-- Logs begin at Thu 2022-05-12 14:11:40 UTC, end at Thu 2022-05-12 16:43:02 UTC. -- May 12 14:52:56.394397 n-d-841483-1 systemd[1]: Started Devstack devstack@q-svc.service. May 12 14:52:58.979543 n-d-841483-1 neutron-server[88046]: INFO neutron.common.config [-] Logging enabled! May 12 14:52:58.980375 n-d-841483-1 neutron-server[88046]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.3.1.dev20 May 12 14:52:58.980466 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=88046) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} May 12 14:52:58.985575 n-d-841483-1 neutron-server[88046]: INFO neutron.common.config [-] Logging enabled! May 12 14:52:58.985575 n-d-841483-1 neutron-server[88046]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.3.1.dev20 May 12 14:52:58.985575 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=88046) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} May 12 14:52:58.985575 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:52:58.985917 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:52:58.986132 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:52:58.986480 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:52:58.986735 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:52:58.987058 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.987506 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.987971 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.988254 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.988699 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.989108 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.989557 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.989864 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.990324 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.990791 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.991236 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.991700 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.992037 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.992345 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] config_source = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.992819 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.993285 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.993694 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] debug = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.994085 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.994529 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.994954 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.995240 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.995531 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.995811 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.996084 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.996470 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.996792 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.997137 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] host = n-d-841483-1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.997436 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.997727 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.998016 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.998305 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.998589 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.998859 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.999143 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.999418 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] log_dir = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:58.999693 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] log_file = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.000648 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.001039 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.001532 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.001830 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.002056 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.002278 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.002570 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.002856 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.003132 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.003406 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.003680 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.003954 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.004228 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.004495 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.004779 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.005060 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.005344 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.005641 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.005930 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.006191 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.006463 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.006745 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.007017 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.007288 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.007557 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.007842 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.008108 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.008378 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.008678 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.008968 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.009246 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.009543 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.009815 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.010103 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.010369 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.010640 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] use_journal = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.010909 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] use_json = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.011178 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.011447 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.011719 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.011989 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.012258 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.012526 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.012796 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.013074 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.013331 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] wsgi_server_debug = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:52:59.013651 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.013945 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.014241 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.014528 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.014816 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.015089 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.016092 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.016514 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.016806 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.017095 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.017405 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.017687 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.017979 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.018255 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.018551 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.018860 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.019154 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.019446 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.019722 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.019998 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.020271 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.020550 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.020844 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.021138 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.021446 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.021723 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.022000 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.022287 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.022562 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.022832 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.023107 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.023392 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.023669 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.023945 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.024217 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.024494 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.024760 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.025026 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.025299 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.025608 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.025881 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.026146 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.026411 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.026683 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.026951 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.027230 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.027761 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.028030 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.028295 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.028567 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.028834 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.029102 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.029371 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.029658 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.029928 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.030193 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.030456 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.030728 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.031009 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.031299 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.031566 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.031837 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.032105 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.032372 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.032640 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.032905 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.033173 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.033462 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.033746 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.034039 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.034312 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.034584 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.034859 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.035133 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.035403 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.035674 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.035946 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.036217 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.036484 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.036773 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.037052 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.037335 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.037638 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.037914 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.038204 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.038477 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.038756 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.039030 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.039310 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.039588 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.039866 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.040153 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.040440 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.040735 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.041025 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.041317 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.041618 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.041926 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.042202 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:52:59.042416 n-d-841483-1 neutron-server[88046]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:52:59.042661 n-d-841483-1 neutron-server[88046]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=88046) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} May 12 14:52:59.435319 n-d-841483-1 neutron-server[88046]: INFO keyring.backend [-] Loading KWallet May 12 14:52:59.443021 n-d-841483-1 neutron-server[88046]: INFO keyring.backend [-] Loading SecretService May 12 14:52:59.446392 n-d-841483-1 neutron-server[88046]: INFO keyring.backend [-] Loading Windows May 12 14:52:59.447659 n-d-841483-1 neutron-server[88046]: INFO keyring.backend [-] Loading chainer May 12 14:52:59.448435 n-d-841483-1 neutron-server[88046]: INFO keyring.backend [-] Loading macOS May 12 14:52:59.481800 n-d-841483-1 neutron-server[88046]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=88046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:59.482070 n-d-841483-1 neutron-server[88046]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=88046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:59.482349 n-d-841483-1 neutron-server[88046]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=88046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:59.482687 n-d-841483-1 neutron-server[88046]: INFO neutron.manager [-] Loading core plugin: ml2 May 12 14:52:59.874036 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.874320 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.874589 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.875957 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.876223 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.876483 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.912008 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.912283 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.912561 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.925689 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.925966 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.926227 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.956050 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.956320 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.956582 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.992718 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.993290 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:52:59.993290 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.234817 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.235103 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.235370 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.235637 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.236382 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.355972 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.356296 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.356581 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.356854 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.357123 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.357465 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.357736 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.357994 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.358250 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.358533 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.358792 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.359054 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.359338 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.359681 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.359856 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.360123 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.360377 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.360644 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.360893 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.361171 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.361542 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.361794 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.362042 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.362323 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.362569 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.362811 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.363199 n-d-841483-1 neutron-server[88046]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=88046) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 12 14:53:00.363435 n-d-841483-1 neutron-server[88046]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=88046) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 12 14:53:00.363671 n-d-841483-1 neutron-server[88046]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=88046) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 12 14:53:00.363902 n-d-841483-1 neutron-server[88046]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=88046) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 12 14:53:00.364135 n-d-841483-1 neutron-server[88046]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=88046) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 12 14:53:00.364368 n-d-841483-1 neutron-server[88046]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=88046) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 12 14:53:00.364730 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] May 12 14:53:00.367803 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] May 12 14:53:00.371677 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete May 12 14:53:00.376212 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(550, 599)])]) May 12 14:53:00.377844 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] May 12 14:53:00.378281 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) May 12 14:53:00.378615 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] May 12 14:53:00.378998 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] May 12 14:53:00.381934 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] May 12 14:53:00.382188 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] May 12 14:53:00.382530 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] May 12 14:53:00.410623 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] May 12 14:53:00.411062 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.411358 n-d-841483-1 neutron-server[88046]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=88046) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} May 12 14:53:00.411718 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.413068 n-d-841483-1 neutron-server[88046]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=88046) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} May 12 14:53:00.413345 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] May 12 14:53:00.413750 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] May 12 14:53:00.416988 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.417267 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.479644 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' May 12 14:53:00.479885 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete May 12 14:53:00.480120 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' May 12 14:53:00.480502 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] May 12 14:53:00.513033 n-d-841483-1 neutron-server[88046]: DEBUG oslo_db.sqlalchemy.engines [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:53:00.846922 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Initializing driver for type 'gre' May 12 14:53:00.847362 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] gre ID ranges: [(1, 1000)] May 12 14:53:00.904284 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Initializing driver for type 'local' May 12 14:53:00.904844 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Initializing driver for type 'vlan' May 12 14:53:00.917468 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] VlanTypeDriver initialization complete May 12 14:53:00.917780 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Initializing driver for type 'vxlan' May 12 14:53:00.918260 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] vxlan ID ranges: [(1, 1000)] May 12 14:53:00.973825 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Initializing extension driver 'port_security' May 12 14:53:00.974272 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.extensions.port_security [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] PortSecurityExtensionDriver initialization complete May 12 14:53:00.974707 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Initializing mechanism driver 'openvswitch' May 12 14:53:00.975148 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Initializing mechanism driver 'hyperv' May 12 14:53:00.981743 n-d-841483-1 neutron-server[88046]: DEBUG neutron.plugins.ml2.plugin [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=88046) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 14:53:00.982408 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > port after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.982771 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > port after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.983118 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > port after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.983645 n-d-841483-1 neutron-server[88046]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=88046) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:111}} May 12 14:53:00.984094 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > subnet after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.984611 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > subnet after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.984969 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > subnet after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.985403 n-d-841483-1 neutron-server[88046]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=88046) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:111}} May 12 14:53:00.985807 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > network after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.986154 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > network after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.986498 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > network after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.986893 n-d-841483-1 neutron-server[88046]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=88046) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:111}} May 12 14:53:00.987297 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > security_group after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.987645 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > security_group after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.987983 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > security_group after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.988376 n-d-841483-1 neutron-server[88046]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=88046) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:111}} May 12 14:53:00.988783 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.989126 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.989490 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.990017 n-d-841483-1 neutron-server[88046]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=88046) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:111}} May 12 14:53:00.990420 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > address_group after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.990774 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > address_group after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.991112 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > address_group after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.991512 n-d-841483-1 neutron-server[88046]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=88046) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:111}} May 12 14:53:00.991958 n-d-841483-1 neutron-server[88046]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] ML2 OVO RPC backend initialized. {{(pid=88046) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:169}} May 12 14:53:00.992672 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router_interface after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.993036 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router_interface after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.993584 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > network before_response 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.993830 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > networks before_response 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.994178 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > port before_response 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.994521 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > ports before_response 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.994864 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > subnet before_response 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.995202 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > subnets before_response 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.995548 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > network after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.995895 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > network after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.996232 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > network after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.996569 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > port after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.996903 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > port after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.997237 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > port after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.997598 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > subnet after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.997935 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > subnet after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.998268 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > subnet after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:00.998844 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.plugin [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Modular L2 Plugin initialization complete May 12 14:53:00.999169 n-d-841483-1 neutron-server[88046]: DEBUG neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading services supported by the core plugin {{(pid=88046) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} May 12 14:53:00.999499 n-d-841483-1 neutron-server[88046]: INFO neutron.plugins.ml2.managers [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Got port-security extension from driver 'port_security' May 12 14:53:01.000573 n-d-841483-1 neutron-server[88046]: INFO neutron.extensions.vlantransparent [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Disabled vlantransparent extension. May 12 14:53:01.001234 n-d-841483-1 neutron-server[88046]: DEBUG neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=88046) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} May 12 14:53:01.001580 n-d-841483-1 neutron-server[88046]: INFO neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading Plugin: router May 12 14:53:01.039158 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router_interface before_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.039546 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router after_create 55549900 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.039912 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router before_create 55549900 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.040276 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router_interface before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.040644 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router_interface after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.040996 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router after_delete 55549900 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.041354 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > floatingip after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.041740 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router after_create 55549900 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.042087 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router after_update 55549900 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.042433 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router after_update 55549900 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.042778 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.043133 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router after_update 55549900 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.043544 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router precommit_update 55549900 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.043912 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: port after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.044251 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: port after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.044588 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: subnet after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.044924 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.045272 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > port precommit_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.045639 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router precommit_create 55549900 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.045979 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: port before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.046318 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router precommit_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.046741 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router after_update 55549900 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.047090 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router precommit_delete 55549900 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.047438 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router precommit_create 55549900 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.047796 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router_interface after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.048138 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router precommit_update 55549900 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.048501 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > agent after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.048854 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > agent after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.049196 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > network after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.050088 n-d-841483-1 neutron-server[88046]: DEBUG neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Tracking information for resource: router configured {{(pid=88046) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 12 14:53:01.050418 n-d-841483-1 neutron-server[88046]: DEBUG neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Tracking information for resource: floatingip configured {{(pid=88046) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 12 14:53:01.055390 n-d-841483-1 neutron-server[88046]: INFO neutron.db.l3_agentschedulers_db [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. May 12 14:53:01.055970 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: port after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.056328 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: port after_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.056674 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: port after_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.057022 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: port after_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.057946 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router before_create 55550100 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.058309 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router precommit_delete 55550100 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.058676 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router precommit_create 55550100 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.059038 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > router precommit_update 55550100 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.064033 n-d-841483-1 neutron-server[88046]: DEBUG neutron.services.provider_configuration [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service providers = [] {{(pid=88046) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} May 12 14:53:01.064399 n-d-841483-1 neutron-server[88046]: DEBUG neutron.db.servicetype_db [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=88046) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} May 12 14:53:01.067332 n-d-841483-1 neutron-server[88046]: DEBUG neutron.services.service_base [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=88046) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 12 14:53:01.067679 n-d-841483-1 neutron-server[88046]: DEBUG neutron.services.service_base [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=88046) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 12 14:53:01.068017 n-d-841483-1 neutron-server[88046]: DEBUG neutron.services.service_base [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=88046) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 12 14:53:01.068911 n-d-841483-1 neutron-server[88046]: DEBUG neutron.services.service_base [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=88046) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 12 14:53:01.069440 n-d-841483-1 neutron-server[88046]: INFO neutron.services.service_base [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Default provider is not specified for service type L3_ROUTER_NAT May 12 14:53:01.069822 n-d-841483-1 neutron-server[88046]: DEBUG neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=88046) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 12 14:53:01.070139 n-d-841483-1 neutron-server[88046]: INFO neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin May 12 14:53:01.081515 n-d-841483-1 neutron-server[88046]: DEBUG neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Successfully loaded METERING plugin. Description: METERING {{(pid=88046) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 12 14:53:01.081856 n-d-841483-1 neutron-server[88046]: INFO neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading Plugin: auto_allocate May 12 14:53:01.087532 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: network precommit_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.087904 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: network precommit_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.088430 n-d-841483-1 neutron-server[88046]: DEBUG neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=88046) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 12 14:53:01.088748 n-d-841483-1 neutron-server[88046]: INFO neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading Plugin: tag May 12 14:53:01.095443 n-d-841483-1 neutron-server[88046]: DEBUG neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=88046) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 12 14:53:01.095766 n-d-841483-1 neutron-server[88046]: INFO neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading Plugin: timestamp May 12 14:53:01.099784 n-d-841483-1 neutron-server[88046]: DEBUG neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=88046) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 12 14:53:01.100067 n-d-841483-1 neutron-server[88046]: INFO neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading Plugin: network_ip_availability May 12 14:53:01.105234 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.105630 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.105989 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.106693 n-d-841483-1 neutron-server[88046]: DEBUG neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=88046) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 12 14:53:01.107014 n-d-841483-1 neutron-server[88046]: INFO neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading Plugin: flavors May 12 14:53:01.111727 n-d-841483-1 neutron-server[88046]: DEBUG neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=88046) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 12 14:53:01.112060 n-d-841483-1 neutron-server[88046]: INFO neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading Plugin: revisions May 12 14:53:01.116278 n-d-841483-1 neutron-server[88046]: DEBUG neutron.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=88046) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 12 14:53:01.116663 n-d-841483-1 neutron-server[88046]: DEBUG oslo_concurrency.lockutils [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.634s {{(pid=88046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:01.117414 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=88046) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} May 12 14:53:01.117759 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Initializing extension manager. May 12 14:53:01.118271 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: __init__.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.118605 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: __pycache__ {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.118936 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.119265 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: address_group.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.120009 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.120571 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: address-group May 12 14:53:01.120892 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: address_scope.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.121625 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.122129 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: address-scope May 12 14:53:01.122446 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: admin_state_down_before_update.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.123368 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.123874 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: router-admin-state-down-before-update May 12 14:53:01.124193 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: agent.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.125444 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.125950 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: agent May 12 14:53:01.126268 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: agent_resources_synced.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.127163 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.127665 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: agent-resources-synced May 12 14:53:01.127984 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: allowedaddresspairs.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.129990 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.130496 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: allowed-address-pairs May 12 14:53:01.130827 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: auto_allocated_topology.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.131883 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.132395 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: auto-allocated-topology May 12 14:53:01.132722 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: availability_zone.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.133433 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.133942 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: availability_zone May 12 14:53:01.134265 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: availability_zone_filter.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.135170 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.135971 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: availability_zone_filter May 12 14:53:01.135971 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: data_plane_status.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.136877 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.137377 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension data-plane-status not supported by any of loaded plugins May 12 14:53:01.137720 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: default_subnetpools.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.138627 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.139137 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: default-subnetpools May 12 14:53:01.139463 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: dhcpagentscheduler.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.140259 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.141356 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: dhcp_agent_scheduler May 12 14:53:01.141802 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: dns.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.142704 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.143207 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension dns-integration not supported by any of loaded plugins May 12 14:53:01.143530 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: dns_domain_ports.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.144434 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.144932 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension dns-domain-ports not supported by any of loaded plugins May 12 14:53:01.145255 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: dvr.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.145953 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.146451 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: dvr May 12 14:53:01.146767 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: empty_string_filtering.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.147679 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.148181 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: empty-string-filtering May 12 14:53:01.148503 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.149406 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.149927 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins May 12 14:53:01.150245 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.151149 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.151651 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins May 12 14:53:01.151970 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: external_net.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.153133 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.153667 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: external-net May 12 14:53:01.153987 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: extra_dhcp_opt.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.154889 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.155393 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: extra_dhcp_opt May 12 14:53:01.155710 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: extraroute.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.156855 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.157362 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: extraroute May 12 14:53:01.157710 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: extraroute_atomic.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.158742 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.159250 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: extraroute-atomic May 12 14:53:01.159568 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: filter_validation.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.160224 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.160725 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: filter-validation May 12 14:53:01.161042 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: fip_pf_description.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.161975 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.162472 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins May 12 14:53:01.162790 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: fip_port_details.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.163698 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.164198 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: fip-port-details May 12 14:53:01.164518 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: flavors.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.165756 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.166273 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: flavors May 12 14:53:01.166597 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.168240 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.168762 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins May 12 14:53:01.169092 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: floatingip_pools.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.169816 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.170324 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: floatingip-pools May 12 14:53:01.170646 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: ip_allocation.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.171657 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.172359 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension ip_allocation not supported by any of loaded plugins May 12 14:53:01.172688 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: ip_substring_port_filtering.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.173736 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.174192 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: ip-substring-filtering May 12 14:53:01.174576 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: l2_adjacency.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.175506 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.176008 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension l2_adjacency not supported by any of loaded plugins May 12 14:53:01.176330 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: l3.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.177299 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.177849 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: router May 12 14:53:01.178173 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: l3_conntrack_helper.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.180556 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.181120 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension l3-conntrack-helper not supported by any of loaded plugins May 12 14:53:01.181498 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: l3_ext_gw_mode.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.182429 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.182981 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: ext-gw-mode May 12 14:53:01.183265 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: l3_ext_ha_mode.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.184177 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.184686 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: l3-ha May 12 14:53:01.185007 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: l3_flavors.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.185950 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.186452 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: l3-flavors May 12 14:53:01.186771 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.188215 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.188717 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: l3-port-ip-change-not-allowed May 12 14:53:01.189032 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: l3agentscheduler.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.190152 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.190663 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: l3_agent_scheduler May 12 14:53:01.190986 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: logging.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.192505 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.193023 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension logging not supported by any of loaded plugins May 12 14:53:01.193355 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: metering.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.194121 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.194701 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: metering May 12 14:53:01.195033 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.196129 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.196646 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: metering_source_and_destination_fields May 12 14:53:01.196973 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: multiprovidernet.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.197913 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.198420 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: multi-provider May 12 14:53:01.198744 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: netmtu.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.199654 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.200161 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: net-mtu May 12 14:53:01.200482 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: netmtu_writable.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.201407 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.201926 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: net-mtu-writable May 12 14:53:01.202249 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: network_availability_zone.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.203573 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.204073 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: network_availability_zone May 12 14:53:01.204395 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: network_ip_availability.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.205511 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.206017 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: network-ip-availability May 12 14:53:01.206341 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: network_segment_range.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.207096 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.207595 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension network-segment-range not supported by any of loaded plugins May 12 14:53:01.207916 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: pagination.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.208876 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.209205 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: pagination May 12 14:53:01.209567 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: port_device_profile.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.210476 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.210986 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: port-device-profile May 12 14:53:01.211306 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: port_mac_address_regenerate.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.212214 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.212717 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: port-mac-address-regenerate May 12 14:53:01.213035 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: port_numa_affinity_policy.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.213972 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.214479 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: port-numa-affinity-policy May 12 14:53:01.214798 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: port_resource_request.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.215691 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.216189 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension port-resource-request not supported by any of loaded plugins May 12 14:53:01.216508 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: portbindings.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.217447 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.217953 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: binding May 12 14:53:01.218270 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: portbindings_extended.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.219705 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.220216 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: binding-extended May 12 14:53:01.220539 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: portsecurity.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.221462 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.221970 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: port-security May 12 14:53:01.222294 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: project_id.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.223250 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.223577 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: project-id May 12 14:53:01.223898 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: providernet.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.224803 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.225311 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: provider May 12 14:53:01.225669 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: qos.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.229318 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.229868 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension qos not supported by any of loaded plugins May 12 14:53:01.230198 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: qos_bw_limit_direction.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.231437 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.231953 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension qos-bw-limit-direction not supported by any of loaded plugins May 12 14:53:01.232292 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.233194 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.233725 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins May 12 14:53:01.234048 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: qos_default.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.234982 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.235486 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension qos-default not supported by any of loaded plugins May 12 14:53:01.235807 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: qos_fip.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.236448 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.236944 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension qos-fip not supported by any of loaded plugins May 12 14:53:01.237261 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: qos_gateway_ip.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.238193 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.238696 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension qos-gateway-ip not supported by any of loaded plugins May 12 14:53:01.239014 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: qos_port_network_policy.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.239922 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.240419 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension qos-port-network-policy not supported by any of loaded plugins May 12 14:53:01.240738 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: qos_rule_type_details.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.241668 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.242168 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension qos-rule-type-details not supported by any of loaded plugins May 12 14:53:01.242490 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: qos_rules_alias.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.243515 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.244019 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension qos-rules-alias not supported by any of loaded plugins May 12 14:53:01.244339 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: quotasv2.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.245267 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.245620 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: quotas May 12 14:53:01.245938 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: quotasv2_detail.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.247514 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.247859 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: quota_details May 12 14:53:01.248186 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: rbac.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.249238 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.250415 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: rbac-policies May 12 14:53:01.250922 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: rbac_address_group.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.251720 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.252229 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: rbac-address-group May 12 14:53:01.252557 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: rbac_address_scope.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.253494 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.254007 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: rbac-address-scope May 12 14:53:01.254329 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: rbac_security_groups.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.255238 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.255746 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: rbac-security-groups May 12 14:53:01.256068 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: rbac_subnetpool.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.256971 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.257501 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: rbac-subnetpool May 12 14:53:01.257824 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: revisionifmatch.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.258753 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.259265 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: revision-if-match May 12 14:53:01.259586 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: revisions.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.260687 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.261194 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: standard-attr-revisions May 12 14:53:01.261548 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: router_availability_zone.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.262218 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.262724 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: router_availability_zone May 12 14:53:01.263043 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: routerservicetype.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.263957 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.264465 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension router-service-type not supported by any of loaded plugins May 12 14:53:01.264787 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.266336 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.266891 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: security-groups-normalized-cidr May 12 14:53:01.267212 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: security_groups_port_filtering.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.268262 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.268774 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: port-security-groups-filtering May 12 14:53:01.269099 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: security_groups_remote_address_group.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.270045 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.270553 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: security-groups-remote-address-group May 12 14:53:01.270871 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: securitygroup.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.280638 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.281228 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: security-group May 12 14:53:01.281640 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: segment.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.282433 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.282941 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension segment not supported by any of loaded plugins May 12 14:53:01.283266 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.284193 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.284696 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins May 12 14:53:01.285017 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: servicetype.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.286145 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.286664 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: service-type May 12 14:53:01.286987 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: sorting.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.287964 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.288292 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: sorting May 12 14:53:01.288612 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: standard_attr_segment.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.289557 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.290063 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension standard-attr-segment not supported by any of loaded plugins May 12 14:53:01.290382 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: standardattrdescription.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.291021 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.291525 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: standard-attr-description May 12 14:53:01.291843 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: stateful_security_group.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.292759 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.293271 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: stateful-security-group May 12 14:53:01.293616 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: stdattrs_common.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.294206 n-d-841483-1 neutron-server[88046]: WARNING neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py May 12 14:53:01.294528 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.295529 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.296042 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins May 12 14:53:01.296361 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: subnet_onboard.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.297486 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.298005 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: subnet_onboard May 12 14:53:01.298330 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: subnet_segmentid_writable.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.299258 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.299772 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension subnet-segmentid-writable not supported by any of loaded plugins May 12 14:53:01.300095 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: subnet_service_types.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.301010 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.301557 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: subnet-service-types May 12 14:53:01.301883 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: subnetallocation.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.302956 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.303463 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: subnet_allocation May 12 14:53:01.303786 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.304441 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.304945 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: subnetpool-prefix-ops May 12 14:53:01.305264 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.306204 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.306710 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins May 12 14:53:01.307029 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: tagging.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.308085 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.308599 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: standard-attr-tag May 12 14:53:01.308925 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: timestamp.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.310151 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.310660 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loaded extension: standard-attr-timestamp May 12 14:53:01.310984 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: trunk.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.312003 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.313126 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension trunk not supported by any of loaded plugins May 12 14:53:01.313646 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: trunk_details.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.314570 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.315079 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension trunk-details not supported by any of loaded plugins May 12 14:53:01.315399 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: uplink_status_propagation.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.316324 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.316831 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension uplink-status-propagation not supported by any of loaded plugins May 12 14:53:01.317150 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Loading extension file: vlantransparent.py {{(pid=88046) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 12 14:53:01.317844 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=88046) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 12 14:53:01.318348 n-d-841483-1 neutron-server[88046]: INFO neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extension vlan-transparent not supported by any of loaded plugins May 12 14:53:01.320753 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:network May 12 14:53:01.321521 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:subnet May 12 14:53:01.323455 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:subnetpool May 12 14:53:01.324069 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:port May 12 14:53:01.325318 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.v2.resource_helper [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=88046) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 12 14:53:01.325791 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.v2.resource_helper [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service FLAVORS assigned prefix: {{(pid=88046) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 12 14:53:01.326409 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.v2.resource_helper [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=88046) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 12 14:53:01.326828 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.v2.resource_helper [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=88046) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 12 14:53:01.327161 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:router May 12 14:53:01.327839 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:floatingip May 12 14:53:01.329242 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.v2.resource_helper [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service METERING assigned prefix: /metering {{(pid=88046) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 12 14:53:01.330749 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.331119 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.331474 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=88046) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 14:53:01.332595 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of CountableResource for resource:rbac_policy May 12 14:53:01.333038 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:security_group May 12 14:53:01.333748 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:security_group_rule May 12 14:53:01.334470 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.v2.resource_helper [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service CORE assigned prefix: {{(pid=88046) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 12 14:53:01.334802 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:subnetpool May 12 14:53:01.335137 n-d-841483-1 neutron-server[88046]: WARNING neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] subnetpool is already registered May 12 14:53:01.335748 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.v2.resource_helper [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service CORE assigned prefix: {{(pid=88046) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 12 14:53:01.336078 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:subnetpool May 12 14:53:01.336404 n-d-841483-1 neutron-server[88046]: WARNING neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] subnetpool is already registered May 12 14:53:01.338988 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.v2.resource_helper [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=88046) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 12 14:53:01.339425 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.v2.resource_helper [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service FLAVORS assigned prefix: {{(pid=88046) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 12 14:53:01.340012 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.v2.resource_helper [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=88046) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 12 14:53:01.340430 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.v2.resource_helper [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=88046) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 12 14:53:01.340764 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:router May 12 14:53:01.341093 n-d-841483-1 neutron-server[88046]: WARNING neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] router is already registered May 12 14:53:01.341709 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:floatingip May 12 14:53:01.342037 n-d-841483-1 neutron-server[88046]: WARNING neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] floatingip is already registered May 12 14:53:01.342658 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.v2.resource_helper [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service METERING assigned prefix: /metering {{(pid=88046) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 12 14:53:01.343314 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of CountableResource for resource:rbac_policy May 12 14:53:01.343663 n-d-841483-1 neutron-server[88046]: WARNING neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] rbac_policy is already registered May 12 14:53:01.344201 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:security_group May 12 14:53:01.344521 n-d-841483-1 neutron-server[88046]: WARNING neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] security_group is already registered May 12 14:53:01.345102 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:security_group_rule May 12 14:53:01.345455 n-d-841483-1 neutron-server[88046]: WARNING neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] security_group_rule is already registered May 12 14:53:01.346121 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.v2.resource_helper [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service CORE assigned prefix: {{(pid=88046) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 12 14:53:01.346451 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:subnetpool May 12 14:53:01.346775 n-d-841483-1 neutron-server[88046]: WARNING neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] subnetpool is already registered May 12 14:53:01.347381 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.v2.resource_helper [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Service CORE assigned prefix: {{(pid=88046) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 12 14:53:01.347707 n-d-841483-1 neutron-server[88046]: INFO neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Creating instance of TrackedResource for resource:subnetpool May 12 14:53:01.348031 n-d-841483-1 neutron-server[88046]: WARNING neutron.quota.resource_registry [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] subnetpool is already registered May 12 14:53:01.348670 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: extensions {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.350217 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: address-groups {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.351781 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: address-scopes {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.353003 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: agents {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.354180 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: auto-allocated-topology {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.355491 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: availability_zones {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.356791 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: dhcp-networks {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.358237 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: dhcp-agents {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.360196 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: routers {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.362026 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: flavors {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.363187 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: service_profiles {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.364378 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: next_providers {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.365952 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: service_profiles {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.367405 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: floatingip-pools {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.368614 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: routers {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.370447 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: floatingips {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.371648 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: l3-routers {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.373009 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: l3-agents {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.374474 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: metering-labels {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.376448 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: metering-label-rules {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.377751 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: network-ip-availabilities {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.379018 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: bindings {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.380656 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: quotas {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.382119 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: quotas {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.383524 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: rbac-policies {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.384856 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: security-groups {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.386084 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: security-group-rules {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.387345 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: service-providers {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.388556 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: subnetpools {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.391591 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: subnetpools {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.393085 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: tags {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.394795 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: tags {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.509667 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: tags {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.511467 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: tags {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.513271 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: tags {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.515281 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: tags {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.517180 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: tags {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.519119 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: tags {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.520872 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: tags {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.522757 n-d-841483-1 neutron-server[88046]: DEBUG neutron.api.extensions [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Extended resource: tags {{(pid=88046) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 12 14:53:01.528870 n-d-841483-1 neutron-server[88046]: WARNING keystonemiddleware.auth_token [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:53:01.533807 n-d-841483-1 neutron-server[88046]: WARNING keystonemiddleware.auth_token [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:53:01.542021 n-d-841483-1 neutron-server[88046]: DEBUG oslo_concurrency.lockutils [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Acquired lock "singleton_lock" {{(pid=88046) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 12 14:53:01.542497 n-d-841483-1 neutron-server[88046]: DEBUG oslo_concurrency.lockutils [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Releasing lock "singleton_lock" {{(pid=88046) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 12 14:53:01.543117 n-d-841483-1 neutron-server[88046]: INFO oslo_service.service [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Starting 2 workers May 12 14:53:01.548368 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Started child 88151 {{(pid=88046) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 12 14:53:01.552613 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Started child 88152 {{(pid=88046) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 12 14:53:01.553615 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:01.554218 n-d-841483-1 neutron-server[88046]: INFO neutron.service [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Neutron service started, listening on 0.0.0.0:9696 May 12 14:53:01.554883 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Notify callbacks [] for process, before_spawn {{(pid=88046) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:01.555117 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [-] (88151) wsgi starting up on http://0.0.0.0:9696 May 12 14:53:01.557180 n-d-841483-1 neutron-server[88046]: INFO oslo_service.service [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Starting 1 workers May 12 14:53:01.557351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:01.558659 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [-] (88152) wsgi starting up on http://0.0.0.0:9696 May 12 14:53:01.562288 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Started child 88153 {{(pid=88046) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 12 14:53:01.563260 n-d-841483-1 neutron-server[88046]: INFO oslo_service.service [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Starting 1 workers May 12 14:53:01.566610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.service [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] calling RpcWorker wait() {{(pid=88153) _wait /opt/stack/neutron/neutron/service.py:128}} May 12 14:53:01.567186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.service [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] returning from RpcWorker wait() {{(pid=88153) _wait /opt/stack/neutron/neutron/service.py:135}} May 12 14:53:01.567529 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Started child 88154 {{(pid=88046) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 12 14:53:01.568320 n-d-841483-1 neutron-server[88046]: DEBUG neutron_lib.callbacks.manager [None req-12798528-2c14-4e13-9e84-c07e3cca67ad None None] Notify callbacks [] for process, after_spawn {{(pid=88046) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:01.568539 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:01.569039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 14:53:01.570173 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=88046) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 12 14:53:01.570378 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:53:01.570727 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:53:01.570826 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:53:01.574266 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:53:01.574266 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:53:01.574266 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.574266 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.574266 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.574709 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:01.575158 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.575158 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.575158 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.575158 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.575158 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.575158 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.575158 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.575676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39782) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:53:01.575760 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.575760 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.575760 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.575760 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.575760 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.576144 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.576144 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.576442 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.576616 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.576878 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] config_source = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.577152 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.577434 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.577698 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] debug = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.578491 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.579337 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.579337 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.579639 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.579639 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.579894 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.580081 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.580346 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.580577 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.580790 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.581007 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.581261 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.581546 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.581761 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.581995 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.582247 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.582462 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.582941 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] host = n-d-841483-1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.583156 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.583404 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.584168 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.584168 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.584648 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [-] 10.222.0.82 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0070958 May 12 14:53:01.584777 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.584777 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.584777 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.585219 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.585219 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.585546 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.585686 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.587210 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.587210 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_dir = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.587210 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_file = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.587661 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_options = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.587661 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.587925 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.588064 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.588313 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.588491 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.588634 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.588801 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.588967 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.589213 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.589438 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.589657 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.590659 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.590659 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.590659 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.590659 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.591211 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.591211 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.591496 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.591496 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.591760 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.591908 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.592139 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.592892 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.592892 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.592892 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.593314 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.593314 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.594427 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.594427 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.594809 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.594809 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.595091 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.595258 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.595480 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.595628 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.595849 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.596078 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.596339 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.596565 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.596835 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.597052 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.597376 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.597621 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.597852 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.598077 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] use_journal = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.598287 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] use_json = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.598555 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.598702 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.598945 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.599517 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.599517 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.600020 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.600020 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.600020 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.600610 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] wsgi_server_debug = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.600610 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.600915 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.601250 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.601505 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.601651 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.601911 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.602285 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.602443 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.602582 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.602815 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.604297 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.605238 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.605581 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.605832 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.606120 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.607259 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.607546 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.608143 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.608841 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.609139 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.611332 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.611503 n-d-841483-1 neutron-server[88154]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 14:53:01.611652 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.612891 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.613151 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.613470 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.82/identity {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.613756 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.614025 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.615262 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.615262 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.615455 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.617427 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.617427 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.617427 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.617427 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.617427 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.617427 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.617427 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.617427 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.617427 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.617997 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.617997 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.618133 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.618506 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.618607 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.618751 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.619313 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.619313 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.619481 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.619635 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.619860 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.620083 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.620320 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.621292 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.621292 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.621292 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.621292 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.621643 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.621643 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.621913 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.622070 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.622268 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.622534 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.623961 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.623961 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.623961 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.623961 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.623961 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.623961 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.624370 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.624370 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.624642 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.624788 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.624953 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.625201 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.625498 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.625641 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.625791 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.625982 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.627231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.627231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.627231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.627231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.627231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.627231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.628101 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.628101 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.628101 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.628524 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.628524 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.628757 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.628997 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.629256 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.629810 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.629810 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.630055 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.630227 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.630663 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.631087 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.631490 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.631882 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.632293 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.632672 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.633176 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.633650 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.634085 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.634318 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.634949 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.634949 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.635135 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.635322 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.635586 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.636422 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.636422 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.636422 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.636614 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.636846 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.637135 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.637429 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.637684 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.637940 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.638197 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.638470 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.638722 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.638961 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.639220 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.639465 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.639684 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.639992 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.640249 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.641076 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.641466 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.641646 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.642097 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.642491 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.642846 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.643291 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.643705 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.644118 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.644534 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.644978 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.645418 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.645937 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.646358 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.646763 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.82/identity {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.647150 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.647565 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.647973 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.648192 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.648428 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.648645 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.648926 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.649116 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.650436 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.650436 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.650436 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.650436 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.650436 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.650796 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.650796 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.650925 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.653417 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.653417 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.653417 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.653417 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.653417 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.653417 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.653417 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.653417 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.653956 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.653956 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.653956 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.653956 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.654191 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.654442 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.654647 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.654856 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.655121 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.655351 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.655594 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.655822 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.656615 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.656827 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.657374 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.657374 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.657645 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.657920 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.658171 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.658501 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.658749 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.659030 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.659240 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.dead_timeout = 60.0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.659487 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.659698 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.enable_retry_client = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.659939 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.enable_socket_keepalive = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.661447 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.661447 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.661447 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.hashclient_retry_attempts = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.661447 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.hashclient_retry_delay = 1.0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.661447 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.661447 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.661447 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.662872 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.662872 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.662872 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.662872 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.662872 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.662872 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.retry_attempts = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.663500 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.retry_delay = 0.0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.663500 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.socket_keepalive_count = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.663500 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.socket_keepalive_idle = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.663730 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.socket_keepalive_interval = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.663879 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.664089 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.664297 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.664542 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.664835 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.665131 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.665376 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.666521 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.666761 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.666988 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.667227 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.667434 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.667675 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.667886 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.668096 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.668318 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.668519 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.668888 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.669101 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.669501 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.669938 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.670188 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.670405 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.670678 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.670919 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.671158 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.671427 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.671928 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.672475 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.672475 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.672684 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.673069 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.673560 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.673970 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.674419 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.674843 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.675246 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.675627 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.675914 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.676195 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:550:599'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.676457 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.676840 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.677297 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.677663 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.677936 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.678550 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.678550 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.678712 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.678941 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.679178 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.679393 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.679627 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.679841 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.680103 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.680340 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.680580 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.680810 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.681029 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.681242 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.681505 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.682172 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.682172 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.682172 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.682396 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:53:01.682809 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=88046) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 12 14:53:01.682960 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:53:01.683262 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:53:01.683428 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:53:01.684704 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:53:01.684704 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:53:01.684704 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.684704 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.684704 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.684704 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.684704 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.685350 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.685350 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.685350 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.685350 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.685350 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.685716 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.685716 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.685833 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.686043 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.686191 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.686333 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.686464 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.686628 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.686791 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.686978 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] config_source = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.687139 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.687321 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.687474 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] debug = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.687627 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.687824 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.687981 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.688134 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.688285 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.688437 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.689278 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.689278 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.689278 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.689278 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.689278 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.689278 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.690052 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.690052 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.690052 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.690052 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.691243 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.691243 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] host = n-d-841483-1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.691243 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.691243 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.691243 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.691243 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.691243 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.691243 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.692488 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.692488 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.692488 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.692488 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.692923 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.692923 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.693949 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_dir = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.693949 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_file = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.694123 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_options = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.694123 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.694355 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.694449 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.694650 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.694827 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.694994 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.695151 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.695316 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.695503 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.695661 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.695823 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.695972 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.696116 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.696263 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.696395 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.696554 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.696714 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.696865 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.697023 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.697182 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.697341 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.697582 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.697740 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.697897 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.698054 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.698209 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.698364 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.698519 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.698675 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.698853 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.698988 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.699145 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.699302 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.699450 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.699608 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.699763 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.699919 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.700078 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.700234 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.700389 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.700545 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.700700 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.700856 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.701011 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.701167 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] use_journal = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.701468 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] use_json = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.701629 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.701784 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.701934 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.702092 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.702240 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.702390 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.702694 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.703629 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.703943 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] wsgi_server_debug = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:53:01.704282 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.704634 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.704816 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.704981 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.705144 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.705306 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.705564 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.706389 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.706389 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.706389 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.706389 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.706389 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.706691 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.706691 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.706825 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.707026 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.707116 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.707264 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.707264 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.707264 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.707264 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.707264 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.707264 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.707264 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.708611 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.82/identity {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.708611 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.708611 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.708780 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.708990 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.709080 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.709224 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.709366 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.709557 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.709695 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.709828 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.710081 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.710081 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.710334 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.710463 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.710589 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.710681 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.710821 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.710981 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.711141 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.711305 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.711571 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.711740 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.711862 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.712026 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.712184 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.712431 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.712551 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.712665 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.712802 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.712960 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.713117 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.713276 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.713452 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.714332 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.714332 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.714332 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.714332 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.714332 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.714793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 14:53:01.714902 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.714902 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.714902 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.714902 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.716231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.716231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.716231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.716231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.716231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.716231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.716231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.716231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.716231 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.717767 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.717767 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.717767 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.717767 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.717767 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.717767 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.717767 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.717767 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.717767 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.719198 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.719198 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.719198 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.719198 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.719198 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.719198 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.719746 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.719746 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.719746 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.720040 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.720040 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.720229 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.720330 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.720476 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.720613 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.720748 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.720893 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.721029 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.721165 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.721299 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.721487 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.721724 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.721888 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.722030 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.722184 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.722343 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.722481 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.722640 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.722803 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.722945 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.723117 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.723288 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.723430 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.723594 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.723744 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.723900 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.724062 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.724214 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.724350 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.724510 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.724652 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.724815 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.724984 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.725155 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.725298 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.725486 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.725630 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.726640 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.726640 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.726640 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.726640 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.726640 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.726640 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.727430 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.727430 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.727430 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.727430 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.727430 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.727430 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.82/identity {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.728166 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.728166 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.728166 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.728166 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.728166 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.728812 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.728812 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.728812 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.728812 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.729310 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.729310 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.729310 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.729310 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.729915 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.729915 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.729915 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.729915 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.730412 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.730412 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.730412 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.730809 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.730809 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.730809 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.731185 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.731185 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.731440 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.731440 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.731697 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.731841 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.731967 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.732101 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.732284 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.732454 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.732606 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.732753 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.732899 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.733043 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.733200 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.733343 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.733542 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.733701 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.733848 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.733991 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.734275 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.734411 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.734891 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.734891 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.dead_timeout = 60.0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.734891 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.735110 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.enable_retry_client = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.735177 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.enable_socket_keepalive = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.735335 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.735432 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.735598 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.hashclient_retry_attempts = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.735767 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.hashclient_retry_delay = 1.0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.735908 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.736058 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.736195 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.736328 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.736475 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.736637 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.736800 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.736966 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.737124 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.retry_attempts = 2 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.737285 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.retry_delay = 0.0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.737477 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.socket_keepalive_count = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.737628 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.socket_keepalive_idle = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.737765 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.socket_keepalive_interval = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.737929 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.738073 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.738233 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.738375 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.738535 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.739255 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.739255 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.739255 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.739255 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.739802 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.739802 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.739802 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.740907 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.740907 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.740907 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.740907 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.740907 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.740907 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.740907 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.740907 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.741985 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.741985 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.741985 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.741985 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.741985 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.741985 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.743241 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.743241 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.743241 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.743241 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.743241 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.743241 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.743241 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.743241 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.744245 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.744245 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.744245 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.744245 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.744245 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.744245 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:550:599'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.744245 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.744881 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.744881 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.744881 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.744881 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.745130 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.745130 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.745245 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.745355 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.746158 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.746326 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.746486 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.746647 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.746812 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.746971 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.747129 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.747289 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.747449 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.747608 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.747769 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.747930 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.748089 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.748248 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:53:01.748401 n-d-841483-1 neutron-server[88046]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=88046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:53:12.639749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf3e6e58-5abf-427e-988c-01f5e48db20e None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 14:53:12.716859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf3e6e58-5abf-427e-988c-01f5e48db20e None None] No non-hosted networks {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} May 12 14:53:12.730349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.agentschedulers_db [None req-cf3e6e58-5abf-427e-988c-01f5e48db20e None None] DHCP Agent not found on host n-d-841483-1 {{(pid=88153) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:454}} May 12 14:53:12.795641 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1cc773f8-e576-48c7-9bc5-e21b536fa0cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3784235'] for agent, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:14.720759 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3f29943c-a4ee-4a03-9bf3-3aea078ef5c7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3784235'] for agent, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:14.764861 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7efcb2eb-5cd5-434e-a7bc-fe02b9e1763a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:15.913766 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3784235'] for agent, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:15.914735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:15.915240 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:15.915849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:15.916373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:15.918279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:15.918708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:15.919197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:15.919637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:15.920046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:15.920460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:15.921043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:15.921807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:15.922291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'n-d-841483-1', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 14:53:15.928787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'n-d-841483-1', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 14:53:15.998255 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3784235'] for agent, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:17.432386 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3784235'] for agent, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:19.136445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39888) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:53:19.769341 n-d-841483-1 neutron-server[88151]: WARNING oslo_policy.policy [None req-c6b68786-1358-4450-a9e9-c0ba5d593a07 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 12 14:53:19.769982 n-d-841483-1 neutron-server[88151]: WARNING oslo_policy.policy [None req-c6b68786-1358-4450-a9e9-c0ba5d593a07 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 12 14:53:19.937462 n-d-841483-1 neutron-server[88153]: INFO neutron.db.l3_hamode_db [None req-61c63e30-4fa4-416d-b527-3a671140561b None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 May 12 14:53:19.991935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-c6b68786-1358-4450-a9e9-c0ba5d593a07 admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 14:53:19.993029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c6b68786-1358-4450-a9e9-c0ba5d593a07 admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.8556311 May 12 14:53:20.022175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61c63e30-4fa4-416d-b527-3a671140561b None None] Routers set() bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 14:53:20.022555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61c63e30-4fa4-416d-b527-3a671140561b None None] Router IDs set() for agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:465}} May 12 14:53:22.401103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39902) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:53:22.981217 n-d-841483-1 neutron-server[88152]: WARNING oslo_policy.policy [None req-ef9cccf3-f8b1-4561-806d-406fb7996f0c admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 12 14:53:22.981824 n-d-841483-1 neutron-server[88152]: WARNING oslo_policy.policy [None req-ef9cccf3-f8b1-4561-806d-406fb7996f0c admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 12 14:53:23.195886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ef9cccf3-f8b1-4561-806d-406fb7996f0c admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26, 'is_default': True, 'name': 'shared-default-subnetpool-v4', 'shared': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 14:53:23.289283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.policy [None req-ef9cccf3-f8b1-4561-806d-406fb7996f0c admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=88152) register_rules /opt/stack/neutron/neutron/policy.py:73}} May 12 14:53:23.334155 n-d-841483-1 neutron-server[88152]: WARNING oslo_policy.policy [None req-ef9cccf3-f8b1-4561-806d-406fb7996f0c admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 12 14:53:23.334514 n-d-841483-1 neutron-server[88152]: WARNING oslo_policy.policy [None req-ef9cccf3-f8b1-4561-806d-406fb7996f0c admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 12 14:53:23.342704 n-d-841483-1 neutron-server[88152]: INFO neutron.quota [None req-ef9cccf3-f8b1-4561-806d-406fb7996f0c admin admin] Loaded quota_driver: . May 12 14:53:23.357933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ef9cccf3-f8b1-4561-806d-406fb7996f0c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 14:53:23.418164 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ef9cccf3-f8b1-4561-806d-406fb7996f0c admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8768026125822', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8768026126093', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8768026139343', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8768026142356', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8768026089719', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8768026091911', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-784117', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3643851', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-495821', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-448448'] for rbac-policy, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:23.482132 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ef9cccf3-f8b1-4561-806d-406fb7996f0c admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:23.483619 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ef9cccf3-f8b1-4561-806d-406fb7996f0c admin admin] 10.222.0.82 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 1.0802183 May 12 14:53:26.158447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39920) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:53:26.505964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Request body: {'network': {'project_id': '1b536d11fcc14a36a7b3c15ffe979375', 'name': 'private', 'admin_state_up': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 14:53:26.507427 n-d-841483-1 neutron-server[88151]: INFO neutron.quota [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Loaded quota_driver: . May 12 14:53:26.523465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 14:53:26.530124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Usage tracker for resource:network and tenant:1b536d11fcc14a36a7b3c15ffe979375 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 14:53:26.536107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 14:53:26.543670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 14:53:26.559088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Made reservation on behalf of 1b536d11fcc14a36a7b3c15ffe979375 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 14:53:26.630046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.policy [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=88151) register_rules /opt/stack/neutron/neutron/policy.py:73}} May 12 14:53:26.677148 n-d-841483-1 neutron-server[88151]: WARNING oslo_policy.policy [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 12 14:53:26.677537 n-d-841483-1 neutron-server[88151]: WARNING oslo_policy.policy [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 12 14:53:26.688116 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:26.708528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:26.724081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 14:53:26.727716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Usage tracker for resource:security_group_rule and tenant:1b536d11fcc14a36a7b3c15ffe979375 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 14:53:26.732774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 14:53:26.738227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 14:53:26.841286 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:26.845511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:26.868457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 591} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 14:53:26.899229 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8768026983033', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:26.899740 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Unsubscribe: segment precommit_create {{(pid=88151) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} May 12 14:53:26.900233 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Added segment 07ca6a5e-db99-408c-abd5-7f799d2facfa of type vlan for network 4451f5be-7146-498e-8ac1-6200c0f0705c May 12 14:53:26.954597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4eab784f-18b8-4c4d-b2be-7c4376b0780a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:26.976993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:26.977326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:26.977686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:26.978015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:26.978341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:26.978663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:26.978979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:26.979293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:26.979609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:26.979922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:26.980234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:26.980545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Tracked resource versions report: May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: pushed versions: May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: { 'AddressGroup': {'1.2'}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'ConntrackHelper': {'1.0'}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'Log': {'1.0'}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'Network': {'1.1'}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'Port': {'1.7'}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'PortForwarding': {'1.2'}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'QosPolicy': {'1.8'}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'SecurityGroup': {'1.4'}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'SecurityGroupRule': {'1.2'}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'SubPort': {'1.0'}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'Subnet': {'1.1'}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'Trunk': {'1.1'}} May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: consumer versions: May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: { DHCP agent@n-d-841483-1: {}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: L3 agent@n-d-841483-1: {}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: Metadata agent@n-d-841483-1: {}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: Metering agent@n-d-841483-1: {}, May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: Open vSwitch agent@n-d-841483-1: { 'AddressGroup': '1.2', May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'ConntrackHelper': '1.0', May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'Log': '1.0', May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'Network': '1.1', May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'Port': '1.7', May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'PortForwarding': '1.2', May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'QosPolicy': '1.8', May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'SecurityGroup': '1.4', May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'SecurityGroupRule': '1.2', May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'SubPort': '1.0', May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'Subnet': '1.1', May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: 'Trunk': '1.1'}} May 12 14:53:26.981671 n-d-841483-1 neutron-server[88151]: {{(pid=88151) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 12 14:53:27.019507 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:27.061595 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:27.062831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:53:27.064090 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:27.175062 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 1.0153289 May 12 14:53:27.175807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbe1f4dd-e010-4ae3-88ce-5dbbee265128 admin admin] Pushing event updated for resources: {'Network': ['ID=4451f5be-7146-498e-8ac1-6200c0f0705c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:27.189669 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 4451f5be-7146-498e-8ac1-6200c0f0705c details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 14:53:29.935962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39938) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:53:30.388433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f07e8a3-cf51-4a81-bb49-bf048a47439c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:53:30.389739 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1f07e8a3-cf51-4a81-bb49-bf048a47439c admin admin] 10.222.0.82 "GET /v2.0/networks/4451f5be-7146-498e-8ac1-6200c0f0705c HTTP/1.1" status: 200 len: 825 time: 0.4528201 May 12 14:53:30.419918 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c91d85f0-7f96-4ab3-b4ef-ddc373eca7c7 admin admin] 10.222.0.82 "GET /v2.0/subnetpools/5bc2062c-8513-47d7-9534-dd9c9d2c7f38 HTTP/1.1" status: 200 len: 734 time: 0.0247550 May 12 14:53:30.428735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Request body: {'subnet': {'subnetpool_id': '5bc2062c-8513-47d7-9534-dd9c9d2c7f38', 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c', 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375', 'name': 'private-subnet', 'gateway_ip': '172.20.0.1', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 14:53:30.433200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 14:53:30.437064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Usage tracker for resource:subnet and tenant:1b536d11fcc14a36a7b3c15ffe979375 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 14:53:30.440449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 14:53:30.451390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 14:53:30.461421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Made reservation on behalf of 1b536d11fcc14a36a7b3c15ffe979375 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 14:53:30.463750 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Notify callbacks [] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:30.740948 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:30.824194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=37644948-d4da-4cb1-85a4-e7eecb721ac2,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:30.830640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Checking segment: {'id': '07ca6a5e-db99-408c-abd5-7f799d2facfa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 591, 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 14:53:30.831565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Network hostable DHCP agents. Network: 4451f5be-7146-498e-8ac1-6200c0f0705c, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 14:53:30.852935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Network 4451f5be-7146-498e-8ac1-6200c0f0705c is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 14:53:30.863523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 4451f5be-7146-498e-8ac1-6200c0f0705c) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 14:53:30.868021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:53:30.868566 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:30.873079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96e0dd7b-2667-4d2a-8b61-372c53ed7b76 None None] Network 4451f5be-7146-498e-8ac1-6200c0f0705c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 14:53:30.887772 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ca1387fe-d46e-4b27-81ef-51ed9c3f4dc8 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4622061 May 12 14:53:31.194983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-4451f5be-7146-498e-8ac1-6200c0f0705c', 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c', 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375', 'fixed_ips': [{'subnet_id': '37644948-d4da-4cb1-85a4-e7eecb721ac2'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 14:53:31.196243 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:31.384155 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Allocated IP 172.20.0.2 (4451f5be-7146-498e-8ac1-6200c0f0705c/37644948-d4da-4cb1-85a4-e7eecb721ac2/9523830b-82e3-4b24-aa31-0f32efc879ce) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 14:53:31.623591 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:31.636975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Transition to ACTIVE for port object 9523830b-82e3-4b24-aa31-0f32efc879ce will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 14:53:31.657850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Transition to ACTIVE for port object 9523830b-82e3-4b24-aa31-0f32efc879ce will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 14:53:31.663703 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:31.728833 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Network 4451f5be-7146-498e-8ac1-6200c0f0705c is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 14:53:31.731810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 14:53:31.738879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Pushing event updated for resources: {'Port': ['ID=9523830b-82e3-4b24-aa31-0f32efc879ce,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:31.741211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 14:53:31.778935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:31.779267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:31.779595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:31.779919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:31.780239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:31.780554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:31.780982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:31.781419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:31.781842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:31.782269 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:31.782711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:31.783123 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Tracked resource versions report: May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: pushed versions: May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: { 'AddressGroup': {'1.2'}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'ConntrackHelper': {'1.0'}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'Log': {'1.0'}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'Network': {'1.1'}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'Port': {'1.7'}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'PortForwarding': {'1.2'}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'QosPolicy': {'1.8'}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'SecurityGroup': {'1.4'}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'SecurityGroupRule': {'1.2'}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'SubPort': {'1.0'}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'Subnet': {'1.1'}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'Trunk': {'1.1'}} May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: consumer versions: May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: { DHCP agent@n-d-841483-1: {}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: L3 agent@n-d-841483-1: {}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: Metadata agent@n-d-841483-1: {}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: Metering agent@n-d-841483-1: {}, May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: Open vSwitch agent@n-d-841483-1: { 'AddressGroup': '1.2', May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'ConntrackHelper': '1.0', May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'Log': '1.0', May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'Network': '1.1', May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'Port': '1.7', May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'PortForwarding': '1.2', May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'QosPolicy': '1.8', May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'SecurityGroup': '1.4', May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'SecurityGroupRule': '1.2', May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'SubPort': '1.0', May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'Subnet': '1.1', May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: 'Trunk': '1.1'}} May 12 14:53:31.784460 n-d-841483-1 neutron-server[88153]: {{(pid=88153) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 12 14:53:31.847589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Attempting to bind port 9523830b-82e3-4b24-aa31-0f32efc879ce on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 14:53:31.847967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Attempting to bind port 9523830b-82e3-4b24-aa31-0f32efc879ce by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '07ca6a5e-db99-408c-abd5-7f799d2facfa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 591, 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 14:53:31.848396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Attempting to bind port 9523830b-82e3-4b24-aa31-0f32efc879ce on network 4451f5be-7146-498e-8ac1-6200c0f0705c {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 14:53:31.853511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 14, 53, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 14:53:31.853858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Checking segment: {'id': '07ca6a5e-db99-408c-abd5-7f799d2facfa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 591, 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 14:53:31.854344 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:31.854722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Bound using segment: {'id': '07ca6a5e-db99-408c-abd5-7f799d2facfa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 591, 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 14:53:31.855229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Bound port: 9523830b-82e3-4b24-aa31-0f32efc879ce, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '07ca6a5e-db99-408c-abd5-7f799d2facfa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 591, 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 14:53:31.855619 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:31.943811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] For port 9523830b-82e3-4b24-aa31-0f32efc879ce, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 14:53:31.948248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] For port 9523830b-82e3-4b24-aa31-0f32efc879ce, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9523830b-82e3-4b24-aa31-0f32efc879ce,segment=NetworkSegment(07ca6a5e-db99-408c-abd5-7f799d2facfa),segment_id=07ca6a5e-db99-408c-abd5-7f799d2facfa)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 14:53:31.951471 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:32.044171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a314617-4fe9-46eb-ba8b-4f9aebdfee4f None None] Pushing event updated for resources: {'Port': ['ID=9523830b-82e3-4b24-aa31-0f32efc879ce,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:33.368088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39948) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:53:33.739728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-75502272-ccad-460a-b2ba-a1cde77a0752 admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 14:53:33.740856 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-75502272-ccad-460a-b2ba-a1cde77a0752 admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3718402 May 12 14:53:35.768075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9523830b-82e3-4b24-aa31-0f32efc879ce up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 14:53:35.849285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1da3fc92-01e6-4d13-9449-5a64fc43cbf2 None None] Network 4451f5be-7146-498e-8ac1-6200c0f0705c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 14:53:35.917514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 9523830b-82e3-4b24-aa31-0f32efc879ce completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 14:53:35.959084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f24ae0bf-902f-4086-8cc2-c95cfc3e9648 None None] Provisioning for port 9523830b-82e3-4b24-aa31-0f32efc879ce completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 14:53:35.967440 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f24ae0bf-902f-4086-8cc2-c95cfc3e9648 None None] Provisioning complete for port 9523830b-82e3-4b24-aa31-0f32efc879ce triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 14:53:35.967843 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f24ae0bf-902f-4086-8cc2-c95cfc3e9648 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:36.214947 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f24ae0bf-902f-4086-8cc2-c95cfc3e9648 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:36.262062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39964) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:53:36.285069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f24ae0bf-902f-4086-8cc2-c95cfc3e9648 None None] For port 9523830b-82e3-4b24-aa31-0f32efc879ce, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9523830b-82e3-4b24-aa31-0f32efc879ce,segment=NetworkSegment(07ca6a5e-db99-408c-abd5-7f799d2facfa),segment_id=07ca6a5e-db99-408c-abd5-7f799d2facfa)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 14:53:36.289627 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f24ae0bf-902f-4086-8cc2-c95cfc3e9648 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:36.362492 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f24ae0bf-902f-4086-8cc2-c95cfc3e9648 None None] Pushing event updated for resources: {'Port': ['ID=9523830b-82e3-4b24-aa31-0f32efc879ce,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:36.522440 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d25b3bf0-147f-4bfb-b9ca-cacd61cb926e None None] Provisioning complete for port 9523830b-82e3-4b24-aa31-0f32efc879ce triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 14:53:36.522802 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d25b3bf0-147f-4bfb-b9ca-cacd61cb926e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:36.677416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-179bbe80-5d4e-4b29-8675-9f9ac3c35781 admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 14:53:36.678450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-179bbe80-5d4e-4b29-8675-9f9ac3c35781 admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.4154909 May 12 14:53:37.744169 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9523830b-82e3-4b24-aa31-0f32efc879ce up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 14:53:37.811047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 9523830b-82e3-4b24-aa31-0f32efc879ce triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 14:53:37.811415 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:39.440870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39976) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:53:39.787119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8df2db56-a702-4168-9495-dc4c5d6ce87f admin admin] Request body: {'router': {'name': 'router1', 'admin_state_up': True, 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 14:53:39.794508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8df2db56-a702-4168-9495-dc4c5d6ce87f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 14:53:39.801879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8df2db56-a702-4168-9495-dc4c5d6ce87f admin admin] Usage tracker for resource:router and tenant:1b536d11fcc14a36a7b3c15ffe979375 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 14:53:39.807329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8df2db56-a702-4168-9495-dc4c5d6ce87f admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 14:53:39.814151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8df2db56-a702-4168-9495-dc4c5d6ce87f admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 14:53:39.824432 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8df2db56-a702-4168-9495-dc4c5d6ce87f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:39.826304 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8df2db56-a702-4168-9495-dc4c5d6ce87f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:39.849321 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8df2db56-a702-4168-9495-dc4c5d6ce87f admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:39.967738 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8df2db56-a702-4168-9495-dc4c5d6ce87f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:39.988289 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8df2db56-a702-4168-9495-dc4c5d6ce87f admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:39.989441 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8df2db56-a702-4168-9495-dc4c5d6ce87f admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5475757 May 12 14:53:42.532483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39986) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:53:42.579970 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7abc6046-7f55-40a4-a064-56dc102148f8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:42.915321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-8f09039a-deb6-46bc-aa70-5bdfeefbd7d2 admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 14:53:42.916286 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8f09039a-deb6-46bc-aa70-5bdfeefbd7d2 admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3829739 May 12 14:53:44.722575 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3954080a-b70f-46f7-aee6-2e25aa8068d2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:45.387132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39996) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:53:45.762866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Request body: {'network': {'name': 'public', 'provider:network_type': 'flat', 'provider:physical_network': 'physnet1', 'router:external': True, 'admin_state_up': True, 'is_default': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 14:53:45.768173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 14:53:45.771982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Usage tracker for resource:network and tenant:7110cf9538324f26940a4fb646dfb9ac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 14:53:45.775341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 14:53:45.781154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 14:53:45.791209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Made reservation on behalf of 7110cf9538324f26940a4fb646dfb9ac for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 14:53:45.794000 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:45.810274 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:45.824313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 14:53:45.827923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Usage tracker for resource:security_group_rule and tenant:7110cf9538324f26940a4fb646dfb9ac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 14:53:45.830989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 14:53:45.836401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 14:53:45.899605 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:45.932951 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:45.938474 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:45.941865 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:45.956989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Reserving flat network on physical network physnet1 {{(pid=88152) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} May 12 14:53:45.988899 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8768026983033', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:45.989492 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Unsubscribe: segment precommit_create {{(pid=88152) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} May 12 14:53:45.989979 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Added segment 621d696b-9fdc-4be4-896e-f6734c2e06e4 of type flat for network 5bff663f-be1e-4c0c-b2e2-d037214cb143 May 12 14:53:46.043021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f212231-3ef4-4d84-b723-01b65ece061e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:46.058588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:46.058973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:46.059360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:46.059742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:46.060074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:46.060434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:46.060810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:46.061179 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:46.061566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:46.061925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:46.062285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:46.063037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Tracked resource versions report: May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: pushed versions: May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: { 'AddressGroup': {'1.2'}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'ConntrackHelper': {'1.0'}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'Log': {'1.0'}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'Network': {'1.1'}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'Port': {'1.7'}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'PortForwarding': {'1.2'}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'QosPolicy': {'1.8'}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'SecurityGroup': {'1.4'}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'SecurityGroupRule': {'1.2'}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'SubPort': {'1.0'}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'Subnet': {'1.1'}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'Trunk': {'1.1'}} May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: consumer versions: May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: { DHCP agent@n-d-841483-1: {}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: L3 agent@n-d-841483-1: {}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: Metadata agent@n-d-841483-1: {}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: Metering agent@n-d-841483-1: {}, May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: Open vSwitch agent@n-d-841483-1: { 'AddressGroup': '1.2', May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'ConntrackHelper': '1.0', May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'Log': '1.0', May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'Network': '1.1', May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'Port': '1.7', May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'PortForwarding': '1.2', May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'QosPolicy': '1.8', May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'SecurityGroup': '1.4', May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'SecurityGroupRule': '1.2', May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'SubPort': '1.0', May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'Subnet': '1.1', May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: 'Trunk': '1.1'}} May 12 14:53:46.063783 n-d-841483-1 neutron-server[88152]: {{(pid=88152) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 12 14:53:46.108645 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:46.151285 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:46.152473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:53:46.153339 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:46.258748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80947665-7036-4201-9a55-19554e636412 admin admin] Pushing event updated for resources: {'Network': ['ID=5bff663f-be1e-4c0c-b2e2-d037214cb143,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:46.261244 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-80947665-7036-4201-9a55-19554e636412 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.8731520 May 12 14:53:46.288295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 14:53:47.398412 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:48.869026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40020) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:53:49.080897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1bdd5133-1aae-45bd-b986-a1a7bcb374b1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:53:49.082264 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1bdd5133-1aae-45bd-b986-a1a7bcb374b1 admin admin] 10.222.0.82 "GET /v2.0/subnets/37644948-d4da-4cb1-85a4-e7eecb721ac2 HTTP/1.1" status: 200 len: 849 time: 0.2122989 May 12 14:53:49.273649 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1f99d6fb-8bb9-40e0-996b-45f9bf38a943 admin admin] 10.222.0.82 "GET /v2.0/routers/9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf HTTP/1.1" status: 200 len: 704 time: 0.1857941 May 12 14:53:49.753744 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:49.990333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Allocated IP 172.20.0.1 (4451f5be-7146-498e-8ac1-6200c0f0705c/37644948-d4da-4cb1-85a4-e7eecb721ac2/53de4921-62a4-47c2-84fb-e51be283a25e) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 14:53:50.157766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:50.176435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Transition to ACTIVE for port object 53de4921-62a4-47c2-84fb-e51be283a25e will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 14:53:50.237119 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:50.307800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Network 4451f5be-7146-498e-8ac1-6200c0f0705c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 14:53:50.310608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 14:53:50.315060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 14:53:50.315625 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:50.452731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Pushing event updated for resources: {'Port': ['ID=53de4921-62a4-47c2-84fb-e51be283a25e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:50.544522 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7890d69f-a62f-4b06-937a-ac256acecfcc None None] Provisioning for port 53de4921-62a4-47c2-84fb-e51be283a25e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 14:53:50.549753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7890d69f-a62f-4b06-937a-ac256acecfcc None None] Provisioning complete for port 53de4921-62a4-47c2-84fb-e51be283a25e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 14:53:50.550117 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7890d69f-a62f-4b06-937a-ac256acecfcc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:50.606163 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-7890d69f-a62f-4b06-937a-ac256acecfcc None None] Port 53de4921-62a4-47c2-84fb-e51be283a25e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 14:53:50.636059 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:50.871303 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:50.876777 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:50.877623 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:51.014307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Pushing event updated for resources: {'Port': ['ID=53de4921-62a4-47c2-84fb-e51be283a25e,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:51.082199 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Network 4451f5be-7146-498e-8ac1-6200c0f0705c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 14:53:51.083252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 14:53:51.281995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Router 9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 14:53:51.329506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-42245f01-e708-463a-83bc-d3349a9136cc None None] Provisioning complete for port 53de4921-62a4-47c2-84fb-e51be283a25e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 14:53:51.329869 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-42245f01-e708-463a-83bc-d3349a9136cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:51.381006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-42245f01-e708-463a-83bc-d3349a9136cc None None] Port 53de4921-62a4-47c2-84fb-e51be283a25e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 14:53:51.435035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 14:53:51.445841 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Sync routers for ids ['9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 14:53:51.446404 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-89c83e17-2868-41f4-a293-340210d4b39e admin admin] 10.222.0.82 "PUT /v2.0/routers/9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.1669261 May 12 14:53:51.457227 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Routers {'9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 14:53:51.458189 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T14:53:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 14:53:51.641054 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Set router 9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 14:53:52.036396 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'name': 'router1', 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T14:53:39Z', 'updated_at': '2022-05-12T14:53:50Z', 'revision_number': 2, 'project_id': '1b536d11fcc14a36a7b3c15ffe979375', 'gw_port_host': None, '_interfaces': [{'id': '53de4921-62a4-47c2-84fb-e51be283a25e', 'name': '', 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c', 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375', 'mac_address': 'fa:16:3e:19:16:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '37644948-d4da-4cb1-85a4-e7eecb721ac2', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T14:53:49Z', 'updated_at': '2022-05-12T14:53:50Z', 'revision_number': 2, 'project_id': '1b536d11fcc14a36a7b3c15ffe979375', 'subnets': [{'id': '37644948-d4da-4cb1-85a4-e7eecb721ac2', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5bc2062c-8513-47d7-9534-dd9c9d2c7f38'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 14:53:52.041119 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Checking router: 9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 14:53:52.041495 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Updating router 9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf port 53de4921-62a4-47c2-84fb-e51be283a25e binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 14:53:52.092973 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:52.497477 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:52.513945 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Transition to ACTIVE for port object 53de4921-62a4-47c2-84fb-e51be283a25e will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 14:53:52.521599 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:52.773298 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Pushing event updated for resources: {'Port': ['ID=53de4921-62a4-47c2-84fb-e51be283a25e,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:52.782899 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:52.783228 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:52.783550 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:52.783869 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:52.784183 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:52.784491 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:52.784799 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:52.785108 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:52.785436 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:52.785743 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:52.786046 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:52.786346 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Tracked resource versions report: May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: pushed versions: May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: { 'AddressGroup': {'1.2'}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'ConntrackHelper': {'1.0'}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'Log': {'1.0'}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'Network': {'1.1'}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'Port': {'1.7'}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'PortForwarding': {'1.2'}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'QosPolicy': {'1.8'}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'SecurityGroup': {'1.4'}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'SecurityGroupRule': {'1.2'}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'SubPort': {'1.0'}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'Subnet': {'1.1'}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'Trunk': {'1.1'}} May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: consumer versions: May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: { DHCP agent@n-d-841483-1: {}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: L3 agent@n-d-841483-1: {}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: Metadata agent@n-d-841483-1: {}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: Metering agent@n-d-841483-1: {}, May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: Open vSwitch agent@n-d-841483-1: { 'AddressGroup': '1.2', May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'ConntrackHelper': '1.0', May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'Log': '1.0', May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'Network': '1.1', May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'Port': '1.7', May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'PortForwarding': '1.2', May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'QosPolicy': '1.8', May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'SecurityGroup': '1.4', May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'SecurityGroupRule': '1.2', May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'SubPort': '1.0', May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'Subnet': '1.1', May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: 'Trunk': '1.1'}} May 12 14:53:52.787698 n-d-841483-1 neutron-server[88154]: {{(pid=88154) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 12 14:53:52.790686 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Attempting to bind port 53de4921-62a4-47c2-84fb-e51be283a25e on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 14:53:52.791065 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Attempting to bind port 53de4921-62a4-47c2-84fb-e51be283a25e by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '07ca6a5e-db99-408c-abd5-7f799d2facfa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 591, 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 14:53:52.791493 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Attempting to bind port 53de4921-62a4-47c2-84fb-e51be283a25e on network 4451f5be-7146-498e-8ac1-6200c0f0705c {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 14:53:52.800287 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 14, 53, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 14:53:52.800650 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Checking segment: {'id': '07ca6a5e-db99-408c-abd5-7f799d2facfa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 591, 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 14:53:52.801414 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:52.801532 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Bound using segment: {'id': '07ca6a5e-db99-408c-abd5-7f799d2facfa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 591, 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 14:53:52.802025 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Bound port: 53de4921-62a4-47c2-84fb-e51be283a25e, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '07ca6a5e-db99-408c-abd5-7f799d2facfa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 591, 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 14:53:52.802411 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:52.889738 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] For port 53de4921-62a4-47c2-84fb-e51be283a25e, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 14:53:52.894220 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] For port 53de4921-62a4-47c2-84fb-e51be283a25e, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=53de4921-62a4-47c2-84fb-e51be283a25e,segment=NetworkSegment(07ca6a5e-db99-408c-abd5-7f799d2facfa),segment_id=07ca6a5e-db99-408c-abd5-7f799d2facfa)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 14:53:52.898093 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:52.993377 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Routers {'9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 14:53:52.994040 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T14:53:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 14:53:53.059774 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beae2734-af9c-473b-8375-9f0fbcbf2eb9 None None] Pushing event updated for resources: {'Port': ['ID=53de4921-62a4-47c2-84fb-e51be283a25e,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:53.155844 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] Set router 9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 14:53:53.485513 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'name': 'router1', 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T14:53:39Z', 'updated_at': '2022-05-12T14:53:50Z', 'revision_number': 2, 'project_id': '1b536d11fcc14a36a7b3c15ffe979375', 'gw_port_host': None, '_interfaces': [{'id': '53de4921-62a4-47c2-84fb-e51be283a25e', 'name': '', 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c', 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375', 'mac_address': 'fa:16:3e:19:16:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '37644948-d4da-4cb1-85a4-e7eecb721ac2', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T14:53:49Z', 'updated_at': '2022-05-12T14:53:52Z', 'revision_number': 4, 'project_id': '1b536d11fcc14a36a7b3c15ffe979375', 'subnets': [{'id': '37644948-d4da-4cb1-85a4-e7eecb721ac2', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5bc2062c-8513-47d7-9534-dd9c9d2c7f38'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 14:53:53.489248 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c63ab89-2eea-42b5-bcd3-9ec992e19907 None None] The sync data for ids ['9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf'] in n-d-841483-1 is: [{'id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'name': 'router1', 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T14:53:39Z', 'updated_at': '2022-05-12T14:53:50Z', 'revision_number': 2, 'project_id': '1b536d11fcc14a36a7b3c15ffe979375', 'gw_port_host': None, '_interfaces': [{'id': '53de4921-62a4-47c2-84fb-e51be283a25e', 'name': '', 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c', 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375', 'mac_address': 'fa:16:3e:19:16:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '37644948-d4da-4cb1-85a4-e7eecb721ac2', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T14:53:49Z', 'updated_at': '2022-05-12T14:53:52Z', 'revision_number': 4, 'project_id': '1b536d11fcc14a36a7b3c15ffe979375', 'subnets': [{'id': '37644948-d4da-4cb1-85a4-e7eecb721ac2', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5bc2062c-8513-47d7-9534-dd9c9d2c7f38'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 14:53:53.814557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40042) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:53:53.965536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c0a9e37-5497-42fe-9870-e3ba6629ffff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:53:53.966904 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7c0a9e37-5497-42fe-9870-e3ba6629ffff admin admin] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 842 time: 0.1514049 May 12 14:53:53.976708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Request body: {'subnet': {'name': 'public-subnet', 'ip_version': 4, 'cidr': '172.25.8.0/24', 'enable_dhcp': False, 'gateway_ip': '172.25.8.1', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 14:53:53.981857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 14:53:53.987028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Usage tracker for resource:subnet and tenant:7110cf9538324f26940a4fb646dfb9ac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 14:53:53.989769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 14:53:53.995329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 14:53:54.008478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Made reservation on behalf of 7110cf9538324f26940a4fb646dfb9ac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 14:53:54.010782 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Notify callbacks [] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:54.404730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.objects.ports [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88151) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 14:53:54.405175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:54.483180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Pushing event updated for resources: {'Subnet': ['ID=9a9fe5f0-4a5e-4d67-842d-7e60d2702213,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:54.488252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 14:53:54.488606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Network hostable DHCP agents. Network: 5bff663f-be1e-4c0c-b2e2-d037214cb143, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 14:53:54.507187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 14:53:54.516213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 5bff663f-be1e-4c0c-b2e2-d037214cb143) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 14:53:54.520082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:53:54.520655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:54.525903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4f18d88-c75b-4faa-807a-15188e8e041f None None] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 14:53:54.545087 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-34506fda-1345-4480-af72-497499f4b24f admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5718517 May 12 14:53:54.768205 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cccd74a6-ddd7-469c-a54e-c42f6ef1659a None None] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 14:53:55.772681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 53de4921-62a4-47c2-84fb-e51be283a25e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 14:53:55.844094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 53de4921-62a4-47c2-84fb-e51be283a25e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 14:53:55.848813 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 53de4921-62a4-47c2-84fb-e51be283a25e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 14:53:55.849178 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:55.964438 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:55.996856 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 53de4921-62a4-47c2-84fb-e51be283a25e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=53de4921-62a4-47c2-84fb-e51be283a25e,segment=NetworkSegment(07ca6a5e-db99-408c-abd5-7f799d2facfa),segment_id=07ca6a5e-db99-408c-abd5-7f799d2facfa)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 14:53:56.001180 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:56.068076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=53de4921-62a4-47c2-84fb-e51be283a25e,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:56.883150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40056) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:53:57.122673 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-da6bb1fe-8770-463e-8e71-ca8714af607e admin admin] 10.222.0.82 "GET /v2.0/routers/9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf HTTP/1.1" status: 200 len: 710 time: 0.2383163 May 12 14:53:57.259583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d419c256-da0b-4d4b-bb88-9f2a35dc288a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:53:57.260943 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d419c256-da0b-4d4b-bb88-9f2a35dc288a admin admin] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 886 time: 0.1304133 May 12 14:53:57.273455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 14:53:57.723652 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:57.757990 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 53de4921-62a4-47c2-84fb-e51be283a25e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 14:53:57.830985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 53de4921-62a4-47c2-84fb-e51be283a25e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 14:53:57.831367 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:58.068523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:58.122449 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:58.302735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Allocated IP 172.25.8.152 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/23c9da61-86db-4c72-9512-413b0eee7983) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 14:53:58.444167 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:58.472957 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:58.536745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 14:53:58.539270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 14:53:58.542976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 14:53:58.610089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Pushing event updated for resources: {'Port': ['ID=23c9da61-86db-4c72-9512-413b0eee7983,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:53:58.941874 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:59.287666 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:59.290900 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:59.474344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Router 9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 14:53:59.712899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 14:53:59.723434 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:53:59.724202 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Sync routers for ids ['9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 14:53:59.724653 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8202f436-5c0f-4c54-b48b-6e352cd938e7 admin admin] 10.222.0.82 "PUT /v2.0/routers/9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf HTTP/1.1" status: 200 len: 890 time: 2.4545078 May 12 14:53:59.734481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Routers {'9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 14:53:59.735236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T14:53:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 14:53:59.950155 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Set router 9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 14:54:00.307790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'name': 'router1', 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.152'}], 'enable_snat': True}, 'gw_port_id': '23c9da61-86db-4c72-9512-413b0eee7983', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T14:53:39Z', 'updated_at': '2022-05-12T14:53:58Z', 'revision_number': 4, 'project_id': '1b536d11fcc14a36a7b3c15ffe979375', 'gw_port': {'id': '23c9da61-86db-4c72-9512-413b0eee7983', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:9f:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T14:53:58Z', 'updated_at': '2022-05-12T14:53:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '53de4921-62a4-47c2-84fb-e51be283a25e', 'name': '', 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c', 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375', 'mac_address': 'fa:16:3e:19:16:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '37644948-d4da-4cb1-85a4-e7eecb721ac2', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T14:53:49Z', 'updated_at': '2022-05-12T14:53:55Z', 'revision_number': 5, 'project_id': '1b536d11fcc14a36a7b3c15ffe979375', 'subnets': [{'id': '37644948-d4da-4cb1-85a4-e7eecb721ac2', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5bc2062c-8513-47d7-9534-dd9c9d2c7f38'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 14:54:00.312841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Checking router: 9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 14:54:00.313211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Updating router 9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf port 23c9da61-86db-4c72-9512-413b0eee7983 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 14:54:00.366385 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:00.714278 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:00.728713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Transition to ACTIVE for port object 23c9da61-86db-4c72-9512-413b0eee7983 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 14:54:00.736380 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:00.816633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Attempting to bind port 23c9da61-86db-4c72-9512-413b0eee7983 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 14:54:00.817004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Attempting to bind port 23c9da61-86db-4c72-9512-413b0eee7983 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 14:54:00.817337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Attempting to bind port 23c9da61-86db-4c72-9512-413b0eee7983 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 14:54:00.819661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dad2eee9-609d-471d-8e65-8bcfb8facd33 None None] Pushing event updated for resources: {'Port': ['ID=23c9da61-86db-4c72-9512-413b0eee7983,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:54:00.825499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 14, 53, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 14:54:00.825869 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 14:54:00.826261 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:00.826636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 14:54:00.827094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Bound port: 23c9da61-86db-4c72-9512-413b0eee7983, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 14:54:00.828612 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:00.909118 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] For port 23c9da61-86db-4c72-9512-413b0eee7983, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 14:54:00.912406 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] For port 23c9da61-86db-4c72-9512-413b0eee7983, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=23c9da61-86db-4c72-9512-413b0eee7983,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 14:54:00.917071 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:00.997073 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Routers {'9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 14:54:00.997721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T14:53:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 14:54:01.051078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dad2eee9-609d-471d-8e65-8bcfb8facd33 None None] Pushing event updated for resources: {'Port': ['ID=23c9da61-86db-4c72-9512-413b0eee7983,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:54:01.219732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] Set router 9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 14:54:01.581668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'name': 'router1', 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.152'}], 'enable_snat': True}, 'gw_port_id': '23c9da61-86db-4c72-9512-413b0eee7983', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T14:53:39Z', 'updated_at': '2022-05-12T14:53:58Z', 'revision_number': 4, 'project_id': '1b536d11fcc14a36a7b3c15ffe979375', 'gw_port': {'id': '23c9da61-86db-4c72-9512-413b0eee7983', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:9f:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T14:53:58Z', 'updated_at': '2022-05-12T14:54:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '53de4921-62a4-47c2-84fb-e51be283a25e', 'name': '', 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c', 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375', 'mac_address': 'fa:16:3e:19:16:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '37644948-d4da-4cb1-85a4-e7eecb721ac2', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T14:53:49Z', 'updated_at': '2022-05-12T14:53:55Z', 'revision_number': 5, 'project_id': '1b536d11fcc14a36a7b3c15ffe979375', 'subnets': [{'id': '37644948-d4da-4cb1-85a4-e7eecb721ac2', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5bc2062c-8513-47d7-9534-dd9c9d2c7f38'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 14:54:01.586140 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d87de2b-f9e8-44ee-9e7c-0da36987ce27 None None] The sync data for ids ['9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf'] in n-d-841483-1 is: [{'id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'name': 'router1', 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.152'}], 'enable_snat': True}, 'gw_port_id': '23c9da61-86db-4c72-9512-413b0eee7983', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T14:53:39Z', 'updated_at': '2022-05-12T14:53:58Z', 'revision_number': 4, 'project_id': '1b536d11fcc14a36a7b3c15ffe979375', 'gw_port': {'id': '23c9da61-86db-4c72-9512-413b0eee7983', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:9f:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T14:53:58Z', 'updated_at': '2022-05-12T14:54:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '53de4921-62a4-47c2-84fb-e51be283a25e', 'name': '', 'network_id': '4451f5be-7146-498e-8ac1-6200c0f0705c', 'tenant_id': '1b536d11fcc14a36a7b3c15ffe979375', 'mac_address': 'fa:16:3e:19:16:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cc4e0f1-4825-49a9-9a8d-2d6cea9bacaf', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '37644948-d4da-4cb1-85a4-e7eecb721ac2', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T14:53:49Z', 'updated_at': '2022-05-12T14:53:55Z', 'revision_number': 5, 'project_id': '1b536d11fcc14a36a7b3c15ffe979375', 'subnets': [{'id': '37644948-d4da-4cb1-85a4-e7eecb721ac2', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5bc2062c-8513-47d7-9534-dd9c9d2c7f38'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 14:54:01.788990 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 23c9da61-86db-4c72-9512-413b0eee7983 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 14:54:01.865676 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 23c9da61-86db-4c72-9512-413b0eee7983 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 14:54:01.871672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 23c9da61-86db-4c72-9512-413b0eee7983 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 14:54:01.872035 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:02.005143 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:02.025573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 23c9da61-86db-4c72-9512-413b0eee7983, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=23c9da61-86db-4c72-9512-413b0eee7983,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 14:54:02.032357 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:02.109991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=23c9da61-86db-4c72-9512-413b0eee7983,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:54:02.243435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40066) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:54:02.380015 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d9b0ada9-c23c-4c73-8558-718d6f738c43 admin admin] 10.222.0.82 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 413 time: 0.1354592 May 12 14:54:03.755904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 23c9da61-86db-4c72-9512-413b0eee7983 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 14:54:03.822892 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 23c9da61-86db-4c72-9512-413b0eee7983 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 14:54:03.823181 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:05.626033 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 5 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 14:54:12.584479 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5c281a3e-d69c-4c4e-9f42-d16fe1af4da7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:14.728007 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-35050695-d67b-406d-b0a6-fa7730de7763 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:15.902399 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:15.936096 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:17.410709 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:42.588077 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ff21e06e-6ca7-43e5-9d6b-6718b87ec2c6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:42.625323 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 5 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 14:54:44.731730 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2317066d-37ac-46ad-9446-4e4b4d95be14 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:45.906060 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:45.937601 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:54:47.420412 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:55:12.593803 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7ed29caf-8c46-41ab-9bba-2ec4ff90288d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:55:14.736890 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0862a0f6-3754-4110-9864-5aaae627114a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:55:15.912518 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:55:15.947037 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:55:17.422404 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:55:19.623980 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 5 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 14:55:42.588763 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1a2d39f3-30e5-4a62-8786-ff7e33a47ce2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:55:44.728711 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-937cf682-ceb1-4f03-8278-16f0bee208ae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:55:45.907428 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:55:45.944515 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:55:47.426658 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:55:56.622788 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 5 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 14:56:10.891417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40668) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:56:10.957521 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-cec2c707-9575-4f06-ae65-53ea6a27142f admin admin] GET failed (client error): The resource could not be found. May 12 14:56:10.958757 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cec2c707-9575-4f06-ae65-53ea6a27142f admin admin] 10.222.0.82 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0663981 May 12 14:56:11.090065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c06c10ed-a33f-4716-a170-b0242ac9a250 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:11.091405 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c06c10ed-a33f-4716-a170-b0242ac9a250 admin admin] 10.222.0.82 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1287866 May 12 14:56:12.592917 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a953321d-10e5-487a-9de4-848f2d71e5da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:13.283479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40678) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:56:13.394302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-937bb2f3-2919-46c4-9556-3d67a56c1bae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:13.395233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-937bb2f3-2919-46c4-9556-3d67a56c1bae admin admin] Synchronizing usage tracker for tenant:7110cf9538324f26940a4fb646dfb9ac on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 14:56:13.415261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-937bb2f3-2919-46c4-9556-3d67a56c1bae admin admin] Unset dirty status for tenant:7110cf9538324f26940a4fb646dfb9ac on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 14:56:13.416570 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-937bb2f3-2919-46c4-9556-3d67a56c1bae admin admin] 10.222.0.82 "GET /v2.0/subnets/37644948-d4da-4cb1-85a4-e7eecb721ac2 HTTP/1.1" status: 200 len: 849 time: 0.1321309 May 12 14:56:13.425712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 14:56:13.541806 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Notify callbacks [] for subnet, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:13.730608 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8768026839929'] for subnet, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:13.775822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:13.776397 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:13.777922 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] 10.222.0.82 "PUT /v2.0/subnets/37644948-d4da-4cb1-85a4-e7eecb721ac2 HTTP/1.1" status: 200 len: 868 time: 0.3555763 May 12 14:56:13.792683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa9ed2f2-d5bc-42bd-94ca-5fae0c8cc787 None None] Network 4451f5be-7146-498e-8ac1-6200c0f0705c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 14:56:13.802795 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Pushing event updated for resources: {'Subnet': ['ID=37644948-d4da-4cb1-85a4-e7eecb721ac2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:56:13.810986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:56:13.810986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:56:13.811306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:56:13.812548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:56:13.812908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:56:13.813211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:56:13.813579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:56:13.813878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:56:13.814197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:56:13.814516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:56:13.814986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:56:13.815313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54bf36ff-58df-4048-a170-a470a56a6351 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:56:14.294362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-eeb9d582-5531-4b99-9479-8f707b4ec6c6 None None] Provisioning complete for port 53de4921-62a4-47c2-84fb-e51be283a25e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 14:56:14.294733 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eeb9d582-5531-4b99-9479-8f707b4ec6c6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:14.422164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-eeb9d582-5531-4b99-9479-8f707b4ec6c6 None None] Provisioning complete for port 9523830b-82e3-4b24-aa31-0f32efc879ce triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 14:56:14.422558 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eeb9d582-5531-4b99-9479-8f707b4ec6c6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:14.731144 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a52c2b6c-f0ed-4a95-866d-89f6fe6a063f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:15.914505 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:15.949753 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:16.053192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40688) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:56:16.227809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d1d204b-64b9-4e5a-9ca5-838ad22f8d12 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:16.228273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d1d204b-64b9-4e5a-9ca5-838ad22f8d12 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:16.237431 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3d1d204b-64b9-4e5a-9ca5-838ad22f8d12 admin admin] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1755996 May 12 14:56:17.429271 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:18.446626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40698) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:56:18.619220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3b9c982-138b-4e47-80b1-54abdb070293 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:18.619601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3b9c982-138b-4e47-80b1-54abdb070293 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:18.621099 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e3b9c982-138b-4e47-80b1-54abdb070293 admin admin] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1735430 May 12 14:56:20.780688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40708) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:56:20.953459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-328f0886-be9f-40c4-b152-ea249fd1479f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:20.954783 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-328f0886-be9f-40c4-b152-ea249fd1479f admin admin] 10.222.0.82 "GET /v2.0/networks/4451f5be-7146-498e-8ac1-6200c0f0705c HTTP/1.1" status: 200 len: 869 time: 0.1730850 May 12 14:56:23.156708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40718) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:56:23.323360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-461ab89a-b565-4502-a6bd-b4791dbd731d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:23.324706 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-461ab89a-b565-4502-a6bd-b4791dbd731d admin admin] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 886 time: 0.1670678 May 12 14:56:25.508733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40728) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:56:25.614253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7abe0646-919b-4e32-bb81-b05961e10b56 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:25.614709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7abe0646-919b-4e32-bb81-b05961e10b56 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:25.616196 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7abe0646-919b-4e32-bb81-b05961e10b56 admin admin] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1062982 May 12 14:56:27.853397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40738) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:56:27.957680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6406c98d-e9c0-46da-804a-06ab23bba57d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:27.958105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6406c98d-e9c0-46da-804a-06ab23bba57d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:27.959567 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6406c98d-e9c0-46da-804a-06ab23bba57d admin admin] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1052349 May 12 14:56:30.200626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40748) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:56:30.310338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5c77b84-263e-42c6-bdaa-73e79632d0ef admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:30.311826 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a5c77b84-263e-42c6-bdaa-73e79632d0ef admin admin] 10.222.0.82 "GET /v2.0/subnets/37644948-d4da-4cb1-85a4-e7eecb721ac2 HTTP/1.1" status: 200 len: 868 time: 0.1101658 May 12 14:56:32.501526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40758) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:56:32.602751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e0144d5-5209-43c6-8700-efc421469081 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:32.604068 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0e0144d5-5209-43c6-8700-efc421469081 admin admin] 10.222.0.82 "GET /v2.0/subnets/9a9fe5f0-4a5e-4d67-842d-7e60d2702213 HTTP/1.1" status: 200 len: 816 time: 0.1016173 May 12 14:56:33.622479 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 5 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 14:56:42.604720 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e1fe2e85-acbc-44de-a747-ff36d989a1eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:44.738266 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a97ca4a3-652b-4011-bd4f-6b6076a5499e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:45.910195 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:45.950943 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:47.433461 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:51.888344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40804) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:56:51.945580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-c5e738a8-d35e-42e3-88c9-19ddaf015a1f admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 14:56:51.946581 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c5e738a8-d35e-42e3-88c9-19ddaf015a1f admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0567632 May 12 14:56:54.388347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40814) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:56:54.471733 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-252a36e6-6779-48df-ab56-353a2d55807f admin admin] GET failed (client error): The resource could not be found. May 12 14:56:54.472268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-252a36e6-6779-48df-ab56-353a2d55807f admin admin] Synchronizing usage tracker for tenant:7110cf9538324f26940a4fb646dfb9ac on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 14:56:54.491194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-252a36e6-6779-48df-ab56-353a2d55807f admin admin] Unset dirty status for tenant:7110cf9538324f26940a4fb646dfb9ac on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 14:56:54.492550 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-252a36e6-6779-48df-ab56-353a2d55807f admin admin] 10.222.0.82 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.1029205 May 12 14:56:54.632325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4446bddd-f775-4474-9e06-26e1d628de16 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:54.634297 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4446bddd-f775-4474-9e06-26e1d628de16 admin admin] 10.222.0.82 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1378052 May 12 14:56:56.855477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40824) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:56:56.903674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'shared', 'shared': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 14:56:56.909581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 14:56:56.919495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 14:56:56.930466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] Made reservation on behalf of 7110cf9538324f26940a4fb646dfb9ac for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 14:56:56.932888 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:57.064122 n-d-841483-1 neutron-server[88151]: WARNING neutron.services.revisions.revision_plugin [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] Could not find related network for resource to bump revision. May 12 14:56:57.077761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 556} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 14:56:57.087761 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:57.088100 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] Added segment d8f9d8a6-0e4b-49d7-bae9-38499934da61 of type vlan for network a44a68c4-7e98-4d43-8306-5fa007779c3c May 12 14:56:57.113442 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:57.142026 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:57.142952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:57.143533 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:57.252144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] Pushing event updated for resources: {'Network': ['ID=a44a68c4-7e98-4d43-8306-5fa007779c3c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:56:57.255191 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dc3add28-1fab-4910-b331-f953a3824b49 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.3987341 May 12 14:56:57.275306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network a44a68c4-7e98-4d43-8306-5fa007779c3c details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 14:56:59.453850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40834) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:56:59.522500 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-9ce70692-0fe5-40f2-b232-1f563ab9561a admin admin] GET failed (client error): The resource could not be found. May 12 14:56:59.522997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9ce70692-0fe5-40f2-b232-1f563ab9561a admin admin] Synchronizing usage tracker for tenant:7110cf9538324f26940a4fb646dfb9ac on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 14:56:59.538574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9ce70692-0fe5-40f2-b232-1f563ab9561a admin admin] Unset dirty status for tenant:7110cf9538324f26940a4fb646dfb9ac on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 14:56:59.539847 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9ce70692-0fe5-40f2-b232-1f563ab9561a admin admin] 10.222.0.82 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0848548 May 12 14:56:59.644022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cff40a56-6676-4e88-9da3-545beec4cadd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:59.645474 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cff40a56-6676-4e88-9da3-545beec4cadd admin admin] 10.222.0.82 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.1019526 May 12 14:56:59.655463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7976cbce-e446-42b8-a341-e315786b9d0e admin admin] Request body: {'subnet': {'ip_version': 4, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'cidr': '192.168.233.0/24', 'name': 'shared-subnet', 'description': 'shared-subnet'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 14:56:59.659778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7976cbce-e446-42b8-a341-e315786b9d0e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 14:56:59.669159 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7976cbce-e446-42b8-a341-e315786b9d0e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 14:56:59.679272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7976cbce-e446-42b8-a341-e315786b9d0e admin admin] Made reservation on behalf of 7110cf9538324f26940a4fb646dfb9ac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 14:56:59.681587 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7976cbce-e446-42b8-a341-e315786b9d0e admin admin] Notify callbacks [] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:59.879430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7976cbce-e446-42b8-a341-e315786b9d0e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:59.949573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7976cbce-e446-42b8-a341-e315786b9d0e admin admin] Pushing event updated for resources: {'Subnet': ['ID=dd1c7d4f-070b-4ce9-8969-e46d734b17c3,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:56:59.957824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7976cbce-e446-42b8-a341-e315786b9d0e admin admin] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 14:56:59.958172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7976cbce-e446-42b8-a341-e315786b9d0e admin admin] Network hostable DHCP agents. Network: a44a68c4-7e98-4d43-8306-5fa007779c3c, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 14:56:59.975684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7976cbce-e446-42b8-a341-e315786b9d0e admin admin] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 14:56:59.984896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7976cbce-e446-42b8-a341-e315786b9d0e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, a44a68c4-7e98-4d43-8306-5fa007779c3c) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 14:56:59.988853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7976cbce-e446-42b8-a341-e315786b9d0e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 14:56:59.989429 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7976cbce-e446-42b8-a341-e315786b9d0e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:56:59.994097 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f065eebd-4246-43af-a71c-69b3fc27daa1 None None] Network a44a68c4-7e98-4d43-8306-5fa007779c3c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 14:57:00.014461 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7976cbce-e446-42b8-a341-e315786b9d0e admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3628175 May 12 14:57:00.217596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-a44a68c4-7e98-4d43-8306-5fa007779c3c', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'tenant_id': '7110cf9538324f26940a4fb646dfb9ac', 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 14:57:00.218451 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:00.378720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Allocated IP 192.168.233.2 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/ecedf759-a700-47f1-9009-be635cc39943) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 14:57:00.587538 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:00.599516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Transition to ACTIVE for port object ecedf759-a700-47f1-9009-be635cc39943 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 14:57:00.618210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Transition to ACTIVE for port object ecedf759-a700-47f1-9009-be635cc39943 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 14:57:00.624322 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:00.692105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 14:57:00.693257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 14:57:00.696761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 14:57:00.731377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Pushing event updated for resources: {'Port': ['ID=ecedf759-a700-47f1-9009-be635cc39943,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:57:00.747244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:57:00.747585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:57:00.747950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:57:00.748274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:57:00.748597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:57:00.748920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:57:00.749234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:57:00.749575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:57:00.749909 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:57:00.750224 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:57:00.750537 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:57:00.750853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:57:00.805462 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Attempting to bind port ecedf759-a700-47f1-9009-be635cc39943 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 14:57:00.805816 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Attempting to bind port ecedf759-a700-47f1-9009-be635cc39943 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 14:57:00.806191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Attempting to bind port ecedf759-a700-47f1-9009-be635cc39943 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 14:57:00.811593 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 14, 56, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 14:57:00.811949 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 14:57:00.812335 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:00.812711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 14:57:00.813163 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Bound port: ecedf759-a700-47f1-9009-be635cc39943, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 14:57:00.813552 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:00.907671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] For port ecedf759-a700-47f1-9009-be635cc39943, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 14:57:00.910562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] For port ecedf759-a700-47f1-9009-be635cc39943, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ecedf759-a700-47f1-9009-be635cc39943,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 14:57:00.915419 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:01.010998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f3c8ef7-9f44-412c-bc9f-e6ef72c8a2d5 None None] Pushing event updated for resources: {'Port': ['ID=ecedf759-a700-47f1-9009-be635cc39943,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:57:01.854646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21085990-7123-429a-8b3a-0e1685d0fca6 None None] Network a44a68c4-7e98-4d43-8306-5fa007779c3c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 14:57:01.922221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ecedf759-a700-47f1-9009-be635cc39943 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 14:57:02.021685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f5dd342f-aadf-4a6e-99c3-5dba4af65461 None None] Provisioning for port ecedf759-a700-47f1-9009-be635cc39943 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 14:57:02.116888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ecedf759-a700-47f1-9009-be635cc39943 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 14:57:02.126076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ecedf759-a700-47f1-9009-be635cc39943 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 14:57:02.126441 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:02.300923 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:02.334468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ecedf759-a700-47f1-9009-be635cc39943, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ecedf759-a700-47f1-9009-be635cc39943,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 14:57:02.339046 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:02.411000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ecedf759-a700-47f1-9009-be635cc39943,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:57:02.572578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a3e3e408-c233-4528-8a83-45f7ee3023d9 None None] Provisioning complete for port ecedf759-a700-47f1-9009-be635cc39943 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 14:57:02.572834 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a3e3e408-c233-4528-8a83-45f7ee3023d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:03.846817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ecedf759-a700-47f1-9009-be635cc39943 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 14:57:03.916098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ecedf759-a700-47f1-9009-be635cc39943 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 14:57:03.916456 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:10.621237 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 5 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 14:57:12.599496 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bcaba3bd-c489-4f15-b97d-b4585df21155 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:14.731155 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-268a70d4-ddf5-462b-8107-f21280133c4a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:15.912961 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:15.953228 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:17.438604 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:42.602942 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6bb1df96-f404-41c1-940d-5fa1a112f708 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:44.735294 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-301d06c2-bce2-4230-913b-5f9aeb7b13fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:45.917191 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:45.955769 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:47.439435 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:57:47.620340 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 5 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 14:58:12.606194 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-36eab5b2-7607-4ec1-acaf-f80dc8e9defe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:14.738457 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-db307d6e-d9fd-4076-8e0d-b0a9c09f4599 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:15.911965 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:15.958849 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:17.441470 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:24.618875 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 5 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 14:58:31.648356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40880) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:58:31.655030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-1eb775b2-01b1-4dd5-80f7-c806173b6de9 tempest-verify_tempest_config-217116567 tempest-verify_tempest_config-217116567-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 14:58:31.655975 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1eb775b2-01b1-4dd5-80f7-c806173b6de9 tempest-verify_tempest_config-217116567 tempest-verify_tempest_config-217116567-project] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13635 time: 0.0066741 May 12 14:58:31.964197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40898) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:58:32.082245 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:32.095606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 14:58:32.099274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Usage tracker for resource:security_group_rule and tenant:ca64aeb1872341eaa9c9353e6f14434e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 14:58:32.101955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 14:58:32.108042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 14:58:32.189398 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:32.192902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:32.239389 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ca64aeb1872341eaa9c9353e6f14434e&name=default HTTP/1.1" status: 200 len: 2975 time: 0.2741508 May 12 14:58:32.240328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e9027b6-9009-4426-b649-6ea9ad83df76,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:58:32.242018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40904) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 14:58:32.248386 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.248719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.249043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.249363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.249708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.250023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.250335 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.250644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.250953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.251258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.251573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.251852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558fc90c-c805-425e-9779-2662484b2491 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.311300 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:32.335974 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:32.431269 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:32.446660 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e9027b6-9009-4426-b649-6ea9ad83df76,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 14:58:32.457097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.457462 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.457800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.458129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.458453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.458775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.459092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.459408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.459749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.460064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.460378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.460694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 14:58:32.463706 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:32.465924 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bfd88d91-77aa-4a46-a429-10349bd23ecd admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6e9027b6-9009-4426-b649-6ea9ad83df76 HTTP/1.1" status: 204 len: 168 time: 0.2223520 May 12 14:58:42.608958 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7a70959d-57e7-4f96-b5b0-df784c7ee29e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:44.741178 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-846d82f6-8421-46f7-a94f-096e0a9c611b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:45.915244 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:45.960105 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:58:47.446576 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:59:01.617526 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 5 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 14:59:12.610523 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03273618-797f-4ea4-b7eb-60ffcdc9385d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:59:14.742074 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2bd89672-ed60-4977-adc3-f1d10748ed74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:59:15.917759 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:59:15.962700 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:59:17.447427 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:59:38.615562 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 5 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 14:59:42.612750 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-71067a6f-8ec0-4d10-b918-0ee79d5eb2c2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:59:44.747827 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4eddab30-0282-40d7-9422-25b704a3a217 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:59:45.920387 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:59:45.964274 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 14:59:47.450344 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:00:12.613776 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b4fb02de-cb6e-442b-a3f0-7198fcc3eef7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:00:14.739768 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-126a70d5-827d-4bda-8bc0-ee406acf396d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:00:15.613468 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 5 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:00:15.922906 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:00:15.967111 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:00:17.455049 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:00:42.615269 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2ac7dc4a-c814-400d-bbfc-e5ce80de9335 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:00:44.742249 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-af868825-5a78-4e4b-b4f8-6d8e295de8e2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:00:45.923965 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:00:45.968691 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:00:47.457757 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:00:52.612062 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 5 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:01:12.617593 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-33731cff-7d01-46dc-be89-b2e15ef137a9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:01:14.745044 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1b81fad4-e050-4936-ad35-33bdc6e4056b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:01:15.927170 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:01:15.971258 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:01:17.460177 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:01:29.611383 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 5 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:01:32.011319 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3784235'] for agent, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:01:42.582803 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3784235'] for agent, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:01:42.619311 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a834ab44-c277-4296-81f9-957976725dad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:01:44.748383 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bfc9d37c-e1bb-4865-8bf0-65506eaf863c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:01:45.930220 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:01:45.973790 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:01:47.463167 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:02:01.974103 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:02:06.610561 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:02:12.539339 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:02:12.622327 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4d1b8f77-dbd9-43f6-bc02-d330ce78a360 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:02:14.774638 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d8d4eb8-8f3e-4b31-b2d9-0e2850b4aa8e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:02:15.935729 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:02:15.977102 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:02:17.467490 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:02:18.333996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40964) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:02:18.454998 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-536ca08e-9937-438f-a935-3b1e57637a1b admin admin] 10.222.0.82 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4681 time: 0.1199183 May 12 15:02:20.657993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40974) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:02:20.712842 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-392b1396-4b36-47a8-86c4-590045859fa6 admin admin] 10.222.0.82 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4681 time: 0.0537837 May 12 15:02:31.988992 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:02:42.553857 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:02:42.623733 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5584a183-2d9f-4a01-a8c3-de52f9ae5b99 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:02:43.610449 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:02:44.746878 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2279f63b-4003-4156-a3a0-ac1d2dbe71e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:02:45.938478 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:02:45.980356 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:02:47.469998 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:01.993732 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:12.552026 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:12.629179 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1e085be6-b07f-4728-afed-9568d518c938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:14.749483 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1a74a800-44ff-404d-9c2c-6c0bfc5a47ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:15.942510 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:15.983422 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:17.473440 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:20.610566 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:03:31.988856 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:42.553821 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:42.622180 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-05acc390-d169-4b85-b76f-663943dc9f6d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:44.751243 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f16b415a-d1ff-4e5d-97d3-bdbe6d180e5f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:45.946872 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:45.987584 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:47.475816 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:03:57.610440 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:04:02.001455 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:04.533744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41190) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:04.932394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Request body: {'network': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-network', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:04.937893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:04.941131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Usage tracker for resource:network and tenant:38c07c88d2f84b29a9ae8c83558ec74b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:04.944059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:04.951297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:04.964004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Made reservation on behalf of 38c07c88d2f84b29a9ae8c83558ec74b for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:04.966506 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:04.980460 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:04.996115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:04.999934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Usage tracker for resource:security_group_rule and tenant:38c07c88d2f84b29a9ae8c83558ec74b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:05.002849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:05.009352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:05.112932 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:05.118286 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:05.156008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 563} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:04:05.161575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6c143721-d68a-410c-8943-0e64dbae0dca,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:05.171010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:05.171356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:05.171760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:05.172147 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:05.172616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:05.173093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:05.173432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:05.173892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:05.174212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:05.174543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:05.174839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:05.175150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Tracked resource versions report: May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: pushed versions: May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: { 'AddressGroup': {'1.2'}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'ConntrackHelper': {'1.0'}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'Log': {'1.0'}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'Network': {'1.1'}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'Port': {'1.7'}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'PortForwarding': {'1.2'}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'QosPolicy': {'1.8'}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'SecurityGroup': {'1.4'}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'SecurityGroupRule': {'1.2'}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'SubPort': {'1.0'}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'Subnet': {'1.1'}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'Trunk': {'1.1'}} May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: consumer versions: May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: { DHCP agent@n-d-841483-1: {}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: HyperV agent@n-h1-841483-1: {}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: HyperV agent@n-h2-841483-1: {}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: L3 agent@n-d-841483-1: {}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: Metadata agent@n-d-841483-1: {}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: Metering agent@n-d-841483-1: {}, May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: Open vSwitch agent@n-d-841483-1: { 'AddressGroup': '1.2', May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'ConntrackHelper': '1.0', May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'Log': '1.0', May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'Network': '1.1', May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'Port': '1.7', May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'PortForwarding': '1.2', May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'QosPolicy': '1.8', May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'SecurityGroup': '1.4', May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'SecurityGroupRule': '1.2', May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'SubPort': '1.0', May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'Subnet': '1.1', May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: 'Trunk': '1.1'}} May 12 15:04:05.176771 n-d-841483-1 neutron-server[88151]: {{(pid=88151) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 12 15:04:05.183966 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:05.184266 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Added segment d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e of type vlan for network feb95830-c0c2-46c0-bb35-f2f43605e79a May 12 15:04:05.213491 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:05.244678 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:05.245983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:05.246669 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:05.360093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] Pushing event updated for resources: {'Network': ['ID=feb95830-c0c2-46c0-bb35-f2f43605e79a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:05.374133 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2519eb61-8914-492d-85c8-a1e48f7fe078 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.8357484 May 12 15:04:05.374133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41228) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:05.375977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network feb95830-c0c2-46c0-bb35-f2f43605e79a details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:04:05.383703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Request body: {'subnet': {'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-subnet', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:05.389916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:05.395749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Usage tracker for resource:subnet and tenant:38c07c88d2f84b29a9ae8c83558ec74b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:05.403160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:05.410831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:05.425085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Made reservation on behalf of 38c07c88d2f84b29a9ae8c83558ec74b for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:05.429430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Notify callbacks [] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:05.642468 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:05.722120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c0ac6201-c8b1-43a9-a509-5a4ff4e34282,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:05.732063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Checking segment: {'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:05.732418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Network hostable DHCP agents. Network: feb95830-c0c2-46c0-bb35-f2f43605e79a, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:04:05.759942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Network feb95830-c0c2-46c0-bb35-f2f43605e79a is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:04:05.770902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, feb95830-c0c2-46c0-bb35-f2f43605e79a) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:05.778489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:05.779577 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:05.783818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5bec6b23-b830-4ee4-a0ba-71ac0c5a538b None None] Network feb95830-c0c2-46c0-bb35-f2f43605e79a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:04:05.810010 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-238d6aa5-bd7d-4dd0-b996-7b37fabe4d53 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 860 time: 0.4331772 May 12 15:04:05.811815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41252) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:05.820963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Request body: {'router': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:05.826784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:05.830701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Usage tracker for resource:router and tenant:38c07c88d2f84b29a9ae8c83558ec74b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:05.833607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:05.840065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:05.851148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:05.853106 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:05.872853 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:06.041655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-feb95830-c0c2-46c0-bb35-f2f43605e79a', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:04:06.042521 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:06.217878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Allocated IP 172.20.0.2 (feb95830-c0c2-46c0-bb35-f2f43605e79a/c0ac6201-c8b1-43a9-a509-5a4ff4e34282/8d03477f-5238-44f5-8861-02a9c691b0d1) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:06.359504 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:06.470297 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:06.485924 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Transition to ACTIVE for port object 8d03477f-5238-44f5-8861-02a9c691b0d1 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:06.513684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Transition to ACTIVE for port object 8d03477f-5238-44f5-8861-02a9c691b0d1 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:06.520673 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:06.596571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Network feb95830-c0c2-46c0-bb35-f2f43605e79a is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:06.604988 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:06.609275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:06.717604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:06.722769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Pushing event updated for resources: {'Port': ['ID=8d03477f-5238-44f5-8861-02a9c691b0d1,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:06.737249 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:06.737808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:06.738415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:06.738897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:06.739345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:06.739919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:06.740659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:06.741115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:06.742252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:06.742868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:06.743463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:06.743931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Tracked resource versions report: May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: pushed versions: May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: { 'AddressGroup': {'1.2'}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'ConntrackHelper': {'1.0'}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'Log': {'1.0'}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'Network': {'1.1'}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'Port': {'1.7'}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'PortForwarding': {'1.2'}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'QosPolicy': {'1.8'}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'SecurityGroup': {'1.4'}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'SecurityGroupRule': {'1.2'}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'SubPort': {'1.0'}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'Subnet': {'1.1'}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'Trunk': {'1.1'}} May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: consumer versions: May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: { DHCP agent@n-d-841483-1: {}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: HyperV agent@n-h1-841483-1: {}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: HyperV agent@n-h2-841483-1: {}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: L3 agent@n-d-841483-1: {}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: Metadata agent@n-d-841483-1: {}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: Metering agent@n-d-841483-1: {}, May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: Open vSwitch agent@n-d-841483-1: { 'AddressGroup': '1.2', May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'ConntrackHelper': '1.0', May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'Log': '1.0', May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'Network': '1.1', May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'Port': '1.7', May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'PortForwarding': '1.2', May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'QosPolicy': '1.8', May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'SecurityGroup': '1.4', May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'SecurityGroupRule': '1.2', May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'SubPort': '1.0', May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'Subnet': '1.1', May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: 'Trunk': '1.1'}} May 12 15:04:06.745112 n-d-841483-1 neutron-server[88153]: {{(pid=88153) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 12 15:04:06.750794 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:06.758096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Attempting to bind port 8d03477f-5238-44f5-8861-02a9c691b0d1 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:06.758525 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Attempting to bind port 8d03477f-5238-44f5-8861-02a9c691b0d1 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:06.758987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Attempting to bind port 8d03477f-5238-44f5-8861-02a9c691b0d1 on network feb95830-c0c2-46c0-bb35-f2f43605e79a {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:06.764754 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 3, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:06.765199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Checking segment: {'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:06.765699 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:06.766135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Bound using segment: {'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:06.766693 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Bound port: 8d03477f-5238-44f5-8861-02a9c691b0d1, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:06.767192 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:06.879015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] For port 8d03477f-5238-44f5-8861-02a9c691b0d1, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:06.887294 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] For port 8d03477f-5238-44f5-8861-02a9c691b0d1, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=8d03477f-5238-44f5-8861-02a9c691b0d1,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:06.901522 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:06.921118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Allocated IP 172.25.8.63 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/4633083f-cafe-447b-9cf2-a0a5ac5b5c67) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:07.005431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e57ab1e6-3deb-44ad-87d1-354d61fd7758 None None] Pushing event updated for resources: {'Port': ['ID=8d03477f-5238-44f5-8861-02a9c691b0d1,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:07.100052 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:07.137678 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:07.253647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:07.255540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:07.261568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:07.363024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Pushing event updated for resources: {'Port': ['ID=4633083f-cafe-447b-9cf2-a0a5ac5b5c67,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:07.747538 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:08.184424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8d03477f-5238-44f5-8861-02a9c691b0d1 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:08.293591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 8d03477f-5238-44f5-8861-02a9c691b0d1 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:08.310605 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d59731f4-89d8-4df8-b324-ab6a5c332764 None None] Network feb95830-c0c2-46c0-bb35-f2f43605e79a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:04:08.436714 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:08.455691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-28ec57fd-a6d5-4018-8c36-3f9778bc0415 None None] Provisioning for port 8d03477f-5238-44f5-8861-02a9c691b0d1 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:08.474845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-28ec57fd-a6d5-4018-8c36-3f9778bc0415 None None] Provisioning complete for port 8d03477f-5238-44f5-8861-02a9c691b0d1 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:08.475211 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-28ec57fd-a6d5-4018-8c36-3f9778bc0415 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:08.681066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Router 272668a4-245d-4021-b26c-456bc892016b is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:04:08.755038 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-28ec57fd-a6d5-4018-8c36-3f9778bc0415 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:08.801508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-28ec57fd-a6d5-4018-8c36-3f9778bc0415 None None] For port 8d03477f-5238-44f5-8861-02a9c691b0d1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=8d03477f-5238-44f5-8861-02a9c691b0d1,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:08.807991 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-28ec57fd-a6d5-4018-8c36-3f9778bc0415 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:08.887930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28ec57fd-a6d5-4018-8c36-3f9778bc0415 None None] Pushing event updated for resources: {'Port': ['ID=8d03477f-5238-44f5-8861-02a9c691b0d1,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:08.915928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:04:08.927239 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Sync routers for ids ['272668a4-245d-4021-b26c-456bc892016b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:04:08.950745 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Routers {'272668a4-245d-4021-b26c-456bc892016b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:04:08.951393 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:03:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['272668a4-245d-4021-b26c-456bc892016b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:08.961353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:08.965528 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fd6dce64-763e-4bf7-867a-1a395605e281 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 935 time: 3.1473901 May 12 15:04:08.965765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41374) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:09.037652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41384) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:09.041922 n-d-841483-1 neutron-server[88152]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 12 15:04:09.099420 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-a1fb862a-9244-4465-9088-19323958914c tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=9e8c135aef5e45fbb72a8db523f01319&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0606015 May 12 15:04:09.146182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-269a0137-9507-4e4d-b2b8-f7b37ed366bf None None] Provisioning complete for port 8d03477f-5238-44f5-8861-02a9c691b0d1 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:09.146552 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-269a0137-9507-4e4d-b2b8-f7b37ed366bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:09.304397 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Set router 272668a4-245d-4021-b26c-456bc892016b gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:04:09.310088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-e8cae004-b653-4892-860f-f5d3afcc3f8b tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:09.317753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-e8cae004-b653-4892-860f-f5d3afcc3f8b tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2173340 May 12 15:04:09.334261 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-b0d1cffc-02ab-4365-9717-ed811982e38a tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/quotas/9e8c135aef5e45fbb72a8db523f01319 HTTP/1.1" status: 200 len: 375 time: 0.0154324 May 12 15:04:09.397714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-a6ae2370-3866-48c5-9fb5-c1b79b37fe12 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=9e8c135aef5e45fbb72a8db523f01319&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0577669 May 12 15:04:09.678796 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:07Z', 'revision_number': 3, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:09.690116 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Checking router: 272668a4-245d-4021-b26c-456bc892016b for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:04:09.690436 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Updating router 272668a4-245d-4021-b26c-456bc892016b port 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:04:09.764560 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:09.794866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-861034de-cb66-4e72-9d1a-7fa55bb31e59 req-0cf7b22c-2ddc-4a10-9c33-643fb2c2014c tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 210 time: 0.0642943 May 12 15:04:10.006111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:10.137317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8d03477f-5238-44f5-8861-02a9c691b0d1 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:10.344675 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 8d03477f-5238-44f5-8861-02a9c691b0d1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:10.345457 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:10.367668 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:10.398338 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Transition to ACTIVE for port object 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:10.420888 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:10.530653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Allocated IP 172.20.0.1 (feb95830-c0c2-46c0-bb35-f2f43605e79a/c0ac6201-c8b1-43a9-a509-5a4ff4e34282/e6cd121a-66ed-439d-82b8-4e9ff7955245) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:10.549316 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Pushing event updated for resources: {'Port': ['ID=4633083f-cafe-447b-9cf2-a0a5ac5b5c67,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:10.560313 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:10.560690 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:10.561143 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:10.561534 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:10.561849 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:10.562169 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:10.562486 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:10.562802 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:10.563115 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:10.563426 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:10.563747 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:10.564047 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Tracked resource versions report: May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: pushed versions: May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: { 'AddressGroup': {'1.2'}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'ConntrackHelper': {'1.0'}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'Log': {'1.0'}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'Network': {'1.1'}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'Port': {'1.7'}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'PortForwarding': {'1.2'}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'QosPolicy': {'1.8'}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'SecurityGroup': {'1.4'}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'SecurityGroupRule': {'1.2'}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'SubPort': {'1.0'}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'Subnet': {'1.1'}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'Trunk': {'1.1'}} May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: consumer versions: May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: { DHCP agent@n-d-841483-1: {}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: HyperV agent@n-h1-841483-1: {}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: HyperV agent@n-h2-841483-1: {}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: L3 agent@n-d-841483-1: {}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: Metadata agent@n-d-841483-1: {}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: Metering agent@n-d-841483-1: {}, May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: Open vSwitch agent@n-d-841483-1: { 'AddressGroup': '1.2', May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'ConntrackHelper': '1.0', May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'Log': '1.0', May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'Network': '1.1', May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'Port': '1.7', May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'PortForwarding': '1.2', May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'QosPolicy': '1.8', May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'SecurityGroup': '1.4', May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'SecurityGroupRule': '1.2', May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'SubPort': '1.0', May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'Subnet': '1.1', May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: 'Trunk': '1.1'}} May 12 15:04:10.565085 n-d-841483-1 neutron-server[88154]: {{(pid=88154) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 12 15:04:10.654814 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Attempting to bind port 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:10.655403 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Attempting to bind port 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:10.655758 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Attempting to bind port 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:10.676787 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 3, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:10.677178 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:10.681763 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:10.682155 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:10.682981 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Bound port: 4633083f-cafe-447b-9cf2-a0a5ac5b5c67, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:10.683522 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:10.746989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41524) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:10.970219 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] For port 4633083f-cafe-447b-9cf2-a0a5ac5b5c67, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:10.973404 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] For port 4633083f-cafe-447b-9cf2-a0a5ac5b5c67, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4633083f-cafe-447b-9cf2-a0a5ac5b5c67,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:10.979748 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:10.988703 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:11.026678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Transition to ACTIVE for port object e6cd121a-66ed-439d-82b8-4e9ff7955245 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:11.029769 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5199dfff-718f-40f6-92d6-65c79408a965 req-80215fa7-621d-4459-b4cb-eeec8f726fcd tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 210 time: 0.0872369 May 12 15:04:11.075713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:11.124639 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Routers {'272668a4-245d-4021-b26c-456bc892016b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:04:11.125309 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:03:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['272668a4-245d-4021-b26c-456bc892016b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:11.194178 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da146e07-bd82-4294-911d-2760b0214b01 None None] Pushing event updated for resources: {'Port': ['ID=4633083f-cafe-447b-9cf2-a0a5ac5b5c67,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:11.220781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Network feb95830-c0c2-46c0-bb35-f2f43605e79a is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:11.229303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:11.235680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:11.236097 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:11.307312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Pushing event updated for resources: {'Port': ['ID=e6cd121a-66ed-439d-82b8-4e9ff7955245,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:11.325839 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:11.381314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41562) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:11.434801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41570) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:11.442696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:11.462481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Usage tracker for resource:security_group_rule and tenant:aa23b4b92a04456db50ad9b62e36ea08 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:11.480884 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:11.502420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:11.568378 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:11.634512 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3b04d20-915f-4f3e-9deb-e9e03b9ac823 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:11.666689 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] Set router 272668a4-245d-4021-b26c-456bc892016b gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:04:11.682247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c3b04d20-915f-4f3e-9deb-e9e03b9ac823 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:11.705973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c3b04d20-915f-4f3e-9deb-e9e03b9ac823 admin admin] Usage tracker for resource:security_group_rule and tenant:97e531c1f97d42e7b70afac8768f7bbf is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:11.709886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c3b04d20-915f-4f3e-9deb-e9e03b9ac823 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:11.720710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c3b04d20-915f-4f3e-9deb-e9e03b9ac823 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:11.734585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-25a2c641-58db-4a6d-800d-906cbef50e1a None None] Provisioning for port e6cd121a-66ed-439d-82b8-4e9ff7955245 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:11.750890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-25a2c641-58db-4a6d-800d-906cbef50e1a None None] Provisioning complete for port e6cd121a-66ed-439d-82b8-4e9ff7955245 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:11.751281 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-25a2c641-58db-4a6d-800d-906cbef50e1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:11.784204 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:11.840646 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:11.842021 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d87b753-19cc-4110-bfad-fb40fb84613c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:11.908182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-25a2c641-58db-4a6d-800d-906cbef50e1a None None] Port e6cd121a-66ed-439d-82b8-4e9ff7955245 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:04:11.911866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Synchronizing usage tracker for tenant:7110cf9538324f26940a4fb646dfb9ac on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:04:11.972440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Unset dirty status for tenant:7110cf9538324f26940a4fb646dfb9ac on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:04:11.979176 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=aa23b4b92a04456db50ad9b62e36ea08&name=default HTTP/1.1" status: 200 len: 2975 time: 1.2312393 May 12 15:04:11.985637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41620) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:12.096451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=472cd4c3-45d4-4ef8-82c2-e0702dd1e7b2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:12.112822 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3b04d20-915f-4f3e-9deb-e9e03b9ac823 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:12.121528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:12.122002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:12.122472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:12.122932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:12.123400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:12.123855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:12.124304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:12.124761 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:12.125212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:12.125697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:12.126139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:12.126583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-487aa2b8-5ed8-486f-bba1-de02a077433c admin admin] Tracked resource versions report: May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: pushed versions: May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: { 'AddressGroup': {'1.2'}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'ConntrackHelper': {'1.0'}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'Log': {'1.0'}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'Network': {'1.1'}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'Port': {'1.7'}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'PortForwarding': {'1.2'}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'QosPolicy': {'1.8'}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'SecurityGroup': {'1.4'}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'SecurityGroupRule': {'1.2'}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'SubPort': {'1.0'}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'Subnet': {'1.1'}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'Trunk': {'1.1'}} May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: consumer versions: May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: { DHCP agent@n-d-841483-1: {}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: HyperV agent@n-h1-841483-1: {}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: HyperV agent@n-h2-841483-1: {}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: L3 agent@n-d-841483-1: {}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: Metadata agent@n-d-841483-1: {}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: Metering agent@n-d-841483-1: {}, May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: Open vSwitch agent@n-d-841483-1: { 'AddressGroup': '1.2', May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'ConntrackHelper': '1.0', May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'Log': '1.0', May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'Network': '1.1', May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'Port': '1.7', May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'PortForwarding': '1.2', May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'QosPolicy': '1.8', May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'SecurityGroup': '1.4', May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'SecurityGroupRule': '1.2', May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'SubPort': '1.0', May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'Subnet': '1.1', May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: 'Trunk': '1.1'}} May 12 15:04:12.127755 n-d-841483-1 neutron-server[88152]: {{(pid=88152) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 12 15:04:12.134818 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3b04d20-915f-4f3e-9deb-e9e03b9ac823 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:12.141569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:12.151938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:12.152156 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:07Z', 'revision_number': 3, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:12.152837 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:12.158218 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be3fc926-be4e-48f5-b828-dde685feb038 None None] The sync data for ids ['272668a4-245d-4021-b26c-456bc892016b'] in n-d-841483-1 is: [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:07Z', 'revision_number': 3, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:04:12.183767 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c3b04d20-915f-4f3e-9deb-e9e03b9ac823 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=97e531c1f97d42e7b70afac8768f7bbf&name=default HTTP/1.1" status: 200 len: 2975 time: 0.7971542 May 12 15:04:12.189849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41632) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:12.230341 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-928275fe-0453-4897-9c84-d6cd87bc0cd7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:12.257304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41642) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:12.307176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3b04d20-915f-4f3e-9deb-e9e03b9ac823 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8e57b264-41f9-4a9c-b76f-5f0f52b4176d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:12.369311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.76', 61658) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:12.397201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8d87b753-19cc-4110-bfad-fb40fb84613c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:12.402716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8d87b753-19cc-4110-bfad-fb40fb84613c admin admin] Usage tracker for resource:security_group_rule and tenant:64731f8bd3394796831a636a7bb1153d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:12.409228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8d87b753-19cc-4110-bfad-fb40fb84613c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:12.428293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8d87b753-19cc-4110-bfad-fb40fb84613c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:12.453836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1563ca84-d42a-4190-9e86-b42664a423fe req-747ae064-1e28-4ea8-9600-e3fa8cb8a78d tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=00830df80689431b80f1e5a51c5f6f9e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1493390 May 12 15:04:12.466231 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-928275fe-0453-4897-9c84-d6cd87bc0cd7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:12.470897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Network feb95830-c0c2-46c0-bb35-f2f43605e79a is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:12.477028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:12.493864 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3beb38a-4bf9-4d55-8121-4946696b8421 req-11d1f89f-fd19-43a6-9436-d019afd73a89 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 210 time: 0.1195717 May 12 15:04:12.571849 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:12.588326 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-992b2fd8-d0fa-4e39-9417-ca859bd735b5 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=9e8c135aef5e45fbb72a8db523f01319&shared=False HTTP/1.1" status: 200 len: 213 time: 0.2131557 May 12 15:04:12.633865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Pushing event updated for resources: {'Port': ['ID=e6cd121a-66ed-439d-82b8-4e9ff7955245,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:12.649514 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-42d4f2b4-26e7-4a9f-b481-93a7fe6827a1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:12.863502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Router 272668a4-245d-4021-b26c-456bc892016b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:04:12.872994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-43ba4ec6-b2b5-4b4b-90ff-cecad8feb894 None None] Provisioning complete for port e6cd121a-66ed-439d-82b8-4e9ff7955245 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:12.873702 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d87b753-19cc-4110-bfad-fb40fb84613c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:12.876560 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-43ba4ec6-b2b5-4b4b-90ff-cecad8feb894 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:12.941170 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-43ba4ec6-b2b5-4b4b-90ff-cecad8feb894 None None] Port e6cd121a-66ed-439d-82b8-4e9ff7955245 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:04:12.976144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d87b753-19cc-4110-bfad-fb40fb84613c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:13.016965 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2bd2cf66-15d3-4a71-b98d-8cf3ed0b3c35 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:13.041696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d87b753-19cc-4110-bfad-fb40fb84613c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59f591a1-aba3-45de-b74a-bed9d079a869,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:13.073977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1563ca84-d42a-4190-9e86-b42664a423fe req-baff4c23-6f03-4e55-ba68-074c491a93ef tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:13.075450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1563ca84-d42a-4190-9e86-b42664a423fe req-baff4c23-6f03-4e55-ba68-074c491a93ef tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.6020391 May 12 15:04:13.076064 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-928275fe-0453-4897-9c84-d6cd87bc0cd7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:13.079506 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8d87b753-19cc-4110-bfad-fb40fb84613c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=64731f8bd3394796831a636a7bb1153d&name=default HTTP/1.1" status: 200 len: 2975 time: 1.6434624 May 12 15:04:13.082019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41676) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:13.113638 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2bd2cf66-15d3-4a71-b98d-8cf3ed0b3c35 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:13.150849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-928275fe-0453-4897-9c84-d6cd87bc0cd7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=472cd4c3-45d4-4ef8-82c2-e0702dd1e7b2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:13.166063 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1563ca84-d42a-4190-9e86-b42664a423fe req-1d081cb6-e3be-4659-83ae-150f42268fe5 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/quotas/00830df80689431b80f1e5a51c5f6f9e HTTP/1.1" status: 200 len: 375 time: 0.0659757 May 12 15:04:13.266934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-1fa0a554-25e5-410b-ad1f-758c58884a30 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:13.269110 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-1fa0a554-25e5-410b-ad1f-758c58884a30 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5014577 May 12 15:04:13.287309 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-928275fe-0453-4897-9c84-d6cd87bc0cd7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:13.291939 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-928275fe-0453-4897-9c84-d6cd87bc0cd7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/472cd4c3-45d4-4ef8-82c2-e0702dd1e7b2 HTTP/1.1" status: 204 len: 168 time: 1.3053243 May 12 15:04:13.315545 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1563ca84-d42a-4190-9e86-b42664a423fe req-2994fc62-5c63-4822-9c74-dca9f6c5315f tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=00830df80689431b80f1e5a51c5f6f9e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1485319 May 12 15:04:13.343416 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2bd2cf66-15d3-4a71-b98d-8cf3ed0b3c35 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:13.344895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:04:13.354503 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-195dcbd9-c61b-40e3-ab79-06626dabd0b3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:13.394908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-195dcbd9-c61b-40e3-ab79-06626dabd0b3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:13.412007 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8d1e6054-8f02-4780-8a97-7a676fc6ea1b admin admin] 10.222.0.82 "PUT /v2.0/routers/272668a4-245d-4021-b26c-456bc892016b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4363654 May 12 15:04:13.416576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Request body: {'port': {'device_id': '048a92c4-13d1-40e6-9714-2c96dd562708', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '9e8c135aef5e45fbb72a8db523f01319'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:13.456422 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2bd2cf66-15d3-4a71-b98d-8cf3ed0b3c35 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:13.463234 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2bd2cf66-15d3-4a71-b98d-8cf3ed0b3c35 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8e57b264-41f9-4a9c-b76f-5f0f52b4176d HTTP/1.1" status: 204 len: 168 time: 1.2691336 May 12 15:04:13.495947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bd2cf66-15d3-4a71-b98d-8cf3ed0b3c35 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e57b264-41f9-4a9c-b76f-5f0f52b4176d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:13.548938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-195dcbd9-c61b-40e3-ab79-06626dabd0b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:13.637835 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-195dcbd9-c61b-40e3-ab79-06626dabd0b3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:13.646299 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-195dcbd9-c61b-40e3-ab79-06626dabd0b3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/59f591a1-aba3-45de-b74a-bed9d079a869 HTTP/1.1" status: 204 len: 168 time: 0.5631835 May 12 15:04:13.650128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-195dcbd9-c61b-40e3-ab79-06626dabd0b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59f591a1-aba3-45de-b74a-bed9d079a869,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:14.030002 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1932211b-b88d-4a31-99d9-64912afc15a5 req-3941ed23-84bf-4abe-82e6-fa8d62b528a2 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 210 time: 0.2547724 May 12 15:04:14.064777 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecc1b17b-f8be-453e-8b2c-a79380ff0dc0 req-fb4078fd-fc69-4b96-8ed2-f2126c762e82 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 210 time: 0.1776466 May 12 15:04:14.174583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:14.188886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:14.192967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41720) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:14.200334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Usage tracker for resource:port and tenant:9e8c135aef5e45fbb72a8db523f01319 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:14.207702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:14.218261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:14.237343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Made reservation on behalf of 9e8c135aef5e45fbb72a8db523f01319 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:14.246232 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:14.278910 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f98defd-18f5-4134-8b0f-c441c6716cac admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:14.294202 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:14.347206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:14.362439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Usage tracker for resource:security_group_rule and tenant:9e8c135aef5e45fbb72a8db523f01319 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:14.363757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7f98defd-18f5-4134-8b0f-c441c6716cac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:14.369685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:14.389178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7f98defd-18f5-4134-8b0f-c441c6716cac admin admin] Usage tracker for resource:security_group_rule and tenant:2986e23f93084432b43af1228b455419 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:14.394894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:14.401519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7f98defd-18f5-4134-8b0f-c441c6716cac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:14.422540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7f98defd-18f5-4134-8b0f-c441c6716cac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:14.510319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:14.517083 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:14.517483 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:14.700574 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f98defd-18f5-4134-8b0f-c441c6716cac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:14.708940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f98defd-18f5-4134-8b0f-c441c6716cac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:14.750905 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:14.760507 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:14.810200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f98defd-18f5-4134-8b0f-c441c6716cac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11937774-7182-4b38-9949-e8dd2e814975,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:14.868470 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:14.885532 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7f98defd-18f5-4134-8b0f-c441c6716cac admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2986e23f93084432b43af1228b455419&name=default HTTP/1.1" status: 200 len: 2975 time: 0.6912301 May 12 15:04:14.888262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41738) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:14.964209 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 4633083f-cafe-447b-9cf2-a0a5ac5b5c67, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4633083f-cafe-447b-9cf2-a0a5ac5b5c67,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:14.968456 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3447b6a3-306c-4065-bfa5-eb2b18343703 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:14.974052 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:15.031370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41742) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:15.066525 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-275cc95e-fc58-402c-ad56-568d08f9d519 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:15.118257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=4633083f-cafe-447b-9cf2-a0a5ac5b5c67,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:15.181355 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5508168b-f4e6-4dc1-a69a-452a4363fd54 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:15.249196 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-275cc95e-fc58-402c-ad56-568d08f9d519 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:15.277588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5508168b-f4e6-4dc1-a69a-452a4363fd54 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:15.318947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5508168b-f4e6-4dc1-a69a-452a4363fd54 admin admin] Usage tracker for resource:security_group_rule and tenant:982bc33fb17e4d66b88a1a82ba385655 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:15.327083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5508168b-f4e6-4dc1-a69a-452a4363fd54 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:15.353445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5508168b-f4e6-4dc1-a69a-452a4363fd54 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:15.401093 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-275cc95e-fc58-402c-ad56-568d08f9d519 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:15.434825 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dfb6f07b-2358-44dd-9671-b7cc9df7e053 req-48205d56-494e-4849-8ffe-2191eb41025c tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 210 time: 0.2796147 May 12 15:04:15.459930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-275cc95e-fc58-402c-ad56-568d08f9d519 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11937774-7182-4b38-9949-e8dd2e814975,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:15.494803 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-275cc95e-fc58-402c-ad56-568d08f9d519 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:15.496271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-275cc95e-fc58-402c-ad56-568d08f9d519 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/11937774-7182-4b38-9949-e8dd2e814975 HTTP/1.1" status: 204 len: 168 time: 0.6065514 May 12 15:04:15.511620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Pushing event updated for resources: {'SecurityGroup': ['ID=738764da-625f-4d95-abf9-0b874356716f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:15.601351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41756) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:15.657207 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9340370-e8cc-40de-9c45-7c21f0353c3b req-71b950a1-e1fb-4954-a1ec-d36e9d62a6ca tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 210 time: 0.2367263 May 12 15:04:15.680439 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5508168b-f4e6-4dc1-a69a-452a4363fd54 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:15.702257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Allocated IP 192.168.233.133 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/57abba16-9897-4390-97ae-11192c4c120c) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:15.738604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5508168b-f4e6-4dc1-a69a-452a4363fd54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:15.789438 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1bb3f5e4-85af-4ae6-8183-2971e0402cea admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:15.895804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1bb3f5e4-85af-4ae6-8183-2971e0402cea admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:15.922363 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5508168b-f4e6-4dc1-a69a-452a4363fd54 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=982bc33fb17e4d66b88a1a82ba385655&name=default HTTP/1.1" status: 200 len: 2975 time: 0.8807404 May 12 15:04:15.930255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1bb3f5e4-85af-4ae6-8183-2971e0402cea admin admin] Usage tracker for resource:security_group_rule and tenant:6ab3bd8e57854c4a9561055e977a0cae is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:15.933618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41762) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:15.938415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1bb3f5e4-85af-4ae6-8183-2971e0402cea admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:15.952675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5508168b-f4e6-4dc1-a69a-452a4363fd54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37d8eca3-ee70-4a5b-8dc1-8bb81f7fdda8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:15.958596 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:15.961709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1bb3f5e4-85af-4ae6-8183-2971e0402cea admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:16.006643 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:16.059521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Sync routers for ids ['272668a4-245d-4021-b26c-456bc892016b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:04:16.077229 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a030ed1e-84ef-430d-96f8-b6a70668ab8b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:16.077459 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Routers {'272668a4-245d-4021-b26c-456bc892016b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:04:16.080401 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:04:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['272668a4-245d-4021-b26c-456bc892016b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:16.144709 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a030ed1e-84ef-430d-96f8-b6a70668ab8b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:16.189594 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:16.219827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Transition to ACTIVE for port object 57abba16-9897-4390-97ae-11192c4c120c will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:16.231317 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1bb3f5e4-85af-4ae6-8183-2971e0402cea admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:16.239697 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1bb3f5e4-85af-4ae6-8183-2971e0402cea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:16.275464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:16.298732 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1bb3f5e4-85af-4ae6-8183-2971e0402cea admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6ab3bd8e57854c4a9561055e977a0cae&name=default HTTP/1.1" status: 200 len: 2975 time: 0.6951137 May 12 15:04:16.299705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41770) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:16.303514 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a030ed1e-84ef-430d-96f8-b6a70668ab8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:16.316121 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:16.330944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bb3f5e4-85af-4ae6-8183-2971e0402cea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2cdb872e-fe32-46a1-86bc-e8d94c33d016,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:16.380337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a030ed1e-84ef-430d-96f8-b6a70668ab8b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37d8eca3-ee70-4a5b-8dc1-8bb81f7fdda8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:16.428716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Pushing event updated for resources: {'Port': ['ID=57abba16-9897-4390-97ae-11192c4c120c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:16.454248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a030ed1e-84ef-430d-96f8-b6a70668ab8b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:16.455838 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a030ed1e-84ef-430d-96f8-b6a70668ab8b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/37d8eca3-ee70-4a5b-8dc1-8bb81f7fdda8 HTTP/1.1" status: 204 len: 168 time: 0.5203638 May 12 15:04:16.467227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:16.469686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:16.477605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:16.493866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:16.494726 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:16.527530 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-baf0efce-2479-420c-ae7f-67a29a667a65 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:16.552653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.76', 61662) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:16.618648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41784) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:16.628112 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-baf0efce-2479-420c-ae7f-67a29a667a65 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:16.672817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Request body: {'network': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-158859462-network', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:16.691395 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1563ca84-d42a-4190-9e86-b42664a423fe req-fea5e787-db5f-4596-a240-453eb3d00a5a tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=00830df80689431b80f1e5a51c5f6f9e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1124933 May 12 15:04:16.692457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:16.693794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-449871d4-5718-4dfc-9f53-acb69a017ea2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 3.3213527 May 12 15:04:16.708580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Usage tracker for resource:network and tenant:22609d3eca554e908455a9f04efb4ffa is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:16.712262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:16.746619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:16.783022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-b10724dd-24eb-4c66-94dc-c91c5e570d22 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:04:16.791043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-b10724dd-24eb-4c66-94dc-c91c5e570d22 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0259511 May 12 15:04:16.795515 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Made reservation on behalf of 22609d3eca554e908455a9f04efb4ffa for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:16.817352 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:16.877015 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:16.934523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:16.957503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Usage tracker for resource:security_group_rule and tenant:22609d3eca554e908455a9f04efb4ffa is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:16.962051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:16.986664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:17.008451 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Set router 272668a4-245d-4021-b26c-456bc892016b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:04:17.036142 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-baf0efce-2479-420c-ae7f-67a29a667a65 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:17.094474 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-baf0efce-2479-420c-ae7f-67a29a667a65 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:17.099277 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-baf0efce-2479-420c-ae7f-67a29a667a65 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2cdb872e-fe32-46a1-86bc-e8d94c33d016 HTTP/1.1" status: 204 len: 168 time: 0.7904592 May 12 15:04:17.106049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baf0efce-2479-420c-ae7f-67a29a667a65 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2cdb872e-fe32-46a1-86bc-e8d94c33d016,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:17.111007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:17.111672 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:17.278920 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:17.287095 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:17.298520 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e290f4c5-fb46-4391-a165-2450c5ab2164 req-a1b39b4c-a999-424e-b5d5-18f3adbd2561 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 210 time: 0.2820506 May 12 15:04:17.313304 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 583} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:04:17.334597 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:17.337836 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Added segment 3f66bf84-0862-4ccb-a6ee-6fe3b88a805c of type vlan for network 889f9b5f-a864-4a4d-a337-581795e1561e May 12 15:04:17.409627 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:17.458945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641c4a55-fd57-4c28-aef6-04ed2a930577 req-16ea08ed-63de-4ac3-aa01-6926234cc5b8 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:17.458945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-641c4a55-fd57-4c28-aef6-04ed2a930577 req-16ea08ed-63de-4ac3-aa01-6926234cc5b8 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Synchronizing usage tracker for tenant:9e8c135aef5e45fbb72a8db523f01319 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:04:17.476324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c8c5c34e-628c-438a-b175-404b485d8b09 None None] Provisioning for port 57abba16-9897-4390-97ae-11192c4c120c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:17.478236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1563ca84-d42a-4190-9e86-b42664a423fe req-b864aa57-c238-4f49-a951-c295d28e3013 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:17.480024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1563ca84-d42a-4190-9e86-b42664a423fe req-b864aa57-c238-4f49-a951-c295d28e3013 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.7629280 May 12 15:04:17.498417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Request body: {'port': {'device_id': '5cd1d64a-2898-4f90-beb1-fad4769e0b7c', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '00830df80689431b80f1e5a51c5f6f9e'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:17.505020 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:17.510685 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:17.511588 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:17.613654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-641c4a55-fd57-4c28-aef6-04ed2a930577 req-16ea08ed-63de-4ac3-aa01-6926234cc5b8 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Unset dirty status for tenant:9e8c135aef5e45fbb72a8db523f01319 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:04:17.622794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-641c4a55-fd57-4c28-aef6-04ed2a930577 req-16ea08ed-63de-4ac3-aa01-6926234cc5b8 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 936 time: 0.6049323 May 12 15:04:17.731454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5069deef-9651-4e54-acbf-0d17d7f18e7f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:17.760098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-641c4a55-fd57-4c28-aef6-04ed2a930577 req-0bde2ce6-dc2e-4e21-bbae-87220f478479 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Synchronizing usage tracker for tenant:9e8c135aef5e45fbb72a8db523f01319 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:04:17.836802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] Pushing event updated for resources: {'Network': ['ID=889f9b5f-a864-4a4d-a337-581795e1561e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:17.856617 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-550a5c65-fbe9-4c9d-9732-3e80bdc9fa64 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 896 time: 1.2364500 May 12 15:04:17.860105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41812) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:17.871214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Request body: {'subnet': {'network_id': '889f9b5f-a864-4a4d-a337-581795e1561e', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-158859462-subnet', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:17.900827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:17.909372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Usage tracker for resource:subnet and tenant:22609d3eca554e908455a9f04efb4ffa is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:17.915487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:17.934418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:17.935767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c8c5c34e-628c-438a-b175-404b485d8b09 None None] Provisioning complete for port 57abba16-9897-4390-97ae-11192c4c120c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:17.937229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:17.937543 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c8c5c34e-628c-438a-b175-404b485d8b09 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:17.945655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Usage tracker for resource:port and tenant:00830df80689431b80f1e5a51c5f6f9e is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:17.953478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:17.970024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:17.988010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Made reservation on behalf of 22609d3eca554e908455a9f04efb4ffa for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:17.988394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-641c4a55-fd57-4c28-aef6-04ed2a930577 req-0bde2ce6-dc2e-4e21-bbae-87220f478479 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Unset dirty status for tenant:9e8c135aef5e45fbb72a8db523f01319 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:04:17.991502 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Notify callbacks [] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:18.002275 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-641c4a55-fd57-4c28-aef6-04ed2a930577 req-0bde2ce6-dc2e-4e21-bbae-87220f478479 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3783457 May 12 15:04:18.006838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Made reservation on behalf of 00830df80689431b80f1e5a51c5f6f9e for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:18.029565 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:18.066838 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:18.114214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:18.137670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Request body: {'port': {'device_id': '048a92c4-13d1-40e6-9714-2c96dd562708', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:18.138874 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c8c5c34e-628c-438a-b175-404b485d8b09 None None] Port 57abba16-9897-4390-97ae-11192c4c120c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:04:18.143324 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:18.300253 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Usage tracker for resource:security_group_rule and tenant:00830df80689431b80f1e5a51c5f6f9e is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:18.339129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:18.387166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:18.412121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:18.426757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 889f9b5f-a864-4a4d-a337-581795e1561e details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:04:18.500238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 2, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:18.522485 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Checking router: 272668a4-245d-4021-b26c-456bc892016b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:04:18.522485 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Updating router 272668a4-245d-4021-b26c-456bc892016b port e6cd121a-66ed-439d-82b8-4e9ff7955245 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:04:18.580617 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:18.581276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Pushing event updated for resources: {'Subnet': ['ID=e47e554d-eb97-4217-b6e3-2120f84b68bf,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:18.654945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Checking segment: {'id': '3f66bf84-0862-4ccb-a6ee-6fe3b88a805c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': '889f9b5f-a864-4a4d-a337-581795e1561e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:18.656164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Network hostable DHCP agents. Network: 889f9b5f-a864-4a4d-a337-581795e1561e, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:04:18.714430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Network 889f9b5f-a864-4a4d-a337-581795e1561e is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:04:18.733301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-53a32405-91f1-4466-a503-044df8895983 req-84c13c53-306f-4c3b-a113-69eee574d667 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 210 time: 0.1188250 May 12 15:04:18.745234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 889f9b5f-a864-4a4d-a337-581795e1561e) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:18.766878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:18.772741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a19060ab-b125-41d6-ac1c-6d243dcc1e99 None None] Network 889f9b5f-a864-4a4d-a337-581795e1561e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:04:18.777700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:18.851088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41836) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:18.852987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1dd10762-3d08-45a9-b215-0fb71248b49d admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 859 time: 0.9910207 May 12 15:04:18.876357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Request body: {'router': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-158859462-router', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:18.891363 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:18.893541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:18.911433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Usage tracker for resource:router and tenant:22609d3eca554e908455a9f04efb4ffa is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:18.927282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:18.955680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:19.043661 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:19.052892 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:19.207739 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:19.208914 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:19.226185 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:19.531559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-889f9b5f-a864-4a4d-a337-581795e1561e', 'network_id': '889f9b5f-a864-4a4d-a337-581795e1561e', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'fixed_ips': [{'subnet_id': 'e47e554d-eb97-4217-b6e3-2120f84b68bf'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:04:19.533098 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:19.781878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Pushing event updated for resources: {'SecurityGroup': ['ID=523e81ba-8739-440a-b9d0-888a323ce6a0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:19.926960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Allocated IP 172.20.0.2 (889f9b5f-a864-4a4d-a337-581795e1561e/e47e554d-eb97-4217-b6e3-2120f84b68bf/a78e82c1-0d04-45cd-9962-f5045e508e70) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:19.967094 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:20.119747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Transition to ACTIVE for port object e6cd121a-66ed-439d-82b8-4e9ff7955245 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:20.139752 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:20.171777 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:20.354621 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-90d3124a-7ccf-4064-a578-d77873d5fc6f req-4cf1ac7a-c60a-44d9-b281-ad48f17ddc51 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 210 time: 0.1711297 May 12 15:04:20.469539 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:20.484069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Transition to ACTIVE for port object a78e82c1-0d04-45cd-9962-f5045e508e70 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:20.492152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05e7be64-a2c9-4909-a07a-818f7efb2109 req-68e20623-ebdd-4d81-9902-040fca867b6e tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:20.503639 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05e7be64-a2c9-4909-a07a-818f7efb2109 req-68e20623-ebdd-4d81-9902-040fca867b6e tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 936 time: 1.2010202 May 12 15:04:20.510241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Transition to ACTIVE for port object a78e82c1-0d04-45cd-9962-f5045e508e70 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:20.550564 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:20.716584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Network 889f9b5f-a864-4a4d-a337-581795e1561e is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:20.726021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:20.821791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:20.855417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05e7be64-a2c9-4909-a07a-818f7efb2109 req-afc0c80c-6259-4d3b-b3e8-1a4efdcf5173 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3263559 May 12 15:04:21.045233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 57abba16-9897-4390-97ae-11192c4c120c {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:21.050371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Attempting to bind port e6cd121a-66ed-439d-82b8-4e9ff7955245 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:21.051343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Attempting to bind port e6cd121a-66ed-439d-82b8-4e9ff7955245 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:21.051930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Attempting to bind port e6cd121a-66ed-439d-82b8-4e9ff7955245 on network feb95830-c0c2-46c0-bb35-f2f43605e79a {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:21.073157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:21.103950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Transition to ACTIVE for port object 57abba16-9897-4390-97ae-11192c4c120c will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:21.125597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:21.126503 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Checking segment: {'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:21.127670 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:21.128404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Bound using segment: {'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:21.132102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Bound port: e6cd121a-66ed-439d-82b8-4e9ff7955245, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:21.133281 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:21.159419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Attempting to bind port a78e82c1-0d04-45cd-9962-f5045e508e70 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:21.160702 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Attempting to bind port a78e82c1-0d04-45cd-9962-f5045e508e70 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '3f66bf84-0862-4ccb-a6ee-6fe3b88a805c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': '889f9b5f-a864-4a4d-a337-581795e1561e'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:21.161091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Attempting to bind port a78e82c1-0d04-45cd-9962-f5045e508e70 on network 889f9b5f-a864-4a4d-a337-581795e1561e {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:21.162415 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:21.205675 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9d9306d-86f0-426d-93d8-d842d802712b None None] Pushing event updated for resources: {'Port': ['ID=e6cd121a-66ed-439d-82b8-4e9ff7955245,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:21.399355 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Pushing event updated for resources: {'Port': ['ID=a78e82c1-0d04-45cd-9962-f5045e508e70,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:21.409641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:21.410005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Checking segment: {'id': '3f66bf84-0862-4ccb-a6ee-6fe3b88a805c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': '889f9b5f-a864-4a4d-a337-581795e1561e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:21.416168 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:21.416620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Bound using segment: {'id': '3f66bf84-0862-4ccb-a6ee-6fe3b88a805c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': '889f9b5f-a864-4a4d-a337-581795e1561e'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:21.417068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Bound port: a78e82c1-0d04-45cd-9962-f5045e508e70, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3f66bf84-0862-4ccb-a6ee-6fe3b88a805c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': '889f9b5f-a864-4a4d-a337-581795e1561e'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:21.417494 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:21.665184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] For port e6cd121a-66ed-439d-82b8-4e9ff7955245, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:21.673968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] For port e6cd121a-66ed-439d-82b8-4e9ff7955245, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e6cd121a-66ed-439d-82b8-4e9ff7955245,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:21.696258 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:21.783635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9d9306d-86f0-426d-93d8-d842d802712b None None] Pushing event updated for resources: {'Port': ['ID=e6cd121a-66ed-439d-82b8-4e9ff7955245,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:21.840864 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Pushing event updated for resources: {'Port': ['ID=57abba16-9897-4390-97ae-11192c4c120c,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:21.848808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Allocated IP 192.168.233.54 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/343f050d-81d2-410f-a8ab-b2bdef562d11) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:21.878070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Routers {'272668a4-245d-4021-b26c-456bc892016b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:04:21.894493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:04:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['272668a4-245d-4021-b26c-456bc892016b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:22.119168 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00a8ca31-0a3d-4c21-b992-712f73b974ca req-49e74bc9-c4d1-432b-a8f7-6e0061350cf6 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 210 time: 0.3800371 May 12 15:04:22.365415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] For port a78e82c1-0d04-45cd-9962-f5045e508e70, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:22.379882 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:22.390230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] For port a78e82c1-0d04-45cd-9962-f5045e508e70, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a78e82c1-0d04-45cd-9962-f5045e508e70,segment=NetworkSegment(3f66bf84-0862-4ccb-a6ee-6fe3b88a805c),segment_id=3f66bf84-0862-4ccb-a6ee-6fe3b88a805c)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:22.439056 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:22.601891 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad499d6-9962-498d-9a56-eeaad39962e0 None None] Pushing event updated for resources: {'Port': ['ID=a78e82c1-0d04-45cd-9962-f5045e508e70,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:22.616442 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] Set router 272668a4-245d-4021-b26c-456bc892016b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:04:22.636184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Attempting to bind port 57abba16-9897-4390-97ae-11192c4c120c on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:22.638631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Attempting to bind port 57abba16-9897-4390-97ae-11192c4c120c by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:22.645752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Attempting to bind port 57abba16-9897-4390-97ae-11192c4c120c on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:22.701765 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:22.744276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Port 57abba16-9897-4390-97ae-11192c4c120c on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:04:22.745472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Attempting to bind port 57abba16-9897-4390-97ae-11192c4c120c on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:23.106862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41934) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:23.142058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Allocated IP 172.25.8.10 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/b968cd57-4673-4ade-9c43-dda43d9558b7) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:23.288619 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f676862-b639-4f87-8a31-e46937400d2e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:23.308517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9f676862-b639-4f87-8a31-e46937400d2e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:23.314030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9f676862-b639-4f87-8a31-e46937400d2e admin admin] Usage tracker for resource:security_group_rule and tenant:bc595cd296494788a4074f54b311f72a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:23.317277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9f676862-b639-4f87-8a31-e46937400d2e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:23.324025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9f676862-b639-4f87-8a31-e46937400d2e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:23.428820 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f676862-b639-4f87-8a31-e46937400d2e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:23.433713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:23.435575 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f676862-b639-4f87-8a31-e46937400d2e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:23.436055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:23.436999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:23.437684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Bound port: 57abba16-9897-4390-97ae-11192c4c120c, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:23.439861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:23.466727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:21Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:23.476925 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ccc96165-b61f-4408-a676-0696353ef74e None None] The sync data for ids ['272668a4-245d-4021-b26c-456bc892016b'] in n-d-841483-1 is: [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:21Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:04:23.480499 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9f676862-b639-4f87-8a31-e46937400d2e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bc595cd296494788a4074f54b311f72a&name=default HTTP/1.1" status: 200 len: 2976 time: 0.3719993 May 12 15:04:23.501428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f676862-b639-4f87-8a31-e46937400d2e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a229473-8b92-4979-9399-1145691e502e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:23.503575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41950) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:23.582280 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec2bae22-a4fa-4926-ab6c-fada7f0ff40e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:23.645192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-c692b9f9-06b7-46fb-a525-0c0a22abaa4e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=146fd417ad5d4f85ae5ce85d279642a7&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1815288 May 12 15:04:23.665619 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec2bae22-a4fa-4926-ab6c-fada7f0ff40e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:23.754704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec2bae22-a4fa-4926-ab6c-fada7f0ff40e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:23.785331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec2bae22-a4fa-4926-ab6c-fada7f0ff40e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a229473-8b92-4979-9399-1145691e502e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:23.796753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec2bae22-a4fa-4926-ab6c-fada7f0ff40e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:23.798324 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ec2bae22-a4fa-4926-ab6c-fada7f0ff40e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5a229473-8b92-4979-9399-1145691e502e HTTP/1.1" status: 204 len: 168 time: 0.2938020 May 12 15:04:24.225187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11691722-e4bc-47f9-835f-553b253f41d1 None None] Network 889f9b5f-a864-4a4d-a337-581795e1561e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:04:24.246627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] For port 57abba16-9897-4390-97ae-11192c4c120c, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:24.251343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] For port 57abba16-9897-4390-97ae-11192c4c120c, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=57abba16-9897-4390-97ae-11192c4c120c,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:24.282540 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:24.341338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ddcf73-f9ee-43fc-aebb-0ca1e0d99b66 req-a77b8707-ffdc-4f0f-be36-07da36374576 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:24.343840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15ddcf73-f9ee-43fc-aebb-0ca1e0d99b66 req-a77b8707-ffdc-4f0f-be36-07da36374576 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 948 time: 1.8808923 May 12 15:04:24.345156 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:24.376629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41958) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:24.411934 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:24.416564 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-388af45f-ebe6-4f55-b6ad-b7841950732b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:24.431933 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-171f9a49-0cb6-4c78-a1d0-ce2545b3cbbb None None] Provisioning for port a78e82c1-0d04-45cd-9962-f5045e508e70 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:24.491028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-388af45f-ebe6-4f55-b6ad-b7841950732b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:24.505356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-388af45f-ebe6-4f55-b6ad-b7841950732b admin admin] Usage tracker for resource:security_group_rule and tenant:0077d2408d2b4016bda9e5513fb12b19 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:24.511502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-388af45f-ebe6-4f55-b6ad-b7841950732b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:24.542995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-388af45f-ebe6-4f55-b6ad-b7841950732b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:24.543712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:24.544319 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:24.547718 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] 10.222.0.76 "PUT /v2.0/ports/57abba16-9897-4390-97ae-11192c4c120c HTTP/1.1" status: 200 len: 1096 time: 7.2168827 May 12 15:04:24.558454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '048a92c4-13d1-40e6-9714-2c96dd562708', 'tag': '57abba16-9897-4390-97ae-11192c4c120c'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:24.910080 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-388af45f-ebe6-4f55-b6ad-b7841950732b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:24.917262 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-388af45f-ebe6-4f55-b6ad-b7841950732b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:24.999161 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-388af45f-ebe6-4f55-b6ad-b7841950732b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0077d2408d2b4016bda9e5513fb12b19&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6212618 May 12 15:04:25.008132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41968) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:25.052806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-388af45f-ebe6-4f55-b6ad-b7841950732b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b69774f7-8ce6-41ca-bdb4-a8d6fbe90812,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:25.084761 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15ddcf73-f9ee-43fc-aebb-0ca1e0d99b66 req-ad44c2f5-61c8-4df5-8a8d-9bd1a49c2d37 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7198145 May 12 15:04:25.155504 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e6cd121a-66ed-439d-82b8-4e9ff7955245 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:25.197113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:25.262714 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d04d26b-abd6-4f45-9d0e-297bf70c69dd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:25.318518 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d04d26b-abd6-4f45-9d0e-297bf70c69dd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:25.326303 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:25.388780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Transition to ACTIVE for port object 343f050d-81d2-410f-a8ab-b2bdef562d11 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:25.407049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port e6cd121a-66ed-439d-82b8-4e9ff7955245 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:25.420933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:25.430081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port e6cd121a-66ed-439d-82b8-4e9ff7955245 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:25.430724 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:25.431710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:25.453444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d04d26b-abd6-4f45-9d0e-297bf70c69dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:25.473291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d04d26b-abd6-4f45-9d0e-297bf70c69dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b69774f7-8ce6-41ca-bdb4-a8d6fbe90812,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:25.485809 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d04d26b-abd6-4f45-9d0e-297bf70c69dd admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:25.487731 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4d04d26b-abd6-4f45-9d0e-297bf70c69dd admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b69774f7-8ce6-41ca-bdb4-a8d6fbe90812 HTTP/1.1" status: 204 len: 168 time: 0.4756634 May 12 15:04:25.647082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-3f475ff0-cd13-4406-8188-3fb4dc3d61db tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:25.654435 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:25.655591 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-3f475ff0-cd13-4406-8188-3fb4dc3d61db tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 1.9957120 May 12 15:04:25.673808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fb17e54-78ad-4b39-88be-d3eddb2bfe86 service neutron] Pushing event updated for resources: {'Port': ['ID=57abba16-9897-4390-97ae-11192c4c120c,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:25.692235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port e6cd121a-66ed-439d-82b8-4e9ff7955245, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e6cd121a-66ed-439d-82b8-4e9ff7955245,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:25.699230 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:25.699987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a78e82c1-0d04-45cd-9962-f5045e508e70 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:25.813957 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-d0d5b0b2-f455-4111-9d51-d0fa6334c5c6 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/quotas/146fd417ad5d4f85ae5ce85d279642a7 HTTP/1.1" status: 200 len: 375 time: 0.1573932 May 12 15:04:25.817235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-ebb0fc3a-ee25-4776-adf5-ed561a694d2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:25.818918 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-ebb0fc3a-ee25-4776-adf5-ed561a694d2c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9e8c135aef5e45fbb72a8db523f01319&device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 1099 time: 1.0645127 May 12 15:04:25.830807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=e6cd121a-66ed-439d-82b8-4e9ff7955245,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:25.846716 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port a78e82c1-0d04-45cd-9962-f5045e508e70 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:25.852132 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a78e82c1-0d04-45cd-9962-f5045e508e70 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:25.852580 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:25.858573 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:25.978966 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:25.995962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-d8154ee5-1f48-4e2c-ae09-2a54e496eed8 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.133&port_id=57abba16-9897-4390-97ae-11192c4c120c HTTP/1.1" status: 200 len: 217 time: 0.1420803 May 12 15:04:25.998072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-b41eeeee-d73b-4185-9ee4-fb85cff005ef tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=146fd417ad5d4f85ae5ce85d279642a7&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1479437 May 12 15:04:26.013997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port a78e82c1-0d04-45cd-9962-f5045e508e70, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a78e82c1-0d04-45cd-9962-f5045e508e70,segment=NetworkSegment(3f66bf84-0862-4ccb-a6ee-6fe3b88a805c),segment_id=3f66bf84-0862-4ccb-a6ee-6fe3b88a805c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:26.014162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:26.019961 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:26.022548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:26.024910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Pushing event updated for resources: {'Port': ['ID=b968cd57-4673-4ade-9c43-dda43d9558b7,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:26.061221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:26.067130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:26.067950 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:26.125095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=a78e82c1-0d04-45cd-9962-f5045e508e70,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:26.429950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fcd1439a-951a-4bf6-a434-c68ad5a06365 None None] Provisioning for port 343f050d-81d2-410f-a8ab-b2bdef562d11 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:26.435196 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:26.436166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fcd1439a-951a-4bf6-a434-c68ad5a06365 None None] Provisioning complete for port 343f050d-81d2-410f-a8ab-b2bdef562d11 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:26.437811 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fcd1439a-951a-4bf6-a434-c68ad5a06365 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:26.506047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fcd1439a-951a-4bf6-a434-c68ad5a06365 None None] Port 343f050d-81d2-410f-a8ab-b2bdef562d11 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:04:26.562799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8841f1-13be-4957-8053-aa5279337ec8 req-3a2caa39-e823-4e47-8333-7f24e7663845 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:26.563695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-bd8841f1-13be-4957-8053-aa5279337ec8 req-3a2caa39-e823-4e47-8333-7f24e7663845 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Synchronizing usage tracker for tenant:00830df80689431b80f1e5a51c5f6f9e on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:04:26.569302 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-da6acb3d-f6f5-48aa-b99b-fc62fb538731'] response: {'name': 'network-changed', 'server_uuid': '048a92c4-13d1-40e6-9714-2c96dd562708', 'tag': '57abba16-9897-4390-97ae-11192c4c120c', 'status': 'completed', 'code': 200} May 12 15:04:26.575461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-9e644ecd-08fe-4db7-b534-764451fd09cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:26.576865 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-9e644ecd-08fe-4db7-b534-764451fd09cf service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.5558109 May 12 15:04:26.578332 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1563ca84-d42a-4190-9e86-b42664a423fe req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 9.0891457 May 12 15:04:26.708940 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Request body: {'port': {'device_id': '5cd1d64a-2898-4f90-beb1-fad4769e0b7c', 'device_owner': 'compute:tempest-test_az-52089536', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:26.803700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-730cd219-ab93-48d2-994f-28f399d28e08 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Pushing event updated for resources: {'Port': ['ID=343f050d-81d2-410f-a8ab-b2bdef562d11,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:26.864986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e6cd121a-66ed-439d-82b8-4e9ff7955245 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:26.904417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-bd8841f1-13be-4957-8053-aa5279337ec8 req-3a2caa39-e823-4e47-8333-7f24e7663845 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Unset dirty status for tenant:00830df80689431b80f1e5a51c5f6f9e on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:04:26.906207 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd8841f1-13be-4957-8053-aa5279337ec8 req-3a2caa39-e823-4e47-8333-7f24e7663845 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 935 time: 1.1825409 May 12 15:04:26.989663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port e6cd121a-66ed-439d-82b8-4e9ff7955245 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:26.990141 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:27.011454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42032) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:27.136241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-bd8841f1-13be-4957-8053-aa5279337ec8 req-91a777d8-82aa-49be-b448-ea9aa0a5604a tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Synchronizing usage tracker for tenant:00830df80689431b80f1e5a51c5f6f9e on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:04:27.138901 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:27.170433 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a78e82c1-0d04-45cd-9962-f5045e508e70 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:27.174871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c63eec56-7941-4c7b-9ae5-9d56d121e495 req-9a27c7c0-edfd-4ad7-8ece-bb26d4aecede tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:27.176343 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c63eec56-7941-4c7b-9ae5-9d56d121e495 req-9a27c7c0-edfd-4ad7-8ece-bb26d4aecede tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 948 time: 0.4267921 May 12 15:04:27.189044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-be47d65d-16b2-4f12-a35f-7bbd21b3128a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:27.190772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-be47d65d-16b2-4f12-a35f-7bbd21b3128a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.5859172 May 12 15:04:27.263657 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-183566b3-dbae-4a56-9162-5d4e62c99a3c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:27.283830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a78e82c1-0d04-45cd-9962-f5045e508e70 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:27.284139 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:27.302612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-183566b3-dbae-4a56-9162-5d4e62c99a3c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:27.312800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-183566b3-dbae-4a56-9162-5d4e62c99a3c admin admin] Usage tracker for resource:security_group_rule and tenant:87e5d0a7ec524453b08b91ccc03c193e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:27.318691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-183566b3-dbae-4a56-9162-5d4e62c99a3c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:27.332870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-183566b3-dbae-4a56-9162-5d4e62c99a3c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:27.466417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-183566b3-dbae-4a56-9162-5d4e62c99a3c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:27.475455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-183566b3-dbae-4a56-9162-5d4e62c99a3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:27.482166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-bd8841f1-13be-4957-8053-aa5279337ec8 req-91a777d8-82aa-49be-b448-ea9aa0a5604a tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Unset dirty status for tenant:00830df80689431b80f1e5a51c5f6f9e on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:04:27.483511 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd8841f1-13be-4957-8053-aa5279337ec8 req-91a777d8-82aa-49be-b448-ea9aa0a5604a tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/security-groups?id=523e81ba-8739-440a-b9d0-888a323ce6a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5568464 May 12 15:04:27.509258 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c63eec56-7941-4c7b-9ae5-9d56d121e495 req-f662406e-87b8-494b-9f4d-ebd126a9949d tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3160486 May 12 15:04:27.556810 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-183566b3-dbae-4a56-9162-5d4e62c99a3c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=87e5d0a7ec524453b08b91ccc03c193e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5440996 May 12 15:04:27.557743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-183566b3-dbae-4a56-9162-5d4e62c99a3c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d09f57a8-7bbe-4ee9-9086-3a0f22791caa,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:27.562362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42046) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:27.628751 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:27.733094 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec9bf231-78a2-4a8c-bf90-34edd4eb3612 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:27.777294 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec9bf231-78a2-4a8c-bf90-34edd4eb3612 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:27.850229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.84', 55057) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:27.852643 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec9bf231-78a2-4a8c-bf90-34edd4eb3612 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:27.873414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec9bf231-78a2-4a8c-bf90-34edd4eb3612 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d09f57a8-7bbe-4ee9-9086-3a0f22791caa,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:27.928044 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec9bf231-78a2-4a8c-bf90-34edd4eb3612 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:27.932498 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ec9bf231-78a2-4a8c-bf90-34edd4eb3612 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d09f57a8-7bbe-4ee9-9086-3a0f22791caa HTTP/1.1" status: 204 len: 168 time: 0.3659205 May 12 15:04:27.932498 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-7332b143-7d97-4541-b164-199c8df48173 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=146fd417ad5d4f85ae5ce85d279642a7&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0599890 May 12 15:04:27.988207 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-886ed4f5-ca91-4c89-9b39-9e221a59c7eb service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7765903 May 12 15:04:28.148330 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50a94874-7945-4a20-8347-62a4dd0bce73 req-6c35eac1-619f-4cbf-a3ae-10bff3c1a89b tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 210 time: 0.5211678 May 12 15:04:28.285074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-6e95d336-7a3b-46a4-819b-e4423dbe2fcf tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:28.286637 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-6e95d336-7a3b-46a4-819b-e4423dbe2fcf tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3445978 May 12 15:04:28.397357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Router 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:04:28.444032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Request body: {'port': {'device_id': 'd3d5a7b0-aaee-4e48-9bd4-e2cffa0be595', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '146fd417ad5d4f85ae5ce85d279642a7'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:28.453250 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7d4490b-5a91-483b-94dc-57b61379a685 req-8bc59f00-4b4e-438f-ba22-e81c08c497a6 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2750375 May 12 15:04:28.532835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42080) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:28.641565 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77fcad08-3c74-4a59-b787-f746c13fd609 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:28.667920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 343f050d-81d2-410f-a8ab-b2bdef562d11 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:28.681437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-77fcad08-3c74-4a59-b787-f746c13fd609 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:28.684445 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:28.718800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:28.722518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Usage tracker for resource:port and tenant:146fd417ad5d4f85ae5ce85d279642a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:28.725664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:28.734336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:28.750258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Made reservation on behalf of 146fd417ad5d4f85ae5ce85d279642a7 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:28.760330 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:28.783443 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:28.801808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:28.807355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Usage tracker for resource:security_group_rule and tenant:146fd417ad5d4f85ae5ce85d279642a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:28.810663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:28.817225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:28.829994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:04:28.836956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-77fcad08-3c74-4a59-b787-f746c13fd609 admin admin] Usage tracker for resource:security_group_rule and tenant:bd33a13d29f346cc9b4e9067090366d4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:28.838053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-77fcad08-3c74-4a59-b787-f746c13fd609 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:28.844783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-77fcad08-3c74-4a59-b787-f746c13fd609 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:28.865667 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Sync routers for ids ['5c57748e-d5af-4f2c-b90a-040ede2ad3e6'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:04:28.879129 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Routers {'5c57748e-d5af-4f2c-b90a-040ede2ad3e6'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:04:28.880105 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:04:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5c57748e-d5af-4f2c-b90a-040ede2ad3e6'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:28.974993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:28.980933 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:28.993571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Transition to ACTIVE for port object 343f050d-81d2-410f-a8ab-b2bdef562d11 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:29.017794 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:29.077080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ae43b3c7-167d-4164-8e4b-975512174f6f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:29.084247 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:29.086114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7b3fde84-6b6d-4c10-acbf-c90c4c940ce0 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 934 time: 10.2331502 May 12 15:04:29.091072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42098) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:29.132885 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Set router 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:04:29.199286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4095437a-bc31-4b86-91a2-680e8805b1c2 req-ab4e61d6-635a-407c-8690-4c96d26ee72d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:29.201122 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4095437a-bc31-4b86-91a2-680e8805b1c2 req-ab4e61d6-635a-407c-8690-4c96d26ee72d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9e8c135aef5e45fbb72a8db523f01319&device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 1099 time: 0.6536505 May 12 15:04:29.275203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Pushing event updated for resources: {'Port': ['ID=343f050d-81d2-410f-a8ab-b2bdef562d11,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:29.452815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Attempting to bind port 343f050d-81d2-410f-a8ab-b2bdef562d11 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:29.453280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Attempting to bind port 343f050d-81d2-410f-a8ab-b2bdef562d11 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:29.453729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Attempting to bind port 343f050d-81d2-410f-a8ab-b2bdef562d11 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:29.455924 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Allocated IP 192.168.233.228 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/2630733c-d113-4a35-86d3-c09219afe149) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:29.463949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Port 343f050d-81d2-410f-a8ab-b2bdef562d11 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:04:29.464417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Attempting to bind port 343f050d-81d2-410f-a8ab-b2bdef562d11 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:29.482863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca44d48-5db8-4683-9eb2-42939ecaee8b req-45b4f7c6-4c59-451e-930b-50fbe28cf889 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:29.490347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aca44d48-5db8-4683-9eb2-42939ecaee8b req-45b4f7c6-4c59-451e-930b-50fbe28cf889 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 948 time: 0.5779045 May 12 15:04:29.499894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:29.500326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:29.500781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:29.501333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Bound port: 343f050d-81d2-410f-a8ab-b2bdef562d11, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:29.501826 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:29.520221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b057ab8-9621-421c-b957-3f555bff4af7 req-3161e0f4-ce58-40a9-bf93-fbabc6e2ec2b tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:29.524784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b057ab8-9621-421c-b957-3f555bff4af7 req-3161e0f4-ce58-40a9-bf93-fbabc6e2ec2b tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 935 time: 0.8208239 May 12 15:04:29.573790 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-158859462-router', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10'}], 'enable_snat': True}, 'gw_port_id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:19Z', 'updated_at': '2022-05-12T15:04:26Z', 'revision_number': 3, 'project_id': '22609d3eca554e908455a9f04efb4ffa', 'gw_port': {'id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:6d:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:22Z', 'updated_at': '2022-05-12T15:04:23Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:29.588966 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Checking router: 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:04:29.590080 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Updating router 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 port b968cd57-4673-4ade-9c43-dda43d9558b7 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:04:29.667222 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:29.738621 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aca44d48-5db8-4683-9eb2-42939ecaee8b req-65d1a90a-9ac1-4888-9a46-7cc24f4ef2ca tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2473278 May 12 15:04:29.746190 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77fcad08-3c74-4a59-b787-f746c13fd609 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:29.750614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4095437a-bc31-4b86-91a2-680e8805b1c2 req-e0dae3a8-e354-4d02-8fd3-a8208b4f831f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:29.752549 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4095437a-bc31-4b86-91a2-680e8805b1c2 req-e0dae3a8-e354-4d02-8fd3-a8208b4f831f service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.5283120 May 12 15:04:29.754471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b057ab8-9621-421c-b957-3f555bff4af7 req-9430f4f4-94e6-4f3b-88c8-bc44dc488377 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/security-groups?id=523e81ba-8739-440a-b9d0-888a323ce6a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1971147 May 12 15:04:29.834358 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77fcad08-3c74-4a59-b787-f746c13fd609 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:29.868312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4095437a-bc31-4b86-91a2-680e8805b1c2 req-4c381b51-a8f9-4f89-b948-c0be1231539c service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.133&port_id=57abba16-9897-4390-97ae-11192c4c120c HTTP/1.1" status: 200 len: 217 time: 0.1004984 May 12 15:04:29.921251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] For port 343f050d-81d2-410f-a8ab-b2bdef562d11, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:30.060032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] For port 343f050d-81d2-410f-a8ab-b2bdef562d11, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=343f050d-81d2-410f-a8ab-b2bdef562d11,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:30.064232 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-77fcad08-3c74-4a59-b787-f746c13fd609 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bd33a13d29f346cc9b4e9067090366d4&name=default HTTP/1.1" status: 200 len: 2979 time: 1.5303409 May 12 15:04:30.068188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77fcad08-3c74-4a59-b787-f746c13fd609 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39749435-e54d-400c-a671-e1932ff4458b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:30.076612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42108) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:30.115669 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:30.179071 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f1b1de14-40b0-4481-8511-aa5f2894b9b7 req-5ac4acd1-decf-455d-88aa-146ce133c0e0 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 210 time: 0.1169233 May 12 15:04:30.197366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:30.198448 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:30.201030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1563ca84-d42a-4190-9e86-b42664a423fe req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] 10.222.0.76 "PUT /v2.0/ports/343f050d-81d2-410f-a8ab-b2bdef562d11 HTTP/1.1" status: 200 len: 1115 time: 3.6046553 May 12 15:04:30.227791 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:30.243302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5cd1d64a-2898-4f90-beb1-fad4769e0b7c', 'tag': '343f050d-81d2-410f-a8ab-b2bdef562d11'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:30.245693 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Transition to ACTIVE for port object b968cd57-4673-4ade-9c43-dda43d9558b7 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:30.260243 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:30.295967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4095437a-bc31-4b86-91a2-680e8805b1c2 req-fb7965f8-5ae1-4ecf-8a61-8611ffe52f38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:30.311190 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4095437a-bc31-4b86-91a2-680e8805b1c2 req-fb7965f8-5ae1-4ecf-8a61-8611ffe52f38 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.4287837 May 12 15:04:30.337097 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b9019a76-6b25-46c9-8b01-61d456795e75 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:30.378389 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08423bdc-baed-4e67-aad6-0770b119ea4c None None] Pushing event updated for resources: {'Port': ['ID=b968cd57-4673-4ade-9c43-dda43d9558b7,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:30.412653 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b9019a76-6b25-46c9-8b01-61d456795e75 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:30.413509 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Attempting to bind port b968cd57-4673-4ade-9c43-dda43d9558b7 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:30.414036 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Attempting to bind port b968cd57-4673-4ade-9c43-dda43d9558b7 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:30.414833 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Attempting to bind port b968cd57-4673-4ade-9c43-dda43d9558b7 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:30.421378 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:30.422065 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:30.422597 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:30.423132 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:30.423730 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Bound port: b968cd57-4673-4ade-9c43-dda43d9558b7, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:30.424267 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:30.433773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91e5a26a-bd37-4253-aee5-9ab0ae95958b service neutron] Pushing event updated for resources: {'Port': ['ID=343f050d-81d2-410f-a8ab-b2bdef562d11,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:30.489287 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8547c2eb-99a0-42b1-a22c-1efe8a070e8f'] response: {'name': 'network-changed', 'server_uuid': '5cd1d64a-2898-4f90-beb1-fad4769e0b7c', 'tag': '343f050d-81d2-410f-a8ab-b2bdef562d11', 'status': 'completed', 'code': 200} May 12 15:04:30.502225 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:30.560291 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] For port b968cd57-4673-4ade-9c43-dda43d9558b7, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:30.564996 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] For port b968cd57-4673-4ade-9c43-dda43d9558b7, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b968cd57-4673-4ade-9c43-dda43d9558b7,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:30.571592 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:30.581977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1563ca84-d42a-4190-9e86-b42664a423fe req-87a9be73-7bfc-490f-941c-92e14868691a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:30.583961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1563ca84-d42a-4190-9e86-b42664a423fe req-87a9be73-7bfc-490f-941c-92e14868691a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=00830df80689431b80f1e5a51c5f6f9e&device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 1118 time: 0.2716258 May 12 15:04:30.592011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4095437a-bc31-4b86-91a2-680e8805b1c2 req-14a83ee1-7fec-4e34-be26-8babf188e119 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:30.593620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4095437a-bc31-4b86-91a2-680e8805b1c2 req-14a83ee1-7fec-4e34-be26-8babf188e119 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1519775 May 12 15:04:30.697286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Transition to ACTIVE for port object 2630733c-d113-4a35-86d3-c09219afe149 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:30.699699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1563ca84-d42a-4190-9e86-b42664a423fe req-7f4d9d0e-49f2-4c04-bbe6-89e3f738a95d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.54&port_id=343f050d-81d2-410f-a8ab-b2bdef562d11 HTTP/1.1" status: 200 len: 217 time: 0.1046090 May 12 15:04:30.703221 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b9019a76-6b25-46c9-8b01-61d456795e75 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:30.722240 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Routers {'5c57748e-d5af-4f2c-b90a-040ede2ad3e6'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:04:30.722874 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:04:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5c57748e-d5af-4f2c-b90a-040ede2ad3e6'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:30.723012 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:30.738522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9019a76-6b25-46c9-8b01-61d456795e75 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39749435-e54d-400c-a671-e1932ff4458b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:30.828611 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08423bdc-baed-4e67-aad6-0770b119ea4c None None] Pushing event updated for resources: {'Port': ['ID=b968cd57-4673-4ade-9c43-dda43d9558b7,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:30.857505 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b9019a76-6b25-46c9-8b01-61d456795e75 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:30.858632 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b9019a76-6b25-46c9-8b01-61d456795e75 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/39749435-e54d-400c-a671-e1932ff4458b HTTP/1.1" status: 204 len: 168 time: 0.7810757 May 12 15:04:30.909744 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:30.990538 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] Set router 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:04:31.063385 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4095437a-bc31-4b86-91a2-680e8805b1c2 req-c6beb765-03e4-4d62-b312-ce783da7e9a4 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3976877 May 12 15:04:31.074655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1563ca84-d42a-4190-9e86-b42664a423fe req-b4d5880c-6d8a-4964-a60f-43d816637559 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:31.076074 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1563ca84-d42a-4190-9e86-b42664a423fe req-b4d5880c-6d8a-4964-a60f-43d816637559 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3116202 May 12 15:04:31.177684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:31.184330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:31.196058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:31.201929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:31.202991 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:31.222096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Pushing event updated for resources: {'Port': ['ID=2630733c-d113-4a35-86d3-c09219afe149,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:31.374998 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-f111bf05-0aba-44a7-a7a6-2c8cd47836a8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.9316504 May 12 15:04:31.457238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Allocated IP 172.20.0.1 (889f9b5f-a864-4a4d-a337-581795e1561e/e47e554d-eb97-4217-b6e3-2120f84b68bf/02954b40-9f4a-4e04-a709-814c598e1c12) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:31.626040 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-158859462-router', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10'}], 'enable_snat': True}, 'gw_port_id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:19Z', 'updated_at': '2022-05-12T15:04:26Z', 'revision_number': 3, 'project_id': '22609d3eca554e908455a9f04efb4ffa', 'gw_port': {'id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:6d:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:22Z', 'updated_at': '2022-05-12T15:04:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:31.631334 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de253f70-6b7d-493a-85fe-b56e6125f637 None None] The sync data for ids ['5c57748e-d5af-4f2c-b90a-040ede2ad3e6'] in n-d-841483-1 is: [{'id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-158859462-router', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10'}], 'enable_snat': True}, 'gw_port_id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:19Z', 'updated_at': '2022-05-12T15:04:26Z', 'revision_number': 3, 'project_id': '22609d3eca554e908455a9f04efb4ffa', 'gw_port': {'id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:6d:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:22Z', 'updated_at': '2022-05-12T15:04:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:04:31.635026 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4095437a-bc31-4b86-91a2-680e8805b1c2 req-9d30ad08-9abe-4595-9308-08f8e731e3dd service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5499074 May 12 15:04:31.645273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2397c1-ab0b-45cb-955d-2c6a91173c35 req-9eb6dac3-386a-43db-b5fa-0fb6ba750e47 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:31.652757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a2397c1-ab0b-45cb-955d-2c6a91173c35 req-9eb6dac3-386a-43db-b5fa-0fb6ba750e47 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 948 time: 0.5801568 May 12 15:04:31.659689 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1563ca84-d42a-4190-9e86-b42664a423fe req-013bd215-0427-492e-bde0-aa4f447cba03 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:31.661164 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1563ca84-d42a-4190-9e86-b42664a423fe req-013bd215-0427-492e-bde0-aa4f447cba03 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.5787294 May 12 15:04:31.686381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f720354b-c98c-48a5-8b13-90e202f2f3e6 req-2bdfe492-29ce-4432-823a-8ffdfaecde61 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:31.688699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ec630f8-90f2-422d-a361-a67e0908dc4a None None] Provisioning for port 2630733c-d113-4a35-86d3-c09219afe149 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:31.696690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f720354b-c98c-48a5-8b13-90e202f2f3e6 req-2bdfe492-29ce-4432-823a-8ffdfaecde61 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 967 time: 0.6250572 May 12 15:04:31.697728 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ec630f8-90f2-422d-a361-a67e0908dc4a None None] Provisioning complete for port 2630733c-d113-4a35-86d3-c09219afe149 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:31.699432 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ec630f8-90f2-422d-a361-a67e0908dc4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:31.805046 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:31.826331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Transition to ACTIVE for port object 02954b40-9f4a-4e04-a709-814c598e1c12 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:31.862138 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9ec630f8-90f2-422d-a361-a67e0908dc4a None None] Port 2630733c-d113-4a35-86d3-c09219afe149 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:04:31.875606 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:31.912378 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a2397c1-ab0b-45cb-955d-2c6a91173c35 req-db29673f-9c33-47de-b79f-d7d6dd12d08b tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2586360 May 12 15:04:31.944271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42156) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:31.961951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Network 889f9b5f-a864-4a4d-a337-581795e1561e is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:31.963970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:31.966890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:31.967400 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:32.041162 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:32.055118 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f720354b-c98c-48a5-8b13-90e202f2f3e6 req-6997c5c0-6c96-4632-96b6-da5412bb5f19 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/security-groups?id=523e81ba-8739-440a-b9d0-888a323ce6a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3574367 May 12 15:04:32.063445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Pushing event updated for resources: {'Port': ['ID=02954b40-9f4a-4e04-a709-814c598e1c12,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:32.081018 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1563ca84-d42a-4190-9e86-b42664a423fe req-b140f98c-8ef4-4667-b45d-e08131d9fe60 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3688638 May 12 15:04:32.296670 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c5fd6bbc-653b-4dc7-b506-28934c141c33 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:32.334856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c5fd6bbc-653b-4dc7-b506-28934c141c33 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:32.339250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c5fd6bbc-653b-4dc7-b506-28934c141c33 admin admin] Usage tracker for resource:security_group_rule and tenant:3a337c9194f94e948b9ef12a38457be0 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:32.344943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c5fd6bbc-653b-4dc7-b506-28934c141c33 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:32.352307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c5fd6bbc-653b-4dc7-b506-28934c141c33 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:32.406316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5a1fc567-3492-4d89-ad0b-53873239c792 None None] Provisioning for port 02954b40-9f4a-4e04-a709-814c598e1c12 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:32.416569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5a1fc567-3492-4d89-ad0b-53873239c792 None None] Provisioning complete for port 02954b40-9f4a-4e04-a709-814c598e1c12 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:32.417857 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5a1fc567-3492-4d89-ad0b-53873239c792 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:32.438406 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:32.507498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5a1fc567-3492-4d89-ad0b-53873239c792 None None] Port 02954b40-9f4a-4e04-a709-814c598e1c12 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:04:32.514991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbb7fcc0-33e4-4108-9785-a34485faf811 req-9a26b04d-9312-4fc8-b8b8-6bdafca2bfde tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:32.526526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbb7fcc0-33e4-4108-9785-a34485faf811 req-9a26b04d-9312-4fc8-b8b8-6bdafca2bfde tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 936 time: 0.3892810 May 12 15:04:32.551737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42172) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:32.563957 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1563ca84-d42a-4190-9e86-b42664a423fe req-15360256-00d0-43c7-ac5e-c75350ef9d2a service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4854760 May 12 15:04:32.568383 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c5fd6bbc-653b-4dc7-b506-28934c141c33 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:32.587025 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c5fd6bbc-653b-4dc7-b506-28934c141c33 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:32.608853 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbb7fcc0-33e4-4108-9785-a34485faf811 req-37143096-cca8-4e1d-a34b-92890a1d9e88 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0803633 May 12 15:04:32.729783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e691771-123a-4cca-8e7b-2cede015d884 req-a8785152-1d16-4c1a-b4df-5c42e719bd51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:32.732156 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e691771-123a-4cca-8e7b-2cede015d884 req-a8785152-1d16-4c1a-b4df-5c42e719bd51 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=00830df80689431b80f1e5a51c5f6f9e&device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 1118 time: 0.1099164 May 12 15:04:32.740215 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c5fd6bbc-653b-4dc7-b506-28934c141c33 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3a337c9194f94e948b9ef12a38457be0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7941077 May 12 15:04:32.743928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42178) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:32.747315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Request body: {'network': {'name': 'tempest-LiveAutoBlockMigrationV225Test-589637709-network', 'tenant_id': '1b3825228b0e4c42a381540b66ea23d6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:32.752073 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5fd6bbc-653b-4dc7-b506-28934c141c33 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e7c9957-cac0-4065-b75c-70950e4c4913,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:32.760631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:32.768716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Usage tracker for resource:network and tenant:1b3825228b0e4c42a381540b66ea23d6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:32.782058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:32.794684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:32.830986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Made reservation on behalf of 1b3825228b0e4c42a381540b66ea23d6 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:32.833346 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:32.855138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:32.880355 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b968cd57-4673-4ade-9c43-dda43d9558b7 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:32.902680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:32.919266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Usage tracker for resource:security_group_rule and tenant:1b3825228b0e4c42a381540b66ea23d6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:32.924038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:32.927798 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:32.936152 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:32.936497 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:32.948213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:32.978391 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port b968cd57-4673-4ade-9c43-dda43d9558b7 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:32.984750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b968cd57-4673-4ade-9c43-dda43d9558b7 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:32.985113 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:33.013178 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8c8b13c9-310c-456d-adec-2aa960da207a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:33.015134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 57abba16-9897-4390-97ae-11192c4c120c details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:04:33.044065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e691771-123a-4cca-8e7b-2cede015d884 req-fcefdbb1-9a74-49a9-8f36-73289c37ce1e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:33.045527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e691771-123a-4cca-8e7b-2cede015d884 req-fcefdbb1-9a74-49a9-8f36-73289c37ce1e service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.2795644 May 12 15:04:33.182684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e691771-123a-4cca-8e7b-2cede015d884 req-ab7182b2-3f3e-4823-af03-586caeee6fbd service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.54&port_id=343f050d-81d2-410f-a8ab-b2bdef562d11 HTTP/1.1" status: 200 len: 217 time: 0.1272905 May 12 15:04:33.194945 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8c8b13c9-310c-456d-adec-2aa960da207a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:33.207896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Pushing event updated for resources: {'Port': ['ID=02954b40-9f4a-4e04-a709-814c598e1c12,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:33.219172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Network 889f9b5f-a864-4a4d-a337-581795e1561e is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:33.223637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-5173aa54-d19b-441a-8625-1747a68f1823 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:04:33.224623 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-5173aa54-d19b-441a-8625-1747a68f1823 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.84 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0188546 May 12 15:04:33.227976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:33.318180 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:33.381698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port b968cd57-4673-4ade-9c43-dda43d9558b7, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b968cd57-4673-4ade-9c43-dda43d9558b7,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:33.396912 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:33.403787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e691771-123a-4cca-8e7b-2cede015d884 req-ceb45be4-de67-4928-94bd-20dc236d2bc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:33.405908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e691771-123a-4cca-8e7b-2cede015d884 req-ceb45be4-de67-4928-94bd-20dc236d2bc0 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1997850 May 12 15:04:33.445734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 57abba16-9897-4390-97ae-11192c4c120c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=57abba16-9897-4390-97ae-11192c4c120c,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:33.477865 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '57abba16-9897-4390-97ae-11192c4c120c', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '57abba16-9897-4390-97ae-11192c4c120c', 'mac_address': 'fa:16:3e:18:39:a3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.133'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:04:33.497059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5898c8fd-a5bb-4486-aa61-6df48b688195 req-3f8926c2-c7d2-4bb3-b282-804dd0fe81c8 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:33.499564 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5898c8fd-a5bb-4486-aa61-6df48b688195 req-3f8926c2-c7d2-4bb3-b282-804dd0fe81c8 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 948 time: 0.3860400 May 12 15:04:33.548464 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8c8b13c9-310c-456d-adec-2aa960da207a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:33.551174 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=b968cd57-4673-4ade-9c43-dda43d9558b7,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:33.551405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Router 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:04:33.556766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Request body: {'port': {'device_id': 'd3d5a7b0-aaee-4e48-9bd4-e2cffa0be595', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:33.557427 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:33.607236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 57abba16-9897-4390-97ae-11192c4c120c {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:33.628300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 57abba16-9897-4390-97ae-11192c4c120c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=57abba16-9897-4390-97ae-11192c4c120c,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:33.632965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60473069-022a-4910-bc3d-6f4cbce99090 req-d158ba98-ed54-473a-98bc-74495bc7d122 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:33.635772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60473069-022a-4910-bc3d-6f4cbce99090 req-d158ba98-ed54-473a-98bc-74495bc7d122 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 967 time: 0.4520640 May 12 15:04:33.643525 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:33.645026 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8c8b13c9-310c-456d-adec-2aa960da207a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:33.651913 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8c8b13c9-310c-456d-adec-2aa960da207a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5e7c9957-cac0-4065-b75c-70950e4c4913 HTTP/1.1" status: 204 len: 168 time: 0.9044800 May 12 15:04:33.717644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e7fc7e03-3d5a-4d6d-a329-604efdbcb476 None None] Provisioning complete for port 02954b40-9f4a-4e04-a709-814c598e1c12 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:33.717966 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e7fc7e03-3d5a-4d6d-a329-604efdbcb476 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:33.726577 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60473069-022a-4910-bc3d-6f4cbce99090 req-a4269c0e-65d4-4f30-913f-8c22b4f58019 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/security-groups?id=523e81ba-8739-440a-b9d0-888a323ce6a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674901 May 12 15:04:33.727848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c8b13c9-310c-456d-adec-2aa960da207a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e7c9957-cac0-4065-b75c-70950e4c4913,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:33.733023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e691771-123a-4cca-8e7b-2cede015d884 req-20d6a745-2a0f-401f-8d3c-d25079bbac5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:33.734523 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e691771-123a-4cca-8e7b-2cede015d884 req-20d6a745-2a0f-401f-8d3c-d25079bbac5b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.3194904 May 12 15:04:33.748926 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5898c8fd-a5bb-4486-aa61-6df48b688195 req-8a4a39f0-4763-44c9-858c-4c8318e03199 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2129269 May 12 15:04:33.832377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=57abba16-9897-4390-97ae-11192c4c120c,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:33.836862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e7fc7e03-3d5a-4d6d-a329-604efdbcb476 None None] Port 02954b40-9f4a-4e04-a709-814c598e1c12 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:04:33.936789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['57abba16-9897-4390-97ae-11192c4c120c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:04:33.994288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e691771-123a-4cca-8e7b-2cede015d884 req-1d6cc612-1051-43cf-94ee-76d007aaba10 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2441905 May 12 15:04:34.000906 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:34.115433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95586283-6e2a-44ef-8b8a-b5df92d84476 req-495fbabd-a8c8-4fbe-b18f-2a92743a7f5e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:34.122976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95586283-6e2a-44ef-8b8a-b5df92d84476 req-495fbabd-a8c8-4fbe-b18f-2a92743a7f5e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 936 time: 0.1998606 May 12 15:04:34.140191 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:34.169096 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:34.176563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42198) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:34.205285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95586283-6e2a-44ef-8b8a-b5df92d84476 req-7466b0c4-2439-43cc-990d-d3378be92f81 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0813937 May 12 15:04:34.215527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e691771-123a-4cca-8e7b-2cede015d884 req-b06a3b5c-ed24-4293-a02f-50e58de80574 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2127829 May 12 15:04:34.228853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 567} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:04:34.265618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:04:34.275612 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Sync routers for ids ['5c57748e-d5af-4f2c-b90a-040ede2ad3e6'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:04:34.285558 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Routers {'5c57748e-d5af-4f2c-b90a-040ede2ad3e6'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:04:34.286390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:04:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5c57748e-d5af-4f2c-b90a-040ede2ad3e6'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:34.319757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:34.324024 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f3aac686-3308-4f6c-b4e7-b4d1046ef6c6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:34.355178 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:34.355544 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Added segment 2e732768-539c-4181-b234-fc2be7d671bf of type vlan for network 95dd1383-efe7-494d-a1ab-57e293da83a3 May 12 15:04:34.374245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f3aac686-3308-4f6c-b4e7-b4d1046ef6c6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:34.391319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f3aac686-3308-4f6c-b4e7-b4d1046ef6c6 admin admin] Usage tracker for resource:security_group_rule and tenant:66414cf07b9e457f9dc1fb1cf5edd30d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:34.405062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f3aac686-3308-4f6c-b4e7-b4d1046ef6c6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:34.465909 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Set router 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:04:34.481160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f3aac686-3308-4f6c-b4e7-b4d1046ef6c6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:34.498704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:34.512579 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7eaed23a-9557-4a70-9f44-7c20d9f628ac admin admin] 10.222.0.82 "PUT /v2.0/routers/5c57748e-d5af-4f2c-b90a-040ede2ad3e6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.4111202 May 12 15:04:34.610911 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:04:34.617223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:34.618246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:34.618970 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:34.811287 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 2.2549498 May 12 15:04:34.814183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42214) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:34.815813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2630733c-d113-4a35-86d3-c09219afe149 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:34.820730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d827655-a4b1-4103-823c-a1ece0e0a50c admin admin] Pushing event updated for resources: {'Network': ['ID=95dd1383-efe7-494d-a1ab-57e293da83a3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:34.823398 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Request body: {'subnet': {'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveAutoBlockMigrationV225Test-589637709-subnet', 'tenant_id': '1b3825228b0e4c42a381540b66ea23d6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:34.825098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-158859462-router', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10'}], 'enable_snat': True}, 'gw_port_id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:19Z', 'updated_at': '2022-05-12T15:04:32Z', 'revision_number': 4, 'project_id': '22609d3eca554e908455a9f04efb4ffa', 'gw_port': {'id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:6d:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:22Z', 'updated_at': '2022-05-12T15:04:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '02954b40-9f4a-4e04-a709-814c598e1c12', 'name': '', 'network_id': '889f9b5f-a864-4a4d-a337-581795e1561e', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'mac_address': 'fa:16:3e:90:b3:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'device_owner': 'network:router_interface', 'standard_attr_id': 122, 'fixed_ips': [{'subnet_id': 'e47e554d-eb97-4217-b6e3-2120f84b68bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:30Z', 'updated_at': '2022-05-12T15:04:32Z', 'revision_number': 2, 'project_id': '22609d3eca554e908455a9f04efb4ffa', 'subnets': [{'id': 'e47e554d-eb97-4217-b6e3-2120f84b68bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:34.827675 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:34.831690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:34.836553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Checking router: 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:04:34.836825 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Updating router 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 port 02954b40-9f4a-4e04-a709-814c598e1c12 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:04:34.844535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Usage tracker for resource:subnet and tenant:1b3825228b0e4c42a381540b66ea23d6 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:34.854314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:34.868512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Transition to ACTIVE for port object 2630733c-d113-4a35-86d3-c09219afe149 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:34.870532 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f3aac686-3308-4f6c-b4e7-b4d1046ef6c6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:34.873302 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:34.880764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:34.902359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 95dd1383-efe7-494d-a1ab-57e293da83a3 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:04:34.924707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b968cd57-4673-4ade-9c43-dda43d9558b7 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:34.930917 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f3aac686-3308-4f6c-b4e7-b4d1046ef6c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:34.963316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Made reservation on behalf of 1b3825228b0e4c42a381540b66ea23d6 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:34.969837 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Notify callbacks [] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:34.985973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3aac686-3308-4f6c-b4e7-b4d1046ef6c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a77690a-5a8c-41a8-a815-affadf64cc61,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:35.027629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 57abba16-9897-4390-97ae-11192c4c120c up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:35.124638 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:35.125249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Pushing event updated for resources: {'Port': ['ID=2630733c-d113-4a35-86d3-c09219afe149,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:35.138457 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f3aac686-3308-4f6c-b4e7-b4d1046ef6c6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=66414cf07b9e457f9dc1fb1cf5edd30d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9508488 May 12 15:04:35.152436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42220) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:35.167676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Attempting to bind port 2630733c-d113-4a35-86d3-c09219afe149 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:35.168260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Attempting to bind port 2630733c-d113-4a35-86d3-c09219afe149 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:35.169610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Attempting to bind port 2630733c-d113-4a35-86d3-c09219afe149 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:35.178670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Port 2630733c-d113-4a35-86d3-c09219afe149 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:04:35.179770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Attempting to bind port 2630733c-d113-4a35-86d3-c09219afe149 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:35.193862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:35.195342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:35.196543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:35.197240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Bound port: 2630733c-d113-4a35-86d3-c09219afe149, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:35.197905 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:35.321750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 57abba16-9897-4390-97ae-11192c4c120c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:35.331615 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b968cd57-4673-4ade-9c43-dda43d9558b7 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:35.331975 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:35.345884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] For port 2630733c-d113-4a35-86d3-c09219afe149, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:35.350398 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] For port 2630733c-d113-4a35-86d3-c09219afe149, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2630733c-d113-4a35-86d3-c09219afe149,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:35.357789 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:35.360782 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e86e35f1-ccbe-4eb7-ba44-c0d0da1281e4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:35.379074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 57abba16-9897-4390-97ae-11192c4c120c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:35.379425 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:35.382867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8062e69-c661-4c8f-99a1-38b3f855a3cb req-037da3b2-49df-4657-9e4e-8bb78623cd6c tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:35.384518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8062e69-c661-4c8f-99a1-38b3f855a3cb req-037da3b2-49df-4657-9e4e-8bb78623cd6c tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 967 time: 0.4874306 May 12 15:04:35.426191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:35.426795 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:35.428249 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] 10.222.0.84 "PUT /v2.0/ports/2630733c-d113-4a35-86d3-c09219afe149 HTTP/1.1" status: 200 len: 1096 time: 1.9688971 May 12 15:04:35.428699 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd3d5a7b0-aaee-4e48-9bd4-e2cffa0be595', 'tag': '2630733c-d113-4a35-86d3-c09219afe149'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:35.437986 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e86e35f1-ccbe-4eb7-ba44-c0d0da1281e4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:35.517884 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58c985e2-e4d6-4a02-bb82-66a0b0ec8a1e req-68816d33-37ac-40b1-bd65-3a060ec2b256 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:35.519647 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58c985e2-e4d6-4a02-bb82-66a0b0ec8a1e req-68816d33-37ac-40b1-bd65-3a060ec2b256 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 949 time: 0.2821455 May 12 15:04:35.530959 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8062e69-c661-4c8f-99a1-38b3f855a3cb req-79271378-4cac-422c-a038-8dcd9bbac9e2 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/security-groups?id=523e81ba-8739-440a-b9d0-888a323ce6a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1287310 May 12 15:04:35.610937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bc0b390-c824-47c4-82ef-7d290c61e0d7 service neutron] Pushing event updated for resources: {'Port': ['ID=2630733c-d113-4a35-86d3-c09219afe149,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:35.678200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-806d0910-d61c-443e-95e9-aa2609a6b321 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:35.680750 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-806d0910-d61c-443e-95e9-aa2609a6b321 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=146fd417ad5d4f85ae5ce85d279642a7&device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 1099 time: 0.1611302 May 12 15:04:35.700933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58c985e2-e4d6-4a02-bb82-66a0b0ec8a1e req-3198278e-6ece-4ccb-82be-9231e505167a tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1227336 May 12 15:04:35.758603 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:35.801071 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e86e35f1-ccbe-4eb7-ba44-c0d0da1281e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:35.838234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86e35f1-ccbe-4eb7-ba44-c0d0da1281e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a77690a-5a8c-41a8-a815-affadf64cc61,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:35.947987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-2a3716e2-5b0d-4a9f-8926-4abdf6034c58 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.228&port_id=2630733c-d113-4a35-86d3-c09219afe149 HTTP/1.1" status: 200 len: 217 time: 0.2491908 May 12 15:04:35.950006 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6bada17f-b3b4-41a0-9624-c69cf2e42e07'] response: {'name': 'network-changed', 'server_uuid': 'd3d5a7b0-aaee-4e48-9bd4-e2cffa0be595', 'tag': '2630733c-d113-4a35-86d3-c09219afe149', 'status': 'completed', 'code': 200} May 12 15:04:35.968031 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:35.992026 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:36.024784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '048a92c4-13d1-40e6-9714-2c96dd562708', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '57abba16-9897-4390-97ae-11192c4c120c'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:36.025921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bc8f64ab-e415-4d25-919a-8e712e76a5f6,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:36.027752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Checking segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:36.028197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Network hostable DHCP agents. Network: 95dd1383-efe7-494d-a1ab-57e293da83a3, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:04:36.039559 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e86e35f1-ccbe-4eb7-ba44-c0d0da1281e4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:36.043563 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e86e35f1-ccbe-4eb7-ba44-c0d0da1281e4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9a77690a-5a8c-41a8-a815-affadf64cc61 HTTP/1.1" status: 204 len: 168 time: 0.8888223 May 12 15:04:36.062286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-6337ac84-b51c-4c86-bda3-adff38ae962c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:36.065660 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-6337ac84-b51c-4c86-bda3-adff38ae962c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1009140 May 12 15:04:36.091857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Transition to ACTIVE for port object 02954b40-9f4a-4e04-a709-814c598e1c12 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:36.098176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Network 95dd1383-efe7-494d-a1ab-57e293da83a3 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:04:36.098337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 57abba16-9897-4390-97ae-11192c4c120c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=57abba16-9897-4390-97ae-11192c4c120c,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:36.106056 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:36.135464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30d4f5ff-8627-423d-b840-145b300e6562 req-081ec0bb-5402-4918-90cb-1c6242ab384a tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:36.143897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30d4f5ff-8627-423d-b840-145b300e6562 req-081ec0bb-5402-4918-90cb-1c6242ab384a tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 948 time: 0.2931345 May 12 15:04:36.196124 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:36.197477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42256) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:36.197949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 95dd1383-efe7-494d-a1ab-57e293da83a3) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:36.207393 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:36.208043 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:36.212064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Request body: {'security_group': {'name': 'tempest-securitygroup--750292895', 'description': 'tempest-description--1467363970'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:36.219195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:36.224162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Usage tracker for resource:security_group and tenant:38c07c88d2f84b29a9ae8c83558ec74b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:36.227694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:36.235022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:36.235858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd7644b6-cc8a-4ad0-9474-b2c68eea1a9e None None] Network 95dd1383-efe7-494d-a1ab-57e293da83a3 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:04:36.244870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-106f9d6c-14ce-46b6-8eec-a9e009c2923e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:36.246808 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-106f9d6c-14ce-46b6-8eec-a9e009c2923e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1733582 May 12 15:04:36.253599 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:36.254869 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30d4f5ff-8627-423d-b840-145b300e6562 req-c443f915-7946-4042-bf9f-b9b1bbba718d tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1097438 May 12 15:04:36.285530 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-74f8ce15-9d8d-4dc6-9ea3-234492201177 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 857 time: 1.4620414 May 12 15:04:36.393757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48b53d77-5b1c-4ce4-bed6-31d867958b3c None None] Pushing event updated for resources: {'Port': ['ID=02954b40-9f4a-4e04-a709-814c598e1c12,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:36.415170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:36.503517 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-ee2134f9-f536-4472-a1e4-948a084ef184 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2278829 May 12 15:04:36.504743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Usage tracker for resource:security_group_rule and tenant:38c07c88d2f84b29a9ae8c83558ec74b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:36.508347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:36.515074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:36.567200 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e14a8c1c-64a7-4f1c-8697-3ba0d253d31b'] response: {'server_uuid': '048a92c4-13d1-40e6-9714-2c96dd562708', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '57abba16-9897-4390-97ae-11192c4c120c', 'code': 200} May 12 15:04:36.627060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=57abba16-9897-4390-97ae-11192c4c120c,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:36.681291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09f20066-90e8-4541-a01e-ee42511ce714 req-16560978-7fc6-468a-8863-689bd6a14b81 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:36.683746 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09f20066-90e8-4541-a01e-ee42511ce714 req-16560978-7fc6-468a-8863-689bd6a14b81 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 1101 time: 0.1959617 May 12 15:04:36.734572 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-09f20066-90e8-4541-a01e-ee42511ce714 req-8a4b91d6-72a8-466f-bb63-9fc055945c38 service neutron] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:36.781978 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:36.815769 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:36.838783 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Attempting to bind port 02954b40-9f4a-4e04-a709-814c598e1c12 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:36.839084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Attempting to bind port 02954b40-9f4a-4e04-a709-814c598e1c12 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '3f66bf84-0862-4ccb-a6ee-6fe3b88a805c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': '889f9b5f-a864-4a4d-a337-581795e1561e'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:36.839440 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Attempting to bind port 02954b40-9f4a-4e04-a709-814c598e1c12 on network 889f9b5f-a864-4a4d-a337-581795e1561e {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:36.856013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:36.856419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Checking segment: {'id': '3f66bf84-0862-4ccb-a6ee-6fe3b88a805c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': '889f9b5f-a864-4a4d-a337-581795e1561e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:36.856765 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:36.857144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Bound using segment: {'id': '3f66bf84-0862-4ccb-a6ee-6fe3b88a805c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': '889f9b5f-a864-4a4d-a337-581795e1561e'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:36.857660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Bound port: 02954b40-9f4a-4e04-a709-814c598e1c12, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3f66bf84-0862-4ccb-a6ee-6fe3b88a805c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': '889f9b5f-a864-4a4d-a337-581795e1561e'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:36.858020 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:36.860106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-09f20066-90e8-4541-a01e-ee42511ce714 req-8a4b91d6-72a8-466f-bb63-9fc055945c38 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:36.874700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-09f20066-90e8-4541-a01e-ee42511ce714 req-8a4b91d6-72a8-466f-bb63-9fc055945c38 service neutron] Usage tracker for resource:security_group_rule and tenant:d1b3cf7bd3a84e5d8fdfbad177a7d8b9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:36.878790 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-09f20066-90e8-4541-a01e-ee42511ce714 req-8a4b91d6-72a8-466f-bb63-9fc055945c38 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:36.899686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-09f20066-90e8-4541-a01e-ee42511ce714 req-8a4b91d6-72a8-466f-bb63-9fc055945c38 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:36.900708 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9dcaee9-4cf2-46d9-819f-f08c62495315 req-6ba58f3e-8ca8-4fbe-a8fb-6e02815d0b31 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3686147 May 12 15:04:36.901938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bea28a12-4648-49eb-967a-a6cae208864d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:36.916581 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:36.918199 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-33e1e7fb-7e24-46ab-a790-e51acbc926a1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.7197447 May 12 15:04:36.921773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42282) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:36.936574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e20c9862-86d8-4d1e-9656-79168f1f1e04 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Request body: {'security_group_rule': {'security_group_id': 'bea28a12-4648-49eb-967a-a6cae208864d', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:36.951626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e20c9862-86d8-4d1e-9656-79168f1f1e04 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:36.957600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e20c9862-86d8-4d1e-9656-79168f1f1e04 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Usage tracker for resource:security_group_rule and tenant:38c07c88d2f84b29a9ae8c83558ec74b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:36.962378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e20c9862-86d8-4d1e-9656-79168f1f1e04 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:36.969714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e20c9862-86d8-4d1e-9656-79168f1f1e04 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:36.995743 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e20c9862-86d8-4d1e-9656-79168f1f1e04 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:37.012414 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] For port 02954b40-9f4a-4e04-a709-814c598e1c12, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:37.016032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] For port 02954b40-9f4a-4e04-a709-814c598e1c12, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=02954b40-9f4a-4e04-a709-814c598e1c12,segment=NetworkSegment(3f66bf84-0862-4ccb-a6ee-6fe3b88a805c),segment_id=3f66bf84-0862-4ccb-a6ee-6fe3b88a805c)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:37.018878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 343f050d-81d2-410f-a8ab-b2bdef562d11 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:04:37.053868 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:37.123124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-402d0b64-c686-42ae-b1a1-23d5ed34c1bf req-3f5e381e-82fd-4e05-8315-4181ffffe7f7 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:37.135229 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-402d0b64-c686-42ae-b1a1-23d5ed34c1bf req-3f5e381e-82fd-4e05-8315-4181ffffe7f7 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 967 time: 0.3412199 May 12 15:04:37.146894 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Routers {'5c57748e-d5af-4f2c-b90a-040ede2ad3e6'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:04:37.148839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:04:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5c57748e-d5af-4f2c-b90a-040ede2ad3e6'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:37.206531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d082ff4a-4975-4479-8fba-0d9eb1b8dcdf None None] Network 95dd1383-efe7-494d-a1ab-57e293da83a3 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:04:37.310308 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e20c9862-86d8-4d1e-9656-79168f1f1e04 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:37.336806 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e20c9862-86d8-4d1e-9656-79168f1f1e04 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:37.349495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b71d0898-deaf-4af0-bf18-ca47dd51a2f5 req-9ec0c78f-5809-4d15-8e7d-ee82228b7cbc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:37.364575 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b71d0898-deaf-4af0-bf18-ca47dd51a2f5 req-9ec0c78f-5809-4d15-8e7d-ee82228b7cbc service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=146fd417ad5d4f85ae5ce85d279642a7&device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 1099 time: 0.3106723 May 12 15:04:37.394272 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-09f20066-90e8-4541-a01e-ee42511ce714 req-8a4b91d6-72a8-466f-bb63-9fc055945c38 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:37.426977 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-09f20066-90e8-4541-a01e-ee42511ce714 req-8a4b91d6-72a8-466f-bb63-9fc055945c38 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:37.480926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a4b91d6-72a8-466f-bb63-9fc055945c38 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=b8b29de1-25ab-461a-8fd2-7247760c9f44,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:37.496756 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-402d0b64-c686-42ae-b1a1-23d5ed34c1bf req-f22dc7af-045d-4587-8c9f-0ee1cd48563a tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/security-groups?id=523e81ba-8739-440a-b9d0-888a323ce6a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3605866 May 12 15:04:37.509998 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] It took 0.38 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:04:37.535919 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09f20066-90e8-4541-a01e-ee42511ce714 req-8a4b91d6-72a8-466f-bb63-9fc055945c38 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8441143 May 12 15:04:37.562596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa93f056-34db-4a46-a4c5-627b4ea1b60d req-e4a977dd-49fe-4558-91f6-769d181d35ce tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:37.572122 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa93f056-34db-4a46-a4c5-627b4ea1b60d req-e4a977dd-49fe-4558-91f6-769d181d35ce tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 950 time: 0.6184473 May 12 15:04:37.657772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b71d0898-deaf-4af0-bf18-ca47dd51a2f5 req-cb0c1b9b-729b-494b-ab39-f6d412732bff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:37.660788 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b71d0898-deaf-4af0-bf18-ca47dd51a2f5 req-cb0c1b9b-729b-494b-ab39-f6d412732bff service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.2939062 May 12 15:04:37.661549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e20c9862-86d8-4d1e-9656-79168f1f1e04 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e1be4cc1-702f-4be6-807d-37ff16ba0dd6,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:37.666054 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa93f056-34db-4a46-a4c5-627b4ea1b60d req-bbd99956-a2ac-430f-a6ea-bc50a02672f2 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0930743 May 12 15:04:37.759021 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e20c9862-86d8-4d1e-9656-79168f1f1e04 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:37.760480 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e20c9862-86d8-4d1e-9656-79168f1f1e04 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.8370092 May 12 15:04:37.776614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42304) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:37.780098 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b71d0898-deaf-4af0-bf18-ca47dd51a2f5 req-1c66039b-cea6-46cc-b012-e8ad22a82a27 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.228&port_id=2630733c-d113-4a35-86d3-c09219afe149 HTTP/1.1" status: 200 len: 217 time: 0.1107435 May 12 15:04:37.785250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-347a94f6-6d3e-460e-94d6-8b44c369affb tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Request body: {'security_group_rule': {'security_group_id': 'bea28a12-4648-49eb-967a-a6cae208864d', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:37.799257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42312) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:37.832134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48b53d77-5b1c-4ce4-bed6-31d867958b3c None None] Pushing event updated for resources: {'Port': ['ID=02954b40-9f4a-4e04-a709-814c598e1c12,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:37.874610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2f82694-41e2-4c5d-9583-25c046b145b9 req-4b1c58f9-42b1-4cfa-9b1c-0e974876aa4b tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:37.875810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b71d0898-deaf-4af0-bf18-ca47dd51a2f5 req-a9b8505e-28af-474d-a326-6473e7cd8806 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:37.877233 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b71d0898-deaf-4af0-bf18-ca47dd51a2f5 req-a9b8505e-28af-474d-a326-6473e7cd8806 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0859177 May 12 15:04:37.878565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-347a94f6-6d3e-460e-94d6-8b44c369affb tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:37.885410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Request body: {'network': {'name': 'tempest-LiveAutoBlockMigrationV225Test-413587902-network', 'tenant_id': '4b120ec547c148f686e319977fca97d7'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:37.886187 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e2f82694-41e2-4c5d-9583-25c046b145b9 req-4b1c58f9-42b1-4cfa-9b1c-0e974876aa4b tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 948 time: 0.1800084 May 12 15:04:37.890419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:37.895495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Usage tracker for resource:network and tenant:4b120ec547c148f686e319977fca97d7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:37.900216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:37.918006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:37.965216 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e2f82694-41e2-4c5d-9583-25c046b145b9 req-b332492f-0108-474b-b3ac-58557c5fca70 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0762796 May 12 15:04:38.019926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-347a94f6-6d3e-460e-94d6-8b44c369affb tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Usage tracker for resource:security_group_rule and tenant:38c07c88d2f84b29a9ae8c83558ec74b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:38.024514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Made reservation on behalf of 4b120ec547c148f686e319977fca97d7 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:38.026795 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.045315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-347a94f6-6d3e-460e-94d6-8b44c369affb tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:38.048340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.073851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 343f050d-81d2-410f-a8ab-b2bdef562d11, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=343f050d-81d2-410f-a8ab-b2bdef562d11,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:38.086433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:38.090621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Usage tracker for resource:security_group_rule and tenant:4b120ec547c148f686e319977fca97d7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:38.094288 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:38.100236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:38.102900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] Set router 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:04:38.139329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-347a94f6-6d3e-460e-94d6-8b44c369affb tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:38.150238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '343f050d-81d2-410f-a8ab-b2bdef562d11', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '343f050d-81d2-410f-a8ab-b2bdef562d11', 'mac_address': 'fa:16:3e:66:df:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.54'}], 'device_owner': 'compute:tempest-test_az-52089536', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:04:38.199449 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-347a94f6-6d3e-460e-94d6-8b44c369affb tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.248617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b71d0898-deaf-4af0-bf18-ca47dd51a2f5 req-1d5a7f9a-58d4-4886-875f-2cf99510bc26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:38.249952 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b71d0898-deaf-4af0-bf18-ca47dd51a2f5 req-1d5a7f9a-58d4-4886-875f-2cf99510bc26 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.3140025 May 12 15:04:38.267338 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.297428 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.364933 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.408553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 554} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:04:38.437484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 343f050d-81d2-410f-a8ab-b2bdef562d11 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:38.448345 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.448684 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Added segment 3e473d99-7071-49a4-8121-959ab1957563 of type vlan for network eb4eaa8c-a12a-4771-b1b0-b81266e37b2a May 12 15:04:38.453686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a543ee7f-b79b-4d14-900f-2472d7620622,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:38.463285 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-347a94f6-6d3e-460e-94d6-8b44c369affb tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.472812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 343f050d-81d2-410f-a8ab-b2bdef562d11, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=343f050d-81d2-410f-a8ab-b2bdef562d11,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:38.481094 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-347a94f6-6d3e-460e-94d6-8b44c369affb tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.488575 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.547061 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.555232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-347a94f6-6d3e-460e-94d6-8b44c369affb tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=267118a3-0536-4e4b-89bd-34a62ec05dce,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:38.565755 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b71d0898-deaf-4af0-bf18-ca47dd51a2f5 req-e82996df-8495-4757-9f99-fa57859b49da service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3065178 May 12 15:04:38.603394 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-347a94f6-6d3e-460e-94d6-8b44c369affb tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.608066 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-347a94f6-6d3e-460e-94d6-8b44c369affb tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.8265634 May 12 15:04:38.608190 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=343f050d-81d2-410f-a8ab-b2bdef562d11,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:38.609046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42322) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:38.619450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:38.628328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:38.634154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Usage tracker for resource:floatingip and tenant:38c07c88d2f84b29a9ae8c83558ec74b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:38.634825 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-158859462-router', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10'}], 'enable_snat': True}, 'gw_port_id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:19Z', 'updated_at': '2022-05-12T15:04:32Z', 'revision_number': 4, 'project_id': '22609d3eca554e908455a9f04efb4ffa', 'gw_port': {'id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:6d:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:22Z', 'updated_at': '2022-05-12T15:04:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '02954b40-9f4a-4e04-a709-814c598e1c12', 'name': '', 'network_id': '889f9b5f-a864-4a4d-a337-581795e1561e', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'mac_address': 'fa:16:3e:90:b3:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'device_owner': 'network:router_interface', 'standard_attr_id': 122, 'fixed_ips': [{'subnet_id': 'e47e554d-eb97-4217-b6e3-2120f84b68bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:30Z', 'updated_at': '2022-05-12T15:04:37Z', 'revision_number': 4, 'project_id': '22609d3eca554e908455a9f04efb4ffa', 'subnets': [{'id': 'e47e554d-eb97-4217-b6e3-2120f84b68bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:04:38.638611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:38.639205 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70ee9b7b-d032-42c2-a3d0-57f9eb11592c None None] The sync data for ids ['5c57748e-d5af-4f2c-b90a-040ede2ad3e6'] in n-d-841483-1 is: [{'id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-158859462-router', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10'}], 'enable_snat': True}, 'gw_port_id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:19Z', 'updated_at': '2022-05-12T15:04:32Z', 'revision_number': 4, 'project_id': '22609d3eca554e908455a9f04efb4ffa', 'gw_port': {'id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:6d:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:22Z', 'updated_at': '2022-05-12T15:04:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '02954b40-9f4a-4e04-a709-814c598e1c12', 'name': '', 'network_id': '889f9b5f-a864-4a4d-a337-581795e1561e', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'mac_address': 'fa:16:3e:90:b3:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'device_owner': 'network:router_interface', 'standard_attr_id': 122, 'fixed_ips': [{'subnet_id': 'e47e554d-eb97-4217-b6e3-2120f84b68bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:30Z', 'updated_at': '2022-05-12T15:04:37Z', 'revision_number': 4, 'project_id': '22609d3eca554e908455a9f04efb4ffa', 'subnets': [{'id': 'e47e554d-eb97-4217-b6e3-2120f84b68bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:04:38.645634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:38.700639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['343f050d-81d2-410f-a8ab-b2bdef562d11'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:04:38.714186 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.721712 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.722658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:38.723235 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:38.890230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] Pushing event updated for resources: {'Network': ['ID=eb4eaa8c-a12a-4771-b1b0-b81266e37b2a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:38.892883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b3e6e7b-38ca-4605-82fe-c8f0a7fa0094 req-756456b6-b83b-4a1c-966f-9427df855f7b tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:38.907852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network eb4eaa8c-a12a-4771-b1b0-b81266e37b2a details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:04:38.908673 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b3e6e7b-38ca-4605-82fe-c8f0a7fa0094 req-756456b6-b83b-4a1c-966f-9427df855f7b tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 968 time: 0.2567642 May 12 15:04:38.925189 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-480805a7-5b9c-401a-9a6b-5ce607ac8855 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 1.0517454 May 12 15:04:38.925982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42328) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:38.934094 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b71d0898-deaf-4af0-bf18-ca47dd51a2f5 req-79eced68-b479-49d3-8578-a71185c06693 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3584876 May 12 15:04:38.940261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Request body: {'subnet': {'network_id': 'eb4eaa8c-a12a-4771-b1b0-b81266e37b2a', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveAutoBlockMigrationV225Test-413587902-subnet', 'tenant_id': '4b120ec547c148f686e319977fca97d7', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:38.945406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:38.949797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Usage tracker for resource:subnet and tenant:4b120ec547c148f686e319977fca97d7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:38.966743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 02954b40-9f4a-4e04-a709-814c598e1c12 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:38.967444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:38.977555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:38.992251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Made reservation on behalf of 4b120ec547c148f686e319977fca97d7 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:38.995628 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Notify callbacks [] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:39.037476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b3e6e7b-38ca-4605-82fe-c8f0a7fa0094 req-28102809-7e60-4b87-bfd7-484841e10c2a tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/security-groups?id=523e81ba-8739-440a-b9d0-888a323ce6a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1277871 May 12 15:04:39.100072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b63ec0-21fd-448d-94ea-b0e27eb9ea9b req-4b1dac13-e9ec-4ebb-b8fb-4f2ce8361c12 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:39.102244 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7b63ec0-21fd-448d-94ea-b0e27eb9ea9b req-4b1dac13-e9ec-4ebb-b8fb-4f2ce8361c12 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 950 time: 0.1674175 May 12 15:04:39.110242 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:39.222265 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 02954b40-9f4a-4e04-a709-814c598e1c12 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:39.231109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 02954b40-9f4a-4e04-a709-814c598e1c12 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:39.237821 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:39.518578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Allocated IP 172.25.8.60 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/6a1d8850-c23f-4315-a99f-1c1a0d8dbecb) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:39.522150 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:39.575431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 02954b40-9f4a-4e04-a709-814c598e1c12, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=02954b40-9f4a-4e04-a709-814c598e1c12,segment=NetworkSegment(3f66bf84-0862-4ccb-a6ee-6fe3b88a805c),segment_id=3f66bf84-0862-4ccb-a6ee-6fe3b88a805c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:39.586874 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:39.594991 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:39.719746 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=02954b40-9f4a-4e04-a709-814c598e1c12,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:39.791737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6fc460c7-68bc-4e44-96ec-27887841733e,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:39.802014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Checking segment: {'id': '3e473d99-7071-49a4-8121-959ab1957563', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': 'eb4eaa8c-a12a-4771-b1b0-b81266e37b2a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:39.802259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Network hostable DHCP agents. Network: eb4eaa8c-a12a-4771-b1b0-b81266e37b2a, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:04:39.832176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Network eb4eaa8c-a12a-4771-b1b0-b81266e37b2a is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:04:39.846193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, eb4eaa8c-a12a-4771-b1b0-b81266e37b2a) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:39.851653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:39.852610 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:39.857137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e308088-4653-484e-8ef0-731adcde377d None None] Network eb4eaa8c-a12a-4771-b1b0-b81266e37b2a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:04:39.879650 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7b63ec0-21fd-448d-94ea-b0e27eb9ea9b req-ddf5c38d-d735-408a-ba62-d5f38c57fd22 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7708836 May 12 15:04:39.917675 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-929533b3-916d-4c39-8334-9110e5e115c7 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 857 time: 0.9820654 May 12 15:04:39.969534 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:39.984357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a990814-2441-4256-b692-6a4092366a52 req-f5cfe483-aea0-404f-b8c4-b2e6c323b5cd tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:39.985782 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a990814-2441-4256-b692-6a4092366a52 req-f5cfe483-aea0-404f-b8c4-b2e6c323b5cd tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 948 time: 0.4444170 May 12 15:04:40.053278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a990814-2441-4256-b692-6a4092366a52 req-96eedb26-4985-4ec8-999e-fd8456fd064f tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557454 May 12 15:04:40.078348 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:40.166736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:40.169944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:40.174199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:40.189860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Pushing event updated for resources: {'Port': ['ID=6a1d8850-c23f-4315-a99f-1c1a0d8dbecb,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:40.212719 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b76669f1-a6f1-4a7a-8282-af404161c2e8 None None] Network eb4eaa8c-a12a-4771-b1b0-b81266e37b2a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:04:40.347545 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:40.412056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2935b68f-07e6-4bcf-8f3f-1bbe73b08b97 req-47c9abf3-6c6b-448e-9cbf-cfa57999dcd4 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:40.414228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2935b68f-07e6-4bcf-8f3f-1bbe73b08b97 req-47c9abf3-6c6b-448e-9cbf-cfa57999dcd4 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 968 time: 0.1740189 May 12 15:04:40.481884 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:40.533233 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2935b68f-07e6-4bcf-8f3f-1bbe73b08b97 req-2f83bbdc-b7e2-4793-b13b-8bf56dfded6f tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/security-groups?id=523e81ba-8739-440a-b9d0-888a323ce6a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1120052 May 12 15:04:40.838556 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 02954b40-9f4a-4e04-a709-814c598e1c12 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:40.902340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-eeea3624-fb20-4033-8588-0a762806b9e1 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:40.903804 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-eeea3624-fb20-4033-8588-0a762806b9e1 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 820 time: 0.1961002 May 12 15:04:40.906735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 02954b40-9f4a-4e04-a709-814c598e1c12 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:40.907112 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:40.932824 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:40.936014 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-f26ee9bb-a72f-487b-b410-78dd8c000915 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/quotas/1b3825228b0e4c42a381540b66ea23d6 HTTP/1.1" status: 200 len: 375 time: 0.0196249 May 12 15:04:40.939679 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:41.005707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 343f050d-81d2-410f-a8ab-b2bdef562d11 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:41.056501 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:41.095032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-c58c41c1-6710-4ac5-9323-0ac1fa4c6490 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1048262 May 12 15:04:41.098072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 343f050d-81d2-410f-a8ab-b2bdef562d11 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:41.102890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 343f050d-81d2-410f-a8ab-b2bdef562d11 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:41.103501 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:41.125229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Pushing event updated for resources: {'Port': ['ID=6a1d8850-c23f-4315-a99f-1c1a0d8dbecb,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:41.149034 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:41.150263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ea5685df-e283-4106-9e44-4059e01a881d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.5393093 May 12 15:04:41.181609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1525d7fa-f8ea-4e88-98d0-4fbcb18a087e req-67168fec-7c12-4d43-a5cb-51fb9dc75d65 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:41.183569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1525d7fa-f8ea-4e88-98d0-4fbcb18a087e req-67168fec-7c12-4d43-a5cb-51fb9dc75d65 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 950 time: 0.1438422 May 12 15:04:41.238292 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:41.245702 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1525d7fa-f8ea-4e88-98d0-4fbcb18a087e req-9162f3cc-1583-438c-86bf-db85a52af3c7 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554721 May 12 15:04:41.290839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5cd1d64a-2898-4f90-beb1-fad4769e0b7c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '343f050d-81d2-410f-a8ab-b2bdef562d11'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:41.305919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 343f050d-81d2-410f-a8ab-b2bdef562d11, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=343f050d-81d2-410f-a8ab-b2bdef562d11,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:41.310299 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:41.342303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd804a1f-1dea-4d49-a099-ddacee6ac92c service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:04:41.343912 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd804a1f-1dea-4d49-a099-ddacee6ac92c service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0580378 May 12 15:04:41.364017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2630733c-d113-4a35-86d3-c09219afe149 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:04:41.412813 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=343f050d-81d2-410f-a8ab-b2bdef562d11,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:41.523183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 2630733c-d113-4a35-86d3-c09219afe149, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2630733c-d113-4a35-86d3-c09219afe149,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:41.536980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '2630733c-d113-4a35-86d3-c09219afe149', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '2630733c-d113-4a35-86d3-c09219afe149', 'mac_address': 'fa:16:3e:5b:3d:64', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.228'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:04:41.546406 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-24edf357-4fea-43b7-a67a-0c4490839c12 service neutron] 10.222.0.82 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1959336 May 12 15:04:41.557640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78565aec-59d3-4876-a902-4f85251ec871 req-1f6b37ba-b6a0-49c6-af2d-f684d13bdf5e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:41.559106 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78565aec-59d3-4876-a902-4f85251ec871 req-1f6b37ba-b6a0-49c6-af2d-f684d13bdf5e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 948 time: 0.1838520 May 12 15:04:41.597426 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:41.613605 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2630733c-d113-4a35-86d3-c09219afe149 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:41.628869 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 2630733c-d113-4a35-86d3-c09219afe149, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2630733c-d113-4a35-86d3-c09219afe149,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:41.633515 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:41.687072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78565aec-59d3-4876-a902-4f85251ec871 req-67a7395b-1498-4d2e-91eb-897ddc5c3e47 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1070926 May 12 15:04:41.710681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=2630733c-d113-4a35-86d3-c09219afe149,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:41.736743 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-82e260d3-1f3f-42a4-baa5-2e78decb5929 service neutron] 10.222.0.82 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1762617 May 12 15:04:41.889792 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8fdcefb6-2a30-4c17-8e20-9a7429b94169'] response: {'server_uuid': '5cd1d64a-2898-4f90-beb1-fad4769e0b7c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '343f050d-81d2-410f-a8ab-b2bdef562d11', 'code': 200} May 12 15:04:42.059541 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9c92d16e-5951-49fb-910e-dda60aab6c79 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--750292895&fields=id&tenant_id=38c07c88d2f84b29a9ae8c83558ec74b HTTP/1.1" status: 200 len: 267 time: 0.0649738 May 12 15:04:42.091019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['2630733c-d113-4a35-86d3-c09219afe149'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:04:42.104545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641af024-9542-4b9f-a84e-6aa7fb4df1ce req-da1c6c84-b9fa-4f4b-9bc7-b6c6c181ea8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:42.106265 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-641af024-9542-4b9f-a84e-6aa7fb4df1ce req-da1c6c84-b9fa-4f4b-9bc7-b6c6c181ea8e service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 1120 time: 0.1502912 May 12 15:04:42.252816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-641af024-9542-4b9f-a84e-6aa7fb4df1ce req-3f6694c5-5be4-45c7-b5df-75b92ff10a3c service neutron] Synchronizing usage tracker for tenant:d1b3cf7bd3a84e5d8fdfbad177a7d8b9 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:04:42.364102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-641af024-9542-4b9f-a84e-6aa7fb4df1ce req-3f6694c5-5be4-45c7-b5df-75b92ff10a3c service neutron] Unset dirty status for tenant:d1b3cf7bd3a84e5d8fdfbad177a7d8b9 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:04:42.365479 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-641af024-9542-4b9f-a84e-6aa7fb4df1ce req-3f6694c5-5be4-45c7-b5df-75b92ff10a3c service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=523e81ba-8739-440a-b9d0-888a323ce6a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1991024 May 12 15:04:42.401503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-20b07b5c-f445-4b55-a1da-476dddb1de11 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:42.402901 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-20b07b5c-f445-4b55-a1da-476dddb1de11 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/networks?id=feb95830-c0c2-46c0-bb35-f2f43605e79a HTTP/1.1" status: 200 len: 824 time: 0.3267007 May 12 15:04:42.432321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-696b01f4-6b37-4f36-bdf2-472f80730f21 req-7acedcf7-a2a1-4570-9236-69cf8f627bc6 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:42.434030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-696b01f4-6b37-4f36-bdf2-472f80730f21 req-7acedcf7-a2a1-4570-9236-69cf8f627bc6 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 969 time: 0.1687148 May 12 15:04:42.435456 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-f54c55b1-e8d7-4708-a543-7ba87a9f11e8 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/quotas/38c07c88d2f84b29a9ae8c83558ec74b HTTP/1.1" status: 200 len: 375 time: 0.0258861 May 12 15:04:42.539590 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-696b01f4-6b37-4f36-bdf2-472f80730f21 req-0224474a-9c23-47fd-ac45-53dbde706afa tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/security-groups?id=523e81ba-8739-440a-b9d0-888a323ce6a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0998070 May 12 15:04:42.568309 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:42.580570 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-120d9cb4-713f-4083-b725-56a822e8be45 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=38c07c88d2f84b29a9ae8c83558ec74b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1384940 May 12 15:04:42.630521 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ff3f283c-3eb9-474c-9d58-f056febfd14f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:42.719471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25bb4b4c-1294-4e5f-8aeb-f0334cdd9206 req-cf1907bf-e839-4427-a493-7b28fc8dc94b tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 210 time: 0.0590239 May 12 15:04:42.763424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-303cbf9a-7957-4fd3-b9ef-165001437e26 service neutron] 10.222.0.82 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1708035 May 12 15:04:42.999249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-8c170aea-04bd-426b-ab6f-5a324ab35529 service neutron] 10.222.0.82 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2296860 May 12 15:04:43.015042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6102fb9a-bc89-4e7f-90ee-2a1e633bcf9e req-59ba52c5-1fb8-47fc-95cd-b2bbf15a6a28 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:43.016452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6102fb9a-bc89-4e7f-90ee-2a1e633bcf9e req-59ba52c5-1fb8-47fc-95cd-b2bbf15a6a28 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 950 time: 0.1292148 May 12 15:04:43.061091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6102fb9a-bc89-4e7f-90ee-2a1e633bcf9e req-eb8b1824-4b0d-429a-ac5a-ab228bee9e11 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386641 May 12 15:04:43.321347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d55809ca-a9ad-4275-9d70-cb3983eb9285 req-e2288956-f7de-4d43-b20c-8583e3ead27c tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 210 time: 0.1355340 May 12 15:04:43.358853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2630733c-d113-4a35-86d3-c09219afe149 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:43.442429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2281e7b1-baa6-4a2e-a1d1-360e4082f42d req-88452eee-9fe1-4932-9abc-e0e2184a0f11 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:43.455130 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2281e7b1-baa6-4a2e-a1d1-360e4082f42d req-88452eee-9fe1-4932-9abc-e0e2184a0f11 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 949 time: 0.1985435 May 12 15:04:43.479256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 2630733c-d113-4a35-86d3-c09219afe149 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:43.487566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-ff47e173-8efe-4b21-bae8-b5175c0a1387 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:43.489492 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 2630733c-d113-4a35-86d3-c09219afe149 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:43.489946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-ff47e173-8efe-4b21-bae8-b5175c0a1387 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Synchronizing usage tracker for tenant:1b3825228b0e4c42a381540b66ea23d6 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:04:43.491844 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:43.528019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-ff47e173-8efe-4b21-bae8-b5175c0a1387 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Unset dirty status for tenant:1b3825228b0e4c42a381540b66ea23d6 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:04:43.532463 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-ff47e173-8efe-4b21-bae8-b5175c0a1387 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.84 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 820 time: 0.3281090 May 12 15:04:43.556645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Request body: {'port': {'device_id': '65495c97-2a82-4737-a9aa-c3ca1d8ffc86', 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3', 'admin_state_up': True, 'tenant_id': '1b3825228b0e4c42a381540b66ea23d6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:43.571392 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2281e7b1-baa6-4a2e-a1d1-360e4082f42d req-fec4d1cc-9d78-48a2-976c-9ad07a7c48fa tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1148145 May 12 15:04:43.727716 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:43.772036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:43.794143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Usage tracker for resource:port and tenant:1b3825228b0e4c42a381540b66ea23d6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:43.799010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:43.800787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 2630733c-d113-4a35-86d3-c09219afe149, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2630733c-d113-4a35-86d3-c09219afe149,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:43.807361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:43.815698 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:43.831223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Made reservation on behalf of 1b3825228b0e4c42a381540b66ea23d6 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:43.839731 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:43.841715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4d68ce6-897f-4b08-b5ab-e12f511b3014 req-b20ad85f-b911-40ea-864b-59e4a6cadb27 tempest-DeleteServersAdminTestJSON-1144414668 tempest-DeleteServersAdminTestJSON-1144414668-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:43.841715 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4d68ce6-897f-4b08-b5ab-e12f511b3014 req-b20ad85f-b911-40ea-864b-59e4a6cadb27 tempest-DeleteServersAdminTestJSON-1144414668 tempest-DeleteServersAdminTestJSON-1144414668-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 1101 time: 0.1607924 May 12 15:04:43.855957 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ddf062c-0386-4d8b-b12c-e34811072ac6 req-3585a2d1-c7fe-40bc-aab1-139b301b58af tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:43.864216 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2ddf062c-0386-4d8b-b12c-e34811072ac6 req-3585a2d1-c7fe-40bc-aab1-139b301b58af tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 969 time: 0.1370316 May 12 15:04:43.903409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd3d5a7b0-aaee-4e48-9bd4-e2cffa0be595', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2630733c-d113-4a35-86d3-c09219afe149'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:43.944028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=2630733c-d113-4a35-86d3-c09219afe149,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:43.996586 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5add9fe8-cde3-4191-b6bb-8bf09632c9d0 req-9c48ce50-ada2-46f1-91fa-ad3fc0711fe8 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 210 time: 0.0657132 May 12 15:04:44.008468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-c4d68ce6-897f-4b08-b5ab-e12f511b3014 req-67218097-7f0e-4d31-b608-513a083aa329 tempest-DeleteServersAdminTestJSON-1144414668 tempest-DeleteServersAdminTestJSON-1144414668-project-admin] Deleting port 57abba16-9897-4390-97ae-11192c4c120c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:04:44.008822 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c4d68ce6-897f-4b08-b5ab-e12f511b3014 req-67218097-7f0e-4d31-b608-513a083aa329 tempest-DeleteServersAdminTestJSON-1144414668 tempest-DeleteServersAdminTestJSON-1144414668-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:44.041124 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2ddf062c-0386-4d8b-b12c-e34811072ac6 req-930e3b26-b392-4994-835e-23186a8f98c3 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/security-groups?id=523e81ba-8739-440a-b9d0-888a323ce6a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1760623 May 12 15:04:44.076645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Allocated IP 172.20.0.13 (95dd1383-efe7-494d-a1ab-57e293da83a3/bc8f64ab-e415-4d25-919a-8e712e76a5f6/d7e09d66-2268-48c4-a658-ef10261e7a46) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:44.082923 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bbe4baac-d12f-4e3d-a468-d47581541c3a'] response: {'server_uuid': 'd3d5a7b0-aaee-4e48-9bd4-e2cffa0be595', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2630733c-d113-4a35-86d3-c09219afe149', 'code': 200} May 12 15:04:44.216142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.84', 55065) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:44.333674 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:44.366117 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:44.392384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c4d68ce6-897f-4b08-b5ab-e12f511b3014 req-67218097-7f0e-4d31-b608-513a083aa329 tempest-DeleteServersAdminTestJSON-1144414668 tempest-DeleteServersAdminTestJSON-1144414668-project-admin] For port 57abba16-9897-4390-97ae-11192c4c120c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=57abba16-9897-4390-97ae-11192c4c120c,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:44.392741 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c4d68ce6-897f-4b08-b5ab-e12f511b3014 req-67218097-7f0e-4d31-b608-513a083aa329 tempest-DeleteServersAdminTestJSON-1144414668 tempest-DeleteServersAdminTestJSON-1144414668-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:44.415472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-249d7c14-c8f1-4a9e-96d9-01720401895b req-f1139eaa-5a97-4e4f-b814-66b1dd5db5ac tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:44.416941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-249d7c14-c8f1-4a9e-96d9-01720401895b req-f1139eaa-5a97-4e4f-b814-66b1dd5db5ac tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=048a92c4-13d1-40e6-9714-2c96dd562708 HTTP/1.1" status: 200 len: 950 time: 0.2073526 May 12 15:04:44.435916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Network 95dd1383-efe7-494d-a1ab-57e293da83a3 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:44.438995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:44.442727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:44.448185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:44.448791 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:44.470976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Pushing event updated for resources: {'Port': ['ID=d7e09d66-2268-48c4-a658-ef10261e7a46,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:44.482011 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-bd96c960-d58c-4ebb-802d-9e5edda01f22 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9308801 May 12 15:04:44.501898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Request body: {'port': {'device_id': '65495c97-2a82-4737-a9aa-c3ca1d8ffc86', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:44.571355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-c4d68ce6-897f-4b08-b5ab-e12f511b3014 req-67218097-7f0e-4d31-b608-513a083aa329 tempest-DeleteServersAdminTestJSON-1144414668 tempest-DeleteServersAdminTestJSON-1144414668-project-admin] Calling delete_port for 57abba16-9897-4390-97ae-11192c4c120c owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:04:44.623690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eb1a191-d266-456a-8faa-1e4f6015982e req-5a0ef93f-07cb-424e-ae69-75fe8900bf77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:44.625629 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3eb1a191-d266-456a-8faa-1e4f6015982e req-5a0ef93f-07cb-424e-ae69-75fe8900bf77 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 1101 time: 0.3794749 May 12 15:04:44.642160 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:44.652510 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89c4575b-5879-4e06-a7d0-680d41b966cd req-a34bf80e-4aff-4daa-bd23-1cee6489340e tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 210 time: 0.1260860 May 12 15:04:44.793068 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-10c258b5-2b2e-49ec-9ce0-e1fc4804799d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:44.874424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-249d7c14-c8f1-4a9e-96d9-01720401895b req-7a60bd25-7535-4c33-bf54-86b2b145ff06 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3490109 May 12 15:04:45.032650 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3eb1a191-d266-456a-8faa-1e4f6015982e req-c569be58-4ab7-461c-a34e-7d2a90e8a073 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3704364 May 12 15:04:45.099710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d7e09d66-2268-48c4-a658-ef10261e7a46 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:45.110679 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:45.174429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-837bf1e9-fc8e-4a4f-845e-eedc9effbcff tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:45.175813 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-837bf1e9-fc8e-4a4f-845e-eedc9effbcff tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.76 "GET /v2.0/networks?id=feb95830-c0c2-46c0-bb35-f2f43605e79a HTTP/1.1" status: 200 len: 824 time: 0.5739388 May 12 15:04:45.266591 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Transition to ACTIVE for port object d7e09d66-2268-48c4-a658-ef10261e7a46 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:45.272339 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:45.272879 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c4d68ce6-897f-4b08-b5ab-e12f511b3014 req-67218097-7f0e-4d31-b608-513a083aa329 tempest-DeleteServersAdminTestJSON-1144414668 tempest-DeleteServersAdminTestJSON-1144414668-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:45.281421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cf3701f-179e-4059-ae78-3293b5aece5a req-0c58139d-3f83-4f59-b977-938a2c6e4a7c tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:45.283296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cf3701f-179e-4059-ae78-3293b5aece5a req-0c58139d-3f83-4f59-b977-938a2c6e4a7c tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 950 time: 0.2974060 May 12 15:04:45.296700 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['57abba16-9897-4390-97ae-11192c4c120c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:04:45.441258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67218097-7f0e-4d31-b608-513a083aa329 tempest-DeleteServersAdminTestJSON-1144414668 tempest-DeleteServersAdminTestJSON-1144414668-project-admin] Pushing event deleted for resources: {'Port': ['ID=57abba16-9897-4390-97ae-11192c4c120c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:45.448228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-0437c282-06bb-4394-9067-dc9857367250 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=38c07c88d2f84b29a9ae8c83558ec74b HTTP/1.1" status: 200 len: 379 time: 0.2341952 May 12 15:04:45.461341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Request body: {'port': {'device_id': '77e209aa-2dd3-4b44-bae4-1bb1f474d43a', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'admin_state_up': True, 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'security_groups': ['bea28a12-4648-49eb-967a-a6cae208864d']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:45.569522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Pushing event updated for resources: {'Port': ['ID=d7e09d66-2268-48c4-a658-ef10261e7a46,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:45.601087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Attempting to bind port d7e09d66-2268-48c4-a658-ef10261e7a46 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:45.601455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Attempting to bind port d7e09d66-2268-48c4-a658-ef10261e7a46 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:45.601770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Attempting to bind port d7e09d66-2268-48c4-a658-ef10261e7a46 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:45.607646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Port d7e09d66-2268-48c4-a658-ef10261e7a46 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:04:45.607983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Attempting to bind port d7e09d66-2268-48c4-a658-ef10261e7a46 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:45.613376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:45.614169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Checking segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:45.614555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Bound using segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:45.615101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Bound port: d7e09d66-2268-48c4-a658-ef10261e7a46, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:45.615406 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:45.659370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cf3701f-179e-4059-ae78-3293b5aece5a req-2b0ee155-cb83-4649-a87b-6d1d90cb328b tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3486521 May 12 15:04:45.664715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-c4d68ce6-897f-4b08-b5ab-e12f511b3014 req-67218097-7f0e-4d31-b608-513a083aa329 tempest-DeleteServersAdminTestJSON-1144414668 tempest-DeleteServersAdminTestJSON-1144414668-project-admin] No DVR routers for this DVR port 57abba16-9897-4390-97ae-11192c4c120c on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:04:45.668909 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c4d68ce6-897f-4b08-b5ab-e12f511b3014 req-67218097-7f0e-4d31-b608-513a083aa329 tempest-DeleteServersAdminTestJSON-1144414668 tempest-DeleteServersAdminTestJSON-1144414668-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:45.675346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '048a92c4-13d1-40e6-9714-2c96dd562708', 'name': 'network-vif-deleted', 'tag': '57abba16-9897-4390-97ae-11192c4c120c'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:45.688160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468a1f90-266d-4552-a360-b169f3a14fe2 req-f41cdd2b-5b46-4003-9e8b-734a1eeb7da9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:45.689646 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-468a1f90-266d-4552-a360-b169f3a14fe2 req-f41cdd2b-5b46-4003-9e8b-734a1eeb7da9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 932 time: 0.5240369 May 12 15:04:45.709152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:45.713198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d7e09d66-2268-48c4-a658-ef10261e7a46,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:45.718797 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:45.736270 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4d68ce6-897f-4b08-b5ab-e12f511b3014 req-67218097-7f0e-4d31-b608-513a083aa329 tempest-DeleteServersAdminTestJSON-1144414668 tempest-DeleteServersAdminTestJSON-1144414668-project-admin] 10.222.0.76 "DELETE /v2.0/ports/57abba16-9897-4390-97ae-11192c4c120c HTTP/1.1" status: 204 len: 173 time: 1.8700085 May 12 15:04:45.789744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:45.790426 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:45.791695 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] 10.222.0.84 "PUT /v2.0/ports/d7e09d66-2268-48c4-a658-ef10261e7a46 HTTP/1.1" status: 200 len: 1092 time: 1.2942808 May 12 15:04:45.792123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '65495c97-2a82-4737-a9aa-c3ca1d8ffc86', 'tag': 'd7e09d66-2268-48c4-a658-ef10261e7a46'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:45.816702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b169ac2-d4bb-458c-874c-10302fc60483 service neutron] Pushing event updated for resources: {'Port': ['ID=d7e09d66-2268-48c4-a658-ef10261e7a46,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:45.831481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-468a1f90-266d-4552-a360-b169f3a14fe2 req-afea4a77-1a75-4680-84dc-7b73e735b591 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1348944 May 12 15:04:45.848661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:45.862032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Usage tracker for resource:port and tenant:38c07c88d2f84b29a9ae8c83558ec74b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:45.865498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:45.873591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:45.897090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12508450-f029-4bc8-8107-f15905bb9c1d req-455f752a-b492-4e1d-a360-dcbbe6dbcfd4 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:45.899508 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12508450-f029-4bc8-8107-f15905bb9c1d req-455f752a-b492-4e1d-a360-dcbbe6dbcfd4 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 969 time: 0.1253102 May 12 15:04:45.900644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Made reservation on behalf of 38c07c88d2f84b29a9ae8c83558ec74b for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:45.903961 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:45.953421 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:45.981256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-a8b37e3f-f7d9-4d2f-a8ea-8f71fcec006b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:45.982966 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-a8b37e3f-f7d9-4d2f-a8ea-8f71fcec006b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 1095 time: 0.1073763 May 12 15:04:45.993364 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:46.019045 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-1b738136-8002-4871-a62b-d963640b2a63 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=b109b727195f4a0286ba8c6b6aa99144&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0525069 May 12 15:04:46.061190 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-b19c0eaf-703d-4d24-bd3e-ada39f15c8e7 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d7e09d66-2268-48c4-a658-ef10261e7a46 HTTP/1.1" status: 200 len: 217 time: 0.0611761 May 12 15:04:46.128303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-108edb4f-a723-4109-b8a1-55262330e720 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:46.129687 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-108edb4f-a723-4109-b8a1-55262330e720 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.0618243 May 12 15:04:46.141294 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12508450-f029-4bc8-8107-f15905bb9c1d req-69122eaa-373a-4506-9c1a-1d66cbc93b81 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/security-groups?id=523e81ba-8739-440a-b9d0-888a323ce6a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2150712 May 12 15:04:46.182025 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-16913665-1e56-470b-be76-b89df0250288 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0455818 May 12 15:04:46.271520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Allocated IP 172.20.0.9 (feb95830-c0c2-46c0-bb35-f2f43605e79a/c0ac6201-c8b1-43a9-a509-5a4ff4e34282/a29ae148-cc4f-4145-807c-c40065747ab9) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:46.287609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-fec8cbb4-e2c0-46ab-a34e-6fc7ff8ecf48 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:46.289669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-fec8cbb4-e2c0-46ab-a34e-6fc7ff8ecf48 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2513120 May 12 15:04:46.365054 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-ec6e835e-5d26-4c25-9705-2031283722ab service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1752958 May 12 15:04:46.409461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb572791-429f-4c16-9eea-117b88e288dc req-7777f99b-e330-472f-8f0b-c8ca53348e0a tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 210 time: 0.0812163 May 12 15:04:46.454190 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-87edcebd-92ba-46b4-aec6-eb027ffc279b tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/quotas/b109b727195f4a0286ba8c6b6aa99144 HTTP/1.1" status: 200 len: 375 time: 0.1215820 May 12 15:04:46.470374 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-590d3c02-285c-4d0f-93e3-a01fad65200d'] response: {'server_uuid': '048a92c4-13d1-40e6-9714-2c96dd562708', 'name': 'network-vif-deleted', 'tag': '57abba16-9897-4390-97ae-11192c4c120c', 'status': 'completed', 'code': 200} May 12 15:04:46.512867 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3658b20b-f9f3-4e6a-a6ab-e0fa9e678442'] response: {'name': 'network-changed', 'server_uuid': '65495c97-2a82-4737-a9aa-c3ca1d8ffc86', 'tag': 'd7e09d66-2268-48c4-a658-ef10261e7a46', 'status': 'completed', 'code': 200} May 12 15:04:46.516401 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a81bc656-4da3-4ff0-aa41-b36f6d7810a0 req-4d924ed8-3885-4f75-a50c-d044d42e89e4 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1451545 May 12 15:04:46.524871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-ddd1a669-ef32-4f49-acc5-1eaff4365d35 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=b109b727195f4a0286ba8c6b6aa99144&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0565879 May 12 15:04:46.595914 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:46.619534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Transition to ACTIVE for port object a29ae148-cc4f-4145-807c-c40065747ab9 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:46.662058 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:46.786482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b650a935-48da-4390-842f-48e10c9f8d93 req-88aa3a88-c88a-435e-aa98-563d872d9a1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:46.789180 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b650a935-48da-4390-842f-48e10c9f8d93 req-88aa3a88-c88a-435e-aa98-563d872d9a1b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 1095 time: 0.1564727 May 12 15:04:46.793147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Network feb95830-c0c2-46c0-bb35-f2f43605e79a is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:46.839039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:46.849062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:46.854684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:46.855292 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:46.906681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Pushing event updated for resources: {'Port': ['ID=a29ae148-cc4f-4145-807c-c40065747ab9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:46.952714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9d69ce99-97be-4527-8a99-b5b3ce684227 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4966736 May 12 15:04:46.968265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b650a935-48da-4390-842f-48e10c9f8d93 req-5165b698-a387-4921-8b24-8a2660c3e707 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:46.970021 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b650a935-48da-4390-842f-48e10c9f8d93 req-5165b698-a387-4921-8b24-8a2660c3e707 service neutron] 10.222.0.84 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.1741431 May 12 15:04:46.974866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Request body: {'port': {'device_id': '77e209aa-2dd3-4b44-bae4-1bb1f474d43a', 'device_owner': 'compute:tempest-test_az-52089536', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:47.062984 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b650a935-48da-4390-842f-48e10c9f8d93 req-feef6a7f-8d1f-4fbe-a99a-7d4c94a2f4f5 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d7e09d66-2268-48c4-a658-ef10261e7a46 HTTP/1.1" status: 200 len: 217 time: 0.0752232 May 12 15:04:47.127423 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a24fdce5-13d4-4a4d-a0ef-a8c9f02abb19 req-bbcedb47-1b16-4989-9f99-5dc2e318394e tempest-AggregatesAdminTestJSON-503168406 tempest-AggregatesAdminTestJSON-503168406-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:47.129518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a24fdce5-13d4-4a4d-a0ef-a8c9f02abb19 req-bbcedb47-1b16-4989-9f99-5dc2e318394e tempest-AggregatesAdminTestJSON-503168406 tempest-AggregatesAdminTestJSON-503168406-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 1120 time: 0.3387461 May 12 15:04:47.139133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66464a02-1876-4196-a565-69170f32ef09 req-662ed000-6120-4d7c-bf91-39573512974c tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:47.142626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b650a935-48da-4390-842f-48e10c9f8d93 req-6c41c197-2b18-431c-8337-aded31d7d0e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:47.144062 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b650a935-48da-4390-842f-48e10c9f8d93 req-6c41c197-2b18-431c-8337-aded31d7d0e1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.0720012 May 12 15:04:47.145883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66464a02-1876-4196-a565-69170f32ef09 req-662ed000-6120-4d7c-bf91-39573512974c tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 950 time: 0.3080382 May 12 15:04:47.199607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a3cf446f-04be-4e8a-9022-b5d81896863a None None] Provisioning for port a29ae148-cc4f-4145-807c-c40065747ab9 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:47.219961 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b650a935-48da-4390-842f-48e10c9f8d93 req-d9f72971-b69f-4945-8740-5f925eef548d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0651414 May 12 15:04:47.220381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a3cf446f-04be-4e8a-9022-b5d81896863a None None] Provisioning complete for port a29ae148-cc4f-4145-807c-c40065747ab9 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:47.220757 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a3cf446f-04be-4e8a-9022-b5d81896863a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:47.222400 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a24fdce5-13d4-4a4d-a0ef-a8c9f02abb19 req-41d6fb59-92f9-41af-aac4-1ac220f58d56 tempest-AggregatesAdminTestJSON-503168406 tempest-AggregatesAdminTestJSON-503168406-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:47.274205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-a24fdce5-13d4-4a4d-a0ef-a8c9f02abb19 req-41d6fb59-92f9-41af-aac4-1ac220f58d56 tempest-AggregatesAdminTestJSON-503168406 tempest-AggregatesAdminTestJSON-503168406-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:47.289337 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66464a02-1876-4196-a565-69170f32ef09 req-fe24b109-6089-4d65-9df2-ec82e8dfa835 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1422727 May 12 15:04:47.301478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a24fdce5-13d4-4a4d-a0ef-a8c9f02abb19 req-41d6fb59-92f9-41af-aac4-1ac220f58d56 tempest-AggregatesAdminTestJSON-503168406 tempest-AggregatesAdminTestJSON-503168406-project-admin] Usage tracker for resource:security_group_rule and tenant:190d5d4723dd4d19a377b75ca759e170 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:47.311699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a24fdce5-13d4-4a4d-a0ef-a8c9f02abb19 req-41d6fb59-92f9-41af-aac4-1ac220f58d56 tempest-AggregatesAdminTestJSON-503168406 tempest-AggregatesAdminTestJSON-503168406-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:47.330406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-a24fdce5-13d4-4a4d-a0ef-a8c9f02abb19 req-41d6fb59-92f9-41af-aac4-1ac220f58d56 tempest-AggregatesAdminTestJSON-503168406 tempest-AggregatesAdminTestJSON-503168406-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:47.331887 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:47.346788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a3cf446f-04be-4e8a-9022-b5d81896863a None None] Port a29ae148-cc4f-4145-807c-c40065747ab9 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:04:47.450392 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b650a935-48da-4390-842f-48e10c9f8d93 req-477c520e-2e12-44df-97d5-92a57db10ae9 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2174203 May 12 15:04:47.485252 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:47.499991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-4e45a7c0-d37a-420a-9fcd-7fc1c3cd8038 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=b109b727195f4a0286ba8c6b6aa99144&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0548291 May 12 15:04:47.598672 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b650a935-48da-4390-842f-48e10c9f8d93 req-20cb3a63-a2a8-410d-94cd-4420f14adf64 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1415520 May 12 15:04:47.832592 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a24fdce5-13d4-4a4d-a0ef-a8c9f02abb19 req-41d6fb59-92f9-41af-aac4-1ac220f58d56 tempest-AggregatesAdminTestJSON-503168406 tempest-AggregatesAdminTestJSON-503168406-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:47.846554 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a24fdce5-13d4-4a4d-a0ef-a8c9f02abb19 req-41d6fb59-92f9-41af-aac4-1ac220f58d56 tempest-AggregatesAdminTestJSON-503168406 tempest-AggregatesAdminTestJSON-503168406-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:47.877254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-af2dc3d6-0a42-452b-88bc-95459d1ba6b1 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:47.878704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-af2dc3d6-0a42-452b-88bc-95459d1ba6b1 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3688440 May 12 15:04:47.899576 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a24fdce5-13d4-4a4d-a0ef-a8c9f02abb19 req-41d6fb59-92f9-41af-aac4-1ac220f58d56 tempest-AggregatesAdminTestJSON-503168406 tempest-AggregatesAdminTestJSON-503168406-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=523e81ba-8739-440a-b9d0-888a323ce6a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7476895 May 12 15:04:47.936000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d6fb59-92f9-41af-aac4-1ac220f58d56 tempest-AggregatesAdminTestJSON-503168406 tempest-AggregatesAdminTestJSON-503168406-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b4f8dfd-dc15-4b3b-b343-a640e4188330,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:47.941729 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-d9c64d74-c6f2-4989-8b6e-7e6a9bdc3391 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/quotas/b109b727195f4a0286ba8c6b6aa99144 HTTP/1.1" status: 200 len: 375 time: 0.0492690 May 12 15:04:48.014587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-e7b18be7-dc66-4ba5-a21d-3823b8dc49d8 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=b109b727195f4a0286ba8c6b6aa99144&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0716300 May 12 15:04:48.023966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-51749ce4-54ec-4047-9133-089d0f1b7cf5 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=b109b727195f4a0286ba8c6b6aa99144&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0573666 May 12 15:04:48.126467 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8cbbaae-36d9-484b-8e8e-c173e3acf719 req-d065e21d-b409-4c4f-971c-656eeac63c1a service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0837545 May 12 15:04:48.141403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-b0ad514d-d606-4d0d-ae78-faf58d0aa0ee tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=9e8c135aef5e45fbb72a8db523f01319&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0906069 May 12 15:04:48.151537 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:04:48.409882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a29ae148-cc4f-4145-807c-c40065747ab9 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:48.441437 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:48.455582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8cbbaae-36d9-484b-8e8e-c173e3acf719 req-6a3a9df8-8f78-438d-9994-fd745661cca9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:48.457033 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8cbbaae-36d9-484b-8e8e-c173e3acf719 req-6a3a9df8-8f78-438d-9994-fd745661cca9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=146fd417ad5d4f85ae5ce85d279642a7&device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 1101 time: 0.1547451 May 12 15:04:48.461571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-b8922df4-e122-4429-aeff-d9973bf435df tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:48.463000 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-b8922df4-e122-4429-aeff-d9973bf435df tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4421322 May 12 15:04:48.484868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Request body: {'port': {'device_id': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': 'b109b727195f4a0286ba8c6b6aa99144'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:48.523684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Transition to ACTIVE for port object a29ae148-cc4f-4145-807c-c40065747ab9 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:48.594736 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:48.609571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-2100793f-daff-4d9f-90e0-bee893c4cd6b tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:48.610998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-2100793f-daff-4d9f-90e0-bee893c4cd6b tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4518027 May 12 15:04:48.642309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8cbbaae-36d9-484b-8e8e-c173e3acf719 req-71c14192-4fef-445a-b6b3-229d65d4a9fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:48.643724 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8cbbaae-36d9-484b-8e8e-c173e3acf719 req-71c14192-4fef-445a-b6b3-229d65d4a9fa service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.1579425 May 12 15:04:48.724920 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8cbbaae-36d9-484b-8e8e-c173e3acf719 req-79aba6e9-e380-44b7-9488-e681e54184d1 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.228&port_id=2630733c-d113-4a35-86d3-c09219afe149 HTTP/1.1" status: 200 len: 217 time: 0.0713172 May 12 15:04:48.751292 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-ed051f81-16ce-42e2-a90c-ef9215f3b83b tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/quotas/9e8c135aef5e45fbb72a8db523f01319 HTTP/1.1" status: 200 len: 375 time: 0.1011317 May 12 15:04:48.803449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8cbbaae-36d9-484b-8e8e-c173e3acf719 req-ae5e860c-095a-4a29-b07f-9c3a846791e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:48.805499 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8cbbaae-36d9-484b-8e8e-c173e3acf719 req-ae5e860c-095a-4a29-b07f-9c3a846791e6 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0748219 May 12 15:04:48.831018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1743d4c5-8336-4a2e-957d-27c6c9d9ac60 req-24d8d9f9-d5ff-42b3-97af-79d6c670d499 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:48.832509 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1743d4c5-8336-4a2e-957d-27c6c9d9ac60 req-24d8d9f9-d5ff-42b3-97af-79d6c670d499 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 944 time: 0.5359797 May 12 15:04:48.842427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Pushing event updated for resources: {'Port': ['ID=a29ae148-cc4f-4145-807c-c40065747ab9,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:48.898191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-b8e33dbf-7cb4-495a-aa6c-123d3d04d04a tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Synchronizing usage tracker for tenant:9e8c135aef5e45fbb72a8db523f01319 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:04:48.909210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8cbbaae-36d9-484b-8e8e-c173e3acf719 req-01b70271-00d8-488d-965f-6962f4be41fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:48.911029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8cbbaae-36d9-484b-8e8e-c173e3acf719 req-01b70271-00d8-488d-965f-6962f4be41fe service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.0926783 May 12 15:04:49.001557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 57abba16-9897-4390-97ae-11192c4c120c no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:04:49.035486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:49.047450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Attempting to bind port a29ae148-cc4f-4145-807c-c40065747ab9 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:49.047788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Attempting to bind port a29ae148-cc4f-4145-807c-c40065747ab9 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:49.048103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Attempting to bind port a29ae148-cc4f-4145-807c-c40065747ab9 on network feb95830-c0c2-46c0-bb35-f2f43605e79a {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:49.052371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Usage tracker for resource:port and tenant:b109b727195f4a0286ba8c6b6aa99144 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:49.053083 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8cbbaae-36d9-484b-8e8e-c173e3acf719 req-31ac0d75-3a94-4673-a8af-468bc99fe614 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1351843 May 12 15:04:49.058846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:49.067829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Port a29ae148-cc4f-4145-807c-c40065747ab9 on network feb95830-c0c2-46c0-bb35-f2f43605e79a not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:04:49.068151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Attempting to bind port a29ae148-cc4f-4145-807c-c40065747ab9 on network feb95830-c0c2-46c0-bb35-f2f43605e79a {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:49.070443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:49.070768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 57abba16-9897-4390-97ae-11192c4c120c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:04:49.071110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 57abba16-9897-4390-97ae-11192c4c120c not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:04:49.075632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-b8e33dbf-7cb4-495a-aa6c-123d3d04d04a tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Unset dirty status for tenant:9e8c135aef5e45fbb72a8db523f01319 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:04:49.077220 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-b8e33dbf-7cb4-495a-aa6c-123d3d04d04a tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=9e8c135aef5e45fbb72a8db523f01319&fields=id HTTP/1.1" status: 200 len: 210 time: 0.2982352 May 12 15:04:49.083978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:49.084471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Checking segment: {'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:49.084947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Bound using segment: {'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:49.085617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Bound port: a29ae148-cc4f-4145-807c-c40065747ab9, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:49.085878 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:49.097012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1743d4c5-8336-4a2e-957d-27c6c9d9ac60 req-71eafa23-ce5f-419e-a972-4344647a3993 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2362821 May 12 15:04:49.139591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Made reservation on behalf of b109b727195f4a0286ba8c6b6aa99144 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:49.143032 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:49.168220 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:49.190477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:49.204847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Usage tracker for resource:security_group_rule and tenant:b109b727195f4a0286ba8c6b6aa99144 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:49.205903 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8cbbaae-36d9-484b-8e8e-c173e3acf719 req-d494868e-bf6c-42d3-9a72-bd8e7c16f9d4 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1457295 May 12 15:04:49.212363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:49.234649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:49.295278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] For port a29ae148-cc4f-4145-807c-c40065747ab9, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:49.317723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] For port a29ae148-cc4f-4145-807c-c40065747ab9, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a29ae148-cc4f-4145-807c-c40065747ab9,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:49.335830 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:49.418051 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device d7e09d66-2268-48c4-a658-ef10261e7a46 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:04:49.433491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:49.434128 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:49.435525 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] 10.222.0.76 "PUT /v2.0/ports/a29ae148-cc4f-4145-807c-c40065747ab9 HTTP/1.1" status: 200 len: 1111 time: 2.4727888 May 12 15:04:49.438261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '77e209aa-2dd3-4b44-bae4-1bb1f474d43a', 'tag': 'a29ae148-cc4f-4145-807c-c40065747ab9'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:49.493260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d42a7332-5f9c-4ce4-920d-403cc86e3b35 service neutron] Pushing event updated for resources: {'Port': ['ID=a29ae148-cc4f-4145-807c-c40065747ab9,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:49.514678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e42a1911-dcc9-4690-a1cd-fc56e48376be req-de2740f2-9fc9-4050-8af1-496b9511cfd0 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:49.515393 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-e42a1911-dcc9-4690-a1cd-fc56e48376be req-de2740f2-9fc9-4050-8af1-496b9511cfd0 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Synchronizing usage tracker for tenant:38c07c88d2f84b29a9ae8c83558ec74b on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:04:49.548709 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:49.565971 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-381e3503-f19b-4d4c-93f9-5cdcda5e949f tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=b109b727195f4a0286ba8c6b6aa99144&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0749185 May 12 15:04:49.674322 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:49.853913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d7e09d66-2268-48c4-a658-ef10261e7a46,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:49.868932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-f63c7e28-9995-4bc9-89a1-6503181733eb tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:49.870857 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-f63c7e28-9995-4bc9-89a1-6503181733eb tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2982621 May 12 15:04:49.888639 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-e42a1911-dcc9-4690-a1cd-fc56e48376be req-de2740f2-9fc9-4050-8af1-496b9511cfd0 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Unset dirty status for tenant:38c07c88d2f84b29a9ae8c83558ec74b on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:04:49.890063 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e42a1911-dcc9-4690-a1cd-fc56e48376be req-de2740f2-9fc9-4050-8af1-496b9511cfd0 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 963 time: 0.6473520 May 12 15:04:49.904614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'd7e09d66-2268-48c4-a658-ef10261e7a46', 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3', 'port_id': 'd7e09d66-2268-48c4-a658-ef10261e7a46', 'mac_address': 'fa:16:3e:99:15:a4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 567, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bc8f64ab-e415-4d25-919a-8e712e76a5f6', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:04:49.927842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Request body: {'port': {'device_id': 'dfc4bc02-d56b-4ef8-8c50-af64aeb1795c', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': 'b109b727195f4a0286ba8c6b6aa99144'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:49.952296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa013569-80f0-4348-bcfa-1fa03d9966f2 req-f569a900-45c5-4d9b-86cb-a51545685029 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 210 time: 0.2647269 May 12 15:04:49.979020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Pushing event updated for resources: {'SecurityGroup': ['ID=98c78171-ded7-4a0c-a647-1cd4c9ff1df4,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:50.021844 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:50.059835 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d7e09d66-2268-48c4-a658-ef10261e7a46 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:50.086478 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d7e09d66-2268-48c4-a658-ef10261e7a46,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:50.092378 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:50.109255 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e42a1911-dcc9-4690-a1cd-fc56e48376be req-346e38a8-640e-4456-9a5f-f53f8c165839 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1922185 May 12 15:04:50.129834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:50.135621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Usage tracker for resource:port and tenant:b109b727195f4a0286ba8c6b6aa99144 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:50.138831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:50.146368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:50.159507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Made reservation on behalf of b109b727195f4a0286ba8c6b6aa99144 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:50.165059 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:50.181299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=d7e09d66-2268-48c4-a658-ef10261e7a46,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:50.184130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-a25baaee-0ced-4f71-a5d6-dff0d6faac48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:50.185596 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-a25baaee-0ced-4f71-a5d6-dff0d6faac48 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=38c07c88d2f84b29a9ae8c83558ec74b&device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 1114 time: 0.6322911 May 12 15:04:50.282686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Allocated IP 192.168.233.202 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/1eade7b6-fd9d-4292-b6d7-67f0ba8285d1) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:50.285661 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-d5890566-bcbd-4eda-8173-cde32f7316cb service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a29ae148-cc4f-4145-807c-c40065747ab9 HTTP/1.1" status: 200 len: 217 time: 0.0847487 May 12 15:04:50.401094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['d7e09d66-2268-48c4-a658-ef10261e7a46'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:04:50.437329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2ba35506-18a9-454f-84c6-3d8771f886d5 req-882bacc5-a77f-4228-9fab-7a33a1aa31e8 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 210 time: 0.0859885 May 12 15:04:50.453302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-428e700e-a185-458e-a260-eb4238411145 req-3669dae7-7db8-4a03-998a-17eb9ff397f8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:50.454768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-428e700e-a185-458e-a260-eb4238411145 req-3669dae7-7db8-4a03-998a-17eb9ff397f8 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 950 time: 0.3404953 May 12 15:04:50.467124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9051d118-3d01-43f8-aee5-1a014be28b4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:50.468517 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-9051d118-3d01-43f8-aee5-1a014be28b4f service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c0ac6201-c8b1-43a9-a509-5a4ff4e34282 HTTP/1.1" status: 200 len: 863 time: 0.1761129 May 12 15:04:50.539628 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-697df3fa-4682-4976-849f-97fb71300826'] response: {'name': 'network-changed', 'server_uuid': '77e209aa-2dd3-4b44-bae4-1bb1f474d43a', 'tag': 'a29ae148-cc4f-4145-807c-c40065747ab9', 'status': 'completed', 'code': 200} May 12 15:04:50.704704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-428e700e-a185-458e-a260-eb4238411145 req-4c40cc7a-ea45-4dc2-a961-88dca0881408 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2394373 May 12 15:04:50.729487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.76', 61676) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:50.788298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-3b6d1346-442c-4fcc-8c39-00fb0f566825 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=9e8c135aef5e45fbb72a8db523f01319&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0519059 May 12 15:04:50.900220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.76', 61677) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:04:50.943900 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:50.955048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-ca648bd3-695b-48ff-9be8-1a227cdd5633 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:50.956495 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-ca648bd3-695b-48ff-9be8-1a227cdd5633 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=feb95830-c0c2-46c0-bb35-f2f43605e79a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4544239 May 12 15:04:50.986944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-642a6cbd-42b4-494c-95ae-d0e6d1aa588b req-909cfb34-b9bd-4fec-b25e-b7f5a70ca97c tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:50.988352 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-642a6cbd-42b4-494c-95ae-d0e6d1aa588b req-909cfb34-b9bd-4fec-b25e-b7f5a70ca97c tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.76 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 969 time: 0.0849240 May 12 15:04:51.026611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-520c6cda-f914-49b4-869d-9d1e21d657f6 req-f78d4276-1e11-4bc1-ad89-1a98baeb2579 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:51.028361 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-520c6cda-f914-49b4-869d-9d1e21d657f6 req-f78d4276-1e11-4bc1-ad89-1a98baeb2579 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 969 time: 0.4324694 May 12 15:04:51.060532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-642a6cbd-42b4-494c-95ae-d0e6d1aa588b req-0d839c0c-da64-4066-97b1-b14ea93c0444 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Deleting port 343f050d-81d2-410f-a8ab-b2bdef562d11 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:04:51.060879 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-642a6cbd-42b4-494c-95ae-d0e6d1aa588b req-0d839c0c-da64-4066-97b1-b14ea93c0444 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:51.081168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Transition to ACTIVE for port object 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:51.260130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-24903f6b-042e-4211-aefa-85f7b67b920b tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:51.261580 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-24903f6b-042e-4211-aefa-85f7b67b920b tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4652839 May 12 15:04:51.283573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-520c6cda-f914-49b4-869d-9d1e21d657f6 req-5a58b0f7-54e7-423c-bc1f-66601c9f0b43 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/security-groups?id=523e81ba-8739-440a-b9d0-888a323ce6a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2492681 May 12 15:04:51.294517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Request body: {'port': {'device_id': '98f7c3c2-103b-4195-94da-8e6d9b108c1c', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '9e8c135aef5e45fbb72a8db523f01319'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:51.327165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-642a6cbd-42b4-494c-95ae-d0e6d1aa588b req-0d839c0c-da64-4066-97b1-b14ea93c0444 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] For port 343f050d-81d2-410f-a8ab-b2bdef562d11, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=343f050d-81d2-410f-a8ab-b2bdef562d11,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:51.327539 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-642a6cbd-42b4-494c-95ae-d0e6d1aa588b req-0d839c0c-da64-4066-97b1-b14ea93c0444 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:51.416186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device d7e09d66-2268-48c4-a658-ef10261e7a46 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:51.416940 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-6eb2cc11-992c-4375-bb06-346391b6bb27 service neutron] 10.222.0.76 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4394925 May 12 15:04:51.425045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e73bbd9-ee2b-440e-b4af-d1599964a5d5 req-6aa78dd8-72cf-4810-a025-0cab46acb7b5 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:51.433027 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e73bbd9-ee2b-440e-b4af-d1599964a5d5 req-6aa78dd8-72cf-4810-a025-0cab46acb7b5 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 945 time: 0.5883811 May 12 15:04:51.459344 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:51.496560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port d7e09d66-2268-48c4-a658-ef10261e7a46 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:51.502366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port d7e09d66-2268-48c4-a658-ef10261e7a46 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:51.503308 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:51.619683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Allocated IP 192.168.233.124 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/a49de190-3075-4dff-a67a-fd9f694116cb) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:51.653754 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:51.673859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:51.689493 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e73bbd9-ee2b-440e-b4af-d1599964a5d5 req-f630e726-d54c-46a3-ac93-db89f4bf4354 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2554865 May 12 15:04:51.695016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '65495c97-2a82-4737-a9aa-c3ca1d8ffc86', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd7e09d66-2268-48c4-a658-ef10261e7a46'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:51.697090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-642a6cbd-42b4-494c-95ae-d0e6d1aa588b req-0d839c0c-da64-4066-97b1-b14ea93c0444 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Calling delete_port for 343f050d-81d2-410f-a8ab-b2bdef562d11 owned by compute:tempest-test_az-52089536 {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:04:51.714682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:51.716489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Pushing event updated for resources: {'Port': ['ID=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:51.720206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d7e09d66-2268-48c4-a658-ef10261e7a46,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:51.727490 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:51.732475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:51.750685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:51.751533 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:51.828814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=d7e09d66-2268-48c4-a658-ef10261e7a46,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:51.839693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:51.846105 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdc933cd-de81-411f-8f4f-1376d2ab385e req-fb6352ba-aec5-4336-b075-7e6d901601a5 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 210 time: 0.0903580 May 12 15:04:51.912081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:51.934943 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74947163-88ec-4b90-bd96-b1aa58743a4b req-b353037a-fc08-44cb-90d0-016efc634ceb service neutron] 10.222.0.76 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4998055 May 12 15:04:51.941280 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c7a5cde0-a3dd-410e-ac98-a1b6b3945e59 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 3.4610071 May 12 15:04:51.957018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Request body: {'port': {'device_id': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'device_owner': 'compute:tempest-test_az-52089536', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:51.996361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Made reservation on behalf of 9e8c135aef5e45fbb72a8db523f01319 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:52.000112 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:52.057048 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:52.062002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-217cac9e-9e5d-48f5-b3af-56c7061b8937 None None] Provisioning for port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:52.069538 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-217cac9e-9e5d-48f5-b3af-56c7061b8937 None None] Provisioning complete for port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:52.070687 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-217cac9e-9e5d-48f5-b3af-56c7061b8937 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:52.081888 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Transition to ACTIVE for port object a49de190-3075-4dff-a67a-fd9f694116cb will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:52.085550 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-642a6cbd-42b4-494c-95ae-d0e6d1aa588b req-0d839c0c-da64-4066-97b1-b14ea93c0444 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:52.110617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['343f050d-81d2-410f-a8ab-b2bdef562d11'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:04:52.125477 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aef52bdb-8880-4485-ba55-f9cc4091769e req-e6dddc7c-6cc1-49e1-9b37-631ae6412464 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 210 time: 0.1148221 May 12 15:04:52.149767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d839c0c-da64-4066-97b1-b14ea93c0444 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Pushing event deleted for resources: {'Port': ['ID=343f050d-81d2-410f-a8ab-b2bdef562d11,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:52.185248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-217cac9e-9e5d-48f5-b3af-56c7061b8937 None None] Port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:04:52.222772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-642a6cbd-42b4-494c-95ae-d0e6d1aa588b req-0d839c0c-da64-4066-97b1-b14ea93c0444 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] No DVR routers for this DVR port 343f050d-81d2-410f-a8ab-b2bdef562d11 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:04:52.227702 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-642a6cbd-42b4-494c-95ae-d0e6d1aa588b req-0d839c0c-da64-4066-97b1-b14ea93c0444 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:52.230407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5cd1d64a-2898-4f90-beb1-fad4769e0b7c', 'name': 'network-vif-deleted', 'tag': '343f050d-81d2-410f-a8ab-b2bdef562d11'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:52.248971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:52.320856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:52.330365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:52.334121 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-642a6cbd-42b4-494c-95ae-d0e6d1aa588b req-0d839c0c-da64-4066-97b1-b14ea93c0444 tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.76 "DELETE /v2.0/ports/343f050d-81d2-410f-a8ab-b2bdef562d11 HTTP/1.1" status: 204 len: 173 time: 1.3396468 May 12 15:04:52.337017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:52.343614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:52.343880 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:52.399908 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.4757915 May 12 15:04:52.400635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46e99cc9-bd44-4686-bcca-7f0ec71a3f3c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Pushing event updated for resources: {'Port': ['ID=a49de190-3075-4dff-a67a-fd9f694116cb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:52.420439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Request body: {'port': {'device_id': 'dfc4bc02-d56b-4ef8-8c50-af64aeb1795c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:52.421269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0751f8d4-d52c-4607-ab9c-6aa24e67b838 req-d945b31e-fe74-4e06-b13b-abb77ded527f tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:52.425848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0751f8d4-d52c-4607-ab9c-6aa24e67b838 req-d945b31e-fe74-4e06-b13b-abb77ded527f tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 963 time: 0.5679128 May 12 15:04:52.433482 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:52.552852 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:52.596552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860a28fd-925e-4fc7-a064-a5301cd489eb req-db9637b5-5f99-49d3-a44c-cfb6d297a790 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:52.597943 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-860a28fd-925e-4fc7-a064-a5301cd489eb req-db9637b5-5f99-49d3-a44c-cfb6d297a790 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=38c07c88d2f84b29a9ae8c83558ec74b&device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 1114 time: 0.5819581 May 12 15:04:52.613495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-894c96c9-15ff-4172-9625-a56a219bcc01 None None] Provisioning for port a49de190-3075-4dff-a67a-fd9f694116cb completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:52.622240 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-894c96c9-15ff-4172-9625-a56a219bcc01 None None] Provisioning complete for port a49de190-3075-4dff-a67a-fd9f694116cb triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:52.622817 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-894c96c9-15ff-4172-9625-a56a219bcc01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:52.689203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-894c96c9-15ff-4172-9625-a56a219bcc01 None None] Port a49de190-3075-4dff-a67a-fd9f694116cb cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:04:52.734493 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0751f8d4-d52c-4607-ab9c-6aa24e67b838 req-223610e2-debe-4ade-9b45-f9958956ac33 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2851388 May 12 15:04:52.752892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Allocated IP 192.168.233.38 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/c794c37e-a152-4438-9c99-8bdaeaf7525f) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:52.798032 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0342c33b-8e05-4252-aa8d-a5b1bbfe2c90'] response: {'server_uuid': '65495c97-2a82-4737-a9aa-c3ca1d8ffc86', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd7e09d66-2268-48c4-a658-ef10261e7a46', 'code': 200} May 12 15:04:52.851435 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f4a9a782-e2cf-461d-91ed-167ea4db4102'] response: {'server_uuid': '5cd1d64a-2898-4f90-beb1-fad4769e0b7c', 'name': 'network-vif-deleted', 'tag': '343f050d-81d2-410f-a8ab-b2bdef562d11', 'status': 'completed', 'code': 200} May 12 15:04:52.854313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2721af8a-fff1-497e-9dfe-69b75bd42336 req-16bf2811-0e8a-40a1-a8f5-75942400c44b tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:52.861097 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2721af8a-fff1-497e-9dfe-69b75bd42336 req-16bf2811-0e8a-40a1-a8f5-75942400c44b tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 950 time: 0.5447791 May 12 15:04:53.043889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860a28fd-925e-4fc7-a064-a5301cd489eb req-7d662984-c20c-4ce1-9a89-061e2eca5e0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:53.045296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-860a28fd-925e-4fc7-a064-a5301cd489eb req-7d662984-c20c-4ce1-9a89-061e2eca5e0f service neutron] 10.222.0.76 "GET /v2.0/networks?id=feb95830-c0c2-46c0-bb35-f2f43605e79a HTTP/1.1" status: 200 len: 925 time: 0.4191530 May 12 15:04:53.067946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2721af8a-fff1-497e-9dfe-69b75bd42336 req-032f3978-5a85-44a7-8b3d-daa84a30033d tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2060306 May 12 15:04:53.218396 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6490fa35-4da2-490d-a9e7-5c16b9bec67e req-89657148-c49e-4e49-907a-4bfe85cecc9f tempest-AggregatesAdminTestJSON-191230541 tempest-AggregatesAdminTestJSON-191230541-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cd1d64a-2898-4f90-beb1-fad4769e0b7c HTTP/1.1" status: 200 len: 210 time: 0.2282832 May 12 15:04:53.296321 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-860a28fd-925e-4fc7-a064-a5301cd489eb req-11ac9d88-0564-467f-bf04-26c4408d893b service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a29ae148-cc4f-4145-807c-c40065747ab9 HTTP/1.1" status: 200 len: 217 time: 0.2313900 May 12 15:04:53.534661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860a28fd-925e-4fc7-a064-a5301cd489eb req-272c3697-a8ea-4466-a63e-c451e2674f44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:53.536077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-860a28fd-925e-4fc7-a064-a5301cd489eb req-272c3697-a8ea-4466-a63e-c451e2674f44 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c0ac6201-c8b1-43a9-a509-5a4ff4e34282 HTTP/1.1" status: 200 len: 863 time: 0.2301538 May 12 15:04:53.545797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b948a8ab-e4e2-4ebc-a182-35bf2aacab36 req-1e732d02-5413-4802-bf98-7d4db05aa5e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:53.547438 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b948a8ab-e4e2-4ebc-a182-35bf2aacab36 req-1e732d02-5413-4802-bf98-7d4db05aa5e9 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 1097 time: 0.6007457 May 12 15:04:53.649458 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:53.676505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02be31ef-0aaa-4d56-91e4-936b79753d33 req-3e8741b4-68e2-49c2-8a71-ec1661c624f3 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:53.677962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02be31ef-0aaa-4d56-91e4-936b79753d33 req-3e8741b4-68e2-49c2-8a71-ec1661c624f3 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 946 time: 0.4432907 May 12 15:04:53.715298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b948a8ab-e4e2-4ebc-a182-35bf2aacab36 req-75eb08c8-436c-4bf3-82ac-50e8a0a65d80 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1538217 May 12 15:04:53.717684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Transition to ACTIVE for port object c794c37e-a152-4438-9c99-8bdaeaf7525f will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:53.742796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b6d0754-09b6-4c0a-b19e-c42d2819f331 req-e63f259d-6434-47ea-94e1-fd09e3a4659e tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:53.743457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3b6d0754-09b6-4c0a-b19e-c42d2819f331 req-e63f259d-6434-47ea-94e1-fd09e3a4659e tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Synchronizing usage tracker for tenant:b109b727195f4a0286ba8c6b6aa99144 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:04:53.779844 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02be31ef-0aaa-4d56-91e4-936b79753d33 req-3adef573-01fe-4706-80bb-748c0cba80ed tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0921383 May 12 15:04:53.790976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860a28fd-925e-4fc7-a064-a5301cd489eb req-0b1f5ab0-ba27-4768-aa9e-ebc7d3d28d54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:53.792801 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-860a28fd-925e-4fc7-a064-a5301cd489eb req-0b1f5ab0-ba27-4768-aa9e-ebc7d3d28d54 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=feb95830-c0c2-46c0-bb35-f2f43605e79a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2358365 May 12 15:04:53.794746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3b6d0754-09b6-4c0a-b19e-c42d2819f331 req-e63f259d-6434-47ea-94e1-fd09e3a4659e tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Unset dirty status for tenant:b109b727195f4a0286ba8c6b6aa99144 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:04:53.795763 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b6d0754-09b6-4c0a-b19e-c42d2819f331 req-e63f259d-6434-47ea-94e1-fd09e3a4659e tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 936 time: 0.4146559 May 12 15:04:53.952475 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d8c6e20-7391-472c-b6a1-b89c964712f8 req-9b7cbef9-f900-4355-bec2-47d7547d24cf tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 210 time: 0.0669179 May 12 15:04:53.962110 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:54.044378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3b6d0754-09b6-4c0a-b19e-c42d2819f331 req-638b64db-afa5-4806-b900-20f7e3a9a14a tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Synchronizing usage tracker for tenant:b109b727195f4a0286ba8c6b6aa99144 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:04:54.081848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:54.110625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:54.113019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:54.119575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:54.120200 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:54.124203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Pushing event updated for resources: {'Port': ['ID=c794c37e-a152-4438-9c99-8bdaeaf7525f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:54.151582 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-f7b25811-d655-4997-bb06-2241e0e39b0b tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=146fd417ad5d4f85ae5ce85d279642a7&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0813382 May 12 15:04:54.166585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a49de190-3075-4dff-a67a-fd9f694116cb {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:54.174940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:54.188179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-860a28fd-925e-4fc7-a064-a5301cd489eb req-0b8dec23-0e7a-429a-8e9e-744601d5f92a service neutron] 10.222.0.76 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3888211 May 12 15:04:54.192593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Transition to ACTIVE for port object a49de190-3075-4dff-a67a-fd9f694116cb will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:54.195360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3b6d0754-09b6-4c0a-b19e-c42d2819f331 req-638b64db-afa5-4806-b900-20f7e3a9a14a tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Unset dirty status for tenant:b109b727195f4a0286ba8c6b6aa99144 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:04:54.197713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:54.204236 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b6d0754-09b6-4c0a-b19e-c42d2819f331 req-638b64db-afa5-4806-b900-20f7e3a9a14a tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3793602 May 12 15:04:54.285957 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Pushing event updated for resources: {'Port': ['ID=a49de190-3075-4dff-a67a-fd9f694116cb,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:54.414916 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-49385505-4ac8-4596-a3bd-0c1fa3c6e24f tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 3.1303298 May 12 15:04:54.431553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5e514697-6a5d-4f6c-8e29-68acfec2ee6c None None] Provisioning for port c794c37e-a152-4438-9c99-8bdaeaf7525f completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:54.436824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5e514697-6a5d-4f6c-8e29-68acfec2ee6c None None] Provisioning complete for port c794c37e-a152-4438-9c99-8bdaeaf7525f triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:54.437296 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5e514697-6a5d-4f6c-8e29-68acfec2ee6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:54.441448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Attempting to bind port a49de190-3075-4dff-a67a-fd9f694116cb on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:54.441772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Attempting to bind port a49de190-3075-4dff-a67a-fd9f694116cb by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:54.442087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Attempting to bind port a49de190-3075-4dff-a67a-fd9f694116cb on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:54.449370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Port a49de190-3075-4dff-a67a-fd9f694116cb on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:04:54.449869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Attempting to bind port a49de190-3075-4dff-a67a-fd9f694116cb on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:54.455546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:54.455875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:54.456250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:54.456671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Bound port: a49de190-3075-4dff-a67a-fd9f694116cb, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:54.457006 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:54.511756 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5e514697-6a5d-4f6c-8e29-68acfec2ee6c None None] Port c794c37e-a152-4438-9c99-8bdaeaf7525f cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:04:54.541725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Request body: {'port': {'device_id': '98f7c3c2-103b-4195-94da-8e6d9b108c1c', 'device_owner': 'compute:tempest-test_az-52089536', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:54.551953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] For port a49de190-3075-4dff-a67a-fd9f694116cb, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:54.555341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] For port a49de190-3075-4dff-a67a-fd9f694116cb, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a49de190-3075-4dff-a67a-fd9f694116cb,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:54.560588 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:54.700861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:54.701421 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:54.702774 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] 10.222.0.84 "PUT /v2.0/ports/a49de190-3075-4dff-a67a-fd9f694116cb HTTP/1.1" status: 200 len: 1096 time: 2.2881045 May 12 15:04:54.721638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b11f58-a0bb-4118-9471-70dee1b76c58 service neutron] Pushing event updated for resources: {'Port': ['ID=a49de190-3075-4dff-a67a-fd9f694116cb,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:54.774595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-433c0580-20a4-4a1b-9c9c-fb29da123e4b tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:54.777847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-433c0580-20a4-4a1b-9c9c-fb29da123e4b tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.6181662 May 12 15:04:54.855898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dfc4bc02-d56b-4ef8-8c50-af64aeb1795c', 'tag': 'a49de190-3075-4dff-a67a-fd9f694116cb'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:54.894187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-64fe6959-fa01-4f34-a6fa-59c7c6a0f7be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:54.896276 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-64fe6959-fa01-4f34-a6fa-59c7c6a0f7be service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b109b727195f4a0286ba8c6b6aa99144&device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 1099 time: 0.1197932 May 12 15:04:54.976446 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-f55c3951-1456-4bfe-a07d-454b265892f0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.124&port_id=a49de190-3075-4dff-a67a-fd9f694116cb HTTP/1.1" status: 200 len: 217 time: 0.0661998 May 12 15:04:54.980380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:54.986355 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-860a28fd-925e-4fc7-a064-a5301cd489eb req-e90bd071-e2e8-4ca5-b78f-4a45b9bcd728 service neutron] 10.222.0.76 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7612081 May 12 15:04:55.001539 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:55.006892 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:55.026060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-5b4395bd-2afe-4562-acdc-45724bfa9b63 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/quotas/146fd417ad5d4f85ae5ce85d279642a7 HTTP/1.1" status: 200 len: 375 time: 0.0572460 May 12 15:04:55.042971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa51469e-7f0d-4dbf-947d-d5b9a55aa5a7 req-bf033a7d-eed0-4b3a-9206-6463b69787a2 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:55.044450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa51469e-7f0d-4dbf-947d-d5b9a55aa5a7 req-bf033a7d-eed0-4b3a-9206-6463b69787a2 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 963 time: 0.6446126 May 12 15:04:55.045556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-182fe785-41ae-4f4b-955a-e045879d8730 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:55.047385 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-182fe785-41ae-4f4b-955a-e045879d8730 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0655441 May 12 15:04:55.063914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a29ae148-cc4f-4145-807c-c40065747ab9 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:04:55.078226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Transition to ACTIVE for port object 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:55.128483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-c0ef94ba-68c0-401d-bae6-c13024a47296 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:55.129987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-c0ef94ba-68c0-401d-bae6-c13024a47296 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.0766122 May 12 15:04:55.138486 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:55.206787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 343f050d-81d2-410f-a8ab-b2bdef562d11 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:04:55.251191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 343f050d-81d2-410f-a8ab-b2bdef562d11 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:04:55.251718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 343f050d-81d2-410f-a8ab-b2bdef562d11 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:04:55.261908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a29ae148-cc4f-4145-807c-c40065747ab9, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a29ae148-cc4f-4145-807c-c40065747ab9,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:55.279066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'a29ae148-cc4f-4145-807c-c40065747ab9', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'port_id': 'a29ae148-cc4f-4145-807c-c40065747ab9', 'mac_address': 'fa:16:3e:d0:dd:5f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 563, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:tempest-test_az-52089536', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:04:55.308896 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-6497e24b-ec8c-438d-95a1-c0b8722acc32 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1728418 May 12 15:04:55.338689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa51469e-7f0d-4dbf-947d-d5b9a55aa5a7 req-e14dded4-6d54-4afa-b8ad-25072894f7df tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2276540 May 12 15:04:55.367591 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:55.396438 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a29ae148-cc4f-4145-807c-c40065747ab9 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:55.419167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a29ae148-cc4f-4145-807c-c40065747ab9, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a29ae148-cc4f-4145-807c-c40065747ab9,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:55.436988 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:55.445420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Pushing event updated for resources: {'Port': ['ID=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:55.488884 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-456f6a02-f94c-412e-bb3b-ef8382cdd376 req-fc07a662-047e-442f-8dad-ff14c49d94e4 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1732745 May 12 15:04:55.511669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Attempting to bind port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:55.511994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Attempting to bind port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:55.512315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Attempting to bind port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:55.523085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e9704d04-d684-4d55-bc0b-33758db42644 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=146fd417ad5d4f85ae5ce85d279642a7&fields=id HTTP/1.1" status: 200 len: 255 time: 0.4899206 May 12 15:04:55.527261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:04:55.527674 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Attempting to bind port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:55.571456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a29ae148-cc4f-4145-807c-c40065747ab9,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:55.596728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:55.596952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:55.597341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:55.597927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Bound port: 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:55.598139 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:55.628076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a29ae148-cc4f-4145-807c-c40065747ab9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:04:55.688134 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ffa3bdef-b624-437c-856d-260e9a3f0a40'] response: {'name': 'network-changed', 'server_uuid': 'dfc4bc02-d56b-4ef8-8c50-af64aeb1795c', 'tag': 'a49de190-3075-4dff-a67a-fd9f694116cb', 'status': 'completed', 'code': 200} May 12 15:04:55.826699 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6bf1a9c-5626-4948-8cbd-5f8c2cecc22d req-ff6649d9-c4b3-42c9-9596-6e80672aa7df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:55.828601 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6bf1a9c-5626-4948-8cbd-5f8c2cecc22d req-ff6649d9-c4b3-42c9-9596-6e80672aa7df service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b109b727195f4a0286ba8c6b6aa99144&device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 1099 time: 0.0945475 May 12 15:04:55.890529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] For port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:55.918382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] For port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:55.927498 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:55.977613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6bf1a9c-5626-4948-8cbd-5f8c2cecc22d req-eb3ec91d-facd-4b18-8ae9-9fe60fef48ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:55.979276 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6bf1a9c-5626-4948-8cbd-5f8c2cecc22d req-eb3ec91d-facd-4b18-8ae9-9fe60fef48ad service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.1425462 May 12 15:04:55.992182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40459dd-a098-4ff6-9b1f-1d3a239bc76d req-809204d6-035b-47c8-a5d8-3f9da2d43e73 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:55.993673 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c40459dd-a098-4ff6-9b1f-1d3a239bc76d req-809204d6-035b-47c8-a5d8-3f9da2d43e73 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 946 time: 0.3746686 May 12 15:04:56.077345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:56.078020 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:56.079491 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6bf1a9c-5626-4948-8cbd-5f8c2cecc22d req-cc2a4424-72cf-461a-8a1d-dea1e4ad8224 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.124&port_id=a49de190-3075-4dff-a67a-fd9f694116cb HTTP/1.1" status: 200 len: 217 time: 0.0931017 May 12 15:04:56.079629 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] 10.222.0.76 "PUT /v2.0/ports/1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 HTTP/1.1" status: 200 len: 1116 time: 4.1277254 May 12 15:04:56.086036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'tag': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:56.146815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c794c37e-a152-4438-9c99-8bdaeaf7525f {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:56.177731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6bf1a9c-5626-4948-8cbd-5f8c2cecc22d req-402dfbff-1cfe-459e-9f13-6f14e6b2c18b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:56.179625 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6bf1a9c-5626-4948-8cbd-5f8c2cecc22d req-402dfbff-1cfe-459e-9f13-6f14e6b2c18b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0851905 May 12 15:04:56.203537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecf10473-f0ae-4740-bb19-ffa5d11a17a2 req-0c0a1a78-b134-4042-9a53-cc71172501ac tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:56.204274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ecf10473-f0ae-4740-bb19-ffa5d11a17a2 req-0c0a1a78-b134-4042-9a53-cc71172501ac tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Synchronizing usage tracker for tenant:9e8c135aef5e45fbb72a8db523f01319 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:04:56.218712 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:56.221100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5710b55-b78e-48c0-9be9-16c904886fb6 service neutron] Pushing event updated for resources: {'Port': ['ID=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:56.243749 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c40459dd-a098-4ff6-9b1f-1d3a239bc76d req-17beb45a-07de-4177-bdcf-68f54fa1c9eb tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2281089 May 12 15:04:56.275704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Transition to ACTIVE for port object c794c37e-a152-4438-9c99-8bdaeaf7525f will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:56.284943 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:56.347886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6bf1a9c-5626-4948-8cbd-5f8c2cecc22d req-a96d131b-8802-4edc-90b7-85cbf329f81f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:56.352957 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6bf1a9c-5626-4948-8cbd-5f8c2cecc22d req-a96d131b-8802-4edc-90b7-85cbf329f81f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1636143 May 12 15:04:56.357677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ecf10473-f0ae-4740-bb19-ffa5d11a17a2 req-0c0a1a78-b134-4042-9a53-cc71172501ac tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Unset dirty status for tenant:9e8c135aef5e45fbb72a8db523f01319 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:04:56.358893 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecf10473-f0ae-4740-bb19-ffa5d11a17a2 req-0c0a1a78-b134-4042-9a53-cc71172501ac tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 935 time: 0.5587466 May 12 15:04:56.540017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Pushing event updated for resources: {'Port': ['ID=c794c37e-a152-4438-9c99-8bdaeaf7525f,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:56.547988 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6bf1a9c-5626-4948-8cbd-5f8c2cecc22d req-d6dcde3a-1e1c-440d-9473-b7796059707a service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1885862 May 12 15:04:56.627234 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecf10473-f0ae-4740-bb19-ffa5d11a17a2 req-0c8c5672-bbcd-4641-a857-f61c9a069d56 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2419548 May 12 15:04:56.639859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-4901ac07-9a08-4c07-8f8b-9e2e89c338d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:56.640688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-4901ac07-9a08-4c07-8f8b-9e2e89c338d3 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b109b727195f4a0286ba8c6b6aa99144&device_id=d92d2403-4d50-4d2e-8f63-1d668eb627d5 HTTP/1.1" status: 200 len: 1119 time: 0.4963808 May 12 15:04:56.727635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Attempting to bind port c794c37e-a152-4438-9c99-8bdaeaf7525f on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:56.727635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Attempting to bind port c794c37e-a152-4438-9c99-8bdaeaf7525f by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:56.727635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Attempting to bind port c794c37e-a152-4438-9c99-8bdaeaf7525f on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:56.733927 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6bf1a9c-5626-4948-8cbd-5f8c2cecc22d req-57f48a7a-ba49-4a61-8769-1a52b6051904 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1726437 May 12 15:04:56.741427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-3be9bf4e-1f59-4591-a0c0-ae8577c6999b service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.202&port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 HTTP/1.1" status: 200 len: 217 time: 0.0888717 May 12 15:04:56.744842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Port c794c37e-a152-4438-9c99-8bdaeaf7525f on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:04:56.745167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Attempting to bind port c794c37e-a152-4438-9c99-8bdaeaf7525f on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:56.786370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:56.786605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:56.786990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:56.787422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Bound port: c794c37e-a152-4438-9c99-8bdaeaf7525f, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:56.787978 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:56.879496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd23af18-dd47-4a1d-a256-9d8beb0baa8c req-b2fe9cea-774c-45c5-a98f-d672583d1771 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:56.880877 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd23af18-dd47-4a1d-a256-9d8beb0baa8c req-b2fe9cea-774c-45c5-a98f-d672583d1771 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 948 time: 0.4621260 May 12 15:04:57.006647 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-b69bd8c6-b480-4604-a082-425ef53121de tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=146fd417ad5d4f85ae5ce85d279642a7&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0281205 May 12 15:04:57.046876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-a69f685e-77dc-4f41-a025-7d9bddf8b983 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:57.048373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-a69f685e-77dc-4f41-a025-7d9bddf8b983 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2982693 May 12 15:04:57.079587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a29ae148-cc4f-4145-807c-c40065747ab9 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:04:57.098353 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e204ce46-13ae-49e8-94c6-90ba8fe4473e req-07e693cb-b4e4-4696-9182-6ffbc657e0ca tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 210 time: 0.1194105 May 12 15:04:57.172049 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd23af18-dd47-4a1d-a256-9d8beb0baa8c req-3c0bac41-2b71-4b94-b916-738b4d753235 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1966128 May 12 15:04:57.186789 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-dffbb17f-bc20-4854-a58c-f4138c6d37b1'] response: {'name': 'network-changed', 'server_uuid': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'tag': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1', 'status': 'completed', 'code': 200} May 12 15:04:57.192900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] For port c794c37e-a152-4438-9c99-8bdaeaf7525f, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:57.199252 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] For port c794c37e-a152-4438-9c99-8bdaeaf7525f, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c794c37e-a152-4438-9c99-8bdaeaf7525f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:57.212758 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:57.265243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-fccaf93a-2cb1-4d12-ae45-24d7641f4518 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:57.267042 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-fccaf93a-2cb1-4d12-ae45-24d7641f4518 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2558179 May 12 15:04:57.283823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-227432d2-7fb2-47ba-a6d2-32514b79a095 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:57.285649 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-227432d2-7fb2-47ba-a6d2-32514b79a095 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2254188 May 12 15:04:57.287010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:57.288495 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:57.290197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] 10.222.0.76 "PUT /v2.0/ports/c794c37e-a152-4438-9c99-8bdaeaf7525f HTTP/1.1" status: 200 len: 1115 time: 2.8317616 May 12 15:04:57.290796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port a29ae148-cc4f-4145-807c-c40065747ab9 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:57.298217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port a29ae148-cc4f-4145-807c-c40065747ab9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:57.300996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Request body: {'port': {'device_id': '03df64b9-52d7-4198-9798-5cc39b9723e4', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '146fd417ad5d4f85ae5ce85d279642a7'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:57.301306 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:57.542416 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:57.571642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '77e209aa-2dd3-4b44-bae4-1bb1f474d43a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a29ae148-cc4f-4145-807c-c40065747ab9'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:57.581997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a29ae148-cc4f-4145-807c-c40065747ab9, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a29ae148-cc4f-4145-807c-c40065747ab9,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:57.588306 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:57.628127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e1ad898-174b-4baf-8505-b114509764c5 service neutron] Pushing event updated for resources: {'Port': ['ID=c794c37e-a152-4438-9c99-8bdaeaf7525f,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:57.632052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:04:57.642634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Usage tracker for resource:port and tenant:146fd417ad5d4f85ae5ce85d279642a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:04:57.645971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:04:57.653365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:04:57.666200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a29ae148-cc4f-4145-807c-c40065747ab9,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:57.667606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Made reservation on behalf of 146fd417ad5d4f85ae5ce85d279642a7 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:04:57.671331 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:57.719907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e3a57f8-9684-494a-b23e-0526f4da6c9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:57.721343 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-1e3a57f8-9684-494a-b23e-0526f4da6c9d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9e8c135aef5e45fbb72a8db523f01319&device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 1118 time: 0.3648438 May 12 15:04:57.724635 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-c8d2a5a9-90b7-43e2-ba75-f9b590c763a7 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4223688 May 12 15:04:57.733719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553504c8-eaf5-474e-ba06-81af0b4a2e40 req-57043386-3cd5-44d0-b3f7-9c6121d6285d tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:57.735131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-553504c8-eaf5-474e-ba06-81af0b4a2e40 req-57043386-3cd5-44d0-b3f7-9c6121d6285d tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 1097 time: 0.2227466 May 12 15:04:57.840338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Allocated IP 192.168.233.71 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/0e7801e8-0a68-4ebc-a8f6-619238135a1d) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:04:57.879246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-91263bbb-3f2f-47c2-a241-6ab032111b25 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=c794c37e-a152-4438-9c99-8bdaeaf7525f HTTP/1.1" status: 200 len: 217 time: 0.1431632 May 12 15:04:57.892597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c746786d-bb71-447f-8aa5-7ec7048ab0bc req-7c5505b7-edc8-4cb1-ab70-68e17c52e150 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:57.894045 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c746786d-bb71-447f-8aa5-7ec7048ab0bc req-7c5505b7-edc8-4cb1-ab70-68e17c52e150 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 964 time: 0.4373939 May 12 15:04:58.026667 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-553504c8-eaf5-474e-ba06-81af0b4a2e40 req-3a641772-7090-4432-81df-3f37ac914b8a tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2167828 May 12 15:04:58.046619 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:58.047621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-3b4ec9d6-bff4-4544-acd7-2208985b72e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:58.049226 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-3b4ec9d6-bff4-4544-acd7-2208985b72e8 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1469688 May 12 15:04:58.054981 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c746786d-bb71-447f-8aa5-7ec7048ab0bc req-4de0469a-17ab-4989-a12c-5fcad034440e tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1436944 May 12 15:04:58.064623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Transition to ACTIVE for port object 0e7801e8-0a68-4ebc-a8f6-619238135a1d will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:58.097354 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebad312-8de1-4dfd-9948-d3c07777b82b req-e50d2615-5a25-4e4e-a092-0edc5867837a service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3600881 May 12 15:04:58.117502 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:58.152879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-443f53d2-ebed-40f4-ba56-e3ba388475fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:58.156284 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-443f53d2-ebed-40f4-ba56-e3ba388475fd service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.0983934 May 12 15:04:58.161987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['2630733c-d113-4a35-86d3-c09219afe149'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:04:58.216829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Pushing event updated for resources: {'Port': ['ID=0e7801e8-0a68-4ebc-a8f6-619238135a1d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:58.232057 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3c602845-f4e6-45b8-8b9d-a646fbee1440'] response: {'server_uuid': '77e209aa-2dd3-4b44-bae4-1bb1f474d43a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a29ae148-cc4f-4145-807c-c40065747ab9', 'code': 200} May 12 15:04:58.250092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:04:58.251315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:04:58.270374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:04:58.276452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:58.277171 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:58.323689 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-e3f73a5f-32b4-468f-8d69-3bebe5962542 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.0328348 May 12 15:04:58.344048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Request body: {'port': {'device_id': '03df64b9-52d7-4198-9798-5cc39b9723e4', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:04:58.478418 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:58.591905 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5374562b-9931-49f8-8d37-d332b8693ab0 None None] Provisioning for port 0e7801e8-0a68-4ebc-a8f6-619238135a1d completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:04:58.599331 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5374562b-9931-49f8-8d37-d332b8693ab0 None None] Provisioning complete for port 0e7801e8-0a68-4ebc-a8f6-619238135a1d triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:04:58.600681 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5374562b-9931-49f8-8d37-d332b8693ab0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:58.642320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-8e8b486f-fab0-44c8-a4ba-5a3b71c64ed3 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4698088 May 12 15:04:58.644137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b8a835-de7c-43b4-bc20-94dd2ccb297b req-61dfbfcb-3437-4cfe-9237-f9b5725f893d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:58.645441 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06b8a835-de7c-43b4-bc20-94dd2ccb297b req-61dfbfcb-3437-4cfe-9237-f9b5725f893d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b109b727195f4a0286ba8c6b6aa99144&device_id=d92d2403-4d50-4d2e-8f63-1d668eb627d5 HTTP/1.1" status: 200 len: 1119 time: 0.4230080 May 12 15:04:58.672227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5374562b-9931-49f8-8d37-d332b8693ab0 None None] Port 0e7801e8-0a68-4ebc-a8f6-619238135a1d cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:04:58.675712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7cbd40a-5921-4899-9696-1ac01c845e0e req-5b136690-0c55-4838-9508-36e37073af10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:58.677096 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7cbd40a-5921-4899-9696-1ac01c845e0e req-5b136690-0c55-4838-9508-36e37073af10 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 1116 time: 0.4047108 May 12 15:04:58.713545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b11a17a0-89e1-43f4-962f-744ad015afa0 req-7d37c4ed-e903-4451-a566-986fdb915985 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:58.714974 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b11a17a0-89e1-43f4-962f-744ad015afa0 req-7d37c4ed-e903-4451-a566-986fdb915985 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 967 time: 0.3514521 May 12 15:04:58.845055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0e7801e8-0a68-4ebc-a8f6-619238135a1d {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:58.853180 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:58.869469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Transition to ACTIVE for port object 0e7801e8-0a68-4ebc-a8f6-619238135a1d will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:04:58.873085 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:58.903432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-546818d2-7315-4473-acdb-43eecb56e864 req-6a0f486e-a231-4c8c-a5fe-2e8d2c41cb3b tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:58.904848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-546818d2-7315-4473-acdb-43eecb56e864 req-6a0f486e-a231-4c8c-a5fe-2e8d2c41cb3b tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 935 time: 0.5400624 May 12 15:04:59.009832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Pushing event updated for resources: {'Port': ['ID=0e7801e8-0a68-4ebc-a8f6-619238135a1d,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:59.019639 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7cbd40a-5921-4899-9696-1ac01c845e0e req-65ff6766-1b6e-49f2-a86a-426a16ccae1c service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3211861 May 12 15:04:59.065703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Attempting to bind port 0e7801e8-0a68-4ebc-a8f6-619238135a1d on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:04:59.066028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Attempting to bind port 0e7801e8-0a68-4ebc-a8f6-619238135a1d by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:04:59.066355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Attempting to bind port 0e7801e8-0a68-4ebc-a8f6-619238135a1d on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:59.067605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b11a17a0-89e1-43f4-962f-744ad015afa0 req-bf7f5171-b95c-4435-a414-dac7e94b1463 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2218590 May 12 15:04:59.072241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Port 0e7801e8-0a68-4ebc-a8f6-619238135a1d on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:04:59.072689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Attempting to bind port 0e7801e8-0a68-4ebc-a8f6-619238135a1d on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:04:59.078615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:04:59.079074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:04:59.079576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:04:59.080104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Bound port: 0e7801e8-0a68-4ebc-a8f6-619238135a1d, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:04:59.080546 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:59.097121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-546818d2-7315-4473-acdb-43eecb56e864 req-df9b7510-ed39-4e5f-bf6c-51f1cba2dead tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1655931 May 12 15:04:59.132533 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0194fef5-7f4c-4235-81ec-ed8a2b9fa06c req-dc5d7bb2-8a68-414b-a3e6-0810aaca6d2a service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4778533 May 12 15:04:59.133623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b8a835-de7c-43b4-bc20-94dd2ccb297b req-f2c7c743-3956-4b12-9b91-3f11e77352a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:59.134981 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06b8a835-de7c-43b4-bc20-94dd2ccb297b req-f2c7c743-3956-4b12-9b91-3f11e77352a9 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.4778519 May 12 15:04:59.187794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '98f7c3c2-103b-4195-94da-8e6d9b108c1c', 'tag': 'c794c37e-a152-4438-9c99-8bdaeaf7525f'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:59.195790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] For port 0e7801e8-0a68-4ebc-a8f6-619238135a1d, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:04:59.200232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] For port 0e7801e8-0a68-4ebc-a8f6-619238135a1d, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0e7801e8-0a68-4ebc-a8f6-619238135a1d,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:04:59.214522 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:59.278833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:59.279726 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:59.281816 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] 10.222.0.84 "PUT /v2.0/ports/0e7801e8-0a68-4ebc-a8f6-619238135a1d HTTP/1.1" status: 200 len: 1095 time: 0.9429817 May 12 15:04:59.289842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '03df64b9-52d7-4198-9798-5cc39b9723e4', 'tag': '0e7801e8-0a68-4ebc-a8f6-619238135a1d'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:04:59.317790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7712a6-f255-495a-b3d6-ddf27b78e702 service neutron] Pushing event updated for resources: {'Port': ['ID=0e7801e8-0a68-4ebc-a8f6-619238135a1d,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:59.392719 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06b8a835-de7c-43b4-bc20-94dd2ccb297b req-b7ce741f-238c-4eed-87a0-2c5ed9e04b6d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.202&port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 HTTP/1.1" status: 200 len: 217 time: 0.1215842 May 12 15:04:59.422178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-a4cea7fb-9929-4e8b-b33c-8fc3cecb20ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:59.423627 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-a4cea7fb-9929-4e8b-b33c-8fc3cecb20ea service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=146fd417ad5d4f85ae5ce85d279642a7&device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 1098 time: 0.0827663 May 12 15:04:59.463197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a49de190-3075-4dff-a67a-fd9f694116cb details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:04:59.502414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b8a835-de7c-43b4-bc20-94dd2ccb297b req-2f56583b-efe6-4453-8260-dd1fc5269271 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:59.503821 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06b8a835-de7c-43b4-bc20-94dd2ccb297b req-2f56583b-efe6-4453-8260-dd1fc5269271 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0835426 May 12 15:04:59.508371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d151c8ba-b632-4733-a75b-9451d4908a6b req-bdb8c426-0f92-467d-8750-6d85f96b8069 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:59.509843 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d151c8ba-b632-4733-a75b-9451d4908a6b req-bdb8c426-0f92-467d-8750-6d85f96b8069 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 1097 time: 0.2909896 May 12 15:04:59.516717 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-183090b2-12e1-41ae-88c6-d36ad9328c37 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.71&port_id=0e7801e8-0a68-4ebc-a8f6-619238135a1d HTTP/1.1" status: 200 len: 217 time: 0.0782232 May 12 15:04:59.520507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c859c4f1-d9f9-4b87-bf77-e18fdd8cdf8c req-e18afae4-e97a-4590-9a7d-6073ecf8e3bc tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:59.522141 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c859c4f1-d9f9-4b87-bf77-e18fdd8cdf8c req-e18afae4-e97a-4590-9a7d-6073ecf8e3bc tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 948 time: 0.2520192 May 12 15:04:59.585164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-0b907af2-6af3-45e7-babe-393de357cfac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:59.586616 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-0b907af2-6af3-45e7-babe-393de357cfac service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0635998 May 12 15:04:59.613495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a49de190-3075-4dff-a67a-fd9f694116cb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a49de190-3075-4dff-a67a-fd9f694116cb,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:59.627937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'a49de190-3075-4dff-a67a-fd9f694116cb', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'a49de190-3075-4dff-a67a-fd9f694116cb', 'mac_address': 'fa:16:3e:4a:24:21', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.124'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:04:59.640189 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d151c8ba-b632-4733-a75b-9451d4908a6b req-6bbafa5b-13c1-4449-bc88-4d6ed0af275f tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0877385 May 12 15:04:59.653339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c859c4f1-d9f9-4b87-bf77-e18fdd8cdf8c req-fc219e4b-4f2b-43f5-8c00-f2c0debfec7d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0986748 May 12 15:04:59.680867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-34186865-7237-49a5-a7c6-8f0728317854 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:59.683453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b8a835-de7c-43b4-bc20-94dd2ccb297b req-8db0bef4-d54c-407e-b608-a027507ec39a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:04:59.683705 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-34186865-7237-49a5-a7c6-8f0728317854 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.0898752 May 12 15:04:59.684893 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06b8a835-de7c-43b4-bc20-94dd2ccb297b req-8db0bef4-d54c-407e-b608-a027507ec39a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1740129 May 12 15:04:59.711046 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:59.759561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a49de190-3075-4dff-a67a-fd9f694116cb {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:04:59.791691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a49de190-3075-4dff-a67a-fd9f694116cb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a49de190-3075-4dff-a67a-fd9f694116cb,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:04:59.805732 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:04:59.915955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a49de190-3075-4dff-a67a-fd9f694116cb,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:04:59.916890 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06b8a835-de7c-43b4-bc20-94dd2ccb297b req-8b4c8f64-8a9d-4905-954e-25fb243c2eb2 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2248592 May 12 15:04:59.965456 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-19dcbd60-651c-4168-8d5e-8090d09075b7 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2697320 May 12 15:04:59.998996 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-dde5a852-e5bc-4355-a352-9559aa5f130a'] response: {'name': 'network-changed', 'server_uuid': '03df64b9-52d7-4198-9798-5cc39b9723e4', 'tag': '0e7801e8-0a68-4ebc-a8f6-619238135a1d', 'status': 'completed', 'code': 200} May 12 15:05:00.004060 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-303b724c-4615-4332-aca7-599063bc926c'] response: {'name': 'network-changed', 'server_uuid': '98f7c3c2-103b-4195-94da-8e6d9b108c1c', 'tag': 'c794c37e-a152-4438-9c99-8bdaeaf7525f', 'status': 'completed', 'code': 200} May 12 15:05:00.123510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a49de190-3075-4dff-a67a-fd9f694116cb'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:05:00.132922 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6d416ad-8241-465f-a2cc-94dd813f74ac req-c45c6a67-b233-4b2b-975e-9cdb765c9a81 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1602995 May 12 15:05:00.158067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f29b604f-3cae-4052-957a-28a1f1da6cef req-6f61f726-0c6b-4ff4-b10d-09345fb29c75 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:00.165326 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f29b604f-3cae-4052-957a-28a1f1da6cef req-6f61f726-0c6b-4ff4-b10d-09345fb29c75 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 965 time: 0.3120279 May 12 15:05:00.193012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06b8a835-de7c-43b4-bc20-94dd2ccb297b req-dfcd48e0-3bc6-458f-b62b-30870005f55d service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2654500 May 12 15:05:00.218837 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb6cbdbd-493c-431e-ab6c-6d323409ca22 req-4dd6d572-eb57-4f45-9e34-3ccb5b0b32c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:00.220326 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb6cbdbd-493c-431e-ab6c-6d323409ca22 req-4dd6d572-eb57-4f45-9e34-3ccb5b0b32c2 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9e8c135aef5e45fbb72a8db523f01319&device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 1118 time: 0.2070475 May 12 15:05:00.237551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f29b604f-3cae-4052-957a-28a1f1da6cef req-6f9ea824-1e94-4c32-a46b-b57cf9c825ae tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0689805 May 12 15:05:00.441350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb6cbdbd-493c-431e-ab6c-6d323409ca22 req-bc710932-64da-4e71-b728-01a7ee5fa278 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:00.442735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb6cbdbd-493c-431e-ab6c-6d323409ca22 req-bc710932-64da-4e71-b728-01a7ee5fa278 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.2030606 May 12 15:05:00.445305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef44ced-9bb6-4338-8b93-4c2ec298883c req-7e23d49f-62c7-4d99-9eb6-6a8974713758 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:00.446921 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ef44ced-9bb6-4338-8b93-4c2ec298883c req-7e23d49f-62c7-4d99-9eb6-6a8974713758 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=146fd417ad5d4f85ae5ce85d279642a7&device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 1098 time: 0.1473269 May 12 15:05:00.556973 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb6cbdbd-493c-431e-ab6c-6d323409ca22 req-c5f5228e-bb4d-48ec-b76b-7b55d9110905 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=c794c37e-a152-4438-9c99-8bdaeaf7525f HTTP/1.1" status: 200 len: 217 time: 0.0743840 May 12 15:05:00.585729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef44ced-9bb6-4338-8b93-4c2ec298883c req-384777eb-5b9b-49a5-8ebf-802a31772349 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:00.587154 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ef44ced-9bb6-4338-8b93-4c2ec298883c req-384777eb-5b9b-49a5-8ebf-802a31772349 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.1342547 May 12 15:05:00.633099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb6cbdbd-493c-431e-ab6c-6d323409ca22 req-de8b1f13-7d49-4ac9-80f1-e8cc6915c528 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:00.634554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb6cbdbd-493c-431e-ab6c-6d323409ca22 req-de8b1f13-7d49-4ac9-80f1-e8cc6915c528 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0710187 May 12 15:05:00.646205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b6d14f-e3cd-4f58-975f-50d363a938c7 req-8ef46500-9875-4b5c-952a-46e2ac35efeb tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:00.649017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f1b6d14f-e3cd-4f58-975f-50d363a938c7 req-8ef46500-9875-4b5c-952a-46e2ac35efeb tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 967 time: 0.2045801 May 12 15:05:00.657800 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ef44ced-9bb6-4338-8b93-4c2ec298883c req-1aca9177-691d-4d5e-83fc-597b4b95de00 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.71&port_id=0e7801e8-0a68-4ebc-a8f6-619238135a1d HTTP/1.1" status: 200 len: 217 time: 0.0638790 May 12 15:05:00.724371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef44ced-9bb6-4338-8b93-4c2ec298883c req-3062d65e-985c-4c53-9c3f-d867484a79aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:00.726228 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ef44ced-9bb6-4338-8b93-4c2ec298883c req-3062d65e-985c-4c53-9c3f-d867484a79aa service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0621297 May 12 15:05:00.810346 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f1b6d14f-e3cd-4f58-975f-50d363a938c7 req-ab238827-e3d1-418c-845d-db467a65b4be tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1306167 May 12 15:05:00.819456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef44ced-9bb6-4338-8b93-4c2ec298883c req-c5cbfb00-e21b-47b6-b8cb-003dcbad047e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:00.821321 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ef44ced-9bb6-4338-8b93-4c2ec298883c req-c5cbfb00-e21b-47b6-b8cb-003dcbad047e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.0890088 May 12 15:05:00.836366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb6cbdbd-493c-431e-ab6c-6d323409ca22 req-eec3a751-3f85-41ad-a3e7-1d97aca01ecd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:00.839842 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb6cbdbd-493c-431e-ab6c-6d323409ca22 req-eec3a751-3f85-41ad-a3e7-1d97aca01ecd service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1905022 May 12 15:05:00.961969 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ef44ced-9bb6-4338-8b93-4c2ec298883c req-033ee2de-141c-4a28-b9ae-a8ebbb77a179 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1329775 May 12 15:05:01.048581 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb6cbdbd-493c-431e-ab6c-6d323409ca22 req-244ad24a-278d-4f12-9c47-8dc94549f73f service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2013359 May 12 15:05:01.110878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:05:01.114919 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ef44ced-9bb6-4338-8b93-4c2ec298883c req-adf0caf7-930f-4164-9be9-f1b967c54be0 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1432409 May 12 15:05:01.136594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dcca103-9842-45df-acba-4ec473e287dc req-a1fc17ce-db8f-486b-bb47-d51f9a4349e3 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:01.138059 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4dcca103-9842-45df-acba-4ec473e287dc req-a1fc17ce-db8f-486b-bb47-d51f9a4349e3 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 947 time: 0.2071037 May 12 15:05:01.221100 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4dcca103-9842-45df-acba-4ec473e287dc req-b5ea9b91-3ac9-4cee-a9c6-cf9232146bb7 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748551 May 12 15:05:01.231650 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb6cbdbd-493c-431e-ab6c-6d323409ca22 req-d7fdc836-708a-43ec-9be9-3fe28fa8acb6 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1765532 May 12 15:05:01.274466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:01.290974 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1', 'mac_address': 'fa:16:3e:f6:2c:94', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.202'}], 'device_owner': 'compute:tempest-test_az-52089536', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:05:01.353181 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:01.373636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:05:01.392767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:01.398832 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:01.412747 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42812) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:01.468610 n-d-841483-1 neutron-server[88151]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 12 15:05:01.472259 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:01.472548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-fa70c8bf-9e26-4753-b9a0-8b1c35d6af21 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:05:01.473750 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-fa70c8bf-9e26-4753-b9a0-8b1c35d6af21 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0597491 May 12 15:05:01.492248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a49de190-3075-4dff-a67a-fd9f694116cb up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:05:01.566192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port a49de190-3075-4dff-a67a-fd9f694116cb completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:05:01.571468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-294b70f8-aa98-4cea-a35d-c3336ca0a489 service neutron] Request body: {'binding': {'host': 'n-h2-841483-1', 'vnic_type': 'normal', 'profile': {}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:05:01.572078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-294b70f8-aa98-4cea-a35d-c3336ca0a489 service neutron] Unknown quota resources ['binding']. {{(pid=88151) _create /opt/stack/neutron/neutron/api/v2/base.py:495}} May 12 15:05:01.572243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port a49de190-3075-4dff-a67a-fd9f694116cb triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:05:01.572690 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:01.573559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-996a6ed6-c09e-46b0-ad5e-9f0d0dd46897 req-17adc3d5-8794-493c-b5c5-fdc5f5e13a80 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:01.575017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-996a6ed6-c09e-46b0-ad5e-9f0d0dd46897 req-17adc3d5-8794-493c-b5c5-fdc5f5e13a80 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 949 time: 0.0931373 May 12 15:05:01.602425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['1eade7b6-fd9d-4292-b6d7-67f0ba8285d1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:05:01.622281 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-996a6ed6-c09e-46b0-ad5e-9f0d0dd46897 req-9ccf71f2-8f88-42b3-a762-db2803ded57d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409722 May 12 15:05:01.804161 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:01.808953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-294b70f8-aa98-4cea-a35d-c3336ca0a489 service neutron] Attempting to bind port d7e09d66-2268-48c4-a658-ef10261e7a46 on host n-h2-841483-1 for vnic_type normal with profile None {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:05:01.809288 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-294b70f8-aa98-4cea-a35d-c3336ca0a489 service neutron] Attempting to bind port d7e09d66-2268-48c4-a658-ef10261e7a46 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:05:01.809640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-294b70f8-aa98-4cea-a35d-c3336ca0a489 service neutron] Attempting to bind port d7e09d66-2268-48c4-a658-ef10261e7a46 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:05:01.813639 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c78cb07f-54f8-4da5-98e1-8452a18b6fb6 req-00ea9352-befd-4c40-b739-ea70b7095a0b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:01.814401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-294b70f8-aa98-4cea-a35d-c3336ca0a489 service neutron] Port d7e09d66-2268-48c4-a658-ef10261e7a46 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:05:01.814713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-294b70f8-aa98-4cea-a35d-c3336ca0a489 service neutron] Attempting to bind port d7e09d66-2268-48c4-a658-ef10261e7a46 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:05:01.820493 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c78cb07f-54f8-4da5-98e1-8452a18b6fb6 req-00ea9352-befd-4c40-b739-ea70b7095a0b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 965 time: 0.0872240 May 12 15:05:01.820937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-294b70f8-aa98-4cea-a35d-c3336ca0a489 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:05:01.821308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-294b70f8-aa98-4cea-a35d-c3336ca0a489 service neutron] Checking segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:05:01.821673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-294b70f8-aa98-4cea-a35d-c3336ca0a489 service neutron] Bound using segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:05:01.822098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-294b70f8-aa98-4cea-a35d-c3336ca0a489 service neutron] Bound port: d7e09d66-2268-48c4-a658-ef10261e7a46, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:05:01.855709 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfc4bc02-d56b-4ef8-8c50-af64aeb1795c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a49de190-3075-4dff-a67a-fd9f694116cb'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:01.867322 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c78cb07f-54f8-4da5-98e1-8452a18b6fb6 req-59c4dc82-5637-4616-9993-f9785b88366b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446756 May 12 15:05:01.874913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a49de190-3075-4dff-a67a-fd9f694116cb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a49de190-3075-4dff-a67a-fd9f694116cb,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:01.891157 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:01.908385 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-294b70f8-aa98-4cea-a35d-c3336ca0a489 service neutron] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d7e09d66-2268-48c4-a658-ef10261e7a46,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:05:01.914843 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-294b70f8-aa98-4cea-a35d-c3336ca0a489 service neutron] Notify callbacks [] for binding, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:01.916671 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-294b70f8-aa98-4cea-a35d-c3336ca0a489 service neutron] 10.222.0.82 "POST /v2.0/ports/d7e09d66-2268-48c4-a658-ef10261e7a46/bindings HTTP/1.1" status: 201 len: 389 time: 0.3922763 May 12 15:05:01.997957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a49de190-3075-4dff-a67a-fd9f694116cb,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:02.000765 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:02.045550 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ee4a29f4-4fa6-430c-a703-5405e0f855b1'] response: {'server_uuid': 'dfc4bc02-d56b-4ef8-8c50-af64aeb1795c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a49de190-3075-4dff-a67a-fd9f694116cb', 'code': 200} May 12 15:05:02.132304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a064f5a-788c-48a9-8717-c36bce92f85d req-4485506f-714e-448f-9993-f90d18c2f13b tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:02.133857 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a064f5a-788c-48a9-8717-c36bce92f85d req-4485506f-714e-448f-9993-f90d18c2f13b tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 967 time: 0.0940382 May 12 15:05:02.242179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790d341f-77b4-463b-a1f8-d6a2976c9fd7 req-e54ace49-4814-4848-a9a2-96fae988e8f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:02.243646 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-790d341f-77b4-463b-a1f8-d6a2976c9fd7 req-e54ace49-4814-4848-a9a2-96fae988e8f5 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 1101 time: 0.0734968 May 12 15:05:02.285815 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-790d341f-77b4-463b-a1f8-d6a2976c9fd7 req-5b76760b-4c2f-4ca4-9a40-7be3bd5c2d42 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0363159 May 12 15:05:02.286402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a064f5a-788c-48a9-8717-c36bce92f85d req-cd991499-9121-431a-ae29-50eefa7606ac tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1129165 May 12 15:05:02.321646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e33d5f3c-8601-45d7-8371-dd0205e3cbd4 req-1d527a2d-2430-4434-af46-c381cb310da5 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:02.323056 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e33d5f3c-8601-45d7-8371-dd0205e3cbd4 req-1d527a2d-2430-4434-af46-c381cb310da5 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 965 time: 0.1879563 May 12 15:05:02.325436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-a972ea21-3a6f-4da8-9c3f-da9baadf7a3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:02.326917 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-a972ea21-3a6f-4da8-9c3f-da9baadf7a3f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 1097 time: 0.1520648 May 12 15:05:02.332025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42836) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:02.364136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-30a89578-afde-4c2a-90c4-0ef828c879c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Request body: {'floatingip': {'port_id': 'a29ae148-cc4f-4145-807c-c40065747ab9'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:05:02.579395 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30a89578-afde-4c2a-90c4-0ef828c879c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:02.824473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-6ce0a215-f209-4895-8516-01515318eef6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:02.825939 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-6ce0a215-f209-4895-8516-01515318eef6 service neutron] 10.222.0.76 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.4916635 May 12 15:05:02.920770 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-ee9dc5ab-b3a8-4974-8720-3734fd7158d9 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d7e09d66-2268-48c4-a658-ef10261e7a46 HTTP/1.1" status: 200 len: 217 time: 0.0829298 May 12 15:05:03.040353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-366e2627-e1b5-46ef-8700-abe57cbf9f4f req-792098a8-cc66-496b-8ed3-118bc016a8ee tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:03.041780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-366e2627-e1b5-46ef-8700-abe57cbf9f4f req-792098a8-cc66-496b-8ed3-118bc016a8ee tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 947 time: 0.6104820 May 12 15:05:03.088198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3485b309-caf0-4846-a621-397f25ad4b00 req-6553660a-5cd0-40e4-826f-dd575709b8a7 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:03.089641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3485b309-caf0-4846-a621-397f25ad4b00 req-6553660a-5cd0-40e4-826f-dd575709b8a7 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 946 time: 0.6641519 May 12 15:05:03.125598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c794c37e-a152-4438-9c99-8bdaeaf7525f details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:05:03.130275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:05:03.247204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-5d479d97-dabf-43df-8d06-61f52cb730d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:03.248625 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-5d479d97-dabf-43df-8d06-61f52cb730d3 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.2172091 May 12 15:05:03.274160 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3485b309-caf0-4846-a621-397f25ad4b00 req-471e5fcb-e5f8-43a0-befe-df2d6bdaa06d tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1781943 May 12 15:05:03.323122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:05:03.332278 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:05:03.332683 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:03.340731 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-366e2627-e1b5-46ef-8700-abe57cbf9f4f req-bae1d725-6a33-4fce-b9dd-ebead671da57 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2474682 May 12 15:05:03.350929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-f00bce3a-89e3-45d9-a316-812f72125ff4 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0810368 May 12 15:05:03.442326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c794c37e-a152-4438-9c99-8bdaeaf7525f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c794c37e-a152-4438-9c99-8bdaeaf7525f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:03.466726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'c794c37e-a152-4438-9c99-8bdaeaf7525f', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'c794c37e-a152-4438-9c99-8bdaeaf7525f', 'mac_address': 'fa:16:3e:73:39:bb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.38'}], 'device_owner': 'compute:tempest-test_az-52089536', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:05:03.506187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0e7801e8-0a68-4ebc-a8f6-619238135a1d details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:05:03.615029 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:03.686314 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:03.710902 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c794c37e-a152-4438-9c99-8bdaeaf7525f {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:05:03.718963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-eb037bee-a61e-4e6b-83de-5fd90a24efed service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3572974 May 12 15:05:03.765260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:03.766866 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c794c37e-a152-4438-9c99-8bdaeaf7525f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c794c37e-a152-4438-9c99-8bdaeaf7525f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:03.781224 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:03.782937 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:03.847535 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0e7801e8-0a68-4ebc-a8f6-619238135a1d, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0e7801e8-0a68-4ebc-a8f6-619238135a1d,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:03.868529 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '0e7801e8-0a68-4ebc-a8f6-619238135a1d', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '0e7801e8-0a68-4ebc-a8f6-619238135a1d', 'mac_address': 'fa:16:3e:a0:5e:a3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.71'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:05:03.907801 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c794c37e-a152-4438-9c99-8bdaeaf7525f,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:03.988798 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:04.002999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c794c37e-a152-4438-9c99-8bdaeaf7525f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:05:04.051176 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:04.059232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-204c5567-dd46-4075-a131-7e9de9547b93 req-d8079364-f21c-4897-9422-bfa2e30a6388 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:04.060671 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-204c5567-dd46-4075-a131-7e9de9547b93 req-d8079364-f21c-4897-9422-bfa2e30a6388 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 950 time: 0.5886843 May 12 15:05:04.068022 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0e7801e8-0a68-4ebc-a8f6-619238135a1d {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:05:04.083805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:04.100719 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0e7801e8-0a68-4ebc-a8f6-619238135a1d, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0e7801e8-0a68-4ebc-a8f6-619238135a1d,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:04.110073 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:04.155079 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-69a8b5f4-da10-449f-aa55-83a5d0c57774 service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3155222 May 12 15:05:04.193058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39187f06-338b-4b61-bc72-c93b70e21a63 req-3be68460-fe59-41e1-b42b-976524308677 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:04.195147 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39187f06-338b-4b61-bc72-c93b70e21a63 req-3be68460-fe59-41e1-b42b-976524308677 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 968 time: 0.3567760 May 12 15:05:04.201506 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-204c5567-dd46-4075-a131-7e9de9547b93 req-a3211f56-d193-43e6-a31a-33904749c45e tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1241245 May 12 15:05:04.222132 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=0e7801e8-0a68-4ebc-a8f6-619238135a1d,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:04.310144 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7ecdd055-4fac-467d-8e07-72f17881bcff'] response: {'server_uuid': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1', 'code': 200} May 12 15:05:04.428681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['0e7801e8-0a68-4ebc-a8f6-619238135a1d'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:05:04.516477 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30a89578-afde-4c2a-90c4-0ef828c879c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:04.521348 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39187f06-338b-4b61-bc72-c93b70e21a63 req-6889454d-11f0-444d-a66e-0fda7efd7a52 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3170483 May 12 15:05:04.527688 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30a89578-afde-4c2a-90c4-0ef828c879c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:04.823743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-0cdc9353-da4e-4aef-bf8c-0b7c72480b48 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:04.825117 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-0cdc9353-da4e-4aef-bf8c-0b7c72480b48 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86&tenant_id=1b3825228b0e4c42a381540b66ea23d6&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1097 time: 0.5314674 May 12 15:05:04.841889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h2-841483-1'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:05:04.877714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0fd9223-f865-4615-82a3-1df8a285d82e req-0739ed6d-3810-4532-ac39-9a75cbb1bf74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:04.879143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0fd9223-f865-4615-82a3-1df8a285d82e req-0739ed6d-3810-4532-ac39-9a75cbb1bf74 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=d92d2403-4d50-4d2e-8f63-1d668eb627d5 HTTP/1.1" status: 200 len: 1121 time: 0.5149376 May 12 15:05:04.915732 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-30a89578-afde-4c2a-90c4-0ef828c879c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Floating IP d8eaf86b-fcbd-4ca9-8430-1ddde3b94626 associated. External IP: 172.25.8.60, port: a29ae148-cc4f-4145-807c-c40065747ab9. May 12 15:05:05.019699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2355abb4-0e39-43a2-a024-cead636fd639 req-1f0b04bb-91a0-4ddf-857b-83b654073ec1 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:05.021123 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2355abb4-0e39-43a2-a024-cead636fd639 req-1f0b04bb-91a0-4ddf-857b-83b654073ec1 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 946 time: 0.4401138 May 12 15:05:05.126124 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c794c37e-a152-4438-9c99-8bdaeaf7525f up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:05:05.161397 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fef2a61-46c1-4fbb-9b91-f19af0993e83 req-9f7cf568-6e98-476b-a70f-75c6c685c032 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:05.163518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2fef2a61-46c1-4fbb-9b91-f19af0993e83 req-9f7cf568-6e98-476b-a70f-75c6c685c032 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 948 time: 0.5077059 May 12 15:05:05.181357 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0fd9223-f865-4615-82a3-1df8a285d82e req-dd9030b2-9550-4bda-8998-92ab691be238 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2887716 May 12 15:05:05.195803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port c794c37e-a152-4438-9c99-8bdaeaf7525f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:05:05.200911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port c794c37e-a152-4438-9c99-8bdaeaf7525f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:05:05.201275 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:05.236655 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:05.254100 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2355abb4-0e39-43a2-a024-cead636fd639 req-3f4ea279-5e1a-496f-b0ef-67e78d578b48 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1967161 May 12 15:05:05.331279 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2fef2a61-46c1-4fbb-9b91-f19af0993e83 req-b7f246f4-82b4-415e-a708-acbb50dd211e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1546812 May 12 15:05:05.361610 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:05.414531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c794c37e-a152-4438-9c99-8bdaeaf7525f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c794c37e-a152-4438-9c99-8bdaeaf7525f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:05.420941 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:05.497084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c794c37e-a152-4438-9c99-8bdaeaf7525f,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:05.509587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0e7801e8-0a68-4ebc-a8f6-619238135a1d up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:05:05.593802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 0e7801e8-0a68-4ebc-a8f6-619238135a1d completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:05:05.598979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 0e7801e8-0a68-4ebc-a8f6-619238135a1d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:05:05.599647 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:05.722735 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:05.750312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d7e09d66-2268-48c4-a658-ef10261e7a46,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:05.755563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0e7801e8-0a68-4ebc-a8f6-619238135a1d, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0e7801e8-0a68-4ebc-a8f6-619238135a1d,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:05.760055 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:05.771745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-30a89578-afde-4c2a-90c4-0ef828c879c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Router 272668a4-245d-4021-b26c-456bc892016b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:05:05.789406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fa35af-5c89-4b0d-a824-fbd613a78742 req-5041b52d-8f83-4aac-99da-6bc6ac01f041 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:05.789645 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8fa35af-5c89-4b0d-a824-fbd613a78742 req-5041b52d-8f83-4aac-99da-6bc6ac01f041 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 950 time: 0.3643346 May 12 15:05:05.832116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=0e7801e8-0a68-4ebc-a8f6-619238135a1d,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:06.004332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:05:06.072106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9f0f10c-eae6-4370-ac4d-7df0aabad66c req-861ea0c3-d0af-4946-8fbb-e77b2b5dcfbc tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:06.073566 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9f0f10c-eae6-4370-ac4d-7df0aabad66c req-861ea0c3-d0af-4946-8fbb-e77b2b5dcfbc tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 969 time: 0.4082460 May 12 15:05:06.089299 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8fa35af-5c89-4b0d-a824-fbd613a78742 req-38f269db-354d-42cd-9ca8-6f84212215d6 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2875867 May 12 15:05:06.204806 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '65495c97-2a82-4737-a9aa-c3ca1d8ffc86', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd7e09d66-2268-48c4-a658-ef10261e7a46'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:06.216554 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:06.273520 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:06.279416 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9f0f10c-eae6-4370-ac4d-7df0aabad66c req-46a42c3a-cd33-43c9-8ea5-86a715eafda6 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1978695 May 12 15:05:06.311180 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98f7c3c2-103b-4195-94da-8e6d9b108c1c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c794c37e-a152-4438-9c99-8bdaeaf7525f'}, {'server_uuid': '03df64b9-52d7-4198-9798-5cc39b9723e4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e7801e8-0a68-4ebc-a8f6-619238135a1d'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:06.350526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-30a89578-afde-4c2a-90c4-0ef828c879c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:05:06.369894 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-570625ce-78db-4046-abb3-f35a252bf323 None None] Sync routers for ids ['272668a4-245d-4021-b26c-456bc892016b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:05:06.379784 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-570625ce-78db-4046-abb3-f35a252bf323 None None] Routers {'272668a4-245d-4021-b26c-456bc892016b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:05:06.380581 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-570625ce-78db-4046-abb3-f35a252bf323 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:04:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['272668a4-245d-4021-b26c-456bc892016b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:05:06.414679 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30a89578-afde-4c2a-90c4-0ef828c879c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:06.501759 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bc82f5aa-6ec4-4699-ad9d-9b222bce0223'] response: {'server_uuid': '65495c97-2a82-4737-a9aa-c3ca1d8ffc86', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd7e09d66-2268-48c4-a658-ef10261e7a46', 'code': 200} May 12 15:05:06.548535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Pushing event updated for resources: {'Port': ['ID=d7e09d66-2268-48c4-a658-ef10261e7a46,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:06.555738 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-30a89578-afde-4c2a-90c4-0ef828c879c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "PUT /v2.0/floatingips/d8eaf86b-fcbd-4ca9-8430-1ddde3b94626 HTTP/1.1" status: 200 len: 1010 time: 4.2194712 May 12 15:05:06.570825 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-570625ce-78db-4046-abb3-f35a252bf323 None None] Set router 272668a4-245d-4021-b26c-456bc892016b gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:05:06.576545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c2f993-e037-4d77-a09c-9757b47c2dab req-b908f783-9086-47bf-9a43-d808f482c64f tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:06.578209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d4c2f993-e037-4d77-a09c-9757b47c2dab req-b908f783-9086-47bf-9a43-d808f482c64f tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=d92d2403-4d50-4d2e-8f63-1d668eb627d5 HTTP/1.1" status: 200 len: 970 time: 0.3685789 May 12 15:05:06.673406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Attempting to bind port d7e09d66-2268-48c4-a658-ef10261e7a46 on host n-h1-841483-1 for vnic_type normal with profile {"migrating_to": "n-h2-841483-1"} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:05:06.673734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Attempting to bind port d7e09d66-2268-48c4-a658-ef10261e7a46 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:05:06.674056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Attempting to bind port d7e09d66-2268-48c4-a658-ef10261e7a46 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:05:06.694942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Port d7e09d66-2268-48c4-a658-ef10261e7a46 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:05:06.694942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Attempting to bind port d7e09d66-2268-48c4-a658-ef10261e7a46 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:05:06.704783 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d4c2f993-e037-4d77-a09c-9757b47c2dab req-a6c90da3-a72d-46fd-8fb8-bf07b2e1359a tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1187031 May 12 15:05:06.707988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 4, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:05:06.708291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Checking segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:05:06.708665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Bound using segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:05:06.709694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Bound port: d7e09d66-2268-48c4-a658-ef10261e7a46, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:05:06.710108 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:06.769998 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d2630ad1-6029-4fd2-9243-dbcd2aa0c1a6'] response: {'server_uuid': '98f7c3c2-103b-4195-94da-8e6d9b108c1c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c794c37e-a152-4438-9c99-8bdaeaf7525f', 'code': 200} May 12 15:05:06.770498 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d2630ad1-6029-4fd2-9243-dbcd2aa0c1a6'] response: {'server_uuid': '03df64b9-52d7-4198-9798-5cc39b9723e4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e7801e8-0a68-4ebc-a8f6-619238135a1d', 'code': 200} May 12 15:05:06.836408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-974cb487-742b-4742-910f-844a8560064e req-2ff03196-cefa-48aa-a683-b54f523f9765 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:06.838041 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-974cb487-742b-4742-910f-844a8560064e req-2ff03196-cefa-48aa-a683-b54f523f9765 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 944 time: 0.2450340 May 12 15:05:06.932823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:05:06.952565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d7e09d66-2268-48c4-a658-ef10261e7a46,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:05:06.958809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-196bdcab-696c-422d-afed-e52180961dbd req-b142e697-4481-44cc-b38f-24e8d6e67805 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:06.963725 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-196bdcab-696c-422d-afed-e52180961dbd req-b142e697-4481-44cc-b38f-24e8d6e67805 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 1100 time: 0.0917318 May 12 15:05:06.969884 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-974cb487-742b-4742-910f-844a8560064e req-05ba9008-6751-40c0-943a-cc4daca8bd00 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0847547 May 12 15:05:06.971475 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:07.026625 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-196bdcab-696c-422d-afed-e52180961dbd req-b6b7ed9d-762c-43b4-bbfa-10bf0e23c362 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560424 May 12 15:05:07.070309 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-570625ce-78db-4046-abb3-f35a252bf323 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd8eaf86b-fcbd-4ca9-8430-1ddde3b94626', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'floating_ip_address': '172.25.8.60', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '272668a4-245d-4021-b26c-456bc892016b', 'port_id': 'a29ae148-cc4f-4145-807c-c40065747ab9', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 160, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'mac_address': 'fa:16:3e:d0:dd:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77e209aa-2dd3-4b44-bae4-1bb1f474d43a', 'device_owner': 'compute:tempest-test_az-52089536'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:04:40Z', 'updated_at': '2022-05-12T15:05:04Z', 'revision_number': 1, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:25Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:05:07.074689 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-570625ce-78db-4046-abb3-f35a252bf323 None None] Checking router: 272668a4-245d-4021-b26c-456bc892016b for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:05:07.085794 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-570625ce-78db-4046-abb3-f35a252bf323 None None] Routers {'272668a4-245d-4021-b26c-456bc892016b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:05:07.086686 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-570625ce-78db-4046-abb3-f35a252bf323 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:04:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['272668a4-245d-4021-b26c-456bc892016b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:05:07.194903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10c6b15c-1a1b-46b7-9c3c-ab345a649f0f req-65609182-5c5f-43db-8f75-fe668004b1de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:07.196338 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10c6b15c-1a1b-46b7-9c3c-ab345a649f0f req-65609182-5c5f-43db-8f75-fe668004b1de service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 1120 time: 0.3574033 May 12 15:05:07.269812 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-570625ce-78db-4046-abb3-f35a252bf323 None None] Set router 272668a4-245d-4021-b26c-456bc892016b gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:05:07.341720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Pushing event updated for resources: {'Port': ['ID=d7e09d66-2268-48c4-a658-ef10261e7a46,revision_number=8']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:07.357874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:07.358829 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:07.361033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-df3f8f6b-3601-42bc-8bb9-44b0e2905c9a service neutron] 10.222.0.76 "PUT /v2.0/ports/d7e09d66-2268-48c4-a658-ef10261e7a46 HTTP/1.1" status: 200 len: 1122 time: 2.5275371 May 12 15:05:07.394022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10c6b15c-1a1b-46b7-9c3c-ab345a649f0f req-5faf9645-066b-484e-90cb-ad40dc489332 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1757681 May 12 15:05:07.413664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4150496-6ab8-470b-99d3-48aba59e2584 req-bc33128a-cd7e-4b64-abf2-c39e42a72c30 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:07.415242 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4150496-6ab8-470b-99d3-48aba59e2584 req-bc33128a-cd7e-4b64-abf2-c39e42a72c30 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 949 time: 0.3879097 May 12 15:05:07.427437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-580edb49-48a0-4d85-b8af-fb546bf1f2de req-a518e657-fd0a-4749-8b63-bb2e02861da4 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:07.429315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-580edb49-48a0-4d85-b8af-fb546bf1f2de req-a518e657-fd0a-4749-8b63-bb2e02861da4 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 965 time: 0.2782729 May 12 15:05:07.495906 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4150496-6ab8-470b-99d3-48aba59e2584 req-7305423a-15d3-4560-bfa8-659cacb4442e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655823 May 12 15:05:07.502705 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-580edb49-48a0-4d85-b8af-fb546bf1f2de req-baa3ca3a-49f0-4bb5-b387-02b4507b9f10 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0598135 May 12 15:05:07.548544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['d7e09d66-2268-48c4-a658-ef10261e7a46'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:05:07.640609 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-570625ce-78db-4046-abb3-f35a252bf323 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd8eaf86b-fcbd-4ca9-8430-1ddde3b94626', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'floating_ip_address': '172.25.8.60', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '272668a4-245d-4021-b26c-456bc892016b', 'port_id': 'a29ae148-cc4f-4145-807c-c40065747ab9', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 160, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'mac_address': 'fa:16:3e:d0:dd:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77e209aa-2dd3-4b44-bae4-1bb1f474d43a', 'device_owner': 'compute:tempest-test_az-52089536'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:04:40Z', 'updated_at': '2022-05-12T15:05:04Z', 'revision_number': 1, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:25Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:05:07.648173 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-570625ce-78db-4046-abb3-f35a252bf323 None None] The sync data for ids ['272668a4-245d-4021-b26c-456bc892016b'] in n-d-841483-1 is: [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd8eaf86b-fcbd-4ca9-8430-1ddde3b94626', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'floating_ip_address': '172.25.8.60', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '272668a4-245d-4021-b26c-456bc892016b', 'port_id': 'a29ae148-cc4f-4145-807c-c40065747ab9', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 160, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'mac_address': 'fa:16:3e:d0:dd:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77e209aa-2dd3-4b44-bae4-1bb1f474d43a', 'device_owner': 'compute:tempest-test_az-52089536'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:04:40Z', 'updated_at': '2022-05-12T15:05:04Z', 'revision_number': 1, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:25Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:05:07.767092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0180fcfc-4919-4a29-ba5a-071ca43ca2a2 req-e16ab1c2-afe2-4bbe-8273-d6ee6daabbe8 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:07.768717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0180fcfc-4919-4a29-ba5a-071ca43ca2a2 req-e16ab1c2-afe2-4bbe-8273-d6ee6daabbe8 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 969 time: 0.1264060 May 12 15:05:07.826386 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0180fcfc-4919-4a29-ba5a-071ca43ca2a2 req-e3695aba-9b19-4fef-99ed-42c9722e7074 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450923 May 12 15:05:07.916516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8caf135f-4e77-48ea-87b2-60df0186e40c None None] New status for floating IP d8eaf86b-fcbd-4ca9-8430-1ddde3b94626: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:05:08.040160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406e08df-1ef5-4e6b-b9f0-ebb82107d67f req-a1cf2f0d-6bd3-408a-8270-12046bccbaee tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:08.047447 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-406e08df-1ef5-4e6b-b9f0-ebb82107d67f req-a1cf2f0d-6bd3-408a-8270-12046bccbaee tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=d92d2403-4d50-4d2e-8f63-1d668eb627d5 HTTP/1.1" status: 200 len: 970 time: 0.0973687 May 12 15:05:08.106976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-406e08df-1ef5-4e6b-b9f0-ebb82107d67f req-2e3df440-4a90-4bc2-99b4-e6acdb5d73ef tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585203 May 12 15:05:08.250453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42952) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:08.258747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c067b0d-29b0-496d-8c4e-2e357bce7ca7 req-ce18d06a-01bd-4bb0-a06c-a2fe0f4e1f8f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:08.260255 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c067b0d-29b0-496d-8c4e-2e357bce7ca7 req-ce18d06a-01bd-4bb0-a06c-a2fe0f4e1f8f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 944 time: 0.1522660 May 12 15:05:08.307624 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c067b0d-29b0-496d-8c4e-2e357bce7ca7 req-c4d08697-3d4d-4446-8756-0f8f2998cbe2 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409069 May 12 15:05:08.495749 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:08.503291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '77e209aa-2dd3-4b44-bae4-1bb1f474d43a', 'tag': 'a29ae148-cc4f-4145-807c-c40065747ab9'}, {'name': 'network-changed', 'server_uuid': '65495c97-2a82-4737-a9aa-c3ca1d8ffc86', 'tag': 'd7e09d66-2268-48c4-a658-ef10261e7a46'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:08.519743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:08.525091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Usage tracker for resource:security_group_rule and tenant:842f05371c1c41299c41dfc38a6eb411 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:08.530669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:08.537833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:08.644162 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:08.651331 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:08.714765 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=842f05371c1c41299c41dfc38a6eb411&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4601490 May 12 15:05:08.714765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=269fbd46-e9c1-4f61-802b-18ed449a6496,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:08.715330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42982) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:08.724793 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:08.725139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:08.725804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:08.725804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:08.726102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:08.726417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:08.726891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:08.727359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:08.727679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:08.727991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:08.728321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:08.728608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e1238d0-b5e7-43fd-bf1b-47e55eac1bfa admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:08.776086 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-51ead0a9-33ae-4c9e-8e79-2f547793d007'] response: {'name': 'network-changed', 'server_uuid': '77e209aa-2dd3-4b44-bae4-1bb1f474d43a', 'tag': 'a29ae148-cc4f-4145-807c-c40065747ab9', 'status': 'completed', 'code': 200} May 12 15:05:08.776357 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-51ead0a9-33ae-4c9e-8e79-2f547793d007'] response: {'name': 'network-changed', 'server_uuid': '65495c97-2a82-4737-a9aa-c3ca1d8ffc86', 'tag': 'd7e09d66-2268-48c4-a658-ef10261e7a46', 'status': 'completed', 'code': 200} May 12 15:05:08.916812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-263a9933-120d-480e-b328-aaa9d1a1fe7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:08.918488 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-263a9933-120d-480e-b328-aaa9d1a1fe7b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 1125 time: 0.0849106 May 12 15:05:09.025875 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-149c6419-c7d6-4e2c-a86a-347dfaffef45 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:09.071177 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-149c6419-c7d6-4e2c-a86a-347dfaffef45 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:09.123398 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-d05efeab-8b22-4647-bfdf-16d34e8e1a0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:09.124856 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-d05efeab-8b22-4647-bfdf-16d34e8e1a0e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=38c07c88d2f84b29a9ae8c83558ec74b&device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 1116 time: 0.3421175 May 12 15:05:09.135841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abc4169f-64ba-42bc-96f7-1614e696f56e req-492e5f91-82ee-4ffb-bbca-4de69953dd90 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:09.137311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-abc4169f-64ba-42bc-96f7-1614e696f56e req-492e5f91-82ee-4ffb-bbca-4de69953dd90 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 949 time: 0.3126862 May 12 15:05:09.150636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-7796c62f-af46-43a3-997d-461e83e2fa9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:09.151979 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-7796c62f-af46-43a3-997d-461e83e2fa9e service neutron] 10.222.0.84 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.2206247 May 12 15:05:09.237045 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-6a85029e-b408-47ff-8dea-0cd994fa43cf service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d7e09d66-2268-48c4-a658-ef10261e7a46 HTTP/1.1" status: 200 len: 217 time: 0.0731239 May 12 15:05:09.311675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-ed44acc4-435d-4461-a09d-8d88e8f3889d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:09.313115 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-ed44acc4-435d-4461-a09d-8d88e8f3889d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.0662320 May 12 15:05:09.321820 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-149c6419-c7d6-4e2c-a86a-347dfaffef45 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:09.339300 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-abc4169f-64ba-42bc-96f7-1614e696f56e req-dafbe350-8029-4269-8f50-529331d6cda9 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1796927 May 12 15:05:09.347907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-149c6419-c7d6-4e2c-a86a-347dfaffef45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=269fbd46-e9c1-4f61-802b-18ed449a6496,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:09.372716 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-79410d71-097e-482f-8d4f-274700324855 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0526154 May 12 15:05:09.398909 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-149c6419-c7d6-4e2c-a86a-347dfaffef45 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:09.402758 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-149c6419-c7d6-4e2c-a86a-347dfaffef45 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/269fbd46-e9c1-4f61-802b-18ed449a6496 HTTP/1.1" status: 204 len: 168 time: 0.6835086 May 12 15:05:09.413070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-b13aa7db-b193-4338-aaa4-f0424bcf0cc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:09.414700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-b13aa7db-b193-4338-aaa4-f0424bcf0cc2 service neutron] 10.222.0.76 "GET /v2.0/networks?id=feb95830-c0c2-46c0-bb35-f2f43605e79a HTTP/1.1" status: 200 len: 925 time: 0.2758553 May 12 15:05:09.427431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a26a67-ba41-4caf-a2fe-fdcce8f4fe05 req-985f919a-73bf-4ded-9888-dad2b464e08a tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:09.435143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-91a26a67-ba41-4caf-a2fe-fdcce8f4fe05 req-985f919a-73bf-4ded-9888-dad2b464e08a tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 969 time: 0.2771840 May 12 15:05:09.529663 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-8e0067cf-7d2b-4e7b-bd24-55c79c224480 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1492503 May 12 15:05:09.583601 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-91a26a67-ba41-4caf-a2fe-fdcce8f4fe05 req-4a1880e1-05ec-43ff-b1eb-0b410004e4d9 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1419003 May 12 15:05:09.679768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-f8342f80-6542-4ed0-a002-2a2fc0c8decd service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a29ae148-cc4f-4145-807c-c40065747ab9 HTTP/1.1" status: 200 len: 1020 time: 0.2201626 May 12 15:05:09.743226 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-51c07a73-5789-48c2-b951-bd3e889e9dde service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2040043 May 12 15:05:09.766559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-9b938b6f-00ac-474e-9dec-b1c8926c4e08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:09.768033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-9b938b6f-00ac-474e-9dec-b1c8926c4e08 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c0ac6201-c8b1-43a9-a509-5a4ff4e34282 HTTP/1.1" status: 200 len: 863 time: 0.0684836 May 12 15:05:09.781948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe126f6-8274-4d58-9683-8a32e895998f req-4ebc29da-5f0f-4346-abd4-23190d5c5e0c tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:09.789933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0fe126f6-8274-4d58-9683-8a32e895998f req-4ebc29da-5f0f-4346-abd4-23190d5c5e0c tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 944 time: 0.1513598 May 12 15:05:09.790916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43028) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:09.810717 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef41c3d9-9bb2-4db9-afa8-6cf9ae8ff822 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:09.826499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ef41c3d9-9bb2-4db9-afa8-6cf9ae8ff822 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:09.830939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef41c3d9-9bb2-4db9-afa8-6cf9ae8ff822 admin admin] Usage tracker for resource:security_group_rule and tenant:0f63688a518d4bd4908c3feff246b0ef is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:09.833949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef41c3d9-9bb2-4db9-afa8-6cf9ae8ff822 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:09.840824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ef41c3d9-9bb2-4db9-afa8-6cf9ae8ff822 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:09.913450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0fe126f6-8274-4d58-9683-8a32e895998f req-4fe4d465-1c6e-4aa1-882f-32b8302e37ab tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1224544 May 12 15:05:09.944963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-f5a100c0-22f6-4e24-99af-401b18144e02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:09.946479 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-f5a100c0-22f6-4e24-99af-401b18144e02 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=feb95830-c0c2-46c0-bb35-f2f43605e79a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1543651 May 12 15:05:09.957956 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef41c3d9-9bb2-4db9-afa8-6cf9ae8ff822 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:09.965569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef41c3d9-9bb2-4db9-afa8-6cf9ae8ff822 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:10.065924 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef41c3d9-9bb2-4db9-afa8-6cf9ae8ff822 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a83d73fa-bc43-49a9-8c2c-55634098d5d3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:10.093965 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ef41c3d9-9bb2-4db9-afa8-6cf9ae8ff822 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0f63688a518d4bd4908c3feff246b0ef&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3018682 May 12 15:05:10.094942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43040) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:10.176479 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75a9348d-37ae-4692-83f0-6049a2d0ce43 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:10.206227 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-2626115a-60b8-463f-ad20-501cb06a184b service neutron] 10.222.0.76 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2508943 May 12 15:05:10.219207 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75a9348d-37ae-4692-83f0-6049a2d0ce43 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:10.320828 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75a9348d-37ae-4692-83f0-6049a2d0ce43 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:10.337491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a9348d-37ae-4692-83f0-6049a2d0ce43 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a83d73fa-bc43-49a9-8c2c-55634098d5d3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:10.347209 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75a9348d-37ae-4692-83f0-6049a2d0ce43 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:10.348415 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-75a9348d-37ae-4692-83f0-6049a2d0ce43 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a83d73fa-bc43-49a9-8c2c-55634098d5d3 HTTP/1.1" status: 204 len: 168 time: 0.2523031 May 12 15:05:10.349080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75edd9c0-b6fd-446f-a5ea-e4c4e1898816 req-25991f7c-7ba0-4521-b6e3-689e3a949612 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:10.351014 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75edd9c0-b6fd-446f-a5ea-e4c4e1898816 req-25991f7c-7ba0-4521-b6e3-689e3a949612 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 949 time: 0.2454040 May 12 15:05:10.437072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43060) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:10.480768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09ce6fb7-8938-45ac-b579-1960de6f5b51 req-637b888d-7cba-40b0-9f6e-e463dad5a0fe service neutron] 10.222.0.76 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2669978 May 12 15:05:10.483574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75edd9c0-b6fd-446f-a5ea-e4c4e1898816 req-25f4160d-7422-4a53-b2f9-f09b33114095 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1066852 May 12 15:05:10.546007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1044d223-e71c-4255-a46e-b9fe03b043fa req-26a2478d-f35e-4dd2-9532-642ee1cbf081 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:10.553980 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1044d223-e71c-4255-a46e-b9fe03b043fa req-26a2478d-f35e-4dd2-9532-642ee1cbf081 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 969 time: 0.1364155 May 12 15:05:10.610707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1044d223-e71c-4255-a46e-b9fe03b043fa req-4b20d6e3-1eaa-4e48-9231-db17244efd21 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535598 May 12 15:05:10.746055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c5cc885-7cd9-43f8-a328-923248250a5f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:10.782571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6c5cc885-7cd9-43f8-a328-923248250a5f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:10.788538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6c5cc885-7cd9-43f8-a328-923248250a5f admin admin] Usage tracker for resource:security_group_rule and tenant:1d991d50c5644f379fe6d9d3ebb0bc1d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:10.792566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6c5cc885-7cd9-43f8-a328-923248250a5f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:10.799503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6c5cc885-7cd9-43f8-a328-923248250a5f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:10.927609 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c5cc885-7cd9-43f8-a328-923248250a5f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:10.933331 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c5cc885-7cd9-43f8-a328-923248250a5f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:10.999062 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6c5cc885-7cd9-43f8-a328-923248250a5f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1d991d50c5644f379fe6d9d3ebb0bc1d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5608680 May 12 15:05:11.000083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c5cc885-7cd9-43f8-a328-923248250a5f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b1aba7b-52cc-4b8b-b64b-e29a8a200ffd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:11.002791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43096) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:11.112898 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5729375a-0d73-4c5a-ad29-6f89e38c77c3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:11.181960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d7e09d66-2268-48c4-a658-ef10261e7a46 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:05:11.198180 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5729375a-0d73-4c5a-ad29-6f89e38c77c3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:11.288253 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-445a5e2b-f360-4cfe-b1a8-7f715866e8c2 req-f6428362-4e89-4b33-a57f-c451308efe1d tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:11.289750 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-445a5e2b-f360-4cfe-b1a8-7f715866e8c2 req-f6428362-4e89-4b33-a57f-c451308efe1d tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 944 time: 0.2129838 May 12 15:05:11.302210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bac67d0f-65ee-4f22-b971-47a7350be6c9 req-2241c14a-a63b-4d32-ac59-4224568d6720 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:11.303710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bac67d0f-65ee-4f22-b971-47a7350be6c9 req-2241c14a-a63b-4d32-ac59-4224568d6720 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 969 time: 0.1646421 May 12 15:05:11.326125 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5729375a-0d73-4c5a-ad29-6f89e38c77c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:11.366340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d7e09d66-2268-48c4-a658-ef10261e7a46,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:11.367478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5729375a-0d73-4c5a-ad29-6f89e38c77c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b1aba7b-52cc-4b8b-b64b-e29a8a200ffd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:11.380436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d7e09d66-2268-48c4-a658-ef10261e7a46 has no active binding in host n-h2-841483-1 {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:142}} May 12 15:05:11.393906 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-445a5e2b-f360-4cfe-b1a8-7f715866e8c2 req-30da7d18-2389-4af8-aa72-04e493611e4d tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0891283 May 12 15:05:11.398667 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5729375a-0d73-4c5a-ad29-6f89e38c77c3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:11.399722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5729375a-0d73-4c5a-ad29-6f89e38c77c3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0b1aba7b-52cc-4b8b-b64b-e29a8a200ffd HTTP/1.1" status: 204 len: 168 time: 0.3957396 May 12 15:05:11.412655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bac67d0f-65ee-4f22-b971-47a7350be6c9 req-7b1b046b-afcb-4390-983e-4c262a35303e tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903687 May 12 15:05:11.611529 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:05:11.733680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81966937-4bce-4311-b7e9-34550e24bdec req-bf51e127-7321-4422-bf7e-a526f09b5bd0 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:11.735155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81966937-4bce-4311-b7e9-34550e24bdec req-bf51e127-7321-4422-bf7e-a526f09b5bd0 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 949 time: 0.1141498 May 12 15:05:11.871733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81966937-4bce-4311-b7e9-34550e24bdec req-fc3e1936-9f23-48bc-b26b-fc59d14fb9ae tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1283545 May 12 15:05:11.890838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43148) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:11.907387 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15c97d66-77ae-4b8c-a3df-3f5038840a19 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:11.924180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-15c97d66-77ae-4b8c-a3df-3f5038840a19 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:11.928993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-15c97d66-77ae-4b8c-a3df-3f5038840a19 admin admin] Usage tracker for resource:security_group_rule and tenant:ffe084fdc9204023b9f6d0308e7e6887 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:11.932332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-15c97d66-77ae-4b8c-a3df-3f5038840a19 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:11.938664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-15c97d66-77ae-4b8c-a3df-3f5038840a19 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:12.078824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43156) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:12.083150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b850e4ce-7ca8-4e00-8e95-7e7654fb9cec req-14a2952b-5251-4e8c-9e3b-e88e989760a4 tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:12.084953 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b850e4ce-7ca8-4e00-8e95-7e7654fb9cec req-14a2952b-5251-4e8c-9e3b-e88e989760a4 tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 1100 time: 0.0973644 May 12 15:05:12.086087 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15c97d66-77ae-4b8c-a3df-3f5038840a19 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:12.105828 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15c97d66-77ae-4b8c-a3df-3f5038840a19 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:12.110473 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b850e4ce-7ca8-4e00-8e95-7e7654fb9cec req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:12.132295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-b850e4ce-7ca8-4e00-8e95-7e7654fb9cec req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:12.137607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b850e4ce-7ca8-4e00-8e95-7e7654fb9cec req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Usage tracker for resource:security_group_rule and tenant:692517ad57b7435cb835a47251b3e242 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:12.141929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b850e4ce-7ca8-4e00-8e95-7e7654fb9cec req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:12.151127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-b850e4ce-7ca8-4e00-8e95-7e7654fb9cec req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:12.178485 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-15c97d66-77ae-4b8c-a3df-3f5038840a19 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ffe084fdc9204023b9f6d0308e7e6887&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2941592 May 12 15:05:12.182230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43168) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:12.201427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15c97d66-77ae-4b8c-a3df-3f5038840a19 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56453d44-7b0b-4cf8-9680-e37fccc7411d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:12.282374 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b850e4ce-7ca8-4e00-8e95-7e7654fb9cec req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:12.293198 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b850e4ce-7ca8-4e00-8e95-7e7654fb9cec req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:12.298055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4059669f-1332-473d-a185-48f24951f96a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:12.336582 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4059669f-1332-473d-a185-48f24951f96a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:12.388635 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b850e4ce-7ca8-4e00-8e95-7e7654fb9cec req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2974858 May 12 15:05:12.448083 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4059669f-1332-473d-a185-48f24951f96a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:12.454471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d9fcd40-351e-433c-b4eb-8698528f7b91,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:12.476693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:12.477032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:12.477468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:12.477801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:12.478123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:12.478494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:12.478815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:12.479192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:12.479607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:12.479915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:12.480229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:12.480588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3696bb-b523-4955-96c9-19f620476eee tempest-LiveMigrationNegativeTest-1673405017 tempest-LiveMigrationNegativeTest-1673405017-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:12.494328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4059669f-1332-473d-a185-48f24951f96a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56453d44-7b0b-4cf8-9680-e37fccc7411d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:12.557268 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f6f8f464-84ba-4c08-834f-85ad98f8059f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=00830df80689431b80f1e5a51c5f6f9e&name=default HTTP/1.1" status: 200 len: 2975 time: 0.4751787 May 12 15:05:12.558297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43196) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:12.563008 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4059669f-1332-473d-a185-48f24951f96a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:12.564065 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4059669f-1332-473d-a185-48f24951f96a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/56453d44-7b0b-4cf8-9680-e37fccc7411d HTTP/1.1" status: 204 len: 168 time: 0.3807762 May 12 15:05:12.614552 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:12.657749 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7664c884-fa3f-4860-a7a0-008b4bdcffc1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:12.778616 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acce1ce8-4cc3-41f4-86ac-50057cc10638 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:12.822151 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acce1ce8-4cc3-41f4-86ac-50057cc10638 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:12.837759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68c11a5a-b16c-4d0b-946c-971728efa672 req-bf85ac0e-f12e-4bad-8d98-7b095e16fd4f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:12.839239 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-68c11a5a-b16c-4d0b-946c-971728efa672 req-bf85ac0e-f12e-4bad-8d98-7b095e16fd4f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 944 time: 0.2468309 May 12 15:05:12.849519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aff68a2f-14e8-4f19-8e6f-5eb719ca5b06 req-8c45fb0f-03af-4a43-a709-ed25feb4bbd7 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:12.852059 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aff68a2f-14e8-4f19-8e6f-5eb719ca5b06 req-8c45fb0f-03af-4a43-a709-ed25feb4bbd7 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 969 time: 0.1868553 May 12 15:05:12.958139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-68c11a5a-b16c-4d0b-946c-971728efa672 req-76458440-391d-48da-abbf-af724fec4328 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1050425 May 12 15:05:12.981371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aff68a2f-14e8-4f19-8e6f-5eb719ca5b06 req-edcab35b-9dd3-4549-a47c-a2201450f9fd tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/security-groups?id=738764da-625f-4d95-abf9-0b874356716f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1036890 May 12 15:05:12.987967 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acce1ce8-4cc3-41f4-86ac-50057cc10638 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:13.016534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acce1ce8-4cc3-41f4-86ac-50057cc10638 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=523e81ba-8739-440a-b9d0-888a323ce6a0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:13.043839 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acce1ce8-4cc3-41f4-86ac-50057cc10638 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:13.046695 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-acce1ce8-4cc3-41f4-86ac-50057cc10638 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/523e81ba-8739-440a-b9d0-888a323ce6a0 HTTP/1.1" status: 204 len: 168 time: 0.4856992 May 12 15:05:13.188800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:05:13.258879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb7435c8-2877-4927-b289-678540be91c1 req-2fb7cf99-ad61-4bc8-bbc3-2d39390754ad tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:13.260565 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb7435c8-2877-4927-b289-678540be91c1 req-2fb7cf99-ad61-4bc8-bbc3-2d39390754ad tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.76 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 969 time: 0.1954207 May 12 15:05:13.371656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-bb7435c8-2877-4927-b289-678540be91c1 req-408e859e-d8c0-4d7e-8c77-d4b6f89ec6a6 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Deleting port c794c37e-a152-4438-9c99-8bdaeaf7525f {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:05:13.371656 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bb7435c8-2877-4927-b289-678540be91c1 req-408e859e-d8c0-4d7e-8c77-d4b6f89ec6a6 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:13.492717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:13.514207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1', 'mac_address': 'fa:16:3e:f6:2c:94', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.202'}], 'device_owner': 'compute:tempest-test_az-52089536', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:05:13.590166 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:13.612632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:05:13.641614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:13.661351 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:13.834663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['1eade7b6-fd9d-4292-b6d7-67f0ba8285d1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:05:13.855327 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43248) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:14.000445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-bb7435c8-2877-4927-b289-678540be91c1 req-408e859e-d8c0-4d7e-8c77-d4b6f89ec6a6 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] For port c794c37e-a152-4438-9c99-8bdaeaf7525f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c794c37e-a152-4438-9c99-8bdaeaf7525f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:14.000894 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bb7435c8-2877-4927-b289-678540be91c1 req-408e859e-d8c0-4d7e-8c77-d4b6f89ec6a6 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:14.024052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:14.128715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:14.129326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:14.129858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:14.130341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:14.131810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:14.132307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:14.132782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:14.133253 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:14.133737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:14.134200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:14.134681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:14.135284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:05:14.284468 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d4fbeb34-5d9d-4ad1-a027-0e47218d98b7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=190d5d4723dd4d19a377b75ca759e170&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4275424 May 12 15:05:14.286925 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-a2df1c14-a3df-4081-b0e5-d6c7c3175768 service neutron] 10.222.0.84 "GET /v2.0/ports/d7e09d66-2268-48c4-a658-ef10261e7a46/bindings/n-h2-841483-1 HTTP/1.1" status: 200 len: 384 time: 0.2751725 May 12 15:05:14.290889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43270) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:14.354976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-bb7435c8-2877-4927-b289-678540be91c1 req-408e859e-d8c0-4d7e-8c77-d4b6f89ec6a6 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Calling delete_port for c794c37e-a152-4438-9c99-8bdaeaf7525f owned by compute:tempest-test_az-52089536 {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:05:14.492136 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23b6de67-6868-4cce-b9b1-3bd13ba796ac admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:14.588516 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23b6de67-6868-4cce-b9b1-3bd13ba796ac admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:14.623214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce8573c0-0ac3-45e9-8cd2-5e3b91cd06d7 req-fc347760-2ec4-4a20-9549-837f6351e9bb tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:14.626874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43282) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:14.630370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce8573c0-0ac3-45e9-8cd2-5e3b91cd06d7 req-fc347760-2ec4-4a20-9549-837f6351e9bb tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 949 time: 0.4302170 May 12 15:05:14.678500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add4ab75-c75f-4451-a698-74518777f5db req-bfdf7923-b211-4ca5-9ee3-7deaa1002baf tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:14.680191 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-add4ab75-c75f-4451-a698-74518777f5db req-bfdf7923-b211-4ca5-9ee3-7deaa1002baf tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 944 time: 0.3335881 May 12 15:05:14.743554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce8573c0-0ac3-45e9-8cd2-5e3b91cd06d7 req-079559c7-b75f-4437-b313-2c69d64cf3a9 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1115172 May 12 15:05:14.771040 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d72a9f06-bd6b-46a8-a9cd-67648c8270fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:14.783652 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23b6de67-6868-4cce-b9b1-3bd13ba796ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:14.805425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-c6407219-476c-4892-ab99-0220efcd37bf service neutron] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d7e09d66-2268-48c4-a658-ef10261e7a46,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:14.819575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23b6de67-6868-4cce-b9b1-3bd13ba796ac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b4f8dfd-dc15-4b3b-b343-a640e4188330,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:14.831861 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23b6de67-6868-4cce-b9b1-3bd13ba796ac admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:14.834502 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-23b6de67-6868-4cce-b9b1-3bd13ba796ac admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1b4f8dfd-dc15-4b3b-b343-a640e4188330 HTTP/1.1" status: 204 len: 168 time: 0.5424888 May 12 15:05:14.846896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-c6407219-476c-4892-ab99-0220efcd37bf service neutron] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:05:14.900387 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-add4ab75-c75f-4451-a698-74518777f5db req-b9eab883-84a4-4e35-b4ce-d3fad17a1ae5 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1737800 May 12 15:05:14.941174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-c6407219-476c-4892-ab99-0220efcd37bf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d7e09d66-2268-48c4-a658-ef10261e7a46 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:05:14.965954 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bb7435c8-2877-4927-b289-678540be91c1 req-408e859e-d8c0-4d7e-8c77-d4b6f89ec6a6 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:15.050434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-c6407219-476c-4892-ab99-0220efcd37bf service neutron] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d7e09d66-2268-48c4-a658-ef10261e7a46,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:15.060516 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4cfed82-1256-446a-8244-19ee742fc123 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:15.097398 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-408e859e-d8c0-4d7e-8c77-d4b6f89ec6a6 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Pushing event deleted for resources: {'Port': ['ID=c794c37e-a152-4438-9c99-8bdaeaf7525f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:15.187857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b4cfed82-1256-446a-8244-19ee742fc123 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:15.190025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:05:15.194395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b4cfed82-1256-446a-8244-19ee742fc123 admin admin] Usage tracker for resource:security_group_rule and tenant:70ec415d2c9c4e04b24123cb75380260 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:15.198355 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-c6407219-476c-4892-ab99-0220efcd37bf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:15.212738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b4cfed82-1256-446a-8244-19ee742fc123 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:15.223036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b4cfed82-1256-446a-8244-19ee742fc123 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:15.405619 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0d56002b-df12-4e47-95f9-a72e8e88363f req-17e00608-9101-4d0a-8989-cfd0e8578c65 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.82 "GET /v2.0/ports?device_id=98f7c3c2-103b-4195-94da-8e6d9b108c1c HTTP/1.1" status: 200 len: 210 time: 0.3092852 May 12 15:05:15.413483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb7435c8-2877-4927-b289-678540be91c1 req-408e859e-d8c0-4d7e-8c77-d4b6f89ec6a6 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] No DVR routers for this DVR port c794c37e-a152-4438-9c99-8bdaeaf7525f on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:05:15.420479 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4cfed82-1256-446a-8244-19ee742fc123 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:15.423765 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bb7435c8-2877-4927-b289-678540be91c1 req-408e859e-d8c0-4d7e-8c77-d4b6f89ec6a6 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:15.433753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98f7c3c2-103b-4195-94da-8e6d9b108c1c', 'name': 'network-vif-deleted', 'tag': 'c794c37e-a152-4438-9c99-8bdaeaf7525f'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:15.440167 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4cfed82-1256-446a-8244-19ee742fc123 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:15.476653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb7435c8-2877-4927-b289-678540be91c1 req-408e859e-d8c0-4d7e-8c77-d4b6f89ec6a6 tempest-DeleteServersAdminTestJSON-953233942 tempest-DeleteServersAdminTestJSON-953233942-project] 10.222.0.76 "DELETE /v2.0/ports/c794c37e-a152-4438-9c99-8bdaeaf7525f HTTP/1.1" status: 204 len: 173 time: 2.1973057 May 12 15:05:15.531439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4cfed82-1256-446a-8244-19ee742fc123 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=184b397b-86ba-472d-bd8c-bf1e8691690d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:15.548391 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:05:15.548839 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:15.581786 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b4cfed82-1256-446a-8244-19ee742fc123 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=70ec415d2c9c4e04b24123cb75380260&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9515536 May 12 15:05:15.582162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43308) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:15.667587 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-adc1c356-7525-4e3e-986a-ec7d356866fb'] response: {'server_uuid': '98f7c3c2-103b-4195-94da-8e6d9b108c1c', 'name': 'network-vif-deleted', 'tag': 'c794c37e-a152-4438-9c99-8bdaeaf7525f', 'status': 'completed', 'code': 200} May 12 15:05:15.684576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-c6407219-476c-4892-ab99-0220efcd37bf service neutron] Transition to ACTIVE for port object d7e09d66-2268-48c4-a658-ef10261e7a46 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:05:15.694840 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-c6407219-476c-4892-ab99-0220efcd37bf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:15.989678 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:16.040597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:16.053990 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:16.059615 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:16.072678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:16.084726 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:16.085603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c794c37e-a152-4438-9c99-8bdaeaf7525f no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:05:16.085842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-c6407219-476c-4892-ab99-0220efcd37bf service neutron] No DVR routers for this DVR port d7e09d66-2268-48c4-a658-ef10261e7a46 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:05:16.262171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6407219-476c-4892-ab99-0220efcd37bf service neutron] Pushing event updated for resources: {'Port': ['ID=d7e09d66-2268-48c4-a658-ef10261e7a46,revision_number=10']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:16.264732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: c794c37e-a152-4438-9c99-8bdaeaf7525f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:05:16.271569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c794c37e-a152-4438-9c99-8bdaeaf7525f not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:05:16.318829 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ea31260-359a-473b-8426-bd1844514d80 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:16.329045 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-c6407219-476c-4892-ab99-0220efcd37bf service neutron] 10.222.0.84 "PUT /v2.0/ports/d7e09d66-2268-48c4-a658-ef10261e7a46/bindings/n-h2-841483-1/activate HTTP/1.1" status: 200 len: 369 time: 2.0329015 May 12 15:05:16.420431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:16.496347 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ea31260-359a-473b-8426-bd1844514d80 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:16.635466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8732b438-e8ce-4dc6-8278-030b454b51ff req-9c58ced6-3d51-40f3-a8c7-fa2115745235 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:16.642334 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8732b438-e8ce-4dc6-8278-030b454b51ff req-9c58ced6-3d51-40f3-a8c7-fa2115745235 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 945 time: 0.4376123 May 12 15:05:16.685995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4065bcd9-315e-4fe3-8a09-b35dd83f4268 req-73996ea4-252e-4b81-98a2-135f18cb8bc3 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:16.689268 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4065bcd9-315e-4fe3-8a09-b35dd83f4268 req-73996ea4-252e-4b81-98a2-135f18cb8bc3 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 949 time: 0.6492817 May 12 15:05:16.703798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1e3cfa-52c4-4c65-b0ee-e5c312ea219f req-0eee7c16-e896-48d8-a7d1-e12f15521983 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:16.705173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df1e3cfa-52c4-4c65-b0ee-e5c312ea219f req-0eee7c16-e896-48d8-a7d1-e12f15521983 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.84 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 949 time: 0.9922619 May 12 15:05:16.820827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43348) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:16.907465 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4065bcd9-315e-4fe3-8a09-b35dd83f4268 req-b01679a0-53eb-4e32-bc81-920f2394b715 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2114127 May 12 15:05:16.914302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-df1e3cfa-52c4-4c65-b0ee-e5c312ea219f req-7a33c0a6-340d-4abe-a0f8-2aae1731768e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Deleting port 0e7801e8-0a68-4ebc-a8f6-619238135a1d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:05:16.917857 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-df1e3cfa-52c4-4c65-b0ee-e5c312ea219f req-7a33c0a6-340d-4abe-a0f8-2aae1731768e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:16.972296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8732b438-e8ce-4dc6-8278-030b454b51ff req-5135bf85-40da-4d32-b6cb-433326f03950 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3287528 May 12 15:05:17.007405 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5ce08d44-52d0-4f10-910c-df3ed24c7ab0'] response: {'server_uuid': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1', 'code': 200} May 12 15:05:17.025586 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ea31260-359a-473b-8426-bd1844514d80 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:17.050827 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-22b8ff6a-1d3a-424e-8595-90395127aa40 tempest-AutoAllocateNetworkTest-695981356 tempest-AutoAllocateNetworkTest-695981356-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=03651d6edcbf4d1aa08074ce170b9b4e&shared=False HTTP/1.1" status: 200 len: 208 time: 0.2286532 May 12 15:05:17.054053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43360) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:17.058754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ea31260-359a-473b-8426-bd1844514d80 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=184b397b-86ba-472d-bd8c-bf1e8691690d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:17.095123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-ce7044be-367f-49ae-b9b1-bcaa93e3ac45 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:17.096958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-ce7044be-367f-49ae-b9b1-bcaa93e3ac45 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86&tenant_id=1b3825228b0e4c42a381540b66ea23d6&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1096 time: 0.5500388 May 12 15:05:17.098319 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ea31260-359a-473b-8426-bd1844514d80 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:17.102946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6ea31260-359a-473b-8426-bd1844514d80 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/184b397b-86ba-472d-bd8c-bf1e8691690d HTTP/1.1" status: 204 len: 168 time: 1.5196753 May 12 15:05:17.389624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-c391b39f-f439-4ca9-a9dd-d341fc81fd65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:17.391569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-c391b39f-f439-4ca9-a9dd-d341fc81fd65 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86&tenant_id=1b3825228b0e4c42a381540b66ea23d6 HTTP/1.1" status: 200 len: 1096 time: 0.2524359 May 12 15:05:17.490662 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:17.529618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b848296b-7745-4a2f-95dd-2267fc63a628 tempest-AutoAllocateNetworkTest-695981356 tempest-AutoAllocateNetworkTest-695981356-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:17.554212 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b848296b-7745-4a2f-95dd-2267fc63a628 tempest-AutoAllocateNetworkTest-695981356 tempest-AutoAllocateNetworkTest-695981356-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 764 time: 0.4934194 May 12 15:05:17.554212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43378) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:17.625609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device d7e09d66-2268-48c4-a658-ef10261e7a46 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:05:17.669728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-df1e3cfa-52c4-4c65-b0ee-e5c312ea219f req-7a33c0a6-340d-4abe-a0f8-2aae1731768e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] For port 0e7801e8-0a68-4ebc-a8f6-619238135a1d, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0e7801e8-0a68-4ebc-a8f6-619238135a1d,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:17.670086 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-df1e3cfa-52c4-4c65-b0ee-e5c312ea219f req-7a33c0a6-340d-4abe-a0f8-2aae1731768e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:17.674190 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ac0dcc53-57fb-4a41-a49b-5107a27d6b66 tempest-AutoAllocateNetworkTest-695981356 tempest-AutoAllocateNetworkTest-695981356-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1192901 May 12 15:05:17.674951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43386) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:17.722737 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-96e4e8e5-4dc1-40a6-934b-ce720748cb9a tempest-AutoAllocateNetworkTest-695981356 tempest-AutoAllocateNetworkTest-695981356-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=03651d6edcbf4d1aa08074ce170b9b4e HTTP/1.1" status: 200 len: 208 time: 0.0462449 May 12 15:05:17.816021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device d7e09d66-2268-48c4-a658-ef10261e7a46 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:05:17.922658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-df1e3cfa-52c4-4c65-b0ee-e5c312ea219f req-7a33c0a6-340d-4abe-a0f8-2aae1731768e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Calling delete_port for 0e7801e8-0a68-4ebc-a8f6-619238135a1d owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:05:17.975206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-8336d3aa-3ad1-41a8-b74b-e8e90ef773b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:17.976782 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-8336d3aa-3ad1-41a8-b74b-e8e90ef773b8 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 1096 time: 0.5409160 May 12 15:05:17.998298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43402) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:18.055656 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c0b4e16-f3af-4158-80d5-97627b00faa7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:18.095673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0c0b4e16-f3af-4158-80d5-97627b00faa7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:18.104688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0c0b4e16-f3af-4158-80d5-97627b00faa7 admin admin] Usage tracker for resource:security_group_rule and tenant:d59238c2fa944d618af358c1cc37ef5c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:18.114270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0c0b4e16-f3af-4158-80d5-97627b00faa7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:18.133077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0c0b4e16-f3af-4158-80d5-97627b00faa7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:18.286259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43414) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:18.355496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-32be2684-1501-4dd3-bb4f-86abb8ab75b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:18.357443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-32be2684-1501-4dd3-bb4f-86abb8ab75b0 service neutron] 10.222.0.76 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.3630500 May 12 15:05:18.399253 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c0b4e16-f3af-4158-80d5-97627b00faa7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:18.412639 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c0b4e16-f3af-4158-80d5-97627b00faa7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:18.508654 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0c0b4e16-f3af-4158-80d5-97627b00faa7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d59238c2fa944d618af358c1cc37ef5c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5092084 May 12 15:05:18.511975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c0b4e16-f3af-4158-80d5-97627b00faa7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f1c306e-f225-40f0-81c6-54d9ba3e7689,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:18.514337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43420) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:18.515017 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a961bce9-5d6b-43f9-a173-17ec6f753b45 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:18.560762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a961bce9-5d6b-43f9-a173-17ec6f753b45 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:18.567240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-fa9ef7b6-1c0d-4366-bdd7-a307699abca8 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d7e09d66-2268-48c4-a658-ef10261e7a46 HTTP/1.1" status: 200 len: 217 time: 0.1529989 May 12 15:05:18.574294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a961bce9-5d6b-43f9-a173-17ec6f753b45 admin admin] Usage tracker for resource:security_group_rule and tenant:03651d6edcbf4d1aa08074ce170b9b4e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:18.579359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a961bce9-5d6b-43f9-a173-17ec6f753b45 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:18.595679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a961bce9-5d6b-43f9-a173-17ec6f753b45 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:18.638314 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07da3fe5-50de-49f3-828d-d30a8b4f41ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:18.684776 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07da3fe5-50de-49f3-828d-d30a8b4f41ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:18.740933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4015560b-bbb5-4404-b9a9-71641a3ea536 req-65bbceb8-3886-4861-ad90-5091932ad94e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:18.748403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4015560b-bbb5-4404-b9a9-71641a3ea536 req-65bbceb8-3886-4861-ad90-5091932ad94e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=03df64b9-52d7-4198-9798-5cc39b9723e4 HTTP/1.1" status: 200 len: 949 time: 0.6601288 May 12 15:05:18.756901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43426) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:18.786557 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a961bce9-5d6b-43f9-a173-17ec6f753b45 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:18.788098 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-df1e3cfa-52c4-4c65-b0ee-e5c312ea219f req-7a33c0a6-340d-4abe-a0f8-2aae1731768e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:18.806887 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a961bce9-5d6b-43f9-a173-17ec6f753b45 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:18.828983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['2630733c-d113-4a35-86d3-c09219afe149'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:05:18.865097 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07da3fe5-50de-49f3-828d-d30a8b4f41ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:18.969101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a33c0a6-340d-4abe-a0f8-2aae1731768e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Pushing event deleted for resources: {'Port': ['ID=0e7801e8-0a68-4ebc-a8f6-619238135a1d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:18.971018 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a961bce9-5d6b-43f9-a173-17ec6f753b45 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=03651d6edcbf4d1aa08074ce170b9b4e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6818643 May 12 15:05:18.981636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43432) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:18.987234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-6f88bc56-bf64-4f7d-91af-8a428f3227e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:18.989109 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-6f88bc56-bf64-4f7d-91af-8a428f3227e0 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.4108458 May 12 15:05:18.990748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-df1e3cfa-52c4-4c65-b0ee-e5c312ea219f req-7a33c0a6-340d-4abe-a0f8-2aae1731768e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] No DVR routers for this DVR port 0e7801e8-0a68-4ebc-a8f6-619238135a1d on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:05:19.004118 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4015560b-bbb5-4404-b9a9-71641a3ea536 req-7517c86b-09d4-43b7-91fa-98acc3ad369a tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2547343 May 12 15:05:19.006427 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-df1e3cfa-52c4-4c65-b0ee-e5c312ea219f req-7a33c0a6-340d-4abe-a0f8-2aae1731768e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:19.024622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '03df64b9-52d7-4198-9798-5cc39b9723e4', 'name': 'network-vif-deleted', 'tag': '0e7801e8-0a68-4ebc-a8f6-619238135a1d'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:19.041078 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df1e3cfa-52c4-4c65-b0ee-e5c312ea219f req-7a33c0a6-340d-4abe-a0f8-2aae1731768e tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.84 "DELETE /v2.0/ports/0e7801e8-0a68-4ebc-a8f6-619238135a1d HTTP/1.1" status: 204 len: 173 time: 2.2762167 May 12 15:05:19.060420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a961bce9-5d6b-43f9-a173-17ec6f753b45 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c04b2d38-8807-4c27-87d2-e0b867e298ad,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:19.126112 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0e0f6112-c099-4ad1-b611-a7596bda60c5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9e8c135aef5e45fbb72a8db523f01319&name=default HTTP/1.1" status: 200 len: 2975 time: 0.3680246 May 12 15:05:19.129325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07da3fe5-50de-49f3-828d-d30a8b4f41ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f1c306e-f225-40f0-81c6-54d9ba3e7689,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:19.134935 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07da3fe5-50de-49f3-828d-d30a8b4f41ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:19.153831 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-07da3fe5-50de-49f3-828d-d30a8b4f41ad admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1f1c306e-f225-40f0-81c6-54d9ba3e7689 HTTP/1.1" status: 204 len: 168 time: 0.6257384 May 12 15:05:19.154885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43438) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:19.201982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a708c0f-207d-46dc-91e0-ea608794ce2c req-5190452f-7326-4979-ac65-964fe81260fd tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:19.218118 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a708c0f-207d-46dc-91e0-ea608794ce2c req-5190452f-7326-4979-ac65-964fe81260fd tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 945 time: 0.9340487 May 12 15:05:19.286591 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-f76415c3-d96a-4736-ad42-26043c7e3ed4 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2815135 May 12 15:05:19.378710 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5906cfeb-4784-46d9-82b3-af7f0eb2a094'] response: {'server_uuid': '03df64b9-52d7-4198-9798-5cc39b9723e4', 'name': 'network-vif-deleted', 'tag': '0e7801e8-0a68-4ebc-a8f6-619238135a1d', 'status': 'completed', 'code': 200} May 12 15:05:19.419466 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46eaffbc-0e0a-41a1-98c0-5251dd3b70b1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:19.465625 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6eb7120e-7b50-4ca3-9e68-746e574b6ecd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:19.468350 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46eaffbc-0e0a-41a1-98c0-5251dd3b70b1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:19.527115 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6eb7120e-7b50-4ca3-9e68-746e574b6ecd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:19.575006 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a708c0f-207d-46dc-91e0-ea608794ce2c req-5e41197e-e547-48a7-bba4-39aea903a610 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3555975 May 12 15:05:19.597273 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46eaffbc-0e0a-41a1-98c0-5251dd3b70b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:19.609808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0e7801e8-0a68-4ebc-a8f6-619238135a1d no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:05:19.635984 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-a49cb07f-3e11-45a9-954c-d7f9811b4695 service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3378336 May 12 15:05:19.643196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46eaffbc-0e0a-41a1-98c0-5251dd3b70b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=738764da-625f-4d95-abf9-0b874356716f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:19.651105 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6eb7120e-7b50-4ca3-9e68-746e574b6ecd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:19.677312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eb7120e-7b50-4ca3-9e68-746e574b6ecd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c04b2d38-8807-4c27-87d2-e0b867e298ad,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:19.731345 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46eaffbc-0e0a-41a1-98c0-5251dd3b70b1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:19.735462 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-46eaffbc-0e0a-41a1-98c0-5251dd3b70b1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/738764da-625f-4d95-abf9-0b874356716f HTTP/1.1" status: 204 len: 168 time: 0.5768178 May 12 15:05:19.743104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 0e7801e8-0a68-4ebc-a8f6-619238135a1d {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:05:19.743322 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6eb7120e-7b50-4ca3-9e68-746e574b6ecd admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:19.743846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0e7801e8-0a68-4ebc-a8f6-619238135a1d not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:05:19.747477 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6eb7120e-7b50-4ca3-9e68-746e574b6ecd admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c04b2d38-8807-4c27-87d2-e0b867e298ad HTTP/1.1" status: 204 len: 168 time: 0.7341511 May 12 15:05:19.935874 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-e22a1b98-e048-4382-8067-8b76bd718b27 service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2912111 May 12 15:05:20.462086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43496) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:20.525468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-361b95d2-60c4-41eb-b374-0a32438ad57a tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:20.527362 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-361b95d2-60c4-41eb-b374-0a32438ad57a tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86&tenant_id=1b3825228b0e4c42a381540b66ea23d6&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 1096 time: 0.2019229 May 12 15:05:20.641232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43512) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:20.686635 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d84901e8-1651-4960-a725-21f6a6ba8253 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:20.747791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d84901e8-1651-4960-a725-21f6a6ba8253 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:20.762467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d84901e8-1651-4960-a725-21f6a6ba8253 admin admin] Usage tracker for resource:security_group_rule and tenant:0c7837ae6909459790d7104cfac2c8bf is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:20.768581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d84901e8-1651-4960-a725-21f6a6ba8253 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:20.793581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d84901e8-1651-4960-a725-21f6a6ba8253 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:20.890103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-c47d307c-ef4f-4e18-8455-713416b50765 service neutron] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:05:20.895473 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-c47d307c-ef4f-4e18-8455-713416b50765 service neutron] Notify callbacks [] for binding, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:20.897603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f30e4aa-6ee3-4fa7-b6c9-3f4828f69afe req-c47d307c-ef4f-4e18-8455-713416b50765 service neutron] 10.222.0.76 "DELETE /v2.0/ports/d7e09d66-2268-48c4-a658-ef10261e7a46/bindings/n-h1-841483-1 HTTP/1.1" status: 204 len: 173 time: 0.3569641 May 12 15:05:20.947499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d7a093d-6f54-452e-a413-609ec9e094cd req-03c2e656-e469-4aa7-8cb9-6ecb0df0719a tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:20.954203 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d7a093d-6f54-452e-a413-609ec9e094cd req-03c2e656-e469-4aa7-8cb9-6ecb0df0719a tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 945 time: 0.1467841 May 12 15:05:20.979954 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc5dcf84-cdb0-4fca-b1e1-c50b9e1e1aa1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:21.047295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dc5dcf84-cdb0-4fca-b1e1-c50b9e1e1aa1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:21.067342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dc5dcf84-cdb0-4fca-b1e1-c50b9e1e1aa1 admin admin] Usage tracker for resource:security_group_rule and tenant:ec9695fec6f148209a800a36f65081f6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:21.086203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dc5dcf84-cdb0-4fca-b1e1-c50b9e1e1aa1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:21.102035 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d7a093d-6f54-452e-a413-609ec9e094cd req-fe806074-c716-41e1-846d-38067492576b tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1245258 May 12 15:05:21.111363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dc5dcf84-cdb0-4fca-b1e1-c50b9e1e1aa1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:21.166642 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4220ba-68d8-4bb9-a550-8df7329f354f req-12761b8f-dec1-49e4-9115-c92d6206e834 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:21.168507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1a4220ba-68d8-4bb9-a550-8df7329f354f req-12761b8f-dec1-49e4-9115-c92d6206e834 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Synchronizing usage tracker for tenant:146fd417ad5d4f85ae5ce85d279642a7 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:05:21.191264 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d84901e8-1651-4960-a725-21f6a6ba8253 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:21.199362 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d84901e8-1651-4960-a725-21f6a6ba8253 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:21.227494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1a4220ba-68d8-4bb9-a550-8df7329f354f req-12761b8f-dec1-49e4-9115-c92d6206e834 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Unset dirty status for tenant:146fd417ad5d4f85ae5ce85d279642a7 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:05:21.229402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4220ba-68d8-4bb9-a550-8df7329f354f req-12761b8f-dec1-49e4-9115-c92d6206e834 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 950 time: 0.2478530 May 12 15:05:21.336501 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4220ba-68d8-4bb9-a550-8df7329f354f req-b7f5ac71-ec5e-4351-96da-b3e8affa3b1c tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0999401 May 12 15:05:21.381214 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d84901e8-1651-4960-a725-21f6a6ba8253 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0c7837ae6909459790d7104cfac2c8bf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7359328 May 12 15:05:21.381952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43538) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:21.435524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d84901e8-1651-4960-a725-21f6a6ba8253 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a851ad2-cf22-4c9f-bb34-adb43ea7db96,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:21.582631 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc5dcf84-cdb0-4fca-b1e1-c50b9e1e1aa1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:21.594517 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc5dcf84-cdb0-4fca-b1e1-c50b9e1e1aa1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:21.647890 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf4456f0-ed41-4b02-8ecd-05f55096fa02 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:21.671083 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dc5dcf84-cdb0-4fca-b1e1-c50b9e1e1aa1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ec9695fec6f148209a800a36f65081f6&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2242539 May 12 15:05:21.672307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43560) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:21.675505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc5dcf84-cdb0-4fca-b1e1-c50b9e1e1aa1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=30f03dc8-1d45-4569-8c3e-b63d72f48579,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:21.735405 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf4456f0-ed41-4b02-8ecd-05f55096fa02 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:21.757551 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a23ef01-d678-42ec-abfd-b79a64720ba4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:21.802315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dec1114-4dc0-40d5-b961-f8b13e07a92e req-175cedf0-17d7-456c-840a-579b93edcd7c tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:21.804953 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a23ef01-d678-42ec-abfd-b79a64720ba4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:21.812633 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4dec1114-4dc0-40d5-b961-f8b13e07a92e req-175cedf0-17d7-456c-840a-579b93edcd7c tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 1096 time: 0.4146879 May 12 15:05:21.918180 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4dec1114-4dc0-40d5-b961-f8b13e07a92e req-2f2c5814-639f-4420-90d5-a7f647a7c824 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0954976 May 12 15:05:21.921970 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a23ef01-d678-42ec-abfd-b79a64720ba4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:21.934027 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf4456f0-ed41-4b02-8ecd-05f55096fa02 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:21.951612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a23ef01-d678-42ec-abfd-b79a64720ba4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=30f03dc8-1d45-4569-8c3e-b63d72f48579,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:21.980661 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a23ef01-d678-42ec-abfd-b79a64720ba4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:21.983651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf4456f0-ed41-4b02-8ecd-05f55096fa02 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a851ad2-cf22-4c9f-bb34-adb43ea7db96,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:21.991821 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf4456f0-ed41-4b02-8ecd-05f55096fa02 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:21.994912 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bf4456f0-ed41-4b02-8ecd-05f55096fa02 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2a851ad2-cf22-4c9f-bb34-adb43ea7db96 HTTP/1.1" status: 204 len: 168 time: 0.6119878 May 12 15:05:21.998047 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4a23ef01-d678-42ec-abfd-b79a64720ba4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/30f03dc8-1d45-4569-8c3e-b63d72f48579 HTTP/1.1" status: 204 len: 168 time: 0.3217559 May 12 15:05:22.646045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1146c1-62b9-4f42-a590-1b31e71a4f03 req-7582d728-11b7-4386-9b63-abc4a2dd39b5 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:22.655084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c1146c1-62b9-4f42-a590-1b31e71a4f03 req-7582d728-11b7-4386-9b63-abc4a2dd39b5 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 950 time: 0.1859376 May 12 15:05:22.666980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caaebffb-c9bb-4e44-9968-20efef9340c5 req-46818b99-ab20-4176-8d2a-5ecf89c4ff22 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:22.668804 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-caaebffb-c9bb-4e44-9968-20efef9340c5 req-46818b99-ab20-4176-8d2a-5ecf89c4ff22 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.84 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 950 time: 0.1509213 May 12 15:05:22.806022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c1146c1-62b9-4f42-a590-1b31e71a4f03 req-523bd4bb-e527-4b04-9479-6168a7d57ed6 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/security-groups?id=ae43b3c7-167d-4164-8e4b-975512174f6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1489255 May 12 15:05:22.901730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43616) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:22.914511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-caaebffb-c9bb-4e44-9968-20efef9340c5 req-31499e34-6466-476b-99d2-b4444ca720ab tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Deleting port 2630733c-d113-4a35-86d3-c09219afe149 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:05:22.914848 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-caaebffb-c9bb-4e44-9968-20efef9340c5 req-31499e34-6466-476b-99d2-b4444ca720ab tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:22.938588 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-502fd393-55cc-4cfd-a483-33ff750a001f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:22.978446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-502fd393-55cc-4cfd-a483-33ff750a001f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:22.985169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-502fd393-55cc-4cfd-a483-33ff750a001f admin admin] Usage tracker for resource:security_group_rule and tenant:a5f7090f9f06421aa50839c3fa4f8214 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:22.989220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-502fd393-55cc-4cfd-a483-33ff750a001f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:22.995866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-502fd393-55cc-4cfd-a483-33ff750a001f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:23.167307 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-502fd393-55cc-4cfd-a483-33ff750a001f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:23.173629 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-502fd393-55cc-4cfd-a483-33ff750a001f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:23.190983 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-3554d700-bf39-4ec3-ac55-99ac9a439a8d tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:23.197748 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-3554d700-bf39-4ec3-ac55-99ac9a439a8d tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 820 time: 0.4116557 May 12 15:05:23.239701 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-502fd393-55cc-4cfd-a483-33ff750a001f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a5f7090f9f06421aa50839c3fa4f8214&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3361740 May 12 15:05:23.241901 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-c2a22878-c27d-402c-b6b4-25cbc863cc1b tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/quotas/1b3825228b0e4c42a381540b66ea23d6 HTTP/1.1" status: 200 len: 375 time: 0.0424967 May 12 15:05:23.243698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43628) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:23.276038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-502fd393-55cc-4cfd-a483-33ff750a001f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f679237c-0477-44e5-8094-04216755c9cb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:23.346597 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33426785-4632-4960-920c-a6a2da48d612 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:23.404984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33426785-4632-4960-920c-a6a2da48d612 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:23.512683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-caaebffb-c9bb-4e44-9968-20efef9340c5 req-31499e34-6466-476b-99d2-b4444ca720ab tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] For port 2630733c-d113-4a35-86d3-c09219afe149, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2630733c-d113-4a35-86d3-c09219afe149,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:23.512951 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-caaebffb-c9bb-4e44-9968-20efef9340c5 req-31499e34-6466-476b-99d2-b4444ca720ab tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:23.534347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-7163db06-04a0-4997-8611-3b1a4fd67126 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2919662 May 12 15:05:23.598013 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33426785-4632-4960-920c-a6a2da48d612 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:23.623334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33426785-4632-4960-920c-a6a2da48d612 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f679237c-0477-44e5-8094-04216755c9cb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:23.633870 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33426785-4632-4960-920c-a6a2da48d612 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:23.635203 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-33426785-4632-4960-920c-a6a2da48d612 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f679237c-0477-44e5-8094-04216755c9cb HTTP/1.1" status: 204 len: 168 time: 0.3833396 May 12 15:05:23.707696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-caaebffb-c9bb-4e44-9968-20efef9340c5 req-31499e34-6466-476b-99d2-b4444ca720ab tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Calling delete_port for 2630733c-d113-4a35-86d3-c09219afe149 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:05:23.945108 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-caaebffb-c9bb-4e44-9968-20efef9340c5 req-31499e34-6466-476b-99d2-b4444ca720ab tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:23.986542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['2630733c-d113-4a35-86d3-c09219afe149'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:05:24.165123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31499e34-6466-476b-99d2-b4444ca720ab tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Pushing event deleted for resources: {'Port': ['ID=2630733c-d113-4a35-86d3-c09219afe149,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:24.187656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-caaebffb-c9bb-4e44-9968-20efef9340c5 req-31499e34-6466-476b-99d2-b4444ca720ab tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] No DVR routers for this DVR port 2630733c-d113-4a35-86d3-c09219afe149 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:05:24.192187 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-98722847-e60b-41ef-904f-ff30fb7b3639 req-d9eda4fd-2fed-4bfe-bfcf-109bf92f9c07 tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.82 "GET /v2.0/ports?device_id=d3d5a7b0-aaee-4e48-9bd4-e2cffa0be595 HTTP/1.1" status: 200 len: 210 time: 0.1687305 May 12 15:05:24.194718 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-caaebffb-c9bb-4e44-9968-20efef9340c5 req-31499e34-6466-476b-99d2-b4444ca720ab tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:24.197744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd3d5a7b0-aaee-4e48-9bd4-e2cffa0be595', 'name': 'network-vif-deleted', 'tag': '2630733c-d113-4a35-86d3-c09219afe149'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:24.218340 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-caaebffb-c9bb-4e44-9968-20efef9340c5 req-31499e34-6466-476b-99d2-b4444ca720ab tempest-LiveMigrationNegativeTest-1343615698 tempest-LiveMigrationNegativeTest-1343615698-project] 10.222.0.84 "DELETE /v2.0/ports/2630733c-d113-4a35-86d3-c09219afe149 HTTP/1.1" status: 204 len: 173 time: 1.5320876 May 12 15:05:24.621354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-b0eae948-a9c1-4116-8dbd-6357f7f9ae51 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:05:24.623630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-b0eae948-a9c1-4116-8dbd-6357f7f9ae51 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.2993224 May 12 15:05:24.836592 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-d3479e14-0d0d-47e1-b7d4-9396363f089b service neutron] 10.222.0.82 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2081470 May 12 15:05:25.074162 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f9605e3e-188c-4431-ad2a-312c9a1b750b'] response: {'server_uuid': 'd3d5a7b0-aaee-4e48-9bd4-e2cffa0be595', 'name': 'network-vif-deleted', 'tag': '2630733c-d113-4a35-86d3-c09219afe149', 'status': 'completed', 'code': 200} May 12 15:05:25.178272 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-c636bd14-f760-4645-aed4-4006ed83b255 service neutron] 10.222.0.82 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3288314 May 12 15:05:25.771807 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77d60b2b-d597-45b6-bd8d-0bbbdc0bb9ae req-8e12cf8a-cbc0-4c08-a305-d75c00eee434 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 210 time: 0.0984597 May 12 15:05:26.218463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43756) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:26.722881 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6db53bb5-3545-4052-ba6d-f2bdf891b836 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:26.760440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6db53bb5-3545-4052-ba6d-f2bdf891b836 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:26.775072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6db53bb5-3545-4052-ba6d-f2bdf891b836 admin admin] Usage tracker for resource:security_group_rule and tenant:734b1427a96849f3bc7ab59a6a109068 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:26.785885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6db53bb5-3545-4052-ba6d-f2bdf891b836 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:26.793579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6db53bb5-3545-4052-ba6d-f2bdf891b836 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:26.882544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43782) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:26.980028 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6db53bb5-3545-4052-ba6d-f2bdf891b836 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:26.989795 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6db53bb5-3545-4052-ba6d-f2bdf891b836 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:27.148522 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e4165eef-bb12-4d25-a964-8fe458f2ab92 req-272fbd9f-12a0-4894-8a3f-4903d29b8872 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 210 time: 0.0997837 May 12 15:05:27.165722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6db53bb5-3545-4052-ba6d-f2bdf891b836 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aec89d39-2fff-4cbc-92f6-312882389cef,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:27.173949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43798) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:27.176873 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6db53bb5-3545-4052-ba6d-f2bdf891b836 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=734b1427a96849f3bc7ab59a6a109068&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9570744 May 12 15:05:27.331624 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d2b547d-f562-4d04-a78a-980e028b68a5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:27.384787 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d2b547d-f562-4d04-a78a-980e028b68a5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:27.493226 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d2b547d-f562-4d04-a78a-980e028b68a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:27.528008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d2b547d-f562-4d04-a78a-980e028b68a5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aec89d39-2fff-4cbc-92f6-312882389cef,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:27.564323 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d2b547d-f562-4d04-a78a-980e028b68a5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:27.573908 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8d2b547d-f562-4d04-a78a-980e028b68a5 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/aec89d39-2fff-4cbc-92f6-312882389cef HTTP/1.1" status: 204 len: 168 time: 0.3985584 May 12 15:05:27.619664 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2630733c-d113-4a35-86d3-c09219afe149 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:05:27.741512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43810) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:27.759729 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 2630733c-d113-4a35-86d3-c09219afe149 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:05:27.760135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2630733c-d113-4a35-86d3-c09219afe149 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:05:27.774421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-82745446-8fef-4315-890d-cbca6c41d5a4 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:27.778639 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-82745446-8fef-4315-890d-cbca6c41d5a4 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.84 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 820 time: 0.4650846 May 12 15:05:27.800054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Request body: {'port': {'device_id': 'e55f7075-e930-469e-9063-1ed463d5a1b9', 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3', 'admin_state_up': True, 'tenant_id': '1b3825228b0e4c42a381540b66ea23d6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:05:27.804794 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-22311821-cb39-4a18-96bd-8c3f4b578865 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=146fd417ad5d4f85ae5ce85d279642a7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9211676 May 12 15:05:27.807190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43820) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:27.957516 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4e0c16c-2191-413b-b35f-c4d7e1876e59 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:27.994198 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4e0c16c-2191-413b-b35f-c4d7e1876e59 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:28.085733 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4e0c16c-2191-413b-b35f-c4d7e1876e59 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:28.145173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4e0c16c-2191-413b-b35f-c4d7e1876e59 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae43b3c7-167d-4164-8e4b-975512174f6f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:28.152667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:28.156633 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4e0c16c-2191-413b-b35f-c4d7e1876e59 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:28.163226 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f4e0c16c-2191-413b-b35f-c4d7e1876e59 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ae43b3c7-167d-4164-8e4b-975512174f6f HTTP/1.1" status: 204 len: 168 time: 0.3533113 May 12 15:05:28.192287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Usage tracker for resource:port and tenant:1b3825228b0e4c42a381540b66ea23d6 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:28.198232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:28.217546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:28.236276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Made reservation on behalf of 1b3825228b0e4c42a381540b66ea23d6 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:05:28.241555 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:28.572378 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db5c5d7a-f3ab-4521-abc4-d6bcb8297edd req-b9c022fa-2b19-46f5-8e42-0a9daffea482 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 210 time: 0.1003952 May 12 15:05:28.590845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36549f01-b1f7-4cbd-a00f-c73a054dc6e0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:28.625812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-36549f01-b1f7-4cbd-a00f-c73a054dc6e0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:28.635612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-36549f01-b1f7-4cbd-a00f-c73a054dc6e0 admin admin] Usage tracker for resource:security_group_rule and tenant:1a7cd82c3db74b13a5149706bc15b882 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:28.641034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-36549f01-b1f7-4cbd-a00f-c73a054dc6e0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:28.652418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-36549f01-b1f7-4cbd-a00f-c73a054dc6e0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:28.701186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43846) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:28.734159 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9e24d23a-2954-4df0-befc-01f980f3292d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:28.751614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Allocated IP 172.20.0.6 (95dd1383-efe7-494d-a1ab-57e293da83a3/bc8f64ab-e415-4d25-919a-8e712e76a5f6/41e26787-6db6-4aed-9809-d91a746dcee9) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:05:28.759719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9e24d23a-2954-4df0-befc-01f980f3292d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:28.765827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9e24d23a-2954-4df0-befc-01f980f3292d admin admin] Usage tracker for resource:security_group_rule and tenant:6eab87beffef4bf3a6f2fee11d194fc3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:28.770089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9e24d23a-2954-4df0-befc-01f980f3292d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:28.781154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9e24d23a-2954-4df0-befc-01f980f3292d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:28.988950 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9e24d23a-2954-4df0-befc-01f980f3292d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.007279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9e24d23a-2954-4df0-befc-01f980f3292d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.091871 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36549f01-b1f7-4cbd-a00f-c73a054dc6e0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.101927 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36549f01-b1f7-4cbd-a00f-c73a054dc6e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.149119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e24d23a-2954-4df0-befc-01f980f3292d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=089cc652-4f39-4e68-87c8-5dc5c0e94126,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:29.202069 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9e24d23a-2954-4df0-befc-01f980f3292d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6eab87beffef4bf3a6f2fee11d194fc3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4973922 May 12 15:05:29.202436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43864) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:29.260277 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-36549f01-b1f7-4cbd-a00f-c73a054dc6e0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1a7cd82c3db74b13a5149706bc15b882&name=default HTTP/1.1" status: 200 len: 2979 time: 1.5174983 May 12 15:05:29.276192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43872) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:29.281753 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.297970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36549f01-b1f7-4cbd-a00f-c73a054dc6e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e47b9966-b9f4-45b3-96d8-61ba884da117,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:29.401234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43882) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:29.459819 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.464912 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ef80f88-6966-4594-8d4f-2876b8920e29 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.530964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Network 95dd1383-efe7-494d-a1ab-57e293da83a3 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:05:29.546984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:05:29.562108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:05:29.569714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:29.570371 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.571077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cddf95cb-34c5-4f24-929b-debc44a9ff99 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.577695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ef80f88-6966-4594-8d4f-2876b8920e29 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.613832 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ed8a5f6d-c6b9-4ef0-9395-7ebec4455987 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=692517ad57b7435cb835a47251b3e242&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2059376 May 12 15:05:29.617370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43888) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:29.624074 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8296614 May 12 15:05:29.650493 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cddf95cb-34c5-4f24-929b-debc44a9ff99 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.690268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Request body: {'port': {'device_id': 'e55f7075-e930-469e-9063-1ed463d5a1b9', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:05:29.723326 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ef80f88-6966-4594-8d4f-2876b8920e29 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.761912 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cddf95cb-34c5-4f24-929b-debc44a9ff99 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.777944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58327338-3478-47d4-a0b9-b5decfe1134e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Pushing event updated for resources: {'Port': ['ID=41e26787-6db6-4aed-9809-d91a746dcee9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:29.812345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ef80f88-6966-4594-8d4f-2876b8920e29 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=089cc652-4f39-4e68-87c8-5dc5c0e94126,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:29.814826 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cddf95cb-34c5-4f24-929b-debc44a9ff99 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.815926 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cddf95cb-34c5-4f24-929b-debc44a9ff99 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e47b9966-b9f4-45b3-96d8-61ba884da117 HTTP/1.1" status: 204 len: 168 time: 0.5300281 May 12 15:05:29.823344 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ef80f88-6966-4594-8d4f-2876b8920e29 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:29.826738 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0ef80f88-6966-4594-8d4f-2876b8920e29 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/089cc652-4f39-4e68-87c8-5dc5c0e94126 HTTP/1.1" status: 204 len: 168 time: 0.6211052 May 12 15:05:29.841686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cddf95cb-34c5-4f24-929b-debc44a9ff99 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e47b9966-b9f4-45b3-96d8-61ba884da117,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:29.963903 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:30.145076 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e5d32883-cf74-4db2-830e-fe128c26a3ff admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:30.190817 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e5d32883-cf74-4db2-830e-fe128c26a3ff admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:30.377808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c38f2a6-7515-45d2-88c6-79986d6b9dd2 req-b3e1eee7-ee8e-43c0-8166-47536d89de86 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:30.379013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4c38f2a6-7515-45d2-88c6-79986d6b9dd2 req-b3e1eee7-ee8e-43c0-8166-47536d89de86 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Synchronizing usage tracker for tenant:1b3825228b0e4c42a381540b66ea23d6 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:05:30.436347 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e5d32883-cf74-4db2-830e-fe128c26a3ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:30.467182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5d32883-cf74-4db2-830e-fe128c26a3ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d9fcd40-351e-433c-b4eb-8698528f7b91,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:30.475862 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e5d32883-cf74-4db2-830e-fe128c26a3ff admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:30.476830 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e5d32883-cf74-4db2-830e-fe128c26a3ff admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9d9fcd40-351e-433c-b4eb-8698528f7b91 HTTP/1.1" status: 204 len: 168 time: 0.8587599 May 12 15:05:30.493523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4c38f2a6-7515-45d2-88c6-79986d6b9dd2 req-b3e1eee7-ee8e-43c0-8166-47536d89de86 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Unset dirty status for tenant:1b3825228b0e4c42a381540b66ea23d6 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:05:30.494731 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c38f2a6-7515-45d2-88c6-79986d6b9dd2 req-b3e1eee7-ee8e-43c0-8166-47536d89de86 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 931 time: 0.7060533 May 12 15:05:30.561780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43910) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:30.589730 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fa281a0f-937a-4452-8df2-4116c7423e8b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:30.633780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fa281a0f-937a-4452-8df2-4116c7423e8b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:30.645208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fa281a0f-937a-4452-8df2-4116c7423e8b admin admin] Usage tracker for resource:security_group_rule and tenant:3aff114095f64d8597a0a8b784547253 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:30.656918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fa281a0f-937a-4452-8df2-4116c7423e8b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:30.658331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 41e26787-6db6-4aed-9809-d91a746dcee9 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:05:30.676058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fa281a0f-937a-4452-8df2-4116c7423e8b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:30.690001 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:30.718137 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c38f2a6-7515-45d2-88c6-79986d6b9dd2 req-5a96f9bb-d0c8-476a-b6a2-e6853e5088f9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1840250 May 12 15:05:30.762527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Transition to ACTIVE for port object 41e26787-6db6-4aed-9809-d91a746dcee9 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:05:30.771626 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:30.872285 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fa281a0f-937a-4452-8df2-4116c7423e8b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:30.880348 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fa281a0f-937a-4452-8df2-4116c7423e8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:30.952549 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fa281a0f-937a-4452-8df2-4116c7423e8b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3aff114095f64d8597a0a8b784547253&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3896406 May 12 15:05:30.953940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa281a0f-937a-4452-8df2-4116c7423e8b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c03fe4ef-7822-4c36-b780-677a6c71439e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:30.975484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43930) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:31.067235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Pushing event updated for resources: {'Port': ['ID=41e26787-6db6-4aed-9809-d91a746dcee9,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:31.075697 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba280b0b-be80-4c58-905e-b48a1d6cd3b9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:31.152247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Attempting to bind port 41e26787-6db6-4aed-9809-d91a746dcee9 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:05:31.152866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Attempting to bind port 41e26787-6db6-4aed-9809-d91a746dcee9 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:05:31.153841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Attempting to bind port 41e26787-6db6-4aed-9809-d91a746dcee9 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:05:31.160446 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba280b0b-be80-4c58-905e-b48a1d6cd3b9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:31.163909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Port 41e26787-6db6-4aed-9809-d91a746dcee9 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:05:31.164757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Attempting to bind port 41e26787-6db6-4aed-9809-d91a746dcee9 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:05:31.174144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 5, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:05:31.177830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Checking segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:05:31.178663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Bound using segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:05:31.179550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Bound port: 41e26787-6db6-4aed-9809-d91a746dcee9, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:05:31.182874 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:31.276831 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba280b0b-be80-4c58-905e-b48a1d6cd3b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:31.321263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba280b0b-be80-4c58-905e-b48a1d6cd3b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c03fe4ef-7822-4c36-b780-677a6c71439e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:31.341365 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba280b0b-be80-4c58-905e-b48a1d6cd3b9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:31.352686 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ba280b0b-be80-4c58-905e-b48a1d6cd3b9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c03fe4ef-7822-4c36-b780-677a6c71439e HTTP/1.1" status: 204 len: 168 time: 0.3749011 May 12 15:05:31.420332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:05:31.424287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=41e26787-6db6-4aed-9809-d91a746dcee9,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:05:31.429984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:31.543189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Pushing event updated for resources: {'Port': ['ID=41e26787-6db6-4aed-9809-d91a746dcee9,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:31.553460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:31.554824 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:31.556603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cd3dc424-b1c4-4f8f-979d-30ac95762260 service neutron] 10.222.0.84 "PUT /v2.0/ports/41e26787-6db6-4aed-9809-d91a746dcee9 HTTP/1.1" status: 200 len: 1091 time: 1.8720012 May 12 15:05:31.557240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e55f7075-e930-469e-9063-1ed463d5a1b9', 'tag': '41e26787-6db6-4aed-9809-d91a746dcee9'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:31.623756 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-32d0d326-378e-4efe-94d2-4d48a84e0b03'] response: {'name': 'network-changed', 'server_uuid': 'e55f7075-e930-469e-9063-1ed463d5a1b9', 'tag': '41e26787-6db6-4aed-9809-d91a746dcee9', 'status': 'completed', 'code': 200} May 12 15:05:31.742168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-e8b4de4a-84a2-42b5-be67-7fd1d600f705 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:31.744499 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-e8b4de4a-84a2-42b5-be67-7fd1d600f705 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 1094 time: 0.1086245 May 12 15:05:31.993475 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-096999ee-bca2-485c-8bda-50204faa7139 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=41e26787-6db6-4aed-9809-d91a746dcee9 HTTP/1.1" status: 200 len: 217 time: 0.2293999 May 12 15:05:31.994124 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:32.092406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-d66af904-3584-431c-8d00-7bf8dea867ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:32.093815 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-d66af904-3584-431c-8d00-7bf8dea867ba service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.0903807 May 12 15:05:32.099758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43982) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:32.172415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-266b77b4-464a-472b-88ea-006100b2f4b9 req-7d130202-2849-4dfc-be00-4ddf37954bfa tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:32.173932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-266b77b4-464a-472b-88ea-006100b2f4b9 req-7d130202-2849-4dfc-be00-4ddf37954bfa tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 943 time: 0.2406590 May 12 15:05:32.175941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-05af1f00-da26-4cff-a37b-e92b13e9aa14 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0678592 May 12 15:05:32.342196 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-266b77b4-464a-472b-88ea-006100b2f4b9 req-f924b15e-f339-4e02-9f67-a918e18eaf11 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1600990 May 12 15:05:32.460822 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-3e474363-6cbd-4c51-97b8-e84691cb7272 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2762296 May 12 15:05:32.585692 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-220afada-de03-42c2-980b-7a950807554c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:32.626386 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-220afada-de03-42c2-980b-7a950807554c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:32.643613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-220afada-de03-42c2-980b-7a950807554c admin admin] Usage tracker for resource:security_group_rule and tenant:33f39cff2b38404ea0dcc8c7c0175818 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:32.651543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-220afada-de03-42c2-980b-7a950807554c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:32.663740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-220afada-de03-42c2-980b-7a950807554c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:32.695463 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5baa91-b9c8-4957-a9a0-44f1c6d2240d req-cac01d46-656e-4163-a3e9-b6b1c5c1de63 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2289317 May 12 15:05:32.875875 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-220afada-de03-42c2-980b-7a950807554c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:32.884392 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-220afada-de03-42c2-980b-7a950807554c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:33.028472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4d847a1-0ea8-4b30-929f-f9e4f819d268 req-89d8aca5-9bc3-4577-8951-f1f13f6285ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:33.030568 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4d847a1-0ea8-4b30-929f-f9e4f819d268 req-89d8aca5-9bc3-4577-8951-f1f13f6285ea service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 1094 time: 0.2066329 May 12 15:05:33.056488 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-220afada-de03-42c2-980b-7a950807554c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=33f39cff2b38404ea0dcc8c7c0175818&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9546444 May 12 15:05:33.058861 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44028) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:33.088621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-220afada-de03-42c2-980b-7a950807554c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da0774d6-5c38-4e9c-9631-81c55a071dee,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:33.336404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4d847a1-0ea8-4b30-929f-f9e4f819d268 req-eb29f17b-ba21-40b5-9105-ea7d28e4c5f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:33.337972 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4d847a1-0ea8-4b30-929f-f9e4f819d268 req-eb29f17b-ba21-40b5-9105-ea7d28e4c5f6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.2912009 May 12 15:05:33.425322 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4d847a1-0ea8-4b30-929f-f9e4f819d268 req-bc7c6500-2785-4f24-9e8f-1cf0a9079a1c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=41e26787-6db6-4aed-9809-d91a746dcee9 HTTP/1.1" status: 200 len: 217 time: 0.0788546 May 12 15:05:33.428374 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f6c37942-b788-4036-bd98-e5c908cf6c3c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:33.615425 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f6c37942-b788-4036-bd98-e5c908cf6c3c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:33.648872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4d847a1-0ea8-4b30-929f-f9e4f819d268 req-b21c2ebe-6f07-4f23-b7e7-3e53c4d35187 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:33.650318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4d847a1-0ea8-4b30-929f-f9e4f819d268 req-b21c2ebe-6f07-4f23-b7e7-3e53c4d35187 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.2185998 May 12 15:05:33.756437 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4d847a1-0ea8-4b30-929f-f9e4f819d268 req-66997789-c1a5-44e5-b392-d643c78df0a2 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0863838 May 12 15:05:33.813960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44066) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:33.896289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-689ec206-f996-4100-a10a-d09626e3f8e4 req-363e3750-7649-45d1-871b-2663c2d878d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:33.903752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-689ec206-f996-4100-a10a-d09626e3f8e4 req-363e3750-7649-45d1-871b-2663c2d878d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 943 time: 0.3710256 May 12 15:05:33.924342 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f6c37942-b788-4036-bd98-e5c908cf6c3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:33.981048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6c37942-b788-4036-bd98-e5c908cf6c3c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da0774d6-5c38-4e9c-9631-81c55a071dee,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:34.006358 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f6c37942-b788-4036-bd98-e5c908cf6c3c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:34.009896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f6c37942-b788-4036-bd98-e5c908cf6c3c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/da0774d6-5c38-4e9c-9631-81c55a071dee HTTP/1.1" status: 204 len: 168 time: 0.9477983 May 12 15:05:34.027051 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-689ec206-f996-4100-a10a-d09626e3f8e4 req-566cbeb7-7c97-4572-b816-d664645eeb90 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1212444 May 12 15:05:34.044310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4d847a1-0ea8-4b30-929f-f9e4f819d268 req-f6b11bec-b21b-48c2-9226-40f0f1706a2b service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2789230 May 12 15:05:34.077800 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3352cc21-3842-4b51-9144-3325cb8da59f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:34.096962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3352cc21-3842-4b51-9144-3325cb8da59f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:34.112378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3352cc21-3842-4b51-9144-3325cb8da59f admin admin] Usage tracker for resource:security_group_rule and tenant:a10a1df922fe4dabbe409b76935e8c09 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:34.118370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3352cc21-3842-4b51-9144-3325cb8da59f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:34.125974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3352cc21-3842-4b51-9144-3325cb8da59f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:34.243819 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4d847a1-0ea8-4b30-929f-f9e4f819d268 req-a4bee5c5-8b73-4e9f-85a6-453c12fea9c5 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1936398 May 12 15:05:34.319071 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3352cc21-3842-4b51-9144-3325cb8da59f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:34.332480 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3352cc21-3842-4b51-9144-3325cb8da59f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:34.383787 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3352cc21-3842-4b51-9144-3325cb8da59f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a10a1df922fe4dabbe409b76935e8c09&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5675075 May 12 15:05:34.386483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44094) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:34.400951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3352cc21-3842-4b51-9144-3325cb8da59f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=abcfa224-5ccc-40a6-8ede-b19a80976ed4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:34.466628 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-41a5239d-9efe-4743-b38d-b7623c7b4209 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:34.494532 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-41a5239d-9efe-4743-b38d-b7623c7b4209 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:34.564284 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-41a5239d-9efe-4743-b38d-b7623c7b4209 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:34.712774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a5239d-9efe-4743-b38d-b7623c7b4209 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=abcfa224-5ccc-40a6-8ede-b19a80976ed4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:34.721845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-41a5239d-9efe-4743-b38d-b7623c7b4209 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:34.723555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-41a5239d-9efe-4743-b38d-b7623c7b4209 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/abcfa224-5ccc-40a6-8ede-b19a80976ed4 HTTP/1.1" status: 204 len: 168 time: 0.3359678 May 12 15:05:34.800441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44134) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:34.832271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ccf618b3-eb51-487d-988d-df0b94d6da59 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:34.850406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ccf618b3-eb51-487d-988d-df0b94d6da59 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:34.854991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ccf618b3-eb51-487d-988d-df0b94d6da59 admin admin] Usage tracker for resource:security_group_rule and tenant:24d90255770f40278cbe4156cb09f878 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:34.858753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ccf618b3-eb51-487d-988d-df0b94d6da59 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:34.866097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ccf618b3-eb51-487d-988d-df0b94d6da59 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:34.947274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de1e09b7-4863-41a3-bce8-e60a87138490 req-cb5d21b3-8093-4034-8912-fd6d31d4ecc8 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:34.954955 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de1e09b7-4863-41a3-bce8-e60a87138490 req-cb5d21b3-8093-4034-8912-fd6d31d4ecc8 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=d92d2403-4d50-4d2e-8f63-1d668eb627d5 HTTP/1.1" status: 200 len: 970 time: 0.1250510 May 12 15:05:34.976212 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ccf618b3-eb51-487d-988d-df0b94d6da59 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:34.983724 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ccf618b3-eb51-487d-988d-df0b94d6da59 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:35.017195 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de1e09b7-4863-41a3-bce8-e60a87138490 req-88e07598-57ba-486f-af39-9e0860bf52cb tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0611928 May 12 15:05:35.063491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf618b3-eb51-487d-988d-df0b94d6da59 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd655825-035a-40b3-bedd-9cbc3f292f91,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:35.070350 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ccf618b3-eb51-487d-988d-df0b94d6da59 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=24d90255770f40278cbe4156cb09f878&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2687478 May 12 15:05:35.073208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44146) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:35.152664 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b9d587e-ce3a-4517-88d5-34d398defbf5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:35.187880 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b9d587e-ce3a-4517-88d5-34d398defbf5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:35.313061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0d5e701-807d-4949-b73f-d825b4864a5d req-a8ee7a9a-f6e2-42fc-bacb-60eb78e0e0b5 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:35.314466 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0d5e701-807d-4949-b73f-d825b4864a5d req-a8ee7a9a-f6e2-42fc-bacb-60eb78e0e0b5 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 943 time: 0.1145930 May 12 15:05:35.347604 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b9d587e-ce3a-4517-88d5-34d398defbf5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:35.430998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b9d587e-ce3a-4517-88d5-34d398defbf5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd655825-035a-40b3-bedd-9cbc3f292f91,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:35.437205 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0d5e701-807d-4949-b73f-d825b4864a5d req-68783633-ae8b-495a-8a16-d876dd9ba051 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1153712 May 12 15:05:35.462587 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b9d587e-ce3a-4517-88d5-34d398defbf5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:35.463714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7b9d587e-ce3a-4517-88d5-34d398defbf5 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bd655825-035a-40b3-bedd-9cbc3f292f91 HTTP/1.1" status: 204 len: 168 time: 0.3893285 May 12 15:05:35.516792 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db383bc3-5759-4da0-b322-aeddbc86d660 req-75b1ead6-1d90-45c6-bacc-5af6d2cf5458 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.1432037 May 12 15:05:35.638365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44178) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:35.675439 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60ae5bc2-d8fe-491e-8e12-3f0e821c1cbe admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:35.692460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db383bc3-5759-4da0-b322-aeddbc86d660 req-e84a776a-5365-49c3-8fbc-d50ae0c57c7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:35.696743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 41e26787-6db6-4aed-9809-d91a746dcee9 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:05:35.697335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db383bc3-5759-4da0-b322-aeddbc86d660 req-e84a776a-5365-49c3-8fbc-d50ae0c57c7f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 1096 time: 0.0882401 May 12 15:05:35.714984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-60ae5bc2-d8fe-491e-8e12-3f0e821c1cbe admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:35.720918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-60ae5bc2-d8fe-491e-8e12-3f0e821c1cbe admin admin] Usage tracker for resource:security_group_rule and tenant:d739d3a88ec5481191ca52ded454a751 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:35.725362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-60ae5bc2-d8fe-491e-8e12-3f0e821c1cbe admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:35.733344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-60ae5bc2-d8fe-491e-8e12-3f0e821c1cbe admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:35.832428 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60ae5bc2-d8fe-491e-8e12-3f0e821c1cbe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:35.839271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60ae5bc2-d8fe-491e-8e12-3f0e821c1cbe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:35.912870 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-60ae5bc2-d8fe-491e-8e12-3f0e821c1cbe admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d739d3a88ec5481191ca52ded454a751&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2725673 May 12 15:05:35.913925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60ae5bc2-d8fe-491e-8e12-3f0e821c1cbe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=863485ab-0708-49c3-99e6-d5184c0ff3df,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:35.917267 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44192) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:35.923189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=41e26787-6db6-4aed-9809-d91a746dcee9,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:35.943611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '41e26787-6db6-4aed-9809-d91a746dcee9', 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3', 'port_id': '41e26787-6db6-4aed-9809-d91a746dcee9', 'mac_address': 'fa:16:3e:fd:39:9c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 567, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bc8f64ab-e415-4d25-919a-8e712e76a5f6', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:05:36.002581 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dbeaa087-385e-40a4-8a66-e4e3e546d41d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:36.039037 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:36.040230 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dbeaa087-385e-40a4-8a66-e4e3e546d41d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:36.056924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db383bc3-5759-4da0-b322-aeddbc86d660 req-b2df0a95-cb2c-4859-bd17-d14936b7f114 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:36.058987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db383bc3-5759-4da0-b322-aeddbc86d660 req-b2df0a95-cb2c-4859-bd17-d14936b7f114 service neutron] 10.222.0.76 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.3375983 May 12 15:05:36.065088 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 41e26787-6db6-4aed-9809-d91a746dcee9 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:05:36.088543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=41e26787-6db6-4aed-9809-d91a746dcee9,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:36.095727 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:36.113334 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dbeaa087-385e-40a4-8a66-e4e3e546d41d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:36.151796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbeaa087-385e-40a4-8a66-e4e3e546d41d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=863485ab-0708-49c3-99e6-d5184c0ff3df,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:36.201526 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dbeaa087-385e-40a4-8a66-e4e3e546d41d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:36.202641 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dbeaa087-385e-40a4-8a66-e4e3e546d41d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/863485ab-0708-49c3-99e6-d5184c0ff3df HTTP/1.1" status: 204 len: 168 time: 0.2842815 May 12 15:05:36.216102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=41e26787-6db6-4aed-9809-d91a746dcee9,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:36.225291 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db383bc3-5759-4da0-b322-aeddbc86d660 req-51fc9250-dfc7-4cf6-8257-bd443877ccd4 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d7e09d66-2268-48c4-a658-ef10261e7a46 HTTP/1.1" status: 200 len: 217 time: 0.1588535 May 12 15:05:36.302009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db383bc3-5759-4da0-b322-aeddbc86d660 req-5a2d8426-0cf0-4e02-9a9f-f9395cb1e54d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:36.303457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db383bc3-5759-4da0-b322-aeddbc86d660 req-5a2d8426-0cf0-4e02-9a9f-f9395cb1e54d service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.0721750 May 12 15:05:36.353296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db383bc3-5759-4da0-b322-aeddbc86d660 req-9f4d4e25-d059-47b9-be32-7a4bc423be34 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0414982 May 12 15:05:36.408913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['41e26787-6db6-4aed-9809-d91a746dcee9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:05:36.515012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db383bc3-5759-4da0-b322-aeddbc86d660 req-bf200b02-a897-4ce4-a844-665f1aa6a286 service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1514597 May 12 15:05:36.686935 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db383bc3-5759-4da0-b322-aeddbc86d660 req-16727f6e-6e08-4efd-917b-34ff5fead393 service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1629944 May 12 15:05:36.795459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-560ab96e-d0ae-4220-94bc-229529d71cbc req-eee0ba04-f7dd-4c70-a31a-778f6683442c tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:36.797022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-560ab96e-d0ae-4220-94bc-229529d71cbc req-eee0ba04-f7dd-4c70-a31a-778f6683442c tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 944 time: 0.0860772 May 12 15:05:36.845604 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-560ab96e-d0ae-4220-94bc-229529d71cbc req-2c280109-c34d-476e-9f60-d4190c14f677 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415564 May 12 15:05:37.716360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 41e26787-6db6-4aed-9809-d91a746dcee9 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:05:37.806315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 41e26787-6db6-4aed-9809-d91a746dcee9 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:05:37.812148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 41e26787-6db6-4aed-9809-d91a746dcee9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:05:37.812766 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:37.936050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44288) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:37.969609 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:38.004057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e55f7075-e930-469e-9063-1ed463d5a1b9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '41e26787-6db6-4aed-9809-d91a746dcee9'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:38.017102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=41e26787-6db6-4aed-9809-d91a746dcee9,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:38.023048 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:38.115428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7586f80c-d878-4791-8699-3ca693cb658a req-83ba18f8-31b5-4023-a65e-5e51e04cfc84 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:38.116157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=41e26787-6db6-4aed-9809-d91a746dcee9,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:38.117044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7586f80c-d878-4791-8699-3ca693cb658a req-83ba18f8-31b5-4023-a65e-5e51e04cfc84 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 945 time: 0.1041610 May 12 15:05:38.165723 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7586f80c-d878-4791-8699-3ca693cb658a req-0835eba4-3273-49a5-9bf4-034eb222cb75 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420492 May 12 15:05:38.345759 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ed2b7f71-d22f-446a-9a49-4bdc34ed28df'] response: {'server_uuid': 'e55f7075-e930-469e-9063-1ed463d5a1b9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '41e26787-6db6-4aed-9809-d91a746dcee9', 'code': 200} May 12 15:05:38.457176 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-925d741a-5062-4a91-bf4b-86b4a05562a1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:38.473634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-925d741a-5062-4a91-bf4b-86b4a05562a1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:38.477880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-925d741a-5062-4a91-bf4b-86b4a05562a1 admin admin] Usage tracker for resource:security_group_rule and tenant:86cc3724fc4d4be4ab9d54ff6f558c64 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:38.480898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-925d741a-5062-4a91-bf4b-86b4a05562a1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:38.486613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44316) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:38.491465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-925d741a-5062-4a91-bf4b-86b4a05562a1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:38.558156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a78a62-03a9-4e1e-a59c-9ce6efb278c4 req-fdd7a72f-7f01-4642-afd9-7d63cbc5f89b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:38.560745 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d4a78a62-03a9-4e1e-a59c-9ce6efb278c4 req-fdd7a72f-7f01-4642-afd9-7d63cbc5f89b service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 1096 time: 0.1102858 May 12 15:05:38.601427 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-925d741a-5062-4a91-bf4b-86b4a05562a1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:38.610514 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-925d741a-5062-4a91-bf4b-86b4a05562a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:38.617036 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d4a78a62-03a9-4e1e-a59c-9ce6efb278c4 req-13b08059-dda9-48fd-bc26-fc708d10118b service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455303 May 12 15:05:38.667228 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-925d741a-5062-4a91-bf4b-86b4a05562a1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=86cc3724fc4d4be4ab9d54ff6f558c64&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7275825 May 12 15:05:38.667228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-925d741a-5062-4a91-bf4b-86b4a05562a1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f9c4811-6f5d-4e30-965a-3111a8359ad5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:38.668775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44330) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:38.737089 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d162c9a1-6269-4604-ad18-c76ab6775232 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:38.739268 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c4897de-4753-4fc1-a600-230dfaec1f31 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:38.763046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3c4897de-4753-4fc1-a600-230dfaec1f31 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:38.768995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3c4897de-4753-4fc1-a600-230dfaec1f31 admin admin] Usage tracker for resource:security_group_rule and tenant:fa8289b332784edab6ff7e5f7ca1f004 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:38.772881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3c4897de-4753-4fc1-a600-230dfaec1f31 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:38.779613 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d162c9a1-6269-4604-ad18-c76ab6775232 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:38.783099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3c4897de-4753-4fc1-a600-230dfaec1f31 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:38.859770 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d162c9a1-6269-4604-ad18-c76ab6775232 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:38.881492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d162c9a1-6269-4604-ad18-c76ab6775232 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f9c4811-6f5d-4e30-965a-3111a8359ad5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:38.898984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c4897de-4753-4fc1-a600-230dfaec1f31 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:38.901000 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d162c9a1-6269-4604-ad18-c76ab6775232 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:38.902232 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d162c9a1-6269-4604-ad18-c76ab6775232 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4f9c4811-6f5d-4e30-965a-3111a8359ad5 HTTP/1.1" status: 204 len: 168 time: 0.2321231 May 12 15:05:38.904168 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c4897de-4753-4fc1-a600-230dfaec1f31 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:38.948458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44342) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:38.948711 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3c4897de-4753-4fc1-a600-230dfaec1f31 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=fa8289b332784edab6ff7e5f7ca1f004&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4319179 May 12 15:05:38.977653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c4897de-4753-4fc1-a600-230dfaec1f31 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=79e3708b-f5c0-4a8f-8184-b20f83399a38,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:39.042261 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e260cc1f-94b8-489c-8ceb-4fa001438a94 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:39.115466 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e260cc1f-94b8-489c-8ceb-4fa001438a94 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:39.180437 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc8f94f4-82ff-4f27-a024-a6d30320ae5f req-bd2a6147-ebe0-4d26-92c2-edab0752cdef tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=6f3dae79f0f2479a81657670a1064211&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0428822 May 12 15:05:39.303222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:05:39.480409 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:39.526065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:39.532533 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:39.544885 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e260cc1f-94b8-489c-8ceb-4fa001438a94 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:39.569855 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e260cc1f-94b8-489c-8ceb-4fa001438a94 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:39.573666 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e260cc1f-94b8-489c-8ceb-4fa001438a94 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/79e3708b-f5c0-4a8f-8184-b20f83399a38 HTTP/1.1" status: 204 len: 168 time: 0.6241059 May 12 15:05:39.593810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e260cc1f-94b8-489c-8ceb-4fa001438a94 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=79e3708b-f5c0-4a8f-8184-b20f83399a38,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:39.625885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44384) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:39.656216 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adcf3330-8b6a-42c2-acf3-4e4edc8a0039 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:39.695734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-adcf3330-8b6a-42c2-acf3-4e4edc8a0039 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:39.696251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:39.703851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc8f94f4-82ff-4f27-a024-a6d30320ae5f req-3b6ce2c2-353c-463c-8861-d533f936de8f tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:39.705067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-adcf3330-8b6a-42c2-acf3-4e4edc8a0039 admin admin] Usage tracker for resource:security_group_rule and tenant:685febf84ced44559b97bb4663defac1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:39.709621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-adcf3330-8b6a-42c2-acf3-4e4edc8a0039 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:39.713512 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc8f94f4-82ff-4f27-a024-a6d30320ae5f req-3b6ce2c2-353c-463c-8861-d533f936de8f tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5248868 May 12 15:05:39.723898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-adcf3330-8b6a-42c2-acf3-4e4edc8a0039 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:39.727361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9cb2757-d604-4759-9030-83630018a26c req-a5801da9-af94-45da-a843-c93d811076e2 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:39.735447 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9cb2757-d604-4759-9030-83630018a26c req-a5801da9-af94-45da-a843-c93d811076e2 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 945 time: 0.2598643 May 12 15:05:39.741298 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a49de190-3075-4dff-a67a-fd9f694116cb details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:05:39.881591 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc8f94f4-82ff-4f27-a024-a6d30320ae5f req-b03c87f8-c3a0-4c18-ae47-7cde35c69ccc tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] 10.222.0.82 "GET /v2.0/quotas/6f3dae79f0f2479a81657670a1064211 HTTP/1.1" status: 200 len: 375 time: 0.1168890 May 12 15:05:39.996180 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9cb2757-d604-4759-9030-83630018a26c req-e118da5e-5b31-4086-b5f2-fc5286f9ed8f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2568500 May 12 15:05:39.996849 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc8f94f4-82ff-4f27-a024-a6d30320ae5f req-689e9ba7-9345-4782-9675-144a637e5774 tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6f3dae79f0f2479a81657670a1064211&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1144044 May 12 15:05:40.077096 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adcf3330-8b6a-42c2-acf3-4e4edc8a0039 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:40.084519 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adcf3330-8b6a-42c2-acf3-4e4edc8a0039 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:40.165720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adcf3330-8b6a-42c2-acf3-4e4edc8a0039 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b066404-2d21-49bb-9eaf-feb67ba8d14f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:40.210848 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-adcf3330-8b6a-42c2-acf3-4e4edc8a0039 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=685febf84ced44559b97bb4663defac1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5838947 May 12 15:05:40.213487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44412) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:40.283430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a49de190-3075-4dff-a67a-fd9f694116cb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a49de190-3075-4dff-a67a-fd9f694116cb,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:40.298406 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-905134b0-b83d-4557-8ac2-8be6a020b7af admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:40.321603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'a49de190-3075-4dff-a67a-fd9f694116cb', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'a49de190-3075-4dff-a67a-fd9f694116cb', 'mac_address': 'fa:16:3e:4a:24:21', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.124'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:05:40.338114 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-905134b0-b83d-4557-8ac2-8be6a020b7af admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:40.375165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:40.415109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-905134b0-b83d-4557-8ac2-8be6a020b7af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:40.420054 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:40.434931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-905134b0-b83d-4557-8ac2-8be6a020b7af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b066404-2d21-49bb-9eaf-feb67ba8d14f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:40.443467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id a49de190-3075-4dff-a67a-fd9f694116cb {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:05:40.452904 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-905134b0-b83d-4557-8ac2-8be6a020b7af admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:40.454213 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-905134b0-b83d-4557-8ac2-8be6a020b7af admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6b066404-2d21-49bb-9eaf-feb67ba8d14f HTTP/1.1" status: 204 len: 168 time: 0.2393715 May 12 15:05:40.470251 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bb126860-fa2e-463b-b6d5-f5166b162fc1'] response: {'server_uuid': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1', 'code': 200} May 12 15:05:40.476643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44422) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:40.486357 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a49de190-3075-4dff-a67a-fd9f694116cb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a49de190-3075-4dff-a67a-fd9f694116cb,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:40.493430 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:40.503374 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c95b339-60f8-4aad-affa-dc03f664729a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:40.522202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4c95b339-60f8-4aad-affa-dc03f664729a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:40.528075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4c95b339-60f8-4aad-affa-dc03f664729a admin admin] Usage tracker for resource:security_group_rule and tenant:d59841a406124d9c9e10b5795f7190cb is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:40.533551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4c95b339-60f8-4aad-affa-dc03f664729a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:40.541468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4c95b339-60f8-4aad-affa-dc03f664729a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:40.576159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a49de190-3075-4dff-a67a-fd9f694116cb,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:40.642666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a49de190-3075-4dff-a67a-fd9f694116cb'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:05:40.652176 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c95b339-60f8-4aad-affa-dc03f664729a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:40.659671 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c95b339-60f8-4aad-affa-dc03f664729a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:40.730338 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4c95b339-60f8-4aad-affa-dc03f664729a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d59841a406124d9c9e10b5795f7190cb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2522130 May 12 15:05:40.732027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c95b339-60f8-4aad-affa-dc03f664729a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd5f2e5a-be11-4480-909b-32ef0266487a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:40.733872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44430) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:40.859870 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad446ada-3ce3-4074-a9a4-81154ec5af11 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:40.905886 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad446ada-3ce3-4074-a9a4-81154ec5af11 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:40.980321 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad446ada-3ce3-4074-a9a4-81154ec5af11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:40.998656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad446ada-3ce3-4074-a9a4-81154ec5af11 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd5f2e5a-be11-4480-909b-32ef0266487a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:41.007804 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad446ada-3ce3-4074-a9a4-81154ec5af11 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:41.009084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ad446ada-3ce3-4074-a9a4-81154ec5af11 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cd5f2e5a-be11-4480-909b-32ef0266487a HTTP/1.1" status: 204 len: 168 time: 0.2741530 May 12 15:05:41.508495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dfd9142-9a83-48e5-9349-f454753ccb97 req-b68daac2-7208-4c8f-a48b-19f7dc1ce6ca tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:41.531116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8dfd9142-9a83-48e5-9349-f454753ccb97 req-b68daac2-7208-4c8f-a48b-19f7dc1ce6ca tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 945 time: 0.1398962 May 12 15:05:41.604367 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8dfd9142-9a83-48e5-9349-f454753ccb97 req-bf1cf7b1-c576-43bd-83d9-124972ba5ec5 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721488 May 12 15:05:41.771358 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a49de190-3075-4dff-a67a-fd9f694116cb up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:05:41.892446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port a49de190-3075-4dff-a67a-fd9f694116cb triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:05:41.892601 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:42.102686 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:42.153293 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a49de190-3075-4dff-a67a-fd9f694116cb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a49de190-3075-4dff-a67a-fd9f694116cb,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:42.167342 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:42.335610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a49de190-3075-4dff-a67a-fd9f694116cb,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:42.344836 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10813e26-fa82-4af0-ac05-cd3f92d7e92f req-bf2f8b6f-fcce-4ad2-9f55-82b3f6b2cffb tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:42.348976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10813e26-fa82-4af0-ac05-cd3f92d7e92f req-bf2f8b6f-fcce-4ad2-9f55-82b3f6b2cffb tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 1096 time: 0.1837890 May 12 15:05:42.428785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10813e26-fa82-4af0-ac05-cd3f92d7e92f req-b0d206d2-3f76-48eb-9d3d-916011663076 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0728743 May 12 15:05:42.471681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfc4bc02-d56b-4ef8-8c50-af64aeb1795c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a49de190-3075-4dff-a67a-fd9f694116cb'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:42.601904 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:42.667708 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-db4d5cc1-0776-4423-8f89-a64591150c29 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:42.825105 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-06ff4bac-9a46-4631-bc93-e363c0a69cc5'] response: {'server_uuid': 'dfc4bc02-d56b-4ef8-8c50-af64aeb1795c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a49de190-3075-4dff-a67a-fd9f694116cb', 'code': 200} May 12 15:05:43.007550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592f3fe9-f4f7-485d-83fc-3dca9c4b2efe req-7c14d626-2065-4c4d-8954-c7feec7710e5 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:43.016166 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-592f3fe9-f4f7-485d-83fc-3dca9c4b2efe req-7c14d626-2065-4c4d-8954-c7feec7710e5 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 1096 time: 0.0927553 May 12 15:05:43.111754 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-592f3fe9-f4f7-485d-83fc-3dca9c4b2efe req-2760899a-ee80-43f5-8af2-1efd4dc471b0 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0944839 May 12 15:05:43.878199 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-529bb9bd-9b02-48bd-bee5-117b453f1db5 req-c56b311c-1ba3-4944-a3c0-53814b40b6dc tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=6f3dae79f0f2479a81657670a1064211&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0647156 May 12 15:05:44.190255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44580) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:44.264518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529bb9bd-9b02-48bd-bee5-117b453f1db5 req-4f0e4d04-1ef0-4af1-afaa-540e2fb15005 tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:44.272240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-529bb9bd-9b02-48bd-bee5-117b453f1db5 req-4f0e4d04-1ef0-4af1-afaa-540e2fb15005 tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3857789 May 12 15:05:44.311325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-529bb9bd-9b02-48bd-bee5-117b453f1db5 req-30dd0efc-67c5-4e1b-8da3-748bb6276cd5 tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] 10.222.0.82 "GET /v2.0/quotas/6f3dae79f0f2479a81657670a1064211 HTTP/1.1" status: 200 len: 375 time: 0.0281615 May 12 15:05:44.381288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-529bb9bd-9b02-48bd-bee5-117b453f1db5 req-ab5cc558-1642-4fd4-a883-75a68f11f494 tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6f3dae79f0f2479a81657670a1064211&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0685306 May 12 15:05:44.405532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e090e118-bdaf-4c11-a5c9-648caa04b81a req-786ca3d7-08bf-49fa-b7e9-3f9f070adfbd tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:44.424091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e090e118-bdaf-4c11-a5c9-648caa04b81a req-786ca3d7-08bf-49fa-b7e9-3f9f070adfbd tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 1096 time: 0.2410488 May 12 15:05:44.523170 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e090e118-bdaf-4c11-a5c9-648caa04b81a req-b9320831-260b-49ef-9058-5f322e8e7244 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0970528 May 12 15:05:44.711067 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de789357-22eb-496c-862e-ffc640c17e08 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:44.729469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-de789357-22eb-496c-862e-ffc640c17e08 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:44.734112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-de789357-22eb-496c-862e-ffc640c17e08 admin admin] Usage tracker for resource:security_group_rule and tenant:b3bc0f467a7245d294a31668603350db is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:44.737325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-de789357-22eb-496c-862e-ffc640c17e08 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:44.759409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-de789357-22eb-496c-862e-ffc640c17e08 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:44.762134 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ab4e7665-4ad2-4d90-a075-328b8006a206 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:44.886154 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-2763754d-d589-40bf-be31-7d74e2f3972b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--750292895&fields=id&tenant_id=38c07c88d2f84b29a9ae8c83558ec74b HTTP/1.1" status: 200 len: 267 time: 0.1025014 May 12 15:05:44.920181 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de789357-22eb-496c-862e-ffc640c17e08 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:44.931713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de789357-22eb-496c-862e-ffc640c17e08 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:45.094617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44630) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:45.298689 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-de789357-22eb-496c-862e-ffc640c17e08 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b3bc0f467a7245d294a31668603350db&name=default HTTP/1.1" status: 200 len: 2979 time: 1.1066706 May 12 15:05:45.303374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44638) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:45.380414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d9f9708-a4fd-4026-960f-944f370f561e req-503ff440-ec18-456b-b684-ef2dc84db27b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:45.385332 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-503ff440-ec18-456b-b684-ef2dc84db27b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/networks?id=feb95830-c0c2-46c0-bb35-f2f43605e79a HTTP/1.1" status: 200 len: 824 time: 0.4982347 May 12 15:05:45.412569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-9707511e-268d-493c-a905-b3476512229a tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/quotas/38c07c88d2f84b29a9ae8c83558ec74b HTTP/1.1" status: 200 len: 375 time: 0.0257292 May 12 15:05:45.496262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de789357-22eb-496c-862e-ffc640c17e08 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=05a5f93f-3822-42f3-a577-b1c12d726efa,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:45.543533 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4bdcad24-9798-418b-8af7-5812751245ad admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:45.552527 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b83b87ca-e9dc-40ca-863f-c43f05acb886 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:45.568818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4bdcad24-9798-418b-8af7-5812751245ad admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:45.579274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4bdcad24-9798-418b-8af7-5812751245ad admin admin] Usage tracker for resource:security_group_rule and tenant:9abe37c9f5df457796e768b27fbc59c7 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:45.583843 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b83b87ca-e9dc-40ca-863f-c43f05acb886 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:45.587354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4bdcad24-9798-418b-8af7-5812751245ad admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:45.604902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4bdcad24-9798-418b-8af7-5812751245ad admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:45.653633 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b83b87ca-e9dc-40ca-863f-c43f05acb886 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:45.673810 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-5e4eb235-da75-477c-aa95-29b04c0bdc11 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=38c07c88d2f84b29a9ae8c83558ec74b&fields=id HTTP/1.1" status: 200 len: 394 time: 0.2533281 May 12 15:05:45.676252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b83b87ca-e9dc-40ca-863f-c43f05acb886 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05a5f93f-3822-42f3-a577-b1c12d726efa,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:45.702805 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b83b87ca-e9dc-40ca-863f-c43f05acb886 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:45.707373 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b83b87ca-e9dc-40ca-863f-c43f05acb886 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/05a5f93f-3822-42f3-a577-b1c12d726efa HTTP/1.1" status: 204 len: 168 time: 0.3998532 May 12 15:05:45.848146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-89cea81a-461a-4195-8b8e-0825d86c8896 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:45.851253 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-89cea81a-461a-4195-8b8e-0825d86c8896 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.76 "GET /v2.0/ports?device_id=77e209aa-2dd3-4b44-bae4-1bb1f474d43a HTTP/1.1" status: 200 len: 965 time: 0.5272229 May 12 15:05:45.871558 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-f378fd5c-764c-4ad0-aa01-3424a467145d service neutron] 10.222.0.82 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1967516 May 12 15:05:45.966443 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:46.033018 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:46.071979 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Deleting port a29ae148-cc4f-4145-807c-c40065747ab9 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:05:46.072597 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:46.400019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44674) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:46.425830 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f264891d-e2cb-49f5-a7b3-62a93b193fa0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:46.463442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f264891d-e2cb-49f5-a7b3-62a93b193fa0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:46.471345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f264891d-e2cb-49f5-a7b3-62a93b193fa0 admin admin] Usage tracker for resource:security_group_rule and tenant:de17aa4b6e4d4472b98147c8404af67a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:46.475018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f264891d-e2cb-49f5-a7b3-62a93b193fa0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:46.481780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f264891d-e2cb-49f5-a7b3-62a93b193fa0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:46.574519 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f264891d-e2cb-49f5-a7b3-62a93b193fa0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:46.587259 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f264891d-e2cb-49f5-a7b3-62a93b193fa0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:46.653239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f264891d-e2cb-49f5-a7b3-62a93b193fa0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d1faa51-a179-4faa-8d3a-7125db246e70,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:46.686146 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f264891d-e2cb-49f5-a7b3-62a93b193fa0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=de17aa4b6e4d4472b98147c8404af67a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2799640 May 12 15:05:46.687846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44686) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:46.695068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-e83206cf-f2a5-4ba8-9d49-ec8aa60d327b service neutron] 10.222.0.82 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8224897 May 12 15:05:46.751248 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4bdcad24-9798-418b-8af7-5812751245ad admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:46.769328 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4bdcad24-9798-418b-8af7-5812751245ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:46.816248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bdcad24-9798-418b-8af7-5812751245ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b7e35aab-59df-46d2-897f-e5aead69ce6e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:46.821336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] For port a29ae148-cc4f-4145-807c-c40065747ab9, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a29ae148-cc4f-4145-807c-c40065747ab9,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:46.821719 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:46.938832 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-92abe1b6-7620-417d-a922-af81e4b7e835 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:46.949611 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4bdcad24-9798-418b-8af7-5812751245ad admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9abe37c9f5df457796e768b27fbc59c7&name=default HTTP/1.1" status: 200 len: 2979 time: 1.8563044 May 12 15:05:46.951529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44690) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:47.022125 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-92abe1b6-7620-417d-a922-af81e4b7e835 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:47.125690 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db0041e7-ac26-48bb-b816-53fbf6e3e3e2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:47.242027 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db0041e7-ac26-48bb-b816-53fbf6e3e3e2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:47.330832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-5c2982eb-4589-4a9e-a045-16814f0b67d1 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:05:47.334630 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-5c2982eb-4589-4a9e-a045-16814f0b67d1 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1476779 May 12 15:05:47.417525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a564f0a8-c9dc-4e65-a980-74107c8b688c service neutron] Request body: {'binding': {'host': 'n-h2-841483-1', 'vnic_type': 'normal', 'profile': {}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:05:47.418990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a564f0a8-c9dc-4e65-a980-74107c8b688c service neutron] Unknown quota resources ['binding']. {{(pid=88151) _create /opt/stack/neutron/neutron/api/v2/base.py:495}} May 12 15:05:47.467796 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-92abe1b6-7620-417d-a922-af81e4b7e835 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:47.476122 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:47.478118 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:47.478513 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Floating IP d8eaf86b-fcbd-4ca9-8430-1ddde3b94626 disassociated. External IP: 172.25.8.60, port: a29ae148-cc4f-4145-807c-c40065747ab9. May 12 15:05:47.478861 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Calling delete_port for a29ae148-cc4f-4145-807c-c40065747ab9 owned by compute:tempest-test_az-52089536 {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:05:47.492676 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:47.521591 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db0041e7-ac26-48bb-b816-53fbf6e3e3e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:47.539895 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db0041e7-ac26-48bb-b816-53fbf6e3e3e2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:47.541347 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-db0041e7-ac26-48bb-b816-53fbf6e3e3e2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b7e35aab-59df-46d2-897f-e5aead69ce6e HTTP/1.1" status: 204 len: 168 time: 0.5887351 May 12 15:05:47.542507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92abe1b6-7620-417d-a922-af81e4b7e835 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d1faa51-a179-4faa-8d3a-7125db246e70,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:47.569429 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-92abe1b6-7620-417d-a922-af81e4b7e835 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:47.571078 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-92abe1b6-7620-417d-a922-af81e4b7e835 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8d1faa51-a179-4faa-8d3a-7125db246e70 HTTP/1.1" status: 204 len: 168 time: 0.8819289 May 12 15:05:47.572202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db0041e7-ac26-48bb-b816-53fbf6e3e3e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b7e35aab-59df-46d2-897f-e5aead69ce6e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:47.609595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44728) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:47.820343 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:47.933875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a564f0a8-c9dc-4e65-a980-74107c8b688c service neutron] Attempting to bind port 41e26787-6db6-4aed-9809-d91a746dcee9 on host n-h2-841483-1 for vnic_type normal with profile None {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:05:47.934459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a564f0a8-c9dc-4e65-a980-74107c8b688c service neutron] Attempting to bind port 41e26787-6db6-4aed-9809-d91a746dcee9 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:05:47.936593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a564f0a8-c9dc-4e65-a980-74107c8b688c service neutron] Attempting to bind port 41e26787-6db6-4aed-9809-d91a746dcee9 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:05:47.954307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a564f0a8-c9dc-4e65-a980-74107c8b688c service neutron] Port 41e26787-6db6-4aed-9809-d91a746dcee9 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:05:47.956159 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a564f0a8-c9dc-4e65-a980-74107c8b688c service neutron] Attempting to bind port 41e26787-6db6-4aed-9809-d91a746dcee9 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:05:47.980465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a564f0a8-c9dc-4e65-a980-74107c8b688c service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 5, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:05:47.984127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a564f0a8-c9dc-4e65-a980-74107c8b688c service neutron] Checking segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:05:47.985566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a564f0a8-c9dc-4e65-a980-74107c8b688c service neutron] Bound using segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:05:47.986218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a564f0a8-c9dc-4e65-a980-74107c8b688c service neutron] Bound port: 41e26787-6db6-4aed-9809-d91a746dcee9, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:05:48.057074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a564f0a8-c9dc-4e65-a980-74107c8b688c service neutron] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=41e26787-6db6-4aed-9809-d91a746dcee9,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:05:48.071340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a564f0a8-c9dc-4e65-a980-74107c8b688c service neutron] Notify callbacks [] for binding, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:48.072662 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a564f0a8-c9dc-4e65-a980-74107c8b688c service neutron] 10.222.0.82 "POST /v2.0/ports/41e26787-6db6-4aed-9809-d91a746dcee9/bindings HTTP/1.1" status: 201 len: 389 time: 0.6622016 May 12 15:05:48.104281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Pushing event deleted for resources: {'Port': ['ID=a29ae148-cc4f-4145-807c-c40065747ab9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:48.509004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44744) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:48.538115 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e10ce7a-71cd-44e3-889d-8397e51add62 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:48.563083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8e10ce7a-71cd-44e3-889d-8397e51add62 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:48.569157 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8e10ce7a-71cd-44e3-889d-8397e51add62 admin admin] Usage tracker for resource:security_group_rule and tenant:818268f1ad40407c90680423dc342b9d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:48.572679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8e10ce7a-71cd-44e3-889d-8397e51add62 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:48.580185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8e10ce7a-71cd-44e3-889d-8397e51add62 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:48.612754 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:05:48.697793 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e10ce7a-71cd-44e3-889d-8397e51add62 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:48.709283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e10ce7a-71cd-44e3-889d-8397e51add62 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:48.773077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b2d9a9b-524f-45f8-a456-9fded06bb138 req-89378d3c-4190-4ded-a552-9a09a77eed58 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 210 time: 0.2099066 May 12 15:05:48.820302 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8e10ce7a-71cd-44e3-889d-8397e51add62 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=818268f1ad40407c90680423dc342b9d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3092864 May 12 15:05:48.821231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e10ce7a-71cd-44e3-889d-8397e51add62 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a1669bf2-1609-4c05-b632-9f8bfe08122d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:48.824406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44758) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:48.876483 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e35fa609-f470-4a32-b72c-d7d18a61ec5b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:48.897306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Router 272668a4-245d-4021-b26c-456bc892016b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:05:48.908889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e35fa609-f470-4a32-b72c-d7d18a61ec5b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:48.917155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e35fa609-f470-4a32-b72c-d7d18a61ec5b admin admin] Usage tracker for resource:security_group_rule and tenant:03b34a01580b4bec905ac5d418d3afbc is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:48.920916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e35fa609-f470-4a32-b72c-d7d18a61ec5b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:48.929208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e35fa609-f470-4a32-b72c-d7d18a61ec5b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:48.965663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7640dad6-77ac-4de4-aabf-d4393cb93088 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:49.072744 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7640dad6-77ac-4de4-aabf-d4393cb93088 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:49.081887 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e35fa609-f470-4a32-b72c-d7d18a61ec5b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:49.155057 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e35fa609-f470-4a32-b72c-d7d18a61ec5b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:49.225276 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7640dad6-77ac-4de4-aabf-d4393cb93088 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:49.274656 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7640dad6-77ac-4de4-aabf-d4393cb93088 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:49.276240 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7640dad6-77ac-4de4-aabf-d4393cb93088 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a1669bf2-1609-4c05-b632-9f8bfe08122d HTTP/1.1" status: 204 len: 168 time: 0.4509132 May 12 15:05:49.283900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7640dad6-77ac-4de4-aabf-d4393cb93088 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1669bf2-1609-4c05-b632-9f8bfe08122d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:49.343174 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a29ae148-cc4f-4145-807c-c40065747ab9 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:05:49.442337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: a29ae148-cc4f-4145-807c-c40065747ab9 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:05:49.443901 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a29ae148-cc4f-4145-807c-c40065747ab9 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:05:49.541972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e35fa609-f470-4a32-b72c-d7d18a61ec5b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae523318-6175-4fb1-a90a-ddbf25ac1f2e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:49.845805 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-626b3ee3-6260-4172-a908-28bb9dec7bac req-53f2935f-74c8-4e78-92ba-915ca67f0e6d tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:49.847193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-626b3ee3-6260-4172-a908-28bb9dec7bac req-53f2935f-74c8-4e78-92ba-915ca67f0e6d tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:49.847814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-626b3ee3-6260-4172-a908-28bb9dec7bac req-53f2935f-74c8-4e78-92ba-915ca67f0e6d tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:49.849171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-626b3ee3-6260-4172-a908-28bb9dec7bac req-53f2935f-74c8-4e78-92ba-915ca67f0e6d tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:49.849813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-626b3ee3-6260-4172-a908-28bb9dec7bac req-53f2935f-74c8-4e78-92ba-915ca67f0e6d tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:49.850429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-626b3ee3-6260-4172-a908-28bb9dec7bac req-53f2935f-74c8-4e78-92ba-915ca67f0e6d tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:49.851028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-626b3ee3-6260-4172-a908-28bb9dec7bac req-53f2935f-74c8-4e78-92ba-915ca67f0e6d tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:49.853265 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-626b3ee3-6260-4172-a908-28bb9dec7bac req-53f2935f-74c8-4e78-92ba-915ca67f0e6d tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 5045 time: 1.5377748 May 12 15:05:49.959523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-05ef2476-afc5-421f-a724-6a35852219be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:49.961274 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-05ef2476-afc5-421f-a724-6a35852219be service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 1096 time: 1.3877125 May 12 15:05:49.963579 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e35fa609-f470-4a32-b72c-d7d18a61ec5b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=03b34a01580b4bec905ac5d418d3afbc&name=default HTTP/1.1" status: 200 len: 2979 time: 2.3471274 May 12 15:05:49.966427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44796) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:50.033242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44802) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:50.078939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-309d0e25-ed81-4f60-9c4e-6a4e379abafa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:50.113429 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-309d0e25-ed81-4f60-9c4e-6a4e379abafa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:50.181542 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-309d0e25-ed81-4f60-9c4e-6a4e379abafa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:50.200299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-309d0e25-ed81-4f60-9c4e-6a4e379abafa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae523318-6175-4fb1-a90a-ddbf25ac1f2e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:50.216861 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-309d0e25-ed81-4f60-9c4e-6a4e379abafa admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:50.218412 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-309d0e25-ed81-4f60-9c4e-6a4e379abafa admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ae523318-6175-4fb1-a90a-ddbf25ac1f2e HTTP/1.1" status: 204 len: 168 time: 0.2502813 May 12 15:05:50.394954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Request body: {'network': {'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-network', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:05:50.401743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:50.410431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Usage tracker for resource:network and tenant:ff9b9aa97cf84863aedddc5615398c31 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:50.417532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:50.432171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:50.459081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Made reservation on behalf of ff9b9aa97cf84863aedddc5615398c31 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:05:50.462369 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:50.494422 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:50.503230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72ccfeea-d148-43b1-922e-902ba33a3c36 req-48db1434-ea5d-4a73-a527-15022327edd8 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 210 time: 0.1595359 May 12 15:05:50.531079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d9f9708-a4fd-4026-960f-944f370f561e req-7a07ff28-1107-4462-b925-c802bba7d27b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:50.532897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-7a07ff28-1107-4462-b925-c802bba7d27b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.76 "GET /v2.0/networks?id=feb95830-c0c2-46c0-bb35-f2f43605e79a HTTP/1.1" status: 200 len: 824 time: 1.4482539 May 12 15:05:50.540833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:50.546136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Usage tracker for resource:security_group_rule and tenant:ff9b9aa97cf84863aedddc5615398c31 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:50.549146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:50.558671 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:05:50.566801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:50.572224 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e249fce-1999-4888-abab-dbd0453494cd None None] Sync routers for ids ['272668a4-245d-4021-b26c-456bc892016b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:05:50.591829 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e249fce-1999-4888-abab-dbd0453494cd None None] Routers {'272668a4-245d-4021-b26c-456bc892016b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:05:50.592470 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6e249fce-1999-4888-abab-dbd0453494cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:05:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['272668a4-245d-4021-b26c-456bc892016b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:05:50.774155 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:50.782034 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:50.839917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 559} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:05:50.844720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=45d36a40-692b-464e-ac04-63c4a6e60759,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:50.861147 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:50.861964 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Added segment 49f41745-6217-458f-8fa0-7833e5e7c9df of type vlan for network 4c945198-2daa-4ae0-a8c1-07ee6da52271 May 12 15:05:50.910122 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:50.969049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44828) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:50.977908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-9af57041-e746-4427-955f-5adfb2b48309 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:50.980000 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-9af57041-e746-4427-955f-5adfb2b48309 service neutron] 10.222.0.76 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.8591363 May 12 15:05:50.996187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:50.998934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:51.000071 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:51.005631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2eb489f-f89b-480c-b4ca-c37f118a4ef1 req-7de0db94-cc10-4308-a5c2-bd616ff0e9cc tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:51.014474 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2eb489f-f89b-480c-b4ca-c37f118a4ef1 req-7de0db94-cc10-4308-a5c2-bd616ff0e9cc tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 945 time: 1.1408572 May 12 15:05:51.029737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] No DVR routers for this DVR port a29ae148-cc4f-4145-807c-c40065747ab9 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:05:51.046424 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f8845e7-d72e-48bb-b04e-af4af2f35948 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:51.055667 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6e249fce-1999-4888-abab-dbd0453494cd None None] Set router 272668a4-245d-4021-b26c-456bc892016b gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:05:51.214366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5f8845e7-d72e-48bb-b04e-af4af2f35948 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:51.219047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5f8845e7-d72e-48bb-b04e-af4af2f35948 admin admin] Usage tracker for resource:security_group_rule and tenant:f03d141abc9e457eabda68e3e1870683 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:51.222386 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5f8845e7-d72e-48bb-b04e-af4af2f35948 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:51.230618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5f8845e7-d72e-48bb-b04e-af4af2f35948 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:51.245299 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-91f1efa7-193b-4ce6-892e-b49c223f50e2 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=38c07c88d2f84b29a9ae8c83558ec74b HTTP/1.1" status: 200 len: 379 time: 0.6956072 May 12 15:05:51.248463 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:51.281469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Request body: {'port': {'device_id': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'admin_state_up': True, 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'security_groups': ['bea28a12-4648-49eb-967a-a6cae208864d']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:05:51.331104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '77e209aa-2dd3-4b44-bae4-1bb1f474d43a', 'name': 'network-vif-deleted', 'tag': 'a29ae148-cc4f-4145-807c-c40065747ab9'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:51.344179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-3bd0a066-e674-4d02-ac13-32cb7f88b1e4 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=41e26787-6db6-4aed-9809-d91a746dcee9 HTTP/1.1" status: 200 len: 217 time: 0.3192115 May 12 15:05:51.353579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd15ef0-2f48-4316-be15-1f3a84ff2fa4 req-e4aab750-c575-402b-9cf5-4be43f9cf79c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:51.355069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bd15ef0-2f48-4316-be15-1f3a84ff2fa4 req-e4aab750-c575-402b-9cf5-4be43f9cf79c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b109b727195f4a0286ba8c6b6aa99144&device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 1101 time: 1.2003074 May 12 15:05:51.397088 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f8845e7-d72e-48bb-b04e-af4af2f35948 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:51.403788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] Pushing event updated for resources: {'Network': ['ID=4c945198-2daa-4ae0-a8c1-07ee6da52271,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:51.410490 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d911a2aa-96eb-400d-ba68-4b85407c6867 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.3761332 May 12 15:05:51.413211 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f8845e7-d72e-48bb-b04e-af4af2f35948 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:51.418853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 4c945198-2daa-4ae0-a8c1-07ee6da52271 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:05:51.427960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44838) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:51.452953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Request body: {'subnet': {'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-subnet', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:05:51.492387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:51.572285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Usage tracker for resource:subnet and tenant:ff9b9aa97cf84863aedddc5615398c31 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:51.587872 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-477226c7-3db8-43ee-ad06-040c8dc3835f req-b0673b9f-17ab-4971-a607-2495f7b65af7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.76 "DELETE /v2.0/ports/a29ae148-cc4f-4145-807c-c40065747ab9 HTTP/1.1" status: 204 len: 173 time: 5.7265646 May 12 15:05:51.602528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:51.627241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f8845e7-d72e-48bb-b04e-af4af2f35948 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4718f40b-f81b-4436-b1e0-5c1972e94605,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:51.675382 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5f8845e7-d72e-48bb-b04e-af4af2f35948 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f03d141abc9e457eabda68e3e1870683&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6976790 May 12 15:05:51.678690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:51.691156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44848) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:51.765263 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6e249fce-1999-4888-abab-dbd0453494cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:25Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:05:51.781531 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e249fce-1999-4888-abab-dbd0453494cd None None] Checking router: 272668a4-245d-4021-b26c-456bc892016b for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:05:51.782883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Made reservation on behalf of ff9b9aa97cf84863aedddc5615398c31 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:05:51.789275 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2eb489f-f89b-480c-b4ca-c37f118a4ef1 req-78ecfe17-ee84-436c-9fa4-0d276235eefa tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7738576 May 12 15:05:51.789835 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Notify callbacks [] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:51.829070 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e249fce-1999-4888-abab-dbd0453494cd None None] Routers {'272668a4-245d-4021-b26c-456bc892016b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:05:51.829752 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6e249fce-1999-4888-abab-dbd0453494cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:05:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['272668a4-245d-4021-b26c-456bc892016b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:05:51.941499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-401855ab-3fbd-4965-a737-de137549a772 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:51.947002 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-401855ab-3fbd-4965-a737-de137549a772 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.4781950 May 12 15:05:51.965352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fed9d64-f293-49e1-9e3d-60a74e89fcfe req-4ee60153-0b27-4980-9b4f-8f5a6c810278 tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:51.970884 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8fed9d64-f293-49e1-9e3d-60a74e89fcfe req-4ee60153-0b27-4980-9b4f-8f5a6c810278 tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 886 time: 1.3853664 May 12 15:05:52.119194 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08710f97-3ec2-4e4e-ae16-67df425ad10a req-2301d13e-3901-4c4e-8d64-7123828b9d66 tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=6f3dae79f0f2479a81657670a1064211&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1645842 May 12 15:05:52.169598 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-54d6fedd-80b3-4104-bd3e-dee8f9e55611 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1674984 May 12 15:05:52.179866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:52.189154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Usage tracker for resource:port and tenant:38c07c88d2f84b29a9ae8c83558ec74b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:52.193794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:52.194824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9da3a64-57d2-4f57-aecb-6abedaa64b38 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:52.210679 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6e249fce-1999-4888-abab-dbd0453494cd None None] Set router 272668a4-245d-4021-b26c-456bc892016b gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:05:52.211364 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:52.228879 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0314baba-1187-4d85-bc24-40dd812483a8'] response: {'server_uuid': '77e209aa-2dd3-4b44-bae4-1bb1f474d43a', 'name': 'network-vif-deleted', 'tag': 'a29ae148-cc4f-4145-807c-c40065747ab9', 'status': 'completed', 'code': 200} May 12 15:05:52.334338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Made reservation on behalf of 38c07c88d2f84b29a9ae8c83558ec74b for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:05:52.337555 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:52.375119 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9da3a64-57d2-4f57-aecb-6abedaa64b38 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:52.719016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:52.812083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Pushing event updated for resources: {'Subnet': ['ID=3ef83b9d-c5b9-4653-9e37-725af3b0ea4c,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:52.828431 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9da3a64-57d2-4f57-aecb-6abedaa64b38 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:52.853525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9da3a64-57d2-4f57-aecb-6abedaa64b38 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4718f40b-f81b-4436-b1e0-5c1972e94605,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:52.868330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Checking segment: {'id': '49f41745-6217-458f-8fa0-7833e5e7c9df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:05:52.868688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Network hostable DHCP agents. Network: 4c945198-2daa-4ae0-a8c1-07ee6da52271, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:05:52.882056 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9da3a64-57d2-4f57-aecb-6abedaa64b38 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:52.883183 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d9da3a64-57d2-4f57-aecb-6abedaa64b38 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4718f40b-f81b-4436-b1e0-5c1972e94605 HTTP/1.1" status: 204 len: 168 time: 1.1910765 May 12 15:05:52.898848 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Network 4c945198-2daa-4ae0-a8c1-07ee6da52271 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:05:52.920693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 4c945198-2daa-4ae0-a8c1-07ee6da52271) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:05:52.925010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:52.925713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:52.939796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e01ddc72-c4d2-4bec-bc0d-327441fd977c None None] Network 4c945198-2daa-4ae0-a8c1-07ee6da52271 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:05:52.961963 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ad36a8b9-8a4b-422c-ad5e-a7219f8fcdce admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 1.5223255 May 12 15:05:52.966280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44886) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:52.971470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Request body: {'router': {'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:05:52.983390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:52.993020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Usage tracker for resource:router and tenant:ff9b9aa97cf84863aedddc5615398c31 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:52.997222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:53.014305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:53.038875 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:53.039772 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:53.057295 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6e249fce-1999-4888-abab-dbd0453494cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:25Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:05:53.066519 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e249fce-1999-4888-abab-dbd0453494cd None None] The sync data for ids ['272668a4-245d-4021-b26c-456bc892016b'] in n-d-841483-1 is: [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:25Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:05:53.073840 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:53.492332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8b3135c3-84ab-4186-8a18-0dcdca690c17 req-cac12744-8eb6-4bc3-91a6-e68fed608732 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Synchronizing usage tracker for tenant:38c07c88d2f84b29a9ae8c83558ec74b on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:05:53.503026 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd15ef0-2f48-4316-be15-1f3a84ff2fa4 req-1e63e28f-a75c-4e30-a682-3fe0386fabae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:53.508854 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bd15ef0-2f48-4316-be15-1f3a84ff2fa4 req-1e63e28f-a75c-4e30-a682-3fe0386fabae service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 1.9806926 May 12 15:05:53.725562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Allocated IP 172.20.0.13 (feb95830-c0c2-46c0-bb35-f2f43605e79a/c0ac6201-c8b1-43a9-a509-5a4ff4e34282/adce94a7-30ae-4036-8a49-87df5c50c324) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:05:53.764056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7b916ab-73c7-4686-8da9-1bcad8ce5818 None None] New status for floating IP d8eaf86b-fcbd-4ca9-8430-1ddde3b94626: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:05:53.969451 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:54.052892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bd15ef0-2f48-4316-be15-1f3a84ff2fa4 req-64707f83-9150-4040-b843-e22e1da23e38 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.124&port_id=a49de190-3075-4dff-a67a-fd9f694116cb HTTP/1.1" status: 200 len: 217 time: 0.2042465 May 12 15:05:54.085675 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-4c945198-2daa-4ae0-a8c1-07ee6da52271', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'fixed_ips': [{'subnet_id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:05:54.086492 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:54.122432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-f1e36c71-7f0c-43c2-9fb1-7fb83686b4d2 service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.8906269 May 12 15:05:54.145003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8b3135c3-84ab-4186-8a18-0dcdca690c17 req-cac12744-8eb6-4bc3-91a6-e68fed608732 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Unset dirty status for tenant:38c07c88d2f84b29a9ae8c83558ec74b on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:05:54.160952 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8b3135c3-84ab-4186-8a18-0dcdca690c17 req-cac12744-8eb6-4bc3-91a6-e68fed608732 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 210 time: 0.9585419 May 12 15:05:54.454098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08710f97-3ec2-4e4e-ae16-67df425ad10a req-f1887eb0-503c-44a8-8d03-d36ba12e8569 tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:54.461942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08710f97-3ec2-4e4e-ae16-67df425ad10a req-f1887eb0-503c-44a8-8d03-d36ba12e8569 tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 2.3215430 May 12 15:05:54.551681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd15ef0-2f48-4316-be15-1f3a84ff2fa4 req-a01f0848-2e05-4a66-95ac-782b215526af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:54.553563 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bd15ef0-2f48-4316-be15-1f3a84ff2fa4 req-a01f0848-2e05-4a66-95ac-782b215526af service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.4742329 May 12 15:05:54.565892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08710f97-3ec2-4e4e-ae16-67df425ad10a req-8ee48473-5f70-4be2-b3a6-4da166071624 tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] 10.222.0.82 "GET /v2.0/quotas/6f3dae79f0f2479a81657670a1064211 HTTP/1.1" status: 200 len: 375 time: 0.1030471 May 12 15:05:54.607951 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Allocated IP 172.20.0.2 (4c945198-2daa-4ae0-a8c1-07ee6da52271/3ef83b9d-c5b9-4653-9e37-725af3b0ea4c/dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:05:54.703042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:54.740453 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08710f97-3ec2-4e4e-ae16-67df425ad10a req-968e5b79-e2e2-4da9-aa28-d40113d99077 tempest-QuotasAdminNegativeTest-1770741422 tempest-QuotasAdminNegativeTest-1770741422-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6f3dae79f0f2479a81657670a1064211&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1736794 May 12 15:05:54.743050 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-be7d37f3-feb5-4a16-88e1-a7975cd2edb1 service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5578897 May 12 15:05:54.778651 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:54.819895 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:54.844553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Transition to ACTIVE for port object adce94a7-30ae-4036-8a49-87df5c50c324 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:05:54.975571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e0d449-fa89-4ac4-a325-7ca6a341c258 req-55e9f57d-91c8-41dc-90c5-b46c27c361be tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:54.976300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e0d449-fa89-4ac4-a325-7ca6a341c258 req-55e9f57d-91c8-41dc-90c5-b46c27c361be tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:54.976779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e0d449-fa89-4ac4-a325-7ca6a341c258 req-55e9f57d-91c8-41dc-90c5-b46c27c361be tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:54.979445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e0d449-fa89-4ac4-a325-7ca6a341c258 req-55e9f57d-91c8-41dc-90c5-b46c27c361be tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:54.979918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e0d449-fa89-4ac4-a325-7ca6a341c258 req-55e9f57d-91c8-41dc-90c5-b46c27c361be tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:54.981934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e0d449-fa89-4ac4-a325-7ca6a341c258 req-55e9f57d-91c8-41dc-90c5-b46c27c361be tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:54.982395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e0d449-fa89-4ac4-a325-7ca6a341c258 req-55e9f57d-91c8-41dc-90c5-b46c27c361be tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:54.982988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e0d449-fa89-4ac4-a325-7ca6a341c258 req-55e9f57d-91c8-41dc-90c5-b46c27c361be tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:54.985832 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8e0d449-fa89-4ac4-a325-7ca6a341c258 req-55e9f57d-91c8-41dc-90c5-b46c27c361be tempest-NetworksTest-1469179371 tempest-NetworksTest-1469179371-project-admin] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 5747 time: 0.6960123 May 12 15:05:55.059419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Allocated IP 172.25.8.78 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/0994331e-432f-4c92-94e5-29c9fa287d0a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:05:55.090274 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:55.159400 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:55.189363 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Transition to ACTIVE for port object dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:05:55.275566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Transition to ACTIVE for port object dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:05:55.296634 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:55.334267 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:55.376498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Network feb95830-c0c2-46c0-bb35-f2f43605e79a is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:05:55.412785 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:55.436149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Network 4c945198-2daa-4ae0-a8c1-07ee6da52271 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:05:55.452977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:05:55.464514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:05:55.488567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Pushing event updated for resources: {'Port': ['ID=adce94a7-30ae-4036-8a49-87df5c50c324,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:55.499817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:05:55.529730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:05:55.537557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:55.538469 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:55.572001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:05:55.575854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:05:55.587880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:05:55.600866 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Pushing event updated for resources: {'Port': ['ID=dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:55.629155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a03f4ba4-3654-4124-98b6-632624c4d556 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 4.3826954 May 12 15:05:55.663878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Request body: {'port': {'device_id': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:05:55.743590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Attempting to bind port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:05:55.744049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Attempting to bind port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '49f41745-6217-458f-8fa0-7833e5e7c9df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:05:55.744347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Attempting to bind port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 on network 4c945198-2daa-4ae0-a8c1-07ee6da52271 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:05:55.753288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a807f091-310d-4515-ab77-e6e54a6308b0 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:55.758595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 5, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:05:55.758960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Checking segment: {'id': '49f41745-6217-458f-8fa0-7833e5e7c9df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:05:55.759370 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:55.759742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Bound using segment: {'id': '49f41745-6217-458f-8fa0-7833e5e7c9df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:05:55.760210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Bound port: dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '49f41745-6217-458f-8fa0-7833e5e7c9df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:05:55.760438 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a807f091-310d-4515-ab77-e6e54a6308b0 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9&tenant_id=1b3825228b0e4c42a381540b66ea23d6&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1096 time: 0.7713704 May 12 15:05:55.760551 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:55.779903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h2-841483-1'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:05:55.927753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] For port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:05:55.949993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] For port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832,segment=NetworkSegment(49f41745-6217-458f-8fa0-7833e5e7c9df),segment_id=49f41745-6217-458f-8fa0-7833e5e7c9df)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:05:55.964462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:55.992092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44940) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:56.043917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Pushing event updated for resources: {'Port': ['ID=0994331e-432f-4c92-94e5-29c9fa287d0a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:56.154489 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-576f4023-058b-456d-8858-3f758fa70b5d None None] Pushing event updated for resources: {'Port': ['ID=dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:56.202506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-98a92835-21b7-48d7-9619-27e3312dce54 None None] Provisioning for port adce94a7-30ae-4036-8a49-87df5c50c324 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:05:56.210982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-98a92835-21b7-48d7-9619-27e3312dce54 None None] Provisioning complete for port adce94a7-30ae-4036-8a49-87df5c50c324 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:05:56.211974 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-98a92835-21b7-48d7-9619-27e3312dce54 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:56.290331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd15ef0-2f48-4316-be15-1f3a84ff2fa4 req-495c2ed8-b1d2-4d53-a222-8a1cac1df763 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:56.302816 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bd15ef0-2f48-4316-be15-1f3a84ff2fa4 req-495c2ed8-b1d2-4d53-a222-8a1cac1df763 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 1.7230921 May 12 15:05:56.327893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-98a92835-21b7-48d7-9619-27e3312dce54 None None] Port adce94a7-30ae-4036-8a49-87df5c50c324 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:05:56.427349 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:56.485628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ada5cd8b-dda2-4f93-9b8a-dfea2ae007bc req-4c7a91d7-366c-4fc4-aa97-54bed6cd56d7 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:56.488359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ada5cd8b-dda2-4f93-9b8a-dfea2ae007bc req-4c7a91d7-366c-4fc4-aa97-54bed6cd56d7 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 945 time: 1.0948803 May 12 15:05:56.701257 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3e486c3-6397-494f-960a-9bb0d376d57f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:56.717682 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:56.859717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bd15ef0-2f48-4316-be15-1f3a84ff2fa4 req-1e9017ad-9a80-4c4b-b92f-a0059cfbfab8 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5229845 May 12 15:05:56.873815 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ada5cd8b-dda2-4f93-9b8a-dfea2ae007bc req-d2d1a7b9-39ae-443b-b0ca-aee804a16421 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1711519 May 12 15:05:57.060007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:05:57.250858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:05:57.424366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e3e486c3-6397-494f-960a-9bb0d376d57f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:57.437779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e3e486c3-6397-494f-960a-9bb0d376d57f admin admin] Usage tracker for resource:security_group_rule and tenant:92b6c07e345a4d2e93cfacad28d364d9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:57.468758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e3e486c3-6397-494f-960a-9bb0d376d57f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:57.513668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e3e486c3-6397-494f-960a-9bb0d376d57f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:57.637733 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:57.790772 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:57.853564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44980) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:58.059154 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bd15ef0-2f48-4316-be15-1f3a84ff2fa4 req-1ca7a3ff-2d31-4e8d-8157-cb7c1857625f service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.1844590 May 12 15:05:58.067524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c222b91-c4d0-48c8-957e-8abfae6c105d None None] Network 4c945198-2daa-4ae0-a8c1-07ee6da52271 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:05:58.170924 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3e486c3-6397-494f-960a-9bb0d376d57f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:58.184163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3e486c3-6397-494f-960a-9bb0d376d57f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:58.205638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51d7205c-de3c-432e-b759-1bfb97a4212b req-583589fb-ac60-4d44-b1b0-3c7221fa95a7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:58.225936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-51d7205c-de3c-432e-b759-1bfb97a4212b req-583589fb-ac60-4d44-b1b0-3c7221fa95a7 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 932 time: 1.3557072 May 12 15:05:58.351571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa5065c5-020e-40a3-a92c-2328e1f44b47 None None] Provisioning for port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:05:58.376282 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa5065c5-020e-40a3-a92c-2328e1f44b47 None None] Provisioning complete for port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:05:58.376785 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa5065c5-020e-40a3-a92c-2328e1f44b47 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:58.405148 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e3e486c3-6397-494f-960a-9bb0d376d57f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=92b6c07e345a4d2e93cfacad28d364d9&name=default HTTP/1.1" status: 200 len: 2979 time: 2.3950105 May 12 15:05:58.406406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id adce94a7-30ae-4036-8a49-87df5c50c324 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:05:58.425424 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:58.428357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44998) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:58.440098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3e486c3-6397-494f-960a-9bb0d376d57f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae7270d7-21e0-4a54-83b1-5d69746dc7f5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:58.467611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Transition to ACTIVE for port object adce94a7-30ae-4036-8a49-87df5c50c324 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:05:58.496839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Router fab022ae-aab5-4b4f-a77e-4570d094dd89 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:05:58.554463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=41e26787-6db6-4aed-9809-d91a746dcee9,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:58.594079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:05:58.622892 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1e7100e1-4358-4ef9-907b-d48afd46002e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:58.648886 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa5065c5-020e-40a3-a92c-2328e1f44b47 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:58.691157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-fa5065c5-020e-40a3-a92c-2328e1f44b47 None None] For port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832,segment=NetworkSegment(49f41745-6217-458f-8fa0-7833e5e7c9df),segment_id=49f41745-6217-458f-8fa0-7833e5e7c9df)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:05:58.697610 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa5065c5-020e-40a3-a92c-2328e1f44b47 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:58.702026 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:58.706182 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e17ad7ac-dab3-4a05-b9ca-33ee2db825a6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:58.741629 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1e7100e1-4358-4ef9-907b-d48afd46002e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:58.810059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa5065c5-020e-40a3-a92c-2328e1f44b47 None None] Pushing event updated for resources: {'Port': ['ID=dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:58.849224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:05:58.860662 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Sync routers for ids ['fab022ae-aab5-4b4f-a77e-4570d094dd89'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:05:58.873552 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Routers {'fab022ae-aab5-4b4f-a77e-4570d094dd89'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:05:58.873552 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:05:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['fab022ae-aab5-4b4f-a77e-4570d094dd89'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:05:58.885813 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1e7100e1-4358-4ef9-907b-d48afd46002e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:58.889483 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1e7100e1-4358-4ef9-907b-d48afd46002e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:58.891466 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1e7100e1-4358-4ef9-907b-d48afd46002e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ae7270d7-21e0-4a54-83b1-5d69746dc7f5 HTTP/1.1" status: 204 len: 168 time: 0.4621477 May 12 15:05:58.921355 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:58.923955 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-51d7205c-de3c-432e-b759-1bfb97a4212b req-43322d6d-c0df-492f-9cae-a3b0722dc454 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.6971650 May 12 15:05:58.924679 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-20bd8f18-431d-4b3f-b524-ddb1fc18b30f admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 5.9569316 May 12 15:05:58.929475 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45004) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:05:58.948016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e55f7075-e930-469e-9063-1ed463d5a1b9', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '41e26787-6db6-4aed-9809-d91a746dcee9'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:05:58.969608 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55ea39eb-db46-44fd-9083-b779e646405a req-d00cab1e-b472-434e-9592-30263a702e36 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=7413f696702a49c390950b9a967696fa&shared=False HTTP/1.1" status: 200 len: 213 time: 0.4472265 May 12 15:05:58.972511 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:59.018700 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:05:59.114479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e17ad7ac-dab3-4a05-b9ca-33ee2db825a6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:05:59.139931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e17ad7ac-dab3-4a05-b9ca-33ee2db825a6 admin admin] Usage tracker for resource:security_group_rule and tenant:6f3dae79f0f2479a81657670a1064211 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:05:59.150490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e17ad7ac-dab3-4a05-b9ca-33ee2db825a6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:05:59.180967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e7100e1-4358-4ef9-907b-d48afd46002e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae7270d7-21e0-4a54-83b1-5d69746dc7f5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:05:59.182498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e17ad7ac-dab3-4a05-b9ca-33ee2db825a6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:05:59.409677 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-51afb829-fa65-45ea-ba40-81155203f40d None None] Provisioning complete for port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:05:59.410274 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-51afb829-fa65-45ea-ba40-81155203f40d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:59.518417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:05:59.518417 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:59.623146 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e17ad7ac-dab3-4a05-b9ca-33ee2db825a6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:59.658365 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Set router fab022ae-aab5-4b4f-a77e-4570d094dd89 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:05:59.961360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ea39eb-db46-44fd-9083-b779e646405a req-8c01897f-98e0-4c32-8f5d-3437d8a280a0 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:05:59.969359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55ea39eb-db46-44fd-9083-b779e646405a req-8c01897f-98e0-4c32-8f5d-3437d8a280a0 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3259132 May 12 15:05:59.978197 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e17ad7ac-dab3-4a05-b9ca-33ee2db825a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:05:59.997818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45016) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:00.036549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45024) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:00.045258 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5110fbfb-87ca-4688-9195-34187dd490c0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:00.091574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5110fbfb-87ca-4688-9195-34187dd490c0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:00.199632 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:00.305934 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:05:56Z', 'revision_number': 3, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port': {'id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:d5:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:05:54Z', 'updated_at': '2022-05-12T15:05:55Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:00.310412 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Checking router: fab022ae-aab5-4b4f-a77e-4570d094dd89 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:06:00.310766 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Updating router fab022ae-aab5-4b4f-a77e-4570d094dd89 port 0994331e-432f-4c92-94e5-29c9fa287d0a binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:06:00.389098 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:00.390166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Pushing event updated for resources: {'Port': ['ID=adce94a7-30ae-4036-8a49-87df5c50c324,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:00.404066 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55ea39eb-db46-44fd-9083-b779e646405a req-f2d2e0c7-faa8-416c-a45b-4c6fee9b2528 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/quotas/7413f696702a49c390950b9a967696fa HTTP/1.1" status: 200 len: 375 time: 0.4337659 May 12 15:06:00.588093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5110fbfb-87ca-4688-9195-34187dd490c0 admin admin] Usage tracker for resource:security_group_rule and tenant:3e3711a1daf34723b5a9cbb60cacfee6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:00.602641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Pushing event updated for resources: {'Port': ['ID=41e26787-6db6-4aed-9809-d91a746dcee9,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:00.617822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5110fbfb-87ca-4688-9195-34187dd490c0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:00.628883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Attempting to bind port adce94a7-30ae-4036-8a49-87df5c50c324 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:06:00.630171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Attempting to bind port adce94a7-30ae-4036-8a49-87df5c50c324 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:06:00.630687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Attempting to bind port adce94a7-30ae-4036-8a49-87df5c50c324 on network feb95830-c0c2-46c0-bb35-f2f43605e79a {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:00.631295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5110fbfb-87ca-4688-9195-34187dd490c0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:00.706540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Port adce94a7-30ae-4036-8a49-87df5c50c324 on network feb95830-c0c2-46c0-bb35-f2f43605e79a not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:06:00.707046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Attempting to bind port adce94a7-30ae-4036-8a49-87df5c50c324 on network feb95830-c0c2-46c0-bb35-f2f43605e79a {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:00.747399 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55ea39eb-db46-44fd-9083-b779e646405a req-f6cea25b-d6d7-42dd-9f76-9627abcc9a74 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=7413f696702a49c390950b9a967696fa&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1223192 May 12 15:06:00.791111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e17ad7ac-dab3-4a05-b9ca-33ee2db825a6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6f3dae79f0f2479a81657670a1064211&name=default HTTP/1.1" status: 200 len: 2979 time: 2.9316790 May 12 15:06:00.794643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45034) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:00.810242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e17ad7ac-dab3-4a05-b9ca-33ee2db825a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d2d262d-36d1-4ff8-8e78-967c6323f58d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:00.824160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 5, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:06:00.825299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Checking segment: {'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:06:00.826262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Bound using segment: {'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:06:00.827291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Bound port: adce94a7-30ae-4036-8a49-87df5c50c324, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:06:00.828690 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:00.879545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c038e9c-684f-46a9-ac12-faeedd3f08ef req-b4ee5537-31ba-4930-b7a3-5268e0a243ab tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:00.881641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c038e9c-684f-46a9-ac12-faeedd3f08ef req-b4ee5537-31ba-4930-b7a3-5268e0a243ab tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 943 time: 1.2069757 May 12 15:06:00.885751 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bfe5b42d-aed1-4da1-a776-9cc17a2a9549 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:00.900219 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5110fbfb-87ca-4688-9195-34187dd490c0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:00.905864 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Attempting to bind port 41e26787-6db6-4aed-9809-d91a746dcee9 on host n-h1-841483-1 for vnic_type normal with profile {"migrating_to": "n-h2-841483-1"} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:06:00.906444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Attempting to bind port 41e26787-6db6-4aed-9809-d91a746dcee9 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:06:00.906852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Attempting to bind port 41e26787-6db6-4aed-9809-d91a746dcee9 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:00.916943 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5110fbfb-87ca-4688-9195-34187dd490c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:00.954615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bfe5b42d-aed1-4da1-a776-9cc17a2a9549 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:00.983034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Port 41e26787-6db6-4aed-9809-d91a746dcee9 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:06:00.984478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Attempting to bind port 41e26787-6db6-4aed-9809-d91a746dcee9 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:01.073351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5110fbfb-87ca-4688-9195-34187dd490c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6375ee8-d681-4eb3-a14e-5d1f4c27ef71,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:01.084541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7aa0e8dd-274c-4edd-835f-d1b298545561 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.092579 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5110fbfb-87ca-4688-9195-34187dd490c0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3e3711a1daf34723b5a9cbb60cacfee6&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0829406 May 12 15:06:01.097931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45046) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:01.110764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] For port adce94a7-30ae-4036-8a49-87df5c50c324, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:06:01.115282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] For port adce94a7-30ae-4036-8a49-87df5c50c324, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=adce94a7-30ae-4036-8a49-87df5c50c324,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:06:01.133842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 5, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:06:01.134016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Checking segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:06:01.134263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Bound using segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:06:01.134700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Bound port: 41e26787-6db6-4aed-9809-d91a746dcee9, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:06:01.135049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.152150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bfe5b42d-aed1-4da1-a776-9cc17a2a9549 admin admin] Usage tracker for resource:security_group_rule and tenant:879d544c234c4608977b32bd3f0c8136 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:01.170095 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.197375 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.225019 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.232378 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Transition to ACTIVE for port object 0994331e-432f-4c92-94e5-29c9fa287d0a will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:01.252295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bfe5b42d-aed1-4da1-a776-9cc17a2a9549 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:01.284044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c038e9c-684f-46a9-ac12-faeedd3f08ef req-fcc22ca9-7ae0-48ad-a4b1-db13298ff4fc tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3704572 May 12 15:06:01.289951 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.422899 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a419baef-4c89-4201-a447-3e8d4825f293'] response: {'server_uuid': 'e55f7075-e930-469e-9063-1ed463d5a1b9', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '41e26787-6db6-4aed-9809-d91a746dcee9', 'code': 200} May 12 15:06:01.471693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bfe5b42d-aed1-4da1-a776-9cc17a2a9549 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:01.490684 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-247cc60c-0512-4bd8-8b0a-1acdb45ed7cb None None] Pushing event updated for resources: {'Port': ['ID=0994331e-432f-4c92-94e5-29c9fa287d0a,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:01.560791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:01.564033 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.568392 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] 10.222.0.76 "PUT /v2.0/ports/adce94a7-30ae-4036-8a49-87df5c50c324 HTTP/1.1" status: 200 len: 1092 time: 5.9246869 May 12 15:06:01.585783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Allocated IP 172.20.0.1 (4c945198-2daa-4ae0-a8c1-07ee6da52271/3ef83b9d-c5b9-4653-9e37-725af3b0ea4c/5547b996-f6f1-4969-9052-5353e51dbe15) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:06:01.638229 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7aa0e8dd-274c-4edd-835f-d1b298545561 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.668953 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-247cc60c-0512-4bd8-8b0a-1acdb45ed7cb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:01.669294 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-247cc60c-0512-4bd8-8b0a-1acdb45ed7cb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:01.669648 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-247cc60c-0512-4bd8-8b0a-1acdb45ed7cb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:01.679312 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-247cc60c-0512-4bd8-8b0a-1acdb45ed7cb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:01.679992 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-247cc60c-0512-4bd8-8b0a-1acdb45ed7cb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:01.680572 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-247cc60c-0512-4bd8-8b0a-1acdb45ed7cb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:01.681000 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-247cc60c-0512-4bd8-8b0a-1acdb45ed7cb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:01.681498 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-247cc60c-0512-4bd8-8b0a-1acdb45ed7cb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:01.682227 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-247cc60c-0512-4bd8-8b0a-1acdb45ed7cb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:01.682876 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-247cc60c-0512-4bd8-8b0a-1acdb45ed7cb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:01.683762 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-247cc60c-0512-4bd8-8b0a-1acdb45ed7cb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:01.685981 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-247cc60c-0512-4bd8-8b0a-1acdb45ed7cb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:01.784020 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bfe5b42d-aed1-4da1-a776-9cc17a2a9549 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.788049 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66a92fae-9aae-44a3-aac4-b6b75682be3f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.800006 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Attempting to bind port 0994331e-432f-4c92-94e5-29c9fa287d0a on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:06:01.802959 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Attempting to bind port 0994331e-432f-4c92-94e5-29c9fa287d0a by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:06:01.803599 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Attempting to bind port 0994331e-432f-4c92-94e5-29c9fa287d0a on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:01.827102 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 5, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:06:01.827899 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:06:01.828924 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.829572 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:06:01.830277 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Bound port: 0994331e-432f-4c92-94e5-29c9fa287d0a, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:06:01.830910 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.893356 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66a92fae-9aae-44a3-aac4-b6b75682be3f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.916723 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.928153 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] For port 0994331e-432f-4c92-94e5-29c9fa287d0a, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:06:01.933431 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] For port 0994331e-432f-4c92-94e5-29c9fa287d0a, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0994331e-432f-4c92-94e5-29c9fa287d0a,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:06:01.933649 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bfe5b42d-aed1-4da1-a776-9cc17a2a9549 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.965431 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:01.997107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Transition to ACTIVE for port object 5547b996-f6f1-4969-9052-5353e51dbe15 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:02.004182 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7aa0e8dd-274c-4edd-835f-d1b298545561 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:02.008297 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bfe5b42d-aed1-4da1-a776-9cc17a2a9549 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=879d544c234c4608977b32bd3f0c8136&name=default HTTP/1.1" status: 200 len: 2979 time: 1.7984827 May 12 15:06:02.014577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45072) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:02.027058 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:02.031649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aa0e8dd-274c-4edd-835f-d1b298545561 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d2d262d-36d1-4ff8-8e78-967c6323f58d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:02.070159 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7aa0e8dd-274c-4edd-835f-d1b298545561 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:02.070572 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Routers {'fab022ae-aab5-4b4f-a77e-4570d094dd89'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:06:02.074275 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:05:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['fab022ae-aab5-4b4f-a77e-4570d094dd89'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:02.075179 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7aa0e8dd-274c-4edd-835f-d1b298545561 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8d2d262d-36d1-4ff8-8e78-967c6323f58d HTTP/1.1" status: 204 len: 168 time: 1.2775166 May 12 15:06:02.080693 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:02.174014 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-bf08a525-c70d-49b8-b2ed-fa0f2d0e7d79 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=7413f696702a49c390950b9a967696fa&shared=False HTTP/1.1" status: 200 len: 213 time: 0.2516246 May 12 15:06:02.201916 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66a92fae-9aae-44a3-aac4-b6b75682be3f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:02.204546 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66a92fae-9aae-44a3-aac4-b6b75682be3f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:02.206156 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-66a92fae-9aae-44a3-aac4-b6b75682be3f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e6375ee8-d681-4eb3-a14e-5d1f4c27ef71 HTTP/1.1" status: 204 len: 168 time: 1.0465391 May 12 15:06:02.210891 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-247cc60c-0512-4bd8-8b0a-1acdb45ed7cb None None] Pushing event updated for resources: {'Port': ['ID=0994331e-432f-4c92-94e5-29c9fa287d0a,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:02.218890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Pushing event updated for resources: {'Port': ['ID=5547b996-f6f1-4969-9052-5353e51dbe15,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:02.231759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Network 4c945198-2daa-4ae0-a8c1-07ee6da52271 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:06:02.235275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:06:02.240433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:06:02.241177 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:02.244475 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66a92fae-9aae-44a3-aac4-b6b75682be3f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6375ee8-d681-4eb3-a14e-5d1f4c27ef71,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:02.313938 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66e3fe54-5bfd-4807-87d9-4651c37b63ba service neutron] Pushing event updated for resources: {'Port': ['ID=adce94a7-30ae-4036-8a49-87df5c50c324,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:02.514613 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] Set router fab022ae-aab5-4b4f-a77e-4570d094dd89 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:06:02.611080 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:02.612206 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7aad77ac-2be8-4c81-8cc9-f1c4f3e5a887 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:02.649179 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7aad77ac-2be8-4c81-8cc9-f1c4f3e5a887 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:02.714338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfe5b42d-aed1-4da1-a776-9cc17a2a9549 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=acf4198f-8e7b-4ae5-ae2f-63512937d45c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:02.723013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:06:02.733871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-89d9928e-368d-4047-bb8e-93d1ed8b3723 None None] Provisioning for port 5547b996-f6f1-4969-9052-5353e51dbe15 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:02.741561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-89d9928e-368d-4047-bb8e-93d1ed8b3723 None None] Provisioning complete for port 5547b996-f6f1-4969-9052-5353e51dbe15 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:02.742159 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-89d9928e-368d-4047-bb8e-93d1ed8b3723 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:02.751906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7aad77ac-2be8-4c81-8cc9-f1c4f3e5a887 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:02.790832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aad77ac-2be8-4c81-8cc9-f1c4f3e5a887 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=acf4198f-8e7b-4ae5-ae2f-63512937d45c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:02.808539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bf9d58-4cf5-482f-ae8b-98200120ff10 req-772d475c-dd26-469e-85bf-f169af357d08 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:02.824289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10bf9d58-4cf5-482f-ae8b-98200120ff10 req-772d475c-dd26-469e-85bf-f169af357d08 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 944 time: 1.2198532 May 12 15:06:02.826091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45100) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:02.836226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=41e26787-6db6-4aed-9809-d91a746dcee9,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:06:02.869899 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-89d9928e-368d-4047-bb8e-93d1ed8b3723 None None] Port 5547b996-f6f1-4969-9052-5353e51dbe15 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:06:02.870801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d9f9708-a4fd-4026-960f-944f370f561e req-82fbc8e7-5f7a-42f0-aa27-b746bcf86d3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:02.872515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-82fbc8e7-5f7a-42f0-aa27-b746bcf86d3a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=38c07c88d2f84b29a9ae8c83558ec74b&device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 1095 time: 1.0169971 May 12 15:06:02.898850 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:02.993819 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f62535c4-e40d-425c-bd5e-b39846dc9495 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:02.998112 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:03.006785 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:03.007893 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:03.082027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Pushing event updated for resources: {'Port': ['ID=41e26787-6db6-4aed-9809-d91a746dcee9,revision_number=8']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:03.156454 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:05:56Z', 'revision_number': 3, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port': {'id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:d5:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:05:54Z', 'updated_at': '2022-05-12T15:06:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:03.162309 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b0f2890-7963-4345-8f03-46066ce64e45 None None] The sync data for ids ['fab022ae-aab5-4b4f-a77e-4570d094dd89'] in n-d-841483-1 is: [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:05:56Z', 'revision_number': 3, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port': {'id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:d5:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:05:54Z', 'updated_at': '2022-05-12T15:06:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:06:03.191335 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Pushing event updated for resources: {'Port': ['ID=5547b996-f6f1-4969-9052-5353e51dbe15,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:03.203486 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10bf9d58-4cf5-482f-ae8b-98200120ff10 req-2773c704-0b8e-44b3-b855-87cf5b6b05d1 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3782446 May 12 15:06:03.205203 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-a3aad435-5c0c-42a3-98b1-c4365fc4c34b service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=adce94a7-30ae-4036-8a49-87df5c50c324 HTTP/1.1" status: 200 len: 217 time: 0.2987745 May 12 15:06:03.205709 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7aad77ac-2be8-4c81-8cc9-f1c4f3e5a887 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:03.206710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7aad77ac-2be8-4c81-8cc9-f1c4f3e5a887 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/acf4198f-8e7b-4ae5-ae2f-63512937d45c HTTP/1.1" status: 204 len: 168 time: 1.1740701 May 12 15:06:03.209049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f62535c4-e40d-425c-bd5e-b39846dc9495 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:03.308761 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f62535c4-e40d-425c-bd5e-b39846dc9495 admin admin] Usage tracker for resource:security_group_rule and tenant:a461b82f4b8244c2a5fa89d19402e1b6 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:03.316604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Network 4c945198-2daa-4ae0-a8c1-07ee6da52271 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:06:03.320933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:06:03.330971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f62535c4-e40d-425c-bd5e-b39846dc9495 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:03.478084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'tag': 'adce94a7-30ae-4036-8a49-87df5c50c324'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:03.513424 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-a0a7b46e-a2f2-4b75-9642-4d18851c8f5e tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:03.529993 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-a0a7b46e-a2f2-4b75-9642-4d18851c8f5e tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 1.3337200 May 12 15:06:03.535162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:03.536494 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:03.537937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-de149a2b-fb14-4cf5-9558-6fc31f22dfaa service neutron] 10.222.0.76 "PUT /v2.0/ports/41e26787-6db6-4aed-9809-d91a746dcee9 HTTP/1.1" status: 200 len: 1121 time: 7.7647457 May 12 15:06:03.539771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f62535c4-e40d-425c-bd5e-b39846dc9495 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:03.670877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['41e26787-6db6-4aed-9809-d91a746dcee9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:06:03.862475 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6ffbe958-e061-4f17-9d44-947d4b850ead None None] Provisioning complete for port 5547b996-f6f1-4969-9052-5353e51dbe15 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:03.863087 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6ffbe958-e061-4f17-9d44-947d4b850ead None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:03.933225 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55ea39eb-db46-44fd-9083-b779e646405a req-263391a5-67c8-4306-aa98-8d251090fe16 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=7413f696702a49c390950b9a967696fa&shared=False HTTP/1.1" status: 200 len: 213 time: 0.3742499 May 12 15:06:03.941533 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1fcfa302-9047-43d0-a3df-9c6a0c1843d8 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/quotas/7413f696702a49c390950b9a967696fa HTTP/1.1" status: 200 len: 375 time: 0.4102600 May 12 15:06:03.993740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Router fab022ae-aab5-4b4f-a77e-4570d094dd89 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:06:04.079525 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6ffbe958-e061-4f17-9d44-947d4b850ead None None] Port 5547b996-f6f1-4969-9052-5353e51dbe15 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:06:04.103935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45136) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:04.132271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5fd6d32c-e2c2-4f0f-9e54-66e6b7fb3155 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:04.202742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d9f9708-a4fd-4026-960f-944f370f561e req-68c42324-d2ff-46da-8832-b69f2e82494f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:04.204191 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-68c42324-d2ff-46da-8832-b69f2e82494f service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c0ac6201-c8b1-43a9-a509-5a4ff4e34282 HTTP/1.1" status: 200 len: 863 time: 0.9568281 May 12 15:06:04.225274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5fd6d32c-e2c2-4f0f-9e54-66e6b7fb3155 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:04.234574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5fd6d32c-e2c2-4f0f-9e54-66e6b7fb3155 admin admin] Usage tracker for resource:security_group_rule and tenant:e79909bb93024970b54ca466f776ec3e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:04.238163 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5fd6d32c-e2c2-4f0f-9e54-66e6b7fb3155 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:04.248920 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1a9bf66e-112d-47d2-8ad9-7218876663f6 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=7413f696702a49c390950b9a967696fa&fields=id HTTP/1.1" status: 200 len: 210 time: 0.3059998 May 12 15:06:04.260135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5fd6d32c-e2c2-4f0f-9e54-66e6b7fb3155 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:04.298475 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:06:04.312400 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d3e46625-82e2-4de9-863c-1d1176ec0996 admin admin] 10.222.0.82 "PUT /v2.0/routers/fab022ae-aab5-4b4f-a77e-4570d094dd89/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.3722000 May 12 15:06:04.410650 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f62535c4-e40d-425c-bd5e-b39846dc9495 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:04.519134 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f62535c4-e40d-425c-bd5e-b39846dc9495 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:04.658473 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-09c5bbb7-0456-4841-a7e3-93578da851be'] response: {'name': 'network-changed', 'server_uuid': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'tag': 'adce94a7-30ae-4036-8a49-87df5c50c324', 'status': 'completed', 'code': 200} May 12 15:06:04.698306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5fd6d32c-e2c2-4f0f-9e54-66e6b7fb3155 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:04.710716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5fd6d32c-e2c2-4f0f-9e54-66e6b7fb3155 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:04.749645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f62535c4-e40d-425c-bd5e-b39846dc9495 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ab613c2b-17d6-4d4d-8e89-7e3cf2c2a79f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:04.798442 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f62535c4-e40d-425c-bd5e-b39846dc9495 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a461b82f4b8244c2a5fa89d19402e1b6&name=default HTTP/1.1" status: 200 len: 2979 time: 1.9479196 May 12 15:06:04.806970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45176) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:04.842278 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5fd6d32c-e2c2-4f0f-9e54-66e6b7fb3155 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e79909bb93024970b54ca466f776ec3e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7369709 May 12 15:06:04.850273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fd6d32c-e2c2-4f0f-9e54-66e6b7fb3155 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c837d3f-5824-4fb5-be3a-6253b42db208,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:04.853381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45182) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:04.916306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e3b2360-6721-4c7b-94b3-313822f6385f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:04.959456 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e3b2360-6721-4c7b-94b3-313822f6385f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:05.006992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ea39eb-db46-44fd-9083-b779e646405a req-4eeef615-bc2e-4e1d-8a0c-a83480c0fabc tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:05.008573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55ea39eb-db46-44fd-9083-b779e646405a req-4eeef615-bc2e-4e1d-8a0c-a83480c0fabc tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.9171376 May 12 15:06:05.033017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d9f9708-a4fd-4026-960f-944f370f561e req-90eaebb8-2dd7-4137-abe1-aacb26b50b1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:05.035528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-90eaebb8-2dd7-4137-abe1-aacb26b50b1b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=feb95830-c0c2-46c0-bb35-f2f43605e79a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.7883158 May 12 15:06:05.070718 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e3b2360-6721-4c7b-94b3-313822f6385f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:05.093506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0994331e-432f-4c92-94e5-29c9fa287d0a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:05.118423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e3b2360-6721-4c7b-94b3-313822f6385f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ab613c2b-17d6-4d4d-8e89-7e3cf2c2a79f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:05.134629 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e3b2360-6721-4c7b-94b3-313822f6385f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:05.138918 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6e3b2360-6721-4c7b-94b3-313822f6385f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ab613c2b-17d6-4d4d-8e89-7e3cf2c2a79f HTTP/1.1" status: 204 len: 168 time: 0.3287389 May 12 15:06:05.172861 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Request body: {'port': {'device_id': '8d278524-0445-4a95-8564-3c04c2f3c41d', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '7413f696702a49c390950b9a967696fa'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:05.202261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ff78c1-0385-4a5d-b51d-79951d5e8c4e req-63e365e7-93fc-4330-96a6-9874a43a24f0 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:05.203781 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6ff78c1-0385-4a5d-b51d-79951d5e8c4e req-63e365e7-93fc-4330-96a6-9874a43a24f0 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 943 time: 1.5296171 May 12 15:06:05.247917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 0994331e-432f-4c92-94e5-29c9fa287d0a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:05.256431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0994331e-432f-4c92-94e5-29c9fa287d0a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:05.257937 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:05.450004 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6ff78c1-0385-4a5d-b51d-79951d5e8c4e req-19b7f1e1-f8c2-4936-970b-3303bcf2f73f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2152417 May 12 15:06:05.483809 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8ac028f1-8705-4cd7-acff-f95f300e5871 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:05.506032 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:05.531146 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8ac028f1-8705-4cd7-acff-f95f300e5871 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:05.548782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 0994331e-432f-4c92-94e5-29c9fa287d0a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0994331e-432f-4c92-94e5-29c9fa287d0a,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:05.574044 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:05.628109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e58c6725-49a7-4a87-aaeb-227e9930ab16 req-a46943c0-95c7-4f5c-ba1f-b912d11f1d0d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:05.636739 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e58c6725-49a7-4a87-aaeb-227e9930ab16 req-a46943c0-95c7-4f5c-ba1f-b912d11f1d0d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 944 time: 0.8016746 May 12 15:06:05.672536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45204) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:05.682460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Request body: {'network': {'name': 'tempest-AttachSCSIVolumeTestJSON-451196841-network', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:05.687792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:05.694146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Usage tracker for resource:network and tenant:3a478f0d02094addabf4cc31816a81f5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:05.702499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:05.714759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:05.733568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=0994331e-432f-4c92-94e5-29c9fa287d0a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:05.752437 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30c9b3d4-715b-4f41-8a51-795aea8446aa req-eaaf2d5a-4248-4562-9680-6781671c1f6b tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 210 time: 0.1000760 May 12 15:06:05.753341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Made reservation on behalf of 3a478f0d02094addabf4cc31816a81f5 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:06:05.757821 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:05.790074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:05.808839 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8ac028f1-8705-4cd7-acff-f95f300e5871 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:05.828386 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:05.834182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Usage tracker for resource:security_group_rule and tenant:3a478f0d02094addabf4cc31816a81f5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:05.836355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ac028f1-8705-4cd7-acff-f95f300e5871 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c837d3f-5824-4fb5-be3a-6253b42db208,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:05.837761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:05.850008 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e58c6725-49a7-4a87-aaeb-227e9930ab16 req-7d7eb788-4d8d-4696-a8e5-2152550a7d93 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2121482 May 12 15:06:05.868582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:05.869667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:05.890804 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-fc11983c-8a96-4c29-bac3-3a01fd417363 service neutron] 10.222.0.76 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7535353 May 12 15:06:05.906861 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Usage tracker for resource:port and tenant:7413f696702a49c390950b9a967696fa is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:05.917207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:05.958368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Sync routers for ids ['fab022ae-aab5-4b4f-a77e-4570d094dd89'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:06:05.971963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Routers {'fab022ae-aab5-4b4f-a77e-4570d094dd89'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:06:05.974143 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:05:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['fab022ae-aab5-4b4f-a77e-4570d094dd89'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:06.005902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:06.015173 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:06.042429 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8ac028f1-8705-4cd7-acff-f95f300e5871 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:06.044646 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8ac028f1-8705-4cd7-acff-f95f300e5871 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0c837d3f-5824-4fb5-be3a-6253b42db208 HTTP/1.1" status: 204 len: 168 time: 1.1064532 May 12 15:06:06.094248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:06.095489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=89426b75-24c4-4a0b-ba4f-3c511ab36974,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:06.115628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 581} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:06:06.134320 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:06.134668 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Added segment 6c869e32-bb71-4864-ab9a-8535af830a80 of type vlan for network e7453c32-56d4-4bed-949a-c05a259218b1 May 12 15:06:06.184260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Made reservation on behalf of 7413f696702a49c390950b9a967696fa for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:06:06.187095 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:06.187736 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:06.213650 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:06.248209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d9f9708-a4fd-4026-960f-944f370f561e req-6a47d873-8f38-45d6-a9b0-8b3666896b5e service neutron] 10.222.0.76 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3305995 May 12 15:06:06.258916 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:06.260864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:06.261486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:06.283245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Set router fab022ae-aab5-4b4f-a77e-4570d094dd89 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:06:06.325741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:06.421615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Usage tracker for resource:security_group_rule and tenant:7413f696702a49c390950b9a967696fa is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:06.431155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-102d9c5b-d406-4628-ae15-99d247ec3279 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=7413f696702a49c390950b9a967696fa&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1663949 May 12 15:06:06.438513 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:06.507440 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.8333797 May 12 15:06:06.510317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45228) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:06.529239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de6f1e6b-7813-42a2-94d5-daecf9db94ba admin admin] Pushing event updated for resources: {'Network': ['ID=e7453c32-56d4-4bed-949a-c05a259218b1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:06.541712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Request body: {'subnet': {'network_id': 'e7453c32-56d4-4bed-949a-c05a259218b1', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachSCSIVolumeTestJSON-451196841-subnet', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:06.558904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:06.560544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network e7453c32-56d4-4bed-949a-c05a259218b1 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:06:06.572012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Usage tracker for resource:subnet and tenant:3a478f0d02094addabf4cc31816a81f5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:06.580348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:06.604746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:06.632760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Made reservation on behalf of 3a478f0d02094addabf4cc31816a81f5 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:06:06.635127 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Notify callbacks [] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:06.758845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:06.761313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e55f7075-e930-469e-9063-1ed463d5a1b9', 'tag': '41e26787-6db6-4aed-9809-d91a746dcee9'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:06.774044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-2eebf8d2-d6e4-4ec0-948e-bf8fed2230a2 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:06.775790 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-2eebf8d2-d6e4-4ec0-948e-bf8fed2230a2 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3236318 May 12 15:06:06.797133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d78d4e21-72c5-467f-852a-27d7d8573597 req-9cb97669-5b44-4b67-9fcd-07a4eea35617 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:06.805001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d78d4e21-72c5-467f-852a-27d7d8573597 req-9cb97669-5b44-4b67-9fcd-07a4eea35617 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 950 time: 0.7589405 May 12 15:06:06.809843 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Request body: {'port': {'device_id': '2a994cf2-e517-4ce3-a9fe-50d8a080508e', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '7413f696702a49c390950b9a967696fa'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:06.968746 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:06:02Z', 'revision_number': 4, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port': {'id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:d5:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:05:54Z', 'updated_at': '2022-05-12T15:06:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5547b996-f6f1-4969-9052-5353e51dbe15', 'name': '', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'mac_address': 'fa:16:3e:bf:c0:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:01Z', 'updated_at': '2022-05-12T15:06:02Z', 'revision_number': 2, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'subnets': [{'id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:06.983406 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Checking router: fab022ae-aab5-4b4f-a77e-4570d094dd89 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:06:06.984597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Updating router fab022ae-aab5-4b4f-a77e-4570d094dd89 port 5547b996-f6f1-4969-9052-5353e51dbe15 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:06:07.030625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0994331e-432f-4c92-94e5-29c9fa287d0a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:07.112350 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:07.200041 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:07.202330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Pushing event updated for resources: {'Subnet': ['ID=ab2c50b2-e633-495f-96cd-e23b8e03d46d,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:07.288332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Checking segment: {'id': '6c869e32-bb71-4864-ab9a-8535af830a80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'e7453c32-56d4-4bed-949a-c05a259218b1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:06:07.290321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Network hostable DHCP agents. Network: e7453c32-56d4-4bed-949a-c05a259218b1, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:06:07.296566 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d78d4e21-72c5-467f-852a-27d7d8573597 req-ec753f92-019b-44e5-a5c0-26d90306be93 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4904113 May 12 15:06:07.338971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Network e7453c32-56d4-4bed-949a-c05a259218b1 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:06:07.343550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:07.365319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, e7453c32-56d4-4bed-949a-c05a259218b1) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:06:07.369437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:07.370023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:07.376138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Usage tracker for resource:port and tenant:7413f696702a49c390950b9a967696fa is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:07.384551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a024d134-7594-4a51-9e6e-d849b162e737 None None] Network e7453c32-56d4-4bed-949a-c05a259218b1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:06:07.389763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:07.413861 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b112f798-fd53-4a7f-9296-0118d04f9b4c admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.9004290 May 12 15:06:07.416367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45260) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:07.422008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Request body: {'router': {'name': 'tempest-AttachSCSIVolumeTestJSON-451196841-router', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:07.422633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:07.427885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0994331e-432f-4c92-94e5-29c9fa287d0a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:07.428034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b07b60a5-7bdd-43bd-8b5f-93a98019f4cf req-e2886f0a-3cc1-4a7c-8170-ef64814f7ee6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:07.428244 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:07.429806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b07b60a5-7bdd-43bd-8b5f-93a98019f4cf req-e2886f0a-3cc1-4a7c-8170-ef64814f7ee6 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=38c07c88d2f84b29a9ae8c83558ec74b&device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 1095 time: 1.1055486 May 12 15:06:07.431393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:07.441346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Usage tracker for resource:router and tenant:3a478f0d02094addabf4cc31816a81f5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:07.486650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 41e26787-6db6-4aed-9809-d91a746dcee9 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:06:07.534751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:07.552463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:07.586347 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:07.590710 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:07.690377 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:07.711718 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1c2e43c-1ac4-4107-b53e-969b1f3bf732 req-ec64f281-3a16-45d4-b194-fc78c2bbb916 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 210 time: 0.0858467 May 12 15:06:07.721186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b07b60a5-7bdd-43bd-8b5f-93a98019f4cf req-36d9f39e-b4b0-49b8-8eb6-177abcb7a800 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:07.722659 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b07b60a5-7bdd-43bd-8b5f-93a98019f4cf req-36d9f39e-b4b0-49b8-8eb6-177abcb7a800 service neutron] 10.222.0.76 "GET /v2.0/networks?id=feb95830-c0c2-46c0-bb35-f2f43605e79a HTTP/1.1" status: 200 len: 925 time: 0.2779479 May 12 15:06:07.737148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Made reservation on behalf of 7413f696702a49c390950b9a967696fa for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:06:07.743972 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:07.744195 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-3eaaeba9-7a3a-4003-bf92-09561c4dd7d5 service neutron] 10.222.0.84 "GET /v2.0/ports/41e26787-6db6-4aed-9809-d91a746dcee9/bindings/n-h2-841483-1 HTTP/1.1" status: 200 len: 384 time: 0.2954683 May 12 15:06:07.890533 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:07.902727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.84', 55124) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:07.927472 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e08ae22a-7ead-4b65-bd2f-869060cb6065'] response: {'name': 'network-changed', 'server_uuid': 'e55f7075-e930-469e-9063-1ed463d5a1b9', 'tag': '41e26787-6db6-4aed-9809-d91a746dcee9', 'status': 'completed', 'code': 200} May 12 15:06:07.961477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:07.966735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b07b60a5-7bdd-43bd-8b5f-93a98019f4cf req-31d80695-16c0-4f0f-83f0-7fc2aead4e3a service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=adce94a7-30ae-4036-8a49-87df5c50c324 HTTP/1.1" status: 200 len: 217 time: 0.1814640 May 12 15:06:07.982121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Usage tracker for resource:security_group_rule and tenant:7413f696702a49c390950b9a967696fa is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:08.032111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:08.052144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c17d830-a63e-409a-b53f-353049c57b26 req-3527e9fa-3300-44d0-9b65-1828e94d3c10 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:08.059295 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c17d830-a63e-409a-b53f-353049c57b26 req-3527e9fa-3300-44d0-9b65-1828e94d3c10 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 943 time: 0.8870809 May 12 15:06:08.082801 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:08.095843 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Transition to ACTIVE for port object 5547b996-f6f1-4969-9052-5353e51dbe15 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:08.112174 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a49de190-3075-4dff-a67a-fd9f694116cb no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:06:08.171213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:08.187111 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:08.224982 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:08.247932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c17d830-a63e-409a-b53f-353049c57b26 req-f50d199f-d8aa-4f41-9c66-582e9b8554a2 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1870244 May 12 15:06:08.260384 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:08.434892 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:08.444430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16e226ec-ee67-421d-a48c-e4aa321d06f6 None None] Pushing event updated for resources: {'Port': ['ID=5547b996-f6f1-4969-9052-5353e51dbe15,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:08.480492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b07b60a5-7bdd-43bd-8b5f-93a98019f4cf req-92df1764-34dd-4b08-bd63-0063d75db4ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:08.482122 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b07b60a5-7bdd-43bd-8b5f-93a98019f4cf req-92df1764-34dd-4b08-bd63-0063d75db4ff service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c0ac6201-c8b1-43a9-a509-5a4ff4e34282 HTTP/1.1" status: 200 len: 863 time: 0.4969740 May 12 15:06:08.562903 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Retry wrapper got retriable exception: Failed to create a duplicate DefaultSecurityGroup: for attribute(s) ['default_security_group.PRIMARY'] with value(s) 7413f696702a49c390950b9a967696fa {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:06:08.564006 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Performing DB retry for function neutron.db.securitygroups_db.SecurityGroupDbMixin.create_security_group {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:06:08.584517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Pushing event updated for resources: {'SecurityGroup': ['ID=226901b6-dd8d-4451-b59a-4e1a727e153f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:08.753452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96d681a2-cda4-4f4d-9409-4469c8d94ee6 req-b0234049-470f-4778-9550-b7094de7a15b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:08.755010 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96d681a2-cda4-4f4d-9409-4469c8d94ee6 req-b0234049-470f-4778-9550-b7094de7a15b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 1124 time: 0.8511393 May 12 15:06:08.826783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a702e4-9f48-48ba-9465-305c8307223e req-ea16f2b4-9bc6-40d0-8a38-82c3a352fab2 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:08.835339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-90a702e4-9f48-48ba-9465-305c8307223e req-ea16f2b4-9bc6-40d0-8a38-82c3a352fab2 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 944 time: 0.7966740 May 12 15:06:08.840164 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:08.861729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Allocated IP 192.168.233.108 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/e5430b6d-6430-4a47-b068-7f891fa37da9) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:06:08.888214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b07b60a5-7bdd-43bd-8b5f-93a98019f4cf req-317285a1-ec18-4d2f-ac2d-d8d9532ffb76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:08.889777 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b07b60a5-7bdd-43bd-8b5f-93a98019f4cf req-317285a1-ec18-4d2f-ac2d-d8d9532ffb76 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=feb95830-c0c2-46c0-bb35-f2f43605e79a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3919585 May 12 15:06:08.947635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a49de190-3075-4dff-a67a-fd9f694116cb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a49de190-3075-4dff-a67a-fd9f694116cb,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:08.951922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=41e26787-6db6-4aed-9809-d91a746dcee9,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:09.005468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfc4bc02-d56b-4ef8-8c50-af64aeb1795c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a49de190-3075-4dff-a67a-fd9f694116cb'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:09.016959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:06:09.050096 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:09.080505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96d681a2-cda4-4f4d-9409-4469c8d94ee6 req-9524507e-9e8b-4cfb-b1bb-9f057ae63a24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:09.081973 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96d681a2-cda4-4f4d-9409-4469c8d94ee6 req-9524507e-9e8b-4cfb-b1bb-9f057ae63a24 service neutron] 10.222.0.84 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.3169553 May 12 15:06:09.196728 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-e7453c32-56d4-4bed-949a-c05a259218b1', 'network_id': 'e7453c32-56d4-4bed-949a-c05a259218b1', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'fixed_ips': [{'subnet_id': 'ab2c50b2-e633-495f-96cd-e23b8e03d46d'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:06:09.197848 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:09.198135 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96d681a2-cda4-4f4d-9409-4469c8d94ee6 req-cb568dcf-7fa9-4a26-835b-00ad391ea822 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=41e26787-6db6-4aed-9809-d91a746dcee9 HTTP/1.1" status: 200 len: 217 time: 0.0933228 May 12 15:06:09.200292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 41e26787-6db6-4aed-9809-d91a746dcee9 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:06:09.238713 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-90a702e4-9f48-48ba-9465-305c8307223e req-3a63708e-9ab1-4c56-ae61-918b1cd54c54 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4000108 May 12 15:06:09.239729 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:09.266385 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=41e26787-6db6-4aed-9809-d91a746dcee9,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:09.335114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 41e26787-6db6-4aed-9809-d91a746dcee9 has no active binding in host n-h2-841483-1 {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:142}} May 12 15:06:09.337180 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Attempting to bind port 5547b996-f6f1-4969-9052-5353e51dbe15 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:06:09.337180 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Attempting to bind port 5547b996-f6f1-4969-9052-5353e51dbe15 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '49f41745-6217-458f-8fa0-7833e5e7c9df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:06:09.337483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Attempting to bind port 5547b996-f6f1-4969-9052-5353e51dbe15 on network 4c945198-2daa-4ae0-a8c1-07ee6da52271 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:09.387143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=41e26787-6db6-4aed-9809-d91a746dcee9,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:09.396053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 5, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:06:09.396053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Checking segment: {'id': '49f41745-6217-458f-8fa0-7833e5e7c9df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:06:09.396488 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:09.401573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Bound using segment: {'id': '49f41745-6217-458f-8fa0-7833e5e7c9df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:06:09.403805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Bound port: 5547b996-f6f1-4969-9052-5353e51dbe15, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '49f41745-6217-458f-8fa0-7833e5e7c9df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:06:09.404481 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:09.440495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Request body: {'security_group': {'name': 'tempest-securitygroup-1574853976', 'description': 'tempest-description-304915801'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:09.454320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device adce94a7-30ae-4036-8a49-87df5c50c324 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:06:09.462343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:09.464677 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a49de190-3075-4dff-a67a-fd9f694116cb,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:09.470162 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:09.481123 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:09.488335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Usage tracker for resource:security_group and tenant:8bbaabbfb25445218d14a5645ed3ac41 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:09.500780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96d681a2-cda4-4f4d-9409-4469c8d94ee6 req-4a8c9061-6d2c-4ac3-862b-0e004364cca7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:09.502333 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96d681a2-cda4-4f4d-9409-4469c8d94ee6 req-4a8c9061-6d2c-4ac3-862b-0e004364cca7 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.2393067 May 12 15:06:09.503247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Quota usage for security_group was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:09.533162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Attempting to reserve 1 items for resource security_group. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:09.569404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] For port 5547b996-f6f1-4969-9052-5353e51dbe15, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:06:09.572926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] For port 5547b996-f6f1-4969-9052-5353e51dbe15, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5547b996-f6f1-4969-9052-5353e51dbe15,segment=NetworkSegment(49f41745-6217-458f-8fa0-7833e5e7c9df),segment_id=49f41745-6217-458f-8fa0-7833e5e7c9df)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:06:09.593907 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:09.621125 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:09.628059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Transition to ACTIVE for port object e5430b6d-6430-4a47-b068-7f891fa37da9 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:09.631954 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96d681a2-cda4-4f4d-9409-4469c8d94ee6 req-2631b5b9-9daa-4ea1-9fbf-052471fdaeeb service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0881679 May 12 15:06:09.639969 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:09.651743 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b07b60a5-7bdd-43bd-8b5f-93a98019f4cf req-c7166ecd-1cef-46c3-8b32-1c40f9330816 service neutron] 10.222.0.76 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7487500 May 12 15:06:09.726334 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:09.727094 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:06:09.829910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Routers {'fab022ae-aab5-4b4f-a77e-4570d094dd89'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:06:09.830684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:05:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['fab022ae-aab5-4b4f-a77e-4570d094dd89'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:09.860871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Transition to ACTIVE for port object 41e26787-6db6-4aed-9809-d91a746dcee9 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:09.883955 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:09.937218 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:10.000586 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:10.015804 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f8b1c65-ed58-4397-9e6c-689b0b49ae8d req-443ae098-9ac4-4f4b-b7b1-cbbbbb4d7ecb tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 210 time: 0.2100275 May 12 15:06:10.023018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Allocated IP 172.20.0.2 (e7453c32-56d4-4bed-949a-c05a259218b1/ab2c50b2-e633-495f-96cd-e23b8e03d46d/f9158451-2a06-46ea-b709-f61479af74d9) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:06:10.054559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16e226ec-ee67-421d-a48c-e4aa321d06f6 None None] Pushing event updated for resources: {'Port': ['ID=5547b996-f6f1-4969-9052-5353e51dbe15,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:10.074356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45330) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:10.236761 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:10.240652 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96d681a2-cda4-4f4d-9409-4469c8d94ee6 req-0a832852-aa91-4d41-8eeb-67d2eb3a8a3f service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5982645 May 12 15:06:10.258473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] No DVR routers for this DVR port 41e26787-6db6-4aed-9809-d91a746dcee9 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:06:10.299972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Usage tracker for resource:security_group_rule and tenant:8bbaabbfb25445218d14a5645ed3ac41 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:10.300633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Allocated IP 172.25.8.229 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/b0f516cc-4eeb-43e7-8139-6cc3d7974bc6) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:06:10.305956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Pushing event updated for resources: {'Port': ['ID=41e26787-6db6-4aed-9809-d91a746dcee9,revision_number=10']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:10.342388 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:10.347728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Allocated IP 192.168.233.127 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/bea6d555-5915-4366-91f7-7e9771e26806) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:06:10.359483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:06:10.361199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port adce94a7-30ae-4036-8a49-87df5c50c324, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=adce94a7-30ae-4036-8a49-87df5c50c324,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:10.380239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:06:10.384777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:10.395508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:06:10.401161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:10.401823 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:10.427391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:10.427734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:10.428053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:10.428375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:10.429104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:10.429104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:10.429295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:10.433844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:10.434144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:10.434437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:10.434764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:10.435082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:10.448145 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Pushing event updated for resources: {'Port': ['ID=e5430b6d-6430-4a47-b068-7f891fa37da9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:10.488142 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'adce94a7-30ae-4036-8a49-87df5c50c324', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'port_id': 'adce94a7-30ae-4036-8a49-87df5c50c324', 'mac_address': 'fa:16:3e:b9:35:bb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 563, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:06:10.560328 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28a73005-689d-467d-ad0e-82c1321c1800 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:10.616021 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b07b60a5-7bdd-43bd-8b5f-93a98019f4cf req-36375a0a-dc2f-4b75-bb7b-fad13de01dc4 service neutron] 10.222.0.76 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7646096 May 12 15:06:10.640422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-28a73005-689d-467d-ad0e-82c1321c1800 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:10.664292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-28a73005-689d-467d-ad0e-82c1321c1800 admin admin] Usage tracker for resource:security_group_rule and tenant:36842012465042b49a7670fcef9f2e0f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:10.669415 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55ea39eb-db46-44fd-9083-b779e646405a req-d9ca0453-41ee-4bd5-951f-4c896cdafe73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 5.6317017 May 12 15:06:10.671893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-28a73005-689d-467d-ad0e-82c1321c1800 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:10.677836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] Set router fab022ae-aab5-4b4f-a77e-4570d094dd89 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:06:10.690138 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-0d9bcebb-edd7-48e9-b75b-31d5cebcb18a service neutron] 10.222.0.84 "PUT /v2.0/ports/41e26787-6db6-4aed-9809-d91a746dcee9/bindings/n-h2-841483-1/activate HTTP/1.1" status: 200 len: 369 time: 2.9374681 May 12 15:06:10.706743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-28a73005-689d-467d-ad0e-82c1321c1800 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:10.728321 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96d681a2-cda4-4f4d-9409-4469c8d94ee6 req-6b91cc26-c113-4f68-9be5-4bc2c31ae756 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4762528 May 12 15:06:10.758981 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5d5247b6-0947-480f-bc3c-717a81122deb'] response: {'server_uuid': 'dfc4bc02-d56b-4ef8-8c50-af64aeb1795c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a49de190-3075-4dff-a67a-fd9f694116cb', 'code': 200} May 12 15:06:10.793665 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:10.811870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Request body: {'port': {'device_id': '8d278524-0445-4a95-8564-3c04c2f3c41d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:10.846770 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:10.921183 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:10.923248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:06:10.926035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:06:10.930161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:06:10.941041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-00a209db-38fc-46ed-ad6a-62edd2c08513 None None] Provisioning for port e5430b6d-6430-4a47-b068-7f891fa37da9 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:10.971337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id adce94a7-30ae-4036-8a49-87df5c50c324 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:06:10.976500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-00a209db-38fc-46ed-ad6a-62edd2c08513 None None] Provisioning complete for port e5430b6d-6430-4a47-b068-7f891fa37da9 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:10.977334 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-00a209db-38fc-46ed-ad6a-62edd2c08513 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.063502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Pushing event updated for resources: {'Port': ['ID=b0f516cc-4eeb-43e7-8139-6cc3d7974bc6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:11.165974 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.179544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port adce94a7-30ae-4036-8a49-87df5c50c324, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=adce94a7-30ae-4036-8a49-87df5c50c324,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:11.192315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Transition to ACTIVE for port object f9158451-2a06-46ea-b709-f61479af74d9 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:11.195006 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.196661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-00a209db-38fc-46ed-ad6a-62edd2c08513 None None] Port e5430b6d-6430-4a47-b068-7f891fa37da9 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:06:11.197059 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.208681 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.236276 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.257572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:11.268881 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.294241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Transition to ACTIVE for port object bea6d555-5915-4366-91f7-7e9771e26806 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:11.300187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Usage tracker for resource:security_group_rule and tenant:8bbaabbfb25445218d14a5645ed3ac41 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:11.306358 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Transition to ACTIVE for port object f9158451-2a06-46ea-b709-f61479af74d9 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:11.324018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:11.342575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-314925ff-72c8-4630-b2d5-02ac0ae850a0 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:11.343646 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.344018 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-314925ff-72c8-4630-b2d5-02ac0ae850a0 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9&tenant_id=1b3825228b0e4c42a381540b66ea23d6&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1095 time: 0.4882400 May 12 15:06:11.359401 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=adce94a7-30ae-4036-8a49-87df5c50c324,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:11.370009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:11.370368 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.378132 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28a73005-689d-467d-ad0e-82c1321c1800 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.421816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2306b2b5-ab79-4ba6-8355-d9eb7791306a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:11.447297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62704669-df65-4973-a0c6-015990930455 req-2d8621eb-fc61-4b70-865d-2b8a3cecc583 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:11.448198 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62704669-df65-4973-a0c6-015990930455 req-2d8621eb-fc61-4b70-865d-2b8a3cecc583 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 944 time: 0.6104164 May 12 15:06:11.456354 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Network e7453c32-56d4-4bed-949a-c05a259218b1 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:06:11.461907 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28a73005-689d-467d-ad0e-82c1321c1800 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.462086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:06:11.472393 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:06:11.483865 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Pushing event updated for resources: {'Port': ['ID=f9158451-2a06-46ea-b709-f61479af74d9,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:11.517344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['adce94a7-30ae-4036-8a49-87df5c50c324'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:06:11.630633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:06:02Z', 'revision_number': 4, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port': {'id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:d5:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:05:54Z', 'updated_at': '2022-05-12T15:06:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5547b996-f6f1-4969-9052-5353e51dbe15', 'name': '', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'mac_address': 'fa:16:3e:bf:c0:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:01Z', 'updated_at': '2022-05-12T15:06:09Z', 'revision_number': 4, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'subnets': [{'id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:11.638219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Attempting to bind port f9158451-2a06-46ea-b709-f61479af74d9 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:06:11.638583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Attempting to bind port f9158451-2a06-46ea-b709-f61479af74d9 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '6c869e32-bb71-4864-ab9a-8535af830a80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'e7453c32-56d4-4bed-949a-c05a259218b1'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:06:11.638941 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Attempting to bind port f9158451-2a06-46ea-b709-f61479af74d9 on network e7453c32-56d4-4bed-949a-c05a259218b1 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:11.640001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-28a73005-689d-467d-ad0e-82c1321c1800 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=36842012465042b49a7670fcef9f2e0f&name=default HTTP/1.1" status: 200 len: 2979 time: 1.5494659 May 12 15:06:11.640796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28a73005-689d-467d-ad0e-82c1321c1800 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ed98418-f23f-42c0-8c79-c4f5d0b49a39,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:11.646158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45352) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:11.651022 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc6f05a7-1094-407d-ad5c-9ed193c20c19 None None] The sync data for ids ['fab022ae-aab5-4b4f-a77e-4570d094dd89'] in n-d-841483-1 is: [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:06:02Z', 'revision_number': 4, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port': {'id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:d5:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:05:54Z', 'updated_at': '2022-05-12T15:06:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5547b996-f6f1-4969-9052-5353e51dbe15', 'name': '', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'mac_address': 'fa:16:3e:bf:c0:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:01Z', 'updated_at': '2022-05-12T15:06:09Z', 'revision_number': 4, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'subnets': [{'id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:06:11.657018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 5, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:06:11.658107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Checking segment: {'id': '6c869e32-bb71-4864-ab9a-8535af830a80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'e7453c32-56d4-4bed-949a-c05a259218b1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:06:11.658107 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.658288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Bound using segment: {'id': '6c869e32-bb71-4864-ab9a-8535af830a80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'e7453c32-56d4-4bed-949a-c05a259218b1'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:06:11.658667 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Bound port: f9158451-2a06-46ea-b709-f61479af74d9, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6c869e32-bb71-4864-ab9a-8535af830a80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'e7453c32-56d4-4bed-949a-c05a259218b1'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:06:11.659099 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.703341 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62704669-df65-4973-a0c6-015990930455 req-c448c6c0-e51e-4caa-a346-757225031838 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2302899 May 12 15:06:11.785829 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.788317 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.886406 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] For port f9158451-2a06-46ea-b709-f61479af74d9, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:06:11.890209 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] For port f9158451-2a06-46ea-b709-f61479af74d9, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f9158451-2a06-46ea-b709-f61479af74d9,segment=NetworkSegment(6c869e32-bb71-4864-ab9a-8535af830a80),segment_id=6c869e32-bb71-4864-ab9a-8535af830a80)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:06:11.909277 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:11.964023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 41e26787-6db6-4aed-9809-d91a746dcee9 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:06:12.046297 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:12.055244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Router 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:06:12.056480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-43c0d92d-41b9-413e-97a5-49048d061979 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:12.058011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-43c0d92d-41b9-413e-97a5-49048d061979 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9&tenant_id=1b3825228b0e4c42a381540b66ea23d6 HTTP/1.1" status: 200 len: 1095 time: 0.6786828 May 12 15:06:12.074484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:06:12.086191 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:12.090550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:06:12.136492 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 41e26787-6db6-4aed-9809-d91a746dcee9 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:06:12.137727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47dc5e91-d10c-4d42-a270-79b4d212afe8 None None] Pushing event updated for resources: {'Port': ['ID=f9158451-2a06-46ea-b709-f61479af74d9,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:12.182971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:06:12.188695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:12.189452 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:12.228417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Pushing event updated for resources: {'Port': ['ID=bea6d555-5915-4366-91f7-7e9771e26806,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:12.291028 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:12.327948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c38c71d5-90b7-433e-b122-2d9be7ccc06a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:12.447735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-783ca6d2-9277-4cc9-bf91-13fcc4caad78 None None] Provisioning for port bea6d555-5915-4366-91f7-7e9771e26806 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:12.458521 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:12.460927 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9c79974-ba71-4ea0-9a06-a53a594baba7 req-10a17ee2-1cc8-481d-80e4-253b76120ff8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1782 time: 3.0335162 May 12 15:06:12.478532 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-783ca6d2-9277-4cc9-bf91-13fcc4caad78 None None] Provisioning complete for port bea6d555-5915-4366-91f7-7e9771e26806 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:12.481042 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-783ca6d2-9277-4cc9-bf91-13fcc4caad78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:12.515269 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-167b3cca-effa-45b1-b74a-99b91b5858ae tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 5.7269833 May 12 15:06:12.536712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Request body: {'port': {'device_id': '2a994cf2-e517-4ce3-a9fe-50d8a080508e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:12.572911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:06:12.583527 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:12.607586 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Sync routers for ids ['9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:06:12.627268 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Routers {'9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:06:12.627904 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:05:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:12.655824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:12.658535 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f65d76ce-c635-47e6-98ed-6cb73f8f7566 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 5.2409079 May 12 15:06:12.661887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45368) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:12.668225 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:06:12.686197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-783ca6d2-9277-4cc9-bf91-13fcc4caad78 None None] Port bea6d555-5915-4366-91f7-7e9771e26806 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:06:12.699099 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f4fa169a-1bd0-437b-9d38-449cc4ad2881 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:12.710390 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:12.896116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e5430b6d-6430-4a47-b068-7f891fa37da9 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:06:12.912105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-287d7cc1-1a1b-48ed-91c5-4179fc91faee req-89125a82-be07-4a49-ab35-502fb87de2ae tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:12.913735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-287d7cc1-1a1b-48ed-91c5-4179fc91faee req-89125a82-be07-4a49-ab35-502fb87de2ae tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 945 time: 0.9939919 May 12 15:06:12.936447 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:13.062539 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45380) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:13.100509 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Set router 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:06:13.274911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-25458942-97cd-4dcf-a78a-f5fe89cdb784 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:13.276275 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-25458942-97cd-4dcf-a78a-f5fe89cdb784 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 1095 time: 1.1829393 May 12 15:06:13.413057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Transition to ACTIVE for port object e5430b6d-6430-4a47-b068-7f891fa37da9 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:13.440564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:06:13.443860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device adce94a7-30ae-4036-8a49-87df5c50c324 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:13.635142 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9260e818-f3ab-4313-a442-8ee8275baf7a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:13.644208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5547b996-f6f1-4969-9052-5353e51dbe15 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:13.650867 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:13.659480 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'name': 'tempest-AttachSCSIVolumeTestJSON-451196841-router', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229'}], 'enable_snat': True}, 'gw_port_id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:06:07Z', 'updated_at': '2022-05-12T15:06:11Z', 'revision_number': 3, 'project_id': '3a478f0d02094addabf4cc31816a81f5', 'gw_port': {'id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ff:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:09Z', 'updated_at': '2022-05-12T15:06:10Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:13.668738 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Checking router: 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:06:13.669244 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Updating router 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 port b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:06:13.684436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9260e818-f3ab-4313-a442-8ee8275baf7a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:13.695999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9260e818-f3ab-4313-a442-8ee8275baf7a admin admin] Usage tracker for resource:security_group_rule and tenant:5e1a26465b974f689ac5e2204c10b690 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:13.700637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9260e818-f3ab-4313-a442-8ee8275baf7a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:13.827171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9260e818-f3ab-4313-a442-8ee8275baf7a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:13.836974 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 5547b996-f6f1-4969-9052-5353e51dbe15 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:13.853815 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:13.858262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 5547b996-f6f1-4969-9052-5353e51dbe15 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:13.858478 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:13.902667 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port adce94a7-30ae-4036-8a49-87df5c50c324 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:13.991009 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port adce94a7-30ae-4036-8a49-87df5c50c324 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:13.991380 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:14.027378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:14.039410 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:14.101281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-684b4413-f0ad-41e4-85e1-83eb97ce7487 None None] Network e7453c32-56d4-4bed-949a-c05a259218b1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:06:14.149303 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-287d7cc1-1a1b-48ed-91c5-4179fc91faee req-911a4a87-a5db-42e4-a38d-a8ecf4e21783 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 1.2132807 May 12 15:06:14.295362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:14.300682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-81e88a9f-6b3f-400c-9107-611828863a52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:14.303552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-81e88a9f-6b3f-400c-9107-611828863a52 service neutron] 10.222.0.76 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.9656563 May 12 15:06:14.340965 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9260e818-f3ab-4313-a442-8ee8275baf7a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:14.358602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ed98418-f23f-42c0-8c79-c4f5d0b49a39,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:14.363022 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9260e818-f3ab-4313-a442-8ee8275baf7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:14.369378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Pushing event updated for resources: {'Port': ['ID=e5430b6d-6430-4a47-b068-7f891fa37da9,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:14.376899 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1', 'mac_address': 'fa:16:3e:f6:2c:94', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.202'}], 'device_owner': 'compute:tempest-test_az-52089536', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:06:14.425360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9260e818-f3ab-4313-a442-8ee8275baf7a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a9fb098e-8ea3-4dcb-9fd2-74811bfcfe7e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:14.465096 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:14.491681 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9260e818-f3ab-4313-a442-8ee8275baf7a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5e1a26465b974f689ac5e2204c10b690&name=default HTTP/1.1" status: 200 len: 2979 time: 1.4279835 May 12 15:06:14.495593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45406) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:14.625583 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:14.630959 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6f1781b-1dd0-498f-bae1-0e874ddb275e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:14.640294 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Transition to ACTIVE for port object b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:14.656489 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:14.713299 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6f1781b-1dd0-498f-bae1-0e874ddb275e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:14.727917 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Attempting to bind port b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:06:14.728868 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Attempting to bind port b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:06:14.729427 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Attempting to bind port b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:14.747202 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 5, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:06:14.747849 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:06:14.748399 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:14.748934 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:06:14.749691 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Bound port: b0f516cc-4eeb-43e7-8139-6cc3d7974bc6, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:06:14.750240 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:14.842278 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] For port b0f516cc-4eeb-43e7-8139-6cc3d7974bc6, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:06:14.843535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Allocated IP 172.20.0.1 (e7453c32-56d4-4bed-949a-c05a259218b1/ab2c50b2-e633-495f-96cd-e23b8e03d46d/31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:06:14.846336 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] For port b0f516cc-4eeb-43e7-8139-6cc3d7974bc6, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b0f516cc-4eeb-43e7-8139-6cc3d7974bc6,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:06:14.857431 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:14.892287 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Routers {'9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:06:14.893163 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:05:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:14.939325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:14.939921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:14.940236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:14.940666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:14.941091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:14.942244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:14.943022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:14.943022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:14.943499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:14.944083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:14.944502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:14.944944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:15.025602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-1f9948c9-7962-4e8f-8b8b-f3d922dd4fd5 req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Request body: {'security_group': {'name': 'tempest-securitygroup-89806871', 'description': 'tempest-description-664825350'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:15.043807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:15.044298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:15.044730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:15.045173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:15.045620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:15.046047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:15.046607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:15.047024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:15.047438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:15.047851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:15.048265 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:15.048676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:15.065748 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-46277683-7b56-4b71-8ff5-91a332b79043 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=41e26787-6db6-4aed-9809-d91a746dcee9 HTTP/1.1" status: 200 len: 217 time: 0.1956222 May 12 15:06:15.068996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-1f9948c9-7962-4e8f-8b8b-f3d922dd4fd5 req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:15.109278 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] Set router 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:06:15.117043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1f9948c9-7962-4e8f-8b8b-f3d922dd4fd5 req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Usage tracker for resource:security_group and tenant:8bbaabbfb25445218d14a5645ed3ac41 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:15.127200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b54f5f43-b2d9-4a03-8588-29150c45815c req-4d70d6a1-a966-417f-ba8a-0b2e67f1d165 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:15.128093 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b54f5f43-b2d9-4a03-8588-29150c45815c req-4d70d6a1-a966-417f-ba8a-0b2e67f1d165 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Synchronizing usage tracker for tenant:7413f696702a49c390950b9a967696fa on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:06:15.131777 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:15.135263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3124f1ae-06e1-4851-ab31-78ff36804680 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5ed98418-f23f-42c0-8c79-c4f5d0b49a39 HTTP/1.1" status: 204 len: 168 time: 3.4750714 May 12 15:06:15.135263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1f9948c9-7962-4e8f-8b8b-f3d922dd4fd5 req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:15.158551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-1f9948c9-7962-4e8f-8b8b-f3d922dd4fd5 req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:15.165607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Attempting to bind port e5430b6d-6430-4a47-b068-7f891fa37da9 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:06:15.166065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Attempting to bind port e5430b6d-6430-4a47-b068-7f891fa37da9 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:06:15.166596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Attempting to bind port e5430b6d-6430-4a47-b068-7f891fa37da9 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:15.217439 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d5a25cea-4339-4e2e-bbd3-0d29c0c0f212 None None] Provisioning for port f9158451-2a06-46ea-b709-f61479af74d9 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:15.222966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Port e5430b6d-6430-4a47-b068-7f891fa37da9 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:06:15.227689 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Attempting to bind port e5430b6d-6430-4a47-b068-7f891fa37da9 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:15.303825 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 6, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:06:15.304243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:06:15.304752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:06:15.305296 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Bound port: e5430b6d-6430-4a47-b068-7f891fa37da9, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:06:15.305765 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:15.365929 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1f9948c9-7962-4e8f-8b8b-f3d922dd4fd5 req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:15.418259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-72b112c4-d1e8-4778-bb47-2463dff94bf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:15.419993 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-72b112c4-d1e8-4778-bb47-2463dff94bf0 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.3418150 May 12 15:06:15.428924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b54f5f43-b2d9-4a03-8588-29150c45815c req-4d70d6a1-a966-417f-ba8a-0b2e67f1d165 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Unset dirty status for tenant:7413f696702a49c390950b9a967696fa on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:06:15.436143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b54f5f43-b2d9-4a03-8588-29150c45815c req-4d70d6a1-a966-417f-ba8a-0b2e67f1d165 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 936 time: 2.5743144 May 12 15:06:15.537661 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6f1781b-1dd0-498f-bae1-0e874ddb275e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:15.550076 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0993e097-b866-4854-8d6e-e3d8cad198a0 None None] Pushing event updated for resources: {'Port': ['ID=b0f516cc-4eeb-43e7-8139-6cc3d7974bc6,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:15.572152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6f1781b-1dd0-498f-bae1-0e874ddb275e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9fb098e-8ea3-4dcb-9fd2-74811bfcfe7e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:15.580200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:15.605637 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6f1781b-1dd0-498f-bae1-0e874ddb275e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:15.617417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-6c1d35e2-97cb-4f22-9479-78079303070f service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1632056 May 12 15:06:15.626828 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c6f1781b-1dd0-498f-bae1-0e874ddb275e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a9fb098e-8ea3-4dcb-9fd2-74811bfcfe7e HTTP/1.1" status: 204 len: 168 time: 1.1159968 May 12 15:06:15.628434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Transition to ACTIVE for port object 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:15.630851 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:06:15.640029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-1f9948c9-7962-4e8f-8b8b-f3d922dd4fd5 req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:15.695260 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:15.714136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1f9948c9-7962-4e8f-8b8b-f3d922dd4fd5 req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Usage tracker for resource:security_group_rule and tenant:8bbaabbfb25445218d14a5645ed3ac41 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:15.738079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1f9948c9-7962-4e8f-8b8b-f3d922dd4fd5 req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:15.798821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b54f5f43-b2d9-4a03-8588-29150c45815c req-cd95f8ab-9825-4b60-aa35-8fd623bb22d3 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Synchronizing usage tracker for tenant:7413f696702a49c390950b9a967696fa on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:06:15.831328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-1f9948c9-7962-4e8f-8b8b-f3d922dd4fd5 req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:15.862411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Network e7453c32-56d4-4bed-949a-c05a259218b1 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:06:15.867999 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:15.876879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:06:15.888503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bea6d555-5915-4366-91f7-7e9771e26806 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:06:15.891973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:06:15.892439 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:15.894074 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:15.897295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Pushing event updated for resources: {'Port': ['ID=31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:15.913325 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:15.922325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] For port e5430b6d-6430-4a47-b068-7f891fa37da9, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:06:15.951173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] For port e5430b6d-6430-4a47-b068-7f891fa37da9, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e5430b6d-6430-4a47-b068-7f891fa37da9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:06:15.985372 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:16.011720 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0993e097-b866-4854-8d6e-e3d8cad198a0 None None] Pushing event updated for resources: {'Port': ['ID=b0f516cc-4eeb-43e7-8139-6cc3d7974bc6,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:16.013434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45422) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:16.057072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port adce94a7-30ae-4036-8a49-87df5c50c324, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=adce94a7-30ae-4036-8a49-87df5c50c324,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:16.058401 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'name': 'tempest-AttachSCSIVolumeTestJSON-451196841-router', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229'}], 'enable_snat': True}, 'gw_port_id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:06:07Z', 'updated_at': '2022-05-12T15:06:11Z', 'revision_number': 3, 'project_id': '3a478f0d02094addabf4cc31816a81f5', 'gw_port': {'id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ff:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:09Z', 'updated_at': '2022-05-12T15:06:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:16.068183 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5b1991e-15c9-41c9-ad29-f4ccc268843d None None] The sync data for ids ['9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'] in n-d-841483-1 is: [{'id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'name': 'tempest-AttachSCSIVolumeTestJSON-451196841-router', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229'}], 'enable_snat': True}, 'gw_port_id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:06:07Z', 'updated_at': '2022-05-12T15:06:11Z', 'revision_number': 3, 'project_id': '3a478f0d02094addabf4cc31816a81f5', 'gw_port': {'id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ff:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:09Z', 'updated_at': '2022-05-12T15:06:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:06:16.083198 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd3c9734-6025-4e26-956f-d74aa2dec898 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:16.091507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:06:16.107987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'adce94a7-30ae-4036-8a49-87df5c50c324'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:16.143739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dd3c9734-6025-4e26-956f-d74aa2dec898 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:16.144549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Transition to ACTIVE for port object bea6d555-5915-4366-91f7-7e9771e26806 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:16.152251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dd3c9734-6025-4e26-956f-d74aa2dec898 admin admin] Usage tracker for resource:security_group_rule and tenant:d46232611a524fffbd67da7477f6194b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:16.155484 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:16.158203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dd3c9734-6025-4e26-956f-d74aa2dec898 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:16.173072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dd3c9734-6025-4e26-956f-d74aa2dec898 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:16.208565 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:16.260590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:16.264764 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:16.267557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55ea39eb-db46-44fd-9083-b779e646405a req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] 10.222.0.84 "PUT /v2.0/ports/e5430b6d-6430-4a47-b068-7f891fa37da9 HTTP/1.1" status: 200 len: 1096 time: 5.4594100 May 12 15:06:16.294971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8d278524-0445-4a95-8564-3c04c2f3c41d', 'tag': 'e5430b6d-6430-4a47-b068-7f891fa37da9'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:16.353680 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:16.386012 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cc41b380-b21d-46a2-b27e-846b698a2730 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:16.418975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=adce94a7-30ae-4036-8a49-87df5c50c324,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:16.431903 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:16.464410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:16.464921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:16.465264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:16.465651 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:16.465978 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:16.466480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:16.466822 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:16.467247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:16.467573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:16.467894 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:16.468761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:16.468761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:06:16.479262 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-44ea7a9c-1307-4d77-9b39-4be2afad51a4 service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8295774 May 12 15:06:16.639437 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:16.666517 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:16.668595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:16.678861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1f9948c9-7962-4e8f-8b8b-f3d922dd4fd5 req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:16.699813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ebe03d-1c1a-44e1-9ba6-7f23317a1304 service neutron] Pushing event updated for resources: {'Port': ['ID=e5430b6d-6430-4a47-b068-7f891fa37da9,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:16.722481 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:16.733488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45434) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:16.787404 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0cc8c999-1499-4799-be1e-048b332bb73b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:16.921950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['1eade7b6-fd9d-4292-b6d7-67f0ba8285d1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:06:16.943139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0cc8c999-1499-4799-be1e-048b332bb73b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:17.052040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 5547b996-f6f1-4969-9052-5353e51dbe15, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5547b996-f6f1-4969-9052-5353e51dbe15,segment=NetworkSegment(49f41745-6217-458f-8fa0-7833e5e7c9df),segment_id=49f41745-6217-458f-8fa0-7833e5e7c9df)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:17.106097 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:17.118008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0cc8c999-1499-4799-be1e-048b332bb73b admin admin] Usage tracker for resource:security_group_rule and tenant:242ea8c75fc84c6283fdff98f58dd8a4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:17.120016 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.120882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f9158451-2a06-46ea-b709-f61479af74d9 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:17.143143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0cc8c999-1499-4799-be1e-048b332bb73b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:17.170890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0cc8c999-1499-4799-be1e-048b332bb73b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:17.188624 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd3c9734-6025-4e26-956f-d74aa2dec898 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.247922 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd3c9734-6025-4e26-956f-d74aa2dec898 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.251627 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1f9948c9-7962-4e8f-8b8b-f3d922dd4fd5 req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.329112 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-a2074d72-8bef-45da-ac28-9668c2515bc6 service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6328189 May 12 15:06:17.356188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e8e7e2a7-8316-4bd9-8886-27fe2c86c518,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:17.367874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd3c9734-6025-4e26-956f-d74aa2dec898 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=004eac69-50f5-421f-8188-2e376b5e16d8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:17.373615 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1f9948c9-7962-4e8f-8b8b-f3d922dd4fd5 req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.393471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f9948c9-7962-4e8f-8b8b-f3d922dd4fd5 req-8a348601-1629-45d2-a922-d8360db927dc tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 3.0111868 May 12 15:06:17.395554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b54f5f43-b2d9-4a03-8588-29150c45815c req-cd95f8ab-9825-4b60-aa35-8fd623bb22d3 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Unset dirty status for tenant:7413f696702a49c390950b9a967696fa on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:06:17.397979 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b54f5f43-b2d9-4a03-8588-29150c45815c req-cd95f8ab-9825-4b60-aa35-8fd623bb22d3 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.9597681 May 12 15:06:17.508617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=5547b996-f6f1-4969-9052-5353e51dbe15,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:17.592384 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dd3c9734-6025-4e26-956f-d74aa2dec898 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d46232611a524fffbd67da7477f6194b&name=default HTTP/1.1" status: 200 len: 2979 time: 1.5733130 May 12 15:06:17.604585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45440) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:17.612152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f9158451-2a06-46ea-b709-f61479af74d9 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:17.642394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f9158451-2a06-46ea-b709-f61479af74d9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:17.643351 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.763577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-94d5cf9e-1f8f-4311-acd2-673c70d44a66 None None] Provisioning complete for port f9158451-2a06-46ea-b709-f61479af74d9 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:17.764279 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-94d5cf9e-1f8f-4311-acd2-673c70d44a66 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.815250 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71e34dd6-1c93-4d08-89c7-249a686a5efd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.855977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71e34dd6-1c93-4d08-89c7-249a686a5efd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.867007 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.933520 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.967018 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.971090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Attempting to bind port bea6d555-5915-4366-91f7-7e9771e26806 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:06:17.971470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Attempting to bind port bea6d555-5915-4366-91f7-7e9771e26806 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:06:17.971753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Attempting to bind port bea6d555-5915-4366-91f7-7e9771e26806 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:17.972307 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.976919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71e34dd6-1c93-4d08-89c7-249a686a5efd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.983271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0cc8c999-1499-4799-be1e-048b332bb73b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:17.991223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Port bea6d555-5915-4366-91f7-7e9771e26806 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:06:17.991591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Attempting to bind port bea6d555-5915-4366-91f7-7e9771e26806 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:18.007722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ea39eb-db46-44fd-9083-b779e646405a req-6af1d06d-32de-4d8f-a043-a2594aa61a62 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:18.009497 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55ea39eb-db46-44fd-9083-b779e646405a req-6af1d06d-32de-4d8f-a043-a2594aa61a62 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=7413f696702a49c390950b9a967696fa&device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 1099 time: 1.6368475 May 12 15:06:18.010411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 6, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:06:18.010895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:06:18.012107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:06:18.012559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Bound port: bea6d555-5915-4366-91f7-7e9771e26806, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:06:18.012906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:18.032536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Pushing event updated for resources: {'Port': ['ID=bea6d555-5915-4366-91f7-7e9771e26806,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:18.109275 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0cc8c999-1499-4799-be1e-048b332bb73b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:18.130194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] For port bea6d555-5915-4366-91f7-7e9771e26806, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:06:18.132856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] For port bea6d555-5915-4366-91f7-7e9771e26806, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=bea6d555-5915-4366-91f7-7e9771e26806,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:06:18.148902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71e34dd6-1c93-4d08-89c7-249a686a5efd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=004eac69-50f5-421f-8188-2e376b5e16d8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:18.203888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d630c5c-77e7-4735-a74b-99c33c019d8b req-12e1e97a-baa1-4595-8f3d-a980ddd5c498 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:18.205511 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d630c5c-77e7-4735-a74b-99c33c019d8b req-12e1e97a-baa1-4595-8f3d-a980ddd5c498 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 946 time: 0.4771459 May 12 15:06:18.229870 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:18.278848 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71e34dd6-1c93-4d08-89c7-249a686a5efd admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:18.286945 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-71e34dd6-1c93-4d08-89c7-249a686a5efd admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/004eac69-50f5-421f-8188-2e376b5e16d8 HTTP/1.1" status: 204 len: 168 time: 0.6764264 May 12 15:06:18.306829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Pushing event updated for resources: {'Port': ['ID=31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:18.349234 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-94d5cf9e-1f8f-4311-acd2-673c70d44a66 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:18.351609 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0cc8c999-1499-4799-be1e-048b332bb73b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=242ea8c75fc84c6283fdff98f58dd8a4&name=default HTTP/1.1" status: 200 len: 2979 time: 1.6148641 May 12 15:06:18.357351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45446) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:18.362205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:18.363212 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:18.374273 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] 10.222.0.76 "PUT /v2.0/ports/bea6d555-5915-4366-91f7-7e9771e26806 HTTP/1.1" status: 200 len: 1096 time: 5.8397985 May 12 15:06:18.391110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cc8c999-1499-4799-be1e-048b332bb73b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6709c0ec-59ff-4b8b-8381-27e8ecc54526,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:18.422734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e5b88d8-e87c-4289-8a9b-b4928e04dbb6 service neutron] Pushing event updated for resources: {'Port': ['ID=bea6d555-5915-4366-91f7-7e9771e26806,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:18.448922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55ea39eb-db46-44fd-9083-b779e646405a req-1574b140-c00d-4980-a110-60758fb10f08 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.108&port_id=e5430b6d-6430-4a47-b068-7f891fa37da9 HTTP/1.1" status: 200 len: 217 time: 0.4098694 May 12 15:06:18.456017 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:18.542565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-94d5cf9e-1f8f-4311-acd2-673c70d44a66 None None] For port f9158451-2a06-46ea-b709-f61479af74d9, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f9158451-2a06-46ea-b709-f61479af74d9,segment=NetworkSegment(6c869e32-bb71-4864-ab9a-8535af830a80),segment_id=6c869e32-bb71-4864-ab9a-8535af830a80)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:18.560719 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-94d5cf9e-1f8f-4311-acd2-673c70d44a66 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:18.665158 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Network e7453c32-56d4-4bed-949a-c05a259218b1 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:06:18.673417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6886bb35-5ed0-430d-8b36-296e24a2eecf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:18.684624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:06:18.714331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13339337-7570-455f-b12a-1481bcd14661 req-150a1eab-9717-45b3-b57c-8041b69aeeea tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:18.721590 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13339337-7570-455f-b12a-1481bcd14661 req-150a1eab-9717-45b3-b57c-8041b69aeeea tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 944 time: 0.9991326 May 12 15:06:18.725495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-6b6b28ca-9e38-4630-a21a-103791f67977 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:18.726916 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-6b6b28ca-9e38-4630-a21a-103791f67977 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9&tenant_id=1b3825228b0e4c42a381540b66ea23d6&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 1095 time: 0.8738744 May 12 15:06:18.786521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:18.926332 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6886bb35-5ed0-430d-8b36-296e24a2eecf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:18.984823 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d630c5c-77e7-4735-a74b-99c33c019d8b req-f7710dc7-1003-414f-bc15-2d54ec701f34 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.7681310 May 12 15:06:18.999885 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:06:19.000357 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:06:19.081926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-098dfb60-683e-429e-87cd-fef18f53f067 None None] Provisioning for port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:19.088550 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13339337-7570-455f-b12a-1481bcd14661 req-7af8515f-f047-4c42-a287-5663edf75b9a tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3661180 May 12 15:06:19.093236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ea39eb-db46-44fd-9083-b779e646405a req-90633764-477d-468e-a522-fb36c2443106 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:19.095682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55ea39eb-db46-44fd-9083-b779e646405a req-90633764-477d-468e-a522-fb36c2443106 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.4649377 May 12 15:06:19.133659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-098dfb60-683e-429e-87cd-fef18f53f067 None None] Provisioning complete for port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:19.134121 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-098dfb60-683e-429e-87cd-fef18f53f067 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:19.238141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-6430b7ae-da6c-4e91-94c7-9c9ec2274fb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:19.240467 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-6430b7ae-da6c-4e91-94c7-9c9ec2274fb4 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=7413f696702a49c390950b9a967696fa&device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 1099 time: 0.7804797 May 12 15:06:19.326569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94d5cf9e-1f8f-4311-acd2-673c70d44a66 None None] Pushing event updated for resources: {'Port': ['ID=f9158451-2a06-46ea-b709-f61479af74d9,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:19.350353 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ee6740d2-19a8-47c7-896e-c650381fb70e'] response: {'server_uuid': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'adce94a7-30ae-4036-8a49-87df5c50c324', 'code': 200} May 12 15:06:19.354610 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6886bb35-5ed0-430d-8b36-296e24a2eecf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:19.382907 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:19.383846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6886bb35-5ed0-430d-8b36-296e24a2eecf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6709c0ec-59ff-4b8b-8381-27e8ecc54526,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:19.387445 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:19.404250 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6886bb35-5ed0-430d-8b36-296e24a2eecf admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:19.408738 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6886bb35-5ed0-430d-8b36-296e24a2eecf admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6709c0ec-59ff-4b8b-8381-27e8ecc54526 HTTP/1.1" status: 204 len: 168 time: 1.0450902 May 12 15:06:19.414632 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-31119d0d-f5c9-4c40-9324-e948c5cf1eb7'] response: {'name': 'network-changed', 'server_uuid': '8d278524-0445-4a95-8564-3c04c2f3c41d', 'tag': 'e5430b6d-6430-4a47-b068-7f891fa37da9', 'status': 'completed', 'code': 200} May 12 15:06:19.428899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Router 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:06:19.561536 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-2f2fc07d-2b3a-4b21-bad5-1de51f2e6651 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.127&port_id=bea6d555-5915-4366-91f7-7e9771e26806 HTTP/1.1" status: 200 len: 217 time: 0.3015647 May 12 15:06:19.642811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-098dfb60-683e-429e-87cd-fef18f53f067 None None] Port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:06:19.687380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-5c3c0027-b639-4cd5-9ddf-ab9d6b8576db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:19.688801 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-5c3c0027-b639-4cd5-9ddf-ab9d6b8576db service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1022894 May 12 15:06:19.721467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-eb05a8e1-2597-415b-be85-9f31fcaa5144 service neutron] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:06:19.774939 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-eb05a8e1-2597-415b-be85-9f31fcaa5144 service neutron] Notify callbacks [] for binding, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:19.776001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716e1e9a-4b57-4d9f-b3c5-fa9b2e40b8e8 req-eb05a8e1-2597-415b-be85-9f31fcaa5144 service neutron] 10.222.0.76 "DELETE /v2.0/ports/41e26787-6db6-4aed-9809-d91a746dcee9/bindings/n-h1-841483-1 HTTP/1.1" status: 204 len: 173 time: 0.9689460 May 12 15:06:19.806279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Request body: {'security_group': {'name': 'tempest-securitygroup-1365052596', 'description': 'tempest-description-1950122512'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:19.812596 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:19.836334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:19.842553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ea39eb-db46-44fd-9083-b779e646405a req-eba44e0d-95f2-432d-ad0c-92ba5ade971a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:19.852108 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55ea39eb-db46-44fd-9083-b779e646405a req-eba44e0d-95f2-432d-ad0c-92ba5ade971a service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.7435856 May 12 15:06:19.875284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Usage tracker for resource:security_group and tenant:88b7de9679da43a4a76a9546c6cb90b2 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:19.884023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Quota usage for security_group was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:19.922642 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Attempting to reserve 1 items for resource security_group. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:19.925436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c66082a5-3f3e-47da-a503-0e011488d93e None None] Provisioning complete for port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:19.926378 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c66082a5-3f3e-47da-a503-0e011488d93e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:19.949731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:06:19.971764 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-62051c3c-6d9f-430c-8b9c-032e19390c28 admin admin] 10.222.0.82 "PUT /v2.0/routers/9e25e09f-2315-4fe8-9d09-cfcdf109bcf4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.3037772 May 12 15:06:19.999050 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:20.000272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Sync routers for ids ['9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:06:20.043023 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:20.108378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93c9f640-e357-4a9c-a1fa-c3dc29538053 req-b5b30d70-08ae-4707-9f32-2ac1e12fa929 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:20.120605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93c9f640-e357-4a9c-a1fa-c3dc29538053 req-b5b30d70-08ae-4707-9f32-2ac1e12fa929 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 948 time: 0.5350280 May 12 15:06:20.149592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:20.178900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5c767e-d4e4-437b-9a5a-dfb927e3e073 req-918119ec-c768-4d62-bab3-6d2eccfbf507 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:20.182051 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec5c767e-d4e4-437b-9a5a-dfb927e3e073 req-918119ec-c768-4d62-bab3-6d2eccfbf507 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 1097 time: 0.8110583 May 12 15:06:20.185431 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:20.221268 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:20.328234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Routers {'9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:06:20.328884 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:06:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:20.469057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,revision_number=10']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:20.539410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:20.556853 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-f813a8e6-e0f9-432a-a296-57a70fb10aec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:20.558720 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-f813a8e6-e0f9-432a-a296-57a70fb10aec service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.8301444 May 12 15:06:20.588580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Usage tracker for resource:security_group_rule and tenant:88b7de9679da43a4a76a9546c6cb90b2 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:20.618101 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93c9f640-e357-4a9c-a1fa-c3dc29538053 req-a86ffa45-66b4-48bc-9ce0-5b1d850e83bc tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4941962 May 12 15:06:20.699863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:20.755890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:20.761501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Set router 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:06:20.963396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c66082a5-3f3e-47da-a503-0e011488d93e None None] Port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:06:21.054765 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec5c767e-d4e4-437b-9a5a-dfb927e3e073 req-0d47493c-d357-4078-a153-38ec526fbfa6 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.8487442 May 12 15:06:21.074710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55ea39eb-db46-44fd-9083-b779e646405a req-9b0e6e70-a521-4501-8f08-a89dcffa6118 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.1915073 May 12 15:06:21.188943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:21.232253 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:21.233360 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:21.416841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2a994cf2-e517-4ce3-a9fe-50d8a080508e', 'tag': 'bea6d555-5915-4366-91f7-7e9771e26806'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:21.496771 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:21.655789 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:21.677443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port b0f516cc-4eeb-43e7-8139-6cc3d7974bc6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b0f516cc-4eeb-43e7-8139-6cc3d7974bc6,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:21.697491 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:21.698703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5547b996-f6f1-4969-9052-5353e51dbe15 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:21.923547 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:21.927341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'name': 'tempest-AttachSCSIVolumeTestJSON-451196841-router', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229'}], 'enable_snat': True}, 'gw_port_id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:06:07Z', 'updated_at': '2022-05-12T15:06:16Z', 'revision_number': 4, 'project_id': '3a478f0d02094addabf4cc31816a81f5', 'gw_port': {'id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ff:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:09Z', 'updated_at': '2022-05-12T15:06:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30', 'name': '', 'network_id': 'e7453c32-56d4-4bed-949a-c05a259218b1', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'mac_address': 'fa:16:3e:81:4f:a7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'device_owner': 'network:router_interface', 'standard_attr_id': 403, 'fixed_ips': [{'subnet_id': 'ab2c50b2-e633-495f-96cd-e23b8e03d46d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:14Z', 'updated_at': '2022-05-12T15:06:16Z', 'revision_number': 2, 'project_id': '3a478f0d02094addabf4cc31816a81f5', 'subnets': [{'id': 'ab2c50b2-e633-495f-96cd-e23b8e03d46d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:21.948935 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-278579ac-c1ce-4288-8f9e-e17b20bcd651 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.3014522 May 12 15:06:21.959239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Checking router: 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:06:21.959680 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Updating router 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:06:21.969358 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:22.063049 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:22.148981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:22.162964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=432e9fab-3b4e-4ffa-bf3e-0a2a467c0c53,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:22.196726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 5547b996-f6f1-4969-9052-5353e51dbe15 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:22.197018 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:22.279742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=b0f516cc-4eeb-43e7-8139-6cc3d7974bc6,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:22.360071 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b76413e-69e7-4c77-aa13-f3ffc152d5eb req-8caaca56-b5b8-4651-9919-91a9513c434d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:22.381697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b76413e-69e7-4c77-aa13-f3ffc152d5eb req-8caaca56-b5b8-4651-9919-91a9513c434d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 946 time: 1.4906743 May 12 15:06:22.383902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Usage tracker for resource:security_group_rule and tenant:88b7de9679da43a4a76a9546c6cb90b2 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:22.453912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:22.635234 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b76413e-69e7-4c77-aa13-f3ffc152d5eb req-f03b1227-6435-4848-a38a-17ebbe8289f4 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2503679 May 12 15:06:22.650876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:23.086888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55ea39eb-db46-44fd-9083-b779e646405a req-0138d75b-3f55-4da5-a8cd-8afecc03121f service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.9078350 May 12 15:06:23.190059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f9158451-2a06-46ea-b709-f61479af74d9 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:23.643991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0259efd4-dcfd-428b-a2b0-45b3078898d9 req-e86e7c5b-9a78-46b8-8b9e-9739a796ba47 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.6774275 May 12 15:06:23.679753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f9158451-2a06-46ea-b709-f61479af74d9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:23.680125 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:23.881735 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:23.909474 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:24.046183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ca3e6d8-7dfb-486a-9a3d-6f52d599174b req-77e489ee-2c9b-44f9-a746-812424188ab9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:24.060956 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ca3e6d8-7dfb-486a-9a3d-6f52d599174b req-77e489ee-2c9b-44f9-a746-812424188ab9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 944 time: 0.9600937 May 12 15:06:24.162599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20e0a3b-2bc0-4d7d-b76b-575296c7fc94 req-223b9c30-8798-4b16-b487-efe0e8179a09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:24.165066 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d20e0a3b-2bc0-4d7d-b76b-575296c7fc94 req-223b9c30-8798-4b16-b487-efe0e8179a09 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=7413f696702a49c390950b9a967696fa&device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 1099 time: 0.7589569 May 12 15:06:24.169731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4de741f0-a381-4d3c-a9a7-7e89914db967,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:24.176912 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:24.178935 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-beb70d2c-1722-4499-84a8-f4156327aec7 req-72227e39-6022-449c-a7d1-57070de0f9ba tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1783 time: 4.4001982 May 12 15:06:24.214403 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:24.229472 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ca3e6d8-7dfb-486a-9a3d-6f52d599174b req-9d6d1257-a56e-4b6d-a7ac-c2cd6cb5db16 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1664326 May 12 15:06:24.264057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Transition to ACTIVE for port object 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:24.293262 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:24.480419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:24.566096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20e0a3b-2bc0-4d7d-b76b-575296c7fc94 req-2ae4da68-4d51-4328-b010-f6f7b4a3f9a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:24.569167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d20e0a3b-2bc0-4d7d-b76b-575296c7fc94 req-2ae4da68-4d51-4328-b010-f6f7b4a3f9a4 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.3891478 May 12 15:06:24.622578 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-948d2905-ba7c-49bf-b7c0-e069576cf933'] response: {'server_uuid': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1', 'code': 200} May 12 15:06:24.678252 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d20e0a3b-2bc0-4d7d-b76b-575296c7fc94 req-d1ae06ac-2d73-4056-97f2-32c7f4510c02 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.108&port_id=e5430b6d-6430-4a47-b068-7f891fa37da9 HTTP/1.1" status: 200 len: 217 time: 0.0981910 May 12 15:06:24.993156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20e0a3b-2bc0-4d7d-b76b-575296c7fc94 req-25ca4390-0630-4de3-ab15-434a863602a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:24.994992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d20e0a3b-2bc0-4d7d-b76b-575296c7fc94 req-25ca4390-0630-4de3-ab15-434a863602a3 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3091695 May 12 15:06:25.032179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd3fc4ba-5f24-4de9-aaba-4dbd7cd35515 None None] Pushing event updated for resources: {'Port': ['ID=31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:25.112868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bd7b6c4-5a01-4770-9d26-e1ae66502ff8 req-83c2981e-145b-4cf4-bfc1-e43ba6100d4e tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:25.118637 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6bd7b6c4-5a01-4770-9d26-e1ae66502ff8 req-83c2981e-145b-4cf4-bfc1-e43ba6100d4e tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 948 time: 0.3229656 May 12 15:06:25.125944 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Attempting to bind port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:06:25.126328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Attempting to bind port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '6c869e32-bb71-4864-ab9a-8535af830a80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'e7453c32-56d4-4bed-949a-c05a259218b1'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:06:25.127035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Attempting to bind port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 on network e7453c32-56d4-4bed-949a-c05a259218b1 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:25.131915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:25.132287 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:25.175173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 6, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:06:25.176231 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Checking segment: {'id': '6c869e32-bb71-4864-ab9a-8535af830a80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'e7453c32-56d4-4bed-949a-c05a259218b1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:06:25.176647 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:25.177053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Bound using segment: {'id': '6c869e32-bb71-4864-ab9a-8535af830a80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'e7453c32-56d4-4bed-949a-c05a259218b1'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:06:25.177595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Bound port: 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6c869e32-bb71-4864-ab9a-8535af830a80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'e7453c32-56d4-4bed-949a-c05a259218b1'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:06:25.177969 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:25.188558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20e0a3b-2bc0-4d7d-b76b-575296c7fc94 req-44301918-6e11-4ea7-8bbc-2af85bded0c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:25.191038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d20e0a3b-2bc0-4d7d-b76b-575296c7fc94 req-44301918-6e11-4ea7-8bbc-2af85bded0c3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1848304 May 12 15:06:25.195652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6bd7b6c4-5a01-4770-9d26-e1ae66502ff8 req-6f9b6f53-4621-40bb-9a1a-719f72ba5725 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656667 May 12 15:06:25.314403 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] For port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:06:25.364573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] For port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30,segment=NetworkSegment(6c869e32-bb71-4864-ab9a-8535af830a80),segment_id=6c869e32-bb71-4864-ab9a-8535af830a80)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:06:25.376871 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:25.380377 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8f786420-f360-4ab7-a9a6-27794a28eb0b'] response: {'name': 'network-changed', 'server_uuid': '2a994cf2-e517-4ce3-a9fe-50d8a080508e', 'tag': 'bea6d555-5915-4366-91f7-7e9771e26806', 'status': 'completed', 'code': 200} May 12 15:06:25.474001 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Routers {'9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:06:25.474617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:06:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:25.615456 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:06:25.655648 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd3fc4ba-5f24-4de9-aaba-4dbd7cd35515 None None] Pushing event updated for resources: {'Port': ['ID=31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:25.886712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] Set router 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:06:25.997563 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d20e0a3b-2bc0-4d7d-b76b-575296c7fc94 req-07447e45-c22e-4a64-b9c2-f79be9a36b8b service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7963758 May 12 15:06:26.033953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e5430b6d-6430-4a47-b068-7f891fa37da9 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:06:26.521669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d20e0a3b-2bc0-4d7d-b76b-575296c7fc94 req-1e1996e7-4eb9-432e-b699-965dfb81b3fa service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5091121 May 12 15:06:26.554913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ac02593-53e9-4b35-90d6-5195bf1509d1 req-b69f5a6e-2333-4e38-89d4-c9abffda7421 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:26.562567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ac02593-53e9-4b35-90d6-5195bf1509d1 req-b69f5a6e-2333-4e38-89d4-c9abffda7421 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 946 time: 0.9734178 May 12 15:06:26.599935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65521e40-29f3-4e38-b205-d77dddd762f5 req-50d6ae89-7d47-43a2-93f4-21364195ce8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:26.601599 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65521e40-29f3-4e38-b205-d77dddd762f5 req-50d6ae89-7d47-43a2-93f4-21364195ce8c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=7413f696702a49c390950b9a967696fa&device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 1099 time: 1.2164829 May 12 15:06:26.715319 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ac02593-53e9-4b35-90d6-5195bf1509d1 req-de146533-8103-4d71-8695-8733f2badd5b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1519880 May 12 15:06:26.784216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'name': 'tempest-AttachSCSIVolumeTestJSON-451196841-router', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229'}], 'enable_snat': True}, 'gw_port_id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:06:07Z', 'updated_at': '2022-05-12T15:06:16Z', 'revision_number': 4, 'project_id': '3a478f0d02094addabf4cc31816a81f5', 'gw_port': {'id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ff:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:09Z', 'updated_at': '2022-05-12T15:06:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30', 'name': '', 'network_id': 'e7453c32-56d4-4bed-949a-c05a259218b1', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'mac_address': 'fa:16:3e:81:4f:a7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'device_owner': 'network:router_interface', 'standard_attr_id': 403, 'fixed_ips': [{'subnet_id': 'ab2c50b2-e633-495f-96cd-e23b8e03d46d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:14Z', 'updated_at': '2022-05-12T15:06:25Z', 'revision_number': 4, 'project_id': '3a478f0d02094addabf4cc31816a81f5', 'subnets': [{'id': 'ab2c50b2-e633-495f-96cd-e23b8e03d46d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:26.791785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abbae3c2-c417-465f-bae4-8c7bde09cf48 None None] The sync data for ids ['9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'] in n-d-841483-1 is: [{'id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'name': 'tempest-AttachSCSIVolumeTestJSON-451196841-router', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229'}], 'enable_snat': True}, 'gw_port_id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:06:07Z', 'updated_at': '2022-05-12T15:06:16Z', 'revision_number': 4, 'project_id': '3a478f0d02094addabf4cc31816a81f5', 'gw_port': {'id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ff:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:09Z', 'updated_at': '2022-05-12T15:06:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30', 'name': '', 'network_id': 'e7453c32-56d4-4bed-949a-c05a259218b1', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'mac_address': 'fa:16:3e:81:4f:a7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'device_owner': 'network:router_interface', 'standard_attr_id': 403, 'fixed_ips': [{'subnet_id': 'ab2c50b2-e633-495f-96cd-e23b8e03d46d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:14Z', 'updated_at': '2022-05-12T15:06:25Z', 'revision_number': 4, 'project_id': '3a478f0d02094addabf4cc31816a81f5', 'subnets': [{'id': 'ab2c50b2-e633-495f-96cd-e23b8e03d46d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:06:26.799715 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-64eebb06-dbde-4ad6-9557-9f5f6e1ea7b7 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=0da54985cde346e68eeadf965b8bc6d3&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0545671 May 12 15:06:26.809151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device bea6d555-5915-4366-91f7-7e9771e26806 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:06:26.819337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e5430b6d-6430-4a47-b068-7f891fa37da9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e5430b6d-6430-4a47-b068-7f891fa37da9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:26.820650 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-182bddba-8fc1-4650-a95e-bbc4dcda63bf req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Request body: {'security_group': {'name': 'tempest-securitygroup-1141489758', 'description': 'tempest-description-1317384319'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:26.829611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-182bddba-8fc1-4650-a95e-bbc4dcda63bf req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:26.834578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-182bddba-8fc1-4650-a95e-bbc4dcda63bf req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Usage tracker for resource:security_group and tenant:88b7de9679da43a4a76a9546c6cb90b2 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:26.838265 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-182bddba-8fc1-4650-a95e-bbc4dcda63bf req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Quota usage for security_group was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:26.844908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-182bddba-8fc1-4650-a95e-bbc4dcda63bf req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:26.923141 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-182bddba-8fc1-4650-a95e-bbc4dcda63bf req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:26.923741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'e5430b6d-6430-4a47-b068-7f891fa37da9', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'e5430b6d-6430-4a47-b068-7f891fa37da9', 'mac_address': 'fa:16:3e:98:d4:eb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.108'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:06:27.075140 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:27.088258 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:06:27.210048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-f8e3c4c8-2d7d-4224-aef0-e9a493c145c4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:27.228435 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-f8e3c4c8-2d7d-4224-aef0-e9a493c145c4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4177222 May 12 15:06:27.241108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-182bddba-8fc1-4650-a95e-bbc4dcda63bf req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:27.308450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-90d0947d-82ee-4cb1-b327-733b8891dd13 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/quotas/0da54985cde346e68eeadf965b8bc6d3 HTTP/1.1" status: 200 len: 375 time: 0.0687542 May 12 15:06:27.311962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port bea6d555-5915-4366-91f7-7e9771e26806, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=bea6d555-5915-4366-91f7-7e9771e26806,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:27.313255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-182bddba-8fc1-4650-a95e-bbc4dcda63bf req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Usage tracker for resource:security_group_rule and tenant:88b7de9679da43a4a76a9546c6cb90b2 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:27.325354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-182bddba-8fc1-4650-a95e-bbc4dcda63bf req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:27.355620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'bea6d555-5915-4366-91f7-7e9771e26806', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'bea6d555-5915-4366-91f7-7e9771e26806', 'mac_address': 'fa:16:3e:07:ff:34', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.127'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:06:27.363369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e5430b6d-6430-4a47-b068-7f891fa37da9 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:06:27.429188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-182bddba-8fc1-4650-a95e-bbc4dcda63bf req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:27.432271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65521e40-29f3-4e38-b205-d77dddd762f5 req-d3113f5b-8250-4544-a5c4-5d25321b9dd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:27.433711 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65521e40-29f3-4e38-b205-d77dddd762f5 req-d3113f5b-8250-4544-a5c4-5d25321b9dd5 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.8207080 May 12 15:06:27.445865 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-28664d5d-75d0-4651-a729-9a62204256d7 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1215951 May 12 15:06:27.477491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e5430b6d-6430-4a47-b068-7f891fa37da9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e5430b6d-6430-4a47-b068-7f891fa37da9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:27.491229 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:27.631436 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65521e40-29f3-4e38-b205-d77dddd762f5 req-423d3f8e-a77a-4012-b79a-b9f3756777ba service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.127&port_id=bea6d555-5915-4366-91f7-7e9771e26806 HTTP/1.1" status: 200 len: 217 time: 0.1828513 May 12 15:06:27.661665 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=e5430b6d-6430-4a47-b068-7f891fa37da9,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:27.677907 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:27.734144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bea6d555-5915-4366-91f7-7e9771e26806 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:06:27.802307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port bea6d555-5915-4366-91f7-7e9771e26806, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=bea6d555-5915-4366-91f7-7e9771e26806,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:27.821018 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:27.843521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65521e40-29f3-4e38-b205-d77dddd762f5 req-72c8d3e7-b98e-48e4-ad9d-02b32e2c77e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:27.848012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65521e40-29f3-4e38-b205-d77dddd762f5 req-72c8d3e7-b98e-48e4-ad9d-02b32e2c77e6 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1750696 May 12 15:06:28.277843 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=bea6d555-5915-4366-91f7-7e9771e26806,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:28.307846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['e5430b6d-6430-4a47-b068-7f891fa37da9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:06:28.327885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65521e40-29f3-4e38-b205-d77dddd762f5 req-539e9536-02fb-4e47-bb70-a29b36e7dadf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:28.332397 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65521e40-29f3-4e38-b205-d77dddd762f5 req-539e9536-02fb-4e47-bb70-a29b36e7dadf service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.4636998 May 12 15:06:28.595601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:28.750402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['bea6d555-5915-4366-91f7-7e9771e26806'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:06:28.787538 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-182bddba-8fc1-4650-a95e-bbc4dcda63bf req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:28.826527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65521e40-29f3-4e38-b205-d77dddd762f5 req-80773fc1-2760-4964-a7e1-d3ab143831a3 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4850423 May 12 15:06:28.832459 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-182bddba-8fc1-4650-a95e-bbc4dcda63bf req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:28.997089 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:29.000665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dcce002f-2b94-4e02-a679-8bc9c09468ca,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:29.025539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:29.026204 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:29.132483 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-182bddba-8fc1-4650-a95e-bbc4dcda63bf req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:29.143923 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-182bddba-8fc1-4650-a95e-bbc4dcda63bf req-7d9211a5-685e-40bf-8254-33417f4b5318 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1783 time: 2.3399298 May 12 15:06:29.255757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db88050f-184a-4221-9ab5-8794568a7895 req-3ffe81c8-b3b3-4cf6-9ae3-69dd7e8240d6 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:29.266936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db88050f-184a-4221-9ab5-8794568a7895 req-3ffe81c8-b3b3-4cf6-9ae3-69dd7e8240d6 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 949 time: 0.8387172 May 12 15:06:29.276193 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:29.405538 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65521e40-29f3-4e38-b205-d77dddd762f5 req-27f96529-87d0-4b28-95b2-f1b17fc2e7cf service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5600524 May 12 15:06:29.483438 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30,segment=NetworkSegment(6c869e32-bb71-4864-ab9a-8535af830a80),segment_id=6c869e32-bb71-4864-ab9a-8535af830a80)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:29.498275 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:29.545857 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db88050f-184a-4221-9ab5-8794568a7895 req-7a721240-c540-4691-9275-b55165cf3d70 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2773643 May 12 15:06:29.572314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eb7866c-470d-4a76-b846-d16244d838ea req-fbe00df3-89c7-47f8-bf88-b4a6b2fb2476 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:29.584793 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45620) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:29.595032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1eb7866c-470d-4a76-b846-d16244d838ea req-fbe00df3-89c7-47f8-bf88-b4a6b2fb2476 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 946 time: 0.1846242 May 12 15:06:29.596240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-fcfa8678-cbb1-4b2f-bb0c-c0cfc154946c tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Request body: {'floatingip': {'port_id': 'adce94a7-30ae-4036-8a49-87df5c50c324'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:29.609935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:29.706332 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fcfa8678-cbb1-4b2f-bb0c-c0cfc154946c tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for floatingip, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:29.827484 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-310aa64d-1784-410d-b986-3baac229e4c5 req-d4d4a19d-60e7-48aa-aa2f-13c1d6eb90a1 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 210 time: 0.1051142 May 12 15:06:30.034300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31a9fb53-edb7-4fb4-b2c8-2ec538d75cbe req-59dccd01-4f5d-49e8-881a-75ac08f3857e tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:30.037333 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31a9fb53-edb7-4fb4-b2c8-2ec538d75cbe req-59dccd01-4f5d-49e8-881a-75ac08f3857e tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 1095 time: 0.1336563 May 12 15:06:30.049806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e5430b6d-6430-4a47-b068-7f891fa37da9 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:30.150828 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31a9fb53-edb7-4fb4-b2c8-2ec538d75cbe req-853ff4b0-7f45-4f00-846a-5526cd846eb4 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1056199 May 12 15:06:30.174318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-6db90482-ac27-4b78-abe8-45675084bd78 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=0da54985cde346e68eeadf965b8bc6d3&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0806024 May 12 15:06:30.517730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port e5430b6d-6430-4a47-b068-7f891fa37da9 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:30.519315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port e5430b6d-6430-4a47-b068-7f891fa37da9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:30.523574 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:30.680953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:30.844957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device bea6d555-5915-4366-91f7-7e9771e26806 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:31.303362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:31.303362 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:31.333044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port bea6d555-5915-4366-91f7-7e9771e26806 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:31.413334 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port bea6d555-5915-4366-91f7-7e9771e26806 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:31.417927 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:31.543729 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [None req-fcfa8678-cbb1-4b2f-bb0c-c0cfc154946c tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:06:31.573178 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-b20146db-9ad2-4f89-8ccf-12c4240e12f5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:31.575007 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-b20146db-9ad2-4f89-8ccf-12c4240e12f5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 1.3926764 May 12 15:06:31.583569 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:31.607833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Request body: {'port': {'device_id': '86881e13-2515-46d4-a5a5-4bc93a1b8647', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '0da54985cde346e68eeadf965b8bc6d3'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:31.714653 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8d278524-0445-4a95-8564-3c04c2f3c41d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e5430b6d-6430-4a47-b068-7f891fa37da9'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:31.760279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b437543-eb0b-4926-8b44-4d2ba6018f42 req-1390c8a4-b07c-47ec-8401-67ad254cdb86 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:31.762520 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b437543-eb0b-4926-8b44-4d2ba6018f42 req-1390c8a4-b07c-47ec-8401-67ad254cdb86 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 949 time: 0.6841733 May 12 15:06:31.775200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fcfa8678-cbb1-4b2f-bb0c-c0cfc154946c tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:31.784351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fcfa8678-cbb1-4b2f-bb0c-c0cfc154946c tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:31.881429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e5430b6d-6430-4a47-b068-7f891fa37da9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e5430b6d-6430-4a47-b068-7f891fa37da9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:31.998580 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b437543-eb0b-4926-8b44-4d2ba6018f42 req-d3c3804a-76d9-453f-99bd-ff246b503abd tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2223458 May 12 15:06:32.040994 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-fcfa8678-cbb1-4b2f-bb0c-c0cfc154946c tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Floating IP d8eaf86b-fcbd-4ca9-8430-1ddde3b94626 associated. External IP: 172.25.8.60, port: adce94a7-30ae-4036-8a49-87df5c50c324. May 12 15:06:32.076595 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:32.148746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:32.163005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Usage tracker for resource:port and tenant:0da54985cde346e68eeadf965b8bc6d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:32.174302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:32.201147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:32.231661 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:32.292849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Made reservation on behalf of 0da54985cde346e68eeadf965b8bc6d3 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:06:32.297378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:32.355158 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:32.374603 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:32.436442 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port bea6d555-5915-4366-91f7-7e9771e26806, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=bea6d555-5915-4366-91f7-7e9771e26806,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:32.442804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:32.456111 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:32.511374 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=e5430b6d-6430-4a47-b068-7f891fa37da9,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:32.517419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Usage tracker for resource:security_group_rule and tenant:0da54985cde346e68eeadf965b8bc6d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:32.560165 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:32.589616 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:32.657965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3010e053-1775-4630-8118-be6b19e227a2 req-dfe2d69b-ed9e-4213-a75e-acb68728e310 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Synchronizing usage tracker for tenant:88b7de9679da43a4a76a9546c6cb90b2 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:06:32.682544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fcfa8678-cbb1-4b2f-bb0c-c0cfc154946c tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Router 272668a4-245d-4021-b26c-456bc892016b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:06:32.754577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=bea6d555-5915-4366-91f7-7e9771e26806,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:32.762030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-494b24c0-5ae0-48d3-82ee-d2a1ac778863 req-4a18caa2-6e79-4c14-b6ad-c379ef836f0d tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 210 time: 0.0923743 May 12 15:06:32.811022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3010e053-1775-4630-8118-be6b19e227a2 req-dfe2d69b-ed9e-4213-a75e-acb68728e310 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Unset dirty status for tenant:88b7de9679da43a4a76a9546c6cb90b2 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:06:32.820085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-dfe2d69b-ed9e-4213-a75e-acb68728e310 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 45081 time: 2.0180824 May 12 15:06:32.978182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-e805cb34-7aa8-4dd8-be89-d66b579a16f7 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/226901b6-dd8d-4451-b59a-4e1a727e153f HTTP/1.1" status: 200 len: 2981 time: 0.1010411 May 12 15:06:33.027128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fcfa8678-cbb1-4b2f-bb0c-c0cfc154946c tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:06:33.034048 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fcfa8678-cbb1-4b2f-bb0c-c0cfc154946c tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:33.043473 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f70a36cf-4cc8-4459-ab1e-8a3bb1fe879c None None] Sync routers for ids ['272668a4-245d-4021-b26c-456bc892016b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:06:33.064148 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f70a36cf-4cc8-4459-ab1e-8a3bb1fe879c None None] Routers {'272668a4-245d-4021-b26c-456bc892016b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:06:33.065045 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f70a36cf-4cc8-4459-ab1e-8a3bb1fe879c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:06:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['272668a4-245d-4021-b26c-456bc892016b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:33.171439 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fcfa8678-cbb1-4b2f-bb0c-c0cfc154946c tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "PUT /v2.0/floatingips/d8eaf86b-fcbd-4ca9-8430-1ddde3b94626 HTTP/1.1" status: 200 len: 991 time: 3.5805874 May 12 15:06:33.174708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'tag': 'adce94a7-30ae-4036-8a49-87df5c50c324'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:33.351777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-d423e2a0-2659-4258-bba4-60cbec3ed464 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:33.353373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-d423e2a0-2659-4258-bba4-60cbec3ed464 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 820 time: 0.3678293 May 12 15:06:33.360619 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:33.362534 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-f70a36cf-4cc8-4459-ab1e-8a3bb1fe879c None None] Set router 272668a4-245d-4021-b26c-456bc892016b gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:06:33.375938 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:33.559522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Allocated IP 192.168.233.253 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/b6035326-cd91-47d7-8a65-cc2dd3d1d127) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:06:33.797009 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:33.815022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Transition to ACTIVE for port object b6035326-cd91-47d7-8a65-cc2dd3d1d127 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:33.912741 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f70a36cf-4cc8-4459-ab1e-8a3bb1fe879c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd8eaf86b-fcbd-4ca9-8430-1ddde3b94626', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'floating_ip_address': '172.25.8.60', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '272668a4-245d-4021-b26c-456bc892016b', 'port_id': 'adce94a7-30ae-4036-8a49-87df5c50c324', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 160, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'mac_address': 'fa:16:3e:b9:35:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:04:40Z', 'updated_at': '2022-05-12T15:06:31Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:25Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:33.913729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f6116fca-2940-4bc5-b21c-3771c678920e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:33.919481 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f70a36cf-4cc8-4459-ab1e-8a3bb1fe879c None None] Checking router: 272668a4-245d-4021-b26c-456bc892016b for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:06:33.923241 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-59d271e5-b651-4f7a-ab7f-a47b79851367 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/quotas/1b3825228b0e4c42a381540b66ea23d6 HTTP/1.1" status: 200 len: 375 time: 0.5580540 May 12 15:06:33.930458 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f70a36cf-4cc8-4459-ab1e-8a3bb1fe879c None None] Routers {'272668a4-245d-4021-b26c-456bc892016b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:06:33.931105 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f70a36cf-4cc8-4459-ab1e-8a3bb1fe879c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:06:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['272668a4-245d-4021-b26c-456bc892016b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:33.973061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:34.166518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-2893d072-090e-47a7-b8dc-1aee0667cf18 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/226901b6-dd8d-4451-b59a-4e1a727e153f HTTP/1.1" status: 200 len: 2981 time: 1.1790295 May 12 15:06:34.178141 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-f70a36cf-4cc8-4459-ab1e-8a3bb1fe879c None None] Set router 272668a4-245d-4021-b26c-456bc892016b gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:06:34.179204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:06:34.197701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:06:34.200496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:06:34.207451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:34.208072 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:34.223777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Pushing event updated for resources: {'Port': ['ID=b6035326-cd91-47d7-8a65-cc2dd3d1d127,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:34.398818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-946f83ed-b1cf-466d-ae45-fbd9d259803b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.7968912 May 12 15:06:34.436479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Request body: {'port': {'device_id': '86881e13-2515-46d4-a5a5-4bc93a1b8647', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:34.576857 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-1231d6e1-0255-4606-adae-13c2dace676d tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/2306b2b5-ab79-4ba6-8355-d9eb7791306a HTTP/1.1" status: 200 len: 2981 time: 0.3958800 May 12 15:06:34.749474 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-b288e096-a248-48f6-baff-f191b6b4871b tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&fields=id HTTP/1.1" status: 200 len: 302 time: 0.8252337 May 12 15:06:34.789698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-74852551-3774-449a-b127-b0e06dbe34fe None None] Provisioning for port b6035326-cd91-47d7-8a65-cc2dd3d1d127 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:34.813872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-74852551-3774-449a-b127-b0e06dbe34fe None None] Provisioning complete for port b6035326-cd91-47d7-8a65-cc2dd3d1d127 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:34.814690 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-74852551-3774-449a-b127-b0e06dbe34fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:34.862584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-e02ebd80-d301-4483-bad5-c3dc736a66e7 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/2306b2b5-ab79-4ba6-8355-d9eb7791306a HTTP/1.1" status: 200 len: 2981 time: 0.2609539 May 12 15:06:34.939698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-74852551-3774-449a-b127-b0e06dbe34fe None None] Port b6035326-cd91-47d7-8a65-cc2dd3d1d127 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:06:34.960930 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f70a36cf-4cc8-4459-ab1e-8a3bb1fe879c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd8eaf86b-fcbd-4ca9-8430-1ddde3b94626', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'floating_ip_address': '172.25.8.60', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '272668a4-245d-4021-b26c-456bc892016b', 'port_id': 'adce94a7-30ae-4036-8a49-87df5c50c324', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 160, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'mac_address': 'fa:16:3e:b9:35:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:04:40Z', 'updated_at': '2022-05-12T15:06:31Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:25Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:06:34.969419 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f70a36cf-4cc8-4459-ab1e-8a3bb1fe879c None None] The sync data for ids ['272668a4-245d-4021-b26c-456bc892016b'] in n-d-841483-1 is: [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd8eaf86b-fcbd-4ca9-8430-1ddde3b94626', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'floating_ip_address': '172.25.8.60', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '272668a4-245d-4021-b26c-456bc892016b', 'port_id': 'adce94a7-30ae-4036-8a49-87df5c50c324', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 160, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'mac_address': 'fa:16:3e:b9:35:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:04:40Z', 'updated_at': '2022-05-12T15:06:31Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:25Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:06:35.136507 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:35.366409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f5ac30e-67b1-4e86-a5c5-8057122eeeaa None None] New status for floating IP d8eaf86b-fcbd-4ca9-8430-1ddde3b94626: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:06:35.543304 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-e9da5330-6ed9-4756-9056-f6916ab928b3 service neutron] 10.222.0.82 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7384841 May 12 15:06:35.696016 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-4b58a402-7b45-4d01-8872-190bddf2300e tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/432e9fab-3b4e-4ffa-bf3e-0a2a467c0c53 HTTP/1.1" status: 200 len: 2981 time: 0.5707126 May 12 15:06:35.905189 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-0fe5a4be-3d12-4c13-b473-6629b52e4e74 service neutron] 10.222.0.82 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3606167 May 12 15:06:35.910969 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-3cf1c0b1-ce55-4bd8-bded-52c368a99300 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/432e9fab-3b4e-4ffa-bf3e-0a2a467c0c53 HTTP/1.1" status: 200 len: 2981 time: 0.1588306 May 12 15:06:35.981672 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-1fc4e2cd-11fb-46a2-9ca1-c6484a494009 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/45d36a40-692b-464e-ac04-63c4a6e60759 HTTP/1.1" status: 200 len: 2981 time: 0.0617981 May 12 15:06:36.178018 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-83764bf1-28c6-4b67-b585-4b7d565bc67a'] response: {'server_uuid': '8d278524-0445-4a95-8564-3c04c2f3c41d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e5430b6d-6430-4a47-b068-7f891fa37da9', 'code': 200} May 12 15:06:36.182340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b6035326-cd91-47d7-8a65-cc2dd3d1d127 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:06:36.191406 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:36.209870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Transition to ACTIVE for port object b6035326-cd91-47d7-8a65-cc2dd3d1d127 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:36.216895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-68b9e255-e444-4ed6-a737-a20d15f76dcb tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/45d36a40-692b-464e-ac04-63c4a6e60759 HTTP/1.1" status: 200 len: 2981 time: 0.2260220 May 12 15:06:36.222862 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:36.538052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-779537df-d8fb-4148-8b9d-a9a45e4a7db8 req-0a145116-3471-46d7-ac94-ca0077ae83ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:36.544948 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-779537df-d8fb-4148-8b9d-a9a45e4a7db8 req-0a145116-3471-46d7-ac94-ca0077ae83ac service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 1101 time: 0.2074289 May 12 15:06:36.667895 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-779537df-d8fb-4148-8b9d-a9a45e4a7db8 req-5c34f5e7-19ec-46d8-b92d-bc354b30776c service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1098404 May 12 15:06:36.956328 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-e83fc4b2-14bf-444b-af3f-7f5e335e0e1f tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/4eab784f-18b8-4c4d-b2be-7c4376b0780a HTTP/1.1" status: 200 len: 2973 time: 0.7106032 May 12 15:06:36.960710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Attempting to bind port b6035326-cd91-47d7-8a65-cc2dd3d1d127 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:06:36.961449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Attempting to bind port b6035326-cd91-47d7-8a65-cc2dd3d1d127 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:06:36.961981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Attempting to bind port b6035326-cd91-47d7-8a65-cc2dd3d1d127 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:36.972746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Pushing event updated for resources: {'Port': ['ID=b6035326-cd91-47d7-8a65-cc2dd3d1d127,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:36.993539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Port b6035326-cd91-47d7-8a65-cc2dd3d1d127 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:06:36.994189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Attempting to bind port b6035326-cd91-47d7-8a65-cc2dd3d1d127 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:37.024794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 6, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:06:37.025574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:06:37.026356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:06:37.027030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Bound port: b6035326-cd91-47d7-8a65-cc2dd3d1d127, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:06:37.027601 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:37.270252 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-40c766f7-6059-40e5-ab2d-1400545c2161 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/4eab784f-18b8-4c4d-b2be-7c4376b0780a HTTP/1.1" status: 200 len: 2973 time: 0.2881293 May 12 15:06:37.275345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1eaef0-259e-46bb-ad4c-0cb9e7c4b90e req-a2c2bf79-a3d5-4bc1-9b9e-d6f47bed8621 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:37.278942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f1eaef0-259e-46bb-ad4c-0cb9e7c4b90e req-a2c2bf79-a3d5-4bc1-9b9e-d6f47bed8621 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b109b727195f4a0286ba8c6b6aa99144&device_id=d92d2403-4d50-4d2e-8f63-1d668eb627d5 HTTP/1.1" status: 200 len: 1122 time: 0.8646655 May 12 15:06:37.310649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab67e410-07a6-494b-a6b4-585541d41885 req-2661fabb-3acc-4a62-baeb-56f899713041 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:37.315584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab67e410-07a6-494b-a6b4-585541d41885 req-2661fabb-3acc-4a62-baeb-56f899713041 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 950 time: 0.5815368 May 12 15:06:37.739936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] For port b6035326-cd91-47d7-8a65-cc2dd3d1d127, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:06:37.748460 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab67e410-07a6-494b-a6b4-585541d41885 req-f45a2f2a-7913-4df0-8c16-096c7062ab41 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3157761 May 12 15:06:37.753417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-503c5254-1311-4c7a-a806-d00f1f4ecadb tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/5069deef-9651-4e54-acbf-0d17d7f18e7f HTTP/1.1" status: 200 len: 2977 time: 0.4307005 May 12 15:06:37.762649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] For port b6035326-cd91-47d7-8a65-cc2dd3d1d127, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:06:37.796351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:37.950737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:37.952728 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:37.954152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] 10.222.0.84 "PUT /v2.0/ports/b6035326-cd91-47d7-8a65-cc2dd3d1d127 HTTP/1.1" status: 200 len: 1096 time: 3.5287385 May 12 15:06:37.984107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '86881e13-2515-46d4-a5a5-4bc93a1b8647', 'tag': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:37.999059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1eaef0-259e-46bb-ad4c-0cb9e7c4b90e req-265e78a4-4997-49af-bdc1-7267c384ae06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:38.000725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f1eaef0-259e-46bb-ad4c-0cb9e7c4b90e req-265e78a4-4997-49af-bdc1-7267c384ae06 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.6825552 May 12 15:06:38.180667 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2a994cf2-e517-4ce3-a9fe-50d8a080508e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bea6d555-5915-4366-91f7-7e9771e26806'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:38.350871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-00db35a6-70a8-41d4-a1c3-5a30063f2ce8 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/5069deef-9651-4e54-acbf-0d17d7f18e7f HTTP/1.1" status: 200 len: 2977 time: 0.5868025 May 12 15:06:38.352498 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f1eaef0-259e-46bb-ad4c-0cb9e7c4b90e req-9f9441a5-6092-480e-ada3-ceb08de01a0d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.202&port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 HTTP/1.1" status: 200 len: 217 time: 0.3400795 May 12 15:06:38.360322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bf7c5c2-810b-483b-bc45-8b7a07450627 service neutron] Pushing event updated for resources: {'Port': ['ID=b6035326-cd91-47d7-8a65-cc2dd3d1d127,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:38.695432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-6d3e829d-80b1-458e-a2be-56d24051077d tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/5f212231-3ef4-4d84-b723-01b65ece061e HTTP/1.1" status: 200 len: 2977 time: 0.3367186 May 12 15:06:38.705786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1eaef0-259e-46bb-ad4c-0cb9e7c4b90e req-c4d342e9-4d70-4b5f-bd7f-748055e1e4c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:38.708420 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f1eaef0-259e-46bb-ad4c-0cb9e7c4b90e req-c4d342e9-4d70-4b5f-bd7f-748055e1e4c2 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3312931 May 12 15:06:38.906997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-9ae9a8b4-f513-4fbf-919f-d327df9c585b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:38.914990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-9ae9a8b4-f513-4fbf-919f-d327df9c585b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 1099 time: 0.7233133 May 12 15:06:38.947331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-d73fb39a-e8b8-48b2-b7bf-418b294a5893 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:38.948701 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-d73fb39a-e8b8-48b2-b7bf-418b294a5893 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.84 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 820 time: 0.4344087 May 12 15:06:38.965805 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bee5f42-4737-4b08-a03f-5f0aa6c8dd93 req-ef179320-31f0-48ec-912d-313f1a610846 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:38.967360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7bee5f42-4737-4b08-a03f-5f0aa6c8dd93 req-ef179320-31f0-48ec-912d-313f1a610846 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 946 time: 0.7325377 May 12 15:06:38.979459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Request body: {'port': {'device_id': 'c16773f3-58ee-4af2-a29d-d343b8561a31', 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3', 'admin_state_up': True, 'tenant_id': '1b3825228b0e4c42a381540b66ea23d6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:39.072494 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-b3bfef15-9b81-405c-b2cf-2635b2ebd476 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/5f212231-3ef4-4d84-b723-01b65ece061e HTTP/1.1" status: 200 len: 2977 time: 0.3615119 May 12 15:06:39.104630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-e00db54d-8335-4c43-a999-743a23522d6a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.253&port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127 HTTP/1.1" status: 200 len: 217 time: 0.1672816 May 12 15:06:39.174991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:39.191175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:39.212359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Made reservation on behalf of 1b3825228b0e4c42a381540b66ea23d6 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:06:39.216486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:39.230888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7bee5f42-4737-4b08-a03f-5f0aa6c8dd93 req-ac32d920-e108-4047-b34f-27a11abad32e tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1676860 May 12 15:06:39.252228 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-babc99a1-89cb-4c8d-9523-311ee4b91d94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:39.253882 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-babc99a1-89cb-4c8d-9523-311ee4b91d94 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1315477 May 12 15:06:39.265618 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-badc32b3-f71d-4331-967e-c36eaf9ef3fc tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/6c143721-d68a-410c-8943-0e64dbae0dca HTTP/1.1" status: 200 len: 2977 time: 0.1712387 May 12 15:06:39.308701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1eaef0-259e-46bb-ad4c-0cb9e7c4b90e req-67047195-03d2-454b-aa78-3acca92c19d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:39.310349 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f1eaef0-259e-46bb-ad4c-0cb9e7c4b90e req-67047195-03d2-454b-aa78-3acca92c19d6 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.5725689 May 12 15:06:39.442685 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8490f238-92cd-42fa-a77c-3e68a03cb325'] response: {'name': 'network-changed', 'server_uuid': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'tag': 'adce94a7-30ae-4036-8a49-87df5c50c324', 'status': 'completed', 'code': 200} May 12 15:06:39.549252 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-c7bf9251-571c-4b42-a9c7-d5f98e32989b tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/6c143721-d68a-410c-8943-0e64dbae0dca HTTP/1.1" status: 200 len: 2977 time: 0.2477391 May 12 15:06:39.633866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Allocated IP 172.20.0.11 (95dd1383-efe7-494d-a1ab-57e293da83a3/bc8f64ab-e415-4d25-919a-8e712e76a5f6/8a33daa6-587f-4787-befb-2fa6e1051f2c) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:06:39.646664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-40b557dc-ce7e-49db-a191-adda51a28471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:39.649297 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-40b557dc-ce7e-49db-a191-adda51a28471 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.3878777 May 12 15:06:39.701853 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f1eaef0-259e-46bb-ad4c-0cb9e7c4b90e req-24de50bf-b208-48b9-b9b3-dd0f4606105c service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3750417 May 12 15:06:39.824370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-78bfb9ec-2fd7-49b1-a3ae-70d5815ec752 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/89426b75-24c4-4a0b-ba4f-3c511ab36974 HTTP/1.1" status: 200 len: 2981 time: 0.2614498 May 12 15:06:39.938208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a859a27-4d89-4c1b-80dd-307c4edbfe69 req-b64cf926-5a6a-464d-9600-56238512e97c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:39.939684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a859a27-4d89-4c1b-80dd-307c4edbfe69 req-b64cf926-5a6a-464d-9600-56238512e97c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=38c07c88d2f84b29a9ae8c83558ec74b&device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 1097 time: 0.4874709 May 12 15:06:39.942426 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:40.023790 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:40.132232 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-c2e9e2ab-6895-4482-961b-f367b685cc99 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4602587 May 12 15:06:40.132777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Network 95dd1383-efe7-494d-a1ab-57e293da83a3 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:06:40.132777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:06:40.137238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:06:40.145441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:40.146494 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:40.173737 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-c4e6a3ae-7138-4950-9b6f-dc2775ede4a8 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/89426b75-24c4-4a0b-ba4f-3c511ab36974 HTTP/1.1" status: 200 len: 2981 time: 0.2710798 May 12 15:06:40.176098 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f1eaef0-259e-46bb-ad4c-0cb9e7c4b90e req-375b763d-bf94-4cb6-827c-5effd38ebd05 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4139042 May 12 15:06:40.229358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Pushing event updated for resources: {'Port': ['ID=8a33daa6-587f-4787-befb-2fa6e1051f2c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:40.246332 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-508c1d49-6963-4225-beb4-5dc1302f2102 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2796571 May 12 15:06:40.267726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Request body: {'port': {'device_id': 'c16773f3-58ee-4af2-a29d-d343b8561a31', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:40.355553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a859a27-4d89-4c1b-80dd-307c4edbfe69 req-3e6112ad-f93f-4168-a951-7ef9a633e893 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:40.356998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a859a27-4d89-4c1b-80dd-307c4edbfe69 req-3e6112ad-f93f-4168-a951-7ef9a633e893 service neutron] 10.222.0.76 "GET /v2.0/networks?id=feb95830-c0c2-46c0-bb35-f2f43605e79a HTTP/1.1" status: 200 len: 925 time: 0.4028473 May 12 15:06:40.438310 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:40.477400 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-2a78553c-1f22-4c1b-b93e-57a9b7af6c45 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/98c78171-ded7-4a0c-a647-1cd4c9ff1df4 HTTP/1.1" status: 200 len: 2981 time: 0.2741263 May 12 15:06:40.617173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a859a27-4d89-4c1b-80dd-307c4edbfe69 req-8a770d71-4cbc-4ff2-9d35-ea433412462d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=adce94a7-30ae-4036-8a49-87df5c50c324 HTTP/1.1" status: 200 len: 1001 time: 0.2399750 May 12 15:06:40.619229 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a22c647-0c5d-4125-b002-35918bbe9eb1 req-f0880428-a256-46ce-b014-d18d1a93dc74 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4836326 May 12 15:06:40.697954 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-f76cfa82-393a-47bd-af8b-e0e49d4ebc59 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/98c78171-ded7-4a0c-a647-1cd4c9ff1df4 HTTP/1.1" status: 200 len: 2981 time: 0.1973193 May 12 15:06:40.708147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a859a27-4d89-4c1b-80dd-307c4edbfe69 req-eb4aad0c-0fdb-4b42-8fb8-f13aaa71272d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:40.709933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a859a27-4d89-4c1b-80dd-307c4edbfe69 req-eb4aad0c-0fdb-4b42-8fb8-f13aaa71272d service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c0ac6201-c8b1-43a9-a509-5a4ff4e34282 HTTP/1.1" status: 200 len: 863 time: 0.0846968 May 12 15:06:40.999384 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-e1498381-baf5-4c92-a33f-cc07658ad042 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/a543ee7f-b79b-4d14-900f-2472d7620622 HTTP/1.1" status: 200 len: 2981 time: 0.2879038 May 12 15:06:41.076792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a859a27-4d89-4c1b-80dd-307c4edbfe69 req-d9c680f5-e679-4d88-9597-f2900973fb71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:41.078544 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a859a27-4d89-4c1b-80dd-307c4edbfe69 req-d9c680f5-e679-4d88-9597-f2900973fb71 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=feb95830-c0c2-46c0-bb35-f2f43605e79a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3549054 May 12 15:06:41.081993 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-dfd4496b-d570-4d97-881c-12d113af6c77 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/a543ee7f-b79b-4d14-900f-2472d7620622 HTTP/1.1" status: 200 len: 2981 time: 0.0739601 May 12 15:06:41.089552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a677143-ce1a-45d7-8449-3d2c5d65bf82 req-e623e4db-5945-4f00-93bb-52a88b683596 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:41.090237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6a677143-ce1a-45d7-8449-3d2c5d65bf82 req-e623e4db-5945-4f00-93bb-52a88b683596 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Synchronizing usage tracker for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:06:41.215974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8a33daa6-587f-4787-befb-2fa6e1051f2c {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:06:41.225977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:41.268599 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Transition to ACTIVE for port object 8a33daa6-587f-4787-befb-2fa6e1051f2c will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:41.279617 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:41.333943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6a677143-ce1a-45d7-8449-3d2c5d65bf82 req-e623e4db-5945-4f00-93bb-52a88b683596 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Unset dirty status for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:06:41.335077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a677143-ce1a-45d7-8449-3d2c5d65bf82 req-e623e4db-5945-4f00-93bb-52a88b683596 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 948 time: 0.4157913 May 12 15:06:41.375517 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-9c4fb19a-822e-41a9-a72e-c53840a88f7e tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/a6ec58c1-c78a-4ff9-910e-6e5d7e93734d HTTP/1.1" status: 200 len: 2981 time: 0.2720745 May 12 15:06:41.477285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-f2b393fc-5630-46da-9774-14ec0db33958 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/a6ec58c1-c78a-4ff9-910e-6e5d7e93734d HTTP/1.1" status: 200 len: 2981 time: 0.0931511 May 12 15:06:41.483911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6a677143-ce1a-45d7-8449-3d2c5d65bf82 req-95d61088-a3cb-4039-abeb-224b07a256fd tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Synchronizing usage tracker for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:06:41.497453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Pushing event updated for resources: {'Port': ['ID=8a33daa6-587f-4787-befb-2fa6e1051f2c,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:41.501799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Attempting to bind port 8a33daa6-587f-4787-befb-2fa6e1051f2c on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:06:41.502317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Attempting to bind port 8a33daa6-587f-4787-befb-2fa6e1051f2c by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:06:41.502814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Attempting to bind port 8a33daa6-587f-4787-befb-2fa6e1051f2c on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:41.509476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Port 8a33daa6-587f-4787-befb-2fa6e1051f2c on network 95dd1383-efe7-494d-a1ab-57e293da83a3 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:06:41.510075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Attempting to bind port 8a33daa6-587f-4787-befb-2fa6e1051f2c on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:41.516686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 6, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:06:41.517450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Checking segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:06:41.517843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Bound using segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:06:41.518289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Bound port: 8a33daa6-587f-4787-befb-2fa6e1051f2c, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:06:41.519540 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:41.531154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6a677143-ce1a-45d7-8449-3d2c5d65bf82 req-95d61088-a3cb-4039-abeb-224b07a256fd tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Unset dirty status for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:06:41.532479 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a677143-ce1a-45d7-8449-3d2c5d65bf82 req-95d61088-a3cb-4039-abeb-224b07a256fd tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1814404 May 12 15:06:41.545851 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a859a27-4d89-4c1b-80dd-307c4edbfe69 req-02b5a465-f42f-48fd-ab03-10c02c21f171 service neutron] 10.222.0.76 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4402046 May 12 15:06:41.709749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:06:41.712994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:06:41.731023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:41.765084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a859a27-4d89-4c1b-80dd-307c4edbfe69 req-9cbe19cd-5f22-4813-a5a5-33aa40215de4 service neutron] 10.222.0.76 "GET /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2046671 May 12 15:06:41.766476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-76b40476-12bd-401b-a083-afd468ca3104 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/b8b29de1-25ab-461a-8fd2-7247760c9f44 HTTP/1.1" status: 200 len: 2981 time: 0.2757249 May 12 15:06:41.854241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:41.855024 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:41.856489 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] 10.222.0.84 "PUT /v2.0/ports/8a33daa6-587f-4787-befb-2fa6e1051f2c HTTP/1.1" status: 200 len: 1092 time: 1.5965919 May 12 15:06:41.857018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c16773f3-58ee-4af2-a29d-d343b8561a31', 'tag': '8a33daa6-587f-4787-befb-2fa6e1051f2c'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:41.882294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db86a483-6a2c-4286-9e62-b8c153fe9e49 req-16f8af80-5ce3-4728-b6a3-21fa81f37ec0 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:41.889553 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db86a483-6a2c-4286-9e62-b8c153fe9e49 req-16f8af80-5ce3-4728-b6a3-21fa81f37ec0 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 944 time: 0.1961391 May 12 15:06:41.891195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3159ec64-d673-40bc-a3bb-d15831bd9bb0 service neutron] Pushing event updated for resources: {'Port': ['ID=8a33daa6-587f-4787-befb-2fa6e1051f2c,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:41.926308 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3010e053-1775-4630-8118-be6b19e227a2 req-da04b995-a061-4935-b30f-226c2bd9aaf7 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/b8b29de1-25ab-461a-8fd2-7247760c9f44 HTTP/1.1" status: 200 len: 2981 time: 0.1351047 May 12 15:06:42.014828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-5921e51d-9487-4547-8def-7635f69be6d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:42.016772 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-5921e51d-9487-4547-8def-7635f69be6d0 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 1095 time: 0.1022973 May 12 15:06:42.022330 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db86a483-6a2c-4286-9e62-b8c153fe9e49 req-82d14676-d034-48d2-9b1c-b6676f9a720a tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1315124 May 12 15:06:42.068644 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9788020b-6a9a-4a35-a0be-8c6d104c2b80'] response: {'name': 'network-changed', 'server_uuid': '86881e13-2515-46d4-a5a5-4bc93a1b8647', 'tag': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127', 'status': 'completed', 'code': 200} May 12 15:06:42.132454 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-219f73f7-5eb5-4758-91de-de1f51c831cc service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c HTTP/1.1" status: 200 len: 217 time: 0.0993245 May 12 15:06:42.138018 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5e557f47-0206-4d40-8e7e-b898e7fb2b68'] response: {'server_uuid': '2a994cf2-e517-4ce3-a9fe-50d8a080508e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bea6d555-5915-4366-91f7-7e9771e26806', 'code': 200} May 12 15:06:42.324871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-dcc48710-2e2d-4be8-89a9-4c17c0cbb41a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:42.327478 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-dcc48710-2e2d-4be8-89a9-4c17c0cbb41a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.1874993 May 12 15:06:42.455744 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-2f97d04e-e0be-4aef-aa68-baf8d5dbd381 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1140115 May 12 15:06:42.475170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43730807-4e4e-48bd-b45b-7ed3d34370d6 req-c1033f30-4214-4a60-855a-1cdbe63edc3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:42.476723 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43730807-4e4e-48bd-b45b-7ed3d34370d6 req-c1033f30-4214-4a60-855a-1cdbe63edc3d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 1099 time: 0.3663914 May 12 15:06:42.501585 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-45339a95-455c-4af4-ae96-81c705a88f6f'] response: {'name': 'network-changed', 'server_uuid': 'c16773f3-58ee-4af2-a29d-d343b8561a31', 'tag': '8a33daa6-587f-4787-befb-2fa6e1051f2c', 'status': 'completed', 'code': 200} May 12 15:06:42.617001 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aa31d91-cfe3-496c-b2e7-7d312953a586 req-a52c9eba-4d9f-46cf-917b-88a52aef5fa7 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:42.618946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6aa31d91-cfe3-496c-b2e7-7d312953a586 req-a52c9eba-4d9f-46cf-917b-88a52aef5fa7 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 950 time: 0.3670645 May 12 15:06:42.633261 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:42.647158 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-da12927f-5202-41d6-8358-f0514cf6eb40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:42.651596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75888558-8485-4868-bb89-4a1ea1eb762c req-d3762aa9-a483-4fd2-895d-d4342b293b89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:42.653157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75888558-8485-4868-bb89-4a1ea1eb762c req-d3762aa9-a483-4fd2-895d-d4342b293b89 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 1101 time: 0.3624406 May 12 15:06:42.667404 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-d5eb0126-d125-428d-9f0d-3353d34e1af9 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2004986 May 12 15:06:42.757682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75888558-8485-4868-bb89-4a1ea1eb762c req-6547cf5a-2154-4947-81d4-7e40befd6fb1 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0974767 May 12 15:06:42.813288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6aa31d91-cfe3-496c-b2e7-7d312953a586 req-70232b9b-0cf9-4495-879b-01d95fcaf667 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1667635 May 12 15:06:42.823483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f888f02c-926e-4bfd-b3b0-f84f08205e91 req-77a4bc80-8835-49e6-a0a0-f4684a88d214 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Synchronizing usage tracker for tenant:8bbaabbfb25445218d14a5645ed3ac41 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:06:42.837054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43730807-4e4e-48bd-b45b-7ed3d34370d6 req-2a5d624c-fb11-4e14-a819-8d1e61fd6095 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:42.838738 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43730807-4e4e-48bd-b45b-7ed3d34370d6 req-2a5d624c-fb11-4e14-a819-8d1e61fd6095 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.3507392 May 12 15:06:42.857533 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9e8d9d99-3602-4930-ae4c-e638918e5c7f req-b6c72ec3-1dea-4a66-9a59-7cbb85c3c8bd service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1833816 May 12 15:06:42.918783 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43730807-4e4e-48bd-b45b-7ed3d34370d6 req-bdbcf083-61cd-4add-bb77-c0c3de7834e0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.253&port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127 HTTP/1.1" status: 200 len: 217 time: 0.0726829 May 12 15:06:42.921971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f888f02c-926e-4bfd-b3b0-f84f08205e91 req-77a4bc80-8835-49e6-a0a0-f4684a88d214 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Unset dirty status for tenant:8bbaabbfb25445218d14a5645ed3ac41 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:06:42.923252 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f888f02c-926e-4bfd-b3b0-f84f08205e91 req-77a4bc80-8835-49e6-a0a0-f4684a88d214 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8bbaabbfb25445218d14a5645ed3ac41 HTTP/1.1" status: 200 len: 6100 time: 0.4125707 May 12 15:06:43.060838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f079300-4ab3-40ab-bd08-954c59dba5e7 req-4375a32c-0fd3-4fc6-b8d3-7335b1dae8d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:43.062554 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f079300-4ab3-40ab-bd08-954c59dba5e7 req-4375a32c-0fd3-4fc6-b8d3-7335b1dae8d4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 1095 time: 0.1017246 May 12 15:06:43.077253 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f888f02c-926e-4bfd-b3b0-f84f08205e91 req-772d1d0f-02d6-4d83-89c4-3beaf673c686 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] 10.222.0.82 "GET /v2.0/security-groups/2306b2b5-ab79-4ba6-8355-d9eb7791306a HTTP/1.1" status: 200 len: 2981 time: 0.1468413 May 12 15:06:43.120333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43730807-4e4e-48bd-b45b-7ed3d34370d6 req-c29a39de-efae-48d8-8f69-6c88c4ca1ebb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:43.121937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43730807-4e4e-48bd-b45b-7ed3d34370d6 req-c29a39de-efae-48d8-8f69-6c88c4ca1ebb service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1566236 May 12 15:06:43.228355 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f888f02c-926e-4bfd-b3b0-f84f08205e91 req-ce40b713-c84a-4cd0-8ee3-3aba9873346e tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] 10.222.0.82 "GET /v2.0/security-groups/2306b2b5-ab79-4ba6-8355-d9eb7791306a HTTP/1.1" status: 200 len: 2981 time: 0.1432483 May 12 15:06:43.252594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fec71421-214c-4367-9e20-8a44881b28b9 req-f24fecda-fd6e-41b4-ae2c-dae7381489b6 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:43.255062 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fec71421-214c-4367-9e20-8a44881b28b9 req-f24fecda-fd6e-41b4-ae2c-dae7381489b6 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=d92d2403-4d50-4d2e-8f63-1d668eb627d5 HTTP/1.1" status: 200 len: 971 time: 0.2912769 May 12 15:06:43.302976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43730807-4e4e-48bd-b45b-7ed3d34370d6 req-6bf97d88-23f1-40a5-bb1d-7b46e935ebe5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:43.304523 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43730807-4e4e-48bd-b45b-7ed3d34370d6 req-6bf97d88-23f1-40a5-bb1d-7b46e935ebe5 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1734672 May 12 15:06:43.306621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f079300-4ab3-40ab-bd08-954c59dba5e7 req-c5f2a0a4-e389-4200-85a7-80c8a0b14c26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:43.310937 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f079300-4ab3-40ab-bd08-954c59dba5e7 req-c5f2a0a4-e389-4200-85a7-80c8a0b14c26 service neutron] 10.222.0.84 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.2377713 May 12 15:06:43.323006 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fec71421-214c-4367-9e20-8a44881b28b9 req-70bc6a6b-5c6b-407e-90e8-6e7459a7b7d9 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0600121 May 12 15:06:43.411887 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f079300-4ab3-40ab-bd08-954c59dba5e7 req-d12b84d4-4d67-4242-9d4f-f6f39a2dd891 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c HTTP/1.1" status: 200 len: 217 time: 0.0932937 May 12 15:06:43.489162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f079300-4ab3-40ab-bd08-954c59dba5e7 req-31068861-0295-4a04-90e7-ba8edddc3605 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:43.490740 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f079300-4ab3-40ab-bd08-954c59dba5e7 req-31068861-0295-4a04-90e7-ba8edddc3605 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.0693057 May 12 15:06:43.547335 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f079300-4ab3-40ab-bd08-954c59dba5e7 req-bc3d8f4d-24c0-4f40-afbd-3362e8c762ac service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0493782 May 12 15:06:43.676639 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43730807-4e4e-48bd-b45b-7ed3d34370d6 req-064af827-8e6a-41cf-9ea2-76c27c0ab88f service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3503554 May 12 15:06:43.691257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4f5a36-b774-4166-b840-332fe47ddefb req-c0d382de-743d-4396-b2ea-cb4c5ff21d6f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:43.693438 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e4f5a36-b774-4166-b840-332fe47ddefb req-c0d382de-743d-4396-b2ea-cb4c5ff21d6f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 948 time: 0.1600034 May 12 15:06:43.831459 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f079300-4ab3-40ab-bd08-954c59dba5e7 req-182b0a87-3039-4ffa-83ba-cd7681d023a3 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2705925 May 12 15:06:43.884346 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e4f5a36-b774-4166-b840-332fe47ddefb req-ca9323e2-8a00-486c-a7a9-667a489a7896 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1635232 May 12 15:06:43.979768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43730807-4e4e-48bd-b45b-7ed3d34370d6 req-c0bc6ce3-75b3-4a28-b276-947e2cf32aa6 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2852128 May 12 15:06:44.014385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b606c51d-454c-4e2a-9c90-d13d3a9aa355 req-293384a5-7600-47c9-bd07-0dea08c13ddd tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:44.021910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b606c51d-454c-4e2a-9c90-d13d3a9aa355 req-293384a5-7600-47c9-bd07-0dea08c13ddd tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 944 time: 0.2283542 May 12 15:06:44.024873 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0bc0e027-a8e2-4825-ba58-3c60a0ae32e7 req-819f3b32-09c8-434b-badd-6e3838484ab0 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/dcce002f-2b94-4e02-a679-8bc9c09468ca HTTP/1.1" status: 200 len: 1778 time: 0.0951345 May 12 15:06:44.037114 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f079300-4ab3-40ab-bd08-954c59dba5e7 req-a8407bac-db03-45c6-949f-5599b1b927fc service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1983051 May 12 15:06:44.113067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b606c51d-454c-4e2a-9c90-d13d3a9aa355 req-283ad52f-08ca-47b0-a8c8-03adcd9f8efa tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0896370 May 12 15:06:44.136518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device b6035326-cd91-47d7-8a65-cc2dd3d1d127 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:06:44.169111 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0bc0e027-a8e2-4825-ba58-3c60a0ae32e7 req-f2d1c156-388d-40e6-9967-67b59a9cb231 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:44.198167 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0bc0e027-a8e2-4825-ba58-3c60a0ae32e7 req-f2d1c156-388d-40e6-9967-67b59a9cb231 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:44.286447 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0bc0e027-a8e2-4825-ba58-3c60a0ae32e7 req-f2d1c156-388d-40e6-9967-67b59a9cb231 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:44.307766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d1c156-388d-40e6-9967-67b59a9cb231 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dcce002f-2b94-4e02-a679-8bc9c09468ca,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:44.323169 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0bc0e027-a8e2-4825-ba58-3c60a0ae32e7 req-f2d1c156-388d-40e6-9967-67b59a9cb231 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:44.330411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0bc0e027-a8e2-4825-ba58-3c60a0ae32e7 req-f2d1c156-388d-40e6-9967-67b59a9cb231 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "DELETE /v2.0/security-groups/dcce002f-2b94-4e02-a679-8bc9c09468ca HTTP/1.1" status: 204 len: 173 time: 0.2880552 May 12 15:06:44.370729 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port b6035326-cd91-47d7-8a65-cc2dd3d1d127, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:44.387176 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127', 'mac_address': 'fa:16:3e:c5:48:dd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.253'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:06:44.482400 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:44.512291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b6035326-cd91-47d7-8a65-cc2dd3d1d127 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:06:44.532681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port b6035326-cd91-47d7-8a65-cc2dd3d1d127, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:44.540990 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:44.598448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4a2f000-6206-4109-9098-66b10992bab8 req-9ec02b51-d5f5-49af-9712-446ad5462a00 tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "GET /v2.0/security-groups/4de741f0-a381-4d3c-a9a7-7e89914db967 HTTP/1.1" status: 200 len: 1778 time: 0.0750046 May 12 15:06:44.654746 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=b6035326-cd91-47d7-8a65-cc2dd3d1d127,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:44.662864 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8576c4da-c710-4d8e-a97f-b3f45c998a7c req-32d958ca-525f-492b-aac0-1c319d62c4c1 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:44.664363 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8576c4da-c710-4d8e-a97f-b3f45c998a7c req-32d958ca-525f-492b-aac0-1c319d62c4c1 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 950 time: 0.1863792 May 12 15:06:44.720817 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a4a2f000-6206-4109-9098-66b10992bab8 req-0a845dfa-c0f8-49ce-9cbf-c06adc274fee tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:44.748486 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8576c4da-c710-4d8e-a97f-b3f45c998a7c req-e409b79e-7fce-4049-9d65-270f3e4e4125 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0743089 May 12 15:06:44.777827 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a4a2f000-6206-4109-9098-66b10992bab8 req-0a845dfa-c0f8-49ce-9cbf-c06adc274fee tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:44.783175 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f4eeb266-9448-43e9-be28-99d9c9ed72ed None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:44.843508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:06:44.857219 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a4a2f000-6206-4109-9098-66b10992bab8 req-0a845dfa-c0f8-49ce-9cbf-c06adc274fee tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:44.874293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a845dfa-c0f8-49ce-9cbf-c06adc274fee tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4de741f0-a381-4d3c-a9a7-7e89914db967,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:44.889050 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a4a2f000-6206-4109-9098-66b10992bab8 req-0a845dfa-c0f8-49ce-9cbf-c06adc274fee tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:44.890298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4a2f000-6206-4109-9098-66b10992bab8 req-0a845dfa-c0f8-49ce-9cbf-c06adc274fee tempest-SecurityGroupsTestAdminJSON-1936330408 tempest-SecurityGroupsTestAdminJSON-1936330408-project-admin] 10.222.0.82 "DELETE /v2.0/security-groups/4de741f0-a381-4d3c-a9a7-7e89914db967 HTTP/1.1" status: 204 len: 173 time: 0.2842467 May 12 15:06:44.899570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['b6035326-cd91-47d7-8a65-cc2dd3d1d127'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:06:45.125090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c5df08-b375-440f-bbe1-1d42c36437d6 req-cd24d4f4-7080-411b-8a03-0983aab7082a tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:45.127813 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48c5df08-b375-440f-bbe1-1d42c36437d6 req-cd24d4f4-7080-411b-8a03-0983aab7082a tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.1461115 May 12 15:06:45.184543 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:45.205242 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48c5df08-b375-440f-bbe1-1d42c36437d6 req-c71f014d-82f8-4c5e-aea7-bea2027b6528 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0718236 May 12 15:06:45.227756 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:45.233281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:45.246790 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:45.407038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1c6fd5d-9106-452f-a8ef-f908c46dffc1 req-90d76655-dc91-425f-818c-9d9bca35cfcb tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] 10.222.0.82 "GET /v2.0/security-groups/e8e7e2a7-8316-4bd9-8886-27fe2c86c518 HTTP/1.1" status: 200 len: 1775 time: 0.1403658 May 12 15:06:45.416574 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,revision_number=11']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:45.561241 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b1c6fd5d-9106-452f-a8ef-f908c46dffc1 req-4007f578-5797-49f7-b298-b03bce81f79b tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:45.594312 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b1c6fd5d-9106-452f-a8ef-f908c46dffc1 req-4007f578-5797-49f7-b298-b03bce81f79b tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:45.653999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-170e3c87-166d-4eb0-bae2-36bb40fb2eab req-d9d8296a-090a-4d67-9f96-9982a5b944b9 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:45.656648 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-170e3c87-166d-4eb0-bae2-36bb40fb2eab req-d9d8296a-090a-4d67-9f96-9982a5b944b9 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 949 time: 0.1717780 May 12 15:06:45.684484 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b1c6fd5d-9106-452f-a8ef-f908c46dffc1 req-4007f578-5797-49f7-b298-b03bce81f79b tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:45.713433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4007f578-5797-49f7-b298-b03bce81f79b tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8e7e2a7-8316-4bd9-8886-27fe2c86c518,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:45.739557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-170e3c87-166d-4eb0-bae2-36bb40fb2eab req-1e3cc0f7-278a-4bcd-aee3-32ab745e09a9 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748105 May 12 15:06:45.745089 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b1c6fd5d-9106-452f-a8ef-f908c46dffc1 req-4007f578-5797-49f7-b298-b03bce81f79b tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:45.746251 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1c6fd5d-9106-452f-a8ef-f908c46dffc1 req-4007f578-5797-49f7-b298-b03bce81f79b tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] 10.222.0.82 "DELETE /v2.0/security-groups/e8e7e2a7-8316-4bd9-8886-27fe2c86c518 HTTP/1.1" status: 204 len: 173 time: 0.3328514 May 12 15:06:45.971373 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d07d52a2-5314-4c84-ab75-7a78f4d90960'] response: {'server_uuid': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1', 'code': 200} May 12 15:06:45.975055 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:46.026904 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:46.029053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e26b855-21da-453c-8b87-0e1d62d0e78e req-1c13a591-6e33-4165-9649-d4aa6c89bfa0 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:46.032282 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e26b855-21da-453c-8b87-0e1d62d0e78e req-1c13a591-6e33-4165-9649-d4aa6c89bfa0 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 944 time: 0.1537266 May 12 15:06:46.119954 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e26b855-21da-453c-8b87-0e1d62d0e78e req-3731d484-5a6b-495c-85f7-d8e351c7ace1 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806620 May 12 15:06:46.149203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8a33daa6-587f-4787-befb-2fa6e1051f2c details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:06:46.227537 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device b6035326-cd91-47d7-8a65-cc2dd3d1d127 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:46.295656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-b4d17fb1-b8e7-4de3-b694-3ee70c3d597b tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=7413f696702a49c390950b9a967696fa&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0725696 May 12 15:06:46.411868 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-128219e8-622e-4928-a427-f475bbb9aada req-d1014c85-b7db-4147-96e3-599405014215 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] 10.222.0.82 "GET /v2.0/security-groups/c38c71d5-90b7-433e-b122-2d9be7ccc06a HTTP/1.1" status: 200 len: 1777 time: 0.2653651 May 12 15:06:46.493827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:46.508256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '8a33daa6-587f-4787-befb-2fa6e1051f2c', 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3', 'port_id': '8a33daa6-587f-4787-befb-2fa6e1051f2c', 'mac_address': 'fa:16:3e:a2:b8:c2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 567, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bc8f64ab-e415-4d25-919a-8e712e76a5f6', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:06:46.539917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-128219e8-622e-4928-a427-f475bbb9aada req-319ccf50-410c-404c-aa78-453522ba4eb8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:46.550735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-82ddc776-6e83-4b9c-a116-60ede53f5812 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:46.553907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-82ddc776-6e83-4b9c-a116-60ede53f5812 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2509825 May 12 15:06:46.573439 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port b6035326-cd91-47d7-8a65-cc2dd3d1d127 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:46.576377 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:46.592428 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-aead0ada-3340-469e-987f-1cabea854723 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/quotas/7413f696702a49c390950b9a967696fa HTTP/1.1" status: 200 len: 375 time: 0.0280254 May 12 15:06:46.593527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port b6035326-cd91-47d7-8a65-cc2dd3d1d127 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:46.593895 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:46.596337 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-128219e8-622e-4928-a427-f475bbb9aada req-319ccf50-410c-404c-aa78-453522ba4eb8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:46.648493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8a33daa6-587f-4787-befb-2fa6e1051f2c {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:06:46.685927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:46.720876 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:46.731179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-1f4da90c-b146-42fe-9f22-fa8e1bb29a4c tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=7413f696702a49c390950b9a967696fa&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1265695 May 12 15:06:46.732066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-128219e8-622e-4928-a427-f475bbb9aada req-319ccf50-410c-404c-aa78-453522ba4eb8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:46.763404 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-128219e8-622e-4928-a427-f475bbb9aada req-319ccf50-410c-404c-aa78-453522ba4eb8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:46.779508 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-128219e8-622e-4928-a427-f475bbb9aada req-319ccf50-410c-404c-aa78-453522ba4eb8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] 10.222.0.82 "DELETE /v2.0/security-groups/c38c71d5-90b7-433e-b122-2d9be7ccc06a HTTP/1.1" status: 204 len: 173 time: 0.3665771 May 12 15:06:46.789115 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-319ccf50-410c-404c-aa78-453522ba4eb8 tempest-SecurityGroupsTestAdminJSON-161193331 tempest-SecurityGroupsTestAdminJSON-161193331-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c38c71d5-90b7-433e-b122-2d9be7ccc06a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:46.889012 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:46.994889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=8a33daa6-587f-4787-befb-2fa6e1051f2c,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:47.041451 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port b6035326-cd91-47d7-8a65-cc2dd3d1d127, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:47.054430 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:47.163241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['8a33daa6-587f-4787-befb-2fa6e1051f2c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:06:47.354175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-754a9112-7597-43e6-ab93-7bec219dc69f req-4db584d5-6d19-43a3-846f-089d79149128 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:47.364878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-754a9112-7597-43e6-ab93-7bec219dc69f req-4db584d5-6d19-43a3-846f-089d79149128 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.2055345 May 12 15:06:47.506151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45930) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:47.536610 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-754a9112-7597-43e6-ab93-7bec219dc69f req-f3758738-3fb3-4749-b8cd-511e0afb71ac tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1701300 May 12 15:06:47.663991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=b6035326-cd91-47d7-8a65-cc2dd3d1d127,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:47.677515 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:47.822668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7435aee4-a4b1-430a-88b2-13ef5ccee23d req-570a0e61-75a8-4bc2-b0d3-d773223f373e tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 210 time: 0.1849687 May 12 15:06:47.906233 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-49ff2a61-278c-42e7-adf4-1e4614339222 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8bbaabbfb25445218d14a5645ed3ac41&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3978326 May 12 15:06:47.908548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45948) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:47.972885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86881e13-2515-46d4-a5a5-4bc93a1b8647', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:47.998252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0b7486f7-75f8-4d03-b9a6-852d19df8952 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:48.028942 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0b7486f7-75f8-4d03-b9a6-852d19df8952 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:48.102860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b8cd5b6-6e3f-46b7-a1d4-81fb820bedc6 req-cd5178cc-e824-4036-b353-73396c96f53f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:48.111009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b8cd5b6-6e3f-46b7-a1d4-81fb820bedc6 req-cd5178cc-e824-4036-b353-73396c96f53f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 945 time: 0.1132743 May 12 15:06:48.113177 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0b7486f7-75f8-4d03-b9a6-852d19df8952 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:48.159981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b7486f7-75f8-4d03-b9a6-852d19df8952 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2306b2b5-ab79-4ba6-8355-d9eb7791306a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:48.188240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b8cd5b6-6e3f-46b7-a1d4-81fb820bedc6 req-f94c1180-afd8-4eaa-9f9c-47b375d32004 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0760856 May 12 15:06:48.211244 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0b7486f7-75f8-4d03-b9a6-852d19df8952 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:48.212593 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0b7486f7-75f8-4d03-b9a6-852d19df8952 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2306b2b5-ab79-4ba6-8355-d9eb7791306a HTTP/1.1" status: 204 len: 168 time: 0.3031063 May 12 15:06:48.442398 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d999b1d5-6a40-406d-ab68-caa19008c528'] response: {'server_uuid': '86881e13-2515-46d4-a5a5-4bc93a1b8647', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127', 'code': 200} May 12 15:06:48.753024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e154e835-309b-4a10-80fa-65ff68ff8215 req-faf0178a-1e9b-422c-88d0-b0de30332a8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:48.756075 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e154e835-309b-4a10-80fa-65ff68ff8215 req-faf0178a-1e9b-422c-88d0-b0de30332a8e service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 1101 time: 0.2107928 May 12 15:06:48.846125 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e154e835-309b-4a10-80fa-65ff68ff8215 req-b0f9f3ac-d0c6-4250-84d2-f9c50120e871 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0778980 May 12 15:06:48.861206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45992) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:48.890009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ca129ef-edb2-4c7b-81f0-2a634b165e0d req-a4a4be4e-b05e-4ab0-95ae-96cd069c0dd5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:48.891700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ca129ef-edb2-4c7b-81f0-2a634b165e0d req-a4a4be4e-b05e-4ab0-95ae-96cd069c0dd5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.1797998 May 12 15:06:48.936002 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-645b9cf0-ad22-4564-8e09-05698d6a6548 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=88b7de9679da43a4a76a9546c6cb90b2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0732470 May 12 15:06:48.938642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45996) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:48.970359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ca129ef-edb2-4c7b-81f0-2a634b165e0d req-633a81d5-216b-4fef-9923-3106308c7c31 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721917 May 12 15:06:49.027986 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f7c4065-76d9-4e25-8ba0-32b49cad1258 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:49.077492 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f7c4065-76d9-4e25-8ba0-32b49cad1258 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:49.174911 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f7c4065-76d9-4e25-8ba0-32b49cad1258 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:49.193703 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-206d051a-a903-48a3-be5d-6493394b72f6 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=7413f696702a49c390950b9a967696fa&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0482757 May 12 15:06:49.203736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f7c4065-76d9-4e25-8ba0-32b49cad1258 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=432e9fab-3b4e-4ffa-bf3e-0a2a467c0c53,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:49.383237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-b4ea40dc-541e-4060-857d-76d410d7551d tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:49.384685 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-b4ea40dc-541e-4060-857d-76d410d7551d tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1720638 May 12 15:06:49.385791 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f7c4065-76d9-4e25-8ba0-32b49cad1258 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:49.387026 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6f7c4065-76d9-4e25-8ba0-32b49cad1258 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/432e9fab-3b4e-4ffa-bf3e-0a2a467c0c53 HTTP/1.1" status: 204 len: 168 time: 0.4471366 May 12 15:06:49.416161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Request body: {'port': {'device_id': '5102166c-3857-4902-810f-a049926fe5f6', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '7413f696702a49c390950b9a967696fa'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:49.546817 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c29b6dcb-3b31-457a-98d7-3144b7431110 req-e4033568-17f6-454a-b2c4-5e71c9f11853 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 210 time: 0.0955558 May 12 15:06:49.692445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:49.716689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:49.745318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Made reservation on behalf of 7413f696702a49c390950b9a967696fa for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:06:49.749850 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:49.989803 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c673cea-3b06-4903-b72d-f824cbf5e84a req-0be3c341-3cea-49e4-92ff-b5a6ecc2aa02 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:50.001915 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c673cea-3b06-4903-b72d-f824cbf5e84a req-0be3c341-3cea-49e4-92ff-b5a6ecc2aa02 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 945 time: 0.1943202 May 12 15:06:50.093005 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c673cea-3b06-4903-b72d-f824cbf5e84a req-5d6f0167-6c25-4681-aec2-6122ebee8288 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0902267 May 12 15:06:50.165654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8a33daa6-587f-4787-befb-2fa6e1051f2c up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:06:50.227012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Allocated IP 192.168.233.223 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:06:50.427486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 8a33daa6-587f-4787-befb-2fa6e1051f2c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:50.435588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 8a33daa6-587f-4787-befb-2fa6e1051f2c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:50.437262 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:50.524122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0580042-a32c-4dfd-9584-f1061ef11836 req-3c8c23ba-37fc-4a26-a9f9-e5c1e477b630 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:50.530138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46050) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:50.534076 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b0580042-a32c-4dfd-9584-f1061ef11836 req-3c8c23ba-37fc-4a26-a9f9-e5c1e477b630 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.1465847 May 12 15:06:50.637720 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:50.661991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b0580042-a32c-4dfd-9584-f1061ef11836 req-0c014809-ba98-4722-af81-b3f11f2b3a7b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1259928 May 12 15:06:50.708226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c16773f3-58ee-4af2-a29d-d343b8561a31', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a33daa6-587f-4787-befb-2fa6e1051f2c'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:50.734463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:50.749009 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:50.969336 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-74912c07-5b6d-4294-bcd4-adbe44990c71'] response: {'server_uuid': 'c16773f3-58ee-4af2-a29d-d343b8561a31', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a33daa6-587f-4787-befb-2fa6e1051f2c', 'code': 200} May 12 15:06:51.015498 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-27cc8b7e-4fd5-4256-b3f2-eee68faa0d2a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:51.038902 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f41b345f-ba96-42a6-bbd5-f29d67a5cc10 req-98c50289-e664-4099-98e1-0ed7d6491b21 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 210 time: 0.0864072 May 12 15:06:51.041665 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=8a33daa6-587f-4787-befb-2fa6e1051f2c,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:51.095759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-27cc8b7e-4fd5-4256-b3f2-eee68faa0d2a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:51.115600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-27cc8b7e-4fd5-4256-b3f2-eee68faa0d2a admin admin] Usage tracker for resource:security_group_rule and tenant:c267db25de4347818c32b0e4506731b4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:51.120704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:51.125137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-27cc8b7e-4fd5-4256-b3f2-eee68faa0d2a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:51.137196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-27cc8b7e-4fd5-4256-b3f2-eee68faa0d2a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:51.150000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29728092-7f70-499e-8713-966096976e1a req-87d689c3-38d4-4682-952e-4cccc0513eb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:51.151883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29728092-7f70-499e-8713-966096976e1a req-87d689c3-38d4-4682-952e-4cccc0513eb5 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 1097 time: 0.1071429 May 12 15:06:51.157654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Transition to ACTIVE for port object 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:51.230009 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:51.252445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29728092-7f70-499e-8713-966096976e1a req-10919c3e-81a8-4ba9-9cd2-01d53e5084b7 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0899310 May 12 15:06:51.258415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['bea6d555-5915-4366-91f7-7e9771e26806'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:06:51.309491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['e5430b6d-6430-4a47-b068-7f891fa37da9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:06:51.439743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:06:51.451991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:06:51.486483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:06:51.497530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:51.499938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:51.559421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Pushing event updated for resources: {'Port': ['ID=8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:51.566351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-27cc8b7e-4fd5-4256-b3f2-eee68faa0d2a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:51.587314 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-27cc8b7e-4fd5-4256-b3f2-eee68faa0d2a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:51.601720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d31baf4c-b8f8-4b44-84bc-875f600102f8 req-9c347ce0-59f2-4453-aeea-8913590e2f59 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:51.609982 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d31baf4c-b8f8-4b44-84bc-875f600102f8 req-9c347ce0-59f2-4453-aeea-8913590e2f59 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 946 time: 0.2448428 May 12 15:06:51.736562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d31baf4c-b8f8-4b44-84bc-875f600102f8 req-751cd176-89fe-445a-8433-dbeb0bfa31c8 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1256347 May 12 15:06:51.754824 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-27cc8b7e-4fd5-4256-b3f2-eee68faa0d2a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c267db25de4347818c32b0e4506731b4&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2114701 May 12 15:06:51.754824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46122) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:51.754824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27cc8b7e-4fd5-4256-b3f2-eee68faa0d2a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=948f6445-7f53-43e6-90ab-894463ce4d86,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:51.764590 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-363f8c45-1698-4b6d-8eed-c3e8e45760e4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.3613558 May 12 15:06:51.863197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Request body: {'port': {'device_id': '5102166c-3857-4902-810f-a049926fe5f6', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:51.943070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0c646391-e935-40d7-8dbe-51dc210dcc41 None None] Provisioning for port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:06:51.944727 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5a845385-7ae8-4d98-94ec-8fe45daef51c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:51.954637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0c646391-e935-40d7-8dbe-51dc210dcc41 None None] Provisioning complete for port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:06:51.955006 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0c646391-e935-40d7-8dbe-51dc210dcc41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:51.998481 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5a845385-7ae8-4d98-94ec-8fe45daef51c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:52.089692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db61b20-f1c5-41c4-9070-6495d88c7740 req-b65a4414-c5f4-4b17-a9df-5c0b969e0e09 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:52.091177 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1db61b20-f1c5-41c4-9070-6495d88c7740 req-b65a4414-c5f4-4b17-a9df-5c0b969e0e09 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.1168439 May 12 15:06:52.108219 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:52.161039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0c646391-e935-40d7-8dbe-51dc210dcc41 None None] Port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:06:52.161769 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1db61b20-f1c5-41c4-9070-6495d88c7740 req-bbf4b9ea-a9ca-487f-a7ff-e964038e2db7 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646017 May 12 15:06:52.520737 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5a845385-7ae8-4d98-94ec-8fe45daef51c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:52.649751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d45f2a6-0a6e-4da1-bfca-689ff2c49096 req-43a17a49-937b-451a-86e1-0252e22cafc1 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:52.658545 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d45f2a6-0a6e-4da1-bfca-689ff2c49096 req-43a17a49-937b-451a-86e1-0252e22cafc1 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 936 time: 0.1924264 May 12 15:06:52.696237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a845385-7ae8-4d98-94ec-8fe45daef51c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=948f6445-7f53-43e6-90ab-894463ce4d86,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:52.729699 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5a845385-7ae8-4d98-94ec-8fe45daef51c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:52.736318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d45f2a6-0a6e-4da1-bfca-689ff2c49096 req-f177e02a-b694-4743-a2dd-47b31aa40c23 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0767810 May 12 15:06:52.738433 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5a845385-7ae8-4d98-94ec-8fe45daef51c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/948f6445-7f53-43e6-90ab-894463ce4d86 HTTP/1.1" status: 204 len: 168 time: 0.9683979 May 12 15:06:53.081857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:06:53.092156 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:53.128072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Transition to ACTIVE for port object 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:06:53.137662 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:53.469530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Attempting to bind port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:06:53.470000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Attempting to bind port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:06:53.470328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Attempting to bind port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:53.496325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Pushing event updated for resources: {'Port': ['ID=8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:53.499660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:06:53.499989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Attempting to bind port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:06:53.508750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 6, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:06:53.509095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:06:53.509530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:06:53.509959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Bound port: 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:06:53.510303 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:53.640001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] For port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:06:53.644801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] For port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:06:53.664622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:53.692665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e9d1368-8542-4159-93a1-0308391a7430 req-a8462cb7-dd24-4e48-b915-87d23f0cc591 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:53.699234 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e9d1368-8542-4159-93a1-0308391a7430 req-a8462cb7-dd24-4e48-b915-87d23f0cc591 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 946 time: 0.2274356 May 12 15:06:53.748531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46196) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:53.775641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:53.776662 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:53.777791 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] 10.222.0.84 "PUT /v2.0/ports/8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 HTTP/1.1" status: 200 len: 1096 time: 1.9388802 May 12 15:06:53.791810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5102166c-3857-4902-810f-a049926fe5f6', 'tag': '8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:06:53.808099 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3658286c-b551-4a87-bd0c-2c9e35ac8f0a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:53.840894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e9d1368-8542-4159-93a1-0308391a7430 req-56219154-cd1e-4e10-b135-fdaecea39ab2 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1357591 May 12 15:06:53.905891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3658286c-b551-4a87-bd0c-2c9e35ac8f0a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:53.917277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3658286c-b551-4a87-bd0c-2c9e35ac8f0a admin admin] Usage tracker for resource:security_group_rule and tenant:2568d6e797f74287a9794bf8f3d0513e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:53.931563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3658286c-b551-4a87-bd0c-2c9e35ac8f0a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:53.943195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3658286c-b551-4a87-bd0c-2c9e35ac8f0a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:53.970600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7ef21fb-3a32-4997-8c5e-fc1a3fe46c62 service neutron] Pushing event updated for resources: {'Port': ['ID=8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:54.060506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-b00c233c-3c58-47ef-b9c1-e15b20f8d831 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:54.062605 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-b00c233c-3c58-47ef-b9c1-e15b20f8d831 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=7413f696702a49c390950b9a967696fa&device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 1099 time: 0.2105899 May 12 15:06:54.070773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ce50b1-d278-4ae9-a655-00286e5fcd53 req-2e0d17ca-5957-4b76-ba55-b2aa71762f2d tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:54.072724 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50ce50b1-d278-4ae9-a655-00286e5fcd53 req-2e0d17ca-5957-4b76-ba55-b2aa71762f2d tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 1101 time: 0.1733339 May 12 15:06:54.097664 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-50ce50b1-d278-4ae9-a655-00286e5fcd53 req-b9f9e5ea-30ee-4c25-8301-edcdcec5c7cf tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:54.115024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-50ce50b1-d278-4ae9-a655-00286e5fcd53 req-b9f9e5ea-30ee-4c25-8301-edcdcec5c7cf tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:54.127365 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-50ce50b1-d278-4ae9-a655-00286e5fcd53 req-b9f9e5ea-30ee-4c25-8301-edcdcec5c7cf tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] Usage tracker for resource:security_group_rule and tenant:847be75eb185471bb30da8258939c648 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:54.139062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-50ce50b1-d278-4ae9-a655-00286e5fcd53 req-b9f9e5ea-30ee-4c25-8301-edcdcec5c7cf tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:54.158859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-50ce50b1-d278-4ae9-a655-00286e5fcd53 req-b9f9e5ea-30ee-4c25-8301-edcdcec5c7cf tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:54.172345 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-99ad337b-2cdc-43b4-804f-dd0573f1e785 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.223&port_id=8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 HTTP/1.1" status: 200 len: 217 time: 0.0937874 May 12 15:06:54.174104 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3658286c-b551-4a87-bd0c-2c9e35ac8f0a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:54.226273 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3658286c-b551-4a87-bd0c-2c9e35ac8f0a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:54.289624 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3658286c-b551-4a87-bd0c-2c9e35ac8f0a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2568d6e797f74287a9794bf8f3d0513e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5252097 May 12 15:06:54.289841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46218) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:54.291359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3658286c-b551-4a87-bd0c-2c9e35ac8f0a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fa72a835-04af-488b-96f8-53e55e43e5ad,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:54.327226 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-9bcbea92-cde1-4a27-83f7-8d07463b9645 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:54.328646 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-9bcbea92-cde1-4a27-83f7-8d07463b9645 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1425097 May 12 15:06:54.356171 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-50ce50b1-d278-4ae9-a655-00286e5fcd53 req-b9f9e5ea-30ee-4c25-8301-edcdcec5c7cf tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:54.373949 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-50ce50b1-d278-4ae9-a655-00286e5fcd53 req-b9f9e5ea-30ee-4c25-8301-edcdcec5c7cf tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:54.450061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9f9e5ea-30ee-4c25-8301-edcdcec5c7cf tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9652de71-308b-4f0f-9d52-92411bf020fc,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:54.462279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-787967a8-bb60-412b-9871-adf70b0e269c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:54.464487 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-787967a8-bb60-412b-9871-adf70b0e269c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1279066 May 12 15:06:54.496293 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50ce50b1-d278-4ae9-a655-00286e5fcd53 req-b9f9e5ea-30ee-4c25-8301-edcdcec5c7cf tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4156597 May 12 15:06:54.555304 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d750685-62bb-412c-8dd0-49d9f2f54fa7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:54.607128 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d750685-62bb-412c-8dd0-49d9f2f54fa7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:54.655425 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-159f0b55-34b6-482d-9caa-a50c3c899fd5 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1779432 May 12 15:06:54.685671 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d750685-62bb-412c-8dd0-49d9f2f54fa7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:54.710825 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d750685-62bb-412c-8dd0-49d9f2f54fa7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa72a835-04af-488b-96f8-53e55e43e5ad,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:54.736653 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d750685-62bb-412c-8dd0-49d9f2f54fa7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:54.738697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7d750685-62bb-412c-8dd0-49d9f2f54fa7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fa72a835-04af-488b-96f8-53e55e43e5ad HTTP/1.1" status: 204 len: 168 time: 0.4483283 May 12 15:06:54.845042 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc495b85-6fdc-47d1-9081-0df363e40778 req-77efc911-0ac7-478e-9937-bebfcf06476a service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1816938 May 12 15:06:54.987066 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-42c62a2f-85fa-4d65-8262-47acaf75524a'] response: {'name': 'network-changed', 'server_uuid': '5102166c-3857-4902-810f-a049926fe5f6', 'tag': '8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1', 'status': 'completed', 'code': 200} May 12 15:06:55.124168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690c7645-8a4c-4f06-8f93-b34b0a5ddbc3 req-8f142d31-090b-42f0-a7ad-0c80ec2089f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:55.125755 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-690c7645-8a4c-4f06-8f93-b34b0a5ddbc3 req-8f142d31-090b-42f0-a7ad-0c80ec2089f4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=7413f696702a49c390950b9a967696fa&device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 1099 time: 0.0870423 May 12 15:06:55.147450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf61730-eba8-4ab8-b2ac-31b112fad768 req-9b14e8c7-3a5f-46b3-8429-bde65e33fd19 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:55.148895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf61730-eba8-4ab8-b2ac-31b112fad768 req-9b14e8c7-3a5f-46b3-8429-bde65e33fd19 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 948 time: 0.1417985 May 12 15:06:55.238645 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf61730-eba8-4ab8-b2ac-31b112fad768 req-b8e5b3ce-4dae-4b20-89b0-557973d87422 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0754750 May 12 15:06:55.247907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7595e9b-c3c1-4d9c-a0a4-1cd7a59495d7 req-fabca6b6-7242-431c-8248-90ca19d5ef1e tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:55.266930 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7595e9b-c3c1-4d9c-a0a4-1cd7a59495d7 req-fabca6b6-7242-431c-8248-90ca19d5ef1e tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 1097 time: 0.1702125 May 12 15:06:55.287189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690c7645-8a4c-4f06-8f93-b34b0a5ddbc3 req-20161553-5391-4f11-a9c6-a11edf12a0a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:55.289316 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-690c7645-8a4c-4f06-8f93-b34b0a5ddbc3 req-20161553-5391-4f11-a9c6-a11edf12a0a4 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.1482618 May 12 15:06:55.324599 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7595e9b-c3c1-4d9c-a0a4-1cd7a59495d7 req-00cd06b4-9c7e-47d2-938a-27136e412152 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0553057 May 12 15:06:55.378695 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-690c7645-8a4c-4f06-8f93-b34b0a5ddbc3 req-93d677c5-afc6-46bc-9a1d-4adb8812a3af service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.223&port_id=8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 HTTP/1.1" status: 200 len: 217 time: 0.0812511 May 12 15:06:55.473829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690c7645-8a4c-4f06-8f93-b34b0a5ddbc3 req-9ec62bca-584a-491f-84eb-cc9dd582c3d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:55.476016 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-690c7645-8a4c-4f06-8f93-b34b0a5ddbc3 req-9ec62bca-584a-491f-84eb-cc9dd582c3d0 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0911336 May 12 15:06:55.657878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690c7645-8a4c-4f06-8f93-b34b0a5ddbc3 req-c3d7655f-4555-4e17-a22a-e7f5d4aaa115 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:55.662946 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-690c7645-8a4c-4f06-8f93-b34b0a5ddbc3 req-c3d7655f-4555-4e17-a22a-e7f5d4aaa115 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1759207 May 12 15:06:55.731331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46298) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:55.738783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1031250858', 'description': 'tempest-description--1393409790'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:55.744916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:55.749119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Usage tracker for resource:security_group and tenant:ff9b9aa97cf84863aedddc5615398c31 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:55.752500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:55.759032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:55.772397 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:55.801025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:55.808624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Usage tracker for resource:security_group_rule and tenant:ff9b9aa97cf84863aedddc5615398c31 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:55.819246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:55.832417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:55.859024 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-690c7645-8a4c-4f06-8f93-b34b0a5ddbc3 req-de78033a-d474-4356-abda-4d1114dcafa9 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1925497 May 12 15:06:55.988121 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:56.002943 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:56.055417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9c9166c2-fc2a-43df-8947-3b0f8ca10a32,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:56.083317 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:56.085350 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-802b1d12-46df-4053-b251-c93ece66155d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 0.3523018 May 12 15:06:56.091352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46336) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:56.105005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-94e66a74-580f-49ae-9940-7b962919a325 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Request body: {'security_group_rule': {'security_group_id': '9c9166c2-fc2a-43df-8947-3b0f8ca10a32', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:56.118524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-94e66a74-580f-49ae-9940-7b962919a325 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:56.123768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-94e66a74-580f-49ae-9940-7b962919a325 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Usage tracker for resource:security_group_rule and tenant:ff9b9aa97cf84863aedddc5615398c31 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:56.128972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-94e66a74-580f-49ae-9940-7b962919a325 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:56.142792 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-690c7645-8a4c-4f06-8f93-b34b0a5ddbc3 req-f24e205d-5108-4ace-9dbe-01b8e170728f service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2723985 May 12 15:06:56.185892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-94e66a74-580f-49ae-9940-7b962919a325 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:56.234719 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-94e66a74-580f-49ae-9940-7b962919a325 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:56.292788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46344) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:56.326095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db4a952-be92-4ee3-8df4-e18f2b9c19a6 req-84918d9a-d761-4dd6-8766-140a651ef197 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:56.327642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8db4a952-be92-4ee3-8df4-e18f2b9c19a6 req-84918d9a-d761-4dd6-8766-140a651ef197 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.1948509 May 12 15:06:56.362953 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-94e66a74-580f-49ae-9940-7b962919a325 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:56.373055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-94e66a74-580f-49ae-9940-7b962919a325 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:56.412892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94e66a74-580f-49ae-9940-7b962919a325 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=95c6a59a-1022-4a65-b33c-6806b4debee5,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:56.431027 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8db4a952-be92-4ee3-8df4-e18f2b9c19a6 req-8ac645c8-bc86-4445-868e-f0cf97418b10 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0900080 May 12 15:06:56.450897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-94e66a74-580f-49ae-9940-7b962919a325 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:56.454649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46352) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:56.454837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-94e66a74-580f-49ae-9940-7b962919a325 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3599615 May 12 15:06:56.461757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-05509599-af0b-4fc1-b9ee-e92eb342b2af tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Request body: {'security_group_rule': {'security_group_id': '9c9166c2-fc2a-43df-8947-3b0f8ca10a32', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:56.473640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-05509599-af0b-4fc1-b9ee-e92eb342b2af tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:56.631370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-05509599-af0b-4fc1-b9ee-e92eb342b2af tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Usage tracker for resource:security_group_rule and tenant:ff9b9aa97cf84863aedddc5615398c31 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:56.636662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-05509599-af0b-4fc1-b9ee-e92eb342b2af tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:56.668058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-05509599-af0b-4fc1-b9ee-e92eb342b2af tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:56.739424 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-05509599-af0b-4fc1-b9ee-e92eb342b2af tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:56.822954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64ad31e0-2a46-4ad6-ab99-15e0d5a0c67a req-88446ff2-badb-44f2-89f5-8409ff1d4305 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:56.825571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64ad31e0-2a46-4ad6-ab99-15e0d5a0c67a req-88446ff2-badb-44f2-89f5-8409ff1d4305 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 948 time: 0.2349253 May 12 15:06:56.882933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64ad31e0-2a46-4ad6-ab99-15e0d5a0c67a req-47ea8f9f-a22b-438b-8247-76f4843cfdf7 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505960 May 12 15:06:56.895626 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-99173d38-54bf-48b7-a6da-5bba3111c99a service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.6011591 May 12 15:06:56.950753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-05509599-af0b-4fc1-b9ee-e92eb342b2af tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:56.955479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46398) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:56.969650 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-05509599-af0b-4fc1-b9ee-e92eb342b2af tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:56.998814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05509599-af0b-4fc1-b9ee-e92eb342b2af tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7cc55dc5-b3ad-4307-a7f8-8ffcb230cc8a,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:57.032733 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-05509599-af0b-4fc1-b9ee-e92eb342b2af tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:57.038087 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-05509599-af0b-4fc1-b9ee-e92eb342b2af tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5815136 May 12 15:06:57.040680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46412) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:57.047092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:06:57.061036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:57.073834 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Usage tracker for resource:floatingip and tenant:ff9b9aa97cf84863aedddc5615398c31 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:57.078044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:57.088474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:57.109795 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:57.368798 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:57.429980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-901d37e7-36fc-4f3f-86e9-c70c0e15b667 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:57.469305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-901d37e7-36fc-4f3f-86e9-c70c0e15b667 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:57.475634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-901d37e7-36fc-4f3f-86e9-c70c0e15b667 admin admin] Usage tracker for resource:security_group_rule and tenant:9c07fdf35cda4f42a688a7ab6b3e0518 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:57.489281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-901d37e7-36fc-4f3f-86e9-c70c0e15b667 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:57.501380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-901d37e7-36fc-4f3f-86e9-c70c0e15b667 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:57.677935 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-901d37e7-36fc-4f3f-86e9-c70c0e15b667 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:57.688396 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-901d37e7-36fc-4f3f-86e9-c70c0e15b667 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:57.729979 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Allocated IP 172.25.8.26 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/98d91964-b059-432a-9498-7c67ee3cce35) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:06:57.764768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a87938f-3c04-464d-96c4-15326818d285 req-f306fdc4-d8eb-438a-9fa1-253f160056e4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:57.766653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a87938f-3c04-464d-96c4-15326818d285 req-f306fdc4-d8eb-438a-9fa1-253f160056e4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.1643510 May 12 15:06:57.823653 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-901d37e7-36fc-4f3f-86e9-c70c0e15b667 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9c07fdf35cda4f42a688a7ab6b3e0518&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8664267 May 12 15:06:57.826265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-901d37e7-36fc-4f3f-86e9-c70c0e15b667 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ac7014b-dc0e-4a89-8fbd-272476997f64,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:57.831879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46446) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:57.960310 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2184c5e7-f942-4a4e-b973-b13a286c660a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:58.039195 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2184c5e7-f942-4a4e-b973-b13a286c660a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:58.091527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a87938f-3c04-464d-96c4-15326818d285 req-c13c07c5-fe53-4aaf-8a93-c7bf02bd2ab3 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3001058 May 12 15:06:58.132340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2184c5e7-f942-4a4e-b973-b13a286c660a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:58.188506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2184c5e7-f942-4a4e-b973-b13a286c660a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ac7014b-dc0e-4a89-8fbd-272476997f64,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:58.192953 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2184c5e7-f942-4a4e-b973-b13a286c660a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:58.195309 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2184c5e7-f942-4a4e-b973-b13a286c660a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1ac7014b-dc0e-4a89-8fbd-272476997f64 HTTP/1.1" status: 204 len: 168 time: 0.3608987 May 12 15:06:58.228216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:06:58.232494 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:58.252739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a357dd-4312-4626-84cb-82294b9faf4f req-7faff0d9-9f85-4832-a3c8-1a0110da01a2 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:58.255338 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1a357dd-4312-4626-84cb-82294b9faf4f req-7faff0d9-9f85-4832-a3c8-1a0110da01a2 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 948 time: 0.3704560 May 12 15:06:58.357887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1a357dd-4312-4626-84cb-82294b9faf4f req-722f7544-5cf8-4439-ad9d-a91d35af294d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0909431 May 12 15:06:58.403435 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:58.498103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:06:58.501891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:06:58.508414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:06:58.511997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:58.549484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Pushing event updated for resources: {'Port': ['ID=98d91964-b059-432a-9498-7c67ee3cce35,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:58.550204 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1', 'mac_address': 'fa:16:3e:6c:05:2f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.223'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:06:58.568773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ade6e0c-9af1-4dda-956e-5e94a967b566 req-c9ee1eba-ee23-470f-9f48-cb7645464e76 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:58.570326 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ade6e0c-9af1-4dda-956e-5e94a967b566 req-c9ee1eba-ee23-470f-9f48-cb7645464e76 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 948 time: 0.2514102 May 12 15:06:58.599519 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:58.646701 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:58.673375 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:06:58.712399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:06:58.718239 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:58.742065 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:58.773757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46482) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:58.801844 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff00cd74-0ee2-4ede-9739-5c1c79267e20 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:58.803372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ade6e0c-9af1-4dda-956e-5e94a967b566 req-0e49bfe3-25bd-4be1-9e34-290702396731 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2244256 May 12 15:06:58.873646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:58.880068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ff00cd74-0ee2-4ede-9739-5c1c79267e20 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:06:58.897376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ff00cd74-0ee2-4ede-9739-5c1c79267e20 admin admin] Usage tracker for resource:security_group_rule and tenant:8370427fd1fc4a25ac0bcc133952f61a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:06:58.902593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ff00cd74-0ee2-4ede-9739-5c1c79267e20 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:06:58.911080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ff00cd74-0ee2-4ede-9739-5c1c79267e20 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:06:59.079763 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:59.080519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-9bc298b0-67fd-4e2f-8912-97ce0b983201 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:59.085704 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-9bc298b0-67fd-4e2f-8912-97ce0b983201 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 1101 time: 0.1134520 May 12 15:06:59.096067 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:59.173597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:06:59.182468 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:59.216341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Pushing event updated for resources: {'Port': ['ID=98d91964-b059-432a-9498-7c67ee3cce35,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:59.268026 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:59.273360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-418090d5-2cd3-49fb-a86e-f7fa85476ffb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.2314315 May 12 15:06:59.385810 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff00cd74-0ee2-4ede-9739-5c1c79267e20 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:59.397252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff00cd74-0ee2-4ede-9739-5c1c79267e20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:59.463030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff00cd74-0ee2-4ede-9739-5c1c79267e20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=84982e83-6dd2-40fd-ab3e-bf2121f3aae1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:06:59.570585 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ff00cd74-0ee2-4ede-9739-5c1c79267e20 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8370427fd1fc4a25ac0bcc133952f61a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7906830 May 12 15:06:59.570799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46504) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:06:59.584218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-eb16c004-a717-4272-be5d-182425a57e7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:59.586748 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-eb16c004-a717-4272-be5d-182425a57e7c service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.4252861 May 12 15:06:59.691846 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-156c8685-1546-4f0d-b01f-d38447767221 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.253&port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127 HTTP/1.1" status: 200 len: 217 time: 0.0973694 May 12 15:06:59.759287 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b249683e-9d1a-4ef3-850b-0555ce6d4967 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:06:59.775690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd659e48-c68c-4b07-979f-1529963e812d req-0f3482c8-c1ba-4ee9-aa30-b538504bc4cc tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:59.777699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd659e48-c68c-4b07-979f-1529963e812d req-0f3482c8-c1ba-4ee9-aa30-b538504bc4cc tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.84 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 948 time: 0.3879247 May 12 15:06:59.781423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-8f2ac174-e8a6-4671-9388-46aeee0cb585 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:59.782988 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-8f2ac174-e8a6-4671-9388-46aeee0cb585 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0849333 May 12 15:06:59.889322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47fcde74-22d5-420d-b8fe-c39edf7a7c08 req-e4e3c8c0-f533-4079-a639-dacc03f79b31 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:59.894325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fcde74-22d5-420d-b8fe-c39edf7a7c08 req-e4e3c8c0-f533-4079-a639-dacc03f79b31 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.3850856 May 12 15:06:59.898896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-ce367386-b38d-452d-be59-2a49e06ef7ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:06:59.900607 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-ce367386-b38d-452d-be59-2a49e06ef7ee service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1094487 May 12 15:06:59.963074 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b249683e-9d1a-4ef3-850b-0555ce6d4967 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:00.037167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46516) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:00.046215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-fd659e48-c68c-4b07-979f-1529963e812d req-aee68a2c-e924-41ad-8de7-5fcf28e25e66 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Deleting port a49de190-3075-4dff-a67a-fd9f694116cb {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:07:00.046552 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fd659e48-c68c-4b07-979f-1529963e812d req-aee68a2c-e924-41ad-8de7-5fcf28e25e66 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:00.061715 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-641c78b5-f0da-43a9-ac02-423b1ad3a9f3 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1543388 May 12 15:07:00.223655 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-0c85854a-ace5-4629-8862-7f1ae5c2a090 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1553743 May 12 15:07:00.226228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fcde74-22d5-420d-b8fe-c39edf7a7c08 req-b9f5b0ae-f38a-469e-a8c9-60be270b29e2 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3249795 May 12 15:07:00.300992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b249683e-9d1a-4ef3-850b-0555ce6d4967 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:00.343981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de8491bd-066d-4915-bd4a-0598231285b1 req-3ed73439-13f5-4c89-aaa5-bdf409579afe tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:00.352930 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de8491bd-066d-4915-bd4a-0598231285b1 req-3ed73439-13f5-4c89-aaa5-bdf409579afe tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 948 time: 0.5741332 May 12 15:07:00.383922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b249683e-9d1a-4ef3-850b-0555ce6d4967 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=84982e83-6dd2-40fd-ab3e-bf2121f3aae1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:00.465437 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ea17982-8406-4c5b-a321-eaf83e90e675 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:00.492062 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b249683e-9d1a-4ef3-850b-0555ce6d4967 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:00.494222 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b249683e-9d1a-4ef3-850b-0555ce6d4967 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/84982e83-6dd2-40fd-ab3e-bf2121f3aae1 HTTP/1.1" status: 204 len: 168 time: 0.9117212 May 12 15:07:00.531916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6ea17982-8406-4c5b-a321-eaf83e90e675 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:00.543250 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de8491bd-066d-4915-bd4a-0598231285b1 req-d9078cbe-e761-462c-96ee-3af8088e7588 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1893768 May 12 15:07:00.595256 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6ea17982-8406-4c5b-a321-eaf83e90e675 admin admin] Usage tracker for resource:security_group_rule and tenant:478138ad58c74c44afe54973838fe4a1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:00.604486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6ea17982-8406-4c5b-a321-eaf83e90e675 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:00.622032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-003f12f3-604b-40b8-b574-2ae62e06846a tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Synchronizing usage tracker for tenant:ff9b9aa97cf84863aedddc5615398c31 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:07:00.624945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6ea17982-8406-4c5b-a321-eaf83e90e675 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:00.701112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-003f12f3-604b-40b8-b574-2ae62e06846a tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Unset dirty status for tenant:ff9b9aa97cf84863aedddc5615398c31 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:07:00.702494 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-003f12f3-604b-40b8-b574-2ae62e06846a tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1031250858&fields=id&tenant_id=ff9b9aa97cf84863aedddc5615398c31 HTTP/1.1" status: 200 len: 267 time: 0.3232646 May 12 15:07:00.819318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-fd659e48-c68c-4b07-979f-1529963e812d req-aee68a2c-e924-41ad-8de7-5fcf28e25e66 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] For port a49de190-3075-4dff-a67a-fd9f694116cb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a49de190-3075-4dff-a67a-fd9f694116cb,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:00.819679 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fd659e48-c68c-4b07-979f-1529963e812d req-aee68a2c-e924-41ad-8de7-5fcf28e25e66 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:01.010384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-fd659e48-c68c-4b07-979f-1529963e812d req-aee68a2c-e924-41ad-8de7-5fcf28e25e66 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Calling delete_port for a49de190-3075-4dff-a67a-fd9f694116cb owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:07:01.169038 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ea17982-8406-4c5b-a321-eaf83e90e675 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:01.190371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-be964098-e24d-426d-9958-9240e70aea52 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:01.192461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-be964098-e24d-426d-9958-9240e70aea52 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/networks?id=4c945198-2daa-4ae0-a8c1-07ee6da52271 HTTP/1.1" status: 200 len: 814 time: 0.4734201 May 12 15:07:01.196479 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ea17982-8406-4c5b-a321-eaf83e90e675 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:01.264889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-4fdc711a-f506-4b5b-9d7c-fec350126051 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/quotas/ff9b9aa97cf84863aedddc5615398c31 HTTP/1.1" status: 200 len: 375 time: 0.0595427 May 12 15:07:01.341902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ea17982-8406-4c5b-a321-eaf83e90e675 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dbaaf58f-b9f5-4e2b-9892-cb2c2f26de83,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:01.352528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09cf692a-c510-4eb9-9a1a-b83e154ec175 req-2272f148-49ea-411d-a49c-0d4ac4f5ae44 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:01.354011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09cf692a-c510-4eb9-9a1a-b83e154ec175 req-2272f148-49ea-411d-a49c-0d4ac4f5ae44 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 949 time: 0.5270622 May 12 15:07:01.356402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6ea17982-8406-4c5b-a321-eaf83e90e675 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=478138ad58c74c44afe54973838fe4a1&name=default HTTP/1.1" status: 200 len: 2979 time: 1.3145394 May 12 15:07:01.359326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46560) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:01.430061 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-936fbd99-87e6-4b91-8697-3da0da1e5c77 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:01.448951 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fd659e48-c68c-4b07-979f-1529963e812d req-aee68a2c-e924-41ad-8de7-5fcf28e25e66 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:01.465433 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-936fbd99-87e6-4b91-8697-3da0da1e5c77 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:01.489204 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09cf692a-c510-4eb9-9a1a-b83e154ec175 req-fdd76382-9555-45d1-ab51-04944f5258e6 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1138406 May 12 15:07:01.507608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aee68a2c-e924-41ad-8de7-5fcf28e25e66 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Pushing event deleted for resources: {'Port': ['ID=a49de190-3075-4dff-a67a-fd9f694116cb,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:01.540684 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-936fbd99-87e6-4b91-8697-3da0da1e5c77 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:01.560233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-936fbd99-87e6-4b91-8697-3da0da1e5c77 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbaaf58f-b9f5-4e2b-9892-cb2c2f26de83,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:01.594308 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-936fbd99-87e6-4b91-8697-3da0da1e5c77 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:01.598287 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-936fbd99-87e6-4b91-8697-3da0da1e5c77 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/dbaaf58f-b9f5-4e2b-9892-cb2c2f26de83 HTTP/1.1" status: 204 len: 168 time: 0.2355478 May 12 15:07:01.614306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-fd659e48-c68c-4b07-979f-1529963e812d req-aee68a2c-e924-41ad-8de7-5fcf28e25e66 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] No DVR routers for this DVR port a49de190-3075-4dff-a67a-fd9f694116cb on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:07:01.623651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-a9cda1fc-1dae-4c4a-98e4-f80bb8e6cb0c tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=ff9b9aa97cf84863aedddc5615398c31&fields=id HTTP/1.1" status: 200 len: 348 time: 0.3577046 May 12 15:07:01.625226 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fd659e48-c68c-4b07-979f-1529963e812d req-aee68a2c-e924-41ad-8de7-5fcf28e25e66 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:01.627285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfc4bc02-d56b-4ef8-8c50-af64aeb1795c', 'name': 'network-vif-deleted', 'tag': 'a49de190-3075-4dff-a67a-fd9f694116cb'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:01.675107 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd659e48-c68c-4b07-979f-1529963e812d req-aee68a2c-e924-41ad-8de7-5fcf28e25e66 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.84 "DELETE /v2.0/ports/a49de190-3075-4dff-a67a-fd9f694116cb HTTP/1.1" status: 204 len: 173 time: 1.8834565 May 12 15:07:01.846158 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-e7480d5e-ed30-4426-84d7-ab59335a930c service neutron] 10.222.0.82 "GET /v2.0/networks/4c945198-2daa-4ae0-a8c1-07ee6da52271?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1966562 May 12 15:07:02.021860 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:02.027285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-f401fbff-1ec0-4f1d-a785-dffa394df443 service neutron] 10.222.0.82 "GET /v2.0/networks/4c945198-2daa-4ae0-a8c1-07ee6da52271?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1800842 May 12 15:07:02.061142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46596) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:02.100482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9383bd46-9276-4645-b6c7-aa71856ce082 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:02.127627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9383bd46-9276-4645-b6c7-aa71856ce082 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:02.131427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9383bd46-9276-4645-b6c7-aa71856ce082 admin admin] Usage tracker for resource:security_group_rule and tenant:afbb7c12a15941b9a35ee94131a1bc54 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:02.134807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9383bd46-9276-4645-b6c7-aa71856ce082 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:02.143317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9383bd46-9276-4645-b6c7-aa71856ce082 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:02.251454 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:07:02.357374 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:07:02.370985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:02.371560 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:02.519925 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:02.524851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e58738e-7e90-4c17-b787-d0201b9a463c req-98268d34-966b-44b6-ba11-893b2a62778a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:02.532690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e58738e-7e90-4c17-b787-d0201b9a463c req-98268d34-966b-44b6-ba11-893b2a62778a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.1388059 May 12 15:07:02.552320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5102166c-3857-4902-810f-a049926fe5f6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:02.564684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:02.571086 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:02.589962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1a29537a-4a5e-4bee-95a9-048d6a15d54f req-2139d9f1-51f9-4eac-a70e-53f644b55870 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Synchronizing usage tracker for tenant:b109b727195f4a0286ba8c6b6aa99144 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:07:02.603466 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9383bd46-9276-4645-b6c7-aa71856ce082 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:02.609566 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9383bd46-9276-4645-b6c7-aa71856ce082 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:02.617276 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:07:02.624163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1a29537a-4a5e-4bee-95a9-048d6a15d54f req-2139d9f1-51f9-4eac-a70e-53f644b55870 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Unset dirty status for tenant:b109b727195f4a0286ba8c6b6aa99144 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:07:02.626459 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a29537a-4a5e-4bee-95a9-048d6a15d54f req-2139d9f1-51f9-4eac-a70e-53f644b55870 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 210 time: 0.0904734 May 12 15:07:02.695796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9383bd46-9276-4645-b6c7-aa71856ce082 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd218f39-b7de-4684-b5f4-dc9660f045b0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:02.706841 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9383bd46-9276-4645-b6c7-aa71856ce082 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=afbb7c12a15941b9a35ee94131a1bc54&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6430287 May 12 15:07:02.709817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46618) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:02.727664 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:02.771581 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c42a2235-551c-4033-85ba-821a954651d2'] response: {'server_uuid': 'dfc4bc02-d56b-4ef8-8c50-af64aeb1795c', 'name': 'network-vif-deleted', 'tag': 'a49de190-3075-4dff-a67a-fd9f694116cb', 'status': 'completed', 'code': 200} May 12 15:07:02.808915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c8f6139d-e884-46ca-a375-9eceb7ca7c5e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:02.821682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e58738e-7e90-4c17-b787-d0201b9a463c req-9d72ba0b-3176-4afc-bf3e-2d142cab4db5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2879014 May 12 15:07:02.829068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d64afbb3-3ad9-484c-be37-ed3c63d41368 req-472db8d4-66c5-4bc4-b498-0dedca2317a0 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 210 time: 0.0564318 May 12 15:07:02.855980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c8f6139d-e884-46ca-a375-9eceb7ca7c5e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:02.923936 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c8f6139d-e884-46ca-a375-9eceb7ca7c5e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:02.942879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8f6139d-e884-46ca-a375-9eceb7ca7c5e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd218f39-b7de-4684-b5f4-dc9660f045b0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:02.947772 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c8f6139d-e884-46ca-a375-9eceb7ca7c5e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:02.951112 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c8f6139d-e884-46ca-a375-9eceb7ca7c5e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cd218f39-b7de-4684-b5f4-dc9660f045b0 HTTP/1.1" status: 204 len: 168 time: 0.2368112 May 12 15:07:03.193070 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2dd6c041-65d9-4d64-9e36-15266485d77e'] response: {'server_uuid': '5102166c-3857-4902-810f-a049926fe5f6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1', 'code': 200} May 12 15:07:03.401901 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1c4a5be-39a1-414d-90e6-ef755de4b536 req-302e9f17-b7b6-478e-ac78-09571336ffd2 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:03.409717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1c4a5be-39a1-414d-90e6-ef755de4b536 req-302e9f17-b7b6-478e-ac78-09571336ffd2 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 950 time: 0.1867411 May 12 15:07:03.625519 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1c4a5be-39a1-414d-90e6-ef755de4b536 req-920480da-b3e8-456a-910f-566429067502 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2135520 May 12 15:07:03.658547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27b7153b-b934-4a50-a0a2-0d10e472131c req-850613b6-a978-44ff-998d-e313e8bd7424 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:03.660475 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27b7153b-b934-4a50-a0a2-0d10e472131c req-850613b6-a978-44ff-998d-e313e8bd7424 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 1101 time: 0.2459202 May 12 15:07:03.670926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c818af99-1ad8-4696-b5d6-8aa4b023027e req-782567ac-0754-4ddb-b778-757b37340f91 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:03.672446 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c818af99-1ad8-4696-b5d6-8aa4b023027e req-782567ac-0754-4ddb-b778-757b37340f91 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 946 time: 0.1869094 May 12 15:07:03.758379 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27b7153b-b934-4a50-a0a2-0d10e472131c req-452a6997-ca83-4a37-9e05-5c08cc437276 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0823121 May 12 15:07:03.795115 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c818af99-1ad8-4696-b5d6-8aa4b023027e req-be596c25-9aae-4922-ac32-c9064f07a99c tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0997145 May 12 15:07:04.175797 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff3f9767-bc51-40fe-8987-9e5aae379ef1 req-6080458e-a4e9-48a2-89f4-1f17c964548c tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfc4bc02-d56b-4ef8-8c50-af64aeb1795c HTTP/1.1" status: 200 len: 210 time: 0.1247568 May 12 15:07:04.195343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46666) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:04.244506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a49de190-3075-4dff-a67a-fd9f694116cb no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:07:04.342886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: a49de190-3075-4dff-a67a-fd9f694116cb {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:07:04.343214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a49de190-3075-4dff-a67a-fd9f694116cb not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:07:04.472599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-d41929d6-f4b3-4d92-8f38-1e033cc21139 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:04.474267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-d41929d6-f4b3-4d92-8f38-1e033cc21139 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.76 "GET /v2.0/networks?id=4c945198-2daa-4ae0-a8c1-07ee6da52271 HTTP/1.1" status: 200 len: 814 time: 0.5951686 May 12 15:07:04.535476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46680) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:04.575257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73e7efcc-43ec-4b9d-9831-001b10d2a3d7 req-414f9533-32c4-4a6b-b68b-ce1839c6e2d3 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 210 time: 0.0966063 May 12 15:07:04.592044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04875af-1600-4d3e-a2a9-b4bf3a58b586 req-42bdbffa-873e-4a92-9e09-f08a7f7f7d82 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:04.593640 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b04875af-1600-4d3e-a2a9-b4bf3a58b586 req-42bdbffa-873e-4a92-9e09-f08a7f7f7d82 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.3835700 May 12 15:07:04.603506 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-ed71a3c8-47b4-4248-b9a1-ca8a8b19d2ce tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ff9b9aa97cf84863aedddc5615398c31 HTTP/1.1" status: 200 len: 380 time: 0.0909209 May 12 15:07:04.645175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Request body: {'port': {'device_id': '5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'admin_state_up': True, 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'security_groups': ['9c9166c2-fc2a-43df-8947-3b0f8ca10a32']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:04.654138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb0b1060-dd02-49eb-bffa-fb1f275eb0a4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:04.689115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Request body: {'network': {'name': 'tempest-VolumesAdminNegativeTest-2000261788-network', 'tenant_id': '42cdb729a3834b40aed1f7fd83ab2973'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:04.695218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:04.703198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Usage tracker for resource:network and tenant:42cdb729a3834b40aed1f7fd83ab2973 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:04.707087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-eb0b1060-dd02-49eb-bffa-fb1f275eb0a4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:04.709996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:04.716944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-eb0b1060-dd02-49eb-bffa-fb1f275eb0a4 admin admin] Usage tracker for resource:security_group_rule and tenant:2244df1f61384f8d964da902649f94f8 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:04.719662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:04.722533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-eb0b1060-dd02-49eb-bffa-fb1f275eb0a4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:04.732706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-eb0b1060-dd02-49eb-bffa-fb1f275eb0a4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:04.745432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Made reservation on behalf of 42cdb729a3834b40aed1f7fd83ab2973 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:07:04.748418 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:04.766581 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:04.795675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:04.805580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Usage tracker for resource:security_group_rule and tenant:42cdb729a3834b40aed1f7fd83ab2973 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:04.810006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:04.820742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:04.903490 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b04875af-1600-4d3e-a2a9-b4bf3a58b586 req-0ead4ec6-054e-431f-ac09-c6857772d3e9 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2990253 May 12 15:07:04.936051 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb0b1060-dd02-49eb-bffa-fb1f275eb0a4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:04.939970 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb0b1060-dd02-49eb-bffa-fb1f275eb0a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:05.040897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:05.061027 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:05.062642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb0b1060-dd02-49eb-bffa-fb1f275eb0a4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=556a8e1e-bd8d-4139-b343-17518d995994,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:05.071003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Usage tracker for resource:port and tenant:ff9b9aa97cf84863aedddc5615398c31 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:05.086611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:05.087198 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:05.118787 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-eb0b1060-dd02-49eb-bffa-fb1f275eb0a4 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2244df1f61384f8d964da902649f94f8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5809214 May 12 15:07:05.126817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:05.129431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46702) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:05.137462 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-869d2898-98c2-4146-a70c-616f745d32e1 req-6526e7e1-6423-487b-b10a-60176e49a168 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:05.151191 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-869d2898-98c2-4146-a70c-616f745d32e1 req-6526e7e1-6423-487b-b10a-60176e49a168 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 950 time: 0.3225303 May 12 15:07:05.151500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 576} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:07:05.171949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-ec33d4d8-0a27-4b45-a929-8eb905cebbe0 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:05.174165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-ec33d4d8-0a27-4b45-a929-8eb905cebbe0 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.76 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 946 time: 0.4872227 May 12 15:07:05.192955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=58d4492e-8d39-43dd-960f-b72be1cb1fa6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:05.221078 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:05.221954 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Added segment 46b06527-f385-49ce-9d8e-98fc74ddf9b7 of type vlan for network 40409ee5-b51e-42cb-8335-adb362d0d213 May 12 15:07:05.305142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Made reservation on behalf of ff9b9aa97cf84863aedddc5615398c31 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:07:05.309082 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:05.310231 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:05.383904 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:05.384815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:05.385411 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:05.481972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Deleting port adce94a7-30ae-4036-8a49-87df5c50c324 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:07:05.482399 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:05.687950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] Pushing event updated for resources: {'Network': ['ID=40409ee5-b51e-42cb-8335-adb362d0d213,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:05.696095 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-869d2898-98c2-4146-a70c-616f745d32e1 req-98bf5a01-d29c-49bf-bab4-77f27c0b4f27 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5091560 May 12 15:07:05.698995 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-993742a4-0a4a-4017-aec9-56a980860935 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 1.5021825 May 12 15:07:05.701818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46712) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:05.708217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 40409ee5-b51e-42cb-8335-adb362d0d213 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:07:05.735514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Request body: {'subnet': {'network_id': '40409ee5-b51e-42cb-8335-adb362d0d213', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesAdminNegativeTest-2000261788-subnet', 'tenant_id': '42cdb729a3834b40aed1f7fd83ab2973', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:05.754496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:05.762476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Usage tracker for resource:subnet and tenant:42cdb729a3834b40aed1f7fd83ab2973 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:05.774331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:05.789762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:05.830751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Made reservation on behalf of 42cdb729a3834b40aed1f7fd83ab2973 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:07:05.833273 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Notify callbacks [] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:06.056708 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-adca7247-5b35-48c9-b15f-8a045d1b11d1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:06.160390 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d124e4cc-db22-4817-9431-6dbbe1e72500 req-643b5a4b-85b5-4ab7-a4fb-9507d110e753 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 210 time: 0.0653930 May 12 15:07:06.282614 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:06.289502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d58ca0e7-4201-47bb-949d-b8f6f7676a45 req-24953d39-1bdc-4f1b-bdc0-7e94299bfe22 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:06.301487 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d58ca0e7-4201-47bb-949d-b8f6f7676a45 req-24953d39-1bdc-4f1b-bdc0-7e94299bfe22 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 946 time: 1.1054738 May 12 15:07:06.458271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8a6a4b4b-c9fd-4587-bd5d-0955b805a307,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:06.490762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Checking segment: {'id': '46b06527-f385-49ce-9d8e-98fc74ddf9b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': '40409ee5-b51e-42cb-8335-adb362d0d213'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:07:06.491186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Network hostable DHCP agents. Network: 40409ee5-b51e-42cb-8335-adb362d0d213, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:07:06.536710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Network 40409ee5-b51e-42cb-8335-adb362d0d213 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:07:06.547575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 40409ee5-b51e-42cb-8335-adb362d0d213) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:07:06.552938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:06.553556 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:06.560229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cf7edb6-9da3-415b-a004-397bcdac2c85 None None] Network 40409ee5-b51e-42cb-8335-adb362d0d213 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:07:06.635959 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f0c1e439-e2db-4ac2-9d31-57bb3f4b2a31 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.9328620 May 12 15:07:06.676602 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-adca7247-5b35-48c9-b15f-8a045d1b11d1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:06.730305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d58ca0e7-4201-47bb-949d-b8f6f7676a45 req-66c1db75-db4f-4435-ae28-3ccc44fe174d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4256999 May 12 15:07:06.825945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Allocated IP 172.20.0.14 (4c945198-2daa-4ae0-a8c1-07ee6da52271/3ef83b9d-c5b9-4653-9e37-725af3b0ea4c/4054de48-da89-4af0-98b0-82ec2255914c) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:07:07.140707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7aa74b5-864d-4435-a1cd-eb7cdbdfaef0 None None] Network 40409ee5-b51e-42cb-8335-adb362d0d213 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:07:07.432842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76072d2b-927c-49d4-ae6a-006454c5a474 req-6eb75f61-ae29-49c1-b2db-c118f8f1e1a1 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:07.442516 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-76072d2b-927c-49d4-ae6a-006454c5a474 req-6eb75f61-ae29-49c1-b2db-c118f8f1e1a1 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.4031925 May 12 15:07:07.596743 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-adca7247-5b35-48c9-b15f-8a045d1b11d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:07.611558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4856aefe-44fb-41d5-b47e-82b2c8da539a req-273925c4-3e36-4107-8b64-42cc5f74e898 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:07.621445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4856aefe-44fb-41d5-b47e-82b2c8da539a req-273925c4-3e36-4107-8b64-42cc5f74e898 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 950 time: 0.4318225 May 12 15:07:07.696274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adca7247-5b35-48c9-b15f-8a045d1b11d1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=556a8e1e-bd8d-4139-b343-17518d995994,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:07.716735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-76072d2b-927c-49d4-ae6a-006454c5a474 req-77d36e8b-8724-4c86-9d7c-f5172d7ecdd1 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2725894 May 12 15:07:07.743718 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-adca7247-5b35-48c9-b15f-8a045d1b11d1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:07.746712 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-adca7247-5b35-48c9-b15f-8a045d1b11d1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/556a8e1e-bd8d-4139-b343-17518d995994 HTTP/1.1" status: 204 len: 168 time: 2.5929203 May 12 15:07:07.777491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] For port adce94a7-30ae-4036-8a49-87df5c50c324, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=adce94a7-30ae-4036-8a49-87df5c50c324,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:07.778182 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:07.893228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46746) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:07.900470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Request body: {'network': {'name': 'tempest-VolumesAdminNegativeTest-1947831157-network', 'tenant_id': 'e01604270dab4830aa9827a5adfca2be'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:07.914806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:07.919736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Usage tracker for resource:network and tenant:e01604270dab4830aa9827a5adfca2be is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:07.934359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:07.942673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:07.963960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Made reservation on behalf of e01604270dab4830aa9827a5adfca2be for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:07:07.966663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:07.991409 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:08.022033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:08.033356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Usage tracker for resource:security_group_rule and tenant:e01604270dab4830aa9827a5adfca2be is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:08.040327 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:08.054078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:08.161427 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:08.168891 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:08.242359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 560} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:07:08.270880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=73c11cdf-edb1-4d3f-a963-3e8bc24ec7b4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:08.288569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:08.290225 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Added segment de2fdbf7-026a-4abe-9cb3-b5d747a87840 of type vlan for network 77b97da7-466e-4431-9430-75b9b8ba987c May 12 15:07:08.300314 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4856aefe-44fb-41d5-b47e-82b2c8da539a req-a0e036ae-539b-4695-a83f-ae577157c72f tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6777101 May 12 15:07:08.417904 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:08.505033 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:08.507120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:08.509177 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:08.624525 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:08.772293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] Pushing event updated for resources: {'Network': ['ID=77b97da7-466e-4431-9430-75b9b8ba987c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:08.785289 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-66890ad1-4771-472f-87df-7fee8096c8ab admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.8889828 May 12 15:07:08.787833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46760) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:08.790784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 77b97da7-466e-4431-9430-75b9b8ba987c details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:07:08.802556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Request body: {'subnet': {'network_id': '77b97da7-466e-4431-9430-75b9b8ba987c', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesAdminNegativeTest-1947831157-subnet', 'tenant_id': 'e01604270dab4830aa9827a5adfca2be', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:08.807861 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-64c786c6-0a28-43f0-a870-3adc45544225 req-9007deb2-f64e-446f-9604-44e15e62a8e7 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Synchronizing usage tracker for tenant:ff9b9aa97cf84863aedddc5615398c31 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:07:08.829649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:08.831624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Transition to ACTIVE for port object 4054de48-da89-4af0-98b0-82ec2255914c will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:07:08.850401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Usage tracker for resource:subnet and tenant:e01604270dab4830aa9827a5adfca2be is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:08.865910 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:08.888805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:08.935171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Made reservation on behalf of e01604270dab4830aa9827a5adfca2be for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:07:08.938987 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Notify callbacks [] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:08.941703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f64ecde8-f536-4d58-82c9-9c39268b8580 req-6fc4dcff-b3ce-45a9-988d-04493af103c3 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:08.943267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f64ecde8-f536-4d58-82c9-9c39268b8580 req-6fc4dcff-b3ce-45a9-988d-04493af103c3 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=d92d2403-4d50-4d2e-8f63-1d668eb627d5 HTTP/1.1" status: 200 len: 969 time: 0.9281611 May 12 15:07:08.988100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46764) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:09.010434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-64c786c6-0a28-43f0-a870-3adc45544225 req-9007deb2-f64e-446f-9604-44e15e62a8e7 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Unset dirty status for tenant:ff9b9aa97cf84863aedddc5615398c31 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:07:09.021531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device adce94a7-30ae-4036-8a49-87df5c50c324 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:07:09.029578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64c786c6-0a28-43f0-a870-3adc45544225 req-9007deb2-f64e-446f-9604-44e15e62a8e7 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 210 time: 0.3642235 May 12 15:07:09.115845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dcc7f097-c1d3-45e9-abaa-76c641d7d802 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:09.233431 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:09.241280 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:09.241834 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Floating IP d8eaf86b-fcbd-4ca9-8430-1ddde3b94626 disassociated. External IP: 172.25.8.60, port: adce94a7-30ae-4036-8a49-87df5c50c324. May 12 15:07:09.244278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Calling delete_port for adce94a7-30ae-4036-8a49-87df5c50c324 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:07:09.408581 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:09.485992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-dcc7f097-c1d3-45e9-abaa-76c641d7d802 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:09.533038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-dcc7f097-c1d3-45e9-abaa-76c641d7d802 admin admin] Usage tracker for resource:security_group_rule and tenant:2347fb4cd29543929c745fb2a398fc03 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:09.547355 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f64ecde8-f536-4d58-82c9-9c39268b8580 req-85568d07-45cc-4880-82dd-416c4db27fc6 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5939524 May 12 15:07:09.552859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-dcc7f097-c1d3-45e9-abaa-76c641d7d802 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:09.562512 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:09.572566 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:09.601891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6bc54724-a880-4a34-beee-bc26ec472cdd,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:09.612036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Checking segment: {'id': 'de2fdbf7-026a-4abe-9cb3-b5d747a87840', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 560, 'network_id': '77b97da7-466e-4431-9430-75b9b8ba987c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:07:09.617458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-dcc7f097-c1d3-45e9-abaa-76c641d7d802 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:09.618023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Network hostable DHCP agents. Network: 77b97da7-466e-4431-9430-75b9b8ba987c, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:07:09.674854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port adce94a7-30ae-4036-8a49-87df5c50c324, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=adce94a7-30ae-4036-8a49-87df5c50c324,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:09.675996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Network 77b97da7-466e-4431-9430-75b9b8ba987c is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:07:09.676206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'adce94a7-30ae-4036-8a49-87df5c50c324'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:09.682455 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:09.702512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 77b97da7-466e-4431-9430-75b9b8ba987c) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:07:09.718238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa6ebadf-255b-4c18-8cfb-6c80a2041b03 None None] Network 77b97da7-466e-4431-9430-75b9b8ba987c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:07:09.725412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:09.726170 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:09.805933 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5d8d846b-97f6-472d-8d66-af54bd6932a9 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.0154679 May 12 15:07:09.900953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=adce94a7-30ae-4036-8a49-87df5c50c324,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:09.934810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Pushing event updated for resources: {'Port': ['ID=4054de48-da89-4af0-98b0-82ec2255914c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:10.027135 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:07:10.027880 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:07:10.033278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Network 4c945198-2daa-4ae0-a8c1-07ee6da52271 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:07:10.040789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:07:10.076068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:07:10.092157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:10.095386 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:10.288775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b53a190-49fb-434a-9df3-f909c3658a10 req-67e7947f-8222-4016-ab74-a84c6db4e31d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:10.290302 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d1c7c20-4ca3-439d-934c-682f26e51ccd None None] Network 77b97da7-466e-4431-9430-75b9b8ba987c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:07:10.291730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5b53a190-49fb-434a-9df3-f909c3658a10 req-67e7947f-8222-4016-ab74-a84c6db4e31d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Synchronizing usage tracker for tenant:38c07c88d2f84b29a9ae8c83558ec74b on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:07:10.383776 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-b697036f-6c72-4282-b371-78a8137d8832 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 5.7457914 May 12 15:07:10.431087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Request body: {'port': {'device_id': '5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:10.528730 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dcc7f097-c1d3-45e9-abaa-76c641d7d802 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:10.529946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Deleting port adce94a7-30ae-4036-8a49-87df5c50c324 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:07:10.530552 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:10.593363 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dcc7f097-c1d3-45e9-abaa-76c641d7d802 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:10.642501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5b53a190-49fb-434a-9df3-f909c3658a10 req-67e7947f-8222-4016-ab74-a84c6db4e31d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Unset dirty status for tenant:38c07c88d2f84b29a9ae8c83558ec74b on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:07:10.650541 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b53a190-49fb-434a-9df3-f909c3658a10 req-67e7947f-8222-4016-ab74-a84c6db4e31d tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 946 time: 1.2437487 May 12 15:07:10.709591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cf2ec92c-1460-4292-94ea-c1a22bdb544c None None] Provisioning for port 4054de48-da89-4af0-98b0-82ec2255914c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:07:10.725159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cf2ec92c-1460-4292-94ea-c1a22bdb544c None None] Provisioning complete for port 4054de48-da89-4af0-98b0-82ec2255914c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:10.725814 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cf2ec92c-1460-4292-94ea-c1a22bdb544c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:10.864781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-cf2ec92c-1460-4292-94ea-c1a22bdb544c None None] Port 4054de48-da89-4af0-98b0-82ec2255914c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:07:11.004470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dcc7f097-c1d3-45e9-abaa-76c641d7d802 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2347fb4cd29543929c745fb2a398fc03&name=default HTTP/1.1" status: 200 len: 2979 time: 2.0133026 May 12 15:07:11.005572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcc7f097-c1d3-45e9-abaa-76c641d7d802 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48dc5496-4781-4231-b3b4-29c598680b60,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:11.009368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46788) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:11.078480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b53a190-49fb-434a-9df3-f909c3658a10 req-26d9e521-746c-4264-84b4-1b914ec8ae37 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups?id=bea28a12-4648-49eb-967a-a6cae208864d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4269691 May 12 15:07:11.207390 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9e8af33b-76e3-4e2a-8dbb-efe49674005b'] response: {'server_uuid': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'adce94a7-30ae-4036-8a49-87df5c50c324', 'code': 200} May 12 15:07:11.234027 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:11.281763 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:11.347009 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:11.390214 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:11.427093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48dc5496-4781-4231-b3b4-29c598680b60,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:11.459052 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:11.460175 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/48dc5496-4781-4231-b3b4-29c598680b60 HTTP/1.1" status: 204 len: 168 time: 0.4480724 May 12 15:07:11.462064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:11.469992 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:11.475844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:11.477610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:11.479794 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:11.480189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:11.480532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:11.480863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:11.482616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:11.483127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:11.486566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:11.487797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c272231-470a-49ed-ac20-81a4a7b445c1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:11.694484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] For port adce94a7-30ae-4036-8a49-87df5c50c324, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=adce94a7-30ae-4036-8a49-87df5c50c324,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:11.694925 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:12.035089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e0bf50-34bb-4948-a81e-26ad0c2be297 req-9da903ed-c1d3-4388-8a10-0578da2b8c7a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:12.044228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86e0bf50-34bb-4948-a81e-26ad0c2be297 req-9da903ed-c1d3-4388-8a10-0578da2b8c7a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 1.0031900 May 12 15:07:12.262112 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86e0bf50-34bb-4948-a81e-26ad0c2be297 req-cc51f805-8683-4472-a751-b9cae441d344 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2167146 May 12 15:07:12.310373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bd2e780-d4d5-42be-acdc-cb2a1328dc14 req-ac6b7fe7-fc02-45e2-aa9f-c16529467940 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:12.328354 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9bd2e780-d4d5-42be-acdc-cb2a1328dc14 req-ac6b7fe7-fc02-45e2-aa9f-c16529467940 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 932 time: 0.8382041 May 12 15:07:12.631627 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9bd2e780-d4d5-42be-acdc-cb2a1328dc14 req-6432f1b6-613c-412f-8211-735d305577e2 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/security-groups?id=9c9166c2-fc2a-43df-8947-3b0f8ca10a32&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3022857 May 12 15:07:12.672344 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:12.690824 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:12.691250 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:12.691604 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Floating IP d8eaf86b-fcbd-4ca9-8430-1ddde3b94626 disassociated. External IP: 172.25.8.60, port: adce94a7-30ae-4036-8a49-87df5c50c324. May 12 15:07:12.692120 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Calling delete_port for adce94a7-30ae-4036-8a49-87df5c50c324 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:07:12.699568 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4637ff51-ae48-4434-8c10-a5e9bcd0a49d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:12.856347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46828) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:12.904364 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:07:13.008863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Request body: {'network': {'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-network', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:13.014044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:13.020604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Usage tracker for resource:network and tenant:bad2264067c248e9803d4b1eeb73116d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:13.037060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:13.054936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:13.073072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Made reservation on behalf of bad2264067c248e9803d4b1eeb73116d for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:07:13.075065 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:13.089286 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:13.114438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:13.118426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Usage tracker for resource:security_group_rule and tenant:bad2264067c248e9803d4b1eeb73116d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:13.121748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:13.127324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4054de48-da89-4af0-98b0-82ec2255914c {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:07:13.130092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:13.213974 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:13.243768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aed630c-800f-499e-a59b-9857533b5955 req-0ea5d6da-7461-4aa9-b482-9e748ba5b576 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:13.256209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aed630c-800f-499e-a59b-9857533b5955 req-0ea5d6da-7461-4aa9-b482-9e748ba5b576 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/networks?id=40409ee5-b51e-42cb-8335-adb362d0d213 HTTP/1.1" status: 200 len: 815 time: 0.6028113 May 12 15:07:13.301914 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aed630c-800f-499e-a59b-9857533b5955 req-4ddcb2c6-63a1-4f96-95a9-32bbd6df34a5 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/quotas/42cdb729a3834b40aed1f7fd83ab2973 HTTP/1.1" status: 200 len: 375 time: 0.0444322 May 12 15:07:13.326966 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:13.333454 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:13.355052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9506b3fb-f32c-4e3d-9880-acc2d7440012 req-d4323f68-aa89-4430-974b-60c7a5dd5067 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:13.356559 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9506b3fb-f32c-4e3d-9880-acc2d7440012 req-d4323f68-aa89-4430-974b-60c7a5dd5067 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=d92d2403-4d50-4d2e-8f63-1d668eb627d5 HTTP/1.1" status: 200 len: 969 time: 0.4977114 May 12 15:07:13.357764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Transition to ACTIVE for port object 4054de48-da89-4af0-98b0-82ec2255914c will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:07:13.368321 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:13.395436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 565} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:07:13.408434 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:13.409735 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Added segment 6877a48e-4842-481b-9f78-5fb45e4e8519 of type vlan for network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 May 12 15:07:13.411176 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aed630c-800f-499e-a59b-9857533b5955 req-5612b210-b78d-4df8-a0a5-679ce6fc477e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=42cdb729a3834b40aed1f7fd83ab2973&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1082633 May 12 15:07:13.456410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:13.472173 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:13.512134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0da5cbef-d2fd-454a-8ac9-aab67e936a65,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:13.545487 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:13.547139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:13.547967 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:13.688037 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9506b3fb-f32c-4e3d-9880-acc2d7440012 req-eec29670-ca5e-452c-8d79-018dc64f256b tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3199246 May 12 15:07:13.688816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Pushing event deleted for resources: {'Port': ['ID=adce94a7-30ae-4036-8a49-87df5c50c324,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:13.855976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] Pushing event updated for resources: {'Network': ['ID=5af19f47-caf0-45a8-9b3d-186b8fd71ec1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:13.868182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:07:13.880307 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b3fd449e-399d-44a3-bfcc-c6f847616dda admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 894 time: 1.0227749 May 12 15:07:13.881040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46840) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:13.887277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Request body: {'subnet': {'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-subnet', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:13.907642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:13.920817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Usage tracker for resource:subnet and tenant:bad2264067c248e9803d4b1eeb73116d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:13.924203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:13.942951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:13.960827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Made reservation on behalf of bad2264067c248e9803d4b1eeb73116d for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:07:13.964207 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Notify callbacks [] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:14.220999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Pushing event updated for resources: {'Port': ['ID=4054de48-da89-4af0-98b0-82ec2255914c,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:14.492451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Attempting to bind port 4054de48-da89-4af0-98b0-82ec2255914c on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:07:14.492897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Attempting to bind port 4054de48-da89-4af0-98b0-82ec2255914c by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '49f41745-6217-458f-8fa0-7833e5e7c9df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:07:14.493175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Attempting to bind port 4054de48-da89-4af0-98b0-82ec2255914c on network 4c945198-2daa-4ae0-a8c1-07ee6da52271 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:14.500429 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:14.513368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Port 4054de48-da89-4af0-98b0-82ec2255914c on network 4c945198-2daa-4ae0-a8c1-07ee6da52271 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:07:14.513868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Attempting to bind port 4054de48-da89-4af0-98b0-82ec2255914c on network 4c945198-2daa-4ae0-a8c1-07ee6da52271 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:14.528257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aed630c-800f-499e-a59b-9857533b5955 req-44544437-17e7-4769-83b7-0146b26790ea service neutron] 10.222.0.82 "GET /v2.0/networks/40409ee5-b51e-42cb-8335-adb362d0d213?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.1159897 May 12 15:07:14.588183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 7, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:07:14.588542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Checking segment: {'id': '49f41745-6217-458f-8fa0-7833e5e7c9df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:07:14.589045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Bound using segment: {'id': '49f41745-6217-458f-8fa0-7833e5e7c9df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:07:14.589710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Bound port: 4054de48-da89-4af0-98b0-82ec2255914c, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '49f41745-6217-458f-8fa0-7833e5e7c9df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:07:14.590144 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:14.606576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b0cba805-7761-41c5-9666-3b2ff25491af,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:14.618225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Checking segment: {'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:07:14.618908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Network hostable DHCP agents. Network: 5af19f47-caf0-45a8-9b3d-186b8fd71ec1, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:07:14.647887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:07:14.667872 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 5af19f47-caf0-45a8-9b3d-186b8fd71ec1) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:07:14.680440 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:14.680802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a5031d8-590a-43ee-9ef4-88d642e92588 None None] Network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:07:14.681102 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:14.729824 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-493e2a7f-026f-40b4-8c8f-f1147e6ddc98 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 857 time: 0.8470790 May 12 15:07:14.733647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46850) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:14.751210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Request body: {'router': {'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:14.757147 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:14.767303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Usage tracker for resource:router and tenant:bad2264067c248e9803d4b1eeb73116d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:14.772222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:14.792458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:14.815706 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:14.816921 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:14.835759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Router 272668a4-245d-4021-b26c-456bc892016b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:07:14.851043 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:14.935146 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c8ea9ecb-8174-42ec-b39d-4357a5f94da2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:15.007544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-570be89e-1a1f-4d3d-b236-7cb987cc5f51 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:15.007916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-570be89e-1a1f-4d3d-b236-7cb987cc5f51 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:15.008471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-570be89e-1a1f-4d3d-b236-7cb987cc5f51 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:15.008830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-570be89e-1a1f-4d3d-b236-7cb987cc5f51 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:15.009427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-570be89e-1a1f-4d3d-b236-7cb987cc5f51 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:15.009763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-570be89e-1a1f-4d3d-b236-7cb987cc5f51 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:15.010222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-570be89e-1a1f-4d3d-b236-7cb987cc5f51 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:15.010672 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-570be89e-1a1f-4d3d-b236-7cb987cc5f51 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:15.011119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-570be89e-1a1f-4d3d-b236-7cb987cc5f51 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:15.013246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-570be89e-1a1f-4d3d-b236-7cb987cc5f51 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d&device_id=5102166c-3857-4902-810f-a049926fe5f6&device_id=c16773f3-58ee-4af2-a29d-d343b8561a31&device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647&device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e&device_id=8d278524-0445-4a95-8564-3c04c2f3c41d&device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc&device_id=e55f7075-e930-469e-9063-1ed463d5a1b9&device_id=d92d2403-4d50-4d2e-8f63-1d668eb627d5&device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 8186 time: 0.6263134 May 12 15:07:15.031121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aed630c-800f-499e-a59b-9857533b5955 req-0bb57a16-4ea1-46e1-adba-b055285e8e63 service neutron] 10.222.0.82 "GET /v2.0/networks/40409ee5-b51e-42cb-8335-adb362d0d213?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5012836 May 12 15:07:15.056500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] For port 4054de48-da89-4af0-98b0-82ec2255914c, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:07:15.069619 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-75e163bb-342c-4832-ba09-f01492419856 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:15.088496 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:07:15.089674 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:15.136412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] For port 4054de48-da89-4af0-98b0-82ec2255914c, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4054de48-da89-4af0-98b0-82ec2255914c,segment=NetworkSegment(49f41745-6217-458f-8fa0-7833e5e7c9df),segment_id=49f41745-6217-458f-8fa0-7833e5e7c9df)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:07:15.159841 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:15.167000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-75e163bb-342c-4832-ba09-f01492419856 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:15.180335 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:15.223078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-75e163bb-342c-4832-ba09-f01492419856 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Usage tracker for resource:security_group_rule and tenant:b485d58c18db49379317964f5d6423e4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:15.235873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-75e163bb-342c-4832-ba09-f01492419856 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:15.329218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-75e163bb-342c-4832-ba09-f01492419856 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:15.340846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:15.356000 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:15.357553 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] 10.222.0.76 "PUT /v2.0/ports/4054de48-da89-4af0-98b0-82ec2255914c HTTP/1.1" status: 200 len: 1092 time: 4.9488699 May 12 15:07:15.360065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d', 'tag': '4054de48-da89-4af0-98b0-82ec2255914c'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:15.361113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Allocated IP 172.20.0.2 (5af19f47-caf0-45a8-9b3d-186b8fd71ec1/b0cba805-7761-41c5-9666-3b2ff25491af/251385fc-b728-4589-9b38-78a36f45231c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:07:15.390980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:07:15.404995 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a45b2b4-e60d-40f4-a5b0-ed89f04e25cf None None] Sync routers for ids ['272668a4-245d-4021-b26c-456bc892016b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:07:15.428071 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a45b2b4-e60d-40f4-a5b0-ed89f04e25cf None None] Routers {'272668a4-245d-4021-b26c-456bc892016b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:07:15.431723 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6a45b2b4-e60d-40f4-a5b0-ed89f04e25cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['272668a4-245d-4021-b26c-456bc892016b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:15.462758 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Pushing event updated for resources: {'Port': ['ID=4054de48-da89-4af0-98b0-82ec2255914c,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:15.756579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:15.756909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:15.757246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:15.758611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:15.758921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:15.759256 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:15.759642 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:15.759966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:15.760289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:15.760649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:15.761048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:15.761287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6974a2-f317-4804-b676-8bcfc9d4ff7a service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:15.788785 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6a45b2b4-e60d-40f4-a5b0-ed89f04e25cf None None] Set router 272668a4-245d-4021-b26c-456bc892016b gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:07:15.796113 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:15.809008 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:15.817163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] No DVR routers for this DVR port adce94a7-30ae-4036-8a49-87df5c50c324 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:07:15.834094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Transition to ACTIVE for port object 251385fc-b728-4589-9b38-78a36f45231c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:07:15.834432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64d0781d-527a-4fd9-a9bb-e9ff3c3e1489 req-4893cd33-e749-42b7-ab94-97a90195eb36 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc HTTP/1.1" status: 200 len: 210 time: 0.3683460 May 12 15:07:15.836666 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:15.839593 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:15.877134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Transition to ACTIVE for port object 251385fc-b728-4589-9b38-78a36f45231c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:07:15.898576 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:15.924493 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9abddea-fd03-4c34-b173-65cac3d19be2 req-f2b9527d-4844-4ed6-bb19-7d91adbee2ce tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.76 "DELETE /v2.0/ports/adce94a7-30ae-4036-8a49-87df5c50c324 HTTP/1.1" status: 204 len: 173 time: 10.5881412 May 12 15:07:16.072456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-c586ed29-3b52-4444-9da3-d4c2e29c7b5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:16.073442 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:07:16.075210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-c586ed29-3b52-4444-9da3-d4c2e29c7b5f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ff9b9aa97cf84863aedddc5615398c31&device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 1095 time: 0.6240532 May 12 15:07:16.075718 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:16.079959 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:07:16.085344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:07:16.087714 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:16.097707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Pushing event updated for resources: {'Port': ['ID=251385fc-b728-4589-9b38-78a36f45231c,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:16.110102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Allocated IP 172.25.8.122 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/fac6a011-85dc-423e-a855-446515118749) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:07:16.258407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Attempting to bind port 251385fc-b728-4589-9b38-78a36f45231c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:07:16.258774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Attempting to bind port 251385fc-b728-4589-9b38-78a36f45231c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:07:16.259127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Attempting to bind port 251385fc-b728-4589-9b38-78a36f45231c on network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:16.278593 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 7, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:07:16.279057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Checking segment: {'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:07:16.279398 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:16.279816 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Bound using segment: {'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:07:16.280314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Bound port: 251385fc-b728-4589-9b38-78a36f45231c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:07:16.280704 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:16.358095 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:16.399606 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:16.400763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-873efb96-f659-4a00-be56-2cf4951df1f1 req-d473fc37-2c11-43ff-ba66-badde20c89ea tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:16.402899 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-873efb96-f659-4a00-be56-2cf4951df1f1 req-d473fc37-2c11-43ff-ba66-badde20c89ea tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.76 "GET /v2.0/ports?device_id=d92d2403-4d50-4d2e-8f63-1d668eb627d5 HTTP/1.1" status: 200 len: 969 time: 0.8623917 May 12 15:07:16.418488 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] For port 251385fc-b728-4589-9b38-78a36f45231c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:07:16.419876 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6a45b2b4-e60d-40f4-a5b0-ed89f04e25cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:25Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:16.422580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] For port 251385fc-b728-4589-9b38-78a36f45231c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=251385fc-b728-4589-9b38-78a36f45231c,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:07:16.425715 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a45b2b4-e60d-40f4-a5b0-ed89f04e25cf None None] Checking router: 272668a4-245d-4021-b26c-456bc892016b for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:07:16.429111 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:16.436359 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a45b2b4-e60d-40f4-a5b0-ed89f04e25cf None None] Routers {'272668a4-245d-4021-b26c-456bc892016b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:07:16.436985 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6a45b2b4-e60d-40f4-a5b0-ed89f04e25cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['272668a4-245d-4021-b26c-456bc892016b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:16.486700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Pushing event updated for resources: {'Port': ['ID=fac6a011-85dc-423e-a855-446515118749,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:16.500087 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-e0a2998f-8db0-4b6b-a60f-1fcc16696c4a service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=4054de48-da89-4af0-98b0-82ec2255914c HTTP/1.1" status: 200 len: 217 time: 0.4058926 May 12 15:07:16.504101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:07:16.505330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:07:16.512560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:07:16.544470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Pushing event updated for resources: {'Port': ['ID=251385fc-b728-4589-9b38-78a36f45231c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:16.553678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:16.554309 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:16.554826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:16.555330 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:16.555842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:16.559482 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:16.560051 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:16.560692 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:16.561203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:16.561731 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:16.562256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:16.562774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a67baf7c-07dd-4b20-8df9-36259a2a9f6d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:16.692334 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-75e163bb-342c-4832-ba09-f01492419856 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:16.712416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-873efb96-f659-4a00-be56-2cf4951df1f1 req-4d2a0614-33e5-4482-a8c2-cc264592bc3d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Deleting port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:07:16.712769 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-873efb96-f659-4a00-be56-2cf4951df1f1 req-4d2a0614-33e5-4482-a8c2-cc264592bc3d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:16.767848 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-75e163bb-342c-4832-ba09-f01492419856 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:16.778782 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6a45b2b4-e60d-40f4-a5b0-ed89f04e25cf None None] Set router 272668a4-245d-4021-b26c-456bc892016b gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:07:16.858126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-979905e6-afad-4732-af60-dc1c953f6947 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:16.860485 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-979905e6-afad-4732-af60-dc1c953f6947 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=3ef83b9d-c5b9-4653-9e37-725af3b0ea4c HTTP/1.1" status: 200 len: 853 time: 0.3449781 May 12 15:07:16.922059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-75e163bb-342c-4832-ba09-f01492419856 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Synchronizing usage tracker for tenant:b485d58c18db49379317964f5d6423e4 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:07:17.119190 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75e163bb-342c-4832-ba09-f01492419856 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3cf4c17e-58fe-4b5e-ad65-506924bd4ea1,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:17.142051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f1b287d-4e0e-49b3-b445-fd99631a0647 req-d7f63c9c-966a-4c5b-adec-e3fb1fbadc71 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:17.145228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f1b287d-4e0e-49b3-b445-fd99631a0647 req-d7f63c9c-966a-4c5b-adec-e3fb1fbadc71 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.7321291 May 12 15:07:17.318342 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:17.344378 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6a45b2b4-e60d-40f4-a5b0-ed89f04e25cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:25Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:17.350959 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a45b2b4-e60d-40f4-a5b0-ed89f04e25cf None None] The sync data for ids ['272668a4-245d-4021-b26c-456bc892016b'] in n-d-841483-1 is: [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:04:11Z', 'revision_number': 4, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'e6cd121a-66ed-439d-82b8-4e9ff7955245', 'name': '', 'network_id': 'feb95830-c0c2-46c0-bb35-f2f43605e79a', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'mac_address': 'fa:16:3e:8c:9c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:10Z', 'updated_at': '2022-05-12T15:04:25Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'subnets': [{'id': 'c0ac6201-c8b1-43a9-a509-5a4ff4e34282', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:07:17.463443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-75e163bb-342c-4832-ba09-f01492419856 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Unset dirty status for tenant:b485d58c18db49379317964f5d6423e4 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:07:17.465872 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ebeaae65-e440-47eb-aa3b-483d2f09ad39 req-75e163bb-342c-4832-ba09-f01492419856 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&id=226901b6-dd8d-4451-b59a-4e1a727e153f&id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&id=9c9166c2-fc2a-43df-8947-3b0f8ca10a32&id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 581 time: 2.4289498 May 12 15:07:17.523295 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:17.692994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b464c4b-76d3-4d82-8813-c3fed3c2c3d0 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:17.694591 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b464c4b-76d3-4d82-8813-c3fed3c2c3d0 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.76 "GET /v2.0/networks?id=40409ee5-b51e-42cb-8335-adb362d0d213 HTTP/1.1" status: 200 len: 815 time: 0.5680470 May 12 15:07:17.712109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:17.714963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f1b287d-4e0e-49b3-b445-fd99631a0647 req-72347b76-c27e-4464-b11c-c10a12f4eb05 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3743656 May 12 15:07:17.744908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Request body: {'port': {'device_id': '8d133fcd-1e60-426e-bc49-2d93dc68083f', 'network_id': '40409ee5-b51e-42cb-8335-adb362d0d213', 'admin_state_up': True, 'tenant_id': '42cdb729a3834b40aed1f7fd83ab2973'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:17.833715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-1741a7c3-f6c1-4237-8fd4-1bbbe64c7257 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:17.835185 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-1741a7c3-f6c1-4237-8fd4-1bbbe64c7257 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=4c945198-2daa-4ae0-a8c1-07ee6da52271&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.9232526 May 12 15:07:17.913847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-873efb96-f659-4a00-be56-2cf4951df1f1 req-4d2a0614-33e5-4482-a8c2-cc264592bc3d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] For port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:17.914213 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-873efb96-f659-4a00-be56-2cf4951df1f1 req-4d2a0614-33e5-4482-a8c2-cc264592bc3d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:17.982011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Router 940e3b0e-8287-409c-890e-28addf1cf0b8 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:07:18.004086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5db7a563-348d-42a8-8b70-24664f276512 None None] New status for floating IP d8eaf86b-fcbd-4ca9-8430-1ddde3b94626: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:07:18.070264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-589c63d4-a9a3-4703-b5c3-0e04457f3e1f None None] Network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:07:18.187309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:07:18.214247 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Sync routers for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:07:18.223127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-873efb96-f659-4a00-be56-2cf4951df1f1 req-4d2a0614-33e5-4482-a8c2-cc264592bc3d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Calling delete_port for 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 owned by compute:tempest-test_az-52089536 {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:07:18.229188 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:18.231900 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-80840551-97ec-4cc1-8461-d6b9dfc4c01a admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 933 time: 3.4972911 May 12 15:07:18.238363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46876) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:18.239042 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:07:18.242590 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:18.328941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e20cd2cd-b03e-410b-a51f-d659f0823de2 req-3d1acc46-928a-474a-b2e4-c208fbdb606c tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:18.337970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e20cd2cd-b03e-410b-a51f-d659f0823de2 req-3d1acc46-928a-474a-b2e4-c208fbdb606c tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 944 time: 0.7538908 May 12 15:07:18.341643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-359ecbf8-e751-4687-80d7-6ffffe878898 None None] Provisioning for port 251385fc-b728-4589-9b38-78a36f45231c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:07:18.413079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 251385fc-b728-4589-9b38-78a36f45231c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:07:18.620514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 251385fc-b728-4589-9b38-78a36f45231c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:07:18.633224 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 251385fc-b728-4589-9b38-78a36f45231c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:18.635345 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:18.664424 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:07:18.679530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:18.708458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Usage tracker for resource:port and tenant:42cdb729a3834b40aed1f7fd83ab2973 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:18.725849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:18.746642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e20cd2cd-b03e-410b-a51f-d659f0823de2 req-eed5018a-48f5-4e52-8b00-7898a0cef42d tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/security-groups?id=9c9166c2-fc2a-43df-8947-3b0f8ca10a32&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4076815 May 12 15:07:18.750113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:18.795634 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-35361631-3496-42c8-9bb9-5b932415d53d service neutron] 10.222.0.76 "GET /v2.0/networks/4c945198-2daa-4ae0-a8c1-07ee6da52271?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9201407 May 12 15:07:18.845011 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:18.926353 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 251385fc-b728-4589-9b38-78a36f45231c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=251385fc-b728-4589-9b38-78a36f45231c,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:18.934385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e772ab-31bb-40f1-acd8-e9c48c993a5b req-9c5ef9be-8655-4c2a-9991-4c404d66151d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:18.934708 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:18.942549 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39e772ab-31bb-40f1-acd8-e9c48c993a5b req-9c5ef9be-8655-4c2a-9991-4c404d66151d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/ports?device_id=d92d2403-4d50-4d2e-8f63-1d668eb627d5 HTTP/1.1" status: 200 len: 969 time: 0.9970958 May 12 15:07:19.015420 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:07:19.095369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Made reservation on behalf of 42cdb729a3834b40aed1f7fd83ab2973 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:07:19.099455 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:19.142799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c92c97f6-c6aa-4c70-ac31-6770f9491903 None None] Provisioning complete for port 251385fc-b728-4589-9b38-78a36f45231c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:19.143071 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c92c97f6-c6aa-4c70-ac31-6770f9491903 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:19.204167 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:17Z', 'revision_number': 3, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:19.216309 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Checking router: 940e3b0e-8287-409c-890e-28addf1cf0b8 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:07:19.218959 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Updating router 940e3b0e-8287-409c-890e-28addf1cf0b8 port fac6a011-85dc-423e-a855-446515118749 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:07:19.282305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 update to DOWN by agent not found {{(pid=88153) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2140}} May 12 15:07:19.317585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=251385fc-b728-4589-9b38-78a36f45231c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:19.353242 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:19.365530 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ac26273-1c3d-4a61-bfd1-e3c1a1523423 req-c8846757-963e-48e2-86af-af7516595808 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d133fcd-1e60-426e-bc49-2d93dc68083f HTTP/1.1" status: 200 len: 210 time: 0.3884194 May 12 15:07:19.376508 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-873efb96-f659-4a00-be56-2cf4951df1f1 req-4d2a0614-33e5-4482-a8c2-cc264592bc3d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:19.403288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39e772ab-31bb-40f1-acd8-e9c48c993a5b req-b84a5cee-9ad9-47f4-9fe9-a8a994563529 tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.82 "GET /v2.0/security-groups?id=98c78171-ded7-4a0c-a647-1cd4c9ff1df4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4597828 May 12 15:07:19.499110 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b5cef74f-5097-425e-984a-a3db70f99f02'] response: {'name': 'network-changed', 'server_uuid': '5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d', 'tag': '4054de48-da89-4af0-98b0-82ec2255914c', 'status': 'completed', 'code': 200} May 12 15:07:19.560292 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-564000cf-704c-4f39-b7cc-c6df49fb202c req-c60871bf-9adf-49ab-bfe0-c2010a22d298 service neutron] 10.222.0.76 "GET /v2.0/networks/4c945198-2daa-4ae0-a8c1-07ee6da52271?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7467377 May 12 15:07:19.718451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d2a0614-33e5-4482-a8c2-cc264592bc3d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Pushing event deleted for resources: {'Port': ['ID=1eade7b6-fd9d-4292-b6d7-67f0ba8285d1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:19.737836 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:19.874663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-873efb96-f659-4a00-be56-2cf4951df1f1 req-4d2a0614-33e5-4482-a8c2-cc264592bc3d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] No DVR routers for this DVR port 1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:07:19.883358 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-873efb96-f659-4a00-be56-2cf4951df1f1 req-4d2a0614-33e5-4482-a8c2-cc264592bc3d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:19.886363 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:19.899161 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Transition to ACTIVE for port object fac6a011-85dc-423e-a855-446515118749 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:07:19.908221 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:19.973078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Allocated IP 172.20.0.1 (5af19f47-caf0-45a8-9b3d-186b8fd71ec1/b0cba805-7761-41c5-9666-3b2ff25491af/207b2c9c-f7e0-4d1b-96ea-20213deda9a0) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:07:19.981923 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535f07a0-686f-466b-a7b8-9191dd25bfa4 None None] Pushing event updated for resources: {'Port': ['ID=fac6a011-85dc-423e-a855-446515118749,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:19.991965 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535f07a0-686f-466b-a7b8-9191dd25bfa4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:19.992460 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535f07a0-686f-466b-a7b8-9191dd25bfa4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:19.992647 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535f07a0-686f-466b-a7b8-9191dd25bfa4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:19.993017 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535f07a0-686f-466b-a7b8-9191dd25bfa4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:19.993334 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535f07a0-686f-466b-a7b8-9191dd25bfa4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:19.993677 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535f07a0-686f-466b-a7b8-9191dd25bfa4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:19.993987 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535f07a0-686f-466b-a7b8-9191dd25bfa4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:19.994296 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535f07a0-686f-466b-a7b8-9191dd25bfa4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:19.994605 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535f07a0-686f-466b-a7b8-9191dd25bfa4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:19.994910 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535f07a0-686f-466b-a7b8-9191dd25bfa4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:19.995213 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535f07a0-686f-466b-a7b8-9191dd25bfa4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:19.995516 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535f07a0-686f-466b-a7b8-9191dd25bfa4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:07:20.015409 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Attempting to bind port fac6a011-85dc-423e-a855-446515118749 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:07:20.015766 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Attempting to bind port fac6a011-85dc-423e-a855-446515118749 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:07:20.016116 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Attempting to bind port fac6a011-85dc-423e-a855-446515118749 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:20.019729 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-873efb96-f659-4a00-be56-2cf4951df1f1 req-4d2a0614-33e5-4482-a8c2-cc264592bc3d tempest-ListImageFiltersTestJSON-1165553636 tempest-ListImageFiltersTestJSON-1165553636-project] 10.222.0.76 "DELETE /v2.0/ports/1eade7b6-fd9d-4292-b6d7-67f0ba8285d1 HTTP/1.1" status: 204 len: 173 time: 3.6051667 May 12 15:07:20.030310 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 7, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:07:20.030672 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:07:20.031382 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:20.032020 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:07:20.032671 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Bound port: fac6a011-85dc-423e-a855-446515118749, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:07:20.033052 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:20.088644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd4fb464-4fee-4b4a-b256-e536939edc91 req-523f4541-6664-4cae-81ef-f582ad160a58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:20.089970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd4fb464-4fee-4b4a-b256-e536939edc91 req-523f4541-6664-4cae-81ef-f582ad160a58 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ff9b9aa97cf84863aedddc5615398c31&device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 1095 time: 0.4205544 May 12 15:07:20.106796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020b9105-236a-4137-85e7-b0db52e8ffbd req-561e8f12-bcc4-4cda-a93a-70cbf7287b73 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:20.108322 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-020b9105-236a-4137-85e7-b0db52e8ffbd req-561e8f12-bcc4-4cda-a93a-70cbf7287b73 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.3827267 May 12 15:07:20.115052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4295e19-eac7-47e1-8fb5-55ec00740418 req-c43914c1-e408-4c26-95dc-c05c23b5516e tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:20.121966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4295e19-eac7-47e1-8fb5-55ec00740418 req-c43914c1-e408-4c26-95dc-c05c23b5516e tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 1097 time: 0.3950663 May 12 15:07:20.141936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Allocated IP 172.20.0.12 (40409ee5-b51e-42cb-8335-adb362d0d213/8a6a4b4b-c9fd-4587-bd5d-0955b805a307/6e590a85-aae0-4e2d-8659-02eb548f69e5) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:07:20.162955 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:20.189507 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] For port fac6a011-85dc-423e-a855-446515118749, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:07:20.191311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Transition to ACTIVE for port object 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:07:20.198838 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] For port fac6a011-85dc-423e-a855-446515118749, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fac6a011-85dc-423e-a855-446515118749,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:07:20.205002 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:20.232462 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:20.313260 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:07:20.314755 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:20.331091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4295e19-eac7-47e1-8fb5-55ec00740418 req-90744086-5fff-4847-a8f8-c6bf497f353f tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2062643 May 12 15:07:20.344556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Pushing event updated for resources: {'Port': ['ID=207b2c9c-f7e0-4d1b-96ea-20213deda9a0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:20.359700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:07:20.361031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:07:20.364590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:07:20.365426 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:20.425708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 251385fc-b728-4589-9b38-78a36f45231c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:07:20.449983 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-020b9105-236a-4137-85e7-b0db52e8ffbd req-b16a6646-60c0-46b6-93ef-e036d6fcc417 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3260169 May 12 15:07:20.469726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd4fb464-4fee-4b4a-b256-e536939edc91 req-94ce86ea-8783-4aac-8519-a786dd605d7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:20.472641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd4fb464-4fee-4b4a-b256-e536939edc91 req-94ce86ea-8783-4aac-8519-a786dd605d7c service neutron] 10.222.0.76 "GET /v2.0/networks?id=4c945198-2daa-4ae0-a8c1-07ee6da52271 HTTP/1.1" status: 200 len: 915 time: 0.3623216 May 12 15:07:20.667448 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:20.668117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 251385fc-b728-4589-9b38-78a36f45231c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:20.668117 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:20.812213 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd4fb464-4fee-4b4a-b256-e536939edc91 req-bd029ad0-84c5-457a-8830-f3f3cf87bbd9 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=4054de48-da89-4af0-98b0-82ec2255914c HTTP/1.1" status: 200 len: 217 time: 0.3312409 May 12 15:07:20.833100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-89ec86e7-aa5e-4d4f-92cd-8f552c77da9a None None] Provisioning for port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:07:20.839494 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:07:20.913204 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-89ec86e7-aa5e-4d4f-92cd-8f552c77da9a None None] Provisioning complete for port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:20.921541 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-89ec86e7-aa5e-4d4f-92cd-8f552c77da9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:21.120148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4054de48-da89-4af0-98b0-82ec2255914c details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:07:21.139886 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535f07a0-686f-466b-a7b8-9191dd25bfa4 None None] Pushing event updated for resources: {'Port': ['ID=fac6a011-85dc-423e-a855-446515118749,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:21.260122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-89ec86e7-aa5e-4d4f-92cd-8f552c77da9a None None] Port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:07:21.264717 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:21.271713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:21.273602 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:21.327515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd4fb464-4fee-4b4a-b256-e536939edc91 req-46ef7824-cb3c-47dc-b3e1-917c20d0a312 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:21.329081 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd4fb464-4fee-4b4a-b256-e536939edc91 req-46ef7824-cb3c-47dc-b3e1-917c20d0a312 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=3ef83b9d-c5b9-4653-9e37-725af3b0ea4c HTTP/1.1" status: 200 len: 853 time: 0.4973059 May 12 15:07:21.414143 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 4054de48-da89-4af0-98b0-82ec2255914c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4054de48-da89-4af0-98b0-82ec2255914c,segment=NetworkSegment(49f41745-6217-458f-8fa0-7833e5e7c9df),segment_id=49f41745-6217-458f-8fa0-7833e5e7c9df)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:21.434939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '4054de48-da89-4af0-98b0-82ec2255914c', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'port_id': '4054de48-da89-4af0-98b0-82ec2255914c', 'mac_address': 'fa:16:3e:72:83:c4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 559, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:07:21.448127 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:17Z', 'revision_number': 3, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:21.452707 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cf83f9c-4b2b-4caf-a116-0bdbc7c8d0ce None None] The sync data for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 is: [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:17Z', 'revision_number': 3, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:07:21.461569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Pushing event updated for resources: {'Port': ['ID=207b2c9c-f7e0-4d1b-96ea-20213deda9a0,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:21.483519 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:21.500574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41929db2-e63d-475f-957b-33ec12fafb8a req-8dcfce57-0e57-462d-b324-447aabfc90eb tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:21.501645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41929db2-e63d-475f-957b-33ec12fafb8a req-8dcfce57-0e57-462d-b324-447aabfc90eb tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:21.502314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41929db2-e63d-475f-957b-33ec12fafb8a req-8dcfce57-0e57-462d-b324-447aabfc90eb tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:21.504565 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41929db2-e63d-475f-957b-33ec12fafb8a req-8dcfce57-0e57-462d-b324-447aabfc90eb tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6&device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e&device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 2884 time: 0.2490864 May 12 15:07:21.507554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'name': 'network-vif-deleted', 'tag': 'adce94a7-30ae-4036-8a49-87df5c50c324'}, {'server_uuid': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'name': 'network-vif-deleted', 'tag': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:21.517651 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:21.529519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:07:21.531404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:07:21.537807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4054de48-da89-4af0-98b0-82ec2255914c {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:07:21.576508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 4054de48-da89-4af0-98b0-82ec2255914c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4054de48-da89-4af0-98b0-82ec2255914c,segment=NetworkSegment(49f41745-6217-458f-8fa0-7833e5e7c9df),segment_id=49f41745-6217-458f-8fa0-7833e5e7c9df)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:21.584974 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:21.684724 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7934a68c-6f80-4e59-8f84-bfcfedfd1c7e req-ad611bd1-cf5c-47e7-b9e6-7d01709e055c tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:21.689132 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=4054de48-da89-4af0-98b0-82ec2255914c,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:21.692575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7934a68c-6f80-4e59-8f84-bfcfedfd1c7e req-ad611bd1-cf5c-47e7-b9e6-7d01709e055c tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 944 time: 0.6709096 May 12 15:07:21.744892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41929db2-e63d-475f-957b-33ec12fafb8a req-922d014e-a28f-4988-81df-7c346cb0c2fb tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2207687 May 12 15:07:21.766334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd4fb464-4fee-4b4a-b256-e536939edc91 req-52ccff4c-033a-4ef6-b749-1a3616596190 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:21.767811 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd4fb464-4fee-4b4a-b256-e536939edc91 req-52ccff4c-033a-4ef6-b749-1a3616596190 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=4c945198-2daa-4ae0-a8c1-07ee6da52271&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4234743 May 12 15:07:21.818439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7934a68c-6f80-4e59-8f84-bfcfedfd1c7e req-d6f24efa-be57-4fbb-b4ef-e81e6810c0c2 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/security-groups?id=9c9166c2-fc2a-43df-8947-3b0f8ca10a32&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1245480 May 12 15:07:21.833951 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:21.856803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['4054de48-da89-4af0-98b0-82ec2255914c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:07:21.960529 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-92d364ef-32bd-4a73-92cb-3b2e2d438fe0 None None] Provisioning complete for port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:21.962441 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-92d364ef-32bd-4a73-92cb-3b2e2d438fe0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:22.000495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Router 940e3b0e-8287-409c-890e-28addf1cf0b8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:07:22.040002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-92d364ef-32bd-4a73-92cb-3b2e2d438fe0 None None] Port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:07:22.162473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Network 40409ee5-b51e-42cb-8335-adb362d0d213 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:07:22.171978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:07:22.183095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Pushing event updated for resources: {'Port': ['ID=6e590a85-aae0-4e2d-8659-02eb548f69e5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:22.188736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:07:22.196554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:22.197455 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:22.285881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aed630c-800f-499e-a59b-9857533b5955 req-9b51c7bf-cfa0-43a2-a6fc-516eae19620e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 4.5743630 May 12 15:07:22.299966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ec93e5-b4be-4d39-8f87-7db445001eaf req-e34a3103-7411-4781-a9e3-4cdbea6da6ea tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:22.301111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-62ec93e5-b4be-4d39-8f87-7db445001eaf req-e34a3103-7411-4781-a9e3-4cdbea6da6ea tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Synchronizing usage tracker for tenant:42cdb729a3834b40aed1f7fd83ab2973 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:07:22.312419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Request body: {'port': {'device_id': '8d133fcd-1e60-426e-bc49-2d93dc68083f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:22.362834 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fac6a011-85dc-423e-a855-446515118749 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:07:22.373408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:07:22.394402 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9630d610-01ca-491f-8fe2-58069319ba60 admin admin] 10.222.0.82 "PUT /v2.0/routers/940e3b0e-8287-409c-890e-28addf1cf0b8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.1523888 May 12 15:07:22.395060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd4fb464-4fee-4b4a-b256-e536939edc91 req-3402c57e-8948-4d39-a079-5d624bf75400 service neutron] 10.222.0.76 "GET /v2.0/networks/4c945198-2daa-4ae0-a8c1-07ee6da52271?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6196525 May 12 15:07:22.460038 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port fac6a011-85dc-423e-a855-446515118749 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:07:22.473618 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port fac6a011-85dc-423e-a855-446515118749 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:22.474063 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:22.593948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-62ec93e5-b4be-4d39-8f87-7db445001eaf req-e34a3103-7411-4781-a9e3-4cdbea6da6ea tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Unset dirty status for tenant:42cdb729a3834b40aed1f7fd83ab2973 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:07:22.595443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62ec93e5-b4be-4d39-8f87-7db445001eaf req-e34a3103-7411-4781-a9e3-4cdbea6da6ea tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d133fcd-1e60-426e-bc49-2d93dc68083f HTTP/1.1" status: 200 len: 932 time: 0.6336269 May 12 15:07:22.676436 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:22.697212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port fac6a011-85dc-423e-a855-446515118749, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fac6a011-85dc-423e-a855-446515118749,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:22.702619 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:22.752210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd4fb464-4fee-4b4a-b256-e536939edc91 req-d4e5bf55-be4c-4cac-a2f1-8d40f3100c04 service neutron] 10.222.0.76 "GET /v2.0/networks/4c945198-2daa-4ae0-a8c1-07ee6da52271?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3403003 May 12 15:07:22.755610 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62ec93e5-b4be-4d39-8f87-7db445001eaf req-6af17f47-eeb5-43c1-9c4d-5fdc667d95e7 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/security-groups?id=58d4492e-8d39-43dd-960f-b72be1cb1fa6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1531706 May 12 15:07:22.756208 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:22.832208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=fac6a011-85dc-423e-a855-446515118749,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:23.015718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4054de48-da89-4af0-98b0-82ec2255914c up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:07:23.103818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 4054de48-da89-4af0-98b0-82ec2255914c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:07:23.110707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 4054de48-da89-4af0-98b0-82ec2255914c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:23.111224 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:23.162451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59da3928-ba68-4dff-9eb1-9049106405d3 req-c1055eda-b9dd-425c-8465-04489b90c8ec tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:23.163978 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59da3928-ba68-4dff-9eb1-9049106405d3 req-c1055eda-b9dd-425c-8465-04489b90c8ec tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.2111862 May 12 15:07:23.259462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:23.301977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59da3928-ba68-4dff-9eb1-9049106405d3 req-91a71b1b-7ca3-4342-9933-51d20d583bb8 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1310055 May 12 15:07:23.336643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6e590a85-aae0-4e2d-8659-02eb548f69e5 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:07:23.340123 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4054de48-da89-4af0-98b0-82ec2255914c'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:23.348117 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:23.355227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 4054de48-da89-4af0-98b0-82ec2255914c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4054de48-da89-4af0-98b0-82ec2255914c,segment=NetworkSegment(49f41745-6217-458f-8fa0-7833e5e7c9df),segment_id=49f41745-6217-458f-8fa0-7833e5e7c9df)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:23.362353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-563c6538-ec9d-4bcb-a6db-e19d4d45fa04 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:07:23.363620 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-563c6538-ec9d-4bcb-a6db-e19d4d45fa04 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0069678 May 12 15:07:23.369175 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:23.371922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Transition to ACTIVE for port object 6e590a85-aae0-4e2d-8659-02eb548f69e5 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:07:23.378869 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:23.387652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-a9c77dcc-616c-4153-adaa-f667f45ee6dc service neutron] Request body: {'binding': {'host': 'n-h2-841483-1', 'vnic_type': 'normal', 'profile': {}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:23.388543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-a9c77dcc-616c-4153-adaa-f667f45ee6dc service neutron] Unknown quota resources ['binding']. {{(pid=88151) _create /opt/stack/neutron/neutron/api/v2/base.py:495}} May 12 15:07:23.430826 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-77a58980-0edb-4c28-b92a-7bd386b96e2e'] response: {'server_uuid': 'f0d6b9d7-49fd-4a8d-be50-eb0cadf2c4dc', 'name': 'network-vif-deleted', 'tag': 'adce94a7-30ae-4036-8a49-87df5c50c324', 'status': 'completed', 'code': 200} May 12 15:07:23.431448 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-77a58980-0edb-4c28-b92a-7bd386b96e2e'] response: {'server_uuid': 'd92d2403-4d50-4d2e-8f63-1d668eb627d5', 'name': 'network-vif-deleted', 'tag': '1eade7b6-fd9d-4292-b6d7-67f0ba8285d1', 'status': 'completed', 'code': 200} May 12 15:07:23.486373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=4054de48-da89-4af0-98b0-82ec2255914c,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:23.634109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Pushing event updated for resources: {'Port': ['ID=6e590a85-aae0-4e2d-8659-02eb548f69e5,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:23.636491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Attempting to bind port 6e590a85-aae0-4e2d-8659-02eb548f69e5 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:07:23.636892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Attempting to bind port 6e590a85-aae0-4e2d-8659-02eb548f69e5 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '46b06527-f385-49ce-9d8e-98fc74ddf9b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': '40409ee5-b51e-42cb-8335-adb362d0d213'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:07:23.637286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Attempting to bind port 6e590a85-aae0-4e2d-8659-02eb548f69e5 on network 40409ee5-b51e-42cb-8335-adb362d0d213 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:23.638949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-a9c77dcc-616c-4153-adaa-f667f45ee6dc service neutron] Attempting to bind port 8a33daa6-587f-4787-befb-2fa6e1051f2c on host n-h2-841483-1 for vnic_type normal with profile None {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:07:23.639354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-a9c77dcc-616c-4153-adaa-f667f45ee6dc service neutron] Attempting to bind port 8a33daa6-587f-4787-befb-2fa6e1051f2c by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:07:23.639750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-a9c77dcc-616c-4153-adaa-f667f45ee6dc service neutron] Attempting to bind port 8a33daa6-587f-4787-befb-2fa6e1051f2c on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:23.642911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Port 6e590a85-aae0-4e2d-8659-02eb548f69e5 on network 40409ee5-b51e-42cb-8335-adb362d0d213 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:07:23.643390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Attempting to bind port 6e590a85-aae0-4e2d-8659-02eb548f69e5 on network 40409ee5-b51e-42cb-8335-adb362d0d213 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:23.645650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-a9c77dcc-616c-4153-adaa-f667f45ee6dc service neutron] Port 8a33daa6-587f-4787-befb-2fa6e1051f2c on network 95dd1383-efe7-494d-a1ab-57e293da83a3 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:07:23.646164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-a9c77dcc-616c-4153-adaa-f667f45ee6dc service neutron] Attempting to bind port 8a33daa6-587f-4787-befb-2fa6e1051f2c on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:23.650370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 7, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:07:23.650704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Checking segment: {'id': '46b06527-f385-49ce-9d8e-98fc74ddf9b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': '40409ee5-b51e-42cb-8335-adb362d0d213'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:07:23.651081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Bound using segment: {'id': '46b06527-f385-49ce-9d8e-98fc74ddf9b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': '40409ee5-b51e-42cb-8335-adb362d0d213'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:07:23.651514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Bound port: 6e590a85-aae0-4e2d-8659-02eb548f69e5, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '46b06527-f385-49ce-9d8e-98fc74ddf9b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': '40409ee5-b51e-42cb-8335-adb362d0d213'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:07:23.652043 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:23.652555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-a9c77dcc-616c-4153-adaa-f667f45ee6dc service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 7, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:07:23.652969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-a9c77dcc-616c-4153-adaa-f667f45ee6dc service neutron] Checking segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:07:23.653478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-a9c77dcc-616c-4153-adaa-f667f45ee6dc service neutron] Bound using segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:07:23.653934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-a9c77dcc-616c-4153-adaa-f667f45ee6dc service neutron] Bound port: 8a33daa6-587f-4787-befb-2fa6e1051f2c, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:07:23.687240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-a9c77dcc-616c-4153-adaa-f667f45ee6dc service neutron] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:07:23.694031 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-a9c77dcc-616c-4153-adaa-f667f45ee6dc service neutron] Notify callbacks [] for binding, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:23.695454 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-a9c77dcc-616c-4153-adaa-f667f45ee6dc service neutron] 10.222.0.82 "POST /v2.0/ports/8a33daa6-587f-4787-befb-2fa6e1051f2c/bindings HTTP/1.1" status: 201 len: 389 time: 0.3129771 May 12 15:07:23.735093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Sync routers for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:07:23.746703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:07:23.747323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:23.762808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] For port 6e590a85-aae0-4e2d-8659-02eb548f69e5, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:07:23.767206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] For port 6e590a85-aae0-4e2d-8659-02eb548f69e5, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=6e590a85-aae0-4e2d-8659-02eb548f69e5,segment=NetworkSegment(46b06527-f385-49ce-9d8e-98fc74ddf9b7),segment_id=46b06527-f385-49ce-9d8e-98fc74ddf9b7)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:07:23.774167 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:23.860772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:23.861522 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:23.863183 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aed630c-800f-499e-a59b-9857533b5955 req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] 10.222.0.76 "PUT /v2.0/ports/6e590a85-aae0-4e2d-8659-02eb548f69e5 HTTP/1.1" status: 200 len: 1092 time: 1.5565312 May 12 15:07:23.883279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c55cc512-a1a0-4215-a911-dbb3a453db31 service neutron] Pushing event updated for resources: {'Port': ['ID=6e590a85-aae0-4e2d-8659-02eb548f69e5,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:24.050386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aed630c-800f-499e-a59b-9857533b5955 req-fbe08309-0b1f-4d08-af47-4e9e0ffcacbc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:24.052480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aed630c-800f-499e-a59b-9857533b5955 req-fbe08309-0b1f-4d08-af47-4e9e0ffcacbc service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=42cdb729a3834b40aed1f7fd83ab2973&device_id=8d133fcd-1e60-426e-bc49-2d93dc68083f HTTP/1.1" status: 200 len: 1095 time: 0.1372521 May 12 15:07:24.090844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:07:24.315723 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aed630c-800f-499e-a59b-9857533b5955 req-703eec88-9a7c-4320-89f9-eabf877565f3 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6e590a85-aae0-4e2d-8659-02eb548f69e5 HTTP/1.1" status: 200 len: 217 time: 0.2517600 May 12 15:07:24.324162 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fac6a011-85dc-423e-a855-446515118749 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:07:24.479020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port fac6a011-85dc-423e-a855-446515118749 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:24.479378 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:24.529051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aed630c-800f-499e-a59b-9857533b5955 req-092fc2e6-a007-47f1-b923-e2f36e87833a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:24.530487 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aed630c-800f-499e-a59b-9857533b5955 req-092fc2e6-a007-47f1-b923-e2f36e87833a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=8a6a4b4b-c9fd-4587-bd5d-0955b805a307 HTTP/1.1" status: 200 len: 855 time: 0.1981268 May 12 15:07:24.574692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-1fb50a06-17b1-4055-8bb0-f72ba9ffb519 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:24.576064 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-1fb50a06-17b1-4055-8bb0-f72ba9ffb519 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 1097 time: 0.5773909 May 12 15:07:24.607279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 2, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:24.617136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Checking router: 940e3b0e-8287-409c-890e-28addf1cf0b8 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:07:24.617525 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Updating router 940e3b0e-8287-409c-890e-28addf1cf0b8 port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:07:24.628703 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aed630c-800f-499e-a59b-9857533b5955 req-c1f9cb04-ccab-4b75-9d0e-77feb62d40d7 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=40409ee5-b51e-42cb-8335-adb362d0d213&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0883369 May 12 15:07:24.639834 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-354b7a51-82b4-4dcf-b3f1-66a7d5dd3f6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:24.641205 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-354b7a51-82b4-4dcf-b3f1-66a7d5dd3f6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 821 time: 0.4017508 May 12 15:07:24.680063 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:24.794680 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-29523bd7-544d-4ad4-a8b3-b34acd4ed3ca tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/quotas/bad2264067c248e9803d4b1eeb73116d HTTP/1.1" status: 200 len: 375 time: 0.0989006 May 12 15:07:24.802891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2f757e-950b-491d-bed9-f2df3ba316fc req-1b7f4fa3-ced8-4717-b1c0-cc77bc8bd057 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:24.804327 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac2f757e-950b-491d-bed9-f2df3ba316fc req-1b7f4fa3-ced8-4717-b1c0-cc77bc8bd057 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 946 time: 0.5580304 May 12 15:07:24.967491 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac2f757e-950b-491d-bed9-f2df3ba316fc req-f0b00ef4-c6a4-4622-9949-e07cc24b5a1c tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/security-groups?id=9c9166c2-fc2a-43df-8947-3b0f8ca10a32&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1496933 May 12 15:07:24.973279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-8268fd3f-0de4-4eb5-9085-d18327507aab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:24.974722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-8268fd3f-0de4-4eb5-9085-d18327507aab service neutron] 10.222.0.76 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.3802476 May 12 15:07:25.015036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46980) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:25.061105 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aed630c-800f-499e-a59b-9857533b5955 req-f8843aa8-de5c-4b19-80d4-ada6620e2abf service neutron] 10.222.0.76 "GET /v2.0/networks/40409ee5-b51e-42cb-8335-adb362d0d213?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4169583 May 12 15:07:25.062359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-81d61c0b-7a91-41bd-93bb-56a15541e77d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c HTTP/1.1" status: 200 len: 217 time: 0.0780358 May 12 15:07:25.070424 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:25.090174 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-831d2381-f10f-42dc-94b5-a1a49e067025'] response: {'server_uuid': '5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4054de48-da89-4af0-98b0-82ec2255914c', 'code': 200} May 12 15:07:25.091552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Transition to ACTIVE for port object 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:07:25.123649 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-44b2d0fb-cf24-404e-a13a-47d9757389c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:25.134598 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:25.161985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-44b2d0fb-cf24-404e-a13a-47d9757389c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:25.206693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-cbaafc7e-ade2-4d3d-bb52-5aa2029e3064 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3989120 May 12 15:07:25.240816 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-44b2d0fb-cf24-404e-a13a-47d9757389c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:25.270281 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-44b2d0fb-cf24-404e-a13a-47d9757389c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:25.271770 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-44b2d0fb-cf24-404e-a13a-47d9757389c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "DELETE /v2.0/security-groups/bea28a12-4648-49eb-967a-a6cae208864d HTTP/1.1" status: 204 len: 168 time: 0.2548881 May 12 15:07:25.272999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44b2d0fb-cf24-404e-a13a-47d9757389c6 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bea28a12-4648-49eb-967a-a6cae208864d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:25.274861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46986) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:25.298629 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-c95e9130-ca8f-413e-af08-40a34eb2eb31 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] show failed (client error): The resource could not be found. May 12 15:07:25.300987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c95e9130-ca8f-413e-af08-40a34eb2eb31 tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "GET /v2.0/security-groups/bea28a12-4648-49eb-967a-a6cae208864d HTTP/1.1" status: 404 len: 347 time: 0.0247240 May 12 15:07:25.308324 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46990) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:25.361845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8bd273f-66d9-44aa-bb44-3da52090ae16 None None] Pushing event updated for resources: {'Port': ['ID=207b2c9c-f7e0-4d1b-96ea-20213deda9a0,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:25.448397 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8d133fcd-1e60-426e-bc49-2d93dc68083f', 'tag': '6e590a85-aae0-4e2d-8659-02eb548f69e5'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:25.462521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-b55478fd-ce6f-462f-af74-62dd61723b71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:25.463315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Attempting to bind port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:07:25.463858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Attempting to bind port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:07:25.464007 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-b55478fd-ce6f-462f-af74-62dd61723b71 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.3927102 May 12 15:07:25.464493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Attempting to bind port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 on network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:25.470918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 7, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:07:25.473096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Checking segment: {'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:07:25.473793 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:25.474351 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Bound using segment: {'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:07:25.474981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Bound port: 207b2c9c-f7e0-4d1b-96ea-20213deda9a0, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:07:25.475848 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:25.528253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-75a364b1-cf59-4896-b04f-4fb7a6dc253b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Deleting port 6a1d8850-c23f-4315-a99f-1c1a0d8dbecb {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:07:25.528662 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75a364b1-cf59-4896-b04f-4fb7a6dc253b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:25.548804 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-78f88a2a-1c5f-4f3f-9084-8849157425c9 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0723240 May 12 15:07:25.591941 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] For port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:07:25.595185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] For port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=207b2c9c-f7e0-4d1b-96ea-20213deda9a0,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:07:25.601932 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:25.699776 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:07:25.699776 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:25.814118 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75a364b1-cf59-4896-b04f-4fb7a6dc253b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:25.814775 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75a364b1-cf59-4896-b04f-4fb7a6dc253b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:25.859741 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aed630c-800f-499e-a59b-9857533b5955 req-47ca31d0-8cee-4735-bc31-83238c640263 service neutron] 10.222.0.76 "GET /v2.0/networks/40409ee5-b51e-42cb-8335-adb362d0d213?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7862995 May 12 15:07:25.903933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d868caed-6330-4e3b-a9ca-aa65b2214de5 req-7c6db180-41f5-4d6f-8755-43132594bcd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:25.905761 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d868caed-6330-4e3b-a9ca-aa65b2214de5 req-7c6db180-41f5-4d6f-8755-43132594bcd6 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 1097 time: 0.6965137 May 12 15:07:25.907901 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-c048bbcd-9110-480f-9cc3-701785013865 service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6164432 May 12 15:07:25.946651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496b81bc-fd21-4f17-88ba-a6ab26d544f9 req-083b4701-8ca0-40b2-ae0a-2ec55217cb23 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:25.953976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-496b81bc-fd21-4f17-88ba-a6ab26d544f9 req-083b4701-8ca0-40b2-ae0a-2ec55217cb23 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 946 time: 0.7104423 May 12 15:07:25.978262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:07:25.984314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-75a364b1-cf59-4896-b04f-4fb7a6dc253b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Calling delete_port for 6a1d8850-c23f-4315-a99f-1c1a0d8dbecb owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:07:26.026803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8bd273f-66d9-44aa-bb44-3da52090ae16 None None] Pushing event updated for resources: {'Port': ['ID=207b2c9c-f7e0-4d1b-96ea-20213deda9a0,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:26.107846 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-d39943f4-df9b-46a3-bfa3-5af4363cfb0c service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5520349 May 12 15:07:26.122278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d868caed-6330-4e3b-a9ca-aa65b2214de5 req-d3a0a7f7-9b47-4d7f-b470-83be1166add1 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=9c9166c2-fc2a-43df-8947-3b0f8ca10a32&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2075295 May 12 15:07:26.150914 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75a364b1-cf59-4896-b04f-4fb7a6dc253b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:26.162052 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-496b81bc-fd21-4f17-88ba-a6ab26d544f9 req-8fc08fe9-2727-41b4-8554-87180e79d688 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2068591 May 12 15:07:26.225160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a364b1-cf59-4896-b04f-4fb7a6dc253b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Pushing event deleted for resources: {'Port': ['ID=6a1d8850-c23f-4315-a99f-1c1a0d8dbecb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:26.260363 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-1291e074-9b07-4f39-adc4-593136396500 service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3219695 May 12 15:07:26.323620 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75a364b1-cf59-4896-b04f-4fb7a6dc253b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:26.342269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75a364b1-cf59-4896-b04f-4fb7a6dc253b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:26.346943 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-75a364b1-cf59-4896-b04f-4fb7a6dc253b tempest-ServersWithSpecificFlavorTestJSON-1326215217 tempest-ServersWithSpecificFlavorTestJSON-1326215217-project] 10.222.0.82 "DELETE /v2.0/floatingips/d8eaf86b-fcbd-4ca9-8430-1ddde3b94626 HTTP/1.1" status: 204 len: 168 time: 1.0367014 May 12 15:07:26.403419 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-3ac370eb-7820-43f3-8134-d21a132e918d service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2848988 May 12 15:07:26.419945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:25Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:26.424808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b29fc939-9008-4f7b-8cbc-7bd5a0084879 None None] The sync data for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 is: [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:25Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:07:26.431960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b14f4bb7-39d7-42c7-8360-9e5d6864a5b9 req-4c9c0b52-a7c3-42b5-887a-a23d48429dcf tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:26.434000 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b14f4bb7-39d7-42c7-8360-9e5d6864a5b9 req-4c9c0b52-a7c3-42b5-887a-a23d48429dcf tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d133fcd-1e60-426e-bc49-2d93dc68083f HTTP/1.1" status: 200 len: 944 time: 0.1261189 May 12 15:07:26.503993 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b14f4bb7-39d7-42c7-8360-9e5d6864a5b9 req-3c7588fa-551f-4225-a546-742e6611a04d tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/security-groups?id=58d4492e-8d39-43dd-960f-b72be1cb1fa6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637128 May 12 15:07:26.756271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d142be43-944e-41c8-a572-9f0355c8484d req-36caedf6-1203-4af7-bdc1-dede2ed49d5e tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:26.764290 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d142be43-944e-41c8-a572-9f0355c8484d req-36caedf6-1203-4af7-bdc1-dede2ed49d5e tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.1364181 May 12 15:07:26.834850 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d142be43-944e-41c8-a572-9f0355c8484d req-2f1f7003-3b70-43df-9131-4f872c1b1279 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0687816 May 12 15:07:26.928526 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-cd2c6368-dc98-454f-a216-d84efe1150f1'] response: {'name': 'network-changed', 'server_uuid': '8d133fcd-1e60-426e-bc49-2d93dc68083f', 'tag': '6e590a85-aae0-4e2d-8659-02eb548f69e5', 'status': 'completed', 'code': 200} May 12 15:07:27.092866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-907b4ebd-4a96-49a2-8a9d-76898d0c70f3 req-f9ef8154-a4b2-459f-bcf7-77d48beee83b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:27.094592 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-907b4ebd-4a96-49a2-8a9d-76898d0c70f3 req-f9ef8154-a4b2-459f-bcf7-77d48beee83b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=42cdb729a3834b40aed1f7fd83ab2973&device_id=8d133fcd-1e60-426e-bc49-2d93dc68083f HTTP/1.1" status: 200 len: 1095 time: 0.1414130 May 12 15:07:27.408380 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c0a25c9-19df-4665-bf75-1c978bdd8afd req-6de8abd5-53a1-4f55-ad21-00096f634a9c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 210 time: 0.0914276 May 12 15:07:27.459731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184d4fb8-16bc-407a-8d29-b5e9842625da req-e804e834-e352-4da0-a020-ac53d7ae18fb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:27.461324 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-184d4fb8-16bc-407a-8d29-b5e9842625da req-e804e834-e352-4da0-a020-ac53d7ae18fb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 946 time: 0.3746338 May 12 15:07:27.557331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-184d4fb8-16bc-407a-8d29-b5e9842625da req-b3f3daec-dc9b-4137-85cc-9617c46863eb tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/security-groups?id=9c9166c2-fc2a-43df-8947-3b0f8ca10a32&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0843093 May 12 15:07:27.565845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-907b4ebd-4a96-49a2-8a9d-76898d0c70f3 req-a84bb56d-2882-47fe-906c-0e72ac80f60d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:27.567683 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-907b4ebd-4a96-49a2-8a9d-76898d0c70f3 req-a84bb56d-2882-47fe-906c-0e72ac80f60d service neutron] 10.222.0.76 "GET /v2.0/networks?id=40409ee5-b51e-42cb-8335-adb362d0d213 HTTP/1.1" status: 200 len: 916 time: 0.4399681 May 12 15:07:27.716935 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-907b4ebd-4a96-49a2-8a9d-76898d0c70f3 req-6d2c5eb4-40f1-4f7f-958c-5e7063a549c1 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6e590a85-aae0-4e2d-8659-02eb548f69e5 HTTP/1.1" status: 200 len: 217 time: 0.1427290 May 12 15:07:27.859414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-907b4ebd-4a96-49a2-8a9d-76898d0c70f3 req-fb5fdaa3-8e50-4089-85e2-244934a726c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:27.861272 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-907b4ebd-4a96-49a2-8a9d-76898d0c70f3 req-fb5fdaa3-8e50-4089-85e2-244934a726c5 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=8a6a4b4b-c9fd-4587-bd5d-0955b805a307 HTTP/1.1" status: 200 len: 855 time: 0.1382108 May 12 15:07:27.929003 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-907b4ebd-4a96-49a2-8a9d-76898d0c70f3 req-c3c7f7ee-6587-4021-ac76-e2f7294771a6 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=40409ee5-b51e-42cb-8335-adb362d0d213&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0604222 May 12 15:07:27.930187 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-275cf93e-09b8-415d-b867-a9e55879ef99 service neutron] show failed (client error): The resource could not be found. May 12 15:07:27.931140 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-275cf93e-09b8-415d-b867-a9e55879ef99 service neutron] 10.222.0.84 "GET /v2.0/ports/b6035326-cd91-47d7-8a65-cc2dd3d1d127/bindings/n-h2-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.2741709 May 12 15:07:28.277538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47068) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:28.406861 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:07:28.536967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:07:28.543857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:28.544477 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:28.580572 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-556e024f-bd6d-4a6d-b0a6-2a039bd1d027 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b109b727195f4a0286ba8c6b6aa99144&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3016281 May 12 15:07:28.583631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47078) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:28.701740 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:28.747669 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=207b2c9c-f7e0-4d1b-96ea-20213deda9a0,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:28.755560 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:28.786461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-907b4ebd-4a96-49a2-8a9d-76898d0c70f3 req-ac1d97d8-a56d-4df2-b286-73ea087fe7fd service neutron] 10.222.0.76 "GET /v2.0/networks/40409ee5-b51e-42cb-8335-adb362d0d213?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8499482 May 12 15:07:28.803829 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbdba61b-cb8e-4128-8e31-6758694e3cd7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:28.847569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbdba61b-cb8e-4128-8e31-6758694e3cd7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:28.850067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=207b2c9c-f7e0-4d1b-96ea-20213deda9a0,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:28.916233 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbdba61b-cb8e-4128-8e31-6758694e3cd7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:28.917997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cddd9f8-75d2-4baf-a8a6-3ae4c2cf0bda req-02636971-4a96-4fd3-bee4-435301ef1748 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:28.922018 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cddd9f8-75d2-4baf-a8a6-3ae4c2cf0bda req-02636971-4a96-4fd3-bee4-435301ef1748 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 946 time: 0.8161368 May 12 15:07:28.935960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbdba61b-cb8e-4128-8e31-6758694e3cd7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=98c78171-ded7-4a0c-a647-1cd4c9ff1df4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:28.947400 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbdba61b-cb8e-4128-8e31-6758694e3cd7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:28.949334 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bbdba61b-cb8e-4128-8e31-6758694e3cd7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/98c78171-ded7-4a0c-a647-1cd4c9ff1df4 HTTP/1.1" status: 204 len: 168 time: 0.3642511 May 12 15:07:28.967672 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-aed49d0d-1805-40f0-a2eb-e6e88c1a1fbc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:28.969492 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-aed49d0d-1805-40f0-a2eb-e6e88c1a1fbc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.84 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 821 time: 0.7539592 May 12 15:07:28.983352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dddc1ebf-633f-4ccd-bd78-b28df71159c4 req-dcdd2614-86aa-4b1d-829c-b59eced9aa33 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:28.991111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dddc1ebf-633f-4ccd-bd78-b28df71159c4 req-dcdd2614-86aa-4b1d-829c-b59eced9aa33 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d133fcd-1e60-426e-bc49-2d93dc68083f HTTP/1.1" status: 200 len: 944 time: 0.8840964 May 12 15:07:29.004289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Request body: {'port': {'device_id': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'admin_state_up': True, 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:29.059459 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 6e590a85-aae0-4e2d-8659-02eb548f69e5 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:07:29.104526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-0c0fb8a2-297f-4f30-8dd8-c97e4b5810bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:29.106029 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-0c0fb8a2-297f-4f30-8dd8-c97e4b5810bb service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647&tenant_id=0da54985cde346e68eeadf965b8bc6d3 HTTP/1.1" status: 200 len: 1101 time: 0.5738096 May 12 15:07:29.138063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:29.215151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 6e590a85-aae0-4e2d-8659-02eb548f69e5, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=6e590a85-aae0-4e2d-8659-02eb548f69e5,segment=NetworkSegment(46b06527-f385-49ce-9d8e-98fc74ddf9b7),segment_id=46b06527-f385-49ce-9d8e-98fc74ddf9b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:29.230065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '6e590a85-aae0-4e2d-8659-02eb548f69e5', 'network_id': '40409ee5-b51e-42cb-8335-adb362d0d213', 'port_id': '6e590a85-aae0-4e2d-8659-02eb548f69e5', 'mac_address': 'fa:16:3e:c9:2d:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 576, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8a6a4b4b-c9fd-4587-bd5d-0955b805a307', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:07:29.234185 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cddd9f8-75d2-4baf-a8a6-3ae4c2cf0bda req-0fc4440b-8274-4a39-ae45-ad3424a4a50d tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3043492 May 12 15:07:29.289792 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dddc1ebf-633f-4ccd-bd78-b28df71159c4 req-be50504a-d106-4cce-9267-bf3b1063caad tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/security-groups?id=58d4492e-8d39-43dd-960f-b72be1cb1fa6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2975111 May 12 15:07:29.340188 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:29.365282 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-907b4ebd-4a96-49a2-8a9d-76898d0c70f3 req-8e5bafc5-522f-44c8-9c46-c74ce85847fc service neutron] 10.222.0.76 "GET /v2.0/networks/40409ee5-b51e-42cb-8335-adb362d0d213?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5620522 May 12 15:07:29.378335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6e590a85-aae0-4e2d-8659-02eb548f69e5 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:07:29.407488 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 6e590a85-aae0-4e2d-8659-02eb548f69e5, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=6e590a85-aae0-4e2d-8659-02eb548f69e5,segment=NetworkSegment(46b06527-f385-49ce-9d8e-98fc74ddf9b7),segment_id=46b06527-f385-49ce-9d8e-98fc74ddf9b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:29.415373 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:29.501132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:29.515676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Usage tracker for resource:port and tenant:bad2264067c248e9803d4b1eeb73116d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:29.516907 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=6e590a85-aae0-4e2d-8659-02eb548f69e5,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:29.525061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:29.536077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:29.538240 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:29.610231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Made reservation on behalf of bad2264067c248e9803d4b1eeb73116d for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:07:29.614627 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:29.663299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['6e590a85-aae0-4e2d-8659-02eb548f69e5'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:07:29.725745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31e8077e-a4bc-49e9-95bf-0ed3bf1f4360 req-6ed21b04-846a-477c-81e1-e884e5141762 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:29.727283 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31e8077e-a4bc-49e9-95bf-0ed3bf1f4360 req-6ed21b04-846a-477c-81e1-e884e5141762 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.3128927 May 12 15:07:29.888685 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd733d6e-2b9b-4787-bb55-1be596c66454 req-96c570cc-17d7-45a2-a148-8e0d70503960 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 210 time: 0.1196375 May 12 15:07:30.041346 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31e8077e-a4bc-49e9-95bf-0ed3bf1f4360 req-a51f4f01-ccec-4d9f-9cfb-a404fd0f78f0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2687631 May 12 15:07:30.194320 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Allocated IP 172.20.0.6 (5af19f47-caf0-45a8-9b3d-186b8fd71ec1/b0cba805-7761-41c5-9666-3b2ff25491af/9015ad2b-bc53-4425-beb5-9a5e82176b06) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:07:30.233254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] For port b6035326-cd91-47d7-8a65-cc2dd3d1d127, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:30.284537 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:07:30.318921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e48e1688-69c3-4119-95e7-4ecc57a3092e req-8b936ff7-c2d6-4441-a113-0de0a074a2c3 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:30.320355 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e48e1688-69c3-4119-95e7-4ecc57a3092e req-8b936ff7-c2d6-4441-a113-0de0a074a2c3 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 946 time: 0.3192732 May 12 15:07:30.355614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:30.356141 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:30.438583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] For port b6035326-cd91-47d7-8a65-cc2dd3d1d127, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:07:30.510539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67b0596e-d5af-4034-9429-e8c3da7ce0f5 req-45f9b385-e91a-44ed-b746-e4ef085e2616 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:30.512033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67b0596e-d5af-4034-9429-e8c3da7ce0f5 req-45f9b385-e91a-44ed-b746-e4ef085e2616 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 1101 time: 0.3664668 May 12 15:07:30.544010 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e48e1688-69c3-4119-95e7-4ecc57a3092e req-57b99c23-7758-4387-add5-57d55565c193 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/security-groups?id=9c9166c2-fc2a-43df-8947-3b0f8ca10a32&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1947935 May 12 15:07:30.584467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86881e13-2515-46d4-a5a5-4bc93a1b8647', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:30.592458 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:30.631347 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:30.654229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Transition to ACTIVE for port object b6035326-cd91-47d7-8a65-cc2dd3d1d127 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:07:30.660105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Transition to ACTIVE for port object 9015ad2b-bc53-4425-beb5-9a5e82176b06 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:07:30.662677 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67b0596e-d5af-4034-9429-e8c3da7ce0f5 req-7ecef93a-1742-4b0b-baed-d06ab02e86bf tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1347661 May 12 15:07:30.664722 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:31.035772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Pushing event updated for resources: {'Port': ['ID=b6035326-cd91-47d7-8a65-cc2dd3d1d127,revision_number=6']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:31.039343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] No DVR routers for this DVR port b6035326-cd91-47d7-8a65-cc2dd3d1d127 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:07:31.059955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 6e590a85-aae0-4e2d-8659-02eb548f69e5 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:07:31.118080 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:31.134693 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 6e590a85-aae0-4e2d-8659-02eb548f69e5 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:07:31.139958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 6e590a85-aae0-4e2d-8659-02eb548f69e5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:31.140462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:31.199055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Attempting to bind port b6035326-cd91-47d7-8a65-cc2dd3d1d127 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:07:31.199279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Attempting to bind port b6035326-cd91-47d7-8a65-cc2dd3d1d127 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:07:31.199600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Attempting to bind port b6035326-cd91-47d7-8a65-cc2dd3d1d127 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:31.218204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:07:31.218909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Port b6035326-cd91-47d7-8a65-cc2dd3d1d127 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:07:31.219239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Attempting to bind port b6035326-cd91-47d7-8a65-cc2dd3d1d127 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:31.225587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:07:31.232471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:07:31.238462 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:31.239149 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:31.254670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e520dbc4-7c48-4850-b9ee-73bcd9c9f3f7 req-e3401cfd-8d97-4b5a-8121-587bf8fc3964 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:31.262415 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e520dbc4-7c48-4850-b9ee-73bcd9c9f3f7 req-e3401cfd-8d97-4b5a-8121-587bf8fc3964 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 946 time: 0.4362280 May 12 15:07:31.269520 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:31.284215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 7, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:07:31.284553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:07:31.284939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:07:31.285370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Bound port: b6035326-cd91-47d7-8a65-cc2dd3d1d127, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:07:31.285735 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:31.305583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Pushing event updated for resources: {'Port': ['ID=9015ad2b-bc53-4425-beb5-9a5e82176b06,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:31.307819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 6e590a85-aae0-4e2d-8659-02eb548f69e5, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=6e590a85-aae0-4e2d-8659-02eb548f69e5,segment=NetworkSegment(46b06527-f385-49ce-9d8e-98fc74ddf9b7),segment_id=46b06527-f385-49ce-9d8e-98fc74ddf9b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:31.308523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8d133fcd-1e60-426e-bc49-2d93dc68083f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6e590a85-aae0-4e2d-8659-02eb548f69e5'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:31.314976 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:31.323021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e461819-589b-4e5f-a25a-d4d09bda6ed2 req-658a870b-b009-4e8c-81cc-2a8a535a97c2 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:31.324540 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e461819-589b-4e5f-a25a-d4d09bda6ed2 req-658a870b-b009-4e8c-81cc-2a8a535a97c2 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d133fcd-1e60-426e-bc49-2d93dc68083f HTTP/1.1" status: 200 len: 945 time: 0.3969982 May 12 15:07:31.401784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ff70df51-d8d7-4df0-aed1-70cadd0c2269 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.4083292 May 12 15:07:31.422011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e520dbc4-7c48-4850-b9ee-73bcd9c9f3f7 req-acb62b54-01da-4fd2-adb6-4d881c18c89f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1586261 May 12 15:07:31.429788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=6e590a85-aae0-4e2d-8659-02eb548f69e5,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:31.454320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e461819-589b-4e5f-a25a-d4d09bda6ed2 req-7960d700-e240-4e75-8cdc-3fa4b331b4ed tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/security-groups?id=58d4492e-8d39-43dd-960f-b72be1cb1fa6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1143963 May 12 15:07:31.458787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Request body: {'port': {'device_id': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:31.544104 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9f6c50ec-322e-420d-9056-e926e3fc00a2'] response: {'server_uuid': '86881e13-2515-46d4-a5a5-4bc93a1b8647', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127', 'code': 200} May 12 15:07:31.549715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4461015a-3283-4053-ad74-3e89f537971b None None] Provisioning for port 9015ad2b-bc53-4425-beb5-9a5e82176b06 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:07:31.555571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4461015a-3283-4053-ad74-3e89f537971b None None] Provisioning complete for port 9015ad2b-bc53-4425-beb5-9a5e82176b06 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:31.556113 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4461015a-3283-4053-ad74-3e89f537971b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:31.615592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4461015a-3283-4053-ad74-3e89f537971b None None] Port 9015ad2b-bc53-4425-beb5-9a5e82176b06 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:07:31.641231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] For port b6035326-cd91-47d7-8a65-cc2dd3d1d127, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:07:31.672627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] For port b6035326-cd91-47d7-8a65-cc2dd3d1d127, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:07:31.673719 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:31.689334 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:31.840035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:31.841375 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:31.842067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] 10.222.0.76 "PUT /v2.0/ports/b6035326-cd91-47d7-8a65-cc2dd3d1d127 HTTP/1.1" status: 200 len: 1096 time: 2.7282875 May 12 15:07:31.939403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00ded21a-29da-48c6-8d6a-306056c6ec81 service neutron] Pushing event updated for resources: {'Port': ['ID=b6035326-cd91-47d7-8a65-cc2dd3d1d127,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:32.020864 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e1e04cb-cce1-458e-af84-9789ca912823 req-cb4f2331-e31e-4641-84d2-a354e39a38cd tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:32.022373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e1e04cb-cce1-458e-af84-9789ca912823 req-cb4f2331-e31e-4641-84d2-a354e39a38cd tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 946 time: 0.4817874 May 12 15:07:32.034473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47140) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:32.040516 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:32.043164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-84419a15-d3ca-4f80-a5b0-c90fc4a41de5 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Request body: {'floatingip': {'port_id': '4054de48-da89-4af0-98b0-82ec2255914c'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:32.103565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a71e3836-2cdd-4aa4-8d84-c9954d477671 req-c627cfb9-bf19-49b0-86f0-97f9caf7e20c tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:32.104962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a71e3836-2cdd-4aa4-8d84-c9954d477671 req-c627cfb9-bf19-49b0-86f0-97f9caf7e20c tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 1101 time: 0.4082954 May 12 15:07:32.138861 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84419a15-d3ca-4f80-a5b0-c90fc4a41de5 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for floatingip, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:32.184054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-b4bad659-0964-48c1-8d47-0195c29ba636 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:32.185553 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-b4bad659-0964-48c1-8d47-0195c29ba636 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 1099 time: 0.3095946 May 12 15:07:32.400173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device b6035326-cd91-47d7-8a65-cc2dd3d1d127 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:07:32.417250 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a71e3836-2cdd-4aa4-8d84-c9954d477671 req-126f8722-75c0-4603-80be-fbc8dc45c979 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2655776 May 12 15:07:32.503859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device b6035326-cd91-47d7-8a65-cc2dd3d1d127 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:07:32.697135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-5792f8e6-e5e0-40d8-86f4-2eb1f71aedbd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:32.698495 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-5792f8e6-e5e0-40d8-86f4-2eb1f71aedbd service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.5053444 May 12 15:07:32.779375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9015ad2b-bc53-4425-beb5-9a5e82176b06 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:07:32.802789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38bb0d8c-3d00-4b22-9300-17bbbf0977db req-8c321f1b-185f-4460-b998-1022ea146919 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:32.803510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-38bb0d8c-3d00-4b22-9300-17bbbf0977db req-8c321f1b-185f-4460-b998-1022ea146919 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Synchronizing usage tracker for tenant:bad2264067c248e9803d4b1eeb73116d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:07:32.807286 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:32.817647 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-e9f7922d-718c-4490-a427-beb33cd11bdd service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.253&port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127 HTTP/1.1" status: 200 len: 217 time: 0.1098824 May 12 15:07:32.817947 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84419a15-d3ca-4f80-a5b0-c90fc4a41de5 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:32.821817 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84419a15-d3ca-4f80-a5b0-c90fc4a41de5 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:32.884070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Transition to ACTIVE for port object 9015ad2b-bc53-4425-beb5-9a5e82176b06 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:07:32.901083 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:32.904554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-38bb0d8c-3d00-4b22-9300-17bbbf0977db req-8c321f1b-185f-4460-b998-1022ea146919 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Unset dirty status for tenant:bad2264067c248e9803d4b1eeb73116d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:07:32.905734 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-38bb0d8c-3d00-4b22-9300-17bbbf0977db req-8c321f1b-185f-4460-b998-1022ea146919 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 931 time: 0.6411343 May 12 15:07:33.003197 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-84419a15-d3ca-4f80-a5b0-c90fc4a41de5 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Floating IP ecb0a857-94c1-4a94-86d7-48852d7f953f associated. External IP: 172.25.8.26, port: 4054de48-da89-4af0-98b0-82ec2255914c. May 12 15:07:33.057656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-cdb07c4e-6cd7-4e21-b7ad-deda74db8206 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:33.059116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-cdb07c4e-6cd7-4e21-b7ad-deda74db8206 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2198920 May 12 15:07:33.088816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb1f7624-f2de-4fcd-94ed-34c86723b880 req-77f1741a-0263-4348-ae19-0e67808aa946 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:33.090403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb1f7624-f2de-4fcd-94ed-34c86723b880 req-77f1741a-0263-4348-ae19-0e67808aa946 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 948 time: 0.5339012 May 12 15:07:33.227121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Pushing event updated for resources: {'Port': ['ID=9015ad2b-bc53-4425-beb5-9a5e82176b06,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:33.231756 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-38bb0d8c-3d00-4b22-9300-17bbbf0977db req-7d50ff77-fab6-4e23-93e6-a88298cad4f5 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2921855 May 12 15:07:33.264003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Attempting to bind port 9015ad2b-bc53-4425-beb5-9a5e82176b06 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:07:33.264266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Attempting to bind port 9015ad2b-bc53-4425-beb5-9a5e82176b06 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:07:33.264594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Attempting to bind port 9015ad2b-bc53-4425-beb5-9a5e82176b06 on network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:33.290730 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb1f7624-f2de-4fcd-94ed-34c86723b880 req-97f58ae9-044f-40a2-bc6b-bf4662f7e32a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1470187 May 12 15:07:33.292851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Port 9015ad2b-bc53-4425-beb5-9a5e82176b06 on network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:07:33.293173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Attempting to bind port 9015ad2b-bc53-4425-beb5-9a5e82176b06 on network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:33.325946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 7, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:07:33.329673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Checking segment: {'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:07:33.330338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Bound using segment: {'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:07:33.331560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Bound port: 9015ad2b-bc53-4425-beb5-9a5e82176b06, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:07:33.332174 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:33.350154 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-cfb00381-2da7-40e0-a8bf-46d1d1d6908a'] response: {'server_uuid': '8d133fcd-1e60-426e-bc49-2d93dc68083f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6e590a85-aae0-4e2d-8659-02eb548f69e5', 'code': 200} May 12 15:07:33.354883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-c8987b8c-2a95-4342-8df9-6f5b79986d25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:33.356404 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-c8987b8c-2a95-4342-8df9-6f5b79986d25 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2843909 May 12 15:07:33.551541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '86881e13-2515-46d4-a5a5-4bc93a1b8647', 'tag': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:33.604813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-84419a15-d3ca-4f80-a5b0-c90fc4a41de5 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Router fab022ae-aab5-4b4f-a77e-4570d094dd89 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:07:33.700345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] For port 9015ad2b-bc53-4425-beb5-9a5e82176b06, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:07:33.713160 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-3f6f55a3-dc23-4901-aa09-5abc45e71e48 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3137949 May 12 15:07:33.806974 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] For port 9015ad2b-bc53-4425-beb5-9a5e82176b06, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:07:33.825562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-84419a15-d3ca-4f80-a5b0-c90fc4a41de5 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:07:33.829909 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84419a15-d3ca-4f80-a5b0-c90fc4a41de5 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:33.840026 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59954a68-1d8f-45e6-b341-1a372c2289b7 None None] Sync routers for ids ['fab022ae-aab5-4b4f-a77e-4570d094dd89'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:07:33.851475 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59954a68-1d8f-45e6-b341-1a372c2289b7 None None] Routers {'fab022ae-aab5-4b4f-a77e-4570d094dd89'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:07:33.852384 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-59954a68-1d8f-45e6-b341-1a372c2289b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['fab022ae-aab5-4b4f-a77e-4570d094dd89'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:33.888448 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-84419a15-d3ca-4f80-a5b0-c90fc4a41de5 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "PUT /v2.0/floatingips/ecb0a857-94c1-4a94-86d7-48852d7f953f HTTP/1.1" status: 200 len: 991 time: 1.8513818 May 12 15:07:33.889281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d', 'tag': '4054de48-da89-4af0-98b0-82ec2255914c'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:33.899516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47182) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:33.922790 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:34.026532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d789f590-4e04-4fa9-8053-12d9038893a6 req-f8b26385-5e69-471c-8c6c-7f1ff4901a3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:34.027741 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d789f590-4e04-4fa9-8053-12d9038893a6 req-f8b26385-5e69-471c-8c6c-7f1ff4901a3c service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=8d133fcd-1e60-426e-bc49-2d93dc68083f HTTP/1.1" status: 200 len: 1097 time: 0.6061370 May 12 15:07:34.030434 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71f13f57-9bce-474b-80e9-5398b7e75e96 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:34.050998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-71f13f57-9bce-474b-80e9-5398b7e75e96 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:34.056021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-71f13f57-9bce-474b-80e9-5398b7e75e96 admin admin] Usage tracker for resource:security_group_rule and tenant:53152455e02f47c5956394392ccbe6cf is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:34.060103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-71f13f57-9bce-474b-80e9-5398b7e75e96 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:34.062606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:34.063209 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:34.064577 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] 10.222.0.84 "PUT /v2.0/ports/9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 200 len: 1091 time: 2.6142476 May 12 15:07:34.066296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-71f13f57-9bce-474b-80e9-5398b7e75e96 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:34.072889 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-59954a68-1d8f-45e6-b341-1a372c2289b7 None None] Set router fab022ae-aab5-4b4f-a77e-4570d094dd89 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:07:34.151629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec69e50e-761e-4be7-af9f-ceecf6854f89 service neutron] Pushing event updated for resources: {'Port': ['ID=9015ad2b-bc53-4425-beb5-9a5e82176b06,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:34.232507 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-292d1dcb-ee96-47cd-8c85-ba29c3c20638 req-165f7da4-a17b-4365-b235-a600355620e0 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4650960 May 12 15:07:34.240563 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71f13f57-9bce-474b-80e9-5398b7e75e96 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:34.245477 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71f13f57-9bce-474b-80e9-5398b7e75e96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:34.281980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04440fb2-af8a-4e72-99a5-5ba9661441c2 req-4bd50f4d-d785-4d97-b3fd-7a831b467396 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:34.283431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04440fb2-af8a-4e72-99a5-5ba9661441c2 req-4bd50f4d-d785-4d97-b3fd-7a831b467396 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 946 time: 0.5727913 May 12 15:07:34.285186 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d789f590-4e04-4fa9-8053-12d9038893a6 req-2d0acb4f-1533-45f2-a26f-099429745880 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=58d4492e-8d39-43dd-960f-b72be1cb1fa6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2411535 May 12 15:07:34.354626 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-71f13f57-9bce-474b-80e9-5398b7e75e96 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=53152455e02f47c5956394392ccbe6cf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4539094 May 12 15:07:34.356569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71f13f57-9bce-474b-80e9-5398b7e75e96 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e5df83ea-324c-4b10-b699-d032b9f4a120,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:34.359245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47192) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:34.385091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24bf5303-239e-4fd6-98d4-a85b144a029a req-d442874f-f9da-438c-a4dd-1d5da7a263bc tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:34.386713 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24bf5303-239e-4fd6-98d4-a85b144a029a req-d442874f-f9da-438c-a4dd-1d5da7a263bc tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d133fcd-1e60-426e-bc49-2d93dc68083f HTTP/1.1" status: 200 len: 946 time: 0.5870404 May 12 15:07:34.428905 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04440fb2-af8a-4e72-99a5-5ba9661441c2 req-4e1f5d59-1124-4b54-9861-b5fc57162e9e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1082120 May 12 15:07:34.435654 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-227a9160-6b6c-4e87-8834-1ab637e64a24 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:34.469910 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-227a9160-6b6c-4e87-8834-1ab637e64a24 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:34.482266 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24bf5303-239e-4fd6-98d4-a85b144a029a req-a49bf55e-a1e3-4f24-8d84-52e05b3f06d9 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/security-groups?id=58d4492e-8d39-43dd-960f-b72be1cb1fa6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0861466 May 12 15:07:34.488114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-2a278813-d654-4114-b6a6-6368a0ff9685 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:34.490018 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-2a278813-d654-4114-b6a6-6368a0ff9685 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 1094 time: 0.3449707 May 12 15:07:34.562737 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-227a9160-6b6c-4e87-8834-1ab637e64a24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:34.583822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-227a9160-6b6c-4e87-8834-1ab637e64a24 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5df83ea-324c-4b10-b699-d032b9f4a120,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:34.592260 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-227a9160-6b6c-4e87-8834-1ab637e64a24 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:34.594160 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-227a9160-6b6c-4e87-8834-1ab637e64a24 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e5df83ea-324c-4b10-b699-d032b9f4a120 HTTP/1.1" status: 204 len: 168 time: 0.2334888 May 12 15:07:34.649833 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-59954a68-1d8f-45e6-b341-1a372c2289b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:06:02Z', 'revision_number': 4, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port': {'id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:d5:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:05:54Z', 'updated_at': '2022-05-12T15:06:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ecb0a857-94c1-4a94-86d7-48852d7f953f', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'floating_ip_address': '172.25.8.26', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'port_id': '4054de48-da89-4af0-98b0-82ec2255914c', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 462, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'mac_address': 'fa:16:3e:72:83:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:06:58Z', 'updated_at': '2022-05-12T15:07:32Z', 'revision_number': 1, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5547b996-f6f1-4969-9052-5353e51dbe15', 'name': '', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'mac_address': 'fa:16:3e:bf:c0:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:01Z', 'updated_at': '2022-05-12T15:06:16Z', 'revision_number': 5, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'subnets': [{'id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:34.651951 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-68f51fae-fc70-48fd-8ad3-d4e6b6a7cc72'] response: {'name': 'network-changed', 'server_uuid': '86881e13-2515-46d4-a5a5-4bc93a1b8647', 'tag': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127', 'status': 'completed', 'code': 200} May 12 15:07:34.661750 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59954a68-1d8f-45e6-b341-1a372c2289b7 None None] Checking router: fab022ae-aab5-4b4f-a77e-4570d094dd89 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:07:34.671919 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-89ead774-d8e4-495a-8d0d-2b83b517fc77 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 200 len: 217 time: 0.1654058 May 12 15:07:34.693050 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59954a68-1d8f-45e6-b341-1a372c2289b7 None None] Routers {'fab022ae-aab5-4b4f-a77e-4570d094dd89'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:07:34.693804 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-59954a68-1d8f-45e6-b341-1a372c2289b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['fab022ae-aab5-4b4f-a77e-4570d094dd89'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:34.761857 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1c16a709-3fbc-4079-8de4-09992eefeefc'] response: {'name': 'network-changed', 'server_uuid': '5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d', 'tag': '4054de48-da89-4af0-98b0-82ec2255914c', 'status': 'completed', 'code': 200} May 12 15:07:34.867009 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-a7372883-68b8-441f-b324-58ef1c6548a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:34.868506 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-a7372883-68b8-441f-b324-58ef1c6548a9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 1099 time: 0.1730917 May 12 15:07:35.010074 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-59954a68-1d8f-45e6-b341-1a372c2289b7 None None] Set router fab022ae-aab5-4b4f-a77e-4570d094dd89 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:07:35.044536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-d4f2c9b8-fc7b-4e59-a40b-cfec736281ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:35.046728 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-d4f2c9b8-fc7b-4e59-a40b-cfec736281ae service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.1689868 May 12 15:07:35.116437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-f13b2cce-f8fc-4686-b417-5f0b12e76386 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:35.119019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-f13b2cce-f8fc-4686-b417-5f0b12e76386 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.3763626 May 12 15:07:35.143845 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-2d82e2e1-3d89-4a04-8b81-6483646e4bfa service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.253&port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127 HTTP/1.1" status: 200 len: 217 time: 0.0892186 May 12 15:07:35.241803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-c9436fb8-a022-4e33-8acc-133792f81c14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:35.243760 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-c9436fb8-a022-4e33-8acc-133792f81c14 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0942867 May 12 15:07:35.310649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-a683ba3d-dec5-44bc-b131-47b61ba455f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:35.312031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-a683ba3d-dec5-44bc-b131-47b61ba455f3 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 1099 time: 0.6420488 May 12 15:07:35.369251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c69834ab-b273-4a37-aa0d-2c20fffbae30 req-42fb6ae3-b3c6-4bf3-91c1-8f8227c718da tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:35.370800 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c69834ab-b273-4a37-aa0d-2c20fffbae30 req-42fb6ae3-b3c6-4bf3-91c1-8f8227c718da tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 948 time: 0.5105200 May 12 15:07:35.379708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-005020c5-7cf3-46f9-9cf6-7ccddf93d098 req-05702a9c-45bf-4a91-a058-b4ed272b6c6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:35.381334 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-005020c5-7cf3-46f9-9cf6-7ccddf93d098 req-05702a9c-45bf-4a91-a058-b4ed272b6c6c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ff9b9aa97cf84863aedddc5615398c31&device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 1097 time: 0.5127470 May 12 15:07:35.389804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e9df7d9-e57c-46de-90ee-aa3b2ef8ff29 req-b272574a-1bb3-4b5c-ab4d-87ae4ce77665 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:35.399574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e9df7d9-e57c-46de-90ee-aa3b2ef8ff29 req-b272574a-1bb3-4b5c-ab4d-87ae4ce77665 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 943 time: 0.3567934 May 12 15:07:35.435675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-7f38d351-491a-4b07-8acd-d213776f85fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:35.437313 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-7f38d351-491a-4b07-8acd-d213776f85fc service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1816738 May 12 15:07:35.500332 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-59954a68-1d8f-45e6-b341-1a372c2289b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:06:02Z', 'revision_number': 4, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port': {'id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:d5:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:05:54Z', 'updated_at': '2022-05-12T15:06:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ecb0a857-94c1-4a94-86d7-48852d7f953f', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'floating_ip_address': '172.25.8.26', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'port_id': '4054de48-da89-4af0-98b0-82ec2255914c', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 462, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'mac_address': 'fa:16:3e:72:83:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:06:58Z', 'updated_at': '2022-05-12T15:07:32Z', 'revision_number': 1, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5547b996-f6f1-4969-9052-5353e51dbe15', 'name': '', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'mac_address': 'fa:16:3e:bf:c0:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:01Z', 'updated_at': '2022-05-12T15:06:16Z', 'revision_number': 5, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'subnets': [{'id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:35.506252 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59954a68-1d8f-45e6-b341-1a372c2289b7 None None] The sync data for ids ['fab022ae-aab5-4b4f-a77e-4570d094dd89'] in n-d-841483-1 is: [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:06:02Z', 'revision_number': 4, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port': {'id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:d5:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:05:54Z', 'updated_at': '2022-05-12T15:06:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ecb0a857-94c1-4a94-86d7-48852d7f953f', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'floating_ip_address': '172.25.8.26', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'port_id': '4054de48-da89-4af0-98b0-82ec2255914c', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 462, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'mac_address': 'fa:16:3e:72:83:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:06:58Z', 'updated_at': '2022-05-12T15:07:32Z', 'revision_number': 1, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5547b996-f6f1-4969-9052-5353e51dbe15', 'name': '', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'mac_address': 'fa:16:3e:bf:c0:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:01Z', 'updated_at': '2022-05-12T15:06:16Z', 'revision_number': 5, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'subnets': [{'id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:07:35.506525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-e5be309d-e17a-4ba2-a806-a9ffd82abb16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:35.507753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-e5be309d-e17a-4ba2-a806-a9ffd82abb16 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3760664 May 12 15:07:35.701704 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-130503c7-baf5-41f0-be29-f3dac06d5aa7 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2567708 May 12 15:07:35.754806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e9df7d9-e57c-46de-90ee-aa3b2ef8ff29 req-14ace31b-438c-4303-b282-a0dddb166fd1 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3529968 May 12 15:07:35.802373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c69834ab-b273-4a37-aa0d-2c20fffbae30 req-e4dbab91-6373-4dfe-88d5-4206879b26e3 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3960030 May 12 15:07:35.878818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-faaa7914-59ef-4e91-b077-7c6a439f9875 None None] New status for floating IP ecb0a857-94c1-4a94-86d7-48852d7f953f: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:07:35.883081 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-90a46f73-940f-4fcf-95a1-214d05109764 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1729193 May 12 15:07:35.890624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47226) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:35.899597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-18955622-113e-4cbb-803a-77267ac0d7d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:35.901049 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-18955622-113e-4cbb-803a-77267ac0d7d3 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.5748818 May 12 15:07:36.005130 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-9ebac6fc-efc8-476a-a5e6-86484ab09801 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.253&port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127 HTTP/1.1" status: 200 len: 217 time: 0.0879719 May 12 15:07:36.009667 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-f265f0d0-3a89-49a0-b5bf-67bef5a4facc service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4806318 May 12 15:07:36.012376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-005020c5-7cf3-46f9-9cf6-7ccddf93d098 req-e255aa50-3914-4a95-8e8a-df6285bc39f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:36.013765 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-005020c5-7cf3-46f9-9cf6-7ccddf93d098 req-e255aa50-3914-4a95-8e8a-df6285bc39f6 service neutron] 10.222.0.76 "GET /v2.0/networks?id=4c945198-2daa-4ae0-a8c1-07ee6da52271 HTTP/1.1" status: 200 len: 915 time: 0.6050496 May 12 15:07:36.373170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-2730159c-5634-4ba7-983e-5330b6c18001 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:36.374568 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-2730159c-5634-4ba7-983e-5330b6c18001 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3278122 May 12 15:07:36.446662 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-005020c5-7cf3-46f9-9cf6-7ccddf93d098 req-f50bd112-fb50-4625-a7c0-447a1b53665e service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=4054de48-da89-4af0-98b0-82ec2255914c HTTP/1.1" status: 200 len: 999 time: 0.4016752 May 12 15:07:36.533587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6a245a3-84b1-4500-bb68-2e803dd5be1d req-047b5598-77c0-477e-989e-f7adaffae57b service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5130234 May 12 15:07:36.575961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d77e6b-08e0-4343-8e89-1ec8f910e776 req-a57c5d6a-297c-401a-91f7-95edb2f53900 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:36.583770 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63d77e6b-08e0-4343-8e89-1ec8f910e776 req-a57c5d6a-297c-401a-91f7-95edb2f53900 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 946 time: 0.5398967 May 12 15:07:36.589300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-005020c5-7cf3-46f9-9cf6-7ccddf93d098 req-461f8cc9-9a60-4d29-8e45-e0e253ca3612 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:36.590186 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-005020c5-7cf3-46f9-9cf6-7ccddf93d098 req-461f8cc9-9a60-4d29-8e45-e0e253ca3612 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=3ef83b9d-c5b9-4653-9e37-725af3b0ea4c HTTP/1.1" status: 200 len: 853 time: 0.1159968 May 12 15:07:36.598301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9023a711-f29b-4c49-94fd-c66ee9e084ba req-3298488b-8f92-476b-a354-47be495dd7df tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:36.599715 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9023a711-f29b-4c49-94fd-c66ee9e084ba req-3298488b-8f92-476b-a354-47be495dd7df tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d133fcd-1e60-426e-bc49-2d93dc68083f HTTP/1.1" status: 200 len: 946 time: 0.3602180 May 12 15:07:36.751637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'tag': '9015ad2b-bc53-4425-beb5-9a5e82176b06'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:36.753645 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b0076b1c-23bc-4784-b522-2541c13d56fd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:36.811243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-3384c3aa-c5e2-4294-9cc5-50fd87c538b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:36.812741 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-3384c3aa-c5e2-4294-9cc5-50fd87c538b9 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.4294558 May 12 15:07:36.892955 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63d77e6b-08e0-4343-8e89-1ec8f910e776 req-b335f547-a038-43a1-825a-545e20b59013 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3081167 May 12 15:07:36.973140 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9023a711-f29b-4c49-94fd-c66ee9e084ba req-cfb5569c-4a56-4475-8db4-4aeb5bc9ded3 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/security-groups?id=58d4492e-8d39-43dd-960f-b72be1cb1fa6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3585541 May 12 15:07:37.054969 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-005020c5-7cf3-46f9-9cf6-7ccddf93d098 req-48512a45-7360-4a0c-a63b-283b5b08f7c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:37.056680 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-005020c5-7cf3-46f9-9cf6-7ccddf93d098 req-48512a45-7360-4a0c-a63b-283b5b08f7c1 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=4c945198-2daa-4ae0-a8c1-07ee6da52271&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4560003 May 12 15:07:37.107287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 8a33daa6-587f-4787-befb-2fa6e1051f2c details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:07:37.274083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b0076b1c-23bc-4784-b522-2541c13d56fd admin admin] Deleting port e6cd121a-66ed-439d-82b8-4e9ff7955245 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:07:37.274645 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b0076b1c-23bc-4784-b522-2541c13d56fd admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:37.358054 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-005020c5-7cf3-46f9-9cf6-7ccddf93d098 req-e91deb6e-6c2c-4b88-813a-c286fee6e3b2 service neutron] 10.222.0.76 "GET /v2.0/networks/4c945198-2daa-4ae0-a8c1-07ee6da52271?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2929273 May 12 15:07:37.360571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-b05a5131-dac3-4109-bbc0-7518590f0f34 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:37.363507 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-b05a5131-dac3-4109-bbc0-7518590f0f34 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31&tenant_id=1b3825228b0e4c42a381540b66ea23d6&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1097 time: 0.5273147 May 12 15:07:37.365743 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-f62a5633-7381-4673-9d2f-188a26f83c9d service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5290976 May 12 15:07:37.466608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h2-841483-1'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:37.545362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:37.580723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 8a33daa6-587f-4787-befb-2fa6e1051f2c has no active binding in host n-h2-841483-1 {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:142}} May 12 15:07:37.582237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b6035326-cd91-47d7-8a65-cc2dd3d1d127 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:07:37.731578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-b0076b1c-23bc-4784-b522-2541c13d56fd admin admin] For port e6cd121a-66ed-439d-82b8-4e9ff7955245, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e6cd121a-66ed-439d-82b8-4e9ff7955245,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:37.732339 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b0076b1c-23bc-4784-b522-2541c13d56fd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:37.896420 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a9335800-8ebb-486f-a19c-ff4795fad6e7'] response: {'name': 'network-changed', 'server_uuid': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'tag': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'status': 'completed', 'code': 200} May 12 15:07:37.929315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b6035326-cd91-47d7-8a65-cc2dd3d1d127, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:37.985185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127', 'mac_address': 'fa:16:3e:c5:48:dd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.253'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:07:38.047401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b0076b1c-23bc-4784-b522-2541c13d56fd admin admin] Calling delete_port for e6cd121a-66ed-439d-82b8-4e9ff7955245 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:07:38.135420 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:38.157723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b6035326-cd91-47d7-8a65-cc2dd3d1d127 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:07:38.182533 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b6035326-cd91-47d7-8a65-cc2dd3d1d127, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:38.192041 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:38.297841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=b6035326-cd91-47d7-8a65-cc2dd3d1d127,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:38.462018 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:38.545939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['b6035326-cd91-47d7-8a65-cc2dd3d1d127'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:07:38.611424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-005020c5-7cf3-46f9-9cf6-7ccddf93d098 req-49a41bf3-7ff6-4725-bdf6-945d7e99266a service neutron] 10.222.0.76 "GET /v2.0/networks/4c945198-2daa-4ae0-a8c1-07ee6da52271?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.2355270 May 12 15:07:38.639459 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee14bc7a-f531-4597-a106-31ef0f9bf53e req-b7beea83-acc1-403f-b198-5fdcbb63f16c service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.1881073 May 12 15:07:38.693901 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b0076b1c-23bc-4784-b522-2541c13d56fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:38.758734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0076b1c-23bc-4784-b522-2541c13d56fd admin admin] Pushing event deleted for resources: {'Port': ['ID=e6cd121a-66ed-439d-82b8-4e9ff7955245,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:38.848405 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-886e34cb-3058-4f37-9b43-28aa13cf8f46 req-0eeab093-3b8a-42fa-8a26-f592c361ca21 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:38.850046 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-886e34cb-3058-4f37-9b43-28aa13cf8f46 req-0eeab093-3b8a-42fa-8a26-f592c361ca21 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 949 time: 0.5404878 May 12 15:07:38.852030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95cc2f4-9df3-4752-917a-5c01c77ce061 req-6397bc9a-850e-47a9-9825-9b612d3be192 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:38.853488 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d95cc2f4-9df3-4752-917a-5c01c77ce061 req-6397bc9a-850e-47a9-9825-9b612d3be192 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 1094 time: 0.9542887 May 12 15:07:38.938350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cec2ecd8-21cc-4a52-9812-1478104b1780 req-6dd6e5d1-e5b3-4a61-8e55-9e8316235272 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:38.939840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cec2ecd8-21cc-4a52-9812-1478104b1780 req-6dd6e5d1-e5b3-4a61-8e55-9e8316235272 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 943 time: 1.0557725 May 12 15:07:39.150111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b0076b1c-23bc-4784-b522-2541c13d56fd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:39.198511 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-886e34cb-3058-4f37-9b43-28aa13cf8f46 req-a61b8850-5049-4737-893b-622caaf377fc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3345096 May 12 15:07:39.238954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:39.273734 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cec2ecd8-21cc-4a52-9812-1478104b1780 req-e16089ff-64df-4d2a-a84c-13467dbfbfdc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2762933 May 12 15:07:39.305613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20d0cdb1-a980-4677-a2de-6f5eac5d095e req-5e5f773f-6efa-4ab8-806a-9746a557df05 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.5076568 May 12 15:07:39.307891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95cc2f4-9df3-4752-917a-5c01c77ce061 req-65a37922-2f9c-4ec0-98c6-1960c7ea2378 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:39.309550 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d95cc2f4-9df3-4752-917a-5c01c77ce061 req-65a37922-2f9c-4ec0-98c6-1960c7ea2378 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.4260960 May 12 15:07:39.458712 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d95cc2f4-9df3-4752-917a-5c01c77ce061 req-3c3054c4-8f77-4a3d-ab10-c55a0caa7bb1 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 200 len: 217 time: 0.1368067 May 12 15:07:39.572749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:07:39.587588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b0076b1c-23bc-4784-b522-2541c13d56fd admin admin] Router 272668a4-245d-4021-b26c-456bc892016b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:07:39.617756 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:07:39.703916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95cc2f4-9df3-4752-917a-5c01c77ce061 req-ff7acd5c-bac4-4a3e-8a45-bef5f00236d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:39.705333 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d95cc2f4-9df3-4752-917a-5c01c77ce061 req-ff7acd5c-bac4-4a3e-8a45-bef5f00236d8 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.1821337 May 12 15:07:39.719415 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:39.775367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b0076b1c-23bc-4784-b522-2541c13d56fd admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:07:39.778298 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:39.788646 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6d0d342-38d0-461e-b099-5a3741aee148 None None] Sync routers for ids ['272668a4-245d-4021-b26c-456bc892016b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:07:39.790598 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b0076b1c-23bc-4784-b522-2541c13d56fd admin admin] 10.222.0.82 "PUT /v2.0/routers/272668a4-245d-4021-b26c-456bc892016b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8988323 May 12 15:07:39.791221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47276) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:39.798657 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6d0d342-38d0-461e-b099-5a3741aee148 None None] Routers {'272668a4-245d-4021-b26c-456bc892016b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:07:39.800550 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d6d0d342-38d0-461e-b099-5a3741aee148 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['272668a4-245d-4021-b26c-456bc892016b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:39.832715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d0cdb1-a980-4677-a2de-6f5eac5d095e req-16904efb-10cf-46c8-8304-58d0481a7465 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:39.834213 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20d0cdb1-a980-4677-a2de-6f5eac5d095e req-16904efb-10cf-46c8-8304-58d0481a7465 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 1096 time: 0.4312944 May 12 15:07:39.918414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c16773f3-58ee-4af2-a29d-d343b8561a31', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8a33daa6-587f-4787-befb-2fa6e1051f2c'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:39.930508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c935ac8-c4f3-4c0f-b0de-96dda0787408 req-7a83db67-8833-426a-90fc-a67cce176233 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:39.931941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c935ac8-c4f3-4c0f-b0de-96dda0787408 req-7a83db67-8833-426a-90fc-a67cce176233 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.4863849 May 12 15:07:39.967531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74554c3b-6405-4e62-bd86-9961422ab752 req-596cc5e8-05d9-4959-8e61-932aaf70f5b3 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:39.969319 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74554c3b-6405-4e62-bd86-9961422ab752 req-596cc5e8-05d9-4959-8e61-932aaf70f5b3 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 946 time: 0.5154135 May 12 15:07:39.980765 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:39.992010 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d6d0d342-38d0-461e-b099-5a3741aee148 None None] Set router 272668a4-245d-4021-b26c-456bc892016b gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:07:40.153561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Pushing event updated for resources: {'Port': ['ID=8a33daa6-587f-4787-befb-2fa6e1051f2c,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:40.163588 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:40.175791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] Deleting port 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:07:40.176183 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:40.220476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74554c3b-6405-4e62-bd86-9961422ab752 req-021d2775-9d4d-404c-9155-3f94dd78aac4 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2390921 May 12 15:07:40.225202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Attempting to bind port 8a33daa6-587f-4787-befb-2fa6e1051f2c on host n-h1-841483-1 for vnic_type normal with profile {"migrating_to": "n-h2-841483-1"} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:07:40.225202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Attempting to bind port 8a33daa6-587f-4787-befb-2fa6e1051f2c by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:07:40.225202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Attempting to bind port 8a33daa6-587f-4787-befb-2fa6e1051f2c on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:40.237537 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c935ac8-c4f3-4c0f-b0de-96dda0787408 req-6083d43b-0092-45e5-836f-57ee5b279018 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2666595 May 12 15:07:40.297723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d0cdb1-a980-4677-a2de-6f5eac5d095e req-46870f3e-3052-4236-9b48-7b51feaa651d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:40.297723 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20d0cdb1-a980-4677-a2de-6f5eac5d095e req-46870f3e-3052-4236-9b48-7b51feaa651d service neutron] 10.222.0.76 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.3802722 May 12 15:07:40.303986 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Port 8a33daa6-587f-4787-befb-2fa6e1051f2c on network 95dd1383-efe7-494d-a1ab-57e293da83a3 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:07:40.304305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Attempting to bind port 8a33daa6-587f-4787-befb-2fa6e1051f2c on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:40.319693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 7, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:07:40.320027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Checking segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:07:40.320412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Bound using segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:07:40.320904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Bound port: 8a33daa6-587f-4787-befb-2fa6e1051f2c, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:07:40.321240 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:40.342802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95cc2f4-9df3-4752-917a-5c01c77ce061 req-24d5836a-59b6-4add-96a3-b1ce092fa6f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:40.344272 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d95cc2f4-9df3-4752-917a-5c01c77ce061 req-24d5836a-59b6-4add-96a3-b1ce092fa6f4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.6287417 May 12 15:07:40.350227 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d6d0d342-38d0-461e-b099-5a3741aee148 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:07:38Z', 'revision_number': 5, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port': {'id': '4633083f-cafe-447b-9cf2-a0a5ac5b5c67', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '272668a4-245d-4021-b26c-456bc892016b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:06Z', 'updated_at': '2022-05-12T15:04:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:40.364572 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6d0d342-38d0-461e-b099-5a3741aee148 None None] Checking router: 272668a4-245d-4021-b26c-456bc892016b for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:07:40.386443 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6d0d342-38d0-461e-b099-5a3741aee148 None None] Routers {'272668a4-245d-4021-b26c-456bc892016b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:07:40.387786 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d6d0d342-38d0-461e-b099-5a3741aee148 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['272668a4-245d-4021-b26c-456bc892016b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:40.456984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9015ad2b-bc53-4425-beb5-9a5e82176b06 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:07:40.458274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] For port 4633083f-cafe-447b-9cf2-a0a5ac5b5c67, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4633083f-cafe-447b-9cf2-a0a5ac5b5c67,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:40.458637 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:40.474369 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20d0cdb1-a980-4677-a2de-6f5eac5d095e req-4e3c291b-07e0-4767-aee0-2b9fd1bc1323 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d7e09d66-2268-48c4-a658-ef10261e7a46 HTTP/1.1" status: 200 len: 217 time: 0.1603677 May 12 15:07:40.601028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9015ad2b-bc53-4425-beb5-9a5e82176b06, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:40.630920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'port_id': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'mac_address': 'fa:16:3e:79:97:ed', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 565, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:07:40.694604 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d6d0d342-38d0-461e-b099-5a3741aee148 None None] Set router 272668a4-245d-4021-b26c-456bc892016b gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:07:40.697146 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-674273e9-aebd-4619-8987-963df3b9ceaa'] response: {'server_uuid': 'c16773f3-58ee-4af2-a29d-d343b8561a31', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8a33daa6-587f-4787-befb-2fa6e1051f2c', 'code': 200} May 12 15:07:40.734856 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:40.780154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9015ad2b-bc53-4425-beb5-9a5e82176b06 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:07:40.802609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9015ad2b-bc53-4425-beb5-9a5e82176b06, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:40.808557 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:40.886505 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d6d0d342-38d0-461e-b099-5a3741aee148 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:07:40Z', 'revision_number': 6, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:40.900653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] Calling delete_port for 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:07:40.903216 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6d0d342-38d0-461e-b099-5a3741aee148 None None] The sync data for ids ['272668a4-245d-4021-b26c-456bc892016b'] in n-d-841483-1 is: [{'id': '272668a4-245d-4021-b26c-456bc892016b', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1063739643-router', 'tenant_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:05Z', 'updated_at': '2022-05-12T15:07:40Z', 'revision_number': 6, 'project_id': '38c07c88d2f84b29a9ae8c83558ec74b', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:07:40.903756 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=9015ad2b-bc53-4425-beb5-9a5e82176b06,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:40.970851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d0cdb1-a980-4677-a2de-6f5eac5d095e req-046d1777-44cb-480a-9c15-578fba783eae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:40.973096 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20d0cdb1-a980-4677-a2de-6f5eac5d095e req-046d1777-44cb-480a-9c15-578fba783eae service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.3032522 May 12 15:07:41.048290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:07:41.070352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20d0cdb1-a980-4677-a2de-6f5eac5d095e req-94ab2c97-894c-499e-888d-84258424e60c service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0809519 May 12 15:07:41.084955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:07:41.090530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-6dd7e6a7-9045-4f51-b1ae-2398a343cdf4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:41.092248 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-6dd7e6a7-9045-4f51-b1ae-2398a343cdf4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.84 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647&tenant_id=0da54985cde346e68eeadf965b8bc6d3&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 949 time: 0.2759678 May 12 15:07:41.119863 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:41.123864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b6035326-cd91-47d7-8a65-cc2dd3d1d127 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:07:41.230785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['9015ad2b-bc53-4425-beb5-9a5e82176b06'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:07:41.342255 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port b6035326-cd91-47d7-8a65-cc2dd3d1d127 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:07:41.384383 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-684c0856-5e21-4eb2-b0ef-356274997f13 service neutron] delete failed (client error): The resource could not be found. May 12 15:07:41.385408 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-684c0856-5e21-4eb2-b0ef-356274997f13 service neutron] 10.222.0.84 "DELETE /v2.0/ports/b6035326-cd91-47d7-8a65-cc2dd3d1d127/bindings/n-h1-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.2811546 May 12 15:07:41.390828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port b6035326-cd91-47d7-8a65-cc2dd3d1d127 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:41.391160 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:41.439322 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:41.452240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d95cc2f4-9df3-4752-917a-5c01c77ce061 req-17bcbec5-8389-4e94-a254-81d1ad718ae1 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9767752 May 12 15:07:41.550277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] Pushing event deleted for resources: {'Port': ['ID=4633083f-cafe-447b-9cf2-a0a5ac5b5c67,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:41.648717 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:41.734863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91cba30-4068-467a-b418-d97ae2372f01 req-7bc99118-f4ea-4e22-b935-bebc28f57915 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:41.743285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a91cba30-4068-467a-b418-d97ae2372f01 req-7bc99118-f4ea-4e22-b935-bebc28f57915 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 944 time: 0.8910692 May 12 15:07:41.769255 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:41.808927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86881e13-2515-46d4-a5a5-4bc93a1b8647', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:41.821969 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b6035326-cd91-47d7-8a65-cc2dd3d1d127, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:41.836772 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:41.839909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Pushing event updated for resources: {'Port': ['ID=8a33daa6-587f-4787-befb-2fa6e1051f2c,revision_number=8']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:41.872831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:41.873577 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:41.875554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-479c9983-b6b5-485a-b0dc-fb1fa852bf05 service neutron] 10.222.0.76 "PUT /v2.0/ports/8a33daa6-587f-4787-befb-2fa6e1051f2c HTTP/1.1" status: 200 len: 1122 time: 4.4208975 May 12 15:07:41.879739 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:41.886485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-875c7892-3b5d-47af-9f98-859f9689b289 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:41.890416 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-875c7892-3b5d-47af-9f98-859f9689b289 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 1100 time: 0.3342483 May 12 15:07:41.905331 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:41.922574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20d0cdb1-a980-4677-a2de-6f5eac5d095e req-c80f9639-cec3-4f40-b80d-bf32e90ee395 service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8347223 May 12 15:07:41.944853 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a91cba30-4068-467a-b418-d97ae2372f01 req-416bf627-71bc-4a9a-849d-3ff1693dfbd2 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2006214 May 12 15:07:41.975450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d95cc2f4-9df3-4752-917a-5c01c77ce061 req-1b8334cd-8aad-47cb-a0c5-e342abf7ab5a service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5037634 May 12 15:07:41.977794 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=b6035326-cd91-47d7-8a65-cc2dd3d1d127,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:42.001268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['8a33daa6-587f-4787-befb-2fa6e1051f2c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:07:42.041263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['8a33daa6-587f-4787-befb-2fa6e1051f2c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:07:42.066687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4964729-a97e-400f-a7d3-97533e6b692d req-7657049e-8fff-4008-bcfd-5794c660668a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:42.073707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4964729-a97e-400f-a7d3-97533e6b692d req-7657049e-8fff-4008-bcfd-5794c660668a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 949 time: 0.6261041 May 12 15:07:42.177729 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4964729-a97e-400f-a7d3-97533e6b692d req-e54db0ca-8dea-414d-ade7-8b74c9814ac5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1028554 May 12 15:07:42.198344 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20d0cdb1-a980-4677-a2de-6f5eac5d095e req-14478362-eadf-403c-9d37-e7938244a2cf service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2581635 May 12 15:07:42.311444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:42.313681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] Fanout notify agent at l3_agent the message router_deleted on router 272668a4-245d-4021-b26c-456bc892016b {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:07:42.392634 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:42.394847 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6cde52ab-4f3d-4acf-a2dd-5582fd7261cc admin admin] 10.222.0.82 "DELETE /v2.0/routers/272668a4-245d-4021-b26c-456bc892016b HTTP/1.1" status: 204 len: 168 time: 2.6020665 May 12 15:07:42.397051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47308) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:42.397261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:07:42.468913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-c5bdf49b-db2e-4f11-9b14-ab9d0f5fabf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:42.470445 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-c5bdf49b-db2e-4f11-9b14-ab9d0f5fabf6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.5667577 May 12 15:07:42.488706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9015ad2b-bc53-4425-beb5-9a5e82176b06 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:07:42.525003 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:07:42.525345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4633083f-cafe-447b-9cf2-a0a5ac5b5c67 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:07:42.525793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e6cd121a-66ed-439d-82b8-4e9ff7955245 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:07:42.566374 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-9b36199d-5ee1-4225-a96f-5335d528f90c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.253&port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127 HTTP/1.1" status: 200 len: 217 time: 0.0849559 May 12 15:07:42.586408 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: e6cd121a-66ed-439d-82b8-4e9ff7955245 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:07:42.586603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e6cd121a-66ed-439d-82b8-4e9ff7955245 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:07:42.628246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-625b6d73-6a6f-4259-8fd9-a411ddd3fa62 admin admin] Deleting subnet c0ac6201-c8b1-43a9-a509-5a4ff4e34282 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:07:42.637142 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-625b6d73-6a6f-4259-8fd9-a411ddd3fa62 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:42.652261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-fb58eaeb-514d-4950-9dc9-2f94d0da8622 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:42.654050 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-fb58eaeb-514d-4950-9dc9-2f94d0da8622 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0721290 May 12 15:07:42.666413 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:42.680551 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c351f42c-8ba8-424b-b94a-3b389d0c656b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:42.704656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c16773f3-58ee-4af2-a29d-d343b8561a31', 'tag': '8a33daa6-587f-4787-befb-2fa6e1051f2c'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:42.716313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 9015ad2b-bc53-4425-beb5-9a5e82176b06 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:07:42.724794 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 9015ad2b-bc53-4425-beb5-9a5e82176b06 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:42.725162 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:42.745327 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-625b6d73-6a6f-4259-8fd9-a411ddd3fa62 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:42.773735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-682740ff-de42-4249-bf71-3507fa3fbee7 req-27fbc722-6933-4295-b49b-21ef4e892fc8 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:42.775602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-682740ff-de42-4249-bf71-3507fa3fbee7 req-27fbc722-6933-4295-b49b-21ef4e892fc8 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.2403777 May 12 15:07:42.786243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-7ddfc323-3c68-4798-a799-ad0026201f6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:42.786712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9906f7-006c-4e57-9b5b-23d419fbddf1 req-b8d5732c-609b-430a-a8d0-d8ab3fb1b5b8 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:42.787893 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-7ddfc323-3c68-4798-a799-ad0026201f6c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1273777 May 12 15:07:42.794317 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cf9906f7-006c-4e57-9b5b-23d419fbddf1 req-b8d5732c-609b-430a-a8d0-d8ab3fb1b5b8 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 944 time: 0.3189645 May 12 15:07:42.864407 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:42.904477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9015ad2b-bc53-4425-beb5-9a5e82176b06, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:42.911450 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:42.957982 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-ac64739f-4eda-43d2-bbdc-f2cb90a76be3 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1599269 May 12 15:07:42.963046 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cf9906f7-006c-4e57-9b5b-23d419fbddf1 req-901c30f5-fec9-4c67-94ea-d1ea3e91a4bd tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1676195 May 12 15:07:43.004450 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=9015ad2b-bc53-4425-beb5-9a5e82176b06,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:43.008641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-682740ff-de42-4249-bf71-3507fa3fbee7 req-13c39166-f639-4d58-bf57-7c7f6b8cba03 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2114577 May 12 15:07:43.041257 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-625b6d73-6a6f-4259-8fd9-a411ddd3fa62 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:43.105119 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7dd74326-fb7b-494a-b920-26648bcc16a8'] response: {'name': 'network-changed', 'server_uuid': 'c16773f3-58ee-4af2-a29d-d343b8561a31', 'tag': '8a33daa6-587f-4787-befb-2fa6e1051f2c', 'status': 'completed', 'code': 200} May 12 15:07:43.152401 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-487ba5ba-f3ee-45a1-ae1b-ff6c6576a2fe'] response: {'server_uuid': '86881e13-2515-46d4-a5a5-4bc93a1b8647', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127', 'code': 200} May 12 15:07:43.163459 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-625b6d73-6a6f-4259-8fd9-a411ddd3fa62 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:43.234895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-625b6d73-6a6f-4259-8fd9-a411ddd3fa62 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c0ac6201-c8b1-43a9-a509-5a4ff4e34282,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:43.242293 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19573ddd-a64e-4cbf-b1e0-7b3ae680af12 None None] Network feb95830-c0c2-46c0-bb35-f2f43605e79a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:07:43.266970 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-625b6d73-6a6f-4259-8fd9-a411ddd3fa62 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:43.362526 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2aab8aa-b67a-4573-9d4a-78fbc9da1ed5 req-e9ba3d66-678a-43a2-9469-c14c9d9a48f2 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3971796 May 12 15:07:43.367318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-625b6d73-6a6f-4259-8fd9-a411ddd3fa62 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/c0ac6201-c8b1-43a9-a509-5a4ff4e34282 HTTP/1.1" status: 204 len: 168 time: 0.9691391 May 12 15:07:43.369780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47322) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:43.443236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03e1bec4-d2fd-4b47-920e-51c31ad0b0e3 req-df056d9f-3749-492f-bcac-6b532c08a101 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:43.444691 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03e1bec4-d2fd-4b47-920e-51c31ad0b0e3 req-df056d9f-3749-492f-bcac-6b532c08a101 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 1125 time: 0.2110362 May 12 15:07:43.460936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543e6458-c0fa-4675-826f-2f3f0164fa51 req-f683084f-df7d-44b7-9a9a-b08580cf1dee tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:43.480673 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-543e6458-c0fa-4675-826f-2f3f0164fa51 req-f683084f-df7d-44b7-9a9a-b08580cf1dee tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 945 time: 0.2038622 May 12 15:07:43.577123 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:43.594127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Deleting port 8d03477f-5238-44f5-8861-02a9c691b0d1 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:07:43.594719 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:43.671078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6bc35702-6d75-4c70-875b-a677198a41e2 None None] DHCP port deletion for feb95830-c0c2-46c0-bb35-f2f43605e79a request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:07:43.677129 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6bc35702-6d75-4c70-875b-a677198a41e2 None None] Deleting port 8d03477f-5238-44f5-8861-02a9c691b0d1 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:07:43.677667 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6bc35702-6d75-4c70-875b-a677198a41e2 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:43.685958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-543e6458-c0fa-4675-826f-2f3f0164fa51 req-7a33b9a3-a49c-4b0a-8c95-8d0cfc591b50 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2044320 May 12 15:07:43.782156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03e1bec4-d2fd-4b47-920e-51c31ad0b0e3 req-cd9dcfb3-9157-4e64-af02-47d25b5212a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:43.783558 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03e1bec4-d2fd-4b47-920e-51c31ad0b0e3 req-cd9dcfb3-9157-4e64-af02-47d25b5212a7 service neutron] 10.222.0.84 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.2952807 May 12 15:07:43.794375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e242f21d-6b68-4ab5-824e-2b796222a20e req-8086ab83-a030-418f-98b3-e7623f205239 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:43.801982 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e242f21d-6b68-4ab5-824e-2b796222a20e req-8086ab83-a030-418f-98b3-e7623f205239 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.3117328 May 12 15:07:43.884888 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] For port 8d03477f-5238-44f5-8861-02a9c691b0d1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=8d03477f-5238-44f5-8861-02a9c691b0d1,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:43.885346 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:43.986583 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03e1bec4-d2fd-4b47-920e-51c31ad0b0e3 req-1c486e52-e350-44b1-89cd-f9e5284339a4 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c HTTP/1.1" status: 200 len: 217 time: 0.1820102 May 12 15:07:44.044758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-6bc35702-6d75-4c70-875b-a677198a41e2 None None] For port 8d03477f-5238-44f5-8861-02a9c691b0d1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=8d03477f-5238-44f5-8861-02a9c691b0d1,segment=NetworkSegment(d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e),segment_id=d6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:44.045377 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6bc35702-6d75-4c70-875b-a677198a41e2 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:44.061899 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e242f21d-6b68-4ab5-824e-2b796222a20e req-980ca7a7-3fb8-4957-9678-d0fec197d42c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2581120 May 12 15:07:44.107512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Calling delete_port for 8d03477f-5238-44f5-8861-02a9c691b0d1 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:07:44.113198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03e1bec4-d2fd-4b47-920e-51c31ad0b0e3 req-cbde2276-8d12-4aa2-8d5d-adefd22dc40d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:44.115261 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03e1bec4-d2fd-4b47-920e-51c31ad0b0e3 req-cbde2276-8d12-4aa2-8d5d-adefd22dc40d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.1158977 May 12 15:07:44.216133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03e1bec4-d2fd-4b47-920e-51c31ad0b0e3 req-7717e161-82cd-425e-9a54-d27b1b3a53f2 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0933695 May 12 15:07:44.270326 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:44.305308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6bc35702-6d75-4c70-875b-a677198a41e2 None None] Calling delete_port for 8d03477f-5238-44f5-8861-02a9c691b0d1 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:07:44.337053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Pushing event deleted for resources: {'Port': ['ID=8d03477f-5238-44f5-8861-02a9c691b0d1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:44.343679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] No DVR routers for this DVR port 8d03477f-5238-44f5-8861-02a9c691b0d1 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:07:44.353561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8d03477f-5238-44f5-8861-02a9c691b0d1 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:07:44.402625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 8d03477f-5238-44f5-8861-02a9c691b0d1 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:07:44.402980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8d03477f-5238-44f5-8861-02a9c691b0d1 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:07:44.488953 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:44.525971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Subscribe: > segment before_delete 55550000 {{(pid=88151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:07:44.527017 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=88151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:07:44.528077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=88151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:07:44.528077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Subscribe: > port after_create 55550000 {{(pid=88151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:07:44.528455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Subscribe: > port after_delete 55550000 {{(pid=88151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:07:44.528919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Subscribe: > port after_update 55550000 {{(pid=88151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:07:44.529255 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Subscribe: > segment after_delete 55550000 {{(pid=88151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:07:44.529763 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Subscribe: > subnet after_create 55550000 {{(pid=88151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:07:44.530110 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=88151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:07:44.530426 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Subscribe: > subnet after_update 55550000 {{(pid=88151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:07:44.543384 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-6bc35702-6d75-4c70-875b-a677198a41e2 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:07:44.543725 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-6bc35702-6d75-4c70-875b-a677198a41e2 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:07:44.561606 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03e1bec4-d2fd-4b47-920e-51c31ad0b0e3 req-460ff551-2243-4b71-9f81-e44e95b6889e service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2480655 May 12 15:07:44.570952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f5a8e8-2f27-4ce1-9d0f-ef6425533b48 req-5c84559a-cb1f-469e-a96e-a9eb6405972a tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:44.572255 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05f5a8e8-2f27-4ce1-9d0f-ef6425533b48 req-5c84559a-cb1f-469e-a96e-a9eb6405972a tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 944 time: 0.2541053 May 12 15:07:44.665962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-803cd801-9e21-4330-82d1-87f97d3b8734 req-b8b516c2-5480-48a3-8731-fea9f61044db tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:44.667383 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-803cd801-9e21-4330-82d1-87f97d3b8734 req-b8b516c2-5480-48a3-8731-fea9f61044db tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.4574552 May 12 15:07:44.700660 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Subscribe: > subnet after_create 55550000 {{(pid=88151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:07:44.701156 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=88151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:07:44.701612 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Subscribe: > subnet before_create 55550000 {{(pid=88151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:07:44.702058 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Subscribe: > subnet before_update 55550000 {{(pid=88151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:07:44.703816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['feb95830-c0c2-46c0-bb35-f2f43605e79a']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:44.718564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:44.718939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd6cd4af7-d4d4-4e58-ab3e-5ff37b8db34e') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:44.731904 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:44.756124 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05f5a8e8-2f27-4ce1-9d0f-ef6425533b48 req-c7a6835b-1f48-4621-8b47-4bb7c604633a tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1605504 May 12 15:07:44.757745 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:44.769942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Releasing vlan 563 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:07:44.770344 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:44.780538 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0ee4cf9d-8ee6-4101-849b-f3944c3db3f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:44.782517 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-803cd801-9e21-4330-82d1-87f97d3b8734 req-cc6e339a-513d-43d0-b7ec-6a7310128c32 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1050944 May 12 15:07:44.804383 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03e1bec4-d2fd-4b47-920e-51c31ad0b0e3 req-72ec2f3b-3baf-463a-930f-17fc3d07c3a3 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2310221 May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: from cryptography.utils import int_from_bytes May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: from cryptography.utils import int_from_bytes May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/relationships.py:1994: SAWarning: Setting backref / back_populates on relationship QosNetworkPolicyBinding.port to refer to viewonly relationship Port.qos_network_policy_binding should include sync_backref=False set on the QosNetworkPolicyBinding.port relationship. (this warning may be suppressed after 10 occurrences) May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: util.warn_limited( May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/relationships.py:1994: SAWarning: Setting backref / back_populates on relationship Tag.standard_attr to refer to viewonly relationship StandardAttribute.tags should include sync_backref=False set on the Tag.standard_attr relationship. (this warning may be suppressed after 10 occurrences) May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: util.warn_limited( May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: timer() May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:07:44.817625 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:07:44.903775 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:44.928265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:44.935743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] Pushing event deleted for resources: {'Network': ['ID=feb95830-c0c2-46c0-bb35-f2f43605e79a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:44.946566 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4543c25c-8b1b-466f-a8aa-0479758a717d admin admin] 10.222.0.82 "DELETE /v2.0/networks/feb95830-c0c2-46c0-bb35-f2f43605e79a HTTP/1.1" status: 204 len: 168 time: 1.5754023 May 12 15:07:44.949553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47350) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:45.001629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b47b6f51-d2c2-4e30-be05-063983838e14 req-e2f745b0-68e5-4648-ba0e-e24907e75f37 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:45.003931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b47b6f51-d2c2-4e30-be05-063983838e14 req-e2f745b0-68e5-4648-ba0e-e24907e75f37 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 945 time: 0.0989175 May 12 15:07:45.045058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6bc35702-6d75-4c70-875b-a677198a41e2 None None] Deleting port 8d03477f-5238-44f5-8861-02a9c691b0d1 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:07:45.046495 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6bc35702-6d75-4c70-875b-a677198a41e2 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:45.059628 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b47b6f51-d2c2-4e30-be05-063983838e14 req-a4761819-4cf7-40b7-b007-0108543bf280 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420723 May 12 15:07:45.129757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6bc35702-6d75-4c70-875b-a677198a41e2 None None] The port '8d03477f-5238-44f5-8861-02a9c691b0d1' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:07:45.153608 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9015ad2b-bc53-4425-beb5-9a5e82176b06'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:45.219450 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1fc585e0-4462-4b36-8365-73a5fdaa775f'] response: {'server_uuid': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'code': 200} May 12 15:07:45.336354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47362) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:45.349758 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee40d75b-a322-452e-bc90-648b677104bb req-d9802ee7-ebd6-4e38-979a-de20b4e5f7c7 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:45.351183 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee40d75b-a322-452e-bc90-648b677104bb req-d9802ee7-ebd6-4e38-979a-de20b4e5f7c7 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.1278076 May 12 15:07:45.442758 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee40d75b-a322-452e-bc90-648b677104bb req-5aea118e-8bb4-438e-8eb3-3d51d283d582 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547602 May 12 15:07:45.462016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f092605-da6e-43f4-9a0e-655a7ec7facc req-027d5d37-2c49-4735-b316-7e90ef73969b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:45.463540 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4f092605-da6e-43f4-9a0e-655a7ec7facc req-027d5d37-2c49-4735-b316-7e90ef73969b service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 1096 time: 0.1099586 May 12 15:07:45.503304 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77c7d914-f71d-4e94-a867-1d14fb636087 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:45.532708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-77c7d914-f71d-4e94-a867-1d14fb636087 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:45.541209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-77c7d914-f71d-4e94-a867-1d14fb636087 admin admin] Usage tracker for resource:security_group_rule and tenant:777edda1130045f494adaccdd3f47954 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:45.545165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4f092605-da6e-43f4-9a0e-655a7ec7facc req-f3cf793d-6ffb-4b8e-a0e0-6e732f1206f5 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617301 May 12 15:07:45.545993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-77c7d914-f71d-4e94-a867-1d14fb636087 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:45.553470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-77c7d914-f71d-4e94-a867-1d14fb636087 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:45.679656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73425888-1113-490d-b842-9380b1b5dc01 req-47ab064e-68c7-41bc-84d2-f653abf352f8 tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:45.681079 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73425888-1113-490d-b842-9380b1b5dc01 req-47ab064e-68c7-41bc-84d2-f653abf352f8 tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 1101 time: 0.1087246 May 12 15:07:45.688954 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b80e364c-ed61-40cd-94ac-b398fd6b3daa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:45.727000 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77c7d914-f71d-4e94-a867-1d14fb636087 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:45.736831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77c7d914-f71d-4e94-a867-1d14fb636087 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:45.774293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-73425888-1113-490d-b842-9380b1b5dc01 req-e4ae9aaa-4c8b-4f70-925e-02fc126154fb tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] Synchronizing usage tracker for tenant:847be75eb185471bb30da8258939c648 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:07:45.792047 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-77c7d914-f71d-4e94-a867-1d14fb636087 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=777edda1130045f494adaccdd3f47954&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4552231 May 12 15:07:45.798606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47376) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:45.803315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77c7d914-f71d-4e94-a867-1d14fb636087 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b26d7060-7206-4619-a3a2-0175ad527dcb,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:45.839966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-73425888-1113-490d-b842-9380b1b5dc01 req-e4ae9aaa-4c8b-4f70-925e-02fc126154fb tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] Unset dirty status for tenant:847be75eb185471bb30da8258939c648 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:07:45.852651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73425888-1113-490d-b842-9380b1b5dc01 req-e4ae9aaa-4c8b-4f70-925e-02fc126154fb tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1597102 May 12 15:07:45.966250 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:46.006991 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c06a6fa-0ffd-451a-a86c-628975d13a5e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:46.010759 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:46.063241 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c06a6fa-0ffd-451a-a86c-628975d13a5e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:46.088950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b80e364c-ed61-40cd-94ac-b398fd6b3daa admin admin] Deleting port 02954b40-9f4a-4e04-a709-814c598e1c12 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:07:46.089292 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b80e364c-ed61-40cd-94ac-b398fd6b3daa admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:46.126663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a41c56-824d-48b6-846a-495da28139c9 req-5ffd84d5-c9b4-4f61-9e3a-c8dd62c9dd6b tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:46.129269 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10a41c56-824d-48b6-846a-495da28139c9 req-5ffd84d5-c9b4-4f61-9e3a-c8dd62c9dd6b tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 944 time: 0.2124634 May 12 15:07:46.169877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9102dfb6-8185-46d7-9a67-6bb34e46ab71 req-9e000f5c-879f-4467-bf51-e818c17a3e47 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:46.171343 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9102dfb6-8185-46d7-9a67-6bb34e46ab71 req-9e000f5c-879f-4467-bf51-e818c17a3e47 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.1988647 May 12 15:07:46.218735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10a41c56-824d-48b6-846a-495da28139c9 req-a73189ae-6e3f-44bc-b4eb-29d30b1d6cbc tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0827904 May 12 15:07:46.226416 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c06a6fa-0ffd-451a-a86c-628975d13a5e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:46.265345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c06a6fa-0ffd-451a-a86c-628975d13a5e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b26d7060-7206-4619-a3a2-0175ad527dcb,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:46.271165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9102dfb6-8185-46d7-9a67-6bb34e46ab71 req-924c819f-452a-41db-a6a0-053443f658dd tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0894291 May 12 15:07:46.273673 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c06a6fa-0ffd-451a-a86c-628975d13a5e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:46.277770 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4c06a6fa-0ffd-451a-a86c-628975d13a5e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b26d7060-7206-4619-a3a2-0175ad527dcb HTTP/1.1" status: 204 len: 168 time: 0.4781804 May 12 15:07:46.340834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-b80e364c-ed61-40cd-94ac-b398fd6b3daa admin admin] For port 02954b40-9f4a-4e04-a709-814c598e1c12, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=02954b40-9f4a-4e04-a709-814c598e1c12,segment=NetworkSegment(3f66bf84-0862-4ccb-a6ee-6fe3b88a805c),segment_id=3f66bf84-0862-4ccb-a6ee-6fe3b88a805c)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:46.341190 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b80e364c-ed61-40cd-94ac-b398fd6b3daa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:46.484338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6fd092e-f8c4-40dc-b92c-4640c4a28881 req-1024994b-2140-411c-a8ae-11c15d061200 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:46.490087 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6fd092e-f8c4-40dc-b92c-4640c4a28881 req-1024994b-2140-411c-a8ae-11c15d061200 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 945 time: 0.0899270 May 12 15:07:46.492916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b80e364c-ed61-40cd-94ac-b398fd6b3daa admin admin] Calling delete_port for 02954b40-9f4a-4e04-a709-814c598e1c12 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:07:46.567274 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6fd092e-f8c4-40dc-b92c-4640c4a28881 req-4f8dc0a6-61ec-41c6-b9d7-e8213873d299 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0727501 May 12 15:07:46.569314 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265a4241-7909-44b0-8168-e28f324794ca req-ea25323c-be24-4586-a1e2-743c9ac106dd tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=0da54985cde346e68eeadf965b8bc6d3&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0372221 May 12 15:07:46.699432 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b80e364c-ed61-40cd-94ac-b398fd6b3daa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:46.747959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b80e364c-ed61-40cd-94ac-b398fd6b3daa admin admin] Pushing event deleted for resources: {'Port': ['ID=02954b40-9f4a-4e04-a709-814c598e1c12,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:46.855198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265a4241-7909-44b0-8168-e28f324794ca req-7e8d2147-1ae5-4f18-9095-7b2195c7e4f6 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:46.862582 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265a4241-7909-44b0-8168-e28f324794ca req-7e8d2147-1ae5-4f18-9095-7b2195c7e4f6 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2869220 May 12 15:07:46.888767 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265a4241-7909-44b0-8168-e28f324794ca req-72dd3c28-11c8-46a8-952c-a4129db10ec8 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/quotas/0da54985cde346e68eeadf965b8bc6d3 HTTP/1.1" status: 200 len: 375 time: 0.0246274 May 12 15:07:47.023848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265a4241-7909-44b0-8168-e28f324794ca req-1845d76c-0ae4-4f7b-b445-4539ac0aedc0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1340957 May 12 15:07:47.145541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b80e364c-ed61-40cd-94ac-b398fd6b3daa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:47.248990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea81a518-148e-4603-82ff-f0cebdf45cd2 req-2f22c3fd-3eac-4c05-b0df-3eafcda3af58 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 210 time: 0.0553241 May 12 15:07:47.512292 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:47.530657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e806b19-56bd-4174-87d4-8a109d7cd19c req-adc5e8d7-fa67-412b-9152-6af43b91be24 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:47.533215 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e806b19-56bd-4174-87d4-8a109d7cd19c req-adc5e8d7-fa67-412b-9152-6af43b91be24 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 944 time: 0.1505079 May 12 15:07:47.611809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e806b19-56bd-4174-87d4-8a109d7cd19c req-4e888373-75e7-43f7-94cf-4cf697e1c0b0 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710623 May 12 15:07:47.742669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab9fd31-d878-48f1-8045-76e0a1ea19c9 req-4a628224-b780-433d-ac6a-3d712cec54f2 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:47.745527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ab9fd31-d878-48f1-8045-76e0a1ea19c9 req-4a628224-b780-433d-ac6a-3d712cec54f2 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.1079209 May 12 15:07:47.811343 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ab9fd31-d878-48f1-8045-76e0a1ea19c9 req-60320068-4a61-4d8d-9fa5-4c565282ddf5 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0597508 May 12 15:07:47.814692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b80e364c-ed61-40cd-94ac-b398fd6b3daa admin admin] Router 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:07:47.957641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-201121f2-be0c-4818-b042-ff0fcced9aa8 req-3113eeb3-59b2-4eb6-87b0-d3f0966d457e tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:47.959950 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-201121f2-be0c-4818-b042-ff0fcced9aa8 req-3113eeb3-59b2-4eb6-87b0-d3f0966d457e tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 945 time: 0.1061275 May 12 15:07:48.014419 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-201121f2-be0c-4818-b042-ff0fcced9aa8 req-5b146805-32c3-453c-bfae-890a3f6c2eb2 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489974 May 12 15:07:48.039474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b80e364c-ed61-40cd-94ac-b398fd6b3daa admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:07:48.051458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2f3ceda-b6a3-4a7e-b9a8-05b9c6017fdd None None] Sync routers for ids ['5c57748e-d5af-4f2c-b90a-040ede2ad3e6'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:07:48.052939 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b80e364c-ed61-40cd-94ac-b398fd6b3daa admin admin] 10.222.0.82 "PUT /v2.0/routers/5c57748e-d5af-4f2c-b90a-040ede2ad3e6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1021388 May 12 15:07:48.055842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47450) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:48.069913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2f3ceda-b6a3-4a7e-b9a8-05b9c6017fdd None None] Routers {'5c57748e-d5af-4f2c-b90a-040ede2ad3e6'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:07:48.070536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d2f3ceda-b6a3-4a7e-b9a8-05b9c6017fdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:07:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5c57748e-d5af-4f2c-b90a-040ede2ad3e6'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:48.349258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-d2f3ceda-b6a3-4a7e-b9a8-05b9c6017fdd None None] Set router 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:07:48.473373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-521128eb-0a4f-449c-89ea-0aff2179daab req-ac79efea-aaf4-4b29-b298-2a7cce802c36 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 210 time: 0.0948484 May 12 15:07:48.601718 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-74a4e6fc-5a94-4996-be93-1797387dffc7 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.4713521 May 12 15:07:48.629626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:48.676555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265a4241-7909-44b0-8168-e28f324794ca req-13601362-0a72-4704-b198-3956f9f39494 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=0da54985cde346e68eeadf965b8bc6d3&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0389764 May 12 15:07:48.677919 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-4b1c1188-622e-4842-abd5-dc4608c8a3cf service neutron] 10.222.0.84 "GET /v2.0/ports/8a33daa6-587f-4787-befb-2fa6e1051f2c/bindings/n-h2-841483-1 HTTP/1.1" status: 200 len: 384 time: 0.3655009 May 12 15:07:48.678884 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:48.681894 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:48.699501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d2f3ceda-b6a3-4a7e-b9a8-05b9c6017fdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-158859462-router', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10'}], 'enable_snat': True}, 'gw_port_id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:19Z', 'updated_at': '2022-05-12T15:07:46Z', 'revision_number': 5, 'project_id': '22609d3eca554e908455a9f04efb4ffa', 'gw_port': {'id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:6d:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:22Z', 'updated_at': '2022-05-12T15:04:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:48.710658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2f3ceda-b6a3-4a7e-b9a8-05b9c6017fdd None None] Checking router: 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:07:48.729103 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2f3ceda-b6a3-4a7e-b9a8-05b9c6017fdd None None] Routers {'5c57748e-d5af-4f2c-b90a-040ede2ad3e6'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:07:48.729746 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d2f3ceda-b6a3-4a7e-b9a8-05b9c6017fdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:07:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5c57748e-d5af-4f2c-b90a-040ede2ad3e6'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:48.746337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Usage tracker for resource:floatingip and tenant:bad2264067c248e9803d4b1eeb73116d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:48.820556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:48.941319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-d2f3ceda-b6a3-4a7e-b9a8-05b9c6017fdd None None] Set router 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:07:48.942796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:48.968343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47476) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:49.123535 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87cd235d-fbec-4ab6-bb42-c9c7986470f2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:49.140368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-87cd235d-fbec-4ab6-bb42-c9c7986470f2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:49.145626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-87cd235d-fbec-4ab6-bb42-c9c7986470f2 admin admin] Usage tracker for resource:security_group_rule and tenant:d6b809f0ffb14fb4ba4cf2ea1070764e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:49.148358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-87cd235d-fbec-4ab6-bb42-c9c7986470f2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:49.155086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-87cd235d-fbec-4ab6-bb42-c9c7986470f2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:49.172133 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:49.275558 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87cd235d-fbec-4ab6-bb42-c9c7986470f2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:49.284810 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87cd235d-fbec-4ab6-bb42-c9c7986470f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:49.323755 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d2f3ceda-b6a3-4a7e-b9a8-05b9c6017fdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-158859462-router', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10'}], 'enable_snat': True}, 'gw_port_id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:19Z', 'updated_at': '2022-05-12T15:07:46Z', 'revision_number': 5, 'project_id': '22609d3eca554e908455a9f04efb4ffa', 'gw_port': {'id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:6d:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:22Z', 'updated_at': '2022-05-12T15:04:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:49.332200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2f3ceda-b6a3-4a7e-b9a8-05b9c6017fdd None None] The sync data for ids ['5c57748e-d5af-4f2c-b90a-040ede2ad3e6'] in n-d-841483-1 is: [{'id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-158859462-router', 'tenant_id': '22609d3eca554e908455a9f04efb4ffa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10'}], 'enable_snat': True}, 'gw_port_id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:04:19Z', 'updated_at': '2022-05-12T15:07:46Z', 'revision_number': 5, 'project_id': '22609d3eca554e908455a9f04efb4ffa', 'gw_port': {'id': 'b968cd57-4673-4ade-9c43-dda43d9558b7', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:6d:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c57748e-d5af-4f2c-b90a-040ede2ad3e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:04:22Z', 'updated_at': '2022-05-12T15:04:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:07:49.354332 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-87cd235d-fbec-4ab6-bb42-c9c7986470f2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d6b809f0ffb14fb4ba4cf2ea1070764e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3842223 May 12 15:07:49.355403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47484) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:49.356389 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87cd235d-fbec-4ab6-bb42-c9c7986470f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=49e008cc-fc56-4292-ad19-5ab1045bf5b4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:49.390305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265a4241-7909-44b0-8168-e28f324794ca req-4b7c01ed-5f17-40a1-adc6-5e6154526e8f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:49.390305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265a4241-7909-44b0-8168-e28f324794ca req-4b7c01ed-5f17-40a1-adc6-5e6154526e8f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.6529338 May 12 15:07:49.419735 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:49.432535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Request body: {'port': {'device_id': '654cac47-c40b-4d9d-a71f-dbbed18b9333', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '0da54985cde346e68eeadf965b8bc6d3'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:49.441056 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17076cb9-325c-4128-aee0-4d8607ffe2de admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:49.468391 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17076cb9-325c-4128-aee0-4d8607ffe2de admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:49.470659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbd94e59-4f57-42c8-bf0c-9eeb577e9f8c req-b7bbf0a6-bf59-42d4-a0f9-5545703b9b0c tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:49.472979 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbd94e59-4f57-42c8-bf0c-9eeb577e9f8c req-b7bbf0a6-bf59-42d4-a0f9-5545703b9b0c tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 944 time: 0.7051396 May 12 15:07:49.530442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] Deleting port b968cd57-4673-4ade-9c43-dda43d9558b7 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:07:49.530867 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:49.531868 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17076cb9-325c-4128-aee0-4d8607ffe2de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:49.546956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17076cb9-325c-4128-aee0-4d8607ffe2de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=49e008cc-fc56-4292-ad19-5ab1045bf5b4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:49.555307 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17076cb9-325c-4128-aee0-4d8607ffe2de admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:49.556772 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-17076cb9-325c-4128-aee0-4d8607ffe2de admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/49e008cc-fc56-4292-ad19-5ab1045bf5b4 HTTP/1.1" status: 204 len: 168 time: 0.1964052 May 12 15:07:49.851137 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbd94e59-4f57-42c8-bf0c-9eeb577e9f8c req-b232c55c-246f-46ab-a556-98fa4b4dd12e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3282497 May 12 15:07:49.930135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:49.974886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:50.047546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-19467883-0cf0-4a19-9b5f-23d4c9ab8941 service neutron] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:50.077798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] For port b968cd57-4673-4ade-9c43-dda43d9558b7, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b968cd57-4673-4ade-9c43-dda43d9558b7,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:50.078215 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:50.089747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Made reservation on behalf of 0da54985cde346e68eeadf965b8bc6d3 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:07:50.093417 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:50.103359 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:50.240442 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 02954b40-9f4a-4e04-a709-814c598e1c12 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:07:50.277160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-19467883-0cf0-4a19-9b5f-23d4c9ab8941 service neutron] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:07:50.281247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 02954b40-9f4a-4e04-a709-814c598e1c12 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:07:50.282061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 02954b40-9f4a-4e04-a709-814c598e1c12 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:07:50.315772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] Calling delete_port for b968cd57-4673-4ade-9c43-dda43d9558b7 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:07:50.370345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47510) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:50.465733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-19467883-0cf0-4a19-9b5f-23d4c9ab8941 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8a33daa6-587f-4787-befb-2fa6e1051f2c {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:07:50.493916 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8a33daa6-587f-4787-befb-2fa6e1051f2c no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:07:50.498342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Request body: {'network': {'name': 'tempest-InstanceActionsV221TestJSON-1110441853-network', 'tenant_id': '43dcdbeffdc84fb38f8c99a9f1d5c9cc'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:50.507523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:50.512356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Usage tracker for resource:network and tenant:43dcdbeffdc84fb38f8c99a9f1d5c9cc is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:50.516083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:50.524607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:50.571425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Made reservation on behalf of 43dcdbeffdc84fb38f8c99a9f1d5c9cc for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:07:50.574289 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:50.586972 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:50.602297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:50.606410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Usage tracker for resource:security_group_rule and tenant:43dcdbeffdc84fb38f8c99a9f1d5c9cc is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:50.609357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:50.615777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:50.617289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-19467883-0cf0-4a19-9b5f-23d4c9ab8941 service neutron] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:50.712661 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:50.716669 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:50.749778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 562} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:07:50.759186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4849d4e4-8875-4f2c-b148-7a6793bc68a2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:50.766245 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:50.766510 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Added segment bdd0c2de-fa4b-4564-94df-a91528c8916f of type vlan for network 4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c May 12 15:07:50.796511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:50.827160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-997cefc0-8847-4448-b169-799a0a3beba8 req-9f104e55-33e6-45f5-a0b7-fecaaf772e8d tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:50.828599 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:50.828733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-997cefc0-8847-4448-b169-799a0a3beba8 req-9f104e55-33e6-45f5-a0b7-fecaaf772e8d tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.8422871 May 12 15:07:50.829617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:50.830265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:50.861634 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-19467883-0cf0-4a19-9b5f-23d4c9ab8941 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:50.934587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] Pushing event updated for resources: {'Network': ['ID=4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:50.938386 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dff08937-4f10-4ef8-bfe2-7e132f8c9033 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 0.5669172 May 12 15:07:50.942182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47524) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:50.948291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:07:50.948673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Request body: {'subnet': {'network_id': '4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c', 'cidr': '172.20.0.0/28', 'name': 'tempest-InstanceActionsV221TestJSON-1110441853-subnet', 'tenant_id': '43dcdbeffdc84fb38f8c99a9f1d5c9cc', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:50.953644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:50.958876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Usage tracker for resource:subnet and tenant:43dcdbeffdc84fb38f8c99a9f1d5c9cc is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:50.961343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:50.967279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:50.981278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Made reservation on behalf of 43dcdbeffdc84fb38f8c99a9f1d5c9cc for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:07:50.985263 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:51.093982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Allocated IP 192.168.233.141 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/a3c95caf-bb88-467f-88c0-e38ce2f7b5ff) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:07:51.107076 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-997cefc0-8847-4448-b169-799a0a3beba8 req-afaf92c1-5371-4a92-98d2-74fb920bf75e tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2319424 May 12 15:07:51.108157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Allocated IP 172.25.8.73 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/f5c4549f-a189-4498-af4d-65d243cbc3a9) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:07:51.254707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82cd316a-0a61-4c20-ba91-83539fdce5b0 req-2f044090-33a7-4d29-8f15-b914ac1c43ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:51.256194 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-82cd316a-0a61-4c20-ba91-83539fdce5b0 req-2f044090-33a7-4d29-8f15-b914ac1c43ac service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=7413f696702a49c390950b9a967696fa&device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 1101 time: 0.1524076 May 12 15:07:51.349003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-19467883-0cf0-4a19-9b5f-23d4c9ab8941 service neutron] Transition to ACTIVE for port object 8a33daa6-587f-4787-befb-2fa6e1051f2c will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:07:51.373216 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6da251e1-b906-4c0b-90ef-f78878ed59b6 req-ae995ab1-3a46-41d3-8eea-7a60bc748991 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 210 time: 0.0832641 May 12 15:07:51.374299 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-19467883-0cf0-4a19-9b5f-23d4c9ab8941 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:51.398683 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:51.507679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82cd316a-0a61-4c20-ba91-83539fdce5b0 req-31e35ff4-179a-4fa4-9ec8-ef47bffd862c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:51.509202 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-82cd316a-0a61-4c20-ba91-83539fdce5b0 req-31e35ff4-179a-4fa4-9ec8-ef47bffd862c service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.2319531 May 12 15:07:51.509920 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c0f56151-d24d-48be-862b-d25eff2d2fb5,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:51.576831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Checking segment: {'id': 'bdd0c2de-fa4b-4564-94df-a91528c8916f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:07:51.577187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Network hostable DHCP agents. Network: 4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:07:51.583460 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:51.590689 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-82cd316a-0a61-4c20-ba91-83539fdce5b0 req-62e10537-2234-4840-ab9d-4057a8938ddb service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.108&port_id=e5430b6d-6430-4a47-b068-7f891fa37da9 HTTP/1.1" status: 200 len: 217 time: 0.0727658 May 12 15:07:51.654355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Network 4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:07:51.667729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82cd316a-0a61-4c20-ba91-83539fdce5b0 req-54c4e98a-a2e7-4533-be4f-46b2fe318aba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:51.669376 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-82cd316a-0a61-4c20-ba91-83539fdce5b0 req-54c4e98a-a2e7-4533-be4f-46b2fe318aba service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0722609 May 12 15:07:51.673125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:07:51.685610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6fc61bb3-3781-45a5-92da-f6a53e8abe78 None None] Network 4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:07:51.714573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-19467883-0cf0-4a19-9b5f-23d4c9ab8941 service neutron] No DVR routers for this DVR port 8a33daa6-587f-4787-befb-2fa6e1051f2c on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:07:51.786993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19467883-0cf0-4a19-9b5f-23d4c9ab8941 service neutron] Pushing event updated for resources: {'Port': ['ID=8a33daa6-587f-4787-befb-2fa6e1051f2c,revision_number=10']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:51.789949 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:51.858691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:51.859416 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:51.919292 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-70902758-ec42-49fb-86e0-4ddbde162b43 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 0.9698200 May 12 15:07:51.942609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82cd316a-0a61-4c20-ba91-83539fdce5b0 req-45c19fba-75b3-4efa-aad3-31fa366551bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:51.944392 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-82cd316a-0a61-4c20-ba91-83539fdce5b0 req-45c19fba-75b3-4efa-aad3-31fa366551bc service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2680056 May 12 15:07:51.946056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-014fdde1-c24d-467a-a1ae-ee4ab26f955a None None] Network 4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:07:51.965915 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.060605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] Pushing event deleted for resources: {'Port': ['ID=b968cd57-4673-4ade-9c43-dda43d9558b7,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:52.108757 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.129923 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.143888 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.206697 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-82cd316a-0a61-4c20-ba91-83539fdce5b0 req-da6af0f2-90e0-4888-afd8-ffdfbde45044 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2537971 May 12 15:07:52.234789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-19467883-0cf0-4a19-9b5f-23d4c9ab8941 service neutron] 10.222.0.84 "PUT /v2.0/ports/8a33daa6-587f-4787-befb-2fa6e1051f2c/bindings/n-h2-841483-1/activate HTTP/1.1" status: 200 len: 369 time: 3.4891968 May 12 15:07:52.298098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Transition to ACTIVE for port object a3c95caf-bb88-467f-88c0-e38ce2f7b5ff will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:07:52.306326 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.307121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5c57748e-d5af-4f2c-b90a-040ede2ad3e6 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:07:52.328641 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.383460 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-82cd316a-0a61-4c20-ba91-83539fdce5b0 req-09ffc59f-6c8a-4211-989f-1b4fba2eb7f7 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1709487 May 12 15:07:52.411799 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.413255 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-db953548-7993-4aa0-b68e-16aa2bf6f66e admin admin] 10.222.0.82 "DELETE /v2.0/routers/5c57748e-d5af-4f2c-b90a-040ede2ad3e6 HTTP/1.1" status: 204 len: 168 time: 4.3542445 May 12 15:07:52.415658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47548) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:52.489617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-85507676-e87a-4a03-abaf-3b35b21036c8 admin admin] Deleting subnet e47e554d-eb97-4217-b6e3-2120f84b68bf {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:07:52.494186 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85507676-e87a-4a03-abaf-3b35b21036c8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.494428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e5430b6d-6430-4a47-b068-7f891fa37da9 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:07:52.556255 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85507676-e87a-4a03-abaf-3b35b21036c8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.573039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:07:52.581092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:07:52.583967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:07:52.618966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Pushing event updated for resources: {'Port': ['ID=f5c4549f-a189-4498-af4d-65d243cbc3a9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:52.639069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e5430b6d-6430-4a47-b068-7f891fa37da9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e5430b6d-6430-4a47-b068-7f891fa37da9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:52.641719 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.654084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62168aa9-1a89-42ae-a416-4ec83b2ec047 req-da53b3c3-7855-49ae-9c3a-d544140f512d tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:52.654903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['b6035326-cd91-47d7-8a65-cc2dd3d1d127'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:07:52.655567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62168aa9-1a89-42ae-a416-4ec83b2ec047 req-da53b3c3-7855-49ae-9c3a-d544140f512d tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 945 time: 0.4366651 May 12 15:07:52.698906 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85507676-e87a-4a03-abaf-3b35b21036c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.710089 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'e5430b6d-6430-4a47-b068-7f891fa37da9', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'e5430b6d-6430-4a47-b068-7f891fa37da9', 'mac_address': 'fa:16:3e:98:d4:eb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.108'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:07:52.749494 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.779351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85507676-e87a-4a03-abaf-3b35b21036c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.780024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-3d954463-e004-4891-a8c4-0d31dc169998 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:52.781771 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-3d954463-e004-4891-a8c4-0d31dc169998 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31&tenant_id=1b3825228b0e4c42a381540b66ea23d6&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1096 time: 0.4158852 May 12 15:07:52.788547 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.790980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:07:52.792034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Pushing event updated for resources: {'Port': ['ID=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:52.808295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id e5430b6d-6430-4a47-b068-7f891fa37da9 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:07:52.828917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:07:52.851025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e5430b6d-6430-4a47-b068-7f891fa37da9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e5430b6d-6430-4a47-b068-7f891fa37da9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:52.887679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:07:52.887958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85507676-e87a-4a03-abaf-3b35b21036c8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e47e554d-eb97-4217-b6e3-2120f84b68bf,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:52.891519 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.894747 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85507676-e87a-4a03-abaf-3b35b21036c8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.899251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:52.899790 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:52.905222 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-85507676-e87a-4a03-abaf-3b35b21036c8 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/e47e554d-eb97-4217-b6e3-2120f84b68bf HTTP/1.1" status: 204 len: 168 time: 0.4862349 May 12 15:07:52.905663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47552) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:52.944145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62168aa9-1a89-42ae-a416-4ec83b2ec047 req-2e8403cc-052e-49f9-ad69-61ce8c58bc39 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2459102 May 12 15:07:52.967429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7e8db35-6d9c-4e06-b220-95572d508ea3 None None] Network 889f9b5f-a864-4a4d-a337-581795e1561e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:07:53.022159 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.064425 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.089176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Deleting port a78e82c1-0d04-45cd-9962-f5045e508e70 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:07:53.089685 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.125963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265a4241-7909-44b0-8168-e28f324794ca req-4f77e135-f912-43a9-a380-0339fba109bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 3.7080388 May 12 15:07:53.145294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Request body: {'port': {'device_id': '654cac47-c40b-4d9d-a71f-dbbed18b9333', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:53.254017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-684d1876-352c-4625-84d4-3af79fccc6e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:53.255737 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-684d1876-352c-4625-84d4-3af79fccc6e9 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31&tenant_id=1b3825228b0e4c42a381540b66ea23d6 HTTP/1.1" status: 200 len: 1096 time: 0.4347193 May 12 15:07:53.295267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['e5430b6d-6430-4a47-b068-7f891fa37da9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:07:53.389484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=e5430b6d-6430-4a47-b068-7f891fa37da9,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:53.407027 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e672e91d-3e16-4d7c-b34a-e04a72b7724d None None] Provisioning for port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:07:53.417372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] For port a78e82c1-0d04-45cd-9962-f5045e508e70, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a78e82c1-0d04-45cd-9962-f5045e508e70,segment=NetworkSegment(3f66bf84-0862-4ccb-a6ee-6fe3b88a805c),segment_id=3f66bf84-0862-4ccb-a6ee-6fe3b88a805c)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:53.418013 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.429996 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e672e91d-3e16-4d7c-b34a-e04a72b7724d None None] Provisioning complete for port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:53.430296 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e672e91d-3e16-4d7c-b34a-e04a72b7724d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.546800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e672e91d-3e16-4d7c-b34a-e04a72b7724d None None] Port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:07:53.550953 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.555740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Calling delete_port for a78e82c1-0d04-45cd-9962-f5045e508e70 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:07:53.599832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7ed6f01-7fa5-447a-b8a0-fc9d7e162388 None None] DHCP port deletion for 889f9b5f-a864-4a4d-a337-581795e1561e request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:07:53.608983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f7ed6f01-7fa5-447a-b8a0-fc9d7e162388 None None] Deleting port a78e82c1-0d04-45cd-9962-f5045e508e70 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:07:53.609495 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f7ed6f01-7fa5-447a-b8a0-fc9d7e162388 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.637179 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ce0fb5-24f9-4811-ae63-149cb7a71339 req-cbe2c08e-5295-4e6a-93b5-600b6ea477b3 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:53.638981 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2ce0fb5-24f9-4811-ae63-149cb7a71339 req-cbe2c08e-5295-4e6a-93b5-600b6ea477b3 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 949 time: 0.4570181 May 12 15:07:53.652885 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.705964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-91e9d0fa-4536-439a-a6a5-108c051f5b52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:53.707434 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-91e9d0fa-4536-439a-a6a5-108c051f5b52 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 1096 time: 0.3326118 May 12 15:07:53.708245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Pushing event deleted for resources: {'Port': ['ID=a78e82c1-0d04-45cd-9962-f5045e508e70,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:53.712076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] No DVR routers for this DVR port a78e82c1-0d04-45cd-9962-f5045e508e70 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:07:53.715881 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.734498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f7ed6f01-7fa5-447a-b8a0-fc9d7e162388 None None] The port 'a78e82c1-0d04-45cd-9962-f5045e508e70' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:07:53.759795 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.844757 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.879032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['889f9b5f-a864-4a4d-a337-581795e1561e']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:53.890972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3f66bf84-0862-4ccb-a6ee-6fe3b88a805c') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:53.891229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3f66bf84-0862-4ccb-a6ee-6fe3b88a805c') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:07:53.898369 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2ce0fb5-24f9-4811-ae63-149cb7a71339 req-25325165-2654-4026-8b30-9824014c5f3f tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2475741 May 12 15:07:53.902825 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.922483 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.930583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Releasing vlan 583 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:07:53.930979 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.936620 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: timer() May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:07:53.944860 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:07:54.003351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Pushing event updated for resources: {'Port': ['ID=f5c4549f-a189-4498-af4d-65d243cbc3a9,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:54.026913 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:54.028113 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-8de5f4a2-1f02-4fda-a01e-7b1e54557e6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 697 time: 5.4132915 May 12 15:07:54.134010 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:54.161313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Pushing event deleted for resources: {'Network': ['ID=889f9b5f-a864-4a4d-a337-581795e1561e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:54.163310 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:54.182178 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8d53b2fb-2825-4145-97be-0e0b6cbb4953 admin admin] 10.222.0.82 "DELETE /v2.0/networks/889f9b5f-a864-4a4d-a337-581795e1561e HTTP/1.1" status: 204 len: 168 time: 1.2755933 May 12 15:07:54.189367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-f9d47427-0771-425c-bf0b-583efcea0aae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:54.191550 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-f9d47427-0771-425c-bf0b-583efcea0aae service neutron] 10.222.0.76 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.4720590 May 12 15:07:54.201471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-f9d5b391-3370-47f1-a475-82c73f6e930d tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Synchronizing usage tracker for tenant:bad2264067c248e9803d4b1eeb73116d on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:07:54.278027 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-bcab0d69-85ae-4aa0-9b2a-8d39b9a4114d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c HTTP/1.1" status: 200 len: 217 time: 0.0738280 May 12 15:07:54.319634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a78e82c1-0d04-45cd-9962-f5045e508e70 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:07:54.363818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-f9d5b391-3370-47f1-a475-82c73f6e930d tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Unset dirty status for tenant:bad2264067c248e9803d4b1eeb73116d on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:07:54.365206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-f9d5b391-3370-47f1-a475-82c73f6e930d tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.73 HTTP/1.1" status: 200 len: 695 time: 0.2831004 May 12 15:07:54.381832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: a78e82c1-0d04-45cd-9962-f5045e508e70 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:07:54.382179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a78e82c1-0d04-45cd-9962-f5045e508e70 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:07:54.382582 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b968cd57-4673-4ade-9c43-dda43d9558b7 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:07:54.425284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47566) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:54.496225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: b968cd57-4673-4ade-9c43-dda43d9558b7 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:07:54.496560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b968cd57-4673-4ade-9c43-dda43d9558b7 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:07:54.519737 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9780e3c5-e059-4306-83d4-437152cafbae admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=38c07c88d2f84b29a9ae8c83558ec74b&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0889983 May 12 15:07:54.520328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47574) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:54.539081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e5430b6d-6430-4a47-b068-7f891fa37da9 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:07:54.608852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-2296c2b0-542e-40ee-99de-7a82e96f2a38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:54.610321 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-2296c2b0-542e-40ee-99de-7a82e96f2a38 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.3136964 May 12 15:07:54.622118 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0d1ce09-f93f-483b-a469-1bf38d5b82ed admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:54.639006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port e5430b6d-6430-4a47-b068-7f891fa37da9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:07:54.639375 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:54.691708 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0d1ce09-f93f-483b-a469-1bf38d5b82ed admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:54.701433 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-f151182f-8390-4895-af3f-b3c08f1e07d5 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0824749 May 12 15:07:54.780306 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:54.780872 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0d1ce09-f93f-483b-a469-1bf38d5b82ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:54.802850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0d1ce09-f93f-483b-a469-1bf38d5b82ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6c143721-d68a-410c-8943-0e64dbae0dca,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:54.811885 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0d1ce09-f93f-483b-a469-1bf38d5b82ed admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:54.818886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8d278524-0445-4a95-8564-3c04c2f3c41d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e5430b6d-6430-4a47-b068-7f891fa37da9'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:54.841850 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d0d1ce09-f93f-483b-a469-1bf38d5b82ed admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6c143721-d68a-410c-8943-0e64dbae0dca HTTP/1.1" status: 204 len: 168 time: 0.3018069 May 12 15:07:54.843585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e5430b6d-6430-4a47-b068-7f891fa37da9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e5430b6d-6430-4a47-b068-7f891fa37da9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:54.850015 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:54.871977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a3c95caf-bb88-467f-88c0-e38ce2f7b5ff {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:07:54.906880 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:54.923557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-7799c01f-b2c0-496f-bd19-729db85f88f0 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:54.925851 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-7799c01f-b2c0-496f-bd19-729db85f88f0 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.5481899 May 12 15:07:54.935677 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=e5430b6d-6430-4a47-b068-7f891fa37da9,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:55.001472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-cc05c3ef-909b-42d9-9cad-f754a6ccbe52 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:07:55.002467 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e529950-ec08-4445-9d75-fec3bb9d978f req-cc05c3ef-909b-42d9-9cad-f754a6ccbe52 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0205305 May 12 15:07:55.025227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Transition to ACTIVE for port object a3c95caf-bb88-467f-88c0-e38ce2f7b5ff will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:07:55.041000 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:55.185050 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-e3c7c121-a3b9-487a-9631-b004e4f3033b service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4503186 May 12 15:07:55.266832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47598) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:55.350078 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-589bb5c4-b03e-4ee8-8ae2-6ec9918403a0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=22609d3eca554e908455a9f04efb4ffa&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0825088 May 12 15:07:55.352424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47602) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:07:55.392546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Pushing event updated for resources: {'Port': ['ID=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:55.423579 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-502d78f3-2310-4d3f-a03f-8337d5cbc8c8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:55.454546 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-502d78f3-2310-4d3f-a03f-8337d5cbc8c8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:55.457178 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-569e097a-15b9-4448-8deb-a9257ee923a1 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:55.458685 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-569e097a-15b9-4448-8deb-a9257ee923a1 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/networks?id=4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c HTTP/1.1" status: 200 len: 818 time: 0.5977011 May 12 15:07:55.507934 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-313861f1-ee4f-4d46-965d-c209110c8cca tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/quotas/43dcdbeffdc84fb38f8c99a9f1d5c9cc HTTP/1.1" status: 200 len: 375 time: 0.0334740 May 12 15:07:55.512185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Attempting to bind port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:07:55.512508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Attempting to bind port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:07:55.512868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Attempting to bind port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:55.549938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-502d78f3-2310-4d3f-a03f-8337d5cbc8c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:55.570942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-502d78f3-2310-4d3f-a03f-8337d5cbc8c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5069deef-9651-4e54-acbf-0d17d7f18e7f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:55.571148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:07:55.571354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Attempting to bind port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:07:55.575632 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-502d78f3-2310-4d3f-a03f-8337d5cbc8c8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:55.576876 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-502d78f3-2310-4d3f-a03f-8337d5cbc8c8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5069deef-9651-4e54-acbf-0d17d7f18e7f HTTP/1.1" status: 204 len: 168 time: 0.2232931 May 12 15:07:55.592470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-b96b125e-f5f0-4d6d-9088-c0ab03431e64 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=43dcdbeffdc84fb38f8c99a9f1d5c9cc&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0772133 May 12 15:07:55.606987 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 7, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:07:55.607321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:07:55.607698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:07:55.608142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Bound port: a3c95caf-bb88-467f-88c0-e38ce2f7b5ff, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:07:55.608844 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:55.663758 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-844ab41e-0543-488c-bd30-5d2a9cb5dc9e service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4306960 May 12 15:07:55.753782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7141bbc8-c2dd-420c-9515-74aa0e484848 req-5d406a04-ede8-4e55-8a9e-022459890c93 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:55.754342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7141bbc8-c2dd-420c-9515-74aa0e484848 req-5d406a04-ede8-4e55-8a9e-022459890c93 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Synchronizing usage tracker for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:07:55.812440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7141bbc8-c2dd-420c-9515-74aa0e484848 req-5d406a04-ede8-4e55-8a9e-022459890c93 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Unset dirty status for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:07:55.813748 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7141bbc8-c2dd-420c-9515-74aa0e484848 req-5d406a04-ede8-4e55-8a9e-022459890c93 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 948 time: 0.6782188 May 12 15:07:55.902239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] For port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:07:55.914582 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-49571a6f-6026-4616-8d91-984ff014b503 service neutron] 10.222.0.82 "GET /v2.0/networks/4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2906175 May 12 15:07:55.918946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7141bbc8-c2dd-420c-9515-74aa0e484848 req-23b74601-dea8-4042-a3de-0fad1407ef78 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806577 May 12 15:07:55.922451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] For port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:07:55.998537 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:56.304350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:56.304897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:56.306150 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265a4241-7909-44b0-8168-e28f324794ca req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] 10.222.0.76 "PUT /v2.0/ports/a3c95caf-bb88-467f-88c0-e38ce2f7b5ff HTTP/1.1" status: 200 len: 1096 time: 3.1702027 May 12 15:07:56.311748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '654cac47-c40b-4d9d-a71f-dbbed18b9333', 'tag': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:07:56.413586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f008c90-4422-4f85-b245-4d4f2372eb06 service neutron] Pushing event updated for resources: {'Port': ['ID=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:56.439545 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-05af4f74-8b7b-4ba6-92c7-56116acec98c service neutron] 10.222.0.82 "GET /v2.0/networks/4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5188010 May 12 15:07:56.471381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-950c86c0-3fb6-4b85-8a09-481a87977532 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:56.472965 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-950c86c0-3fb6-4b85-8a09-481a87977532 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31&tenant_id=1b3825228b0e4c42a381540b66ea23d6&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 1096 time: 0.4760029 May 12 15:07:56.482509 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f638ae0-61d1-4024-adc9-d96e9a04c316 req-1c7439d6-8381-44ba-89b3-d5b0151685d7 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:56.483993 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f638ae0-61d1-4024-adc9-d96e9a04c316 req-1c7439d6-8381-44ba-89b3-d5b0151685d7 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 945 time: 0.4115715 May 12 15:07:56.599123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265a4241-7909-44b0-8168-e28f324794ca req-65e8094f-49bd-43a7-86e7-2b227fc73d11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:56.600585 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265a4241-7909-44b0-8168-e28f324794ca req-65e8094f-49bd-43a7-86e7-2b227fc73d11 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 1099 time: 0.2380078 May 12 15:07:56.618307 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f638ae0-61d1-4024-adc9-d96e9a04c316 req-e0ab25cf-c6a3-45a0-a0da-1185e03b3b05 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0897748 May 12 15:07:56.695067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265a4241-7909-44b0-8168-e28f324794ca req-1464e4be-41ff-48d7-8aee-2fdadd49d713 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.141&port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff HTTP/1.1" status: 200 len: 217 time: 0.0793777 May 12 15:07:56.774008 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6f0bc762-971f-42df-b6f4-f214f2461d2f'] response: {'server_uuid': '8d278524-0445-4a95-8564-3c04c2f3c41d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e5430b6d-6430-4a47-b068-7f891fa37da9', 'code': 200} May 12 15:07:56.781066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265a4241-7909-44b0-8168-e28f324794ca req-5e0e0ea9-94e7-4193-a77f-de4d5ed62af6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:56.783215 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265a4241-7909-44b0-8168-e28f324794ca req-5e0e0ea9-94e7-4193-a77f-de4d5ed62af6 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0751350 May 12 15:07:56.899145 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-607fef7f-5a4d-4917-a07f-5237598c366f service neutron] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:07:56.910180 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-607fef7f-5a4d-4917-a07f-5237598c366f service neutron] Notify callbacks [] for binding, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:56.911260 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac82b594-fd24-44c0-8c0d-eae7287998bb req-607fef7f-5a4d-4917-a07f-5237598c366f service neutron] 10.222.0.76 "DELETE /v2.0/ports/8a33daa6-587f-4787-befb-2fa6e1051f2c/bindings/n-h1-841483-1 HTTP/1.1" status: 204 len: 173 time: 0.4264100 May 12 15:07:57.187749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-cb36e721-1a2f-47de-b9d7-923577df79cd tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:57.190205 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-cb36e721-1a2f-47de-b9d7-923577df79cd tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 821 time: 0.2325802 May 12 15:07:57.207961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfdad932-390e-4f68-a185-2bf477e62232 req-2fc1f0f0-d35a-4ae0-a9d9-ba5f0273712d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:57.209481 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cfdad932-390e-4f68-a185-2bf477e62232 req-2fc1f0f0-d35a-4ae0-a9d9-ba5f0273712d service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 1101 time: 0.1536460 May 12 15:07:57.220114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-d0dc3915-23a3-4e1d-b01e-ed93bf510602 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/quotas/bad2264067c248e9803d4b1eeb73116d HTTP/1.1" status: 200 len: 375 time: 0.0210168 May 12 15:07:57.227377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265a4241-7909-44b0-8168-e28f324794ca req-e695d898-5f0a-4f70-abab-c88f5596a1a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:57.229008 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265a4241-7909-44b0-8168-e28f324794ca req-e695d898-5f0a-4f70-abab-c88f5596a1a3 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.4368742 May 12 15:07:57.239839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e7f9513-7cc3-4c84-b89c-8113d594fd03 req-22df0046-7f63-46e9-a5bc-d64059dabff5 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:57.247263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e7f9513-7cc3-4c84-b89c-8113d594fd03 req-22df0046-7f63-46e9-a5bc-d64059dabff5 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.4087231 May 12 15:07:57.340355 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cfdad932-390e-4f68-a185-2bf477e62232 req-16645975-ffe9-4029-988c-9e6c0718c16c service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1079168 May 12 15:07:57.510077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e7f9513-7cc3-4c84-b89c-8113d594fd03 req-544cc16e-4b45-4105-83b2-55264a35ef29 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2616031 May 12 15:07:57.572857 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265a4241-7909-44b0-8168-e28f324794ca req-0d3ab415-789f-4964-8882-29a4377ed493 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3232634 May 12 15:07:57.575494 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-62e6594d-d124-4a15-9c50-224ab61e48a6'] response: {'name': 'network-changed', 'server_uuid': '654cac47-c40b-4d9d-a71f-dbbed18b9333', 'tag': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff', 'status': 'completed', 'code': 200} May 12 15:07:57.730090 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-917af732-6461-42d2-bbf7-4d11ce2e69f9 req-f2c6c1c6-de4d-4f9f-88fe-3401137ee637 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/ports?device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 210 time: 0.0602853 May 12 15:07:57.744561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-36809844-131f-4b8f-9e92-ae45571e640a tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&fields=id HTTP/1.1" status: 200 len: 394 time: 0.5136399 May 12 15:07:57.959023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-4815c7c0-bd3c-4206-bbcd-8d44b7e9d51b service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2065136 May 12 15:07:57.969249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265a4241-7909-44b0-8168-e28f324794ca req-3c09b33c-bc3d-4450-a584-e9f5c1d72c05 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3868198 May 12 15:07:58.189276 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-867ba4d1-e92b-428a-b221-b152f52c44b1 service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2231603 May 12 15:07:58.198893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e06f41e-a79f-45bd-b792-953e65377d7c req-6fea4c75-7604-4ba9-93c0-8854029346d7 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:58.200285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e06f41e-a79f-45bd-b792-953e65377d7c req-6fea4c75-7604-4ba9-93c0-8854029346d7 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 948 time: 0.2951126 May 12 15:07:58.223538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95911d4-3764-4b24-ae2b-b5710bdbf09d req-8ab7c1bf-ee4b-4444-af3c-73a514f7cb10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:58.224994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d95911d4-3764-4b24-ae2b-b5710bdbf09d req-8ab7c1bf-ee4b-4444-af3c-73a514f7cb10 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 1099 time: 0.1778007 May 12 15:07:58.468667 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e06f41e-a79f-45bd-b792-953e65377d7c req-bba5dbbb-1fb5-4fb4-b5db-f076513e82e7 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2604010 May 12 15:07:58.598738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95911d4-3764-4b24-ae2b-b5710bdbf09d req-e8da9389-55e3-4459-ae17-9592e55e85c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:58.600187 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d95911d4-3764-4b24-ae2b-b5710bdbf09d req-e8da9389-55e3-4459-ae17-9592e55e85c1 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.3585978 May 12 15:07:58.780065 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d95911d4-3764-4b24-ae2b-b5710bdbf09d req-252e49f1-a4e2-4bde-b998-913e64c7c61e service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.141&port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff HTTP/1.1" status: 200 len: 217 time: 0.1707344 May 12 15:07:58.833805 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3be2e3f1-85e2-4269-8cfd-da6138d4aa9d req-33f68509-3b14-4a71-9779-042f3e65440f tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 210 time: 0.1252804 May 12 15:07:58.882282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95911d4-3764-4b24-ae2b-b5710bdbf09d req-e39252a6-17bf-47b3-aab2-e5c8d551d052 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:58.883718 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d95911d4-3764-4b24-ae2b-b5710bdbf09d req-e39252a6-17bf-47b3-aab2-e5c8d551d052 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0884559 May 12 15:07:58.942348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c248035-4123-43f8-89ee-0e752ac0500c req-5e18ca25-fd25-49c6-97b6-5d0f3fcec9ef tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:58.943815 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c248035-4123-43f8-89ee-0e752ac0500c req-5e18ca25-fd25-49c6-97b6-5d0f3fcec9ef tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 1096 time: 0.2365308 May 12 15:07:59.062034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c248035-4123-43f8-89ee-0e752ac0500c req-e85b1ce7-288f-4424-be4e-c50e7d3d50d1 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836744 May 12 15:07:59.077167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95911d4-3764-4b24-ae2b-b5710bdbf09d req-534c54e5-9d7b-404d-8062-5095cd4e0e3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:59.078866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d95911d4-3764-4b24-ae2b-b5710bdbf09d req-534c54e5-9d7b-404d-8062-5095cd4e0e3b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1850619 May 12 15:07:59.095064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-935f9cf0-6bd5-4f77-8e6e-0bd951154362 req-99d65d20-0f02-4273-a641-bffca0167130 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:59.096913 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-935f9cf0-6bd5-4f77-8e6e-0bd951154362 req-99d65d20-0f02-4273-a641-bffca0167130 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.1508152 May 12 15:07:59.185552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a3c95caf-bb88-467f-88c0-e38ce2f7b5ff details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:07:59.231496 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-935f9cf0-6bd5-4f77-8e6e-0bd951154362 req-aa7219c3-22e4-4431-aeb0-5c121ccf5047 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1159229 May 12 15:07:59.269096 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d95911d4-3764-4b24-ae2b-b5710bdbf09d req-a5dbf64c-17b4-4912-b626-a2286967d7f3 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1811783 May 12 15:07:59.449336 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-508ffe81-8723-4e9d-8c44-9ba08cf17ae0 req-ba1f91ed-57ed-4b11-a8a8-c42cee16b751 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/ports?device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 210 time: 0.0651267 May 12 15:07:59.459339 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:59.485452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-69431b4a-5c9c-4ab3-a287-9d777850d8f0 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:59.488657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-69431b4a-5c9c-4ab3-a287-9d777850d8f0 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Synchronizing usage tracker for tenant:43dcdbeffdc84fb38f8c99a9f1d5c9cc on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:07:59.493754 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d95911d4-3764-4b24-ae2b-b5710bdbf09d req-f7a112ad-f514-4cdc-b4da-48c8b4210736 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2175255 May 12 15:07:59.496421 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff', 'mac_address': 'fa:16:3e:60:a5:ee', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.141'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:07:59.537109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-69431b4a-5c9c-4ab3-a287-9d777850d8f0 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Unset dirty status for tenant:43dcdbeffdc84fb38f8c99a9f1d5c9cc on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:07:59.538282 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-69431b4a-5c9c-4ab3-a287-9d777850d8f0 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.84 "GET /v2.0/networks?id=4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c HTTP/1.1" status: 200 len: 818 time: 0.3752384 May 12 15:07:59.560689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Request body: {'port': {'device_id': '78be535d-f7c7-4408-a6d7-b433e2cb30e3', 'network_id': '4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c', 'admin_state_up': True, 'tenant_id': '43dcdbeffdc84fb38f8c99a9f1d5c9cc'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:07:59.592709 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:59.630025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a3c95caf-bb88-467f-88c0-e38ce2f7b5ff {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:07:59.669059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:07:59.676792 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:59.746557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16f49020-3c9c-48ee-87b2-9faf293deba2 req-eddf9213-9adf-4cd6-b4b1-ecdef16b3aef tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:59.758672 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16f49020-3c9c-48ee-87b2-9faf293deba2 req-eddf9213-9adf-4cd6-b4b1-ecdef16b3aef tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 1096 time: 0.1485310 May 12 15:07:59.793266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:07:59.799058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Usage tracker for resource:port and tenant:43dcdbeffdc84fb38f8c99a9f1d5c9cc is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:07:59.804035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:07:59.813621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:07:59.820254 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:07:59.832122 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16f49020-3c9c-48ee-87b2-9faf293deba2 req-74e70d4d-2756-4e57-ab23-93229546e527 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0724566 May 12 15:07:59.841507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Made reservation on behalf of 43dcdbeffdc84fb38f8c99a9f1d5c9cc for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:07:59.845721 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:07:59.962011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd79b830-07dd-4ee9-ad8e-e2ed13652727 req-2f9fafb6-fdbf-46e2-8f2b-5bbdb8e6f111 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:07:59.963582 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd79b830-07dd-4ee9-ad8e-e2ed13652727 req-2f9fafb6-fdbf-46e2-8f2b-5bbdb8e6f111 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.1289716 May 12 15:07:59.990555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a3c95caf-bb88-467f-88c0-e38ce2f7b5ff'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:08:00.120115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Allocated IP 172.20.0.5 (4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c/c0f56151-d24d-48be-862b-d25eff2d2fb5/70e00de6-17a0-4bb3-861d-3630cc5b4a56) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:08:00.161145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd79b830-07dd-4ee9-ad8e-e2ed13652727 req-21691150-ddeb-4fa5-86bd-3536b4aee6b6 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1900787 May 12 15:08:00.453842 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8db1c14b-615d-4b2c-9e49-10fadc3ad34b req-2de692af-1663-4201-b3b2-c056fa9dba57 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 210 time: 0.0597205 May 12 15:08:00.466491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-968eb9bc-4fcb-4786-b900-7535826b7a6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:00.468123 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-968eb9bc-4fcb-4786-b900-7535826b7a6c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.84 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 821 time: 0.2848296 May 12 15:08:00.479603 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc00280d-bc55-4227-8df3-b520ee125c09 req-0672a9f2-8a4c-47a8-8b02-09a6d077f5e0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:00.479603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc00280d-bc55-4227-8df3-b520ee125c09 req-0672a9f2-8a4c-47a8-8b02-09a6d077f5e0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 949 time: 0.4510968 May 12 15:08:00.497153 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:00.506326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Request body: {'port': {'device_id': '127cef03-8661-4b61-a807-7baf9f974c4c', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'admin_state_up': True, 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:00.556682 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:00.637932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc00280d-bc55-4227-8df3-b520ee125c09 req-80710d72-13ad-44b5-b8a0-cd94cac89daa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1513650 May 12 15:08:00.668912 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Pushing event updated for resources: {'Port': ['ID=70e00de6-17a0-4bb3-861d-3630cc5b4a56,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:00.697642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Network 4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:08:00.701276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:08:00.709051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:08:00.740470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:00.768144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:00.791473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Made reservation on behalf of bad2264067c248e9803d4b1eeb73116d for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:08:00.795192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:00.847874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:00.848487 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:00.898250 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-0842cb78-c76a-4f2b-8392-656b131ef78f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3415935 May 12 15:08:00.917972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Request body: {'port': {'device_id': '78be535d-f7c7-4408-a6d7-b433e2cb30e3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:01.167977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:01.200174 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a3c95caf-bb88-467f-88c0-e38ce2f7b5ff up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:08:01.353760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:08:01.360862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:01.362090 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:01.556520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Allocated IP 172.20.0.12 (5af19f47-caf0-45a8-9b3d-186b8fd71ec1/b0cba805-7761-41c5-9666-3b2ff25491af/4844ecc9-16ec-4455-af7d-c1e11840b51a) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:08:01.557856 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:01.589667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8934ad9a-4653-40c8-bb09-36e4cef3d796 req-55e118f7-0866-4e15-85bb-e1c39b8f569a tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:01.599330 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8934ad9a-4653-40c8-bb09-36e4cef3d796 req-55e118f7-0866-4e15-85bb-e1c39b8f569a tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/ports?device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 931 time: 0.2651677 May 12 15:08:01.606254 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:01.616619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '654cac47-c40b-4d9d-a71f-dbbed18b9333', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:01.621037 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:01.684576 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8934ad9a-4653-40c8-bb09-36e4cef3d796 req-c194c15b-d81f-47b0-81fa-8fab4ae573be tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/security-groups?id=4849d4e4-8875-4f2c-b148-7a6793bc68a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0832171 May 12 15:08:01.793633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:01.904806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 70e00de6-17a0-4bb3-861d-3630cc5b4a56 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:08:01.915080 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:01.938891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Transition to ACTIVE for port object 70e00de6-17a0-4bb3-861d-3630cc5b4a56 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:08:01.944632 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:02.023492 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-92f31dde-9041-4638-be97-2b17494bcf0c req-f9c2364d-1f45-4635-a4a9-f4741a251db1 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 210 time: 0.1124091 May 12 15:08:02.062454 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:02.107901 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8caa84dc-7b29-4fa0-bb71-1da9e54eab42'] response: {'server_uuid': '654cac47-c40b-4d9d-a71f-dbbed18b9333', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff', 'code': 200} May 12 15:08:02.180966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Pushing event updated for resources: {'Port': ['ID=70e00de6-17a0-4bb3-861d-3630cc5b4a56,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:02.322505 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:02.375173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52007cf1-56b2-4831-a25c-664bec0e5887 req-87b3cd69-2a22-46a0-aab4-f9086ad860c3 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:02.376737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Attempting to bind port 70e00de6-17a0-4bb3-861d-3630cc5b4a56 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:08:02.377902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Attempting to bind port 70e00de6-17a0-4bb3-861d-3630cc5b4a56 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'bdd0c2de-fa4b-4564-94df-a91528c8916f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:08:02.378265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Attempting to bind port 70e00de6-17a0-4bb3-861d-3630cc5b4a56 on network 4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:08:02.383433 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52007cf1-56b2-4831-a25c-664bec0e5887 req-87b3cd69-2a22-46a0-aab4-f9086ad860c3 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.4711905 May 12 15:08:02.383865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Port 70e00de6-17a0-4bb3-861d-3630cc5b4a56 on network 4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:08:02.384235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Attempting to bind port 70e00de6-17a0-4bb3-861d-3630cc5b4a56 on network 4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:08:02.389853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 7, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:08:02.390189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Checking segment: {'id': 'bdd0c2de-fa4b-4564-94df-a91528c8916f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:08:02.390811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Bound using segment: {'id': 'bdd0c2de-fa4b-4564-94df-a91528c8916f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:08:02.391252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Bound port: 70e00de6-17a0-4bb3-861d-3630cc5b4a56, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bdd0c2de-fa4b-4564-94df-a91528c8916f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:08:02.391593 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:02.450233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Transition to ACTIVE for port object 4844ecc9-16ec-4455-af7d-c1e11840b51a will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:08:02.500200 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52007cf1-56b2-4831-a25c-664bec0e5887 req-bcd034b2-db9d-404f-bea6-fa9025432b13 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1122153 May 12 15:08:02.507214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] For port 70e00de6-17a0-4bb3-861d-3630cc5b4a56, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:08:02.512616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] For port 70e00de6-17a0-4bb3-861d-3630cc5b4a56, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=70e00de6-17a0-4bb3-861d-3630cc5b4a56,segment=NetworkSegment(bdd0c2de-fa4b-4564-94df-a91528c8916f),segment_id=bdd0c2de-fa4b-4564-94df-a91528c8916f)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:08:02.519458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea712626-a9ed-4b3c-b7f2-31a1afd608d7 req-45bddfe5-f2fe-4483-b9ca-96ae054fc993 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:02.520927 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea712626-a9ed-4b3c-b7f2-31a1afd608d7 req-45bddfe5-f2fe-4483-b9ca-96ae054fc993 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 1101 time: 0.3202040 May 12 15:08:02.528606 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:02.609615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-173de496-c5f0-4f89-b2ea-91af67c52a5a req-983e9fe0-3fd5-46cd-819c-d65fc898e985 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:02.611122 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-173de496-c5f0-4f89-b2ea-91af67c52a5a req-983e9fe0-3fd5-46cd-819c-d65fc898e985 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.2977560 May 12 15:08:02.615465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:02.617736 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:02.618031 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] 10.222.0.84 "PUT /v2.0/ports/70e00de6-17a0-4bb3-861d-3630cc5b4a56 HTTP/1.1" status: 200 len: 1091 time: 1.7045288 May 12 15:08:02.619423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '78be535d-f7c7-4408-a6d7-b433e2cb30e3', 'tag': '70e00de6-17a0-4bb3-861d-3630cc5b4a56'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:02.642306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632494d4-83bb-480c-b056-e0c5495b29f5 service neutron] Pushing event updated for resources: {'Port': ['ID=70e00de6-17a0-4bb3-861d-3630cc5b4a56,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:02.726632 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:02.745163 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-558f2b7f-c93f-4ba8-9c0e-033f70c4c4fb'] response: {'name': 'network-changed', 'server_uuid': '78be535d-f7c7-4408-a6d7-b433e2cb30e3', 'tag': '70e00de6-17a0-4bb3-861d-3630cc5b4a56', 'status': 'completed', 'code': 200} May 12 15:08:02.766195 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['9015ad2b-bc53-4425-beb5-9a5e82176b06'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:08:02.778781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-778d4cf1-3607-4cb2-bfef-edc5c170db21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:02.780460 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-778d4cf1-3607-4cb2-bfef-edc5c170db21 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=43dcdbeffdc84fb38f8c99a9f1d5c9cc&device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 1094 time: 0.0869401 May 12 15:08:02.829475 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea712626-a9ed-4b3c-b7f2-31a1afd608d7 req-8095fa25-deac-400c-bafc-e990bd32436f service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2902098 May 12 15:08:02.842282 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-173de496-c5f0-4f89-b2ea-91af67c52a5a req-516ccf8c-8e42-44a6-be70-a12553295189 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2231371 May 12 15:08:02.852681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Pushing event updated for resources: {'Port': ['ID=4844ecc9-16ec-4455-af7d-c1e11840b51a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:02.881171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:08:02.883802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:08:02.886357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:08:02.894600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:02.895320 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:02.931070 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-1747d22c-1b78-4257-88b4-626116e0087b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.4293909 May 12 15:08:02.949301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Request body: {'port': {'device_id': '127cef03-8661-4b61-a807-7baf9f974c4c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:02.949799 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-7ee56418-1241-43c1-8e1b-a02ec15a7b2a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=70e00de6-17a0-4bb3-861d-3630cc5b4a56 HTTP/1.1" status: 200 len: 217 time: 0.1528659 May 12 15:08:03.074700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-6ec0ca87-be1c-4283-a3b1-b6fd20eb8a9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:03.076145 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-6ec0ca87-be1c-4283-a3b1-b6fd20eb8a9e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c0f56151-d24d-48be-862b-d25eff2d2fb5 HTTP/1.1" status: 200 len: 858 time: 0.1195858 May 12 15:08:03.148040 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-bf56884e-7fcc-414c-8ce7-37886ab01d22 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0655313 May 12 15:08:03.305184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-473f0d73-5f8f-4e8f-ba84-5bf8c28f67e4 None None] Provisioning for port 4844ecc9-16ec-4455-af7d-c1e11840b51a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:08:03.308902 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:03.311126 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-473f0d73-5f8f-4e8f-ba84-5bf8c28f67e4 None None] Provisioning complete for port 4844ecc9-16ec-4455-af7d-c1e11840b51a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:03.311507 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-473f0d73-5f8f-4e8f-ba84-5bf8c28f67e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:03.384535 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-7ee7d76b-4ca5-45a2-a481-9cfc8411191f service neutron] 10.222.0.84 "GET /v2.0/networks/4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2290478 May 12 15:08:03.433686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-473f0d73-5f8f-4e8f-ba84-5bf8c28f67e4 None None] Port 4844ecc9-16ec-4455-af7d-c1e11840b51a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:08:03.460487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978a9314-34a0-4764-aaea-963d9f04431b req-0d9968aa-33d2-4949-98e6-67f1087bc812 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:03.465715 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-978a9314-34a0-4764-aaea-963d9f04431b req-0d9968aa-33d2-4949-98e6-67f1087bc812 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/ports?device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 943 time: 0.4296715 May 12 15:08:03.576068 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ec5d47e2-87d9-41a0-98f0-159050ce4123 req-b1a3c9a3-42d5-4726-b2d2-07e8ab510c7d service neutron] 10.222.0.84 "GET /v2.0/networks/4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1843679 May 12 15:08:03.706943 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-978a9314-34a0-4764-aaea-963d9f04431b req-8c3e8455-c436-478f-b5a8-89a34cf230ff tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/security-groups?id=4849d4e4-8875-4f2c-b148-7a6793bc68a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2307043 May 12 15:08:03.727262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89949578-147c-4bdc-b832-78c5f2a3217c req-967ed36d-dcf6-4278-858f-2b423a35ceaa tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:03.728000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-89949578-147c-4bdc-b832-78c5f2a3217c req-967ed36d-dcf6-4278-858f-2b423a35ceaa tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Synchronizing usage tracker for tenant:bad2264067c248e9803d4b1eeb73116d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:08:03.765008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-89949578-147c-4bdc-b832-78c5f2a3217c req-967ed36d-dcf6-4278-858f-2b423a35ceaa tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Unset dirty status for tenant:bad2264067c248e9803d4b1eeb73116d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:08:03.773591 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89949578-147c-4bdc-b832-78c5f2a3217c req-967ed36d-dcf6-4278-858f-2b423a35ceaa tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 932 time: 0.5804651 May 12 15:08:03.788825 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b24875b4-85ac-43b6-b5b4-a2609eeebc7a req-660690b9-6d13-4b57-900c-196324c1c8cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:03.791542 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b24875b4-85ac-43b6-b5b4-a2609eeebc7a req-660690b9-6d13-4b57-900c-196324c1c8cf service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=43dcdbeffdc84fb38f8c99a9f1d5c9cc&device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 1094 time: 0.1138296 May 12 15:08:03.858491 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89949578-147c-4bdc-b832-78c5f2a3217c req-935b0b92-24e7-4915-9f01-1253e57a79a0 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0839169 May 12 15:08:03.993737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b24875b4-85ac-43b6-b5b4-a2609eeebc7a req-d95c87c7-50a1-47ef-93af-860487e9ea47 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:03.995186 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b24875b4-85ac-43b6-b5b4-a2609eeebc7a req-d95c87c7-50a1-47ef-93af-860487e9ea47 service neutron] 10.222.0.84 "GET /v2.0/networks?id=4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c HTTP/1.1" status: 200 len: 919 time: 0.1965833 May 12 15:08:04.060631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4844ecc9-16ec-4455-af7d-c1e11840b51a {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:08:04.090701 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:04.099728 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b24875b4-85ac-43b6-b5b4-a2609eeebc7a req-060b1cc8-ecaa-4105-a899-67211b253cfd service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=70e00de6-17a0-4bb3-861d-3630cc5b4a56 HTTP/1.1" status: 200 len: 217 time: 0.0960035 May 12 15:08:04.143410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fa090c2-181e-4d36-9bb9-347db4a4b718 req-0b18e0bc-ddd2-4c71-8098-d2975c2530b0 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:04.144991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6fa090c2-181e-4d36-9bb9-347db4a4b718 req-0b18e0bc-ddd2-4c71-8098-d2975c2530b0 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.1791811 May 12 15:08:04.146480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Transition to ACTIVE for port object 4844ecc9-16ec-4455-af7d-c1e11840b51a will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:08:04.202671 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:04.211000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b24875b4-85ac-43b6-b5b4-a2609eeebc7a req-35a5c09a-6f55-4f72-9bfd-a7971d9afa75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:04.218401 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b24875b4-85ac-43b6-b5b4-a2609eeebc7a req-35a5c09a-6f55-4f72-9bfd-a7971d9afa75 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c0f56151-d24d-48be-862b-d25eff2d2fb5 HTTP/1.1" status: 200 len: 858 time: 0.1105564 May 12 15:08:04.326465 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b24875b4-85ac-43b6-b5b4-a2609eeebc7a req-21bc174c-6623-47b4-9b22-507242c6b06f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1009681 May 12 15:08:04.529167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6fa090c2-181e-4d36-9bb9-347db4a4b718 req-432ebc35-ff77-4341-85c1-4864234a65de tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3756597 May 12 15:08:04.570713 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b24875b4-85ac-43b6-b5b4-a2609eeebc7a req-4c6100f0-a4b3-45cc-a7bb-2ed50e7873e8 service neutron] 10.222.0.84 "GET /v2.0/networks/4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2369626 May 12 15:08:04.628612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Pushing event updated for resources: {'Port': ['ID=4844ecc9-16ec-4455-af7d-c1e11840b51a,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:04.761959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Attempting to bind port 4844ecc9-16ec-4455-af7d-c1e11840b51a on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:08:04.762295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Attempting to bind port 4844ecc9-16ec-4455-af7d-c1e11840b51a by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:08:04.762770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Attempting to bind port 4844ecc9-16ec-4455-af7d-c1e11840b51a on network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:08:04.784672 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Port 4844ecc9-16ec-4455-af7d-c1e11840b51a on network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:08:04.784890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Attempting to bind port 4844ecc9-16ec-4455-af7d-c1e11840b51a on network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:08:04.802932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 7, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:08:04.803543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Checking segment: {'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:08:04.804580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Bound using segment: {'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:08:04.805229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Bound port: 4844ecc9-16ec-4455-af7d-c1e11840b51a, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6877a48e-4842-481b-9f78-5fb45e4e8519', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:08:04.806331 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:04.855597 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b24875b4-85ac-43b6-b5b4-a2609eeebc7a req-708ff4cf-cc38-490a-be34-4775407f36ed service neutron] 10.222.0.84 "GET /v2.0/networks/4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2772460 May 12 15:08:04.864362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95478890-beef-469c-9799-2615f71f1f8a req-dd8f6fc6-9cc6-47af-ad2d-f098532e9c58 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:04.876844 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95478890-beef-469c-9799-2615f71f1f8a req-dd8f6fc6-9cc6-47af-ad2d-f098532e9c58 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.6823828 May 12 15:08:05.029194 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95478890-beef-469c-9799-2615f71f1f8a req-8541939f-4d7b-4989-95e4-dc6c6b7daadb tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1505170 May 12 15:08:05.084177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] For port 4844ecc9-16ec-4455-af7d-c1e11840b51a, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:08:05.088709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] For port 4844ecc9-16ec-4455-af7d-c1e11840b51a, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4844ecc9-16ec-4455-af7d-c1e11840b51a,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:08:05.107309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca91eefe-8cdd-4776-bf83-fbf9ef63cfee req-55e022dd-565d-4935-870f-3162d35af855 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:05.109094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca91eefe-8cdd-4776-bf83-fbf9ef63cfee req-55e022dd-565d-4935-870f-3162d35af855 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/ports?device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 943 time: 0.1724546 May 12 15:08:05.110265 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:05.178012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:05.178602 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:05.180551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] 10.222.0.84 "PUT /v2.0/ports/4844ecc9-16ec-4455-af7d-c1e11840b51a HTTP/1.1" status: 200 len: 1092 time: 2.2353802 May 12 15:08:05.211281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '127cef03-8661-4b61-a807-7baf9f974c4c', 'tag': '4844ecc9-16ec-4455-af7d-c1e11840b51a'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:05.291103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca91eefe-8cdd-4776-bf83-fbf9ef63cfee req-6e030049-5c1d-4c76-9d41-c7ad254e145f tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/security-groups?id=4849d4e4-8875-4f2c-b148-7a6793bc68a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1275311 May 12 15:08:05.331990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23c70725-64a3-43b3-8847-4c0b1192b0df service neutron] Pushing event updated for resources: {'Port': ['ID=4844ecc9-16ec-4455-af7d-c1e11840b51a,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:05.416019 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f7a3d30b-609e-417f-a174-ba63045768e0'] response: {'name': 'network-changed', 'server_uuid': '127cef03-8661-4b61-a807-7baf9f974c4c', 'tag': '4844ecc9-16ec-4455-af7d-c1e11840b51a', 'status': 'completed', 'code': 200} May 12 15:08:05.437268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-c3286fd1-df90-4db3-95ef-fb996cbc7506 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:05.438835 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-c3286fd1-df90-4db3-95ef-fb996cbc7506 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 1095 time: 0.1960597 May 12 15:08:05.534504 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-a7a547d2-3229-48f2-a374-aee62d694fb6 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4844ecc9-16ec-4455-af7d-c1e11840b51a HTTP/1.1" status: 200 len: 217 time: 0.0831456 May 12 15:08:05.673889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-d85aabf9-9e4c-48e8-b9f0-c38275c49143 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:05.677229 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-d85aabf9-9e4c-48e8-b9f0-c38275c49143 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.0947387 May 12 15:08:05.737778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92a06c7-243c-4aab-9c26-15dc1f566e3e req-de55899c-1371-49a6-b38c-170847fb1505 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:05.739288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92a06c7-243c-4aab-9c26-15dc1f566e3e req-de55899c-1371-49a6-b38c-170847fb1505 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 944 time: 0.2037969 May 12 15:08:05.855145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92a06c7-243c-4aab-9c26-15dc1f566e3e req-81676fa8-e40f-4552-b254-1c6b4ce2b3bd tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0804629 May 12 15:08:05.878255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-5974a254-678d-44fb-952d-a9d706ebe6ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:05.879748 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-5974a254-678d-44fb-952d-a9d706ebe6ec service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1959891 May 12 15:08:05.892479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41796ee6-9f05-4465-83df-b0078e48f66e req-0f05907a-e98d-4ec8-9dc2-3c967b6757b3 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:05.899725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41796ee6-9f05-4465-83df-b0078e48f66e req-0f05907a-e98d-4ec8-9dc2-3c967b6757b3 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.1765947 May 12 15:08:06.070311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41796ee6-9f05-4465-83df-b0078e48f66e req-e1de7bca-28c1-4448-a791-71d0bea1c4d2 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1696336 May 12 15:08:06.091554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-2a7cbbd4-45fa-4cf8-bed3-c80e9e8520a4 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1897545 May 12 15:08:06.374765 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e482f98f-8f76-420b-8951-2c6689d1aeea req-776700a3-4ccc-4a2d-8b7c-f9a31ed1bd11 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2737677 May 12 15:08:06.385022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5799ece-3d84-48fa-84d0-d6723a7520aa req-d3f73a71-e85e-4189-b5a8-bd86188d92e3 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:06.386556 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5799ece-3d84-48fa-84d0-d6723a7520aa req-d3f73a71-e85e-4189-b5a8-bd86188d92e3 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.1656466 May 12 15:08:06.462912 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5799ece-3d84-48fa-84d0-d6723a7520aa req-d88c69d7-3cc6-4c54-bc8c-3375db0530df tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619378 May 12 15:08:06.582759 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 70e00de6-17a0-4bb3-861d-3630cc5b4a56 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:08:06.742010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a004668-f51a-40ba-84c6-6f4483985096 req-dee83972-0b46-4291-9344-67887becc71d tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:06.749356 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a004668-f51a-40ba-84c6-6f4483985096 req-dee83972-0b46-4291-9344-67887becc71d tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/ports?device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 943 time: 0.2852783 May 12 15:08:06.802957 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a004668-f51a-40ba-84c6-6f4483985096 req-cf6213e0-135e-4fb7-8479-392d4a19f625 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/security-groups?id=4849d4e4-8875-4f2c-b148-7a6793bc68a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525596 May 12 15:08:06.810504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db6d0026-6fbd-449a-9383-cbd4deddf1ec req-9d100567-1c1a-43d0-9e66-add00c3f3af4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:06.812027 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db6d0026-6fbd-449a-9383-cbd4deddf1ec req-9d100567-1c1a-43d0-9e66-add00c3f3af4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 1095 time: 0.3084404 May 12 15:08:06.869460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 70e00de6-17a0-4bb3-861d-3630cc5b4a56, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=70e00de6-17a0-4bb3-861d-3630cc5b4a56,segment=NetworkSegment(bdd0c2de-fa4b-4564-94df-a91528c8916f),segment_id=bdd0c2de-fa4b-4564-94df-a91528c8916f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:06.888642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '70e00de6-17a0-4bb3-861d-3630cc5b4a56', 'network_id': '4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c', 'port_id': '70e00de6-17a0-4bb3-861d-3630cc5b4a56', 'mac_address': 'fa:16:3e:7e:8e:be', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 562, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c0f56151-d24d-48be-862b-d25eff2d2fb5', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:08:07.037023 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:07.072828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 70e00de6-17a0-4bb3-861d-3630cc5b4a56 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:08:07.090693 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 70e00de6-17a0-4bb3-861d-3630cc5b4a56, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=70e00de6-17a0-4bb3-861d-3630cc5b4a56,segment=NetworkSegment(bdd0c2de-fa4b-4564-94df-a91528c8916f),segment_id=bdd0c2de-fa4b-4564-94df-a91528c8916f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:07.096460 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:07.133035 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-f79d8182-43d4-49b1-820e-bce64d6f8692 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1307349 May 12 15:08:07.183854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=70e00de6-17a0-4bb3-861d-3630cc5b4a56,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:07.296643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db6d0026-6fbd-449a-9383-cbd4deddf1ec req-aec5d64f-f879-4e1f-aa1e-2e1b0aada78e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:07.298158 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db6d0026-6fbd-449a-9383-cbd4deddf1ec req-aec5d64f-f879-4e1f-aa1e-2e1b0aada78e service neutron] 10.222.0.84 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.4678867 May 12 15:08:07.386338 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db6d0026-6fbd-449a-9383-cbd4deddf1ec req-b1d49b48-3906-432e-afbe-69b3dc8b1d91 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4844ecc9-16ec-4455-af7d-c1e11840b51a HTTP/1.1" status: 200 len: 217 time: 0.0808463 May 12 15:08:07.401265 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35af7796-fce4-418e-8551-89787b33b0a1 req-549b97ea-cb3b-4893-a0fc-c874c6337ded tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:07.403221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35af7796-fce4-418e-8551-89787b33b0a1 req-549b97ea-cb3b-4893-a0fc-c874c6337ded tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.2536306 May 12 15:08:07.448820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36230a2-2cff-4a41-bfd5-b631f824dd2d req-a00d80fe-b5fd-44fe-af09-03a1f1a44573 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:07.450288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a36230a2-2cff-4a41-bfd5-b631f824dd2d req-a00d80fe-b5fd-44fe-af09-03a1f1a44573 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 944 time: 0.3807993 May 12 15:08:07.536225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['70e00de6-17a0-4bb3-861d-3630cc5b4a56'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:08:07.536460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db6d0026-6fbd-449a-9383-cbd4deddf1ec req-7f59337a-a59f-4741-b772-291fda940c68 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:07.537910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db6d0026-6fbd-449a-9383-cbd4deddf1ec req-7f59337a-a59f-4741-b772-291fda940c68 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.1338184 May 12 15:08:07.547177 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35af7796-fce4-418e-8551-89787b33b0a1 req-88e608d3-7788-4cbe-a094-59ce26811bcb tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1067135 May 12 15:08:07.552854 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a36230a2-2cff-4a41-bfd5-b631f824dd2d req-82618195-0e96-4399-9118-376919015bb7 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786912 May 12 15:08:07.645030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db6d0026-6fbd-449a-9383-cbd4deddf1ec req-063b27f5-e6b2-4d6e-b4db-f52c8e2e4eb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:07.646687 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db6d0026-6fbd-449a-9383-cbd4deddf1ec req-063b27f5-e6b2-4d6e-b4db-f52c8e2e4eb6 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0971103 May 12 15:08:07.914668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db6d0026-6fbd-449a-9383-cbd4deddf1ec req-eaa3a40b-5064-492c-bfbe-a8b424294313 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2597272 May 12 15:08:08.041664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-440ee5f1-86d5-4ef7-9f6e-ab1b4f190057 req-8ab0bd78-b2a3-48be-b3f5-87ac97c0339b tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:08.043157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-440ee5f1-86d5-4ef7-9f6e-ab1b4f190057 req-8ab0bd78-b2a3-48be-b3f5-87ac97c0339b tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.2206085 May 12 15:08:08.167623 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-440ee5f1-86d5-4ef7-9f6e-ab1b4f190057 req-826ac892-b334-4fae-bcc3-dc41a799ffa4 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1134748 May 12 15:08:08.170283 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db6d0026-6fbd-449a-9383-cbd4deddf1ec req-5b9cf428-21e7-43b3-926d-534dbc2518d6 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2470121 May 12 15:08:08.222537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f84037d-987e-4a51-b46a-d81bbd1a520b req-76523926-a2f6-4223-92a5-0a96f25220ea tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:08.223984 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f84037d-987e-4a51-b46a-d81bbd1a520b req-76523926-a2f6-4223-92a5-0a96f25220ea tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/ports?device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 944 time: 0.1404710 May 12 15:08:08.298082 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f84037d-987e-4a51-b46a-d81bbd1a520b req-3265672f-a5d0-4276-bbf7-b927bb5ba605 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/security-groups?id=4849d4e4-8875-4f2c-b148-7a6793bc68a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651810 May 12 15:08:08.428638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05393c8c-f8f4-4010-8725-8b41673f728d req-60ca447d-6c26-4063-bc0a-9310d9353eeb tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:08.430216 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05393c8c-f8f4-4010-8725-8b41673f728d req-60ca447d-6c26-4063-bc0a-9310d9353eeb tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d133fcd-1e60-426e-bc49-2d93dc68083f HTTP/1.1" status: 200 len: 946 time: 0.0929475 May 12 15:08:08.491192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05393c8c-f8f4-4010-8725-8b41673f728d req-992c6b82-0d36-4f6c-839f-a2bd98a5355e tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/security-groups?id=58d4492e-8d39-43dd-960f-b72be1cb1fa6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484169 May 12 15:08:08.590686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4844ecc9-16ec-4455-af7d-c1e11840b51a details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:08:08.596410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 70e00de6-17a0-4bb3-861d-3630cc5b4a56 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:08:08.815602 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4844ecc9-16ec-4455-af7d-c1e11840b51a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4844ecc9-16ec-4455-af7d-c1e11840b51a,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:08.841766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '4844ecc9-16ec-4455-af7d-c1e11840b51a', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'port_id': '4844ecc9-16ec-4455-af7d-c1e11840b51a', 'mac_address': 'fa:16:3e:e1:a6:97', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 565, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:08:08.870509 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f979ca-9c3f-4c41-91ee-c050dd4e381c req-00d9d94d-3fe3-4012-8f53-68b08c766945 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:08.879718 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28f979ca-9c3f-4c41-91ee-c050dd4e381c req-00d9d94d-3fe3-4012-8f53-68b08c766945 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.1537049 May 12 15:08:08.913524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 70e00de6-17a0-4bb3-861d-3630cc5b4a56 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:08:08.920460 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:08.929702 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 70e00de6-17a0-4bb3-861d-3630cc5b4a56 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:08.930082 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:08.981040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4844ecc9-16ec-4455-af7d-c1e11840b51a {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:08:09.009628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4844ecc9-16ec-4455-af7d-c1e11840b51a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4844ecc9-16ec-4455-af7d-c1e11840b51a,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:09.022193 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:09.053932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28f979ca-9c3f-4c41-91ee-c050dd4e381c req-188c3f4e-025f-47a3-b652-c9134fef663c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1733453 May 12 15:08:09.085537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-b75791e8-638d-45e9-8b4a-5e0721307afe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:09.085537 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-b75791e8-638d-45e9-8b4a-5e0721307afe service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 1101 time: 0.1850882 May 12 15:08:09.138710 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:09.161408 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4844ecc9-16ec-4455-af7d-c1e11840b51a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:09.183069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78be535d-f7c7-4408-a6d7-b433e2cb30e3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '70e00de6-17a0-4bb3-861d-3630cc5b4a56'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:09.191758 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcddce8e-2145-4367-9435-b22c12a6c18f req-f2a6b321-44c2-4412-9430-6d52786e380f tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:09.192770 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 70e00de6-17a0-4bb3-861d-3630cc5b4a56, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=70e00de6-17a0-4bb3-861d-3630cc5b4a56,segment=NetworkSegment(bdd0c2de-fa4b-4564-94df-a91528c8916f),segment_id=bdd0c2de-fa4b-4564-94df-a91528c8916f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:09.194089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dcddce8e-2145-4367-9435-b22c12a6c18f req-f2a6b321-44c2-4412-9430-6d52786e380f tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 944 time: 0.2969906 May 12 15:08:09.203961 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:09.290867 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d64a6e4a-3cf4-4035-9a53-f7c641a64a39'] response: {'server_uuid': '78be535d-f7c7-4408-a6d7-b433e2cb30e3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '70e00de6-17a0-4bb3-861d-3630cc5b4a56', 'code': 200} May 12 15:08:09.299765 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dcddce8e-2145-4367-9435-b22c12a6c18f req-205efcc8-4085-411c-a4b1-0945d916fcf1 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0918779 May 12 15:08:09.367818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-aca068b2-5476-4962-9391-4146665517ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:09.372692 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-aca068b2-5476-4962-9391-4146665517ff service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.2795732 May 12 15:08:09.386305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=70e00de6-17a0-4bb3-861d-3630cc5b4a56,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:09.436049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['4844ecc9-16ec-4455-af7d-c1e11840b51a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:08:09.692670 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-55887b96-9c78-41bc-8c34-370255bce0f2 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.141&port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff HTTP/1.1" status: 200 len: 217 time: 0.2668791 May 12 15:08:09.808146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-a3566133-ae14-41a3-a516-9a174ba3a39a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:09.809625 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-a3566133-ae14-41a3-a516-9a174ba3a39a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1007171 May 12 15:08:09.827422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c755afdf-255a-4df8-bbac-7f80c721ae59 req-e32f2992-77d2-479c-8c60-0527676fb5fc tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:09.828896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c755afdf-255a-4df8-bbac-7f80c721ae59 req-e32f2992-77d2-479c-8c60-0527676fb5fc tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.4532106 May 12 15:08:09.874939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7feadc05-55d5-4ba3-b8d7-5f266a19d606 req-ea30d2d1-2cf0-43e5-842d-026d834c62d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:09.876318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7feadc05-55d5-4ba3-b8d7-5f266a19d606 req-ea30d2d1-2cf0-43e5-842d-026d834c62d5 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 1096 time: 0.4492528 May 12 15:08:09.929124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b0484b-13ad-4ca8-b3b5-beb754068267 req-49fef1c0-63e9-49e8-a073-aaf801ac50c2 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:09.930593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15b0484b-13ad-4ca8-b3b5-beb754068267 req-49fef1c0-63e9-49e8-a073-aaf801ac50c2 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/ports?device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 945 time: 0.3089945 May 12 15:08:09.996339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c755afdf-255a-4df8-bbac-7f80c721ae59 req-54754993-a0e7-44ab-883b-dbfe921aea8d tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1585846 May 12 15:08:10.010828 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7feadc05-55d5-4ba3-b8d7-5f266a19d606 req-f25eb111-a444-4e94-b708-2d804769ec56 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=4849d4e4-8875-4f2c-b148-7a6793bc68a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1130900 May 12 15:08:10.070118 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15b0484b-13ad-4ca8-b3b5-beb754068267 req-a4b55277-6f2f-43ad-b288-5bf71f7798b4 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/security-groups?id=4849d4e4-8875-4f2c-b148-7a6793bc68a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1243670 May 12 15:08:10.093812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-a8a04b95-0434-4b6a-bea3-6b0771af6d0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:10.095314 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-a8a04b95-0434-4b6a-bea3-6b0771af6d0e service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2630877 May 12 15:08:10.323354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d322677c-6aa2-4dc5-83cd-4ace42c4a2d7 req-55363c1b-619c-4f47-aab7-bb11e7a414a8 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:10.324779 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d322677c-6aa2-4dc5-83cd-4ace42c4a2d7 req-55363c1b-619c-4f47-aab7-bb11e7a414a8 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.76 "GET /v2.0/ports?device_id=8d133fcd-1e60-426e-bc49-2d93dc68083f HTTP/1.1" status: 200 len: 946 time: 0.3169143 May 12 15:08:10.462310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-d322677c-6aa2-4dc5-83cd-4ace42c4a2d7 req-08fae711-3d14-4aea-a916-dc79c987fb5f tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Deleting port 6e590a85-aae0-4e2d-8659-02eb548f69e5 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:08:10.462601 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d322677c-6aa2-4dc5-83cd-4ace42c4a2d7 req-08fae711-3d14-4aea-a916-dc79c987fb5f tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:10.506125 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-a6a4bb80-1192-4201-acad-eb53482de2d6 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3992989 May 12 15:08:10.608809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4844ecc9-16ec-4455-af7d-c1e11840b51a up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:08:10.615404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a78eb2c-bb3e-49b9-97c9-7eb699a1eac5 req-642ac505-ba58-43a1-a606-b29cd1a8a0e3 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:10.616902 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a78eb2c-bb3e-49b9-97c9-7eb699a1eac5 req-642ac505-ba58-43a1-a606-b29cd1a8a0e3 tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d133fcd-1e60-426e-bc49-2d93dc68083f HTTP/1.1" status: 200 len: 946 time: 0.4118745 May 12 15:08:10.693218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-998472bc-051d-4a7e-bf46-0b8a0f0e7053 req-60652cd3-9a7d-49ff-9c78-6358a821490c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:10.694726 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-998472bc-051d-4a7e-bf46-0b8a0f0e7053 req-60652cd3-9a7d-49ff-9c78-6358a821490c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.4282494 May 12 15:08:10.707022 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 4844ecc9-16ec-4455-af7d-c1e11840b51a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:08:10.715618 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 4844ecc9-16ec-4455-af7d-c1e11840b51a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:10.715911 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:10.838981 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a78eb2c-bb3e-49b9-97c9-7eb699a1eac5 req-c346d232-9620-4f78-8c61-004b9059b65a tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/security-groups?id=58d4492e-8d39-43dd-960f-b72be1cb1fa6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2084055 May 12 15:08:10.844874 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:10.903300 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-998472bc-051d-4a7e-bf46-0b8a0f0e7053 req-601f09b3-e288-40fa-8477-0a6df4ae13bc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1914816 May 12 15:08:10.905479 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4844ecc9-16ec-4455-af7d-c1e11840b51a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4844ecc9-16ec-4455-af7d-c1e11840b51a,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:10.910907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-aa119580-94d9-4b3d-89eb-1cf86ad275a5 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3940988 May 12 15:08:10.914703 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:11.089020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4844ecc9-16ec-4455-af7d-c1e11840b51a,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:11.162198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-d322677c-6aa2-4dc5-83cd-4ace42c4a2d7 req-08fae711-3d14-4aea-a916-dc79c987fb5f tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] For port 6e590a85-aae0-4e2d-8659-02eb548f69e5, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=6e590a85-aae0-4e2d-8659-02eb548f69e5,segment=NetworkSegment(46b06527-f385-49ce-9d8e-98fc74ddf9b7),segment_id=46b06527-f385-49ce-9d8e-98fc74ddf9b7)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:11.162817 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d322677c-6aa2-4dc5-83cd-4ace42c4a2d7 req-08fae711-3d14-4aea-a916-dc79c987fb5f tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:11.292267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '127cef03-8661-4b61-a807-7baf9f974c4c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4844ecc9-16ec-4455-af7d-c1e11840b51a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:11.311220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48042) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:11.471795 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:11.487678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:11.492820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Usage tracker for resource:security_group_rule and tenant:3254d71fb8b74a38bdb54744b2c32770 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:11.495837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:11.503240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:11.569610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-d322677c-6aa2-4dc5-83cd-4ace42c4a2d7 req-08fae711-3d14-4aea-a916-dc79c987fb5f tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Calling delete_port for 6e590a85-aae0-4e2d-8659-02eb548f69e5 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:08:11.599223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:11.604288 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:11.656018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9c292e37-c91a-4d22-a4c1-1e8d652e9d23,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:11.663187 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3254d71fb8b74a38bdb54744b2c32770&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3505664 May 12 15:08:11.664510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-825a91ab-e54b-47a5-88fe-0040e05fe4a2 req-edc3f6b2-60d4-478d-9cd4-59502e61e922 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:11.667737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48048) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:11.669309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:11.669673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:11.670004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:11.670334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:11.670665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:11.670983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:11.671307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:11.671625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:11.671850 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-825a91ab-e54b-47a5-88fe-0040e05fe4a2 req-edc3f6b2-60d4-478d-9cd4-59502e61e922 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 946 time: 0.6231396 May 12 15:08:11.671993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:11.672392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:11.672976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:11.673218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fd8860-ab1c-41b9-abb2-2c37bfcc2d4f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:11.780279 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-825a91ab-e54b-47a5-88fe-0040e05fe4a2 req-46665fe1-aab4-4902-b8f3-9ddbc7b4088e tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1073785 May 12 15:08:11.828649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59562551-9768-4a8f-aa4a-aa3dfebda3a6 req-f1b2b7f8-c6f5-464d-9ff7-c505d8923064 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:11.830161 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59562551-9768-4a8f-aa4a-aa3dfebda3a6 req-f1b2b7f8-c6f5-464d-9ff7-c505d8923064 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.6428254 May 12 15:08:11.896528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e6d7cee1-843f-4794-9965-57fadcd666ea admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:11.910572 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59562551-9768-4a8f-aa4a-aa3dfebda3a6 req-2fa10f80-6c97-44be-965b-3be5d8572c6e tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631251 May 12 15:08:11.935214 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e6d7cee1-843f-4794-9965-57fadcd666ea admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:11.974244 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6502bab0-88ff-44a2-ab9a-50fef59f29d4'] response: {'server_uuid': '127cef03-8661-4b61-a807-7baf9f974c4c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4844ecc9-16ec-4455-af7d-c1e11840b51a', 'code': 200} May 12 15:08:11.986153 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d322677c-6aa2-4dc5-83cd-4ace42c4a2d7 req-08fae711-3d14-4aea-a916-dc79c987fb5f tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:12.015767 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e6d7cee1-843f-4794-9965-57fadcd666ea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:12.034024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6d7cee1-843f-4794-9965-57fadcd666ea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c292e37-c91a-4d22-a4c1-1e8d652e9d23,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:12.044582 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e6d7cee1-843f-4794-9965-57fadcd666ea admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:12.049845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08fae711-3d14-4aea-a916-dc79c987fb5f tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Pushing event deleted for resources: {'Port': ['ID=6e590a85-aae0-4e2d-8659-02eb548f69e5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:12.060491 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e6d7cee1-843f-4794-9965-57fadcd666ea admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9c292e37-c91a-4d22-a4c1-1e8d652e9d23 HTTP/1.1" status: 204 len: 168 time: 0.3741667 May 12 15:08:12.251316 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f243deb4-6797-456f-b11b-5fe12c0d3d64 req-a422c84c-7b7a-4696-814b-e4a9cce7382d tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d133fcd-1e60-426e-bc49-2d93dc68083f HTTP/1.1" status: 200 len: 210 time: 0.1360641 May 12 15:08:12.256889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-d322677c-6aa2-4dc5-83cd-4ace42c4a2d7 req-08fae711-3d14-4aea-a916-dc79c987fb5f tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] No DVR routers for this DVR port 6e590a85-aae0-4e2d-8659-02eb548f69e5 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:08:12.267479 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d322677c-6aa2-4dc5-83cd-4ace42c4a2d7 req-08fae711-3d14-4aea-a916-dc79c987fb5f tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:12.271313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8d133fcd-1e60-426e-bc49-2d93dc68083f', 'name': 'network-vif-deleted', 'tag': '6e590a85-aae0-4e2d-8659-02eb548f69e5'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:12.292063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b21a2413-988b-4638-8471-6357376fc738 req-36c95d01-ae06-44b6-9836-676d95eac5d4 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:12.298894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b21a2413-988b-4638-8471-6357376fc738 req-36c95d01-ae06-44b6-9836-676d95eac5d4 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/ports?device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 945 time: 0.3846607 May 12 15:08:12.344009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d322677c-6aa2-4dc5-83cd-4ace42c4a2d7 req-08fae711-3d14-4aea-a916-dc79c987fb5f tempest-VolumesAdminNegativeTest-23185147 tempest-VolumesAdminNegativeTest-23185147-project] 10.222.0.76 "DELETE /v2.0/ports/6e590a85-aae0-4e2d-8659-02eb548f69e5 HTTP/1.1" status: 204 len: 173 time: 2.0097466 May 12 15:08:12.376124 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b21a2413-988b-4638-8471-6357376fc738 req-38ebdc93-9779-4083-bbea-c83aa82debaf tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/security-groups?id=4849d4e4-8875-4f2c-b148-7a6793bc68a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721903 May 12 15:08:12.400897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b6b38e7-93dd-4b0f-8f4c-615e207c4756 req-c5a2233b-b1e6-4a1a-8d05-8f2a82f81662 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:12.402555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b6b38e7-93dd-4b0f-8f4c-615e207c4756 req-c5a2233b-b1e6-4a1a-8d05-8f2a82f81662 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 1097 time: 0.2942932 May 12 15:08:12.475328 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-34ea8025-5d88-4bba-9e57-775df1262540'] response: {'server_uuid': '8d133fcd-1e60-426e-bc49-2d93dc68083f', 'name': 'network-vif-deleted', 'tag': '6e590a85-aae0-4e2d-8659-02eb548f69e5', 'status': 'completed', 'code': 200} May 12 15:08:12.479087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48066) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:12.506362 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cb504ba-ecd3-4ab2-9127-5929f72bc4ab admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:12.506706 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b6b38e7-93dd-4b0f-8f4c-615e207c4756 req-b654ceea-fe35-4436-9af9-adf35e83640b service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0974479 May 12 15:08:12.545200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7cb504ba-ecd3-4ab2-9127-5929f72bc4ab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:12.548461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61aa815e-bf68-4b60-bd30-08bc7c850622 req-e5bb8199-95cf-4b5e-b68c-650c1ffb7a87 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:12.551163 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61aa815e-bf68-4b60-bd30-08bc7c850622 req-e5bb8199-95cf-4b5e-b68c-650c1ffb7a87 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.1141825 May 12 15:08:12.559204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7cb504ba-ecd3-4ab2-9127-5929f72bc4ab admin admin] Usage tracker for resource:security_group_rule and tenant:e11e0ef69071484493247aa32d671f05 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:12.562905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7cb504ba-ecd3-4ab2-9127-5929f72bc4ab admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:12.570178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7cb504ba-ecd3-4ab2-9127-5929f72bc4ab admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:12.615963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61aa815e-bf68-4b60-bd30-08bc7c850622 req-8feb9b7c-3737-425b-bc83-983cbb363eb3 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584881 May 12 15:08:12.638515 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e128091f-c024-4713-bec2-a6bc983909d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:12.644957 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:12.702473 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cb504ba-ecd3-4ab2-9127-5929f72bc4ab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:12.708537 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cb504ba-ecd3-4ab2-9127-5929f72bc4ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:12.761896 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7cb504ba-ecd3-4ab2-9127-5929f72bc4ab admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e11e0ef69071484493247aa32d671f05&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2817228 May 12 15:08:12.762738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cb504ba-ecd3-4ab2-9127-5929f72bc4ab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59bac1c4-4819-4e1b-a15a-4e283fde1789,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:12.764551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48072) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:12.961711 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09dd7ba5-222d-4425-9405-32925aa42ee4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:13.021764 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09dd7ba5-222d-4425-9405-32925aa42ee4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:13.059129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-798f56cf-fad2-4e9d-ba49-90c938b42f32 req-58ebfe2c-c2c6-4abd-abad-fef6d1a2e0d1 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:13.060575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-798f56cf-fad2-4e9d-ba49-90c938b42f32 req-58ebfe2c-c2c6-4abd-abad-fef6d1a2e0d1 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/ports?device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 945 time: 0.2413239 May 12 15:08:13.130544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ec43ea5-4ef5-4ddf-a777-339ba8b652f2 req-ee72dcbd-3988-46d1-8083-e552925ac909 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:13.132662 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ec43ea5-4ef5-4ddf-a777-339ba8b652f2 req-ee72dcbd-3988-46d1-8083-e552925ac909 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 946 time: 0.2170770 May 12 15:08:13.141982 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-798f56cf-fad2-4e9d-ba49-90c938b42f32 req-ad69f654-9fce-433e-9e08-02e808b7f7e7 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/security-groups?id=4849d4e4-8875-4f2c-b148-7a6793bc68a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708587 May 12 15:08:13.172438 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09dd7ba5-222d-4425-9405-32925aa42ee4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:13.224460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09dd7ba5-222d-4425-9405-32925aa42ee4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59bac1c4-4819-4e1b-a15a-4e283fde1789,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:13.233037 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09dd7ba5-222d-4425-9405-32925aa42ee4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:13.245047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 6e590a85-aae0-4e2d-8659-02eb548f69e5 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:08:13.254560 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-09dd7ba5-222d-4425-9405-32925aa42ee4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/59bac1c4-4819-4e1b-a15a-4e283fde1789 HTTP/1.1" status: 204 len: 168 time: 0.4888816 May 12 15:08:13.264069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ec43ea5-4ef5-4ddf-a777-339ba8b652f2 req-c92f2d6b-6de6-4015-b444-aa89b1c2ee15 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1147394 May 12 15:08:13.310765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 6e590a85-aae0-4e2d-8659-02eb548f69e5 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:08:13.311235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 6e590a85-aae0-4e2d-8659-02eb548f69e5 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:08:13.379396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c8bbc2b-e88c-4d61-84cd-7b8b6fc05f6d req-e7c511ac-ea54-4665-8753-80c6badb1e42 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:13.381523 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c8bbc2b-e88c-4d61-84cd-7b8b6fc05f6d req-e7c511ac-ea54-4665-8753-80c6badb1e42 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.1165800 May 12 15:08:13.423299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48086) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:13.446151 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c8bbc2b-e88c-4d61-84cd-7b8b6fc05f6d req-e79f5db9-7e89-4112-a66e-325b99ca53b1 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571327 May 12 15:08:13.491029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-1c656091-100c-4117-a1d8-6d9ade8b60c6 admin admin] Deleting subnet 8a6a4b4b-c9fd-4587-bd5d-0955b805a307 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:08:13.494385 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c656091-100c-4117-a1d8-6d9ade8b60c6 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:13.551520 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c656091-100c-4117-a1d8-6d9ade8b60c6 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:13.617100 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c656091-100c-4117-a1d8-6d9ade8b60c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:13.696241 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c656091-100c-4117-a1d8-6d9ade8b60c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:13.743461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c656091-100c-4117-a1d8-6d9ade8b60c6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8a6a4b4b-c9fd-4587-bd5d-0955b805a307,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:13.746252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c656091-100c-4117-a1d8-6d9ade8b60c6 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:13.767883 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1c656091-100c-4117-a1d8-6d9ade8b60c6 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/8a6a4b4b-c9fd-4587-bd5d-0955b805a307 HTTP/1.1" status: 204 len: 168 time: 0.3428538 May 12 15:08:13.770263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48100) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:13.978674 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:14.060753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae32cca1-57b1-488f-b7cb-523e6486108d req-ca2c272a-9459-4445-af3f-0317695020ba tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:14.062221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae32cca1-57b1-488f-b7cb-523e6486108d req-ca2c272a-9459-4445-af3f-0317695020ba tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.2563102 May 12 15:08:14.154218 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:14.201752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae32cca1-57b1-488f-b7cb-523e6486108d req-6c0e6f86-bf5d-4d43-9cf7-f342cf0ce725 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0919290 May 12 15:08:14.208622 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=88152) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:08:14.208961 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=88152) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:08:14.209727 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=88152) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:08:14.210057 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Subscribe: > port after_create 55550000 {{(pid=88152) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:08:14.210367 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Subscribe: > port after_delete 55550000 {{(pid=88152) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:08:14.210690 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Subscribe: > port after_update 55550000 {{(pid=88152) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:08:14.210998 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=88152) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:08:14.211327 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=88152) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:08:14.211706 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=88152) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:08:14.211961 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=88152) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:08:14.288747 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=88152) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:08:14.289404 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=88152) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:08:14.289404 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=88152) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:08:14.289740 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=88152) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 12 15:08:14.290088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['40409ee5-b51e-42cb-8335-adb362d0d213']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:14.339380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '46b06527-f385-49ce-9d8e-98fc74ddf9b7') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:14.339667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '46b06527-f385-49ce-9d8e-98fc74ddf9b7') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:14.362270 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:14.389952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:14.401628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Releasing vlan 576 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:08:14.402093 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: from cryptography.utils import int_from_bytes May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: from cryptography.utils import int_from_bytes May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/relationships.py:1994: SAWarning: Setting backref / back_populates on relationship QosNetworkPolicyBinding.port to refer to viewonly relationship Port.qos_network_policy_binding should include sync_backref=False set on the QosNetworkPolicyBinding.port relationship. (this warning may be suppressed after 10 occurrences) May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: util.warn_limited( May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/relationships.py:1994: SAWarning: Setting backref / back_populates on relationship Tag.standard_attr to refer to viewonly relationship StandardAttribute.tags should include sync_backref=False set on the Tag.standard_attr relationship. (this warning may be suppressed after 10 occurrences) May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: util.warn_limited( May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: timer() May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:08:14.419233 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:08:14.676414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e3c29b-08cb-4eb6-a7e6-3c12d7f5f5b5 req-76157441-3919-43f4-b1a8-593a0e1b55b8 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:14.678042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25e3c29b-08cb-4eb6-a7e6-3c12d7f5f5b5 req-76157441-3919-43f4-b1a8-593a0e1b55b8 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/ports?device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 945 time: 0.3762498 May 12 15:08:14.682070 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:14.767160 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:14.773047 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e8458719-53ee-48d8-91ae-0961904370eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:14.775736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] Pushing event deleted for resources: {'Network': ['ID=40409ee5-b51e-42cb-8335-adb362d0d213,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:14.803508 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-de49588f-7d17-4f1f-8070-2811d97fe999 admin admin] 10.222.0.82 "DELETE /v2.0/networks/40409ee5-b51e-42cb-8335-adb362d0d213 HTTP/1.1" status: 204 len: 168 time: 1.0321038 May 12 15:08:14.807171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48132) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:14.822919 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25e3c29b-08cb-4eb6-a7e6-3c12d7f5f5b5 req-ffdf0980-6e1f-4874-b20b-41498cb02c63 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/security-groups?id=4849d4e4-8875-4f2c-b148-7a6793bc68a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1076782 May 12 15:08:14.841917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efcbfa07-2b85-45f5-a4bd-ebe877687560 req-7dfdd62c-ab0f-47b3-a81d-40ef31e2504f tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:14.849170 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-efcbfa07-2b85-45f5-a4bd-ebe877687560 req-7dfdd62c-ab0f-47b3-a81d-40ef31e2504f tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 946 time: 0.2655940 May 12 15:08:14.894641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19cac1d-c781-423e-8b5f-28935d49cd95 req-9fda91d9-7b6b-4216-9ce5-f8ec1d83662a tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:14.896146 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f19cac1d-c781-423e-8b5f-28935d49cd95 req-9fda91d9-7b6b-4216-9ce5-f8ec1d83662a tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.84 "GET /v2.0/ports?device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 945 time: 0.2172344 May 12 15:08:14.954145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-efcbfa07-2b85-45f5-a4bd-ebe877687560 req-af43ac5e-6928-4f12-9863-c36c74b19347 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1020157 May 12 15:08:14.972003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-288e59b7-7134-4d94-a94e-4d71483eacc8 admin admin] Deleting subnet 6bc54724-a880-4a34-beee-bc26ec472cdd {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:08:14.977789 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-288e59b7-7134-4d94-a94e-4d71483eacc8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.012730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-f19cac1d-c781-423e-8b5f-28935d49cd95 req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Deleting port 70e00de6-17a0-4bb3-861d-3630cc5b4a56 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:08:15.013008 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f19cac1d-c781-423e-8b5f-28935d49cd95 req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.084280 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-288e59b7-7134-4d94-a94e-4d71483eacc8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.202274 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-288e59b7-7134-4d94-a94e-4d71483eacc8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.295975 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-288e59b7-7134-4d94-a94e-4d71483eacc8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.375099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-288e59b7-7134-4d94-a94e-4d71483eacc8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6bc54724-a880-4a34-beee-bc26ec472cdd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:15.385643 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-288e59b7-7134-4d94-a94e-4d71483eacc8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.394103 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-288e59b7-7134-4d94-a94e-4d71483eacc8 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/6bc54724-a880-4a34-beee-bc26ec472cdd HTTP/1.1" status: 204 len: 168 time: 0.5853126 May 12 15:08:15.396432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48150) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:15.454108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f19cac1d-c781-423e-8b5f-28935d49cd95 req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] For port 70e00de6-17a0-4bb3-861d-3630cc5b4a56, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=70e00de6-17a0-4bb3-861d-3630cc5b4a56,segment=NetworkSegment(bdd0c2de-fa4b-4564-94df-a91528c8916f),segment_id=bdd0c2de-fa4b-4564-94df-a91528c8916f)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:15.455089 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f19cac1d-c781-423e-8b5f-28935d49cd95 req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.558242 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce48b3b6-75ee-4c8c-9bd3-9a39ebf07f55 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.600044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-f19cac1d-c781-423e-8b5f-28935d49cd95 req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Calling delete_port for 70e00de6-17a0-4bb3-861d-3630cc5b4a56 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:08:15.655098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22105136-7460-4f55-bbb9-63209a3985d4 req-4dbf1975-ae5f-4d73-b7ad-49fca06d16cc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:15.663027 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22105136-7460-4f55-bbb9-63209a3985d4 req-4dbf1975-ae5f-4d73-b7ad-49fca06d16cc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.4807134 May 12 15:08:15.719824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce48b3b6-75ee-4c8c-9bd3-9a39ebf07f55 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.738703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e2b1571-bfe8-442f-8ca5-8114a7227083 req-0212932d-50c6-44a6-892b-29ae0b091e0a tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:15.740476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7e2b1571-bfe8-442f-8ca5-8114a7227083 req-0212932d-50c6-44a6-892b-29ae0b091e0a tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.6551321 May 12 15:08:15.759816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ce48b3b6-75ee-4c8c-9bd3-9a39ebf07f55 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['77b97da7-466e-4431-9430-75b9b8ba987c']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:15.776913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ce48b3b6-75ee-4c8c-9bd3-9a39ebf07f55 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'de2fdbf7-026a-4abe-9cb3-b5d747a87840') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:15.777412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ce48b3b6-75ee-4c8c-9bd3-9a39ebf07f55 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'de2fdbf7-026a-4abe-9cb3-b5d747a87840') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:15.783949 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22105136-7460-4f55-bbb9-63209a3985d4 req-0342d3da-bf69-4d17-b36d-7bf7e88a3b49 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.73 HTTP/1.1" status: 200 len: 695 time: 0.1195004 May 12 15:08:15.794869 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce48b3b6-75ee-4c8c-9bd3-9a39ebf07f55 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.810383 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-22105136-7460-4f55-bbb9-63209a3985d4 req-c6e9c479-5a2a-4859-840c-6577e677a292 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Request body: {'floatingip': {'port_id': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'fixed_ip_address': '172.20.0.6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:15.822091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce48b3b6-75ee-4c8c-9bd3-9a39ebf07f55 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.834384 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ce48b3b6-75ee-4c8c-9bd3-9a39ebf07f55 admin admin] Releasing vlan 560 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:08:15.834791 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce48b3b6-75ee-4c8c-9bd3-9a39ebf07f55 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: timer() May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:08:15.849099 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:08:15.909512 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-22105136-7460-4f55-bbb9-63209a3985d4 req-c6e9c479-5a2a-4859-840c-6577e677a292 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.927712 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce48b3b6-75ee-4c8c-9bd3-9a39ebf07f55 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.932334 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce48b3b6-75ee-4c8c-9bd3-9a39ebf07f55 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.954263 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ce48b3b6-75ee-4c8c-9bd3-9a39ebf07f55 admin admin] 10.222.0.82 "DELETE /v2.0/networks/77b97da7-466e-4431-9430-75b9b8ba987c HTTP/1.1" status: 204 len: 168 time: 0.5567644 May 12 15:08:15.958546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce48b3b6-75ee-4c8c-9bd3-9a39ebf07f55 admin admin] Pushing event deleted for resources: {'Network': ['ID=77b97da7-466e-4431-9430-75b9b8ba987c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:15.975751 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:15.992844 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7e2b1571-bfe8-442f-8ca5-8114a7227083 req-971cb3c3-902a-4fdf-8a5a-5b74bf948b94 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2366219 May 12 15:08:16.018440 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:16.164627 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f19cac1d-c781-423e-8b5f-28935d49cd95 req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:16.202041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['70e00de6-17a0-4bb3-861d-3630cc5b4a56'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:08:16.217764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48172) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:16.294933 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d88cfd78-ddef-4a80-8b13-046dc8ff24fd admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=42cdb729a3834b40aed1f7fd83ab2973&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0754592 May 12 15:08:16.295669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48178) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:16.376427 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-939cc984-62d8-4f6a-afe2-9734213599d0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:16.403045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Pushing event deleted for resources: {'Port': ['ID=70e00de6-17a0-4bb3-861d-3630cc5b4a56,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:16.411668 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-939cc984-62d8-4f6a-afe2-9734213599d0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:16.489223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-939cc984-62d8-4f6a-afe2-9734213599d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:16.509830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-939cc984-62d8-4f6a-afe2-9734213599d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=58d4492e-8d39-43dd-960f-b72be1cb1fa6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:16.512244 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-939cc984-62d8-4f6a-afe2-9734213599d0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:16.513548 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-939cc984-62d8-4f6a-afe2-9734213599d0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/58d4492e-8d39-43dd-960f-b72be1cb1fa6 HTTP/1.1" status: 204 len: 168 time: 0.2168481 May 12 15:08:16.526379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:16.526854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:16.527028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:16.527518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:16.528013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:16.528481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:16.528945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:16.529439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:16.529917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:16.530375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:16.530836 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:16.531295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:16.599975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-f19cac1d-c781-423e-8b5f-28935d49cd95 req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] No DVR routers for this DVR port 70e00de6-17a0-4bb3-861d-3630cc5b4a56 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:08:16.607058 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f19cac1d-c781-423e-8b5f-28935d49cd95 req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:16.609890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78be535d-f7c7-4408-a6d7-b433e2cb30e3', 'name': 'network-vif-deleted', 'tag': '70e00de6-17a0-4bb3-861d-3630cc5b4a56'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:16.619541 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:08:16.680971 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f19cac1d-c781-423e-8b5f-28935d49cd95 req-aa66ed71-3d59-43f5-894b-115300be9a68 tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.84 "DELETE /v2.0/ports/70e00de6-17a0-4bb3-861d-3630cc5b4a56 HTTP/1.1" status: 204 len: 173 time: 1.7784686 May 12 15:08:16.718716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc45c2bb-507d-4e67-afbb-9ff45e6cf7b6 req-ca903c24-c011-46ce-80f9-bd07a2a80340 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:16.720572 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc45c2bb-507d-4e67-afbb-9ff45e6cf7b6 req-ca903c24-c011-46ce-80f9-bd07a2a80340 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.5579624 May 12 15:08:16.964717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc45c2bb-507d-4e67-afbb-9ff45e6cf7b6 req-af8ab2b5-793c-49ba-9041-476c303ab379 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2360368 May 12 15:08:17.095245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48198) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:17.133957 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-22105136-7460-4f55-bbb9-63209a3985d4 req-c6e9c479-5a2a-4859-840c-6577e677a292 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:17.144392 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-22105136-7460-4f55-bbb9-63209a3985d4 req-c6e9c479-5a2a-4859-840c-6577e677a292 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:17.167289 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2bcb2dd6-b26c-4a88-8b6b-b5ce17bd2642 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e01604270dab4830aa9827a5adfca2be&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0706205 May 12 15:08:17.169580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48202) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:17.311908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff9b4d01-a865-480f-90a9-4e9f77b7f659 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:17.375263 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff9b4d01-a865-480f-90a9-4e9f77b7f659 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:17.437021 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff9b4d01-a865-480f-90a9-4e9f77b7f659 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:17.460755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff9b4d01-a865-480f-90a9-4e9f77b7f659 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=73c11cdf-edb1-4d3f-a963-3e8bc24ec7b4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:17.475858 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff9b4d01-a865-480f-90a9-4e9f77b7f659 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:17.479236 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ff9b4d01-a865-480f-90a9-4e9f77b7f659 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/73c11cdf-edb1-4d3f-a963-3e8bc24ec7b4 HTTP/1.1" status: 204 len: 168 time: 0.3064237 May 12 15:08:17.567936 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:17.703057 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-22105136-7460-4f55-bbb9-63209a3985d4 req-c6e9c479-5a2a-4859-840c-6577e677a292 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Floating IP 39327416-fca3-4fc6-84f2-31a84b283d83 associated. External IP: 172.25.8.73, port: 9015ad2b-bc53-4425-beb5-9a5e82176b06. May 12 15:08:17.767158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6e2026a4-fa04-4d6c-b5a2-e6b22db33539 req-90a1cb05-1902-4efd-b050-8a471aaf65ca tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Synchronizing usage tracker for tenant:43dcdbeffdc84fb38f8c99a9f1d5c9cc on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:08:17.810208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6e2026a4-fa04-4d6c-b5a2-e6b22db33539 req-90a1cb05-1902-4efd-b050-8a471aaf65ca tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] Unset dirty status for tenant:43dcdbeffdc84fb38f8c99a9f1d5c9cc on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:08:17.811497 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e2026a4-fa04-4d6c-b5a2-e6b22db33539 req-90a1cb05-1902-4efd-b050-8a471aaf65ca tempest-InstanceActionsV221TestJSON-253795179 tempest-InstanceActionsV221TestJSON-253795179-project] 10.222.0.82 "GET /v2.0/ports?device_id=78be535d-f7c7-4408-a6d7-b433e2cb30e3 HTTP/1.1" status: 200 len: 210 time: 0.2534089 May 12 15:08:17.916332 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-84a1f368-0469-4764-ae56-cbdfb8edc357'] response: {'server_uuid': '78be535d-f7c7-4408-a6d7-b433e2cb30e3', 'name': 'network-vif-deleted', 'tag': '70e00de6-17a0-4bb3-861d-3630cc5b4a56', 'status': 'completed', 'code': 200} May 12 15:08:18.199167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-22105136-7460-4f55-bbb9-63209a3985d4 req-c6e9c479-5a2a-4859-840c-6577e677a292 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Router 940e3b0e-8287-409c-890e-28addf1cf0b8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:08:18.217402 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41cc8ef9-e351-4946-8a65-8a470ce5a623 req-2ae62438-6001-478c-9a07-b8d71b73bb62 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:18.218895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41cc8ef9-e351-4946-8a65-8a470ce5a623 req-2ae62438-6001-478c-9a07-b8d71b73bb62 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.2046912 May 12 15:08:18.508911 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41cc8ef9-e351-4946-8a65-8a470ce5a623 req-f8dbbc66-2215-4e84-beb8-34878ed13fd7 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1210380 May 12 15:08:18.553261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-22105136-7460-4f55-bbb9-63209a3985d4 req-c6e9c479-5a2a-4859-840c-6577e677a292 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:08:18.558079 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-22105136-7460-4f55-bbb9-63209a3985d4 req-c6e9c479-5a2a-4859-840c-6577e677a292 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:18.565201 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61dd4dee-eb9c-479b-8151-4ca895d18676 None None] Sync routers for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:08:18.572724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48240) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:18.579988 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61dd4dee-eb9c-479b-8151-4ca895d18676 None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:18.581103 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-61dd4dee-eb9c-479b-8151-4ca895d18676 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:18.664514 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22105136-7460-4f55-bbb9-63209a3985d4 req-c6e9c479-5a2a-4859-840c-6577e677a292 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "PUT /v2.0/floatingips/39327416-fca3-4fc6-84f2-31a84b283d83 HTTP/1.1" status: 200 len: 995 time: 2.8730087 May 12 15:08:18.668571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 70e00de6-17a0-4bb3-861d-3630cc5b4a56 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:08:18.754570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 70e00de6-17a0-4bb3-861d-3630cc5b4a56 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:08:18.755184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 70e00de6-17a0-4bb3-861d-3630cc5b4a56 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:08:18.797491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Request body: {'network': {'name': 'tempest-FloatingIPsNegativeTestJSON-563347280-network', 'tenant_id': '609294cb20c74222b602884b6fde24e5'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:18.804163 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:18.808213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Usage tracker for resource:network and tenant:609294cb20c74222b602884b6fde24e5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:18.809522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22105136-7460-4f55-bbb9-63209a3985d4 req-6c64b984-692c-4995-bdb8-086a98df5ec8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:18.811769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:18.817161 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22105136-7460-4f55-bbb9-63209a3985d4 req-6c64b984-692c-4995-bdb8-086a98df5ec8 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 1096 time: 0.1314087 May 12 15:08:18.838977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:18.854529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Made reservation on behalf of 609294cb20c74222b602884b6fde24e5 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:08:18.857099 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:18.874773 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:18.892687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:18.897265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Usage tracker for resource:security_group_rule and tenant:609294cb20c74222b602884b6fde24e5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:18.900575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:18.907561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:18.961704 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-61dd4dee-eb9c-479b-8151-4ca895d18676 None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:19.006378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22105136-7460-4f55-bbb9-63209a3985d4 req-212189b7-8926-4cff-b0ae-efd8ec5c6faf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:19.008140 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22105136-7460-4f55-bbb9-63209a3985d4 req-212189b7-8926-4cff-b0ae-efd8ec5c6faf service neutron] 10.222.0.82 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.1841176 May 12 15:08:19.081766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:19.088060 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:19.130097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 563} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:08:19.146717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ae75455-82fa-42f7-aeeb-f0e51502c2ae,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:19.149891 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:19.151778 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Added segment 763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3 of type vlan for network 15f59a83-2b8a-4caa-8b98-f8f692faf883 May 12 15:08:19.201696 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:19.207779 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22105136-7460-4f55-bbb9-63209a3985d4 req-3d49df47-3ef5-4a0b-88be-f7892addcf10 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 200 len: 998 time: 0.1907601 May 12 15:08:19.248451 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:19.249809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:19.250780 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:19.352310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a643fd4-3a34-41a3-b7c3-425b465796eb req-4056ee08-19f0-4add-8473-3bcd6684a831 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:19.353756 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a643fd4-3a34-41a3-b7c3-425b465796eb req-4056ee08-19f0-4add-8473-3bcd6684a831 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.2665260 May 12 15:08:19.375877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] Pushing event updated for resources: {'Network': ['ID=15f59a83-2b8a-4caa-8b98-f8f692faf883,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:19.381530 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e83f13c4-c537-4447-9c20-f9409ac59a27 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.8066540 May 12 15:08:19.384243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48252) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:19.388152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 15f59a83-2b8a-4caa-8b98-f8f692faf883 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:08:19.389905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Request body: {'subnet': {'network_id': '15f59a83-2b8a-4caa-8b98-f8f692faf883', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPsNegativeTestJSON-563347280-subnet', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:19.395118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:19.416331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Usage tracker for resource:subnet and tenant:609294cb20c74222b602884b6fde24e5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:19.422750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:19.429794 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:19.439074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22105136-7460-4f55-bbb9-63209a3985d4 req-b34d377f-9c40-46d3-8bba-a65b1cb1cd84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:19.441815 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22105136-7460-4f55-bbb9-63209a3985d4 req-b34d377f-9c40-46d3-8bba-a65b1cb1cd84 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.2139208 May 12 15:08:19.452363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Made reservation on behalf of 609294cb20c74222b602884b6fde24e5 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:08:19.457884 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a643fd4-3a34-41a3-b7c3-425b465796eb req-8b1b9048-1852-4c4e-8dff-0e4bff14c86a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0901220 May 12 15:08:19.461165 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-61dd4dee-eb9c-479b-8151-4ca895d18676 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '39327416-fca3-4fc6-84f2-31a84b283d83', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'floating_ip_address': '172.25.8.73', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'port_id': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'mac_address': 'fa:16:3e:79:97:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:07:52Z', 'updated_at': '2022-05-12T15:08:17Z', 'revision_number': 1, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:19.462108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:19.476987 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61dd4dee-eb9c-479b-8151-4ca895d18676 None None] Checking router: 940e3b0e-8287-409c-890e-28addf1cf0b8 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:08:19.508582 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61dd4dee-eb9c-479b-8151-4ca895d18676 None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:19.508936 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-61dd4dee-eb9c-479b-8151-4ca895d18676 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:19.638117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22105136-7460-4f55-bbb9-63209a3985d4 req-7ea325b6-8bd3-4ba3-a157-88981f98528e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:19.647387 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22105136-7460-4f55-bbb9-63209a3985d4 req-7ea325b6-8bd3-4ba3-a157-88981f98528e service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1834953 May 12 15:08:19.655497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-22105136-7460-4f55-bbb9-63209a3985d4 req-4bd7e584-4ff5-44b5-87f3-9f5a103bf666 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:08:19.664096 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22105136-7460-4f55-bbb9-63209a3985d4 req-4bd7e584-4ff5-44b5-87f3-9f5a103bf666 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0154395 May 12 15:08:19.795315 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:19.828390 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-61dd4dee-eb9c-479b-8151-4ca895d18676 None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:19.921427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'tag': '9015ad2b-bc53-4425-beb5-9a5e82176b06'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:19.928295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Pushing event updated for resources: {'Subnet': ['ID=83ba0f0d-d481-4305-b0c1-f74bc09d5138,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:19.938693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Checking segment: {'id': '763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '15f59a83-2b8a-4caa-8b98-f8f692faf883'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:08:19.939017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Network hostable DHCP agents. Network: 15f59a83-2b8a-4caa-8b98-f8f692faf883, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:08:19.948706 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22105136-7460-4f55-bbb9-63209a3985d4 req-a546f4c0-7298-4ca3-9353-af86b90417c8 service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2828000 May 12 15:08:19.989076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Network 15f59a83-2b8a-4caa-8b98-f8f692faf883 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:08:20.010380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 15f59a83-2b8a-4caa-8b98-f8f692faf883) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:08:20.014893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:20.015468 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:20.023690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41636ef4-243f-4b08-b719-b121fc189748 None None] Network 15f59a83-2b8a-4caa-8b98-f8f692faf883 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:08:20.076767 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9cb3ee2f-a56d-4d02-97f6-07372369dd7b admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.6913052 May 12 15:08:20.077501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48276) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:20.085065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Request body: {'router': {'name': 'tempest-FloatingIPsNegativeTestJSON-563347280-router', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:20.100481 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:20.104716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Usage tracker for resource:router and tenant:609294cb20c74222b602884b6fde24e5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:20.110249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:20.121911 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22105136-7460-4f55-bbb9-63209a3985d4 req-0beb01f5-5367-4abf-9c4c-146c83601a67 service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1653883 May 12 15:08:20.125538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:20.165041 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:20.168215 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:20.194017 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:20.561998 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-61dd4dee-eb9c-479b-8151-4ca895d18676 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '39327416-fca3-4fc6-84f2-31a84b283d83', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'floating_ip_address': '172.25.8.73', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'port_id': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'mac_address': 'fa:16:3e:79:97:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:07:52Z', 'updated_at': '2022-05-12T15:08:17Z', 'revision_number': 1, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:20.575565 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61dd4dee-eb9c-479b-8151-4ca895d18676 None None] The sync data for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 is: [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '39327416-fca3-4fc6-84f2-31a84b283d83', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'floating_ip_address': '172.25.8.73', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'port_id': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'mac_address': 'fa:16:3e:79:97:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:07:52Z', 'updated_at': '2022-05-12T15:08:17Z', 'revision_number': 1, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:08:20.592433 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-15f59a83-2b8a-4caa-8b98-f8f692faf883', 'network_id': '15f59a83-2b8a-4caa-8b98-f8f692faf883', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'fixed_ips': [{'subnet_id': '83ba0f0d-d481-4305-b0c1-f74bc09d5138'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:08:20.593190 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:20.606951 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-43970986-7fb4-428c-b3b0-82149bd078db'] response: {'name': 'network-changed', 'server_uuid': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'tag': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'status': 'completed', 'code': 200} May 12 15:08:20.815020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-266468d8-0dfe-4072-bfb2-1d7143c7c3a9 req-d9ab5878-962f-4ce1-a000-c63cfc85bbbe tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:20.816877 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-266468d8-0dfe-4072-bfb2-1d7143c7c3a9 req-d9ab5878-962f-4ce1-a000-c63cfc85bbbe tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.2928736 May 12 15:08:20.925852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Allocated IP 172.20.0.2 (15f59a83-2b8a-4caa-8b98-f8f692faf883/83ba0f0d-d481-4305-b0c1-f74bc09d5138/4190f5c1-50d1-42fe-ad87-7e535d8561a9) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:08:20.951310 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:21.025500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-239bcfb8-2dc0-4e68-8e94-5bfdea374bc8 req-afa31937-604b-4b1c-9898-bbe5abacaffe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:21.030891 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-239bcfb8-2dc0-4e68-8e94-5bfdea374bc8 req-afa31937-604b-4b1c-9898-bbe5abacaffe service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 1096 time: 0.3725896 May 12 15:08:21.040175 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-266468d8-0dfe-4072-bfb2-1d7143c7c3a9 req-067d9207-582f-4afd-a1da-dcc6a52501f3 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1627748 May 12 15:08:21.087571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2df898db-8df2-4388-af5b-398cfa633fe3 None None] New status for floating IP 39327416-fca3-4fc6-84f2-31a84b283d83: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:08:21.193107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-47697fa3-2e3c-4905-8d80-6ceb33468396 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:21.201001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-47697fa3-2e3c-4905-8d80-6ceb33468396 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=127cef03-8661-4b61-a807-7baf9f974c4c&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 946 time: 0.3830330 May 12 15:08:21.475900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-bcb555b3-94b0-4974-a16c-7bd3ef2d1dd9 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.73 HTTP/1.1" status: 200 len: 998 time: 0.2739162 May 12 15:08:21.480503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-f838dbcb-bc42-4fd9-929c-e4a521bcf7fb tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Request body: {'floatingip': {'port_id': '4844ecc9-16ec-4455-af7d-c1e11840b51a', 'fixed_ip_address': '172.20.0.12'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:21.597180 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:21.622576 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Transition to ACTIVE for port object 4190f5c1-50d1-42fe-ad87-7e535d8561a9 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:08:21.633460 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:21.649037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Transition to ACTIVE for port object 4190f5c1-50d1-42fe-ad87-7e535d8561a9 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:08:21.655660 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:21.679031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-239bcfb8-2dc0-4e68-8e94-5bfdea374bc8 req-e2b7d9ee-28f6-4082-aea3-c773ac979000 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:21.680438 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-239bcfb8-2dc0-4e68-8e94-5bfdea374bc8 req-e2b7d9ee-28f6-4082-aea3-c773ac979000 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.6373813 May 12 15:08:21.685422 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:21.747786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Pushing event updated for resources: {'Port': ['ID=4190f5c1-50d1-42fe-ad87-7e535d8561a9,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:21.762220 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:21.762846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:21.763161 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:21.763484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:21.763808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:21.764127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:21.764442 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:21.764754 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:21.765067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:21.765375 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:21.765991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:21.766438 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:21.776356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Network 15f59a83-2b8a-4caa-8b98-f8f692faf883 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:08:21.777743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:08:21.784611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:08:21.866184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Allocated IP 172.25.8.130 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/b785b434-3554-4ebf-82d5-7d9066a9bdae) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:08:21.874273 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-239bcfb8-2dc0-4e68-8e94-5bfdea374bc8 req-f0e20f84-9e76-42fc-bfbf-a7263809078a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 200 len: 1000 time: 0.1396222 May 12 15:08:21.884684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-f838dbcb-bc42-4fd9-929c-e4a521bcf7fb tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:21.942169 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Attempting to bind port 4190f5c1-50d1-42fe-ad87-7e535d8561a9 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:08:21.942809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Attempting to bind port 4190f5c1-50d1-42fe-ad87-7e535d8561a9 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '15f59a83-2b8a-4caa-8b98-f8f692faf883'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:08:21.943335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Attempting to bind port 4190f5c1-50d1-42fe-ad87-7e535d8561a9 on network 15f59a83-2b8a-4caa-8b98-f8f692faf883 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:08:21.951368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 8, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:08:21.952682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Checking segment: {'id': '763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '15f59a83-2b8a-4caa-8b98-f8f692faf883'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:08:21.953257 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:21.953857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Bound using segment: {'id': '763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '15f59a83-2b8a-4caa-8b98-f8f692faf883'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:08:21.954656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Bound port: 4190f5c1-50d1-42fe-ad87-7e535d8561a9, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '15f59a83-2b8a-4caa-8b98-f8f692faf883'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:08:21.955838 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:22.081360 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:22.091398 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] For port 4190f5c1-50d1-42fe-ad87-7e535d8561a9, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:08:22.095224 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] For port 4190f5c1-50d1-42fe-ad87-7e535d8561a9, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4190f5c1-50d1-42fe-ad87-7e535d8561a9,segment=NetworkSegment(763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3),segment_id=763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:08:22.100617 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:22.168929 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:22.188710 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ed6c797-475a-40eb-953f-2b2fdbee8fb7 None None] Pushing event updated for resources: {'Port': ['ID=4190f5c1-50d1-42fe-ad87-7e535d8561a9,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:22.245497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-239bcfb8-2dc0-4e68-8e94-5bfdea374bc8 req-be84c671-f277-4ded-b827-4f1e574eec9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:22.247115 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-239bcfb8-2dc0-4e68-8e94-5bfdea374bc8 req-be84c671-f277-4ded-b827-4f1e574eec9d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.2948835 May 12 15:08:22.362819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fad48bc-74ed-4339-8bf3-4ac468d10619 req-4a328c86-f4bc-4b7a-84bd-4ce99b386e7b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:22.364543 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4fad48bc-74ed-4339-8bf3-4ac468d10619 req-4a328c86-f4bc-4b7a-84bd-4ce99b386e7b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.6873345 May 12 15:08:22.378772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Pushing event updated for resources: {'Port': ['ID=b785b434-3554-4ebf-82d5-7d9066a9bdae,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:22.412457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:08:22.416562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:08:22.426066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:08:22.608114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4fad48bc-74ed-4339-8bf3-4ac468d10619 req-bd5655b4-ad8c-4608-8a68-d6f82703ca23 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2352409 May 12 15:08:22.615243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-239bcfb8-2dc0-4e68-8e94-5bfdea374bc8 req-c755cf1c-e54b-4ea0-9eee-d4d151a2ae86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:22.619133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-239bcfb8-2dc0-4e68-8e94-5bfdea374bc8 req-c755cf1c-e54b-4ea0-9eee-d4d151a2ae86 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3640013 May 12 15:08:23.117719 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-239bcfb8-2dc0-4e68-8e94-5bfdea374bc8 req-7bebc862-0771-4211-a8ff-35b28d9ae222 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3626409 May 12 15:08:23.172452 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:23.462855 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-239bcfb8-2dc0-4e68-8e94-5bfdea374bc8 req-88b154b5-c600-4dd7-aa0c-a8384c71d9fc service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3338978 May 12 15:08:23.481973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9f7c92e-c016-48a2-9a29-7ad5b9438a4b req-7bc591f0-dc42-4aac-ae47-56a30fd58613 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:23.483503 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9f7c92e-c016-48a2-9a29-7ad5b9438a4b req-7bc591f0-dc42-4aac-ae47-56a30fd58613 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.4753768 May 12 15:08:23.721661 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:23.748976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2af6e481-5266-48c5-977c-34cbc1349983 None None] Network 15f59a83-2b8a-4caa-8b98-f8f692faf883 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:08:23.780179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9f7c92e-c016-48a2-9a29-7ad5b9438a4b req-618766ae-99cd-454a-9ffc-cf70656c63c1 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2738578 May 12 15:08:23.810229 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-f838dbcb-bc42-4fd9-929c-e4a521bcf7fb tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:23.817010 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-f838dbcb-bc42-4fd9-929c-e4a521bcf7fb tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:23.847918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e01c6571-0b8b-4a8b-ae40-6a935e31a6d6 None None] Provisioning for port 4190f5c1-50d1-42fe-ad87-7e535d8561a9 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:08:23.981653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48338) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:24.036828 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-f838dbcb-bc42-4fd9-929c-e4a521bcf7fb tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Floating IP 39327416-fca3-4fc6-84f2-31a84b283d83 associated. External IP: 172.25.8.73, port: 9015ad2b-bc53-4425-beb5-9a5e82176b06. May 12 15:08:24.122864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-a9654644-4d57-425a-8840-cdf18eed2db4 admin admin] Deleting subnet c0f56151-d24d-48be-862b-d25eff2d2fb5 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:08:24.148044 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a9654644-4d57-425a-8840-cdf18eed2db4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:24.244328 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a9654644-4d57-425a-8840-cdf18eed2db4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:24.333914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Router 9f298a9e-5220-4e39-9a41-71d509e7d361 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:08:24.339776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af20a0db-0625-4986-990e-c4c44efa109b req-09e7d633-7869-4f57-a7ba-eba2bb3c39ed tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:24.345118 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af20a0db-0625-4986-990e-c4c44efa109b req-09e7d633-7869-4f57-a7ba-eba2bb3c39ed tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.2385488 May 12 15:08:24.430341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4190f5c1-50d1-42fe-ad87-7e535d8561a9 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:08:24.430652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af20a0db-0625-4986-990e-c4c44efa109b req-1c150e33-39d7-41dd-80e7-50a1421122f9 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0697737 May 12 15:08:24.522288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 4190f5c1-50d1-42fe-ad87-7e535d8561a9 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:08:24.528041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4190f5c1-50d1-42fe-ad87-7e535d8561a9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:24.528470 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:24.669851 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a9654644-4d57-425a-8840-cdf18eed2db4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:24.723507 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:24.739557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-f838dbcb-bc42-4fd9-929c-e4a521bcf7fb tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Router 940e3b0e-8287-409c-890e-28addf1cf0b8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:08:24.785291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 4190f5c1-50d1-42fe-ad87-7e535d8561a9, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4190f5c1-50d1-42fe-ad87-7e535d8561a9,segment=NetworkSegment(763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3),segment_id=763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:24.791518 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a9654644-4d57-425a-8840-cdf18eed2db4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:24.801246 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:24.831713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:08:24.841183 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Sync routers for ids ['9f298a9e-5220-4e39-9a41-71d509e7d361'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:08:24.845227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9654644-4d57-425a-8840-cdf18eed2db4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c0f56151-d24d-48be-862b-d25eff2d2fb5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:24.857738 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a9654644-4d57-425a-8840-cdf18eed2db4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:24.863475 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Routers {'9f298a9e-5220-4e39-9a41-71d509e7d361'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:24.865375 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9f298a9e-5220-4e39-9a41-71d509e7d361'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:24.871707 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a9654644-4d57-425a-8840-cdf18eed2db4 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/c0f56151-d24d-48be-862b-d25eff2d2fb5 HTTP/1.1" status: 204 len: 168 time: 0.8933625 May 12 15:08:24.874969 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48362) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:24.883723 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:24.888416 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ad074183-230b-42d3-a516-df413e1bb1ac admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 4.8098409 May 12 15:08:24.892992 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48366) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:24.923192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=4190f5c1-50d1-42fe-ad87-7e535d8561a9,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:25.172117 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb44cae4-4015-41b7-ae36-11e82b25c82e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:25.197927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-f838dbcb-bc42-4fd9-929c-e4a521bcf7fb tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:08:25.210922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ce4514c-1801-4d1a-b06e-f8631d1506c5 None None] Sync routers for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:08:25.225261 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Set router 9f298a9e-5220-4e39-9a41-71d509e7d361 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:25.227675 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ce4514c-1801-4d1a-b06e-f8631d1506c5 None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:25.228336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4ce4514c-1801-4d1a-b06e-f8631d1506c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:25.522455 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-4ce4514c-1801-4d1a-b06e-f8631d1506c5 None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:25.784100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c328593-184b-42af-9f56-08b554e98190 req-2b3dc417-d67d-4017-9b01-c06bc3d65ec9 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:25.786781 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c328593-184b-42af-9f56-08b554e98190 req-2b3dc417-d67d-4017-9b01-c06bc3d65ec9 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.7132139 May 12 15:08:25.788844 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb44cae4-4015-41b7-ae36-11e82b25c82e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:25.851061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fb44cae4-4015-41b7-ae36-11e82b25c82e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:25.887739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fb44cae4-4015-41b7-ae36-11e82b25c82e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bdd0c2de-fa4b-4564-94df-a91528c8916f') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:25.888518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fb44cae4-4015-41b7-ae36-11e82b25c82e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bdd0c2de-fa4b-4564-94df-a91528c8916f') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:25.891770 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'name': 'tempest-FloatingIPsNegativeTestJSON-563347280-router', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.130'}], 'enable_snat': True}, 'gw_port_id': 'b785b434-3554-4ebf-82d5-7d9066a9bdae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:08:20Z', 'updated_at': '2022-05-12T15:08:22Z', 'revision_number': 3, 'project_id': '609294cb20c74222b602884b6fde24e5', 'gw_port': {'id': 'b785b434-3554-4ebf-82d5-7d9066a9bdae', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:c4:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'device_owner': 'network:router_gateway', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:08:21Z', 'updated_at': '2022-05-12T15:08:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:25.905313 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Checking router: 9f298a9e-5220-4e39-9a41-71d509e7d361 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:08:25.907388 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Updating router 9f298a9e-5220-4e39-9a41-71d509e7d361 port b785b434-3554-4ebf-82d5-7d9066a9bdae binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:08:25.990629 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:25.995190 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb44cae4-4015-41b7-ae36-11e82b25c82e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:26.017221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c328593-184b-42af-9f56-08b554e98190 req-ece70c85-a372-4a7f-be60-4bf2da0147ad tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2164607 May 12 15:08:26.097291 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb44cae4-4015-41b7-ae36-11e82b25c82e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:26.137227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fb44cae4-4015-41b7-ae36-11e82b25c82e admin admin] Releasing vlan 562 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:08:26.137883 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb44cae4-4015-41b7-ae36-11e82b25c82e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: timer() May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:08:26.166065 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:08:26.240542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4ce4514c-1801-4d1a-b06e-f8631d1506c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '39327416-fca3-4fc6-84f2-31a84b283d83', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'floating_ip_address': '172.25.8.73', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'port_id': '4844ecc9-16ec-4455-af7d-c1e11840b51a', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'mac_address': 'fa:16:3e:e1:a6:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '127cef03-8661-4b61-a807-7baf9f974c4c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:07:52Z', 'updated_at': '2022-05-12T15:08:23Z', 'revision_number': 3, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:26.246996 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ce4514c-1801-4d1a-b06e-f8631d1506c5 None None] Checking router: 940e3b0e-8287-409c-890e-28addf1cf0b8 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:08:26.259352 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ce4514c-1801-4d1a-b06e-f8631d1506c5 None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:26.260157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4ce4514c-1801-4d1a-b06e-f8631d1506c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:26.365690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-f838dbcb-bc42-4fd9-929c-e4a521bcf7fb tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Router 940e3b0e-8287-409c-890e-28addf1cf0b8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:08:26.409558 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4190f5c1-50d1-42fe-ad87-7e535d8561a9 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:08:26.471320 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:26.540462 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb44cae4-4015-41b7-ae36-11e82b25c82e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:26.550734 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb44cae4-4015-41b7-ae36-11e82b25c82e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:26.600817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb44cae4-4015-41b7-ae36-11e82b25c82e admin admin] Pushing event deleted for resources: {'Network': ['ID=4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:26.628871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fb44cae4-4015-41b7-ae36-11e82b25c82e admin admin] 10.222.0.82 "DELETE /v2.0/networks/4ea2a38a-48ad-4a0c-8ed9-4cd857eebd8c HTTP/1.1" status: 204 len: 168 time: 1.7496560 May 12 15:08:26.638732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4190f5c1-50d1-42fe-ad87-7e535d8561a9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:26.639105 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:26.734895 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:26.743947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-f838dbcb-bc42-4fd9-929c-e4a521bcf7fb tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:08:26.752962 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-f838dbcb-bc42-4fd9-929c-e4a521bcf7fb tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:26.768453 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Transition to ACTIVE for port object b785b434-3554-4ebf-82d5-7d9066a9bdae will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:08:26.775806 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:26.810618 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-4ce4514c-1801-4d1a-b06e-f8631d1506c5 None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:26.865907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806a51f3-5ba7-4425-b8d2-d7142d1fe178 req-4db3332e-8f70-4822-ba9f-90da2342d7a2 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:26.868350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48386) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:26.880228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-806a51f3-5ba7-4425-b8d2-d7142d1fe178 req-4db3332e-8f70-4822-ba9f-90da2342d7a2 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.4050322 May 12 15:08:26.932045 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Attempting to bind port b785b434-3554-4ebf-82d5-7d9066a9bdae on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:08:26.932624 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Attempting to bind port b785b434-3554-4ebf-82d5-7d9066a9bdae by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:08:26.932720 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Attempting to bind port b785b434-3554-4ebf-82d5-7d9066a9bdae on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:08:26.947273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'tag': '9015ad2b-bc53-4425-beb5-9a5e82176b06'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:26.970455 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 8, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:08:26.971569 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e8fc86d2-b750-418c-b03d-ace2b5155da9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=43dcdbeffdc84fb38f8c99a9f1d5c9cc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1011269 May 12 15:08:26.973628 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:08:26.974041 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:26.974435 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:08:26.974917 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Bound port: b785b434-3554-4ebf-82d5-7d9066a9bdae, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:08:26.975301 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:26.976304 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48392) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:27.019604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Allocated IP 172.20.0.1 (15f59a83-2b8a-4caa-8b98-f8f692faf883/83ba0f0d-d481-4305-b0c1-f74bc09d5138/4a9cb98c-0f32-4a71-b603-45bfa5b3e92b) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:08:27.035017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-f838dbcb-bc42-4fd9-929c-e4a521bcf7fb tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "PUT /v2.0/floatingips/39327416-fca3-4fc6-84f2-31a84b283d83 HTTP/1.1" status: 200 len: 998 time: 5.5577149 May 12 15:08:27.045305 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-811bf90c-f7d1-4e5f-a1a3-81779630ffe4 None None] Pushing event updated for resources: {'Port': ['ID=b785b434-3554-4ebf-82d5-7d9066a9bdae,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:27.059958 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-811bf90c-f7d1-4e5f-a1a3-81779630ffe4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:27.060346 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-811bf90c-f7d1-4e5f-a1a3-81779630ffe4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:27.060764 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-811bf90c-f7d1-4e5f-a1a3-81779630ffe4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:27.061088 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-811bf90c-f7d1-4e5f-a1a3-81779630ffe4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:27.061420 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-811bf90c-f7d1-4e5f-a1a3-81779630ffe4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:27.061740 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-811bf90c-f7d1-4e5f-a1a3-81779630ffe4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:27.062051 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-811bf90c-f7d1-4e5f-a1a3-81779630ffe4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:27.062471 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-811bf90c-f7d1-4e5f-a1a3-81779630ffe4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:27.062821 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-811bf90c-f7d1-4e5f-a1a3-81779630ffe4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:27.063355 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-811bf90c-f7d1-4e5f-a1a3-81779630ffe4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:27.063670 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-811bf90c-f7d1-4e5f-a1a3-81779630ffe4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:27.063979 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-811bf90c-f7d1-4e5f-a1a3-81779630ffe4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:08:27.088499 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-806a51f3-5ba7-4425-b8d2-d7142d1fe178 req-3d339459-f483-4c25-8901-7bc60dd43300 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2111161 May 12 15:08:27.145479 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] For port b785b434-3554-4ebf-82d5-7d9066a9bdae, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:08:27.150715 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] For port b785b434-3554-4ebf-82d5-7d9066a9bdae, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b785b434-3554-4ebf-82d5-7d9066a9bdae,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:08:27.157816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-2c984f37-84f7-468c-b2cb-060ac68b93ce tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:27.159547 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-2c984f37-84f7-468c-b2cb-060ac68b93ce tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports/9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 200 len: 942 time: 0.1239247 May 12 15:08:27.167526 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:27.324237 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-07db620d-d8b8-4114-9789-1885ece396cb'] response: {'name': 'network-changed', 'server_uuid': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'tag': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'status': 'completed', 'code': 200} May 12 15:08:27.373091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d14259b-9005-472b-8d08-03661ebb5afb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:27.380912 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-811bf90c-f7d1-4e5f-a1a3-81779630ffe4 None None] Pushing event updated for resources: {'Port': ['ID=b785b434-3554-4ebf-82d5-7d9066a9bdae,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:27.406553 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Routers {'9f298a9e-5220-4e39-9a41-71d509e7d361'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:27.407422 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9f298a9e-5220-4e39-9a41-71d509e7d361'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:27.454035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d14259b-9005-472b-8d08-03661ebb5afb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:27.464228 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4ce4514c-1801-4d1a-b06e-f8631d1506c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '39327416-fca3-4fc6-84f2-31a84b283d83', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'floating_ip_address': '172.25.8.73', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'port_id': '4844ecc9-16ec-4455-af7d-c1e11840b51a', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'mac_address': 'fa:16:3e:e1:a6:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '127cef03-8661-4b61-a807-7baf9f974c4c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:07:52Z', 'updated_at': '2022-05-12T15:08:23Z', 'revision_number': 3, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:27.475379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ce4514c-1801-4d1a-b06e-f8631d1506c5 None None] The sync data for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 is: [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '39327416-fca3-4fc6-84f2-31a84b283d83', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'floating_ip_address': '172.25.8.73', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'port_id': '4844ecc9-16ec-4455-af7d-c1e11840b51a', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'mac_address': 'fa:16:3e:e1:a6:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '127cef03-8661-4b61-a807-7baf9f974c4c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:07:52Z', 'updated_at': '2022-05-12T15:08:23Z', 'revision_number': 3, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:08:27.505308 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:27.544684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Transition to ACTIVE for port object 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:08:27.579314 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d14259b-9005-472b-8d08-03661ebb5afb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:27.592688 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:27.616727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-2742ef1c-71fa-435a-985a-c99fe9fab0aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:27.618341 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-2742ef1c-71fa-435a-985a-c99fe9fab0aa service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 1096 time: 0.3837149 May 12 15:08:27.623159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3d0ea65-2cb0-44ee-9b34-59a3d1a44eb5 req-ba4505d6-3df7-4aa6-93f5-62b82d9571bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:27.623919 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3d0ea65-2cb0-44ee-9b34-59a3d1a44eb5 req-ba4505d6-3df7-4aa6-93f5-62b82d9571bc service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 1096 time: 0.2989297 May 12 15:08:27.652090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d14259b-9005-472b-8d08-03661ebb5afb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4849d4e4-8875-4f2c-b148-7a6793bc68a2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:27.699495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Network 15f59a83-2b8a-4caa-8b98-f8f692faf883 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:08:27.704712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:08:27.705124 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] Set router 9f298a9e-5220-4e39-9a41-71d509e7d361 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:27.709879 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d14259b-9005-472b-8d08-03661ebb5afb admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:27.712445 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1d14259b-9005-472b-8d08-03661ebb5afb admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4849d4e4-8875-4f2c-b148-7a6793bc68a2 HTTP/1.1" status: 204 len: 168 time: 0.7343934 May 12 15:08:27.717150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:08:27.749888 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Pushing event updated for resources: {'Port': ['ID=4a9cb98c-0f32-4a71-b603-45bfa5b3e92b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:27.776907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-449a4951-2144-4e9a-b0d8-0d960ad78d1a req-7c3454d7-3c72-4d0d-85da-221bed427a64 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:27.786148 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-449a4951-2144-4e9a-b0d8-0d960ad78d1a req-7c3454d7-3c72-4d0d-85da-221bed427a64 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.3561983 May 12 15:08:27.793318 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:27.960764 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-faa39b6e-5f1e-46ea-a8d0-461cafd6da5a None None] New status for floating IP 39327416-fca3-4fc6-84f2-31a84b283d83: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:08:27.970434 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-449a4951-2144-4e9a-b0d8-0d960ad78d1a req-d7139c8d-0c6d-40c5-b763-3f21811830bc tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1786427 May 12 15:08:28.168721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-832458c3-9682-4d5f-bf0b-2f198d768a35 None None] Provisioning for port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:08:28.176229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-832458c3-9682-4d5f-bf0b-2f198d768a35 None None] Provisioning complete for port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:28.176640 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-832458c3-9682-4d5f-bf0b-2f198d768a35 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:28.259734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:28.277117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-832458c3-9682-4d5f-bf0b-2f198d768a35 None None] Port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:08:28.383495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3d0ea65-2cb0-44ee-9b34-59a3d1a44eb5 req-0dbfe615-7ce1-4918-bb0f-a26d47763738 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:28.384894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3d0ea65-2cb0-44ee-9b34-59a3d1a44eb5 req-0dbfe615-7ce1-4918-bb0f-a26d47763738 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.7512460 May 12 15:08:28.406988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-0677a66e-bced-4ab8-ab45-525d485b9b03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:28.408808 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-0677a66e-bced-4ab8-ab45-525d485b9b03 service neutron] 10.222.0.82 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.7479820 May 12 15:08:28.619687 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3d0ea65-2cb0-44ee-9b34-59a3d1a44eb5 req-d29f523f-6cdd-4d65-8fca-a50c55133fd4 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 200 len: 217 time: 0.2049763 May 12 15:08:28.641072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-6206239b-c401-49c5-a60e-540f1f6e6353 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 200 len: 217 time: 0.1072066 May 12 15:08:28.713682 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:28.723968 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:28.731188 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'name': 'tempest-FloatingIPsNegativeTestJSON-563347280-router', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.130'}], 'enable_snat': True}, 'gw_port_id': 'b785b434-3554-4ebf-82d5-7d9066a9bdae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:08:20Z', 'updated_at': '2022-05-12T15:08:22Z', 'revision_number': 3, 'project_id': '609294cb20c74222b602884b6fde24e5', 'gw_port': {'id': 'b785b434-3554-4ebf-82d5-7d9066a9bdae', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:c4:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'device_owner': 'network:router_gateway', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:08:21Z', 'updated_at': '2022-05-12T15:08:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:28.739338 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a77d63a-0bb0-4dbb-8f75-80f66f85c04e None None] The sync data for ids ['9f298a9e-5220-4e39-9a41-71d509e7d361'] in n-d-841483-1 is: [{'id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'name': 'tempest-FloatingIPsNegativeTestJSON-563347280-router', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.130'}], 'enable_snat': True}, 'gw_port_id': 'b785b434-3554-4ebf-82d5-7d9066a9bdae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:08:20Z', 'updated_at': '2022-05-12T15:08:22Z', 'revision_number': 3, 'project_id': '609294cb20c74222b602884b6fde24e5', 'gw_port': {'id': 'b785b434-3554-4ebf-82d5-7d9066a9bdae', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:c4:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'device_owner': 'network:router_gateway', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:08:21Z', 'updated_at': '2022-05-12T15:08:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:08:28.792606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfa39638-b86a-4a92-8c49-f02a04b69a64 None None] Sync routers for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:08:28.810547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfa39638-b86a-4a92-8c49-f02a04b69a64 None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:28.813522 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-bfa39638-b86a-4a92-8c49-f02a04b69a64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:28.887265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:28.915983 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3d0ea65-2cb0-44ee-9b34-59a3d1a44eb5 req-8734c731-230c-4934-a03f-f0086a1add4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:28.918860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3d0ea65-2cb0-44ee-9b34-59a3d1a44eb5 req-8734c731-230c-4934-a03f-f0086a1add4f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.2875180 May 12 15:08:29.028094 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a9098c28-1fb1-4826-9018-6ba7d7cf0b9a tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:29.036979 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a9098c28-1fb1-4826-9018-6ba7d7cf0b9a tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 820 time: 0.6637743 May 12 15:08:29.042207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-1578434b-e152-4d55-8f1f-474dc1ee1cdf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:29.047499 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-1578434b-e152-4d55-8f1f-474dc1ee1cdf service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.3685150 May 12 15:08:29.104511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-bfa39638-b86a-4a92-8c49-f02a04b69a64 None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:29.163288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-0ee7a675-04b3-4d2c-8986-d710e8415cf8 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/quotas/1b3825228b0e4c42a381540b66ea23d6 HTTP/1.1" status: 200 len: 375 time: 0.1253018 May 12 15:08:29.274262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48440) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:29.307811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Pushing event updated for resources: {'Port': ['ID=4a9cb98c-0f32-4a71-b603-45bfa5b3e92b,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:29.320071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Network 15f59a83-2b8a-4caa-8b98-f8f692faf883 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:08:29.321502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:08:29.332337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '127cef03-8661-4b61-a807-7baf9f974c4c', 'tag': '4844ecc9-16ec-4455-af7d-c1e11840b51a'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:29.412118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3d0ea65-2cb0-44ee-9b34-59a3d1a44eb5 req-e131e917-e00b-4a8c-a508-2fae47d2ab15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:29.414248 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3d0ea65-2cb0-44ee-9b34-59a3d1a44eb5 req-e131e917-e00b-4a8c-a508-2fae47d2ab15 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4885271 May 12 15:08:29.550583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Router 9f298a9e-5220-4e39-9a41-71d509e7d361 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:08:29.612331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Request body: {'network': {'name': 'tempest-ServerPasswordTestJSON-119014360-network', 'tenant_id': '153fc52d3d58413ebbcf4e094c9ec085'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:29.634696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-b939166b-5cfc-4cbc-a680-f671be5d21e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:29.642526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-b939166b-5cfc-4cbc-a680-f671be5d21e6 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5561655 May 12 15:08:29.645865 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:29.655931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-a51a6090-13b6-42a9-907e-b23d4b88e83b service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:08:29.665979 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-a51a6090-13b6-42a9-907e-b23d4b88e83b service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0220919 May 12 15:08:29.675079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Usage tracker for resource:network and tenant:153fc52d3d58413ebbcf4e094c9ec085 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:29.709123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:29.728513 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-6ff9aac8-70df-4ad5-bf4f-817711565a50 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&fields=id HTTP/1.1" status: 200 len: 348 time: 0.5635269 May 12 15:08:29.747073 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ca5ecc47-0ddf-4efe-bddc-8c438e91a0ab None None] Provisioning complete for port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:29.747445 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ca5ecc47-0ddf-4efe-bddc-8c438e91a0ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:29.774769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:29.803855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:08:29.810596 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4a1e6ce7-5bfd-42a5-80a5-862263d195a0 admin admin] 10.222.0.82 "PUT /v2.0/routers/9f298a9e-5220-4e39-9a41-71d509e7d361/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.9162972 May 12 15:08:29.859480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ca5ecc47-0ddf-4efe-bddc-8c438e91a0ab None None] Port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:08:29.886115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-bfa39638-b86a-4a92-8c49-f02a04b69a64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '39327416-fca3-4fc6-84f2-31a84b283d83', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'floating_ip_address': '172.25.8.73', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'port_id': '4844ecc9-16ec-4455-af7d-c1e11840b51a', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'mac_address': 'fa:16:3e:e1:a6:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '127cef03-8661-4b61-a807-7baf9f974c4c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:07:52Z', 'updated_at': '2022-05-12T15:08:28Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:29.890867 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfa39638-b86a-4a92-8c49-f02a04b69a64 None None] Checking router: 940e3b0e-8287-409c-890e-28addf1cf0b8 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:08:29.900839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfa39638-b86a-4a92-8c49-f02a04b69a64 None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:29.901506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-bfa39638-b86a-4a92-8c49-f02a04b69a64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:29.933788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Made reservation on behalf of 153fc52d3d58413ebbcf4e094c9ec085 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:08:29.936057 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:29.960553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:29.977607 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3d0ea65-2cb0-44ee-9b34-59a3d1a44eb5 req-4ffea4c1-9ff5-4198-87eb-9431e3e11f88 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5509336 May 12 15:08:30.030840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:30.098274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-bfa39638-b86a-4a92-8c49-f02a04b69a64 None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:30.098486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Usage tracker for resource:security_group_rule and tenant:153fc52d3d58413ebbcf4e094c9ec085 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:30.120698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:30.149227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:30.152550 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-1bd4f66d-60af-47eb-84d5-c1946223b3a9 service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4810300 May 12 15:08:30.157491 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a7c8a87a-cf60-4811-bacf-00af20c70862 service neutron] 10.222.0.82 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3641768 May 12 15:08:30.374626 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b785b434-3554-4ebf-82d5-7d9066a9bdae up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:08:30.391059 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3d0ea65-2cb0-44ee-9b34-59a3d1a44eb5 req-4bee0641-3a95-4eba-83a4-8b6cf38bf6fd service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3956614 May 12 15:08:30.521922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port b785b434-3554-4ebf-82d5-7d9066a9bdae completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:08:30.533301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b785b434-3554-4ebf-82d5-7d9066a9bdae triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:30.533686 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:30.583861 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-92a961d7-30f2-43a7-ba3a-ed803e1d2e4a service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4214470 May 12 15:08:30.597105 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-318c7d6d-743f-4142-9491-83a6d9dbf240 service neutron] 10.222.0.82 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4064760 May 12 15:08:30.631335 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:30.644500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-bfa39638-b86a-4a92-8c49-f02a04b69a64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '39327416-fca3-4fc6-84f2-31a84b283d83', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'floating_ip_address': '172.25.8.73', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'port_id': '4844ecc9-16ec-4455-af7d-c1e11840b51a', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'mac_address': 'fa:16:3e:e1:a6:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '127cef03-8661-4b61-a807-7baf9f974c4c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:07:52Z', 'updated_at': '2022-05-12T15:08:28Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:30.661253 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfa39638-b86a-4a92-8c49-f02a04b69a64 None None] The sync data for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 is: [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '39327416-fca3-4fc6-84f2-31a84b283d83', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'floating_ip_address': '172.25.8.73', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'port_id': '4844ecc9-16ec-4455-af7d-c1e11840b51a', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'mac_address': 'fa:16:3e:e1:a6:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '127cef03-8661-4b61-a807-7baf9f974c4c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:07:52Z', 'updated_at': '2022-05-12T15:08:28Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:08:30.675469 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:30.682134 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:30.702575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port b785b434-3554-4ebf-82d5-7d9066a9bdae, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b785b434-3554-4ebf-82d5-7d9066a9bdae,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:30.707646 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:30.716123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 552} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:08:30.756882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=32089edf-5255-423f-8e69-be133d389cd9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:30.760577 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:30.761178 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Added segment 6eefd9b4-779d-4776-9b4f-7ffc772f0b91 of type vlan for network b6e076d7-9d8e-4b84-bc09-feef5e2b7c21 May 12 15:08:30.796295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=b785b434-3554-4ebf-82d5-7d9066a9bdae,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:30.804807 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:30.818858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-08893c0b-a984-422d-a8b9-9be50314a6f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:30.820342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-08893c0b-a984-422d-a8b9-9be50314a6f1 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 1097 time: 0.1865904 May 12 15:08:30.870472 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:30.872099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:30.872935 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:31.076978 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Sync routers for ids ['9f298a9e-5220-4e39-9a41-71d509e7d361'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:08:31.079748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48468) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:31.080436 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.7928264 May 12 15:08:31.087194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Request body: {'subnet': {'network_id': 'b6e076d7-9d8e-4b84-bc09-feef5e2b7c21', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerPasswordTestJSON-119014360-subnet', 'tenant_id': '153fc52d3d58413ebbcf4e094c9ec085', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:31.088003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adf4d3ae-cc56-4868-8f31-06f80047ee01 admin admin] Pushing event updated for resources: {'Network': ['ID=b6e076d7-9d8e-4b84-bc09-feef5e2b7c21,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:31.099820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network b6e076d7-9d8e-4b84-bc09-feef5e2b7c21 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:08:31.100539 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Routers {'9f298a9e-5220-4e39-9a41-71d509e7d361'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:31.101159 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9f298a9e-5220-4e39-9a41-71d509e7d361'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:31.101824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:31.106120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Usage tracker for resource:subnet and tenant:153fc52d3d58413ebbcf4e094c9ec085 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:31.109524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:31.116605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:31.117662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-eaf0e89c-1f0a-4e9f-ba81-c54b985d15ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:31.119507 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-eaf0e89c-1f0a-4e9f-ba81-c54b985d15ef service neutron] 10.222.0.82 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.2888010 May 12 15:08:31.143625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Made reservation on behalf of 153fc52d3d58413ebbcf4e094c9ec085 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:08:31.147731 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:31.283552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-ab5e51fd-3a8b-4c21-8acc-273669c90cef service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4844ecc9-16ec-4455-af7d-c1e11840b51a HTTP/1.1" status: 200 len: 1001 time: 0.1563587 May 12 15:08:31.355384 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Set router 9f298a9e-5220-4e39-9a41-71d509e7d361 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:31.382217 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-4ffce9a9-aa81-4481-8ad3-d688dc1e36a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:31.384175 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-4ffce9a9-aa81-4481-8ad3-d688dc1e36a2 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.0939536 May 12 15:08:31.496542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-a6664593-0253-49b9-bcdc-6f3e80318b54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:31.498539 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-a6664593-0253-49b9-bcdc-6f3e80318b54 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1081426 May 12 15:08:31.616743 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:31.720350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Pushing event updated for resources: {'Subnet': ['ID=110673fc-f28f-4534-af1b-b57b5d397f0f,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:31.728121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Checking segment: {'id': '6eefd9b4-779d-4776-9b4f-7ffc772f0b91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': 'b6e076d7-9d8e-4b84-bc09-feef5e2b7c21'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:08:31.728817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Network hostable DHCP agents. Network: b6e076d7-9d8e-4b84-bc09-feef5e2b7c21, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:08:31.751418 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'name': 'tempest-FloatingIPsNegativeTestJSON-563347280-router', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.130'}], 'enable_snat': True}, 'gw_port_id': 'b785b434-3554-4ebf-82d5-7d9066a9bdae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:08:20Z', 'updated_at': '2022-05-12T15:08:28Z', 'revision_number': 4, 'project_id': '609294cb20c74222b602884b6fde24e5', 'gw_port': {'id': 'b785b434-3554-4ebf-82d5-7d9066a9bdae', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:c4:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'device_owner': 'network:router_gateway', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:08:21Z', 'updated_at': '2022-05-12T15:08:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4a9cb98c-0f32-4a71-b603-45bfa5b3e92b', 'name': '', 'network_id': '15f59a83-2b8a-4caa-8b98-f8f692faf883', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'mac_address': 'fa:16:3e:3f:9a:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'device_owner': 'network:router_interface', 'standard_attr_id': 573, 'fixed_ips': [{'subnet_id': '83ba0f0d-d481-4305-b0c1-f74bc09d5138', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:08:26Z', 'updated_at': '2022-05-12T15:08:28Z', 'revision_number': 2, 'project_id': '609294cb20c74222b602884b6fde24e5', 'subnets': [{'id': '83ba0f0d-d481-4305-b0c1-f74bc09d5138', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:31.758620 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Checking router: 9f298a9e-5220-4e39-9a41-71d509e7d361 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:08:31.759431 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Updating router 9f298a9e-5220-4e39-9a41-71d509e7d361 port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:08:31.760628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Network b6e076d7-9d8e-4b84-bc09-feef5e2b7c21 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:08:31.765813 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-9e6af724-c49b-4504-8e83-64f591a8e33f service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2563174 May 12 15:08:31.780455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-023c15cc-c8ad-4f33-8f87-3c8e41616ded req-a9749707-73c2-4d3c-a409-8d6c7213e799 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:31.782033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-023c15cc-c8ad-4f33-8f87-3c8e41616ded req-a9749707-73c2-4d3c-a409-8d6c7213e799 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.1424518 May 12 15:08:31.785615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, b6e076d7-9d8e-4b84-bc09-feef5e2b7c21) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:08:31.796547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a846b8b8-6983-4905-ac5c-a85fe0ac8cf8 None None] Network b6e076d7-9d8e-4b84-bc09-feef5e2b7c21 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:08:31.799425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:31.800452 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:31.843955 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:31.844618 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-725712f3-a7bb-4d1d-b807-124453e11022 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.7620316 May 12 15:08:31.926784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-023c15cc-c8ad-4f33-8f87-3c8e41616ded req-1827aab3-f4a2-4529-aeea-f89d51415f6c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1248107 May 12 15:08:32.020459 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed028bb0-eda8-4f9e-ab91-8ec7e3a399a3 req-11b84c67-246b-4b5f-a019-c3d685498c1c service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2371943 May 12 15:08:32.080764 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:32.169183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-021651af-84ef-447d-a2d8-c7ecf596385c None None] Network b6e076d7-9d8e-4b84-bc09-feef5e2b7c21 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:08:32.188610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4771b52-9257-4631-b8f0-88352abd3d88 req-3cdac53f-8614-476d-bd5d-e39f6b392f6b tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:32.196613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4771b52-9257-4631-b8f0-88352abd3d88 req-3cdac53f-8614-476d-bd5d-e39f6b392f6b tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.1263447 May 12 15:08:32.270954 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4771b52-9257-4631-b8f0-88352abd3d88 req-4e90fffc-cb68-4994-8e02-c54ea43979bb tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683241 May 12 15:08:32.273141 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ce878295-956c-48d1-a204-98bcb245af0d'] response: {'name': 'network-changed', 'server_uuid': '127cef03-8661-4b61-a807-7baf9f974c4c', 'tag': '4844ecc9-16ec-4455-af7d-c1e11840b51a', 'status': 'completed', 'code': 200} May 12 15:08:32.457753 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:32.463924 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b785b434-3554-4ebf-82d5-7d9066a9bdae up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:08:32.473655 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Transition to ACTIVE for port object 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:08:32.480742 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:32.546599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b785b434-3554-4ebf-82d5-7d9066a9bdae triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:32.546972 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:32.550823 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca56de20-5396-41da-b4ca-862c8aa6edab req-9e6e0fae-c6ed-4f52-90b7-0623b9a7d77a tempest-FloatingIPsNegativeTestJSON-346340830 tempest-FloatingIPsNegativeTestJSON-346340830-project] 10.222.0.82 "GET /v2.0/floatingips?tenant_id=609294cb20c74222b602884b6fde24e5 HTTP/1.1" status: 200 len: 217 time: 0.0958006 May 12 15:08:32.574537 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7bb21cf8-4233-4a64-ba0b-b3ec499ec288 req-f71c9176-7fde-449d-a609-4f7dddfa7174 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 210 time: 0.1562572 May 12 15:08:32.626229 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1127541d-458c-4c97-96e1-d50ed80e6509 None None] Pushing event updated for resources: {'Port': ['ID=4a9cb98c-0f32-4a71-b603-45bfa5b3e92b,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:32.801874 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Attempting to bind port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:08:32.802293 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Attempting to bind port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '15f59a83-2b8a-4caa-8b98-f8f692faf883'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:08:32.802655 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Attempting to bind port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b on network 15f59a83-2b8a-4caa-8b98-f8f692faf883 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:08:32.808935 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 8, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:08:32.809292 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Checking segment: {'id': '763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '15f59a83-2b8a-4caa-8b98-f8f692faf883'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:08:32.810097 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:32.810497 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Bound using segment: {'id': '763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '15f59a83-2b8a-4caa-8b98-f8f692faf883'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:08:32.811135 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Bound port: 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '15f59a83-2b8a-4caa-8b98-f8f692faf883'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:08:32.811523 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:32.817063 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bfb591b1-46a1-47a3-b1a5-442bfe70c0b7 req-616d1539-a017-4beb-a229-d2bce8a4bef9 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.73 HTTP/1.1" status: 200 len: 1001 time: 0.2121325 May 12 15:08:32.891883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d74316-2ac4-41b6-ab24-9ff7648b3f3b req-7c2d027c-b56b-4737-9c36-2a860d6a59dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:32.894461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99d74316-2ac4-41b6-ab24-9ff7648b3f3b req-7c2d027c-b56b-4737-9c36-2a860d6a59dd service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 1097 time: 0.5706871 May 12 15:08:32.936061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfb591b1-46a1-47a3-b1a5-442bfe70c0b7 req-5af4a761-a8d8-411b-a96b-f75e1cec64d6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:32.947034 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] For port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:08:32.949025 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bfb591b1-46a1-47a3-b1a5-442bfe70c0b7 req-5af4a761-a8d8-411b-a96b-f75e1cec64d6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports/4844ecc9-16ec-4455-af7d-c1e11840b51a HTTP/1.1" status: 200 len: 943 time: 0.1308758 May 12 15:08:32.953374 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] For port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4a9cb98c-0f32-4a71-b603-45bfa5b3e92b,segment=NetworkSegment(763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3),segment_id=763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:08:32.962304 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:33.067974 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Routers {'9f298a9e-5220-4e39-9a41-71d509e7d361'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:33.069091 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9f298a9e-5220-4e39-9a41-71d509e7d361'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:33.080628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-8260134a-8de6-47a0-99cc-dcf20c365f0c tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:33.082203 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-8260134a-8de6-47a0-99cc-dcf20c365f0c tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.84 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 820 time: 0.3147392 May 12 15:08:33.101929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Request body: {'port': {'device_id': '90ffd47c-e072-4c18-8d59-4ad501ade5d8', 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3', 'admin_state_up': True, 'tenant_id': '1b3825228b0e4c42a381540b66ea23d6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:33.229650 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1127541d-458c-4c97-96e1-d50ed80e6509 None None] Pushing event updated for resources: {'Port': ['ID=4a9cb98c-0f32-4a71-b603-45bfa5b3e92b,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:33.326120 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bfb591b1-46a1-47a3-b1a5-442bfe70c0b7 req-f759362b-6bae-47ef-aff0-2650022c562c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.73 HTTP/1.1" status: 200 len: 1001 time: 0.1945448 May 12 15:08:33.497154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:33.506679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Usage tracker for resource:port and tenant:1b3825228b0e4c42a381540b66ea23d6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:33.510018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:33.529096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:33.530412 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] Set router 9f298a9e-5220-4e39-9a41-71d509e7d361 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:33.557894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Made reservation on behalf of 1b3825228b0e4c42a381540b66ea23d6 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:08:33.560600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfb591b1-46a1-47a3-b1a5-442bfe70c0b7 req-64f2b7da-c6ca-461b-8e11-3574f6326af6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:33.562130 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bfb591b1-46a1-47a3-b1a5-442bfe70c0b7 req-64f2b7da-c6ca-461b-8e11-3574f6326af6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.2106380 May 12 15:08:33.571241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d74316-2ac4-41b6-ab24-9ff7648b3f3b req-0d1e440f-4398-4686-b2a4-ed271e39ad4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:33.572848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99d74316-2ac4-41b6-ab24-9ff7648b3f3b req-0d1e440f-4398-4686-b2a4-ed271e39ad4d service neutron] 10.222.0.84 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.6697607 May 12 15:08:33.575926 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:33.712902 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6dbaaa3f-6809-4eac-8094-8650bd9e7348 req-c3b92e44-b79e-4492-87b3-43a72a971ad2 tempest-FloatingIPsNegativeTestJSON-346340830 tempest-FloatingIPsNegativeTestJSON-346340830-project] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=non_exist_pool HTTP/1.1" status: 200 len: 213 time: 0.1118503 May 12 15:08:33.806157 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Allocated IP 172.20.0.7 (95dd1383-efe7-494d-a1ab-57e293da83a3/bc8f64ab-e415-4d25-919a-8e712e76a5f6/b4e74807-b360-4c0d-894d-809b429ca3a6) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:08:33.903169 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99d74316-2ac4-41b6-ab24-9ff7648b3f3b req-ada27258-2181-4610-afdf-602aadcbcbde service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4844ecc9-16ec-4455-af7d-c1e11840b51a HTTP/1.1" status: 200 len: 1001 time: 0.2985826 May 12 15:08:34.084465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d74316-2ac4-41b6-ab24-9ff7648b3f3b req-994ba2b1-e9f4-4a15-b6dd-1151fc83762a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:34.085421 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'name': 'tempest-FloatingIPsNegativeTestJSON-563347280-router', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.130'}], 'enable_snat': True}, 'gw_port_id': 'b785b434-3554-4ebf-82d5-7d9066a9bdae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:08:20Z', 'updated_at': '2022-05-12T15:08:28Z', 'revision_number': 4, 'project_id': '609294cb20c74222b602884b6fde24e5', 'gw_port': {'id': 'b785b434-3554-4ebf-82d5-7d9066a9bdae', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:c4:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'device_owner': 'network:router_gateway', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:08:21Z', 'updated_at': '2022-05-12T15:08:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4a9cb98c-0f32-4a71-b603-45bfa5b3e92b', 'name': '', 'network_id': '15f59a83-2b8a-4caa-8b98-f8f692faf883', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'mac_address': 'fa:16:3e:3f:9a:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'device_owner': 'network:router_interface', 'standard_attr_id': 573, 'fixed_ips': [{'subnet_id': '83ba0f0d-d481-4305-b0c1-f74bc09d5138', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:08:26Z', 'updated_at': '2022-05-12T15:08:32Z', 'revision_number': 4, 'project_id': '609294cb20c74222b602884b6fde24e5', 'subnets': [{'id': '83ba0f0d-d481-4305-b0c1-f74bc09d5138', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:34.085932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99d74316-2ac4-41b6-ab24-9ff7648b3f3b req-994ba2b1-e9f4-4a15-b6dd-1151fc83762a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.1746106 May 12 15:08:34.095258 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-643f9009-0675-47be-9cd0-52a9a4904a1a None None] The sync data for ids ['9f298a9e-5220-4e39-9a41-71d509e7d361'] in n-d-841483-1 is: [{'id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'name': 'tempest-FloatingIPsNegativeTestJSON-563347280-router', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.130'}], 'enable_snat': True}, 'gw_port_id': 'b785b434-3554-4ebf-82d5-7d9066a9bdae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:08:20Z', 'updated_at': '2022-05-12T15:08:28Z', 'revision_number': 4, 'project_id': '609294cb20c74222b602884b6fde24e5', 'gw_port': {'id': 'b785b434-3554-4ebf-82d5-7d9066a9bdae', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:c4:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'device_owner': 'network:router_gateway', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:08:21Z', 'updated_at': '2022-05-12T15:08:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4a9cb98c-0f32-4a71-b603-45bfa5b3e92b', 'name': '', 'network_id': '15f59a83-2b8a-4caa-8b98-f8f692faf883', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'mac_address': 'fa:16:3e:3f:9a:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'device_owner': 'network:router_interface', 'standard_attr_id': 573, 'fixed_ips': [{'subnet_id': '83ba0f0d-d481-4305-b0c1-f74bc09d5138', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:08:26Z', 'updated_at': '2022-05-12T15:08:32Z', 'revision_number': 4, 'project_id': '609294cb20c74222b602884b6fde24e5', 'subnets': [{'id': '83ba0f0d-d481-4305-b0c1-f74bc09d5138', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:08:34.099357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4309463-b612-4d61-be8e-675a7463bd8e req-94698090-853e-4ac4-bbb4-49472b8a0a56 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:34.100047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a4309463-b612-4d61-be8e-675a7463bd8e req-94698090-853e-4ac4-bbb4-49472b8a0a56 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Synchronizing usage tracker for tenant:153fc52d3d58413ebbcf4e094c9ec085 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:08:34.224347 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:34.283795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a4309463-b612-4d61-be8e-675a7463bd8e req-94698090-853e-4ac4-bbb4-49472b8a0a56 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Unset dirty status for tenant:153fc52d3d58413ebbcf4e094c9ec085 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:08:34.287038 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:34.300236 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4309463-b612-4d61-be8e-675a7463bd8e req-94698090-853e-4ac4-bbb4-49472b8a0a56 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/networks?id=b6e076d7-9d8e-4b84-bc09-feef5e2b7c21 HTTP/1.1" status: 200 len: 812 time: 0.7227073 May 12 15:08:34.304224 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['8a33daa6-587f-4787-befb-2fa6e1051f2c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:08:34.382571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4309463-b612-4d61-be8e-675a7463bd8e req-99f011ca-f4ef-4aa6-8944-3bb63b1f666e tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/quotas/153fc52d3d58413ebbcf4e094c9ec085 HTTP/1.1" status: 200 len: 375 time: 0.0720313 May 12 15:08:34.423460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f28e23d5-b2d8-4209-bbcd-e11347a6e029 req-fa631cd7-f06c-4b96-961e-4246be67914e tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:34.435063 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f28e23d5-b2d8-4209-bbcd-e11347a6e029 req-fa631cd7-f06c-4b96-961e-4246be67914e tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.4024844 May 12 15:08:34.443153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:08:34.482071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Network 95dd1383-efe7-494d-a1ab-57e293da83a3 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:08:34.485904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:08:34.493365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:08:34.545808 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d30165e8-abeb-4100-af5c-756eb0cc4698 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=153fc52d3d58413ebbcf4e094c9ec085&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1500440 May 12 15:08:34.635501 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f28e23d5-b2d8-4209-bbcd-e11347a6e029 req-b4ea1de5-63d0-4f2e-8dda-3b2dde442b89 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1995590 May 12 15:08:34.744458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d74316-2ac4-41b6-ab24-9ff7648b3f3b req-94954691-d8a8-4b89-8880-79ec2e0ae678 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:34.746309 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99d74316-2ac4-41b6-ab24-9ff7648b3f3b req-94954691-d8a8-4b89-8880-79ec2e0ae678 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.6434333 May 12 15:08:34.781236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:08:34.791046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:34.791674 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:34.796853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:34.799272 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:34.810035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Pushing event updated for resources: {'Port': ['ID=b4e74807-b360-4c0d-894d-809b429ca3a6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:34.854222 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-866ccd73-b192-4792-94c9-954a05a980d9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7560947 May 12 15:08:34.876535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Request body: {'port': {'device_id': '90ffd47c-e072-4c18-8d59-4ad501ade5d8', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:35.051655 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:35.081852 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4309463-b612-4d61-be8e-675a7463bd8e req-336810b8-2e49-4792-a65c-f91d389f0f60 service neutron] 10.222.0.82 "GET /v2.0/networks/b6e076d7-9d8e-4b84-bc09-feef5e2b7c21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5349591 May 12 15:08:35.103512 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4a9cb98c-0f32-4a71-b603-45bfa5b3e92b,segment=NetworkSegment(763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3),segment_id=763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:35.103753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:35.118308 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:35.253442 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=4a9cb98c-0f32-4a71-b603-45bfa5b3e92b,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:35.337543 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4309463-b612-4d61-be8e-675a7463bd8e req-2ea2de83-80fb-4d6f-a15a-aa3382bd544f service neutron] 10.222.0.82 "GET /v2.0/networks/b6e076d7-9d8e-4b84-bc09-feef5e2b7c21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2264936 May 12 15:08:35.346960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-825d6a05-0430-4324-8af2-5dd6160b108b req-e40d9331-9bdb-489e-8207-207479b6684f tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:35.354603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-825d6a05-0430-4324-8af2-5dd6160b108b req-e40d9331-9bdb-489e-8207-207479b6684f tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 950 time: 0.4337142 May 12 15:08:35.432842 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99d74316-2ac4-41b6-ab24-9ff7648b3f3b req-e676d859-5b44-4227-b61d-130d41c2ce2b service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6732037 May 12 15:08:35.500933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-825d6a05-0430-4324-8af2-5dd6160b108b req-79b4b322-0de9-475f-ac63-d54c3c5a4c73 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1453905 May 12 15:08:35.869107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b4e74807-b360-4c0d-894d-809b429ca3a6 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:08:35.880108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:35.898044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfd27023-83d4-44fa-8626-e9d6b81c7a1e req-d0cdeab7-1584-4513-ac07-b8b940bd0038 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:35.900087 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cfd27023-83d4-44fa-8626-e9d6b81c7a1e req-d0cdeab7-1584-4513-ac07-b8b940bd0038 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 1101 time: 0.2527850 May 12 15:08:35.950965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Transition to ACTIVE for port object b4e74807-b360-4c0d-894d-809b429ca3a6 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:08:35.986946 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:36.020884 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-340ceae9-2a95-4c37-909b-85cb21147a73 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.73 HTTP/1.1" status: 200 len: 1001 time: 0.2398779 May 12 15:08:36.110210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99d74316-2ac4-41b6-ab24-9ff7648b3f3b req-f42a1196-1465-4980-aa26-6a8fe3da386c service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6600878 May 12 15:08:36.111576 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cfd27023-83d4-44fa-8626-e9d6b81c7a1e req-e159b84f-c5e4-4078-8cd5-5bd3480096e0 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2011666 May 12 15:08:36.135516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-b7d90a17-70cb-4c53-a9c3-8e2fcca3e272 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:36.136877 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-b7d90a17-70cb-4c53-a9c3-8e2fcca3e272 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports/4844ecc9-16ec-4455-af7d-c1e11840b51a HTTP/1.1" status: 200 len: 943 time: 0.1072948 May 12 15:08:36.144712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f22757d-e5fa-4042-aa9f-a37f3120db70 req-0c92c498-9c2f-44ff-9d02-a62e15ac6793 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:36.151609 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f22757d-e5fa-4042-aa9f-a37f3120db70 req-0c92c498-9c2f-44ff-9d02-a62e15ac6793 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 931 time: 0.3717360 May 12 15:08:36.207096 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f22757d-e5fa-4042-aa9f-a37f3120db70 req-2e5fd6b2-9e6f-4198-8bf4-e78872ac0b9b tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511343 May 12 15:08:36.217548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Pushing event updated for resources: {'Port': ['ID=b4e74807-b360-4c0d-894d-809b429ca3a6,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:36.345306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:08:36.363050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:08:36.364875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:08:36.365283 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:08:36.370732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Port b4e74807-b360-4c0d-894d-809b429ca3a6 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:08:36.371162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:08:36.377497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 8, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:08:36.377891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Checking segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:08:36.378366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Bound using segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:08:36.378894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Bound port: b4e74807-b360-4c0d-894d-809b429ca3a6, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:08:36.379340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:36.431990 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-160ef3cf-b887-4d5d-859b-8e41460fb643 req-c1aac8cd-d897-4775-8d46-03865bc74c06 tempest-FloatingIPsNegativeTestJSON-346340830 tempest-FloatingIPsNegativeTestJSON-346340830-project] show failed (client error): The resource could not be found. May 12 15:08:36.443352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-160ef3cf-b887-4d5d-859b-8e41460fb643 req-c1aac8cd-d897-4775-8d46-03865bc74c06 tempest-FloatingIPsNegativeTestJSON-346340830 tempest-FloatingIPsNegativeTestJSON-346340830-project] 10.222.0.82 "GET /v2.0/floatingips/10169e81-528d-4619-a778-11386de25fa0 HTTP/1.1" status: 404 len: 350 time: 0.1763604 May 12 15:08:36.443991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48544) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:36.461342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:36.462240 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:36.547441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:08:36.555077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b4e74807-b360-4c0d-894d-809b429ca3a6,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:08:36.565745 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-47293f17-3a94-4903-9f69-748b727e9597 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.73 HTTP/1.1" status: 200 len: 1001 time: 0.2971644 May 12 15:08:36.567932 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:36.651684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Pushing event updated for resources: {'Port': ['ID=b4e74807-b360-4c0d-894d-809b429ca3a6,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:36.664272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:36.665226 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:36.666984 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-a652e82d-8ebe-4557-b0dd-63b01b25e6b2 service neutron] 10.222.0.84 "PUT /v2.0/ports/b4e74807-b360-4c0d-894d-809b429ca3a6 HTTP/1.1" status: 200 len: 1091 time: 1.7959661 May 12 15:08:36.668099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '90ffd47c-e072-4c18-8d59-4ad501ade5d8', 'tag': 'b4e74807-b360-4c0d-894d-809b429ca3a6'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:36.773318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e5430b6d-6430-4a47-b068-7f891fa37da9 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:08:36.775518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e5430b6d-6430-4a47-b068-7f891fa37da9 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:08:36.808118 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e3cd763-1f8b-4d34-acf3-4cce347cc334 req-904c1ecd-09b8-4a87-beca-0828094733c9 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/ports?device_id=7eab681f-43e0-4c0a-bdb9-74a7ea6de40b HTTP/1.1" status: 200 len: 210 time: 0.0784762 May 12 15:08:36.855577 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-422e717e-eae2-463a-a6c5-a1d523cd3bb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:36.857826 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-422e717e-eae2-463a-a6c5-a1d523cd3bb0 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 1094 time: 0.1044312 May 12 15:08:36.953046 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-ef0e4701-ef6f-46ad-ac02-64ffd84c94b9 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b4e74807-b360-4c0d-894d-809b429ca3a6 HTTP/1.1" status: 200 len: 217 time: 0.0764053 May 12 15:08:37.038538 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:37.049756 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-0dfaae14-955e-4f4f-a6ec-46f7b1cd95d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:37.051677 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-0dfaae14-955e-4f4f-a6ec-46f7b1cd95d1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.0924056 May 12 15:08:37.073192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e5430b6d-6430-4a47-b068-7f891fa37da9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e5430b6d-6430-4a47-b068-7f891fa37da9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:37.080779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-bdb4fa58-819a-44db-a24b-a9a408ba9ef6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:37.088756 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-bdb4fa58-819a-44db-a24b-a9a408ba9ef6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.5220172 May 12 15:08:37.099177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8d278524-0445-4a95-8564-3c04c2f3c41d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e5430b6d-6430-4a47-b068-7f891fa37da9'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:37.105952 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'e5430b6d-6430-4a47-b068-7f891fa37da9', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'e5430b6d-6430-4a47-b068-7f891fa37da9', 'mac_address': 'fa:16:3e:98:d4:eb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.108'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:08:37.112703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e5430b6d-6430-4a47-b068-7f891fa37da9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e5430b6d-6430-4a47-b068-7f891fa37da9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:37.148039 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:37.206447 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-0fd6c008-90b4-4834-be45-ed1eb4c2b1b4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1398644 May 12 15:08:37.237137 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:37.263540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e5430b6d-6430-4a47-b068-7f891fa37da9 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:08:37.269356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=e5430b6d-6430-4a47-b068-7f891fa37da9,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:37.289095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e5430b6d-6430-4a47-b068-7f891fa37da9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e5430b6d-6430-4a47-b068-7f891fa37da9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:37.297052 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:37.426177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=e5430b6d-6430-4a47-b068-7f891fa37da9,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:37.469129 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-35badcef-7ab8-4978-a00a-c58117c37031 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2567554 May 12 15:08:37.632658 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-56fbbd8f-9dd5-481a-9066-1cec6e6e1444 req-3e3ae8f9-eabc-4d02-922c-6673b255e1cd service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1557949 May 12 15:08:37.638063 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-a88331de-d4d9-4fb8-9606-f1e7431b106b tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.73 HTTP/1.1" status: 200 len: 1001 time: 0.5482869 May 12 15:08:37.645648 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['e5430b6d-6430-4a47-b068-7f891fa37da9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:08:37.656732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb405385-cf86-4815-a672-1e00c154976f req-809d2708-19b9-469c-a9a4-694a5cdcdf26 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:37.659573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb405385-cf86-4815-a672-1e00c154976f req-809d2708-19b9-469c-a9a4-694a5cdcdf26 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.7397461 May 12 15:08:37.665659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-63e4dc5b-f27c-46e4-a3cd-0d865262f358 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Request body: {'floatingip': {'port_id': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:37.936380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4309463-b612-4d61-be8e-675a7463bd8e req-6b399f1f-2698-4436-b058-16e55ca4ea5f tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:37.937786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4309463-b612-4d61-be8e-675a7463bd8e req-6b399f1f-2698-4436-b058-16e55ca4ea5f tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.76 "GET /v2.0/networks?id=b6e076d7-9d8e-4b84-bc09-feef5e2b7c21 HTTP/1.1" status: 200 len: 812 time: 0.7787209 May 12 15:08:37.964404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Request body: {'port': {'device_id': '7eab681f-43e0-4c0a-bdb9-74a7ea6de40b', 'network_id': 'b6e076d7-9d8e-4b84-bc09-feef5e2b7c21', 'admin_state_up': True, 'tenant_id': '153fc52d3d58413ebbcf4e094c9ec085'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:37.982087 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-63e4dc5b-f27c-46e4-a3cd-0d865262f358 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:38.073108 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb405385-cf86-4815-a672-1e00c154976f req-d04f4b09-d1bb-4c44-a1bf-fd6b96489927 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3283334 May 12 15:08:38.254458 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-f6d0d4bc-4231-40e9-bad9-03c51e537efe service neutron] 10.222.0.76 "GET /v2.0/ports/a3c95caf-bb88-467f-88c0-e38ce2f7b5ff/bindings/n-h2-841483-1 HTTP/1.1" status: 200 len: 382 time: 0.4208317 May 12 15:08:38.523572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:38.537253 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-63e4dc5b-f27c-46e4-a3cd-0d865262f358 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:38.538349 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Usage tracker for resource:port and tenant:153fc52d3d58413ebbcf4e094c9ec085 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:38.546848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:38.555320 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-63e4dc5b-f27c-46e4-a3cd-0d865262f358 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:38.555620 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-63e4dc5b-f27c-46e4-a3cd-0d865262f358 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Floating IP 39327416-fca3-4fc6-84f2-31a84b283d83 disassociated. External IP: 172.25.8.73, port: 4844ecc9-16ec-4455-af7d-c1e11840b51a. May 12 15:08:38.607937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:38.689699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Made reservation on behalf of 153fc52d3d58413ebbcf4e094c9ec085 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:08:38.693046 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:38.734595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddb62d53-8459-4e6b-8e0c-846a12005d94 req-f12223ab-a819-4edd-adb4-b97c184cab6d tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:38.736724 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ddb62d53-8459-4e6b-8e0c-846a12005d94 req-f12223ab-a819-4edd-adb4-b97c184cab6d tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 949 time: 0.4783180 May 12 15:08:38.778140 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e5430b6d-6430-4a47-b068-7f891fa37da9 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:08:38.852390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port e5430b6d-6430-4a47-b068-7f891fa37da9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:38.852754 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:38.945399 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-d39c7883-fc1d-47f6-801a-a72d24ec0630 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:38.946866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-d39c7883-fc1d-47f6-801a-a72d24ec0630 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333&tenant_id=0da54985cde346e68eeadf965b8bc6d3 HTTP/1.1" status: 200 len: 1101 time: 0.4542594 May 12 15:08:38.957878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ddb62d53-8459-4e6b-8e0c-846a12005d94 req-7dbbc217-5108-4ed1-afaa-3d9a99cd2017 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1685610 May 12 15:08:38.974862 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:39.022105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e5430b6d-6430-4a47-b068-7f891fa37da9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e5430b6d-6430-4a47-b068-7f891fa37da9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:39.027009 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:39.034023 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-cd8296cc-fe92-4cce-9ed7-8cc2460a1d13'] response: {'name': 'network-changed', 'server_uuid': '90ffd47c-e072-4c18-8d59-4ad501ade5d8', 'tag': 'b4e74807-b360-4c0d-894d-809b429ca3a6', 'status': 'completed', 'code': 200} May 12 15:08:39.109195 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=e5430b6d-6430-4a47-b068-7f891fa37da9,revision_number=10']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:39.168504 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d4a2f5fe-e0c7-4b33-a2f6-4800bf66c3a3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:39.177816 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-aabd1d6a-bf4f-416f-8116-66828dcdac1d'] response: {'server_uuid': '8d278524-0445-4a95-8564-3c04c2f3c41d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e5430b6d-6430-4a47-b068-7f891fa37da9', 'code': 200} May 12 15:08:39.201001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09e9b9d-fe16-4e34-80ac-356bee320f31 req-77ac7c28-d608-49c1-871f-25b0ac45bb3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:39.202760 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c09e9b9d-fe16-4e34-80ac-356bee320f31 req-77ac7c28-d608-49c1-871f-25b0ac45bb3f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 1094 time: 0.1176589 May 12 15:08:39.470136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09e9b9d-fe16-4e34-80ac-356bee320f31 req-d151fd68-f098-41ed-8201-811e86ef26f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:39.472403 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c09e9b9d-fe16-4e34-80ac-356bee320f31 req-d151fd68-f098-41ed-8201-811e86ef26f8 service neutron] 10.222.0.84 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.2566638 May 12 15:08:39.540721 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c09e9b9d-fe16-4e34-80ac-356bee320f31 req-54c9fed7-546b-4d12-a6a6-99ff44d24d96 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b4e74807-b360-4c0d-894d-809b429ca3a6 HTTP/1.1" status: 200 len: 217 time: 0.0611336 May 12 15:08:39.606172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09e9b9d-fe16-4e34-80ac-356bee320f31 req-362ba0a5-f475-4608-a95a-3712fdfee2f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:39.607498 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c09e9b9d-fe16-4e34-80ac-356bee320f31 req-362ba0a5-f475-4608-a95a-3712fdfee2f8 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.0599141 May 12 15:08:39.644842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Allocated IP 172.20.0.12 (b6e076d7-9d8e-4b84-bc09-feef5e2b7c21/110673fc-f28f-4534-af1b-b57b5d397f0f/05971417-5c62-469b-bcc4-c4aa1291bb6f) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:08:39.654243 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c09e9b9d-fe16-4e34-80ac-356bee320f31 req-85d32bf1-a79a-4549-8c31-ffc41df937d5 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0403538 May 12 15:08:39.786998 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c09e9b9d-fe16-4e34-80ac-356bee320f31 req-a235a09b-6c86-42fa-9aa4-af2b48f0dde3 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1262627 May 12 15:08:39.856948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-63e4dc5b-f27c-46e4-a3cd-0d865262f358 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Router 940e3b0e-8287-409c-890e-28addf1cf0b8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:08:39.865054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-8d890319-5c76-4da9-b48b-f2ddd32dc17b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:39.866545 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-8d890319-5c76-4da9-b48b-f2ddd32dc17b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 1101 time: 0.6329939 May 12 15:08:39.917251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1219266f-6616-407f-976e-6fdd75553f93 req-07a0913c-29a7-479b-8d80-eebd3dc38d89 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:39.918716 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1219266f-6616-407f-976e-6fdd75553f93 req-07a0913c-29a7-479b-8d80-eebd3dc38d89 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 943 time: 0.6229742 May 12 15:08:39.923027 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c09e9b9d-fe16-4e34-80ac-356bee320f31 req-7b57773e-1921-4661-bcb5-6617b97f0d35 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1281672 May 12 15:08:39.950953 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3341d56-0d65-4b53-b670-591fc782eda7 req-ca2e9660-16c8-4f72-91ae-02651a3cab10 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.5528343 May 12 15:08:40.346940 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1219266f-6616-407f-976e-6fdd75553f93 req-709a108e-c4b5-4fd7-a8f4-0192940c246a tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4009626 May 12 15:08:40.575778 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba000bd7-d944-4bf8-a043-81a189f161ee req-d4eb99db-6927-4205-b877-9d5ec6552a95 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/ports?device_id=7eab681f-43e0-4c0a-bdb9-74a7ea6de40b HTTP/1.1" status: 200 len: 210 time: 0.0961258 May 12 15:08:40.602206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-afae80ca-ba7c-4df0-a98c-06e09d3c4de0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:40.602206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-afae80ca-ba7c-4df0-a98c-06e09d3c4de0 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.7188463 May 12 15:08:40.689423 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:40.729771 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-3cc6b55f-07e9-403b-8607-589914e7d19f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.141&port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff HTTP/1.1" status: 200 len: 217 time: 0.0976775 May 12 15:08:40.737314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-63e4dc5b-f27c-46e4-a3cd-0d865262f358 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:08:40.751256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f9723dd-5291-423b-94cf-2c029610c86a None None] Sync routers for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:08:40.773929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f9723dd-5291-423b-94cf-2c029610c86a None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:40.774617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3f9723dd-5291-423b-94cf-2c029610c86a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:40.783982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3341d56-0d65-4b53-b670-591fc782eda7 req-00876628-6b0d-4c4f-9f4f-5e930a5d38e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:40.785496 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3341d56-0d65-4b53-b670-591fc782eda7 req-00876628-6b0d-4c4f-9f4f-5e930a5d38e9 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 1095 time: 0.7223148 May 12 15:08:40.810473 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-63e4dc5b-f27c-46e4-a3cd-0d865262f358 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:40.869844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d4a2f5fe-e0c7-4b33-a2f6-4800bf66c3a3 admin admin] Deleting port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:08:40.870530 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d4a2f5fe-e0c7-4b33-a2f6-4800bf66c3a3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:40.975167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-3f9723dd-5291-423b-94cf-2c029610c86a None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:41.059739 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-63e4dc5b-f27c-46e4-a3cd-0d865262f358 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "PUT /v2.0/floatingips/39327416-fca3-4fc6-84f2-31a84b283d83 HTTP/1.1" status: 200 len: 694 time: 3.3990912 May 12 15:08:41.061077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-1c709707-2ca3-4b1e-b8f0-278290895c69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:41.062462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-1c709707-2ca3-4b1e-b8f0-278290895c69 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3215775 May 12 15:08:41.067701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '127cef03-8661-4b61-a807-7baf9f974c4c', 'tag': '4844ecc9-16ec-4455-af7d-c1e11840b51a'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:41.184014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8d278524-0445-4a95-8564-3c04c2f3c41d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e5430b6d-6430-4a47-b068-7f891fa37da9'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:41.229699 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:41.307141 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3f9723dd-5291-423b-94cf-2c029610c86a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:41.311063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f9723dd-5291-423b-94cf-2c029610c86a None None] Checking router: 940e3b0e-8287-409c-890e-28addf1cf0b8 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:08:41.319500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f9723dd-5291-423b-94cf-2c029610c86a None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:41.320128 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3f9723dd-5291-423b-94cf-2c029610c86a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:41.378303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a3c95caf-bb88-467f-88c0-e38ce2f7b5ff no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:08:41.388920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Network b6e076d7-9d8e-4b84-bc09-feef5e2b7c21 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:08:41.410291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:08:41.413795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3341d56-0d65-4b53-b670-591fc782eda7 req-8987a587-7f97-4980-a729-aedaa4c0f6df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:41.415033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3341d56-0d65-4b53-b670-591fc782eda7 req-8987a587-7f97-4980-a729-aedaa4c0f6df service neutron] 10.222.0.76 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.5725403 May 12 15:08:41.420699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:08:41.508375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Pushing event updated for resources: {'Port': ['ID=05971417-5c62-469b-bcc4-c4aa1291bb6f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:41.560362 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3341d56-0d65-4b53-b670-591fc782eda7 req-a099c0ef-058b-480d-911d-28a328adbee5 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=41e26787-6db6-4aed-9809-d91a746dcee9 HTTP/1.1" status: 200 len: 217 time: 0.1056802 May 12 15:08:41.621164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ee3262-c7cc-42c0-a516-8d9e374b25b4 req-fbb4872f-ebfc-4c24-8d81-d4eadfc25864 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:41.622670 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33ee3262-c7cc-42c0-a516-8d9e374b25b4 req-fbb4872f-ebfc-4c24-8d81-d4eadfc25864 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.7270839 May 12 15:08:41.624497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-d4a2f5fe-e0c7-4b33-a2f6-4800bf66c3a3 admin admin] For port 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4a9cb98c-0f32-4a71-b603-45bfa5b3e92b,segment=NetworkSegment(763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3),segment_id=763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:41.624850 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d4a2f5fe-e0c7-4b33-a2f6-4800bf66c3a3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:41.652358 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:41.662805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-3f9723dd-5291-423b-94cf-2c029610c86a None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:41.798290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:41.798903 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:41.812243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d4a2f5fe-e0c7-4b33-a2f6-4800bf66c3a3 admin admin] Calling delete_port for 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:08:41.825860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:41.867527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-9e23980b-acbc-4f1b-9ed3-032ed328a9b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:41.869217 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-9e23980b-acbc-4f1b-9ed3-032ed328a9b6 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.7901831 May 12 15:08:41.877860 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:41.925504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-c21ca0c2-6092-4bf4-b377-41c410356978 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:41.927085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-c21ca0c2-6092-4bf4-b377-41c410356978 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 1097 time: 0.8320584 May 12 15:08:41.946605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4309463-b612-4d61-be8e-675a7463bd8e req-099a29f3-5c72-43e7-903e-732e4408b290 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.9877551 May 12 15:08:41.948039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3341d56-0d65-4b53-b670-591fc782eda7 req-f1e0e10e-ab67-4b5a-b788-e489e41d1e73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:41.949477 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3341d56-0d65-4b53-b670-591fc782eda7 req-f1e0e10e-ab67-4b5a-b788-e489e41d1e73 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.3765793 May 12 15:08:41.984631 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:42.013958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33ee3262-c7cc-42c0-a516-8d9e374b25b4 req-eb2add0b-4141-463f-9f26-5d8fcc680106 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3653495 May 12 15:08:42.071186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3f9723dd-5291-423b-94cf-2c029610c86a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:42.075450 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f9723dd-5291-423b-94cf-2c029610c86a None None] The sync data for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 is: [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:08:42.194832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Request body: {'port': {'device_id': '7eab681f-43e0-4c0a-bdb9-74a7ea6de40b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:42.329779 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3341d56-0d65-4b53-b670-591fc782eda7 req-2fc5247e-5dab-42a4-967f-fcaca0b6fd69 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.3047683 May 12 15:08:42.406352 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e33770a-94d2-4a73-923e-7c316c6f12e4 None None] New status for floating IP 39327416-fca3-4fc6-84f2-31a84b283d83: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:08:42.620279 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-00e2a9c3-2b32-44e0-91b9-dbab20fd72ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:42.647154 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:42.663805 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-d7a51411-d6ed-4118-972c-554422ca9e3a service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7686422 May 12 15:08:42.671919 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:42.681166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-ec2a932b-ca3d-44c3-9125-d1f0b3e3c49f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:42.682592 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-ec2a932b-ca3d-44c3-9125-d1f0b3e3c49f service neutron] 10.222.0.82 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.7435369 May 12 15:08:42.875084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3341d56-0d65-4b53-b670-591fc782eda7 req-78b37c07-320a-4272-9d97-76885ebc7a4a service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5228078 May 12 15:08:42.876202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-1e510400-04bd-4ba4-a8eb-941cfda37246 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4844ecc9-16ec-4455-af7d-c1e11840b51a HTTP/1.1" status: 200 len: 217 time: 0.1687281 May 12 15:08:43.149200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-8dba535a-96b3-48b7-b07a-70b516f3be2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:43.150584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-8dba535a-96b3-48b7-b07a-70b516f3be2f service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.2562282 May 12 15:08:43.207176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3242c14a-254c-411d-b2e2-14de65c390c5 req-37c5f34c-2c89-4cc6-abea-c8b523cd551f tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:43.208630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3242c14a-254c-411d-b2e2-14de65c390c5 req-37c5f34c-2c89-4cc6-abea-c8b523cd551f tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 1102 time: 0.7190528 May 12 15:08:43.303155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd364759-c73a-4eed-8348-d3fbf872d2fa req-891bd300-05b5-42dd-8c01-dedfc51990c0 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6162891 May 12 15:08:43.429223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3341d56-0d65-4b53-b670-591fc782eda7 req-6c7bb781-47e7-4319-8103-a7daeeaf0eb7 service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5380518 May 12 15:08:43.452407 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d4a2f5fe-e0c7-4b33-a2f6-4800bf66c3a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:43.490310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3242c14a-254c-411d-b2e2-14de65c390c5 req-bf2463da-957c-4f90-a9ee-65a81a5c34f3 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2210317 May 12 15:08:43.517004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4a2f5fe-e0c7-4b33-a2f6-4800bf66c3a3 admin admin] Pushing event deleted for resources: {'Port': ['ID=4a9cb98c-0f32-4a71-b603-45bfa5b3e92b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:43.557912 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e9f3d66c-202d-4c43-a1e3-15d949999e4e'] response: {'name': 'network-changed', 'server_uuid': '127cef03-8661-4b61-a807-7baf9f974c4c', 'tag': '4844ecc9-16ec-4455-af7d-c1e11840b51a', 'status': 'completed', 'code': 200} May 12 15:08:43.594252 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e319faf1-5dd6-44de-b945-0da3708fca5e'] response: {'server_uuid': '8d278524-0445-4a95-8564-3c04c2f3c41d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e5430b6d-6430-4a47-b068-7f891fa37da9', 'code': 200} May 12 15:08:43.703872 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065cdc4a-3221-4665-9498-92b5c38e111d req-f96bc2a2-5cd1-4491-822d-3225a546cc23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:43.708062 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-065cdc4a-3221-4665-9498-92b5c38e111d req-f96bc2a2-5cd1-4491-822d-3225a546cc23 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 1097 time: 0.1163614 May 12 15:08:43.789096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-4b0399a1-2312-4b73-8409-b0cc12cc9dd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:43.790772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-4b0399a1-2312-4b73-8409-b0cc12cc9dd0 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5923145 May 12 15:08:43.858243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065cdc4a-3221-4665-9498-92b5c38e111d req-387a90e5-1926-4402-94d0-6f7f2e5f24c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:43.859686 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-065cdc4a-3221-4665-9498-92b5c38e111d req-387a90e5-1926-4402-94d0-6f7f2e5f24c5 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.1444209 May 12 15:08:43.932500 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-065cdc4a-3221-4665-9498-92b5c38e111d req-41d567c5-f5fd-44fd-a4ea-35eeb5b99b15 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4844ecc9-16ec-4455-af7d-c1e11840b51a HTTP/1.1" status: 200 len: 217 time: 0.0658162 May 12 15:08:43.998744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065cdc4a-3221-4665-9498-92b5c38e111d req-d5a8bf65-9fec-4ed6-a44f-3daca90ea52d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:44.000184 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-065cdc4a-3221-4665-9498-92b5c38e111d req-d5a8bf65-9fec-4ed6-a44f-3daca90ea52d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.0614183 May 12 15:08:44.076132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065cdc4a-3221-4665-9498-92b5c38e111d req-bc37b3a9-c008-457a-b386-cfa5fba471e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:44.078105 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-065cdc4a-3221-4665-9498-92b5c38e111d req-bc37b3a9-c008-457a-b386-cfa5fba471e0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0713475 May 12 15:08:44.214856 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-065cdc4a-3221-4665-9498-92b5c38e111d req-a3fe0264-f7e4-4df1-b0aa-fa035fcbf680 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1283803 May 12 15:08:44.266814 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-ad95fc79-6b81-4664-9ef2-2de46b2c7812 service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4625969 May 12 15:08:44.301305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 05971417-5c62-469b-bcc4-c4aa1291bb6f {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:08:44.322913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-4c20fd70-e8a9-433e-8d9d-d843b0c0cf66 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:44.324375 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-4c20fd70-e8a9-433e-8d9d-d843b0c0cf66 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.76 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 946 time: 0.5219953 May 12 15:08:44.332057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4cf4ad3-6cf5-4b65-ba28-ae54634cf3aa req-7fa22088-14cd-4fe8-a96c-97ba981cce13 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:44.338839 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4cf4ad3-6cf5-4b65-ba28-ae54634cf3aa req-7fa22088-14cd-4fe8-a96c-97ba981cce13 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 943 time: 0.6010308 May 12 15:08:44.358319 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:44.362795 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-065cdc4a-3221-4665-9498-92b5c38e111d req-dde5a044-fb55-4c94-a5e1-17ec60f86b78 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1413212 May 12 15:08:44.433113 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d4a2f5fe-e0c7-4b33-a2f6-4800bf66c3a3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:44.497517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Transition to ACTIVE for port object 05971417-5c62-469b-bcc4-c4aa1291bb6f will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:08:44.566122 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:44.626192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4cf4ad3-6cf5-4b65-ba28-ae54634cf3aa req-3567206c-c823-4788-ac66-b1868b8f9f88 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2865219 May 12 15:08:44.660943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Deleting port 4054de48-da89-4af0-98b0-82ec2255914c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:08:44.661283 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:44.765780 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ebea3030-8e97-4852-8fbf-bc4d4b53e1f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:44.802457 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device b4e74807-b360-4c0d-894d-809b429ca3a6 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:08:44.918006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Pushing event updated for resources: {'Port': ['ID=05971417-5c62-469b-bcc4-c4aa1291bb6f,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:44.943159 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47fedc73-afb2-4b06-9e0d-55a65d32c61c req-8bbc36fb-dd2e-41a3-92ff-6461b3cfe75e service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6698511 May 12 15:08:44.943407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b4e74807-b360-4c0d-894d-809b429ca3a6,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:44.959975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'b4e74807-b360-4c0d-894d-809b429ca3a6', 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3', 'port_id': 'b4e74807-b360-4c0d-894d-809b429ca3a6', 'mac_address': 'fa:16:3e:ba:50:65', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 567, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bc8f64ab-e415-4d25-919a-8e712e76a5f6', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:08:45.018971 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:45.037275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b4e74807-b360-4c0d-894d-809b429ca3a6 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:08:45.065975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b4e74807-b360-4c0d-894d-809b429ca3a6,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:45.072711 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:45.162748 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=b4e74807-b360-4c0d-894d-809b429ca3a6,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:45.410182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['b4e74807-b360-4c0d-894d-809b429ca3a6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:08:45.461057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Attempting to bind port 05971417-5c62-469b-bcc4-c4aa1291bb6f on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:08:45.461638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Attempting to bind port 05971417-5c62-469b-bcc4-c4aa1291bb6f by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '6eefd9b4-779d-4776-9b4f-7ffc772f0b91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': 'b6e076d7-9d8e-4b84-bc09-feef5e2b7c21'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:08:45.461638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Attempting to bind port 05971417-5c62-469b-bcc4-c4aa1291bb6f on network b6e076d7-9d8e-4b84-bc09-feef5e2b7c21 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:08:45.490267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efce0f15-27ab-4674-ae6e-0428ac366ab3 req-302ad7d3-18fb-4781-997b-cc5384e502c5 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:45.490956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-efce0f15-27ab-4674-ae6e-0428ac366ab3 req-302ad7d3-18fb-4781-997b-cc5384e502c5 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Synchronizing usage tracker for tenant:153fc52d3d58413ebbcf4e094c9ec085 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:08:45.498772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Port 05971417-5c62-469b-bcc4-c4aa1291bb6f on network b6e076d7-9d8e-4b84-bc09-feef5e2b7c21 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:08:45.499091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Attempting to bind port 05971417-5c62-469b-bcc4-c4aa1291bb6f on network b6e076d7-9d8e-4b84-bc09-feef5e2b7c21 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:08:45.531974 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 8, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:08:45.532307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Checking segment: {'id': '6eefd9b4-779d-4776-9b4f-7ffc772f0b91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': 'b6e076d7-9d8e-4b84-bc09-feef5e2b7c21'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:08:45.532964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Bound using segment: {'id': '6eefd9b4-779d-4776-9b4f-7ffc772f0b91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': 'b6e076d7-9d8e-4b84-bc09-feef5e2b7c21'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:08:45.533410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Bound port: 05971417-5c62-469b-bcc4-c4aa1291bb6f, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6eefd9b4-779d-4776-9b4f-7ffc772f0b91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': 'b6e076d7-9d8e-4b84-bc09-feef5e2b7c21'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:08:45.533830 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:45.594836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '654cac47-c40b-4d9d-a71f-dbbed18b9333', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:45.680774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-efce0f15-27ab-4674-ae6e-0428ac366ab3 req-302ad7d3-18fb-4781-997b-cc5384e502c5 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Unset dirty status for tenant:153fc52d3d58413ebbcf4e094c9ec085 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:08:45.681929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-efce0f15-27ab-4674-ae6e-0428ac366ab3 req-302ad7d3-18fb-4781-997b-cc5384e502c5 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/ports?device_id=7eab681f-43e0-4c0a-bdb9-74a7ea6de40b HTTP/1.1" status: 200 len: 944 time: 0.9099419 May 12 15:08:45.690058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] For port 4054de48-da89-4af0-98b0-82ec2255914c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4054de48-da89-4af0-98b0-82ec2255914c,segment=NetworkSegment(49f41745-6217-458f-8fa0-7833e5e7c9df),segment_id=49f41745-6217-458f-8fa0-7833e5e7c9df)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:45.690549 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:45.704322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd23419f-5856-4434-8a46-06aef924b322 req-82e32d23-7569-4552-a7bb-595e4dbcd394 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:45.705894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd23419f-5856-4434-8a46-06aef924b322 req-82e32d23-7569-4552-a7bb-595e4dbcd394 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 946 time: 0.5211563 May 12 15:08:45.879556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d4a2f5fe-e0c7-4b33-a2f6-4800bf66c3a3 admin admin] Router 9f298a9e-5220-4e39-9a41-71d509e7d361 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:08:45.917230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-efce0f15-27ab-4674-ae6e-0428ac366ab3 req-c5a89281-711b-4111-8ea3-1a3adcd0f2dc tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Synchronizing usage tracker for tenant:153fc52d3d58413ebbcf4e094c9ec085 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:08:45.963753 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:45.996417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd23419f-5856-4434-8a46-06aef924b322 req-5e12fcb3-45ed-49f9-ad0e-849c9eaf3e1a tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/security-groups?id=9c9166c2-fc2a-43df-8947-3b0f8ca10a32&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2707686 May 12 15:08:46.018999 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:46.061989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] For port 05971417-5c62-469b-bcc4-c4aa1291bb6f, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:08:46.094798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] For port 05971417-5c62-469b-bcc4-c4aa1291bb6f, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=05971417-5c62-469b-bcc4-c4aa1291bb6f,segment=NetworkSegment(6eefd9b4-779d-4776-9b4f-7ffc772f0b91),segment_id=6eefd9b4-779d-4776-9b4f-7ffc772f0b91)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:08:46.115397 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:46.222868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-efce0f15-27ab-4674-ae6e-0428ac366ab3 req-c5a89281-711b-4111-8ea3-1a3adcd0f2dc tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Unset dirty status for tenant:153fc52d3d58413ebbcf4e094c9ec085 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:08:46.223981 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-efce0f15-27ab-4674-ae6e-0428ac366ab3 req-c5a89281-711b-4111-8ea3-1a3adcd0f2dc tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/security-groups?id=32089edf-5255-423f-8e69-be133d389cd9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5089583 May 12 15:08:46.377719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:46.378431 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:46.379788 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4309463-b612-4d61-be8e-675a7463bd8e req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] 10.222.0.76 "PUT /v2.0/ports/05971417-5c62-469b-bcc4-c4aa1291bb6f HTTP/1.1" status: 200 len: 1092 time: 4.3561082 May 12 15:08:46.385038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7eab681f-43e0-4c0a-bdb9-74a7ea6de40b', 'tag': '05971417-5c62-469b-bcc4-c4aa1291bb6f'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:46.468069 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:46.468756 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:46.468878 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Floating IP ecb0a857-94c1-4a94-86d7-48852d7f953f disassociated. External IP: 172.25.8.26, port: 4054de48-da89-4af0-98b0-82ec2255914c. May 12 15:08:46.469191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Calling delete_port for 4054de48-da89-4af0-98b0-82ec2255914c owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:08:46.505114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d668ad7d-4518-4953-9993-ca1a3d884c29 service neutron] Pushing event updated for resources: {'Port': ['ID=05971417-5c62-469b-bcc4-c4aa1291bb6f,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:46.531403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d4a2f5fe-e0c7-4b33-a2f6-4800bf66c3a3 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:08:46.542025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ef90bf2-33b8-4758-b97a-24d640e97dc9 None None] Sync routers for ids ['9f298a9e-5220-4e39-9a41-71d509e7d361'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:08:46.551514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ef90bf2-33b8-4758-b97a-24d640e97dc9 None None] Routers {'9f298a9e-5220-4e39-9a41-71d509e7d361'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:46.552119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0ef90bf2-33b8-4758-b97a-24d640e97dc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9f298a9e-5220-4e39-9a41-71d509e7d361'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:46.565898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d4a2f5fe-e0c7-4b33-a2f6-4800bf66c3a3 admin admin] 10.222.0.82 "PUT /v2.0/routers/9f298a9e-5220-4e39-9a41-71d509e7d361/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 10.1032329 May 12 15:08:46.566482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48610) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:46.605088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ded88ad2-e574-40b6-803f-ccfa1608bb2d req-e6ac6d9d-c123-4697-9fa0-f818e3f3ba4c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:46.606622 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ded88ad2-e574-40b6-803f-ccfa1608bb2d req-e6ac6d9d-c123-4697-9fa0-f818e3f3ba4c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 948 time: 0.3991833 May 12 15:08:46.675421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4309463-b612-4d61-be8e-675a7463bd8e req-39721475-0c65-4c50-854a-1c9db960d42e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:46.676904 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4309463-b612-4d61-be8e-675a7463bd8e req-39721475-0c65-4c50-854a-1c9db960d42e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=153fc52d3d58413ebbcf4e094c9ec085&device_id=7eab681f-43e0-4c0a-bdb9-74a7ea6de40b HTTP/1.1" status: 200 len: 1095 time: 0.2520642 May 12 15:08:46.784478 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-0ef90bf2-33b8-4758-b97a-24d640e97dc9 None None] Set router 9f298a9e-5220-4e39-9a41-71d509e7d361 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:46.874230 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:46.899445 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2d67ba3e-ea7e-4e14-898c-9e5c3d931b1d'] response: {'server_uuid': '654cac47-c40b-4d9d-a71f-dbbed18b9333', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff', 'code': 200} May 12 15:08:46.901366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device b4e74807-b360-4c0d-894d-809b429ca3a6 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:08:46.913402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4309463-b612-4d61-be8e-675a7463bd8e req-b0303644-aaa9-43f7-86b4-5d49e4c4cf98 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=05971417-5c62-469b-bcc4-c4aa1291bb6f HTTP/1.1" status: 200 len: 217 time: 0.2279279 May 12 15:08:47.001173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ded88ad2-e574-40b6-803f-ccfa1608bb2d req-172d2c8f-63d5-4168-a735-0bcb317a5dcf tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3865113 May 12 15:08:47.041368 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:47.102756 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-862c2be2-5a81-4744-8171-52578ad7f2fd'] response: {'name': 'network-changed', 'server_uuid': '7eab681f-43e0-4c0a-bdb9-74a7ea6de40b', 'tag': '05971417-5c62-469b-bcc4-c4aa1291bb6f', 'status': 'completed', 'code': 200} May 12 15:08:47.107609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Pushing event deleted for resources: {'Port': ['ID=4054de48-da89-4af0-98b0-82ec2255914c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:47.116810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4309463-b612-4d61-be8e-675a7463bd8e req-dcf1dcc6-fc49-4b94-a2d4-0ffa91d24e2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:47.118120 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4309463-b612-4d61-be8e-675a7463bd8e req-dcf1dcc6-fc49-4b94-a2d4-0ffa91d24e2f service neutron] 10.222.0.76 "GET /v2.0/subnets?id=110673fc-f28f-4534-af1b-b57b5d397f0f HTTP/1.1" status: 200 len: 852 time: 0.1673760 May 12 15:08:47.123837 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:47.150084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] Deleting port b785b434-3554-4ebf-82d5-7d9066a9bdae {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:08:47.150993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:47.312606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port b4e74807-b360-4c0d-894d-809b429ca3a6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:08:47.320491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port b4e74807-b360-4c0d-894d-809b429ca3a6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:47.320865 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:47.389667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] For port b785b434-3554-4ebf-82d5-7d9066a9bdae, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b785b434-3554-4ebf-82d5-7d9066a9bdae,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:47.390052 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:47.393941 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a3c95caf-bb88-467f-88c0-e38ce2f7b5ff details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:08:47.396536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4054de48-da89-4af0-98b0-82ec2255914c no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:08:47.404288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4309463-b612-4d61-be8e-675a7463bd8e req-1f6fe0bb-af9d-454d-8834-ffd873748010 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b6e076d7-9d8e-4b84-bc09-feef5e2b7c21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2787957 May 12 15:08:47.434606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48628) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:47.508248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 4054de48-da89-4af0-98b0-82ec2255914c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:08:47.508595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4054de48-da89-4af0-98b0-82ec2255914c not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:08:47.536071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0ef90bf2-33b8-4758-b97a-24d640e97dc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'name': 'tempest-FloatingIPsNegativeTestJSON-563347280-router', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.130'}], 'enable_snat': True}, 'gw_port_id': 'b785b434-3554-4ebf-82d5-7d9066a9bdae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:08:20Z', 'updated_at': '2022-05-12T15:08:43Z', 'revision_number': 5, 'project_id': '609294cb20c74222b602884b6fde24e5', 'gw_port': {'id': 'b785b434-3554-4ebf-82d5-7d9066a9bdae', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:c4:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'device_owner': 'network:router_gateway', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:08:21Z', 'updated_at': '2022-05-12T15:08:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:47.536734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb37323a-bd81-4036-8f41-3196023036c2 req-26c207d2-9d16-4d57-a8e1-9a0ad1134ea3 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:47.538289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb37323a-bd81-4036-8f41-3196023036c2 req-26c207d2-9d16-4d57-a8e1-9a0ad1134ea3 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 944 time: 0.6315892 May 12 15:08:47.551511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] Calling delete_port for b785b434-3554-4ebf-82d5-7d9066a9bdae owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:08:47.557856 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ef90bf2-33b8-4758-b97a-24d640e97dc9 None None] Checking router: 9f298a9e-5220-4e39-9a41-71d509e7d361 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:08:47.603094 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Router fab022ae-aab5-4b4f-a77e-4570d094dd89 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:08:47.654174 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ef90bf2-33b8-4758-b97a-24d640e97dc9 None None] Routers {'9f298a9e-5220-4e39-9a41-71d509e7d361'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:47.654821 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0ef90bf2-33b8-4758-b97a-24d640e97dc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9f298a9e-5220-4e39-9a41-71d509e7d361'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:47.678032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb37323a-bd81-4036-8f41-3196023036c2 req-8beb72b5-0fde-4945-9ab4-61b7e403edc9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1219106 May 12 15:08:47.725752 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:47.882901 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:47.892626 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff65d90d-d5e4-4469-9b32-143ef3d68ace admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:47.902463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f79251e-4ee3-44b1-b700-76bf73e233fd req-cfa761bd-240d-4d7d-a29c-f6d6509050a4 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:47.911548 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f79251e-4ee3-44b1-b700-76bf73e233fd req-cfa761bd-240d-4d7d-a29c-f6d6509050a4 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 1102 time: 0.5695455 May 12 15:08:47.921884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:47.935848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-0ef90bf2-33b8-4758-b97a-24d640e97dc9 None None] Set router 9f298a9e-5220-4e39-9a41-71d509e7d361 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:47.938834 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4309463-b612-4d61-be8e-675a7463bd8e req-fe8b16aa-3f7e-475d-ac33-5f818983fb0e service neutron] 10.222.0.76 "GET /v2.0/networks/b6e076d7-9d8e-4b84-bc09-feef5e2b7c21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5281477 May 12 15:08:47.977336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] Pushing event deleted for resources: {'Port': ['ID=b785b434-3554-4ebf-82d5-7d9066a9bdae,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:48.052262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ff65d90d-d5e4-4469-9b32-143ef3d68ace admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:48.072716 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0ef90bf2-33b8-4758-b97a-24d640e97dc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'name': 'tempest-FloatingIPsNegativeTestJSON-563347280-router', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:08:20Z', 'updated_at': '2022-05-12T15:08:47Z', 'revision_number': 6, 'project_id': '609294cb20c74222b602884b6fde24e5', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:48.079301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:48.084440 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:48.088710 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b4e74807-b360-4c0d-894d-809b429ca3a6,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:48.088893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ff65d90d-d5e4-4469-9b32-143ef3d68ace admin admin] Usage tracker for resource:security_group_rule and tenant:7db9d80fdc124e898b613eb21c8214dd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:48.093079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ef90bf2-33b8-4758-b97a-24d640e97dc9 None None] The sync data for ids ['9f298a9e-5220-4e39-9a41-71d509e7d361'] in n-d-841483-1 is: [{'id': '9f298a9e-5220-4e39-9a41-71d509e7d361', 'name': 'tempest-FloatingIPsNegativeTestJSON-563347280-router', 'tenant_id': '609294cb20c74222b602884b6fde24e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:08:20Z', 'updated_at': '2022-05-12T15:08:47Z', 'revision_number': 6, 'project_id': '609294cb20c74222b602884b6fde24e5', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:08:48.097371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ff65d90d-d5e4-4469-9b32-143ef3d68ace admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:48.097557 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:48.155562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff', 'mac_address': 'fa:16:3e:60:a5:ee', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.141'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:08:48.161536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ff65d90d-d5e4-4469-9b32-143ef3d68ace admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:48.182588 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f79251e-4ee3-44b1-b700-76bf73e233fd req-682dfe22-3736-4c86-a76d-a6a813b99366 tempest-ServersAdminTestJSON-2019771052 tempest-ServersAdminTestJSON-2019771052-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2700739 May 12 15:08:48.233316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:08:48.239666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=b4e74807-b360-4c0d-894d-809b429ca3a6,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:48.243835 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:48.258472 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9161c0d-8856-40d1-b289-594d0e432184 None None] Sync routers for ids ['fab022ae-aab5-4b4f-a77e-4570d094dd89'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:08:48.273255 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:48.273748 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9161c0d-8856-40d1-b289-594d0e432184 None None] Routers {'fab022ae-aab5-4b4f-a77e-4570d094dd89'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:48.274377 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f9161c0d-8856-40d1-b289-594d0e432184 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['fab022ae-aab5-4b4f-a77e-4570d094dd89'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:48.275546 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:48.285550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a3c95caf-bb88-467f-88c0-e38ce2f7b5ff {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:08:48.307550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:48.310040 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:48.310616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9f298a9e-5220-4e39-9a41-71d509e7d361 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:08:48.313121 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:48.333174 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:48.334315 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-588e7ec2-2984-474f-8a10-2e2857c14d64 admin admin] 10.222.0.82 "DELETE /v2.0/routers/9f298a9e-5220-4e39-9a41-71d509e7d361 HTTP/1.1" status: 204 len: 168 time: 1.7668231 May 12 15:08:48.337024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48636) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:48.401888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:48.460912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-d0c63175-bb9f-4e87-8911-00f3330b384e tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:48.462541 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-d0c63175-bb9f-4e87-8911-00f3330b384e tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.6078036 May 12 15:08:48.471074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-173ff23d-0681-4036-87fb-0979efe3d11e admin admin] Deleting subnet 83ba0f0d-d481-4305-b0c1-f74bc09d5138 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:08:48.471249 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] No DVR routers for this DVR port 4054de48-da89-4af0-98b0-82ec2255914c on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:08:48.473799 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:48.487952 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-173ff23d-0681-4036-87fb-0979efe3d11e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:48.508292 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4309463-b612-4d61-be8e-675a7463bd8e req-9f771b57-cd9b-4ec3-a916-fd23a40a88d7 service neutron] 10.222.0.76 "GET /v2.0/networks/b6e076d7-9d8e-4b84-bc09-feef5e2b7c21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5562239 May 12 15:08:48.608494 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:08:48.679631 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-f9161c0d-8856-40d1-b289-594d0e432184 None None] Set router fab022ae-aab5-4b4f-a77e-4570d094dd89 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:48.682926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a3c95caf-bb88-467f-88c0-e38ce2f7b5ff'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:08:48.723233 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:08:48.723233 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4a9cb98c-0f32-4a71-b603-45bfa5b3e92b not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:08:48.770917 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-173ff23d-0681-4036-87fb-0979efe3d11e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:48.859410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-173ff23d-0681-4036-87fb-0979efe3d11e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:48.903888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '90ffd47c-e072-4c18-8d59-4ad501ade5d8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4e74807-b360-4c0d-894d-809b429ca3a6'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:48.949457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-53e5ec16-84a2-4245-b5dd-e473939de181 req-7909cc4f-13ec-42d4-b09f-599480ed1108 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.76 "DELETE /v2.0/ports/4054de48-da89-4af0-98b0-82ec2255914c HTTP/1.1" status: 204 len: 173 time: 4.5883844 May 12 15:08:48.953633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f24c8bf1-764f-4971-ba3f-da12ac595cbb req-18f86590-b0a1-49af-b8fe-8b7b398f6d12 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Synchronizing usage tracker for tenant:ff9b9aa97cf84863aedddc5615398c31 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:08:48.968065 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-173ff23d-0681-4036-87fb-0979efe3d11e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:48.989283 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-b06b3afc-f895-40d3-a5ed-ff5dbd29f38d tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.73 HTTP/1.1" status: 200 len: 695 time: 0.4838784 May 12 15:08:49.009103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-8701f5d4-780b-409e-80f0-90a6aa3c7de6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Request body: {'floatingip': {'port_id': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'fixed_ip_address': '172.20.0.6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:49.020675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-173ff23d-0681-4036-87fb-0979efe3d11e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=83ba0f0d-d481-4305-b0c1-f74bc09d5138,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:49.026675 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-173ff23d-0681-4036-87fb-0979efe3d11e admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:49.029615 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5209a9b-3601-433d-b611-bcd87ea0f1e5 None None] Network 15f59a83-2b8a-4caa-8b98-f8f692faf883 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:08:49.039490 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-173ff23d-0681-4036-87fb-0979efe3d11e admin admin] 10.222.0.82 "DELETE /v2.0/subnets/83ba0f0d-d481-4305-b0c1-f74bc09d5138 HTTP/1.1" status: 204 len: 168 time: 0.7012513 May 12 15:08:49.040896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48646) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:49.116974 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f9161c0d-8856-40d1-b289-594d0e432184 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:06:02Z', 'revision_number': 4, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port': {'id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:d5:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:05:54Z', 'updated_at': '2022-05-12T15:06:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5547b996-f6f1-4969-9052-5353e51dbe15', 'name': '', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'mac_address': 'fa:16:3e:bf:c0:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:01Z', 'updated_at': '2022-05-12T15:06:16Z', 'revision_number': 5, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'subnets': [{'id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:49.121133 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9161c0d-8856-40d1-b289-594d0e432184 None None] Checking router: fab022ae-aab5-4b4f-a77e-4570d094dd89 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:08:49.137576 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9161c0d-8856-40d1-b289-594d0e432184 None None] Routers {'fab022ae-aab5-4b4f-a77e-4570d094dd89'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:49.139277 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f9161c0d-8856-40d1-b289-594d0e432184 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['fab022ae-aab5-4b4f-a77e-4570d094dd89'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:49.155293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63e8f2a5-d22b-4c79-a081-58ac523f6a2a req-32013e23-4061-4e23-9aa7-8431a48a2eb2 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:49.159963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-63e8f2a5-d22b-4c79-a081-58ac523f6a2a req-32013e23-4061-4e23-9aa7-8431a48a2eb2 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Synchronizing usage tracker for tenant:bad2264067c248e9803d4b1eeb73116d on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:08:49.206484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d', 'name': 'network-vif-deleted', 'tag': '4054de48-da89-4af0-98b0-82ec2255914c'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:49.206729 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:49.217351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-63e8f2a5-d22b-4c79-a081-58ac523f6a2a req-32013e23-4061-4e23-9aa7-8431a48a2eb2 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Unset dirty status for tenant:bad2264067c248e9803d4b1eeb73116d on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:08:49.218452 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63e8f2a5-d22b-4c79-a081-58ac523f6a2a req-32013e23-4061-4e23-9aa7-8431a48a2eb2 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.84 "GET /v2.0/ports?device_id=127cef03-8661-4b61-a807-7baf9f974c4c HTTP/1.1" status: 200 len: 946 time: 0.8828826 May 12 15:08:49.281298 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-8701f5d4-780b-409e-80f0-90a6aa3c7de6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:49.302317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Deleting port 4190f5c1-50d1-42fe-ad87-7e535d8561a9 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:08:49.302664 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:49.336118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-63e8f2a5-d22b-4c79-a081-58ac523f6a2a req-7ba978db-b257-4544-a9d4-88aa5feed8b5 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Deleting port 4844ecc9-16ec-4455-af7d-c1e11840b51a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:08:49.336463 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-63e8f2a5-d22b-4c79-a081-58ac523f6a2a req-7ba978db-b257-4544-a9d4-88aa5feed8b5 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:49.369109 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-f9161c0d-8856-40d1-b289-594d0e432184 None None] Set router fab022ae-aab5-4b4f-a77e-4570d094dd89 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:49.403773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f24c8bf1-764f-4971-ba3f-da12ac595cbb req-18f86590-b0a1-49af-b8fe-8b7b398f6d12 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Unset dirty status for tenant:ff9b9aa97cf84863aedddc5615398c31 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:08:49.404913 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f24c8bf1-764f-4971-ba3f-da12ac595cbb req-18f86590-b0a1-49af-b8fe-8b7b398f6d12 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d HTTP/1.1" status: 200 len: 210 time: 0.6873162 May 12 15:08:49.565339 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c2a06a9a-bf58-44f8-9c40-87d399fca104 None None] DHCP port deletion for 15f59a83-2b8a-4caa-8b98-f8f692faf883 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:08:49.578639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c2a06a9a-bf58-44f8-9c40-87d399fca104 None None] Deleting port 4190f5c1-50d1-42fe-ad87-7e535d8561a9 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:08:49.579021 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c2a06a9a-bf58-44f8-9c40-87d399fca104 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:49.608585 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff65d90d-d5e4-4469-9b32-143ef3d68ace admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:49.729604 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff65d90d-d5e4-4469-9b32-143ef3d68ace admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:49.782923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-053411d7-6324-4c68-83da-0398cb898a71 req-f98132db-6ec0-4f66-8ae7-520fc92a2073 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:49.782923 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-053411d7-6324-4c68-83da-0398cb898a71 req-f98132db-6ec0-4f66-8ae7-520fc92a2073 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=153fc52d3d58413ebbcf4e094c9ec085&device_id=7eab681f-43e0-4c0a-bdb9-74a7ea6de40b HTTP/1.1" status: 200 len: 1095 time: 1.1334832 May 12 15:08:49.882615 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c2a06a9a-bf58-44f8-9c40-87d399fca104 None None] For port 4190f5c1-50d1-42fe-ad87-7e535d8561a9, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4190f5c1-50d1-42fe-ad87-7e535d8561a9,segment=NetworkSegment(763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3),segment_id=763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:49.882999 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c2a06a9a-bf58-44f8-9c40-87d399fca104 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:49.889459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44c5c3ee-c151-4797-b1b2-d42fa4ecbda4 req-ea4ca875-5527-4161-bcf3-f51a88426a10 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:49.891391 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44c5c3ee-c151-4797-b1b2-d42fa4ecbda4 req-ea4ca875-5527-4161-bcf3-f51a88426a10 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.76 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333&tenant_id=0da54985cde346e68eeadf965b8bc6d3&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 949 time: 1.1317999 May 12 15:08:49.898444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] For port 4190f5c1-50d1-42fe-ad87-7e535d8561a9, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4190f5c1-50d1-42fe-ad87-7e535d8561a9,segment=NetworkSegment(763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3),segment_id=763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:49.899126 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:49.927017 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f9161c0d-8856-40d1-b289-594d0e432184 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:06:02Z', 'revision_number': 4, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port': {'id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:d5:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:05:54Z', 'updated_at': '2022-05-12T15:06:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5547b996-f6f1-4969-9052-5353e51dbe15', 'name': '', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'mac_address': 'fa:16:3e:bf:c0:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:01Z', 'updated_at': '2022-05-12T15:06:16Z', 'revision_number': 5, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'subnets': [{'id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:49.941447 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9161c0d-8856-40d1-b289-594d0e432184 None None] The sync data for ids ['fab022ae-aab5-4b4f-a77e-4570d094dd89'] in n-d-841483-1 is: [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:06:02Z', 'revision_number': 4, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port': {'id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:d5:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:05:54Z', 'updated_at': '2022-05-12T15:06:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5547b996-f6f1-4969-9052-5353e51dbe15', 'name': '', 'network_id': '4c945198-2daa-4ae0-a8c1-07ee6da52271', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'mac_address': 'fa:16:3e:bf:c0:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:01Z', 'updated_at': '2022-05-12T15:06:16Z', 'revision_number': 5, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'subnets': [{'id': '3ef83b9d-c5b9-4653-9e37-725af3b0ea4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:08:49.993929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ff65d90d-d5e4-4469-9b32-143ef3d68ace admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7db9d80fdc124e898b613eb21c8214dd&name=default HTTP/1.1" status: 200 len: 2979 time: 2.5508113 May 12 15:08:50.044441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48652) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:50.055779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff65d90d-d5e4-4469-9b32-143ef3d68ace admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1994aa5-7d0c-4bad-9525-cc21733d8974,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:50.070032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Calling delete_port for 4190f5c1-50d1-42fe-ad87-7e535d8561a9 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:08:50.093264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c2a06a9a-bf58-44f8-9c40-87d399fca104 None None] Calling delete_port for 4190f5c1-50d1-42fe-ad87-7e535d8561a9 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:08:50.198424 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c2a06a9a-bf58-44f8-9c40-87d399fca104 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:50.209913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-63e8f2a5-d22b-4c79-a081-58ac523f6a2a req-7ba978db-b257-4544-a9d4-88aa5feed8b5 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] For port 4844ecc9-16ec-4455-af7d-c1e11840b51a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4844ecc9-16ec-4455-af7d-c1e11840b51a,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:50.210593 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-63e8f2a5-d22b-4c79-a081-58ac523f6a2a req-7ba978db-b257-4544-a9d4-88aa5feed8b5 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:50.334859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a06a9a-bf58-44f8-9c40-87d399fca104 None None] Pushing event deleted for resources: {'Port': ['ID=4190f5c1-50d1-42fe-ad87-7e535d8561a9,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:50.340144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f073dfdf-7c70-497b-8b8a-9239419f6bed req-feae614c-220b-4240-ac33-f4b3fbeba702 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:50.342203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2a06a9a-bf58-44f8-9c40-87d399fca104 None None] No DVR routers for this DVR port 4190f5c1-50d1-42fe-ad87-7e535d8561a9 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:08:50.348360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f073dfdf-7c70-497b-8b8a-9239419f6bed req-feae614c-220b-4240-ac33-f4b3fbeba702 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/ports?device_id=7eab681f-43e0-4c0a-bdb9-74a7ea6de40b HTTP/1.1" status: 200 len: 944 time: 0.7412071 May 12 15:08:50.380960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-053411d7-6324-4c68-83da-0398cb898a71 req-081f2203-bdfc-41ed-b7a6-740ddef9d854 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:50.382640 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-053411d7-6324-4c68-83da-0398cb898a71 req-081f2203-bdfc-41ed-b7a6-740ddef9d854 service neutron] 10.222.0.76 "GET /v2.0/networks?id=b6e076d7-9d8e-4b84-bc09-feef5e2b7c21 HTTP/1.1" status: 200 len: 913 time: 0.5784590 May 12 15:08:50.382788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b785b434-3554-4ebf-82d5-7d9066a9bdae no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:08:50.395261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-63e8f2a5-d22b-4c79-a081-58ac523f6a2a req-7ba978db-b257-4544-a9d4-88aa5feed8b5 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Calling delete_port for 4844ecc9-16ec-4455-af7d-c1e11840b51a owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:08:50.418711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43419cb5-2411-4533-a0f4-618a1bd787ab None None] New status for floating IP ecb0a857-94c1-4a94-86d7-48852d7f953f: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:08:50.457071 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-084a4924-58a3-4a44-95f7-bc05b83f7b4b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:50.478948 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:08:50.479292 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:08:50.503236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: b785b434-3554-4ebf-82d5-7d9066a9bdae {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:08:50.503583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b785b434-3554-4ebf-82d5-7d9066a9bdae not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:08:50.504061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4190f5c1-50d1-42fe-ad87-7e535d8561a9 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:08:50.506288 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-084a4924-58a3-4a44-95f7-bc05b83f7b4b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:50.513714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44c5c3ee-c151-4797-b1b2-d42fa4ecbda4 req-cf83e6d9-266e-4820-9739-0f80531471fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:50.515260 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44c5c3ee-c151-4797-b1b2-d42fa4ecbda4 req-cf83e6d9-266e-4820-9739-0f80531471fa service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 1100 time: 0.4377644 May 12 15:08:50.585151 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-053411d7-6324-4c68-83da-0398cb898a71 req-b750afd3-1282-4837-bb30-125549591b90 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=05971417-5c62-469b-bcc4-c4aa1291bb6f HTTP/1.1" status: 200 len: 217 time: 0.1890991 May 12 15:08:50.598094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f073dfdf-7c70-497b-8b8a-9239419f6bed req-00d6d8e4-ed6a-44cf-974f-e1c9be4e57d9 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/security-groups?id=32089edf-5255-423f-8e69-be133d389cd9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2493935 May 12 15:08:50.624489 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 4190f5c1-50d1-42fe-ad87-7e535d8561a9 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:08:50.625121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4190f5c1-50d1-42fe-ad87-7e535d8561a9 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:08:50.648716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-084a4924-58a3-4a44-95f7-bc05b83f7b4b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:50.673995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-084a4924-58a3-4a44-95f7-bc05b83f7b4b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1994aa5-7d0c-4bad-9525-cc21733d8974,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:50.687697 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-63e8f2a5-d22b-4c79-a081-58ac523f6a2a req-7ba978db-b257-4544-a9d4-88aa5feed8b5 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:50.737786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['9015ad2b-bc53-4425-beb5-9a5e82176b06', '4844ecc9-16ec-4455-af7d-c1e11840b51a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:08:50.787177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-053411d7-6324-4c68-83da-0398cb898a71 req-1e67f80b-3b54-4c40-b2c0-5459b514cb88 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:50.790921 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-053411d7-6324-4c68-83da-0398cb898a71 req-1e67f80b-3b54-4c40-b2c0-5459b514cb88 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=110673fc-f28f-4534-af1b-b57b5d397f0f HTTP/1.1" status: 200 len: 852 time: 0.1780102 May 12 15:08:50.879516 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-053411d7-6324-4c68-83da-0398cb898a71 req-dd06536a-e5bf-4916-9059-54464ba9e42c service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b6e076d7-9d8e-4b84-bc09-feef5e2b7c21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0809078 May 12 15:08:50.916677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44c5c3ee-c151-4797-b1b2-d42fa4ecbda4 req-ff1042b7-bd33-460d-baa0-3711993cc78e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:50.918307 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44c5c3ee-c151-4797-b1b2-d42fa4ecbda4 req-ff1042b7-bd33-460d-baa0-3711993cc78e service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.3712676 May 12 15:08:51.003602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Deleting port 4190f5c1-50d1-42fe-ad87-7e535d8561a9 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:08:51.004024 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.028614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-63e8f2a5-d22b-4c79-a081-58ac523f6a2a req-7ba978db-b257-4544-a9d4-88aa5feed8b5 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] No DVR routers for this DVR port 4844ecc9-16ec-4455-af7d-c1e11840b51a on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:08:51.031145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ba978db-b257-4544-a9d4-88aa5feed8b5 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Pushing event deleted for resources: {'Port': ['ID=4844ecc9-16ec-4455-af7d-c1e11840b51a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:51.038708 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-63e8f2a5-d22b-4c79-a081-58ac523f6a2a req-7ba978db-b257-4544-a9d4-88aa5feed8b5 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.040724 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63e8f2a5-d22b-4c79-a081-58ac523f6a2a req-7ba978db-b257-4544-a9d4-88aa5feed8b5 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.84 "DELETE /v2.0/ports/4844ecc9-16ec-4455-af7d-c1e11840b51a HTTP/1.1" status: 204 len: 173 time: 1.8122582 May 12 15:08:51.041535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '127cef03-8661-4b61-a807-7baf9f974c4c', 'name': 'network-vif-deleted', 'tag': '4844ecc9-16ec-4455-af7d-c1e11840b51a'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:51.053730 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-084a4924-58a3-4a44-95f7-bc05b83f7b4b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.054916 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-084a4924-58a3-4a44-95f7-bc05b83f7b4b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d1994aa5-7d0c-4bad-9525-cc21733d8974 HTTP/1.1" status: 204 len: 168 time: 1.0087979 May 12 15:08:51.091239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] The port '4190f5c1-50d1-42fe-ad87-7e535d8561a9' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:08:51.223554 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.259883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44c5c3ee-c151-4797-b1b2-d42fa4ecbda4 req-43bda893-6d29-40cc-8e62-c72318f8e137 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.141&port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff HTTP/1.1" status: 200 len: 217 time: 0.3316979 May 12 15:08:51.294287 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['15f59a83-2b8a-4caa-8b98-f8f692faf883']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:51.311221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:51.311523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '763f7bdf-8cd6-46d6-bdfd-8e28ce4868d3') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:51.328896 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-8701f5d4-780b-409e-80f0-90a6aa3c7de6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] It took 0.44 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:08:51.329812 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.352596 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.360165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Releasing vlan 563 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:08:51.360577 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: timer() May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:08:51.382444 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:08:51.409137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 05971417-5c62-469b-bcc4-c4aa1291bb6f details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:08:51.414016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a3c95caf-bb88-467f-88c0-e38ce2f7b5ff up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:08:51.443338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48666) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:51.475424 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a4581fa-95aa-41ab-8b4c-f209892b0a68 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.476327 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-053411d7-6324-4c68-83da-0398cb898a71 req-2aa75357-2a96-42ca-89c5-5927a90d7ae1 service neutron] 10.222.0.76 "GET /v2.0/networks/b6e076d7-9d8e-4b84-bc09-feef5e2b7c21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5869403 May 12 15:08:51.509146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8a4581fa-95aa-41ab-8b4c-f209892b0a68 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:51.514675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8a4581fa-95aa-41ab-8b4c-f209892b0a68 admin admin] Usage tracker for resource:security_group_rule and tenant:0ba3fe3c75dc400892cfa80b40ca5d63 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:51.518690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8a4581fa-95aa-41ab-8b4c-f209892b0a68 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:51.521528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.540964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8a4581fa-95aa-41ab-8b4c-f209892b0a68 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:51.543241 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.558336 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] 10.222.0.82 "DELETE /v2.0/networks/15f59a83-2b8a-4caa-8b98-f8f692faf883 HTTP/1.1" status: 204 len: 168 time: 2.5140982 May 12 15:08:51.559316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86663d1b-6e7b-452e-9e25-d63dbbb965db admin admin] Pushing event deleted for resources: {'Network': ['ID=15f59a83-2b8a-4caa-8b98-f8f692faf883,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:51.605546 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:51.605546 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.679747 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a4581fa-95aa-41ab-8b4c-f209892b0a68 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.684362 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-053411d7-6324-4c68-83da-0398cb898a71 req-2e6c6b1b-81f4-4e46-8be7-7ac6b17ac681 service neutron] 10.222.0.76 "GET /v2.0/networks/b6e076d7-9d8e-4b84-bc09-feef5e2b7c21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1716852 May 12 15:08:51.688509 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a4581fa-95aa-41ab-8b4c-f209892b0a68 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.714703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 05971417-5c62-469b-bcc4-c4aa1291bb6f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=05971417-5c62-469b-bcc4-c4aa1291bb6f,segment=NetworkSegment(6eefd9b4-779d-4776-9b4f-7ffc772f0b91),segment_id=6eefd9b4-779d-4776-9b4f-7ffc772f0b91)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:51.751290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '05971417-5c62-469b-bcc4-c4aa1291bb6f', 'network_id': 'b6e076d7-9d8e-4b84-bc09-feef5e2b7c21', 'port_id': '05971417-5c62-469b-bcc4-c4aa1291bb6f', 'mac_address': 'fa:16:3e:f5:e5:28', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 552, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '110673fc-f28f-4534-af1b-b57b5d397f0f', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:08:51.753779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-855fa92f-2d8c-4bba-a307-5aa57cf66ef2 req-2ac759ab-fa90-422d-8348-3bdd6f464db0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:51.760689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-855fa92f-2d8c-4bba-a307-5aa57cf66ef2 req-2ac759ab-fa90-422d-8348-3bdd6f464db0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 949 time: 0.5742180 May 12 15:08:51.764797 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-8701f5d4-780b-409e-80f0-90a6aa3c7de6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.766763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44c5c3ee-c151-4797-b1b2-d42fa4ecbda4 req-afe40a9b-7495-4cef-afbc-a7390ce1bbc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:51.768501 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44c5c3ee-c151-4797-b1b2-d42fa4ecbda4 req-afe40a9b-7495-4cef-afbc-a7390ce1bbc9 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.4897060 May 12 15:08:51.787774 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-8701f5d4-780b-409e-80f0-90a6aa3c7de6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.808169 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8a4581fa-95aa-41ab-8b4c-f209892b0a68 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0ba3fe3c75dc400892cfa80b40ca5d63&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3637788 May 12 15:08:51.810165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a4581fa-95aa-41ab-8b4c-f209892b0a68 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d47ea90e-3edc-46dc-8575-9708e83e3444,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:51.812945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48674) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:51.855989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48678) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:51.894317 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.920927 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.934395 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 05971417-5c62-469b-bcc4-c4aa1291bb6f {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:08:51.966100 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4351aa4f-7820-499f-a2ad-2ecd93f82907 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=609294cb20c74222b602884b6fde24e5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1095035 May 12 15:08:51.967166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 05971417-5c62-469b-bcc4-c4aa1291bb6f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=05971417-5c62-469b-bcc4-c4aa1291bb6f,segment=NetworkSegment(6eefd9b4-779d-4776-9b4f-7ffc772f0b91),segment_id=6eefd9b4-779d-4776-9b4f-7ffc772f0b91)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:51.975036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48682) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:51.975784 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:51.999383 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-549ff03f-0745-45e6-a1e6-f68801ffe339 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:52.001301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-855fa92f-2d8c-4bba-a307-5aa57cf66ef2 req-afc4788a-bca7-48e6-8b95-a61a08e2e64f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2397771 May 12 15:08:52.032753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-549ff03f-0745-45e6-a1e6-f68801ffe339 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:52.034190 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:52.057569 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:52.076590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=05971417-5c62-469b-bcc4-c4aa1291bb6f,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:52.118270 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-8701f5d4-780b-409e-80f0-90a6aa3c7de6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Floating IP 39327416-fca3-4fc6-84f2-31a84b283d83 associated. External IP: 172.25.8.73, port: 9015ad2b-bc53-4425-beb5-9a5e82176b06. May 12 15:08:52.143633 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-549ff03f-0745-45e6-a1e6-f68801ffe339 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:52.161220 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f6c17d3-cc98-4845-a8d7-f4703f8d3471 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:52.164038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-549ff03f-0745-45e6-a1e6-f68801ffe339 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d47ea90e-3edc-46dc-8575-9708e83e3444,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:52.171185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:52.178992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44c5c3ee-c151-4797-b1b2-d42fa4ecbda4 req-6b9f91b6-cec3-4d6b-a5b8-6e7b2b524275 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:52.180652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44c5c3ee-c151-4797-b1b2-d42fa4ecbda4 req-6b9f91b6-cec3-4d6b-a5b8-6e7b2b524275 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.3943596 May 12 15:08:52.193612 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-549ff03f-0745-45e6-a1e6-f68801ffe339 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:52.197320 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-549ff03f-0745-45e6-a1e6-f68801ffe339 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d47ea90e-3edc-46dc-8575-9708e83e3444 HTTP/1.1" status: 204 len: 168 time: 0.3813858 May 12 15:08:52.202820 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f6c17d3-cc98-4845-a8d7-f4703f8d3471 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:52.237997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['05971417-5c62-469b-bcc4-c4aa1291bb6f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:08:52.320110 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f6c17d3-cc98-4845-a8d7-f4703f8d3471 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:52.336002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f6c17d3-cc98-4845-a8d7-f4703f8d3471 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ae75455-82fa-42f7-aeeb-f0e51502c2ae,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:52.342105 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f6c17d3-cc98-4845-a8d7-f4703f8d3471 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:52.346772 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7f6c17d3-cc98-4845-a8d7-f4703f8d3471 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4ae75455-82fa-42f7-aeeb-f0e51502c2ae HTTP/1.1" status: 204 len: 168 time: 0.3701096 May 12 15:08:52.604907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69164b75-f427-4436-ac05-a32f6d166a4a req-5efaf830-a944-4fbd-813e-a96dbd011aa1 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:52.612587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69164b75-f427-4436-ac05-a32f6d166a4a req-5efaf830-a944-4fbd-813e-a96dbd011aa1 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 945 time: 0.4424646 May 12 15:08:52.640796 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44c5c3ee-c151-4797-b1b2-d42fa4ecbda4 req-de2ed9c6-811b-4f81-a146-a417341d5a7a service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4490969 May 12 15:08:52.773819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48698) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:52.806911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0934f1e-7e97-4732-940f-c00843658d91 req-c84fc497-9dc5-4ef6-81c5-39f4c7132c52 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:52.807747 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b0934f1e-7e97-4732-940f-c00843658d91 req-c84fc497-9dc5-4ef6-81c5-39f4c7132c52 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Synchronizing usage tracker for tenant:7413f696702a49c390950b9a967696fa on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:08:52.818230 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e6b2098f-4d36-4cc7-8dff-3589ede54927 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:52.819287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4844ecc9-16ec-4455-af7d-c1e11840b51a no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:08:52.839626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e6b2098f-4d36-4cc7-8dff-3589ede54927 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:52.843987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e6b2098f-4d36-4cc7-8dff-3589ede54927 admin admin] Usage tracker for resource:security_group_rule and tenant:c0c724003aec48ea91dafe4a88b928b2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:52.848969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b0934f1e-7e97-4732-940f-c00843658d91 req-c84fc497-9dc5-4ef6-81c5-39f4c7132c52 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Unset dirty status for tenant:7413f696702a49c390950b9a967696fa on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:08:52.850480 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0934f1e-7e97-4732-940f-c00843658d91 req-c84fc497-9dc5-4ef6-81c5-39f4c7132c52 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.84 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 950 time: 0.1632807 May 12 15:08:52.851451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e6b2098f-4d36-4cc7-8dff-3589ede54927 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:52.880548 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 4844ecc9-16ec-4455-af7d-c1e11840b51a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:08:52.881105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4844ecc9-16ec-4455-af7d-c1e11840b51a not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:08:52.897008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e6b2098f-4d36-4cc7-8dff-3589ede54927 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:52.959366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69164b75-f427-4436-ac05-a32f6d166a4a req-ecaf19a0-d9ff-476e-94eb-e4fd333b7363 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3459105 May 12 15:08:52.963007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-b0934f1e-7e97-4732-940f-c00843658d91 req-a935a20c-6134-4134-984f-bfa84b032929 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Deleting port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:08:52.963312 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b0934f1e-7e97-4732-940f-c00843658d91 req-a935a20c-6134-4134-984f-bfa84b032929 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:53.027778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-8701f5d4-780b-409e-80f0-90a6aa3c7de6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Router 940e3b0e-8287-409c-890e-28addf1cf0b8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:08:53.037970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44c5c3ee-c151-4797-b1b2-d42fa4ecbda4 req-0fc49da4-c55f-4be0-838b-56cf52b850c2 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3909950 May 12 15:08:53.058950 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-293a259b-548c-487c-831f-e4834dd986ff'] response: {'server_uuid': '90ffd47c-e072-4c18-8d59-4ad501ade5d8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4e74807-b360-4c0d-894d-809b429ca3a6', 'code': 200} May 12 15:08:53.120455 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4b008f7b-6e2f-4923-9abf-cc0e08a249b6'] response: {'server_uuid': '5d5f6e42-a2f7-45ac-b7f3-675c5454ee3d', 'name': 'network-vif-deleted', 'tag': '4054de48-da89-4af0-98b0-82ec2255914c', 'status': 'completed', 'code': 200} May 12 15:08:53.284043 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e6b2098f-4d36-4cc7-8dff-3589ede54927 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:53.303669 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e6b2098f-4d36-4cc7-8dff-3589ede54927 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:53.345339 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e6b2098f-4d36-4cc7-8dff-3589ede54927 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c0c724003aec48ea91dafe4a88b928b2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5694444 May 12 15:08:53.345910 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48716) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:53.389721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-8701f5d4-780b-409e-80f0-90a6aa3c7de6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:08:53.402215 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebfa7bea-eb28-4e87-81bc-11f7cb5e0f8c None None] Sync routers for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:08:53.412780 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-8701f5d4-780b-409e-80f0-90a6aa3c7de6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:53.430449 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebfa7bea-eb28-4e87-81bc-11f7cb5e0f8c None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:53.431090 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ebfa7bea-eb28-4e87-81bc-11f7cb5e0f8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:53.434267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 05971417-5c62-469b-bcc4-c4aa1291bb6f up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:08:53.485342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd5fc6c-f5c7-425e-8807-8b987539e99f req-9dbe8a76-771a-49a1-a6fd-59d695307eb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:53.491632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6b2098f-4d36-4cc7-8dff-3589ede54927 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=28ff7364-4872-4eb8-93d1-fc9fea2b9658,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:53.494551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cd5fc6c-f5c7-425e-8807-8b987539e99f req-9dbe8a76-771a-49a1-a6fd-59d695307eb7 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 1096 time: 0.2758145 May 12 15:08:53.527004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48722) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:53.536011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-8701f5d4-780b-409e-80f0-90a6aa3c7de6 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "PUT /v2.0/floatingips/39327416-fca3-4fc6-84f2-31a84b283d83 HTTP/1.1" status: 200 len: 995 time: 4.5452626 May 12 15:08:53.555386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aee14cba-b10a-4fac-86b9-e69da6eea7ca req-5ce7aab6-c1f5-4ada-b36b-926ac0dfdcdb tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:53.556840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aee14cba-b10a-4fac-86b9-e69da6eea7ca req-5ce7aab6-c1f5-4ada-b36b-926ac0dfdcdb tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=5102166c-3857-4902-810f-a049926fe5f6 HTTP/1.1" status: 200 len: 950 time: 0.2442541 May 12 15:08:53.571408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b0934f1e-7e97-4732-940f-c00843658d91 req-a935a20c-6134-4134-984f-bfa84b032929 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] For port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:53.571829 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b0934f1e-7e97-4732-940f-c00843658d91 req-a935a20c-6134-4134-984f-bfa84b032929 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:53.572377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 05971417-5c62-469b-bcc4-c4aa1291bb6f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:08:53.590046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 05971417-5c62-469b-bcc4-c4aa1291bb6f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:08:53.591438 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:53.631261 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f2f2c39-8a26-4d4f-8e6b-6768b9f390b1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:53.648096 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cd5fc6c-f5c7-425e-8807-8b987539e99f req-07ba0dfe-5ec8-4b99-b4d5-82d3db08a4a7 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1432481 May 12 15:08:53.669755 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:08:53.704900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aee14cba-b10a-4fac-86b9-e69da6eea7ca req-a640acd4-8fcc-484f-8572-c5650ec3b899 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1387613 May 12 15:08:53.753750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-b248bacf-ea86-4ed6-97be-bf567b5ba11c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:53.758488 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-b248bacf-ea86-4ed6-97be-bf567b5ba11c service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 1096 time: 0.1946096 May 12 15:08:53.818581 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-ebfa7bea-eb28-4e87-81bc-11f7cb5e0f8c None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:53.822141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-b0934f1e-7e97-4732-940f-c00843658d91 req-a935a20c-6134-4134-984f-bfa84b032929 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Calling delete_port for 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:08:53.951211 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:54.002882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 05971417-5c62-469b-bcc4-c4aa1291bb6f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=05971417-5c62-469b-bcc4-c4aa1291bb6f,segment=NetworkSegment(6eefd9b4-779d-4776-9b4f-7ffc772f0b91),segment_id=6eefd9b4-779d-4776-9b4f-7ffc772f0b91)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:08:54.019351 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:54.062505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-adde83e4-fa80-4bf1-8f89-bd46fdd0464a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:54.064032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-adde83e4-fa80-4bf1-8f89-bd46fdd0464a service neutron] 10.222.0.82 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.2968788 May 12 15:08:54.094339 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6abd4b64-d989-421c-b258-2c9f21cb85a8'] response: {'server_uuid': '127cef03-8661-4b61-a807-7baf9f974c4c', 'name': 'network-vif-deleted', 'tag': '4844ecc9-16ec-4455-af7d-c1e11840b51a', 'status': 'completed', 'code': 200} May 12 15:08:54.100367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Request body: {'network': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-1030288485-network', 'tenant_id': '1765470896784bdd91025d3b6fa9cabd'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:54.105004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=05971417-5c62-469b-bcc4-c4aa1291bb6f,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:54.117883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:54.130075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Usage tracker for resource:network and tenant:1765470896784bdd91025d3b6fa9cabd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:54.138875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:54.143456 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f2f2c39-8a26-4d4f-8e6b-6768b9f390b1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:54.157165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:54.208216 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-b9dea024-a9dd-4faa-9b3f-48871eb76e94 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 200 len: 998 time: 0.1106417 May 12 15:08:54.215216 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b0934f1e-7e97-4732-940f-c00843658d91 req-a935a20c-6134-4134-984f-bfa84b032929 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:54.228391 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['bea6d555-5915-4366-91f7-7e9771e26806'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:08:54.292919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Made reservation on behalf of 1765470896784bdd91025d3b6fa9cabd for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:08:54.295916 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:54.302535 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1', 'e5430b6d-6430-4a47-b068-7f891fa37da9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:08:54.319463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a935a20c-6134-4134-984f-bfa84b032929 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Pushing event deleted for resources: {'Port': ['ID=8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:54.373424 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:54.378634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-77962618-e8ac-48c8-8eb3-520c5682a52a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:54.380215 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-77962618-e8ac-48c8-8eb3-520c5682a52a service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.1563716 May 12 15:08:54.390664 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f2f2c39-8a26-4d4f-8e6b-6768b9f390b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:54.432287 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ebfa7bea-eb28-4e87-81bc-11f7cb5e0f8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '39327416-fca3-4fc6-84f2-31a84b283d83', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'floating_ip_address': '172.25.8.73', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'port_id': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'mac_address': 'fa:16:3e:79:97:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:07:52Z', 'updated_at': '2022-05-12T15:08:50Z', 'revision_number': 8, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:54.445874 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebfa7bea-eb28-4e87-81bc-11f7cb5e0f8c None None] Checking router: 940e3b0e-8287-409c-890e-28addf1cf0b8 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:08:54.446135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d16ef831-642d-4785-95e1-a45db9a285b9 req-b18cc241-48ef-4a94-9967-058ecc39b1ef tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:54.447710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d16ef831-642d-4785-95e1-a45db9a285b9 req-b18cc241-48ef-4a94-9967-058ecc39b1ef tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/ports?device_id=7eab681f-43e0-4c0a-bdb9-74a7ea6de40b HTTP/1.1" status: 200 len: 946 time: 0.3826361 May 12 15:08:54.454257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2f2c39-8a26-4d4f-8e6b-6768b9f390b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=28ff7364-4872-4eb8-93d1-fc9fea2b9658,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:54.464123 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebfa7bea-eb28-4e87-81bc-11f7cb5e0f8c None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:08:54.464761 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ebfa7bea-eb28-4e87-81bc-11f7cb5e0f8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:54.465531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:54.468939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0934f1e-7e97-4732-940f-c00843658d91 req-a935a20c-6134-4134-984f-bfa84b032929 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] No DVR routers for this DVR port 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:08:54.474425 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b0934f1e-7e97-4732-940f-c00843658d91 req-a935a20c-6134-4134-984f-bfa84b032929 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:54.478303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Usage tracker for resource:security_group_rule and tenant:1765470896784bdd91025d3b6fa9cabd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:54.484927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:54.496405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:54.499637 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f2f2c39-8a26-4d4f-8e6b-6768b9f390b1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:54.501085 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6f2f2c39-8a26-4d4f-8e6b-6768b9f390b1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/28ff7364-4872-4eb8-93d1-fc9fea2b9658 HTTP/1.1" status: 204 len: 168 time: 1.1507583 May 12 15:08:54.505004 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0934f1e-7e97-4732-940f-c00843658d91 req-a935a20c-6134-4134-984f-bfa84b032929 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.84 "DELETE /v2.0/ports/8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 HTTP/1.1" status: 204 len: 173 time: 1.6468716 May 12 15:08:54.557675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d16ef831-642d-4785-95e1-a45db9a285b9 req-abf89936-655b-40b7-982d-150ca02334be tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/security-groups?id=32089edf-5255-423f-8e69-be133d389cd9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1015642 May 12 15:08:54.572440 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d46b606-3989-4852-8ba5-5658602f22b4 req-6166b43a-eeef-4586-b265-e048f3cbb304 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.2910855 May 12 15:08:54.625300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-128ba901-46ff-435a-b1b4-473da782c7f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:54.627009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-128ba901-46ff-435a-b1b4-473da782c7f3 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2335596 May 12 15:08:54.737329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:54.754430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:54.797005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 590} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:08:54.821362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=82474291-eaf8-434c-a9c0-6a0e1084298d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:54.827073 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:54.827780 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Added segment 45df704c-0bf6-42d3-be24-743711e80f04 of type vlan for network 7ff67598-426f-471a-8d47-b5df5dee599f May 12 15:08:54.911766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:54.914907 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-ebfa7bea-eb28-4e87-81bc-11f7cb5e0f8c None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:08:54.989063 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:54.990180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:54.990836 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:55.061227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '654cac47-c40b-4d9d-a71f-dbbed18b9333', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff'}, {'server_uuid': '7eab681f-43e0-4c0a-bdb9-74a7ea6de40b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '05971417-5c62-469b-bcc4-c4aa1291bb6f'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:55.130284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'tag': '9015ad2b-bc53-4425-beb5-9a5e82176b06'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:55.131817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] Pushing event updated for resources: {'Network': ['ID=7ff67598-426f-471a-8d47-b5df5dee599f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:55.139728 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5193ae55-3b4d-452c-9e4b-f4a16f6192da admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.6091216 May 12 15:08:55.140262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48742) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:55.144143 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 7ff67598-426f-471a-8d47-b5df5dee599f details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:08:55.147029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Request body: {'subnet': {'network_id': '7ff67598-426f-471a-8d47-b5df5dee599f', 'cidr': '172.20.0.0/28', 'name': 'tempest-SecurityGroupRulesNegativeTestJSON-1030288485-subnet', 'tenant_id': '1765470896784bdd91025d3b6fa9cabd', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:55.152669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:55.156706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Usage tracker for resource:subnet and tenant:1765470896784bdd91025d3b6fa9cabd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:55.163501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:55.171512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:55.206606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Made reservation on behalf of 1765470896784bdd91025d3b6fa9cabd for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:08:55.209102 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:55.222035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d46b606-3989-4852-8ba5-5658602f22b4 req-a2fe607c-36a9-4a72-aded-7ba4e1227cc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:55.223991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d46b606-3989-4852-8ba5-5658602f22b4 req-a2fe607c-36a9-4a72-aded-7ba4e1227cc5 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 1096 time: 0.6054337 May 12 15:08:55.228978 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-24615a07-4896-4bc4-aa97-c36a834f0698 service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4749882 May 12 15:08:55.246883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af71a97-6299-4d8b-8882-76764efc4205 req-47caa70b-6968-4d0e-a48c-bb5ece2b9648 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:55.257673 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1af71a97-6299-4d8b-8882-76764efc4205 req-47caa70b-6968-4d0e-a48c-bb5ece2b9648 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.3871694 May 12 15:08:55.538327 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ebfa7bea-eb28-4e87-81bc-11f7cb5e0f8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '39327416-fca3-4fc6-84f2-31a84b283d83', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'floating_ip_address': '172.25.8.73', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'port_id': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'mac_address': 'fa:16:3e:79:97:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:07:52Z', 'updated_at': '2022-05-12T15:08:50Z', 'revision_number': 8, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:08:55.552488 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebfa7bea-eb28-4e87-81bc-11f7cb5e0f8c None None] The sync data for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 is: [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '39327416-fca3-4fc6-84f2-31a84b283d83', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'floating_ip_address': '172.25.8.73', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'port_id': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'mac_address': 'fa:16:3e:79:97:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:07:52Z', 'updated_at': '2022-05-12T15:08:50Z', 'revision_number': 8, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:08:55.587388 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:55.700969 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1af71a97-6299-4d8b-8882-76764efc4205 req-ab8b1c66-29cb-422b-9656-d652fe9c47d3 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4419842 May 12 15:08:55.709093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Checking segment: {'id': '45df704c-0bf6-42d3-be24-743711e80f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': '7ff67598-426f-471a-8d47-b5df5dee599f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:08:55.709580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Network hostable DHCP agents. Network: 7ff67598-426f-471a-8d47-b5df5dee599f, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:08:55.715673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=90c1a347-6b85-4241-b499-0c3eab27e7b1,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:55.742875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Network 7ff67598-426f-471a-8d47-b5df5dee599f is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:08:55.762909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 7ff67598-426f-471a-8d47-b5df5dee599f) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:08:55.773363 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81be23a0-71c4-40a4-94af-7cb95c41b9b1 None None] Network 7ff67598-426f-471a-8d47-b5df5dee599f requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:08:55.774577 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:55.775978 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:55.798032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48764) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:55.824965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d46b606-3989-4852-8ba5-5658602f22b4 req-885b3f03-59e8-426a-b46b-5a793d728dd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:55.826744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d46b606-3989-4852-8ba5-5658602f22b4 req-885b3f03-59e8-426a-b46b-5a793d728dd6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.5668483 May 12 15:08:55.835070 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b433f268-3a8d-4487-8d4a-3956765117e9 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.6938200 May 12 15:08:55.848667 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56adab85-50d9-47bf-9dac-98325ce2eb9b req-11b0aeff-6ec3-4cff-8660-1ede4d4fee11 service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5830417 May 12 15:08:55.933150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b892299f-13eb-42d7-813b-0b0943f85fb3 None None] New status for floating IP 39327416-fca3-4fc6-84f2-31a84b283d83: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:08:56.097055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5102166c-3857-4902-810f-a049926fe5f6', 'name': 'network-vif-deleted', 'tag': '8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:08:56.126405 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-697a8819-1e6d-4b42-89c2-1587100305f7'] response: {'server_uuid': '654cac47-c40b-4d9d-a71f-dbbed18b9333', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff', 'code': 200} May 12 15:08:56.127845 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-697a8819-1e6d-4b42-89c2-1587100305f7'] response: {'server_uuid': '7eab681f-43e0-4c0a-bdb9-74a7ea6de40b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '05971417-5c62-469b-bcc4-c4aa1291bb6f', 'code': 200} May 12 15:08:56.179260 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d46b606-3989-4852-8ba5-5658602f22b4 req-a97739ea-1b23-4965-b2c8-56c0ff577c29 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 200 len: 998 time: 0.3206923 May 12 15:08:56.224447 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f4026726-581e-4870-b89e-2e0035c6102d'] response: {'name': 'network-changed', 'server_uuid': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'tag': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'status': 'completed', 'code': 200} May 12 15:08:56.293319 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dd161026-ee37-4aa8-b120-3a2f974ce8c9 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:56.413297 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dd161026-ee37-4aa8-b120-3a2f974ce8c9 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:56.424328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d46b606-3989-4852-8ba5-5658602f22b4 req-d9172480-0d92-4272-a8a8-bc7940cbf012 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:56.426123 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d46b606-3989-4852-8ba5-5658602f22b4 req-d9172480-0d92-4272-a8a8-bc7940cbf012 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.2006400 May 12 15:08:56.451629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-308d7813-fa04-4af7-af4a-8dfd2f2b5c4e None None] Network 7ff67598-426f-471a-8d47-b5df5dee599f requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:08:56.529917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a6900d-e6e2-4bac-a811-d37741c10875 req-0b7229ac-68c9-4941-a288-1e3a041bd811 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:56.531270 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71a6900d-e6e2-4bac-a811-d37741c10875 req-0b7229ac-68c9-4941-a288-1e3a041bd811 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 945 time: 0.5071156 May 12 15:08:56.593618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ba486db-ab5a-48cd-867d-dd4191f3d074 req-fd187856-2739-409a-8311-d92ff970a34c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:56.595110 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ba486db-ab5a-48cd-867d-dd4191f3d074 req-fd187856-2739-409a-8311-d92ff970a34c service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=7eab681f-43e0-4c0a-bdb9-74a7ea6de40b HTTP/1.1" status: 200 len: 1097 time: 0.4122338 May 12 15:08:56.633967 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71a6900d-e6e2-4bac-a811-d37741c10875 req-ee9aa80e-c5fb-428f-8e7c-52ff2d808dd4 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0878379 May 12 15:08:56.643304 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dd161026-ee37-4aa8-b120-3a2f974ce8c9 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:56.682672 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b6c28d-30e0-4c86-8546-c39a8f7885cc req-8ae9b0ef-d88d-4806-aa3e-cb9f25d76c13 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:56.684138 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83b6c28d-30e0-4c86-8546-c39a8f7885cc req-8ae9b0ef-d88d-4806-aa3e-cb9f25d76c13 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/ports?device_id=7eab681f-43e0-4c0a-bdb9-74a7ea6de40b HTTP/1.1" status: 200 len: 946 time: 0.3403907 May 12 15:08:56.696303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd161026-ee37-4aa8-b120-3a2f974ce8c9 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c9166c2-fc2a-43df-8947-3b0f8ca10a32,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:56.703236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d46b606-3989-4852-8ba5-5658602f22b4 req-a615667f-cc65-434c-9553-23cb5fccd557 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:56.705780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d46b606-3989-4852-8ba5-5658602f22b4 req-a615667f-cc65-434c-9553-23cb5fccd557 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2675202 May 12 15:08:56.729824 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ba486db-ab5a-48cd-867d-dd4191f3d074 req-f2b73181-4f35-41e8-9c90-7d719c5355d8 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=32089edf-5255-423f-8e69-be133d389cd9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1235845 May 12 15:08:56.823878 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dd161026-ee37-4aa8-b120-3a2f974ce8c9 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:56.824922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dd161026-ee37-4aa8-b120-3a2f974ce8c9 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "DELETE /v2.0/security-groups/9c9166c2-fc2a-43df-8947-3b0f8ca10a32 HTTP/1.1" status: 204 len: 168 time: 1.0217402 May 12 15:08:56.827931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48796) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:56.838521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:08:56.846182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83b6c28d-30e0-4c86-8546-c39a8f7885cc req-0664a3bc-a2b7-428b-bfdd-6fcb098ae1ef tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/security-groups?id=32089edf-5255-423f-8e69-be133d389cd9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1511326 May 12 15:08:56.846576 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-84a7e3a0-3b9c-4010-b7fa-1598878d4680 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] show failed (client error): The resource could not be found. May 12 15:08:56.847592 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-84a7e3a0-3b9c-4010-b7fa-1598878d4680 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "GET /v2.0/security-groups/9c9166c2-fc2a-43df-8947-3b0f8ca10a32 HTTP/1.1" status: 404 len: 347 time: 0.0186918 May 12 15:08:56.850498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48800) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:08:56.901036 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:08:56.901557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:08:56.985068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d46b606-3989-4852-8ba5-5658602f22b4 req-524797cc-5e76-44b0-84d4-c92eea5888f5 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2629080 May 12 15:08:57.027193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-fca3aa8d-b2e4-4913-ad60-003ff66171b3 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Deleting port 98d91964-b059-432a-9498-7c67ee3cce35 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:08:57.027534 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fca3aa8d-b2e4-4913-ad60-003ff66171b3 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:57.143045 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47e05093-6a1d-4cd3-ad81-baa0126b4998 req-5487bf16-c017-4ecf-bb9a-9bf66fe098bf tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips/39327416-fca3-4fc6-84f2-31a84b283d83 HTTP/1.1" status: 200 len: 997 time: 0.2578077 May 12 15:08:57.198649 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fca3aa8d-b2e4-4913-ad60-003ff66171b3 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:57.198649 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fca3aa8d-b2e4-4913-ad60-003ff66171b3 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:57.292892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d46b606-3989-4852-8ba5-5658602f22b4 req-fb4c6bab-2533-4da6-a2e7-eece875223d3 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2710731 May 12 15:08:57.316419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c75da22e-884d-4051-a311-65c867cf4bc6 req-820b3468-9b7a-4651-8d28-3a3da5537cf5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:57.317961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c75da22e-884d-4051-a311-65c867cf4bc6 req-820b3468-9b7a-4651-8d28-3a3da5537cf5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.3352082 May 12 15:08:57.340958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-fca3aa8d-b2e4-4913-ad60-003ff66171b3 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Calling delete_port for 98d91964-b059-432a-9498-7c67ee3cce35 owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:08:57.493493 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fca3aa8d-b2e4-4913-ad60-003ff66171b3 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:57.540140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fca3aa8d-b2e4-4913-ad60-003ff66171b3 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Pushing event deleted for resources: {'Port': ['ID=98d91964-b059-432a-9498-7c67ee3cce35,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:57.545174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47e05093-6a1d-4cd3-ad81-baa0126b4998 req-4659662d-6ef4-4129-8857-96bfb5cf4f12 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:57.546622 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47e05093-6a1d-4cd3-ad81-baa0126b4998 req-4659662d-6ef4-4129-8857-96bfb5cf4f12 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.3964875 May 12 15:08:57.561724 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-47e05093-6a1d-4cd3-ad81-baa0126b4998 req-e790b2e4-04ba-4971-89bb-c15cc7b1a67f tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:08:57.562662 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47e05093-6a1d-4cd3-ad81-baa0126b4998 req-e790b2e4-04ba-4971-89bb-c15cc7b1a67f tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0100212 May 12 15:08:57.573914 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c75da22e-884d-4051-a311-65c867cf4bc6 req-aa2fb446-17f1-4685-8327-7fe1b7564538 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2395563 May 12 15:08:57.600219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f90165-a84d-4a47-bdca-9d03ae65a5df req-4419001f-dc89-43c0-8fac-7e513e781e55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:57.603066 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a5f90165-a84d-4a47-bdca-9d03ae65a5df req-4419001f-dc89-43c0-8fac-7e513e781e55 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 1096 time: 0.1402383 May 12 15:08:57.710306 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-de142944-61cb-4720-baee-3f597790c7d3'] response: {'server_uuid': '5102166c-3857-4902-810f-a049926fe5f6', 'name': 'network-vif-deleted', 'tag': '8b142f35-81c6-4f62-91dc-b0cd4b5c3ae1', 'status': 'completed', 'code': 200} May 12 15:08:57.765573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f90165-a84d-4a47-bdca-9d03ae65a5df req-af0cb699-17af-4588-bae8-5f5a574c9d02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:57.768090 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a5f90165-a84d-4a47-bdca-9d03ae65a5df req-af0cb699-17af-4588-bae8-5f5a574c9d02 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.1560302 May 12 15:08:57.773763 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fca3aa8d-b2e4-4913-ad60-003ff66171b3 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:57.805884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fca3aa8d-b2e4-4913-ad60-003ff66171b3 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:57.807441 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fca3aa8d-b2e4-4913-ad60-003ff66171b3 tempest-AttachSCSIVolumeTestJSON-469868129 tempest-AttachSCSIVolumeTestJSON-469868129-project] 10.222.0.82 "DELETE /v2.0/floatingips/ecb0a857-94c1-4a94-86d7-48852d7f953f HTTP/1.1" status: 204 len: 168 time: 0.9558761 May 12 15:08:57.864079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-24f80f5e-929d-4ef8-9aad-8d5fb8a911a5 req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-665522306', 'description': 'tempest-description-1589667224'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:57.871097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-24f80f5e-929d-4ef8-9aad-8d5fb8a911a5 req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:57.888499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-24f80f5e-929d-4ef8-9aad-8d5fb8a911a5 req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Usage tracker for resource:security_group and tenant:1765470896784bdd91025d3b6fa9cabd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:57.894359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-24f80f5e-929d-4ef8-9aad-8d5fb8a911a5 req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:57.911242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-24f80f5e-929d-4ef8-9aad-8d5fb8a911a5 req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:57.931345 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a5f90165-a84d-4a47-bdca-9d03ae65a5df req-140d348d-1185-42ff-bc86-95f84088e5be service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 200 len: 1000 time: 0.1579506 May 12 15:08:57.932884 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-24f80f5e-929d-4ef8-9aad-8d5fb8a911a5 req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:58.050876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-24f80f5e-929d-4ef8-9aad-8d5fb8a911a5 req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:08:58.058609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-24f80f5e-929d-4ef8-9aad-8d5fb8a911a5 req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Usage tracker for resource:security_group_rule and tenant:1765470896784bdd91025d3b6fa9cabd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:08:58.067116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-24f80f5e-929d-4ef8-9aad-8d5fb8a911a5 req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:08:58.072077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f90165-a84d-4a47-bdca-9d03ae65a5df req-255168c4-e974-4cd3-9729-632dc039944b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:58.073638 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a5f90165-a84d-4a47-bdca-9d03ae65a5df req-255168c4-e974-4cd3-9729-632dc039944b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.1286781 May 12 15:08:58.078435 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-24f80f5e-929d-4ef8-9aad-8d5fb8a911a5 req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:08:58.186176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9889e44-62dd-4076-bd8f-043430ebedec req-4186dfd2-bd6c-485e-9a91-b6e57a024c21 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:58.187728 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9889e44-62dd-4076-bd8f-043430ebedec req-4186dfd2-bd6c-485e-9a91-b6e57a024c21 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 1096 time: 0.2453604 May 12 15:08:58.271463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f90165-a84d-4a47-bdca-9d03ae65a5df req-7c397371-0381-4d2e-b8a4-35cc2b365b46 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:58.272969 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a5f90165-a84d-4a47-bdca-9d03ae65a5df req-7c397371-0381-4d2e-b8a4-35cc2b365b46 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1908984 May 12 15:08:58.274679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9889e44-62dd-4076-bd8f-043430ebedec req-61a5a17d-b239-4bf4-a69b-57e71e6b72d0 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0771651 May 12 15:08:58.276922 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-24f80f5e-929d-4ef8-9aad-8d5fb8a911a5 req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:58.306592 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-24f80f5e-929d-4ef8-9aad-8d5fb8a911a5 req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:58.419052 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-24f80f5e-929d-4ef8-9aad-8d5fb8a911a5 req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:58.420307 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24f80f5e-929d-4ef8-9aad-8d5fb8a911a5 req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1817 time: 0.5660992 May 12 15:08:58.426151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06fee8f2-e3e4-4673-8f57-5d2409450ef6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d167e737-7283-41a4-bb55-d5b9dcb4bf0f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:08:58.570013 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a5f90165-a84d-4a47-bdca-9d03ae65a5df req-15639ad8-5fd5-4ef3-b540-a9f6c5914f87 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2899659 May 12 15:08:58.605291 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-bd2e4eb2-0ed1-4100-af1b-d2e2a19e1ae8 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.73 HTTP/1.1" status: 200 len: 1000 time: 0.1533549 May 12 15:08:58.797230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-bb832c94-fb0f-49a8-85f8-6ce7a9dac472 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:58.799104 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-bb832c94-fb0f-49a8-85f8-6ce7a9dac472 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports/9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 200 len: 942 time: 0.1602814 May 12 15:08:58.840963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a5f90165-a84d-4a47-bdca-9d03ae65a5df req-84bf394f-bed6-41f9-bafd-e14c9156a899 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2630854 May 12 15:08:58.857997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5afbce4-cf0c-4e06-93a0-6f1a8267cf57 req-9162f106-7715-4257-a234-1995f9ab85aa tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:58.859602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5afbce4-cf0c-4e06-93a0-6f1a8267cf57 req-9162f106-7715-4257-a234-1995f9ab85aa tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 950 time: 0.2604983 May 12 15:08:58.987979 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5afbce4-cf0c-4e06-93a0-6f1a8267cf57 req-7ccb6d01-f7a2-4d2e-916a-de0725ffeccb tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1215463 May 12 15:08:59.013056 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-d53751bd-a0ac-4a56-bf11-fc94db8d6031 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.73 HTTP/1.1" status: 200 len: 1000 time: 0.1233764 May 12 15:08:59.225280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-608313b8-241f-4e42-9000-6c847e833c5a tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:59.226837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-608313b8-241f-4e42-9000-6c847e833c5a tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.2079332 May 12 15:08:59.240406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b3aa25a-703f-4304-bfc7-e49db9ad3896 req-0aeda8ad-7cdc-4c2e-9625-4bad2d035e4b tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:59.242105 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b3aa25a-703f-4304-bfc7-e49db9ad3896 req-0aeda8ad-7cdc-4c2e-9625-4bad2d035e4b tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/ports?device_id=7eab681f-43e0-4c0a-bdb9-74a7ea6de40b HTTP/1.1" status: 200 len: 946 time: 0.1491206 May 12 15:08:59.521935 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-8bfc23ac-adc6-4404-a75e-c313f2c0e385 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.73 HTTP/1.1" status: 200 len: 1000 time: 0.2786713 May 12 15:08:59.528980 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b3aa25a-703f-4304-bfc7-e49db9ad3896 req-5e025f2f-ccdf-494c-b232-7eca2ebdcaf9 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/security-groups?id=32089edf-5255-423f-8e69-be133d389cd9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1385942 May 12 15:08:59.537227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-979a297b-77bc-4bc8-ad76-357ae25cb5dc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Request body: {'floatingip': {'port_id': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:08:59.637433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b47ce19-adf0-4a0b-8694-dde426d1f71a req-94240474-6a0c-48f7-bc0d-129829d8a5b6 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:08:59.638794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b47ce19-adf0-4a0b-8694-dde426d1f71a req-94240474-6a0c-48f7-bc0d-129829d8a5b6 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.76 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 950 time: 0.2495465 May 12 15:08:59.725454 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-979a297b-77bc-4bc8-ad76-357ae25cb5dc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:08:59.852827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-6b47ce19-adf0-4a0b-8694-dde426d1f71a req-ce4eee0d-422c-4af0-8f13-ce06857dc76a tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Deleting port bea6d555-5915-4366-91f7-7e9771e26806 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:08:59.853167 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6b47ce19-adf0-4a0b-8694-dde426d1f71a req-ce4eee0d-422c-4af0-8f13-ce06857dc76a tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:00.059662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e79552dc-7b65-49a2-b903-7255f5a71686 req-4be2c848-232f-4849-803d-ac876da92ee7 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:00.061059 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e79552dc-7b65-49a2-b903-7255f5a71686 req-4be2c848-232f-4849-803d-ac876da92ee7 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 1096 time: 0.4214458 May 12 15:09:00.194249 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-979a297b-77bc-4bc8-ad76-357ae25cb5dc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:00.249735 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-979a297b-77bc-4bc8-ad76-357ae25cb5dc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:00.249963 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-979a297b-77bc-4bc8-ad76-357ae25cb5dc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Floating IP 39327416-fca3-4fc6-84f2-31a84b283d83 disassociated. External IP: 172.25.8.73, port: 9015ad2b-bc53-4425-beb5-9a5e82176b06. May 12 15:09:00.351447 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e79552dc-7b65-49a2-b903-7255f5a71686 req-871199a0-c6c2-4ecb-9537-8b751773fecd tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2760952 May 12 15:09:00.516915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-6b47ce19-adf0-4a0b-8694-dde426d1f71a req-ce4eee0d-422c-4af0-8f13-ce06857dc76a tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] For port bea6d555-5915-4366-91f7-7e9771e26806, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=bea6d555-5915-4366-91f7-7e9771e26806,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:00.517190 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6b47ce19-adf0-4a0b-8694-dde426d1f71a req-ce4eee0d-422c-4af0-8f13-ce06857dc76a tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:00.816029 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-faf8ec44-b7f1-47fe-98f6-10c5ae85f673 req-612453f0-48ed-44a3-9a39-6518f43eaaf9 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-groups/d167e737-7283-41a4-bb55-d5b9dcb4bf0f HTTP/1.1" status: 200 len: 1812 time: 0.3727107 May 12 15:09:00.822717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-6b47ce19-adf0-4a0b-8694-dde426d1f71a req-ce4eee0d-422c-4af0-8f13-ce06857dc76a tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Calling delete_port for bea6d555-5915-4366-91f7-7e9771e26806 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:00.876372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-faf8ec44-b7f1-47fe-98f6-10c5ae85f673 req-769abf8c-df10-464d-9bad-2d7cbfbbc1fa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': 'd167e737-7283-41a4-bb55-d5b9dcb4bf0f', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:00.876678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-faf8ec44-b7f1-47fe-98f6-10c5ae85f673 req-769abf8c-df10-464d-9bad-2d7cbfbbc1fa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': 'd167e737-7283-41a4-bb55-d5b9dcb4bf0f', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:00.898640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-faf8ec44-b7f1-47fe-98f6-10c5ae85f673 req-769abf8c-df10-464d-9bad-2d7cbfbbc1fa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:00.913515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-faf8ec44-b7f1-47fe-98f6-10c5ae85f673 req-769abf8c-df10-464d-9bad-2d7cbfbbc1fa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Usage tracker for resource:security_group_rule and tenant:1765470896784bdd91025d3b6fa9cabd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:00.919933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-faf8ec44-b7f1-47fe-98f6-10c5ae85f673 req-769abf8c-df10-464d-9bad-2d7cbfbbc1fa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:00.996829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-faf8ec44-b7f1-47fe-98f6-10c5ae85f673 req-769abf8c-df10-464d-9bad-2d7cbfbbc1fa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:01.092713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-979a297b-77bc-4bc8-ad76-357ae25cb5dc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Router 940e3b0e-8287-409c-890e-28addf1cf0b8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:09:01.209591 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-faf8ec44-b7f1-47fe-98f6-10c5ae85f673 req-769abf8c-df10-464d-9bad-2d7cbfbbc1fa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:01.234526 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6b47ce19-adf0-4a0b-8694-dde426d1f71a req-ce4eee0d-422c-4af0-8f13-ce06857dc76a tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:01.271577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['e5430b6d-6430-4a47-b068-7f891fa37da9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:09:01.305956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce4eee0d-422c-4af0-8f13-ce06857dc76a tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Pushing event deleted for resources: {'Port': ['ID=bea6d555-5915-4366-91f7-7e9771e26806,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:01.414329 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-faf8ec44-b7f1-47fe-98f6-10c5ae85f673 req-769abf8c-df10-464d-9bad-2d7cbfbbc1fa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:01.446130 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-faf8ec44-b7f1-47fe-98f6-10c5ae85f673 req-769abf8c-df10-464d-9bad-2d7cbfbbc1fa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:01.463227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device bea6d555-5915-4366-91f7-7e9771e26806 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:01.472982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-6b47ce19-adf0-4a0b-8694-dde426d1f71a req-ce4eee0d-422c-4af0-8f13-ce06857dc76a tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] No DVR routers for this DVR port bea6d555-5915-4366-91f7-7e9771e26806 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:09:01.482850 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6b47ce19-adf0-4a0b-8694-dde426d1f71a req-ce4eee0d-422c-4af0-8f13-ce06857dc76a tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:01.486602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2a994cf2-e517-4ce3-a9fe-50d8a080508e', 'name': 'network-vif-deleted', 'tag': 'bea6d555-5915-4366-91f7-7e9771e26806'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:09:01.499863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-769abf8c-df10-464d-9bad-2d7cbfbbc1fa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cf261160-a74d-48a6-8f86-068f1b10e797,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:01.500134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: bea6d555-5915-4366-91f7-7e9771e26806 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:09:01.500466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device bea6d555-5915-4366-91f7-7e9771e26806 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:09:01.519868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-979a297b-77bc-4bc8-ad76-357ae25cb5dc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:09:01.522612 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b47ce19-adf0-4a0b-8694-dde426d1f71a req-ce4eee0d-422c-4af0-8f13-ce06857dc76a tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.76 "DELETE /v2.0/ports/bea6d555-5915-4366-91f7-7e9771e26806 HTTP/1.1" status: 204 len: 173 time: 1.8431005 May 12 15:09:01.525552 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-979a297b-77bc-4bc8-ad76-357ae25cb5dc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:01.529852 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-934b80e5-e048-4e0b-be8f-3fd6bd626b1e None None] Sync routers for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:09:01.539829 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-934b80e5-e048-4e0b-be8f-3fd6bd626b1e None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:01.540453 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-934b80e5-e048-4e0b-be8f-3fd6bd626b1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:01.550629 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-faf8ec44-b7f1-47fe-98f6-10c5ae85f673 req-769abf8c-df10-464d-9bad-2d7cbfbbc1fa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:01.562767 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-faf8ec44-b7f1-47fe-98f6-10c5ae85f673 req-769abf8c-df10-464d-9bad-2d7cbfbbc1fa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.7065358 May 12 15:09:01.621567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-979a297b-77bc-4bc8-ad76-357ae25cb5dc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "PUT /v2.0/floatingips/39327416-fca3-4fc6-84f2-31a84b283d83 HTTP/1.1" status: 200 len: 695 time: 2.0914302 May 12 15:09:01.734517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-dc49dd12-0804-4c59-9f47-0b2cb5af7285 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:01.737359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-dc49dd12-0804-4c59-9f47-0b2cb5af7285 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 1096 time: 0.1118085 May 12 15:09:01.778906 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-934b80e5-e048-4e0b-be8f-3fd6bd626b1e None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:01.894881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-16d09bb7-805a-4caa-b43e-d02ceb0f6438 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:01.896345 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-16d09bb7-805a-4caa-b43e-d02ceb0f6438 service neutron] 10.222.0.82 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.1510985 May 12 15:09:02.004675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-36418cd0-3f79-409a-9d21-47bc11f823cd service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 200 len: 217 time: 0.1020429 May 12 15:09:02.016594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7f4a8ce6-78b0-4b83-8bbf-22819eb92c8d req-c5d26157-75f0-4fd6-b2d1-03fff71d8ba6 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Synchronizing usage tracker for tenant:7413f696702a49c390950b9a967696fa on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:09:02.031437 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:02.081512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7f4a8ce6-78b0-4b83-8bbf-22819eb92c8d req-c5d26157-75f0-4fd6-b2d1-03fff71d8ba6 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Unset dirty status for tenant:7413f696702a49c390950b9a967696fa on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:09:02.083016 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f4a8ce6-78b0-4b83-8bbf-22819eb92c8d req-c5d26157-75f0-4fd6-b2d1-03fff71d8ba6 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a994cf2-e517-4ce3-a9fe-50d8a080508e HTTP/1.1" status: 200 len: 210 time: 0.1179433 May 12 15:09:02.092881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-35c75782-d6e9-46be-a4fb-5b2ca365e932 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:02.105743 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-35c75782-d6e9-46be-a4fb-5b2ca365e932 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.0820594 May 12 15:09:02.154768 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-934b80e5-e048-4e0b-be8f-3fd6bd626b1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:02.162731 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-934b80e5-e048-4e0b-be8f-3fd6bd626b1e None None] Checking router: 940e3b0e-8287-409c-890e-28addf1cf0b8 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:09:02.173810 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-934b80e5-e048-4e0b-be8f-3fd6bd626b1e None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:02.174897 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-934b80e5-e048-4e0b-be8f-3fd6bd626b1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:02.194041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-78bd88c7-5312-433b-aee6-e5d75cb72748 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:02.203189 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-78bd88c7-5312-433b-aee6-e5d75cb72748 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0995183 May 12 15:09:02.280706 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bf35d33c-324b-4c6c-873c-88a058136d5e'] response: {'server_uuid': '2a994cf2-e517-4ce3-a9fe-50d8a080508e', 'name': 'network-vif-deleted', 'tag': 'bea6d555-5915-4366-91f7-7e9771e26806', 'status': 'completed', 'code': 200} May 12 15:09:02.364473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d988a77a-0880-4b25-9a00-9bfefcbc5fa6 req-a6c42340-3257-4aa2-96da-d20b95f01572 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-groups/d167e737-7283-41a4-bb55-d5b9dcb4bf0f HTTP/1.1" status: 200 len: 2405 time: 0.0858493 May 12 15:09:02.382764 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-934b80e5-e048-4e0b-be8f-3fd6bd626b1e None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:02.382947 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-c12c5706-da1f-4bb7-bb22-5a53e8e156da service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1788027 May 12 15:09:02.637305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc411be4-6a4a-4975-9ccb-1a3400ac862a req-e60dc8b1-0baa-494e-8335-340156adb267 service neutron] 10.222.0.82 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2486999 May 12 15:09:02.735377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48914) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:02.757899 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-934b80e5-e048-4e0b-be8f-3fd6bd626b1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:02.764420 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-934b80e5-e048-4e0b-be8f-3fd6bd626b1e None None] The sync data for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 is: [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:07:20Z', 'revision_number': 4, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '207b2c9c-f7e0-4d1b-96ea-20213deda9a0', 'name': '', 'network_id': '5af19f47-caf0-45a8-9b3d-186b8fd71ec1', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'mac_address': 'fa:16:3e:9d:a3:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:19Z', 'updated_at': '2022-05-12T15:07:28Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'subnets': [{'id': 'b0cba805-7761-41c5-9666-3b2ff25491af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:09:02.799098 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae0937f1-9e4a-49e2-977e-8aae27f08227 req-f75ad7de-08bf-40f5-9e58-66f824b1a40b tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-group-rules/cf261160-a74d-48a6-8f86-068f1b10e797 HTTP/1.1" status: 200 len: 778 time: 0.0475876 May 12 15:09:02.856878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae0937f1-9e4a-49e2-977e-8aae27f08227 req-6b0a5e7d-76d6-4f5f-9a82-97ef81529a56 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-groups/d167e737-7283-41a4-bb55-d5b9dcb4bf0f HTTP/1.1" status: 200 len: 2405 time: 0.0499854 May 12 15:09:02.897288 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ae0937f1-9e4a-49e2-977e-8aae27f08227 req-5fe38087-daa1-4eab-a63d-8f13ff59b6dd tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:02.927366 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ae0937f1-9e4a-49e2-977e-8aae27f08227 req-5fe38087-daa1-4eab-a63d-8f13ff59b6dd tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:02.978114 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ae0937f1-9e4a-49e2-977e-8aae27f08227 req-5fe38087-daa1-4eab-a63d-8f13ff59b6dd tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:03.000546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fe38087-daa1-4eab-a63d-8f13ff59b6dd tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=cf261160-a74d-48a6-8f86-068f1b10e797,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:03.003862 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ae0937f1-9e4a-49e2-977e-8aae27f08227 req-5fe38087-daa1-4eab-a63d-8f13ff59b6dd tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:03.016751 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae0937f1-9e4a-49e2-977e-8aae27f08227 req-5fe38087-daa1-4eab-a63d-8f13ff59b6dd tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/cf261160-a74d-48a6-8f86-068f1b10e797 HTTP/1.1" status: 204 len: 173 time: 0.1498997 May 12 15:09:03.117616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8447aa3e-dd34-484d-bd5b-b8b8325d37b4 None None] New status for floating IP 39327416-fca3-4fc6-84f2-31a84b283d83: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:09:03.568307 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82e4b8a4-8235-4e97-b782-70c518aed756 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:03.628344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-aec19d4c-6e4d-4955-9fd7-53eca291f2c2 req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1141840695', 'description': 'tempest-description-1748896604'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:03.637142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-aec19d4c-6e4d-4955-9fd7-53eca291f2c2 req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:03.643175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-aec19d4c-6e4d-4955-9fd7-53eca291f2c2 req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Usage tracker for resource:security_group and tenant:1765470896784bdd91025d3b6fa9cabd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:03.648350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-aec19d4c-6e4d-4955-9fd7-53eca291f2c2 req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:03.657010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-aec19d4c-6e4d-4955-9fd7-53eca291f2c2 req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:03.683721 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-aec19d4c-6e4d-4955-9fd7-53eca291f2c2 req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:03.715373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-aec19d4c-6e4d-4955-9fd7-53eca291f2c2 req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:03.721925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-aec19d4c-6e4d-4955-9fd7-53eca291f2c2 req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Usage tracker for resource:security_group_rule and tenant:1765470896784bdd91025d3b6fa9cabd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:03.726259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-aec19d4c-6e4d-4955-9fd7-53eca291f2c2 req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:03.736121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-aec19d4c-6e4d-4955-9fd7-53eca291f2c2 req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:03.835757 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-aec19d4c-6e4d-4955-9fd7-53eca291f2c2 req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:03.840548 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-aec19d4c-6e4d-4955-9fd7-53eca291f2c2 req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:03.890565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e8575d86-de9c-46d1-972c-e06fc52f7ad7,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:03.899269 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-aec19d4c-6e4d-4955-9fd7-53eca291f2c2 req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:03.900578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aec19d4c-6e4d-4955-9fd7-53eca291f2c2 req-4d2451fc-7522-4e87-83ad-6c3ec603994e tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1818 time: 0.2779689 May 12 15:09:03.987098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-a663064a-a409-4bd5-a18d-6794a8f7aef8 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:09:03.988090 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-a663064a-a409-4bd5-a18d-6794a8f7aef8 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0107024 May 12 15:09:04.000801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-697e767a-7326-454f-a4f9-38bdd61381e8 service neutron] Request body: {'binding': {'host': 'n-h2-841483-1', 'vnic_type': 'normal', 'profile': {}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:04.001295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-697e767a-7326-454f-a4f9-38bdd61381e8 service neutron] Unknown quota resources ['binding']. {{(pid=88151) _create /opt/stack/neutron/neutron/api/v2/base.py:495}} May 12 15:09:04.066987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-82e4b8a4-8235-4e97-b782-70c518aed756 admin admin] Deleting port 5547b996-f6f1-4969-9052-5353e51dbe15 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:04.067276 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82e4b8a4-8235-4e97-b782-70c518aed756 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:04.124788 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-4a26e5c3-bc52-4853-a73e-be15a97b317b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=0da54985cde346e68eeadf965b8bc6d3&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0416522 May 12 15:09:04.286595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'tag': '9015ad2b-bc53-4425-beb5-9a5e82176b06'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:09:04.305564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-b0ddb5fc-b152-4534-8126-7224207ef621 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:04.307208 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-b0ddb5fc-b152-4534-8126-7224207ef621 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1761150 May 12 15:09:04.326352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-0a22e712-29d7-4aa4-9e89-df101ce2df51 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/quotas/0da54985cde346e68eeadf965b8bc6d3 HTTP/1.1" status: 200 len: 375 time: 0.0100617 May 12 15:09:04.385767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-82e4b8a4-8235-4e97-b782-70c518aed756 admin admin] For port 5547b996-f6f1-4969-9052-5353e51dbe15, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5547b996-f6f1-4969-9052-5353e51dbe15,segment=NetworkSegment(49f41745-6217-458f-8fa0-7833e5e7c9df),segment_id=49f41745-6217-458f-8fa0-7833e5e7c9df)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:04.386139 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82e4b8a4-8235-4e97-b782-70c518aed756 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:04.393528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-697e767a-7326-454f-a4f9-38bdd61381e8 service neutron] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 on host n-h2-841483-1 for vnic_type normal with profile None {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:09:04.393854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-697e767a-7326-454f-a4f9-38bdd61381e8 service neutron] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:09:04.394182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-697e767a-7326-454f-a4f9-38bdd61381e8 service neutron] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:04.405923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-697e767a-7326-454f-a4f9-38bdd61381e8 service neutron] Port b4e74807-b360-4c0d-894d-809b429ca3a6 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:09:04.406239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-697e767a-7326-454f-a4f9-38bdd61381e8 service neutron] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:04.416020 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-a9f39ab5-2dd7-44a9-b7c7-5df8d5caf46d tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0823245 May 12 15:09:04.654785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-82e4b8a4-8235-4e97-b782-70c518aed756 admin admin] Calling delete_port for 5547b996-f6f1-4969-9052-5353e51dbe15 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:04.683071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-697e767a-7326-454f-a4f9-38bdd61381e8 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 9, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:09:04.683407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-697e767a-7326-454f-a4f9-38bdd61381e8 service neutron] Checking segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:04.683815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-697e767a-7326-454f-a4f9-38bdd61381e8 service neutron] Bound using segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:09:04.684259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-697e767a-7326-454f-a4f9-38bdd61381e8 service neutron] Bound port: b4e74807-b360-4c0d-894d-809b429ca3a6, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:09:04.700161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12faba53-23c7-46c9-9dce-6df67d21f0e9 req-d5e96a03-f2ce-45a1-a646-95a303aa6d80 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:04.702315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12faba53-23c7-46c9-9dce-6df67d21f0e9 req-d5e96a03-f2ce-45a1-a646-95a303aa6d80 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/ports?device_id=7eab681f-43e0-4c0a-bdb9-74a7ea6de40b HTTP/1.1" status: 200 len: 946 time: 0.0965643 May 12 15:09:04.753589 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12faba53-23c7-46c9-9dce-6df67d21f0e9 req-869ddec7-80db-4ef6-98ef-3dabf9aff486 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/security-groups?id=32089edf-5255-423f-8e69-be133d389cd9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445461 May 12 15:09:04.771900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-697e767a-7326-454f-a4f9-38bdd61381e8 service neutron] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b4e74807-b360-4c0d-894d-809b429ca3a6,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:09:04.787868 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-697e767a-7326-454f-a4f9-38bdd61381e8 service neutron] Notify callbacks [] for binding, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:04.789030 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-697e767a-7326-454f-a4f9-38bdd61381e8 service neutron] 10.222.0.82 "POST /v2.0/ports/b4e74807-b360-4c0d-894d-809b429ca3a6/bindings HTTP/1.1" status: 201 len: 389 time: 0.7915931 May 12 15:09:04.935529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82e4b8a4-8235-4e97-b782-70c518aed756 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:04.983621 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-434b1833-bec6-468a-8bf7-f120950b2cfd req-b27ef322-3cb0-4e3e-8894-b522cbd05ab3 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-groups/e8575d86-de9c-46d1-972c-e06fc52f7ad7 HTTP/1.1" status: 200 len: 1813 time: 0.0893064 May 12 15:09:05.026709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82e4b8a4-8235-4e97-b782-70c518aed756 admin admin] Pushing event deleted for resources: {'Port': ['ID=5547b996-f6f1-4969-9052-5353e51dbe15,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:05.060573 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8e7a8de6-36aa-429f-935c-dfe94fee2172'] response: {'name': 'network-changed', 'server_uuid': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'tag': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'status': 'completed', 'code': 200} May 12 15:09:05.214042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f35d2e-8edc-4c5a-a6ec-beecc22cbe20 req-a9e10a1f-2246-4be8-aef4-0ed5d0e64dab tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:05.215692 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37f35d2e-8edc-4c5a-a6ec-beecc22cbe20 req-a9e10a1f-2246-4be8-aef4-0ed5d0e64dab tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.76 "GET /v2.0/ports?device_id=7eab681f-43e0-4c0a-bdb9-74a7ea6de40b HTTP/1.1" status: 200 len: 946 time: 0.2253413 May 12 15:09:05.346713 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0fc6c983-9be7-47e8-b162-89284833b5e0 req-c59a3667-1587-4342-a0bf-1d4cf7431bb0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 210 time: 0.1295223 May 12 15:09:05.488577 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82e4b8a4-8235-4e97-b782-70c518aed756 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:05.541479 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-22cefaa5-c6fa-42a0-a690-9f36e738c2e7 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips/39327416-fca3-4fc6-84f2-31a84b283d83 HTTP/1.1" status: 200 len: 693 time: 0.1873653 May 12 15:09:05.607899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-37f35d2e-8edc-4c5a-a6ec-beecc22cbe20 req-82e65254-4825-44c1-a9bf-2034356f1989 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Deleting port 05971417-5c62-469b-bcc4-c4aa1291bb6f {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:05.608145 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-37f35d2e-8edc-4c5a-a6ec-beecc22cbe20 req-82e65254-4825-44c1-a9bf-2034356f1989 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:05.756935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-086b29d8-910b-48b0-8460-80e39eba5a76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:05.758411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-086b29d8-910b-48b0-8460-80e39eba5a76 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 1096 time: 0.5395544 May 12 15:09:05.760099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a37782-19f6-41f8-b8ed-890a2bc88b82 req-59f8e547-7c91-4b66-95ea-034b6d74f1de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:05.761411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8a37782-19f6-41f8-b8ed-890a2bc88b82 req-59f8e547-7c91-4b66-95ea-034b6d74f1de service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bad2264067c248e9803d4b1eeb73116d&device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 1096 time: 0.6540391 May 12 15:09:05.878007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-82e4b8a4-8235-4e97-b782-70c518aed756 admin admin] Router fab022ae-aab5-4b4f-a77e-4570d094dd89 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:09:05.993711 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-124be258-df04-4082-8d53-fb778a289876 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=0da54985cde346e68eeadf965b8bc6d3&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0502019 May 12 15:09:06.180664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07abbd22-0af2-4c27-a9de-452dfa6d426c req-e4b0d05d-2e53-4cd6-ad87-33bcf71ca42b tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:06.182760 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-07abbd22-0af2-4c27-a9de-452dfa6d426c req-e4b0d05d-2e53-4cd6-ad87-33bcf71ca42b tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 945 time: 0.6907015 May 12 15:09:06.219737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-82e4b8a4-8235-4e97-b782-70c518aed756 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:09:06.232023 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df8efbb4-3098-4bf7-a444-e9498f5de45d None None] Sync routers for ids ['fab022ae-aab5-4b4f-a77e-4570d094dd89'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:09:06.238104 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-82e4b8a4-8235-4e97-b782-70c518aed756 admin admin] 10.222.0.82 "PUT /v2.0/routers/fab022ae-aab5-4b4f-a77e-4570d094dd89/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4972990 May 12 15:09:06.241872 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df8efbb4-3098-4bf7-a444-e9498f5de45d None None] Routers {'fab022ae-aab5-4b4f-a77e-4570d094dd89'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:06.242552 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-df8efbb4-3098-4bf7-a444-e9498f5de45d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['fab022ae-aab5-4b4f-a77e-4570d094dd89'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:06.254785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-1e51c766-ac23-4f62-aa9d-3d7ffe876b4d tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:06.255182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48990) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:06.262571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-1e51c766-ac23-4f62-aa9d-3d7ffe876b4d tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.7079206 May 12 15:09:06.296363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-5f3f71f8-f46d-4ef6-8a68-5a907761efa3 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:09:06.304800 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-5f3f71f8-f46d-4ef6-8a68-5a907761efa3 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0410187 May 12 15:09:06.509331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-fe8dc92f-9e92-4f04-a77b-4b69f3924843 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:06.511885 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-fe8dc92f-9e92-4f04-a77b-4b69f3924843 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5114515 May 12 15:09:06.521992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-622b91b9-caf5-488a-841b-baf72c5338c7 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.73 HTTP/1.1" status: 200 len: 696 time: 0.2150741 May 12 15:09:06.522342 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-df8efbb4-3098-4bf7-a444-e9498f5de45d None None] Set router fab022ae-aab5-4b4f-a77e-4570d094dd89 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:06.583748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Request body: {'port': {'device_id': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '0da54985cde346e68eeadf965b8bc6d3'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:06.607760 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-ca022956-eaca-41ea-b59b-affa1d7c12ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:06.609191 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-ca022956-eaca-41ea-b59b-affa1d7c12ab service neutron] 10.222.0.76 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.8421249 May 12 15:09:06.620981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a37782-19f6-41f8-b8ed-890a2bc88b82 req-4c4451b4-212c-47af-bbcb-7cc1006e65fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:06.624145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8a37782-19f6-41f8-b8ed-890a2bc88b82 req-4c4451b4-212c-47af-bbcb-7cc1006e65fa service neutron] 10.222.0.84 "GET /v2.0/networks?id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 200 len: 922 time: 0.7935660 May 12 15:09:06.634717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-07abbd22-0af2-4c27-a9de-452dfa6d426c req-fc32e96f-7a6c-42a9-bab3-198a6e1446a9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3577266 May 12 15:09:06.718701 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:06.853771 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-6e917e34-e0c2-489f-9d88-e9455168176f tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.73 HTTP/1.1" status: 200 len: 696 time: 0.3317716 May 12 15:09:06.858377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8a37782-19f6-41f8-b8ed-890a2bc88b82 req-59b1a60a-cf7e-4431-9633-17ff1fdef1a2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 200 len: 217 time: 0.1482549 May 12 15:09:06.859573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-16007214-a6aa-4ed6-a236-30f0b7d53ff1 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b4e74807-b360-4c0d-894d-809b429ca3a6 HTTP/1.1" status: 200 len: 217 time: 0.2229850 May 12 15:09:06.867559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-37f35d2e-8edc-4c5a-a6ec-beecc22cbe20 req-82e65254-4825-44c1-a9bf-2034356f1989 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] For port 05971417-5c62-469b-bcc4-c4aa1291bb6f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=05971417-5c62-469b-bcc4-c4aa1291bb6f,segment=NetworkSegment(6eefd9b4-779d-4776-9b4f-7ffc772f0b91),segment_id=6eefd9b4-779d-4776-9b4f-7ffc772f0b91)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:06.867887 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-37f35d2e-8edc-4c5a-a6ec-beecc22cbe20 req-82e65254-4825-44c1-a9bf-2034356f1989 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:06.903160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:06.927254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:06.956408 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:06.958595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Made reservation on behalf of 0da54985cde346e68eeadf965b8bc6d3 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:09:06.961865 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:07.008083 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-df8efbb4-3098-4bf7-a444-e9498f5de45d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:09:04Z', 'revision_number': 5, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port': {'id': '0994331e-432f-4c92-94e5-29c9fa287d0a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:d5:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:05:54Z', 'updated_at': '2022-05-12T15:06:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:07.014016 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df8efbb4-3098-4bf7-a444-e9498f5de45d None None] Checking router: fab022ae-aab5-4b4f-a77e-4570d094dd89 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:09:07.026107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] Deleting port 0994331e-432f-4c92-94e5-29c9fa287d0a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:07.026774 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:07.028385 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df8efbb4-3098-4bf7-a444-e9498f5de45d None None] Routers {'fab022ae-aab5-4b4f-a77e-4570d094dd89'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:07.030181 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-df8efbb4-3098-4bf7-a444-e9498f5de45d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['fab022ae-aab5-4b4f-a77e-4570d094dd89'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:07.221199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-37f35d2e-8edc-4c5a-a6ec-beecc22cbe20 req-82e65254-4825-44c1-a9bf-2034356f1989 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Calling delete_port for 05971417-5c62-469b-bcc4-c4aa1291bb6f owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:07.295302 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-df8efbb4-3098-4bf7-a444-e9498f5de45d None None] Set router fab022ae-aab5-4b4f-a77e-4570d094dd89 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:07.386735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a37782-19f6-41f8-b8ed-890a2bc88b82 req-e8797189-538d-4ea4-bf98-b5ad25e145e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:07.387249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8a37782-19f6-41f8-b8ed-890a2bc88b82 req-e8797189-538d-4ea4-bf98-b5ad25e145e1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 200 len: 860 time: 0.5217087 May 12 15:09:07.430337 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-df8efbb4-3098-4bf7-a444-e9498f5de45d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:09:06Z', 'revision_number': 6, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:07.430598 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Allocated IP 192.168.233.52 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/a686f1c4-b2f1-4692-950a-b2a71f6aeb6f) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:09:07.431666 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df8efbb4-3098-4bf7-a444-e9498f5de45d None None] The sync data for ids ['fab022ae-aab5-4b4f-a77e-4570d094dd89'] in n-d-841483-1 is: [{'id': 'fab022ae-aab5-4b4f-a77e-4570d094dd89', 'name': 'tempest-AttachSCSIVolumeTestJSON-374394841-router', 'tenant_id': 'ff9b9aa97cf84863aedddc5615398c31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:05:53Z', 'updated_at': '2022-05-12T15:09:06Z', 'revision_number': 6, 'project_id': 'ff9b9aa97cf84863aedddc5615398c31', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:09:07.454308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-84493eb3-f111-46b8-87f5-c4be4dd4c50d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:07.457014 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-84493eb3-f111-46b8-87f5-c4be4dd4c50d service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.5092318 May 12 15:09:07.460104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] For port 0994331e-432f-4c92-94e5-29c9fa287d0a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0994331e-432f-4c92-94e5-29c9fa287d0a,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:07.460478 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:07.482141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-fa4c8899-c17e-4565-a295-ce8de26b8f06 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Deleting port f5c4549f-a189-4498-af4d-65d243cbc3a9 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:07.482477 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-fa4c8899-c17e-4565-a295-ce8de26b8f06 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:07.493115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a5ecb3a-df75-46ca-82be-9dcc5598c7d5 req-6d6c4a09-15a1-4d46-b830-e284f3b44d15 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:07.493548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-8a5ecb3a-df75-46ca-82be-9dcc5598c7d5 req-6d6c4a09-15a1-4d46-b830-e284f3b44d15 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Synchronizing usage tracker for tenant:7413f696702a49c390950b9a967696fa on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:09:07.497917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 05971417-5c62-469b-bcc4-c4aa1291bb6f no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:07.632560 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-dcb7d052-2a4c-4a91-94f8-df14342f2bcb service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1506457 May 12 15:09:07.643727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] Calling delete_port for 0994331e-432f-4c92-94e5-29c9fa287d0a owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:07.650413 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:07.713057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-8a5ecb3a-df75-46ca-82be-9dcc5598c7d5 req-6d6c4a09-15a1-4d46-b830-e284f3b44d15 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Unset dirty status for tenant:7413f696702a49c390950b9a967696fa on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:09:07.714027 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8a5ecb3a-df75-46ca-82be-9dcc5598c7d5 req-6d6c4a09-15a1-4d46-b830-e284f3b44d15 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.84 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 951 time: 0.6511140 May 12 15:09:07.935925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-8a5ecb3a-df75-46ca-82be-9dcc5598c7d5 req-94dcdcf5-f7b0-496f-a55d-211dabee309c tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Deleting port e5430b6d-6430-4a47-b068-7f891fa37da9 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:07.937453 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8a5ecb3a-df75-46ca-82be-9dcc5598c7d5 req-94dcdcf5-f7b0-496f-a55d-211dabee309c tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:08.034888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32e5bcfc-1396-4d3e-879d-3d42aa4808bc req-b013feda-e2fb-40a4-9cf9-7041467ee18f tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:08.037864 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32e5bcfc-1396-4d3e-879d-3d42aa4808bc req-b013feda-e2fb-40a4-9cf9-7041467ee18f tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 951 time: 1.1811390 May 12 15:09:08.107461 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-37f35d2e-8edc-4c5a-a6ec-beecc22cbe20 req-82e65254-4825-44c1-a9bf-2034356f1989 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:08.217043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82e65254-4825-44c1-a9bf-2034356f1989 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Pushing event deleted for resources: {'Port': ['ID=05971417-5c62-469b-bcc4-c4aa1291bb6f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:08.222115 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a37782-19f6-41f8-b8ed-890a2bc88b82 req-6b76eda9-0a03-4a59-bb57-eb87ba042128 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:08.223623 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8a37782-19f6-41f8-b8ed-890a2bc88b82 req-6b76eda9-0a03-4a59-bb57-eb87ba042128 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5af19f47-caf0-45a8-9b3d-186b8fd71ec1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.8145609 May 12 15:09:08.233334 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:08.320304 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Transition to ACTIVE for port object a686f1c4-b2f1-4692-950a-b2a71f6aeb6f will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:09:08.352147 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-fa4c8899-c17e-4565-a295-ce8de26b8f06 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:08.352476 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-fa4c8899-c17e-4565-a295-ce8de26b8f06 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:08.360055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-37f35d2e-8edc-4c5a-a6ec-beecc22cbe20 req-82e65254-4825-44c1-a9bf-2034356f1989 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] No DVR routers for this DVR port 05971417-5c62-469b-bcc4-c4aa1291bb6f on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:09:08.374819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5547b996-f6f1-4969-9052-5353e51dbe15 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:08.411545 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 5547b996-f6f1-4969-9052-5353e51dbe15 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:09:08.412317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5547b996-f6f1-4969-9052-5353e51dbe15 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:09:08.412885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0994331e-432f-4c92-94e5-29c9fa287d0a no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:08.416703 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-a49015d6-28a2-44c3-ab81-78caeca576b2 service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7678123 May 12 15:09:08.418097 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-37f35d2e-8edc-4c5a-a6ec-beecc22cbe20 req-82e65254-4825-44c1-a9bf-2034356f1989 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:08.427390 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:08.429500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7eab681f-43e0-4c0a-bdb9-74a7ea6de40b', 'name': 'network-vif-deleted', 'tag': '05971417-5c62-469b-bcc4-c4aa1291bb6f'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:09:08.455500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 0994331e-432f-4c92-94e5-29c9fa287d0a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:09:08.455828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0994331e-432f-4c92-94e5-29c9fa287d0a not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:09:08.499861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] Pushing event deleted for resources: {'Port': ['ID=0994331e-432f-4c92-94e5-29c9fa287d0a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:08.590142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-fa4c8899-c17e-4565-a295-ce8de26b8f06 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Calling delete_port for f5c4549f-a189-4498-af4d-65d243cbc3a9 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:08.594595 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:08.607901 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['b6035326-cd91-47d7-8a65-cc2dd3d1d127', 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:09:08.683973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-8a5ecb3a-df75-46ca-82be-9dcc5598c7d5 req-94dcdcf5-f7b0-496f-a55d-211dabee309c tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] For port e5430b6d-6430-4a47-b068-7f891fa37da9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e5430b6d-6430-4a47-b068-7f891fa37da9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:08.684339 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8a5ecb3a-df75-46ca-82be-9dcc5598c7d5 req-94dcdcf5-f7b0-496f-a55d-211dabee309c tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:08.693497 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37f35d2e-8edc-4c5a-a6ec-beecc22cbe20 req-82e65254-4825-44c1-a9bf-2034356f1989 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.76 "DELETE /v2.0/ports/05971417-5c62-469b-bcc4-c4aa1291bb6f HTTP/1.1" status: 204 len: 173 time: 3.4671834 May 12 15:09:08.715670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:09:08.802125 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32e5bcfc-1396-4d3e-879d-3d42aa4808bc req-8784a1ae-2d0b-46ca-b2e3-99e5a93dbf85 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/security-groups?id=226901b6-dd8d-4451-b59a-4e1a727e153f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7480671 May 12 15:09:08.809457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-f4f09750-7110-45c7-9db1-d7b660058716 service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3271797 May 12 15:09:08.840163 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:08.853141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-8a5ecb3a-df75-46ca-82be-9dcc5598c7d5 req-94dcdcf5-f7b0-496f-a55d-211dabee309c tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Calling delete_port for e5430b6d-6430-4a47-b068-7f891fa37da9 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:08.894798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:09:08.937476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Pushing event updated for resources: {'Port': ['ID=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:08.983082 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:09.004014 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-fa4c8899-c17e-4565-a295-ce8de26b8f06 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:09.122407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa4c8899-c17e-4565-a295-ce8de26b8f06 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Pushing event deleted for resources: {'Port': ['ID=f5c4549f-a189-4498-af4d-65d243cbc3a9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:09.125489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8dc5c316-d7dc-4fd5-b34c-63a0264a5401 req-9962a2a2-3fda-4b1d-b198-9d28ac2878b9 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Synchronizing usage tracker for tenant:153fc52d3d58413ebbcf4e094c9ec085 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:09:09.181878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8a37782-19f6-41f8-b8ed-890a2bc88b82 req-4c7eaadd-06c1-4201-8bf1-4300e7ecd4a8 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9283166 May 12 15:09:09.194453 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e1b95daf-3d8e-4a5f-8d98-842ffa124be7 None None] Provisioning for port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:09:09.203848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e1b95daf-3d8e-4a5f-8d98-842ffa124be7 None None] Provisioning complete for port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:09.207218 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e1b95daf-3d8e-4a5f-8d98-842ffa124be7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:09.243511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:09.244146 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:09.311658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e1b95daf-3d8e-4a5f-8d98-842ffa124be7 None None] Port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:09:09.442050 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8a5ecb3a-df75-46ca-82be-9dcc5598c7d5 req-94dcdcf5-f7b0-496f-a55d-211dabee309c tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:09.457278 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-fa4c8899-c17e-4565-a295-ce8de26b8f06 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:09.484118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8dc5c316-d7dc-4fd5-b34c-63a0264a5401 req-9962a2a2-3fda-4b1d-b198-9d28ac2878b9 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] Unset dirty status for tenant:153fc52d3d58413ebbcf4e094c9ec085 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:09:09.485255 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8dc5c316-d7dc-4fd5-b34c-63a0264a5401 req-9962a2a2-3fda-4b1d-b198-9d28ac2878b9 tempest-ServerPasswordTestJSON-1947174138 tempest-ServerPasswordTestJSON-1947174138-project] 10.222.0.82 "GET /v2.0/ports?device_id=7eab681f-43e0-4c0a-bdb9-74a7ea6de40b HTTP/1.1" status: 200 len: 210 time: 0.4138043 May 12 15:09:09.491386 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8a37782-19f6-41f8-b8ed-890a2bc88b82 req-33542c23-9fbb-4bab-8556-f57219ad4e75 service neutron] 10.222.0.84 "GET /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2079971 May 12 15:09:09.506905 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-fa4c8899-c17e-4565-a295-ce8de26b8f06 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:09.508088 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-9a0805f9-1b91-4075-b7d6-a519f21278fa tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.9284046 May 12 15:09:09.513905 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d1948f3-92ab-4045-b0b5-c37b5fa95388 req-fa4c8899-c17e-4565-a295-ce8de26b8f06 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "DELETE /v2.0/floatingips/39327416-fca3-4fc6-84f2-31a84b283d83 HTTP/1.1" status: 204 len: 173 time: 2.5677745 May 12 15:09:09.537831 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:09.551229 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:09.561472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Request body: {'port': {'device_id': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:09.595011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-0cb7e635-5c9a-4e4e-8738-770e29ab807d req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1187600625', 'description': 'tempest-description-182116549'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:09.601709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0cb7e635-5c9a-4e4e-8738-770e29ab807d req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:09.606218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0cb7e635-5c9a-4e4e-8738-770e29ab807d req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Usage tracker for resource:security_group and tenant:1765470896784bdd91025d3b6fa9cabd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:09.609270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0cb7e635-5c9a-4e4e-8738-770e29ab807d req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Quota usage for security_group was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:09.616444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0cb7e635-5c9a-4e4e-8738-770e29ab807d req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Attempting to reserve 1 items for resource security_group. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:09.635544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94dcdcf5-f7b0-496f-a55d-211dabee309c tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Pushing event deleted for resources: {'Port': ['ID=e5430b6d-6430-4a47-b068-7f891fa37da9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:09.667459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a5ecb3a-df75-46ca-82be-9dcc5598c7d5 req-94dcdcf5-f7b0-496f-a55d-211dabee309c tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] No DVR routers for this DVR port e5430b6d-6430-4a47-b068-7f891fa37da9 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:09:09.670115 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0cb7e635-5c9a-4e4e-8738-770e29ab807d req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:09.681852 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8a5ecb3a-df75-46ca-82be-9dcc5598c7d5 req-94dcdcf5-f7b0-496f-a55d-211dabee309c tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:09.686427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8d278524-0445-4a95-8564-3c04c2f3c41d', 'name': 'network-vif-deleted', 'tag': 'e5430b6d-6430-4a47-b068-7f891fa37da9'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:09:09.696457 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:09.697057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router fab022ae-aab5-4b4f-a77e-4570d094dd89 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:09:09.702753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:09.704010 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-24c67b2a-cb67-49c1-9d24-96a554f703d6 admin admin] 10.222.0.82 "DELETE /v2.0/routers/fab022ae-aab5-4b4f-a77e-4570d094dd89 HTTP/1.1" status: 204 len: 168 time: 3.4476907 May 12 15:09:09.708571 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8a5ecb3a-df75-46ca-82be-9dcc5598c7d5 req-94dcdcf5-f7b0-496f-a55d-211dabee309c tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.84 "DELETE /v2.0/ports/e5430b6d-6430-4a47-b068-7f891fa37da9 HTTP/1.1" status: 204 len: 173 time: 1.9826090 May 12 15:09:09.709096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49012) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:09.729971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0cb7e635-5c9a-4e4e-8738-770e29ab807d req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:09.735606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0cb7e635-5c9a-4e4e-8738-770e29ab807d req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Usage tracker for resource:security_group_rule and tenant:1765470896784bdd91025d3b6fa9cabd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:09.740656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0cb7e635-5c9a-4e4e-8738-770e29ab807d req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:09.751455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0cb7e635-5c9a-4e4e-8738-770e29ab807d req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:09.766984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-201e539c-095e-4eb0-88ed-3d50348d4fa1 req-210edbce-c5f0-4277-866c-f892c29f8565 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:09.768200 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-201e539c-095e-4eb0-88ed-3d50348d4fa1 req-210edbce-c5f0-4277-866c-f892c29f8565 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 935 time: 0.1428051 May 12 15:09:09.853210 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:09.905068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-201e539c-095e-4eb0-88ed-3d50348d4fa1 req-b34bc160-390d-4b42-b2de-b2b4333e8cd1 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1290026 May 12 15:09:10.023192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0cb7e635-5c9a-4e4e-8738-770e29ab807d req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:10.030071 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0cb7e635-5c9a-4e4e-8738-770e29ab807d req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:10.186539 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-9680ab8c-703c-4a6b-a64f-c6d7f77cc6a8 admin admin] Deleting subnet 3ef83b9d-c5b9-4653-9e37-725af3b0ea4c {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:09:10.192967 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9680ab8c-703c-4a6b-a64f-c6d7f77cc6a8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:10.255732 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9680ab8c-703c-4a6b-a64f-c6d7f77cc6a8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:10.267066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b77a65c0-d8e5-4946-9999-adf20f0d34f8,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:10.270623 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0cb7e635-5c9a-4e4e-8738-770e29ab807d req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:10.272285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0cb7e635-5c9a-4e4e-8738-770e29ab807d req-33b98d16-ff8b-48ea-8653-216ec7d22f67 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1817 time: 0.6814356 May 12 15:09:10.345802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5170a8f-a50b-416e-9d9c-98933b9a994b req-fb5c3bf3-0601-46ae-a04e-c9eb0f55cc66 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:10.347330 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5170a8f-a50b-416e-9d9c-98933b9a994b req-fb5c3bf3-0601-46ae-a04e-c9eb0f55cc66 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 945 time: 0.1333423 May 12 15:09:10.352456 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b5c26c03-a95e-4543-9bb8-97f50e9ac6a5'] response: {'server_uuid': '7eab681f-43e0-4c0a-bdb9-74a7ea6de40b', 'name': 'network-vif-deleted', 'tag': '05971417-5c62-469b-bcc4-c4aa1291bb6f', 'status': 'completed', 'code': 200} May 12 15:09:10.417000 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5170a8f-a50b-416e-9d9c-98933b9a994b req-19980909-3393-4c9f-a612-ad585ba930c4 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619900 May 12 15:09:10.529858 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-536483b6-1db3-4546-8789-e9838b8fe24c'] response: {'server_uuid': '8d278524-0445-4a95-8564-3c04c2f3c41d', 'name': 'network-vif-deleted', 'tag': 'e5430b6d-6430-4a47-b068-7f891fa37da9', 'status': 'completed', 'code': 200} May 12 15:09:10.611551 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9680ab8c-703c-4a6b-a64f-c6d7f77cc6a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:10.726705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a686f1c4-b2f1-4692-950a-b2a71f6aeb6f {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:09:10.736644 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:10.759273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Transition to ACTIVE for port object a686f1c4-b2f1-4692-950a-b2a71f6aeb6f will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:09:10.762627 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9680ab8c-703c-4a6b-a64f-c6d7f77cc6a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:10.775706 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cfe5bdee-2b0b-497c-bf60-9b97ae72443a req-fd29ca44-bec3-4285-b9b9-2a8429b9f524 tempest-ServersAdminTestJSON-281292709 tempest-ServersAdminTestJSON-281292709-project] 10.222.0.82 "GET /v2.0/ports?device_id=8d278524-0445-4a95-8564-3c04c2f3c41d HTTP/1.1" status: 200 len: 210 time: 0.0775478 May 12 15:09:10.796868 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:10.808333 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7324173-b4b6-41d1-80a2-5a0abf6a9382 req-89fda6a9-d6b1-4866-ad0d-9289581b2ca9 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-groups/b77a65c0-d8e5-4946-9999-adf20f0d34f8 HTTP/1.1" status: 200 len: 1812 time: 0.1082103 May 12 15:09:10.849357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9680ab8c-703c-4a6b-a64f-c6d7f77cc6a8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3ef83b9d-c5b9-4653-9e37-725af3b0ea4c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:10.869437 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9680ab8c-703c-4a6b-a64f-c6d7f77cc6a8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:10.871882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5319b498-18e4-4a47-8516-30bdeef5a146 None None] Network 4c945198-2daa-4ae0-a8c1-07ee6da52271 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:09:10.887230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49030) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:10.912531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e5430b6d-6430-4a47-b068-7f891fa37da9 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:10.950352 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9680ab8c-703c-4a6b-a64f-c6d7f77cc6a8 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/3ef83b9d-c5b9-4653-9e37-725af3b0ea4c HTTP/1.1" status: 204 len: 168 time: 1.2400119 May 12 15:09:10.955984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-936e74f2-e02d-4661-a91d-6ff854be1fc2 req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1992626155', 'description': 'tempest-description-1192871764'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:10.968596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49036) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:10.986817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-936e74f2-e02d-4661-a91d-6ff854be1fc2 req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:11.001885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-936e74f2-e02d-4661-a91d-6ff854be1fc2 req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Usage tracker for resource:security_group and tenant:1765470896784bdd91025d3b6fa9cabd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:11.006478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-936e74f2-e02d-4661-a91d-6ff854be1fc2 req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Quota usage for security_group was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:11.018342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-936e74f2-e02d-4661-a91d-6ff854be1fc2 req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Attempting to reserve 1 items for resource security_group. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:11.023016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-18185cb6-5a53-41aa-9f5f-38f7315aea00 admin admin] Deleting subnet 110673fc-f28f-4534-af1b-b57b5d397f0f {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:09:11.027310 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18185cb6-5a53-41aa-9f5f-38f7315aea00 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.029139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: e5430b6d-6430-4a47-b068-7f891fa37da9 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:09:11.029515 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e5430b6d-6430-4a47-b068-7f891fa37da9 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:09:11.033913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Pushing event updated for resources: {'Port': ['ID=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:11.124729 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-936e74f2-e02d-4661-a91d-6ff854be1fc2 req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.157507 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18185cb6-5a53-41aa-9f5f-38f7315aea00 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.202994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-936e74f2-e02d-4661-a91d-6ff854be1fc2 req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:11.218346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-936e74f2-e02d-4661-a91d-6ff854be1fc2 req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Usage tracker for resource:security_group_rule and tenant:1765470896784bdd91025d3b6fa9cabd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:11.223936 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.226867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-936e74f2-e02d-4661-a91d-6ff854be1fc2 req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:11.242320 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-936e74f2-e02d-4661-a91d-6ff854be1fc2 req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:11.255652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Attempting to bind port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:09:11.255985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Attempting to bind port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:09:11.256315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Attempting to bind port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:11.260373 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18185cb6-5a53-41aa-9f5f-38f7315aea00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.261921 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:09:11.262243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Attempting to bind port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:11.264639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Deleting port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:11.265150 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.275861 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ed924e6-6942-4be1-b711-499caa21c63e None None] DHCP port deletion for 4c945198-2daa-4ae0-a8c1-07ee6da52271 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:09:11.281148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1ed924e6-6942-4be1-b711-499caa21c63e None None] Deleting port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:11.281915 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1ed924e6-6942-4be1-b711-499caa21c63e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.313504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 8, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:09:11.313965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:11.315108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:09:11.315716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Bound port: a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:09:11.316223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.349697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e4239fc-ea17-44d8-a9e6-7a0537750f1c req-e4f216ba-74f3-4c00-bbff-0c12632b66c3 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:11.349852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4e4239fc-ea17-44d8-a9e6-7a0537750f1c req-e4f216ba-74f3-4c00-bbff-0c12632b66c3 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Synchronizing usage tracker for tenant:bad2264067c248e9803d4b1eeb73116d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:09:11.404697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4e4239fc-ea17-44d8-a9e6-7a0537750f1c req-e4f216ba-74f3-4c00-bbff-0c12632b66c3 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Unset dirty status for tenant:bad2264067c248e9803d4b1eeb73116d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:09:11.405796 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e4239fc-ea17-44d8-a9e6-7a0537750f1c req-e4f216ba-74f3-4c00-bbff-0c12632b66c3 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 945 time: 0.4141715 May 12 15:09:11.409899 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18185cb6-5a53-41aa-9f5f-38f7315aea00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.479206 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-936e74f2-e02d-4661-a91d-6ff854be1fc2 req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.483715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18185cb6-5a53-41aa-9f5f-38f7315aea00 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=110673fc-f28f-4534-af1b-b57b5d397f0f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:11.487192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18185cb6-5a53-41aa-9f5f-38f7315aea00 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.494090 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-936e74f2-e02d-4661-a91d-6ff854be1fc2 req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.523982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1ed924e6-6942-4be1-b711-499caa21c63e None None] For port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832,segment=NetworkSegment(49f41745-6217-458f-8fa0-7833e5e7c9df),segment_id=49f41745-6217-458f-8fa0-7833e5e7c9df)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:11.524375 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1ed924e6-6942-4be1-b711-499caa21c63e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.545980 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-18185cb6-5a53-41aa-9f5f-38f7315aea00 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/110673fc-f28f-4534-af1b-b57b5d397f0f HTTP/1.1" status: 204 len: 168 time: 0.6574647 May 12 15:09:11.554867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49044) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:11.562245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:09:11.564199 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-936e74f2-e02d-4661-a91d-6ff854be1fc2 req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.565364 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-936e74f2-e02d-4661-a91d-6ff854be1fc2 req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1818 time: 0.6337240 May 12 15:09:11.587202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e4239fc-ea17-44d8-a9e6-7a0537750f1c req-c7a202dc-9665-48c3-8f30-2d9399f131cd tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1704495 May 12 15:09:11.590852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3143a7a7-b8a4-484b-9282-b08d6432df23 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aadb6d4e-eaee-40f4-a9de-46f4a2b69842,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:11.611218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:09:11.630770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] For port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832,segment=NetworkSegment(49f41745-6217-458f-8fa0-7833e5e7c9df),segment_id=49f41745-6217-458f-8fa0-7833e5e7c9df)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:11.633873 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.652776 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.712227 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86c45b51-6911-47ab-90f6-bbc5488b2d35 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.723596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1ed924e6-6942-4be1-b711-499caa21c63e None None] Calling delete_port for dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:11.810753 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1ed924e6-6942-4be1-b711-499caa21c63e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.867929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Calling delete_port for dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:11.869740 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ed924e6-6942-4be1-b711-499caa21c63e None None] Pushing event deleted for resources: {'Port': ['ID=dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:11.875197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ed924e6-6942-4be1-b711-499caa21c63e None None] No DVR routers for this DVR port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:09:11.928037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:11.928716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.930111 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] 10.222.0.84 "PUT /v2.0/ports/a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 200 len: 1095 time: 2.3853023 May 12 15:09:11.957556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Pushing event updated for resources: {'Port': ['ID=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:11.968412 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86c45b51-6911-47ab-90f6-bbc5488b2d35 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:11.972641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:11.972981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:11.973310 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:11.973683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:11.974003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:11.974321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:11.974635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:11.974948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:11.975259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:11.975593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:11.975907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:11.976218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-550a639e-41cc-4348-9d0a-881bf5c91f2d service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:12.004032 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:09:12.004530 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:09:12.014659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-86c45b51-6911-47ab-90f6-bbc5488b2d35 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b6e076d7-9d8e-4b84-bc09-feef5e2b7c21']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:12.035742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-86c45b51-6911-47ab-90f6-bbc5488b2d35 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6eefd9b4-779d-4776-9b4f-7ffc772f0b91') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:12.036089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-86c45b51-6911-47ab-90f6-bbc5488b2d35 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6eefd9b4-779d-4776-9b4f-7ffc772f0b91') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:12.071605 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86c45b51-6911-47ab-90f6-bbc5488b2d35 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:12.094365 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ddd5a7-3d4c-482e-838b-3f13bfe77940 req-216feea0-a280-4296-9594-ec39ef073988 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:12.098665 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37ddd5a7-3d4c-482e-838b-3f13bfe77940 req-216feea0-a280-4296-9594-ec39ef073988 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 947 time: 0.3345041 May 12 15:09:12.109289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001d4f7c-616b-4d62-abed-cfe71ab017ec req-c63fef0c-e982-43c8-b87d-370d5ea4a9fd tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:12.112228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-001d4f7c-616b-4d62-abed-cfe71ab017ec req-c63fef0c-e982-43c8-b87d-370d5ea4a9fd tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 945 time: 0.3463557 May 12 15:09:12.120767 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86c45b51-6911-47ab-90f6-bbc5488b2d35 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:12.162995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-86c45b51-6911-47ab-90f6-bbc5488b2d35 admin admin] Releasing vlan 552 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:09:12.163372 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86c45b51-6911-47ab-90f6-bbc5488b2d35 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: timer() May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:09:12.179769 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:09:12.200782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-c33209c6-18dc-413c-8ff9-017809fe1012 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:12.203357 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-c33209c6-18dc-413c-8ff9-017809fe1012 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 1098 time: 0.1976018 May 12 15:09:12.278787 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37ddd5a7-3d4c-482e-838b-3f13bfe77940 req-641bff56-dcda-44bd-8850-f10feb6919d3 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1654792 May 12 15:09:12.294236 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-1ad19c19-46fa-49b1-819c-900795e16ef3 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.52&port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 200 len: 217 time: 0.0677350 May 12 15:09:12.304442 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-001d4f7c-616b-4d62-abed-cfe71ab017ec req-56eea62c-113a-449c-bcb3-31828a1c361e tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1852357 May 12 15:09:12.325696 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86c45b51-6911-47ab-90f6-bbc5488b2d35 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:12.366618 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:12.400416 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86c45b51-6911-47ab-90f6-bbc5488b2d35 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:12.404549 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:09:12.405104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:09:12.420149 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86c45b51-6911-47ab-90f6-bbc5488b2d35 admin admin] Pushing event deleted for resources: {'Network': ['ID=b6e076d7-9d8e-4b84-bc09-feef5e2b7c21,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:12.427884 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e49b4e2d-b4c6-44ef-a872-a08e6887c114 req-ffe2f8c6-c859-40a2-95bf-4cecd9796194 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-groups/aadb6d4e-eaee-40f4-a9de-46f4a2b69842 HTTP/1.1" status: 200 len: 1813 time: 0.1206360 May 12 15:09:12.431403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-86c45b51-6911-47ab-90f6-bbc5488b2d35 admin admin] 10.222.0.82 "DELETE /v2.0/networks/b6e076d7-9d8e-4b84-bc09-feef5e2b7c21 HTTP/1.1" status: 204 len: 168 time: 0.8714316 May 12 15:09:12.452940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-8d110414-3e7e-495e-a8bf-43c3a38e3033 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:12.456124 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-8d110414-3e7e-495e-a8bf-43c3a38e3033 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0940542 May 12 15:09:12.465057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-b9655390-ffaa-4591-8dec-47b9683bf736 req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1910208196', 'description': 'tempest-description-483876634'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:12.472688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-b9655390-ffaa-4591-8dec-47b9683bf736 req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:12.477228 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b9655390-ffaa-4591-8dec-47b9683bf736 req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Usage tracker for resource:security_group and tenant:1765470896784bdd91025d3b6fa9cabd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:12.480772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b9655390-ffaa-4591-8dec-47b9683bf736 req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Quota usage for security_group was recalculated. Used quota:5. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:12.487895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-b9655390-ffaa-4591-8dec-47b9683bf736 req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Attempting to reserve 1 items for resource security_group. Total usage: 5; quota limit: 100; headroom:95 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:12.503266 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b9655390-ffaa-4591-8dec-47b9683bf736 req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:12.507336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Deleting port dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:12.507901 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:12.538416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-b9655390-ffaa-4591-8dec-47b9683bf736 req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:12.542503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:09:12.542973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b9655390-ffaa-4591-8dec-47b9683bf736 req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Usage tracker for resource:security_group_rule and tenant:1765470896784bdd91025d3b6fa9cabd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:12.547303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b9655390-ffaa-4591-8dec-47b9683bf736 req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Quota usage for security_group_rule was recalculated. Used quota:12. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:12.553555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-b9655390-ffaa-4591-8dec-47b9683bf736 req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 12; quota limit: 100; headroom:88 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:12.623761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] The port 'dc2ac9cd-a6ba-40c4-8a6a-97a61a16d832' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:09:12.635471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02ab534c-5144-42e6-a3ec-db98294ffa1f req-0b1e24a8-e77e-4def-a705-299a4107232c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:12.637200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-02ab534c-5144-42e6-a3ec-db98294ffa1f req-0b1e24a8-e77e-4def-a705-299a4107232c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Synchronizing usage tracker for tenant:bad2264067c248e9803d4b1eeb73116d on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:09:12.642761 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bca5591d-c02a-4900-8e01-dcf21af1eddc'] response: {'name': 'network-changed', 'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'status': 'completed', 'code': 200} May 12 15:09:12.643550 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b9655390-ffaa-4591-8dec-47b9683bf736 req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:12.648982 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b9655390-ffaa-4591-8dec-47b9683bf736 req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:12.651149 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fed1ff43-04db-4b4e-b297-6769e4ce5441 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:12.691276 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:12.698631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Pushing event updated for resources: {'SecurityGroup': ['ID=524b484f-9758-419d-aa87-9bc59c849efb,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:12.716936 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b9655390-ffaa-4591-8dec-47b9683bf736 req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:12.718526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9655390-ffaa-4591-8dec-47b9683bf736 req-f20dcbf2-82f2-41f9-b524-7a3a9802b5fe tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1817 time: 0.2584913 May 12 15:09:12.749562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-02ab534c-5144-42e6-a3ec-db98294ffa1f req-0b1e24a8-e77e-4def-a705-299a4107232c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Unset dirty status for tenant:bad2264067c248e9803d4b1eeb73116d on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:09:12.752009 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02ab534c-5144-42e6-a3ec-db98294ffa1f req-0b1e24a8-e77e-4def-a705-299a4107232c tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.84 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 945 time: 0.4287789 May 12 15:09:12.828203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49074) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:12.887987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac7d62ef-04e0-4368-9efa-5a6910086998 req-7b5d9be3-2a32-4cb2-bb8b-69bf9d679130 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-groups/524b484f-9758-419d-aa87-9bc59c849efb HTTP/1.1" status: 200 len: 1812 time: 0.1385877 May 12 15:09:12.895308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-cfeea6c4-f55c-4b79-8f09-bbc0fd4e4673 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:12.901760 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-cfeea6c4-f55c-4b79-8f09-bbc0fd4e4673 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.4369848 May 12 15:09:12.908198 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:12.919199 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3f00b2e7-860c-405d-81b8-774542a1fd58 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=153fc52d3d58413ebbcf4e094c9ec085&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0882809 May 12 15:09:12.921986 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49080) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:13.003847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49084) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:13.041214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-02ab534c-5144-42e6-a3ec-db98294ffa1f req-691a94eb-b9ef-48f9-a42e-ff50c4400ebc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Deleting port 9015ad2b-bc53-4425-beb5-9a5e82176b06 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:13.041563 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-02ab534c-5144-42e6-a3ec-db98294ffa1f req-691a94eb-b9ef-48f9-a42e-ff50c4400ebc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.069135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c91eeda-8012-45ff-aced-e00fafa0d916 req-e52561ba-db33-43f9-9af0-62884fd7c387 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:13.070660 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c91eeda-8012-45ff-aced-e00fafa0d916 req-e52561ba-db33-43f9-9af0-62884fd7c387 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 945 time: 0.3004332 May 12 15:09:13.071504 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-830222f7-3359-4038-a394-42358eecaea8 req-3f52c701-a5cd-4983-ac80-d11dd294d958 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] show failed (client error): The resource could not be found. May 12 15:09:13.072403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-830222f7-3359-4038-a394-42358eecaea8 req-3f52c701-a5cd-4983-ac80-d11dd294d958 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-groups/390bac8f-b0e1-45d0-b227-2e305eaa1896 HTTP/1.1" status: 404 len: 352 time: 0.1473849 May 12 15:09:13.140452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4c945198-2daa-4ae0-a8c1-07ee6da52271']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:13.152388 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-f2e641b0-8f48-4e29-931c-867100823c36 req-80487061-3f4e-409b-be3c-8393177ed3e0 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] show failed (client error): The resource could not be found. May 12 15:09:13.161620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2e641b0-8f48-4e29-931c-867100823c36 req-80487061-3f4e-409b-be3c-8393177ed3e0 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-group-rules/c070b069-49dc-4262-bfd6-b490c32974e7 HTTP/1.1" status: 404 len: 361 time: 0.0563986 May 12 15:09:13.181550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '49f41745-6217-458f-8fa0-7833e5e7c9df') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:13.181846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '49f41745-6217-458f-8fa0-7833e5e7c9df') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:13.201483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c91eeda-8012-45ff-aced-e00fafa0d916 req-57a6ca69-0ab0-4ebd-b6df-9ac27fdb15ab tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/security-groups?id=0da5cbef-d2fd-454a-8ac9-aab67e936a65&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1211445 May 12 15:09:13.230711 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a91c7ce2-721f-4206-bd8c-d663f22a1bb1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.244155 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.291087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49096) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:13.309194 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a91c7ce2-721f-4206-bd8c-d663f22a1bb1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.330165 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.330490 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75443b82-d005-45a0-9f1e-cec951df6b59 req-a2320cdb-3414-4ca4-94c4-fcb025ce03b1 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-groups/524b484f-9758-419d-aa87-9bc59c849efb HTTP/1.1" status: 200 len: 1812 time: 0.1348305 May 12 15:09:13.344479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Releasing vlan 559 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:09:13.344479 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: timer() May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:09:13.369360 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:09:13.426662 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4a34bfc2-4693-4681-9b19-68a238291559 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.490463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4a34bfc2-4693-4681-9b19-68a238291559 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:13.498732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4a34bfc2-4693-4681-9b19-68a238291559 admin admin] Usage tracker for resource:security_group_rule and tenant:ee6d727310924ec29ae33194a3b96c9b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:13.503876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4a34bfc2-4693-4681-9b19-68a238291559 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:13.534172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4a34bfc2-4693-4681-9b19-68a238291559 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:13.538217 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-75443b82-d005-45a0-9f1e-cec951df6b59 req-c3daca10-d142-4270-8bdd-2f5bbe3f89ae tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.543369 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-d79d595d-7ffc-4030-bb56-c4272831acd9 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6270895 May 12 15:09:13.544322 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a91c7ce2-721f-4206-bd8c-d663f22a1bb1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.587208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a91c7ce2-721f-4206-bd8c-d663f22a1bb1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=32089edf-5255-423f-8e69-be133d389cd9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:13.613048 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-75443b82-d005-45a0-9f1e-cec951df6b59 req-c3daca10-d142-4270-8bdd-2f5bbe3f89ae tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.633146 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a91c7ce2-721f-4206-bd8c-d663f22a1bb1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.634264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a91c7ce2-721f-4206-bd8c-d663f22a1bb1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/32089edf-5255-423f-8e69-be133d389cd9 HTTP/1.1" status: 204 len: 168 time: 0.7115335 May 12 15:09:13.676531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9c3ba0f-b0ce-4ba1-b108-d649582f9ef3 req-15d2573c-4e6a-4c66-a2f5-56634c7bfe78 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:13.678022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9c3ba0f-b0ce-4ba1-b108-d649582f9ef3 req-15d2573c-4e6a-4c66-a2f5-56634c7bfe78 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 947 time: 0.2399890 May 12 15:09:13.689541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.725580 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-75443b82-d005-45a0-9f1e-cec951df6b59 req-c3daca10-d142-4270-8bdd-2f5bbe3f89ae tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.732384 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.761353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] Pushing event deleted for resources: {'Network': ['ID=4c945198-2daa-4ae0-a8c1-07ee6da52271,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:13.763620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3daca10-d142-4270-8bdd-2f5bbe3f89ae tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=524b484f-9758-419d-aa87-9bc59c849efb,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:13.768175 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2b32d3b3-6361-4ea1-b5fd-7c6e1fcac566 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7413f696702a49c390950b9a967696fa&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7497101 May 12 15:09:13.773141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49108) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:13.800690 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-68a5a8e5-7574-468f-95bb-135dbf4cabaf admin admin] 10.222.0.82 "DELETE /v2.0/networks/4c945198-2daa-4ae0-a8c1-07ee6da52271 HTTP/1.1" status: 204 len: 168 time: 2.8273935 May 12 15:09:13.802931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49114) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:13.811470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9c3ba0f-b0ce-4ba1-b108-d649582f9ef3 req-2a40a76a-e8c9-42be-9fee-1a1d677a1a9d tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1207802 May 12 15:09:13.816526 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4a34bfc2-4693-4681-9b19-68a238291559 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.821518 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-75443b82-d005-45a0-9f1e-cec951df6b59 req-c3daca10-d142-4270-8bdd-2f5bbe3f89ae tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.824856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-02ab534c-5144-42e6-a3ec-db98294ffa1f req-691a94eb-b9ef-48f9-a42e-ff50c4400ebc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] For port 9015ad2b-bc53-4425-beb5-9a5e82176b06, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9015ad2b-bc53-4425-beb5-9a5e82176b06,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:13.825243 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-02ab534c-5144-42e6-a3ec-db98294ffa1f req-691a94eb-b9ef-48f9-a42e-ff50c4400ebc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.833960 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75443b82-d005-45a0-9f1e-cec951df6b59 req-c3daca10-d142-4270-8bdd-2f5bbe3f89ae tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "DELETE /v2.0/security-groups/524b484f-9758-419d-aa87-9bc59c849efb HTTP/1.1" status: 204 len: 173 time: 0.5023756 May 12 15:09:13.858473 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4a34bfc2-4693-4681-9b19-68a238291559 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:13.997990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4a34bfc2-4693-4681-9b19-68a238291559 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ee6d727310924ec29ae33194a3b96c9b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7031777 May 12 15:09:14.015526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49126) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:14.016252 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a34bfc2-4693-4681-9b19-68a238291559 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc7889b6-fd1e-4ab8-8364-ddd8717c2c18,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:14.040240 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a03668b0-f967-40a0-bce0-d9b7cb1ff480 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:14.086899 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2afcc3f7-433c-44fa-868b-8a5cb6c30707 req-b506572c-576f-46c9-8e4d-f1dc26ab7685 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-groups/aadb6d4e-eaee-40f4-a9de-46f4a2b69842 HTTP/1.1" status: 200 len: 1813 time: 0.2324393 May 12 15:09:14.135258 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a03668b0-f967-40a0-bce0-d9b7cb1ff480 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:14.238367 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6dd708bd-2362-492a-b5df-47a3c1eee7ef req-2516e671-50dc-4b2f-99c1-e07020a66f11 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6752303 May 12 15:09:14.245451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-02ab534c-5144-42e6-a3ec-db98294ffa1f req-691a94eb-b9ef-48f9-a42e-ff50c4400ebc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Calling delete_port for 9015ad2b-bc53-4425-beb5-9a5e82176b06 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:14.301150 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d553b1d8-c7c6-4571-8b12-14c66c524e0b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:14.359413 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2afcc3f7-433c-44fa-868b-8a5cb6c30707 req-04085245-c67e-4a17-aee1-dbbefce9cf2a tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:14.360775 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a03668b0-f967-40a0-bce0-d9b7cb1ff480 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:14.387389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5356675-118c-4aee-8ea3-9f69fceee818 req-a0a9207f-c283-4c55-b781-2c6186872ed3 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:14.399193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5356675-118c-4aee-8ea3-9f69fceee818 req-a0a9207f-c283-4c55-b781-2c6186872ed3 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 945 time: 0.4419990 May 12 15:09:14.452828 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d553b1d8-c7c6-4571-8b12-14c66c524e0b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:14.462092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a03668b0-f967-40a0-bce0-d9b7cb1ff480 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=226901b6-dd8d-4451-b59a-4e1a727e153f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:14.467654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49142) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:14.562631 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2afcc3f7-433c-44fa-868b-8a5cb6c30707 req-04085245-c67e-4a17-aee1-dbbefce9cf2a tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:14.577318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5356675-118c-4aee-8ea3-9f69fceee818 req-1c7ba546-d1a2-4b29-999b-a54e0b9f1f18 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1802542 May 12 15:09:14.592981 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a03668b0-f967-40a0-bce0-d9b7cb1ff480 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:14.607991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a03668b0-f967-40a0-bce0-d9b7cb1ff480 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/226901b6-dd8d-4451-b59a-4e1a727e153f HTTP/1.1" status: 204 len: 168 time: 0.8186266 May 12 15:09:14.684087 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d553b1d8-c7c6-4571-8b12-14c66c524e0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:14.697193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728601a0-caa2-4cf4-a847-90ab7c401245 req-86a88ec2-c90d-4636-94c7-6cfffc093818 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:14.698925 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-728601a0-caa2-4cf4-a847-90ab7c401245 req-86a88ec2-c90d-4636-94c7-6cfffc093818 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 1098 time: 0.3350410 May 12 15:09:14.727164 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2afcc3f7-433c-44fa-868b-8a5cb6c30707 req-04085245-c67e-4a17-aee1-dbbefce9cf2a tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:14.787573 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f328f5f0-e9d5-4b62-8e11-1a3c3807ff17 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:14.803180 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d553b1d8-c7c6-4571-8b12-14c66c524e0b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:14.807999 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d553b1d8-c7c6-4571-8b12-14c66c524e0b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cc7889b6-fd1e-4ab8-8364-ddd8717c2c18 HTTP/1.1" status: 204 len: 168 time: 0.7840757 May 12 15:09:14.807999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d553b1d8-c7c6-4571-8b12-14c66c524e0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc7889b6-fd1e-4ab8-8364-ddd8717c2c18,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:14.832113 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-02ab534c-5144-42e6-a3ec-db98294ffa1f req-691a94eb-b9ef-48f9-a42e-ff50c4400ebc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:14.861445 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2afcc3f7-433c-44fa-868b-8a5cb6c30707 req-04085245-c67e-4a17-aee1-dbbefce9cf2a tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:14.889352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2afcc3f7-433c-44fa-868b-8a5cb6c30707 req-04085245-c67e-4a17-aee1-dbbefce9cf2a tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "DELETE /v2.0/security-groups/aadb6d4e-eaee-40f4-a9de-46f4a2b69842 HTTP/1.1" status: 204 len: 173 time: 0.7700210 May 12 15:09:14.922640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9015ad2b-bc53-4425-beb5-9a5e82176b06 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:14.933474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-691a94eb-b9ef-48f9-a42e-ff50c4400ebc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Pushing event deleted for resources: {'Port': ['ID=9015ad2b-bc53-4425-beb5-9a5e82176b06,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:14.948455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Request body: {'network': {'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-network', 'tenant_id': 'fd97c932be3143b1846bb48363040c63'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:14.994088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728601a0-caa2-4cf4-a847-90ab7c401245 req-dc2da1be-5833-4030-935a-8f99c88cb400 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:14.994088 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-728601a0-caa2-4cf4-a847-90ab7c401245 req-dc2da1be-5833-4030-935a-8f99c88cb400 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.2811124 May 12 15:09:15.007445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04085245-c67e-4a17-aee1-dbbefce9cf2a tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=aadb6d4e-eaee-40f4-a9de-46f4a2b69842,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:15.029322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:15.051437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Usage tracker for resource:network and tenant:fd97c932be3143b1846bb48363040c63 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:15.069923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:15.107579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:15.146114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 9015ad2b-bc53-4425-beb5-9a5e82176b06 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:09:15.146114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9015ad2b-bc53-4425-beb5-9a5e82176b06 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:09:15.209600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49158) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:15.216655 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-728601a0-caa2-4cf4-a847-90ab7c401245 req-5bd420dd-66ec-42b6-8545-27b96d6dfa7a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.52&port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 200 len: 217 time: 0.1940856 May 12 15:09:15.222666 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f6a2c543-3467-4c67-9178-b7daa94e91d0 req-4a0bbc88-1d24-495f-9439-d0b805b2b802 tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.82 "GET /v2.0/ports?device_id=6c001362-6181-4ca2-84a8-a7eacfa74914 HTTP/1.1" status: 200 len: 210 time: 0.1417947 May 12 15:09:15.230230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-02ab534c-5144-42e6-a3ec-db98294ffa1f req-691a94eb-b9ef-48f9-a42e-ff50c4400ebc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] No DVR routers for this DVR port 9015ad2b-bc53-4425-beb5-9a5e82176b06 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:09:15.236709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Made reservation on behalf of fd97c932be3143b1846bb48363040c63 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:09:15.240307 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:15.257257 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-02ab534c-5144-42e6-a3ec-db98294ffa1f req-691a94eb-b9ef-48f9-a42e-ff50c4400ebc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:15.328761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'name': 'network-vif-deleted', 'tag': '9015ad2b-bc53-4425-beb5-9a5e82176b06'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:09:15.368930 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02ab534c-5144-42e6-a3ec-db98294ffa1f req-691a94eb-b9ef-48f9-a42e-ff50c4400ebc tempest-FloatingIPsAssociationTestJSON-1276322171 tempest-FloatingIPsAssociationTestJSON-1276322171-project] 10.222.0.84 "DELETE /v2.0/ports/9015ad2b-bc53-4425-beb5-9a5e82176b06 HTTP/1.1" status: 204 len: 173 time: 2.5605786 May 12 15:09:15.447493 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:15.523505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:15.554108 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b94fcd60-15d3-4a5a-a359-a6dc7d6548fc admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b485d58c18db49379317964f5d6423e4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3285189 May 12 15:09:15.554108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49166) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:15.562060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728601a0-caa2-4cf4-a847-90ab7c401245 req-7a3326c8-9f11-433e-8204-20a315564952 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:15.562060 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-728601a0-caa2-4cf4-a847-90ab7c401245 req-7a3326c8-9f11-433e-8204-20a315564952 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3071485 May 12 15:09:15.620013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Usage tracker for resource:security_group_rule and tenant:fd97c932be3143b1846bb48363040c63 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:15.644610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:15.658269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:15.681924 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-132608b0-1df2-4d22-82af-9eae5401eb77 req-f4ccf1ba-7eb8-404a-8d9f-9f20976436e6 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-groups/b77a65c0-d8e5-4946-9999-adf20f0d34f8 HTTP/1.1" status: 200 len: 1812 time: 0.4228883 May 12 15:09:15.738255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f430ddc-b2e0-4138-8640-9165ab62f013 req-85d49660-a9a3-4493-a919-21f4a4ea396d tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:15.747046 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f430ddc-b2e0-4138-8640-9165ab62f013 req-85d49660-a9a3-4493-a919-21f4a4ea396d tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 947 time: 0.4897177 May 12 15:09:15.747675 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a6eea64b-0de0-4d0c-ad19-97dfa58e7990 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:15.794997 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a6eea64b-0de0-4d0c-ad19-97dfa58e7990 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:15.846772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728601a0-caa2-4cf4-a847-90ab7c401245 req-bd914355-4a09-4e05-99ee-0e9d7a30eec7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:15.846772 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-728601a0-caa2-4cf4-a847-90ab7c401245 req-bd914355-4a09-4e05-99ee-0e9d7a30eec7 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1950614 May 12 15:09:15.853316 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1febaac7-3ad7-45f2-b418-f2456ec1ca11 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:15.869653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49172) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:15.913427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f430ddc-b2e0-4138-8640-9165ab62f013 req-245810da-656a-4466-8a3c-683ed8d90485 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1615343 May 12 15:09:15.919536 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:15.988239 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.060148 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-132608b0-1df2-4d22-82af-9eae5401eb77 req-436d0b1d-e668-46e6-92b9-bc32bcc6aeaa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.062142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:16.066936 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.105128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Usage tracker for resource:security_group_rule and tenant:18bfce87629e4eb8acfeae13e2e55af2 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:16.116271 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-132608b0-1df2-4d22-82af-9eae5401eb77 req-436d0b1d-e668-46e6-92b9-bc32bcc6aeaa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.141143 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e98aab99-efbc-4fe1-a9c2-0d2fc55f4e0e'] response: {'server_uuid': '6c001362-6181-4ca2-84a8-a7eacfa74914', 'name': 'network-vif-deleted', 'tag': '9015ad2b-bc53-4425-beb5-9a5e82176b06', 'status': 'completed', 'code': 200} May 12 15:09:16.162177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:16.203780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:16.209948 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.275140 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a6eea64b-0de0-4d0c-ad19-97dfa58e7990 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.283689 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.316221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6eea64b-0de0-4d0c-ad19-97dfa58e7990 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3cf4c17e-58fe-4b5e-ad65-506924bd4ea1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:16.328500 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-728601a0-caa2-4cf4-a847-90ab7c401245 req-49bb6fb9-4f78-4c28-a49c-1384b243ebb9 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4187899 May 12 15:09:16.349535 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-132608b0-1df2-4d22-82af-9eae5401eb77 req-436d0b1d-e668-46e6-92b9-bc32bcc6aeaa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.368832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 580} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:09:16.388359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14760cab-e3dc-4bd2-9dbe-16aa688504a5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:16.408890 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a6eea64b-0de0-4d0c-ad19-97dfa58e7990 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.410003 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a6eea64b-0de0-4d0c-ad19-97dfa58e7990 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3cf4c17e-58fe-4b5e-ad65-506924bd4ea1 HTTP/1.1" status: 204 len: 168 time: 0.8569515 May 12 15:09:16.427442 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.427783 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Added segment 96a7c587-eda9-40b0-aaff-97f4e1387d63 of type vlan for network 74c45f45-b34b-4876-a35b-8ae714cf4d5f May 12 15:09:16.432555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-436d0b1d-e668-46e6-92b9-bc32bcc6aeaa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b77a65c0-d8e5-4946-9999-adf20f0d34f8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:16.460265 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfa78ccd-99fc-475a-848c-45bf26bb2a5a req-3e3b12eb-536f-4c7d-9b54-36ab738d5182 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:16.461821 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dfa78ccd-99fc-475a-848c-45bf26bb2a5a req-3e3b12eb-536f-4c7d-9b54-36ab738d5182 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 945 time: 0.3597662 May 12 15:09:16.466831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-132608b0-1df2-4d22-82af-9eae5401eb77 req-436d0b1d-e668-46e6-92b9-bc32bcc6aeaa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.468088 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-132608b0-1df2-4d22-82af-9eae5401eb77 req-436d0b1d-e668-46e6-92b9-bc32bcc6aeaa tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "DELETE /v2.0/security-groups/b77a65c0-d8e5-4946-9999-adf20f0d34f8 HTTP/1.1" status: 204 len: 173 time: 0.7802377 May 12 15:09:16.549784 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.556314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49182) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:16.564618 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dfa78ccd-99fc-475a-848c-45bf26bb2a5a req-91a6b864-33b1-4b1d-b540-8e721724b4a3 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0953999 May 12 15:09:16.574868 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.607194 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.674096 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-728601a0-caa2-4cf4-a847-90ab7c401245 req-3159e7ff-fd8b-41b6-a9ad-f60dc17e1bcb service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2931075 May 12 15:09:16.684920 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.685896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:16.686466 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.728783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=777988ba-dfd0-46f8-bbb2-c0ba71f659f9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:16.740748 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=18bfce87629e4eb8acfeae13e2e55af2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8714206 May 12 15:09:16.746132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49188) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:16.799921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:16.799921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:16.799921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:16.799921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:16.799921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:16.799921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:16.799921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:16.799921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:16.799921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:16.799921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:16.799921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:16.801750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf2151d3-ff81-4da0-bc4b-536523458e28 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:16.809090 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29daa062-9661-46fc-8d7d-ef6e55bf5859 req-491e0214-ba9f-49c9-b0bd-ff7c0f6fd395 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-groups/e8575d86-de9c-46d1-972c-e06fc52f7ad7 HTTP/1.1" status: 200 len: 1813 time: 0.2293370 May 12 15:09:16.856782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1febaac7-3ad7-45f2-b418-f2456ec1ca11 admin admin] Deleting port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:16.857326 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1febaac7-3ad7-45f2-b418-f2456ec1ca11 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:16.915678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a686f1c4-b2f1-4692-950a-b2a71f6aeb6f details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:09:16.928109 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 2.4422719 May 12 15:09:16.971014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49200) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:17.002546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Request body: {'subnet': {'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-subnet', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:17.009107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d887f163-5c5f-42fb-ba20-5bc7b44c662d admin admin] Pushing event updated for resources: {'Network': ['ID=74c45f45-b34b-4876-a35b-8ae714cf4d5f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:17.014968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 74c45f45-b34b-4876-a35b-8ae714cf4d5f details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:09:17.021735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:17.044797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Usage tracker for resource:subnet and tenant:fd97c932be3143b1846bb48363040c63 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:17.056895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:17.082427 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-29daa062-9661-46fc-8d7d-ef6e55bf5859 req-594d3696-671e-4d2a-8a53-fa3d59d489da tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:17.101697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8b36235a-09f4-49b3-afc9-1c9f1edd16cf tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:17.103260 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8b36235a-09f4-49b3-afc9-1c9f1edd16cf tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8&tenant_id=1b3825228b0e4c42a381540b66ea23d6&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1096 time: 0.3095450 May 12 15:09:17.121062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h2-841483-1'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:17.124432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:17.191971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2f92418-175d-4c29-8024-e5eae68a2a60 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:17.243858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Made reservation on behalf of fd97c932be3143b1846bb48363040c63 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:09:17.246230 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:17.384106 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-29daa062-9661-46fc-8d7d-ef6e55bf5859 req-594d3696-671e-4d2a-8a53-fa3d59d489da tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:17.388002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:17.403389 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2f92418-175d-4c29-8024-e5eae68a2a60 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:17.406287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'mac_address': 'fa:16:3e:46:3e:8a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.52'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:09:17.482783 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:17.510298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-1febaac7-3ad7-45f2-b418-f2456ec1ca11 admin admin] For port 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30,segment=NetworkSegment(6c869e32-bb71-4864-ab9a-8535af830a80),segment_id=6c869e32-bb71-4864-ab9a-8535af830a80)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:17.510666 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1febaac7-3ad7-45f2-b418-f2456ec1ca11 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:17.520017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a686f1c4-b2f1-4692-950a-b2a71f6aeb6f {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:09:17.539534 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:17.546611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:17.554565 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:17.561652 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-29daa062-9661-46fc-8d7d-ef6e55bf5859 req-594d3696-671e-4d2a-8a53-fa3d59d489da tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:17.593891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-594d3696-671e-4d2a-8a53-fa3d59d489da tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8575d86-de9c-46d1-972c-e06fc52f7ad7,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:17.615334 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-29daa062-9661-46fc-8d7d-ef6e55bf5859 req-594d3696-671e-4d2a-8a53-fa3d59d489da tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:17.616433 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29daa062-9661-46fc-8d7d-ef6e55bf5859 req-594d3696-671e-4d2a-8a53-fa3d59d489da tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "DELETE /v2.0/security-groups/e8575d86-de9c-46d1-972c-e06fc52f7ad7 HTTP/1.1" status: 204 len: 173 time: 0.7477889 May 12 15:09:17.625650 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4537a28c-aa7b-462d-beaa-3225a1b47239 req-5c244743-1127-4b1f-99c9-2e74a7170971 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:17.631038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4537a28c-aa7b-462d-beaa-3225a1b47239 req-5c244743-1127-4b1f-99c9-2e74a7170971 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 947 time: 0.4791582 May 12 15:09:17.642707 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:17.679230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:17.860263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1febaac7-3ad7-45f2-b418-f2456ec1ca11 admin admin] Calling delete_port for 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:17.870595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a686f1c4-b2f1-4692-950a-b2a71f6aeb6f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:09:17.957009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4537a28c-aa7b-462d-beaa-3225a1b47239 req-339125a1-31ff-4ef3-aa45-0c07ef09fed1 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2975578 May 12 15:09:18.026241 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2f92418-175d-4c29-8024-e5eae68a2a60 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:18.053546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2f92418-175d-4c29-8024-e5eae68a2a60 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=777988ba-dfd0-46f8-bbb2-c0ba71f659f9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:18.124899 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2f92418-175d-4c29-8024-e5eae68a2a60 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:18.129908 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f2f92418-175d-4c29-8024-e5eae68a2a60 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/777988ba-dfd0-46f8-bbb2-c0ba71f659f9 HTTP/1.1" status: 204 len: 168 time: 1.3537951 May 12 15:09:18.150402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d443474-d2a8-4003-aacc-9643d24250d4 req-e3cfcbe6-4a69-4815-8959-9c29c907ac37 tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "GET /v2.0/security-groups/d167e737-7283-41a4-bb55-d5b9dcb4bf0f HTTP/1.1" status: 200 len: 1812 time: 0.1677213 May 12 15:09:18.179512 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:18.299046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74cea71c-ec41-46d6-a960-11648351d054 req-d4d0cf80-ebbd-4c3d-b7d1-b183021d283a tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:18.300568 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74cea71c-ec41-46d6-a960-11648351d054 req-d4d0cf80-ebbd-4c3d-b7d1-b183021d283a tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 945 time: 0.5727744 May 12 15:09:18.341673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b4e74807-b360-4c0d-894d-809b429ca3a6,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:18.352420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Pushing event updated for resources: {'Subnet': ['ID=8de7231c-cca8-4041-a1ba-b8eba5dd5861,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:18.381325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Checking segment: {'id': '96a7c587-eda9-40b0-aaff-97f4e1387d63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:18.381325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Network hostable DHCP agents. Network: 74c45f45-b34b-4876-a35b-8ae714cf4d5f, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:09:18.435160 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b35fb9b-c687-47e4-a4f1-cebbb82794bd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:18.453137 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74cea71c-ec41-46d6-a960-11648351d054 req-23806094-29b2-433b-9b5f-144693829a47 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1351368 May 12 15:09:18.459121 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7d443474-d2a8-4003-aacc-9643d24250d4 req-848912ec-be09-4269-8bd4-f81bd8b9bced tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:18.480970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:09:18.536265 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7d443474-d2a8-4003-aacc-9643d24250d4 req-848912ec-be09-4269-8bd4-f81bd8b9bced tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:18.540080 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1febaac7-3ad7-45f2-b418-f2456ec1ca11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:18.591633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '90ffd47c-e072-4c18-8d59-4ad501ade5d8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b4e74807-b360-4c0d-894d-809b429ca3a6'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:09:18.598551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Network 74c45f45-b34b-4876-a35b-8ae714cf4d5f is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:09:18.600044 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:18.607208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1febaac7-3ad7-45f2-b418-f2456ec1ca11 admin admin] Pushing event deleted for resources: {'Port': ['ID=31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:18.627781 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:18.721259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 74c45f45-b34b-4876-a35b-8ae714cf4d5f) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:18.736265 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b768f67-c4b9-440e-aa81-cf3baca6b66a None None] Network 74c45f45-b34b-4876-a35b-8ae714cf4d5f requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:09:18.779200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:18.779790 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:18.916742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Pushing event updated for resources: {'Port': ['ID=b4e74807-b360-4c0d-894d-809b429ca3a6,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:18.936332 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7d443474-d2a8-4003-aacc-9643d24250d4 req-848912ec-be09-4269-8bd4-f81bd8b9bced tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:18.951538 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8ed19aa2-dc63-45a5-a523-2736520a1f1e admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 857 time: 1.9753804 May 12 15:09:18.960708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49244) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:18.981512 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c213896f-cf6d-4ba4-bac5-23946149eb5b'] response: {'server_uuid': '90ffd47c-e072-4c18-8d59-4ad501ade5d8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b4e74807-b360-4c0d-894d-809b429ca3a6', 'code': 200} May 12 15:09:19.047429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:19.078816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-848912ec-be09-4269-8bd4-f81bd8b9bced tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d167e737-7283-41a4-bb55-d5b9dcb4bf0f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:19.088696 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7d443474-d2a8-4003-aacc-9643d24250d4 req-848912ec-be09-4269-8bd4-f81bd8b9bced tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:19.089710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d443474-d2a8-4003-aacc-9643d24250d4 req-848912ec-be09-4269-8bd4-f81bd8b9bced tempest-SecurityGroupRulesNegativeTestJSON-1261301579 tempest-SecurityGroupRulesNegativeTestJSON-1261301579-project] 10.222.0.82 "DELETE /v2.0/security-groups/d167e737-7283-41a4-bb55-d5b9dcb4bf0f HTTP/1.1" status: 204 len: 173 time: 0.9385152 May 12 15:09:19.098585 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:19.098901 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49252) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:19.179721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Usage tracker for resource:router and tenant:fd97c932be3143b1846bb48363040c63 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:19.179721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:19.243298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:19.250076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a686f1c4-b2f1-4692-950a-b2a71f6aeb6f up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:09:19.255839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 on host n-h1-841483-1 for vnic_type normal with profile {"migrating_to": "n-h2-841483-1"} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:09:19.255839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:09:19.255839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:19.284690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Port b4e74807-b360-4c0d-894d-809b429ca3a6 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:09:19.284690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:19.293859 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:19.294942 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:19.313324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-fcf1596a-b74e-4476-9c67-2c4c39ef1fbd admin admin] Deleting subnet 90c1a347-6b85-4241-b499-0c3eab27e7b1 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:09:19.317069 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 9, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:09:19.317590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Checking segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:19.317886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Bound using segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:09:19.319116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Bound port: b4e74807-b360-4c0d-894d-809b429ca3a6, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:09:19.319944 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:19.333421 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fcf1596a-b74e-4476-9c67-2c4c39ef1fbd admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:19.372068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64024d55-b18d-4b8f-ac40-812d473371b0 None None] Network 74c45f45-b34b-4876-a35b-8ae714cf4d5f requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:09:19.480595 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:19.486355 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fcf1596a-b74e-4476-9c67-2c4c39ef1fbd admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:19.577320 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1febaac7-3ad7-45f2-b418-f2456ec1ca11 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:19.651594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eb1e5e0-b982-4393-a537-a20647bbf013 req-582dfa70-f817-470a-b2a6-ffa6ee9fdc37 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:19.666471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8eb1e5e0-b982-4393-a537-a20647bbf013 req-582dfa70-f817-470a-b2a6-ffa6ee9fdc37 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 948 time: 0.4797342 May 12 15:09:19.806121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3b35fb9b-c687-47e4-a4f1-cebbb82794bd admin admin] Deleting port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:19.806121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b35fb9b-c687-47e4-a4f1-cebbb82794bd admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:19.878498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b4e74807-b360-4c0d-894d-809b429ca3a6 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:09:19.901017 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fcf1596a-b74e-4476-9c67-2c4c39ef1fbd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:19.928878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:09:20.104022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b4e74807-b360-4c0d-894d-809b429ca3a6,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:09:20.118915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:09:20.137127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:20.138576 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:20.185982 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:20.244258 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8eb1e5e0-b982-4393-a537-a20647bbf013 req-889041e9-4175-4231-ba0e-8cbf91b0c9ee tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5861382 May 12 15:09:20.247547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h1-841483-1, got binding levels [] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:20.296312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 on host n-h1-841483-1 for vnic_type normal with profile {"migrating_to": "n-h2-841483-1"} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:09:20.297658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:09:20.297658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:20.304532 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Port b4e74807-b360-4c0d-894d-809b429ca3a6 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:09:20.305100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Attempting to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 on network 95dd1383-efe7-494d-a1ab-57e293da83a3 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:20.491374 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 9, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:09:20.491774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Checking segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:20.492386 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Bound using segment: {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:09:20.493417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Bound port: b4e74807-b360-4c0d-894d-809b429ca3a6, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2e732768-539c-4181-b234-fc2be7d671bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '95dd1383-efe7-494d-a1ab-57e293da83a3'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:09:20.495307 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:20.571028 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:20.621043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78794a9d-8cd2-4e66-bf21-7a6a27734e60 req-51544465-04ae-4a11-b9d0-4bfebd1a6179 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:20.623100 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78794a9d-8cd2-4e66-bf21-7a6a27734e60 req-51544465-04ae-4a11-b9d0-4bfebd1a6179 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 943 time: 0.8441489 May 12 15:09:20.645039 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:20.690164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1febaac7-3ad7-45f2-b418-f2456ec1ca11 admin admin] Router 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:09:20.715110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:09:20.744318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:20.749766 n-d-841483-1 neutron-server[88153]: WARNING neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Concurrent port binding operations failed on port b4e74807-b360-4c0d-894d-809b429ca3a6 May 12 15:09:20.756000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b4e74807-b360-4c0d-894d-809b429ca3a6,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:20.756000 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:20.775215 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fcf1596a-b74e-4476-9c67-2c4c39ef1fbd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:20.823035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-3b35fb9b-c687-47e4-a4f1-cebbb82794bd admin admin] For port 207b2c9c-f7e0-4d1b-96ea-20213deda9a0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=207b2c9c-f7e0-4d1b-96ea-20213deda9a0,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:20.823409 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b35fb9b-c687-47e4-a4f1-cebbb82794bd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:20.840335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:20.843333 n-d-841483-1 neutron-server[88153]: INFO neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Attempt 2 to bind port b4e74807-b360-4c0d-894d-809b429ca3a6 May 12 15:09:20.843923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b4e74807-b360-4c0d-894d-809b429ca3a6 has no active binding in host n-h2-841483-1 {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:142}} May 12 15:09:20.854004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Pushing event updated for resources: {'Port': ['ID=b4e74807-b360-4c0d-894d-809b429ca3a6,revision_number=8']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:20.937225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:20.937872 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:20.940420 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8554cf33-1763-4dc9-acd9-2edd142a1845 service neutron] 10.222.0.76 "PUT /v2.0/ports/b4e74807-b360-4c0d-894d-809b429ca3a6 HTTP/1.1" status: 200 len: 1121 time: 3.8240862 May 12 15:09:20.942374 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcf1596a-b74e-4476-9c67-2c4c39ef1fbd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=90c1a347-6b85-4241-b499-0c3eab27e7b1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:20.946529 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fcf1596a-b74e-4476-9c67-2c4c39ef1fbd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:20.993951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '90ffd47c-e072-4c18-8d59-4ad501ade5d8', 'tag': 'b4e74807-b360-4c0d-894d-809b429ca3a6'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:09:20.998921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['b4e74807-b360-4c0d-894d-809b429ca3a6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:09:21.016397 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-886af9ae-69fd-423f-9a06-b2adcedf0374 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1293962 May 12 15:09:21.016397 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78794a9d-8cd2-4e66-bf21-7a6a27734e60 req-52abf6c9-f5bf-4d10-9ba6-45a43495e57d tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3494363 May 12 15:09:21.041315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fcf1596a-b74e-4476-9c67-2c4c39ef1fbd admin admin] 10.222.0.82 "DELETE /v2.0/subnets/90c1a347-6b85-4241-b499-0c3eab27e7b1 HTTP/1.1" status: 204 len: 168 time: 1.9299319 May 12 15:09:21.041315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49300) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:21.052659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['b4e74807-b360-4c0d-894d-809b429ca3a6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:09:21.125080 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2af91320-c5e8-4064-9068-7b78981ac624'] response: {'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'code': 200} May 12 15:09:21.350010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1febaac7-3ad7-45f2-b418-f2456ec1ca11 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:09:21.356537 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-000658c2-0101-4ae4-8de5-8a37cbdd7b6d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:21.375323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5edfeb5-93de-4664-a67d-1e99ac761674 None None] Sync routers for ids ['9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:09:21.401739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-768c5f39-04fe-46bf-a169-c26db05269c9 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:21.408393 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-768c5f39-04fe-46bf-a169-c26db05269c9 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4016516 May 12 15:09:21.417570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3b35fb9b-c687-47e4-a4f1-cebbb82794bd admin admin] Calling delete_port for 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:21.437163 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5edfeb5-93de-4664-a67d-1e99ac761674 None None] Routers {'9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:21.441155 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b5edfeb5-93de-4664-a67d-1e99ac761674 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:21.450107 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1febaac7-3ad7-45f2-b418-f2456ec1ca11 admin admin] 10.222.0.82 "PUT /v2.0/routers/9e25e09f-2315-4fe8-9d09-cfcdf109bcf4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.6344283 May 12 15:09:21.462195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49308) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:21.493530 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-9261c9e3-c684-420d-bff9-ae0323b5859d tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/quotas/fa4eac6b8c464c45aa3c550e59a0d34b HTTP/1.1" status: 200 len: 375 time: 0.0840976 May 12 15:09:21.541062 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1a55eb8f-6f8f-46df-b7ff-7046b432514d'] response: {'name': 'network-changed', 'server_uuid': '90ffd47c-e072-4c18-8d59-4ad501ade5d8', 'tag': 'b4e74807-b360-4c0d-894d-809b429ca3a6', 'status': 'completed', 'code': 200} May 12 15:09:21.624863 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-9577a1a5-ed3c-4b48-8cef-2fbc8c04ca72 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1302333 May 12 15:09:21.740724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b5edfeb5-93de-4664-a67d-1e99ac761674 None None] Set router 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:21.762997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a879b2d4-956c-48e0-ac65-156856d14762 req-de97e04f-9598-4079-a1c5-a49b443ebf9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:21.764181 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a879b2d4-956c-48e0-ac65-156856d14762 req-de97e04f-9598-4079-a1c5-a49b443ebf9e service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 1100 time: 0.4106262 May 12 15:09:21.785280 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-000658c2-0101-4ae4-8de5-8a37cbdd7b6d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:21.887636 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:21.952509 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-000658c2-0101-4ae4-8de5-8a37cbdd7b6d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7ff67598-426f-471a-8d47-b5df5dee599f']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:22.041234 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:22.059710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7933d01-b8cf-4c8d-b782-a7f7762a9f7e req-37644102-d21c-4edc-af62-3c7e5a78aab9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:22.061430 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7933d01-b8cf-4c8d-b782-a7f7762a9f7e req-37644102-d21c-4edc-af62-3c7e5a78aab9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 1124 time: 0.4765935 May 12 15:09:22.110280 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a879b2d4-956c-48e0-ac65-156856d14762 req-8e943d42-1434-4df0-9656-220f2e5703fa service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3213608 May 12 15:09:22.163566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b5edfeb5-93de-4664-a67d-1e99ac761674 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'name': 'tempest-AttachSCSIVolumeTestJSON-451196841-router', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229'}], 'enable_snat': True}, 'gw_port_id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:06:07Z', 'updated_at': '2022-05-12T15:09:18Z', 'revision_number': 5, 'project_id': '3a478f0d02094addabf4cc31816a81f5', 'gw_port': {'id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ff:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:09Z', 'updated_at': '2022-05-12T15:06:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:22.174475 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5edfeb5-93de-4664-a67d-1e99ac761674 None None] Checking router: 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:09:22.198177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5edfeb5-93de-4664-a67d-1e99ac761674 None None] Routers {'9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:22.198985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b5edfeb5-93de-4664-a67d-1e99ac761674 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:22.257962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-000658c2-0101-4ae4-8de5-8a37cbdd7b6d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '45df704c-0bf6-42d3-be24-743711e80f04') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:22.258250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-000658c2-0101-4ae4-8de5-8a37cbdd7b6d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '45df704c-0bf6-42d3-be24-743711e80f04') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:22.289862 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:22.301680 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d7545db-6a66-410f-bad5-036061a7dba7 req-b3ae0907-940c-4029-8d83-d44767cdd764 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 210 time: 0.2624378 May 12 15:09:22.304455 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-000658c2-0101-4ae4-8de5-8a37cbdd7b6d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:22.388809 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-674c6272-fe05-43e7-bca3-f21d82254734 req-eac97042-5493-4f15-b975-57071a49e3ab tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:22.390377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-674c6272-fe05-43e7-bca3-f21d82254734 req-eac97042-5493-4f15-b975-57071a49e3ab tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 0.7468894 May 12 15:09:22.398204 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-000658c2-0101-4ae4-8de5-8a37cbdd7b6d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:22.426827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-000658c2-0101-4ae4-8de5-8a37cbdd7b6d admin admin] Releasing vlan 590 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:09:22.427599 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-000658c2-0101-4ae4-8de5-8a37cbdd7b6d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: timer() May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:09:22.445129 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:09:22.540260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b5edfeb5-93de-4664-a67d-1e99ac761674 None None] Set router 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:22.666725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7933d01-b8cf-4c8d-b782-a7f7762a9f7e req-2bee8764-13d7-4bea-969e-bc095bf52e78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:22.667978 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7933d01-b8cf-4c8d-b782-a7f7762a9f7e req-2bee8764-13d7-4bea-969e-bc095bf52e78 service neutron] 10.222.0.84 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 0.5839083 May 12 15:09:22.746111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-674c6272-fe05-43e7-bca3-f21d82254734 req-2fa84609-7296-49e6-93ca-3bec4e7c78b9 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3259590 May 12 15:09:22.761303 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-000658c2-0101-4ae4-8de5-8a37cbdd7b6d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:22.763636 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:22.784006 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7933d01-b8cf-4c8d-b782-a7f7762a9f7e req-29d7b36c-4b72-4d0d-a55d-c513f2bb09cd service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b4e74807-b360-4c0d-894d-809b429ca3a6 HTTP/1.1" status: 200 len: 217 time: 0.0965157 May 12 15:09:22.787005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] Deleting port b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:22.787406 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:22.788602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Allocated IP 172.25.8.211 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/38259385-54e1-4178-becc-b82fe7cde7a2) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:09:22.814628 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b35fb9b-c687-47e4-a4f1-cebbb82794bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:22.860007 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-000658c2-0101-4ae4-8de5-8a37cbdd7b6d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:22.913941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-000658c2-0101-4ae4-8de5-8a37cbdd7b6d admin admin] Pushing event deleted for resources: {'Network': ['ID=7ff67598-426f-471a-8d47-b5df5dee599f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:22.999998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b5edfeb5-93de-4664-a67d-1e99ac761674 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'name': 'tempest-AttachSCSIVolumeTestJSON-451196841-router', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229'}], 'enable_snat': True}, 'gw_port_id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:06:07Z', 'updated_at': '2022-05-12T15:09:18Z', 'revision_number': 5, 'project_id': '3a478f0d02094addabf4cc31816a81f5', 'gw_port': {'id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ff:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:09Z', 'updated_at': '2022-05-12T15:06:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:23.010555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b35fb9b-c687-47e4-a4f1-cebbb82794bd admin admin] Pushing event deleted for resources: {'Port': ['ID=207b2c9c-f7e0-4d1b-96ea-20213deda9a0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:23.011370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5edfeb5-93de-4664-a67d-1e99ac761674 None None] The sync data for ids ['9e25e09f-2315-4fe8-9d09-cfcdf109bcf4'] in n-d-841483-1 is: [{'id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'name': 'tempest-AttachSCSIVolumeTestJSON-451196841-router', 'tenant_id': '3a478f0d02094addabf4cc31816a81f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229'}], 'enable_snat': True}, 'gw_port_id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:06:07Z', 'updated_at': '2022-05-12T15:09:18Z', 'revision_number': 5, 'project_id': '3a478f0d02094addabf4cc31816a81f5', 'gw_port': {'id': 'b0f516cc-4eeb-43e7-8139-6cc3d7974bc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ff:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e25e09f-2315-4fe8-9d09-cfcdf109bcf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:06:09Z', 'updated_at': '2022-05-12T15:06:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:09:23.050453 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-000658c2-0101-4ae4-8de5-8a37cbdd7b6d admin admin] 10.222.0.82 "DELETE /v2.0/networks/7ff67598-426f-471a-8d47-b5df5dee599f HTTP/1.1" status: 204 len: 168 time: 2.0111706 May 12 15:09:23.125648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a88e3b7-9e00-4641-a141-b68a57495f75 req-be2ad4f8-00a3-45f0-a8be-ec635ceede48 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:23.139664 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a88e3b7-9e00-4641-a141-b68a57495f75 req-be2ad4f8-00a3-45f0-a8be-ec635ceede48 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 943 time: 0.6758263 May 12 15:09:23.206040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7933d01-b8cf-4c8d-b782-a7f7762a9f7e req-c5e05f0e-763d-4109-8831-08c7b198d791 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:23.213251 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7933d01-b8cf-4c8d-b782-a7f7762a9f7e req-c5e05f0e-763d-4109-8831-08c7b198d791 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.3944244 May 12 15:09:23.412989 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a88e3b7-9e00-4641-a141-b68a57495f75 req-83e00f92-c37a-46e6-8903-0b81c9351dc6 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2720985 May 12 15:09:23.423474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49358) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:23.527244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] For port b0f516cc-4eeb-43e7-8139-6cc3d7974bc6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b0f516cc-4eeb-43e7-8139-6cc3d7974bc6,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:23.527618 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:23.544196 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:23.632338 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5b465bd-b61e-4428-a52b-b2fb6eafc939 req-0fa7cb6d-c036-49fe-b056-5faafede72fb tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 210 time: 0.0842633 May 12 15:09:23.665944 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9d5febbc-173a-47a4-a5c8-bb54c1437270 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1765470896784bdd91025d3b6fa9cabd&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2319088 May 12 15:09:23.667892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49364) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:23.746768 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:23.774910 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] Calling delete_port for b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:23.785139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49370) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:23.808724 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dbc6a3b7-8c56-44f4-bb2d-65955e188310 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:23.851855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:09:23.857649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:23.867520 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dbc6a3b7-8c56-44f4-bb2d-65955e188310 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:23.874820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:09:23.929892 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7933d01-b8cf-4c8d-b782-a7f7762a9f7e req-a8e9d781-9523-46b7-bc50-6579892dc162 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.6197805 May 12 15:09:23.958492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Pushing event updated for resources: {'Port': ['ID=38259385-54e1-4178-becc-b82fe7cde7a2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:24.059956 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e57556c4-21f2-4dcb-a0fc-f1ce37f3942e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:24.144231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-a8762993-1ec7-4a95-b7e6-4e29a8f57645 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1174984 May 12 15:09:24.160875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e57556c4-21f2-4dcb-a0fc-f1ce37f3942e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:24.202125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e57556c4-21f2-4dcb-a0fc-f1ce37f3942e admin admin] Usage tracker for resource:security_group_rule and tenant:fc5268e4c5e2491b8e342b4b7dcf5aae is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:24.238261 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b35fb9b-c687-47e4-a4f1-cebbb82794bd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:24.252686 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7933d01-b8cf-4c8d-b782-a7f7762a9f7e req-709f3ded-0ad3-4ef3-849f-a074c585e8c4 service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3039887 May 12 15:09:24.309543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e57556c4-21f2-4dcb-a0fc-f1ce37f3942e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:24.398674 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:24.436654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:09:24.437010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 31ad01d5-c0ab-4fcd-a0c2-4cc18a9e4b30 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:09:24.444416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e57556c4-21f2-4dcb-a0fc-f1ce37f3942e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:24.500352 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dbc6a3b7-8c56-44f4-bb2d-65955e188310 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:24.542249 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b43e35-82dc-4d7b-b7e4-b9caccfbbeeb req-781311fe-a535-4bc5-9dbe-98f20d3a780d tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:24.545365 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70b43e35-82dc-4d7b-b7e4-b9caccfbbeeb req-781311fe-a535-4bc5-9dbe-98f20d3a780d tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 0.6802847 May 12 15:09:24.588726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbc6a3b7-8c56-44f4-bb2d-65955e188310 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=82474291-eaf8-434c-a9c0-6a0e1084298d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:24.711311 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dbc6a3b7-8c56-44f4-bb2d-65955e188310 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:24.712429 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dbc6a3b7-8c56-44f4-bb2d-65955e188310 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/82474291-eaf8-434c-a9c0-6a0e1084298d HTTP/1.1" status: 204 len: 168 time: 1.0429256 May 12 15:09:24.772683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-15d7b1b9-f9a8-43fd-88a5-5a5fbf36e959 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:24.774426 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-15d7b1b9-f9a8-43fd-88a5-5a5fbf36e959 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.6182189 May 12 15:09:24.786459 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70b43e35-82dc-4d7b-b7e4-b9caccfbbeeb req-417038e6-6e39-48a6-a0cf-c7a329d99aaf tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2262988 May 12 15:09:24.794402 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Request body: {'port': {'device_id': '068ccb5e-6f3b-4d6f-af59-35e722e2b8a1', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': 'fa4eac6b8c464c45aa3c550e59a0d34b'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:24.939830 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:24.950550 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-7ef0483d-8728-4cf5-9837-e564e750e5e0 service neutron] 10.222.0.84 "GET /v2.0/ports/b4e74807-b360-4c0d-894d-809b429ca3a6/bindings/n-h2-841483-1 HTTP/1.1" status: 200 len: 384 time: 0.2605829 May 12 15:09:25.042464 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7933d01-b8cf-4c8d-b782-a7f7762a9f7e req-9e16e657-2dcb-48a8-91f8-eac5b5ff724a service neutron] 10.222.0.84 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7020085 May 12 15:09:25.054739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] Pushing event deleted for resources: {'Port': ['ID=b0f516cc-4eeb-43e7-8139-6cc3d7974bc6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:25.233923 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9e154b7-8e5a-412d-9be0-165fd8bc4ada req-81b55947-91ed-437f-ae3b-bf8f86b245c5 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 210 time: 0.1927848 May 12 15:09:25.317375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1434f1a5-cb44-4845-89e2-2b619821ee5b req-f2aba88c-21e9-4c7e-b70d-605ed8a52637 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:25.325546 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1434f1a5-cb44-4845-89e2-2b619821ee5b req-f2aba88c-21e9-4c7e-b70d-605ed8a52637 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 943 time: 0.7098627 May 12 15:09:25.398021 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:25.465486 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e57556c4-21f2-4dcb-a0fc-f1ce37f3942e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:25.530542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e57556c4-21f2-4dcb-a0fc-f1ce37f3942e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:25.601674 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:25.647597 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1434f1a5-cb44-4845-89e2-2b619821ee5b req-3c28ecb5-5861-4ef6-a496-03dc4317c2e1 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3200736 May 12 15:09:25.648968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Usage tracker for resource:port and tenant:fa4eac6b8c464c45aa3c550e59a0d34b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:25.670294 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:25.678626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:25.683123 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e57556c4-21f2-4dcb-a0fc-f1ce37f3942e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=fc5268e4c5e2491b8e342b4b7dcf5aae&name=default HTTP/1.1" status: 200 len: 2979 time: 1.8952944 May 12 15:09:25.684688 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:25.689551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49402) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:25.692691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e57556c4-21f2-4dcb-a0fc-f1ce37f3942e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=387f838a-ca3a-4a46-b567-7232749f43b4,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:25.697043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:25.701623 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:25.725125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3b35fb9b-c687-47e4-a4f1-cebbb82794bd admin admin] Router 940e3b0e-8287-409c-890e-28addf1cf0b8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:09:25.770168 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:25.770168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:09:25.896246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49406) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:25.907194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Made reservation on behalf of fa4eac6b8c464c45aa3c550e59a0d34b for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:09:25.913945 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:25.918233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-537181c2-214c-495b-96db-d4bddb43e590 service neutron] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b4e74807-b360-4c0d-894d-809b429ca3a6,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:25.959394 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:25.998746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e18e2207-d63a-44ba-9c36-45ea2c83899b req-62a07aa4-a8e0-4ef4-8d24-e7a4b954c82f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:26.001876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e18e2207-d63a-44ba-9c36-45ea2c83899b req-62a07aa4-a8e0-4ef4-8d24-e7a4b954c82f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 0.5375786 May 12 15:09:26.002004 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:26.002782 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d4e8ea2e-2144-4380-8e47-c0ef250e146d admin admin] 10.222.0.82 "DELETE /v2.0/routers/9e25e09f-2315-4fe8-9d09-cfcdf109bcf4 HTTP/1.1" status: 204 len: 168 time: 4.5396008 May 12 15:09:26.020736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49412) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:26.044350 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8dbacf42-d7ed-4037-bbea-fe7a49802315 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:26.067008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:26.098503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Usage tracker for resource:security_group_rule and tenant:fa4eac6b8c464c45aa3c550e59a0d34b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:26.099627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-537181c2-214c-495b-96db-d4bddb43e590 service neutron] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:09:26.107339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:26.118914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:26.132882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Request body: {'network': {'name': 'tempest-ServersTestJSON-1452749819-network', 'tenant_id': '982e4927ecc048a1a769000f4c067d06'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:26.151342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:26.176502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Usage tracker for resource:network and tenant:982e4927ecc048a1a769000f4c067d06 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:26.255868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:26.291958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e18e2207-d63a-44ba-9c36-45ea2c83899b req-6a9734d9-8c5b-4c2e-9c6a-cbeca4042f83 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2236164 May 12 15:09:26.356480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:26.398642 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8dbacf42-d7ed-4037-bbea-fe7a49802315 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:26.428113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:26.488326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-537181c2-214c-495b-96db-d4bddb43e590 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b4e74807-b360-4c0d-894d-809b429ca3a6 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:09:26.496144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:09:26.497380 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b0f516cc-4eeb-43e7-8139-6cc3d7974bc6 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:09:26.506263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-537181c2-214c-495b-96db-d4bddb43e590 service neutron] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b4e74807-b360-4c0d-894d-809b429ca3a6,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:26.514488 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4993976d-5a14-45cb-9503-0ac240edbd54 req-f6066647-fcc5-4516-9e32-13ddbd97082c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 210 time: 0.0851562 May 12 15:09:26.522141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Made reservation on behalf of 982e4927ecc048a1a769000f4c067d06 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:09:26.524583 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:26.538887 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-537181c2-214c-495b-96db-d4bddb43e590 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:26.553405 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:26.556063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3b35fb9b-c687-47e4-a4f1-cebbb82794bd admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:09:26.565957 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:26.567948 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c75e603a-46e6-47ca-84bf-466156bbb14d None None] Sync routers for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:09:26.578321 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3b35fb9b-c687-47e4-a4f1-cebbb82794bd admin admin] 10.222.0.82 "PUT /v2.0/routers/940e3b0e-8287-409c-890e-28addf1cf0b8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 10.0207033 May 12 15:09:26.585216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-ec89b303-e9e6-488b-9bb1-0565a0b308b2 admin admin] Deleting subnet ab2c50b2-e633-495f-96cd-e23b8e03d46d {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:09:26.585494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49424) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:26.587082 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c75e603a-46e6-47ca-84bf-466156bbb14d None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:26.587603 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c75e603a-46e6-47ca-84bf-466156bbb14d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:26.608618 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec89b303-e9e6-488b-9bb1-0565a0b308b2 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:26.695472 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec89b303-e9e6-488b-9bb1-0565a0b308b2 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:26.754242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:26.776098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Usage tracker for resource:security_group_rule and tenant:982e4927ecc048a1a769000f4c067d06 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:26.795794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:26.805150 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec89b303-e9e6-488b-9bb1-0565a0b308b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:26.807842 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-c75e603a-46e6-47ca-84bf-466156bbb14d None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:26.818675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:26.821639 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:26.898708 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:26.990322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device b4e74807-b360-4c0d-894d-809b429ca3a6 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:27.028489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-537181c2-214c-495b-96db-d4bddb43e590 service neutron] Transition to ACTIVE for port object b4e74807-b360-4c0d-894d-809b429ca3a6 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:09:27.107607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device b4e74807-b360-4c0d-894d-809b429ca3a6 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:09:27.114999 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8dbacf42-d7ed-4037-bbea-fe7a49802315 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:27.120679 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec89b303-e9e6-488b-9bb1-0565a0b308b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:27.162904 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-537181c2-214c-495b-96db-d4bddb43e590 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:27.170532 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c75e603a-46e6-47ca-84bf-466156bbb14d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:09:22Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:27.175936 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c75e603a-46e6-47ca-84bf-466156bbb14d None None] Checking router: 940e3b0e-8287-409c-890e-28addf1cf0b8 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:09:27.184270 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c75e603a-46e6-47ca-84bf-466156bbb14d None None] Routers {'940e3b0e-8287-409c-890e-28addf1cf0b8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:27.184866 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c75e603a-46e6-47ca-84bf-466156bbb14d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['940e3b0e-8287-409c-890e-28addf1cf0b8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:27.230297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7ec9062-cf8c-441c-86c3-07d0cfa9cfef None None] Network e7453c32-56d4-4bed-949a-c05a259218b1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:09:27.230479 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec89b303-e9e6-488b-9bb1-0565a0b308b2 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:27.233237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dbacf42-d7ed-4037-bbea-fe7a49802315 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=387f838a-ca3a-4a46-b567-7232749f43b4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:27.343561 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ec89b303-e9e6-488b-9bb1-0565a0b308b2 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/ab2c50b2-e633-495f-96cd-e23b8e03d46d HTTP/1.1" status: 204 len: 168 time: 1.3172746 May 12 15:09:27.355816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49436) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:27.385942 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8dbacf42-d7ed-4037-bbea-fe7a49802315 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:27.404440 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8dbacf42-d7ed-4037-bbea-fe7a49802315 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/387f838a-ca3a-4a46-b567-7232749f43b4 HTTP/1.1" status: 204 len: 168 time: 1.6968107 May 12 15:09:27.410139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec89b303-e9e6-488b-9bb1-0565a0b308b2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ab2c50b2-e633-495f-96cd-e23b8e03d46d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:27.448389 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-537181c2-214c-495b-96db-d4bddb43e590 service neutron] No DVR routers for this DVR port b4e74807-b360-4c0d-894d-809b429ca3a6 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:09:27.467714 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-c75e603a-46e6-47ca-84bf-466156bbb14d None None] Set router 940e3b0e-8287-409c-890e-28addf1cf0b8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:27.468968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event updated for resources: {'SecurityGroup': ['ID=085c0de6-5055-4947-92b0-5e4da04eea48,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:27.603892 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:27.613743 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-537181c2-214c-495b-96db-d4bddb43e590 service neutron] 10.222.0.84 "PUT /v2.0/ports/b4e74807-b360-4c0d-894d-809b429ca3a6/bindings/n-h2-841483-1/activate HTTP/1.1" status: 200 len: 369 time: 2.6297040 May 12 15:09:27.621871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] DHCP port deletion for e7453c32-56d4-4bed-949a-c05a259218b1 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:09:27.623565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-537181c2-214c-495b-96db-d4bddb43e590 service neutron] Pushing event updated for resources: {'Port': ['ID=b4e74807-b360-4c0d-894d-809b429ca3a6,revision_number=10']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:27.635981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Deleting port f9158451-2a06-46ea-b709-f61479af74d9 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:27.636432 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:27.637671 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-6b059c38-a936-46ad-b36c-388c80ee5fd8 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.6054893 May 12 15:09:27.871879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d84efc2-43a7-4dd5-a5ee-e963f63da25b req-de5f0aab-a646-4cfe-8a97-304100853400 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:27.881716 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d84efc2-43a7-4dd5-a5ee-e963f63da25b req-de5f0aab-a646-4cfe-8a97-304100853400 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 944 time: 0.9979143 May 12 15:09:27.989928 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d84efc2-43a7-4dd5-a5ee-e963f63da25b req-1002830a-ff00-4a34-848f-e45f63e27103 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1069283 May 12 15:09:28.005047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49458) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:28.010337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] For port f9158451-2a06-46ea-b709-f61479af74d9, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f9158451-2a06-46ea-b709-f61479af74d9,segment=NetworkSegment(6c869e32-bb71-4864-ab9a-8535af830a80),segment_id=6c869e32-bb71-4864-ab9a-8535af830a80)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:28.011318 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:28.020685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Allocated IP 192.168.233.27 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:09:28.028688 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-653d9b0c-f3bb-4535-8198-023f30290f4d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:28.052032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-653d9b0c-f3bb-4535-8198-023f30290f4d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:28.056824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-653d9b0c-f3bb-4535-8198-023f30290f4d admin admin] Usage tracker for resource:security_group_rule and tenant:e6f69d98469c410f963f6a1b09845f8d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:28.060538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-653d9b0c-f3bb-4535-8198-023f30290f4d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:28.070732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-653d9b0c-f3bb-4535-8198-023f30290f4d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:28.129247 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c75e603a-46e6-47ca-84bf-466156bbb14d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:09:22Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:28.147520 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c75e603a-46e6-47ca-84bf-466156bbb14d None None] The sync data for ids ['940e3b0e-8287-409c-890e-28addf1cf0b8'] in n-d-841483-1 is: [{'id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1022840416-router', 'tenant_id': 'bad2264067c248e9803d4b1eeb73116d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122'}], 'enable_snat': True}, 'gw_port_id': 'fac6a011-85dc-423e-a855-446515118749', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:07:14Z', 'updated_at': '2022-05-12T15:09:22Z', 'revision_number': 5, 'project_id': 'bad2264067c248e9803d4b1eeb73116d', 'gw_port': {'id': 'fac6a011-85dc-423e-a855-446515118749', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940e3b0e-8287-409c-890e-28addf1cf0b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:07:15Z', 'updated_at': '2022-05-12T15:07:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:09:28.227131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Calling delete_port for f9158451-2a06-46ea-b709-f61479af74d9 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:28.249239 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-653d9b0c-f3bb-4535-8198-023f30290f4d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:28.260146 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-653d9b0c-f3bb-4535-8198-023f30290f4d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:28.397482 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:28.398038 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-653d9b0c-f3bb-4535-8198-023f30290f4d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e6f69d98469c410f963f6a1b09845f8d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3917572 May 12 15:09:28.399942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-653d9b0c-f3bb-4535-8198-023f30290f4d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3888269a-953a-42f7-a0c2-5a491d2405f5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:28.402636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49468) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:28.463108 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Pushing event deleted for resources: {'Port': ['ID=f9158451-2a06-46ea-b709-f61479af74d9,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:28.473837 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] No DVR routers for this DVR port f9158451-2a06-46ea-b709-f61479af74d9 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:09:28.476094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:28.476649 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:28.477125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:28.477784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:28.478776 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:28.478776 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:28.478973 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:28.479232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:28.479555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:28.479870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:28.480332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:28.480547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe3fe2d0-d30d-4e2c-b7cb-89a337fbd70d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:28.496781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9ee7d478-9c94-4f1d-95f4-48b573da91fb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:28.529472 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-914e11e5-e0b5-47ed-a46b-f74d9eb4e4e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:28.537283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9ee7d478-9c94-4f1d-95f4-48b573da91fb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:28.631622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9ee7d478-9c94-4f1d-95f4-48b573da91fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:28.651172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:28.680878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ee7d478-9c94-4f1d-95f4-48b573da91fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3888269a-953a-42f7-a0c2-5a491d2405f5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:28.698668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-36dbc557-dd72-4bb6-b94e-bcdfb0393b00 req-ab33da15-5359-42df-93e7-ea2ebea7b906 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 210 time: 0.1572900 May 12 15:09:28.709597 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9ee7d478-9c94-4f1d-95f4-48b573da91fb admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:28.709597 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9ee7d478-9c94-4f1d-95f4-48b573da91fb admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3888269a-953a-42f7-a0c2-5a491d2405f5 HTTP/1.1" status: 204 len: 168 time: 0.2925053 May 12 15:09:28.728533 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:09:28.728759 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 207b2c9c-f7e0-4d1b-96ea-20213deda9a0 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:09:28.729430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f9158451-2a06-46ea-b709-f61479af74d9 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:28.786602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-0aab4273-2c55-40e6-a605-94f627ad3d40 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:28.786602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-0aab4273-2c55-40e6-a605-94f627ad3d40 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8&tenant_id=1b3825228b0e4c42a381540b66ea23d6&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1095 time: 1.0492599 May 12 15:09:28.790996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b61374-dc5f-4cb0-a28c-c8137cf477d6 req-653b6c4a-588c-4a03-a2b2-b0ad81428ab5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:28.796020 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31b61374-dc5f-4cb0-a28c-c8137cf477d6 req-653b6c4a-588c-4a03-a2b2-b0ad81428ab5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 1.5982153 May 12 15:09:28.833617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: f9158451-2a06-46ea-b709-f61479af74d9 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:09:28.838620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f9158451-2a06-46ea-b709-f61479af74d9 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:09:28.916470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Router 405f5f48-a239-4c20-a0c9-dd825327abd0 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:09:28.957351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-914e11e5-e0b5-47ed-a46b-f74d9eb4e4e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:28.971942 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:29.004132 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:29.131626 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31b61374-dc5f-4cb0-a28c-c8137cf477d6 req-4e1db7fa-5428-4b30-a122-a137c2ee4f91 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3317685 May 12 15:09:29.162932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-914e11e5-e0b5-47ed-a46b-f74d9eb4e4e3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e7453c32-56d4-4bed-949a-c05a259218b1']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:29.219051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 563} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:09:29.234138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-914e11e5-e0b5-47ed-a46b-f74d9eb4e4e3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6c869e32-bb71-4864-ab9a-8535af830a80') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:29.234138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-914e11e5-e0b5-47ed-a46b-f74d9eb4e4e3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6c869e32-bb71-4864-ab9a-8535af830a80') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:29.253296 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:29.264762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11054946-0eea-4d43-abcb-4652027aced8,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:29.278466 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:29.287220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] Deleting port fac6a011-85dc-423e-a855-446515118749 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:29.287220 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:29.311592 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-914e11e5-e0b5-47ed-a46b-f74d9eb4e4e3 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:29.508429 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:29.508564 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Added segment 5557610c-85a4-4c18-8793-b6867e2cb17c of type vlan for network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 May 12 15:09:29.650439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Transition to ACTIVE for port object f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:09:29.664614 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-914e11e5-e0b5-47ed-a46b-f74d9eb4e4e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:29.695078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-914e11e5-e0b5-47ed-a46b-f74d9eb4e4e3 admin admin] Releasing vlan 581 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:09:29.695078 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-914e11e5-e0b5-47ed-a46b-f74d9eb4e4e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: timer() May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:09:29.713550 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:09:29.757413 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:29.774065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-70d37b42-5aa0-4311-aa29-2338aa93d32b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:29.775778 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-70d37b42-5aa0-4311-aa29-2338aa93d32b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 1100 time: 0.1262257 May 12 15:09:29.881697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:09:29.899157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49d37501-087a-440a-a320-64b598b36861 None None] Sync routers for ids ['405f5f48-a239-4c20-a0c9-dd825327abd0'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:09:29.913414 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49d37501-087a-440a-a320-64b598b36861 None None] Routers {'405f5f48-a239-4c20-a0c9-dd825327abd0'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:29.914352 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-49d37501-087a-440a-a320-64b598b36861 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['405f5f48-a239-4c20-a0c9-dd825327abd0'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:29.990852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-c508893d-03be-4ea8-af5e-777c5a484a5c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:29.991830 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-c508893d-03be-4ea8-af5e-777c5a484a5c service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.2086949 May 12 15:09:30.020793 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-914e11e5-e0b5-47ed-a46b-f74d9eb4e4e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:30.037466 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19445ef7-88ae-489e-bb81-03bf09d985d9 req-7d79bb07-f92b-47f3-949d-e275a629f5f1 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 210 time: 0.1073148 May 12 15:09:30.091941 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-914e11e5-e0b5-47ed-a46b-f74d9eb4e4e3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:30.114970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-9cca1654-d623-43eb-ae08-68b80e946209 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.52&port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 200 len: 217 time: 0.1083004 May 12 15:09:30.138317 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:30.146718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-914e11e5-e0b5-47ed-a46b-f74d9eb4e4e3 admin admin] Pushing event deleted for resources: {'Network': ['ID=e7453c32-56d4-4bed-949a-c05a259218b1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:30.215635 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:30.216802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:30.217542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:30.250331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-8d80a178-b720-4391-9b4f-233bbfe9cb9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:30.252399 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-8d80a178-b720-4391-9b4f-233bbfe9cb9f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1311049 May 12 15:09:30.273112 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-49d37501-087a-440a-a320-64b598b36861 None None] Set router 405f5f48-a239-4c20-a0c9-dd825327abd0 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:30.383275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] Pushing event updated for resources: {'Network': ['ID=e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:30.402339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f5cf3d6-dedc-4a94-ad74-23bf7591747e req-0c76ea82-6a1c-4970-a244-ab8b308ae847 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:30.410124 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4f5cf3d6-dedc-4a94-ad74-23bf7591747e req-0c76ea82-6a1c-4970-a244-ab8b308ae847 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 944 time: 1.0902603 May 12 15:09:30.414024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-266169d9-77d1-4679-bb73-bab560a56704 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:30.414682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-266169d9-77d1-4679-bb73-bab560a56704 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8&tenant_id=1b3825228b0e4c42a381540b66ea23d6 HTTP/1.1" status: 200 len: 1095 time: 1.6161857 May 12 15:09:30.416101 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:09:30.418883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] For port fac6a011-85dc-423e-a855-446515118749, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fac6a011-85dc-423e-a855-446515118749,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:30.419235 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:30.451142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-4009a39d-09e7-48a6-a374-b0917376c26c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:30.455319 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-4009a39d-09e7-48a6-a374-b0917376c26c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1943967 May 12 15:09:30.482757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:09:30.487674 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-914e11e5-e0b5-47ed-a46b-f74d9eb4e4e3 admin admin] 10.222.0.82 "DELETE /v2.0/networks/e7453c32-56d4-4bed-949a-c05a259218b1 HTTP/1.1" status: 204 len: 168 time: 3.0219114 May 12 15:09:30.488371 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:30.489490 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a0543eee-8a67-4f9e-be55-e71cf45f19a1 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 932 time: 11.4501917 May 12 15:09:30.492765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49514) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:30.536661 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b554f61a-f054-4a63-a1d9-1357068ce0dc admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 879 time: 4.6397705 May 12 15:09:30.541799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:30.550646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49518) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:30.631599 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:09:30.686137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Request body: {'subnet': {'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestJSON-1452749819-subnet', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:30.724924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:09:30.729887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:30.752348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49526) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:30.763336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Usage tracker for resource:subnet and tenant:982e4927ecc048a1a769000f4c067d06 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:30.777183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:30.834071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:30.883842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event updated for resources: {'Port': ['ID=f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:30.914636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] Calling delete_port for fac6a011-85dc-423e-a855-446515118749 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:31.044531 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4f5cf3d6-dedc-4a94-ad74-23bf7591747e req-4636cd40-81f2-443a-bb10-79a5bc2ad673 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6336117 May 12 15:09:31.123739 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-98861d87-f068-4556-b955-d8680ae494f1 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6645033 May 12 15:09:31.139703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Made reservation on behalf of 982e4927ecc048a1a769000f4c067d06 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:09:31.142500 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:31.144915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3a8b566a-9c2c-43e5-aaae-47aa2110763b None None] Provisioning for port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:09:31.166640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3a8b566a-9c2c-43e5-aaae-47aa2110763b None None] Provisioning complete for port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:31.167084 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3a8b566a-9c2c-43e5-aaae-47aa2110763b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:31.196515 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-572857be-b634-496e-a1be-e25e88222ed8 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ff9b9aa97cf84863aedddc5615398c31&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4351141 May 12 15:09:31.209829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:31.210765 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:31.216098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49536) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:31.271210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-49d37501-087a-440a-a320-64b598b36861 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:09:24Z', 'revision_number': 3, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:31.271872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3b35ffc-ec32-49e6-a629-3ef8b26f8892 req-1e7f59d8-b120-4bd8-9b77-4ba891889f2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:31.285619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49d37501-087a-440a-a320-64b598b36861 None None] Checking router: 405f5f48-a239-4c20-a0c9-dd825327abd0 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:09:31.285766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49d37501-087a-440a-a320-64b598b36861 None None] Updating router 405f5f48-a239-4c20-a0c9-dd825327abd0 port 38259385-54e1-4178-becc-b82fe7cde7a2 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:09:31.286594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3b35ffc-ec32-49e6-a629-3ef8b26f8892 req-1e7f59d8-b120-4bd8-9b77-4ba891889f2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 0.8992925 May 12 15:09:31.369297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3a8b566a-9c2c-43e5-aaae-47aa2110763b None None] Port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:09:31.385897 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-49d37501-087a-440a-a320-64b598b36861 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:31.429671 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-ef03cb94-a7fb-4f14-9809-2381ec403e4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 6.6401947 May 12 15:09:31.475265 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3b35ffc-ec32-49e6-a629-3ef8b26f8892 req-f4aa5d0b-10e0-49eb-9289-c7fe5b33eb44 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1875503 May 12 15:09:31.509054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Request body: {'port': {'device_id': '068ccb5e-6f3b-4d6f-af59-35e722e2b8a1', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:31.566903 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-cdc09a80-1f69-4b1c-a3f6-4583277a68f1 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4309206 May 12 15:09:31.904182 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:31.929108 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-49d37501-087a-440a-a320-64b598b36861 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:31.937140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-6503ef22-370b-45d6-93e6-69fd497f5c28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:31.937909 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-6503ef22-370b-45d6-93e6-69fd497f5c28 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1b3825228b0e4c42a381540b66ea23d6&device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 1095 time: 1.4188459 May 12 15:09:31.956558 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-49d37501-087a-440a-a320-64b598b36861 None None] Transition to ACTIVE for port object 38259385-54e1-4178-becc-b82fe7cde7a2 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:09:31.967767 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-49d37501-087a-440a-a320-64b598b36861 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.015190 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-29a22bd8-fc48-413b-b49b-21008caf0cc9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.024332 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.095669 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-49d37501-087a-440a-a320-64b598b36861 None None] Attempting to bind port 38259385-54e1-4178-becc-b82fe7cde7a2 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:09:32.097212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-49d37501-087a-440a-a320-64b598b36861 None None] Attempting to bind port 38259385-54e1-4178-becc-b82fe7cde7a2 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:09:32.097689 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49d37501-087a-440a-a320-64b598b36861 None None] Attempting to bind port 38259385-54e1-4178-becc-b82fe7cde7a2 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:32.108561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49d37501-087a-440a-a320-64b598b36861 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 9, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:09:32.109369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49d37501-087a-440a-a320-64b598b36861 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:32.109908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Checking segment: {'id': '5557610c-85a4-4c18-8793-b6867e2cb17c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:32.110882 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-49d37501-087a-440a-a320-64b598b36861 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.110996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Network hostable DHCP agents. Network: e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:09:32.112017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49d37501-087a-440a-a320-64b598b36861 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:09:32.113490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-49d37501-087a-440a-a320-64b598b36861 None None] Bound port: 38259385-54e1-4178-becc-b82fe7cde7a2, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:09:32.114330 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-49d37501-087a-440a-a320-64b598b36861 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.133405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1636e4f2-4025-4f61-a8dd-65adade9e66c,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:32.154659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] Pushing event deleted for resources: {'Port': ['ID=fac6a011-85dc-423e-a855-446515118749,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:32.162359 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.182221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9c61c13-aac3-4b56-83d7-d0ea8cdeeb5a None None] Pushing event updated for resources: {'Port': ['ID=38259385-54e1-4178-becc-b82fe7cde7a2,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:32.182938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:09:32.203542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:32.215162 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23aa5695-4208-4f55-aca7-cd25fe18d4e4 None None] Network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:09:32.229286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:32.230661 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.286809 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6cfd45c4-76ab-4eb0-8d56-5ef2dc0bc838 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 1.6472633 May 12 15:09:32.291125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49556) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:32.296917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.320424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-49d37501-087a-440a-a320-64b598b36861 None None] For port 38259385-54e1-4178-becc-b82fe7cde7a2, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:09:32.325531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Request body: {'router': {'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:32.345860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:32.347306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-49d37501-087a-440a-a320-64b598b36861 None None] For port 38259385-54e1-4178-becc-b82fe7cde7a2, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=38259385-54e1-4178-becc-b82fe7cde7a2,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:09:32.351504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Usage tracker for resource:router and tenant:982e4927ecc048a1a769000f4c067d06 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:32.362507 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-29a22bd8-fc48-413b-b49b-21008caf0cc9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.362640 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-49d37501-087a-440a-a320-64b598b36861 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.370896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:32.383954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:32.406187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.427315 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.428880 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.479695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9c61c13-aac3-4b56-83d7-d0ea8cdeeb5a None None] Pushing event updated for resources: {'Port': ['ID=38259385-54e1-4178-becc-b82fe7cde7a2,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:32.506532 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.530710 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49d37501-087a-440a-a320-64b598b36861 None None] Routers {'405f5f48-a239-4c20-a0c9-dd825327abd0'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:32.531954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-49d37501-087a-440a-a320-64b598b36861 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['405f5f48-a239-4c20-a0c9-dd825327abd0'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:32.600291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d488353f-0c20-4fa3-a0ff-ce10def67e9d req-98318d3f-450d-4d73-8fcd-aecd83a9c6bd tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:32.601108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d488353f-0c20-4fa3-a0ff-ce10def67e9d req-98318d3f-450d-4d73-8fcd-aecd83a9c6bd tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Synchronizing usage tracker for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:09:32.832306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d488353f-0c20-4fa3-a0ff-ce10def67e9d req-98318d3f-450d-4d73-8fcd-aecd83a9c6bd tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Unset dirty status for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:09:32.832306 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d488353f-0c20-4fa3-a0ff-ce10def67e9d req-98318d3f-450d-4d73-8fcd-aecd83a9c6bd tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 935 time: 1.4926503 May 12 15:09:32.843638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'fixed_ips': [{'subnet_id': '1636e4f2-4025-4f61-a8dd-65adade9e66c'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:09:32.843638 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.909480 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:32.975714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-71a70985-4b9c-4028-862d-ee279876f0ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:32.975714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-71a70985-4b9c-4028-862d-ee279876f0ff service neutron] 10.222.0.76 "GET /v2.0/networks?id=95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 200 len: 921 time: 1.0099213 May 12 15:09:33.046237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-49d37501-087a-440a-a320-64b598b36861 None None] Set router 405f5f48-a239-4c20-a0c9-dd825327abd0 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:33.103053 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:33.145529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Allocated IP 172.20.0.1 (74c45f45-b34b-4876-a35b-8ae714cf4d5f/8de7231c-cca8-4041-a1ba-b8eba5dd5861/317c5178-1ffb-4fde-a98e-8a9fce5e9457) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:09:33.265440 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-5f5f278b-1d50-40c3-8b82-7e38d83b4719 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b4e74807-b360-4c0d-894d-809b429ca3a6 HTTP/1.1" status: 200 len: 217 time: 0.2017207 May 12 15:09:33.279134 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:33.358422 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:33.361411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8c3bcb37-83b6-4711-914e-5983cbb72de5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:33.363664 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-8c3bcb37-83b6-4711-914e-5983cbb72de5 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 200 len: 860 time: 0.0762007 May 12 15:09:33.377076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d331d92-ca3f-4a0a-a347-f280f84f9d44 req-b0542e4d-2d59-46b2-aa77-64b47139d1d0 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:33.378859 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d331d92-ca3f-4a0a-a347-f280f84f9d44 req-b0542e4d-2d59-46b2-aa77-64b47139d1d0 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 944 time: 1.0196373 May 12 15:09:33.381017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d488353f-0c20-4fa3-a0ff-ce10def67e9d req-958e1706-5db1-4b76-a0d5-5dd900ef6106 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Synchronizing usage tracker for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:09:33.442549 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:33.456196 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-29a22bd8-fc48-413b-b49b-21008caf0cc9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:33.477885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Allocated IP 172.20.0.2 (e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5/1636e4f2-4025-4f61-a8dd-65adade9e66c/217ffa4f-2983-42fc-8f53-273403043cd2) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:09:33.504382 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:09:33.542112 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-996ee401-9002-451d-9a8b-1485bb08069d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=95dd1383-efe7-494d-a1ab-57e293da83a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1520791 May 12 15:09:33.548382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29a22bd8-fc48-413b-b49b-21008caf0cc9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=45d36a40-692b-464e-ac04-63c4a6e60759,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:33.638281 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:33.639122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 940e3b0e-8287-409c-890e-28addf1cf0b8 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:09:33.642145 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d488353f-0c20-4fa3-a0ff-ce10def67e9d req-958e1706-5db1-4b76-a0d5-5dd900ef6106 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Unset dirty status for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:09:33.642145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d488353f-0c20-4fa3-a0ff-ce10def67e9d req-958e1706-5db1-4b76-a0d5-5dd900ef6106 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7669716 May 12 15:09:33.679058 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:33.793302 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:33.825728 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d331d92-ca3f-4a0a-a347-f280f84f9d44 req-bba88c1f-c534-45bf-8ae5-6a8fcc937dcb tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3588691 May 12 15:09:33.833521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:09:33.851709 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:33.862093 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:33.862093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8e32303b-ee1e-4542-a6b9-00f019c484c7 admin admin] 10.222.0.82 "DELETE /v2.0/routers/940e3b0e-8287-409c-890e-28addf1cf0b8 HTTP/1.1" status: 204 len: 168 time: 7.2650280 May 12 15:09:33.875060 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49564) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:33.887706 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-29a22bd8-fc48-413b-b49b-21008caf0cc9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:33.888818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-29a22bd8-fc48-413b-b49b-21008caf0cc9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/45d36a40-692b-464e-ac04-63c4a6e60759 HTTP/1.1" status: 204 len: 168 time: 2.6669977 May 12 15:09:33.905780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Network 74c45f45-b34b-4876-a35b-8ae714cf4d5f is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:09:33.929067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:33.942897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:09:34.039522 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:34.107298 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:34.131350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Transition to ACTIVE for port object 217ffa4f-2983-42fc-8f53-273403043cd2 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:09:34.154661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Transition to ACTIVE for port object f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:09:34.166873 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Transition to ACTIVE for port object 217ffa4f-2983-42fc-8f53-273403043cd2 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:09:34.170133 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:34.173264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-49d37501-087a-440a-a320-64b598b36861 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:09:24Z', 'revision_number': 3, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:34.181370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49d37501-087a-440a-a320-64b598b36861 None None] The sync data for ids ['405f5f48-a239-4c20-a0c9-dd825327abd0'] in n-d-841483-1 is: [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:09:24Z', 'revision_number': 3, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:09:34.195696 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:34.225568 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:34.245600 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-7a8b2689-d82d-486e-8e0f-a1b537a1aabf service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6938086 May 12 15:09:34.358586 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:09:34.365203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fac6a011-85dc-423e-a855-446515118749 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:34.403899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-75787bac-bb6d-45ea-b162-01ec2060d906 admin admin] Deleting subnet b0cba805-7761-41c5-9666-3b2ff25491af {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:09:34.437482 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:34.462914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:09:34.471860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: fac6a011-85dc-423e-a855-446515118749 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:09:34.473067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fac6a011-85dc-423e-a855-446515118749 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:09:34.575025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Pushing event updated for resources: {'Port': ['ID=217ffa4f-2983-42fc-8f53-273403043cd2,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:34.635968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Attempting to bind port 217ffa4f-2983-42fc-8f53-273403043cd2 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:09:34.637955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Attempting to bind port 217ffa4f-2983-42fc-8f53-273403043cd2 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '5557610c-85a4-4c18-8793-b6867e2cb17c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:09:34.639700 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Attempting to bind port 217ffa4f-2983-42fc-8f53-273403043cd2 on network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:34.668332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 9, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:09:34.671705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Checking segment: {'id': '5557610c-85a4-4c18-8793-b6867e2cb17c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:34.676545 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:34.679997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Bound using segment: {'id': '5557610c-85a4-4c18-8793-b6867e2cb17c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:09:34.681718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Bound port: 217ffa4f-2983-42fc-8f53-273403043cd2, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5557610c-85a4-4c18-8793-b6867e2cb17c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:09:34.682451 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:34.767326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49580) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:34.767326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Pushing event updated for resources: {'Port': ['ID=317c5178-1ffb-4fde-a98e-8a9fce5e9457,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:34.792204 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75787bac-bb6d-45ea-b162-01ec2060d906 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:34.886594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49586) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:34.950312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] For port 217ffa4f-2983-42fc-8f53-273403043cd2, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:09:34.958961 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] For port 217ffa4f-2983-42fc-8f53-273403043cd2, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=217ffa4f-2983-42fc-8f53-273403043cd2,segment=NetworkSegment(5557610c-85a4-4c18-8793-b6867e2cb17c),segment_id=5557610c-85a4-4c18-8793-b6867e2cb17c)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:09:34.981003 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:35.028908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Pushing event updated for resources: {'Port': ['ID=f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:35.120012 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ae69600e-106c-4583-87b6-a74b40f458c2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3a478f0d02094addabf4cc31816a81f5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3498769 May 12 15:09:35.130535 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd606f52-92eb-430e-9211-51e7280b16a8 None None] Pushing event updated for resources: {'Port': ['ID=217ffa4f-2983-42fc-8f53-273403043cd2,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:35.134140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49592) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:35.150870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Allocated IP 172.25.8.50 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/3e3227c7-431d-48ce-8a34-1d616d5ac800) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:09:35.232165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-814d8b1c-09a3-463f-b173-e963e40d5c3e service neutron] 10.222.0.76 "GET /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9516852 May 12 15:09:35.259897 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5249f193-24c7-4814-8307-0ea2417dcee6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:35.276055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75787bac-bb6d-45ea-b162-01ec2060d906 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:35.382988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04cf605-2eb2-48b7-9300-62d3a980ac9d req-a6738b71-bd87-4ac5-a96f-6f6d0d6a0157 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:35.390419 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b04cf605-2eb2-48b7-9300-62d3a980ac9d req-a6738b71-bd87-4ac5-a96f-6f6d0d6a0157 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 1.3005564 May 12 15:09:35.424696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5249f193-24c7-4814-8307-0ea2417dcee6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:35.488021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Attempting to bind port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:09:35.488438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Attempting to bind port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:09:35.489725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Attempting to bind port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:35.523924 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5249f193-24c7-4814-8307-0ea2417dcee6 admin admin] Usage tracker for resource:security_group_rule and tenant:96e88757f0cb4d60ab4b882d2ee4b569 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:35.534678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5249f193-24c7-4814-8307-0ea2417dcee6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:35.539488 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:09:35.539696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Attempting to bind port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:35.569286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 9, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:09:35.570593 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:35.571244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:09:35.571918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Bound port: f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:09:35.572480 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:35.575518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5249f193-24c7-4814-8307-0ea2417dcee6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:35.608655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f62ea5b0-c75a-4324-bdce-1050e1dead66 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:35.639908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d3532e-af6c-47a8-ad28-7267dcc8e45d req-5ca6750c-6fd6-4247-a2b6-be4a9176317c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:35.651394 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33d3532e-af6c-47a8-ad28-7267dcc8e45d req-5ca6750c-6fd6-4247-a2b6-be4a9176317c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 947 time: 0.7295203 May 12 15:09:35.656326 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f62ea5b0-c75a-4324-bdce-1050e1dead66 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:35.694299 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b04cf605-2eb2-48b7-9300-62d3a980ac9d req-2c693ccd-8675-4509-ae95-390a916ff3b2 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3027389 May 12 15:09:35.858019 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75787bac-bb6d-45ea-b162-01ec2060d906 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:35.886636 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:35.975059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] For port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:09:36.019101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] For port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:09:36.035802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33d3532e-af6c-47a8-ad28-7267dcc8e45d req-88955cc9-18d4-49c0-a4a9-8058913977dc tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3801653 May 12 15:09:36.038996 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:36.045832 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:36.050821 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f62ea5b0-c75a-4324-bdce-1050e1dead66 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:36.100317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f62ea5b0-c75a-4324-bdce-1050e1dead66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=89426b75-24c4-4a0b-ba4f-3c511ab36974,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:36.142098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:36.142824 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:36.144144 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] 10.222.0.76 "PUT /v2.0/ports/f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 HTTP/1.1" status: 200 len: 1095 time: 4.6877613 May 12 15:09:36.146077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '068ccb5e-6f3b-4d6f-af59-35e722e2b8a1', 'tag': 'f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:09:36.196046 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75787bac-bb6d-45ea-b162-01ec2060d906 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:36.296396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66734848-bce4-40ba-99c7-db202bc9cefa service neutron] Pushing event updated for resources: {'Port': ['ID=f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:36.303073 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f62ea5b0-c75a-4324-bdce-1050e1dead66 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:36.311193 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f62ea5b0-c75a-4324-bdce-1050e1dead66 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/89426b75-24c4-4a0b-ba4f-3c511ab36974 HTTP/1.1" status: 204 len: 168 time: 1.1757410 May 12 15:09:36.336111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5249f193-24c7-4814-8307-0ea2417dcee6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:36.356062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5249f193-24c7-4814-8307-0ea2417dcee6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:36.378502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75787bac-bb6d-45ea-b162-01ec2060d906 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b0cba805-7761-41c5-9666-3b2ff25491af,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:36.397379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d985f9-8937-4a18-8d28-1c1408f90544 req-3b74e417-3870-499f-aed0-078648f2bc77 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:36.412115 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09d985f9-8937-4a18-8d28-1c1408f90544 req-3b74e417-3870-499f-aed0-078648f2bc77 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 944 time: 0.5611563 May 12 15:09:36.418535 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:36.516274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b7194e3-4fb3-4377-860b-6c2040a7533e None None] Network 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:09:36.521188 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75787bac-bb6d-45ea-b162-01ec2060d906 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:36.526533 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-17faea72-3006-4a62-b1c2-da3618106e44 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:36.528744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-17faea72-3006-4a62-b1c2-da3618106e44 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8&tenant_id=1b3825228b0e4c42a381540b66ea23d6&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 1095 time: 0.8739684 May 12 15:09:36.619859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:09:36.635463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:36.646815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:09:36.681425 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-75787bac-bb6d-45ea-b162-01ec2060d906 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/b0cba805-7761-41c5-9666-3b2ff25491af HTTP/1.1" status: 204 len: 168 time: 2.8056359 May 12 15:09:36.702261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 217ffa4f-2983-42fc-8f53-273403043cd2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:09:36.709361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49604) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:36.719717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09d985f9-8937-4a18-8d28-1c1408f90544 req-af42c4dc-90a8-4765-bde8-043c91bfba9a tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3028867 May 12 15:09:36.843466 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7b42b534-71c2-4c82-9a86-41cf23c3682f'] response: {'name': 'network-changed', 'server_uuid': '068ccb5e-6f3b-4d6f-af59-35e722e2b8a1', 'tag': 'f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81', 'status': 'completed', 'code': 200} May 12 15:09:36.866787 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5249f193-24c7-4814-8307-0ea2417dcee6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=96e88757f0cb4d60ab4b882d2ee4b569&name=default HTTP/1.1" status: 200 len: 2979 time: 1.9729996 May 12 15:09:36.891923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5249f193-24c7-4814-8307-0ea2417dcee6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6571b76-c069-448a-afb1-d6b475deeeb4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:36.936734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49612) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:36.975223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:37.104848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 217ffa4f-2983-42fc-8f53-273403043cd2 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:09:37.164683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 38259385-54e1-4178-becc-b82fe7cde7a2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:09:37.190462 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:37.262075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Pushing event updated for resources: {'Port': ['ID=3e3227c7-431d-48ce-8a34-1d616d5ac800,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:37.277701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 38259385-54e1-4178-becc-b82fe7cde7a2 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:09:37.300887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 38259385-54e1-4178-becc-b82fe7cde7a2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:37.303041 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:37.383514 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:37.390402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44bb8107-63a8-42ee-98f7-25f0afd9b2a7 None None] DHCP port deletion for 5af19f47-caf0-45a8-9b3d-186b8fd71ec1 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:09:37.391993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-c3d6b602-dbd0-4ece-84de-c7ac38f7754c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:37.393900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-c3d6b602-dbd0-4ece-84de-c7ac38f7754c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 1098 time: 1.1559463 May 12 15:09:37.442292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-44bb8107-63a8-42ee-98f7-25f0afd9b2a7 None None] Deleting port 251385fc-b728-4589-9b38-78a36f45231c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:37.442847 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-44bb8107-63a8-42ee-98f7-25f0afd9b2a7 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:37.507675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-b368004b-4fb5-4870-9173-964bf7d9db19 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.27&port_id=f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 HTTP/1.1" status: 200 len: 217 time: 0.1015880 May 12 15:09:37.553340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf6d4456-90a6-48cb-b6b1-2399941b6174 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:37.560212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Deleting port 251385fc-b728-4589-9b38-78a36f45231c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:37.561067 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:37.567167 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:37.624684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-374ecb50-afaa-4ab2-b1bf-41ffab4798e4 None None] Network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:09:37.638688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-2e795136-82d5-4dc7-a0fa-fc562cbc1f10 service neutron] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:09:37.659887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f57e0dd2-2453-40db-bc3a-497093a94025 req-9dab4dcb-c487-4cfd-b1fe-0e3bfa19a5b2 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:37.667721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f57e0dd2-2453-40db-bc3a-497093a94025 req-9dab4dcb-c487-4cfd-b1fe-0e3bfa19a5b2 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 0.6766148 May 12 15:09:37.679255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-2e795136-82d5-4dc7-a0fa-fc562cbc1f10 service neutron] Notify callbacks [] for binding, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:37.680616 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a938b29-3cf7-4bd3-b939-e31100eb77bb req-2e795136-82d5-4dc7-a0fa-fc562cbc1f10 service neutron] 10.222.0.76 "DELETE /v2.0/ports/b4e74807-b360-4c0d-894d-809b429ca3a6/bindings/n-h1-841483-1 HTTP/1.1" status: 204 len: 173 time: 1.1055212 May 12 15:09:37.683222 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf6d4456-90a6-48cb-b6b1-2399941b6174 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:37.719316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Pushing event updated for resources: {'Port': ['ID=317c5178-1ffb-4fde-a98e-8a9fce5e9457,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:37.724374 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-3e0822da-4cc3-43af-9117-6a3c98762895 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:37.725873 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-3e0822da-4cc3-43af-9117-6a3c98762895 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2042339 May 12 15:09:37.820659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9dc9dfe-f83f-4f26-8f9d-c864949a97f9 req-d42fcbd1-68d7-4a51-a741-64568df8c597 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:37.823664 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9dc9dfe-f83f-4f26-8f9d-c864949a97f9 req-d42fcbd1-68d7-4a51-a741-64568df8c597 tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 1095 time: 0.6780326 May 12 15:09:37.848997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cd20c9a3-68fb-4ada-959e-fc56957d87df None None] Provisioning for port 217ffa4f-2983-42fc-8f53-273403043cd2 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:09:37.937789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f57e0dd2-2453-40db-bc3a-497093a94025 req-98fb1466-8e50-48ca-8b6a-15b266dc9169 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2686560 May 12 15:09:37.965088 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:37.976962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cd20c9a3-68fb-4ada-959e-fc56957d87df None None] Provisioning complete for port 217ffa4f-2983-42fc-8f53-273403043cd2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:37.976962 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cd20c9a3-68fb-4ada-959e-fc56957d87df None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:37.993209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9dc9dfe-f83f-4f26-8f9d-c864949a97f9 req-0fa5c92c-1092-43c8-81fd-39bab2ab88ad tempest-LiveAutoBlockMigrationV225Test-230000483 tempest-LiveAutoBlockMigrationV225Test-230000483-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1142783 May 12 15:09:38.040244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-e0e7f8e4-c617-45bd-8784-4cf19a763da8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:38.041774 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-e0e7f8e4-c617-45bd-8784-4cf19a763da8 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2939780 May 12 15:09:38.155187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 38259385-54e1-4178-becc-b82fe7cde7a2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=38259385-54e1-4178-becc-b82fe7cde7a2,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:38.215094 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] For port 251385fc-b728-4589-9b38-78a36f45231c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=251385fc-b728-4589-9b38-78a36f45231c,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:38.215446 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:38.226432 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:38.246408 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:38.385972 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf6d4456-90a6-48cb-b6b1-2399941b6174 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:38.412545 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 251385fc-b728-4589-9b38-78a36f45231c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:38.414799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Network 74c45f45-b34b-4876-a35b-8ae714cf4d5f is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:09:38.428891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:38.435165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf6d4456-90a6-48cb-b6b1-2399941b6174 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6571b76-c069-448a-afb1-d6b475deeeb4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:38.518423 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf6d4456-90a6-48cb-b6b1-2399941b6174 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:38.518679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-44bb8107-63a8-42ee-98f7-25f0afd9b2a7 None None] For port 251385fc-b728-4589-9b38-78a36f45231c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=251385fc-b728-4589-9b38-78a36f45231c,segment=NetworkSegment(6877a48e-4842-481b-9f78-5fb45e4e8519),segment_id=6877a48e-4842-481b-9f78-5fb45e4e8519)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:38.519214 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-44bb8107-63a8-42ee-98f7-25f0afd9b2a7 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:38.519558 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cf6d4456-90a6-48cb-b6b1-2399941b6174 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e6571b76-c069-448a-afb1-d6b475deeeb4 HTTP/1.1" status: 204 len: 168 time: 1.5417888 May 12 15:09:38.686698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Calling delete_port for 251385fc-b728-4589-9b38-78a36f45231c owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:38.832660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-44bb8107-63a8-42ee-98f7-25f0afd9b2a7 None None] Calling delete_port for 251385fc-b728-4589-9b38-78a36f45231c owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:38.887528 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:38.943693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-293ed0ce-edf9-4f8b-96ec-01ca3b309761 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8825870 May 12 15:09:38.956099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Pushing event deleted for resources: {'Port': ['ID=251385fc-b728-4589-9b38-78a36f45231c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:38.981243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] No DVR routers for this DVR port 251385fc-b728-4589-9b38-78a36f45231c on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:09:39.076804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c9ddaed-0650-4970-a1c1-1f78c657f7f4 req-50e7f9c1-834b-4994-9341-1765cba24d4d tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:39.077624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=38259385-54e1-4178-becc-b82fe7cde7a2,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:39.084172 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c9ddaed-0650-4970-a1c1-1f78c657f7f4 req-50e7f9c1-834b-4994-9341-1765cba24d4d tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 947 time: 0.9358902 May 12 15:09:39.218918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:39.353818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Router 405f5f48-a239-4c20-a0c9-dd825327abd0 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:09:39.378021 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cd20c9a3-68fb-4ada-959e-fc56957d87df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:39.393749 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c9ddaed-0650-4970-a1c1-1f78c657f7f4 req-ad955460-0bfd-418a-a9b8-d116e344afb4 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3084791 May 12 15:09:39.404600 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:39.452255 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No active binding found for port 251385fc-b728-4589-9b38-78a36f45231c {{(pid=88153) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:224}} May 12 15:09:39.470606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 251385fc-b728-4589-9b38-78a36f45231c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:09:39.473862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49654) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:39.477160 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-44bb8107-63a8-42ee-98f7-25f0afd9b2a7 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:09:39.477642 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-44bb8107-63a8-42ee-98f7-25f0afd9b2a7 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:09:39.509235 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf5285b8-d6f5-49a8-842f-5459559a4775 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:39.513590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-cd20c9a3-68fb-4ada-959e-fc56957d87df None None] For port 217ffa4f-2983-42fc-8f53-273403043cd2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=217ffa4f-2983-42fc-8f53-273403043cd2,segment=NetworkSegment(5557610c-85a4-4c18-8793-b6867e2cb17c),segment_id=5557610c-85a4-4c18-8793-b6867e2cb17c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:39.525065 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cd20c9a3-68fb-4ada-959e-fc56957d87df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:39.593362 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5e0cb46-d009-486c-999a-b2bcea77dcd5 req-f7588ccf-9dbb-46a2-abe7-a737d601dd4b service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6390142 May 12 15:09:39.599657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5af19f47-caf0-45a8-9b3d-186b8fd71ec1']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:39.643513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cf5285b8-d6f5-49a8-842f-5459559a4775 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:39.651708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd20c9a3-68fb-4ada-959e-fc56957d87df None None] Pushing event updated for resources: {'Port': ['ID=217ffa4f-2983-42fc-8f53-273403043cd2,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:39.663974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cf5285b8-d6f5-49a8-842f-5459559a4775 admin admin] Usage tracker for resource:security_group_rule and tenant:f1db24dec81c4b0dbcb9f1c4d93fdd08 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:39.669110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cf5285b8-d6f5-49a8-842f-5459559a4775 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:39.679303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cf5285b8-d6f5-49a8-842f-5459559a4775 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:39.835195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:09:39.851410 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Sync routers for ids ['405f5f48-a239-4c20-a0c9-dd825327abd0'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:09:39.851891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Router 2efb0694-c577-4ca8-871f-c4b55760ad4a is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:09:39.867585 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Routers {'405f5f48-a239-4c20-a0c9-dd825327abd0'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:39.868444 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['405f5f48-a239-4c20-a0c9-dd825327abd0'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:39.946028 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-39e306da-9025-4b71-aadb-26334be9c429 admin admin] 10.222.0.82 "PUT /v2.0/routers/405f5f48-a239-4c20-a0c9-dd825327abd0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 9.4019864 May 12 15:09:39.978493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-44bb8107-63a8-42ee-98f7-25f0afd9b2a7 None None] Deleting port 251385fc-b728-4589-9b38-78a36f45231c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:39.979581 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-44bb8107-63a8-42ee-98f7-25f0afd9b2a7 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:39.991778 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf5285b8-d6f5-49a8-842f-5459559a4775 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:40.011866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6877a48e-4842-481b-9f78-5fb45e4e8519') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:40.012740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6877a48e-4842-481b-9f78-5fb45e4e8519') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:40.044774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3cb01af7-0ef7-44d3-bc80-2b103ab4bca2 None None] Provisioning complete for port 217ffa4f-2983-42fc-8f53-273403043cd2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:40.052478 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3cb01af7-0ef7-44d3-bc80-2b103ab4bca2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:40.055655 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:40.063171 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Set router 405f5f48-a239-4c20-a0c9-dd825327abd0 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:40.114853 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:40.136485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Releasing vlan 565 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:09:40.137351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: timer() May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:09:40.155318 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:09:40.187690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:09:40.220338 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf5285b8-d6f5-49a8-842f-5459559a4775 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:40.263484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Sync routers for ids ['2efb0694-c577-4ca8-871f-c4b55760ad4a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:09:40.291709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e25b4a38-5644-48f3-95c5-9d03e2bb2dd5 req-8ff34fa1-1233-4231-b334-ecda10970cef tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:40.293588 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e25b4a38-5644-48f3-95c5-9d03e2bb2dd5 req-8ff34fa1-1233-4231-b334-ecda10970cef tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.76 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 944 time: 0.6711912 May 12 15:09:40.306876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6409e7b-fb9b-4c22-ae14-2462aca7adc9 req-f066e440-b5a4-4456-ae69-e40dac2ac869 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:40.309295 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6409e7b-fb9b-4c22-ae14-2462aca7adc9 req-f066e440-b5a4-4456-ae69-e40dac2ac869 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 944 time: 0.6800382 May 12 15:09:40.318884 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-44bb8107-63a8-42ee-98f7-25f0afd9b2a7 None None] The port '251385fc-b728-4589-9b38-78a36f45231c' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:09:40.320711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cdc0e95-0fdd-4797-b224-7b3665df5983 req-f522b079-b731-4a4d-a8d3-bf405dfb9990 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:40.324366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cdc0e95-0fdd-4797-b224-7b3665df5983 req-f522b079-b731-4a4d-a8d3-bf405dfb9990 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 1098 time: 0.5919559 May 12 15:09:40.325055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:40.334836 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cf5285b8-d6f5-49a8-842f-5459559a4775 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f1db24dec81c4b0dbcb9f1c4d93fdd08&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8573787 May 12 15:09:40.334836 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:40.334836 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-95d6f6dd-1fce-47b5-9028-c5a7a605a008 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 917 time: 8.0423470 May 12 15:09:40.337938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49664) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:40.351508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d493d66-fc60-4dce-9055-ca14be98eb8e req-8fd9bdbe-830e-44c3-b316-7350e7974945 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:40.352243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49666) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:40.354004 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d493d66-fc60-4dce-9055-ca14be98eb8e req-8fd9bdbe-830e-44c3-b316-7350e7974945 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 0.7272758 May 12 15:09:40.391459 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Routers {'2efb0694-c577-4ca8-871f-c4b55760ad4a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:40.392086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2efb0694-c577-4ca8-871f-c4b55760ad4a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:40.430433 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:40.431716 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:09:35Z', 'revision_number': 4, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '317c5178-1ffb-4fde-a98e-8a9fce5e9457', 'name': '', 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'mac_address': 'fa:16:3e:5d:a4:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:36Z', 'revision_number': 2, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'subnets': [{'id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:40.436182 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Checking router: 405f5f48-a239-4c20-a0c9-dd825327abd0 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:09:40.436727 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Updating router 405f5f48-a239-4c20-a0c9-dd825327abd0 port 317c5178-1ffb-4fde-a98e-8a9fce5e9457 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:09:40.455380 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5ff3b9d-4546-4a88-8bf3-3343c735aaf1 req-ebe14ff5-7fe6-4260-a0c5-b9d459de4534 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.7183471 May 12 15:09:40.526792 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:40.546771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] Pushing event deleted for resources: {'Network': ['ID=5af19f47-caf0-45a8-9b3d-186b8fd71ec1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:40.557708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 217ffa4f-2983-42fc-8f53-273403043cd2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:09:40.564262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf5285b8-d6f5-49a8-842f-5459559a4775 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54e2d71a-f256-4b48-bcab-9f7b793c2e93,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:40.747631 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb52c5b9-ce0f-4eff-8364-b13ad5a06169 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:40.775510 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-43dbd107-8c51-48ed-ba66-eaa3a225f992 admin admin] 10.222.0.82 "DELETE /v2.0/networks/5af19f47-caf0-45a8-9b3d-186b8fd71ec1 HTTP/1.1" status: 204 len: 168 time: 4.0559123 May 12 15:09:40.902003 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d493d66-fc60-4dce-9055-ca14be98eb8e req-7eb7c595-e341-4958-b20d-3b04c2878349 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4577487 May 12 15:09:40.902524 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb52c5b9-ce0f-4eff-8364-b13ad5a06169 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:40.965785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-e25b4a38-5644-48f3-95c5-9d03e2bb2dd5 req-26594891-78f9-4cbd-93ad-db0c55718614 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Deleting port b4e74807-b360-4c0d-894d-809b429ca3a6 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:40.974774 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e25b4a38-5644-48f3-95c5-9d03e2bb2dd5 req-26594891-78f9-4cbd-93ad-db0c55718614 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:40.982546 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:41.016875 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Transition to ACTIVE for port object 317c5178-1ffb-4fde-a98e-8a9fce5e9457 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:09:41.039398 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:41.148481 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08e26b29-b8b6-4959-8ed6-f3a53a479648 None None] Pushing event updated for resources: {'Port': ['ID=317c5178-1ffb-4fde-a98e-8a9fce5e9457,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:41.226461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6409e7b-fb9b-4c22-ae14-2462aca7adc9 req-34de2832-dd3d-43d3-bbfe-50c8b41b9d3b tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7970495 May 12 15:09:41.285583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Set router 2efb0694-c577-4ca8-871f-c4b55760ad4a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:41.361177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49684) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:41.379794 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08e26b29-b8b6-4959-8ed6-f3a53a479648 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:41.380115 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08e26b29-b8b6-4959-8ed6-f3a53a479648 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:41.380445 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08e26b29-b8b6-4959-8ed6-f3a53a479648 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:41.380770 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08e26b29-b8b6-4959-8ed6-f3a53a479648 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:41.381091 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08e26b29-b8b6-4959-8ed6-f3a53a479648 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:41.381420 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08e26b29-b8b6-4959-8ed6-f3a53a479648 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:41.381741 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08e26b29-b8b6-4959-8ed6-f3a53a479648 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:41.382139 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08e26b29-b8b6-4959-8ed6-f3a53a479648 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:41.382455 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08e26b29-b8b6-4959-8ed6-f3a53a479648 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:41.382768 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08e26b29-b8b6-4959-8ed6-f3a53a479648 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:41.383076 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08e26b29-b8b6-4959-8ed6-f3a53a479648 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:41.383382 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08e26b29-b8b6-4959-8ed6-f3a53a479648 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:09:41.400309 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Attempting to bind port 317c5178-1ffb-4fde-a98e-8a9fce5e9457 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:09:41.400766 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Attempting to bind port 317c5178-1ffb-4fde-a98e-8a9fce5e9457 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '96a7c587-eda9-40b0-aaff-97f4e1387d63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:09:41.401129 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Attempting to bind port 317c5178-1ffb-4fde-a98e-8a9fce5e9457 on network 74c45f45-b34b-4876-a35b-8ae714cf4d5f {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:41.418622 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 9, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:09:41.419026 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Checking segment: {'id': '96a7c587-eda9-40b0-aaff-97f4e1387d63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:41.419478 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:41.420232 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Bound using segment: {'id': '96a7c587-eda9-40b0-aaff-97f4e1387d63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:09:41.420941 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Bound port: 317c5178-1ffb-4fde-a98e-8a9fce5e9457, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '96a7c587-eda9-40b0-aaff-97f4e1387d63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:09:41.421308 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:41.515822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cdc0e95-0fdd-4797-b224-7b3665df5983 req-affa50c7-6404-4377-a520-8b59ca6a9d7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:41.518070 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cdc0e95-0fdd-4797-b224-7b3665df5983 req-affa50c7-6404-4377-a520-8b59ca6a9d7f service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 1.1561694 May 12 15:09:41.538478 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] For port 317c5178-1ffb-4fde-a98e-8a9fce5e9457, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:09:41.542164 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] For port 317c5178-1ffb-4fde-a98e-8a9fce5e9457, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=317c5178-1ffb-4fde-a98e-8a9fce5e9457,segment=NetworkSegment(96a7c587-eda9-40b0-aaff-97f4e1387d63),segment_id=96a7c587-eda9-40b0-aaff-97f4e1387d63)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:09:41.550887 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:41.557779 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 217ffa4f-2983-42fc-8f53-273403043cd2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:41.558767 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:41.670476 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Routers {'405f5f48-a239-4c20-a0c9-dd825327abd0'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:41.671732 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['405f5f48-a239-4c20-a0c9-dd825327abd0'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:41.740879 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cdc0e95-0fdd-4797-b224-7b3665df5983 req-f4bd3998-e97e-4549-b109-c1c5c6df2b5f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.27&port_id=f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 HTTP/1.1" status: 200 len: 217 time: 0.1931784 May 12 15:09:41.859543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb52c5b9-ce0f-4eff-8364-b13ad5a06169 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:41.915813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb52c5b9-ce0f-4eff-8364-b13ad5a06169 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54e2d71a-f256-4b48-bcab-9f7b793c2e93,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:41.927432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-910a7d12-d610-4de1-bb30-8c28130c3a95 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bad2264067c248e9803d4b1eeb73116d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5524750 May 12 15:09:41.928569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb52c5b9-ce0f-4eff-8364-b13ad5a06169 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:41.929767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49696) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:41.930530 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cb52c5b9-ce0f-4eff-8364-b13ad5a06169 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/54e2d71a-f256-4b48-bcab-9f7b793c2e93 HTTP/1.1" status: 204 len: 168 time: 1.5916374 May 12 15:09:42.022070 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] Set router 405f5f48-a239-4c20-a0c9-dd825327abd0 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:42.062779 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 38259385-54e1-4178-becc-b82fe7cde7a2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:09:42.088642 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-d1d9aea7-41fe-4dc9-9556-66b66f0b83b1 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:42.089627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-d1d9aea7-41fe-4dc9-9556-66b66f0b83b1 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Synchronizing usage tracker for tenant:fd97c932be3143b1846bb48363040c63 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:09:42.111083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ff3b9d-4546-4a88-8bf3-3343c735aaf1 req-88c2e8c8-4320-4206-b169-1d2926a4c336 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:42.112860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5ff3b9d-4546-4a88-8bf3-3343c735aaf1 req-88c2e8c8-4320-4206-b169-1d2926a4c336 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 1101 time: 1.5697262 May 12 15:09:42.212631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cdc0e95-0fdd-4797-b224-7b3665df5983 req-a3355e71-d549-4fc3-9dfa-c0e0a42b99c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:42.214425 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cdc0e95-0fdd-4797-b224-7b3665df5983 req-a3355e71-d549-4fc3-9dfa-c0e0a42b99c7 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3644581 May 12 15:09:42.354605 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 38259385-54e1-4178-becc-b82fe7cde7a2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:42.355458 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:42.378494 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:42.475406 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08e26b29-b8b6-4959-8ed6-f3a53a479648 None None] Pushing event updated for resources: {'Port': ['ID=317c5178-1ffb-4fde-a98e-8a9fce5e9457,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:42.488018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a58d01f5-c8cb-4019-83ce-769383d74029 req-070fdd35-1184-4b8f-ad56-a2b2b11a0649 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:42.507809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a58d01f5-c8cb-4019-83ce-769383d74029 req-070fdd35-1184-4b8f-ad56-a2b2b11a0649 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 947 time: 1.2624681 May 12 15:09:42.601288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50'}], 'enable_snat': True}, 'gw_port_id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:37Z', 'revision_number': 3, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port': {'id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:5a:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:34Z', 'updated_at': '2022-05-12T15:09:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:42.628206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Checking router: 2efb0694-c577-4ca8-871f-c4b55760ad4a for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:09:42.628750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Updating router 2efb0694-c577-4ca8-871f-c4b55760ad4a port 3e3227c7-431d-48ce-8a34-1d616d5ac800 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:09:42.675739 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:09:35Z', 'revision_number': 4, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '317c5178-1ffb-4fde-a98e-8a9fce5e9457', 'name': '', 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'mac_address': 'fa:16:3e:5d:a4:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:41Z', 'revision_number': 4, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'subnets': [{'id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:42.681204 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e804a889-06a8-45f3-a919-5a0f889b0086 None None] The sync data for ids ['405f5f48-a239-4c20-a0c9-dd825327abd0'] in n-d-841483-1 is: [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:09:35Z', 'revision_number': 4, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '317c5178-1ffb-4fde-a98e-8a9fce5e9457', 'name': '', 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'mac_address': 'fa:16:3e:5d:a4:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:41Z', 'revision_number': 4, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'subnets': [{'id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:09:42.762201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-d1d9aea7-41fe-4dc9-9556-66b66f0b83b1 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Unset dirty status for tenant:fd97c932be3143b1846bb48363040c63 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:09:42.777223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-d1d9aea7-41fe-4dc9-9556-66b66f0b83b1 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/networks?id=74c45f45-b34b-4876-a35b-8ae714cf4d5f HTTP/1.1" status: 200 len: 820 time: 0.8684406 May 12 15:09:42.850055 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:42.872986 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-4b5573f2-5c7d-42e8-8479-22820e6921bc tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/quotas/fd97c932be3143b1846bb48363040c63 HTTP/1.1" status: 200 len: 375 time: 0.0945415 May 12 15:09:42.895883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-e25b4a38-5644-48f3-95c5-9d03e2bb2dd5 req-26594891-78f9-4cbd-93ad-db0c55718614 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] For port b4e74807-b360-4c0d-894d-809b429ca3a6, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b4e74807-b360-4c0d-894d-809b429ca3a6,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:42.896275 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e25b4a38-5644-48f3-95c5-9d03e2bb2dd5 req-26594891-78f9-4cbd-93ad-db0c55718614 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:42.918158 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b08baf97-8120-40a0-b5cd-92833b02ff77 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:42.965646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Allocated IP 172.20.0.1 (e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5/1636e4f2-4025-4f61-a8dd-65adade9e66c/7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:09:42.997669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a58d01f5-c8cb-4019-83ce-769383d74029 req-a3665bb4-0136-4e50-b7d4-d2429585a3fc tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4854915 May 12 15:09:43.160243 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:43.161017 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0f6c01cb-b0a1-47fb-872c-34c3d5ff975a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:43.279519 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:43.310397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Transition to ACTIVE for port object 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:09:43.325194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-e25b4a38-5644-48f3-95c5-9d03e2bb2dd5 req-26594891-78f9-4cbd-93ad-db0c55718614 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Calling delete_port for b4e74807-b360-4c0d-894d-809b429ca3a6 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:43.361163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:43.422350 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:43.436257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Transition to ACTIVE for port object 3e3227c7-431d-48ce-8a34-1d616d5ac800 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:09:43.444907 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b08baf97-8120-40a0-b5cd-92833b02ff77 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:43.452888 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:43.485552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:09:43.488674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:43.492741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:09:43.570035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Pushing event updated for resources: {'Port': ['ID=7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:43.584571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ff3b9d-4546-4a88-8bf3-3343c735aaf1 req-39c8136f-f341-4fc5-abcf-ff950c0b644c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:43.589031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5ff3b9d-4546-4a88-8bf3-3343c735aaf1 req-39c8136f-f341-4fc5-abcf-ff950c0b644c service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 1.4056761 May 12 15:09:43.599923 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:43.632244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Attempting to bind port 3e3227c7-431d-48ce-8a34-1d616d5ac800 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:09:43.632566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Attempting to bind port 3e3227c7-431d-48ce-8a34-1d616d5ac800 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:09:43.634033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Attempting to bind port 3e3227c7-431d-48ce-8a34-1d616d5ac800 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:43.645161 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 9, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:09:43.645821 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:43.646471 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:43.647558 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:09:43.648259 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Bound port: 3e3227c7-431d-48ce-8a34-1d616d5ac800, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:09:43.648837 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:43.694510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49726) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:43.698465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:09:43.795898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cdc0e95-0fdd-4797-b224-7b3665df5983 req-efb81a69-cab8-4573-a1be-a90a47bbd3ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:43.798312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cdc0e95-0fdd-4797-b224-7b3665df5983 req-efb81a69-cab8-4573-a1be-a90a47bbd3ad service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 1.5705001 May 12 15:09:43.823455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:43.836334 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5ff3b9d-4546-4a88-8bf3-3343c735aaf1 req-2b37e856-69d1-445d-9499-15d5e7966f02 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.253&port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127 HTTP/1.1" status: 200 len: 217 time: 0.1963387 May 12 15:09:43.839662 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b4e74807-b360-4c0d-894d-809b429ca3a6 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:43.895028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Request body: {'network': {'name': 'tempest-LiveMigrationRemoteConsolesV26Test-1530363216-network', 'tenant_id': 'efc138ce233d4d88a27b2f15a41f3cd5'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:43.911025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:43.924289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Usage tracker for resource:network and tenant:efc138ce233d4d88a27b2f15a41f3cd5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:43.928889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:43.929062 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-933b00de-9d12-46d0-8725-32e7be76e8b1 None None] Pushing event updated for resources: {'Port': ['ID=3e3227c7-431d-48ce-8a34-1d616d5ac800,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:43.944290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:43.947310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-227c035c-c1db-415a-8a83-cb4ae8c7a224 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=fd97c932be3143b1846bb48363040c63&fields=id HTTP/1.1" status: 200 len: 255 time: 1.0729878 May 12 15:09:43.949183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4e9a7920-0f79-41ea-b9de-d1aa10877042 None None] Provisioning for port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:09:43.982026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Made reservation on behalf of efc138ce233d4d88a27b2f15a41f3cd5 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:09:43.984388 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:43.995425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4e9a7920-0f79-41ea-b9de-d1aa10877042 None None] Provisioning complete for port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:43.995787 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4e9a7920-0f79-41ea-b9de-d1aa10877042 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.088049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] For port 3e3227c7-431d-48ce-8a34-1d616d5ac800, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:09:44.098295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] For port 3e3227c7-431d-48ce-8a34-1d616d5ac800, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3e3227c7-431d-48ce-8a34-1d616d5ac800,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:09:44.099397 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4e9a7920-0f79-41ea-b9de-d1aa10877042 None None] Port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:09:44.103319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:44.129243 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.140848 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.154711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:44.161169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Usage tracker for resource:security_group_rule and tenant:efc138ce233d4d88a27b2f15a41f3cd5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:44.164920 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:44.172985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:44.200185 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.246779 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-a2ab93f6-ccb3-4d71-80b8-fda6b627b4c7 service neutron] 10.222.0.82 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2301588 May 12 15:09:44.277727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81', 'mac_address': 'fa:16:3e:37:ba:4c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.27'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:09:44.330394 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.331874 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.336635 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b08baf97-8120-40a0-b5cd-92833b02ff77 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.351197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df0d35e4-5713-4dad-8af2-31e588e65827 req-eca6b132-3a11-4ffa-9ed1-a0abf84d3bc2 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:44.358821 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df0d35e4-5713-4dad-8af2-31e588e65827 req-eca6b132-3a11-4ffa-9ed1-a0abf84d3bc2 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 0.9924359 May 12 15:09:44.389569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Routers {'2efb0694-c577-4ca8-871f-c4b55760ad4a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:44.390179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2efb0694-c577-4ca8-871f-c4b55760ad4a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:44.446023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.449753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-933b00de-9d12-46d0-8725-32e7be76e8b1 None None] Pushing event updated for resources: {'Port': ['ID=3e3227c7-431d-48ce-8a34-1d616d5ac800,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:44.458344 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.460718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08baf97-8120-40a0-b5cd-92833b02ff77 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0da5cbef-d2fd-454a-8ac9-aab67e936a65,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:44.481581 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.487989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ff3b9d-4546-4a88-8bf3-3343c735aaf1 req-8e86cdb3-8b64-4eef-9c4a-ea229de18b7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:44.489560 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5ff3b9d-4546-4a88-8bf3-3343c735aaf1 req-8e86cdb3-8b64-4eef-9c4a-ea229de18b7c service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.6025386 May 12 15:09:44.515460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:09:44.577967 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df0d35e4-5713-4dad-8af2-31e588e65827 req-79c02168-49ff-400c-9313-567de003c950 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2180746 May 12 15:09:44.620267 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b08baf97-8120-40a0-b5cd-92833b02ff77 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.621515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b08baf97-8120-40a0-b5cd-92833b02ff77 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0da5cbef-d2fd-454a-8ac9-aab67e936a65 HTTP/1.1" status: 204 len: 168 time: 2.5400634 May 12 15:09:44.625042 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:44.626759 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e25b4a38-5644-48f3-95c5-9d03e2bb2dd5 req-26594891-78f9-4cbd-93ad-db0c55718614 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.633378 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.639188 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cdc0e95-0fdd-4797-b224-7b3665df5983 req-9ba55c5d-0d08-4a9f-b3cd-c2cd69720c72 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8058481 May 12 15:09:44.693317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['8a33daa6-587f-4787-befb-2fa6e1051f2c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:09:44.746683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26594891-78f9-4cbd-93ad-db0c55718614 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Pushing event deleted for resources: {'Port': ['ID=b4e74807-b360-4c0d-894d-809b429ca3a6,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:44.766057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 586} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:09:44.777371 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.780596 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Added segment 7c475e35-2952-43f2-911d-559ab33d0a9f of type vlan for network 22b5d9f0-3270-4d1d-9d0f-8719ed790190 May 12 15:09:44.830569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 317c5178-1ffb-4fde-a98e-8a9fce5e9457 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:09:44.859595 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:44.871985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-ba505720-6eb8-4ba3-8f3f-1a3bd0a9d659 service neutron] 10.222.0.82 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6021805 May 12 15:09:44.914159 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:09:44.917990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Pushing event updated for resources: {'Port': ['ID=7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:44.918250 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] Set router 2efb0694-c577-4ca8-871f-c4b55760ad4a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:44.923920 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:44.954812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0abf7787-b5c1-4f0f-9d37-9d8723c825cc req-4082eff1-6044-4cfb-8b9c-cc60a9f36d99 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Synchronizing usage tracker for tenant:1b3825228b0e4c42a381540b66ea23d6 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:09:45.000315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-e25b4a38-5644-48f3-95c5-9d03e2bb2dd5 req-26594891-78f9-4cbd-93ad-db0c55718614 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] No DVR routers for this DVR port b4e74807-b360-4c0d-894d-809b429ca3a6 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:09:45.009178 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ff3b9d-4546-4a88-8bf3-3343c735aaf1 req-bd21b52f-fb12-4fb6-a1db-2f795041f475 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:45.010788 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5ff3b9d-4546-4a88-8bf3-3343c735aaf1 req-bd21b52f-fb12-4fb6-a1db-2f795041f475 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.4993722 May 12 15:09:45.015391 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e25b4a38-5644-48f3-95c5-9d03e2bb2dd5 req-26594891-78f9-4cbd-93ad-db0c55718614 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:45.017567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e25b4a38-5644-48f3-95c5-9d03e2bb2dd5 req-26594891-78f9-4cbd-93ad-db0c55718614 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.76 "DELETE /v2.0/ports/b4e74807-b360-4c0d-894d-809b429ca3a6 HTTP/1.1" status: 204 len: 173 time: 4.7069705 May 12 15:09:45.018098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '90ffd47c-e072-4c18-8d59-4ad501ade5d8', 'name': 'network-vif-deleted', 'tag': 'b4e74807-b360-4c0d-894d-809b429ca3a6'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:09:45.109664 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:09:45.165365 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-428dc8d6-06f4-4a44-84ef-991b871c21b8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:45.226851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a9192705-dd0c-4a49-94b7-298b628dfca3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:45.261080 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] It took 0.37 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:09:45.299663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:45.417717 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:45.418602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:45.424665 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:45.454436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0abf7787-b5c1-4f0f-9d37-9d8723c825cc req-4082eff1-6044-4cfb-8b9c-cc60a9f36d99 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Unset dirty status for tenant:1b3825228b0e4c42a381540b66ea23d6 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:09:45.468337 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0abf7787-b5c1-4f0f-9d37-9d8723c825cc req-4082eff1-6044-4cfb-8b9c-cc60a9f36d99 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 210 time: 0.6006660 May 12 15:09:45.628213 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6cddea7c-a93b-44f7-bd3a-db97ba3b243a'] response: {'server_uuid': '90ffd47c-e072-4c18-8d59-4ad501ade5d8', 'name': 'network-vif-deleted', 'tag': 'b4e74807-b360-4c0d-894d-809b429ca3a6', 'status': 'completed', 'code': 200} May 12 15:09:45.716900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cdc0e95-0fdd-4797-b224-7b3665df5983 req-357c60f7-d6a1-4cc1-a4d5-46d526bee45b service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.0185115 May 12 15:09:45.818428 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-878f7616-72e4-4315-ba21-e9c793b50564 req-c073cb07-778d-4bbe-9505-491fe7103506 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 210 time: 0.0997274 May 12 15:09:45.842566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Router 2efb0694-c577-4ca8-871f-c4b55760ad4a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:09:45.912450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] Pushing event updated for resources: {'Network': ['ID=22b5d9f0-3270-4d1d-9d0f-8719ed790190,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:45.948443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5ff3b9d-4546-4a88-8bf3-3343c735aaf1 req-d8f57f82-7bfa-4f55-8d58-a0c3b1cae4e4 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9253380 May 12 15:09:45.980730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 22b5d9f0-3270-4d1d-9d0f-8719ed790190 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:09:45.981555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-808848ee-3a18-44cb-91a2-a1d0d616be9e req-1c5f4a5a-895b-442c-99ae-852c82e754ec tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:45.983602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-808848ee-3a18-44cb-91a2-a1d0d616be9e req-1c5f4a5a-895b-442c-99ae-852c82e754ec tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 948 time: 0.4858499 May 12 15:09:46.008815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2a83a6eb-4c4c-4cf8-a3c7-c697d4f43d1f None None] Provisioning complete for port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:46.009778 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2a83a6eb-4c4c-4cf8-a3c7-c697d4f43d1f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:46.066473 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e4a71dab-8164-4b2a-9a4e-596c1e309fac admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 2.3705709 May 12 15:09:46.067293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49776) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:46.257046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:09:46.261955 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8503a75d-6ab9-4f31-ab9b-512b62e07447 admin admin] 10.222.0.82 "PUT /v2.0/routers/2efb0694-c577-4ca8-871f-c4b55760ad4a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9021330 May 12 15:09:46.288087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Request body: {'subnet': {'network_id': '22b5d9f0-3270-4d1d-9d0f-8719ed790190', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveMigrationRemoteConsolesV26Test-1530363216-subnet', 'tenant_id': 'efc138ce233d4d88a27b2f15a41f3cd5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:46.314712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2a83a6eb-4c4c-4cf8-a3c7-c697d4f43d1f None None] Port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:09:46.357139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:46.362283 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 317c5178-1ffb-4fde-a98e-8a9fce5e9457 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:09:46.406016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Usage tracker for resource:subnet and tenant:efc138ce233d4d88a27b2f15a41f3cd5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:46.419104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 317c5178-1ffb-4fde-a98e-8a9fce5e9457 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:46.419483 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:46.437131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:46.451379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:46.456812 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-808848ee-3a18-44cb-91a2-a1d0d616be9e req-eda0a985-6e1b-4eba-a67c-eb4cef2e9eb9 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4281759 May 12 15:09:46.467823 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:46.489102 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:46.509796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Made reservation on behalf of efc138ce233d4d88a27b2f15a41f3cd5 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:09:46.517668 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:46.564396 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5ff3b9d-4546-4a88-8bf3-3343c735aaf1 req-8fc9a3cc-1114-47d8-ada6-c9d8a21d2aa0 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5790341 May 12 15:09:46.785370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ffdd0f5-875e-492a-8fb9-245a8126ae6f req-55f1ca5e-ae22-4d4d-a86b-2c1bad86224b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:46.786902 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ffdd0f5-875e-492a-8fb9-245a8126ae6f req-55f1ca5e-ae22-4d4d-a86b-2c1bad86224b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 0.7187116 May 12 15:09:46.826043 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:46.886809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50'}], 'enable_snat': True}, 'gw_port_id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:43Z', 'revision_number': 4, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port': {'id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:5a:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:34Z', 'updated_at': '2022-05-12T15:09:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5', 'name': '', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'mac_address': 'fa:16:3e:44:ec:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:42Z', 'updated_at': '2022-05-12T15:09:43Z', 'revision_number': 2, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'subnets': [{'id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:46.915100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-966202db-bc66-4e23-8b91-98b1fce5d29a None None] The sync data for ids ['2efb0694-c577-4ca8-871f-c4b55760ad4a'] in n-d-841483-1 is: [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50'}], 'enable_snat': True}, 'gw_port_id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:43Z', 'revision_number': 4, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port': {'id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:5a:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:34Z', 'updated_at': '2022-05-12T15:09:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5', 'name': '', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'mac_address': 'fa:16:3e:44:ec:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:42Z', 'updated_at': '2022-05-12T15:09:43Z', 'revision_number': 2, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'subnets': [{'id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:09:46.921767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 317c5178-1ffb-4fde-a98e-8a9fce5e9457, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=317c5178-1ffb-4fde-a98e-8a9fce5e9457,segment=NetworkSegment(96a7c587-eda9-40b0-aaff-97f4e1387d63),segment_id=96a7c587-eda9-40b0-aaff-97f4e1387d63)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:46.932951 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:46.937239 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46b0bbbb-c62e-4bd4-9144-b3df1d5ca6ad req-50e4d1a9-d370-4e2f-85aa-7235f35c5de5 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=90ffd47c-e072-4c18-8d59-4ad501ade5d8 HTTP/1.1" status: 200 len: 210 time: 0.1493340 May 12 15:09:46.958528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ffdd0f5-875e-492a-8fb9-245a8126ae6f req-1f65dbf2-ae7b-46e6-8e31-abac0bc95e83 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1509652 May 12 15:09:47.124726 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:47.225128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Pushing event updated for resources: {'Subnet': ['ID=8646cfd4-8f65-4837-b1bf-19c77543a345,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:47.231316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Checking segment: {'id': '7c475e35-2952-43f2-911d-559ab33d0a9f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '22b5d9f0-3270-4d1d-9d0f-8719ed790190'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:47.231797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Network hostable DHCP agents. Network: 22b5d9f0-3270-4d1d-9d0f-8719ed790190, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:09:47.266073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Network 22b5d9f0-3270-4d1d-9d0f-8719ed790190 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:09:47.418250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 22b5d9f0-3270-4d1d-9d0f-8719ed790190) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:47.422140 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48dd1def-6862-4140-bbdd-e0bf16dc0766 req-ff3ba587-ea26-4e5b-9fc5-0e2781b4c2f5 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 210 time: 0.1463034 May 12 15:09:47.426750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:47.427387 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:47.461671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cce23c8-26e8-437d-8b8a-c3ae0f509469 None None] Network 22b5d9f0-3270-4d1d-9d0f-8719ed790190 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:09:47.480866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f206a2ab-8e8d-4067-b3f8-3eeb985e877c admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.2745867 May 12 15:09:47.592331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49834) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:47.599155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Request body: {'security_group': {'name': 'tempest-securitygroup--835046634', 'description': 'tempest-description--1974040692'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:47.611499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:47.632707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Usage tracker for resource:security_group and tenant:982e4927ecc048a1a769000f4c067d06 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:47.652949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:47.670634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:47.706325 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:47.733014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:47.737616 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Usage tracker for resource:security_group_rule and tenant:982e4927ecc048a1a769000f4c067d06 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:47.740663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:47.748347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:47.799908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:09:47.853572 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=317c5178-1ffb-4fde-a98e-8a9fce5e9457,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:47.887792 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:48.007561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:09:48.017819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:48.018281 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:48.062627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-d45acc2f-754f-4895-bc23-3ade9509e2af tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:48.073204 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-d45acc2f-754f-4895-bc23-3ade9509e2af tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.84 "GET /v2.0/networks?id=74c45f45-b34b-4876-a35b-8ae714cf4d5f HTTP/1.1" status: 200 len: 820 time: 0.5581055 May 12 15:09:48.080820 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:48.104059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Request body: {'port': {'device_id': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'admin_state_up': True, 'tenant_id': 'fd97c932be3143b1846bb48363040c63'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:48.108827 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:48.157911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53793875-2518-47b2-9e8d-b8d58ddc3861 None None] Network 22b5d9f0-3270-4d1d-9d0f-8719ed790190 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:09:48.206266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:48.238174 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:48.242611 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c5e56172-04cf-4ed7-a9ae-4b1a9dc9ba27 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.6491852 May 12 15:09:48.244284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49878) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:48.288102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88f73e2c-c907-45a9-beb0-74bb52b1a155 req-c6181f99-b558-4a73-8180-e8ac4897fd9e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:48.300038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88f73e2c-c907-45a9-beb0-74bb52b1a155 req-c6181f99-b558-4a73-8180-e8ac4897fd9e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 948 time: 0.4015937 May 12 15:09:48.303608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9a2cbeed-49d8-438c-a7a6-65b6789c2c79 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Request body: {'security_group_rule': {'security_group_id': '4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:48.325829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9a2cbeed-49d8-438c-a7a6-65b6789c2c79 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:48.385339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9a2cbeed-49d8-438c-a7a6-65b6789c2c79 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Usage tracker for resource:security_group_rule and tenant:982e4927ecc048a1a769000f4c067d06 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:48.399350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9a2cbeed-49d8-438c-a7a6-65b6789c2c79 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:48.420718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9a2cbeed-49d8-438c-a7a6-65b6789c2c79 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:48.458503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:48.466922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Usage tracker for resource:port and tenant:fd97c932be3143b1846bb48363040c63 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:48.476180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:48.493416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:48.496754 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88f73e2c-c907-45a9-beb0-74bb52b1a155 req-1b43ca68-90ac-45f2-bb49-9dc45fc6409a tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1809807 May 12 15:09:48.535895 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a2cbeed-49d8-438c-a7a6-65b6789c2c79 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:48.539119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Made reservation on behalf of fd97c932be3143b1846bb48363040c63 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:09:48.550989 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:48.773735 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a2cbeed-49d8-438c-a7a6-65b6789c2c79 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:48.786667 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a2cbeed-49d8-438c-a7a6-65b6789c2c79 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:48.829688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a2cbeed-49d8-438c-a7a6-65b6789c2c79 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fa7da43c-68d3-4d4b-9427-887bc3b7027e,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:48.850822 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:48.938762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Allocated IP 172.20.0.6 (74c45f45-b34b-4876-a35b-8ae714cf4d5f/8de7231c-cca8-4041-a1ba-b8eba5dd5861/bedffd1f-e77b-484f-b090-5d8637b7262c) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:09:48.996316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '068ccb5e-6f3b-4d6f-af59-35e722e2b8a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:09:49.008472 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a2cbeed-49d8-438c-a7a6-65b6789c2c79 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:49.013827 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9a2cbeed-49d8-438c-a7a6-65b6789c2c79 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7685013 May 12 15:09:49.019363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49906) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:49.027775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:49.038283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d634915c-5698-474c-a118-17802789749c tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Request body: {'security_group_rule': {'security_group_id': '4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:49.041612 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:49.221065 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd52b1a3-eff5-4cc0-b94c-b19468102397 req-f8ef2333-f5d0-49a2-9f34-569ac0b87b6e tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 210 time: 0.1928022 May 12 15:09:49.222771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d634915c-5698-474c-a118-17802789749c tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:49.241712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49914) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:49.260822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d634915c-5698-474c-a118-17802789749c tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Usage tracker for resource:security_group_rule and tenant:982e4927ecc048a1a769000f4c067d06 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:49.266958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Request body: {'network': {'name': 'tempest-LiveMigrationRemoteConsolesV26Test-1126932008-network', 'tenant_id': '949ac9b100544441bb63b89dc89f7d4d'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:49.270435 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:49.290507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:49.293914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d634915c-5698-474c-a118-17802789749c tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:49.295961 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:49.311059 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:49.313775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Usage tracker for resource:network and tenant:949ac9b100544441bb63b89dc89f7d4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:49.331971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:49.346363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:49.348499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3e3227c7-431d-48ce-8a34-1d616d5ac800 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:09:49.355811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d634915c-5698-474c-a118-17802789749c tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:49.376288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25863ddc-d336-40c6-8f77-319506fb3635 req-027d20a8-fa3c-4108-b61c-d8554a2e2c75 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:49.386897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25863ddc-d336-40c6-8f77-319506fb3635 req-027d20a8-fa3c-4108-b61c-d8554a2e2c75 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 0.5426762 May 12 15:09:49.387838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Made reservation on behalf of 949ac9b100544441bb63b89dc89f7d4d for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:09:49.391220 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:49.410151 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:49.431479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Network 74c45f45-b34b-4876-a35b-8ae714cf4d5f is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:09:49.432714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:49.452207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:09:49.529240 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d634915c-5698-474c-a118-17802789749c tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:49.541494 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 3e3227c7-431d-48ce-8a34-1d616d5ac800 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:09:49.551875 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 3e3227c7-431d-48ce-8a34-1d616d5ac800 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:49.552794 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:49.575771 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Pushing event updated for resources: {'Port': ['ID=bedffd1f-e77b-484f-b090-5d8637b7262c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:49.602764 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25863ddc-d336-40c6-8f77-319506fb3635 req-c3a63304-a158-4290-b678-6543c4117d8d tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2172885 May 12 15:09:49.603885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:49.638331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Usage tracker for resource:security_group_rule and tenant:949ac9b100544441bb63b89dc89f7d4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:49.656575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:49.681789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:49.682679 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:49.697996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:49.708834 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7e48864a-741e-4fa7-85b4-37961c40b806 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6101809 May 12 15:09:49.818407 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d634915c-5698-474c-a118-17802789749c tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:49.839698 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d634915c-5698-474c-a118-17802789749c tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:49.910463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d634915c-5698-474c-a118-17802789749c tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dece0fd0-ac72-49dd-8258-8db737d02046,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:49.947781 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d634915c-5698-474c-a118-17802789749c tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:49.952159 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49958) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:49.952339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d634915c-5698-474c-a118-17802789749c tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.9291003 May 12 15:09:49.958989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:49.972911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:49.982523 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:49.991906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Usage tracker for resource:floatingip and tenant:982e4927ecc048a1a769000f4c067d06 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:49.997913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:50.000374 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:50.011337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:50.015126 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:50.025338 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:50.058737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 3e3227c7-431d-48ce-8a34-1d616d5ac800, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3e3227c7-431d-48ce-8a34-1d616d5ac800,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:50.066089 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:50.067349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 317c5178-1ffb-4fde-a98e-8a9fce5e9457 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:09:50.081945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 555} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:09:50.088660 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=922a85c1-c3d5-45a8-8392-dc204bebfea2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:50.136932 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:50.137285 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Added segment 4e4d061e-bfe3-4e24-99de-51f49b9d8d72 of type vlan for network 7b11f933-4cd9-4211-acfc-bc47d040f673 May 12 15:09:50.144548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Request body: {'port': {'device_id': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:50.230906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:50.311869 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-877eea83-dd07-4d08-b51e-ef1241c81af9'] response: {'server_uuid': '068ccb5e-6f3b-4d6f-af59-35e722e2b8a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81', 'code': 200} May 12 15:09:50.330660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=3e3227c7-431d-48ce-8a34-1d616d5ac800,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:50.333017 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:50.334066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:50.334738 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:50.399530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 317c5178-1ffb-4fde-a98e-8a9fce5e9457 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:50.399895 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:50.544517 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:50.932638 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Sync routers for ids ['2efb0694-c577-4ca8-871f-c4b55760ad4a'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:09:50.947974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:50.952518 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Routers {'2efb0694-c577-4ca8-871f-c4b55760ad4a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:50.953039 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2efb0694-c577-4ca8-871f-c4b55760ad4a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:50.987744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] Pushing event updated for resources: {'Network': ['ID=7b11f933-4cd9-4211-acfc-bc47d040f673,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:51.000391 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0abbf9e6-4559-4a69-aa3b-33346a44c7ff admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.7574530 May 12 15:09:51.011578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49976) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:51.018215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 7b11f933-4cd9-4211-acfc-bc47d040f673 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:09:51.039025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Request body: {'subnet': {'network_id': '7b11f933-4cd9-4211-acfc-bc47d040f673', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveMigrationRemoteConsolesV26Test-1126932008-subnet', 'tenant_id': '949ac9b100544441bb63b89dc89f7d4d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:51.044447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:51.049824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Usage tracker for resource:subnet and tenant:949ac9b100544441bb63b89dc89f7d4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:51.053743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:51.060704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:51.090763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Made reservation on behalf of 949ac9b100544441bb63b89dc89f7d4d for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:09:51.093363 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:51.104790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3e3227c7-431d-48ce-8a34-1d616d5ac800 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:09:51.124121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e1ef5d-cf79-4946-9438-5af96bc5a480 req-b48267a6-d43d-4993-b237-1bfa22a71816 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:51.126852 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7e1ef5d-cf79-4946-9438-5af96bc5a480 req-b48267a6-d43d-4993-b237-1bfa22a71816 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 1100 time: 0.6954641 May 12 15:09:51.259742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a53ba59-62d9-4805-85e8-d82a1cd91592 req-2f27b1eb-4cd3-4783-be25-7e06da9b2594 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:51.261689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a53ba59-62d9-4805-85e8-d82a1cd91592 req-2f27b1eb-4cd3-4783-be25-7e06da9b2594 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 931 time: 0.5068188 May 12 15:09:51.301841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650037ac-3c8b-45b9-893c-5d7926f97df6 req-46090975-e309-406d-b599-931c8ae4d0b5 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:51.309909 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-650037ac-3c8b-45b9-893c-5d7926f97df6 req-46090975-e309-406d-b599-931c8ae4d0b5 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 949 time: 0.5624032 May 12 15:09:51.333336 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Set router 2efb0694-c577-4ca8-871f-c4b55760ad4a gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:51.416799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0a53ba59-62d9-4805-85e8-d82a1cd91592 req-e5593f80-0d68-42b5-a2ab-5ff94e3c21af tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Synchronizing usage tracker for tenant:fd97c932be3143b1846bb48363040c63 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:09:51.427002 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7e1ef5d-cf79-4946-9438-5af96bc5a480 req-9abf70bb-e0a5-46fb-99f4-ccb6f50c270c service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2343462 May 12 15:09:51.450423 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-650037ac-3c8b-45b9-893c-5d7926f97df6 req-e7885e6f-8848-428e-bfc0-311d95d59546 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1344972 May 12 15:09:51.545946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0a53ba59-62d9-4805-85e8-d82a1cd91592 req-e5593f80-0d68-42b5-a2ab-5ff94e3c21af tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Unset dirty status for tenant:fd97c932be3143b1846bb48363040c63 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:09:51.548497 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a53ba59-62d9-4805-85e8-d82a1cd91592 req-e5593f80-0d68-42b5-a2ab-5ff94e3c21af tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2632368 May 12 15:09:51.686997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 3e3227c7-431d-48ce-8a34-1d616d5ac800 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:51.687381 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:51.885461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Allocated IP 172.25.8.55 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/2a625bd2-a252-451f-af02-b2b448ddc430) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:09:52.041600 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:52.100263 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50'}], 'enable_snat': True}, 'gw_port_id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:43Z', 'revision_number': 4, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port': {'id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:5a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:34Z', 'updated_at': '2022-05-12T15:09:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5', 'name': '', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'mac_address': 'fa:16:3e:44:ec:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:42Z', 'updated_at': '2022-05-12T15:09:43Z', 'revision_number': 2, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'subnets': [{'id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:52.105622 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Checking router: 2efb0694-c577-4ca8-871f-c4b55760ad4a for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:09:52.106236 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Updating router 2efb0694-c577-4ca8-871f-c4b55760ad4a port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:09:52.118573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Pushing event updated for resources: {'Subnet': ['ID=fb6202cf-2b8b-49f6-8000-ae33100fb08c,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:52.178831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Checking segment: {'id': '4e4d061e-bfe3-4e24-99de-51f49b9d8d72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 555, 'network_id': '7b11f933-4cd9-4211-acfc-bc47d040f673'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:52.179548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Network hostable DHCP agents. Network: 7b11f933-4cd9-4211-acfc-bc47d040f673, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:09:52.193972 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:52.194176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4104b7e2-8b23-4678-98f4-2de80130294d req-c06b7e1f-4fd5-4cf2-9cab-90e9a251fde5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:52.201543 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4104b7e2-8b23-4678-98f4-2de80130294d req-c06b7e1f-4fd5-4cf2-9cab-90e9a251fde5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 0.3285201 May 12 15:09:52.248375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bedffd1f-e77b-484f-b090-5d8637b7262c {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:09:52.274943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Network 7b11f933-4cd9-4211-acfc-bc47d040f673 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:09:52.279508 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4104b7e2-8b23-4678-98f4-2de80130294d req-3623445c-e77e-44f6-9344-f311683b2668 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0771499 May 12 15:09:52.288731 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:52.299936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 7b11f933-4cd9-4211-acfc-bc47d040f673) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:52.305832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:52.306578 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:52.315628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-317c5e3d-b09b-4343-851f-18c83696b25d None None] Network 7b11f933-4cd9-4211-acfc-bc47d040f673 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:09:52.363386 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8e0e122b-e971-454e-b469-43e15ffcad5b admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.3299685 May 12 15:09:52.383342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Transition to ACTIVE for port object bedffd1f-e77b-484f-b090-5d8637b7262c will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:09:52.421816 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:52.511996 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:52.806738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50054) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:52.920929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Pushing event updated for resources: {'Port': ['ID=bedffd1f-e77b-484f-b090-5d8637b7262c,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:52.955735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b18649a-9ac9-405d-95e4-4759a542653a None None] Network 7b11f933-4cd9-4211-acfc-bc47d040f673 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:09:52.998047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-75aa93eb-8c70-49c5-a092-226f7e7c7eaf admin admin] Deleting subnet 8646cfd4-8f65-4837-b1bf-19c77543a345 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:09:53.018451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Attempting to bind port bedffd1f-e77b-484f-b090-5d8637b7262c on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:09:53.019184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Attempting to bind port bedffd1f-e77b-484f-b090-5d8637b7262c by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '96a7c587-eda9-40b0-aaff-97f4e1387d63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:09:53.019765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Attempting to bind port bedffd1f-e77b-484f-b090-5d8637b7262c on network 74c45f45-b34b-4876-a35b-8ae714cf4d5f {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:53.030274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Port bedffd1f-e77b-484f-b090-5d8637b7262c on network 74c45f45-b34b-4876-a35b-8ae714cf4d5f not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:09:53.030923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Attempting to bind port bedffd1f-e77b-484f-b090-5d8637b7262c on network 74c45f45-b34b-4876-a35b-8ae714cf4d5f {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:53.042508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 9, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:09:53.044195 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75aa93eb-8c70-49c5-a092-226f7e7c7eaf admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.044342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Checking segment: {'id': '96a7c587-eda9-40b0-aaff-97f4e1387d63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:53.044983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Bound using segment: {'id': '96a7c587-eda9-40b0-aaff-97f4e1387d63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:09:53.049301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Bound port: bedffd1f-e77b-484f-b090-5d8637b7262c, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '96a7c587-eda9-40b0-aaff-97f4e1387d63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:09:53.049579 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.050091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.064315 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Transition to ACTIVE for port object 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:09:53.071300 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.079881 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.125408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-153689b6-fe5c-45f6-a887-f44bdca93f8e req-3f953c7a-0692-49fc-9623-c64223c38f97 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:53.133024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-153689b6-fe5c-45f6-a887-f44bdca93f8e req-3f953c7a-0692-49fc-9623-c64223c38f97 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 949 time: 0.3990188 May 12 15:09:53.169891 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75aa93eb-8c70-49c5-a092-226f7e7c7eaf admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.243569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-153689b6-fe5c-45f6-a887-f44bdca93f8e req-39261179-029c-4036-8577-a1010a01c349 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1095529 May 12 15:09:53.286071 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-753fa336-6bee-4a35-9f74-44d053e51c23 req-d0bfd978-5ae7-497a-a7ad-cebd0ffa9499 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:53.292641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:09:53.302664 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-753fa336-6bee-4a35-9f74-44d053e51c23 req-d0bfd978-5ae7-497a-a7ad-cebd0ffa9499 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 943 time: 0.2973278 May 12 15:09:53.320429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:09:53.328458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:09:53.386020 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75aa93eb-8c70-49c5-a092-226f7e7c7eaf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.394162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] For port bedffd1f-e77b-484f-b090-5d8637b7262c, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:09:53.405463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] For port bedffd1f-e77b-484f-b090-5d8637b7262c, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bedffd1f-e77b-484f-b090-5d8637b7262c,segment=NetworkSegment(96a7c587-eda9-40b0-aaff-97f4e1387d63),segment_id=96a7c587-eda9-40b0-aaff-97f4e1387d63)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:09:53.408250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Pushing event updated for resources: {'Port': ['ID=2a625bd2-a252-451f-af02-b2b448ddc430,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:53.466055 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c805c3f-819d-4eef-9205-dabc3ba1d531 None None] Pushing event updated for resources: {'Port': ['ID=7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:53.480251 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.483445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-753fa336-6bee-4a35-9f74-44d053e51c23 req-e1cfd07c-afba-462d-944e-8a01bef723b6 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1795621 May 12 15:09:53.552223 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75aa93eb-8c70-49c5-a092-226f7e7c7eaf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.562071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:53.562984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.564990 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] 10.222.0.84 "PUT /v2.0/ports/bedffd1f-e77b-484f-b090-5d8637b7262c HTTP/1.1" status: 200 len: 1091 time: 3.8343632 May 12 15:09:53.572344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'tag': 'bedffd1f-e77b-484f-b090-5d8637b7262c'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:09:53.646479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75aa93eb-8c70-49c5-a092-226f7e7c7eaf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8646cfd4-8f65-4837-b1bf-19c77543a345,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:53.652622 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75aa93eb-8c70-49c5-a092-226f7e7c7eaf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.663128 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-75aa93eb-8c70-49c5-a092-226f7e7c7eaf admin admin] 10.222.0.82 "DELETE /v2.0/subnets/8646cfd4-8f65-4837-b1bf-19c77543a345 HTTP/1.1" status: 204 len: 168 time: 0.8553307 May 12 15:09:53.666195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50088) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:53.748392 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Attempting to bind port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:09:53.748818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7058e95-6067-42ec-a98e-0207912831fe service neutron] Pushing event updated for resources: {'Port': ['ID=bedffd1f-e77b-484f-b090-5d8637b7262c,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:53.748986 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Attempting to bind port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '5557610c-85a4-4c18-8793-b6867e2cb17c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:09:53.749344 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Attempting to bind port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 on network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:53.768092 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 9, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:09:53.771724 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Checking segment: {'id': '5557610c-85a4-4c18-8793-b6867e2cb17c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:53.772139 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.772523 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Bound using segment: {'id': '5557610c-85a4-4c18-8793-b6867e2cb17c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:09:53.772986 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Bound port: 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5557610c-85a4-4c18-8793-b6867e2cb17c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:09:53.773343 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.826891 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-50c790b2-7ff7-4437-bc4c-7f6c15d49e3c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.898664 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:53.976971 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] For port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:09:54.006209 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] For port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5,segment=NetworkSegment(5557610c-85a4-4c18-8793-b6867e2cb17c),segment_id=5557610c-85a4-4c18-8793-b6867e2cb17c)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:09:54.011418 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:54.107751 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c805c3f-819d-4eef-9205-dabc3ba1d531 None None] Pushing event updated for resources: {'Port': ['ID=7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:54.111775 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Routers {'2efb0694-c577-4ca8-871f-c4b55760ad4a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:09:54.112628 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2efb0694-c577-4ca8-871f-c4b55760ad4a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:54.118823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7128b8cb-87c6-4592-b9b2-4133c343ff51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:54.120310 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-7128b8cb-87c6-4592-b9b2-4133c343ff51 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fd97c932be3143b1846bb48363040c63&device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 1094 time: 0.4584837 May 12 15:09:54.124496 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:54.229794 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-50c790b2-7ff7-4437-bc4c-7f6c15d49e3c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:54.335500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-50c790b2-7ff7-4437-bc4c-7f6c15d49e3c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['22b5d9f0-3270-4d1d-9d0f-8719ed790190']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:54.379114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-50c790b2-7ff7-4437-bc4c-7f6c15d49e3c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7c475e35-2952-43f2-911d-559ab33d0a9f') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:54.385047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-50c790b2-7ff7-4437-bc4c-7f6c15d49e3c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7c475e35-2952-43f2-911d-559ab33d0a9f') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:54.394495 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-50c790b2-7ff7-4437-bc4c-7f6c15d49e3c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:54.619109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93cb1fef-81bc-47a4-9807-63f6c6d54960 req-b5eabffd-1ee3-4454-b5f5-e7b3f9a03ece tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:54.628866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93cb1fef-81bc-47a4-9807-63f6c6d54960 req-b5eabffd-1ee3-4454-b5f5-e7b3f9a03ece tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 0.6054847 May 12 15:09:54.635166 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-a61d4f73-d4a5-4354-b38a-4226d2954760 service neutron] show failed (client error): The resource could not be found. May 12 15:09:54.636161 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-a61d4f73-d4a5-4354-b38a-4226d2954760 service neutron] 10.222.0.84 "GET /v2.0/ports/a686f1c4-b2f1-4692-950a-b2a71f6aeb6f/bindings/n-h2-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.8307288 May 12 15:09:54.638969 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] Set router 2efb0694-c577-4ca8-871f-c4b55760ad4a gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:09:54.644445 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1e6e0692-f9aa-4199-8b83-03e5cf05037d'] response: {'name': 'network-changed', 'server_uuid': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'tag': 'bedffd1f-e77b-484f-b090-5d8637b7262c', 'status': 'completed', 'code': 200} May 12 15:09:54.740581 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-50c790b2-7ff7-4437-bc4c-7f6c15d49e3c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:54.751086 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-ad33349b-1102-4ffd-9d9a-bbf3a3a4181e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bedffd1f-e77b-484f-b090-5d8637b7262c HTTP/1.1" status: 200 len: 217 time: 0.1131930 May 12 15:09:54.774386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-50c790b2-7ff7-4437-bc4c-7f6c15d49e3c admin admin] Releasing vlan 586 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:09:54.775150 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-50c790b2-7ff7-4437-bc4c-7f6c15d49e3c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: timer() May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:09:54.804911 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:09:54.812872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50132) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:54.890755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-34f09d36-ccf9-4b8f-be79-e1352e80ad40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:54.892383 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-34f09d36-ccf9-4b8f-be79-e1352e80ad40 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8de7231c-cca8-4041-a1ba-b8eba5dd5861 HTTP/1.1" status: 200 len: 860 time: 0.1233330 May 12 15:09:54.912553 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93cb1fef-81bc-47a4-9807-63f6c6d54960 req-ce27f23e-2daa-4b92-8baa-0b870379d4d1 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2827287 May 12 15:09:54.973990 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-69f6297f-cd9b-475b-bc6d-7d426c6cb599 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=74c45f45-b34b-4876-a35b-8ae714cf4d5f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0713809 May 12 15:09:54.976494 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:55.060586 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:55.081370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04d8b28-5bd3-426a-a173-a832f4fbfa30 req-f91da099-1f11-4192-91f3-1f805bc16ab9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:55.082896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b04d8b28-5bd3-426a-a173-a832f4fbfa30 req-f91da099-1f11-4192-91f3-1f805bc16ab9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.76 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 945 time: 0.5158947 May 12 15:09:55.091574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2473a7b6-8d48-40fd-a7f8-ab80683f34af req-cd225cc6-b96d-4fb1-9ed7-3df33aed5f55 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:55.110948 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2473a7b6-8d48-40fd-a7f8-ab80683f34af req-cd225cc6-b96d-4fb1-9ed7-3df33aed5f55 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=c16773f3-58ee-4af2-a29d-d343b8561a31 HTTP/1.1" status: 200 len: 945 time: 0.4997342 May 12 15:09:55.132857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:09:55.141318 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-50c790b2-7ff7-4437-bc4c-7f6c15d49e3c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:55.179935 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50'}], 'enable_snat': True}, 'gw_port_id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:43Z', 'revision_number': 4, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port': {'id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:5a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:34Z', 'updated_at': '2022-05-12T15:09:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5', 'name': '', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'mac_address': 'fa:16:3e:44:ec:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:42Z', 'updated_at': '2022-05-12T15:09:53Z', 'revision_number': 4, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'subnets': [{'id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:55.184512 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6924245b-cb54-44a2-b9be-42db5f8580fe None None] The sync data for ids ['2efb0694-c577-4ca8-871f-c4b55760ad4a'] in n-d-841483-1 is: [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50'}], 'enable_snat': True}, 'gw_port_id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:43Z', 'revision_number': 4, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port': {'id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:5a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:34Z', 'updated_at': '2022-05-12T15:09:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5', 'name': '', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'mac_address': 'fa:16:3e:44:ec:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:42Z', 'updated_at': '2022-05-12T15:09:53Z', 'revision_number': 4, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'subnets': [{'id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:09:55.243624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:09:55.247482 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-50c790b2-7ff7-4437-bc4c-7f6c15d49e3c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:55.252129 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:55.252723 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:55.265457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Pushing event updated for resources: {'Port': ['ID=2a625bd2-a252-451f-af02-b2b448ddc430,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:55.316282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-b04d8b28-5bd3-426a-a173-a832f4fbfa30 req-1b944d4e-da9e-4404-ac4c-f84a08568e05 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Deleting port 8a33daa6-587f-4787-befb-2fa6e1051f2c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:09:55.316666 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b04d8b28-5bd3-426a-a173-a832f4fbfa30 req-1b944d4e-da9e-4404-ac4c-f84a08568e05 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:55.384715 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a2b880e-5235-4135-bc83-bb5f9678dbc0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:55.397103 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:55.416716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a2b880e-5235-4135-bc83-bb5f9678dbc0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:55.420458 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:55.421655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0a2b880e-5235-4135-bc83-bb5f9678dbc0 admin admin] Usage tracker for resource:security_group_rule and tenant:e2d378318e6d4c878aa02739dfc033bc is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:55.425136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0a2b880e-5235-4135-bc83-bb5f9678dbc0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:55.433063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a2b880e-5235-4135-bc83-bb5f9678dbc0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:55.437397 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-6bb1ec1e-f520-4055-a485-4458c129fe0e service neutron] 10.222.0.84 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4537086 May 12 15:09:55.442672 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:55.445811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50c790b2-7ff7-4437-bc4c-7f6c15d49e3c admin admin] Pushing event deleted for resources: {'Network': ['ID=22b5d9f0-3270-4d1d-9d0f-8719ed790190,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:55.454500 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0f3cf059-c7d1-4ee7-8792-246041932903 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 5.5002198 May 12 15:09:55.474672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5,segment=NetworkSegment(5557610c-85a4-4c18-8793-b6867e2cb17c),segment_id=5557610c-85a4-4c18-8793-b6867e2cb17c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:55.481263 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:55.504270 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2473a7b6-8d48-40fd-a7f8-ab80683f34af req-f351b11a-67bb-4678-8080-e15e5ce464ac tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3920996 May 12 15:09:55.508392 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-50c790b2-7ff7-4437-bc4c-7f6c15d49e3c admin admin] 10.222.0.82 "DELETE /v2.0/networks/22b5d9f0-3270-4d1d-9d0f-8719ed790190 HTTP/1.1" status: 204 len: 168 time: 1.8410900 May 12 15:09:55.509438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50140) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:55.606561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-f9e8a0bc-c7c8-431e-8a4a-40ca0ec50aee admin admin] Deleting subnet fb6202cf-2b8b-49f6-8000-ae33100fb08c {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:09:55.616776 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:55.634958 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9e8a0bc-c7c8-431e-8a4a-40ca0ec50aee admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:55.724633 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f6311dc9-6961-4e4c-946e-6370cca63d35 req-62d1398b-1a50-4b58-9c2e-15c39e7ee6e9 service neutron] 10.222.0.84 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2687132 May 12 15:09:55.730722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-4fc2c9a8-0f29-4519-bb39-4f25b1bf3b59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:55.732175 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-4fc2c9a8-0f29-4519-bb39-4f25b1bf3b59 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58&tenant_id=0da54985cde346e68eeadf965b8bc6d3 HTTP/1.1" status: 200 len: 1100 time: 0.7910383 May 12 15:09:55.766813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Request body: {'port': {'binding:host_id': 'n-h2-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:55.807527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a80b003-311f-41f8-8afa-e02cbc42b3fe req-0b68cd2e-8e5b-4697-9aa7-5d3ee430580a tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:55.809837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a80b003-311f-41f8-8afa-e02cbc42b3fe req-0b68cd2e-8e5b-4697-9aa7-5d3ee430580a tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 949 time: 0.6186869 May 12 15:09:55.833613 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9e8a0bc-c7c8-431e-8a4a-40ca0ec50aee admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:55.965125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb36b49f-8e8b-4d8b-9296-51f7d9416d66 req-f680fa37-5fd2-493a-b3a7-e8663d0b5115 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:55.968072 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fb36b49f-8e8b-4d8b-9296-51f7d9416d66 req-f680fa37-5fd2-493a-b3a7-e8663d0b5115 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fd97c932be3143b1846bb48363040c63&device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 1094 time: 0.1086493 May 12 15:09:56.053666 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a80b003-311f-41f8-8afa-e02cbc42b3fe req-f1b2cc46-426c-4bdb-b8a5-07b6586dfbf1 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2233753 May 12 15:09:56.070954 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a2b880e-5235-4135-bc83-bb5f9678dbc0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:56.147235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb36b49f-8e8b-4d8b-9296-51f7d9416d66 req-4aa75bc1-dc94-4f87-a3c1-ba1938b874ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:56.148688 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fb36b49f-8e8b-4d8b-9296-51f7d9416d66 req-4aa75bc1-dc94-4f87-a3c1-ba1938b874ba service neutron] 10.222.0.84 "GET /v2.0/networks?id=74c45f45-b34b-4876-a35b-8ae714cf4d5f HTTP/1.1" status: 200 len: 921 time: 0.1722507 May 12 15:09:56.162783 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9e8a0bc-c7c8-431e-8a4a-40ca0ec50aee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:56.199504 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a2b880e-5235-4135-bc83-bb5f9678dbc0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:56.223723 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fb36b49f-8e8b-4d8b-9296-51f7d9416d66 req-fa51eebb-7229-4bd3-9f70-5cb78b6baeca service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bedffd1f-e77b-484f-b090-5d8637b7262c HTTP/1.1" status: 200 len: 217 time: 0.0660684 May 12 15:09:56.280094 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:56.292896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb36b49f-8e8b-4d8b-9296-51f7d9416d66 req-cbbfd91a-2913-4708-9bdd-04fc84227f09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:56.294097 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fb36b49f-8e8b-4d8b-9296-51f7d9416d66 req-cbbfd91a-2913-4708-9bdd-04fc84227f09 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8de7231c-cca8-4041-a1ba-b8eba5dd5861 HTTP/1.1" status: 200 len: 860 time: 0.0636978 May 12 15:09:56.344337 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fb36b49f-8e8b-4d8b-9296-51f7d9416d66 req-ba712bf3-b2a1-4984-b48b-a54ce0035b9b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=74c45f45-b34b-4876-a35b-8ae714cf4d5f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0436606 May 12 15:09:56.435355 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0a2b880e-5235-4135-bc83-bb5f9678dbc0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e2d378318e6d4c878aa02739dfc033bc&name=default HTTP/1.1" status: 200 len: 2979 time: 1.6116450 May 12 15:09:56.436656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a2b880e-5235-4135-bc83-bb5f9678dbc0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=405ccf3a-e4af-4fc9-9385-16e27188d128,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:56.439279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50196) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:56.460135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-b04d8b28-5bd3-426a-a173-a832f4fbfa30 req-1b944d4e-da9e-4404-ac4c-f84a08568e05 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] For port 8a33daa6-587f-4787-befb-2fa6e1051f2c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8a33daa6-587f-4787-befb-2fa6e1051f2c,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:56.460489 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b04d8b28-5bd3-426a-a173-a832f4fbfa30 req-1b944d4e-da9e-4404-ac4c-f84a08568e05 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:56.489354 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fb36b49f-8e8b-4d8b-9296-51f7d9416d66 req-afb56343-6aa3-4fba-8fe5-242e1cddee99 service neutron] 10.222.0.84 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1347764 May 12 15:09:56.492059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-48cc3790-a8b2-497a-8baf-a9a65c3374af tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Synchronizing usage tracker for tenant:982e4927ecc048a1a769000f4c067d06 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:09:56.628626 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fb36b49f-8e8b-4d8b-9296-51f7d9416d66 req-8335ac48-a2f8-4d8d-96b7-0a33ac1ab6d9 service neutron] 10.222.0.84 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1320486 May 12 15:09:56.736967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-b04d8b28-5bd3-426a-a173-a832f4fbfa30 req-1b944d4e-da9e-4404-ac4c-f84a08568e05 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Calling delete_port for 8a33daa6-587f-4787-befb-2fa6e1051f2c owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:09:56.881440 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9e8a0bc-c7c8-431e-8a4a-40ca0ec50aee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:56.929920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-48cc3790-a8b2-497a-8baf-a9a65c3374af tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Unset dirty status for tenant:982e4927ecc048a1a769000f4c067d06 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:09:56.931072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-48cc3790-a8b2-497a-8baf-a9a65c3374af tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--835046634&fields=id&tenant_id=982e4927ecc048a1a769000f4c067d06 HTTP/1.1" status: 200 len: 267 time: 0.6867597 May 12 15:09:56.956868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa69013e-ffc2-4e75-a029-b2ad2a8e2c7c req-2f4e6739-98f0-40a6-a6ba-92790111b71f tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:56.958225 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa69013e-ffc2-4e75-a029-b2ad2a8e2c7c req-2f4e6739-98f0-40a6-a6ba-92790111b71f tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 943 time: 0.7680247 May 12 15:09:56.960350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9e8a0bc-c7c8-431e-8a4a-40ca0ec50aee admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fb6202cf-2b8b-49f6-8000-ae33100fb08c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:57.024165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:09:57.036524 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9e8a0bc-c7c8-431e-8a4a-40ca0ec50aee admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.092988 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:09:57.093354 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.152172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a686f1c4-b2f1-4692-950a-b2a71f6aeb6f no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:57.171689 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1cc8498c-e259-41f8-89ca-cb5a38c9587f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.226099 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f9e8a0bc-c7c8-431e-8a4a-40ca0ec50aee admin admin] 10.222.0.82 "DELETE /v2.0/subnets/fb6202cf-2b8b-49f6-8000-ae33100fb08c HTTP/1.1" status: 204 len: 168 time: 1.7088528 May 12 15:09:57.226811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50202) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:57.285311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa69013e-ffc2-4e75-a029-b2ad2a8e2c7c req-f80f4887-3023-44cf-8291-6324cbef70b3 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2877936 May 12 15:09:57.355706 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1cc8498c-e259-41f8-89ca-cb5a38c9587f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.368830 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.427705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-700475af-6d11-435e-bf56-3e616b546c9e tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:57.428330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-700475af-6d11-435e-bf56-3e616b546c9e tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Synchronizing usage tracker for tenant:982e4927ecc048a1a769000f4c067d06 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:09:57.452887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:57.482515 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2abfd930-83f1-4e69-bf77-bbc44fc66382 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.512109 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b04d8b28-5bd3-426a-a173-a832f4fbfa30 req-1b944d4e-da9e-4404-ac4c-f84a08568e05 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.524284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['8a33daa6-587f-4787-befb-2fa6e1051f2c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:09:57.580847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-700475af-6d11-435e-bf56-3e616b546c9e tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Unset dirty status for tenant:982e4927ecc048a1a769000f4c067d06 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:09:57.582024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-700475af-6d11-435e-bf56-3e616b546c9e tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/networks?id=e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 HTTP/1.1" status: 200 len: 806 time: 0.6355472 May 12 15:09:57.590971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b944d4e-da9e-4404-ac4c-f84a08568e05 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Pushing event deleted for resources: {'Port': ['ID=8a33daa6-587f-4787-befb-2fa6e1051f2c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:57.609050 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2abfd930-83f1-4e69-bf77-bbc44fc66382 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.636890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-2abfd930-83f1-4e69-bf77-bbc44fc66382 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7b11f933-4cd9-4211-acfc-bc47d040f673']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:57.651700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-2abfd930-83f1-4e69-bf77-bbc44fc66382 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4e4d061e-bfe3-4e24-99de-51f49b9d8d72') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:57.651979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-2abfd930-83f1-4e69-bf77-bbc44fc66382 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4e4d061e-bfe3-4e24-99de-51f49b9d8d72') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:09:57.664667 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2abfd930-83f1-4e69-bf77-bbc44fc66382 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.681134 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2abfd930-83f1-4e69-bf77-bbc44fc66382 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.687375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2abfd930-83f1-4e69-bf77-bbc44fc66382 admin admin] Releasing vlan 555 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:09:57.687782 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2abfd930-83f1-4e69-bf77-bbc44fc66382 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.698771 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-05fa9d27-ef86-48aa-9329-dab6f57fb025 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/quotas/982e4927ecc048a1a769000f4c067d06 HTTP/1.1" status: 200 len: 375 time: 0.1027212 May 12 15:09:57.699345 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1cc8498c-e259-41f8-89ca-cb5a38c9587f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: timer() May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:09:57.702167 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:09:57.725041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-b04d8b28-5bd3-426a-a173-a832f4fbfa30 req-1b944d4e-da9e-4404-ac4c-f84a08568e05 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] No DVR routers for this DVR port 8a33daa6-587f-4787-befb-2fa6e1051f2c on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:09:57.728325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:09:57.784038 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2abfd930-83f1-4e69-bf77-bbc44fc66382 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.800764 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2abfd930-83f1-4e69-bf77-bbc44fc66382 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.802966 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b04d8b28-5bd3-426a-a173-a832f4fbfa30 req-1b944d4e-da9e-4404-ac4c-f84a08568e05 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.805945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c16773f3-58ee-4af2-a29d-d343b8561a31', 'name': 'network-vif-deleted', 'tag': '8a33daa6-587f-4787-befb-2fa6e1051f2c'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:09:57.810404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cc8498c-e259-41f8-89ca-cb5a38c9587f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=405ccf3a-e4af-4fc9-9385-16e27188d128,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:57.810735 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2abfd930-83f1-4e69-bf77-bbc44fc66382 admin admin] 10.222.0.82 "DELETE /v2.0/networks/7b11f933-4cd9-4211-acfc-bc47d040f673 HTTP/1.1" status: 204 len: 168 time: 0.5828025 May 12 15:09:57.811579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2abfd930-83f1-4e69-bf77-bbc44fc66382 admin admin] Pushing event deleted for resources: {'Network': ['ID=7b11f933-4cd9-4211-acfc-bc47d040f673,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:57.874365 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa667c99-4b76-407d-ab87-ca507d26d299 req-6a61e661-38fb-49e1-b33e-b8f436601aac tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:57.876383 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa667c99-4b76-407d-ab87-ca507d26d299 req-6a61e661-38fb-49e1-b33e-b8f436601aac tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 0.4295409 May 12 15:09:57.885602 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1cc8498c-e259-41f8-89ca-cb5a38c9587f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.886942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1cc8498c-e259-41f8-89ca-cb5a38c9587f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/405ccf3a-e4af-4fc9-9385-16e27188d128 HTTP/1.1" status: 204 len: 168 time: 1.4331522 May 12 15:09:57.888433 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b04d8b28-5bd3-426a-a173-a832f4fbfa30 req-1b944d4e-da9e-4404-ac4c-f84a08568e05 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.76 "DELETE /v2.0/ports/8a33daa6-587f-4787-befb-2fa6e1051f2c HTTP/1.1" status: 204 len: 173 time: 2.7432368 May 12 15:09:57.911993 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:57.952153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Transition to ACTIVE for port object a686f1c4-b2f1-4692-950a-b2a71f6aeb6f will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:09:57.961509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50212) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:57.971214 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa667c99-4b76-407d-ab87-ca507d26d299 req-0397abb6-9d2b-47c6-ad4f-816072fd7645 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0817535 May 12 15:09:57.976861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:58.045676 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-66b98fe3-f421-48d9-98f8-0e6dbaa01252 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=efc138ce233d4d88a27b2f15a41f3cd5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0828273 May 12 15:09:58.048969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50220) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:58.119147 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:09:58.119714 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:09:58.149653 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8deb87f3-8282-4063-bc6f-21a0d5b8f53b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:58.187863 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-9daa33fe-c463-4093-968d-93c9dc864b4e tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=982e4927ecc048a1a769000f4c067d06&fields=id HTTP/1.1" status: 200 len: 348 time: 0.4662638 May 12 15:09:58.214550 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8deb87f3-8282-4063-bc6f-21a0d5b8f53b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:58.285170 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8deb87f3-8282-4063-bc6f-21a0d5b8f53b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:58.316768 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8deb87f3-8282-4063-bc6f-21a0d5b8f53b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:58.322216 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8deb87f3-8282-4063-bc6f-21a0d5b8f53b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a9192705-dd0c-4a49-94b7-298b628dfca3 HTTP/1.1" status: 204 len: 168 time: 0.2721524 May 12 15:09:58.323589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8deb87f3-8282-4063-bc6f-21a0d5b8f53b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9192705-dd0c-4a49-94b7-298b628dfca3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:58.455937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] No DVR routers for this DVR port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:09:58.468824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Pushing event updated for resources: {'Port': ['ID=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,revision_number=6']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:58.587327 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-b3829ece-111a-42d3-88a7-7546f1adc029 service neutron] 10.222.0.82 "GET /v2.0/networks/e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3500218 May 12 15:09:58.588252 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Attempting to bind port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:09:58.588517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Attempting to bind port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:09:58.588837 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Attempting to bind port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:58.596710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:09:58.597000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Attempting to bind port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:09:58.606348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 9, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:09:58.606784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:09:58.607282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:09:58.608164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Bound port: a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:09:58.608938 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:58.882148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50278) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:58.936670 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a1075ca4-618a-4b6a-b9f0-ab2302c41a3e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=949ac9b100544441bb63b89dc89f7d4d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0510614 May 12 15:09:58.936902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50282) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:59.010240 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2d71bc7-0bf2-403f-9a13-9bb178e7b614 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:59.042687 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2d71bc7-0bf2-403f-9a13-9bb178e7b614 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:59.052567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-2181de9b-7357-4ca9-b229-14fbaa58b30e service neutron] 10.222.0.82 "GET /v2.0/networks/e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4056714 May 12 15:09:59.053943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:09:59.057704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:09:59.065965 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:59.147198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:59.148324 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:59.150416 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] 10.222.0.76 "PUT /v2.0/ports/a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 200 len: 1095 time: 3.3912532 May 12 15:09:59.152208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bedffd1f-e77b-484f-b090-5d8637b7262c details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:09:59.154575 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2d71bc7-0bf2-403f-9a13-9bb178e7b614 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:59.193831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d71bc7-0bf2-403f-9a13-9bb178e7b614 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=922a85c1-c3d5-45a8-8392-dc204bebfea2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:59.195944 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2d71bc7-0bf2-403f-9a13-9bb178e7b614 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:59.197097 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f2d71bc7-0bf2-403f-9a13-9bb178e7b614 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/922a85c1-c3d5-45a8-8392-dc204bebfea2 HTTP/1.1" status: 204 len: 168 time: 0.2592893 May 12 15:09:59.231601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b468492-a399-4d1f-8f38-d29bc11cbb7f service neutron] Pushing event updated for resources: {'Port': ['ID=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:09:59.429148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50300) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:09:59.467064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1725c2a8-f041-4cb9-bc8e-69e285c4d56b req-3bd042f8-13e9-4542-a21d-efda68f61d31 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:59.468741 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1725c2a8-f041-4cb9-bc8e-69e285c4d56b req-3bd042f8-13e9-4542-a21d-efda68f61d31 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 1100 time: 0.2434709 May 12 15:09:59.477598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-bccd99c6-da85-49c0-a603-948d9473b01f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:59.478860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-bccd99c6-da85-49c0-a603-948d9473b01f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 1098 time: 0.2907279 May 12 15:09:59.499854 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1725c2a8-f041-4cb9-bc8e-69e285c4d56b req-0e52322c-bea5-4b55-800d-3aad7266de0e tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:59.545642 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c5e7b2c2-b801-4a87-be68-bc5b3de1ae99'] response: {'server_uuid': 'c16773f3-58ee-4af2-a29d-d343b8561a31', 'name': 'network-vif-deleted', 'tag': '8a33daa6-587f-4787-befb-2fa6e1051f2c', 'status': 'completed', 'code': 200} May 12 15:09:59.597558 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port bedffd1f-e77b-484f-b090-5d8637b7262c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bedffd1f-e77b-484f-b090-5d8637b7262c,segment=NetworkSegment(96a7c587-eda9-40b0-aaff-97f4e1387d63),segment_id=96a7c587-eda9-40b0-aaff-97f4e1387d63)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:59.608977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-1725c2a8-f041-4cb9-bc8e-69e285c4d56b req-0e52322c-bea5-4b55-800d-3aad7266de0e tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:59.629029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1725c2a8-f041-4cb9-bc8e-69e285c4d56b req-0e52322c-bea5-4b55-800d-3aad7266de0e tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Usage tracker for resource:security_group_rule and tenant:9a79f1afc97d454587f70a609af0a887 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:59.634434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1725c2a8-f041-4cb9-bc8e-69e285c4d56b req-0e52322c-bea5-4b55-800d-3aad7266de0e tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:59.645832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-1725c2a8-f041-4cb9-bc8e-69e285c4d56b req-0e52322c-bea5-4b55-800d-3aad7266de0e tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:59.646563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'bedffd1f-e77b-484f-b090-5d8637b7262c', 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'port_id': 'bedffd1f-e77b-484f-b090-5d8637b7262c', 'mac_address': 'fa:16:3e:7c:1d:05', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 580, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:09:59.725919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-11cd9c91-f9e3-42b7-b45f-706a2d96107f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:09:59.728389 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-11cd9c91-f9e3-42b7-b45f-706a2d96107f service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.2341406 May 12 15:09:59.748566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 8a33daa6-587f-4787-befb-2fa6e1051f2c no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:09:59.810357 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 8a33daa6-587f-4787-befb-2fa6e1051f2c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:09:59.810908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 8a33daa6-587f-4787-befb-2fa6e1051f2c not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:09:59.824460 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:59.836540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Request body: {'network': {'name': 'tempest-FloatingIPDetailsTestJSON-1923857176-network', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:09:59.845969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:59.856672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bedffd1f-e77b-484f-b090-5d8637b7262c {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:09:59.859018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Usage tracker for resource:network and tenant:d914960d703a44ae913f9a1804d5b368 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:59.867355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:59.877585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:59.882985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port bedffd1f-e77b-484f-b090-5d8637b7262c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bedffd1f-e77b-484f-b090-5d8637b7262c,segment=NetworkSegment(96a7c587-eda9-40b0-aaff-97f4e1387d63),segment_id=96a7c587-eda9-40b0-aaff-97f4e1387d63)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:09:59.893409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Made reservation on behalf of d914960d703a44ae913f9a1804d5b368 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:09:59.896036 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:59.896994 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:59.916979 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:09:59.936428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:09:59.942382 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Usage tracker for resource:security_group_rule and tenant:d914960d703a44ae913f9a1804d5b368 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:09:59.946586 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-6bb1dee5-9173-4a53-bbac-2ec2de3c0415 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.52&port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 200 len: 217 time: 0.1661329 May 12 15:09:59.947162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:09:59.956011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:09:59.983241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=bedffd1f-e77b-484f-b090-5d8637b7262c,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:00.060816 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:00.068536 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:00.095342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-5160a20b-68c0-4281-92e2-cd2fc20dc9ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:00.096892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-5160a20b-68c0-4281-92e2-cd2fc20dc9ce service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1323111 May 12 15:10:00.108751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 596} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:10:00.112251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cbba302-0eda-4ad8-9b89-7ff15d3c1efc req-d12bf2de-7b59-4ed0-a2bc-ea498235e399 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:00.113837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9cbba302-0eda-4ad8-9b89-7ff15d3c1efc req-d12bf2de-7b59-4ed0-a2bc-ea498235e399 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 943 time: 0.3848441 May 12 15:10:00.124147 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b804ef2-2980-4432-9f6e-bc8c33849aac,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:00.130458 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:00.130966 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Added segment 7d065a97-a552-4415-a638-f68219b3bad1 of type vlan for network 7869b0da-59f4-4b95-80b3-2cee1e2f3494 May 12 15:10:00.153929 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1725c2a8-f041-4cb9-bc8e-69e285c4d56b req-0e52322c-bea5-4b55-800d-3aad7266de0e tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:00.178093 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1725c2a8-f041-4cb9-bc8e-69e285c4d56b req-0e52322c-bea5-4b55-800d-3aad7266de0e tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:00.180470 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:00.244597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['bedffd1f-e77b-484f-b090-5d8637b7262c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:00.245121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1725c2a8-f041-4cb9-bc8e-69e285c4d56b req-0e52322c-bea5-4b55-800d-3aad7266de0e tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7648776 May 12 15:10:00.252231 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:00.253658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:00.254327 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:00.291735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e52322c-bea5-4b55-800d-3aad7266de0e tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47a56ceb-f079-40c2-a7e3-380b93fe504b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:00.310262 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9cbba302-0eda-4ad8-9b89-7ff15d3c1efc req-bd38b9bb-bfb4-4f00-bf7b-cc13298df8e5 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1587455 May 12 15:10:00.380657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-8c8a988b-c0e2-40ce-b2c7-2c6dcb8d4fae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:00.382165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-8c8a988b-c0e2-40ce-b2c7-2c6dcb8d4fae service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2646468 May 12 15:10:00.588334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] Pushing event updated for resources: {'Network': ['ID=7869b0da-59f4-4b95-80b3-2cee1e2f3494,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:00.623659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 7869b0da-59f4-4b95-80b3-2cee1e2f3494 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:10:00.625111 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6e623056-1384-4bd0-8ae9-0f87b3c1baac admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 1.1943145 May 12 15:10:00.626381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50344) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:00.629271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c91e9a05-626c-4574-b5c6-79313f0ed73a req-06d00dba-2d09-4faa-b2db-7e66ed3e47d2 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 210 time: 0.1009827 May 12 15:10:00.649706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Request body: {'subnet': {'network_id': '7869b0da-59f4-4b95-80b3-2cee1e2f3494', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPDetailsTestJSON-1923857176-subnet', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:00.669288 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:00.678708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Usage tracker for resource:subnet and tenant:d914960d703a44ae913f9a1804d5b368 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:00.683725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:00.699012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:00.727126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Made reservation on behalf of d914960d703a44ae913f9a1804d5b368 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:00.729925 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:00.767722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e154f0-d3ff-4dbf-87e3-0713989ea257 req-d2a14df1-1f82-4fb1-ae4e-dddd482ef3d2 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:00.769243 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10e154f0-d3ff-4dbf-87e3-0713989ea257 req-d2a14df1-1f82-4fb1-ae4e-dddd482ef3d2 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 947 time: 0.1387475 May 12 15:10:00.810754 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-1b37559a-9f09-42d0-a5b0-8bc12fa25bb7 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4086790 May 12 15:10:00.841291 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10e154f0-d3ff-4dbf-87e3-0713989ea257 req-dd783ed1-10e0-42b5-a121-2fd2ff4e8d44 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602064 May 12 15:10:01.022911 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01ece37a-1c7c-4834-9fb0-46a1c7e6b440 req-350e2641-7086-4fc5-851e-84181789d728 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1923232 May 12 15:10:01.219485 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:01.369806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Pushing event updated for resources: {'Subnet': ['ID=55f11913-d2d9-4fda-86a7-3a4470347229,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:01.378495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Checking segment: {'id': '7d065a97-a552-4415-a638-f68219b3bad1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '7869b0da-59f4-4b95-80b3-2cee1e2f3494'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:01.378855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Network hostable DHCP agents. Network: 7869b0da-59f4-4b95-80b3-2cee1e2f3494, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:10:01.420372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Network 7869b0da-59f4-4b95-80b3-2cee1e2f3494 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:10:01.465494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 7869b0da-59f4-4b95-80b3-2cee1e2f3494) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:01.474928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:01.476072 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:01.488423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b676591e-4f66-4c82-bade-6dfe83d0e230 None None] Network 7869b0da-59f4-4b95-80b3-2cee1e2f3494 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:10:01.526350 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e3c1ccee-a85a-4bc1-aad0-9a7f8185d6ed admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.8969233 May 12 15:10:01.529157 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50394) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:01.533768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f1a076d-298c-43ba-b7f8-0ab0079a0969 req-51ee0cc8-76db-4f52-a922-f4bb1e893746 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:01.534500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0f1a076d-298c-43ba-b7f8-0ab0079a0969 req-51ee0cc8-76db-4f52-a922-f4bb1e893746 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Synchronizing usage tracker for tenant:1b3825228b0e4c42a381540b66ea23d6 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:01.539250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Request body: {'router': {'name': 'tempest-FloatingIPDetailsTestJSON-1923857176-router', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:01.553001 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f'}, {'name': 'network-changed', 'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:01.553232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:01.563574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Usage tracker for resource:router and tenant:d914960d703a44ae913f9a1804d5b368 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:01.572853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:01.577141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-39faedae-da3d-43ec-87f6-c79347dd4024 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:01.579743 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-39faedae-da3d-43ec-87f6-c79347dd4024 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.76 "GET /v2.0/networks?id=e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 HTTP/1.1" status: 200 len: 806 time: 0.2352374 May 12 15:10:01.591350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:01.613047 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:01.613302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0f1a076d-298c-43ba-b7f8-0ab0079a0969 req-51ee0cc8-76db-4f52-a922-f4bb1e893746 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Unset dirty status for tenant:1b3825228b0e4c42a381540b66ea23d6 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:01.613858 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0f1a076d-298c-43ba-b7f8-0ab0079a0969 req-51ee0cc8-76db-4f52-a922-f4bb1e893746 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 944 time: 0.3651030 May 12 15:10:01.618056 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:01.648878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:01.839855 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-42a0dc2a-981c-4caf-aa91-c9b1318d5d3b tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=982e4927ecc048a1a769000f4c067d06 HTTP/1.1" status: 200 len: 379 time: 0.2250698 May 12 15:10:01.855838 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0f1a076d-298c-43ba-b7f8-0ab0079a0969 req-dc9d41ae-fb57-42b5-9f9e-dd1fc8c61080 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2230759 May 12 15:10:01.876363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Request body: {'port': {'device_id': '74ddf043-2cb7-4286-b010-6509b25bb4aa', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'admin_state_up': True, 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'security_groups': ['4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:01.951113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-7869b0da-59f4-4b95-80b3-2cee1e2f3494', 'network_id': '7869b0da-59f4-4b95-80b3-2cee1e2f3494', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'fixed_ips': [{'subnet_id': '55f11913-d2d9-4fda-86a7-3a4470347229'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:10:01.955867 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:02.094901 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-66afdcef-eafa-46c9-bee9-18ad01f2328c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0544386 May 12 15:10:02.133109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:02.133425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa40ed68-d996-49db-a286-233afb756c7a req-b3d929d6-ee39-4f46-bc70-62718573536b tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:02.135409 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa40ed68-d996-49db-a286-233afb756c7a req-b3d929d6-ee39-4f46-bc70-62718573536b tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.76 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 944 time: 0.5545440 May 12 15:10:02.136286 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:02.234682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:02.244975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Allocated IP 172.20.0.2 (7869b0da-59f4-4b95-80b3-2cee1e2f3494/55f11913-d2d9-4fda-86a7-3a4470347229/288de558-83a5-4339-86db-baf8307134b8) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:02.375050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Usage tracker for resource:port and tenant:982e4927ecc048a1a769000f4c067d06 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:02.383129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-fa40ed68-d996-49db-a286-233afb756c7a req-7731bdcc-2435-4154-8af8-242790186637 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Deleting port 41e26787-6db6-4aed-9809-d91a746dcee9 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:10:02.383800 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fa40ed68-d996-49db-a286-233afb756c7a req-7731bdcc-2435-4154-8af8-242790186637 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:02.421159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:02.447327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:02.491507 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:02.504355 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Transition to ACTIVE for port object 288de558-83a5-4339-86db-baf8307134b8 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:02.524764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Transition to ACTIVE for port object 288de558-83a5-4339-86db-baf8307134b8 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:02.530895 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:02.543196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Made reservation on behalf of 982e4927ecc048a1a769000f4c067d06 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:02.545838 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:02.601880 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Network 7869b0da-59f4-4b95-80b3-2cee1e2f3494 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:02.604678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:02.605085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-672f5b3a-a126-424d-a3a4-58ca29a62d4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:02.606564 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-672f5b3a-a126-424d-a3a4-58ca29a62d4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5108964 May 12 15:10:02.608264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:02.617862 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:02.651901 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:02.656489 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Pushing event updated for resources: {'Port': ['ID=288de558-83a5-4339-86db-baf8307134b8,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:02.712244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Attempting to bind port 288de558-83a5-4339-86db-baf8307134b8 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:02.712601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Attempting to bind port 288de558-83a5-4339-86db-baf8307134b8 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '7d065a97-a552-4415-a638-f68219b3bad1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '7869b0da-59f4-4b95-80b3-2cee1e2f3494'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:02.712953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Attempting to bind port 288de558-83a5-4339-86db-baf8307134b8 on network 7869b0da-59f4-4b95-80b3-2cee1e2f3494 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:02.718483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 9, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:02.718847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Checking segment: {'id': '7d065a97-a552-4415-a638-f68219b3bad1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '7869b0da-59f4-4b95-80b3-2cee1e2f3494'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:02.720025 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:02.720599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Bound using segment: {'id': '7d065a97-a552-4415-a638-f68219b3bad1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '7869b0da-59f4-4b95-80b3-2cee1e2f3494'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:02.720761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Bound port: 288de558-83a5-4339-86db-baf8307134b8, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7d065a97-a552-4415-a638-f68219b3bad1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '7869b0da-59f4-4b95-80b3-2cee1e2f3494'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:02.721118 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:02.747058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79361986-1a4f-4fbd-b277-c50419f342b7 req-75519952-d4f9-4c91-bb75-d62967b28689 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:02.748529 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-79361986-1a4f-4fbd-b277-c50419f342b7 req-75519952-d4f9-4c91-bb75-d62967b28689 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 944 time: 0.6024272 May 12 15:10:02.749796 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-7e8cb41b-d92a-402d-af57-5cfdaedcf69b tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/quotas/fa4eac6b8c464c45aa3c550e59a0d34b HTTP/1.1" status: 200 len: 375 time: 0.1336911 May 12 15:10:02.805297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Allocated IP 172.25.8.112 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/43ddf270-5ffe-40d9-b4c7-c5b75ccda930) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:02.812388 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] For port 288de558-83a5-4339-86db-baf8307134b8, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:02.816784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] For port 288de558-83a5-4339-86db-baf8307134b8, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=288de558-83a5-4339-86db-baf8307134b8,segment=NetworkSegment(7d065a97-a552-4415-a638-f68219b3bad1),segment_id=7d065a97-a552-4415-a638-f68219b3bad1)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:02.822486 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:02.918549 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e198a6e6-b251-48d9-b083-feac30d105e6 None None] Pushing event updated for resources: {'Port': ['ID=288de558-83a5-4339-86db-baf8307134b8,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:02.964959 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-79361986-1a4f-4fbd-b277-c50419f342b7 req-a824cdb4-ea16-49e5-a481-ce28452bb8d9 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1914477 May 12 15:10:02.996865 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:03.031123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-fa40ed68-d996-49db-a286-233afb756c7a req-7731bdcc-2435-4154-8af8-242790186637 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] For port 41e26787-6db6-4aed-9809-d91a746dcee9, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=41e26787-6db6-4aed-9809-d91a746dcee9,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:03.032255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fa40ed68-d996-49db-a286-233afb756c7a req-7731bdcc-2435-4154-8af8-242790186637 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:03.035340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:03.188131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bedffd1f-e77b-484f-b090-5d8637b7262c up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:03.213060 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d7c5e4f0-5e42-4abe-b463-71eab63df786'] response: {'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'code': 200} May 12 15:10:03.213616 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d7c5e4f0-5e42-4abe-b463-71eab63df786'] response: {'name': 'network-changed', 'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'status': 'completed', 'code': 200} May 12 15:10:03.308151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port bedffd1f-e77b-484f-b090-5d8637b7262c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:03.312942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-fa40ed68-d996-49db-a286-233afb756c7a req-7731bdcc-2435-4154-8af8-242790186637 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Calling delete_port for 41e26787-6db6-4aed-9809-d91a746dcee9 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:10:03.314735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port bedffd1f-e77b-484f-b090-5d8637b7262c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:03.315111 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:03.343143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:03.350238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:03.352556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:03.409708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Pushing event updated for resources: {'Port': ['ID=43ddf270-5ffe-40d9-b4c7-c5b75ccda930,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:03.461001 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:03.491423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bedffd1f-e77b-484f-b090-5d8637b7262c'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:03.497544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Allocated IP 172.20.0.10 (e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5/1636e4f2-4025-4f61-a8dd-65adade9e66c/a3478c2b-fafc-4acf-abce-c432fa4e874d) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:03.501586 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b9825d0-c111-4f4c-8fbc-1a8109134de4 req-5092787d-8189-405d-9226-c51dd95fa058 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 210 time: 0.1441276 May 12 15:10:03.502893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port bedffd1f-e77b-484f-b090-5d8637b7262c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bedffd1f-e77b-484f-b090-5d8637b7262c,segment=NetworkSegment(96a7c587-eda9-40b0-aaff-97f4e1387d63),segment_id=96a7c587-eda9-40b0-aaff-97f4e1387d63)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:03.506154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-8d4f405f-e045-4ec4-bbe7-7807271a44eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:03.508358 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-8d4f405f-e045-4ec4-bbe7-7807271a44eb service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 1098 time: 0.2967699 May 12 15:10:03.509787 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:03.514842 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-c24f191d-73e5-4941-be5e-67cb3f007122 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&fields=id HTTP/1.1" status: 200 len: 255 time: 0.7492688 May 12 15:10:03.636294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-ad8d0d74-396e-4d69-9240-13f921bcdbd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:03.637818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-ad8d0d74-396e-4d69-9240-13f921bcdbd6 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 1098 time: 0.2837965 May 12 15:10:03.642568 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fa40ed68-d996-49db-a286-233afb756c7a req-7731bdcc-2435-4154-8af8-242790186637 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:03.695544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=bedffd1f-e77b-484f-b090-5d8637b7262c,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:03.760951 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a686f1c4-b2f1-4692-950a-b2a71f6aeb6f details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:10:03.784089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-c030adaf-713e-45ce-81a4-173d6fa2b06c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:03.785630 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-c030adaf-713e-45ce-81a4-173d6fa2b06c service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.2657559 May 12 15:10:03.984307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:04.005527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'mac_address': 'fa:16:3e:46:3e:8a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.52'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:10:04.028781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7731bdcc-2435-4154-8af8-242790186637 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Pushing event deleted for resources: {'Port': ['ID=41e26787-6db6-4aed-9809-d91a746dcee9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:04.040716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:04.086130 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:04.125789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a686f1c4-b2f1-4692-950a-b2a71f6aeb6f {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:04.160654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:04.168401 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:04.337686 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-5e82c73f-305d-4bd9-bf34-37bc4f4ecc80 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.52&port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 200 len: 217 time: 0.3545189 May 12 15:10:04.362765 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:04.383446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:04.421679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Transition to ACTIVE for port object a3478c2b-fafc-4acf-abce-c432fa4e874d will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:04.432309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-fa40ed68-d996-49db-a286-233afb756c7a req-7731bdcc-2435-4154-8af8-242790186637 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] No DVR routers for this DVR port 41e26787-6db6-4aed-9809-d91a746dcee9 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:10:04.440984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fa40ed68-d996-49db-a286-233afb756c7a req-7731bdcc-2435-4154-8af8-242790186637 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:04.465540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ada98fd8-3236-43df-92f0-3a69d2b5329c None None] Network 7869b0da-59f4-4b95-80b3-2cee1e2f3494 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:10:04.530980 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa40ed68-d996-49db-a286-233afb756c7a req-7731bdcc-2435-4154-8af8-242790186637 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.76 "DELETE /v2.0/ports/41e26787-6db6-4aed-9809-d91a746dcee9 HTTP/1.1" status: 204 len: 173 time: 2.3798444 May 12 15:10:04.543844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae3637a5-8f81-48f7-ba88-6c424e1b7345 req-45b79ab1-d02b-4168-99f8-890cf9485f4f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:04.551717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-a295f492-1298-4969-bcc2-001b1075ead9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:04.553173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae3637a5-8f81-48f7-ba88-6c424e1b7345 req-45b79ab1-d02b-4168-99f8-890cf9485f4f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 947 time: 0.8224361 May 12 15:10:04.553494 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-a295f492-1298-4969-bcc2-001b1075ead9 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2043993 May 12 15:10:04.561162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-9f4d321c-9dd4-4a6d-b1dc-5660caa1ed47 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:04.563748 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-9f4d321c-9dd4-4a6d-b1dc-5660caa1ed47 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.9176967 May 12 15:10:04.582887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a686f1c4-b2f1-4692-950a-b2a71f6aeb6f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:04.664275 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-c5d16eec-0396-49db-8f9d-f1d342849137 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.52&port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 200 len: 217 time: 0.0773585 May 12 15:10:04.841726 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:04.854751 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae3637a5-8f81-48f7-ba88-6c424e1b7345 req-29cea982-f205-43e7-9d5a-0f8f07903900 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3002882 May 12 15:10:04.887916 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b186fab2-fac9-4220-b37d-c5fc95e1ee84 None None] Provisioning for port 288de558-83a5-4339-86db-baf8307134b8 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:04.956028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-0eb5992f-a15a-429a-b429-e49b96468856 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:04.960694 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-0eb5992f-a15a-429a-b429-e49b96468856 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.3865688 May 12 15:10:04.966017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-8f64e2db-a816-42a4-aed8-903c8d7e3572 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:04.969518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-8f64e2db-a816-42a4-aed8-903c8d7e3572 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2763913 May 12 15:10:05.127100 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:05.260845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e55f7075-e930-469e-9063-1ed463d5a1b9', 'name': 'network-vif-deleted', 'tag': '41e26787-6db6-4aed-9809-d91a746dcee9'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:05.335948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 288de558-83a5-4339-86db-baf8307134b8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:05.382850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:05.447095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:05.462045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:05.503072 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-a8f760f1-fe76-44b6-8b99-b8f324ef72dd service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5189960 May 12 15:10:05.538771 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b222347d-e4c7-48ed-8db0-7e4f4b44c0f8'] response: {'server_uuid': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bedffd1f-e77b-484f-b090-5d8637b7262c', 'code': 200} May 12 15:10:05.581332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:05.582040 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:05.585978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Pushing event updated for resources: {'Port': ['ID=a3478c2b-fafc-4acf-abce-c432fa4e874d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:05.589764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f7e9efaf-4f26-446f-8acd-76837bab7ca2 req-f83eea3a-2620-4c8e-a033-53da7611c2a3 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Synchronizing usage tracker for tenant:1b3825228b0e4c42a381540b66ea23d6 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:05.647896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f7e9efaf-4f26-446f-8acd-76837bab7ca2 req-f83eea3a-2620-4c8e-a033-53da7611c2a3 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Unset dirty status for tenant:1b3825228b0e4c42a381540b66ea23d6 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:05.649108 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f7e9efaf-4f26-446f-8acd-76837bab7ca2 req-f83eea3a-2620-4c8e-a033-53da7611c2a3 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=e55f7075-e930-469e-9063-1ed463d5a1b9 HTTP/1.1" status: 200 len: 210 time: 0.2652264 May 12 15:10:05.650316 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-6ada8ff2-4b11-497e-b560-44d2a9fada21 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.7926500 May 12 15:10:05.670194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Request body: {'port': {'device_id': '74ddf043-2cb7-4286-b010-6509b25bb4aa', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:05.729937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 288de558-83a5-4339-86db-baf8307134b8 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:05.739552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 288de558-83a5-4339-86db-baf8307134b8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:05.740200 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:05.744453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-29644359-8d01-48f4-9d7e-f147257b9cb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:05.746156 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-29644359-8d01-48f4-9d7e-f147257b9cb4 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.7262871 May 12 15:10:05.801040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 41e26787-6db6-4aed-9809-d91a746dcee9 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:10:05.924188 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:05.931066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 41e26787-6db6-4aed-9809-d91a746dcee9 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:10:05.933891 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 41e26787-6db6-4aed-9809-d91a746dcee9 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:10:05.989219 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-79f0be29-55a8-4c32-8596-8c81e606724a service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4328115 May 12 15:10:06.022260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5e785cd-610a-46d6-81eb-c12b0f5e03fa req-4392fbb2-fd69-4243-a20b-09287ce239d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:06.024325 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a5e785cd-610a-46d6-81eb-c12b0f5e03fa req-4392fbb2-fd69-4243-a20b-09287ce239d9 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 1096 time: 0.2358401 May 12 15:10:06.048012 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3448ea4e-9d27-4855-a3d8-68cc49fd67ef None None] Provisioning for port a3478c2b-fafc-4acf-abce-c432fa4e874d completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:06.052024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Router 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:10:06.068487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3448ea4e-9d27-4855-a3d8-68cc49fd67ef None None] Provisioning complete for port a3478c2b-fafc-4acf-abce-c432fa4e874d triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:06.068850 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3448ea4e-9d27-4855-a3d8-68cc49fd67ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:06.119152 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:06.174860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 288de558-83a5-4339-86db-baf8307134b8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=288de558-83a5-4339-86db-baf8307134b8,segment=NetworkSegment(7d065a97-a552-4415-a638-f68219b3bad1),segment_id=7d065a97-a552-4415-a638-f68219b3bad1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:06.184911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3448ea4e-9d27-4855-a3d8-68cc49fd67ef None None] Port a3478c2b-fafc-4acf-abce-c432fa4e874d cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:10:06.187158 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:06.274713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:10:06.305067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Sync routers for ids ['3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:10:06.321556 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a5e785cd-610a-46d6-81eb-c12b0f5e03fa req-8d340b01-29c4-4c44-a3f2-d79479a11ce3 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2886083 May 12 15:10:06.332406 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:06.336925 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-13d12799-3d4a-44fe-9ee1-996bbaad4ee1 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 4.8039346 May 12 15:10:06.337256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50510) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:06.382955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=288de558-83a5-4339-86db-baf8307134b8,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:06.392315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Routers {'3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:10:06.392840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:06.448917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fb12df0c-a508-4b64-b93a-6cc9531200c5 None None] Provisioning complete for port 288de558-83a5-4339-86db-baf8307134b8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:06.449275 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fb12df0c-a508-4b64-b93a-6cc9531200c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:06.637456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0581d0b8-61cf-4f90-9ba1-a02e6475394e req-2f39df9a-7b1c-4777-abc5-e4d4b5eb72f1 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:06.645975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0581d0b8-61cf-4f90-9ba1-a02e6475394e req-2f39df9a-7b1c-4777-abc5-e4d4b5eb72f1 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 945 time: 0.7234423 May 12 15:10:06.673970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Set router 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:10:06.688450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-4b2cae4a-5c43-46ad-9acc-03480fd25a8d service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7667115 May 12 15:10:06.724219 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0581d0b8-61cf-4f90-9ba1-a02e6475394e req-a09b4f83-6bf5-47c9-86a2-22e894d54fb1 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0772760 May 12 15:10:06.942358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-006a6f05-c89f-4a7a-9d5f-65629f278d3c req-8f178ffb-c010-4503-bb05-0f15a3221106 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:06.942641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-006a6f05-c89f-4a7a-9d5f-65629f278d3c req-8f178ffb-c010-4503-bb05-0f15a3221106 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Synchronizing usage tracker for tenant:982e4927ecc048a1a769000f4c067d06 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:07.042107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a3478c2b-fafc-4acf-abce-c432fa4e874d {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:07.051521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'name': 'tempest-FloatingIPDetailsTestJSON-1923857176-router', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.112'}], 'enable_snat': True}, 'gw_port_id': '43ddf270-5ffe-40d9-b4c7-c5b75ccda930', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:01Z', 'updated_at': '2022-05-12T15:10:03Z', 'revision_number': 3, 'project_id': 'd914960d703a44ae913f9a1804d5b368', 'gw_port': {'id': '43ddf270-5ffe-40d9-b4c7-c5b75ccda930', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:5a:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 728, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:02Z', 'updated_at': '2022-05-12T15:10:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:07.054093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 288de558-83a5-4339-86db-baf8307134b8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:07.059411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-006a6f05-c89f-4a7a-9d5f-65629f278d3c req-8f178ffb-c010-4503-bb05-0f15a3221106 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Unset dirty status for tenant:982e4927ecc048a1a769000f4c067d06 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:07.060551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-006a6f05-c89f-4a7a-9d5f-65629f278d3c req-8f178ffb-c010-4503-bb05-0f15a3221106 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 932 time: 0.6876271 May 12 15:10:07.062384 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:07.092004 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1e42d1a-2671-4dca-b391-a64ddfd1af36 req-1115557d-2900-41f8-bd91-fdde75c59659 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3910198 May 12 15:10:07.094868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Checking router: 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:10:07.095210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Updating router 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf port 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:10:07.104518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Transition to ACTIVE for port object a3478c2b-fafc-4acf-abce-c432fa4e874d will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:07.115753 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:07.186212 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-006a6f05-c89f-4a7a-9d5f-65629f278d3c req-b4cf86ae-b606-4695-8b53-33fced4d292d tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/security-groups?id=4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1126120 May 12 15:10:07.346882 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:07.463180 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 288de558-83a5-4339-86db-baf8307134b8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:07.463608 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:07.507367 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8e2ee32e-a7d6-44d7-a6d7-ff9cc9e9f98a'] response: {'server_uuid': 'e55f7075-e930-469e-9063-1ed463d5a1b9', 'name': 'network-vif-deleted', 'tag': '41e26787-6db6-4aed-9809-d91a746dcee9', 'status': 'completed', 'code': 200} May 12 15:10:07.529009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Pushing event updated for resources: {'Port': ['ID=a3478c2b-fafc-4acf-abce-c432fa4e874d,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:07.562410 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-5e6a79ea-2046-45df-859e-0f175f7ca6c2 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0751326 May 12 15:10:07.638037 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:10:07.812540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a686f1c4-b2f1-4692-950a-b2a71f6aeb6f up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:07.818928 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6440256-9785-41a8-a80c-1e2bb459be87 req-916fd912-46de-460a-b13e-5bd06a355f50 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 210 time: 0.1246476 May 12 15:10:07.950113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Attempting to bind port a3478c2b-fafc-4acf-abce-c432fa4e874d on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:07.950447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Attempting to bind port a3478c2b-fafc-4acf-abce-c432fa4e874d by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '5557610c-85a4-4c18-8793-b6867e2cb17c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:07.950766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Attempting to bind port a3478c2b-fafc-4acf-abce-c432fa4e874d on network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:07.973875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Port a3478c2b-fafc-4acf-abce-c432fa4e874d on network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:10:07.974185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Attempting to bind port a3478c2b-fafc-4acf-abce-c432fa4e874d on network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:07.980125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a756daaf-2086-4e4b-9a8b-2cde6fc1127b tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:07.982769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 10, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:07.983099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Checking segment: {'id': '5557610c-85a4-4c18-8793-b6867e2cb17c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:07.983478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Bound using segment: {'id': '5557610c-85a4-4c18-8793-b6867e2cb17c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:07.983898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Bound port: a3478c2b-fafc-4acf-abce-c432fa4e874d, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5557610c-85a4-4c18-8793-b6867e2cb17c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:07.984210 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a756daaf-2086-4e4b-9a8b-2cde6fc1127b tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4014745 May 12 15:10:07.984335 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:07.992365 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:08.037858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-84fa490e-7ffd-40a0-8e65-f17c37d4bbb4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:08.042584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-84fa490e-7ffd-40a0-8e65-f17c37d4bbb4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.76 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58&tenant_id=0da54985cde346e68eeadf965b8bc6d3&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 948 time: 0.5343289 May 12 15:10:08.102158 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Request body: {'port': {'device_id': '9b2b4b7d-231c-4e54-83f4-827d02cbcbb5', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': 'fa4eac6b8c464c45aa3c550e59a0d34b'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:08.136472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] For port a3478c2b-fafc-4acf-abce-c432fa4e874d, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:08.139959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] For port a3478c2b-fafc-4acf-abce-c432fa4e874d, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3478c2b-fafc-4acf-abce-c432fa4e874d,segment=NetworkSegment(5557610c-85a4-4c18-8793-b6867e2cb17c),segment_id=5557610c-85a4-4c18-8793-b6867e2cb17c)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:08.192234 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:08.197497 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:08.206980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:08.207573 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:08.255426 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:08.289917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Transition to ACTIVE for port object 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:08.334317 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:08.355384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:08.356865 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:08.358722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] 10.222.0.76 "PUT /v2.0/ports/a3478c2b-fafc-4acf-abce-c432fa4e874d HTTP/1.1" status: 200 len: 1092 time: 2.6989009 May 12 15:10:08.415485 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-8f9c0865-6a86-4070-9be6-99e6b50ffe06 service neutron] 10.222.0.76 "GET /v2.0/ports/a686f1c4-b2f1-4692-950a-b2a71f6aeb6f/bindings/n-h2-841483-1 HTTP/1.1" status: 200 len: 382 time: 0.2716522 May 12 15:10:08.423075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bcb716b-aa6f-4019-9d88-3738fb05797a service neutron] Pushing event updated for resources: {'Port': ['ID=a3478c2b-fafc-4acf-abce-c432fa4e874d,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:08.432548 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-5f186d62-0534-4bf5-9c1f-6e636e440846 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.2510240 May 12 15:10:08.451154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e93050d0-62fc-49d9-909c-4df2a7f48272 req-92d7eb44-f593-444d-b672-e6b86b7e1771 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:08.464471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e93050d0-62fc-49d9-909c-4df2a7f48272 req-92d7eb44-f593-444d-b672-e6b86b7e1771 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 948 time: 0.3222258 May 12 15:10:08.509303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-195d0d6c-0313-4e7d-a079-fa70b63689b0 None None] Pushing event updated for resources: {'Port': ['ID=43ddf270-5ffe-40d9-b4c7-c5b75ccda930,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:08.534439 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Attempting to bind port 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:08.534791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Attempting to bind port 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:08.535140 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Attempting to bind port 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:08.542584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 9, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:08.542943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:08.543338 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:08.543715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:08.544175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Bound port: 43ddf270-5ffe-40d9-b4c7-c5b75ccda930, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:08.544538 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:08.648882 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e93050d0-62fc-49d9-909c-4df2a7f48272 req-24711ac4-0417-4c66-a533-7001ffe6e746 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1833146 May 12 15:10:08.710015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] For port 43ddf270-5ffe-40d9-b4c7-c5b75ccda930, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:08.716293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-c3a969eb-2bbb-4805-8721-b27ea28ee30d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:08.716994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] For port 43ddf270-5ffe-40d9-b4c7-c5b75ccda930, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=43ddf270-5ffe-40d9-b4c7-c5b75ccda930,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:08.721403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-c3a969eb-2bbb-4805-8721-b27ea28ee30d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 1099 time: 0.2270763 May 12 15:10:08.738140 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:08.752909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:08.824283 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:08.855630 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-eb7318ed-f06e-4f85-bfc7-92b41bd570b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:08.857418 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-eb7318ed-f06e-4f85-bfc7-92b41bd570b9 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=982e4927ecc048a1a769000f4c067d06&device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 1095 time: 0.3096373 May 12 15:10:08.871885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-1b05ba55-b081-49e5-a31d-c86bafb67ac5 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:08.873797 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-1b05ba55-b081-49e5-a31d-c86bafb67ac5 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4265230 May 12 15:10:08.877635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Made reservation on behalf of fa4eac6b8c464c45aa3c550e59a0d34b for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:08.881458 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:08.886133 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:08.904162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Request body: {'port': {'device_id': '000d5cf1-e430-46d6-a455-2550da7e4b71', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': 'fa4eac6b8c464c45aa3c550e59a0d34b'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:08.920624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Routers {'3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:10:08.921259 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:09.020769 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-c085ced4-9baa-43a6-8b8a-de2af46f22e1 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a3478c2b-fafc-4acf-abce-c432fa4e874d HTTP/1.1" status: 200 len: 217 time: 0.0915370 May 12 15:10:09.050071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Allocated IP 172.20.0.1 (7869b0da-59f4-4b95-80b3-2cee1e2f3494/55f11913-d2d9-4fda-86a7-3a4470347229/859ac872-331f-4c8a-a382-c0072053ab23) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:09.156502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4fa0339-40a2-4d0b-963f-305466e6972f req-627b9462-47e9-4432-aa3f-117702bfdac4 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:09.158990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4fa0339-40a2-4d0b-963f-305466e6972f req-627b9462-47e9-4432-aa3f-117702bfdac4 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 945 time: 0.2887526 May 12 15:10:09.160974 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-65fcbce4-db7b-4d82-b2c8-2607cefc0b33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:09.162341 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-65fcbce4-db7b-4d82-b2c8-2607cefc0b33 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=1636e4f2-4025-4f61-a8dd-65adade9e66c HTTP/1.1" status: 200 len: 845 time: 0.1345360 May 12 15:10:09.163379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-713f2891-984a-42a8-857f-566787b640fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:09.164598 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-713f2891-984a-42a8-857f-566787b640fd service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.4353709 May 12 15:10:09.181108 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] Set router 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:10:09.386167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:09.452661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-195d0d6c-0313-4e7d-a079-fa70b63689b0 None None] Pushing event updated for resources: {'Port': ['ID=43ddf270-5ffe-40d9-b4c7-c5b75ccda930,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:09.458422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:09.472885 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:09.485578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:09.491414 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-d59addfe-c328-4f22-aa79-162d850cc851 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.52&port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 200 len: 217 time: 0.3081121 May 12 15:10:09.511126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Usage tracker for resource:port and tenant:fa4eac6b8c464c45aa3c550e59a0d34b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:09.511327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '74ddf043-2cb7-4286-b010-6509b25bb4aa', 'tag': 'a3478c2b-fafc-4acf-abce-c432fa4e874d'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:09.518853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:09.539898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:09.542259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Allocated IP 192.168.233.195 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/83a7b910-a912-4e05-9d03-5d6b1f6b0edc) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:09.559163 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:09.578017 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:09.594249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4fa0339-40a2-4d0b-963f-305466e6972f req-c61b8288-420b-47fa-9bdf-bc37e5d55875 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4282053 May 12 15:10:09.601267 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Made reservation on behalf of fa4eac6b8c464c45aa3c550e59a0d34b for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:09.604696 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:09.663711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-f4811697-25ae-42d2-95d4-1e7771e75775 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:09.665197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-f4811697-25ae-42d2-95d4-1e7771e75775 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1469798 May 12 15:10:09.686682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Transition to ACTIVE for port object 859ac872-331f-4c8a-a382-c0072053ab23 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:09.689999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'name': 'tempest-FloatingIPDetailsTestJSON-1923857176-router', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.112'}], 'enable_snat': True}, 'gw_port_id': '43ddf270-5ffe-40d9-b4c7-c5b75ccda930', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:01Z', 'updated_at': '2022-05-12T15:10:03Z', 'revision_number': 3, 'project_id': 'd914960d703a44ae913f9a1804d5b368', 'gw_port': {'id': '43ddf270-5ffe-40d9-b4c7-c5b75ccda930', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:5a:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 728, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:02Z', 'updated_at': '2022-05-12T15:10:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:09.695778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d93f1e33-9129-4721-922d-6aaad761d522 None None] The sync data for ids ['3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'] in n-d-841483-1 is: [{'id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'name': 'tempest-FloatingIPDetailsTestJSON-1923857176-router', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.112'}], 'enable_snat': True}, 'gw_port_id': '43ddf270-5ffe-40d9-b4c7-c5b75ccda930', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:01Z', 'updated_at': '2022-05-12T15:10:03Z', 'revision_number': 3, 'project_id': 'd914960d703a44ae913f9a1804d5b368', 'gw_port': {'id': '43ddf270-5ffe-40d9-b4c7-c5b75ccda930', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:5a:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 728, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:02Z', 'updated_at': '2022-05-12T15:10:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:10:09.812007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5f40d1e-4862-4170-a139-c286ab5ba279 req-804dd33c-357c-4d9f-a1ce-f0a2d485a500 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:09.819800 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5f40d1e-4862-4170-a139-c286ab5ba279 req-804dd33c-357c-4d9f-a1ce-f0a2d485a500 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 944 time: 0.3973498 May 12 15:10:09.830075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-226f78a5-61e6-4362-a884-4d1f50ef2eb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:09.831507 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-226f78a5-61e6-4362-a884-4d1f50ef2eb4 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5861936 May 12 15:10:09.846742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-f3b9154b-d1d3-4cb1-a284-210e696c7c72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:09.848325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-f3b9154b-d1d3-4cb1-a284-210e696c7c72 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1694655 May 12 15:10:09.883384 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:09.986271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:09.995506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Pushing event updated for resources: {'Port': ['ID=859ac872-331f-4c8a-a382-c0072053ab23,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:09.999132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Network 7869b0da-59f4-4b95-80b3-2cee1e2f3494 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:10.003381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:10.007925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:10.055524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Transition to ACTIVE for port object 83a7b910-a912-4e05-9d03-5d6b1f6b0edc will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:10.092865 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:10.122395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d79337e3-c5f7-4325-a2f6-da98c8aa17a8 req-0bc946cf-b16b-4e8a-b3be-c8a3f2b0d5b6 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:10.124414 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d79337e3-c5f7-4325-a2f6-da98c8aa17a8 req-0bc946cf-b16b-4e8a-b3be-c8a3f2b0d5b6 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.76 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 945 time: 0.6048942 May 12 15:10:10.134124 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5f40d1e-4862-4170-a139-c286ab5ba279 req-4e66c994-74e4-4046-b834-d50e741f5354 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/security-groups?id=4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3134916 May 12 15:10:10.166060 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:10.180622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:10.355866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-d79337e3-c5f7-4325-a2f6-da98c8aa17a8 req-080f2dd9-3305-4946-8ee6-55d093521e6f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Deleting port d7e09d66-2268-48c4-a658-ef10261e7a46 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:10:10.356364 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d79337e3-c5f7-4325-a2f6-da98c8aa17a8 req-080f2dd9-3305-4946-8ee6-55d093521e6f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:10.402338 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-58cfa924-62ef-4f2f-81b7-03b3718b0b88 service neutron] 10.222.0.76 "GET /v2.0/networks/e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5514314 May 12 15:10:10.491088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:10.498452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:10.507116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:10.557934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event updated for resources: {'Port': ['ID=83a7b910-a912-4e05-9d03-5d6b1f6b0edc,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:10.616494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Allocated IP 192.168.233.165 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/3ae73679-d198-440a-966c-619a9930fbcb) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:10.627872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0136ff02-d821-499b-9bd8-19a0cc272aab None None] Provisioning for port 859ac872-331f-4c8a-a382-c0072053ab23 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:10.640237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0136ff02-d821-499b-9bd8-19a0cc272aab None None] Provisioning complete for port 859ac872-331f-4c8a-a382-c0072053ab23 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:10.640809 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0136ff02-d821-499b-9bd8-19a0cc272aab None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:10.684720 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174ded80-061a-4aff-86bc-64eced5c3cf5 req-94f56a2d-2555-4f88-a033-b5754e95425e service neutron] 10.222.0.76 "GET /v2.0/networks/e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2542405 May 12 15:10:10.696868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:10.697739 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:10.785464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0136ff02-d821-499b-9bd8-19a0cc272aab None None] Port 859ac872-331f-4c8a-a382-c0072053ab23 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:10:10.813830 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-2e0c2fc0-6a87-4fe0-bad9-940d06175df4 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9247124 May 12 15:10:10.845230 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a4af671d-3547-4c7b-9dd4-fa3e63b63638 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.8252099 May 12 15:10:10.845878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:10.887465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Request body: {'port': {'device_id': '9b2b4b7d-231c-4e54-83f4-827d02cbcbb5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:10.912354 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-407dfc59-62d2-4605-ae7a-739154ac8424 None None] Provisioning for port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:10.920779 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-407dfc59-62d2-4605-ae7a-739154ac8424 None None] Provisioning complete for port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:10.921196 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-407dfc59-62d2-4605-ae7a-739154ac8424 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:10.938573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2c7b526-8dab-41fa-8f51-dc4f19dad15a req-9ed6b553-d993-4980-868a-dd2e49601beb tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 210 time: 0.4762559 May 12 15:10:11.073805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-407dfc59-62d2-4605-ae7a-739154ac8424 None None] Port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:10:11.176351 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:11.197105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-d79337e3-c5f7-4325-a2f6-da98c8aa17a8 req-080f2dd9-3305-4946-8ee6-55d093521e6f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] For port d7e09d66-2268-48c4-a658-ef10261e7a46, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d7e09d66-2268-48c4-a658-ef10261e7a46,segment=NetworkSegment(2e732768-539c-4181-b234-fc2be7d671bf),segment_id=2e732768-539c-4181-b234-fc2be7d671bf)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:11.197825 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d79337e3-c5f7-4325-a2f6-da98c8aa17a8 req-080f2dd9-3305-4946-8ee6-55d093521e6f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:11.217247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-561618f7-e223-4733-8ba8-33e154f340a5 req-87703bba-9cf3-4fcd-b3e2-7447e5ca3ac9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:11.219878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-561618f7-e223-4733-8ba8-33e154f340a5 req-87703bba-9cf3-4fcd-b3e2-7447e5ca3ac9 tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/ports?device_id=65495c97-2a82-4737-a9aa-c3ca1d8ffc86 HTTP/1.1" status: 200 len: 945 time: 0.4427953 May 12 15:10:11.224818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-4b9d9bcf-69c6-46b9-b985-2d0b623bd055 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3677349 May 12 15:10:11.271196 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0b2283c3-8485-46be-b54a-81a29f795dca'] response: {'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'code': 200} May 12 15:10:11.335260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:11.347898 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:11.348277 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:11.453221 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:11.504664 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:11.539677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Transition to ACTIVE for port object 3ae73679-d198-440a-966c-619a9930fbcb will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:11.560136 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9a1b6272-7cc4-4a65-844b-7b991a910c34'] response: {'name': 'network-changed', 'server_uuid': '74ddf043-2cb7-4286-b010-6509b25bb4aa', 'tag': 'a3478c2b-fafc-4acf-abce-c432fa4e874d', 'status': 'completed', 'code': 200} May 12 15:10:11.567477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-d79337e3-c5f7-4325-a2f6-da98c8aa17a8 req-080f2dd9-3305-4946-8ee6-55d093521e6f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Calling delete_port for d7e09d66-2268-48c4-a658-ef10261e7a46 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:10:11.575711 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:11.582590 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:11.604735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 43ddf270-5ffe-40d9-b4c7-c5b75ccda930, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=43ddf270-5ffe-40d9-b4c7-c5b75ccda930,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:11.611377 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:11.612690 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:11.640083 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-561618f7-e223-4733-8ba8-33e154f340a5 req-3f7344d9-d9cf-4d92-8fa3-dd7b8d2f354d tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.82 "GET /v2.0/security-groups?id=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3528297 May 12 15:10:11.743678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=43ddf270-5ffe-40d9-b4c7-c5b75ccda930,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:11.848254 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:11.869904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7081b41-b887-4719-965e-d71c9f271224 req-cab75890-221e-4861-aaf8-bf918ce16f17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:11.871369 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7081b41-b887-4719-965e-d71c9f271224 req-cab75890-221e-4861-aaf8-bf918ce16f17 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=982e4927ecc048a1a769000f4c067d06&device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 1095 time: 0.4814460 May 12 15:10:12.195791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aa0ef64-2cfc-4009-958c-57d3e175e5cb req-23e869d9-e4fb-4504-9e99-6e9535b24cdf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:12.197257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3aa0ef64-2cfc-4009-958c-57d3e175e5cb req-23e869d9-e4fb-4504-9e99-6e9535b24cdf service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fd97c932be3143b1846bb48363040c63&device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 1096 time: 0.4398422 May 12 15:10:12.209664 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d79337e3-c5f7-4325-a2f6-da98c8aa17a8 req-080f2dd9-3305-4946-8ee6-55d093521e6f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:12.318782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Pushing event updated for resources: {'Port': ['ID=859ac872-331f-4c8a-a382-c0072053ab23,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:12.360858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:12.361426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:12.361980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:12.362384 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:12.362869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:12.363268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:12.363659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:12.364076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:12.364411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:12.364722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:12.365519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:12.365751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:12.379442 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:12.392918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:12.425778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50684) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:12.436505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Network 7869b0da-59f4-4b95-80b3-2cee1e2f3494 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:12.440525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-080f2dd9-3305-4946-8ee6-55d093521e6f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Pushing event deleted for resources: {'Port': ['ID=d7e09d66-2268-48c4-a658-ef10261e7a46,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:12.471476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:12.546203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:12.555928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7081b41-b887-4719-965e-d71c9f271224 req-2e01eb50-045a-4bf0-998a-0ef104068b31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:12.560516 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7081b41-b887-4719-965e-d71c9f271224 req-2e01eb50-045a-4bf0-998a-0ef104068b31 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 HTTP/1.1" status: 200 len: 907 time: 0.6462879 May 12 15:10:12.580922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:12.623523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-780271c6-4a89-4bb9-8946-7165c16f2cc1 req-895d0089-96ca-469c-b2f4-a1328289c166 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:12.632264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-780271c6-4a89-4bb9-8946-7165c16f2cc1 req-895d0089-96ca-469c-b2f4-a1328289c166 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 0.7308378 May 12 15:10:12.678951 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cff4c378-1745-4d41-898d-56d3390e6e2f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:12.690136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:12.778132 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:12.788990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event updated for resources: {'Port': ['ID=3ae73679-d198-440a-966c-619a9930fbcb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:12.880547 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c44cddaf-245a-4586-b8c5-ac38a542ab9d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:12.881170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-d79337e3-c5f7-4325-a2f6-da98c8aa17a8 req-080f2dd9-3305-4946-8ee6-55d093521e6f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] No DVR routers for this DVR port d7e09d66-2268-48c4-a658-ef10261e7a46 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:10:12.884483 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d79337e3-c5f7-4325-a2f6-da98c8aa17a8 req-080f2dd9-3305-4946-8ee6-55d093521e6f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:12.888750 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7081b41-b887-4719-965e-d71c9f271224 req-3a432b46-faac-454c-8791-9193cbbddc2f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a3478c2b-fafc-4acf-abce-c432fa4e874d HTTP/1.1" status: 200 len: 217 time: 0.2306573 May 12 15:10:12.892742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50696) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:12.914969 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05196e2-7622-4c90-a404-162bb844f944 req-fb2f4615-6ac4-47a1-a6a8-f6d97f8736af tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:12.916538 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d05196e2-7622-4c90-a404-162bb844f944 req-fb2f4615-6ac4-47a1-a6a8-f6d97f8736af tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 944 time: 0.9341493 May 12 15:10:12.946573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7a6e4cd8-a53a-4b05-9347-20ed5355ab8f None None] Provisioning complete for port 859ac872-331f-4c8a-a382-c0072053ab23 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:12.947298 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7a6e4cd8-a53a-4b05-9347-20ed5355ab8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:12.947550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c44cddaf-245a-4586-b8c5-ac38a542ab9d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:12.999826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7081b41-b887-4719-965e-d71c9f271224 req-0094dc2b-5bc5-43e2-9e65-3717096d8f32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:13.002155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7081b41-b887-4719-965e-d71c9f271224 req-0094dc2b-5bc5-43e2-9e65-3717096d8f32 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=1636e4f2-4025-4f61-a8dd-65adade9e66c HTTP/1.1" status: 200 len: 845 time: 0.0989723 May 12 15:10:13.011250 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-7a6e4cd8-a53a-4b05-9347-20ed5355ab8f None None] Port 859ac872-331f-4c8a-a382-c0072053ab23 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:10:13.029640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c44cddaf-245a-4586-b8c5-ac38a542ab9d admin admin] Usage tracker for resource:security_group_rule and tenant:5600ff2864d14ed6b2d90c0e21371b8a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:13.043938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:13.044871 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:13.050328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c44cddaf-245a-4586-b8c5-ac38a542ab9d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:13.060579 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:13.061911 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-780271c6-4a89-4bb9-8946-7165c16f2cc1 req-eafd2bc6-5eca-45bb-bcbf-f30ac74418d6 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4286063 May 12 15:10:13.116525 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d05196e2-7622-4c90-a404-162bb844f944 req-f43f1410-46cc-463f-b9e8-220a71aa2037 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/security-groups?id=4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1087036 May 12 15:10:13.118342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d79337e3-c5f7-4325-a2f6-da98c8aa17a8 req-080f2dd9-3305-4946-8ee6-55d093521e6f tempest-LiveAutoBlockMigrationV225Test-1586324582 tempest-LiveAutoBlockMigrationV225Test-1586324582-project] 10.222.0.76 "DELETE /v2.0/ports/d7e09d66-2268-48c4-a658-ef10261e7a46 HTTP/1.1" status: 204 len: 173 time: 2.9827399 May 12 15:10:13.149245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aa0ef64-2cfc-4009-958c-57d3e175e5cb req-e83f4aaf-d650-4c4d-80cd-01f0a8f21f0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:13.151341 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3aa0ef64-2cfc-4009-958c-57d3e175e5cb req-e83f4aaf-d650-4c4d-80cd-01f0a8f21f0d service neutron] 10.222.0.84 "GET /v2.0/networks?id=74c45f45-b34b-4876-a35b-8ae714cf4d5f HTTP/1.1" status: 200 len: 921 time: 0.9337797 May 12 15:10:13.151666 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c44cddaf-245a-4586-b8c5-ac38a542ab9d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:13.170223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3fedc3c8-46b1-42cd-a8a7-62e6ba2f4a91 None None] Provisioning for port 3ae73679-d198-440a-966c-619a9930fbcb completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:13.179386 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3fedc3c8-46b1-42cd-a8a7-62e6ba2f4a91 None None] Provisioning complete for port 3ae73679-d198-440a-966c-619a9930fbcb triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:13.180290 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3fedc3c8-46b1-42cd-a8a7-62e6ba2f4a91 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:13.221715 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-98d77881-ffcb-445f-a087-7fac3a9f2f11 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:13.278985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:13.279509 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:13.311028 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-41fe4a54-1147-4aef-bc06-11c78ab5cc5c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 4.4148903 May 12 15:10:13.338616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3fedc3c8-46b1-42cd-a8a7-62e6ba2f4a91 None None] Port 3ae73679-d198-440a-966c-619a9930fbcb cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:10:13.372064 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3aa0ef64-2cfc-4009-958c-57d3e175e5cb req-e30467fc-24ee-4c58-8126-0eca9da61543 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bedffd1f-e77b-484f-b090-5d8637b7262c HTTP/1.1" status: 200 len: 217 time: 0.1792622 May 12 15:10:13.435525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Request body: {'port': {'device_id': '000d5cf1-e430-46d6-a455-2550da7e4b71', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:13.461576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-98d77881-ffcb-445f-a087-7fac3a9f2f11 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:13.498148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-98d77881-ffcb-445f-a087-7fac3a9f2f11 admin admin] Usage tracker for resource:security_group_rule and tenant:bb4416240d4a49568bdb004b6710d057 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:13.517913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-98d77881-ffcb-445f-a087-7fac3a9f2f11 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:13.546438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-98d77881-ffcb-445f-a087-7fac3a9f2f11 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:13.550296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Router 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:10:13.564700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '65495c97-2a82-4737-a9aa-c3ca1d8ffc86', 'name': 'network-vif-deleted', 'tag': 'd7e09d66-2268-48c4-a658-ef10261e7a46'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:13.589275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7081b41-b887-4719-965e-d71c9f271224 req-52c86d6d-832e-4699-b5c5-2f98ccc9c816 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:13.590953 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7081b41-b887-4719-965e-d71c9f271224 req-52c86d6d-832e-4699-b5c5-2f98ccc9c816 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5407367 May 12 15:10:13.604754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aa0ef64-2cfc-4009-958c-57d3e175e5cb req-8c0d2b7b-2db9-4afd-ad56-696a985862c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:13.606193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3aa0ef64-2cfc-4009-958c-57d3e175e5cb req-8c0d2b7b-2db9-4afd-ad56-696a985862c3 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8de7231c-cca8-4041-a1ba-b8eba5dd5861 HTTP/1.1" status: 200 len: 860 time: 0.1619968 May 12 15:10:13.642820 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c44cddaf-245a-4586-b8c5-ac38a542ab9d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:13.706704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.84', 55229) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:13.714353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:10:13.737901 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c44cddaf-245a-4586-b8c5-ac38a542ab9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:13.849420 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a3478c2b-fafc-4acf-abce-c432fa4e874d details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:10:13.855205 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3aa0ef64-2cfc-4009-958c-57d3e175e5cb req-155acdd2-583c-42c8-8606-210d4799c21a service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=74c45f45-b34b-4876-a35b-8ae714cf4d5f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2259698 May 12 15:10:13.917974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:13.942960 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c44cddaf-245a-4586-b8c5-ac38a542ab9d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5600ff2864d14ed6b2d90c0e21371b8a&name=default HTTP/1.1" status: 200 len: 2979 time: 1.5090449 May 12 15:10:13.953733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bbcc859-cfd9-4fb4-af04-08ff8a0116c6 req-9ccf7d3e-8ec6-4238-abd9-d584cb821395 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:13.961005 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8bbcc859-cfd9-4fb4-af04-08ff8a0116c6 req-9ccf7d3e-8ec6-4238-abd9-d584cb821395 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 936 time: 0.6252367 May 12 15:10:13.968602 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d7e09d66-2268-48c4-a658-ef10261e7a46 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:10:13.977078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50706) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:14.018503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c44cddaf-245a-4586-b8c5-ac38a542ab9d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8cadf030-cce4-47d3-9c75-3c30b967ac07,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:14.037967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 83a7b910-a912-4e05-9d03-5d6b1f6b0edc {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:14.073100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21ee060a-56e2-42b3-ae10-e281d3549c9c req-d8c56a83-4f61-4d41-8b09-55b13b4f528b tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:14.077984 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21ee060a-56e2-42b3-ae10-e281d3549c9c req-d8c56a83-4f61-4d41-8b09-55b13b4f528b tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 945 time: 0.6325133 May 12 15:10:14.086591 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:14.107778 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7081b41-b887-4719-965e-d71c9f271224 req-f8b4858a-7ca0-452d-a20a-e5c58f6d189e service neutron] 10.222.0.76 "GET /v2.0/networks/e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5046985 May 12 15:10:14.111436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: d7e09d66-2268-48c4-a658-ef10261e7a46 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:10:14.111709 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d7e09d66-2268-48c4-a658-ef10261e7a46 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:10:14.135078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a3478c2b-fafc-4acf-abce-c432fa4e874d, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3478c2b-fafc-4acf-abce-c432fa4e874d,segment=NetworkSegment(5557610c-85a4-4c18-8793-b6867e2cb17c),segment_id=5557610c-85a4-4c18-8793-b6867e2cb17c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:14.152527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'a3478c2b-fafc-4acf-abce-c432fa4e874d', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'port_id': 'a3478c2b-fafc-4acf-abce-c432fa4e874d', 'mac_address': 'fa:16:3e:94:93:3e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 563, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:10:14.154701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Transition to ACTIVE for port object 83a7b910-a912-4e05-9d03-5d6b1f6b0edc will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:14.177846 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:14.224872 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:14.225490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:10:14.236996 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Sync routers for ids ['3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:10:14.251172 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Routers {'3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:10:14.253537 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:09:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:14.257289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a3478c2b-fafc-4acf-abce-c432fa4e874d {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:14.280609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a3478c2b-fafc-4acf-abce-c432fa4e874d, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3478c2b-fafc-4acf-abce-c432fa4e874d,segment=NetworkSegment(5557610c-85a4-4c18-8793-b6867e2cb17c),segment_id=5557610c-85a4-4c18-8793-b6867e2cb17c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:14.298565 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:14.300426 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8bbcc859-cfd9-4fb4-af04-08ff8a0116c6 req-cc11629d-dd44-437b-924c-88871028b327 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3384521 May 12 15:10:14.306907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7081b41-b887-4719-965e-d71c9f271224 req-22df4588-e9b1-4a9c-98c9-8ca993ced129 service neutron] 10.222.0.76 "GET /v2.0/networks/e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1631641 May 12 15:10:14.405858 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3aa0ef64-2cfc-4009-958c-57d3e175e5cb req-f5079b91-509f-4d5d-bab7-ddd83ccd936d service neutron] 10.222.0.84 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5404887 May 12 15:10:14.432979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a3478c2b-fafc-4acf-abce-c432fa4e874d,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:14.451855 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-98d77881-ffcb-445f-a087-7fac3a9f2f11 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:14.455197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50714) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:14.484114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21ee060a-56e2-42b3-ae10-e281d3549c9c req-fa965942-cb2f-42df-b7d4-d33873f5a8f6 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3869584 May 12 15:10:14.488910 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f887d872-2523-4915-a02b-2c5630c8feff admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:14.511597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-fa351907-a105-4333-ba59-8880936a8d14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:14.513061 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-fa351907-a105-4333-ba59-8880936a8d14 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58&tenant_id=0da54985cde346e68eeadf965b8bc6d3 HTTP/1.1" status: 200 len: 1100 time: 0.8004215 May 12 15:10:14.545014 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-98d77881-ffcb-445f-a087-7fac3a9f2f11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:14.552311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a3478c2b-fafc-4acf-abce-c432fa4e874d'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:14.555684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:14.643370 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Set router 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:10:14.644296 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2f7f8dea-34c5-4da1-83e3-e19f2db2328b'] response: {'server_uuid': '65495c97-2a82-4737-a9aa-c3ca1d8ffc86', 'name': 'network-vif-deleted', 'tag': 'd7e09d66-2268-48c4-a658-ef10261e7a46', 'status': 'completed', 'code': 200} May 12 15:10:14.723199 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f887d872-2523-4915-a02b-2c5630c8feff admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:14.830759 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6e4224a9-9f02-4d2b-8369-672c248aa3a8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:14.838392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Pushing event updated for resources: {'Port': ['ID=83a7b910-a912-4e05-9d03-5d6b1f6b0edc,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:14.902218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-a23bb752-1430-4f60-8e77-8872a7ea2a9c admin admin] Deleting subnet bc8f64ab-e415-4d25-919a-8e712e76a5f6 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:10:14.914657 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3aa0ef64-2cfc-4009-958c-57d3e175e5cb req-8e406569-40d2-4b28-bdf9-04099463ed9e service neutron] 10.222.0.84 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4960554 May 12 15:10:14.923505 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0faca72f-575c-45ee-9e4b-a616038ec376 admin admin] 10.222.0.82 "PUT /v2.0/routers/3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.5849872 May 12 15:10:14.929934 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a23bb752-1430-4f60-8e77-8872a7ea2a9c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:14.958439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee2cfe2-3f5f-4571-871e-3dbbd1868c43 req-91adac7e-a766-44be-94be-c6d1aaa2c5e6 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:14.960096 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fee2cfe2-3f5f-4571-871e-3dbbd1868c43 req-91adac7e-a766-44be-94be-c6d1aaa2c5e6 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 945 time: 0.2450604 May 12 15:10:14.993944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92100dbd-b742-4ca8-8018-ae51509b8351 req-1720d271-3437-49cf-8b9d-0cc917d22c58 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:14.995570 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-92100dbd-b742-4ca8-8018-ae51509b8351 req-1720d271-3437-49cf-8b9d-0cc917d22c58 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 949 time: 0.2116692 May 12 15:10:14.998587 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f887d872-2523-4915-a02b-2c5630c8feff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.058557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f887d872-2523-4915-a02b-2c5630c8feff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8cadf030-cce4-47d3-9c75-3c30b967ac07,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:15.073276 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f887d872-2523-4915-a02b-2c5630c8feff admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.076770 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f887d872-2523-4915-a02b-2c5630c8feff admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8cadf030-cce4-47d3-9c75-3c30b967ac07 HTTP/1.1" status: 204 len: 168 time: 1.0950153 May 12 15:10:15.078019 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-98d77881-ffcb-445f-a087-7fac3a9f2f11 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bb4416240d4a49568bdb004b6710d057&name=default HTTP/1.1" status: 200 len: 2979 time: 2.1752143 May 12 15:10:15.095270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50730) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:15.108669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98d77881-ffcb-445f-a087-7fac3a9f2f11 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=875491ad-7afb-4b7c-83e1-d8cfd77009e3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:15.147759 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fee2cfe2-3f5f-4571-871e-3dbbd1868c43 req-e61f45f9-bfc4-4806-875c-728775517abc tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/security-groups?id=4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1506765 May 12 15:10:15.182632 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-92100dbd-b742-4ca8-8018-ae51509b8351 req-02c6b269-8c98-4973-b83a-f49ddaa711f1 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1676970 May 12 15:10:15.236575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Attempting to bind port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:15.236898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Attempting to bind port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:15.237220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Attempting to bind port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:15.246096 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a23bb752-1430-4f60-8e77-8872a7ea2a9c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.269793 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9c76d9f-ed6f-493d-bc53-59ca708a0559 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.293112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:10:15.293445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Attempting to bind port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:15.320031 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.354081 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9c76d9f-ed6f-493d-bc53-59ca708a0559 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.365600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 10, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:15.365939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:15.366325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:15.366766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Bound port: 83a7b910-a912-4e05-9d03-5d6b1f6b0edc, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:15.367108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.396699 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'name': 'tempest-FloatingIPDetailsTestJSON-1923857176-router', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.112'}], 'enable_snat': True}, 'gw_port_id': '43ddf270-5ffe-40d9-b4c7-c5b75ccda930', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:01Z', 'updated_at': '2022-05-12T15:10:10Z', 'revision_number': 4, 'project_id': 'd914960d703a44ae913f9a1804d5b368', 'gw_port': {'id': '43ddf270-5ffe-40d9-b4c7-c5b75ccda930', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:5a:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 728, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:02Z', 'updated_at': '2022-05-12T15:10:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '859ac872-331f-4c8a-a382-c0072053ab23', 'name': '', 'network_id': '7869b0da-59f4-4b95-80b3-2cee1e2f3494', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'mac_address': 'fa:16:3e:6c:62:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'device_owner': 'network:router_interface', 'standard_attr_id': 729, 'fixed_ips': [{'subnet_id': '55f11913-d2d9-4fda-86a7-3a4470347229', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:08Z', 'updated_at': '2022-05-12T15:10:11Z', 'revision_number': 2, 'project_id': 'd914960d703a44ae913f9a1804d5b368', 'subnets': [{'id': '55f11913-d2d9-4fda-86a7-3a4470347229', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:15.402940 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Checking router: 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:10:15.410073 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Updating router 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf port 859ac872-331f-4c8a-a382-c0072053ab23 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:10:15.462085 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9c76d9f-ed6f-493d-bc53-59ca708a0559 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.463330 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a23bb752-1430-4f60-8e77-8872a7ea2a9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.491654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9c76d9f-ed6f-493d-bc53-59ca708a0559 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=875491ad-7afb-4b7c-83e1-d8cfd77009e3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:15.493844 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9c76d9f-ed6f-493d-bc53-59ca708a0559 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.495173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f9c76d9f-ed6f-493d-bc53-59ca708a0559 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/875491ad-7afb-4b7c-83e1-d8cfd77009e3 HTTP/1.1" status: 204 len: 168 time: 0.3895190 May 12 15:10:15.507360 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.587339 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a23bb752-1430-4f60-8e77-8872a7ea2a9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.636230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50746) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:15.663461 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a23bb752-1430-4f60-8e77-8872a7ea2a9c admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.673975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a23bb752-1430-4f60-8e77-8872a7ea2a9c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bc8f64ab-e415-4d25-919a-8e712e76a5f6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:15.681016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:10:15.683513 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.728751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:15.735899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Usage tracker for resource:security_group_rule and tenant:0d31cba948554a788401d08ef09e6be6 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:15.739844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:15.748530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:15.759180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aab09fd-8dc9-4f54-bc02-cb33b2cff79d req-66cbbcac-ae19-4df0-841f-a97ec55fff03 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:15.761058 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7aab09fd-8dc9-4f54-bc02-cb33b2cff79d req-66cbbcac-ae19-4df0-841f-a97ec55fff03 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 936 time: 0.2155919 May 12 15:10:15.763905 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a23bb752-1430-4f60-8e77-8872a7ea2a9c admin admin] 10.222.0.82 "DELETE /v2.0/subnets/bc8f64ab-e415-4d25-919a-8e712e76a5f6 HTTP/1.1" status: 204 len: 168 time: 1.2548423 May 12 15:10:15.767290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50750) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:15.845837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] For port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:15.859019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a3478c2b-fafc-4acf-abce-c432fa4e874d up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:15.868411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] For port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=83a7b910-a912-4e05-9d03-5d6b1f6b0edc,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:15.870762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3ae73679-d198-440a-966c-619a9930fbcb {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:15.881373 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.893040 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:15.998323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Transition to ACTIVE for port object 3ae73679-d198-440a-966c-619a9930fbcb will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:16.008867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:16.009665 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:16.011167 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] 10.222.0.84 "PUT /v2.0/ports/83a7b910-a912-4e05-9d03-5d6b1f6b0edc HTTP/1.1" status: 200 len: 1096 time: 5.1495764 May 12 15:10:16.028334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9b2b4b7d-231c-4e54-83f4-827d02cbcbb5', 'tag': '83a7b910-a912-4e05-9d03-5d6b1f6b0edc'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:16.050146 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:16.067392 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port a3478c2b-fafc-4acf-abce-c432fa4e874d completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:16.074258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port a3478c2b-fafc-4acf-abce-c432fa4e874d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:16.074798 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:16.131141 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:16.151556 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Transition to ACTIVE for port object 859ac872-331f-4c8a-a382-c0072053ab23 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:16.155395 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:16.159621 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-6e6feedd-a328-42a6-8ab4-4d8175c8de2e tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.3963554 May 12 15:10:16.160188 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:16.174844 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:16.202253 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:16.248938 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:16.268027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:16.299940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a3478c2b-fafc-4acf-abce-c432fa4e874d, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3478c2b-fafc-4acf-abce-c432fa4e874d,segment=NetworkSegment(5557610c-85a4-4c18-8793-b6867e2cb17c),segment_id=5557610c-85a4-4c18-8793-b6867e2cb17c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:16.301212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '74ddf043-2cb7-4286-b010-6509b25bb4aa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a3478c2b-fafc-4acf-abce-c432fa4e874d'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:16.315237 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7aab09fd-8dc9-4f54-bc02-cb33b2cff79d req-5a5c91df-a65a-42d9-bf14-4f640d3f0026 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3999956 May 12 15:10:16.316499 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:16.317333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a686f1c4-b2f1-4692-950a-b2a71f6aeb6f no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:10:16.347540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Usage tracker for resource:floatingip and tenant:d914960d703a44ae913f9a1804d5b368 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:16.374705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:16.428430 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-26577a98-656c-4023-9192-6052faf850e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:16.448590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:16.451573 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a76a9c30-872b-4ecc-83e1-e766cc5e3f12 None None] Pushing event updated for resources: {'Port': ['ID=859ac872-331f-4c8a-a382-c0072053ab23,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:16.510187 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:16.660024 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a3478c2b-fafc-4acf-abce-c432fa4e874d,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:16.660468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7dd91f7-9dcd-4f44-b580-2be1dd3d3b08 service neutron] Pushing event updated for resources: {'Port': ['ID=83a7b910-a912-4e05-9d03-5d6b1f6b0edc,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:16.680101 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:16.723422 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Attempting to bind port 859ac872-331f-4c8a-a382-c0072053ab23 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:16.723781 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Attempting to bind port 859ac872-331f-4c8a-a382-c0072053ab23 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '7d065a97-a552-4415-a638-f68219b3bad1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '7869b0da-59f4-4b95-80b3-2cee1e2f3494'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:16.724148 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Attempting to bind port 859ac872-331f-4c8a-a382-c0072053ab23 on network 7869b0da-59f4-4b95-80b3-2cee1e2f3494 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:16.729674 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 10, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:16.730029 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Checking segment: {'id': '7d065a97-a552-4415-a638-f68219b3bad1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '7869b0da-59f4-4b95-80b3-2cee1e2f3494'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:16.730490 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:16.731007 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Bound using segment: {'id': '7d065a97-a552-4415-a638-f68219b3bad1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '7869b0da-59f4-4b95-80b3-2cee1e2f3494'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:16.731603 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Bound port: 859ac872-331f-4c8a-a382-c0072053ab23, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7d065a97-a552-4415-a638-f68219b3bad1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '7869b0da-59f4-4b95-80b3-2cee1e2f3494'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:16.731971 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:16.856304 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] For port 859ac872-331f-4c8a-a382-c0072053ab23, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:16.859744 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] For port 859ac872-331f-4c8a-a382-c0072053ab23, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=859ac872-331f-4c8a-a382-c0072053ab23,segment=NetworkSegment(7d065a97-a552-4415-a638-f68219b3bad1),segment_id=7d065a97-a552-4415-a638-f68219b3bad1)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:16.869597 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.007764 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Routers {'3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:10:17.008661 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:10:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:17.083204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50780) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:17.113999 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.121700 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a76a9c30-872b-4ecc-83e1-e766cc5e3f12 None None] Pushing event updated for resources: {'Port': ['ID=859ac872-331f-4c8a-a382-c0072053ab23,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:17.130362 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-26577a98-656c-4023-9192-6052faf850e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.148195 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.180285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:17.184848 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Attempting to bind port 3ae73679-d198-440a-966c-619a9930fbcb on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:17.185262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Attempting to bind port 3ae73679-d198-440a-966c-619a9930fbcb by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:17.185698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Attempting to bind port 3ae73679-d198-440a-966c-619a9930fbcb on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:17.200015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-938c6c03-c303-4057-bb96-f0c4d2c7508a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:17.201604 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-938c6c03-c303-4057-bb96-f0c4d2c7508a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=9b2b4b7d-231c-4e54-83f4-827d02cbcbb5 HTTP/1.1" status: 200 len: 1099 time: 1.0239258 May 12 15:10:17.206815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Port 3ae73679-d198-440a-966c-619a9930fbcb on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:10:17.207222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Attempting to bind port 3ae73679-d198-440a-966c-619a9930fbcb on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:17.221411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-26577a98-656c-4023-9192-6052faf850e7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['95dd1383-efe7-494d-a1ab-57e293da83a3']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:17.259317 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0d31cba948554a788401d08ef09e6be6&name=default HTTP/1.1" status: 200 len: 2979 time: 1.6216662 May 12 15:10:17.263799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50786) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:17.267390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-26577a98-656c-4023-9192-6052faf850e7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2e732768-539c-4181-b234-fc2be7d671bf') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:17.267878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-26577a98-656c-4023-9192-6052faf850e7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2e732768-539c-4181-b234-fc2be7d671bf') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:17.290815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3fd5ed-fd62-4724-a7b2-532fefca50d6 req-91b43723-d3d0-4b08-9073-6f977cfd18d3 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:17.292738 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab3fd5ed-fd62-4724-a7b2-532fefca50d6 req-91b43723-d3d0-4b08-9073-6f977cfd18d3 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 945 time: 0.6729369 May 12 15:10:17.296117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f4a6d819-9947-489a-9b2e-025ea26d8ac9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:17.319108 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] Set router 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:10:17.326984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-26577a98-656c-4023-9192-6052faf850e7 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.338481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:17.339048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:17.339542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:17.340032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:17.340501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:17.340965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:17.341470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:17.341952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:17.342413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:17.342872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:17.343485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:17.344731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 10, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:17.345049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:17.345327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a86cf786-315d-4aee-8c46-f112a3731ccf admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:17.345509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:17.345967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Bound port: 3ae73679-d198-440a-966c-619a9930fbcb, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:17.346309 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.373915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Request body: {'network': {'name': 'tempest-ServersTestManualDisk-2106532628-network', 'tenant_id': 'a673d571317840e888b6cfe5a121092e'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:17.384930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Pushing event updated for resources: {'Port': ['ID=3ae73679-d198-440a-966c-619a9930fbcb,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:17.401706 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-26577a98-656c-4023-9192-6052faf850e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.402314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:17.410330 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-d70923bc-672c-4487-9bcb-a87c10d33030 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.195&port_id=83a7b910-a912-4e05-9d03-5d6b1f6b0edc HTTP/1.1" status: 200 len: 217 time: 0.1766903 May 12 15:10:17.412734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:10:17.420385 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Usage tracker for resource:network and tenant:a673d571317840e888b6cfe5a121092e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:17.442774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-26577a98-656c-4023-9192-6052faf850e7 admin admin] Releasing vlan 567 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:10:17.443172 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-26577a98-656c-4023-9192-6052faf850e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: timer() May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:10:17.457519 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:10:17.487673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:17.523114 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.530030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:17.546554 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:17.549942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab3fd5ed-fd62-4724-a7b2-532fefca50d6 req-03c94a5b-037f-43af-8011-393bb43a38c3 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2402980 May 12 15:10:17.592154 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c632078-dffd-4857-a0ef-e115bf086859 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.604069 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-26577a98-656c-4023-9192-6052faf850e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.610292 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2c06ab12-b7e1-41dc-abf3-e4e1f144a7a8'] response: {'name': 'network-changed', 'server_uuid': '9b2b4b7d-231c-4e54-83f4-827d02cbcbb5', 'tag': '83a7b910-a912-4e05-9d03-5d6b1f6b0edc', 'status': 'completed', 'code': 200} May 12 15:10:17.616634 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-26577a98-656c-4023-9192-6052faf850e7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.639836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Made reservation on behalf of a673d571317840e888b6cfe5a121092e for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:17.642939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.658452 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.673873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6a600f18-ddf2-444d-8de2-bee99f1e2421 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:17.675321 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6a600f18-ddf2-444d-8de2-bee99f1e2421 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2483778 May 12 15:10:17.684138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.711787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26577a98-656c-4023-9192-6052faf850e7 admin admin] Pushing event deleted for resources: {'Network': ['ID=95dd1383-efe7-494d-a1ab-57e293da83a3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:17.721605 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'name': 'tempest-FloatingIPDetailsTestJSON-1923857176-router', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.112'}], 'enable_snat': True}, 'gw_port_id': '43ddf270-5ffe-40d9-b4c7-c5b75ccda930', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:01Z', 'updated_at': '2022-05-12T15:10:10Z', 'revision_number': 4, 'project_id': 'd914960d703a44ae913f9a1804d5b368', 'gw_port': {'id': '43ddf270-5ffe-40d9-b4c7-c5b75ccda930', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:5a:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 728, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:02Z', 'updated_at': '2022-05-12T15:10:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '859ac872-331f-4c8a-a382-c0072053ab23', 'name': '', 'network_id': '7869b0da-59f4-4b95-80b3-2cee1e2f3494', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'mac_address': 'fa:16:3e:6c:62:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'device_owner': 'network:router_interface', 'standard_attr_id': 729, 'fixed_ips': [{'subnet_id': '55f11913-d2d9-4fda-86a7-3a4470347229', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:08Z', 'updated_at': '2022-05-12T15:10:16Z', 'revision_number': 4, 'project_id': 'd914960d703a44ae913f9a1804d5b368', 'subnets': [{'id': '55f11913-d2d9-4fda-86a7-3a4470347229', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:17.726293 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e37201c-0518-4a46-9cd8-9a0bb54ec1bf None None] The sync data for ids ['3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'] in n-d-841483-1 is: [{'id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'name': 'tempest-FloatingIPDetailsTestJSON-1923857176-router', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.112'}], 'enable_snat': True}, 'gw_port_id': '43ddf270-5ffe-40d9-b4c7-c5b75ccda930', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:01Z', 'updated_at': '2022-05-12T15:10:10Z', 'revision_number': 4, 'project_id': 'd914960d703a44ae913f9a1804d5b368', 'gw_port': {'id': '43ddf270-5ffe-40d9-b4c7-c5b75ccda930', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:5a:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 728, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:02Z', 'updated_at': '2022-05-12T15:10:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '859ac872-331f-4c8a-a382-c0072053ab23', 'name': '', 'network_id': '7869b0da-59f4-4b95-80b3-2cee1e2f3494', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'mac_address': 'fa:16:3e:6c:62:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'device_owner': 'network:router_interface', 'standard_attr_id': 729, 'fixed_ips': [{'subnet_id': '55f11913-d2d9-4fda-86a7-3a4470347229', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:08Z', 'updated_at': '2022-05-12T15:10:16Z', 'revision_number': 4, 'project_id': 'd914960d703a44ae913f9a1804d5b368', 'subnets': [{'id': '55f11913-d2d9-4fda-86a7-3a4470347229', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:10:17.745995 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.753954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:17.764296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] For port 3ae73679-d198-440a-966c-619a9930fbcb, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:17.785573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] For port 3ae73679-d198-440a-966c-619a9930fbcb, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3ae73679-d198-440a-966c-619a9930fbcb,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:17.803270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Usage tracker for resource:security_group_rule and tenant:a673d571317840e888b6cfe5a121092e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:17.809251 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-26577a98-656c-4023-9192-6052faf850e7 admin admin] 10.222.0.82 "DELETE /v2.0/networks/95dd1383-efe7-494d-a1ab-57e293da83a3 HTTP/1.1" status: 204 len: 168 time: 1.9032631 May 12 15:10:17.810895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50792) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:17.811671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:17.818003 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.822568 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c632078-dffd-4857-a0ef-e115bf086859 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.912089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:17.921274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Transition to ACTIVE for port object a686f1c4-b2f1-4692-950a-b2a71f6aeb6f will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:17.980496 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:17.993735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70066b81-8e57-460d-848b-18b85bf60e7e req-783d02f8-dc1e-4885-a8e6-20ef9939ca9e tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:18.001419 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70066b81-8e57-460d-848b-18b85bf60e7e req-783d02f8-dc1e-4885-a8e6-20ef9939ca9e tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 946 time: 0.2757294 May 12 15:10:18.004227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Allocated IP 172.25.8.193 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/cb5b0c58-0341-4cca-9cd7-d49f1e80f42a) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:18.007252 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c632078-dffd-4857-a0ef-e115bf086859 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:18.025838 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:10:18.026293 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:10:18.026651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:18.027273 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:18.028678 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] 10.222.0.84 "PUT /v2.0/ports/3ae73679-d198-440a-966c-619a9930fbcb HTTP/1.1" status: 200 len: 1096 time: 4.6874545 May 12 15:10:18.059617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c632078-dffd-4857-a0ef-e115bf086859 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4a6d819-9947-489a-9b2e-025ea26d8ac9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:18.176889 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c632078-dffd-4857-a0ef-e115bf086859 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:18.180377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5c632078-dffd-4857-a0ef-e115bf086859 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f4a6d819-9947-489a-9b2e-025ea26d8ac9 HTTP/1.1" status: 204 len: 168 time: 0.8839800 May 12 15:10:18.190062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cfb97be-6e08-42e4-a04b-37b7a2071238 service neutron] Pushing event updated for resources: {'Port': ['ID=3ae73679-d198-440a-966c-619a9930fbcb,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:18.220987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70066b81-8e57-460d-848b-18b85bf60e7e req-14b608f8-52ad-4b43-8f20-77e7bdf7445d tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/security-groups?id=4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2184153 May 12 15:10:18.354101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-7d616d94-f278-4913-a27f-dc95e7b9973c admin admin] Deleting subnet 6fc460c7-68bc-4e44-96ec-27887841733e {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:10:18.354420 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:18.356447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] No DVR routers for this DVR port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:10:18.397639 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d616d94-f278-4913-a27f-dc95e7b9973c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:18.415596 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:18.570418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:18.580717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:18.588350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Pushing event updated for resources: {'Port': ['ID=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,revision_number=10']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:18.590143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:18.592234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-1e65ad25-786a-4b64-8e63-9257af373db1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:18.597622 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-1e65ad25-786a-4b64-8e63-9257af373db1 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.8936954 May 12 15:10:18.659939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Attempting to bind port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:18.660261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Attempting to bind port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:18.660606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Attempting to bind port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:18.674350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Pushing event updated for resources: {'Port': ['ID=cb5b0c58-0341-4cca-9cd7-d49f1e80f42a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:18.696639 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d616d94-f278-4913-a27f-dc95e7b9973c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:18.714671 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3044b6a0-8311-48b6-b553-fe66143754c3 req-83a26f43-93a9-4467-bd17-2b98ce4a1a53 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:18.716481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3044b6a0-8311-48b6-b553-fe66143754c3 req-83a26f43-93a9-4467-bd17-2b98ce4a1a53 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 948 time: 0.2881522 May 12 15:10:18.786418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:18.788240 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:18.789516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:10:18.790223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Attempting to bind port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:18.804119 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3044b6a0-8311-48b6-b553-fe66143754c3 req-97070fe5-fbfa-4a8d-9b69-c74aedd7175c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806782 May 12 15:10:18.872522 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c61738d2-0b42-4374-a5f5-5b43fffe2860'] response: {'server_uuid': '74ddf043-2cb7-4286-b010-6509b25bb4aa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a3478c2b-fafc-4acf-abce-c432fa4e874d', 'code': 200} May 12 15:10:18.874713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:18.887434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 552} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:10:18.899039 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:18.899395 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Added segment 0f481a89-826f-4a90-903d-276e9b18feb1 of type vlan for network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 May 12 15:10:18.936227 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:18.950344 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:19.020903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 10, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:19.021425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:19.021739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:19.022145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Bound port: a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:19.022488 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:19.042229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-8affb371-4acd-4d78-9a83-f1b116785387 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:19.044125 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-8affb371-4acd-4d78-9a83-f1b116785387 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 1099 time: 0.8906672 May 12 15:10:19.044758 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:19.045895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:19.046584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:19.117779 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 859ac872-331f-4c8a-a382-c0072053ab23 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:19.241067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 859ac872-331f-4c8a-a382-c0072053ab23 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:19.252695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 859ac872-331f-4c8a-a382-c0072053ab23 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:19.253609 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:19.278369 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 2.1842353 May 12 15:10:19.280471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50818) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:19.361330 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-b50d0550-6bcf-4393-ad3d-2d6ea40fdd54 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.165&port_id=3ae73679-d198-440a-966c-619a9930fbcb HTTP/1.1" status: 200 len: 217 time: 0.2544529 May 12 15:10:19.393209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd8123d-baca-4fcc-98e0-ac57e2392984 req-6570af52-4d8d-4db0-a4d8-999fb870765a tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:19.394764 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5cd8123d-baca-4fcc-98e0-ac57e2392984 req-6570af52-4d8d-4db0-a4d8-999fb870765a tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 948 time: 0.3853114 May 12 15:10:19.398879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1015db80-7a0b-4bea-9c42-283e2e72a60f req-3bdea559-0c1f-4bb4-82a9-f412fbfb946e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:19.400280 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1015db80-7a0b-4bea-9c42-283e2e72a60f req-3bdea559-0c1f-4bb4-82a9-f412fbfb946e service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 1097 time: 0.3920357 May 12 15:10:19.401518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Request body: {'subnet': {'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestManualDisk-2106532628-subnet', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:19.497199 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:19.536043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5cd8123d-baca-4fcc-98e0-ac57e2392984 req-bc9dd248-e182-42f5-af7e-750ac9d14da6 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1347866 May 12 15:10:19.548380 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 859ac872-331f-4c8a-a382-c0072053ab23, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=859ac872-331f-4c8a-a382-c0072053ab23,segment=NetworkSegment(7d065a97-a552-4415-a638-f68219b3bad1),segment_id=7d065a97-a552-4415-a638-f68219b3bad1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:19.554777 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1015db80-7a0b-4bea-9c42-283e2e72a60f req-a2899036-eee4-4e51-a1d3-98facaf75f58 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0890076 May 12 15:10:19.559171 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:19.591952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:19.599231 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:19.650987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=859ac872-331f-4c8a-a382-c0072053ab23,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:19.699640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f'}, {'name': 'network-changed', 'server_uuid': '000d5cf1-e430-46d6-a455-2550da7e4b71', 'tag': '3ae73679-d198-440a-966c-619a9930fbcb'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:19.704612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b07ab56c-6992-461f-9d49-85a5e3334b7e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:19.715876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:19.746383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Usage tracker for resource:subnet and tenant:a673d571317840e888b6cfe5a121092e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:19.751175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d616d94-f278-4913-a27f-dc95e7b9973c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:19.787710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:19.799185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c3f87d8-27f6-4be4-aa96-ee0d550f61e9 admin admin] Pushing event updated for resources: {'Network': ['ID=7336b0e1-6ae7-4c8a-98e8-3f13adbdc190,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:19.810317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:10:19.826261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:19.867368 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-67947582-f2f1-419e-b364-570a598d0cb9 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.2582972 May 12 15:10:19.880858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-c9b43a12-4c31-4e38-910e-052f9cbb00bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:19.882336 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-c9b43a12-4c31-4e38-910e-052f9cbb00bc service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.4902828 May 12 15:10:19.909110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Made reservation on behalf of a673d571317840e888b6cfe5a121092e for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:19.912013 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:19.916177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Pushing event updated for resources: {'Port': ['ID=cb5b0c58-0341-4cca-9cd7-d49f1e80f42a,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:19.929431 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:19.957934 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:19.962732 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-7061af5d-69c5-4bbb-903a-0f0c59083583 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 3.8014386 May 12 15:10:19.964536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:20.039676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-079d5777-c8c3-438e-828b-2b413a6fb49d req-58483ca0-a3b1-4e53-b762-a627cdd73053 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:20.041213 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-079d5777-c8c3-438e-828b-2b413a6fb49d req-58483ca0-a3b1-4e53-b762-a627cdd73053 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 945 time: 0.3262970 May 12 15:10:20.082424 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-84b447f6-4c02-425f-a7e2-be5820c8bc34 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Synchronizing usage tracker for tenant:d914960d703a44ae913f9a1804d5b368 on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:20.118524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:20.122932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-079d5777-c8c3-438e-828b-2b413a6fb49d req-2a6680ef-df76-4f58-85de-1b318cd0bc46 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0622675 May 12 15:10:20.124108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-84b447f6-4c02-425f-a7e2-be5820c8bc34 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Unset dirty status for tenant:d914960d703a44ae913f9a1804d5b368 on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:20.132367 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-84b447f6-4c02-425f-a7e2-be5820c8bc34 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.193 HTTP/1.1" status: 200 len: 696 time: 0.1654346 May 12 15:10:20.146329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:20.227458 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d616d94-f278-4913-a27f-dc95e7b9973c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:20.313898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:20.314532 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:20.316131 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] 10.222.0.84 "PUT /v2.0/ports/a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 200 len: 1096 time: 5.7849233 May 12 15:10:20.323814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d616d94-f278-4913-a27f-dc95e7b9973c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6fc460c7-68bc-4e44-96ec-27887841733e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:20.336378 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d616d94-f278-4913-a27f-dc95e7b9973c admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:20.347800 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-46bcb3c6-beff-45e5-8e80-892119dff999 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4726818 May 12 15:10:20.365603 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7d616d94-f278-4913-a27f-dc95e7b9973c admin admin] 10.222.0.82 "DELETE /v2.0/subnets/6fc460c7-68bc-4e44-96ec-27887841733e HTTP/1.1" status: 204 len: 168 time: 2.5436120 May 12 15:10:20.366468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50842) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:20.443800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5687f8ef-9a75-4115-a85f-476b0a8f0346 service neutron] Pushing event updated for resources: {'Port': ['ID=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,revision_number=11']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:20.464291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040d1e25-fca5-41f5-ba93-daac0383beea req-de01ebfd-d1d4-444e-980e-5d2541144a6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:20.465932 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-de01ebfd-d1d4-444e-980e-5d2541144a6c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.5620060 May 12 15:10:20.469271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-498b6c63-2d2e-4264-8656-51b9d7b37772 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:20.472103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7506e0b9-dd07-41bf-bea9-066fd9a8f9f2 req-498b6c63-2d2e-4264-8656-51b9d7b37772 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.3388326 May 12 15:10:20.508048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf1cab4e-5c35-4dd8-b8a9-3e7b29ae8902 req-8016aa57-e65d-41d0-8056-65386b39165c tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:20.519240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cf1cab4e-5c35-4dd8-b8a9-3e7b29ae8902 req-8016aa57-e65d-41d0-8056-65386b39165c tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 946 time: 0.2186081 May 12 15:10:20.590062 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cf1cab4e-5c35-4dd8-b8a9-3e7b29ae8902 req-29d3f22c-7e51-4072-801e-643574ce2d74 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/security-groups?id=4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0667174 May 12 15:10:20.648223 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-af23ee5e-1289-4181-8694-9db96aad68bb'] response: {'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'code': 200} May 12 15:10:20.648732 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-af23ee5e-1289-4181-8694-9db96aad68bb'] response: {'name': 'network-changed', 'server_uuid': '000d5cf1-e430-46d6-a455-2550da7e4b71', 'tag': '3ae73679-d198-440a-966c-619a9930fbcb', 'status': 'completed', 'code': 200} May 12 15:10:20.776133 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8284e191-e7ba-46c6-8a4c-8e23011ffbf4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:20.840654 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-8407b4ab-cbcc-43ae-9cd9-fe17e7456123 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.2322638 May 12 15:10:20.854324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e122c33a-0af6-47b0-91fd-69f3f0162309 req-7501a275-e011-4213-ba56-6d957d22c88b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:20.856482 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e122c33a-0af6-47b0-91fd-69f3f0162309 req-7501a275-e011-4213-ba56-6d957d22c88b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 948 time: 0.1544764 May 12 15:10:20.862001 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:20.869102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:20.897784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:20.915689 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:20.924257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e122c33a-0af6-47b0-91fd-69f3f0162309 req-cb2608ca-b461-4345-a17c-077a8b91acfc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563567 May 12 15:10:20.925554 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:20.961094 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-0ad34926-293d-4fe8-afe5-a0e39c26e289 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4239743 May 12 15:10:20.971789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-2b089c48-6885-4848-8ad4-7540a96ebf19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:20.973226 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-2b089c48-6885-4848-8ad4-7540a96ebf19 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 1099 time: 0.6057019 May 12 15:10:21.047722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 859ac872-331f-4c8a-a382-c0072053ab23 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:21.098018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78af6dfa-b3af-4b48-9af5-b15f4c1d8b75 req-73da4d17-26a9-4678-aa33-d23542775f91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:21.099497 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78af6dfa-b3af-4b48-9af5-b15f4c1d8b75 req-73da4d17-26a9-4678-aa33-d23542775f91 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=9b2b4b7d-231c-4e54-83f4-827d02cbcbb5 HTTP/1.1" status: 200 len: 1099 time: 0.5589390 May 12 15:10:21.120507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 859ac872-331f-4c8a-a382-c0072053ab23 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:21.120897 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:21.157427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-555e5bfe-a22b-4fc2-88d2-f88d4f6a75fe req-ec74d3f5-07ef-47c8-9272-1cfeff81c003 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:21.159104 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-555e5bfe-a22b-4fc2-88d2-f88d4f6a75fe req-ec74d3f5-07ef-47c8-9272-1cfeff81c003 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 948 time: 0.1227825 May 12 15:10:21.181976 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:21.249751 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8284e191-e7ba-46c6-8a4c-8e23011ffbf4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:21.259321 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-555e5bfe-a22b-4fc2-88d2-f88d4f6a75fe req-8e0976c8-1c10-49a4-8211-02e5dbf73ab9 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0922081 May 12 15:10:21.370191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Allocated IP 172.25.8.201 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/4815bb65-7c5e-4bdf-8e5f-4e3ab599f1a9) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:21.526999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=eb51e145-1f59-4ab5-b2f3-a32c2c6ee575,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:21.544383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8284e191-e7ba-46c6-8a4c-8e23011ffbf4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eb4eaa8c-a12a-4771-b1b0-b81266e37b2a']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:21.552102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-9ba79e80-ec24-485d-8fcb-89e80abcf1e0 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=8a871ef1e9124e35b230ac65e37bd02e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0415516 May 12 15:10:21.559362 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:21.570683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8284e191-e7ba-46c6-8a4c-8e23011ffbf4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3e473d99-7071-49a4-8121-959ab1957563') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:21.570988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8284e191-e7ba-46c6-8a4c-8e23011ffbf4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3e473d99-7071-49a4-8121-959ab1957563') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:21.587605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Checking segment: {'id': '0f481a89-826f-4a90-903d-276e9b18feb1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:21.587965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Network hostable DHCP agents. Network: 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:10:21.611908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8284e191-e7ba-46c6-8a4c-8e23011ffbf4 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:21.686413 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8284e191-e7ba-46c6-8a4c-8e23011ffbf4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:21.715837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-837395ad-058f-4483-9753-e391f15b8e35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:21.717285 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-837395ad-058f-4483-9753-e391f15b8e35 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.6707163 May 12 15:10:21.724063 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-040d1e25-fca5-41f5-ba93-daac0383beea req-c946e3a1-b7f1-4872-8334-e43011b4cb10 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7499120 May 12 15:10:21.725027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ca97024c-d0f3-42c6-8f73-9ec72533a5ad tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:21.726142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8284e191-e7ba-46c6-8a4c-8e23011ffbf4 admin admin] Releasing vlan 554 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:10:21.726507 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8284e191-e7ba-46c6-8a4c-8e23011ffbf4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:21.726613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ca97024c-d0f3-42c6-8f73-9ec72533a5ad tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1644127 May 12 15:10:21.728119 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: timer() May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:10:21.741544 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:10:21.743631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78af6dfa-b3af-4b48-9af5-b15f4c1d8b75 req-115a126a-c21e-4697-8ee8-ee71867ce4d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:21.744338 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78af6dfa-b3af-4b48-9af5-b15f4c1d8b75 req-115a126a-c21e-4697-8ee8-ee71867ce4d1 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.6281674 May 12 15:10:21.799714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-8379e75d-1c24-40e0-a8a8-b74104576557 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/quotas/8a871ef1e9124e35b230ac65e37bd02e HTTP/1.1" status: 200 len: 375 time: 0.0317943 May 12 15:10:21.810408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:10:21.817464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:21.856478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:21.859356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:21.902043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-91bef295-ddd7-49be-964c-db0ff3bda8fd tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=8a871ef1e9124e35b230ac65e37bd02e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0924935 May 12 15:10:21.913170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Pushing event updated for resources: {'Port': ['ID=4815bb65-7c5e-4bdf-8e5f-4e3ab599f1a9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:21.925172 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-83bf6c90-8ceb-4229-9091-10246046bdb8 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.52&port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 200 len: 217 time: 0.2000561 May 12 15:10:21.960624 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:21.980863 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78af6dfa-b3af-4b48-9af5-b15f4c1d8b75 req-3a932594-8b23-4aeb-b513-03e165038de0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.195&port_id=83a7b910-a912-4e05-9d03-5d6b1f6b0edc HTTP/1.1" status: 200 len: 217 time: 0.1767571 May 12 15:10:22.038930 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:22.069045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:22.078023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a3ac118-3b6b-426b-bf61-1694e4b6c760 None None] Network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:10:22.116041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:22.116611 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:22.145611 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8284e191-e7ba-46c6-8a4c-8e23011ffbf4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:22.159952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-4616160c-7d5b-47c2-b87a-079294b5bb28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:22.161282 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-4616160c-7d5b-47c2-b87a-079294b5bb28 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1825008 May 12 15:10:22.183798 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8284e191-e7ba-46c6-8a4c-8e23011ffbf4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:22.227639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78af6dfa-b3af-4b48-9af5-b15f4c1d8b75 req-dd9f9a5e-d4b9-495c-bee5-baab490feb41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:22.229525 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78af6dfa-b3af-4b48-9af5-b15f4c1d8b75 req-dd9f9a5e-d4b9-495c-bee5-baab490feb41 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2022796 May 12 15:10:22.247226 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8284e191-e7ba-46c6-8a4c-8e23011ffbf4 admin admin] Pushing event deleted for resources: {'Network': ['ID=eb4eaa8c-a12a-4771-b1b0-b81266e37b2a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:22.250094 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-99becbe3-67fb-4d65-89ad-3e24e9d022a0 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 2.9017692 May 12 15:10:22.291171 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8284e191-e7ba-46c6-8a4c-8e23011ffbf4 admin admin] 10.222.0.82 "DELETE /v2.0/networks/eb4eaa8c-a12a-4771-b1b0-b81266e37b2a HTTP/1.1" status: 204 len: 168 time: 1.9202383 May 12 15:10:22.293836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50880) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:22.339210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Request body: {'router': {'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:22.387798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:22.409722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Usage tracker for resource:router and tenant:a673d571317840e888b6cfe5a121092e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:22.430948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:22.459154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:22.471763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e1d0c0-9e5d-40e0-90de-84ea44a625cc req-654b2a08-19ce-4a44-ad8c-c08ec1b2e269 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:22.482678 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a0e1d0c0-9e5d-40e0-90de-84ea44a625cc req-654b2a08-19ce-4a44-ad8c-c08ec1b2e269 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 1099 time: 0.5666451 May 12 15:10:22.491027 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'fixed_ips': [{'subnet_id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:10:22.492241 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:22.515484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d742a23-c25c-442b-ba54-0317b7e18575 req-db0cbccd-2a8b-4bbf-a063-0cb144c92e59 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:22.518204 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0d742a23-c25c-442b-ba54-0317b7e18575 req-db0cbccd-2a8b-4bbf-a063-0cb144c92e59 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 945 time: 0.1974585 May 12 15:10:22.555263 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:22.556316 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:22.585211 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0d742a23-c25c-442b-ba54-0317b7e18575 req-fa4154c9-a58d-44ec-9a1f-8e19f2893c24 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574422 May 12 15:10:22.606559 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:22.621853 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:22.651953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:22.664292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50890) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:22.676076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-06daa594-8c9e-4324-a42c-aca1dcf9e9fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:22.677841 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-06daa594-8c9e-4324-a42c-aca1dcf9e9fa service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.4889927 May 12 15:10:22.705623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Pushing event updated for resources: {'Port': ['ID=4815bb65-7c5e-4bdf-8e5f-4e3ab599f1a9,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:22.728687 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:22.737783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78af6dfa-b3af-4b48-9af5-b15f4c1d8b75 req-ff5f1745-a17c-4ea4-a8f5-f7228b07ace9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:22.739536 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78af6dfa-b3af-4b48-9af5-b15f4c1d8b75 req-ff5f1745-a17c-4ea4-a8f5-f7228b07ace9 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.4940600 May 12 15:10:22.764220 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Allocated IP 172.20.0.2 (7336b0e1-6ae7-4c8a-98e8-3f13adbdc190/eb51e145-1f59-4ab5-b2f3-a32c2c6ee575/adab67f3-e920-4d7e-965f-e2431533c911) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:22.770998 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:22.804534 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:22.806243 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-36d89351-6725-4d3d-a3b6-d0ff62cfad7d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 1.9486067 May 12 15:10:22.931175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-a887b340-fd3e-40ff-8d8b-b8927e220032 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Synchronizing usage tracker for tenant:d914960d703a44ae913f9a1804d5b368 on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:22.963609 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d8391354-47d0-49bf-8246-5a6fcf2cb3c6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1b3825228b0e4c42a381540b66ea23d6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2939310 May 12 15:10:22.963609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e1d0c0-9e5d-40e0-90de-84ea44a625cc req-f55e11cf-739a-46f2-ba94-6a3da661e3e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:22.964296 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a0e1d0c0-9e5d-40e0-90de-84ea44a625cc req-f55e11cf-739a-46f2-ba94-6a3da661e3e1 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.4740372 May 12 15:10:22.966919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50896) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:23.022279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-a887b340-fd3e-40ff-8d8b-b8927e220032 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Unset dirty status for tenant:d914960d703a44ae913f9a1804d5b368 on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:23.023550 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-a887b340-fd3e-40ff-8d8b-b8927e220032 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.201 HTTP/1.1" status: 200 len: 696 time: 0.2116351 May 12 15:10:23.072500 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3acb81f1-3e1e-4357-8492-8b85372932d9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:23.080919 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:23.092383 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Transition to ACTIVE for port object adab67f3-e920-4d7e-965f-e2431533c911 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:23.111362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Transition to ACTIVE for port object adab67f3-e920-4d7e-965f-e2431533c911 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:23.117002 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:23.152007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ea9cab4-f776-4848-a362-257096127f4e req-4a2b31bf-4f53-4861-90f1-c451dc4ea7a4 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:23.153574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ea9cab4-f776-4848-a362-257096127f4e req-4a2b31bf-4f53-4861-90f1-c451dc4ea7a4 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 946 time: 0.2643647 May 12 15:10:23.174907 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:23.182904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:23.192585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:23.216723 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3acb81f1-3e1e-4357-8492-8b85372932d9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:23.339562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ea9cab4-f776-4848-a362-257096127f4e req-c78c49f7-853f-479b-9639-5649645333d4 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/security-groups?id=4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1693988 May 12 15:10:23.342743 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a0e1d0c0-9e5d-40e0-90de-84ea44a625cc req-3c1ec358-aa31-4725-af47-adf9a0e502a0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.165&port_id=3ae73679-d198-440a-966c-619a9930fbcb HTTP/1.1" status: 200 len: 217 time: 0.3219044 May 12 15:10:23.371876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-4471da4c-1cb9-48bd-b448-690b7fe32db7 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:23.377150 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-4471da4c-1cb9-48bd-b448-690b7fe32db7 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.3446908 May 12 15:10:23.380209 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3acb81f1-3e1e-4357-8492-8b85372932d9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:23.410716 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3ae73679-d198-440a-966c-619a9930fbcb details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:10:23.413154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Pushing event updated for resources: {'Port': ['ID=adab67f3-e920-4d7e-965f-e2431533c911,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:23.417964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-04ff0c15-0ef8-4c07-b3da-14402439c535 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:10:23.421836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Attempting to bind port adab67f3-e920-4d7e-965f-e2431533c911 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:23.421836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Attempting to bind port adab67f3-e920-4d7e-965f-e2431533c911 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '0f481a89-826f-4a90-903d-276e9b18feb1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:23.422722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Attempting to bind port adab67f3-e920-4d7e-965f-e2431533c911 on network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:23.426245 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-869f31f2-6541-4918-bcc7-67ec6f167a5c req-04ff0c15-0ef8-4c07-b3da-14402439c535 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0410628 May 12 15:10:23.432604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3acb81f1-3e1e-4357-8492-8b85372932d9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6ec58c1-c78a-4ff9-910e-6e5d7e93734d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:23.437137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 10, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:23.437678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Checking segment: {'id': '0f481a89-826f-4a90-903d-276e9b18feb1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:23.438761 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:23.439173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Bound using segment: {'id': '0f481a89-826f-4a90-903d-276e9b18feb1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:23.439697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Bound port: adab67f3-e920-4d7e-965f-e2431533c911, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0f481a89-826f-4a90-903d-276e9b18feb1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:23.440054 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:23.613462 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3acb81f1-3e1e-4357-8492-8b85372932d9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:23.618512 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3acb81f1-3e1e-4357-8492-8b85372932d9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a6ec58c1-c78a-4ff9-910e-6e5d7e93734d HTTP/1.1" status: 204 len: 168 time: 0.6474166 May 12 15:10:23.623589 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-6f4e370c-a901-4e51-9477-004a8977af3c tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=8a871ef1e9124e35b230ac65e37bd02e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1638703 May 12 15:10:23.691355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e1d0c0-9e5d-40e0-90de-84ea44a625cc req-ac31973a-c8af-43ff-b5ee-21ffb752da26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:23.692780 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a0e1d0c0-9e5d-40e0-90de-84ea44a625cc req-ac31973a-c8af-43ff-b5ee-21ffb752da26 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3340385 May 12 15:10:23.701435 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-47e009f6-a5fe-4963-a3af-328ca4bfc4a4 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0058670 May 12 15:10:23.703722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] For port adab67f3-e920-4d7e-965f-e2431533c911, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:23.705375 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:23.731556 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] For port adab67f3-e920-4d7e-965f-e2431533c911, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=adab67f3-e920-4d7e-965f-e2431533c911,segment=NetworkSegment(0f481a89-826f-4a90-903d-276e9b18feb1),segment_id=0f481a89-826f-4a90-903d-276e9b18feb1)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:23.747955 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:23.769573 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78af6dfa-b3af-4b48-9af5-b15f4c1d8b75 req-092d62ef-1521-4e93-a29a-749f24096e67 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9533434 May 12 15:10:23.800863 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d1dfb42-cd0a-463f-bb3e-c70f185d8443 req-56383894-2fa6-429d-a6b2-6f34ed6dc976 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=ec64d0a8-e302-4f1f-b954-5a422e360221 HTTP/1.1" status: 200 len: 210 time: 0.1687603 May 12 15:10:23.878022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-cc4e8ae1-2e00-4be1-ab27-1668cc295d21 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:23.879494 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-cc4e8ae1-2e00-4be1-ab27-1668cc295d21 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2040429 May 12 15:10:23.891896 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 3ae73679-d198-440a-966c-619a9930fbcb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3ae73679-d198-440a-966c-619a9930fbcb,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:23.896177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08194106-8537-4fb7-899f-6a55cc3539ca req-d46638db-983f-4147-a2ea-f860308685ca tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:23.897709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08194106-8537-4fb7-899f-6a55cc3539ca req-d46638db-983f-4147-a2ea-f860308685ca tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 948 time: 0.3587053 May 12 15:10:23.902566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Request body: {'port': {'device_id': 'ec64d0a8-e302-4f1f-b954-5a422e360221', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '8a871ef1e9124e35b230ac65e37bd02e'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:23.931479 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '3ae73679-d198-440a-966c-619a9930fbcb', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '3ae73679-d198-440a-966c-619a9930fbcb', 'mac_address': 'fa:16:3e:14:60:3c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.165'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:10:23.936914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4675a321-8f55-4145-aacb-2491f6511e3b None None] Pushing event updated for resources: {'Port': ['ID=adab67f3-e920-4d7e-965f-e2431533c911,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:24.026028 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:24.050682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3ae73679-d198-440a-966c-619a9930fbcb {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:24.067749 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08194106-8537-4fb7-899f-6a55cc3539ca req-c9584370-b565-44cf-a565-ba8493c90ff7 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1494710 May 12 15:10:24.082854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 3ae73679-d198-440a-966c-619a9930fbcb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3ae73679-d198-440a-966c-619a9930fbcb,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:24.097217 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:24.105903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 83a7b910-a912-4e05-9d03-5d6b1f6b0edc details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:10:24.181087 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fedd98a6-8dd8-4cd4-8feb-3c051bf208b0 req-b0c33236-0c23-4553-8aa2-37ae34893894 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4402225 May 12 15:10:24.247903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=3ae73679-d198-440a-966c-619a9930fbcb,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:24.261974 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78af6dfa-b3af-4b48-9af5-b15f4c1d8b75 req-184c6b9b-d41b-40e5-91b0-270dea8bf443 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3653092 May 12 15:10:24.266075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e1d0c0-9e5d-40e0-90de-84ea44a625cc req-e354a2e1-6d16-4f4c-885d-bea515462d53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:24.268050 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a0e1d0c0-9e5d-40e0-90de-84ea44a625cc req-e354a2e1-6d16-4f4c-885d-bea515462d53 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.5580909 May 12 15:10:24.291409 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5119dcb4-45c5-440e-9be1-fbb2856e0d9f'] response: {'name': 'network-changed', 'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'status': 'completed', 'code': 200} May 12 15:10:24.330627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:24.330823 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=83a7b910-a912-4e05-9d03-5d6b1f6b0edc,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:24.334887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Usage tracker for resource:port and tenant:8a871ef1e9124e35b230ac65e37bd02e is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:24.337924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:24.344603 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:24.364065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '83a7b910-a912-4e05-9d03-5d6b1f6b0edc', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '83a7b910-a912-4e05-9d03-5d6b1f6b0edc', 'mac_address': 'fa:16:3e:cc:6b:60', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.195'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:10:24.391663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50910) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:24.444619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Made reservation on behalf of 8a871ef1e9124e35b230ac65e37bd02e for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:24.449178 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:24.480608 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:24.483937 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:24.500715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 83a7b910-a912-4e05-9d03-5d6b1f6b0edc {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:24.519300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=83a7b910-a912-4e05-9d03-5d6b1f6b0edc,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:24.527262 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:24.545321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:24.556908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Usage tracker for resource:security_group_rule and tenant:8a871ef1e9124e35b230ac65e37bd02e is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:24.567506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:24.581164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:24.598319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a32771a-b699-4bdf-a60e-4723a946f0b3 req-193a4854-d26d-45ce-b0ac-c1358d659f87 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:24.599796 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a32771a-b699-4bdf-a60e-4723a946f0b3 req-193a4854-d26d-45ce-b0ac-c1358d659f87 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 949 time: 0.6080773 May 12 15:10:24.611243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=83a7b910-a912-4e05-9d03-5d6b1f6b0edc,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:24.621346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-5d765aea-701a-4208-bc00-2f8b4adf5db2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:24.622829 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-5d765aea-701a-4208-bc00-2f8b4adf5db2 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 1099 time: 0.2706764 May 12 15:10:24.769674 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-55e9efed-0c29-4308-bdd8-ab4df106c467 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4b120ec547c148f686e319977fca97d7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3682103 May 12 15:10:24.776677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50914) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:24.783084 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a0e1d0c0-9e5d-40e0-90de-84ea44a625cc req-31da70a7-a0a8-41a0-961c-7fa4626428e7 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4567482 May 12 15:10:24.853958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-bf5a7920-07b0-43f1-a80a-b04ddf69fc44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:24.855455 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-bf5a7920-07b0-43f1-a80a-b04ddf69fc44 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 1099 time: 0.4649267 May 12 15:10:24.869555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a465824-7c2b-497a-8807-96d069ffcfd6 req-fabba56f-3c53-4949-b533-0195f73a75cd tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:24.871033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a465824-7c2b-497a-8807-96d069ffcfd6 req-fabba56f-3c53-4949-b533-0195f73a75cd tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 946 time: 0.3900528 May 12 15:10:24.887432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50920) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:24.892675 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3ae73679-d198-440a-966c-619a9930fbcb'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:24.905473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-15b03a79-a2ee-492c-a40f-1695e9b9bf68 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Request body: {'floatingip': {'port_id': 'a3478c2b-fafc-4acf-abce-c432fa4e874d'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:24.956362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['83a7b910-a912-4e05-9d03-5d6b1f6b0edc'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:24.966392 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a32771a-b699-4bdf-a60e-4723a946f0b3 req-3a8dc0a2-b975-497f-aa70-a44797119d06 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3387525 May 12 15:10:25.186193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device adab67f3-e920-4d7e-965f-e2431533c911 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:25.194930 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:25.232261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-676b7d62-4a9e-43c0-ba78-33bad4c5c0bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:25.234793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-676b7d62-4a9e-43c0-ba78-33bad4c5c0bb service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.5897858 May 12 15:10:25.259587 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:25.290662 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:25.379387 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:25.391216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port adab67f3-e920-4d7e-965f-e2431533c911 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:25.413117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-928ddd4e-c1ee-495a-98a6-ddb7ec7f788c None None] Network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:10:25.477015 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a0e1d0c0-9e5d-40e0-90de-84ea44a625cc req-10f65fc9-79ae-415d-86bc-8740e051b79c service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6565940 May 12 15:10:25.477366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ed9b6d66-f4bf-46c2-824a-412105731ce2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:25.488257 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb772ecf-3667-437c-add0-c465517d4b97 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:25.537651 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15b03a79-a2ee-492c-a40f-1695e9b9bf68 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:25.544505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-6a5778a5-8da0-459d-8c9b-81c612742f49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:25.546179 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-6a5778a5-8da0-459d-8c9b-81c612742f49 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.6789918 May 12 15:10:25.572241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7c4251e7-f953-4c20-9e28-f6db5c3b9bb5 None None] Provisioning for port adab67f3-e920-4d7e-965f-e2431533c911 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:25.585971 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7c4251e7-f953-4c20-9e28-f6db5c3b9bb5 None None] Provisioning complete for port adab67f3-e920-4d7e-965f-e2431533c911 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:25.586337 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7c4251e7-f953-4c20-9e28-f6db5c3b9bb5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:25.608322 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb772ecf-3667-437c-add0-c465517d4b97 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:25.644311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-0074badf-85f6-42a7-848f-60e59c8a482d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.52&port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 200 len: 217 time: 0.3812368 May 12 15:10:25.708944 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-0ab783e8-f878-4ac8-91f9-9dc50e946d0a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.52&port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 200 len: 217 time: 0.1530905 May 12 15:10:25.820595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Allocated IP 172.25.8.17 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/8c5ce78c-6510-4f26-8ec1-1c039e69ff93) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:25.827364 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7c4251e7-f953-4c20-9e28-f6db5c3b9bb5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:25.832480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-49d92f32-24be-41b3-9433-93995ee8d147 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:25.834290 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-49d92f32-24be-41b3-9433-93995ee8d147 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1085856 May 12 15:10:25.876531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-7c4251e7-f953-4c20-9e28-f6db5c3b9bb5 None None] For port adab67f3-e920-4d7e-965f-e2431533c911, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=adab67f3-e920-4d7e-965f-e2431533c911,segment=NetworkSegment(0f481a89-826f-4a90-903d-276e9b18feb1),segment_id=0f481a89-826f-4a90-903d-276e9b18feb1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:25.882252 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7c4251e7-f953-4c20-9e28-f6db5c3b9bb5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:25.960730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c4251e7-f953-4c20-9e28-f6db5c3b9bb5 None None] Pushing event updated for resources: {'Port': ['ID=adab67f3-e920-4d7e-965f-e2431533c911,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:25.961497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-971c6f2d-a429-4a43-a5a0-6f44edda059d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:25.963204 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-971c6f2d-a429-4a43-a5a0-6f44edda059d service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3001189 May 12 15:10:25.967067 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb772ecf-3667-437c-add0-c465517d4b97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:26.008391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb772ecf-3667-437c-add0-c465517d4b97 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a543ee7f-b79b-4d14-900f-2472d7620622,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:26.022354 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-8dd5800f-9cd1-497d-802d-8aed52ee73c7 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 1.1259665 May 12 15:10:26.065729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:26.088082 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb772ecf-3667-437c-add0-c465517d4b97 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:26.089005 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bb772ecf-3667-437c-add0-c465517d4b97 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a543ee7f-b79b-4d14-900f-2472d7620622 HTTP/1.1" status: 204 len: 168 time: 1.3096838 May 12 15:10:26.089361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:26.112225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-b01cfb6d-1984-46d7-b599-e225057c460b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:26.113907 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-b01cfb6d-1984-46d7-b599-e225057c460b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2697477 May 12 15:10:26.121754 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:26.175349 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Allocated IP 192.168.233.191 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/e8c30887-a54f-44a8-af0a-122711662e1e) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:26.223631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f23eb1-64d9-4800-9f47-a6d67cc871ca req-d01b4c04-b9d2-46bd-bc1e-7898def7c61c tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:26.225250 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81f23eb1-64d9-4800-9f47-a6d67cc871ca req-d01b4c04-b9d2-46bd-bc1e-7898def7c61c tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 945 time: 0.9670160 May 12 15:10:26.227852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:26.361039 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:26.367724 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-62b50e08-4f66-43c9-9065-3ddb74151c11 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2437315 May 12 15:10:26.424486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6db4ac84-e46f-4a14-9319-4018343bd380 None None] Provisioning complete for port adab67f3-e920-4d7e-965f-e2431533c911 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:26.425477 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6db4ac84-e46f-4a14-9319-4018343bd380 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:26.471202 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:26.571159 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Pushing event updated for resources: {'Port': ['ID=8c5ce78c-6510-4f26-8ec1-1c039e69ff93,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:26.592001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:26.594349 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81f23eb1-64d9-4800-9f47-a6d67cc871ca req-82c16f8b-e79f-4911-8d6a-156b2e709e94 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3299208 May 12 15:10:26.595980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:26.600913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:26.736269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-ee85f6f0-22e8-43bd-a2f0-bb0dc6175f02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:26.737778 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-ee85f6f0-22e8-43bd-a2f0-bb0dc6175f02 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.7609646 May 12 15:10:26.877963 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-bfd5058e-ba1f-422c-b73b-503c786b891a service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5029273 May 12 15:10:27.076707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device adab67f3-e920-4d7e-965f-e2431533c911 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:27.081373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff904ca5-c8e1-410d-af42-bdcd4b4b4709 req-7f569cbb-4f46-4837-8b31-11360a873c16 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=ec64d0a8-e302-4f1f-b954-5a422e360221 HTTP/1.1" status: 200 len: 210 time: 0.1935124 May 12 15:10:27.107101 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.179194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50948) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:27.193444 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port adab67f3-e920-4d7e-965f-e2431533c911 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:27.193821 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.298742 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.303930 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-735733a0-06c8-466f-b422-37dfa40aa0d7 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4064114 May 12 15:10:27.321160 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a686f1c4-b2f1-4692-950a-b2a71f6aeb6f details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:10:27.427469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Transition to ACTIVE for port object e8c30887-a54f-44a8-af0a-122711662e1e will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:27.429627 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-15b03a79-a2ee-492c-a40f-1695e9b9bf68 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:10:27.471582 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:27.488062 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 83a7b910-a912-4e05-9d03-5d6b1f6b0edc up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:27.523378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Request body: {'network': {'name': 'tempest-LiveMigrationTest-1295398250-network', 'tenant_id': '68c66ae0cd45476b87e2e79625b80f69'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:27.533030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:27.541930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Usage tracker for resource:network and tenant:68c66ae0cd45476b87e2e79625b80f69 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:27.546291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:27.554680 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'mac_address': 'fa:16:3e:46:3e:8a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.52'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:10:27.611910 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:27.620672 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15b03a79-a2ee-492c-a40f-1695e9b9bf68 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.622157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.654405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Made reservation on behalf of 68c66ae0cd45476b87e2e79625b80f69 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:27.656706 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.658392 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.671425 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15b03a79-a2ee-492c-a40f-1695e9b9bf68 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.697190 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a686f1c4-b2f1-4692-950a-b2a71f6aeb6f {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:27.709300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:27.725697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:27.726165 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.732655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4c5f6cc-768d-443b-acd1-b8e907e7b8ff req-9ad3c47b-8c4a-49c1-8446-62eb5e2ee25e service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4094610 May 12 15:10:27.743023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.763924 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:27.767059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:27.774891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Usage tracker for resource:security_group_rule and tenant:68c66ae0cd45476b87e2e79625b80f69 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:27.780357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:27.791717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:27.793654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b22cd75b-8a58-4ac4-99a0-87e7e3bc98f3 req-1b27c1dc-4675-4c31-a746-5107049735d4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:27.795297 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b22cd75b-8a58-4ac4-99a0-87e7e3bc98f3 req-1b27c1dc-4675-4c31-a746-5107049735d4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 948 time: 0.5491400 May 12 15:10:27.797605 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.804546 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.805350 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.932697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,revision_number=12']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:27.944782 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.978833 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9b2b4b7d-231c-4e54-83f4-827d02cbcbb5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '83a7b910-a912-4e05-9d03-5d6b1f6b0edc'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:27.989964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=83a7b910-a912-4e05-9d03-5d6b1f6b0edc,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:27.996084 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:27.996326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3ae73679-d198-440a-966c-619a9930fbcb up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:28.037744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:28.049433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:28.065228 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:28.074384 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:28.083640 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:28.120578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 579} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:10:28.132738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=83a7b910-a912-4e05-9d03-5d6b1f6b0edc,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:28.137731 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b22cd75b-8a58-4ac4-99a0-87e7e3bc98f3 req-7f83c4b0-79b8-4b5a-b370-cf15d4f47469 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3264380 May 12 15:10:28.138481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Pushing event updated for resources: {'Port': ['ID=e8c30887-a54f-44a8-af0a-122711662e1e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:28.142314 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-15b03a79-a2ee-492c-a40f-1695e9b9bf68 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Floating IP 86ba9930-7249-4cf3-94d1-68180b9f26fa associated. External IP: 172.25.8.55, port: a3478c2b-fafc-4acf-abce-c432fa4e874d. May 12 15:10:28.144960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Router ea3f04a0-308b-4219-ad26-2924d153122f is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:10:28.149564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=84fde8a0-0025-4028-a28e-5b3152f4f62d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:28.167353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:28.167780 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Added segment 619405e4-e83d-45d8-8f13-c0a176ec94ed of type vlan for network e8211761-0dd9-424f-b732-629fd2d77e28 May 12 15:10:28.174426 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 3ae73679-d198-440a-966c-619a9930fbcb completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:28.180136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 3ae73679-d198-440a-966c-619a9930fbcb triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:28.180435 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:28.239859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a686f1c4-b2f1-4692-950a-b2a71f6aeb6f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:28.386555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:10:28.394393 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:28.401424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Sync routers for ids ['ea3f04a0-308b-4219-ad26-2924d153122f'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:10:28.440942 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:28.441789 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-830acd44-c125-4aba-b4e2-c8a8e4b8610e admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 6.1259949 May 12 15:10:28.444893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50962) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:28.453154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Routers {'ea3f04a0-308b-4219-ad26-2924d153122f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:10:28.454481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:10:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ea3f04a0-308b-4219-ad26-2924d153122f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:28.509700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:28.511072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:28.512702 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:28.585455 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:28.614286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Allocated IP 172.25.8.75 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/5df27161-37d8-44f0-9aef-0e913c200081) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:28.621186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9f28dd5f-adf9-458f-81f8-8e90a859007f None None] Provisioning for port e8c30887-a54f-44a8-af0a-122711662e1e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:28.640556 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.4581406 May 12 15:10:28.641821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50966) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:28.649535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Request body: {'subnet': {'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveMigrationTest-1295398250-subnet', 'tenant_id': '68c66ae0cd45476b87e2e79625b80f69', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:28.654304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:28.654921 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:28.702254 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9f28dd5f-adf9-458f-81f8-8e90a859007f None None] Provisioning complete for port e8c30887-a54f-44a8-af0a-122711662e1e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:28.702768 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9f28dd5f-adf9-458f-81f8-8e90a859007f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:28.704177 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-ea78d95a-3e35-49b5-a260-a63ce5544fdf tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 4.8053036 May 12 15:10:28.716394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:28.728120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea009caf-214d-465a-845c-52794a314a6b admin admin] Pushing event updated for resources: {'Network': ['ID=e8211761-0dd9-424f-b732-629fd2d77e28,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:28.736705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Usage tracker for resource:subnet and tenant:68c66ae0cd45476b87e2e79625b80f69 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:28.741294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:28.745507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Request body: {'port': {'device_id': 'ec64d0a8-e302-4f1f-b954-5a422e360221', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:28.751093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:28.769118 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network e8211761-0dd9-424f-b732-629fd2d77e28 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:10:28.824747 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Made reservation on behalf of 68c66ae0cd45476b87e2e79625b80f69 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:28.827045 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:28.891498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 3ae73679-d198-440a-966c-619a9930fbcb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3ae73679-d198-440a-966c-619a9930fbcb,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:28.924840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9f28dd5f-adf9-458f-81f8-8e90a859007f None None] Port e8c30887-a54f-44a8-af0a-122711662e1e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:10:28.926820 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:28.949116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f23b116-4ff5-4ea4-9761-98aef7ac3b79 req-e608e52e-f02a-4717-8953-537ebb05d3ea tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:28.950603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f23b116-4ff5-4ea4-9761-98aef7ac3b79 req-e608e52e-f02a-4717-8953-537ebb05d3ea tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 949 time: 0.5451877 May 12 15:10:28.984825 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Set router ea3f04a0-308b-4219-ad26-2924d153122f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:10:29.213267 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:29.221309 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:29.232343 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f23b116-4ff5-4ea4-9761-98aef7ac3b79 req-b0b7f226-4736-4374-8b94-4772d659b9a5 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2646301 May 12 15:10:29.264307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=3ae73679-d198-440a-966c-619a9930fbcb,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:29.277324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:29.277866 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:29.278037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:29.278329 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:29.278647 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:29.279010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:29.279789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:29.279789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:29.279993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:29.280218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:29.280521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:29.280829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:10:29.430693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-15b03a79-a2ee-492c-a40f-1695e9b9bf68 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Router 2efb0694-c577-4ca8-871f-c4b55760ad4a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:10:29.471509 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17'}], 'enable_snat': True}, 'gw_port_id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:10:26Z', 'revision_number': 3, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port': {'id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:36:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 766, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:25Z', 'updated_at': '2022-05-12T15:10:25Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:29.476098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Checking router: ea3f04a0-308b-4219-ad26-2924d153122f for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:10:29.476559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Updating router ea3f04a0-308b-4219-ad26-2924d153122f port 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:10:29.532138 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:29.547219 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:29.673425 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:29.688606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ed7d4325-c4dc-4592-8d41-1f3fe41da585,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:29.700592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Checking segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:29.700951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Network hostable DHCP agents. Network: e8211761-0dd9-424f-b732-629fd2d77e28, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:10:29.720805 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:29.778086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Network e8211761-0dd9-424f-b732-629fd2d77e28 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:10:29.808601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, e8211761-0dd9-424f-b732-629fd2d77e28) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:29.817951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:29.818762 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:29.831075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-289f365b-c877-4515-ad9e-c9fe9eeff35e None None] Network e8211761-0dd9-424f-b732-629fd2d77e28 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:10:29.852675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:29.861324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:29.867472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Pushing event updated for resources: {'Port': ['ID=5df27161-37d8-44f0-9aef-0e913c200081,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:29.869823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:29.903732 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-75dff427-3258-4be1-b546-735f8ec81233 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.2524519 May 12 15:10:29.916912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ff8151d-ffae-4021-86de-9d1764b043be req-1b16a448-824b-4ff7-aacd-c4dbfa2c4d5f tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:29.924581 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ff8151d-ffae-4021-86de-9d1764b043be req-1b16a448-824b-4ff7-aacd-c4dbfa2c4d5f tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 945 time: 0.4418044 May 12 15:10:29.961244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-15b03a79-a2ee-492c-a40f-1695e9b9bf68 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:10:29.971289 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15b03a79-a2ee-492c-a40f-1695e9b9bf68 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:29.978408 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91785cd6-672b-42f3-a8d5-a2a0c45b1e8b None None] Sync routers for ids ['2efb0694-c577-4ca8-871f-c4b55760ad4a'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:10:29.985838 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:29.994771 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91785cd6-672b-42f3-a8d5-a2a0c45b1e8b None None] Routers {'2efb0694-c577-4ca8-871f-c4b55760ad4a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:10:29.995513 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-91785cd6-672b-42f3-a8d5-a2a0c45b1e8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:10:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2efb0694-c577-4ca8-871f-c4b55760ad4a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:30.007023 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:10:30.022914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Transition to ACTIVE for port object 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:30.046101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Allocated IP 172.20.0.1 (7336b0e1-6ae7-4c8a-98e8-3f13adbdc190/eb51e145-1f59-4ab5-b2f3-a32c2c6ee575/fdea6f95-4926-47ab-b77f-0443f92db7f5) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:30.062395 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ff8151d-ffae-4021-86de-9d1764b043be req-0f85eaad-f532-4c55-a143-5effb4e9c5fe tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1368511 May 12 15:10:30.068152 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:30.182064 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d5cf3586-4209-44b8-a3c5-90b9ebdc38c4'] response: {'server_uuid': '9b2b4b7d-231c-4e54-83f4-827d02cbcbb5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '83a7b910-a912-4e05-9d03-5d6b1f6b0edc', 'code': 200} May 12 15:10:30.192385 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Attempting to bind port 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:30.193139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Attempting to bind port 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:30.193139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Attempting to bind port 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:30.202487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-607afc3a-5ac5-4182-8092-0266ca2ca615 None None] Pushing event updated for resources: {'Port': ['ID=8c5ce78c-6510-4f26-8ec1-1c039e69ff93,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:30.236408 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-15b03a79-a2ee-492c-a40f-1695e9b9bf68 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "PUT /v2.0/floatingips/86ba9930-7249-4cf3-94d1-68180b9f26fa HTTP/1.1" status: 200 len: 991 time: 5.3479574 May 12 15:10:30.238786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e8c30887-a54f-44a8-af0a-122711662e1e {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:30.252164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '74ddf043-2cb7-4286-b010-6509b25bb4aa', 'tag': 'a3478c2b-fafc-4acf-abce-c432fa4e874d'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:30.276560 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:30.297876 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:30.315510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 10, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:30.315863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:30.316261 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:30.316642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:30.317162 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Bound port: 8c5ce78c-6510-4f26-8ec1-1c039e69ff93, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:30.317550 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:30.330830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Transition to ACTIVE for port object fdea6f95-4926-47ab-b77f-0443f92db7f5 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:30.347358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Transition to ACTIVE for port object e8c30887-a54f-44a8-af0a-122711662e1e will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:30.355419 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:30.358589 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:30.381878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0dd89971-2776-4034-862a-c1837f1c18e1 None None] Network e8211761-0dd9-424f-b732-629fd2d77e28 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:10:30.443265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:30.458687 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-91785cd6-672b-42f3-a8d5-a2a0c45b1e8b None None] Set router 2efb0694-c577-4ca8-871f-c4b55760ad4a gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:10:30.619408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:30.650911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:30.666143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:30.776077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:30.794439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Pushing event updated for resources: {'Port': ['ID=fdea6f95-4926-47ab-b77f-0443f92db7f5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:30.811660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] For port 8c5ce78c-6510-4f26-8ec1-1c039e69ff93, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:30.825280 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] For port 8c5ce78c-6510-4f26-8ec1-1c039e69ff93, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=8c5ce78c-6510-4f26-8ec1-1c039e69ff93,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:30.834858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94676190-75b5-41f5-ae7f-d354006a5829 req-9943cede-3565-4fbb-8ddd-f51ece5f22d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:30.837208 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-94676190-75b5-41f5-ae7f-d354006a5829 req-9943cede-3565-4fbb-8ddd-f51ece5f22d0 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9b2b4b7d-231c-4e54-83f4-827d02cbcbb5 HTTP/1.1" status: 200 len: 1101 time: 0.4520323 May 12 15:10:30.887621 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:30.901325 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-94676190-75b5-41f5-ae7f-d354006a5829 req-206c3eb4-8aae-44e1-bc6e-4fbfd937cfc1 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538545 May 12 15:10:31.056944 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.059204 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-607afc3a-5ac5-4182-8092-0266ca2ca615 None None] Pushing event updated for resources: {'Port': ['ID=8c5ce78c-6510-4f26-8ec1-1c039e69ff93,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:31.061919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Routers {'ea3f04a0-308b-4219-ad26-2924d153122f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:10:31.062755 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:10:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ea3f04a0-308b-4219-ad26-2924d153122f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:31.074218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Pushing event updated for resources: {'Port': ['ID=e8c30887-a54f-44a8-af0a-122711662e1e,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:31.122482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50992) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:31.136803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Request body: {'network': {'name': 'tempest-LiveMigrationTest-267630753-network', 'tenant_id': '385682058f81452b82f06eb277dee5eb'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:31.151202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:31.159245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Usage tracker for resource:network and tenant:385682058f81452b82f06eb277dee5eb is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:31.164338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:31.180639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:31.206038 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.228067 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-91785cd6-672b-42f3-a8d5-a2a0c45b1e8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50'}], 'enable_snat': True}, 'gw_port_id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:43Z', 'revision_number': 4, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port': {'id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:5a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:34Z', 'updated_at': '2022-05-12T15:09:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '86ba9930-7249-4cf3-94d1-68180b9f26fa', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'port_id': 'a3478c2b-fafc-4acf-abce-c432fa4e874d', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 706, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'mac_address': 'fa:16:3e:94:93:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74ddf043-2cb7-4286-b010-6509b25bb4aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:09:53Z', 'updated_at': '2022-05-12T15:10:27Z', 'revision_number': 1, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5', 'name': '', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'mac_address': 'fa:16:3e:44:ec:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:42Z', 'updated_at': '2022-05-12T15:09:55Z', 'revision_number': 5, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'subnets': [{'id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:31.232752 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91785cd6-672b-42f3-a8d5-a2a0c45b1e8b None None] Checking router: 2efb0694-c577-4ca8-871f-c4b55760ad4a for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:10:31.244090 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91785cd6-672b-42f3-a8d5-a2a0c45b1e8b None None] Routers {'2efb0694-c577-4ca8-871f-c4b55760ad4a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:10:31.244673 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-91785cd6-672b-42f3-a8d5-a2a0c45b1e8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:10:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2efb0694-c577-4ca8-871f-c4b55760ad4a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:31.265732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Made reservation on behalf of 385682058f81452b82f06eb277dee5eb for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:31.267983 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.288232 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.301111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4e5d2d3c-f180-4f6c-9294-c4d83cb366df None None] Provisioning for port fdea6f95-4926-47ab-b77f-0443f92db7f5 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:31.320971 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a686f1c4-b2f1-4692-950a-b2a71f6aeb6f up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:31.324812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:31.331608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Usage tracker for resource:security_group_rule and tenant:385682058f81452b82f06eb277dee5eb is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:31.336054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:31.368344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4e5d2d3c-f180-4f6c-9294-c4d83cb366df None None] Provisioning complete for port fdea6f95-4926-47ab-b77f-0443f92db7f5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:31.369099 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4e5d2d3c-f180-4f6c-9294-c4d83cb366df None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.387881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:31.483869 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.502508 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.509053 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-91785cd6-672b-42f3-a8d5-a2a0c45b1e8b None None] Set router 2efb0694-c577-4ca8-871f-c4b55760ad4a gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:10:31.541906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.543948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] Set router ea3f04a0-308b-4219-ad26-2924d153122f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:10:31.545548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Attempting to bind port e8c30887-a54f-44a8-af0a-122711662e1e on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:31.545928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Attempting to bind port e8c30887-a54f-44a8-af0a-122711662e1e by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:31.546257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Attempting to bind port e8c30887-a54f-44a8-af0a-122711662e1e on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:31.555464 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.601633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4e5d2d3c-f180-4f6c-9294-c4d83cb366df None None] Port fdea6f95-4926-47ab-b77f-0443f92db7f5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:10:31.644979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:31.648516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Port e8c30887-a54f-44a8-af0a-122711662e1e on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:10:31.648849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Attempting to bind port e8c30887-a54f-44a8-af0a-122711662e1e on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:31.709727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:31.710198 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.712693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Pushing event updated for resources: {'Port': ['ID=5df27161-37d8-44f0-9aef-0e913c200081,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:31.721245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 10, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:31.721601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:31.721984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:31.722977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Bound port: e8c30887-a54f-44a8-af0a-122711662e1e, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:31.722977 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.736178 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.776204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff98b4f5-6a8e-453e-b3e8-ea9946611f26 req-0087bcbb-c62f-4c75-8a24-2fd48bb8ff49 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:31.777008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ff98b4f5-6a8e-453e-b3e8-ea9946611f26 req-0087bcbb-c62f-4c75-8a24-2fd48bb8ff49 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Synchronizing usage tracker for tenant:8a871ef1e9124e35b230ac65e37bd02e on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:31.787144 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.788322 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-99dcbd57-3b2a-46e4-b33f-293d53f97d3c tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 697 time: 5.7451088 May 12 15:10:31.874184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.882370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Pushing event updated for resources: {'Port': ['ID=fdea6f95-4926-47ab-b77f-0443f92db7f5,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:31.894683 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:31.985958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-c969adec-f570-4144-8c38-f692f4dc1a75 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Synchronizing usage tracker for tenant:d914960d703a44ae913f9a1804d5b368 on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:31.993414 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:32.014593 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ff98b4f5-6a8e-453e-b3e8-ea9946611f26 req-0087bcbb-c62f-4c75-8a24-2fd48bb8ff49 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Unset dirty status for tenant:8a871ef1e9124e35b230ac65e37bd02e on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:32.016436 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff98b4f5-6a8e-453e-b3e8-ea9946611f26 req-0087bcbb-c62f-4c75-8a24-2fd48bb8ff49 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=ec64d0a8-e302-4f1f-b954-5a422e360221 HTTP/1.1" status: 200 len: 948 time: 1.1644838 May 12 15:10:32.020322 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:32.034987 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-91785cd6-672b-42f3-a8d5-a2a0c45b1e8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50'}], 'enable_snat': True}, 'gw_port_id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:43Z', 'revision_number': 4, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port': {'id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:5a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:34Z', 'updated_at': '2022-05-12T15:09:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '86ba9930-7249-4cf3-94d1-68180b9f26fa', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'port_id': 'a3478c2b-fafc-4acf-abce-c432fa4e874d', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 706, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'mac_address': 'fa:16:3e:94:93:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74ddf043-2cb7-4286-b010-6509b25bb4aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:09:53Z', 'updated_at': '2022-05-12T15:10:27Z', 'revision_number': 1, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5', 'name': '', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'mac_address': 'fa:16:3e:44:ec:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:42Z', 'updated_at': '2022-05-12T15:09:55Z', 'revision_number': 5, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'subnets': [{'id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:32.041740 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91785cd6-672b-42f3-a8d5-a2a0c45b1e8b None None] The sync data for ids ['2efb0694-c577-4ca8-871f-c4b55760ad4a'] in n-d-841483-1 is: [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50'}], 'enable_snat': True}, 'gw_port_id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:43Z', 'revision_number': 4, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port': {'id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:5a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:34Z', 'updated_at': '2022-05-12T15:09:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '86ba9930-7249-4cf3-94d1-68180b9f26fa', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'port_id': 'a3478c2b-fafc-4acf-abce-c432fa4e874d', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 706, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'mac_address': 'fa:16:3e:94:93:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74ddf043-2cb7-4286-b010-6509b25bb4aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:09:53Z', 'updated_at': '2022-05-12T15:10:27Z', 'revision_number': 1, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5', 'name': '', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'mac_address': 'fa:16:3e:44:ec:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:42Z', 'updated_at': '2022-05-12T15:09:55Z', 'revision_number': 5, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'subnets': [{'id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:10:32.051704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 593} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:10:32.088831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-c969adec-f570-4144-8c38-f692f4dc1a75 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Unset dirty status for tenant:d914960d703a44ae913f9a1804d5b368 on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:32.090034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-c969adec-f570-4144-8c38-f692f4dc1a75 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.75 HTTP/1.1" status: 200 len: 695 time: 0.2914510 May 12 15:10:32.097746 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:32.098356 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Added segment 5188e866-f311-4b2f-8076-1c31b8762965 of type vlan for network cbad95e3-1420-461b-8eca-a2f4771201e7 May 12 15:10:32.099810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ca8979b-061c-40c5-93f2-1759fedb5d51,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:32.103924 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2155319-b4f8-4ae8-b735-10d45e0d633a req-69229b1d-733d-4133-b21f-989f0b97b81c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:32.105607 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2155319-b4f8-4ae8-b735-10d45e0d633a req-69229b1d-733d-4133-b21f-989f0b97b81c service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 1096 time: 0.5622323 May 12 15:10:32.105763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ff98b4f5-6a8e-453e-b3e8-ea9946611f26 req-f92240fc-0edb-4316-af42-9734976bf56f tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Synchronizing usage tracker for tenant:8a871ef1e9124e35b230ac65e37bd02e on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:32.113413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] For port e8c30887-a54f-44a8-af0a-122711662e1e, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:32.162627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] For port e8c30887-a54f-44a8-af0a-122711662e1e, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8c30887-a54f-44a8-af0a-122711662e1e,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:32.168241 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:32.184620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '000d5cf1-e430-46d6-a455-2550da7e4b71', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3ae73679-d198-440a-966c-619a9930fbcb'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:32.204960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:32.217847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:32.224372 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:32.224701 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:32.237628 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:32.319743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:32.320345 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:32.321744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] 10.222.0.76 "PUT /v2.0/ports/e8c30887-a54f-44a8-af0a-122711662e1e HTTP/1.1" status: 200 len: 1096 time: 3.5877290 May 12 15:10:32.341338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ff98b4f5-6a8e-453e-b3e8-ea9946611f26 req-f92240fc-0edb-4316-af42-9734976bf56f tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Unset dirty status for tenant:8a871ef1e9124e35b230ac65e37bd02e on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:32.342501 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff98b4f5-6a8e-453e-b3e8-ea9946611f26 req-f92240fc-0edb-4316-af42-9734976bf56f tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3177047 May 12 15:10:32.388666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,revision_number=13']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:32.424306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:32.441915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17'}], 'enable_snat': True}, 'gw_port_id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 4, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port': {'id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:36:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 766, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:25Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'fdea6f95-4926-47ab-b77f-0443f92db7f5', 'name': '', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'mac_address': 'fa:16:3e:d3:23:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_interface', 'standard_attr_id': 777, 'fixed_ips': [{'subnet_id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:29Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 1, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'subnets': [{'id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:32.448648 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2155319-b4f8-4ae8-b735-10d45e0d633a req-21e90507-afc4-4998-b39a-7932b173389d service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3277004 May 12 15:10:32.452716 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4332cdd-97d5-480a-94f3-b12df72a3a69 None None] The sync data for ids ['ea3f04a0-308b-4219-ad26-2924d153122f'] in n-d-841483-1 is: [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17'}], 'enable_snat': True}, 'gw_port_id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 4, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port': {'id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:36:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 766, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:25Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'fdea6f95-4926-47ab-b77f-0443f92db7f5', 'name': '', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'mac_address': 'fa:16:3e:d3:23:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_interface', 'standard_attr_id': 777, 'fixed_ips': [{'subnet_id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:29Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 1, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'subnets': [{'id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:10:32.475529 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d71069e6-4572-47b5-9ba0-0accc66cda8f None None] New status for floating IP 86ba9930-7249-4cf3-94d1-68180b9f26fa: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:10:32.514384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb6f5e80-29a1-430d-818b-fe0f7bbd4ec2 service neutron] Pushing event updated for resources: {'Port': ['ID=e8c30887-a54f-44a8-af0a-122711662e1e,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:32.567272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-df15b450-b380-481b-9b3a-a63c3fa32d25 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:32.568641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4755b77e-74d2-48d9-8b90-36f410833dd5 req-df15b450-b380-481b-9b3a-a63c3fa32d25 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.4514413 May 12 15:10:32.729038 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:32.730034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:32.730615 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:32.786742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-4c1a7fce-b7d5-48c7-9270-5fcfffc1e50b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:32.788329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-4c1a7fce-b7d5-48c7-9270-5fcfffc1e50b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=8a871ef1e9124e35b230ac65e37bd02e&device_id=ec64d0a8-e302-4f1f-b954-5a422e360221 HTTP/1.1" status: 200 len: 1099 time: 0.4004149 May 12 15:10:32.876069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1233d2b1-a4f4-4fa5-baf0-e7bbfcf202df None None] Provisioning complete for port fdea6f95-4926-47ab-b77f-0443f92db7f5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:32.876997 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1233d2b1-a4f4-4fa5-baf0-e7bbfcf202df None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:32.885217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Router ea3f04a0-308b-4219-ad26-2924d153122f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:10:32.893897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] Pushing event updated for resources: {'Network': ['ID=cbad95e3-1420-461b-8eca-a2f4771201e7,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:32.900356 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-3c3bbe19-3a3c-49b6-92c6-46e04577595e service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.191&port_id=e8c30887-a54f-44a8-af0a-122711662e1e HTTP/1.1" status: 200 len: 217 time: 0.1015806 May 12 15:10:32.910236 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-29eb0aa1-320e-4cea-b021-f158c653496e admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 880 time: 1.7856953 May 12 15:10:32.919054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network cbad95e3-1420-461b-8eca-a2f4771201e7 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:10:32.925297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5506f689-50a2-41de-a8ad-d946f12c5266 req-553685e5-9f07-4bda-b72a-7718999434e3 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:32.927434 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5506f689-50a2-41de-a8ad-d946f12c5266 req-553685e5-9f07-4bda-b72a-7718999434e3 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 950 time: 0.3710999 May 12 15:10:32.931367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51000) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:32.938812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Request body: {'subnet': {'network_id': 'cbad95e3-1420-461b-8eca-a2f4771201e7', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveMigrationTest-267630753-subnet', 'tenant_id': '385682058f81452b82f06eb277dee5eb', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:33.004286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:33.027424 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Usage tracker for resource:subnet and tenant:385682058f81452b82f06eb277dee5eb is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:33.033696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:33.072368 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5506f689-50a2-41de-a8ad-d946f12c5266 req-101e3f83-4e28-49d9-9fc3-33124311a1a1 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1285906 May 12 15:10:33.085811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:33.135241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:10:33.137110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-3c9ad225-672b-4e4c-a0c1-1103f23cd4f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:33.142837 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-acc1f1ba-0f31-42b8-a157-d2caf435d05a admin admin] 10.222.0.82 "PUT /v2.0/routers/ea3f04a0-308b-4219-ad26-2924d153122f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6967769 May 12 15:10:33.143030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-3c9ad225-672b-4e4c-a0c1-1103f23cd4f8 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2123477 May 12 15:10:33.145664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Made reservation on behalf of 385682058f81452b82f06eb277dee5eb for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:33.150203 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:33.162900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1233d2b1-a4f4-4fa5-baf0-e7bbfcf202df None None] Port fdea6f95-4926-47ab-b77f-0443f92db7f5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:10:33.196038 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1ba181c5-ee7b-49ed-9494-72f8188bac1a'] response: {'name': 'network-changed', 'server_uuid': '74ddf043-2cb7-4286-b010-6509b25bb4aa', 'tag': 'a3478c2b-fafc-4acf-abce-c432fa4e874d', 'status': 'completed', 'code': 200} May 12 15:10:33.221859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c213e678-2265-42c3-8879-351b6087e6e5 req-de967d9c-f772-4879-a0b7-09227d7dbe9b tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:33.233963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c213e678-2265-42c3-8879-351b6087e6e5 req-de967d9c-f772-4879-a0b7-09227d7dbe9b tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 946 time: 0.5263186 May 12 15:10:33.666017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c213e678-2265-42c3-8879-351b6087e6e5 req-68bbe1c0-5076-4e6d-9da1-a7d3024c5706 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/security-groups?id=4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4310207 May 12 15:10:33.744915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7441004d-770c-412b-9e27-0b6554511207 req-d9859525-6aad-49e2-84b0-eede551ba8e7 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:33.746490 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7441004d-770c-412b-9e27-0b6554511207 req-d9859525-6aad-49e2-84b0-eede551ba8e7 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 950 time: 0.4068930 May 12 15:10:33.758734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-9ac8ebb3-b5cf-4918-8cde-7d7332b534e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:33.760232 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-9ac8ebb3-b5cf-4918-8cde-7d7332b534e8 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.5612202 May 12 15:10:33.767915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae0c69b2-12d6-4460-afe0-6209fd40b187 req-34bfa372-7da4-4cc3-b320-20790084f4f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:33.769092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae0c69b2-12d6-4460-afe0-6209fd40b187 req-34bfa372-7da4-4cc3-b320-20790084f4f7 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=982e4927ecc048a1a769000f4c067d06&device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 1097 time: 0.5689957 May 12 15:10:34.094386 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7441004d-770c-412b-9e27-0b6554511207 req-5c2d39c8-f6c2-4e62-87f5-86e5c8940d4e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3326163 May 12 15:10:34.146990 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0bb78eff-6d1d-4cfb-8715-d9b6412656dd'] response: {'server_uuid': '000d5cf1-e430-46d6-a455-2550da7e4b71', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3ae73679-d198-440a-966c-619a9930fbcb', 'code': 200} May 12 15:10:34.221832 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:34.309636 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-3009ddbd-ae6d-4094-85dc-ec3fb9d64943 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5273538 May 12 15:10:34.310610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae0c69b2-12d6-4460-afe0-6209fd40b187 req-0c6ef1dd-529a-4579-9ece-11d5e36589e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:34.311917 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae0c69b2-12d6-4460-afe0-6209fd40b187 req-0c6ef1dd-529a-4579-9ece-11d5e36589e4 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 HTTP/1.1" status: 200 len: 907 time: 0.4791195 May 12 15:10:34.313761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41e6bbee-2512-407b-a8b1-c3e7a46fcec5 req-972a4738-05e6-4913-983b-dc48e5851b8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:34.315280 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-41e6bbee-2512-407b-a8b1-c3e7a46fcec5 req-972a4738-05e6-4913-983b-dc48e5851b8f service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 1101 time: 0.0858176 May 12 15:10:34.357795 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-41e6bbee-2512-407b-a8b1-c3e7a46fcec5 req-3d2d3eeb-e011-4891-bef7-497994d7f0ee service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0361259 May 12 15:10:34.458965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292b245c-88fb-4879-ac32-06aeb4e13bd6 req-27d82d41-5272-4fe7-a778-65be3f75914a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:34.460408 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-292b245c-88fb-4879-ac32-06aeb4e13bd6 req-27d82d41-5272-4fe7-a778-65be3f75914a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 945 time: 0.6502481 May 12 15:10:34.576961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=361dca53-0db0-4571-81ea-2e9c24261de5,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:34.642830 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae0c69b2-12d6-4460-afe0-6209fd40b187 req-47919b86-b885-458f-a7a5-6bf4d35aaa33 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a3478c2b-fafc-4acf-abce-c432fa4e874d HTTP/1.1" status: 200 len: 1001 time: 0.2981455 May 12 15:10:34.705799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Checking segment: {'id': '5188e866-f311-4b2f-8076-1c31b8762965', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 593, 'network_id': 'cbad95e3-1420-461b-8eca-a2f4771201e7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:34.706224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Network hostable DHCP agents. Network: cbad95e3-1420-461b-8eca-a2f4771201e7, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:10:34.736839 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-292b245c-88fb-4879-ac32-06aeb4e13bd6 req-825b1ed7-e9fd-41d5-a31d-8334e9d2ea8b tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2195101 May 12 15:10:34.749483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-0e811f35-5200-409f-b098-b7fc8eb7bda4 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.5906157 May 12 15:10:34.770842 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05d79f3d-0339-44b5-a3e4-42c5424f0773 req-9b4ad5c0-f543-465e-b833-44883e9bc0d9 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4247527 May 12 15:10:34.788952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:34.808414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:34.814531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Network cbad95e3-1420-461b-8eca-a2f4771201e7 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:10:34.817916 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Sync routers for ids ['ea3f04a0-308b-4219-ad26-2924d153122f'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:10:34.830608 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Routers {'ea3f04a0-308b-4219-ad26-2924d153122f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:10:34.830840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae0c69b2-12d6-4460-afe0-6209fd40b187 req-fb51a8f4-fdd6-4da9-91f2-cd6d52d08059 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:34.831894 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:10:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ea3f04a0-308b-4219-ad26-2924d153122f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:34.832346 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae0c69b2-12d6-4460-afe0-6209fd40b187 req-fb51a8f4-fdd6-4da9-91f2-cd6d52d08059 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=1636e4f2-4025-4f61-a8dd-65adade9e66c HTTP/1.1" status: 200 len: 845 time: 0.1632206 May 12 15:10:34.837510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, cbad95e3-1420-461b-8eca-a2f4771201e7) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:34.846438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attempting to reserve 1 items for resource floatingip. Total usage: 3; quota limit: 50; headroom:47 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:34.847085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-adf27f84-d79d-418f-93b1-d1a1fffd6d44 None None] Network cbad95e3-1420-461b-8eca-a2f4771201e7 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:10:34.893047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:34.894978 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:34.936434 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9c69ac6b-a0a3-4f41-97e6-93e2ec6382c5 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 2.0036511 May 12 15:10:34.982505 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.108830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51024) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:35.118178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1259432688', 'description': 'tempest-description--1404445144'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:35.130344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:35.130606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:35.137007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Usage tracker for resource:security_group and tenant:a673d571317840e888b6cfe5a121092e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:35.141754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:35.155240 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Set router ea3f04a0-308b-4219-ad26-2924d153122f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:10:35.159708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:35.188754 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.192244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae0c69b2-12d6-4460-afe0-6209fd40b187 req-ac4c906e-bb1c-4d1e-83b4-397ecd018427 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:35.194587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae0c69b2-12d6-4460-afe0-6209fd40b187 req-ac4c906e-bb1c-4d1e-83b4-397ecd018427 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3516428 May 12 15:10:35.197175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ec64d0a8-e302-4f1f-b954-5a422e360221', 'tag': 'e8c30887-a54f-44a8-af0a-122711662e1e'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:35.228015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:35.232759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Usage tracker for resource:security_group_rule and tenant:a673d571317840e888b6cfe5a121092e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:35.236620 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:35.243378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:35.364541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.382543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.518583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8bbc81bc-cc92-4d30-95f9-1b79691f1279 None None] Network cbad95e3-1420-461b-8eca-a2f4771201e7 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:10:35.521802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4db559d6-6ff9-4f01-9ab9-98bc9279fdd7,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:35.528437 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.533309 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b93287e2-b300-44d4-a57c-26e82d0f40b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 0.4199452 May 12 15:10:35.533309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51036) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:35.537568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:35.540690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-cd593197-5795-43c4-8236-0da8387bf326 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Request body: {'security_group_rule': {'security_group_id': '4db559d6-6ff9-4f01-9ab9-98bc9279fdd7', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:35.547592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cd593197-5795-43c4-8236-0da8387bf326 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:35.551798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cd593197-5795-43c4-8236-0da8387bf326 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Usage tracker for resource:security_group_rule and tenant:a673d571317840e888b6cfe5a121092e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:35.555161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cd593197-5795-43c4-8236-0da8387bf326 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:35.560915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cd593197-5795-43c4-8236-0da8387bf326 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:35.615750 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cd593197-5795-43c4-8236-0da8387bf326 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.625459 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:35.625977 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.702495 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae0c69b2-12d6-4460-afe0-6209fd40b187 req-00069b05-a7fa-442a-ad75-550ff6ab6b6e service neutron] 10.222.0.76 "GET /v2.0/networks/e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4997213 May 12 15:10:35.725418 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cd593197-5795-43c4-8236-0da8387bf326 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.731861 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cd593197-5795-43c4-8236-0da8387bf326 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.739535 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.775422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd593197-5795-43c4-8236-0da8387bf326 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d8c73be3-9da9-487a-8030-f08ecbc383b8,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:35.789714 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17'}], 'enable_snat': True}, 'gw_port_id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 4, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port': {'id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:36:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 766, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:25Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'fdea6f95-4926-47ab-b77f-0443f92db7f5', 'name': '', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'mac_address': 'fa:16:3e:d3:23:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_interface', 'standard_attr_id': 777, 'fixed_ips': [{'subnet_id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:29Z', 'updated_at': '2022-05-12T15:10:31Z', 'revision_number': 2, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'subnets': [{'id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:35.793724 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cd593197-5795-43c4-8236-0da8387bf326 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.798201 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Checking router: ea3f04a0-308b-4219-ad26-2924d153122f for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:10:35.798365 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cd593197-5795-43c4-8236-0da8387bf326 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2606242 May 12 15:10:35.798487 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Updating router ea3f04a0-308b-4219-ad26-2924d153122f port fdea6f95-4926-47ab-b77f-0443f92db7f5 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:10:35.798734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51040) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:35.804920 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6878e415-07f1-4219-bac3-7cd6ca6b50c5 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Request body: {'security_group_rule': {'security_group_id': '4db559d6-6ff9-4f01-9ab9-98bc9279fdd7', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:35.812763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6878e415-07f1-4219-bac3-7cd6ca6b50c5 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:35.818637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6878e415-07f1-4219-bac3-7cd6ca6b50c5 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Usage tracker for resource:security_group_rule and tenant:a673d571317840e888b6cfe5a121092e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:35.821998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6878e415-07f1-4219-bac3-7cd6ca6b50c5 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:35.828958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6878e415-07f1-4219-bac3-7cd6ca6b50c5 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:35.851636 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6878e415-07f1-4219-bac3-7cd6ca6b50c5 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.857672 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.870498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a66abb-de5b-4c42-9b5f-519c606bfa28 req-d42afdf9-55f2-42e7-bfff-fe1e473ddc1e tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:35.871966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d4a66abb-de5b-4c42-9b5f-519c606bfa28 req-d42afdf9-55f2-42e7-bfff-fe1e473ddc1e tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=ec64d0a8-e302-4f1f-b954-5a422e360221 HTTP/1.1" status: 200 len: 948 time: 0.4091077 May 12 15:10:35.881178 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.914879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 8c5ce78c-6510-4f26-8ec1-1c039e69ff93, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=8c5ce78c-6510-4f26-8ec1-1c039e69ff93,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:35.944040 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6878e415-07f1-4219-bac3-7cd6ca6b50c5 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.955096 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6878e415-07f1-4219-bac3-7cd6ca6b50c5 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.957562 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:35.982174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6878e415-07f1-4219-bac3-7cd6ca6b50c5 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a707c453-8131-46a9-8575-7c3f7f4f9671,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:36.015197 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6878e415-07f1-4219-bac3-7cd6ca6b50c5 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.017984 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6878e415-07f1-4219-bac3-7cd6ca6b50c5 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2180436 May 12 15:10:36.021078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51044) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:10:36.025022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d4a66abb-de5b-4c42-9b5f-519c606bfa28 req-6829868a-7643-4dc2-b53f-1354149e187d tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1419067 May 12 15:10:36.041848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae0c69b2-12d6-4460-afe0-6209fd40b187 req-1fa26f85-f3e2-4d05-ae9f-08a0c67b767b service neutron] 10.222.0.76 "GET /v2.0/networks/e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3305500 May 12 15:10:36.045446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=8c5ce78c-6510-4f26-8ec1-1c039e69ff93,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:36.054294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:36.069313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:36.075958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Usage tracker for resource:floatingip and tenant:a673d571317840e888b6cfe5a121092e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:36.082186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:36.088601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:36.092143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-624652b7-7d0a-455f-8fd0-93e968e0ec84 req-ebcc67ce-5c80-45f7-a6c6-78311ab7ce4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Request body: {'security_group': {'name': 'tempest-ServerRescueTestJSONUnderV235-securitygroup-781619532', 'description': 'tempest-description-1115564387'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:36.097534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Allocated IP 172.25.8.36 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/e824a752-ab38-45a7-8cb9-ed8329e6d797) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:36.099356 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.102697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-624652b7-7d0a-455f-8fd0-93e968e0ec84 req-ebcc67ce-5c80-45f7-a6c6-78311ab7ce4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:36.118705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-624652b7-7d0a-455f-8fd0-93e968e0ec84 req-ebcc67ce-5c80-45f7-a6c6-78311ab7ce4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:36.148436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:36.204541 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-624652b7-7d0a-455f-8fd0-93e968e0ec84 req-ebcc67ce-5c80-45f7-a6c6-78311ab7ce4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.233290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-624652b7-7d0a-455f-8fd0-93e968e0ec84 req-ebcc67ce-5c80-45f7-a6c6-78311ab7ce4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:36.250930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-624652b7-7d0a-455f-8fd0-93e968e0ec84 req-ebcc67ce-5c80-45f7-a6c6-78311ab7ce4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Usage tracker for resource:security_group_rule and tenant:fd97c932be3143b1846bb48363040c63 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:36.259431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-624652b7-7d0a-455f-8fd0-93e968e0ec84 req-ebcc67ce-5c80-45f7-a6c6-78311ab7ce4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:36.261417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.269614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-624652b7-7d0a-455f-8fd0-93e968e0ec84 req-ebcc67ce-5c80-45f7-a6c6-78311ab7ce4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:36.313883 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.319123 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.330356 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Transition to ACTIVE for port object fdea6f95-4926-47ab-b77f-0443f92db7f5 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:36.339200 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.389316 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-624652b7-7d0a-455f-8fd0-93e968e0ec84 req-ebcc67ce-5c80-45f7-a6c6-78311ab7ce4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.396366 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-624652b7-7d0a-455f-8fd0-93e968e0ec84 req-ebcc67ce-5c80-45f7-a6c6-78311ab7ce4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.447068 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.454129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebcc67ce-5c80-45f7-a6c6-78311ab7ce4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9718bb98-bff2-4136-a403-fec1779615d0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:36.492055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Allocated IP 172.25.8.163 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/ada5cf8c-8987-4268-a289-dc58cde185f1) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:36.530751 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-753211e8-db81-44cb-b477-08cc3860616c None None] Pushing event updated for resources: {'Port': ['ID=fdea6f95-4926-47ab-b77f-0443f92db7f5,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:36.549841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:36.553691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:36.556451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:36.595338 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Attempting to bind port fdea6f95-4926-47ab-b77f-0443f92db7f5 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:36.595636 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-624652b7-7d0a-455f-8fd0-93e968e0ec84 req-ebcc67ce-5c80-45f7-a6c6-78311ab7ce4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.596043 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Attempting to bind port fdea6f95-4926-47ab-b77f-0443f92db7f5 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '0f481a89-826f-4a90-903d-276e9b18feb1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:36.596717 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Attempting to bind port fdea6f95-4926-47ab-b77f-0443f92db7f5 on network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:36.597497 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-624652b7-7d0a-455f-8fd0-93e968e0ec84 req-ebcc67ce-5c80-45f7-a6c6-78311ab7ce4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1812 time: 0.5161901 May 12 15:10:36.604403 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 10, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:36.604973 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Checking segment: {'id': '0f481a89-826f-4a90-903d-276e9b18feb1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:36.605515 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.606230 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Bound using segment: {'id': '0f481a89-826f-4a90-903d-276e9b18feb1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:36.607048 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Bound port: fdea6f95-4926-47ab-b77f-0443f92db7f5, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0f481a89-826f-4a90-903d-276e9b18feb1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:36.607537 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.611330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Pushing event updated for resources: {'Port': ['ID=e824a752-ab38-45a7-8cb9-ed8329e6d797,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:36.676787 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.742930 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] For port fdea6f95-4926-47ab-b77f-0443f92db7f5, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:36.748271 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] For port fdea6f95-4926-47ab-b77f-0443f92db7f5, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fdea6f95-4926-47ab-b77f-0443f92db7f5,segment=NetworkSegment(0f481a89-826f-4a90-903d-276e9b18feb1),segment_id=0f481a89-826f-4a90-903d-276e9b18feb1)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:36.750837 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.755256 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.825995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-fe0d6623-c237-40b1-a0d4-cb2cfd238268 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=0da54985cde346e68eeadf965b8bc6d3&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0438080 May 12 15:10:36.835022 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.847411 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Routers {'ea3f04a0-308b-4219-ad26-2924d153122f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:10:36.848444 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:10:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ea3f04a0-308b-4219-ad26-2924d153122f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:36.871480 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:36.908623 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-753211e8-db81-44cb-b477-08cc3860616c None None] Pushing event updated for resources: {'Port': ['ID=fdea6f95-4926-47ab-b77f-0443f92db7f5,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:36.944883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:36.947969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:36.951720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:37.049038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Pushing event updated for resources: {'Port': ['ID=ada5cf8c-8987-4268-a289-dc58cde185f1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:37.056056 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] Set router ea3f04a0-308b-4219-ad26-2924d153122f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:10:37.162275 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:37.190539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fdea6f95-4926-47ab-b77f-0443f92db7f5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:37.249720 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:37.331869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-f4bc3ca6-1347-4b23-ab83-052f1ae854ff tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:37.333936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-f4bc3ca6-1347-4b23-ab83-052f1ae854ff tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4868684 May 12 15:10:37.380895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-135b39ce-a5bf-4fd8-9195-1f11851ca807 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/quotas/0da54985cde346e68eeadf965b8bc6d3 HTTP/1.1" status: 200 len: 375 time: 0.0387363 May 12 15:10:37.427596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port fdea6f95-4926-47ab-b77f-0443f92db7f5 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:37.439158 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port fdea6f95-4926-47ab-b77f-0443f92db7f5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:37.439158 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:37.463548 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:37.476423 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:37.516548 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17'}], 'enable_snat': True}, 'gw_port_id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 4, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port': {'id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:36:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 766, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:25Z', 'updated_at': '2022-05-12T15:10:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'fdea6f95-4926-47ab-b77f-0443f92db7f5', 'name': '', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'mac_address': 'fa:16:3e:d3:23:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_interface', 'standard_attr_id': 777, 'fixed_ips': [{'subnet_id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:29Z', 'updated_at': '2022-05-12T15:10:36Z', 'revision_number': 4, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'subnets': [{'id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:37.522501 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b822b294-35c8-4fb7-b150-f83ad504f10a None None] The sync data for ids ['ea3f04a0-308b-4219-ad26-2924d153122f'] in n-d-841483-1 is: [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17'}], 'enable_snat': True}, 'gw_port_id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 4, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port': {'id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:36:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 766, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:25Z', 'updated_at': '2022-05-12T15:10:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'fdea6f95-4926-47ab-b77f-0443f92db7f5', 'name': '', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'mac_address': 'fa:16:3e:d3:23:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_interface', 'standard_attr_id': 777, 'fixed_ips': [{'subnet_id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:29Z', 'updated_at': '2022-05-12T15:10:36Z', 'revision_number': 4, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'subnets': [{'id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:10:37.538464 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:37.560893 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:37.592352 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:37.637567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port fdea6f95-4926-47ab-b77f-0443f92db7f5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fdea6f95-4926-47ab-b77f-0443f92db7f5,segment=NetworkSegment(0f481a89-826f-4a90-903d-276e9b18feb1),segment_id=0f481a89-826f-4a90-903d-276e9b18feb1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:37.643527 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:37.644900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:37.665925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Pushing event updated for resources: {'Port': ['ID=e824a752-ab38-45a7-8cb9-ed8329e6d797,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:37.692291 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:37.714854 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-cf7afb44-3aac-473e-9ebe-ecbea17920f7 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&fields=id HTTP/1.1" status: 200 len: 348 time: 0.3060694 May 12 15:10:37.776940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Pushing event updated for resources: {'Port': ['ID=ada5cf8c-8987-4268-a289-dc58cde185f1,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:37.784355 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:37.785573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-f64666fd-7d29-4d8e-bde5-56917a6360d9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 697 time: 3.0176508 May 12 15:10:37.828982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:37.829486 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:37.839502 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:37.876300 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:37.877810 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-91447631-7105-43a7-b558-d31c68e1075b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.8546684 May 12 15:10:37.930079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=fdea6f95-4926-47ab-b77f-0443f92db7f5,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:37.942047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e8c30887-a54f-44a8-af0a-122711662e1e details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:10:37.976418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-507d75d9-79a1-4150-8c84-4b600b890b64 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Synchronizing usage tracker for tenant:d914960d703a44ae913f9a1804d5b368 on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:38.002384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-507d75d9-79a1-4150-8c84-4b600b890b64 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Unset dirty status for tenant:d914960d703a44ae913f9a1804d5b368 on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:38.007117 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-507d75d9-79a1-4150-8c84-4b600b890b64 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.36 HTTP/1.1" status: 200 len: 695 time: 0.2101846 May 12 15:10:38.223312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e8c30887-a54f-44a8-af0a-122711662e1e, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8c30887-a54f-44a8-af0a-122711662e1e,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:38.241107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'e8c30887-a54f-44a8-af0a-122711662e1e', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'e8c30887-a54f-44a8-af0a-122711662e1e', 'mac_address': 'fa:16:3e:1e:3f:d9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.191'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:10:38.351325 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:38.373574 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e8c30887-a54f-44a8-af0a-122711662e1e {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:38.393988 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e8c30887-a54f-44a8-af0a-122711662e1e, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8c30887-a54f-44a8-af0a-122711662e1e,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:38.401545 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:38.446923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-9126c227-7f09-4254-8a49-83e336f7e354 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:38.448296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed4b1a20-d25e-4b2a-a170-8593bd723b70 req-9126c227-7f09-4254-8a49-83e336f7e354 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.4348204 May 12 15:10:38.468969 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28b4e16-e653-4ca6-936b-4897c258c4d1 req-9dde69f4-7a9c-4bac-88a1-0adc8ab6bbe2 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:38.475946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e28b4e16-e653-4ca6-936b-4897c258c4d1 req-9dde69f4-7a9c-4bac-88a1-0adc8ab6bbe2 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 950 time: 0.1550221 May 12 15:10:38.482431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=e8c30887-a54f-44a8-af0a-122711662e1e,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:38.535921 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-26345d6f-a302-4eb8-af75-18cffde30a78'] response: {'name': 'network-changed', 'server_uuid': 'ec64d0a8-e302-4f1f-b954-5a422e360221', 'tag': 'e8c30887-a54f-44a8-af0a-122711662e1e', 'status': 'completed', 'code': 200} May 12 15:10:38.556156 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e28b4e16-e653-4ca6-936b-4897c258c4d1 req-978e2d7a-4ca9-4500-b7f7-ffbf5cb27cd0 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0792356 May 12 15:10:38.607590 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-157fe68f-ba4e-4b1a-ab93-153b9df39e17'] response: {'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'code': 200} May 12 15:10:38.650816 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['e8c30887-a54f-44a8-af0a-122711662e1e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:38.655759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ef07df-e5a4-4a4b-a219-2d4e372d1e1e req-12310781-00f9-4cac-9151-c5d009679cf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:38.657335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69ef07df-e5a4-4a4b-a219-2d4e372d1e1e req-12310781-00f9-4cac-9151-c5d009679cf3 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=8a871ef1e9124e35b230ac65e37bd02e&device_id=ec64d0a8-e302-4f1f-b954-5a422e360221 HTTP/1.1" status: 200 len: 1100 time: 0.1002469 May 12 15:10:38.917570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8c763545-c060-4d49-8114-c2cc4fe67915 req-ef9d9fac-f11b-4fa9-979a-237864ff094c tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Synchronizing usage tracker for tenant:fd97c932be3143b1846bb48363040c63 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:38.998483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8c763545-c060-4d49-8114-c2cc4fe67915 req-ef9d9fac-f11b-4fa9-979a-237864ff094c tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Unset dirty status for tenant:fd97c932be3143b1846bb48363040c63 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:39.000228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c763545-c060-4d49-8114-c2cc4fe67915 req-ef9d9fac-f11b-4fa9-979a-237864ff094c tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-ServerRescueTestJSONUnderV235-securitygroup-781619532&fields=id&tenant_id=fd97c932be3143b1846bb48363040c63 HTTP/1.1" status: 200 len: 267 time: 0.3007145 May 12 15:10:39.003533 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ef07df-e5a4-4a4b-a219-2d4e372d1e1e req-2017924d-86dc-43d6-8ae2-41eea36c7bc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:39.006384 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69ef07df-e5a4-4a4b-a219-2d4e372d1e1e req-2017924d-86dc-43d6-8ae2-41eea36c7bc8 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.3400359 May 12 15:10:39.046868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fdea6f95-4926-47ab-b77f-0443f92db7f5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:39.118855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port fdea6f95-4926-47ab-b77f-0443f92db7f5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:39.119314 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:39.127027 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69ef07df-e5a4-4a4b-a219-2d4e372d1e1e req-7d38c29b-4bb0-49e4-80e7-ca248641bc51 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.191&port_id=e8c30887-a54f-44a8-af0a-122711662e1e HTTP/1.1" status: 200 len: 217 time: 0.1093838 May 12 15:10:39.134251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-57a98ea6-8130-4745-b01e-e8f38c89ebc8 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:39.135623 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-57a98ea6-8130-4745-b01e-e8f38c89ebc8 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 808 time: 0.4198534 May 12 15:10:39.209195 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-310b5218-e457-4f66-8717-10e23cfb0c20 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/quotas/68c66ae0cd45476b87e2e79625b80f69 HTTP/1.1" status: 200 len: 375 time: 0.0649152 May 12 15:10:39.277919 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-b2ffa541-895a-47d9-8c4e-79260d935b51 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=0da54985cde346e68eeadf965b8bc6d3&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0730898 May 12 15:10:39.292903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ef07df-e5a4-4a4b-a219-2d4e372d1e1e req-6b7911e0-e5c3-43a9-8c39-1386ff8dfbe8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:39.294353 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69ef07df-e5a4-4a4b-a219-2d4e372d1e1e req-6b7911e0-e5c3-43a9-8c39-1386ff8dfbe8 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1578736 May 12 15:10:39.317029 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-f2d7da6b-7ccf-43a6-85eb-49ad0d86dc79 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0777426 May 12 15:10:39.451207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c763545-c060-4d49-8114-c2cc4fe67915 req-b2b68377-e9d7-4887-ace1-b1d9554ecd80 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:39.452692 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c763545-c060-4d49-8114-c2cc4fe67915 req-b2b68377-e9d7-4887-ace1-b1d9554ecd80 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 945 time: 0.4452913 May 12 15:10:39.475073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-8c763545-c060-4d49-8114-c2cc4fe67915 req-65240a65-7683-48c9-8daa-4449166e208e tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Request body: {'port': {'security_groups': ['14760cab-e3dc-4bd2-9dbe-16aa688504a5', '9718bb98-bff2-4136-a403-fec1779615d0']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:39.708238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e4e27581-bde9-414a-9322-ca6d083078f4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:39.709669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e4e27581-bde9-414a-9322-ca6d083078f4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4233677 May 12 15:10:39.729459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ef07df-e5a4-4a4b-a219-2d4e372d1e1e req-4ad1ab34-4e12-406d-9ace-4714a9be4e2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:39.730785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69ef07df-e5a4-4a4b-a219-2d4e372d1e1e req-4ad1ab34-4e12-406d-9ace-4714a9be4e2e service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.4128156 May 12 15:10:39.738668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Request body: {'port': {'device_id': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '0da54985cde346e68eeadf965b8bc6d3'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:39.860264 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8c763545-c060-4d49-8114-c2cc4fe67915 req-65240a65-7683-48c9-8daa-4449166e208e tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:39.962074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e8c30887-a54f-44a8-af0a-122711662e1e up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:40.034274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port e8c30887-a54f-44a8-af0a-122711662e1e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:40.039431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port e8c30887-a54f-44a8-af0a-122711662e1e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:40.039845 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:40.107732 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-2b026acd-d3db-4156-9c5f-d88ddd69be6a service neutron] 10.222.0.82 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7517865 May 12 15:10:40.190242 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:40.224606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e8c30887-a54f-44a8-af0a-122711662e1e, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8c30887-a54f-44a8-af0a-122711662e1e,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:40.229615 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:40.307109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=e8c30887-a54f-44a8-af0a-122711662e1e,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:40.327702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:40.334261 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69ef07df-e5a4-4a4b-a219-2d4e372d1e1e req-f824393e-cc61-41f0-a2b5-3f430fd0c87f service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5817397 May 12 15:10:40.353492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Usage tracker for resource:port and tenant:0da54985cde346e68eeadf965b8bc6d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:40.377090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:40.391240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:40.482116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-b4bfb3e2-2a9c-47b3-a8d0-07589cdf6dc0 service neutron] 10.222.0.82 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3634069 May 12 15:10:40.488302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Made reservation on behalf of 0da54985cde346e68eeadf965b8bc6d3 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:40.491814 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:40.652128 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ec64d0a8-e302-4f1f-b954-5a422e360221', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8c30887-a54f-44a8-af0a-122711662e1e'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:40.710017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69ef07df-e5a4-4a4b-a219-2d4e372d1e1e req-98f3b453-3114-4340-8678-febee9d55f08 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3537979 May 12 15:10:40.788409 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-8c763545-c060-4d49-8114-c2cc4fe67915 req-65240a65-7683-48c9-8daa-4449166e208e tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] For port bedffd1f-e77b-484f-b090-5d8637b7262c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bedffd1f-e77b-484f-b090-5d8637b7262c,segment=NetworkSegment(96a7c587-eda9-40b0-aaff-97f4e1387d63),segment_id=96a7c587-eda9-40b0-aaff-97f4e1387d63)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:40.888762 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8c763545-c060-4d49-8114-c2cc4fe67915 req-65240a65-7683-48c9-8daa-4449166e208e tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:40.901281 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8c763545-c060-4d49-8114-c2cc4fe67915 req-65240a65-7683-48c9-8daa-4449166e208e tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:40.915288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Allocated IP 192.168.233.38 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/9787cef9-03af-4a15-af20-0eb8fe5ee859) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:40.947607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['bedffd1f-e77b-484f-b090-5d8637b7262c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:41.002242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc5f3fbe-feba-433d-aa9d-84af72a4e6b4 req-e55ab408-d753-43f6-8274-e304ea43071a tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:41.003652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc5f3fbe-feba-433d-aa9d-84af72a4e6b4 req-e55ab408-d753-43f6-8274-e304ea43071a tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=ec64d0a8-e302-4f1f-b954-5a422e360221 HTTP/1.1" status: 200 len: 950 time: 0.2985680 May 12 15:10:41.011687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c763545-c060-4d49-8114-c2cc4fe67915 req-65240a65-7683-48c9-8daa-4449166e208e tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:41.012294 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8c763545-c060-4d49-8114-c2cc4fe67915 req-65240a65-7683-48c9-8daa-4449166e208e tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:41.013630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c763545-c060-4d49-8114-c2cc4fe67915 req-65240a65-7683-48c9-8daa-4449166e208e tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "PUT /v2.0/ports/bedffd1f-e77b-484f-b090-5d8637b7262c HTTP/1.1" status: 200 len: 981 time: 1.5477264 May 12 15:10:41.017028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'tag': 'bedffd1f-e77b-484f-b090-5d8637b7262c'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:41.068362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65240a65-7683-48c9-8daa-4449166e208e tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Pushing event updated for resources: {'Port': ['ID=bedffd1f-e77b-484f-b090-5d8637b7262c,revision_number=6']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:41.117763 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc5f3fbe-feba-433d-aa9d-84af72a4e6b4 req-4fc49020-eef2-44c4-9836-278252f09b94 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0914550 May 12 15:10:41.185570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['bedffd1f-e77b-484f-b090-5d8637b7262c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:41.274595 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32c221da-eba6-40ca-a68a-7c9a63976230 req-c0100aa6-b62d-4e93-ab40-a415aeb678dd tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 210 time: 0.1359596 May 12 15:10:41.440725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-f922dccc-3290-4e35-b960-8e4bc6614fbc tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1259432688&fields=id&tenant_id=a673d571317840e888b6cfe5a121092e HTTP/1.1" status: 200 len: 267 time: 0.2034972 May 12 15:10:41.448314 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00d9c313-c263-4cea-a23e-775b6eed5008 req-c5baf974-1caa-40bd-951c-19b6f3829586 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips/32051d3b-924d-4d0c-8f9b-153455cc8fc0 HTTP/1.1" status: 200 len: 692 time: 0.1307209 May 12 15:10:41.641196 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:41.697331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Transition to ACTIVE for port object 9787cef9-03af-4a15-af20-0eb8fe5ee859 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:41.774284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d8a6f583-1b88-416c-83a7-6714bccb5743 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:41.775702 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d8a6f583-1b88-416c-83a7-6714bccb5743 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/networks?id=7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 HTTP/1.1" status: 200 len: 812 time: 0.3262007 May 12 15:10:41.788966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00d9c313-c263-4cea-a23e-775b6eed5008 req-967bc584-2b96-4408-8fe6-d31a87d298fa tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:41.790254 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00d9c313-c263-4cea-a23e-775b6eed5008 req-967bc584-2b96-4408-8fe6-d31a87d298fa tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.3275106 May 12 15:10:41.803840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-b7be302d-a4f7-4888-9d8e-0bf21b461779 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/quotas/a673d571317840e888b6cfe5a121092e HTTP/1.1" status: 200 len: 375 time: 0.0117548 May 12 15:10:41.850830 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:41.865200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['b6035326-cd91-47d7-8a65-cc2dd3d1d127', 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:41.896397 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a686f1c4-b2f1-4692-950a-b2a71f6aeb6f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:42.123510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:42.125315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:42.131737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:42.135450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:42.232700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-7b8a964a-8e56-4117-a701-0de9a15cd9d8 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=a673d571317840e888b6cfe5a121092e&fields=id HTTP/1.1" status: 200 len: 348 time: 0.4162223 May 12 15:10:42.264096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:42.268975 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:42.351243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63f1698b-6937-492d-9e70-3ec45c82b187 req-3c26f9ff-5786-4a3d-a692-760144bd2e37 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:42.352829 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63f1698b-6937-492d-9e70-3ec45c82b187 req-3c26f9ff-5786-4a3d-a692-760144bd2e37 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=9b2b4b7d-231c-4e54-83f4-827d02cbcbb5 HTTP/1.1" status: 200 len: 950 time: 0.3714037 May 12 15:10:42.392101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-b71ba701-a2b8-4aeb-a5df-b15c496fe021 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:42.392698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-b71ba701-a2b8-4aeb-a5df-b15c496fe021 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Synchronizing usage tracker for tenant:68c66ae0cd45476b87e2e79625b80f69 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:42.409811 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-e1d5a75f-0e2a-45b4-8ce8-3207c8e14d52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.6870155 May 12 15:10:42.412726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-b71ba701-a2b8-4aeb-a5df-b15c496fe021 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Unset dirty status for tenant:68c66ae0cd45476b87e2e79625b80f69 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:42.414260 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-b71ba701-a2b8-4aeb-a5df-b15c496fe021 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.84 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 808 time: 0.3734958 May 12 15:10:42.430069 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Request body: {'port': {'device_id': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:42.462462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Request body: {'port': {'device_id': '3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4', 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28', 'admin_state_up': True, 'tenant_id': '68c66ae0cd45476b87e2e79625b80f69'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:42.482065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c298430f-7137-47c6-93f3-46c27c4d22be None None] Provisioning for port 9787cef9-03af-4a15-af20-0eb8fe5ee859 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:42.489333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c298430f-7137-47c6-93f3-46c27c4d22be None None] Provisioning complete for port 9787cef9-03af-4a15-af20-0eb8fe5ee859 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:42.490043 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c298430f-7137-47c6-93f3-46c27c4d22be None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:42.504426 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63f1698b-6937-492d-9e70-3ec45c82b187 req-b4c575df-4b40-4708-bb51-87455c162ced tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1380141 May 12 15:10:42.569344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c298430f-7137-47c6-93f3-46c27c4d22be None None] Port 9787cef9-03af-4a15-af20-0eb8fe5ee859 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:10:42.580120 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-4c92f1af-4ce6-4085-aed3-1bf4513d9450 service neutron] 10.222.0.82 "GET /v2.0/networks/7336b0e1-6ae7-4c8a-98e8-3f13adbdc190?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3464029 May 12 15:10:42.656762 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5bf767c-34ed-4acd-9fe9-10784890678e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:42.679751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:42.696040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Usage tracker for resource:port and tenant:68c66ae0cd45476b87e2e79625b80f69 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:42.700456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:42.706512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:42.719396 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Made reservation on behalf of 68c66ae0cd45476b87e2e79625b80f69 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:42.720429 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:42.723635 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:42.774837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c0688e7-54a2-4513-a231-41b25e64fb2e req-10c7b7b3-90c7-4e30-ae87-5508896cb013 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 210 time: 0.0686517 May 12 15:10:42.777426 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:42.869756 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ba45a25a-81fc-430d-89f5-46c9f7325f6f'] response: {'server_uuid': 'ec64d0a8-e302-4f1f-b954-5a422e360221', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8c30887-a54f-44a8-af0a-122711662e1e', 'code': 200} May 12 15:10:42.896761 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-6f019a6e-42d4-4e10-977e-26e95e421a86 service neutron] 10.222.0.82 "GET /v2.0/networks/7336b0e1-6ae7-4c8a-98e8-3f13adbdc190?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3157690 May 12 15:10:42.916012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Allocated IP 172.20.0.4 (e8211761-0dd9-424f-b732-629fd2d77e28/ed7d4325-c4dc-4592-8d41-1f3fe41da585/14990298-685a-4dd8-a308-ee8dcbbb6d93) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:43.187599 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86ee04d2-9996-41af-92e8-3621a7b28228 req-1c3dd1c3-12e5-4ed9-9630-127d52982015 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-ServerRescueTestJSONUnderV235-securitygroup-781619532&fields=id&tenant_id=fd97c932be3143b1846bb48363040c63 HTTP/1.1" status: 200 len: 267 time: 0.1547081 May 12 15:10:43.191391 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:43.225777 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:43.263908 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c6aec200-b973-413f-a4d4-4361faa5d8e1'] response: {'name': 'network-changed', 'server_uuid': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'tag': 'bedffd1f-e77b-484f-b090-5d8637b7262c', 'status': 'completed', 'code': 200} May 12 15:10:43.372388 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Network e8211761-0dd9-424f-b732-629fd2d77e28 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:43.379043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:43.381676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:43.439789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Pushing event updated for resources: {'Port': ['ID=14990298-685a-4dd8-a308-ee8dcbbb6d93,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:43.452197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6697c1bc-1fbd-49a6-afa5-4b816c0da68e req-42e56ce9-4152-432f-b9dc-3c347c9d008d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:43.454646 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6697c1bc-1fbd-49a6-afa5-4b816c0da68e req-42e56ce9-4152-432f-b9dc-3c347c9d008d service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=ec64d0a8-e302-4f1f-b954-5a422e360221 HTTP/1.1" status: 200 len: 1101 time: 0.4758236 May 12 15:10:43.465905 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-6f3e56f3-170d-4828-a499-45b60e1fa8a9 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips/32051d3b-924d-4d0c-8f9b-153455cc8fc0 HTTP/1.1" status: 200 len: 692 time: 0.2038941 May 12 15:10:43.473579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:43.474204 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:43.507607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca11ebe1-631b-44f4-94b4-5e0194392f41 req-3d3d6697-91db-476b-b402-5560bf743a1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:43.509431 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca11ebe1-631b-44f4-94b4-5e0194392f41 req-3d3d6697-91db-476b-b402-5560bf743a1a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fd97c932be3143b1846bb48363040c63&device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 1135 time: 0.2167220 May 12 15:10:43.511019 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-6e27ac4e-2cba-4c3d-a65c-fbea90de19f2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0525122 May 12 15:10:43.557243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Request body: {'port': {'device_id': '3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:43.663211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9787cef9-03af-4a15-af20-0eb8fe5ee859 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:43.671131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6697c1bc-1fbd-49a6-afa5-4b816c0da68e req-d4327898-6f41-4d0f-b4cb-6278a6932bf7 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2017796 May 12 15:10:43.678927 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:43.688739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ee04d2-9996-41af-92e8-3621a7b28228 req-89d79451-0905-49cb-947d-8e38c9a737c2 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:43.690315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86ee04d2-9996-41af-92e8-3621a7b28228 req-89d79451-0905-49cb-947d-8e38c9a737c2 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 984 time: 0.4923549 May 12 15:10:43.712079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-86ee04d2-9996-41af-92e8-3621a7b28228 req-54803b63-e690-4f8e-855d-ab7b8ab4ffc0 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Request body: {'port': {'security_groups': ['14760cab-e3dc-4bd2-9dbe-16aa688504a5']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:43.883675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Transition to ACTIVE for port object 9787cef9-03af-4a15-af20-0eb8fe5ee859 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:43.894548 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:43.902176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca11ebe1-631b-44f4-94b4-5e0194392f41 req-c543600f-6aa4-420f-854e-167c83ff5ec0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:43.903777 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca11ebe1-631b-44f4-94b4-5e0194392f41 req-c543600f-6aa4-420f-854e-167c83ff5ec0 service neutron] 10.222.0.84 "GET /v2.0/networks?id=74c45f45-b34b-4876-a35b-8ae714cf4d5f HTTP/1.1" status: 200 len: 921 time: 0.3751357 May 12 15:10:43.904398 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:44.018465 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca11ebe1-631b-44f4-94b4-5e0194392f41 req-997e209a-d92e-438a-92a1-7d92605d8a08 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bedffd1f-e77b-484f-b090-5d8637b7262c HTTP/1.1" status: 200 len: 217 time: 0.1044829 May 12 15:10:44.031000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-894c591b-1db1-4c1e-af7a-fc6a3005ec1b tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:44.032939 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-894c591b-1db1-4c1e-af7a-fc6a3005ec1b tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.5461626 May 12 15:10:44.087409 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-f93fe9b3-9119-4285-a8ef-5b4013651738 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:10:44.096454 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-f93fe9b3-9119-4285-a8ef-5b4013651738 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0132082 May 12 15:10:44.193465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca11ebe1-631b-44f4-94b4-5e0194392f41 req-18d541c1-3b43-460c-961e-240427b89bca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:44.194953 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca11ebe1-631b-44f4-94b4-5e0194392f41 req-18d541c1-3b43-460c-961e-240427b89bca service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8de7231c-cca8-4041-a1ba-b8eba5dd5861 HTTP/1.1" status: 200 len: 860 time: 0.1704886 May 12 15:10:44.200994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:44.239863 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-6675489a-2abd-4862-a896-3877bef069eb tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.36 HTTP/1.1" status: 200 len: 695 time: 0.1426339 May 12 15:10:44.253507 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca11ebe1-631b-44f4-94b4-5e0194392f41 req-ffcafc5d-423c-4a9d-aeea-2eb3bd5bde20 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=74c45f45-b34b-4876-a35b-8ae714cf4d5f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0479043 May 12 15:10:44.306230 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-86ee04d2-9996-41af-92e8-3621a7b28228 req-54803b63-e690-4f8e-855d-ab7b8ab4ffc0 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:44.416049 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-f9182a2e-0831-4291-8cd8-62f54d67fa2b tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.36 HTTP/1.1" status: 200 len: 695 time: 0.1589167 May 12 15:10:44.509690 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca11ebe1-631b-44f4-94b4-5e0194392f41 req-1cbda4a7-ea58-4dd3-a07b-bc7387567957 service neutron] 10.222.0.84 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2341371 May 12 15:10:44.627858 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:10:44.668198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Attempting to bind port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:44.668530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Attempting to bind port 9787cef9-03af-4a15-af20-0eb8fe5ee859 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:44.668858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Attempting to bind port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:44.683038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 14990298-685a-4dd8-a308-ee8dcbbb6d93 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:44.695002 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:44.737136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:10:44.737485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Attempting to bind port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:44.741760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Transition to ACTIVE for port object 14990298-685a-4dd8-a308-ee8dcbbb6d93 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:44.747662 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca11ebe1-631b-44f4-94b4-5e0194392f41 req-49c63866-0531-4d96-9d7e-17f3fd491433 service neutron] 10.222.0.84 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2241552 May 12 15:10:44.750766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-c642f758-9405-430f-aa02-a27a197c516a tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Deleting port e824a752-ab38-45a7-8cb9-ed8329e6d797 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:10:44.751110 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-c642f758-9405-430f-aa02-a27a197c516a tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:44.752432 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:44.792750 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7c971db9-2b65-43ad-8ed1-d5da0df11f4f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:44.811432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 10, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:44.811819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:44.812259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:44.813245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Bound port: 9787cef9-03af-4a15-af20-0eb8fe5ee859, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:44.813608 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:44.929652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Pushing event updated for resources: {'Port': ['ID=14990298-685a-4dd8-a308-ee8dcbbb6d93,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:45.052388 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Attempting to bind port 14990298-685a-4dd8-a308-ee8dcbbb6d93 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:45.052727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Attempting to bind port 14990298-685a-4dd8-a308-ee8dcbbb6d93 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:45.053049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Attempting to bind port 14990298-685a-4dd8-a308-ee8dcbbb6d93 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:45.057864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Port 14990298-685a-4dd8-a308-ee8dcbbb6d93 on network e8211761-0dd9-424f-b732-629fd2d77e28 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:10:45.058175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Attempting to bind port 14990298-685a-4dd8-a308-ee8dcbbb6d93 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:45.063826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 10, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:45.064157 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Checking segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:45.064527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Bound using segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:45.064949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Bound port: 14990298-685a-4dd8-a308-ee8dcbbb6d93, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:45.065289 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:45.134738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6397c8-2b94-43e9-a02e-60a84588845c req-0dfe4145-fb3c-424a-8ae2-48f2e363f037 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:45.136145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-0dfe4145-fb3c-424a-8ae2-48f2e363f037 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.76 "GET /v2.0/networks?id=7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 HTTP/1.1" status: 200 len: 812 time: 0.5376225 May 12 15:10:45.154364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:45.157341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:45.162282 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:45.195123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-86ee04d2-9996-41af-92e8-3621a7b28228 req-54803b63-e690-4f8e-855d-ab7b8ab4ffc0 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] For port bedffd1f-e77b-484f-b090-5d8637b7262c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bedffd1f-e77b-484f-b090-5d8637b7262c,segment=NetworkSegment(96a7c587-eda9-40b0-aaff-97f4e1387d63),segment_id=96a7c587-eda9-40b0-aaff-97f4e1387d63)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:45.204596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:45.226641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:45.227296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:45.228633 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] 10.222.0.84 "PUT /v2.0/ports/14990298-685a-4dd8-a308-ee8dcbbb6d93 HTTP/1.1" status: 200 len: 1091 time: 1.6798143 May 12 15:10:45.229208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4', 'tag': '14990298-685a-4dd8-a308-ee8dcbbb6d93'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:45.240926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:45.243016 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-c642f758-9405-430f-aa02-a27a197c516a tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:45.243392 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-c642f758-9405-430f-aa02-a27a197c516a tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:45.257048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80ded396-865c-4f50-b631-9c4bcf064abd service neutron] Pushing event updated for resources: {'Port': ['ID=14990298-685a-4dd8-a308-ee8dcbbb6d93,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:45.261662 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:45.363151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-86106ee2-44db-4db3-be23-26694c832f22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:45.364579 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-86106ee2-44db-4db3-be23-26694c832f22 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 1094 time: 0.0756764 May 12 15:10:45.447879 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-76e35505-3184-4a90-a28b-a8a1f3edf6dd service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93 HTTP/1.1" status: 200 len: 217 time: 0.0682847 May 12 15:10:45.495114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-519e6138-512e-4b8f-9748-d695d731089f tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a673d571317840e888b6cfe5a121092e HTTP/1.1" status: 200 len: 380 time: 0.3381960 May 12 15:10:45.510669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-87df0668-2cfc-4d56-b985-b5522601b992 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:45.512108 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-87df0668-2cfc-4d56-b985-b5522601b992 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.0576241 May 12 15:10:45.559342 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-124635dd-91e5-4852-ac3b-0480b8602207 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0402021 May 12 15:10:45.561821 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-86ee04d2-9996-41af-92e8-3621a7b28228 req-54803b63-e690-4f8e-855d-ab7b8ab4ffc0 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:45.577774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-c642f758-9405-430f-aa02-a27a197c516a tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Calling delete_port for e824a752-ab38-45a7-8cb9-ed8329e6d797 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:10:45.606269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Request body: {'port': {'device_id': '8403f3e5-d02f-4cd4-b73d-21cd47e6f139', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'admin_state_up': True, 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'security_groups': ['4db559d6-6ff9-4f01-9ab9-98bc9279fdd7']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:45.634892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:45.635493 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:45.636889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d1015c10-399d-4510-83c7-a67005618878 service neutron] 10.222.0.76 "PUT /v2.0/ports/9787cef9-03af-4a15-af20-0eb8fe5ee859 HTTP/1.1" status: 200 len: 1095 time: 3.2178054 May 12 15:10:45.637595 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-86ee04d2-9996-41af-92e8-3621a7b28228 req-54803b63-e690-4f8e-855d-ab7b8ab4ffc0 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:45.638973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:45.680502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['bedffd1f-e77b-484f-b090-5d8637b7262c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:45.807802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ee04d2-9996-41af-92e8-3621a7b28228 req-54803b63-e690-4f8e-855d-ab7b8ab4ffc0 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:45.808497 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-86ee04d2-9996-41af-92e8-3621a7b28228 req-54803b63-e690-4f8e-855d-ab7b8ab4ffc0 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:45.809790 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86ee04d2-9996-41af-92e8-3621a7b28228 req-54803b63-e690-4f8e-855d-ab7b8ab4ffc0 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "PUT /v2.0/ports/bedffd1f-e77b-484f-b090-5d8637b7262c HTTP/1.1" status: 200 len: 942 time: 2.1093142 May 12 15:10:45.824805 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1015c10-399d-4510-83c7-a67005618878 service neutron] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:45.866987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-3d0b4675-2cc2-4fd8-9bbb-c93929138934 service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3011982 May 12 15:10:45.974335 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:45.978668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['bedffd1f-e77b-484f-b090-5d8637b7262c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:46.031563 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0de51f1a-8d3d-4716-bc6a-7bc051bb779e req-dd71f97a-290b-4be6-89dc-2a2e5c6f9ef8 service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1565161 May 12 15:10:46.058500 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:46.067026 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:46.081746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54803b63-e690-4f8e-855d-ab7b8ab4ffc0 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Pushing event updated for resources: {'Port': ['ID=bedffd1f-e77b-484f-b090-5d8637b7262c,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:46.088166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Usage tracker for resource:port and tenant:a673d571317840e888b6cfe5a121092e is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:46.101972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:46.115331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:46.123837 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-0ebb8d76-6673-4cba-8e13-37b1a44b9965 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:46.125488 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-0ebb8d76-6673-4cba-8e13-37b1a44b9965 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 1098 time: 0.4036496 May 12 15:10:46.133960 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-c642f758-9405-430f-aa02-a27a197c516a tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:46.221305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Made reservation on behalf of a673d571317840e888b6cfe5a121092e for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:46.224659 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:46.257337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c642f758-9405-430f-aa02-a27a197c516a tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Pushing event deleted for resources: {'Port': ['ID=e824a752-ab38-45a7-8cb9-ed8329e6d797,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:46.273242 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-d51faccc-5af8-45d1-8416-ae3817843cd9 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859 HTTP/1.1" status: 200 len: 217 time: 0.1353550 May 12 15:10:46.391262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d6304be-101f-4fca-a76b-8e0e360fbbcc req-5d03df5e-3dfd-4618-aee8-ad433b8283a9 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:46.392706 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d6304be-101f-4fca-a76b-8e0e360fbbcc req-5d03df5e-3dfd-4618-aee8-ad433b8283a9 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=ec64d0a8-e302-4f1f-b954-5a422e360221 HTTP/1.1" status: 200 len: 950 time: 0.4715440 May 12 15:10:46.514238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-95c58339-ad55-4a0b-82be-7914e2caf96f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:46.516457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-95c58339-ad55-4a0b-82be-7914e2caf96f service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2060168 May 12 15:10:46.533515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d6304be-101f-4fca-a76b-8e0e360fbbcc req-365b8b52-7a63-487c-be6f-6d1e7d1412c8 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1110172 May 12 15:10:46.610384 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-c642f758-9405-430f-aa02-a27a197c516a tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:46.718888 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-c642f758-9405-430f-aa02-a27a197c516a tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:46.719992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-913d4736-2521-4d45-b8f5-ed27ff09bf74 req-c642f758-9405-430f-aa02-a27a197c516a tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "DELETE /v2.0/floatingips/32051d3b-924d-4d0c-8f9b-153455cc8fc0 HTTP/1.1" status: 204 len: 173 time: 2.2945216 May 12 15:10:46.732445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Allocated IP 172.20.0.12 (7336b0e1-6ae7-4c8a-98e8-3f13adbdc190/eb51e145-1f59-4ab5-b2f3-a32c2c6ee575/b916a765-866f-4478-817f-f3e33e79f873) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:46.786139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-3079f590-ef1d-4222-972f-39974161b674 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:46.788219 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-3079f590-ef1d-4222-972f-39974161b674 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2590199 May 12 15:10:46.892552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70599d96-7b84-444d-9df7-50796ad805c4 req-983f7037-683d-44ce-9032-c8ede1125a5e tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:46.893255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-70599d96-7b84-444d-9df7-50796ad805c4 req-983f7037-683d-44ce-9032-c8ede1125a5e tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Synchronizing usage tracker for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:47.123285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-70599d96-7b84-444d-9df7-50796ad805c4 req-983f7037-683d-44ce-9032-c8ede1125a5e tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Unset dirty status for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:47.124265 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70599d96-7b84-444d-9df7-50796ad805c4 req-983f7037-683d-44ce-9032-c8ede1125a5e tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 947 time: 0.4941406 May 12 15:10:47.256241 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:47.291225 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-f86e2e8d-5e75-4151-a6fd-5e7607ccd7a2 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4942694 May 12 15:10:47.294235 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70599d96-7b84-444d-9df7-50796ad805c4 req-91416d51-2ba8-4ce9-9035-cfc1d069c381 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1359711 May 12 15:10:47.321708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Transition to ACTIVE for port object b916a765-866f-4478-817f-f3e33e79f873 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:47.458988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40b2ceda-45c6-4788-9bbd-c0b5550a6cf1 req-04a8d51d-b560-41fa-81b5-096adcb41403 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:47.464620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40b2ceda-45c6-4788-9bbd-c0b5550a6cf1 req-04a8d51d-b560-41fa-81b5-096adcb41403 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:47.466163 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40b2ceda-45c6-4788-9bbd-c0b5550a6cf1 req-04a8d51d-b560-41fa-81b5-096adcb41403 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71&device_id=9b2b4b7d-231c-4e54-83f4-827d02cbcbb5 HTTP/1.1" status: 200 len: 1691 time: 0.3486643 May 12 15:10:47.467399 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4955b099-0467-436c-b9a7-aa48182f211d req-3e17ba8b-11b0-4118-b5f6-04f0e6671f19 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Synchronizing usage tracker for tenant:a673d571317840e888b6cfe5a121092e on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:47.525002 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:47.548076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4955b099-0467-436c-b9a7-aa48182f211d req-3e17ba8b-11b0-4118-b5f6-04f0e6671f19 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Unset dirty status for tenant:a673d571317840e888b6cfe5a121092e on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:47.549254 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4955b099-0467-436c-b9a7-aa48182f211d req-3e17ba8b-11b0-4118-b5f6-04f0e6671f19 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/ports?device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 210 time: 0.1552866 May 12 15:10:47.557900 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:47.563228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b57521a-36d2-4105-9fd8-c4709a714c15 req-a50e1286-1d26-4be4-946c-685f8c11b072 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2622998 May 12 15:10:47.604196 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40b2ceda-45c6-4788-9bbd-c0b5550a6cf1 req-b3ffa785-1540-42d2-90ba-a081dcc24768 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1297407 May 12 15:10:47.641171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:47.644183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:47.648473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:47.681927 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5b1f9d7c-e02b-43c2-846c-42b0178e4420'] response: {'name': 'network-changed', 'server_uuid': '3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4', 'tag': '14990298-685a-4dd8-a308-ee8dcbbb6d93', 'status': 'completed', 'code': 200} May 12 15:10:47.735967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Pushing event updated for resources: {'Port': ['ID=b916a765-866f-4478-817f-f3e33e79f873,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:47.747618 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ef3690e5-0e4d-48fc-ad06-ff5e00532509'] response: {'name': 'network-changed', 'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'status': 'completed', 'code': 200} May 12 15:10:47.822212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94f8d723-371b-45fa-a3a1-599d8e8337bc req-366fbcc8-5297-40aa-9509-57f249012e6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:47.823812 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-94f8d723-371b-45fa-a3a1-599d8e8337bc req-366fbcc8-5297-40aa-9509-57f249012e6a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 1094 time: 0.0867748 May 12 15:10:47.888560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:47.889159 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:47.917288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4b2c7838-a77e-4b52-bd6f-cea55e5730ba None None] Provisioning for port b916a765-866f-4478-817f-f3e33e79f873 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:47.923788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4b2c7838-a77e-4b52-bd6f-cea55e5730ba None None] Provisioning complete for port b916a765-866f-4478-817f-f3e33e79f873 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:47.924293 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4b2c7838-a77e-4b52-bd6f-cea55e5730ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:47.951108 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-d73f3590-ee5a-4dfc-b0f9-96130f1d18f6 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.3512630 May 12 15:10:47.974616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94f8d723-371b-45fa-a3a1-599d8e8337bc req-7589bfd1-a138-4d4b-b5c9-3de5fbdd0530 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:47.976054 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-94f8d723-371b-45fa-a3a1-599d8e8337bc req-7589bfd1-a138-4d4b-b5c9-3de5fbdd0530 service neutron] 10.222.0.84 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.1388772 May 12 15:10:47.976453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Request body: {'port': {'device_id': '8403f3e5-d02f-4cd4-b73d-21cd47e6f139', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:47.981109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4b2c7838-a77e-4b52-bd6f-cea55e5730ba None None] Port b916a765-866f-4478-817f-f3e33e79f873 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:10:48.050369 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-94f8d723-371b-45fa-a3a1-599d8e8337bc req-ab553ce9-455f-4f6a-8f0b-44e4304e3a8f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93 HTTP/1.1" status: 200 len: 217 time: 0.0669069 May 12 15:10:48.075067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ef0fcf-ae5c-402a-9031-015b63667d28 req-5a637d67-24e6-4795-8eb5-49378de28fe1 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:48.076506 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ef0fcf-ae5c-402a-9031-015b63667d28 req-5a637d67-24e6-4795-8eb5-49378de28fe1 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 943 time: 0.4015200 May 12 15:10:48.078597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-914155b8-298f-4fda-97ce-b56c09c4d9c9 req-bf8eac2b-61ff-487b-9402-506b62a1af61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:48.079935 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-914155b8-298f-4fda-97ce-b56c09c4d9c9 req-bf8eac2b-61ff-487b-9402-506b62a1af61 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 1098 time: 0.3058770 May 12 15:10:48.086151 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-e8081281-ba62-49c4-939b-4214b45dc959 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.3356776 May 12 15:10:48.118434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94f8d723-371b-45fa-a3a1-599d8e8337bc req-2f58e59a-4cb3-4011-8225-d7ea74e67cc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:48.119871 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-94f8d723-371b-45fa-a3a1-599d8e8337bc req-2f58e59a-4cb3-4011-8225-d7ea74e67cc6 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.0590415 May 12 15:10:48.164357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:48.172939 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-94f8d723-371b-45fa-a3a1-599d8e8337bc req-b27ad70a-0e3f-498a-8383-5226c7d9a030 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0417981 May 12 15:10:48.229614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:48.247769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Usage tracker for resource:floatingip and tenant:fd97c932be3143b1846bb48363040c63 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:10:48.254005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:10:48.275628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:48.290861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:48.316461 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-94f8d723-371b-45fa-a3a1-599d8e8337bc req-89a435f9-7553-4329-be8d-3d3d8f948075 service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1357005 May 12 15:10:48.326908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ef0fcf-ae5c-402a-9031-015b63667d28 req-769ec91a-e67f-4b38-81ed-2487673c5d90 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2398496 May 12 15:10:48.375620 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:48.408155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-914155b8-298f-4fda-97ce-b56c09c4d9c9 req-47eb970f-baec-44f7-adda-d9378f09231d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:48.409890 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-914155b8-298f-4fda-97ce-b56c09c4d9c9 req-47eb970f-baec-44f7-adda-d9378f09231d service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.3207407 May 12 15:10:48.463604 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-94f8d723-371b-45fa-a3a1-599d8e8337bc req-28a56f2f-3604-4e84-bc9e-acce99bcc927 service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1355786 May 12 15:10:48.573741 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-914155b8-298f-4fda-97ce-b56c09c4d9c9 req-eaa89bbd-ecd2-4e95-a45f-9ee429556f25 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859 HTTP/1.1" status: 200 len: 217 time: 0.1553378 May 12 15:10:48.994076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-914155b8-298f-4fda-97ce-b56c09c4d9c9 req-33ab4081-b9ec-4884-afb6-e9b050959ced service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:48.995508 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-914155b8-298f-4fda-97ce-b56c09c4d9c9 req-33ab4081-b9ec-4884-afb6-e9b050959ced service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3720038 May 12 15:10:49.009021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1765d436-b92c-41cb-b01e-6ff4a29fd389 req-a27b1b18-3128-4dce-a07d-1372f03998e7 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:49.010389 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1765d436-b92c-41cb-b01e-6ff4a29fd389 req-a27b1b18-3128-4dce-a07d-1372f03998e7 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 787 time: 0.4875560 May 12 15:10:49.154610 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:49.261261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-914155b8-298f-4fda-97ce-b56c09c4d9c9 req-948de809-bdfe-42a2-945a-46690ecc83e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:49.262673 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-914155b8-298f-4fda-97ce-b56c09c4d9c9 req-948de809-bdfe-42a2-945a-46690ecc83e7 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2505352 May 12 15:10:49.426263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 14990298-685a-4dd8-a308-ee8dcbbb6d93 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:10:49.472346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b916a765-866f-4478-817f-f3e33e79f873 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:49.490445 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:49.530233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Transition to ACTIVE for port object b916a765-866f-4478-817f-f3e33e79f873 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:49.557912 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:49.562929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Allocated IP 172.25.8.136 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/4a5c9445-7a04-4dec-9255-25097532a868) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:49.566722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:49.584211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '14990298-685a-4dd8-a308-ee8dcbbb6d93', 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28', 'port_id': '14990298-685a-4dd8-a308-ee8dcbbb6d93', 'mac_address': 'fa:16:3e:98:6a:de', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 579, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ed7d4325-c4dc-4592-8d41-1f3fe41da585', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:10:49.628637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b064b52b-3926-45f5-8e12-37a70eff887e req-cf9105ee-8cd3-416e-9d5a-bb82d8b412e3 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:49.630191 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b064b52b-3926-45f5-8e12-37a70eff887e req-cf9105ee-8cd3-416e-9d5a-bb82d8b412e3 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 947 time: 0.4347301 May 12 15:10:49.668850 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:49.686601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 14990298-685a-4dd8-a308-ee8dcbbb6d93 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:49.704468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:49.708273 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:49.746240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-914155b8-298f-4fda-97ce-b56c09c4d9c9 req-77c9685c-6f11-4aff-a2d2-9febef52bc54 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4400363 May 12 15:10:49.772176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'tag': 'bedffd1f-e77b-484f-b090-5d8637b7262c'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:49.782847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=14990298-685a-4dd8-a308-ee8dcbbb6d93,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:49.783079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Pushing event updated for resources: {'Port': ['ID=b916a765-866f-4478-817f-f3e33e79f873,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:49.995979 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b064b52b-3926-45f5-8e12-37a70eff887e req-d04652b4-8c2a-4166-8123-cb2bb158b584 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3400400 May 12 15:10:50.011457 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 9787cef9-03af-4a15-af20-0eb8fe5ee859 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:10:50.103853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['14990298-685a-4dd8-a308-ee8dcbbb6d93'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:50.177202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Attempting to bind port b916a765-866f-4478-817f-f3e33e79f873 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:50.177564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Attempting to bind port b916a765-866f-4478-817f-f3e33e79f873 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '0f481a89-826f-4a90-903d-276e9b18feb1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:50.177891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Attempting to bind port b916a765-866f-4478-817f-f3e33e79f873 on network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:50.183372 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:50.192597 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-914155b8-298f-4fda-97ce-b56c09c4d9c9 req-e5b8ae1a-a2d6-4873-b709-e57036208b85 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4107907 May 12 15:10:50.196319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Port b916a765-866f-4478-817f-f3e33e79f873 on network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:10:50.196643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Attempting to bind port b916a765-866f-4478-817f-f3e33e79f873 on network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:50.211734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 10, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:50.212073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Checking segment: {'id': '0f481a89-826f-4a90-903d-276e9b18feb1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:50.212458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Bound using segment: {'id': '0f481a89-826f-4a90-903d-276e9b18feb1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:50.213420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Bound port: b916a765-866f-4478-817f-f3e33e79f873, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0f481a89-826f-4a90-903d-276e9b18feb1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:50.213420 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:50.234463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:50.263888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'mac_address': 'fa:16:3e:ab:63:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.38'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:10:50.336736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cb366a1-81d4-4faa-91c0-4f6ec7f8c8ff req-0450748d-061a-442b-b568-a3e651c5c07d tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:50.338227 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0cb366a1-81d4-4faa-91c0-4f6ec7f8c8ff req-0450748d-061a-442b-b568-a3e651c5c07d tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/ports?device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 944 time: 0.2332675 May 12 15:10:50.345000 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:50.353931 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:50.381934 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9787cef9-03af-4a15-af20-0eb8fe5ee859 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:50.412632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:50.415333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] For port b916a765-866f-4478-817f-f3e33e79f873, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:50.418448 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:50.439432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:50.455605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:50.459265 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] For port b916a765-866f-4478-817f-f3e33e79f873, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b916a765-866f-4478-817f-f3e33e79f873,segment=NetworkSegment(0f481a89-826f-4a90-903d-276e9b18feb1),segment_id=0f481a89-826f-4a90-903d-276e9b18feb1)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:50.464221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:50.491560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:50.499726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Pushing event updated for resources: {'Port': ['ID=4a5c9445-7a04-4dec-9255-25097532a868,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:50.502407 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:50.508254 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0cb366a1-81d4-4faa-91c0-4f6ec7f8c8ff req-b238f428-f2ec-49f8-a17d-8e087ac2095a tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/security-groups?id=4db559d6-6ff9-4f01-9ab9-98bc9279fdd7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1586902 May 12 15:10:50.698423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['9787cef9-03af-4a15-af20-0eb8fe5ee859'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:50.733678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:50.734496 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:50.736210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] 10.222.0.76 "PUT /v2.0/ports/b916a765-866f-4478-817f-f3e33e79f873 HTTP/1.1" status: 200 len: 1092 time: 2.7752523 May 12 15:10:50.737853 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd402dad-2056-45f5-961f-dd13babbab60 req-2e20907e-b79e-4746-8be5-311fadc7d7b9 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=8a871ef1e9124e35b230ac65e37bd02e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0696321 May 12 15:10:50.778606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17aaac4d-f296-44b8-9179-5db171281c19 service neutron] Pushing event updated for resources: {'Port': ['ID=b916a765-866f-4478-817f-f3e33e79f873,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:50.934311 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:51.024822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd402dad-2056-45f5-961f-dd13babbab60 req-280baa56-b4b9-42e3-8e1d-efacf2c75fae tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:51.026278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd402dad-2056-45f5-961f-dd13babbab60 req-280baa56-b4b9-42e3-8e1d-efacf2c75fae tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2758801 May 12 15:10:51.053241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6397c8-2b94-43e9-a02e-60a84588845c req-a60a8384-766c-49c1-8f36-7d1f0c88db1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:51.054652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-a60a8384-766c-49c1-8f36-7d1f0c88db1e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a673d571317840e888b6cfe5a121092e&device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 1095 time: 0.2588050 May 12 15:10:51.057445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd402dad-2056-45f5-961f-dd13babbab60 req-dd5dd6c8-2e9e-48db-ba72-c7de4c7c6391 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/quotas/8a871ef1e9124e35b230ac65e37bd02e HTTP/1.1" status: 200 len: 375 time: 0.0234282 May 12 15:10:51.058139 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:51.197704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-a068a626-837d-4625-bfdd-14106f1c6e07 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b916a765-866f-4478-817f-f3e33e79f873 HTTP/1.1" status: 200 len: 217 time: 0.1145372 May 12 15:10:51.360395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6397c8-2b94-43e9-a02e-60a84588845c req-53fe1fe3-b2fe-409e-a6cc-b9a623d98a04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:51.361840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-53fe1fe3-b2fe-409e-a6cc-b9a623d98a04 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=eb51e145-1f59-4ab5-b2f3-a32c2c6ee575 HTTP/1.1" status: 200 len: 851 time: 0.1497068 May 12 15:10:51.425209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd402dad-2056-45f5-961f-dd13babbab60 req-2211f0dc-727e-4f6e-9825-741d48c89907 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=8a871ef1e9124e35b230ac65e37bd02e&fields=id HTTP/1.1" status: 200 len: 255 time: 0.3431721 May 12 15:10:51.441697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 14990298-685a-4dd8-a308-ee8dcbbb6d93 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:51.497561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6397c8-2b94-43e9-a02e-60a84588845c req-a708ac80-b2be-435d-a050-85d482591313 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:51.498575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-a708ac80-b2be-435d-a050-85d482591313 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=7336b0e1-6ae7-4c8a-98e8-3f13adbdc190&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1261318 May 12 15:10:51.520787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 14990298-685a-4dd8-a308-ee8dcbbb6d93 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:51.525949 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 14990298-685a-4dd8-a308-ee8dcbbb6d93 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:51.526316 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:51.538498 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:51.599524 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:51.666802 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:51.702133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '14990298-685a-4dd8-a308-ee8dcbbb6d93'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:51.716954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:51.721807 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:51.789953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d816ca9e-00ea-457c-b42d-be8c14d686b7 req-a468bd4c-04b0-4fb3-b8d0-3a1651f9b301 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Synchronizing usage tracker for tenant:d914960d703a44ae913f9a1804d5b368 on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:51.800939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=14990298-685a-4dd8-a308-ee8dcbbb6d93,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:51.840661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Pushing event updated for resources: {'Port': ['ID=4a5c9445-7a04-4dec-9255-25097532a868,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:51.860559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d816ca9e-00ea-457c-b42d-be8c14d686b7 req-a468bd4c-04b0-4fb3-b8d0-3a1651f9b301 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Unset dirty status for tenant:d914960d703a44ae913f9a1804d5b368 on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:51.861755 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d816ca9e-00ea-457c-b42d-be8c14d686b7 req-a468bd4c-04b0-4fb3-b8d0-3a1651f9b301 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips?tenant_id=d914960d703a44ae913f9a1804d5b368 HTTP/1.1" status: 200 len: 1656 time: 0.2691631 May 12 15:10:51.872472 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:51.897821 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-91590658-20a8-42d2-93e5-fee4f402d1c3 service neutron] 10.222.0.76 "GET /v2.0/networks/7336b0e1-6ae7-4c8a-98e8-3f13adbdc190?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3896146 May 12 15:10:52.018486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 9787cef9-03af-4a15-af20-0eb8fe5ee859 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:52.067111 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:52.069855 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-32c5f7a5-455b-47ba-89f5-2e4a2e0e2926 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 3.9360433 May 12 15:10:52.095661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 9787cef9-03af-4a15-af20-0eb8fe5ee859 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:52.101593 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 9787cef9-03af-4a15-af20-0eb8fe5ee859 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:52.102105 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:52.232489 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:52.269417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:52.274635 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:52.318519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-5cc9004f-47dd-4033-b21e-f4fc5532781d tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Synchronizing usage tracker for tenant:fd97c932be3143b1846bb48363040c63 on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:52.348876 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:52.366529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d816ca9e-00ea-457c-b42d-be8c14d686b7 req-13d4cfcb-8a9d-473b-a2d6-a6efc0057a17 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:52.367935 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d816ca9e-00ea-457c-b42d-be8c14d686b7 req-13d4cfcb-8a9d-473b-a2d6-a6efc0057a17 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks?id=5bff663f-be1e-4c0c-b2e2-d037214cb143&id=5bff663f-be1e-4c0c-b2e2-d037214cb143&id=5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 787 time: 0.5001900 May 12 15:10:52.384765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-d816ca9e-00ea-457c-b42d-be8c14d686b7 req-93e0655a-33e2-4666-9397-28314cbe38f6 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:10:52.385715 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d816ca9e-00ea-457c-b42d-be8c14d686b7 req-93e0655a-33e2-4666-9397-28314cbe38f6 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0101142 May 12 15:10:52.388900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df6397c8-2b94-43e9-a02e-60a84588845c req-fca8748e-979e-4fa5-9010-25129c0a7547 service neutron] 10.222.0.76 "GET /v2.0/networks/7336b0e1-6ae7-4c8a-98e8-3f13adbdc190?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4777095 May 12 15:10:52.392537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-5cc9004f-47dd-4033-b21e-f4fc5532781d tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Unset dirty status for tenant:fd97c932be3143b1846bb48363040c63 on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:52.393802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-5cc9004f-47dd-4033-b21e-f4fc5532781d tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.136 HTTP/1.1" status: 200 len: 696 time: 0.3167489 May 12 15:10:52.600814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-db1eaa42-08a7-4425-bea1-ce64709811f8 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:52.602087 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7dd64cb-8584-4133-870f-e17429f42cb1 req-db1eaa42-08a7-4425-bea1-ce64709811f8 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.2008009 May 12 15:10:52.618495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eade5d4d-ebfb-42d2-bf3e-5e7b505e8eb6 req-0d2126d7-dd7a-4c7f-abc0-a5c4b9531309 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:52.619975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eade5d4d-ebfb-42d2-bf3e-5e7b505e8eb6 req-0d2126d7-dd7a-4c7f-abc0-a5c4b9531309 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 1101 time: 0.1387494 May 12 15:10:52.678711 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd402dad-2056-45f5-961f-dd13babbab60 req-a12eba5b-00bf-419f-9546-161d79eb9536 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=8a871ef1e9124e35b230ac65e37bd02e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0498638 May 12 15:10:52.822440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-eade5d4d-ebfb-42d2-bf3e-5e7b505e8eb6 req-3ebcefe7-8c2e-45b9-abc2-c99b2e71ef65 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Synchronizing usage tracker for tenant:9a79f1afc97d454587f70a609af0a887 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:52.883038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-eade5d4d-ebfb-42d2-bf3e-5e7b505e8eb6 req-3ebcefe7-8c2e-45b9-abc2-c99b2e71ef65 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Unset dirty status for tenant:9a79f1afc97d454587f70a609af0a887 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:52.884076 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eade5d4d-ebfb-42d2-bf3e-5e7b505e8eb6 req-3ebcefe7-8c2e-45b9-abc2-c99b2e71ef65 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2571957 May 12 15:10:52.918918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd402dad-2056-45f5-961f-dd13babbab60 req-f0c05887-947b-4f61-a436-6d0eedccb4ff tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:52.920306 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd402dad-2056-45f5-961f-dd13babbab60 req-f0c05887-947b-4f61-a436-6d0eedccb4ff tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2336800 May 12 15:10:52.928300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0ef846b-b4e8-46b1-91d4-85f5b4e724e4 req-5f0c9ace-3dbe-4815-afbf-006967fa26da tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:52.929690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0ef846b-b4e8-46b1-91d4-85f5b4e724e4 req-5f0c9ace-3dbe-4815-afbf-006967fa26da tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 945 time: 0.2212563 May 12 15:10:52.935353 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ff31b1cf-588d-4a68-9152-4c5649ea93a2'] response: {'name': 'network-changed', 'server_uuid': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'tag': 'bedffd1f-e77b-484f-b090-5d8637b7262c', 'status': 'completed', 'code': 200} May 12 15:10:52.940226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Request body: {'port': {'device_id': '5fa19168-fc7f-4f74-8443-7b0c98ad2c18', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '8a871ef1e9124e35b230ac65e37bd02e'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:53.087594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceda03d2-974f-4974-9656-6f6801a84d98 req-65f912e4-8015-4749-8eea-047407be316b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:53.089060 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ceda03d2-974f-4974-9656-6f6801a84d98 req-65f912e4-8015-4749-8eea-047407be316b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fd97c932be3143b1846bb48363040c63&device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 1096 time: 0.0853245 May 12 15:10:53.115697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0ef846b-b4e8-46b1-91d4-85f5b4e724e4 req-84786765-d3fe-4be6-9c15-9ea34905a09b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1795120 May 12 15:10:53.195394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9475969d-0326-49b5-a4a8-6517b5fdbbca req-9033b075-2080-4a02-b7cf-68ba05294581 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:53.196816 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9475969d-0326-49b5-a4a8-6517b5fdbbca req-9033b075-2080-4a02-b7cf-68ba05294581 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.1647708 May 12 15:10:53.199021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:10:53.225959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:10:53.240859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceda03d2-974f-4974-9656-6f6801a84d98 req-9097123e-f2e6-4cf6-ab59-31b06581df2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:53.242645 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ceda03d2-974f-4974-9656-6f6801a84d98 req-9097123e-f2e6-4cf6-ab59-31b06581df2c service neutron] 10.222.0.84 "GET /v2.0/networks?id=74c45f45-b34b-4876-a35b-8ae714cf4d5f HTTP/1.1" status: 200 len: 921 time: 0.1446369 May 12 15:10:53.292665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Made reservation on behalf of 8a871ef1e9124e35b230ac65e37bd02e for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:10:53.296065 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:53.315155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9475969d-0326-49b5-a4a8-6517b5fdbbca req-e7c9214c-7eda-4c1c-8e19-e25b61ef51a2 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1122818 May 12 15:10:53.325376 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ceda03d2-974f-4974-9656-6f6801a84d98 req-83db0373-7c91-46ef-bfca-62c3c214d79a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bedffd1f-e77b-484f-b090-5d8637b7262c HTTP/1.1" status: 200 len: 217 time: 0.0739424 May 12 15:10:53.404276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceda03d2-974f-4974-9656-6f6801a84d98 req-c2e5588c-da0e-4e21-8ed4-1bc3d34c4647 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:53.405727 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ceda03d2-974f-4974-9656-6f6801a84d98 req-c2e5588c-da0e-4e21-8ed4-1bc3d34c4647 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8de7231c-cca8-4041-a1ba-b8eba5dd5861 HTTP/1.1" status: 200 len: 860 time: 0.0673366 May 12 15:10:53.428957 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-391154e9-879b-4887-b16b-1ef792c64506 req-441783d5-6b46-4aad-8f10-5d5e1d76a6e0 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:53.430402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-391154e9-879b-4887-b16b-1ef792c64506 req-441783d5-6b46-4aad-8f10-5d5e1d76a6e0 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/ports?device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 944 time: 0.2023587 May 12 15:10:53.458104 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ceda03d2-974f-4974-9656-6f6801a84d98 req-b89f3782-df5b-4b5a-a0ca-ea27a3782391 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=74c45f45-b34b-4876-a35b-8ae714cf4d5f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0435779 May 12 15:10:53.527892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f7072a9-0202-41dd-a559-c39bc320f584 req-647e8347-c547-4a88-bd4f-9d92b312d86b tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 210 time: 0.1105161 May 12 15:10:53.580176 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-391154e9-879b-4887-b16b-1ef792c64506 req-b97eb8ea-0648-4e84-a304-c1ec13a6aca7 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/security-groups?id=4db559d6-6ff9-4f01-9ab9-98bc9279fdd7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1175396 May 12 15:10:53.581929 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-75a79d33-22f6-405f-9565-a828ddbf9e24'] response: {'server_uuid': '3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '14990298-685a-4dd8-a308-ee8dcbbb6d93', 'code': 200} May 12 15:10:53.587736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Allocated IP 192.168.233.233 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/a5a0bcd7-b21d-42b5-9b81-e250cd922e03) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:10:53.618265 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ceda03d2-974f-4974-9656-6f6801a84d98 req-9461166d-7a8e-4d3f-ac4f-a4b9204c4cd4 service neutron] 10.222.0.84 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1524677 May 12 15:10:53.689295 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03cdd67e-c17a-410b-855e-8f3316368c47 req-06586ce5-78ba-4ac9-9845-a7722c3f2c59 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips/f3350ec8-f7a0-4119-9fc6-0d2e90ae2ca7 HTTP/1.1" status: 200 len: 692 time: 0.0957613 May 12 15:10:53.936332 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ceda03d2-974f-4974-9656-6f6801a84d98 req-913504d7-8bbd-424f-8480-0ef68b893530 service neutron] 10.222.0.84 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3098824 May 12 15:10:53.942147 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5530a4f3-b346-4387-b3c7-c9129df6ecb6 req-a741aaa8-f6a4-4490-af5f-c5b468f353c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:53.943513 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5530a4f3-b346-4387-b3c7-c9129df6ecb6 req-a741aaa8-f6a4-4490-af5f-c5b468f353c6 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 1096 time: 0.2432098 May 12 15:10:54.016288 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5530a4f3-b346-4387-b3c7-c9129df6ecb6 req-1ca59ed9-a607-493c-9679-86df646e169b service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360630 May 12 15:10:54.153029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03cdd67e-c17a-410b-855e-8f3316368c47 req-15efa7bf-b7f7-4556-ac01-7ce35eb5e94d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:54.154466 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03cdd67e-c17a-410b-855e-8f3316368c47 req-15efa7bf-b7f7-4556-ac01-7ce35eb5e94d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.4554386 May 12 15:10:54.178033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-5744687c-22bf-48c6-aeed-f5e0b24297bf tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:54.179451 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-5744687c-22bf-48c6-aeed-f5e0b24297bf tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.4547586 May 12 15:10:54.339656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03cdd67e-c17a-410b-855e-8f3316368c47 req-80b7472f-a79d-4957-be38-474e3c9cccd2 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.75 HTTP/1.1" status: 200 len: 695 time: 0.1702707 May 12 15:10:54.342328 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:54.405726 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-a77e3d89-dd33-4886-bfc6-f91869cfd429 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.136 HTTP/1.1" status: 200 len: 696 time: 0.1664391 May 12 15:10:54.436629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-1bf26af0-f17c-4b9a-bc27-b2a0bbd345bf tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Request body: {'floatingip': {'port_id': 'bedffd1f-e77b-484f-b090-5d8637b7262c', 'fixed_ip_address': '172.20.0.6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:54.489786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Transition to ACTIVE for port object a5a0bcd7-b21d-42b5-9b81-e250cd922e03 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:54.515536 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03cdd67e-c17a-410b-855e-8f3316368c47 req-dedbbfd2-7000-44e8-93f7-858dfba0e249 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.75 HTTP/1.1" status: 200 len: 695 time: 0.1671546 May 12 15:10:54.524843 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-1bf26af0-f17c-4b9a-bc27-b2a0bbd345bf tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:54.803784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-03cdd67e-c17a-410b-855e-8f3316368c47 req-5e6e4582-92a5-4664-b94b-62b366c33852 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Deleting port 5df27161-37d8-44f0-9aef-0e913c200081 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:10:54.804523 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-03cdd67e-c17a-410b-855e-8f3316368c47 req-5e6e4582-92a5-4664-b94b-62b366c33852 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:54.900116 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:54.911489 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['e8c30887-a54f-44a8-af0a-122711662e1e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:54.961182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8403f3e5-d02f-4cd4-b73d-21cd47e6f139', 'tag': 'b916a765-866f-4478-817f-f3e33e79f873'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:55.113959 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6c35492-0de3-4d80-ba1f-66b7de792d00 req-70ea70e1-b39c-4d1e-a5c6-b236bded0bb9 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0756886 May 12 15:10:55.129003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:10:55.142345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:10:55.158944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:10:55.185828 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Pushing event updated for resources: {'Port': ['ID=a5a0bcd7-b21d-42b5-9b81-e250cd922e03,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:55.376592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c35492-0de3-4d80-ba1f-66b7de792d00 req-36cd1a51-de17-4817-b504-71ecd4b714e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:55.378450 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6c35492-0de3-4d80-ba1f-66b7de792d00 req-36cd1a51-de17-4817-b504-71ecd4b714e2 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 1101 time: 0.0999615 May 12 15:10:55.396713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5188a540-ada4-4418-b961-ffbdb4781940 None None] Provisioning for port a5a0bcd7-b21d-42b5-9b81-e250cd922e03 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:55.408359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5188a540-ada4-4418-b961-ffbdb4781940 None None] Provisioning complete for port a5a0bcd7-b21d-42b5-9b81-e250cd922e03 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:55.408819 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5188a540-ada4-4418-b961-ffbdb4781940 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:55.460309 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-03cdd67e-c17a-410b-855e-8f3316368c47 req-5e6e4582-92a5-4664-b94b-62b366c33852 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:55.460531 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-03cdd67e-c17a-410b-855e-8f3316368c47 req-5e6e4582-92a5-4664-b94b-62b366c33852 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:55.475653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:55.476267 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:55.480603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5188a540-ada4-4418-b961-ffbdb4781940 None None] Port a5a0bcd7-b21d-42b5-9b81-e250cd922e03 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:10:55.584006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:10:55.598789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c35492-0de3-4d80-ba1f-66b7de792d00 req-863f3f05-b6f6-4df4-97d6-8ee548feaea6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:55.600215 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6c35492-0de3-4d80-ba1f-66b7de792d00 req-863f3f05-b6f6-4df4-97d6-8ee548feaea6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.1425335 May 12 15:10:55.626959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-03cdd67e-c17a-410b-855e-8f3316368c47 req-5e6e4582-92a5-4664-b94b-62b366c33852 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Calling delete_port for 5df27161-37d8-44f0-9aef-0e913c200081 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:10:55.668834 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6c35492-0de3-4d80-ba1f-66b7de792d00 req-5db6d8ad-59af-43d2-a4d8-23112ea21bcb service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.52&port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 200 len: 217 time: 0.0612116 May 12 15:10:55.736823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c35492-0de3-4d80-ba1f-66b7de792d00 req-ca3498f6-0b6f-438d-ba42-1704d02b37a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:55.738291 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6c35492-0de3-4d80-ba1f-66b7de792d00 req-ca3498f6-0b6f-438d-ba42-1704d02b37a8 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0617967 May 12 15:10:55.759714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd402dad-2056-45f5-961f-dd13babbab60 req-95291f69-5e69-4a61-b6d9-b8b5ff1542be tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.8263116 May 12 15:10:55.773331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Request body: {'port': {'device_id': '5fa19168-fc7f-4f74-8443-7b0c98ad2c18', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:10:55.818728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c35492-0de3-4d80-ba1f-66b7de792d00 req-ac8bf76f-d866-4847-8256-5719e3e1cd8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:55.820408 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6c35492-0de3-4d80-ba1f-66b7de792d00 req-ac8bf76f-d866-4847-8256-5719e3e1cd8a service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.0737712 May 12 15:10:55.967746 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6c35492-0de3-4d80-ba1f-66b7de792d00 req-bf5b0237-66e9-47f5-9bf7-23f4e733cfc4 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1379001 May 12 15:10:55.985174 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:56.026644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b916a765-866f-4478-817f-f3e33e79f873 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:10:56.106009 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6c35492-0de3-4d80-ba1f-66b7de792d00 req-ebc274b9-c0ea-40a6-8f8b-4baeeea0c776 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1317375 May 12 15:10:56.140127 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-03cdd67e-c17a-410b-855e-8f3316368c47 req-5e6e4582-92a5-4664-b94b-62b366c33852 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:56.175968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b916a765-866f-4478-817f-f3e33e79f873, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b916a765-866f-4478-817f-f3e33e79f873,segment=NetworkSegment(0f481a89-826f-4a90-903d-276e9b18feb1),segment_id=0f481a89-826f-4a90-903d-276e9b18feb1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:56.190218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'b916a765-866f-4478-817f-f3e33e79f873', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'port_id': 'b916a765-866f-4478-817f-f3e33e79f873', 'mac_address': 'fa:16:3e:51:d2:99', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 552, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:10:56.198495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e6e4582-92a5-4664-b94b-62b366c33852 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Pushing event deleted for resources: {'Port': ['ID=5df27161-37d8-44f0-9aef-0e913c200081,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:56.216253 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-1bf26af0-f17c-4b9a-bc27-b2a0bbd345bf tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:56.248491 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:56.270362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b916a765-866f-4478-817f-f3e33e79f873 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:56.286993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b916a765-866f-4478-817f-f3e33e79f873, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b916a765-866f-4478-817f-f3e33e79f873,segment=NetworkSegment(0f481a89-826f-4a90-903d-276e9b18feb1),segment_id=0f481a89-826f-4a90-903d-276e9b18feb1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:56.291491 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:56.294203 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-1bf26af0-f17c-4b9a-bc27-b2a0bbd345bf tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:56.386729 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=b916a765-866f-4478-817f-f3e33e79f873,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:56.520682 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-03cdd67e-c17a-410b-855e-8f3316368c47 req-5e6e4582-92a5-4664-b94b-62b366c33852 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:56.601289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['b916a765-866f-4478-817f-f3e33e79f873'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:10:56.629855 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-03cdd67e-c17a-410b-855e-8f3316368c47 req-5e6e4582-92a5-4664-b94b-62b366c33852 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:56.630976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03cdd67e-c17a-410b-855e-8f3316368c47 req-5e6e4582-92a5-4664-b94b-62b366c33852 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "DELETE /v2.0/floatingips/f3350ec8-f7a0-4119-9fc6-0d2e90ae2ca7 HTTP/1.1" status: 204 len: 173 time: 2.1094198 May 12 15:10:56.656609 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-1bf26af0-f17c-4b9a-bc27-b2a0bbd345bf tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Floating IP 211d15a7-d35e-4d81-ae94-71f5ba6cc332 associated. External IP: 172.25.8.136, port: bedffd1f-e77b-484f-b090-5d8637b7262c. May 12 15:10:56.988652 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] It took 0.19 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:10:57.081615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a5a0bcd7-b21d-42b5-9b81-e250cd922e03 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:10:57.091045 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:57.168986 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c8673e9-978a-4a22-bc16-5bc620c508ab req-7c8e9bd4-6981-41a4-b58b-684638c10774 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:57.170515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c8673e9-978a-4a22-bc16-5bc620c508ab req-7c8e9bd4-6981-41a4-b58b-684638c10774 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=9b2b4b7d-231c-4e54-83f4-827d02cbcbb5 HTTP/1.1" status: 200 len: 1101 time: 0.4257138 May 12 15:10:57.185267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Transition to ACTIVE for port object a5a0bcd7-b21d-42b5-9b81-e250cd922e03 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:10:57.205507 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:57.423962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c8673e9-978a-4a22-bc16-5bc620c508ab req-c10c0c18-18ab-4855-ab43-93144d409ab9 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2398577 May 12 15:10:57.471132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Pushing event updated for resources: {'Port': ['ID=a5a0bcd7-b21d-42b5-9b81-e250cd922e03,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:57.533202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-1bf26af0-f17c-4b9a-bc27-b2a0bbd345bf tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Router 405f5f48-a239-4c20-a0c9-dd825327abd0 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:10:57.679822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Attempting to bind port a5a0bcd7-b21d-42b5-9b81-e250cd922e03 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:10:57.680151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Attempting to bind port a5a0bcd7-b21d-42b5-9b81-e250cd922e03 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:10:57.680472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Attempting to bind port a5a0bcd7-b21d-42b5-9b81-e250cd922e03 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:57.699438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Port a5a0bcd7-b21d-42b5-9b81-e250cd922e03 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:10:57.699755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Attempting to bind port a5a0bcd7-b21d-42b5-9b81-e250cd922e03 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:10:57.712701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 10, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:10:57.713035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:10:57.713445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:10:57.713867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Bound port: a5a0bcd7-b21d-42b5-9b81-e250cd922e03, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:10:57.714211 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:57.867436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afc74ffa-6033-46e4-8147-971d20c77279 req-0d65a855-5ec7-4441-a052-c7c95a181588 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:57.868897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-afc74ffa-6033-46e4-8147-971d20c77279 req-0d65a855-5ec7-4441-a052-c7c95a181588 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 945 time: 0.3346059 May 12 15:10:57.893776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-1bf26af0-f17c-4b9a-bc27-b2a0bbd345bf tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:10:57.903082 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-1bf26af0-f17c-4b9a-bc27-b2a0bbd345bf tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:57.904893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0125c60a-c1aa-4404-a7bb-cbf9efa8244d None None] Sync routers for ids ['405f5f48-a239-4c20-a0c9-dd825327abd0'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:10:57.915857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0125c60a-c1aa-4404-a7bb-cbf9efa8244d None None] Routers {'405f5f48-a239-4c20-a0c9-dd825327abd0'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:10:57.916540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0125c60a-c1aa-4404-a7bb-cbf9efa8244d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:10:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['405f5f48-a239-4c20-a0c9-dd825327abd0'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:57.995648 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-afc74ffa-6033-46e4-8147-971d20c77279 req-ad6d5b6a-239e-4333-9f66-f8b68e0a2b9b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1180842 May 12 15:10:57.999918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] For port a5a0bcd7-b21d-42b5-9b81-e250cd922e03, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:10:58.002574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-1bf26af0-f17c-4b9a-bc27-b2a0bbd345bf tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "PUT /v2.0/floatingips/211d15a7-d35e-4d81-ae94-71f5ba6cc332 HTTP/1.1" status: 200 len: 996 time: 3.5882056 May 12 15:10:58.004214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] For port a5a0bcd7-b21d-42b5-9b81-e250cd922e03, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5a0bcd7-b21d-42b5-9b81-e250cd922e03,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:10:58.011770 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:58.053704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b916a765-866f-4478-817f-f3e33e79f873 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:10:58.123124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:58.123725 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:58.125764 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd402dad-2056-45f5-961f-dd13babbab60 req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] 10.222.0.76 "PUT /v2.0/ports/a5a0bcd7-b21d-42b5-9b81-e250cd922e03 HTTP/1.1" status: 200 len: 1096 time: 2.3580055 May 12 15:10:58.150295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-0125c60a-c1aa-4404-a7bb-cbf9efa8244d None None] Set router 405f5f48-a239-4c20-a0c9-dd825327abd0 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:10:58.238111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port b916a765-866f-4478-817f-f3e33e79f873 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:10:58.245798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c7f64f3-38a9-4053-8892-930f98845cf3 service neutron] Pushing event updated for resources: {'Port': ['ID=a5a0bcd7-b21d-42b5-9b81-e250cd922e03,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:58.246343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port b916a765-866f-4478-817f-f3e33e79f873 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:10:58.246708 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:58.300582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-1e1b3c8b-98c6-4015-9849-57c0a97e3930 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:58.302148 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-1e1b3c8b-98c6-4015-9849-57c0a97e3930 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=fd97c932be3143b1846bb48363040c63&device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 1096 time: 0.2500575 May 12 15:10:58.314934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa01c738-fe9b-433d-b0dc-cc934dc68c6d req-6d2a56e6-c8c9-4e2f-9404-5aa131303027 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:58.316457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa01c738-fe9b-433d-b0dc-cc934dc68c6d req-6d2a56e6-c8c9-4e2f-9404-5aa131303027 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.1993537 May 12 15:10:58.361380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd402dad-2056-45f5-961f-dd13babbab60 req-cb13e8e7-f5fb-4f77-b9f5-1f7a3fae8f72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:58.362826 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd402dad-2056-45f5-961f-dd13babbab60 req-cb13e8e7-f5fb-4f77-b9f5-1f7a3fae8f72 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=8a871ef1e9124e35b230ac65e37bd02e&device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 1099 time: 0.1874757 May 12 15:10:58.558870 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:58.603995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd402dad-2056-45f5-961f-dd13babbab60 req-fc1319d5-d24f-42d8-8e1b-ea15c1f14428 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.233&port_id=a5a0bcd7-b21d-42b5-9b81-e250cd922e03 HTTP/1.1" status: 200 len: 217 time: 0.1970322 May 12 15:10:58.627788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b916a765-866f-4478-817f-f3e33e79f873, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b916a765-866f-4478-817f-f3e33e79f873,segment=NetworkSegment(0f481a89-826f-4a90-903d-276e9b18feb1),segment_id=0f481a89-826f-4a90-903d-276e9b18feb1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:10:58.647461 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:10:58.674023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa01c738-fe9b-433d-b0dc-cc934dc68c6d req-d865d063-fe80-42c1-a1cb-327bc5eca97c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3315525 May 12 15:10:58.717893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd402dad-2056-45f5-961f-dd13babbab60 req-52ce05bf-5d05-42e4-b9bd-ad3414b55466 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:58.719682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd402dad-2056-45f5-961f-dd13babbab60 req-52ce05bf-5d05-42e4-b9bd-ad3414b55466 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1057992 May 12 15:10:58.722220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-60d0d671-72fb-4143-96f2-60c47358bffe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:58.724064 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-60d0d671-72fb-4143-96f2-60c47358bffe service neutron] 10.222.0.82 "GET /v2.0/networks?id=74c45f45-b34b-4876-a35b-8ae714cf4d5f HTTP/1.1" status: 200 len: 921 time: 0.4062655 May 12 15:10:58.755467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=b916a765-866f-4478-817f-f3e33e79f873,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:10:58.781185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0125c60a-c1aa-4404-a7bb-cbf9efa8244d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:09:35Z', 'revision_number': 4, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '211d15a7-d35e-4d81-ae94-71f5ba6cc332', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'floating_ip_address': '172.25.8.136', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'port_id': 'bedffd1f-e77b-484f-b090-5d8637b7262c', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 803, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'mac_address': 'fa:16:3e:7c:1d:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:10:50Z', 'updated_at': '2022-05-12T15:10:55Z', 'revision_number': 1, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '317c5178-1ffb-4fde-a98e-8a9fce5e9457', 'name': '', 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'mac_address': 'fa:16:3e:5d:a4:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:46Z', 'revision_number': 5, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'subnets': [{'id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:58.786076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0125c60a-c1aa-4404-a7bb-cbf9efa8244d None None] Checking router: 405f5f48-a239-4c20-a0c9-dd825327abd0 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:10:58.794562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0125c60a-c1aa-4404-a7bb-cbf9efa8244d None None] Routers {'405f5f48-a239-4c20-a0c9-dd825327abd0'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:10:58.795225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0125c60a-c1aa-4404-a7bb-cbf9efa8244d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:10:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['405f5f48-a239-4c20-a0c9-dd825327abd0'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:58.935816 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-a69d2d3b-a38a-4457-8f0f-0a7e775e9fce service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bedffd1f-e77b-484f-b090-5d8637b7262c HTTP/1.1" status: 200 len: 999 time: 0.1713789 May 12 15:10:58.979823 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-0125c60a-c1aa-4404-a7bb-cbf9efa8244d None None] Set router 405f5f48-a239-4c20-a0c9-dd825327abd0 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:10:59.010141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd402dad-2056-45f5-961f-dd13babbab60 req-3f0fca5e-baf3-4c65-a34b-1c87790c7e48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:59.012193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd402dad-2056-45f5-961f-dd13babbab60 req-3f0fca5e-baf3-4c65-a34b-1c87790c7e48 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2835312 May 12 15:10:59.024991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7942547-7c4a-44e1-b9fc-5e60da80baa9 req-48ac4dc0-8e77-4420-b330-f6816e411cab tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:59.025634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a7942547-7c4a-44e1-b9fc-5e60da80baa9 req-48ac4dc0-8e77-4420-b330-f6816e411cab tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Synchronizing usage tracker for tenant:8a871ef1e9124e35b230ac65e37bd02e on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:10:59.052909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-a82c63dc-1d0d-4fd4-a06a-3e82d6fc110e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:59.054352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-a82c63dc-1d0d-4fd4-a06a-3e82d6fc110e service neutron] 10.222.0.82 "GET /v2.0/subnets?id=8de7231c-cca8-4041-a1ba-b8eba5dd5861 HTTP/1.1" status: 200 len: 860 time: 0.1111572 May 12 15:10:59.164596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a7942547-7c4a-44e1-b9fc-5e60da80baa9 req-48ac4dc0-8e77-4420-b330-f6816e411cab tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Unset dirty status for tenant:8a871ef1e9124e35b230ac65e37bd02e on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:10:59.165751 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7942547-7c4a-44e1-b9fc-5e60da80baa9 req-48ac4dc0-8e77-4420-b330-f6816e411cab tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 948 time: 0.3436210 May 12 15:10:59.167863 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-d6f93ea7-b918-46c0-a2b6-8d6a9c31792f service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=74c45f45-b34b-4876-a35b-8ae714cf4d5f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0574965 May 12 15:10:59.339663 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd402dad-2056-45f5-961f-dd13babbab60 req-80ead7a1-c1ca-46e5-a704-6651350f40fd service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3103652 May 12 15:10:59.342468 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7942547-7c4a-44e1-b9fc-5e60da80baa9 req-11c7aee6-9f4d-41ea-b4b9-d6a6d7ce3417 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1667643 May 12 15:10:59.398064 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0125c60a-c1aa-4404-a7bb-cbf9efa8244d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:09:35Z', 'revision_number': 4, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '211d15a7-d35e-4d81-ae94-71f5ba6cc332', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'floating_ip_address': '172.25.8.136', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'port_id': 'bedffd1f-e77b-484f-b090-5d8637b7262c', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 803, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'mac_address': 'fa:16:3e:7c:1d:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:10:50Z', 'updated_at': '2022-05-12T15:10:55Z', 'revision_number': 1, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '317c5178-1ffb-4fde-a98e-8a9fce5e9457', 'name': '', 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'mac_address': 'fa:16:3e:5d:a4:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:46Z', 'revision_number': 5, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'subnets': [{'id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:10:59.402229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0125c60a-c1aa-4404-a7bb-cbf9efa8244d None None] The sync data for ids ['405f5f48-a239-4c20-a0c9-dd825327abd0'] in n-d-841483-1 is: [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:09:35Z', 'revision_number': 4, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '211d15a7-d35e-4d81-ae94-71f5ba6cc332', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'floating_ip_address': '172.25.8.136', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'port_id': 'bedffd1f-e77b-484f-b090-5d8637b7262c', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 803, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'mac_address': 'fa:16:3e:7c:1d:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:10:50Z', 'updated_at': '2022-05-12T15:10:55Z', 'revision_number': 1, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '317c5178-1ffb-4fde-a98e-8a9fce5e9457', 'name': '', 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'mac_address': 'fa:16:3e:5d:a4:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:46Z', 'revision_number': 5, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'subnets': [{'id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:10:59.500134 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-2b4c13d8-f805-4802-86c3-129e132aa583 service neutron] 10.222.0.82 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3252883 May 12 15:10:59.600925 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6878d39-0bc4-4780-8941-cf9833153a44 None None] New status for floating IP 211d15a7-d35e-4d81-ae94-71f5ba6cc332: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:10:59.650782 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd402dad-2056-45f5-961f-dd13babbab60 req-1892ea2d-3b11-49a0-a465-ff3a935a6a05 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3043256 May 12 15:10:59.694757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-610af10d-fbc1-46ac-bc59-9f65ff2f58cb req-053d8f4e-9e07-49ee-9bad-d983ae0180f2 service neutron] 10.222.0.82 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1872942 May 12 15:10:59.704465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-894054ad-a6d3-4d69-b979-2e932add2dcb req-3e746bd8-3b49-4d0f-86c5-615bb1c8b7b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:10:59.705357 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-894054ad-a6d3-4d69-b979-2e932add2dcb req-3e746bd8-3b49-4d0f-86c5-615bb1c8b7b1 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/ports?device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 946 time: 0.2504253 May 12 15:10:59.761953 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-894054ad-a6d3-4d69-b979-2e932add2dcb req-0e75e34e-4ffb-4100-9eb8-c022c7e9eace tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/security-groups?id=4db559d6-6ff9-4f01-9ab9-98bc9279fdd7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0507157 May 12 15:10:59.770716 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-562e1101-9a73-4747-bc7b-ecb6523d8512'] response: {'name': 'network-changed', 'server_uuid': '8403f3e5-d02f-4cd4-b73d-21cd47e6f139', 'tag': 'b916a765-866f-4478-817f-f3e33e79f873', 'status': 'completed', 'code': 200} May 12 15:10:59.807855 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5d38edd4-da8c-4865-8275-5812d16d5cbc'] response: {'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'code': 200} May 12 15:10:59.977911 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-6ca3d309-a4c3-4646-97df-edd716655519 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips/9f3a9eb5-4d40-402e-86ef-84e4940bd486 HTTP/1.1" status: 200 len: 693 time: 0.1971076 May 12 15:11:00.305079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7218531f-c2d3-4cf5-a4dc-84a3c0c8a59a req-99bf1140-591c-482e-97d0-3054408f4001 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:00.306558 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7218531f-c2d3-4cf5-a4dc-84a3c0c8a59a req-99bf1140-591c-482e-97d0-3054408f4001 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 1100 time: 0.4271510 May 12 15:11:00.323109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e36cab-129f-44e7-99a6-821cd010510e req-57175b6b-4a65-4fc7-b499-b0ef3289db40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:00.324463 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11e36cab-129f-44e7-99a6-821cd010510e req-57175b6b-4a65-4fc7-b499-b0ef3289db40 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a673d571317840e888b6cfe5a121092e&device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 1097 time: 0.4439888 May 12 15:11:00.473753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-a692af82-3efb-49bf-98c4-80d3ba14fac0 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:00.475078 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-a692af82-3efb-49bf-98c4-80d3ba14fac0 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.4787226 May 12 15:11:00.482956 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7218531f-c2d3-4cf5-a4dc-84a3c0c8a59a req-2554fc91-533b-46c6-9183-2516893f6fcf service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1569438 May 12 15:11:00.540702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a32f1079-fe98-46c0-a6b0-88cf849ed1da req-e492494f-1a29-4cdb-8863-3c62f35079d5 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:00.542202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a32f1079-fe98-46c0-a6b0-88cf849ed1da req-e492494f-1a29-4cdb-8863-3c62f35079d5 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 1096 time: 0.3381116 May 12 15:11:00.601982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-9f3c0379-5df3-4143-ac8d-554e4b0eab82 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Synchronizing usage tracker for tenant:d914960d703a44ae913f9a1804d5b368 on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:11:00.646450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e36cab-129f-44e7-99a6-821cd010510e req-607eeb3a-9b60-469d-aac5-d4444c06fb3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:00.648038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11e36cab-129f-44e7-99a6-821cd010510e req-607eeb3a-9b60-469d-aac5-d4444c06fb3b service neutron] 10.222.0.76 "GET /v2.0/networks?id=7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 HTTP/1.1" status: 200 len: 913 time: 0.3051856 May 12 15:11:00.650820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-9f3c0379-5df3-4143-ac8d-554e4b0eab82 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Unset dirty status for tenant:d914960d703a44ae913f9a1804d5b368 on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:11:00.651886 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-9f3c0379-5df3-4143-ac8d-554e4b0eab82 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.201 HTTP/1.1" status: 200 len: 696 time: 0.1653233 May 12 15:11:00.653492 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a32f1079-fe98-46c0-a6b0-88cf849ed1da req-f4271f2d-a3ae-42c6-92fe-570ca7ae4951 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1033750 May 12 15:11:00.836168 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11e36cab-129f-44e7-99a6-821cd010510e req-2cacb7f3-8562-4f63-8948-beba1385876a service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b916a765-866f-4478-817f-f3e33e79f873 HTTP/1.1" status: 200 len: 217 time: 0.1151052 May 12 15:11:00.843836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-4bbb9109-4d8b-4f23-856c-22e1c22deac1 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.201 HTTP/1.1" status: 200 len: 696 time: 0.1774187 May 12 15:11:01.069507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e36cab-129f-44e7-99a6-821cd010510e req-45d714c1-218c-455e-beec-60aa4cda795c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:01.070937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11e36cab-129f-44e7-99a6-821cd010510e req-45d714c1-218c-455e-beec-60aa4cda795c service neutron] 10.222.0.76 "GET /v2.0/subnets?id=eb51e145-1f59-4ab5-b2f3-a32c2c6ee575 HTTP/1.1" status: 200 len: 851 time: 0.2262058 May 12 15:11:01.076037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-f4bddf08-9187-4954-b605-59f1cf88ef6d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Deleting port 4815bb65-7c5e-4bdf-8e5f-4e3ab599f1a9 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:01.076264 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-f4bddf08-9187-4954-b605-59f1cf88ef6d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:01.184653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13366297-8f50-4bf4-896f-54a9266136e8 req-25fff30a-b4b5-4b13-babf-4394ae30aa42 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:01.186017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13366297-8f50-4bf4-896f-54a9266136e8 req-25fff30a-b4b5-4b13-babf-4394ae30aa42 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.3959250 May 12 15:11:01.328162 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13366297-8f50-4bf4-896f-54a9266136e8 req-542157aa-ec44-4bd7-9ebf-7feadc87dca6 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1190636 May 12 15:11:01.342382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e36cab-129f-44e7-99a6-821cd010510e req-46ed99d0-cec8-41ec-8333-ae2c738bb039 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:01.343848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11e36cab-129f-44e7-99a6-821cd010510e req-46ed99d0-cec8-41ec-8333-ae2c738bb039 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=7336b0e1-6ae7-4c8a-98e8-3f13adbdc190&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2431285 May 12 15:11:01.426065 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-f4bddf08-9187-4954-b605-59f1cf88ef6d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:01.426505 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-f4bddf08-9187-4954-b605-59f1cf88ef6d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:01.743113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-f4bddf08-9187-4954-b605-59f1cf88ef6d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Calling delete_port for 4815bb65-7c5e-4bdf-8e5f-4e3ab599f1a9 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:01.773127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'tag': 'bedffd1f-e77b-484f-b090-5d8637b7262c'}, {'name': 'network-changed', 'server_uuid': '5fa19168-fc7f-4f74-8443-7b0c98ad2c18', 'tag': 'a5a0bcd7-b21d-42b5-9b81-e250cd922e03'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:01.809683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8403f3e5-d02f-4cd4-b73d-21cd47e6f139', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b916a765-866f-4478-817f-f3e33e79f873'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:01.819108 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-68d3941a-eecd-480d-8551-01d9bafc15c8 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.136 HTTP/1.1" status: 200 len: 1001 time: 0.4618547 May 12 15:11:01.933836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11e36cab-129f-44e7-99a6-821cd010510e req-b3d4842c-92f3-463b-a75a-7cfc0e8d192d service neutron] 10.222.0.76 "GET /v2.0/networks/7336b0e1-6ae7-4c8a-98e8-3f13adbdc190?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5775993 May 12 15:11:01.943718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-f68f62a1-c41f-4979-afaf-b5e7c24be21f tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:01.944960 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-f68f62a1-c41f-4979-afaf-b5e7c24be21f tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports/bedffd1f-e77b-484f-b090-5d8637b7262c HTTP/1.1" status: 200 len: 942 time: 0.1121826 May 12 15:11:02.041603 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:02.200781 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-f4bddf08-9187-4954-b605-59f1cf88ef6d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:02.251697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-ab922742-d2ac-4b8d-9053-97efcbd0df29 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.136 HTTP/1.1" status: 200 len: 1001 time: 0.2074864 May 12 15:11:02.263938 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4bddf08-9187-4954-b605-59f1cf88ef6d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Pushing event deleted for resources: {'Port': ['ID=4815bb65-7c5e-4bdf-8e5f-4e3ab599f1a9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:02.267473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11e36cab-129f-44e7-99a6-821cd010510e req-7ec940cc-fafd-4b27-88cb-1bce47d4ce36 service neutron] 10.222.0.76 "GET /v2.0/networks/7336b0e1-6ae7-4c8a-98e8-3f13adbdc190?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3216238 May 12 15:11:02.456626 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-f4bddf08-9187-4954-b605-59f1cf88ef6d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:02.492847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-dc24c89c-8193-4306-a252-e03e7ec5e90a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:02.494221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-dc24c89c-8193-4306-a252-e03e7ec5e90a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.2331033 May 12 15:11:02.496537 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-f4bddf08-9187-4954-b605-59f1cf88ef6d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:02.497092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-922cbf3e-2fd9-47a9-8131-4333b0d3ad7f req-f4bddf08-9187-4954-b605-59f1cf88ef6d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "DELETE /v2.0/floatingips/9f3a9eb5-4d40-402e-86ef-84e4940bd486 HTTP/1.1" status: 204 len: 173 time: 1.6439414 May 12 15:11:02.616135 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-aa6451e1-c65b-4eb9-9fb7-a9151536f695 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0400674 May 12 15:11:02.649883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-22f9da9d-55a3-4bcf-93ee-78e70e57f989 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.136 HTTP/1.1" status: 200 len: 1001 time: 0.1483665 May 12 15:11:02.711037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-c2e59d0e-eadc-42c3-87e5-63eb723cba82 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Request body: {'floatingip': {'port_id': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:02.851773 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-c2e59d0e-eadc-42c3-87e5-63eb723cba82 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:02.952539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-7f78c24c-7149-4118-810a-25d98316ba79 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:02.954492 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-7f78c24c-7149-4118-810a-25d98316ba79 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3331478 May 12 15:11:02.977733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-86d69be0-e48b-4e2f-b68c-7aa6828e2209 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/quotas/fa4eac6b8c464c45aa3c550e59a0d34b HTTP/1.1" status: 200 len: 375 time: 0.0174661 May 12 15:11:03.319869 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-c2e59d0e-eadc-42c3-87e5-63eb723cba82 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:03.324233 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-c2e59d0e-eadc-42c3-87e5-63eb723cba82 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:03.324566 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-c2e59d0e-eadc-42c3-87e5-63eb723cba82 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Floating IP 211d15a7-d35e-4d81-ae94-71f5ba6cc332 disassociated. External IP: 172.25.8.136, port: bedffd1f-e77b-484f-b090-5d8637b7262c. May 12 15:11:03.399241 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-370636cb-488a-4965-970c-6ac9b5763ead tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.3607340 May 12 15:11:03.702105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-c2e59d0e-eadc-42c3-87e5-63eb723cba82 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Router 405f5f48-a239-4c20-a0c9-dd825327abd0 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:11:03.949452 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-c2e59d0e-eadc-42c3-87e5-63eb723cba82 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:11:03.954845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-c2e59d0e-eadc-42c3-87e5-63eb723cba82 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:03.962931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43829d57-9ea7-41c2-8eef-1b508f92ee3b None None] Sync routers for ids ['405f5f48-a239-4c20-a0c9-dd825327abd0'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:11:03.973268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43829d57-9ea7-41c2-8eef-1b508f92ee3b None None] Routers {'405f5f48-a239-4c20-a0c9-dd825327abd0'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:03.974199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-43829d57-9ea7-41c2-8eef-1b508f92ee3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:10:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['405f5f48-a239-4c20-a0c9-dd825327abd0'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:04.020042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f68b6e06-e6af-4f77-81e6-e8b06fb37783 req-592df63f-7818-4331-9d5c-1e493ccc6214 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:04.022329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f68b6e06-e6af-4f77-81e6-e8b06fb37783 req-592df63f-7818-4331-9d5c-1e493ccc6214 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 948 time: 0.1673563 May 12 15:11:04.033761 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-c2e59d0e-eadc-42c3-87e5-63eb723cba82 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "PUT /v2.0/floatingips/211d15a7-d35e-4d81-ae94-71f5ba6cc332 HTTP/1.1" status: 200 len: 695 time: 1.3317635 May 12 15:11:04.052199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a5a0bcd7-b21d-42b5-9b81-e250cd922e03 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:11:04.126921 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f68b6e06-e6af-4f77-81e6-e8b06fb37783 req-626d863e-85d1-4fab-89b9-fd437fa91f82 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0959408 May 12 15:11:04.157554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-6955f9f1-ccbe-4fcd-8925-52a8edd7a8a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:04.159526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-6955f9f1-ccbe-4fcd-8925-52a8edd7a8a2 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=fd97c932be3143b1846bb48363040c63&device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 1096 time: 0.1086829 May 12 15:11:04.321422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-43829d57-9ea7-41c2-8eef-1b508f92ee3b None None] Set router 405f5f48-a239-4c20-a0c9-dd825327abd0 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:04.346208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-2bafcd7c-1eca-44b3-8bc5-5b208a0ded33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:04.358081 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-2bafcd7c-1eca-44b3-8bc5-5b208a0ded33 service neutron] 10.222.0.82 "GET /v2.0/networks?id=74c45f45-b34b-4876-a35b-8ae714cf4d5f HTTP/1.1" status: 200 len: 921 time: 0.1925628 May 12 15:11:04.437780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a5a0bcd7-b21d-42b5-9b81-e250cd922e03, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5a0bcd7-b21d-42b5-9b81-e250cd922e03,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:04.462371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-5659a4fe-6d07-4d42-9d93-b34635cd0c47 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bedffd1f-e77b-484f-b090-5d8637b7262c HTTP/1.1" status: 200 len: 217 time: 0.0958755 May 12 15:11:04.534872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'a5a0bcd7-b21d-42b5-9b81-e250cd922e03', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'a5a0bcd7-b21d-42b5-9b81-e250cd922e03', 'mac_address': 'fa:16:3e:e6:28:6a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.233'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:11:04.589973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-13ef9235-02b7-4b95-a095-39da3edb5288 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:04.592030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-13ef9235-02b7-4b95-a095-39da3edb5288 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=8de7231c-cca8-4041-a1ba-b8eba5dd5861 HTTP/1.1" status: 200 len: 860 time: 0.1288383 May 12 15:11:04.658408 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-6384a2b8-97ae-407f-923f-707cb0324784 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=74c45f45-b34b-4876-a35b-8ae714cf4d5f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0490642 May 12 15:11:04.685992 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:04.703740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-532a2b34-118b-48c7-b5a6-ba65a615d1cb req-1c7a64ed-e6ad-4404-a407-e60c1ab9b021 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:04.705476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-532a2b34-118b-48c7-b5a6-ba65a615d1cb req-1c7a64ed-e6ad-4404-a407-e60c1ab9b021 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 1096 time: 0.1715889 May 12 15:11:04.748040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a5a0bcd7-b21d-42b5-9b81-e250cd922e03 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:11:04.822337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a5a0bcd7-b21d-42b5-9b81-e250cd922e03, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5a0bcd7-b21d-42b5-9b81-e250cd922e03,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:04.835014 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:04.914751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a5a0bcd7-b21d-42b5-9b81-e250cd922e03,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:04.924094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-43829d57-9ea7-41c2-8eef-1b508f92ee3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:09:35Z', 'revision_number': 4, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '317c5178-1ffb-4fde-a98e-8a9fce5e9457', 'name': '', 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'mac_address': 'fa:16:3e:5d:a4:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:46Z', 'revision_number': 5, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'subnets': [{'id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:04.928431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43829d57-9ea7-41c2-8eef-1b508f92ee3b None None] Checking router: 405f5f48-a239-4c20-a0c9-dd825327abd0 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:11:04.938415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43829d57-9ea7-41c2-8eef-1b508f92ee3b None None] Routers {'405f5f48-a239-4c20-a0c9-dd825327abd0'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:04.938415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-43829d57-9ea7-41c2-8eef-1b508f92ee3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:10:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['405f5f48-a239-4c20-a0c9-dd825327abd0'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:04.958212 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-532a2b34-118b-48c7-b5a6-ba65a615d1cb req-4ec75f70-8058-4707-b8ca-eff5020b7602 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0870812 May 12 15:11:04.989084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-b2abd5af-796b-45b4-b2e7-ae416ddff17f service neutron] 10.222.0.82 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3195798 May 12 15:11:05.146176 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a5a0bcd7-b21d-42b5-9b81-e250cd922e03'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:05.217127 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb211597-5c24-4b79-801c-97724f3f4c55 req-bc8c85d4-1ee7-4a83-b3e1-80ebc6635d2c service neutron] 10.222.0.82 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2207973 May 12 15:11:05.228005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-43829d57-9ea7-41c2-8eef-1b508f92ee3b None None] Set router 405f5f48-a239-4c20-a0c9-dd825327abd0 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:05.246844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-100949d4-5fe9-485c-8ac2-5acde905c733 req-5ad1a50c-d4b6-43bc-9be4-3e4158678a07 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:05.248718 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-100949d4-5fe9-485c-8ac2-5acde905c733 req-5ad1a50c-d4b6-43bc-9be4-3e4158678a07 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/ports?device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 946 time: 0.1634336 May 12 15:11:05.325279 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-100949d4-5fe9-485c-8ac2-5acde905c733 req-f1e81098-444a-454b-a2b1-f0a634573aee tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/security-groups?id=4db559d6-6ff9-4f01-9ab9-98bc9279fdd7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0699551 May 12 15:11:05.361103 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-44ac1a7b-e60c-4bf9-8daf-23ce498e1d2e'] response: {'name': 'network-changed', 'server_uuid': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'tag': 'bedffd1f-e77b-484f-b090-5d8637b7262c', 'status': 'completed', 'code': 200} May 12 15:11:05.361446 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-44ac1a7b-e60c-4bf9-8daf-23ce498e1d2e'] response: {'name': 'network-changed', 'server_uuid': '5fa19168-fc7f-4f74-8443-7b0c98ad2c18', 'tag': 'a5a0bcd7-b21d-42b5-9b81-e250cd922e03', 'status': 'completed', 'code': 200} May 12 15:11:05.524554 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5b88dd78-0b7b-4085-b979-bda3a4850b73'] response: {'server_uuid': '8403f3e5-d02f-4cd4-b73d-21cd47e6f139', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b916a765-866f-4478-817f-f3e33e79f873', 'code': 200} May 12 15:11:05.569664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87428033-5a63-44df-b10e-b2ac2b236446 req-a0e08a1f-4736-42df-a8c2-6582ffb10c71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:05.572178 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87428033-5a63-44df-b10e-b2ac2b236446 req-a0e08a1f-4736-42df-a8c2-6582ffb10c71 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fd97c932be3143b1846bb48363040c63&device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 1096 time: 0.1510639 May 12 15:11:05.661817 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-f389da5f-1eae-4f14-8993-e941d174146c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1713591 May 12 15:11:05.797266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87428033-5a63-44df-b10e-b2ac2b236446 req-5f46db07-d758-4fac-97d6-666125f1cc07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:05.799137 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87428033-5a63-44df-b10e-b2ac2b236446 req-5f46db07-d758-4fac-97d6-666125f1cc07 service neutron] 10.222.0.84 "GET /v2.0/networks?id=74c45f45-b34b-4876-a35b-8ae714cf4d5f HTTP/1.1" status: 200 len: 921 time: 0.2187271 May 12 15:11:05.801965 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-86d3b063-5458-443d-95cb-9cc6811702e3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0405030 May 12 15:11:05.838990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8558ca66-d227-4ad9-9a83-349a96909395 req-cb4b316b-da20-41d4-b619-f79ac6bbe90a tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips/271c712d-1732-45c0-adc8-53ca7fcf8693 HTTP/1.1" status: 200 len: 693 time: 0.3219242 May 12 15:11:05.879413 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-43829d57-9ea7-41c2-8eef-1b508f92ee3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:09:35Z', 'revision_number': 4, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '317c5178-1ffb-4fde-a98e-8a9fce5e9457', 'name': '', 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'mac_address': 'fa:16:3e:5d:a4:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:46Z', 'revision_number': 5, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'subnets': [{'id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:05.890704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43829d57-9ea7-41c2-8eef-1b508f92ee3b None None] The sync data for ids ['405f5f48-a239-4c20-a0c9-dd825327abd0'] in n-d-841483-1 is: [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:09:35Z', 'revision_number': 4, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '317c5178-1ffb-4fde-a98e-8a9fce5e9457', 'name': '', 'network_id': '74c45f45-b34b-4876-a35b-8ae714cf4d5f', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'mac_address': 'fa:16:3e:5d:a4:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:46Z', 'revision_number': 5, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'subnets': [{'id': '8de7231c-cca8-4041-a1ba-b8eba5dd5861', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:11:05.981553 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87428033-5a63-44df-b10e-b2ac2b236446 req-8661a35a-18d1-449a-a2d1-85ac518195b7 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bedffd1f-e77b-484f-b090-5d8637b7262c HTTP/1.1" status: 200 len: 217 time: 0.1664753 May 12 15:11:06.086801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87428033-5a63-44df-b10e-b2ac2b236446 req-63df2e55-0bb3-4668-84a5-d2130fb17004 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:06.087845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87428033-5a63-44df-b10e-b2ac2b236446 req-6d543729-61e5-451f-b5a9-8a6cc02d9ec9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:06.088269 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87428033-5a63-44df-b10e-b2ac2b236446 req-63df2e55-0bb3-4668-84a5-d2130fb17004 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=8a871ef1e9124e35b230ac65e37bd02e&device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 1100 time: 0.7011845 May 12 15:11:06.089247 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87428033-5a63-44df-b10e-b2ac2b236446 req-6d543729-61e5-451f-b5a9-8a6cc02d9ec9 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8de7231c-cca8-4041-a1ba-b8eba5dd5861 HTTP/1.1" status: 200 len: 860 time: 0.0974443 May 12 15:11:06.122966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-65e002a6-d832-46a5-a36f-0376dd7258e7 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:06.124879 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-65e002a6-d832-46a5-a36f-0376dd7258e7 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3083208 May 12 15:11:06.150431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d035ae7-9205-46ad-abc7-5433eebcc35b req-fe7e0daa-6480-43a4-bd6b-6c273963384c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:06.151902 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d035ae7-9205-46ad-abc7-5433eebcc35b req-fe7e0daa-6480-43a4-bd6b-6c273963384c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.5430293 May 12 15:11:06.161563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Request body: {'port': {'device_id': '5ac222f7-bb37-42b6-9a18-0b8a2211c771', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': 'fa4eac6b8c464c45aa3c550e59a0d34b'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:06.184949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-e8bc334b-4960-4578-aa47-143b35963fb1 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:06.186456 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-e8bc334b-4960-4578-aa47-143b35963fb1 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4805820 May 12 15:11:06.212602 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ffbdaaf-7698-484f-a8fc-cbb89653d78f None None] New status for floating IP 211d15a7-d35e-4d81-ae94-71f5ba6cc332: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:11:06.239535 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87428033-5a63-44df-b10e-b2ac2b236446 req-e3ad15c4-7617-4f76-926e-d234cf7d2475 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=74c45f45-b34b-4876-a35b-8ae714cf4d5f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1126242 May 12 15:11:06.259333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Request body: {'port': {'device_id': 'd63a3a59-bf0b-4b7e-ab5a-b1275d00d587', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': 'fa4eac6b8c464c45aa3c550e59a0d34b'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:06.303056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93b6a7ee-a256-4852-ba8f-bba2544eb8f0 req-7e2372ab-44eb-4758-a8a5-1e9364310075 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:06.304527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93b6a7ee-a256-4852-ba8f-bba2544eb8f0 req-7e2372ab-44eb-4758-a8a5-1e9364310075 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 1097 time: 0.6366246 May 12 15:11:06.358783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8558ca66-d227-4ad9-9a83-349a96909395 req-ef738d81-510d-44f9-a3ec-64d388ba1cd3 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:06.360106 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8558ca66-d227-4ad9-9a83-349a96909395 req-ef738d81-510d-44f9-a3ec-64d388ba1cd3 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.5203600 May 12 15:11:06.524574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d035ae7-9205-46ad-abc7-5433eebcc35b req-3ebfd516-3d71-41ed-b4ca-66e9310dc744 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3591008 May 12 15:11:06.554949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:06.565215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Usage tracker for resource:port and tenant:fa4eac6b8c464c45aa3c550e59a0d34b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:06.569453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:06.573653 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87428033-5a63-44df-b10e-b2ac2b236446 req-83deecd7-3a07-42fc-a0ff-f7400d1d64ef service neutron] 10.222.0.84 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3194444 May 12 15:11:06.580415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:06.583294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87428033-5a63-44df-b10e-b2ac2b236446 req-23c264ce-6caf-478d-9f3a-ae744f67b54c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:06.584752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87428033-5a63-44df-b10e-b2ac2b236446 req-23c264ce-6caf-478d-9f3a-ae744f67b54c service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.4715190 May 12 15:11:06.586988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8558ca66-d227-4ad9-9a83-349a96909395 req-6656f49d-2365-4325-b1e0-57fb235bd8ca tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Synchronizing usage tracker for tenant:d914960d703a44ae913f9a1804d5b368 on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:11:06.701937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Made reservation on behalf of fa4eac6b8c464c45aa3c550e59a0d34b for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:06.706462 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:06.802834 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93b6a7ee-a256-4852-ba8f-bba2544eb8f0 req-328a2c7a-d022-4291-8cbe-33a21ef9ba00 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=4db559d6-6ff9-4f01-9ab9-98bc9279fdd7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4416533 May 12 15:11:06.812999 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87428033-5a63-44df-b10e-b2ac2b236446 req-6ba02e16-361c-4918-afb1-449c3ce06b0a service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.233&port_id=a5a0bcd7-b21d-42b5-9b81-e250cd922e03 HTTP/1.1" status: 200 len: 217 time: 0.2105606 May 12 15:11:06.833024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8558ca66-d227-4ad9-9a83-349a96909395 req-6656f49d-2365-4325-b1e0-57fb235bd8ca tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Unset dirty status for tenant:d914960d703a44ae913f9a1804d5b368 on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:11:06.837909 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8558ca66-d227-4ad9-9a83-349a96909395 req-6656f49d-2365-4325-b1e0-57fb235bd8ca tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.193 HTTP/1.1" status: 200 len: 696 time: 0.4421058 May 12 15:11:06.847445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:06.857873 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87428033-5a63-44df-b10e-b2ac2b236446 req-3f142a5f-491a-4f47-838e-792845e2b958 service neutron] 10.222.0.84 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2742324 May 12 15:11:06.908814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Usage tracker for resource:port and tenant:fa4eac6b8c464c45aa3c550e59a0d34b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:06.917291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:06.930676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Allocated IP 192.168.233.65 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/9c35d53f-6773-4ce7-9642-3b542a20efa8) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:11:06.938018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:06.945988 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8558ca66-d227-4ad9-9a83-349a96909395 req-07c39111-e1e7-457b-a924-4f3c2f702839 tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.193 HTTP/1.1" status: 200 len: 696 time: 0.0942953 May 12 15:11:07.068174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Made reservation on behalf of fa4eac6b8c464c45aa3c550e59a0d34b for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:07.071605 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:07.148432 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:07.164533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Transition to ACTIVE for port object 9c35d53f-6773-4ce7-9642-3b542a20efa8 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:07.191094 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:07.202902 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:07.235815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3ae73679-d198-440a-966c-619a9930fbcb', '83a7b910-a912-4e05-9d03-5d6b1f6b0edc'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:07.238062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-8558ca66-d227-4ad9-9a83-349a96909395 req-89c3dd0e-80b6-4e46-b6b8-0b9949a5664d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Deleting port cb5b0c58-0341-4cca-9cd7-d49f1e80f42a {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:07.238390 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8558ca66-d227-4ad9-9a83-349a96909395 req-89c3dd0e-80b6-4e46-b6b8-0b9949a5664d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:07.265950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:11:07.272124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:07.276729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:11:07.314287 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event updated for resources: {'Port': ['ID=9c35d53f-6773-4ce7-9642-3b542a20efa8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:07.365322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'tag': 'bedffd1f-e77b-484f-b090-5d8637b7262c'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:07.373263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:07.374050 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:07.400304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87428033-5a63-44df-b10e-b2ac2b236446 req-bd9afd87-4db2-48fc-8e6d-8f228633f834 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:07.401276 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-77ec90eb-4466-4b56-98b9-c92b8bf17865 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.2436721 May 12 15:11:07.401822 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87428033-5a63-44df-b10e-b2ac2b236446 req-bd9afd87-4db2-48fc-8e6d-8f228633f834 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3657045 May 12 15:11:07.421866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Request body: {'port': {'device_id': '5ac222f7-bb37-42b6-9a18-0b8a2211c771', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:07.545036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec608248-fd57-4993-ab6c-1a2706bb341d req-b1990262-d21b-49b7-8a5a-5ce628e38098 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:07.547146 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec608248-fd57-4993-ab6c-1a2706bb341d req-b1990262-d21b-49b7-8a5a-5ce628e38098 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 946 time: 0.5127039 May 12 15:11:07.550827 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:07.667534 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ba748b6-f3e3-45d2-b15a-319d644c4d1e None None] Provisioning for port 9c35d53f-6773-4ce7-9642-3b542a20efa8 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:07.675624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ba748b6-f3e3-45d2-b15a-319d644c4d1e None None] Provisioning complete for port 9c35d53f-6773-4ce7-9642-3b542a20efa8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:07.675993 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ba748b6-f3e3-45d2-b15a-319d644c4d1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:07.703023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec608248-fd57-4993-ab6c-1a2706bb341d req-4fa5fb9e-bf52-4ae2-a3b3-fc50cb471b5f tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/security-groups?id=4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1377096 May 12 15:11:07.734959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Allocated IP 192.168.233.126 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/8c301fff-eebe-4ee3-ae47-9da749d76d58) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:11:07.747076 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8558ca66-d227-4ad9-9a83-349a96909395 req-89c3dd0e-80b6-4e46-b6b8-0b9949a5664d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:07.747395 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8558ca66-d227-4ad9-9a83-349a96909395 req-89c3dd0e-80b6-4e46-b6b8-0b9949a5664d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:07.767275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9ba748b6-f3e3-45d2-b15a-319d644c4d1e None None] Port 9c35d53f-6773-4ce7-9642-3b542a20efa8 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:11:07.769776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87428033-5a63-44df-b10e-b2ac2b236446 req-ac87824f-95a7-4b34-bbed-49c2893b0b35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:07.771901 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87428033-5a63-44df-b10e-b2ac2b236446 req-ac87824f-95a7-4b34-bbed-49c2893b0b35 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.3605545 May 12 15:11:07.910074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-8558ca66-d227-4ad9-9a83-349a96909395 req-89c3dd0e-80b6-4e46-b6b8-0b9949a5664d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Calling delete_port for cb5b0c58-0341-4cca-9cd7-d49f1e80f42a owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:08.074348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a5a0bcd7-b21d-42b5-9b81-e250cd922e03 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:11:08.164244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port a5a0bcd7-b21d-42b5-9b81-e250cd922e03 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:08.172315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port a5a0bcd7-b21d-42b5-9b81-e250cd922e03 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:08.172802 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:08.306084 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:08.335751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5fa19168-fc7f-4f74-8443-7b0c98ad2c18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a5a0bcd7-b21d-42b5-9b81-e250cd922e03'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:08.347987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a5a0bcd7-b21d-42b5-9b81-e250cd922e03, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5a0bcd7-b21d-42b5-9b81-e250cd922e03,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:08.352133 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:08.383460 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87428033-5a63-44df-b10e-b2ac2b236446 req-d945c373-e69d-4ed7-bbf4-2ae43cb2b22a service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5598891 May 12 15:11:08.424123 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a5a0bcd7-b21d-42b5-9b81-e250cd922e03,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:08.547411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5c501d5-291b-4221-a52f-32bbffe06e33 req-f614e0d3-86c8-4039-abd0-83ad53756815 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:08.548836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5c501d5-291b-4221-a52f-32bbffe06e33 req-f614e0d3-86c8-4039-abd0-83ad53756815 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 949 time: 0.6508358 May 12 15:11:08.655321 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:08.658317 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8558ca66-d227-4ad9-9a83-349a96909395 req-89c3dd0e-80b6-4e46-b6b8-0b9949a5664d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:08.727617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89c3dd0e-80b6-4e46-b6b8-0b9949a5664d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Pushing event deleted for resources: {'Port': ['ID=cb5b0c58-0341-4cca-9cd7-d49f1e80f42a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:08.735419 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5c501d5-291b-4221-a52f-32bbffe06e33 req-7154ca75-2012-4598-b20f-4628bb5642c4 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1802168 May 12 15:11:08.737301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87428033-5a63-44df-b10e-b2ac2b236446 req-754acf02-369b-4e59-8272-3475f6740900 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3456004 May 12 15:11:08.763237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Transition to ACTIVE for port object 8c301fff-eebe-4ee3-ae47-9da749d76d58 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:08.901835 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-721d972e-fa00-4cda-9369-11c929bf0dd3 req-f6e5fcf4-e9e6-4e10-b963-77a779ba81ff tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/floatingips/211d15a7-d35e-4d81-ae94-71f5ba6cc332 HTTP/1.1" status: 200 len: 693 time: 0.1325655 May 12 15:11:08.994530 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8558ca66-d227-4ad9-9a83-349a96909395 req-89c3dd0e-80b6-4e46-b6b8-0b9949a5664d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:09.017807 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:09.029624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:09.062441 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3ae73679-d198-440a-966c-619a9930fbcb', '83a7b910-a912-4e05-9d03-5d6b1f6b0edc'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:09.098122 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8558ca66-d227-4ad9-9a83-349a96909395 req-89c3dd0e-80b6-4e46-b6b8-0b9949a5664d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:09.099410 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8558ca66-d227-4ad9-9a83-349a96909395 req-89c3dd0e-80b6-4e46-b6b8-0b9949a5664d tempest-FloatingIPDetailsTestJSON-826931195 tempest-FloatingIPDetailsTestJSON-826931195-project] 10.222.0.82 "DELETE /v2.0/floatingips/271c712d-1732-45c0-adc8-53ca7fcf8693 HTTP/1.1" status: 204 len: 173 time: 2.1460428 May 12 15:11:09.113890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51300) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:09.128034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:11:09.133887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:09.142634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:11:09.180100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event updated for resources: {'Port': ['ID=8c301fff-eebe-4ee3-ae47-9da749d76d58,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:09.211980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-721d972e-fa00-4cda-9369-11c929bf0dd3 req-c38f4edf-3f49-4954-b372-cb175b92131d tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:09.213713 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-721d972e-fa00-4cda-9369-11c929bf0dd3 req-c38f4edf-3f49-4954-b372-cb175b92131d tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.3032384 May 12 15:11:09.393570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:09.394234 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:09.415972 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-721d972e-fa00-4cda-9369-11c929bf0dd3 req-d073d2c6-3855-47d3-83da-78b174c14a55 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.136 HTTP/1.1" status: 200 len: 696 time: 0.1918428 May 12 15:11:09.498262 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-107601b8-be9d-480f-8382-9df2052aaf4c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 3.2458992 May 12 15:11:09.522563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a3212c59-6f45-4043-969b-325197d5d6e1 None None] Provisioning for port 8c301fff-eebe-4ee3-ae47-9da749d76d58 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:09.527544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Request body: {'port': {'device_id': 'd63a3a59-bf0b-4b7e-ab5a-b1275d00d587', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:09.530445 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a3212c59-6f45-4043-969b-325197d5d6e1 None None] Provisioning complete for port 8c301fff-eebe-4ee3-ae47-9da749d76d58 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:09.531418 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a3212c59-6f45-4043-969b-325197d5d6e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:09.552070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9c35d53f-6773-4ce7-9642-3b542a20efa8 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:11:09.563445 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:09.568629 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-721d972e-fa00-4cda-9369-11c929bf0dd3 req-2ee57f65-e3f5-4d26-bed4-66e8a7b58859 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.136 HTTP/1.1" status: 200 len: 696 time: 0.1385946 May 12 15:11:09.612936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a3212c59-6f45-4043-969b-325197d5d6e1 None None] Port 8c301fff-eebe-4ee3-ae47-9da749d76d58 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:11:09.688518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41f4ac27-7e20-445c-8a63-487956188a92 req-51e318e2-b5b7-4a92-a12e-802b0c0ae60e tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:09.690126 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41f4ac27-7e20-445c-8a63-487956188a92 req-51e318e2-b5b7-4a92-a12e-802b0c0ae60e tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/ports?device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 946 time: 0.3823454 May 12 15:11:09.771243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Transition to ACTIVE for port object 9c35d53f-6773-4ce7-9642-3b542a20efa8 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:09.778591 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:09.840906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-721d972e-fa00-4cda-9369-11c929bf0dd3 req-31c432a9-c998-4a75-96fa-1287affd3246 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Deleting port 4a5c9445-7a04-4dec-9255-25097532a868 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:09.841326 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-721d972e-fa00-4cda-9369-11c929bf0dd3 req-31c432a9-c998-4a75-96fa-1287affd3246 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:09.915848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41f4ac27-7e20-445c-8a63-487956188a92 req-7d30b473-7e83-4858-b618-ed2d9b2a0430 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/security-groups?id=4db559d6-6ff9-4f01-9ab9-98bc9279fdd7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1599324 May 12 15:11:09.920119 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:09.959464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Pushing event updated for resources: {'Port': ['ID=9c35d53f-6773-4ce7-9642-3b542a20efa8,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:10.171783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Attempting to bind port 9c35d53f-6773-4ce7-9642-3b542a20efa8 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:11:10.171783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Attempting to bind port 9c35d53f-6773-4ce7-9642-3b542a20efa8 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:11:10.172649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Attempting to bind port 9c35d53f-6773-4ce7-9642-3b542a20efa8 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:10.179782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Port 9c35d53f-6773-4ce7-9642-3b542a20efa8 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:11:10.180097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Attempting to bind port 9c35d53f-6773-4ce7-9642-3b542a20efa8 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:10.188954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 10, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:11:10.189284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:10.189682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:11:10.190104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Bound port: 9c35d53f-6773-4ce7-9642-3b542a20efa8, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:11:10.190441 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:10.337905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] For port 9c35d53f-6773-4ce7-9642-3b542a20efa8, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:10.342229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] For port 9c35d53f-6773-4ce7-9642-3b542a20efa8, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9c35d53f-6773-4ce7-9642-3b542a20efa8,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:11:10.348517 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:10.377264 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-721d972e-fa00-4cda-9369-11c929bf0dd3 req-31c432a9-c998-4a75-96fa-1287affd3246 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:10.377902 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-721d972e-fa00-4cda-9369-11c929bf0dd3 req-31c432a9-c998-4a75-96fa-1287affd3246 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:10.404287 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:10.405109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:10.406978 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] 10.222.0.84 "PUT /v2.0/ports/9c35d53f-6773-4ce7-9642-3b542a20efa8 HTTP/1.1" status: 200 len: 1095 time: 2.9899607 May 12 15:11:10.415652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5ac222f7-bb37-42b6-9a18-0b8a2211c771', 'tag': '9c35d53f-6773-4ce7-9642-3b542a20efa8'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:10.424328 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:10.533655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-721d972e-fa00-4cda-9369-11c929bf0dd3 req-31c432a9-c998-4a75-96fa-1287affd3246 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Calling delete_port for 4a5c9445-7a04-4dec-9255-25097532a868 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:10.585682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a8bb58-eb30-4fd1-95e5-eaedd3a8ef2b service neutron] Pushing event updated for resources: {'Port': ['ID=9c35d53f-6773-4ce7-9642-3b542a20efa8,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:10.633880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b06a8e61-c2b0-4974-b21d-efb60e6cc87b req-ff689bb6-0fb3-4be0-bf83-65e7649cbe5f tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:10.635375 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b06a8e61-c2b0-4974-b21d-efb60e6cc87b req-ff689bb6-0fb3-4be0-bf83-65e7649cbe5f tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 1100 time: 0.4598968 May 12 15:11:10.689070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-814a6d03-7436-42f4-a01d-a6761c956616 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:10.690637 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-814a6d03-7436-42f4-a01d-a6761c956616 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=5ac222f7-bb37-42b6-9a18-0b8a2211c771 HTTP/1.1" status: 200 len: 1098 time: 0.2100604 May 12 15:11:10.741982 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b06a8e61-c2b0-4974-b21d-efb60e6cc87b req-7a3c4486-8c8c-49de-8756-864a50f334ce tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0977480 May 12 15:11:10.842676 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-7dbdfd39-9d79-481a-bd1d-913e6fe928e8 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.65&port_id=9c35d53f-6773-4ce7-9642-3b542a20efa8 HTTP/1.1" status: 200 len: 217 time: 0.1017969 May 12 15:11:10.923646 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-721d972e-fa00-4cda-9369-11c929bf0dd3 req-31c432a9-c998-4a75-96fa-1287affd3246 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:10.924341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-90c47ec4-fe46-44ea-a708-927dba921d22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:10.925862 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-90c47ec4-fe46-44ea-a708-927dba921d22 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0732725 May 12 15:11:10.960210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8c301fff-eebe-4ee3-ae47-9da749d76d58 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:11:10.981766 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:10.996572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31c432a9-c998-4a75-96fa-1287affd3246 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Pushing event deleted for resources: {'Port': ['ID=4a5c9445-7a04-4dec-9255-25097532a868,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:11.045615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Deleting port 859ac872-331f-4c8a-a382-c0072053ab23 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:11.046482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:11.078980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Transition to ACTIVE for port object 8c301fff-eebe-4ee3-ae47-9da749d76d58 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:11.091917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:11.176412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-be14eb81-708a-4bc4-8667-a114076dc6a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:11.177901 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-be14eb81-708a-4bc4-8667-a114076dc6a7 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2384501 May 12 15:11:11.243216 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-721d972e-fa00-4cda-9369-11c929bf0dd3 req-31c432a9-c998-4a75-96fa-1287affd3246 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:11.254548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd362429-e691-43ef-b240-d547e20d1a76 req-373c877f-ba3b-4289-9ca0-ed5c89fdf1c9 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:11.255293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-bd362429-e691-43ef-b240-d547e20d1a76 req-373c877f-ba3b-4289-9ca0-ed5c89fdf1c9 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Synchronizing usage tracker for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:11:11.309326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Pushing event updated for resources: {'Port': ['ID=8c301fff-eebe-4ee3-ae47-9da749d76d58,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:11.369362 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-721d972e-fa00-4cda-9369-11c929bf0dd3 req-31c432a9-c998-4a75-96fa-1287affd3246 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:11.370540 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-721d972e-fa00-4cda-9369-11c929bf0dd3 req-31c432a9-c998-4a75-96fa-1287affd3246 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "DELETE /v2.0/floatingips/211d15a7-d35e-4d81-ae94-71f5ba6cc332 HTTP/1.1" status: 204 len: 173 time: 1.7913027 May 12 15:11:11.379515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-bd362429-e691-43ef-b240-d547e20d1a76 req-373c877f-ba3b-4289-9ca0-ed5c89fdf1c9 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Unset dirty status for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:11:11.380840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd362429-e691-43ef-b240-d547e20d1a76 req-373c877f-ba3b-4289-9ca0-ed5c89fdf1c9 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ac222f7-bb37-42b6-9a18-0b8a2211c771 HTTP/1.1" status: 200 len: 947 time: 0.5180967 May 12 15:11:11.434108 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bbe595cf-9057-4301-bd3d-6a1b9918b6c5'] response: {'name': 'network-changed', 'server_uuid': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'tag': 'bedffd1f-e77b-484f-b090-5d8637b7262c', 'status': 'completed', 'code': 200} May 12 15:11:11.438641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Attempting to bind port 8c301fff-eebe-4ee3-ae47-9da749d76d58 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:11:11.438988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Attempting to bind port 8c301fff-eebe-4ee3-ae47-9da749d76d58 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:11:11.439458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Attempting to bind port 8c301fff-eebe-4ee3-ae47-9da749d76d58 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:11.454729 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd362429-e691-43ef-b240-d547e20d1a76 req-cf54fd42-6980-4271-8824-32d451a467d6 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666835 May 12 15:11:11.455353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Port 8c301fff-eebe-4ee3-ae47-9da749d76d58 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:11:11.455852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Attempting to bind port 8c301fff-eebe-4ee3-ae47-9da749d76d58 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:11.467690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:11:11.468093 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:11.469073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:11:11.469537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Bound port: 8c301fff-eebe-4ee3-ae47-9da749d76d58, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:11:11.469886 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:11.491795 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] For port 859ac872-331f-4c8a-a382-c0072053ab23, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=859ac872-331f-4c8a-a382-c0072053ab23,segment=NetworkSegment(7d065a97-a552-4415-a638-f68219b3bad1),segment_id=7d065a97-a552-4415-a638-f68219b3bad1)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:11.492029 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:11.541829 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-77b54599-eac6-4a18-9f3e-61140eaf1920'] response: {'server_uuid': '5fa19168-fc7f-4f74-8443-7b0c98ad2c18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a5a0bcd7-b21d-42b5-9b81-e250cd922e03', 'code': 200} May 12 15:11:11.613195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] For port 8c301fff-eebe-4ee3-ae47-9da749d76d58, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:11.617202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] For port 8c301fff-eebe-4ee3-ae47-9da749d76d58, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8c301fff-eebe-4ee3-ae47-9da749d76d58,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:11:11.708015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Calling delete_port for 859ac872-331f-4c8a-a382-c0072053ab23 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:11.717026 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:11.769714 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-e831f35b-8658-451e-84dc-8a7802bfbbe7 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5778835 May 12 15:11:11.902415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:11.903020 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:11.904375 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] 10.222.0.76 "PUT /v2.0/ports/8c301fff-eebe-4ee3-ae47-9da749d76d58 HTTP/1.1" status: 200 len: 1096 time: 2.3910007 May 12 15:11:12.001485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-102e82dc-6744-4617-ae49-40f0de1df42c service neutron] Pushing event updated for resources: {'Port': ['ID=8c301fff-eebe-4ee3-ae47-9da749d76d58,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:12.028567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e7d53a-6bf5-4fef-be09-1509defc1045 req-3ce74779-3278-438b-8de6-acb34b670ac9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:12.030126 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-62e7d53a-6bf5-4fef-be09-1509defc1045 req-3ce74779-3278-438b-8de6-acb34b670ac9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fd97c932be3143b1846bb48363040c63&device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 1096 time: 0.5307417 May 12 15:11:12.030272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcc07d8c-648f-470e-9e8b-2c619eafb1cc req-3be34c72-5dec-42b5-b074-4926fc6546f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:12.032184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bcc07d8c-648f-470e-9e8b-2c619eafb1cc req-3be34c72-5dec-42b5-b074-4926fc6546f0 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 1101 time: 0.4132600 May 12 15:11:12.050407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03a3ac4-b067-4aca-aca7-61f66ebff044 req-bcb69cc5-980a-4fb7-bef6-f753db03c938 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:12.057537 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d03a3ac4-b067-4aca-aca7-61f66ebff044 req-bcb69cc5-980a-4fb7-bef6-f753db03c938 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 950 time: 0.3840888 May 12 15:11:12.153835 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d03a3ac4-b067-4aca-aca7-61f66ebff044 req-329a30cf-980c-4b74-a886-b6dfd4be4946 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0953102 May 12 15:11:12.173317 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bcc07d8c-648f-470e-9e8b-2c619eafb1cc req-be277038-52c6-40b7-8559-95e3b967c80b service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1118314 May 12 15:11:12.178005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-04c7f4a6-ca72-4140-8380-5dc76a619888 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:12.179430 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-04c7f4a6-ca72-4140-8380-5dc76a619888 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=d63a3a59-bf0b-4b7e-ab5a-b1275d00d587 HTTP/1.1" status: 200 len: 1099 time: 0.2193167 May 12 15:11:12.251012 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-10c53f39-65d8-4060-ae83-5c9b38aad014 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4685466 May 12 15:11:12.259576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e7d53a-6bf5-4fef-be09-1509defc1045 req-b73359df-52d2-46ab-8efe-3148888c23c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:12.261114 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-62e7d53a-6bf5-4fef-be09-1509defc1045 req-b73359df-52d2-46ab-8efe-3148888c23c8 service neutron] 10.222.0.84 "GET /v2.0/networks?id=74c45f45-b34b-4876-a35b-8ae714cf4d5f HTTP/1.1" status: 200 len: 921 time: 0.2175622 May 12 15:11:12.356876 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-62e7d53a-6bf5-4fef-be09-1509defc1045 req-6ee39637-a6c2-4a77-a8d8-b88ba1927819 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bedffd1f-e77b-484f-b090-5d8637b7262c HTTP/1.1" status: 200 len: 217 time: 0.0778568 May 12 15:11:12.368125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea06cbd-e3ab-4d31-a2f1-5474ba05dd6b req-fa33392a-c222-40bf-9671-00ac6c22abdb tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:12.369997 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cea06cbd-e3ab-4d31-a2f1-5474ba05dd6b req-fa33392a-c222-40bf-9671-00ac6c22abdb tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/ports?device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 946 time: 0.0916674 May 12 15:11:12.388597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51340) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:12.433661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8198cff3-1ce2-4743-876e-08e829353819 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Request body: {'floatingip': {'port_id': 'b916a765-866f-4478-817f-f3e33e79f873'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:12.490217 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f1676fd3-187f-4aff-b39e-c10371f2815d'] response: {'name': 'network-changed', 'server_uuid': '5ac222f7-bb37-42b6-9a18-0b8a2211c771', 'tag': '9c35d53f-6773-4ce7-9642-3b542a20efa8', 'status': 'completed', 'code': 200} May 12 15:11:12.497209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-b3400304-c740-4f7f-bfa9-078df4e55bcf service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.126&port_id=8c301fff-eebe-4ee3-ae47-9da749d76d58 HTTP/1.1" status: 200 len: 217 time: 0.1201301 May 12 15:11:12.585209 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8198cff3-1ce2-4743-876e-08e829353819 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for floatingip, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:12.599846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-84374c22-5d02-4924-9df2-1c2340f5c447 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:12.601646 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-84374c22-5d02-4924-9df2-1c2340f5c447 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0743158 May 12 15:11:12.640729 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-841c040d-6f88-4c3e-946f-ec5ddaa9b23f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:12.720420 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:12.730285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-57864395-55a4-44e7-8e67-779e04407cb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:12.731897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-57864395-55a4-44e7-8e67-779e04407cb0 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1167729 May 12 15:11:12.741759 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:12.746408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e7d53a-6bf5-4fef-be09-1509defc1045 req-3b6bcae6-8bcd-474f-81fe-577184251528 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:12.748271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-62e7d53a-6bf5-4fef-be09-1509defc1045 req-3b6bcae6-8bcd-474f-81fe-577184251528 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8de7231c-cca8-4041-a1ba-b8eba5dd5861 HTTP/1.1" status: 200 len: 860 time: 0.3603942 May 12 15:11:12.880373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Pushing event deleted for resources: {'Port': ['ID=859ac872-331f-4c8a-a382-c0072053ab23,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:12.944397 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-eafb80c3-0619-4158-bfb4-b2ed1c02b280 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2051473 May 12 15:11:12.947397 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-073584d3-d7ed-4f2c-b848-fe40973f2630 req-fbbfb116-0591-4bbb-b489-ea7b37f2eef5 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups/9718bb98-bff2-4136-a403-fec1779615d0 HTTP/1.1" status: 200 len: 1807 time: 0.0877726 May 12 15:11:13.069827 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-62e7d53a-6bf5-4fef-be09-1509defc1045 req-d0dcb266-b930-47cc-a648-8a8ee220154a service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=74c45f45-b34b-4876-a35b-8ae714cf4d5f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2825503 May 12 15:11:13.085359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:13.085925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:13.086110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:13.086437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:13.086747 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:13.087068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:13.087380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:13.087691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:13.088017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:13.088288 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:13.088590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:13.088997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:13.122512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-6dcc5e8d-b154-4af7-94ec-0ca60b9fdbcc tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:11:13.123488 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-6dcc5e8d-b154-4af7-94ec-0ca60b9fdbcc tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3352413 May 12 15:11:13.135726 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f487af84-cdb4-4776-bd88-081fb7004af2 req-d74786d7-0932-49e4-b655-ad656317adc0 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1825111 May 12 15:11:13.152061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-073584d3-d7ed-4f2c-b848-fe40973f2630 req-a8439afb-8638-45a3-9e91-773e11ef926c tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:13.185557 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-073584d3-d7ed-4f2c-b848-fe40973f2630 req-a8439afb-8638-45a3-9e91-773e11ef926c tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:13.237205 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-073584d3-d7ed-4f2c-b848-fe40973f2630 req-a8439afb-8638-45a3-9e91-773e11ef926c tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:13.254234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d16368eb-fe80-4295-9060-6e22cacfdfb5 service neutron] Request body: {'binding': {'host': 'n-h2-841483-1', 'vnic_type': 'normal', 'profile': {}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:13.254884 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8439afb-8638-45a3-9e91-773e11ef926c tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9718bb98-bff2-4136-a403-fec1779615d0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:13.254993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d16368eb-fe80-4295-9060-6e22cacfdfb5 service neutron] Unknown quota resources ['binding']. {{(pid=88151) _create /opt/stack/neutron/neutron/api/v2/base.py:495}} May 12 15:11:13.273667 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-073584d3-d7ed-4f2c-b848-fe40973f2630 req-a8439afb-8638-45a3-9e91-773e11ef926c tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:13.275023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-073584d3-d7ed-4f2c-b848-fe40973f2630 req-a8439afb-8638-45a3-9e91-773e11ef926c tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "DELETE /v2.0/security-groups/9718bb98-bff2-4136-a403-fec1779615d0 HTTP/1.1" status: 204 len: 173 time: 0.2336268 May 12 15:11:13.435407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd63a3a59-bf0b-4b7e-ab5a-b1275d00d587', 'tag': '8c301fff-eebe-4ee3-ae47-9da749d76d58'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:13.464552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d82e68-1e5a-47ae-88db-944143e79327 req-7cde4547-8316-4189-bc5b-f926ce98e581 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:13.466049 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d82e68-1e5a-47ae-88db-944143e79327 req-7cde4547-8316-4189-bc5b-f926ce98e581 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=5ac222f7-bb37-42b6-9a18-0b8a2211c771 HTTP/1.1" status: 200 len: 1098 time: 0.9608474 May 12 15:11:13.676547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a28ddff0-7417-4028-bb6b-93e0d329b1e9 req-d2836c53-e065-4284-8fd3-8ee3b0852b80 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:13.678058 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a28ddff0-7417-4028-bb6b-93e0d329b1e9 req-d2836c53-e065-4284-8fd3-8ee3b0852b80 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ac222f7-bb37-42b6-9a18-0b8a2211c771 HTTP/1.1" status: 200 len: 947 time: 0.0930660 May 12 15:11:13.725425 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a28ddff0-7417-4028-bb6b-93e0d329b1e9 req-f5ba9ff6-14b4-4e28-b765-85234264673b tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414002 May 12 15:11:13.838310 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-62e7d53a-6bf5-4fef-be09-1509defc1045 req-130651ba-fb99-4a48-9d0c-6534fd37d814 service neutron] 10.222.0.84 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7452021 May 12 15:11:13.914241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f76e3ea5-995c-48b7-997d-533bd2ec0660 req-a824a64d-0120-4c55-8ca6-4f5fe0ff28ad tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:13.915703 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f76e3ea5-995c-48b7-997d-533bd2ec0660 req-a824a64d-0120-4c55-8ca6-4f5fe0ff28ad tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.0940621 May 12 15:11:13.961931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f76e3ea5-995c-48b7-997d-533bd2ec0660 req-921bead3-5193-4e69-845b-66d604998dda tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394681 May 12 15:11:14.145484 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-fd2be926-db15-4786-8e07-e5fadad4bc45 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 1.1057405 May 12 15:11:14.152163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-278f4cb6-4cba-4d7a-96b5-4dfc0ae652b2 req-1d0763f3-4753-4400-aa5b-122047003403 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:14.153738 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-278f4cb6-4cba-4d7a-96b5-4dfc0ae652b2 req-1d0763f3-4753-4400-aa5b-122047003403 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 950 time: 0.0817184 May 12 15:11:14.213321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d82e68-1e5a-47ae-88db-944143e79327 req-7c7efbfd-c772-45a3-bbbc-1637453b9821 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:14.214677 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d82e68-1e5a-47ae-88db-944143e79327 req-7c7efbfd-c772-45a3-bbbc-1637453b9821 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.7187605 May 12 15:11:14.221912 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-278f4cb6-4cba-4d7a-96b5-4dfc0ae652b2 req-f011f600-0276-438b-92fc-eb85ee10bd05 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580575 May 12 15:11:14.237714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d16368eb-fe80-4295-9060-6e22cacfdfb5 service neutron] Attempting to bind port 14990298-685a-4dd8-a308-ee8dcbbb6d93 on host n-h2-841483-1 for vnic_type normal with profile None {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:11:14.238039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d16368eb-fe80-4295-9060-6e22cacfdfb5 service neutron] Attempting to bind port 14990298-685a-4dd8-a308-ee8dcbbb6d93 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:11:14.238361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d16368eb-fe80-4295-9060-6e22cacfdfb5 service neutron] Attempting to bind port 14990298-685a-4dd8-a308-ee8dcbbb6d93 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:14.240480 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:14.478550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d16368eb-fe80-4295-9060-6e22cacfdfb5 service neutron] Port 14990298-685a-4dd8-a308-ee8dcbbb6d93 on network e8211761-0dd9-424f-b732-629fd2d77e28 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:11:14.479274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d16368eb-fe80-4295-9060-6e22cacfdfb5 service neutron] Attempting to bind port 14990298-685a-4dd8-a308-ee8dcbbb6d93 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:14.486597 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d82e68-1e5a-47ae-88db-944143e79327 req-02211b66-02f8-482a-b99d-a056bee76d43 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.65&port_id=9c35d53f-6773-4ce7-9642-3b542a20efa8 HTTP/1.1" status: 200 len: 217 time: 0.2499816 May 12 15:11:14.599633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d16368eb-fe80-4295-9060-6e22cacfdfb5 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:11:14.600315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d16368eb-fe80-4295-9060-6e22cacfdfb5 service neutron] Checking segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:14.600551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d16368eb-fe80-4295-9060-6e22cacfdfb5 service neutron] Bound using segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:11:14.600806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d16368eb-fe80-4295-9060-6e22cacfdfb5 service neutron] Bound port: 14990298-685a-4dd8-a308-ee8dcbbb6d93, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:11:14.632604 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-62e7d53a-6bf5-4fef-be09-1509defc1045 req-d9e0710e-17aa-4b85-85fb-6be9a0ddcc71 service neutron] 10.222.0.84 "GET /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7162142 May 12 15:11:14.690465 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b070a476-1de6-4c9a-a02b-9d979f15994f'] response: {'name': 'network-changed', 'server_uuid': 'd63a3a59-bf0b-4b7e-ab5a-b1275d00d587', 'tag': '8c301fff-eebe-4ee3-ae47-9da749d76d58', 'status': 'completed', 'code': 200} May 12 15:11:14.776304 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d82e68-1e5a-47ae-88db-944143e79327 req-e437d5d6-be5c-47ed-97a1-74516cff202e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:14.777908 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d82e68-1e5a-47ae-88db-944143e79327 req-e437d5d6-be5c-47ed-97a1-74516cff202e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2301800 May 12 15:11:14.798164 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1950d27b-ef09-4b7c-8339-e11d092a4461 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:14.828943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d16368eb-fe80-4295-9060-6e22cacfdfb5 service neutron] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:11:14.928935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-affdcd23-85dc-4596-af1a-96a8a14d5395 req-04d60e2a-2f6c-4db0-8ee0-49f7209c4c76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:14.930463 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-affdcd23-85dc-4596-af1a-96a8a14d5395 req-04d60e2a-2f6c-4db0-8ee0-49f7209c4c76 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=d63a3a59-bf0b-4b7e-ab5a-b1275d00d587 HTTP/1.1" status: 200 len: 1099 time: 0.2147381 May 12 15:11:14.950336 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d16368eb-fe80-4295-9060-6e22cacfdfb5 service neutron] Notify callbacks [] for binding, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:14.951442 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d16368eb-fe80-4295-9060-6e22cacfdfb5 service neutron] 10.222.0.82 "POST /v2.0/ports/14990298-685a-4dd8-a308-ee8dcbbb6d93/bindings HTTP/1.1" status: 201 len: 389 time: 1.7936089 May 12 15:11:14.978515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95346f20-8c90-4636-aa82-7d48cd4eb9b7 req-96d01782-86a8-4487-9716-80466de06e61 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:14.980110 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95346f20-8c90-4636-aa82-7d48cd4eb9b7 req-96d01782-86a8-4487-9716-80466de06e61 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 946 time: 0.1419191 May 12 15:11:15.026277 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8198cff3-1ce2-4743-876e-08e829353819 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:15.055529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8198cff3-1ce2-4743-876e-08e829353819 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:15.138179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95346f20-8c90-4636-aa82-7d48cd4eb9b7 req-d3e2bac0-59e1-45d2-bbaa-07577c98873d tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/security-groups?id=4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1035736 May 12 15:11:15.301627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-affdcd23-85dc-4596-af1a-96a8a14d5395 req-a6bf09c8-7adb-4116-b26e-17708cdc6d23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:15.302966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-affdcd23-85dc-4596-af1a-96a8a14d5395 req-a6bf09c8-7adb-4116-b26e-17708cdc6d23 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.3577993 May 12 15:11:15.334029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d82e68-1e5a-47ae-88db-944143e79327 req-59aabdb0-8011-4d31-81c4-bc8f623255e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:15.335796 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d82e68-1e5a-47ae-88db-944143e79327 req-59aabdb0-8011-4d31-81c4-bc8f623255e5 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.5486698 May 12 15:11:15.450637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Router 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:11:15.481231 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-8198cff3-1ce2-4743-876e-08e829353819 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Floating IP bf15d665-374d-49cc-aa1b-7297db778487 associated. External IP: 172.25.8.163, port: b916a765-866f-4478-817f-f3e33e79f873. May 12 15:11:15.571275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9c35d53f-6773-4ce7-9642-3b542a20efa8 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:11:15.631539 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-affdcd23-85dc-4596-af1a-96a8a14d5395 req-c5f07c4f-6920-48d1-a2cb-5ab117322b3b service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.126&port_id=8c301fff-eebe-4ee3-ae47-9da749d76d58 HTTP/1.1" status: 200 len: 217 time: 0.3145001 May 12 15:11:15.669196 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d82e68-1e5a-47ae-88db-944143e79327 req-d0f42376-e9ba-49d9-b811-22d534058924 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3161070 May 12 15:11:15.719043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-4bb1abbd-d885-4e57-89d7-57f0aeb3f725 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:15.720820 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-4bb1abbd-d885-4e57-89d7-57f0aeb3f725 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.76 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 946 time: 0.5816839 May 12 15:11:15.738665 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9c35d53f-6773-4ce7-9642-3b542a20efa8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9c35d53f-6773-4ce7-9642-3b542a20efa8,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:15.752740 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '9c35d53f-6773-4ce7-9642-3b542a20efa8', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '9c35d53f-6773-4ce7-9642-3b542a20efa8', 'mac_address': 'fa:16:3e:0b:db:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.65'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:11:15.816468 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:15.825478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Deleting port a3478c2b-fafc-4acf-abce-c432fa4e874d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:15.826090 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:15.838324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9c35d53f-6773-4ce7-9642-3b542a20efa8 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:11:15.855997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9c35d53f-6773-4ce7-9642-3b542a20efa8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9c35d53f-6773-4ce7-9642-3b542a20efa8,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:15.860593 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:15.951184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-affdcd23-85dc-4596-af1a-96a8a14d5395 req-bdc644e0-1f3b-465a-81dd-3dadecddc985 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:15.953166 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-affdcd23-85dc-4596-af1a-96a8a14d5395 req-bdc644e0-1f3b-465a-81dd-3dadecddc985 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3082314 May 12 15:11:15.989333 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:15.998392 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=9c35d53f-6773-4ce7-9642-3b542a20efa8,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:16.050275 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:16.062515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55526acf-78e2-4d03-8fa1-9f5e4ba30f2f req-16469bf7-4b62-45be-9eb9-56721683d96b tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:16.063210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-55526acf-78e2-4d03-8fa1-9f5e4ba30f2f req-16469bf7-4b62-45be-9eb9-56721683d96b tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Synchronizing usage tracker for tenant:fd97c932be3143b1846bb48363040c63 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:11:16.080251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce74978-a17b-4017-b6aa-bc40b71126ea req-4fbd7203-ad33-4d77-8c79-f80c02eff892 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:16.087364 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ce74978-a17b-4017-b6aa-bc40b71126ea req-4fbd7203-ad33-4d77-8c79-f80c02eff892 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ac222f7-bb37-42b6-9a18-0b8a2211c771 HTTP/1.1" status: 200 len: 947 time: 0.5344086 May 12 15:11:16.135911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-11842366-39d8-4387-9192-96fb0a145de1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:16.137365 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-11842366-39d8-4387-9192-96fb0a145de1 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 1096 time: 0.7259052 May 12 15:11:16.168880 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 8c301fff-eebe-4ee3-ae47-9da749d76d58 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:11:16.258918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:11:16.270760 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c13fc129-77f0-4059-93fc-2001deb59816 admin admin] 10.222.0.82 "PUT /v2.0/routers/3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.1528084 May 12 15:11:16.271799 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d82e68-1e5a-47ae-88db-944143e79327 req-faa25c5c-06af-4f4a-94ed-aeb3dad857f6 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5931299 May 12 15:11:16.273264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51414) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:16.322563 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-55526acf-78e2-4d03-8fa1-9f5e4ba30f2f req-16469bf7-4b62-45be-9eb9-56721683d96b tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Unset dirty status for tenant:fd97c932be3143b1846bb48363040c63 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:11:16.326618 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a991dff0-a0ad-491d-b4b9-f104f53641c3 None None] Sync routers for ids ['3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:11:16.329621 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55526acf-78e2-4d03-8fa1-9f5e4ba30f2f req-16469bf7-4b62-45be-9eb9-56721683d96b tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 945 time: 0.9245539 May 12 15:11:16.330171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['9c35d53f-6773-4ce7-9642-3b542a20efa8'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:16.349925 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ce74978-a17b-4017-b6aa-bc40b71126ea req-2b782684-47ec-4f84-aaac-95a6d8fc9bb1 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2615893 May 12 15:11:16.397594 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a991dff0-a0ad-491d-b4b9-f104f53641c3 None None] Routers {'3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:16.397971 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a991dff0-a0ad-491d-b4b9-f104f53641c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:16.454182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-6cb658a6-cecb-42c6-a92b-42b24046632a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:16.455691 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-6cb658a6-cecb-42c6-a92b-42b24046632a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 1100 time: 0.4900670 May 12 15:11:16.464661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8198cff3-1ce2-4743-876e-08e829353819 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Router ea3f04a0-308b-4219-ad26-2924d153122f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:11:16.476929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] For port a3478c2b-fafc-4acf-abce-c432fa4e874d, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3478c2b-fafc-4acf-abce-c432fa4e874d,segment=NetworkSegment(5557610c-85a4-4c18-8793-b6867e2cb17c),segment_id=5557610c-85a4-4c18-8793-b6867e2cb17c)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:16.477295 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:16.490875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-affdcd23-85dc-4596-af1a-96a8a14d5395 req-f5085abb-95ef-4ac4-8683-df15fb990575 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:16.492342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-affdcd23-85dc-4596-af1a-96a8a14d5395 req-f5085abb-95ef-4ac4-8683-df15fb990575 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.5021327 May 12 15:11:16.506449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-55526acf-78e2-4d03-8fa1-9f5e4ba30f2f req-b422a318-e080-46ef-8199-a7de0e5eca8a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Synchronizing usage tracker for tenant:fd97c932be3143b1846bb48363040c63 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:11:16.564994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 8c301fff-eebe-4ee3-ae47-9da749d76d58, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8c301fff-eebe-4ee3-ae47-9da749d76d58,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:16.654800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-4cf2246f-7773-4b2b-9c60-c1cf66a84647 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:16.656531 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-4cf2246f-7773-4b2b-9c60-c1cf66a84647 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.4969149 May 12 15:11:16.675778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '8c301fff-eebe-4ee3-ae47-9da749d76d58', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '8c301fff-eebe-4ee3-ae47-9da749d76d58', 'mac_address': 'fa:16:3e:15:28:a3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.126'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:11:16.731261 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:16.767994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-a991dff0-a0ad-491d-b4b9-f104f53641c3 None None] Set router 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:16.803846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-55526acf-78e2-4d03-8fa1-9f5e4ba30f2f req-b422a318-e080-46ef-8199-a7de0e5eca8a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Unset dirty status for tenant:fd97c932be3143b1846bb48363040c63 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:11:16.805011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55526acf-78e2-4d03-8fa1-9f5e4ba30f2f req-b422a318-e080-46ef-8199-a7de0e5eca8a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/security-groups?id=14760cab-e3dc-4bd2-9dbe-16aa688504a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4746301 May 12 15:11:16.810806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-bc09e3c0-7596-4c6e-9b8c-0917ac9d524f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93 HTTP/1.1" status: 200 len: 217 time: 0.0871661 May 12 15:11:16.920642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-976a2e17-3440-43ea-8d63-4392dac62f70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:16.922193 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-976a2e17-3440-43ea-8d63-4392dac62f70 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.4013574 May 12 15:11:16.939279 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:17.037826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8c301fff-eebe-4ee3-ae47-9da749d76d58 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:11:17.068279 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-26c01894-1309-4391-833d-6dcfe8f5a6ff service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859 HTTP/1.1" status: 200 len: 217 time: 0.1379328 May 12 15:11:17.079683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8198cff3-1ce2-4743-876e-08e829353819 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:11:17.090360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 8c301fff-eebe-4ee3-ae47-9da749d76d58, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8c301fff-eebe-4ee3-ae47-9da749d76d58,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:17.097322 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97ed8657-b95c-4a91-bfe0-c80e658fcaae None None] Sync routers for ids ['ea3f04a0-308b-4219-ad26-2924d153122f'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:11:17.113228 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:17.115832 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8198cff3-1ce2-4743-876e-08e829353819 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:17.119759 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97ed8657-b95c-4a91-bfe0-c80e658fcaae None None] Routers {'ea3f04a0-308b-4219-ad26-2924d153122f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:17.120888 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-97ed8657-b95c-4a91-bfe0-c80e658fcaae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ea3f04a0-308b-4219-ad26-2924d153122f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:17.209807 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:17.260085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-a00b98f0-c176-4eac-9522-4ea874b60dcc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:17.261583 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-a00b98f0-c176-4eac-9522-4ea874b60dcc service neutron] 10.222.0.76 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.4398804 May 12 15:11:17.263456 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-affdcd23-85dc-4596-af1a-96a8a14d5395 req-10c76217-8097-46c3-a905-899206063408 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7533195 May 12 15:11:17.325665 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=8c301fff-eebe-4ee3-ae47-9da749d76d58,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:17.378780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a991dff0-a0ad-491d-b4b9-f104f53641c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'name': 'tempest-FloatingIPDetailsTestJSON-1923857176-router', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.112'}], 'enable_snat': True}, 'gw_port_id': '43ddf270-5ffe-40d9-b4c7-c5b75ccda930', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:01Z', 'updated_at': '2022-05-12T15:11:12Z', 'revision_number': 5, 'project_id': 'd914960d703a44ae913f9a1804d5b368', 'gw_port': {'id': '43ddf270-5ffe-40d9-b4c7-c5b75ccda930', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:5a:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 728, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:02Z', 'updated_at': '2022-05-12T15:10:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:17.386866 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8198cff3-1ce2-4743-876e-08e829353819 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "PUT /v2.0/floatingips/bf15d665-374d-49cc-aa1b-7297db778487 HTTP/1.1" status: 200 len: 992 time: 4.9972837 May 12 15:11:17.387578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a991dff0-a0ad-491d-b4b9-f104f53641c3 None None] Checking router: 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:11:17.391291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8403f3e5-d02f-4cd4-b73d-21cd47e6f139', 'tag': 'b916a765-866f-4478-817f-f3e33e79f873'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:17.400558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-9e5ebb65-43b7-4379-9b6a-1bc6918ea688 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:17.401957 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-9e5ebb65-43b7-4379-9b6a-1bc6918ea688 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3238249 May 12 15:11:17.402708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a991dff0-a0ad-491d-b4b9-f104f53641c3 None None] Routers {'3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:17.403431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a991dff0-a0ad-491d-b4b9-f104f53641c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:17.405833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] Deleting port 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:17.406414 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-97ed8657-b95c-4a91-bfe0-c80e658fcaae None None] Set router ea3f04a0-308b-4219-ad26-2924d153122f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:17.406844 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:17.438085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-c9c11360-5aa4-43f6-a639-69197e0d0be1 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1575696 May 12 15:11:17.457725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7bbf706-471b-46e5-bd9b-732d878dca78 req-5d720f5e-5a86-499c-a959-75638353fb6f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:17.459213 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f7bbf706-471b-46e5-bd9b-732d878dca78 req-5d720f5e-5a86-499c-a959-75638353fb6f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.8696218 May 12 15:11:17.514144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['8c301fff-eebe-4ee3-ae47-9da749d76d58'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:17.626273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-7a0bba1b-d23f-458f-b533-08f0635c2356 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:17.628674 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-7a0bba1b-d23f-458f-b533-08f0635c2356 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1959696 May 12 15:11:17.681020 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:17.692955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-a991dff0-a0ad-491d-b4b9-f104f53641c3 None None] Set router 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:17.693730 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:17.694193 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:17.694594 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Floating IP 86ba9930-7249-4cf3-94d1-68180b9f26fa disassociated. External IP: 172.25.8.55, port: a3478c2b-fafc-4acf-abce-c432fa4e874d. May 12 15:11:17.695020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Calling delete_port for a3478c2b-fafc-4acf-abce-c432fa4e874d owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:17.789553 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-affdcd23-85dc-4596-af1a-96a8a14d5395 req-bb0ea6cc-c10c-4d3c-8827-ae7078c39e67 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4736080 May 12 15:11:17.812253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] For port 43ddf270-5ffe-40d9-b4c7-c5b75ccda930, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=43ddf270-5ffe-40d9-b4c7-c5b75ccda930,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:17.813700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:17.834660 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-97ed8657-b95c-4a91-bfe0-c80e658fcaae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17'}], 'enable_snat': True}, 'gw_port_id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 4, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port': {'id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:36:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 766, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:25Z', 'updated_at': '2022-05-12T15:10:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'bf15d665-374d-49cc-aa1b-7297db778487', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'floating_ip_address': '172.25.8.163', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'port_id': 'b916a765-866f-4478-817f-f3e33e79f873', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 798, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'mac_address': 'fa:16:3e:51:d2:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8403f3e5-d02f-4cd4-b73d-21cd47e6f139', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:10:37Z', 'updated_at': '2022-05-12T15:11:14Z', 'revision_number': 1, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fdea6f95-4926-47ab-b77f-0443f92db7f5', 'name': '', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'mac_address': 'fa:16:3e:d3:23:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_interface', 'standard_attr_id': 777, 'fixed_ips': [{'subnet_id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:29Z', 'updated_at': '2022-05-12T15:10:37Z', 'revision_number': 5, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'subnets': [{'id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:17.844777 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97ed8657-b95c-4a91-bfe0-c80e658fcaae None None] Checking router: ea3f04a0-308b-4219-ad26-2924d153122f for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:11:17.860915 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97ed8657-b95c-4a91-bfe0-c80e658fcaae None None] Routers {'ea3f04a0-308b-4219-ad26-2924d153122f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:17.862101 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-97ed8657-b95c-4a91-bfe0-c80e658fcaae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ea3f04a0-308b-4219-ad26-2924d153122f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:17.867133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a991dff0-a0ad-491d-b4b9-f104f53641c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'name': 'tempest-FloatingIPDetailsTestJSON-1923857176-router', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:01Z', 'updated_at': '2022-05-12T15:11:17Z', 'revision_number': 6, 'project_id': 'd914960d703a44ae913f9a1804d5b368', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:17.879576 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a991dff0-a0ad-491d-b4b9-f104f53641c3 None None] The sync data for ids ['3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf'] in n-d-841483-1 is: [{'id': '3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf', 'name': 'tempest-FloatingIPDetailsTestJSON-1923857176-router', 'tenant_id': 'd914960d703a44ae913f9a1804d5b368', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:01Z', 'updated_at': '2022-05-12T15:11:17Z', 'revision_number': 6, 'project_id': 'd914960d703a44ae913f9a1804d5b368', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:11:17.958142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-336bb42b-e75f-46c9-9ce4-bf9250e9f602 req-1ec7266f-6d79-4341-b52d-18a92d1f8b93 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:17.968363 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-336bb42b-e75f-46c9-9ce4-bf9250e9f602 req-1ec7266f-6d79-4341-b52d-18a92d1f8b93 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 945 time: 0.9888947 May 12 15:11:17.974858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] Calling delete_port for 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:18.022197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f7bbf706-471b-46e5-bd9b-732d878dca78 req-a789d67d-cc69-4eff-984f-0b24adda9db4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4088817 May 12 15:11:18.058379 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-1513f973-a348-4078-b3c0-4158b9763fb3 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4153602 May 12 15:11:18.066190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e8bbe53-a030-4941-ba88-48c5ba784655 req-97ea052a-f632-4d12-8d7d-5b69644fcbc0 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:18.067160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0e8bbe53-a030-4941-ba88-48c5ba784655 req-97ea052a-f632-4d12-8d7d-5b69644fcbc0 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Synchronizing usage tracker for tenant:fd97c932be3143b1846bb48363040c63 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:11:18.097668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-336bb42b-e75f-46c9-9ce4-bf9250e9f602 req-6c8d6263-efa1-4089-bce2-ac315c143148 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1282449 May 12 15:11:18.100822 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:18.105429 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-e760d1e1-93ca-4d44-b0c7-2ee749b6b462 service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6243944 May 12 15:11:18.141498 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-97ed8657-b95c-4a91-bfe0-c80e658fcaae None None] Set router ea3f04a0-308b-4219-ad26-2924d153122f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:18.179418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0e8bbe53-a030-4941-ba88-48c5ba784655 req-97ea052a-f632-4d12-8d7d-5b69644fcbc0 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Unset dirty status for tenant:fd97c932be3143b1846bb48363040c63 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:11:18.180810 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e8bbe53-a030-4941-ba88-48c5ba784655 req-97ea052a-f632-4d12-8d7d-5b69644fcbc0 tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.84 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 945 time: 0.4492540 May 12 15:11:18.191400 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a3478c2b-fafc-4acf-abce-c432fa4e874d no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:11:18.236303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Pushing event deleted for resources: {'Port': ['ID=a3478c2b-fafc-4acf-abce-c432fa4e874d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:18.278697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: a3478c2b-fafc-4acf-abce-c432fa4e874d {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:11:18.278862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a3478c2b-fafc-4acf-abce-c432fa4e874d not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:11:18.346873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:18.347278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:18.347612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:18.347946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:18.348309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:18.348636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:18.348957 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:18.349309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:18.351904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:18.351904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:18.351904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:18.351904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:18.352356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-0e8bbe53-a030-4941-ba88-48c5ba784655 req-53fb91e6-5942-4483-a46b-299bea614e4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Deleting port bedffd1f-e77b-484f-b090-5d8637b7262c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:18.352487 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0e8bbe53-a030-4941-ba88-48c5ba784655 req-53fb91e6-5942-4483-a46b-299bea614e4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:18.442780 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-b2fd36bf-4ff0-4c28-8561-144058c3f0e7 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3724611 May 12 15:11:18.476660 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3e61516-47f6-42dc-b33c-8497d9f8492a req-4c5e96d0-bb3c-4f22-93b6-1d651dec2916 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/ports?device_id=74ddf043-2cb7-4286-b010-6509b25bb4aa HTTP/1.1" status: 200 len: 210 time: 0.2047241 May 12 15:11:18.658220 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:18.708253 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-5a2ca0c1-b412-457c-b409-6f75e8c57906 service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5240848 May 12 15:11:18.715595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd533e6-e455-45dd-a2af-0ab9b525326b req-2ef36c09-4ddf-4cfa-a3fe-cbec68573d58 tempest-ServersAdminNegativeTestJSON-2087206548 tempest-ServersAdminNegativeTestJSON-2087206548-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:18.725535 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdd533e6-e455-45dd-a2af-0ab9b525326b req-2ef36c09-4ddf-4cfa-a3fe-cbec68573d58 tempest-ServersAdminNegativeTestJSON-2087206548 tempest-ServersAdminNegativeTestJSON-2087206548-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 1101 time: 0.5417354 May 12 15:11:18.740856 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-97ed8657-b95c-4a91-bfe0-c80e658fcaae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17'}], 'enable_snat': True}, 'gw_port_id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 4, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port': {'id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:36:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 766, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:25Z', 'updated_at': '2022-05-12T15:10:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'bf15d665-374d-49cc-aa1b-7297db778487', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'floating_ip_address': '172.25.8.163', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'port_id': 'b916a765-866f-4478-817f-f3e33e79f873', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 798, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'mac_address': 'fa:16:3e:51:d2:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8403f3e5-d02f-4cd4-b73d-21cd47e6f139', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:10:37Z', 'updated_at': '2022-05-12T15:11:14Z', 'revision_number': 1, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fdea6f95-4926-47ab-b77f-0443f92db7f5', 'name': '', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'mac_address': 'fa:16:3e:d3:23:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_interface', 'standard_attr_id': 777, 'fixed_ips': [{'subnet_id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:29Z', 'updated_at': '2022-05-12T15:10:37Z', 'revision_number': 5, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'subnets': [{'id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:18.754195 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97ed8657-b95c-4a91-bfe0-c80e658fcaae None None] The sync data for ids ['ea3f04a0-308b-4219-ad26-2924d153122f'] in n-d-841483-1 is: [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17'}], 'enable_snat': True}, 'gw_port_id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 4, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port': {'id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:36:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 766, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:25Z', 'updated_at': '2022-05-12T15:10:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'bf15d665-374d-49cc-aa1b-7297db778487', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'floating_ip_address': '172.25.8.163', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'port_id': 'b916a765-866f-4478-817f-f3e33e79f873', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 798, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'mac_address': 'fa:16:3e:51:d2:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8403f3e5-d02f-4cd4-b73d-21cd47e6f139', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:10:37Z', 'updated_at': '2022-05-12T15:11:14Z', 'revision_number': 1, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fdea6f95-4926-47ab-b77f-0443f92db7f5', 'name': '', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'mac_address': 'fa:16:3e:d3:23:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_interface', 'standard_attr_id': 777, 'fixed_ips': [{'subnet_id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:29Z', 'updated_at': '2022-05-12T15:10:37Z', 'revision_number': 5, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'subnets': [{'id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:11:18.769469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] Pushing event deleted for resources: {'Port': ['ID=43ddf270-5ffe-40d9-b4c7-c5b75ccda930,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:18.804129 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fdd533e6-e455-45dd-a2af-0ab9b525326b req-fe4e9a50-30df-4358-ae42-4eca4a0f4207 tempest-ServersAdminNegativeTestJSON-2087206548 tempest-ServersAdminNegativeTestJSON-2087206548-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:18.881180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-fdd533e6-e455-45dd-a2af-0ab9b525326b req-fe4e9a50-30df-4358-ae42-4eca4a0f4207 tempest-ServersAdminNegativeTestJSON-2087206548 tempest-ServersAdminNegativeTestJSON-2087206548-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:18.888903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-fdd533e6-e455-45dd-a2af-0ab9b525326b req-fe4e9a50-30df-4358-ae42-4eca4a0f4207 tempest-ServersAdminNegativeTestJSON-2087206548 tempest-ServersAdminNegativeTestJSON-2087206548-project-admin] Usage tracker for resource:security_group_rule and tenant:9759882593c34b689baaafe6db795647 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:18.900514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Router 2efb0694-c577-4ca8-871f-c4b55760ad4a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:11:18.901505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-fdd533e6-e455-45dd-a2af-0ab9b525326b req-fe4e9a50-30df-4358-ae42-4eca4a0f4207 tempest-ServersAdminNegativeTestJSON-2087206548 tempest-ServersAdminNegativeTestJSON-2087206548-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:18.912700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-fdd533e6-e455-45dd-a2af-0ab9b525326b req-fe4e9a50-30df-4358-ae42-4eca4a0f4207 tempest-ServersAdminNegativeTestJSON-2087206548 tempest-ServersAdminNegativeTestJSON-2087206548-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:18.945607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0e8bbe53-a030-4941-ba88-48c5ba784655 req-53fb91e6-5942-4483-a46b-299bea614e4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] For port bedffd1f-e77b-484f-b090-5d8637b7262c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bedffd1f-e77b-484f-b090-5d8637b7262c,segment=NetworkSegment(96a7c587-eda9-40b0-aaff-97f4e1387d63),segment_id=96a7c587-eda9-40b0-aaff-97f4e1387d63)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:18.946674 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0e8bbe53-a030-4941-ba88-48c5ba784655 req-53fb91e6-5942-4483-a46b-299bea614e4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:19.066260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2e7c89e-81be-4559-acb8-d8d57ac8f10d None None] New status for floating IP bf15d665-374d-49cc-aa1b-7297db778487: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:11:19.143431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:11:19.206153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:11:19.206853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 43ddf270-5ffe-40d9-b4c7-c5b75ccda930 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:11:19.207125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 859ac872-331f-4c8a-a382-c0072053ab23 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:11:19.211083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-0e8bbe53-a030-4941-ba88-48c5ba784655 req-53fb91e6-5942-4483-a46b-299bea614e4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Calling delete_port for bedffd1f-e77b-484f-b090-5d8637b7262c owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:19.247634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 859ac872-331f-4c8a-a382-c0072053ab23 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:11:19.248136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 859ac872-331f-4c8a-a382-c0072053ab23 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:11:19.272287 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:19.298792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d8681671-23e3-49cf-82ca-de0cf2bfca1f tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:19.300258 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-d8681671-23e3-49cf-82ca-de0cf2bfca1f tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4&tenant_id=68c66ae0cd45476b87e2e79625b80f69&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1096 time: 0.4990509 May 12 15:11:19.321750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h2-841483-1'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:19.353060 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5532200-6a94-4d60-93b3-8415c5b6c278 req-d77161ee-fb21-4e6e-ac77-bd0bfd990901 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:19.354520 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5532200-6a94-4d60-93b3-8415c5b6c278 req-d77161ee-fb21-4e6e-ac77-bd0bfd990901 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/ports?device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 946 time: 0.5976369 May 12 15:11:19.431187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:11:19.448256 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ced58968-4c96-4d75-8c4a-74fd219deda7 None None] Sync routers for ids ['2efb0694-c577-4ca8-871f-c4b55760ad4a'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:11:19.460006 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ced58968-4c96-4d75-8c4a-74fd219deda7 None None] Routers {'2efb0694-c577-4ca8-871f-c4b55760ad4a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:19.460694 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ced58968-4c96-4d75-8c4a-74fd219deda7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2efb0694-c577-4ca8-871f-c4b55760ad4a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:19.472415 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:19.486425 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:19.558597 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:19.559088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:11:19.596762 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fdd533e6-e455-45dd-a2af-0ab9b525326b req-fe4e9a50-30df-4358-ae42-4eca4a0f4207 tempest-ServersAdminNegativeTestJSON-2087206548 tempest-ServersAdminNegativeTestJSON-2087206548-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:19.600993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:19.605081 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8e3bd0e7-4e29-4030-9b62-b1cc7a52a35d admin admin] 10.222.0.82 "DELETE /v2.0/routers/3a2d9f55-a8a4-4aa0-8817-0a1cef5e1baf HTTP/1.1" status: 204 len: 168 time: 3.2827544 May 12 15:11:19.606155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51432) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:19.610441 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0e8bbe53-a030-4941-ba88-48c5ba784655 req-53fb91e6-5942-4483-a46b-299bea614e4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:19.615036 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9c35d53f-6773-4ce7-9642-3b542a20efa8 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:11:19.660503 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5532200-6a94-4d60-93b3-8415c5b6c278 req-6b65074d-3d49-44be-9e33-3e9a531dfee7 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/security-groups?id=4db559d6-6ff9-4f01-9ab9-98bc9279fdd7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2774510 May 12 15:11:19.661599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] No DVR routers for this DVR port a3478c2b-fafc-4acf-abce-c432fa4e874d on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:11:19.669288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['bedffd1f-e77b-484f-b090-5d8637b7262c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:19.675684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fdd533e6-e455-45dd-a2af-0ab9b525326b req-fe4e9a50-30df-4358-ae42-4eca4a0f4207 tempest-ServersAdminNegativeTestJSON-2087206548 tempest-ServersAdminNegativeTestJSON-2087206548-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:19.722231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53fb91e6-5942-4483-a46b-299bea614e4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Pushing event deleted for resources: {'Port': ['ID=bedffd1f-e77b-484f-b090-5d8637b7262c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:19.723368 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:19.743907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdd533e6-e455-45dd-a2af-0ab9b525326b req-fe4e9a50-30df-4358-ae42-4eca4a0f4207 tempest-ServersAdminNegativeTestJSON-2087206548 tempest-ServersAdminNegativeTestJSON-2087206548-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.0173490 May 12 15:11:19.744809 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '74ddf043-2cb7-4286-b010-6509b25bb4aa', 'name': 'network-vif-deleted', 'tag': 'a3478c2b-fafc-4acf-abce-c432fa4e874d'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:19.791116 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:19.798722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 9c35d53f-6773-4ce7-9642-3b542a20efa8 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:19.806450 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 9c35d53f-6773-4ce7-9642-3b542a20efa8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:19.807077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe4e9a50-30df-4358-ae42-4eca4a0f4207 tempest-ServersAdminNegativeTestJSON-2087206548 tempest-ServersAdminNegativeTestJSON-2087206548-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6427c6fb-1b24-45d7-8c27-29619bc2b4af,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:19.807210 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:19.824392 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08e5f16b-fbac-43b4-a7f6-adf5b1707f61 req-7043673d-b8bc-44ad-b639-610563772dc0 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.76 "DELETE /v2.0/ports/a3478c2b-fafc-4acf-abce-c432fa4e874d HTTP/1.1" status: 204 len: 173 time: 4.0820901 May 12 15:11:19.847608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-0e8bbe53-a030-4941-ba88-48c5ba784655 req-53fb91e6-5942-4483-a46b-299bea614e4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] No DVR routers for this DVR port bedffd1f-e77b-484f-b090-5d8637b7262c on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:11:19.851141 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0e8bbe53-a030-4941-ba88-48c5ba784655 req-53fb91e6-5942-4483-a46b-299bea614e4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:19.854876 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e8bbe53-a030-4941-ba88-48c5ba784655 req-53fb91e6-5942-4483-a46b-299bea614e4a tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.84 "DELETE /v2.0/ports/bedffd1f-e77b-484f-b090-5d8637b7262c HTTP/1.1" status: 204 len: 173 time: 1.6591485 May 12 15:11:19.862799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-4ce74af6-57ae-40af-a4f5-012b3565666b admin admin] Deleting subnet 55f11913-d2d9-4fda-86a7-3a4470347229 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:11:19.866906 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ce74af6-57ae-40af-a4f5-012b3565666b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:19.906619 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3559f5cc-8617-428b-a58a-824e72d7552a'] response: {'name': 'network-changed', 'server_uuid': '8403f3e5-d02f-4cd4-b73d-21cd47e6f139', 'tag': 'b916a765-866f-4478-817f-f3e33e79f873', 'status': 'completed', 'code': 200} May 12 15:11:19.930858 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-ced58968-4c96-4d75-8c4a-74fd219deda7 None None] Set router 2efb0694-c577-4ca8-871f-c4b55760ad4a gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:19.953079 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ce74af6-57ae-40af-a4f5-012b3565666b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:20.104381 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ce74af6-57ae-40af-a4f5-012b3565666b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:20.105764 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:20.163992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5ac222f7-bb37-42b6-9a18-0b8a2211c771', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c35d53f-6773-4ce7-9642-3b542a20efa8'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:20.177321 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9c35d53f-6773-4ce7-9642-3b542a20efa8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9c35d53f-6773-4ce7-9642-3b542a20efa8,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:20.184238 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:20.218828 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ce74af6-57ae-40af-a4f5-012b3565666b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:20.237671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 8c301fff-eebe-4ee3-ae47-9da749d76d58 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:11:20.242253 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3f2a317-dab0-4e1b-bce8-f2d74ca2bd27 req-77373e4a-7015-424c-86df-70449ab8a8bc tempest-ServerRescueTestJSONUnderV235-1947838091 tempest-ServerRescueTestJSONUnderV235-1947838091-project] 10.222.0.82 "GET /v2.0/ports?device_id=674d52a4-c926-40b2-a4b1-6029fb3c8e10 HTTP/1.1" status: 200 len: 210 time: 0.1389053 May 12 15:11:20.288155 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ce74af6-57ae-40af-a4f5-012b3565666b admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:20.295537 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ce74af6-57ae-40af-a4f5-012b3565666b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=55f11913-d2d9-4fda-86a7-3a4470347229,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:20.309758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a017e4d8-34ea-45ef-a57c-1113f7d49659 None None] Network 7869b0da-59f4-4b95-80b3-2cee1e2f3494 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:11:20.318652 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ce74af6-57ae-40af-a4f5-012b3565666b admin admin] 10.222.0.82 "DELETE /v2.0/subnets/55f11913-d2d9-4fda-86a7-3a4470347229 HTTP/1.1" status: 204 len: 168 time: 0.7109466 May 12 15:11:20.320956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51444) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:20.359517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:20.443346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9ee0253-1b12-4a32-ab5c-49953bb7d22d req-13616da3-913b-4af9-bd3b-49b6d9db1206 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:20.445184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9ee0253-1b12-4a32-ab5c-49953bb7d22d req-13616da3-913b-4af9-bd3b-49b6d9db1206 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a673d571317840e888b6cfe5a121092e&device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 1097 time: 0.3840995 May 12 15:11:20.496569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3f4833b-dd64-42f1-aeaf-71db889c43ae req-803072e3-65b0-4701-9629-b5b76624da1f tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:20.498282 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3f4833b-dd64-42f1-aeaf-71db889c43ae req-803072e3-65b0-4701-9629-b5b76624da1f tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ac222f7-bb37-42b6-9a18-0b8a2211c771 HTTP/1.1" status: 200 len: 949 time: 0.4352632 May 12 15:11:20.522771 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:20.541005 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ced58968-4c96-4d75-8c4a-74fd219deda7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50'}], 'enable_snat': True}, 'gw_port_id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:43Z', 'revision_number': 4, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port': {'id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:5a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:34Z', 'updated_at': '2022-05-12T15:09:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5', 'name': '', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'mac_address': 'fa:16:3e:44:ec:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:42Z', 'updated_at': '2022-05-12T15:09:55Z', 'revision_number': 5, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'subnets': [{'id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:20.551180 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ced58968-4c96-4d75-8c4a-74fd219deda7 None None] Checking router: 2efb0694-c577-4ca8-871f-c4b55760ad4a for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:11:20.551585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Deleting port 288de558-83a5-4339-86db-baf8307134b8 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:20.551936 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:20.563236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=9c35d53f-6773-4ce7-9642-3b542a20efa8,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:20.581641 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ced58968-4c96-4d75-8c4a-74fd219deda7 None None] Routers {'2efb0694-c577-4ca8-871f-c4b55760ad4a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:20.590535 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ced58968-4c96-4d75-8c4a-74fd219deda7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2efb0694-c577-4ca8-871f-c4b55760ad4a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:20.615560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 8c301fff-eebe-4ee3-ae47-9da749d76d58 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:20.621936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 8c301fff-eebe-4ee3-ae47-9da749d76d58 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:20.622298 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:20.681183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:20.793869 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3f4833b-dd64-42f1-aeaf-71db889c43ae req-96806c38-a8f2-40f4-a843-66d9e0ec25d3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2853239 May 12 15:11:20.804855 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:20.826543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70bef315-b3a5-4538-9d0f-1fa1af79164b None None] DHCP port deletion for 7869b0da-59f4-4b95-80b3-2cee1e2f3494 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:11:20.828780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-70bef315-b3a5-4538-9d0f-1fa1af79164b None None] Deleting port 288de558-83a5-4339-86db-baf8307134b8 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:20.829216 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-70bef315-b3a5-4538-9d0f-1fa1af79164b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:20.836516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9ee0253-1b12-4a32-ab5c-49953bb7d22d req-d89309c4-ee18-41de-b5dd-b38f106f24a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:20.838094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9ee0253-1b12-4a32-ab5c-49953bb7d22d req-d89309c4-ee18-41de-b5dd-b38f106f24a9 service neutron] 10.222.0.76 "GET /v2.0/networks?id=7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 HTTP/1.1" status: 200 len: 913 time: 0.3851438 May 12 15:11:20.839926 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:20.912326 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:20.975009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89114e47-b925-4b81-87d2-029eb7f8c238 req-4b97a920-0645-497b-8ec7-199f132094c0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:20.984579 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89114e47-b925-4b81-87d2-029eb7f8c238 req-4b97a920-0645-497b-8ec7-199f132094c0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.6031594 May 12 15:11:20.990159 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-ced58968-4c96-4d75-8c4a-74fd219deda7 None None] Set router 2efb0694-c577-4ca8-871f-c4b55760ad4a gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:21.011813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] For port 288de558-83a5-4339-86db-baf8307134b8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=288de558-83a5-4339-86db-baf8307134b8,segment=NetworkSegment(7d065a97-a552-4415-a638-f68219b3bad1),segment_id=7d065a97-a552-4415-a638-f68219b3bad1)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:21.012365 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:21.130500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 8c301fff-eebe-4ee3-ae47-9da749d76d58, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8c301fff-eebe-4ee3-ae47-9da749d76d58,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:21.133043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 288de558-83a5-4339-86db-baf8307134b8 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:11:21.190368 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:21.235049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Calling delete_port for 288de558-83a5-4339-86db-baf8307134b8 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:21.251399 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9ee0253-1b12-4a32-ab5c-49953bb7d22d req-6c772d08-cb32-43ff-9bfb-234604891172 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b916a765-866f-4478-817f-f3e33e79f873 HTTP/1.1" status: 200 len: 1002 time: 0.4042614 May 12 15:11:21.276061 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89114e47-b925-4b81-87d2-029eb7f8c238 req-5a446e19-49c5-405f-a80f-aedd255a3021 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2898891 May 12 15:11:21.319600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-70bef315-b3a5-4538-9d0f-1fa1af79164b None None] For port 288de558-83a5-4339-86db-baf8307134b8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=288de558-83a5-4339-86db-baf8307134b8,segment=NetworkSegment(7d065a97-a552-4415-a638-f68219b3bad1),segment_id=7d065a97-a552-4415-a638-f68219b3bad1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:21.320121 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-70bef315-b3a5-4538-9d0f-1fa1af79164b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:21.396149 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:21.447157 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] No DVR routers for this DVR port 288de558-83a5-4339-86db-baf8307134b8 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:11:21.455372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Pushing event updated for resources: {'Port': ['ID=14990298-685a-4dd8-a308-ee8dcbbb6d93,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:21.483499 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ced58968-4c96-4d75-8c4a-74fd219deda7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50'}], 'enable_snat': True}, 'gw_port_id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:43Z', 'revision_number': 4, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port': {'id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:5a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:34Z', 'updated_at': '2022-05-12T15:09:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5', 'name': '', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'mac_address': 'fa:16:3e:44:ec:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:42Z', 'updated_at': '2022-05-12T15:09:55Z', 'revision_number': 5, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'subnets': [{'id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:21.488236 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ced58968-4c96-4d75-8c4a-74fd219deda7 None None] The sync data for ids ['2efb0694-c577-4ca8-871f-c4b55760ad4a'] in n-d-841483-1 is: [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50'}], 'enable_snat': True}, 'gw_port_id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:09:43Z', 'revision_number': 4, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port': {'id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:5a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:34Z', 'updated_at': '2022-05-12T15:09:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5', 'name': '', 'network_id': 'e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'mac_address': 'fa:16:3e:44:ec:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:42Z', 'updated_at': '2022-05-12T15:09:55Z', 'revision_number': 5, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'subnets': [{'id': '1636e4f2-4025-4f61-a8dd-65adade9e66c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:11:21.501731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Pushing event deleted for resources: {'Port': ['ID=288de558-83a5-4339-86db-baf8307134b8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:21.504111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-70bef315-b3a5-4538-9d0f-1fa1af79164b None None] Calling delete_port for 288de558-83a5-4339-86db-baf8307134b8 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:21.518135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Attempting to bind port 14990298-685a-4dd8-a308-ee8dcbbb6d93 on host n-h1-841483-1 for vnic_type normal with profile {"migrating_to": "n-h2-841483-1"} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:11:21.518382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Attempting to bind port 14990298-685a-4dd8-a308-ee8dcbbb6d93 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:11:21.518707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Attempting to bind port 14990298-685a-4dd8-a308-ee8dcbbb6d93 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:21.523546 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a7a06613-4bea-428d-9118-b4c8b67dcdc2'] response: {'server_uuid': '74ddf043-2cb7-4286-b010-6509b25bb4aa', 'name': 'network-vif-deleted', 'tag': 'a3478c2b-fafc-4acf-abce-c432fa4e874d', 'status': 'completed', 'code': 200} May 12 15:11:21.539539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Port 14990298-685a-4dd8-a308-ee8dcbbb6d93 on network e8211761-0dd9-424f-b732-629fd2d77e28 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:11:21.539539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Attempting to bind port 14990298-685a-4dd8-a308-ee8dcbbb6d93 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:21.571382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:11:21.571717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Checking segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:21.572102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Bound using segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:11:21.572537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Bound port: 14990298-685a-4dd8-a308-ee8dcbbb6d93, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:11:21.572880 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:21.574411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No active binding found for port 288de558-83a5-4339-86db-baf8307134b8 {{(pid=88153) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:224}} May 12 15:11:21.574889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 288de558-83a5-4339-86db-baf8307134b8 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:11:21.586447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9ee0253-1b12-4a32-ab5c-49953bb7d22d req-acf07f9a-962b-4970-8238-468bf2b74980 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:21.587922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9ee0253-1b12-4a32-ab5c-49953bb7d22d req-acf07f9a-962b-4970-8238-468bf2b74980 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=eb51e145-1f59-4ab5-b2f3-a32c2c6ee575 HTTP/1.1" status: 200 len: 851 time: 0.3104255 May 12 15:11:21.599147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=8c301fff-eebe-4ee3-ae47-9da749d76d58,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:21.617166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bedffd1f-e77b-484f-b090-5d8637b7262c no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:11:21.630849 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:11:21.673453 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: bedffd1f-e77b-484f-b090-5d8637b7262c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:11:21.674279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bedffd1f-e77b-484f-b090-5d8637b7262c not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:11:21.699332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-070ff963-66f6-4eb1-a212-791cfbee6794 req-b1ae2efc-9d16-4086-bcfa-32fb21d0d2c0 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:21.706885 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-070ff963-66f6-4eb1-a212-791cfbee6794 req-b1ae2efc-9d16-4086-bcfa-32fb21d0d2c0 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 943 time: 0.6468256 May 12 15:11:21.713074 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-70bef315-b3a5-4538-9d0f-1fa1af79164b None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:11:21.713550 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-70bef315-b3a5-4538-9d0f-1fa1af79164b None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:11:21.734476 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:21.754294 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-90d44923-902d-4916-b53d-073740d88f2d'] response: {'server_uuid': '5ac222f7-bb37-42b6-9a18-0b8a2211c771', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c35d53f-6773-4ce7-9642-3b542a20efa8', 'code': 200} May 12 15:11:21.768353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7869b0da-59f4-4b95-80b3-2cee1e2f3494']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:21.789446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7d065a97-a552-4415-a638-f68219b3bad1') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:21.789745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7d065a97-a552-4415-a638-f68219b3bad1') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:21.807199 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:21.825575 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:21.835598 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Releasing vlan 596 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:11:21.837951 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: timer() May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:11:21.855009 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:11:21.858168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51458) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:21.905472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51462) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:21.910857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'name': 'network-vif-deleted', 'tag': 'bedffd1f-e77b-484f-b090-5d8637b7262c'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:21.917520 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d7c7d86-dcb7-4f54-87c9-e897c2f8f07b None None] New status for floating IP 86ba9930-7249-4cf3-94d1-68180b9f26fa: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:11:22.049164 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-070ff963-66f6-4eb1-a212-791cfbee6794 req-6be029c7-6a81-4621-b6b8-4ee6fa2a6233 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3413808 May 12 15:11:22.150231 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6ea8030-eaae-4b4e-af02-5cac4bbbe951 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:22.156722 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1b6c408c-11b6-4610-b54e-2a76a5505a90'] response: {'server_uuid': '674d52a4-c926-40b2-a4b1-6029fb3c8e10', 'name': 'network-vif-deleted', 'tag': 'bedffd1f-e77b-484f-b090-5d8637b7262c', 'status': 'completed', 'code': 200} May 12 15:11:22.158602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:22.163690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9ee0253-1b12-4a32-ab5c-49953bb7d22d req-43a7b405-1dc1-4d58-b734-84042c1cc04d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:22.165197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9ee0253-1b12-4a32-ab5c-49953bb7d22d req-43a7b405-1dc1-4d58-b734-84042c1cc04d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=7336b0e1-6ae7-4c8a-98e8-3f13adbdc190&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5668113 May 12 15:11:22.180653 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:22.214551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-70bef315-b3a5-4538-9d0f-1fa1af79164b None None] Deleting port 288de558-83a5-4339-86db-baf8307134b8 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:22.215024 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-70bef315-b3a5-4538-9d0f-1fa1af79164b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:22.219236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:22.230030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] Pushing event deleted for resources: {'Network': ['ID=7869b0da-59f4-4b95-80b3-2cee1e2f3494,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:22.253505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9530de2-6e4a-411e-a0bb-6aeac26079df req-73195db2-e9a1-468f-97e2-7ef973a768f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:22.255260 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d9530de2-6e4a-411e-a0bb-6aeac26079df req-73195db2-e9a1-468f-97e2-7ef973a768f0 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=5ac222f7-bb37-42b6-9a18-0b8a2211c771 HTTP/1.1" status: 200 len: 1100 time: 0.3454664 May 12 15:11:22.256889 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8c51a3d7-7019-452e-9b8f-f44274ecdf68 admin admin] 10.222.0.82 "DELETE /v2.0/networks/7869b0da-59f4-4b95-80b3-2cee1e2f3494 HTTP/1.1" status: 204 len: 168 time: 1.9349933 May 12 15:11:22.274796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:11:22.299944 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6ea8030-eaae-4b4e-af02-5cac4bbbe951 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:22.310148 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:22.360622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-70bef315-b3a5-4538-9d0f-1fa1af79164b None None] The port '288de558-83a5-4339-86db-baf8307134b8' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:11:22.394296 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291a30f8-391f-4c11-a522-ec10a3e779af req-93a82930-cf68-4443-ad5d-4a72910cef39 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:22.396068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-291a30f8-391f-4c11-a522-ec10a3e779af req-93a82930-cf68-4443-ad5d-4a72910cef39 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ac222f7-bb37-42b6-9a18-0b8a2211c771 HTTP/1.1" status: 200 len: 949 time: 0.4313085 May 12 15:11:22.411348 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d9530de2-6e4a-411e-a0bb-6aeac26079df req-1344a91c-e50b-4514-be20-01f47086cefd service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0692673 May 12 15:11:22.538635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51480) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:22.640944 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b1e534f8-acb4-4cca-8984-91db085a499b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d914960d703a44ae913f9a1804d5b368&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1010175 May 12 15:11:22.643482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51484) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:22.653636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:22.654228 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:22.655559 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] 10.222.0.76 "PUT /v2.0/ports/14990298-685a-4dd8-a308-ee8dcbbb6d93 HTTP/1.1" status: 200 len: 1121 time: 3.3381355 May 12 15:11:22.658690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25b8369c-976e-44e8-80f4-16a79482dada service neutron] Pushing event updated for resources: {'Port': ['ID=14990298-685a-4dd8-a308-ee8dcbbb6d93,revision_number=8']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:22.695704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-291a30f8-391f-4c11-a522-ec10a3e779af req-09e6ed97-55be-4660-a9c4-6e1fefdbc0e9 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2693665 May 12 15:11:22.697527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9ee0253-1b12-4a32-ab5c-49953bb7d22d req-7cbbf564-ab56-426a-b4f3-103e2b60b92d service neutron] 10.222.0.76 "GET /v2.0/networks/7336b0e1-6ae7-4c8a-98e8-3f13adbdc190?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5154829 May 12 15:11:22.729727 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6ea8030-eaae-4b4e-af02-5cac4bbbe951 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:22.758821 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e67c7539-c804-4110-93d4-fb39fc334460 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:22.792059 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e67c7539-c804-4110-93d4-fb39fc334460 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:22.812820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6ea8030-eaae-4b4e-af02-5cac4bbbe951 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:22.840975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['14990298-685a-4dd8-a308-ee8dcbbb6d93'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:22.848748 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6ea8030-eaae-4b4e-af02-5cac4bbbe951 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:22.850189 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c6ea8030-eaae-4b4e-af02-5cac4bbbe951 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "DELETE /v2.0/security-groups/4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a HTTP/1.1" status: 204 len: 168 time: 0.9142525 May 12 15:11:22.855737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51488) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:22.897754 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-3cb7edc5-0491-4d1e-8d13-97035e795c34 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] show failed (client error): The resource could not be found. May 12 15:11:22.898763 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3cb7edc5-0491-4d1e-8d13-97035e795c34 tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "GET /v2.0/security-groups/4ffd59b3-ca4e-4144-b2f4-202f9b2cfc5a HTTP/1.1" status: 404 len: 347 time: 0.0336411 May 12 15:11:22.901525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51492) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:22.957149 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9024566-5657-4956-bde7-25162542aa95 req-dd031548-6fe7-45d6-bda0-cc871b97f9ff tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:22.958637 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9024566-5657-4956-bde7-25162542aa95 req-dd031548-6fe7-45d6-bda0-cc871b97f9ff tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.3121042 May 12 15:11:22.969335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9ee0253-1b12-4a32-ab5c-49953bb7d22d req-17ed1b48-6414-4a3d-85ca-796cdcbb5b89 service neutron] 10.222.0.76 "GET /v2.0/networks/7336b0e1-6ae7-4c8a-98e8-3f13adbdc190?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2638662 May 12 15:11:23.027758 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9024566-5657-4956-bde7-25162542aa95 req-fdfa9d11-8e90-424f-a862-cd4cb505ce31 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566242 May 12 15:11:23.047547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0fc005e-e8c6-4afd-a097-1f56c97066b0 req-5860c3aa-6f30-4e03-bf40-8b0f3c125c66 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:23.049152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0fc005e-e8c6-4afd-a097-1f56c97066b0 req-5860c3aa-6f30-4e03-bf40-8b0f3c125c66 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 950 time: 0.1914601 May 12 15:11:23.091328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-0fa9a83b-a154-4fc4-ad21-dd60ff2212df tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Deleting port 2a625bd2-a252-451f-af02-b2b448ddc430 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:23.091721 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0fa9a83b-a154-4fc4-ad21-dd60ff2212df tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:23.105696 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0fc005e-e8c6-4afd-a097-1f56c97066b0 req-1403f355-423a-403a-82b0-fbaa3d7705cb tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475779 May 12 15:11:23.120267 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e67c7539-c804-4110-93d4-fb39fc334460 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:23.158944 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-283c736d-8c2d-4d21-b63c-06de988df073 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:23.219365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e67c7539-c804-4110-93d4-fb39fc334460 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b804ef2-2980-4432-9f6e-bc8c33849aac,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:23.269758 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dcb17d4-7f16-4f0d-adc8-77f746ad0f4f req-bd8aae41-b221-49be-a6b0-98b740021c0e tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:23.271504 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1dcb17d4-7f16-4f0d-adc8-77f746ad0f4f req-bd8aae41-b221-49be-a6b0-98b740021c0e tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 943 time: 0.0974460 May 12 15:11:23.332061 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1dcb17d4-7f16-4f0d-adc8-77f746ad0f4f req-ad4de84b-51ae-4aef-967d-3b1fabf1fdda tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473161 May 12 15:11:23.368312 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e67c7539-c804-4110-93d4-fb39fc334460 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:23.369421 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e67c7539-c804-4110-93d4-fb39fc334460 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6b804ef2-2980-4432-9f6e-bc8c33849aac HTTP/1.1" status: 204 len: 168 time: 0.7250400 May 12 15:11:23.524651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '14990298-685a-4dd8-a308-ee8dcbbb6d93'}, {'name': 'network-changed', 'server_uuid': '3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4', 'tag': '14990298-685a-4dd8-a308-ee8dcbbb6d93'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:23.580382 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-66e3b688-ade3-419c-89cf-c65b7cadd3fb'] response: {'server_uuid': '3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '14990298-685a-4dd8-a308-ee8dcbbb6d93', 'code': 200} May 12 15:11:23.580644 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-66e3b688-ade3-419c-89cf-c65b7cadd3fb'] response: {'name': 'network-changed', 'server_uuid': '3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4', 'tag': '14990298-685a-4dd8-a308-ee8dcbbb6d93', 'status': 'completed', 'code': 200} May 12 15:11:23.654254 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0fa9a83b-a154-4fc4-ad21-dd60ff2212df tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:23.654478 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0fa9a83b-a154-4fc4-ad21-dd60ff2212df tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:23.755222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd63a3a59-bf0b-4b7e-ab5a-b1275d00d587', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8c301fff-eebe-4ee3-ae47-9da749d76d58'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:23.834912 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7ba5717d-601f-4dbc-b64b-c408657388f6'] response: {'server_uuid': 'd63a3a59-bf0b-4b7e-ab5a-b1275d00d587', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8c301fff-eebe-4ee3-ae47-9da749d76d58', 'code': 200} May 12 15:11:23.875568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-0fa9a83b-a154-4fc4-ad21-dd60ff2212df tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Calling delete_port for 2a625bd2-a252-451f-af02-b2b448ddc430 owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:24.053584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c29dd8f-7f62-4adf-ae4f-5d4f6132c86f req-f3d693b3-5ec2-40c6-b124-bb0c3511ac8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:24.055274 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c29dd8f-7f62-4adf-ae4f-5d4f6132c86f req-f3d693b3-5ec2-40c6-b124-bb0c3511ac8a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 1124 time: 0.2929397 May 12 15:11:24.075857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93e7c633-6ae8-4fd4-b9de-cbab5281f180 req-188c3f7e-aa0d-4866-9248-9e9efe5f5057 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:24.075857 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93e7c633-6ae8-4fd4-b9de-cbab5281f180 req-188c3f7e-aa0d-4866-9248-9e9efe5f5057 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ac222f7-bb37-42b6-9a18-0b8a2211c771 HTTP/1.1" status: 200 len: 949 time: 0.1900527 May 12 15:11:24.150484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d26447-a221-4c02-98de-2f67635df738 req-03dfe5c7-e49c-4c6d-be73-0cda5ce277df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:24.152139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09d26447-a221-4c02-98de-2f67635df738 req-03dfe5c7-e49c-4c6d-be73-0cda5ce277df service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=d63a3a59-bf0b-4b7e-ab5a-b1275d00d587 HTTP/1.1" status: 200 len: 1101 time: 0.1537726 May 12 15:11:24.175578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93e7c633-6ae8-4fd4-b9de-cbab5281f180 req-1b85d098-fba2-476b-9a47-3ba107fa48c8 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0843658 May 12 15:11:24.239452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-283c736d-8c2d-4d21-b63c-06de988df073 admin admin] Deleting port 317c5178-1ffb-4fde-a98e-8a9fce5e9457 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:24.240081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-283c736d-8c2d-4d21-b63c-06de988df073 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:24.285978 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0fa9a83b-a154-4fc4-ad21-dd60ff2212df tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:24.300584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51528) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:24.373701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fa9a83b-a154-4fc4-ad21-dd60ff2212df tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Pushing event deleted for resources: {'Port': ['ID=2a625bd2-a252-451f-af02-b2b448ddc430,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:24.437853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c29dd8f-7f62-4adf-ae4f-5d4f6132c86f req-de17dbd5-256a-41c1-9b76-bb29f25a791d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:24.439372 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c29dd8f-7f62-4adf-ae4f-5d4f6132c86f req-de17dbd5-256a-41c1-9b76-bb29f25a791d service neutron] 10.222.0.84 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.3711929 May 12 15:11:24.449909 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09d26447-a221-4c02-98de-2f67635df738 req-1ad15733-2901-4df1-8a4e-3b5ed5656fb5 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2722173 May 12 15:11:24.496953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e836362a-e700-458f-b462-c4707119f9e8 req-8476e37d-e013-438e-a69e-273954ac3d2d tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:24.498352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e836362a-e700-458f-b462-c4707119f9e8 req-8476e37d-e013-438e-a69e-273954ac3d2d tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.76 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 950 time: 0.1973846 May 12 15:11:24.511556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2767206c-fdee-4524-b476-952d8051772c req-dcfb3d09-b512-4370-80b9-c468ca25b9d5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:24.512912 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2767206c-fdee-4524-b476-952d8051772c req-dcfb3d09-b512-4370-80b9-c468ca25b9d5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.3364141 May 12 15:11:24.520817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1742418-1067-4eaa-b8c1-8b7971d0d040 req-702e7618-bc68-42d8-92c0-0e8f703ef097 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:24.522249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1742418-1067-4eaa-b8c1-8b7971d0d040 req-702e7618-bc68-42d8-92c0-0e8f703ef097 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 950 time: 0.1827867 May 12 15:11:24.571769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Request body: {'network': {'name': 'tempest-SecurityGroupsNegativeTestJSON-236720540-network', 'tenant_id': '559c5717b8bd444f993099e77a1550ad'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:24.592042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2767206c-fdee-4524-b476-952d8051772c req-4b3fd395-a74e-46c9-8dea-ebe89d57ef68 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688522 May 12 15:11:24.594290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:24.596619 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1742418-1067-4eaa-b8c1-8b7971d0d040 req-d11043ac-58f9-494b-a83e-5713a66bbdb3 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0598476 May 12 15:11:24.619476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Usage tracker for resource:network and tenant:559c5717b8bd444f993099e77a1550ad is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:24.625796 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c29dd8f-7f62-4adf-ae4f-5d4f6132c86f req-2230d7ec-f370-4401-8c42-61b5a87a713b service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93 HTTP/1.1" status: 200 len: 217 time: 0.1074569 May 12 15:11:24.626599 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:24.677168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:24.721973 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0fa9a83b-a154-4fc4-ad21-dd60ff2212df tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:24.747010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Made reservation on behalf of 559c5717b8bd444f993099e77a1550ad for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:24.750545 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:24.772128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c19142-b081-4043-90d5-9e8adeb3dcda req-267a2010-8e8f-4b83-99dd-72352b95a7ea tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:24.773590 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37c19142-b081-4043-90d5-9e8adeb3dcda req-267a2010-8e8f-4b83-99dd-72352b95a7ea tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 943 time: 0.0828962 May 12 15:11:24.777160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-283c736d-8c2d-4d21-b63c-06de988df073 admin admin] For port 317c5178-1ffb-4fde-a98e-8a9fce5e9457, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=317c5178-1ffb-4fde-a98e-8a9fce5e9457,segment=NetworkSegment(96a7c587-eda9-40b0-aaff-97f4e1387d63),segment_id=96a7c587-eda9-40b0-aaff-97f4e1387d63)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:24.777549 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-283c736d-8c2d-4d21-b63c-06de988df073 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:24.786143 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:24.821180 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37c19142-b081-4043-90d5-9e8adeb3dcda req-2f33acce-3509-4dd7-bd15-43c4a5a66889 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412667 May 12 15:11:24.933408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c29dd8f-7f62-4adf-ae4f-5d4f6132c86f req-68797049-8153-4f2f-a64f-3fb23ad4ce6d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:24.934820 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c29dd8f-7f62-4adf-ae4f-5d4f6132c86f req-68797049-8153-4f2f-a64f-3fb23ad4ce6d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.3005097 May 12 15:11:25.083646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:25.098356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-283c736d-8c2d-4d21-b63c-06de988df073 admin admin] Calling delete_port for 317c5178-1ffb-4fde-a98e-8a9fce5e9457 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:25.127348 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0fa9a83b-a154-4fc4-ad21-dd60ff2212df tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:25.128472 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0fa9a83b-a154-4fc4-ad21-dd60ff2212df tempest-ServersTestJSON-1843331450 tempest-ServersTestJSON-1843331450-project] 10.222.0.82 "DELETE /v2.0/floatingips/86ba9930-7249-4cf3-94d1-68180b9f26fa HTTP/1.1" status: 204 len: 168 time: 2.2260714 May 12 15:11:25.131533 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51536) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:25.137970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c29dd8f-7f62-4adf-ae4f-5d4f6132c86f req-acbed801-dfbc-43ff-ade2-def0e33648a1 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1462843 May 12 15:11:25.138861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Usage tracker for resource:security_group_rule and tenant:559c5717b8bd444f993099e77a1550ad is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:25.147939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:25.182080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:25.377196 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c29dd8f-7f62-4adf-ae4f-5d4f6132c86f req-4b29f7b6-06e4-404a-b928-a221dd5fcc68 service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2263889 May 12 15:11:25.514127 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:25.524099 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:25.564551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e77eb3b1-6dff-4f4f-8e16-34649f6fcfb5 req-90b4f537-e481-4eb2-990a-28f88c2f4bf7 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:25.566030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e77eb3b1-6dff-4f4f-8e16-34649f6fcfb5 req-90b4f537-e481-4eb2-990a-28f88c2f4bf7 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ac222f7-bb37-42b6-9a18-0b8a2211c771 HTTP/1.1" status: 200 len: 949 time: 0.2620912 May 12 15:11:25.631668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 575} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:11:25.646980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87badfca-2b50-404e-815a-f0b6fd99d05d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:25.659364 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c29dd8f-7f62-4adf-ae4f-5d4f6132c86f req-901023f8-f0d2-4fee-81b1-fe419bf39e79 service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2703257 May 12 15:11:25.666138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:25.669997 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Added segment 69cf54ae-18f4-43ac-837f-52b48569d732 of type vlan for network 0b39d5f2-b0b5-4752-8aee-53a71c6a1a5b May 12 15:11:25.681864 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-283c736d-8c2d-4d21-b63c-06de988df073 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:25.721003 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e77eb3b1-6dff-4f4f-8e16-34649f6fcfb5 req-2ecb9a41-ff69-4282-98e5-fd473a667a84 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1434870 May 12 15:11:25.738670 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:25.751222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-283c736d-8c2d-4d21-b63c-06de988df073 admin admin] Pushing event deleted for resources: {'Port': ['ID=317c5178-1ffb-4fde-a98e-8a9fce5e9457,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:25.864713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:25.865668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:25.866273 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:25.980794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4b81c54-826b-4428-b73c-3b2437dbe1fc req-8de5aacb-b0c4-4a5c-b08e-9b395b483f8f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:25.982335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4b81c54-826b-4428-b73c-3b2437dbe1fc req-8de5aacb-b0c4-4a5c-b08e-9b395b483f8f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.2515066 May 12 15:11:26.024489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04416ae0-2426-4dba-be84-21a64a699acd req-2322b641-68ae-455c-ad9c-fc3ac5459dbe tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:26.025968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04416ae0-2426-4dba-be84-21a64a699acd req-2322b641-68ae-455c-ad9c-fc3ac5459dbe tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 950 time: 0.1866384 May 12 15:11:26.073988 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4b81c54-826b-4428-b73c-3b2437dbe1fc req-9cab5c40-de70-4952-8c10-8e4a2bde4dda tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0838842 May 12 15:11:26.121424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] Pushing event updated for resources: {'Network': ['ID=0b39d5f2-b0b5-4752-8aee-53a71c6a1a5b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:26.136431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 0b39d5f2-b0b5-4752-8aee-53a71c6a1a5b details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:11:26.137271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c7f6f0cc-c04b-4de6-9f56-1e30fc71781e admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 1.8068535 May 12 15:11:26.141408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51552) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:26.145671 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04416ae0-2426-4dba-be84-21a64a699acd req-be88b202-0fe3-422d-b9ce-61df80ed7992 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1054807 May 12 15:11:26.148521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Request body: {'subnet': {'network_id': '0b39d5f2-b0b5-4752-8aee-53a71c6a1a5b', 'cidr': '172.20.0.0/28', 'name': 'tempest-SecurityGroupsNegativeTestJSON-236720540-subnet', 'tenant_id': '559c5717b8bd444f993099e77a1550ad', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:26.162350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:26.171025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Usage tracker for resource:subnet and tenant:559c5717b8bd444f993099e77a1550ad is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:26.175954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:26.182660 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-283c736d-8c2d-4d21-b63c-06de988df073 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:26.184833 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-548578e9-4153-47a5-9ccf-ac88a096d0a5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:26.188461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:26.276310 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Made reservation on behalf of 559c5717b8bd444f993099e77a1550ad for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:26.278619 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:26.327957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 14990298-685a-4dd8-a308-ee8dcbbb6d93 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:11:26.486424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:26.501310 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 14990298-685a-4dd8-a308-ee8dcbbb6d93 has no active binding in host n-h2-841483-1 {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:142}} May 12 15:11:26.633341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d8914c8-4f67-4246-a743-11ac91843ad2 req-01741477-ccef-45d1-b36d-0494c4207ec6 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:26.634875 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d8914c8-4f67-4246-a743-11ac91843ad2 req-01741477-ccef-45d1-b36d-0494c4207ec6 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 943 time: 0.3502393 May 12 15:11:26.651718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0866df1d-bf05-4ef4-99c5-7263418e1445 req-67b3428a-dc2c-4041-b681-21dab7cd5cae tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:26.653074 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0866df1d-bf05-4ef4-99c5-7263418e1445 req-67b3428a-dc2c-4041-b681-21dab7cd5cae tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=d63a3a59-bf0b-4b7e-ab5a-b1275d00d587 HTTP/1.1" status: 200 len: 950 time: 0.3203914 May 12 15:11:26.734427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d8914c8-4f67-4246-a743-11ac91843ad2 req-b2589495-1a41-42f9-927f-8ed067aaf2dc tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0912120 May 12 15:11:26.743721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0866df1d-bf05-4ef4-99c5-7263418e1445 req-daa95156-e6d9-450d-be75-da4e4ecf381a tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0752840 May 12 15:11:26.826071 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-548578e9-4153-47a5-9ccf-ac88a096d0a5 admin admin] Deleting port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:26.826402 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-548578e9-4153-47a5-9ccf-ac88a096d0a5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:26.881571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-283c736d-8c2d-4d21-b63c-06de988df073 admin admin] Router 405f5f48-a239-4c20-a0c9-dd825327abd0 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:11:26.884749 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:27.054420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Pushing event updated for resources: {'Subnet': ['ID=36bb0ea1-1ce7-4f3a-b522-a55676fb13b2,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:27.068108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Checking segment: {'id': '69cf54ae-18f4-43ac-837f-52b48569d732', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': '0b39d5f2-b0b5-4752-8aee-53a71c6a1a5b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:27.068476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Network hostable DHCP agents. Network: 0b39d5f2-b0b5-4752-8aee-53a71c6a1a5b, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:11:27.132213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-548578e9-4153-47a5-9ccf-ac88a096d0a5 admin admin] For port 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5,segment=NetworkSegment(5557610c-85a4-4c18-8793-b6867e2cb17c),segment_id=5557610c-85a4-4c18-8793-b6867e2cb17c)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:27.132588 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-548578e9-4153-47a5-9ccf-ac88a096d0a5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:27.175606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Network 0b39d5f2-b0b5-4752-8aee-53a71c6a1a5b is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:11:27.185979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-283c736d-8c2d-4d21-b63c-06de988df073 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:11:27.197369 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12d4545b-eae7-45d5-8a42-2630e563cbe5 None None] Sync routers for ids ['405f5f48-a239-4c20-a0c9-dd825327abd0'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:11:27.202970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-283c736d-8c2d-4d21-b63c-06de988df073 admin admin] 10.222.0.82 "PUT /v2.0/routers/405f5f48-a239-4c20-a0c9-dd825327abd0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.3396888 May 12 15:11:27.205431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 0b39d5f2-b0b5-4752-8aee-53a71c6a1a5b) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:27.206995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51562) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:27.215159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1027a162-4422-4eb8-b7c1-b7e52ed62ad1 None None] Network 0b39d5f2-b0b5-4752-8aee-53a71c6a1a5b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:11:27.226446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:27.227064 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:27.228736 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12d4545b-eae7-45d5-8a42-2630e563cbe5 None None] Routers {'405f5f48-a239-4c20-a0c9-dd825327abd0'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:27.229362 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-12d4545b-eae7-45d5-8a42-2630e563cbe5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['405f5f48-a239-4c20-a0c9-dd825327abd0'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:27.267938 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-00ad6b19-906c-498d-bf6f-8c314ea6e40e admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 857 time: 1.1253834 May 12 15:11:27.337790 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-548578e9-4153-47a5-9ccf-ac88a096d0a5 admin admin] Calling delete_port for 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:27.554602 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-12d4545b-eae7-45d5-8a42-2630e563cbe5 None None] Set router 405f5f48-a239-4c20-a0c9-dd825327abd0 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:27.569557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-379daafa-8571-4d7a-98b5-35169c2aadc9 None None] Network 0b39d5f2-b0b5-4752-8aee-53a71c6a1a5b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:11:27.787414 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:27.838115 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Deleting port a5a0bcd7-b21d-42b5-9b81-e250cd922e03 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:27.838447 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:27.882645 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-12d4545b-eae7-45d5-8a42-2630e563cbe5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:11:25Z', 'revision_number': 5, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:27.886502 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12d4545b-eae7-45d5-8a42-2630e563cbe5 None None] Checking router: 405f5f48-a239-4c20-a0c9-dd825327abd0 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:11:27.896012 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12d4545b-eae7-45d5-8a42-2630e563cbe5 None None] Routers {'405f5f48-a239-4c20-a0c9-dd825327abd0'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:27.896602 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-12d4545b-eae7-45d5-8a42-2630e563cbe5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['405f5f48-a239-4c20-a0c9-dd825327abd0'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:28.014148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63dd104a-95e0-42b4-908a-1fc1d9b86ffe req-c0f5241b-f8c3-4d7b-9823-7ce742325975 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:28.016131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63dd104a-95e0-42b4-908a-1fc1d9b86ffe req-c0f5241b-f8c3-4d7b-9823-7ce742325975 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 950 time: 0.5626700 May 12 15:11:28.078373 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-12d4545b-eae7-45d5-8a42-2630e563cbe5 None None] Set router 405f5f48-a239-4c20-a0c9-dd825327abd0 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:28.105858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f029fa7-5cf3-4008-b66b-ea3396dd4baf req-f7712896-cba1-4d4e-92cd-a20c0cfda7cc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:28.107265 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f029fa7-5cf3-4008-b66b-ea3396dd4baf req-f7712896-cba1-4d4e-92cd-a20c0cfda7cc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.5828135 May 12 15:11:28.255878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63dd104a-95e0-42b4-908a-1fc1d9b86ffe req-7ee47ff1-8f9e-4742-9dfe-e7ab8faf1523 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2100494 May 12 15:11:28.257151 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:28.262468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a5a0bcd7-b21d-42b5-9b81-e250cd922e03 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:11:28.387734 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-12d4545b-eae7-45d5-8a42-2630e563cbe5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:11:25Z', 'revision_number': 5, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:28.393599 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12d4545b-eae7-45d5-8a42-2630e563cbe5 None None] The sync data for ids ['405f5f48-a239-4c20-a0c9-dd825327abd0'] in n-d-841483-1 is: [{'id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'name': 'tempest-ServerRescueTestJSONUnderV235-1220743085-router', 'tenant_id': 'fd97c932be3143b1846bb48363040c63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:19Z', 'updated_at': '2022-05-12T15:11:25Z', 'revision_number': 5, 'project_id': 'fd97c932be3143b1846bb48363040c63', 'gw_port': {'id': '38259385-54e1-4178-becc-b82fe7cde7a2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:00:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '405f5f48-a239-4c20-a0c9-dd825327abd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 643, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:22Z', 'updated_at': '2022-05-12T15:09:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:11:28.466491 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:28.479858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] Deleting port 38259385-54e1-4178-becc-b82fe7cde7a2 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:28.480184 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:28.494987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5fa19168-fc7f-4f74-8443-7b0c98ad2c18', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a5a0bcd7-b21d-42b5-9b81-e250cd922e03'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:28.504543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a5a0bcd7-b21d-42b5-9b81-e250cd922e03, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5a0bcd7-b21d-42b5-9b81-e250cd922e03,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:28.508281 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:28.516053 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f029fa7-5cf3-4008-b66b-ea3396dd4baf req-e064aea9-ce48-4f1b-9f15-6eff573b96a7 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3967383 May 12 15:11:28.546823 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-6ecc85e0-33d0-4472-b67d-cc37e85f140c req-98577b0d-8f01-408e-a6e4-feea8d966e87 tempest-SecurityGroupsNegativeTestJSON-2038926396 tempest-SecurityGroupsNegativeTestJSON-2038926396-project] show failed (client error): The resource could not be found. May 12 15:11:28.547828 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ecc85e0-33d0-4472-b67d-cc37e85f140c req-98577b0d-8f01-408e-a6e4-feea8d966e87 tempest-SecurityGroupsNegativeTestJSON-2038926396 tempest-SecurityGroupsNegativeTestJSON-2038926396-project] 10.222.0.82 "GET /v2.0/security-groups/2e631000-d97e-4ffe-b6ad-82ce4ac9a2e5 HTTP/1.1" status: 404 len: 352 time: 0.0887179 May 12 15:11:28.598315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a5a0bcd7-b21d-42b5-9b81-e250cd922e03,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:28.600648 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-548578e9-4153-47a5-9ccf-ac88a096d0a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:28.696373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] For port a5a0bcd7-b21d-42b5-9b81-e250cd922e03, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5a0bcd7-b21d-42b5-9b81-e250cd922e03,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:28.696641 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:28.758307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-548578e9-4153-47a5-9ccf-ac88a096d0a5 admin admin] Pushing event deleted for resources: {'Port': ['ID=7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:28.958037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Calling delete_port for a5a0bcd7-b21d-42b5-9b81-e250cd922e03 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:29.096412 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 317c5178-1ffb-4fde-a98e-8a9fce5e9457 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:11:29.132202 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 317c5178-1ffb-4fde-a98e-8a9fce5e9457 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:11:29.132458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 317c5178-1ffb-4fde-a98e-8a9fce5e9457 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:11:29.161941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] For port 38259385-54e1-4178-becc-b82fe7cde7a2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=38259385-54e1-4178-becc-b82fe7cde7a2,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:29.162293 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:29.331428 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-b914024a-164d-44d2-a8a9-d7dbefa88a48 service neutron] 10.222.0.84 "GET /v2.0/ports/14990298-685a-4dd8-a308-ee8dcbbb6d93/bindings/n-h2-841483-1 HTTP/1.1" status: 200 len: 384 time: 0.0911233 May 12 15:11:29.377655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] Calling delete_port for 38259385-54e1-4178-becc-b82fe7cde7a2 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:29.418956 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:11:29.419268 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:11:29.435801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af184ac4-d59f-42a6-932f-5652e19c161b req-c3ac82d3-3fd4-4dfc-beb4-cadc3e8a7eb0 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:29.438024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af184ac4-d59f-42a6-932f-5652e19c161b req-c3ac82d3-3fd4-4dfc-beb4-cadc3e8a7eb0 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=d63a3a59-bf0b-4b7e-ab5a-b1275d00d587 HTTP/1.1" status: 200 len: 950 time: 0.7282615 May 12 15:11:29.450056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63c81d02-9d64-4bbc-b2ca-25d4093d3a5f req-0450a16d-52d3-46f5-930f-babea3e7692d tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:29.451533 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63c81d02-9d64-4bbc-b2ca-25d4093d3a5f req-0450a16d-52d3-46f5-930f-babea3e7692d tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 943 time: 0.7592070 May 12 15:11:29.598443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-9d087b7d-f36e-43d8-82c9-58e18755fb0e service neutron] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:29.620456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-9d087b7d-f36e-43d8-82c9-58e18755fb0e service neutron] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:29.642022 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-548578e9-4153-47a5-9ccf-ac88a096d0a5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:29.647598 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af184ac4-d59f-42a6-932f-5652e19c161b req-4456a6ba-45bb-476e-b8e3-b1fb192e50ef tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1909981 May 12 15:11:29.652688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63c81d02-9d64-4bbc-b2ca-25d4093d3a5f req-e57d49b5-e13b-4a91-9eed-613df1737116 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1248477 May 12 15:11:29.687434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-9d087b7d-f36e-43d8-82c9-58e18755fb0e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 14990298-685a-4dd8-a308-ee8dcbbb6d93 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:11:29.705027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-9d087b7d-f36e-43d8-82c9-58e18755fb0e service neutron] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:29.722249 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-9d087b7d-f36e-43d8-82c9-58e18755fb0e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:29.763264 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-dfb37903-bc7a-449e-834a-51e9ba7169fa'] response: {'server_uuid': '5fa19168-fc7f-4f74-8443-7b0c98ad2c18', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a5a0bcd7-b21d-42b5-9b81-e250cd922e03', 'code': 200} May 12 15:11:29.877180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-9d087b7d-f36e-43d8-82c9-58e18755fb0e service neutron] Transition to ACTIVE for port object 14990298-685a-4dd8-a308-ee8dcbbb6d93 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:29.881157 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-9d087b7d-f36e-43d8-82c9-58e18755fb0e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:29.990792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Deleting port a5a0bcd7-b21d-42b5-9b81-e250cd922e03 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:29.991186 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:30.045354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-9d087b7d-f36e-43d8-82c9-58e18755fb0e service neutron] No DVR routers for this DVR port 14990298-685a-4dd8-a308-ee8dcbbb6d93 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:11:30.052763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d087b7d-f36e-43d8-82c9-58e18755fb0e service neutron] Pushing event updated for resources: {'Port': ['ID=14990298-685a-4dd8-a308-ee8dcbbb6d93,revision_number=10']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:30.097531 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-9d087b7d-f36e-43d8-82c9-58e18755fb0e service neutron] 10.222.0.84 "PUT /v2.0/ports/14990298-685a-4dd8-a308-ee8dcbbb6d93/bindings/n-h2-841483-1/activate HTTP/1.1" status: 200 len: 369 time: 0.7601216 May 12 15:11:30.534904 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:30.607502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] Pushing event deleted for resources: {'Port': ['ID=38259385-54e1-4178-becc-b82fe7cde7a2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:30.718991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-432480c1-6a62-4f94-a694-b51281e27eda req-2db290b1-9fb3-4df1-ab9e-e72c33bcae52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:30.720416 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-432480c1-6a62-4f94-a694-b51281e27eda req-2db290b1-9fb3-4df1-ab9e-e72c33bcae52 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.6984570 May 12 15:11:30.727530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a83ef42-557d-450a-9ee0-0f6c290c7600 req-29a5ed13-84fe-4218-87df-ae49bdc126c6 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:30.728868 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a83ef42-557d-450a-9ee0-0f6c290c7600 req-29a5ed13-84fe-4218-87df-ae49bdc126c6 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 948 time: 0.7085812 May 12 15:11:30.880956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] For port a5a0bcd7-b21d-42b5-9b81-e250cd922e03, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5a0bcd7-b21d-42b5-9b81-e250cd922e03,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:30.881225 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:30.917133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-e0b09a10-6f77-4d34-89ab-ab5486cc6df8 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:30.918621 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-e0b09a10-6f77-4d34-89ab-ab5486cc6df8 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4&tenant_id=68c66ae0cd45476b87e2e79625b80f69&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1095 time: 0.6782467 May 12 15:11:31.081420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-548578e9-4153-47a5-9ccf-ac88a096d0a5 admin admin] Router 2efb0694-c577-4ca8-871f-c4b55760ad4a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:11:31.088584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Calling delete_port for a5a0bcd7-b21d-42b5-9b81-e250cd922e03 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:31.125599 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-432480c1-6a62-4f94-a694-b51281e27eda req-41883264-bb70-482c-9c7f-a910f6cc9460 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3708577 May 12 15:11:31.126657 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:31.178973 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a83ef42-557d-450a-9ee0-0f6c290c7600 req-5ae84eb5-e040-4c7b-a361-fd35151cfb0b tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4202096 May 12 15:11:31.572015 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:31.599373 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:31.647527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 14990298-685a-4dd8-a308-ee8dcbbb6d93 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:11:31.685997 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5dfb1285-e713-4212-9994-d1c663f4888a req-fd1f1674-44a5-49e0-b5d2-5aea205d9c96 tempest-SecurityGroupsNegativeTestJSON-2038926396 tempest-SecurityGroupsNegativeTestJSON-2038926396-project] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=559c5717b8bd444f993099e77a1550ad HTTP/1.1" status: 200 len: 2984 time: 0.5058656 May 12 15:11:31.708182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 14990298-685a-4dd8-a308-ee8dcbbb6d93 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:11:31.729897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:31.730408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 405f5f48-a239-4c20-a0c9-dd825327abd0 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:11:31.860839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-5438d473-5b44-4fda-9c64-93169adc5975 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:31.862331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-5438d473-5b44-4fda-9c64-93169adc5975 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4&tenant_id=68c66ae0cd45476b87e2e79625b80f69 HTTP/1.1" status: 200 len: 1095 time: 0.8796625 May 12 15:11:31.966457 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:31.978074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65f42606-c627-4225-8cea-d6313917d2f5 req-de06e36a-7fef-4eda-82c4-29f9f5517d8b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:31.979518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65f42606-c627-4225-8cea-d6313917d2f5 req-de06e36a-7fef-4eda-82c4-29f9f5517d8b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 944 time: 0.5214071 May 12 15:11:31.981454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-548578e9-4153-47a5-9ccf-ac88a096d0a5 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:11:31.981624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['e8c30887-a54f-44a8-af0a-122711662e1e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:31.990237 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5dfb1285-e713-4212-9994-d1c663f4888a req-881acc12-4e1d-45a4-a502-57762c30269c tempest-SecurityGroupsNegativeTestJSON-2038926396 tempest-SecurityGroupsNegativeTestJSON-2038926396-project] 10.222.0.82 "GET /v2.0/security-groups/87badfca-2b50-404e-815a-f0b6fd99d05d HTTP/1.1" status: 200 len: 2981 time: 0.2689190 May 12 15:11:32.019672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c877509-9538-4ffa-bd78-8038b6d1faff None None] Sync routers for ids ['2efb0694-c577-4ca8-871f-c4b55760ad4a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:11:32.024664 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-548578e9-4153-47a5-9ccf-ac88a096d0a5 admin admin] 10.222.0.82 "PUT /v2.0/routers/2efb0694-c577-4ca8-871f-c4b55760ad4a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.8920672 May 12 15:11:32.028131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51592) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:32.035066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:32.038491 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d785b339-8573-467a-9ee4-edeae5e273a2 admin admin] 10.222.0.82 "DELETE /v2.0/routers/405f5f48-a239-4c20-a0c9-dd825327abd0 HTTP/1.1" status: 204 len: 168 time: 4.8282270 May 12 15:11:32.063663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c877509-9538-4ffa-bd78-8038b6d1faff None None] Routers {'2efb0694-c577-4ca8-871f-c4b55760ad4a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:32.064283 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4c877509-9538-4ffa-bd78-8038b6d1faff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2efb0694-c577-4ca8-871f-c4b55760ad4a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:32.071088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51596) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:32.073820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Pushing event deleted for resources: {'Port': ['ID=a5a0bcd7-b21d-42b5-9b81-e250cd922e03,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:32.138407 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:32.265145 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:32.318498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] No DVR routers for this DVR port a5a0bcd7-b21d-42b5-9b81-e250cd922e03 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:11:32.337430 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65f42606-c627-4225-8cea-d6313917d2f5 req-ff8fa5b1-bec8-4a0b-9e63-121a8bfd708a tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3162339 May 12 15:11:32.338454 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:32.340762 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e836362a-e700-458f-b462-c4707119f9e8 req-75f82db1-69c4-422a-9789-4adfeb85b327 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.76 "DELETE /v2.0/ports/a5a0bcd7-b21d-42b5-9b81-e250cd922e03 HTTP/1.1" status: 204 len: 173 time: 4.7093122 May 12 15:11:32.344980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5fa19168-fc7f-4f74-8443-7b0c98ad2c18', 'name': 'network-vif-deleted', 'tag': 'a5a0bcd7-b21d-42b5-9b81-e250cd922e03'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:32.368808 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5dfb1285-e713-4212-9994-d1c663f4888a req-5348db70-8ee5-4012-b22b-c692caa54129 tempest-SecurityGroupsNegativeTestJSON-2038926396 tempest-SecurityGroupsNegativeTestJSON-2038926396-project] 10.222.0.82 "GET /v2.0/security-groups/87badfca-2b50-404e-815a-f0b6fd99d05d HTTP/1.1" status: 200 len: 2981 time: 0.3431580 May 12 15:11:32.381195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-cba2a5e3-aea9-4e2a-9a3c-03f05e244fbe admin admin] Deleting subnet 8de7231c-cca8-4041-a1ba-b8eba5dd5861 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:11:32.395036 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cba2a5e3-aea9-4e2a-9a3c-03f05e244fbe admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:32.396651 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-4c877509-9538-4ffa-bd78-8038b6d1faff None None] Set router 2efb0694-c577-4ca8-871f-c4b55760ad4a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:32.461269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-a8209e1e-0324-40d4-a8eb-449de4cf66b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:32.463153 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-a8209e1e-0324-40d4-a8eb-449de4cf66b6 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 1095 time: 0.5582922 May 12 15:11:32.477218 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cba2a5e3-aea9-4e2a-9a3c-03f05e244fbe admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:32.729773 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cba2a5e3-aea9-4e2a-9a3c-03f05e244fbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:32.730762 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:32.743065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] Deleting port 3e3227c7-431d-48ce-8a34-1d616d5ac800 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:32.743407 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:32.838324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-dc0c3398-230d-4ee4-ad9a-9dda1b51de58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:32.839764 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-dc0c3398-230d-4ee4-ad9a-9dda1b51de58 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.3651965 May 12 15:11:32.853758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4c877509-9538-4ffa-bd78-8038b6d1faff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50'}], 'enable_snat': True}, 'gw_port_id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:11:28Z', 'revision_number': 5, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port': {'id': '3e3227c7-431d-48ce-8a34-1d616d5ac800', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:5a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:09:34Z', 'updated_at': '2022-05-12T15:09:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:32.857723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c877509-9538-4ffa-bd78-8038b6d1faff None None] Checking router: 2efb0694-c577-4ca8-871f-c4b55760ad4a for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:11:32.867194 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c877509-9538-4ffa-bd78-8038b6d1faff None None] Routers {'2efb0694-c577-4ca8-871f-c4b55760ad4a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:32.867800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4c877509-9538-4ffa-bd78-8038b6d1faff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2efb0694-c577-4ca8-871f-c4b55760ad4a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:32.923188 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-6929b057-483b-46b9-8ee0-d4cffd7f14ad service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93 HTTP/1.1" status: 200 len: 217 time: 0.0750687 May 12 15:11:32.929559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] For port 3e3227c7-431d-48ce-8a34-1d616d5ac800, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3e3227c7-431d-48ce-8a34-1d616d5ac800,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:32.929918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:32.934213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3630198c-4bc3-42d0-b12d-2f667212e148 req-e59c1120-cc54-483b-b6f9-1ce860214d20 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:32.941934 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3630198c-4bc3-42d0-b12d-2f667212e148 req-e59c1120-cc54-483b-b6f9-1ce860214d20 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=d63a3a59-bf0b-4b7e-ab5a-b1275d00d587 HTTP/1.1" status: 200 len: 950 time: 0.3462505 May 12 15:11:32.997888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e05d03-a105-4f40-a7d4-687456c97742 req-a4a80b25-7739-47f0-a845-e9f30934bf1b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:33.004881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39e05d03-a105-4f40-a7d4-687456c97742 req-a4a80b25-7739-47f0-a845-e9f30934bf1b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.4103150 May 12 15:11:33.027428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-4c877509-9538-4ffa-bd78-8038b6d1faff None None] Set router 2efb0694-c577-4ca8-871f-c4b55760ad4a gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:33.044703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cba2a5e3-aea9-4e2a-9a3c-03f05e244fbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:33.111281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cba2a5e3-aea9-4e2a-9a3c-03f05e244fbe admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8de7231c-cca8-4041-a1ba-b8eba5dd5861,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:33.129121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39e05d03-a105-4f40-a7d4-687456c97742 req-cd212faf-0ac3-4b31-97c5-189c98ac32f0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1233554 May 12 15:11:33.130812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] Calling delete_port for 3e3227c7-431d-48ce-8a34-1d616d5ac800 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:33.138340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 38259385-54e1-4178-becc-b82fe7cde7a2 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:11:33.152937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-ee4a0d5d-8e95-4cc5-97fd-f2414f40cc63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:33.154711 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-ee4a0d5d-8e95-4cc5-97fd-f2414f40cc63 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.2095234 May 12 15:11:33.159145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3630198c-4bc3-42d0-b12d-2f667212e148 req-8bdbe76d-436d-4f4e-89f7-3e6f1d25c633 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2162597 May 12 15:11:33.160666 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cba2a5e3-aea9-4e2a-9a3c-03f05e244fbe admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:33.246811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 38259385-54e1-4178-becc-b82fe7cde7a2 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:11:33.247052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 38259385-54e1-4178-becc-b82fe7cde7a2 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:11:33.249663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4c877509-9538-4ffa-bd78-8038b6d1faff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:11:32Z', 'revision_number': 6, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:33.255226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c877509-9538-4ffa-bd78-8038b6d1faff None None] The sync data for ids ['2efb0694-c577-4ca8-871f-c4b55760ad4a'] in n-d-841483-1 is: [{'id': '2efb0694-c577-4ca8-871f-c4b55760ad4a', 'name': 'tempest-ServersTestJSON-1452749819-router', 'tenant_id': '982e4927ecc048a1a769000f4c067d06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:09:32Z', 'updated_at': '2022-05-12T15:11:32Z', 'revision_number': 6, 'project_id': '982e4927ecc048a1a769000f4c067d06', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:11:33.401537 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6a935390-28c2-4826-be33-50dbbe18b1f0'] response: {'server_uuid': '5fa19168-fc7f-4f74-8443-7b0c98ad2c18', 'name': 'network-vif-deleted', 'tag': 'a5a0bcd7-b21d-42b5-9b81-e250cd922e03', 'status': 'completed', 'code': 200} May 12 15:11:33.425268 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:33.451064 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-a90e39fd-ad7a-47f5-8e6d-13a3e785ed81 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2863512 May 12 15:11:33.459721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cba2a5e3-aea9-4e2a-9a3c-03f05e244fbe admin admin] 10.222.0.82 "DELETE /v2.0/subnets/8de7231c-cca8-4041-a1ba-b8eba5dd5861 HTTP/1.1" status: 204 len: 168 time: 1.3837738 May 12 15:11:33.462651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51612) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:33.497002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] Pushing event deleted for resources: {'Port': ['ID=3e3227c7-431d-48ce-8a34-1d616d5ac800,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:33.498511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3425960b-271f-4f74-b51c-e577a300b19b req-cbc41810-8d5b-42bb-9f30-80a6da26a7b9 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Synchronizing usage tracker for tenant:8a871ef1e9124e35b230ac65e37bd02e on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:11:33.594393 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12b11ef2-9b46-462d-a7ad-a7ea5b0b6f70 req-e6e4c216-84e2-41a9-a87f-ce5fdf2df210 tempest-SecurityGroupsNegativeTestJSON-2038926396 tempest-SecurityGroupsNegativeTestJSON-2038926396-project] 10.222.0.82 "GET /v2.0/security-groups/87badfca-2b50-404e-815a-f0b6fd99d05d HTTP/1.1" status: 200 len: 2981 time: 0.1908910 May 12 15:11:33.605700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3425960b-271f-4f74-b51c-e577a300b19b req-cbc41810-8d5b-42bb-9f30-80a6da26a7b9 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Unset dirty status for tenant:8a871ef1e9124e35b230ac65e37bd02e on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:11:33.606784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3425960b-271f-4f74-b51c-e577a300b19b req-cbc41810-8d5b-42bb-9f30-80a6da26a7b9 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fa19168-fc7f-4f74-8443-7b0c98ad2c18 HTTP/1.1" status: 200 len: 210 time: 0.2070923 May 12 15:11:33.692363 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d58f222f-6389-4e8b-b97b-8bb8bc236445 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:33.696919 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-a7dfbdf8-75d3-4f4e-a9a5-f04da15fa05c service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2254367 May 12 15:11:33.697480 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:33.743530 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-12b11ef2-9b46-462d-a7ad-a7ea5b0b6f70 req-4268b028-3306-4ab9-b839-566692b481c3 tempest-SecurityGroupsNegativeTestJSON-2038926396 tempest-SecurityGroupsNegativeTestJSON-2038926396-project] delete failed (client error): There was a conflict when trying to complete your request. May 12 15:11:33.744554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12b11ef2-9b46-462d-a7ad-a7ea5b0b6f70 req-4268b028-3306-4ab9-b839-566692b481c3 tempest-SecurityGroupsNegativeTestJSON-2038926396 tempest-SecurityGroupsNegativeTestJSON-2038926396-project] 10.222.0.82 "DELETE /v2.0/security-groups/87badfca-2b50-404e-815a-f0b6fd99d05d HTTP/1.1" status: 409 len: 352 time: 0.1421859 May 12 15:11:33.871417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-03ca0449-7da3-4fc0-ab45-7c8223308d57 service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1599846 May 12 15:11:33.950080 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:33.954620 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.012332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e103a8df-c377-4c7e-a979-70389b83d547 req-6bde7817-d753-41ce-b8b2-a167b418b28b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:34.013831 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e103a8df-c377-4c7e-a979-70389b83d547 req-6bde7817-d753-41ce-b8b2-a167b418b28b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 944 time: 0.1450469 May 12 15:11:34.043510 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d58f222f-6389-4e8b-b97b-8bb8bc236445 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.069412 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.070053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 2efb0694-c577-4ca8-871f-c4b55760ad4a {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:11:34.076722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d58f222f-6389-4e8b-b97b-8bb8bc236445 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['74c45f45-b34b-4876-a35b-8ae714cf4d5f']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:34.079245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3474c69-4f65-49ed-bd02-b2372b00008d req-8ac15042-78c1-43f3-9da6-fc1b2968d3c8 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:34.089096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3474c69-4f65-49ed-bd02-b2372b00008d req-8ac15042-78c1-43f3-9da6-fc1b2968d3c8 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:34.090727 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3474c69-4f65-49ed-bd02-b2372b00008d req-8ac15042-78c1-43f3-9da6-fc1b2968d3c8 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ac222f7-bb37-42b6-9a18-0b8a2211c771&device_id=d63a3a59-bf0b-4b7e-ab5a-b1275d00d587 HTTP/1.1" status: 200 len: 1690 time: 0.1506579 May 12 15:11:34.097234 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e103a8df-c377-4c7e-a979-70389b83d547 req-db2bab1f-3670-4085-bcfd-c7c471a4b5be tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731025 May 12 15:11:34.102264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d58f222f-6389-4e8b-b97b-8bb8bc236445 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '96a7c587-eda9-40b0-aaff-97f4e1387d63') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:34.102553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d58f222f-6389-4e8b-b97b-8bb8bc236445 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '96a7c587-eda9-40b0-aaff-97f4e1387d63') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:34.115296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.116571 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3b749d43-64cf-4981-9ed3-30da76a8c670 admin admin] 10.222.0.82 "DELETE /v2.0/routers/2efb0694-c577-4ca8-871f-c4b55760ad4a HTTP/1.1" status: 204 len: 168 time: 2.0866721 May 12 15:11:34.120756 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d58f222f-6389-4e8b-b97b-8bb8bc236445 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.124427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51618) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:34.159208 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d58f222f-6389-4e8b-b97b-8bb8bc236445 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.168249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d58f222f-6389-4e8b-b97b-8bb8bc236445 admin admin] Releasing vlan 580 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:11:34.168663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d58f222f-6389-4e8b-b97b-8bb8bc236445 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: timer() May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:11:34.190222 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:11:34.216621 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3474c69-4f65-49ed-bd02-b2372b00008d req-7a35cd7f-4c2a-4011-b0e2-ef5d3ee6d52d tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1182773 May 12 15:11:34.234616 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-c0f00daa-0dfd-4242-a0bc-1196256c276a req-e5a4ecc9-d276-444a-bba8-963f43f68877 tempest-SecurityGroupsNegativeTestJSON-2038926396 tempest-SecurityGroupsNegativeTestJSON-2038926396-project] show failed (client error): The resource could not be found. May 12 15:11:34.235938 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0f00daa-0dfd-4242-a0bc-1196256c276a req-e5a4ecc9-d276-444a-bba8-963f43f68877 tempest-SecurityGroupsNegativeTestJSON-2038926396 tempest-SecurityGroupsNegativeTestJSON-2038926396-project] 10.222.0.82 "GET /v2.0/security-groups/99168042-3c1e-44c2-b6a5-0088fde1343b HTTP/1.1" status: 404 len: 352 time: 0.0472593 May 12 15:11:34.250603 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-6f965e8d-1ac3-4bca-9407-fe6209455cc3 admin admin] Deleting subnet 1636e4f2-4025-4f61-a8dd-65adade9e66c {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:11:34.297201 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f965e8d-1ac3-4bca-9407-fe6209455cc3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.370499 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f965e8d-1ac3-4bca-9407-fe6209455cc3 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.458090 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d58f222f-6389-4e8b-b97b-8bb8bc236445 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.463852 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d58f222f-6389-4e8b-b97b-8bb8bc236445 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.485015 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-9f7a50c4-a8d9-450e-8d0e-a9f9e48bbb3d req-f75401d3-d3d1-4e22-8890-034526a9a68b tempest-SecurityGroupsNegativeTestJSON-2038926396 tempest-SecurityGroupsNegativeTestJSON-2038926396-project] show failed (client error): The resource could not be found. May 12 15:11:34.497238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d58f222f-6389-4e8b-b97b-8bb8bc236445 admin admin] Pushing event deleted for resources: {'Network': ['ID=74c45f45-b34b-4876-a35b-8ae714cf4d5f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:34.501637 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f7a50c4-a8d9-450e-8d0e-a9f9e48bbb3d req-f75401d3-d3d1-4e22-8890-034526a9a68b tempest-SecurityGroupsNegativeTestJSON-2038926396 tempest-SecurityGroupsNegativeTestJSON-2038926396-project] 10.222.0.82 "GET /v2.0/security-groups/bbd8e1d6-a178-453e-a412-008f05911716 HTTP/1.1" status: 404 len: 352 time: 0.0976243 May 12 15:11:34.504654 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d58f222f-6389-4e8b-b97b-8bb8bc236445 admin admin] 10.222.0.82 "DELETE /v2.0/networks/74c45f45-b34b-4876-a35b-8ae714cf4d5f HTTP/1.1" status: 204 len: 168 time: 1.0337400 May 12 15:11:34.507378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51632) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:34.514157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-b5807eaf-93ef-4d96-aad5-3217a613a6c1 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:34.518961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-b5807eaf-93ef-4d96-aad5-3217a613a6c1 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4&tenant_id=68c66ae0cd45476b87e2e79625b80f69&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 1095 time: 0.2659991 May 12 15:11:34.588783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-87804f45-7cbf-4bce-a096-7243727bfead admin admin] Deleting subnet 36bb0ea1-1ce7-4f3a-b522-a55676fb13b2 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:11:34.594653 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87804f45-7cbf-4bce-a096-7243727bfead admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.660737 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87804f45-7cbf-4bce-a096-7243727bfead admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.679256 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51638) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:34.723190 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87804f45-7cbf-4bce-a096-7243727bfead admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.756125 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f965e8d-1ac3-4bca-9407-fe6209455cc3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.795442 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87804f45-7cbf-4bce-a096-7243727bfead admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.801989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b38a151f-b637-428b-ba5f-392a69e01588 req-6987ee98-64ba-4f6a-aff0-63f2e95098c8 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:34.803469 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b38a151f-b637-428b-ba5f-392a69e01588 req-6987ee98-64ba-4f6a-aff0-63f2e95098c8 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.3970056 May 12 15:11:34.833832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87804f45-7cbf-4bce-a096-7243727bfead admin admin] Pushing event deleted for resources: {'Subnet': ['ID=36bb0ea1-1ce7-4f3a-b522-a55676fb13b2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:34.837545 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87804f45-7cbf-4bce-a096-7243727bfead admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.843581 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-87804f45-7cbf-4bce-a096-7243727bfead admin admin] 10.222.0.82 "DELETE /v2.0/subnets/36bb0ea1-1ce7-4f3a-b522-a55676fb13b2 HTTP/1.1" status: 204 len: 168 time: 0.3349493 May 12 15:11:34.846248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51642) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:34.870880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6d41ef78-1158-436c-80ba-dd16544aee5b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=fd97c932be3143b1846bb48363040c63&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1890256 May 12 15:11:34.877480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51646) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:34.941097 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b38a151f-b637-428b-ba5f-392a69e01588 req-e0d70930-cb5a-400a-9dd0-a172981e3adb tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1192493 May 12 15:11:34.947273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9e4d201-b066-4c55-9775-690a5a0c0f50 req-dc07db3e-7272-47f4-83bc-307e192200f8 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:34.948738 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9e4d201-b066-4c55-9775-690a5a0c0f50 req-dc07db3e-7272-47f4-83bc-307e192200f8 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=5ac222f7-bb37-42b6-9a18-0b8a2211c771 HTTP/1.1" status: 200 len: 1100 time: 0.3175163 May 12 15:11:34.960733 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eee7a3dd-8df5-4ab9-ba6e-5f3acffc5f2f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:34.971931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-f111b620-f339-49c5-bcac-bc61d0415ab2 service neutron] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:34.997847 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f965e8d-1ac3-4bca-9407-fe6209455cc3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.046170 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-f111b620-f339-49c5-bcac-bc61d0415ab2 service neutron] Notify callbacks [] for binding, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.047708 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-933c9f0c-45ae-4120-b551-0c702d9bda94 req-f111b620-f339-49c5-bcac-bc61d0415ab2 service neutron] 10.222.0.76 "DELETE /v2.0/ports/14990298-685a-4dd8-a308-ee8dcbbb6d93/bindings/n-h1-841483-1 HTTP/1.1" status: 204 len: 173 time: 0.5094049 May 12 15:11:35.055054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f965e8d-1ac3-4bca-9407-fe6209455cc3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1636e4f2-4025-4f61-a8dd-65adade9e66c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:35.065950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55be2fd3-c4ef-4efd-91d5-ad6573170b39 None None] Network e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:11:35.072039 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f965e8d-1ac3-4bca-9407-fe6209455cc3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.073937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6f965e8d-1ac3-4bca-9407-fe6209455cc3 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/1636e4f2-4025-4f61-a8dd-65adade9e66c HTTP/1.1" status: 204 len: 168 time: 0.9456518 May 12 15:11:35.080590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51652) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:35.113545 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9e4d201-b066-4c55-9775-690a5a0c0f50 req-35b92920-7cd8-42a2-ac3e-3e7007c0b7e2 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1467507 May 12 15:11:35.116766 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9deb78f0-eee1-4ab6-8bb9-e7ef3ed9dbe1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.162424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:11:35.172461 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eee7a3dd-8df5-4ab9-ba6e-5f3acffc5f2f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.214415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:11:35.215044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7cedc32b-b5cd-4a76-a42a-a94a0eb4ccf5 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:11:35.215596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3e3227c7-431d-48ce-8a34-1d616d5ac800 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:11:35.260477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 3e3227c7-431d-48ce-8a34-1d616d5ac800 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:11:35.260832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-eee7a3dd-8df5-4ab9-ba6e-5f3acffc5f2f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0b39d5f2-b0b5-4752-8aee-53a71c6a1a5b']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:35.260938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3e3227c7-431d-48ce-8a34-1d616d5ac800 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:11:35.274523 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.291038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-eee7a3dd-8df5-4ab9-ba6e-5f3acffc5f2f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '69cf54ae-18f4-43ac-837f-52b48569d732') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:35.291422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-eee7a3dd-8df5-4ab9-ba6e-5f3acffc5f2f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '69cf54ae-18f4-43ac-837f-52b48569d732') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:35.301470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Deleting port 217ffa4f-2983-42fc-8f53-273403043cd2 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:35.302278 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.321706 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eee7a3dd-8df5-4ab9-ba6e-5f3acffc5f2f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.354734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eee7a3dd-8df5-4ab9-ba6e-5f3acffc5f2f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.368485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-eee7a3dd-8df5-4ab9-ba6e-5f3acffc5f2f admin admin] Releasing vlan 575 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:11:35.368900 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eee7a3dd-8df5-4ab9-ba6e-5f3acffc5f2f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: timer() May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:11:35.394768 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:11:35.474614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] DHCP port deletion for e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:11:35.480186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Deleting port 217ffa4f-2983-42fc-8f53-273403043cd2 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:35.481109 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.512281 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eee7a3dd-8df5-4ab9-ba6e-5f3acffc5f2f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.537211 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eee7a3dd-8df5-4ab9-ba6e-5f3acffc5f2f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.542490 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9deb78f0-eee1-4ab6-8bb9-e7ef3ed9dbe1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.547066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eee7a3dd-8df5-4ab9-ba6e-5f3acffc5f2f admin admin] Pushing event deleted for resources: {'Network': ['ID=0b39d5f2-b0b5-4752-8aee-53a71c6a1a5b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:35.550674 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-eee7a3dd-8df5-4ab9-ba6e-5f3acffc5f2f admin admin] 10.222.0.82 "DELETE /v2.0/networks/0b39d5f2-b0b5-4752-8aee-53a71c6a1a5b HTTP/1.1" status: 204 len: 168 time: 0.7034886 May 12 15:11:35.770930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] For port 217ffa4f-2983-42fc-8f53-273403043cd2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=217ffa4f-2983-42fc-8f53-273403043cd2,segment=NetworkSegment(5557610c-85a4-4c18-8793-b6867e2cb17c),segment_id=5557610c-85a4-4c18-8793-b6867e2cb17c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:35.771401 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.793837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51664) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:35.851465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b2d2d6-2444-4ca1-bac5-79ee6047bf6d req-488c7599-ffe2-43e1-836c-b2569e237555 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:35.852898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f8b2d2d6-2444-4ca1-bac5-79ee6047bf6d req-488c7599-ffe2-43e1-836c-b2569e237555 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=d63a3a59-bf0b-4b7e-ab5a-b1275d00d587 HTTP/1.1" status: 200 len: 1101 time: 0.4799457 May 12 15:11:35.864746 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a3c4738f-74c2-4779-9f9e-faee7545ba51 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=559c5717b8bd444f993099e77a1550ad&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0667980 May 12 15:11:35.864746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51668) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:35.865738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] For port 217ffa4f-2983-42fc-8f53-273403043cd2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=217ffa4f-2983-42fc-8f53-273403043cd2,segment=NetworkSegment(5557610c-85a4-4c18-8793-b6867e2cb17c),segment_id=5557610c-85a4-4c18-8793-b6867e2cb17c)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:35.866097 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.879754 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9deb78f0-eee1-4ab6-8bb9-e7ef3ed9dbe1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.916153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Calling delete_port for 217ffa4f-2983-42fc-8f53-273403043cd2 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:35.916406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae0822a3-c263-4769-9ac6-c91914ee75d9 req-32f5e6ec-860b-41c9-a867-be8ebea7d936 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:35.917616 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae0822a3-c263-4769-9ac6-c91914ee75d9 req-32f5e6ec-860b-41c9-a867-be8ebea7d936 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 944 time: 0.3641410 May 12 15:11:35.936988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d197a60-2eae-4254-9eab-29b5a7ccf20b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:35.972272 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d197a60-2eae-4254-9eab-29b5a7ccf20b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:36.002797 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:36.032303 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d197a60-2eae-4254-9eab-29b5a7ccf20b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:36.047114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9deb78f0-eee1-4ab6-8bb9-e7ef3ed9dbe1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14760cab-e3dc-4bd2-9dbe-16aa688504a5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:36.051318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d197a60-2eae-4254-9eab-29b5a7ccf20b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87badfca-2b50-404e-815a-f0b6fd99d05d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:36.055268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] No DVR routers for this DVR port 217ffa4f-2983-42fc-8f53-273403043cd2 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:11:36.060055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d197a60-2eae-4254-9eab-29b5a7ccf20b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:36.067243 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0d197a60-2eae-4254-9eab-29b5a7ccf20b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/87badfca-2b50-404e-815a-f0b6fd99d05d HTTP/1.1" status: 204 len: 168 time: 0.1959975 May 12 15:11:36.073649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Calling delete_port for 217ffa4f-2983-42fc-8f53-273403043cd2 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:36.088911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Pushing event deleted for resources: {'Port': ['ID=217ffa4f-2983-42fc-8f53-273403043cd2,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:36.098822 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:36.099165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:36.099491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:36.099820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:36.100141 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:36.100474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:36.100775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:36.101217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:36.101653 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:36.101910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:36.102429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:36.102739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b1d151-7fb6-4b1f-a203-881316173fe1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:36.143305 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9deb78f0-eee1-4ab6-8bb9-e7ef3ed9dbe1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:36.144416 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9deb78f0-eee1-4ab6-8bb9-e7ef3ed9dbe1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/14760cab-e3dc-4bd2-9dbe-16aa688504a5 HTTP/1.1" status: 204 len: 168 time: 1.2636805 May 12 15:11:36.153082 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f8b2d2d6-2444-4ca1-bac5-79ee6047bf6d req-5ef176d7-0d4b-4389-aee0-257d191eedcb tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2794008 May 12 15:11:36.193538 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae0822a3-c263-4769-9ac6-c91914ee75d9 req-b464bbb4-8576-4b06-8896-0c4cfe402c1f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2128093 May 12 15:11:36.208578 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:11:36.208904 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:11:36.491248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c201f999-fa33-46c2-a04f-720e5e01ae26 req-40ec9b2c-5047-4a3f-a623-ebedde05c26a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:36.491248 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c201f999-fa33-46c2-a04f-720e5e01ae26 req-40ec9b2c-5047-4a3f-a623-ebedde05c26a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.1552091 May 12 15:11:36.499756 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ac3686-07a1-4f15-b66d-783732538f3b req-fcf100a2-e710-4e3d-987e-be8a6d8dade5 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:36.501370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09ac3686-07a1-4f15-b66d-783732538f3b req-fcf100a2-e710-4e3d-987e-be8a6d8dade5 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=ec64d0a8-e302-4f1f-b954-5a422e360221 HTTP/1.1" status: 200 len: 950 time: 0.1297240 May 12 15:11:36.579320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c201f999-fa33-46c2-a04f-720e5e01ae26 req-e8e4b8eb-fb4b-47ba-926e-1b760aac42b1 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0769465 May 12 15:11:36.581883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09ac3686-07a1-4f15-b66d-783732538f3b req-3fcc1f79-6cc2-466c-8a35-aff35a5ce6f1 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647118 May 12 15:11:36.710147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Deleting port 217ffa4f-2983-42fc-8f53-273403043cd2 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:36.710513 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:36.860950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] The port '217ffa4f-2983-42fc-8f53-273403043cd2' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:11:36.863270 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-80c7e88b-9cd7-4954-8a17-68c8e5f32d22 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1222131 May 12 15:11:37.118757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 217ffa4f-2983-42fc-8f53-273403043cd2 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:11:37.168244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 217ffa4f-2983-42fc-8f53-273403043cd2 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:11:37.169059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 217ffa4f-2983-42fc-8f53-273403043cd2 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:11:37.184572 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.219340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:37.234925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5557610c-85a4-4c18-8793-b6867e2cb17c') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:37.235218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5557610c-85a4-4c18-8793-b6867e2cb17c') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:37.249250 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.269272 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.273721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51730) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:37.320788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Releasing vlan 563 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:11:37.321198 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: timer() May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:11:37.343047 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:11:37.434722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51738) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:37.504126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Request body: {'network': {'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-network', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:37.509812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:37.514291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Usage tracker for resource:network and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:37.518189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:37.524439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:37.542293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Made reservation on behalf of 05b4f1ce61294fb29efb0a765ed28561 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:37.545816 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.555741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bbb6628-b9af-4947-8daa-b7a6f67f0e6f req-16f74507-d40c-4eea-a918-4c7187865c61 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:37.564281 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5bbb6628-b9af-4947-8daa-b7a6f67f0e6f req-16f74507-d40c-4eea-a918-4c7187865c61 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 1095 time: 0.8170037 May 12 15:11:37.572461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Request body: {'network': {'name': 'tempest-ServersTestJSON-2092020686-network', 'tenant_id': '593ec496e5db4078be8dc940596be321'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:37.577896 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.587165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:37.594499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Usage tracker for resource:network and tenant:593ec496e5db4078be8dc940596be321 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:37.597633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a31e041-f150-4a51-a474-6c1957a2ad8c req-57856d98-5d40-4326-a3b1-6ee05a178767 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:37.599246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a31e041-f150-4a51-a474-6c1957a2ad8c req-57856d98-5d40-4326-a3b1-6ee05a178767 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.76 "GET /v2.0/ports?device_id=ec64d0a8-e302-4f1f-b954-5a422e360221 HTTP/1.1" status: 200 len: 950 time: 0.7445657 May 12 15:11:37.608309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:37.611208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:37.614685 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.617328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:37.619670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Usage tracker for resource:security_group_rule and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:37.623366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:37.633463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:37.645367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Made reservation on behalf of 593ec496e5db4078be8dc940596be321 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:37.647808 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.668528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.690496 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.693814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:37.700383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Usage tracker for resource:security_group_rule and tenant:593ec496e5db4078be8dc940596be321 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:37.705176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:37.714732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:37.721029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-5498f06f-79b8-422b-bd95-9de57b535a3c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:37.722846 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-5498f06f-79b8-422b-bd95-9de57b535a3c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.8205175 May 12 15:11:37.723599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] Pushing event deleted for resources: {'Network': ['ID=e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:37.747956 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5bbb6628-b9af-4947-8daa-b7a6f67f0e6f req-33487a63-c2f0-4907-9f1d-3f369df8d0aa tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1828177 May 12 15:11:37.758643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-4a31e041-f150-4a51-a474-6c1957a2ad8c req-f264fc29-59c6-4300-9244-20390fa87eae tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Deleting port e8c30887-a54f-44a8-af0a-122711662e1e {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:11:37.759136 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4a31e041-f150-4a51-a474-6c1957a2ad8c req-f264fc29-59c6-4300-9244-20390fa87eae tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.799019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-00843a95-8dc5-48fb-b273-3269dbe62ad1 admin admin] 10.222.0.82 "DELETE /v2.0/networks/e4528aa6-2a1e-4f01-9f1d-4eb1d6b2fdc5 HTTP/1.1" status: 204 len: 168 time: 2.7173927 May 12 15:11:37.807252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.816902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.830854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 584} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:11:37.841668 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.841984 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Added segment a64e84dc-d91c-44e1-ab35-6c9b54a1b65b of type vlan for network 13468259-dd20-42ac-88ec-2614ebea6ccc May 12 15:11:37.882738 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.891915 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-a575b9b0-8dd9-4d80-9890-9a0b8cb6a836 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/quotas/fa4eac6b8c464c45aa3c550e59a0d34b HTTP/1.1" status: 200 len: 375 time: 0.1001954 May 12 15:11:37.941410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:37.942403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:37.942987 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:38.048480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51754) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:38.088039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f02964c6-c413-4fee-8742-d14649e5864e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:38.126622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:38.134328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] Pushing event updated for resources: {'Network': ['ID=13468259-dd20-42ac-88ec-2614ebea6ccc,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:38.138177 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:38.147469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 13468259-dd20-42ac-88ec-2614ebea6ccc details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:11:38.156257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 558} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:11:38.173477 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5f35e394-6382-43b9-9d07-e79c2e283dbc admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.8943100 May 12 15:11:38.173477 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:38.173477 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Added segment 76dd0247-55ca-4461-a3a9-cbb7a4a1c0db of type vlan for network dbc2e49c-2591-4534-a48c-cea8e23115f4 May 12 15:11:38.182113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51758) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:38.194620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Request body: {'subnet': {'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'cidr': '172.20.0.0/28', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-subnet', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:38.205625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6de33d80-c657-4853-a4a3-0c0960619be7,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:38.209929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:38.225362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Usage tracker for resource:subnet and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:38.240651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:38.243011 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b2e81506-316f-45fb-8cfe-1d00a026d024 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=982e4927ecc048a1a769000f4c067d06&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1934128 May 12 15:11:38.249362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51762) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:38.257800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:38.284388 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:38.323737 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:38.324607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:38.324911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-4a31e041-f150-4a51-a474-6c1957a2ad8c req-f264fc29-59c6-4300-9244-20390fa87eae tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] For port e8c30887-a54f-44a8-af0a-122711662e1e, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8c30887-a54f-44a8-af0a-122711662e1e,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:38.325194 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:38.325309 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4a31e041-f150-4a51-a474-6c1957a2ad8c req-f264fc29-59c6-4300-9244-20390fa87eae tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:38.342013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Made reservation on behalf of 05b4f1ce61294fb29efb0a765ed28561 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:38.344477 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:38.384120 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-27eee840-1ec2-4cc9-bead-4a21136e9e0e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&fields=id HTTP/1.1" status: 200 len: 440 time: 0.3976493 May 12 15:11:38.429652 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 879 time: 0.9937615 May 12 15:11:38.432808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51766) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:38.435447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72564be7-3972-42eb-a527-c35d5b0a9225 admin admin] Pushing event updated for resources: {'Network': ['ID=dbc2e49c-2591-4534-a48c-cea8e23115f4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:38.440893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Request body: {'subnet': {'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestJSON-2092020686-subnet', 'tenant_id': '593ec496e5db4078be8dc940596be321', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:38.447011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:38.450109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network dbc2e49c-2591-4534-a48c-cea8e23115f4 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:11:38.450243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Usage tracker for resource:subnet and tenant:593ec496e5db4078be8dc940596be321 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:38.453788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:38.459815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:38.493219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Made reservation on behalf of 593ec496e5db4078be8dc940596be321 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:38.495822 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:38.569896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-4a31e041-f150-4a51-a474-6c1957a2ad8c req-f264fc29-59c6-4300-9244-20390fa87eae tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Calling delete_port for e8c30887-a54f-44a8-af0a-122711662e1e owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:11:38.628060 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d8dea6b-33f1-4c90-a0c4-4fd1295eca2e req-c276cd66-bf9f-4ca6-8008-0d2bf16601ca tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:38.635074 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d8dea6b-33f1-4c90-a0c4-4fd1295eca2e req-c276cd66-bf9f-4ca6-8008-0d2bf16601ca tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.6471756 May 12 15:11:38.800972 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c090b44f-37df-49ad-828e-1b90050d248d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:38.801970 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:38.872427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d8dea6b-33f1-4c90-a0c4-4fd1295eca2e req-f31d6e0d-d8d7-4c54-bc43-8f8f09ffd84e tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2361050 May 12 15:11:38.917008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Pushing event updated for resources: {'Subnet': ['ID=84c2082e-f394-46d5-8a8f-8e3a70d54fc1,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:38.919535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Checking segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:38.919874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Network hostable DHCP agents. Network: dbc2e49c-2591-4534-a48c-cea8e23115f4, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:11:38.923830 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c090b44f-37df-49ad-828e-1b90050d248d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:38.954169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Network dbc2e49c-2591-4534-a48c-cea8e23115f4 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:11:38.969562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, dbc2e49c-2591-4534-a48c-cea8e23115f4) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:38.976243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:38.978449 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:38.984304 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52da0ca1-7742-4834-92c1-65230d7f285d None None] Network dbc2e49c-2591-4534-a48c-cea8e23115f4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:11:39.043475 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d642b6a9-f370-4102-abb6-e92308a39553 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 843 time: 0.5942543 May 12 15:11:39.232813 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4a31e041-f150-4a51-a474-6c1957a2ad8c req-f264fc29-59c6-4300-9244-20390fa87eae tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:39.270086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['e8c30887-a54f-44a8-af0a-122711662e1e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:39.316250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f264fc29-59c6-4300-9244-20390fa87eae tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Pushing event deleted for resources: {'Port': ['ID=e8c30887-a54f-44a8-af0a-122711662e1e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:39.326981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce7bb61-b633-46fa-8808-c44bc563ddc1 req-403a3574-d257-4040-9e95-ef439b8eba7d tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:39.328884 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cce7bb61-b633-46fa-8808-c44bc563ddc1 req-403a3574-d257-4040-9e95-ef439b8eba7d tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/ports?device_id=ec64d0a8-e302-4f1f-b954-5a422e360221 HTTP/1.1" status: 200 len: 950 time: 0.6007135 May 12 15:11:39.427035 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c090b44f-37df-49ad-828e-1b90050d248d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:39.429102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afc8b6ad-5cac-4568-976c-01d9b48c9093 None None] Network dbc2e49c-2591-4534-a48c-cea8e23115f4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:11:39.501378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:39.677687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-2ed57a0d-0a15-4528-bdae-c6c8cd7af496 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:39.679156 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-2ed57a0d-0a15-4528-bdae-c6c8cd7af496 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 808 time: 0.6539319 May 12 15:11:39.679975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c090b44f-37df-49ad-828e-1b90050d248d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11054946-0eea-4d43-abcb-4652027aced8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:39.692161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-4a31e041-f150-4a51-a474-6c1957a2ad8c req-f264fc29-59c6-4300-9244-20390fa87eae tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] No DVR routers for this DVR port e8c30887-a54f-44a8-af0a-122711662e1e on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:11:39.714336 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4a31e041-f150-4a51-a474-6c1957a2ad8c req-f264fc29-59c6-4300-9244-20390fa87eae tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:39.716883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ec64d0a8-e302-4f1f-b954-5a422e360221', 'name': 'network-vif-deleted', 'tag': 'e8c30887-a54f-44a8-af0a-122711662e1e'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:39.729519 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cce7bb61-b633-46fa-8808-c44bc563ddc1 req-3540e5d8-ca5b-439c-bfd9-0bec9398f321 tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed9b6d66-f4bf-46c2-824a-412105731ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3719947 May 12 15:11:39.758837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a31e041-f150-4a51-a474-6c1957a2ad8c req-f264fc29-59c6-4300-9244-20390fa87eae tempest-ServersAdminNegativeTestJSON-1654190600 tempest-ServersAdminNegativeTestJSON-1654190600-project] 10.222.0.76 "DELETE /v2.0/ports/e8c30887-a54f-44a8-af0a-122711662e1e HTTP/1.1" status: 204 len: 173 time: 2.1278431 May 12 15:11:39.760054 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-e5e436e6-23e6-4963-bcf0-9a5c88e0daa9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/quotas/68c66ae0cd45476b87e2e79625b80f69 HTTP/1.1" status: 200 len: 375 time: 0.0384121 May 12 15:11:39.767227 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c090b44f-37df-49ad-828e-1b90050d248d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:39.768232 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c090b44f-37df-49ad-828e-1b90050d248d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/11054946-0eea-4d43-abcb-4652027aced8 HTTP/1.1" status: 204 len: 168 time: 1.5141928 May 12 15:11:39.777936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Pushing event updated for resources: {'Subnet': ['ID=4ecb64d7-7b16-437b-8f3e-4996d58043f6,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:39.861487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Checking segment: {'id': 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:39.861848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Network hostable DHCP agents. Network: 13468259-dd20-42ac-88ec-2614ebea6ccc, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:11:39.937121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-187e9075-e258-477f-b012-7e85438dc75b req-e0d04973-b37c-40de-bbcb-1d7d8abd7912 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 210 time: 0.0594501 May 12 15:11:39.946969 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Network 13468259-dd20-42ac-88ec-2614ebea6ccc is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:11:39.964610 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-6094b4c8-2dbb-407b-a72e-8fe356eee547 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1736534 May 12 15:11:39.971684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 13468259-dd20-42ac-88ec-2614ebea6ccc) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:39.979009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:39.979584 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:39.982641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec78dfef-57d9-4b92-ae34-c0008db91204 None None] Network 13468259-dd20-42ac-88ec-2614ebea6ccc requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:11:40.174256 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d7bd3a9d-e1ac-4bf0-8c2c-0966a9c58e5e admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 1.9896746 May 12 15:11:40.175090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51806) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:40.206366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Request body: {'router': {'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:40.216976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:40.245633 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-c44db4ab-ca5d-425c-a0bd-ca74a9e8cd62 service neutron] 10.222.0.82 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2559755 May 12 15:11:40.267515 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-13468259-dd20-42ac-88ec-2614ebea6ccc', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'fixed_ips': [{'subnet_id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:11:40.268627 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:40.284557 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-62bfedf5-bb91-48e7-b41d-c3cbdc871933 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0651927 May 12 15:11:40.287207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Usage tracker for resource:router and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:40.294269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:40.378345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:40.417018 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:40.418388 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:40.443428 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:40.666415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Allocated IP 172.20.0.2 (13468259-dd20-42ac-88ec-2614ebea6ccc/4ecb64d7-7b16-437b-8f3e-4996d58043f6/f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:11:40.770237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-f77dba15-6702-4d8a-82c4-dcf0c4dd642d tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:40.771836 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-f77dba15-6702-4d8a-82c4-dcf0c4dd642d tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4794374 May 12 15:11:40.798111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Request body: {'port': {'device_id': '3ea64917-282e-46ab-bc5b-00e8f66e5176', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': 'fa4eac6b8c464c45aa3c550e59a0d34b'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:40.985248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:40.998677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attempting to reserve 1 items for resource port. Total usage: 5; quota limit: 500; headroom:495 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:41.000377 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:41.011056 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:41.011525 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-c6e5870e-a36a-4aa5-94dd-395c8334e2e7 service neutron] 10.222.0.82 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7647305 May 12 15:11:41.024208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Transition to ACTIVE for port object f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:41.026989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Made reservation on behalf of fa4eac6b8c464c45aa3c550e59a0d34b for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:41.040262 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:41.052548 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Transition to ACTIVE for port object f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:41.062238 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:41.110315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51838) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:41.155000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Network 13468259-dd20-42ac-88ec-2614ebea6ccc is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:11:41.156741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:41.163988 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:11:41.193081 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d51fc9d9-40df-448d-98fc-d915b9e1ddd4 req-6c6074e1-6130-4645-9230-840d1c0b016b service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.3666403 May 12 15:11:41.201584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-26d51506-e23a-43d8-917e-380d6f09af88 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:41.203840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-26d51506-e23a-43d8-917e-380d6f09af88 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.4354496 May 12 15:11:41.204992 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-b5b4cedc-d624-4fc9-a535-4c66f57b1b78 service neutron] show failed (client error): The resource could not be found. May 12 15:11:41.206024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-b5b4cedc-d624-4fc9-a535-4c66f57b1b78 service neutron] 10.222.0.76 "GET /v2.0/ports/9787cef9-03af-4a15-af20-0eb8fe5ee859/bindings/n-h1-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.4365764 May 12 15:11:41.258777 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-e2454c86-298a-45e7-be84-664453a90fad tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/quotas/593ec496e5db4078be8dc940596be321 HTTP/1.1" status: 200 len: 375 time: 0.0457108 May 12 15:11:41.329639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Allocated IP 192.168.233.250 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/fa933a35-7a96-4a45-bb36-afb53c7641b9) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:11:41.333490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Pushing event updated for resources: {'Port': ['ID=f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:41.388919 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-c5e14034-d581-4022-8923-ee9018598373 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1292279 May 12 15:11:41.411428 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-af3d3324-4231-4db5-ba75-924edc7ac0e7'] response: {'server_uuid': 'ec64d0a8-e302-4f1f-b954-5a422e360221', 'name': 'network-vif-deleted', 'tag': 'e8c30887-a54f-44a8-af0a-122711662e1e', 'status': 'completed', 'code': 200} May 12 15:11:41.418441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-309743523-network', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:41.439889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:41.445164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Usage tracker for resource:network and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:41.449001 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Attempting to bind port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:11:41.449456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Attempting to bind port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:11:41.449754 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Attempting to bind port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 on network 13468259-dd20-42ac-88ec-2614ebea6ccc {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:41.464143 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:11:41.464504 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Checking segment: {'id': 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:41.464896 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:41.465275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Bound using segment: {'id': 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:11:41.465752 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Bound port: f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:11:41.466111 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:41.471208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:41.538163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:41.640410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:41.647293 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] For port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:41.652711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] For port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6,segment=NetworkSegment(a64e84dc-d91c-44e1-ab35-6c9b54a1b65b),segment_id=a64e84dc-d91c-44e1-ab35-6c9b54a1b65b)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:11:41.660503 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:41.664281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Transition to ACTIVE for port object fa933a35-7a96-4a45-bb36-afb53c7641b9 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:41.740774 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:41.760781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81', '8c301fff-eebe-4ee3-ae47-9da749d76d58'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:41.796470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3ae73679-d198-440a-966c-619a9930fbcb', '83a7b910-a912-4e05-9d03-5d6b1f6b0edc', '9c35d53f-6773-4ce7-9642-3b542a20efa8'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:41.824138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:11:41.834732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:41.862459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:41.864652 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:41.885341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:11:41.907428 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:41.916389 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-679b653e-4e93-4c72-badb-f3fbdad14977 None None] Pushing event updated for resources: {'Port': ['ID=f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:41.947315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:41.951457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Usage tracker for resource:security_group_rule and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:41.955181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:41.961224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:41.981846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event updated for resources: {'Port': ['ID=fa933a35-7a96-4a45-bb36-afb53c7641b9,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:42.016193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-61a4b172-ad60-41f2-a966-26bb94e0fc0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:42.018173 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-61a4b172-ad60-41f2-a966-26bb94e0fc0a service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1&tenant_id=0da54985cde346e68eeadf965b8bc6d3 HTTP/1.1" status: 200 len: 1100 time: 0.3236156 May 12 15:11:42.026173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:42.027180 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:42.055176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:42.068149 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-4b78b57d-ba65-4c0b-8aae-168332279f91 service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6775782 May 12 15:11:42.336227 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-7dd4398b-faa3-4cd6-b62f-396e1bb519b3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.5441830 May 12 15:11:42.338457 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:42.339781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 9787cef9-03af-4a15-af20-0eb8fe5ee859 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:11:42.362150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Request body: {'port': {'device_id': '3ea64917-282e-46ab-bc5b-00e8f66e5176', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:42.465600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c593aeb5-68ac-4cda-9061-98620bb33c70 None None] Provisioning for port fa933a35-7a96-4a45-bb36-afb53c7641b9 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:42.491850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ae8beb-e7d9-449c-bfe7-8c68a6685ec5 req-0ee456d1-d7a7-4d4a-adc8-11871c7b636f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:42.493340 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01ae8beb-e7d9-449c-bfe7-8c68a6685ec5 req-0ee456d1-d7a7-4d4a-adc8-11871c7b636f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.8717313 May 12 15:11:42.499889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c593aeb5-68ac-4cda-9061-98620bb33c70 None None] Provisioning complete for port fa933a35-7a96-4a45-bb36-afb53c7641b9 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:42.500572 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c593aeb5-68ac-4cda-9061-98620bb33c70 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:42.608113 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-1b709788-4a66-4ddb-8de1-1096d7974cc3 service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5207720 May 12 15:11:42.636256 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:42.637171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c593aeb5-68ac-4cda-9061-98620bb33c70 None None] Port fa933a35-7a96-4a45-bb36-afb53c7641b9 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:11:42.680872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d51fc9d9-40df-448d-98fc-d915b9e1ddd4 req-1c2a17ad-c2fc-45aa-8c92-d41c6644aea6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:42.682638 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d51fc9d9-40df-448d-98fc-d915b9e1ddd4 req-1c2a17ad-c2fc-45aa-8c92-d41c6644aea6 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 1101 time: 1.1930940 May 12 15:11:42.704877 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:42.749151 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-22fdbcb3-1c5c-44ba-a105-3dd25a1efc46 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:42.787150 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01ae8beb-e7d9-449c-bfe7-8c68a6685ec5 req-d5626f64-3daa-4a68-88bb-f79e0cb77c82 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2755105 May 12 15:11:42.793249 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:42.793989 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:42.814965 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:42.960761 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:43.087703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:43.284368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:11:43.552469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Allocated IP 172.25.8.4 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/a9fcd520-c18d-4516-9fc0-3db76c87dad6) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:11:43.596396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c1a3e0a-bdc2-4073-a220-b9c81e4e8639 None None] Network 13468259-dd20-42ac-88ec-2614ebea6ccc requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:11:43.673953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 561} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:11:43.702476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51870) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:43.704984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:43.732931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-4e39bf20-f081-4400-b9f6-0fb732490a81 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:43.734679 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-4e39bf20-f081-4400-b9f6-0fb732490a81 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.84 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 808 time: 0.5368187 May 12 15:11:43.750654 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75c22cc0-3b0e-406e-9326-da0fe61c8ae4 req-bf62d3df-7faf-4908-b1f5-fcd151b999ee tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.4506905 May 12 15:11:43.757148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:43.771530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f534afdd-dbad-43b8-9ae0-bd616bab9a95,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:43.785106 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:43.785530 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Added segment 3155d58f-cee0-46db-bac9-2d07d9e2fa60 of type vlan for network fb52840d-9bbb-41d8-beb2-82a8e29947d0 May 12 15:11:43.818105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-83cd6cda-8297-484f-bc9f-6cf104abffda None None] Provisioning for port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:43.833175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-83cd6cda-8297-484f-bc9f-6cf104abffda None None] Provisioning complete for port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:43.833175 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-83cd6cda-8297-484f-bc9f-6cf104abffda None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:43.953322 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-800ae160-fe80-4f8f-a227-a2197007bd82 req-37f4876d-8a19-4244-88dd-51e4af3f1835 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 210 time: 0.0746615 May 12 15:11:43.968516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d51fc9d9-40df-448d-98fc-d915b9e1ddd4 req-1774b116-f778-47ca-b602-db642769d0f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:43.969122 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d51fc9d9-40df-448d-98fc-d915b9e1ddd4 req-1774b116-f778-47ca-b602-db642769d0f1 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 1.2286265 May 12 15:11:43.994356 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:43.994502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Request body: {'port': {'device_id': '6a304fd0-80ef-4b27-86c5-a861e6627236', 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28', 'admin_state_up': True, 'tenant_id': '68c66ae0cd45476b87e2e79625b80f69'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:44.074898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66f911c6-20b9-4404-a74d-f5b96a533cfa req-fce3ae4a-bce6-456e-8630-bf161ffe2b66 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:44.076342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66f911c6-20b9-4404-a74d-f5b96a533cfa req-fce3ae4a-bce6-456e-8630-bf161ffe2b66 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 936 time: 0.9967437 May 12 15:11:44.082165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d51fc9d9-40df-448d-98fc-d915b9e1ddd4 req-f58a1b45-b030-45fa-9a53-c279074f0eda service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.253&port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127 HTTP/1.1" status: 200 len: 217 time: 0.1035004 May 12 15:11:44.094782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:44.172322 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-83cd6cda-8297-484f-bc9f-6cf104abffda None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:44.217947 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-83cd6cda-8297-484f-bc9f-6cf104abffda None None] For port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6,segment=NetworkSegment(a64e84dc-d91c-44e1-ab35-6c9b54a1b65b),segment_id=a64e84dc-d91c-44e1-ab35-6c9b54a1b65b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:44.235217 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-83cd6cda-8297-484f-bc9f-6cf104abffda None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:44.274328 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3fa2fbd6-5654-4704-87fd-276e0409e457 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8a871ef1e9124e35b230ac65e37bd02e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5663812 May 12 15:11:44.275014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:44.283016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51878) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:44.285213 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:44.297518 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:44.304798 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66f911c6-20b9-4404-a74d-f5b96a533cfa req-77a64e1c-d705-4bca-82d7-1793b8bb0d8f tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2216039 May 12 15:11:44.312073 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:44.319901 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:44.320900 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:44.377210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83cd6cda-8297-484f-bc9f-6cf104abffda None None] Pushing event updated for resources: {'Port': ['ID=f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:44.392378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d51fc9d9-40df-448d-98fc-d915b9e1ddd4 req-53b17006-1f90-418a-afd0-0bf8973443db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:44.395749 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d51fc9d9-40df-448d-98fc-d915b9e1ddd4 req-53b17006-1f90-418a-afd0-0bf8973443db service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2984529 May 12 15:11:44.412533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Transition to ACTIVE for port object 9787cef9-03af-4a15-af20-0eb8fe5ee859 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:44.457321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:44.460532 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5c3612f3-d08c-4f51-b94b-03748b520bf1'] response: {'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'code': 200} May 12 15:11:44.464347 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:44.498237 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:11:44.499661 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:11:44.558778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c97c374c-5628-48d7-9e61-8e20c1d8f792 None None] Provisioning complete for port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:44.559250 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c97c374c-5628-48d7-9e61-8e20c1d8f792 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:44.566152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Usage tracker for resource:port and tenant:68c66ae0cd45476b87e2e79625b80f69 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:44.585310 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:44.709185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:44.729300 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-357d5e0b-2c2e-4df1-b6ba-30462f77f525 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:44.731771 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] No DVR routers for this DVR port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:11:44.750645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] Pushing event updated for resources: {'Network': ['ID=fb52840d-9bbb-41d8-beb2-82a8e29947d0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:44.756466 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-004c1ad8-e377-4547-a3be-a8c296d6d329 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 3.5827761 May 12 15:11:44.763122 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51884) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:44.763807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=6']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:44.771301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Made reservation on behalf of 68c66ae0cd45476b87e2e79625b80f69 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:44.775477 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:44.776796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network fb52840d-9bbb-41d8-beb2-82a8e29947d0 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:11:44.792148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0785da49-78f5-4d9a-8747-3bd90e3945e3 req-0a240a0e-ce3b-4fd6-b550-37469d8cfabc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:44.793585 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0785da49-78f5-4d9a-8747-3bd90e3945e3 req-0a240a0e-ce3b-4fd6-b550-37469d8cfabc tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.6208320 May 12 15:11:44.852823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Request body: {'subnet': {'network_id': 'fb52840d-9bbb-41d8-beb2-82a8e29947d0', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestMultiNic-309743523-subnet', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:44.898790 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4c7d246-dd80-40d9-a0b9-46def1a5a578 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:44.923152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:44.951526 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-357d5e0b-2c2e-4df1-b6ba-30462f77f525 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:44.964089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d51fc9d9-40df-448d-98fc-d915b9e1ddd4 req-74bc7d87-41e2-4e70-9219-fe46e6e105c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:44.965662 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d51fc9d9-40df-448d-98fc-d915b9e1ddd4 req-74bc7d87-41e2-4e70-9219-fe46e6e105c4 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.5424228 May 12 15:11:44.965804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Usage tracker for resource:subnet and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:44.966800 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:44.978532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:45.005553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:45.024564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Attempting to bind port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:11:45.024914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Attempting to bind port 9787cef9-03af-4a15-af20-0eb8fe5ee859 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:11:45.025230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Attempting to bind port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:45.040689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:11:45.041021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Attempting to bind port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:45.056205 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0785da49-78f5-4d9a-8747-3bd90e3945e3 req-f47299c4-930d-4857-a205-ce402df5f3c8 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2220929 May 12 15:11:45.086193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:11:45.086532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:45.086926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:11:45.087845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Bound port: 9787cef9-03af-4a15-af20-0eb8fe5ee859, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:11:45.087845 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:45.098090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:45.100353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:45.100671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e8c30887-a54f-44a8-af0a-122711662e1e no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:11:45.172314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: e8c30887-a54f-44a8-af0a-122711662e1e {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:11:45.172645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e8c30887-a54f-44a8-af0a-122711662e1e not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:11:45.174297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:11:45.274809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:45.275523 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:45.328233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:45.331890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:11:45.352949 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] It took 0.23 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:11:45.365666 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:45.370608 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87564125-0a54-489a-81bc-4a39b05fbc66 req-31e9eb1f-def6-4f00-be6e-1e08cd9c5876 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 210 time: 0.1016054 May 12 15:11:45.384038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce59003a-b6e0-482f-9b34-c8cd93cfa625 req-0748087a-2e6b-4297-8c02-1fada8567f3a tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.3641551 May 12 15:11:45.460113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:11:45.476053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:45.491579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Pushing event updated for resources: {'Port': ['ID=a9fcd520-c18d-4516-9fc0-3db76c87dad6,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:45.494268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:11:45.510037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:45.510840 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:45.512221 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] 10.222.0.84 "PUT /v2.0/ports/9787cef9-03af-4a15-af20-0eb8fe5ee859 HTTP/1.1" status: 200 len: 1095 time: 3.4780760 May 12 15:11:45.547813 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-357d5e0b-2c2e-4df1-b6ba-30462f77f525 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:45.554332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fa933a35-7a96-4a45-bb36-afb53c7641b9 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:11:45.558964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Allocated IP 172.20.0.12 (e8211761-0dd9-424f-b732-629fd2d77e28/ed7d4325-c4dc-4592-8d41-1f3fe41da585/54f3ad03-fdf2-4862-93ff-f60efa594593) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:11:45.622310 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:45.635945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-357d5e0b-2c2e-4df1-b6ba-30462f77f525 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed9b6d66-f4bf-46c2-824a-412105731ce2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:45.662213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12d38a96-dc44-4948-8676-46ec215228d0 service neutron] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=7']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:45.713299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Transition to ACTIVE for port object fa933a35-7a96-4a45-bb36-afb53c7641b9 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:45.759470 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:45.760101 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d51fc9d9-40df-448d-98fc-d915b9e1ddd4 req-d07dfd38-7dbb-40d1-b444-d9bc9ead78e4 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7390668 May 12 15:11:45.816476 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-357d5e0b-2c2e-4df1-b6ba-30462f77f525 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:45.817691 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-357d5e0b-2c2e-4df1-b6ba-30462f77f525 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ed9b6d66-f4bf-46c2-824a-412105731ce2 HTTP/1.1" status: 204 len: 168 time: 1.5133870 May 12 15:11:45.851249 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-53489992-9d23-40fc-849b-1d82c67c8747 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:45.852642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-53489992-9d23-40fc-849b-1d82c67c8747 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.7955112 May 12 15:11:45.961677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Request body: {'port': {'device_id': '15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'admin_state_up': True, 'tenant_id': '593ec496e5db4078be8dc940596be321'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:45.989031 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:46.098190 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:46.268515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d51fc9d9-40df-448d-98fc-d915b9e1ddd4 req-5e300360-6faf-49c5-8d03-b6b3eadc455b service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4560204 May 12 15:11:46.268737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Pushing event updated for resources: {'Port': ['ID=fa933a35-7a96-4a45-bb36-afb53c7641b9,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:46.291200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36ca3241-c8a2-4a0c-bef5-d4bdac992914 req-1998a568-cbce-4e5b-8bf3-2853edb8667d tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:46.292245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-7a081655-b7de-4264-84a6-db775459d452 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:46.293818 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-7a081655-b7de-4264-84a6-db775459d452 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 1098 time: 0.7117119 May 12 15:11:46.297534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51902) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:46.301707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-36ca3241-c8a2-4a0c-bef5-d4bdac992914 req-1998a568-cbce-4e5b-8bf3-2853edb8667d tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 936 time: 0.7652562 May 12 15:11:46.417131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:46.455097 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:46.502869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:46.604202 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:46.612252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Attempting to bind port fa933a35-7a96-4a45-bb36-afb53c7641b9 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:11:46.612495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Attempting to bind port fa933a35-7a96-4a45-bb36-afb53c7641b9 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:11:46.612809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Attempting to bind port fa933a35-7a96-4a45-bb36-afb53c7641b9 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:46.625550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Usage tracker for resource:port and tenant:593ec496e5db4078be8dc940596be321 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:46.647122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:46.659602 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-367380a2-0fc7-40b5-a3c2-1e3aef483689 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9759882593c34b689baaafe6db795647&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3507679 May 12 15:11:46.659602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Port fa933a35-7a96-4a45-bb36-afb53c7641b9 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:11:46.659602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Attempting to bind port fa933a35-7a96-4a45-bb36-afb53c7641b9 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:46.662366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-36ca3241-c8a2-4a0c-bef5-d4bdac992914 req-2493064b-33aa-4127-a547-bceb348b0d6e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3586876 May 12 15:11:46.664976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51912) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:46.682177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Pushing event updated for resources: {'Subnet': ['ID=005ae052-6cd6-4ddc-833f-af6e1c2bff40,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:46.702512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:11:46.702844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:46.703428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:11:46.703880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Bound port: fa933a35-7a96-4a45-bb36-afb53c7641b9, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:11:46.704221 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:46.705676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:46.715557 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:46.721961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Checking segment: {'id': '3155d58f-cee0-46db-bac9-2d07d9e2fa60', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'fb52840d-9bbb-41d8-beb2-82a8e29947d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:46.722918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Network hostable DHCP agents. Network: fb52840d-9bbb-41d8-beb2-82a8e29947d0, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:11:46.741811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-5724bb2d-9f1d-42d6-bf64-bb995a288bc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:46.743518 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-5724bb2d-9f1d-42d6-bf64-bb995a288bc0 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.4356859 May 12 15:11:46.813217 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Made reservation on behalf of 593ec496e5db4078be8dc940596be321 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:46.816821 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:46.874471 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-12860543-94de-43de-9226-3abc26b1f441 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859 HTTP/1.1" status: 200 len: 217 time: 0.1212533 May 12 15:11:46.880454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Network fb52840d-9bbb-41d8-beb2-82a8e29947d0 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:11:46.924417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e4e0cd-472d-45e7-afae-67d881138673 req-46782161-0f24-4799-9b6b-3d51dd393e46 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:46.926162 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6e4e0cd-472d-45e7-afae-67d881138673 req-46782161-0f24-4799-9b6b-3d51dd393e46 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 947 time: 0.6558154 May 12 15:11:46.928176 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-116fb59b-9607-411a-8625-20f9046574b9 req-09f77f2d-bbcf-47a1-ba91-85e5f3d88826 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.1364312 May 12 15:11:46.984084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, fb52840d-9bbb-41d8-beb2-82a8e29947d0) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:46.993177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-812a319b-fba0-4b22-af62-51bf4516260b None None] Network fb52840d-9bbb-41d8-beb2-82a8e29947d0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:11:47.011181 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.030958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] For port fa933a35-7a96-4a45-bb36-afb53c7641b9, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:47.083148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:47.084145 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.127736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] For port fa933a35-7a96-4a45-bb36-afb53c7641b9, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fa933a35-7a96-4a45-bb36-afb53c7641b9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:11:47.131488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-2f2df337-bfbb-4308-9e3c-64765edc1bc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:47.133288 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-2f2df337-bfbb-4308-9e3c-64765edc1bc7 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2462845 May 12 15:11:47.147965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Network e8211761-0dd9-424f-b732-629fd2d77e28 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:11:47.166708 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6ef369c-5871-41b0-b126-d11bc9cef62d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.190970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:47.201107 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.216369 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d58ac843-d1e2-4af7-be0f-17dba0d90310 req-f1214b3b-72c4-4185-b98f-9707e97fe952 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 210 time: 0.1352980 May 12 15:11:47.228988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:11:47.279059 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-89713fa1-a765-41c8-8785-77ca5e3c22ba admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 2.4782705 May 12 15:11:47.279264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6e4e0cd-472d-45e7-afae-67d881138673 req-c4dbddfa-1cd7-4daa-9add-191d87172250 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3339834 May 12 15:11:47.291580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51918) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:47.293691 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6ef369c-5871-41b0-b126-d11bc9cef62d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.323937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Request body: {'router': {'name': 'tempest-ServersTestMultiNic-309743523-router', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:47.331319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-fb52840d-9bbb-41d8-beb2-82a8e29947d0', 'network_id': 'fb52840d-9bbb-41d8-beb2-82a8e29947d0', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'fixed_ips': [{'subnet_id': '005ae052-6cd6-4ddc-833f-af6e1c2bff40'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:11:47.332397 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.352502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Pushing event updated for resources: {'Port': ['ID=54f3ad03-fdf2-4862-93ff-f60efa594593,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:47.375357 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-29d11dba-7005-4428-90e9-b264c77a557e'] response: {'name': 'network-changed', 'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'status': 'completed', 'code': 200} May 12 15:11:47.380403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:47.453201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:47.454174 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.455802 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] 10.222.0.84 "PUT /v2.0/ports/fa933a35-7a96-4a45-bb36-afb53c7641b9 HTTP/1.1" status: 200 len: 1096 time: 5.0994906 May 12 15:11:47.494497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-278c6123-4b1f-43d9-9f98-d7f4064bf179 service neutron] Pushing event updated for resources: {'Port': ['ID=fa933a35-7a96-4a45-bb36-afb53c7641b9,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:47.508963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:47.509655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.529991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Usage tracker for resource:router and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:47.570135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:47.606045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:47.610599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Allocated IP 172.20.0.2 (fb52840d-9bbb-41d8-beb2-82a8e29947d0/005ae052-6cd6-4ddc-833f-af6e1c2bff40/1f5268c3-49af-4820-a5c3-93acb927124a) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:11:47.610801 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-b0057263-bf82-4ec6-9bce-48007cb77438 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.6201680 May 12 15:11:47.629826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-cdbbcc10-05e7-43be-8cb0-2288e749c3de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:47.631248 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-cdbbcc10-05e7-43be-8cb0-2288e749c3de service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.4781575 May 12 15:11:47.637083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Request body: {'port': {'device_id': '6a304fd0-80ef-4b27-86c5-a861e6627236', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:47.656995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Allocated IP 172.20.0.14 (dbc2e49c-2591-4534-a48c-cea8e23115f4/84c2082e-f394-46d5-8a8f-8e3a70d54fc1/f0d25bc9-ee34-4065-92d8-0ccb85b91668) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:11:47.754514 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.755947 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.786496 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6ef369c-5871-41b0-b126-d11bc9cef62d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.829509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-0a093eae-639a-47d9-8534-fe531f2c1bf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:47.831283 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-0a093eae-639a-47d9-8534-fe531f2c1bf7 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 1099 time: 0.3006747 May 12 15:11:47.835480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6ef369c-5871-41b0-b126-d11bc9cef62d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6427c6fb-1b24-45d7-8c27-29619bc2b4af,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:47.846171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-5207abc3-f6a6-4de0-bf4a-fa9937f45d39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:47.847638 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-5207abc3-f6a6-4de0-bf4a-fa9937f45d39 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 1098 time: 0.4614968 May 12 15:11:47.848570 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.851129 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.870878 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.910727 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:47.924035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Transition to ACTIVE for port object 1f5268c3-49af-4820-a5c3-93acb927124a will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:47.944524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Transition to ACTIVE for port object 1f5268c3-49af-4820-a5c3-93acb927124a will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:47.949144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-d9d79bef-6844-453a-8287-7b6afa968868 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.250&port_id=fa933a35-7a96-4a45-bb36-afb53c7641b9 HTTP/1.1" status: 200 len: 217 time: 0.0951939 May 12 15:11:47.951359 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:48.024107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Network fb52840d-9bbb-41d8-beb2-82a8e29947d0 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:11:48.025955 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:48.032452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:48.037470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:11:48.055643 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-35e352ba-6c62-4187-965d-a6d42cb92cd5 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3836663 May 12 15:11:48.125123 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Pushing event updated for resources: {'Port': ['ID=1f5268c3-49af-4820-a5c3-93acb927124a,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:48.144317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Attempting to bind port 1f5268c3-49af-4820-a5c3-93acb927124a on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:11:48.144645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Attempting to bind port 1f5268c3-49af-4820-a5c3-93acb927124a by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '3155d58f-cee0-46db-bac9-2d07d9e2fa60', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'fb52840d-9bbb-41d8-beb2-82a8e29947d0'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:11:48.144953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Attempting to bind port 1f5268c3-49af-4820-a5c3-93acb927124a on network fb52840d-9bbb-41d8-beb2-82a8e29947d0 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:48.150682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:11:48.151245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Checking segment: {'id': '3155d58f-cee0-46db-bac9-2d07d9e2fa60', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'fb52840d-9bbb-41d8-beb2-82a8e29947d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:48.151642 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:48.152057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Bound using segment: {'id': '3155d58f-cee0-46db-bac9-2d07d9e2fa60', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'fb52840d-9bbb-41d8-beb2-82a8e29947d0'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:11:48.152540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Bound port: 1f5268c3-49af-4820-a5c3-93acb927124a, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3155d58f-cee0-46db-bac9-2d07d9e2fa60', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'fb52840d-9bbb-41d8-beb2-82a8e29947d0'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:11:48.152919 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:48.258036 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] For port 1f5268c3-49af-4820-a5c3-93acb927124a, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:48.261816 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] For port 1f5268c3-49af-4820-a5c3-93acb927124a, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1f5268c3-49af-4820-a5c3-93acb927124a,segment=NetworkSegment(3155d58f-cee0-46db-bac9-2d07d9e2fa60),segment_id=3155d58f-cee0-46db-bac9-2d07d9e2fa60)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:11:48.268052 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:48.368918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43dd7eb9-6f0a-4138-89fb-60bc4e33e747 None None] Pushing event updated for resources: {'Port': ['ID=1f5268c3-49af-4820-a5c3-93acb927124a,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:48.405994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-07d14146-80db-4c6d-907f-9cc73f6f30e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:48.407447 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-07d14146-80db-4c6d-907f-9cc73f6f30e4 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.4298532 May 12 15:11:48.430669 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6ef369c-5871-41b0-b126-d11bc9cef62d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:48.431772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c6ef369c-5871-41b0-b126-d11bc9cef62d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6427c6fb-1b24-45d7-8c27-29619bc2b4af HTTP/1.1" status: 204 len: 168 time: 1.7614076 May 12 15:11:48.636356 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d29aabf-8ec7-4473-8717-d6add8f196c0 req-19bdd687-7d47-4439-9f48-7233cf1d3521 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5706580 May 12 15:11:48.646989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-96769326-871b-41a1-97b7-dc9f9a119d96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:48.648950 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-96769326-871b-41a1-97b7-dc9f9a119d96 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2290449 May 12 15:11:48.965201 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-61b14c61-f3e2-4de0-8ac1-cee0a21e4c58 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2654760 May 12 15:11:48.969529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-881af192-6e60-4b9e-8945-f9e58e469a76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:48.970653 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-881af192-6e60-4b9e-8945-f9e58e469a76 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 1098 time: 0.2325261 May 12 15:11:48.981704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be843fcf-aead-490c-8b0b-5346735a078e req-ef79a85c-aba2-454f-a452-e97a52fb8f7e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:48.988865 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be843fcf-aead-490c-8b0b-5346735a078e req-ef79a85c-aba2-454f-a452-e97a52fb8f7e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 948 time: 1.1480846 May 12 15:11:48.999003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-4b282bcc-2ea7-4349-a2cb-ce5de083046c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:49.000635 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-4b282bcc-2ea7-4349-a2cb-ce5de083046c service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 1.1097181 May 12 15:11:49.015145 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:49.136319 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-a2ca3ba6-f5f0-43df-a587-19361011e03d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859 HTTP/1.1" status: 200 len: 217 time: 0.0994027 May 12 15:11:49.182567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be843fcf-aead-490c-8b0b-5346735a078e req-0627bffc-494d-4ded-9c92-df2310725b5d tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1927390 May 12 15:11:49.198053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1f5268c3-49af-4820-a5c3-93acb927124a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:11:49.325816 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:49.329847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 54f3ad03-fdf2-4862-93ff-f60efa594593 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:11:49.342052 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:49.362883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f2adba-030a-4ead-b5b3-ebdad29125bf req-bcc2ce7d-5858-46c4-b321-d3c514cd42b2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:49.376364 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85f2adba-030a-4ead-b5b3-ebdad29125bf req-bcc2ce7d-5858-46c4-b321-d3c514cd42b2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 932 time: 1.3003719 May 12 15:11:49.386432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3ea64917-282e-46ab-bc5b-00e8f66e5176', 'tag': 'fa933a35-7a96-4a45-bb36-afb53c7641b9'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:49.386749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 1f5268c3-49af-4820-a5c3-93acb927124a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:49.435552 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ace4d584-5afd-4b2e-abdd-2f28f932671b req-9d250310-6a5e-4d37-a56f-c7f71f69d3b9 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4521749 May 12 15:11:49.437667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Transition to ACTIVE for port object 54f3ad03-fdf2-4862-93ff-f60efa594593 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:49.455781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:49.461853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-c4701b0d-0f20-4629-b90f-b83fbf8e80d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:49.463490 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-c4701b0d-0f20-4629-b90f-b83fbf8e80d5 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.4787018 May 12 15:11:49.573011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-101f6a7a-396a-4ba8-bea3-321b358c8a13 req-350dfbbd-be9f-4bf7-80e6-b73c9d7b813a tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Synchronizing usage tracker for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:11:49.602638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51954) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:49.607510 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-9692618d-b5f0-4b9c-b929-02483777fc41 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859 HTTP/1.1" status: 200 len: 217 time: 0.0769510 May 12 15:11:49.632498 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85f2adba-030a-4ead-b5b3-ebdad29125bf req-d067a920-8618-41c1-b4c8-3355428ff5b6 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2552481 May 12 15:11:49.637728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-0eec8b9f-eb84-47c3-920b-aba7f1694eb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:49.640179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-0eec8b9f-eb84-47c3-920b-aba7f1694eb7 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.4748642 May 12 15:11:49.664125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Router be64a9da-126d-4279-98a4-e0a9cc891b26 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:11:49.715135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-101f6a7a-396a-4ba8-bea3-321b358c8a13 req-350dfbbd-be9f-4bf7-80e6-b73c9d7b813a tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Unset dirty status for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:11:49.718830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79518a59-cdb4-4de1-ba1b-99f905610c07 None None] Network fb52840d-9bbb-41d8-beb2-82a8e29947d0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:11:49.724376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-101f6a7a-396a-4ba8-bea3-321b358c8a13 req-350dfbbd-be9f-4bf7-80e6-b73c9d7b813a tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 210 time: 0.3042696 May 12 15:11:49.798303 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-16a14be3-f6bf-4348-9d84-b42d1cd29597'] response: {'name': 'network-changed', 'server_uuid': '3ea64917-282e-46ab-bc5b-00e8f66e5176', 'tag': 'fa933a35-7a96-4a45-bb36-afb53c7641b9', 'status': 'completed', 'code': 200} May 12 15:11:49.869671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5bb953-732d-4b08-8ecd-e75a95d04414 None None] Provisioning for port 1f5268c3-49af-4820-a5c3-93acb927124a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:49.878244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5bb953-732d-4b08-8ecd-e75a95d04414 None None] Provisioning complete for port 1f5268c3-49af-4820-a5c3-93acb927124a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:49.878902 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5bb953-732d-4b08-8ecd-e75a95d04414 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:49.893160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Request body: {'network': {'name': 'tempest-FloatingIPsTestJSON-1092809323-network', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:49.912948 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:49.914981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:49.923316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Pushing event updated for resources: {'Port': ['ID=54f3ad03-fdf2-4862-93ff-f60efa594593,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:49.943303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-43e4ecd6-63d1-4141-8c42-7f2188c67232 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:49.944745 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-43e4ecd6-63d1-4141-8c42-7f2188c67232 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2489424 May 12 15:11:49.969370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Usage tracker for resource:network and tenant:4c3ee180ddb64a8685bd55247106d4cb is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:49.994994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:50.021540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:50.028894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Attempting to bind port 54f3ad03-fdf2-4862-93ff-f60efa594593 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:11:50.029743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Attempting to bind port 54f3ad03-fdf2-4862-93ff-f60efa594593 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:11:50.029743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Attempting to bind port 54f3ad03-fdf2-4862-93ff-f60efa594593 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:50.046574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Port 54f3ad03-fdf2-4862-93ff-f60efa594593 on network e8211761-0dd9-424f-b732-629fd2d77e28 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:11:50.046909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Attempting to bind port 54f3ad03-fdf2-4862-93ff-f60efa594593 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:50.057856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:11:50.058194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Checking segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:50.058576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Bound using segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:11:50.059006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Bound port: 54f3ad03-fdf2-4862-93ff-f60efa594593, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:11:50.059354 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:50.110517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-749543a1-7124-4dfa-97e3-784d2a45a867 req-7c9dff36-f828-473f-89d0-2778d112590c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:50.112146 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-749543a1-7124-4dfa-97e3-784d2a45a867 req-7c9dff36-f828-473f-89d0-2778d112590c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 1099 time: 0.2499180 May 12 15:11:50.124435 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Network dbc2e49c-2591-4534-a48c-cea8e23115f4 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:11:50.126392 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5bb953-732d-4b08-8ecd-e75a95d04414 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:50.138568 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:50.148332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:11:50.176604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5bb953-732d-4b08-8ecd-e75a95d04414 None None] For port 1f5268c3-49af-4820-a5c3-93acb927124a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1f5268c3-49af-4820-a5c3-93acb927124a,segment=NetworkSegment(3155d58f-cee0-46db-bac9-2d07d9e2fa60),segment_id=3155d58f-cee0-46db-bac9-2d07d9e2fa60)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:50.180858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Made reservation on behalf of 4c3ee180ddb64a8685bd55247106d4cb for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:50.183281 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:50.185509 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5bb953-732d-4b08-8ecd-e75a95d04414 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:50.212368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event updated for resources: {'Port': ['ID=f0d25bc9-ee34-4065-92d8-0ccb85b91668,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:50.236201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-ff30e625-21fc-4b29-b897-5d03440ca175 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:50.237736 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-ff30e625-21fc-4b29-b897-5d03440ca175 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.5874059 May 12 15:11:50.239686 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:50.290133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:11:50.319039 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Sync routers for ids ['be64a9da-126d-4279-98a4-e0a9cc891b26'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:11:50.351434 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Routers {'be64a9da-126d-4279-98a4-e0a9cc891b26'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:50.352318 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['be64a9da-126d-4279-98a4-e0a9cc891b26'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:50.355303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5bb953-732d-4b08-8ecd-e75a95d04414 None None] Pushing event updated for resources: {'Port': ['ID=1f5268c3-49af-4820-a5c3-93acb927124a,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:50.381698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-dd84afde-077f-4c83-b126-e412cb3e6816 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:50.383497 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-dd84afde-077f-4c83-b126-e412cb3e6816 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.4265857 May 12 15:11:50.548687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:50.571020 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Set router be64a9da-126d-4279-98a4-e0a9cc891b26 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:50.574162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=54f3ad03-fdf2-4862-93ff-f60efa594593,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:11:50.589883 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:50.636942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d3062001-a806-4b30-a6a0-0faad2fa753c None None] Provisioning complete for port 1f5268c3-49af-4820-a5c3-93acb927124a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:50.637631 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d3062001-a806-4b30-a6a0-0faad2fa753c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:50.643267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:50.647522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Usage tracker for resource:security_group_rule and tenant:4c3ee180ddb64a8685bd55247106d4cb is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:50.649662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-749543a1-7124-4dfa-97e3-784d2a45a867 req-d2369ff1-3617-4dfd-88b2-1644e6bc5fe0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:50.651165 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-749543a1-7124-4dfa-97e3-784d2a45a867 req-d2369ff1-3617-4dfd-88b2-1644e6bc5fe0 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.5317783 May 12 15:11:50.652562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:50.659493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:50.705355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:50.706906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:50.735452 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35381dab-7c44-4db6-989d-d151933aa304 req-e97ed5ec-efd4-41d4-a5e8-754f251f96f1 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:50.744480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35381dab-7c44-4db6-989d-d151933aa304 req-e97ed5ec-efd4-41d4-a5e8-754f251f96f1 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 947 time: 0.9820533 May 12 15:11:50.765649 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:50.767020 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a5bdd4c6-b276-4c9c-b7d0-4a0867f71235 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 10.5725846 May 12 15:11:50.786479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:50.791760 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:50.801053 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] 10.222.0.84 "PUT /v2.0/ports/54f3ad03-fdf2-4862-93ff-f60efa594593 HTTP/1.1" status: 200 len: 1092 time: 3.1677849 May 12 15:11:50.801959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51966) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:50.806552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-05cd2dd3-e62d-40a9-b0d3-331e1b2d91e0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 4.8645458 May 12 15:11:50.877219 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-749543a1-7124-4dfa-97e3-784d2a45a867 req-d0efda03-e752-408d-9e14-cf8f76ec3b2c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.250&port_id=fa933a35-7a96-4a45-bb36-afb53c7641b9 HTTP/1.1" status: 200 len: 217 time: 0.2120361 May 12 15:11:50.925151 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:11:46Z', 'revision_number': 3, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:43Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:50.930266 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Checking router: be64a9da-126d-4279-98a4-e0a9cc891b26 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:11:50.930766 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Updating router be64a9da-126d-4279-98a4-e0a9cc891b26 port a9fcd520-c18d-4516-9fc0-3db76c87dad6 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:11:50.963870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Request body: {'port': {'device_id': '15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:51.005971 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:51.112567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-759aac00-1859-430e-8515-66c37b74faad service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8609819 May 12 15:11:51.127635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1f5268c3-49af-4820-a5c3-93acb927124a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:11:51.133904 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35381dab-7c44-4db6-989d-d151933aa304 req-3661944f-0cf1-49a0-a76d-a475ad3c4d75 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3875308 May 12 15:11:51.168721 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:51.172029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-a108d944-4470-4c17-bd78-0f96db1efb54 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7757080 May 12 15:11:51.282569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 1f5268c3-49af-4820-a5c3-93acb927124a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:51.283310 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:51.284196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b8a2f27-1f62-43d7-80db-cb842dda364c service neutron] Pushing event updated for resources: {'Port': ['ID=54f3ad03-fdf2-4862-93ff-f60efa594593,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:51.297311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fbff35f-3072-4ea2-8fd9-6783ac864ef6 req-145a883f-08a7-4c33-892b-725f17dc0358 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:51.298966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8fbff35f-3072-4ea2-8fd9-6783ac864ef6 req-145a883f-08a7-4c33-892b-725f17dc0358 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 948 time: 0.7741046 May 12 15:11:51.475192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:51.502758 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:51.521034 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:51.535524 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Transition to ACTIVE for port object a9fcd520-c18d-4516-9fc0-3db76c87dad6 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:51.548791 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:51.553836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-749543a1-7124-4dfa-97e3-784d2a45a867 req-870a9b95-118b-4111-81c1-e04f21a23357 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:51.555346 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-749543a1-7124-4dfa-97e3-784d2a45a867 req-870a9b95-118b-4111-81c1-e04f21a23357 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.5779016 May 12 15:11:51.642629 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Attempting to bind port a9fcd520-c18d-4516-9fc0-3db76c87dad6 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:11:51.642960 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Attempting to bind port a9fcd520-c18d-4516-9fc0-3db76c87dad6 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:11:51.643410 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Attempting to bind port a9fcd520-c18d-4516-9fc0-3db76c87dad6 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:51.646209 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38e6ee3a-853e-4ac7-9603-fae97978ab24 None None] Pushing event updated for resources: {'Port': ['ID=a9fcd520-c18d-4516-9fc0-3db76c87dad6,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:51.655259 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:11:51.655942 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:51.656452 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:51.656929 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:11:51.657556 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Bound port: a9fcd520-c18d-4516-9fc0-3db76c87dad6, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:11:51.658049 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:51.691303 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38e6ee3a-853e-4ac7-9603-fae97978ab24 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:51.691812 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38e6ee3a-853e-4ac7-9603-fae97978ab24 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:51.692241 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38e6ee3a-853e-4ac7-9603-fae97978ab24 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:51.692659 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38e6ee3a-853e-4ac7-9603-fae97978ab24 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:51.694034 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38e6ee3a-853e-4ac7-9603-fae97978ab24 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:51.694535 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38e6ee3a-853e-4ac7-9603-fae97978ab24 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:51.695076 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38e6ee3a-853e-4ac7-9603-fae97978ab24 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:51.695569 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38e6ee3a-853e-4ac7-9603-fae97978ab24 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:51.696565 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38e6ee3a-853e-4ac7-9603-fae97978ab24 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:51.697281 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38e6ee3a-853e-4ac7-9603-fae97978ab24 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:51.697794 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38e6ee3a-853e-4ac7-9603-fae97978ab24 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:51.698228 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38e6ee3a-853e-4ac7-9603-fae97978ab24 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:11:51.740527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fa933a35-7a96-4a45-bb36-afb53c7641b9 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:11:51.756677 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-aec21fff-6336-4de9-8162-1d0eab06cf3a service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5500278 May 12 15:11:51.759151 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] For port a9fcd520-c18d-4516-9fc0-3db76c87dad6, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:51.763779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-e0c8532e-2e44-4e88-96f7-1fb58952375a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:51.765224 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] For port a9fcd520-c18d-4516-9fc0-3db76c87dad6, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a9fcd520-c18d-4516-9fc0-3db76c87dad6,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:11:51.765651 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-e0c8532e-2e44-4e88-96f7-1fb58952375a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 1095 time: 0.7892797 May 12 15:11:51.790867 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:51.826465 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:51.830463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6a304fd0-80ef-4b27-86c5-a861e6627236', 'tag': '54f3ad03-fdf2-4862-93ff-f60efa594593'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:51.846599 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8fbff35f-3072-4ea2-8fd9-6783ac864ef6 req-d8c628cb-8068-471e-b4a5-2504d86d9789 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3518491 May 12 15:11:51.896765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e7a5041-8509-407c-9095-95790297f6d2 req-5aac02ae-9365-4e1c-b8bd-61e53e5068f4 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:51.910452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e7a5041-8509-407c-9095-95790297f6d2 req-5aac02ae-9365-4e1c-b8bd-61e53e5068f4 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 944 time: 0.4736905 May 12 15:11:51.929875 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-e6351152-b188-4e81-aff1-5cd8d2c50259 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=54f3ad03-fdf2-4862-93ff-f60efa594593 HTTP/1.1" status: 200 len: 217 time: 0.0943098 May 12 15:11:51.939980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-749543a1-7124-4dfa-97e3-784d2a45a867 req-7937c358-0621-4252-b07d-cff69962285e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:51.941503 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-749543a1-7124-4dfa-97e3-784d2a45a867 req-7937c358-0621-4252-b07d-cff69962285e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.3771579 May 12 15:11:51.974417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port fa933a35-7a96-4a45-bb36-afb53c7641b9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fa933a35-7a96-4a45-bb36-afb53c7641b9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:51.976861 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38e6ee3a-853e-4ac7-9603-fae97978ab24 None None] Pushing event updated for resources: {'Port': ['ID=a9fcd520-c18d-4516-9fc0-3db76c87dad6,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:51.993298 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:52.000086 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Routers {'be64a9da-126d-4279-98a4-e0a9cc891b26'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:52.000944 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['be64a9da-126d-4279-98a4-e0a9cc891b26'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:52.012720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'fa933a35-7a96-4a45-bb36-afb53c7641b9', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'fa933a35-7a96-4a45-bb36-afb53c7641b9', 'mac_address': 'fa:16:3e:e1:63:a6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.250'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:11:52.017049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 596} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:11:52.027073 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:52.027546 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Added segment d6eafc19-f9db-4010-b69b-58d99283bc6a of type vlan for network cb55ee6d-0282-4fd1-b7e7-3686cea611b9 May 12 15:11:52.056043 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:52.112586 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:52.133787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fa933a35-7a96-4a45-bb36-afb53c7641b9 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:11:52.156809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port fa933a35-7a96-4a45-bb36-afb53c7641b9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fa933a35-7a96-4a45-bb36-afb53c7641b9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:52.165161 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:52.166572 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9787cef9-03af-4a15-af20-0eb8fe5ee859 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:11:52.218000 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] Set router be64a9da-126d-4279-98a4-e0a9cc891b26 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:52.229758 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=96195734-f583-4ac7-afd4-4d30a68ea7fe,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:52.253657 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:52.254628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:52.255300 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:52.307789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff0d5118-175a-4bcf-99a0-1373bc905fb9 req-433810bd-554f-4c3c-b5b6-712f40c53c4a service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.1816638 May 12 15:11:52.333113 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 2.7206998 May 12 15:11:52.336787 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51978) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:52.351469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Request body: {'subnet': {'network_id': 'cb55ee6d-0282-4fd1-b7e7-3686cea611b9', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPsTestJSON-1092809323-subnet', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:52.400805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=fa933a35-7a96-4a45-bb36-afb53c7641b9,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:52.405544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:52.422136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'mac_address': 'fa:16:3e:ab:63:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.38'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:11:52.424757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:52.438847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-acd48454-7dbf-4671-9d8f-6481e55c22fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:52.440310 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-acd48454-7dbf-4671-9d8f-6481e55c22fb service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.4954619 May 12 15:11:52.466140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Usage tracker for resource:subnet and tenant:4c3ee180ddb64a8685bd55247106d4cb is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:52.496385 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:52.509664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:52.519630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9787cef9-03af-4a15-af20-0eb8fe5ee859 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:11:52.540540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:52.544536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:52.548342 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:52.549501 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-f9425ff7-b12f-49ff-9941-b01e8acdece3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0846953 May 12 15:11:52.566041 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-749543a1-7124-4dfa-97e3-784d2a45a867 req-f0071609-04bf-487f-911b-ef7f4813ed58 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5743518 May 12 15:11:52.573214 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e7a5041-8509-407c-9095-95790297f6d2 req-87dd9dc1-c9a9-4e5e-b1c6-1da8d2cfd048 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6614408 May 12 15:11:52.591214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d2d75ac-8574-447b-aa8f-f315959f8192 admin admin] Pushing event updated for resources: {'Network': ['ID=cb55ee6d-0282-4fd1-b7e7-3686cea611b9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:52.592988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Allocated IP 172.25.8.34 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/fe3707b0-af9e-4644-80d0-b3821d828b3d) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:11:52.623966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network cb55ee6d-0282-4fd1-b7e7-3686cea611b9 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:11:52.716062 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-98c639a5-3fd4-4d9d-a7ba-d826fd99f583'] response: {'name': 'network-changed', 'server_uuid': '6a304fd0-80ef-4b27-86c5-a861e6627236', 'tag': '54f3ad03-fdf2-4862-93ff-f60efa594593', 'status': 'completed', 'code': 200} May 12 15:11:52.722512 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:11:46Z', 'revision_number': 3, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:52.727875 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3f51024-4547-4a0a-a412-6373c27ca191 None None] The sync data for ids ['be64a9da-126d-4279-98a4-e0a9cc891b26'] in n-d-841483-1 is: [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:11:46Z', 'revision_number': 3, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:11:52.782012 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:52.808409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Made reservation on behalf of 4c3ee180ddb64a8685bd55247106d4cb for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:52.812277 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:52.886668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3a00ba1-1d20-4fb8-9a81-e3d151c59f4d req-532ef196-e935-4f79-8f5b-a939d41e10f4 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:52.888074 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3a00ba1-1d20-4fb8-9a81-e3d151c59f4d req-532ef196-e935-4f79-8f5b-a939d41e10f4 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 932 time: 0.7975390 May 12 15:11:52.937501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['fa933a35-7a96-4a45-bb36-afb53c7641b9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:53.004988 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['9787cef9-03af-4a15-af20-0eb8fe5ee859'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:53.082197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3a00ba1-1d20-4fb8-9a81-e3d151c59f4d req-20447d64-92a9-478b-9e2e-0b577ea89df5 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1537333 May 12 15:11:53.157803 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:53.222350 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:53.274101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9985e0f6-ee87-40d7-ac22-bfc589dd3663 req-ddff66ad-c527-4bd0-b68f-c1fb68e28a47 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:53.275578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9985e0f6-ee87-40d7-ac22-bfc589dd3663 req-ddff66ad-c527-4bd0-b68f-c1fb68e28a47 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 948 time: 0.3988864 May 12 15:11:53.318980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a9fcd520-c18d-4516-9fc0-3db76c87dad6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:11:53.362784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f0d25bc9-ee34-4065-92d8-0ccb85b91668 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:11:53.392091 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:53.396767 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9985e0f6-ee87-40d7-ac22-bfc589dd3663 req-4005f170-dd1a-4f75-ad54-bf8cbd7abd4a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0960977 May 12 15:11:53.430790 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Transition to ACTIVE for port object f0d25bc9-ee34-4065-92d8-0ccb85b91668 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:53.454817 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:53.547957 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:53.562213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port a9fcd520-c18d-4516-9fc0-3db76c87dad6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:53.567728 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a9fcd520-c18d-4516-9fc0-3db76c87dad6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:53.568233 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:53.627618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:11:53.676328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Allocated IP 172.20.0.1 (13468259-dd20-42ac-88ec-2614ebea6ccc/4ecb64d7-7b16-437b-8f3e-4996d58043f6/60462079-9a62-4718-a485-d1d0aa343c39) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:11:53.685636 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-849e53fe-4b09-4c41-a38e-00cc500e0a17 service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.1259222 May 12 15:11:53.695358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:53.696574 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-749543a1-7124-4dfa-97e3-784d2a45a867 req-4064aaf9-bf49-4220-9f7a-cce19dd237e8 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.0951345 May 12 15:11:53.707368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:11:53.740841 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:53.764909 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port a9fcd520-c18d-4516-9fc0-3db76c87dad6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a9fcd520-c18d-4516-9fc0-3db76c87dad6,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:53.780477 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:53.832587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Pushing event updated for resources: {'Port': ['ID=fe3707b0-af9e-4644-80d0-b3821d828b3d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:53.879734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=a9fcd520-c18d-4516-9fc0-3db76c87dad6,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:53.987682 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:54.119567 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5df47818-1b8e-4d54-aa7b-0107559aa2fe req-e0037a05-efe7-4ced-93d8-531f92bf7ebc service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4256825 May 12 15:11:54.131364 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:54.150290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4d5b7d28-8e2d-474e-8eb6-dfe9b12d479f,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:54.167037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Pushing event updated for resources: {'Port': ['ID=f0d25bc9-ee34-4065-92d8-0ccb85b91668,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:54.203803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Transition to ACTIVE for port object 60462079-9a62-4718-a485-d1d0aa343c39 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:54.208247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Checking segment: {'id': 'd6eafc19-f9db-4010-b69b-58d99283bc6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': 'cb55ee6d-0282-4fd1-b7e7-3686cea611b9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:54.208591 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Network hostable DHCP agents. Network: cb55ee6d-0282-4fd1-b7e7-3686cea611b9, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:11:54.252967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Network cb55ee6d-0282-4fd1-b7e7-3686cea611b9 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:11:54.282528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Attempting to bind port f0d25bc9-ee34-4065-92d8-0ccb85b91668 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:11:54.283098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Attempting to bind port f0d25bc9-ee34-4065-92d8-0ccb85b91668 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:11:54.283238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Attempting to bind port f0d25bc9-ee34-4065-92d8-0ccb85b91668 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:54.314717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Port f0d25bc9-ee34-4065-92d8-0ccb85b91668 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:11:54.315080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Attempting to bind port f0d25bc9-ee34-4065-92d8-0ccb85b91668 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:54.326943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8cdc575-f699-4384-b69f-0b323b2c672b req-bb32b9a5-f129-4f82-85dd-b92343c0f0f3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:54.328477 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8cdc575-f699-4384-b69f-0b323b2c672b req-bb32b9a5-f129-4f82-85dd-b92343c0f0f3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 949 time: 0.6245332 May 12 15:11:54.340283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:11:54.340663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Checking segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:54.341059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Bound using segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:11:54.341539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Bound port: f0d25bc9-ee34-4065-92d8-0ccb85b91668, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:11:54.342035 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:54.432881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, cb55ee6d-0282-4fd1-b7e7-3686cea611b9) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:54.449849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:54.450319 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:54.461130 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:54.462599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cacc6b4e-ff9e-4061-97d7-666e28f51801 None None] Network cb55ee6d-0282-4fd1-b7e7-3686cea611b9 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:11:54.530780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-3b339718-4651-4c8b-a4d6-f2bc68f311a0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:54.531875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-3b339718-4651-4c8b-a4d6-f2bc68f311a0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Synchronizing usage tracker for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:11:54.559320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8cdc575-f699-4384-b69f-0b323b2c672b req-95c1ca52-8913-4602-984a-2268be78048f tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2202852 May 12 15:11:54.567302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edec29e1-c3b0-4dfb-9d60-6900f488b964 req-ea296330-9ed6-4aad-9bf0-487c4f5bd560 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:54.569131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-edec29e1-c3b0-4dfb-9d60-6900f488b964 req-ea296330-9ed6-4aad-9bf0-487c4f5bd560 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 944 time: 0.3553557 May 12 15:11:54.587035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Network 13468259-dd20-42ac-88ec-2614ebea6ccc is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:11:54.597879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:54.599876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Pushing event updated for resources: {'Port': ['ID=60462079-9a62-4718-a485-d1d0aa343c39,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:54.609216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-3b339718-4651-4c8b-a4d6-f2bc68f311a0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Unset dirty status for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:11:54.610811 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-3b339718-4651-4c8b-a4d6-f2bc68f311a0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.84 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1&tenant_id=0da54985cde346e68eeadf965b8bc6d3&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 948 time: 0.4616656 May 12 15:11:54.612394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:11:54.657255 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-daf8ee2b-a8de-405b-937c-0e4362ac4ec1 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 2.3161016 May 12 15:11:54.700658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51994) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:54.711535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Request body: {'router': {'name': 'tempest-FloatingIPsTestJSON-1092809323-router', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:54.762388 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:54.789559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-cb55ee6d-0282-4fd1-b7e7-3686cea611b9', 'network_id': 'cb55ee6d-0282-4fd1-b7e7-3686cea611b9', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'fixed_ips': [{'subnet_id': '4d5b7d28-8e2d-474e-8eb6-dfe9b12d479f'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:11:54.790847 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:54.792677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Usage tracker for resource:router and tenant:4c3ee180ddb64a8685bd55247106d4cb is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:54.803862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] For port f0d25bc9-ee34-4065-92d8-0ccb85b91668, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:54.819490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:54.840820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:54.851951 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:54.869774 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-edec29e1-c3b0-4dfb-9d60-6900f488b964 req-b51bb60d-a00a-4e5b-a15c-9dab6bf9e0b6 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2859328 May 12 15:11:54.871552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] For port f0d25bc9-ee34-4065-92d8-0ccb85b91668, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f0d25bc9-ee34-4065-92d8-0ccb85b91668,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:11:54.885689 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:54.965765 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:55.007550 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-8862d1e0-8a02-4161-bc65-d4157d257d3e service neutron] 10.222.0.84 "GET /v2.0/ports/9787cef9-03af-4a15-af20-0eb8fe5ee859/bindings/n-h1-841483-1 HTTP/1.1" status: 200 len: 382 time: 0.3484938 May 12 15:11:55.025773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109f5cdc-c978-48da-95f1-77f8e3deaea3 req-4a9587c9-6747-4d0d-92c5-790ddb98b950 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:55.027430 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-109f5cdc-c978-48da-95f1-77f8e3deaea3 req-4a9587c9-6747-4d0d-92c5-790ddb98b950 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 1095 time: 0.7633421 May 12 15:11:55.099333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Allocated IP 172.20.0.2 (cb55ee6d-0282-4fd1-b7e7-3686cea611b9/4d5b7d28-8e2d-474e-8eb6-dfe9b12d479f/2694e8ad-2c96-4f58-b898-cb226cd91d63) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:11:55.183082 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a9fcd520-c18d-4516-9fc0-3db76c87dad6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:11:55.195078 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:55.196066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:55.200294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109f5cdc-c978-48da-95f1-77f8e3deaea3 req-018bfb82-274a-4740-8cda-1c942b312f7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:55.202167 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-109f5cdc-c978-48da-95f1-77f8e3deaea3 req-018bfb82-274a-4740-8cda-1c942b312f7d service neutron] 10.222.0.84 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.1579370 May 12 15:11:55.215698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-deaab97f-06e5-427e-9f81-4ffddebac3e0 None None] Provisioning for port 60462079-9a62-4718-a485-d1d0aa343c39 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:55.244876 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-deaab97f-06e5-427e-9f81-4ffddebac3e0 None None] Provisioning complete for port 60462079-9a62-4718-a485-d1d0aa343c39 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:55.245241 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-deaab97f-06e5-427e-9f81-4ffddebac3e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:55.335333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:55.335991 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:55.337231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] 10.222.0.84 "PUT /v2.0/ports/f0d25bc9-ee34-4065-92d8-0ccb85b91668 HTTP/1.1" status: 200 len: 1092 time: 4.3776424 May 12 15:11:55.342998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f', 'tag': 'f0d25bc9-ee34-4065-92d8-0ccb85b91668'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:55.351738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-deaab97f-06e5-427e-9f81-4ffddebac3e0 None None] Port 60462079-9a62-4718-a485-d1d0aa343c39 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:11:55.382745 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-109f5cdc-c978-48da-95f1-77f8e3deaea3 req-e55a744c-5a72-479f-9a73-824802e35e32 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=54f3ad03-fdf2-4862-93ff-f60efa594593 HTTP/1.1" status: 200 len: 217 time: 0.1289928 May 12 15:11:55.421507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a9fcd520-c18d-4516-9fc0-3db76c87dad6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:55.421922 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:55.423490 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:55.505850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109f5cdc-c978-48da-95f1-77f8e3deaea3 req-260f9c67-3a9a-4cd2-8551-b9393213a308 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:55.507223 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-109f5cdc-c978-48da-95f1-77f8e3deaea3 req-260f9c67-3a9a-4cd2-8551-b9393213a308 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.1082451 May 12 15:11:55.515466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-8598e9f3-6e86-44a1-acd6-976cedd5919a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:55.517154 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-8598e9f3-6e86-44a1-acd6-976cedd5919a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 1099 time: 0.3125520 May 12 15:11:55.522375 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:55.522573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fc3cea7-415c-4f87-8b7d-1a75d3647765 service neutron] Pushing event updated for resources: {'Port': ['ID=f0d25bc9-ee34-4065-92d8-0ccb85b91668,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:55.539138 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Transition to ACTIVE for port object 2694e8ad-2c96-4f58-b898-cb226cd91d63 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:55.565785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Transition to ACTIVE for port object 2694e8ad-2c96-4f58-b898-cb226cd91d63 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:55.603425 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:55.625018 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-109f5cdc-c978-48da-95f1-77f8e3deaea3 req-5e00ad3a-de81-4d57-8840-312eda673463 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1050668 May 12 15:11:55.691344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Network cb55ee6d-0282-4fd1-b7e7-3686cea611b9 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:11:55.694473 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:55.698030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:11:55.704961 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Pushing event updated for resources: {'Port': ['ID=2694e8ad-2c96-4f58-b898-cb226cd91d63,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:55.774308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 54f3ad03-fdf2-4862-93ff-f60efa594593 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:11:55.777557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fa933a35-7a96-4a45-bb36-afb53c7641b9 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:11:55.808935 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:55.873070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Attempting to bind port 2694e8ad-2c96-4f58-b898-cb226cd91d63 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:11:55.874141 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Attempting to bind port 2694e8ad-2c96-4f58-b898-cb226cd91d63 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'd6eafc19-f9db-4010-b69b-58d99283bc6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': 'cb55ee6d-0282-4fd1-b7e7-3686cea611b9'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:11:55.874571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Attempting to bind port 2694e8ad-2c96-4f58-b898-cb226cd91d63 on network cb55ee6d-0282-4fd1-b7e7-3686cea611b9 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:11:55.936028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:11:55.936028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Checking segment: {'id': 'd6eafc19-f9db-4010-b69b-58d99283bc6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': 'cb55ee6d-0282-4fd1-b7e7-3686cea611b9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:11:55.936028 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:55.936028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Bound using segment: {'id': 'd6eafc19-f9db-4010-b69b-58d99283bc6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': 'cb55ee6d-0282-4fd1-b7e7-3686cea611b9'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:11:55.936592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Bound port: 2694e8ad-2c96-4f58-b898-cb226cd91d63, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd6eafc19-f9db-4010-b69b-58d99283bc6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': 'cb55ee6d-0282-4fd1-b7e7-3686cea611b9'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:11:55.936715 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:55.942652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebc3fa60-dcff-45ba-a43a-aba58161774d req-05005281-601b-4f58-9d8c-5244dacb3236 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:55.944528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ebc3fa60-dcff-45ba-a43a-aba58161774d req-05005281-601b-4f58-9d8c-5244dacb3236 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/ports?device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 946 time: 0.7424786 May 12 15:11:55.953161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-6996bb51-b051-4088-b395-05e5815943bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:55.953845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10f6504c-7d39-42df-ae0a-827d48152575 req-6bcd25b9-63bf-4f32-aa57-48f416add68a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:55.954167 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-6996bb51-b051-4088-b395-05e5815943bc service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.3884819 May 12 15:11:55.954919 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10f6504c-7d39-42df-ae0a-827d48152575 req-6bcd25b9-63bf-4f32-aa57-48f416add68a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 948 time: 0.7517068 May 12 15:11:55.977991 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-109f5cdc-c978-48da-95f1-77f8e3deaea3 req-1754c344-3480-4334-a028-39bcea38b5be service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2994852 May 12 15:11:55.978481 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:56.042093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port fa933a35-7a96-4a45-bb36-afb53c7641b9 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:56.069344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port fa933a35-7a96-4a45-bb36-afb53c7641b9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:56.069730 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:56.088561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-7158ce40-9a39-4937-a859-ca0f1044a3f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:56.090020 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-7158ce40-9a39-4937-a859-ca0f1044a3f5 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 1095 time: 0.6430509 May 12 15:11:56.103119 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-be640e8f-06bf-4aee-ba3e-34611b539e16 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859 HTTP/1.1" status: 200 len: 217 time: 0.1282091 May 12 15:11:56.140198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=54f3ad03-fdf2-4862-93ff-f60efa594593,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:56.155641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] For port 2694e8ad-2c96-4f58-b898-cb226cd91d63, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:11:56.175726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] For port 2694e8ad-2c96-4f58-b898-cb226cd91d63, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2694e8ad-2c96-4f58-b898-cb226cd91d63,segment=NetworkSegment(d6eafc19-f9db-4010-b69b-58d99283bc6a),segment_id=d6eafc19-f9db-4010-b69b-58d99283bc6a)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:11:56.176864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '54f3ad03-fdf2-4862-93ff-f60efa594593', 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28', 'port_id': '54f3ad03-fdf2-4862-93ff-f60efa594593', 'mac_address': 'fa:16:3e:6a:7c:3c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 579, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ed7d4325-c4dc-4592-8d41-1f3fe41da585', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:11:56.215327 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:56.237860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-1a2d7d46-b2f6-4cd4-8822-99f94ec8112d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f0d25bc9-ee34-4065-92d8-0ccb85b91668 HTTP/1.1" status: 200 len: 217 time: 0.1268897 May 12 15:11:56.240194 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:56.255042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10f6504c-7d39-42df-ae0a-827d48152575 req-27c3a3ee-cc19-42c3-a8a2-0180f074651a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2888758 May 12 15:11:56.390951 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:56.415889 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:56.423439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-e859802e-6551-4f72-89c3-aac8b3c69fb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:56.424866 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-e859802e-6551-4f72-89c3-aac8b3c69fb1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0741353 May 12 15:11:56.435566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 54f3ad03-fdf2-4862-93ff-f60efa594593 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:11:56.453832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64fb5f65-e114-4789-8a17-3f0660be0c6c None None] Pushing event updated for resources: {'Port': ['ID=2694e8ad-2c96-4f58-b898-cb226cd91d63,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:56.463725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ebc3fa60-dcff-45ba-a43a-aba58161774d req-f438453a-cb32-4f46-83c5-ef9ecc34b4bc tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/security-groups?id=4db559d6-6ff9-4f01-9ab9-98bc9279fdd7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4964876 May 12 15:11:56.470717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ea64917-282e-46ab-bc5b-00e8f66e5176', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fa933a35-7a96-4a45-bb36-afb53c7641b9'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:11:56.488935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=54f3ad03-fdf2-4862-93ff-f60efa594593,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:56.493162 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port fa933a35-7a96-4a45-bb36-afb53c7641b9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fa933a35-7a96-4a45-bb36-afb53c7641b9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:56.502259 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:56.563072 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:56.563845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9787cef9-03af-4a15-af20-0eb8fe5ee859 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:11:56.643528 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-109f5cdc-c978-48da-95f1-77f8e3deaea3 req-d428911c-f5f1-4585-840e-24a41cd31f9e service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6001074 May 12 15:11:56.648525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-f98fdce8-896f-4edb-ba49-f54950cb213d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:56.650004 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-f98fdce8-896f-4edb-ba49-f54950cb213d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2100465 May 12 15:11:56.691692 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:56.695690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=54f3ad03-fdf2-4862-93ff-f60efa594593,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:56.751530 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:56.812611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 9787cef9-03af-4a15-af20-0eb8fe5ee859 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:56.819933 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 9787cef9-03af-4a15-af20-0eb8fe5ee859 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:56.820221 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:56.841899 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7f3a598d-de32-4cfc-9082-dd6ae649f72c'] response: {'name': 'network-changed', 'server_uuid': '15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f', 'tag': 'f0d25bc9-ee34-4065-92d8-0ccb85b91668', 'status': 'completed', 'code': 200} May 12 15:11:56.847147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-4c27b029-92aa-4afa-a08e-f82751e96f1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:56.848629 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-4c27b029-92aa-4afa-a08e-f82751e96f1c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.5885944 May 12 15:11:56.852269 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=fa933a35-7a96-4a45-bb36-afb53c7641b9,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:56.915711 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:56.924653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Pushing event updated for resources: {'Port': ['ID=60462079-9a62-4718-a485-d1d0aa343c39,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:56.933631 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['54f3ad03-fdf2-4862-93ff-f60efa594593'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:11:56.992835 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-2a5ec3c1-be68-4493-b8df-b79a76a50e98 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0968356 May 12 15:11:57.020871 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:57.083299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:57.099778 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:57.191801 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-467e28eb-3ff3-41cf-9803-8d121a7fbca4 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4765894 May 12 15:11:57.230464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7cc0b87-0a97-436b-8645-28a2001e5bba req-af75100f-af50-4649-b0bd-125295f26641 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:57.232076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:57.240304 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7cc0b87-0a97-436b-8645-28a2001e5bba req-af75100f-af50-4649-b0bd-125295f26641 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 944 time: 0.7414584 May 12 15:11:57.250259 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2694e8ad-2c96-4f58-b898-cb226cd91d63 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:11:57.372697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8340d28d-5e02-4615-84f7-33f225f64c12 req-e8497f8f-20d3-46f6-99b1-e418f6e7c293 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:57.376765 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8340d28d-5e02-4615-84f7-33f225f64c12 req-e8497f8f-20d3-46f6-99b1-e418f6e7c293 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 950 time: 0.5315282 May 12 15:11:57.389522 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 2694e8ad-2c96-4f58-b898-cb226cd91d63 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:57.399737 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7cc0b87-0a97-436b-8645-28a2001e5bba req-395976df-b98a-45c5-8808-b824b2e38951 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1556456 May 12 15:11:57.403050 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-615714bc-0224-4f5e-aa7b-42b43e8dfa19 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3459885 May 12 15:11:57.437861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Network 13468259-dd20-42ac-88ec-2614ebea6ccc is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:11:57.440461 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-4f82504c-0bb7-4ab0-b5f7-d65ce5790063 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2077506 May 12 15:11:57.441611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:57.609241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Router 56048083-24ed-41eb-868c-2140c7b486c8 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:11:57.695711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Router be64a9da-126d-4279-98a4-e0a9cc891b26 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:11:57.793668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bfad367e-0a3e-4866-9574-90982e1d3d67 None None] Provisioning complete for port 60462079-9a62-4718-a485-d1d0aa343c39 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:57.794164 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bfad367e-0a3e-4866-9574-90982e1d3d67 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:57.855462 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0958290-afa7-49b4-b495-63fa501e2e82 None None] Network cb55ee6d-0282-4fd1-b7e7-3686cea611b9 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:11:57.882470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8340d28d-5e02-4615-84f7-33f225f64c12 req-4e5b3bd6-f674-4874-a3ca-c188989507fc tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4971926 May 12 15:11:57.888537 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:11:57.900384 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-07e3bc26-4ff2-4fdc-aa42-a24c2223831a admin admin] 10.222.0.82 "PUT /v2.0/routers/be64a9da-126d-4279-98a4-e0a9cc891b26/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.0319369 May 12 15:11:57.996178 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-70e9f92b-25c2-4209-a28f-b6e5d7726d80'] response: {'server_uuid': '3ea64917-282e-46ab-bc5b-00e8f66e5176', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fa933a35-7a96-4a45-bb36-afb53c7641b9', 'code': 200} May 12 15:11:58.000650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Sync routers for ids ['be64a9da-126d-4279-98a4-e0a9cc891b26'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:11:58.020330 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bfad367e-0a3e-4866-9574-90982e1d3d67 None None] Port 60462079-9a62-4718-a485-d1d0aa343c39 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:11:58.036794 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Routers {'be64a9da-126d-4279-98a4-e0a9cc891b26'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:58.037496 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['be64a9da-126d-4279-98a4-e0a9cc891b26'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:58.039198 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:58.178621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9eb7a1d-355d-43c1-a1f3-a336801dd16d req-5d4966a6-358e-48cc-b003-4680a5df1e67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:58.180992 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c9eb7a1d-355d-43c1-a1f3-a336801dd16d req-5d4966a6-358e-48cc-b003-4680a5df1e67 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 1101 time: 0.1295364 May 12 15:11:58.211882 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:58.291168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0a39f1bd-aec7-4476-bd7a-9afba6cc3e3a None None] Provisioning for port 2694e8ad-2c96-4f58-b898-cb226cd91d63 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:58.337573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0a39f1bd-aec7-4476-bd7a-9afba6cc3e3a None None] Provisioning complete for port 2694e8ad-2c96-4f58-b898-cb226cd91d63 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:58.337946 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0a39f1bd-aec7-4476-bd7a-9afba6cc3e3a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:58.340492 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c9eb7a1d-355d-43c1-a1f3-a336801dd16d req-c89132e4-02c6-4df6-8a86-3909bf165d26 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1431375 May 12 15:11:58.358029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9a1d1ae7-0046-4a28-91ac-712cd0e832e4 req-d4af7ba5-44e4-4838-9d0f-8b96c9c0f2ee service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9b2b4b7d-231c-4e54-83f4-827d02cbcbb5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.1591668 May 12 15:11:58.372752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Allocated IP 172.25.8.23 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/f6107f32-e7d6-4f41-bfa1-9d4697d1809b) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:11:58.462312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Set router be64a9da-126d-4279-98a4-e0a9cc891b26 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:58.464306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406b3323-80da-4eee-82af-4055f92b8982 req-10c82298-217b-4e7d-abf1-fd7199b1f4c4 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:58.471849 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-406b3323-80da-4eee-82af-4055f92b8982 req-10c82298-217b-4e7d-abf1-fd7199b1f4c4 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 945 time: 0.8863974 May 12 15:11:58.498737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:11:58.513370 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Sync routers for ids ['56048083-24ed-41eb-868c-2140c7b486c8'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:11:58.522466 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Routers {'56048083-24ed-41eb-868c-2140c7b486c8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:11:58.523061 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['56048083-24ed-41eb-868c-2140c7b486c8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:58.538289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b179acc-4eff-487d-92e1-f186b4b3f57f req-1b79ebef-dc54-4faf-909e-57930f9a7c93 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.1183748 May 12 15:11:58.694659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52030) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:58.696754 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:11:58.702886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Request body: {'network': {'name': 'tempest-TaggedBootDevicesTest_v242-265683194-network', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:11:58.714841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:58.722796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Usage tracker for resource:network and tenant:0e49c03c26594e7fa192a1a667415ff3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:58.727044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:58.732294 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Set router 56048083-24ed-41eb-868c-2140c7b486c8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:11:58.735728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:58.799383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Made reservation on behalf of 0e49c03c26594e7fa192a1a667415ff3 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:11:58.802462 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:58.804894 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0a39f1bd-aec7-4476-bd7a-9afba6cc3e3a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:58.824924 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:58.845145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:11:58.849925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Usage tracker for resource:security_group_rule and tenant:0e49c03c26594e7fa192a1a667415ff3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:11:58.853151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:11:58.863357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:11:58.864221 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:58.915367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0a39f1bd-aec7-4476-bd7a-9afba6cc3e3a None None] For port 2694e8ad-2c96-4f58-b898-cb226cd91d63, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2694e8ad-2c96-4f58-b898-cb226cd91d63,segment=NetworkSegment(d6eafc19-f9db-4010-b69b-58d99283bc6a),segment_id=d6eafc19-f9db-4010-b69b-58d99283bc6a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:11:58.924787 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0a39f1bd-aec7-4476-bd7a-9afba6cc3e3a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.015442 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.036552 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.064654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bae103a-959b-475a-9a4e-cb2f8a59f12a req-6e1cc8d8-e8d4-4c1b-87dd-3e368212136a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:59.067826 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5bae103a-959b-475a-9a4e-cb2f8a59f12a req-6e1cc8d8-e8d4-4c1b-87dd-3e368212136a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.9388006 May 12 15:11:59.074798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a39f1bd-aec7-4476-bd7a-9afba6cc3e3a None None] Pushing event updated for resources: {'Port': ['ID=2694e8ad-2c96-4f58-b898-cb226cd91d63,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:59.076223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6948a56f-1582-47bb-8204-45bc3d46bc6f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:59.086508 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-406b3323-80da-4eee-82af-4055f92b8982 req-9ad373aa-82b4-4396-afef-6da31507610a tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6134765 May 12 15:11:59.113525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a1d1ae7-0046-4a28-91ac-712cd0e832e4 req-49d2babd-f963-439f-aa12-66e614632edb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:59.114441 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9a1d1ae7-0046-4a28-91ac-712cd0e832e4 req-49d2babd-f963-439f-aa12-66e614632edb service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=9b2b4b7d-231c-4e54-83f4-827d02cbcbb5 HTTP/1.1" status: 200 len: 1101 time: 0.3647637 May 12 15:11:59.122924 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 562} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:11:59.137444 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:11:55Z', 'revision_number': 4, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '60462079-9a62-4718-a485-d1d0aa343c39', 'name': '', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'mac_address': 'fa:16:3e:09:47:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_interface', 'standard_attr_id': 861, 'fixed_ips': [{'subnet_id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:53Z', 'updated_at': '2022-05-12T15:11:55Z', 'revision_number': 2, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'subnets': [{'id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:59.145765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Checking router: be64a9da-126d-4279-98a4-e0a9cc891b26 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:11:59.146660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Updating router be64a9da-126d-4279-98a4-e0a9cc891b26 port 60462079-9a62-4718-a485-d1d0aa343c39 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:11:59.155338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30d6494b-83a9-4570-b33c-4e13d6f585e8 req-85a7d1d8-3e99-47ff-b415-30414b9d59a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:59.157358 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30d6494b-83a9-4570-b33c-4e13d6f585e8 req-85a7d1d8-3e99-47ff-b415-30414b9d59a1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 1095 time: 0.2478499 May 12 15:11:59.161950 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.184673 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '56048083-24ed-41eb-868c-2140c7b486c8', 'name': 'tempest-ServersTestMultiNic-309743523-router', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34'}], 'enable_snat': True}, 'gw_port_id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:47Z', 'updated_at': '2022-05-12T15:11:54Z', 'revision_number': 3, 'project_id': '1aea6927c780448b89ddf44ec6bcb186', 'gw_port': {'id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '56048083-24ed-41eb-868c-2140c7b486c8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 857, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:51Z', 'updated_at': '2022-05-12T15:11:52Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:11:59.190809 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Checking router: 56048083-24ed-41eb-868c-2140c7b486c8 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:11:59.191628 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Updating router 56048083-24ed-41eb-868c-2140c7b486c8 port fe3707b0-af9e-4644-80d0-b3821d828b3d binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:11:59.211082 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.300903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:11:59.302198 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.302931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-602e6c60-5960-4118-a62f-3c3da23d1b4d None None] Provisioning complete for port 2694e8ad-2c96-4f58-b898-cb226cd91d63 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:59.303393 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6ecdf83c-9cb8-47d4-937c-b727f5307573 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 11.9988804 May 12 15:11:59.303939 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-602e6c60-5960-4118-a62f-3c3da23d1b4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.307772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52036) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:59.334055 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.442661 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.443255 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Added segment b6ca0527-0ae0-46e1-98b3-d59b1f312d8d of type vlan for network aceafe3e-7a49-42ba-b541-5d9652123c2b May 12 15:11:59.548488 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.584258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Pushing event updated for resources: {'Port': ['ID=f6107f32-e7d6-4f41-bfa1-9d4697d1809b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:11:59.598961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:11:59.601544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:11:59.606547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a1d1ae7-0046-4a28-91ac-712cd0e832e4 req-572c26a8-8d7d-4d92-b789-ac8cca2aa1c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:59.608590 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9a1d1ae7-0046-4a28-91ac-712cd0e832e4 req-572c26a8-8d7d-4d92-b789-ac8cca2aa1c1 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.4653289 May 12 15:11:59.644927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30d6494b-83a9-4570-b33c-4e13d6f585e8 req-a2bc85b7-6f71-4639-8030-1c876fda50e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:59.646741 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30d6494b-83a9-4570-b33c-4e13d6f585e8 req-a2bc85b7-6f71-4639-8030-1c876fda50e8 service neutron] 10.222.0.84 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 907 time: 0.4740448 May 12 15:11:59.739294 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.740759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:11:59.741342 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.773626 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9a1d1ae7-0046-4a28-91ac-712cd0e832e4 req-aae13839-a184-4e60-a10c-d17a4c3b1a24 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.195&port_id=83a7b910-a912-4e05-9d03-5d6b1f6b0edc HTTP/1.1" status: 200 len: 217 time: 0.1526277 May 12 15:11:59.788764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 54f3ad03-fdf2-4862-93ff-f60efa594593 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:11:59.872465 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 1.1758878 May 12 15:11:59.874371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52042) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:11:59.877960 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.886976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30d6494b-83a9-4570-b33c-4e13d6f585e8 req-763511ec-6c9a-4970-a7fc-59a377dedfdf service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f0d25bc9-ee34-4065-92d8-0ccb85b91668 HTTP/1.1" status: 200 len: 217 time: 0.1697326 May 12 15:11:59.902858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 54f3ad03-fdf2-4862-93ff-f60efa594593 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:11:59.907356 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5bae103a-959b-475a-9a4e-cb2f8a59f12a req-07bd9fa9-e8d6-400f-a93b-57c661f8de5b tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8197739 May 12 15:11:59.914416 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Transition to ACTIVE for port object fe3707b0-af9e-4644-80d0-b3821d828b3d will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:11:59.924891 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 54f3ad03-fdf2-4862-93ff-f60efa594593 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:11:59.925539 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.936234 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:11:59.997976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-758340c7-1780-4c34-9c0b-3f6b22cac415 admin admin] Pushing event updated for resources: {'Network': ['ID=aceafe3e-7a49-42ba-b541-5d9652123c2b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:00.004795 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Request body: {'subnet': {'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TaggedBootDevicesTest_v242-265683194-subnet', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:00.054139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a1d1ae7-0046-4a28-91ac-712cd0e832e4 req-568f6acc-1f43-4180-86a0-aeb106ea578c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:00.055749 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9a1d1ae7-0046-4a28-91ac-712cd0e832e4 req-568f6acc-1f43-4180-86a0-aeb106ea578c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2609026 May 12 15:12:00.059418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:00.100146 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-280081d6-d05f-4c34-b78e-a1b8f36611ef None None] Pushing event updated for resources: {'Port': ['ID=fe3707b0-af9e-4644-80d0-b3821d828b3d,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:00.115594 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Attempting to bind port fe3707b0-af9e-4644-80d0-b3821d828b3d on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:00.115594 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Attempting to bind port fe3707b0-af9e-4644-80d0-b3821d828b3d by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:00.115594 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Attempting to bind port fe3707b0-af9e-4644-80d0-b3821d828b3d on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:00.117256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:00.121820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network aceafe3e-7a49-42ba-b541-5d9652123c2b details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:12:00.131836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Usage tracker for resource:subnet and tenant:0e49c03c26594e7fa192a1a667415ff3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:00.137520 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:00.137872 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:00.138306 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:00.138706 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:00.139845 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Bound port: fe3707b0-af9e-4644-80d0-b3821d828b3d, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:00.142494 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:00.147344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:00.155797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:00.191344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Made reservation on behalf of 0e49c03c26594e7fa192a1a667415ff3 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:00.193836 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:00.287626 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] For port fe3707b0-af9e-4644-80d0-b3821d828b3d, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:00.290919 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] For port fe3707b0-af9e-4644-80d0-b3821d828b3d, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fe3707b0-af9e-4644-80d0-b3821d828b3d,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:00.305051 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:00.424258 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Routers {'56048083-24ed-41eb-868c-2140c7b486c8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:00.424883 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['56048083-24ed-41eb-868c-2140c7b486c8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:00.461065 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:00.502229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a1d1ae7-0046-4a28-91ac-712cd0e832e4 req-bdd8c206-f109-4ae5-adcd-4249f646be24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:00.503880 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9a1d1ae7-0046-4a28-91ac-712cd0e832e4 req-bdd8c206-f109-4ae5-adcd-4249f646be24 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.4366426 May 12 15:12:00.509799 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:00.521157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Transition to ACTIVE for port object 60462079-9a62-4718-a485-d1d0aa343c39 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:00.540971 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:00.573507 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:00.644579 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-280081d6-d05f-4c34-b78e-a1b8f36611ef None None] Pushing event updated for resources: {'Port': ['ID=fe3707b0-af9e-4644-80d0-b3821d828b3d,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:00.687365 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] Set router 56048083-24ed-41eb-868c-2140c7b486c8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:00.708097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4081ed9c-dabb-4f65-a1dc-a63a854f2f4a,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:00.770522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Checking segment: {'id': 'b6ca0527-0ae0-46e1-98b3-d59b1f312d8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:00.771578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Network hostable DHCP agents. Network: aceafe3e-7a49-42ba-b541-5d9652123c2b, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:12:00.783472 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=54f3ad03-fdf2-4862-93ff-f60efa594593,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:00.820968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c7bccdf-857e-420c-be91-ab7ccfb87ecc None None] Pushing event updated for resources: {'Port': ['ID=60462079-9a62-4718-a485-d1d0aa343c39,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:00.830214 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:00.858029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9a1d1ae7-0046-4a28-91ac-712cd0e832e4 req-9302d65b-9087-4024-bf6e-21bb4251494e service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3412249 May 12 15:12:00.908534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Network aceafe3e-7a49-42ba-b541-5d9652123c2b is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:12:00.975948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Attempting to bind port 60462079-9a62-4718-a485-d1d0aa343c39 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:00.976339 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Attempting to bind port 60462079-9a62-4718-a485-d1d0aa343c39 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:00.976667 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Attempting to bind port 60462079-9a62-4718-a485-d1d0aa343c39 on network 13468259-dd20-42ac-88ec-2614ebea6ccc {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:00.987565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:00.987936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Checking segment: {'id': 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:00.988319 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:00.988704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Bound using segment: {'id': 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:00.989168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Bound port: 60462079-9a62-4718-a485-d1d0aa343c39, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:00.989561 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:01.019205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, aceafe3e-7a49-42ba-b541-5d9652123c2b) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:01.043967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:01.045134 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:01.046858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=54f3ad03-fdf2-4862-93ff-f60efa594593,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:01.057713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3722f098-7d25-4444-adb5-7527decbc441 None None] Network aceafe3e-7a49-42ba-b541-5d9652123c2b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:12:01.104951 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3c8bfeb1-eeb7-43b0-9b90-e7e7b873c073 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.1062884 May 12 15:12:01.106758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52052) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:01.114137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Request body: {'router': {'name': 'tempest-TaggedBootDevicesTest_v242-265683194-router', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:01.124211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:01.137405 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30d6494b-83a9-4570-b33c-4e13d6f585e8 req-fc36e064-2882-4b4b-9f32-ffe531ed3124 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:01.137405 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30d6494b-83a9-4570-b33c-4e13d6f585e8 req-fc36e064-2882-4b4b-9f32-ffe531ed3124 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 1.2071452 May 12 15:12:01.141966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Usage tracker for resource:router and tenant:0e49c03c26594e7fa192a1a667415ff3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:01.146650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:01.156062 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9a1d1ae7-0046-4a28-91ac-712cd0e832e4 req-5ca283dd-1bc8-4073-9f3e-e83573052ca3 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2876577 May 12 15:12:01.157176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:01.187768 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:01.189802 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:01.191168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2694e8ad-2c96-4f58-b898-cb226cd91d63 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:01.214730 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:01.308986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] For port 60462079-9a62-4718-a485-d1d0aa343c39, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:01.328254 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2694e8ad-2c96-4f58-b898-cb226cd91d63 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:01.328637 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:01.330910 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '56048083-24ed-41eb-868c-2140c7b486c8', 'name': 'tempest-ServersTestMultiNic-309743523-router', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34'}], 'enable_snat': True}, 'gw_port_id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:47Z', 'updated_at': '2022-05-12T15:11:54Z', 'revision_number': 3, 'project_id': '1aea6927c780448b89ddf44ec6bcb186', 'gw_port': {'id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '56048083-24ed-41eb-868c-2140c7b486c8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 857, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:51Z', 'updated_at': '2022-05-12T15:12:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:01.364091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] For port 60462079-9a62-4718-a485-d1d0aa343c39, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=60462079-9a62-4718-a485-d1d0aa343c39,segment=NetworkSegment(a64e84dc-d91c-44e1-ab35-6c9b54a1b65b),segment_id=a64e84dc-d91c-44e1-ab35-6c9b54a1b65b)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:01.396636 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:01.424293 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c8f355e-d563-42fb-a3f4-df3eed51b83f None None] The sync data for ids ['56048083-24ed-41eb-868c-2140c7b486c8'] in n-d-841483-1 is: [{'id': '56048083-24ed-41eb-868c-2140c7b486c8', 'name': 'tempest-ServersTestMultiNic-309743523-router', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34'}], 'enable_snat': True}, 'gw_port_id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:47Z', 'updated_at': '2022-05-12T15:11:54Z', 'revision_number': 3, 'project_id': '1aea6927c780448b89ddf44ec6bcb186', 'gw_port': {'id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '56048083-24ed-41eb-868c-2140c7b486c8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 857, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:51Z', 'updated_at': '2022-05-12T15:12:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:12:01.489100 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30d6494b-83a9-4570-b33c-4e13d6f585e8 req-5efc5ce4-098d-4a3f-b8f6-596c1d14d944 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1560998 May 12 15:12:01.509285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f3e818a-0d2c-40dd-bc48-bb40499ee3c4 req-5f37ddf4-f2c1-4f99-9243-ac50a8dc70b2 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:01.522095 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f3e818a-0d2c-40dd-bc48-bb40499ee3c4 req-5f37ddf4-f2c1-4f99-9243-ac50a8dc70b2 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 944 time: 1.8714781 May 12 15:12:01.605265 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Routers {'be64a9da-126d-4279-98a4-e0a9cc891b26'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:01.606114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['be64a9da-126d-4279-98a4-e0a9cc891b26'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:01.634972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-378de103-a1dd-4345-bb99-a6946eee1ce5 req-686d3fbe-9330-45f9-82c6-6a1a5e125e9e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:01.636567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-378de103-a1dd-4345-bb99-a6946eee1ce5 req-686d3fbe-9330-45f9-82c6-6a1a5e125e9e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 950 time: 1.3905687 May 12 15:12:01.647621 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:01.686650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-aceafe3e-7a49-42ba-b541-5d9652123c2b', 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'fixed_ips': [{'subnet_id': '4081ed9c-dabb-4f65-a1dc-a63a854f2f4a'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:12:01.687837 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:01.892513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f0d25bc9-ee34-4065-92d8-0ccb85b91668 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:12:01.892513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9787cef9-03af-4a15-af20-0eb8fe5ee859 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:12:01.993208 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-378de103-a1dd-4345-bb99-a6946eee1ce5 req-0f5895a4-158f-4061-a7f8-f3d2192574aa tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3090289 May 12 15:12:01.995519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-27f84c9e-453a-44ce-a5c6-ff6e7dcd98f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:01.997092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-27f84c9e-453a-44ce-a5c6-ff6e7dcd98f7 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1&tenant_id=0da54985cde346e68eeadf965b8bc6d3 HTTP/1.1" status: 200 len: 1100 time: 0.9027231 May 12 15:12:02.028336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:02.058788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c7bccdf-857e-420c-be91-ab7ccfb87ecc None None] Pushing event updated for resources: {'Port': ['ID=60462079-9a62-4718-a485-d1d0aa343c39,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:02.114895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30d6494b-83a9-4570-b33c-4e13d6f585e8 req-2cf612c8-413c-46c5-9a94-5aba9b8cc967 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5746155 May 12 15:12:02.117825 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f3e818a-0d2c-40dd-bc48-bb40499ee3c4 req-5709e001-4210-4dfa-9cb4-65f66d80f604 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5949361 May 12 15:12:02.136258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] Set router be64a9da-126d-4279-98a4-e0a9cc891b26 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:02.347129 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:02.385585 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:02.415875 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30d6494b-83a9-4570-b33c-4e13d6f585e8 req-632099fd-7252-4f02-a528-a2a35efeef02 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1590173 May 12 15:12:02.497288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Allocated IP 172.20.0.2 (aceafe3e-7a49-42ba-b541-5d9652123c2b/4081ed9c-dabb-4f65-a1dc-a63a854f2f4a/5c46c678-2e72-48d4-9add-5571a817d0fe) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:02.506341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-4fcbd00e-6c34-4bb2-9835-c834d22e909a tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:02.507802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-4fcbd00e-6c34-4bb2-9835-c834d22e909a tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.76 "GET /v2.0/ports?device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 946 time: 1.4190023 May 12 15:12:02.572969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Allocated IP 172.25.8.245 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/49fa16f5-ab90-402d-8b5a-04aca0a68917) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:02.602550 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:02.622265 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:02.792634 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:02.797957 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:02.827973 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:02.902360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:02.906014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:02.910624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:02.923407 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:02.944786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Pushing event updated for resources: {'Port': ['ID=49fa16f5-ab90-402d-8b5a-04aca0a68917,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:03.007727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Deleting port b916a765-866f-4478-817f-f3e33e79f873 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:03.008131 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:03.069532 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port f0d25bc9-ee34-4065-92d8-0ccb85b91668, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f0d25bc9-ee34-4065-92d8-0ccb85b91668,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:03.099126 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:03.117336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:03.117883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49d24628-4755-45a7-9208-cf26668689be req-adc02332-795c-4a3b-8da0-03c94c551ddf tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:03.118319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'f0d25bc9-ee34-4065-92d8-0ccb85b91668', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'port_id': 'f0d25bc9-ee34-4065-92d8-0ccb85b91668', 'mac_address': 'fa:16:3e:f5:c5:78', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 558, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84c2082e-f394-46d5-8a8f-8e3a70d54fc1', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:12:03.119272 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49d24628-4755-45a7-9208-cf26668689be req-adc02332-795c-4a3b-8da0-03c94c551ddf tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 946 time: 0.6862993 May 12 15:12:03.172666 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:03.225615 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:03.259819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Transition to ACTIVE for port object 5c46c678-2e72-48d4-9add-5571a817d0fe will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:03.268178 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4326caea-885b-4111-b621-2ef3ff057c7b req-094d3fe1-968b-4e68-b09d-26f5d53c0be0 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:03.270565 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4326caea-885b-4111-b621-2ef3ff057c7b req-094d3fe1-968b-4e68-b09d-26f5d53c0be0 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/ports?device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 946 time: 1.0629411 May 12 15:12:03.274376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fe3707b0-af9e-4644-80d0-b3821d828b3d up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:03.333978 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:03.406940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Transition to ACTIVE for port object 5c46c678-2e72-48d4-9add-5571a817d0fe will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:03.414977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f0d25bc9-ee34-4065-92d8-0ccb85b91668 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:03.416072 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:03.434611 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:03.439898 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:11:55Z', 'revision_number': 4, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '60462079-9a62-4718-a485-d1d0aa343c39', 'name': '', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'mac_address': 'fa:16:3e:09:47:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_interface', 'standard_attr_id': 861, 'fixed_ips': [{'subnet_id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:53Z', 'updated_at': '2022-05-12T15:12:01Z', 'revision_number': 4, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'subnets': [{'id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:03.443003 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=10']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:03.494843 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cb20cbb-6cf4-4bcf-a8a8-1cd48fa008a1 None None] The sync data for ids ['be64a9da-126d-4279-98a4-e0a9cc891b26'] in n-d-841483-1 is: [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:11:55Z', 'revision_number': 4, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '60462079-9a62-4718-a485-d1d0aa343c39', 'name': '', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'mac_address': 'fa:16:3e:09:47:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_interface', 'standard_attr_id': 861, 'fixed_ips': [{'subnet_id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:53Z', 'updated_at': '2022-05-12T15:12:01Z', 'revision_number': 4, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'subnets': [{'id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:12:03.520773 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port f0d25bc9-ee34-4065-92d8-0ccb85b91668, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f0d25bc9-ee34-4065-92d8-0ccb85b91668,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:03.533262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Network aceafe3e-7a49-42ba-b541-5d9652123c2b is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:03.538798 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:03.540728 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:03.546475 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49d24628-4755-45a7-9208-cf26668689be req-d94d088a-cf25-4fb9-bf97-05e6760f5998 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3740826 May 12 15:12:03.547834 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:03.683070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Pushing event updated for resources: {'Port': ['ID=5c46c678-2e72-48d4-9add-5571a817d0fe,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:03.758197 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1c5f8787-5ee9-4e11-b3d2-15d87a393841'] response: {'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'code': 200} May 12 15:12:03.775514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port fe3707b0-af9e-4644-80d0-b3821d828b3d completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:03.807651 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port fe3707b0-af9e-4644-80d0-b3821d828b3d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:03.808193 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:03.815651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4326caea-885b-4111-b621-2ef3ff057c7b req-d6a8ff7d-4140-4b25-b487-bd6deb90500c tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/security-groups?id=4db559d6-6ff9-4f01-9ab9-98bc9279fdd7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4135845 May 12 15:12:03.899227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Attempting to bind port 5c46c678-2e72-48d4-9add-5571a817d0fe on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:03.899624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Attempting to bind port 5c46c678-2e72-48d4-9add-5571a817d0fe by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'b6ca0527-0ae0-46e1-98b3-d59b1f312d8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:03.899960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Attempting to bind port 5c46c678-2e72-48d4-9add-5571a817d0fe on network aceafe3e-7a49-42ba-b541-5d9652123c2b {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:03.909293 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:03.970561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:03.971289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Checking segment: {'id': 'b6ca0527-0ae0-46e1-98b3-d59b1f312d8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:03.971289 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:03.971682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Bound using segment: {'id': 'b6ca0527-0ae0-46e1-98b3-d59b1f312d8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:03.972152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Bound port: 5c46c678-2e72-48d4-9add-5571a817d0fe, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b6ca0527-0ae0-46e1-98b3-d59b1f312d8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:03.972514 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:04.014469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=f0d25bc9-ee34-4065-92d8-0ccb85b91668,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:04.172965 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:04.229094 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:04.238739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Allocated IP 172.20.0.1 (fb52840d-9bbb-41d8-beb2-82a8e29947d0/005ae052-6cd6-4ddc-833f-af6e1c2bff40/9003ae7a-c261-4797-a9b3-af884e53a88b) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:04.325859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] For port 5c46c678-2e72-48d4-9add-5571a817d0fe, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:04.331245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] For port 5c46c678-2e72-48d4-9add-5571a817d0fe, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5c46c678-2e72-48d4-9add-5571a817d0fe,segment=NetworkSegment(b6ca0527-0ae0-46e1-98b3-d59b1f312d8d),segment_id=b6ca0527-0ae0-46e1-98b3-d59b1f312d8d)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:04.351780 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:04.369111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port fe3707b0-af9e-4644-80d0-b3821d828b3d, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fe3707b0-af9e-4644-80d0-b3821d828b3d,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:04.382150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] For port b916a765-866f-4478-817f-f3e33e79f873, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b916a765-866f-4478-817f-f3e33e79f873,segment=NetworkSegment(0f481a89-826f-4a90-903d-276e9b18feb1),segment_id=0f481a89-826f-4a90-903d-276e9b18feb1)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:04.382595 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:04.441134 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:04.449700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Router 301de57f-75b6-4323-a891-da62f7306fd1 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:12:04.530917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bf7c158-4f34-434e-89fd-54b506a740ff None None] Pushing event updated for resources: {'Port': ['ID=5c46c678-2e72-48d4-9add-5571a817d0fe,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:04.678130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=fe3707b0-af9e-4644-80d0-b3821d828b3d,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:04.680145 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:04.704585 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:04.736754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec196399-6c13-4eff-a559-159bc8191682 req-bb07bb88-d433-44c8-8f68-4ad3caa60cd6 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:04.743820 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec196399-6c13-4eff-a559-159bc8191682 req-bb07bb88-d433-44c8-8f68-4ad3caa60cd6 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 948 time: 0.8112779 May 12 15:12:04.748000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:12:04.759247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Sync routers for ids ['301de57f-75b6-4323-a891-da62f7306fd1'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:12:04.772257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Routers {'301de57f-75b6-4323-a891-da62f7306fd1'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:04.772890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['301de57f-75b6-4323-a891-da62f7306fd1'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:04.788342 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:04.789747 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-757b193c-86a3-443d-8ec0-9db59588170d admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 3.6818447 May 12 15:12:04.793059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52064) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:05.069921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Set router 301de57f-75b6-4323-a891-da62f7306fd1 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:05.216480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a9039c-55ac-4447-a6a1-430f6a90f67d req-ef7112e5-a65d-485c-836a-fe82c3906ae0 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:05.218461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5a9039c-55ac-4447-a6a1-430f6a90f67d req-ef7112e5-a65d-485c-836a-fe82c3906ae0 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 1101 time: 1.1441431 May 12 15:12:05.219778 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:12:05.271530 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec196399-6c13-4eff-a559-159bc8191682 req-08b7a442-7ef3-4eba-bcf8-212373885641 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5267420 May 12 15:12:05.408390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5c46c678-2e72-48d4-9add-5571a817d0fe up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:05.492367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:05.555727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 5c46c678-2e72-48d4-9add-5571a817d0fe completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:05.571079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 60462079-9a62-4718-a485-d1d0aa343c39 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:05.656200 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:05.656576 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:05.656886 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Floating IP bf15d665-374d-49cc-aa1b-7297db778487 disassociated. External IP: 172.25.8.163, port: b916a765-866f-4478-817f-f3e33e79f873. May 12 15:12:05.657229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Calling delete_port for b916a765-866f-4478-817f-f3e33e79f873 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:05.659584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 60462079-9a62-4718-a485-d1d0aa343c39 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:05.666227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '301de57f-75b6-4323-a891-da62f7306fd1', 'name': 'tempest-TaggedBootDevicesTest_v242-265683194-router', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245'}], 'enable_snat': True}, 'gw_port_id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:12:01Z', 'updated_at': '2022-05-12T15:12:03Z', 'revision_number': 3, 'project_id': '0e49c03c26594e7fa192a1a667415ff3', 'gw_port': {'id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:49:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '301de57f-75b6-4323-a891-da62f7306fd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 875, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:02Z', 'updated_at': '2022-05-12T15:12:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:05.668197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 60462079-9a62-4718-a485-d1d0aa343c39 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:05.668816 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:05.704817 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:05.759559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Checking router: 301de57f-75b6-4323-a891-da62f7306fd1 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:12:05.759890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Updating router 301de57f-75b6-4323-a891-da62f7306fd1 port 49fa16f5-ab90-402d-8b5a-04aca0a68917 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:12:05.793039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a304fd0-80ef-4b27-86c5-a861e6627236', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '54f3ad03-fdf2-4862-93ff-f60efa594593'}, {'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:05.799087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f0d25bc9-ee34-4065-92d8-0ccb85b91668 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:05.843680 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:05.868443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de78f167-6ac9-4b9d-8059-333ed0cb2179 None None] Network aceafe3e-7a49-42ba-b541-5d9652123c2b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:12:05.954994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9787cef9-03af-4a15-af20-0eb8fe5ee859 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:05.964655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Transition to ACTIVE for port object 9003ae7a-c261-4797-a9b3-af884e53a88b will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:05.975009 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:05.993916 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5a9039c-55ac-4447-a6a1-430f6a90f67d req-58af0552-bcad-42da-9806-e83b92a77edb tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7516043 May 12 15:12:06.043772 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:06.082243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Transition to ACTIVE for port object 9787cef9-03af-4a15-af20-0eb8fe5ee859 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:06.086365 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:06.126660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8c6c28d1-fda5-4e93-8288-cc1f238de961 None None] Provisioning for port 5c46c678-2e72-48d4-9add-5571a817d0fe completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:06.127245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Allocated IP 172.20.0.1 (aceafe3e-7a49-42ba-b541-5d9652123c2b/4081ed9c-dabb-4f65-a1dc-a63a854f2f4a/78867492-bce0-46a9-bcbd-e2e2cbd76ff5) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:06.141800 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:06.159398 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8c6c28d1-fda5-4e93-8288-cc1f238de961 None None] Provisioning complete for port 5c46c678-2e72-48d4-9add-5571a817d0fe triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:06.159768 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8c6c28d1-fda5-4e93-8288-cc1f238de961 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:06.183781 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:06.188342 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:06.205870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Router c3b59b75-f7cf-49f3-b6b3-5a717f23c43d is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:12:06.236625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Pushing event deleted for resources: {'Port': ['ID=b916a765-866f-4478-817f-f3e33e79f873,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:06.368277 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:06.391258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Transition to ACTIVE for port object 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:06.428823 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:06.454659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Network fb52840d-9bbb-41d8-beb2-82a8e29947d0 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:06.499392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Network aceafe3e-7a49-42ba-b541-5d9652123c2b is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:06.506085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:06.508397 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 60462079-9a62-4718-a485-d1d0aa343c39, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=60462079-9a62-4718-a485-d1d0aa343c39,segment=NetworkSegment(a64e84dc-d91c-44e1-ab35-6c9b54a1b65b),segment_id=a64e84dc-d91c-44e1-ab35-6c9b54a1b65b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:06.508600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:06.531203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b916a765-866f-4478-817f-f3e33e79f873 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:12:06.610713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Pushing event updated for resources: {'Port': ['ID=78867492-bce0-46a9-bcbd-e2e2cbd76ff5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:06.616396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:06.616749 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:06.617574 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fe3707b0-af9e-4644-80d0-b3821d828b3d up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:06.619086 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:06.660672 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:06.714777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] No DVR routers for this DVR port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:12:06.740742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port f0d25bc9-ee34-4065-92d8-0ccb85b91668 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:06.775175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: b916a765-866f-4478-817f-f3e33e79f873 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:12:06.775524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b916a765-866f-4478-817f-f3e33e79f873 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:12:06.785942 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:06.802562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b19af2b-9d4a-4b36-8394-98746be8f3de req-52d95936-bb4b-48e1-83a6-1b8521ecda16 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:06.809970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b19af2b-9d4a-4b36-8394-98746be8f3de req-52d95936-bb4b-48e1-83a6-1b8521ecda16 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 945 time: 0.9976184 May 12 15:12:06.855591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port f0d25bc9-ee34-4065-92d8-0ccb85b91668 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:06.856259 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:06.962044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=60462079-9a62-4718-a485-d1d0aa343c39,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:06.976510 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8c6c28d1-fda5-4e93-8288-cc1f238de961 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:07.083945 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:07.090568 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:07.108892 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:07.179301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8c6c28d1-fda5-4e93-8288-cc1f238de961 None None] For port 5c46c678-2e72-48d4-9add-5571a817d0fe, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5c46c678-2e72-48d4-9add-5571a817d0fe,segment=NetworkSegment(b6ca0527-0ae0-46e1-98b3-d59b1f312d8d),segment_id=b6ca0527-0ae0-46e1-98b3-d59b1f312d8d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:07.195913 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8c6c28d1-fda5-4e93-8288-cc1f238de961 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:07.202990 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:07.206564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Pushing event updated for resources: {'Port': ['ID=78867492-bce0-46a9-bcbd-e2e2cbd76ff5,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:07.224560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=11']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:07.257509 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port fe3707b0-af9e-4644-80d0-b3821d828b3d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:07.258337 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:07.355884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Network aceafe3e-7a49-42ba-b541-5d9652123c2b is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:07.357096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:07.443295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Attempting to bind port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:07.443624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Attempting to bind port 9787cef9-03af-4a15-af20-0eb8fe5ee859 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:07.444197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Attempting to bind port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:07.462083 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:07.483624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:12:07.483950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Attempting to bind port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:07.486647 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c6c28d1-fda5-4e93-8288-cc1f238de961 None None] Pushing event updated for resources: {'Port': ['ID=5c46c678-2e72-48d4-9add-5571a817d0fe,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:07.489299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Router ea3f04a0-308b-4219-ad26-2924d153122f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:12:07.507865 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fd03e074-cded-4606-b888-1de1527da48e None None] Provisioning for port 9003ae7a-c261-4797-a9b3-af884e53a88b completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:07.516683 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b19af2b-9d4a-4b36-8394-98746be8f3de req-3d4d302e-f2c4-42b4-8851-7ee67777ec6b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7057393 May 12 15:12:07.541333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fd03e074-cded-4606-b888-1de1527da48e None None] Provisioning complete for port 9003ae7a-c261-4797-a9b3-af884e53a88b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:07.541914 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fd03e074-cded-4606-b888-1de1527da48e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:07.575537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:07.577124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:07.577124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:07.577995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Bound port: 9787cef9-03af-4a15-af20-0eb8fe5ee859, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:07.579063 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:07.618305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Router 301de57f-75b6-4323-a891-da62f7306fd1 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:12:07.640481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:12:07.642280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Pushing event updated for resources: {'Port': ['ID=9003ae7a-c261-4797-a9b3-af884e53a88b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:07.646624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port f0d25bc9-ee34-4065-92d8-0ccb85b91668, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f0d25bc9-ee34-4065-92d8-0ccb85b91668,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:07.661841 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Sync routers for ids ['c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:12:07.681341 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Routers {'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:07.682355 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:07.696153 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:07.841072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f323022b-55b5-472e-879c-651454cc52e6 req-78e97203-185d-48ee-bc00-12c986d55a48 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:07.843193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f323022b-55b5-472e-879c-651454cc52e6 req-78e97203-185d-48ee-bc00-12c986d55a48 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 946 time: 1.6093159 May 12 15:12:07.859628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:12:07.874525 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fd03e074-cded-4606-b888-1de1527da48e None None] Port 9003ae7a-c261-4797-a9b3-af884e53a88b cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:12:07.880513 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:07.896088 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2acc9098-9546-4405-b4a5-8f9ff629859d admin admin] 10.222.0.82 "PUT /v2.0/routers/301de57f-75b6-4323-a891-da62f7306fd1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1006320 May 12 15:12:07.921444 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Transition to ACTIVE for port object 49fa16f5-ab90-402d-8b5a-04aca0a68917 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:07.928061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=f0d25bc9-ee34-4065-92d8-0ccb85b91668,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:07.946583 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:07.994880 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5c46c678-2e72-48d4-9add-5571a817d0fe up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:07.998945 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Set router c3b59b75-f7cf-49f3-b6b3-5a717f23c43d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:08.031174 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:08.032487 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d5e1ac7d-a400-4779-94f6-d9d0c9e88e1d admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 13.3257346 May 12 15:12:08.036776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52080) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:08.166969 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6169a1b7-d540-46b4-8bd6-0ab4b0f14146 None None] Pushing event updated for resources: {'Port': ['ID=49fa16f5-ab90-402d-8b5a-04aca0a68917,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:08.175493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Attempting to bind port 49fa16f5-ab90-402d-8b5a-04aca0a68917 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:08.175956 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Attempting to bind port 49fa16f5-ab90-402d-8b5a-04aca0a68917 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:08.176362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Attempting to bind port 49fa16f5-ab90-402d-8b5a-04aca0a68917 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:08.181756 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-76a0d842-358a-4644-9bf0-e7ce3ab4ba77 None None] Provisioning for port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:08.199799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-76a0d842-358a-4644-9bf0-e7ce3ab4ba77 None None] Provisioning complete for port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:08.200446 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-76a0d842-358a-4644-9bf0-e7ce3ab4ba77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:08.236226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:08.236654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:08.237028 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:08.237465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:08.238217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Bound port: 49fa16f5-ab90-402d-8b5a-04aca0a68917, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:08.238607 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:08.258366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f323022b-55b5-472e-879c-651454cc52e6 req-12ea2e9e-4766-4350-87e5-46f01d992652 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2109907 May 12 15:12:08.260518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-56da1ddb-6fac-436e-b684-76cfc05663c3 req-9382171d-6061-4523-a319-6515c1b8fd6a tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Synchronizing usage tracker for tenant:a673d571317840e888b6cfe5a121092e on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:12:08.267232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:08.302695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-56da1ddb-6fac-436e-b684-76cfc05663c3 req-9382171d-6061-4523-a319-6515c1b8fd6a tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Unset dirty status for tenant:a673d571317840e888b6cfe5a121092e on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:12:08.312160 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56da1ddb-6fac-436e-b684-76cfc05663c3 req-9382171d-6061-4523-a319-6515c1b8fd6a tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/ports?device_id=8403f3e5-d02f-4cd4-b73d-21cd47e6f139 HTTP/1.1" status: 200 len: 210 time: 0.5784562 May 12 15:12:08.344043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:08.388984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-76a0d842-358a-4644-9bf0-e7ce3ab4ba77 None None] Port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:12:08.418793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 5c46c678-2e72-48d4-9add-5571a817d0fe triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:08.419136 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:08.503595 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ab53d601-0c36-4266-8f34-fe5146171f74'] response: {'server_uuid': '6a304fd0-80ef-4b27-86c5-a861e6627236', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '54f3ad03-fdf2-4862-93ff-f60efa594593', 'code': 200} May 12 15:12:08.503851 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ab53d601-0c36-4266-8f34-fe5146171f74'] response: {'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'code': 200} May 12 15:12:08.531209 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:08.578689 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-76a0d842-358a-4644-9bf0-e7ce3ab4ba77 None None] Provisioning complete for port 5c46c678-2e72-48d4-9add-5571a817d0fe triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:08.579373 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-76a0d842-358a-4644-9bf0-e7ce3ab4ba77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:08.621265 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] For port 49fa16f5-ab90-402d-8b5a-04aca0a68917, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:08.655726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] For port 49fa16f5-ab90-402d-8b5a-04aca0a68917, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=49fa16f5-ab90-402d-8b5a-04aca0a68917,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:08.675137 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:08.696413 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'name': 'tempest-FloatingIPsTestJSON-1092809323-router', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.23'}], 'enable_snat': True}, 'gw_port_id': 'f6107f32-e7d6-4f41-bfa1-9d4697d1809b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:55Z', 'updated_at': '2022-05-12T15:12:01Z', 'revision_number': 3, 'project_id': '4c3ee180ddb64a8685bd55247106d4cb', 'gw_port': {'id': 'f6107f32-e7d6-4f41-bfa1-9d4697d1809b', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:ec:87:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 864, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.23', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:58Z', 'updated_at': '2022-05-12T15:11:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:08.705474 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Checking router: c3b59b75-f7cf-49f3-b6b3-5a717f23c43d for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:12:08.705812 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Updating router c3b59b75-f7cf-49f3-b6b3-5a717f23c43d port f6107f32-e7d6-4f41-bfa1-9d4697d1809b binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:12:08.771269 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:08.811818 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:08.876434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Routers {'301de57f-75b6-4323-a891-da62f7306fd1'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:08.877310 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['301de57f-75b6-4323-a891-da62f7306fd1'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:08.938714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:12:09.110990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-765ca0d4-59ae-42da-9012-f7011c1e5eca tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.5807459 May 12 15:12:09.125846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:09.126547 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:09.127943 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] 10.222.0.76 "PUT /v2.0/ports/9787cef9-03af-4a15-af20-0eb8fe5ee859 HTTP/1.1" status: 200 len: 1096 time: 7.1044753 May 12 15:12:09.131787 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:09.155361 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Transition to ACTIVE for port object f6107f32-e7d6-4f41-bfa1-9d4697d1809b will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:09.164115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6169a1b7-d540-46b4-8bd6-0ab4b0f14146 None None] Pushing event updated for resources: {'Port': ['ID=49fa16f5-ab90-402d-8b5a-04aca0a68917,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:09.165915 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:09.192023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 60462079-9a62-4718-a485-d1d0aa343c39 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:09.195582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:09.221943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6171040f-a3cb-4610-ba94-01d6cddf7d82 None None] Sync routers for ids ['ea3f04a0-308b-4219-ad26-2924d153122f'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:12:09.329683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6171040f-a3cb-4610-ba94-01d6cddf7d82 None None] Routers {'ea3f04a0-308b-4219-ad26-2924d153122f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:09.330422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6171040f-a3cb-4610-ba94-01d6cddf7d82 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ea3f04a0-308b-4219-ad26-2924d153122f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:09.344963 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Attempting to bind port f6107f32-e7d6-4f41-bfa1-9d4697d1809b on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:09.345357 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Attempting to bind port f6107f32-e7d6-4f41-bfa1-9d4697d1809b by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:09.347153 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Attempting to bind port f6107f32-e7d6-4f41-bfa1-9d4697d1809b on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:09.362154 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 11, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:09.362618 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:09.362901 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:09.363281 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:09.366866 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Bound port: f6107f32-e7d6-4f41-bfa1-9d4697d1809b, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:09.370137 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:09.426373 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec32a1f4-1169-4254-bfdd-1b9f9a424319 None None] Pushing event updated for resources: {'Port': ['ID=f6107f32-e7d6-4f41-bfa1-9d4697d1809b,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:09.483595 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] For port f6107f32-e7d6-4f41-bfa1-9d4697d1809b, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:09.487319 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] For port f6107f32-e7d6-4f41-bfa1-9d4697d1809b, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f6107f32-e7d6-4f41-bfa1-9d4697d1809b,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:09.501680 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:09.620593 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec32a1f4-1169-4254-bfdd-1b9f9a424319 None None] Pushing event updated for resources: {'Port': ['ID=f6107f32-e7d6-4f41-bfa1-9d4697d1809b,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:09.667905 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Routers {'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:09.668788 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:09.762149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 60462079-9a62-4718-a485-d1d0aa343c39 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:09.762392 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:09.815807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] Set router 301de57f-75b6-4323-a891-da62f7306fd1 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:09.860547 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:09.886359 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] Set router c3b59b75-f7cf-49f3-b6b3-5a717f23c43d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:09.971096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-6171040f-a3cb-4610-ba94-01d6cddf7d82 None None] Set router ea3f04a0-308b-4219-ad26-2924d153122f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:09.995527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-b26b1191-5fec-47b6-9eb7-31c2274ede49 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:09.997259 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-b26b1191-5fec-47b6-9eb7-31c2274ede49 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.7863889 May 12 15:12:10.013124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] No DVR routers for this DVR port b916a765-866f-4478-817f-f3e33e79f873 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:12:10.021270 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:10.023376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3017d1fc-f4bb-46ea-9f3e-9c03925b85ee req-cf2cfd13-d14c-425c-acd0-b161962c7038 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.76 "DELETE /v2.0/ports/b916a765-866f-4478-817f-f3e33e79f873 HTTP/1.1" status: 204 len: 173 time: 7.4572997 May 12 15:12:10.196448 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73b16023-aa90-436e-a50f-f2fac2d2c543 service neutron] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=12']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:10.228428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Allocated IP 172.20.0.1 (cb55ee6d-0282-4fd1-b7e7-3686cea611b9/4d5b7d28-8e2d-474e-8eb6-dfe9b12d479f/fac623c3-0b49-4481-af00-ce11553f25e2) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:10.232195 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-46130d1d-67e2-4d82-9704-5ec418be9d75 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/quotas/fa4eac6b8c464c45aa3c550e59a0d34b HTTP/1.1" status: 200 len: 375 time: 0.2129579 May 12 15:12:10.256246 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'name': 'tempest-FloatingIPsTestJSON-1092809323-router', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.23'}], 'enable_snat': True}, 'gw_port_id': 'f6107f32-e7d6-4f41-bfa1-9d4697d1809b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:55Z', 'updated_at': '2022-05-12T15:12:01Z', 'revision_number': 3, 'project_id': '4c3ee180ddb64a8685bd55247106d4cb', 'gw_port': {'id': 'f6107f32-e7d6-4f41-bfa1-9d4697d1809b', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:ec:87:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 864, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.23', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:58Z', 'updated_at': '2022-05-12T15:12:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:10.264972 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c025d05-7dc1-4b60-a488-f5711d311a3c None None] The sync data for ids ['c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'] in n-d-841483-1 is: [{'id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'name': 'tempest-FloatingIPsTestJSON-1092809323-router', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.23'}], 'enable_snat': True}, 'gw_port_id': 'f6107f32-e7d6-4f41-bfa1-9d4697d1809b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:55Z', 'updated_at': '2022-05-12T15:12:01Z', 'revision_number': 3, 'project_id': '4c3ee180ddb64a8685bd55247106d4cb', 'gw_port': {'id': 'f6107f32-e7d6-4f41-bfa1-9d4697d1809b', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:ec:87:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 864, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.23', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:58Z', 'updated_at': '2022-05-12T15:12:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:12:10.308491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0dbdb7e0-979c-4179-99f0-581ca0d0e884 None None] Provisioning complete for port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:10.308491 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0dbdb7e0-979c-4179-99f0-581ca0d0e884 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:10.355643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6343499b-329c-48c9-aa5b-1276d6bcf821 req-6fb5904d-6ed5-4e82-b974-d460a0b4108e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:10.358229 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6343499b-329c-48c9-aa5b-1276d6bcf821 req-6fb5904d-6ed5-4e82-b974-d460a0b4108e service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 1097 time: 1.5012481 May 12 15:12:10.427813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e3fef88-6539-4825-8e95-4602a8a86c44 req-ce3b1975-e55b-4f34-800b-d6b0850e9b2e tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:10.430528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1e3fef88-6539-4825-8e95-4602a8a86c44 req-ce3b1975-e55b-4f34-800b-d6b0850e9b2e tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 948 time: 1.5261576 May 12 15:12:10.437194 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:10.469961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-e738f803-268d-448a-bb40-612983f3a2ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:10.471757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-e738f803-268d-448a-bb40-612983f3a2ed service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 1099 time: 1.2524371 May 12 15:12:10.495080 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:10.508144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f0d25bc9-ee34-4065-92d8-0ccb85b91668'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:10.554333 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:10.574137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Transition to ACTIVE for port object fac623c3-0b49-4481-af00-ce11553f25e2 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:10.610687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0dbdb7e0-979c-4179-99f0-581ca0d0e884 None None] Port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:12:10.627273 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:10.783541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Network cb55ee6d-0282-4fd1-b7e7-3686cea611b9 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:10.791375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:10.798130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:10.855561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Pushing event updated for resources: {'Port': ['ID=fac623c3-0b49-4481-af00-ce11553f25e2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:10.930541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:11.000384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Pushing event updated for resources: {'Port': ['ID=9003ae7a-c261-4797-a9b3-af884e53a88b,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:11.151123 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-dc7e0370-4747-48b3-91b7-bfc564969b79 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&fields=id HTTP/1.1" status: 200 len: 486 time: 0.8892310 May 12 15:12:11.151334 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:11.168078 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:11.180317 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6343499b-329c-48c9-aa5b-1276d6bcf821 req-2f6b3ad3-e4b5-4e6a-be56-87f4fb42f75b service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7887156 May 12 15:12:11.191469 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1e3fef88-6539-4825-8e95-4602a8a86c44 req-e18b1f7b-5256-4dbc-9b96-33994a1be0c9 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7272317 May 12 15:12:11.329339 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6107f32-e7d6-4f41-bfa1-9d4697d1809b up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:11.392337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5b5016c2-1844-41eb-95b0-2982d382db64 None None] Provisioning for port fac623c3-0b49-4481-af00-ce11553f25e2 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:11.419562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5b5016c2-1844-41eb-95b0-2982d382db64 None None] Provisioning complete for port fac623c3-0b49-4481-af00-ce11553f25e2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:11.419562 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5b5016c2-1844-41eb-95b0-2982d382db64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:11.461502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-70ad3f0c-8027-4c28-b98b-61778321d3e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:11.463201 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-70ad3f0c-8027-4c28-b98b-61778321d3e6 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.9113746 May 12 15:12:11.694672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6171040f-a3cb-4610-ba94-01d6cddf7d82 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17'}], 'enable_snat': True}, 'gw_port_id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 4, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port': {'id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:36:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 766, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:25Z', 'updated_at': '2022-05-12T15:10:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'fdea6f95-4926-47ab-b77f-0443f92db7f5', 'name': '', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'mac_address': 'fa:16:3e:d3:23:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_interface', 'standard_attr_id': 777, 'fixed_ips': [{'subnet_id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:29Z', 'updated_at': '2022-05-12T15:10:37Z', 'revision_number': 5, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'subnets': [{'id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:11.697596 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-e9f5df09-fd1a-4dcb-8015-f7c121060061 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859 HTTP/1.1" status: 200 len: 217 time: 0.2190287 May 12 15:12:11.711993 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ba6ee1fe-0893-45ab-b017-eb39cd4077a3'] response: {'name': 'network-changed', 'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'status': 'completed', 'code': 200} May 12 15:12:11.718467 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:11.729713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:11.733240 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6171040f-a3cb-4610-ba94-01d6cddf7d82 None None] Checking router: ea3f04a0-308b-4219-ad26-2924d153122f for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:12:11.773726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '301de57f-75b6-4323-a891-da62f7306fd1', 'name': 'tempest-TaggedBootDevicesTest_v242-265683194-router', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245'}], 'enable_snat': True}, 'gw_port_id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:12:01Z', 'updated_at': '2022-05-12T15:12:06Z', 'revision_number': 4, 'project_id': '0e49c03c26594e7fa192a1a667415ff3', 'gw_port': {'id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:49:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '301de57f-75b6-4323-a891-da62f7306fd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 875, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:02Z', 'updated_at': '2022-05-12T15:12:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '78867492-bce0-46a9-bcbd-e2e2cbd76ff5', 'name': '', 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'mac_address': 'fa:16:3e:75:80:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '301de57f-75b6-4323-a891-da62f7306fd1', 'device_owner': 'network:router_interface', 'standard_attr_id': 877, 'fixed_ips': [{'subnet_id': '4081ed9c-dabb-4f65-a1dc-a63a854f2f4a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:05Z', 'updated_at': '2022-05-12T15:12:06Z', 'revision_number': 2, 'project_id': '0e49c03c26594e7fa192a1a667415ff3', 'subnets': [{'id': '4081ed9c-dabb-4f65-a1dc-a63a854f2f4a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:11.798577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2348ae0-44d6-4710-ada7-fb1e61870f42 None None] The sync data for ids ['301de57f-75b6-4323-a891-da62f7306fd1'] in n-d-841483-1 is: [{'id': '301de57f-75b6-4323-a891-da62f7306fd1', 'name': 'tempest-TaggedBootDevicesTest_v242-265683194-router', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245'}], 'enable_snat': True}, 'gw_port_id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:12:01Z', 'updated_at': '2022-05-12T15:12:06Z', 'revision_number': 4, 'project_id': '0e49c03c26594e7fa192a1a667415ff3', 'gw_port': {'id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:49:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '301de57f-75b6-4323-a891-da62f7306fd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 875, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:02Z', 'updated_at': '2022-05-12T15:12:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '78867492-bce0-46a9-bcbd-e2e2cbd76ff5', 'name': '', 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'mac_address': 'fa:16:3e:75:80:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '301de57f-75b6-4323-a891-da62f7306fd1', 'device_owner': 'network:router_interface', 'standard_attr_id': 877, 'fixed_ips': [{'subnet_id': '4081ed9c-dabb-4f65-a1dc-a63a854f2f4a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:05Z', 'updated_at': '2022-05-12T15:12:06Z', 'revision_number': 2, 'project_id': '0e49c03c26594e7fa192a1a667415ff3', 'subnets': [{'id': '4081ed9c-dabb-4f65-a1dc-a63a854f2f4a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:12:11.810172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6171040f-a3cb-4610-ba94-01d6cddf7d82 None None] Routers {'ea3f04a0-308b-4219-ad26-2924d153122f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:11.812542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6171040f-a3cb-4610-ba94-01d6cddf7d82 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ea3f04a0-308b-4219-ad26-2924d153122f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:11.887441 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5b5016c2-1844-41eb-95b0-2982d382db64 None None] Port fac623c3-0b49-4481-af00-ce11553f25e2 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:12:11.915721 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:11.960427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Pushing event updated for resources: {'Port': ['ID=fac623c3-0b49-4481-af00-ce11553f25e2,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:12.160980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Network fb52840d-9bbb-41d8-beb2-82a8e29947d0 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:12.198126 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-6171040f-a3cb-4610-ba94-01d6cddf7d82 None None] Set router ea3f04a0-308b-4219-ad26-2924d153122f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:12.208729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:12.518104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-fd13e955-6e7d-460e-9633-62596538e579 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:12.519727 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-fd13e955-6e7d-460e-9633-62596538e579 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.6409240 May 12 15:12:12.634673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f6107f32-e7d6-4f41-bfa1-9d4697d1809b completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:12.706646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Network cb55ee6d-0282-4fd1-b7e7-3686cea611b9 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:12.708493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:12.726050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d06a27af-311d-4ae1-aeca-c6aae6a4512a req-8b7ca70e-40d8-4922-96f1-1f45b2c8bd76 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:12.727937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d06a27af-311d-4ae1-aeca-c6aae6a4512a req-8b7ca70e-40d8-4922-96f1-1f45b2c8bd76 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 946 time: 1.0894699 May 12 15:12:12.756650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f6107f32-e7d6-4f41-bfa1-9d4697d1809b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:12.757030 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:12.842280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-a8d440ba-28d7-42de-92e3-e85f8c4b912e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:12.843963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-a8d440ba-28d7-42de-92e3-e85f8c4b912e service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 1099 time: 1.0582530 May 12 15:12:12.914996 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f94c9d10-ac46-40a7-b4a7-e545e5db1b53 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:12.973013 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:13.012904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-221947be-b52c-447b-a006-b4f562728202 None None] Provisioning complete for port 9003ae7a-c261-4797-a9b3-af884e53a88b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:13.013722 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-221947be-b52c-447b-a006-b4f562728202 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:13.275506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-221947be-b52c-447b-a006-b4f562728202 None None] Port 9003ae7a-c261-4797-a9b3-af884e53a88b cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:12:13.283182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Router c3b59b75-f7cf-49f3-b6b3-5a717f23c43d has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:12:13.438562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc5a9cd4-36bc-43b1-908a-410b270b4e63 req-40080590-e15f-4269-8fb8-39df78f93fbb tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:13.456061 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc5a9cd4-36bc-43b1-908a-410b270b4e63 req-40080590-e15f-4269-8fb8-39df78f93fbb tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 946 time: 1.7341409 May 12 15:12:13.490978 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:13.500328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7d32d7e6-9f47-4938-93e4-e10631b47e69 None None] Provisioning complete for port fac623c3-0b49-4481-af00-ce11553f25e2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:13.500786 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7d32d7e6-9f47-4938-93e4-e10631b47e69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:13.577722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port f6107f32-e7d6-4f41-bfa1-9d4697d1809b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f6107f32-e7d6-4f41-bfa1-9d4697d1809b,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:13.584201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:12:13.591275 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:13.600029 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Sync routers for ids ['c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:12:13.623851 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-57286495-1ce6-4343-9ee1-5b70055dbba0 admin admin] 10.222.0.82 "PUT /v2.0/routers/c3b59b75-f7cf-49f3-b6b3-5a717f23c43d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.5856929 May 12 15:12:13.625926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-7d32d7e6-9f47-4938-93e4-e10631b47e69 None None] Port fac623c3-0b49-4481-af00-ce11553f25e2 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:12:13.637880 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Routers {'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:13.638577 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:13.663829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6171040f-a3cb-4610-ba94-01d6cddf7d82 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17'}], 'enable_snat': True}, 'gw_port_id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 4, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port': {'id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:36:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 766, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:25Z', 'updated_at': '2022-05-12T15:10:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'fdea6f95-4926-47ab-b77f-0443f92db7f5', 'name': '', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'mac_address': 'fa:16:3e:d3:23:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_interface', 'standard_attr_id': 777, 'fixed_ips': [{'subnet_id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:29Z', 'updated_at': '2022-05-12T15:10:37Z', 'revision_number': 5, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'subnets': [{'id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:13.673566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6171040f-a3cb-4610-ba94-01d6cddf7d82 None None] The sync data for ids ['ea3f04a0-308b-4219-ad26-2924d153122f'] in n-d-841483-1 is: [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17'}], 'enable_snat': True}, 'gw_port_id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:10:30Z', 'revision_number': 4, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port': {'id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:36:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 766, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:25Z', 'updated_at': '2022-05-12T15:10:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'fdea6f95-4926-47ab-b77f-0443f92db7f5', 'name': '', 'network_id': '7336b0e1-6ae7-4c8a-98e8-3f13adbdc190', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'mac_address': 'fa:16:3e:d3:23:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_interface', 'standard_attr_id': 777, 'fixed_ips': [{'subnet_id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:29Z', 'updated_at': '2022-05-12T15:10:37Z', 'revision_number': 5, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'subnets': [{'id': 'eb51e145-1f59-4ab5-b2f3-a32c2c6ee575', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:12:13.685761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=f6107f32-e7d6-4f41-bfa1-9d4697d1809b,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:13.708371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d06a27af-311d-4ae1-aeca-c6aae6a4512a req-fe6cbf8a-16ea-4b59-95a9-c60a7064d2c6 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9624746 May 12 15:12:13.742336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8403f3e5-d02f-4cd4-b73d-21cd47e6f139', 'name': 'network-vif-deleted', 'tag': 'b916a765-866f-4478-817f-f3e33e79f873'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:13.772182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Router 56048083-24ed-41eb-868c-2140c7b486c8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:12:13.787502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc5a9cd4-36bc-43b1-908a-410b270b4e63 req-a55d9316-dc76-4775-a9a7-4d80f54dd1c8 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3302593 May 12 15:12:13.826247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-e8a500ab-02e6-432e-a72e-1d04498593ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:13.828259 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-e8a500ab-02e6-432e-a72e-1d04498593ff service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 1.2850871 May 12 15:12:13.894791 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-64782dc9-76ca-4a9c-88fe-9f8469ced6a0'] response: {'server_uuid': '15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f0d25bc9-ee34-4065-92d8-0ccb85b91668', 'code': 200} May 12 15:12:14.084181 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Set router c3b59b75-f7cf-49f3-b6b3-5a717f23c43d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:14.088009 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a8f035-0133-4ce0-bf3b-8d8f6a7bd3f0 req-d614a765-f6af-4348-9fbb-04dfcc66da12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:14.090055 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-42a8f035-0133-4ce0-bf3b-8d8f6a7bd3f0 req-d614a765-f6af-4348-9fbb-04dfcc66da12 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 1097 time: 0.1004055 May 12 15:12:14.150695 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-42a8f035-0133-4ce0-bf3b-8d8f6a7bd3f0 req-41115c70-427b-4801-bdf8-ed84fda5e716 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509968 May 12 15:12:14.312601 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-8a7e312e-9e80-474a-bf7d-3f871e4d1f7a service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4510968 May 12 15:12:14.500337 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-cc5089fc-1203-4031-869f-66e1aab51990 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0409193 May 12 15:12:14.502021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:12:14.511920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Sync routers for ids ['56048083-24ed-41eb-868c-2140c7b486c8'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:12:14.531243 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bda3a384-ae8c-482d-bc36-0d35a0c96799 req-36eb5c4b-224a-41db-a5f8-77e2ff397528 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 210 time: 0.5389359 May 12 15:12:14.545696 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-772fbd0a-821b-4377-a904-c82227261524 admin admin] 10.222.0.82 "PUT /v2.0/routers/56048083-24ed-41eb-868c-2140c7b486c8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 14.8944983 May 12 15:12:14.546084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Routers {'56048083-24ed-41eb-868c-2140c7b486c8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:14.546084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['56048083-24ed-41eb-868c-2140c7b486c8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:14.738289 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'name': 'tempest-FloatingIPsTestJSON-1092809323-router', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.23'}], 'enable_snat': True}, 'gw_port_id': 'f6107f32-e7d6-4f41-bfa1-9d4697d1809b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:55Z', 'updated_at': '2022-05-12T15:12:11Z', 'revision_number': 4, 'project_id': '4c3ee180ddb64a8685bd55247106d4cb', 'gw_port': {'id': 'f6107f32-e7d6-4f41-bfa1-9d4697d1809b', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:ec:87:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 864, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.23', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:58Z', 'updated_at': '2022-05-12T15:12:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'fac623c3-0b49-4481-af00-ce11553f25e2', 'name': '', 'network_id': 'cb55ee6d-0282-4fd1-b7e7-3686cea611b9', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'mac_address': 'fa:16:3e:5d:89:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'device_owner': 'network:router_interface', 'standard_attr_id': 878, 'fixed_ips': [{'subnet_id': '4d5b7d28-8e2d-474e-8eb6-dfe9b12d479f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:09Z', 'updated_at': '2022-05-12T15:12:11Z', 'revision_number': 2, 'project_id': '4c3ee180ddb64a8685bd55247106d4cb', 'subnets': [{'id': '4d5b7d28-8e2d-474e-8eb6-dfe9b12d479f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:14.757317 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Checking router: c3b59b75-f7cf-49f3-b6b3-5a717f23c43d for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:12:14.757317 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Updating router c3b59b75-f7cf-49f3-b6b3-5a717f23c43d port fac623c3-0b49-4481-af00-ce11553f25e2 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:12:14.828254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52206) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:14.909748 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b3da3af6-19be-4f1e-8e5d-2aeecde2f5a9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:14.932315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52214) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:14.970573 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:15.010671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-c743e3d7-4d46-43ae-9273-a7a387b21f5a tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:15.012530 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-c743e3d7-4d46-43ae-9273-a7a387b21f5a tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4959712 May 12 15:12:15.015788 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5834d8b-b16b-4e93-8f9c-a7a6a46ebc93 req-6b5a8577-0968-42a6-a9c2-928359f091aa service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5005276 May 12 15:12:15.021345 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a6494074-5769-4f2e-9597-c195ebe0d128'] response: {'server_uuid': '8403f3e5-d02f-4cd4-b73d-21cd47e6f139', 'name': 'network-vif-deleted', 'tag': 'b916a765-866f-4478-817f-f3e33e79f873', 'status': 'completed', 'code': 200} May 12 15:12:15.027232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-ecea2e12-6901-46f0-889a-5f85cab4e51b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:15.031914 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-ecea2e12-6901-46f0-889a-5f85cab4e51b service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 1.9670489 May 12 15:12:15.062774 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c2472c6-8f54-45c0-a82b-e373eb4902e4 None None] New status for floating IP bf15d665-374d-49cc-aa1b-7297db778487: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:12:15.090117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Request body: {'port': {'device_id': '356d3884-ccc1-4305-bdd1-7231fe627d9f', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': 'fa4eac6b8c464c45aa3c550e59a0d34b'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:15.093425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a72957f6-614d-43aa-8559-32a519af047f req-ba1e471b-b3dd-46e6-a31c-0e07f7dc264e tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:15.096247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a72957f6-614d-43aa-8559-32a519af047f req-ba1e471b-b3dd-46e6-a31c-0e07f7dc264e tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 948 time: 1.0623159 May 12 15:12:15.192341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Set router 56048083-24ed-41eb-868c-2140c7b486c8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:15.271915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-1641999940'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:15.292995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:15.301968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Usage tracker for resource:network and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:15.309441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:15.330493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:15.341996 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:15.356855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:15.361880 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:15.555255 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:15.591198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 577} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:12:15.756983 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:15.757342 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Added segment 8037e7d9-36c9-4cfc-9420-983f2660ddef of type vlan for network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 May 12 15:12:15.772143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:15.795752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-feec2657-b575-44ce-854d-0922c69661a7 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859 HTTP/1.1" status: 200 len: 217 time: 0.6943195 May 12 15:12:15.800527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Usage tracker for resource:port and tenant:fa4eac6b8c464c45aa3c550e59a0d34b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:15.804697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-fa2a981e-07b4-48fa-aa8d-863f7d9977f7 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Synchronizing usage tracker for tenant:4c3ee180ddb64a8685bd55247106d4cb on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:12:15.806860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Quota usage for port was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:15.820293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attempting to reserve 1 items for resource port. Total usage: 6; quota limit: 500; headroom:494 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:15.850445 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:15.858608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Made reservation on behalf of fa4eac6b8c464c45aa3c550e59a0d34b for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:15.879137 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:15.898494 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 49fa16f5-ab90-402d-8b5a-04aca0a68917 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:15.900405 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:15.913370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a72957f6-614d-43aa-8559-32a519af047f req-48f309f8-f22c-4035-a02d-8b34106d99ba tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5140204 May 12 15:12:15.937371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4db559d6-6ff9-4f01-9ab9-98bc9279fdd7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:15.959880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:15.960899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:15.961497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:15.962246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:15.962804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:15.963332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:15.963857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:15.964395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:15.964932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:15.965542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:15.966080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:15.966780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:15.984150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-fa2a981e-07b4-48fa-aa8d-863f7d9977f7 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Unset dirty status for tenant:4c3ee180ddb64a8685bd55247106d4cb on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:12:15.987294 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-fa2a981e-07b4-48fa-aa8d-863f7d9977f7 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.7147975 May 12 15:12:15.998299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-ac71ce0b-e8fc-46b9-b0ef-ed4212390eab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:16.005184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-ac71ce0b-e8fc-46b9-b0ef-ed4212390eab service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 1099 time: 0.7320983 May 12 15:12:16.026503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:16.091498 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:16.100822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:16.102749 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:16.284316 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:16.286085 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fbf02c4f-bb68-4347-ba27-6054a5b8959b tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "DELETE /v2.0/security-groups/4db559d6-6ff9-4f01-9ab9-98bc9279fdd7 HTTP/1.1" status: 204 len: 168 time: 1.4568942 May 12 15:12:16.291767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event updated for resources: {'Network': ['ID=9021e9b2-6c8f-4b20-8148-52e45c2296b3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:16.308150 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-42a49b8f-fd60-4d8b-9250-c9820946c867 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 774 time: 1.3725703 May 12 15:12:16.313725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52224) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:16.314739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52226) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:16.329650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Request body: {'subnet': {'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3', 'cidr': '19.80.0.0/24', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:16.332640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:12:16.374373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-93bdbf76-129d-493a-a537-2c497e23bc3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:16.375390 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-93bdbf76-129d-493a-a537-2c497e23bc3a service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.3591080 May 12 15:12:16.376353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:16.480965 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:16.488074 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-e38350ba-bba8-455f-953c-018693d4be85 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] show failed (client error): The resource could not be found. May 12 15:12:16.488406 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:16.490217 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e38350ba-bba8-455f-953c-018693d4be85 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "GET /v2.0/security-groups/4db559d6-6ff9-4f01-9ab9-98bc9279fdd7 HTTP/1.1" status: 404 len: 347 time: 0.1735573 May 12 15:12:16.509562 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:16.512306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-7580e1af-5f47-4286-8ef3-6784a08cc3e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:16.518718 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-7580e1af-5f47-4286-8ef3-6784a08cc3e9 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.6968627 May 12 15:12:16.518960 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Transition to ACTIVE for port object fac623c3-0b49-4481-af00-ce11553f25e2 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:16.521637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52232) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:16.528880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Usage tracker for resource:floatingip and tenant:4c3ee180ddb64a8685bd55247106d4cb is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:16.539665 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:16.550030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:16.586557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 49fa16f5-ab90-402d-8b5a-04aca0a68917 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:16.596277 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 49fa16f5-ab90-402d-8b5a-04aca0a68917 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:16.596690 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:16.657422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '56048083-24ed-41eb-868c-2140c7b486c8', 'name': 'tempest-ServersTestMultiNic-309743523-router', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34'}], 'enable_snat': True}, 'gw_port_id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:47Z', 'updated_at': '2022-05-12T15:12:08Z', 'revision_number': 4, 'project_id': '1aea6927c780448b89ddf44ec6bcb186', 'gw_port': {'id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '56048083-24ed-41eb-868c-2140c7b486c8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 857, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:51Z', 'updated_at': '2022-05-12T15:12:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '9003ae7a-c261-4797-a9b3-af884e53a88b', 'name': '', 'network_id': 'fb52840d-9bbb-41d8-beb2-82a8e29947d0', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'mac_address': 'fa:16:3e:45:99:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '56048083-24ed-41eb-868c-2140c7b486c8', 'device_owner': 'network:router_interface', 'standard_attr_id': 876, 'fixed_ips': [{'subnet_id': '005ae052-6cd6-4ddc-833f-af6e1c2bff40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:02Z', 'updated_at': '2022-05-12T15:12:08Z', 'revision_number': 2, 'project_id': '1aea6927c780448b89ddf44ec6bcb186', 'subnets': [{'id': '005ae052-6cd6-4ddc-833f-af6e1c2bff40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:16.662541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:16.687907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Usage tracker for resource:subnet and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:16.702042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Allocated IP 192.168.233.21 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:16.706805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:16.714635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Checking router: 56048083-24ed-41eb-868c-2140c7b486c8 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:12:16.715000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Updating router 56048083-24ed-41eb-868c-2140c7b486c8 port 9003ae7a-c261-4797-a9b3-af884e53a88b binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:12:16.729803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:16.816791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:16.820258 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:16.959604 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:16.970848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-7bf77b52-6724-41de-8a8e-b49b900750bc service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859 HTTP/1.1" status: 200 len: 217 time: 0.5410519 May 12 15:12:16.979316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:17.141633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Sync routers for ids ['301de57f-75b6-4323-a891-da62f7306fd1'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:12:17.157326 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e80804d7-1c51-40d1-b9ed-059a4a4ec0b0 None None] Pushing event updated for resources: {'Port': ['ID=fac623c3-0b49-4481-af00-ce11553f25e2,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:17.177551 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:17.195364 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-be6f78c9-a8e8-405b-9042-74740a5d8a28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:17.196930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 49fa16f5-ab90-402d-8b5a-04aca0a68917, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=49fa16f5-ab90-402d-8b5a-04aca0a68917,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:17.199080 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-be6f78c9-a8e8-405b-9042-74740a5d8a28 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1790257 May 12 15:12:17.207905 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:17.208984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6107f32-e7d6-4f41-bfa1-9d4697d1809b up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:17.297311 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Attempting to bind port fac623c3-0b49-4481-af00-ce11553f25e2 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:17.298743 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Attempting to bind port fac623c3-0b49-4481-af00-ce11553f25e2 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'd6eafc19-f9db-4010-b69b-58d99283bc6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': 'cb55ee6d-0282-4fd1-b7e7-3686cea611b9'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:17.300158 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Attempting to bind port fac623c3-0b49-4481-af00-ce11553f25e2 on network cb55ee6d-0282-4fd1-b7e7-3686cea611b9 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:17.316834 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:17.317211 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Checking segment: {'id': 'd6eafc19-f9db-4010-b69b-58d99283bc6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': 'cb55ee6d-0282-4fd1-b7e7-3686cea611b9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:17.319106 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:17.321931 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Bound using segment: {'id': 'd6eafc19-f9db-4010-b69b-58d99283bc6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': 'cb55ee6d-0282-4fd1-b7e7-3686cea611b9'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:17.325836 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Bound port: fac623c3-0b49-4481-af00-ce11553f25e2, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd6eafc19-f9db-4010-b69b-58d99283bc6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': 'cb55ee6d-0282-4fd1-b7e7-3686cea611b9'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:17.335758 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:17.437789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Routers {'301de57f-75b6-4323-a891-da62f7306fd1'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:17.439115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:12:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['301de57f-75b6-4323-a891-da62f7306fd1'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:17.493541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Deleting port ada5cf8c-8987-4268-a289-dc58cde185f1 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:17.493881 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:17.506570 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:17.573887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Transition to ACTIVE for port object bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:17.584222 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] For port fac623c3-0b49-4481-af00-ce11553f25e2, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:17.591224 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] For port fac623c3-0b49-4481-af00-ce11553f25e2, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fac623c3-0b49-4481-af00-ce11553f25e2,segment=NetworkSegment(d6eafc19-f9db-4010-b69b-58d99283bc6a),segment_id=d6eafc19-f9db-4010-b69b-58d99283bc6a)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:17.595536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a3ba75-8a7f-4c4d-a07b-f59849a7888e req-ee56bb99-35a8-4476-a38c-6563a619818a tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:17.598061 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7a3ba75-8a7f-4c4d-a07b-f59849a7888e req-ee56bb99-35a8-4476-a38c-6563a619818a tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 946 time: 1.2188463 May 12 15:12:17.599330 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:17.607872 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:17.664293 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:17.699177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=49fa16f5-ab90-402d-8b5a-04aca0a68917,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:17.758662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-8d3b9c89-075d-4365-aac6-973b55eb5f22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:17.760982 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-8d3b9c89-075d-4365-aac6-973b55eb5f22 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 1.2262263 May 12 15:12:17.809058 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:17.862353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event updated for resources: {'Subnet': ['ID=7e73bcb0-088d-46bf-8dd4-a976776d8b9c,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:17.865106 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:17.883441 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Routers {'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:17.884439 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:12:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:17.940359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f6107f32-e7d6-4f41-bfa1-9d4697d1809b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:17.940681 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:17.983157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81', '8c301fff-eebe-4ee3-ae47-9da749d76d58'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:18.017621 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e80804d7-1c51-40d1-b9ed-059a4a4ec0b0 None None] Pushing event updated for resources: {'Port': ['ID=fac623c3-0b49-4481-af00-ce11553f25e2,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:18.019622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3ae73679-d198-440a-966c-619a9930fbcb', '83a7b910-a912-4e05-9d03-5d6b1f6b0edc', '9c35d53f-6773-4ce7-9642-3b542a20efa8', 'fa933a35-7a96-4a45-bb36-afb53c7641b9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:18.108113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event updated for resources: {'Port': ['ID=bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:18.161271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:18.164068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:18.169622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:18.183840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Set router 301de57f-75b6-4323-a891-da62f7306fd1 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:18.200165 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-6e7fe51c-0c30-4072-b439-88d846f35d71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:18.202323 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-6e7fe51c-0c30-4072-b439-88d846f35d71 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.9819987 May 12 15:12:18.233961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Checking segment: {'id': '8037e7d9-36c9-4cfc-9420-983f2660ddef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:18.239125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Network hostable DHCP agents. Network: 9021e9b2-6c8f-4b20-8148-52e45c2296b3, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:12:18.311485 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] Set router c3b59b75-f7cf-49f3-b6b3-5a717f23c43d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:18.320255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:12:18.354529 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7a3ba75-8a7f-4c4d-a07b-f59849a7888e req-b065b949-85b3-4d35-9df4-1df9d26f957f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7225296 May 12 15:12:18.357977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-e9676077-79de-4d86-96d2-dbd03f36c30e service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5017400 May 12 15:12:18.408623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:18.409788 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:18.459965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 9021e9b2-6c8f-4b20-8148-52e45c2296b3) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:18.481127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:18.484935 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:18.523839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7271309b-7629-49eb-a4d8-228c5baab59c None None] Network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:12:18.529642 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-d8f3af70-07e3-4615-9084-548a59116807 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 3.4435430 May 12 15:12:18.541341 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ac9036eb-2cb5-4d23-a2d5-4f36992d23cc tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 798 time: 2.2230427 May 12 15:12:18.544595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52244) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:18.554281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Request body: {'port': {'device_id': '356d3884-ccc1-4305-bdd1-7231fe627d9f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:18.616783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-402333535'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:18.647540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 9787cef9-03af-4a15-af20-0eb8fe5ee859 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:12:18.651886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:18.657984 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-09b521f6-1211-4d2b-ab39-d76a7730d549 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2757957 May 12 15:12:18.780070 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:18.780389 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:18.787333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Usage tracker for resource:network and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:18.792739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:18.825090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:18.852893 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:18.871754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:18.876795 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:18.928605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 576} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:12:18.946186 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:18.947176 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Added segment 36ebeacd-da47-43a4-9f56-f8706690a71c of type vlan for network b55a7520-40f6-4d38-b0f0-235a1cd1b883 May 12 15:12:18.956537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Calling delete_port for ada5cf8c-8987-4268-a289-dc58cde185f1 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:18.979297 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'name': 'tempest-FloatingIPsTestJSON-1092809323-router', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.23'}], 'enable_snat': True}, 'gw_port_id': 'f6107f32-e7d6-4f41-bfa1-9d4697d1809b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:55Z', 'updated_at': '2022-05-12T15:12:11Z', 'revision_number': 4, 'project_id': '4c3ee180ddb64a8685bd55247106d4cb', 'gw_port': {'id': 'f6107f32-e7d6-4f41-bfa1-9d4697d1809b', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:ec:87:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 864, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.23', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:58Z', 'updated_at': '2022-05-12T15:12:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'fac623c3-0b49-4481-af00-ce11553f25e2', 'name': '', 'network_id': 'cb55ee6d-0282-4fd1-b7e7-3686cea611b9', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'mac_address': 'fa:16:3e:5d:89:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'device_owner': 'network:router_interface', 'standard_attr_id': 878, 'fixed_ips': [{'subnet_id': '4d5b7d28-8e2d-474e-8eb6-dfe9b12d479f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:09Z', 'updated_at': '2022-05-12T15:12:17Z', 'revision_number': 4, 'project_id': '4c3ee180ddb64a8685bd55247106d4cb', 'subnets': [{'id': '4d5b7d28-8e2d-474e-8eb6-dfe9b12d479f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:18.992010 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5616b75b-a334-4756-9a4a-742ff9803047 None None] The sync data for ids ['c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'] in n-d-841483-1 is: [{'id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'name': 'tempest-FloatingIPsTestJSON-1092809323-router', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.23'}], 'enable_snat': True}, 'gw_port_id': 'f6107f32-e7d6-4f41-bfa1-9d4697d1809b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:55Z', 'updated_at': '2022-05-12T15:12:11Z', 'revision_number': 4, 'project_id': '4c3ee180ddb64a8685bd55247106d4cb', 'gw_port': {'id': 'f6107f32-e7d6-4f41-bfa1-9d4697d1809b', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:ec:87:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 864, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.23', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:58Z', 'updated_at': '2022-05-12T15:12:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'fac623c3-0b49-4481-af00-ce11553f25e2', 'name': '', 'network_id': 'cb55ee6d-0282-4fd1-b7e7-3686cea611b9', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'mac_address': 'fa:16:3e:5d:89:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'device_owner': 'network:router_interface', 'standard_attr_id': 878, 'fixed_ips': [{'subnet_id': '4d5b7d28-8e2d-474e-8eb6-dfe9b12d479f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:09Z', 'updated_at': '2022-05-12T15:12:17Z', 'revision_number': 4, 'project_id': '4c3ee180ddb64a8685bd55247106d4cb', 'subnets': [{'id': '4d5b7d28-8e2d-474e-8eb6-dfe9b12d479f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:12:18.999078 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:19.129788 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-f82e8f4a-b2eb-4ced-8df5-ae9464555022 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8725717 May 12 15:12:19.199152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47edf458-a191-455e-b91b-e9c3934749ca req-84d1c587-1b5d-4ca5-ab50-3946877760f6 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:19.200688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47edf458-a191-455e-b91b-e9c3934749ca req-84d1c587-1b5d-4ca5-ab50-3946877760f6 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 946 time: 0.5310886 May 12 15:12:19.325443 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] It took 0.37 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:12:19.423786 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:19.430355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:19.431386 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:19.481103 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 0.8816669 May 12 15:12:19.489179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52252) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:19.593150 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:19.614679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Request body: {'subnet': {'network_id': 'b55a7520-40f6-4d38-b0f0-235a1cd1b883', 'cidr': '19.86.0.0/24', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:19.638100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a163acae-c0a7-48fa-bf15-a5b0093389f7 None None] Provisioning for port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:19.751305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47edf458-a191-455e-b91b-e9c3934749ca req-a5ae8644-9664-4436-a249-9d39d019c69b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4583945 May 12 15:12:19.811805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:19.835251 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:19.840178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38ec30f8-226b-4d49-b265-8016e4cdee1b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event updated for resources: {'Network': ['ID=b55a7520-40f6-4d38-b0f0-235a1cd1b883,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:19.855201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'mac_address': 'fa:16:3e:ab:63:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.38'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:12:19.886123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:19.892438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Usage tracker for resource:subnet and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:19.896738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:19.904069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:19.963833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:19.968858 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:19.998185 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6574612-0620-4636-9b6a-4b4a0a89e478 req-87d09513-2771-4ac7-baf0-696c8375e617 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8457718 May 12 15:12:20.055623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Pushing event deleted for resources: {'Port': ['ID=ada5cf8c-8987-4268-a289-dc58cde185f1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:20.057954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a163acae-c0a7-48fa-bf15-a5b0093389f7 None None] Provisioning complete for port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:20.058331 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a163acae-c0a7-48fa-bf15-a5b0093389f7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:20.097160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:20.113248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:20.154962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Transition to ACTIVE for port object bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:20.157569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network b55a7520-40f6-4d38-b0f0-235a1cd1b883 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:12:20.165266 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:20.167912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:20.168305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:20.168631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:20.168959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:20.169285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:20.170003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:20.170347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:20.170784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:20.171091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:20.171401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:20.171711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:20.172021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:20.188163 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 49fa16f5-ab90-402d-8b5a-04aca0a68917 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:20.245277 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:20.249369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Allocated IP 172.25.8.97 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/c7cafed4-a492-4873-8fd6-cf54b2e9da10) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:20.263350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Pushing event updated for resources: {'Port': ['ID=bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:20.315071 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f25f9c13-e7de-4328-8f8b-cae430fbef3f req-2bbf46c4-a3d7-4769-875a-cb4fffd7266b tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:20.330406 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f25f9c13-e7de-4328-8f8b-cae430fbef3f req-2bbf46c4-a3d7-4769-875a-cb4fffd7266b tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 935 time: 0.3346736 May 12 15:12:20.369917 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] It took 0.77 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:12:20.490041 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:20.492583 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b41fbcc2-0500-4116-9062-c094f3211599 tempest-ServersTestManualDisk-1731729320 tempest-ServersTestManualDisk-1731729320-project] 10.222.0.82 "DELETE /v2.0/floatingips/bf15d665-374d-49cc-aa1b-7297db778487 HTTP/1.1" status: 204 len: 168 time: 3.9593661 May 12 15:12:20.495680 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f25f9c13-e7de-4328-8f8b-cae430fbef3f req-243f8214-65d0-4d00-8c73-836fc18c6b48 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1644640 May 12 15:12:20.559785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52262) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:20.704649 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:20.850806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a163acae-c0a7-48fa-bf15-a5b0093389f7 None None] Port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:12:20.869939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4d8e4f2-83a0-4508-930c-bd6a894b8636 req-d0205a7a-ccbf-4e2f-b59c-cb3fc35092a8 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:20.877143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4d8e4f2-83a0-4508-930c-bd6a894b8636 req-d0205a7a-ccbf-4e2f-b59c-cb3fc35092a8 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 948 time: 0.1411273 May 12 15:12:20.917117 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:20.953374 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 49fa16f5-ab90-402d-8b5a-04aca0a68917 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:20.953765 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:21.000570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-9021e9b2-6c8f-4b20-8148-52e45c2296b3', 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'fixed_ips': [{'subnet_id': '7e73bcb0-088d-46bf-8dd4-a976776d8b9c'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:12:21.001414 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:21.009665 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4d8e4f2-83a0-4508-930c-bd6a894b8636 req-a5661060-a9f5-42ca-b283-31d244b4822f tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1288106 May 12 15:12:21.050692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:21.058696 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:21.062883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:21.080092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:21.087659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9787cef9-03af-4a15-af20-0eb8fe5ee859 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:21.164973 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:21.181019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Pushing event updated for resources: {'Port': ['ID=c7cafed4-a492-4873-8fd6-cf54b2e9da10,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:21.199929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Attempting to bind port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:21.200574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Attempting to bind port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:21.200701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Attempting to bind port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:21.208561 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:21.250702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:12:21.251012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Attempting to bind port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:21.324335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Transition to ACTIVE for port object 9003ae7a-c261-4797-a9b3-af884e53a88b will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:21.331298 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:21.345652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:21.345971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:21.346357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:21.346842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Bound port: bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:21.347144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:21.409502 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:21.415483 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:21.428110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-874db59a-c7b0-4f41-9345-6410113ee9ba tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:21.429904 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-874db59a-c7b0-4f41-9345-6410113ee9ba tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.2691398 May 12 15:12:21.491690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-befcecd5-b562-46a5-a0b2-7b2a83cc0d4b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/quotas/593ec496e5db4078be8dc940596be321 HTTP/1.1" status: 200 len: 375 time: 0.0214453 May 12 15:12:21.523692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event updated for resources: {'Subnet': ['ID=b8fd478e-7f1c-4be3-acd2-b5504391fab8,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:21.542067 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:21.551268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Checking segment: {'id': '36ebeacd-da47-43a4-9f56-f8706690a71c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'b55a7520-40f6-4d38-b0f0-235a1cd1b883'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:21.551623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Network hostable DHCP agents. Network: b55a7520-40f6-4d38-b0f0-235a1cd1b883, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:12:21.577848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '301de57f-75b6-4323-a891-da62f7306fd1', 'name': 'tempest-TaggedBootDevicesTest_v242-265683194-router', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245'}], 'enable_snat': True}, 'gw_port_id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:12:01Z', 'updated_at': '2022-05-12T15:12:06Z', 'revision_number': 4, 'project_id': '0e49c03c26594e7fa192a1a667415ff3', 'gw_port': {'id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:49:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '301de57f-75b6-4323-a891-da62f7306fd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 875, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:02Z', 'updated_at': '2022-05-12T15:12:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '78867492-bce0-46a9-bcbd-e2e2cbd76ff5', 'name': '', 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'mac_address': 'fa:16:3e:75:80:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '301de57f-75b6-4323-a891-da62f7306fd1', 'device_owner': 'network:router_interface', 'standard_attr_id': 877, 'fixed_ips': [{'subnet_id': '4081ed9c-dabb-4f65-a1dc-a63a854f2f4a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:05Z', 'updated_at': '2022-05-12T15:12:06Z', 'revision_number': 2, 'project_id': '0e49c03c26594e7fa192a1a667415ff3', 'subnets': [{'id': '4081ed9c-dabb-4f65-a1dc-a63a854f2f4a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:21.610462 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:21.611879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] For port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:21.652558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Network b55a7520-40f6-4d38-b0f0-235a1cd1b883 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:12:21.663799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] For port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:21.680117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Checking router: 301de57f-75b6-4323-a891-da62f7306fd1 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:12:21.680472 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Updating router 301de57f-75b6-4323-a891-da62f7306fd1 port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:12:21.681296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:21.764653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, b55a7520-40f6-4d38-b0f0-235a1cd1b883) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:21.777170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:21.777987 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:21.780448 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] 10.222.0.84 "PUT /v2.0/ports/bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea HTTP/1.1" status: 200 len: 1095 time: 3.2370424 May 12 15:12:21.784931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '356d3884-ccc1-4305-bdd1-7231fe627d9f', 'tag': 'bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:21.804177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:21.804820 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:21.844713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fac623c3-0b49-4481-af00-ce11553f25e2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:21.854216 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-6a051da9-5c98-459b-bbb6-fc0a03620d75 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&fields=id HTTP/1.1" status: 200 len: 255 time: 0.3529837 May 12 15:12:21.880027 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['9787cef9-03af-4a15-af20-0eb8fe5ee859'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:21.948129 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3caa279e-e529-4329-9287-20e4932f977d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 798 time: 2.3376851 May 12 15:12:22.087292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e19da96a-6f36-40a3-b984-b9f148b5bff4 None None] Network b55a7520-40f6-4d38-b0f0-235a1cd1b883 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:12:22.132439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2df7e558-aa0e-443e-92f3-94d9a30adadc service neutron] Pushing event updated for resources: {'Port': ['ID=bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:22.219700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-302c8d21-ee7a-4443-9297-ccabb424d46e service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2764180 May 12 15:12:22.241178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-38ec92d3-f29e-44d4-9750-d5e416bd4ebf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:22.243516 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-38ec92d3-f29e-44d4-9750-d5e416bd4ebf service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 1098 time: 0.2996941 May 12 15:12:22.406674 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=13']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:22.418742 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-8960f282-c8f4-401d-b4bb-0215696e2842 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.21&port_id=bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea HTTP/1.1" status: 200 len: 217 time: 0.0995469 May 12 15:12:22.512189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-95793af0-3657-491a-9c64-f3aae0883183 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:22.514566 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-95793af0-3657-491a-9c64-f3aae0883183 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0840323 May 12 15:12:22.564848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b712a9fa-3c8c-4951-867e-c6b2b29eafaa None None] Pushing event updated for resources: {'Port': ['ID=9003ae7a-c261-4797-a9b3-af884e53a88b,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:22.566641 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:22.569336 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-42b02924-cb56-4106-b6df-fa994613dea3 service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3412535 May 12 15:12:22.572130 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] It took 0.31 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:12:22.599915 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:22.605049 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adcb9bc6-d97a-4994-8470-7f2260d2c82f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:22.614554 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:22.652642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Allocated IP 19.80.0.2 (9021e9b2-6c8f-4b20-8148-52e45c2296b3/7e73bcb0-088d-46bf-8dd4-a976776d8b9c/6a06c973-3d79-4b79-bed8-be79093b0fe4) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:22.821086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-e5dacc2f-3f39-46f8-bbe2-3746d09a3fa0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:22.822592 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-e5dacc2f-3f39-46f8-bbe2-3746d09a3fa0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.3002801 May 12 15:12:22.827620 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:22.893277 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:22.894653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 697 time: 6.8842487 May 12 15:12:22.900596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81c7e43a-7bbd-4a50-8bb1-e96c5c99afe2 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Pushing event updated for resources: {'Port': ['ID=c7cafed4-a492-4873-8fd6-cf54b2e9da10,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:23.066445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-05dd8948-6ee8-4644-8d2c-4f777ac07ee1 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Synchronizing usage tracker for tenant:4c3ee180ddb64a8685bd55247106d4cb on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:12:23.130817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-05dd8948-6ee8-4644-8d2c-4f777ac07ee1 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Unset dirty status for tenant:4c3ee180ddb64a8685bd55247106d4cb on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:12:23.132165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-05dd8948-6ee8-4644-8d2c-4f777ac07ee1 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.97 HTTP/1.1" status: 200 len: 695 time: 0.2285237 May 12 15:12:23.137137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cb72352-8437-4b33-b1cf-c5bba87daf51 req-16166a4e-8f64-497e-8ef9-f4b88d958f90 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:23.139432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cb72352-8437-4b33-b1cf-c5bba87daf51 req-16166a4e-8f64-497e-8ef9-f4b88d958f90 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 1097 time: 0.1573739 May 12 15:12:23.192544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Attempting to bind port 9003ae7a-c261-4797-a9b3-af884e53a88b on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:23.193145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Attempting to bind port 9003ae7a-c261-4797-a9b3-af884e53a88b by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '3155d58f-cee0-46db-bac9-2d07d9e2fa60', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'fb52840d-9bbb-41d8-beb2-82a8e29947d0'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:23.193254 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Attempting to bind port 9003ae7a-c261-4797-a9b3-af884e53a88b on network fb52840d-9bbb-41d8-beb2-82a8e29947d0 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:23.223041 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cb72352-8437-4b33-b1cf-c5bba87daf51 req-d474ff86-6504-4bb5-ab96-cfb0aa972bec tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0588276 May 12 15:12:23.401168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:23.403273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Checking segment: {'id': '3155d58f-cee0-46db-bac9-2d07d9e2fa60', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'fb52840d-9bbb-41d8-beb2-82a8e29947d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:23.403842 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:23.406627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Bound using segment: {'id': '3155d58f-cee0-46db-bac9-2d07d9e2fa60', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'fb52840d-9bbb-41d8-beb2-82a8e29947d0'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:23.407511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Bound port: 9003ae7a-c261-4797-a9b3-af884e53a88b, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3155d58f-cee0-46db-bac9-2d07d9e2fa60', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'fb52840d-9bbb-41d8-beb2-82a8e29947d0'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:23.408077 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:23.497448 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-859f05b0-b745-49e9-ad4b-94145d4d6bac service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6604345 May 12 15:12:23.507107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-b8bc988a-9d80-44ff-87cb-7de5f0128273 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:23.508473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4288afa-8a16-4361-b4c7-eb7e667eb0f9 req-b8bc988a-9d80-44ff-87cb-7de5f0128273 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.3681664 May 12 15:12:23.682103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-adcb9bc6-d97a-4994-8470-7f2260d2c82f admin admin] Deleting port fdea6f95-4926-47ab-b77f-0443f92db7f5 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:23.682572 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adcb9bc6-d97a-4994-8470-7f2260d2c82f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:23.734373 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:23.748284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Transition to ACTIVE for port object 6a06c973-3d79-4b79-bed8-be79093b0fe4 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:23.770562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Transition to ACTIVE for port object 6a06c973-3d79-4b79-bed8-be79093b0fe4 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:23.839992 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02a37bae-b1a3-4c3c-9844-e76e76383cc1 req-90549140-2ebd-46af-88e3-a22a24f7f6b1 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3316309 May 12 15:12:23.917019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dea42ac4-9299-4387-9184-a74d433fa552 req-a30c5edb-2748-4626-901b-941ae5111cfd tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:23.919534 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] For port 9003ae7a-c261-4797-a9b3-af884e53a88b, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:23.920978 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dea42ac4-9299-4387-9184-a74d433fa552 req-a30c5edb-2748-4626-901b-941ae5111cfd tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 1100 time: 0.2067814 May 12 15:12:23.925057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] For port 9003ae7a-c261-4797-a9b3-af884e53a88b, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9003ae7a-c261-4797-a9b3-af884e53a88b,segment=NetworkSegment(3155d58f-cee0-46db-bac9-2d07d9e2fa60),segment_id=3155d58f-cee0-46db-bac9-2d07d9e2fa60)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:23.937809 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a4f4564-98ea-435a-a356-0c701f4a5a94 req-d8e5017c-2532-4ff1-8353-1c4ca244f921 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:23.939305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a4f4564-98ea-435a-a356-0c701f4a5a94 req-d8e5017c-2532-4ff1-8353-1c4ca244f921 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 947 time: 0.1529086 May 12 15:12:24.050217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-adcb9bc6-d97a-4994-8470-7f2260d2c82f admin admin] For port fdea6f95-4926-47ab-b77f-0443f92db7f5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fdea6f95-4926-47ab-b77f-0443f92db7f5,segment=NetworkSegment(0f481a89-826f-4a90-903d-276e9b18feb1),segment_id=0f481a89-826f-4a90-903d-276e9b18feb1)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:24.050700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adcb9bc6-d97a-4994-8470-7f2260d2c82f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:24.051488 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:24.055439 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:24.061290 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a4f4564-98ea-435a-a356-0c701f4a5a94 req-be696902-91c5-43ee-93e5-f6ba4138e1e6 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957365 May 12 15:12:24.070226 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dea42ac4-9299-4387-9184-a74d433fa552 req-2d621687-9f9e-4e71-b3de-86f166d7e2a0 tempest-MigrationsAdminTest-755013595 tempest-MigrationsAdminTest-755013595-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1299658 May 12 15:12:24.150261 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-58454ed1-1153-4c5a-bdaf-371fd0f7302c'] response: {'name': 'network-changed', 'server_uuid': '356d3884-ccc1-4305-bdd1-7231fe627d9f', 'tag': 'bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea', 'status': 'completed', 'code': 200} May 12 15:12:24.304743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-adcb9bc6-d97a-4994-8470-7f2260d2c82f admin admin] Calling delete_port for fdea6f95-4926-47ab-b77f-0443f92db7f5 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:24.462582 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port fac623c3-0b49-4481-af00-ce11553f25e2 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:24.516952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-65d3e13d-74ef-458f-9377-e4f474c63351 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:24.524953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-65d3e13d-74ef-458f-9377-e4f474c63351 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:24.526127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-65d3e13d-74ef-458f-9377-e4f474c63351 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Synchronizing usage tracker for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:12:24.548777 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:24.565282 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port fac623c3-0b49-4481-af00-ce11553f25e2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:24.565669 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:24.584427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-65d3e13d-74ef-458f-9377-e4f474c63351 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Unset dirty status for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:12:24.591186 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-65d3e13d-74ef-458f-9377-e4f474c63351 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/networks?id=9021e9b2-6c8f-4b20-8148-52e45c2296b3&id=b55a7520-40f6-4d38-b0f0-235a1cd1b883&id=9021e9b2-6c8f-4b20-8148-52e45c2296b3 HTTP/1.1" status: 200 len: 1391 time: 0.4119718 May 12 15:12:24.677465 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-9000b223-1984-46f5-a66c-cb4f8fc60c10 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/quotas/1aea6927c780448b89ddf44ec6bcb186 HTTP/1.1" status: 200 len: 375 time: 0.0851586 May 12 15:12:24.680753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:24.710461 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93118091-da39-4168-a496-9426ac59167f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-b55a7520-40f6-4d38-b0f0-235a1cd1b883', 'network_id': 'b55a7520-40f6-4d38-b0f0-235a1cd1b883', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'fixed_ips': [{'subnet_id': 'b8fd478e-7f1c-4be3-acd2-b5504391fab8'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:12:24.714295 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-93118091-da39-4168-a496-9426ac59167f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:24.752267 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:24.755287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:24.929068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-97825348-5a80-4533-9770-4877cb360c8f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:24.930589 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-97825348-5a80-4533-9770-4877cb360c8f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.76 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.5182526 May 12 15:12:24.960909 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Transition to ACTIVE for port object 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:24.961935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Request body: {'port': {'device_id': '463cc5a1-f7b3-45c8-a707-e2e999a85e8c', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'admin_state_up': True, 'tenant_id': '593ec496e5db4078be8dc940596be321'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:24.964435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-730b2bdf-586f-4918-a735-ef1b680b5fe5 req-4a2fcbf2-ae69-47b7-ad7b-5701578b7413 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:24.967304 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-730b2bdf-586f-4918-a735-ef1b680b5fe5 req-4a2fcbf2-ae69-47b7-ad7b-5701578b7413 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 1098 time: 0.7456908 May 12 15:12:24.972988 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Routers {'56048083-24ed-41eb-868c-2140c7b486c8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:24.973705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:12:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['56048083-24ed-41eb-868c-2140c7b486c8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:25.061067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b712a9fa-3c8c-4951-867e-c6b2b29eafaa None None] Pushing event updated for resources: {'Port': ['ID=9003ae7a-c261-4797-a9b3-af884e53a88b,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:25.123365 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4a4cd680-27b4-4a25-98af-b64eeb32cdb8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Synchronizing usage tracker for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:12:25.195273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4a4cd680-27b4-4a25-98af-b64eeb32cdb8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Unset dirty status for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:12:25.196550 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4a4cd680-27b4-4a25-98af-b64eeb32cdb8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=1aea6927c780448b89ddf44ec6bcb186&fields=id HTTP/1.1" status: 200 len: 348 time: 0.5116091 May 12 15:12:25.200968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b49d28e4-7624-4998-b159-28bd0c262004 req-4639f2ee-da86-4ae1-93f2-64637a3ae761 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:25.202491 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b49d28e4-7624-4998-b159-28bd0c262004 req-4639f2ee-da86-4ae1-93f2-64637a3ae761 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 1097 time: 0.4058032 May 12 15:12:25.210920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:25.218298 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adcb9bc6-d97a-4994-8470-7f2260d2c82f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:25.275462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-730b2bdf-586f-4918-a735-ef1b680b5fe5 req-2c4c74c8-edd2-4a79-801c-06ea4320971c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:25.277186 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-730b2bdf-586f-4918-a735-ef1b680b5fe5 req-2c4c74c8-edd2-4a79-801c-06ea4320971c service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.3028433 May 12 15:12:25.281932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adcb9bc6-d97a-4994-8470-7f2260d2c82f admin admin] Pushing event deleted for resources: {'Port': ['ID=fdea6f95-4926-47ab-b77f-0443f92db7f5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:25.316883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:25.351951 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b49d28e4-7624-4998-b159-28bd0c262004 req-f56a988c-118f-4b99-b27c-41c090e470cf tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1429100 May 12 15:12:25.355300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Made reservation on behalf of 593ec496e5db4078be8dc940596be321 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:25.359374 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:25.369938 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:25.524634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Attempting to bind port 6a06c973-3d79-4b79-bed8-be79093b0fe4 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:25.525322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Attempting to bind port 6a06c973-3d79-4b79-bed8-be79093b0fe4 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '8037e7d9-36c9-4cfc-9420-983f2660ddef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:25.525322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Attempting to bind port 6a06c973-3d79-4b79-bed8-be79093b0fe4 on network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:25.627163 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-730b2bdf-586f-4918-a735-ef1b680b5fe5 req-004a8679-f744-4244-8fe4-2b5e6f1243eb service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.21&port_id=bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea HTTP/1.1" status: 200 len: 217 time: 0.3351288 May 12 15:12:25.723071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:25.723492 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Checking segment: {'id': '8037e7d9-36c9-4cfc-9420-983f2660ddef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:25.723842 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:25.724425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Bound using segment: {'id': '8037e7d9-36c9-4cfc-9420-983f2660ddef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:25.724893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Bound port: 6a06c973-3d79-4b79-bed8-be79093b0fe4, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8037e7d9-36c9-4cfc-9420-983f2660ddef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:25.725268 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:25.760418 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Pushing event updated for resources: {'Port': ['ID=6a06c973-3d79-4b79-bed8-be79093b0fe4,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:25.800938 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-afb3dded-8a4c-4376-8c8d-8c6046b9a319 service neutron] 10.222.0.82 "GET /v2.0/networks/9021e9b2-6c8f-4b20-8148-52e45c2296b3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5876007 May 12 15:12:25.819529 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9af4d0d5-fe99-4fc1-801c-5f4dcaaf0e2b req-479b675b-521d-4bfd-876b-35ea4c4eafc8 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/floatingips/4ef70a1b-989d-4909-b9b1-b8292829ff28 HTTP/1.1" status: 200 len: 692 time: 0.3792181 May 12 15:12:25.888225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-730b2bdf-586f-4918-a735-ef1b680b5fe5 req-32af5ebd-8356-4659-b85f-6b424cf9ea5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:25.890291 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-730b2bdf-586f-4918-a735-ef1b680b5fe5 req-32af5ebd-8356-4659-b85f-6b424cf9ea5f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2261610 May 12 15:12:25.959163 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:26.001623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:12:26.185046 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-01207d62-31b1-473c-818d-d6d3c0c46826 service neutron] 10.222.0.82 "GET /v2.0/networks/9021e9b2-6c8f-4b20-8148-52e45c2296b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3752069 May 12 15:12:26.186641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Allocated IP 172.20.0.7 (dbc2e49c-2591-4534-a48c-cea8e23115f4/84c2082e-f394-46d5-8a8f-8e3a70d54fc1/4b2fc410-d9a8-4bcd-af90-17da21c97bac) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:26.192526 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adcb9bc6-d97a-4994-8470-7f2260d2c82f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:26.203870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-730b2bdf-586f-4918-a735-ef1b680b5fe5 req-40b2a6aa-a82e-461a-a6b3-11a63b10a525 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:26.206399 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-730b2bdf-586f-4918-a735-ef1b680b5fe5 req-40b2a6aa-a82e-461a-a6b3-11a63b10a525 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.3008804 May 12 15:12:26.226889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9af4d0d5-fe99-4fc1-801c-5f4dcaaf0e2b req-816a3e61-6f90-439f-b7ed-44fd968f3d21 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:26.233441 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9af4d0d5-fe99-4fc1-801c-5f4dcaaf0e2b req-816a3e61-6f90-439f-b7ed-44fd968f3d21 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.4127481 May 12 15:12:26.234707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-93118091-da39-4168-a496-9426ac59167f None None] Allocated IP 19.86.0.2 (b55a7520-40f6-4d38-b0f0-235a1cd1b883/b8fd478e-7f1c-4be3-acd2-b5504391fab8/7f35bc1f-e9eb-48bd-ad84-4040c239cee1) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:26.242743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-9af4d0d5-fe99-4fc1-801c-5f4dcaaf0e2b req-4a5b2faf-b51b-4b62-94c4-e9d6007fa428 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:12:26.255357 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9af4d0d5-fe99-4fc1-801c-5f4dcaaf0e2b req-4a5b2faf-b51b-4b62-94c4-e9d6007fa428 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0192184 May 12 15:12:26.277810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Attempting to bind port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:26.278372 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Attempting to bind port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'b6ca0527-0ae0-46e1-98b3-d59b1f312d8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:26.279307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Attempting to bind port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 on network aceafe3e-7a49-42ba-b541-5d9652123c2b {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:26.334313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port fac623c3-0b49-4481-af00-ce11553f25e2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fac623c3-0b49-4481-af00-ce11553f25e2,segment=NetworkSegment(d6eafc19-f9db-4010-b69b-58d99283bc6a),segment_id=d6eafc19-f9db-4010-b69b-58d99283bc6a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:26.346337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:26.347060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Checking segment: {'id': 'b6ca0527-0ae0-46e1-98b3-d59b1f312d8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:26.347558 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:26.348165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Bound using segment: {'id': 'b6ca0527-0ae0-46e1-98b3-d59b1f312d8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:26.348754 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Bound port: 78867492-bce0-46a9-bcbd-e2e2cbd76ff5, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b6ca0527-0ae0-46e1-98b3-d59b1f312d8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:26.349986 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:26.380159 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:26.394551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a5f0c0e-0496-4ed2-975f-6194fb841708 None None] Pushing event updated for resources: {'Port': ['ID=78867492-bce0-46a9-bcbd-e2e2cbd76ff5,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:26.431898 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:12:26.544026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=fac623c3-0b49-4481-af00-ce11553f25e2,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:26.553519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] Set router 56048083-24ed-41eb-868c-2140c7b486c8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:26.691083 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-df787ee5-6580-404d-b234-bf666e189847 service neutron] 10.222.0.82 "GET /v2.0/networks/b55a7520-40f6-4d38-b0f0-235a1cd1b883?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4985058 May 12 15:12:26.697761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] For port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:26.848479 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-274f4f25-d549-4de4-9a8c-88d5ad67bd07 service neutron] 10.222.0.82 "GET /v2.0/networks/b55a7520-40f6-4d38-b0f0-235a1cd1b883?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1498308 May 12 15:12:26.878506 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-730b2bdf-586f-4918-a735-ef1b680b5fe5 req-3e92e8aa-92d7-4128-abfb-d627bc55f528 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4686754 May 12 15:12:26.966546 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] For port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=78867492-bce0-46a9-bcbd-e2e2cbd76ff5,segment=NetworkSegment(b6ca0527-0ae0-46e1-98b3-d59b1f312d8d),segment_id=b6ca0527-0ae0-46e1-98b3-d59b1f312d8d)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:26.974199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] For port 6a06c973-3d79-4b79-bed8-be79093b0fe4, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:27.033295 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:27.059901 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-28f47ad9-1f34-4ba5-8fc0-f1fa047d3778 service neutron] 10.222.0.82 "GET /v2.0/networks/9021e9b2-6c8f-4b20-8148-52e45c2296b3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2104001 May 12 15:12:27.120435 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:27.175386 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] For port 6a06c973-3d79-4b79-bed8-be79093b0fe4, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6a06c973-3d79-4b79-bed8-be79093b0fe4,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:27.218352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-061ecf74-8b1a-4658-aa16-ef5eec4f9ee5 req-1307f9fa-dd7b-4ecc-8d8f-05559f5ae229 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=463cc5a1-f7b3-45c8-a707-e2e999a85e8c HTTP/1.1" status: 200 len: 210 time: 0.0725818 May 12 15:12:27.246863 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:27.281702 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:27.400841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Network dbc2e49c-2591-4534-a48c-cea8e23115f4 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:27.419156 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:27.439783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:27.443232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:27.448658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 9787cef9-03af-4a15-af20-0eb8fe5ee859 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:27.450653 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-730b2bdf-586f-4918-a735-ef1b680b5fe5 req-98c3a95d-1deb-486e-94e4-c5247ca04c07 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5712190 May 12 15:12:27.475733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-adcb9bc6-d97a-4994-8470-7f2260d2c82f admin admin] Router ea3f04a0-308b-4219-ad26-2924d153122f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:12:27.547112 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a5f0c0e-0496-4ed2-975f-6194fb841708 None None] Pushing event updated for resources: {'Port': ['ID=78867492-bce0-46a9-bcbd-e2e2cbd76ff5,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:27.643977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Routers {'301de57f-75b6-4323-a891-da62f7306fd1'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:27.644900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:12:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['301de57f-75b6-4323-a891-da62f7306fd1'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:27.691372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:27.692296 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:27.713793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-1ea1d7ce-8338-45df-bb53-21eed32af269 service neutron] 10.222.0.82 "GET /v2.0/networks/9021e9b2-6c8f-4b20-8148-52e45c2296b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6460125 May 12 15:12:27.726349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea', 'mac_address': 'fa:16:3e:40:d2:4e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.21'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:12:27.763937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-adcb9bc6-d97a-4994-8470-7f2260d2c82f admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:12:27.775575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event updated for resources: {'Port': ['ID=4b2fc410-d9a8-4bcd-af90-17da21c97bac,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:27.781791 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfca20fc-b8d6-4253-a9c0-b8a0cf5a9467 None None] Sync routers for ids ['ea3f04a0-308b-4219-ad26-2924d153122f'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:12:27.800021 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-adcb9bc6-d97a-4994-8470-7f2260d2c82f admin admin] 10.222.0.82 "PUT /v2.0/routers/ea3f04a0-308b-4219-ad26-2924d153122f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.2351897 May 12 15:12:27.800252 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfca20fc-b8d6-4253-a9c0-b8a0cf5a9467 None None] Routers {'ea3f04a0-308b-4219-ad26-2924d153122f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:27.800802 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-bfca20fc-b8d6-4253-a9c0-b8a0cf5a9467 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:12:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ea3f04a0-308b-4219-ad26-2924d153122f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:27.801431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52334) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:27.836106 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-0ef53a67-a8f5-4ce0-a0ca-3ca48a407d14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.8810158 May 12 15:12:27.851160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Request body: {'port': {'device_id': '463cc5a1-f7b3-45c8-a707-e2e999a85e8c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:27.970191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f60171-8458-4fda-a5d5-f5ec97faaf92 req-548c1a91-7048-4741-b440-37e1fa6b9393 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:27.976866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46f60171-8458-4fda-a5d5-f5ec97faaf92 req-548c1a91-7048-4741-b440-37e1fa6b9393 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 947 time: 0.5590825 May 12 15:12:28.148870 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-93118091-da39-4168-a496-9426ac59167f None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:28.165532 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d6b1bdd-333b-46c1-a8ae-3c11364fc8b0 None None] Pushing event updated for resources: {'Port': ['ID=6a06c973-3d79-4b79-bed8-be79093b0fe4,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:28.293913 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-bfca20fc-b8d6-4253-a9c0-b8a0cf5a9467 None None] Set router ea3f04a0-308b-4219-ad26-2924d153122f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:28.522391 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:28.556435 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:28.568391 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:28.605496 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-93118091-da39-4168-a496-9426ac59167f None None] Transition to ACTIVE for port object 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:28.731018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:28.819044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-93118091-da39-4168-a496-9426ac59167f None None] Transition to ACTIVE for port object 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:28.820862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 9787cef9-03af-4a15-af20-0eb8fe5ee859 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:28.838606 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f996f13-3b84-4484-b70f-d62384347a3c req-9830dc5c-dbca-40d4-a27c-50abe6fff7b4 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/floatingips?tenant_id=4c3ee180ddb64a8685bd55247106d4cb HTTP/1.1" status: 200 len: 695 time: 0.3366659 May 12 15:12:28.895526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:28.900321 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] Set router 301de57f-75b6-4323-a891-da62f7306fd1 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:28.916112 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46f60171-8458-4fda-a5d5-f5ec97faaf92 req-77601625-ab75-41d7-88cc-fd48a62f0dcb tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9383512 May 12 15:12:28.946724 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:29.090512 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:29.095168 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-bfca20fc-b8d6-4253-a9c0-b8a0cf5a9467 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17'}], 'enable_snat': True}, 'gw_port_id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:12:25Z', 'revision_number': 5, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port': {'id': '8c5ce78c-6510-4f26-8ec1-1c039e69ff93', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:36:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 766, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:10:25Z', 'updated_at': '2022-05-12T15:10:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:29.118000 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfca20fc-b8d6-4253-a9c0-b8a0cf5a9467 None None] Checking router: ea3f04a0-308b-4219-ad26-2924d153122f for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:12:29.118507 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-93118091-da39-4168-a496-9426ac59167f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:29.119263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] Deleting port 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:29.119655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:29.123953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6a06c973-3d79-4b79-bed8-be79093b0fe4 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:29.146969 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfca20fc-b8d6-4253-a9c0-b8a0cf5a9467 None None] Routers {'ea3f04a0-308b-4219-ad26-2924d153122f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:29.148449 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-bfca20fc-b8d6-4253-a9c0-b8a0cf5a9467 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:12:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ea3f04a0-308b-4219-ad26-2924d153122f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:29.413137 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:29.418915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 9787cef9-03af-4a15-af20-0eb8fe5ee859 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:29.420978 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:29.428817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f996f13-3b84-4484-b70f-d62384347a3c req-8acce14c-e17a-4c17-9011-60aea03de482 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:29.455614 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f996f13-3b84-4484-b70f-d62384347a3c req-8acce14c-e17a-4c17-9011-60aea03de482 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/networks?id=5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 787 time: 0.6160717 May 12 15:12:29.516266 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-bfca20fc-b8d6-4253-a9c0-b8a0cf5a9467 None None] Set router ea3f04a0-308b-4219-ad26-2924d153122f gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:29.547689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] For port 8c5ce78c-6510-4f26-8ec1-1c039e69ff93, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=8c5ce78c-6510-4f26-8ec1-1c039e69ff93,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:29.549219 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:29.706260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93118091-da39-4168-a496-9426ac59167f None None] Network b55a7520-40f6-4d38-b0f0-235a1cd1b883 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:29.759238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] Calling delete_port for 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:29.770055 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-93118091-da39-4168-a496-9426ac59167f None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:29.772140 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f12a3be8-a557-4456-ab2b-00c883b666d0 req-5e1cd34b-cd54-4f38-b84c-c6879722578d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 210 time: 0.0870290 May 12 15:12:29.772549 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93118091-da39-4168-a496-9426ac59167f None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:29.783876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-0e483802-037c-4efa-adc6-99bf01405417 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:29.785643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-0e483802-037c-4efa-adc6-99bf01405417 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.76 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 1.2072122 May 12 15:12:29.787679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f14d8ae9-b50a-47a7-831e-baaa2098be1b None None] Network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:12:29.828718 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-bfca20fc-b8d6-4253-a9c0-b8a0cf5a9467 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:12:29Z', 'revision_number': 6, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:29.840655 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfca20fc-b8d6-4253-a9c0-b8a0cf5a9467 None None] The sync data for ids ['ea3f04a0-308b-4219-ad26-2924d153122f'] in n-d-841483-1 is: [{'id': 'ea3f04a0-308b-4219-ad26-2924d153122f', 'name': 'tempest-ServersTestManualDisk-2106532628-router', 'tenant_id': 'a673d571317840e888b6cfe5a121092e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:10:22Z', 'updated_at': '2022-05-12T15:12:29Z', 'revision_number': 6, 'project_id': 'a673d571317840e888b6cfe5a121092e', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:12:29.989793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e277557-5c3d-4138-9666-9c9c7209d1a1 req-17aab8e8-0baa-4e63-8d7e-f215c505d51a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:29.996970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e277557-5c3d-4138-9666-9c9c7209d1a1 req-17aab8e8-0baa-4e63-8d7e-f215c505d51a tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 949 time: 0.7617218 May 12 15:12:30.021696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Deleting port 9787cef9-03af-4a15-af20-0eb8fe5ee859 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:30.022031 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:30.110448 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:30.179399 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e277557-5c3d-4138-9666-9c9c7209d1a1 req-b163ab30-c401-4065-b75f-d7f24ea9a565 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1814299 May 12 15:12:30.470236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:30.493837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] Pushing event deleted for resources: {'Port': ['ID=8c5ce78c-6510-4f26-8ec1-1c039e69ff93,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:30.628801 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '56048083-24ed-41eb-868c-2140c7b486c8', 'name': 'tempest-ServersTestMultiNic-309743523-router', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34'}], 'enable_snat': True}, 'gw_port_id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:47Z', 'updated_at': '2022-05-12T15:12:08Z', 'revision_number': 4, 'project_id': '1aea6927c780448b89ddf44ec6bcb186', 'gw_port': {'id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '56048083-24ed-41eb-868c-2140c7b486c8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 857, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:51Z', 'updated_at': '2022-05-12T15:12:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '9003ae7a-c261-4797-a9b3-af884e53a88b', 'name': '', 'network_id': 'fb52840d-9bbb-41d8-beb2-82a8e29947d0', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'mac_address': 'fa:16:3e:45:99:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '56048083-24ed-41eb-868c-2140c7b486c8', 'device_owner': 'network:router_interface', 'standard_attr_id': 876, 'fixed_ips': [{'subnet_id': '005ae052-6cd6-4ddc-833f-af6e1c2bff40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:02Z', 'updated_at': '2022-05-12T15:12:23Z', 'revision_number': 4, 'project_id': '1aea6927c780448b89ddf44ec6bcb186', 'subnets': [{'id': '005ae052-6cd6-4ddc-833f-af6e1c2bff40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:30.650021 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9965f819-7752-433b-8d19-0c1b8b0af90d req-cf3815d8-8475-4a31-9ef6-bcb44eb70fc0 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/floatingips/4ef70a1b-989d-4909-b9b1-b8292829ff28 HTTP/1.1" status: 200 len: 692 time: 0.2871273 May 12 15:12:30.748177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93118091-da39-4168-a496-9426ac59167f None None] Pushing event updated for resources: {'Port': ['ID=7f35bc1f-e9eb-48bd-ad84-4040c239cee1,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:30.838918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:30.902917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:30.902917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:30.946861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-799cc7fc-692b-4f43-9c7c-e1d4adde1f9e tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:30.953793 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-799cc7fc-692b-4f43-9c7c-e1d4adde1f9e tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:30.954619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-799cc7fc-692b-4f43-9c7c-e1d4adde1f9e tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Synchronizing usage tracker for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:12:30.988521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:30.992838 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-78183c56-174b-4986-93ed-9fb2f4d48a2b None None] The sync data for ids ['56048083-24ed-41eb-868c-2140c7b486c8'] in n-d-841483-1 is: [{'id': '56048083-24ed-41eb-868c-2140c7b486c8', 'name': 'tempest-ServersTestMultiNic-309743523-router', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34'}], 'enable_snat': True}, 'gw_port_id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:47Z', 'updated_at': '2022-05-12T15:12:08Z', 'revision_number': 4, 'project_id': '1aea6927c780448b89ddf44ec6bcb186', 'gw_port': {'id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '56048083-24ed-41eb-868c-2140c7b486c8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 857, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:51Z', 'updated_at': '2022-05-12T15:12:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '9003ae7a-c261-4797-a9b3-af884e53a88b', 'name': '', 'network_id': 'fb52840d-9bbb-41d8-beb2-82a8e29947d0', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'mac_address': 'fa:16:3e:45:99:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '56048083-24ed-41eb-868c-2140c7b486c8', 'device_owner': 'network:router_interface', 'standard_attr_id': 876, 'fixed_ips': [{'subnet_id': '005ae052-6cd6-4ddc-833f-af6e1c2bff40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:02Z', 'updated_at': '2022-05-12T15:12:23Z', 'revision_number': 4, 'project_id': '1aea6927c780448b89ddf44ec6bcb186', 'subnets': [{'id': '005ae052-6cd6-4ddc-833f-af6e1c2bff40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:12:31.052596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-799cc7fc-692b-4f43-9c7c-e1d4adde1f9e tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Unset dirty status for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:12:31.054053 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-799cc7fc-692b-4f43-9c7c-e1d4adde1f9e tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.76 "GET /v2.0/networks?id=9021e9b2-6c8f-4b20-8148-52e45c2296b3&id=b55a7520-40f6-4d38-b0f0-235a1cd1b883&id=9021e9b2-6c8f-4b20-8148-52e45c2296b3 HTTP/1.1" status: 200 len: 1391 time: 0.8360739 May 12 15:12:31.161890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 6a06c973-3d79-4b79-bed8-be79093b0fe4 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:31.172227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-34272803-518f-4b01-8159-955c881a2f97 None None] Provisioning for port 6a06c973-3d79-4b79-bed8-be79093b0fe4 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:31.182077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Request body: {'port': {'device_id': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3', 'admin_state_up': True, 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:31.200061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-34272803-518f-4b01-8159-955c881a2f97 None None] Provisioning complete for port 6a06c973-3d79-4b79-bed8-be79093b0fe4 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:31.200425 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-34272803-518f-4b01-8159-955c881a2f97 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:31.260644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Calling delete_port for 9787cef9-03af-4a15-af20-0eb8fe5ee859 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:31.333719 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-93118091-da39-4168-a496-9426ac59167f None None] Attempting to bind port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:31.334083 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-93118091-da39-4168-a496-9426ac59167f None None] Attempting to bind port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '36ebeacd-da47-43a4-9f56-f8706690a71c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'b55a7520-40f6-4d38-b0f0-235a1cd1b883'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:31.334435 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93118091-da39-4168-a496-9426ac59167f None None] Attempting to bind port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 on network b55a7520-40f6-4d38-b0f0-235a1cd1b883 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:31.346846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 6a06c973-3d79-4b79-bed8-be79093b0fe4 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:31.347212 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:31.374386 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:12:31.426225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93118091-da39-4168-a496-9426ac59167f None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:31.427076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93118091-da39-4168-a496-9426ac59167f None None] Checking segment: {'id': '36ebeacd-da47-43a4-9f56-f8706690a71c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'b55a7520-40f6-4d38-b0f0-235a1cd1b883'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:31.427794 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-93118091-da39-4168-a496-9426ac59167f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:31.428349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93118091-da39-4168-a496-9426ac59167f None None] Bound using segment: {'id': '36ebeacd-da47-43a4-9f56-f8706690a71c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'b55a7520-40f6-4d38-b0f0-235a1cd1b883'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:31.429237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-93118091-da39-4168-a496-9426ac59167f None None] Bound port: 7f35bc1f-e9eb-48bd-ad84-4040c239cee1, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '36ebeacd-da47-43a4-9f56-f8706690a71c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'b55a7520-40f6-4d38-b0f0-235a1cd1b883'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:31.429893 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-93118091-da39-4168-a496-9426ac59167f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:31.483888 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:31.580493 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:31.598070 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:31.651594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:31.662763 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:31.663305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] Fanout notify agent at l3_agent the message router_deleted on router ea3f04a0-308b-4219-ad26-2924d153122f {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:12:31.665882 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Usage tracker for resource:port and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:31.694381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Quota usage for port was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:31.705337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:31.740781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:31.744533 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7d93d01d-efcf-41b2-ba94-631e1ff733c5 admin admin] 10.222.0.82 "DELETE /v2.0/routers/ea3f04a0-308b-4219-ad26-2924d153122f HTTP/1.1" status: 204 len: 168 time: 3.9390712 May 12 15:12:31.751835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52386) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:31.767817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '301de57f-75b6-4323-a891-da62f7306fd1', 'name': 'tempest-TaggedBootDevicesTest_v242-265683194-router', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245'}], 'enable_snat': True}, 'gw_port_id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:12:01Z', 'updated_at': '2022-05-12T15:12:06Z', 'revision_number': 4, 'project_id': '0e49c03c26594e7fa192a1a667415ff3', 'gw_port': {'id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:49:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '301de57f-75b6-4323-a891-da62f7306fd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 875, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:02Z', 'updated_at': '2022-05-12T15:12:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '78867492-bce0-46a9-bcbd-e2e2cbd76ff5', 'name': '', 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'mac_address': 'fa:16:3e:75:80:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '301de57f-75b6-4323-a891-da62f7306fd1', 'device_owner': 'network:router_interface', 'standard_attr_id': 877, 'fixed_ips': [{'subnet_id': '4081ed9c-dabb-4f65-a1dc-a63a854f2f4a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:05Z', 'updated_at': '2022-05-12T15:12:26Z', 'revision_number': 4, 'project_id': '0e49c03c26594e7fa192a1a667415ff3', 'subnets': [{'id': '4081ed9c-dabb-4f65-a1dc-a63a854f2f4a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:31.780666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:31.797578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aad00e9-72eb-4a0b-a113-64e251ad071f None None] The sync data for ids ['301de57f-75b6-4323-a891-da62f7306fd1'] in n-d-841483-1 is: [{'id': '301de57f-75b6-4323-a891-da62f7306fd1', 'name': 'tempest-TaggedBootDevicesTest_v242-265683194-router', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245'}], 'enable_snat': True}, 'gw_port_id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:12:01Z', 'updated_at': '2022-05-12T15:12:06Z', 'revision_number': 4, 'project_id': '0e49c03c26594e7fa192a1a667415ff3', 'gw_port': {'id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:49:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '301de57f-75b6-4323-a891-da62f7306fd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 875, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:02Z', 'updated_at': '2022-05-12T15:12:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '78867492-bce0-46a9-bcbd-e2e2cbd76ff5', 'name': '', 'network_id': 'aceafe3e-7a49-42ba-b541-5d9652123c2b', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'mac_address': 'fa:16:3e:75:80:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '301de57f-75b6-4323-a891-da62f7306fd1', 'device_owner': 'network:router_interface', 'standard_attr_id': 877, 'fixed_ips': [{'subnet_id': '4081ed9c-dabb-4f65-a1dc-a63a854f2f4a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:05Z', 'updated_at': '2022-05-12T15:12:26Z', 'revision_number': 4, 'project_id': '0e49c03c26594e7fa192a1a667415ff3', 'subnets': [{'id': '4081ed9c-dabb-4f65-a1dc-a63a854f2f4a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:12:31.836728 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:31.846383 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4b2fc410-d9a8-4bcd-af90-17da21c97bac {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:31.868967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:31.875536 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:31.883226 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:31.892043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f1baf56-2f87-4b72-9313-e1e609416feb req-2d8f1c7e-bb27-4716-9484-f0a2a7ca5713 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:31.892798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9f1baf56-2f87-4b72-9313-e1e609416feb req-2d8f1c7e-bb27-4716-9484-f0a2a7ca5713 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Synchronizing usage tracker for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:12:31.936856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Transition to ACTIVE for port object 4b2fc410-d9a8-4bcd-af90-17da21c97bac will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:31.946523 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:12:31.946634 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:12:31.949840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9f1baf56-2f87-4b72-9313-e1e609416feb req-2d8f1c7e-bb27-4716-9484-f0a2a7ca5713 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Unset dirty status for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:12:31.959290 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f1baf56-2f87-4b72-9313-e1e609416feb req-2d8f1c7e-bb27-4716-9484-f0a2a7ca5713 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=463cc5a1-f7b3-45c8-a707-e2e999a85e8c HTTP/1.1" status: 200 len: 931 time: 1.3080215 May 12 15:12:31.978191 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:32.004869 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:32.027090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-93118091-da39-4168-a496-9426ac59167f None None] For port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:32.031545 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-93118091-da39-4168-a496-9426ac59167f None None] For port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7f35bc1f-e9eb-48bd-ad84-4040c239cee1,segment=NetworkSegment(36ebeacd-da47-43a4-9f56-f8706690a71c),segment_id=36ebeacd-da47-43a4-9f56-f8706690a71c)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:32.082504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9965f819-7752-433b-8d19-0c1b8b0af90d req-2ab845fc-42c3-4698-a1cc-cc9f1d11fadc tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:32.084525 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9965f819-7752-433b-8d19-0c1b8b0af90d req-2ab845fc-42c3-4698-a1cc-cc9f1d11fadc tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.7835956 May 12 15:12:32.141481 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-4595b69b-2b41-4133-89d5-c1cd94e6d522 admin admin] Deleting subnet eb51e145-1f59-4ab5-b2f3-a32c2c6ee575 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:12:32.182352 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4595b69b-2b41-4133-89d5-c1cd94e6d522 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:32.199453 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=14']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:32.204101 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 9787cef9-03af-4a15-af20-0eb8fe5ee859 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:12:32.317634 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-93118091-da39-4168-a496-9426ac59167f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:32.424564 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9965f819-7752-433b-8d19-0c1b8b0af90d req-1e8582a0-ce3e-41f6-8a4d-6bb214f4c440 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.97 HTTP/1.1" status: 200 len: 695 time: 0.1193466 May 12 15:12:32.431887 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4595b69b-2b41-4133-89d5-c1cd94e6d522 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:32.465956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Deleting port 9787cef9-03af-4a15-af20-0eb8fe5ee859 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:32.467365 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:32.491967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93118091-da39-4168-a496-9426ac59167f None None] Pushing event updated for resources: {'Port': ['ID=7f35bc1f-e9eb-48bd-ad84-4040c239cee1,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:32.584283 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f1baf56-2f87-4b72-9313-e1e609416feb req-08683787-e6f6-4e55-a8fc-6ec10abdf5f5 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6232932 May 12 15:12:32.620050 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:32.672819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Allocated IP 19.80.0.220 (9021e9b2-6c8f-4b20-8148-52e45c2296b3/7e73bcb0-088d-46bf-8dd4-a976776d8b9c/0e99f99c-8d6a-408a-83f0-5cc1c1d502a3) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:32.688043 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:32.760969 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-34272803-518f-4b01-8159-955c881a2f97 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:32.892076 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:33.044337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 6a06c973-3d79-4b79-bed8-be79093b0fe4, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6a06c973-3d79-4b79-bed8-be79093b0fe4,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:33.062852 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:33.082546 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:33.083335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:33.151331 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4595b69b-2b41-4133-89d5-c1cd94e6d522 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:33.165784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Pushing event updated for resources: {'Port': ['ID=4b2fc410-d9a8-4bcd-af90-17da21c97bac,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:33.356472 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4595b69b-2b41-4133-89d5-c1cd94e6d522 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:33.363458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Transition to ACTIVE for port object 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:33.398607 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-34272803-518f-4b01-8159-955c881a2f97 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:12:33.398978 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-34272803-518f-4b01-8159-955c881a2f97 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:12:33.413364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:33.436810 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:33.454890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:33.465829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=6a06c973-3d79-4b79-bed8-be79093b0fe4,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:33.468156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4595b69b-2b41-4133-89d5-c1cd94e6d522 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=eb51e145-1f59-4ab5-b2f3-a32c2c6ee575,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:33.491066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Attempting to bind port 4b2fc410-d9a8-4bcd-af90-17da21c97bac on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:33.491595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Attempting to bind port 4b2fc410-d9a8-4bcd-af90-17da21c97bac by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:33.492097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Attempting to bind port 4b2fc410-d9a8-4bcd-af90-17da21c97bac on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:33.492889 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4595b69b-2b41-4133-89d5-c1cd94e6d522 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:33.522941 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4595b69b-2b41-4133-89d5-c1cd94e6d522 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/eb51e145-1f59-4ab5-b2f3-a32c2c6ee575 HTTP/1.1" status: 204 len: 168 time: 1.7699070 May 12 15:12:33.527020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52404) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:33.556785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9965f819-7752-433b-8d19-0c1b8b0af90d req-00b4d1be-8efb-40b1-8bae-91cdc5011230 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.97 HTTP/1.1" status: 200 len: 695 time: 1.0988603 May 12 15:12:33.557549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Port 4b2fc410-d9a8-4bcd-af90-17da21c97bac on network dbc2e49c-2591-4534-a48c-cea8e23115f4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:12:33.558036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Attempting to bind port 4b2fc410-d9a8-4bcd-af90-17da21c97bac on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:33.572023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:33.572397 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:33.608523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=15']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:33.611394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f76cca30-04f5-44a4-ae3f-d222d013d790 None None] Network 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:12:33.690026 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:33.690288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:33.690670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Checking segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:33.691173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Bound using segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:33.691730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Bound port: 4b2fc410-d9a8-4bcd-af90-17da21c97bac, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:33.692175 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:33.705740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Deleting port adab67f3-e920-4d7e-965f-e2431533c911 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:33.706168 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:33.740248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:33.810580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:33.811055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:33.826465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-9965f819-7752-433b-8d19-0c1b8b0af90d req-160c7003-2284-4ca6-8448-d4ff8cd811ec tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Deleting port c7cafed4-a492-4873-8fd6-cf54b2e9da10 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:33.826832 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9965f819-7752-433b-8d19-0c1b8b0af90d req-160c7003-2284-4ca6-8448-d4ff8cd811ec tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:33.840498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event updated for resources: {'Port': ['ID=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:33.863513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:33.866423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:33.881113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:33.960775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:33.961468 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:34.118807 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9965f819-7752-433b-8d19-0c1b8b0af90d req-160c7003-2284-4ca6-8448-d4ff8cd811ec tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:34.119140 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9965f819-7752-433b-8d19-0c1b8b0af90d req-160c7003-2284-4ca6-8448-d4ff8cd811ec tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:34.195978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] For port adab67f3-e920-4d7e-965f-e2431533c911, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=adab67f3-e920-4d7e-965f-e2431533c911,segment=NetworkSegment(0f481a89-826f-4a90-903d-276e9b18feb1),segment_id=0f481a89-826f-4a90-903d-276e9b18feb1)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:34.196501 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:34.225293 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:34.301352 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=78867492-bce0-46a9-bcbd-e2e2cbd76ff5,segment=NetworkSegment(b6ca0527-0ae0-46e1-98b3-d59b1f312d8d),segment_id=b6ca0527-0ae0-46e1-98b3-d59b1f312d8d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:34.329164 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:34.330346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fac623c3-0b49-4481-af00-ce11553f25e2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:34.442554 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Calling delete_port for adab67f3-e920-4d7e-965f-e2431533c911 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:34.502825 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e79f29f-566c-4fdb-b82d-da76a346df14 None None] DHCP port deletion for 7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:12:34.505368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2068286f-b2bb-4bbd-ae5b-356f5d1e6a9f None None] Provisioning for port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:34.518256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=78867492-bce0-46a9-bcbd-e2e2cbd76ff5,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:34.531317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2e79f29f-566c-4fdb-b82d-da76a346df14 None None] Deleting port adab67f3-e920-4d7e-965f-e2431533c911 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:34.531691 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2e79f29f-566c-4fdb-b82d-da76a346df14 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:34.599115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2068286f-b2bb-4bbd-ae5b-356f5d1e6a9f None None] Provisioning complete for port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:34.599485 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2068286f-b2bb-4bbd-ae5b-356f5d1e6a9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:34.613549 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f4fda7ed-5c38-4d15-b395-a64150ba1b62 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.4361074 May 12 15:12:34.626936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Request body: {'port': {'device_id': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'network_id': 'b55a7520-40f6-4d38-b0f0-235a1cd1b883', 'admin_state_up': True, 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:34.688032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b0dde49-8eac-4bd7-9923-641a5be322f7 None None] Network b55a7520-40f6-4d38-b0f0-235a1cd1b883 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:12:34.796725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-9965f819-7752-433b-8d19-0c1b8b0af90d req-160c7003-2284-4ca6-8448-d4ff8cd811ec tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Calling delete_port for c7cafed4-a492-4873-8fd6-cf54b2e9da10 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:34.805761 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:34.919107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2e79f29f-566c-4fdb-b82d-da76a346df14 None None] The port 'adab67f3-e920-4d7e-965f-e2431533c911' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:12:34.948266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2068286f-b2bb-4bbd-ae5b-356f5d1e6a9f None None] Port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:12:34.998749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2068286f-b2bb-4bbd-ae5b-356f5d1e6a9f None None] Provisioning complete for port 6a06c973-3d79-4b79-bed8-be79093b0fe4 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:34.999154 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2068286f-b2bb-4bbd-ae5b-356f5d1e6a9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:35.042243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port fac623c3-0b49-4481-af00-ce11553f25e2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:35.042598 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:35.051722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Calling delete_port for 9787cef9-03af-4a15-af20-0eb8fe5ee859 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:35.090535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] No DVR routers for this DVR port adab67f3-e920-4d7e-965f-e2431533c911 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:12:35.100446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d54e1840-b98a-4783-914e-2d1c4d30ed93 req-baea7ba9-bd6e-4369-b9c4-9ceda3823bde tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:35.108303 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d54e1840-b98a-4783-914e-2d1c4d30ed93 req-baea7ba9-bd6e-4369-b9c4-9ceda3823bde tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 948 time: 1.8496265 May 12 15:12:35.250250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] For port 4b2fc410-d9a8-4bcd-af90-17da21c97bac, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:35.256328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] For port 4b2fc410-d9a8-4bcd-af90-17da21c97bac, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4b2fc410-d9a8-4bcd-af90-17da21c97bac,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:35.262306 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d54e1840-b98a-4783-914e-2d1c4d30ed93 req-466632dc-77fb-4ca7-baa4-1d6847ab1f2e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1527314 May 12 15:12:35.301913 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:35.362876 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:35.376142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Pushing event deleted for resources: {'Port': ['ID=adab67f3-e920-4d7e-965f-e2431533c911,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:35.409195 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:12:35.409544 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:12:35.418132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:35.421797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7336b0e1-6ae7-4c8a-98e8-3f13adbdc190']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:35.426032 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:35.427492 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] 10.222.0.76 "PUT /v2.0/ports/4b2fc410-d9a8-4bcd-af90-17da21c97bac HTTP/1.1" status: 200 len: 1091 time: 7.5813360 May 12 15:12:35.429447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '463cc5a1-f7b3-45c8-a707-e2e999a85e8c', 'tag': '4b2fc410-d9a8-4bcd-af90-17da21c97bac'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:35.459182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:35.473941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0f481a89-826f-4a90-903d-276e9b18feb1') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:35.476763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0f481a89-826f-4a90-903d-276e9b18feb1') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:35.542458 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:35.596429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:35.596684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-526e8ab4-9b20-44ff-93b5-b05b3abdd6a2 None None] Provisioning for port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:35.609114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Usage tracker for resource:port and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:35.619958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Quota usage for port was recalculated. Used quota:5. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:35.630904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attempting to reserve 1 items for resource port. Total usage: 5; quota limit: 500; headroom:495 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:35.638029 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:35.676693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Releasing vlan 552 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:12:35.678726 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:35.681121 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:12:35.682798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:35.690198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:35.691152 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: timer() May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:12:35.713491 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:12:35.813036 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:35.816588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:35.820934 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:35.857734 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9965f819-7752-433b-8d19-0c1b8b0af90d req-160c7003-2284-4ca6-8448-d4ff8cd811ec tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:35.876971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c9bf6f3-4bf6-4266-930d-1876704783db service neutron] Pushing event updated for resources: {'Port': ['ID=4b2fc410-d9a8-4bcd-af90-17da21c97bac,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:35.918460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:35.920039 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.004481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-160c7003-2284-4ca6-8448-d4ff8cd811ec tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Pushing event deleted for resources: {'Port': ['ID=c7cafed4-a492-4873-8fd6-cf54b2e9da10,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:36.031632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d921a88e-48dd-4507-a2aa-b7c8b1eda6be req-180c3102-be86-4c24-9a6b-d21feb314cdc tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:36.033120 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d921a88e-48dd-4507-a2aa-b7c8b1eda6be req-180c3102-be86-4c24-9a6b-d21feb314cdc tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 1097 time: 0.4749677 May 12 15:12:36.069066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-4c0055ea-177b-4194-a244-8831c43dbeb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:36.070553 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-4c0055ea-177b-4194-a244-8831c43dbeb1 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=463cc5a1-f7b3-45c8-a707-e2e999a85e8c HTTP/1.1" status: 200 len: 1094 time: 0.5764000 May 12 15:12:36.071337 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9965f819-7752-433b-8d19-0c1b8b0af90d req-160c7003-2284-4ca6-8448-d4ff8cd811ec tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.096945 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.101897 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.124505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:36.140564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] Pushing event deleted for resources: {'Network': ['ID=7336b0e1-6ae7-4c8a-98e8-3f13adbdc190,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:36.155430 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-58d2d0be-acf2-4592-9905-7ececc81a1e0 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4b2fc410-d9a8-4bcd-af90-17da21c97bac HTTP/1.1" status: 200 len: 217 time: 0.0765448 May 12 15:12:36.175252 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b7b3f59c-ea50-401e-b0f2-c7fb16484c73 admin admin] 10.222.0.82 "DELETE /v2.0/networks/7336b0e1-6ae7-4c8a-98e8-3f13adbdc190 HTTP/1.1" status: 204 len: 168 time: 2.6471848 May 12 15:12:36.176968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Allocated IP 19.86.0.4 (b55a7520-40f6-4d38-b0f0-235a1cd1b883/b8fd478e-7f1c-4be3-acd2-b5504391fab8/65584e07-bbd0-40f8-806a-3b7a85300525) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:36.202291 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9965f819-7752-433b-8d19-0c1b8b0af90d req-160c7003-2284-4ca6-8448-d4ff8cd811ec tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.203412 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9965f819-7752-433b-8d19-0c1b8b0af90d req-160c7003-2284-4ca6-8448-d4ff8cd811ec tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "DELETE /v2.0/floatingips/4ef70a1b-989d-4909-b9b1-b8292829ff28 HTTP/1.1" status: 204 len: 173 time: 2.6292896 May 12 15:12:36.211020 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d921a88e-48dd-4507-a2aa-b7c8b1eda6be req-3331c51f-c20f-401f-a605-0a623e05e2f4 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1664391 May 12 15:12:36.299361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-eaea145f-4e8a-4ca8-a144-f3c035f0e528 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:36.300822 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-eaea145f-4e8a-4ca8-a144-f3c035f0e528 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.1355629 May 12 15:12:36.321597 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.376601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:36.378490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:36.385413 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:36.386073 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.423443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Deleting port 9787cef9-03af-4a15-af20-0eb8fe5ee859 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:36.423800 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.423929 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.452116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-6d8ec4e3-d311-47a7-b2ed-351f2f54edd7 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1439593 May 12 15:12:36.575185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:36.585814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:36.586434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:36.586434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:36.586661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:36.586991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:36.587308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:36.587600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:36.587911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:36.588218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:36.588526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:36.588834 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:36.589134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:12:36.598121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.627521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52426) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:36.636513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Transition to ACTIVE for port object 65584e07-bbd0-40f8-806a-3b7a85300525 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:36.662296 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.704035 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-78ee815e-dd90-4257-b984-0a3ae89ce9de admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a673d571317840e888b6cfe5a121092e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0718410 May 12 15:12:36.706416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52430) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:36.713186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7f35bc1f-e9eb-48bd-ad84-4040c239cee1,segment=NetworkSegment(36ebeacd-da47-43a4-9f56-f8706690a71c),segment_id=36ebeacd-da47-43a4-9f56-f8706690a71c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:36.718529 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.719301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9003ae7a-c261-4797-a9b3-af884e53a88b up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:36.782433 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.820143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-88f30c19-115e-4c37-8535-7c4fcae1e036 service neutron] 10.222.0.76 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2918601 May 12 15:12:36.839621 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=7f35bc1f-e9eb-48bd-ad84-4040c239cee1,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:36.853631 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 9003ae7a-c261-4797-a9b3-af884e53a88b completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:36.858799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 9003ae7a-c261-4797-a9b3-af884e53a88b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:36.859410 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.859527 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32ef4468-a595-4506-88f3-e7c892e3a6dd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:36.863127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Network b55a7520-40f6-4d38-b0f0-235a1cd1b883 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:36.878612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:36.887293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:37.003419 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32ef4468-a595-4506-88f3-e7c892e3a6dd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:37.009232 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:37.020791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event updated for resources: {'Port': ['ID=65584e07-bbd0-40f8-806a-3b7a85300525,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:37.059111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 9003ae7a-c261-4797-a9b3-af884e53a88b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9003ae7a-c261-4797-a9b3-af884e53a88b,segment=NetworkSegment(3155d58f-cee0-46db-bac9-2d07d9e2fa60),segment_id=3155d58f-cee0-46db-bac9-2d07d9e2fa60)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:37.070607 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:37.071617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6a06c973-3d79-4b79-bed8-be79093b0fe4 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:37.072096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:37.072783 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:37.143457 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f762fc96-894a-403e-8923-62706bc159c6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 2.5225425 May 12 15:12:37.159275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Request body: {'port': {'device_id': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3', 'admin_state_up': True, 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:37.276457 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=9003ae7a-c261-4797-a9b3-af884e53a88b,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:37.312202 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 6a06c973-3d79-4b79-bed8-be79093b0fe4 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:37.312597 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:37.358255 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86099bed-254f-4ee0-8880-3bf2da45f945 req-6397615a-2929-442f-b871-281fab4434d3 service neutron] 10.222.0.76 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5136118 May 12 15:12:37.381338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69af284b-8cb1-409a-a7c4-f40665ae3926 req-4a31773a-3869-4d2e-aa76-aee548a67e76 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:37.382855 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69af284b-8cb1-409a-a7c4-f40665ae3926 req-4a31773a-3869-4d2e-aa76-aee548a67e76 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 932 time: 0.8969126 May 12 15:12:37.404857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baa4fa62-e6a7-429b-9942-da7ee79975bf req-0d759a3d-4d13-4b70-833d-542e599ac395 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:37.405626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-baa4fa62-e6a7-429b-9942-da7ee79975bf req-0d759a3d-4d13-4b70-833d-542e599ac395 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Synchronizing usage tracker for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:12:37.429243 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32ef4468-a595-4506-88f3-e7c892e3a6dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:37.449328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0e19f16d-8ccb-4607-84a4-66cf6c180675 None None] Provisioning for port 65584e07-bbd0-40f8-806a-3b7a85300525 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:37.449582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-baa4fa62-e6a7-429b-9942-da7ee79975bf req-0d759a3d-4d13-4b70-833d-542e599ac395 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Unset dirty status for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:12:37.450529 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-baa4fa62-e6a7-429b-9942-da7ee79975bf req-0d759a3d-4d13-4b70-833d-542e599ac395 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=e0cf7455-6caf-459e-9abc-ba41eaa0ccc1 HTTP/1.1" status: 200 len: 948 time: 0.9975479 May 12 15:12:37.457755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ef4468-a595-4506-88f3-e7c892e3a6dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b07ab56c-6992-461f-9d49-85a5e3334b7e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:37.466279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0e19f16d-8ccb-4607-84a4-66cf6c180675 None None] Provisioning complete for port 65584e07-bbd0-40f8-806a-3b7a85300525 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:37.466654 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0e19f16d-8ccb-4607-84a4-66cf6c180675 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:37.483174 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32ef4468-a595-4506-88f3-e7c892e3a6dd admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:37.484958 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-32ef4468-a595-4506-88f3-e7c892e3a6dd admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b07ab56c-6992-461f-9d49-85a5e3334b7e HTTP/1.1" status: 204 len: 168 time: 0.7774642 May 12 15:12:37.498884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:37.508619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Usage tracker for resource:port and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:37.516919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Quota usage for port was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:37.523717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-69af284b-8cb1-409a-a7c4-f40665ae3926 req-c48bb5a8-d44c-4cb3-aa71-732234dc39c8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Synchronizing usage tracker for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:12:37.533643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attempting to reserve 1 items for resource port. Total usage: 6; quota limit: 500; headroom:494 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:37.564167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:37.569003 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:37.586847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-baa4fa62-e6a7-429b-9942-da7ee79975bf req-b1bae7e3-536b-4f9e-988a-85370add1e5d tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0867720 May 12 15:12:37.588630 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] For port 9787cef9-03af-4a15-af20-0eb8fe5ee859, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9787cef9-03af-4a15-af20-0eb8fe5ee859,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:37.588992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:37.603404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-69af284b-8cb1-409a-a7c4-f40665ae3926 req-c48bb5a8-d44c-4cb3-aa71-732234dc39c8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Unset dirty status for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:12:37.616908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69af284b-8cb1-409a-a7c4-f40665ae3926 req-c48bb5a8-d44c-4cb3-aa71-732234dc39c8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2266417 May 12 15:12:37.640507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0e19f16d-8ccb-4607-84a4-66cf6c180675 None None] Port 65584e07-bbd0-40f8-806a-3b7a85300525 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:12:37.733271 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6f09dd4b-11b0-4942-a83b-49199ef48f75'] response: {'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'code': 200} May 12 15:12:37.891590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fdea6f95-4926-47ab-b77f-0443f92db7f5 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:12:37.983260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: fdea6f95-4926-47ab-b77f-0443f92db7f5 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:12:37.983617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fdea6f95-4926-47ab-b77f-0443f92db7f5 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:12:37.984000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device adab67f3-e920-4d7e-965f-e2431533c911 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:12:38.056577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: adab67f3-e920-4d7e-965f-e2431533c911 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:12:38.056906 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device adab67f3-e920-4d7e-965f-e2431533c911 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:12:38.057311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:12:38.071056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Allocated IP 19.80.0.219 (9021e9b2-6c8f-4b20-8148-52e45c2296b3/7e73bcb0-088d-46bf-8dd4-a976776d8b9c/039f5f29-f92a-42e9-9582-4aaf75edb62a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:38.131621 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ea9ef79f-9eb3-494b-b312-7f533574c230'] response: {'name': 'network-changed', 'server_uuid': '463cc5a1-f7b3-45c8-a707-e2e999a85e8c', 'tag': '4b2fc410-d9a8-4bcd-af90-17da21c97bac', 'status': 'completed', 'code': 200} May 12 15:12:38.139367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:12:38.139671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8c5ce78c-6510-4f26-8ec1-1c039e69ff93 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:12:38.207346 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-4f695105-1e38-4d5c-990f-55e03fbe890d tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.2491527 May 12 15:12:38.284282 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:38.299531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Calling delete_port for 9787cef9-03af-4a15-af20-0eb8fe5ee859 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:38.469458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:38.470772 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:38.473277 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:38.493623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Transition to ACTIVE for port object 039f5f29-f92a-42e9-9582-4aaf75edb62a will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:38.508639 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:38.522958 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:38.533282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:38.564950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Usage tracker for resource:floatingip and tenant:4c3ee180ddb64a8685bd55247106d4cb is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:38.576402 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:38.595748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:38.627138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event updated for resources: {'Port': ['ID=039f5f29-f92a-42e9-9582-4aaf75edb62a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:38.639317 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:38.656853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:38.659997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:38.662640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['b6035326-cd91-47d7-8a65-cc2dd3d1d127', 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:38.663823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:38.714234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a686f1c4-b2f1-4692-950a-b2a71f6aeb6f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:38.745769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:38.746409 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:38.760986 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:38.782366 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-dc59f344-5fcd-4eb1-aa5c-06075a983895 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.6324539 May 12 15:12:38.795826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Request body: {'port': {'device_id': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:38.806218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83f4c2c8-eb67-4750-a4c7-736dde06667b req-f2b00179-b10c-430d-a74e-eecb70c325f4 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:38.808368 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83f4c2c8-eb67-4750-a4c7-736dde06667b req-f2b00179-b10c-430d-a74e-eecb70c325f4 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=463cc5a1-f7b3-45c8-a707-e2e999a85e8c HTTP/1.1" status: 200 len: 943 time: 0.6733510 May 12 15:12:38.823934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Pushing event deleted for resources: {'Port': ['ID=9787cef9-03af-4a15-af20-0eb8fe5ee859,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:38.970337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9003ae7a-c261-4797-a9b3-af884e53a88b up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:39.071809 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781475ad-dd84-467d-87ee-b4199cb2ac7d req-68f76dbf-35c4-442e-8c18-0789a7537654 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:39.075143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-781475ad-dd84-467d-87ee-b4199cb2ac7d req-68f76dbf-35c4-442e-8c18-0789a7537654 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=463cc5a1-f7b3-45c8-a707-e2e999a85e8c HTTP/1.1" status: 200 len: 1094 time: 0.9454806 May 12 15:12:39.134428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52470) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:39.221198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b0025ee7-9fe8-4886-9045-e38d563eb764 None None] Provisioning for port 039f5f29-f92a-42e9-9582-4aaf75edb62a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:39.231648 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b0025ee7-9fe8-4886-9045-e38d563eb764 None None] Provisioning complete for port 039f5f29-f92a-42e9-9582-4aaf75edb62a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:39.232044 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b0025ee7-9fe8-4886-9045-e38d563eb764 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:39.264129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] No DVR routers for this DVR port 9787cef9-03af-4a15-af20-0eb8fe5ee859 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:12:39.269765 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:39.278214 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:39.295545 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b0025ee7-9fe8-4886-9045-e38d563eb764 None None] Port 039f5f29-f92a-42e9-9582-4aaf75edb62a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:12:39.323264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83f4c2c8-eb67-4750-a4c7-736dde06667b req-6f0a3cc1-360f-402e-a900-27adba21d30a tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4947278 May 12 15:12:39.339467 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3886fbba-f43c-4480-8848-5de53fd688c1 req-64a6049a-baa0-4bdc-8ce0-2a5f54684d07 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.76 "DELETE /v2.0/ports/9787cef9-03af-4a15-af20-0eb8fe5ee859 HTTP/1.1" status: 204 len: 173 time: 9.5449197 May 12 15:12:39.354185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 9003ae7a-c261-4797-a9b3-af884e53a88b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:39.354185 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:39.428909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781475ad-dd84-467d-87ee-b4199cb2ac7d req-c669cfe6-31db-4617-9ade-b54a02f22782 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:39.430989 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-781475ad-dd84-467d-87ee-b4199cb2ac7d req-c669cfe6-31db-4617-9ade-b54a02f22782 service neutron] 10.222.0.76 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 907 time: 0.2944872 May 12 15:12:39.532638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Request body: {'network': {'name': 'tempest-ServerDiskConfigTestJSON-1067706343-network', 'tenant_id': 'aca50b48316f40a7a6ceb23c44dd4720'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:39.551659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4b2fc410-d9a8-4bcd-af90-17da21c97bac details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:12:39.552349 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-781475ad-dd84-467d-87ee-b4199cb2ac7d req-2e5766e4-6323-4b36-b267-e0554957a659 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4b2fc410-d9a8-4bcd-af90-17da21c97bac HTTP/1.1" status: 200 len: 217 time: 0.1105964 May 12 15:12:39.556301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:39.572900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Usage tracker for resource:network and tenant:aca50b48316f40a7a6ceb23c44dd4720 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:39.609244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:39.634102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:39.664470 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:39.721099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Made reservation on behalf of aca50b48316f40a7a6ceb23c44dd4720 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:39.723432 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:39.735485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781475ad-dd84-467d-87ee-b4199cb2ac7d req-67f4b331-f6d6-4121-bcca-42fd246bd996 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:39.737120 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-781475ad-dd84-467d-87ee-b4199cb2ac7d req-67f4b331-f6d6-4121-bcca-42fd246bd996 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.1750195 May 12 15:12:39.737422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859'}, {'server_uuid': '356d3884-ccc1-4305-bdd1-7231fe627d9f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:39.788070 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:39.852434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 4b2fc410-d9a8-4bcd-af90-17da21c97bac, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4b2fc410-d9a8-4bcd-af90-17da21c97bac,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:39.878020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '4b2fc410-d9a8-4bcd-af90-17da21c97bac', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'port_id': '4b2fc410-d9a8-4bcd-af90-17da21c97bac', 'mac_address': 'fa:16:3e:e9:e2:46', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 558, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84c2082e-f394-46d5-8a8f-8e3a70d54fc1', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:12:39.891700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-781475ad-dd84-467d-87ee-b4199cb2ac7d req-b8b6d736-7a2b-488c-b044-a0949e13e3b2 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1463518 May 12 15:12:39.893158 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:39.901540 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:39.925776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Transition to ACTIVE for port object 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:39.936054 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:39.970634 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:39.992677 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4b2fc410-d9a8-4bcd-af90-17da21c97bac {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:40.011803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 4b2fc410-d9a8-4bcd-af90-17da21c97bac, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4b2fc410-d9a8-4bcd-af90-17da21c97bac,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:40.019733 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:40.128435 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=4b2fc410-d9a8-4bcd-af90-17da21c97bac,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:40.145088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'name': 'network-vif-deleted', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:40.153178 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:40.153517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Pushing event updated for resources: {'Port': ['ID=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:40.173024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Usage tracker for resource:security_group_rule and tenant:aca50b48316f40a7a6ceb23c44dd4720 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:40.190505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:40.272903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['4b2fc410-d9a8-4bcd-af90-17da21c97bac'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:40.316209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Allocated IP 172.25.8.141 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/1d55c8ea-2cb2-4dde-a25c-d6485cc42d42) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:40.341008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Attempting to bind port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:40.343836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Attempting to bind port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8037e7d9-36c9-4cfc-9420-983f2660ddef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:40.344300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Attempting to bind port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 on network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:40.358352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 on network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:12:40.358917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Attempting to bind port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 on network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:40.365067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:40.365696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Checking segment: {'id': '8037e7d9-36c9-4cfc-9420-983f2660ddef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:40.366247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Bound using segment: {'id': '8037e7d9-36c9-4cfc-9420-983f2660ddef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:40.366929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Bound port: 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8037e7d9-36c9-4cfc-9420-983f2660ddef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:40.367432 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:40.456881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:40.534753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] For port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:40.538688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] For port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:40.544968 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:40.650552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:40.651301 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:40.656907 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] 10.222.0.76 "PUT /v2.0/ports/0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 HTTP/1.1" status: 200 len: 1092 time: 1.8662229 May 12 15:12:40.657420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'tag': '0e99f99c-8d6a-408a-83f0-5cc1c1d502a3'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:40.683681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d06e9a8-3225-4a23-a0ef-78d1fe51f289 service neutron] Pushing event updated for resources: {'Port': ['ID=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:40.693714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Request body: {'port': {'device_id': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:40.723337 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:40.744362 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:40.760678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 573} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:12:40.801223 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:40.801493 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Added segment 68221a3b-1121-4349-a5a1-801f502e908b of type vlan for network 079240cc-25ba-4ba4-a3b0-412d897b19bb May 12 15:12:40.816267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-781475ad-dd84-467d-87ee-b4199cb2ac7d req-fa0315fe-bb22-48f8-b589-b342cb6a449d service neutron] 10.222.0.76 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9087296 May 12 15:12:40.929531 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:40.965635 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:40.975695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:41.005597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed7317fd-2525-4d5b-a839-904abfb8ef28,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:41.029600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-b9bcc412-8ec4-486c-ad5c-8fce9cf61eef tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:12:41.030897 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-b9bcc412-8ec4-486c-ad5c-8fce9cf61eef tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0098495 May 12 15:12:41.089327 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:12:41.123609 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:41.162605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-465abdc0-8144-4f2b-b8ed-804b12cc702e service neutron] Request body: {'binding': {'host': 'n-h2-841483-1', 'vnic_type': 'normal', 'profile': {}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:41.163061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-465abdc0-8144-4f2b-b8ed-804b12cc702e service neutron] Unknown quota resources ['binding']. {{(pid=88151) _create /opt/stack/neutron/neutron/api/v2/base.py:495}} May 12 15:12:41.197851 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:41.198885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:41.199553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:41.321420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] Pushing event updated for resources: {'Network': ['ID=079240cc-25ba-4ba4-a3b0-412d897b19bb,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:41.336049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 079240cc-25ba-4ba4-a3b0-412d897b19bb details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:12:41.369582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:41.374442 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-781475ad-dd84-467d-87ee-b4199cb2ac7d req-b1a6cab7-4edb-47f6-aedc-63b2bcaff153 service neutron] 10.222.0.76 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5404985 May 12 15:12:41.377903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:41.389747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Pushing event updated for resources: {'Port': ['ID=1d55c8ea-2cb2-4dde-a25c-d6485cc42d42,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:41.396038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:41.440800 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8dc939ff-cc35-4d9f-b07b-cf8dc8e2e776 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 2.2942564 May 12 15:12:41.443443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52516) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:41.448742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Request body: {'subnet': {'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerDiskConfigTestJSON-1067706343-subnet', 'tenant_id': 'aca50b48316f40a7a6ceb23c44dd4720', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:41.457489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:41.464988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Usage tracker for resource:subnet and tenant:aca50b48316f40a7a6ceb23c44dd4720 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:41.471011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:41.481265 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:41.501931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Made reservation on behalf of aca50b48316f40a7a6ceb23c44dd4720 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:41.504611 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:41.552643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4b2fc410-d9a8-4bcd-af90-17da21c97bac up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:41.606119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-465abdc0-8144-4f2b-b8ed-804b12cc702e service neutron] Attempting to bind port 54f3ad03-fdf2-4862-93ff-f60efa594593 on host n-h2-841483-1 for vnic_type normal with profile None {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:41.607008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-465abdc0-8144-4f2b-b8ed-804b12cc702e service neutron] Attempting to bind port 54f3ad03-fdf2-4862-93ff-f60efa594593 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:41.607008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-465abdc0-8144-4f2b-b8ed-804b12cc702e service neutron] Attempting to bind port 54f3ad03-fdf2-4862-93ff-f60efa594593 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:41.617755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-465abdc0-8144-4f2b-b8ed-804b12cc702e service neutron] Port 54f3ad03-fdf2-4862-93ff-f60efa594593 on network e8211761-0dd9-424f-b732-629fd2d77e28 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:12:41.618097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-465abdc0-8144-4f2b-b8ed-804b12cc702e service neutron] Attempting to bind port 54f3ad03-fdf2-4862-93ff-f60efa594593 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:41.627332 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:41.628658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 65584e07-bbd0-40f8-806a-3b7a85300525 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:41.633201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-465abdc0-8144-4f2b-b8ed-804b12cc702e service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:41.633581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-465abdc0-8144-4f2b-b8ed-804b12cc702e service neutron] Checking segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:41.634263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-465abdc0-8144-4f2b-b8ed-804b12cc702e service neutron] Bound using segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:41.634424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-465abdc0-8144-4f2b-b8ed-804b12cc702e service neutron] Bound port: 54f3ad03-fdf2-4862-93ff-f60efa594593, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:41.642038 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:41.659029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 4b2fc410-d9a8-4bcd-af90-17da21c97bac completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:41.665956 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 4b2fc410-d9a8-4bcd-af90-17da21c97bac triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:41.666295 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:41.679789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Transition to ACTIVE for port object 65584e07-bbd0-40f8-806a-3b7a85300525 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:41.707728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-465abdc0-8144-4f2b-b8ed-804b12cc702e service neutron] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=54f3ad03-fdf2-4862-93ff-f60efa594593,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:41.712589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:41.748242 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:41.847572 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:41.890735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 4b2fc410-d9a8-4bcd-af90-17da21c97bac, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4b2fc410-d9a8-4bcd-af90-17da21c97bac,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:41.897412 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:41.939457 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-465abdc0-8144-4f2b-b8ed-804b12cc702e service neutron] Notify callbacks [] for binding, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:41.940363 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-465abdc0-8144-4f2b-b8ed-804b12cc702e service neutron] 10.222.0.82 "POST /v2.0/ports/54f3ad03-fdf2-4862-93ff-f60efa594593/bindings HTTP/1.1" status: 201 len: 389 time: 0.8788228 May 12 15:12:41.984551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=4b2fc410-d9a8-4bcd-af90-17da21c97bac,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:41.989338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Pushing event updated for resources: {'Port': ['ID=65584e07-bbd0-40f8-806a-3b7a85300525,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:42.082848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52524) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:42.102588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'network': {'name': 'tempest-device-tagging-net1-1511825541'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:42.110815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:42.118777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:network and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:42.124213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:42.139601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:42.153440 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:42.161355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Attempting to bind port 65584e07-bbd0-40f8-806a-3b7a85300525 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:42.161732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Attempting to bind port 65584e07-bbd0-40f8-806a-3b7a85300525 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '36ebeacd-da47-43a4-9f56-f8706690a71c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'b55a7520-40f6-4d38-b0f0-235a1cd1b883'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:42.162057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Attempting to bind port 65584e07-bbd0-40f8-806a-3b7a85300525 on network b55a7520-40f6-4d38-b0f0-235a1cd1b883 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:42.168147 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Port 65584e07-bbd0-40f8-806a-3b7a85300525 on network b55a7520-40f6-4d38-b0f0-235a1cd1b883 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:12:42.168378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Attempting to bind port 65584e07-bbd0-40f8-806a-3b7a85300525 on network b55a7520-40f6-4d38-b0f0-235a1cd1b883 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:42.174626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:42.175034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Checking segment: {'id': '36ebeacd-da47-43a4-9f56-f8706690a71c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'b55a7520-40f6-4d38-b0f0-235a1cd1b883'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:42.175346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Bound using segment: {'id': '36ebeacd-da47-43a4-9f56-f8706690a71c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'b55a7520-40f6-4d38-b0f0-235a1cd1b883'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:42.175781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Bound port: 65584e07-bbd0-40f8-806a-3b7a85300525, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '36ebeacd-da47-43a4-9f56-f8706690a71c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'b55a7520-40f6-4d38-b0f0-235a1cd1b883'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:42.176130 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:42.233944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Made reservation on behalf of 05b4f1ce61294fb29efb0a765ed28561 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:42.238047 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:42.300771 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] For port 65584e07-bbd0-40f8-806a-3b7a85300525, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:42.305047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] For port 65584e07-bbd0-40f8-806a-3b7a85300525, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=65584e07-bbd0-40f8-806a-3b7a85300525,segment=NetworkSegment(36ebeacd-da47-43a4-9f56-f8706690a71c),segment_id=36ebeacd-da47-43a4-9f56-f8706690a71c)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:42.311370 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:42.378619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Pushing event updated for resources: {'Subnet': ['ID=b6cc6b5a-d56a-4336-afb7-99232d9672dc,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:42.391798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:42.392401 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:42.394657 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] 10.222.0.76 "PUT /v2.0/ports/65584e07-bbd0-40f8-806a-3b7a85300525 HTTP/1.1" status: 200 len: 1090 time: 1.7061393 May 12 15:12:42.413746 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:12:42.419395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b74c97ce-18cd-44f3-8c98-b6750a29367d service neutron] Pushing event updated for resources: {'Port': ['ID=65584e07-bbd0-40f8-806a-3b7a85300525,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:42.428242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Request body: {'port': {'device_id': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:42.564596 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:42.588898 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:42.601038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 571} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:12:42.616436 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:42.671598 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fdb32a93-92de-4ec6-be09-9c7a1903f34e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:42.677667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Checking segment: {'id': '68221a3b-1121-4349-a5a1-801f502e908b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:42.678019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Network hostable DHCP agents. Network: 079240cc-25ba-4ba4-a3b0-412d897b19bb, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:12:42.682865 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:42.683197 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Added segment b6fbbd36-13c3-4b1d-bb92-589caea03666 of type vlan for network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 May 12 15:12:42.738118 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:42.817356 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:42.832697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Pushing event updated for resources: {'Port': ['ID=1d55c8ea-2cb2-4dde-a25c-d6485cc42d42,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:42.840740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Network 079240cc-25ba-4ba4-a3b0-412d897b19bb is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:12:42.850826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-70898227-6eaa-47c1-b855-712c6ff7c957 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:42.852203 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-70898227-6eaa-47c1-b855-712c6ff7c957 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 1097 time: 0.6002481 May 12 15:12:42.866482 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba7eb850-bff0-48c5-b7bf-845125a17194 req-2f83c957-92a0-4d1d-b096-c4cc83822a34 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:42.867909 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba7eb850-bff0-48c5-b7bf-845125a17194 req-2f83c957-92a0-4d1d-b096-c4cc83822a34 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 949 time: 0.6140645 May 12 15:12:42.872684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:42.899173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16eb7fe7-b6d7-496b-bece-0e26f6bf1354 req-287171b6-4d08-456a-a2af-dd8fd26317e3 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.5180624 May 12 15:12:42.912078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 079240cc-25ba-4ba4-a3b0-412d897b19bb) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:42.925741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74a42e88-0067-4401-b40c-532089d53564 None None] Network 079240cc-25ba-4ba4-a3b0-412d897b19bb requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:12:42.942333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 039f5f29-f92a-42e9-9582-4aaf75edb62a {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:42.949730 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:42.965244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Transition to ACTIVE for port object 039f5f29-f92a-42e9-9582-4aaf75edb62a will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:42.970523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:43.027588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:43.028397 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:43.104599 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:43.110496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:43.111093 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:43.128094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Pushing event updated for resources: {'Port': ['ID=039f5f29-f92a-42e9-9582-4aaf75edb62a,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:43.181894 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ad43198-7496-4c76-ab38-d614db91c6b8 None None] Network 079240cc-25ba-4ba4-a3b0-412d897b19bb requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:12:43.198770 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba7eb850-bff0-48c5-b7bf-845125a17194 req-041b49a0-fe3a-43f9-b942-c863c0aba7e0 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3197455 May 12 15:12:43.207539 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-91e74f0b-3689-42a8-8566-2e8d893b999b admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.7553022 May 12 15:12:43.207539 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:43.220881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-2b2161f9-f207-4ace-bf52-f1ebb9a70f41 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 4.7353835 May 12 15:12:43.239139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Attempting to bind port 039f5f29-f92a-42e9-9582-4aaf75edb62a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:43.239139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Attempting to bind port 039f5f29-f92a-42e9-9582-4aaf75edb62a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8037e7d9-36c9-4cfc-9420-983f2660ddef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:43.240314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Attempting to bind port 039f5f29-f92a-42e9-9582-4aaf75edb62a on network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:43.246079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Port 039f5f29-f92a-42e9-9582-4aaf75edb62a on network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:12:43.246484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Attempting to bind port 039f5f29-f92a-42e9-9582-4aaf75edb62a on network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:43.257142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:43.257616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Checking segment: {'id': '8037e7d9-36c9-4cfc-9420-983f2660ddef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:43.258124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Bound using segment: {'id': '8037e7d9-36c9-4cfc-9420-983f2660ddef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:43.258725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Bound port: 039f5f29-f92a-42e9-9582-4aaf75edb62a, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8037e7d9-36c9-4cfc-9420-983f2660ddef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:43.259174 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:43.439651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] For port 039f5f29-f92a-42e9-9582-4aaf75edb62a, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:43.444092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] For port 039f5f29-f92a-42e9-9582-4aaf75edb62a, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=039f5f29-f92a-42e9-9582-4aaf75edb62a,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:43.449649 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:43.503546 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 774 time: 1.4179826 May 12 15:12:43.508128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52536) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:43.525823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:43.526352 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:43.528868 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] 10.222.0.76 "PUT /v2.0/ports/039f5f29-f92a-42e9-9582-4aaf75edb62a HTTP/1.1" status: 200 len: 1092 time: 1.1106367 May 12 15:12:43.540606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'network': {'name': 'tempest-device-tagging-net2-432080808'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:43.550288 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:43.561615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:network and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:43.579492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:43.616200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84d97a83-ec67-42b4-9ebf-2cadc7357f9c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'Network': ['ID=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:43.633832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:43.637150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-195909fd-ab29-4fb2-a124-b7ba4d7a7f87 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:43.640209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-195909fd-ab29-4fb2-a124-b7ba4d7a7f87 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.7696609 May 12 15:12:43.641364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:12:43.644814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-f9d4952e-2813-46cb-805b-826df296e9f6 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Synchronizing usage tracker for tenant:4c3ee180ddb64a8685bd55247106d4cb on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:12:43.670028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dbd2a56-9c53-4cc4-b7a4-e0cde0c8ae92 service neutron] Pushing event updated for resources: {'Port': ['ID=039f5f29-f92a-42e9-9582-4aaf75edb62a,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:43.701011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Made reservation on behalf of 05b4f1ce61294fb29efb0a765ed28561 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:43.707588 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:43.737989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-c91b55a6-4ef2-4907-8e5e-2792cf9696c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:43.737989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-c91b55a6-4ef2-4907-8e5e-2792cf9696c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:43.737989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-c91b55a6-4ef2-4907-8e5e-2792cf9696c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:43.739182 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-c91b55a6-4ef2-4907-8e5e-2792cf9696c6 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1aea6927c780448b89ddf44ec6bcb186&device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2864 time: 0.1571529 May 12 15:12:43.816179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-f8493a9b-8477-41ce-b2f5-4c710fa93dd8 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=54f3ad03-fdf2-4862-93ff-f60efa594593 HTTP/1.1" status: 200 len: 217 time: 0.1513402 May 12 15:12:43.826131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 581} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:12:43.829267 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-aba57357-9f8f-4707-ae6c-8608f04889ca service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=19.80.0.220&port_id=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 HTTP/1.1" status: 200 len: 217 time: 0.0827434 May 12 15:12:43.854669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16eb7fe7-b6d7-496b-bece-0e26f6bf1354 req-2386a315-dd6f-43a4-b6bb-3999df5028ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:43.856136 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16eb7fe7-b6d7-496b-bece-0e26f6bf1354 req-2386a315-dd6f-43a4-b6bb-3999df5028ca service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0da54985cde346e68eeadf965b8bc6d3&device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 1101 time: 0.8692029 May 12 15:12:43.876632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-f9d4952e-2813-46cb-805b-826df296e9f6 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Unset dirty status for tenant:4c3ee180ddb64a8685bd55247106d4cb on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:12:43.877721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-f9d4952e-2813-46cb-805b-826df296e9f6 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.141 HTTP/1.1" status: 200 len: 696 time: 0.4811120 May 12 15:12:43.882354 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:43.882581 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Added segment 4d535119-7517-4056-aef4-603b1fd140c2 of type vlan for network 187794df-e6cb-4ee3-8b40-6b546c229bd2 May 12 15:12:43.927785 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:43.935732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-46171d2c-6ac6-4709-8357-27bed24c0113 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:43.937061 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-46171d2c-6ac6-4709-8357-27bed24c0113 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=7e73bcb0-088d-46bf-8dd4-a976776d8b9c HTTP/1.1" status: 200 len: 801 time: 0.1017032 May 12 15:12:43.945284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-7efd8e44-b048-400b-9d7b-9dca0449f258 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:43.946687 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-7efd8e44-b048-400b-9d7b-9dca0449f258 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.1227794 May 12 15:12:43.956095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85662b24-f73e-4893-9c0d-31068af16a62 req-c762bb94-ee26-4e67-aad3-04a423b28f7f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:43.961931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85662b24-f73e-4893-9c0d-31068af16a62 req-c762bb94-ee26-4e67-aad3-04a423b28f7f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:43.968555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85662b24-f73e-4893-9c0d-31068af16a62 req-c762bb94-ee26-4e67-aad3-04a423b28f7f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:43.970243 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85662b24-f73e-4893-9c0d-31068af16a62 req-c762bb94-ee26-4e67-aad3-04a423b28f7f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2411 time: 0.4573541 May 12 15:12:44.017024 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:44.023455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:44.023455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:44.155728 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-8311903b-366b-48bf-b264-f79085794dfa service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1322145 May 12 15:12:44.243445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'Network': ['ID=187794df-e6cb-4ee3-8b40-6b546c229bd2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:44.251781 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fd13f96f-1199-4234-b490-728ed2b28bbf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 0.7384994 May 12 15:12:44.252608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52542) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:44.256558 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 187794df-e6cb-4ee3-8b40-6b546c229bd2 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:12:44.257102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-37216db1-d1e8-47cc-af74-a03c973bdce8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:44.258203 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-37216db1-d1e8-47cc-af74-a03c973bdce8 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9021e9b2-6c8f-4b20-8148-52e45c2296b3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.3149860 May 12 15:12:44.261919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'subnet': {'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06', 'cidr': '10.1.1.0/24', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:44.317018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16eb7fe7-b6d7-496b-bece-0e26f6bf1354 req-e2314bfb-7b44-4e3d-b5e1-70851bd184e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:44.318471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16eb7fe7-b6d7-496b-bece-0e26f6bf1354 req-e2314bfb-7b44-4e3d-b5e1-70851bd184e8 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.4015472 May 12 15:12:44.330644 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85662b24-f73e-4893-9c0d-31068af16a62 req-39f704e9-136e-4d52-a11d-5e5db451737e tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3061264 May 12 15:12:44.421666 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16eb7fe7-b6d7-496b-bece-0e26f6bf1354 req-b6454e8f-f5cd-4a24-8e4d-eb47ff086c15 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.141&port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff HTTP/1.1" status: 200 len: 217 time: 0.0855989 May 12 15:12:44.425206 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1fedce32-6b51-44aa-974e-307e173d7dfa'] response: {'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'code': 200} May 12 15:12:44.425511 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1fedce32-6b51-44aa-974e-307e173d7dfa'] response: {'server_uuid': '356d3884-ccc1-4305-bdd1-7231fe627d9f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea', 'code': 200} May 12 15:12:44.430306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-b42eafbd-52df-461d-9331-8c4244f1ae00 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:44.431587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b5f80be-1960-457a-ba9b-0adfd405e30d req-b42eafbd-52df-461d-9331-8c4244f1ae00 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.5447235 May 12 15:12:44.480536 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-dcea3679-56ef-41a1-b53b-113ba25ed82b'] response: {'server_uuid': 'e0cf7455-6caf-459e-9abc-ba41eaa0ccc1', 'name': 'network-vif-deleted', 'tag': '9787cef9-03af-4a15-af20-0eb8fe5ee859', 'status': 'completed', 'code': 200} May 12 15:12:44.499371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:44.514795 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:subnet and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:44.518638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:44.532116 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e7fb58ae-cdd3-4939-97e3-cebb6b6f84c8'] response: {'name': 'network-changed', 'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'tag': '0e99f99c-8d6a-408a-83f0-5cc1c1d502a3', 'status': 'completed', 'code': 200} May 12 15:12:44.533005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:44.572083 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f7ab2cb3-b992-4c5c-be3c-656e023ed31f service neutron] 10.222.0.76 "GET /v2.0/networks/9021e9b2-6c8f-4b20-8148-52e45c2296b3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2959876 May 12 15:12:44.610269 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Made reservation on behalf of 05b4f1ce61294fb29efb0a765ed28561 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:44.613776 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:44.733696 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-3b72eedf-016e-4ce6-9f5d-6388ae42fd9b service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5686493 May 12 15:12:44.747804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16eb7fe7-b6d7-496b-bece-0e26f6bf1354 req-4964d1e2-1947-4d87-924d-eee7a096fecd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:44.749312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16eb7fe7-b6d7-496b-bece-0e26f6bf1354 req-4964d1e2-1947-4d87-924d-eee7a096fecd service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3150668 May 12 15:12:44.787212 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-91434665-9516-4a1e-a2c4-4889e82ff63b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:44.853407 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-9a9b0733-9ea0-4d28-84e0-fa6d9e6ac283 service neutron] 10.222.0.76 "GET /v2.0/networks/9021e9b2-6c8f-4b20-8148-52e45c2296b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2731252 May 12 15:12:44.856264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d49431f5-9f98-4936-b594-846959367bee req-fd9a7721-5989-4aa4-bc43-c4289673faeb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:44.858197 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d49431f5-9f98-4936-b594-846959367bee req-fd9a7721-5989-4aa4-bc43-c4289673faeb service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 1100 time: 0.3203609 May 12 15:12:44.946817 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-936decd8-eb9b-4686-9adb-51a99ed571eb service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=19.86.0.4&port_id=65584e07-bbd0-40f8-806a-3b7a85300525 HTTP/1.1" status: 200 len: 217 time: 0.0867882 May 12 15:12:44.983426 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf99ac4-cd0b-4153-8fac-bb6f23f6dc8b req-589b304d-14ba-46eb-a567-76df91682d17 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:44.984958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-adf99ac4-cd0b-4153-8fac-bb6f23f6dc8b req-589b304d-14ba-46eb-a567-76df91682d17 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 946 time: 0.3358035 May 12 15:12:44.996933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb271fb0-8e21-4b47-9b09-c565fb631419 req-b311004d-4471-44a8-a7a9-3b0cb9e70450 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:44.999050 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb271fb0-8e21-4b47-9b09-c565fb631419 req-b311004d-4471-44a8-a7a9-3b0cb9e70450 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=463cc5a1-f7b3-45c8-a707-e2e999a85e8c HTTP/1.1" status: 200 len: 945 time: 0.3488193 May 12 15:12:45.001244 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-0bf92728-23ff-4de6-b22c-d06e9f1edeae service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2552183 May 12 15:12:45.042382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16eb7fe7-b6d7-496b-bece-0e26f6bf1354 req-0b03cb10-fcb6-480b-a8af-ea8d2c37bc13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:45.043807 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16eb7fe7-b6d7-496b-bece-0e26f6bf1354 req-0b03cb10-fcb6-480b-a8af-ea8d2c37bc13 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2719629 May 12 15:12:45.061401 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d49431f5-9f98-4936-b594-846959367bee req-574c4c8e-47d1-490f-86f6-46b52d46203b service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1478324 May 12 15:12:45.094461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-e5daa5db-2e24-4fde-af39-0018761b04e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:45.095895 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-e5daa5db-2e24-4fde-af39-0018761b04e9 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=b8fd478e-7f1c-4be3-acd2-b5504391fab8 HTTP/1.1" status: 200 len: 801 time: 0.1181836 May 12 15:12:45.154262 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:45.186383 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-adf99ac4-cd0b-4153-8fac-bb6f23f6dc8b req-5f4acb98-26ce-40b6-a1bb-21b816b58636 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1824629 May 12 15:12:45.207246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb271fb0-8e21-4b47-9b09-c565fb631419 req-681b2c52-b2cc-4b01-bafc-02821eb6de59 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1889477 May 12 15:12:45.268037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'Subnet': ['ID=34e89d1d-72aa-4216-94d6-f37b8a0c162b,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:45.269324 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16eb7fe7-b6d7-496b-bece-0e26f6bf1354 req-bad237bd-f567-43cd-8f96-021af17ce49f service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2143400 May 12 15:12:45.279713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-98667ffe-f6cd-4438-873a-374cbf41670a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:45.281135 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-98667ffe-f6cd-4438-873a-374cbf41670a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b55a7520-40f6-4d38-b0f0-235a1cd1b883&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1751950 May 12 15:12:45.285360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Checking segment: {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:45.286012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Network hostable DHCP agents. Network: 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:12:45.402188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-f477a56d-d3d7-477e-b676-9e75af73d6c8 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:45.405230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-f477a56d-d3d7-477e-b676-9e75af73d6c8 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&tenant_id=68c66ae0cd45476b87e2e79625b80f69&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1097 time: 0.3213141 May 12 15:12:45.405443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:12:45.413974 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h2-841483-1'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:45.437970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:45.446290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:45.446865 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:45.448279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e65b567d-6933-49eb-a241-4f1db3a8942b None None] Network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:12:45.460517 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-2333bd40-7cea-469e-a279-d7ab1652c9a7 service neutron] 10.222.0.76 "GET /v2.0/networks/b55a7520-40f6-4d38-b0f0-235a1cd1b883?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1697752 May 12 15:12:45.586283 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8bd281b4-4512-45f4-ba46-0656f754be76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 1.3326297 May 12 15:12:45.587680 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16eb7fe7-b6d7-496b-bece-0e26f6bf1354 req-3e539824-5403-4a72-8f0e-fdf060de61fd service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3044825 May 12 15:12:45.591807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52562) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:45.596174 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:45.605785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'subnet': {'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2', 'cidr': '10.2.2.0/24', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:45.757526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:45.764458 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-b39e962d-8668-4c42-a324-f6b3479c283b service neutron] 10.222.0.76 "GET /v2.0/networks/b55a7520-40f6-4d38-b0f0-235a1cd1b883?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2955060 May 12 15:12:45.765722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:subnet and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:45.768535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:45.772289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-86d71e93-6e6b-4e00-b1ac-48b27c2b0f06', 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'fixed_ips': [{'subnet_id': '34e89d1d-72aa-4216-94d6-f37b8a0c162b'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:12:45.773362 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:45.830194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:45.840215 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-9518cfed-1324-4eec-813e-ca0130e90aca service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=19.80.0.219&port_id=039f5f29-f92a-42e9-9582-4aaf75edb62a HTTP/1.1" status: 200 len: 217 time: 0.0685065 May 12 15:12:45.848235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Made reservation on behalf of 05b4f1ce61294fb29efb0a765ed28561 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:45.852556 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:45.984248 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:45.986629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Allocated IP 10.1.1.2 (86d71e93-6e6b-4e00-b1ac-48b27c2b0f06/34e89d1d-72aa-4216-94d6-f37b8a0c162b/8092a31e-f22d-4b85-9a51-6929599fcf39) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:46.051242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-58fa87b3-ae41-41bc-a1b9-d71103c71466 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:46.052601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-58fa87b3-ae41-41bc-a1b9-d71103c71466 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Synchronizing usage tracker for tenant:aca50b48316f40a7a6ceb23c44dd4720 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:12:46.066234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15d63448-b955-498b-8e5d-75484002cd2b req-a046e2b7-532a-4b15-bb48-b1b4c5ccf53a tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:46.068036 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15d63448-b955-498b-8e5d-75484002cd2b req-a046e2b7-532a-4b15-bb48-b1b4c5ccf53a tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 949 time: 0.3643880 May 12 15:12:46.099498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=54f3ad03-fdf2-4862-93ff-f60efa594593,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:46.119657 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:46.171268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-96deef36-9ed1-4211-8363-83a844280523 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:46.173089 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-96deef36-9ed1-4211-8363-83a844280523 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=7e73bcb0-088d-46bf-8dd4-a976776d8b9c HTTP/1.1" status: 200 len: 801 time: 0.2998147 May 12 15:12:46.185520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:46.260764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-58fa87b3-ae41-41bc-a1b9-d71103c71466 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Unset dirty status for tenant:aca50b48316f40a7a6ceb23c44dd4720 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:12:46.268077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-58fa87b3-ae41-41bc-a1b9-d71103c71466 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/networks?id=079240cc-25ba-4ba4-a3b0-412d897b19bb HTTP/1.1" status: 200 len: 815 time: 0.6499858 May 12 15:12:46.278290 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:46.292611 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15d63448-b955-498b-8e5d-75484002cd2b req-fef802c8-8cb1-44d1-8ae5-575fbda566fd tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2143848 May 12 15:12:46.295189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Transition to ACTIVE for port object 8092a31e-f22d-4b85-9a51-6929599fcf39 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:46.318030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-73aa5128-6b15-4978-890d-70be5fd37736 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/quotas/aca50b48316f40a7a6ceb23c44dd4720 HTTP/1.1" status: 200 len: 375 time: 0.0490201 May 12 15:12:46.323327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Transition to ACTIVE for port object 8092a31e-f22d-4b85-9a51-6929599fcf39 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:46.331825 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:46.387003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-7de08de5-a8e1-48d4-992c-2161ee8f560c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:46.388823 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-7de08de5-a8e1-48d4-992c-2161ee8f560c service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9021e9b2-6c8f-4b20-8148-52e45c2296b3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1954734 May 12 15:12:46.427460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '463cc5a1-f7b3-45c8-a707-e2e999a85e8c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b2fc410-d9a8-4bcd-af90-17da21c97bac'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:46.441516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:46.446162 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:46.454996 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:46.462915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Pushing event updated for resources: {'Port': ['ID=8092a31e-f22d-4b85-9a51-6929599fcf39,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:46.533465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'tag': '65584e07-bbd0-40f8-806a-3b7a85300525'}, {'name': 'network-changed', 'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'tag': '039f5f29-f92a-42e9-9582-4aaf75edb62a'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:46.564878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Attempting to bind port 8092a31e-f22d-4b85-9a51-6929599fcf39 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:46.564878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Attempting to bind port 8092a31e-f22d-4b85-9a51-6929599fcf39 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:46.564878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Attempting to bind port 8092a31e-f22d-4b85-9a51-6929599fcf39 on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:46.570778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:46.570778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Checking segment: {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:46.571232 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:46.571668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Bound using segment: {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:46.572298 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Bound port: 8092a31e-f22d-4b85-9a51-6929599fcf39, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:46.572592 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:46.589815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a304fd0-80ef-4b27-86c5-a861e6627236', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '54f3ad03-fdf2-4862-93ff-f60efa594593'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:46.598697 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:46.599336 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:46.602794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-c578b64f-063d-49e2-a236-a6a05caa623a tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=aca50b48316f40a7a6ceb23c44dd4720&fields=id HTTP/1.1" status: 200 len: 210 time: 0.2838078 May 12 15:12:46.614012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0a62910-f2ae-4a75-aa84-7bd3c370b4de req-303634ab-70fd-4cd0-a21a-5e153a7eae95 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/floatingips/3340c7ef-fd9e-4488-a189-a250be5f44fb HTTP/1.1" status: 200 len: 693 time: 0.2423418 May 12 15:12:46.654688 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:46.668596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] For port 8092a31e-f22d-4b85-9a51-6929599fcf39, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:46.672937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] For port 8092a31e-f22d-4b85-9a51-6929599fcf39, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=8092a31e-f22d-4b85-9a51-6929599fcf39,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:46.677783 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:46.682515 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-f393ea8a-92d3-4614-a6c0-b27dc7c699cc service neutron] 10.222.0.76 "GET /v2.0/networks/9021e9b2-6c8f-4b20-8148-52e45c2296b3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2802162 May 12 15:12:46.720960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'Subnet': ['ID=a98bb094-ea48-4784-b33c-d20b0aad5132,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:46.768893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f7526bd-7e71-4a95-a8a3-a4c08dad1ecb None None] Pushing event updated for resources: {'Port': ['ID=8092a31e-f22d-4b85-9a51-6929599fcf39,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:46.802258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Checking segment: {'id': '4d535119-7517-4056-aef4-603b1fd140c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:46.802614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Network hostable DHCP agents. Network: 187794df-e6cb-4ee3-8b40-6b546c229bd2, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:12:46.850422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Network 187794df-e6cb-4ee3-8b40-6b546c229bd2 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:12:46.870798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 187794df-e6cb-4ee3-8b40-6b546c229bd2) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:46.876483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:46.877066 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:46.884078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38685657-81ce-4eea-bfe9-2aa3fcf902db None None] Network 187794df-e6cb-4ee3-8b40-6b546c229bd2 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:12:46.906555 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fffea0c2-6477-4c67-8896-04611c2c542d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 1.3134992 May 12 15:12:46.909217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52576) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:46.913715 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6183f13-2b7f-4123-9939-42eb352a0261 req-63ef5c3b-62b4-4960-acd8-aa437d394b14 service neutron] 10.222.0.76 "GET /v2.0/networks/9021e9b2-6c8f-4b20-8148-52e45c2296b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2180321 May 12 15:12:46.917218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'port': {'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06', 'name': 'tempest-TaggedBootDevicesTest_v242-242806432', 'fixed_ips': [{'subnet_id': '34e89d1d-72aa-4216-94d6-f37b8a0c162b'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:46.996251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Pushing event updated for resources: {'Port': ['ID=54f3ad03-fdf2-4862-93ff-f60efa594593,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:47.094864 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Attempting to bind port 54f3ad03-fdf2-4862-93ff-f60efa594593 on host n-h1-841483-1 for vnic_type normal with profile {"migrating_to": "n-h2-841483-1"} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:47.095496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Attempting to bind port 54f3ad03-fdf2-4862-93ff-f60efa594593 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:47.095496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Attempting to bind port 54f3ad03-fdf2-4862-93ff-f60efa594593 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:47.104441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Port 54f3ad03-fdf2-4862-93ff-f60efa594593 on network e8211761-0dd9-424f-b732-629fd2d77e28 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:12:47.104783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Attempting to bind port 54f3ad03-fdf2-4862-93ff-f60efa594593 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:47.114203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0a62910-f2ae-4a75-aa84-7bd3c370b4de req-64e1c0c3-70a9-4266-ae39-274f6385ff82 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:47.115604 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0a62910-f2ae-4a75-aa84-7bd3c370b4de req-64e1c0c3-70a9-4266-ae39-274f6385ff82 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.5007942 May 12 15:12:47.128846 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-e12b9b98-9521-42eb-b378-5940d7fa1d48 service neutron] 10.222.0.82 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5014262 May 12 15:12:47.204578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:47.208630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:port and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:47.212095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:47.221288 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:47.222811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:47.222968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Checking segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:47.223459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Bound using segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:47.224006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Bound port: 54f3ad03-fdf2-4862-93ff-f60efa594593, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:47.224451 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:47.226007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c54ce5-6265-4a26-bc1c-1d25c37bac81 req-6b936740-555c-44f4-bbbe-418a3b887f63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:47.226480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c54ce5-6265-4a26-bc1c-1d25c37bac81 req-6b936740-555c-44f4-bbbe-418a3b887f63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:47.226939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c54ce5-6265-4a26-bc1c-1d25c37bac81 req-6b936740-555c-44f4-bbbe-418a3b887f63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:47.228745 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08c54ce5-6265-4a26-bc1c-1d25c37bac81 req-6b936740-555c-44f4-bbbe-418a3b887f63 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1aea6927c780448b89ddf44ec6bcb186&device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2864 time: 0.2189069 May 12 15:12:47.269650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-187794df-e6cb-4ee3-8b40-6b546c229bd2', 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'fixed_ips': [{'subnet_id': 'a98bb094-ea48-4784-b33c-d20b0aad5132'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:12:47.270419 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:47.314514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Made reservation on behalf of 05b4f1ce61294fb29efb0a765ed28561 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:47.340928 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0a62910-f2ae-4a75-aa84-7bd3c370b4de req-cccbb17b-5a4e-46bf-b1cb-6d1f3fc99d8d tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.141 HTTP/1.1" status: 200 len: 696 time: 0.1907630 May 12 15:12:47.486696 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0a62910-f2ae-4a75-aa84-7bd3c370b4de req-6b9e0b21-15f2-4c0b-994a-a722bd0bfc86 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.141 HTTP/1.1" status: 200 len: 696 time: 0.1187198 May 12 15:12:47.492845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Allocated IP 10.2.2.2 (187794df-e6cb-4ee3-8b40-6b546c229bd2/a98bb094-ea48-4784-b33c-d20b0aad5132/80316dbd-bbfa-49eb-a448-99afe53e8a57) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:47.579651 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:47.611692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f16b1d4-4d7b-4ae2-965f-a420a183312e req-b2e85deb-0e7e-49d8-8982-6367251ffef5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:47.614012 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f16b1d4-4d7b-4ae2-965f-a420a183312e req-b2e85deb-0e7e-49d8-8982-6367251ffef5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.84 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 950 time: 0.3562992 May 12 15:12:47.615305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c54ce5-6265-4a26-bc1c-1d25c37bac81 req-fc2c8752-10ad-498e-9ea5-1cff92d998ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:47.617500 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08c54ce5-6265-4a26-bc1c-1d25c37bac81 req-fc2c8752-10ad-498e-9ea5-1cff92d998ac service neutron] 10.222.0.76 "GET /v2.0/networks?id=9021e9b2-6c8f-4b20-8148-52e45c2296b3 HTTP/1.1" status: 200 len: 903 time: 0.3811412 May 12 15:12:47.627649 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:47.712195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-a0a62910-f2ae-4a75-aa84-7bd3c370b4de req-cbbfdb6b-ac39-4789-ab00-97f15cd7c455 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Deleting port 1d55c8ea-2cb2-4dde-a25c-d6485cc42d42 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:47.712679 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a0a62910-f2ae-4a75-aa84-7bd3c370b4de req-cbbfdb6b-ac39-4789-ab00-97f15cd7c455 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:47.730276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] device_id is not set on port d96ca9ce-4a19-49f0-bef3-e0e31ace478a yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:12:47.746530 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-63c969cd-f455-49bf-af8e-0e2bd63d7ad0 service neutron] 10.222.0.82 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6167650 May 12 15:12:47.752493 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:47.755813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:47.767762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Transition to ACTIVE for port object 80316dbd-bbfa-49eb-a448-99afe53e8a57 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:47.777075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=54f3ad03-fdf2-4862-93ff-f60efa594593,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:47.798536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Transition to ACTIVE for port object 80316dbd-bbfa-49eb-a448-99afe53e8a57 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:47.810650 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:47.823852 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:47.873311 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08c54ce5-6265-4a26-bc1c-1d25c37bac81 req-66d3142d-841c-4ad5-8510-976722ea8b69 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=19.80.0.220&port_id=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 HTTP/1.1" status: 200 len: 217 time: 0.2169094 May 12 15:12:47.913262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Network 187794df-e6cb-4ee3-8b40-6b546c229bd2 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:47.934450 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:47.953124 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:48.093068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Pushing event updated for resources: {'Port': ['ID=80316dbd-bbfa-49eb-a448-99afe53e8a57,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:48.102857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b8f46e5-c028-4f00-9310-60d4935db5f6 None None] Network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:12:48.180686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-6f16b1d4-4d7b-4ae2-965f-a420a183312e req-a86a97da-2d4a-40d4-982f-625046d60040 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Deleting port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:48.181157 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6f16b1d4-4d7b-4ae2-965f-a420a183312e req-a86a97da-2d4a-40d4-982f-625046d60040 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:48.211644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Attempting to bind port 80316dbd-bbfa-49eb-a448-99afe53e8a57 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:48.211936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Attempting to bind port 80316dbd-bbfa-49eb-a448-99afe53e8a57 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '4d535119-7517-4056-aef4-603b1fd140c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:48.212307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Attempting to bind port 80316dbd-bbfa-49eb-a448-99afe53e8a57 on network 187794df-e6cb-4ee3-8b40-6b546c229bd2 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:48.222405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8103769d-2cff-4e7b-a824-c05d12fb0b3b None None] Provisioning for port 8092a31e-f22d-4b85-9a51-6929599fcf39 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:48.227399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:48.227771 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Checking segment: {'id': '4d535119-7517-4056-aef4-603b1fd140c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:48.228175 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:48.228565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Bound using segment: {'id': '4d535119-7517-4056-aef4-603b1fd140c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:48.229048 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Bound port: 80316dbd-bbfa-49eb-a448-99afe53e8a57, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4d535119-7517-4056-aef4-603b1fd140c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:48.229638 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:48.302600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c54ce5-6265-4a26-bc1c-1d25c37bac81 req-70df698c-82a2-44e7-8688-0bdc2f1c2406 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:48.304850 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08c54ce5-6265-4a26-bc1c-1d25c37bac81 req-70df698c-82a2-44e7-8688-0bdc2f1c2406 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=7e73bcb0-088d-46bf-8dd4-a976776d8b9c HTTP/1.1" status: 200 len: 801 time: 0.4220996 May 12 15:12:48.348944 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] For port 80316dbd-bbfa-49eb-a448-99afe53e8a57, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:48.352383 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] For port 80316dbd-bbfa-49eb-a448-99afe53e8a57, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=80316dbd-bbfa-49eb-a448-99afe53e8a57,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:48.368246 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:48.419955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:48.420612 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:48.422088 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8092a31e-f22d-4b85-9a51-6929599fcf39 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:48.422218 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] 10.222.0.76 "PUT /v2.0/ports/54f3ad03-fdf2-4862-93ff-f60efa594593 HTTP/1.1" status: 200 len: 1122 time: 3.0122302 May 12 15:12:48.461447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d28a9b46-5d20-4a5f-b579-d90b916094ed service neutron] Pushing event updated for resources: {'Port': ['ID=54f3ad03-fdf2-4862-93ff-f60efa594593,revision_number=8']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:48.496663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Allocated IP 10.1.1.21 (86d71e93-6e6b-4e00-b1ac-48b27c2b0f06/34e89d1d-72aa-4216-94d6-f37b8a0c162b/d96ca9ce-4a19-49f0-bef3-e0e31ace478a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:48.516495 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a0a62910-f2ae-4a75-aa84-7bd3c370b4de req-cbbfdb6b-ac39-4789-ab00-97f15cd7c455 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:48.516900 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a0a62910-f2ae-4a75-aa84-7bd3c370b4de req-cbbfdb6b-ac39-4789-ab00-97f15cd7c455 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:48.675991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['54f3ad03-fdf2-4862-93ff-f60efa594593'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:48.682244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-a0a62910-f2ae-4a75-aa84-7bd3c370b4de req-cbbfdb6b-ac39-4789-ab00-97f15cd7c455 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Calling delete_port for 1d55c8ea-2cb2-4dde-a25c-d6485cc42d42 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:48.735562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e8019b8-1245-4710-bc48-b41e386aec56 None None] Pushing event updated for resources: {'Port': ['ID=80316dbd-bbfa-49eb-a448-99afe53e8a57,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:48.766882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 8092a31e-f22d-4b85-9a51-6929599fcf39 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:48.775658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 8092a31e-f22d-4b85-9a51-6929599fcf39 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:48.781782 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:48.906665 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a0a62910-f2ae-4a75-aa84-7bd3c370b4de req-cbbfdb6b-ac39-4789-ab00-97f15cd7c455 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:48.988743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbbfdb6b-ac39-4789-ab00-97f15cd7c455 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Pushing event deleted for resources: {'Port': ['ID=1d55c8ea-2cb2-4dde-a25c-d6485cc42d42,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:49.009202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a888a2d-4252-475b-936f-048f92c1ba1c req-6b2514b3-5704-48ed-b8e8-deece6d3ebac tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:49.023859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a888a2d-4252-475b-936f-048f92c1ba1c req-6b2514b3-5704-48ed-b8e8-deece6d3ebac tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:49.034247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6f16b1d4-4d7b-4ae2-965f-a420a183312e req-a86a97da-2d4a-40d4-982f-625046d60040 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] For port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:49.034612 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6f16b1d4-4d7b-4ae2-965f-a420a183312e req-a86a97da-2d4a-40d4-982f-625046d60040 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:49.036278 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:49.038206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a888a2d-4252-475b-936f-048f92c1ba1c req-6b2514b3-5704-48ed-b8e8-deece6d3ebac tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:49.039926 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a888a2d-4252-475b-936f-048f92c1ba1c req-6b2514b3-5704-48ed-b8e8-deece6d3ebac tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2411 time: 0.7816670 May 12 15:12:49.166733 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 8092a31e-f22d-4b85-9a51-6929599fcf39, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=8092a31e-f22d-4b85-9a51-6929599fcf39,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:49.182220 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:49.240577 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c54ce5-6265-4a26-bc1c-1d25c37bac81 req-99c556cf-8d9c-4da3-bd7d-6a6911ab4d2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:49.243210 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08c54ce5-6265-4a26-bc1c-1d25c37bac81 req-99c556cf-8d9c-4da3-bd7d-6a6911ab4d2b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9021e9b2-6c8f-4b20-8148-52e45c2296b3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.9289644 May 12 15:12:49.243994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a888a2d-4252-475b-936f-048f92c1ba1c req-881715f1-9d7a-4f30-807d-a8252b536011 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1482832 May 12 15:12:49.252141 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a0a62910-f2ae-4a75-aa84-7bd3c370b4de req-cbbfdb6b-ac39-4789-ab00-97f15cd7c455 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:49.254242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-6f16b1d4-4d7b-4ae2-965f-a420a183312e req-a86a97da-2d4a-40d4-982f-625046d60040 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Calling delete_port for a686f1c4-b2f1-4692-950a-b2a71f6aeb6f owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:49.281845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a0a62910-f2ae-4a75-aa84-7bd3c370b4de req-cbbfdb6b-ac39-4789-ab00-97f15cd7c455 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:49.297441 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0a62910-f2ae-4a75-aa84-7bd3c370b4de req-cbbfdb6b-ac39-4789-ab00-97f15cd7c455 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "DELETE /v2.0/floatingips/3340c7ef-fd9e-4488-a189-a250be5f44fb HTTP/1.1" status: 204 len: 173 time: 1.7901616 May 12 15:12:49.366597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=8092a31e-f22d-4b85-9a51-6929599fcf39,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:49.404388 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8934f0c8-fb7d-4cb2-b92c-b2616200ec7f None None] Provisioning complete for port 8092a31e-f22d-4b85-9a51-6929599fcf39 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:49.405474 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8934f0c8-fb7d-4cb2-b92c-b2616200ec7f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:49.560718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-859a7b10-5732-4e5e-9d88-2a23faa42d57 req-7733f828-257a-40ce-bc8e-90de1ce5c664 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:49.563006 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-859a7b10-5732-4e5e-9d88-2a23faa42d57 req-7733f828-257a-40ce-bc8e-90de1ce5c664 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 944 time: 0.1551290 May 12 15:12:49.570396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d75467a-6a01-4be1-8331-b71dd94cecb3 req-ac988683-7236-4bde-bc76-0bd31aca22a0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:49.571235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9d75467a-6a01-4be1-8331-b71dd94cecb3 req-ac988683-7236-4bde-bc76-0bd31aca22a0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Synchronizing usage tracker for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:12:49.589585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:12:49.648043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9d75467a-6a01-4be1-8331-b71dd94cecb3 req-ac988683-7236-4bde-bc76-0bd31aca22a0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Unset dirty status for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:12:49.649336 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d75467a-6a01-4be1-8331-b71dd94cecb3 req-ac988683-7236-4bde-bc76-0bd31aca22a0 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=1ba1fe04-2028-450d-a328-91f2555a5d58 HTTP/1.1" status: 200 len: 950 time: 0.2037208 May 12 15:12:49.661306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:49.673669 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08c54ce5-6265-4a26-bc1c-1d25c37bac81 req-2bce3450-8596-4615-9714-9f6a3406e3f5 service neutron] 10.222.0.76 "GET /v2.0/networks/9021e9b2-6c8f-4b20-8148-52e45c2296b3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3742898 May 12 15:12:49.714457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Transition to ACTIVE for port object d96ca9ce-4a19-49f0-bef3-e0e31ace478a will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:49.790793 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6f16b1d4-4d7b-4ae2-965f-a420a183312e req-a86a97da-2d4a-40d4-982f-625046d60040 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:49.797264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-859a7b10-5732-4e5e-9d88-2a23faa42d57 req-fbe01891-083a-49ea-bfd3-14037c52b092 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2021599 May 12 15:12:49.804813 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['b6035326-cd91-47d7-8a65-cc2dd3d1d127', 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:49.872987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a86a97da-2d4a-40d4-982f-625046d60040 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Pushing event deleted for resources: {'Port': ['ID=a686f1c4-b2f1-4692-950a-b2a71f6aeb6f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:49.910205 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d75467a-6a01-4be1-8331-b71dd94cecb3 req-35a40ec4-965f-455f-b386-4940ea9fb79d tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2406902 May 12 15:12:50.016270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-6f16b1d4-4d7b-4ae2-965f-a420a183312e req-a86a97da-2d4a-40d4-982f-625046d60040 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] No DVR routers for this DVR port a686f1c4-b2f1-4692-950a-b2a71f6aeb6f on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:12:50.037128 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3560c956-033f-47cc-b3fa-e7788d8da212'] response: {'server_uuid': '463cc5a1-f7b3-45c8-a707-e2e999a85e8c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b2fc410-d9a8-4bcd-af90-17da21c97bac', 'code': 200} May 12 15:12:50.040380 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:50.042871 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6f16b1d4-4d7b-4ae2-965f-a420a183312e req-a86a97da-2d4a-40d4-982f-625046d60040 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:50.055269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:50.063161 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08c54ce5-6265-4a26-bc1c-1d25c37bac81 req-19f42447-0258-4d1d-bf16-265bf5e465b9 service neutron] 10.222.0.76 "GET /v2.0/networks/9021e9b2-6c8f-4b20-8148-52e45c2296b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3737185 May 12 15:12:50.101316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '0e99f99c-8d6a-408a-83f0-5cc1c1d502a3', 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3', 'port_id': '0e99f99c-8d6a-408a-83f0-5cc1c1d502a3', 'mac_address': 'fa:16:3e:46:ee:45', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 577, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7e73bcb0-088d-46bf-8dd4-a976776d8b9c', 'ip_address': '19.80.0.220'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:12:50.113650 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-b6daa5bd-72bf-4a4b-913b-793e4e997bcb tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:50.115296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-b6daa5bd-72bf-4a4b-913b-793e4e997bcb tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.76 "GET /v2.0/networks?id=079240cc-25ba-4ba4-a3b0-412d897b19bb HTTP/1.1" status: 200 len: 815 time: 0.4417953 May 12 15:12:50.130242 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e9e91122-478e-4f3a-9f74-32b93b9ff8e0'] response: {'name': 'network-changed', 'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'tag': '65584e07-bbd0-40f8-806a-3b7a85300525', 'status': 'completed', 'code': 200} May 12 15:12:50.130587 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e9e91122-478e-4f3a-9f74-32b93b9ff8e0'] response: {'name': 'network-changed', 'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'tag': '039f5f29-f92a-42e9-9582-4aaf75edb62a', 'status': 'completed', 'code': 200} May 12 15:12:50.152942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Request body: {'port': {'device_id': '93f69d1e-0068-4634-b7ad-70f7710d8470', 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb', 'admin_state_up': True, 'tenant_id': 'aca50b48316f40a7a6ceb23c44dd4720'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:50.280054 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f16b1d4-4d7b-4ae2-965f-a420a183312e req-a86a97da-2d4a-40d4-982f-625046d60040 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.84 "DELETE /v2.0/ports/a686f1c4-b2f1-4692-950a-b2a71f6aeb6f HTTP/1.1" status: 204 len: 173 time: 2.6477783 May 12 15:12:50.287054 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:50.339679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e933c21c-c0f5-4dc7-8a38-38b4c86c9557 None None] Network 187794df-e6cb-4ee3-8b40-6b546c229bd2 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:12:50.340422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:50.341603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'Port': ['ID=d96ca9ce-4a19-49f0-bef3-e0e31ace478a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:50.345161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:50.380634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:50.418851 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f6085231-bfea-4ef9-972e-87dbf6a92811'] response: {'server_uuid': '6a304fd0-80ef-4b27-86c5-a861e6627236', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '54f3ad03-fdf2-4862-93ff-f60efa594593', 'code': 200} May 12 15:12:50.533902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:50.534565 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:50.572751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-402e5698-b562-4ef8-bb76-517eeb3e4f92 req-825ec69c-ed45-408c-ae84-4d38896c16e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:50.574523 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-402e5698-b562-4ef8-bb76-517eeb3e4f92 req-825ec69c-ed45-408c-ae84-4d38896c16e9 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=463cc5a1-f7b3-45c8-a707-e2e999a85e8c HTTP/1.1" status: 200 len: 1096 time: 0.4315593 May 12 15:12:50.579842 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-796e5b91-cbb0-40c5-b223-360a352eb159 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 935 time: 3.6670754 May 12 15:12:50.580280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52596) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:50.586507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f599fd8-0c33-417c-8630-c1f1245cd2e9 req-b9d5adc7-8467-4413-a387-e1a947e48509 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:50.588021 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4f599fd8-0c33-417c-8630-c1f1245cd2e9 req-b9d5adc7-8467-4413-a387-e1a947e48509 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=463cc5a1-f7b3-45c8-a707-e2e999a85e8c HTTP/1.1" status: 200 len: 945 time: 0.5619764 May 12 15:12:50.605379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:50.610102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Usage tracker for resource:port and tenant:aca50b48316f40a7a6ceb23c44dd4720 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:50.613595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:50.620025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:50.624716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'port': {'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06', 'name': 'tempest-TaggedBootDevicesTest_v242-1013726093', 'fixed_ips': [{'subnet_id': '34e89d1d-72aa-4216-94d6-f37b8a0c162b'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:50.685075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Made reservation on behalf of aca50b48316f40a7a6ceb23c44dd4720 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:50.687721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:50.689037 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:50.706809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:50.713554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8092a31e-f22d-4b85-9a51-6929599fcf39 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:50.734817 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4f599fd8-0c33-417c-8630-c1f1245cd2e9 req-a006941f-b464-493c-9bb7-d1c49741db5b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0936739 May 12 15:12:50.765313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5bd47f83-3cae-4b53-b60d-2e66ff786816 None None] Provisioning for port 80316dbd-bbfa-49eb-a448-99afe53e8a57 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:50.783924 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:50.784564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 65584e07-bbd0-40f8-806a-3b7a85300525 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:12:50.800805 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-61c9b1bc-d7fe-4d93-b851-6424a58335bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:50.801330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-61c9b1bc-d7fe-4d93-b851-6424a58335bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:50.801827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-61c9b1bc-d7fe-4d93-b851-6424a58335bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:50.803613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-61c9b1bc-d7fe-4d93-b851-6424a58335bd service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1aea6927c780448b89ddf44ec6bcb186&device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2864 time: 0.4706559 May 12 15:12:50.837623 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-402e5698-b562-4ef8-bb76-517eeb3e4f92 req-2e1210ce-a726-48bf-8f3d-1f16ff4d8ce6 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2544644 May 12 15:12:51.007736 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-32569314-fe30-4d06-a043-1a1a50636e65 None None] Provisioning for port d96ca9ce-4a19-49f0-bef3-e0e31ace478a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:51.032222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:51.037197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:port and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:51.040701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for port was recalculated. Used quota:5. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:51.047711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource port. Total usage: 5; quota limit: 500; headroom:495 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:51.066599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:51.085194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Made reservation on behalf of 05b4f1ce61294fb29efb0a765ed28561 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:12:51.088103 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-32569314-fe30-4d06-a043-1a1a50636e65 None None] Provisioning complete for port d96ca9ce-4a19-49f0-bef3-e0e31ace478a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:51.088103 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-32569314-fe30-4d06-a043-1a1a50636e65 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:51.095690 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:51.103598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cd70e18-bdce-4712-ab73-ec3f100316be req-07c3c28e-3bfa-41ba-a98e-cbe1d792dc93 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:51.111566 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3cd70e18-bdce-4712-ab73-ec3f100316be req-07c3c28e-3bfa-41ba-a98e-cbe1d792dc93 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 949 time: 0.6713471 May 12 15:12:51.141686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] device_id is not set on port be802a6d-cca9-42fd-bdc5-6c9f78035217 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:12:51.143337 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32021e8e-90de-42de-ac41-eacbd8ab0779 req-e9cb3b0a-9c42-493a-9676-ceaa8c012a20 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 210 time: 0.2906899 May 12 15:12:51.238903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 8092a31e-f22d-4b85-9a51-6929599fcf39 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:51.239273 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:51.286697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-32569314-fe30-4d06-a043-1a1a50636e65 None None] Port d96ca9ce-4a19-49f0-bef3-e0e31ace478a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:12:51.305217 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-83390898-359d-437d-bb30-ebf6074016ef req-a4569d1b-94b4-41fc-b18b-1969d0f40ed3 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] show failed (client error): The resource could not be found. May 12 15:12:51.309041 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83390898-359d-437d-bb30-ebf6074016ef req-a4569d1b-94b4-41fc-b18b-1969d0f40ed3 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/floatingips/3340c7ef-fd9e-4488-a189-a250be5f44fb HTTP/1.1" status: 404 len: 350 time: 0.1328714 May 12 15:12:51.327827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 65584e07-bbd0-40f8-806a-3b7a85300525, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=65584e07-bbd0-40f8-806a-3b7a85300525,segment=NetworkSegment(36ebeacd-da47-43a4-9f56-f8706690a71c),segment_id=36ebeacd-da47-43a4-9f56-f8706690a71c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:51.331078 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3cd70e18-bdce-4712-ab73-ec3f100316be req-750af83a-8643-41b5-acbb-26344eaeb342 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2186661 May 12 15:12:51.375534 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '65584e07-bbd0-40f8-806a-3b7a85300525', 'network_id': 'b55a7520-40f6-4d38-b0f0-235a1cd1b883', 'port_id': '65584e07-bbd0-40f8-806a-3b7a85300525', 'mac_address': 'fa:16:3e:03:e9:56', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 576, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b8fd478e-7f1c-4be3-acd2-b5504391fab8', 'ip_address': '19.86.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:12:51.398091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Allocated IP 172.20.0.11 (079240cc-25ba-4ba4-a3b0-412d897b19bb/b6cc6b5a-d56a-4336-afb7-99232d9672dc/79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:51.465707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Allocated IP 10.1.1.182 (86d71e93-6e6b-4e00-b1ac-48b27c2b0f06/34e89d1d-72aa-4216-94d6-f37b8a0c162b/be802a6d-cca9-42fd-bdc5-6c9f78035217) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:51.516172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a686f1c4-b2f1-4692-950a-b2a71f6aeb6f no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:12:51.587234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: a686f1c4-b2f1-4692-950a-b2a71f6aeb6f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:12:51.587567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a686f1c4-b2f1-4692-950a-b2a71f6aeb6f not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:12:51.594028 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:51.597574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-045f9358-d82d-45f5-9153-87c84675aaf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:51.599293 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-045f9358-d82d-45f5-9153-87c84675aaf8 service neutron] 10.222.0.76 "GET /v2.0/networks?id=b55a7520-40f6-4d38-b0f0-235a1cd1b883 HTTP/1.1" status: 200 len: 902 time: 0.7829745 May 12 15:12:51.636021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 65584e07-bbd0-40f8-806a-3b7a85300525 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:51.654607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 80316dbd-bbfa-49eb-a448-99afe53e8a57 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:51.698351 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 65584e07-bbd0-40f8-806a-3b7a85300525, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=65584e07-bbd0-40f8-806a-3b7a85300525,segment=NetworkSegment(36ebeacd-da47-43a4-9f56-f8706690a71c),segment_id=36ebeacd-da47-43a4-9f56-f8706690a71c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:51.709899 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:51.710409 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:51.711051 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 54f3ad03-fdf2-4862-93ff-f60efa594593 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:12:51.726457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Transition to ACTIVE for port object be802a6d-cca9-42fd-bdc5-6c9f78035217 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:51.751715 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:51.803613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-18f0e960-3ff3-4138-acf3-c13761947747 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=19.86.0.4&port_id=65584e07-bbd0-40f8-806a-3b7a85300525 HTTP/1.1" status: 200 len: 217 time: 0.1597505 May 12 15:12:51.831496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:51.834941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:51.838864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:51.876860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'Port': ['ID=be802a6d-cca9-42fd-bdc5-6c9f78035217,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:51.887810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 80316dbd-bbfa-49eb-a448-99afe53e8a57 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:51.894319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=65584e07-bbd0-40f8-806a-3b7a85300525,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:51.903035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 80316dbd-bbfa-49eb-a448-99afe53e8a57 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:51.903450 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:51.929114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:51.929853 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:51.947912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-3d3f56ac-7686-4dc1-a201-e789f50ee068 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:51.949462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-3d3f56ac-7686-4dc1-a201-e789f50ee068 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=b8fd478e-7f1c-4be3-acd2-b5504391fab8 HTTP/1.1" status: 200 len: 801 time: 0.1357267 May 12 15:12:51.954374 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-71320f37-0c4c-474e-b64c-59dc677da5be tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.3729110 May 12 15:12:52.020546 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=54f3ad03-fdf2-4862-93ff-f60efa594593,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:52.031374 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb09347-a30d-4e70-9ac7-d8b7723f2fa2 req-dee0ac4f-d0bb-49fe-9556-c52bc712a51d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:52.037502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb09347-a30d-4e70-9ac7-d8b7723f2fa2 req-dee0ac4f-d0bb-49fe-9556-c52bc712a51d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:52.043287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb09347-a30d-4e70-9ac7-d8b7723f2fa2 req-dee0ac4f-d0bb-49fe-9556-c52bc712a51d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:52.044971 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2eb09347-a30d-4e70-9ac7-d8b7723f2fa2 req-dee0ac4f-d0bb-49fe-9556-c52bc712a51d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2412 time: 0.5519300 May 12 15:12:52.056175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-495e6efb-f33d-45ff-a95f-c837d810463b req-84e318fa-ec1c-432d-b6c3-62aeff7c127a tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:52.057697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-495e6efb-f33d-45ff-a95f-c837d810463b req-84e318fa-ec1c-432d-b6c3-62aeff7c127a tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 944 time: 0.5088859 May 12 15:12:52.062019 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:52.074633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 54f3ad03-fdf2-4862-93ff-f60efa594593 has no active binding in host n-h2-841483-1 {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:142}} May 12 15:12:52.074962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 039f5f29-f92a-42e9-9582-4aaf75edb62a details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:12:52.119983 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:52.131669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'name': 'network-vif-deleted', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:52.144237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e375ed8e-f0ee-4de0-a367-b3cda9bc4adc None None] Provisioning for port be802a6d-cca9-42fd-bdc5-6c9f78035217 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:52.149771 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 039f5f29-f92a-42e9-9582-4aaf75edb62a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=039f5f29-f92a-42e9-9582-4aaf75edb62a,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:52.166885 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2eb09347-a30d-4e70-9ac7-d8b7723f2fa2 req-9a5c6a3f-2a49-4a80-9eb1-af1060064f8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1015437 May 12 15:12:52.170604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e375ed8e-f0ee-4de0-a367-b3cda9bc4adc None None] Provisioning complete for port be802a6d-cca9-42fd-bdc5-6c9f78035217 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:52.170604 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e375ed8e-f0ee-4de0-a367-b3cda9bc4adc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:52.172059 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-495e6efb-f33d-45ff-a95f-c837d810463b req-44b6fe2e-1e9e-4a27-abae-de05728124b3 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0931733 May 12 15:12:52.190466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-d894c860-4d7f-410e-95a2-e050810e3e48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:52.191966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-d894c860-4d7f-410e-95a2-e050810e3e48 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b55a7520-40f6-4d38-b0f0-235a1cd1b883&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.2272117 May 12 15:12:52.212288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '039f5f29-f92a-42e9-9582-4aaf75edb62a', 'network_id': '9021e9b2-6c8f-4b20-8148-52e45c2296b3', 'port_id': '039f5f29-f92a-42e9-9582-4aaf75edb62a', 'mac_address': 'fa:16:3e:9e:b9:08', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 577, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7e73bcb0-088d-46bf-8dd4-a976776d8b9c', 'ip_address': '19.80.0.219'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:12:52.353628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 80316dbd-bbfa-49eb-a448-99afe53e8a57, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=80316dbd-bbfa-49eb-a448-99afe53e8a57,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:52.354561 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:52.365409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e375ed8e-f0ee-4de0-a367-b3cda9bc4adc None None] Port be802a6d-cca9-42fd-bdc5-6c9f78035217 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:12:52.371954 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:52.409784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 039f5f29-f92a-42e9-9582-4aaf75edb62a {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:52.455894 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 039f5f29-f92a-42e9-9582-4aaf75edb62a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=039f5f29-f92a-42e9-9582-4aaf75edb62a,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:52.465866 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-c4a9fcab-238b-4649-82f6-761eff733a68 service neutron] 10.222.0.84 "GET /v2.0/ports/54f3ad03-fdf2-4862-93ff-f60efa594593/bindings/n-h2-841483-1 HTTP/1.1" status: 200 len: 384 time: 0.2085168 May 12 15:12:52.468436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=80316dbd-bbfa-49eb-a448-99afe53e8a57,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:52.472934 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:52.475813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6a304fd0-80ef-4b27-86c5-a861e6627236', 'tag': '54f3ad03-fdf2-4862-93ff-f60efa594593'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:52.486008 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:52.548731 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=039f5f29-f92a-42e9-9582-4aaf75edb62a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:52.583731 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-a49f77e8-f05c-4803-ad76-a5d037bc4de8 req-81bb4f0c-e79a-4999-afe3-b4414ff4c657 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] show failed (client error): The resource could not be found. May 12 15:12:52.584742 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a49f77e8-f05c-4803-ad76-a5d037bc4de8 req-81bb4f0c-e79a-4999-afe3-b4414ff4c657 tempest-FloatingIPsTestJSON-943029332 tempest-FloatingIPsTestJSON-943029332-project] 10.222.0.82 "GET /v2.0/floatingips/3340c7ef-fd9e-4488-a189-a250be5f44fb HTTP/1.1" status: 404 len: 350 time: 0.3232086 May 12 15:12:52.599334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52620) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:52.630246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Network 079240cc-25ba-4ba4-a3b0-412d897b19bb is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:12:52.636383 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:12:52.655479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:12:52.710142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Pushing event updated for resources: {'Port': ['ID=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:52.784718 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-81a31b55-cc34-442f-857c-e3587401f5c5 service neutron] 10.222.0.76 "GET /v2.0/networks/b55a7520-40f6-4d38-b0f0-235a1cd1b883?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5852344 May 12 15:12:52.797773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:52.798372 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:52.830846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['65584e07-bbd0-40f8-806a-3b7a85300525'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:52.886869 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['039f5f29-f92a-42e9-9582-4aaf75edb62a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:52.897193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-666b644e-bc82-4a4b-8a21-780f708696b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:52.898760 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-666b644e-bc82-4a4b-8a21-780f708696b6 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=463cc5a1-f7b3-45c8-a707-e2e999a85e8c HTTP/1.1" status: 200 len: 1096 time: 0.3804061 May 12 15:12:52.925685 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-f6870e5e-63ca-47ee-a58a-37a75c8878c0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.7824664 May 12 15:12:52.943201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Request body: {'port': {'device_id': '93f69d1e-0068-4634-b7ad-70f7710d8470', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:53.116935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b4f7350-5ebc-4c11-a9b7-9cb891450f5a req-bffea525-5d2e-4776-91df-7ea506ec7939 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:53.118449 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b4f7350-5ebc-4c11-a9b7-9cb891450f5a req-bffea525-5d2e-4776-91df-7ea506ec7939 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 1100 time: 0.6264760 May 12 15:12:53.193775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a6521c9-65a5-49d5-a114-addc121edee8 req-e459f371-4084-4e01-9d6a-866ca3cdde4f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:53.195162 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a6521c9-65a5-49d5-a114-addc121edee8 req-e459f371-4084-4e01-9d6a-866ca3cdde4f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=463cc5a1-f7b3-45c8-a707-e2e999a85e8c HTTP/1.1" status: 200 len: 945 time: 0.4921856 May 12 15:12:53.267421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-307b5ffc-06e5-4bc1-a05f-4b46442492ea service neutron] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=54f3ad03-fdf2-4862-93ff-f60efa594593,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:53.312371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-1a534a4b-3b2c-4fd7-a6e6-4d5fefb5e25d service neutron] 10.222.0.76 "GET /v2.0/networks/b55a7520-40f6-4d38-b0f0-235a1cd1b883?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5077555 May 12 15:12:53.324590 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b4f7350-5ebc-4c11-a9b7-9cb891450f5a req-f0f33a7d-590f-40a3-bee5-c7ac23da3f41 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1855223 May 12 15:12:53.333931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a6521c9-65a5-49d5-a114-addc121edee8 req-2cf0182d-ac47-4893-aa50-b63dbcbd3311 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1197822 May 12 15:12:53.346055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:53.384644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-59264be4-873b-4f42-8297-951cdbda07e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:53.386176 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-59264be4-873b-4f42-8297-951cdbda07e4 service neutron] 10.222.0.76 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 907 time: 0.4792550 May 12 15:12:53.389039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-307b5ffc-06e5-4bc1-a05f-4b46442492ea service neutron] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:53.421104 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-206d7a2f-e427-4153-a865-a8d1d95d4825'] response: {'server_uuid': '1ba1fe04-2028-450d-a328-91f2555a5d58', 'name': 'network-vif-deleted', 'tag': 'a686f1c4-b2f1-4692-950a-b2a71f6aeb6f', 'status': 'completed', 'code': 200} May 12 15:12:53.504617 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-7c389abd-9b6c-49d5-bc50-45364460a1ab service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4b2fc410-d9a8-4bcd-af90-17da21c97bac HTTP/1.1" status: 200 len: 217 time: 0.0859532 May 12 15:12:53.521278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52630) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:53.579998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1104440069', 'description': 'tempest-description--362164016'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:53.604905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-307b5ffc-06e5-4bc1-a05f-4b46442492ea service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 54f3ad03-fdf2-4862-93ff-f60efa594593 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:53.618018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:53.633702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-307b5ffc-06e5-4bc1-a05f-4b46442492ea service neutron] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=54f3ad03-fdf2-4862-93ff-f60efa594593,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:53.637314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:security_group and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:53.644362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:53.686886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-04cd87ef-b1c5-4233-b123-db73be573e4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:53.688323 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-04cd87ef-b1c5-4233-b123-db73be573e4d service neutron] 10.222.0.76 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.1734385 May 12 15:12:53.693781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-307b5ffc-06e5-4bc1-a05f-4b46442492ea service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:53.725874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:53.753195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-800d92d0-aaeb-4616-a63b-8995110e45cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:53.753769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-800d92d0-aaeb-4616-a63b-8995110e45cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:53.754242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-800d92d0-aaeb-4616-a63b-8995110e45cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:53.756014 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-800d92d0-aaeb-4616-a63b-8995110e45cb service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=1aea6927c780448b89ddf44ec6bcb186&device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2867 time: 0.3808289 May 12 15:12:53.760699 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-508586a6-da57-47a2-bd7d-e7dea0b6d5e1 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0564628 May 12 15:12:53.767987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:53.782482 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a9f3003d-7b00-4d99-ae6d-0ecf5e0a4b59'] response: {'name': 'network-changed', 'server_uuid': '6a304fd0-80ef-4b27-86c5-a861e6627236', 'tag': '54f3ad03-fdf2-4862-93ff-f60efa594593', 'status': 'completed', 'code': 200} May 12 15:12:53.983579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-307b5ffc-06e5-4bc1-a05f-4b46442492ea service neutron] Transition to ACTIVE for port object 54f3ad03-fdf2-4862-93ff-f60efa594593 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:53.993476 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:53.997262 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-307b5ffc-06e5-4bc1-a05f-4b46442492ea service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:54.031465 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-740e96f6-0731-42ea-b41b-20528da35168 service neutron] 10.222.0.76 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2338285 May 12 15:12:54.047290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:security_group_rule and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:54.061554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['0e99f99c-8d6a-408a-83f0-5cc1c1d502a3'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:54.067334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead435ee-7ecb-434a-a7fb-59ca8eb82b65 req-f6016a38-f7f3-4fde-9689-a46952a455d3 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:54.068038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ead435ee-7ecb-434a-a7fb-59ca8eb82b65 req-f6016a38-f7f3-4fde-9689-a46952a455d3 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Synchronizing usage tracker for tenant:aca50b48316f40a7a6ceb23c44dd4720 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:12:54.077289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:54.096814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:54.192932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ead435ee-7ecb-434a-a7fb-59ca8eb82b65 req-f6016a38-f7f3-4fde-9689-a46952a455d3 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Unset dirty status for tenant:aca50b48316f40a7a6ceb23c44dd4720 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:12:54.194136 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ead435ee-7ecb-434a-a7fb-59ca8eb82b65 req-f6016a38-f7f3-4fde-9689-a46952a455d3 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 932 time: 0.6699870 May 12 15:12:54.257137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-dc00cbeb-4784-4e6f-96c7-a3280bc8a6ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:54.258713 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-dc00cbeb-4784-4e6f-96c7-a3280bc8a6ad service neutron] 10.222.0.76 "GET /v2.0/networks?id=9021e9b2-6c8f-4b20-8148-52e45c2296b3 HTTP/1.1" status: 200 len: 903 time: 0.4781263 May 12 15:12:54.283602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-307b5ffc-06e5-4bc1-a05f-4b46442492ea service neutron] No DVR routers for this DVR port 54f3ad03-fdf2-4862-93ff-f60efa594593 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:12:54.298031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-307b5ffc-06e5-4bc1-a05f-4b46442492ea service neutron] Pushing event updated for resources: {'Port': ['ID=54f3ad03-fdf2-4862-93ff-f60efa594593,revision_number=10']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:54.370062 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-307b5ffc-06e5-4bc1-a05f-4b46442492ea service neutron] 10.222.0.84 "PUT /v2.0/ports/54f3ad03-fdf2-4862-93ff-f60efa594593/bindings/n-h2-841483-1/activate HTTP/1.1" status: 200 len: 369 time: 1.8918052 May 12 15:12:54.380514 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-3790077c-9c1c-4c10-b302-b86ae215fd4d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=19.80.0.219&port_id=039f5f29-f92a-42e9-9582-4aaf75edb62a HTTP/1.1" status: 200 len: 217 time: 0.1115124 May 12 15:12:54.396249 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-040a3860-52b0-4269-914b-151c712371db service neutron] 10.222.0.76 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3478577 May 12 15:12:54.405925 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-438fc70d-1246-4135-b0dd-1b8d23c04a62 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:54.488016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 80316dbd-bbfa-49eb-a448-99afe53e8a57 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:54.526430 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d0095c-fc3f-4c2c-af86-b139fbbdc4d0 req-87e1e1bd-73a9-4dee-a572-82b6311fbaeb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:54.527910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58d0095c-fc3f-4c2c-af86-b139fbbdc4d0 req-87e1e1bd-73a9-4dee-a572-82b6311fbaeb service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 1083 time: 0.6872370 May 12 15:12:54.530175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ead435ee-7ecb-434a-a7fb-59ca8eb82b65 req-8e11e332-52f9-496a-a78c-cc4034236473 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Synchronizing usage tracker for tenant:aca50b48316f40a7a6ceb23c44dd4720 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:12:54.531167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 039f5f29-f92a-42e9-9582-4aaf75edb62a up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:54.560826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26cc54e3-33ce-4670-8946-e0216d89e6f6 req-6692d5a7-ada5-43f2-a411-fea887df3536 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:54.566698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26cc54e3-33ce-4670-8946-e0216d89e6f6 req-6692d5a7-ada5-43f2-a411-fea887df3536 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:54.572730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26cc54e3-33ce-4670-8946-e0216d89e6f6 req-6692d5a7-ada5-43f2-a411-fea887df3536 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:54.574371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-26cc54e3-33ce-4670-8946-e0216d89e6f6 req-6692d5a7-ada5-43f2-a411-fea887df3536 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2414 time: 0.6001422 May 12 15:12:54.633657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 039f5f29-f92a-42e9-9582-4aaf75edb62a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:54.637101 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 80316dbd-bbfa-49eb-a448-99afe53e8a57 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:54.637608 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:54.670990 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 039f5f29-f92a-42e9-9582-4aaf75edb62a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:54.671445 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:54.723731 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:54.726411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:12:54.738569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-9333a053-995a-4d3e-beff-c5844ed9b652 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:54.739998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-9333a053-995a-4d3e-beff-c5844ed9b652 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=7e73bcb0-088d-46bf-8dd4-a976776d8b9c HTTP/1.1" status: 200 len: 801 time: 0.3305779 May 12 15:12:54.760480 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:54.797516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ead435ee-7ecb-434a-a7fb-59ca8eb82b65 req-8e11e332-52f9-496a-a78c-cc4034236473 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Unset dirty status for tenant:aca50b48316f40a7a6ceb23c44dd4720 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:12:54.805554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ead435ee-7ecb-434a-a7fb-59ca8eb82b65 req-8e11e332-52f9-496a-a78c-cc4034236473 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5427382 May 12 15:12:54.806203 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:54.862822 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-26cc54e3-33ce-4670-8946-e0216d89e6f6 req-c8541c60-eede-4c61-be64-7b7db7b6bf11 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2504957 May 12 15:12:54.870210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-34be545c-93ea-41f4-86a3-e4f4cf537b17 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:54.873057 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-34be545c-93ea-41f4-86a3-e4f4cf537b17 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&tenant_id=68c66ae0cd45476b87e2e79625b80f69&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1096 time: 0.3872204 May 12 15:12:54.887409 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:54.931446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Transition to ACTIVE for port object 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:12:54.935404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5d05f580-8d94-4f7a-847b-79c969006d42,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:54.941053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '039f5f29-f92a-42e9-9582-4aaf75edb62a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:54.950963 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:54.978225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 039f5f29-f92a-42e9-9582-4aaf75edb62a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=039f5f29-f92a-42e9-9582-4aaf75edb62a,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:54.990402 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:54.991547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 65584e07-bbd0-40f8-806a-3b7a85300525 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:55.018617 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:55.020167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ccfe6a5d-e61b-48d4-8b2b-57bad7899af3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 1.4942336 May 12 15:12:55.034902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52646) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:55.068929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-c4a02da9-0305-4945-b5ed-dc573efbd596 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:55.070344 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-c4a02da9-0305-4945-b5ed-dc573efbd596 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&tenant_id=68c66ae0cd45476b87e2e79625b80f69 HTTP/1.1" status: 200 len: 1096 time: 0.1865795 May 12 15:12:55.085040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-438fc70d-1246-4135-b0dd-1b8d23c04a62 admin admin] Deleting port fac623c3-0b49-4481-af00-ce11553f25e2 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:55.085543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-438fc70d-1246-4135-b0dd-1b8d23c04a62 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:55.164102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 65584e07-bbd0-40f8-806a-3b7a85300525 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:55.174803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 65584e07-bbd0-40f8-806a-3b7a85300525 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:55.175175 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:55.218739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=039f5f29-f92a-42e9-9582-4aaf75edb62a,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:55.295700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-019dbb15-7c3d-461a-acdd-cccf5439eb22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:55.297176 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-019dbb15-7c3d-461a-acdd-cccf5439eb22 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 1096 time: 0.1872215 May 12 15:12:55.315473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8310cabd-cc47-4f28-8771-64279c65d7eb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'security_group_rule': {'security_group_id': '5d05f580-8d94-4f7a-847b-79c969006d42', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:55.348456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d0095c-fc3f-4c2c-af86-b139fbbdc4d0 req-5838760d-67f4-4021-b572-2b260a63af53 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:55.349930 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58d0095c-fc3f-4c2c-af86-b139fbbdc4d0 req-5838760d-67f4-4021-b572-2b260a63af53 service neutron] 10.222.0.84 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.7741132 May 12 15:12:55.350451 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:55.359370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8310cabd-cc47-4f28-8771-64279c65d7eb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:55.387093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 65584e07-bbd0-40f8-806a-3b7a85300525, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=65584e07-bbd0-40f8-806a-3b7a85300525,segment=NetworkSegment(36ebeacd-da47-43a4-9f56-f8706690a71c),segment_id=36ebeacd-da47-43a4-9f56-f8706690a71c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:55.392388 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:55.420857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-438fc70d-1246-4135-b0dd-1b8d23c04a62 admin admin] For port fac623c3-0b49-4481-af00-ce11553f25e2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fac623c3-0b49-4481-af00-ce11553f25e2,segment=NetworkSegment(d6eafc19-f9db-4010-b69b-58d99283bc6a),segment_id=d6eafc19-f9db-4010-b69b-58d99283bc6a)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:55.421228 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-438fc70d-1246-4135-b0dd-1b8d23c04a62 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:55.425543 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9321c6b6-5154-449c-b241-4af98861cdfd req-e3c73141-101f-48b0-a8a8-2eb8b876173c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1727264 May 12 15:12:55.465699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8310cabd-cc47-4f28-8771-64279c65d7eb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:security_group_rule and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:55.470798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=65584e07-bbd0-40f8-806a-3b7a85300525,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:55.507921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8310cabd-cc47-4f28-8771-64279c65d7eb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:55.548508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 54f3ad03-fdf2-4862-93ff-f60efa594593 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:12:55.561816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Pushing event updated for resources: {'Port': ['ID=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:55.566824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-438fc70d-1246-4135-b0dd-1b8d23c04a62 admin admin] Calling delete_port for fac623c3-0b49-4481-af00-ce11553f25e2 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:55.569964 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58d0095c-fc3f-4c2c-af86-b139fbbdc4d0 req-b93303ef-6911-4acf-b884-58602307bbdf service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=54f3ad03-fdf2-4862-93ff-f60efa594593 HTTP/1.1" status: 200 len: 217 time: 0.2048202 May 12 15:12:55.602259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8310cabd-cc47-4f28-8771-64279c65d7eb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:55.612530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 54f3ad03-fdf2-4862-93ff-f60efa594593 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:12:55.634913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-095d8e42-e427-4013-917e-21906df4ba1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:55.635663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-35def338-9e71-44e6-9501-fbbff7df3f3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:55.635903 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-095d8e42-e427-4013-917e-21906df4ba1a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9021e9b2-6c8f-4b20-8148-52e45c2296b3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.8714271 May 12 15:12:55.637089 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-35def338-9e71-44e6-9501-fbbff7df3f3f service neutron] 10.222.0.76 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.3282776 May 12 15:12:55.727258 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-9c9773be-fbbe-4d60-aad6-3496c8472c0b service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=54f3ad03-fdf2-4862-93ff-f60efa594593 HTTP/1.1" status: 200 len: 217 time: 0.0732417 May 12 15:12:55.811082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-04f8254b-d6ec-4b84-b899-523b3432783c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:55.812524 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-04f8254b-d6ec-4b84-b899-523b3432783c service neutron] 10.222.0.76 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.0783029 May 12 15:12:55.846105 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8310cabd-cc47-4f28-8771-64279c65d7eb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:55.866248 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-9e542c32-fd19-4f11-b93a-dcaad5dc8935 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0462236 May 12 15:12:55.896523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d0095c-fc3f-4c2c-af86-b139fbbdc4d0 req-3029e3e0-f627-4777-8f69-c0075182d0ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:55.897942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58d0095c-fc3f-4c2c-af86-b139fbbdc4d0 req-3029e3e0-f627-4777-8f69-c0075182d0ec service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.2936802 May 12 15:12:55.923240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.76', 61857) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:55.978709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9321c6b6-5154-449c-b241-4af98861cdfd req-dd563ba5-079c-4bce-af0d-4580b5c149b1 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:55.980112 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9321c6b6-5154-449c-b241-4af98861cdfd req-dd563ba5-079c-4bce-af0d-4580b5c149b1 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5538485 May 12 15:12:55.980762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Attempting to bind port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:12:55.981079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Attempting to bind port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '68221a3b-1121-4349-a5a1-801f502e908b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:12:55.981412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Attempting to bind port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 on network 079240cc-25ba-4ba4-a3b0-412d897b19bb {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:56.011735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58d0095c-fc3f-4c2c-af86-b139fbbdc4d0 req-6c7882f7-36fb-40a1-a984-bab27c1718d2 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0905051 May 12 15:12:56.019206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ea6329-88b3-4966-a42d-3d0099343426 req-1d85931b-1a2c-49ff-bff1-88a8834e8132 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:56.020520 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-17ea6329-88b3-4966-a42d-3d0099343426 req-1d85931b-1a2c-49ff-bff1-88a8834e8132 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.76 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 950 time: 0.7435794 May 12 15:12:56.033410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b845655-d7fe-411a-9fec-a6c77171a802 req-d8c8ff3e-a09c-4b2c-a0b1-d569ef0754f1 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:56.034824 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b845655-d7fe-411a-9fec-a6c77171a802 req-d8c8ff3e-a09c-4b2c-a0b1-d569ef0754f1 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 945 time: 1.0256245 May 12 15:12:56.035389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 on network 079240cc-25ba-4ba4-a3b0-412d897b19bb not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:12:56.035957 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Attempting to bind port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 on network 079240cc-25ba-4ba4-a3b0-412d897b19bb {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:12:56.103561 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-438fc70d-1246-4135-b0dd-1b8d23c04a62 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:56.119429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:12:56.119685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Checking segment: {'id': '68221a3b-1121-4349-a5a1-801f502e908b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:12:56.120057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Bound using segment: {'id': '68221a3b-1121-4349-a5a1-801f502e908b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:12:56.120494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Bound port: 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '68221a3b-1121-4349-a5a1-801f502e908b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:12:56.120827 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:56.158374 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-a0420038-1ea6-45ed-9133-28457d08efba service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2841012 May 12 15:12:56.159083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-438fc70d-1246-4135-b0dd-1b8d23c04a62 admin admin] Pushing event deleted for resources: {'Port': ['ID=fac623c3-0b49-4481-af00-ce11553f25e2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:56.195828 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9321c6b6-5154-449c-b241-4af98861cdfd req-aaf8363f-b9d2-4640-8016-2d1fb438a5ae tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/quotas/fa4eac6b8c464c45aa3c550e59a0d34b HTTP/1.1" status: 200 len: 375 time: 0.1925426 May 12 15:12:56.311249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-5c3d93d8-4691-4ee8-b82e-f3cbdaec5f8b service neutron] 10.222.0.76 "GET /v2.0/networks/9021e9b2-6c8f-4b20-8148-52e45c2296b3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6368811 May 12 15:12:56.402908 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8310cabd-cc47-4f28-8771-64279c65d7eb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:56.416280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Deleting port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:56.416723 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:56.445064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-fdca1823-d669-4693-9192-b3f66f5f1436 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:56.446516 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-fdca1823-d669-4693-9192-b3f66f5f1436 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.76 "GET /v2.0/ports?device_id=463cc5a1-f7b3-45c8-a707-e2e999a85e8c HTTP/1.1" status: 200 len: 945 time: 0.5191686 May 12 15:12:56.491849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:12:56.519759 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8310cabd-cc47-4f28-8771-64279c65d7eb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:56.523781 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b845655-d7fe-411a-9fec-a6c77171a802 req-1484a44d-1720-401b-8c58-b09cdbe67df6 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4469466 May 12 15:12:56.589329 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:12:56.598228 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:12:56.598603 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:56.620707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-efcf5b6c-c1fe-4b94-8d98-f548b75a9ccb tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Deleting port 4b2fc410-d9a8-4bcd-af90-17da21c97bac {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:56.621053 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-efcf5b6c-c1fe-4b94-8d98-f548b75a9ccb tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:56.633877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8310cabd-cc47-4f28-8771-64279c65d7eb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=232ed91e-e4e6-4c92-825f-33470df936e7,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:56.656134 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58d0095c-fc3f-4c2c-af86-b139fbbdc4d0 req-c36c135c-bb5b-4693-a611-52c079760e73 service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6344478 May 12 15:12:56.659808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] For port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:56.671100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] For port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:12:56.720725 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-6b683033-f41c-4047-89c1-6416460e25db service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5542643 May 12 15:12:56.733128 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8310cabd-cc47-4f28-8771-64279c65d7eb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:56.734336 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8310cabd-cc47-4f28-8771-64279c65d7eb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.4833267 May 12 15:12:56.747035 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:56.754199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52662) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:56.832782 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:56.909554 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-438fc70d-1246-4135-b0dd-1b8d23c04a62 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:56.913695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:56.921460 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:56.922398 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a3c95caf-bb88-467f-88c0-e38ce2f7b5ff no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:12:57.076895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:57.142244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-65193630-05f7-4151-b7c2-001d997dcb5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'security_group_rule': {'security_group_id': '5d05f580-8d94-4f7a-847b-79c969006d42', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:57.156592 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-762056b0-df62-4842-a985-38108c019144 service neutron] 10.222.0.76 "GET /v2.0/networks/9021e9b2-6c8f-4b20-8148-52e45c2296b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8007729 May 12 15:12:57.177004 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:57.207644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-65193630-05f7-4151-b7c2-001d997dcb5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:57.210521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:57.216158 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:57.238635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:57.240591 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:57.242473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-87935577-0800-4cfa-9003-2da241116c18 service neutron] 10.222.0.76 "PUT /v2.0/ports/79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 HTTP/1.1" status: 200 len: 1092 time: 4.3055954 May 12 15:12:57.258484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-65193630-05f7-4151-b7c2-001d997dcb5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:security_group_rule and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:57.258715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-efcf5b6c-c1fe-4b94-8d98-f548b75a9ccb tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] For port 4b2fc410-d9a8-4bcd-af90-17da21c97bac, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4b2fc410-d9a8-4bcd-af90-17da21c97bac,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:57.259223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-efcf5b6c-c1fe-4b94-8d98-f548b75a9ccb tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:57.281504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '93f69d1e-0068-4634-b7ad-70f7710d8470', 'tag': '79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:57.302358 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:57.311456 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9321c6b6-5154-449c-b241-4af98861cdfd req-f8b9f4c7-032a-44c5-86d3-e743dcda673c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&fields=id HTTP/1.1" status: 200 len: 532 time: 1.0750914 May 12 15:12:57.321256 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-65193630-05f7-4151-b7c2-001d997dcb5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:57.389033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-65193630-05f7-4151-b7c2-001d997dcb5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:57.399177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87935577-0800-4cfa-9003-2da241116c18 service neutron] Pushing event updated for resources: {'Port': ['ID=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:57.401787 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-efcf5b6c-c1fe-4b94-8d98-f548b75a9ccb tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Calling delete_port for 4b2fc410-d9a8-4bcd-af90-17da21c97bac owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:57.471721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-8a7404e9-ec72-4819-b770-dcb1edc97415 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:57.473199 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-8a7404e9-ec72-4819-b770-dcb1edc97415 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&tenant_id=68c66ae0cd45476b87e2e79625b80f69&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 1096 time: 0.4375935 May 12 15:12:57.508970 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65193630-05f7-4151-b7c2-001d997dcb5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:57.572415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] For port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:57.572946 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:57.584972 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58d0095c-fc3f-4c2c-af86-b139fbbdc4d0 req-ed2680c1-e584-441a-863c-12aed81259cc service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8828697 May 12 15:12:57.616137 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65193630-05f7-4151-b7c2-001d997dcb5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:57.745952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65193630-05f7-4151-b7c2-001d997dcb5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:57.754987 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Calling delete_port for a3c95caf-bb88-467f-88c0-e38ce2f7b5ff owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:57.802577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-575c2172-e955-4d57-a82e-8b3d31c32059 req-c179c08a-4225-463b-9ffc-d8083647e796 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:57.804137 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-575c2172-e955-4d57-a82e-8b3d31c32059 req-c179c08a-4225-463b-9ffc-d8083647e796 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 948 time: 0.6522987 May 12 15:12:57.894705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65193630-05f7-4151-b7c2-001d997dcb5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c00edc1c-883e-49a3-bba0-cb5b06ef8790,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:57.898027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-4310fd6a-bc92-4291-a1f6-364c5096174c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:57.899510 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-4310fd6a-bc92-4291-a1f6-364c5096174c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=aca50b48316f40a7a6ceb23c44dd4720&device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 1095 time: 0.5811355 May 12 15:12:57.998540 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-991452ac-e4be-4c75-b337-6feba62320ea service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 HTTP/1.1" status: 200 len: 217 time: 0.0853014 May 12 15:12:58.003473 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65193630-05f7-4151-b7c2-001d997dcb5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:58.004601 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-65193630-05f7-4151-b7c2-001d997dcb5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.0231292 May 12 15:12:58.016801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52680) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:58.056959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:58.083567 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-efcf5b6c-c1fe-4b94-8d98-f548b75a9ccb tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:58.090626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:58.095058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['4b2fc410-d9a8-4bcd-af90-17da21c97bac'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:58.121679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-3b76dd06-e103-48e1-8e88-57183ac3fab2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:58.123768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-3b76dd06-e103-48e1-8e88-57183ac3fab2 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=b6cc6b5a-d56a-4336-afb7-99232d9672dc HTTP/1.1" status: 200 len: 855 time: 0.1077974 May 12 15:12:58.131060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:12:58.137708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-438fc70d-1246-4135-b0dd-1b8d23c04a62 admin admin] Router c3b59b75-f7cf-49f3-b6b3-5a717f23c43d has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:12:58.138939 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-575c2172-e955-4d57-a82e-8b3d31c32059 req-e74eec30-69df-407d-85cf-fe93fb1c7055 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2902498 May 12 15:12:58.141563 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:floatingip and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:58.154578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d880721d-d7c8-467d-b42a-aac9a591eb25 service neutron] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:12:58.160962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:58.167378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efcf5b6c-c1fe-4b94-8d98-f548b75a9ccb tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event deleted for resources: {'Port': ['ID=4b2fc410-d9a8-4bcd-af90-17da21c97bac,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:12:58.181307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:12:58.186685 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d880721d-d7c8-467d-b42a-aac9a591eb25 service neutron] Notify callbacks [] for binding, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:58.188140 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f884ef72-dc0b-434c-b6ac-23ee5772d6d1 req-d880721d-d7c8-467d-b42a-aac9a591eb25 service neutron] 10.222.0.76 "DELETE /v2.0/ports/54f3ad03-fdf2-4862-93ff-f60efa594593/bindings/n-h1-841483-1 HTTP/1.1" status: 204 len: 173 time: 0.6458795 May 12 15:12:58.215180 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0e005dd4-27a6-43e4-98b8-7269dd1db6d8'] response: {'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '039f5f29-f92a-42e9-9582-4aaf75edb62a', 'code': 200} May 12 15:12:58.257855 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-72cc704f-798e-4194-9cd6-da7913f53bf9 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=079240cc-25ba-4ba4-a3b0-412d897b19bb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0533886 May 12 15:12:58.258982 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:58.401004 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:12:58.401527 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:12:58.473704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-efcf5b6c-c1fe-4b94-8d98-f548b75a9ccb tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] No DVR routers for this DVR port 4b2fc410-d9a8-4bcd-af90-17da21c97bac on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:12:58.477683 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-efcf5b6c-c1fe-4b94-8d98-f548b75a9ccb tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:58.479174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd93950-1cc5-4a6a-b7dd-fbf5ef3b72b8 req-67cfd9b1-62b8-4c32-bea2-88e5c5166217 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:58.479551 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97dad2f1-86aa-4061-a5be-4a593a38c80a req-efcf5b6c-c1fe-4b94-8d98-f548b75a9ccb tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.76 "DELETE /v2.0/ports/4b2fc410-d9a8-4bcd-af90-17da21c97bac HTTP/1.1" status: 204 len: 173 time: 2.0254171 May 12 15:12:58.479971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '463cc5a1-f7b3-45c8-a707-e2e999a85e8c', 'name': 'network-vif-deleted', 'tag': '4b2fc410-d9a8-4bcd-af90-17da21c97bac'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:12:58.480828 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-efd93950-1cc5-4a6a-b7dd-fbf5ef3b72b8 req-67cfd9b1-62b8-4c32-bea2-88e5c5166217 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=463cc5a1-f7b3-45c8-a707-e2e999a85e8c HTTP/1.1" status: 200 len: 945 time: 0.7928741 May 12 15:12:58.502665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-438fc70d-1246-4135-b0dd-1b8d23c04a62 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:12:58.514348 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-438fc70d-1246-4135-b0dd-1b8d23c04a62 admin admin] 10.222.0.82 "PUT /v2.0/routers/c3b59b75-f7cf-49f3-b6b3-5a717f23c43d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9139335 May 12 15:12:58.514981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60f5b292-e17e-44b4-ad10-95f1d1d8eb19 None None] Sync routers for ids ['c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:12:58.515428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52686) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:12:58.524784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60f5b292-e17e-44b4-ad10-95f1d1d8eb19 None None] Routers {'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:58.525423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-60f5b292-e17e-44b4-ad10-95f1d1d8eb19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:12:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:58.674670 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-efd93950-1cc5-4a6a-b7dd-fbf5ef3b72b8 req-9f2887b1-f9c8-4a3e-9924-19cc8d9cab3c tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1445222 May 12 15:12:58.694397 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-3761a36e-4767-4a22-9de5-5e55452ba3f7 service neutron] 10.222.0.76 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4212451 May 12 15:12:58.745407 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:58.818249 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-60f5b292-e17e-44b4-ad10-95f1d1d8eb19 None None] Set router c3b59b75-f7cf-49f3-b6b3-5a717f23c43d gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:58.829609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d27bb6fd-f557-4215-bff8-205740ee002e req-1dbdda85-cb49-4e1f-8f4c-ef29bd879546 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:58.831254 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d27bb6fd-f557-4215-bff8-205740ee002e req-1dbdda85-cb49-4e1f-8f4c-ef29bd879546 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 944 time: 0.3689091 May 12 15:12:59.017725 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9321c6b6-5154-449c-b241-4af98861cdfd req-1ae0e5f6-d66d-4b36-ab68-51e060d4118a tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0475368 May 12 15:12:59.061956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Deleting port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:59.062355 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:59.143598 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:59.167628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] Deleting port f6107f32-e7d6-4f41-bfa1-9d4697d1809b {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:12:59.167976 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:59.259314 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:59.286240 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-60f5b292-e17e-44b4-ad10-95f1d1d8eb19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'name': 'tempest-FloatingIPsTestJSON-1092809323-router', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.23'}], 'enable_snat': True}, 'gw_port_id': 'f6107f32-e7d6-4f41-bfa1-9d4697d1809b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:55Z', 'updated_at': '2022-05-12T15:12:55Z', 'revision_number': 5, 'project_id': '4c3ee180ddb64a8685bd55247106d4cb', 'gw_port': {'id': 'f6107f32-e7d6-4f41-bfa1-9d4697d1809b', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:ec:87:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 864, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.23', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:58Z', 'updated_at': '2022-05-12T15:12:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:59.290456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60f5b292-e17e-44b4-ad10-95f1d1d8eb19 None None] Checking router: c3b59b75-f7cf-49f3-b6b3-5a717f23c43d for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:12:59.300021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60f5b292-e17e-44b4-ad10-95f1d1d8eb19 None None] Routers {'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:12:59.301040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-60f5b292-e17e-44b4-ad10-95f1d1d8eb19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:12:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:59.443716 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d27bb6fd-f557-4215-bff8-205740ee002e req-dbf7e224-d3ea-418e-8236-2572e7b5dedf tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6024308 May 12 15:12:59.464527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c61c2e9-c92f-412d-935e-54f17d2b7e71 req-055920a5-3e58-4dfc-babc-b0ab9ac1c958 service neutron] 10.222.0.76 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7621160 May 12 15:12:59.469873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9321c6b6-5154-449c-b241-4af98861cdfd req-76fdba1b-fc5b-4123-ab6b-a352332fc3ab tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:59.470418 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9321c6b6-5154-449c-b241-4af98861cdfd req-76fdba1b-fc5b-4123-ab6b-a352332fc3ab tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4452140 May 12 15:12:59.491679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Request body: {'port': {'device_id': '93d3a473-9471-49cf-b0d7-802129d2ab04', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': 'fa4eac6b8c464c45aa3c550e59a0d34b'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:12:59.508775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-60f5b292-e17e-44b4-ad10-95f1d1d8eb19 None None] Set router c3b59b75-f7cf-49f3-b6b3-5a717f23c43d gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:12:59.526837 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0260a2bf-ba42-4b9e-8276-17d52e8ecd6d'] response: {'name': 'network-changed', 'server_uuid': '93f69d1e-0068-4634-b7ad-70f7710d8470', 'tag': '79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6', 'status': 'completed', 'code': 200} May 12 15:12:59.583647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] For port f6107f32-e7d6-4f41-bfa1-9d4697d1809b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f6107f32-e7d6-4f41-bfa1-9d4697d1809b,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:12:59.584109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:12:59.703955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-60f5b292-e17e-44b4-ad10-95f1d1d8eb19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'name': 'tempest-FloatingIPsTestJSON-1092809323-router', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:55Z', 'updated_at': '2022-05-12T15:12:59Z', 'revision_number': 6, 'project_id': '4c3ee180ddb64a8685bd55247106d4cb', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:12:59.709292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60f5b292-e17e-44b4-ad10-95f1d1d8eb19 None None] The sync data for ids ['c3b59b75-f7cf-49f3-b6b3-5a717f23c43d'] in n-d-841483-1 is: [{'id': 'c3b59b75-f7cf-49f3-b6b3-5a717f23c43d', 'name': 'tempest-FloatingIPsTestJSON-1092809323-router', 'tenant_id': '4c3ee180ddb64a8685bd55247106d4cb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:55Z', 'updated_at': '2022-05-12T15:12:59Z', 'revision_number': 6, 'project_id': '4c3ee180ddb64a8685bd55247106d4cb', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:12:59.835182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c79dd4-d495-4454-be82-5f876551ae45 req-0130d853-cf4b-43a3-b421-5deeda0726c0 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:59.841949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c79dd4-d495-4454-be82-5f876551ae45 req-0130d853-cf4b-43a3-b421-5deeda0726c0 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:59.847825 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c79dd4-d495-4454-be82-5f876551ae45 req-0130d853-cf4b-43a3-b421-5deeda0726c0 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:12:59.849480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31c79dd4-d495-4454-be82-5f876551ae45 req-0130d853-cf4b-43a3-b421-5deeda0726c0 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2417 time: 0.6783113 May 12 15:12:59.860716 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86145878-90bf-45e0-9862-8bb2a14e7d2f req-70bd2153-e3fe-4d15-9076-f016fb2dda43 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.6276982 May 12 15:12:59.861598 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] Calling delete_port for f6107f32-e7d6-4f41-bfa1-9d4697d1809b owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:12:59.862700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9805897-c84e-47ba-8717-bfc575944fed req-f116dc97-b63c-42c6-a270-ab007ab47215 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=93d3a473-9471-49cf-b0d7-802129d2ab04 HTTP/1.1" status: 200 len: 210 time: 0.1494172 May 12 15:12:59.972687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Allocated IP 172.25.8.175 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/f870e17a-1996-41a8-bb25-d9cef52647e3) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:12:59.975445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:12:59.985380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Usage tracker for resource:port and tenant:fa4eac6b8c464c45aa3c550e59a0d34b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:12:59.989069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Quota usage for port was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:12:59.999904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attempting to reserve 1 items for resource port. Total usage: 7; quota limit: 500; headroom:493 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:00.012916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Made reservation on behalf of fa4eac6b8c464c45aa3c550e59a0d34b for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:00.016072 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:00.039047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] For port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:00.039434 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:00.079539 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31c79dd4-d495-4454-be82-5f876551ae45 req-f4bbe188-b4ac-4405-9734-998a30006e39 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2027562 May 12 15:13:00.157864 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-46bc8d3b-f968-43f4-841b-005a0ff17a3a'] response: {'server_uuid': '463cc5a1-f7b3-45c8-a707-e2e999a85e8c', 'name': 'network-vif-deleted', 'tag': '4b2fc410-d9a8-4bcd-af90-17da21c97bac', 'status': 'completed', 'code': 200} May 12 15:13:00.217230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '65584e07-bbd0-40f8-806a-3b7a85300525'}, {'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e99f99c-8d6a-408a-83f0-5cc1c1d502a3'}, {'server_uuid': '654cac47-c40b-4d9d-a71f-dbbed18b9333', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:00.234430 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Calling delete_port for a3c95caf-bb88-467f-88c0-e38ce2f7b5ff owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:00.286137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Allocated IP 192.168.233.73 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/451b695f-17f0-4d54-8214-37e3ab72567c) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:00.291381 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:00.350283 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] Pushing event deleted for resources: {'Port': ['ID=f6107f32-e7d6-4f41-bfa1-9d4697d1809b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:00.351719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d0652e0-2948-4989-b569-14b49fa9ee73 req-20e2a9e4-f443-42c8-a53c-f84c55aadee5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:00.353555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d0652e0-2948-4989-b569-14b49fa9ee73 req-20e2a9e4-f443-42c8-a53c-f84c55aadee5 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=aca50b48316f40a7a6ceb23c44dd4720&device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 1095 time: 0.7227898 May 12 15:13:00.507573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4b2fc410-d9a8-4bcd-af90-17da21c97bac no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:00.561684 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:00.584961 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 4b2fc410-d9a8-4bcd-af90-17da21c97bac {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:13:00.585829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4b2fc410-d9a8-4bcd-af90-17da21c97bac not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:00.597314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6107f32-e7d6-4f41-bfa1-9d4697d1809b no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:00.598307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86145878-90bf-45e0-9862-8bb2a14e7d2f req-248d2797-5adf-4f9a-9906-e9a8853d50ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:00.599769 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86145878-90bf-45e0-9862-8bb2a14e7d2f req-248d2797-5adf-4f9a-9906-e9a8853d50ef service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 1101 time: 0.6782229 May 12 15:13:00.640474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: f6107f32-e7d6-4f41-bfa1-9d4697d1809b {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:13:00.640972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6107f32-e7d6-4f41-bfa1-9d4697d1809b not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:00.641513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fac623c3-0b49-4481-af00-ce11553f25e2 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:00.671675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e0ebaf-f572-4a28-a3f2-e43834d1ed01 req-9c0861ce-17a6-451e-a4db-38a00e0e8254 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:00.678722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66e0ebaf-f572-4a28-a3f2-e43834d1ed01 req-9c0861ce-17a6-451e-a4db-38a00e0e8254 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 945 time: 0.7011430 May 12 15:13:00.681456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: fac623c3-0b49-4481-af00-ce11553f25e2 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:13:00.682670 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fac623c3-0b49-4481-af00-ce11553f25e2 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:00.758445 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:00.764414 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:00.826383 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:00.826644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] Fanout notify agent at l3_agent the message router_deleted on router c3b59b75-f7cf-49f3-b6b3-5a717f23c43d {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:13:00.838186 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:00.863338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Transition to ACTIVE for port object 451b695f-17f0-4d54-8214-37e3ab72567c will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:00.867225 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:00.868373 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-db0e14d0-4a1d-4fa2-810d-10631cc41840 admin admin] 10.222.0.82 "DELETE /v2.0/routers/c3b59b75-f7cf-49f3-b6b3-5a717f23c43d HTTP/1.1" status: 204 len: 168 time: 2.3520129 May 12 15:13:00.871165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52700) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:00.945547 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:00.945849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-1af7a3f0-460d-4299-9b0f-aed444d0d3a5 admin admin] Deleting subnet 4d5b7d28-8e2d-474e-8eb6-dfe9b12d479f {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:13:00.950854 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1af7a3f0-460d-4299-9b0f-aed444d0d3a5 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:00.991528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:01.002535 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81', '8c301fff-eebe-4ee3-ae47-9da749d76d58'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:01.040984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3ae73679-d198-440a-966c-619a9930fbcb', '83a7b910-a912-4e05-9d03-5d6b1f6b0edc', '9c35d53f-6773-4ce7-9642-3b542a20efa8', 'fa933a35-7a96-4a45-bb36-afb53c7641b9', 'bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:01.055085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d0652e0-2948-4989-b569-14b49fa9ee73 req-bd65ef7a-fdb6-4841-b44a-43d8bbcd5504 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:01.056521 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d0652e0-2948-4989-b569-14b49fa9ee73 req-bd65ef7a-fdb6-4841-b44a-43d8bbcd5504 service neutron] 10.222.0.76 "GET /v2.0/networks?id=079240cc-25ba-4ba4-a3b0-412d897b19bb HTTP/1.1" status: 200 len: 916 time: 0.6578169 May 12 15:13:01.076276 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1af7a3f0-460d-4299-9b0f-aed444d0d3a5 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:01.118410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:01.126182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:01.129964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event updated for resources: {'Port': ['ID=451b695f-17f0-4d54-8214-37e3ab72567c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:01.133281 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66e0ebaf-f572-4a28-a3f2-e43834d1ed01 req-3d15d774-907e-4a7a-83a4-2b0755a880aa tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4536893 May 12 15:13:01.134151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:01.140717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54b7c217-cb7c-4257-b8e9-70fc9b76d22f req-69174319-8c3b-462c-a1dc-7d5a064d8049 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:01.142607 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-54b7c217-cb7c-4257-b8e9-70fc9b76d22f req-69174319-8c3b-462c-a1dc-7d5a064d8049 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=654cac47-c40b-4d9d-a71f-dbbed18b9333 HTTP/1.1" status: 200 len: 948 time: 0.8157060 May 12 15:13:01.173171 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:01.246190 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d0652e0-2948-4989-b569-14b49fa9ee73 req-ebe47351-e6ce-4b52-8d7f-91caa072ba27 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 HTTP/1.1" status: 200 len: 217 time: 0.1673725 May 12 15:13:01.267879 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1af7a3f0-460d-4299-9b0f-aed444d0d3a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:01.394608 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7b1c45b6-c32e-44d5-ba96-cef9b7667732'] response: {'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '65584e07-bbd0-40f8-806a-3b7a85300525', 'code': 200} May 12 15:13:01.395083 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7b1c45b6-c32e-44d5-ba96-cef9b7667732'] response: {'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e99f99c-8d6a-408a-83f0-5cc1c1d502a3', 'code': 200} May 12 15:13:01.395509 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7b1c45b6-c32e-44d5-ba96-cef9b7667732'] response: {'server_uuid': '654cac47-c40b-4d9d-a71f-dbbed18b9333', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff', 'code': 200} May 12 15:13:01.422144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1af7a3f0-460d-4299-9b0f-aed444d0d3a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:01.483062 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-54b7c217-cb7c-4257-b8e9-70fc9b76d22f req-1cad96f1-9da3-4c98-a6c7-5d4449dac9d5 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/security-groups?id=f6116fca-2940-4bc5-b21c-3771c678920e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3259609 May 12 15:13:01.490261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86145878-90bf-45e0-9862-8bb2a14e7d2f req-1f56b5c7-68a7-441f-ad64-9f384fe866eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:01.494150 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86145878-90bf-45e0-9862-8bb2a14e7d2f req-1f56b5c7-68a7-441f-ad64-9f384fe866eb service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.8697829 May 12 15:13:01.495081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Pushing event deleted for resources: {'Port': ['ID=a3c95caf-bb88-467f-88c0-e38ce2f7b5ff,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:01.510392 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1af7a3f0-460d-4299-9b0f-aed444d0d3a5 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:01.532761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a9d83e4-3200-4c9c-a044-70f2942b16fa None None] Network cb55ee6d-0282-4fd1-b7e7-3686cea611b9 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:13:01.596845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:01.664117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c79b13fc-2b5d-41ae-b14a-1092d3797c39 None None] Provisioning for port 451b695f-17f0-4d54-8214-37e3ab72567c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:01.715778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c79b13fc-2b5d-41ae-b14a-1092d3797c39 None None] Provisioning complete for port 451b695f-17f0-4d54-8214-37e3ab72567c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:01.716893 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c79b13fc-2b5d-41ae-b14a-1092d3797c39 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:01.720331 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1af7a3f0-460d-4299-9b0f-aed444d0d3a5 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/4d5b7d28-8e2d-474e-8eb6-dfe9b12d479f HTTP/1.1" status: 204 len: 168 time: 0.8480871 May 12 15:13:01.729541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52714) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:01.753222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1af7a3f0-460d-4299-9b0f-aed444d0d3a5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4d5b7d28-8e2d-474e-8eb6-dfe9b12d479f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:01.783701 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86145878-90bf-45e0-9862-8bb2a14e7d2f req-0f5a2882-9ffb-4a15-9fed-911a57708373 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.165&port_id=3ae73679-d198-440a-966c-619a9930fbcb HTTP/1.1" status: 200 len: 217 time: 0.2784548 May 12 15:13:01.786354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:01.787211 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:01.844580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:01.887106 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9321c6b6-5154-449c-b241-4af98861cdfd req-b5c58c87-645e-4a42-8ff7-d46a8076a262 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.4081273 May 12 15:13:01.908722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Request body: {'port': {'device_id': '93d3a473-9471-49cf-b0d7-802129d2ab04', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:01.912590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:01.915539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:01.918379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c79b13fc-2b5d-41ae-b14a-1092d3797c39 None None] Port 451b695f-17f0-4d54-8214-37e3ab72567c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:13:01.943408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a72967a-7dde-440a-8580-5c99e0a804a0 req-91c9d3dd-ad0f-48ac-acf0-8877a7f7e674 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:01.943841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a72967a-7dde-440a-8580-5c99e0a804a0 req-91c9d3dd-ad0f-48ac-acf0-8877a7f7e674 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:01.944301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a72967a-7dde-440a-8580-5c99e0a804a0 req-91c9d3dd-ad0f-48ac-acf0-8877a7f7e674 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:01.951844 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6a72967a-7dde-440a-8580-5c99e0a804a0 req-91c9d3dd-ad0f-48ac-acf0-8877a7f7e674 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2870 time: 0.4235678 May 12 15:13:01.952091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] No DVR routers for this DVR port a3c95caf-bb88-467f-88c0-e38ce2f7b5ff on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:13:01.952091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d0652e0-2948-4989-b569-14b49fa9ee73 req-03a8c5c8-593d-491c-ba3a-3cbe3d9bd86c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:01.953681 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d0652e0-2948-4989-b569-14b49fa9ee73 req-03a8c5c8-593d-491c-ba3a-3cbe3d9bd86c service neutron] 10.222.0.76 "GET /v2.0/subnets?id=b6cc6b5a-d56a-4336-afb7-99232d9672dc HTTP/1.1" status: 200 len: 855 time: 0.6831582 May 12 15:13:01.956737 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:01.959703 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:01.973798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '654cac47-c40b-4d9d-a71f-dbbed18b9333', 'name': 'network-vif-deleted', 'tag': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:02.016376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Deleting port 2694e8ad-2c96-4f58-b898-cb226cd91d63 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:02.016750 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:02.070976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d0652e0-2948-4989-b569-14b49fa9ee73 req-3e8ad454-6bad-4cd5-b39b-1efe48c31fa6 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=079240cc-25ba-4ba4-a3b0-412d897b19bb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0817945 May 12 15:13:02.071659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'Port': ['ID=f870e17a-1996-41a8-bb25-d9cef52647e3,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:02.097425 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6a72967a-7dde-440a-8580-5c99e0a804a0 req-e9b00c9f-1ae1-468a-ad1e-0f24575e18c8 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1416619 May 12 15:13:02.111592 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-17ea6329-88b3-4966-a42d-3d0099343426 req-4aa122a5-29b3-497f-b8c3-e0b492ad7b2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.76 "DELETE /v2.0/ports/a3c95caf-bb88-467f-88c0-e38ce2f7b5ff HTTP/1.1" status: 204 len: 173 time: 6.0730624 May 12 15:13:02.122730 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:02.130684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86145878-90bf-45e0-9862-8bb2a14e7d2f req-54e6a8bc-4fe1-45bb-8e6d-e5ca11785343 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:02.132396 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86145878-90bf-45e0-9862-8bb2a14e7d2f req-54e6a8bc-4fe1-45bb-8e6d-e5ca11785343 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2905104 May 12 15:13:02.167333 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:02.216627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74a6ebca-9e59-4d21-a991-6ba638c4ff94 None None] DHCP port deletion for cb55ee6d-0282-4fd1-b7e7-3686cea611b9 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:13:02.224276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-74a6ebca-9e59-4d21-a991-6ba638c4ff94 None None] Deleting port 2694e8ad-2c96-4f58-b898-cb226cd91d63 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:02.224718 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-74a6ebca-9e59-4d21-a991-6ba638c4ff94 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:02.327157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7902a57a-3494-44c2-b878-636523b9b967 req-99ee0827-480a-4c7a-ad9c-af878995a81e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:02.335329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7902a57a-3494-44c2-b878-636523b9b967 req-99ee0827-480a-4c7a-ad9c-af878995a81e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 944 time: 0.7405865 May 12 15:13:02.370100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3256112a-5699-4f1f-b95a-19835faf75c3 req-0bdbb4ec-1ef3-4e9e-ab97-4e89c8d20394 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:02.378448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3256112a-5699-4f1f-b95a-19835faf75c3 req-0bdbb4ec-1ef3-4e9e-ab97-4e89c8d20394 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=93d3a473-9471-49cf-b0d7-802129d2ab04 HTTP/1.1" status: 200 len: 935 time: 0.6442158 May 12 15:13:02.409062 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:02.452753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d0652e0-2948-4989-b569-14b49fa9ee73 req-afbed306-f48d-4e5b-a363-583538d8b670 service neutron] 10.222.0.76 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3652704 May 12 15:13:02.534102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7902a57a-3494-44c2-b878-636523b9b967 req-69ca985c-5a8d-4c3a-ba82-e5c5a2ae086e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1980159 May 12 15:13:02.572733 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2694e8ad-2c96-4f58-b898-cb226cd91d63 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:02.594229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] For port 2694e8ad-2c96-4f58-b898-cb226cd91d63, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2694e8ad-2c96-4f58-b898-cb226cd91d63,segment=NetworkSegment(d6eafc19-f9db-4010-b69b-58d99283bc6a),segment_id=d6eafc19-f9db-4010-b69b-58d99283bc6a)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:02.594589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:02.598253 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:13:02.610502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['b6035326-cd91-47d7-8a65-cc2dd3d1d127'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:02.665329 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:02.693089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3256112a-5699-4f1f-b95a-19835faf75c3 req-bf786e8d-ad79-4461-adb4-20e8b8cbdc31 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3135920 May 12 15:13:02.713490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-74a6ebca-9e59-4d21-a991-6ba638c4ff94 None None] For port 2694e8ad-2c96-4f58-b898-cb226cd91d63, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2694e8ad-2c96-4f58-b898-cb226cd91d63,segment=NetworkSegment(d6eafc19-f9db-4010-b69b-58d99283bc6a),segment_id=d6eafc19-f9db-4010-b69b-58d99283bc6a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:02.713950 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-74a6ebca-9e59-4d21-a991-6ba638c4ff94 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:02.756885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Calling delete_port for 2694e8ad-2c96-4f58-b898-cb226cd91d63 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:02.900234 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:02.929181 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] It took 0.22 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:13:02.963859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-74a6ebca-9e59-4d21-a991-6ba638c4ff94 None None] Calling delete_port for 2694e8ad-2c96-4f58-b898-cb226cd91d63 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:02.972285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86145878-90bf-45e0-9862-8bb2a14e7d2f req-543ccf93-8f47-4790-939a-aeecbc5a8c67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:02.973756 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86145878-90bf-45e0-9862-8bb2a14e7d2f req-543ccf93-8f47-4790-939a-aeecbc5a8c67 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.7833099 May 12 15:13:02.993432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Pushing event deleted for resources: {'Port': ['ID=2694e8ad-2c96-4f58-b898-cb226cd91d63,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:02.995191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] No DVR routers for this DVR port 2694e8ad-2c96-4f58-b898-cb226cd91d63 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:13:03.100116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No active binding found for port 2694e8ad-2c96-4f58-b898-cb226cd91d63 {{(pid=88153) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:224}} May 12 15:13:03.100516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2694e8ad-2c96-4f58-b898-cb226cd91d63 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:03.145042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.180919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 451b695f-17f0-4d54-8214-37e3ab72567c {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:03.189502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cb55ee6d-0282-4fd1-b7e7-3686cea611b9']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:03.197717 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.220011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d0652e0-2948-4989-b569-14b49fa9ee73 req-faf6d099-d905-43b4-9548-66f18785746e service neutron] 10.222.0.76 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7288651 May 12 15:13:03.225937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd6eafc19-f9db-4010-b69b-58d99283bc6a') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:03.226177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd6eafc19-f9db-4010-b69b-58d99283bc6a') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:03.257018 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86145878-90bf-45e0-9862-8bb2a14e7d2f req-2c2e5d8b-7a5a-4453-aec1-8a50f62f132b service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2310414 May 12 15:13:03.259163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.280267 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-74a6ebca-9e59-4d21-a991-6ba638c4ff94 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:13:03.280902 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-74a6ebca-9e59-4d21-a991-6ba638c4ff94 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:13:03.283421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Transition to ACTIVE for port object 451b695f-17f0-4d54-8214-37e3ab72567c will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:03.285428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:03.305163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.343483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6', 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb', 'port_id': '79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6', 'mac_address': 'fa:16:3e:7f:be:35', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 573, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b6cc6b5a-d56a-4336-afb7-99232d9672dc', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:13:03.413468 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.416344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Pushing event updated for resources: {'Port': ['ID=451b695f-17f0-4d54-8214-37e3ab72567c,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:03.454548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-bfed2741-f8a5-4f2b-a46e-0f3c000e0a89 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:03.456022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-bfed2741-f8a5-4f2b-a46e-0f3c000e0a89 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.5324290 May 12 15:13:03.471340 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.501587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Releasing vlan 596 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:13:03.501995 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: timer() May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:13:03.517992 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:13:03.534947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44cf9f67-2211-4ece-b02e-43bbf4a7d08f req-188b875c-b781-410a-bf3a-af65610dd698 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:03.541644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44cf9f67-2211-4ece-b02e-43bbf4a7d08f req-188b875c-b781-410a-bf3a-af65610dd698 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:03.548778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44cf9f67-2211-4ece-b02e-43bbf4a7d08f req-188b875c-b781-410a-bf3a-af65610dd698 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:03.556862 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44cf9f67-2211-4ece-b02e-43bbf4a7d08f req-188b875c-b781-410a-bf3a-af65610dd698 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2417 time: 0.8607259 May 12 15:13:03.564632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:03.587811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:03.597214 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.597494 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-15112c44-84d5-4501-bd64-1b8f8ce797f4 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/quotas/593ec496e5db4078be8dc940596be321 HTTP/1.1" status: 200 len: 375 time: 0.1205802 May 12 15:13:03.692986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:03.745681 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.777303 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.782386 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-74a6ebca-9e59-4d21-a991-6ba638c4ff94 None None] Deleting port 2694e8ad-2c96-4f58-b898-cb226cd91d63 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:03.782808 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-74a6ebca-9e59-4d21-a991-6ba638c4ff94 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.817138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.839992 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.843202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44cf9f67-2211-4ece-b02e-43bbf4a7d08f req-df26a6ae-b8b8-4a79-a4cb-8182a62ff790 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2854836 May 12 15:13:03.853606 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86145878-90bf-45e0-9862-8bb2a14e7d2f req-21fc0d03-c8b7-42bc-ad6d-fe4390efbcdb service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5773981 May 12 15:13:03.853949 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-74a6ebca-9e59-4d21-a991-6ba638c4ff94 None None] The port '2694e8ad-2c96-4f58-b898-cb226cd91d63' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:13:03.857843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] Pushing event deleted for resources: {'Network': ['ID=cb55ee6d-0282-4fd1-b7e7-3686cea611b9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:03.880456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:03.894542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Attempting to bind port 451b695f-17f0-4d54-8214-37e3ab72567c on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:03.894869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Attempting to bind port 451b695f-17f0-4d54-8214-37e3ab72567c by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:03.895305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Attempting to bind port 451b695f-17f0-4d54-8214-37e3ab72567c on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:03.900397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Port 451b695f-17f0-4d54-8214-37e3ab72567c on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:13:03.900647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Attempting to bind port 451b695f-17f0-4d54-8214-37e3ab72567c on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:03.906874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:03.907220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:03.908000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:03.908000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Bound port: 451b695f-17f0-4d54-8214-37e3ab72567c, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:03.908356 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.925710 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-484efe1f-46b5-42f3-9c0a-8383d570f79e admin admin] 10.222.0.82 "DELETE /v2.0/networks/cb55ee6d-0282-4fd1-b7e7-3686cea611b9 HTTP/1.1" status: 204 len: 168 time: 2.1786816 May 12 15:13:03.932822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'Port': ['ID=f870e17a-1996-41a8-bb25-d9cef52647e3,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:03.960286 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-5bb1064c-023d-4917-a53f-0d5127a533f7 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&fields=id HTTP/1.1" status: 200 len: 255 time: 0.3617225 May 12 15:13:03.962153 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:03.986511 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d418cc46-ee78-442b-be19-dfd19acb4f84'] response: {'server_uuid': '654cac47-c40b-4d9d-a71f-dbbed18b9333', 'name': 'network-vif-deleted', 'tag': 'a3c95caf-bb88-467f-88c0-e38ce2f7b5ff', 'status': 'completed', 'code': 200} May 12 15:13:04.043118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] For port 451b695f-17f0-4d54-8214-37e3ab72567c, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:04.047196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] For port 451b695f-17f0-4d54-8214-37e3ab72567c, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=451b695f-17f0-4d54-8214-37e3ab72567c,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:04.059745 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:04.105926 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:04.107557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-46dce3f6-c434-49a2-913d-42a77a286f23 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 6.0887105 May 12 15:13:04.175536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52742) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:04.223633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Pushing event updated for resources: {'Port': ['ID=451b695f-17f0-4d54-8214-37e3ab72567c,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:04.243567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:04.244220 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:04.246640 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9321c6b6-5154-449c-b241-4af98861cdfd req-0112f08b-ccfa-4a1e-a206-afc8e034bfdf service neutron] 10.222.0.76 "PUT /v2.0/ports/451b695f-17f0-4d54-8214-37e3ab72567c HTTP/1.1" status: 200 len: 1095 time: 2.3458476 May 12 15:13:04.247161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '93d3a473-9471-49cf-b0d7-802129d2ab04', 'tag': '451b695f-17f0-4d54-8214-37e3ab72567c'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:04.268113 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-fb4c87ce-2ae2-4b9e-a1c8-8fd1b3fe8981 service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2912354 May 12 15:13:04.328193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b64caf03-59b5-4dcd-8735-1a728cab1475 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4c3ee180ddb64a8685bd55247106d4cb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1514373 May 12 15:13:04.331307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52748) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:04.437694 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-864a76d3-9d3c-418b-85ca-b6e87b6b1d9a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:04.477204 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-864a76d3-9d3c-418b-85ca-b6e87b6b1d9a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:04.485929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-4ad3bc5d-40a7-471d-bc46-159e6a906624 service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2169316 May 12 15:13:04.489738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9321c6b6-5154-449c-b241-4af98861cdfd req-f2c73115-ca92-4c92-9247-c01e0ae997db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:04.492145 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9321c6b6-5154-449c-b241-4af98861cdfd req-f2c73115-ca92-4c92-9247-c01e0ae997db service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=93d3a473-9471-49cf-b0d7-802129d2ab04 HTTP/1.1" status: 200 len: 1098 time: 0.1988199 May 12 15:13:04.494494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de93833a-6bf2-415d-a4c1-7e5f77ea8c81 req-36bfb7b4-a261-4e40-9230-2189dd6ae5d0 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:04.504005 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de93833a-6bf2-415d-a4c1-7e5f77ea8c81 req-36bfb7b4-a261-4e40-9230-2189dd6ae5d0 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 1096 time: 0.3102789 May 12 15:13:04.544073 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de93833a-6bf2-415d-a4c1-7e5f77ea8c81 req-00f5c088-beeb-4525-8acc-2e3cb20ff916 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391212 May 12 15:13:04.591288 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9321c6b6-5154-449c-b241-4af98861cdfd req-dddcbfc3-128a-4e23-b661-dd5eaca89c3a service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.73&port_id=451b695f-17f0-4d54-8214-37e3ab72567c HTTP/1.1" status: 200 len: 217 time: 0.0888700 May 12 15:13:04.685567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9321c6b6-5154-449c-b241-4af98861cdfd req-6eab0d3d-0b02-4d85-8e5c-908f526f0181 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:04.687251 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9321c6b6-5154-449c-b241-4af98861cdfd req-6eab0d3d-0b02-4d85-8e5c-908f526f0181 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0817447 May 12 15:13:04.692651 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-864a76d3-9d3c-418b-85ca-b6e87b6b1d9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:04.758092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-864a76d3-9d3c-418b-85ca-b6e87b6b1d9a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=96195734-f583-4ac7-afd4-4d30a68ea7fe,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:04.785223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-864a76d3-9d3c-418b-85ca-b6e87b6b1d9a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:04.786777 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-864a76d3-9d3c-418b-85ca-b6e87b6b1d9a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/96195734-f583-4ac7-afd4-4d30a68ea7fe HTTP/1.1" status: 204 len: 168 time: 0.4543369 May 12 15:13:04.817190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9321c6b6-5154-449c-b241-4af98861cdfd req-e0f74131-141e-4e3a-a5c6-b5c617905c25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:04.819268 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9321c6b6-5154-449c-b241-4af98861cdfd req-e0f74131-141e-4e3a-a5c6-b5c617905c25 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1208060 May 12 15:13:04.860469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b70fb704-dd5a-4a25-b222-4aa343373db7 req-52eb0e62-b3a2-457b-9147-289ea2b91733 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:04.862022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b70fb704-dd5a-4a25-b222-4aa343373db7 req-52eb0e62-b3a2-457b-9147-289ea2b91733 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 945 time: 0.1748738 May 12 15:13:04.896128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e84a55d7-67ff-4154-8a9b-c9974eb935f8 req-8618099b-5c97-4298-a41e-2ab138680182 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:04.897654 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e84a55d7-67ff-4154-8a9b-c9974eb935f8 req-8618099b-5c97-4298-a41e-2ab138680182 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=93d3a473-9471-49cf-b0d7-802129d2ab04 HTTP/1.1" status: 200 len: 947 time: 0.1326287 May 12 15:13:04.948336 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b70fb704-dd5a-4a25-b222-4aa343373db7 req-b9f4999c-9d93-423c-8907-1852ce8bfb5a tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0779579 May 12 15:13:04.992855 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e84a55d7-67ff-4154-8a9b-c9974eb935f8 req-63b172bb-adb1-4b10-bb94-1d745f741e0a tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786018 May 12 15:13:05.002722 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9321c6b6-5154-449c-b241-4af98861cdfd req-cc5a7c2b-1668-459e-9cf5-fe8b4befe3a5 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1751356 May 12 15:13:05.061434 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fd9d0ef1-514d-4727-87ac-fb10291621c0'] response: {'name': 'network-changed', 'server_uuid': '93d3a473-9471-49cf-b0d7-802129d2ab04', 'tag': '451b695f-17f0-4d54-8214-37e3ab72567c', 'status': 'completed', 'code': 200} May 12 15:13:05.225405 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-c9f22c0b-7a02-4344-af10-b29296b01084 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Synchronizing usage tracker for tenant:05b4f1ce61294fb29efb0a765ed28561 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:05.250759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-c9f22c0b-7a02-4344-af10-b29296b01084 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Unset dirty status for tenant:05b4f1ce61294fb29efb0a765ed28561 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:05.254630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-c9f22c0b-7a02-4344-af10-b29296b01084 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1104440069&fields=id&tenant_id=05b4f1ce61294fb29efb0a765ed28561 HTTP/1.1" status: 200 len: 267 time: 0.0918620 May 12 15:13:05.267114 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9321c6b6-5154-449c-b241-4af98861cdfd req-67136cdc-a07f-499d-8411-70b578ccd46b service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2557709 May 12 15:13:05.362155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-dd9654db-fa97-48e2-ab08-e981e5275d84 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:05.368903 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-dd9654db-fa97-48e2-ab08-e981e5275d84 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports/d96ca9ce-4a19-49f0-bef3-e0e31ace478a HTTP/1.1" status: 200 len: 935 time: 0.1060181 May 12 15:13:05.463044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc047a4c-7ec2-465b-a549-d528572a9017 req-a43731a5-6d5d-49eb-9c12-9fe3e441047c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:05.464571 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc047a4c-7ec2-465b-a549-d528572a9017 req-a43731a5-6d5d-49eb-9c12-9fe3e441047c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=93d3a473-9471-49cf-b0d7-802129d2ab04 HTTP/1.1" status: 200 len: 1098 time: 0.1312962 May 12 15:13:05.642253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc047a4c-7ec2-465b-a549-d528572a9017 req-c04001ad-4bad-4891-9b1a-a1c0c7b3beb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:05.643757 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc047a4c-7ec2-465b-a549-d528572a9017 req-c04001ad-4bad-4891-9b1a-a1c0c7b3beb2 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.1686585 May 12 15:13:05.669985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1126daa-fe73-4157-b046-93ab5d59fe91 req-543743df-1b72-432b-b57a-ced9fecd3981 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 210 time: 0.2081485 May 12 15:13:05.692894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-45d57031-1f81-4352-a442-d6bf34412005 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:05.692894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-45d57031-1f81-4352-a442-d6bf34412005 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports/be802a6d-cca9-42fd-bdc5-6c9f78035217 HTTP/1.1" status: 200 len: 937 time: 0.3218682 May 12 15:13:05.739722 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc047a4c-7ec2-465b-a549-d528572a9017 req-f4efcffc-bd41-4ebe-8b36-4f95aa3c7b1d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.73&port_id=451b695f-17f0-4d54-8214-37e3ab72567c HTTP/1.1" status: 200 len: 217 time: 0.0811088 May 12 15:13:05.798698 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-4b77cc5e-d63c-4d22-8c74-228a25ec4739 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?network_id=187794df-e6cb-4ee3-8b40-6b546c229bd2&fixed_ips=ip_address%3D10.2.2.100&fields=device_id HTTP/1.1" status: 200 len: 210 time: 0.0735395 May 12 15:13:05.815015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc047a4c-7ec2-465b-a549-d528572a9017 req-8b3f7e38-f1f6-431f-8a38-ae27ff50a0f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:05.816343 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc047a4c-7ec2-465b-a549-d528572a9017 req-8b3f7e38-f1f6-431f-8a38-ae27ff50a0f4 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0701768 May 12 15:13:05.879784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52810) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:05.900842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc047a4c-7ec2-465b-a549-d528572a9017 req-6b1783e4-b582-4edf-a96e-77f7b04906a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:05.902666 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc047a4c-7ec2-465b-a549-d528572a9017 req-6b1783e4-b582-4edf-a96e-77f7b04906a9 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.0796392 May 12 15:13:05.941684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-d07faf1e-5dbe-4467-b161-34936f31c438 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?network_id=187794df-e6cb-4ee3-8b40-6b546c229bd2&fixed_ips=ip_address%3D10.2.2.200&fields=device_id HTTP/1.1" status: 200 len: 210 time: 0.1380093 May 12 15:13:06.004331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Request body: {'network': {'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2100763337-network', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:06.011834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:06.019880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Usage tracker for resource:network and tenant:1469be66fea349e29c86f5666f6e4b1f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:06.032109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:06.041268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:06.064351 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc047a4c-7ec2-465b-a549-d528572a9017 req-8ea523fc-cbbf-4fe7-990a-e38481cc1282 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1553898 May 12 15:13:06.065832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Made reservation on behalf of 1469be66fea349e29c86f5666f6e4b1f for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:06.068131 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:06.098308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-944ada7d-4255-49d1-acef-dd8d90603229 req-f3cd6f3d-7d17-4419-a403-bc97fc4b73b4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:06.099065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-944ada7d-4255-49d1-acef-dd8d90603229 req-f3cd6f3d-7d17-4419-a403-bc97fc4b73b4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Synchronizing usage tracker for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:06.108150 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:06.117651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-4bb637ac-af25-41ac-9b49-b29456756e5a tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:06.119165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-4bb637ac-af25-41ac-9b49-b29456756e5a tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 808 time: 0.3200831 May 12 15:13:06.196202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-1684f28a-a54c-4aec-8a36-d289c5d4ab67 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/quotas/68c66ae0cd45476b87e2e79625b80f69 HTTP/1.1" status: 200 len: 375 time: 0.0674357 May 12 15:13:06.196783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-944ada7d-4255-49d1-acef-dd8d90603229 req-f3cd6f3d-7d17-4419-a403-bc97fc4b73b4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Unset dirty status for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:06.197793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-944ada7d-4255-49d1-acef-dd8d90603229 req-f3cd6f3d-7d17-4419-a403-bc97fc4b73b4 tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.76 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 950 time: 0.5264847 May 12 15:13:06.274279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:06.287088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Usage tracker for resource:security_group_rule and tenant:1469be66fea349e29c86f5666f6e4b1f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:06.291495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:06.300307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:06.365888 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc047a4c-7ec2-465b-a549-d528572a9017 req-4bea9b46-fe6c-4ec1-a10d-147a7d7f9fa3 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2883227 May 12 15:13:06.367010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-243953cd-242c-4424-8bc6-eec2045bd698 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:06.373033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-243953cd-242c-4424-8bc6-eec2045bd698 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:06.378759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-243953cd-242c-4424-8bc6-eec2045bd698 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:06.379573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-243953cd-242c-4424-8bc6-eec2045bd698 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Synchronizing usage tracker for tenant:05b4f1ce61294fb29efb0a765ed28561 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:06.431363 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:06.436321 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:06.451353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-944ada7d-4255-49d1-acef-dd8d90603229 req-aa6d71dd-c0dc-4204-b2d8-12546c1328ed tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Deleting port b6035326-cd91-47d7-8a65-cc2dd3d1d127 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:06.451738 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-944ada7d-4255-49d1-acef-dd8d90603229 req-aa6d71dd-c0dc-4204-b2d8-12546c1328ed tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:06.471143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 572} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:13:06.476391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e111c4b-1113-4087-a7d2-6eb288fd40e0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:06.484438 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:06.484759 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Added segment 76d93afe-dbed-4578-bf3e-884ce482db6b of type vlan for network 32cea943-7534-489c-b9f1-17a345bb2737 May 12 15:13:06.489868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-243953cd-242c-4424-8bc6-eec2045bd698 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Unset dirty status for tenant:05b4f1ce61294fb29efb0a765ed28561 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:06.493853 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-243953cd-242c-4424-8bc6-eec2045bd698 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/networks?id=13468259-dd20-42ac-88ec-2614ebea6ccc&id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&id=187794df-e6cb-4ee3-8b40-6b546c229bd2&id=187794df-e6cb-4ee3-8b40-6b546c229bd2 HTTP/1.1" status: 200 len: 1995 time: 0.5409205 May 12 15:13:06.513575 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:06.520187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:06.550009 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:06.550952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:06.552537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-718a3cf7-231d-4edf-9d8a-f0ff6ba4b69d tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:06.552752 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:06.553980 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-718a3cf7-231d-4edf-9d8a-f0ff6ba4b69d tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.3980942 May 12 15:13:06.558977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e2b84767-1955-4601-ad45-2d8fb1ed657c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/quotas/05b4f1ce61294fb29efb0a765ed28561 HTTP/1.1" status: 200 len: 375 time: 0.0542259 May 12 15:13:06.594971 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:06.599925 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:06.600549 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:06.603207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Request body: {'port': {'device_id': '7c4eb2cc-a1cc-47ef-915b-beb583a717ed', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'admin_state_up': True, 'tenant_id': '593ec496e5db4078be8dc940596be321'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:06.665622 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.7847810 May 12 15:13:06.668425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52820) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:06.672025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15453140-9b87-4b98-aeb9-3383e81b133e admin admin] Pushing event updated for resources: {'Network': ['ID=32cea943-7534-489c-b9f1-17a345bb2737,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:06.678201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Request body: {'subnet': {'network_id': '32cea943-7534-489c-b9f1-17a345bb2737', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2100763337-subnet', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:06.684151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:06.688589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Usage tracker for resource:subnet and tenant:1469be66fea349e29c86f5666f6e4b1f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:06.692388 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:06.699234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:06.703525 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 32cea943-7534-489c-b9f1-17a345bb2737 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:13:06.710345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Made reservation on behalf of 1469be66fea349e29c86f5666f6e4b1f for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:06.713089 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:06.756197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-9795f0d8-0970-47d3-814d-07777a094fc2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&fields=id HTTP/1.1" status: 200 len: 302 time: 0.5058305 May 12 15:13:06.811725 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:06.852655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '93f69d1e-0068-4634-b7ad-70f7710d8470', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:06.862664 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:06.867308 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:06.941148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:06.942542 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.023720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Pushing event updated for resources: {'Subnet': ['ID=f287ffea-ab95-43b4-beb2-c0a16496b6b3,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:07.033274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Checking segment: {'id': '76d93afe-dbed-4578-bf3e-884ce482db6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '32cea943-7534-489c-b9f1-17a345bb2737'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:07.033654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Network hostable DHCP agents. Network: 32cea943-7534-489c-b9f1-17a345bb2737, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:13:07.053060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Network 32cea943-7534-489c-b9f1-17a345bb2737 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:13:07.064503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 32cea943-7534-489c-b9f1-17a345bb2737) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:07.070098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:07.070677 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.078392 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e125c02b-a0fa-4b14-b16d-d0325bb6155a None None] Network 32cea943-7534-489c-b9f1-17a345bb2737 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:13:07.102322 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a06304d0-3e14-4a11-8d4f-683eb9e6492b admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 860 time: 0.4293141 May 12 15:13:07.102556 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-98f5481b-5c54-4422-8b39-94381416eb19 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=05b4f1ce61294fb29efb0a765ed28561&fields=id HTTP/1.1" status: 200 len: 532 time: 0.5082331 May 12 15:13:07.102556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:07.102785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52828) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:07.108341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Request body: {'router': {'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2100763337-router', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:07.114120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:07.118029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Usage tracker for resource:router and tenant:1469be66fea349e29c86f5666f6e4b1f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:07.119518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Usage tracker for resource:port and tenant:593ec496e5db4078be8dc940596be321 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:07.121135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:07.126683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:07.127426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:07.140003 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.141125 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.159790 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.165615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:07.329907 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-32cea943-7534-489c-b9f1-17a345bb2737', 'network_id': '32cea943-7534-489c-b9f1-17a345bb2737', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'fixed_ips': [{'subnet_id': 'f287ffea-ab95-43b4-beb2-c0a16496b6b3'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:13:07.330866 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.358103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-69fae8f7-b022-4441-a6bc-2a888e640a96 service neutron] 10.222.0.82 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5891542 May 12 15:13:07.367244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-944ada7d-4255-49d1-acef-dd8d90603229 req-aa6d71dd-c0dc-4204-b2d8-12546c1328ed tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] For port b6035326-cd91-47d7-8a65-cc2dd3d1d127, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b6035326-cd91-47d7-8a65-cc2dd3d1d127,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:07.367602 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-944ada7d-4255-49d1-acef-dd8d90603229 req-aa6d71dd-c0dc-4204-b2d8-12546c1328ed tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.446985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.504300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Allocated IP 172.20.0.2 (32cea943-7534-489c-b9f1-17a345bb2737/f287ffea-ab95-43b4-beb2-c0a16496b6b3/da71c1e6-e964-4162-8d94-2826a1af675e) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:07.539534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-944ada7d-4255-49d1-acef-dd8d90603229 req-aa6d71dd-c0dc-4204-b2d8-12546c1328ed tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Calling delete_port for b6035326-cd91-47d7-8a65-cc2dd3d1d127 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:07.567099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Made reservation on behalf of 593ec496e5db4078be8dc940596be321 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:07.570507 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.737456 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.751242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Transition to ACTIVE for port object da71c1e6-e964-4162-8d94-2826a1af675e will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:07.773045 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.774203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Transition to ACTIVE for port object da71c1e6-e964-4162-8d94-2826a1af675e will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:07.781500 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.786644 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-8de20865-b92a-40aa-96a9-9bf0a5edafd6 service neutron] 10.222.0.82 "GET /v2.0/networks/13468259-dd20-42ac-88ec-2614ebea6ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6613736 May 12 15:13:07.804619 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.849128 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Network 32cea943-7534-489c-b9f1-17a345bb2737 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:07.859147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:07.860758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:07.936234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Pushing event updated for resources: {'Port': ['ID=da71c1e6-e964-4162-8d94-2826a1af675e,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:07.964723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Allocated IP 172.25.8.243 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/218a3a16-e45c-495a-b212-a765f6e26b32) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:07.969357 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Attempting to bind port da71c1e6-e964-4162-8d94-2826a1af675e on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:07.969724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Attempting to bind port da71c1e6-e964-4162-8d94-2826a1af675e by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '76d93afe-dbed-4578-bf3e-884ce482db6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '32cea943-7534-489c-b9f1-17a345bb2737'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:07.970207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Attempting to bind port da71c1e6-e964-4162-8d94-2826a1af675e on network 32cea943-7534-489c-b9f1-17a345bb2737 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:07.975434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:07.976272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Checking segment: {'id': '76d93afe-dbed-4578-bf3e-884ce482db6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '32cea943-7534-489c-b9f1-17a345bb2737'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:07.976272 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.976565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Bound using segment: {'id': '76d93afe-dbed-4578-bf3e-884ce482db6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '32cea943-7534-489c-b9f1-17a345bb2737'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:07.976992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Bound port: da71c1e6-e964-4162-8d94-2826a1af675e, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '76d93afe-dbed-4578-bf3e-884ce482db6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '32cea943-7534-489c-b9f1-17a345bb2737'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:07.977509 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:07.979881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-f5a1021b-cd72-4341-99bf-84cc5213e180 service neutron] 10.222.0.82 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5962255 May 12 15:13:08.087640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] For port da71c1e6-e964-4162-8d94-2826a1af675e, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:08.094587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] For port da71c1e6-e964-4162-8d94-2826a1af675e, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=da71c1e6-e964-4162-8d94-2826a1af675e,segment=NetworkSegment(76d93afe-dbed-4578-bf3e-884ce482db6b),segment_id=76d93afe-dbed-4578-bf3e-884ce482db6b)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:08.103068 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:08.111419 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-944ada7d-4255-49d1-acef-dd8d90603229 req-aa6d71dd-c0dc-4204-b2d8-12546c1328ed tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:08.147994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['b6035326-cd91-47d7-8a65-cc2dd3d1d127'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:08.250031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa6d71dd-c0dc-4204-b2d8-12546c1328ed tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Pushing event deleted for resources: {'Port': ['ID=b6035326-cd91-47d7-8a65-cc2dd3d1d127,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:08.254662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Allocated IP 172.20.0.6 (dbc2e49c-2591-4534-a48c-cea8e23115f4/84c2082e-f394-46d5-8a8f-8e3a70d54fc1/afe94bd0-1ff9-4d77-b779-c4dc6066222e) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:08.269253 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-5ff14f30-aae0-4cbb-a72b-dfb2b44e272d service neutron] 10.222.0.82 "GET /v2.0/networks/13468259-dd20-42ac-88ec-2614ebea6ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4576576 May 12 15:13:08.358374 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3635dc2-7199-4df8-aa55-8d42685946be None None] Pushing event updated for resources: {'Port': ['ID=da71c1e6-e964-4162-8d94-2826a1af675e,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:08.377361 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:08.442929 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:08.514586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:08.519560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:08.521127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 451b695f-17f0-4d54-8214-37e3ab72567c details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:13:08.522426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:08.537439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-944ada7d-4255-49d1-acef-dd8d90603229 req-aa6d71dd-c0dc-4204-b2d8-12546c1328ed tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] No DVR routers for this DVR port b6035326-cd91-47d7-8a65-cc2dd3d1d127 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:13:08.541492 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-90f0d796-8c40-45ae-b453-74fee9cd108b service neutron] 10.222.0.82 "GET /v2.0/ports/d96ca9ce-4a19-49f0-bef3-e0e31ace478a?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy HTTP/1.1" status: 200 len: 311 time: 0.2682731 May 12 15:13:08.544871 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-944ada7d-4255-49d1-acef-dd8d90603229 req-aa6d71dd-c0dc-4204-b2d8-12546c1328ed tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:08.632016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Pushing event updated for resources: {'Port': ['ID=218a3a16-e45c-495a-b212-a765f6e26b32,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:08.781004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 451b695f-17f0-4d54-8214-37e3ab72567c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=451b695f-17f0-4d54-8214-37e3ab72567c,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:08.798163 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '451b695f-17f0-4d54-8214-37e3ab72567c', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '451b695f-17f0-4d54-8214-37e3ab72567c', 'mac_address': 'fa:16:3e:10:ae:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.73'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:13:08.888506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86881e13-2515-46d4-a5a5-4bc93a1b8647', 'name': 'network-vif-deleted', 'tag': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:08.925697 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:08.954389 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 451b695f-17f0-4d54-8214-37e3ab72567c {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:08.978455 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 451b695f-17f0-4d54-8214-37e3ab72567c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=451b695f-17f0-4d54-8214-37e3ab72567c,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:08.984022 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:09.069904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=451b695f-17f0-4d54-8214-37e3ab72567c,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:09.074967 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-944ada7d-4255-49d1-acef-dd8d90603229 req-aa6d71dd-c0dc-4204-b2d8-12546c1328ed tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.76 "DELETE /v2.0/ports/b6035326-cd91-47d7-8a65-cc2dd3d1d127 HTTP/1.1" status: 204 len: 173 time: 2.8251941 May 12 15:13:09.139490 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:09.197531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea61501-eae8-405d-90f3-0b2d8e2a70e1 req-9276a16f-a45d-4dea-88fc-25fa3206e453 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:09.203845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea61501-eae8-405d-90f3-0b2d8e2a70e1 req-9276a16f-a45d-4dea-88fc-25fa3206e453 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:09.210849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea61501-eae8-405d-90f3-0b2d8e2a70e1 req-9276a16f-a45d-4dea-88fc-25fa3206e453 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:09.219675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bea61501-eae8-405d-90f3-0b2d8e2a70e1 req-9276a16f-a45d-4dea-88fc-25fa3206e453 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2417 time: 0.8134193 May 12 15:13:09.231669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-fa2e5b7f-f1d7-4fc5-944f-03a3338ffeef service neutron] 10.222.0.82 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3228467 May 12 15:13:09.273918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['451b695f-17f0-4d54-8214-37e3ab72567c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:09.295288 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:09.557904 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4918ff9-5dcd-4286-8084-ac82d3ade8d3 service neutron] 10.222.0.82 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3021820 May 12 15:13:09.636912 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bea61501-eae8-405d-90f3-0b2d8e2a70e1 req-c233a6b2-5e99-4389-b5e6-e265e74c9637 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4162693 May 12 15:13:09.667134 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:09.680181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-33793f17-a017-4ef7-821c-20e65ac8bb68 service neutron] 10.222.0.82 "GET /v2.0/ports/be802a6d-cca9-42fd-bdc5-6c9f78035217?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy HTTP/1.1" status: 200 len: 311 time: 0.1083577 May 12 15:13:09.704953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:09.815902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:09.872340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event updated for resources: {'Port': ['ID=afe94bd0-1ff9-4d77-b779-c4dc6066222e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:09.930392 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec346a12-c611-425c-ae72-752ae333f9e7 None None] Network 32cea943-7534-489c-b9f1-17a345bb2737 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:13:10.001813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cc114d2c-ee11-4e77-a1c4-f468d56994f8 req-53396ae3-80fe-43e0-b7cc-c994393cbd2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Synchronizing usage tracker for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:10.005346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Network dbc2e49c-2591-4534-a48c-cea8e23115f4 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:10.015198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:10.019584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:10.100280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cc114d2c-ee11-4e77-a1c4-f468d56994f8 req-53396ae3-80fe-43e0-b7cc-c994393cbd2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] Unset dirty status for tenant:0da54985cde346e68eeadf965b8bc6d3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:10.109342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc114d2c-ee11-4e77-a1c4-f468d56994f8 req-53396ae3-80fe-43e0-b7cc-c994393cbd2c tempest-MigrationsAdminTest-243630016 tempest-MigrationsAdminTest-243630016-project] 10.222.0.82 "GET /v2.0/ports?device_id=86881e13-2515-46d4-a5a5-4bc93a1b8647 HTTP/1.1" status: 200 len: 210 time: 0.2274108 May 12 15:13:10.162324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:10.163173 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:10.168157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-119f8ee5-fe7a-4c64-8408-340137b6fff0 None None] Provisioning for port da71c1e6-e964-4162-8d94-2826a1af675e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:10.220713 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-d17d3797-82b8-4b1f-9b6c-ede8914d0354 service neutron] 10.222.0.82 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4516554 May 12 15:13:10.338827 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-99ba2785-732d-4acb-827c-a3837cc66f23 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.7406523 May 12 15:13:10.363378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-e1c78c8d-2988-4e1b-8ac7-f12a506a3b0e tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:10.364695 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-e1c78c8d-2988-4e1b-8ac7-f12a506a3b0e tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.84 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 808 time: 0.3526063 May 12 15:13:10.374319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Router 8277cf82-93e4-4768-95d6-0b3d971a6c22 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:13:10.387270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Request body: {'port': {'device_id': '42278800-f3f9-433a-9df4-98d9daab30e5', 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28', 'admin_state_up': True, 'tenant_id': '68c66ae0cd45476b87e2e79625b80f69'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:10.403386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Request body: {'port': {'device_id': '7c4eb2cc-a1cc-47ef-915b-beb583a717ed', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:10.489293 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-5044d163-7bbc-44de-a015-01a9938919a0 service neutron] 10.222.0.82 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2549407 May 12 15:13:10.526453 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 451b695f-17f0-4d54-8214-37e3ab72567c up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:10.602076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device da71c1e6-e964-4162-8d94-2826a1af675e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:10.662581 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-555b50d4-1ee8-4fd2-961b-2d159c05a01b req-3ed8b074-e592-4201-9cb9-ea3ce91349a1 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:10.663870 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-555b50d4-1ee8-4fd2-961b-2d159c05a01b req-3ed8b074-e592-4201-9cb9-ea3ce91349a1 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 0.3216429 May 12 15:13:10.667015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 451b695f-17f0-4d54-8214-37e3ab72567c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:10.672716 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:10.678773 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 451b695f-17f0-4d54-8214-37e3ab72567c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:10.679145 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:10.723926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:13:10.736205 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Sync routers for ids ['8277cf82-93e4-4768-95d6-0b3d971a6c22'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:13:10.756915 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Routers {'8277cf82-93e4-4768-95d6-0b3d971a6c22'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:13:10.759873 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:12:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8277cf82-93e4-4768-95d6-0b3d971a6c22'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:10.767446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-471d1496-3f79-469d-9272-a1ebbadbc610 None None] Provisioning complete for port da71c1e6-e964-4162-8d94-2826a1af675e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:10.767814 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-471d1496-3f79-469d-9272-a1ebbadbc610 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:10.780057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:10.783687 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:10.788144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a29fdb38-c563-4129-8b40-337db2b7bf09 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 936 time: 3.6845908 May 12 15:13:10.788905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52846) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:10.801006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port da71c1e6-e964-4162-8d94-2826a1af675e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:10.804953 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-555b50d4-1ee8-4fd2-961b-2d159c05a01b req-eac7578a-bed0-4c37-a7db-10cb329893d2 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1201115 May 12 15:13:10.815439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-2634fe12-a97c-462e-b465-1d6bb24ab438 service neutron] 10.222.0.82 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2856605 May 12 15:13:10.828854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port da71c1e6-e964-4162-8d94-2826a1af675e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:10.829245 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:10.981613 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:11.048701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Usage tracker for resource:port and tenant:68c66ae0cd45476b87e2e79625b80f69 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:11.054778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:11.064700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:11.082634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 451b695f-17f0-4d54-8214-37e3ab72567c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=451b695f-17f0-4d54-8214-37e3ab72567c,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:11.100428 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Set router 8277cf82-93e4-4768-95d6-0b3d971a6c22 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:13:11.140182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-9b44d103-34d4-4b66-9a2e-851a6c89a478 service neutron] 10.222.0.82 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3161249 May 12 15:13:11.140777 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:11.141350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b6035326-cd91-47d7-8a65-cc2dd3d1d127 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:11.170773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Made reservation on behalf of 68c66ae0cd45476b87e2e79625b80f69 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:11.175731 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:11.242635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: b6035326-cd91-47d7-8a65-cc2dd3d1d127 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:13:11.243322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b6035326-cd91-47d7-8a65-cc2dd3d1d127 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:11.285248 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-471d1496-3f79-469d-9272-a1ebbadbc610 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:11.332831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64a61d2f-2e01-4fd4-90f0-5efb7766d365 req-ba67fd76-4427-4edb-86a3-3d2e4915799c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:11.333760 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64a61d2f-2e01-4fd4-90f0-5efb7766d365 req-ba67fd76-4427-4edb-86a3-3d2e4915799c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=93d3a473-9471-49cf-b0d7-802129d2ab04 HTTP/1.1" status: 200 len: 949 time: 0.2677011 May 12 15:13:11.362708 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:11.414824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=451b695f-17f0-4d54-8214-37e3ab72567c,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:11.437115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-471d1496-3f79-469d-9272-a1ebbadbc610 None None] For port da71c1e6-e964-4162-8d94-2826a1af675e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=da71c1e6-e964-4162-8d94-2826a1af675e,segment=NetworkSegment(76d93afe-dbed-4578-bf3e-884ce482db6b),segment_id=76d93afe-dbed-4578-bf3e-884ce482db6b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:11.445969 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-471d1496-3f79-469d-9272-a1ebbadbc610 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:11.478043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Allocated IP 172.20.0.10 (e8211761-0dd9-424f-b732-629fd2d77e28/ed7d4325-c4dc-4592-8d41-1f3fe41da585/c89ed514-64cd-4011-b01a-855ecf2c3a8e) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:11.510029 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-899a0ba2-8db6-4745-bcc8-80e88f7a2e29 service neutron] 10.222.0.82 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3634634 May 12 15:13:11.542792 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2100763337-router', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243'}], 'enable_snat': True}, 'gw_port_id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:09Z', 'revision_number': 3, 'project_id': '1469be66fea349e29c86f5666f6e4b1f', 'gw_port': {'id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:65:07', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'device_owner': 'network:router_gateway', 'standard_attr_id': 934, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:07Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:11.547823 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Checking router: 8277cf82-93e4-4768-95d6-0b3d971a6c22 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:13:11.548401 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Updating router 8277cf82-93e4-4768-95d6-0b3d971a6c22 port 218a3a16-e45c-495a-b212-a765f6e26b32 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:13:11.601811 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:13:11.602591 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:13:11.608757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-471d1496-3f79-469d-9272-a1ebbadbc610 None None] Pushing event updated for resources: {'Port': ['ID=da71c1e6-e964-4162-8d94-2826a1af675e,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:11.617369 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:11.648173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64a61d2f-2e01-4fd4-90f0-5efb7766d365 req-e3f2837e-c228-4f54-be25-19b8fde773c7 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2996619 May 12 15:13:11.666250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id afe94bd0-1ff9-4d77-b779-c4dc6066222e {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:11.677146 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:11.710214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Transition to ACTIVE for port object afe94bd0-1ff9-4d77-b779-c4dc6066222e will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:11.727266 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:11.779027 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-514fb0b4-e03a-4c49-b30a-40fd3dca48ad service neutron] 10.222.0.82 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2567728 May 12 15:13:11.891031 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:11.991303 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:12.004153 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Transition to ACTIVE for port object 218a3a16-e45c-495a-b212-a765f6e26b32 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:12.011754 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:12.021860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Pushing event updated for resources: {'Port': ['ID=afe94bd0-1ff9-4d77-b779-c4dc6066222e,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:12.094629 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Attempting to bind port 218a3a16-e45c-495a-b212-a765f6e26b32 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:12.095496 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Attempting to bind port 218a3a16-e45c-495a-b212-a765f6e26b32 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:12.095496 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Attempting to bind port 218a3a16-e45c-495a-b212-a765f6e26b32 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:12.105055 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:12.105732 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:12.106241 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:12.107426 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:12.108030 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Bound port: 218a3a16-e45c-495a-b212-a765f6e26b32, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:12.108516 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:12.132632 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-091242ac-aad2-404e-8209-774422a6cfd4 None None] Pushing event updated for resources: {'Port': ['ID=218a3a16-e45c-495a-b212-a765f6e26b32,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:12.159130 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-091242ac-aad2-404e-8209-774422a6cfd4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:12.159618 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-091242ac-aad2-404e-8209-774422a6cfd4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:12.160048 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-091242ac-aad2-404e-8209-774422a6cfd4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:12.160484 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-091242ac-aad2-404e-8209-774422a6cfd4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:12.161202 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-091242ac-aad2-404e-8209-774422a6cfd4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:12.161647 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-091242ac-aad2-404e-8209-774422a6cfd4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:12.162067 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-091242ac-aad2-404e-8209-774422a6cfd4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:12.162481 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-091242ac-aad2-404e-8209-774422a6cfd4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:12.162919 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-091242ac-aad2-404e-8209-774422a6cfd4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:12.163333 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-091242ac-aad2-404e-8209-774422a6cfd4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:12.163745 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-091242ac-aad2-404e-8209-774422a6cfd4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:12.164154 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-091242ac-aad2-404e-8209-774422a6cfd4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:12.173731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32948014-2490-44ba-b7f8-82aad1c81b86 req-e7559076-7a2d-46b6-99d1-3eef0f38f3dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:12.174458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-32948014-2490-44ba-b7f8-82aad1c81b86 req-e7559076-7a2d-46b6-99d1-3eef0f38f3dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Synchronizing usage tracker for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:12.195809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-c7954ea6-8ff1-4533-b56f-c3d2bff7d9f3 service neutron] 10.222.0.82 "GET /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3638358 May 12 15:13:12.197890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Attempting to bind port afe94bd0-1ff9-4d77-b779-c4dc6066222e on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:12.198216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Attempting to bind port afe94bd0-1ff9-4d77-b779-c4dc6066222e by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:12.198545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Attempting to bind port afe94bd0-1ff9-4d77-b779-c4dc6066222e on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:12.232398 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Port afe94bd0-1ff9-4d77-b779-c4dc6066222e on network dbc2e49c-2591-4534-a48c-cea8e23115f4 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:13:12.232814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Attempting to bind port afe94bd0-1ff9-4d77-b779-c4dc6066222e on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:12.240892 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] For port 218a3a16-e45c-495a-b212-a765f6e26b32, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:12.249864 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:12.253114 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] For port 218a3a16-e45c-495a-b212-a765f6e26b32, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=218a3a16-e45c-495a-b212-a765f6e26b32,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:12.261647 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:12.265333 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:12.289026 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-32948014-2490-44ba-b7f8-82aad1c81b86 req-e7559076-7a2d-46b6-99d1-3eef0f38f3dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Unset dirty status for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:12.290193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32948014-2490-44ba-b7f8-82aad1c81b86 req-e7559076-7a2d-46b6-99d1-3eef0f38f3dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 943 time: 0.4594548 May 12 15:13:12.290888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 12, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:12.291442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Checking segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:12.291994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Bound using segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:12.292583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Bound port: afe94bd0-1ff9-4d77-b779-c4dc6066222e, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:12.293099 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:12.360539 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-091242ac-aad2-404e-8209-774422a6cfd4 None None] Pushing event updated for resources: {'Port': ['ID=218a3a16-e45c-495a-b212-a765f6e26b32,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:12.383808 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Routers {'8277cf82-93e4-4768-95d6-0b3d971a6c22'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:13:12.384547 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:12:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8277cf82-93e4-4768-95d6-0b3d971a6c22'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:12.386984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Network e8211761-0dd9-424f-b732-629fd2d77e28 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:12.427293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:12.429707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32948014-2490-44ba-b7f8-82aad1c81b86 req-e56d2b45-7055-4c46-b45e-d1bcd1026d2a tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1264765 May 12 15:13:12.443809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:12.478325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-3377e03b-0b02-4329-af18-83ae020192d6 service neutron] 10.222.0.82 "GET /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2732487 May 12 15:13:12.514561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device da71c1e6-e964-4162-8d94-2826a1af675e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:12.523768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] For port afe94bd0-1ff9-4d77-b779-c4dc6066222e, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:12.555831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Pushing event updated for resources: {'Port': ['ID=c89ed514-64cd-4011-b01a-855ecf2c3a8e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:12.579616 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7e5e0cb0-e83f-4127-b143-6f952ac69621'] response: {'server_uuid': '93f69d1e-0068-4634-b7ad-70f7710d8470', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6', 'code': 200} May 12 15:13:12.620062 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] Set router 8277cf82-93e4-4768-95d6-0b3d971a6c22 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:13:12.650103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:12.651401 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:12.664550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port da71c1e6-e964-4162-8d94-2826a1af675e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:12.665197 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:12.703811 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-40490d95-9c0b-43c9-9c6d-71b41f91b867 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:12.739347 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-72bad27e-f274-4501-a241-ee01d9ee44c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.3575940 May 12 15:13:12.757948 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:12.777934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] For port afe94bd0-1ff9-4d77-b779-c4dc6066222e, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=afe94bd0-1ff9-4d77-b779-c4dc6066222e,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:12.792060 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:13:12.801673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Request body: {'port': {'device_id': '42278800-f3f9-433a-9df4-98d9daab30e5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:12.804289 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:12.870438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:12.871048 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:12.873062 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] 10.222.0.84 "PUT /v2.0/ports/afe94bd0-1ff9-4d77-b779-c4dc6066222e HTTP/1.1" status: 200 len: 1091 time: 2.4806311 May 12 15:13:12.911100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Allocated IP 172.20.0.1 (32cea943-7534-489c-b9f1-17a345bb2737/f287ffea-ab95-43b4-beb2-c0a16496b6b3/74dbcee5-f229-4782-8cc4-0550ca1e1717) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:12.984175 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2100763337-router', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243'}], 'enable_snat': True}, 'gw_port_id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:09Z', 'revision_number': 3, 'project_id': '1469be66fea349e29c86f5666f6e4b1f', 'gw_port': {'id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:65:07', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'device_owner': 'network:router_gateway', 'standard_attr_id': 934, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:12.990022 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c38ce2ac-422a-41e6-b843-6b306287f6de None None] The sync data for ids ['8277cf82-93e4-4768-95d6-0b3d971a6c22'] in n-d-841483-1 is: [{'id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2100763337-router', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243'}], 'enable_snat': True}, 'gw_port_id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:09Z', 'revision_number': 3, 'project_id': '1469be66fea349e29c86f5666f6e4b1f', 'gw_port': {'id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:65:07', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'device_owner': 'network:router_gateway', 'standard_attr_id': 934, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:13:13.017089 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:13.058006 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-dfd5f45e-7a6f-4a7b-bf0e-967995d15858 service neutron] 10.222.0.82 "GET /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5639493 May 12 15:13:13.144343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dff559e5-a748-467e-a1e2-38000bc98cf0 service neutron] Pushing event updated for resources: {'Port': ['ID=afe94bd0-1ff9-4d77-b779-c4dc6066222e,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:13.191545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac6997e2-0924-4e08-8d48-2f071497c0c0 req-4b16df51-a243-494f-8ee5-53034122b4aa tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:13.193247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac6997e2-0924-4e08-8d48-2f071497c0c0 req-4b16df51-a243-494f-8ee5-53034122b4aa tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 932 time: 0.5515485 May 12 15:13:13.195225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64ff03b6-1229-48d9-af7e-e4a8b801a7ce req-a63578dd-915c-4197-92f1-7017e80cc21b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:13.196572 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64ff03b6-1229-48d9-af7e-e4a8b801a7ce req-a63578dd-915c-4197-92f1-7017e80cc21b service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 1097 time: 0.5575674 May 12 15:13:13.261790 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:13.364285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Transition to ACTIVE for port object 74dbcee5-f229-4782-8cc4-0550ca1e1717 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:13.416945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-074146d1-e5c2-4b74-8bd0-4b16b73848cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:13.418040 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-074146d1-e5c2-4b74-8bd0-4b16b73848cc service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 1094 time: 0.4815733 May 12 15:13:13.449210 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:13.456459 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac6997e2-0924-4e08-8d48-2f071497c0c0 req-c75474e0-f17a-4f61-9125-73b96ed83d2c tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2512045 May 12 15:13:13.532625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Pushing event updated for resources: {'Port': ['ID=74dbcee5-f229-4782-8cc4-0550ca1e1717,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:13.545205 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4e3ace5e-4548-44cd-aa3f-eadfe197dfe5'] response: {'server_uuid': '86881e13-2515-46d4-a5a5-4bc93a1b8647', 'name': 'network-vif-deleted', 'tag': 'b6035326-cd91-47d7-8a65-cc2dd3d1d127', 'status': 'completed', 'code': 200} May 12 15:13:13.547195 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64ff03b6-1229-48d9-af7e-e4a8b801a7ce req-4613a037-458e-41ca-8265-652c16b0340a service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3430150 May 12 15:13:13.548960 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-b3d232d9-904c-4bdb-a2dc-4d710c57fd89 service neutron] 10.222.0.82 "GET /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4797363 May 12 15:13:13.550226 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-f5a22cc8-9104-46f6-a378-17da8511e71b service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=afe94bd0-1ff9-4d77-b779-c4dc6066222e HTTP/1.1" status: 200 len: 217 time: 0.0985374 May 12 15:13:13.619481 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Network 32cea943-7534-489c-b9f1-17a345bb2737 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:13.620907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:13.623611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:13.632357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-540ff36e-c0c2-406e-b30a-e99d3b4cdd31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:13.633808 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-540ff36e-c0c2-406e-b30a-e99d3b4cdd31 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.0769298 May 12 15:13:13.717817 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-c7c2f937-7df2-4ca7-86fe-5cf03983a9bb service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0707531 May 12 15:13:13.722742 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:13.964552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c89ed514-64cd-4011-b01a-855ecf2c3a8e {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:13.983498 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-62f31bfe-4c44-4596-8f17-aca8949499a6 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2583389 May 12 15:13:13.989610 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:13.998911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-649fe4de-1521-49f4-98d4-7c45cd788fb8 None None] Provisioning for port 74dbcee5-f229-4782-8cc4-0550ca1e1717 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:14.004798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-649fe4de-1521-49f4-98d4-7c45cd788fb8 None None] Provisioning complete for port 74dbcee5-f229-4782-8cc4-0550ca1e1717 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:14.005260 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-649fe4de-1521-49f4-98d4-7c45cd788fb8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:14.076102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Transition to ACTIVE for port object c89ed514-64cd-4011-b01a-855ecf2c3a8e will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:14.088145 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:14.137271 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-649fe4de-1521-49f4-98d4-7c45cd788fb8 None None] Port 74dbcee5-f229-4782-8cc4-0550ca1e1717 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:13:14.229939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52874) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:14.246223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-891d586e-71d1-45d5-8f51-d88d14999c78 req-acbdfe59-72d9-4efc-b679-c5b28a6d1f64 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2252119 May 12 15:13:14.255441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04871c25-dc37-4e1b-af31-e10d3eedbcc4 req-09599f15-463d-4abd-b230-f9e18a6af756 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:14.266495 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04871c25-dc37-4e1b-af31-e10d3eedbcc4 req-09599f15-463d-4abd-b230-f9e18a6af756 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 0.2818644 May 12 15:13:14.336739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Pushing event updated for resources: {'Port': ['ID=c89ed514-64cd-4011-b01a-855ecf2c3a8e,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:14.362310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04871c25-dc37-4e1b-af31-e10d3eedbcc4 req-7c1a9bd2-cea8-47c5-adec-0661fb3357d6 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0946090 May 12 15:13:14.569278 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 218a3a16-e45c-495a-b212-a765f6e26b32 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:14.603398 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '93d3a473-9471-49cf-b0d7-802129d2ab04', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '451b695f-17f0-4d54-8214-37e3ab72567c'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:14.645168 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b0b38915-3fd6-48f5-b268-880a4c999835 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0da54985cde346e68eeadf965b8bc6d3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4121037 May 12 15:13:14.649139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52892) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:14.650863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 218a3a16-e45c-495a-b212-a765f6e26b32 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:14.657458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 218a3a16-e45c-495a-b212-a765f6e26b32 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:14.657914 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:14.670161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:14.699519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Attempting to bind port c89ed514-64cd-4011-b01a-855ecf2c3a8e on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:14.700491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Attempting to bind port c89ed514-64cd-4011-b01a-855ecf2c3a8e by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:14.700712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Attempting to bind port c89ed514-64cd-4011-b01a-855ecf2c3a8e on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:14.714074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ff9bff-a1be-4f5f-a037-acbda9716d61 req-bde70181-da03-4ab7-8f5f-234d1f6652ff tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:14.722727 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15ff9bff-a1be-4f5f-a037-acbda9716d61 req-bde70181-da03-4ab7-8f5f-234d1f6652ff tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=93d3a473-9471-49cf-b0d7-802129d2ab04 HTTP/1.1" status: 200 len: 949 time: 0.2320738 May 12 15:13:14.752963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Port c89ed514-64cd-4011-b01a-855ecf2c3a8e on network e8211761-0dd9-424f-b732-629fd2d77e28 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:13:14.752963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Attempting to bind port c89ed514-64cd-4011-b01a-855ecf2c3a8e on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:14.786016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:14.786364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Checking segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:14.786835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Bound using segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:14.787277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Bound port: c89ed514-64cd-4011-b01a-855ecf2c3a8e, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:14.787624 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:14.860405 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15ff9bff-a1be-4f5f-a037-acbda9716d61 req-13f351c9-da1a-49eb-9288-8ad8ff38a8cc tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1364253 May 12 15:13:14.874209 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4a5b8014-521e-4912-b285-4bcb58d771a3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:14.892461 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:14.906985 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f31d4b45-40f1-4111-8ec5-951d195d90b9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:14.926620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 218a3a16-e45c-495a-b212-a765f6e26b32, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=218a3a16-e45c-495a-b212-a765f6e26b32,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:14.958053 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:15.032149 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f31d4b45-40f1-4111-8ec5-951d195d90b9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:15.100752 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=218a3a16-e45c-495a-b212-a765f6e26b32,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:15.160242 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:15.173780 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:15.252425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edad5f4f-cbda-4b18-ad7f-afeb1404fdfd req-e6c10d2b-c256-4a07-bb0a-1dfeabb2eda4 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:15.254300 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-edad5f4f-cbda-4b18-ad7f-afeb1404fdfd req-e6c10d2b-c256-4a07-bb0a-1dfeabb2eda4 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 943 time: 0.1941512 May 12 15:13:15.255432 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f31d4b45-40f1-4111-8ec5-951d195d90b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:15.268842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:15.301228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:15.310685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f31d4b45-40f1-4111-8ec5-951d195d90b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f6116fca-2940-4bc5-b21c-3771c678920e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:15.338308 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:15.343923 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:15.344248 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f31d4b45-40f1-4111-8ec5-951d195d90b9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:15.347785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f31d4b45-40f1-4111-8ec5-951d195d90b9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f6116fca-2940-4bc5-b21c-3771c678920e HTTP/1.1" status: 204 len: 168 time: 0.6951098 May 12 15:13:15.360388 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-edad5f4f-cbda-4b18-ad7f-afeb1404fdfd req-24dce081-3f03-457f-9d95-8d1f344dd3b5 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903490 May 12 15:13:15.388019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Pushing event updated for resources: {'Port': ['ID=74dbcee5-f229-4782-8cc4-0550ca1e1717,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:15.401640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:15.405774 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:15.407777 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] 10.222.0.84 "PUT /v2.0/ports/c89ed514-64cd-4011-b01a-855ecf2c3a8e HTTP/1.1" status: 200 len: 1092 time: 2.6104591 May 12 15:13:15.481317 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f16bc6b9-a456-476b-a527-481aabdb452e'] response: {'server_uuid': '93d3a473-9471-49cf-b0d7-802129d2ab04', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '451b695f-17f0-4d54-8214-37e3ab72567c', 'code': 200} May 12 15:13:15.546742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7c4eb2cc-a1cc-47ef-915b-beb583a717ed', 'tag': 'afe94bd0-1ff9-4d77-b779-c4dc6066222e'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:15.582567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '42278800-f3f9-433a-9df4-98d9daab30e5', 'tag': 'c89ed514-64cd-4011-b01a-855ecf2c3a8e'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:15.691970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09668b3f-2b1d-47fa-aa48-6d51901a9eaa req-113b89e4-6d40-4e9a-9225-a4303bb80910 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 210 time: 0.1238725 May 12 15:13:15.699304 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Network 32cea943-7534-489c-b9f1-17a345bb2737 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:15.704053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:15.706278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dbae3cf-4627-459a-b63a-2d4588dff1de service neutron] Pushing event updated for resources: {'Port': ['ID=c89ed514-64cd-4011-b01a-855ecf2c3a8e,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:15.814270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ea1721-126e-4306-9bf1-cadd772b9421 req-f92decab-43ae-490b-86bd-a0f57f4fceb2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:15.815832 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47ea1721-126e-4306-9bf1-cadd772b9421 req-f92decab-43ae-490b-86bd-a0f57f4fceb2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 944 time: 0.3468776 May 12 15:13:15.848289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52918) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:15.858602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a0b35cc-9131-49c8-a228-ba8efb76a581 req-12a77070-2c29-4d3a-ba51-ca25dd6b4b16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:15.858602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a0b35cc-9131-49c8-a228-ba8efb76a581 req-12a77070-2c29-4d3a-ba51-ca25dd6b4b16 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=93d3a473-9471-49cf-b0d7-802129d2ab04 HTTP/1.1" status: 200 len: 1100 time: 0.2912543 May 12 15:13:15.874222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-3f69b602-913e-4ffc-a42b-736738525ed0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:15.876100 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-3f69b602-913e-4ffc-a42b-736738525ed0 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 1095 time: 0.2809334 May 12 15:13:15.962354 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:16.003841 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47ea1721-126e-4306-9bf1-cadd772b9421 req-edf4a493-59c2-417d-bb51-d39c4bd9c24d tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1763446 May 12 15:13:16.009618 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a0b35cc-9131-49c8-a228-ba8efb76a581 req-53609abb-86f6-494d-a43d-4a107e2f1b40 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0974081 May 12 15:13:16.082452 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d7fe53-a6cf-44ca-a45d-66a187af4ebb req-1a121ddd-6ca0-4cf9-9dbb-0259db1e31e7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:16.088403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d7fe53-a6cf-44ca-a45d-66a187af4ebb req-1a121ddd-6ca0-4cf9-9dbb-0259db1e31e7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:16.093935 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:16.094633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d7fe53-a6cf-44ca-a45d-66a187af4ebb req-1a121ddd-6ca0-4cf9-9dbb-0259db1e31e7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:16.096587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ddcdeb89-c96a-41c1-b294-9845d1a2177a None None] Provisioning complete for port 74dbcee5-f229-4782-8cc4-0550ca1e1717 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:16.098110 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ddcdeb89-c96a-41c1-b294-9845d1a2177a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:16.101702 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-37212907-5690-4e3f-9242-8c56f793a63f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e HTTP/1.1" status: 200 len: 217 time: 0.2030377 May 12 15:13:16.103288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8d7fe53-a6cf-44ca-a45d-66a187af4ebb req-1a121ddd-6ca0-4cf9-9dbb-0259db1e31e7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2417 time: 0.2424908 May 12 15:13:16.163801 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ddcdeb89-c96a-41c1-b294-9845d1a2177a None None] Port 74dbcee5-f229-4782-8cc4-0550ca1e1717 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:13:16.175584 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d5a76d6e-4813-4688-a0de-6396219ad013 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=847be75eb185471bb30da8258939c648&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2982690 May 12 15:13:16.179827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52924) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:16.218173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-5f2e26cb-4d31-4f23-b5ac-36e7eb049d0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:16.219613 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-5f2e26cb-4d31-4f23-b5ac-36e7eb049d0d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.1042738 May 12 15:13:16.221374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Router 8277cf82-93e4-4768-95d6-0b3d971a6c22 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:13:16.223370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8d7fe53-a6cf-44ca-a45d-66a187af4ebb req-78e56d1e-e75a-4fde-b0e8-d2c880d6f466 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1190960 May 12 15:13:16.264130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44bf474a-3d77-4b82-b293-77b2ef823ac0 req-7910320c-a3ea-42e7-a8fd-d0257951a047 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:16.267019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44bf474a-3d77-4b82-b293-77b2ef823ac0 req-7910320c-a3ea-42e7-a8fd-d0257951a047 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 0.1250167 May 12 15:13:16.290819 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-6d57bc9b-6e53-4b4d-91f1-02fdf09a0c0e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0621817 May 12 15:13:16.312984 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5712dac9-1d0c-4534-abb2-78e2bcf97661'] response: {'name': 'network-changed', 'server_uuid': '7c4eb2cc-a1cc-47ef-915b-beb583a717ed', 'tag': 'afe94bd0-1ff9-4d77-b779-c4dc6066222e', 'status': 'completed', 'code': 200} May 12 15:13:16.324295 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44bf474a-3d77-4b82-b293-77b2ef823ac0 req-f0a8ee0d-4070-42a4-8ba8-b7d9d94f3bec tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493615 May 12 15:13:16.359638 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-35b235c6-d840-4d6b-8272-759ecd9ce3a2'] response: {'name': 'network-changed', 'server_uuid': '42278800-f3f9-433a-9df4-98d9daab30e5', 'tag': 'c89ed514-64cd-4011-b01a-855ecf2c3a8e', 'status': 'completed', 'code': 200} May 12 15:13:16.519144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 218a3a16-e45c-495a-b212-a765f6e26b32 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:16.607389 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:16.614357 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 218a3a16-e45c-495a-b212-a765f6e26b32 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:16.614948 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:16.758697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f229cf94-4c9c-489c-8ffc-accc088328c3 req-ae68bac4-e1cf-4e8c-aacf-7a19b4e0c89c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:16.759726 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f229cf94-4c9c-489c-8ffc-accc088328c3 req-ae68bac4-e1cf-4e8c-aacf-7a19b4e0c89c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 1094 time: 0.3869634 May 12 15:13:16.787975 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:16.835730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:13:16.845891 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-beb30132-a8c1-4678-8935-c7178b084e2a admin admin] 10.222.0.82 "PUT /v2.0/routers/8277cf82-93e4-4768-95d6-0b3d971a6c22/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.0542586 May 12 15:13:16.853002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Sync routers for ids ['8277cf82-93e4-4768-95d6-0b3d971a6c22'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:13:16.868259 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Routers {'8277cf82-93e4-4768-95d6-0b3d971a6c22'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:13:16.868878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:13:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8277cf82-93e4-4768-95d6-0b3d971a6c22'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:16.876546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-682fabca-3517-404d-8348-02b476402765 req-64faf00b-98d1-462b-a27d-759361cefe45 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:16.883340 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-682fabca-3517-404d-8348-02b476402765 req-64faf00b-98d1-462b-a27d-759361cefe45 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 0.3775754 May 12 15:13:16.915082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1308c3f1-0444-4ac5-8af9-96522ddf293d req-45af8afc-c41f-4848-8b80-65b218e30539 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:16.916583 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1308c3f1-0444-4ac5-8af9-96522ddf293d req-45af8afc-c41f-4848-8b80-65b218e30539 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=93d3a473-9471-49cf-b0d7-802129d2ab04 HTTP/1.1" status: 200 len: 949 time: 0.4478645 May 12 15:13:16.956999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-6fbffe52-ea86-4202-89d7-bebcda85d9f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:16.958634 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-6fbffe52-ea86-4202-89d7-bebcda85d9f2 service neutron] 10.222.0.84 "GET /v2.0/ports/d96ca9ce-4a19-49f0-bef3-e0e31ace478a HTTP/1.1" status: 200 len: 1031 time: 0.2953095 May 12 15:13:16.970269 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-d4d4022f-4e87-4212-bd23-6cb6bbb8e04f service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6186936 May 12 15:13:16.998883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-682fabca-3517-404d-8348-02b476402765 req-7906298b-6280-4c95-8224-c3236b7a0792 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1146076 May 12 15:13:17.049929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f229cf94-4c9c-489c-8ffc-accc088328c3 req-14a13943-0a15-40d7-9f2a-e2ca94276a2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:17.051365 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f229cf94-4c9c-489c-8ffc-accc088328c3 req-14a13943-0a15-40d7-9f2a-e2ca94276a2b service neutron] 10.222.0.84 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 907 time: 0.2829514 May 12 15:13:17.058278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1308c3f1-0444-4ac5-8af9-96522ddf293d req-9700de58-18aa-4af1-989e-ff06649413a8 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1116033 May 12 15:13:17.111980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:17.192625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9652de71-308b-4f0f-9d52-92411bf020fc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:17.196150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Set router 8277cf82-93e4-4768-95d6-0b3d971a6c22 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:13:17.231825 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f229cf94-4c9c-489c-8ffc-accc088328c3 req-7d41d71f-3f07-4a14-beee-305130ffdca8 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=afe94bd0-1ff9-4d77-b779-c4dc6066222e HTTP/1.1" status: 200 len: 217 time: 0.1695409 May 12 15:13:17.398332 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:17.402850 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9652de71-308b-4f0f-9d52-92411bf020fc HTTP/1.1" status: 204 len: 168 time: 1.2204423 May 12 15:13:17.405176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:17.405919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:17.406338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:17.406756 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:17.407176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:17.407698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:17.408290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:17.408700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:17.409227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:17.409751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:17.410168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:17.410707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1270a873-536b-433e-afec-e925e7eb22ba admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:17.425293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1de6fb0f-7d31-4380-9a30-f0a2b272a3cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:17.430382 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1de6fb0f-7d31-4380-9a30-f0a2b272a3cb service neutron] 10.222.0.84 "GET /v2.0/ports/be802a6d-cca9-42fd-bdc5-6c9f78035217 HTTP/1.1" status: 200 len: 1033 time: 0.4514117 May 12 15:13:17.447917 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c175f10c-2a65-496a-ba74-c511fc5c5512 req-79d29fab-58d2-4148-abf1-dc73b35fd84a tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 210 time: 0.1004307 May 12 15:13:17.461889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f229cf94-4c9c-489c-8ffc-accc088328c3 req-863fa5cc-dbef-4b9c-8334-b7bfc69ede7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:17.463836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f229cf94-4c9c-489c-8ffc-accc088328c3 req-863fa5cc-dbef-4b9c-8334-b7bfc69ede7c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.1953187 May 12 15:13:17.537802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f229cf94-4c9c-489c-8ffc-accc088328c3 req-af87eb4b-d37c-4dec-9ec7-5a3f87db1321 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0667026 May 12 15:13:17.554656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91478fa9-3d41-426b-9ee7-978318888529 req-ca121b94-507d-4c16-bce9-312f4b0d28ff tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:17.563150 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-91478fa9-3d41-426b-9ee7-978318888529 req-ca121b94-507d-4c16-bce9-312f4b0d28ff tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 943 time: 0.3914928 May 12 15:13:17.642307 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:17.654137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-1995a07a-7836-481b-9561-05ee18dcafa6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:17.660380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-1995a07a-7836-481b-9561-05ee18dcafa6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:17.667032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-1995a07a-7836-481b-9561-05ee18dcafa6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:17.668369 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-1995a07a-7836-481b-9561-05ee18dcafa6 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.76 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2417 time: 0.4431622 May 12 15:13:17.731147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device afe94bd0-1ff9-4d77-b779-c4dc6066222e details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:13:17.769661 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2a46bf02-e82f-4fb0-959d-0e12b119a208 req-8b4c2da7-e5d3-421c-ab6d-b0f7ae306314 service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7251866 May 12 15:13:17.892619 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-91478fa9-3d41-426b-9ee7-978318888529 req-763a3ac1-e342-4547-904d-f59c3ce3f2ec tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3285062 May 12 15:13:17.910104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting port 65584e07-bbd0-40f8-806a-3b7a85300525 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:17.919604 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:18.083042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-2d10f9c5-094c-4835-ba83-767cccd427d6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:18.088876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f229cf94-4c9c-489c-8ffc-accc088328c3 req-af7536dd-53f9-485d-99e6-6958d59e2b37 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4984658 May 12 15:13:18.096610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-2d10f9c5-094c-4835-ba83-767cccd427d6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:18.112282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-2d10f9c5-094c-4835-ba83-767cccd427d6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:18.113119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-2d10f9c5-094c-4835-ba83-767cccd427d6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Synchronizing usage tracker for tenant:05b4f1ce61294fb29efb0a765ed28561 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:18.161619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-2d10f9c5-094c-4835-ba83-767cccd427d6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Unset dirty status for tenant:05b4f1ce61294fb29efb0a765ed28561 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:18.161839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2100763337-router', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243'}], 'enable_snat': True}, 'gw_port_id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:14Z', 'revision_number': 4, 'project_id': '1469be66fea349e29c86f5666f6e4b1f', 'gw_port': {'id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:65:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'device_owner': 'network:router_gateway', 'standard_attr_id': 934, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '74dbcee5-f229-4782-8cc4-0550ca1e1717', 'name': '', 'network_id': '32cea943-7534-489c-b9f1-17a345bb2737', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'mac_address': 'fa:16:3e:26:5d:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'device_owner': 'network:router_interface', 'standard_attr_id': 936, 'fixed_ips': [{'subnet_id': 'f287ffea-ab95-43b4-beb2-c0a16496b6b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:12Z', 'updated_at': '2022-05-12T15:13:14Z', 'revision_number': 2, 'project_id': '1469be66fea349e29c86f5666f6e4b1f', 'subnets': [{'id': 'f287ffea-ab95-43b4-beb2-c0a16496b6b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:18.162260 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-2d10f9c5-094c-4835-ba83-767cccd427d6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "GET /v2.0/networks?id=13468259-dd20-42ac-88ec-2614ebea6ccc&id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&id=187794df-e6cb-4ee3-8b40-6b546c229bd2&id=187794df-e6cb-4ee3-8b40-6b546c229bd2 HTTP/1.1" status: 200 len: 1995 time: 0.7173254 May 12 15:13:18.171741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Checking router: 8277cf82-93e4-4768-95d6-0b3d971a6c22 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:13:18.173870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Updating router 8277cf82-93e4-4768-95d6-0b3d971a6c22 port 74dbcee5-f229-4782-8cc4-0550ca1e1717 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:13:18.261473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9558349-66f3-437f-9ac2-c75c51003df9 req-58ce922c-e333-4e8c-8fde-0f06a3318781 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:18.264264 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9558349-66f3-437f-9ac2-c75c51003df9 req-58ce922c-e333-4e8c-8fde-0f06a3318781 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 1095 time: 0.3853400 May 12 15:13:18.314609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port afe94bd0-1ff9-4d77-b779-c4dc6066222e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=afe94bd0-1ff9-4d77-b779-c4dc6066222e,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:18.420894 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'afe94bd0-1ff9-4d77-b779-c4dc6066222e', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'port_id': 'afe94bd0-1ff9-4d77-b779-c4dc6066222e', 'mac_address': 'fa:16:3e:3c:2a:a4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 558, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84c2082e-f394-46d5-8a8f-8e3a70d54fc1', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:13:18.512983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9558349-66f3-437f-9ac2-c75c51003df9 req-38df03e7-4164-4ed9-a200-b8103a039cde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:18.514596 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9558349-66f3-437f-9ac2-c75c51003df9 req-38df03e7-4164-4ed9-a200-b8103a039cde service neutron] 10.222.0.84 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.2405357 May 12 15:13:18.521197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-f77e20ff-b3b0-4b24-a30f-d17e4b9929a6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Synchronizing usage tracker for tenant:05b4f1ce61294fb29efb0a765ed28561 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:18.576455 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:18.606725 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9558349-66f3-437f-9ac2-c75c51003df9 req-0b207e19-4ae6-49d9-abaf-4b821e9f59ab service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e HTTP/1.1" status: 200 len: 217 time: 0.0824459 May 12 15:13:18.646172 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:18.690029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-f77e20ff-b3b0-4b24-a30f-d17e4b9929a6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Unset dirty status for tenant:05b4f1ce61294fb29efb0a765ed28561 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:18.691316 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-f77e20ff-b3b0-4b24-a30f-d17e4b9929a6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=05b4f1ce61294fb29efb0a765ed28561 HTTP/1.1" status: 200 len: 380 time: 0.4806683 May 12 15:13:18.703205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'port': {'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'admin_state_up': True, 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'security_groups': ['5d05f580-8d94-4f7a-847b-79c969006d42']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:18.759694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id afe94bd0-1ff9-4d77-b779-c4dc6066222e {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:18.764042 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-63eeaed2-8907-4a6e-ab64-410361b1de0b req-f3a0bf86-ca78-4e01-be29-4a5a7b43ae3e tempest-FloatingIPDetailsNegativeTestJSON-303234574 tempest-FloatingIPDetailsNegativeTestJSON-303234574-project] show failed (client error): The resource could not be found. May 12 15:13:18.776585 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63eeaed2-8907-4a6e-ab64-410361b1de0b req-f3a0bf86-ca78-4e01-be29-4a5a7b43ae3e tempest-FloatingIPDetailsNegativeTestJSON-303234574 tempest-FloatingIPDetailsNegativeTestJSON-303234574-project] 10.222.0.82 "GET /v2.0/floatingips/691dd4f1-5b5a-4693-8936-00b878c44447 HTTP/1.1" status: 404 len: 350 time: 0.1586437 May 12 15:13:18.779240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52982) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:18.819546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9558349-66f3-437f-9ac2-c75c51003df9 req-97104f5a-d57e-4697-889a-468df38efc42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:18.821055 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9558349-66f3-437f-9ac2-c75c51003df9 req-97104f5a-d57e-4697-889a-468df38efc42 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.1960692 May 12 15:13:18.843376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port afe94bd0-1ff9-4d77-b779-c4dc6066222e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=afe94bd0-1ff9-4d77-b779-c4dc6066222e,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:18.925590 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9558349-66f3-437f-9ac2-c75c51003df9 req-24c5f93f-5b36-48d7-a5b3-449b57281bd3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0958254 May 12 15:13:18.931330 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f229cf94-4c9c-489c-8ffc-accc088328c3 req-8864e042-2751-4c32-a294-0797ede3093c service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8311551 May 12 15:13:18.967489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05532712-ea1d-4dad-8b1b-f6d0e5a680ce req-061c4c7e-f995-4d5a-9aff-ca4fc72ad8eb tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:18.974451 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05532712-ea1d-4dad-8b1b-f6d0e5a680ce req-061c4c7e-f995-4d5a-9aff-ca4fc72ad8eb tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 944 time: 0.7789543 May 12 15:13:19.146419 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:19.160675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:19.166677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:port and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:19.170833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for port was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:19.178904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource port. Total usage: 7; quota limit: 500; headroom:493 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:19.202684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Made reservation on behalf of 05b4f1ce61294fb29efb0a765ed28561 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:19.208284 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:19.290589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] For port 65584e07-bbd0-40f8-806a-3b7a85300525, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=65584e07-bbd0-40f8-806a-3b7a85300525,segment=NetworkSegment(36ebeacd-da47-43a4-9f56-f8706690a71c),segment_id=36ebeacd-da47-43a4-9f56-f8706690a71c)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:19.291259 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:19.302303 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:19.344313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Transition to ACTIVE for port object 74dbcee5-f229-4782-8cc4-0550ca1e1717 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:19.348110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=afe94bd0-1ff9-4d77-b779-c4dc6066222e,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:19.359601 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:19.364864 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9558349-66f3-437f-9ac2-c75c51003df9 req-5a9779be-d8a4-4009-b487-5ddbd1773b87 service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4066136 May 12 15:13:19.593800 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05532712-ea1d-4dad-8b1b-f6d0e5a680ce req-d5b0d126-235e-410a-8f1e-5bb91a08251d tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6132176 May 12 15:13:19.604738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['afe94bd0-1ff9-4d77-b779-c4dc6066222e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:19.605272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Calling delete_port for 65584e07-bbd0-40f8-806a-3b7a85300525 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:19.843057 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9558349-66f3-437f-9ac2-c75c51003df9 req-914fb4d6-cd74-4af8-94f1-e2b2e9517397 service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4689889 May 12 15:13:19.864160 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c30d8775-2806-48ec-af03-fcbf624ffa9a None None] Pushing event updated for resources: {'Port': ['ID=74dbcee5-f229-4782-8cc4-0550ca1e1717,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:19.901882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Attempting to bind port 74dbcee5-f229-4782-8cc4-0550ca1e1717 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:19.901882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Attempting to bind port 74dbcee5-f229-4782-8cc4-0550ca1e1717 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '76d93afe-dbed-4578-bf3e-884ce482db6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '32cea943-7534-489c-b9f1-17a345bb2737'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:19.901882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Attempting to bind port 74dbcee5-f229-4782-8cc4-0550ca1e1717 on network 32cea943-7534-489c-b9f1-17a345bb2737 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:19.925300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:19.925717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Checking segment: {'id': '76d93afe-dbed-4578-bf3e-884ce482db6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '32cea943-7534-489c-b9f1-17a345bb2737'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:19.926124 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:19.926519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Bound using segment: {'id': '76d93afe-dbed-4578-bf3e-884ce482db6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '32cea943-7534-489c-b9f1-17a345bb2737'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:19.926977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Bound port: 74dbcee5-f229-4782-8cc4-0550ca1e1717, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '76d93afe-dbed-4578-bf3e-884ce482db6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '32cea943-7534-489c-b9f1-17a345bb2737'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:19.927348 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:19.960035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Allocated IP 172.20.0.5 (13468259-dd20-42ac-88ec-2614ebea6ccc/4ecb64d7-7b16-437b-8f3e-4996d58043f6/04429346-9f7d-4f32-8c65-290ee17fda8a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:20.150847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] For port 74dbcee5-f229-4782-8cc4-0550ca1e1717, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:20.171607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] For port 74dbcee5-f229-4782-8cc4-0550ca1e1717, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=74dbcee5-f229-4782-8cc4-0550ca1e1717,segment=NetworkSegment(76d93afe-dbed-4578-bf3e-884ce482db6b),segment_id=76d93afe-dbed-4578-bf3e-884ce482db6b)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:20.186813 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:20.208747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1723ca10-1b56-4e0c-9f50-835eb2151679 req-30feed6e-1127-496d-a7cd-3df2ec2374e8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:20.216917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1723ca10-1b56-4e0c-9f50-835eb2151679 req-30feed6e-1127-496d-a7cd-3df2ec2374e8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:20.226057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1723ca10-1b56-4e0c-9f50-835eb2151679 req-30feed6e-1127-496d-a7cd-3df2ec2374e8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:20.235059 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1723ca10-1b56-4e0c-9f50-835eb2151679 req-30feed6e-1127-496d-a7cd-3df2ec2374e8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 2417 time: 1.0380697 May 12 15:13:20.307815 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:20.359532 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Routers {'8277cf82-93e4-4768-95d6-0b3d971a6c22'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:13:20.360172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:13:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8277cf82-93e4-4768-95d6-0b3d971a6c22'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:20.362739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Transition to ACTIVE for port object 04429346-9f7d-4f32-8c65-290ee17fda8a will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:20.447406 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:20.489966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c30d8775-2806-48ec-af03-fcbf624ffa9a None None] Pushing event updated for resources: {'Port': ['ID=74dbcee5-f229-4782-8cc4-0550ca1e1717,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:20.547296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1723ca10-1b56-4e0c-9f50-835eb2151679 req-fc919b34-9c4c-48f6-90a8-22290c46b445 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3102243 May 12 15:13:20.552510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'Port': ['ID=04429346-9f7d-4f32-8c65-290ee17fda8a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:20.571475 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Network 13468259-dd20-42ac-88ec-2614ebea6ccc is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:20.572837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:20.576671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:20.588095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:20.679322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:20.680363 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:20.689748 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:20.718593 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-963bb279-0c4c-462e-b347-696c9f8adee6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.0191915 May 12 15:13:20.724538 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] Set router 8277cf82-93e4-4768-95d6-0b3d971a6c22 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:13:20.740253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'port': {'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06', 'admin_state_up': True, 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'security_groups': ['5d05f580-8d94-4f7a-847b-79c969006d42']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:20.820617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event deleted for resources: {'Port': ['ID=65584e07-bbd0-40f8-806a-3b7a85300525,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:20.896696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53012) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:21.065509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:21.070407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:port and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:21.077943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for port was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:21.078548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:21.078890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:21.079220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:21.079548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:21.079890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:21.080215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:21.080530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:21.081262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:21.081262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:21.081491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:21.081770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:21.082081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:21.092560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08be28a1-b11d-4270-a5f4-3789c882ae62 req-df3d5c8d-cb6b-4a92-82dd-063dad7e56e5 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:21.094121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08be28a1-b11d-4270-a5f4-3789c882ae62 req-df3d5c8d-cb6b-4a92-82dd-063dad7e56e5 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=93d3a473-9471-49cf-b0d7-802129d2ab04 HTTP/1.1" status: 200 len: 949 time: 1.2584872 May 12 15:13:21.109563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource port. Total usage: 8; quota limit: 500; headroom:492 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:21.113147 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af23ff85-52fa-4fe0-8d9d-a59fbabbaa25 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:21.126158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] No DVR routers for this DVR port 65584e07-bbd0-40f8-806a-3b7a85300525 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:13:21.130383 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:21.135308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-af23ff85-52fa-4fe0-8d9d-a59fbabbaa25 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:21.142477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-af23ff85-52fa-4fe0-8d9d-a59fbabbaa25 admin admin] Usage tracker for resource:security_group_rule and tenant:7331d392a922493aa0cd04829f443ecd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:21.146710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-af23ff85-52fa-4fe0-8d9d-a59fbabbaa25 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:21.149580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Made reservation on behalf of 05b4f1ce61294fb29efb0a765ed28561 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:21.153800 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:21.159740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-deleted', 'tag': '65584e07-bbd0-40f8-806a-3b7a85300525'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:21.179149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-af23ff85-52fa-4fe0-8d9d-a59fbabbaa25 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:21.268320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-8e0a9bc4-b707-4212-9b0d-8c3243e9dc23 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.76 "DELETE /v2.0/ports/65584e07-bbd0-40f8-806a-3b7a85300525 HTTP/1.1" status: 204 len: 173 time: 3.5896838 May 12 15:13:21.330769 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:21.355603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08be28a1-b11d-4270-a5f4-3789c882ae62 req-d55db44d-1e6b-4b80-a074-9c4e465e645e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2325671 May 12 15:13:21.394023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0e99f99c-8d6a-408a-83f0-5cc1c1d502a3'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:21.395127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting port 039f5f29-f92a-42e9-9582-4aaf75edb62a {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:21.395906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:21.405975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6321129a-f1b5-4218-b424-dfff88dff9e6 None None] Provisioning for port 04429346-9f7d-4f32-8c65-290ee17fda8a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:21.417642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:21.425276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2100763337-router', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243'}], 'enable_snat': True}, 'gw_port_id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:14Z', 'revision_number': 4, 'project_id': '1469be66fea349e29c86f5666f6e4b1f', 'gw_port': {'id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:65:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'device_owner': 'network:router_gateway', 'standard_attr_id': 934, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '74dbcee5-f229-4782-8cc4-0550ca1e1717', 'name': '', 'network_id': '32cea943-7534-489c-b9f1-17a345bb2737', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'mac_address': 'fa:16:3e:26:5d:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'device_owner': 'network:router_interface', 'standard_attr_id': 936, 'fixed_ips': [{'subnet_id': 'f287ffea-ab95-43b4-beb2-c0a16496b6b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:12Z', 'updated_at': '2022-05-12T15:13:20Z', 'revision_number': 4, 'project_id': '1469be66fea349e29c86f5666f6e4b1f', 'subnets': [{'id': 'f287ffea-ab95-43b4-beb2-c0a16496b6b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:21.429871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6321129a-f1b5-4218-b424-dfff88dff9e6 None None] Provisioning complete for port 04429346-9f7d-4f32-8c65-290ee17fda8a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:21.430224 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6321129a-f1b5-4218-b424-dfff88dff9e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:21.449239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8043ff9c-b724-4c2f-8539-7a8a942b8b9a req-c6b0d48e-1b02-40d1-89b4-e71d43a8822e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:21.457325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8043ff9c-b724-4c2f-8539-7a8a942b8b9a req-c6b0d48e-1b02-40d1-89b4-e71d43a8822e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 0.6149137 May 12 15:13:21.464388 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03fa87a2-760b-4721-a72d-28ced540d94f None None] The sync data for ids ['8277cf82-93e4-4768-95d6-0b3d971a6c22'] in n-d-841483-1 is: [{'id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2100763337-router', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243'}], 'enable_snat': True}, 'gw_port_id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:14Z', 'revision_number': 4, 'project_id': '1469be66fea349e29c86f5666f6e4b1f', 'gw_port': {'id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:65:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'device_owner': 'network:router_gateway', 'standard_attr_id': 934, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '74dbcee5-f229-4782-8cc4-0550ca1e1717', 'name': '', 'network_id': '32cea943-7534-489c-b9f1-17a345bb2737', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'mac_address': 'fa:16:3e:26:5d:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'device_owner': 'network:router_interface', 'standard_attr_id': 936, 'fixed_ips': [{'subnet_id': 'f287ffea-ab95-43b4-beb2-c0a16496b6b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:12Z', 'updated_at': '2022-05-12T15:13:20Z', 'revision_number': 4, 'project_id': '1469be66fea349e29c86f5666f6e4b1f', 'subnets': [{'id': 'f287ffea-ab95-43b4-beb2-c0a16496b6b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:13:21.479059 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:21.479752 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 65584e07-bbd0-40f8-806a-3b7a85300525 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:21.552916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Allocated IP 10.1.1.217 (86d71e93-6e6b-4e00-b1ac-48b27c2b0f06/34e89d1d-72aa-4216-94d6-f37b8a0c162b/857536b0-998d-4731-a09f-f8fca9f18d3e) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:21.595023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 65584e07-bbd0-40f8-806a-3b7a85300525 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:13:21.595718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 65584e07-bbd0-40f8-806a-3b7a85300525 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:21.596394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 039f5f29-f92a-42e9-9582-4aaf75edb62a no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:21.642723 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af23ff85-52fa-4fe0-8d9d-a59fbabbaa25 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:21.688849 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8043ff9c-b724-4c2f-8539-7a8a942b8b9a req-6955b483-116b-4ea7-8f94-df682ad51254 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2229960 May 12 15:13:21.721517 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6321129a-f1b5-4218-b424-dfff88dff9e6 None None] Port 04429346-9f7d-4f32-8c65-290ee17fda8a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:13:21.784866 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c89ed514-64cd-4011-b01a-855ecf2c3a8e details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:13:21.787799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device afe94bd0-1ff9-4d77-b779-c4dc6066222e up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:21.882106 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:21.919413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Transition to ACTIVE for port object 857536b0-998d-4731-a09f-f8fca9f18d3e will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:21.928275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:21.933933 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af23ff85-52fa-4fe0-8d9d-a59fbabbaa25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:21.998044 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-af23ff85-52fa-4fe0-8d9d-a59fbabbaa25 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7331d392a922493aa0cd04829f443ecd&name=default HTTP/1.1" status: 200 len: 2979 time: 1.1006854 May 12 15:13:22.005991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53026) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:22.019031 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:22.072029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af23ff85-52fa-4fe0-8d9d-a59fbabbaa25 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ee4b559b-f14e-447f-aaa4-7acd4cf893c3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:22.117076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port afe94bd0-1ff9-4d77-b779-c4dc6066222e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:22.133086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 039f5f29-f92a-42e9-9582-4aaf75edb62a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=039f5f29-f92a-42e9-9582-4aaf75edb62a,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:22.139068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:22.147214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port afe94bd0-1ff9-4d77-b779-c4dc6066222e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:22.147526 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:22.151330 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:22.179977 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:22.224976 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5753b214-774b-4efb-962d-7c3ffcc1fd34 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:22.256878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5753b214-774b-4efb-962d-7c3ffcc1fd34 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:22.263542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1527f83-f229-4925-ac4d-2dd6d9c5ca34 req-09218f06-c169-4380-9497-1884e665c74a tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:22.271674 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f1527f83-f229-4925-ac4d-2dd6d9c5ca34 req-09218f06-c169-4380-9497-1884e665c74a tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 931 time: 0.6935005 May 12 15:13:22.274465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'c89ed514-64cd-4011-b01a-855ecf2c3a8e', 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28', 'port_id': 'c89ed514-64cd-4011-b01a-855ecf2c3a8e', 'mac_address': 'fa:16:3e:97:bb:8c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 579, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ed7d4325-c4dc-4592-8d41-1f3fe41da585', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:13:22.367444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5753b214-774b-4efb-962d-7c3ffcc1fd34 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:22.379517 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c161467f-1849-4425-855d-831e8a95b8aa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:22.392015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:22.400247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:22.403086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:22.442920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=039f5f29-f92a-42e9-9582-4aaf75edb62a,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:22.445371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5753b214-774b-4efb-962d-7c3ffcc1fd34 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ee4b559b-f14e-447f-aaa4-7acd4cf893c3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:22.447062 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:22.455030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'Port': ['ID=857536b0-998d-4731-a09f-f8fca9f18d3e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:22.480936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c89ed514-64cd-4011-b01a-855ecf2c3a8e {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:22.485663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5753b214-774b-4efb-962d-7c3ffcc1fd34 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:22.495838 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5753b214-774b-4efb-962d-7c3ffcc1fd34 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ee4b559b-f14e-447f-aaa4-7acd4cf893c3 HTTP/1.1" status: 204 len: 168 time: 0.4787431 May 12 15:13:22.521165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:22.522139 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:22.568781 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-299685c0-dd0b-4894-8d0d-c2d7525b526e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8329685 May 12 15:13:22.594730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'port': {'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06', 'admin_state_up': True, 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'security_groups': ['5d05f580-8d94-4f7a-847b-79c969006d42']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:22.673840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:22.696024 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:22.720088 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 74dbcee5-f229-4782-8cc4-0550ca1e1717 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:22.886410 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:22.938908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:22.948230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:port and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:22.953181 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for port was recalculated. Used quota:9. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:22.959346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource port. Total usage: 9; quota limit: 500; headroom:491 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:22.973131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=c89ed514-64cd-4011-b01a-855ecf2c3a8e,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:22.976671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Made reservation on behalf of 05b4f1ce61294fb29efb0a765ed28561 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:22.981236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:23.009103 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port afe94bd0-1ff9-4d77-b779-c4dc6066222e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=afe94bd0-1ff9-4d77-b779-c4dc6066222e,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:23.011943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4b271a8c-481a-495f-bc78-23f07e7b7d88 None None] Provisioning for port 857536b0-998d-4731-a09f-f8fca9f18d3e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:23.020180 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4b271a8c-481a-495f-bc78-23f07e7b7d88 None None] Provisioning complete for port 857536b0-998d-4731-a09f-f8fca9f18d3e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:23.020649 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4b271a8c-481a-495f-bc78-23f07e7b7d88 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:23.054734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 74dbcee5-f229-4782-8cc4-0550ca1e1717 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:23.068719 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 74dbcee5-f229-4782-8cc4-0550ca1e1717 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:23.069552 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:23.096564 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:23.108941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53036) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:23.148731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] For port 039f5f29-f92a-42e9-9582-4aaf75edb62a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=039f5f29-f92a-42e9-9582-4aaf75edb62a,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:23.149107 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:23.176122 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f1527f83-f229-4925-ac4d-2dd6d9c5ca34 req-de22957f-19a7-4523-afaf-8e3d156e5650 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.9027517 May 12 15:13:23.231652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4b271a8c-481a-495f-bc78-23f07e7b7d88 None None] Port 857536b0-998d-4731-a09f-f8fca9f18d3e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:13:23.245806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=afe94bd0-1ff9-4d77-b779-c4dc6066222e,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:23.247295 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9bde57f0-bbd9-4149-8e84-adf2d528e457 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:23.270438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9bde57f0-bbd9-4149-8e84-adf2d528e457 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:23.274990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9bde57f0-bbd9-4149-8e84-adf2d528e457 admin admin] Usage tracker for resource:security_group_rule and tenant:5523e6f9291849aab3209555520fe016 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:23.282281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9bde57f0-bbd9-4149-8e84-adf2d528e457 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:23.289661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9bde57f0-bbd9-4149-8e84-adf2d528e457 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:23.351361 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['c89ed514-64cd-4011-b01a-855ecf2c3a8e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:23.405248 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9bde57f0-bbd9-4149-8e84-adf2d528e457 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:23.455190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Allocated IP 10.1.1.117 (86d71e93-6e6b-4e00-b1ac-48b27c2b0f06/34e89d1d-72aa-4216-94d6-f37b8a0c162b/4834ab3b-6306-4f41-81ec-4af4df1f4c1b) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:23.467245 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:23.602707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 74dbcee5-f229-4782-8cc4-0550ca1e1717, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=74dbcee5-f229-4782-8cc4-0550ca1e1717,segment=NetworkSegment(76d93afe-dbed-4578-bf3e-884ce482db6b),segment_id=76d93afe-dbed-4578-bf3e-884ce482db6b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:23.620496 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:23.636095 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9bde57f0-bbd9-4149-8e84-adf2d528e457 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:23.654527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Calling delete_port for 039f5f29-f92a-42e9-9582-4aaf75edb62a owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:23.698075 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:23.725775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Transition to ACTIVE for port object 4834ab3b-6306-4f41-81ec-4af4df1f4c1b will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:23.731550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d2caf7-7f40-4db2-82b4-8ba5d218e31e req-97594fcd-be68-4819-b89e-75153ff44aa5 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:23.739587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34d2caf7-7f40-4db2-82b4-8ba5d218e31e req-97594fcd-be68-4819-b89e-75153ff44aa5 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 944 time: 1.5942173 May 12 15:13:23.758875 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=74dbcee5-f229-4782-8cc4-0550ca1e1717,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:23.761979 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:23.842210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:23.845150 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9bde57f0-bbd9-4149-8e84-adf2d528e457 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5523e6f9291849aab3209555520fe016&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7319915 May 12 15:13:23.845554 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:23.846111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bde57f0-bbd9-4149-8e84-adf2d528e457 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ea5268dd-057b-4147-84e4-97aac0c4911a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:23.847669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53040) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:23.849964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:23.918487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'Port': ['ID=4834ab3b-6306-4f41-81ec-4af4df1f4c1b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:23.919873 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34d2caf7-7f40-4db2-82b4-8ba5d218e31e req-60a232f5-5e72-4e27-937e-31bf3496c47d tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1771858 May 12 15:13:23.973524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:23.974147 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:23.974972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b4655dd-0786-46eb-b0b7-da8efa8c1601 req-3925b46c-9760-4db6-b7c8-72d2e3eefe84 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:23.976537 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8b4655dd-0786-46eb-b0b7-da8efa8c1601 req-3925b46c-9760-4db6-b7c8-72d2e3eefe84 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 945 time: 0.5676248 May 12 15:13:23.977767 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:13:23.978087 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:13:24.013330 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-751f36cb-e667-4539-8179-9fa63752a98e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:24.018266 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-800ce670-cc1e-4c37-8fe8-a1b574f5930c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4281921 May 12 15:13:24.054236 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-09e0a644-9b53-44d3-ade0-e056197c1be0'] response: {'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-deleted', 'tag': '65584e07-bbd0-40f8-806a-3b7a85300525', 'status': 'completed', 'code': 200} May 12 15:13:24.081492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-c161467f-1849-4425-855d-831e8a95b8aa admin admin] Deleting port 74dbcee5-f229-4782-8cc4-0550ca1e1717 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:24.081930 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c161467f-1849-4425-855d-831e8a95b8aa admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:24.170828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'port': {'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'fixed_ips': [{'ip_address': '10.2.2.100'}], 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2', 'admin_state_up': True, 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'security_groups': ['5d05f580-8d94-4f7a-847b-79c969006d42']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:24.257365 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-751f36cb-e667-4539-8179-9fa63752a98e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:24.270955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-79520bef-87f5-4e4b-bca0-4521fac11d59 None None] Provisioning for port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:24.276753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-79520bef-87f5-4e4b-bca0-4521fac11d59 None None] Provisioning complete for port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:24.277137 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-79520bef-87f5-4e4b-bca0-4521fac11d59 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:24.361516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:24.363355 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-79520bef-87f5-4e4b-bca0-4521fac11d59 None None] Port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:13:24.368246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:port and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:24.373602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for port was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:24.380536 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-751f36cb-e667-4539-8179-9fa63752a98e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:24.384269 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource port. Total usage: 10; quota limit: 500; headroom:490 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:24.403286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-751f36cb-e667-4539-8179-9fa63752a98e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea5268dd-057b-4147-84e4-97aac0c4911a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:24.404731 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8b4655dd-0786-46eb-b0b7-da8efa8c1601 req-db99921e-b526-427f-9cc8-2f3c2410f581 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3493154 May 12 15:13:24.410361 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-751f36cb-e667-4539-8179-9fa63752a98e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:24.410468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-c161467f-1849-4425-855d-831e8a95b8aa admin admin] For port 74dbcee5-f229-4782-8cc4-0550ca1e1717, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=74dbcee5-f229-4782-8cc4-0550ca1e1717,segment=NetworkSegment(76d93afe-dbed-4578-bf3e-884ce482db6b),segment_id=76d93afe-dbed-4578-bf3e-884ce482db6b)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:24.413825 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c161467f-1849-4425-855d-831e8a95b8aa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:24.414372 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-751f36cb-e667-4539-8179-9fa63752a98e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ea5268dd-057b-4147-84e4-97aac0c4911a HTTP/1.1" status: 204 len: 168 time: 0.5623860 May 12 15:13:24.416174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Made reservation on behalf of 05b4f1ce61294fb29efb0a765ed28561 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:24.496818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting port 039f5f29-f92a-42e9-9582-4aaf75edb62a {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:24.497162 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:24.532448 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9bc2c845-548a-4260-a6b8-e6bc8e62a367'] response: {'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0e99f99c-8d6a-408a-83f0-5cc1c1d502a3', 'code': 200} May 12 15:13:24.587257 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:24.594989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 74dbcee5-f229-4782-8cc4-0550ca1e1717 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:24.699531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 74dbcee5-f229-4782-8cc4-0550ca1e1717 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:24.699531 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:24.860231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-c161467f-1849-4425-855d-831e8a95b8aa admin admin] Calling delete_port for 74dbcee5-f229-4782-8cc4-0550ca1e1717 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:24.911083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Allocated IP 10.2.2.100 (187794df-e6cb-4ee3-8b40-6b546c229bd2/a98bb094-ea48-4784-b33c-d20b0aad5132/a2eb37f9-aba2-47d2-9756-11109b082c05) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:25.155569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:25.182215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Transition to ACTIVE for port object a2eb37f9-aba2-47d2-9756-11109b082c05 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:25.203056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca4e5165-768c-4e73-96da-3d1470dea60e req-edb224d1-1c76-44ce-9e00-2e77c1fb73b3 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:25.204551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca4e5165-768c-4e73-96da-3d1470dea60e req-edb224d1-1c76-44ce-9e00-2e77c1fb73b3 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=93d3a473-9471-49cf-b0d7-802129d2ab04 HTTP/1.1" status: 200 len: 1100 time: 0.8800447 May 12 15:13:25.227909 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:25.403353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77aa60ec-e301-4634-b7c0-3af72794e27c req-658fb1f8-b325-471b-b999-9b81a431cffe tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:25.406103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'Port': ['ID=a2eb37f9-aba2-47d2-9756-11109b082c05,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:25.409495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77aa60ec-e301-4634-b7c0-3af72794e27c req-658fb1f8-b325-471b-b999-9b81a431cffe tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:25.410294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-77aa60ec-e301-4634-b7c0-3af72794e27c req-658fb1f8-b325-471b-b999-9b81a431cffe tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Synchronizing usage tracker for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:25.412065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Network 187794df-e6cb-4ee3-8b40-6b546c229bd2 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:25.414181 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:25.420162 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca4e5165-768c-4e73-96da-3d1470dea60e req-af67b81f-5af7-49ac-b7a8-9d4e9ee6ac00 tempest-ServersOnMultiNodesTest-619150440 tempest-ServersOnMultiNodesTest-619150440-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2030666 May 12 15:13:25.430023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:25.509456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] For port 039f5f29-f92a-42e9-9582-4aaf75edb62a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=039f5f29-f92a-42e9-9582-4aaf75edb62a,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:25.509736 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:25.554489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:25.555158 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:25.593003 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-62e63d59-8705-424a-8eaa-b4efb3a2b93e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5585697 May 12 15:13:25.612730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'port': {'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'fixed_ips': [{'ip_address': '10.2.2.200'}], 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2', 'admin_state_up': True, 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'security_groups': ['5d05f580-8d94-4f7a-847b-79c969006d42']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:25.701857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53072) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:25.710971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Calling delete_port for 039f5f29-f92a-42e9-9582-4aaf75edb62a owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:25.768355 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c89ed514-64cd-4011-b01a-855ecf2c3a8e up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:25.779113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-77aa60ec-e301-4634-b7c0-3af72794e27c req-658fb1f8-b325-471b-b999-9b81a431cffe tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Unset dirty status for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:25.780264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77aa60ec-e301-4634-b7c0-3af72794e27c req-658fb1f8-b325-471b-b999-9b81a431cffe tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 1679 time: 0.8772728 May 12 15:13:25.789278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:25.795047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Usage tracker for resource:port and tenant:05b4f1ce61294fb29efb0a765ed28561 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:25.798132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Quota usage for port was recalculated. Used quota:11. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:25.806656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attempting to reserve 1 items for resource port. Total usage: 11; quota limit: 500; headroom:489 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:25.823684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Made reservation on behalf of 05b4f1ce61294fb29efb0a765ed28561 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:25.831555 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:25.842420 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3a00236c-68d1-4ae6-9c47-ea0b2e024bbc None None] Provisioning for port a2eb37f9-aba2-47d2-9756-11109b082c05 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:25.852613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3a00236c-68d1-4ae6-9c47-ea0b2e024bbc None None] Provisioning complete for port a2eb37f9-aba2-47d2-9756-11109b082c05 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:25.853054 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3a00236c-68d1-4ae6-9c47-ea0b2e024bbc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:25.924389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Request body: {'network': {'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-network', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:25.926757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port c89ed514-64cd-4011-b01a-855ecf2c3a8e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:25.933527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3a00236c-68d1-4ae6-9c47-ea0b2e024bbc None None] Port a2eb37f9-aba2-47d2-9756-11109b082c05 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:13:25.938107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port c89ed514-64cd-4011-b01a-855ecf2c3a8e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:25.938957 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:25.940122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:25.987032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Usage tracker for resource:network and tenant:a687923521d64fba8b0ceae3dbf4d7d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:26.012824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:26.030543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:26.035298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77aa60ec-e301-4634-b7c0-3af72794e27c req-99637228-0b61-470b-a170-23e34ede4555 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2259684 May 12 15:13:26.040308 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c161467f-1849-4425-855d-831e8a95b8aa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:26.086311 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:26.102557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c161467f-1849-4425-855d-831e8a95b8aa admin admin] Pushing event deleted for resources: {'Port': ['ID=74dbcee5-f229-4782-8cc4-0550ca1e1717,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:26.112517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a042d8eb-d9a6-44ad-842c-43e39806e8da req-8e138e44-1bce-4dc4-bc87-2c84d5559398 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:26.113751 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a042d8eb-d9a6-44ad-842c-43e39806e8da req-8e138e44-1bce-4dc4-bc87-2c84d5559398 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 0.5254421 May 12 15:13:26.128993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Allocated IP 10.2.2.200 (187794df-e6cb-4ee3-8b40-6b546c229bd2/a98bb094-ea48-4784-b33c-d20b0aad5132/39390bec-fdd9-4910-a8d2-6718da722725) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:26.136028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:26.145141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Made reservation on behalf of a687923521d64fba8b0ceae3dbf4d7d3 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:26.145777 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:26.147456 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:26.202528 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:26.254881 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:26.255111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=c89ed514-64cd-4011-b01a-855ecf2c3a8e,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:26.360266 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:26.365036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:26.379239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Transition to ACTIVE for port object 39390bec-fdd9-4910-a8d2-6718da722725 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:26.395867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Usage tracker for resource:security_group_rule and tenant:a687923521d64fba8b0ceae3dbf4d7d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:26.400529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event deleted for resources: {'Port': ['ID=039f5f29-f92a-42e9-9582-4aaf75edb62a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:26.402404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:26.413451 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:26.462024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a042d8eb-d9a6-44ad-842c-43e39806e8da req-9865d6e9-2521-4b4e-844e-fe69b2e1a1ef tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2970173 May 12 15:13:26.467051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:26.533905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Network 187794df-e6cb-4ee3-8b40-6b546c229bd2 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:26.534555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '039f5f29-f92a-42e9-9582-4aaf75edb62a'}, {'server_uuid': '7c4eb2cc-a1cc-47ef-915b-beb583a717ed', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'afe94bd0-1ff9-4d77-b779-c4dc6066222e'}, {'server_uuid': '42278800-f3f9-433a-9df4-98d9daab30e5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c89ed514-64cd-4011-b01a-855ecf2c3a8e'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:26.534885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event updated for resources: {'Port': ['ID=39390bec-fdd9-4910-a8d2-6718da722725,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:26.539088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:26.540492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:26.629584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:26.630573 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:26.657649 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-cde226e2-f57c-4107-9e0c-ec47b3e3af3d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0490999 May 12 15:13:26.678651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Request body: {'port': {'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:26.803700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:26.847436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] No DVR routers for this DVR port 039f5f29-f92a-42e9-9582-4aaf75edb62a on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:13:26.868044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1849cc31-8f37-4854-a2f0-7a0ee3a93859 None None] Provisioning for port 39390bec-fdd9-4910-a8d2-6718da722725 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:26.872739 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:26.873788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1849cc31-8f37-4854-a2f0-7a0ee3a93859 None None] Provisioning complete for port 39390bec-fdd9-4910-a8d2-6718da722725 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:26.874177 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1849cc31-8f37-4854-a2f0-7a0ee3a93859 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:26.875383 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-deleted', 'tag': '039f5f29-f92a-42e9-9582-4aaf75edb62a'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:26.889114 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:26.918098 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:26.936077 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1849cc31-8f37-4854-a2f0-7a0ee3a93859 None None] Port 39390bec-fdd9-4910-a8d2-6718da722725 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:13:27.042835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 596} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:13:27.069780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65dd7cf5-7186-4dcb-b992-7a1529d67f4a req-97b5f4cb-c537-45b1-9176-c893a49bfdeb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:27.075480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65dd7cf5-7186-4dcb-b992-7a1529d67f4a req-97b5f4cb-c537-45b1-9176-c893a49bfdeb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:27.081229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65dd7cf5-7186-4dcb-b992-7a1529d67f4a req-97b5f4cb-c537-45b1-9176-c893a49bfdeb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:27.086972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65dd7cf5-7186-4dcb-b992-7a1529d67f4a req-97b5f4cb-c537-45b1-9176-c893a49bfdeb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:27.088651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65dd7cf5-7186-4dcb-b992-7a1529d67f4a req-97b5f4cb-c537-45b1-9176-c893a49bfdeb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 3095 time: 0.8495228 May 12 15:13:27.097240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-7580cb41-eb5d-43ff-a2ea-acfb60bd2a36 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.76 "DELETE /v2.0/ports/039f5f29-f92a-42e9-9582-4aaf75edb62a HTTP/1.1" status: 204 len: 173 time: 5.8053410 May 12 15:13:27.102933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=acb87c27-050e-44b1-859d-2cd063c51659,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:27.164943 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:27.165282 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Added segment fc4158ff-96b8-4d00-981b-81b5cdb89988 of type vlan for network 13bc975a-b248-4de3-b27d-6d14b7951c4b May 12 15:13:27.206157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c161467f-1849-4425-855d-831e8a95b8aa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:27.257494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-270aebc8-94ea-4f08-9ce4-8400d481cebd tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:27.257857 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-270aebc8-94ea-4f08-9ce4-8400d481cebd tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:27.276578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 04429346-9f7d-4f32-8c65-290ee17fda8a {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:27.284069 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:27.293023 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:27.299707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65dd7cf5-7186-4dcb-b992-7a1529d67f4a req-d7df2ca2-6049-4bfc-b9b2-8f442989b475 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2003624 May 12 15:13:27.299979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Transition to ACTIVE for port object 04429346-9f7d-4f32-8c65-290ee17fda8a will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:27.307124 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:27.367622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fce6c83a-fb79-4d7b-93f0-284a9604c8dd req-3b5d5b90-dacd-4b60-a99d-aba62a3476d1 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:27.369112 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fce6c83a-fb79-4d7b-93f0-284a9604c8dd req-3b5d5b90-dacd-4b60-a99d-aba62a3476d1 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 945 time: 0.6235752 May 12 15:13:27.480652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Pushing event updated for resources: {'Port': ['ID=04429346-9f7d-4f32-8c65-290ee17fda8a,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:27.611959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Attempting to bind port 04429346-9f7d-4f32-8c65-290ee17fda8a on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:27.612430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Attempting to bind port 04429346-9f7d-4f32-8c65-290ee17fda8a by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:27.612979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Attempting to bind port 04429346-9f7d-4f32-8c65-290ee17fda8a on network 13468259-dd20-42ac-88ec-2614ebea6ccc {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:27.616378 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fce6c83a-fb79-4d7b-93f0-284a9604c8dd req-0efba360-445a-4797-b4a6-f7798b77579d tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2292335 May 12 15:13:27.616982 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:27.617983 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:27.618561 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:27.632039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Port 04429346-9f7d-4f32-8c65-290ee17fda8a on network 13468259-dd20-42ac-88ec-2614ebea6ccc not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:13:27.634681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Attempting to bind port 04429346-9f7d-4f32-8c65-290ee17fda8a on network 13468259-dd20-42ac-88ec-2614ebea6ccc {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:27.646358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:27.648800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Checking segment: {'id': 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:27.649442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Bound using segment: {'id': 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:27.651565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Bound port: 04429346-9f7d-4f32-8c65-290ee17fda8a, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:27.652153 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:27.725568 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-01c5681a-2103-4ddb-9fb5-4f38228f4f33'] response: {'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '039f5f29-f92a-42e9-9582-4aaf75edb62a', 'code': 200} May 12 15:13:27.726575 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-01c5681a-2103-4ddb-9fb5-4f38228f4f33'] response: {'server_uuid': '7c4eb2cc-a1cc-47ef-915b-beb583a717ed', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'afe94bd0-1ff9-4d77-b779-c4dc6066222e', 'code': 200} May 12 15:13:27.726575 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-01c5681a-2103-4ddb-9fb5-4f38228f4f33'] response: {'server_uuid': '42278800-f3f9-433a-9df4-98d9daab30e5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c89ed514-64cd-4011-b01a-855ecf2c3a8e', 'code': 200} May 12 15:13:27.780835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] For port 04429346-9f7d-4f32-8c65-290ee17fda8a, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:27.784593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] For port 04429346-9f7d-4f32-8c65-290ee17fda8a, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=04429346-9f7d-4f32-8c65-290ee17fda8a,segment=NetworkSegment(a64e84dc-d91c-44e1-ab35-6c9b54a1b65b),segment_id=a64e84dc-d91c-44e1-ab35-6c9b54a1b65b)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:27.785487 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5ef7c4d8-9f1a-4050-9007-3425881509c0'] response: {'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-deleted', 'tag': '039f5f29-f92a-42e9-9582-4aaf75edb62a', 'status': 'completed', 'code': 200} May 12 15:13:27.794221 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:27.858964 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 902 time: 2.1147919 May 12 15:13:27.867456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:27.868208 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:27.869610 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] 10.222.0.84 "PUT /v2.0/ports/04429346-9f7d-4f32-8c65-290ee17fda8a HTTP/1.1" status: 200 len: 1091 time: 1.1958890 May 12 15:13:27.874770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53088) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:27.878682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': '04429346-9f7d-4f32-8c65-290ee17fda8a'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:27.921862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Request body: {'subnet': {'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-subnet', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:27.939628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Request body: {'port': {'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:28.029205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4ec6bad-d289-4af1-9bb1-38395a857ee3 service neutron] Pushing event updated for resources: {'Port': ['ID=04429346-9f7d-4f32-8c65-290ee17fda8a,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:28.029485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:28.041635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a354370-7361-4b00-9bd2-612eb921259f admin admin] Pushing event updated for resources: {'Network': ['ID=13bc975a-b248-4de3-b27d-6d14b7951c4b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:28.053752 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 13bc975a-b248-4de3-b27d-6d14b7951c4b details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:13:28.061849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Usage tracker for resource:subnet and tenant:a687923521d64fba8b0ceae3dbf4d7d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:28.071073 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f8cc47e-81f6-4d31-ba4f-972fe86ef6ee req-0cd0cea0-7b43-4bb4-a051-1adedad37f9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:28.073329 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5f8cc47e-81f6-4d31-ba4f-972fe86ef6ee req-0cd0cea0-7b43-4bb4-a051-1adedad37f9e service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 1096 time: 0.1804757 May 12 15:13:28.080261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c1d555d-36cd-49fe-9ead-d62b52bacfcc req-8da45633-a128-4d3a-88d0-b4cdcb8db175 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:28.082223 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7c1d555d-36cd-49fe-9ead-d62b52bacfcc req-8da45633-a128-4d3a-88d0-b4cdcb8db175 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 1097 time: 0.1412573 May 12 15:13:28.099409 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:28.131153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:28.162345 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5f8cc47e-81f6-4d31-ba4f-972fe86ef6ee req-b7f993ba-da98-41c0-a694-b1115c209561 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0781889 May 12 15:13:28.164125 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7c1d555d-36cd-49fe-9ead-d62b52bacfcc req-d1d46261-afed-4aee-bc5e-0b307e9a4ce1 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644562 May 12 15:13:28.392857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Made reservation on behalf of a687923521d64fba8b0ceae3dbf4d7d3 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:28.395147 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:28.452945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-270aebc8-94ea-4f08-9ce4-8400d481cebd tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] For port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:28.453296 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-270aebc8-94ea-4f08-9ce4-8400d481cebd tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:28.664247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-270aebc8-94ea-4f08-9ce4-8400d481cebd tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Calling delete_port for 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:28.695705 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:28.726858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97fb208b-2301-4136-a69f-17a5f5703560 req-9e77b544-2878-4742-b115-762bd06d6ee7 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:28.728294 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-97fb208b-2301-4136-a69f-17a5f5703560 req-9e77b544-2878-4742-b115-762bd06d6ee7 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 946 time: 1.0003247 May 12 15:13:28.763459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83479fe1-d1cd-41e9-b7be-7768812afde5 req-222d8eba-4489-4a19-9f03-259f1de1ba2a tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:28.764129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-83479fe1-d1cd-41e9-b7be-7768812afde5 req-222d8eba-4489-4a19-9f03-259f1de1ba2a tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Synchronizing usage tracker for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:28.841703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c161467f-1849-4425-855d-831e8a95b8aa admin admin] Router 8277cf82-93e4-4768-95d6-0b3d971a6c22 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:13:28.908346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-83479fe1-d1cd-41e9-b7be-7768812afde5 req-222d8eba-4489-4a19-9f03-259f1de1ba2a tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Unset dirty status for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:28.909519 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83479fe1-d1cd-41e9-b7be-7768812afde5 req-222d8eba-4489-4a19-9f03-259f1de1ba2a tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=927af517-c58e-4b05-8ecd-295ba864c8f1 HTTP/1.1" status: 200 len: 944 time: 1.0496502 May 12 15:13:28.927427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-97fb208b-2301-4136-a69f-17a5f5703560 req-48c00ff5-ae8a-4bab-b17e-b8b30f034b2a tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1851885 May 12 15:13:29.113364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db0c5c43-1178-4aa0-8ec4-bd404fe1dca0 req-6fbf348b-03d2-49c3-9b47-b7bdc823d14b tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:29.114046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-db0c5c43-1178-4aa0-8ec4-bd404fe1dca0 req-6fbf348b-03d2-49c3-9b47-b7bdc823d14b tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Synchronizing usage tracker for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:29.130500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-db0c5c43-1178-4aa0-8ec4-bd404fe1dca0 req-6fbf348b-03d2-49c3-9b47-b7bdc823d14b tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Unset dirty status for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:29.131919 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-db0c5c43-1178-4aa0-8ec4-bd404fe1dca0 req-6fbf348b-03d2-49c3-9b47-b7bdc823d14b tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "GET /v2.0/ports?device_id=93d3a473-9471-49cf-b0d7-802129d2ab04 HTTP/1.1" status: 200 len: 949 time: 0.1006920 May 12 15:13:29.204852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-db0c5c43-1178-4aa0-8ec4-bd404fe1dca0 req-17ad4534-f8d8-4b42-bef7-c20028831a48 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Deleting port 451b695f-17f0-4d54-8214-37e3ab72567c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:29.205486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-db0c5c43-1178-4aa0-8ec4-bd404fe1dca0 req-17ad4534-f8d8-4b42-bef7-c20028831a48 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:29.306415 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83479fe1-d1cd-41e9-b7be-7768812afde5 req-687c0721-8148-4808-be75-f74fec2be0a7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3823187 May 12 15:13:29.446503 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-270aebc8-94ea-4f08-9ce4-8400d481cebd tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:29.488550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-db0c5c43-1178-4aa0-8ec4-bd404fe1dca0 req-17ad4534-f8d8-4b42-bef7-c20028831a48 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] For port 451b695f-17f0-4d54-8214-37e3ab72567c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=451b695f-17f0-4d54-8214-37e3ab72567c,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:29.488908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-db0c5c43-1178-4aa0-8ec4-bd404fe1dca0 req-17ad4534-f8d8-4b42-bef7-c20028831a48 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:29.577928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270aebc8-94ea-4f08-9ce4-8400d481cebd tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event deleted for resources: {'Port': ['ID=0e99f99c-8d6a-408a-83f0-5cc1c1d502a3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:29.585085 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:29.620634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c161467f-1849-4425-855d-831e8a95b8aa admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:13:29.628490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-db0c5c43-1178-4aa0-8ec4-bd404fe1dca0 req-17ad4534-f8d8-4b42-bef7-c20028831a48 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Calling delete_port for 451b695f-17f0-4d54-8214-37e3ab72567c owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:29.635146 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94a16df1-131c-4703-9a6b-8be93791aeb8 None None] Sync routers for ids ['8277cf82-93e4-4768-95d6-0b3d971a6c22'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:13:29.648631 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94a16df1-131c-4703-9a6b-8be93791aeb8 None None] Routers {'8277cf82-93e4-4768-95d6-0b3d971a6c22'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:13:29.649652 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-94a16df1-131c-4703-9a6b-8be93791aeb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:13:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8277cf82-93e4-4768-95d6-0b3d971a6c22'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:29.875152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a426824-90ba-44ca-9631-b050f154784c req-bdb5181d-2936-4381-a161-42a78e3a54d4 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:29.885102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a426824-90ba-44ca-9631-b050f154784c req-bdb5181d-2936-4381-a161-42a78e3a54d4 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 0.7948821 May 12 15:13:29.901898 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-94a16df1-131c-4703-9a6b-8be93791aeb8 None None] Set router 8277cf82-93e4-4768-95d6-0b3d971a6c22 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:13:29.903658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-270aebc8-94ea-4f08-9ce4-8400d481cebd tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] No DVR routers for this DVR port 0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:13:29.906575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-270aebc8-94ea-4f08-9ce4-8400d481cebd tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:29.936161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-deleted', 'tag': '0e99f99c-8d6a-408a-83f0-5cc1c1d502a3'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:29.991408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9a114164-5df9-48f9-8806-96a06aeff952,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:29.998648 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-db0c5c43-1178-4aa0-8ec4-bd404fe1dca0 req-17ad4534-f8d8-4b42-bef7-c20028831a48 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:30.006852 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c161467f-1849-4425-855d-831e8a95b8aa admin admin] 10.222.0.82 "PUT /v2.0/routers/8277cf82-93e4-4768-95d6-0b3d971a6c22/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 11.2220418 May 12 15:13:30.010755 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81', '8c301fff-eebe-4ee3-ae47-9da749d76d58', '451b695f-17f0-4d54-8214-37e3ab72567c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:30.024730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53102) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:30.067490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3ae73679-d198-440a-966c-619a9930fbcb', '83a7b910-a912-4e05-9d03-5d6b1f6b0edc', '9c35d53f-6773-4ce7-9642-3b542a20efa8', 'fa933a35-7a96-4a45-bb36-afb53c7641b9', 'bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:30.070853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17ad4534-f8d8-4b42-bef7-c20028831a48 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event deleted for resources: {'Port': ['ID=451b695f-17f0-4d54-8214-37e3ab72567c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:30.168080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-db0c5c43-1178-4aa0-8ec4-bd404fe1dca0 req-17ad4534-f8d8-4b42-bef7-c20028831a48 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] No DVR routers for this DVR port 451b695f-17f0-4d54-8214-37e3ab72567c on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:13:30.176236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-db0c5c43-1178-4aa0-8ec4-bd404fe1dca0 req-17ad4534-f8d8-4b42-bef7-c20028831a48 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:30.192763 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-db0c5c43-1178-4aa0-8ec4-bd404fe1dca0 req-17ad4534-f8d8-4b42-bef7-c20028831a48 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "DELETE /v2.0/ports/451b695f-17f0-4d54-8214-37e3ab72567c HTTP/1.1" status: 204 len: 173 time: 1.0537214 May 12 15:13:30.350268 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-94a16df1-131c-4703-9a6b-8be93791aeb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2100763337-router', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243'}], 'enable_snat': True}, 'gw_port_id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:25Z', 'revision_number': 5, 'project_id': '1469be66fea349e29c86f5666f6e4b1f', 'gw_port': {'id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:65:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'device_owner': 'network:router_gateway', 'standard_attr_id': 934, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:30.354290 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94a16df1-131c-4703-9a6b-8be93791aeb8 None None] Checking router: 8277cf82-93e4-4768-95d6-0b3d971a6c22 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:13:30.380556 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94a16df1-131c-4703-9a6b-8be93791aeb8 None None] Routers {'8277cf82-93e4-4768-95d6-0b3d971a6c22'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:13:30.381090 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-94a16df1-131c-4703-9a6b-8be93791aeb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:13:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8277cf82-93e4-4768-95d6-0b3d971a6c22'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:30.382799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44ebc1dc-850d-42c2-b054-ea6ff432d31c req-270aebc8-94ea-4f08-9ce4-8400d481cebd tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.76 "DELETE /v2.0/ports/0e99f99c-8d6a-408a-83f0-5cc1c1d502a3 HTTP/1.1" status: 204 len: 173 time: 3.2747905 May 12 15:13:30.516242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Checking segment: {'id': 'fc4158ff-96b8-4d00-981b-81b5cdb89988', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:30.519151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Network hostable DHCP agents. Network: 13bc975a-b248-4de3-b27d-6d14b7951c4b, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:13:30.541552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a426824-90ba-44ca-9631-b050f154784c req-93dfe847-fc09-44f0-8e30-fc892d43ceac tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6548214 May 12 15:13:30.557635 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:13:30.601530 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-94a16df1-131c-4703-9a6b-8be93791aeb8 None None] Set router 8277cf82-93e4-4768-95d6-0b3d971a6c22 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:13:30.606974 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-841e6b25-b27e-451f-8a86-e9edf5044ddb req-d5cf07b9-0c87-4bfd-8207-a3247b650db3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:30.610478 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-841e6b25-b27e-451f-8a86-e9edf5044ddb req-d5cf07b9-0c87-4bfd-8207-a3247b650db3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=93d3a473-9471-49cf-b0d7-802129d2ab04 HTTP/1.1" status: 200 len: 949 time: 1.1741388 May 12 15:13:30.629927 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ca520555-60c7-41b2-9406-5c523c388141'] response: {'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': '04429346-9f7d-4f32-8c65-290ee17fda8a', 'status': 'completed', 'code': 200} May 12 15:13:30.786945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a73339-02ff-4048-97c2-3f8dbfe75579 req-53e3c563-5669-4c3b-b71d-342ecdd42a4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:30.787566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a73339-02ff-4048-97c2-3f8dbfe75579 req-53e3c563-5669-4c3b-b71d-342ecdd42a4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:30.788036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a73339-02ff-4048-97c2-3f8dbfe75579 req-53e3c563-5669-4c3b-b71d-342ecdd42a4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:30.788733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a73339-02ff-4048-97c2-3f8dbfe75579 req-53e3c563-5669-4c3b-b71d-342ecdd42a4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:30.788953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a73339-02ff-4048-97c2-3f8dbfe75579 req-53e3c563-5669-4c3b-b71d-342ecdd42a4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:30.790812 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49a73339-02ff-4048-97c2-3f8dbfe75579 req-53e3c563-5669-4c3b-b71d-342ecdd42a4e service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=05b4f1ce61294fb29efb0a765ed28561&device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 4363 time: 0.1158934 May 12 15:13:30.809598 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:30.993022 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-94a16df1-131c-4703-9a6b-8be93791aeb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2100763337-router', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243'}], 'enable_snat': True}, 'gw_port_id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:25Z', 'revision_number': 5, 'project_id': '1469be66fea349e29c86f5666f6e4b1f', 'gw_port': {'id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:65:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'device_owner': 'network:router_gateway', 'standard_attr_id': 934, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:30.999216 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94a16df1-131c-4703-9a6b-8be93791aeb8 None None] The sync data for ids ['8277cf82-93e4-4768-95d6-0b3d971a6c22'] in n-d-841483-1 is: [{'id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2100763337-router', 'tenant_id': '1469be66fea349e29c86f5666f6e4b1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243'}], 'enable_snat': True}, 'gw_port_id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:25Z', 'revision_number': 5, 'project_id': '1469be66fea349e29c86f5666f6e4b1f', 'gw_port': {'id': '218a3a16-e45c-495a-b212-a765f6e26b32', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:65:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8277cf82-93e4-4768-95d6-0b3d971a6c22', 'device_owner': 'network:router_gateway', 'standard_attr_id': 934, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.243', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:07Z', 'updated_at': '2022-05-12T15:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:13:31.069950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a73339-02ff-4048-97c2-3f8dbfe75579 req-f2d6c0ae-052b-4138-a245-321042142789 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:31.070333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a73339-02ff-4048-97c2-3f8dbfe75579 req-f2d6c0ae-052b-4138-a245-321042142789 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:31.070863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a73339-02ff-4048-97c2-3f8dbfe75579 req-f2d6c0ae-052b-4138-a245-321042142789 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:31.072701 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49a73339-02ff-4048-97c2-3f8dbfe75579 req-f2d6c0ae-052b-4138-a245-321042142789 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=05b4f1ce61294fb29efb0a765ed28561&shared=False HTTP/1.1" status: 200 len: 2298 time: 0.2688274 May 12 15:13:31.088638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Network 13bc975a-b248-4de3-b27d-6d14b7951c4b is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:13:31.125680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d96ca9ce-4a19-49f0-bef3-e0e31ace478a {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:31.204139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 13bc975a-b248-4de3-b27d-6d14b7951c4b) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:31.208606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:31.209541 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:31.216486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81a40950-9674-4c3c-a679-bee86a3a053a None None] Network 13bc975a-b248-4de3-b27d-6d14b7951c4b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:13:31.217900 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:31.226890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a73339-02ff-4048-97c2-3f8dbfe75579 req-ab079c28-044e-4d04-9889-73cf1f575b43 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:31.228596 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49a73339-02ff-4048-97c2-3f8dbfe75579 req-ab079c28-044e-4d04-9889-73cf1f575b43 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1497710 May 12 15:13:31.281990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-841e6b25-b27e-451f-8a86-e9edf5044ddb req-75df406c-3bae-4c5d-8002-70a0c7ab1f53 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5324104 May 12 15:13:31.297778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Transition to ACTIVE for port object d96ca9ce-4a19-49f0-bef3-e0e31ace478a will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:31.341457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2263fa20-68e7-469b-8a64-9c27fdcecdc2 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 3.4591100 May 12 15:13:31.341457 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:31.342511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53108) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:31.348942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Request body: {'router': {'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:31.359305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:31.379780 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:31.380246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Usage tracker for resource:router and tenant:a687923521d64fba8b0ceae3dbf4d7d3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:31.388048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:31.415511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:31.445336 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:31.446715 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:31.488246 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:31.529671 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] Deleting port 218a3a16-e45c-495a-b212-a765f6e26b32 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:31.535761 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:31.563952 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-13bc975a-b248-4de3-b27d-6d14b7951c4b', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'fixed_ips': [{'subnet_id': '9a114164-5df9-48f9-8806-96a06aeff952'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:13:31.565285 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:31.696549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Pushing event updated for resources: {'Port': ['ID=d96ca9ce-4a19-49f0-bef3-e0e31ace478a,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:31.756135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4448f0c-841d-4ea4-bff1-b47b15846f84 req-1822f0cc-f498-49f3-b749-add67fd79f55 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:31.763306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4448f0c-841d-4ea4-bff1-b47b15846f84 req-1822f0cc-f498-49f3-b749-add67fd79f55 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:31.769173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4448f0c-841d-4ea4-bff1-b47b15846f84 req-1822f0cc-f498-49f3-b749-add67fd79f55 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:31.774961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4448f0c-841d-4ea4-bff1-b47b15846f84 req-1822f0cc-f498-49f3-b749-add67fd79f55 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:31.781588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4448f0c-841d-4ea4-bff1-b47b15846f84 req-1822f0cc-f498-49f3-b749-add67fd79f55 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:31.783376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4448f0c-841d-4ea4-bff1-b47b15846f84 req-1822f0cc-f498-49f3-b749-add67fd79f55 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 3828 time: 0.9994032 May 12 15:13:31.805170 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Allocated IP 172.20.0.2 (13bc975a-b248-4de3-b27d-6d14b7951c4b/9a114164-5df9-48f9-8806-96a06aeff952/5078e1c4-c56d-4859-ac6d-58bc909054a7) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:31.875896 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:31.981900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Attempting to bind port d96ca9ce-4a19-49f0-bef3-e0e31ace478a on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:31.982382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Attempting to bind port d96ca9ce-4a19-49f0-bef3-e0e31ace478a by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:31.982718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Attempting to bind port d96ca9ce-4a19-49f0-bef3-e0e31ace478a on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:31.999111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Port d96ca9ce-4a19-49f0-bef3-e0e31ace478a on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:13:31.999506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Attempting to bind port d96ca9ce-4a19-49f0-bef3-e0e31ace478a on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:32.024923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:32.025282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Checking segment: {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:32.025657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Bound using segment: {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:32.026095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Bound port: d96ca9ce-4a19-49f0-bef3-e0e31ace478a, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:32.026496 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:32.041740 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:32.059551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Transition to ACTIVE for port object 5078e1c4-c56d-4859-ac6d-58bc909054a7 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:32.063023 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:32.064854 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4448f0c-841d-4ea4-bff1-b47b15846f84 req-0346d0fb-598c-4cec-bd80-777c39ea4f19 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1950190 May 12 15:13:32.083797 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Transition to ACTIVE for port object 5078e1c4-c56d-4859-ac6d-58bc909054a7 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:32.092452 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:32.157896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3f0172f-63e7-4f62-80da-ff78cc1cf0fb req-f7cb9e9e-3568-4ec9-831f-556f1954c755 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:32.167175 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3f0172f-63e7-4f62-80da-ff78cc1cf0fb req-f7cb9e9e-3568-4ec9-831f-556f1954c755 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 945 time: 0.6434333 May 12 15:13:32.169169 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Network 13bc975a-b248-4de3-b27d-6d14b7951c4b is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:32.172543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:32.172709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] For port 218a3a16-e45c-495a-b212-a765f6e26b32, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=218a3a16-e45c-495a-b212-a765f6e26b32,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:32.172944 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:32.176329 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:32.222145 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:32.223337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Pushing event updated for resources: {'Port': ['ID=5078e1c4-c56d-4859-ac6d-58bc909054a7,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:32.255455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:32.302025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Attempting to bind port 5078e1c4-c56d-4859-ac6d-58bc909054a7 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:32.302417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Attempting to bind port 5078e1c4-c56d-4859-ac6d-58bc909054a7 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'fc4158ff-96b8-4d00-981b-81b5cdb89988', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:32.302773 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Attempting to bind port 5078e1c4-c56d-4859-ac6d-58bc909054a7 on network 13bc975a-b248-4de3-b27d-6d14b7951c4b {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:32.310940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:32.311327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Checking segment: {'id': 'fc4158ff-96b8-4d00-981b-81b5cdb89988', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:32.311702 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:32.312086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Bound using segment: {'id': 'fc4158ff-96b8-4d00-981b-81b5cdb89988', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:32.312604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Bound port: 5078e1c4-c56d-4859-ac6d-58bc909054a7, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fc4158ff-96b8-4d00-981b-81b5cdb89988', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:32.313029 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:32.382153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] Calling delete_port for 218a3a16-e45c-495a-b212-a765f6e26b32 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:32.411858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Allocated IP 172.25.8.204 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/4abd2c3a-c517-4d15-805c-d27c45138fec) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:32.423742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] For port 5078e1c4-c56d-4859-ac6d-58bc909054a7, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:32.428101 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] For port 5078e1c4-c56d-4859-ac6d-58bc909054a7, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5078e1c4-c56d-4859-ac6d-58bc909054a7,segment=NetworkSegment(fc4158ff-96b8-4d00-981b-81b5cdb89988),segment_id=fc4158ff-96b8-4d00-981b-81b5cdb89988)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:32.434948 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:32.483490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 74dbcee5-f229-4782-8cc4-0550ca1e1717 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:32.548404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 74dbcee5-f229-4782-8cc4-0550ca1e1717 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:13:32.548785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 74dbcee5-f229-4782-8cc4-0550ca1e1717 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:32.583150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9728eba-c907-4172-9d63-85e0c1c3e7af None None] Pushing event updated for resources: {'Port': ['ID=5078e1c4-c56d-4859-ac6d-58bc909054a7,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:32.618768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3f0172f-63e7-4f62-80da-ff78cc1cf0fb req-313d780f-f0fc-4268-9ee0-5f4e9bc0a714 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4503443 May 12 15:13:32.630826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '93d3a473-9471-49cf-b0d7-802129d2ab04', 'name': 'network-vif-deleted', 'tag': '451b695f-17f0-4d54-8214-37e3ab72567c'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:32.653678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] For port d96ca9ce-4a19-49f0-bef3-e0e31ace478a, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:32.660428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] For port d96ca9ce-4a19-49f0-bef3-e0e31ace478a, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d96ca9ce-4a19-49f0-bef3-e0e31ace478a,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:32.669320 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:32.670933 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 451b695f-17f0-4d54-8214-37e3ab72567c no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:32.722895 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:32.723331 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 451b695f-17f0-4d54-8214-37e3ab72567c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:13:32.723829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 451b695f-17f0-4d54-8214-37e3ab72567c not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:32.727371 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-57f9faa9-7c91-4dcc-9c2b-2651a05653fb'] response: {'server_uuid': '927af517-c58e-4b05-8ecd-295ba864c8f1', 'name': 'network-vif-deleted', 'tag': '0e99f99c-8d6a-408a-83f0-5cc1c1d502a3', 'status': 'completed', 'code': 200} May 12 15:13:32.768020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:32.768622 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:32.770029 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] 10.222.0.84 "PUT /v2.0/ports/d96ca9ce-4a19-49f0-bef3-e0e31ace478a HTTP/1.1" status: 200 len: 1134 time: 4.8410795 May 12 15:13:32.795604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:32.810111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beb2eb56-d999-4568-95c0-9bf3fd9538df req-2b8618d9-e72d-4ed6-9398-2fd2aff299a0 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:32.817064 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-beb2eb56-d999-4568-95c0-9bf3fd9538df req-2b8618d9-e72d-4ed6-9398-2fd2aff299a0 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 946 time: 0.6046457 May 12 15:13:32.832737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53120) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:32.848484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Request body: {'port': {'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:32.911448 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49451207-29fc-4f21-91a0-7c5dcc3ac64d service neutron] Pushing event updated for resources: {'Port': ['ID=d96ca9ce-4a19-49f0-bef3-e0e31ace478a,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:32.935888 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:32.939838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:32.949235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:32.998012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Pushing event updated for resources: {'Port': ['ID=4abd2c3a-c517-4d15-805c-d27c45138fec,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:33.105225 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-beb2eb56-d999-4568-95c0-9bf3fd9538df req-824a5c06-176b-4fcc-bf6b-ec38811b3b4b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2872646 May 12 15:13:33.165014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-8b11a1a6-cfb1-465f-8f0b-36c64f9266b7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting subnet b8fd478e-7f1c-4be3-acd2-b5504391fab8 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:13:33.189210 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b11a1a6-cfb1-465f-8f0b-36c64f9266b7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:33.265311 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:33.310273 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a8c753a5-9346-4c9e-bc86-3b34e532cebb'] response: {'server_uuid': '93d3a473-9471-49cf-b0d7-802129d2ab04', 'name': 'network-vif-deleted', 'tag': '451b695f-17f0-4d54-8214-37e3ab72567c', 'status': 'completed', 'code': 200} May 12 15:13:33.314915 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b11a1a6-cfb1-465f-8f0b-36c64f9266b7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:33.382279 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:33.434412 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:33.534860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] Pushing event deleted for resources: {'Port': ['ID=218a3a16-e45c-495a-b212-a765f6e26b32,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:33.638791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d4b4cf4-590b-4af5-9526-554e93c1d1ce req-d2cfdd6a-6a88-4a0a-8d53-f6b5a4a4391d tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:33.640297 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d4b4cf4-590b-4af5-9526-554e93c1d1ce req-d2cfdd6a-6a88-4a0a-8d53-f6b5a4a4391d tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 0.6677711 May 12 15:13:33.800654 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:33.804231 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:33.834325 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e03b411-c4bc-464d-a27a-d29ef074a78c None None] Network 13bc975a-b248-4de3-b27d-6d14b7951c4b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:13:33.927305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f191039c-be21-4061-a0db-523c66665ba8 None None] Provisioning for port 5078e1c4-c56d-4859-ac6d-58bc909054a7 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:33.934539 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d4b4cf4-590b-4af5-9526-554e93c1d1ce req-2453ee88-9824-42c4-889f-0d798741f910 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2709801 May 12 15:13:34.039261 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b11a1a6-cfb1-465f-8f0b-36c64f9266b7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:34.045355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:13:34.171732 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:34.179495 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:34.197410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e97092-27b5-4c4e-b1cd-04ad10fb7096 req-d1994d42-3613-4f54-ab6f-28f5a1bb1d3f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:34.198969 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3e97092-27b5-4c4e-b1cd-04ad10fb7096 req-d1994d42-3613-4f54-ab6f-28f5a1bb1d3f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 945 time: 0.7716475 May 12 15:13:34.241947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:13:34.256376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Sync routers for ids ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:13:34.269775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Routers {'86f12517-ac09-4f4e-b30f-f7f1a1aa3190'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:13:34.271004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:13:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:34.295130 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:34.299131 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7eb164e0-d5f2-4f06-b08b-576d220ac070 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 941 time: 2.9555409 May 12 15:13:34.299772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53130) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:34.515653 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Set router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:13:34.637735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id be802a6d-cca9-42fd-bdc5-6c9f78035217 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:34.646385 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:34.650667 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:34.651189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8277cf82-93e4-4768-95d6-0b3d971a6c22 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:13:34.670424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5078e1c4-c56d-4859-ac6d-58bc909054a7 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:34.680690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3e97092-27b5-4c4e-b1cd-04ad10fb7096 req-477ea77c-6b33-4ff4-b25c-7a793bf86cd5 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4602497 May 12 15:13:34.687842 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b11a1a6-cfb1-465f-8f0b-36c64f9266b7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:34.736025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Transition to ACTIVE for port object be802a6d-cca9-42fd-bdc5-6c9f78035217 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:34.740912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': 'd96ca9ce-4a19-49f0-bef3-e0e31ace478a'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:34.777241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f21e27-5b58-4141-a12b-3acd839e07ab req-e71e2461-70e0-48ec-b501-d2c160bbd848 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:34.783910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f21e27-5b58-4141-a12b-3acd839e07ab req-e71e2461-70e0-48ec-b501-d2c160bbd848 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:34.802371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f21e27-5b58-4141-a12b-3acd839e07ab req-e71e2461-70e0-48ec-b501-d2c160bbd848 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:34.810092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f21e27-5b58-4141-a12b-3acd839e07ab req-e71e2461-70e0-48ec-b501-d2c160bbd848 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:34.817109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f21e27-5b58-4141-a12b-3acd839e07ab req-e71e2461-70e0-48ec-b501-d2c160bbd848 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:34.823283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f21e27-5b58-4141-a12b-3acd839e07ab req-e71e2461-70e0-48ec-b501-d2c160bbd848 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:34.830835 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-38f21e27-5b58-4141-a12b-3acd839e07ab req-e71e2461-70e0-48ec-b501-d2c160bbd848 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 4604 time: 0.7611880 May 12 15:13:34.837340 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:34.842054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b11a1a6-cfb1-465f-8f0b-36c64f9266b7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event deleted for resources: {'Subnet': ['ID=b8fd478e-7f1c-4be3-acd2-b5504391fab8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:34.905801 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d45ca0a9-2b0e-4f6c-a656-774fc69edb13 None None] Network b55a7520-40f6-4d38-b0f0-235a1cd1b883 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:13:34.908373 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b11a1a6-cfb1-465f-8f0b-36c64f9266b7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.026242 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.031700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fc070da0-4f4a-4e7e-b85c-d8dec3a592a4 admin admin] 10.222.0.82 "DELETE /v2.0/routers/8277cf82-93e4-4768-95d6-0b3d971a6c22 HTTP/1.1" status: 204 len: 168 time: 4.9877725 May 12 15:13:35.050281 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8b11a1a6-cfb1-465f-8f0b-36c64f9266b7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "DELETE /v2.0/subnets/b8fd478e-7f1c-4be3-acd2-b5504391fab8 HTTP/1.1" status: 204 len: 168 time: 2.1612649 May 12 15:13:35.053225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53140) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:35.053587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53142) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:35.152889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Pushing event updated for resources: {'Port': ['ID=be802a6d-cca9-42fd-bdc5-6c9f78035217,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:35.173206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-38f21e27-5b58-4141-a12b-3acd839e07ab req-cafbc153-8892-4695-9a00-beee316fb947 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.3406286 May 12 15:13:35.174535 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 5078e1c4-c56d-4859-ac6d-58bc909054a7 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:35.196343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 5078e1c4-c56d-4859-ac6d-58bc909054a7 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:35.196708 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.345844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:13:33Z', 'revision_number': 3, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:35.375982 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.400290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-9d219cef-b102-4d2e-a66b-73b1d906577a admin admin] Deleting subnet f287ffea-ab95-43b4-beb2-c0a16496b6b3 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:13:35.404276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Checking router: 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:13:35.404720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Updating router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 port 4abd2c3a-c517-4d15-805c-d27c45138fec binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:13:35.429902 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9d219cef-b102-4d2e-a66b-73b1d906577a admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.454298 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] DHCP port deletion for b55a7520-40f6-4d38-b0f0-235a1cd1b883 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:13:35.490463 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.491229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Deleting port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:35.491595 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.513324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Attempting to bind port be802a6d-cca9-42fd-bdc5-6c9f78035217 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:35.513710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Attempting to bind port be802a6d-cca9-42fd-bdc5-6c9f78035217 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:35.514026 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Attempting to bind port be802a6d-cca9-42fd-bdc5-6c9f78035217 on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:35.527504 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9d219cef-b102-4d2e-a66b-73b1d906577a admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.542340 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.561651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Port be802a6d-cca9-42fd-bdc5-6c9f78035217 on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:13:35.562068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Attempting to bind port be802a6d-cca9-42fd-bdc5-6c9f78035217 on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:35.580794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d2639ff-f598-489e-8c24-ea3f23106e56 req-30b5461d-8a01-4734-911c-39b356055e85 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:35.587977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d2639ff-f598-489e-8c24-ea3f23106e56 req-30b5461d-8a01-4734-911c-39b356055e85 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 1097 time: 0.6842709 May 12 15:13:35.594428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:35.594778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Checking segment: {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:35.595154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Bound using segment: {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:35.595654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Bound port: be802a6d-cca9-42fd-bdc5-6c9f78035217, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:35.596337 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.600806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 5078e1c4-c56d-4859-ac6d-58bc909054a7, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5078e1c4-c56d-4859-ac6d-58bc909054a7,segment=NetworkSegment(fc4158ff-96b8-4d00-981b-81b5cdb89988),segment_id=fc4158ff-96b8-4d00-981b-81b5cdb89988)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:35.604011 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.619449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:35.619820 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.654377 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.669906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Allocated IP 172.20.0.1 (13bc975a-b248-4de3-b27d-6d14b7951c4b/9a114164-5df9-48f9-8806-96a06aeff952/c04fe88c-5805-45f0-b3fd-52b35ea3fe16) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:35.781188 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d2639ff-f598-489e-8c24-ea3f23106e56 req-2598258f-8ca3-4623-b74c-c088c2578fc1 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1923137 May 12 15:13:35.852791 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.887281 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-03c2c6c0-caed-4d9f-a901-27b240ba16a5'] response: {'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': 'd96ca9ce-4a19-49f0-bef3-e0e31ace478a', 'status': 'completed', 'code': 200} May 12 15:13:35.898578 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9d219cef-b102-4d2e-a66b-73b1d906577a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:35.908977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Transition to ACTIVE for port object c04fe88c-5805-45f0-b3fd-52b35ea3fe16 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:35.991723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] For port be802a6d-cca9-42fd-bdc5-6c9f78035217, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:36.030635 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.069986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=5078e1c4-c56d-4859-ac6d-58bc909054a7,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:36.075853 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] For port be802a6d-cca9-42fd-bdc5-6c9f78035217, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=be802a6d-cca9-42fd-bdc5-6c9f78035217,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:36.102730 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.143654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Network 13bc975a-b248-4de3-b27d-6d14b7951c4b is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:36.152677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:36.163607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:36.197418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Pushing event updated for resources: {'Port': ['ID=c04fe88c-5805-45f0-b3fd-52b35ea3fe16,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:36.199252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] For port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7f35bc1f-e9eb-48bd-ad84-4040c239cee1,segment=NetworkSegment(36ebeacd-da47-43a4-9f56-f8706690a71c),segment_id=36ebeacd-da47-43a4-9f56-f8706690a71c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:36.199668 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.237374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d67007-cf05-4cfd-82d0-5e549cad2f54 req-8431ea79-3c59-4037-b776-6cc0fb0f00b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:36.237876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d67007-cf05-4cfd-82d0-5e549cad2f54 req-8431ea79-3c59-4037-b776-6cc0fb0f00b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:36.238346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d67007-cf05-4cfd-82d0-5e549cad2f54 req-8431ea79-3c59-4037-b776-6cc0fb0f00b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:36.239074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d67007-cf05-4cfd-82d0-5e549cad2f54 req-8431ea79-3c59-4037-b776-6cc0fb0f00b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:36.239545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d67007-cf05-4cfd-82d0-5e549cad2f54 req-8431ea79-3c59-4037-b776-6cc0fb0f00b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:36.240005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d67007-cf05-4cfd-82d0-5e549cad2f54 req-8431ea79-3c59-4037-b776-6cc0fb0f00b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:36.240470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d67007-cf05-4cfd-82d0-5e549cad2f54 req-8431ea79-3c59-4037-b776-6cc0fb0f00b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:36.243089 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-62d67007-cf05-4cfd-82d0-5e549cad2f54 req-8431ea79-3c59-4037-b776-6cc0fb0f00b2 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=05b4f1ce61294fb29efb0a765ed28561&device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 6177 time: 0.2947888 May 12 15:13:36.254614 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.299444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Pushing event updated for resources: {'Port': ['ID=be802a6d-cca9-42fd-bdc5-6c9f78035217,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:36.350908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:36.351693 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.353860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-1df1d680-82f0-40d8-b729-0609fc40a481 service neutron] 10.222.0.84 "PUT /v2.0/ports/be802a6d-cca9-42fd-bdc5-6c9f78035217 HTTP/1.1" status: 200 len: 1136 time: 3.5172114 May 12 15:13:36.360057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Calling delete_port for 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:36.368417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] For port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7f35bc1f-e9eb-48bd-ad84-4040c239cee1,segment=NetworkSegment(36ebeacd-da47-43a4-9f56-f8706690a71c),segment_id=36ebeacd-da47-43a4-9f56-f8706690a71c)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:36.368790 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.399614 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9d219cef-b102-4d2e-a66b-73b1d906577a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.455726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Request body: {'port': {'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:36.582754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d67007-cf05-4cfd-82d0-5e549cad2f54 req-13cc3b46-2290-4fe1-80cd-7fc991d16ec4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:36.583348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d67007-cf05-4cfd-82d0-5e549cad2f54 req-13cc3b46-2290-4fe1-80cd-7fc991d16ec4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:36.583903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d67007-cf05-4cfd-82d0-5e549cad2f54 req-13cc3b46-2290-4fe1-80cd-7fc991d16ec4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:36.585430 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-62d67007-cf05-4cfd-82d0-5e549cad2f54 req-13cc3b46-2290-4fe1-80cd-7fc991d16ec4 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=05b4f1ce61294fb29efb0a765ed28561&shared=False HTTP/1.1" status: 200 len: 2298 time: 0.3267114 May 12 15:13:36.586221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5078e1c4-c56d-4859-ac6d-58bc909054a7 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:36.660806 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.664653 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-95996506-4691-40eb-891a-33c595bc7576 None None] Provisioning for port c04fe88c-5805-45f0-b3fd-52b35ea3fe16 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:36.671036 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.776987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-95996506-4691-40eb-891a-33c595bc7576 None None] Provisioning complete for port c04fe88c-5805-45f0-b3fd-52b35ea3fe16 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:36.777582 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-95996506-4691-40eb-891a-33c595bc7576 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.809417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Pushing event deleted for resources: {'Port': ['ID=7f35bc1f-e9eb-48bd-ad84-4040c239cee1,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:36.812197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Transition to ACTIVE for port object 4abd2c3a-c517-4d15-805c-d27c45138fec will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:36.830875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Calling delete_port for 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:36.834775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] No DVR routers for this DVR port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:13:36.846973 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:36.847694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:36.847694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:36.847894 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:36.849051 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:36.849051 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:36.849051 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:36.849367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:36.849918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:36.849918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:36.850280 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:36.850612 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde2942-e3d7-4119-b904-f6693fcc1741 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:13:36.857032 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.901620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d219cef-b102-4d2e-a66b-73b1d906577a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f287ffea-ab95-43b4-beb2-c0a16496b6b3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:36.904656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 5078e1c4-c56d-4859-ac6d-58bc909054a7 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:36.905016 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.916692 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9d219cef-b102-4d2e-a66b-73b1d906577a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.933467 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9d219cef-b102-4d2e-a66b-73b1d906577a admin admin] 10.222.0.82 "DELETE /v2.0/subnets/f287ffea-ab95-43b4-beb2-c0a16496b6b3 HTTP/1.1" status: 204 len: 168 time: 1.8663685 May 12 15:13:36.936306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53156) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:36.950946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-95996506-4691-40eb-891a-33c595bc7576 None None] Port c04fe88c-5805-45f0-b3fd-52b35ea3fe16 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:13:36.952474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-400c8389-fdc4-49ba-9784-75d8462456e0 None None] Network 32cea943-7534-489c-b9f1-17a345bb2737 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:13:36.954550 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.974958 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:36.978120 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8517ee89-d084-4daa-862e-424f0b0e697d req-83bae307-52b8-413e-b05d-646e496793c4 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:36.983239 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8517ee89-d084-4daa-862e-424f0b0e697d req-83bae307-52b8-413e-b05d-646e496793c4 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 949 time: 0.7860050 May 12 15:13:36.998522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d67007-cf05-4cfd-82d0-5e549cad2f54 req-1f0d8ff9-af39-4eb2-a52e-91d87b442765 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:37.000972 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-62d67007-cf05-4cfd-82d0-5e549cad2f54 req-1f0d8ff9-af39-4eb2-a52e-91d87b442765 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2613850 May 12 15:13:37.038907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d88bba62-0a2a-4133-84a5-a2c18f0a7b3b req-ca236432-9592-4c14-967d-7ed685c5c7d8 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:37.046757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d88bba62-0a2a-4133-84a5-a2c18f0a7b3b req-ca236432-9592-4c14-967d-7ed685c5c7d8 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 0.9357872 May 12 15:13:37.145132 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:13:37.145408 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:13:37.147149 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:37.164267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8517ee89-d084-4daa-862e-424f0b0e697d req-9257b48c-a437-47f2-bb5e-9418655320d7 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1739326 May 12 15:13:37.172383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Deleting port da71c1e6-e964-4162-8d94-2826a1af675e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:37.172730 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:37.213589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-330872b1-2068-42e6-9c63-28b31d757349 None None] Pushing event updated for resources: {'Port': ['ID=4abd2c3a-c517-4d15-805c-d27c45138fec,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:37.236747 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d88bba62-0a2a-4133-84a5-a2c18f0a7b3b req-7995a6ee-ecad-4d16-ba08-78ad59eee14e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1890242 May 12 15:13:37.308267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Attempting to bind port 4abd2c3a-c517-4d15-805c-d27c45138fec on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:37.312433 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Attempting to bind port 4abd2c3a-c517-4d15-805c-d27c45138fec by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:37.312937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Attempting to bind port 4abd2c3a-c517-4d15-805c-d27c45138fec on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:37.511116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:37.511985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:37.512667 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:37.513276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:37.514005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Bound port: 4abd2c3a-c517-4d15-805c-d27c45138fec, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:37.514763 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:37.655455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting port 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:37.655995 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:37.708963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:37.730112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] For port da71c1e6-e964-4162-8d94-2826a1af675e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=da71c1e6-e964-4162-8d94-2826a1af675e,segment=NetworkSegment(76d93afe-dbed-4578-bf3e-884ce482db6b),segment_id=76d93afe-dbed-4578-bf3e-884ce482db6b)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:37.731463 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:37.754447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] For port 4abd2c3a-c517-4d15-805c-d27c45138fec, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:37.758139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:13:37.759000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7f35bc1f-e9eb-48bd-ad84-4040c239cee1 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:37.759626 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 218a3a16-e45c-495a-b212-a765f6e26b32 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:37.807579 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 218a3a16-e45c-495a-b212-a765f6e26b32 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:13:37.808409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 218a3a16-e45c-495a-b212-a765f6e26b32 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:37.817996 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] For port 4abd2c3a-c517-4d15-805c-d27c45138fec, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4abd2c3a-c517-4d15-805c-d27c45138fec,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:37.830319 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:37.838973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] The port '7f35bc1f-e9eb-48bd-ad84-4040c239cee1' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:13:37.880219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Calling delete_port for da71c1e6-e964-4162-8d94-2826a1af675e owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:37.957920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': 'be802a6d-cca9-42fd-bdc5-6c9f78035217'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:37.958683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4169964-6fcb-4933-9dc0-07e4c576043a None None] DHCP port deletion for 32cea943-7534-489c-b9f1-17a345bb2737 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:13:38.007758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c4169964-6fcb-4933-9dc0-07e4c576043a None None] Deleting port da71c1e6-e964-4162-8d94-2826a1af675e {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:38.008131 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4169964-6fcb-4933-9dc0-07e4c576043a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:38.057780 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:38.134766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c4169964-6fcb-4933-9dc0-07e4c576043a None None] The port 'da71c1e6-e964-4162-8d94-2826a1af675e' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:13:38.135724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Pushing event deleted for resources: {'Port': ['ID=da71c1e6-e964-4162-8d94-2826a1af675e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:38.151914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-330872b1-2068-42e6-9c63-28b31d757349 None None] Pushing event updated for resources: {'Port': ['ID=4abd2c3a-c517-4d15-805c-d27c45138fec,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:38.177936 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:38.180917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Routers {'86f12517-ac09-4f4e-b30f-f7f1a1aa3190'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:13:38.182565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:13:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:38.188370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] No DVR routers for this DVR port da71c1e6-e964-4162-8d94-2826a1af675e on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:13:38.260691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b55a7520-40f6-4d38-b0f0-235a1cd1b883']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:38.265076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f6eb336-8aa0-4482-90ba-260592cd62ac req-43075e5b-1467-4a98-999e-424d3a7e9a63 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:38.265828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0f6eb336-8aa0-4482-90ba-260592cd62ac req-43075e5b-1467-4a98-999e-424d3a7e9a63 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Synchronizing usage tracker for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:38.321367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac297d8c-268e-40b0-8daa-b74d941dd99b req-1e096196-8587-498f-a9b8-889c7871d2a7 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:38.335325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac297d8c-268e-40b0-8daa-b74d941dd99b req-1e096196-8587-498f-a9b8-889c7871d2a7 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:38.349468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac297d8c-268e-40b0-8daa-b74d941dd99b req-1e096196-8587-498f-a9b8-889c7871d2a7 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:38.355188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac297d8c-268e-40b0-8daa-b74d941dd99b req-1e096196-8587-498f-a9b8-889c7871d2a7 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:38.373727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac297d8c-268e-40b0-8daa-b74d941dd99b req-1e096196-8587-498f-a9b8-889c7871d2a7 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:38.379813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac297d8c-268e-40b0-8daa-b74d941dd99b req-1e096196-8587-498f-a9b8-889c7871d2a7 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:38.386332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac297d8c-268e-40b0-8daa-b74d941dd99b req-1e096196-8587-498f-a9b8-889c7871d2a7 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:38.388864 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac297d8c-268e-40b0-8daa-b74d941dd99b req-1e096196-8587-498f-a9b8-889c7871d2a7 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5382 time: 0.8846831 May 12 15:13:38.401607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b09b881-90a7-44b6-a9fc-8c1eac7c5122 req-da2f0d72-5997-485d-9bcb-1f84c086499d tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:38.404201 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b09b881-90a7-44b6-a9fc-8c1eac7c5122 req-da2f0d72-5997-485d-9bcb-1f84c086499d tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 945 time: 0.8980496 May 12 15:13:38.408876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '36ebeacd-da47-43a4-9f56-f8706690a71c') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:38.409086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '36ebeacd-da47-43a4-9f56-f8706690a71c') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:38.417540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] Set router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:13:38.451238 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:38.475679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42941c02-e87b-4218-be9a-54b11f578ce2 req-42cfa0bd-8c42-45db-bf2c-514934d63b7f tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:38.476432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-42941c02-e87b-4218-be9a-54b11f578ce2 req-42cfa0bd-8c42-45db-bf2c-514934d63b7f tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Synchronizing usage tracker for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:38.513593 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:38.518777 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:38.565803 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:38.587823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 857536b0-998d-4731-a09f-f8fca9f18d3e {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:38.596841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Releasing vlan 576 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:13:38.597302 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: timer() May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:13:38.619846 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:13:38.648497 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:38.677321 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:38.683641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac297d8c-268e-40b0-8daa-b74d941dd99b req-350b7c42-537d-4ddc-a110-c1ba8d0f620f tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2666142 May 12 15:13:38.708140 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b09b881-90a7-44b6-a9fc-8c1eac7c5122 req-e259f204-a61a-44e8-85cc-a870e130df9b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2548449 May 12 15:13:38.740085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Transition to ACTIVE for port object 857536b0-998d-4731-a09f-f8fca9f18d3e will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:38.744447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device da71c1e6-e964-4162-8d94-2826a1af675e no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:38.749158 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:38.793298 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: da71c1e6-e964-4162-8d94-2826a1af675e {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:13:38.793695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device da71c1e6-e964-4162-8d94-2826a1af675e not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:38.850689 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:38.958764 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1e9be6ef-b941-4a6b-995a-dca574e176aa'] response: {'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': 'be802a6d-cca9-42fd-bdc5-6c9f78035217', 'status': 'completed', 'code': 200} May 12 15:13:38.960333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Pushing event updated for resources: {'Port': ['ID=857536b0-998d-4731-a09f-f8fca9f18d3e,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:38.975454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0f6eb336-8aa0-4482-90ba-260592cd62ac req-43075e5b-1467-4a98-999e-424d3a7e9a63 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Unset dirty status for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:38.978114 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f6eb336-8aa0-4482-90ba-260592cd62ac req-43075e5b-1467-4a98-999e-424d3a7e9a63 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "GET /v2.0/ports?device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 945 time: 0.9999306 May 12 15:13:39.002725 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:13:36Z', 'revision_number': 4, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c04fe88c-5805-45f0-b3fd-52b35ea3fe16', 'name': '', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'mac_address': 'fa:16:3e:8e:94:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_interface', 'standard_attr_id': 963, 'fixed_ips': [{'subnet_id': '9a114164-5df9-48f9-8806-96a06aeff952', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:35Z', 'updated_at': '2022-05-12T15:13:35Z', 'revision_number': 1, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'subnets': [{'id': '9a114164-5df9-48f9-8806-96a06aeff952', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:39.011768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fd86f19-6ea5-4955-b248-d760a5f9e52c None None] The sync data for ids ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'] in n-d-841483-1 is: [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:13:36Z', 'revision_number': 4, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c04fe88c-5805-45f0-b3fd-52b35ea3fe16', 'name': '', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'mac_address': 'fa:16:3e:8e:94:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_interface', 'standard_attr_id': 963, 'fixed_ips': [{'subnet_id': '9a114164-5df9-48f9-8806-96a06aeff952', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:35Z', 'updated_at': '2022-05-12T15:13:35Z', 'revision_number': 1, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'subnets': [{'id': '9a114164-5df9-48f9-8806-96a06aeff952', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:13:39.048862 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:39.181642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-42941c02-e87b-4218-be9a-54b11f578ce2 req-42cfa0bd-8c42-45db-bf2c-514934d63b7f tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Unset dirty status for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:39.182981 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-42941c02-e87b-4218-be9a-54b11f578ce2 req-42cfa0bd-8c42-45db-bf2c-514934d63b7f tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/ports?device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 949 time: 1.7766495 May 12 15:13:39.197538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['32cea943-7534-489c-b9f1-17a345bb2737']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:39.204585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Pushing event updated for resources: {'Port': ['ID=c04fe88c-5805-45f0-b3fd-52b35ea3fe16,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:39.270561 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:39.286624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '76d93afe-dbed-4578-bf3e-884ce482db6b') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:39.286979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '76d93afe-dbed-4578-bf3e-884ce482db6b') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:39.307638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-0f6eb336-8aa0-4482-90ba-260592cd62ac req-a79ade30-7dc7-4599-81ac-6cfaf48e5856 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Deleting port afe94bd0-1ff9-4d77-b779-c4dc6066222e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:39.307967 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0f6eb336-8aa0-4482-90ba-260592cd62ac req-a79ade30-7dc7-4599-81ac-6cfaf48e5856 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:39.343560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event deleted for resources: {'Network': ['ID=b55a7520-40f6-4d38-b0f0-235a1cd1b883,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:39.365879 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:39.399163 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-96fe3a5a-2063-44e2-b837-7bf49a1fad8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "DELETE /v2.0/networks/b55a7520-40f6-4d38-b0f0-235a1cd1b883 HTTP/1.1" status: 204 len: 168 time: 4.3326204 May 12 15:13:39.403828 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53180) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:39.486121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-42941c02-e87b-4218-be9a-54b11f578ce2 req-69320937-e488-457f-bec2-fdbe01664292 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Deleting port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:39.486469 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-42941c02-e87b-4218-be9a-54b11f578ce2 req-69320937-e488-457f-bec2-fdbe01664292 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:39.496839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Attempting to bind port 857536b0-998d-4731-a09f-f8fca9f18d3e on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:39.497165 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Attempting to bind port 857536b0-998d-4731-a09f-f8fca9f18d3e by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:39.501586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Attempting to bind port 857536b0-998d-4731-a09f-f8fca9f18d3e on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:39.525156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Port 857536b0-998d-4731-a09f-f8fca9f18d3e on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:13:39.525573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Attempting to bind port 857536b0-998d-4731-a09f-f8fca9f18d3e on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:39.526818 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:39.542479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:39.542756 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Checking segment: {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:39.543010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Bound using segment: {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:39.543984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Bound port: 857536b0-998d-4731-a09f-f8fca9f18d3e, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:39.544556 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:39.558898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-ff9ed75b-7c91-4b64-8a53-41f016a257c9 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting subnet 7e73bcb0-088d-46bf-8dd4-a976776d8b9c {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:13:39.567664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Releasing vlan 572 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:13:39.568025 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:39.571685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-181f9dcf-29cb-48cd-b76a-4bc753168327 req-bf5559e7-2553-4339-ba2e-691f5fdf2834 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:39.577617 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-181f9dcf-29cb-48cd-b76a-4bc753168327 req-bf5559e7-2553-4339-ba2e-691f5fdf2834 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 0.6049461 May 12 15:13:39.578399 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff9ed75b-7c91-4b64-8a53-41f016a257c9 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: timer() May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:13:39.609118 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:13:39.616266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658a8a9b-6d50-49c5-8ad3-b69e74b315fa req-719881f9-4a1d-4c5f-a011-2f0b067ed2a9 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:39.623908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-658a8a9b-6d50-49c5-8ad3-b69e74b315fa req-719881f9-4a1d-4c5f-a011-2f0b067ed2a9 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 949 time: 0.6524115 May 12 15:13:39.739094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1c9f74-ba79-4d6e-ad50-d3db8cca8d75 req-45d49177-984b-4a86-a7a6-9ccf0d907bd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:39.740091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1c9f74-ba79-4d6e-ad50-d3db8cca8d75 req-45d49177-984b-4a86-a7a6-9ccf0d907bd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:39.740091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1c9f74-ba79-4d6e-ad50-d3db8cca8d75 req-45d49177-984b-4a86-a7a6-9ccf0d907bd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:39.740458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1c9f74-ba79-4d6e-ad50-d3db8cca8d75 req-45d49177-984b-4a86-a7a6-9ccf0d907bd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:39.740927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1c9f74-ba79-4d6e-ad50-d3db8cca8d75 req-45d49177-984b-4a86-a7a6-9ccf0d907bd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:39.741380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1c9f74-ba79-4d6e-ad50-d3db8cca8d75 req-45d49177-984b-4a86-a7a6-9ccf0d907bd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:39.741874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1c9f74-ba79-4d6e-ad50-d3db8cca8d75 req-45d49177-984b-4a86-a7a6-9ccf0d907bd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:39.743818 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dd1c9f74-ba79-4d6e-ad50-d3db8cca8d75 req-45d49177-984b-4a86-a7a6-9ccf0d907bd9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=05b4f1ce61294fb29efb0a765ed28561&device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 6244 time: 0.7644699 May 12 15:13:39.764271 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff9ed75b-7c91-4b64-8a53-41f016a257c9 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:39.814111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-658a8a9b-6d50-49c5-8ad3-b69e74b315fa req-69860369-dcb4-4a3e-b5ab-19784a6d54d8 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1893272 May 12 15:13:39.835358 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-181f9dcf-29cb-48cd-b76a-4bc753168327 req-f9623a77-1e9b-4cef-8f56-e82478a23ec8 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1949527 May 12 15:13:39.883297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] For port 857536b0-998d-4731-a09f-f8fca9f18d3e, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:39.902257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] For port 857536b0-998d-4731-a09f-f8fca9f18d3e, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=857536b0-998d-4731-a09f-f8fca9f18d3e,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:39.914371 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:39.956842 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:40.052999 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff9ed75b-7c91-4b64-8a53-41f016a257c9 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:40.089168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:40.089966 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:40.092682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-72183936-7e79-4663-b54f-09290b8406cb service neutron] 10.222.0.84 "PUT /v2.0/ports/857536b0-998d-4731-a09f-f8fca9f18d3e HTTP/1.1" status: 200 len: 1091 time: 3.6822603 May 12 15:13:40.110088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Network 13bc975a-b248-4de3-b27d-6d14b7951c4b is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:40.112076 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:40.146998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Request body: {'port': {'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:40.168454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:40.261100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] Pushing event deleted for resources: {'Network': ['ID=32cea943-7534-489c-b9f1-17a345bb2737,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:40.335629 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f84b777b-ed83-4e88-a8fd-75090e7f8914 admin admin] 10.222.0.82 "DELETE /v2.0/networks/32cea943-7534-489c-b9f1-17a345bb2737 HTTP/1.1" status: 204 len: 168 time: 3.3976188 May 12 15:13:40.363199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72183936-7e79-4663-b54f-09290b8406cb service neutron] Pushing event updated for resources: {'Port': ['ID=857536b0-998d-4731-a09f-f8fca9f18d3e,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:40.581817 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff9ed75b-7c91-4b64-8a53-41f016a257c9 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:40.633282 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4abd2c3a-c517-4d15-805c-d27c45138fec up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:40.662697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53198) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:40.736038 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-00613954-3d47-4e9a-9233-b29038bb8055 None None] Provisioning complete for port c04fe88c-5805-45f0-b3fd-52b35ea3fe16 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:40.736643 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-00613954-3d47-4e9a-9233-b29038bb8055 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:40.755485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff9ed75b-7c91-4b64-8a53-41f016a257c9 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event deleted for resources: {'Subnet': ['ID=7e73bcb0-088d-46bf-8dd4-a976776d8b9c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:40.798205 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff9ed75b-7c91-4b64-8a53-41f016a257c9 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:40.843327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13d4f36b-21c5-4c36-9207-7ab990d3639f None None] Network 9021e9b2-6c8f-4b20-8148-52e45c2296b3 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:13:40.846503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-42941c02-e87b-4218-be9a-54b11f578ce2 req-69320937-e488-457f-bec2-fdbe01664292 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] For port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:40.846882 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-42941c02-e87b-4218-be9a-54b11f578ce2 req-69320937-e488-457f-bec2-fdbe01664292 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:40.900862 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:40.941604 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ff9ed75b-7c91-4b64-8a53-41f016a257c9 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "DELETE /v2.0/subnets/7e73bcb0-088d-46bf-8dd4-a976776d8b9c HTTP/1.1" status: 204 len: 168 time: 1.5337114 May 12 15:13:40.948571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53206) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:41.003583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': '857536b0-998d-4731-a09f-f8fca9f18d3e'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:41.039378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-42941c02-e87b-4218-be9a-54b11f578ce2 req-69320937-e488-457f-bec2-fdbe01664292 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Calling delete_port for bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:41.041856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f98dc8-b2fd-44a6-8759-d9dc46150d35 req-4f573ae1-3570-4a9f-b623-44330f570660 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:41.048339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f98dc8-b2fd-44a6-8759-d9dc46150d35 req-4f573ae1-3570-4a9f-b623-44330f570660 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:41.054440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f98dc8-b2fd-44a6-8759-d9dc46150d35 req-4f573ae1-3570-4a9f-b623-44330f570660 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:41.061636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f98dc8-b2fd-44a6-8759-d9dc46150d35 req-4f573ae1-3570-4a9f-b623-44330f570660 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:41.067898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f98dc8-b2fd-44a6-8759-d9dc46150d35 req-4f573ae1-3570-4a9f-b623-44330f570660 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:41.077824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f98dc8-b2fd-44a6-8759-d9dc46150d35 req-4f573ae1-3570-4a9f-b623-44330f570660 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:41.084396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f98dc8-b2fd-44a6-8759-d9dc46150d35 req-4f573ae1-3570-4a9f-b623-44330f570660 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:41.087210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52f98dc8-b2fd-44a6-8759-d9dc46150d35 req-4f573ae1-3570-4a9f-b623-44330f570660 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5394 time: 0.9934995 May 12 15:13:41.127842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1c9f74-ba79-4d6e-ad50-d3db8cca8d75 req-27566475-53d3-4e84-a041-47efc243e707 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:41.128499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1c9f74-ba79-4d6e-ad50-d3db8cca8d75 req-27566475-53d3-4e84-a041-47efc243e707 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:41.129064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1c9f74-ba79-4d6e-ad50-d3db8cca8d75 req-27566475-53d3-4e84-a041-47efc243e707 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:41.131029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dd1c9f74-ba79-4d6e-ad50-d3db8cca8d75 req-27566475-53d3-4e84-a041-47efc243e707 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=05b4f1ce61294fb29efb0a765ed28561&shared=False HTTP/1.1" status: 200 len: 2298 time: 1.3461909 May 12 15:13:41.149159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-00613954-3d47-4e9a-9233-b29038bb8055 None None] Port c04fe88c-5805-45f0-b3fd-52b35ea3fe16 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:13:41.175949 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 4abd2c3a-c517-4d15-805c-d27c45138fec completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:41.192435 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4abd2c3a-c517-4d15-805c-d27c45138fec triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:41.192816 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:41.240948 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f81e149c-0f12-4511-b688-4d2124ff2ad7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1469be66fea349e29c86f5666f6e4b1f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5510540 May 12 15:13:41.254586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53212) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:41.352287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0816bc1f-f82c-4d8c-83b7-3693723ea93f None None] DHCP port deletion for 9021e9b2-6c8f-4b20-8148-52e45c2296b3 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:13:41.362037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0816bc1f-f82c-4d8c-83b7-3693723ea93f None None] Deleting port 6a06c973-3d79-4b79-bed8-be79093b0fe4 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:41.362425 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0816bc1f-f82c-4d8c-83b7-3693723ea93f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:41.388861 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52f98dc8-b2fd-44a6-8759-d9dc46150d35 req-a64e8b72-0e63-45ab-b6bf-ca1d44d29b71 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2538669 May 12 15:13:41.393323 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:41.471557 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:41.488482 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeda2bb5-9e82-4dc5-b947-cf1473ef2945 req-025907ae-e500-4a98-afcb-c99ba5d249b8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:41.495498 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aeda2bb5-9e82-4dc5-b947-cf1473ef2945 req-025907ae-e500-4a98-afcb-c99ba5d249b8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 945 time: 0.6759751 May 12 15:13:41.515717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 4abd2c3a-c517-4d15-805c-d27c45138fec, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4abd2c3a-c517-4d15-805c-d27c45138fec,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:41.541215 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:41.559037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting port 6a06c973-3d79-4b79-bed8-be79093b0fe4 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:41.559373 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:41.600200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0f6eb336-8aa0-4482-90ba-260592cd62ac req-a79ade30-7dc7-4599-81ac-6cfaf48e5856 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] For port afe94bd0-1ff9-4d77-b779-c4dc6066222e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=afe94bd0-1ff9-4d77-b779-c4dc6066222e,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:41.600804 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0f6eb336-8aa0-4482-90ba-260592cd62ac req-a79ade30-7dc7-4599-81ac-6cfaf48e5856 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:41.648043 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb5fde10-1753-4702-8eab-92333df01b20 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:41.669993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=4abd2c3a-c517-4d15-805c-d27c45138fec,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:41.788861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-0f6eb336-8aa0-4482-90ba-260592cd62ac req-a79ade30-7dc7-4599-81ac-6cfaf48e5856 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Calling delete_port for afe94bd0-1ff9-4d77-b779-c4dc6066222e owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:41.804556 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aeda2bb5-9e82-4dc5-b947-cf1473ef2945 req-e0842fcd-b22e-4a6c-b0f4-10ecaa4f3cde tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3080997 May 12 15:13:41.854306 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb5fde10-1753-4702-8eab-92333df01b20 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:41.892660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:13:41.999589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0816bc1f-f82c-4d8c-83b7-3693723ea93f None None] For port 6a06c973-3d79-4b79-bed8-be79093b0fe4, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6a06c973-3d79-4b79-bed8-be79093b0fe4,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:42.001068 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0816bc1f-f82c-4d8c-83b7-3693723ea93f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:42.164981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1c9f74-ba79-4d6e-ad50-d3db8cca8d75 req-ab44e577-6ccb-4ee0-93ac-fb52c1095faf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:42.166475 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dd1c9f74-ba79-4d6e-ad50-d3db8cca8d75 req-ab44e577-6ccb-4ee0-93ac-fb52c1095faf service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.7063172 May 12 15:13:42.191554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0816bc1f-f82c-4d8c-83b7-3693723ea93f None None] Calling delete_port for 6a06c973-3d79-4b79-bed8-be79093b0fe4 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:42.298323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:42.329107 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-42941c02-e87b-4218-be9a-54b11f578ce2 req-69320937-e488-457f-bec2-fdbe01664292 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:42.356030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:13:42.357475 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:42.359506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device afe94bd0-1ff9-4d77-b779-c4dc6066222e no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:42.362881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4834ab3b-6306-4f41-81ec-4af4df1f4c1b {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:42.370581 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] For port 6a06c973-3d79-4b79-bed8-be79093b0fe4, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6a06c973-3d79-4b79-bed8-be79093b0fe4,segment=NetworkSegment(8037e7d9-36c9-4cfc-9420-983f2660ddef),segment_id=8037e7d9-36c9-4cfc-9420-983f2660ddef)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:42.371848 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:42.390531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3678ede0-c4ba-466b-9b7a-ce933f77193e req-df689fae-9a25-4a46-9c5e-a365d043c381 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:42.392468 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3678ede0-c4ba-466b-9b7a-ce933f77193e req-df689fae-9a25-4a46-9c5e-a365d043c381 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=356d3884-ccc1-4305-bdd1-7231fe627d9f HTTP/1.1" status: 200 len: 949 time: 0.7254188 May 12 15:13:42.396337 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:42.477291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81', '8c301fff-eebe-4ee3-ae47-9da749d76d58'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:42.514386 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69320937-e488-457f-bec2-fdbe01664292 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event deleted for resources: {'Port': ['ID=bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:42.541598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3ae73679-d198-440a-966c-619a9930fbcb', '83a7b910-a912-4e05-9d03-5d6b1f6b0edc', '9c35d53f-6773-4ce7-9642-3b542a20efa8', 'fa933a35-7a96-4a45-bb36-afb53c7641b9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:42.565884 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb5fde10-1753-4702-8eab-92333df01b20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:42.581778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Calling delete_port for 6a06c973-3d79-4b79-bed8-be79093b0fe4 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:42.602233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-42941c02-e87b-4218-be9a-54b11f578ce2 req-69320937-e488-457f-bec2-fdbe01664292 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] No DVR routers for this DVR port bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:13:42.605367 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0816bc1f-f82c-4d8c-83b7-3693723ea93f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:42.607474 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-42941c02-e87b-4218-be9a-54b11f578ce2 req-69320937-e488-457f-bec2-fdbe01664292 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:42.610542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '356d3884-ccc1-4305-bdd1-7231fe627d9f', 'name': 'network-vif-deleted', 'tag': 'bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:42.616740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Transition to ACTIVE for port object 4834ab3b-6306-4f41-81ec-4af4df1f4c1b will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:42.619240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:13:42.634017 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Sync routers for ids ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:13:42.635215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4abd2c3a-c517-4d15-805c-d27c45138fec up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:42.638553 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0f6eb336-8aa0-4482-90ba-260592cd62ac req-a79ade30-7dc7-4599-81ac-6cfaf48e5856 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:42.649987 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Routers {'86f12517-ac09-4f4e-b30f-f7f1a1aa3190'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:13:42.650993 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:13:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:42.651494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb5fde10-1753-4702-8eab-92333df01b20 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e111c4b-1113-4087-a7d2-6eb288fd40e0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:42.655279 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:42.718574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a79ade30-7dc7-4599-81ac-6cfaf48e5856 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event deleted for resources: {'Port': ['ID=afe94bd0-1ff9-4d77-b779-c4dc6066222e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:42.739431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3678ede0-c4ba-466b-9b7a-ce933f77193e req-f525dd3d-31ef-4a78-aa33-c06215047d01 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3352826 May 12 15:13:42.741227 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb5fde10-1753-4702-8eab-92333df01b20 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:42.744622 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fb5fde10-1753-4702-8eab-92333df01b20 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0e111c4b-1113-4087-a7d2-6eb288fd40e0 HTTP/1.1" status: 204 len: 168 time: 1.4863300 May 12 15:13:42.817246 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-42941c02-e87b-4218-be9a-54b11f578ce2 req-69320937-e488-457f-bec2-fdbe01664292 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "DELETE /v2.0/ports/bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea HTTP/1.1" status: 204 len: 173 time: 3.6233571 May 12 15:13:42.891493 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-02623600-9ede-4155-b2eb-a5ca39dedb46 admin admin] 10.222.0.82 "PUT /v2.0/routers/86f12517-ac09-4f4e-b30f-f7f1a1aa3190/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.5800261 May 12 15:13:42.900291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-0f6eb336-8aa0-4482-90ba-260592cd62ac req-a79ade30-7dc7-4599-81ac-6cfaf48e5856 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] No DVR routers for this DVR port afe94bd0-1ff9-4d77-b779-c4dc6066222e on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:13:42.915443 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0f6eb336-8aa0-4482-90ba-260592cd62ac req-a79ade30-7dc7-4599-81ac-6cfaf48e5856 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:42.920055 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f6eb336-8aa0-4482-90ba-260592cd62ac req-a79ade30-7dc7-4599-81ac-6cfaf48e5856 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "DELETE /v2.0/ports/afe94bd0-1ff9-4d77-b779-c4dc6066222e HTTP/1.1" status: 204 len: 173 time: 3.8375819 May 12 15:13:42.985544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0816bc1f-f82c-4d8c-83b7-3693723ea93f None None] Pushing event deleted for resources: {'Port': ['ID=6a06c973-3d79-4b79-bed8-be79093b0fe4,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:43.029569 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-27f11462-6ed2-4572-81b0-28cd17dbab96'] response: {'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': '857536b0-998d-4731-a09f-f8fca9f18d3e', 'status': 'completed', 'code': 200} May 12 15:13:43.122616 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a04d924-e55b-45d6-97d9-840a39339708 req-5f3bbc24-e702-45e1-ab45-7312db6c0cf1 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.131651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a04d924-e55b-45d6-97d9-840a39339708 req-5f3bbc24-e702-45e1-ab45-7312db6c0cf1 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 0.9602163 May 12 15:13:43.186232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No active binding found for port afe94bd0-1ff9-4d77-b779-c4dc6066222e {{(pid=88153) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:224}} May 12 15:13:43.188191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device afe94bd0-1ff9-4d77-b779-c4dc6066222e not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:43.244900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0816bc1f-f82c-4d8c-83b7-3693723ea93f None None] No DVR routers for this DVR port 6a06c973-3d79-4b79-bed8-be79093b0fe4 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:13:43.280548 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1675248c-f1ff-4b66-ad6b-b348043f864f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:43.289925 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Set router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:13:43.303290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Pushing event updated for resources: {'Port': ['ID=4834ab3b-6306-4f41-81ec-4af4df1f4c1b,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:43.419413 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:43.539798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184fbc6d-ccd4-415f-954d-738053ac7744 req-b48fb5b6-e097-4f9a-8443-7325629c83ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.541565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184fbc6d-ccd4-415f-954d-738053ac7744 req-b48fb5b6-e097-4f9a-8443-7325629c83ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.543292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184fbc6d-ccd4-415f-954d-738053ac7744 req-b48fb5b6-e097-4f9a-8443-7325629c83ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.543779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184fbc6d-ccd4-415f-954d-738053ac7744 req-b48fb5b6-e097-4f9a-8443-7325629c83ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.544255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184fbc6d-ccd4-415f-954d-738053ac7744 req-b48fb5b6-e097-4f9a-8443-7325629c83ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.545444 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a04d924-e55b-45d6-97d9-840a39339708 req-d4fddde0-2abc-42fd-bcbc-fc7fdff69394 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4138546 May 12 15:13:43.546132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184fbc6d-ccd4-415f-954d-738053ac7744 req-b48fb5b6-e097-4f9a-8443-7325629c83ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.546637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184fbc6d-ccd4-415f-954d-738053ac7744 req-b48fb5b6-e097-4f9a-8443-7325629c83ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.548646 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-184fbc6d-ccd4-415f-954d-738053ac7744 req-b48fb5b6-e097-4f9a-8443-7325629c83ea service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=05b4f1ce61294fb29efb0a765ed28561&device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 6311 time: 0.2728970 May 12 15:13:43.596256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4abd2c3a-c517-4d15-805c-d27c45138fec triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:43.596660 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:43.691206 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-04977f16-5788-4cd8-b83c-710a3b208e1c'] response: {'server_uuid': '356d3884-ccc1-4305-bdd1-7231fe627d9f', 'name': 'network-vif-deleted', 'tag': 'bb5a5fe7-9ea7-4780-87e6-00220d9bd5ea', 'status': 'completed', 'code': 200} May 12 15:13:43.718369 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:13:43.718787 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:13:43.827457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Attempting to bind port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:43.827833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Attempting to bind port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:43.828086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Attempting to bind port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:43.840029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:13:43.840379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Attempting to bind port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:43.868304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163b8170-bcce-4451-88a2-7687c96981bd req-1b17e310-d1da-4c21-9c37-0540939bcdbd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.875940 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163b8170-bcce-4451-88a2-7687c96981bd req-1b17e310-d1da-4c21-9c37-0540939bcdbd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.879419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184fbc6d-ccd4-415f-954d-738053ac7744 req-b46d7856-7825-4406-a8bf-5b885daabc5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.880000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184fbc6d-ccd4-415f-954d-738053ac7744 req-b46d7856-7825-4406-a8bf-5b885daabc5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.880463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184fbc6d-ccd4-415f-954d-738053ac7744 req-b46d7856-7825-4406-a8bf-5b885daabc5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.882118 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-184fbc6d-ccd4-415f-954d-738053ac7744 req-b46d7856-7825-4406-a8bf-5b885daabc5e service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=05b4f1ce61294fb29efb0a765ed28561&shared=False HTTP/1.1" status: 200 len: 2298 time: 0.3151076 May 12 15:13:43.883105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163b8170-bcce-4451-88a2-7687c96981bd req-1b17e310-d1da-4c21-9c37-0540939bcdbd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.890139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163b8170-bcce-4451-88a2-7687c96981bd req-1b17e310-d1da-4c21-9c37-0540939bcdbd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.897469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163b8170-bcce-4451-88a2-7687c96981bd req-1b17e310-d1da-4c21-9c37-0540939bcdbd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.904206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163b8170-bcce-4451-88a2-7687c96981bd req-1b17e310-d1da-4c21-9c37-0540939bcdbd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.911641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163b8170-bcce-4451-88a2-7687c96981bd req-1b17e310-d1da-4c21-9c37-0540939bcdbd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:43.913636 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-163b8170-bcce-4451-88a2-7687c96981bd req-1b17e310-d1da-4c21-9c37-0540939bcdbd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5406 time: 0.4701686 May 12 15:13:43.914436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:43.914761 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Checking segment: {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:43.915134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Bound using segment: {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:43.915626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Bound port: 4834ab3b-6306-4f41-81ec-4af4df1f4c1b, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b6fbbd36-13c3-4b1d-bb92-589caea03666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:43.915964 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:43.978898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a6bb6a4-8e89-455a-bbf7-d7938527ca1b req-f6761972-850c-4dc5-8856-0e6baaabc0c8 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.4323070 May 12 15:13:44.077962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2162bce-f6a4-4fdf-a19a-108e210dc25c req-fc91f5ba-c165-4ad8-9f32-a078fab8d3d0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c4eb2cc-a1cc-47ef-915b-beb583a717ed HTTP/1.1" status: 200 len: 210 time: 0.1250780 May 12 15:13:44.173800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] For port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:44.177496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] For port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4834ab3b-6306-4f41-81ec-4af4df1f4c1b,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:44.258792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting port 6a06c973-3d79-4b79-bed8-be79093b0fe4 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:44.259849 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:44.342207 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:13:36Z', 'revision_number': 4, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c04fe88c-5805-45f0-b3fd-52b35ea3fe16', 'name': '', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'mac_address': 'fa:16:3e:8e:94:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_interface', 'standard_attr_id': 963, 'fixed_ips': [{'subnet_id': '9a114164-5df9-48f9-8806-96a06aeff952', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:35Z', 'updated_at': '2022-05-12T15:13:37Z', 'revision_number': 2, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'subnets': [{'id': '9a114164-5df9-48f9-8806-96a06aeff952', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:44.354785 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:44.356362 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Checking router: 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:13:44.356710 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Updating router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 port c04fe88c-5805-45f0-b3fd-52b35ea3fe16 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:13:44.490651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184fbc6d-ccd4-415f-954d-738053ac7744 req-6fa2725c-dcbf-4c19-9028-23c75024cd3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:44.495070 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-184fbc6d-ccd4-415f-954d-738053ac7744 req-6fa2725c-dcbf-4c19-9028-23c75024cd3a service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.5517030 May 12 15:13:44.579772 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:44.594236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] The port '6a06c973-3d79-4b79-bed8-be79093b0fe4' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:13:44.684885 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-163b8170-bcce-4451-88a2-7687c96981bd req-4a11bf1e-ec9a-4be4-a2b3-458de51768e3 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.7551074 May 12 15:13:44.697312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:44.698340 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:44.700894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] 10.222.0.84 "PUT /v2.0/ports/4834ab3b-6306-4f41-81ec-4af4df1f4c1b HTTP/1.1" status: 200 len: 1091 time: 4.5577002 May 12 15:13:44.711173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6a06c973-3d79-4b79-bed8-be79093b0fe4 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:44.842925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Request body: {'port': {'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:44.871774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 6a06c973-3d79-4b79-bed8-be79093b0fe4 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:13:44.873127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6a06c973-3d79-4b79-bed8-be79093b0fe4 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:44.991148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53270) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:45.010705 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9f1bb067-3e52-47bf-a4b9-af6a505700f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.239438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': '4834ab3b-6306-4f41-81ec-4af4df1f4c1b'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:45.282608 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.297824 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Transition to ACTIVE for port object c04fe88c-5805-45f0-b3fd-52b35ea3fe16 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:45.315239 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.325228 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.335771 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Request body: {'network': {'name': 'tempest-TaggedBootDevicesTest-1360490356-network', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:45.343352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:45.349692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Usage tracker for resource:network and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:45.361866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:45.378311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:45.379442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7964ca90-7e1c-45df-91f4-ecb44b403d47 service neutron] Pushing event updated for resources: {'Port': ['ID=4834ab3b-6306-4f41-81ec-4af4df1f4c1b,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:45.394595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Made reservation on behalf of 42581a8af83242e0bb61f84a30bd27a7 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:45.400322 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.419597 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.443859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:45.448708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Usage tracker for resource:security_group_rule and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:45.452497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:45.462272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:45.482908 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a63b179e-f25c-4f81-b7e5-04d4ac404636 None None] Pushing event updated for resources: {'Port': ['ID=c04fe88c-5805-45f0-b3fd-52b35ea3fe16,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:45.610158 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Attempting to bind port c04fe88c-5805-45f0-b3fd-52b35ea3fe16 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:45.610655 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Attempting to bind port c04fe88c-5805-45f0-b3fd-52b35ea3fe16 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'fc4158ff-96b8-4d00-981b-81b5cdb89988', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:45.612183 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Attempting to bind port c04fe88c-5805-45f0-b3fd-52b35ea3fe16 on network 13bc975a-b248-4de3-b27d-6d14b7951c4b {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:45.616999 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.620196 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:45.620888 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Checking segment: {'id': 'fc4158ff-96b8-4d00-981b-81b5cdb89988', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:45.622292 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.622888 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Bound using segment: {'id': 'fc4158ff-96b8-4d00-981b-81b5cdb89988', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:45.623644 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Bound port: c04fe88c-5805-45f0-b3fd-52b35ea3fe16, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fc4158ff-96b8-4d00-981b-81b5cdb89988', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:45.624119 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.625360 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.663807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 550} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:13:45.675829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8814ef16-03ed-468a-b207-7c8497a79fc0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:45.682688 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.683115 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Added segment 7c4990b9-5a5f-484e-a357-c9a37d811129 of type vlan for network 939fdac4-3043-4213-bd31-a421a6c659bc May 12 15:13:45.693476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c4eb2cc-a1cc-47ef-915b-beb583a717ed', 'name': 'network-vif-deleted', 'tag': 'afe94bd0-1ff9-4d77-b779-c4dc6066222e'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:45.724301 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.737932 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.743224 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] For port c04fe88c-5805-45f0-b3fd-52b35ea3fe16, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:45.748372 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] For port c04fe88c-5805-45f0-b3fd-52b35ea3fe16, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c04fe88c-5805-45f0-b3fd-52b35ea3fe16,segment=NetworkSegment(fc4158ff-96b8-4d00-981b-81b5cdb89988),segment_id=fc4158ff-96b8-4d00-981b-81b5cdb89988)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:45.754230 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.760300 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.761442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:45.763434 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:45.792876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a6bb6a4-8e89-455a-bbf7-d7938527ca1b req-12a05e89-3210-4d7a-8e2c-514ada9f0f70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:45.794011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a6bb6a4-8e89-455a-bbf7-d7938527ca1b req-12a05e89-3210-4d7a-8e2c-514ada9f0f70 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 1100 time: 1.7121475 May 12 15:13:45.825836 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9021e9b2-6c8f-4b20-8148-52e45c2296b3']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:45.857439 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Routers {'86f12517-ac09-4f4e-b30f-f7f1a1aa3190'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:13:45.858137 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:13:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:45.921761 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a63b179e-f25c-4f81-b7e5-04d4ac404636 None None] Pushing event updated for resources: {'Port': ['ID=c04fe88c-5805-45f0-b3fd-52b35ea3fe16,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:45.976445 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:46.017125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8037e7d9-36c9-4cfc-9420-983f2660ddef') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:46.017533 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8037e7d9-36c9-4cfc-9420-983f2660ddef') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:46.061372 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.0667453 May 12 15:13:46.071737 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:46.073380 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:46.080880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53286) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:46.085859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a6bb6a4-8e89-455a-bbf7-d7938527ca1b req-941ccaf4-f440-4dcc-a13a-06eb0c30cc78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:46.087267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a6bb6a4-8e89-455a-bbf7-d7938527ca1b req-941ccaf4-f440-4dcc-a13a-06eb0c30cc78 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.2702057 May 12 15:13:46.093850 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] Set router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:13:46.096741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1c78044-d932-4b76-ad75-6233be7e48e1 admin admin] Pushing event updated for resources: {'Network': ['ID=939fdac4-3043-4213-bd31-a421a6c659bc,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:46.109025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 939fdac4-3043-4213-bd31-a421a6c659bc details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:13:46.154817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Request body: {'subnet': {'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'cidr': '172.20.0.0/28', 'name': 'tempest-TaggedBootDevicesTest-1360490356-subnet', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:46.195176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:46.202771 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:46.209179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a6bb6a4-8e89-455a-bbf7-d7938527ca1b req-e19e8dd5-032a-412a-8b0b-240958a8b6d8 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.27&port_id=f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 HTTP/1.1" status: 200 len: 217 time: 0.1114621 May 12 15:13:46.212245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Usage tracker for resource:subnet and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:46.219133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:46.233763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-e0b9fb6d-b258-48b5-b122-32d06f16bb13 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:46.234451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-e0b9fb6d-b258-48b5-b122-32d06f16bb13 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Synchronizing usage tracker for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:46.239644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Releasing vlan 577 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:13:46.240270 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: timer() May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:13:46.291662 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:13:46.297086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:46.408857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Made reservation on behalf of 42581a8af83242e0bb61f84a30bd27a7 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:46.411040 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:46.445552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7144d78b-b0dd-496c-9e0f-b07f90fa99b3 req-0e7478de-845f-4b3e-88dd-23771e83bb26 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:46.446967 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7144d78b-b0dd-496c-9e0f-b07f90fa99b3 req-0e7478de-845f-4b3e-88dd-23771e83bb26 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 1.1339562 May 12 15:13:46.481415 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:13:36Z', 'revision_number': 4, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c04fe88c-5805-45f0-b3fd-52b35ea3fe16', 'name': '', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'mac_address': 'fa:16:3e:8e:94:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_interface', 'standard_attr_id': 963, 'fixed_ips': [{'subnet_id': '9a114164-5df9-48f9-8806-96a06aeff952', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:35Z', 'updated_at': '2022-05-12T15:13:45Z', 'revision_number': 4, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'subnets': [{'id': '9a114164-5df9-48f9-8806-96a06aeff952', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:13:46.485494 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53f257b1-9350-4f35-aee2-8aaeb714445e None None] The sync data for ids ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'] in n-d-841483-1 is: [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:13:36Z', 'revision_number': 4, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c04fe88c-5805-45f0-b3fd-52b35ea3fe16', 'name': '', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'mac_address': 'fa:16:3e:8e:94:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_interface', 'standard_attr_id': 963, 'fixed_ips': [{'subnet_id': '9a114164-5df9-48f9-8806-96a06aeff952', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:35Z', 'updated_at': '2022-05-12T15:13:45Z', 'revision_number': 4, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'subnets': [{'id': '9a114164-5df9-48f9-8806-96a06aeff952', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:13:46.509832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-e0b9fb6d-b258-48b5-b122-32d06f16bb13 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Unset dirty status for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:46.510948 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-e0b9fb6d-b258-48b5-b122-32d06f16bb13 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/networks?id=13bc975a-b248-4de3-b27d-6d14b7951c4b HTTP/1.1" status: 200 len: 829 time: 1.5606198 May 12 15:13:46.573260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a6bb6a4-8e89-455a-bbf7-d7938527ca1b req-15675786-3d34-4cb5-b59c-6b62a6594c5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:46.575410 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a6bb6a4-8e89-455a-bbf7-d7938527ca1b req-15675786-3d34-4cb5-b59c-6b62a6594c5a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3533652 May 12 15:13:46.602073 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:46.678883 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:46.688435 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-ecacb00a-2f18-486d-b5ea-a0c956844bc6 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/quotas/a687923521d64fba8b0ceae3dbf4d7d3 HTTP/1.1" status: 200 len: 375 time: 0.1169236 May 12 15:13:46.711131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:46.715394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event deleted for resources: {'Network': ['ID=9021e9b2-6c8f-4b20-8148-52e45c2296b3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:46.760789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a2eb37f9-aba2-47d2-9756-11109b082c05 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:46.799120 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:46.819878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fe265bc8-0026-4b34-8926-c8b327826691 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "DELETE /v2.0/networks/9021e9b2-6c8f-4b20-8148-52e45c2296b3 HTTP/1.1" status: 204 len: 168 time: 5.8665130 May 12 15:13:46.820127 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7144d78b-b0dd-496c-9e0f-b07f90fa99b3 req-115999a6-160d-4f7a-b5b7-15a69c860fe3 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3643224 May 12 15:13:46.820685 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53292) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:46.834342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-1504106765'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:46.850983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:46.851250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Transition to ACTIVE for port object a2eb37f9-aba2-47d2-9756-11109b082c05 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:46.864500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Usage tracker for resource:network and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:46.869577 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:46.873370 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:46.880036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:46.910675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:46.915835 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:46.953662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 563} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:13:46.967116 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:46.967472 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Added segment 8ffe4223-2972-4274-85b3-fbe4e0a1c649 of type vlan for network cc2308f9-d1ec-4568-bf98-60c7e336ff78 May 12 15:13:47.001511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:47.056103 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c04fe88c-5805-45f0-b3fd-52b35ea3fe16 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:47.066798 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:47.081662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:47.082311 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:47.199113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port c04fe88c-5805-45f0-b3fd-52b35ea3fe16 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:47.210132 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c04fe88c-5805-45f0-b3fd-52b35ea3fe16 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:47.221006 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:47.310610 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 774 time: 0.4878056 May 12 15:13:47.314697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53300) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:47.329941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Request body: {'subnet': {'network_id': 'cc2308f9-d1ec-4568-bf98-60c7e336ff78', 'cidr': '19.80.0.0/24', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:47.392275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c89ccd9-3fab-479a-9cef-bc41ad363ec7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event updated for resources: {'Network': ['ID=cc2308f9-d1ec-4568-bf98-60c7e336ff78,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:47.407447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network cc2308f9-d1ec-4568-bf98-60c7e336ff78 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:13:47.470109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a6bb6a4-8e89-455a-bbf7-d7938527ca1b req-41f276eb-d82e-46be-8f4c-09a68ee696f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:47.471575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a6bb6a4-8e89-455a-bbf7-d7938527ca1b req-41f276eb-d82e-46be-8f4c-09a68ee696f3 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.8732836 May 12 15:13:47.473361 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-faa2d05f-7720-4089-94f3-1f500757a54c'] response: {'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': '4834ab3b-6306-4f41-81ec-4af4df1f4c1b', 'status': 'completed', 'code': 200} May 12 15:13:47.506182 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-af251aa9-63b6-46ff-a0d5-e00582e798dc'] response: {'server_uuid': '7c4eb2cc-a1cc-47ef-915b-beb583a717ed', 'name': 'network-vif-deleted', 'tag': 'afe94bd0-1ff9-4d77-b779-c4dc6066222e', 'status': 'completed', 'code': 200} May 12 15:13:47.530958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Pushing event updated for resources: {'Port': ['ID=a2eb37f9-aba2-47d2-9756-11109b082c05,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:47.533411 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:47.634606 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-dd3ce79a-ac85-4726-9a03-5096868f84d3 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=a687923521d64fba8b0ceae3dbf4d7d3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.9286401 May 12 15:13:47.646606 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:47.661672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:47.665016 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:47.666427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Usage tracker for resource:subnet and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:47.670585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:47.679055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:47.700170 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port c04fe88c-5805-45f0-b3fd-52b35ea3fe16, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c04fe88c-5805-45f0-b3fd-52b35ea3fe16,segment=NetworkSegment(fc4158ff-96b8-4d00-981b-81b5cdb89988),segment_id=fc4158ff-96b8-4d00-981b-81b5cdb89988)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:47.700868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2091ec5-b49f-4463-a2ef-12c8e797a388 req-b0d92f7e-9f83-449f-9ab7-893425b710d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:47.701333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2091ec5-b49f-4463-a2ef-12c8e797a388 req-b0d92f7e-9f83-449f-9ab7-893425b710d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:47.702022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2091ec5-b49f-4463-a2ef-12c8e797a388 req-b0d92f7e-9f83-449f-9ab7-893425b710d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:47.702483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2091ec5-b49f-4463-a2ef-12c8e797a388 req-b0d92f7e-9f83-449f-9ab7-893425b710d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:47.702999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2091ec5-b49f-4463-a2ef-12c8e797a388 req-b0d92f7e-9f83-449f-9ab7-893425b710d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:47.703574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2091ec5-b49f-4463-a2ef-12c8e797a388 req-b0d92f7e-9f83-449f-9ab7-893425b710d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:47.704877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2091ec5-b49f-4463-a2ef-12c8e797a388 req-b0d92f7e-9f83-449f-9ab7-893425b710d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:47.705269 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:47.708125 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d2091ec5-b49f-4463-a2ef-12c8e797a388 req-b0d92f7e-9f83-449f-9ab7-893425b710d7 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=05b4f1ce61294fb29efb0a765ed28561&device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 6378 time: 0.2009108 May 12 15:13:47.711094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:47.716779 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:47.805751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=c04fe88c-5805-45f0-b3fd-52b35ea3fe16,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:47.934076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c7af977d-fe6b-4182-af40-d4c2523b54a3,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:47.998035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2091ec5-b49f-4463-a2ef-12c8e797a388 req-7ef01e29-bab2-46c8-980c-903f393937b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:47.998511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2091ec5-b49f-4463-a2ef-12c8e797a388 req-7ef01e29-bab2-46c8-980c-903f393937b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:47.998978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2091ec5-b49f-4463-a2ef-12c8e797a388 req-7ef01e29-bab2-46c8-980c-903f393937b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:47.999412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Checking segment: {'id': '7c4990b9-5a5f-484e-a357-c9a37d811129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:47.999772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Network hostable DHCP agents. Network: 939fdac4-3043-4213-bd31-a421a6c659bc, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:13:48.000534 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d2091ec5-b49f-4463-a2ef-12c8e797a388 req-7ef01e29-bab2-46c8-980c-903f393937b1 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=05b4f1ce61294fb29efb0a765ed28561&shared=False HTTP/1.1" status: 200 len: 2298 time: 0.2668493 May 12 15:13:48.005324 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a6bb6a4-8e89-455a-bbf7-d7938527ca1b req-c014f392-86fb-4306-bd3d-0af4f275721a service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5176895 May 12 15:13:48.046810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Attempting to bind port a2eb37f9-aba2-47d2-9756-11109b082c05 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:48.047144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Attempting to bind port a2eb37f9-aba2-47d2-9756-11109b082c05 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '4d535119-7517-4056-aef4-603b1fd140c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:48.047469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Attempting to bind port a2eb37f9-aba2-47d2-9756-11109b082c05 on network 187794df-e6cb-4ee3-8b40-6b546c229bd2 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:48.123944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Port a2eb37f9-aba2-47d2-9756-11109b082c05 on network 187794df-e6cb-4ee3-8b40-6b546c229bd2 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:13:48.124277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Attempting to bind port a2eb37f9-aba2-47d2-9756-11109b082c05 on network 187794df-e6cb-4ee3-8b40-6b546c229bd2 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:48.154306 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-fa6eb74f-275d-4330-bfce-93c6f8eafe52 service neutron] 10.222.0.82 "GET /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4753804 May 12 15:13:48.154999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:48.155328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Checking segment: {'id': '4d535119-7517-4056-aef4-603b1fd140c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:48.155702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Bound using segment: {'id': '4d535119-7517-4056-aef4-603b1fd140c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:48.156131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Bound port: a2eb37f9-aba2-47d2-9756-11109b082c05, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4d535119-7517-4056-aef4-603b1fd140c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:48.156468 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:48.204114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9fbcef-500e-4932-8447-17ccff5e2f7f req-db37563f-afe0-4b2a-a82c-215fcaa94410 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:48.209845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9fbcef-500e-4932-8447-17ccff5e2f7f req-db37563f-afe0-4b2a-a82c-215fcaa94410 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:48.215701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9fbcef-500e-4932-8447-17ccff5e2f7f req-db37563f-afe0-4b2a-a82c-215fcaa94410 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:48.221478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9fbcef-500e-4932-8447-17ccff5e2f7f req-db37563f-afe0-4b2a-a82c-215fcaa94410 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:48.222760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2091ec5-b49f-4463-a2ef-12c8e797a388 req-3548cd18-99fe-4d1c-bae3-76e89d710a1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:48.224256 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d2091ec5-b49f-4463-a2ef-12c8e797a388 req-3548cd18-99fe-4d1c-bae3-76e89d710a1b service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2161241 May 12 15:13:48.225177 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:48.227237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9fbcef-500e-4932-8447-17ccff5e2f7f req-db37563f-afe0-4b2a-a82c-215fcaa94410 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:48.233534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9fbcef-500e-4932-8447-17ccff5e2f7f req-db37563f-afe0-4b2a-a82c-215fcaa94410 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:48.239265 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9fbcef-500e-4932-8447-17ccff5e2f7f req-db37563f-afe0-4b2a-a82c-215fcaa94410 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:48.241167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c9fbcef-500e-4932-8447-17ccff5e2f7f req-db37563f-afe0-4b2a-a82c-215fcaa94410 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5418 time: 0.6142478 May 12 15:13:48.255213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Network 939fdac4-3043-4213-bd31-a421a6c659bc is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:13:48.303143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event updated for resources: {'Subnet': ['ID=95022f85-d8df-4537-b394-3df92c22f710,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:48.316326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Checking segment: {'id': '8ffe4223-2972-4274-85b3-fbe4e0a1c649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'cc2308f9-d1ec-4568-bf98-60c7e336ff78'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:48.316764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Network hostable DHCP agents. Network: cc2308f9-d1ec-4568-bf98-60c7e336ff78, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:13:48.359088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Network cc2308f9-d1ec-4568-bf98-60c7e336ff78 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:13:48.365844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, cc2308f9-d1ec-4568-bf98-60c7e336ff78) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:48.370750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:48.373037 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:48.376272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0769abee-f1d4-43a8-a2ef-d995f23706cb None None] Network cc2308f9-d1ec-4568-bf98-60c7e336ff78 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:13:48.392915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 939fdac4-3043-4213-bd31-a421a6c659bc) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:48.404679 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-93a5cd7f-e1d3-4dd6-80dd-aaeec9feb4ca tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 798 time: 1.0868068 May 12 15:13:48.404885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53308) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:48.413639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-1591897185'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:48.419815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:48.424218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Usage tracker for resource:network and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:48.427778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:48.429882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:48.430468 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:48.434776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:48.447683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:48.451984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:48.453359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12d3865e-43b6-411a-ac9e-97795d2ee428 None None] Network 939fdac4-3043-4213-bd31-a421a6c659bc requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:13:48.483208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 554} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:13:48.491061 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c9fbcef-500e-4932-8447-17ccff5e2f7f req-05694195-dc76-4246-b512-97a7225e2533 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2388301 May 12 15:13:48.492958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a6bb6a4-8e89-455a-bbf7-d7938527ca1b req-5a6ae393-241c-4296-a0ea-5fbbf519bb9a service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4716089 May 12 15:13:48.498074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:48.498486 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Added segment 3176ebc9-22db-4ad4-84e4-d78f669f2179 of type vlan for network a77dc623-3230-4c49-bb40-819a554177b1 May 12 15:13:48.511927 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9a61aeaa-1985-49f1-812c-911df198f915 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 2.4278181 May 12 15:13:48.516048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53312) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:48.540716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:48.545114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Request body: {'router': {'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:48.553585 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:48.561930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] For port a2eb37f9-aba2-47d2-9756-11109b082c05, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:48.564187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Usage tracker for resource:router and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:48.568399 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-420607f9-2122-4b30-806f-0a9569327869 service neutron] 10.222.0.82 "GET /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3979859 May 12 15:13:48.570350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:48.578064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:48.581054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] For port a2eb37f9-aba2-47d2-9756-11109b082c05, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a2eb37f9-aba2-47d2-9756-11109b082c05,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:48.594169 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:48.609022 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:48.620345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:48.626924 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:48.666524 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:48.668299 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:48.686329 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:48.768622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:13:48.772276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:48.787721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:48.788737 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:48.790560 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] 10.222.0.84 "PUT /v2.0/ports/a2eb37f9-aba2-47d2-9756-11109b082c05 HTTP/1.1" status: 200 len: 1091 time: 3.9544063 May 12 15:13:48.826898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event updated for resources: {'Network': ['ID=a77dc623-3230-4c49-bb40-819a554177b1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:48.848740 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-885db9fb-6827-4172-809e-f3a213fba669 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 774 time: 0.4425642 May 12 15:13:48.849367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53322) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:13:48.858020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Request body: {'subnet': {'network_id': 'a77dc623-3230-4c49-bb40-819a554177b1', 'cidr': '19.86.0.0/24', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:48.886521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network a77dc623-3230-4c49-bb40-819a554177b1 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:13:49.031297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Request body: {'port': {'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:49.189261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1acb797-6666-4c7e-abb1-d27ef7817569 service neutron] Pushing event updated for resources: {'Port': ['ID=a2eb37f9-aba2-47d2-9756-11109b082c05,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:49.413094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:49.423884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Usage tracker for resource:subnet and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:49.430059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:49.444127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:49.480866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8483e03-20db-47cd-bd7e-1b49ae6377dc req-73d9b488-04e9-4fec-8d6a-bdbc8125c80b tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:49.481494 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:49.481964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c8483e03-20db-47cd-bd7e-1b49ae6377dc req-73d9b488-04e9-4fec-8d6a-bdbc8125c80b tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Synchronizing usage tracker for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:49.487696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:49.492976 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:49.505703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c04fe88c-5805-45f0-b3fd-52b35ea3fe16 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:49.606937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6', 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb', 'port_id': '79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6', 'mac_address': 'fa:16:3e:7f:be:35', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 573, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b6cc6b5a-d56a-4336-afb7-99232d9672dc', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:13:49.747761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c8483e03-20db-47cd-bd7e-1b49ae6377dc req-73d9b488-04e9-4fec-8d6a-bdbc8125c80b tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Unset dirty status for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:49.751694 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:49.751949 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8483e03-20db-47cd-bd7e-1b49ae6377dc req-73d9b488-04e9-4fec-8d6a-bdbc8125c80b tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/ports?device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 950 time: 0.7955525 May 12 15:13:49.760180 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-cc2308f9-d1ec-4568-bf98-60c7e336ff78', 'network_id': 'cc2308f9-d1ec-4568-bf98-60c7e336ff78', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'fixed_ips': [{'subnet_id': '95022f85-d8df-4537-b394-3df92c22f710'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:13:49.761239 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:49.796882 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:13:49.853276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': 'a2eb37f9-aba2-47d2-9756-11109b082c05'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:49.884701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:49.904953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:50.067767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-c8483e03-20db-47cd-bd7e-1b49ae6377dc req-c021933b-8987-488f-b751-b7c03ae3715e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Deleting port fa933a35-7a96-4a45-bb36-afb53c7641b9 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:13:50.068482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8483e03-20db-47cd-bd7e-1b49ae6377dc req-c021933b-8987-488f-b751-b7c03ae3715e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:50.069827 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:50.071670 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:50.081592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-939fdac4-3043-4213-bd31-a421a6c659bc', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'fixed_ips': [{'subnet_id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:13:50.082645 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:50.118687 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:50.158125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df01104-0b2e-49cc-854a-982be2eee175 req-208036b4-f552-4943-9076-4c00059fe4e0 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:50.166023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1df01104-0b2e-49cc-854a-982be2eee175 req-208036b4-f552-4943-9076-4c00059fe4e0 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 950 time: 1.5096378 May 12 15:13:50.175433 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Allocated IP 19.80.0.2 (cc2308f9-d1ec-4568-bf98-60c7e336ff78/95022f85-d8df-4537-b394-3df92c22f710/e4457ad6-9fe6-46af-85db-912f5b5167ef) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:50.233926 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:50.350301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1df01104-0b2e-49cc-854a-982be2eee175 req-49606721-3986-4d0b-b354-d7c7ce931b07 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1714461 May 12 15:13:50.427399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:50.495299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba47ed9-9172-4956-ac1d-9ad1c8d5f85a req-85a25416-c767-4ccf-ad23-85a60a9cacd6 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:50.501982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c04fe88c-5805-45f0-b3fd-52b35ea3fe16 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:50.502558 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:50.504060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ba47ed9-9172-4956-ac1d-9ad1c8d5f85a req-85a25416-c767-4ccf-ad23-85a60a9cacd6 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 1.1545489 May 12 15:13:50.529296 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:50.585056 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:50.712941 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:13:50.713675 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:13:50.724668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ba47ed9-9172-4956-ac1d-9ad1c8d5f85a req-c79779e6-178f-49f9-ac2f-20ccd46ce6ab tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2196395 May 12 15:13:50.732667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c8483e03-20db-47cd-bd7e-1b49ae6377dc req-c021933b-8987-488f-b751-b7c03ae3715e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] For port fa933a35-7a96-4a45-bb36-afb53c7641b9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fa933a35-7a96-4a45-bb36-afb53c7641b9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:50.733142 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8483e03-20db-47cd-bd7e-1b49ae6377dc req-c021933b-8987-488f-b751-b7c03ae3715e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:50.742261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Checking segment: {'id': '3176ebc9-22db-4ad4-84e4-d78f669f2179', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': 'a77dc623-3230-4c49-bb40-819a554177b1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:50.742720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Network hostable DHCP agents. Network: a77dc623-3230-4c49-bb40-819a554177b1, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:13:50.748360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event updated for resources: {'Subnet': ['ID=017deaab-283a-4147-ab68-24cdb3eaed15,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:50.766942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31595588-bb50-496f-963b-72fc5fd6db4d req-d728f47e-d3c2-4711-98e8-3bd2a28b6ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/ports?device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 210 time: 0.1548903 May 12 15:13:50.915746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-c8483e03-20db-47cd-bd7e-1b49ae6377dc req-c021933b-8987-488f-b751-b7c03ae3715e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Calling delete_port for fa933a35-7a96-4a45-bb36-afb53c7641b9 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:13:50.942089 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Allocated IP 172.20.0.2 (939fdac4-3043-4213-bd31-a421a6c659bc/c7af977d-fe6b-4182-af40-d4c2523b54a3/dd07ec66-993d-4fad-af43-9102ed08c6af) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:50.966859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Network a77dc623-3230-4c49-bb40-819a554177b1 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:13:50.986320 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a222eb7d-02aa-49ec-afd9-b1e47ade3a75'] response: {'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': 'a2eb37f9-aba2-47d2-9756-11109b082c05', 'status': 'completed', 'code': 200} May 12 15:13:51.100537 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, a77dc623-3230-4c49-bb40-819a554177b1) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:51.110132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.110855 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:51.138030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4896711-5a2c-48ca-b8a6-737f483d9e7b None None] Network a77dc623-3230-4c49-bb40-819a554177b1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:13:51.169287 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d92299fd-9da7-4aff-bfc4-7843991f99e3 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 798 time: 2.3188026 May 12 15:13:51.282381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52ebcdc-c861-4225-8ef7-fd945db5ce9b req-de214a5c-6512-4f91-ba65-4a8f7cfcb66d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.289707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52ebcdc-c861-4225-8ef7-fd945db5ce9b req-de214a5c-6512-4f91-ba65-4a8f7cfcb66d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.290269 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52ebcdc-c861-4225-8ef7-fd945db5ce9b req-de214a5c-6512-4f91-ba65-4a8f7cfcb66d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.290893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52ebcdc-c861-4225-8ef7-fd945db5ce9b req-de214a5c-6512-4f91-ba65-4a8f7cfcb66d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.291971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52ebcdc-c861-4225-8ef7-fd945db5ce9b req-de214a5c-6512-4f91-ba65-4a8f7cfcb66d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.293909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52ebcdc-c861-4225-8ef7-fd945db5ce9b req-de214a5c-6512-4f91-ba65-4a8f7cfcb66d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.294453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52ebcdc-c861-4225-8ef7-fd945db5ce9b req-de214a5c-6512-4f91-ba65-4a8f7cfcb66d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.298743 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a52ebcdc-c861-4225-8ef7-fd945db5ce9b req-de214a5c-6512-4f91-ba65-4a8f7cfcb66d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=05b4f1ce61294fb29efb0a765ed28561&device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 6420 time: 0.2831640 May 12 15:13:51.303477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-0c08752a-9c93-4836-b65a-f23d1ada5871 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.304934 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-0c08752a-9c93-4836-b65a-f23d1ada5871 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.76 "GET /v2.0/networks?id=13bc975a-b248-4de3-b27d-6d14b7951c4b HTTP/1.1" status: 200 len: 829 time: 0.6254675 May 12 15:13:51.395293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Request body: {'port': {'device_id': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'admin_state_up': True, 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:51.442457 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:51.485619 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:51.502076 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8483e03-20db-47cd-bd7e-1b49ae6377dc req-c021933b-8987-488f-b751-b7c03ae3715e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:51.503316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Transition to ACTIVE for port object e4457ad6-9fe6-46af-85db-912f5b5167ef will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:51.548977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3ae73679-d198-440a-966c-619a9930fbcb', '83a7b910-a912-4e05-9d03-5d6b1f6b0edc', '9c35d53f-6773-4ce7-9642-3b542a20efa8', 'fa933a35-7a96-4a45-bb36-afb53c7641b9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:51.574134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c021933b-8987-488f-b751-b7c03ae3715e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event deleted for resources: {'Port': ['ID=fa933a35-7a96-4a45-bb36-afb53c7641b9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:51.606276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52ebcdc-c861-4225-8ef7-fd945db5ce9b req-8c785f3b-5c36-425f-8781-b87621842073 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.607113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52ebcdc-c861-4225-8ef7-fd945db5ce9b req-8c785f3b-5c36-425f-8781-b87621842073 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.607590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52ebcdc-c861-4225-8ef7-fd945db5ce9b req-8c785f3b-5c36-425f-8781-b87621842073 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.609221 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a52ebcdc-c861-4225-8ef7-fd945db5ce9b req-8c785f3b-5c36-425f-8781-b87621842073 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=05b4f1ce61294fb29efb0a765ed28561&shared=False HTTP/1.1" status: 200 len: 2298 time: 0.2758720 May 12 15:13:51.614888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:51.640914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2626cd6-8fa9-415c-99ec-6b64b7cf2ba1 req-bca54f24-40fc-4cfa-ae35-324e13bbc0ba tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.646743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2626cd6-8fa9-415c-99ec-6b64b7cf2ba1 req-bca54f24-40fc-4cfa-ae35-324e13bbc0ba tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.653135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2626cd6-8fa9-415c-99ec-6b64b7cf2ba1 req-bca54f24-40fc-4cfa-ae35-324e13bbc0ba tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.659068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2626cd6-8fa9-415c-99ec-6b64b7cf2ba1 req-bca54f24-40fc-4cfa-ae35-324e13bbc0ba tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.665211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2626cd6-8fa9-415c-99ec-6b64b7cf2ba1 req-bca54f24-40fc-4cfa-ae35-324e13bbc0ba tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.671886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2626cd6-8fa9-415c-99ec-6b64b7cf2ba1 req-bca54f24-40fc-4cfa-ae35-324e13bbc0ba tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.677689 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2626cd6-8fa9-415c-99ec-6b64b7cf2ba1 req-bca54f24-40fc-4cfa-ae35-324e13bbc0ba tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.679564 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2626cd6-8fa9-415c-99ec-6b64b7cf2ba1 req-bca54f24-40fc-4cfa-ae35-324e13bbc0ba tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5418 time: 0.6894338 May 12 15:13:51.682080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd52fe69-cb54-463a-8fd6-4fbc0b832e51 req-ebc7f3fa-90df-4f88-b8a2-403aecb5d8a4 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.682898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd52fe69-cb54-463a-8fd6-4fbc0b832e51 req-ebc7f3fa-90df-4f88-b8a2-403aecb5d8a4 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 1097 time: 0.5704732 May 12 15:13:51.714113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Transition to ACTIVE for port object e4457ad6-9fe6-46af-85db-912f5b5167ef will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:51.721468 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:13:51.742614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c8483e03-20db-47cd-bd7e-1b49ae6377dc req-c021933b-8987-488f-b751-b7c03ae3715e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] No DVR routers for this DVR port fa933a35-7a96-4a45-bb36-afb53c7641b9 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:13:51.745505 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8483e03-20db-47cd-bd7e-1b49ae6377dc req-c021933b-8987-488f-b751-b7c03ae3715e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:51.755402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ea64917-282e-46ab-bc5b-00e8f66e5176', 'name': 'network-vif-deleted', 'tag': 'fa933a35-7a96-4a45-bb36-afb53c7641b9'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:51.759964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:51.779833 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:51.780119 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:51.787755 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8483e03-20db-47cd-bd7e-1b49ae6377dc req-c021933b-8987-488f-b751-b7c03ae3715e tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "DELETE /v2.0/ports/fa933a35-7a96-4a45-bb36-afb53c7641b9 HTTP/1.1" status: 204 len: 173 time: 2.0313239 May 12 15:13:51.849376 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:51.851668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52ebcdc-c861-4225-8ef7-fd945db5ce9b req-fa5ba6ad-460b-4177-a29e-7397a495a4b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:51.853470 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a52ebcdc-c861-4225-8ef7-fd945db5ce9b req-fa5ba6ad-460b-4177-a29e-7397a495a4b7 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2264712 May 12 15:13:51.854480 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:51.879538 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:51.904554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Transition to ACTIVE for port object dd07ec66-993d-4fad-af43-9102ed08c6af will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:51.914871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Network cc2308f9-d1ec-4568-bf98-60c7e336ff78 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:51.930819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:51.946132 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:51.984528 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Pushing event updated for resources: {'Port': ['ID=e4457ad6-9fe6-46af-85db-912f5b5167ef,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:52.072871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Transition to ACTIVE for port object dd07ec66-993d-4fad-af43-9102ed08c6af will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:52.096061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:52.107800 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd52fe69-cb54-463a-8fd6-4fbc0b832e51 req-7b70ce60-4fab-40b4-91a1-8a598372380a tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3876607 May 12 15:13:52.108565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-a77dc623-3230-4c49-bb40-819a554177b1', 'network_id': 'a77dc623-3230-4c49-bb40-819a554177b1', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'fixed_ips': [{'subnet_id': '017deaab-283a-4147-ab68-24cdb3eaed15'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:13:52.108834 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Usage tracker for resource:port and tenant:a687923521d64fba8b0ceae3dbf4d7d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:52.109371 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:52.114288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 39390bec-fdd9-4910-a8d2-6718da722725 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:52.129360 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:52.150028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Transition to ACTIVE for port object 39390bec-fdd9-4910-a8d2-6718da722725 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:52.177321 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:52.182522 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2626cd6-8fa9-415c-99ec-6b64b7cf2ba1 req-4de39699-3759-4bad-aafb-c0ee14d3e887 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.4648120 May 12 15:13:52.183350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:52.190456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:52.208197 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:52.298215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Network 939fdac4-3043-4213-bd31-a421a6c659bc is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:52.298955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:52.304836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:52.307329 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Attempting to bind port e4457ad6-9fe6-46af-85db-912f5b5167ef on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:52.308061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Attempting to bind port e4457ad6-9fe6-46af-85db-912f5b5167ef by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '8ffe4223-2972-4274-85b3-fbe4e0a1c649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'cc2308f9-d1ec-4568-bf98-60c7e336ff78'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:52.309127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Attempting to bind port e4457ad6-9fe6-46af-85db-912f5b5167ef on network cc2308f9-d1ec-4568-bf98-60c7e336ff78 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:52.348049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:52.368715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81', '8c301fff-eebe-4ee3-ae47-9da749d76d58'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:52.375713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Made reservation on behalf of a687923521d64fba8b0ceae3dbf4d7d3 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:52.378844 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:52.457510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:52.457958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Checking segment: {'id': '8ffe4223-2972-4274-85b3-fbe4e0a1c649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'cc2308f9-d1ec-4568-bf98-60c7e336ff78'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:52.458266 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:52.458652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Bound using segment: {'id': '8ffe4223-2972-4274-85b3-fbe4e0a1c649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'cc2308f9-d1ec-4568-bf98-60c7e336ff78'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:52.459131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Bound port: e4457ad6-9fe6-46af-85db-912f5b5167ef, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8ffe4223-2972-4274-85b3-fbe4e0a1c649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'cc2308f9-d1ec-4568-bf98-60c7e336ff78'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:52.459498 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:52.579079 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c516263-6f5d-459d-8fe0-c64206edb669 req-087bc209-55a7-4970-b087-308f2f24ad10 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ea64917-282e-46ab-bc5b-00e8f66e5176 HTTP/1.1" status: 200 len: 210 time: 0.1784058 May 12 15:13:52.688371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Pushing event updated for resources: {'Port': ['ID=dd07ec66-993d-4fad-af43-9102ed08c6af,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:52.744404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:52.806351 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Attempting to bind port dd07ec66-993d-4fad-af43-9102ed08c6af on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:52.806705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Attempting to bind port dd07ec66-993d-4fad-af43-9102ed08c6af by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '7c4990b9-5a5f-484e-a357-c9a37d811129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:52.807057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Attempting to bind port dd07ec66-993d-4fad-af43-9102ed08c6af on network 939fdac4-3043-4213-bd31-a421a6c659bc {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:52.879045 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:52.879412 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Checking segment: {'id': '7c4990b9-5a5f-484e-a357-c9a37d811129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:52.879809 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:52.880191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Bound using segment: {'id': '7c4990b9-5a5f-484e-a357-c9a37d811129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:52.880656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Bound port: dd07ec66-993d-4fad-af43-9102ed08c6af, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c4990b9-5a5f-484e-a357-c9a37d811129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:52.881022 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:52.894378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Pushing event updated for resources: {'Port': ['ID=39390bec-fdd9-4910-a8d2-6718da722725,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:52.908131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Allocated IP 19.86.0.2 (a77dc623-3230-4c49-bb40-819a554177b1/017deaab-283a-4147-ab68-24cdb3eaed15/79021b52-62a2-42bb-b979-9b3513069ddd) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:52.922068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] For port e4457ad6-9fe6-46af-85db-912f5b5167ef, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:52.995954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Allocated IP 172.25.8.209 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/42d2caf6-4185-4201-91dc-c0881fe15eea) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:53.000706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] For port e4457ad6-9fe6-46af-85db-912f5b5167ef, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e4457ad6-9fe6-46af-85db-912f5b5167ef,segment=NetworkSegment(8ffe4223-2972-4274-85b3-fbe4e0a1c649),segment_id=8ffe4223-2972-4274-85b3-fbe4e0a1c649)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:53.052310 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:53.073849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Attempting to bind port 39390bec-fdd9-4910-a8d2-6718da722725 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:53.074780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Attempting to bind port 39390bec-fdd9-4910-a8d2-6718da722725 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '4d535119-7517-4056-aef4-603b1fd140c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:53.075108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Attempting to bind port 39390bec-fdd9-4910-a8d2-6718da722725 on network 187794df-e6cb-4ee3-8b40-6b546c229bd2 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:53.104753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-872bd579-b49f-4e10-a020-9488dc9cc70b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:53.106345 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-872bd579-b49f-4e10-a020-9488dc9cc70b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.8716228 May 12 15:13:53.132029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Port 39390bec-fdd9-4910-a8d2-6718da722725 on network 187794df-e6cb-4ee3-8b40-6b546c229bd2 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:13:53.132359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Attempting to bind port 39390bec-fdd9-4910-a8d2-6718da722725 on network 187794df-e6cb-4ee3-8b40-6b546c229bd2 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:53.216915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:53.217321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Checking segment: {'id': '4d535119-7517-4056-aef4-603b1fd140c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:53.217743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Bound using segment: {'id': '4d535119-7517-4056-aef4-603b1fd140c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:53.218179 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Bound port: 39390bec-fdd9-4910-a8d2-6718da722725, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4d535119-7517-4056-aef4-603b1fd140c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:53.218897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:53.221410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:53.221776 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:53.255029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-a39ba3b7-442b-43f1-a762-6997b5ee876f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:53.261333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-a39ba3b7-442b-43f1-a762-6997b5ee876f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:53.262728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-da4a1d71-924d-4175-bc98-40935ded7394 req-a39ba3b7-442b-43f1-a762-6997b5ee876f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Synchronizing usage tracker for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:53.268002 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-fb29c333-483e-4937-9b1a-07bc70c550ef tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/quotas/593ec496e5db4078be8dc940596be321 HTTP/1.1" status: 200 len: 375 time: 0.1368949 May 12 15:13:53.288671 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Allocated IP 172.20.0.5 (13bc975a-b248-4de3-b27d-6d14b7951c4b/9a114164-5df9-48f9-8806-96a06aeff952/c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:53.320645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] For port dd07ec66-993d-4fad-af43-9102ed08c6af, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:53.405097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-da4a1d71-924d-4175-bc98-40935ded7394 req-a39ba3b7-442b-43f1-a762-6997b5ee876f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Unset dirty status for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:53.407110 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-a39ba3b7-442b-43f1-a762-6997b5ee876f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/networks?id=cc2308f9-d1ec-4568-bf98-60c7e336ff78&id=a77dc623-3230-4c49-bb40-819a554177b1 HTTP/1.1" status: 200 len: 1392 time: 0.6964068 May 12 15:13:53.435220 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] For port dd07ec66-993d-4fad-af43-9102ed08c6af, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=dd07ec66-993d-4fad-af43-9102ed08c6af,segment=NetworkSegment(7c4990b9-5a5f-484e-a357-c9a37d811129),segment_id=7c4990b9-5a5f-484e-a357-c9a37d811129)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:53.452085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb1bc0ae-05a0-4e5f-8bfd-5ecc077a4ced None None] Pushing event updated for resources: {'Port': ['ID=e4457ad6-9fe6-46af-85db-912f5b5167ef,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:53.462686 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-ddbd9fd5-129f-4e2a-8434-88fd9ad2b50b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/quotas/1aea6927c780448b89ddf44ec6bcb186 HTTP/1.1" status: 200 len: 375 time: 0.0380507 May 12 15:13:53.468990 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:53.613750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] For port 39390bec-fdd9-4910-a8d2-6718da722725, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:53.675853 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:53.751923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] For port 39390bec-fdd9-4910-a8d2-6718da722725, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=39390bec-fdd9-4910-a8d2-6718da722725,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:53.795280 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:53.819412 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0f3a9ca-a76f-415e-aff6-3b2147e6e4f6 None None] Pushing event updated for resources: {'Port': ['ID=dd07ec66-993d-4fad-af43-9102ed08c6af,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:53.838790 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:53.857194 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-1674d742-747b-4c42-ba45-ae1c19dd7c75 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&fields=id HTTP/1.1" status: 200 len: 255 time: 0.5729523 May 12 15:13:53.869273 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:53.899788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Transition to ACTIVE for port object 79021b52-62a2-42bb-b979-9b3513069ddd will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:53.914356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:53.915057 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:53.917021 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] 10.222.0.84 "PUT /v2.0/ports/39390bec-fdd9-4910-a8d2-6718da722725 HTTP/1.1" status: 200 len: 1091 time: 4.9118268 May 12 15:13:53.942903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': '39390bec-fdd9-4910-a8d2-6718da722725'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:53.958140 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fa933a35-7a96-4a45-bb36-afb53c7641b9 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:13:53.997157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Transition to ACTIVE for port object 79021b52-62a2-42bb-b979-9b3513069ddd will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:54.011834 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '93f69d1e-0068-4634-b7ad-70f7710d8470', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:13:54.051265 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:54.058769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: fa933a35-7a96-4a45-bb36-afb53c7641b9 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:13:54.059510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fa933a35-7a96-4a45-bb36-afb53c7641b9 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:13:54.098360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:54.142357 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:54.181359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Network a77dc623-3230-4c49-bb40-819a554177b1 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:54.188216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:54.194848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:54.273130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Pushing event updated for resources: {'Port': ['ID=79021b52-62a2-42bb-b979-9b3513069ddd,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:54.310457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-da4a1d71-924d-4175-bc98-40935ded7394 req-bd61c2bb-aef4-4eab-b4d0-8d87f9cdb01d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Synchronizing usage tracker for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:54.380772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9c7f61b-7b62-4cab-9be2-bd8dbce7f1bb service neutron] Pushing event updated for resources: {'Port': ['ID=39390bec-fdd9-4910-a8d2-6718da722725,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:54.386236 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:54.400462 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-da4a1d71-924d-4175-bc98-40935ded7394 req-bd61c2bb-aef4-4eab-b4d0-8d87f9cdb01d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Unset dirty status for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:54.401679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-bd61c2bb-aef4-4eab-b4d0-8d87f9cdb01d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=1aea6927c780448b89ddf44ec6bcb186&fields=id HTTP/1.1" status: 200 len: 348 time: 0.9264207 May 12 15:13:54.404627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Attempting to bind port 79021b52-62a2-42bb-b979-9b3513069ddd on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:54.404989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Attempting to bind port 79021b52-62a2-42bb-b979-9b3513069ddd by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '3176ebc9-22db-4ad4-84e4-d78f669f2179', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': 'a77dc623-3230-4c49-bb40-819a554177b1'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:54.405351 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Attempting to bind port 79021b52-62a2-42bb-b979-9b3513069ddd on network a77dc623-3230-4c49-bb40-819a554177b1 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:54.426153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:54.426656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Checking segment: {'id': '3176ebc9-22db-4ad4-84e4-d78f669f2179', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': 'a77dc623-3230-4c49-bb40-819a554177b1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:54.427180 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:54.428047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Bound using segment: {'id': '3176ebc9-22db-4ad4-84e4-d78f669f2179', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': 'a77dc623-3230-4c49-bb40-819a554177b1'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:54.428594 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Bound port: 79021b52-62a2-42bb-b979-9b3513069ddd, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3176ebc9-22db-4ad4-84e4-d78f669f2179', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': 'a77dc623-3230-4c49-bb40-819a554177b1'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:54.429027 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:54.491658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:54.503387 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Transition to ACTIVE for port object c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:54.521176 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:54.554886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] For port 79021b52-62a2-42bb-b979-9b3513069ddd, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:54.559521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] For port 79021b52-62a2-42bb-b979-9b3513069ddd, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=79021b52-62a2-42bb-b979-9b3513069ddd,segment=NetworkSegment(3176ebc9-22db-4ad4-84e4-d78f669f2179),segment_id=3176ebc9-22db-4ad4-84e4-d78f669f2179)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:54.563789 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:54.604746 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-9dc03a94-f177-41ac-a7aa-ad0ad21377ac service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7206695 May 12 15:13:54.649082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:54.650983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f042016-eed7-4b76-b1b9-0048c7e14afb None None] Pushing event updated for resources: {'Port': ['ID=79021b52-62a2-42bb-b979-9b3513069ddd,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:54.664470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-55f8b780-b992-40b1-87f3-d3afe9b63e52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:54.664964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-55f8b780-b992-40b1-87f3-d3afe9b63e52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:54.665461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-55f8b780-b992-40b1-87f3-d3afe9b63e52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:54.665922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-55f8b780-b992-40b1-87f3-d3afe9b63e52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:54.666373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-55f8b780-b992-40b1-87f3-d3afe9b63e52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:54.667013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-55f8b780-b992-40b1-87f3-d3afe9b63e52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:54.667659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-55f8b780-b992-40b1-87f3-d3afe9b63e52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:54.669862 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-55f8b780-b992-40b1-87f3-d3afe9b63e52 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=05b4f1ce61294fb29efb0a765ed28561&device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 6487 time: 0.6225860 May 12 15:13:54.678939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:54.784224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:54.832006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e34df10-b538-473c-a266-c73b39720daa None None] Network cc2308f9-d1ec-4568-bf98-60c7e336ff78 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:13:54.834622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Pushing event updated for resources: {'Port': ['ID=42d2caf6-4185-4201-91dc-c0881fe15eea,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:54.876114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-3c54d6b5-e44d-4821-b9ba-335e12138ba7 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=04429346-9f7d-4f32-8c65-290ee17fda8a HTTP/1.1" status: 200 len: 217 time: 0.1439204 May 12 15:13:54.959156 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-3a46a5ec-1d08-4f13-a2cd-79ed61ddeb0e service neutron] 10.222.0.82 "GET /v2.0/networks/cc2308f9-d1ec-4568-bf98-60c7e336ff78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5387735 May 12 15:13:54.966132 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:54.987825 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c91467c9-84eb-4d14-8d4b-36ed81f622b5 None None] Provisioning for port e4457ad6-9fe6-46af-85db-912f5b5167ef completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:55.254102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Network 13bc975a-b248-4de3-b27d-6d14b7951c4b is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:55.281056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:55.299599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-45b5d453-3c34-43a7-aa82-04307f8f4954 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:55.301032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-45b5d453-3c34-43a7-aa82-04307f8f4954 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4ecb64d7-7b16-437b-8f3e-4996d58043f6 HTTP/1.1" status: 200 len: 856 time: 0.4066284 May 12 15:13:55.301879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:55.417673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-606bed29-ea1f-4139-b284-acbd2d41eb40 None None] Network 939fdac4-3043-4213-bd31-a421a6c659bc requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:13:55.475513 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-bfb1f387-f545-46f1-8277-1b4277bfce41 service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8594854 May 12 15:13:55.536086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Pushing event updated for resources: {'Port': ['ID=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:55.573539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dd07ec66-993d-4fad-af43-9102ed08c6af up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:55.610716 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-50dacabb-6686-4d42-9f44-1a1a0b73e9ae service neutron] 10.222.0.82 "GET /v2.0/networks/cc2308f9-d1ec-4568-bf98-60c7e336ff78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6420960 May 12 15:13:55.635936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-dfbd227a-125e-4102-be3b-318aeb34b215 None None] Provisioning for port dd07ec66-993d-4fad-af43-9102ed08c6af completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:55.665878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:55.666842 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:55.711937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-48a30ef8-cc84-49d8-8de9-6f7f2cd69b64 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 4.3266993 May 12 15:13:55.786410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Request body: {'port': {'device_id': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:55.861645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port dd07ec66-993d-4fad-af43-9102ed08c6af completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:55.875685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port dd07ec66-993d-4fad-af43-9102ed08c6af triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:55.876053 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:55.968584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a4e333dd-5178-46ae-bb13-71f6991dc440 None None] Provisioning for port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:55.992788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a4e333dd-5178-46ae-bb13-71f6991dc440 None None] Provisioning complete for port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:55.993158 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4e333dd-5178-46ae-bb13-71f6991dc440 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:56.068820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a4e333dd-5178-46ae-bb13-71f6991dc440 None None] Port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:13:56.096199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-2f27ac19-f67f-4b4f-8f13-9913ff36928b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:56.097689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-2f27ac19-f67f-4b4f-8f13-9913ff36928b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=13468259-dd20-42ac-88ec-2614ebea6ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.7161651 May 12 15:13:56.158926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3e75613-3915-4701-969a-5217887e75d2 None None] Network a77dc623-3230-4c49-bb40-819a554177b1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:13:56.266553 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:56.300460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-14c414bc-2dfd-4f03-8536-da89cb3d690d None None] Provisioning for port 79021b52-62a2-42bb-b979-9b3513069ddd completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:56.345774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port dd07ec66-993d-4fad-af43-9102ed08c6af, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=dd07ec66-993d-4fad-af43-9102ed08c6af,segment=NetworkSegment(7c4990b9-5a5f-484e-a357-c9a37d811129),segment_id=7c4990b9-5a5f-484e-a357-c9a37d811129)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:56.356109 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:56.357124 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e4457ad6-9fe6-46af-85db-912f5b5167ef up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:56.540415 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-7a2deaed-50ea-4fc3-8d34-8309cb2fe230 service neutron] 10.222.0.84 "GET /v2.0/networks/13468259-dd20-42ac-88ec-2614ebea6ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4166765 May 12 15:13:56.544972 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-24074f50-02d7-4d43-874c-38416c836bde service neutron] 10.222.0.82 "GET /v2.0/networks/a77dc623-3230-4c49-bb40-819a554177b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9240401 May 12 15:13:56.585219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=dd07ec66-993d-4fad-af43-9102ed08c6af,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:56.649654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port e4457ad6-9fe6-46af-85db-912f5b5167ef completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:56.658719 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port e4457ad6-9fe6-46af-85db-912f5b5167ef triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:56.659085 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:56.679988 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:56.756257 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:56.807053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-082a2300-9543-40af-9bd4-80adba100aa6 None None] Provisioning complete for port dd07ec66-993d-4fad-af43-9102ed08c6af triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:56.807053 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-082a2300-9543-40af-9bd4-80adba100aa6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:56.847214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ca30b8d-a8f4-4721-a19f-4cd870d769d7 req-e1708b3d-ac8c-481a-a516-6aac9dfba6a2 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:56.856947 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ca30b8d-a8f4-4721-a19f-4cd870d769d7 req-e1708b3d-ac8c-481a-a516-6aac9dfba6a2 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 1.0335999 May 12 15:13:56.889037 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:56.960036 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port e4457ad6-9fe6-46af-85db-912f5b5167ef, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e4457ad6-9fe6-46af-85db-912f5b5167ef,segment=NetworkSegment(8ffe4223-2972-4274-85b3-fbe4e0a1c649),segment_id=8ffe4223-2972-4274-85b3-fbe4e0a1c649)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:56.974542 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:56.975305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 79021b52-62a2-42bb-b979-9b3513069ddd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:57.138210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=e4457ad6-9fe6-46af-85db-912f5b5167ef,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:57.155822 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 79021b52-62a2-42bb-b979-9b3513069ddd completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:13:57.161999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 79021b52-62a2-42bb-b979-9b3513069ddd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:57.162458 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:57.166940 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ca30b8d-a8f4-4721-a19f-4cd870d769d7 req-8bb99800-6a9c-47e7-9f91-acf103a1a16b tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3171437 May 12 15:13:57.182546 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-89ea6255-0f2f-4f85-8893-7f38d01f9c60 service neutron] 10.222.0.84 "GET /v2.0/networks/13468259-dd20-42ac-88ec-2614ebea6ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6359084 May 12 15:13:57.192780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-6a8a69b4-90f8-4afb-a62f-aa823c76eb66 service neutron] 10.222.0.82 "GET /v2.0/networks/a77dc623-3230-4c49-bb40-819a554177b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6428850 May 12 15:13:57.303849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-94f5823c-b735-43fd-a863-ba4a8a29d4ce None None] Provisioning complete for port 79021b52-62a2-42bb-b979-9b3513069ddd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:57.304342 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-94f5823c-b735-43fd-a863-ba4a8a29d4ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:57.350205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-d7412c93-2e84-4312-8bf7-142225a680ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:57.351566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-d7412c93-2e84-4312-8bf7-142225a680ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Synchronizing usage tracker for tenant:593ec496e5db4078be8dc940596be321 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:57.379518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-d7412c93-2e84-4312-8bf7-142225a680ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Unset dirty status for tenant:593ec496e5db4078be8dc940596be321 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:57.381644 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-d7412c93-2e84-4312-8bf7-142225a680ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.76 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.3219254 May 12 15:13:57.396447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Request body: {'port': {'device_id': '38791bcd-dc8b-4e32-bf93-723fbcfc3199', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'admin_state_up': True, 'tenant_id': '593ec496e5db4078be8dc940596be321'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:57.470482 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-64713e6e-3482-4130-800a-c00e95872a13 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.21&port_id=d96ca9ce-4a19-49f0-bef3-e0e31ace478a HTTP/1.1" status: 200 len: 217 time: 0.2767057 May 12 15:13:57.488557 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ddf4e2c1-5d97-4d62-b56f-39fc42bd8ad3'] response: {'server_uuid': '3ea64917-282e-46ab-bc5b-00e8f66e5176', 'name': 'network-vif-deleted', 'tag': 'fa933a35-7a96-4a45-bb36-afb53c7641b9', 'status': 'completed', 'code': 200} May 12 15:13:57.549799 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:57.595413 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-94f5823c-b735-43fd-a863-ba4a8a29d4ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:57.620263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 79021b52-62a2-42bb-b979-9b3513069ddd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=79021b52-62a2-42bb-b979-9b3513069ddd,segment=NetworkSegment(3176ebc9-22db-4ad4-84e4-d78f669f2179),segment_id=3176ebc9-22db-4ad4-84e4-d78f669f2179)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:13:57.665462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:57.799351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:13:57.807702 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:57.811137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:13:57.820292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Usage tracker for resource:port and tenant:593ec496e5db4078be8dc940596be321 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:13:57.826371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Transition to ACTIVE for port object c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:13:57.829671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:13:57.838836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dd07ec66-993d-4fad-af43-9102ed08c6af up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:57.841812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:13:57.865455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Made reservation on behalf of 593ec496e5db4078be8dc940596be321 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:13:57.869201 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:57.918672 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-94f5823c-b735-43fd-a863-ba4a8a29d4ce None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:13:57.919687 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-94f5823c-b735-43fd-a863-ba4a8a29d4ce None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:13:57.927396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=79021b52-62a2-42bb-b979-9b3513069ddd,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:57.955940 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:57.960345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port dd07ec66-993d-4fad-af43-9102ed08c6af triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:57.960464 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:58.113652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Allocated IP 172.20.0.7 (dbc2e49c-2591-4534-a48c-cea8e23115f4/84c2082e-f394-46d5-8a8f-8e3a70d54fc1/86786c97-61f2-4d39-8699-212c2f96f6f3) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:13:58.180141 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e4457ad6-9fe6-46af-85db-912f5b5167ef up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:58.303748 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port e4457ad6-9fe6-46af-85db-912f5b5167ef triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:58.304527 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:58.612439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-0ce1c3fe-842b-41f4-9e70-95d836674f85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:58.614006 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-0ce1c3fe-842b-41f4-9e70-95d836674f85 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=34e89d1d-72aa-4216-94d6-f37b8a0c162b HTTP/1.1" status: 200 len: 797 time: 0.7834790 May 12 15:13:58.615596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Pushing event updated for resources: {'Port': ['ID=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:58.644700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:58.703333 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:58.731944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe8f6b0-7a42-4728-bebe-af51955f70b7 req-ae60dab4-b77d-4396-aa55-80ed5eb26c87 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:58.732720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ebe8f6b0-7a42-4728-bebe-af51955f70b7 req-ae60dab4-b77d-4396-aa55-80ed5eb26c87 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Synchronizing usage tracker for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:58.742670 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:58.745342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:13:58.795968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Network dbc2e49c-2591-4534-a48c-cea8e23115f4 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:13:58.799737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:13:58.804011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:13:58.834635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Attempting to bind port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:58.835245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Attempting to bind port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fc4158ff-96b8-4d00-981b-81b5cdb89988', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:58.835439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Attempting to bind port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e on network 13bc975a-b248-4de3-b27d-6d14b7951c4b {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:58.853287 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event updated for resources: {'Port': ['ID=86786c97-61f2-4d39-8699-212c2f96f6f3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:58.859998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e on network 13bc975a-b248-4de3-b27d-6d14b7951c4b not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:13:58.860322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Attempting to bind port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e on network 13bc975a-b248-4de3-b27d-6d14b7951c4b {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:58.878642 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:13:58.879035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Checking segment: {'id': 'fc4158ff-96b8-4d00-981b-81b5cdb89988', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:13:58.879623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Bound using segment: {'id': 'fc4158ff-96b8-4d00-981b-81b5cdb89988', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:13:58.880327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Bound port: c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fc4158ff-96b8-4d00-981b-81b5cdb89988', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:13:58.880841 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:58.890830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ebe8f6b0-7a42-4728-bebe-af51955f70b7 req-ae60dab4-b77d-4396-aa55-80ed5eb26c87 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Unset dirty status for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:58.892410 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ebe8f6b0-7a42-4728-bebe-af51955f70b7 req-ae60dab4-b77d-4396-aa55-80ed5eb26c87 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/ports?device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 931 time: 1.5212026 May 12 15:13:58.900248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:58.900993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:58.932932 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-74b09142-79dc-498b-a26e-26a0666ba9a8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5409131 May 12 15:13:58.947937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Request body: {'port': {'device_id': '38791bcd-dc8b-4e32-bf93-723fbcfc3199', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:59.036666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e0aae5ee-0d57-41ea-8642-ec5ceccaeddc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:59.038420 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e0aae5ee-0d57-41ea-8642-ec5ceccaeddc service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.4074240 May 12 15:13:59.110128 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:59.164689 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ebe8f6b0-7a42-4728-bebe-af51955f70b7 req-c43eb0ef-33ac-4e26-aeae-8d110a94348d tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Synchronizing usage tracker for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:59.241267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] For port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:13:59.251255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] For port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e,segment=NetworkSegment(fc4158ff-96b8-4d00-981b-81b5cdb89988),segment_id=fc4158ff-96b8-4d00-981b-81b5cdb89988)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:13:59.264462 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ebe8f6b0-7a42-4728-bebe-af51955f70b7 req-c43eb0ef-33ac-4e26-aeae-8d110a94348d tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Unset dirty status for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:59.265897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ebe8f6b0-7a42-4728-bebe-af51955f70b7 req-c43eb0ef-33ac-4e26-aeae-8d110a94348d tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/security-groups?id=acb87c27-050e-44b1-859d-2cd063c51659&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3053274 May 12 15:13:59.275279 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:59.336176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-d7c76fc2-38c3-4cc4-a44f-29fc9f01cc63 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:13:59.337170 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-d7c76fc2-38c3-4cc4-a44f-29fc9f01cc63 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0054007 May 12 15:13:59.357909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-f30a37b6-6326-4eb1-8ab9-c74476b580e1 service neutron] Request body: {'binding': {'host': 'n-h2-841483-1', 'vnic_type': 'normal', 'profile': {}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:59.358745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-f30a37b6-6326-4eb1-8ab9-c74476b580e1 service neutron] Unknown quota resources ['binding']. {{(pid=88151) _create /opt/stack/neutron/neutron/api/v2/base.py:495}} May 12 15:13:59.373171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Router 82fdce0c-213a-480d-a72d-d6fec22a5428 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:13:59.390617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:59.391291 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:59.392809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] 10.222.0.76 "PUT /v2.0/ports/c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e HTTP/1.1" status: 200 len: 1091 time: 3.6698720 May 12 15:13:59.403965 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-6fc9da6e-f02e-40cb-8659-caf6ef71d92e service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3524549 May 12 15:13:59.670559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2536f479-566d-43ea-8399-22e447b1a3fe service neutron] Pushing event updated for resources: {'Port': ['ID=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:13:59.697565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-0ba45ea4-5e2f-4752-81b0-932c054fe438 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:59.704052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-0ba45ea4-5e2f-4752-81b0-932c054fe438 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:13:59.705175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-da4a1d71-924d-4175-bc98-40935ded7394 req-0ba45ea4-5e2f-4752-81b0-932c054fe438 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Synchronizing usage tracker for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:13:59.766822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-da4a1d71-924d-4175-bc98-40935ded7394 req-0ba45ea4-5e2f-4752-81b0-932c054fe438 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Unset dirty status for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:13:59.767151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 79021b52-62a2-42bb-b979-9b3513069ddd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:13:59.767981 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-0ba45ea4-5e2f-4752-81b0-932c054fe438 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.84 "GET /v2.0/networks?id=cc2308f9-d1ec-4568-bf98-60c7e336ff78&id=a77dc623-3230-4c49-bb40-819a554177b1 HTTP/1.1" status: 200 len: 1392 time: 0.5391076 May 12 15:13:59.809211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Request body: {'port': {'device_id': '964db126-f48c-4257-8b18-8bd06d832b12', 'network_id': 'cc2308f9-d1ec-4568-bf98-60c7e336ff78', 'admin_state_up': True, 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:13:59.845082 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-b6e50665-1405-4a5b-ac8a-9db9d81742b6 service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4339969 May 12 15:13:59.845690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 79021b52-62a2-42bb-b979-9b3513069ddd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:13:59.845940 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:13:59.983216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-f30a37b6-6326-4eb1-8ab9-c74476b580e1 service neutron] Attempting to bind port c89ed514-64cd-4011-b01a-855ecf2c3a8e on host n-h2-841483-1 for vnic_type normal with profile None {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:13:59.983550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-f30a37b6-6326-4eb1-8ab9-c74476b580e1 service neutron] Attempting to bind port c89ed514-64cd-4011-b01a-855ecf2c3a8e by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:13:59.983874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-f30a37b6-6326-4eb1-8ab9-c74476b580e1 service neutron] Attempting to bind port c89ed514-64cd-4011-b01a-855ecf2c3a8e on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:13:59.995761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 86786c97-61f2-4d39-8699-212c2f96f6f3 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:00.000924 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-f30a37b6-6326-4eb1-8ab9-c74476b580e1 service neutron] Port c89ed514-64cd-4011-b01a-855ecf2c3a8e on network e8211761-0dd9-424f-b732-629fd2d77e28 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:14:00.001245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-f30a37b6-6326-4eb1-8ab9-c74476b580e1 service neutron] Attempting to bind port c89ed514-64cd-4011-b01a-855ecf2c3a8e on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:00.010008 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:00.034788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-f30a37b6-6326-4eb1-8ab9-c74476b580e1 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:14:00.035128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-f30a37b6-6326-4eb1-8ab9-c74476b580e1 service neutron] Checking segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:00.035512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-f30a37b6-6326-4eb1-8ab9-c74476b580e1 service neutron] Bound using segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:14:00.035946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-f30a37b6-6326-4eb1-8ab9-c74476b580e1 service neutron] Bound port: c89ed514-64cd-4011-b01a-855ecf2c3a8e, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:14:00.066651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-f9d0ab58-e3fa-4133-83da-cab910455d44 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.182&port_id=be802a6d-cca9-42fd-bdc5-6c9f78035217 HTTP/1.1" status: 200 len: 217 time: 0.2142792 May 12 15:14:00.070212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Transition to ACTIVE for port object 86786c97-61f2-4d39-8699-212c2f96f6f3 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:00.071662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-4bc0f67c-6621-4105-9477-0bafa69d0ecb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:00.073013 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-4bc0f67c-6621-4105-9477-0bafa69d0ecb service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a687923521d64fba8b0ceae3dbf4d7d3&device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 1094 time: 0.5598929 May 12 15:14:00.080432 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:00.084201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:00.107634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:14:00.117887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Sync routers for ids ['82fdce0c-213a-480d-a72d-d6fec22a5428'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:14:00.145790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Routers {'82fdce0c-213a-480d-a72d-d6fec22a5428'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:14:00.147793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3301950b-8679-4607-9c74-d124b21733ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:13:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['82fdce0c-213a-480d-a72d-d6fec22a5428'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:00.157634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:00.206785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4edcd79c-8adb-44b8-baaf-b670f902d5e6 req-1cfac1d5-ac5c-43dc-a4af-83ab1e3318fc tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:00.212589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4edcd79c-8adb-44b8-baaf-b670f902d5e6 req-1cfac1d5-ac5c-43dc-a4af-83ab1e3318fc tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:00.218571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4edcd79c-8adb-44b8-baaf-b670f902d5e6 req-1cfac1d5-ac5c-43dc-a4af-83ab1e3318fc tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:00.224349 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4edcd79c-8adb-44b8-baaf-b670f902d5e6 req-1cfac1d5-ac5c-43dc-a4af-83ab1e3318fc tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:00.231197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4edcd79c-8adb-44b8-baaf-b670f902d5e6 req-1cfac1d5-ac5c-43dc-a4af-83ab1e3318fc tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:00.236951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4edcd79c-8adb-44b8-baaf-b670f902d5e6 req-1cfac1d5-ac5c-43dc-a4af-83ab1e3318fc tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:00.242797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4edcd79c-8adb-44b8-baaf-b670f902d5e6 req-1cfac1d5-ac5c-43dc-a4af-83ab1e3318fc tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:00.244748 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4edcd79c-8adb-44b8-baaf-b670f902d5e6 req-1cfac1d5-ac5c-43dc-a4af-83ab1e3318fc tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5430 time: 0.6458032 May 12 15:14:00.267454 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-1bb03276-1dcb-4e1b-b0fa-bdd516a370dc service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e HTTP/1.1" status: 200 len: 217 time: 0.1579268 May 12 15:14:00.359576 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:00.363311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-09315196-7301-4f56-b1c9-700db603ca5e admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 11.8301425 May 12 15:14:00.364563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Set router 82fdce0c-213a-480d-a72d-d6fec22a5428 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:14:00.367612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53430) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:00.373415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-19a7e11e-b881-42b4-9a13-be807e3edd51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:00.374810 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-19a7e11e-b881-42b4-9a13-be807e3edd51 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=34e89d1d-72aa-4216-94d6-f37b8a0c162b HTTP/1.1" status: 200 len: 797 time: 0.3009520 May 12 15:14:00.424933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-f30a37b6-6326-4eb1-8ab9-c74476b580e1 service neutron] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:14:00.430381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Pushing event updated for resources: {'Port': ['ID=86786c97-61f2-4d39-8699-212c2f96f6f3,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:00.432703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:00.436832 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:00.485593 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-f10b1145-3982-4035-80db-1f09d3079bdf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:00.486556 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-f30a37b6-6326-4eb1-8ab9-c74476b580e1 service neutron] Notify callbacks [] for binding, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:00.486924 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-f10b1145-3982-4035-80db-1f09d3079bdf service neutron] 10.222.0.76 "GET /v2.0/subnets?id=9a114164-5df9-48f9-8806-96a06aeff952 HTTP/1.1" status: 200 len: 868 time: 0.1985519 May 12 15:14:00.490848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4edcd79c-8adb-44b8-baaf-b670f902d5e6 req-fbd90419-a3f4-4371-b3ee-f2530874e22d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2253947 May 12 15:14:00.495177 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-f30a37b6-6326-4eb1-8ab9-c74476b580e1 service neutron] 10.222.0.82 "POST /v2.0/ports/c89ed514-64cd-4011-b01a-855ecf2c3a8e/bindings HTTP/1.1" status: 201 len: 389 time: 1.1382568 May 12 15:14:00.767820 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e9cf3553-3132-4c58-b612-c0ad461137dc'] response: {'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': '39390bec-fdd9-4910-a8d2-6718da722725', 'status': 'completed', 'code': 200} May 12 15:14:00.806822 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b171b949-ab98-4423-99e6-20c32f405129'] response: {'server_uuid': '93f69d1e-0068-4634-b7ad-70f7710d8470', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6', 'code': 200} May 12 15:14:00.813748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-736c352a-de51-4e53-bd9f-a57476cb2e1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:00.815287 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-736c352a-de51-4e53-bd9f-a57476cb2e1e service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=13bc975a-b248-4de3-b27d-6d14b7951c4b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3172512 May 12 15:14:00.820012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-37496a49-55a5-46e8-985b-f08519c25cb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:00.821594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-37496a49-55a5-46e8-985b-f08519c25cb7 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.3904424 May 12 15:14:00.832548 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3301950b-8679-4607-9c74-d124b21733ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:13:55Z', 'revision_number': 3, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port': {'id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:0b:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_gateway', 'standard_attr_id': 981, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:52Z', 'updated_at': '2022-05-12T15:13:53Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:00.843628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Checking router: 82fdce0c-213a-480d-a72d-d6fec22a5428 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:14:00.846792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Updating router 82fdce0c-213a-480d-a72d-d6fec22a5428 port 42d2caf6-4185-4201-91dc-c0881fe15eea binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:14:00.919349 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Attempting to bind port 86786c97-61f2-4d39-8699-212c2f96f6f3 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:14:00.920001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Attempting to bind port 86786c97-61f2-4d39-8699-212c2f96f6f3 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:14:00.920001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Attempting to bind port 86786c97-61f2-4d39-8699-212c2f96f6f3 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:00.938698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Port 86786c97-61f2-4d39-8699-212c2f96f6f3 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:14:00.939191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Attempting to bind port 86786c97-61f2-4d39-8699-212c2f96f6f3 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:00.992026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:14:00.992277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Checking segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:00.992648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Bound using segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:14:00.993094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Bound port: 86786c97-61f2-4d39-8699-212c2f96f6f3, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:14:00.993472 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:01.011230 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:01.082595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Allocated IP 19.80.0.127 (cc2308f9-d1ec-4568-bf98-60c7e336ff78/95022f85-d8df-4537-b394-3df92c22f710/f9f5bc5a-a74b-4196-8629-7321fb74da65) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:14:01.206597 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0529d5d5-6c10-4221-8b4a-34d82a1ad0ae req-1af333e8-cc58-4716-95ad-8c7f14220138 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9b2b4b7d-231c-4e54-83f4-827d02cbcbb5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.4306951 May 12 15:14:01.241683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] For port 86786c97-61f2-4d39-8699-212c2f96f6f3, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:01.251888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4eae3e3-487b-4597-96ce-682fe780e1ad req-0625ad23-007f-464e-9c29-36e828f354eb tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=964db126-f48c-4257-8b18-8bd06d832b12 HTTP/1.1" status: 200 len: 210 time: 0.2270675 May 12 15:14:01.268515 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] For port 86786c97-61f2-4d39-8699-212c2f96f6f3, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=86786c97-61f2-4d39-8699-212c2f96f6f3,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:14:01.346762 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:01.467874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4f67d0b-c616-4532-878f-d6688993b1f2 req-d772e105-66bc-49c5-b328-a3b55b7c72a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:01.469508 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4f67d0b-c616-4532-878f-d6688993b1f2 req-d772e105-66bc-49c5-b328-a3b55b7c72a1 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 1097 time: 0.3626354 May 12 15:14:01.500573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:01.501296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:01.502811 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] 10.222.0.76 "PUT /v2.0/ports/86786c97-61f2-4d39-8699-212c2f96f6f3 HTTP/1.1" status: 200 len: 1091 time: 2.5614297 May 12 15:14:01.507349 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '38791bcd-dc8b-4e32-bf93-723fbcfc3199', 'tag': '86786c97-61f2-4d39-8699-212c2f96f6f3'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:01.584905 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:01.598234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Transition to ACTIVE for port object 42d2caf6-4185-4201-91dc-c0881fe15eea will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:01.606599 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:01.636405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f4f88bc-b5e4-4213-ba58-6487d80be242 service neutron] Pushing event updated for resources: {'Port': ['ID=86786c97-61f2-4d39-8699-212c2f96f6f3,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:01.670676 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-553087f5-629c-40f5-ad03-267238e82b75 service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8111298 May 12 15:14:01.676826 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4f67d0b-c616-4532-878f-d6688993b1f2 req-a7941d23-d8a6-40bd-a59d-c6d8bd7b2c4d service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1953404 May 12 15:14:01.677134 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-b185d714-2430-41c4-9ffd-cbde7205169a service neutron] 10.222.0.76 "GET /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8517530 May 12 15:14:01.687902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:01.692581 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Attempting to bind port 42d2caf6-4185-4201-91dc-c0881fe15eea on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:14:01.692947 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Attempting to bind port 42d2caf6-4185-4201-91dc-c0881fe15eea by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:14:01.693287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Attempting to bind port 42d2caf6-4185-4201-91dc-c0881fe15eea on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:01.699730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-246d2999-e77b-4ece-a3b5-81988bde5c0b None None] Pushing event updated for resources: {'Port': ['ID=42d2caf6-4185-4201-91dc-c0881fe15eea,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:01.704345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:14:01.704717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:01.705107 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:01.705511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:14:01.705970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Bound port: 42d2caf6-4185-4201-91dc-c0881fe15eea, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:14:01.706448 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:01.720125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0529d5d5-6c10-4221-8b4a-34d82a1ad0ae req-b5123296-0626-4682-b848-4f79f37e57e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:01.721702 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0529d5d5-6c10-4221-8b4a-34d82a1ad0ae req-b5123296-0626-4682-b848-4f79f37e57e0 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&device_id=9b2b4b7d-231c-4e54-83f4-827d02cbcbb5 HTTP/1.1" status: 200 len: 1101 time: 0.3200481 May 12 15:14:01.722632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Transition to ACTIVE for port object f9f5bc5a-a74b-4196-8629-7321fb74da65 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:01.747527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-00b5d421-6fe6-444a-ad42-38728b83fade service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:01.749174 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-00b5d421-6fe6-444a-ad42-38728b83fade service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=38791bcd-dc8b-4e32-bf93-723fbcfc3199 HTTP/1.1" status: 200 len: 1094 time: 0.1840079 May 12 15:14:01.784442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-438d5d4c-2e7f-4fb8-ac43-98d25456a33b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:01.785827 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-438d5d4c-2e7f-4fb8-ac43-98d25456a33b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 1097 time: 0.8127198 May 12 15:14:01.790270 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-3301950b-8679-4607-9c74-d124b21733ce None None] For port 42d2caf6-4185-4201-91dc-c0881fe15eea, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:01.794405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-3301950b-8679-4607-9c74-d124b21733ce None None] For port 42d2caf6-4185-4201-91dc-c0881fe15eea, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=42d2caf6-4185-4201-91dc-c0881fe15eea,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:14:01.798948 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:01.873427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70cd95fd-3a9d-4297-bc01-a40532d6833b req-412359a7-3cf4-4f4d-8aea-6d8f2b204a93 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:01.875452 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:01.880430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Routers {'82fdce0c-213a-480d-a72d-d6fec22a5428'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:14:01.880963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70cd95fd-3a9d-4297-bc01-a40532d6833b req-412359a7-3cf4-4f4d-8aea-6d8f2b204a93 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=38791bcd-dc8b-4e32-bf93-723fbcfc3199 HTTP/1.1" status: 200 len: 943 time: 0.8052306 May 12 15:14:01.881121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3301950b-8679-4607-9c74-d124b21733ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:13:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['82fdce0c-213a-480d-a72d-d6fec22a5428'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:01.943849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-246d2999-e77b-4ece-a3b5-81988bde5c0b None None] Pushing event updated for resources: {'Port': ['ID=42d2caf6-4185-4201-91dc-c0881fe15eea,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:02.023576 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-d2ccdb79-1897-4f07-96a8-211002e1d338 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=86786c97-61f2-4d39-8699-212c2f96f6f3 HTTP/1.1" status: 200 len: 217 time: 0.1432073 May 12 15:14:02.036042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Network cc2308f9-d1ec-4568-bf98-60c7e336ff78 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:02.072883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0529d5d5-6c10-4221-8b4a-34d82a1ad0ae req-39828468-30bd-4db5-8bdc-a1f0d6be76e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:02.074477 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0529d5d5-6c10-4221-8b4a-34d82a1ad0ae req-39828468-30bd-4db5-8bdc-a1f0d6be76e2 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.3243530 May 12 15:14:02.080191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:02.096601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:14:02.109574 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:02.122533 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-3301950b-8679-4607-9c74-d124b21733ce None None] Set router 82fdce0c-213a-480d-a72d-d6fec22a5428 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:14:02.190834 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0529d5d5-6c10-4221-8b4a-34d82a1ad0ae req-68c2ca10-a55c-422d-aa20-247992dbb1d8 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.195&port_id=83a7b910-a912-4e05-9d03-5d6b1f6b0edc HTTP/1.1" status: 200 len: 217 time: 0.1074188 May 12 15:14:02.196058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event updated for resources: {'Port': ['ID=f9f5bc5a-a74b-4196-8629-7321fb74da65,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:02.208976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70cd95fd-3a9d-4297-bc01-a40532d6833b req-eecef426-c8c6-48d5-8cb2-4f03ec85b493 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3276086 May 12 15:14:02.294878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-0f950f76-fff5-45f4-bcda-0e582f37383c service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5514989 May 12 15:14:02.402995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-7b6daa17-c5c4-4551-84ad-acf44346e6bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:02.404754 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-7b6daa17-c5c4-4551-84ad-acf44346e6bc service neutron] 10.222.0.76 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.3708353 May 12 15:14:02.414336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0529d5d5-6c10-4221-8b4a-34d82a1ad0ae req-5ea7de47-e5d1-4eba-9c9a-b61c9711dc7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:02.415921 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0529d5d5-6c10-4221-8b4a-34d82a1ad0ae req-5ea7de47-e5d1-4eba-9c9a-b61c9711dc7d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2139397 May 12 15:14:02.424168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:02.424944 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:02.505075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d134fabd-004b-4df8-83ec-ceba0181a5ff None None] Provisioning for port f9f5bc5a-a74b-4196-8629-7321fb74da65 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:02.519076 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-48d4a5c8-6d18-48c0-a493-42162df143e2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.217&port_id=857536b0-998d-4731-a09f-f8fca9f18d3e HTTP/1.1" status: 200 len: 217 time: 0.2136602 May 12 15:14:02.524756 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d134fabd-004b-4df8-83ec-ceba0181a5ff None None] Provisioning complete for port f9f5bc5a-a74b-4196-8629-7321fb74da65 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:02.525124 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d134fabd-004b-4df8-83ec-ceba0181a5ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:02.538152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008aa95e-594f-49e3-a018-fee9e45e99ee req-c170d3ff-5b10-4853-b51c-08f896878923 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:02.539716 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-008aa95e-594f-49e3-a018-fee9e45e99ee req-c170d3ff-5b10-4853-b51c-08f896878923 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 1.0769036 May 12 15:14:02.546389 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3902405-1c3a-4a93-adff-8e4ecb006f9e req-2b83884d-8d55-4bd8-a81d-52a6a66b6b62 service neutron] 10.222.0.76 "GET /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6611280 May 12 15:14:02.547715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-8bc1b706-f95a-412b-82e4-8ea20d8f3f34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:02.549451 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-8bc1b706-f95a-412b-82e4-8ea20d8f3f34 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.6634786 May 12 15:14:02.626536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d134fabd-004b-4df8-83ec-ceba0181a5ff None None] Port f9f5bc5a-a74b-4196-8629-7321fb74da65 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:14:02.649860 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-c9b1b215-b8f3-493a-b708-62215d3f802d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2324781 May 12 15:14:02.661782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3301950b-8679-4607-9c74-d124b21733ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:13:55Z', 'revision_number': 3, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port': {'id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:0b:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_gateway', 'standard_attr_id': 981, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:52Z', 'updated_at': '2022-05-12T15:14:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:02.666881 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3301950b-8679-4607-9c74-d124b21733ce None None] The sync data for ids ['82fdce0c-213a-480d-a72d-d6fec22a5428'] in n-d-841483-1 is: [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:13:55Z', 'revision_number': 3, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port': {'id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:0b:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_gateway', 'standard_attr_id': 981, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:52Z', 'updated_at': '2022-05-12T15:14:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:14:02.749435 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-e62825e7-fd04-4b53-a167-a040f7564701 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e HTTP/1.1" status: 200 len: 217 time: 0.1484799 May 12 15:14:02.766307 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-fd86ea9e-2195-43d9-9948-16330cd6dcc2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.9781196 May 12 15:14:02.784767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Request body: {'port': {'device_id': '964db126-f48c-4257-8b18-8bd06d832b12', 'network_id': 'a77dc623-3230-4c49-bb40-819a554177b1', 'admin_state_up': True, 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:02.804020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'tag': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:02.852923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-77143e7f-9756-4f04-b7f8-6ea48de7ce9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:02.854394 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-77143e7f-9756-4f04-b7f8-6ea48de7ce9a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=34e89d1d-72aa-4216-94d6-f37b8a0c162b HTTP/1.1" status: 200 len: 797 time: 0.3133686 May 12 15:14:02.902784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-008aa95e-594f-49e3-a018-fee9e45e99ee req-b24069c9-5a56-4b3c-afdd-f8200fbee3b1 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3489285 May 12 15:14:02.914355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0529d5d5-6c10-4221-8b4a-34d82a1ad0ae req-f020c5c5-b2bb-4f01-9386-0bd0a83a6d71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:02.915737 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0529d5d5-6c10-4221-8b4a-34d82a1ad0ae req-f020c5c5-b2bb-4f01-9386-0bd0a83a6d71 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.4859445 May 12 15:14:02.928403 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:02.954407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-4db5ec3e-0491-47ec-8bbd-f96267d2bceb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:02.956121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-4db5ec3e-0491-47ec-8bbd-f96267d2bceb service neutron] 10.222.0.76 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.1977482 May 12 15:14:03.036582 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-b8c55d5d-82c1-4f3c-8604-74a7beb5372c service neutron] 10.222.0.76 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3755660 May 12 15:14:03.069876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a656597a-ddc3-4eea-8960-488e3fd97aa6 req-2e989a66-6264-4ffc-bcd3-31c0da7f30e0 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:03.079845 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a656597a-ddc3-4eea-8960-488e3fd97aa6 req-2e989a66-6264-4ffc-bcd3-31c0da7f30e0 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/ports?device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 943 time: 0.6270673 May 12 15:14:03.143362 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6be4b6fc-36ce-4977-aacb-aaefbb4f460b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1693914 May 12 15:14:03.185867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:03.197818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Usage tracker for resource:port and tenant:1aea6927c780448b89ddf44ec6bcb186 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:03.204631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Quota usage for port was recalculated. Used quota:5. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:03.220402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attempting to reserve 1 items for resource port. Total usage: 5; quota limit: 500; headroom:495 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:03.251895 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0529d5d5-6c10-4221-8b4a-34d82a1ad0ae req-02fe4f72-6478-4ba0-a221-82735a9f810f service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3240116 May 12 15:14:03.296714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Made reservation on behalf of 1aea6927c780448b89ddf44ec6bcb186 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:03.300223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:03.395277 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4fc66578-adb0-48e9-b7b1-9ec331ead445 req-d0e93711-47e3-45d4-9583-50062d6afd8e service neutron] 10.222.0.76 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3427565 May 12 15:14:03.520969 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0529d5d5-6c10-4221-8b4a-34d82a1ad0ae req-e6090dca-952c-416d-9d68-5dd4a3d25a3d service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2515368 May 12 15:14:03.527656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a656597a-ddc3-4eea-8960-488e3fd97aa6 req-fc276863-43d5-4f98-a9b1-99ebcf088589 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/security-groups?id=acb87c27-050e-44b1-859d-2cd063c51659&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4467435 May 12 15:14:03.590676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-4dbb068d-4b92-45a6-9896-525df9771a9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:03.592351 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-4dbb068d-4b92-45a6-9896-525df9771a9e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.7299538 May 12 15:14:03.600707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Allocated IP 19.86.0.237 (a77dc623-3230-4c49-bb40-819a554177b1/017deaab-283a-4147-ab68-24cdb3eaed15/821acf60-4359-4f69-aa40-45a9cf272ac4) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:14:03.734931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-075c4672-503d-4cda-bc07-954d51dc17b4 service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5491915 May 12 15:14:03.858816 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 42d2caf6-4185-4201-91dc-c0881fe15eea up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:03.883713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-773efa4b-1ebd-4d55-ad75-f651de24eaa1 req-9e431425-5bb9-40a4-8413-65a1152fa7ab tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:03.885223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-773efa4b-1ebd-4d55-ad75-f651de24eaa1 req-9e431425-5bb9-40a4-8413-65a1152fa7ab tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 946 time: 0.7445617 May 12 15:14:03.899696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Allocated IP 172.20.0.1 (939fdac4-3043-4213-bd31-a421a6c659bc/c7af977d-fe6b-4182-af40-d4c2523b54a3/27d87447-eec9-4938-9dce-782d012459ac) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:14:03.940598 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f3d460e1-a3d9-407c-a7de-33aa9bc57c0d'] response: {'name': 'network-changed', 'server_uuid': '38791bcd-dc8b-4e32-bf93-723fbcfc3199', 'tag': '86786c97-61f2-4d39-8699-212c2f96f6f3', 'status': 'completed', 'code': 200} May 12 15:14:03.999975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 42d2caf6-4185-4201-91dc-c0881fe15eea completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:04.000590 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:04.008277 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 42d2caf6-4185-4201-91dc-c0881fe15eea triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:04.009251 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:04.031422 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-f8d08d3b-0ae0-48c7-bec2-60eb725bce65 service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4004343 May 12 15:14:04.034668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Transition to ACTIVE for port object 821acf60-4359-4f69-aa40-45a9cf272ac4 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:04.066347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c9c83a-ad01-49b1-9fad-0b2a4dfb6d03 req-e565deb7-b69c-4660-b420-bcf6856bdc49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:04.067838 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d3c9c83a-ad01-49b1-9fad-0b2a4dfb6d03 req-e565deb7-b69c-4660-b420-bcf6856bdc49 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=38791bcd-dc8b-4e32-bf93-723fbcfc3199 HTTP/1.1" status: 200 len: 1094 time: 0.1237793 May 12 15:14:04.166444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:04.173217 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-773efa4b-1ebd-4d55-ad75-f651de24eaa1 req-10af4e2f-1f9b-432c-832a-977619e9d1a4 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2775280 May 12 15:14:04.175395 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-9438902b-dd1c-4c0a-8ac7-a1cb8495c9d3 service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4312606 May 12 15:14:04.175927 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:04.208656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 42d2caf6-4185-4201-91dc-c0881fe15eea, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=42d2caf6-4185-4201-91dc-c0881fe15eea,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:04.226544 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:04.266593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Network a77dc623-3230-4c49-bb40-819a554177b1 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:04.275775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:04.282039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:14:04.391869 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=42d2caf6-4185-4201-91dc-c0881fe15eea,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:04.400730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c9c83a-ad01-49b1-9fad-0b2a4dfb6d03 req-22e31414-3ece-4be0-ac1c-4998d1dd8fdc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:04.402436 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d3c9c83a-ad01-49b1-9fad-0b2a4dfb6d03 req-22e31414-3ece-4be0-ac1c-4998d1dd8fdc service neutron] 10.222.0.76 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 907 time: 0.3270636 May 12 15:14:04.416427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event updated for resources: {'Port': ['ID=821acf60-4359-4f69-aa40-45a9cf272ac4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:04.507275 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:04.561472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Transition to ACTIVE for port object 27d87447-eec9-4938-9dce-782d012459ac will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:04.574176 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-8e900326-e300-48bd-91b9-1353ee4d1b58 service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4510620 May 12 15:14:04.592513 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b2a711-3481-4309-b5f4-9b42f944e4d5 req-3c7f557a-6dab-4f32-ba86-93a35ec72a11 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:04.598407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b2a711-3481-4309-b5f4-9b42f944e4d5 req-3c7f557a-6dab-4f32-ba86-93a35ec72a11 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:04.604431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b2a711-3481-4309-b5f4-9b42f944e4d5 req-3c7f557a-6dab-4f32-ba86-93a35ec72a11 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:04.610944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b2a711-3481-4309-b5f4-9b42f944e4d5 req-3c7f557a-6dab-4f32-ba86-93a35ec72a11 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:04.616675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b2a711-3481-4309-b5f4-9b42f944e4d5 req-3c7f557a-6dab-4f32-ba86-93a35ec72a11 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:04.623050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b2a711-3481-4309-b5f4-9b42f944e4d5 req-3c7f557a-6dab-4f32-ba86-93a35ec72a11 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:04.628848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b2a711-3481-4309-b5f4-9b42f944e4d5 req-3c7f557a-6dab-4f32-ba86-93a35ec72a11 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:04.630806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73b2a711-3481-4309-b5f4-9b42f944e4d5 req-3c7f557a-6dab-4f32-ba86-93a35ec72a11 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5430 time: 0.5394819 May 12 15:14:04.664516 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d3c9c83a-ad01-49b1-9fad-0b2a4dfb6d03 req-3fb1f245-22c2-4cb9-a58e-50fa418324bf service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=86786c97-61f2-4d39-8699-212c2f96f6f3 HTTP/1.1" status: 200 len: 217 time: 0.2490430 May 12 15:14:04.683383 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f862059b-a662-4f53-a2ae-acf19c1098f8 None None] Provisioning for port 821acf60-4359-4f69-aa40-45a9cf272ac4 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:04.688591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f862059b-a662-4f53-a2ae-acf19c1098f8 None None] Provisioning complete for port 821acf60-4359-4f69-aa40-45a9cf272ac4 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:04.688956 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f862059b-a662-4f53-a2ae-acf19c1098f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:04.727297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:04.727906 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:04.760260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c9c83a-ad01-49b1-9fad-0b2a4dfb6d03 req-50327ed7-544e-4bca-988f-97c19a35fa89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:04.763278 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d3c9c83a-ad01-49b1-9fad-0b2a4dfb6d03 req-50327ed7-544e-4bca-988f-97c19a35fa89 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.0895405 May 12 15:14:04.767726 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-90bfa28e-7347-4451-8ad5-c55ef1947b04 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.9868648 May 12 15:14:04.788351 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f862059b-a662-4f53-a2ae-acf19c1098f8 None None] Port 821acf60-4359-4f69-aa40-45a9cf272ac4 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:14:04.801806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 86786c97-61f2-4d39-8699-212c2f96f6f3 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:14:04.810320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-48322f54-7e65-4c24-8ccf-b8375220eae8 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.117&port_id=4834ab3b-6306-4f41-81ec-4af4df1f4c1b HTTP/1.1" status: 200 len: 217 time: 0.1772070 May 12 15:14:04.814570 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73b2a711-3481-4309-b5f4-9b42f944e4d5 req-f8630c36-2425-44a2-a068-e7b61a040603 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0818193 May 12 15:14:04.850407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Request body: {'port': {'device_id': '964db126-f48c-4257-8b18-8bd06d832b12', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:04.907194 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d3c9c83a-ad01-49b1-9fad-0b2a4dfb6d03 req-9e38bf80-e8f5-46a8-9743-9fcaf9b856a4 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1359322 May 12 15:14:04.914583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203209ee-5cd8-40fb-9eb0-f3d395ca6e94 req-313f2137-6bba-4de3-bd94-daa0f87b3652 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:04.924457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203209ee-5cd8-40fb-9eb0-f3d395ca6e94 req-313f2137-6bba-4de3-bd94-daa0f87b3652 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:04.933110 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-203209ee-5cd8-40fb-9eb0-f3d395ca6e94 req-313f2137-6bba-4de3-bd94-daa0f87b3652 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=964db126-f48c-4257-8b18-8bd06d832b12 HTTP/1.1" status: 200 len: 1655 time: 0.5231636 May 12 15:14:04.948057 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e74cba62-8e16-45c5-88b0-47de953aa8b9'] response: {'name': 'network-changed', 'server_uuid': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'tag': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e', 'status': 'completed', 'code': 200} May 12 15:14:04.979425 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:05.006428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 86786c97-61f2-4d39-8699-212c2f96f6f3, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=86786c97-61f2-4d39-8699-212c2f96f6f3,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:05.024094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '86786c97-61f2-4d39-8699-212c2f96f6f3', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'port_id': '86786c97-61f2-4d39-8699-212c2f96f6f3', 'mac_address': 'fa:16:3e:1c:e5:29', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 558, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84c2082e-f394-46d5-8a8f-8e3a70d54fc1', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:14:05.100912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-95374fc6-1a20-4323-a948-1aef314b95b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:05.101839 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-95374fc6-1a20-4323-a948-1aef314b95b2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=34e89d1d-72aa-4216-94d6-f37b8a0c162b HTTP/1.1" status: 200 len: 797 time: 0.2825422 May 12 15:14:05.122374 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:05.143737 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:05.144987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 86786c97-61f2-4d39-8699-212c2f96f6f3 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:05.181984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 86786c97-61f2-4d39-8699-212c2f96f6f3, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=86786c97-61f2-4d39-8699-212c2f96f6f3,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:05.188068 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:05.189666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:14:05.205899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Network 939fdac4-3043-4213-bd31-a421a6c659bc is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:05.219617 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d3c9c83a-ad01-49b1-9fad-0b2a4dfb6d03 req-d38aec35-e506-426f-83bf-7d5d69dbb201 service neutron] 10.222.0.76 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3017807 May 12 15:14:05.298721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:05.319888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:14:05.396898 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:05.535970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=86786c97-61f2-4d39-8699-212c2f96f6f3,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:05.619877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e,segment=NetworkSegment(fc4158ff-96b8-4d00-981b-81b5cdb89988),segment_id=fc4158ff-96b8-4d00-981b-81b5cdb89988)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:05.634595 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d3c9c83a-ad01-49b1-9fad-0b2a4dfb6d03 req-897d206a-b970-4889-a5db-8c0b673b387a service neutron] 10.222.0.76 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3902671 May 12 15:14:05.643798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'port_id': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e', 'mac_address': 'fa:16:3e:28:75:fc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 596, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9a114164-5df9-48f9-8806-96a06aeff952', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:14:05.693691 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-203209ee-5cd8-40fb-9eb0-f3d395ca6e94 req-956c7b3b-843a-498c-99d9-0069ea935330 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7563581 May 12 15:14:05.734122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Pushing event updated for resources: {'Port': ['ID=27d87447-eec9-4938-9dce-782d012459ac,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:05.765495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-afa8cdd2-e26f-4809-89af-cd4be1506d65 None None] Provisioning for port 27d87447-eec9-4938-9dce-782d012459ac completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:05.773797 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:05.789358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55e09acf-1785-46d1-9b0a-be2eea8fd18f req-0c28f4b9-ddaf-43ec-9f66-76af000daaea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:05.791093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55e09acf-1785-46d1-9b0a-be2eea8fd18f req-0c28f4b9-ddaf-43ec-9f66-76af000daaea service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a687923521d64fba8b0ceae3dbf4d7d3&device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 1094 time: 0.8032396 May 12 15:14:05.805179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-afa8cdd2-e26f-4809-89af-cd4be1506d65 None None] Provisioning complete for port 27d87447-eec9-4938-9dce-782d012459ac triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:05.805761 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-afa8cdd2-e26f-4809-89af-cd4be1506d65 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:05.825299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f9f5bc5a-a74b-4196-8629-7321fb74da65 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:05.834473 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:05.853159 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Transition to ACTIVE for port object f9f5bc5a-a74b-4196-8629-7321fb74da65 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:05.865285 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:05.880534 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:05.902455 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e,segment=NetworkSegment(fc4158ff-96b8-4d00-981b-81b5cdb89988),segment_id=fc4158ff-96b8-4d00-981b-81b5cdb89988)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:05.906085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-afa8cdd2-e26f-4809-89af-cd4be1506d65 None None] Port 27d87447-eec9-4938-9dce-782d012459ac cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:14:05.910712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 42d2caf6-4185-4201-91dc-c0881fe15eea up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:05.934943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-ad9258fd-dc77-423f-9bca-b194711d7774 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:05.936803 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-ad9258fd-dc77-423f-9bca-b194711d7774 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.8137960 May 12 15:14:05.951466 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:05.966052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c5b3a9c-071d-49fb-bff7-bb9223fb12aa req-cf5f3148-b638-480a-8b98-a89c488f1fea tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:05.968019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c5b3a9c-071d-49fb-bff7-bb9223fb12aa req-cf5f3148-b638-480a-8b98-a89c488f1fea tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=38791bcd-dc8b-4e32-bf93-723fbcfc3199 HTTP/1.1" status: 200 len: 944 time: 0.7611108 May 12 15:14:06.022886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-f37066cf-c3ee-423f-9148-d9dfa9f2e1b7 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:06.024709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-f37066cf-c3ee-423f-9148-d9dfa9f2e1b7 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "GET /v2.0/ports?device_id=d63a3a59-bf0b-4b7e-ab5a-b1275d00d587 HTTP/1.1" status: 200 len: 950 time: 0.7831545 May 12 15:14:06.064153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:06.102416 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 42d2caf6-4185-4201-91dc-c0881fe15eea triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:06.104223 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:06.322865 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c5b3a9c-071d-49fb-bff7-bb9223fb12aa req-467b7849-a765-4e86-9817-34e52837ce71 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3222833 May 12 15:14:06.368375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Pushing event updated for resources: {'Port': ['ID=f9f5bc5a-a74b-4196-8629-7321fb74da65,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:06.370239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:06.385260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Deleting port 8c301fff-eebe-4ee3-ae47-9da749d76d58 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:06.389781 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:06.416957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['86786c97-61f2-4d39-8699-212c2f96f6f3'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:06.487447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Attempting to bind port f9f5bc5a-a74b-4196-8629-7321fb74da65 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:14:06.488124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Attempting to bind port f9f5bc5a-a74b-4196-8629-7321fb74da65 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '8ffe4223-2972-4274-85b3-fbe4e0a1c649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'cc2308f9-d1ec-4568-bf98-60c7e336ff78'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:14:06.488555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Attempting to bind port f9f5bc5a-a74b-4196-8629-7321fb74da65 on network cc2308f9-d1ec-4568-bf98-60c7e336ff78 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:06.497365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Port f9f5bc5a-a74b-4196-8629-7321fb74da65 on network cc2308f9-d1ec-4568-bf98-60c7e336ff78 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:14:06.497720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Attempting to bind port f9f5bc5a-a74b-4196-8629-7321fb74da65 on network cc2308f9-d1ec-4568-bf98-60c7e336ff78 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:06.511129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:14:06.511129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Checking segment: {'id': '8ffe4223-2972-4274-85b3-fbe4e0a1c649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'cc2308f9-d1ec-4568-bf98-60c7e336ff78'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:06.511129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Bound using segment: {'id': '8ffe4223-2972-4274-85b3-fbe4e0a1c649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'cc2308f9-d1ec-4568-bf98-60c7e336ff78'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:14:06.511129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Bound port: f9f5bc5a-a74b-4196-8629-7321fb74da65, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8ffe4223-2972-4274-85b3-fbe4e0a1c649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'cc2308f9-d1ec-4568-bf98-60c7e336ff78'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:14:06.512895 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:06.567751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55e09acf-1785-46d1-9b0a-be2eea8fd18f req-ed7b7159-052e-4999-b32c-57c035b88e71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:06.568641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55e09acf-1785-46d1-9b0a-be2eea8fd18f req-ed7b7159-052e-4999-b32c-57c035b88e71 service neutron] 10.222.0.76 "GET /v2.0/networks?id=13bc975a-b248-4de3-b27d-6d14b7951c4b HTTP/1.1" status: 200 len: 930 time: 0.7711666 May 12 15:14:06.624564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] For port f9f5bc5a-a74b-4196-8629-7321fb74da65, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:06.628069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] For port f9f5bc5a-a74b-4196-8629-7321fb74da65, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f9f5bc5a-a74b-4196-8629-7321fb74da65,segment=NetworkSegment(8ffe4223-2972-4274-85b3-fbe4e0a1c649),segment_id=8ffe4223-2972-4274-85b3-fbe4e0a1c649)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:14:06.632332 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:06.703655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-bad88814-6b10-4fdc-a64b-f2f8f3202c82 service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7474513 May 12 15:14:06.707077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:06.708284 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:06.710123 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] 10.222.0.84 "PUT /v2.0/ports/f9f5bc5a-a74b-4196-8629-7321fb74da65 HTTP/1.1" status: 200 len: 1092 time: 1.8807347 May 12 15:14:06.711633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '964db126-f48c-4257-8b18-8bd06d832b12', 'tag': 'f9f5bc5a-a74b-4196-8629-7321fb74da65'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:06.738040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a358c9-58a5-4009-b6d3-22d314b7c5e1 service neutron] Pushing event updated for resources: {'Port': ['ID=f9f5bc5a-a74b-4196-8629-7321fb74da65,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:06.742661 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55e09acf-1785-46d1-9b0a-be2eea8fd18f req-ca68db3b-2cc4-49bc-9e2c-d8bba95a12e2 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e HTTP/1.1" status: 200 len: 217 time: 0.1487250 May 12 15:14:06.749969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Request body: {'port': {'device_id': '964db126-f48c-4257-8b18-8bd06d832b12', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:06.809322 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:06.811247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 8c301fff-eebe-4ee3-ae47-9da749d76d58 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:14:06.879846 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:06.955808 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:06.984781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd63a3a59-bf0b-4b7e-ab5a-b1275d00d587', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8c301fff-eebe-4ee3-ae47-9da749d76d58'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:06.997355 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 8c301fff-eebe-4ee3-ae47-9da749d76d58, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8c301fff-eebe-4ee3-ae47-9da749d76d58,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:07.002067 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:07.048716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55e09acf-1785-46d1-9b0a-be2eea8fd18f req-677f4ab4-d223-4b1e-bb83-abe1849837fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:07.050176 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55e09acf-1785-46d1-9b0a-be2eea8fd18f req-677f4ab4-d223-4b1e-bb83-abe1849837fa service neutron] 10.222.0.76 "GET /v2.0/subnets?id=9a114164-5df9-48f9-8806-96a06aeff952 HTTP/1.1" status: 200 len: 868 time: 0.2793875 May 12 15:14:07.083647 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=8c301fff-eebe-4ee3-ae47-9da749d76d58,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:07.246809 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca12641c-9095-4d74-91f1-431be609900b req-9238b7bb-2f97-4337-aa22-50ad097b9bcc tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:07.248346 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca12641c-9095-4d74-91f1-431be609900b req-9238b7bb-2f97-4337-aa22-50ad097b9bcc tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 0.8152325 May 12 15:14:07.288362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecce71f4-ad24-440f-8ca6-782f377f976e req-8a607936-3519-4c27-9c77-06e77a289a89 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:07.290248 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecce71f4-ad24-440f-8ca6-782f377f976e req-8a607936-3519-4c27-9c77-06e77a289a89 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/ports?device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 944 time: 0.7003236 May 12 15:14:07.356810 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e0ad55df-f263-4b5f-a04f-d5033ab1cb6b service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6216700 May 12 15:14:07.385742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 821acf60-4359-4f69-aa40-45a9cf272ac4 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:07.394103 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:07.410073 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Transition to ACTIVE for port object 821acf60-4359-4f69-aa40-45a9cf272ac4 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:07.414227 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:07.549123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Pushing event updated for resources: {'Port': ['ID=821acf60-4359-4f69-aa40-45a9cf272ac4,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:07.662865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Attempting to bind port 821acf60-4359-4f69-aa40-45a9cf272ac4 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:14:07.663106 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-6f3f0687-98c0-4661-8581-24d548cbd38c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=a2eb37f9-aba2-47d2-9756-11109b082c05 HTTP/1.1" status: 200 len: 217 time: 0.2579877 May 12 15:14:07.663233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Attempting to bind port 821acf60-4359-4f69-aa40-45a9cf272ac4 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '3176ebc9-22db-4ad4-84e4-d78f669f2179', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': 'a77dc623-3230-4c49-bb40-819a554177b1'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:14:07.663503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Attempting to bind port 821acf60-4359-4f69-aa40-45a9cf272ac4 on network a77dc623-3230-4c49-bb40-819a554177b1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:07.668858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Port 821acf60-4359-4f69-aa40-45a9cf272ac4 on network a77dc623-3230-4c49-bb40-819a554177b1 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:14:07.669165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Attempting to bind port 821acf60-4359-4f69-aa40-45a9cf272ac4 on network a77dc623-3230-4c49-bb40-819a554177b1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:07.674341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:14:07.674671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Checking segment: {'id': '3176ebc9-22db-4ad4-84e4-d78f669f2179', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': 'a77dc623-3230-4c49-bb40-819a554177b1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:07.675046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Bound using segment: {'id': '3176ebc9-22db-4ad4-84e4-d78f669f2179', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': 'a77dc623-3230-4c49-bb40-819a554177b1'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:14:07.675466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Bound port: 821acf60-4359-4f69-aa40-45a9cf272ac4, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3176ebc9-22db-4ad4-84e4-d78f669f2179', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': 'a77dc623-3230-4c49-bb40-819a554177b1'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:14:07.675799 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:07.759058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] For port 8c301fff-eebe-4ee3-ae47-9da749d76d58, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8c301fff-eebe-4ee3-ae47-9da749d76d58,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:07.759703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:07.774415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] For port 821acf60-4359-4f69-aa40-45a9cf272ac4, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:07.778438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] For port 821acf60-4359-4f69-aa40-45a9cf272ac4, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=821acf60-4359-4f69-aa40-45a9cf272ac4,segment=NetworkSegment(3176ebc9-22db-4ad4-84e4-d78f669f2179),segment_id=3176ebc9-22db-4ad4-84e4-d78f669f2179)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:14:07.781002 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecce71f4-ad24-440f-8ca6-782f377f976e req-21dd6d8b-642e-4432-88f6-a4abd8487751 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/security-groups?id=acb87c27-050e-44b1-859d-2cd063c51659&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4275055 May 12 15:14:07.783630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca12641c-9095-4d74-91f1-431be609900b req-fe3d8397-142c-419f-8a8a-cfb217546338 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5078416 May 12 15:14:07.784425 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:07.879249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Pushing event updated for resources: {'Port': ['ID=821acf60-4359-4f69-aa40-45a9cf272ac4,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:07.929421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Calling delete_port for 8c301fff-eebe-4ee3-ae47-9da749d76d58 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:07.936227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:07.936719 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:07.938102 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-2404ecfc-d4f1-4d8d-b919-0b9cc835a333 service neutron] 10.222.0.84 "PUT /v2.0/ports/821acf60-4359-4f69-aa40-45a9cf272ac4 HTTP/1.1" status: 200 len: 1092 time: 1.1934021 May 12 15:14:07.967437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55e09acf-1785-46d1-9b0a-be2eea8fd18f req-85de2dd4-22f1-479f-952d-100d14b5f570 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:07.968713 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55e09acf-1785-46d1-9b0a-be2eea8fd18f req-85de2dd4-22f1-479f-952d-100d14b5f570 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=13bc975a-b248-4de3-b27d-6d14b7951c4b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.9055293 May 12 15:14:07.995143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42cf2afb-6a90-4734-8c42-177fd896f5af req-cd0e3c84-b991-4c1b-933b-b0a7e040f3ac tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:07.997247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-42cf2afb-6a90-4734-8c42-177fd896f5af req-cd0e3c84-b991-4c1b-933b-b0a7e040f3ac tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Synchronizing usage tracker for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:14:08.017843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-42cf2afb-6a90-4734-8c42-177fd896f5af req-cd0e3c84-b991-4c1b-933b-b0a7e040f3ac tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Unset dirty status for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:14:08.019053 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-42cf2afb-6a90-4734-8c42-177fd896f5af req-cd0e3c84-b991-4c1b-933b-b0a7e040f3ac tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/ports?device_id=5ac222f7-bb37-42b6-9a18-0b8a2211c771 HTTP/1.1" status: 200 len: 949 time: 0.1434035 May 12 15:14:08.110161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e8ec6552-44ab-4e30-9e64-6da0987f62ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:08.112233 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-e8ec6552-44ab-4e30-9e64-6da0987f62ba service neutron] 10.222.0.84 "GET /v2.0/subnets?id=a98bb094-ea48-4784-b33c-d20b0aad5132 HTTP/1.1" status: 200 len: 797 time: 0.4362421 May 12 15:14:08.200872 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-42cf2afb-6a90-4734-8c42-177fd896f5af req-4ee77b1e-0f19-433e-8563-fe8232649576 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Deleting port 9c35d53f-6773-4ce7-9642-3b542a20efa8 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:08.200872 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-42cf2afb-6a90-4734-8c42-177fd896f5af req-4ee77b1e-0f19-433e-8563-fe8232649576 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:08.244440 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:14:08.284094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-d30a1e9f-ca13-43b4-8607-861a8b0239b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:08.284749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-d30a1e9f-ca13-43b4-8607-861a8b0239b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:08.286839 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-d30a1e9f-ca13-43b4-8607-861a8b0239b0 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1aea6927c780448b89ddf44ec6bcb186&device_id=964db126-f48c-4257-8b18-8bd06d832b12 HTTP/1.1" status: 200 len: 1981 time: 0.2570848 May 12 15:14:08.302228 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:08.338818 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:08.404508 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-b2767868-e767-4cae-a1d2-32d29f957980 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=19.80.0.127&port_id=f9f5bc5a-a74b-4196-8629-7321fb74da65 HTTP/1.1" status: 200 len: 217 time: 0.0896611 May 12 15:14:08.468204 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:14:08.468566 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:14:08.491952 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55e09acf-1785-46d1-9b0a-be2eea8fd18f req-4c1a3854-a146-4795-a548-0166e92e2fb3 service neutron] 10.222.0.76 "GET /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4414468 May 12 15:14:08.537290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-794de772-1c88-45e2-bc00-dfab39a2ed71 req-f609030f-de2c-4c2a-bfea-1df9f6e5560b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:08.538777 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-794de772-1c88-45e2-bc00-dfab39a2ed71 req-f609030f-de2c-4c2a-bfea-1df9f6e5560b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 946 time: 0.6171930 May 12 15:14:08.539394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Pushing event updated for resources: {'Port': ['ID=27d87447-eec9-4938-9dce-782d012459ac,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:08.546586 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:08.568246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42429f60-9532-4c81-9612-5c501d5d626b req-cd543aac-9612-477f-a5e5-876acdac7679 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:08.574847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42429f60-9532-4c81-9612-5c501d5d626b req-cd543aac-9612-477f-a5e5-876acdac7679 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:08.580455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42429f60-9532-4c81-9612-5c501d5d626b req-cd543aac-9612-477f-a5e5-876acdac7679 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:08.586214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42429f60-9532-4c81-9612-5c501d5d626b req-cd543aac-9612-477f-a5e5-876acdac7679 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:08.592948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42429f60-9532-4c81-9612-5c501d5d626b req-cd543aac-9612-477f-a5e5-876acdac7679 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:08.597265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-d665f5d3-f70f-4046-a57f-035389603c8b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:08.598570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42429f60-9532-4c81-9612-5c501d5d626b req-cd543aac-9612-477f-a5e5-876acdac7679 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:08.598737 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-d665f5d3-f70f-4046-a57f-035389603c8b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=95022f85-d8df-4537-b394-3df92c22f710 HTTP/1.1" status: 200 len: 801 time: 0.1850760 May 12 15:14:08.604577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42429f60-9532-4c81-9612-5c501d5d626b req-cd543aac-9612-477f-a5e5-876acdac7679 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:08.606784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-42429f60-9532-4c81-9612-5c501d5d626b req-cd543aac-9612-477f-a5e5-876acdac7679 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5430 time: 0.6432960 May 12 15:14:08.724294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-42cf2afb-6a90-4734-8c42-177fd896f5af req-4ee77b1e-0f19-433e-8563-fe8232649576 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] For port 9c35d53f-6773-4ce7-9642-3b542a20efa8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9c35d53f-6773-4ce7-9642-3b542a20efa8,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:08.724653 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-42cf2afb-6a90-4734-8c42-177fd896f5af req-4ee77b1e-0f19-433e-8563-fe8232649576 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:08.773004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-22c56e2e-76be-462a-a471-5ffe35050ce1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:08.774496 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-22c56e2e-76be-462a-a471-5ffe35050ce1 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=187794df-e6cb-4ee3-8b40-6b546c229bd2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.6035295 May 12 15:14:08.816031 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 86786c97-61f2-4d39-8699-212c2f96f6f3 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:08.879174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-42cf2afb-6a90-4734-8c42-177fd896f5af req-4ee77b1e-0f19-433e-8563-fe8232649576 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Calling delete_port for 9c35d53f-6773-4ce7-9642-3b542a20efa8 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:08.897755 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 86786c97-61f2-4d39-8699-212c2f96f6f3 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:08.905036 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-42429f60-9532-4c81-9612-5c501d5d626b req-132728a7-f352-478a-9013-3a566594446a tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2374628 May 12 15:14:08.905415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 86786c97-61f2-4d39-8699-212c2f96f6f3 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:08.905830 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:08.971280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Deleting port 8c301fff-eebe-4ee3-ae47-9da749d76d58 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:08.971952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:09.028647 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55e09acf-1785-46d1-9b0a-be2eea8fd18f req-30616be1-2f14-4f7e-93a0-66ee916f4684 service neutron] 10.222.0.76 "GET /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5262964 May 12 15:14:09.061520 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:09.070930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-22b0d9c9-9ab2-4756-87b3-bd8d0aed46b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:09.072503 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-22b0d9c9-9ab2-4756-87b3-bd8d0aed46b8 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=cc2308f9-d1ec-4568-bf98-60c7e336ff78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.4674039 May 12 15:14:09.073614 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-42cf2afb-6a90-4734-8c42-177fd896f5af req-4ee77b1e-0f19-433e-8563-fe8232649576 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:09.093992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:09.126704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3ae73679-d198-440a-966c-619a9930fbcb', '83a7b910-a912-4e05-9d03-5d6b1f6b0edc', '9c35d53f-6773-4ce7-9642-3b542a20efa8'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:09.147783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ee77b1e-0f19-433e-8563-fe8232649576 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event deleted for resources: {'Port': ['ID=9c35d53f-6773-4ce7-9642-3b542a20efa8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:09.161229 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-794de772-1c88-45e2-bc00-dfab39a2ed71 req-04e93d87-b057-445f-a16a-2b86aa207348 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6097555 May 12 15:14:09.203262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 86786c97-61f2-4d39-8699-212c2f96f6f3, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=86786c97-61f2-4d39-8699-212c2f96f6f3,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:09.221926 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:09.223059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:09.267611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Network 939fdac4-3043-4213-bd31-a421a6c659bc is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:09.271432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-24303a77-998a-442f-9b82-a0be0cf5946f service neutron] 10.222.0.84 "GET /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4824238 May 12 15:14:09.275354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:09.383578 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9747d08c-ec27-4c56-944b-9ea940286818'] response: {'name': 'network-changed', 'server_uuid': '964db126-f48c-4257-8b18-8bd06d832b12', 'tag': 'f9f5bc5a-a74b-4196-8629-7321fb74da65', 'status': 'completed', 'code': 200} May 12 15:14:09.491438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-42cf2afb-6a90-4734-8c42-177fd896f5af req-4ee77b1e-0f19-433e-8563-fe8232649576 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] No DVR routers for this DVR port 9c35d53f-6773-4ce7-9642-3b542a20efa8 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:14:09.496351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-42cf2afb-6a90-4734-8c42-177fd896f5af req-4ee77b1e-0f19-433e-8563-fe8232649576 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:09.533857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:09.543476 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:09.544217 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:09.555796 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-42cf2afb-6a90-4734-8c42-177fd896f5af req-4ee77b1e-0f19-433e-8563-fe8232649576 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "DELETE /v2.0/ports/9c35d53f-6773-4ce7-9642-3b542a20efa8 HTTP/1.1" status: 204 len: 173 time: 1.4764242 May 12 15:14:09.584288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=86786c97-61f2-4d39-8699-212c2f96f6f3,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:09.601274 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-bb0cc5a5-ff35-4eb2-b4a8-cb6071ef138f service neutron] 10.222.0.84 "GET /v2.0/networks/cc2308f9-d1ec-4568-bf98-60c7e336ff78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4756513 May 12 15:14:09.781911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-762be887-0a0d-4c73-bb1e-aec8cee29ea1 None None] Provisioning complete for port 27d87447-eec9-4938-9dce-782d012459ac triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:09.782276 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-762be887-0a0d-4c73-bb1e-aec8cee29ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:09.807591 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-c5bc5836-e15b-453c-8d69-56db89405ee0 service neutron] 10.222.0.84 "GET /v2.0/networks/cc2308f9-d1ec-4568-bf98-60c7e336ff78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1949022 May 12 15:14:09.893656 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-c67dc603-9882-4223-9300-af8996c39068 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=19.86.0.237&port_id=821acf60-4359-4f69-aa40-45a9cf272ac4 HTTP/1.1" status: 200 len: 217 time: 0.0770879 May 12 15:14:09.951925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca3c630-a1df-4544-a065-efc9c9dfd94a req-ddca7f8e-5f8b-4ab2-80c1-02b279b7863d tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:09.961300 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ca3c630-a1df-4544-a065-efc9c9dfd94a req-ddca7f8e-5f8b-4ab2-80c1-02b279b7863d tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=d63a3a59-bf0b-4b7e-ab5a-b1275d00d587 HTTP/1.1" status: 200 len: 948 time: 0.9023638 May 12 15:14:09.967476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-1256bdb0-f4ec-4249-a2cd-9bf763c63760 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:09.968839 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-1256bdb0-f4ec-4249-a2cd-9bf763c63760 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=017deaab-283a-4147-ab68-24cdb3eaed15 HTTP/1.1" status: 200 len: 801 time: 0.0670240 May 12 15:14:09.974148 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:10.014535 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e,segment=NetworkSegment(fc4158ff-96b8-4d00-981b-81b5cdb89988),segment_id=fc4158ff-96b8-4d00-981b-81b5cdb89988)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:10.030118 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:10.052992 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4a1d71-924d-4175-bc98-40935ded7394 req-7c940d5c-734f-4de6-aad3-6ff80d6a4d7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:10.053668 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-7c940d5c-734f-4de6-aad3-6ff80d6a4d7d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a77dc623-3230-4c49-bb40-819a554177b1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0773752 May 12 15:14:10.093990 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-762be887-0a0d-4c73-bb1e-aec8cee29ea1 None None] Port 27d87447-eec9-4938-9dce-782d012459ac cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:14:10.099434 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-8e768e14-2dfd-4533-b594-d14269813901 service neutron] 10.222.0.84 "GET /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7968781 May 12 15:14:10.113927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] For port 8c301fff-eebe-4ee3-ae47-9da749d76d58, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8c301fff-eebe-4ee3-ae47-9da749d76d58,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:10.114440 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:10.140527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:10.184199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Router 82fdce0c-213a-480d-a72d-d6fec22a5428 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:14:10.201706 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-f96609ec-0f95-4913-8969-0bfb69519567 service neutron] 10.222.0.84 "GET /v2.0/networks/a77dc623-3230-4c49-bb40-819a554177b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1397891 May 12 15:14:10.201940 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ca3c630-a1df-4544-a065-efc9c9dfd94a req-5abcb341-3361-4fb6-b9a9-83aa7caff035 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2395809 May 12 15:14:10.252335 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-295e6a5d-db8b-40c9-ac98-a134d63681ae'] response: {'server_uuid': 'd63a3a59-bf0b-4b7e-ab5a-b1275d00d587', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8c301fff-eebe-4ee3-ae47-9da749d76d58', 'code': 200} May 12 15:14:10.266601 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-97fbeaba-56c9-4d82-a78a-7d837bd1f065 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=39390bec-fdd9-4910-a8d2-6718da722725 HTTP/1.1" status: 200 len: 217 time: 0.1438982 May 12 15:14:10.345293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Calling delete_port for 8c301fff-eebe-4ee3-ae47-9da749d76d58 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:10.373853 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da4a1d71-924d-4175-bc98-40935ded7394 req-149d2878-16f6-41e7-8b81-3b09bfa0659d service neutron] 10.222.0.84 "GET /v2.0/networks/a77dc623-3230-4c49-bb40-819a554177b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1553633 May 12 15:14:10.565749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a785ef-a1d9-4d3a-9117-aed24112aeb6 req-6b0e2bc3-5f68-4e3b-be48-cd2e26b297a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:10.566567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a785ef-a1d9-4d3a-9117-aed24112aeb6 req-6b0e2bc3-5f68-4e3b-be48-cd2e26b297a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:10.568009 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e1a785ef-a1d9-4d3a-9117-aed24112aeb6 req-6b0e2bc3-5f68-4e3b-be48-cd2e26b297a2 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1aea6927c780448b89ddf44ec6bcb186&device_id=964db126-f48c-4257-8b18-8bd06d832b12 HTTP/1.1" status: 200 len: 1981 time: 0.0741401 May 12 15:14:10.577818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c8cbd8-4cc7-4031-bdc1-c929a04961b5 req-9868134d-5d38-4f1c-9a5a-ae46b237d639 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:10.583481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c8cbd8-4cc7-4031-bdc1-c929a04961b5 req-9868134d-5d38-4f1c-9a5a-ae46b237d639 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:10.584987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31c8cbd8-4cc7-4031-bdc1-c929a04961b5 req-9868134d-5d38-4f1c-9a5a-ae46b237d639 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=964db126-f48c-4257-8b18-8bd06d832b12 HTTP/1.1" status: 200 len: 1679 time: 0.9911456 May 12 15:14:10.646048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-65d3e528-10ed-4b5a-9acd-ea8572e343d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:10.647143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-65d3e528-10ed-4b5a-9acd-ea8572e343d5 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=a98bb094-ea48-4784-b33c-d20b0aad5132 HTTP/1.1" status: 200 len: 797 time: 0.3137710 May 12 15:14:10.707574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a785ef-a1d9-4d3a-9117-aed24112aeb6 req-349b7144-6916-401f-966c-cea9c2c6aef3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:10.709103 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e1a785ef-a1d9-4d3a-9117-aed24112aeb6 req-349b7144-6916-401f-966c-cea9c2c6aef3 service neutron] 10.222.0.84 "GET /v2.0/networks?id=cc2308f9-d1ec-4568-bf98-60c7e336ff78 HTTP/1.1" status: 200 len: 903 time: 0.1339514 May 12 15:14:10.781584 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e1a785ef-a1d9-4d3a-9117-aed24112aeb6 req-2fe68960-a9c9-495c-886d-2b7dc5db6ce5 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=19.80.0.127&port_id=f9f5bc5a-a74b-4196-8629-7321fb74da65 HTTP/1.1" status: 200 len: 217 time: 0.0655353 May 12 15:14:10.809894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31c8cbd8-4cc7-4031-bdc1-c929a04961b5 req-a69a31cc-9cbc-43de-9353-7277d5f80f6a tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2161057 May 12 15:14:10.854544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a785ef-a1d9-4d3a-9117-aed24112aeb6 req-6afda4d3-3785-4010-b652-6507c8eff01e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:10.857056 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e1a785ef-a1d9-4d3a-9117-aed24112aeb6 req-6afda4d3-3785-4010-b652-6507c8eff01e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=95022f85-d8df-4537-b394-3df92c22f710 HTTP/1.1" status: 200 len: 801 time: 0.0676115 May 12 15:14:10.888757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:14:10.908514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6f5f907-2f76-40d6-80f1-6b4ccae05de2 req-7e2af81f-643e-45d6-b389-86ff62cdf112 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:10.914507 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Sync routers for ids ['82fdce0c-213a-480d-a72d-d6fec22a5428'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:14:10.915729 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6f5f907-2f76-40d6-80f1-6b4ccae05de2 req-7e2af81f-643e-45d6-b389-86ff62cdf112 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=38791bcd-dc8b-4e32-bf93-723fbcfc3199 HTTP/1.1" status: 200 len: 945 time: 0.4903286 May 12 15:14:10.925352 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Routers {'82fdce0c-213a-480d-a72d-d6fec22a5428'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:14:10.925993 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:13:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['82fdce0c-213a-480d-a72d-d6fec22a5428'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:10.955541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a785ef-a1d9-4d3a-9117-aed24112aeb6 req-49629b8b-779d-4853-b96d-1117b830dad9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:10.957174 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e1a785ef-a1d9-4d3a-9117-aed24112aeb6 req-49629b8b-779d-4853-b96d-1117b830dad9 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=cc2308f9-d1ec-4568-bf98-60c7e336ff78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0935190 May 12 15:14:10.992189 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:11.002801 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:11.059859 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-02b5134f-69a5-4f02-b138-a5dd98d3ea65 admin admin] 10.222.0.82 "PUT /v2.0/routers/82fdce0c-213a-480d-a72d-d6fec22a5428/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.6888292 May 12 15:14:11.086025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3ae73679-d198-440a-966c-619a9930fbcb', '83a7b910-a912-4e05-9d03-5d6b1f6b0edc'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:11.110883 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Set router 82fdce0c-213a-480d-a72d-d6fec22a5428 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:14:11.145677 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e1a785ef-a1d9-4d3a-9117-aed24112aeb6 req-7b951a0a-7a63-49d1-8044-0fba8ec77d6c service neutron] 10.222.0.84 "GET /v2.0/networks/cc2308f9-d1ec-4568-bf98-60c7e336ff78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1812778 May 12 15:14:11.218865 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event deleted for resources: {'Port': ['ID=8c301fff-eebe-4ee3-ae47-9da749d76d58,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:11.248598 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6f5f907-2f76-40d6-80f1-6b4ccae05de2 req-e223eee3-5e9b-4154-8918-5f664bd8c12b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3319287 May 12 15:14:11.346867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-6b815c4a-5fbc-45e8-ae81-b9cad2232f06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:11.348366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-6b815c4a-5fbc-45e8-ae81-b9cad2232f06 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=187794df-e6cb-4ee3-8b40-6b546c229bd2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.6813567 May 12 15:14:11.559259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '964db126-f48c-4257-8b18-8bd06d832b12', 'tag': '821acf60-4359-4f69-aa40-45a9cf272ac4'}, {'server_uuid': '5ac222f7-bb37-42b6-9a18-0b8a2211c771', 'name': 'network-vif-deleted', 'tag': '9c35d53f-6773-4ce7-9642-3b542a20efa8'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:11.566043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] No DVR routers for this DVR port 8c301fff-eebe-4ee3-ae47-9da749d76d58 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:14:11.619836 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e1a785ef-a1d9-4d3a-9117-aed24112aeb6 req-585b4b0d-d392-4749-9d22-0bf3b1ac3bfc service neutron] 10.222.0.84 "GET /v2.0/networks/cc2308f9-d1ec-4568-bf98-60c7e336ff78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4651542 May 12 15:14:11.630026 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:11.632094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b51810b7-ea2c-4c48-a7f1-75846f8ba1b7 req-e381a6e4-231b-4534-8b11-4a4d7c6abe73 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "DELETE /v2.0/ports/8c301fff-eebe-4ee3-ae47-9da749d76d58 HTTP/1.1" status: 204 len: 173 time: 5.5306482 May 12 15:14:11.642422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd63a3a59-bf0b-4b7e-ab5a-b1275d00d587', 'name': 'network-vif-deleted', 'tag': '8c301fff-eebe-4ee3-ae47-9da749d76d58'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:11.716350 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:14:06Z', 'revision_number': 4, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port': {'id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:0b:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_gateway', 'standard_attr_id': 981, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:52Z', 'updated_at': '2022-05-12T15:14:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '27d87447-eec9-4938-9dce-782d012459ac', 'name': '', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'mac_address': 'fa:16:3e:d6:d1:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_interface', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:03Z', 'updated_at': '2022-05-12T15:14:07Z', 'revision_number': 2, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'subnets': [{'id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:11.721054 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Checking router: 82fdce0c-213a-480d-a72d-d6fec22a5428 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:14:11.721529 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Updating router 82fdce0c-213a-480d-a72d-d6fec22a5428 port 27d87447-eec9-4938-9dce-782d012459ac binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:14:11.785137 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:11.817653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3dcc5a3-00ee-452c-9dce-dba9a0abc78b req-c3b60dc5-c3ce-44ac-90e9-0f2b4e8b9cb0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:11.825218 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3dcc5a3-00ee-452c-9dce-dba9a0abc78b req-c3b60dc5-c3ce-44ac-90e9-0f2b4e8b9cb0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 0.8897786 May 12 15:14:11.882134 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-dd9685d0-ff18-429a-8886-ebd5992e73c1 service neutron] 10.222.0.84 "GET /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5163333 May 12 15:14:11.935085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e61ac3a-34ea-486c-92bd-e07e066713f1 req-621a6a11-f3a1-4012-b2c1-6a29e4e71da9 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:11.936558 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e61ac3a-34ea-486c-92bd-e07e066713f1 req-621a6a11-f3a1-4012-b2c1-6a29e4e71da9 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/ports?device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 945 time: 0.4830084 May 12 15:14:12.021463 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3dcc5a3-00ee-452c-9dce-dba9a0abc78b req-681d49a4-bffe-49f3-bd76-53b184411ca2 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1953731 May 12 15:14:12.066863 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e61ac3a-34ea-486c-92bd-e07e066713f1 req-be6f9beb-c103-4952-9703-bb77e88612ed tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/security-groups?id=acb87c27-050e-44b1-859d-2cd063c51659&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798502 May 12 15:14:12.075557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53510) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:12.082084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Request body: {'network': {'name': 'tempest-TaggedBootDevicesTest-712902579-network', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:12.090391 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cc7a78-c8e9-421e-97d6-6b2ff97d1ed5 req-9427da2d-04a5-4dfd-8f2c-c8a7198f828d service neutron] 10.222.0.84 "GET /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2000570 May 12 15:14:12.094273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:12.095085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9c35d53f-6773-4ce7-9642-3b542a20efa8 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:14:12.101820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Usage tracker for resource:network and tenant:a8ccc27e73294a6abe2cb2107c8a9a66 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:12.107541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:12.117617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:12.140205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Made reservation on behalf of a8ccc27e73294a6abe2cb2107c8a9a66 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:12.140872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 9c35d53f-6773-4ce7-9642-3b542a20efa8 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:14:12.141433 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9c35d53f-6773-4ce7-9642-3b542a20efa8 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:14:12.149054 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.186297 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.207162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:12.212169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Usage tracker for resource:security_group_rule and tenant:a8ccc27e73294a6abe2cb2107c8a9a66 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:12.215993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:12.224412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:12.254696 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '38791bcd-dc8b-4e32-bf93-723fbcfc3199', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '86786c97-61f2-4d39-8699-212c2f96f6f3'}, {'server_uuid': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:12.284943 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.302556 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Transition to ACTIVE for port object 27d87447-eec9-4938-9dce-782d012459ac will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:12.315347 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.391524 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.397833 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.441482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 595} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:14:12.453586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f9cda2b9-397a-4d35-ad65-13e8a26f2766,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:12.459908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.460375 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Added segment 9a5ce622-a3ea-4c31-b698-fca2808b112c of type vlan for network 55fd03f8-edf5-46b5-a343-d05b647d0c02 May 12 15:14:12.503435 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.544020 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.545505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.546248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.567621 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64922e1a-62ab-4b29-992a-d4e419825bbb None None] Pushing event updated for resources: {'Port': ['ID=27d87447-eec9-4938-9dce-782d012459ac,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:12.569969 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Attempting to bind port 27d87447-eec9-4938-9dce-782d012459ac on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:14:12.570528 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Attempting to bind port 27d87447-eec9-4938-9dce-782d012459ac by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '7c4990b9-5a5f-484e-a357-c9a37d811129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:14:12.571039 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Attempting to bind port 27d87447-eec9-4938-9dce-782d012459ac on network 939fdac4-3043-4213-bd31-a421a6c659bc {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:12.581208 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64922e1a-62ab-4b29-992a-d4e419825bbb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:12.581742 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64922e1a-62ab-4b29-992a-d4e419825bbb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:12.582221 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64922e1a-62ab-4b29-992a-d4e419825bbb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:12.582714 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64922e1a-62ab-4b29-992a-d4e419825bbb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:12.583187 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64922e1a-62ab-4b29-992a-d4e419825bbb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:12.583678 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64922e1a-62ab-4b29-992a-d4e419825bbb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:12.584156 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64922e1a-62ab-4b29-992a-d4e419825bbb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:12.584634 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64922e1a-62ab-4b29-992a-d4e419825bbb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:12.585109 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64922e1a-62ab-4b29-992a-d4e419825bbb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:12.585610 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64922e1a-62ab-4b29-992a-d4e419825bbb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:12.586236 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64922e1a-62ab-4b29-992a-d4e419825bbb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:12.586704 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64922e1a-62ab-4b29-992a-d4e419825bbb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:12.590809 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:14:12.591420 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Checking segment: {'id': '7c4990b9-5a5f-484e-a357-c9a37d811129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:12.591973 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.592501 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Bound using segment: {'id': '7c4990b9-5a5f-484e-a357-c9a37d811129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:14:12.593105 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Bound port: 27d87447-eec9-4938-9dce-782d012459ac, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c4990b9-5a5f-484e-a357-c9a37d811129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:14:12.593645 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.633734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-d6b46c74-c12e-469d-90cd-0538cd314d83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.635328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-d6b46c74-c12e-469d-90cd-0538cd314d83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.635528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-d6b46c74-c12e-469d-90cd-0538cd314d83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.636005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-d6b46c74-c12e-469d-90cd-0538cd314d83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.637033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-d6b46c74-c12e-469d-90cd-0538cd314d83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.638072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-d6b46c74-c12e-469d-90cd-0538cd314d83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.638675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-d6b46c74-c12e-469d-90cd-0538cd314d83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.640688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-d6b46c74-c12e-469d-90cd-0538cd314d83 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=05b4f1ce61294fb29efb0a765ed28561&device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 6487 time: 0.2796934 May 12 15:14:12.658637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aee5cb9-4352-4715-b092-fe307b3a1d2a req-f7945d0f-b377-46c6-8190-89f3a6468c1f tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.659756 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6fa8c77c-3f90-464b-a63f-19486eef6b33 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.668399 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aee5cb9-4352-4715-b092-fe307b3a1d2a req-f7945d0f-b377-46c6-8190-89f3a6468c1f tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.670884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] Pushing event updated for resources: {'Network': ['ID=55fd03f8-edf5-46b5-a343-d05b647d0c02,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:12.675232 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b3d4b2b3-ba80-41f2-8c2a-cd91f899bb16 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.5985055 May 12 15:14:12.676703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aee5cb9-4352-4715-b092-fe307b3a1d2a req-f7945d0f-b377-46c6-8190-89f3a6468c1f tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.677868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53518) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:12.684282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Request body: {'subnet': {'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02', 'cidr': '172.20.0.0/28', 'name': 'tempest-TaggedBootDevicesTest-712902579-subnet', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:12.684470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aee5cb9-4352-4715-b092-fe307b3a1d2a req-f7945d0f-b377-46c6-8190-89f3a6468c1f tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.684759 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 55fd03f8-edf5-46b5-a343-d05b647d0c02 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:14:12.690636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aee5cb9-4352-4715-b092-fe307b3a1d2a req-f7945d0f-b377-46c6-8190-89f3a6468c1f tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.695310 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:12.696860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aee5cb9-4352-4715-b092-fe307b3a1d2a req-f7945d0f-b377-46c6-8190-89f3a6468c1f tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.699914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Usage tracker for resource:subnet and tenant:a8ccc27e73294a6abe2cb2107c8a9a66 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:12.703347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aee5cb9-4352-4715-b092-fe307b3a1d2a req-f7945d0f-b377-46c6-8190-89f3a6468c1f tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.703968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:12.705333 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4aee5cb9-4352-4715-b092-fe307b3a1d2a req-f7945d0f-b377-46c6-8190-89f3a6468c1f tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5430 time: 0.5024846 May 12 15:14:12.710750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:12.743503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Made reservation on behalf of a8ccc27e73294a6abe2cb2107c8a9a66 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:12.744501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc3e6c66-252b-4bc1-a37c-28b74d65cfe5 req-2ecd30c0-876b-4337-af0a-5946305c787e tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.746502 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.746830 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc3e6c66-252b-4bc1-a37c-28b74d65cfe5 req-2ecd30c0-876b-4337-af0a-5946305c787e tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 946 time: 0.4447064 May 12 15:14:12.752839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-31bb3e32-a41a-4940-88ab-9fdc747f35c2 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:12.754294 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-31bb3e32-a41a-4940-88ab-9fdc747f35c2 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5&tenant_id=68c66ae0cd45476b87e2e79625b80f69&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1097 time: 0.3079493 May 12 15:14:12.770640 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] For port 27d87447-eec9-4938-9dce-782d012459ac, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:12.787860 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] For port 27d87447-eec9-4938-9dce-782d012459ac, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=27d87447-eec9-4938-9dce-782d012459ac,segment=NetworkSegment(7c4990b9-5a5f-484e-a357-c9a37d811129),segment_id=7c4990b9-5a5f-484e-a357-c9a37d811129)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:14:12.801855 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.844192 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:12.848955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c89ed514-64cd-4011-b01a-855ecf2c3a8e details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:14:12.904603 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h2-841483-1'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:12.929188 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Routers {'82fdce0c-213a-480d-a72d-d6fec22a5428'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:14:12.943967 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:13:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['82fdce0c-213a-480d-a72d-d6fec22a5428'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:12.999461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4aee5cb9-4352-4715-b092-fe307b3a1d2a req-dd9c38d8-f4b6-467d-967d-d147d3671b7f tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2489448 May 12 15:14:13.039927 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc3e6c66-252b-4bc1-a37c-28b74d65cfe5 req-7a0812b1-a97a-4fc2-84a2-5c8504f17044 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2736297 May 12 15:14:13.045081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:13.048639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:13.074162 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c89ed514-64cd-4011-b01a-855ecf2c3a8e has no active binding in host n-h2-841483-1 {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:142}} May 12 15:14:13.140154 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64922e1a-62ab-4b29-992a-d4e419825bbb None None] Pushing event updated for resources: {'Port': ['ID=27d87447-eec9-4938-9dce-782d012459ac,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:13.168496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-e437ed42-6850-4ac6-be92-593040bb273f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:13.170269 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-e437ed42-6850-4ac6-be92-593040bb273f service neutron] 10.222.0.84 "GET /v2.0/networks?id=187794df-e6cb-4ee3-8b40-6b546c229bd2 HTTP/1.1" status: 200 len: 902 time: 0.4624364 May 12 15:14:13.189423 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-85ef81f0-8ce8-4c63-8f9f-5d7d604c4bc3'] response: {'name': 'network-changed', 'server_uuid': '964db126-f48c-4257-8b18-8bd06d832b12', 'tag': '821acf60-4359-4f69-aa40-45a9cf272ac4', 'status': 'completed', 'code': 200} May 12 15:14:13.189789 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-85ef81f0-8ce8-4c63-8f9f-5d7d604c4bc3'] response: {'server_uuid': '5ac222f7-bb37-42b6-9a18-0b8a2211c771', 'name': 'network-vif-deleted', 'tag': '9c35d53f-6773-4ce7-9642-3b542a20efa8', 'status': 'completed', 'code': 200} May 12 15:14:13.252690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:13.262227 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] Set router 82fdce0c-213a-480d-a72d-d6fec22a5428 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:14:13.271218 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:13.284968 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e44b0c2c-78da-4f04-ba92-ab8895d3643e'] response: {'server_uuid': 'd63a3a59-bf0b-4b7e-ab5a-b1275d00d587', 'name': 'network-vif-deleted', 'tag': '8c301fff-eebe-4ee3-ae47-9da749d76d58', 'status': 'completed', 'code': 200} May 12 15:14:13.287117 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-78ff9b46-6967-4a22-bc42-6dc8ed262b7f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=39390bec-fdd9-4910-a8d2-6718da722725 HTTP/1.1" status: 200 len: 217 time: 0.1041367 May 12 15:14:13.368050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Checking segment: {'id': '9a5ce622-a3ea-4c31-b698-fca2808b112c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:13.371339 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Network hostable DHCP agents. Network: 55fd03f8-edf5-46b5-a343-d05b647d0c02, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:14:13.384446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-3e1911ed-21f8-40ff-84c2-c880b000b4bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:13.386942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-3e1911ed-21f8-40ff-84c2-c880b000b4bd service neutron] 10.222.0.84 "GET /v2.0/subnets?id=a98bb094-ea48-4784-b33c-d20b0aad5132 HTTP/1.1" status: 200 len: 797 time: 0.0912449 May 12 15:14:13.449754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Network 55fd03f8-edf5-46b5-a343-d05b647d0c02 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:14:13.461611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceb6ef9a-7b4c-4576-ada8-cf6f07529bab req-da73b72c-c895-47a2-b29b-903883c9e57c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:13.462282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceb6ef9a-7b4c-4576-ada8-cf6f07529bab req-da73b72c-c895-47a2-b29b-903883c9e57c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:13.463988 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ceb6ef9a-7b4c-4576-ada8-cf6f07529bab req-da73b72c-c895-47a2-b29b-903883c9e57c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1aea6927c780448b89ddf44ec6bcb186&device_id=964db126-f48c-4257-8b18-8bd06d832b12 HTTP/1.1" status: 200 len: 1981 time: 0.2124870 May 12 15:14:13.472056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 55fd03f8-edf5-46b5-a343-d05b647d0c02) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:13.481370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e069a14c-571b-4f45-9078-230e26309747 None None] Network 55fd03f8-edf5-46b5-a343-d05b647d0c02 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:14:13.501553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:13.502663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:13.612273 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b5d7c153-472c-4385-82ed-fd0b7547e823 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.9331601 May 12 15:14:13.616024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53526) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:13.626344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Request body: {'router': {'name': 'tempest-TaggedBootDevicesTest-712902579-router', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:13.651907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:13.671684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Usage tracker for resource:router and tenant:a8ccc27e73294a6abe2cb2107c8a9a66 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:13.713133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:13.748689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:13.755151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceb6ef9a-7b4c-4576-ada8-cf6f07529bab req-c18fc0a2-55ef-4085-a42f-0d415b1ad52e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:13.764413 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ceb6ef9a-7b4c-4576-ada8-cf6f07529bab req-c18fc0a2-55ef-4085-a42f-0d415b1ad52e service neutron] 10.222.0.84 "GET /v2.0/networks?id=a77dc623-3230-4c49-bb40-819a554177b1 HTTP/1.1" status: 200 len: 903 time: 0.2942815 May 12 15:14:13.805112 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3c3c843a-fbe0-44de-ab12-3f9e5949e09f'] response: {'server_uuid': '38791bcd-dc8b-4e32-bf93-723fbcfc3199', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '86786c97-61f2-4d39-8699-212c2f96f6f3', 'code': 200} May 12 15:14:13.805441 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3c3c843a-fbe0-44de-ab12-3f9e5949e09f'] response: {'server_uuid': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e', 'code': 200} May 12 15:14:13.846167 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:14:06Z', 'revision_number': 4, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port': {'id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:0b:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_gateway', 'standard_attr_id': 981, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:52Z', 'updated_at': '2022-05-12T15:14:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '27d87447-eec9-4938-9dce-782d012459ac', 'name': '', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'mac_address': 'fa:16:3e:d6:d1:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_interface', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:03Z', 'updated_at': '2022-05-12T15:14:12Z', 'revision_number': 4, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'subnets': [{'id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:13.857157 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb3bac72-6a6e-4894-9ad9-e3dd22c25ea6 None None] The sync data for ids ['82fdce0c-213a-480d-a72d-d6fec22a5428'] in n-d-841483-1 is: [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:14:06Z', 'revision_number': 4, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port': {'id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:0b:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_gateway', 'standard_attr_id': 981, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:52Z', 'updated_at': '2022-05-12T15:14:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '27d87447-eec9-4938-9dce-782d012459ac', 'name': '', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'mac_address': 'fa:16:3e:d6:d1:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_interface', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:03Z', 'updated_at': '2022-05-12T15:14:12Z', 'revision_number': 4, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'subnets': [{'id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:14:13.888930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-55fd03f8-edf5-46b5-a343-d05b647d0c02', 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'fixed_ips': [{'subnet_id': 'cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:14:13.890265 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:13.965091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:13.966865 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:13.990240 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ceb6ef9a-7b4c-4576-ada8-cf6f07529bab req-ee33ee33-50cb-42e1-92d3-7fd4a6b56866 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=19.86.0.237&port_id=821acf60-4359-4f69-aa40-45a9cf272ac4 HTTP/1.1" status: 200 len: 217 time: 0.2064977 May 12 15:14:14.070873 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:14.095308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 821acf60-4359-4f69-aa40-45a9cf272ac4 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:14:14.100004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceb6ef9a-7b4c-4576-ada8-cf6f07529bab req-97916ae6-d5f3-4706-b119-0d4bfd75f95a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:14.101875 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ceb6ef9a-7b4c-4576-ada8-cf6f07529bab req-97916ae6-d5f3-4706-b119-0d4bfd75f95a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=017deaab-283a-4147-ab68-24cdb3eaed15 HTTP/1.1" status: 200 len: 801 time: 0.1014407 May 12 15:14:14.114040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef56a085-0d15-4ab8-a738-d130dcbb6c56 req-1c2dc182-1eef-469f-91a2-bf8883e47aa0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:14.115524 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef56a085-0d15-4ab8-a738-d130dcbb6c56 req-1c2dc182-1eef-469f-91a2-bf8883e47aa0 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=38791bcd-dc8b-4e32-bf93-723fbcfc3199 HTTP/1.1" status: 200 len: 1096 time: 0.2167788 May 12 15:14:14.149599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-62d09407-56bf-4b54-925e-6537fe0e15e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:14.151098 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-62d09407-56bf-4b54-925e-6537fe0e15e1 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=187794df-e6cb-4ee3-8b40-6b546c229bd2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.7319536 May 12 15:14:14.171148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed251846-3ac5-4196-a479-99742d157058 req-2dfe1dbc-e728-47f4-b0c4-8b9f44b06feb tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:14.176868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed251846-3ac5-4196-a479-99742d157058 req-2dfe1dbc-e728-47f4-b0c4-8b9f44b06feb tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:14.184540 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed251846-3ac5-4196-a479-99742d157058 req-2dfe1dbc-e728-47f4-b0c4-8b9f44b06feb tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=964db126-f48c-4257-8b18-8bd06d832b12 HTTP/1.1" status: 200 len: 1679 time: 0.7595513 May 12 15:14:14.258310 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 821acf60-4359-4f69-aa40-45a9cf272ac4, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=821acf60-4359-4f69-aa40-45a9cf272ac4,segment=NetworkSegment(3176ebc9-22db-4ad4-84e4-d78f669f2179),segment_id=3176ebc9-22db-4ad4-84e4-d78f669f2179)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:14.290963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '821acf60-4359-4f69-aa40-45a9cf272ac4', 'network_id': 'a77dc623-3230-4c49-bb40-819a554177b1', 'port_id': '821acf60-4359-4f69-aa40-45a9cf272ac4', 'mac_address': 'fa:16:3e:35:5e:99', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 554, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '017deaab-283a-4147-ab68-24cdb3eaed15', 'ip_address': '19.86.0.237'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:14:14.381730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Allocated IP 172.20.0.2 (55fd03f8-edf5-46b5-a343-d05b647d0c02/cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c/2aacd053-a6fc-4b9c-a864-3492866aab49) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:14:14.383969 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:14.403007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d56c00-343c-429c-817e-4b043cc9d0e9 req-b3c0d4b5-ed3e-44c1-9e14-61f0aaa12bc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:14.404958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5d56c00-343c-429c-817e-4b043cc9d0e9 req-b3c0d4b5-ed3e-44c1-9e14-61f0aaa12bc5 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 1096 time: 0.4305003 May 12 15:14:14.410306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 821acf60-4359-4f69-aa40-45a9cf272ac4 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:14.492264 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:14.508934 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed251846-3ac5-4196-a479-99742d157058 req-b1b4623c-9337-4534-b6bd-8d3df937ec9d tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3232393 May 12 15:14:14.511935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 821acf60-4359-4f69-aa40-45a9cf272ac4, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=821acf60-4359-4f69-aa40-45a9cf272ac4,segment=NetworkSegment(3176ebc9-22db-4ad4-84e4-d78f669f2179),segment_id=3176ebc9-22db-4ad4-84e4-d78f669f2179)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:14.514429 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-97eb9486-02a6-42e5-b124-080f263a5ca7 service neutron] 10.222.0.84 "GET /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3099380 May 12 15:14:14.519071 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef56a085-0d15-4ab8-a738-d130dcbb6c56 req-c0714a29-3cc8-4c9a-b08c-cde9613d9a6f service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3628383 May 12 15:14:14.524441 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:14.526231 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f9f5bc5a-a74b-4196-8629-7321fb74da65 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:14:14.526508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:14.672468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f81c3ab-a5c9-4d39-af5d-ec12c99c2599 req-1849bad1-9926-4cbb-93a8-c70618082a24 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:14.674109 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f81c3ab-a5c9-4d39-af5d-ec12c99c2599 req-1849bad1-9926-4cbb-93a8-c70618082a24 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=38791bcd-dc8b-4e32-bf93-723fbcfc3199 HTTP/1.1" status: 200 len: 945 time: 0.7340035 May 12 15:14:14.715328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=821acf60-4359-4f69-aa40-45a9cf272ac4,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:14.722424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5d56c00-343c-429c-817e-4b043cc9d0e9 req-7ac8347d-ca9e-4080-b7f9-4d664a250522 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=acb87c27-050e-44b1-859d-2cd063c51659&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2954018 May 12 15:14:14.781491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceb6ef9a-7b4c-4576-ada8-cf6f07529bab req-45145fc5-bcbd-4d13-8b5e-4828d6f0f9bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:14.783188 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ceb6ef9a-7b4c-4576-ada8-cf6f07529bab req-45145fc5-bcbd-4d13-8b5e-4828d6f0f9bf service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a77dc623-3230-4c49-bb40-819a554177b1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.6665373 May 12 15:14:14.829671 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:14.882718 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dca98ab1-4c90-469a-8a13-ec7bf7ee034c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:14.900943 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f81c3ab-a5c9-4d39-af5d-ec12c99c2599 req-acf33c27-59a9-4838-9c4c-01d3b6d32ea2 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2116132 May 12 15:14:14.927552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-774723aa-dc9f-486a-b9ed-6095aa267a2a req-f0edf52c-b902-49e8-91d1-e7b335b01b44 service neutron] 10.222.0.84 "GET /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3819485 May 12 15:14:14.946246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port f9f5bc5a-a74b-4196-8629-7321fb74da65, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f9f5bc5a-a74b-4196-8629-7321fb74da65,segment=NetworkSegment(8ffe4223-2972-4274-85b3-fbe4e0a1c649),segment_id=8ffe4223-2972-4274-85b3-fbe4e0a1c649)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:14.947670 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ceb6ef9a-7b4c-4576-ada8-cf6f07529bab req-338d9721-c39a-490b-8fe9-971b4836c3f0 service neutron] 10.222.0.84 "GET /v2.0/networks/a77dc623-3230-4c49-bb40-819a554177b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1509075 May 12 15:14:14.974835 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:14.982202 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:14.988443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'f9f5bc5a-a74b-4196-8629-7321fb74da65', 'network_id': 'cc2308f9-d1ec-4568-bf98-60c7e336ff78', 'port_id': 'f9f5bc5a-a74b-4196-8629-7321fb74da65', 'mac_address': 'fa:16:3e:85:fa:a7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 563, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '95022f85-d8df-4537-b394-3df92c22f710', 'ip_address': '19.80.0.127'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:14:14.992997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Transition to ACTIVE for port object 2aacd053-a6fc-4b9c-a864-3492866aab49 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:15.003973 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:15.128702 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:15.178479 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f9f5bc5a-a74b-4196-8629-7321fb74da65 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:15.184787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Transition to ACTIVE for port object 2aacd053-a6fc-4b9c-a864-3492866aab49 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:15.189832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13f57147-0d71-461f-a0db-212db33d5cb5 req-d14e1a40-208e-4d8d-9ecf-01dfd16a5728 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:15.199815 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13f57147-0d71-461f-a0db-212db33d5cb5 req-d14e1a40-208e-4d8d-9ecf-01dfd16a5728 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/ports?device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 945 time: 0.4684527 May 12 15:14:15.200415 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:15.206651 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port f9f5bc5a-a74b-4196-8629-7321fb74da65, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f9f5bc5a-a74b-4196-8629-7321fb74da65,segment=NetworkSegment(8ffe4223-2972-4274-85b3-fbe4e0a1c649),segment_id=8ffe4223-2972-4274-85b3-fbe4e0a1c649)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:15.291352 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ceb6ef9a-7b4c-4576-ada8-cf6f07529bab req-7041d8aa-80ad-4407-8fb6-ee8fef58f99d service neutron] 10.222.0.84 "GET /v2.0/networks/a77dc623-3230-4c49-bb40-819a554177b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3340333 May 12 15:14:15.302816 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:15.307459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '42278800-f3f9-433a-9df4-98d9daab30e5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c89ed514-64cd-4011-b01a-855ecf2c3a8e'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:15.328685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Network 55fd03f8-edf5-46b5-a343-d05b647d0c02 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:15.332724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:15.337462 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:14:15.368002 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:15.378613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Pushing event updated for resources: {'Port': ['ID=2aacd053-a6fc-4b9c-a864-3492866aab49,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:15.406358 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:15.498009 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Attempting to bind port 2aacd053-a6fc-4b9c-a864-3492866aab49 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:14:15.498346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Attempting to bind port 2aacd053-a6fc-4b9c-a864-3492866aab49 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '9a5ce622-a3ea-4c31-b698-fca2808b112c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:14:15.498927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Attempting to bind port 2aacd053-a6fc-4b9c-a864-3492866aab49 on network 55fd03f8-edf5-46b5-a343-d05b647d0c02 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:15.509517 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 13, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:14:15.510201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Checking segment: {'id': '9a5ce622-a3ea-4c31-b698-fca2808b112c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:15.510775 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:15.511879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Bound using segment: {'id': '9a5ce622-a3ea-4c31-b698-fca2808b112c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:14:15.512505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Bound port: 2aacd053-a6fc-4b9c-a864-3492866aab49, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9a5ce622-a3ea-4c31-b698-fca2808b112c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:14:15.513501 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:15.538383 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=f9f5bc5a-a74b-4196-8629-7321fb74da65,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:15.584436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Allocated IP 172.25.8.186 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/09ea88a5-8b36-412b-ae6c-f2a8e7beae7f) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:14:15.609735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13f57147-0d71-461f-a0db-212db33d5cb5 req-8b5f15f8-4efc-4916-baaa-3bf30e3a9432 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/security-groups?id=acb87c27-050e-44b1-859d-2cd063c51659&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4088626 May 12 15:14:15.624237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] For port 2aacd053-a6fc-4b9c-a864-3492866aab49, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:15.628987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] For port 2aacd053-a6fc-4b9c-a864-3492866aab49, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2aacd053-a6fc-4b9c-a864-3492866aab49,segment=NetworkSegment(9a5ce622-a3ea-4c31-b698-fca2808b112c),segment_id=9a5ce622-a3ea-4c31-b698-fca2808b112c)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:14:15.630682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Attempting to bind port c89ed514-64cd-4011-b01a-855ecf2c3a8e on host n-h1-841483-1 for vnic_type normal with profile {"migrating_to": "n-h2-841483-1"} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:14:15.631052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Attempting to bind port c89ed514-64cd-4011-b01a-855ecf2c3a8e by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:14:15.631345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Attempting to bind port c89ed514-64cd-4011-b01a-855ecf2c3a8e on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:15.638334 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:15.688898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d518233-b071-4722-83a8-01477a72816d service neutron] Pushing event updated for resources: {'Port': ['ID=c89ed514-64cd-4011-b01a-855ecf2c3a8e,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:15.695857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Port c89ed514-64cd-4011-b01a-855ecf2c3a8e on network e8211761-0dd9-424f-b732-629fd2d77e28 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:14:15.696235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Attempting to bind port c89ed514-64cd-4011-b01a-855ecf2c3a8e on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:15.712906 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f9f5bc5a-a74b-4196-8629-7321fb74da65'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:15.721871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 14, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:14:15.722206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Checking segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:15.722589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Bound using segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:14:15.723013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Bound port: c89ed514-64cd-4011-b01a-855ecf2c3a8e, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:14:15.723397 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:15.750750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee98dd1-c552-4021-834b-3de63704002a req-b0f34fd0-4a61-447c-844d-33794c83fdda tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:15.758840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-b0f34fd0-4a61-447c-844d-33794c83fdda tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/networks?id=079240cc-25ba-4ba4-a3b0-412d897b19bb HTTP/1.1" status: 200 len: 815 time: 0.5513322 May 12 15:14:15.820836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-348d4b0c-0c12-499e-84e6-22a661df2adf None None] Pushing event updated for resources: {'Port': ['ID=2aacd053-a6fc-4b9c-a864-3492866aab49,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:15.946940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 27d87447-eec9-4938-9dce-782d012459ac up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:15.975771 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:16.000822 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-857f5045-4a36-4626-b9b3-94e143609fcf tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/quotas/aca50b48316f40a7a6ceb23c44dd4720 HTTP/1.1" status: 200 len: 375 time: 0.2411282 May 12 15:14:16.010187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:16.103523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:16.120021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:16.126940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:14:16.168138 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:16.183555 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:16.190347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4ad4438-d819-4a83-894f-2ba6d0522502 req-dc554ca6-5e8d-4b57-a441-8bdddae6d78e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:16.191836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e4ad4438-d819-4a83-894f-2ba6d0522502 req-dc554ca6-5e8d-4b57-a441-8bdddae6d78e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.76 "GET /v2.0/ports?device_id=93f69d1e-0068-4634-b7ad-70f7710d8470 HTTP/1.1" status: 200 len: 946 time: 0.6754458 May 12 15:14:16.220520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Pushing event updated for resources: {'Port': ['ID=09ea88a5-8b36-412b-ae6c-f2a8e7beae7f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:16.236840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 27d87447-eec9-4938-9dce-782d012459ac completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:16.249641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 27d87447-eec9-4938-9dce-782d012459ac triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:16.250013 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:16.287113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:16.304563 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:14:16.326980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-e4ad4438-d819-4a83-894f-2ba6d0522502 req-f05e307d-b891-4276-959e-174ca3f17a6e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Deleting port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:16.327461 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e4ad4438-d819-4a83-894f-2ba6d0522502 req-f05e307d-b891-4276-959e-174ca3f17a6e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:16.377157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:16.431391 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:16.468325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d96645-3b51-4aa9-9db6-7eb1cb7e191c req-d5c97186-c9d4-409c-9edb-6747f2ed7ad4 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:16.468599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 27d87447-eec9-4938-9dce-782d012459ac, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=27d87447-eec9-4938-9dce-782d012459ac,segment=NetworkSegment(7c4990b9-5a5f-484e-a357-c9a37d811129),segment_id=7c4990b9-5a5f-484e-a357-c9a37d811129)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:16.473377 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:16.476638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d96645-3b51-4aa9-9db6-7eb1cb7e191c req-d5c97186-c9d4-409c-9edb-6747f2ed7ad4 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:16.483019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d96645-3b51-4aa9-9db6-7eb1cb7e191c req-d5c97186-c9d4-409c-9edb-6747f2ed7ad4 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:16.488689 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d96645-3b51-4aa9-9db6-7eb1cb7e191c req-d5c97186-c9d4-409c-9edb-6747f2ed7ad4 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:16.494378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d96645-3b51-4aa9-9db6-7eb1cb7e191c req-d5c97186-c9d4-409c-9edb-6747f2ed7ad4 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:16.500963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d96645-3b51-4aa9-9db6-7eb1cb7e191c req-d5c97186-c9d4-409c-9edb-6747f2ed7ad4 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:16.506770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d96645-3b51-4aa9-9db6-7eb1cb7e191c req-d5c97186-c9d4-409c-9edb-6747f2ed7ad4 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:16.508695 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5d96645-3b51-4aa9-9db6-7eb1cb7e191c req-d5c97186-c9d4-409c-9edb-6747f2ed7ad4 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5430 time: 0.7118554 May 12 15:14:16.548126 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=27d87447-eec9-4938-9dce-782d012459ac,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:16.663517 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:16.753314 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-b1c54916-67b8-4101-83a0-e526a9cf74cc tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=aca50b48316f40a7a6ceb23c44dd4720&fields=id HTTP/1.1" status: 200 len: 255 time: 0.7514155 May 12 15:14:16.791921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['821acf60-4359-4f69-aa40-45a9cf272ac4'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:16.893361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d518233-b071-4722-83a8-01477a72816d service neutron] Pushing event updated for resources: {'Port': ['ID=c89ed514-64cd-4011-b01a-855ecf2c3a8e,revision_number=8']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:16.900181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:16.900842 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:16.902952 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6d518233-b071-4722-83a8-01477a72816d service neutron] 10.222.0.76 "PUT /v2.0/ports/c89ed514-64cd-4011-b01a-855ecf2c3a8e HTTP/1.1" status: 200 len: 1122 time: 4.1339576 May 12 15:14:16.967609 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5d96645-3b51-4aa9-9db6-7eb1cb7e191c req-4fa0bb7d-a5e2-485b-873d-2c4ca168319e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2750487 May 12 15:14:17.035173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c89ed514-64cd-4011-b01a-855ecf2c3a8e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:17.104403 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['c89ed514-64cd-4011-b01a-855ecf2c3a8e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:17.236658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fce815bb-b190-4731-a1ea-4c6756d3e8e9 None None] Network 55fd03f8-edf5-46b5-a343-d05b647d0c02 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:14:17.255877 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:17.279273 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-ad45faeb-9632-4188-bd5e-c743d7162644 service neutron] 10.222.0.82 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4869111 May 12 15:14:17.387791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6388607-0255-4ac7-a939-be0de8354788 req-a7e18ddb-ced1-48ea-9548-3c3b64fed318 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:17.389345 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e6388607-0255-4ac7-a939-be0de8354788 req-a7e18ddb-ced1-48ea-9548-3c3b64fed318 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 944 time: 0.2365000 May 12 15:14:17.440640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-e4ad4438-d819-4a83-894f-2ba6d0522502 req-f05e307d-b891-4276-959e-174ca3f17a6e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] For port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:17.441960 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e4ad4438-d819-4a83-894f-2ba6d0522502 req-f05e307d-b891-4276-959e-174ca3f17a6e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:17.474998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ff5bc426-9a43-4532-bb44-465ba787c574 None None] Provisioning for port 2aacd053-a6fc-4b9c-a864-3492866aab49 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:17.487864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Router 9b2fa912-d414-4854-a39a-4ff1d3393c44 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:14:17.600852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-e4ad4438-d819-4a83-894f-2ba6d0522502 req-f05e307d-b891-4276-959e-174ca3f17a6e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Calling delete_port for 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:17.607181 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:17.671250 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e6388607-0255-4ac7-a939-be0de8354788 req-21872bc6-8b77-44a7-9602-6fbf8f9afe98 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2735572 May 12 15:14:17.683836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-5926da9d-f903-400d-9742-2f1b93a3b08b service neutron] 10.222.0.82 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4018106 May 12 15:14:17.706365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:14:17.747692 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Sync routers for ids ['9b2fa912-d414-4854-a39a-4ff1d3393c44'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:14:17.764035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:17.766273 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2c86680f-0fcf-4196-ae21-136cb4db7627 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 4.1491191 May 12 15:14:17.769251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53556) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:17.772443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Routers {'9b2fa912-d414-4854-a39a-4ff1d3393c44'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:14:17.773235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:14:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9b2fa912-d414-4854-a39a-4ff1d3393c44'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:17.871912 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e4ad4438-d819-4a83-894f-2ba6d0522502 req-f05e307d-b891-4276-959e-174ca3f17a6e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:18.010743 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-928b8364-0322-484b-803b-e29c5262903a'] response: {'server_uuid': '42278800-f3f9-433a-9df4-98d9daab30e5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c89ed514-64cd-4011-b01a-855ecf2c3a8e', 'code': 200} May 12 15:14:18.018311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f05e307d-b891-4276-959e-174ca3f17a6e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Pushing event deleted for resources: {'Port': ['ID=79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:18.268749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Set router 9b2fa912-d414-4854-a39a-4ff1d3393c44 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:14:18.310237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-e4ad4438-d819-4a83-894f-2ba6d0522502 req-f05e307d-b891-4276-959e-174ca3f17a6e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] No DVR routers for this DVR port 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:14:18.318513 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e4ad4438-d819-4a83-894f-2ba6d0522502 req-f05e307d-b891-4276-959e-174ca3f17a6e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:18.345217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f9f5bc5a-a74b-4196-8629-7321fb74da65 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:18.377445 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 27d87447-eec9-4938-9dce-782d012459ac up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:18.392488 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e4ad4438-d819-4a83-894f-2ba6d0522502 req-f05e307d-b891-4276-959e-174ca3f17a6e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.76 "DELETE /v2.0/ports/79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 HTTP/1.1" status: 204 len: 173 time: 2.1900537 May 12 15:14:18.443997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9ac85e3-6214-455a-b76a-d87870dcb9a4 req-fb7da11e-02c5-4af4-aaed-5f2b1a768c69 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:18.468862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9ac85e3-6214-455a-b76a-d87870dcb9a4 req-fb7da11e-02c5-4af4-aaed-5f2b1a768c69 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:18.482198 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9ac85e3-6214-455a-b76a-d87870dcb9a4 req-fb7da11e-02c5-4af4-aaed-5f2b1a768c69 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=964db126-f48c-4257-8b18-8bd06d832b12 HTTP/1.1" status: 200 len: 1681 time: 0.3238928 May 12 15:14:18.576086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6720eeb-6d4b-4eee-95ec-12100a17d83e req-b96d0da2-b8b6-45bd-a49e-b65ab681172f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:18.578078 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6720eeb-6d4b-4eee-95ec-12100a17d83e req-b96d0da2-b8b6-45bd-a49e-b65ab681172f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=38791bcd-dc8b-4e32-bf93-723fbcfc3199 HTTP/1.1" status: 200 len: 945 time: 0.3826156 May 12 15:14:18.594634 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9ac85e3-6214-455a-b76a-d87870dcb9a4 req-de918fa7-0246-43a8-a2a3-59118d366df1 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1113126 May 12 15:14:18.688248 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6720eeb-6d4b-4eee-95ec-12100a17d83e req-8062ca28-7d76-4e4d-9e50-99e3ac5a3694 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0911100 May 12 15:14:18.710757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 27d87447-eec9-4938-9dce-782d012459ac triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:18.711287 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:18.748901 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port f9f5bc5a-a74b-4196-8629-7321fb74da65 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:18.774447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port f9f5bc5a-a74b-4196-8629-7321fb74da65 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:18.774817 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:18.858942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:14:18.895933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4528c9b-3940-463b-9cd5-afb74348b66e req-0c4f2c76-dec6-4dcd-83d6-d5991819322c tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:18.904549 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4528c9b-3940-463b-9cd5-afb74348b66e req-0c4f2c76-dec6-4dcd-83d6-d5991819322c tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/ports?device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 945 time: 0.1745682 May 12 15:14:18.908791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:14:18.909139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:14:19.005587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4528c9b-3940-463b-9cd5-afb74348b66e req-43991d6a-53ca-4fd5-8299-6b1214bd6faa tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/security-groups?id=acb87c27-050e-44b1-859d-2cd063c51659&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1000454 May 12 15:14:19.071799 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:19.215751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3c2e703f-f294-4178-bb0f-e9a0d866ff60 req-fbb5f001-f36d-4c51-8518-2e8feeeaee50 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Synchronizing usage tracker for tenant:aca50b48316f40a7a6ceb23c44dd4720 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:14:19.270365 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:19.297342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2aacd053-a6fc-4b9c-a864-3492866aab49 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:19.344550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Allocated IP 172.20.0.1 (55fd03f8-edf5-46b5-a343-d05b647d0c02/cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c/2b0f41b8-aaa6-4b9c-b597-703f558651d5) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:14:19.388336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '964db126-f48c-4257-8b18-8bd06d832b12', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f9f5bc5a-a74b-4196-8629-7321fb74da65'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:19.402479 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'name': 'tempest-TaggedBootDevicesTest-712902579-router', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.186'}], 'enable_snat': True}, 'gw_port_id': '09ea88a5-8b36-412b-ae6c-f2a8e7beae7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:14:13Z', 'updated_at': '2022-05-12T15:14:16Z', 'revision_number': 3, 'project_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'gw_port': {'id': '09ea88a5-8b36-412b-ae6c-f2a8e7beae7f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:3e:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 998, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:15Z', 'updated_at': '2022-05-12T15:14:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:19.409397 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port f9f5bc5a-a74b-4196-8629-7321fb74da65, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f9f5bc5a-a74b-4196-8629-7321fb74da65,segment=NetworkSegment(8ffe4223-2972-4274-85b3-fbe4e0a1c649),segment_id=8ffe4223-2972-4274-85b3-fbe4e0a1c649)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:19.413167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Checking router: 9b2fa912-d414-4854-a39a-4ff1d3393c44 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:14:19.413795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Updating router 9b2fa912-d414-4854-a39a-4ff1d3393c44 port 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:14:19.426795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3c2e703f-f294-4178-bb0f-e9a0d866ff60 req-fbb5f001-f36d-4c51-8518-2e8feeeaee50 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Unset dirty status for tenant:aca50b48316f40a7a6ceb23c44dd4720 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:14:19.428610 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c2e703f-f294-4178-bb0f-e9a0d866ff60 req-fbb5f001-f36d-4c51-8518-2e8feeeaee50 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 210 time: 0.3137684 May 12 15:14:19.465994 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:19.470182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a8e39c-8f42-435a-a68e-78351212978c req-4c37c0cc-9e42-425e-ae31-12d8ccbf56fb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:19.481146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a8e39c-8f42-435a-a68e-78351212978c req-4c37c0cc-9e42-425e-ae31-12d8ccbf56fb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:19.487513 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a8e39c-8f42-435a-a68e-78351212978c req-4c37c0cc-9e42-425e-ae31-12d8ccbf56fb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:19.497679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a8e39c-8f42-435a-a68e-78351212978c req-4c37c0cc-9e42-425e-ae31-12d8ccbf56fb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:19.505619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a8e39c-8f42-435a-a68e-78351212978c req-4c37c0cc-9e42-425e-ae31-12d8ccbf56fb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:19.513236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a8e39c-8f42-435a-a68e-78351212978c req-4c37c0cc-9e42-425e-ae31-12d8ccbf56fb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:19.521015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a8e39c-8f42-435a-a68e-78351212978c req-4c37c0cc-9e42-425e-ae31-12d8ccbf56fb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:19.523200 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1a8e39c-8f42-435a-a68e-78351212978c req-4c37c0cc-9e42-425e-ae31-12d8ccbf56fb tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5430 time: 0.3620870 May 12 15:14:19.524671 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:19.545133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Transition to ACTIVE for port object 2b0f41b8-aaa6-4b9c-b597-703f558651d5 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:19.561170 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:19.583065 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:19.595637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 2aacd053-a6fc-4b9c-a864-3492866aab49 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:19.625757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=f9f5bc5a-a74b-4196-8629-7321fb74da65,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:19.628257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2aacd053-a6fc-4b9c-a864-3492866aab49 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:19.628849 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:19.659187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Pushing event updated for resources: {'Port': ['ID=2b0f41b8-aaa6-4b9c-b597-703f558651d5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:19.672457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1a8e39c-8f42-435a-a68e-78351212978c req-fccfccff-7d9c-4000-b683-ce9e2cb80f02 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1430001 May 12 15:14:19.682419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:19.683621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:19.684156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:19.684655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:19.685144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:19.685678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:19.686894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:19.687423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:19.687932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:19.688603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:19.689096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:19.689603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:19.700534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Network 55fd03f8-edf5-46b5-a343-d05b647d0c02 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:19.703342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:19.723622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:14:19.756269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f28ec49-98a8-4857-a1be-6462a97ba7cf req-6e618780-8b2c-4359-abb3-f6c6f15b7e8a tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:19.767231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f28ec49-98a8-4857-a1be-6462a97ba7cf req-6e618780-8b2c-4359-abb3-f6c6f15b7e8a tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 944 time: 0.1891034 May 12 15:14:19.807698 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:19.849862 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f28ec49-98a8-4857-a1be-6462a97ba7cf req-6455eec1-18e9-4c14-8bd8-1cec1b4b3f7d tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0813451 May 12 15:14:20.005739 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.071150 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.077498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '42278800-f3f9-433a-9df4-98d9daab30e5', 'tag': 'c89ed514-64cd-4011-b01a-855ecf2c3a8e'}, {'server_uuid': '93f69d1e-0068-4634-b7ad-70f7710d8470', 'name': 'network-vif-deleted', 'tag': '79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:20.108851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 821acf60-4359-4f69-aa40-45a9cf272ac4 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:20.206790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3504d0c7-2155-4832-9484-63dbcc9369ea None None] Provisioning for port 2b0f41b8-aaa6-4b9c-b597-703f558651d5 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:20.251829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee98dd1-c552-4021-834b-3de63704002a req-6d6c1a01-5d60-4a96-a8ee-bdb1315789cd tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:20.254988 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-6d6c1a01-5d60-4a96-a8ee-bdb1315789cd tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.76 "GET /v2.0/networks?id=079240cc-25ba-4ba4-a3b0-412d897b19bb HTTP/1.1" status: 200 len: 815 time: 0.3174176 May 12 15:14:20.268031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd05b0f2-492a-4fd7-87fb-a7566b3e5dd5 req-54f73912-cac0-4cc8-9e46-63f0cd1c500f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:20.269222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 2aacd053-a6fc-4b9c-a864-3492866aab49, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2aacd053-a6fc-4b9c-a864-3492866aab49,segment=NetworkSegment(9a5ce622-a3ea-4c31-b698-fca2808b112c),segment_id=9a5ce622-a3ea-4c31-b698-fca2808b112c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:20.271001 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3504d0c7-2155-4832-9484-63dbcc9369ea None None] Provisioning complete for port 2b0f41b8-aaa6-4b9c-b597-703f558651d5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:20.271001 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3504d0c7-2155-4832-9484-63dbcc9369ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.280061 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd05b0f2-492a-4fd7-87fb-a7566b3e5dd5 req-54f73912-cac0-4cc8-9e46-63f0cd1c500f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=38791bcd-dc8b-4e32-bf93-723fbcfc3199 HTTP/1.1" status: 200 len: 945 time: 0.1946716 May 12 15:14:20.330229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-3ee98dd1-c552-4021-834b-3de63704002a req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Request body: {'port': {'device_id': '6062b237-2dea-4593-98c5-e5bcf587f743', 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb', 'admin_state_up': True, 'tenant_id': 'aca50b48316f40a7a6ceb23c44dd4720'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:20.378689 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.387112 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.392195 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.479666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3504d0c7-2155-4832-9484-63dbcc9369ea None None] Port 2b0f41b8-aaa6-4b9c-b597-703f558651d5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:14:20.502170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Pushing event updated for resources: {'Port': ['ID=2b0f41b8-aaa6-4b9c-b597-703f558651d5,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:20.507169 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.550353 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 821acf60-4359-4f69-aa40-45a9cf272ac4 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:20.551142 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd05b0f2-492a-4fd7-87fb-a7566b3e5dd5 req-58e1c02e-7f34-408b-a5e7-4af5d4f97fc3 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2698250 May 12 15:14:20.566189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 821acf60-4359-4f69-aa40-45a9cf272ac4 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:20.566555 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.599860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=2aacd053-a6fc-4b9c-a864-3492866aab49,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:20.638565 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.649720 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d8d79205-38da-4630-bef5-cdc544b53501'] response: {'server_uuid': '964db126-f48c-4257-8b18-8bd06d832b12', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f9f5bc5a-a74b-4196-8629-7321fb74da65', 'code': 200} May 12 15:14:20.658402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Transition to ACTIVE for port object 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:20.664881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Network 55fd03f8-edf5-46b5-a343-d05b647d0c02 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:20.666153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:20.676055 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-6d376082-da3a-4817-8dbf-ed670e442e84 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True&fields=id&id=5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 258 time: 0.3132513 May 12 15:14:20.688943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:20.706589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:20.709272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-3ee98dd1-c552-4021-834b-3de63704002a req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:20.714401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Usage tracker for resource:floatingip and tenant:a687923521d64fba8b0ceae3dbf4d7d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:20.721667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:20.729605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-3ee98dd1-c552-4021-834b-3de63704002a req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:20.733685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:20.756088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3ee98dd1-c552-4021-834b-3de63704002a req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Made reservation on behalf of aca50b48316f40a7a6ceb23c44dd4720 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:20.759641 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.760774 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3ee98dd1-c552-4021-834b-3de63704002a req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.815117 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.824171 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.862668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Attempting to bind port 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:14:20.863033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Attempting to bind port 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:14:20.863396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Attempting to bind port 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:20.891704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 14, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:14:20.891704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:20.891704 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.891704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:14:20.891704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Bound port: 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:14:20.892382 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:20.967064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Router 9b2fa912-d414-4854-a39a-4ff1d3393c44 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:14:20.978502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] For port 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:20.982646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] For port 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=09ea88a5-8b36-412b-ae6c-f2a8e7beae7f,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:14:20.988593 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bd96cc2-b5c7-42b5-a85d-7eac0c1a22bb None None] Pushing event updated for resources: {'Port': ['ID=09ea88a5-8b36-412b-ae6c-f2a8e7beae7f,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:20.999318 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:21.054199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 821acf60-4359-4f69-aa40-45a9cf272ac4, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=821acf60-4359-4f69-aa40-45a9cf272ac4,segment=NetworkSegment(3176ebc9-22db-4ad4-84e4-d78f669f2179),segment_id=3176ebc9-22db-4ad4-84e4-d78f669f2179)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:21.075909 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:21.091964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Routers {'9b2fa912-d414-4854-a39a-4ff1d3393c44'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:14:21.092589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:14:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9b2fa912-d414-4854-a39a-4ff1d3393c44'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:21.167040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-3ee98dd1-c552-4021-834b-3de63704002a req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Allocated IP 172.20.0.12 (079240cc-25ba-4ba4-a3b0-412d897b19bb/b6cc6b5a-d56a-4336-afb7-99232d9672dc/b4c1d2d6-213d-4562-8698-2dc7f8f15413) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:14:21.196865 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bd96cc2-b5c7-42b5-a85d-7eac0c1a22bb None None] Pushing event updated for resources: {'Port': ['ID=09ea88a5-8b36-412b-ae6c-f2a8e7beae7f,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:21.222087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a5f436a-4c83-43af-a984-416eb05ceece req-9ff2014f-f67c-4790-a9c6-37015d9a2f8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:21.228261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a5f436a-4c83-43af-a984-416eb05ceece req-9ff2014f-f67c-4790-a9c6-37015d9a2f8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:21.231421 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a5f436a-4c83-43af-a984-416eb05ceece req-9ff2014f-f67c-4790-a9c6-37015d9a2f8b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=964db126-f48c-4257-8b18-8bd06d832b12 HTTP/1.1" status: 200 len: 1682 time: 0.4551446 May 12 15:14:21.270812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=821acf60-4359-4f69-aa40-45a9cf272ac4,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:21.328178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ccd327ed-478a-4293-b8b6-8d4a923093ef None None] Provisioning complete for port 2b0f41b8-aaa6-4b9c-b597-703f558651d5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:21.328178 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ccd327ed-478a-4293-b8b6-8d4a923093ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:21.330679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:14:21.347320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a5f436a-4c83-43af-a984-416eb05ceece req-6aaac35c-1092-404b-93d0-e600b9984e72 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0990953 May 12 15:14:21.362339 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ec98a322-a6e7-47c1-a039-c83930c84934 admin admin] 10.222.0.82 "PUT /v2.0/routers/9b2fa912-d414-4854-a39a-4ff1d3393c44/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5911200 May 12 15:14:21.440720 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2f484932-9193-4599-9977-7e1c83c33fff'] response: {'name': 'network-changed', 'server_uuid': '42278800-f3f9-433a-9df4-98d9daab30e5', 'tag': 'c89ed514-64cd-4011-b01a-855ecf2c3a8e', 'status': 'completed', 'code': 200} May 12 15:14:21.441011 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2f484932-9193-4599-9977-7e1c83c33fff'] response: {'server_uuid': '93f69d1e-0068-4634-b7ad-70f7710d8470', 'name': 'network-vif-deleted', 'tag': '79a4c0f6-1eac-421e-b4ba-c704cb6cd3e6', 'status': 'completed', 'code': 200} May 12 15:14:21.457342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ccd327ed-478a-4293-b8b6-8d4a923093ef None None] Port 2b0f41b8-aaa6-4b9c-b597-703f558651d5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:14:21.471997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] Set router 9b2fa912-d414-4854-a39a-4ff1d3393c44 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:14:21.571395 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:21.705703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6bcdcd-2301-47d4-8f9d-f525d0e38fbc req-8003f27c-7ea7-4686-9310-cdcf25e4bcf6 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:21.706447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ae6bcdcd-2301-47d4-8f9d-f525d0e38fbc req-8003f27c-7ea7-4686-9310-cdcf25e4bcf6 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Synchronizing usage tracker for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:14:21.751972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ae6bcdcd-2301-47d4-8f9d-f525d0e38fbc req-8003f27c-7ea7-4686-9310-cdcf25e4bcf6 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Unset dirty status for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:14:21.753485 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae6bcdcd-2301-47d4-8f9d-f525d0e38fbc req-8003f27c-7ea7-4686-9310-cdcf25e4bcf6 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/ports?device_id=9b2b4b7d-231c-4e54-83f4-827d02cbcbb5 HTTP/1.1" status: 200 len: 950 time: 0.6998601 May 12 15:14:21.762503 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3ee98dd1-c552-4021-834b-3de63704002a req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:21.834859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e771a232-120c-446b-86d2-7951c6fd4fc3 req-33af81de-2e68-4b53-a9fd-4db0b9c2d881 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:21.838331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e771a232-120c-446b-86d2-7951c6fd4fc3 req-33af81de-2e68-4b53-a9fd-4db0b9c2d881 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 1125 time: 0.3411262 May 12 15:14:21.857311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Allocated IP 172.25.8.224 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/6a305637-db60-42b2-a986-b2b2950e083d) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:14:21.861828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'name': 'tempest-TaggedBootDevicesTest-712902579-router', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.186'}], 'enable_snat': True}, 'gw_port_id': '09ea88a5-8b36-412b-ae6c-f2a8e7beae7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:14:13Z', 'updated_at': '2022-05-12T15:14:19Z', 'revision_number': 4, 'project_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'gw_port': {'id': '09ea88a5-8b36-412b-ae6c-f2a8e7beae7f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:3e:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 998, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:15Z', 'updated_at': '2022-05-12T15:14:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2b0f41b8-aaa6-4b9c-b597-703f558651d5', 'name': '', 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'mac_address': 'fa:16:3e:1a:01:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'device_owner': 'network:router_interface', 'standard_attr_id': 999, 'fixed_ips': [{'subnet_id': 'cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:19Z', 'updated_at': '2022-05-12T15:14:20Z', 'revision_number': 2, 'project_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'subnets': [{'id': 'cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:21.867213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fae7ad8-e62f-4bab-96eb-0b46e672bbb7 None None] The sync data for ids ['9b2fa912-d414-4854-a39a-4ff1d3393c44'] in n-d-841483-1 is: [{'id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'name': 'tempest-TaggedBootDevicesTest-712902579-router', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.186'}], 'enable_snat': True}, 'gw_port_id': '09ea88a5-8b36-412b-ae6c-f2a8e7beae7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:14:13Z', 'updated_at': '2022-05-12T15:14:19Z', 'revision_number': 4, 'project_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'gw_port': {'id': '09ea88a5-8b36-412b-ae6c-f2a8e7beae7f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:3e:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 998, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:15Z', 'updated_at': '2022-05-12T15:14:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2b0f41b8-aaa6-4b9c-b597-703f558651d5', 'name': '', 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'mac_address': 'fa:16:3e:1a:01:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'device_owner': 'network:router_interface', 'standard_attr_id': 999, 'fixed_ips': [{'subnet_id': 'cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:19Z', 'updated_at': '2022-05-12T15:14:20Z', 'revision_number': 2, 'project_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'subnets': [{'id': 'cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:14:21.885503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-ae6bcdcd-2301-47d4-8f9d-f525d0e38fbc req-c3696e5b-2061-4c92-8b21-2d3d6ba6550c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Deleting port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:21.886354 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ae6bcdcd-2301-47d4-8f9d-f525d0e38fbc req-c3696e5b-2061-4c92-8b21-2d3d6ba6550c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:22.328131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ae6bcdcd-2301-47d4-8f9d-f525d0e38fbc req-c3696e5b-2061-4c92-8b21-2d3d6ba6550c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] For port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=83a7b910-a912-4e05-9d03-5d6b1f6b0edc,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:22.328912 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ae6bcdcd-2301-47d4-8f9d-f525d0e38fbc req-c3696e5b-2061-4c92-8b21-2d3d6ba6550c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:22.421117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e771a232-120c-446b-86d2-7951c6fd4fc3 req-f48e0a66-e6cf-4fec-a807-6b3d64b29eec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:22.422637 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e771a232-120c-446b-86d2-7951c6fd4fc3 req-f48e0a66-e6cf-4fec-a807-6b3d64b29eec service neutron] 10.222.0.84 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.5685446 May 12 15:14:22.432748 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3ee98dd1-c552-4021-834b-3de63704002a req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:22.560323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-ae6bcdcd-2301-47d4-8f9d-f525d0e38fbc req-c3696e5b-2061-4c92-8b21-2d3d6ba6550c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Calling delete_port for 83a7b910-a912-4e05-9d03-5d6b1f6b0edc owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:22.572737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2aacd053-a6fc-4b9c-a864-3492866aab49 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:22.654914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0608045f-7406-4f36-93c8-e77a70be84b2 req-d1e9394e-cb9e-474a-acf8-808afd8afda7 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:22.660800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '964db126-f48c-4257-8b18-8bd06d832b12', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '821acf60-4359-4f69-aa40-45a9cf272ac4'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:22.665682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0608045f-7406-4f36-93c8-e77a70be84b2 req-d1e9394e-cb9e-474a-acf8-808afd8afda7 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Synchronizing usage tracker for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:14:22.703644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3ee98dd1-c552-4021-834b-3de63704002a req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Network 079240cc-25ba-4ba4-a3b0-412d897b19bb is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:22.709002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74d00415-22e6-453f-b116-d5f4a7b69a33 req-f5f0f91c-de5a-443e-bc45-648b94c5cf41 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:22.710513 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-74d00415-22e6-453f-b116-d5f4a7b69a33 req-f5f0f91c-de5a-443e-bc45-648b94c5cf41 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "GET /v2.0/ports?device_id=000d5cf1-e430-46d6-a455-2550da7e4b71 HTTP/1.1" status: 200 len: 950 time: 0.4669845 May 12 15:14:22.719845 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e771a232-120c-446b-86d2-7951c6fd4fc3 req-836075be-8173-4980-ba2b-e622dcd2631f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e HTTP/1.1" status: 200 len: 217 time: 0.2587616 May 12 15:14:22.750858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2aacd053-a6fc-4b9c-a864-3492866aab49 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:22.751890 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:22.809734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-3ee98dd1-c552-4021-834b-3de63704002a req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:22.826708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0608045f-7406-4f36-93c8-e77a70be84b2 req-d1e9394e-cb9e-474a-acf8-808afd8afda7 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Unset dirty status for tenant:fa4eac6b8c464c45aa3c550e59a0d34b on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:14:22.835018 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0608045f-7406-4f36-93c8-e77a70be84b2 req-d1e9394e-cb9e-474a-acf8-808afd8afda7 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=9b2b4b7d-231c-4e54-83f4-827d02cbcbb5 HTTP/1.1" status: 200 len: 950 time: 0.8683007 May 12 15:14:22.836427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-74d00415-22e6-453f-b116-d5f4a7b69a33 req-40b0da76-3d2c-4b80-a77e-ae71a59f0144 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Deleting port 3ae73679-d198-440a-966c-619a9930fbcb {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:22.836828 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-74d00415-22e6-453f-b116-d5f4a7b69a33 req-40b0da76-3d2c-4b80-a77e-ae71a59f0144 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:22.856963 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:22.939040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-3ee98dd1-c552-4021-834b-3de63704002a req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:14:23.063800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Pushing event updated for resources: {'Port': ['ID=b4c1d2d6-213d-4562-8698-2dc7f8f15413,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:23.104151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:23.104325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:23.104801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:23.106289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:23.107095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:23.107621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:23.108117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:23.108608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:23.109097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:23.109609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:23.110115 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:23.110615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:23.117321 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ae6bcdcd-2301-47d4-8f9d-f525d0e38fbc req-c3696e5b-2061-4c92-8b21-2d3d6ba6550c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:23.127138 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0608045f-7406-4f36-93c8-e77a70be84b2 req-90dc1b61-9b2c-4635-8b96-5db81e5c9a26 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2908163 May 12 15:14:23.139207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:23.159101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee98dd1-c552-4021-834b-3de63704002a req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:23.159947 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3ee98dd1-c552-4021-834b-3de63704002a req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:23.179641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e771a232-120c-446b-86d2-7951c6fd4fc3 req-88ceb229-0697-46f9-8da3-63aed508700f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:23.181408 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e771a232-120c-446b-86d2-7951c6fd4fc3 req-88ceb229-0697-46f9-8da3-63aed508700f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.3615010 May 12 15:14:23.199541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3696e5b-2061-4c92-8b21-2d3d6ba6550c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event deleted for resources: {'Port': ['ID=83a7b910-a912-4e05-9d03-5d6b1f6b0edc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:23.203401 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3ae73679-d198-440a-966c-619a9930fbcb'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:23.203705 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-1451bb4c-9894-484b-900b-460dc154e180 service neutron] 10.222.0.84 "GET /v2.0/ports/c89ed514-64cd-4011-b01a-855ecf2c3a8e/bindings/n-h2-841483-1 HTTP/1.1" status: 200 len: 384 time: 0.3359425 May 12 15:14:23.357246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e771a232-120c-446b-86d2-7951c6fd4fc3 req-9c8347a8-73e8-4d83-924c-c2df2ad418fd service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1674373 May 12 15:14:23.361426 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-011fae11-b280-4316-9c0a-cdba86cc8000 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.0404017 May 12 15:14:23.421216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-11f5b0de-3cfb-4159-b416-c3cb09a3084a tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:14:23.422380 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-11f5b0de-3cfb-4159-b416-c3cb09a3084a tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0117481 May 12 15:14:23.429930 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:23.538891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae6bcdcd-2301-47d4-8f9d-f525d0e38fbc req-c3696e5b-2061-4c92-8b21-2d3d6ba6550c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] No DVR routers for this DVR port 83a7b910-a912-4e05-9d03-5d6b1f6b0edc on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:14:23.542012 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ae6bcdcd-2301-47d4-8f9d-f525d0e38fbc req-c3696e5b-2061-4c92-8b21-2d3d6ba6550c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:23.579946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9b2b4b7d-231c-4e54-83f4-827d02cbcbb5', 'name': 'network-vif-deleted', 'tag': '83a7b910-a912-4e05-9d03-5d6b1f6b0edc'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:23.592191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Request body: {'port': {'device_id': '6062b237-2dea-4593-98c5-e5bcf587f743', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:23.602799 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae6bcdcd-2301-47d4-8f9d-f525d0e38fbc req-c3696e5b-2061-4c92-8b21-2d3d6ba6550c tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "DELETE /v2.0/ports/83a7b910-a912-4e05-9d03-5d6b1f6b0edc HTTP/1.1" status: 204 len: 173 time: 1.8204336 May 12 15:14:23.851896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Pushing event updated for resources: {'Port': ['ID=6a305637-db60-42b2-a986-b2b2950e083d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:23.904550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:23.920080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:23.932952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:14:23.944531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-74d00415-22e6-453f-b116-d5f4a7b69a33 req-40b0da76-3d2c-4b80-a77e-ae71a59f0144 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] For port 3ae73679-d198-440a-966c-619a9930fbcb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3ae73679-d198-440a-966c-619a9930fbcb,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:23.954095 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-74d00415-22e6-453f-b116-d5f4a7b69a33 req-40b0da76-3d2c-4b80-a77e-ae71a59f0144 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:24.123454 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 83a7b910-a912-4e05-9d03-5d6b1f6b0edc no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:14:24.147973 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e771a232-120c-446b-86d2-7951c6fd4fc3 req-41b3215a-2981-4eaf-ba34-eca7150bedd6 service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7809653 May 12 15:14:24.172993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 83a7b910-a912-4e05-9d03-5d6b1f6b0edc {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:14:24.173336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 83a7b910-a912-4e05-9d03-5d6b1f6b0edc not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:14:24.176017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c89ed514-64cd-4011-b01a-855ecf2c3a8e no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:14:24.279099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-74d00415-22e6-453f-b116-d5f4a7b69a33 req-40b0da76-3d2c-4b80-a77e-ae71a59f0144 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Calling delete_port for 3ae73679-d198-440a-966c-619a9930fbcb owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:24.320600 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:24.371004 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:24.481951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6975c3fc-94fa-48ea-8e74-69d0c2b74219 service neutron] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:24.505812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6975c3fc-94fa-48ea-8e74-69d0c2b74219 service neutron] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:24.532213 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e771a232-120c-446b-86d2-7951c6fd4fc3 req-f8705542-0d29-45ef-baa7-97fe57c0d26e service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3732243 May 12 15:14:24.553910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:24.565769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6975c3fc-94fa-48ea-8e74-69d0c2b74219 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c89ed514-64cd-4011-b01a-855ecf2c3a8e {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:24.582393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6975c3fc-94fa-48ea-8e74-69d0c2b74219 service neutron] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:24.590206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ea17a6-fa9b-432e-b635-bca0dc032ef3 req-e4c741de-ae43-4084-80da-c3b26713d604 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:24.591005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-00ea17a6-fa9b-432e-b635-bca0dc032ef3 req-e4c741de-ae43-4084-80da-c3b26713d604 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Synchronizing usage tracker for tenant:aca50b48316f40a7a6ceb23c44dd4720 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:14:24.614313 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6975c3fc-94fa-48ea-8e74-69d0c2b74219 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:24.648953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:24.658256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:24.659685 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:24.677879 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:24.734488 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-00ea17a6-fa9b-432e-b635-bca0dc032ef3 req-e4c741de-ae43-4084-80da-c3b26713d604 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Unset dirty status for tenant:aca50b48316f40a7a6ceb23c44dd4720 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:14:24.741992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00ea17a6-fa9b-432e-b635-bca0dc032ef3 req-e4c741de-ae43-4084-80da-c3b26713d604 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 932 time: 1.3323364 May 12 15:14:24.819769 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:24.838209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6975c3fc-94fa-48ea-8e74-69d0c2b74219 service neutron] Transition to ACTIVE for port object c89ed514-64cd-4011-b01a-855ecf2c3a8e will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:24.847844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=09ea88a5-8b36-412b-ae6c-f2a8e7beae7f,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:24.848930 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6975c3fc-94fa-48ea-8e74-69d0c2b74219 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:24.854437 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:24.884355 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00ea17a6-fa9b-432e-b635-bca0dc032ef3 req-7b21967e-39d9-4fc0-b0ca-b9ff6b31a989 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1352935 May 12 15:14:24.997415 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-74d00415-22e6-453f-b116-d5f4a7b69a33 req-40b0da76-3d2c-4b80-a77e-ae71a59f0144 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:25.013848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=09ea88a5-8b36-412b-ae6c-f2a8e7beae7f,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:25.035349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:25.067143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6975c3fc-94fa-48ea-8e74-69d0c2b74219 service neutron] No DVR routers for this DVR port c89ed514-64cd-4011-b01a-855ecf2c3a8e on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:14:25.073130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6975c3fc-94fa-48ea-8e74-69d0c2b74219 service neutron] Pushing event updated for resources: {'Port': ['ID=c89ed514-64cd-4011-b01a-855ecf2c3a8e,revision_number=10']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:25.253957 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40b0da76-3d2c-4b80-a77e-ae71a59f0144 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event deleted for resources: {'Port': ['ID=3ae73679-d198-440a-966c-619a9930fbcb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:25.256178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-74d00415-22e6-453f-b116-d5f4a7b69a33 req-40b0da76-3d2c-4b80-a77e-ae71a59f0144 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] No DVR routers for this DVR port 3ae73679-d198-440a-966c-619a9930fbcb on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:14:25.261313 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-74d00415-22e6-453f-b116-d5f4a7b69a33 req-40b0da76-3d2c-4b80-a77e-ae71a59f0144 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:25.273686 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6975c3fc-94fa-48ea-8e74-69d0c2b74219 service neutron] 10.222.0.84 "PUT /v2.0/ports/c89ed514-64cd-4011-b01a-855ecf2c3a8e/bindings/n-h2-841483-1/activate HTTP/1.1" status: 200 len: 369 time: 1.8917871 May 12 15:14:25.278438 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-74d00415-22e6-453f-b116-d5f4a7b69a33 req-40b0da76-3d2c-4b80-a77e-ae71a59f0144 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.84 "DELETE /v2.0/ports/3ae73679-d198-440a-966c-619a9930fbcb HTTP/1.1" status: 204 len: 173 time: 2.5542283 May 12 15:14:25.800411 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Sync routers for ids ['9b2fa912-d414-4854-a39a-4ff1d3393c44'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:14:25.805904 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:25.811919 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Routers {'9b2fa912-d414-4854-a39a-4ff1d3393c44'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:14:25.812532 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:14:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9b2fa912-d414-4854-a39a-4ff1d3393c44'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:25.816735 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:25.873466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f1f1d3-fba0-404a-9fe4-1a1d86ec952a req-54ff034f-4e2a-4cd0-9dcd-c43dfc91cac6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:25.879215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f1f1d3-fba0-404a-9fe4-1a1d86ec952a req-54ff034f-4e2a-4cd0-9dcd-c43dfc91cac6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:25.885025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f1f1d3-fba0-404a-9fe4-1a1d86ec952a req-54ff034f-4e2a-4cd0-9dcd-c43dfc91cac6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:25.890848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f1f1d3-fba0-404a-9fe4-1a1d86ec952a req-54ff034f-4e2a-4cd0-9dcd-c43dfc91cac6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:25.897105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f1f1d3-fba0-404a-9fe4-1a1d86ec952a req-54ff034f-4e2a-4cd0-9dcd-c43dfc91cac6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:25.903466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f1f1d3-fba0-404a-9fe4-1a1d86ec952a req-54ff034f-4e2a-4cd0-9dcd-c43dfc91cac6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:25.909792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f1f1d3-fba0-404a-9fe4-1a1d86ec952a req-54ff034f-4e2a-4cd0-9dcd-c43dfc91cac6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:25.911939 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39f1f1d3-fba0-404a-9fe4-1a1d86ec952a req-54ff034f-4e2a-4cd0-9dcd-c43dfc91cac6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5430 time: 0.4060330 May 12 15:14:25.924138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-db5174fd-f572-4e8f-9687-ebb7b3c10075 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:25.925659 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-db5174fd-f572-4e8f-9687-ebb7b3c10075 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5&tenant_id=68c66ae0cd45476b87e2e79625b80f69&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1096 time: 0.4482992 May 12 15:14:26.012430 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Set router 9b2fa912-d414-4854-a39a-4ff1d3393c44 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:14:26.110465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3ae73679-d198-440a-966c-619a9930fbcb no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:14:26.139420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Pushing event updated for resources: {'Port': ['ID=6a305637-db60-42b2-a986-b2b2950e083d,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:26.142444 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:26.194684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:26.202317 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-e547d27f-51d1-4e55-93b9-f3b8c712132f tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 5.5252526 May 12 15:14:26.239095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 3ae73679-d198-440a-966c-619a9930fbcb {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:14:26.239421 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3ae73679-d198-440a-966c-619a9930fbcb not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:14:26.327123 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39f1f1d3-fba0-404a-9fe4-1a1d86ec952a req-0de861b3-a6be-4d15-abb5-d47184c0d67a tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.3606365 May 12 15:14:26.340218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b4c1d2d6-213d-4562-8698-2dc7f8f15413 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:26.367916 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:26.373110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-a81df4c2-829c-4e70-a339-279de1d17477 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Synchronizing usage tracker for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:14:26.396579 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'name': 'tempest-TaggedBootDevicesTest-712902579-router', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.186'}], 'enable_snat': True}, 'gw_port_id': '09ea88a5-8b36-412b-ae6c-f2a8e7beae7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:14:13Z', 'updated_at': '2022-05-12T15:14:19Z', 'revision_number': 4, 'project_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'gw_port': {'id': '09ea88a5-8b36-412b-ae6c-f2a8e7beae7f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:3e:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 998, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:15Z', 'updated_at': '2022-05-12T15:14:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2b0f41b8-aaa6-4b9c-b597-703f558651d5', 'name': '', 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'mac_address': 'fa:16:3e:1a:01:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'device_owner': 'network:router_interface', 'standard_attr_id': 999, 'fixed_ips': [{'subnet_id': 'cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:19Z', 'updated_at': '2022-05-12T15:14:20Z', 'revision_number': 2, 'project_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'subnets': [{'id': 'cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:26.400898 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Checking router: 9b2fa912-d414-4854-a39a-4ff1d3393c44 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:14:26.401409 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Updating router 9b2fa912-d414-4854-a39a-4ff1d3393c44 port 2b0f41b8-aaa6-4b9c-b597-703f558651d5 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:14:26.408004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Transition to ACTIVE for port object b4c1d2d6-213d-4562-8698-2dc7f8f15413 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:26.415958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6b38c47a-2d5b-41e2-80b5-581ca99f6476 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:26.418192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6b38c47a-2d5b-41e2-80b5-581ca99f6476 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5&tenant_id=68c66ae0cd45476b87e2e79625b80f69 HTTP/1.1" status: 200 len: 1096 time: 0.4529219 May 12 15:14:26.420015 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:26.486510 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:26.495381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-a81df4c2-829c-4e70-a339-279de1d17477 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Unset dirty status for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:14:26.496528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-a81df4c2-829c-4e70-a339-279de1d17477 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.224 HTTP/1.1" status: 200 len: 696 time: 0.2933235 May 12 15:14:26.535471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:26.660526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:26.661260 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:26.766806 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Pushing event updated for resources: {'Port': ['ID=b4c1d2d6-213d-4562-8698-2dc7f8f15413,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:26.801097 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:14:26.867914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e69b5c2-dbd0-40bb-9154-df0828ca89f0 req-6923f19f-46b8-401a-b224-5bd6b4bb6bb9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:26.868710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-7e69b5c2-dbd0-40bb-9154-df0828ca89f0 req-6923f19f-46b8-401a-b224-5bd6b4bb6bb9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Synchronizing usage tracker for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:14:26.895486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-7e69b5c2-dbd0-40bb-9154-df0828ca89f0 req-6923f19f-46b8-401a-b224-5bd6b4bb6bb9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Unset dirty status for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:14:26.896981 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7e69b5c2-dbd0-40bb-9154-df0828ca89f0 req-6923f19f-46b8-401a-b224-5bd6b4bb6bb9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.76 "GET /v2.0/ports?device_id=38791bcd-dc8b-4e32-bf93-723fbcfc3199 HTTP/1.1" status: 200 len: 945 time: 0.1822333 May 12 15:14:26.949417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d99836c3-b238-4442-b994-99d17c8f99ee req-0774ddd0-8c37-4306-af83-f42e77f303e8 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:26.950894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d99836c3-b238-4442-b994-99d17c8f99ee req-0774ddd0-8c37-4306-af83-f42e77f303e8 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 945 time: 0.4281430 May 12 15:14:26.951128 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:26.953023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-69346e47-2b2b-4729-b2bb-ae5f3169e83c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:26.954387 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-69346e47-2b2b-4729-b2bb-ae5f3169e83c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 1096 time: 0.4957297 May 12 15:14:26.967652 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Transition to ACTIVE for port object 2b0f41b8-aaa6-4b9c-b597-703f558651d5 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:26.968198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-8429735d-75a9-46a5-9621-f2f646f4d873 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:26.981871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a9f07fa-e1b2-46db-9463-d46ce653f594 req-8429735d-75a9-46a5-9621-f2f646f4d873 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.4126410 May 12 15:14:26.982732 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:27.035560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-7e69b5c2-dbd0-40bb-9154-df0828ca89f0 req-608d034e-9867-4de3-8662-a0f34fddade0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Deleting port 86786c97-61f2-4d39-8699-212c2f96f6f3 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:27.036823 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7e69b5c2-dbd0-40bb-9154-df0828ca89f0 req-608d034e-9867-4de3-8662-a0f34fddade0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:27.117377 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa7097ea-4344-4ffc-8b26-d1d05f1d4879 None None] Pushing event updated for resources: {'Port': ['ID=2b0f41b8-aaa6-4b9c-b597-703f558651d5,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:27.289192 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Attempting to bind port 2b0f41b8-aaa6-4b9c-b597-703f558651d5 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:14:27.290175 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Attempting to bind port 2b0f41b8-aaa6-4b9c-b597-703f558651d5 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '9a5ce622-a3ea-4c31-b698-fca2808b112c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:14:27.290731 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Attempting to bind port 2b0f41b8-aaa6-4b9c-b597-703f558651d5 on network 55fd03f8-edf5-46b5-a343-d05b647d0c02 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:27.300667 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 14, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:14:27.301441 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Checking segment: {'id': '9a5ce622-a3ea-4c31-b698-fca2808b112c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:27.302173 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:27.303598 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Bound using segment: {'id': '9a5ce622-a3ea-4c31-b698-fca2808b112c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:14:27.304273 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Bound port: 2b0f41b8-aaa6-4b9c-b597-703f558651d5, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9a5ce622-a3ea-4c31-b698-fca2808b112c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:14:27.305050 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:27.402281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Attempting to bind port b4c1d2d6-213d-4562-8698-2dc7f8f15413 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:14:27.402606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Attempting to bind port b4c1d2d6-213d-4562-8698-2dc7f8f15413 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '68221a3b-1121-4349-a5a1-801f502e908b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:14:27.402928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Attempting to bind port b4c1d2d6-213d-4562-8698-2dc7f8f15413 on network 079240cc-25ba-4ba4-a3b0-412d897b19bb {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:27.449687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Port b4c1d2d6-213d-4562-8698-2dc7f8f15413 on network 079240cc-25ba-4ba4-a3b0-412d897b19bb not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:14:27.450095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Attempting to bind port b4c1d2d6-213d-4562-8698-2dc7f8f15413 on network 079240cc-25ba-4ba4-a3b0-412d897b19bb {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:27.461036 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d99836c3-b238-4442-b994-99d17c8f99ee req-b6be0618-8a76-4dce-958b-5fe81986665b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4748051 May 12 15:14:27.466688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-7e69b5c2-dbd0-40bb-9154-df0828ca89f0 req-608d034e-9867-4de3-8662-a0f34fddade0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] For port 86786c97-61f2-4d39-8699-212c2f96f6f3, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=86786c97-61f2-4d39-8699-212c2f96f6f3,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:27.467236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7e69b5c2-dbd0-40bb-9154-df0828ca89f0 req-608d034e-9867-4de3-8662-a0f34fddade0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:27.468767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 14, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:14:27.469100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Checking segment: {'id': '68221a3b-1121-4349-a5a1-801f502e908b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:27.469503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Bound using segment: {'id': '68221a3b-1121-4349-a5a1-801f502e908b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:14:27.469938 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Bound port: b4c1d2d6-213d-4562-8698-2dc7f8f15413, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '68221a3b-1121-4349-a5a1-801f502e908b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:14:27.470273 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:27.476566 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] For port 2b0f41b8-aaa6-4b9c-b597-703f558651d5, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:27.484896 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] For port 2b0f41b8-aaa6-4b9c-b597-703f558651d5, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2b0f41b8-aaa6-4b9c-b597-703f558651d5,segment=NetworkSegment(9a5ce622-a3ea-4c31-b698-fca2808b112c),segment_id=9a5ce622-a3ea-4c31-b698-fca2808b112c)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:14:27.498846 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:27.583036 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa7097ea-4344-4ffc-8b26-d1d05f1d4879 None None] Pushing event updated for resources: {'Port': ['ID=2b0f41b8-aaa6-4b9c-b597-703f558651d5,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:27.611935 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4e2e375d-a5da-470e-9953-abb72bf87385'] response: {'server_uuid': '964db126-f48c-4257-8b18-8bd06d832b12', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '821acf60-4359-4f69-aa40-45a9cf272ac4', 'code': 200} May 12 15:14:27.616885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-dd7abe94-b0a8-47f8-8571-d490b9540a52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:27.621904 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-dd7abe94-b0a8-47f8-8571-d490b9540a52 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.6390257 May 12 15:14:27.627451 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Routers {'9b2fa912-d414-4854-a39a-4ff1d3393c44'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:14:27.628124 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:14:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9b2fa912-d414-4854-a39a-4ff1d3393c44'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:27.629697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] For port b4c1d2d6-213d-4562-8698-2dc7f8f15413, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:27.640613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b645718e-6e1d-4289-b436-26fb99259f6c req-7e43e428-5dd6-4e2f-a34f-29da8ca03328 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:27.659091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b645718e-6e1d-4289-b436-26fb99259f6c req-7e43e428-5dd6-4e2f-a34f-29da8ca03328 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:27.669127 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b645718e-6e1d-4289-b436-26fb99259f6c req-7e43e428-5dd6-4e2f-a34f-29da8ca03328 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=964db126-f48c-4257-8b18-8bd06d832b12 HTTP/1.1" status: 200 len: 1683 time: 0.4913535 May 12 15:14:27.739806 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fcd10db2-5af0-400a-89cf-b672989acee4'] response: {'server_uuid': '9b2b4b7d-231c-4e54-83f4-827d02cbcbb5', 'name': 'network-vif-deleted', 'tag': '83a7b910-a912-4e05-9d03-5d6b1f6b0edc', 'status': 'completed', 'code': 200} May 12 15:14:27.793309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] For port b4c1d2d6-213d-4562-8698-2dc7f8f15413, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b4c1d2d6-213d-4562-8698-2dc7f8f15413,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:14:27.831088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-7e69b5c2-dbd0-40bb-9154-df0828ca89f0 req-608d034e-9867-4de3-8662-a0f34fddade0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Calling delete_port for 86786c97-61f2-4d39-8699-212c2f96f6f3 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:27.896544 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b645718e-6e1d-4289-b436-26fb99259f6c req-fd575bd2-abcf-4903-8b9d-e2ae933e6c5a tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2276175 May 12 15:14:27.906061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:27.910359 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] Set router 9b2fa912-d414-4854-a39a-4ff1d3393c44 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:14:27.981945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3be287be-c730-4609-9246-68a2fd9d6a16 req-6ee25937-5de4-4112-9816-7e10f6c46c71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:27.982519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3be287be-c730-4609-9246-68a2fd9d6a16 req-6ee25937-5de4-4112-9816-7e10f6c46c71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:27.983941 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3be287be-c730-4609-9246-68a2fd9d6a16 req-6ee25937-5de4-4112-9816-7e10f6c46c71 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=964db126-f48c-4257-8b18-8bd06d832b12 HTTP/1.1" status: 200 len: 1985 time: 0.2424293 May 12 15:14:28.044152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-9e343430-61d4-4752-ae53-1308ecb514a1 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e HTTP/1.1" status: 200 len: 217 time: 0.3609529 May 12 15:14:28.053593 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:28.054272 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:28.057311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] 10.222.0.76 "PUT /v2.0/ports/b4c1d2d6-213d-4562-8698-2dc7f8f15413 HTTP/1.1" status: 200 len: 1092 time: 4.6194885 May 12 15:14:28.074457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6062b237-2dea-4593-98c5-e5bcf587f743', 'tag': 'b4c1d2d6-213d-4562-8698-2dc7f8f15413'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:28.225837 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3be287be-c730-4609-9246-68a2fd9d6a16 req-1fbb64db-679a-4412-87fe-8f86442e9aa4 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505571 May 12 15:14:28.238421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-0801596b-5f85-4213-b4bf-148a22ed2580 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:28.239556 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-0801596b-5f85-4213-b4bf-148a22ed2580 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.1287673 May 12 15:14:28.248468 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7e69b5c2-dbd0-40bb-9154-df0828ca89f0 req-608d034e-9867-4de3-8662-a0f34fddade0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:28.260276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['86786c97-61f2-4d39-8699-212c2f96f6f3'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:28.307068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-608d034e-9867-4de3-8662-a0f34fddade0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event deleted for resources: {'Port': ['ID=86786c97-61f2-4d39-8699-212c2f96f6f3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:28.351728 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:28.435253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-7e69b5c2-dbd0-40bb-9154-df0828ca89f0 req-608d034e-9867-4de3-8662-a0f34fddade0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] No DVR routers for this DVR port 86786c97-61f2-4d39-8699-212c2f96f6f3 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:14:28.441788 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7e69b5c2-dbd0-40bb-9154-df0828ca89f0 req-608d034e-9867-4de3-8662-a0f34fddade0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:28.478146 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7e69b5c2-dbd0-40bb-9154-df0828ca89f0 req-608d034e-9867-4de3-8662-a0f34fddade0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.76 "DELETE /v2.0/ports/86786c97-61f2-4d39-8699-212c2f96f6f3 HTTP/1.1" status: 204 len: 173 time: 1.5735824 May 12 15:14:28.494310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdd098ca-3764-4374-82b6-2ad1dd34ca04 req-a913bcf6-7801-47d3-92f8-02d3bdbf093e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=38791bcd-dc8b-4e32-bf93-723fbcfc3199 HTTP/1.1" status: 200 len: 210 time: 0.2319679 May 12 15:14:28.584018 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-df89f82e-ffd1-445d-a7dd-ea12046facb5 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2940936 May 12 15:14:28.600508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2b0f41b8-aaa6-4b9c-b597-703f558651d5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:28.657545 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'name': 'tempest-TaggedBootDevicesTest-712902579-router', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.186'}], 'enable_snat': True}, 'gw_port_id': '09ea88a5-8b36-412b-ae6c-f2a8e7beae7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:14:13Z', 'updated_at': '2022-05-12T15:14:19Z', 'revision_number': 4, 'project_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'gw_port': {'id': '09ea88a5-8b36-412b-ae6c-f2a8e7beae7f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:3e:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 998, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:15Z', 'updated_at': '2022-05-12T15:14:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2b0f41b8-aaa6-4b9c-b597-703f558651d5', 'name': '', 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'mac_address': 'fa:16:3e:1a:01:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'device_owner': 'network:router_interface', 'standard_attr_id': 999, 'fixed_ips': [{'subnet_id': 'cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:19Z', 'updated_at': '2022-05-12T15:14:27Z', 'revision_number': 4, 'project_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'subnets': [{'id': 'cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:28.669369 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bff5f2e-b515-4c7a-861e-a787e2fa7bf4 None None] The sync data for ids ['9b2fa912-d414-4854-a39a-4ff1d3393c44'] in n-d-841483-1 is: [{'id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'name': 'tempest-TaggedBootDevicesTest-712902579-router', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.186'}], 'enable_snat': True}, 'gw_port_id': '09ea88a5-8b36-412b-ae6c-f2a8e7beae7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:14:13Z', 'updated_at': '2022-05-12T15:14:19Z', 'revision_number': 4, 'project_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'gw_port': {'id': '09ea88a5-8b36-412b-ae6c-f2a8e7beae7f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:3e:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 998, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:15Z', 'updated_at': '2022-05-12T15:14:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2b0f41b8-aaa6-4b9c-b597-703f558651d5', 'name': '', 'network_id': '55fd03f8-edf5-46b5-a343-d05b647d0c02', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'mac_address': 'fa:16:3e:1a:01:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'device_owner': 'network:router_interface', 'standard_attr_id': 999, 'fixed_ips': [{'subnet_id': 'cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:19Z', 'updated_at': '2022-05-12T15:14:27Z', 'revision_number': 4, 'project_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'subnets': [{'id': 'cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:14:28.670571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69f251b4-ff8b-4cbe-9e27-32bea98b5efd service neutron] Pushing event updated for resources: {'Port': ['ID=b4c1d2d6-213d-4562-8698-2dc7f8f15413,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:28.774121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 2b0f41b8-aaa6-4b9c-b597-703f558651d5 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:28.782546 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2b0f41b8-aaa6-4b9c-b597-703f558651d5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:28.782910 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:28.864482 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee98dd1-c552-4021-834b-3de63704002a req-8bbe60a7-40dd-43ca-835c-d01deb3ef1f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:28.866024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-8bbe60a7-40dd-43ca-835c-d01deb3ef1f2 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=aca50b48316f40a7a6ceb23c44dd4720&device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 1095 time: 0.7540867 May 12 15:14:28.881696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd481358-e318-45d3-9e3f-8084297e4c20 req-bf77c2db-c1cb-4ec8-98c0-174b2bf6753d tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:28.885942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd481358-e318-45d3-9e3f-8084297e4c20 req-bf77c2db-c1cb-4ec8-98c0-174b2bf6753d tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 944 time: 0.6376565 May 12 15:14:28.930785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-6b3869db-b741-4b18-a212-d7d2e73102d5 service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3186467 May 12 15:14:28.969529 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:28.999568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 2b0f41b8-aaa6-4b9c-b597-703f558651d5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2b0f41b8-aaa6-4b9c-b597-703f558651d5,segment=NetworkSegment(9a5ce622-a3ea-4c31-b698-fca2808b112c),segment_id=9a5ce622-a3ea-4c31-b698-fca2808b112c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:29.006677 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:29.013009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-4ad328df-5c21-4679-a5b6-2613d790f7da service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b4c1d2d6-213d-4562-8698-2dc7f8f15413 HTTP/1.1" status: 200 len: 217 time: 0.1243846 May 12 15:14:29.119089 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=2b0f41b8-aaa6-4b9c-b597-703f558651d5,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:29.174995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-6fb463cb-7d7d-4dae-8b72-771cd7466728 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:29.177438 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-6fb463cb-7d7d-4dae-8b72-771cd7466728 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/ports?device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.4992712 May 12 15:14:29.334642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd481358-e318-45d3-9e3f-8084297e4c20 req-acbbaabb-de60-4a3f-903f-221071bde5dc tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4028566 May 12 15:14:29.350497 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-7ac5ea43-da4b-4569-a288-1e0beb0efcb1 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.224 HTTP/1.1" status: 200 len: 696 time: 0.1594009 May 12 15:14:29.372944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-91ff2f71-78cd-463e-b822-e85b278c652e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Request body: {'floatingip': {'port_id': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e', 'fixed_ip_address': '172.20.0.5'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:29.428425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee98dd1-c552-4021-834b-3de63704002a req-80e9874c-c204-4ca6-9fb4-513ea0273a58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:29.430101 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-80e9874c-c204-4ca6-9fb4-513ea0273a58 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=b6cc6b5a-d56a-4336-afb7-99232d9672dc HTTP/1.1" status: 200 len: 855 time: 0.3661141 May 12 15:14:29.495943 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-91ff2f71-78cd-463e-b822-e85b278c652e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:29.741945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '000d5cf1-e430-46d6-a455-2550da7e4b71', 'name': 'network-vif-deleted', 'tag': '3ae73679-d198-440a-966c-619a9930fbcb'}, {'server_uuid': '38791bcd-dc8b-4e32-bf93-723fbcfc3199', 'name': 'network-vif-deleted', 'tag': '86786c97-61f2-4d39-8699-212c2f96f6f3'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:29.852826 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-bb93ef05-6674-4d9e-803b-f87bfedb8d53 service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8381369 May 12 15:14:29.886219 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-a93ebccb-3323-44ea-8bec-fb68091f0c9b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=079240cc-25ba-4ba4-a3b0-412d897b19bb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.4415798 May 12 15:14:30.244935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f37a406-fe6c-43b8-a6ad-df3a8ea2dbc4 req-22281f9f-83a9-4077-b959-5b40083b84a2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:30.252108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f37a406-fe6c-43b8-a6ad-df3a8ea2dbc4 req-22281f9f-83a9-4077-b959-5b40083b84a2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:30.257915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f37a406-fe6c-43b8-a6ad-df3a8ea2dbc4 req-22281f9f-83a9-4077-b959-5b40083b84a2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:30.264390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f37a406-fe6c-43b8-a6ad-df3a8ea2dbc4 req-22281f9f-83a9-4077-b959-5b40083b84a2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:30.270193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f37a406-fe6c-43b8-a6ad-df3a8ea2dbc4 req-22281f9f-83a9-4077-b959-5b40083b84a2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:30.276015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f37a406-fe6c-43b8-a6ad-df3a8ea2dbc4 req-22281f9f-83a9-4077-b959-5b40083b84a2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:30.282628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f37a406-fe6c-43b8-a6ad-df3a8ea2dbc4 req-22281f9f-83a9-4077-b959-5b40083b84a2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:30.284547 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f37a406-fe6c-43b8-a6ad-df3a8ea2dbc4 req-22281f9f-83a9-4077-b959-5b40083b84a2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5430 time: 0.7971516 May 12 15:14:30.322806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-ced19343-e2ff-442b-b012-b853e751c946 service neutron] 10.222.0.76 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4270222 May 12 15:14:30.490631 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2b0f41b8-aaa6-4b9c-b597-703f558651d5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:30.542025 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f37a406-fe6c-43b8-a6ad-df3a8ea2dbc4 req-4cd15aba-3caa-49f1-b2f9-f35339fe405f tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2414618 May 12 15:14:30.564917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2b0f41b8-aaa6-4b9c-b597-703f558651d5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:30.565333 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:30.689147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-16c04f2c-a1f2-4986-833b-116877a6aaca tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:30.690770 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-16c04f2c-a1f2-4986-833b-116877a6aaca tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5&tenant_id=68c66ae0cd45476b87e2e79625b80f69&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 1096 time: 0.5942390 May 12 15:14:30.741049 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7b856dc3-de87-4fd5-8efe-1f730da587fd'] response: {'name': 'network-changed', 'server_uuid': '6062b237-2dea-4593-98c5-e5bcf587f743', 'tag': 'b4c1d2d6-213d-4562-8698-2dc7f8f15413', 'status': 'completed', 'code': 200} May 12 15:14:30.751243 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee98dd1-c552-4021-834b-3de63704002a req-cb2a2b1b-475f-4ec7-bf89-5920e38d931a service neutron] 10.222.0.76 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4200993 May 12 15:14:30.877695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 86786c97-61f2-4d39-8699-212c2f96f6f3 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:14:30.912363 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 86786c97-61f2-4d39-8699-212c2f96f6f3 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:14:30.912694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 86786c97-61f2-4d39-8699-212c2f96f6f3 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:14:30.989318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-26b8ac6d-3747-4d3d-b4b9-654197cdcdef service neutron] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:31.066230 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-26b8ac6d-3747-4d3d-b4b9-654197cdcdef service neutron] Notify callbacks [] for binding, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:31.067234 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e9b53f-0bcc-49f4-906b-563e85a6a36d req-26b8ac6d-3747-4d3d-b4b9-654197cdcdef service neutron] 10.222.0.76 "DELETE /v2.0/ports/c89ed514-64cd-4011-b01a-855ecf2c3a8e/bindings/n-h1-841483-1 HTTP/1.1" status: 204 len: 173 time: 0.3649745 May 12 15:14:31.115278 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-91ff2f71-78cd-463e-b822-e85b278c652e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:31.117640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec96a830-6a59-4698-a2cf-236629d0a07e req-94946e80-92b1-4729-8660-ffe745508f42 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:31.119091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec96a830-6a59-4698-a2cf-236629d0a07e req-94946e80-92b1-4729-8660-ffe745508f42 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=aca50b48316f40a7a6ceb23c44dd4720&device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 1095 time: 0.3033791 May 12 15:14:31.129478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e001202d-70e1-496b-bd94-95a0b2d399cd req-29faaebe-7f1c-4181-800a-077591ca4879 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:31.130814 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e001202d-70e1-496b-bd94-95a0b2d399cd req-29faaebe-7f1c-4181-800a-077591ca4879 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 945 time: 0.2763033 May 12 15:14:31.131496 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-91ff2f71-78cd-463e-b822-e85b278c652e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:31.522965 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e001202d-70e1-496b-bd94-95a0b2d399cd req-e1d8ef90-8e88-4a65-8437-fe2d28124711 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3415155 May 12 15:14:31.598532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec96a830-6a59-4698-a2cf-236629d0a07e req-f85a916a-c4b1-4bb3-b854-454cbc7332ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:31.599970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec96a830-6a59-4698-a2cf-236629d0a07e req-f85a916a-c4b1-4bb3-b854-454cbc7332ab service neutron] 10.222.0.76 "GET /v2.0/networks?id=079240cc-25ba-4ba4-a3b0-412d897b19bb HTTP/1.1" status: 200 len: 916 time: 0.4175024 May 12 15:14:31.602697 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-91ff2f71-78cd-463e-b822-e85b278c652e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Floating IP 03f3fc43-1c40-4332-9857-d7ed5e3953cd associated. External IP: 172.25.8.224, port: c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e. May 12 15:14:31.780602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec96a830-6a59-4698-a2cf-236629d0a07e req-638595bf-fd82-4272-80e2-9a7a34d4f693 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b4c1d2d6-213d-4562-8698-2dc7f8f15413 HTTP/1.1" status: 200 len: 217 time: 0.1230159 May 12 15:14:31.946216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec96a830-6a59-4698-a2cf-236629d0a07e req-9e81be41-51e8-4c10-9c70-65fca42c68f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:31.947653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec96a830-6a59-4698-a2cf-236629d0a07e req-9e81be41-51e8-4c10-9c70-65fca42c68f4 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=b6cc6b5a-d56a-4336-afb7-99232d9672dc HTTP/1.1" status: 200 len: 855 time: 0.1570642 May 12 15:14:32.013249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec96a830-6a59-4698-a2cf-236629d0a07e req-7b31df74-aba2-45b5-b846-e59b92dad3c1 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=079240cc-25ba-4ba4-a3b0-412d897b19bb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0528769 May 12 15:14:32.026105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1598ddef-5166-489d-9ac3-c6fbfae059c4 req-83d027ec-e43f-457d-b108-b225590ad7e0 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:32.033323 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1598ddef-5166-489d-9ac3-c6fbfae059c4 req-83d027ec-e43f-457d-b108-b225590ad7e0 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:32.035005 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1598ddef-5166-489d-9ac3-c6fbfae059c4 req-83d027ec-e43f-457d-b108-b225590ad7e0 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=964db126-f48c-4257-8b18-8bd06d832b12 HTTP/1.1" status: 200 len: 1683 time: 0.3787293 May 12 15:14:32.068042 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:32.126723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 39390bec-fdd9-4910-a8d2-6718da722725 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:14:32.310610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 39390bec-fdd9-4910-a8d2-6718da722725, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=39390bec-fdd9-4910-a8d2-6718da722725,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:32.330638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '39390bec-fdd9-4910-a8d2-6718da722725', 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2', 'port_id': '39390bec-fdd9-4910-a8d2-6718da722725', 'mac_address': 'fa:16:3e:6d:8f:54', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 581, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a98bb094-ea48-4784-b33c-d20b0aad5132', 'ip_address': '10.2.2.200'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:14:32.350667 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1598ddef-5166-489d-9ac3-c6fbfae059c4 req-1e1ba63b-c477-4cbb-b944-22d5499e6455 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2889655 May 12 15:14:32.387288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec96a830-6a59-4698-a2cf-236629d0a07e req-06e0892b-06a1-4f9c-97f9-edd0142b0c21 service neutron] 10.222.0.76 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3512390 May 12 15:14:32.397148 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:32.415618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-91ff2f71-78cd-463e-b822-e85b278c652e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:14:32.417343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 39390bec-fdd9-4910-a8d2-6718da722725 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:32.436664 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 39390bec-fdd9-4910-a8d2-6718da722725, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=39390bec-fdd9-4910-a8d2-6718da722725,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:32.444368 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:32.445273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 04429346-9f7d-4f32-8c65-290ee17fda8a details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:14:32.540403 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4a9ea07d-9fab-427c-80b0-16925fda5ecc'] response: {'server_uuid': '000d5cf1-e430-46d6-a455-2550da7e4b71', 'name': 'network-vif-deleted', 'tag': '3ae73679-d198-440a-966c-619a9930fbcb', 'status': 'completed', 'code': 200} May 12 15:14:32.541014 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4a9ea07d-9fab-427c-80b0-16925fda5ecc'] response: {'server_uuid': '38791bcd-dc8b-4e32-bf93-723fbcfc3199', 'name': 'network-vif-deleted', 'tag': '86786c97-61f2-4d39-8699-212c2f96f6f3', 'status': 'completed', 'code': 200} May 12 15:14:32.671430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=39390bec-fdd9-4910-a8d2-6718da722725,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:32.693346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 04429346-9f7d-4f32-8c65-290ee17fda8a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=04429346-9f7d-4f32-8c65-290ee17fda8a,segment=NetworkSegment(a64e84dc-d91c-44e1-ab35-6c9b54a1b65b),segment_id=a64e84dc-d91c-44e1-ab35-6c9b54a1b65b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:32.711262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '04429346-9f7d-4f32-8c65-290ee17fda8a', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'port_id': '04429346-9f7d-4f32-8c65-290ee17fda8a', 'mac_address': 'fa:16:3e:87:09:8a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 584, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:14:32.778007 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:32.798032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 04429346-9f7d-4f32-8c65-290ee17fda8a {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:32.816067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 04429346-9f7d-4f32-8c65-290ee17fda8a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=04429346-9f7d-4f32-8c65-290ee17fda8a,segment=NetworkSegment(a64e84dc-d91c-44e1-ab35-6c9b54a1b65b),segment_id=a64e84dc-d91c-44e1-ab35-6c9b54a1b65b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:32.821610 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:32.821786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a2eb37f9-aba2-47d2-9756-11109b082c05 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:14:32.882387 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b4c1d2d6-213d-4562-8698-2dc7f8f15413 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:14:32.885543 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec96a830-6a59-4698-a2cf-236629d0a07e req-a36989c6-fb75-47bf-b257-178e48d73e21 service neutron] 10.222.0.76 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4915981 May 12 15:14:32.901039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-91ff2f71-78cd-463e-b822-e85b278c652e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:14:32.906538 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-91ff2f71-78cd-463e-b822-e85b278c652e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:32.915211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=04429346-9f7d-4f32-8c65-290ee17fda8a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:32.923090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a2eb37f9-aba2-47d2-9756-11109b082c05, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a2eb37f9-aba2-47d2-9756-11109b082c05,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:32.948518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f383c45-3411-40a9-bc08-2644c7fa5c28 None None] Sync routers for ids ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:14:32.982534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c76d24a-4bbe-4f01-aae8-b6efbefd692d req-89c19b6f-d572-4c15-b087-1295f268f184 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:32.984063 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c76d24a-4bbe-4f01-aae8-b6efbefd692d req-89c19b6f-d572-4c15-b087-1295f268f184 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 944 time: 0.3170135 May 12 15:14:33.000104 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-91ff2f71-78cd-463e-b822-e85b278c652e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "PUT /v2.0/floatingips/03f3fc43-1c40-4332-9857-d7ed5e3953cd HTTP/1.1" status: 200 len: 996 time: 3.6329322 May 12 15:14:33.003799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'tag': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:33.016762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'a2eb37f9-aba2-47d2-9756-11109b082c05', 'network_id': '187794df-e6cb-4ee3-8b40-6b546c229bd2', 'port_id': 'a2eb37f9-aba2-47d2-9756-11109b082c05', 'mac_address': 'fa:16:3e:30:33:59', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 581, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a98bb094-ea48-4784-b33c-d20b0aad5132', 'ip_address': '10.2.2.100'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:14:33.059248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f383c45-3411-40a9-bc08-2644c7fa5c28 None None] Routers {'86f12517-ac09-4f4e-b30f-f7f1a1aa3190'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:14:33.060063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1f383c45-3411-40a9-bc08-2644c7fa5c28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:14:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:33.101882 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c76d24a-4bbe-4f01-aae8-b6efbefd692d req-16b28e61-ef60-4d79-8482-fdab0c3bf5d2 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1006246 May 12 15:14:33.135948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-c6ed7e87-4112-4d9d-a79c-adc2012797f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:33.142796 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-c6ed7e87-4112-4d9d-a79c-adc2012797f0 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=a687923521d64fba8b0ceae3dbf4d7d3&device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 1096 time: 0.1302667 May 12 15:14:33.200311 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:33.309365 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-8a08c420-89d6-4c94-9a92-eac4bc308efd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:33.317641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-8a08c420-89d6-4c94-9a92-eac4bc308efd service neutron] 10.222.0.82 "GET /v2.0/networks?id=13bc975a-b248-4de3-b27d-6d14b7951c4b HTTP/1.1" status: 200 len: 930 time: 0.1721053 May 12 15:14:33.378180 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a2eb37f9-aba2-47d2-9756-11109b082c05 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:33.388367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b4c1d2d6-213d-4562-8698-2dc7f8f15413, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b4c1d2d6-213d-4562-8698-2dc7f8f15413,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:33.420701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'b4c1d2d6-213d-4562-8698-2dc7f8f15413', 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb', 'port_id': 'b4c1d2d6-213d-4562-8698-2dc7f8f15413', 'mac_address': 'fa:16:3e:ca:da:24', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 573, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b6cc6b5a-d56a-4336-afb7-99232d9672dc', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:14:33.426085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a2eb37f9-aba2-47d2-9756-11109b082c05, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a2eb37f9-aba2-47d2-9756-11109b082c05,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:33.436769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-1f383c45-3411-40a9-bc08-2644c7fa5c28 None None] Set router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:14:33.494830 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-1e3a13f6-7b8c-4a7c-a24f-236a2c21b960 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e HTTP/1.1" status: 200 len: 999 time: 0.1237943 May 12 15:14:33.533584 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:33.534219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device be802a6d-cca9-42fd-bdc5-6c9f78035217 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:14:33.565847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a825a0c-acee-4065-be62-1afe5c497a86 req-11c08473-1889-4a1e-ae79-667c0c7715cd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:33.571863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a825a0c-acee-4065-be62-1afe5c497a86 req-11c08473-1889-4a1e-ae79-667c0c7715cd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:33.578125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a825a0c-acee-4065-be62-1afe5c497a86 req-11c08473-1889-4a1e-ae79-667c0c7715cd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:33.583928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a825a0c-acee-4065-be62-1afe5c497a86 req-11c08473-1889-4a1e-ae79-667c0c7715cd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:33.590164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a825a0c-acee-4065-be62-1afe5c497a86 req-11c08473-1889-4a1e-ae79-667c0c7715cd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:33.596071 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a825a0c-acee-4065-be62-1afe5c497a86 req-11c08473-1889-4a1e-ae79-667c0c7715cd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:33.601950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a825a0c-acee-4065-be62-1afe5c497a86 req-11c08473-1889-4a1e-ae79-667c0c7715cd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:33.603882 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a825a0c-acee-4065-be62-1afe5c497a86 req-11c08473-1889-4a1e-ae79-667c0c7715cd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5432 time: 0.2850482 May 12 15:14:33.636396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-bbcc2ab5-fddc-49f6-adf2-594887053b5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:33.638001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-bbcc2ab5-fddc-49f6-adf2-594887053b5d service neutron] 10.222.0.82 "GET /v2.0/subnets?id=9a114164-5df9-48f9-8806-96a06aeff952 HTTP/1.1" status: 200 len: 868 time: 0.1365674 May 12 15:14:33.713844 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a825a0c-acee-4065-be62-1afe5c497a86 req-ba51b383-214f-48bc-be07-d45272e8d635 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0950720 May 12 15:14:33.733619 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:33.746350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-b14b224a-7c36-42ad-92ac-f436290368d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:33.749228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-b14b224a-7c36-42ad-92ac-f436290368d5 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=13bc975a-b248-4de3-b27d-6d14b7951c4b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1036708 May 12 15:14:33.749862 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:14:33.844792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a2eb37f9-aba2-47d2-9756-11109b082c05,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:33.859672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b4c1d2d6-213d-4562-8698-2dc7f8f15413 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:33.926239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b4c1d2d6-213d-4562-8698-2dc7f8f15413, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b4c1d2d6-213d-4562-8698-2dc7f8f15413,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:33.957738 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-a5b167cf-1c4b-4368-aeb0-b3b2441515b8 service neutron] 10.222.0.82 "GET /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1935902 May 12 15:14:33.989603 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5c90f4e8-e2e5-4bbc-803f-29409af153c6'] response: {'name': 'network-changed', 'server_uuid': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'tag': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e', 'status': 'completed', 'code': 200} May 12 15:14:34.196748 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:34.255827 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28d96e8a-8b3f-430f-a65a-0a1895f27c2b req-b0430d0b-eba4-4769-892d-862c092173a1 service neutron] 10.222.0.82 "GET /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2910392 May 12 15:14:34.263945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb10c89b-c43e-4fe0-8df4-f0371481247d req-d74eefa6-64f5-4ae8-8220-063580b4f890 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:34.268167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb10c89b-c43e-4fe0-8df4-f0371481247d req-d74eefa6-64f5-4ae8-8220-063580b4f890 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a687923521d64fba8b0ceae3dbf4d7d3&device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 1096 time: 0.2230585 May 12 15:14:34.420651 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port be802a6d-cca9-42fd-bdc5-6c9f78035217, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=be802a6d-cca9-42fd-bdc5-6c9f78035217,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:34.461537 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=b4c1d2d6-213d-4562-8698-2dc7f8f15413,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:34.464960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'be802a6d-cca9-42fd-bdc5-6c9f78035217', 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06', 'port_id': 'be802a6d-cca9-42fd-bdc5-6c9f78035217', 'mac_address': 'fa:16:3e:cd:76:cc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 571, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '34e89d1d-72aa-4216-94d6-f37b8a0c162b', 'ip_address': '10.1.1.182'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:14:34.511923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['b4c1d2d6-213d-4562-8698-2dc7f8f15413'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:34.556160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb10c89b-c43e-4fe0-8df4-f0371481247d req-5cbee288-ae3d-4c6f-974d-771a71ca5abb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:34.559051 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb10c89b-c43e-4fe0-8df4-f0371481247d req-5cbee288-ae3d-4c6f-974d-771a71ca5abb service neutron] 10.222.0.76 "GET /v2.0/networks?id=13bc975a-b248-4de3-b27d-6d14b7951c4b HTTP/1.1" status: 200 len: 930 time: 0.2779272 May 12 15:14:34.590336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1f383c45-3411-40a9-bc08-2644c7fa5c28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:13:36Z', 'revision_number': 4, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '03f3fc43-1c40-4332-9857-d7ed5e3953cd', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'floating_ip_address': '172.25.8.224', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'port_id': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1002, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'mac_address': 'fa:16:3e:28:75:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:14:24Z', 'updated_at': '2022-05-12T15:14:30Z', 'revision_number': 1, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c04fe88c-5805-45f0-b3fd-52b35ea3fe16', 'name': '', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'mac_address': 'fa:16:3e:8e:94:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_interface', 'standard_attr_id': 963, 'fixed_ips': [{'subnet_id': '9a114164-5df9-48f9-8806-96a06aeff952', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:35Z', 'updated_at': '2022-05-12T15:13:47Z', 'revision_number': 5, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'subnets': [{'id': '9a114164-5df9-48f9-8806-96a06aeff952', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:34.605622 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:34.618372 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f383c45-3411-40a9-bc08-2644c7fa5c28 None None] Checking router: 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:14:34.641798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f383c45-3411-40a9-bc08-2644c7fa5c28 None None] Routers {'86f12517-ac09-4f4e-b30f-f7f1a1aa3190'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:14:34.642739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1f383c45-3411-40a9-bc08-2644c7fa5c28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:14:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:34.690699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb10c89b-c43e-4fe0-8df4-f0371481247d req-add1959a-e598-4b2e-b690-2f28cd3bfa2d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e HTTP/1.1" status: 200 len: 999 time: 0.1252573 May 12 15:14:34.772730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-536c44a5-77e9-4cea-a8b4-8b3b0adcb7dd req-cebc4802-87c4-4cf6-a542-4e11065ca836 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:34.780431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-536c44a5-77e9-4cea-a8b4-8b3b0adcb7dd req-cebc4802-87c4-4cf6-a542-4e11065ca836 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 1096 time: 0.2880154 May 12 15:14:34.797667 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id be802a6d-cca9-42fd-bdc5-6c9f78035217 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:34.855984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb10c89b-c43e-4fe0-8df4-f0371481247d req-e0405aea-4430-4dfc-a84f-c5c98d4d1e14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:34.857605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb10c89b-c43e-4fe0-8df4-f0371481247d req-e0405aea-4430-4dfc-a84f-c5c98d4d1e14 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=9a114164-5df9-48f9-8806-96a06aeff952 HTTP/1.1" status: 200 len: 868 time: 0.1600375 May 12 15:14:34.864654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-1f383c45-3411-40a9-bc08-2644c7fa5c28 None None] Set router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:14:34.866171 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-536c44a5-77e9-4cea-a8b4-8b3b0adcb7dd req-12fdd4f3-c72e-45d0-9dbd-523a7fa149f2 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0848317 May 12 15:14:34.937970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port be802a6d-cca9-42fd-bdc5-6c9f78035217, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=be802a6d-cca9-42fd-bdc5-6c9f78035217,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:34.954224 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:34.954892 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4834ab3b-6306-4f41-81ec-4af4df1f4c1b details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:14:35.112739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=be802a6d-cca9-42fd-bdc5-6c9f78035217,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:35.170076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2450eb0-932a-4eff-9f96-c657fa425a68 req-d6f0df33-b834-4c0c-a50e-5a0f4c1b9278 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:35.172188 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2450eb0-932a-4eff-9f96-c657fa425a68 req-d6f0df33-b834-4c0c-a50e-5a0f4c1b9278 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 945 time: 0.4360523 May 12 15:14:35.250332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4834ab3b-6306-4f41-81ec-4af4df1f4c1b,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:35.264487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-99568d48-b4df-4c95-b2cb-d8488da253f6 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:35.275733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-99568d48-b4df-4c95-b2cb-d8488da253f6 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.2438591 May 12 15:14:35.291812 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-01d916a8-ba4e-4f09-96a7-2b09c3cab3ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/quotas/593ec496e5db4078be8dc940596be321 HTTP/1.1" status: 200 len: 375 time: 0.0147691 May 12 15:14:35.339124 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '4834ab3b-6306-4f41-81ec-4af4df1f4c1b', 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06', 'port_id': '4834ab3b-6306-4f41-81ec-4af4df1f4c1b', 'mac_address': 'fa:16:3e:0d:b8:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 571, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '34e89d1d-72aa-4216-94d6-f37b8a0c162b', 'ip_address': '10.1.1.117'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:14:35.391216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb10c89b-c43e-4fe0-8df4-f0371481247d req-1657cacd-cc93-4d51-b8d1-946b8d98d28b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:35.392793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb10c89b-c43e-4fe0-8df4-f0371481247d req-1657cacd-cc93-4d51-b8d1-946b8d98d28b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=13bc975a-b248-4de3-b27d-6d14b7951c4b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5248885 May 12 15:14:35.463707 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:35.507707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2450eb0-932a-4eff-9f96-c657fa425a68 req-841e58a0-53d7-4aa2-a65a-18f2ecb39152 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2184360 May 12 15:14:35.519725 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4834ab3b-6306-4f41-81ec-4af4df1f4c1b {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:35.554140 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4834ab3b-6306-4f41-81ec-4af4df1f4c1b,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:35.562712 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:35.563380 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 857536b0-998d-4731-a09f-f8fca9f18d3e details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:14:35.579306 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-cd6b49a5-23a6-459a-b2c7-f16369962eb9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2648771 May 12 15:14:35.663198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4834ab3b-6306-4f41-81ec-4af4df1f4c1b,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:35.669286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 857536b0-998d-4731-a09f-f8fca9f18d3e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=857536b0-998d-4731-a09f-f8fca9f18d3e,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:35.686371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1f383c45-3411-40a9-bc08-2644c7fa5c28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:13:36Z', 'revision_number': 4, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '03f3fc43-1c40-4332-9857-d7ed5e3953cd', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'floating_ip_address': '172.25.8.224', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'port_id': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1002, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'mac_address': 'fa:16:3e:28:75:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:14:24Z', 'updated_at': '2022-05-12T15:14:30Z', 'revision_number': 1, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c04fe88c-5805-45f0-b3fd-52b35ea3fe16', 'name': '', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'mac_address': 'fa:16:3e:8e:94:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_interface', 'standard_attr_id': 963, 'fixed_ips': [{'subnet_id': '9a114164-5df9-48f9-8806-96a06aeff952', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:35Z', 'updated_at': '2022-05-12T15:13:47Z', 'revision_number': 5, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'subnets': [{'id': '9a114164-5df9-48f9-8806-96a06aeff952', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:35.690824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '857536b0-998d-4731-a09f-f8fca9f18d3e', 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06', 'port_id': '857536b0-998d-4731-a09f-f8fca9f18d3e', 'mac_address': 'fa:16:3e:7a:aa:05', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 571, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '34e89d1d-72aa-4216-94d6-f37b8a0c162b', 'ip_address': '10.1.1.217'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:14:35.694004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f383c45-3411-40a9-bc08-2644c7fa5c28 None None] The sync data for ids ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'] in n-d-841483-1 is: [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:13:36Z', 'revision_number': 4, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '03f3fc43-1c40-4332-9857-d7ed5e3953cd', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'floating_ip_address': '172.25.8.224', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'port_id': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1002, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'mac_address': 'fa:16:3e:28:75:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:14:24Z', 'updated_at': '2022-05-12T15:14:30Z', 'revision_number': 1, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c04fe88c-5805-45f0-b3fd-52b35ea3fe16', 'name': '', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'mac_address': 'fa:16:3e:8e:94:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_interface', 'standard_attr_id': 963, 'fixed_ips': [{'subnet_id': '9a114164-5df9-48f9-8806-96a06aeff952', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:35Z', 'updated_at': '2022-05-12T15:13:47Z', 'revision_number': 5, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'subnets': [{'id': '9a114164-5df9-48f9-8806-96a06aeff952', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:14:35.723880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb10c89b-c43e-4fe0-8df4-f0371481247d req-6333474a-0fdf-4438-94c4-93247523b69e service neutron] 10.222.0.76 "GET /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3226800 May 12 15:14:35.756863 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:35.781120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 857536b0-998d-4731-a09f-f8fca9f18d3e {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:35.800781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 857536b0-998d-4731-a09f-f8fca9f18d3e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=857536b0-998d-4731-a09f-f8fca9f18d3e,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:35.810975 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:35.812047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device d96ca9ce-4a19-49f0-bef3-e0e31ace478a details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:14:35.903567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port d96ca9ce-4a19-49f0-bef3-e0e31ace478a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d96ca9ce-4a19-49f0-bef3-e0e31ace478a,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:35.920923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=857536b0-998d-4731-a09f-f8fca9f18d3e,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:35.927035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'd96ca9ce-4a19-49f0-bef3-e0e31ace478a', 'network_id': '86d71e93-6e6b-4e00-b1ac-48b27c2b0f06', 'port_id': 'd96ca9ce-4a19-49f0-bef3-e0e31ace478a', 'mac_address': 'fa:16:3e:c2:cc:de', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 571, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '34e89d1d-72aa-4216-94d6-f37b8a0c162b', 'ip_address': '10.1.1.21'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:14:35.995102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-e98bb8cf-a0a1-4ff6-8ada-8adceb01cd14 service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4149485 May 12 15:14:35.998486 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:36.019610 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4ecc383-dc6d-402c-bfc3-0950b6889b77 None None] New status for floating IP 03f3fc43-1c40-4332-9857-d7ed5e3953cd: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:14:36.023236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d96ca9ce-4a19-49f0-bef3-e0e31ace478a {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:36.046714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port d96ca9ce-4a19-49f0-bef3-e0e31ace478a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d96ca9ce-4a19-49f0-bef3-e0e31ace478a,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:36.056533 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:36.112264 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-286fbcdf-6b4f-45cc-a05f-eb3dbdc32847 req-81152e42-8fd5-4bda-bdd4-2f014faf92e0 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:36.119208 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-286fbcdf-6b4f-45cc-a05f-eb3dbdc32847 req-81152e42-8fd5-4bda-bdd4-2f014faf92e0 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 949 time: 0.4083111 May 12 15:14:36.123745 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb10c89b-c43e-4fe0-8df4-f0371481247d req-ac14a980-d81b-47dd-9a2a-ff302b185ce3 service neutron] 10.222.0.76 "GET /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3506310 May 12 15:14:36.131409 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1ef129c-01fa-4547-8fa4-d843ed020f6c req-596260f9-eed3-478e-8906-ba19e87b2ba3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:36.132943 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1ef129c-01fa-4547-8fa4-d843ed020f6c req-596260f9-eed3-478e-8906-ba19e87b2ba3 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "GET /v2.0/ports?device_id=068ccb5e-6f3b-4d6f-af59-35e722e2b8a1 HTTP/1.1" status: 200 len: 949 time: 0.4594946 May 12 15:14:36.164749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=d96ca9ce-4a19-49f0-bef3-e0e31ace478a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:36.265987 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-d1ef129c-01fa-4547-8fa4-d843ed020f6c req-c9b0f8b3-0801-4b5e-b3df-a1c23d521430 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Deleting port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:36.266589 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d1ef129c-01fa-4547-8fa4-d843ed020f6c req-c9b0f8b3-0801-4b5e-b3df-a1c23d521430 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:36.371798 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-286fbcdf-6b4f-45cc-a05f-eb3dbdc32847 req-a42ecbda-691e-4f35-a83a-84f630e08043 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.82 "GET /v2.0/security-groups?id=085c0de6-5055-4947-92b0-5e4da04eea48&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2497728 May 12 15:14:36.446345 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-548fb583-be26-4bd2-b3ec-54ff073ceeae service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4438424 May 12 15:14:36.521176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-05ddc5e4-5f9a-43a5-9ba7-34f42f284c93 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:36.528363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-05ddc5e4-5f9a-43a5-9ba7-34f42f284c93 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:36.530817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-05ddc5e4-5f9a-43a5-9ba7-34f42f284c93 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Synchronizing usage tracker for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:14:36.553709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-05ddc5e4-5f9a-43a5-9ba7-34f42f284c93 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Unset dirty status for tenant:1aea6927c780448b89ddf44ec6bcb186 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:14:36.555457 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-05ddc5e4-5f9a-43a5-9ba7-34f42f284c93 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.84 "GET /v2.0/ports?device_id=964db126-f48c-4257-8b18-8bd06d832b12 HTTP/1.1" status: 200 len: 1683 time: 0.1281645 May 12 15:14:36.660657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-e8670067-832a-4ada-9578-e2c8845a408f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting port f9f5bc5a-a74b-4196-8629-7321fb74da65 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:36.661009 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-e8670067-832a-4ada-9578-e2c8845a408f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:36.898154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b4c1d2d6-213d-4562-8698-2dc7f8f15413 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:36.995923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['39390bec-fdd9-4910-a8d2-6718da722725'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:37.066527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-e8670067-832a-4ada-9578-e2c8845a408f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] For port f9f5bc5a-a74b-4196-8629-7321fb74da65, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f9f5bc5a-a74b-4196-8629-7321fb74da65,segment=NetworkSegment(8ffe4223-2972-4274-85b3-fbe4e0a1c649),segment_id=8ffe4223-2972-4274-85b3-fbe4e0a1c649)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:37.067218 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-e8670067-832a-4ada-9578-e2c8845a408f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:37.074557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-9581c2d9-8201-4ee4-b586-0f83b508e8f2 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True&fields=id&id=5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 258 time: 0.6639724 May 12 15:14:37.095827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:37.121681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['be802a6d-cca9-42fd-bdc5-6c9f78035217'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:37.134492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:37.150928 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a2eb37f9-aba2-47d2-9756-11109b082c05'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:37.173181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-d1ef129c-01fa-4547-8fa4-d843ed020f6c req-c9b0f8b3-0801-4b5e-b3df-a1c23d521430 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] For port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:37.173611 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d1ef129c-01fa-4547-8fa4-d843ed020f6c req-c9b0f8b3-0801-4b5e-b3df-a1c23d521430 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:37.210570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['4834ab3b-6306-4f41-81ec-4af4df1f4c1b'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:37.313114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-e8670067-832a-4ada-9578-e2c8845a408f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Calling delete_port for f9f5bc5a-a74b-4196-8629-7321fb74da65 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:37.418618 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['d96ca9ce-4a19-49f0-bef3-e0e31ace478a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:37.460613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:37.485884 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-d1ef129c-01fa-4547-8fa4-d843ed020f6c req-c9b0f8b3-0801-4b5e-b3df-a1c23d521430 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Calling delete_port for f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:37.607871 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:37.638118 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-e8670067-832a-4ada-9578-e2c8845a408f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:37.705971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8670067-832a-4ada-9578-e2c8845a408f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event deleted for resources: {'Port': ['ID=f9f5bc5a-a74b-4196-8629-7321fb74da65,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:37.765005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66172601-3d54-474c-9f7e-eeb486ee8b13 req-7db41cb6-bafe-46ce-bcee-97d2d4c7c7d2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:37.787351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66172601-3d54-474c-9f7e-eeb486ee8b13 req-7db41cb6-bafe-46ce-bcee-97d2d4c7c7d2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:37.802029 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66172601-3d54-474c-9f7e-eeb486ee8b13 req-7db41cb6-bafe-46ce-bcee-97d2d4c7c7d2 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/ports?device_id=964db126-f48c-4257-8b18-8bd06d832b12 HTTP/1.1" status: 200 len: 1683 time: 1.1190648 May 12 15:14:37.844500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-e8670067-832a-4ada-9578-e2c8845a408f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] No DVR routers for this DVR port f9f5bc5a-a74b-4196-8629-7321fb74da65 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:14:37.848485 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-e8670067-832a-4ada-9578-e2c8845a408f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:37.850817 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d1ef129c-01fa-4547-8fa4-d843ed020f6c req-c9b0f8b3-0801-4b5e-b3df-a1c23d521430 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:37.864343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '964db126-f48c-4257-8b18-8bd06d832b12', 'name': 'network-vif-deleted', 'tag': 'f9f5bc5a-a74b-4196-8629-7321fb74da65'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:37.896360 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-e8670067-832a-4ada-9578-e2c8845a408f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.84 "DELETE /v2.0/ports/f9f5bc5a-a74b-4196-8629-7321fb74da65 HTTP/1.1" status: 204 len: 173 time: 1.3350244 May 12 15:14:37.976671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port b4c1d2d6-213d-4562-8698-2dc7f8f15413 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:38.032406 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port b4c1d2d6-213d-4562-8698-2dc7f8f15413 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:38.032790 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:38.048671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-01de0a46-1752-481d-af3b-41eba2f40ef7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting port 821acf60-4359-4f69-aa40-45a9cf272ac4 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:38.049012 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-01de0a46-1752-481d-af3b-41eba2f40ef7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:38.083086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['04429346-9f7d-4f32-8c65-290ee17fda8a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:38.185454 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66172601-3d54-474c-9f7e-eeb486ee8b13 req-3d04e2f5-2720-4e75-864d-2732bbbd2263 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "GET /v2.0/security-groups?id=f534afdd-dbad-43b8-9ae0-bd616bab9a95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3813326 May 12 15:14:38.228905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9b0f8b3-0801-4b5e-b3df-a1c23d521430 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Pushing event deleted for resources: {'Port': ['ID=f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:38.242936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['857536b0-998d-4731-a09f-f8fca9f18d3e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:38.316292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-d1ef129c-01fa-4547-8fa4-d843ed020f6c req-c9b0f8b3-0801-4b5e-b3df-a1c23d521430 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] No DVR routers for this DVR port f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:14:38.319673 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d1ef129c-01fa-4547-8fa4-d843ed020f6c req-c9b0f8b3-0801-4b5e-b3df-a1c23d521430 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:38.351025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '068ccb5e-6f3b-4d6f-af59-35e722e2b8a1', 'name': 'network-vif-deleted', 'tag': 'f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:38.365797 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1ef129c-01fa-4547-8fa4-d843ed020f6c req-c9b0f8b3-0801-4b5e-b3df-a1c23d521430 tempest-ServersOnMultiNodesTest-207046223 tempest-ServersOnMultiNodesTest-207046223-project] 10.222.0.76 "DELETE /v2.0/ports/f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 HTTP/1.1" status: 204 len: 173 time: 2.2060807 May 12 15:14:38.442777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-01de0a46-1752-481d-af3b-41eba2f40ef7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] For port 821acf60-4359-4f69-aa40-45a9cf272ac4, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=821acf60-4359-4f69-aa40-45a9cf272ac4,segment=NetworkSegment(3176ebc9-22db-4ad4-84e4-d78f669f2179),segment_id=3176ebc9-22db-4ad4-84e4-d78f669f2179)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:38.443134 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-01de0a46-1752-481d-af3b-41eba2f40ef7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:38.578969 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:38.667074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-01de0a46-1752-481d-af3b-41eba2f40ef7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Calling delete_port for 821acf60-4359-4f69-aa40-45a9cf272ac4 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:38.898484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b24f5e-eb68-470b-9e44-fd60d194633a req-d4497c6b-ee90-4a6d-98c7-9bf605bd3ba2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:38.905776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b24f5e-eb68-470b-9e44-fd60d194633a req-d4497c6b-ee90-4a6d-98c7-9bf605bd3ba2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:38.912453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b24f5e-eb68-470b-9e44-fd60d194633a req-d4497c6b-ee90-4a6d-98c7-9bf605bd3ba2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:38.919539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b24f5e-eb68-470b-9e44-fd60d194633a req-d4497c6b-ee90-4a6d-98c7-9bf605bd3ba2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:38.925657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b24f5e-eb68-470b-9e44-fd60d194633a req-d4497c6b-ee90-4a6d-98c7-9bf605bd3ba2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:38.932047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b24f5e-eb68-470b-9e44-fd60d194633a req-d4497c6b-ee90-4a6d-98c7-9bf605bd3ba2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:38.939073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b24f5e-eb68-470b-9e44-fd60d194633a req-d4497c6b-ee90-4a6d-98c7-9bf605bd3ba2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:38.940625 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75b24f5e-eb68-470b-9e44-fd60d194633a req-d4497c6b-ee90-4a6d-98c7-9bf605bd3ba2 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5437 time: 0.5057046 May 12 15:14:38.968186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Allocated IP 172.25.8.112 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/6c7de683-c224-4e59-81f7-366683517dfe) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:14:39.045334 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75b24f5e-eb68-470b-9e44-fd60d194633a req-5dea03cb-6a74-4e64-afe6-66539c3dde76 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0965543 May 12 15:14:39.289453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-8e374dab-34f0-4248-a908-059e2a31fbaf tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:39.291311 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-8e374dab-34f0-4248-a908-059e2a31fbaf tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.2041428 May 12 15:14:39.293161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-01de0a46-1752-481d-af3b-41eba2f40ef7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:39.333470 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:39.353162 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:39.411898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Request body: {'port': {'device_id': 'ab8299d7-c09c-426b-bd43-a7208f66c4a4', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'admin_state_up': True, 'tenant_id': '593ec496e5db4078be8dc940596be321'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:39.414709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5db6590b-b86e-4c59-a99a-e39a70a99b72 req-54e7e4f0-de93-4fc8-a6c7-6550cbf0711d tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:39.423440 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5db6590b-b86e-4c59-a99a-e39a70a99b72 req-54e7e4f0-de93-4fc8-a6c7-6550cbf0711d tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 1096 time: 0.1311522 May 12 15:14:39.471779 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:39.521610 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5db6590b-b86e-4c59-a99a-e39a70a99b72 req-80afce22-3d16-4f75-b772-c03910292010 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0970957 May 12 15:14:39.540592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b4c1d2d6-213d-4562-8698-2dc7f8f15413, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b4c1d2d6-213d-4562-8698-2dc7f8f15413,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:39.547077 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6062b237-2dea-4593-98c5-e5bcf587f743', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4c1d2d6-213d-4562-8698-2dc7f8f15413'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:39.548206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:39.571602 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:39.576144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:39.591225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:14:39.637899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01de0a46-1752-481d-af3b-41eba2f40ef7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event deleted for resources: {'Port': ['ID=821acf60-4359-4f69-aa40-45a9cf272ac4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:39.706023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:14:39.774054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Pushing event updated for resources: {'Port': ['ID=6c7de683-c224-4e59-81f7-366683517dfe,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:39.787211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:39.800886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:14:39.801335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:14:39.836091 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:39.866184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f95e6ae9-7518-493a-85ee-80ac79ea039c req-9d62eb03-037e-4d5c-99b5-c8f9c824d5b6 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:39.868211 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f95e6ae9-7518-493a-85ee-80ac79ea039c req-9d62eb03-037e-4d5c-99b5-c8f9c824d5b6 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.1566286 May 12 15:14:39.880776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Usage tracker for resource:port and tenant:593ec496e5db4078be8dc940596be321 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:39.889688 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=b4c1d2d6-213d-4562-8698-2dc7f8f15413,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:39.900320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:39.901187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:39.902072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:39.903303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:39.903834 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:39.904237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:39.904633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:39.905025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:39.905427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:39.905822 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:39.906208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:39.906595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:39.907150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:14:39.908881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-01de0a46-1752-481d-af3b-41eba2f40ef7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] No DVR routers for this DVR port 821acf60-4359-4f69-aa40-45a9cf272ac4 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:14:39.914828 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-01de0a46-1752-481d-af3b-41eba2f40ef7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:39.944606 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-824db23b-7f7d-48ff-802e-0f9dd7fbfe37 req-01de0a46-1752-481d-af3b-41eba2f40ef7 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.84 "DELETE /v2.0/ports/821acf60-4359-4f69-aa40-45a9cf272ac4 HTTP/1.1" status: 204 len: 173 time: 2.0308328 May 12 15:14:39.945608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:39.970050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Made reservation on behalf of 593ec496e5db4078be8dc940596be321 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:39.974760 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:39.987336 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f95e6ae9-7518-493a-85ee-80ac79ea039c req-6b705e30-3410-4497-bf32-6329dadcf57f tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0784914 May 12 15:14:39.999087 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:40.195836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a2eb37f9-aba2-47d2-9756-11109b082c05 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:40.222939 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0648f957-fb02-4b0c-8101-6d7244b39e5e req-e995f9b8-e852-4771-b5d0-aebb926261a5 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab8299d7-c09c-426b-bd43-a7208f66c4a4 HTTP/1.1" status: 200 len: 210 time: 0.0691891 May 12 15:14:40.238657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Allocated IP 172.20.0.5 (dbc2e49c-2591-4534-a48c-cea8e23115f4/84c2082e-f394-46d5-8a8f-8e3a70d54fc1/5fb6e0a8-b27d-442a-857d-367ef3a32588) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:14:40.334402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port a2eb37f9-aba2-47d2-9756-11109b082c05 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:40.341349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port a2eb37f9-aba2-47d2-9756-11109b082c05 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:40.342051 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:40.547951 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6499c382-d4ce-4e3f-b7f3-2b470722528c'] response: {'server_uuid': '964db126-f48c-4257-8b18-8bd06d832b12', 'name': 'network-vif-deleted', 'tag': 'f9f5bc5a-a74b-4196-8629-7321fb74da65', 'status': 'completed', 'code': 200} May 12 15:14:40.565615 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:40.572598 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:40.581890 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:40.623763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a2eb37f9-aba2-47d2-9756-11109b082c05, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a2eb37f9-aba2-47d2-9756-11109b082c05,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:40.636140 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:40.637442 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device d96ca9ce-4a19-49f0-bef3-e0e31ace478a up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:40.781518 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:40.820562 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:40.870260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Pushing event updated for resources: {'Port': ['ID=6c7de683-c224-4e59-81f7-366683517dfe,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:40.914679 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:41.023101 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a2eb37f9-aba2-47d2-9756-11109b082c05,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:41.030440 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:41.032251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event updated for resources: {'Port': ['ID=5fb6e0a8-b27d-442a-857d-367ef3a32588,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:41.044713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port d96ca9ce-4a19-49f0-bef3-e0e31ace478a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:41.045218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Network dbc2e49c-2591-4534-a48c-cea8e23115f4 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:41.046933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-b794a10b-bce4-4e45-a150-983f1afe3519 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 3.9681699 May 12 15:14:41.049518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:41.060360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:14:41.062764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port d96ca9ce-4a19-49f0-bef3-e0e31ace478a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:41.064161 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:41.199824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53846) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:41.209084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:41.254644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:41.255966 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:41.286259 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f8435977-d6a4-46db-a86e-05150f4567e7'] response: {'server_uuid': '068ccb5e-6f3b-4d6f-af59-35e722e2b8a1', 'name': 'network-vif-deleted', 'tag': 'f5b4bd48-fcfe-4af1-adfa-e9dcba8ddb81', 'status': 'completed', 'code': 200} May 12 15:14:41.312809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53854) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:41.412557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-1383a658-3513-4507-a73b-c60426a58d75 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Synchronizing usage tracker for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:14:41.430559 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-52d2d6fd-c9eb-4d69-97e0-297214371456'] response: {'server_uuid': '6062b237-2dea-4593-98c5-e5bcf587f743', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4c1d2d6-213d-4562-8698-2dc7f8f15413', 'code': 200} May 12 15:14:41.432114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-1383a658-3513-4507-a73b-c60426a58d75 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Unset dirty status for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:14:41.434486 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-1383a658-3513-4507-a73b-c60426a58d75 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.112 HTTP/1.1" status: 200 len: 696 time: 0.3822885 May 12 15:14:41.531926 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:41.562856 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c7df7c40-1d38-4daa-b7ef-f55fb4265de8 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=fa4eac6b8c464c45aa3c550e59a0d34b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3611283 May 12 15:14:41.565897 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-a21a7db9-b644-452e-ac59-801bcad6d260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.1674106 May 12 15:14:41.570187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53858) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:41.591206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-aee70031-d60d-49cc-a5cc-f588fcc8633f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting subnet 017deaab-283a-4147-ab68-24cdb3eaed15 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:14:41.595240 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aee70031-d60d-49cc-a5cc-f588fcc8633f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:41.622236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port d96ca9ce-4a19-49f0-bef3-e0e31ace478a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d96ca9ce-4a19-49f0-bef3-e0e31ace478a,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:41.677984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aee70031-d60d-49cc-a5cc-f588fcc8633f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:41.693939 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:41.695397 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 821acf60-4359-4f69-aa40-45a9cf272ac4 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:14:41.723621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b32994-fe23-4727-a3f5-3d2e9ca944ea req-df120fc1-3b5d-4af2-bca9-4f3f529411ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:41.725082 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57b32994-fe23-4727-a3f5-3d2e9ca944ea req-df120fc1-3b5d-4af2-bca9-4f3f529411ad service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 1097 time: 0.2895086 May 12 15:14:41.766218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-995ccee6-d752-4a77-8eb2-1c2eb14c974e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:41.782574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f299e4f2-a46e-4fdd-8a0f-d5477166a462 req-995ccee6-d752-4a77-8eb2-1c2eb14c974e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.3046646 May 12 15:14:41.790674 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aee70031-d60d-49cc-a5cc-f588fcc8633f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:41.812122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 821acf60-4359-4f69-aa40-45a9cf272ac4 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:14:41.812461 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 821acf60-4359-4f69-aa40-45a9cf272ac4 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:14:41.812878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f9f5bc5a-a74b-4196-8629-7321fb74da65 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:14:41.818426 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f6c69ff-988e-4847-a4be-8746357e42c5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:41.845864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=d96ca9ce-4a19-49f0-bef3-e0e31ace478a,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:41.879508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: f9f5bc5a-a74b-4196-8629-7321fb74da65 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:14:41.879846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f9f5bc5a-a74b-4196-8629-7321fb74da65 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:14:41.892834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-2d8619dc-5fef-42d1-af7c-7458323875dd tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:14:41.894901 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-2d8619dc-5fef-42d1-af7c-7458323875dd tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1565886 May 12 15:14:41.898045 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aee70031-d60d-49cc-a5cc-f588fcc8633f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:41.918752 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f6c69ff-988e-4847-a4be-8746357e42c5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:41.957699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57b32994-fe23-4727-a3f5-3d2e9ca944ea req-9ae85e56-3de2-4833-8a57-2b2e5cc8a862 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2107999 May 12 15:14:41.982883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Request body: {'port': {'device_id': 'ab8299d7-c09c-426b-bd43-a7208f66c4a4', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:42.030580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aee70031-d60d-49cc-a5cc-f588fcc8633f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event deleted for resources: {'Subnet': ['ID=017deaab-283a-4147-ab68-24cdb3eaed15,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:42.041049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f6c69ff-988e-4847-a4be-8746357e42c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:42.049193 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aee70031-d60d-49cc-a5cc-f588fcc8633f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:42.049789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-26228968-d4b4-42cf-b907-037d72eb42ea None None] Network a77dc623-3230-4c49-bb40-819a554177b1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:14:42.076482 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aee70031-d60d-49cc-a5cc-f588fcc8633f tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "DELETE /v2.0/subnets/017deaab-283a-4147-ab68-24cdb3eaed15 HTTP/1.1" status: 204 len: 168 time: 0.7622206 May 12 15:14:42.079862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53870) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:42.113771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f6c69ff-988e-4847-a4be-8746357e42c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=085c0de6-5055-4947-92b0-5e4da04eea48,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:42.152760 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f6c69ff-988e-4847-a4be-8746357e42c5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:42.163847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0f6c69ff-988e-4847-a4be-8746357e42c5 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/085c0de6-5055-4947-92b0-5e4da04eea48 HTTP/1.1" status: 204 len: 168 time: 0.5844014 May 12 15:14:42.332864 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c750aac-b685-4afe-8d4d-aae842d0f645 req-e1551fd9-4182-4821-9580-cd3139ad575e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:42.342359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c750aac-b685-4afe-8d4d-aae842d0f645 req-e1551fd9-4182-4821-9580-cd3139ad575e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:42.344126 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:42.349914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c750aac-b685-4afe-8d4d-aae842d0f645 req-e1551fd9-4182-4821-9580-cd3139ad575e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:42.358530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c750aac-b685-4afe-8d4d-aae842d0f645 req-e1551fd9-4182-4821-9580-cd3139ad575e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:42.365592 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c750aac-b685-4afe-8d4d-aae842d0f645 req-e1551fd9-4182-4821-9580-cd3139ad575e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:42.366142 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 39390bec-fdd9-4910-a8d2-6718da722725 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:42.372944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c750aac-b685-4afe-8d4d-aae842d0f645 req-e1551fd9-4182-4821-9580-cd3139ad575e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:42.380121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c750aac-b685-4afe-8d4d-aae842d0f645 req-e1551fd9-4182-4821-9580-cd3139ad575e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:42.382473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c750aac-b685-4afe-8d4d-aae842d0f645 req-e1551fd9-4182-4821-9580-cd3139ad575e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5439 time: 0.3852706 May 12 15:14:42.388820 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:42.403089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80fdd4c7-dd1a-4e9f-b7eb-9566f80a2516 req-c8215e36-ad27-4f57-9204-5c0adbd4ac8f tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:42.410739 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-80fdd4c7-dd1a-4e9f-b7eb-9566f80a2516 req-c8215e36-ad27-4f57-9204-5c0adbd4ac8f tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.2402084 May 12 15:14:42.565222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '964db126-f48c-4257-8b18-8bd06d832b12', 'name': 'network-vif-deleted', 'tag': '821acf60-4359-4f69-aa40-45a9cf272ac4'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:42.573023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c750aac-b685-4afe-8d4d-aae842d0f645 req-2e6a4726-50f8-41a2-810a-a71f70a9cb58 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1411819 May 12 15:14:42.591308 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-80fdd4c7-dd1a-4e9f-b7eb-9566f80a2516 req-e017a87a-6776-456e-8f6a-cf4802f72259 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1787360 May 12 15:14:42.591970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting port 79021b52-62a2-42bb-b979-9b3513069ddd {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:42.592862 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:42.688909 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e65c46ed-0e29-4806-8464-097d1aa2c341 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:42.715950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 39390bec-fdd9-4910-a8d2-6718da722725 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:42.736022 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 39390bec-fdd9-4910-a8d2-6718da722725 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:42.736389 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:42.810401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53882) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:42.830344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1e2fa0e-c56d-42e6-885f-abd65be8ee05 req-29735a2a-ede7-4760-b81f-1b8d750a921a tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:42.838926 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1e2fa0e-c56d-42e6-885f-abd65be8ee05 req-29735a2a-ede7-4760-b81f-1b8d750a921a tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab8299d7-c09c-426b-bd43-a7208f66c4a4 HTTP/1.1" status: 200 len: 931 time: 0.1288209 May 12 15:14:42.907201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f90d75b6-4991-456c-8ee0-6240d5d44f87 None None] DHCP port deletion for a77dc623-3230-4c49-bb40-819a554177b1 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:14:42.930021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f90d75b6-4991-456c-8ee0-6240d5d44f87 None None] Deleting port 79021b52-62a2-42bb-b979-9b3513069ddd {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:42.930664 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f90d75b6-4991-456c-8ee0-6240d5d44f87 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:42.953675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1e2fa0e-c56d-42e6-885f-abd65be8ee05 req-55cd08d0-7cb1-44e9-8040-32e453697680 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1136470 May 12 15:14:43.042122 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:43.050805 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49f59cc0-39c6-413c-a899-8c352b247628 req-c5ffb515-73d0-4053-8f97-be5654f66f8e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:43.062396 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49f59cc0-39c6-413c-a899-8c352b247628 req-c5ffb515-73d0-4053-8f97-be5654f66f8e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/ports?device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.2014039 May 12 15:14:43.254562 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a2a4dd1c-b6c5-4934-8fc2-09fdf94aec77 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9a79f1afc97d454587f70a609af0a887&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4424148 May 12 15:14:43.256399 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4a554fb4-7e7b-457f-86e4-a216fa8a5861'] response: {'server_uuid': '964db126-f48c-4257-8b18-8bd06d832b12', 'name': 'network-vif-deleted', 'tag': '821acf60-4359-4f69-aa40-45a9cf272ac4', 'status': 'completed', 'code': 200} May 12 15:14:43.263877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53886) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:43.338569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49f59cc0-39c6-413c-a899-8c352b247628 req-b7252e6b-d93d-4e44-a8fa-19fab9b4099d tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.112 HTTP/1.1" status: 200 len: 696 time: 0.2748036 May 12 15:14:43.360345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-49f59cc0-39c6-413c-a899-8c352b247628 req-b844c69b-ccf2-4c1d-8f69-9ce17342adf1 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Request body: {'floatingip': {'port_id': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e', 'fixed_ip_address': '172.20.0.5'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:43.413502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] For port 79021b52-62a2-42bb-b979-9b3513069ddd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=79021b52-62a2-42bb-b979-9b3513069ddd,segment=NetworkSegment(3176ebc9-22db-4ad4-84e4-d78f669f2179),segment_id=3176ebc9-22db-4ad4-84e4-d78f669f2179)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:43.413876 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:43.487704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a2eb37f9-aba2-47d2-9756-11109b082c05'}, {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd96ca9ce-4a19-49f0-bef3-e0e31ace478a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:43.567456 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:43.582405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5fb6e0a8-b27d-442a-857d-367ef3a32588 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:43.597706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Calling delete_port for 79021b52-62a2-42bb-b979-9b3513069ddd owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:43.610028 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-49f59cc0-39c6-413c-a899-8c352b247628 req-b844c69b-ccf2-4c1d-8f69-9ce17342adf1 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:43.633718 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d2217de0-7eba-4aef-a180-711bdf082182'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a2eb37f9-aba2-47d2-9756-11109b082c05', 'code': 200} May 12 15:14:43.634237 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d2217de0-7eba-4aef-a180-711bdf082182'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd96ca9ce-4a19-49f0-bef3-e0e31ace478a', 'code': 200} May 12 15:14:43.642608 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:43.651513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f90d75b6-4991-456c-8ee0-6240d5d44f87 None None] For port 79021b52-62a2-42bb-b979-9b3513069ddd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=79021b52-62a2-42bb-b979-9b3513069ddd,segment=NetworkSegment(3176ebc9-22db-4ad4-84e4-d78f669f2179),segment_id=3176ebc9-22db-4ad4-84e4-d78f669f2179)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:43.652398 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f90d75b6-4991-456c-8ee0-6240d5d44f87 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:43.677922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Transition to ACTIVE for port object 5fb6e0a8-b27d-442a-857d-367ef3a32588 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:43.694507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 39390bec-fdd9-4910-a8d2-6718da722725, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=39390bec-fdd9-4910-a8d2-6718da722725,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:43.756724 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:43.764551 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:43.765425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 04429346-9f7d-4f32-8c65-290ee17fda8a up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:43.820442 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:43.926311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] No DVR routers for this DVR port 79021b52-62a2-42bb-b979-9b3513069ddd on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:14:44.041427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f90d75b6-4991-456c-8ee0-6240d5d44f87 None None] Calling delete_port for 79021b52-62a2-42bb-b979-9b3513069ddd owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:44.072514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=39390bec-fdd9-4910-a8d2-6718da722725,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:44.104618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Pushing event updated for resources: {'Port': ['ID=5fb6e0a8-b27d-442a-857d-367ef3a32588,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:44.117225 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-241abdac-4dca-4a00-887f-2976c836d646 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.140636 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-f90d75b6-4991-456c-8ee0-6240d5d44f87 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:14:44.141012 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-f90d75b6-4991-456c-8ee0-6240d5d44f87 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:14:44.144735 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-241abdac-4dca-4a00-887f-2976c836d646 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.156697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 04429346-9f7d-4f32-8c65-290ee17fda8a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:44.163795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 04429346-9f7d-4f32-8c65-290ee17fda8a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:44.164165 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.226205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event deleted for resources: {'Port': ['ID=79021b52-62a2-42bb-b979-9b3513069ddd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:44.228862 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-241abdac-4dca-4a00-887f-2976c836d646 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.268000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-241abdac-4dca-4a00-887f-2976c836d646 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47a56ceb-f079-40c2-a7e3-380b93fe504b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:44.306135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.358909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a77dc623-3230-4c49-bb40-819a554177b1']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:44.366938 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.378423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3176ebc9-22db-4ad4-84e4-d78f669f2179') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:44.378707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3176ebc9-22db-4ad4-84e4-d78f669f2179') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:44.385965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Attempting to bind port 5fb6e0a8-b27d-442a-857d-367ef3a32588 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:14:44.386257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Attempting to bind port 5fb6e0a8-b27d-442a-857d-367ef3a32588 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:14:44.386586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Attempting to bind port 5fb6e0a8-b27d-442a-857d-367ef3a32588 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:44.397656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Port 5fb6e0a8-b27d-442a-857d-367ef3a32588 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:14:44.397990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Attempting to bind port 5fb6e0a8-b27d-442a-857d-367ef3a32588 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:44.406925 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.414488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 14, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:14:44.414826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Checking segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:44.415213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Bound using segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:14:44.415759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Bound port: 5fb6e0a8-b27d-442a-857d-367ef3a32588, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:14:44.416641 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.476520 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 04429346-9f7d-4f32-8c65-290ee17fda8a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=04429346-9f7d-4f32-8c65-290ee17fda8a,segment=NetworkSegment(a64e84dc-d91c-44e1-ab35-6c9b54a1b65b),segment_id=a64e84dc-d91c-44e1-ab35-6c9b54a1b65b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:44.484232 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.485890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device be802a6d-cca9-42fd-bdc5-6c9f78035217 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:44.499194 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.510979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Releasing vlan 554 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:14:44.512365 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: timer() May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:14:44.528396 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:14:44.534354 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-241abdac-4dca-4a00-887f-2976c836d646 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.535481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-241abdac-4dca-4a00-887f-2976c836d646 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/47a56ceb-f079-40c2-a7e3-380b93fe504b HTTP/1.1" status: 204 len: 168 time: 1.2706783 May 12 15:14:44.544177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e77dbad2-3200-4a00-b065-557fa0715713 req-4c18b699-706a-417c-871a-c1089ac9baf1 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:44.551303 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e77dbad2-3200-4a00-b065-557fa0715713 req-4c18b699-706a-417c-871a-c1089ac9baf1 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.6265345 May 12 15:14:44.625449 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 79021b52-62a2-42bb-b979-9b3513069ddd no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:14:44.701078 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e77dbad2-3200-4a00-b065-557fa0715713 req-86730ac4-d10f-4dae-ab73-6e18a0c03452 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1487556 May 12 15:14:44.781108 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f90d75b6-4991-456c-8ee0-6240d5d44f87 None None] Deleting port 79021b52-62a2-42bb-b979-9b3513069ddd {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:44.782178 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f90d75b6-4991-456c-8ee0-6240d5d44f87 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.784227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] For port 5fb6e0a8-b27d-442a-857d-367ef3a32588, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:44.788171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] For port 5fb6e0a8-b27d-442a-857d-367ef3a32588, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=5fb6e0a8-b27d-442a-857d-367ef3a32588,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:14:44.796341 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.864292 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.866698 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:44.965459 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 79021b52-62a2-42bb-b979-9b3513069ddd {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:14:44.965960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 79021b52-62a2-42bb-b979-9b3513069ddd not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:14:45.018214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event deleted for resources: {'Network': ['ID=a77dc623-3230-4c49-bb40-819a554177b1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:45.021595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Pushing event updated for resources: {'Port': ['ID=5fb6e0a8-b27d-442a-857d-367ef3a32588,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:45.044541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:45.045365 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:45.048840 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d00346d3-3035-4899-a075-caefd13aa4ef service neutron] 10.222.0.84 "PUT /v2.0/ports/5fb6e0a8-b27d-442a-857d-367ef3a32588 HTTP/1.1" status: 200 len: 1091 time: 3.1366265 May 12 15:14:45.058762 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-85c1156b-8a50-4315-92d2-f3a6726f5c3b tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "DELETE /v2.0/networks/a77dc623-3230-4c49-bb40-819a554177b1 HTTP/1.1" status: 204 len: 168 time: 2.9773736 May 12 15:14:45.060051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53910) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:45.081364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f90d75b6-4991-456c-8ee0-6240d5d44f87 None None] The port '79021b52-62a2-42bb-b979-9b3513069ddd' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:14:45.087873 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port be802a6d-cca9-42fd-bdc5-6c9f78035217 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:45.100709 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d755dfb5-bf77-4b44-8ba4-948719a8aec6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:45.108150 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63874642-b746-4fef-8171-610f60619430 req-b65ec503-3e21-490b-a335-3b05a3446cfe service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.5085130 May 12 15:14:45.125106 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-49f59cc0-39c6-413c-a899-8c352b247628 req-b844c69b-ccf2-4c1d-8f69-9ce17342adf1 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] update failed (client error): There was a conflict when trying to complete your request. May 12 15:14:45.135076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=04429346-9f7d-4f32-8c65-290ee17fda8a,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:45.139369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port be802a6d-cca9-42fd-bdc5-6c9f78035217 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:45.140065 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:45.144957 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49f59cc0-39c6-413c-a899-8c352b247628 req-b844c69b-ccf2-4c1d-8f69-9ce17342adf1 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "PUT /v2.0/floatingips/673c7163-052c-4369-9825-9ecda9c1a91f HTTP/1.1" status: 409 len: 550 time: 1.8043079 May 12 15:14:45.167024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-a28cd2be-3d61-4d7d-a90f-46b11f29d3b8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting subnet 95022f85-d8df-4537-b394-3df92c22f710 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:14:45.171362 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a28cd2be-3d61-4d7d-a90f-46b11f29d3b8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:45.235498 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a28cd2be-3d61-4d7d-a90f-46b11f29d3b8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:45.325207 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:45.369884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a28cd2be-3d61-4d7d-a90f-46b11f29d3b8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:45.376402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port be802a6d-cca9-42fd-bdc5-6c9f78035217, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=be802a6d-cca9-42fd-bdc5-6c9f78035217,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:45.385085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c834409-e9c4-442a-979e-9014cd46b21e req-0a5e2600-34a1-4b69-bef3-56a0b4933631 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:45.387093 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:45.388119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4834ab3b-6306-4f41-81ec-4af4df1f4c1b up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:45.391904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c834409-e9c4-442a-979e-9014cd46b21e req-0a5e2600-34a1-4b69-bef3-56a0b4933631 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:45.397889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c834409-e9c4-442a-979e-9014cd46b21e req-0a5e2600-34a1-4b69-bef3-56a0b4933631 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:45.403900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c834409-e9c4-442a-979e-9014cd46b21e req-0a5e2600-34a1-4b69-bef3-56a0b4933631 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:45.410324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c834409-e9c4-442a-979e-9014cd46b21e req-0a5e2600-34a1-4b69-bef3-56a0b4933631 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:45.416746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c834409-e9c4-442a-979e-9014cd46b21e req-0a5e2600-34a1-4b69-bef3-56a0b4933631 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:45.422635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c834409-e9c4-442a-979e-9014cd46b21e req-0a5e2600-34a1-4b69-bef3-56a0b4933631 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:45.424547 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c834409-e9c4-442a-979e-9014cd46b21e req-0a5e2600-34a1-4b69-bef3-56a0b4933631 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5441 time: 0.4792068 May 12 15:14:45.457738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ab8299d7-c09c-426b-bd43-a7208f66c4a4', 'tag': '5fb6e0a8-b27d-442a-857d-367ef3a32588'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:45.513459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63874642-b746-4fef-8171-610f60619430 req-1bf43660-dfe5-49f0-bc8f-666f1258960c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:45.515045 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63874642-b746-4fef-8171-610f60619430 req-1bf43660-dfe5-49f0-bc8f-666f1258960c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 1095 time: 0.3693521 May 12 15:14:45.526798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=be802a6d-cca9-42fd-bdc5-6c9f78035217,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:45.537715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:45.543066 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a28cd2be-3d61-4d7d-a90f-46b11f29d3b8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:45.543800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:45.543800 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:45.585179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c834409-e9c4-442a-979e-9014cd46b21e req-813eabe7-3e14-4dc0-975e-1f4663a173fd tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1176820 May 12 15:14:45.647804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a28cd2be-3d61-4d7d-a90f-46b11f29d3b8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event deleted for resources: {'Subnet': ['ID=95022f85-d8df-4537-b394-3df92c22f710,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:45.655009 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39390bec-fdd9-4910-a8d2-6718da722725'}, {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '04429346-9f7d-4f32-8c65-290ee17fda8a'}, {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be802a6d-cca9-42fd-bdc5-6c9f78035217'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:45.667021 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a28cd2be-3d61-4d7d-a90f-46b11f29d3b8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:45.677943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53928) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:45.678261 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a28cd2be-3d61-4d7d-a90f-46b11f29d3b8 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "DELETE /v2.0/subnets/95022f85-d8df-4537-b394-3df92c22f710 HTTP/1.1" status: 204 len: 168 time: 0.6169317 May 12 15:14:45.690610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e27a0bb-24e7-40b0-a74a-2e6a26d32665 req-036cfd19-2cb4-4c0e-bf9a-5c21c013d8c6 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:45.692121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e27a0bb-24e7-40b0-a74a-2e6a26d32665 req-036cfd19-2cb4-4c0e-bf9a-5c21c013d8c6 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab8299d7-c09c-426b-bd43-a7208f66c4a4 HTTP/1.1" status: 200 len: 943 time: 0.2666061 May 12 15:14:45.695214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-6642734a-54c1-4293-b9d6-627d3fa00572 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:45.703340 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-6642734a-54c1-4293-b9d6-627d3fa00572 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=ab8299d7-c09c-426b-bd43-a7208f66c4a4 HTTP/1.1" status: 200 len: 1094 time: 0.2469575 May 12 15:14:45.719007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-801292a4-4993-467d-9a36-d5faec888de6 None None] Network cc2308f9-d1ec-4568-bf98-60c7e336ff78 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:14:45.864408 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-bd232b90-545b-4f77-8ad7-785d4800878e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5fb6e0a8-b27d-442a-857d-367ef3a32588 HTTP/1.1" status: 200 len: 217 time: 0.1381497 May 12 15:14:45.881594 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:45.968010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d2523a9b-775a-4561-9716-228e7a33caef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:45.972427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63874642-b746-4fef-8171-610f60619430 req-fe944876-55ad-476b-8e23-5c20084c959b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:45.974179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63874642-b746-4fef-8171-610f60619430 req-fe944876-55ad-476b-8e23-5c20084c959b service neutron] 10.222.0.76 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.4318848 May 12 15:14:45.974492 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-d2523a9b-775a-4561-9716-228e7a33caef service neutron] 10.222.0.84 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.0939810 May 12 15:14:45.990846 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e27a0bb-24e7-40b0-a74a-2e6a26d32665 req-15f6dd2c-e77e-4f18-99f7-452e23930b38 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2631991 May 12 15:14:45.995197 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:46.079853 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-124e8979-a8af-41b0-92ae-0665b1262d9c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0978971 May 12 15:14:46.120860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4834ab3b-6306-4f41-81ec-4af4df1f4c1b,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:46.123576 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:46.141194 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:46.142347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 857536b0-998d-4731-a09f-f8fca9f18d3e up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:46.187965 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63874642-b746-4fef-8171-610f60619430 req-2430c201-7503-4a70-8a7a-2e5af8b53d30 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93 HTTP/1.1" status: 200 len: 217 time: 0.1865845 May 12 15:14:46.204007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53954) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:46.264041 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c9dbc11-2b7b-499f-9593-9c82a782b2ec req-89f15e34-04ec-45a4-b064-a42750056e63 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips/673c7163-052c-4369-9825-9ecda9c1a91f HTTP/1.1" status: 200 len: 693 time: 0.2056637 May 12 15:14:46.265027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting port e4457ad6-9fe6-46af-85db-912f5b5167ef {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:46.265478 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:46.300771 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:46.356078 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-7bcda18b-9ef3-4a16-ad8b-333cc44f5275 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2646794 May 12 15:14:46.357955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4834ab3b-6306-4f41-81ec-4af4df1f4c1b,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:46.392691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 857536b0-998d-4731-a09f-f8fca9f18d3e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:46.399344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 857536b0-998d-4731-a09f-f8fca9f18d3e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:46.399771 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:46.503730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] DHCP port deletion for cc2308f9-d1ec-4568-bf98-60c7e336ff78 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:14:46.509223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] Deleting port e4457ad6-9fe6-46af-85db-912f5b5167ef {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:46.509887 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:46.585348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63874642-b746-4fef-8171-610f60619430 req-b9e7e71d-8235-442b-b00c-fe76913407eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:46.592430 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63874642-b746-4fef-8171-610f60619430 req-b9e7e71d-8235-442b-b00c-fe76913407eb service neutron] 10.222.0.76 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.3850164 May 12 15:14:46.598638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e4457ad6-9fe6-46af-85db-912f5b5167ef no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:14:46.677036 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3545d90e-71fd-46f8-9cce-ac31f6f134f5 req-91647236-bb54-4fa0-a80f-e5d15e3eee26 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3089223 May 12 15:14:46.749601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c9dbc11-2b7b-499f-9593-9c82a782b2ec req-6a64f371-ff38-4f8b-a8dd-8674298fe80e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:46.756587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c9dbc11-2b7b-499f-9593-9c82a782b2ec req-6a64f371-ff38-4f8b-a8dd-8674298fe80e tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.4466283 May 12 15:14:46.947819 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:46.987535 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63874642-b746-4fef-8171-610f60619430 req-25adf1f7-d8a1-440f-82cb-12e846fb5bc1 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2269795 May 12 15:14:46.990957 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Request body: {'network': {'name': 'tempest-ImagesTestJSON-1625240882-network', 'tenant_id': '7d73e66034f94885ae45429129883002'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:47.024768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:47.027662 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:47.058900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa14c9c3-1593-4b4e-bd60-3219b25b03ef req-f8ea45d1-2cc4-4063-b5e0-b35e48f7e357 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:47.060853 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa14c9c3-1593-4b4e-bd60-3219b25b03ef req-f8ea45d1-2cc4-4063-b5e0-b35e48f7e357 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 1.1577606 May 12 15:14:47.076326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port e4457ad6-9fe6-46af-85db-912f5b5167ef, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e4457ad6-9fe6-46af-85db-912f5b5167ef,segment=NetworkSegment(8ffe4223-2972-4274-85b3-fbe4e0a1c649),segment_id=8ffe4223-2972-4274-85b3-fbe4e0a1c649)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:47.128782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Usage tracker for resource:network and tenant:7d73e66034f94885ae45429129883002 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:47.143350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:47.155435 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c9dbc11-2b7b-499f-9593-9c82a782b2ec req-97bdf40c-1ef1-4da1-adc0-eaaa9abb5d90 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.112 HTTP/1.1" status: 200 len: 696 time: 0.3979638 May 12 15:14:47.169027 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] For port e4457ad6-9fe6-46af-85db-912f5b5167ef, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e4457ad6-9fe6-46af-85db-912f5b5167ef,segment=NetworkSegment(8ffe4223-2972-4274-85b3-fbe4e0a1c649),segment_id=8ffe4223-2972-4274-85b3-fbe4e0a1c649)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:47.169434 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:47.312633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:47.318478 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa14c9c3-1593-4b4e-bd60-3219b25b03ef req-85e45972-0a33-43a5-b643-a798a43d20e7 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1848366 May 12 15:14:47.388472 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c9dbc11-2b7b-499f-9593-9c82a782b2ec req-2a8a4a56-8fb2-4529-898e-000e9a2ae977 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.112 HTTP/1.1" status: 200 len: 696 time: 0.2318301 May 12 15:14:47.438093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] Calling delete_port for e4457ad6-9fe6-46af-85db-912f5b5167ef owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:47.445348 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a3f2b899-d4cd-48b8-af6a-854fada419c1'] response: {'name': 'network-changed', 'server_uuid': 'ab8299d7-c09c-426b-bd43-a7208f66c4a4', 'tag': '5fb6e0a8-b27d-442a-857d-367ef3a32588', 'status': 'completed', 'code': 200} May 12 15:14:47.474236 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:47.486811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Made reservation on behalf of 7d73e66034f94885ae45429129883002 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:47.490299 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:47.578348 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:47.600016 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-15638e3a-da62-4547-9473-df175e1344db'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39390bec-fdd9-4910-a8d2-6718da722725', 'code': 200} May 12 15:14:47.600261 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-15638e3a-da62-4547-9473-df175e1344db'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '04429346-9f7d-4f32-8c65-290ee17fda8a', 'code': 200} May 12 15:14:47.600513 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-15638e3a-da62-4547-9473-df175e1344db'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be802a6d-cca9-42fd-bdc5-6c9f78035217', 'code': 200} May 12 15:14:47.601093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=e4457ad6-9fe6-46af-85db-912f5b5167ef,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:47.607531 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63874642-b746-4fef-8171-610f60619430 req-da3b2be9-f429-401b-a8c6-556cd5c72bd4 service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5992398 May 12 15:14:47.623067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 857536b0-998d-4731-a09f-f8fca9f18d3e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=857536b0-998d-4731-a09f-f8fca9f18d3e,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:47.643621 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:47.649734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] For port e4457ad6-9fe6-46af-85db-912f5b5167ef, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e4457ad6-9fe6-46af-85db-912f5b5167ef,segment=NetworkSegment(8ffe4223-2972-4274-85b3-fbe4e0a1c649),segment_id=8ffe4223-2972-4274-85b3-fbe4e0a1c649)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:47.650570 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:47.650848 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:47.720591 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4cd1d06-8031-4839-a33c-bfda0daa1ca7 req-e72e2ab7-fad9-4a0d-a829-22c6ecafb310 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:47.722453 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4cd1d06-8031-4839-a33c-bfda0daa1ca7 req-e72e2ab7-fad9-4a0d-a829-22c6ecafb310 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=ab8299d7-c09c-426b-bd43-a7208f66c4a4 HTTP/1.1" status: 200 len: 1094 time: 0.2118382 May 12 15:14:47.732204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:47.767637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=857536b0-998d-4731-a09f-f8fca9f18d3e,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:47.780409 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:14:47.793635 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:14:47.972004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4cd1d06-8031-4839-a33c-bfda0daa1ca7 req-67100436-1d55-471f-a617-f34d27a68e4e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:47.978680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Usage tracker for resource:security_group_rule and tenant:7d73e66034f94885ae45429129883002 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:47.982180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:47.983026 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4cd1d06-8031-4839-a33c-bfda0daa1ca7 req-67100436-1d55-471f-a617-f34d27a68e4e service neutron] 10.222.0.84 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 907 time: 0.2484410 May 12 15:14:48.064901 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4cd1d06-8031-4839-a33c-bfda0daa1ca7 req-56eae80c-51ae-44ea-a783-8beb15292b42 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5fb6e0a8-b27d-442a-857d-367ef3a32588 HTTP/1.1" status: 200 len: 217 time: 0.0771358 May 12 15:14:48.067599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:48.089137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Calling delete_port for e4457ad6-9fe6-46af-85db-912f5b5167ef owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:48.154076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4cd1d06-8031-4839-a33c-bfda0daa1ca7 req-9a9ba56e-a736-4e35-b253-01d94320fc9c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:48.155603 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4cd1d06-8031-4839-a33c-bfda0daa1ca7 req-9a9ba56e-a736-4e35-b253-01d94320fc9c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.0805371 May 12 15:14:48.172795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-6c9dbc11-2b7b-499f-9593-9c82a782b2ec req-89b27d19-73c9-4a04-a77c-c93714374d95 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Deleting port 6c7de683-c224-4e59-81f7-366683517dfe {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:48.173137 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6c9dbc11-2b7b-499f-9593-9c82a782b2ec req-89b27d19-73c9-4a04-a77c-c93714374d95 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:48.208652 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4cd1d06-8031-4839-a33c-bfda0daa1ca7 req-882f1f8a-ea06-4b85-8ceb-c3672410a619 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0439339 May 12 15:14:48.223095 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63874642-b746-4fef-8171-610f60619430 req-ea38bf7a-295a-4047-891d-f7e36d6b7afb service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5622389 May 12 15:14:48.294417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] Deleting port e4457ad6-9fe6-46af-85db-912f5b5167ef {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:48.296175 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:48.387960 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:14:48.388626 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:14:48.412763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66172012-8329-4b1a-8797-607dddbd14a4 req-401b3d9b-f1b0-4298-8489-a67c2d01bd10 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:48.418793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66172012-8329-4b1a-8797-607dddbd14a4 req-401b3d9b-f1b0-4298-8489-a67c2d01bd10 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:48.424632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66172012-8329-4b1a-8797-607dddbd14a4 req-401b3d9b-f1b0-4298-8489-a67c2d01bd10 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:48.425996 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4cd1d06-8031-4839-a33c-bfda0daa1ca7 req-4bb41625-344e-422a-9002-631af3bbe25a service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2075729 May 12 15:14:48.430413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66172012-8329-4b1a-8797-607dddbd14a4 req-401b3d9b-f1b0-4298-8489-a67c2d01bd10 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:48.436880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66172012-8329-4b1a-8797-607dddbd14a4 req-401b3d9b-f1b0-4298-8489-a67c2d01bd10 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:48.442629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66172012-8329-4b1a-8797-607dddbd14a4 req-401b3d9b-f1b0-4298-8489-a67c2d01bd10 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:48.449864 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66172012-8329-4b1a-8797-607dddbd14a4 req-401b3d9b-f1b0-4298-8489-a67c2d01bd10 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:48.457402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66172012-8329-4b1a-8797-607dddbd14a4 req-401b3d9b-f1b0-4298-8489-a67c2d01bd10 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5444 time: 0.7678983 May 12 15:14:48.571355 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6c9dbc11-2b7b-499f-9593-9c82a782b2ec req-89b27d19-73c9-4a04-a77c-c93714374d95 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:48.571596 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6c9dbc11-2b7b-499f-9593-9c82a782b2ec req-89b27d19-73c9-4a04-a77c-c93714374d95 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:48.582876 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:48.598252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] For port e4457ad6-9fe6-46af-85db-912f5b5167ef, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e4457ad6-9fe6-46af-85db-912f5b5167ef,segment=NetworkSegment(8ffe4223-2972-4274-85b3-fbe4e0a1c649),segment_id=8ffe4223-2972-4274-85b3-fbe4e0a1c649)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:48.598644 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:48.607785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66172012-8329-4b1a-8797-607dddbd14a4 req-725d6a52-02ac-4c27-ac15-5fcf68405133 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1494288 May 12 15:14:48.716047 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:48.806624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] Calling delete_port for e4457ad6-9fe6-46af-85db-912f5b5167ef owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:48.820034 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4cd1d06-8031-4839-a33c-bfda0daa1ca7 req-6ce75261-eb6e-450e-8345-ded3385275a4 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3836596 May 12 15:14:48.908897 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:48.926333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-6c9dbc11-2b7b-499f-9593-9c82a782b2ec req-89b27d19-73c9-4a04-a77c-c93714374d95 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Calling delete_port for 6c7de683-c224-4e59-81f7-366683517dfe owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:14:48.953915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Deleting port e4457ad6-9fe6-46af-85db-912f5b5167ef {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:14:48.954518 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:48.959505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] Pushing event deleted for resources: {'Port': ['ID=e4457ad6-9fe6-46af-85db-912f5b5167ef,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:48.963102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-585ba49c-f9df-4766-ad4d-ba1c78a10d0a None None] No DVR routers for this DVR port e4457ad6-9fe6-46af-85db-912f5b5167ef on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:14:49.065990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 587} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:14:49.118893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cac695a8-4e75-4439-8978-1a574d6875af,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:49.132158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] The port 'e4457ad6-9fe6-46af-85db-912f5b5167ef' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:14:49.140255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:49.140603 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Added segment 75265c81-b0a3-4707-85cf-250efb72702a of type vlan for network c3c7ba99-d7de-4515-b784-ef9ce8b08726 May 12 15:14:49.335962 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:49.340325 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:49.432572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cc2308f9-d1ec-4568-bf98-60c7e336ff78']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:49.459042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8ffe4223-2972-4274-85b3-fbe4e0a1c649') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:49.459337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8ffe4223-2972-4274-85b3-fbe4e0a1c649') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:49.481442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2793cc0-04cc-4a10-a697-5f8f9969fc1d req-19ef6feb-283a-48e9-b20c-b13528220ea8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:49.483012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e2793cc0-04cc-4a10-a697-5f8f9969fc1d req-19ef6feb-283a-48e9-b20c-b13528220ea8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab8299d7-c09c-426b-bd43-a7208f66c4a4 HTTP/1.1" status: 200 len: 943 time: 0.4896197 May 12 15:14:49.491361 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:49.531559 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6c9dbc11-2b7b-499f-9593-9c82a782b2ec req-89b27d19-73c9-4a04-a77c-c93714374d95 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:49.535025 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:49.536352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:49.536898 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:49.601476 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4834ab3b-6306-4f41-81ec-4af4df1f4c1b'}, {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '857536b0-998d-4731-a09f-f8fca9f18d3e'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:49.669437 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:49.720309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89b27d19-73c9-4a04-a77c-c93714374d95 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Pushing event deleted for resources: {'Port': ['ID=6c7de683-c224-4e59-81f7-366683517dfe,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:49.747324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Releasing vlan 563 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:14:49.747859 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: timer() May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:14:49.768459 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:14:49.869768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e2793cc0-04cc-4a10-a697-5f8f9969fc1d req-8f080849-3964-49a0-96c9-d580690b14f5 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3696966 May 12 15:14:49.890030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] Pushing event updated for resources: {'Network': ['ID=c3c7ba99-d7de-4515-b784-ef9ce8b08726,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:49.901402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network c3c7ba99-d7de-4515-b784-ef9ce8b08726 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:14:49.929454 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6c9dbc11-2b7b-499f-9593-9c82a782b2ec req-89b27d19-73c9-4a04-a77c-c93714374d95 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:49.935774 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:49.941136 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:49.965535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54064) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:49.966122 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-18a0931f-4404-4c9b-9a33-9e2d79bdc614 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 878 time: 3.7494285 May 12 15:14:49.971912 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Request body: {'subnet': {'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726', 'cidr': '172.20.0.0/28', 'name': 'tempest-ImagesTestJSON-1625240882-subnet', 'tenant_id': '7d73e66034f94885ae45429129883002', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:49.977417 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6c9dbc11-2b7b-499f-9593-9c82a782b2ec req-89b27d19-73c9-4a04-a77c-c93714374d95 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:49.978873 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c9dbc11-2b7b-499f-9593-9c82a782b2ec req-89b27d19-73c9-4a04-a77c-c93714374d95 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "DELETE /v2.0/floatingips/673c7163-052c-4369-9825-9ecda9c1a91f HTTP/1.1" status: 204 len: 173 time: 2.5896115 May 12 15:14:49.983305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] Pushing event deleted for resources: {'Network': ['ID=cc2308f9-d1ec-4568-bf98-60c7e336ff78,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:49.987781 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-61fac25a-fad0-4591-908a-f755246b2b73 tempest-ServersTestMultiNic-1203572766 tempest-ServersTestMultiNic-1203572766-project] 10.222.0.82 "DELETE /v2.0/networks/cc2308f9-d1ec-4568-bf98-60c7e336ff78 HTTP/1.1" status: 204 len: 168 time: 4.3068352 May 12 15:14:49.997506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:50.006322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Usage tracker for resource:subnet and tenant:7d73e66034f94885ae45429129883002 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:50.014797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:50.025719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:50.057225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Made reservation on behalf of 7d73e66034f94885ae45429129883002 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:50.061327 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:50.286128 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 5fb6e0a8-b27d-442a-857d-367ef3a32588 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:14:50.377327 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a905c086-3503-47f2-8f62-6fe3c34cbd1a'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4834ab3b-6306-4f41-81ec-4af4df1f4c1b', 'code': 200} May 12 15:14:50.399253 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a905c086-3503-47f2-8f62-6fe3c34cbd1a'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '857536b0-998d-4731-a09f-f8fca9f18d3e', 'code': 200} May 12 15:14:50.469908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:50.579890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 5fb6e0a8-b27d-442a-857d-367ef3a32588, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=5fb6e0a8-b27d-442a-857d-367ef3a32588,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:50.597370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '5fb6e0a8-b27d-442a-857d-367ef3a32588', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'port_id': '5fb6e0a8-b27d-442a-857d-367ef3a32588', 'mac_address': 'fa:16:3e:c5:58:ea', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 558, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84c2082e-f394-46d5-8a8f-8e3a70d54fc1', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:14:50.627020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2c6ef05c-5190-47b2-bba9-0d2bdacd727d,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:50.641672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Checking segment: {'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:50.642287 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Network hostable DHCP agents. Network: c3c7ba99-d7de-4515-b784-ef9ce8b08726, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:14:50.642422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-d1fb59bf-ac01-4658-bd5c-0323dda36a13 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Synchronizing usage tracker for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:14:50.693781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c71cebf2-d9d9-4c22-98a9-54c7d56f2bc9 req-e7f6f991-e61a-44a9-8cab-2b13b01486e9 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.700551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c71cebf2-d9d9-4c22-98a9-54c7d56f2bc9 req-e7f6f991-e61a-44a9-8cab-2b13b01486e9 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.707044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c71cebf2-d9d9-4c22-98a9-54c7d56f2bc9 req-e7f6f991-e61a-44a9-8cab-2b13b01486e9 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.712560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c71cebf2-d9d9-4c22-98a9-54c7d56f2bc9 req-e7f6f991-e61a-44a9-8cab-2b13b01486e9 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.718461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c71cebf2-d9d9-4c22-98a9-54c7d56f2bc9 req-e7f6f991-e61a-44a9-8cab-2b13b01486e9 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.724588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c71cebf2-d9d9-4c22-98a9-54c7d56f2bc9 req-e7f6f991-e61a-44a9-8cab-2b13b01486e9 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.726169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54080) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:50.730557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c71cebf2-d9d9-4c22-98a9-54c7d56f2bc9 req-e7f6f991-e61a-44a9-8cab-2b13b01486e9 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.734323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'network': {'name': 'tempest-device-tagging-net1-503140033'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:50.734751 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:50.738172 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c71cebf2-d9d9-4c22-98a9-54c7d56f2bc9 req-e7f6f991-e61a-44a9-8cab-2b13b01486e9 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5444 time: 0.4483085 May 12 15:14:50.752397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:50.755268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-d1fb59bf-ac01-4658-bd5c-0323dda36a13 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Unset dirty status for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:14:50.757860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-d1fb59bf-ac01-4658-bd5c-0323dda36a13 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.224 HTTP/1.1" status: 200 len: 1001 time: 0.3483477 May 12 15:14:50.758039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5fb6e0a8-b27d-442a-857d-367ef3a32588 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:14:50.763121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:network and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:50.768126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:50.778822 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 5fb6e0a8-b27d-442a-857d-367ef3a32588, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=5fb6e0a8-b27d-442a-857d-367ef3a32588,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:50.783984 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:50.784531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Network c3c7ba99-d7de-4515-b784-ef9ce8b08726 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:14:50.788608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:50.806244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, c3c7ba99-d7de-4515-b784-ef9ce8b08726) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:50.814377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.815157 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:50.819014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Made reservation on behalf of 42581a8af83242e0bb61f84a30bd27a7 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:50.826404 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:50.849580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8682b018-91ca-4054-bebf-49cd2426167f None None] Network c3c7ba99-d7de-4515-b784-ef9ce8b08726 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:14:50.860408 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c71cebf2-d9d9-4c22-98a9-54c7d56f2bc9 req-ccc909de-c896-44fd-98d8-d06829a9e389 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1213803 May 12 15:14:50.880929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-26cecb64-f6aa-43d3-97b9-f37748872bfd tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.881532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-26cecb64-f6aa-43d3-97b9-f37748872bfd tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Synchronizing usage tracker for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:14:50.881824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa132997-4b79-4d29-afff-3a82691ef13d req-bd29cba3-10e6-47c8-b31f-e21fe9d202ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.882362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa132997-4b79-4d29-afff-3a82691ef13d req-bd29cba3-10e6-47c8-b31f-e21fe9d202ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.883041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa132997-4b79-4d29-afff-3a82691ef13d req-bd29cba3-10e6-47c8-b31f-e21fe9d202ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.883875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa132997-4b79-4d29-afff-3a82691ef13d req-bd29cba3-10e6-47c8-b31f-e21fe9d202ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.884406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa132997-4b79-4d29-afff-3a82691ef13d req-bd29cba3-10e6-47c8-b31f-e21fe9d202ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.885547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa132997-4b79-4d29-afff-3a82691ef13d req-bd29cba3-10e6-47c8-b31f-e21fe9d202ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.886437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa132997-4b79-4d29-afff-3a82691ef13d req-bd29cba3-10e6-47c8-b31f-e21fe9d202ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:50.889719 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-aa132997-4b79-4d29-afff-3a82691ef13d req-bd29cba3-10e6-47c8-b31f-e21fe9d202ce service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 6501 time: 0.3553033 May 12 15:14:50.900347 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-16b7c329-871c-4f55-9f20-9e24fafd7dd2 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 0.9332354 May 12 15:14:50.918890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-26cecb64-f6aa-43d3-97b9-f37748872bfd tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Unset dirty status for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:14:50.920255 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-26cecb64-f6aa-43d3-97b9-f37748872bfd tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/ports/c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e HTTP/1.1" status: 200 len: 942 time: 0.1552672 May 12 15:14:50.945619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 594} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:14:50.975849 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-aa132997-4b79-4d29-afff-3a82691ef13d req-f60ed130-1eed-49b6-904f-851e6ae7b19a service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=5d05f580-8d94-4f7a-847b-79c969006d42&id=f02964c6-c413-4fee-8742-d14649e5864e&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0738010 May 12 15:14:50.976883 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:50.977286 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Added segment e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357 of type vlan for network e6a7ff8f-d7ef-4614-8958-ef6026371726 May 12 15:14:51.015379 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:51.075127 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:51.085856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:51.088223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:51.152986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=5fb6e0a8-b27d-442a-857d-367ef3a32588,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:51.244010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'Network': ['ID=e6a7ff8f-d7ef-4614-8958-ef6026371726,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:51.250488 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7014d787-36a2-4eeb-ad60-5af598115b19 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 0.5207486 May 12 15:14:51.251543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54094) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:51.257600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'network': {'name': 'tempest-device-tagging-net2-1193440568'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:51.264453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:51.269139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:network and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:51.272834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:51.274694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network e6a7ff8f-d7ef-4614-8958-ef6026371726 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:14:51.280326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:51.294257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['5fb6e0a8-b27d-442a-857d-367ef3a32588'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:14:51.297657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Made reservation on behalf of 42581a8af83242e0bb61f84a30bd27a7 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:51.307838 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:51.320128 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-02758762-24c3-4525-b263-f345c0927fc6 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.224 HTTP/1.1" status: 200 len: 1001 time: 0.2113504 May 12 15:14:51.369596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 599} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:14:51.381325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:51.381920 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Added segment ed0c42e2-53e7-41f7-b08b-1540aadbe724 of type vlan for network c5f75c23-a033-42fa-b7cd-dcbda413fa9a May 12 15:14:51.432178 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:51.480704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:51.486708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:51.487376 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:51.609455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66baa6af-dcee-408c-b2b4-0da98ea03dbc req-308a65f7-4dd8-40b3-bd7d-93c561d031e8 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:51.610989 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66baa6af-dcee-408c-b2b4-0da98ea03dbc req-308a65f7-4dd8-40b3-bd7d-93c561d031e8 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.3980715 May 12 15:14:51.619299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc3ae37a-6419-4804-b17e-0fe31e7bb2a8 None None] Network c3c7ba99-d7de-4515-b784-ef9ce8b08726 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:14:51.658860 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 774 time: 0.4056168 May 12 15:14:51.665697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54100) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:51.677732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'subnet': {'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726', 'cidr': '10.1.1.0/24', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:51.697758 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-00b0a9da-347a-4395-9d25-a5de5d38db01 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:51.700168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aaa5d16-f917-4fea-ac3d-69781d631e4b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'Network': ['ID=c5f75c23-a033-42fa-b7cd-dcbda413fa9a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:51.700740 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-00b0a9da-347a-4395-9d25-a5de5d38db01 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 0.3733912 May 12 15:14:51.710975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66baa6af-dcee-408c-b2b4-0da98ea03dbc req-0c9d6350-bbc9-4c83-9d23-63389a9b3445 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0925694 May 12 15:14:51.738168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network c5f75c23-a033-42fa-b7cd-dcbda413fa9a details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:14:51.864684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:51.871584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:subnet and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:51.874941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:51.881802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:51.894219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Made reservation on behalf of 42581a8af83242e0bb61f84a30bd27a7 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:51.898959 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:51.944435 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-dde33b36-aec6-4456-8bff-ed1fad9a570d tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.224 HTTP/1.1" status: 200 len: 1001 time: 0.2320290 May 12 15:14:51.956685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-d50b61a8-ad09-416d-be59-1e8e42e6c7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Request body: {'floatingip': {'port_id': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:52.108223 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-d50b61a8-ad09-416d-be59-1e8e42e6c7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:52.159918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:52.234913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b4ab88b-0f13-45c4-a40b-5ecbd4bbe08b req-074c288b-3968-434d-abb2-c0a661af6313 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:52.234913 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b4ab88b-0f13-45c4-a40b-5ecbd4bbe08b req-074c288b-3968-434d-abb2-c0a661af6313 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab8299d7-c09c-426b-bd43-a7208f66c4a4 HTTP/1.1" status: 200 len: 944 time: 0.3634620 May 12 15:14:52.249924 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'Subnet': ['ID=722dd775-53fe-4359-9d8f-d74143e5ced9,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:52.259098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Checking segment: {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:52.262617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Network hostable DHCP agents. Network: e6a7ff8f-d7ef-4614-8958-ef6026371726, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:14:52.287450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Network e6a7ff8f-d7ef-4614-8958-ef6026371726 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:14:52.300502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, e6a7ff8f-d7ef-4614-8958-ef6026371726) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:52.305934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:52.306869 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:52.312048 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afe8db7d-78ef-4f6d-ba69-8c1d4dc25436 None None] Network e6a7ff8f-d7ef-4614-8958-ef6026371726 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:14:52.329912 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b4ab88b-0f13-45c4-a40b-5ecbd4bbe08b req-095a21f8-349c-4c51-af85-b27e7d9d13b9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0795460 May 12 15:14:52.374888 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-06905314-f469-4339-a9b7-66ed28a009e8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 0.7040324 May 12 15:14:52.377289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54108) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:52.390911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'subnet': {'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a', 'cidr': '10.2.2.0/24', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:52.657735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:52.668059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:subnet and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:52.673567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:52.681700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:52.702541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Made reservation on behalf of 42581a8af83242e0bb61f84a30bd27a7 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:52.706783 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:52.721864 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-d50b61a8-ad09-416d-be59-1e8e42e6c7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:52.731244 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-d50b61a8-ad09-416d-be59-1e8e42e6c7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:52.733648 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-d50b61a8-ad09-416d-be59-1e8e42e6c7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Floating IP 03f3fc43-1c40-4332-9857-d7ed5e3953cd disassociated. External IP: 172.25.8.224, port: c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e. May 12 15:14:52.741901 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-e6a7ff8f-d7ef-4614-8958-ef6026371726', 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'fixed_ips': [{'subnet_id': '722dd775-53fe-4359-9d8f-d74143e5ced9'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:14:52.743532 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:52.988740 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Allocated IP 10.1.1.2 (e6a7ff8f-d7ef-4614-8958-ef6026371726/722dd775-53fe-4359-9d8f-d74143e5ced9/92b1b7a4-91a0-4aea-a3ac-f070053d04b4) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:14:53.082850 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:53.160493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'Subnet': ['ID=6457d378-be74-408c-98d5-b411738c6998,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:53.192831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Checking segment: {'id': 'ed0c42e2-53e7-41f7-b08b-1540aadbe724', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:53.193534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Network hostable DHCP agents. Network: c5f75c23-a033-42fa-b7cd-dcbda413fa9a, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:14:53.197683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-bc3fd54a-edee-4429-9052-9b06fc6dbb41 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:53.198634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-bc3fd54a-edee-4429-9052-9b06fc6dbb41 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Synchronizing usage tracker for tenant:7d73e66034f94885ae45429129883002 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:14:53.218029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Network c5f75c23-a033-42fa-b7cd-dcbda413fa9a is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:14:53.230650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, c5f75c23-a033-42fa-b7cd-dcbda413fa9a) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:53.236466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:53.237345 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:53.241079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54f46e53-999d-424e-ba97-351d44cfb3be None None] Network c5f75c23-a033-42fa-b7cd-dcbda413fa9a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:14:53.267155 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-25dddaa1-3f98-4f39-9c1f-055215373877 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 0.8883529 May 12 15:14:53.270071 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54126) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:53.278222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'port': {'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726', 'name': 'tempest-TaggedBootDevicesTest-1636170293', 'fixed_ips': [{'subnet_id': '722dd775-53fe-4359-9d8f-d74143e5ced9'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:53.326240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-bc3fd54a-edee-4429-9052-9b06fc6dbb41 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Unset dirty status for tenant:7d73e66034f94885ae45429129883002 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:14:53.329886 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-bc3fd54a-edee-4429-9052-9b06fc6dbb41 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/networks?id=c3c7ba99-d7de-4515-b784-ef9ce8b08726 HTTP/1.1" status: 200 len: 805 time: 0.3991256 May 12 15:14:53.376700 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:53.403132 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Transition to ACTIVE for port object 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:53.424281 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-5e42e291-09ab-4fae-8f52-b7676335553d tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/quotas/7d73e66034f94885ae45429129883002 HTTP/1.1" status: 200 len: 375 time: 0.0381088 May 12 15:14:53.436177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-d50b61a8-ad09-416d-be59-1e8e42e6c7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:14:53.462341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Transition to ACTIVE for port object 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:53.479118 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:53.570522 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Network e6a7ff8f-d7ef-4614-8958-ef6026371726 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:53.595613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:53.597491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Pushing event updated for resources: {'Port': ['ID=92b1b7a4-91a0-4aea-a3ac-f070053d04b4,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:53.606465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:14:53.634396 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-e6eca0f8-4587-4874-aa39-6ab04f522dce tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=7d73e66034f94885ae45429129883002&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1932154 May 12 15:14:53.645948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-c5f75c23-a033-42fa-b7cd-dcbda413fa9a', 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'fixed_ips': [{'subnet_id': '6457d378-be74-408c-98d5-b411738c6998'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:14:53.646772 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:53.692893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-d1ff3f44-35a7-439f-a73d-3162020e83b8 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:14:53.695529 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-d1ff3f44-35a7-439f-a73d-3162020e83b8 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0052247 May 12 15:14:53.774050 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Attempting to bind port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:14:53.774649 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Attempting to bind port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:14:53.774777 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Attempting to bind port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 on network e6a7ff8f-d7ef-4614-8958-ef6026371726 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:53.793907 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 14, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:14:53.794286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Checking segment: {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:53.794682 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:53.795070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Bound using segment: {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:14:53.795552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Bound port: 92b1b7a4-91a0-4aea-a3ac-f070053d04b4, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:14:53.795923 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:53.884666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:53.911566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:port and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:53.919787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:53.932028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:53.968387 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-d50b61a8-ad09-416d-be59-1e8e42e6c7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:14:53.980546 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-d50b61a8-ad09-416d-be59-1e8e42e6c7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:53.981772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e45db91-63f6-48d2-ad2d-582500836071 None None] Sync routers for ids ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:14:54.003865 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Made reservation on behalf of 42581a8af83242e0bb61f84a30bd27a7 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:54.020987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e45db91-63f6-48d2-ad2d-582500836071 None None] Routers {'86f12517-ac09-4f4e-b30f-f7f1a1aa3190'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:14:54.021645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4e45db91-63f6-48d2-ad2d-582500836071 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:14:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:54.047340 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-bcabb823-42f6-4cef-879f-739aa7ae471b service neutron] 10.222.0.82 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3376143 May 12 15:14:54.084267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] For port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:54.107818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Allocated IP 10.2.2.2 (c5f75c23-a033-42fa-b7cd-dcbda413fa9a/6457d378-be74-408c-98d5-b411738c6998/d775410b-5243-4cfd-98b4-580efdd2099c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:14:54.113009 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] For port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=92b1b7a4-91a0-4aea-a3ac-f070053d04b4,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:14:54.129873 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:54.141718 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-d50b61a8-ad09-416d-be59-1e8e42e6c7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "PUT /v2.0/floatingips/03f3fc43-1c40-4332-9857-d7ed5e3953cd HTTP/1.1" status: 200 len: 695 time: 2.1893351 May 12 15:14:54.186921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'tag': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:54.346306 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:54.350316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 5fb6e0a8-b27d-442a-857d-367ef3a32588 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:54.397428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] device_id is not set on port ef28df6f-7573-4910-9fae-c2b49092303b yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:14:54.450928 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1429d63-4db7-4988-9699-edb8c37b3943 None None] Pushing event updated for resources: {'Port': ['ID=92b1b7a4-91a0-4aea-a3ac-f070053d04b4,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:54.452802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-1c946aea-4017-45e0-b4c4-46aaee8d81fe service neutron] 10.222.0.82 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3548746 May 12 15:14:54.459977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-4e45db91-63f6-48d2-ad2d-582500836071 None None] Set router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:14:54.479235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-ca2a3210-d956-4a63-8b5a-52f67ef4302b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:54.486799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-ca2a3210-d956-4a63-8b5a-52f67ef4302b service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=a687923521d64fba8b0ceae3dbf4d7d3&device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 1096 time: 0.2951670 May 12 15:14:54.734228 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 5fb6e0a8-b27d-442a-857d-367ef3a32588 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:54.818163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-ab15d742-f5b1-4082-ad51-7386d7411187 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:54.819650 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-ab15d742-f5b1-4082-ad51-7386d7411187 service neutron] 10.222.0.82 "GET /v2.0/networks?id=13bc975a-b248-4de3-b27d-6d14b7951c4b HTTP/1.1" status: 200 len: 930 time: 0.3321290 May 12 15:14:54.858275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 5fb6e0a8-b27d-442a-857d-367ef3a32588 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:54.858867 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:54.982475 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-36c2fed0-ce6b-4092-9a32-1885729921af service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e HTTP/1.1" status: 200 len: 217 time: 0.0880127 May 12 15:14:55.046846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Allocated IP 10.1.1.199 (e6a7ff8f-d7ef-4614-8958-ef6026371726/722dd775-53fe-4359-9d8f-d74143e5ced9/ef28df6f-7573-4910-9fae-c2b49092303b) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:14:55.079167 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:55.116223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-8b334c1c-d679-4714-9111-54e43cd4457d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:55.117699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-8b334c1c-d679-4714-9111-54e43cd4457d service neutron] 10.222.0.82 "GET /v2.0/subnets?id=9a114164-5df9-48f9-8806-96a06aeff952 HTTP/1.1" status: 200 len: 868 time: 0.1234698 May 12 15:14:55.147728 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Transition to ACTIVE for port object d775410b-5243-4cfd-98b4-580efdd2099c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:55.196993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-153c1b28-e4db-46a8-aa35-bb259f25d28e req-00fe15dd-22b6-4680-b9cf-61e0cdd4fc74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:55.199222 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-153c1b28-e4db-46a8-aa35-bb259f25d28e req-00fe15dd-22b6-4680-b9cf-61e0cdd4fc74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.3722885 May 12 15:14:55.253833 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Transition to ACTIVE for port object d775410b-5243-4cfd-98b4-580efdd2099c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:55.284921 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:55.335807 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:55.397315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Network c5f75c23-a033-42fa-b7cd-dcbda413fa9a is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:55.406994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:55.409632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:14:55.480414 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Pushing event updated for resources: {'Port': ['ID=d775410b-5243-4cfd-98b4-580efdd2099c,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:55.482435 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ab8299d7-c09c-426b-bd43-a7208f66c4a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5fb6e0a8-b27d-442a-857d-367ef3a32588'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:14:55.553085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-153c1b28-e4db-46a8-aa35-bb259f25d28e req-5ca7606b-d6ae-44fd-8acf-6cf55951efd4 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3289535 May 12 15:14:55.554335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 5fb6e0a8-b27d-442a-857d-367ef3a32588, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=5fb6e0a8-b27d-442a-857d-367ef3a32588,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:55.591164 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:55.598874 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4e45db91-63f6-48d2-ad2d-582500836071 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:13:36Z', 'revision_number': 4, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c04fe88c-5805-45f0-b3fd-52b35ea3fe16', 'name': '', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'mac_address': 'fa:16:3e:8e:94:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_interface', 'standard_attr_id': 963, 'fixed_ips': [{'subnet_id': '9a114164-5df9-48f9-8806-96a06aeff952', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:35Z', 'updated_at': '2022-05-12T15:13:47Z', 'revision_number': 5, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'subnets': [{'id': '9a114164-5df9-48f9-8806-96a06aeff952', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:55.644865 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-12410899-0601-43e7-b317-53353ab220a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:55.646442 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-12410899-0601-43e7-b317-53353ab220a5 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=13bc975a-b248-4de3-b27d-6d14b7951c4b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5149493 May 12 15:14:55.701312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e45db91-63f6-48d2-ad2d-582500836071 None None] Checking router: 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:14:55.749791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Attempting to bind port d775410b-5243-4cfd-98b4-580efdd2099c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:14:55.750150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Attempting to bind port d775410b-5243-4cfd-98b4-580efdd2099c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ed0c42e2-53e7-41f7-b08b-1540aadbe724', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:14:55.750510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Attempting to bind port d775410b-5243-4cfd-98b4-580efdd2099c on network c5f75c23-a033-42fa-b7cd-dcbda413fa9a {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:14:55.768324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 14, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:14:55.768823 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Checking segment: {'id': 'ed0c42e2-53e7-41f7-b08b-1540aadbe724', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:14:55.769227 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:55.769640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Bound using segment: {'id': 'ed0c42e2-53e7-41f7-b08b-1540aadbe724', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:14:55.771492 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Bound port: d775410b-5243-4cfd-98b4-580efdd2099c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ed0c42e2-53e7-41f7-b08b-1540aadbe724', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:14:55.771883 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:55.787300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e45db91-63f6-48d2-ad2d-582500836071 None None] Routers {'86f12517-ac09-4f4e-b30f-f7f1a1aa3190'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:14:55.787934 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4e45db91-63f6-48d2-ad2d-582500836071 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:14:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:55.874259 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:55.927351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Transition to ACTIVE for port object ef28df6f-7573-4910-9fae-c2b49092303b will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:55.957274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=5fb6e0a8-b27d-442a-857d-367ef3a32588,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:55.985524 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-890b1b9c-5f84-498e-a055-cabec3bc1701 service neutron] 10.222.0.82 "GET /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3149040 May 12 15:14:56.012033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7110db0-ef1b-466d-831c-1f43b5f5d5c9 None None] Network e6a7ff8f-d7ef-4614-8958-ef6026371726 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:14:56.137738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2920f2c8-92ae-4bbf-971e-b9ff63fbdf92 req-3d239e04-4d36-44b1-a3b8-51661365f319 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:56.143602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2920f2c8-92ae-4bbf-971e-b9ff63fbdf92 req-3d239e04-4d36-44b1-a3b8-51661365f319 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:56.149396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2920f2c8-92ae-4bbf-971e-b9ff63fbdf92 req-3d239e04-4d36-44b1-a3b8-51661365f319 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:56.156672 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2920f2c8-92ae-4bbf-971e-b9ff63fbdf92 req-3d239e04-4d36-44b1-a3b8-51661365f319 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:56.162661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2920f2c8-92ae-4bbf-971e-b9ff63fbdf92 req-3d239e04-4d36-44b1-a3b8-51661365f319 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:56.168933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2920f2c8-92ae-4bbf-971e-b9ff63fbdf92 req-3d239e04-4d36-44b1-a3b8-51661365f319 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:56.174743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2920f2c8-92ae-4bbf-971e-b9ff63fbdf92 req-3d239e04-4d36-44b1-a3b8-51661365f319 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:56.176690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2920f2c8-92ae-4bbf-971e-b9ff63fbdf92 req-3d239e04-4d36-44b1-a3b8-51661365f319 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5444 time: 0.3944635 May 12 15:14:56.225957 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8262f4da-0870-48a5-96eb-0bdd74e6d6b4 req-e6b17386-ebb3-4465-a687-5991e95699ee service neutron] 10.222.0.82 "GET /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2394149 May 12 15:14:56.239066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:56.251029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-4e45db91-63f6-48d2-ad2d-582500836071 None None] Set router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:14:56.301619 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2920f2c8-92ae-4bbf-971e-b9ff63fbdf92 req-1fbb3de2-b85f-4f91-80ca-66a7c36f87a4 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1094437 May 12 15:14:56.320961 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] For port d775410b-5243-4cfd-98b4-580efdd2099c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:14:56.325897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a7490d41-f8fd-495a-8095-9e1ef916698e None None] Provisioning for port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:56.351122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Network e6a7ff8f-d7ef-4614-8958-ef6026371726 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:56.355665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:56.360542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:14:56.391765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'Port': ['ID=ef28df6f-7573-4910-9fae-c2b49092303b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:56.401183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] For port d775410b-5243-4cfd-98b4-580efdd2099c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d775410b-5243-4cfd-98b4-580efdd2099c,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:14:56.444908 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:56.452909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:56.464632 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:56.565240 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-27f7296e-dc25-4a67-a511-21f135a2dc79'] response: {'name': 'network-changed', 'server_uuid': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'tag': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e', 'status': 'completed', 'code': 200} May 12 15:14:56.665494 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:56.724102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fb8ad351-d571-4583-a304-5731b3615ea5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 3.4491003 May 12 15:14:56.724412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54160) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:56.733624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'port': {'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726', 'name': 'tempest-TaggedBootDevicesTest-878431986', 'fixed_ips': [{'subnet_id': '722dd775-53fe-4359-9d8f-d74143e5ced9'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:56.862686 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1546f812-b8d0-4d43-9f6b-ec81c90656ec req-8691493e-99dc-4a6e-96e7-e2beff0893de tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=e012dc12-9257-4f1f-bf64-5f38b5e69a5f HTTP/1.1" status: 200 len: 210 time: 0.1136687 May 12 15:14:56.988286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-a82282e1-2ef0-4a75-8294-b0a40a06c2bb tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:56.989899 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-a82282e1-2ef0-4a75-8294-b0a40a06c2bb tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.76 "GET /v2.0/networks?id=c3c7ba99-d7de-4515-b784-ef9ce8b08726 HTTP/1.1" status: 200 len: 805 time: 0.5027456 May 12 15:14:57.009359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ed432e8-4e14-47a4-861e-972e7f3c3fee req-bd598528-50e7-46ee-9c04-57cd0bd3a9f5 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:57.017090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:57.021940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:port and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:57.025906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for port was recalculated. Used quota:5. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:57.030211 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ed432e8-4e14-47a4-861e-972e7f3c3fee req-bd598528-50e7-46ee-9c04-57cd0bd3a9f5 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab8299d7-c09c-426b-bd43-a7208f66c4a4 HTTP/1.1" status: 200 len: 945 time: 0.4665339 May 12 15:14:57.030879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2904b046-c184-4db9-a0e4-9e14152a03c0 None None] Pushing event updated for resources: {'Port': ['ID=d775410b-5243-4cfd-98b4-580efdd2099c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:57.034626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource port. Total usage: 5; quota limit: 500; headroom:495 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:57.056639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Made reservation on behalf of 42581a8af83242e0bb61f84a30bd27a7 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:57.087643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Request body: {'port': {'device_id': 'e012dc12-9257-4f1f-bf64-5f38b5e69a5f', 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726', 'admin_state_up': True, 'tenant_id': '7d73e66034f94885ae45429129883002'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:57.130275 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3d031998-ec87-4805-aeb3-0204619a0fdc'] response: {'server_uuid': 'ab8299d7-c09c-426b-bd43-a7208f66c4a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5fb6e0a8-b27d-442a-857d-367ef3a32588', 'code': 200} May 12 15:14:57.232645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:57.259122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:57.260604 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:57.343886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eadb7d92-933a-4919-b96c-e622f83c242e req-0eede921-a45f-4eea-9559-075352bec005 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:57.345584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eadb7d92-933a-4919-b96c-e622f83c242e req-0eede921-a45f-4eea-9559-075352bec005 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a687923521d64fba8b0ceae3dbf4d7d3&device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 1096 time: 0.7303417 May 12 15:14:57.436918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4e45db91-63f6-48d2-ad2d-582500836071 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:13:36Z', 'revision_number': 4, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c04fe88c-5805-45f0-b3fd-52b35ea3fe16', 'name': '', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'mac_address': 'fa:16:3e:8e:94:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_interface', 'standard_attr_id': 963, 'fixed_ips': [{'subnet_id': '9a114164-5df9-48f9-8806-96a06aeff952', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:35Z', 'updated_at': '2022-05-12T15:13:47Z', 'revision_number': 5, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'subnets': [{'id': '9a114164-5df9-48f9-8806-96a06aeff952', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:14:57.459141 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e45db91-63f6-48d2-ad2d-582500836071 None None] The sync data for ids ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'] in n-d-841483-1 is: [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:13:36Z', 'revision_number': 4, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c04fe88c-5805-45f0-b3fd-52b35ea3fe16', 'name': '', 'network_id': '13bc975a-b248-4de3-b27d-6d14b7951c4b', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'mac_address': 'fa:16:3e:8e:94:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_interface', 'standard_attr_id': 963, 'fixed_ips': [{'subnet_id': '9a114164-5df9-48f9-8806-96a06aeff952', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:35Z', 'updated_at': '2022-05-12T15:13:47Z', 'revision_number': 5, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'subnets': [{'id': '9a114164-5df9-48f9-8806-96a06aeff952', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:14:57.604026 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:57.639258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=92b1b7a4-91a0-4aea-a3ac-f070053d04b4,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:57.649816 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:57.671446 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ed432e8-4e14-47a4-861e-972e7f3c3fee req-27adf6ca-c064-4755-8dbe-49f903bf6a9b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6402547 May 12 15:14:57.677335 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:57.768806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] device_id is not set on port 85b4d43d-f235-4852-bda9-2dc870bb3d11 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:14:57.784945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=92b1b7a4-91a0-4aea-a3ac-f070053d04b4,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:57.865934 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-54c63845-03f7-4d1b-ac8c-b4113f8809f3 None None] Provisioning complete for port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:57.866428 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-54c63845-03f7-4d1b-ac8c-b4113f8809f3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:58.043232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f932accd-f022-4103-9a39-2028befcb009 req-e71755fe-0db0-4672-995e-fa85ad6bd1a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:58.044733 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f932accd-f022-4103-9a39-2028befcb009 req-e71755fe-0db0-4672-995e-fa85ad6bd1a5 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=ab8299d7-c09c-426b-bd43-a7208f66c4a4 HTTP/1.1" status: 200 len: 1096 time: 0.6383750 May 12 15:14:58.045373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ab7f17e-5484-4d48-9753-f6d3bf028c89 req-99f0ffc4-610c-46a7-b8f6-964b3709b2e1 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips/03f3fc43-1c40-4332-9857-d7ed5e3953cd HTTP/1.1" status: 200 len: 695 time: 0.3139379 May 12 15:14:58.205510 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f932accd-f022-4103-9a39-2028befcb009 req-d7151b02-c082-459a-9e17-452ff309a056 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0758157 May 12 15:14:58.221758 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-991cce7f-d326-4ead-95a7-9332021ecb75 None None] New status for floating IP 03f3fc43-1c40-4332-9857-d7ed5e3953cd: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:14:58.260739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-54c63845-03f7-4d1b-ac8c-b4113f8809f3 None None] Provisioning for port ef28df6f-7573-4910-9fae-c2b49092303b completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:58.271112 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-54c63845-03f7-4d1b-ac8c-b4113f8809f3 None None] Provisioning complete for port ef28df6f-7573-4910-9fae-c2b49092303b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:58.271781 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-54c63845-03f7-4d1b-ac8c-b4113f8809f3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:58.383715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:14:58.428921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Usage tracker for resource:port and tenant:7d73e66034f94885ae45429129883002 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:14:58.437340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Allocated IP 10.1.1.10 (e6a7ff8f-d7ef-4614-8958-ef6026371726/722dd775-53fe-4359-9d8f-d74143e5ced9/85b4d43d-f235-4852-bda9-2dc870bb3d11) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:14:58.440998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:14:58.476814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-54c63845-03f7-4d1b-ac8c-b4113f8809f3 None None] Port ef28df6f-7573-4910-9fae-c2b49092303b cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:14:58.477042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:14:58.532020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eadb7d92-933a-4919-b96c-e622f83c242e req-05b634c6-19b0-438d-8711-d81e2237c664 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:58.538907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eadb7d92-933a-4919-b96c-e622f83c242e req-05b634c6-19b0-438d-8711-d81e2237c664 service neutron] 10.222.0.76 "GET /v2.0/networks?id=13bc975a-b248-4de3-b27d-6d14b7951c4b HTTP/1.1" status: 200 len: 930 time: 1.1550314 May 12 15:14:58.567629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-327d47c7-d1e8-479e-88bc-a55b88d88140 None None] Network c5f75c23-a033-42fa-b7cd-dcbda413fa9a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:14:58.780786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:58.834248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:58.855904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Transition to ACTIVE for port object 85b4d43d-f235-4852-bda9-2dc870bb3d11 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:14:58.863219 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eadb7d92-933a-4919-b96c-e622f83c242e req-67cea660-5d5e-4478-944f-b8e72c18a7ce service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e HTTP/1.1" status: 200 len: 217 time: 0.2947750 May 12 15:14:58.874380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Made reservation on behalf of 7d73e66034f94885ae45429129883002 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:14:58.878566 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:58.898770 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:58.924417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d57ee2bc-20f0-479b-9b29-4a0a59b5218d None None] Provisioning for port d775410b-5243-4cfd-98b4-580efdd2099c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:58.968812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eadb7d92-933a-4919-b96c-e622f83c242e req-5375099d-fbc1-4bd5-9868-f03bea471e06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:58.970970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eadb7d92-933a-4919-b96c-e622f83c242e req-5375099d-fbc1-4bd5-9868-f03bea471e06 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=9a114164-5df9-48f9-8806-96a06aeff952 HTTP/1.1" status: 200 len: 868 time: 0.0764706 May 12 15:14:59.053679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:59.054049 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:59.063522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab7f17e-5484-4d48-9753-f6d3bf028c89 req-87eade7d-2646-4865-8c10-59a99e3c44ba tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:59.065926 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ab7f17e-5484-4d48-9753-f6d3bf028c89 req-87eade7d-2646-4865-8c10-59a99e3c44ba tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 784 time: 1.0197682 May 12 15:14:59.072636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'Port': ['ID=85b4d43d-f235-4852-bda9-2dc870bb3d11,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:14:59.101941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Network e6a7ff8f-d7ef-4614-8958-ef6026371726 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:14:59.103821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:14:59.115997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:14:59.126811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d57ee2bc-20f0-479b-9b29-4a0a59b5218d None None] Provisioning complete for port ef28df6f-7573-4910-9fae-c2b49092303b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:59.127178 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d57ee2bc-20f0-479b-9b29-4a0a59b5218d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:59.219112 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ab7f17e-5484-4d48-9753-f6d3bf028c89 req-8f327eb0-cf56-47b8-8f03-87b51286a263 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.224 HTTP/1.1" status: 200 len: 696 time: 0.1024680 May 12 15:14:59.294974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:59.297322 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:59.357860 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-40b4a207-489e-4b51-975e-bb87408b843a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 2.6311321 May 12 15:14:59.402791 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ab7f17e-5484-4d48-9753-f6d3bf028c89 req-6fec5102-a119-4c1c-89cc-64093a1bfe1c tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=172.25.8.224 HTTP/1.1" status: 200 len: 696 time: 0.1699865 May 12 15:14:59.408872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d57ee2bc-20f0-479b-9b29-4a0a59b5218d None None] Port ef28df6f-7573-4910-9fae-c2b49092303b cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:14:59.423596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c609e71-a29f-4cd7-8da6-5ca778774729 req-4c8d3225-0c05-470c-b118-be9ef3e2b58b tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:59.436548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c609e71-a29f-4cd7-8da6-5ca778774729 req-4c8d3225-0c05-470c-b118-be9ef3e2b58b tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:59.444572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c609e71-a29f-4cd7-8da6-5ca778774729 req-4c8d3225-0c05-470c-b118-be9ef3e2b58b tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:59.464095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c609e71-a29f-4cd7-8da6-5ca778774729 req-4c8d3225-0c05-470c-b118-be9ef3e2b58b tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:59.469894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c609e71-a29f-4cd7-8da6-5ca778774729 req-4c8d3225-0c05-470c-b118-be9ef3e2b58b tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:59.476733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c609e71-a29f-4cd7-8da6-5ca778774729 req-4c8d3225-0c05-470c-b118-be9ef3e2b58b tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:59.482722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c609e71-a29f-4cd7-8da6-5ca778774729 req-4c8d3225-0c05-470c-b118-be9ef3e2b58b tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:14:59.495539 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c609e71-a29f-4cd7-8da6-5ca778774729 req-4c8d3225-0c05-470c-b118-be9ef3e2b58b tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5444 time: 1.3231339 May 12 15:14:59.496594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54190) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:59.509235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d775410b-5243-4cfd-98b4-580efdd2099c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:14:59.580636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54192) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:14:59.604208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-597a0f13-e7db-4864-827e-aaa101cddaac None None] Provisioning for port 85b4d43d-f235-4852-bda9-2dc870bb3d11 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:59.613239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-597a0f13-e7db-4864-827e-aaa101cddaac None None] Provisioning complete for port 85b4d43d-f235-4852-bda9-2dc870bb3d11 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:59.613692 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-597a0f13-e7db-4864-827e-aaa101cddaac None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:59.684948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-597a0f13-e7db-4864-827e-aaa101cddaac None None] Port 85b4d43d-f235-4852-bda9-2dc870bb3d11 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:14:59.692211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port d775410b-5243-4cfd-98b4-580efdd2099c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:14:59.707068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port d775410b-5243-4cfd-98b4-580efdd2099c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:14:59.707942 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:59.723715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-386dfea8-5e31-4b72-a6e4-d3ba3c8d4380 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Request body: {'floatingip': {'port_id': '04429346-9f7d-4f32-8c65-290ee17fda8a'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:14:59.843446 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-386dfea8-5e31-4b72-a6e4-d3ba3c8d4380 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:59.907410 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:14:59.952479 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port d775410b-5243-4cfd-98b4-580efdd2099c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d775410b-5243-4cfd-98b4-580efdd2099c,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:14:59.961136 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:00.050495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-670cfa26-ac0d-49ff-ae7e-225be226f4fe None None] Provisioning complete for port d775410b-5243-4cfd-98b4-580efdd2099c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:15:00.051167 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-670cfa26-ac0d-49ff-ae7e-225be226f4fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:00.111434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-5ab7f17e-5484-4d48-9753-f6d3bf028c89 req-7e6c3663-a9e0-429b-8f5b-b61e45a249ff tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Deleting port 6a305637-db60-42b2-a986-b2b2950e083d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:00.112025 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5ab7f17e-5484-4d48-9753-f6d3bf028c89 req-7e6c3663-a9e0-429b-8f5b-b61e45a249ff tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:00.123820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=d775410b-5243-4cfd-98b4-580efdd2099c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:00.220973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eadb7d92-933a-4919-b96c-e622f83c242e req-dac5d644-3248-4d0c-a98e-23a70545005e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:00.222449 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eadb7d92-933a-4919-b96c-e622f83c242e req-dac5d644-3248-4d0c-a98e-23a70545005e service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=13bc975a-b248-4de3-b27d-6d14b7951c4b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 1.2426491 May 12 15:15:00.415962 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a52c1892-ebce-4e6c-9892-b24f063d8ebf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:00.471639 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Allocated IP 172.20.0.11 (c3c7ba99-d7de-4515-b784-ef9ce8b08726/2c6ef05c-5190-47b2-bba9-0d2bdacd727d/294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:15:00.568063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d775410b-5243-4cfd-98b4-580efdd2099c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:15:00.664418 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port d775410b-5243-4cfd-98b4-580efdd2099c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:15:00.664804 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:00.727547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ed95d8-9aae-4cb7-b98f-5c832bede0cd req-b03dbf5d-a0b3-4981-a2e9-e7f144e40968 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:00.735022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96ed95d8-9aae-4cb7-b98f-5c832bede0cd req-b03dbf5d-a0b3-4981-a2e9-e7f144e40968 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.9055846 May 12 15:15:00.934772 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5ab7f17e-5484-4d48-9753-f6d3bf028c89 req-7e6c3663-a9e0-429b-8f5b-b61e45a249ff tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:00.935076 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5ab7f17e-5484-4d48-9753-f6d3bf028c89 req-7e6c3663-a9e0-429b-8f5b-b61e45a249ff tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:00.945675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eadb7d92-933a-4919-b96c-e622f83c242e req-aa01743e-bc0b-4fbe-8d3b-ad492023775f service neutron] 10.222.0.76 "GET /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7071545 May 12 15:15:00.990062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-a52c1892-ebce-4e6c-9892-b24f063d8ebf admin admin] Deleting port 9003ae7a-c261-4797-a9b3-af884e53a88b {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:00.990623 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a52c1892-ebce-4e6c-9892-b24f063d8ebf admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:01.004603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96ed95d8-9aae-4cb7-b98f-5c832bede0cd req-b47d6f62-b3c2-4e8a-90f7-03718987127a tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2686305 May 12 15:15:01.209567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-5ab7f17e-5484-4d48-9753-f6d3bf028c89 req-7e6c3663-a9e0-429b-8f5b-b61e45a249ff tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Calling delete_port for 6a305637-db60-42b2-a986-b2b2950e083d owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:15:01.219705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-a52c1892-ebce-4e6c-9892-b24f063d8ebf admin admin] For port 9003ae7a-c261-4797-a9b3-af884e53a88b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9003ae7a-c261-4797-a9b3-af884e53a88b,segment=NetworkSegment(3155d58f-cee0-46db-bac9-2d07d9e2fa60),segment_id=3155d58f-cee0-46db-bac9-2d07d9e2fa60)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:01.220060 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a52c1892-ebce-4e6c-9892-b24f063d8ebf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:01.368208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-a52c1892-ebce-4e6c-9892-b24f063d8ebf admin admin] Calling delete_port for 9003ae7a-c261-4797-a9b3-af884e53a88b owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:15:01.549655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bbf29c4e-39c6-4bfc-851a-289c63ff2106 req-f3f90b4d-2274-4935-8de9-7bef9ab50601 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=e012dc12-9257-4f1f-bf64-5f38b5e69a5f HTTP/1.1" status: 200 len: 210 time: 0.3472722 May 12 15:15:01.708010 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eadb7d92-933a-4919-b96c-e622f83c242e req-ece5c729-957a-47a1-ad9e-bb4afa624d00 service neutron] 10.222.0.76 "GET /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7469053 May 12 15:15:01.792975 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:01.797579 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a52c1892-ebce-4e6c-9892-b24f063d8ebf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:01.848563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a52c1892-ebce-4e6c-9892-b24f063d8ebf admin admin] Pushing event deleted for resources: {'Port': ['ID=9003ae7a-c261-4797-a9b3-af884e53a88b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:01.869498 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5ab7f17e-5484-4d48-9753-f6d3bf028c89 req-7e6c3663-a9e0-429b-8f5b-b61e45a249ff tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:02.000529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e6c3663-a9e0-429b-8f5b-b61e45a249ff tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Pushing event deleted for resources: {'Port': ['ID=6a305637-db60-42b2-a986-b2b2950e083d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:02.019108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5556de3f-6ee3-4b6b-be98-c2c8242b0cae req-c1a0d41a-279c-4598-bc82-6974f451af07 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:02.022545 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5556de3f-6ee3-4b6b-be98-c2c8242b0cae req-c1a0d41a-279c-4598-bc82-6974f451af07 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab8299d7-c09c-426b-bd43-a7208f66c4a4 HTTP/1.1" status: 200 len: 945 time: 0.2690115 May 12 15:15:02.085773 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:02.141273 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5ab7f17e-5484-4d48-9753-f6d3bf028c89 req-7e6c3663-a9e0-429b-8f5b-b61e45a249ff tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:02.170606 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-386dfea8-5e31-4b72-a6e4-d3ba3c8d4380 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] It took 0.30 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:15:02.220077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a52c1892-ebce-4e6c-9892-b24f063d8ebf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:02.295811 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5ab7f17e-5484-4d48-9753-f6d3bf028c89 req-7e6c3663-a9e0-429b-8f5b-b61e45a249ff tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:02.297239 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ab7f17e-5484-4d48-9753-f6d3bf028c89 req-7e6c3663-a9e0-429b-8f5b-b61e45a249ff tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "DELETE /v2.0/floatingips/03f3fc43-1c40-4332-9857-d7ed5e3953cd HTTP/1.1" status: 204 len: 173 time: 2.7997348 May 12 15:15:02.314946 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:02.402608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Network c3c7ba99-d7de-4515-b784-ef9ce8b08726 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:15:02.428161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:15:02.430648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:15:02.452088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54208) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:02.468282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'security_group': {'name': 'tempest-securitygroup--2080200758', 'description': 'tempest-description--2102446852'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:02.632298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5556de3f-6ee3-4b6b-be98-c2c8242b0cae req-ec1fb296-6306-49a2-9486-9bc16a818845 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5137937 May 12 15:15:02.634125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:02.642639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:security_group and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:02.649204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:02.659179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:02.687516 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:02.708784 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-70b0ad82-e310-4433-add1-0ace5a742f47 req-d23e9d0c-49da-49e6-8cd1-133de8f51d25 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.3642402 May 12 15:15:02.783693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Pushing event updated for resources: {'Port': ['ID=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:02.794819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:02.795442 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:02.831796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:02.848296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:security_group_rule and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:02.855527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:02.907966 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-386dfea8-5e31-4b72-a6e4-d3ba3c8d4380 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:02.918716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:02.974097 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-82dfc859-2125-465c-ba8a-4e71b2da8fd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 5.9037066 May 12 15:15:02.974860 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-386dfea8-5e31-4b72-a6e4-d3ba3c8d4380 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:03.016980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b0ad82-e310-4433-add1-0ace5a742f47 req-f42abc98-7c0b-4ac1-96a7-122e4ba79220 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:03.020288 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-70b0ad82-e310-4433-add1-0ace5a742f47 req-f42abc98-7c0b-4ac1-96a7-122e4ba79220 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 1097 time: 0.2624931 May 12 15:15:03.035141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a52c1892-ebce-4e6c-9892-b24f063d8ebf admin admin] Router 56048083-24ed-41eb-868c-2140c7b486c8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:15:03.073136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Request body: {'port': {'device_id': 'e012dc12-9257-4f1f-bf64-5f38b5e69a5f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:03.142875 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:03.158786 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:03.322608 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:03.376824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'SecurityGroup': ['ID=98320268-f290-4c75-8a2a-57916de87f04,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:03.391297 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:03.393833 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-96557fce-7c0f-48ec-a1ed-f9b15c607a5c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1782 time: 0.9404812 May 12 15:15:03.401730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54234) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:03.427639 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b2eacc69-8165-474b-a3b4-c53dfc80e0d9 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'security_group_rule': {'security_group_id': '98320268-f290-4c75-8a2a-57916de87f04', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:03.431514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b0ad82-e310-4433-add1-0ace5a742f47 req-c644936a-95f6-4b9d-936d-a3cf6fbeae70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:03.433523 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-70b0ad82-e310-4433-add1-0ace5a742f47 req-c644936a-95f6-4b9d-936d-a3cf6fbeae70 service neutron] 10.222.0.84 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 907 time: 0.3758659 May 12 15:15:03.434494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b2eacc69-8165-474b-a3b4-c53dfc80e0d9 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:03.436636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a52c1892-ebce-4e6c-9892-b24f063d8ebf admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:15:03.442083 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a52c1892-ebce-4e6c-9892-b24f063d8ebf admin admin] 10.222.0.82 "PUT /v2.0/routers/56048083-24ed-41eb-868c-2140c7b486c8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8601308 May 12 15:15:03.446373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7060eb-5af1-4411-93d1-74847b462c27 req-f60142f8-a35d-491d-a3f6-2da73de6504e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:03.447865 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a7060eb-5af1-4411-93d1-74847b462c27 req-f60142f8-a35d-491d-a3f6-2da73de6504e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.7458265 May 12 15:15:03.449832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12395743-b3be-4a6a-a93b-35deb3f92893 None None] Sync routers for ids ['56048083-24ed-41eb-868c-2140c7b486c8'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:15:03.451871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54238) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:03.457696 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-386dfea8-5e31-4b72-a6e4-d3ba3c8d4380 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Floating IP b8015aab-2a22-4ed4-8692-3f7185b4feae associated. External IP: 172.25.8.175, port: 04429346-9f7d-4f32-8c65-290ee17fda8a. May 12 15:15:03.466564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12395743-b3be-4a6a-a93b-35deb3f92893 None None] Routers {'56048083-24ed-41eb-868c-2140c7b486c8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:15:03.467904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-12395743-b3be-4a6a-a93b-35deb3f92893 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:14:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['56048083-24ed-41eb-868c-2140c7b486c8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:03.512229 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-70b0ad82-e310-4433-add1-0ace5a742f47 req-d282cc29-2891-43ba-ba31-cdf5d67b136c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f0d25bc9-ee34-4065-92d8-0ccb85b91668 HTTP/1.1" status: 200 len: 217 time: 0.0688691 May 12 15:15:03.533348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b2eacc69-8165-474b-a3b4-c53dfc80e0d9 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:security_group_rule and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:03.592144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b2eacc69-8165-474b-a3b4-c53dfc80e0d9 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:03.606698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b0ad82-e310-4433-add1-0ace5a742f47 req-48c1bdfc-a1a8-47e4-be2f-f17091a7b2b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:03.608193 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-70b0ad82-e310-4433-add1-0ace5a742f47 req-48c1bdfc-a1a8-47e4-be2f-f17091a7b2b1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.0888584 May 12 15:15:03.629422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b2eacc69-8165-474b-a3b4-c53dfc80e0d9 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:03.678338 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-70b0ad82-e310-4433-add1-0ace5a742f47 req-19a424ea-49c8-4b9e-b8b6-04860aecf336 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0635247 May 12 15:15:03.706070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1d3a146-4839-445e-ab2f-cf4987eb030f req-0454d815-4f62-461d-beb7-bea5af19b5b0 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:03.707164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b1d3a146-4839-445e-ab2f-cf4987eb030f req-0454d815-4f62-461d-beb7-bea5af19b5b0 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Synchronizing usage tracker for tenant:7d73e66034f94885ae45429129883002 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:15:03.733126 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-12395743-b3be-4a6a-a93b-35deb3f92893 None None] Set router 56048083-24ed-41eb-868c-2140c7b486c8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:15:03.795857 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:15:03.890030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a7060eb-5af1-4411-93d1-74847b462c27 req-baf0c7ed-eb78-4076-ba18-dda16f6ef787 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3699343 May 12 15:15:03.952560 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-70b0ad82-e310-4433-add1-0ace5a742f47 req-fe6d558f-1543-4526-b31e-c81c77cdcbd6 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2663906 May 12 15:15:03.959863 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2eacc69-8165-474b-a3b4-c53dfc80e0d9 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:03.994302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b1d3a146-4839-445e-ab2f-cf4987eb030f req-0454d815-4f62-461d-beb7-bea5af19b5b0 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Unset dirty status for tenant:7d73e66034f94885ae45429129883002 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:15:03.996063 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1d3a146-4839-445e-ab2f-cf4987eb030f req-0454d815-4f62-461d-beb7-bea5af19b5b0 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=e012dc12-9257-4f1f-bf64-5f38b5e69a5f HTTP/1.1" status: 200 len: 932 time: 1.1274359 May 12 15:15:04.178133 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:04.244157 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-70b0ad82-e310-4433-add1-0ace5a742f47 req-6a24cb73-9449-42f3-b10e-00be277ad873 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2825491 May 12 15:15:04.409600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-12395743-b3be-4a6a-a93b-35deb3f92893 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '56048083-24ed-41eb-868c-2140c7b486c8', 'name': 'tempest-ServersTestMultiNic-309743523-router', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34'}], 'enable_snat': True}, 'gw_port_id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:47Z', 'updated_at': '2022-05-12T15:15:01Z', 'revision_number': 5, 'project_id': '1aea6927c780448b89ddf44ec6bcb186', 'gw_port': {'id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '56048083-24ed-41eb-868c-2140c7b486c8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 857, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:51Z', 'updated_at': '2022-05-12T15:12:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:04.419569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12395743-b3be-4a6a-a93b-35deb3f92893 None None] Checking router: 56048083-24ed-41eb-868c-2140c7b486c8 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:15:04.438709 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12395743-b3be-4a6a-a93b-35deb3f92893 None None] Routers {'56048083-24ed-41eb-868c-2140c7b486c8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:15:04.439598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-12395743-b3be-4a6a-a93b-35deb3f92893 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:14:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['56048083-24ed-41eb-868c-2140c7b486c8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:04.561849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b1d3a146-4839-445e-ab2f-cf4987eb030f req-329b718a-9c3f-4283-9665-ef6dc47c1952 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Synchronizing usage tracker for tenant:7d73e66034f94885ae45429129883002 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:15:04.685841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-12395743-b3be-4a6a-a93b-35deb3f92893 None None] Set router 56048083-24ed-41eb-868c-2140c7b486c8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:15:04.702361 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2eacc69-8165-474b-a3b4-c53dfc80e0d9 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:04.794504 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2eacc69-8165-474b-a3b4-c53dfc80e0d9 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:04.825351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b1d3a146-4839-445e-ab2f-cf4987eb030f req-329b718a-9c3f-4283-9665-ef6dc47c1952 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Unset dirty status for tenant:7d73e66034f94885ae45429129883002 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:15:04.826025 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1d3a146-4839-445e-ab2f-cf4987eb030f req-329b718a-9c3f-4283-9665-ef6dc47c1952 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7955055 May 12 15:15:04.864125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2eacc69-8165-474b-a3b4-c53dfc80e0d9 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e9466771-7d87-458e-b246-22d3b770c1cc,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:04.899000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac76c4fa-7388-42b3-a543-aed3a29577f5 req-8d51f355-e63c-4f3a-92b0-7425db8460b9 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:04.900195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ac76c4fa-7388-42b3-a543-aed3a29577f5 req-8d51f355-e63c-4f3a-92b0-7425db8460b9 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Synchronizing usage tracker for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:15:04.908963 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2eacc69-8165-474b-a3b4-c53dfc80e0d9 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:04.912446 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b2eacc69-8165-474b-a3b4-c53dfc80e0d9 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.5042627 May 12 15:15:04.914522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54256) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:04.914644 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:04.920991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-01cfa25f-ba30-4aa0-983c-7b7273c78dcb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'security_group_rule': {'security_group_id': '98320268-f290-4c75-8a2a-57916de87f04', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:04.935635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-01cfa25f-ba30-4aa0-983c-7b7273c78dcb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:04.945621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-01cfa25f-ba30-4aa0-983c-7b7273c78dcb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:security_group_rule and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:04.953141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-01cfa25f-ba30-4aa0-983c-7b7273c78dcb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:04.970874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-386dfea8-5e31-4b72-a6e4-d3ba3c8d4380 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Router be64a9da-126d-4279-98a4-e0a9cc891b26 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:15:04.990212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] Deleting port fe3707b0-af9e-4644-80d0-b3821d828b3d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:04.990212 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:04.992155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-01cfa25f-ba30-4aa0-983c-7b7273c78dcb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:05.034744 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-01cfa25f-ba30-4aa0-983c-7b7273c78dcb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:05.098302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ac76c4fa-7388-42b3-a543-aed3a29577f5 req-8d51f355-e63c-4f3a-92b0-7425db8460b9 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Unset dirty status for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:15:05.098302 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac76c4fa-7388-42b3-a543-aed3a29577f5 req-8d51f355-e63c-4f3a-92b0-7425db8460b9 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/ports?device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.9858663 May 12 15:15:05.149484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:05.275455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-01cfa25f-ba30-4aa0-983c-7b7273c78dcb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:05.289832 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-01cfa25f-ba30-4aa0-983c-7b7273c78dcb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:05.295757 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:05.303774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-12395743-b3be-4a6a-a93b-35deb3f92893 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '56048083-24ed-41eb-868c-2140c7b486c8', 'name': 'tempest-ServersTestMultiNic-309743523-router', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34'}], 'enable_snat': True}, 'gw_port_id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:47Z', 'updated_at': '2022-05-12T15:15:01Z', 'revision_number': 5, 'project_id': '1aea6927c780448b89ddf44ec6bcb186', 'gw_port': {'id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '56048083-24ed-41eb-868c-2140c7b486c8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 857, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:51Z', 'updated_at': '2022-05-12T15:12:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:05.318677 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12395743-b3be-4a6a-a93b-35deb3f92893 None None] The sync data for ids ['56048083-24ed-41eb-868c-2140c7b486c8'] in n-d-841483-1 is: [{'id': '56048083-24ed-41eb-868c-2140c7b486c8', 'name': 'tempest-ServersTestMultiNic-309743523-router', 'tenant_id': '1aea6927c780448b89ddf44ec6bcb186', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34'}], 'enable_snat': True}, 'gw_port_id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:47Z', 'updated_at': '2022-05-12T15:15:01Z', 'revision_number': 5, 'project_id': '1aea6927c780448b89ddf44ec6bcb186', 'gw_port': {'id': 'fe3707b0-af9e-4644-80d0-b3821d828b3d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '56048083-24ed-41eb-868c-2140c7b486c8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 857, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:51Z', 'updated_at': '2022-05-12T15:12:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:15:05.333320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01cfa25f-ba30-4aa0-983c-7b7273c78dcb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8ab2307a-2eef-455c-98f1-c1b7e62ab946,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:05.339931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ac76c4fa-7388-42b3-a543-aed3a29577f5 req-4838d89e-7517-4ab4-a436-ce154ea8c400 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Synchronizing usage tracker for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:15:05.349654 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-01cfa25f-ba30-4aa0-983c-7b7273c78dcb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:05.349869 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-01cfa25f-ba30-4aa0-983c-7b7273c78dcb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4346955 May 12 15:15:05.355665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54274) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:05.362798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:05.385496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:05.385496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:floatingip and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:05.394595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:05.394595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:05.415408 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:05.465674 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Transition to ACTIVE for port object 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:05.490893 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:05.623958 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:05.628344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ac76c4fa-7388-42b3-a543-aed3a29577f5 req-4838d89e-7517-4ab4-a436-ce154ea8c400 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Unset dirty status for tenant:a687923521d64fba8b0ceae3dbf4d7d3 on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:15:05.629526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac76c4fa-7388-42b3-a543-aed3a29577f5 req-4838d89e-7517-4ab4-a436-ce154ea8c400 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=0.0.0.0 HTTP/1.1" status: 200 len: 217 time: 0.4143035 May 12 15:15:05.814315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46adc42a-5fdd-4753-a945-dc4600919abe req-7a4f3bad-437e-4c11-8773-382fd75201fc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:05.815771 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46adc42a-5fdd-4753-a945-dc4600919abe req-7a4f3bad-437e-4c11-8773-382fd75201fc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.7959573 May 12 15:15:05.848973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Allocated IP 172.25.8.64 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/a791c1da-d5c6-42db-89a7-413eb8230f3b) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:15:05.912073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Pushing event updated for resources: {'Port': ['ID=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:05.928870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-386dfea8-5e31-4b72-a6e4-d3ba3c8d4380 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:15:05.943567 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c357e954-2d72-4291-b302-9c98581a8f81 None None] Sync routers for ids ['be64a9da-126d-4279-98a4-e0a9cc891b26'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:15:05.949644 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-386dfea8-5e31-4b72-a6e4-d3ba3c8d4380 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:05.962431 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c357e954-2d72-4291-b302-9c98581a8f81 None None] Routers {'be64a9da-126d-4279-98a4-e0a9cc891b26'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:15:05.963042 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c357e954-2d72-4291-b302-9c98581a8f81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:14:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['be64a9da-126d-4279-98a4-e0a9cc891b26'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:06.002639 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46adc42a-5fdd-4753-a945-dc4600919abe req-035b441e-33c5-435e-b37b-98b3942f9f1c tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/quotas/593ec496e5db4078be8dc940596be321 HTTP/1.1" status: 200 len: 375 time: 0.1742640 May 12 15:15:06.006835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] For port fe3707b0-af9e-4644-80d0-b3821d828b3d, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fe3707b0-af9e-4644-80d0-b3821d828b3d,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:06.007197 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:06.202092 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-c357e954-2d72-4291-b302-9c98581a8f81 None None] Set router be64a9da-126d-4279-98a4-e0a9cc891b26 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:15:06.216454 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:06.257735 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:06.358230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:15:06.366653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:15:06.370725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] Calling delete_port for fe3707b0-af9e-4644-80d0-b3821d828b3d owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:15:06.407263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'Port': ['ID=a791c1da-d5c6-42db-89a7-413eb8230f3b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:06.418338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:15:06.459457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-386dfea8-5e31-4b72-a6e4-d3ba3c8d4380 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "PUT /v2.0/floatingips/b8015aab-2a22-4ed4-8692-3f7185b4feae HTTP/1.1" status: 200 len: 991 time: 6.8536143 May 12 15:15:06.467435 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': '04429346-9f7d-4f32-8c65-290ee17fda8a'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:06.491702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Attempting to bind port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:15:06.492037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Attempting to bind port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:15:06.492367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Attempting to bind port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c on network c3c7ba99-d7de-4515-b784-ef9ce8b08726 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:06.497073 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9003ae7a-c261-4797-a9b3-af884e53a88b no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:15:06.541121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:06.546660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 9003ae7a-c261-4797-a9b3-af884e53a88b {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:15:06.547011 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9003ae7a-c261-4797-a9b3-af884e53a88b not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:15:06.619102 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:06.653643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c on network c3c7ba99-d7de-4515-b784-ef9ce8b08726 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:15:06.654718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Attempting to bind port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c on network c3c7ba99-d7de-4515-b784-ef9ce8b08726 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:06.679704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d2966d-b41e-4b02-99f2-6c3037496e20 req-8be1d513-748a-46df-91f5-6e5aba8fd9df tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:06.687463 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04d2966d-b41e-4b02-99f2-6c3037496e20 req-8be1d513-748a-46df-91f5-6e5aba8fd9df tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.8908999 May 12 15:15:06.699044 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c357e954-2d72-4291-b302-9c98581a8f81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:11:55Z', 'revision_number': 4, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'b8015aab-2a22-4ed4-8692-3f7185b4feae', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'floating_ip_address': '172.25.8.175', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'port_id': '04429346-9f7d-4f32-8c65-290ee17fda8a', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 922, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'mac_address': 'fa:16:3e:87:09:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:13:02Z', 'updated_at': '2022-05-12T15:15:01Z', 'revision_number': 1, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '60462079-9a62-4718-a485-d1d0aa343c39', 'name': '', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'mac_address': 'fa:16:3e:09:47:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_interface', 'standard_attr_id': 861, 'fixed_ips': [{'subnet_id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:53Z', 'updated_at': '2022-05-12T15:12:06Z', 'revision_number': 5, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'subnets': [{'id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:06.709471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:15:06.709703 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c357e954-2d72-4291-b302-9c98581a8f81 None None] Checking router: be64a9da-126d-4279-98a4-e0a9cc891b26 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:15:06.710221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Checking segment: {'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:15:06.710784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Bound using segment: {'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:15:06.711566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Bound port: 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:15:06.712106 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:06.732380 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c357e954-2d72-4291-b302-9c98581a8f81 None None] Routers {'be64a9da-126d-4279-98a4-e0a9cc891b26'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:15:06.733007 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c357e954-2d72-4291-b302-9c98581a8f81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:14:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['be64a9da-126d-4279-98a4-e0a9cc891b26'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:06.827227 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46adc42a-5fdd-4753-a945-dc4600919abe req-10311121-5d28-4b13-917e-45a4daff6ed4 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&fields=id HTTP/1.1" status: 200 len: 302 time: 0.8016074 May 12 15:15:06.843549 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04d2966d-b41e-4b02-99f2-6c3037496e20 req-c0a75cf7-551a-47b3-968a-738cb3ece71a tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1548333 May 12 15:15:06.912766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:06.919611 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:06.973592 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6645363-f10e-47af-8a5f-8cc1312b125b req-e2fcd4b3-9273-4331-aa6b-83ce36bfaaa7 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/floatingips?floating_ip_address=0.0.0.0 HTTP/1.1" status: 200 len: 217 time: 0.0762527 May 12 15:15:07.043310 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-c357e954-2d72-4291-b302-9c98581a8f81 None None] Set router be64a9da-126d-4279-98a4-e0a9cc891b26 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:15:07.133049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'Port': ['ID=a791c1da-d5c6-42db-89a7-413eb8230f3b,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:07.153011 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:07.164671 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46adc42a-5fdd-4753-a945-dc4600919abe req-a6ea0325-d944-46f0-bbff-daf85aa20e0e service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3135307 May 12 15:15:07.182111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:07.192678 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8125ccaf-8464-4459-9a14-62c6657dc84a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.8367624 May 12 15:15:07.270306 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:07.385530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] For port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:15:07.397628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] For port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:15:07.426932 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:07.439472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] Pushing event deleted for resources: {'Port': ['ID=fe3707b0-af9e-4644-80d0-b3821d828b3d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:07.507871 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c357e954-2d72-4291-b302-9c98581a8f81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:11:55Z', 'revision_number': 4, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'b8015aab-2a22-4ed4-8692-3f7185b4feae', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'floating_ip_address': '172.25.8.175', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'port_id': '04429346-9f7d-4f32-8c65-290ee17fda8a', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 922, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'mac_address': 'fa:16:3e:87:09:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:13:02Z', 'updated_at': '2022-05-12T15:15:01Z', 'revision_number': 1, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '60462079-9a62-4718-a485-d1d0aa343c39', 'name': '', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'mac_address': 'fa:16:3e:09:47:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_interface', 'standard_attr_id': 861, 'fixed_ips': [{'subnet_id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:53Z', 'updated_at': '2022-05-12T15:12:06Z', 'revision_number': 5, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'subnets': [{'id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:07.515503 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c357e954-2d72-4291-b302-9c98581a8f81 None None] The sync data for ids ['be64a9da-126d-4279-98a4-e0a9cc891b26'] in n-d-841483-1 is: [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:11:55Z', 'revision_number': 4, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'b8015aab-2a22-4ed4-8692-3f7185b4feae', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'floating_ip_address': '172.25.8.175', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'port_id': '04429346-9f7d-4f32-8c65-290ee17fda8a', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 922, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'mac_address': 'fa:16:3e:87:09:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86573116-6413-4a6b-9619-662f524d2cc3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:13:02Z', 'updated_at': '2022-05-12T15:15:01Z', 'revision_number': 1, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '60462079-9a62-4718-a485-d1d0aa343c39', 'name': '', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'mac_address': 'fa:16:3e:09:47:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_interface', 'standard_attr_id': 861, 'fixed_ips': [{'subnet_id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:53Z', 'updated_at': '2022-05-12T15:12:06Z', 'revision_number': 5, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'subnets': [{'id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:15:07.617785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:07.618400 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:07.619923 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] 10.222.0.76 "PUT /v2.0/ports/294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c HTTP/1.1" status: 200 len: 1092 time: 4.5547626 May 12 15:15:07.759940 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:07.774385 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8dcd17a-368e-4271-abc9-915a386a4af5 None None] New status for floating IP b8015aab-2a22-4ed4-8692-3f7185b4feae: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:15:07.815174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbdeed69-9b63-4da8-a263-3b5d010a7c83 service neutron] Pushing event updated for resources: {'Port': ['ID=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:07.841538 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46adc42a-5fdd-4753-a945-dc4600919abe req-641e7e5b-efe1-4b11-8b20-e11aaea25ba6 service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6000068 May 12 15:15:08.149814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d5daf54-7b3b-4fc2-9670-a7e0cef131e2 req-e1d57eab-2df5-430e-af71-3a3f34594a93 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:08.159018 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d5daf54-7b3b-4fc2-9670-a7e0cef131e2 req-e1d57eab-2df5-430e-af71-3a3f34594a93 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=e012dc12-9257-4f1f-bf64-5f38b5e69a5f HTTP/1.1" status: 200 len: 944 time: 0.9818523 May 12 15:15:08.360392 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:08.365989 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:08.383540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-cbc9a920-3476-47c1-ac00-21f8f8ff1a02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:08.384141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-cbc9a920-3476-47c1-ac00-21f8f8ff1a02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:08.384479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-cbc9a920-3476-47c1-ac00-21f8f8ff1a02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:08.385061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-cbc9a920-3476-47c1-ac00-21f8f8ff1a02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:08.385624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-cbc9a920-3476-47c1-ac00-21f8f8ff1a02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:08.386602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-cbc9a920-3476-47c1-ac00-21f8f8ff1a02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:08.387083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-cbc9a920-3476-47c1-ac00-21f8f8ff1a02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:08.389083 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-cbc9a920-3476-47c1-ac00-21f8f8ff1a02 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=05b4f1ce61294fb29efb0a765ed28561&device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 6501 time: 0.2128589 May 12 15:15:08.407880 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8992f288-4c9d-4afd-b1d2-9a8180d585d2'] response: {'name': 'network-changed', 'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'tag': '04429346-9f7d-4f32-8c65-290ee17fda8a', 'status': 'completed', 'code': 200} May 12 15:15:08.443169 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:08.443617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 56048083-24ed-41eb-868c-2140c7b486c8 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:15:08.464606 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d5daf54-7b3b-4fc2-9670-a7e0cef131e2 req-e409b5f0-61e5-42f1-b752-b27e55f1f3bd tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3049335 May 12 15:15:08.484798 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:08.486298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5c0ec7db-84cb-46e3-a0c3-4e7b0c070df7 admin admin] 10.222.0.82 "DELETE /v2.0/routers/56048083-24ed-41eb-868c-2140c7b486c8 HTTP/1.1" status: 204 len: 168 time: 5.0316639 May 12 15:15:08.490224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54310) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:08.589353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-9b0495b9-a570-45c1-9e71-806f04d001aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:08.592321 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-9b0495b9-a570-45c1-9e71-806f04d001aa service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=7d73e66034f94885ae45429129883002&device_id=e012dc12-9257-4f1f-bf64-5f38b5e69a5f HTTP/1.1" status: 200 len: 1095 time: 0.9219980 May 12 15:15:08.810655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-98e9eeb3-fbfe-41c6-920f-05d8006d063c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:08.816772 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-98e9eeb3-fbfe-41c6-920f-05d8006d063c service neutron] 10.222.0.84 "GET /v2.0/networks?id=13468259-dd20-42ac-88ec-2614ebea6ccc HTTP/1.1" status: 200 len: 918 time: 0.4118857 May 12 15:15:08.821058 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-44668ab4-8df1-4dd3-a9d5-d8338605e45b service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c HTTP/1.1" status: 200 len: 217 time: 0.2169073 May 12 15:15:08.998259 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f0f8faa6-d353-46be-9798-5b240eaa446d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--2080200758&fields=id&tenant_id=42581a8af83242e0bb61f84a30bd27a7 HTTP/1.1" status: 200 len: 267 time: 0.2625184 May 12 15:15:09.001764 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-4adc4c5f-92e2-4bf9-8911-910fc9df6242 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=04429346-9f7d-4f32-8c65-290ee17fda8a HTTP/1.1" status: 200 len: 1001 time: 0.1759710 May 12 15:15:09.051121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-4dd8d11e-5480-4627-a946-f5b590946e09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:09.053587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-4dd8d11e-5480-4627-a946-f5b590946e09 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2c6ef05c-5190-47b2-bba9-0d2bdacd727d HTTP/1.1" status: 200 len: 845 time: 0.2181284 May 12 15:15:09.071857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-bb43f2f5-7658-46e7-98fc-d57ab1f62765 admin admin] Deleting subnet 005ae052-6cd6-4ddc-833f-af6e1c2bff40 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:15:09.085513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-ebb85fc8-edfe-4f74-a73d-af69b5c0e301 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:09.087231 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-ebb85fc8-edfe-4f74-a73d-af69b5c0e301 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4ecb64d7-7b16-437b-8f3e-4996d58043f6 HTTP/1.1" status: 200 len: 856 time: 0.0789557 May 12 15:15:09.131358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-674058d9-613e-4b29-b8b0-063368924d09 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:09.132065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-674058d9-613e-4b29-b8b0-063368924d09 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Synchronizing usage tracker for tenant:42581a8af83242e0bb61f84a30bd27a7 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:15:09.168647 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb43f2f5-7658-46e7-98fc-d57ab1f62765 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:09.180255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-5aa70d42-e9da-4941-b8e7-dd76d92756b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:09.182128 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-5aa70d42-e9da-4941-b8e7-dd76d92756b7 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=13468259-dd20-42ac-88ec-2614ebea6ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0892277 May 12 15:15:09.263504 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-dc2c7da9-0971-4ded-bc10-670c1db081e3 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=c3c7ba99-d7de-4515-b784-ef9ce8b08726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1829717 May 12 15:15:09.330352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-674058d9-613e-4b29-b8b0-063368924d09 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Unset dirty status for tenant:42581a8af83242e0bb61f84a30bd27a7 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:15:09.331556 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-674058d9-613e-4b29-b8b0-063368924d09 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports/ef28df6f-7573-4910-9fae-c2b49092303b HTTP/1.1" status: 200 len: 932 time: 0.3321862 May 12 15:15:09.336666 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb43f2f5-7658-46e7-98fc-d57ab1f62765 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:09.406185 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-e11a4443-49f1-4912-ba78-7710e92fe297 service neutron] 10.222.0.84 "GET /v2.0/networks/13468259-dd20-42ac-88ec-2614ebea6ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2167156 May 12 15:15:09.496617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc78f0a2-cc62-4a7b-8991-d3cb926c135d req-26ac3f8d-df66-44fa-8468-d1f4d8f3bded tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:09.498102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc78f0a2-cc62-4a7b-8991-d3cb926c135d req-26ac3f8d-df66-44fa-8468-d1f4d8f3bded tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.7314022 May 12 15:15:09.549777 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2448de32-7f76-44bf-89ab-5c8aa89e9d82 req-3de65cf5-e374-47d3-bf72-e30132ca8b19 service neutron] 10.222.0.84 "GET /v2.0/networks/13468259-dd20-42ac-88ec-2614ebea6ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1353250 May 12 15:15:09.602198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-0392d467-c869-48a2-8a15-f84a49d369ea tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:09.603411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-0392d467-c869-48a2-8a15-f84a49d369ea tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports/85b4d43d-f235-4852-bda9-2dc870bb3d11 HTTP/1.1" status: 200 len: 930 time: 0.1730483 May 12 15:15:09.672967 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc78f0a2-cc62-4a7b-8991-d3cb926c135d req-35c2249a-dc33-4d64-bbf7-dc5edad663f6 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1609230 May 12 15:15:09.674776 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-c1d74005-8af6-4f2a-871f-cf139978907d service neutron] 10.222.0.76 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3910055 May 12 15:15:09.685457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-dd331411-26a7-45d9-9614-37f945ff75fb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?network_id=c5f75c23-a033-42fa-b7cd-dcbda413fa9a&fixed_ips=ip_address%3D10.2.2.100&fields=device_id HTTP/1.1" status: 200 len: 210 time: 0.0694294 May 12 15:15:09.758144 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-da124c11-aba8-4615-a4e8-b5913a08fc30 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?network_id=c5f75c23-a033-42fa-b7cd-dcbda413fa9a&fixed_ips=ip_address%3D10.2.2.200&fields=device_id HTTP/1.1" status: 200 len: 210 time: 0.0525892 May 12 15:15:09.819702 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb43f2f5-7658-46e7-98fc-d57ab1f62765 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:10.002516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46adc42a-5fdd-4753-a945-dc4600919abe req-b0013caf-548e-4032-924b-ae42bf74f12e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:10.004295 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-46adc42a-5fdd-4753-a945-dc4600919abe req-b0013caf-548e-4032-924b-ae42bf74f12e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.1549492 May 12 15:15:10.019601 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85b5a8be-ce22-44c7-93f3-5af0c60d7909 req-7402eaec-2db5-4d47-8d52-9b050f451dfc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b HTTP/1.1" status: 200 len: 210 time: 0.2084248 May 12 15:15:10.024552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Request body: {'port': {'device_id': 'a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'admin_state_up': True, 'tenant_id': '593ec496e5db4078be8dc940596be321'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:10.174631 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f92ba86b-aa70-4459-8b31-4aaa5d532651 req-273bbe9d-0104-4fe6-ad93-8ed6fa32a685 service neutron] 10.222.0.76 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4923978 May 12 15:15:10.309889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:10.314124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Usage tracker for resource:port and tenant:593ec496e5db4078be8dc940596be321 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:10.317952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:10.326358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:10.335613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Made reservation on behalf of 593ec496e5db4078be8dc940596be321 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:15:10.339238 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:10.372264 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb43f2f5-7658-46e7-98fc-d57ab1f62765 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:10.409426 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-c27c9f23-7413-4ef3-8034-28b955e82700 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:10.415177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-c27c9f23-7413-4ef3-8034-28b955e82700 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:10.421688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-c27c9f23-7413-4ef3-8034-28b955e82700 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:10.423257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-c27c9f23-7413-4ef3-8034-28b955e82700 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/networks?id=939fdac4-3043-4213-bd31-a421a6c659bc&id=e6a7ff8f-d7ef-4614-8958-ef6026371726&id=e6a7ff8f-d7ef-4614-8958-ef6026371726&id=c5f75c23-a033-42fa-b7cd-dcbda413fa9a&id=c5f75c23-a033-42fa-b7cd-dcbda413fa9a HTTP/1.1" status: 200 len: 1990 time: 0.6132774 May 12 15:15:10.429610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e012dc12-9257-4f1f-bf64-5f38b5e69a5f', 'tag': '294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:10.456977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb43f2f5-7658-46e7-98fc-d57ab1f62765 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=005ae052-6cd6-4ddc-833f-af6e1c2bff40,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:10.459957 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb43f2f5-7658-46e7-98fc-d57ab1f62765 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:10.464440 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c00dc26-be00-48d7-8f37-4e86da2a2a19 None None] Network fb52840d-9bbb-41d8-beb2-82a8e29947d0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:15:10.480683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66d3ed62-05f0-4c51-82ab-d5ce6b99d8e7 req-192057dc-eca9-40b8-a238-02882e64843c tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:10.481112 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66d3ed62-05f0-4c51-82ab-d5ce6b99d8e7 req-192057dc-eca9-40b8-a238-02882e64843c tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.76 "GET /v2.0/ports?device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 945 time: 0.5791297 May 12 15:15:10.485376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-5cd2f3ff-d5eb-468f-aef5-477349c4e299 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/quotas/42581a8af83242e0bb61f84a30bd27a7 HTTP/1.1" status: 200 len: 375 time: 0.0348737 May 12 15:15:10.518800 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bb43f2f5-7658-46e7-98fc-d57ab1f62765 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/005ae052-6cd6-4ddc-833f-af6e1c2bff40 HTTP/1.1" status: 204 len: 168 time: 2.0216968 May 12 15:15:10.519046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54336) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:10.539750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fe3707b0-af9e-4644-80d0-b3821d828b3d no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:15:10.540541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Allocated IP 172.20.0.8 (dbc2e49c-2591-4534-a48c-cea8e23115f4/84c2082e-f394-46d5-8a8f-8e3a70d54fc1/53ed6996-04cb-443a-92b9-36c84091d88a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:15:10.597014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: fe3707b0-af9e-4644-80d0-b3821d828b3d {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:15:10.597014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fe3707b0-af9e-4644-80d0-b3821d828b3d not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:15:10.625182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-66d3ed62-05f0-4c51-82ab-d5ce6b99d8e7 req-20b1986d-53cf-45b5-903f-ed40154ba448 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Deleting port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:10.625182 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-66d3ed62-05f0-4c51-82ab-d5ce6b99d8e7 req-20b1986d-53cf-45b5-903f-ed40154ba448 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:10.680362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b23dad8c-c3e0-48c6-a5c4-386546dadd33 req-eb0a2d09-dd74-403d-9a57-06d83c21c346 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:10.688644 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b23dad8c-c3e0-48c6-a5c4-386546dadd33 req-eb0a2d09-dd74-403d-9a57-06d83c21c346 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/ports?device_id=2e8533d5-beb5-49d6-bfa3-fd07fde91f7a HTTP/1.1" status: 200 len: 945 time: 0.5037432 May 12 15:15:10.740150 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:10.759613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Deleting port 1f5268c3-49af-4820-a5c3-93acb927124a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:10.760021 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:10.847812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4ffa29f-44c0-4591-8b54-c921bf202edc None None] DHCP port deletion for fb52840d-9bbb-41d8-beb2-82a8e29947d0 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:15:10.862302 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c4ffa29f-44c0-4591-8b54-c921bf202edc None None] Deleting port 1f5268c3-49af-4820-a5c3-93acb927124a {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:10.862302 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4ffa29f-44c0-4591-8b54-c921bf202edc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:10.873426 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-4d01a57e-801c-450d-9b52-7d9345cf4478 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=42581a8af83242e0bb61f84a30bd27a7&fields=id HTTP/1.1" status: 200 len: 532 time: 0.3434970 May 12 15:15:10.881212 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b23dad8c-c3e0-48c6-a5c4-386546dadd33 req-103395af-4cd0-4b71-9ac1-68454acd1a67 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.82 "GET /v2.0/security-groups?id=acb87c27-050e-44b1-859d-2cd063c51659&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1950502 May 12 15:15:11.016995 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:11.104376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c4ffa29f-44c0-4591-8b54-c921bf202edc None None] For port 1f5268c3-49af-4820-a5c3-93acb927124a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1f5268c3-49af-4820-a5c3-93acb927124a,segment=NetworkSegment(3155d58f-cee0-46db-bac9-2d07d9e2fa60),segment_id=3155d58f-cee0-46db-bac9-2d07d9e2fa60)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:11.104622 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4ffa29f-44c0-4591-8b54-c921bf202edc None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:11.157952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] For port 1f5268c3-49af-4820-a5c3-93acb927124a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1f5268c3-49af-4820-a5c3-93acb927124a,segment=NetworkSegment(3155d58f-cee0-46db-bac9-2d07d9e2fa60),segment_id=3155d58f-cee0-46db-bac9-2d07d9e2fa60)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:11.158242 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:11.169977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:11.202439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-c6d165b7-bee2-48fc-8e26-642315367f9a service neutron] 10.222.0.82 "GET /v2.0/networks/939fdac4-3043-4213-bd31-a421a6c659bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3136146 May 12 15:15:11.222863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668', '5fb6e0a8-b27d-442a-857d-367ef3a32588'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:15:11.317132 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c4ffa29f-44c0-4591-8b54-c921bf202edc None None] Calling delete_port for 1f5268c3-49af-4820-a5c3-93acb927124a owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:15:11.345376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Calling delete_port for 1f5268c3-49af-4820-a5c3-93acb927124a owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:15:11.379396 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8977eff1-5089-4308-a4b7-c7d181518217 service neutron] 10.222.0.82 "GET /v2.0/networks/939fdac4-3043-4213-bd31-a421a6c659bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1607943 May 12 15:15:11.392275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-66d3ed62-05f0-4c51-82ab-d5ce6b99d8e7 req-20b1986d-53cf-45b5-903f-ed40154ba448 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] For port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e,segment=NetworkSegment(fc4158ff-96b8-4d00-981b-81b5cdb89988),segment_id=fc4158ff-96b8-4d00-981b-81b5cdb89988)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:11.392607 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-66d3ed62-05f0-4c51-82ab-d5ce6b99d8e7 req-20b1986d-53cf-45b5-903f-ed40154ba448 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:11.400183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Network dbc2e49c-2591-4534-a48c-cea8e23115f4 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:15:11.405687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:15:11.411237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:15:11.445293 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4ffa29f-44c0-4591-8b54-c921bf202edc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:11.447452 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dab9c59-4e42-4e75-a5ed-e8ca59025788 req-af521773-9a18-460b-abd5-e363bc200894 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:11.449881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7dab9c59-4e42-4e75-a5ed-e8ca59025788 req-af521773-9a18-460b-abd5-e363bc200894 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=e012dc12-9257-4f1f-bf64-5f38b5e69a5f HTTP/1.1" status: 200 len: 944 time: 0.3829825 May 12 15:15:11.451847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event updated for resources: {'Port': ['ID=53ed6996-04cb-443a-92b9-36c84091d88a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:11.504460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4ffa29f-44c0-4591-8b54-c921bf202edc None None] Pushing event deleted for resources: {'Port': ['ID=1f5268c3-49af-4820-a5c3-93acb927124a,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:11.505074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:11.505602 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:11.512416 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:15:11.512914 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:15:11.517369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4ffa29f-44c0-4591-8b54-c921bf202edc None None] No DVR routers for this DVR port 1f5268c3-49af-4820-a5c3-93acb927124a on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:15:11.545507 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-46adc42a-5fdd-4753-a945-dc4600919abe req-0bfe1439-27e0-46a1-b30d-c0edf29dc279 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5256290 May 12 15:15:11.567712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Request body: {'port': {'device_id': 'a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:11.601538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-66d3ed62-05f0-4c51-82ab-d5ce6b99d8e7 req-20b1986d-53cf-45b5-903f-ed40154ba448 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Calling delete_port for c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:15:11.675923 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8c28e5fd-ed99-4473-a031-9f10f7739912 service neutron] 10.222.0.82 "GET /v2.0/ports/ef28df6f-7573-4910-9fae-c2b49092303b?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy HTTP/1.1" status: 200 len: 311 time: 0.2857494 May 12 15:15:11.687999 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7dab9c59-4e42-4e75-a5ed-e8ca59025788 req-0098724b-524e-4355-abef-c81eaa2839fc tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1736817 May 12 15:15:11.689658 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:11.964799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-3a6a81f4-2910-4c2c-b29e-1f0df928c1b0 service neutron] 10.222.0.82 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2725310 May 12 15:15:12.036000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Deleting port 1f5268c3-49af-4820-a5c3-93acb927124a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:12.036000 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:12.204194 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-66d3ed62-05f0-4c51-82ab-d5ce6b99d8e7 req-20b1986d-53cf-45b5-903f-ed40154ba448 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:12.236848 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] The port '1f5268c3-49af-4820-a5c3-93acb927124a' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:15:12.275509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 53ed6996-04cb-443a-92b9-36c84091d88a {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:12.305380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20b1986d-53cf-45b5-903f-ed40154ba448 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Pushing event deleted for resources: {'Port': ['ID=c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:12.310329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:12.380606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Transition to ACTIVE for port object 53ed6996-04cb-443a-92b9-36c84091d88a will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:12.382423 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:12.390591 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:12.416835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-66d3ed62-05f0-4c51-82ab-d5ce6b99d8e7 req-20b1986d-53cf-45b5-903f-ed40154ba448 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] No DVR routers for this DVR port c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:15:12.416835 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-66d3ed62-05f0-4c51-82ab-d5ce6b99d8e7 req-20b1986d-53cf-45b5-903f-ed40154ba448 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:12.452334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-71d05373-b1e1-4b2e-8897-ac807e954d4f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:12.459110 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-71d05373-b1e1-4b2e-8897-ac807e954d4f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 808 time: 0.6120806 May 12 15:15:12.489510 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-c86a2006-33f3-48d7-93a2-3a0cd0080a5e tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/quotas/68c66ae0cd45476b87e2e79625b80f69 HTTP/1.1" status: 200 len: 375 time: 0.0332119 May 12 15:15:12.527698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fb52840d-9bbb-41d8-beb2-82a8e29947d0']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:12.554536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1f5268c3-49af-4820-a5c3-93acb927124a no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:15:12.556098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3155d58f-cee0-46db-bac9-2d07d9e2fa60') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:12.556576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3155d58f-cee0-46db-bac9-2d07d9e2fa60') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:12.578402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66d3ed62-05f0-4c51-82ab-d5ce6b99d8e7 req-20b1986d-53cf-45b5-903f-ed40154ba448 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621 tempest-FloatingIPsAssociationNegativeTestJSON-1082548621-project] 10.222.0.76 "DELETE /v2.0/ports/c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e HTTP/1.1" status: 204 len: 173 time: 2.0833123 May 12 15:15:12.589490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Pushing event updated for resources: {'Port': ['ID=53ed6996-04cb-443a-92b9-36c84091d88a,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:12.616219 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:12.631328 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-dc8a33d1-c1e7-45f2-887b-20ab8f098cdb service neutron] 10.222.0.82 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6592255 May 12 15:15:12.642141 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 1f5268c3-49af-4820-a5c3-93acb927124a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:15:12.642750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1f5268c3-49af-4820-a5c3-93acb927124a not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:15:12.672651 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:12.690575 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c7a787f5-d38a-451d-94a8-51836da0cd4a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:12.699729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Releasing vlan 561 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:15:12.700144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: timer() May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:15:12.715049 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:15:12.752979 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:12.786455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Attempting to bind port 53ed6996-04cb-443a-92b9-36c84091d88a on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:15:12.788263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Attempting to bind port 53ed6996-04cb-443a-92b9-36c84091d88a by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:15:12.788809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Attempting to bind port 53ed6996-04cb-443a-92b9-36c84091d88a on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:12.797801 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-01a2168b-b7a3-428c-96de-542e38e8a2d9 service neutron] 10.222.0.82 "GET /v2.0/ports/85b4d43d-f235-4852-bda9-2dc870bb3d11?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy HTTP/1.1" status: 200 len: 311 time: 0.1652172 May 12 15:15:12.817474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Port 53ed6996-04cb-443a-92b9-36c84091d88a on network dbc2e49c-2591-4534-a48c-cea8e23115f4 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:15:12.817797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Attempting to bind port 53ed6996-04cb-443a-92b9-36c84091d88a on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:12.837831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:15:12.838665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Checking segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:15:12.838665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Bound using segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:15:12.839141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Bound port: 53ed6996-04cb-443a-92b9-36c84091d88a, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:15:12.839525 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:12.840115 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-b95d8e49-77a9-46ca-911e-9b6cf0977762 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&fields=id HTTP/1.1" status: 200 len: 348 time: 0.3383863 May 12 15:15:12.852269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:12.877790 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:12.920793 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] Pushing event deleted for resources: {'Network': ['ID=fb52840d-9bbb-41d8-beb2-82a8e29947d0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:12.929918 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-46ddd6b2-d4ea-4db3-9e0d-20e48a8dee6f admin admin] 10.222.0.82 "DELETE /v2.0/networks/fb52840d-9bbb-41d8-beb2-82a8e29947d0 HTTP/1.1" status: 204 len: 168 time: 2.4098921 May 12 15:15:12.991143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] For port 53ed6996-04cb-443a-92b9-36c84091d88a, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:15:12.991143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] For port 53ed6996-04cb-443a-92b9-36c84091d88a, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=53ed6996-04cb-443a-92b9-36c84091d88a,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:15:12.996499 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:13.061586 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:15:13.061586 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:15:13.083588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:13.083588 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:13.083588 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-46adc42a-5fdd-4753-a945-dc4600919abe req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] 10.222.0.84 "PUT /v2.0/ports/53ed6996-04cb-443a-92b9-36c84091d88a HTTP/1.1" status: 200 len: 1091 time: 1.5157583 May 12 15:15:13.083588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b', 'tag': '53ed6996-04cb-443a-92b9-36c84091d88a'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:13.157597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cb9ab18-576d-437b-9f90-a231acb6c7b7 service neutron] Pushing event updated for resources: {'Port': ['ID=53ed6996-04cb-443a-92b9-36c84091d88a,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:13.172134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:15:13.172134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:15:13.194070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54354) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:13.318675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-917e2ca5-b52f-4ba1-86c8-c014b763170b service neutron] 10.222.0.82 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5125031 May 12 15:15:13.364618 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-50734e18-f87b-4f5e-adab-37dd5da4d9ee admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1aea6927c780448b89ddf44ec6bcb186&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1689763 May 12 15:15:13.364618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54360) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:13.402800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46adc42a-5fdd-4753-a945-dc4600919abe req-f47d1d02-0fa8-4b11-915d-fb5d185404af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:13.404489 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-46adc42a-5fdd-4753-a945-dc4600919abe req-f47d1d02-0fa8-4b11-915d-fb5d185404af service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b HTTP/1.1" status: 200 len: 1094 time: 0.1797559 May 12 15:15:13.432044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:13.465908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c', 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726', 'port_id': '294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c', 'mac_address': 'fa:16:3e:3a:4f:74', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 587, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2c6ef05c-5190-47b2-bba9-0d2bdacd727d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:15:13.500412 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-46adc42a-5fdd-4753-a945-dc4600919abe req-622cd6f0-9ded-4512-9f32-858ff36e7d25 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=53ed6996-04cb-443a-92b9-36c84091d88a HTTP/1.1" status: 200 len: 217 time: 0.0728989 May 12 15:15:13.549593 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:13.555244 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d918748e-dc70-43f6-8d3f-5c82fd0b1edd service neutron] 10.222.0.82 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6804745 May 12 15:15:13.560712 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de3c7cf7-7dae-4a7d-adc5-974a6ff1ba49 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:13.572154 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-0221f5fe-989a-4d57-92a9-f94b86d2db68 service neutron] 10.222.0.82 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2542865 May 12 15:15:13.577455 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:13.600153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:13.612199 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:13.617047 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de3c7cf7-7dae-4a7d-adc5-974a6ff1ba49 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:13.637059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46adc42a-5fdd-4753-a945-dc4600919abe req-809f94c3-e9e9-4d31-a815-fc8a00f72ccc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:13.637059 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-46adc42a-5fdd-4753-a945-dc4600919abe req-809f94c3-e9e9-4d31-a815-fc8a00f72ccc service neutron] 10.222.0.84 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.1106772 May 12 15:15:13.702974 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-46adc42a-5fdd-4753-a945-dc4600919abe req-8198ed0e-7815-442b-bae5-ee55077b429c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0508077 May 12 15:15:13.744800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:13.811941 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de3c7cf7-7dae-4a7d-adc5-974a6ff1ba49 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:13.835208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de3c7cf7-7dae-4a7d-adc5-974a6ff1ba49 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f534afdd-dbad-43b8-9ae0-bd616bab9a95,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:13.836712 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-6e3971ff-51e4-4f34-bfb8-7abba2bac420 service neutron] 10.222.0.82 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2693641 May 12 15:15:13.868927 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-de3c7cf7-7dae-4a7d-adc5-974a6ff1ba49 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:13.868927 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-de3c7cf7-7dae-4a7d-adc5-974a6ff1ba49 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f534afdd-dbad-43b8-9ae0-bd616bab9a95 HTTP/1.1" status: 204 len: 168 time: 0.4986401 May 12 15:15:13.893827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:15:13.919740 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-46adc42a-5fdd-4753-a945-dc4600919abe req-6c5e04a2-ce8a-4106-9eb2-7eed05a63293 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2132144 May 12 15:15:14.130849 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-46adc42a-5fdd-4753-a945-dc4600919abe req-f815e816-b087-4472-86ef-885e68491477 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1972065 May 12 15:15:14.136101 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-35ec1501-4914-494e-9896-f62cc6462bde service neutron] 10.222.0.82 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3394661 May 12 15:15:14.153666 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-879efa9d-f27b-490b-aa0d-8bfba0289ea3 service neutron] 10.222.0.82 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3130100 May 12 15:15:14.407605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-4c372d63-bbe6-4eaa-aee7-6297a1d9bc32 service neutron] 10.222.0.82 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2448206 May 12 15:15:14.751869 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-03328023-6258-4ad0-a801-ebe5ff97bfd5'] response: {'name': 'network-changed', 'server_uuid': 'e012dc12-9257-4f1f-bf64-5f38b5e69a5f', 'tag': '294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c', 'status': 'completed', 'code': 200} May 12 15:15:14.804816 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-c65394a2-7138-4f88-b3a8-aec00ed3ddeb service neutron] 10.222.0.82 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3903627 May 12 15:15:14.819652 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1b4fa294-8e40-4be6-b5a6-c485a41b49bd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:14.973667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54400) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:15.001571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf8cfc74-b80f-485e-b7cf-31f33256787c req-0c06d19b-82c8-4988-8852-53e666360409 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:15.003155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf8cfc74-b80f-485e-b7cf-31f33256787c req-0c06d19b-82c8-4988-8852-53e666360409 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.2853642 May 12 15:15:15.014711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d8b64b-be58-49b3-b4c9-28354be83724 req-14a49848-963a-499a-977e-a3816ffcee21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:15.016474 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86d8b64b-be58-49b3-b4c9-28354be83724 req-14a49848-963a-499a-977e-a3816ffcee21 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=7d73e66034f94885ae45429129883002&device_id=e012dc12-9257-4f1f-bf64-5f38b5e69a5f HTTP/1.1" status: 200 len: 1096 time: 0.2997334 May 12 15:15:15.019012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-51bd0771-1303-42aa-b88d-7defc43e4801 service neutron] 10.222.0.82 "GET /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2019320 May 12 15:15:15.064864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:15:15.117908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Request body: {'network': {'name': 'tempest-InstanceActionsNegativeTestJSON-240441644-network', 'tenant_id': 'df509deac95f4a6298820b86cc7c9da9'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:15.125361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:15.130830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Usage tracker for resource:network and tenant:df509deac95f4a6298820b86cc7c9da9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:15.134442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:15.144202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:15.152887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:15:15.159475 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:15:15.160428 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:15.161031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Made reservation on behalf of df509deac95f4a6298820b86cc7c9da9 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:15:15.163699 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:15.184388 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:15.216350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:15.222340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Usage tracker for resource:security_group_rule and tenant:df509deac95f4a6298820b86cc7c9da9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:15.229312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:15.236123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:15.278043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf8cfc74-b80f-485e-b7cf-31f33256787c req-f72b794b-f89c-4553-a9cb-0f4934422ae9 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2676120 May 12 15:15:15.330681 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:15.416269 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e012dc12-9257-4f1f-bf64-5f38b5e69a5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:15.428981 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-782e64d6-7536-431f-bffe-f357b2fb49dd service neutron] 10.222.0.82 "GET /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3601909 May 12 15:15:15.428981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d8b64b-be58-49b3-b4c9-28354be83724 req-a1bad1df-dfa5-4d53-a465-83a9b2945327 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:15.428981 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86d8b64b-be58-49b3-b4c9-28354be83724 req-a1bad1df-dfa5-4d53-a465-83a9b2945327 service neutron] 10.222.0.76 "GET /v2.0/networks?id=c3c7ba99-d7de-4515-b784-ef9ce8b08726 HTTP/1.1" status: 200 len: 906 time: 0.3850172 May 12 15:15:15.433261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:15.447546 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:15.509284 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:15.516208 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:15.533230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:15.537551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-13785330-629e-4321-824f-e561f4897793 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 572} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:15:15.561348 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:15.561709 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Added segment 80bcba73-0fe8-433c-8fce-7a57f2e38fc5 of type vlan for network 03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8 May 12 15:15:15.569892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bac8477b-d8ec-449d-8f9e-8a0d9a1df32c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:15.577987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86d8b64b-be58-49b3-b4c9-28354be83724 req-989eae47-060d-46f2-be24-8d48e5df3c07 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c HTTP/1.1" status: 200 len: 217 time: 0.1482060 May 12 15:15:15.594911 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:15.624954 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:15.625926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:15.626967 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:15.752425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13785330-629e-4321-824f-e561f4897793 admin admin] Pushing event updated for resources: {'Network': ['ID=03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:15.758372 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-13785330-629e-4321-824f-e561f4897793 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 894 time: 0.7806625 May 12 15:15:15.759225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54408) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:15.765434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:15:15.768145 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d8b64b-be58-49b3-b4c9-28354be83724 req-f689ec9e-1cec-426d-a062-035a8bb8998b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:15.768698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Request body: {'subnet': {'network_id': '03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8', 'cidr': '172.20.0.0/28', 'name': 'tempest-InstanceActionsNegativeTestJSON-240441644-subnet', 'tenant_id': 'df509deac95f4a6298820b86cc7c9da9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:15.769590 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86d8b64b-be58-49b3-b4c9-28354be83724 req-f689ec9e-1cec-426d-a062-035a8bb8998b service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2c6ef05c-5190-47b2-bba9-0d2bdacd727d HTTP/1.1" status: 200 len: 845 time: 0.1829109 May 12 15:15:15.775302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:15.782182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Usage tracker for resource:subnet and tenant:df509deac95f4a6298820b86cc7c9da9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:15.790119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:15.802694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:15.822043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Made reservation on behalf of df509deac95f4a6298820b86cc7c9da9 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:15:15.825964 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:15.837599 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7470e283-86e7-4328-a40b-03e50245c455 service neutron] 10.222.0.82 "GET /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3217435 May 12 15:15:15.841434 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86d8b64b-be58-49b3-b4c9-28354be83724 req-e7f3fa8e-54cc-4370-8c18-95680ae69625 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=c3c7ba99-d7de-4515-b784-ef9ce8b08726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0542548 May 12 15:15:15.852134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04c45d2a-0924-4210-88b1-a7b36b80f1b7 req-34c0981d-8fc2-4c2d-8e06-f14fcb48b692 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:15.857890 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04c45d2a-0924-4210-88b1-a7b36b80f1b7 req-34c0981d-8fc2-4c2d-8e06-f14fcb48b692 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b HTTP/1.1" status: 200 len: 943 time: 0.3436022 May 12 15:15:15.998598 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:16.076464 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:16.096354 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:16.167973 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04c45d2a-0924-4210-88b1-a7b36b80f1b7 req-a9764ba9-8008-4e0b-a998-baecaa223149 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3074663 May 12 15:15:16.179221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Pushing event updated for resources: {'Subnet': ['ID=295f68b4-8c5b-4424-9ddc-bd5a4dbfbfae,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:16.189783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Checking segment: {'id': '80bcba73-0fe8-433c-8fce-7a57f2e38fc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:15:16.189981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Network hostable DHCP agents. Network: 03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:15:16.231152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Network 03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:15:16.253631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:15:16.258080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:16.258938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:16.267499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba999ca1-f6c2-4180-94b4-421df2f90216 None None] Network 03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:15:16.269009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-5d5c8878-2748-469b-a3ab-c270e7000706 service neutron] 10.222.0.82 "GET /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4096894 May 12 15:15:16.297776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-8c7d40c5-5b8a-4b35-8e70-9bc99de2ec96 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:16.299471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-8c7d40c5-5b8a-4b35-8e70-9bc99de2ec96 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.76 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 808 time: 0.3210750 May 12 15:15:16.303141 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86d8b64b-be58-49b3-b4c9-28354be83724 req-07d12787-1fa4-47fb-a870-a5fdb1694310 service neutron] 10.222.0.76 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3450477 May 12 15:15:16.311109 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-00800c87-445f-408c-8325-9ca960d1f1dd admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 858 time: 0.5507405 May 12 15:15:16.315852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Request body: {'port': {'device_id': '7396daa3-460c-4d29-88ac-fe6ba33a7244', 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28', 'admin_state_up': True, 'tenant_id': '68c66ae0cd45476b87e2e79625b80f69'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:16.316759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54414) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:16.600089 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 53ed6996-04cb-443a-92b9-36c84091d88a details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:15:16.776460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'name': 'network-vif-deleted', 'tag': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:17.062491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59874835-f7b4-46eb-b0f2-e7bf24de365e None None] Network 03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:15:17.091857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b4c1d2d6-213d-4562-8698-2dc7f8f15413 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:15:17.191339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adbb8aba-43b7-4567-bde1-b2d9bbec32f3 req-0bd63e18-f514-4df2-a96c-5f98e4826dff tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:17.205518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-adbb8aba-43b7-4567-bde1-b2d9bbec32f3 req-0bd63e18-f514-4df2-a96c-5f98e4826dff tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=e012dc12-9257-4f1f-bf64-5f38b5e69a5f HTTP/1.1" status: 200 len: 946 time: 0.3474882 May 12 15:15:17.303042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:17.348591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Usage tracker for resource:port and tenant:68c66ae0cd45476b87e2e79625b80f69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:17.348591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:17.355042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86d8b64b-be58-49b3-b4c9-28354be83724 req-35ab9ce0-b034-4388-9cff-3489d394e932 service neutron] 10.222.0.76 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5962315 May 12 15:15:17.356812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 53ed6996-04cb-443a-92b9-36c84091d88a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=53ed6996-04cb-443a-92b9-36c84091d88a,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:17.364003 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-adbb8aba-43b7-4567-bde1-b2d9bbec32f3 req-f7d870e1-0d97-4f4e-8993-e3b4a7d431ee tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1645379 May 12 15:15:17.381268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:17.405336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Made reservation on behalf of 68c66ae0cd45476b87e2e79625b80f69 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:15:17.408989 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:17.440400 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '53ed6996-04cb-443a-92b9-36c84091d88a', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'port_id': '53ed6996-04cb-443a-92b9-36c84091d88a', 'mac_address': 'fa:16:3e:ec:3c:91', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 558, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84c2082e-f394-46d5-8a8f-8e3a70d54fc1', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:15:17.703823 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:17.811517 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:17.871172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Allocated IP 172.20.0.2 (e8211761-0dd9-424f-b732-629fd2d77e28/ed7d4325-c4dc-4592-8d41-1f3fe41da585/2483265a-0012-4339-be86-677490680e84) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:15:17.899589 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:17.989953 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-31f50a95-03a4-4a89-ac1a-32d058c9dc89'] response: {'name': 'network-changed', 'server_uuid': 'a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b', 'tag': '53ed6996-04cb-443a-92b9-36c84091d88a', 'status': 'completed', 'code': 200} May 12 15:15:18.019548 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 53ed6996-04cb-443a-92b9-36c84091d88a {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:18.228048 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3a3776ae-729c-47e9-9598-0c0de6b22971'] response: {'server_uuid': 'e012dc12-9257-4f1f-bf64-5f38b5e69a5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c', 'code': 200} May 12 15:15:18.317057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 53ed6996-04cb-443a-92b9-36c84091d88a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=53ed6996-04cb-443a-92b9-36c84091d88a,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:18.340352 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:18.462597 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15657553-f4e7-48f6-b9ac-727cd2bd4905 req-4190ba46-276a-4bce-bc36-0a8e541074d7 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 210 time: 0.1757908 May 12 15:15:18.546750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a77d8fd-336b-420b-a4f5-b03d1ea29e0a req-0354d8bb-4a7a-4822-9428-db3511125614 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:18.552527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b4c1d2d6-213d-4562-8698-2dc7f8f15413, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b4c1d2d6-213d-4562-8698-2dc7f8f15413,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:18.559396 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4a77d8fd-336b-420b-a4f5-b03d1ea29e0a req-0354d8bb-4a7a-4822-9428-db3511125614 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b HTTP/1.1" status: 200 len: 1094 time: 0.5335882 May 12 15:15:18.613039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'b4c1d2d6-213d-4562-8698-2dc7f8f15413', 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb', 'port_id': 'b4c1d2d6-213d-4562-8698-2dc7f8f15413', 'mac_address': 'fa:16:3e:ca:da:24', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 573, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b6cc6b5a-d56a-4336-afb7-99232d9672dc', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:15:18.783159 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:18.809266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['53ed6996-04cb-443a-92b9-36c84091d88a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:15:18.849740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a77d8fd-336b-420b-a4f5-b03d1ea29e0a req-21255b4c-1752-481b-b7bf-6ee1966b6528 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:18.851359 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4a77d8fd-336b-420b-a4f5-b03d1ea29e0a req-21255b4c-1752-481b-b7bf-6ee1966b6528 service neutron] 10.222.0.84 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 907 time: 0.3111925 May 12 15:15:18.906122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=53ed6996-04cb-443a-92b9-36c84091d88a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:18.929023 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:18.963938 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4a77d8fd-336b-420b-a4f5-b03d1ea29e0a req-8a4d638a-42bd-406d-bf7d-d4d1b9101b38 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=53ed6996-04cb-443a-92b9-36c84091d88a HTTP/1.1" status: 200 len: 217 time: 0.1035888 May 12 15:15:18.965884 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e280ccf-e0b2-4ceb-bb8b-854640479840 req-61456cda-1362-4c86-bfa1-2a9419231f55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:18.967411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e280ccf-e0b2-4ceb-bb8b-854640479840 req-61456cda-1362-4c86-bfa1-2a9419231f55 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=e012dc12-9257-4f1f-bf64-5f38b5e69a5f HTTP/1.1" status: 200 len: 1097 time: 0.5001528 May 12 15:15:18.989155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ad99c3-33cb-484b-ab33-edc2095b1101 req-3a0a75c3-6334-4a5e-9857-80588945c954 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:18.997519 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52ad99c3-33cb-484b-ab33-edc2095b1101 req-3a0a75c3-6334-4a5e-9857-80588945c954 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.4481676 May 12 15:15:19.043285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id b4c1d2d6-213d-4562-8698-2dc7f8f15413 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:19.086794 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Deleting port c04fe88c-5805-45f0-b3fd-52b35ea3fe16 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:19.087137 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:19.091995 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:19.111246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c89ed514-64cd-4011-b01a-855ecf2c3a8e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:15:19.125141 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52ad99c3-33cb-484b-ab33-edc2095b1101 req-78f22a8c-715b-4da6-9e27-e437a2b44e69 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1254275 May 12 15:15:19.137575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a77d8fd-336b-420b-a4f5-b03d1ea29e0a req-95f80f44-3573-4c3e-b1fd-d27f84e1ade7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:19.139192 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4a77d8fd-336b-420b-a4f5-b03d1ea29e0a req-95f80f44-3573-4c3e-b1fd-d27f84e1ade7 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.1437745 May 12 15:15:19.194906 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e280ccf-e0b2-4ceb-bb8b-854640479840 req-747403e3-6a83-4ab6-86e7-733f9fe2872f service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2109866 May 12 15:15:19.215557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Network e8211761-0dd9-424f-b732-629fd2d77e28 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:15:19.215557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:15:19.240110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:15:19.269760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b4c1d2d6-213d-4562-8698-2dc7f8f15413, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b4c1d2d6-213d-4562-8698-2dc7f8f15413,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:19.331277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-4682fb49-480f-4498-be39-f57604a6fb12 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:19.343945 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-4682fb49-480f-4498-be39-f57604a6fb12 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/networks?id=03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8 HTTP/1.1" status: 200 len: 821 time: 0.5037704 May 12 15:15:19.357544 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b21a1f51-494e-434a-b67e-03217b18f368'] response: {'server_uuid': '2e8533d5-beb5-49d6-bfa3-fd07fde91f7a', 'name': 'network-vif-deleted', 'tag': 'c23fe40b-1f1f-4ac2-8c89-a549dc4f2a1e', 'status': 'completed', 'code': 200} May 12 15:15:19.358394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Pushing event updated for resources: {'Port': ['ID=2483265a-0012-4339-be86-677490680e84,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:19.374366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-c4affc77-20e0-4530-b136-a4a3aefab02b tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/quotas/df509deac95f4a6298820b86cc7c9da9 HTTP/1.1" status: 200 len: 375 time: 0.0289075 May 12 15:15:19.383525 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4a77d8fd-336b-420b-a4f5-b03d1ea29e0a req-ccc1f4b4-c44f-4e91-8bf6-998a53e32bc6 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2322812 May 12 15:15:19.438990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-d9e606b4-4a34-4e97-b083-3da8ce77b292 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=df509deac95f4a6298820b86cc7c9da9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0634522 May 12 15:15:19.444193 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:19.537721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:19.538450 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:19.651686 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-d5833eb7-18bf-4ab6-b3e4-c3c0a87144d9 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.3398318 May 12 15:15:19.680191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Request body: {'port': {'device_id': '7396daa3-460c-4d29-88ac-fe6ba33a7244', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:19.725220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] For port c04fe88c-5805-45f0-b3fd-52b35ea3fe16, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c04fe88c-5805-45f0-b3fd-52b35ea3fe16,segment=NetworkSegment(fc4158ff-96b8-4d00-981b-81b5cdb89988),segment_id=fc4158ff-96b8-4d00-981b-81b5cdb89988)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:19.725607 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:19.735656 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4a77d8fd-336b-420b-a4f5-b03d1ea29e0a req-bbe69aae-72f9-4f57-87b8-f419c33e08b6 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3015964 May 12 15:15:19.765183 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-95d72718-55d6-4ae0-a375-94aafac80a1d service neutron] 10.222.0.82 "GET /v2.0/networks/03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3250699 May 12 15:15:19.802306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=b4c1d2d6-213d-4562-8698-2dc7f8f15413,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:19.886185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Calling delete_port for c04fe88c-5805-45f0-b3fd-52b35ea3fe16 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:15:20.028321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d79cade-e1ee-47f4-876f-d9904a400920 req-37b6679e-c254-49a2-a506-552e5f6d5226 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:20.030319 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d79cade-e1ee-47f4-876f-d9904a400920 req-37b6679e-c254-49a2-a506-552e5f6d5226 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b HTTP/1.1" status: 200 len: 944 time: 0.4847012 May 12 15:15:20.069025 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4a77d8fd-336b-420b-a4f5-b03d1ea29e0a req-c274b80e-2f03-4ff7-9199-cd9c361c9213 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2689490 May 12 15:15:20.080020 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:20.177961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-aac0da6c-306f-415b-a419-b4a0bac91923 service neutron] 10.222.0.82 "GET /v2.0/networks/03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4118474 May 12 15:15:20.186851 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:20.293896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Pushing event deleted for resources: {'Port': ['ID=c04fe88c-5805-45f0-b3fd-52b35ea3fe16,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:20.443128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:20.443804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:20.444106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:20.444453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:20.445231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:20.445231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:20.446204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:20.446204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:20.446651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:20.447466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:20.449497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:20.449497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:20.736445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-2b183a85-6af0-4ebe-acc6-1da6f8359c93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:20.736445 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-2b183a85-6af0-4ebe-acc6-1da6f8359c93 service neutron] 10.222.0.84 "GET /v2.0/ports/ef28df6f-7573-4910-9fae-c2b49092303b HTTP/1.1" status: 200 len: 1028 time: 0.2877543 May 12 15:15:20.816039 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d79cade-e1ee-47f4-876f-d9904a400920 req-96d44005-1bab-4552-9475-ffa94da0ee77 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7741566 May 12 15:15:21.028265 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d262322-0c1d-4a13-a13f-1407b2d6159f req-1ef5532f-2bf5-4033-b297-b4a4e3c79c25 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 210 time: 0.1752362 May 12 15:15:21.106788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2483265a-0012-4339-be86-677490680e84 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:21.143756 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:21.153361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f5f63b1d-b633-46df-a2e5-90df2c8d7424 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:21.167690 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f5f63b1d-b633-46df-a2e5-90df2c8d7424 service neutron] 10.222.0.84 "GET /v2.0/ports/85b4d43d-f235-4852-bda9-2dc870bb3d11 HTTP/1.1" status: 200 len: 1026 time: 0.1559665 May 12 15:15:21.179856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Transition to ACTIVE for port object 2483265a-0012-4339-be86-677490680e84 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:21.181641 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:21.235456 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:21.345812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Pushing event updated for resources: {'Port': ['ID=2483265a-0012-4339-be86-677490680e84,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:21.460297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29be18da-2e9d-4f83-ac9d-86117b07b9d1 req-c1327530-c49d-4fd1-aa0c-40214221ef81 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:21.462968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29be18da-2e9d-4f83-ac9d-86117b07b9d1 req-c1327530-c49d-4fd1-aa0c-40214221ef81 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=e012dc12-9257-4f1f-bf64-5f38b5e69a5f HTTP/1.1" status: 200 len: 946 time: 0.4270382 May 12 15:15:21.473246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b4c1d2d6-213d-4562-8698-2dc7f8f15413 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:15:21.475781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b4c1d2d6-213d-4562-8698-2dc7f8f15413 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:15:21.578271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-277ce415-a2fb-4978-b356-e3f8fb218d76 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:21.594082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-277ce415-a2fb-4978-b356-e3f8fb218d76 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:21.601238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-277ce415-a2fb-4978-b356-e3f8fb218d76 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:21.602507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-277ce415-a2fb-4978-b356-e3f8fb218d76 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Synchronizing usage tracker for tenant:42581a8af83242e0bb61f84a30bd27a7 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:15:21.639915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a17859-1314-46b8-bfaa-507d014bfd74 req-f9f817e6-1a91-446b-96d2-fcf4b89fc89b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:21.642230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-75a17859-1314-46b8-bfaa-507d014bfd74 req-f9f817e6-1a91-446b-96d2-fcf4b89fc89b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Synchronizing usage tracker for tenant:68c66ae0cd45476b87e2e79625b80f69 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:15:21.690164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-277ce415-a2fb-4978-b356-e3f8fb218d76 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Unset dirty status for tenant:42581a8af83242e0bb61f84a30bd27a7 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:15:21.691377 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-277ce415-a2fb-4978-b356-e3f8fb218d76 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "GET /v2.0/networks?id=939fdac4-3043-4213-bd31-a421a6c659bc&id=e6a7ff8f-d7ef-4614-8958-ef6026371726&id=e6a7ff8f-d7ef-4614-8958-ef6026371726&id=e6a7ff8f-d7ef-4614-8958-ef6026371726&id=e6a7ff8f-d7ef-4614-8958-ef6026371726&id=c5f75c23-a033-42fa-b7cd-dcbda413fa9a&id=c5f75c23-a033-42fa-b7cd-dcbda413fa9a HTTP/1.1" status: 200 len: 1990 time: 0.5043151 May 12 15:15:21.765378 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:21.829002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-75a17859-1314-46b8-bfaa-507d014bfd74 req-f9f817e6-1a91-446b-96d2-fcf4b89fc89b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Unset dirty status for tenant:68c66ae0cd45476b87e2e79625b80f69 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:15:21.842038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75a17859-1314-46b8-bfaa-507d014bfd74 req-f9f817e6-1a91-446b-96d2-fcf4b89fc89b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 943 time: 0.6458459 May 12 15:15:21.870963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29be18da-2e9d-4f83-ac9d-86117b07b9d1 req-2e211f9c-dddf-4039-b3c6-3d5a7a6386d5 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3840611 May 12 15:15:21.895280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-fc7d1347-7f13-4f3e-8d10-ac622767e276 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Synchronizing usage tracker for tenant:42581a8af83242e0bb61f84a30bd27a7 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:15:21.929174 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75a17859-1314-46b8-bfaa-507d014bfd74 req-bb489dfb-ae96-47f3-bfb9-49134131c4f1 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0789659 May 12 15:15:21.951431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:15:21.952241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-fc7d1347-7f13-4f3e-8d10-ac622767e276 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Unset dirty status for tenant:42581a8af83242e0bb61f84a30bd27a7 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:15:21.953113 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-fc7d1347-7f13-4f3e-8d10-ac622767e276 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=42581a8af83242e0bb61f84a30bd27a7 HTTP/1.1" status: 200 len: 380 time: 0.2240348 May 12 15:15:21.967830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b4c1d2d6-213d-4562-8698-2dc7f8f15413, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b4c1d2d6-213d-4562-8698-2dc7f8f15413,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:21.970940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'port': {'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'admin_state_up': True, 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'security_groups': ['98320268-f290-4c75-8a2a-57916de87f04']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:21.990447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'b4c1d2d6-213d-4562-8698-2dc7f8f15413', 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb', 'port_id': 'b4c1d2d6-213d-4562-8698-2dc7f8f15413', 'mac_address': 'fa:16:3e:ca:da:24', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 573, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b6cc6b5a-d56a-4336-afb7-99232d9672dc', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:15:22.001419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id b4c1d2d6-213d-4562-8698-2dc7f8f15413 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:22.009678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Attempting to bind port 2483265a-0012-4339-be86-677490680e84 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:15:22.011696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Attempting to bind port 2483265a-0012-4339-be86-677490680e84 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:15:22.012036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Attempting to bind port 2483265a-0012-4339-be86-677490680e84 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:22.023739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b4c1d2d6-213d-4562-8698-2dc7f8f15413, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b4c1d2d6-213d-4562-8698-2dc7f8f15413,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:22.033169 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:22.035084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Port 2483265a-0012-4339-be86-677490680e84 on network e8211761-0dd9-424f-b732-629fd2d77e28 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:15:22.035420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Attempting to bind port 2483265a-0012-4339-be86-677490680e84 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:22.051346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:15:22.055085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Checking segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:15:22.055483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Bound using segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:15:22.055980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Bound port: 2483265a-0012-4339-be86-677490680e84, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:15:22.057491 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:22.131016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['b4c1d2d6-213d-4562-8698-2dc7f8f15413'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:15:22.300156 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=b4c1d2d6-213d-4562-8698-2dc7f8f15413,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:22.450604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 53ed6996-04cb-443a-92b9-36c84091d88a up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:15:22.531002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:22.550102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:15:22.550102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource port. Total usage: 7; quota limit: 500; headroom:493 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:22.563147 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae9244a6-41e5-4b61-9270-8679576eee10 None None] Sync routers for ids ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:15:22.568500 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eec332b6-230e-4f5b-a134-7ac96da0c4ed req-6913090f-3665-4251-b42c-10842bb0176c tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/ports?device_id=590df846-b8e7-4847-aeec-9f7ff7b352e6 HTTP/1.1" status: 200 len: 210 time: 0.2995214 May 12 15:15:22.580115 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae9244a6-41e5-4b61-9270-8679576eee10 None None] Routers {'86f12517-ac09-4f4e-b30f-f7f1a1aa3190'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:15:22.595954 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ae9244a6-41e5-4b61-9270-8679576eee10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:15:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:22.600828 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7f243108-faf4-4199-aa74-e95852cd3bde admin admin] 10.222.0.82 "PUT /v2.0/routers/86f12517-ac09-4f4e-b30f-f7f1a1aa3190/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.2718680 May 12 15:15:22.600828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Made reservation on behalf of 42581a8af83242e0bb61f84a30bd27a7 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:15:22.611965 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:22.628877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 53ed6996-04cb-443a-92b9-36c84091d88a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:15:22.628877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 53ed6996-04cb-443a-92b9-36c84091d88a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:15:22.628877 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:22.645079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54492) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:22.849916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] For port 2483265a-0012-4339-be86-677490680e84, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:15:22.853253 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:22.895851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '53ed6996-04cb-443a-92b9-36c84091d88a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:22.906391 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] For port 2483265a-0012-4339-be86-677490680e84, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2483265a-0012-4339-be86-677490680e84,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:15:22.909681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 53ed6996-04cb-443a-92b9-36c84091d88a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=53ed6996-04cb-443a-92b9-36c84091d88a,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:22.919747 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:22.985959 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:23.071630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=53ed6996-04cb-443a-92b9-36c84091d88a,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:23.100987 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:23.100987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:23.106193 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-ae9244a6-41e5-4b61-9270-8679576eee10 None None] Set router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:15:23.110445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] 10.222.0.76 "PUT /v2.0/ports/2483265a-0012-4339-be86-677490680e84 HTTP/1.1" status: 200 len: 1091 time: 3.4292309 May 12 15:15:23.110445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7396daa3-460c-4d29-88ac-fe6ba33a7244', 'tag': '2483265a-0012-4339-be86-677490680e84'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:23.158069 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986fe55f-491f-4ba3-a2aa-8c3a846deaab req-048a4905-0d98-4060-b07e-968d30ff066f tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:23.158069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986fe55f-491f-4ba3-a2aa-8c3a846deaab req-048a4905-0d98-4060-b07e-968d30ff066f tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 944 time: 0.9843948 May 12 15:15:23.199439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-9028a0e3-cb13-42d1-81b4-e360db62b643 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:23.199612 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-9028a0e3-cb13-42d1-81b4-e360db62b643 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.76 "GET /v2.0/networks?id=03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8 HTTP/1.1" status: 200 len: 821 time: 0.8985841 May 12 15:15:23.223651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Request body: {'port': {'device_id': '590df846-b8e7-4847-aeec-9f7ff7b352e6', 'network_id': '03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8', 'admin_state_up': True, 'tenant_id': 'df509deac95f4a6298820b86cc7c9da9'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:23.287199 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:23.435623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Pushing event updated for resources: {'Port': ['ID=2483265a-0012-4339-be86-677490680e84,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:23.450858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:23.450858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:23.450858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:23.450858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:23.450858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:23.450858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:23.450858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:23.453327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:23.453327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:23.453327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:23.453327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:23.453327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5b6b740-83cd-477c-a0c1-96b3c2b1bcaa service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:23.501752 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b4c1d2d6-213d-4562-8698-2dc7f8f15413 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:15:23.567729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c58f1bf-0eae-465a-a8a8-2c79c6fd0081 req-004ca523-c456-41c7-a66d-9c1ca7b7cc14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:23.584227 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c58f1bf-0eae-465a-a8a8-2c79c6fd0081 req-004ca523-c456-41c7-a66d-9c1ca7b7cc14 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b HTTP/1.1" status: 200 len: 945 time: 0.6415184 May 12 15:15:23.601093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986fe55f-491f-4ba3-a2aa-8c3a846deaab req-3c94c29b-2882-4bd3-bcb8-e0d6431f2e45 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3979545 May 12 15:15:23.689918 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c58f1bf-0eae-465a-a8a8-2c79c6fd0081 req-e6fe6a12-ea7d-4f5c-a2b4-65b060ab0b28 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1170752 May 12 15:15:23.733069 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e899dfb0-f847-4a6b-91e6-8cd2e74c0de5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:23.734765 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-e899dfb0-f847-4a6b-91e6-8cd2e74c0de5 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 1094 time: 0.5772674 May 12 15:15:23.748858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port b4c1d2d6-213d-4562-8698-2dc7f8f15413 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:15:23.751174 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:23.757167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Allocated IP 172.20.0.7 (939fdac4-3043-4213-bd31-a421a6c659bc/c7af977d-fe6b-4182-af40-d4c2523b54a3/026a86ba-df92-4de2-9f16-6e6b8794d1df) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:15:23.866593 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ae9244a6-41e5-4b61-9270-8679576eee10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:15:20Z', 'revision_number': 5, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:23.875256 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae9244a6-41e5-4b61-9270-8679576eee10 None None] Checking router: 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:15:23.897643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-7cb3d7fa-f300-4d9a-b9c7-67719a0f5ee9 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=2483265a-0012-4339-be86-677490680e84 HTTP/1.1" status: 200 len: 217 time: 0.1373632 May 12 15:15:23.910443 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae9244a6-41e5-4b61-9270-8679576eee10 None None] Routers {'86f12517-ac09-4f4e-b30f-f7f1a1aa3190'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:15:23.910834 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ae9244a6-41e5-4b61-9270-8679576eee10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:15:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:23.943804 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:24.043189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port b4c1d2d6-213d-4562-8698-2dc7f8f15413, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b4c1d2d6-213d-4562-8698-2dc7f8f15413,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:24.049064 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:24.055671 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d1472428-39be-42c1-9529-dc3dc4d91ece'] response: {'server_uuid': 'a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '53ed6996-04cb-443a-92b9-36c84091d88a', 'code': 200} May 12 15:15:24.087928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:24.132885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Usage tracker for resource:port and tenant:df509deac95f4a6298820b86cc7c9da9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:24.151655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2049de5b-f8fe-439b-83ab-8c19127586fc req-5f56a1fc-348c-440a-a5ee-4eb6f20abf0c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 210 time: 0.1652224 May 12 15:15:24.154560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:24.171029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:24.246474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=b4c1d2d6-213d-4562-8698-2dc7f8f15413,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:24.374513 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f4b9a655-f7d2-4df5-9bbd-9cc0b493a5ea'] response: {'name': 'network-changed', 'server_uuid': '7396daa3-460c-4d29-88ac-fe6ba33a7244', 'tag': '2483265a-0012-4339-be86-677490680e84', 'status': 'completed', 'code': 200} May 12 15:15:24.380307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-751fd88e-9c39-43d5-8d7a-5ac7a3eddd08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:24.386018 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-751fd88e-9c39-43d5-8d7a-5ac7a3eddd08 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.4783874 May 12 15:15:24.388463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Made reservation on behalf of df509deac95f4a6298820b86cc7c9da9 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:15:24.395294 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:24.457180 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-ae9244a6-41e5-4b61-9270-8679576eee10 None None] Set router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:15:24.469979 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:24.527036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Transition to ACTIVE for port object 026a86ba-df92-4de2-9f16-6e6b8794d1df will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:24.531643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55c39df9-f3dc-4913-bc9a-cf48f5c619cf req-99ab511b-5bb8-4493-a845-a2b3b658ca65 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/ports?device_id=590df846-b8e7-4847-aeec-9f7ff7b352e6 HTTP/1.1" status: 200 len: 210 time: 0.0767493 May 12 15:15:24.580785 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:24.593448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-fc210bce-e3eb-432a-935d-8412dc832947 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0612936 May 12 15:15:24.608724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07fb12a2-d91c-4a1c-b1f7-69e196911f34 req-fd533e0b-b812-499b-827b-c19d97510e5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:24.610422 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-07fb12a2-d91c-4a1c-b1f7-69e196911f34 req-fd533e0b-b812-499b-827b-c19d97510e5a service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b HTTP/1.1" status: 200 len: 1096 time: 0.4034927 May 12 15:15:24.613546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] Deleting port 4abd2c3a-c517-4d15-805c-d27c45138fec {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:24.614121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:24.721756 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-07fb12a2-d91c-4a1c-b1f7-69e196911f34 req-3abe44c0-8453-43ee-96c0-459b692581bd service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725975 May 12 15:15:24.724292 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:24.894902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Network 939fdac4-3043-4213-bd31-a421a6c659bc is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:15:24.902762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:15:24.907614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'Port': ['ID=026a86ba-df92-4de2-9f16-6e6b8794d1df,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:24.918401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Allocated IP 172.20.0.8 (03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8/295f68b4-8c5b-4424-9ddc-bd5a4dbfbfae/c0221401-ba65-4823-8157-04df90260837) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:15:24.985908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bfa74e7-3e44-4330-a364-bfa50f8d1372 req-c5ae1dc4-60d7-4b19-9047-22e3ff2275c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:24.991114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1bfa74e7-3e44-4330-a364-bfa50f8d1372 req-c5ae1dc4-60d7-4b19-9047-22e3ff2275c2 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 943 time: 0.7874815 May 12 15:15:24.999861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:15:25.079824 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ae9244a6-41e5-4b61-9270-8679576eee10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:15:20Z', 'revision_number': 5, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:25.082730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] For port 4abd2c3a-c517-4d15-805c-d27c45138fec, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4abd2c3a-c517-4d15-805c-d27c45138fec,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:25.084517 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:25.084627 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae9244a6-41e5-4b61-9270-8679576eee10 None None] The sync data for ids ['86f12517-ac09-4f4e-b30f-f7f1a1aa3190'] in n-d-841483-1 is: [{'id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1265099035-router', 'tenant_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204'}], 'enable_snat': True}, 'gw_port_id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:31Z', 'updated_at': '2022-05-12T15:15:20Z', 'revision_number': 5, 'project_id': 'a687923521d64fba8b0ceae3dbf4d7d3', 'gw_port': {'id': '4abd2c3a-c517-4d15-805c-d27c45138fec', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:a9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86f12517-ac09-4f4e-b30f-f7f1a1aa3190', 'device_owner': 'network:router_gateway', 'standard_attr_id': 962, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:32Z', 'updated_at': '2022-05-12T15:13:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:15:25.097972 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-449aa246-da2b-4dae-a133-b2436f504dfe service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3100064 May 12 15:15:25.269050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] Calling delete_port for 4abd2c3a-c517-4d15-805c-d27c45138fec owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:15:25.299189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d11a9907-cf71-4587-870d-4b9e2e66ca5e None None] Provisioning for port 026a86ba-df92-4de2-9f16-6e6b8794d1df completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:15:25.306770 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d11a9907-cf71-4587-870d-4b9e2e66ca5e None None] Provisioning complete for port 026a86ba-df92-4de2-9f16-6e6b8794d1df triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:15:25.308457 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d11a9907-cf71-4587-870d-4b9e2e66ca5e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:25.321998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:25.323468 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:25.392753 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ae3d99e4-4974-4308-b2a5-a3f0fbdee021 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.4280686 May 12 15:15:25.396381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d11a9907-cf71-4587-870d-4b9e2e66ca5e None None] Port 026a86ba-df92-4de2-9f16-6e6b8794d1df cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:15:25.420491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'port': {'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726', 'admin_state_up': True, 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'security_groups': ['98320268-f290-4c75-8a2a-57916de87f04']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:25.470058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8753a609-2ef9-406a-97dd-3987c40e7e09 req-ea5e65eb-9872-4b75-9943-2659e5ebd51c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:25.471615 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8753a609-2ef9-406a-97dd-3987c40e7e09 req-ea5e65eb-9872-4b75-9943-2659e5ebd51c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=e012dc12-9257-4f1f-bf64-5f38b5e69a5f HTTP/1.1" status: 200 len: 946 time: 0.7254093 May 12 15:15:25.572376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1bfa74e7-3e44-4330-a364-bfa50f8d1372 req-a63aa642-353e-4550-8b26-8110dea53517 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4514499 May 12 15:15:25.672161 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f02b678c-1ce3-4a20-8f03-e4687781a3d8 req-33a755dc-2bff-4e36-b3d1-182940e15733 service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5615547 May 12 15:15:25.693987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8753a609-2ef9-406a-97dd-3987c40e7e09 req-05ea64c4-d6c8-4377-9932-f82cd1ffdab2 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1707044 May 12 15:15:25.747335 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:25.784449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:25.790460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:port and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:25.795392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for port was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:25.803330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource port. Total usage: 8; quota limit: 500; headroom:492 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:25.824933 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:25.883389 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Made reservation on behalf of 42581a8af83242e0bb61f84a30bd27a7 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:15:25.887008 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:25.905587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] Pushing event deleted for resources: {'Port': ['ID=4abd2c3a-c517-4d15-805c-d27c45138fec,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:26.058801 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6062b237-2dea-4593-98c5-e5bcf587f743', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4c1d2d6-213d-4562-8698-2dc7f8f15413'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:26.067011 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:26.127390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00110541-35c6-42a7-8ab6-8aba43ec9c20 req-f75722be-5cea-4504-98ba-8b18d1ed32c2 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:26.133178 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00110541-35c6-42a7-8ab6-8aba43ec9c20 req-f75722be-5cea-4504-98ba-8b18d1ed32c2 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.2893815 May 12 15:15:26.172703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d532f4c0-b453-4814-bcbf-09aa93f23025 req-41d4c31f-0f42-45ed-815c-73b21d956fc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:26.172703 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d532f4c0-b453-4814-bcbf-09aa93f23025 req-41d4c31f-0f42-45ed-815c-73b21d956fc4 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 1094 time: 0.3862672 May 12 15:15:26.244416 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:26.386201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Network 03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:15:26.386201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:15:26.386201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:15:26.415642 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d1bfc9b-2c35-492a-bd32-50d2884a94b8 req-94d52178-d9e5-490a-9e48-2a964199827b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:26.417988 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d1bfc9b-2c35-492a-bd32-50d2884a94b8 req-94d52178-d9e5-490a-9e48-2a964199827b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b HTTP/1.1" status: 200 len: 945 time: 0.4930162 May 12 15:15:26.453051 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:26.458337 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:26.544998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:26.545694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 86f12517-ac09-4f4e-b30f-f7f1a1aa3190 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:15:26.605589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Pushing event updated for resources: {'Port': ['ID=c0221401-ba65-4823-8157-04df90260837,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:26.616661 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:26.619000 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c9ac7dd8-62b0-4f2e-a6e2-c1f6da4f5228 admin admin] 10.222.0.82 "DELETE /v2.0/routers/86f12517-ac09-4f4e-b30f-f7f1a1aa3190 HTTP/1.1" status: 204 len: 168 time: 3.9760437 May 12 15:15:26.622857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Allocated IP 10.1.1.80 (e6a7ff8f-d7ef-4614-8958-ef6026371726/722dd775-53fe-4359-9d8f-d74143e5ced9/c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:15:26.627777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54520) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:26.642101 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00110541-35c6-42a7-8ab6-8aba43ec9c20 req-10b28e29-b787-4377-900c-f6a8ec1db7ff tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5042436 May 12 15:15:26.666583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c04fe88c-5805-45f0-b3fd-52b35ea3fe16 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:15:26.754177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-45c32752-3d6d-4d99-a237-bbded9f2b4eb admin admin] Deleting subnet 9a114164-5df9-48f9-8806-96a06aeff952 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:15:26.765764 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-45c32752-3d6d-4d99-a237-bbded9f2b4eb admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:26.766515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d1bfc9b-2c35-492a-bd32-50d2884a94b8 req-f54e7ecb-6983-49c6-ac36-e8a51a6a4e7a tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3298500 May 12 15:15:26.781207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:26.782190 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: c04fe88c-5805-45f0-b3fd-52b35ea3fe16 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:15:26.782653 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c04fe88c-5805-45f0-b3fd-52b35ea3fe16 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:15:26.793524 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:26.843369 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-401a5ce2-90be-43c6-aef9-30c2e919233e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.6311414 May 12 15:15:26.851240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d532f4c0-b453-4814-bcbf-09aa93f23025 req-0ab6d0cc-d5cd-45ca-8a56-2b4a0c8cdaec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:26.859110 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d532f4c0-b453-4814-bcbf-09aa93f23025 req-0ab6d0cc-d5cd-45ca-8a56-2b4a0c8cdaec service neutron] 10.222.0.76 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.6652122 May 12 15:15:26.865459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Request body: {'port': {'device_id': '590df846-b8e7-4847-aeec-9f7ff7b352e6', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:26.934983 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-45c32752-3d6d-4d99-a237-bbded9f2b4eb admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:27.088605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d532f4c0-b453-4814-bcbf-09aa93f23025 req-b843430e-20c0-4727-a234-b78e22b2db1e service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=2483265a-0012-4339-be86-677490680e84 HTTP/1.1" status: 200 len: 217 time: 0.1693659 May 12 15:15:27.133062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:27.144954 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-45c32752-3d6d-4d99-a237-bbded9f2b4eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:27.223218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Transition to ACTIVE for port object c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:27.264591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d532f4c0-b453-4814-bcbf-09aa93f23025 req-0337daaa-26c7-4b19-a48e-2d47ac80e0bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:27.265607 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d532f4c0-b453-4814-bcbf-09aa93f23025 req-0337daaa-26c7-4b19-a48e-2d47ac80e0bf service neutron] 10.222.0.76 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.1639061 May 12 15:15:27.268427 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:27.298642 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-45c32752-3d6d-4d99-a237-bbded9f2b4eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:27.341824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:27.354500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c32752-3d6d-4d99-a237-bbded9f2b4eb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9a114164-5df9-48f9-8806-96a06aeff952,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:27.420435 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d532f4c0-b453-4814-bcbf-09aa93f23025 req-fe1c8802-05b0-46f5-a3a0-2739f13ced3e service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1173234 May 12 15:15:27.424614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a80c0103-373d-445e-bebd-1ce93d87328b None None] Network 13bc975a-b248-4de3-b27d-6d14b7951c4b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:15:27.425607 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-45c32752-3d6d-4d99-a237-bbded9f2b4eb admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:27.427076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60b56fe-7d08-40dd-80fd-a96cda80ac8e req-1b215e1a-2690-4070-95f4-c3299348c21b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:27.438479 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c60b56fe-7d08-40dd-80fd-a96cda80ac8e req-1b215e1a-2690-4070-95f4-c3299348c21b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 931 time: 0.5220356 May 12 15:15:27.443864 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-45c32752-3d6d-4d99-a237-bbded9f2b4eb admin admin] 10.222.0.82 "DELETE /v2.0/subnets/9a114164-5df9-48f9-8806-96a06aeff952 HTTP/1.1" status: 204 len: 168 time: 0.8112922 May 12 15:15:27.447129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Network e6a7ff8f-d7ef-4614-8958-ef6026371726 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:15:27.449090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54524) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:27.461098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:15:27.475858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'Port': ['ID=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:27.478930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:15:27.541023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d6ea811-e9f3-4a3b-aaae-7a9c47e4934f req-7230cd8f-12cb-478c-ac7e-c3f7d3cb110c tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:27.542876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4d6ea811-e9f3-4a3b-aaae-7a9c47e4934f req-7230cd8f-12cb-478c-ac7e-c3f7d3cb110c tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Synchronizing usage tracker for tenant:df509deac95f4a6298820b86cc7c9da9 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:15:27.713222 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:27.804421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:27.805164 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:27.813117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Deleting port 5078e1c4-c56d-4859-ac6d-58bc909054a7 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:27.813701 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:27.848024 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-035a822b-42b9-4007-9bf5-52adbd56c153 None None] Provisioning for port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:15:27.853018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-035a822b-42b9-4007-9bf5-52adbd56c153 None None] Provisioning complete for port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:15:27.853500 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-035a822b-42b9-4007-9bf5-52adbd56c153 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:27.863217 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4d6ea811-e9f3-4a3b-aaae-7a9c47e4934f req-7230cd8f-12cb-478c-ac7e-c3f7d3cb110c tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Unset dirty status for tenant:df509deac95f4a6298820b86cc7c9da9 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:15:27.872015 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d6ea811-e9f3-4a3b-aaae-7a9c47e4934f req-7230cd8f-12cb-478c-ac7e-c3f7d3cb110c tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/ports?device_id=590df846-b8e7-4847-aeec-9f7ff7b352e6 HTTP/1.1" status: 200 len: 931 time: 0.8564715 May 12 15:15:27.903259 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8ee9ff5-e24e-4ed6-99e0-332c9b6e0fa5 None None] DHCP port deletion for 13bc975a-b248-4de3-b27d-6d14b7951c4b request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:15:27.906991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c60b56fe-7d08-40dd-80fd-a96cda80ac8e req-cfab4c05-03ac-49b1-8f8f-2a82b9ac71f2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4720445 May 12 15:15:27.912264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c8ee9ff5-e24e-4ed6-99e0-332c9b6e0fa5 None None] Deleting port 5078e1c4-c56d-4859-ac6d-58bc909054a7 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:27.912670 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c8ee9ff5-e24e-4ed6-99e0-332c9b6e0fa5 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:27.921157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d532f4c0-b453-4814-bcbf-09aa93f23025 req-4fb04e72-dfb6-42ad-ab47-cae820b65186 service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4824634 May 12 15:15:27.921441 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7d47d959-bb3e-4e05-b8e9-713ea76c6b91 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 2.5063498 May 12 15:15:27.949242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'port': {'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726', 'admin_state_up': True, 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'security_groups': ['98320268-f290-4c75-8a2a-57916de87f04']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:28.243203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c8ee9ff5-e24e-4ed6-99e0-332c9b6e0fa5 None None] For port 5078e1c4-c56d-4859-ac6d-58bc909054a7, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5078e1c4-c56d-4859-ac6d-58bc909054a7,segment=NetworkSegment(fc4158ff-96b8-4d00-981b-81b5cdb89988),segment_id=fc4158ff-96b8-4d00-981b-81b5cdb89988)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:28.244240 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c8ee9ff5-e24e-4ed6-99e0-332c9b6e0fa5 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:28.297240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d532f4c0-b453-4814-bcbf-09aa93f23025 req-6e59f000-25d2-4ea1-a9fc-fbe7c863ff87 service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3347237 May 12 15:15:28.310305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d6ea811-e9f3-4a3b-aaae-7a9c47e4934f req-72a50fe8-9a85-4712-9233-af868f78cff7 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/security-groups?id=bac8477b-d8ec-449d-8f9e-8a0d9a1df32c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4372692 May 12 15:15:28.416065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c8ee9ff5-e24e-4ed6-99e0-332c9b6e0fa5 None None] Calling delete_port for 5078e1c4-c56d-4859-ac6d-58bc909054a7 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:15:28.433379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] For port 5078e1c4-c56d-4859-ac6d-58bc909054a7, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5078e1c4-c56d-4859-ac6d-58bc909054a7,segment=NetworkSegment(fc4158ff-96b8-4d00-981b-81b5cdb89988),segment_id=fc4158ff-96b8-4d00-981b-81b5cdb89988)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:28.437072 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:28.555606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c0221401-ba65-4823-8157-04df90260837 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:28.565995 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-84617942-fa3b-4581-a6d3-2bec40c5b4a5'] response: {'server_uuid': '6062b237-2dea-4593-98c5-e5bcf587f743', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4c1d2d6-213d-4562-8698-2dc7f8f15413', 'code': 200} May 12 15:15:28.578060 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:28.601250 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-035a822b-42b9-4007-9bf5-52adbd56c153 None None] Port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:15:28.634056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Transition to ACTIVE for port object c0221401-ba65-4823-8157-04df90260837 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:28.647747 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:28.653938 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c8ee9ff5-e24e-4ed6-99e0-332c9b6e0fa5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:28.788386 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5078e1c4-c56d-4859-ac6d-58bc909054a7 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:15:28.921827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8ee9ff5-e24e-4ed6-99e0-332c9b6e0fa5 None None] Pushing event deleted for resources: {'Port': ['ID=5078e1c4-c56d-4859-ac6d-58bc909054a7,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:28.923502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 5078e1c4-c56d-4859-ac6d-58bc909054a7 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:15:28.924392 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5078e1c4-c56d-4859-ac6d-58bc909054a7 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:15:28.924392 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4abd2c3a-c517-4d15-805c-d27c45138fec no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:15:28.932373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Calling delete_port for 5078e1c4-c56d-4859-ac6d-58bc909054a7 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:15:28.964036 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8ee9ff5-e24e-4ed6-99e0-332c9b6e0fa5 None None] No DVR routers for this DVR port 5078e1c4-c56d-4859-ac6d-58bc909054a7 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:15:28.966257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 4abd2c3a-c517-4d15-805c-d27c45138fec {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:15:28.966257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4abd2c3a-c517-4d15-805c-d27c45138fec not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:15:29.039241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:29.047235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:port and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:29.051695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for port was recalculated. Used quota:9. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:29.067959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource port. Total usage: 9; quota limit: 500; headroom:491 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:29.081619 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:15:29.082033 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:15:29.082974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Made reservation on behalf of 42581a8af83242e0bb61f84a30bd27a7 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:15:29.086902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:29.244183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Pushing event updated for resources: {'Port': ['ID=c0221401-ba65-4823-8157-04df90260837,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:29.263553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Allocated IP 10.1.1.158 (e6a7ff8f-d7ef-4614-8958-ef6026371726/722dd775-53fe-4359-9d8f-d74143e5ced9/4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:15:29.370436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b74775-04c5-4c7c-b0ce-0642c375aa37 req-0ee1f09b-2b81-4500-a562-09ac06dc9c48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:29.371815 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35b74775-04c5-4c7c-b0ce-0642c375aa37 req-0ee1f09b-2b81-4500-a562-09ac06dc9c48 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 1097 time: 0.4348638 May 12 15:15:29.379376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a8149c-5494-4c10-8967-0f3534ec7d3e req-cbfcb741-d52b-4673-bd43-e2efa53ce694 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:29.381333 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10a8149c-5494-4c10-8967-0f3534ec7d3e req-cbfcb741-d52b-4673-bd43-e2efa53ce694 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 943 time: 0.6229978 May 12 15:15:29.415106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Attempting to bind port c0221401-ba65-4823-8157-04df90260837 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:15:29.415106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Attempting to bind port c0221401-ba65-4823-8157-04df90260837 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '80bcba73-0fe8-433c-8fce-7a57f2e38fc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:15:29.415106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Attempting to bind port c0221401-ba65-4823-8157-04df90260837 on network 03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:29.422481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Port c0221401-ba65-4823-8157-04df90260837 on network 03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:15:29.422481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Attempting to bind port c0221401-ba65-4823-8157-04df90260837 on network 03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:29.434610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cad268f-92a5-40f4-a932-eca0f2843764 req-e5d0060d-48a1-45e1-b624-d84cbe8d20c9 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:29.439903 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cad268f-92a5-40f4-a932-eca0f2843764 req-e5d0060d-48a1-45e1-b624-d84cbe8d20c9 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.5004373 May 12 15:15:29.469970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:15:29.469970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Checking segment: {'id': '80bcba73-0fe8-433c-8fce-7a57f2e38fc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:15:29.470293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Bound using segment: {'id': '80bcba73-0fe8-433c-8fce-7a57f2e38fc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:15:29.470656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Bound port: c0221401-ba65-4823-8157-04df90260837, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '80bcba73-0fe8-433c-8fce-7a57f2e38fc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:15:29.471133 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:29.490424 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:29.508684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Transition to ACTIVE for port object 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:29.536278 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:29.591319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Deleting port 5078e1c4-c56d-4859-ac6d-58bc909054a7 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:29.591670 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:29.599470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35b74775-04c5-4c7c-b0ce-0642c375aa37 req-05aeed49-b8a9-4269-ab83-c14a7f90f1f9 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2146740 May 12 15:15:29.634889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10a8149c-5494-4c10-8967-0f3534ec7d3e req-a31f0eda-846c-4049-8964-00379d17908e tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2129059 May 12 15:15:29.644858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Network e6a7ff8f-d7ef-4614-8958-ef6026371726 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:15:29.682497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:15:29.706072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cad268f-92a5-40f4-a932-eca0f2843764 req-73a54029-9eda-44e2-828f-dff9f3b0297a tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2059100 May 12 15:15:29.732105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] For port c0221401-ba65-4823-8157-04df90260837, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:15:29.736138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] For port c0221401-ba65-4823-8157-04df90260837, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c0221401-ba65-4823-8157-04df90260837,segment=NetworkSegment(80bcba73-0fe8-433c-8fce-7a57f2e38fc5),segment_id=80bcba73-0fe8-433c-8fce-7a57f2e38fc5)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:15:29.747474 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:29.784710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:15:29.829966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:29.830570 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:29.850028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] The port '5078e1c4-c56d-4859-ac6d-58bc909054a7' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:15:29.850327 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] 10.222.0.76 "PUT /v2.0/ports/c0221401-ba65-4823-8157-04df90260837 HTTP/1.1" status: 200 len: 1091 time: 2.9891040 May 12 15:15:29.851142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '590df846-b8e7-4847-aeec-9f7ff7b352e6', 'tag': 'c0221401-ba65-4823-8157-04df90260837'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:29.975922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'Port': ['ID=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:30.080646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:30.081443 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:30.101836 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:30.116179 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3b7d174-a7ad-4936-800b-1019c27197c7 service neutron] Pushing event updated for resources: {'Port': ['ID=c0221401-ba65-4823-8157-04df90260837,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:30.134032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-824f5e3a-55bd-444e-883c-61b5237f29a3 None None] Provisioning for port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:15:30.142808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-824f5e3a-55bd-444e-883c-61b5237f29a3 None None] Provisioning complete for port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:15:30.143910 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-824f5e3a-55bd-444e-883c-61b5237f29a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:30.152434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['13bc975a-b248-4de3-b27d-6d14b7951c4b']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:30.160811 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-871c5a32-784d-4ad0-9035-912117fdbc32 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2242358 May 12 15:15:30.167946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fc4158ff-96b8-4d00-981b-81b5cdb89988') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:30.168484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fc4158ff-96b8-4d00-981b-81b5cdb89988') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:30.174156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2961acd-3c3c-48ec-b847-ed22c440673b req-f463afd6-f189-45a8-afea-8be28ad064ea tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:30.182855 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2961acd-3c3c-48ec-b847-ed22c440673b req-f463afd6-f189-45a8-afea-8be28ad064ea tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b HTTP/1.1" status: 200 len: 945 time: 0.3031569 May 12 15:15:30.183708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'port': {'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'fixed_ips': [{'ip_address': '10.2.2.100'}], 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a', 'admin_state_up': True, 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'security_groups': ['98320268-f290-4c75-8a2a-57916de87f04']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:30.203540 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:30.210684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-824f5e3a-55bd-444e-883c-61b5237f29a3 None None] Port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:15:30.234030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65f65246-f408-45a2-9fef-0f630746c8ac req-632846db-fd48-44be-af4f-8123d49b3ecb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:30.242810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65f65246-f408-45a2-9fef-0f630746c8ac req-632846db-fd48-44be-af4f-8123d49b3ecb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:30.251241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65f65246-f408-45a2-9fef-0f630746c8ac req-632846db-fd48-44be-af4f-8123d49b3ecb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:30.253699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65f65246-f408-45a2-9fef-0f630746c8ac req-632846db-fd48-44be-af4f-8123d49b3ecb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 2373 time: 0.2471433 May 12 15:15:30.258283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-5f3e7297-2a9c-46ff-b2ec-dc2d01066851 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:30.260883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-5f3e7297-2a9c-46ff-b2ec-dc2d01066851 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=df509deac95f4a6298820b86cc7c9da9&device_id=590df846-b8e7-4847-aeec-9f7ff7b352e6 HTTP/1.1" status: 200 len: 1094 time: 0.2554781 May 12 15:15:30.294879 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:30.307683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Releasing vlan 596 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:15:30.308550 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: timer() May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:15:30.322247 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:15:30.352965 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2961acd-3c3c-48ec-b847-ed22c440673b req-4c2718a1-063b-4027-b02a-a321e28e8e80 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1691215 May 12 15:15:30.378024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-7d4a47a8-d531-4ced-aad6-2e7489e82440 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c0221401-ba65-4823-8157-04df90260837 HTTP/1.1" status: 200 len: 217 time: 0.0938432 May 12 15:15:30.437205 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:30.439285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:30.442934 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65f65246-f408-45a2-9fef-0f630746c8ac req-348b3957-11ee-49b3-8c94-7472ea8877fe tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1764071 May 12 15:15:30.456733 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:30.462033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:port and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:30.466265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for port was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:30.475720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] Pushing event deleted for resources: {'Network': ['ID=13bc975a-b248-4de3-b27d-6d14b7951c4b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:30.477714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource port. Total usage: 10; quota limit: 500; headroom:490 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:30.499083 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e0b0aa1e-370b-4c35-bd3d-539ffd6b4389 admin admin] 10.222.0.82 "DELETE /v2.0/networks/13bc975a-b248-4de3-b27d-6d14b7951c4b HTTP/1.1" status: 204 len: 168 time: 3.0474648 May 12 15:15:30.499083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Made reservation on behalf of 42581a8af83242e0bb61f84a30bd27a7 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:15:30.519630 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8820ad0f-59aa-4def-9ba7-0d5bf52e36a0'] response: {'name': 'network-changed', 'server_uuid': '590df846-b8e7-4847-aeec-9f7ff7b352e6', 'tag': 'c0221401-ba65-4823-8157-04df90260837', 'status': 'completed', 'code': 200} May 12 15:15:30.538454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-48f92a1a-724d-4f27-96bd-4d96fcb2e7a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:30.539880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-48f92a1a-724d-4f27-96bd-4d96fcb2e7a5 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=295f68b4-8c5b-4424-9ddc-bd5a4dbfbfae HTTP/1.1" status: 200 len: 861 time: 0.1528823 May 12 15:15:30.602427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-d9a9b00e-3628-4e78-803f-6fa1f0c6da42 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0524807 May 12 15:15:30.636766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbb20d47-d6c2-4870-b71f-d6618c6e0aab req-bfbf6fad-3a24-4fd5-9ab3-f98d0af98c17 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:30.639577 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bbb20d47-d6c2-4870-b71f-d6618c6e0aab req-bfbf6fad-3a24-4fd5-9ab3-f98d0af98c17 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/ports?device_id=590df846-b8e7-4847-aeec-9f7ff7b352e6 HTTP/1.1" status: 200 len: 943 time: 0.1795249 May 12 15:15:30.672328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54562) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:30.703385 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:30.851802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bbb20d47-d6c2-4870-b71f-d6618c6e0aab req-7656c756-2acb-4a1b-8214-8a1444a9d33e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/security-groups?id=bac8477b-d8ec-449d-8f9e-8a0d9a1df32c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1887026 May 12 15:15:30.852428 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8c14e7ea-6be0-4439-a926-780e822c60a1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a687923521d64fba8b0ceae3dbf4d7d3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1789591 May 12 15:15:30.856184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54570) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:30.903959 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-34ff8733-ef26-45f4-9e6c-b47bcc5c7603 service neutron] 10.222.0.76 "GET /v2.0/networks/03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2633991 May 12 15:15:30.964105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccc33894-8f66-4b1e-8d36-c3fec3c9d8de req-4271d817-72f5-43d3-8cea-2058d68496a9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:30.971235 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ccc33894-8f66-4b1e-8d36-c3fec3c9d8de req-4271d817-72f5-43d3-8cea-2058d68496a9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab8299d7-c09c-426b-bd43-a7208f66c4a4 HTTP/1.1" status: 200 len: 945 time: 0.3037891 May 12 15:15:31.033445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Allocated IP 10.2.2.100 (c5f75c23-a033-42fa-b7cd-dcbda413fa9a/6457d378-be74-408c-98d5-b411738c6998/097f632d-3127-4539-ba4a-3e2739125cf8) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:15:31.140306 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e46a9d84-3514-40d6-8a4c-582d5115bb5d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:31.156455 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ccc33894-8f66-4b1e-8d36-c3fec3c9d8de req-c1358b1f-7b32-4f19-af1a-924173c1c50f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1841209 May 12 15:15:31.226527 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e46a9d84-3514-40d6-8a4c-582d5115bb5d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:31.375316 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:31.393738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Transition to ACTIVE for port object 097f632d-3127-4539-ba4a-3e2739125cf8 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:31.414439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cee28bf2-5a10-4833-abc9-54e455ae75db req-30b9989f-cef4-4de9-bcb5-c98b83d1d795 service neutron] 10.222.0.76 "GET /v2.0/networks/03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4938519 May 12 15:15:31.421152 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:31.471073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce86ba05-121b-4588-a2a9-ba49f2b0c424 req-53348e8c-8655-418e-a20e-6a1707e9b30d tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:31.472523 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce86ba05-121b-4588-a2a9-ba49f2b0c424 req-53348e8c-8655-418e-a20e-6a1707e9b30d tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 943 time: 0.4866810 May 12 15:15:31.505437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Network c5f75c23-a033-42fa-b7cd-dcbda413fa9a is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:15:31.508694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:15:31.512330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:15:31.559904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:15:31.581592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'Port': ['ID=097f632d-3127-4539-ba4a-3e2739125cf8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:31.610738 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e46a9d84-3514-40d6-8a4c-582d5115bb5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:31.612950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:31.613806 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:31.638965 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce86ba05-121b-4588-a2a9-ba49f2b0c424 req-85bb1941-2bfa-4daa-b694-b2de323321d7 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1238825 May 12 15:15:31.643631 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-a3d0231f-86a0-45a5-a380-c88d9e2fc45e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4678218 May 12 15:15:31.668501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'port': {'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'fixed_ips': [{'ip_address': '10.2.2.200'}], 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a', 'admin_state_up': True, 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'security_groups': ['98320268-f290-4c75-8a2a-57916de87f04']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:31.669205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e46a9d84-3514-40d6-8a4c-582d5115bb5d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=acb87c27-050e-44b1-859d-2cd063c51659,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:31.683743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b03be5b-c774-436e-8cea-61b10eaddf26 req-fe69b713-3ef5-4d4b-9257-71fc8343f96d tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:31.684360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b03be5b-c774-436e-8cea-61b10eaddf26 req-fe69b713-3ef5-4d4b-9257-71fc8343f96d tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.3167133 May 12 15:15:31.718279 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e46a9d84-3514-40d6-8a4c-582d5115bb5d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:31.734984 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e46a9d84-3514-40d6-8a4c-582d5115bb5d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/acb87c27-050e-44b1-859d-2cd063c51659 HTTP/1.1" status: 204 len: 168 time: 0.8624198 May 12 15:15:31.765920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98510758-9624-4d15-8a0d-479fe38106cd req-22be4f02-cc22-4e73-9695-305dc45e9d52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:31.771184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-98510758-9624-4d15-8a0d-479fe38106cd req-22be4f02-cc22-4e73-9695-305dc45e9d52 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=df509deac95f4a6298820b86cc7c9da9&device_id=590df846-b8e7-4847-aeec-9f7ff7b352e6 HTTP/1.1" status: 200 len: 1094 time: 0.2954614 May 12 15:15:31.796778 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b03be5b-c774-436e-8cea-61b10eaddf26 req-640b8082-de72-46fe-99f6-6efad317fc4a tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1021450 May 12 15:15:31.815120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:31.886236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c', 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726', 'port_id': '294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c', 'mac_address': 'fa:16:3e:3a:4f:74', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 587, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2c6ef05c-5190-47b2-bba9-0d2bdacd727d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:15:31.923800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6438c8fc-1996-42a1-b543-d5c63e25ce8b None None] Provisioning for port 097f632d-3127-4539-ba4a-3e2739125cf8 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:15:31.935765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6438c8fc-1996-42a1-b543-d5c63e25ce8b None None] Provisioning complete for port 097f632d-3127-4539-ba4a-3e2739125cf8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:15:31.936397 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6438c8fc-1996-42a1-b543-d5c63e25ce8b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:31.988560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:31.994564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Usage tracker for resource:port and tenant:42581a8af83242e0bb61f84a30bd27a7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:31.998153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Quota usage for port was recalculated. Used quota:11. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:32.005569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attempting to reserve 1 items for resource port. Total usage: 11; quota limit: 500; headroom:489 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:32.015931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6438c8fc-1996-42a1-b543-d5c63e25ce8b None None] Port 097f632d-3127-4539-ba4a-3e2739125cf8 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:15:32.020404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Made reservation on behalf of 42581a8af83242e0bb61f84a30bd27a7 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:15:32.031090 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:32.044253 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:32.085036 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:32.108745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98510758-9624-4d15-8a0d-479fe38106cd req-48e597d8-8176-4d7d-ad37-6e39d4ecbe6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:32.111039 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-98510758-9624-4d15-8a0d-479fe38106cd req-48e597d8-8176-4d7d-ad37-6e39d4ecbe6e service neutron] 10.222.0.76 "GET /v2.0/networks?id=03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8 HTTP/1.1" status: 200 len: 922 time: 0.3298666 May 12 15:15:32.132936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:32.139672 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:32.202932 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:32.204340 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-98510758-9624-4d15-8a0d-479fe38106cd req-72292674-f80d-4b6e-8afc-bc33f2161df8 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c0221401-ba65-4823-8157-04df90260837 HTTP/1.1" status: 200 len: 217 time: 0.0820787 May 12 15:15:32.233859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:32.261940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:15:32.306286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98510758-9624-4d15-8a0d-479fe38106cd req-52b0a1d5-6689-482c-95d9-68cce2c3a908 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:32.308809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-98510758-9624-4d15-8a0d-479fe38106cd req-52b0a1d5-6689-482c-95d9-68cce2c3a908 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=295f68b4-8c5b-4424-9ddc-bd5a4dbfbfae HTTP/1.1" status: 200 len: 861 time: 0.0953884 May 12 15:15:32.332459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b59626a5-2cb8-42ca-9c97-0ef9b51895df req-8ff604b3-3669-4469-8a65-3600a45f7853 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:32.334500 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b59626a5-2cb8-42ca-9c97-0ef9b51895df req-8ff604b3-3669-4469-8a65-3600a45f7853 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b HTTP/1.1" status: 200 len: 945 time: 0.3443899 May 12 15:15:32.384276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52bf3159-f985-43fa-9adf-f776c0ef9df5 req-5620c09e-07a8-4d3f-970f-d4bbe55f6619 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:32.390922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52bf3159-f985-43fa-9adf-f776c0ef9df5 req-5620c09e-07a8-4d3f-970f-d4bbe55f6619 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:32.396849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52bf3159-f985-43fa-9adf-f776c0ef9df5 req-5620c09e-07a8-4d3f-970f-d4bbe55f6619 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:32.402873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52bf3159-f985-43fa-9adf-f776c0ef9df5 req-5620c09e-07a8-4d3f-970f-d4bbe55f6619 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:32.404660 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52bf3159-f985-43fa-9adf-f776c0ef9df5 req-5620c09e-07a8-4d3f-970f-d4bbe55f6619 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 3094 time: 0.4156647 May 12 15:15:32.449724 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-98510758-9624-4d15-8a0d-479fe38106cd req-b67a66a2-55d1-4260-a48c-8887756973e0 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1316793 May 12 15:15:32.475158 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Allocated IP 10.2.2.200 (c5f75c23-a033-42fa-b7cd-dcbda413fa9a/6457d378-be74-408c-98d5-b411738c6998/b8aacb03-fed3-4aed-b3cf-8c58c91ef18e) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:15:32.516571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b59626a5-2cb8-42ca-9c97-0ef9b51895df req-14052867-917d-423d-b4e3-b5a542c81462 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1060600 May 12 15:15:32.608560 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52bf3159-f985-43fa-9adf-f776c0ef9df5 req-7d2d6ec2-bf70-48ae-bc5e-e196a75e9f1e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1739981 May 12 15:15:32.874357 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:32.895224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Transition to ACTIVE for port object b8aacb03-fed3-4aed-b3cf-8c58c91ef18e will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:32.906301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-98510758-9624-4d15-8a0d-479fe38106cd req-a88dabe0-348e-43d8-9ebc-4b194e2857b1 service neutron] 10.222.0.76 "GET /v2.0/networks/03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4236629 May 12 15:15:32.927324 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:33.007249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Network c5f75c23-a033-42fa-b7cd-dcbda413fa9a is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:15:33.011300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:15:33.017803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:15:33.066300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event updated for resources: {'Port': ['ID=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:33.087502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5be0f8a-915b-4bd2-b8f2-8e7f650fdfab req-f290cbca-eff7-4846-8d03-ac079842699a tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:33.095483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5be0f8a-915b-4bd2-b8f2-8e7f650fdfab req-f290cbca-eff7-4846-8d03-ac079842699a tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.3684664 May 12 15:15:33.123516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:33.124180 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:33.146746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73e55df2-ea52-41f6-b9bf-da6dd0405bb5 req-7ecce3b2-ea3d-4ba8-b0ab-3046f564070a tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:33.155626 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73e55df2-ea52-41f6-b9bf-da6dd0405bb5 req-7ecce3b2-ea3d-4ba8-b0ab-3046f564070a tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/ports?device_id=590df846-b8e7-4847-aeec-9f7ff7b352e6 HTTP/1.1" status: 200 len: 943 time: 0.3353608 May 12 15:15:33.160622 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b8c237f5-95c7-492d-8fa3-0a8cf8411106 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5001857 May 12 15:15:33.187237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Request body: {'port': {'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:33.242954 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5be0f8a-915b-4bd2-b8f2-8e7f650fdfab req-20848721-bf07-41b2-b03a-6abc0c90acf7 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1454017 May 12 15:15:33.254542 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-98510758-9624-4d15-8a0d-479fe38106cd req-d1261650-ddf7-419a-8ef3-45f0ed6acd85 service neutron] 10.222.0.76 "GET /v2.0/networks/03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3294106 May 12 15:15:33.291634 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73e55df2-ea52-41f6-b9bf-da6dd0405bb5 req-02b4b596-f7fa-4e6c-a988-ad1e76a73156 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/security-groups?id=bac8477b-d8ec-449d-8f9e-8a0d9a1df32c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1353247 May 12 15:15:33.376563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-af511464-94b3-415b-8762-d6d8c0f89045 None None] Provisioning for port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:15:33.386976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-af511464-94b3-415b-8762-d6d8c0f89045 None None] Provisioning complete for port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:15:33.389999 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-af511464-94b3-415b-8762-d6d8c0f89045 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:33.390162 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:33.503428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-af511464-94b3-415b-8762-d6d8c0f89045 None None] Port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:15:33.559111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 2483265a-0012-4339-be86-677490680e84 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:15:33.648172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7633471-31ad-4f0d-9cc7-237f63e0f2d7 req-c40b4b1f-6479-4d65-8ef9-ec67e0c0cda1 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:33.654346 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7633471-31ad-4f0d-9cc7-237f63e0f2d7 req-c40b4b1f-6479-4d65-8ef9-ec67e0c0cda1 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 943 time: 0.1662238 May 12 15:15:33.753204 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 2483265a-0012-4339-be86-677490680e84, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2483265a-0012-4339-be86-677490680e84,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:33.768780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:15:33.770987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7633471-31ad-4f0d-9cc7-237f63e0f2d7 req-dc072958-7b78-4d33-b460-ce7f90124b8d tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1134815 May 12 15:15:33.801638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '2483265a-0012-4339-be86-677490680e84', 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28', 'port_id': '2483265a-0012-4339-be86-677490680e84', 'mac_address': 'fa:16:3e:b4:1b:a5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 579, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ed7d4325-c4dc-4592-8d41-1f3fe41da585', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:15:33.885161 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:33.909239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2483265a-0012-4339-be86-677490680e84 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:33.952739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 2483265a-0012-4339-be86-677490680e84, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2483265a-0012-4339-be86-677490680e84,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:34.006908 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:34.012000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c0221401-ba65-4823-8157-04df90260837 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:15:34.107857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 026a86ba-df92-4de2-9f16-6e6b8794d1df {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:34.126623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:15:34.130760 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:34.136353 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:34.190932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Transition to ACTIVE for port object 026a86ba-df92-4de2-9f16-6e6b8794d1df will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:34.203974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:34.394096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=2483265a-0012-4339-be86-677490680e84,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:34.563166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4638159b-130d-4fec-a33e-2dc6b043fac8 req-27dff877-b73b-41ae-a637-ca21877abff0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:34.569874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4638159b-130d-4fec-a33e-2dc6b043fac8 req-27dff877-b73b-41ae-a637-ca21877abff0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:34.577838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4638159b-130d-4fec-a33e-2dc6b043fac8 req-27dff877-b73b-41ae-a637-ca21877abff0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:34.585187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4638159b-130d-4fec-a33e-2dc6b043fac8 req-27dff877-b73b-41ae-a637-ca21877abff0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:34.593076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4638159b-130d-4fec-a33e-2dc6b043fac8 req-27dff877-b73b-41ae-a637-ca21877abff0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:34.594988 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4638159b-130d-4fec-a33e-2dc6b043fac8 req-27dff877-b73b-41ae-a637-ca21877abff0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 3827 time: 0.3339288 May 12 15:15:34.615298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e8e40db-788f-4d2a-9eb9-25727b2ddac8 req-53c2e358-6bb2-48ba-a6b6-e03abf213445 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:34.617203 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e8e40db-788f-4d2a-9eb9-25727b2ddac8 req-53c2e358-6bb2-48ba-a6b6-e03abf213445 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b HTTP/1.1" status: 200 len: 945 time: 0.2704358 May 12 15:15:34.659684 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:34.707283 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c0221401-ba65-4823-8157-04df90260837, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c0221401-ba65-4823-8157-04df90260837,segment=NetworkSegment(80bcba73-0fe8-433c-8fce-7a57f2e38fc5),segment_id=80bcba73-0fe8-433c-8fce-7a57f2e38fc5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:34.715950 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4638159b-130d-4fec-a33e-2dc6b043fac8 req-89d4b11c-ca2a-499d-9693-facf7cc6612e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0944467 May 12 15:15:34.739041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'c0221401-ba65-4823-8157-04df90260837', 'network_id': '03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8', 'port_id': 'c0221401-ba65-4823-8157-04df90260837', 'mac_address': 'fa:16:3e:91:48:c4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 572, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '295f68b4-8c5b-4424-9ddc-bd5a4dbfbfae', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:15:34.761132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Pushing event updated for resources: {'Port': ['ID=026a86ba-df92-4de2-9f16-6e6b8794d1df,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:34.788300 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e8e40db-788f-4d2a-9eb9-25727b2ddac8 req-a1d36b69-2ce8-49ad-9dc1-70ae36d3433f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1160016 May 12 15:15:34.801409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e012dc12-9257-4f1f-bf64-5f38b5e69a5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:34.815292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Attempting to bind port 026a86ba-df92-4de2-9f16-6e6b8794d1df on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:15:34.815816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Attempting to bind port 026a86ba-df92-4de2-9f16-6e6b8794d1df by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '7c4990b9-5a5f-484e-a357-c9a37d811129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:15:34.816658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Attempting to bind port 026a86ba-df92-4de2-9f16-6e6b8794d1df on network 939fdac4-3043-4213-bd31-a421a6c659bc {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:34.840745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Port 026a86ba-df92-4de2-9f16-6e6b8794d1df on network 939fdac4-3043-4213-bd31-a421a6c659bc not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:15:34.840745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Attempting to bind port 026a86ba-df92-4de2-9f16-6e6b8794d1df on network 939fdac4-3043-4213-bd31-a421a6c659bc {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:34.849689 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:34.857185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:15:34.860538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Checking segment: {'id': '7c4990b9-5a5f-484e-a357-c9a37d811129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:15:34.861079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Bound using segment: {'id': '7c4990b9-5a5f-484e-a357-c9a37d811129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:15:34.861703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Bound port: 026a86ba-df92-4de2-9f16-6e6b8794d1df, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7c4990b9-5a5f-484e-a357-c9a37d811129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:15:34.863243 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:34.863772 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:34.967017 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:35.014211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c0221401-ba65-4823-8157-04df90260837 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:35.035088 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c0221401-ba65-4823-8157-04df90260837, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c0221401-ba65-4823-8157-04df90260837,segment=NetworkSegment(80bcba73-0fe8-433c-8fce-7a57f2e38fc5),segment_id=80bcba73-0fe8-433c-8fce-7a57f2e38fc5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:35.046254 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:35.050578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:35.078388 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] For port 026a86ba-df92-4de2-9f16-6e6b8794d1df, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:15:35.087340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] For port 026a86ba-df92-4de2-9f16-6e6b8794d1df, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=026a86ba-df92-4de2-9f16-6e6b8794d1df,segment=NetworkSegment(7c4990b9-5a5f-484e-a357-c9a37d811129),segment_id=7c4990b9-5a5f-484e-a357-c9a37d811129)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:15:35.102408 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:35.172872 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:35.181091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:35.183046 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] 10.222.0.84 "PUT /v2.0/ports/026a86ba-df92-4de2-9f16-6e6b8794d1df HTTP/1.1" status: 200 len: 1091 time: 2.0070884 May 12 15:15:35.188646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': '026a86ba-df92-4de2-9f16-6e6b8794d1df'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:35.242692 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c0221401-ba65-4823-8157-04df90260837,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:35.308620 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc839a5e-975c-45c3-8f68-61dceec4e9af service neutron] Pushing event updated for resources: {'Port': ['ID=026a86ba-df92-4de2-9f16-6e6b8794d1df,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:35.383910 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Request body: {'port': {'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:35.410848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['2483265a-0012-4339-be86-677490680e84'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:15:35.446762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c0221401-ba65-4823-8157-04df90260837'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:15:35.592846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85b42a6b-764d-447e-8899-e0abf7334c7e req-294bde35-81e4-448d-a4c2-1115624ee875 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:35.600744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85b42a6b-764d-447e-8899-e0abf7334c7e req-294bde35-81e4-448d-a4c2-1115624ee875 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/ports?device_id=590df846-b8e7-4847-aeec-9f7ff7b352e6 HTTP/1.1" status: 200 len: 944 time: 0.6582882 May 12 15:15:35.624918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:35.706907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-4562dc56-ba0a-4525-915b-d7fddaee923b tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:35.712172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e3204a1-0b02-4e13-93d3-dbcc84a05fea req-04864aad-4e92-44cf-b66d-f22a925c5c20 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:35.713636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-1e3204a1-0b02-4e13-93d3-dbcc84a05fea req-04864aad-4e92-44cf-b66d-f22a925c5c20 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Synchronizing usage tracker for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:15:35.717595 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-4562dc56-ba0a-4525-915b-d7fddaee923b tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/networks?id=079240cc-25ba-4ba4-a3b0-412d897b19bb HTTP/1.1" status: 200 len: 815 time: 0.6886046 May 12 15:15:35.755179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85b42a6b-764d-447e-8899-e0abf7334c7e req-7beae60d-14c4-4690-8886-71683424d53a tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/security-groups?id=bac8477b-d8ec-449d-8f9e-8a0d9a1df32c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1531482 May 12 15:15:35.784326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-1e3204a1-0b02-4e13-93d3-dbcc84a05fea req-04864aad-4e92-44cf-b66d-f22a925c5c20 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Unset dirty status for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:15:35.792451 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e3204a1-0b02-4e13-93d3-dbcc84a05fea req-04864aad-4e92-44cf-b66d-f22a925c5c20 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "GET /v2.0/ports?device_id=a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b HTTP/1.1" status: 200 len: 945 time: 0.5454245 May 12 15:15:35.796359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-77a830a2-f436-49f5-8e4d-0c6996039555 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/quotas/aca50b48316f40a7a6ceb23c44dd4720 HTTP/1.1" status: 200 len: 375 time: 0.0771601 May 12 15:15:35.900693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f746091b-67b4-4843-bdb2-ef4b48a8dd12 req-5b21556a-63f9-432d-9173-54544834ce76 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:35.903717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f746091b-67b4-4843-bdb2-ef4b48a8dd12 req-5b21556a-63f9-432d-9173-54544834ce76 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.76 "GET /v2.0/ports?device_id=6062b237-2dea-4593-98c5-e5bcf587f743 HTTP/1.1" status: 200 len: 946 time: 0.4201539 May 12 15:15:36.007943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-1e3204a1-0b02-4e13-93d3-dbcc84a05fea req-5c04887b-ea8a-4b62-ace2-c7cb0c4c091e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Deleting port 53ed6996-04cb-443a-92b9-36c84091d88a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:36.008639 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1e3204a1-0b02-4e13-93d3-dbcc84a05fea req-5c04887b-ea8a-4b62-ace2-c7cb0c4c091e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:36.075192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-8874afb7-709d-4e1b-8317-fb316614ebcd tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=aca50b48316f40a7a6ceb23c44dd4720&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2778633 May 12 15:15:36.079814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-f746091b-67b4-4843-bdb2-ef4b48a8dd12 req-590fcda2-35ac-46dc-8dfb-d26df8005b65 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Deleting port b4c1d2d6-213d-4562-8698-2dc7f8f15413 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:36.080598 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f746091b-67b4-4843-bdb2-ef4b48a8dd12 req-590fcda2-35ac-46dc-8dfb-d26df8005b65 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:36.402774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd6e1e75-613a-4feb-8d83-2a8fa8cd691e req-62c2aefb-8af5-4d44-9064-dfeca986652a tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:36.404068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd6e1e75-613a-4feb-8d83-2a8fa8cd691e req-62c2aefb-8af5-4d44-9064-dfeca986652a tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 944 time: 0.3930519 May 12 15:15:36.448787 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-1e3204a1-0b02-4e13-93d3-dbcc84a05fea req-5c04887b-ea8a-4b62-ace2-c7cb0c4c091e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] For port 53ed6996-04cb-443a-92b9-36c84091d88a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=53ed6996-04cb-443a-92b9-36c84091d88a,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:36.449375 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1e3204a1-0b02-4e13-93d3-dbcc84a05fea req-5c04887b-ea8a-4b62-ace2-c7cb0c4c091e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:36.509496 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e8002fdf-6a06-47d6-9363-5b7628431152 service neutron] 10.222.0.82 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3910482 May 12 15:15:36.628441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-1e3204a1-0b02-4e13-93d3-dbcc84a05fea req-5c04887b-ea8a-4b62-ace2-c7cb0c4c091e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Calling delete_port for 53ed6996-04cb-443a-92b9-36c84091d88a owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:15:36.676732 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-96ec054c-4c60-4936-8986-e66b54f5cea4 service neutron] 10.222.0.82 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1662221 May 12 15:15:36.690991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ef28df6f-7573-4910-9fae-c2b49092303b {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:36.703817 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:36.714878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd6e1e75-613a-4feb-8d83-2a8fa8cd691e req-40b5e1c9-8438-4443-bf18-5912a07af04d tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2972324 May 12 15:15:36.735156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Transition to ACTIVE for port object ef28df6f-7573-4910-9fae-c2b49092303b will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:36.794374 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:36.796574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f746091b-67b4-4843-bdb2-ef4b48a8dd12 req-590fcda2-35ac-46dc-8dfb-d26df8005b65 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] For port b4c1d2d6-213d-4562-8698-2dc7f8f15413, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=b4c1d2d6-213d-4562-8698-2dc7f8f15413,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:36.797108 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f746091b-67b4-4843-bdb2-ef4b48a8dd12 req-590fcda2-35ac-46dc-8dfb-d26df8005b65 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:36.814256 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0a08aa48-448b-4475-a15c-e06ba41eecba'] response: {'server_uuid': 'e012dc12-9257-4f1f-bf64-5f38b5e69a5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c', 'code': 200} May 12 15:15:37.005051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Pushing event updated for resources: {'Port': ['ID=ef28df6f-7573-4910-9fae-c2b49092303b,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:37.017304 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8caef04a-817f-4d66-bf5d-40bf75a233ab'] response: {'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': '026a86ba-df92-4de2-9f16-6e6b8794d1df', 'status': 'completed', 'code': 200} May 12 15:15:37.019944 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1e3204a1-0b02-4e13-93d3-dbcc84a05fea req-5c04887b-ea8a-4b62-ace2-c7cb0c4c091e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:37.054091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668', '5fb6e0a8-b27d-442a-857d-367ef3a32588'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:15:37.164880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-f746091b-67b4-4843-bdb2-ef4b48a8dd12 req-590fcda2-35ac-46dc-8dfb-d26df8005b65 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Calling delete_port for b4c1d2d6-213d-4562-8698-2dc7f8f15413 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:15:37.610215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c04887b-ea8a-4b62-ace2-c7cb0c4c091e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event deleted for resources: {'Port': ['ID=53ed6996-04cb-443a-92b9-36c84091d88a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:37.636171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 2483265a-0012-4339-be86-677490680e84 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:15:37.668026 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a68173b-cc23-4b25-a802-250f95125967 req-d7f65e85-95f5-47a7-8faa-5ee65002c86c tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b HTTP/1.1" status: 200 len: 210 time: 0.1519094 May 12 15:15:37.775324 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f746091b-67b4-4843-bdb2-ef4b48a8dd12 req-590fcda2-35ac-46dc-8dfb-d26df8005b65 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:37.876993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c95d01-202a-4159-8598-e687256a46fc req-2dcca0da-3943-452b-96cf-948aad9da65c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:37.877668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c95d01-202a-4159-8598-e687256a46fc req-2dcca0da-3943-452b-96cf-948aad9da65c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:37.878200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c95d01-202a-4159-8598-e687256a46fc req-2dcca0da-3943-452b-96cf-948aad9da65c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:37.878788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c95d01-202a-4159-8598-e687256a46fc req-2dcca0da-3943-452b-96cf-948aad9da65c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:37.879307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c95d01-202a-4159-8598-e687256a46fc req-2dcca0da-3943-452b-96cf-948aad9da65c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:37.879826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c95d01-202a-4159-8598-e687256a46fc req-2dcca0da-3943-452b-96cf-948aad9da65c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:37.881727 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34c95d01-202a-4159-8598-e687256a46fc req-2dcca0da-3943-452b-96cf-948aad9da65c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=42581a8af83242e0bb61f84a30bd27a7&device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5244 time: 0.4064677 May 12 15:15:37.894205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd43c9f-c3ee-4826-bb69-9dbdef0abfde req-cb505630-ed79-4f2a-8fa9-067437dc06e6 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:37.902944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd43c9f-c3ee-4826-bb69-9dbdef0abfde req-cb505630-ed79-4f2a-8fa9-067437dc06e6 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:37.912598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd43c9f-c3ee-4826-bb69-9dbdef0abfde req-cb505630-ed79-4f2a-8fa9-067437dc06e6 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:37.989307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd43c9f-c3ee-4826-bb69-9dbdef0abfde req-cb505630-ed79-4f2a-8fa9-067437dc06e6 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:37.989307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd43c9f-c3ee-4826-bb69-9dbdef0abfde req-cb505630-ed79-4f2a-8fa9-067437dc06e6 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:38.002406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd43c9f-c3ee-4826-bb69-9dbdef0abfde req-cb505630-ed79-4f2a-8fa9-067437dc06e6 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:38.002644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 2483265a-0012-4339-be86-677490680e84 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:15:38.041928 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5cd43c9f-c3ee-4826-bb69-9dbdef0abfde req-cb505630-ed79-4f2a-8fa9-067437dc06e6 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 4600 time: 0.5527184 May 12 15:15:38.044782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 2483265a-0012-4339-be86-677490680e84 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:15:38.044782 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:38.045005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Attempting to bind port ef28df6f-7573-4910-9fae-c2b49092303b on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:15:38.045005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Attempting to bind port ef28df6f-7573-4910-9fae-c2b49092303b by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:15:38.045005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Attempting to bind port ef28df6f-7573-4910-9fae-c2b49092303b on network e6a7ff8f-d7ef-4614-8958-ef6026371726 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:38.060191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-1e3204a1-0b02-4e13-93d3-dbcc84a05fea req-5c04887b-ea8a-4b62-ace2-c7cb0c4c091e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] No DVR routers for this DVR port 53ed6996-04cb-443a-92b9-36c84091d88a on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:15:38.064355 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1e3204a1-0b02-4e13-93d3-dbcc84a05fea req-5c04887b-ea8a-4b62-ace2-c7cb0c4c091e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:38.087729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Port ef28df6f-7573-4910-9fae-c2b49092303b on network e6a7ff8f-d7ef-4614-8958-ef6026371726 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:15:38.087729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Attempting to bind port ef28df6f-7573-4910-9fae-c2b49092303b on network e6a7ff8f-d7ef-4614-8958-ef6026371726 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:38.108218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:15:38.108615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Checking segment: {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:15:38.109013 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Bound using segment: {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:15:38.110450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Bound port: ef28df6f-7573-4910-9fae-c2b49092303b, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:15:38.110993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:38.246060 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e3204a1-0b02-4e13-93d3-dbcc84a05fea req-5c04887b-ea8a-4b62-ace2-c7cb0c4c091e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "DELETE /v2.0/ports/53ed6996-04cb-443a-92b9-36c84091d88a HTTP/1.1" status: 204 len: 173 time: 2.4055481 May 12 15:15:38.294338 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:38.360095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 2483265a-0012-4339-be86-677490680e84, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2483265a-0012-4339-be86-677490680e84,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:38.372670 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:38.375288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c0221401-ba65-4823-8157-04df90260837 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:15:38.395617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-590fcda2-35ac-46dc-8dfb-d26df8005b65 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Pushing event deleted for resources: {'Port': ['ID=b4c1d2d6-213d-4562-8698-2dc7f8f15413,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:38.422308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] For port ef28df6f-7573-4910-9fae-c2b49092303b, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:15:38.437495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] For port ef28df6f-7573-4910-9fae-c2b49092303b, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=ef28df6f-7573-4910-9fae-c2b49092303b,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:15:38.450322 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:38.540315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 53ed6996-04cb-443a-92b9-36c84091d88a no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:15:38.581261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:38.582665 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:38.585788 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] 10.222.0.84 "PUT /v2.0/ports/ef28df6f-7573-4910-9fae-c2b49092303b HTTP/1.1" status: 200 len: 1131 time: 3.2393103 May 12 15:15:38.613743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25bc3c04-6c09-4b4b-b6d0-945579ead872 service neutron] Pushing event updated for resources: {'Port': ['ID=ef28df6f-7573-4910-9fae-c2b49092303b,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:38.647044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 53ed6996-04cb-443a-92b9-36c84091d88a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:15:38.647485 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 53ed6996-04cb-443a-92b9-36c84091d88a not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:15:38.683327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=2483265a-0012-4339-be86-677490680e84,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:38.693170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Request body: {'port': {'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:38.711669 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port c0221401-ba65-4823-8157-04df90260837 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:15:38.727122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port c0221401-ba65-4823-8157-04df90260837 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:15:38.729886 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:38.825979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7396daa3-460c-4d29-88ac-fe6ba33a7244', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2483265a-0012-4339-be86-677490680e84'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:38.935765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-f746091b-67b4-4843-bdb2-ef4b48a8dd12 req-590fcda2-35ac-46dc-8dfb-d26df8005b65 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] No DVR routers for this DVR port b4c1d2d6-213d-4562-8698-2dc7f8f15413 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:15:38.945376 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f746091b-67b4-4843-bdb2-ef4b48a8dd12 req-590fcda2-35ac-46dc-8dfb-d26df8005b65 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:38.957012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6062b237-2dea-4593-98c5-e5bcf587f743', 'name': 'network-vif-deleted', 'tag': 'b4c1d2d6-213d-4562-8698-2dc7f8f15413'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:39.015012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5cd43c9f-c3ee-4826-bb69-9dbdef0abfde req-bf6ce8e1-833b-48b5-a5d9-cff91ce95ee8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.9862280 May 12 15:15:39.024667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b', 'name': 'network-vif-deleted', 'tag': '53ed6996-04cb-443a-92b9-36c84091d88a'}, {'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': 'ef28df6f-7573-4910-9fae-c2b49092303b'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:39.038612 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:39.091071 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f746091b-67b4-4843-bdb2-ef4b48a8dd12 req-590fcda2-35ac-46dc-8dfb-d26df8005b65 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.76 "DELETE /v2.0/ports/b4c1d2d6-213d-4562-8698-2dc7f8f15413 HTTP/1.1" status: 204 len: 173 time: 3.1809580 May 12 15:15:39.092039 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:39.254942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c95d01-202a-4159-8598-e687256a46fc req-de7d6acd-d19a-4728-9e30-22def57637af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:39.258716 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c0221401-ba65-4823-8157-04df90260837, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c0221401-ba65-4823-8157-04df90260837,segment=NetworkSegment(80bcba73-0fe8-433c-8fce-7a57f2e38fc5),segment_id=80bcba73-0fe8-433c-8fce-7a57f2e38fc5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:39.265740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c95d01-202a-4159-8598-e687256a46fc req-de7d6acd-d19a-4728-9e30-22def57637af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:39.268913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c95d01-202a-4159-8598-e687256a46fc req-de7d6acd-d19a-4728-9e30-22def57637af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:39.274889 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:39.279013 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34c95d01-202a-4159-8598-e687256a46fc req-de7d6acd-d19a-4728-9e30-22def57637af service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=42581a8af83242e0bb61f84a30bd27a7&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.9290447 May 12 15:15:39.466273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c0221401-ba65-4823-8157-04df90260837,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:39.550238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c95d01-202a-4159-8598-e687256a46fc req-6720983f-4c31-4d22-9fb6-b0551728748f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:39.551838 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34c95d01-202a-4159-8598-e687256a46fc req-6720983f-4c31-4d22-9fb6-b0551728748f service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2060573 May 12 15:15:39.561051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c527b7d7-1a85-4400-a756-e548feab6b2e req-3f07e12c-39ce-4015-bd41-88f78da44c19 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Synchronizing usage tracker for tenant:aca50b48316f40a7a6ceb23c44dd4720 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:15:39.590575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b4c1d2d6-213d-4562-8698-2dc7f8f15413 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:15:39.599859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cda9f10-57b5-4439-af76-1f4e071fb036 req-d02f1745-933c-40b7-bcaa-8d18119412df tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:39.613443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4cda9f10-57b5-4439-af76-1f4e071fb036 req-d02f1745-933c-40b7-bcaa-8d18119412df tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/ports?device_id=590df846-b8e7-4847-aeec-9f7ff7b352e6 HTTP/1.1" status: 200 len: 944 time: 1.2309120 May 12 15:15:39.638800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c527b7d7-1a85-4400-a756-e548feab6b2e req-3f07e12c-39ce-4015-bd41-88f78da44c19 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Unset dirty status for tenant:aca50b48316f40a7a6ceb23c44dd4720 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:15:39.651612 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c527b7d7-1a85-4400-a756-e548feab6b2e req-3f07e12c-39ce-4015-bd41-88f78da44c19 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 210 time: 0.3714705 May 12 15:15:39.723283 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: b4c1d2d6-213d-4562-8698-2dc7f8f15413 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:15:39.725506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device b4c1d2d6-213d-4562-8698-2dc7f8f15413 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:15:39.783035 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4cda9f10-57b5-4439-af76-1f4e071fb036 req-8b5aceda-7fd1-43d7-b88f-677c5753d595 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/security-groups?id=bac8477b-d8ec-449d-8f9e-8a0d9a1df32c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1680188 May 12 15:15:39.950823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-3a177d61-915a-4400-985a-fbe6dee88869 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:39.953471 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-3a177d61-915a-4400-985a-fbe6dee88869 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.84 "GET /v2.0/networks?id=079240cc-25ba-4ba4-a3b0-412d897b19bb HTTP/1.1" status: 200 len: 815 time: 0.4340539 May 12 15:15:39.982920 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Request body: {'port': {'device_id': 'f829e7c1-6bd8-46ec-96c7-1df321ce49f0', 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb', 'admin_state_up': True, 'tenant_id': 'aca50b48316f40a7a6ceb23c44dd4720'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:40.159195 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad53aa8a-c9a4-4569-bffc-190afed85175 req-b21278ad-cc42-4a05-bd53-d7f3364eb30d tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b HTTP/1.1" status: 200 len: 210 time: 0.0810530 May 12 15:15:40.274456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:40.300173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:40.316267 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-253384d8-108f-4f36-aaa7-17c705636c71'] response: {'server_uuid': '7396daa3-460c-4d29-88ac-fe6ba33a7244', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2483265a-0012-4339-be86-677490680e84', 'code': 200} May 12 15:15:40.347403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Made reservation on behalf of aca50b48316f40a7a6ceb23c44dd4720 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:15:40.351251 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:40.478659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 85b4d43d-f235-4852-bda9-2dc870bb3d11 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:40.490639 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:40.502747 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d1ca79ec-7f68-44b9-ac08-50f98a476388'] response: {'server_uuid': '6062b237-2dea-4593-98c5-e5bcf587f743', 'name': 'network-vif-deleted', 'tag': 'b4c1d2d6-213d-4562-8698-2dc7f8f15413', 'status': 'completed', 'code': 200} May 12 15:15:40.520514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Transition to ACTIVE for port object 85b4d43d-f235-4852-bda9-2dc870bb3d11 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:40.535449 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:40.593922 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ad0907ed-35e0-4642-bdb3-3174025170f9'] response: {'server_uuid': 'a2ebc0b5-a1f5-47b9-bbaa-53fbbfd46e4b', 'name': 'network-vif-deleted', 'tag': '53ed6996-04cb-443a-92b9-36c84091d88a', 'status': 'completed', 'code': 200} May 12 15:15:40.594580 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ad0907ed-35e0-4642-bdb3-3174025170f9'] response: {'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': 'ef28df6f-7573-4910-9fae-c2b49092303b', 'status': 'completed', 'code': 200} May 12 15:15:40.612017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36f002a8-1dac-4303-a5b4-09cd4a862fd7 req-f231450b-319a-41a1-919d-182a090cbe3b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:40.623764 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-36f002a8-1dac-4303-a5b4-09cd4a862fd7 req-f231450b-319a-41a1-919d-182a090cbe3b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 945 time: 0.2904487 May 12 15:15:40.751916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c78328-a46b-441e-a1e3-c5223a9e4140 req-a41f429e-0155-48c5-bd1a-f93eef387b71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:40.755311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0c78328-a46b-441e-a1e3-c5223a9e4140 req-a41f429e-0155-48c5-bd1a-f93eef387b71 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 1096 time: 0.3213544 May 12 15:15:40.772543 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-36f002a8-1dac-4303-a5b4-09cd4a862fd7 req-f3735276-0731-44a8-abab-4eeb37ba79d4 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1423819 May 12 15:15:40.801399 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:15:40.872424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Pushing event updated for resources: {'Port': ['ID=85b4d43d-f235-4852-bda9-2dc870bb3d11,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:41.092987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0c78328-a46b-441e-a1e3-c5223a9e4140 req-2f60cd10-cdd5-481a-a867-eba0cf6c9fad service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3202968 May 12 15:15:41.116644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Attempting to bind port 85b4d43d-f235-4852-bda9-2dc870bb3d11 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:15:41.117223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Attempting to bind port 85b4d43d-f235-4852-bda9-2dc870bb3d11 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:15:41.117372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Attempting to bind port 85b4d43d-f235-4852-bda9-2dc870bb3d11 on network e6a7ff8f-d7ef-4614-8958-ef6026371726 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:41.129081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Port 85b4d43d-f235-4852-bda9-2dc870bb3d11 on network e6a7ff8f-d7ef-4614-8958-ef6026371726 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:15:41.129426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Attempting to bind port 85b4d43d-f235-4852-bda9-2dc870bb3d11 on network e6a7ff8f-d7ef-4614-8958-ef6026371726 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:41.134508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eee604e-e877-4e1d-8941-9a221d6fd5da req-d86b9488-80ab-436c-ac52-86c4ec0d517f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.136846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eee604e-e877-4e1d-8941-9a221d6fd5da req-d86b9488-80ab-436c-ac52-86c4ec0d517f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.137336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eee604e-e877-4e1d-8941-9a221d6fd5da req-d86b9488-80ab-436c-ac52-86c4ec0d517f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.138447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eee604e-e877-4e1d-8941-9a221d6fd5da req-d86b9488-80ab-436c-ac52-86c4ec0d517f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.138447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eee604e-e877-4e1d-8941-9a221d6fd5da req-d86b9488-80ab-436c-ac52-86c4ec0d517f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.138781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eee604e-e877-4e1d-8941-9a221d6fd5da req-d86b9488-80ab-436c-ac52-86c4ec0d517f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.138932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:15:41.139137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Checking segment: {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:15:41.139785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eee604e-e877-4e1d-8941-9a221d6fd5da req-d86b9488-80ab-436c-ac52-86c4ec0d517f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.139930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Bound using segment: {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:15:41.140131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Bound port: 85b4d43d-f235-4852-bda9-2dc870bb3d11, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:15:41.140796 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:41.142068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5eee604e-e877-4e1d-8941-9a221d6fd5da req-d86b9488-80ab-436c-ac52-86c4ec0d517f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=42581a8af83242e0bb61f84a30bd27a7&device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 6166 time: 0.5137038 May 12 15:15:41.347206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Allocated IP 172.20.0.4 (079240cc-25ba-4ba4-a3b0-412d897b19bb/b6cc6b5a-d56a-4336-afb7-99232d9672dc/3a378176-9994-44d1-b14f-a0257262a251) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:15:41.368870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eee604e-e877-4e1d-8941-9a221d6fd5da req-c34f1204-9463-4239-b6e9-5561d8e3aaf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.373553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eee604e-e877-4e1d-8941-9a221d6fd5da req-c34f1204-9463-4239-b6e9-5561d8e3aaf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.375180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eee604e-e877-4e1d-8941-9a221d6fd5da req-c34f1204-9463-4239-b6e9-5561d8e3aaf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.376173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5eee604e-e877-4e1d-8941-9a221d6fd5da req-c34f1204-9463-4239-b6e9-5561d8e3aaf3 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=42581a8af83242e0bb61f84a30bd27a7&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.2086318 May 12 15:15:41.392438 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89a445c7-302a-4647-99f0-c05e46637b4b req-90d86cd7-fdfb-4460-b90c-00c1e3d42680 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 210 time: 0.3109004 May 12 15:15:41.570286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54786) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:41.669235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363203ee-592e-4082-b029-f8fb42f488e7 req-27a4c990-b1ef-4607-90a9-37d956a063d0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.676479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363203ee-592e-4082-b029-f8fb42f488e7 req-27a4c990-b1ef-4607-90a9-37d956a063d0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.686943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363203ee-592e-4082-b029-f8fb42f488e7 req-27a4c990-b1ef-4607-90a9-37d956a063d0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.695705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363203ee-592e-4082-b029-f8fb42f488e7 req-27a4c990-b1ef-4607-90a9-37d956a063d0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.706788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363203ee-592e-4082-b029-f8fb42f488e7 req-27a4c990-b1ef-4607-90a9-37d956a063d0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.717629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363203ee-592e-4082-b029-f8fb42f488e7 req-27a4c990-b1ef-4607-90a9-37d956a063d0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.726622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363203ee-592e-4082-b029-f8fb42f488e7 req-27a4c990-b1ef-4607-90a9-37d956a063d0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.737991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-363203ee-592e-4082-b029-f8fb42f488e7 req-27a4c990-b1ef-4607-90a9-37d956a063d0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5371 time: 0.8234906 May 12 15:15:41.827362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eee604e-e877-4e1d-8941-9a221d6fd5da req-6d07c08f-29a7-4420-ab9a-da0cbca13861 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.829043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5eee604e-e877-4e1d-8941-9a221d6fd5da req-6d07c08f-29a7-4420-ab9a-da0cbca13861 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4356716 May 12 15:15:41.839290 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:41.863469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] For port 85b4d43d-f235-4852-bda9-2dc870bb3d11, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:15:41.876890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] For port 85b4d43d-f235-4852-bda9-2dc870bb3d11, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85b4d43d-f235-4852-bda9-2dc870bb3d11,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:15:41.884511 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff6be703-b789-42e4-bd00-7ed008b275d4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:41.888015 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:41.937479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ff6be703-b789-42e4-bd00-7ed008b275d4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:41.941963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ff6be703-b789-42e4-bd00-7ed008b275d4 admin admin] Usage tracker for resource:security_group_rule and tenant:7ff94e1bfd8d4b848f597eb0a7983391 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:41.944998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ff6be703-b789-42e4-bd00-7ed008b275d4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:41.952826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ff6be703-b789-42e4-bd00-7ed008b275d4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:41.967787 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:41.971468 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:41.974470 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] 10.222.0.84 "PUT /v2.0/ports/85b4d43d-f235-4852-bda9-2dc870bb3d11 HTTP/1.1" status: 200 len: 1129 time: 3.2857788 May 12 15:15:42.053884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Request body: {'port': {'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:42.085015 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff6be703-b789-42e4-bd00-7ed008b275d4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:42.095982 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:42.118803 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff6be703-b789-42e4-bd00-7ed008b275d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:42.196079 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-363203ee-592e-4082-b029-f8fb42f488e7 req-1c4c047b-c5a7-4fe9-95c6-62f7fca4b357 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.4565392 May 12 15:15:42.286087 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ff6be703-b789-42e4-bd00-7ed008b275d4 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7ff94e1bfd8d4b848f597eb0a7983391&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7143281 May 12 15:15:42.302753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54798) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:42.311517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d99314e-ece3-4f20-b945-4147e1b8bb21 service neutron] Pushing event updated for resources: {'Port': ['ID=85b4d43d-f235-4852-bda9-2dc870bb3d11,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:42.317798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '590df846-b8e7-4847-aeec-9f7ff7b352e6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0221401-ba65-4823-8157-04df90260837'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:42.391926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Network 079240cc-25ba-4ba4-a3b0-412d897b19bb is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:15:42.417635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:15:42.449709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:15:42.455722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf5eaf7-021b-42ba-98ea-a3eae9319005 req-3dfaf5b4-be21-402e-afee-f89dc29f4d25 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:42.467871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-adf5eaf7-021b-42ba-98ea-a3eae9319005 req-3dfaf5b4-be21-402e-afee-f89dc29f4d25 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/ports?device_id=590df846-b8e7-4847-aeec-9f7ff7b352e6 HTTP/1.1" status: 200 len: 945 time: 0.8706377 May 12 15:15:42.491708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff6be703-b789-42e4-bd00-7ed008b275d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a94f10f0-2f0f-4b95-8f96-c4b3223d3076,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:42.545975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Pushing event updated for resources: {'Port': ['ID=3a378176-9994-44d1-b14f-a0257262a251,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:42.550479 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:42.569278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:42.570028 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:42.600848 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': '85b4d43d-f235-4852-bda9-2dc870bb3d11'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:42.661956 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a91919e9-a243-470c-bb16-0eba11e0012e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:42.716513 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-64feecc7-3c64-4e96-adcb-931d77d46b74 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.7386229 May 12 15:15:42.748031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Request body: {'port': {'device_id': 'f829e7c1-6bd8-46ec-96c7-1df321ce49f0', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:42.772703 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:42.943078 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ded5b8b4-08c2-4147-949d-21c15a26fb28 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:42.948312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-adf5eaf7-021b-42ba-98ea-a3eae9319005 req-dadc7a75-5c62-4612-9083-c550118c243b tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/security-groups?id=bac8477b-d8ec-449d-8f9e-8a0d9a1df32c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4653327 May 12 15:15:42.997712 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ded5b8b4-08c2-4147-949d-21c15a26fb28 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:43.055360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff3617a2-ba42-45e9-8985-d2cdb2e2a220 req-90d07b3c-efdb-445d-8e4d-3613d877783c tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:43.063499 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ad715a11-db7b-4695-a83c-a6cda6763b3f'] response: {'server_uuid': '590df846-b8e7-4847-aeec-9f7ff7b352e6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0221401-ba65-4823-8157-04df90260837', 'code': 200} May 12 15:15:43.066646 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff3617a2-ba42-45e9-8985-d2cdb2e2a220 req-90d07b3c-efdb-445d-8e4d-3613d877783c tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 945 time: 0.2549596 May 12 15:15:43.124529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:43.247395 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff3617a2-ba42-45e9-8985-d2cdb2e2a220 req-149769ad-2f02-445c-8696-b2d041ab6d59 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1788161 May 12 15:15:43.518014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:43.536929 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:43.547648 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ded5b8b4-08c2-4147-949d-21c15a26fb28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:43.583457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef570bb0-3db3-46c2-957f-e28d06a7e937 req-d9817886-4d83-405a-949d-b4f10ac4efff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:43.584951 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef570bb0-3db3-46c2-957f-e28d06a7e937 req-d9817886-4d83-405a-949d-b4f10ac4efff service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=590df846-b8e7-4847-aeec-9f7ff7b352e6 HTTP/1.1" status: 200 len: 1096 time: 0.4359753 May 12 15:15:43.638441 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ded5b8b4-08c2-4147-949d-21c15a26fb28 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:43.642645 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ded5b8b4-08c2-4147-949d-21c15a26fb28 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a94f10f0-2f0f-4b95-8f96-c4b3223d3076 HTTP/1.1" status: 204 len: 168 time: 1.3340852 May 12 15:15:43.643992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ded5b8b4-08c2-4147-949d-21c15a26fb28 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a94f10f0-2f0f-4b95-8f96-c4b3223d3076,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:43.670346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Transition to ACTIVE for port object c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:43.695948 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:43.716883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef570bb0-3db3-46c2-957f-e28d06a7e937 req-3d5ad192-2d9d-40fe-9d01-50fcd0c152cc service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=bac8477b-d8ec-449d-8f9e-8a0d9a1df32c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1210036 May 12 15:15:43.745695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7dba158-31bc-435b-8bf0-5a0559ef5e39 req-cadd16dc-5b77-45a5-8e90-248b6fc47381 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:43.749200 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7dba158-31bc-435b-8bf0-5a0559ef5e39 req-cadd16dc-5b77-45a5-8e90-248b6fc47381 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 931 time: 0.4609053 May 12 15:15:43.897591 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7dba158-31bc-435b-8bf0-5a0559ef5e39 req-5839b33a-a87d-42fa-bee0-c4252e1beb59 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1385133 May 12 15:15:44.011020 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3d486aa5-e315-43ca-b1c3-2885f0f53d9d'] response: {'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': '85b4d43d-f235-4852-bda9-2dc870bb3d11', 'status': 'completed', 'code': 200} May 12 15:15:44.171699 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Pushing event updated for resources: {'Port': ['ID=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:44.383208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26462d8-8e93-489f-9824-1967fa6e1907 req-755f80c9-b555-49f2-b604-15adfe085984 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.383883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26462d8-8e93-489f-9824-1967fa6e1907 req-755f80c9-b555-49f2-b604-15adfe085984 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.386037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26462d8-8e93-489f-9824-1967fa6e1907 req-755f80c9-b555-49f2-b604-15adfe085984 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.387581 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26462d8-8e93-489f-9824-1967fa6e1907 req-755f80c9-b555-49f2-b604-15adfe085984 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.387887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26462d8-8e93-489f-9824-1967fa6e1907 req-755f80c9-b555-49f2-b604-15adfe085984 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.388612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26462d8-8e93-489f-9824-1967fa6e1907 req-755f80c9-b555-49f2-b604-15adfe085984 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.389465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26462d8-8e93-489f-9824-1967fa6e1907 req-755f80c9-b555-49f2-b604-15adfe085984 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.397469 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e26462d8-8e93-489f-9824-1967fa6e1907 req-755f80c9-b555-49f2-b604-15adfe085984 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=42581a8af83242e0bb61f84a30bd27a7&device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 6233 time: 0.4321008 May 12 15:15:44.510632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Attempting to bind port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:15:44.510632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Attempting to bind port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:15:44.510889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Attempting to bind port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c on network e6a7ff8f-d7ef-4614-8958-ef6026371726 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:44.531020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c on network e6a7ff8f-d7ef-4614-8958-ef6026371726 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:15:44.531625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Attempting to bind port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c on network e6a7ff8f-d7ef-4614-8958-ef6026371726 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:44.539606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:15:44.539740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Checking segment: {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:15:44.540020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Bound using segment: {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:15:44.540448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Bound port: c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:15:44.540789 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:44.559757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3a378176-9994-44d1-b14f-a0257262a251 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:44.569814 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:44.649286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Transition to ACTIVE for port object 3a378176-9994-44d1-b14f-a0257262a251 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:44.658676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9ec6f2-734c-4386-a52e-91a4fcea17c1 req-5e90d128-55ce-4109-a59a-a3b5c6087c17 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.659700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b9ec6f2-734c-4386-a52e-91a4fcea17c1 req-5e90d128-55ce-4109-a59a-a3b5c6087c17 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 1096 time: 0.4254563 May 12 15:15:44.688200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] For port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:15:44.693787 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] For port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:15:44.693787 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:44.694326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5412c947-445f-4afe-a37f-dd62c438891b req-238ff970-9e53-482c-8448-746aca7fea5d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.701111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5412c947-445f-4afe-a37f-dd62c438891b req-238ff970-9e53-482c-8448-746aca7fea5d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.717717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5412c947-445f-4afe-a37f-dd62c438891b req-238ff970-9e53-482c-8448-746aca7fea5d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.732032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5412c947-445f-4afe-a37f-dd62c438891b req-238ff970-9e53-482c-8448-746aca7fea5d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.735735 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:44.741527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5412c947-445f-4afe-a37f-dd62c438891b req-238ff970-9e53-482c-8448-746aca7fea5d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.755953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5412c947-445f-4afe-a37f-dd62c438891b req-238ff970-9e53-482c-8448-746aca7fea5d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.767189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5412c947-445f-4afe-a37f-dd62c438891b req-238ff970-9e53-482c-8448-746aca7fea5d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.782791 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5412c947-445f-4afe-a37f-dd62c438891b req-238ff970-9e53-482c-8448-746aca7fea5d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5383 time: 0.6502061 May 12 15:15:44.825660 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cab106c-38f1-4669-8bc0-8d691dc99796 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:44.852780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.853358 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:44.855442 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] 10.222.0.84 "PUT /v2.0/ports/c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c HTTP/1.1" status: 200 len: 1090 time: 2.8201025 May 12 15:15:44.922630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Pushing event updated for resources: {'Port': ['ID=3a378176-9994-44d1-b14f-a0257262a251,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:44.958304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26462d8-8e93-489f-9824-1967fa6e1907 req-40fa79e0-13e0-438f-9d5a-a956efa4fe3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.958733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26462d8-8e93-489f-9824-1967fa6e1907 req-40fa79e0-13e0-438f-9d5a-a956efa4fe3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.960471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Request body: {'port': {'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:44.965260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26462d8-8e93-489f-9824-1967fa6e1907 req-40fa79e0-13e0-438f-9d5a-a956efa4fe3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:44.967995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e26462d8-8e93-489f-9824-1967fa6e1907 req-40fa79e0-13e0-438f-9d5a-a956efa4fe3c service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=42581a8af83242e0bb61f84a30bd27a7&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.5485322 May 12 15:15:45.061594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5412c947-445f-4afe-a37f-dd62c438891b req-acdb106a-1fe0-4ea9-ba0a-85adfc9e903d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2774136 May 12 15:15:45.107987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b9ec6f2-734c-4386-a52e-91a4fcea17c1 req-7c7eb2b6-bcff-4d29-af7a-173ba4cdfa5b tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4393337 May 12 15:15:45.169273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf1d5aa4-7f56-4f08-8834-64bcef0349c9 service neutron] Pushing event updated for resources: {'Port': ['ID=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:45.659252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:45.690142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Attempting to bind port 3a378176-9994-44d1-b14f-a0257262a251 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:15:45.690481 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Attempting to bind port 3a378176-9994-44d1-b14f-a0257262a251 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '68221a3b-1121-4349-a5a1-801f502e908b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:15:45.690814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Attempting to bind port 3a378176-9994-44d1-b14f-a0257262a251 on network 079240cc-25ba-4ba4-a3b0-412d897b19bb {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:45.711364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Port 3a378176-9994-44d1-b14f-a0257262a251 on network 079240cc-25ba-4ba4-a3b0-412d897b19bb not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:15:45.711652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Attempting to bind port 3a378176-9994-44d1-b14f-a0257262a251 on network 079240cc-25ba-4ba4-a3b0-412d897b19bb {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:45.726255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:15:45.726589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Checking segment: {'id': '68221a3b-1121-4349-a5a1-801f502e908b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:15:45.727156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Bound using segment: {'id': '68221a3b-1121-4349-a5a1-801f502e908b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:15:45.727781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Bound port: 3a378176-9994-44d1-b14f-a0257262a251, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '68221a3b-1121-4349-a5a1-801f502e908b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:15:45.728347 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:45.861754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26462d8-8e93-489f-9824-1967fa6e1907 req-295568ec-a888-4393-b511-89103eef3d10 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:45.863303 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e26462d8-8e93-489f-9824-1967fa6e1907 req-295568ec-a888-4393-b511-89103eef3d10 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.8818312 May 12 15:15:45.932458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32776e6-7d20-443d-86ae-442dd5cec5c4 req-db6a1f3e-6141-4d46-b700-4bb134d54ba1 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:45.934582 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b32776e6-7d20-443d-86ae-442dd5cec5c4 req-db6a1f3e-6141-4d46-b700-4bb134d54ba1 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab8299d7-c09c-426b-bd43-a7208f66c4a4 HTTP/1.1" status: 200 len: 945 time: 0.2188780 May 12 15:15:45.946276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f51022b-d59a-44f5-afa9-5865e28e3da2 req-5b86dc39-a9e2-4100-a73c-731cf1afa1be tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:45.956409 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4f51022b-d59a-44f5-afa9-5865e28e3da2 req-5b86dc39-a9e2-4100-a73c-731cf1afa1be tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/ports?device_id=590df846-b8e7-4847-aeec-9f7ff7b352e6 HTTP/1.1" status: 200 len: 945 time: 0.4197171 May 12 15:15:46.005873 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:46.020452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': 'c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:46.068708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5e1309b-3c0c-40e0-ab86-7d82db5127ff req-753af53a-b10e-4302-8015-b74200dd298b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:46.071363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a5e1309b-3c0c-40e0-ab86-7d82db5127ff req-753af53a-b10e-4302-8015-b74200dd298b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Synchronizing usage tracker for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:15:46.096040 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:46.108531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] For port 3a378176-9994-44d1-b14f-a0257262a251, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:15:46.111019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4f51022b-d59a-44f5-afa9-5865e28e3da2 req-5e5588f3-cc97-4a40-9735-b9af4f103bd7 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/security-groups?id=bac8477b-d8ec-449d-8f9e-8a0d9a1df32c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1540830 May 12 15:15:46.140404 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b32776e6-7d20-443d-86ae-442dd5cec5c4 req-a1fc201e-eea1-48b6-af91-186157d673d5 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1812468 May 12 15:15:46.191955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a5e1309b-3c0c-40e0-ab86-7d82db5127ff req-753af53a-b10e-4302-8015-b74200dd298b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Unset dirty status for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:15:46.193123 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a5e1309b-3c0c-40e0-ab86-7d82db5127ff req-753af53a-b10e-4302-8015-b74200dd298b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "GET /v2.0/ports?device_id=ab8299d7-c09c-426b-bd43-a7208f66c4a4 HTTP/1.1" status: 200 len: 945 time: 0.6139183 May 12 15:15:46.203040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] For port 3a378176-9994-44d1-b14f-a0257262a251, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3a378176-9994-44d1-b14f-a0257262a251,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:15:46.287470 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:46.370975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:46.372073 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:46.373678 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] 10.222.0.84 "PUT /v2.0/ports/3a378176-9994-44d1-b14f-a0257262a251 HTTP/1.1" status: 200 len: 1091 time: 3.6352017 May 12 15:15:46.455795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a08dafa5-2503-42df-9686-40767ea2961c req-056a9b03-0445-4df9-98ee-acb4e3064544 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:46.457770 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a08dafa5-2503-42df-9686-40767ea2961c req-056a9b03-0445-4df9-98ee-acb4e3064544 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 1096 time: 0.1852756 May 12 15:15:46.525004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8f7a5f8-87d9-4210-acba-d8606b807483 req-f801b4cf-8f7e-41db-a7fc-4e741253be05 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:46.534942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8f7a5f8-87d9-4210-acba-d8606b807483 req-f801b4cf-8f7e-41db-a7fc-4e741253be05 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 943 time: 0.2040699 May 12 15:15:46.599611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-a5e1309b-3c0c-40e0-ab86-7d82db5127ff req-af4dcef8-97e8-4b81-b88e-806a1434f3c9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Deleting port 5fb6e0a8-b27d-442a-857d-367ef3a32588 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:46.600016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a5e1309b-3c0c-40e0-ab86-7d82db5127ff req-af4dcef8-97e8-4b81-b88e-806a1434f3c9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:46.606266 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a08dafa5-2503-42df-9686-40767ea2961c req-4a620890-76a4-4cf9-9dbe-9afed73076d2 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1216230 May 12 15:15:46.618758 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8f7a5f8-87d9-4210-acba-d8606b807483 req-9a370570-39e9-402f-8be5-9f6381574856 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0828326 May 12 15:15:46.913125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-a5e1309b-3c0c-40e0-ab86-7d82db5127ff req-af4dcef8-97e8-4b81-b88e-806a1434f3c9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] For port 5fb6e0a8-b27d-442a-857d-367ef3a32588, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=5fb6e0a8-b27d-442a-857d-367ef3a32588,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:46.913843 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a5e1309b-3c0c-40e0-ab86-7d82db5127ff req-af4dcef8-97e8-4b81-b88e-806a1434f3c9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:47.139288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2d8efc-a4de-4fd4-a684-4ceef9c10425 req-9fe494f4-97e2-467e-ba60-5d98a0de5906 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.153343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2d8efc-a4de-4fd4-a684-4ceef9c10425 req-9fe494f4-97e2-467e-ba60-5d98a0de5906 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.171386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2d8efc-a4de-4fd4-a684-4ceef9c10425 req-9fe494f4-97e2-467e-ba60-5d98a0de5906 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.203576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1e42dd8-ffce-4afd-994e-ac83157fcdec service neutron] Pushing event updated for resources: {'Port': ['ID=3a378176-9994-44d1-b14f-a0257262a251,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:47.207862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2d8efc-a4de-4fd4-a684-4ceef9c10425 req-9fe494f4-97e2-467e-ba60-5d98a0de5906 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.216823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2d8efc-a4de-4fd4-a684-4ceef9c10425 req-9fe494f4-97e2-467e-ba60-5d98a0de5906 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.222051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2d8efc-a4de-4fd4-a684-4ceef9c10425 req-9fe494f4-97e2-467e-ba60-5d98a0de5906 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.223192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-a5e1309b-3c0c-40e0-ab86-7d82db5127ff req-af4dcef8-97e8-4b81-b88e-806a1434f3c9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Calling delete_port for 5fb6e0a8-b27d-442a-857d-367ef3a32588 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:15:47.233826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2d8efc-a4de-4fd4-a684-4ceef9c10425 req-9fe494f4-97e2-467e-ba60-5d98a0de5906 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.246447 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc2d8efc-a4de-4fd4-a684-4ceef9c10425 req-9fe494f4-97e2-467e-ba60-5d98a0de5906 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5383 time: 0.3770583 May 12 15:15:47.280633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd40ec4e-935d-4d1a-9438-51358cdfb81d req-1f1e5689-7be6-4eca-b0ab-e035f33ef0a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.281507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd40ec4e-935d-4d1a-9438-51358cdfb81d req-1f1e5689-7be6-4eca-b0ab-e035f33ef0a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.282155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd40ec4e-935d-4d1a-9438-51358cdfb81d req-1f1e5689-7be6-4eca-b0ab-e035f33ef0a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.285476 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd40ec4e-935d-4d1a-9438-51358cdfb81d req-1f1e5689-7be6-4eca-b0ab-e035f33ef0a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.286241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd40ec4e-935d-4d1a-9438-51358cdfb81d req-1f1e5689-7be6-4eca-b0ab-e035f33ef0a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.286364 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b713c0a6-974a-45cf-b304-919eb94cc98a'] response: {'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': 'c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c', 'status': 'completed', 'code': 200} May 12 15:15:47.287061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd40ec4e-935d-4d1a-9438-51358cdfb81d req-1f1e5689-7be6-4eca-b0ab-e035f33ef0a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.288025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd40ec4e-935d-4d1a-9438-51358cdfb81d req-1f1e5689-7be6-4eca-b0ab-e035f33ef0a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.293588 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd40ec4e-935d-4d1a-9438-51358cdfb81d req-1f1e5689-7be6-4eca-b0ab-e035f33ef0a4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=42581a8af83242e0bb61f84a30bd27a7&device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 6275 time: 0.3628500 May 12 15:15:47.419596 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc2d8efc-a4de-4fd4-a684-4ceef9c10425 req-c1c2fd0c-e577-4077-9dda-74ad617297dd tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1714454 May 12 15:15:47.476146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-fe5121fa-4601-4887-928d-f6ba01b4c7cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.478127 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-fe5121fa-4601-4887-928d-f6ba01b4c7cd service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=aca50b48316f40a7a6ceb23c44dd4720&device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 1094 time: 1.0208452 May 12 15:15:47.575876 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:47.631043 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-17440be4-52ea-4e3d-8699-baaed75ebbd0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=3a378176-9994-44d1-b14f-a0257262a251 HTTP/1.1" status: 200 len: 217 time: 0.1382222 May 12 15:15:47.639704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:47.718278 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:47.811474 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a5e1309b-3c0c-40e0-ab86-7d82db5127ff req-af4dcef8-97e8-4b81-b88e-806a1434f3c9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:47.833717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Transition to ACTIVE for port object 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:47.863816 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:15:47.924926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd40ec4e-935d-4d1a-9438-51358cdfb81d req-a71efd26-d962-4b20-b55a-078184bf4ed8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.925927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd40ec4e-935d-4d1a-9438-51358cdfb81d req-a71efd26-d962-4b20-b55a-078184bf4ed8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.926995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd40ec4e-935d-4d1a-9438-51358cdfb81d req-a71efd26-d962-4b20-b55a-078184bf4ed8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.927900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd40ec4e-935d-4d1a-9438-51358cdfb81d req-a71efd26-d962-4b20-b55a-078184bf4ed8 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=42581a8af83242e0bb61f84a30bd27a7&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.5975561 May 12 15:15:47.939842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e332da92-1460-4247-9d60-08f6a652354a req-fab8ff7b-da5d-4d44-aef9-70c2e64e0e09 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.941526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e332da92-1460-4247-9d60-08f6a652354a req-fab8ff7b-da5d-4d44-aef9-70c2e64e0e09 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab8299d7-c09c-426b-bd43-a7208f66c4a4 HTTP/1.1" status: 200 len: 867 time: 0.2029088 May 12 15:15:47.973679 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:47.988860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-b04ff225-c7b9-4604-8fdc-7a4145974e00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:47.991301 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-b04ff225-c7b9-4604-8fdc-7a4145974e00 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b6cc6b5a-d56a-4336-afb7-99232d9672dc HTTP/1.1" status: 200 len: 855 time: 0.3443136 May 12 15:15:47.997936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af4dcef8-97e8-4b81-b88e-806a1434f3c9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event deleted for resources: {'Port': ['ID=5fb6e0a8-b27d-442a-857d-367ef3a32588,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:48.133316 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e332da92-1460-4247-9d60-08f6a652354a req-ef0a1c5f-8740-447e-a34f-f847e4412721 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1629260 May 12 15:15:48.186102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd40ec4e-935d-4d1a-9438-51358cdfb81d req-58e3262d-d455-4afc-8ab1-d7cca051ec0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:48.187630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd40ec4e-935d-4d1a-9438-51358cdfb81d req-58e3262d-d455-4afc-8ab1-d7cca051ec0d service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2433996 May 12 15:15:48.564589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 5fb6e0a8-b27d-442a-857d-367ef3a32588 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:15:48.608646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-a5e1309b-3c0c-40e0-ab86-7d82db5127ff req-af4dcef8-97e8-4b81-b88e-806a1434f3c9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] No DVR routers for this DVR port 5fb6e0a8-b27d-442a-857d-367ef3a32588 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:15:48.621800 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a5e1309b-3c0c-40e0-ab86-7d82db5127ff req-af4dcef8-97e8-4b81-b88e-806a1434f3c9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:48.660444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Pushing event updated for resources: {'Port': ['ID=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:48.687514 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a5e1309b-3c0c-40e0-ab86-7d82db5127ff req-af4dcef8-97e8-4b81-b88e-806a1434f3c9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "DELETE /v2.0/ports/5fb6e0a8-b27d-442a-857d-367ef3a32588 HTTP/1.1" status: 204 len: 173 time: 2.4728003 May 12 15:15:48.694650 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-287a3bb6-9d0f-48db-8984-7d740da526f2 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=079240cc-25ba-4ba4-a3b0-412d897b19bb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.6881673 May 12 15:15:48.794803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 5fb6e0a8-b27d-442a-857d-367ef3a32588 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:15:48.795281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 5fb6e0a8-b27d-442a-857d-367ef3a32588 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:15:49.200935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Attempting to bind port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:15:49.201542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Attempting to bind port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:15:49.204419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b71baf8-5137-4f7c-b301-5fb092106926 req-d2851717-8c6d-4ea5-bc7d-3e8f4978e7ea tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:49.207880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Attempting to bind port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad on network e6a7ff8f-d7ef-4614-8958-ef6026371726 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:49.214598 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b71baf8-5137-4f7c-b301-5fb092106926 req-d2851717-8c6d-4ea5-bc7d-3e8f4978e7ea tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 943 time: 0.1774857 May 12 15:15:49.232093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad on network e6a7ff8f-d7ef-4614-8958-ef6026371726 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:15:49.232703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Attempting to bind port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad on network e6a7ff8f-d7ef-4614-8958-ef6026371726 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:49.242146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:15:49.242827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Checking segment: {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:15:49.244898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Bound using segment: {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:15:49.247121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Bound port: 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:15:49.247834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:49.287026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f829e7c1-6bd8-46ec-96c7-1df321ce49f0', 'tag': '3a378176-9994-44d1-b14f-a0257262a251'}, {'server_uuid': 'ab8299d7-c09c-426b-bd43-a7208f66c4a4', 'name': 'network-vif-deleted', 'tag': '5fb6e0a8-b27d-442a-857d-367ef3a32588'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:49.289485 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b71baf8-5137-4f7c-b301-5fb092106926 req-5fb76aa6-27a0-49b3-8ce0-a7c2e44814e7 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739317 May 12 15:15:49.362076 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-21ee2829-7748-4cd0-a831-9587f9c4ac88 service neutron] 10.222.0.84 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6615803 May 12 15:15:49.555025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] For port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:15:49.569941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] For port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:15:49.583011 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78ee5d4f-d949-46e2-89cc-1dd9e288b116 req-c10d1a24-caf7-4439-9466-27e108647c53 service neutron] 10.222.0.84 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2133060 May 12 15:15:49.586685 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:49.705566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:49.705566 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:49.705566 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] 10.222.0.84 "PUT /v2.0/ports/4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad HTTP/1.1" status: 200 len: 1091 time: 4.7564023 May 12 15:15:49.745548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-334f7615-3d05-4ecd-b72f-2a03ddf74f90 service neutron] Pushing event updated for resources: {'Port': ['ID=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:49.786812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Request body: {'port': {'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:49.976315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31475cd0-aa5b-4d50-a126-7767f7ffc186 req-d2a61fa0-c77e-42a0-a36b-ab7ea7257ced tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:49.983963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31475cd0-aa5b-4d50-a126-7767f7ffc186 req-d2a61fa0-c77e-42a0-a36b-ab7ea7257ced tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:49.989889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31475cd0-aa5b-4d50-a126-7767f7ffc186 req-d2a61fa0-c77e-42a0-a36b-ab7ea7257ced tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:49.996899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31475cd0-aa5b-4d50-a126-7767f7ffc186 req-d2a61fa0-c77e-42a0-a36b-ab7ea7257ced tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:50.003217 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31475cd0-aa5b-4d50-a126-7767f7ffc186 req-d2a61fa0-c77e-42a0-a36b-ab7ea7257ced tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:50.009323 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31475cd0-aa5b-4d50-a126-7767f7ffc186 req-d2a61fa0-c77e-42a0-a36b-ab7ea7257ced tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:50.016875 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:50.023421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31475cd0-aa5b-4d50-a126-7767f7ffc186 req-d2a61fa0-c77e-42a0-a36b-ab7ea7257ced tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:50.035309 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31475cd0-aa5b-4d50-a126-7767f7ffc186 req-d2a61fa0-c77e-42a0-a36b-ab7ea7257ced tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5395 time: 0.2455249 May 12 15:15:50.085160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-01a0349c-b5ae-4e1c-9ee2-f4d67ba5a5af tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:15:50.089186 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-01a0349c-b5ae-4e1c-9ee2-f4d67ba5a5af tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0196185 May 12 15:15:50.129366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1235c85a-e09b-49d5-888b-a9819b31ead8 service neutron] Request body: {'binding': {'host': 'n-h1-841483-1', 'vnic_type': 'normal', 'profile': {}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:50.130544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1235c85a-e09b-49d5-888b-a9819b31ead8 service neutron] Unknown quota resources ['binding']. {{(pid=88151) _create /opt/stack/neutron/neutron/api/v2/base.py:495}} May 12 15:15:50.274737 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31475cd0-aa5b-4d50-a126-7767f7ffc186 req-7f8f0624-db5d-45ba-801f-82618544d398 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2290108 May 12 15:15:50.308240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af344623-f71f-47d8-8b2f-b756e9156b12 req-017a683b-cf5f-4eba-8e8b-399d6c5ccd08 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:50.311703 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af344623-f71f-47d8-8b2f-b756e9156b12 req-017a683b-cf5f-4eba-8e8b-399d6c5ccd08 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.76 "GET /v2.0/ports?device_id=590df846-b8e7-4847-aeec-9f7ff7b352e6 HTTP/1.1" status: 200 len: 945 time: 0.2422457 May 12 15:15:50.498620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-af344623-f71f-47d8-8b2f-b756e9156b12 req-04f0b66a-5d44-41c8-8f29-b7d0623e5800 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Deleting port c0221401-ba65-4823-8157-04df90260837 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:15:50.499186 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-af344623-f71f-47d8-8b2f-b756e9156b12 req-04f0b66a-5d44-41c8-8f29-b7d0623e5800 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:50.780363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-af344623-f71f-47d8-8b2f-b756e9156b12 req-04f0b66a-5d44-41c8-8f29-b7d0623e5800 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] For port c0221401-ba65-4823-8157-04df90260837, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c0221401-ba65-4823-8157-04df90260837,segment=NetworkSegment(80bcba73-0fe8-433c-8fce-7a57f2e38fc5),segment_id=80bcba73-0fe8-433c-8fce-7a57f2e38fc5)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:50.780363 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-af344623-f71f-47d8-8b2f-b756e9156b12 req-04f0b66a-5d44-41c8-8f29-b7d0623e5800 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:50.811532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1235c85a-e09b-49d5-888b-a9819b31ead8 service neutron] Attempting to bind port 2483265a-0012-4339-be86-677490680e84 on host n-h1-841483-1 for vnic_type normal with profile None {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:15:50.812111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1235c85a-e09b-49d5-888b-a9819b31ead8 service neutron] Attempting to bind port 2483265a-0012-4339-be86-677490680e84 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:15:50.813095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1235c85a-e09b-49d5-888b-a9819b31ead8 service neutron] Attempting to bind port 2483265a-0012-4339-be86-677490680e84 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:50.830218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1235c85a-e09b-49d5-888b-a9819b31ead8 service neutron] Port 2483265a-0012-4339-be86-677490680e84 on network e8211761-0dd9-424f-b732-629fd2d77e28 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:15:50.830543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1235c85a-e09b-49d5-888b-a9819b31ead8 service neutron] Attempting to bind port 2483265a-0012-4339-be86-677490680e84 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:50.843381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1235c85a-e09b-49d5-888b-a9819b31ead8 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:15:50.843572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1235c85a-e09b-49d5-888b-a9819b31ead8 service neutron] Checking segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:15:50.843778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1235c85a-e09b-49d5-888b-a9819b31ead8 service neutron] Bound using segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:15:50.844407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1235c85a-e09b-49d5-888b-a9819b31ead8 service neutron] Bound port: 2483265a-0012-4339-be86-677490680e84, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:15:50.924076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-af344623-f71f-47d8-8b2f-b756e9156b12 req-04f0b66a-5d44-41c8-8f29-b7d0623e5800 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Calling delete_port for c0221401-ba65-4823-8157-04df90260837 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:15:50.946788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1235c85a-e09b-49d5-888b-a9819b31ead8 service neutron] For port 2483265a-0012-4339-be86-677490680e84, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2483265a-0012-4339-be86-677490680e84,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:15:50.958258 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1235c85a-e09b-49d5-888b-a9819b31ead8 service neutron] Notify callbacks [] for binding, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:50.959482 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1235c85a-e09b-49d5-888b-a9819b31ead8 service neutron] 10.222.0.82 "POST /v2.0/ports/2483265a-0012-4339-be86-677490680e84/bindings HTTP/1.1" status: 201 len: 389 time: 0.8336415 May 12 15:15:50.962560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 097f632d-3127-4539-ba4a-3e2739125cf8 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:50.972183 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:50.988905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9423fbc1-d110-4416-8cde-fbc15892f4cc req-ccb84152-11d6-4be0-9cfe-58f326954c3f tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:50.995997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Transition to ACTIVE for port object 097f632d-3127-4539-ba4a-3e2739125cf8 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:50.996509 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9423fbc1-d110-4416-8cde-fbc15892f4cc req-ccb84152-11d6-4be0-9cfe-58f326954c3f tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/ports?device_id=590df846-b8e7-4847-aeec-9f7ff7b352e6 HTTP/1.1" status: 200 len: 945 time: 0.5676441 May 12 15:15:51.005364 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:51.080220 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9423fbc1-d110-4416-8cde-fbc15892f4cc req-61af5b2d-3561-43f5-a7c2-4d2590ff3f0e tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.82 "GET /v2.0/security-groups?id=bac8477b-d8ec-449d-8f9e-8a0d9a1df32c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0779092 May 12 15:15:51.223876 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c8fe3e13-8a04-4ff2-b96d-9d718c3180e3'] response: {'name': 'network-changed', 'server_uuid': 'f829e7c1-6bd8-46ec-96c7-1df321ce49f0', 'tag': '3a378176-9994-44d1-b14f-a0257262a251', 'status': 'completed', 'code': 200} May 12 15:15:51.225094 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c8fe3e13-8a04-4ff2-b96d-9d718c3180e3'] response: {'server_uuid': 'ab8299d7-c09c-426b-bd43-a7208f66c4a4', 'name': 'network-vif-deleted', 'tag': '5fb6e0a8-b27d-442a-857d-367ef3a32588', 'status': 'completed', 'code': 200} May 12 15:15:51.280139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Pushing event updated for resources: {'Port': ['ID=097f632d-3127-4539-ba4a-3e2739125cf8,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:51.287996 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-af344623-f71f-47d8-8b2f-b756e9156b12 req-04f0b66a-5d44-41c8-8f29-b7d0623e5800 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:51.300800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c0221401-ba65-4823-8157-04df90260837'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:15:51.548215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04f0b66a-5d44-41c8-8f29-b7d0623e5800 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Pushing event deleted for resources: {'Port': ['ID=c0221401-ba65-4823-8157-04df90260837,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:51.637298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-af344623-f71f-47d8-8b2f-b756e9156b12 req-04f0b66a-5d44-41c8-8f29-b7d0623e5800 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] No DVR routers for this DVR port c0221401-ba65-4823-8157-04df90260837 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:15:51.642952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-af344623-f71f-47d8-8b2f-b756e9156b12 req-04f0b66a-5d44-41c8-8f29-b7d0623e5800 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:51.646103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '590df846-b8e7-4847-aeec-9f7ff7b352e6', 'name': 'network-vif-deleted', 'tag': 'c0221401-ba65-4823-8157-04df90260837'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:51.678326 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af344623-f71f-47d8-8b2f-b756e9156b12 req-04f0b66a-5d44-41c8-8f29-b7d0623e5800 tempest-InstanceActionsNegativeTestJSON-1921426222 tempest-InstanceActionsNegativeTestJSON-1921426222-project] 10.222.0.76 "DELETE /v2.0/ports/c0221401-ba65-4823-8157-04df90260837 HTTP/1.1" status: 204 len: 173 time: 1.3542199 May 12 15:15:51.729900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Attempting to bind port 097f632d-3127-4539-ba4a-3e2739125cf8 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:15:51.729900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Attempting to bind port 097f632d-3127-4539-ba4a-3e2739125cf8 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'ed0c42e2-53e7-41f7-b08b-1540aadbe724', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:15:51.732458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Attempting to bind port 097f632d-3127-4539-ba4a-3e2739125cf8 on network c5f75c23-a033-42fa-b7cd-dcbda413fa9a {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:51.741560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f16ec27-0bb3-48fc-a94c-255fc995d8ec req-d4285fa5-7d71-42a2-8873-1ebafa90eb18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:51.743050 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f16ec27-0bb3-48fc-a94c-255fc995d8ec req-d4285fa5-7d71-42a2-8873-1ebafa90eb18 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=aca50b48316f40a7a6ceb23c44dd4720&device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 1094 time: 0.3835328 May 12 15:15:51.746510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Port 097f632d-3127-4539-ba4a-3e2739125cf8 on network c5f75c23-a033-42fa-b7cd-dcbda413fa9a not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:15:51.747488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Attempting to bind port 097f632d-3127-4539-ba4a-3e2739125cf8 on network c5f75c23-a033-42fa-b7cd-dcbda413fa9a {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:51.758959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-8c217b76-f6bc-41fd-b4c2-7b431e3f2840 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:51.761286 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-8c217b76-f6bc-41fd-b4c2-7b431e3f2840 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 1096 time: 0.2057774 May 12 15:15:51.915124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:15:51.915124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Checking segment: {'id': 'ed0c42e2-53e7-41f7-b08b-1540aadbe724', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:15:51.915942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Bound using segment: {'id': 'ed0c42e2-53e7-41f7-b08b-1540aadbe724', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:15:51.916569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Bound port: 097f632d-3127-4539-ba4a-3e2739125cf8, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ed0c42e2-53e7-41f7-b08b-1540aadbe724', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:15:51.916569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:51.951372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f16ec27-0bb3-48fc-a94c-255fc995d8ec req-6121e4b2-133d-46ec-a920-34e54622c008 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:51.952437 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f16ec27-0bb3-48fc-a94c-255fc995d8ec req-6121e4b2-133d-46ec-a920-34e54622c008 service neutron] 10.222.0.84 "GET /v2.0/networks?id=079240cc-25ba-4ba4-a3b0-412d897b19bb HTTP/1.1" status: 200 len: 916 time: 0.1986232 May 12 15:15:51.975833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63172dee-9544-47b9-a02b-8a9111a6a767 req-255c31c0-19c9-4b62-bf9b-e055652a26e3 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:51.979023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63172dee-9544-47b9-a02b-8a9111a6a767 req-255c31c0-19c9-4b62-bf9b-e055652a26e3 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 945 time: 0.1966524 May 12 15:15:52.116941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63172dee-9544-47b9-a02b-8a9111a6a767 req-8d31bc68-be60-48e7-8e01-33947e3a12e6 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0697923 May 12 15:15:52.117064 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f16ec27-0bb3-48fc-a94c-255fc995d8ec req-e7092eb7-b8a1-48ce-bd97-f9bcaac5da24 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=3a378176-9994-44d1-b14f-a0257262a251 HTTP/1.1" status: 200 len: 217 time: 0.1086268 May 12 15:15:52.173887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8b5edff-0ed6-49ce-8333-95f8b3f0c3eb req-92a777ab-3078-4fa0-9b55-dfec81852618 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:52.193710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e8b5edff-0ed6-49ce-8333-95f8b3f0c3eb req-92a777ab-3078-4fa0-9b55-dfec81852618 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 943 time: 0.2109494 May 12 15:15:52.378877 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e8b5edff-0ed6-49ce-8333-95f8b3f0c3eb req-6a6894d8-3377-4535-a81b-b6b4cff96f78 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1781502 May 12 15:15:52.430422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1e59bae6-ecec-4222-82f0-750443b8d165 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:52.433605 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1e59bae6-ecec-4222-82f0-750443b8d165 service neutron] 10.222.0.84 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.5065231 May 12 15:15:52.450340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] For port 097f632d-3127-4539-ba4a-3e2739125cf8, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:15:52.457925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] For port 097f632d-3127-4539-ba4a-3e2739125cf8, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=097f632d-3127-4539-ba4a-3e2739125cf8,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:15:52.492194 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-49bcb045-b909-4b09-95ff-8f5c839c2d26'] response: {'server_uuid': '590df846-b8e7-4847-aeec-9f7ff7b352e6', 'name': 'network-vif-deleted', 'tag': 'c0221401-ba65-4823-8157-04df90260837', 'status': 'completed', 'code': 200} May 12 15:15:52.550218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f16ec27-0bb3-48fc-a94c-255fc995d8ec req-3d740a0a-ae8d-4361-9e48-18893e9f9d72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:52.551872 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f16ec27-0bb3-48fc-a94c-255fc995d8ec req-3d740a0a-ae8d-4361-9e48-18893e9f9d72 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b6cc6b5a-d56a-4336-afb7-99232d9672dc HTTP/1.1" status: 200 len: 855 time: 0.4270523 May 12 15:15:52.566215 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:52.577020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd716ef2-159f-4928-b752-b7f6d41816a4 req-9ca107f4-82c3-4538-b616-ea79eda5455b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:52.583608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd716ef2-159f-4928-b752-b7f6d41816a4 req-9ca107f4-82c3-4538-b616-ea79eda5455b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:52.590819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd716ef2-159f-4928-b752-b7f6d41816a4 req-9ca107f4-82c3-4538-b616-ea79eda5455b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:52.594027 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3a378176-9994-44d1-b14f-a0257262a251 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:15:52.596900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd716ef2-159f-4928-b752-b7f6d41816a4 req-9ca107f4-82c3-4538-b616-ea79eda5455b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:52.603924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd716ef2-159f-4928-b752-b7f6d41816a4 req-9ca107f4-82c3-4538-b616-ea79eda5455b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:52.610163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd716ef2-159f-4928-b752-b7f6d41816a4 req-9ca107f4-82c3-4538-b616-ea79eda5455b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:52.621177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd716ef2-159f-4928-b752-b7f6d41816a4 req-9ca107f4-82c3-4538-b616-ea79eda5455b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:52.629885 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd716ef2-159f-4928-b752-b7f6d41816a4 req-9ca107f4-82c3-4538-b616-ea79eda5455b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5407 time: 0.2078099 May 12 15:15:52.760221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:52.761621 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:52.763202 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] 10.222.0.84 "PUT /v2.0/ports/097f632d-3127-4539-ba4a-3e2739125cf8 HTTP/1.1" status: 200 len: 1091 time: 2.9889982 May 12 15:15:52.765755 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f16ec27-0bb3-48fc-a94c-255fc995d8ec req-6cd937df-9da1-4af2-b91e-cdc91e9d3abd service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=079240cc-25ba-4ba4-a3b0-412d897b19bb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2011812 May 12 15:15:52.787622 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-48848f0f-9307-414f-b310-ff1cd43030fe service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=2483265a-0012-4339-be86-677490680e84 HTTP/1.1" status: 200 len: 217 time: 0.3313110 May 12 15:15:52.802124 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd716ef2-159f-4928-b752-b7f6d41816a4 req-79d3d5a9-d626-46e9-8e60-8b870be32ab7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1710222 May 12 15:15:52.820976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Request body: {'port': {'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:52.889985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 3a378176-9994-44d1-b14f-a0257262a251, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3a378176-9994-44d1-b14f-a0257262a251,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:52.913426 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-40b75b85-0047-4d32-bbd7-b48f1976a31b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:52.922901 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-40b75b85-0047-4d32-bbd7-b48f1976a31b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.2662754 May 12 15:15:52.931926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '3a378176-9994-44d1-b14f-a0257262a251', 'network_id': '079240cc-25ba-4ba4-a3b0-412d897b19bb', 'port_id': '3a378176-9994-44d1-b14f-a0257262a251', 'mac_address': 'fa:16:3e:87:70:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 573, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b6cc6b5a-d56a-4336-afb7-99232d9672dc', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:15:52.948856 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-cde3d66c-614e-48a6-bb43-16e2a63c5747 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/quotas/593ec496e5db4078be8dc940596be321 HTTP/1.1" status: 200 len: 375 time: 0.0246427 May 12 15:15:52.990940 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54982) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:53.115915 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:53.136779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-8f1abbe8-8a87-4588-acae-5b94f11e94bb admin admin] Deleting subnet 295f68b4-8c5b-4424-9ddc-bd5a4dbfbfae {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:15:53.139785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3a378176-9994-44d1-b14f-a0257262a251 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:53.141956 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f1abbe8-8a87-4588-acae-5b94f11e94bb admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:53.156611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 3a378176-9994-44d1-b14f-a0257262a251, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3a378176-9994-44d1-b14f-a0257262a251,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:53.167979 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:53.213852 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f1abbe8-8a87-4588-acae-5b94f11e94bb admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:53.271645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=3a378176-9994-44d1-b14f-a0257262a251,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:53.282780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:53.283135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:53.283448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:53.284400 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:53.284863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:53.285320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:53.285855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:53.286475 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:53.286976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:53.287747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:53.288261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:53.288768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:15:53.288960 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f1abbe8-8a87-4588-acae-5b94f11e94bb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:53.363387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': '4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad'}, {'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': '097f632d-3127-4539-ba4a-3e2739125cf8'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:53.401265 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-c2659d60-e4a9-4597-bcdb-1d26541bc580 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&fields=id HTTP/1.1" status: 200 len: 255 time: 0.4507985 May 12 15:15:53.409683 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f1abbe8-8a87-4588-acae-5b94f11e94bb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:53.464068 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f1abbe8-8a87-4588-acae-5b94f11e94bb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:53.472687 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:53.519638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f1abbe8-8a87-4588-acae-5b94f11e94bb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=295f68b4-8c5b-4424-9ddc-bd5a4dbfbfae,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:53.538427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8f1abbe8-8a87-4588-acae-5b94f11e94bb admin admin] 10.222.0.82 "DELETE /v2.0/subnets/295f68b4-8c5b-4424-9ddc-bd5a4dbfbfae HTTP/1.1" status: 204 len: 168 time: 0.5460484 May 12 15:15:53.542710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55006) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:53.549555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3a378176-9994-44d1-b14f-a0257262a251'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:15:53.696319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c0221401-ba65-4823-8157-04df90260837 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:15:53.716015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7db62f3b-f4d9-4e52-84f2-41edefa63c0c service neutron] Pushing event updated for resources: {'Port': ['ID=097f632d-3127-4539-ba4a-3e2739125cf8,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:53.746013 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-230cc1b3-912f-4e57-9dab-a6ae163e9023 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:53.747432 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-230cc1b3-912f-4e57-9dab-a6ae163e9023 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.5663087 May 12 15:15:53.778793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: c0221401-ba65-4823-8157-04df90260837 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:15:53.779328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c0221401-ba65-4823-8157-04df90260837 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:15:53.857588 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b46f15c-5491-4c20-9e14-c61ae48fe07a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:53.892781 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-afffbfbe-0d4f-4823-818a-6d64f75301ea service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1232557 May 12 15:15:53.894035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3741e9f-7a3e-4366-ae26-7accb9d78673 req-2e0bb904-4181-43ca-8a75-3d732ded48a3 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:53.895565 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3741e9f-7a3e-4366-ae26-7accb9d78673 req-2e0bb904-4181-43ca-8a75-3d732ded48a3 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 945 time: 0.4340053 May 12 15:15:53.942234 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f16ec27-0bb3-48fc-a94c-255fc995d8ec req-3dbd6497-84fe-430f-a016-bdedac15e173 service neutron] 10.222.0.84 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.1531661 May 12 15:15:53.992201 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-2861697d-a368-4c8f-8cfb-d12ecb68afdd service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5890071 May 12 15:15:54.163940 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b46f15c-5491-4c20-9e14-c61ae48fe07a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:54.190186 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3741e9f-7a3e-4366-ae26-7accb9d78673 req-4cca29c4-2741-478b-ab9e-2887626c4218 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2753382 May 12 15:15:54.247301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-1b46f15c-5491-4c20-9e14-c61ae48fe07a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:54.309948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-1b46f15c-5491-4c20-9e14-c61ae48fe07a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '80bcba73-0fe8-433c-8fce-7a57f2e38fc5') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:54.310248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-1b46f15c-5491-4c20-9e14-c61ae48fe07a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '80bcba73-0fe8-433c-8fce-7a57f2e38fc5') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:15:54.350271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-30cb7010-5e0f-497c-ab9f-774d424fbf88 service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4430864 May 12 15:15:54.378698 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b46f15c-5491-4c20-9e14-c61ae48fe07a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:54.409916 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f16ec27-0bb3-48fc-a94c-255fc995d8ec req-4003d3eb-262a-4d6c-83b4-1de6929f95d9 service neutron] 10.222.0.84 "GET /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4069047 May 12 15:15:54.430030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-7c9d0147-33fe-4a19-b855-17e53ebf51fc service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4357588 May 12 15:15:54.458931 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b46f15c-5491-4c20-9e14-c61ae48fe07a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:54.467804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1b46f15c-5491-4c20-9e14-c61ae48fe07a admin admin] Releasing vlan 572 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:15:54.469064 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b46f15c-5491-4c20-9e14-c61ae48fe07a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: timer() May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:15:54.487688 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:15:54.684095 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-f585e625-51c9-431b-b5db-ef95d600f26d service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3271255 May 12 15:15:54.796766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b8aacb03-fed3-4aed-b3cf-8c58c91ef18e {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:15:54.811141 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:54.828790 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b46f15c-5491-4c20-9e14-c61ae48fe07a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:54.831447 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a4d1bc4b-ad80-4fe6-bf1e-5ebf9538c444'] response: {'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': '4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad', 'status': 'completed', 'code': 200} May 12 15:15:54.831447 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a4d1bc4b-ad80-4fe6-bf1e-5ebf9538c444'] response: {'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': '097f632d-3127-4539-ba4a-3e2739125cf8', 'status': 'completed', 'code': 200} May 12 15:15:54.860804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Transition to ACTIVE for port object b8aacb03-fed3-4aed-b3cf-8c58c91ef18e will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:15:54.943039 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b46f15c-5491-4c20-9e14-c61ae48fe07a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:54.995404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b46f15c-5491-4c20-9e14-c61ae48fe07a admin admin] Pushing event deleted for resources: {'Network': ['ID=03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:55.018614 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1b46f15c-5491-4c20-9e14-c61ae48fe07a admin admin] 10.222.0.82 "DELETE /v2.0/networks/03fab8c0-b2cb-4cf2-bb6f-ddc9d8f8efe8 HTTP/1.1" status: 204 len: 168 time: 1.4698849 May 12 15:15:55.029681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5d3736-d0c6-4ad7-8a37-213270d6daa4 req-69102c4e-afc4-49b9-8df6-834273722804 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:55.032147 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f5d3736-d0c6-4ad7-8a37-213270d6daa4 req-69102c4e-afc4-49b9-8df6-834273722804 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 944 time: 0.4067652 May 12 15:15:55.059522 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:55.527674 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55036) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:55.727030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Pushing event updated for resources: {'Port': ['ID=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:55.743285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f5d3736-d0c6-4ad7-8a37-213270d6daa4 req-875e02df-72b3-481e-9fdc-c3f1834aa993 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2176902 May 12 15:15:55.794763 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8da77c6e-6bb1-4428-bd70-25962d1f99d9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=df509deac95f4a6298820b86cc7c9da9&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2545345 May 12 15:15:55.797136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55048) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:55.842605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-55dba47c-f32d-49bf-9a9b-0714dcbf336a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:55.843367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-55dba47c-f32d-49bf-9a9b-0714dcbf336a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:55.844053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-55dba47c-f32d-49bf-9a9b-0714dcbf336a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:55.844711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-55dba47c-f32d-49bf-9a9b-0714dcbf336a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:55.849195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-55dba47c-f32d-49bf-9a9b-0714dcbf336a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:55.850684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-55dba47c-f32d-49bf-9a9b-0714dcbf336a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:55.855990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-55dba47c-f32d-49bf-9a9b-0714dcbf336a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:55.858367 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d065c66-9a59-4887-9670-c15da4328f22 req-55dba47c-f32d-49bf-9a9b-0714dcbf336a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=42581a8af83242e0bb61f84a30bd27a7&device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 6434 time: 0.9712543 May 12 15:15:55.999525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4775af5-425b-4cdc-a7c4-cb4fa3dfbc84 req-eb45097d-5104-433a-a2cf-1f220c577b88 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:56.006418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4775af5-425b-4cdc-a7c4-cb4fa3dfbc84 req-eb45097d-5104-433a-a2cf-1f220c577b88 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:56.022573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4775af5-425b-4cdc-a7c4-cb4fa3dfbc84 req-eb45097d-5104-433a-a2cf-1f220c577b88 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:56.036794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4775af5-425b-4cdc-a7c4-cb4fa3dfbc84 req-eb45097d-5104-433a-a2cf-1f220c577b88 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:56.066246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4775af5-425b-4cdc-a7c4-cb4fa3dfbc84 req-eb45097d-5104-433a-a2cf-1f220c577b88 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:56.088761 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4775af5-425b-4cdc-a7c4-cb4fa3dfbc84 req-eb45097d-5104-433a-a2cf-1f220c577b88 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:56.102370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4775af5-425b-4cdc-a7c4-cb4fa3dfbc84 req-eb45097d-5104-433a-a2cf-1f220c577b88 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:56.105427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4775af5-425b-4cdc-a7c4-cb4fa3dfbc84 req-eb45097d-5104-433a-a2cf-1f220c577b88 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5419 time: 1.0954762 May 12 15:15:56.106094 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f85faedc-0db6-4c4f-89bf-29db83863626 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:56.199543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Attempting to bind port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:15:56.200104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Attempting to bind port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'ed0c42e2-53e7-41f7-b08b-1540aadbe724', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:15:56.200591 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Attempting to bind port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e on network c5f75c23-a033-42fa-b7cd-dcbda413fa9a {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:56.218077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-257f2220-43cf-4ac8-b9c8-e714541e2b65 req-78e904f8-53ae-4e3b-9362-60063e3bef72 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 210 time: 0.0660698 May 12 15:15:56.221089 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f85faedc-0db6-4c4f-89bf-29db83863626 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:56.221611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e on network c5f75c23-a033-42fa-b7cd-dcbda413fa9a not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:15:56.221942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Attempting to bind port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e on network c5f75c23-a033-42fa-b7cd-dcbda413fa9a {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:15:56.233170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:15:56.233558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Checking segment: {'id': 'ed0c42e2-53e7-41f7-b08b-1540aadbe724', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:15:56.233951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Bound using segment: {'id': 'ed0c42e2-53e7-41f7-b08b-1540aadbe724', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:15:56.234393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Bound port: b8aacb03-fed3-4aed-b3cf-8c58c91ef18e, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ed0c42e2-53e7-41f7-b08b-1540aadbe724', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:15:56.234738 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:56.283665 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4775af5-425b-4cdc-a7c4-cb4fa3dfbc84 req-c8f6d5a5-b558-4081-b6ca-c91575c874a6 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1352172 May 12 15:15:56.339099 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f85faedc-0db6-4c4f-89bf-29db83863626 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:56.361058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-8cee0237-60ba-48d7-950a-17d26e52ce9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:56.361598 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-8cee0237-60ba-48d7-950a-17d26e52ce9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:56.362074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-8cee0237-60ba-48d7-950a-17d26e52ce9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:56.365004 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d065c66-9a59-4887-9670-c15da4328f22 req-8cee0237-60ba-48d7-950a-17d26e52ce9e service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=42581a8af83242e0bb61f84a30bd27a7&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.4826970 May 12 15:15:56.381322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f85faedc-0db6-4c4f-89bf-29db83863626 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bac8477b-d8ec-449d-8f9e-8a0d9a1df32c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:56.393118 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f85faedc-0db6-4c4f-89bf-29db83863626 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:56.395409 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f85faedc-0db6-4c4f-89bf-29db83863626 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bac8477b-d8ec-449d-8f9e-8a0d9a1df32c HTTP/1.1" status: 204 len: 168 time: 0.5973454 May 12 15:15:56.604197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d22dbaed-a6e1-41e4-a245-ffd131d90a0f req-281e097d-c9a4-4415-b74f-f5a5dbf9d443 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:56.613649 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d22dbaed-a6e1-41e4-a245-ffd131d90a0f req-281e097d-c9a4-4415-b74f-f5a5dbf9d443 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 945 time: 0.1502666 May 12 15:15:56.631075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3a378176-9994-44d1-b14f-a0257262a251 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:15:56.690855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-d1e893d4-981d-43a8-a653-8e1c5d46d712 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:56.693050 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d065c66-9a59-4887-9670-c15da4328f22 req-d1e893d4-981d-43a8-a653-8e1c5d46d712 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3209119 May 12 15:15:56.694838 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d22dbaed-a6e1-41e4-a245-ffd131d90a0f req-013ab40b-5e70-438d-8713-7690b60ebdcb tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0768111 May 12 15:15:56.742140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] For port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:15:56.751321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] For port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:15:56.761910 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:56.788439 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 3a378176-9994-44d1-b14f-a0257262a251 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:15:56.800062 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 3a378176-9994-44d1-b14f-a0257262a251 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:15:56.803396 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:56.858380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:56.859202 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:56.861546 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] 10.222.0.84 "PUT /v2.0/ports/b8aacb03-fed3-4aed-b3cf-8c58c91ef18e HTTP/1.1" status: 200 len: 1091 time: 4.0459108 May 12 15:15:56.862199 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': 'b8aacb03-fed3-4aed-b3cf-8c58c91ef18e'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:56.951363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f47dcaa1-faa6-4399-8a31-b33836ed116b service neutron] Pushing event updated for resources: {'Port': ['ID=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:57.080363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-7194c952-d108-4c25-909b-bdc65586c6f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:57.081072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-7194c952-d108-4c25-909b-bdc65586c6f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:57.081746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-7194c952-d108-4c25-909b-bdc65586c6f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:57.082415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-7194c952-d108-4c25-909b-bdc65586c6f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:57.083016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-7194c952-d108-4c25-909b-bdc65586c6f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:57.083762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-7194c952-d108-4c25-909b-bdc65586c6f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:57.084361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-7194c952-d108-4c25-909b-bdc65586c6f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:57.087127 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d065c66-9a59-4887-9670-c15da4328f22 req-7194c952-d108-4c25-909b-bdc65586c6f1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=42581a8af83242e0bb61f84a30bd27a7&device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 6476 time: 0.1922107 May 12 15:15:57.092512 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:57.130539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 3a378176-9994-44d1-b14f-a0257262a251, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3a378176-9994-44d1-b14f-a0257262a251,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:57.132260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f829e7c1-6bd8-46ec-96c7-1df321ce49f0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3a378176-9994-44d1-b14f-a0257262a251'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:57.148741 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:57.301060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=3a378176-9994-44d1-b14f-a0257262a251,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:57.373604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-ae058d75-6917-4741-a8aa-f5d2fb8c2963 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:57.375349 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-ae058d75-6917-4741-a8aa-f5d2fb8c2963 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.76 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.5099170 May 12 15:15:57.418512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Request body: {'port': {'device_id': '3ab740bd-7f74-4e50-be5b-e03680401acd', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'admin_state_up': True, 'tenant_id': '593ec496e5db4078be8dc940596be321'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:57.474161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-ee622895-f7f6-4ffd-80d3-7a7dbfd1b93f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:57.474632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-ee622895-f7f6-4ffd-80d3-7a7dbfd1b93f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:57.475755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-ee622895-f7f6-4ffd-80d3-7a7dbfd1b93f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:57.477335 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d065c66-9a59-4887-9670-c15da4328f22 req-ee622895-f7f6-4ffd-80d3-7a7dbfd1b93f service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=42581a8af83242e0bb61f84a30bd27a7&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.3673632 May 12 15:15:57.479623 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0a3ba442-b282-41df-a1f0-1f3653853d6e'] response: {'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': 'b8aacb03-fed3-4aed-b3cf-8c58c91ef18e', 'status': 'completed', 'code': 200} May 12 15:15:57.625287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3852f4b-b8bc-4a10-a6cc-53ef28afd69f req-3a3fa0c2-89bc-48d1-bc62-2e52087fd035 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:57.629326 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e54dc111-3a2d-4eb4-99f9-2577058d0664'] response: {'server_uuid': 'f829e7c1-6bd8-46ec-96c7-1df321ce49f0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3a378176-9994-44d1-b14f-a0257262a251', 'code': 200} May 12 15:15:57.632723 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3852f4b-b8bc-4a10-a6cc-53ef28afd69f req-3a3fa0c2-89bc-48d1-bc62-2e52087fd035 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 945 time: 0.4602246 May 12 15:15:57.682968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d065c66-9a59-4887-9670-c15da4328f22 req-cbf9d865-a059-45c4-bc1d-63175227d7c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:57.684622 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d065c66-9a59-4887-9670-c15da4328f22 req-cbf9d865-a059-45c4-bc1d-63175227d7c6 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1832502 May 12 15:15:57.723957 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3852f4b-b8bc-4a10-a6cc-53ef28afd69f req-83bd8477-f2c5-47b2-b9c2-216c3c9407f0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903671 May 12 15:15:57.729227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:57.735454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Usage tracker for resource:port and tenant:593ec496e5db4078be8dc940596be321 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:57.742807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:57.773339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:57.862134 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f36630f6-3e5c-41a7-97e5-80b28fcf897e req-144bc03c-3c06-4ea2-9757-35539ee212c9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 210 time: 0.1061816 May 12 15:15:57.919365 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Made reservation on behalf of 593ec496e5db4078be8dc940596be321 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:15:57.924564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:57.992847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55138) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:58.002891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaaef521-8fe4-4e86-bd6f-1f604bf7eea8 req-14f60e07-8ae8-44df-bdd9-57e081ca49af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.004552 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-eaaef521-8fe4-4e86-bd6f-1f604bf7eea8 req-14f60e07-8ae8-44df-bdd9-57e081ca49af service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 1096 time: 0.2272861 May 12 15:15:58.010697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-4f0ff693-5bcc-4005-b86c-4c9f196ccdd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.011256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-4f0ff693-5bcc-4005-b86c-4c9f196ccdd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.011729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-4f0ff693-5bcc-4005-b86c-4c9f196ccdd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.012193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-4f0ff693-5bcc-4005-b86c-4c9f196ccdd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.012639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-4f0ff693-5bcc-4005-b86c-4c9f196ccdd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.013238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-4f0ff693-5bcc-4005-b86c-4c9f196ccdd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.013881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-4f0ff693-5bcc-4005-b86c-4c9f196ccdd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.015857 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-4f0ff693-5bcc-4005-b86c-4c9f196ccdd1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=42581a8af83242e0bb61f84a30bd27a7&device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 6476 time: 0.1826763 May 12 15:15:58.084860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c00378-942e-4b58-9153-e55159e33d1c req-ca0c3322-8d0e-496e-8391-56a0e52b6b2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.090891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c00378-942e-4b58-9153-e55159e33d1c req-ca0c3322-8d0e-496e-8391-56a0e52b6b2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.096690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c00378-942e-4b58-9153-e55159e33d1c req-ca0c3322-8d0e-496e-8391-56a0e52b6b2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.102928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c00378-942e-4b58-9153-e55159e33d1c req-ca0c3322-8d0e-496e-8391-56a0e52b6b2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.108500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c00378-942e-4b58-9153-e55159e33d1c req-ca0c3322-8d0e-496e-8391-56a0e52b6b2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.114572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c00378-942e-4b58-9153-e55159e33d1c req-ca0c3322-8d0e-496e-8391-56a0e52b6b2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.121098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c00378-942e-4b58-9153-e55159e33d1c req-ca0c3322-8d0e-496e-8391-56a0e52b6b2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.122719 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7c00378-942e-4b58-9153-e55159e33d1c req-ca0c3322-8d0e-496e-8391-56a0e52b6b2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5419 time: 0.2574675 May 12 15:15:58.139693 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-dfa33602-9c1f-4ce8-a04d-da14bb70a56c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=026a86ba-df92-4de2-9f16-6e6b8794d1df HTTP/1.1" status: 200 len: 217 time: 0.1029623 May 12 15:15:58.196290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Request body: {'network': {'name': 'tempest-ServerTagsTestJSON-102886380-network', 'tenant_id': '0221a2702f9c420a9143d37995213f9d'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:58.201650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:58.211381 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-eaaef521-8fe4-4e86-bd6f-1f604bf7eea8 req-8f8d9d56-71d7-4455-bd78-740b887a5379 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1769924 May 12 15:15:58.212280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Usage tracker for resource:network and tenant:0221a2702f9c420a9143d37995213f9d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:58.221451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:58.234760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:58.261134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8b4f61ac-6761-4cb3-924b-ec51a5a0b5ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.261134 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-8b4f61ac-6761-4cb3-924b-ec51a5a0b5ef service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c7af977d-fe6b-4182-af40-d4c2523b54a3 HTTP/1.1" status: 200 len: 851 time: 0.0994632 May 12 15:15:58.261134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Made reservation on behalf of 0221a2702f9c420a9143d37995213f9d for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:15:58.261134 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:58.269758 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:58.285609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:58.289732 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7c00378-942e-4b58-9153-e55159e33d1c req-954ed1ea-9f2e-48e1-8c40-505d6354799b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1363018 May 12 15:15:58.290421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Usage tracker for resource:security_group_rule and tenant:0221a2702f9c420a9143d37995213f9d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:58.291839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Allocated IP 172.20.0.7 (dbc2e49c-2591-4534-a48c-cea8e23115f4/84c2082e-f394-46d5-8a8f-8e3a70d54fc1/49d6769a-b216-47e8-aaa9-58847c3c8ca7) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:15:58.293633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:58.299987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:58.343727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-123ab758-20ef-467a-b68d-6388a69c4ed5 req-148ed164-1098-4820-b2ed-f7f9d97cb757 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.345446 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-123ab758-20ef-467a-b68d-6388a69c4ed5 req-148ed164-1098-4820-b2ed-f7f9d97cb757 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 945 time: 0.1933718 May 12 15:15:58.407937 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:58.412592 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:58.442869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 574} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:15:58.448107 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-123ab758-20ef-467a-b68d-6388a69c4ed5 req-7855d7bf-3c51-40d1-9a32-101b613fe834 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0907204 May 12 15:15:58.456157 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b520f0c2-32b3-4656-bbec-ee430aa330d2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:58.460770 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:58.461221 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Added segment 4d6939e6-0762-4f32-ab66-c216826b2cf3 of type vlan for network 1d7499f3-5bbd-4f94-822c-977c4f67540a May 12 15:15:58.564588 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:58.615454 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:58.615979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.616668 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:58.616971 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:58.669333 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:58.705843 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:15:58.741581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-3a8715a7-f8ac-44c8-957e-5b9799ae117f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.743641 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-3a8715a7-f8ac-44c8-957e-5b9799ae117f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=939fdac4-3043-4213-bd31-a421a6c659bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2463732 May 12 15:15:58.794862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Network dbc2e49c-2591-4534-a48c-cea8e23115f4 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:15:58.795882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event updated for resources: {'Port': ['ID=49d6769a-b216-47e8-aaa9-58847c3c8ca7,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:58.798404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:15:58.800467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:15:58.887979 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:58.890156 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:58.950248 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0d16ad0f-aebf-4e0e-ab95-57bf383313dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5365112 May 12 15:15:58.968985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Request body: {'port': {'device_id': '3ab740bd-7f74-4e50-be5b-e03680401acd', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:59.003375 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.0094702 May 12 15:15:59.011674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55168) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:59.036729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Request body: {'subnet': {'network_id': '1d7499f3-5bbd-4f94-822c-977c4f67540a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerTagsTestJSON-102886380-subnet', 'tenant_id': '0221a2702f9c420a9143d37995213f9d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:15:59.062026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-569f087c-dc64-4244-b53c-6b73297883e6 admin admin] Pushing event updated for resources: {'Network': ['ID=1d7499f3-5bbd-4f94-822c-977c4f67540a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:15:59.066933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55172) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:15:59.075841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 1d7499f3-5bbd-4f94-822c-977c4f67540a details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:15:59.082804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:59.114751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Usage tracker for resource:subnet and tenant:0221a2702f9c420a9143d37995213f9d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:59.121088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:59.159389 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:59.220700 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-1c8f98a4-e8e0-482c-9026-a3df4ea0f1b0 service neutron] 10.222.0.84 "GET /v2.0/networks/939fdac4-3043-4213-bd31-a421a6c659bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4470091 May 12 15:15:59.221730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Made reservation on behalf of 0221a2702f9c420a9143d37995213f9d for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:15:59.232095 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:59.333742 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:59.429744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55359a18-ae5b-444e-b62c-2bc56c183005 req-6975f45f-c5f1-49e2-98ec-25658529ebaa tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:59.432385 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55359a18-ae5b-444e-b62c-2bc56c183005 req-6975f45f-c5f1-49e2-98ec-25658529ebaa tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 945 time: 0.4011753 May 12 15:15:59.522102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55359a18-ae5b-444e-b62c-2bc56c183005 req-477653cb-5ca5-460f-b09a-14269a25a173 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0802903 May 12 15:15:59.581325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3ff87c39-f552-4ac5-a397-6285eac3e548 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:59.654938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3ff87c39-f552-4ac5-a397-6285eac3e548 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:15:59.666044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3ff87c39-f552-4ac5-a397-6285eac3e548 admin admin] Usage tracker for resource:security_group_rule and tenant:67aee8f20f734a6b880b77619a4fd648 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:15:59.671423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3ff87c39-f552-4ac5-a397-6285eac3e548 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:15:59.684891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3ff87c39-f552-4ac5-a397-6285eac3e548 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:15:59.739391 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:15:59.767334 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-e924ef13-cbac-414a-a265-da5c71854ecb service neutron] 10.222.0.84 "GET /v2.0/networks/939fdac4-3043-4213-bd31-a421a6c659bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2458694 May 12 15:15:59.874150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c85e55ee-f285-458e-a603-30a035bb32b9 req-2d08f8ce-d610-47bf-8584-860a290b9fac tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:15:59.875916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c85e55ee-f285-458e-a603-30a035bb32b9 req-2d08f8ce-d610-47bf-8584-860a290b9fac tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Synchronizing usage tracker for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:15:59.895775 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:59.924742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c85e55ee-f285-458e-a603-30a035bb32b9 req-2d08f8ce-d610-47bf-8584-860a290b9fac tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Unset dirty status for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:15:59.926196 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c85e55ee-f285-458e-a603-30a035bb32b9 req-2d08f8ce-d610-47bf-8584-860a290b9fac tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 931 time: 0.2850912 May 12 15:15:59.937177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e012dc12-9257-4f1f-bf64-5f38b5e69a5f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:15:59.956975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:15:59.966833 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:15:59.999457 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:00.044448 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3ff87c39-f552-4ac5-a397-6285eac3e548 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:00.050136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:00.061822 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-aeaedc3e-fbf4-45c0-abca-40a018975313 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.199&port_id=ef28df6f-7573-4910-9fae-c2b49092303b HTTP/1.1" status: 200 len: 217 time: 0.1710584 May 12 15:16:00.067792 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3ff87c39-f552-4ac5-a397-6285eac3e548 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:00.117360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 49d6769a-b216-47e8-aaa9-58847c3c8ca7 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:00.128500 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:00.141091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c85e55ee-f285-458e-a603-30a035bb32b9 req-137113d6-3c8f-4a73-9b40-d039ca995f2e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1881759 May 12 15:16:00.161587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Transition to ACTIVE for port object 49d6769a-b216-47e8-aaa9-58847c3c8ca7 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:16:00.170969 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:00.227838 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3ff87c39-f552-4ac5-a397-6285eac3e548 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=67aee8f20f734a6b880b77619a4fd648&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1573660 May 12 15:16:00.236014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Pushing event updated for resources: {'Subnet': ['ID=445d4ea4-9d5e-46f7-a0d1-71a9c4f87159,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:00.240215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ff87c39-f552-4ac5-a397-6285eac3e548 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0587ef4e-b7aa-4f6d-8a83-2a9751a7a3d8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:00.258482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55214) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:00.302364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ecfa689c-d645-4df9-9e18-8d0e505866cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:00.304041 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ecfa689c-d645-4df9-9e18-8d0e505866cf service neutron] 10.222.0.84 "GET /v2.0/subnets?id=722dd775-53fe-4359-9d8f-d74143e5ced9 HTTP/1.1" status: 200 len: 797 time: 0.2214687 May 12 15:16:00.359176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Checking segment: {'id': '4d6939e6-0762-4f32-ab66-c216826b2cf3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 574, 'network_id': '1d7499f3-5bbd-4f94-822c-977c4f67540a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:16:00.359176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Network hostable DHCP agents. Network: 1d7499f3-5bbd-4f94-822c-977c4f67540a, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:16:00.418716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f716f15-b594-484d-8a3c-400063c22e96 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:00.420711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4cdfec-d710-4bed-87a4-b68de27b57d0 req-b930c7ff-4a3f-48d9-8cf1-106dc5955352 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:00.429295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4cdfec-d710-4bed-87a4-b68de27b57d0 req-b930c7ff-4a3f-48d9-8cf1-106dc5955352 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:00.434698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Network 1d7499f3-5bbd-4f94-822c-977c4f67540a is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:16:00.436227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4cdfec-d710-4bed-87a4-b68de27b57d0 req-b930c7ff-4a3f-48d9-8cf1-106dc5955352 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:00.446538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4cdfec-d710-4bed-87a4-b68de27b57d0 req-b930c7ff-4a3f-48d9-8cf1-106dc5955352 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:00.449067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4cdfec-d710-4bed-87a4-b68de27b57d0 req-b930c7ff-4a3f-48d9-8cf1-106dc5955352 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:00.455618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4cdfec-d710-4bed-87a4-b68de27b57d0 req-b930c7ff-4a3f-48d9-8cf1-106dc5955352 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:00.466617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4cdfec-d710-4bed-87a4-b68de27b57d0 req-b930c7ff-4a3f-48d9-8cf1-106dc5955352 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:00.466617 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed4cdfec-d710-4bed-87a4-b68de27b57d0 req-b930c7ff-4a3f-48d9-8cf1-106dc5955352 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5444 time: 0.4891591 May 12 15:16:00.472455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f716f15-b594-484d-8a3c-400063c22e96 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:00.481425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 1d7499f3-5bbd-4f94-822c-977c4f67540a) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:16:00.497325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:00.497325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:00.515686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ed852d6b-2f9e-4267-bac5-cfc8e6105be2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:00.515686 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ed852d6b-2f9e-4267-bac5-cfc8e6105be2 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e6a7ff8f-d7ef-4614-8958-ef6026371726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.1992509 May 12 15:16:00.523127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a08467be-7ade-45e9-a1e8-85c835b8cd83 None None] Network 1d7499f3-5bbd-4f94-822c-977c4f67540a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:16:00.560319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Pushing event updated for resources: {'Port': ['ID=49d6769a-b216-47e8-aaa9-58847c3c8ca7,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:00.591142 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-569fc6df-9fc9-48ad-8ab2-1217b02e5dfc admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.5584960 May 12 15:16:00.664699 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f716f15-b594-484d-8a3c-400063c22e96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:00.689329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f716f15-b594-484d-8a3c-400063c22e96 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0587ef4e-b7aa-4f6d-8a83-2a9751a7a3d8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:00.704210 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f716f15-b594-484d-8a3c-400063c22e96 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:00.705570 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0f716f15-b594-484d-8a3c-400063c22e96 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0587ef4e-b7aa-4f6d-8a83-2a9751a7a3d8 HTTP/1.1" status: 204 len: 168 time: 0.4453800 May 12 15:16:00.758722 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-1c336f89-98f2-4789-85df-2c04c2c2a7ad service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2098064 May 12 15:16:00.772520 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed4cdfec-d710-4bed-87a4-b68de27b57d0 req-310e3425-f293-4e8f-bfb0-edc766b10197 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2630670 May 12 15:16:00.911963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Attempting to bind port 49d6769a-b216-47e8-aaa9-58847c3c8ca7 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:16:00.912798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Attempting to bind port 49d6769a-b216-47e8-aaa9-58847c3c8ca7 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:16:00.912902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Attempting to bind port 49d6769a-b216-47e8-aaa9-58847c3c8ca7 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:00.968135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e6a0e2-94d4-44ec-8164-d59706363635 req-7280f078-4291-4fef-bda3-1fb7d3563bf2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:00.983380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e6a0e2-94d4-44ec-8164-d59706363635 req-7280f078-4291-4fef-bda3-1fb7d3563bf2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:00.995664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e6a0e2-94d4-44ec-8164-d59706363635 req-7280f078-4291-4fef-bda3-1fb7d3563bf2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:01.004710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e6a0e2-94d4-44ec-8164-d59706363635 req-7280f078-4291-4fef-bda3-1fb7d3563bf2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:01.015618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e6a0e2-94d4-44ec-8164-d59706363635 req-7280f078-4291-4fef-bda3-1fb7d3563bf2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:01.023862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e6a0e2-94d4-44ec-8164-d59706363635 req-7280f078-4291-4fef-bda3-1fb7d3563bf2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:01.030426 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e6a0e2-94d4-44ec-8164-d59706363635 req-7280f078-4291-4fef-bda3-1fb7d3563bf2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:01.032361 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11e6a0e2-94d4-44ec-8164-d59706363635 req-7280f078-4291-4fef-bda3-1fb7d3563bf2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5419 time: 0.7117901 May 12 15:16:01.033163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Port 49d6769a-b216-47e8-aaa9-58847c3c8ca7 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:16:01.033669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Attempting to bind port 49d6769a-b216-47e8-aaa9-58847c3c8ca7 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:01.045561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:16:01.045897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Checking segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:16:01.046589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Bound using segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:16:01.047021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Bound port: 49d6769a-b216-47e8-aaa9-58847c3c8ca7, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:16:01.047243 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:01.066385 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-c6bfa9be-1a8e-4bde-9c21-6efb1f4f9f3c service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2993028 May 12 15:16:01.070480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-308115cb-3460-4809-9bc0-bbfc2b470947 None None] Network 1d7499f3-5bbd-4f94-822c-977c4f67540a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:16:01.190872 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-fbd4f4da-4c43-4e63-8cd6-0a79eba40738 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.10&port_id=85b4d43d-f235-4852-bda9-2dc870bb3d11 HTTP/1.1" status: 200 len: 217 time: 0.1091664 May 12 15:16:01.268305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-9abfbfe2-4e78-4c49-8c24-b1fce28c3ee2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:01.275354 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-9abfbfe2-4e78-4c49-8c24-b1fce28c3ee2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=722dd775-53fe-4359-9d8f-d74143e5ced9 HTTP/1.1" status: 200 len: 797 time: 0.0786135 May 12 15:16:01.280121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] For port 49d6769a-b216-47e8-aaa9-58847c3c8ca7, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:16:01.284103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] For port 49d6769a-b216-47e8-aaa9-58847c3c8ca7, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=49d6769a-b216-47e8-aaa9-58847c3c8ca7,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:16:01.316462 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:01.393497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-d3a8ea3a-6f7b-4d2d-b92e-f23725224280 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:01.397489 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-d3a8ea3a-6f7b-4d2d-b92e-f23725224280 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e6a7ff8f-d7ef-4614-8958-ef6026371726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.1142359 May 12 15:16:01.413590 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11e6a0e2-94d4-44ec-8164-d59706363635 req-2b1d10bb-21b7-42ad-bd62-75da5dbbb93d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.3702319 May 12 15:16:01.419954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:01.420555 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:01.421914 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] 10.222.0.76 "PUT /v2.0/ports/49d6769a-b216-47e8-aaa9-58847c3c8ca7 HTTP/1.1" status: 200 len: 1091 time: 2.4580896 May 12 15:16:01.426245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3ab740bd-7f74-4e50-be5b-e03680401acd', 'tag': '49d6769a-b216-47e8-aaa9-58847c3c8ca7'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:01.472207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64039d45-7dfd-49eb-b30e-b5060a960a55 req-9af33d98-e102-49fd-b835-e8d8bc3c1ab1 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:01.481323 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64039d45-7dfd-49eb-b30e-b5060a960a55 req-9af33d98-e102-49fd-b835-e8d8bc3c1ab1 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 945 time: 0.4351671 May 12 15:16:01.535299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22cc8b5b-b044-4c54-8182-d2fe515b2421 service neutron] Pushing event updated for resources: {'Port': ['ID=49d6769a-b216-47e8-aaa9-58847c3c8ca7,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:01.610230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64039d45-7dfd-49eb-b30e-b5060a960a55 req-40d6d75d-7ae6-421e-a079-ca9c34f504c7 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1239636 May 12 15:16:01.664581 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0e3a2bb4-1f2f-4212-9912-ce61fa408772 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:01.664581 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0e3a2bb4-1f2f-4212-9912-ce61fa408772 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 1094 time: 0.1799123 May 12 15:16:01.707393 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-313a3c0c-7d8d-415a-bd68-2183f3d28725 service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2957551 May 12 15:16:01.734853 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e3399fc3-ef48-490d-8342-bae312a86775'] response: {'server_uuid': 'e012dc12-9257-4f1f-bf64-5f38b5e69a5f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c', 'code': 200} May 12 15:16:01.816961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-bbf27294-79a2-4dda-8bb2-cad4f8fcd4e4 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=49d6769a-b216-47e8-aaa9-58847c3c8ca7 HTTP/1.1" status: 200 len: 217 time: 0.1462266 May 12 15:16:02.015071 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-59fc8db9-07f8-4b88-b323-43735d3fbd29 service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3050640 May 12 15:16:02.112410 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:02.221436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-4fa62ccc-45b9-4a60-8142-723fb3fb97e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:02.221436 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-4fa62ccc-45b9-4a60-8142-723fb3fb97e4 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.3936200 May 12 15:16:02.265882 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-3434b40b-339e-476a-9a23-62447552a539 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.80&port_id=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c HTTP/1.1" status: 200 len: 217 time: 0.2343090 May 12 15:16:02.316253 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-c9111ceb-33df-426f-bab4-4e58dfc710f1 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0859487 May 12 15:16:02.381562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-241aa0e8-61ea-4160-a74b-b89a539baa1e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:02.381562 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-241aa0e8-61ea-4160-a74b-b89a539baa1e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=722dd775-53fe-4359-9d8f-d74143e5ced9 HTTP/1.1" status: 200 len: 797 time: 0.1068137 May 12 15:16:02.475798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b5e1a68d-35fc-41af-9298-0f11c796383d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:02.475798 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-b5e1a68d-35fc-41af-9298-0f11c796383d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e6a7ff8f-d7ef-4614-8958-ef6026371726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.0862119 May 12 15:16:02.484081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f46ac618-d9ad-4679-ad7a-a3ad346278db req-a0547d2e-7f61-4817-a4c9-5cb9c9cb53d1 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:02.489124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f46ac618-d9ad-4679-ad7a-a3ad346278db req-a0547d2e-7f61-4817-a4c9-5cb9c9cb53d1 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:02.491923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f46ac618-d9ad-4679-ad7a-a3ad346278db req-a0547d2e-7f61-4817-a4c9-5cb9c9cb53d1 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:02.498375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f46ac618-d9ad-4679-ad7a-a3ad346278db req-a0547d2e-7f61-4817-a4c9-5cb9c9cb53d1 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:02.504525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f46ac618-d9ad-4679-ad7a-a3ad346278db req-a0547d2e-7f61-4817-a4c9-5cb9c9cb53d1 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:02.511607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f46ac618-d9ad-4679-ad7a-a3ad346278db req-a0547d2e-7f61-4817-a4c9-5cb9c9cb53d1 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:02.517082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f46ac618-d9ad-4679-ad7a-a3ad346278db req-a0547d2e-7f61-4817-a4c9-5cb9c9cb53d1 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:02.518740 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f46ac618-d9ad-4679-ad7a-a3ad346278db req-a0547d2e-7f61-4817-a4c9-5cb9c9cb53d1 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5444 time: 0.5186596 May 12 15:16:02.539245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0881956d-8de3-46a3-8628-1227119d100b req-d26c0ba1-43c0-4b53-b5a3-4c3b6a4acf88 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:02.546637 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0881956d-8de3-46a3-8628-1227119d100b req-d26c0ba1-43c0-4b53-b5a3-4c3b6a4acf88 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 945 time: 0.6162271 May 12 15:16:02.598630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-809b2daa-d23a-4bda-87f1-01e2093d8270 service neutron] 10.222.0.76 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2638252 May 12 15:16:02.681858 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-015f342c-e765-4267-a924-0f1f2a44e975 service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1916773 May 12 15:16:02.730349 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0881956d-8de3-46a3-8628-1227119d100b req-1bc6be6e-a7c0-4cee-bba1-997256f22d12 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1748316 May 12 15:16:02.906756 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-ab384020-528e-43e5-8078-5b6dfd287342 service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2168736 May 12 15:16:02.938503 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ebfd9f3-d808-4e82-bda7-4dc7b838fa8d req-0daccd6d-daf0-42ad-8270-e7d064989736 service neutron] 10.222.0.76 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3281941 May 12 15:16:03.016045 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-1bdf7f48-ae13-4772-90a0-53727c1a3b07 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.158&port_id=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad HTTP/1.1" status: 200 len: 217 time: 0.1057987 May 12 15:16:03.027037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0603bd96-85f4-4b53-82f3-2b3161fd5a91 req-adc2fea8-6d4d-426c-8c60-63c3878bb3d4 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:03.037200 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0603bd96-85f4-4b53-82f3-2b3161fd5a91 req-adc2fea8-6d4d-426c-8c60-63c3878bb3d4 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 943 time: 0.1570470 May 12 15:16:03.106528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0603bd96-85f4-4b53-82f3-2b3161fd5a91 req-f41e8740-85d1-4994-85ee-b1bd5eb100ed tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671813 May 12 15:16:03.127224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-467f87f7-e60d-4c52-b207-99fe4ad50253 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:03.127224 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-467f87f7-e60d-4c52-b207-99fe4ad50253 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=722dd775-53fe-4359-9d8f-d74143e5ced9 HTTP/1.1" status: 200 len: 797 time: 0.1038146 May 12 15:16:03.171059 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-38e3c2e6-3e89-48cd-b3c8-3dbf1a993c69'] response: {'name': 'network-changed', 'server_uuid': '3ab740bd-7f74-4e50-be5b-e03680401acd', 'tag': '49d6769a-b216-47e8-aaa9-58847c3c8ca7', 'status': 'completed', 'code': 200} May 12 15:16:03.302532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-303cd623-722b-4525-987a-de4d2abb54a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:03.302532 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-303cd623-722b-4525-987a-de4d2abb54a5 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e6a7ff8f-d7ef-4614-8958-ef6026371726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.1657715 May 12 15:16:03.500242 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-d7fab010-33f6-4512-870c-dcce0547580e service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1826866 May 12 15:16:03.668172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-2757bbe6-a717-4317-846d-9a0c7f515ccc tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:03.674985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-2757bbe6-a717-4317-846d-9a0c7f515ccc tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/networks?id=1d7499f3-5bbd-4f94-822c-977c4f67540a HTTP/1.1" status: 200 len: 808 time: 0.3939638 May 12 15:16:03.686126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-5c17fa6b-8f43-4a14-ba8a-8ec899eba938 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:03.687386 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bd6b318c-7d32-4d1b-aba5-1d798ccb9227 service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1807485 May 12 15:16:03.696507 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-5c17fa6b-8f43-4a14-ba8a-8ec899eba938 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/networks?id=c3c7ba99-d7de-4515-b784-ef9ce8b08726 HTTP/1.1" status: 200 len: 805 time: 0.4109325 May 12 15:16:03.722450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4feefce6-ecbf-4958-ac2e-c05d92fe8da9 req-efe72362-de35-45ac-b1e5-76c56c6e8210 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:03.722450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4feefce6-ecbf-4958-ac2e-c05d92fe8da9 req-efe72362-de35-45ac-b1e5-76c56c6e8210 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 1094 time: 0.5177352 May 12 15:16:03.722450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-347aaf5b-7676-4d7c-aa48-38d8c90f3cf8 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/quotas/7d73e66034f94885ae45429129883002 HTTP/1.1" status: 200 len: 375 time: 0.0283411 May 12 15:16:03.722450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-bc7ca98f-e336-4762-bc27-05a13651469d tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/quotas/0221a2702f9c420a9143d37995213f9d HTTP/1.1" status: 200 len: 375 time: 0.0460906 May 12 15:16:03.793544 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-4cf9d46d-7698-489b-8fcc-7949d9def0d9 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=097f632d-3127-4539-ba4a-3e2739125cf8 HTTP/1.1" status: 200 len: 217 time: 0.1021633 May 12 15:16:03.877453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-40cf0a4b-7f67-4760-af50-3b7c30fdbff7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:03.879176 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-40cf0a4b-7f67-4760-af50-3b7c30fdbff7 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=6457d378-be74-408c-98d5-b411738c6998 HTTP/1.1" status: 200 len: 797 time: 0.0780561 May 12 15:16:03.905371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-c84bf8f1-1b1e-4423-bbb7-74ae8c7888fb tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=0221a2702f9c420a9143d37995213f9d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1560116 May 12 15:16:03.958361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6354a9de-50cf-48a3-b02d-9a640ef1b8f2 req-284f7163-3ffc-46e1-a719-1fa8004d3456 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:03.959757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6354a9de-50cf-48a3-b02d-9a640ef1b8f2 req-284f7163-3ffc-46e1-a719-1fa8004d3456 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.76 "GET /v2.0/ports?device_id=e012dc12-9257-4f1f-bf64-5f38b5e69a5f HTTP/1.1" status: 200 len: 944 time: 0.4203274 May 12 15:16:03.979704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-0b902bbb-d482-46d1-9679-931b3faae069 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:03.981052 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-0b902bbb-d482-46d1-9679-931b3faae069 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=c5f75c23-a033-42fa-b7cd-dcbda413fa9a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.0940449 May 12 15:16:04.144619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4feefce6-ecbf-4958-ac2e-c05d92fe8da9 req-06b9fa5e-e5fe-4423-875e-a1e64c4fe088 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:04.146495 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4feefce6-ecbf-4958-ac2e-c05d92fe8da9 req-06b9fa5e-e5fe-4423-875e-a1e64c4fe088 service neutron] 10.222.0.76 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 907 time: 0.4213343 May 12 15:16:04.187888 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-373ec6aa-7a90-4f50-a1f7-c9b90eba5896 service neutron] 10.222.0.84 "GET /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1843400 May 12 15:16:04.228598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-6354a9de-50cf-48a3-b02d-9a640ef1b8f2 req-53798ad7-6239-4acf-ab3e-ca53b963e648 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Deleting port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:16:04.228950 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6354a9de-50cf-48a3-b02d-9a640ef1b8f2 req-53798ad7-6239-4acf-ab3e-ca53b963e648 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:04.419389 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4feefce6-ecbf-4958-ac2e-c05d92fe8da9 req-04be3c12-1886-4bf8-a3b7-4a0584560d91 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=49d6769a-b216-47e8-aaa9-58847c3c8ca7 HTTP/1.1" status: 200 len: 217 time: 0.2637520 May 12 15:16:04.523511 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-f0ea6a45-49d4-4431-ad8e-0fe2f8642402 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=7d73e66034f94885ae45429129883002&fields=id HTTP/1.1" status: 200 len: 255 time: 0.7742951 May 12 15:16:04.541263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-bc86b779-9998-4a71-a29c-a5acc433059e service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:16:04.544196 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-bc86b779-9998-4a71-a29c-a5acc433059e service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0178237 May 12 15:16:04.578733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4feefce6-ecbf-4958-ac2e-c05d92fe8da9 req-920754ab-5140-4c07-9fad-db5f0aa7a923 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:04.578733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4feefce6-ecbf-4958-ac2e-c05d92fe8da9 req-920754ab-5140-4c07-9fad-db5f0aa7a923 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.1335356 May 12 15:16:04.583123 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-bf53e699-b071-4160-9cef-1bafcf0e7911 service neutron] 10.222.0.84 "GET /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3793888 May 12 15:16:04.600721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-642f6e48-6373-4781-90ae-cf425196977d service neutron] 10.222.0.82 "GET /v2.0/networks/1d7499f3-5bbd-4f94-822c-977c4f67540a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6633883 May 12 15:16:04.658052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2483265a-0012-4339-be86-677490680e84 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:16:04.679608 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-87ba2808-0b48-4edc-b5ef-3a45efede1f8 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e HTTP/1.1" status: 200 len: 217 time: 0.0909231 May 12 15:16:04.679608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-2eddfa3d-e093-4d76-a034-3ff6828b42d9 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:04.692427 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-2eddfa3d-e093-4d76-a034-3ff6828b42d9 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.84 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244&tenant_id=68c66ae0cd45476b87e2e79625b80f69&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 1096 time: 0.6758938 May 12 15:16:04.737733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-841483-1'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:04.879415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55306) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:04.885879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 2483265a-0012-4339-be86-677490680e84, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2483265a-0012-4339-be86-677490680e84,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:04.902989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-11fe287f-620e-4db5-8249-f46ee5f43c6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:04.904274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2483265a-0012-4339-be86-677490680e84 has no active binding in host n-h1-841483-1 {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:142}} May 12 15:16:04.907409 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-11fe287f-620e-4db5-8249-f46ee5f43c6a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=6457d378-be74-408c-98d5-b411738c6998 HTTP/1.1" status: 200 len: 797 time: 0.2247779 May 12 15:16:04.989987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4feefce6-ecbf-4958-ac2e-c05d92fe8da9 req-9f0197ca-bcb4-4a7c-af8b-fe5b185608a1 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.3579710 May 12 15:16:05.029543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:05.090513 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-71597c32-6247-4d8d-8eb4-9b043e4ec0a6 service neutron] 10.222.0.82 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4598689 May 12 15:16:05.159752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-95a5aea6-d8f8-45a4-8820-4344e05b7f68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:05.161406 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-95a5aea6-d8f8-45a4-8820-4344e05b7f68 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=c5f75c23-a033-42fa-b7cd-dcbda413fa9a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.2322385 May 12 15:16:05.306748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d14f4d8-e33d-42be-b933-331e0f810f7a req-28d35b96-85d7-4c83-83ed-2c8e85f32d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:05.307235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d14f4d8-e33d-42be-b933-331e0f810f7a req-28d35b96-85d7-4c83-83ed-2c8e85f32d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:05.307702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d14f4d8-e33d-42be-b933-331e0f810f7a req-28d35b96-85d7-4c83-83ed-2c8e85f32d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:05.308169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d14f4d8-e33d-42be-b933-331e0f810f7a req-28d35b96-85d7-4c83-83ed-2c8e85f32d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:05.308628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d14f4d8-e33d-42be-b933-331e0f810f7a req-28d35b96-85d7-4c83-83ed-2c8e85f32d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:05.309077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d14f4d8-e33d-42be-b933-331e0f810f7a req-28d35b96-85d7-4c83-83ed-2c8e85f32d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:05.309757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d14f4d8-e33d-42be-b933-331e0f810f7a req-28d35b96-85d7-4c83-83ed-2c8e85f32d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:05.312220 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d14f4d8-e33d-42be-b933-331e0f810f7a req-28d35b96-85d7-4c83-83ed-2c8e85f32d9b service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 6501 time: 0.4298923 May 12 15:16:05.376567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-9da1af28-c265-4826-99d2-18de38724c32 service neutron] 10.222.0.82 "GET /v2.0/networks/1d7499f3-5bbd-4f94-822c-977c4f67540a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7829289 May 12 15:16:05.435323 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d14f4d8-e33d-42be-b933-331e0f810f7a req-4fd45806-2897-43d7-b3b0-ee3e4793a82e service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=5d05f580-8d94-4f7a-847b-79c969006d42&id=f02964c6-c413-4fee-8742-d14649e5864e&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1061535 May 12 15:16:05.459769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] For port 2483265a-0012-4339-be86-677490680e84, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2483265a-0012-4339-be86-677490680e84,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:05.463299 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4feefce6-ecbf-4958-ac2e-c05d92fe8da9 req-459e5e63-d6b7-4b9b-8114-a884dfbb62f2 service neutron] 10.222.0.76 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4487104 May 12 15:16:05.488559 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-041e8752-0b89-405c-9d9f-7e2ef8d5cb98 service neutron] 10.222.0.84 "GET /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2718132 May 12 15:16:05.574782 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-180a1a21-27c4-437a-8569-efd373383a51 service neutron] 10.222.0.82 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4567242 May 12 15:16:05.585296 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-6354a9de-50cf-48a3-b02d-9a640ef1b8f2 req-53798ad7-6239-4acf-ab3e-ca53b963e648 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] For port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:05.586146 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6354a9de-50cf-48a3-b02d-9a640ef1b8f2 req-53798ad7-6239-4acf-ab3e-ca53b963e648 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:05.591985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:16:05.709654 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad61f312-37b7-4a6a-9a2b-5870c15e1ac7 req-55ee306a-a06b-4c77-a74d-b867c3ad154f service neutron] 10.222.0.84 "GET /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2205725 May 12 15:16:05.722436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] For port 2483265a-0012-4339-be86-677490680e84, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:16:05.741617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-6354a9de-50cf-48a3-b02d-9a640ef1b8f2 req-53798ad7-6239-4acf-ab3e-ca53b963e648 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Calling delete_port for 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:16:05.782601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 49d6769a-b216-47e8-aaa9-58847c3c8ca7 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:16:05.911955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7396daa3-460c-4d29-88ac-fe6ba33a7244', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2483265a-0012-4339-be86-677490680e84'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:05.952890 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:06.140486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:06.176376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 49d6769a-b216-47e8-aaa9-58847c3c8ca7, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=49d6769a-b216-47e8-aaa9-58847c3c8ca7,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:06.186579 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4feefce6-ecbf-4958-ac2e-c05d92fe8da9 req-f84f66f5-02a9-426f-811b-2da7ac391dbf service neutron] 10.222.0.76 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7135086 May 12 15:16:06.209186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '49d6769a-b216-47e8-aaa9-58847c3c8ca7', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'port_id': '49d6769a-b216-47e8-aaa9-58847c3c8ca7', 'mac_address': 'fa:16:3e:24:20:1a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 558, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84c2082e-f394-46d5-8a8f-8e3a70d54fc1', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:16:06.300871 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:06.393499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 49d6769a-b216-47e8-aaa9-58847c3c8ca7 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:06.431763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 49d6769a-b216-47e8-aaa9-58847c3c8ca7, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=49d6769a-b216-47e8-aaa9-58847c3c8ca7,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:06.431763 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:06.466738 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6354a9de-50cf-48a3-b02d-9a640ef1b8f2 req-53798ad7-6239-4acf-ab3e-ca53b963e648 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:06.519429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Pushing event updated for resources: {'Port': ['ID=2483265a-0012-4339-be86-677490680e84,revision_number=7']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:06.538768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Attempting to bind port 2483265a-0012-4339-be86-677490680e84 on host n-h2-841483-1 for vnic_type normal with profile {"migrating_to": "n-h1-841483-1"} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:16:06.538768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Attempting to bind port 2483265a-0012-4339-be86-677490680e84 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:16:06.538768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Attempting to bind port 2483265a-0012-4339-be86-677490680e84 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:06.552983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Port 2483265a-0012-4339-be86-677490680e84 on network e8211761-0dd9-424f-b732-629fd2d77e28 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:16:06.552983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Attempting to bind port 2483265a-0012-4339-be86-677490680e84 on network e8211761-0dd9-424f-b732-629fd2d77e28 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:06.565444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 16, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:16:06.565444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Checking segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:16:06.565444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Bound using segment: {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:16:06.565444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Bound port: 2483265a-0012-4339-be86-677490680e84, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '619405e4-e83d-45d8-8f13-c0a176ec94ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'e8211761-0dd9-424f-b732-629fd2d77e28'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:16:06.570539 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:06.594323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=49d6769a-b216-47e8-aaa9-58847c3c8ca7,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:06.629604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53798ad7-6239-4acf-ab3e-ca53b963e648 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Pushing event deleted for resources: {'Port': ['ID=294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:06.636245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-edbf3ee1-550f-4ab3-ba47-0c18166bc0ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:06.636693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-edbf3ee1-550f-4ab3-ba47-0c18166bc0ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:06.637165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-edbf3ee1-550f-4ab3-ba47-0c18166bc0ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:06.637715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-edbf3ee1-550f-4ab3-ba47-0c18166bc0ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:06.638197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-edbf3ee1-550f-4ab3-ba47-0c18166bc0ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:06.638636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-edbf3ee1-550f-4ab3-ba47-0c18166bc0ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:06.639094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-edbf3ee1-550f-4ab3-ba47-0c18166bc0ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:06.641530 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-edbf3ee1-550f-4ab3-ba47-0c18166bc0ee service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=42581a8af83242e0bb61f84a30bd27a7&device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 6476 time: 0.6347136 May 12 15:16:06.643436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea09918-c5f1-4d14-923a-86f05010aaca req-f03478f2-3ebd-4cd4-a672-adf25506db1c tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:06.646102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aea09918-c5f1-4d14-923a-86f05010aaca req-f03478f2-3ebd-4cd4-a672-adf25506db1c tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 945 time: 0.5825140 May 12 15:16:06.705542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['49d6769a-b216-47e8-aaa9-58847c3c8ca7'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:06.909531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] For port 2483265a-0012-4339-be86-677490680e84, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:16:06.938523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] For port 2483265a-0012-4339-be86-677490680e84, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2483265a-0012-4339-be86-677490680e84,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:16:06.960053 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:06.992300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc44a799-e92a-4c33-b59b-b7e0c6e6813a req-3db1724e-d926-4cde-abec-9b7e3dfb708b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:06.998629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc44a799-e92a-4c33-b59b-b7e0c6e6813a req-3db1724e-d926-4cde-abec-9b7e3dfb708b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:07.004927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc44a799-e92a-4c33-b59b-b7e0c6e6813a req-3db1724e-d926-4cde-abec-9b7e3dfb708b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:07.012319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc44a799-e92a-4c33-b59b-b7e0c6e6813a req-3db1724e-d926-4cde-abec-9b7e3dfb708b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:07.020208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc44a799-e92a-4c33-b59b-b7e0c6e6813a req-3db1724e-d926-4cde-abec-9b7e3dfb708b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:07.026802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc44a799-e92a-4c33-b59b-b7e0c6e6813a req-3db1724e-d926-4cde-abec-9b7e3dfb708b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:07.032728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc44a799-e92a-4c33-b59b-b7e0c6e6813a req-3db1724e-d926-4cde-abec-9b7e3dfb708b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:07.043339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc44a799-e92a-4c33-b59b-b7e0c6e6813a req-3db1724e-d926-4cde-abec-9b7e3dfb708b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5419 time: 1.0786810 May 12 15:16:07.073415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-6354a9de-50cf-48a3-b02d-9a640ef1b8f2 req-53798ad7-6239-4acf-ab3e-ca53b963e648 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] No DVR routers for this DVR port 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:16:07.076232 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6354a9de-50cf-48a3-b02d-9a640ef1b8f2 req-53798ad7-6239-4acf-ab3e-ca53b963e648 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:07.083468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e012dc12-9257-4f1f-bf64-5f38b5e69a5f', 'name': 'network-vif-deleted', 'tag': '294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:07.124109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-8990ac15-3fbd-4dda-b6c3-e208dc0225b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:07.125562 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-8990ac15-3fbd-4dda-b6c3-e208dc0225b1 service neutron] 10.222.0.84 "GET /v2.0/networks?id=c5f75c23-a033-42fa-b7cd-dcbda413fa9a HTTP/1.1" status: 200 len: 903 time: 0.4427116 May 12 15:16:07.126827 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6354a9de-50cf-48a3-b02d-9a640ef1b8f2 req-53798ad7-6239-4acf-ab3e-ca53b963e648 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.76 "DELETE /v2.0/ports/294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c HTTP/1.1" status: 204 len: 173 time: 3.1565237 May 12 15:16:07.138311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aea09918-c5f1-4d14-923a-86f05010aaca req-58e157c9-0141-42bf-a82d-db1330235d6f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2184939 May 12 15:16:07.142656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc44a799-e92a-4c33-b59b-b7e0c6e6813a req-a2f0e563-72a3-4df8-8d2b-1cfe72a214b9 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0982964 May 12 15:16:07.303826 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-ae9ed7b0-908e-4bad-bd64-9096d809604b service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e HTTP/1.1" status: 200 len: 217 time: 0.0894966 May 12 15:16:07.402289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:07.402896 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:07.404250 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] 10.222.0.84 "PUT /v2.0/ports/2483265a-0012-4339-be86-677490680e84 HTTP/1.1" status: 200 len: 1121 time: 2.6813598 May 12 15:16:07.411030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c636fbfe-671f-4039-8c2d-fdd7db90691d service neutron] Pushing event updated for resources: {'Port': ['ID=2483265a-0012-4339-be86-677490680e84,revision_number=8']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:07.428585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-1deb55b7-b586-49c4-8e1e-9da8c578f020 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:07.429863 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-1deb55b7-b586-49c4-8e1e-9da8c578f020 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=6457d378-be74-408c-98d5-b411738c6998 HTTP/1.1" status: 200 len: 797 time: 0.0953157 May 12 15:16:07.496589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['2483265a-0012-4339-be86-677490680e84'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:07.539374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-a594615d-ae75-4792-a096-5cb93951ef6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:07.541249 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-a594615d-ae75-4792-a096-5cb93951ef6e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=c5f75c23-a033-42fa-b7cd-dcbda413fa9a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.1050603 May 12 15:16:07.596226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['2483265a-0012-4339-be86-677490680e84'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:07.597609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d4ea4a-f0e4-4e77-960f-a5bfa0321b9c req-d3cf4a40-1eb9-4b44-ba7a-b52c8a1412dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:07.600075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44d4ea4a-f0e4-4e77-960f-a5bfa0321b9c req-d3cf4a40-1eb9-4b44-ba7a-b52c8a1412dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 944 time: 0.1956992 May 12 15:16:07.611882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa534d3f-8249-47de-8904-e2fc684672c3 req-eb2a910a-fc91-4788-b3e1-0419b17d7c56 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:07.613754 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa534d3f-8249-47de-8904-e2fc684672c3 req-eb2a910a-fc91-4788-b3e1-0419b17d7c56 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 945 time: 0.3275604 May 12 15:16:07.767868 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-f6363d49-9869-4a1b-a6cf-bb27bb0d315d service neutron] 10.222.0.84 "GET /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2172043 May 12 15:16:07.805018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 49d6769a-b216-47e8-aaa9-58847c3c8ca7 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:07.863591 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44d4ea4a-f0e4-4e77-960f-a5bfa0321b9c req-f1a05898-d59d-4af3-9620-e1b7cad756aa tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2461240 May 12 15:16:07.898578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa534d3f-8249-47de-8904-e2fc684672c3 req-28d9e2e5-df3f-411c-ad3f-5adb15824eb0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2476966 May 12 15:16:07.987448 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-2a89f1bc-4de4-4306-9bb6-0b94554ee401 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:07.989806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-2a89f1bc-4de4-4306-9bb6-0b94554ee401 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.76 "GET /v2.0/networks?id=c3c7ba99-d7de-4515-b784-ef9ce8b08726 HTTP/1.1" status: 200 len: 805 time: 0.3734787 May 12 15:16:08.006025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Request body: {'port': {'device_id': 'c404b13c-0df0-43be-82ae-456d361c1059', 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726', 'admin_state_up': True, 'tenant_id': '7d73e66034f94885ae45429129883002'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:08.065777 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 49d6769a-b216-47e8-aaa9-58847c3c8ca7 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:08.073913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 49d6769a-b216-47e8-aaa9-58847c3c8ca7 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:08.074466 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:08.076544 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f8df2357-46c8-46b9-b008-18cbed88fbf9 req-0c4583a1-a95f-48cd-ab86-773a22637960 service neutron] 10.222.0.84 "GET /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3041258 May 12 15:16:08.202134 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5852882d-ad6d-4512-acc1-ff396af58cb0 req-ab8be4a3-a887-4f4b-8ffb-340c0abb3cc4 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 210 time: 0.1573198 May 12 15:16:08.211981 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:08.272411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 49d6769a-b216-47e8-aaa9-58847c3c8ca7, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=49d6769a-b216-47e8-aaa9-58847c3c8ca7,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:08.272411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ab740bd-7f74-4e50-be5b-e03680401acd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '49d6769a-b216-47e8-aaa9-58847c3c8ca7'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:08.272411 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:08.272411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:16:08.294970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-49f355be-fea4-41de-97ec-43fa2ac7b7fd req-2e377e79-aa21-4ffa-b556-82ed4175cf0f tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Synchronizing usage tracker for tenant:7d73e66034f94885ae45429129883002 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:08.403947 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=49d6769a-b216-47e8-aaa9-58847c3c8ca7,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:08.414044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:16:08.414441 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:16:08.513668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-49f355be-fea4-41de-97ec-43fa2ac7b7fd req-2e377e79-aa21-4ffa-b556-82ed4175cf0f tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Unset dirty status for tenant:7d73e66034f94885ae45429129883002 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:08.514421 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49f355be-fea4-41de-97ec-43fa2ac7b7fd req-2e377e79-aa21-4ffa-b556-82ed4175cf0f tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 210 time: 0.3440835 May 12 15:16:08.532365 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3041b9aa-63c8-42f9-884a-42f194608d0d req-ec39614e-0d00-4fe7-8e92-7b3c9eaeb903 tempest-AbsoluteLimitsNegativeTestJSON-821324685 tempest-AbsoluteLimitsNegativeTestJSON-821324685-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=e2a509cbec1b4eefb982df720ba09a75&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0725987 May 12 15:16:08.590141 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a3ca2996-9e2c-4945-8e61-7e87eeb9c2c6'] response: {'server_uuid': '7396daa3-460c-4d29-88ac-fe6ba33a7244', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2483265a-0012-4339-be86-677490680e84', 'code': 200} May 12 15:16:08.622162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-e8a511e7-b138-4d51-b12f-f71dd5cf7779 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:08.623193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-e8a511e7-b138-4d51-b12f-f71dd5cf7779 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.76 "GET /v2.0/networks?id=1d7499f3-5bbd-4f94-822c-977c4f67540a HTTP/1.1" status: 200 len: 808 time: 0.4473977 May 12 15:16:08.629287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:08.685758 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1b090a66-a693-4f12-abd3-d78befa54712'] response: {'server_uuid': 'e012dc12-9257-4f1f-bf64-5f38b5e69a5f', 'name': 'network-vif-deleted', 'tag': '294bbcc1-2a3d-42ea-85d8-4f4fc3f6c79c', 'status': 'completed', 'code': 200} May 12 15:16:08.696482 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Request body: {'port': {'device_id': 'e8edf139-ac47-4665-b440-955365fe722e', 'network_id': '1d7499f3-5bbd-4f94-822c-977c4f67540a', 'admin_state_up': True, 'tenant_id': '0221a2702f9c420a9143d37995213f9d'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:08.733172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:08.826878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Made reservation on behalf of 7d73e66034f94885ae45429129883002 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:16:08.830413 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:09.028006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3041b9aa-63c8-42f9-884a-42f194608d0d req-3c4d500d-f4bb-44ce-a532-4a387ada2792 tempest-AbsoluteLimitsNegativeTestJSON-821324685 tempest-AbsoluteLimitsNegativeTestJSON-821324685-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:09.029542 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3041b9aa-63c8-42f9-884a-42f194608d0d req-3c4d500d-f4bb-44ce-a532-4a387ada2792 tempest-AbsoluteLimitsNegativeTestJSON-821324685 tempest-AbsoluteLimitsNegativeTestJSON-821324685-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4797592 May 12 15:16:09.088911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:09.103604 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3041b9aa-63c8-42f9-884a-42f194608d0d req-929fc1d9-d0f1-48b9-acf8-3b7fdd5e992f tempest-AbsoluteLimitsNegativeTestJSON-821324685 tempest-AbsoluteLimitsNegativeTestJSON-821324685-project] 10.222.0.82 "GET /v2.0/quotas/e2a509cbec1b4eefb982df720ba09a75 HTTP/1.1" status: 200 len: 375 time: 0.0547495 May 12 15:16:09.104677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Usage tracker for resource:port and tenant:0221a2702f9c420a9143d37995213f9d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:09.114910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:09.125661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:09.199326 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3041b9aa-63c8-42f9-884a-42f194608d0d req-a547cd08-f891-473e-9bf5-a109132552bb tempest-AbsoluteLimitsNegativeTestJSON-821324685 tempest-AbsoluteLimitsNegativeTestJSON-821324685-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=e2a509cbec1b4eefb982df720ba09a75&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0845597 May 12 15:16:09.260547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Made reservation on behalf of 0221a2702f9c420a9143d37995213f9d for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:16:09.265639 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:09.376915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38ffb70a-728b-4d78-9816-d8a062e7da65 req-fa5d4852-a6a7-47f2-8995-739a536a2757 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:09.376915 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-38ffb70a-728b-4d78-9816-d8a062e7da65 req-fa5d4852-a6a7-47f2-8995-739a536a2757 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 943 time: 0.4783061 May 12 15:16:09.388697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Allocated IP 172.20.0.3 (c3c7ba99-d7de-4515-b784-ef9ce8b08726/2c6ef05c-5190-47b2-bba9-0d2bdacd727d/c0f50665-5b0d-4723-ad87-6d08af238805) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:16:09.666911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55374) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:09.758046 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-38ffb70a-728b-4d78-9816-d8a062e7da65 req-4eec5589-6d3e-42a3-b17c-4778b016f3c4 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3632050 May 12 15:16:09.818481 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-47617564-74ba-4a9c-9350-1a502b6d4a23 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:09.819600 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6e40eee0-bfe7-4685-ba9d-a40fc6e44c72'] response: {'server_uuid': '3ab740bd-7f74-4e50-be5b-e03680401acd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '49d6769a-b216-47e8-aaa9-58847c3c8ca7', 'code': 200} May 12 15:16:09.836757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-47617564-74ba-4a9c-9350-1a502b6d4a23 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:09.849017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-47617564-74ba-4a9c-9350-1a502b6d4a23 admin admin] Usage tracker for resource:security_group_rule and tenant:e2a509cbec1b4eefb982df720ba09a75 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:09.852576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-47617564-74ba-4a9c-9350-1a502b6d4a23 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:09.860993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-47617564-74ba-4a9c-9350-1a502b6d4a23 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:09.907858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Allocated IP 172.20.0.8 (1d7499f3-5bbd-4f94-822c-977c4f67540a/445d4ea4-9d5e-46f7-a0d1-71a9c4f87159/0a9596a5-4318-4dc7-ace0-c18b1ee4f359) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:16:09.989750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-940ae6ce-ca11-4c59-9f40-ac3d304983c9 req-00db3b45-7e90-4e22-9450-2dd96879daac tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:09.996091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-940ae6ce-ca11-4c59-9f40-ac3d304983c9 req-00db3b45-7e90-4e22-9450-2dd96879daac tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:10.001836 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-940ae6ce-ca11-4c59-9f40-ac3d304983c9 req-00db3b45-7e90-4e22-9450-2dd96879daac tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:10.007502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-940ae6ce-ca11-4c59-9f40-ac3d304983c9 req-00db3b45-7e90-4e22-9450-2dd96879daac tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:10.010007 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-47617564-74ba-4a9c-9350-1a502b6d4a23 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:10.014082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-940ae6ce-ca11-4c59-9f40-ac3d304983c9 req-00db3b45-7e90-4e22-9450-2dd96879daac tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:10.018290 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-47617564-74ba-4a9c-9350-1a502b6d4a23 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:10.020712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-940ae6ce-ca11-4c59-9f40-ac3d304983c9 req-00db3b45-7e90-4e22-9450-2dd96879daac tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:10.026427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-940ae6ce-ca11-4c59-9f40-ac3d304983c9 req-00db3b45-7e90-4e22-9450-2dd96879daac tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:10.028682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-940ae6ce-ca11-4c59-9f40-ac3d304983c9 req-00db3b45-7e90-4e22-9450-2dd96879daac tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5419 time: 0.4627254 May 12 15:16:10.059282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67832dc9-ba49-49d5-b19b-b16f1477e39c req-18baa06c-1baf-4c45-91bf-e17eb3013eaa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:10.060739 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67832dc9-ba49-49d5-b19b-b16f1477e39c req-18baa06c-1baf-4c45-91bf-e17eb3013eaa service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 1096 time: 0.1512728 May 12 15:16:10.065615 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-47617564-74ba-4a9c-9350-1a502b6d4a23 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e2a509cbec1b4eefb982df720ba09a75&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3976846 May 12 15:16:10.074037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55380) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:10.111154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47617564-74ba-4a9c-9350-1a502b6d4a23 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d121562-3c95-4d98-97c3-1852a8e626bd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:10.150875 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67832dc9-ba49-49d5-b19b-b16f1477e39c req-b037c188-6f77-43ac-9a59-aefccb33f982 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0775287 May 12 15:16:10.172864 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-98269f6c-53bb-4d08-a234-80f786aa2620 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:10.181577 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-940ae6ce-ca11-4c59-9f40-ac3d304983c9 req-7fa577ca-f296-4419-a346-fd1e33a50262 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1401210 May 12 15:16:10.201256 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-98269f6c-53bb-4d08-a234-80f786aa2620 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:10.272015 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-98269f6c-53bb-4d08-a234-80f786aa2620 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:10.289876 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:10.304420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98269f6c-53bb-4d08-a234-80f786aa2620 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d121562-3c95-4d98-97c3-1852a8e626bd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:10.308500 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-98269f6c-53bb-4d08-a234-80f786aa2620 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:10.325928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3638118-def4-44bc-b166-07bce8a997d7 req-c604baa0-d290-43a4-8d0a-962753f3dbf0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:10.326799 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-98269f6c-53bb-4d08-a234-80f786aa2620 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2d121562-3c95-4d98-97c3-1852a8e626bd HTTP/1.1" status: 204 len: 168 time: 0.2424386 May 12 15:16:10.337973 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3638118-def4-44bc-b166-07bce8a997d7 req-c604baa0-d290-43a4-8d0a-962753f3dbf0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 945 time: 0.4098663 May 12 15:16:10.492048 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3638118-def4-44bc-b166-07bce8a997d7 req-e880ea26-56a2-4f84-890d-98fc97039221 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1525402 May 12 15:16:10.530699 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:10.539327 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:10.591336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7396daa3-460c-4d29-88ac-fe6ba33a7244', 'tag': '2483265a-0012-4339-be86-677490680e84'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:10.628252 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd71c820-249c-4ae2-8138-5a52634d5949 req-619bb0ff-f898-4e06-9325-310fa51b3c5e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:10.630299 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd71c820-249c-4ae2-8138-5a52634d5949 req-619bb0ff-f898-4e06-9325-310fa51b3c5e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 945 time: 0.2848108 May 12 15:16:10.708588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Network c3c7ba99-d7de-4515-b784-ef9ce8b08726 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:16:10.711346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Pushing event updated for resources: {'Port': ['ID=c0f50665-5b0d-4723-ad87-6d08af238805,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:10.720969 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:16:10.729121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8f56b997-138a-4f56-8a96-214b114d745a req-ea6d64d5-c3e4-497b-bb24-80ff433ecd83 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 210 time: 0.0923178 May 12 15:16:10.740057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:16:10.824921 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd71c820-249c-4ae2-8138-5a52634d5949 req-a0dd9d26-81ea-465f-82d2-fc420b7853d1 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1801350 May 12 15:16:10.857824 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:10.987550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:10.988188 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:11.134740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Network 1d7499f3-5bbd-4f94-822c-977c4f67540a is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:16:11.160045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:16:11.180357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:16:11.249952 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-274606dd-dd70-4060-8d5b-57a0863154c1 service neutron] 10.222.0.76 "GET /v2.0/ports/2483265a-0012-4339-be86-677490680e84/bindings/n-h1-841483-1 HTTP/1.1" status: 200 len: 384 time: 0.1075253 May 12 15:16:11.286378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:11.286989 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:11.292000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Pushing event updated for resources: {'Port': ['ID=0a9596a5-4318-4dc7-ace0-c18b1ee4f359,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:11.298123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55412) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:11.349955 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-55a13955-f04c-4ca3-b081-1614a4faf65c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.3476694 May 12 15:16:11.378118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Request body: {'port': {'device_id': 'c404b13c-0df0-43be-82ae-456d361c1059', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:11.447445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-62a57a9f-e526-44d8-8120-a812cbd18d6c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.7608001 May 12 15:16:11.468018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251688da-8c3a-40d9-b0ef-43c013d73951 req-d91943b4-3dd1-4108-8188-872d3a27e50b tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:11.469916 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-251688da-8c3a-40d9-b0ef-43c013d73951 req-d91943b4-3dd1-4108-8188-872d3a27e50b tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 945 time: 0.3996160 May 12 15:16:11.474373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Request body: {'port': {'device_id': 'e8edf139-ac47-4665-b440-955365fe722e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:11.570553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-25481374-3486-4066-88db-2975203d85bf service neutron] For port 2483265a-0012-4339-be86-677490680e84, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2483265a-0012-4339-be86-677490680e84,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:11.593051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-25481374-3486-4066-88db-2975203d85bf service neutron] For port 2483265a-0012-4339-be86-677490680e84, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:16:11.602443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Request body: {'network': {'name': 'tempest-ServersTestBootFromVolume-659148527-network', 'tenant_id': '60b7c456959149269dc444554ba6a6c2'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:11.614104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:11.626847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ced2a38f-3100-4ab1-bf2f-68b4ba3abade req-74e725a3-7385-4510-8e0d-c0e02f1b4a17 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:11.627522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ced2a38f-3100-4ab1-bf2f-68b4ba3abade req-74e725a3-7385-4510-8e0d-c0e02f1b4a17 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Synchronizing usage tracker for tenant:7d73e66034f94885ae45429129883002 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:11.646559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-25481374-3486-4066-88db-2975203d85bf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2483265a-0012-4339-be86-677490680e84 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:11.651062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Usage tracker for resource:network and tenant:60b7c456959149269dc444554ba6a6c2 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:11.655337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:11.659524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-25481374-3486-4066-88db-2975203d85bf service neutron] For port 2483265a-0012-4339-be86-677490680e84, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2483265a-0012-4339-be86-677490680e84,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:11.673553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:11.678511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-25481374-3486-4066-88db-2975203d85bf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:11.716570 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:11.739284 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-251688da-8c3a-40d9-b0ef-43c013d73951 req-6f83cd22-21a5-4663-b63d-3cde65cccec0 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2271669 May 12 15:16:11.754188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ced2a38f-3100-4ab1-bf2f-68b4ba3abade req-74e725a3-7385-4510-8e0d-c0e02f1b4a17 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Unset dirty status for tenant:7d73e66034f94885ae45429129883002 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:11.755323 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ced2a38f-3100-4ab1-bf2f-68b4ba3abade req-74e725a3-7385-4510-8e0d-c0e02f1b4a17 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 931 time: 0.7773812 May 12 15:16:11.795428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-25481374-3486-4066-88db-2975203d85bf service neutron] Transition to ACTIVE for port object 2483265a-0012-4339-be86-677490680e84 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:16:11.803309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Made reservation on behalf of 60b7c456959149269dc444554ba6a6c2 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:16:11.804038 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-25481374-3486-4066-88db-2975203d85bf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:11.806176 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:11.848173 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-292da9a5-ca03-4310-9cfc-85159047f878'] response: {'name': 'network-changed', 'server_uuid': '7396daa3-460c-4d29-88ac-fe6ba33a7244', 'tag': '2483265a-0012-4339-be86-677490680e84', 'status': 'completed', 'code': 200} May 12 15:16:11.862991 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:12.015236 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:12.111607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:12.136155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-25481374-3486-4066-88db-2975203d85bf service neutron] No DVR routers for this DVR port 2483265a-0012-4339-be86-677490680e84 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:16:12.148503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Usage tracker for resource:security_group_rule and tenant:60b7c456959149269dc444554ba6a6c2 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:12.189654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25481374-3486-4066-88db-2975203d85bf service neutron] Pushing event updated for resources: {'Port': ['ID=2483265a-0012-4339-be86-677490680e84,revision_number=10']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:12.197670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:12.200153 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-25481374-3486-4066-88db-2975203d85bf service neutron] 10.222.0.76 "PUT /v2.0/ports/2483265a-0012-4339-be86-677490680e84/bindings/n-h1-841483-1/activate HTTP/1.1" status: 200 len: 369 time: 0.9413912 May 12 15:16:12.219064 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ced2a38f-3100-4ab1-bf2f-68b4ba3abade req-d74212aa-bd65-43a6-8916-ce0de768c440 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4260070 May 12 15:16:12.227194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c0d0ac9-b236-4595-ab0d-db6847af1ed8 req-4cfe6088-b7c6-4b27-aa3c-b451343b838d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:12.229625 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c0d0ac9-b236-4595-ab0d-db6847af1ed8 req-4cfe6088-b7c6-4b27-aa3c-b451343b838d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 1095 time: 0.3833876 May 12 15:16:12.264967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:12.512300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c0d0ac9-b236-4595-ab0d-db6847af1ed8 req-b973feed-971b-40e4-acab-aede12809f46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:12.514523 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c0d0ac9-b236-4595-ab0d-db6847af1ed8 req-b973feed-971b-40e4-acab-aede12809f46 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.2779453 May 12 15:16:12.576249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-2d7c31d1-4d6c-4fb2-80c0-e7dd6d9a55ea tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:12.578071 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-2d7c31d1-4d6c-4fb2-80c0-e7dd6d9a55ea tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.84 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244&tenant_id=68c66ae0cd45476b87e2e79625b80f69&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 1095 time: 0.2983463 May 12 15:16:12.631550 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c0d0ac9-b236-4595-ab0d-db6847af1ed8 req-1d630831-8281-4f86-a5cd-419b11859f11 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=2483265a-0012-4339-be86-677490680e84 HTTP/1.1" status: 200 len: 217 time: 0.1113791 May 12 15:16:12.636054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e86e189-6b3c-4f3d-bf18-2be086d55522 req-10e6e5c4-ef7e-4195-8f50-550565e31b4c tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:12.638143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e86e189-6b3c-4f3d-bf18-2be086d55522 req-10e6e5c4-ef7e-4195-8f50-550565e31b4c tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 944 time: 0.6188395 May 12 15:16:12.656482 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7ef865b6-4221-40a1-939e-27708e27ccff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:12.717108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c0d0ac9-b236-4595-ab0d-db6847af1ed8 req-74b66e1f-b116-40aa-90c1-a521541c4ad2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:12.718552 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c0d0ac9-b236-4595-ab0d-db6847af1ed8 req-74b66e1f-b116-40aa-90c1-a521541c4ad2 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.0808494 May 12 15:16:12.746696 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:12.773664 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c0d0ac9-b236-4595-ab0d-db6847af1ed8 req-20c82449-2403-41b6-ad81-c078f1bad4f9 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0489788 May 12 15:16:12.777244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-85ec1731-2b52-4352-ba79-8b7bf957ddbb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:12.778629 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-85ec1731-2b52-4352-ba79-8b7bf957ddbb service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244&tenant_id=68c66ae0cd45476b87e2e79625b80f69 HTTP/1.1" status: 200 len: 1095 time: 0.1930089 May 12 15:16:12.791841 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e86e189-6b3c-4f3d-bf18-2be086d55522 req-b51642ae-0700-42d2-bcdf-4d86569a80b3 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1428552 May 12 15:16:12.834025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1b3bad-bba3-4ea2-a4d4-8244baa34899 req-deb01bc4-8cb5-4a8f-af8e-983414138045 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:12.840751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1b3bad-bba3-4ea2-a4d4-8244baa34899 req-deb01bc4-8cb5-4a8f-af8e-983414138045 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:12.847187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1b3bad-bba3-4ea2-a4d4-8244baa34899 req-deb01bc4-8cb5-4a8f-af8e-983414138045 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:12.853346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1b3bad-bba3-4ea2-a4d4-8244baa34899 req-deb01bc4-8cb5-4a8f-af8e-983414138045 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:12.861975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1b3bad-bba3-4ea2-a4d4-8244baa34899 req-deb01bc4-8cb5-4a8f-af8e-983414138045 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:12.867738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1b3bad-bba3-4ea2-a4d4-8244baa34899 req-deb01bc4-8cb5-4a8f-af8e-983414138045 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:12.873647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1b3bad-bba3-4ea2-a4d4-8244baa34899 req-deb01bc4-8cb5-4a8f-af8e-983414138045 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:12.875630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b1b3bad-bba3-4ea2-a4d4-8244baa34899 req-deb01bc4-8cb5-4a8f-af8e-983414138045 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5419 time: 0.4928212 May 12 15:16:12.881166 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:12.888367 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:12.997906 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c0d0ac9-b236-4595-ab0d-db6847af1ed8 req-17f4f89d-09cb-4c50-98b6-87868f5f795e service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2173283 May 12 15:16:13.000480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-39408250-a7b6-457b-8c49-1db004314eff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:13.001938 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-39408250-a7b6-457b-8c49-1db004314eff service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 1095 time: 0.1453280 May 12 15:16:13.036798 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:16:13.048831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 597} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:16:13.061451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=76d1888c-b8d7-463e-9024-d0050580818c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:13.075192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c0f50665-5b0d-4723-ad87-6d08af238805 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:13.129258 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:13.153033 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:13.153033 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Added segment 51a763ab-4327-4303-92e7-963b2e4c87d0 of type vlan for network 944a3072-30fa-47bc-9620-9dfd43f531e1 May 12 15:16:13.160712 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b1b3bad-bba3-4ea2-a4d4-8244baa34899 req-eef70eb9-4ebf-48de-bd29-f339c2a13c92 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2298815 May 12 15:16:13.176298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Transition to ACTIVE for port object c0f50665-5b0d-4723-ad87-6d08af238805 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:16:13.188735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:13.212049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:13.215625 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:13.274350 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:13.274942 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c0d0ac9-b236-4595-ab0d-db6847af1ed8 req-0b85bc3b-c724-4600-956d-e256428aee9a service neutron] 10.222.0.76 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2723539 May 12 15:16:13.276231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-e88c3db1-031e-43e5-b0e4-1ddb96cab10d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:13.277523 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-e88c3db1-031e-43e5-b0e4-1ddb96cab10d service neutron] 10.222.0.84 "GET /v2.0/networks?id=e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 200 len: 909 time: 0.2558789 May 12 15:16:13.320268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Transition to ACTIVE for port object 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:16:13.392682 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:13.422742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Pushing event updated for resources: {'Port': ['ID=c0f50665-5b0d-4723-ad87-6d08af238805,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:13.433680 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-dccc7e2f-3282-4eb9-932b-96aec0a187fb service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=2483265a-0012-4339-be86-677490680e84 HTTP/1.1" status: 200 len: 217 time: 0.1484969 May 12 15:16:13.477079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e69a8e0-4009-4052-83c5-9400bc35a3d3 req-a2dfc42a-c65d-43c9-86c1-1cd95e198319 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:13.478398 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1e69a8e0-4009-4052-83c5-9400bc35a3d3 req-a2dfc42a-c65d-43c9-86c1-1cd95e198319 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Synchronizing usage tracker for tenant:0221a2702f9c420a9143d37995213f9d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:13.510109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-7098f6fd-03b2-4f58-a540-810bd8975081 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:13.511546 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-7098f6fd-03b2-4f58-a540-810bd8975081 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 200 len: 848 time: 0.0693166 May 12 15:16:13.578753 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-1ff44979-344b-49bd-aec1-022b8790dd0d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e8211761-0dd9-424f-b732-629fd2d77e28&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0557702 May 12 15:16:13.664749 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:13.665829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:13.666436 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:13.740279 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-3de6e977-f641-4e97-ac11-92acbfe5521c service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1564333 May 12 15:16:13.829630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 2483265a-0012-4339-be86-677490680e84 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:16:13.902266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 2483265a-0012-4339-be86-677490680e84 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:16:13.996686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Pushing event updated for resources: {'Port': ['ID=0a9596a5-4318-4dc7-ace0-c18b1ee4f359,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:14.009987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-65812f58-f9f2-48f2-ad6b-56c5377c0099 service neutron] 10.222.0.84 "GET /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2611072 May 12 15:16:14.010729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1e69a8e0-4009-4052-83c5-9400bc35a3d3 req-a2dfc42a-c65d-43c9-86c1-1cd95e198319 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Unset dirty status for tenant:0221a2702f9c420a9143d37995213f9d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:14.011857 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1e69a8e0-4009-4052-83c5-9400bc35a3d3 req-a2dfc42a-c65d-43c9-86c1-1cd95e198319 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 931 time: 1.0786853 May 12 15:16:14.055787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] Pushing event updated for resources: {'Network': ['ID=944a3072-30fa-47bc-9620-9dfd43f531e1,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:14.065770 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-780ef6aa-5123-439c-a98d-a5761cd49ec0 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 2.7637517 May 12 15:16:14.066518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 944a3072-30fa-47bc-9620-9dfd43f531e1 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:16:14.069138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55432) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:14.076548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Request body: {'subnet': {'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestBootFromVolume-659148527-subnet', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:14.082269 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:14.086628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Usage tracker for resource:subnet and tenant:60b7c456959149269dc444554ba6a6c2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:14.090499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:14.096567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:14.111162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Made reservation on behalf of 60b7c456959149269dc444554ba6a6c2 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:16:14.113930 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.124839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Attempting to bind port c0f50665-5b0d-4723-ad87-6d08af238805 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:16:14.125174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Attempting to bind port c0f50665-5b0d-4723-ad87-6d08af238805 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:16:14.125534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Attempting to bind port c0f50665-5b0d-4723-ad87-6d08af238805 on network c3c7ba99-d7de-4515-b784-ef9ce8b08726 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:14.135571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1e69a8e0-4009-4052-83c5-9400bc35a3d3 req-bcda94e3-18f9-479a-8e1c-8839f6c1aaf6 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/security-groups?id=b520f0c2-32b3-4656-bbec-ee430aa330d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1079676 May 12 15:16:14.137401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Attempting to bind port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:16:14.137898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Attempting to bind port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '4d6939e6-0762-4f32-ab66-c216826b2cf3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 574, 'network_id': '1d7499f3-5bbd-4f94-822c-977c4f67540a'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:16:14.138368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Attempting to bind port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 on network 1d7499f3-5bbd-4f94-822c-977c4f67540a {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:14.145074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Port c0f50665-5b0d-4723-ad87-6d08af238805 on network c3c7ba99-d7de-4515-b784-ef9ce8b08726 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:16:14.145414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Attempting to bind port c0f50665-5b0d-4723-ad87-6d08af238805 on network c3c7ba99-d7de-4515-b784-ef9ce8b08726 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:14.166434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d2ecc75-61da-41a9-be41-f1d8649b745d req-54778ad9-be58-4ae7-bd81-aae41f972c79 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:14.168224 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d2ecc75-61da-41a9-be41-f1d8649b745d req-54778ad9-be58-4ae7-bd81-aae41f972c79 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 945 time: 0.6009774 May 12 15:16:14.171403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 on network 1d7499f3-5bbd-4f94-822c-977c4f67540a not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:16:14.171873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Attempting to bind port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 on network 1d7499f3-5bbd-4f94-822c-977c4f67540a {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:14.179512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 16, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:16:14.179860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Checking segment: {'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:16:14.180241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Bound using segment: {'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:16:14.180679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Bound port: c0f50665-5b0d-4723-ad87-6d08af238805, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:16:14.181583 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.207729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 16, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:16:14.208061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Checking segment: {'id': '4d6939e6-0762-4f32-ab66-c216826b2cf3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 574, 'network_id': '1d7499f3-5bbd-4f94-822c-977c4f67540a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:16:14.208610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Bound using segment: {'id': '4d6939e6-0762-4f32-ab66-c216826b2cf3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 574, 'network_id': '1d7499f3-5bbd-4f94-822c-977c4f67540a'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:16:14.209052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Bound port: 0a9596a5-4318-4dc7-ace0-c18b1ee4f359, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4d6939e6-0762-4f32-ab66-c216826b2cf3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 574, 'network_id': '1d7499f3-5bbd-4f94-822c-977c4f67540a'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:16:14.209413 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.399327 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d2ecc75-61da-41a9-be41-f1d8649b745d req-84180692-f1f3-4e86-8f4e-b419f7b2b6f4 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2246082 May 12 15:16:14.456947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] For port c0f50665-5b0d-4723-ad87-6d08af238805, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:16:14.459240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] For port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:16:14.464064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] For port c0f50665-5b0d-4723-ad87-6d08af238805, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c0f50665-5b0d-4723-ad87-6d08af238805,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:16:14.466598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] For port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=0a9596a5-4318-4dc7-ace0-c18b1ee4f359,segment=NetworkSegment(4d6939e6-0762-4f32-ab66-c216826b2cf3),segment_id=4d6939e6-0762-4f32-ab66-c216826b2cf3)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:16:14.471550 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.486734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.514253 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.529589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-5eb13438-9652-4818-bfda-643f02ed8e4a tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:14.531071 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-5eb13438-9652-4818-bfda-643f02ed8e4a tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.84 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244&tenant_id=68c66ae0cd45476b87e2e79625b80f69&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1095 time: 0.1650765 May 12 15:16:14.597012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:14.597630 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.598977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] 10.222.0.76 "PUT /v2.0/ports/c0f50665-5b0d-4723-ad87-6d08af238805 HTTP/1.1" status: 200 len: 1091 time: 3.2273250 May 12 15:16:14.603594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c404b13c-0df0-43be-82ae-456d361c1059', 'tag': 'c0f50665-5b0d-4723-ad87-6d08af238805'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:14.623154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Pushing event updated for resources: {'Subnet': ['ID=1972ca52-439b-4a99-be07-5a8a9346589c,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:14.625143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b2a2fd-ad9d-48dc-99c9-d2936c698708 req-513aa00d-1255-425d-86f0-06a1acab3eaf tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:14.626306 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3b2a2fd-ad9d-48dc-99c9-d2936c698708 req-513aa00d-1255-425d-86f0-06a1acab3eaf tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 943 time: 0.3583050 May 12 15:16:14.629610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:14.630204 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.631515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] 10.222.0.76 "PUT /v2.0/ports/0a9596a5-4318-4dc7-ace0-c18b1ee4f359 HTTP/1.1" status: 200 len: 1091 time: 3.1725566 May 12 15:16:14.653435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Checking segment: {'id': '51a763ab-4327-4303-92e7-963b2e4c87d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:16:14.654037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Network hostable DHCP agents. Network: 944a3072-30fa-47bc-9620-9dfd43f531e1, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:16:14.686338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Network 944a3072-30fa-47bc-9620-9dfd43f531e1 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:16:14.700305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 944a3072-30fa-47bc-9620-9dfd43f531e1) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:16:14.705246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:14.705908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.708379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7be8a04-b2a1-4731-a105-b0ffe527003a None None] Network 944a3072-30fa-47bc-9620-9dfd43f531e1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:16:14.716579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aa87c0f-5bed-4083-928a-f0a4684339ea service neutron] Pushing event updated for resources: {'Port': ['ID=c0f50665-5b0d-4723-ad87-6d08af238805,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:14.725927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-7f419a21-af05-48ac-8672-5387a4518f1f service neutron] For port 2483265a-0012-4339-be86-677490680e84, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:16:14.738500 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-7f419a21-af05-48ac-8672-5387a4518f1f service neutron] Notify callbacks [] for binding, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.739709 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb95c2af-2852-4c4a-a89c-e5a047d0368e req-7f419a21-af05-48ac-8672-5387a4518f1f service neutron] 10.222.0.84 "DELETE /v2.0/ports/2483265a-0012-4339-be86-677490680e84/bindings/n-h2-841483-1 HTTP/1.1" status: 204 len: 173 time: 0.1997850 May 12 15:16:14.741416 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-30ae2493-fc3e-4265-ad97-403a3d2c846e admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6705992 May 12 15:16:14.744790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55442) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:14.749791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Request body: {'router': {'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:14.754795 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:14.758733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Usage tracker for resource:router and tenant:60b7c456959149269dc444554ba6a6c2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:14.763550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:14.769705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:14.782764 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.785325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.810238 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.828852 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ac8843a4-8686-4468-9117-480dae652738 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.887271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3b2a2fd-ad9d-48dc-99c9-d2936c698708 req-04177c4a-116a-4b68-bd47-2230316b3469 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2375660 May 12 15:16:14.913737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5faa0b18-f3c4-46a1-83d0-3ee8b9c5945c req-fa46cf23-801a-4b44-b56a-4b73546bb4b1 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:14.920843 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5faa0b18-f3c4-46a1-83d0-3ee8b9c5945c req-fa46cf23-801a-4b44-b56a-4b73546bb4b1 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 945 time: 0.4140718 May 12 15:16:14.950899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-595f1f7d-93b4-4a97-b4ee-fa8359acab05 service neutron] Pushing event updated for resources: {'Port': ['ID=0a9596a5-4318-4dc7-ace0-c18b1ee4f359,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:14.983035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-944a3072-30fa-47bc-9620-9dfd43f531e1', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'fixed_ips': [{'subnet_id': '1972ca52-439b-4a99-be07-5a8a9346589c'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:16:14.986288 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:14.987399 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5faa0b18-f3c4-46a1-83d0-3ee8b9c5945c req-cebff241-78cf-44b4-8696-e9a9578b40ed tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657222 May 12 15:16:14.990564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-de87f8fc-68ee-49c1-ba3a-1fe12911ae59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:14.992167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-de87f8fc-68ee-49c1-ba3a-1fe12911ae59 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=7d73e66034f94885ae45429129883002&device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 1094 time: 0.3399687 May 12 15:16:14.994556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-804c19a8-99fe-41a9-bea4-684a73123431 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:14.996093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-804c19a8-99fe-41a9-bea4-684a73123431 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0221a2702f9c420a9143d37995213f9d&device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 1094 time: 0.2944603 May 12 15:16:15.136555 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:15.253746 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-e7b91013-678d-4340-8a41-9ad51a4495a9 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0a9596a5-4318-4dc7-ace0-c18b1ee4f359 HTTP/1.1" status: 200 len: 217 time: 0.2064321 May 12 15:16:15.257789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-3c569416-25c8-464a-b685-684fafba9f25 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c0f50665-5b0d-4723-ad87-6d08af238805 HTTP/1.1" status: 200 len: 217 time: 0.2094891 May 12 15:16:15.295513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Allocated IP 172.20.0.2 (944a3072-30fa-47bc-9620-9dfd43f531e1/1972ca52-439b-4a99-be07-5a8a9346589c/b35ebd98-cef6-4408-89c1-4c0186cfb834) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:16:15.485997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-0725744b-c785-4b75-9c19-22e44c0c87cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:15.487675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-0725744b-c785-4b75-9c19-22e44c0c87cb service neutron] 10.222.0.76 "GET /v2.0/subnets?id=445d4ea4-9d5e-46f7-a0d1-71a9c4f87159 HTTP/1.1" status: 200 len: 848 time: 0.1668451 May 12 15:16:15.494247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-5fe85725-28c1-4108-a09e-961c20478cfe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:15.495652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-5fe85725-28c1-4108-a09e-961c20478cfe service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2c6ef05c-5190-47b2-bba9-0d2bdacd727d HTTP/1.1" status: 200 len: 845 time: 0.2155139 May 12 15:16:15.561652 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:15.584981 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:15.596634 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:15.598986 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c9be8fc-91d4-4885-87fd-4ac395c82f8b req-36429a80-cff5-4f3d-9845-c673c1c52b0e tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:15.600852 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1c9be8fc-91d4-4885-87fd-4ac395c82f8b req-36429a80-cff5-4f3d-9845-c673c1c52b0e tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 944 time: 0.6011648 May 12 15:16:15.603066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Transition to ACTIVE for port object b35ebd98-cef6-4408-89c1-4c0186cfb834 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:16:15.609421 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-5368f5c6-bd2c-467a-a43a-cfe0d6d572bd service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=1d7499f3-5bbd-4f94-822c-977c4f67540a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1099982 May 12 15:16:15.621570 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-78be3d7e-ec92-442f-b81a-17b45ea3dcb0 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=c3c7ba99-d7de-4515-b784-ef9ce8b08726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0709910 May 12 15:16:15.626615 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Transition to ACTIVE for port object b35ebd98-cef6-4408-89c1-4c0186cfb834 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:16:15.638134 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:15.723837 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Network 944a3072-30fa-47bc-9620-9dfd43f531e1 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:16:15.726668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:16:15.730754 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:16:15.788265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Allocated IP 172.25.8.194 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/e2ce627a-e325-4d84-8e5d-f1e1fd58d98d) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:16:15.796638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Pushing event updated for resources: {'Port': ['ID=b35ebd98-cef6-4408-89c1-4c0186cfb834,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:15.866779 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Attempting to bind port b35ebd98-cef6-4408-89c1-4c0186cfb834 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:16:15.867209 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Attempting to bind port b35ebd98-cef6-4408-89c1-4c0186cfb834 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '51a763ab-4327-4303-92e7-963b2e4c87d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:16:15.867607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Attempting to bind port b35ebd98-cef6-4408-89c1-4c0186cfb834 on network 944a3072-30fa-47bc-9620-9dfd43f531e1 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:15.875475 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 15, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:16:15.876110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Checking segment: {'id': '51a763ab-4327-4303-92e7-963b2e4c87d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:16:15.876503 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:15.876933 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Bound using segment: {'id': '51a763ab-4327-4303-92e7-963b2e4c87d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:16:15.877513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Bound port: b35ebd98-cef6-4408-89c1-4c0186cfb834, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '51a763ab-4327-4303-92e7-963b2e4c87d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:16:15.878914 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:15.980072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91e16a4-b3ca-4e79-b560-92f2ad543b3e req-9c07fe9b-7f68-4187-903c-5a1785d2f894 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:15.986443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91e16a4-b3ca-4e79-b560-92f2ad543b3e req-9c07fe9b-7f68-4187-903c-5a1785d2f894 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:16.000027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91e16a4-b3ca-4e79-b560-92f2ad543b3e req-9c07fe9b-7f68-4187-903c-5a1785d2f894 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:16.006274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91e16a4-b3ca-4e79-b560-92f2ad543b3e req-9c07fe9b-7f68-4187-903c-5a1785d2f894 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:16.013619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91e16a4-b3ca-4e79-b560-92f2ad543b3e req-9c07fe9b-7f68-4187-903c-5a1785d2f894 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:16.013754 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] For port b35ebd98-cef6-4408-89c1-4c0186cfb834, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:16:16.020891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91e16a4-b3ca-4e79-b560-92f2ad543b3e req-9c07fe9b-7f68-4187-903c-5a1785d2f894 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:16.021091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] For port b35ebd98-cef6-4408-89c1-4c0186cfb834, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b35ebd98-cef6-4408-89c1-4c0186cfb834,segment=NetworkSegment(51a763ab-4327-4303-92e7-963b2e4c87d0),segment_id=51a763ab-4327-4303-92e7-963b2e4c87d0)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:16:16.031338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91e16a4-b3ca-4e79-b560-92f2ad543b3e req-9c07fe9b-7f68-4187-903c-5a1785d2f894 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:16.031729 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:16.039183 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b91e16a4-b3ca-4e79-b560-92f2ad543b3e req-9c07fe9b-7f68-4187-903c-5a1785d2f894 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5419 time: 0.8720818 May 12 15:16:16.108886 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:16.110294 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:16.134159 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:16.138201 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1c9be8fc-91d4-4885-87fd-4ac395c82f8b req-56fff50f-3d7c-4aa0-8614-335f1691114c tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5215390 May 12 15:16:16.174059 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:16.180433 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8661605a-a64e-4fec-9e56-c3387b2ef45d None None] Pushing event updated for resources: {'Port': ['ID=b35ebd98-cef6-4408-89c1-4c0186cfb834,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:16.202752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b91e16a4-b3ca-4e79-b560-92f2ad543b3e req-76278033-9e1b-497c-a825-5b029dffe9d5 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1604609 May 12 15:16:16.267546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:16:16.267705 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-045ce831-0214-469a-8658-80bd1cf2d4ce service neutron] 10.222.0.76 "GET /v2.0/networks/1d7499f3-5bbd-4f94-822c-977c4f67540a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6499734 May 12 15:16:16.270272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:16:16.275740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:16:16.278130 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-0fa009a9-a123-41fc-9f78-172a6a776608 service neutron] 10.222.0.76 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6122622 May 12 15:16:16.330103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Pushing event updated for resources: {'Port': ['ID=e2ce627a-e325-4d84-8e5d-f1e1fd58d98d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:16.352866 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b8ed0606-309e-4db9-a4da-4d12e13e4c9d'] response: {'name': 'network-changed', 'server_uuid': 'c404b13c-0df0-43be-82ae-456d361c1059', 'tag': 'c0f50665-5b0d-4723-ad87-6d08af238805', 'status': 'completed', 'code': 200} May 12 15:16:16.768898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a66e7c6-9794-4a2c-94d9-4aee5a3462fa req-be26ea52-5c66-4fc1-9ebc-b0947aafa213 service neutron] 10.222.0.76 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4637632 May 12 15:16:16.780874 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f936b32-0d48-4a8f-98eb-b1f5c4cf6753 req-bab7c411-c6ce-47b7-b3b7-aa8d5bfd8cb2 service neutron] 10.222.0.76 "GET /v2.0/networks/1d7499f3-5bbd-4f94-822c-977c4f67540a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5014820 May 12 15:16:16.798884 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b35ebd98-cef6-4408-89c1-4c0186cfb834 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:16.802259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db1021c-a8b4-4821-bda9-0544eb1d13ef req-7b9b1b85-9bf0-424d-85e2-6fc6c9318a99 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:16.804085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1db1021c-a8b4-4821-bda9-0544eb1d13ef req-7b9b1b85-9bf0-424d-85e2-6fc6c9318a99 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 945 time: 0.2998903 May 12 15:16:16.872224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2922d39-131c-4188-85b6-41304b8f674b req-4e5777d4-240d-4e5d-bb95-10a6f64df3a1 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:16.873901 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2922d39-131c-4188-85b6-41304b8f674b req-4e5777d4-240d-4e5d-bb95-10a6f64df3a1 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 943 time: 0.1783745 May 12 15:16:16.917938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port b35ebd98-cef6-4408-89c1-4c0186cfb834 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:16.954661 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1db1021c-a8b4-4821-bda9-0544eb1d13ef req-ea9ba0a3-5b9f-44ba-8695-80aaa40d172e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1357226 May 12 15:16:16.975015 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:17.007211 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2922d39-131c-4188-85b6-41304b8f674b req-4993d88b-d2ce-4711-9c35-eaab8a7e47d2 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/security-groups?id=b520f0c2-32b3-4656-bbec-ee430aa330d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811505 May 12 15:16:17.023939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5108bf3c-f6ab-49e7-b805-d2454de4fe18 req-8030ad68-5b6d-4c89-86f5-5e6df417c53d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:17.026950 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5108bf3c-f6ab-49e7-b805-d2454de4fe18 req-8030ad68-5b6d-4c89-86f5-5e6df417c53d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=7d73e66034f94885ae45429129883002&device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 1094 time: 0.1519835 May 12 15:16:17.356765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5108bf3c-f6ab-49e7-b805-d2454de4fe18 req-ad1d71df-1a0c-4de4-8f10-a2a594849b1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:17.363753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5108bf3c-f6ab-49e7-b805-d2454de4fe18 req-ad1d71df-1a0c-4de4-8f10-a2a594849b1a service neutron] 10.222.0.76 "GET /v2.0/networks?id=c3c7ba99-d7de-4515-b784-ef9ce8b08726 HTTP/1.1" status: 200 len: 906 time: 0.3271568 May 12 15:16:17.464291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4874fcf4-c4f3-455e-b9b8-1edd6f1a8cc2 req-420cdccb-a610-46a2-a8d7-ea32b5c8d692 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:17.471682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4874fcf4-c4f3-455e-b9b8-1edd6f1a8cc2 req-420cdccb-a610-46a2-a8d7-ea32b5c8d692 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 945 time: 0.2648962 May 12 15:16:17.474235 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5108bf3c-f6ab-49e7-b805-d2454de4fe18 req-1457f180-fd27-4145-bf5a-81e4fe124d38 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c0f50665-5b0d-4723-ad87-6d08af238805 HTTP/1.1" status: 200 len: 217 time: 0.1011186 May 12 15:16:17.498574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cadc2f99-d25c-4dd3-bd54-f5c5b5b2fc8a req-ccc7d02f-eb60-4314-bfff-778d113a9a3d tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:17.500227 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cadc2f99-d25c-4dd3-bd54-f5c5b5b2fc8a req-ccc7d02f-eb60-4314-bfff-778d113a9a3d tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 943 time: 0.3466065 May 12 15:16:17.566161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:17.593279 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:17.644989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46111dc0-ab75-46ed-8af8-46cf20fc4f14 None None] Network 944a3072-30fa-47bc-9620-9dfd43f531e1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:16:17.683665 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4874fcf4-c4f3-455e-b9b8-1edd6f1a8cc2 req-4d4e05ee-2801-47e0-bcc6-03fb845ad748 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2017984 May 12 15:16:17.706703 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cadc2f99-d25c-4dd3-bd54-f5c5b5b2fc8a req-e6a82f90-55bd-4ca1-88f0-519db55bb5f6 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1515307 May 12 15:16:17.715985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5108bf3c-f6ab-49e7-b805-d2454de4fe18 req-ebe3f81b-b969-4194-8f5c-1f7ead2fef7a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:17.715985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5108bf3c-f6ab-49e7-b805-d2454de4fe18 req-ebe3f81b-b969-4194-8f5c-1f7ead2fef7a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2c6ef05c-5190-47b2-bba9-0d2bdacd727d HTTP/1.1" status: 200 len: 845 time: 0.2076495 May 12 15:16:17.800254 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:16:17.816816 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5108bf3c-f6ab-49e7-b805-d2454de4fe18 req-f81b8140-8127-4792-b95c-7a246198682a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=c3c7ba99-d7de-4515-b784-ef9ce8b08726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0971620 May 12 15:16:17.873314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:16:17.876765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-48a996c8-35f5-4066-b996-3d5b9ded11cd None None] Provisioning for port b35ebd98-cef6-4408-89c1-4c0186cfb834 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:17.895164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-48a996c8-35f5-4066-b996-3d5b9ded11cd None None] Provisioning complete for port b35ebd98-cef6-4408-89c1-4c0186cfb834 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:17.895549 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48a996c8-35f5-4066-b996-3d5b9ded11cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:18.107420 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48a996c8-35f5-4066-b996-3d5b9ded11cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:18.163671 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5108bf3c-f6ab-49e7-b805-d2454de4fe18 req-4848b707-bd8c-40c2-ad7a-2137e01d2a69 service neutron] 10.222.0.76 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3335011 May 12 15:16:18.166841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d4a29f0-401c-47eb-9904-0d85f49dcfb0 req-6927afff-c624-46da-a969-a1c4c9499b04 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:18.167597 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d4a29f0-401c-47eb-9904-0d85f49dcfb0 req-6927afff-c624-46da-a969-a1c4c9499b04 tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 1095 time: 0.2166357 May 12 15:16:18.169487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:16:18.188670 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Sync routers for ids ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:16:18.199821 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:18.203508 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-24868bb7-0339-49fb-a068-531f51d19e6c admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 3.4557927 May 12 15:16:18.204960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55468) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:18.223504 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Routers {'1131f7ae-7566-4efd-ac8e-02ea4717a2aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:16:18.224086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:16:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:18.339281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-48a996c8-35f5-4066-b996-3d5b9ded11cd None None] For port b35ebd98-cef6-4408-89c1-4c0186cfb834, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b35ebd98-cef6-4408-89c1-4c0186cfb834,segment=NetworkSegment(51a763ab-4327-4303-92e7-963b2e4c87d0),segment_id=51a763ab-4327-4303-92e7-963b2e4c87d0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:18.408945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e8edf139-ac47-4665-b440-955365fe722e', 'tag': '0a9596a5-4318-4dc7-ace0-c18b1ee4f359'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:18.438853 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48a996c8-35f5-4066-b996-3d5b9ded11cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:18.504207 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d4a29f0-401c-47eb-9904-0d85f49dcfb0 req-19e7bbce-0bd2-495e-adc1-fab2e883ec2b tempest-LiveMigrationTest-2129024979 tempest-LiveMigrationTest-2129024979-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3137758 May 12 15:16:18.572693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5108bf3c-f6ab-49e7-b805-d2454de4fe18 req-f1b1093e-d116-4673-a8cb-2a38bc516ba8 service neutron] 10.222.0.76 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4023640 May 12 15:16:18.583188 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Set router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:16:18.635920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673da5fe-ee41-4741-8aa9-3603df6a9505 req-e8d1ebb2-fef3-48d9-8d7a-b6ecfb0220fb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:18.643541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673da5fe-ee41-4741-8aa9-3603df6a9505 req-e8d1ebb2-fef3-48d9-8d7a-b6ecfb0220fb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:18.649796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673da5fe-ee41-4741-8aa9-3603df6a9505 req-e8d1ebb2-fef3-48d9-8d7a-b6ecfb0220fb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:18.656171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673da5fe-ee41-4741-8aa9-3603df6a9505 req-e8d1ebb2-fef3-48d9-8d7a-b6ecfb0220fb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:18.662352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673da5fe-ee41-4741-8aa9-3603df6a9505 req-e8d1ebb2-fef3-48d9-8d7a-b6ecfb0220fb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:18.670319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673da5fe-ee41-4741-8aa9-3603df6a9505 req-e8d1ebb2-fef3-48d9-8d7a-b6ecfb0220fb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:18.675898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673da5fe-ee41-4741-8aa9-3603df6a9505 req-e8d1ebb2-fef3-48d9-8d7a-b6ecfb0220fb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:18.679402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-673da5fe-ee41-4741-8aa9-3603df6a9505 req-e8d1ebb2-fef3-48d9-8d7a-b6ecfb0220fb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5419 time: 0.4712386 May 12 15:16:18.751579 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48a996c8-35f5-4066-b996-3d5b9ded11cd None None] Pushing event updated for resources: {'Port': ['ID=b35ebd98-cef6-4408-89c1-4c0186cfb834,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:18.777528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-673da5fe-ee41-4741-8aa9-3603df6a9505 req-ef224fca-dbc5-4f6d-a84f-0733c9c37949 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0596342 May 12 15:16:18.808960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63cfb89c-e8f0-4829-bacf-a4f1bf9b5f3c req-2b69a594-45aa-4070-b5e4-4d4719a70aa6 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:18.816757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63cfb89c-e8f0-4829-bacf-a4f1bf9b5f3c req-2b69a594-45aa-4070-b5e4-4d4719a70aa6 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 945 time: 0.1375213 May 12 15:16:18.892721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63cfb89c-e8f0-4829-bacf-a4f1bf9b5f3c req-3228e2b9-320b-49ce-8af7-130f8aafee1a tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750999 May 12 15:16:18.993806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194'}], 'enable_snat': True}, 'gw_port_id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:16:16Z', 'revision_number': 3, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port': {'id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:79:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1085, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:15Z', 'updated_at': '2022-05-12T15:16:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:19.001953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Checking router: 1131f7ae-7566-4efd-ac8e-02ea4717a2aa for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:16:19.002312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Updating router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa port e2ce627a-e325-4d84-8e5d-f1e1fd58d98d binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:16:19.076903 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:19.199674 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f32c91b5-2fc0-43b5-b5ee-3ac849ac5ee0 req-8b0f15b9-213c-492f-b3da-eeea7371ccf1 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:19.207589 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f32c91b5-2fc0-43b5-b5ee-3ac849ac5ee0 req-8b0f15b9-213c-492f-b3da-eeea7371ccf1 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 943 time: 0.1452744 May 12 15:16:19.263309 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:19.283764 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f32c91b5-2fc0-43b5-b5ee-3ac849ac5ee0 req-b9633be0-277e-4c19-8b18-94fb4d2e746e tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/security-groups?id=b520f0c2-32b3-4656-bbec-ee430aa330d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0752311 May 12 15:16:19.298829 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4e3a5a3c-7f93-467c-9e9d-84140cae0add'] response: {'name': 'network-changed', 'server_uuid': 'e8edf139-ac47-4665-b440-955365fe722e', 'tag': '0a9596a5-4318-4dc7-ace0-c18b1ee4f359', 'status': 'completed', 'code': 200} May 12 15:16:19.335695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cf172245-8f3a-4925-a4d7-df56597339d1 None None] Provisioning complete for port b35ebd98-cef6-4408-89c1-4c0186cfb834 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:19.341532 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cf172245-8f3a-4925-a4d7-df56597339d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:19.491604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3219f069-8c6e-405f-9f11-5ab424b77d00 req-d471b75d-c27e-439f-a435-ca37b088cb1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:19.494950 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3219f069-8c6e-405f-9f11-5ab424b77d00 req-d471b75d-c27e-439f-a435-ca37b088cb1a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0221a2702f9c420a9143d37995213f9d&device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 1094 time: 0.1765666 May 12 15:16:19.672139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Allocated IP 172.20.0.1 (944a3072-30fa-47bc-9620-9dfd43f531e1/1972ca52-439b-4a99-be07-5a8a9346589c/68f43459-2da5-4601-a6c1-9d5d57573727) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:16:19.769279 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:19.785287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Transition to ACTIVE for port object e2ce627a-e325-4d84-8e5d-f1e1fd58d98d will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:16:19.788055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee3a4c5-c294-458f-93f0-2ebeb66c58cf req-2daaed8f-f11a-4e0c-934a-60d5ca57133f tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:19.788055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5ee3a4c5-c294-458f-93f0-2ebeb66c58cf req-2daaed8f-f11a-4e0c-934a-60d5ca57133f tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Synchronizing usage tracker for tenant:aca50b48316f40a7a6ceb23c44dd4720 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:19.797211 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:19.817122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de472292-5dae-403f-b7a7-b281344b2802 req-d552583c-4509-417b-a221-df17ead80798 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:19.818928 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de472292-5dae-403f-b7a7-b281344b2802 req-d552583c-4509-417b-a221-df17ead80798 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 943 time: 0.2901125 May 12 15:16:19.822828 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3219f069-8c6e-405f-9f11-5ab424b77d00 req-5d31754e-9bcd-4ed4-80ba-999c1f0c99b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:19.825752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3219f069-8c6e-405f-9f11-5ab424b77d00 req-5d31754e-9bcd-4ed4-80ba-999c1f0c99b5 service neutron] 10.222.0.76 "GET /v2.0/networks?id=1d7499f3-5bbd-4f94-822c-977c4f67540a HTTP/1.1" status: 200 len: 909 time: 0.3252416 May 12 15:16:19.863469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c0f50665-5b0d-4723-ad87-6d08af238805 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:16:19.908926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Attempting to bind port e2ce627a-e325-4d84-8e5d-f1e1fd58d98d on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:16:19.909297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Attempting to bind port e2ce627a-e325-4d84-8e5d-f1e1fd58d98d by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:16:19.909794 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Attempting to bind port e2ce627a-e325-4d84-8e5d-f1e1fd58d98d on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:19.912305 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:19.924722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 16, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:16:19.925218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:16:19.925830 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:19.926508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:16:19.927122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Bound port: e2ce627a-e325-4d84-8e5d-f1e1fd58d98d, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:16:19.927656 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:19.934192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Transition to ACTIVE for port object 68f43459-2da5-4601-a6c1-9d5d57573727 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:16:19.942809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3219f069-8c6e-405f-9f11-5ab424b77d00 req-0a956659-8f57-432c-a59a-41fdb825628c service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0a9596a5-4318-4dc7-ace0-c18b1ee4f359 HTTP/1.1" status: 200 len: 217 time: 0.0946796 May 12 15:16:19.946139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5ee3a4c5-c294-458f-93f0-2ebeb66c58cf req-2daaed8f-f11a-4e0c-934a-60d5ca57133f tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Unset dirty status for tenant:aca50b48316f40a7a6ceb23c44dd4720 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:19.948291 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5ee3a4c5-c294-458f-93f0-2ebeb66c58cf req-2daaed8f-f11a-4e0c-934a-60d5ca57133f tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.84 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 945 time: 0.3688862 May 12 15:16:19.986134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9ca8c52-a0b6-4b2e-bdc1-d452bbbdb480 None None] Pushing event updated for resources: {'Port': ['ID=e2ce627a-e325-4d84-8e5d-f1e1fd58d98d,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:20.042074 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de472292-5dae-403f-b7a7-b281344b2802 req-272f2508-2410-4da6-8e13-597f322afa19 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2149892 May 12 15:16:20.070723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-5ee3a4c5-c294-458f-93f0-2ebeb66c58cf req-1fcee333-d0f4-4489-893c-03fab800b6bb tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Deleting port 3a378176-9994-44d1-b14f-a0257262a251 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:16:20.070723 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5ee3a4c5-c294-458f-93f0-2ebeb66c58cf req-1fcee333-d0f4-4489-893c-03fab800b6bb tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:20.073278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3219f069-8c6e-405f-9f11-5ab424b77d00 req-806600b0-bf2c-42d4-8a46-8e74e87fa93e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:20.076608 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3219f069-8c6e-405f-9f11-5ab424b77d00 req-806600b0-bf2c-42d4-8a46-8e74e87fa93e service neutron] 10.222.0.76 "GET /v2.0/subnets?id=445d4ea4-9d5e-46f7-a0d1-71a9c4f87159 HTTP/1.1" status: 200 len: 848 time: 0.1276393 May 12 15:16:20.105982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] For port e2ce627a-e325-4d84-8e5d-f1e1fd58d98d, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:16:20.112102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] For port e2ce627a-e325-4d84-8e5d-f1e1fd58d98d, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e2ce627a-e325-4d84-8e5d-f1e1fd58d98d,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:16:20.127776 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:20.141908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:20.152168 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3219f069-8c6e-405f-9f11-5ab424b77d00 req-320045dc-eb5e-46e7-b0bc-c8de31abe25c service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=1d7499f3-5bbd-4f94-822c-977c4f67540a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0675480 May 12 15:16:20.246870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c0f50665-5b0d-4723-ad87-6d08af238805, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c0f50665-5b0d-4723-ad87-6d08af238805,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:20.249120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Network 944a3072-30fa-47bc-9620-9dfd43f531e1 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:16:20.256141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:16:20.266265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:16:20.278838 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9ca8c52-a0b6-4b2e-bdc1-d452bbbdb480 None None] Pushing event updated for resources: {'Port': ['ID=e2ce627a-e325-4d84-8e5d-f1e1fd58d98d,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:20.293009 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Routers {'1131f7ae-7566-4efd-ac8e-02ea4717a2aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:16:20.293751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:16:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:20.395788 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:20.451207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'c0f50665-5b0d-4723-ad87-6d08af238805', 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726', 'port_id': 'c0f50665-5b0d-4723-ad87-6d08af238805', 'mac_address': 'fa:16:3e:ac:96:8f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 587, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2c6ef05c-5190-47b2-bba9-0d2bdacd727d', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:16:20.460653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3219f069-8c6e-405f-9f11-5ab424b77d00 req-7d67062a-ff7d-44c1-a864-76d6d4e082fb service neutron] 10.222.0.76 "GET /v2.0/networks/1d7499f3-5bbd-4f94-822c-977c4f67540a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2723665 May 12 15:16:20.559539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93bfe7a9-3cd6-488b-8d89-1260211ac6d2 req-b4172b76-ed74-484e-9d4c-3edd19c145f6 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:20.560995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93bfe7a9-3cd6-488b-8d89-1260211ac6d2 req-b4172b76-ed74-484e-9d4c-3edd19c145f6 tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 945 time: 0.4077029 May 12 15:16:20.621197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e271678f-0799-44d5-84aa-01ecd84453e5 req-939fc793-b9b3-4baa-8c55-a70e4d583e69 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:20.627832 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e271678f-0799-44d5-84aa-01ecd84453e5 req-939fc793-b9b3-4baa-8c55-a70e4d583e69 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 944 time: 0.4172554 May 12 15:16:20.688373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] Set router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:16:20.698352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93bfe7a9-3cd6-488b-8d89-1260211ac6d2 req-745ccfcd-d0a7-41da-9e3d-7bc14508d99e tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed7317fd-2525-4d5b-a839-904abfb8ef28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1160576 May 12 15:16:20.743778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Pushing event updated for resources: {'Port': ['ID=68f43459-2da5-4601-a6c1-9d5d57573727,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:20.760831 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e271678f-0799-44d5-84aa-01ecd84453e5 req-e6b21a06-843c-4a06-8e04-43e8a5b106c3 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1320179 May 12 15:16:20.851631 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:20.861198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:20.861600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:20.862029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:20.862362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:20.862686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:20.864446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:20.864446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:20.864446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:20.864446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:20.864446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:20.864775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:20.864866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:20.889143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3219f069-8c6e-405f-9f11-5ab424b77d00 req-d77def1e-3cb7-4f39-8ed3-1f03ce68b7bc service neutron] 10.222.0.76 "GET /v2.0/networks/1d7499f3-5bbd-4f94-822c-977c4f67540a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4136033 May 12 15:16:20.920721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b35ebd98-cef6-4408-89c1-4c0186cfb834 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:20.956246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2df8980d-162b-4b88-b922-87a82b2c0f95 None None] Provisioning for port 68f43459-2da5-4601-a6c1-9d5d57573727 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:21.018342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb644f63-7f03-4b13-bbc2-3de96992ce24 req-ce914d2a-3e16-47bd-be28-f3ccac6a6d24 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:21.024255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb644f63-7f03-4b13-bbc2-3de96992ce24 req-ce914d2a-3e16-47bd-be28-f3ccac6a6d24 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:21.031741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb644f63-7f03-4b13-bbc2-3de96992ce24 req-ce914d2a-3e16-47bd-be28-f3ccac6a6d24 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:21.032223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c0f50665-5b0d-4723-ad87-6d08af238805 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:21.036218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2df8980d-162b-4b88-b922-87a82b2c0f95 None None] Provisioning complete for port 68f43459-2da5-4601-a6c1-9d5d57573727 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:21.036748 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2df8980d-162b-4b88-b922-87a82b2c0f95 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:21.038287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb644f63-7f03-4b13-bbc2-3de96992ce24 req-ce914d2a-3e16-47bd-be28-f3ccac6a6d24 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:21.044978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb644f63-7f03-4b13-bbc2-3de96992ce24 req-ce914d2a-3e16-47bd-be28-f3ccac6a6d24 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:21.050776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb644f63-7f03-4b13-bbc2-3de96992ce24 req-ce914d2a-3e16-47bd-be28-f3ccac6a6d24 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:21.054813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1920151a-64f2-409a-8688-315f9a643b2c req-404d2663-50e2-427c-8731-ec4bede19779 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:21.055498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-1920151a-64f2-409a-8688-315f9a643b2c req-404d2663-50e2-427c-8731-ec4bede19779 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Synchronizing usage tracker for tenant:68c66ae0cd45476b87e2e79625b80f69 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:21.057680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb644f63-7f03-4b13-bbc2-3de96992ce24 req-ce914d2a-3e16-47bd-be28-f3ccac6a6d24 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:21.059561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eb644f63-7f03-4b13-bbc2-3de96992ce24 req-ce914d2a-3e16-47bd-be28-f3ccac6a6d24 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5419 time: 0.2328603 May 12 15:16:21.082991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35285c68-3a38-4527-bfed-82ea3e4770e6 req-07c57a86-a475-4a8d-af07-5e21d939f163 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:21.084483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35285c68-3a38-4527-bfed-82ea3e4770e6 req-07c57a86-a475-4a8d-af07-5e21d939f163 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 945 time: 0.1826878 May 12 15:16:21.092672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-5ee3a4c5-c294-458f-93f0-2ebeb66c58cf req-1fcee333-d0f4-4489-893c-03fab800b6bb tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] For port 3a378176-9994-44d1-b14f-a0257262a251, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3a378176-9994-44d1-b14f-a0257262a251,segment=NetworkSegment(68221a3b-1121-4349-a5a1-801f502e908b),segment_id=68221a3b-1121-4349-a5a1-801f502e908b)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:21.093032 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5ee3a4c5-c294-458f-93f0-2ebeb66c58cf req-1fcee333-d0f4-4489-893c-03fab800b6bb tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:21.103340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:21.119955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-1920151a-64f2-409a-8688-315f9a643b2c req-404d2663-50e2-427c-8731-ec4bede19779 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Unset dirty status for tenant:68c66ae0cd45476b87e2e79625b80f69 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:21.121131 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1920151a-64f2-409a-8688-315f9a643b2c req-404d2663-50e2-427c-8731-ec4bede19779 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.84 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 944 time: 0.3396077 May 12 15:16:21.123409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c0f50665-5b0d-4723-ad87-6d08af238805, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c0f50665-5b0d-4723-ad87-6d08af238805,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:21.147208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2df8980d-162b-4b88-b922-87a82b2c0f95 None None] Port 68f43459-2da5-4601-a6c1-9d5d57573727 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:16:21.152280 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:21.153285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:16:21.229224 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b35ebd98-cef6-4408-89c1-4c0186cfb834 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:21.229443 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:21.293735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35285c68-3a38-4527-bfed-82ea3e4770e6 req-60bfdc62-576e-498f-a0b3-09e2fe60ec07 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1931190 May 12 15:16:21.298852 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eb644f63-7f03-4b13-bbc2-3de96992ce24 req-f87c8045-7d62-4a99-ad09-2bad052d5066 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2253034 May 12 15:16:21.313187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-5ee3a4c5-c294-458f-93f0-2ebeb66c58cf req-1fcee333-d0f4-4489-893c-03fab800b6bb tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Calling delete_port for 3a378176-9994-44d1-b14f-a0257262a251 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:16:21.426132 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c0f50665-5b0d-4723-ad87-6d08af238805,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:21.427233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-1920151a-64f2-409a-8688-315f9a643b2c req-2fd7aada-7fec-4fb5-9fdf-94a3ed1bf534 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Deleting port 2483265a-0012-4339-be86-677490680e84 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:16:21.427791 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1920151a-64f2-409a-8688-315f9a643b2c req-2fd7aada-7fec-4fb5-9fdf-94a3ed1bf534 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:21.477237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb87e0b3-0ecb-434e-8775-fbc56513c7c2 req-6e94a80b-9049-4f6b-a33e-54ba4181b533 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:21.479475 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eb87e0b3-0ecb-434e-8775-fbc56513c7c2 req-6e94a80b-9049-4f6b-a33e-54ba4181b533 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.76 "GET /v2.0/ports?device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 945 time: 0.1737444 May 12 15:16:21.560100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=0a9596a5-4318-4dc7-ace0-c18b1ee4f359,segment=NetworkSegment(4d6939e6-0762-4f32-ab66-c216826b2cf3),segment_id=4d6939e6-0762-4f32-ab66-c216826b2cf3)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:21.583800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '0a9596a5-4318-4dc7-ace0-c18b1ee4f359', 'network_id': '1d7499f3-5bbd-4f94-822c-977c4f67540a', 'port_id': '0a9596a5-4318-4dc7-ace0-c18b1ee4f359', 'mac_address': 'fa:16:3e:99:92:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 574, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '445d4ea4-9d5e-46f7-a0d1-71a9c4f87159', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:16:21.588186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194'}], 'enable_snat': True}, 'gw_port_id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:16:16Z', 'revision_number': 3, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port': {'id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:79:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1085, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:15Z', 'updated_at': '2022-05-12T15:16:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:21.625765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8bf8f7d-8423-48d6-93dc-33804affa377 None None] The sync data for ids ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'] in n-d-841483-1 is: [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194'}], 'enable_snat': True}, 'gw_port_id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:16:16Z', 'revision_number': 3, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port': {'id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:79:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1085, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:15Z', 'updated_at': '2022-05-12T15:16:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:16:21.662758 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:21.687984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:21.700885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-eb87e0b3-0ecb-434e-8775-fbc56513c7c2 req-61abebd0-438b-466d-ba76-cee709dc0d68 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Deleting port 49d6769a-b216-47e8-aaa9-58847c3c8ca7 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:16:21.701965 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-eb87e0b3-0ecb-434e-8775-fbc56513c7c2 req-61abebd0-438b-466d-ba76-cee709dc0d68 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:21.711425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=0a9596a5-4318-4dc7-ace0-c18b1ee4f359,segment=NetworkSegment(4d6939e6-0762-4f32-ab66-c216826b2cf3),segment_id=4d6939e6-0762-4f32-ab66-c216826b2cf3)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:21.718816 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:21.813705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=0a9596a5-4318-4dc7-ace0-c18b1ee4f359,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:21.836189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-547a3691-7183-4fe0-a12b-924e47763a97 req-6a290117-f9af-4e85-823f-d9ba45ef7c15 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:21.838267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-547a3691-7183-4fe0-a12b-924e47763a97 req-6a290117-f9af-4e85-823f-d9ba45ef7c15 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 944 time: 0.2992682 May 12 15:16:21.859092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15f36d40-1794-41de-bbaf-c459450fc904 req-612b0b9e-e17e-47f9-826e-3e3072e571c0 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:21.860598 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15f36d40-1794-41de-bbaf-c459450fc904 req-612b0b9e-e17e-47f9-826e-3e3072e571c0 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 943 time: 0.2812116 May 12 15:16:21.864305 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5ee3a4c5-c294-458f-93f0-2ebeb66c58cf req-1fcee333-d0f4-4489-893c-03fab800b6bb tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:21.955416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fcee333-d0f4-4489-893c-03fab800b6bb tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Pushing event deleted for resources: {'Port': ['ID=3a378176-9994-44d1-b14f-a0257262a251,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:21.975770 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c0f50665-5b0d-4723-ad87-6d08af238805'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:22.031608 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['0a9596a5-4318-4dc7-ace0-c18b1ee4f359'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:22.051683 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-547a3691-7183-4fe0-a12b-924e47763a97 req-d271eb65-3b64-4ed3-ae79-e5b3a01c8543 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2042785 May 12 15:16:22.091444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-5ee3a4c5-c294-458f-93f0-2ebeb66c58cf req-1fcee333-d0f4-4489-893c-03fab800b6bb tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] No DVR routers for this DVR port 3a378176-9994-44d1-b14f-a0257262a251 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:16:22.094994 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5ee3a4c5-c294-458f-93f0-2ebeb66c58cf req-1fcee333-d0f4-4489-893c-03fab800b6bb tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:22.106433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f829e7c1-6bd8-46ec-96c7-1df321ce49f0', 'name': 'network-vif-deleted', 'tag': '3a378176-9994-44d1-b14f-a0257262a251'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:22.122700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-eb87e0b3-0ecb-434e-8775-fbc56513c7c2 req-61abebd0-438b-466d-ba76-cee709dc0d68 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] For port 49d6769a-b216-47e8-aaa9-58847c3c8ca7, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=49d6769a-b216-47e8-aaa9-58847c3c8ca7,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:22.123081 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-eb87e0b3-0ecb-434e-8775-fbc56513c7c2 req-61abebd0-438b-466d-ba76-cee709dc0d68 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:22.146264 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:22.168964 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:22.328778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-eb87e0b3-0ecb-434e-8775-fbc56513c7c2 req-61abebd0-438b-466d-ba76-cee709dc0d68 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Calling delete_port for 49d6769a-b216-47e8-aaa9-58847c3c8ca7 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:16:22.445843 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15f36d40-1794-41de-bbaf-c459450fc904 req-b63e7748-66d7-4837-815f-73e783f86cf0 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/security-groups?id=b520f0c2-32b3-4656-bbec-ee430aa330d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5679240 May 12 15:16:22.449426 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:22.460960 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5ee3a4c5-c294-458f-93f0-2ebeb66c58cf req-1fcee333-d0f4-4489-893c-03fab800b6bb tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.84 "DELETE /v2.0/ports/3a378176-9994-44d1-b14f-a0257262a251 HTTP/1.1" status: 204 len: 173 time: 2.5050893 May 12 15:16:22.473882 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8fdbd478-6c14-4227-92d2-f43da287a162 req-e93982fd-5af8-4025-8c1d-a3f09a4ede6c tempest-ServerDiskConfigTestJSON-42557680 tempest-ServerDiskConfigTestJSON-42557680-project] 10.222.0.82 "GET /v2.0/ports?device_id=f829e7c1-6bd8-46ec-96c7-1df321ce49f0 HTTP/1.1" status: 200 len: 210 time: 0.1113975 May 12 15:16:22.528050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Pushing event updated for resources: {'Port': ['ID=68f43459-2da5-4601-a6c1-9d5d57573727,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:22.533374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-1920151a-64f2-409a-8688-315f9a643b2c req-2fd7aada-7fec-4fb5-9fdf-94a3ed1bf534 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] For port 2483265a-0012-4339-be86-677490680e84, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2483265a-0012-4339-be86-677490680e84,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:22.533646 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1920151a-64f2-409a-8688-315f9a643b2c req-2fd7aada-7fec-4fb5-9fdf-94a3ed1bf534 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:22.675669 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f23fc061-5b25-46c2-8cc0-f809c44d0620'] response: {'server_uuid': 'f829e7c1-6bd8-46ec-96c7-1df321ce49f0', 'name': 'network-vif-deleted', 'tag': '3a378176-9994-44d1-b14f-a0257262a251', 'status': 'completed', 'code': 200} May 12 15:16:22.682708 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-eb87e0b3-0ecb-434e-8775-fbc56513c7c2 req-61abebd0-438b-466d-ba76-cee709dc0d68 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:22.740488 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:22.822729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61abebd0-438b-466d-ba76-cee709dc0d68 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event deleted for resources: {'Port': ['ID=49d6769a-b216-47e8-aaa9-58847c3c8ca7,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:22.847543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3a378176-9994-44d1-b14f-a0257262a251 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:16:22.901828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['49d6769a-b216-47e8-aaa9-58847c3c8ca7'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:22.922960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-1920151a-64f2-409a-8688-315f9a643b2c req-2fd7aada-7fec-4fb5-9fdf-94a3ed1bf534 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Calling delete_port for 2483265a-0012-4339-be86-677490680e84 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:16:22.954173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e2ce627a-e325-4d84-8e5d-f1e1fd58d98d up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:23.007910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 3a378176-9994-44d1-b14f-a0257262a251 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:16:23.009282 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3a378176-9994-44d1-b14f-a0257262a251 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:16:23.010014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2483265a-0012-4339-be86-677490680e84 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:16:23.019728 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4cac9087-6a29-43fa-9f31-baa6bd9168c1 req-7486946c-4068-4504-88c1-a09b4cf6d56d tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=3ab740bd-7f74-4e50-be5b-e03680401acd HTTP/1.1" status: 200 len: 210 time: 0.0970078 May 12 15:16:23.033701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-eb87e0b3-0ecb-434e-8775-fbc56513c7c2 req-61abebd0-438b-466d-ba76-cee709dc0d68 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] No DVR routers for this DVR port 49d6769a-b216-47e8-aaa9-58847c3c8ca7 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:16:23.036871 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-eb87e0b3-0ecb-434e-8775-fbc56513c7c2 req-61abebd0-438b-466d-ba76-cee709dc0d68 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:23.040040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ab740bd-7f74-4e50-be5b-e03680401acd', 'name': 'network-vif-deleted', 'tag': '49d6769a-b216-47e8-aaa9-58847c3c8ca7'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:23.060199 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Network 944a3072-30fa-47bc-9620-9dfd43f531e1 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:16:23.062058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:16:23.067836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eb87e0b3-0ecb-434e-8775-fbc56513c7c2 req-61abebd0-438b-466d-ba76-cee709dc0d68 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.76 "DELETE /v2.0/ports/49d6769a-b216-47e8-aaa9-58847c3c8ca7 HTTP/1.1" status: 204 len: 173 time: 1.5824416 May 12 15:16:23.093705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e32a31-12b0-4096-9714-db462547ab73 req-4660c43a-5615-48ea-9143-a40b19147b6b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:23.101878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3e32a31-12b0-4096-9714-db462547ab73 req-4660c43a-5615-48ea-9143-a40b19147b6b tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 944 time: 0.2631049 May 12 15:16:23.166240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3e32a31-12b0-4096-9714-db462547ab73 req-dc68f7f3-8a50-4a6f-9520-f58c7d93cc1d tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636432 May 12 15:16:23.303810 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-46c578a9-df48-495b-b156-0751cdd55ff7'] response: {'server_uuid': '3ab740bd-7f74-4e50-be5b-e03680401acd', 'name': 'network-vif-deleted', 'tag': '49d6769a-b216-47e8-aaa9-58847c3c8ca7', 'status': 'completed', 'code': 200} May 12 15:16:23.396044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd1cecb-a2dc-4b34-a3a3-17625e6aeae9 req-8f75adb8-6beb-4c10-a60a-46bddfce9a00 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:23.410752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd1cecb-a2dc-4b34-a3a3-17625e6aeae9 req-8f75adb8-6beb-4c10-a60a-46bddfce9a00 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:23.425955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd1cecb-a2dc-4b34-a3a3-17625e6aeae9 req-8f75adb8-6beb-4c10-a60a-46bddfce9a00 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:23.433888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd1cecb-a2dc-4b34-a3a3-17625e6aeae9 req-8f75adb8-6beb-4c10-a60a-46bddfce9a00 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:23.440318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd1cecb-a2dc-4b34-a3a3-17625e6aeae9 req-8f75adb8-6beb-4c10-a60a-46bddfce9a00 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:23.446931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd1cecb-a2dc-4b34-a3a3-17625e6aeae9 req-8f75adb8-6beb-4c10-a60a-46bddfce9a00 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:23.459519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd1cecb-a2dc-4b34-a3a3-17625e6aeae9 req-8f75adb8-6beb-4c10-a60a-46bddfce9a00 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:23.461760 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cd1cecb-a2dc-4b34-a3a3-17625e6aeae9 req-8f75adb8-6beb-4c10-a60a-46bddfce9a00 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5419 time: 0.2241173 May 12 15:16:23.511517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:16:23.571122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port e2ce627a-e325-4d84-8e5d-f1e1fd58d98d completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:23.586969 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cd1cecb-a2dc-4b34-a3a3-17625e6aeae9 req-b143562b-6b4d-4161-b52d-706dd5dae044 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0761783 May 12 15:16:23.588399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port e2ce627a-e325-4d84-8e5d-f1e1fd58d98d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:23.588569 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:23.619054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54e5cd2a-2756-4358-acbe-859df29dd80d req-2d329ccd-27b5-485b-9d69-b057ad761893 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:23.631080 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-54e5cd2a-2756-4358-acbe-859df29dd80d req-2d329ccd-27b5-485b-9d69-b057ad761893 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 944 time: 0.1636288 May 12 15:16:23.685456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f33c54a0-44ad-4263-99e2-55c02d35d3cb None None] Provisioning complete for port 68f43459-2da5-4601-a6c1-9d5d57573727 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:23.685833 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f33c54a0-44ad-4263-99e2-55c02d35d3cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:23.690887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-54e5cd2a-2756-4358-acbe-859df29dd80d req-64c17b41-da8c-4f7e-a2f2-46d1b0846fa1 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624397 May 12 15:16:23.744961 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1920151a-64f2-409a-8688-315f9a643b2c req-2fd7aada-7fec-4fb5-9fdf-94a3ed1bf534 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:23.845023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd7aada-7fec-4fb5-9fdf-94a3ed1bf534 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Pushing event deleted for resources: {'Port': ['ID=2483265a-0012-4339-be86-677490680e84,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:23.875607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f33c54a0-44ad-4263-99e2-55c02d35d3cb None None] Port 68f43459-2da5-4601-a6c1-9d5d57573727 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:16:23.887284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c89ed514-64cd-4011-b01a-855ecf2c3a8e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:23.927690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:23.976263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-1920151a-64f2-409a-8688-315f9a643b2c req-2fd7aada-7fec-4fb5-9fdf-94a3ed1bf534 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] No DVR routers for this DVR port 2483265a-0012-4339-be86-677490680e84 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:16:23.979087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74068d8d-df27-4583-a67d-903131c01852 req-9cbc458f-e2df-4cc3-9ac5-77be5ea04499 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:23.980247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:16:23.987343 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74068d8d-df27-4583-a67d-903131c01852 req-9cbc458f-e2df-4cc3-9ac5-77be5ea04499 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 944 time: 0.1950092 May 12 15:16:23.990644 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Sync routers for ids ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:16:24.005727 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1920151a-64f2-409a-8688-315f9a643b2c req-2fd7aada-7fec-4fb5-9fdf-94a3ed1bf534 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:24.016981 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Routers {'1131f7ae-7566-4efd-ac8e-02ea4717a2aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:16:24.017990 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:16:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:24.060850 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1920151a-64f2-409a-8688-315f9a643b2c req-2fd7aada-7fec-4fb5-9fdf-94a3ed1bf534 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.84 "DELETE /v2.0/ports/2483265a-0012-4339-be86-677490680e84 HTTP/1.1" status: 204 len: 173 time: 2.8774273 May 12 15:16:24.063657 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-629dcf4c-6131-45a4-95a1-ab3af079229d admin admin] 10.222.0.82 "PUT /v2.0/routers/1131f7ae-7566-4efd-ac8e-02ea4717a2aa/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.8575966 May 12 15:16:24.078218 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74068d8d-df27-4583-a67d-903131c01852 req-45f81240-42e9-4991-a1d2-f6a757595f88 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/security-groups?id=b520f0c2-32b3-4656-bbec-ee430aa330d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0898809 May 12 15:16:24.172759 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:24.211154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:24.229494 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port e2ce627a-e325-4d84-8e5d-f1e1fd58d98d, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e2ce627a-e325-4d84-8e5d-f1e1fd58d98d,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:24.236206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:24.236684 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:24.361302 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:24.376348 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Set router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:16:24.442601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55528) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:24.516857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-2cfc72f7-b920-432f-91a4-3cbebb4e4fd6 admin admin] Deleting subnet b6cc6b5a-d56a-4336-afb7-99232d9672dc {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:16:24.521713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2cfc72f7-b920-432f-91a4-3cbebb4e4fd6 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:24.560245 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8f20ea91-2f42-48af-b081-9b2258d96f63 req-7c64f0a0-6bc1-4f72-b711-d5566bd36c92 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=7396daa3-460c-4d29-88ac-fe6ba33a7244 HTTP/1.1" status: 200 len: 210 time: 0.1223638 May 12 15:16:24.612038 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2cfc72f7-b920-432f-91a4-3cbebb4e4fd6 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:24.637309 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=e2ce627a-e325-4d84-8e5d-f1e1fd58d98d,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:24.702257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7396daa3-460c-4d29-88ac-fe6ba33a7244', 'name': 'network-vif-deleted', 'tag': '2483265a-0012-4339-be86-677490680e84'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:24.733343 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2cfc72f7-b920-432f-91a4-3cbebb4e4fd6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:24.744253 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:24.806300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55552) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:24.812531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 097f632d-3127-4539-ba4a-3e2739125cf8 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:16:24.823429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Request body: {'security_group': {'name': 'tempest-securitygroup--495028888', 'description': 'tempest-description--470369870'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:24.831661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:24.836466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Usage tracker for resource:security_group and tenant:60b7c456959149269dc444554ba6a6c2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:24.839844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:24.845326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e8edf139-ac47-4665-b440-955365fe722e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0a9596a5-4318-4dc7-ace0-c18b1ee4f359'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:24.854866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:24.870184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=0a9596a5-4318-4dc7-ace0-c18b1ee4f359,segment=NetworkSegment(4d6939e6-0762-4f32-ab66-c216826b2cf3),segment_id=4d6939e6-0762-4f32-ab66-c216826b2cf3)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:24.886173 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:24.919889 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:24.920683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c0f50665-5b0d-4723-ad87-6d08af238805 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:24.949897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:24.953039 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194'}], 'enable_snat': True}, 'gw_port_id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:16:20Z', 'revision_number': 4, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port': {'id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:79:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1085, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:15Z', 'updated_at': '2022-05-12T15:16:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '68f43459-2da5-4601-a6c1-9d5d57573727', 'name': '', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'mac_address': 'fa:16:3e:90:e0:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 1086, 'fixed_ips': [{'subnet_id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:19Z', 'updated_at': '2022-05-12T15:16:21Z', 'revision_number': 2, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'subnets': [{'id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:24.958957 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Checking router: 1131f7ae-7566-4efd-ac8e-02ea4717a2aa for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:16:24.959644 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Updating router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa port 68f43459-2da5-4601-a6c1-9d5d57573727 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:16:24.968116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Usage tracker for resource:security_group_rule and tenant:60b7c456959149269dc444554ba6a6c2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:24.970989 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2cfc72f7-b920-432f-91a4-3cbebb4e4fd6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:24.974721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:24.993515 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:25.030896 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:25.105924 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:25.139440 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:25.155180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cfc72f7-b920-432f-91a4-3cbebb4e4fd6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b6cc6b5a-d56a-4336-afb7-99232d9672dc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:25.163393 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2cfc72f7-b920-432f-91a4-3cbebb4e4fd6 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:25.203072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-8534cc8e-2859-4a6e-ada8-9231eb32172d tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:25.205458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Pushing event updated for resources: {'SecurityGroup': ['ID=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:25.205643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-8534cc8e-2859-4a6e-ada8-9231eb32172d tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.4491398 May 12 15:16:25.211560 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2cfc72f7-b920-432f-91a4-3cbebb4e4fd6 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/b6cc6b5a-d56a-4336-afb7-99232d9672dc HTTP/1.1" status: 204 len: 168 time: 0.7679658 May 12 15:16:25.212967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55560) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:25.216928 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:25.220917 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-48b9fec8-dbae-4426-8ce0-24eed198f814 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 0.4109893 May 12 15:16:25.250354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ccb3a6-2cd6-497d-b311-a2fec39ef689 req-a551f148-2611-4767-a175-90b6438c524f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:25.260142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55564) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:25.269470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ccb3a6-2cd6-497d-b311-a2fec39ef689 req-a551f148-2611-4767-a175-90b6438c524f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:25.283167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ad6f1add-7e14-4ea0-a02e-a380a51841a6 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Request body: {'security_group_rule': {'security_group_id': '68ef6c87-3499-4eee-a9ec-ab87d41c4f8b', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:25.285667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ccb3a6-2cd6-497d-b311-a2fec39ef689 req-a551f148-2611-4767-a175-90b6438c524f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:25.293193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 097f632d-3127-4539-ba4a-3e2739125cf8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=097f632d-3127-4539-ba4a-3e2739125cf8,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:25.316501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ccb3a6-2cd6-497d-b311-a2fec39ef689 req-a551f148-2611-4767-a175-90b6438c524f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:25.328198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=0a9596a5-4318-4dc7-ace0-c18b1ee4f359,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:25.342331 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '097f632d-3127-4539-ba4a-3e2739125cf8', 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a', 'port_id': '097f632d-3127-4539-ba4a-3e2739125cf8', 'mac_address': 'fa:16:3e:86:ab:b3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 599, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6457d378-be74-408c-98d5-b411738c6998', 'ip_address': '10.2.2.100'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:16:25.351218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port c0f50665-5b0d-4723-ad87-6d08af238805 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:25.362074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ccb3a6-2cd6-497d-b311-a2fec39ef689 req-a551f148-2611-4767-a175-90b6438c524f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:25.381286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ccb3a6-2cd6-497d-b311-a2fec39ef689 req-a551f148-2611-4767-a175-90b6438c524f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:25.393128 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port c0f50665-5b0d-4723-ad87-6d08af238805 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:25.393521 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:25.399524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ccb3a6-2cd6-497d-b311-a2fec39ef689 req-a551f148-2611-4767-a175-90b6438c524f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:25.407641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-90ccb3a6-2cd6-497d-b311-a2fec39ef689 req-a551f148-2611-4767-a175-90b6438c524f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5419 time: 0.4044459 May 12 15:16:25.456075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-c900622f-63de-4d58-ad3a-d4b0d60d3110 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/quotas/593ec496e5db4078be8dc940596be321 HTTP/1.1" status: 200 len: 375 time: 0.2384880 May 12 15:16:25.491673 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:25.519510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 097f632d-3127-4539-ba4a-3e2739125cf8 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:25.577347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 097f632d-3127-4539-ba4a-3e2739125cf8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=097f632d-3127-4539-ba4a-3e2739125cf8,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:25.592380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ad6f1add-7e14-4ea0-a02e-a380a51841a6 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:25.595366 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:25.597779 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device b8aacb03-fed3-4aed-b3cf-8c58c91ef18e details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:16:25.605993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ad6f1add-7e14-4ea0-a02e-a380a51841a6 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Usage tracker for resource:security_group_rule and tenant:60b7c456959149269dc444554ba6a6c2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:25.615182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-90ccb3a6-2cd6-497d-b311-a2fec39ef689 req-80b35405-b364-45eb-8546-21dff48b4289 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1889365 May 12 15:16:25.624637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ad6f1add-7e14-4ea0-a02e-a380a51841a6 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:25.635409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ad6f1add-7e14-4ea0-a02e-a380a51841a6 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:25.690300 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cfac61b-39e7-471d-a169-4b5194eab1b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:25.704105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-cf162080-4a53-4e88-b56e-180e23396e8e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Synchronizing usage tracker for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:25.711149 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:25.713780 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:25.719171 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad6f1add-7e14-4ea0-a02e-a380a51841a6 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:25.748000 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Transition to ACTIVE for port object 68f43459-2da5-4601-a6c1-9d5d57573727 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:16:25.748232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-cf162080-4a53-4e88-b56e-180e23396e8e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Unset dirty status for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:25.749417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-cf162080-4a53-4e88-b56e-180e23396e8e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2879279 May 12 15:16:25.756686 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:25.813353 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c0f50665-5b0d-4723-ad87-6d08af238805, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c0f50665-5b0d-4723-ad87-6d08af238805,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:25.814440 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=097f632d-3127-4539-ba4a-3e2739125cf8,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:25.819368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:25.837873 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:25.854624 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-59d9e0f7-135d-415d-9c30-f994cfd83fdb'] response: {'server_uuid': '7396daa3-460c-4d29-88ac-fe6ba33a7244', 'name': 'network-vif-deleted', 'tag': '2483265a-0012-4339-be86-677490680e84', 'status': 'completed', 'code': 200} May 12 15:16:25.945462 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c0f50665-5b0d-4723-ad87-6d08af238805,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:25.951030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 49d6769a-b216-47e8-aaa9-58847c3c8ca7 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:16:26.015518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'b8aacb03-fed3-4aed-b3cf-8c58c91ef18e', 'network_id': 'c5f75c23-a033-42fa-b7cd-dcbda413fa9a', 'port_id': 'b8aacb03-fed3-4aed-b3cf-8c58c91ef18e', 'mac_address': 'fa:16:3e:96:13:d8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 599, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6457d378-be74-408c-98d5-b411738c6998', 'ip_address': '10.2.2.200'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:16:26.044176 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 49d6769a-b216-47e8-aaa9-58847c3c8ca7 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:16:26.044870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 49d6769a-b216-47e8-aaa9-58847c3c8ca7 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:16:26.063177 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cfac61b-39e7-471d-a169-4b5194eab1b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.125810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-7cfac61b-39e7-471d-a169-4b5194eab1b9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['079240cc-25ba-4ba4-a3b0-412d897b19bb']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:26.149064 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad6f1add-7e14-4ea0-a02e-a380a51841a6 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.156809 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.159759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-7cfac61b-39e7-471d-a169-4b5194eab1b9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '68221a3b-1121-4349-a5a1-801f502e908b') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:26.161943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-7cfac61b-39e7-471d-a169-4b5194eab1b9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '68221a3b-1121-4349-a5a1-801f502e908b') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:26.169349 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a2b35a9-3a68-41e4-93da-cd8839862cb6 None None] Pushing event updated for resources: {'Port': ['ID=68f43459-2da5-4601-a6c1-9d5d57573727,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:26.185694 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad6f1add-7e14-4ea0-a02e-a380a51841a6 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.187100 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a2b35a9-3a68-41e4-93da-cd8839862cb6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:26.187439 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a2b35a9-3a68-41e4-93da-cd8839862cb6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:26.187767 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a2b35a9-3a68-41e4-93da-cd8839862cb6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:26.188125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b8aacb03-fed3-4aed-b3cf-8c58c91ef18e {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:26.188238 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a2b35a9-3a68-41e4-93da-cd8839862cb6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:26.188450 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a2b35a9-3a68-41e4-93da-cd8839862cb6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:26.190441 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a2b35a9-3a68-41e4-93da-cd8839862cb6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:26.190758 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a2b35a9-3a68-41e4-93da-cd8839862cb6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:26.191087 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a2b35a9-3a68-41e4-93da-cd8839862cb6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:26.191452 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a2b35a9-3a68-41e4-93da-cd8839862cb6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:26.192504 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a2b35a9-3a68-41e4-93da-cd8839862cb6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:26.192876 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a2b35a9-3a68-41e4-93da-cd8839862cb6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:26.193539 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a2b35a9-3a68-41e4-93da-cd8839862cb6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:26.212048 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cfac61b-39e7-471d-a169-4b5194eab1b9 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.217427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:26.221520 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Attempting to bind port 68f43459-2da5-4601-a6c1-9d5d57573727 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:16:26.222660 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Attempting to bind port 68f43459-2da5-4601-a6c1-9d5d57573727 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '51a763ab-4327-4303-92e7-963b2e4c87d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:16:26.223029 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Attempting to bind port 68f43459-2da5-4601-a6c1-9d5d57573727 on network 944a3072-30fa-47bc-9620-9dfd43f531e1 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:26.223861 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.224953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 85b4d43d-f235-4852-bda9-2dc870bb3d11 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:16:26.237344 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 16, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:16:26.237761 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Checking segment: {'id': '51a763ab-4327-4303-92e7-963b2e4c87d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:16:26.238191 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.238574 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Bound using segment: {'id': '51a763ab-4327-4303-92e7-963b2e4c87d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:16:26.239079 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Bound port: 68f43459-2da5-4601-a6c1-9d5d57573727, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '51a763ab-4327-4303-92e7-963b2e4c87d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:16:26.239402 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.266806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-4786efc9-dc2a-4c94-88c9-53664fac2cd5 service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5092468 May 12 15:16:26.290084 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cfac61b-39e7-471d-a169-4b5194eab1b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.293007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad6f1add-7e14-4ea0-a02e-a380a51841a6 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dad8398e-7c4c-47a0-aee8-023d2919acfb,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:26.322601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7cfac61b-39e7-471d-a169-4b5194eab1b9 admin admin] Releasing vlan 573 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:16:26.323028 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cfac61b-39e7-471d-a169-4b5194eab1b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: timer() May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:16:26.346764 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:16:26.376882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e3a7e42-c167-4ea7-b71a-7862dcaf2b05 req-ea27ff1e-aeb9-4934-9e27-126f34eea003 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:26.383204 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e3a7e42-c167-4ea7-b71a-7862dcaf2b05 req-ea27ff1e-aeb9-4934-9e27-126f34eea003 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.3397508 May 12 15:16:26.403993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad6f1add-7e14-4ea0-a02e-a380a51841a6 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.405570 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ad6f1add-7e14-4ea0-a02e-a380a51841a6 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.1419611 May 12 15:16:26.411379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55570) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:26.413071 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] For port 68f43459-2da5-4601-a6c1-9d5d57573727, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:16:26.417987 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] For port 68f43459-2da5-4601-a6c1-9d5d57573727, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=68f43459-2da5-4601-a6c1-9d5d57573727,segment=NetworkSegment(51a763ab-4327-4303-92e7-963b2e4c87d0),segment_id=51a763ab-4327-4303-92e7-963b2e4c87d0)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:16:26.426939 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.429125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-61e1b076-d3d6-489b-9b45-fd1825737a47 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Request body: {'security_group_rule': {'security_group_id': '68ef6c87-3499-4eee-a9ec-ab87d41c4f8b', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:26.436333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-61e1b076-d3d6-489b-9b45-fd1825737a47 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:26.440530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-61e1b076-d3d6-489b-9b45-fd1825737a47 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Usage tracker for resource:security_group_rule and tenant:60b7c456959149269dc444554ba6a6c2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:26.443837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-61e1b076-d3d6-489b-9b45-fd1825737a47 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:26.450529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-61e1b076-d3d6-489b-9b45-fd1825737a47 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:26.476962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:26.481189 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-61e1b076-d3d6-489b-9b45-fd1825737a47 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.501682 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cfac61b-39e7-471d-a169-4b5194eab1b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.535695 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Routers {'1131f7ae-7566-4efd-ac8e-02ea4717a2aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:16:26.537073 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cfac61b-39e7-471d-a169-4b5194eab1b9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.539653 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:16:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:26.555299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cfac61b-39e7-471d-a169-4b5194eab1b9 admin admin] Pushing event deleted for resources: {'Network': ['ID=079240cc-25ba-4ba4-a3b0-412d897b19bb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:26.582911 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e3a7e42-c167-4ea7-b71a-7862dcaf2b05 req-f7d41893-28a4-43a6-86b6-d91c6329c15c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1272135 May 12 15:16:26.632721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 85b4d43d-f235-4852-bda9-2dc870bb3d11, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85b4d43d-f235-4852-bda9-2dc870bb3d11,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:26.645944 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7cfac61b-39e7-471d-a169-4b5194eab1b9 admin admin] 10.222.0.82 "DELETE /v2.0/networks/079240cc-25ba-4ba4-a3b0-412d897b19bb HTTP/1.1" status: 204 len: 168 time: 1.4260361 May 12 15:16:26.651944 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-61e1b076-d3d6-489b-9b45-fd1825737a47 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.660750 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-61e1b076-d3d6-489b-9b45-fd1825737a47 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.671347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '85b4d43d-f235-4852-bda9-2dc870bb3d11', 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726', 'port_id': '85b4d43d-f235-4852-bda9-2dc870bb3d11', 'mac_address': 'fa:16:3e:e0:83:1a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 594, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '722dd775-53fe-4359-9d8f-d74143e5ced9', 'ip_address': '10.1.1.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:16:26.678582 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-58562165-1459-414c-8f25-717aa053a0b1 service neutron] 10.222.0.82 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3935771 May 12 15:16:26.716459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61e1b076-d3d6-489b-9b45-fd1825737a47 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e0d6cf3d-eb89-4607-9e2a-e80b1009dea3,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:26.726225 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-61e1b076-d3d6-489b-9b45-fd1825737a47 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.727763 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-61e1b076-d3d6-489b-9b45-fd1825737a47 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3149042 May 12 15:16:26.731457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55578) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:26.737208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:26.765056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:26.783095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Usage tracker for resource:floatingip and tenant:60b7c456959149269dc444554ba6a6c2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:26.787320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:26.796135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:26.810391 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.840341 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6cfca10e-791b-4e3c-bf6a-168e3e0d8b1c'] response: {'server_uuid': 'e8edf139-ac47-4665-b440-955365fe722e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0a9596a5-4318-4dc7-ace0-c18b1ee4f359', 'code': 200} May 12 15:16:26.844345 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:26.896163 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e2ce627a-e325-4d84-8e5d-f1e1fd58d98d up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:26.976069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 85b4d43d-f235-4852-bda9-2dc870bb3d11 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:26.989833 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a2b35a9-3a68-41e4-93da-cd8839862cb6 None None] Pushing event updated for resources: {'Port': ['ID=68f43459-2da5-4601-a6c1-9d5d57573727,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:27.027204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55582) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:27.064893 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] Set router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:16:27.154312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d8d9961-3e27-4faf-9276-e723bad7c6d0 req-3c935dc3-2109-4c2c-8452-b0a09601711a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:27.155897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d8d9961-3e27-4faf-9276-e723bad7c6d0 req-3c935dc3-2109-4c2c-8452-b0a09601711a service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 1096 time: 0.3178415 May 12 15:16:27.171116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-600cbf33-4b1a-41c7-bb69-b135e3af034d req-761a91fb-de01-43ee-914e-4ce4d79cba15 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:27.172804 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-600cbf33-4b1a-41c7-bb69-b135e3af034d req-761a91fb-de01-43ee-914e-4ce4d79cba15 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 945 time: 0.2125311 May 12 15:16:27.269779 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-600cbf33-4b1a-41c7-bb69-b135e3af034d req-1434f37f-74c2-4837-aab2-af50814bb9f2 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/security-groups?id=b520f0c2-32b3-4656-bbec-ee430aa330d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798450 May 12 15:16:27.272799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d8d9961-3e27-4faf-9276-e723bad7c6d0 req-9fd2b9b6-ae8c-42f9-8e2a-6bad4ff6b3d7 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=b520f0c2-32b3-4656-bbec-ee430aa330d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0985036 May 12 15:16:27.339411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 85b4d43d-f235-4852-bda9-2dc870bb3d11, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85b4d43d-f235-4852-bda9-2dc870bb3d11,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:27.342932 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-df7b7add-1f88-45e6-8822-5cb3fb237884 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=aca50b48316f40a7a6ceb23c44dd4720&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3134544 May 12 15:16:27.345566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55592) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:27.355048 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:27.371080 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:27.374007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:16:27.587927 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:16:27.606018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:27.614457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-faa866fc-525f-4a0d-85e1-96c642d8d86f req-e536166f-a6bc-464c-9822-d9fbdf37ef01 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 210 time: 0.1298332 May 12 15:16:27.644149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c', 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726', 'port_id': 'c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c', 'mac_address': 'fa:16:3e:ed:07:03', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 594, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '722dd775-53fe-4359-9d8f-d74143e5ced9', 'ip_address': '10.1.1.80'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:16:27.724405 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:27.734033 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194'}], 'enable_snat': True}, 'gw_port_id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:16:20Z', 'revision_number': 4, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port': {'id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:79:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1085, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:15Z', 'updated_at': '2022-05-12T15:16:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '68f43459-2da5-4601-a6c1-9d5d57573727', 'name': '', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'mac_address': 'fa:16:3e:90:e0:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 1086, 'fixed_ips': [{'subnet_id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:19Z', 'updated_at': '2022-05-12T15:16:26Z', 'revision_number': 4, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'subnets': [{'id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:27.745733 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66aad76d-70f4-48fc-9d92-5def16770b67 None None] The sync data for ids ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'] in n-d-841483-1 is: [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194'}], 'enable_snat': True}, 'gw_port_id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:16:20Z', 'revision_number': 4, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port': {'id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:79:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1085, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:15Z', 'updated_at': '2022-05-12T15:16:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '68f43459-2da5-4601-a6c1-9d5d57573727', 'name': '', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'mac_address': 'fa:16:3e:90:e0:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 1086, 'fixed_ips': [{'subnet_id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:19Z', 'updated_at': '2022-05-12T15:16:26Z', 'revision_number': 4, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'subnets': [{'id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:16:27.771395 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port e2ce627a-e325-4d84-8e5d-f1e1fd58d98d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:27.771759 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:27.838448 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:27.878418 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:27.881075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f72439-147f-4b02-a1ae-6cc3297b0f18 req-5208cd81-913a-4dda-9111-3dd95f5ef26f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:27.904912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f72439-147f-4b02-a1ae-6cc3297b0f18 req-5208cd81-913a-4dda-9111-3dd95f5ef26f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:27.912941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f72439-147f-4b02-a1ae-6cc3297b0f18 req-5208cd81-913a-4dda-9111-3dd95f5ef26f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:27.921856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f72439-147f-4b02-a1ae-6cc3297b0f18 req-5208cd81-913a-4dda-9111-3dd95f5ef26f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:27.929753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f72439-147f-4b02-a1ae-6cc3297b0f18 req-5208cd81-913a-4dda-9111-3dd95f5ef26f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:27.931222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Allocated IP 172.25.8.53 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/44699307-5ea5-44b0-ad14-e5bde41eec9a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:16:27.933787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=85b4d43d-f235-4852-bda9-2dc870bb3d11,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:27.938214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f72439-147f-4b02-a1ae-6cc3297b0f18 req-5208cd81-913a-4dda-9111-3dd95f5ef26f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:27.951769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:27.972016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f72439-147f-4b02-a1ae-6cc3297b0f18 req-5208cd81-913a-4dda-9111-3dd95f5ef26f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:27.982270 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04f72439-147f-4b02-a1ae-6cc3297b0f18 req-5208cd81-913a-4dda-9111-3dd95f5ef26f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5422 time: 0.4484866 May 12 15:16:27.985229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:28.111785 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:28.113508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 026a86ba-df92-4de2-9f16-6e6b8794d1df details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:16:28.277871 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:28.294064 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04f72439-147f-4b02-a1ae-6cc3297b0f18 req-5c3b1276-86ad-4f45-94c1-9a5acb27a29f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.3107238 May 12 15:16:28.369990 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:28.380872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cdbb9dd-2210-42ae-b02b-ebe8945a434f req-3c6238b4-6a26-4740-976a-a20931ac3486 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:28.398239 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4cdbb9dd-2210-42ae-b02b-ebe8945a434f req-3c6238b4-6a26-4740-976a-a20931ac3486 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.3609195 May 12 15:16:28.424813 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 026a86ba-df92-4de2-9f16-6e6b8794d1df, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=026a86ba-df92-4de2-9f16-6e6b8794d1df,segment=NetworkSegment(7c4990b9-5a5f-484e-a357-c9a37d811129),segment_id=7c4990b9-5a5f-484e-a357-c9a37d811129)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:28.516050 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:28.572142 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4cdbb9dd-2210-42ae-b02b-ebe8945a434f req-77c1242b-093b-4b90-944e-ea23fb280e7c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1721351 May 12 15:16:28.575027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed7317fd-2525-4d5b-a839-904abfb8ef28,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:28.586371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:16:28.594076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:16:28.598793 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:16:28.617632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:28.618786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:28.621785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:28.622172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:28.624848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:28.624848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:28.628514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:28.629824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:28.629950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:28.630230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:28.631070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:28.632381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:16:28.641234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '026a86ba-df92-4de2-9f16-6e6b8794d1df', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'port_id': '026a86ba-df92-4de2-9f16-6e6b8794d1df', 'mac_address': 'fa:16:3e:3a:da:b1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 550, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:16:28.646437 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:28.652255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:28.656617 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-43fe1e98-fdcc-4fac-a691-c706d669466b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ed7317fd-2525-4d5b-a839-904abfb8ef28 HTTP/1.1" status: 204 len: 168 time: 1.3097670 May 12 15:16:28.848434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Pushing event updated for resources: {'Port': ['ID=44699307-5ea5-44b0-ad14-e5bde41eec9a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:28.860147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c404b13c-0df0-43be-82ae-456d361c1059', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0f50665-5b0d-4723-ad87-6d08af238805'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:28.875193 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:28.886812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73315363-cb49-4220-9552-5675a06f12b0 req-c3be1882-800e-43d0-a4d1-e66bc54047e9 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:28.892892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73315363-cb49-4220-9552-5675a06f12b0 req-c3be1882-800e-43d0-a4d1-e66bc54047e9 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 945 time: 0.2158899 May 12 15:16:28.937851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 68f43459-2da5-4601-a6c1-9d5d57573727 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:28.969793 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:29.078390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 026a86ba-df92-4de2-9f16-6e6b8794d1df {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:29.097257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 026a86ba-df92-4de2-9f16-6e6b8794d1df, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=026a86ba-df92-4de2-9f16-6e6b8794d1df,segment=NetworkSegment(7c4990b9-5a5f-484e-a357-c9a37d811129),segment_id=7c4990b9-5a5f-484e-a357-c9a37d811129)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:29.110452 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:29.113018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device ef28df6f-7573-4910-9fae-c2b49092303b details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:16:29.123332 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73315363-cb49-4220-9552-5675a06f12b0 req-b0910eb8-5254-46a0-8933-75fa3033528e tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/security-groups?id=b520f0c2-32b3-4656-bbec-ee430aa330d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2278490 May 12 15:16:29.133013 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:29.144787 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-79edb052-5cd6-447a-acb3-e74d4935862d req-25e677d3-dd8c-462b-9ae6-62d6b4ea6cf6 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 210 time: 0.1443889 May 12 15:16:29.187635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port ef28df6f-7573-4910-9fae-c2b49092303b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=ef28df6f-7573-4910-9fae-c2b49092303b,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:29.330570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'ef28df6f-7573-4910-9fae-c2b49092303b', 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726', 'port_id': 'ef28df6f-7573-4910-9fae-c2b49092303b', 'mac_address': 'fa:16:3e:85:a9:bb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 594, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '722dd775-53fe-4359-9d8f-d74143e5ced9', 'ip_address': '10.1.1.199'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:16:29.351471 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6fba7626-f0e0-466e-8f1a-77e1b82ca7ad'] response: {'server_uuid': 'c404b13c-0df0-43be-82ae-456d361c1059', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0f50665-5b0d-4723-ad87-6d08af238805', 'code': 200} May 12 15:16:29.352780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 68f43459-2da5-4601-a6c1-9d5d57573727 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:29.575938 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:29.631214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 68f43459-2da5-4601-a6c1-9d5d57573727 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:29.631600 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:29.783815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ef28df6f-7573-4910-9fae-c2b49092303b {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:29.831046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port ef28df6f-7573-4910-9fae-c2b49092303b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=ef28df6f-7573-4910-9fae-c2b49092303b,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:29.878228 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:29.881010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:16:29.886993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-25668195-cb34-40b9-bd0a-34336a7ae1e3 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:29.895297 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-25668195-cb34-40b9-bd0a-34336a7ae1e3 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 806 time: 0.6238015 May 12 15:16:29.929006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Request body: {'port': {'device_id': '013bfc4f-b074-4b38-a7be-ae5aa7b41b5f', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'admin_state_up': True, 'tenant_id': '593ec496e5db4078be8dc940596be321'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:29.958995 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=026a86ba-df92-4de2-9f16-6e6b8794d1df,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:30.085916 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:16:30.131545 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:30.181363 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] It took 0.27 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:16:30.197334 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad', 'network_id': 'e6a7ff8f-d7ef-4614-8958-ef6026371726', 'port_id': '4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad', 'mac_address': 'fa:16:3e:58:1f:67', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 594, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '722dd775-53fe-4359-9d8f-d74143e5ced9', 'ip_address': '10.1.1.158'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:16:30.206035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=ef28df6f-7573-4910-9fae-c2b49092303b,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:30.232354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5d678e-95b5-47ff-997e-43a9fecbaf52 req-23dd8ab5-4f67-41e0-ab17-292a17c42307 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:30.234005 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d5d678e-95b5-47ff-997e-43a9fecbaf52 req-23dd8ab5-4f67-41e0-ab17-292a17c42307 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 1096 time: 0.6187012 May 12 15:16:30.306982 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:30.310223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6212b7b-5593-40af-9798-be3229db5bb8 req-dc28f571-252f-4b30-ab27-3158190ed638 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:30.324950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6212b7b-5593-40af-9798-be3229db5bb8 req-dc28f571-252f-4b30-ab27-3158190ed638 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:30.332440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6212b7b-5593-40af-9798-be3229db5bb8 req-dc28f571-252f-4b30-ab27-3158190ed638 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:30.346806 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6212b7b-5593-40af-9798-be3229db5bb8 req-dc28f571-252f-4b30-ab27-3158190ed638 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:30.361430 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6212b7b-5593-40af-9798-be3229db5bb8 req-dc28f571-252f-4b30-ab27-3158190ed638 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:30.380811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6212b7b-5593-40af-9798-be3229db5bb8 req-dc28f571-252f-4b30-ab27-3158190ed638 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:30.392530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6212b7b-5593-40af-9798-be3229db5bb8 req-dc28f571-252f-4b30-ab27-3158190ed638 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:30.395553 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:30.402922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6212b7b-5593-40af-9798-be3229db5bb8 req-dc28f571-252f-4b30-ab27-3158190ed638 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5424 time: 0.8682306 May 12 15:16:30.410601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55644) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:30.422054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 68f43459-2da5-4601-a6c1-9d5d57573727, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=68f43459-2da5-4601-a6c1-9d5d57573727,segment=NetworkSegment(51a763ab-4327-4303-92e7-963b2e4c87d0),segment_id=51a763ab-4327-4303-92e7-963b2e4c87d0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:30.425626 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:30.444105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:30.446248 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:30.490407 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:30.521709 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:30.534053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:30.544932 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:30.558526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=68f43459-2da5-4601-a6c1-9d5d57573727,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:30.612561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6212b7b-5593-40af-9798-be3229db5bb8 req-f108df8c-1bd8-4ebe-940d-5addb81c3e00 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2008240 May 12 15:16:30.626815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:30.639236 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d5d678e-95b5-47ff-997e-43a9fecbaf52 req-88bcef01-4d07-4ce0-9db7-33eb19eb3817 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3871508 May 12 15:16:30.683729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7886bee3-b9df-43b4-8cdc-362b8dbba671 req-42a2ecec-7fda-465b-9e9c-1eaca453c999 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:30.691116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7886bee3-b9df-43b4-8cdc-362b8dbba671 req-42a2ecec-7fda-465b-9e9c-1eaca453c999 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.8397806 May 12 15:16:30.710981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Request body: {'network': {'name': 'tempest-MultipleCreateTestJSON-1281651397-network', 'tenant_id': 'd6a33151cf37459889a9facebe6ff6fd'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:30.724390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:30.731480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Usage tracker for resource:network and tenant:d6a33151cf37459889a9facebe6ff6fd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:30.734448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:30.741628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:30.749673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 68f43459-2da5-4601-a6c1-9d5d57573727 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:30.753425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:30.776482 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7886bee3-b9df-43b4-8cdc-362b8dbba671 req-3b458607-33d7-47c3-92e3-0facc9fdf509 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0844030 May 12 15:16:30.792392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Made reservation on behalf of d6a33151cf37459889a9facebe6ff6fd for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:16:30.795252 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:30.822391 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:30.828797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Made reservation on behalf of 593ec496e5db4078be8dc940596be321 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:16:30.841125 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:30.870728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Pushing event updated for resources: {'Port': ['ID=44699307-5ea5-44b0-ad14-e5bde41eec9a,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:30.908962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 68f43459-2da5-4601-a6c1-9d5d57573727 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:30.909518 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:30.961110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:30.978378 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0d7e9039-a5fd-4ce7-9ad3-678bc4ed3ac7 req-658b69d3-74c2-4525-9940-0b2bfd839cff tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 210 time: 0.0562479 May 12 15:16:30.987846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Usage tracker for resource:security_group_rule and tenant:d6a33151cf37459889a9facebe6ff6fd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:30.995020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:31.004478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:31.073342 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:31.080316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4bb3dd-151b-4ef6-8b16-1713d9bda48c req-67b791bd-c4e8-40d7-9ce4-2eefa0bdea53 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:31.088576 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf4bb3dd-151b-4ef6-8b16-1713d9bda48c req-67b791bd-c4e8-40d7-9ce4-2eefa0bdea53 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 945 time: 0.2524288 May 12 15:16:31.154377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf4bb3dd-151b-4ef6-8b16-1713d9bda48c req-24462010-acc1-4b74-b588-f6232946ea69 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/security-groups?id=b520f0c2-32b3-4656-bbec-ee430aa330d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649006 May 12 15:16:31.201014 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:31.209974 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f8e0d19a-73ea-44c0-8994-f4be70b482e8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.4772034 May 12 15:16:31.252369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Allocated IP 172.20.0.5 (dbc2e49c-2591-4534-a48c-cea8e23115f4/84c2082e-f394-46d5-8a8f-8e3a70d54fc1/182e22d5-523d-40ba-8f4c-b88eabce6db7) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:16:31.276168 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:31.293378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:31.357361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 565} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:16:31.388252 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=814df81a-d1a0-4fdb-b4e6-962fafacfe9e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:31.397425 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:31.397872 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Added segment d15583e1-352d-4594-8d9f-2e9d574c2f64 of type vlan for network 8c326986-914c-4d15-83ee-665daa53b37e May 12 15:16:31.434633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['b8aacb03-fed3-4aed-b3cf-8c58c91ef18e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:31.448552 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:31.481798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['026a86ba-df92-4de2-9f16-6e6b8794d1df'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:31.523220 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:31.524549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:31.525789 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:31.550465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['ef28df6f-7573-4910-9fae-c2b49092303b'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:31.698960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:31.729308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:31.798112 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:31.874178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['097f632d-3127-4539-ba4a-3e2739125cf8'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:31.913837 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:32.029228 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] Pushing event updated for resources: {'Network': ['ID=8c326986-914c-4d15-83ee-665daa53b37e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:32.065721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event updated for resources: {'Port': ['ID=182e22d5-523d-40ba-8f4c-b88eabce6db7,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:32.075939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 8c326986-914c-4d15-83ee-665daa53b37e details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:16:32.083916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Network dbc2e49c-2591-4534-a48c-cea8e23115f4 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:16:32.085311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:16:32.087933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:16:32.169605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:32.170373 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:32.185140 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5a609a12-2c99-4975-bac5-f5d7fbd9be3d admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 1.7678595 May 12 15:16:32.185803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55702) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:32.197255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Request body: {'subnet': {'network_id': '8c326986-914c-4d15-83ee-665daa53b37e', 'cidr': '172.20.0.0/28', 'name': 'tempest-MultipleCreateTestJSON-1281651397-subnet', 'tenant_id': 'd6a33151cf37459889a9facebe6ff6fd', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:32.206618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:32.214212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Usage tracker for resource:subnet and tenant:d6a33151cf37459889a9facebe6ff6fd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:32.218834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:32.232312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:32.251368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Made reservation on behalf of d6a33151cf37459889a9facebe6ff6fd for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:16:32.254278 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:32.312091 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6ef88c61-6fc5-4a40-b279-03bd9ba71941 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.3984504 May 12 15:16:32.325690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868f8325-aee9-4a43-8b9d-37fbbefb2563 req-83d663e1-0523-457e-bb23-ae27ab1599bb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:32.336893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868f8325-aee9-4a43-8b9d-37fbbefb2563 req-83d663e1-0523-457e-bb23-ae27ab1599bb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:32.350923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868f8325-aee9-4a43-8b9d-37fbbefb2563 req-83d663e1-0523-457e-bb23-ae27ab1599bb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:32.366735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868f8325-aee9-4a43-8b9d-37fbbefb2563 req-83d663e1-0523-457e-bb23-ae27ab1599bb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:32.378375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868f8325-aee9-4a43-8b9d-37fbbefb2563 req-83d663e1-0523-457e-bb23-ae27ab1599bb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:32.394418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868f8325-aee9-4a43-8b9d-37fbbefb2563 req-83d663e1-0523-457e-bb23-ae27ab1599bb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:32.410544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868f8325-aee9-4a43-8b9d-37fbbefb2563 req-83d663e1-0523-457e-bb23-ae27ab1599bb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:32.414148 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-868f8325-aee9-4a43-8b9d-37fbbefb2563 req-83d663e1-0523-457e-bb23-ae27ab1599bb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5426 time: 0.5537198 May 12 15:16:32.433801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Request body: {'port': {'device_id': '013bfc4f-b074-4b38-a7be-ae5aa7b41b5f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:32.470218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['85b4d43d-f235-4852-bda9-2dc870bb3d11'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:32.485523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa89925c-f972-47c5-b2db-e023222415ff req-c4f5e42d-0222-4713-adc2-f6e4ab9adf3e tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:32.494077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa89925c-f972-47c5-b2db-e023222415ff req-c4f5e42d-0222-4713-adc2-f6e4ab9adf3e tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.4576905 May 12 15:16:32.525638 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-868f8325-aee9-4a43-8b9d-37fbbefb2563 req-6d497e46-31d5-47e3-a433-81d1feeddf1e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0996215 May 12 15:16:32.577984 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa89925c-f972-47c5-b2db-e023222415ff req-248a08f1-1853-4476-bcd8-9043ba82e9b6 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0829580 May 12 15:16:32.612224 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:32.777245 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:32.936161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:32.979181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50d6eaf2-1e98-4097-bcd2-edc3b12618b0 req-184e724d-a9a5-408c-a5f7-3077f0fa33f0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:32.980809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50d6eaf2-1e98-4097-bcd2-edc3b12618b0 req-184e724d-a9a5-408c-a5f7-3077f0fa33f0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 931 time: 0.1515656 May 12 15:16:33.093500 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50d6eaf2-1e98-4097-bcd2-edc3b12618b0 req-1a1436e3-98ad-4202-8f68-eaf26dcb273e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1059272 May 12 15:16:33.160492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Pushing event updated for resources: {'Subnet': ['ID=bbf4de36-cca3-4e54-b76e-de177b2d73c3,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:33.196228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Checking segment: {'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:16:33.196228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Network hostable DHCP agents. Network: 8c326986-914c-4d15-83ee-665daa53b37e, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:16:33.293781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Network 8c326986-914c-4d15-83ee-665daa53b37e is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:16:33.322021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 8c326986-914c-4d15-83ee-665daa53b37e) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:16:33.330301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:33.330889 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:33.370646 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cab342f1-9068-4d0e-b0c0-0326895f53ed admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 1.1833997 May 12 15:16:33.397846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dad34298-3605-4401-96dd-55bd307e3ab5 None None] Network 8c326986-914c-4d15-83ee-665daa53b37e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:16:33.432447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f913ad49-c5ac-42d5-945d-8e2c986cbb52 req-e932909a-009f-4b42-bd02-11572225adda tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:33.443774 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f913ad49-c5ac-42d5-945d-8e2c986cbb52 req-e932909a-009f-4b42-bd02-11572225adda tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 945 time: 0.2168267 May 12 15:16:33.572845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 182e22d5-523d-40ba-8f4c-b88eabce6db7 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:33.593651 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:33.628302 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f913ad49-c5ac-42d5-945d-8e2c986cbb52 req-4f5e4281-daa7-4018-9fdd-ccec9db44aa6 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1810536 May 12 15:16:33.667447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Transition to ACTIVE for port object 182e22d5-523d-40ba-8f4c-b88eabce6db7 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:16:33.676971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:33.740795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30cf0a75-dab7-4610-a0b8-7705656f037d req-00fc8fd3-5460-4743-99ce-073cc42599de tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:33.742893 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30cf0a75-dab7-4610-a0b8-7705656f037d req-00fc8fd3-5460-4743-99ce-073cc42599de tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.76 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 945 time: 0.2097929 May 12 15:16:33.863628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3a93a6b-7680-4851-8404-494e233adb98 None None] Network 8c326986-914c-4d15-83ee-665daa53b37e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:16:33.948733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Pushing event updated for resources: {'Port': ['ID=182e22d5-523d-40ba-8f4c-b88eabce6db7,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:33.959700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-30cf0a75-dab7-4610-a0b8-7705656f037d req-24e9d7f4-127d-43bd-b6ec-0d447df5cd07 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Deleting port c89ed514-64cd-4011-b01a-855ecf2c3a8e {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:16:33.960269 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-30cf0a75-dab7-4610-a0b8-7705656f037d req-24e9d7f4-127d-43bd-b6ec-0d447df5cd07 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:34.042376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Attempting to bind port 182e22d5-523d-40ba-8f4c-b88eabce6db7 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:16:34.042811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Attempting to bind port 182e22d5-523d-40ba-8f4c-b88eabce6db7 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:16:34.043254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Attempting to bind port 182e22d5-523d-40ba-8f4c-b88eabce6db7 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:34.050470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Port 182e22d5-523d-40ba-8f4c-b88eabce6db7 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:16:34.050791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Attempting to bind port 182e22d5-523d-40ba-8f4c-b88eabce6db7 on network dbc2e49c-2591-4534-a48c-cea8e23115f4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:34.060057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 16, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:16:34.060400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Checking segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:16:34.060790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Bound using segment: {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:16:34.061225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Bound port: 182e22d5-523d-40ba-8f4c-b88eabce6db7, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:16:34.061648 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:34.289524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bee8ba9-47bf-4270-baad-810622deb1f8 req-51febcbb-9023-49f5-a202-745f49c0955d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:34.295995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bee8ba9-47bf-4270-baad-810622deb1f8 req-51febcbb-9023-49f5-a202-745f49c0955d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:34.300856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] For port 182e22d5-523d-40ba-8f4c-b88eabce6db7, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:16:34.301678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bee8ba9-47bf-4270-baad-810622deb1f8 req-51febcbb-9023-49f5-a202-745f49c0955d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:34.303880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] For port 182e22d5-523d-40ba-8f4c-b88eabce6db7, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=182e22d5-523d-40ba-8f4c-b88eabce6db7,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:16:34.307738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bee8ba9-47bf-4270-baad-810622deb1f8 req-51febcbb-9023-49f5-a202-745f49c0955d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:34.311348 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:34.313761 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bee8ba9-47bf-4270-baad-810622deb1f8 req-51febcbb-9023-49f5-a202-745f49c0955d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:34.319603 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bee8ba9-47bf-4270-baad-810622deb1f8 req-51febcbb-9023-49f5-a202-745f49c0955d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:34.326376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bee8ba9-47bf-4270-baad-810622deb1f8 req-51febcbb-9023-49f5-a202-745f49c0955d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:34.334156 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3bee8ba9-47bf-4270-baad-810622deb1f8 req-51febcbb-9023-49f5-a202-745f49c0955d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5426 time: 0.4005902 May 12 15:16:34.347553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf895cbb-b48d-43d3-abff-55142f480256 req-e8384df6-6314-4e59-b583-2b7653754f2d tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:34.349072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cf895cbb-b48d-43d3-abff-55142f480256 req-e8384df6-6314-4e59-b583-2b7653754f2d tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.5381548 May 12 15:16:34.392735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:34.393426 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:34.395266 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] 10.222.0.84 "PUT /v2.0/ports/182e22d5-523d-40ba-8f4c-b88eabce6db7 HTTP/1.1" status: 200 len: 1091 time: 1.9722137 May 12 15:16:34.395781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '013bfc4f-b074-4b38-a7be-ae5aa7b41b5f', 'tag': '182e22d5-523d-40ba-8f4c-b88eabce6db7'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:34.424719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9946476-d09d-4179-a371-d46df44f5b7d service neutron] Pushing event updated for resources: {'Port': ['ID=182e22d5-523d-40ba-8f4c-b88eabce6db7,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:34.455316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-30cf0a75-dab7-4610-a0b8-7705656f037d req-24e9d7f4-127d-43bd-b6ec-0d447df5cd07 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] For port c89ed514-64cd-4011-b01a-855ecf2c3a8e, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c89ed514-64cd-4011-b01a-855ecf2c3a8e,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:34.455904 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-30cf0a75-dab7-4610-a0b8-7705656f037d req-24e9d7f4-127d-43bd-b6ec-0d447df5cd07 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:34.481331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3bee8ba9-47bf-4270-baad-810622deb1f8 req-77e51eea-b853-4e66-a136-8da84e08ffe8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1462848 May 12 15:16:34.542401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6514b778-3e8a-4738-a4b8-c4ad4e09238d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:34.544162 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-6514b778-3e8a-4738-a4b8-c4ad4e09238d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 1094 time: 0.0888855 May 12 15:16:34.683912 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-be4f941d-b17c-4f86-88f7-2cd984074d07 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=182e22d5-523d-40ba-8f4c-b88eabce6db7 HTTP/1.1" status: 200 len: 217 time: 0.1256533 May 12 15:16:34.717993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-30cf0a75-dab7-4610-a0b8-7705656f037d req-24e9d7f4-127d-43bd-b6ec-0d447df5cd07 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Calling delete_port for c89ed514-64cd-4011-b01a-855ecf2c3a8e owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:16:34.761788 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cf895cbb-b48d-43d3-abff-55142f480256 req-35c56e9d-4e63-4613-834b-7599b64c4a78 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3924294 May 12 15:16:34.769917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-683a6097-d807-4218-9783-5f7c85ff34ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:34.771472 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-683a6097-d807-4218-9783-5f7c85ff34ff service neutron] 10.222.0.84 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.0809362 May 12 15:16:34.844167 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-618b7aa7-48d8-4fc8-bb7e-42f1e3a2f97c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0655527 May 12 15:16:35.009522 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-dcf3db5c-3904-4c7d-b36c-dd8d347723ed service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1584992 May 12 15:16:35.079182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-6fc670bd-0986-4c91-94eb-a17c1f10ffcd tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:35.079870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-6fc670bd-0986-4c91-94eb-a17c1f10ffcd tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Synchronizing usage tracker for tenant:d6a33151cf37459889a9facebe6ff6fd on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:35.113320 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-30cf0a75-dab7-4610-a0b8-7705656f037d req-24e9d7f4-127d-43bd-b6ec-0d447df5cd07 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:35.125229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c89ed514-64cd-4011-b01a-855ecf2c3a8e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:35.163876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a256d32-0e95-4d67-bbdf-ad3b50a483d0 req-8f950de3-530d-4834-a036-3da71710558c tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:35.165920 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a256d32-0e95-4d67-bbdf-ad3b50a483d0 req-8f950de3-530d-4834-a036-3da71710558c tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 943 time: 0.2454743 May 12 15:16:35.167338 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24869e73-1e19-49df-a6cb-08f7e7988b2c req-2f33e1b6-05f5-49d9-bbab-f771bd9a01a2 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1504662 May 12 15:16:35.174902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-6fc670bd-0986-4c91-94eb-a17c1f10ffcd tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Unset dirty status for tenant:d6a33151cf37459889a9facebe6ff6fd on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:35.176001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-6fc670bd-0986-4c91-94eb-a17c1f10ffcd tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/networks?id=8c326986-914c-4d15-83ee-665daa53b37e HTTP/1.1" status: 200 len: 813 time: 0.3953295 May 12 15:16:35.179568 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24e9d7f4-127d-43bd-b6ec-0d447df5cd07 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Pushing event deleted for resources: {'Port': ['ID=c89ed514-64cd-4011-b01a-855ecf2c3a8e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:35.250500 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-270031ca-b863-47ac-ac28-ed10cd86bfef tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/quotas/d6a33151cf37459889a9facebe6ff6fd HTTP/1.1" status: 200 len: 375 time: 0.0669658 May 12 15:16:35.339289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-30cf0a75-dab7-4610-a0b8-7705656f037d req-24e9d7f4-127d-43bd-b6ec-0d447df5cd07 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] No DVR routers for this DVR port c89ed514-64cd-4011-b01a-855ecf2c3a8e on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:16:35.344397 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-23c2b36a-319a-4448-b95e-186e44c61786 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=d6a33151cf37459889a9facebe6ff6fd&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0691619 May 12 15:16:35.345499 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-30cf0a75-dab7-4610-a0b8-7705656f037d req-24e9d7f4-127d-43bd-b6ec-0d447df5cd07 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:35.350316 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a256d32-0e95-4d67-bbdf-ad3b50a483d0 req-ec9b699d-6a6d-4d69-907d-e89412048c45 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1718879 May 12 15:16:35.350730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '42278800-f3f9-433a-9df4-98d9daab30e5', 'name': 'network-vif-deleted', 'tag': 'c89ed514-64cd-4011-b01a-855ecf2c3a8e'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:35.386475 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30cf0a75-dab7-4610-a0b8-7705656f037d req-24e9d7f4-127d-43bd-b6ec-0d447df5cd07 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.76 "DELETE /v2.0/ports/c89ed514-64cd-4011-b01a-855ecf2c3a8e HTTP/1.1" status: 204 len: 173 time: 1.6373875 May 12 15:16:35.429976 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-531650e6-11ce-4882-b94a-4d29086762cb'] response: {'name': 'network-changed', 'server_uuid': '013bfc4f-b074-4b38-a7be-ae5aa7b41b5f', 'tag': '182e22d5-523d-40ba-8f4c-b88eabce6db7', 'status': 'completed', 'code': 200} May 12 15:16:35.517087 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-c08d17bf-27c9-48cd-9774-d38d3370453b service neutron] 10.222.0.82 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1611059 May 12 15:16:35.588878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71d1d89b-6ebd-421e-bbfb-b8987ca44620 req-c01c3804-60c2-4bea-b386-873acdb340c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:35.590554 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-71d1d89b-6ebd-421e-bbfb-b8987ca44620 req-c01c3804-60c2-4bea-b386-873acdb340c1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 1094 time: 0.1129260 May 12 15:16:35.671028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1aaa921c-526d-406b-a3b4-fa97aa8b348c req-6e72e0eb-1cc1-45aa-8c4b-5e34eeebacce tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Synchronizing usage tracker for tenant:68c66ae0cd45476b87e2e79625b80f69 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:35.703346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1aaa921c-526d-406b-a3b4-fa97aa8b348c req-6e72e0eb-1cc1-45aa-8c4b-5e34eeebacce tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Unset dirty status for tenant:68c66ae0cd45476b87e2e79625b80f69 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:35.704482 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1aaa921c-526d-406b-a3b4-fa97aa8b348c req-6e72e0eb-1cc1-45aa-8c4b-5e34eeebacce tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=42278800-f3f9-433a-9df4-98d9daab30e5 HTTP/1.1" status: 200 len: 210 time: 0.1582420 May 12 15:16:35.741669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71d1d89b-6ebd-421e-bbfb-b8987ca44620 req-e9a94f46-0740-484b-b1ef-62150911f5eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:35.743215 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-71d1d89b-6ebd-421e-bbfb-b8987ca44620 req-e9a94f46-0740-484b-b1ef-62150911f5eb service neutron] 10.222.0.84 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 907 time: 0.1457491 May 12 15:16:35.754116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-86cb26ee-96da-48ae-ac8b-a184d3e904b6 service neutron] 10.222.0.82 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2297039 May 12 15:16:35.856777 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-71d1d89b-6ebd-421e-bbfb-b8987ca44620 req-d6638ed3-368c-428f-803b-eaa6bf73da62 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=182e22d5-523d-40ba-8f4c-b88eabce6db7 HTTP/1.1" status: 200 len: 217 time: 0.1072209 May 12 15:16:35.937535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71d1d89b-6ebd-421e-bbfb-b8987ca44620 req-2722a42b-582d-4841-98b2-0be3c68a48ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:35.939276 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-71d1d89b-6ebd-421e-bbfb-b8987ca44620 req-2722a42b-582d-4841-98b2-0be3c68a48ec service neutron] 10.222.0.84 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.0744236 May 12 15:16:36.046593 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-71d1d89b-6ebd-421e-bbfb-b8987ca44620 req-5417be03-28cf-4131-b7c9-533f0005a4fa service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1007674 May 12 15:16:36.106455 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-06e32ac2-d652-4bf9-8148-6d13deba2291'] response: {'server_uuid': '42278800-f3f9-433a-9df4-98d9daab30e5', 'name': 'network-vif-deleted', 'tag': 'c89ed514-64cd-4011-b01a-855ecf2c3a8e', 'status': 'completed', 'code': 200} May 12 15:16:36.155270 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:36.268202 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-71d1d89b-6ebd-421e-bbfb-b8987ca44620 req-a8cb853d-9c32-4f97-b894-c08179ecb91e service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2146649 May 12 15:16:36.491112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b742811f-cea6-4245-9bf5-c29a6718cf2a req-25656e57-f8fb-4a16-81fb-a54d905c549a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:36.499917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b742811f-cea6-4245-9bf5-c29a6718cf2a req-25656e57-f8fb-4a16-81fb-a54d905c549a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:36.506534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b742811f-cea6-4245-9bf5-c29a6718cf2a req-25656e57-f8fb-4a16-81fb-a54d905c549a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:36.516335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b742811f-cea6-4245-9bf5-c29a6718cf2a req-25656e57-f8fb-4a16-81fb-a54d905c549a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:36.523194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b742811f-cea6-4245-9bf5-c29a6718cf2a req-25656e57-f8fb-4a16-81fb-a54d905c549a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:36.526304 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-71d1d89b-6ebd-421e-bbfb-b8987ca44620 req-20d92d03-0310-4459-b0d8-27e5d75934a9 service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2503645 May 12 15:16:36.529601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b742811f-cea6-4245-9bf5-c29a6718cf2a req-25656e57-f8fb-4a16-81fb-a54d905c549a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:36.535692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b742811f-cea6-4245-9bf5-c29a6718cf2a req-25656e57-f8fb-4a16-81fb-a54d905c549a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:36.537870 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b742811f-cea6-4245-9bf5-c29a6718cf2a req-25656e57-f8fb-4a16-81fb-a54d905c549a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5426 time: 0.1926985 May 12 15:16:36.654268 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b742811f-cea6-4245-9bf5-c29a6718cf2a req-f6717377-7438-4ee6-aee4-56980e59b54d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0725682 May 12 15:16:36.655313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 182e22d5-523d-40ba-8f4c-b88eabce6db7 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:16:36.663855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 097f632d-3127-4539-ba4a-3e2739125cf8 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:36.679468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e960772-c64d-4195-9b0f-3ef231d796bf req-5a1fb0ed-514b-4bd4-b6fa-3f36ed3018af tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:36.689094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7e960772-c64d-4195-9b0f-3ef231d796bf req-5a1fb0ed-514b-4bd4-b6fa-3f36ed3018af tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.1492877 May 12 15:16:36.742135 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7e960772-c64d-4195-9b0f-3ef231d796bf req-6cf40573-244b-4b0b-a207-b6a38cff9867 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497007 May 12 15:16:36.886857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 097f632d-3127-4539-ba4a-3e2739125cf8 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:36.895142 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 097f632d-3127-4539-ba4a-3e2739125cf8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:36.895680 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:37.016986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 182e22d5-523d-40ba-8f4c-b88eabce6db7, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=182e22d5-523d-40ba-8f4c-b88eabce6db7,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:37.154827 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:37.190089 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '182e22d5-523d-40ba-8f4c-b88eabce6db7', 'network_id': 'dbc2e49c-2591-4534-a48c-cea8e23115f4', 'port_id': '182e22d5-523d-40ba-8f4c-b88eabce6db7', 'mac_address': 'fa:16:3e:ca:38:bb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 558, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84c2082e-f394-46d5-8a8f-8e3a70d54fc1', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:16:37.236963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 097f632d-3127-4539-ba4a-3e2739125cf8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=097f632d-3127-4539-ba4a-3e2739125cf8,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:37.238784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '097f632d-3127-4539-ba4a-3e2739125cf8'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:37.281000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13b8bcbd-ad00-4805-bc30-84fa539d0b37 req-2c41146b-5c69-47b0-84eb-3c53ac21b1cf tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:37.290471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13b8bcbd-ad00-4805-bc30-84fa539d0b37 req-2c41146b-5c69-47b0-84eb-3c53ac21b1cf tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 943 time: 0.1323061 May 12 15:16:37.387453 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:37.394481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device b8aacb03-fed3-4aed-b3cf-8c58c91ef18e up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:37.399078 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13b8bcbd-ad00-4805-bc30-84fa539d0b37 req-57b71198-66f1-43dc-8595-b6bdef929616 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1049674 May 12 15:16:37.516818 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:37.546833 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-faafabd7-a9f9-43d8-b6c3-c7053a89ddf8'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '097f632d-3127-4539-ba4a-3e2739125cf8', 'code': 200} May 12 15:16:37.595189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 182e22d5-523d-40ba-8f4c-b88eabce6db7 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:37.691423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 182e22d5-523d-40ba-8f4c-b88eabce6db7, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=182e22d5-523d-40ba-8f4c-b88eabce6db7,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:37.706034 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:37.718646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=097f632d-3127-4539-ba4a-3e2739125cf8,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:37.768189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:37.773535 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aec9c8dd-5cba-4fd9-9708-114ee8b64d97 req-a6d75d48-4b76-4703-a620-fd786ecbd990 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=fdcb764b-85e6-4151-a350-f4cf9fe6096f HTTP/1.1" status: 200 len: 210 time: 0.0803113 May 12 15:16:37.794339 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:37.794703 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:37.920429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=182e22d5-523d-40ba-8f4c-b88eabce6db7,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:37.957641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c89ed514-64cd-4011-b01a-855ecf2c3a8e no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:16:37.990642 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:38.030384 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: c89ed514-64cd-4011-b01a-855ecf2c3a8e {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:16:38.030723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c89ed514-64cd-4011-b01a-855ecf2c3a8e not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:16:38.074157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:38.082685 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:38.083279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 026a86ba-df92-4de2-9f16-6e6b8794d1df up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:38.113317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1f5c78-c23d-4b34-9f47-7ae41a0baef8 req-1c999ff1-cfe4-451d-bc81-84a1054cb7e7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:38.123701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1f5c78-c23d-4b34-9f47-7ae41a0baef8 req-1c999ff1-cfe4-451d-bc81-84a1054cb7e7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:38.132121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1f5c78-c23d-4b34-9f47-7ae41a0baef8 req-1c999ff1-cfe4-451d-bc81-84a1054cb7e7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:38.139050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1f5c78-c23d-4b34-9f47-7ae41a0baef8 req-1c999ff1-cfe4-451d-bc81-84a1054cb7e7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:38.144873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1f5c78-c23d-4b34-9f47-7ae41a0baef8 req-1c999ff1-cfe4-451d-bc81-84a1054cb7e7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:38.156591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1f5c78-c23d-4b34-9f47-7ae41a0baef8 req-1c999ff1-cfe4-451d-bc81-84a1054cb7e7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:38.162300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1f5c78-c23d-4b34-9f47-7ae41a0baef8 req-1c999ff1-cfe4-451d-bc81-84a1054cb7e7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:38.170744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c1f5c78-c23d-4b34-9f47-7ae41a0baef8 req-1c999ff1-cfe4-451d-bc81-84a1054cb7e7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5427 time: 0.2658374 May 12 15:16:38.262780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c1f5c78-c23d-4b34-9f47-7ae41a0baef8 req-ae5b19a7-4fe4-4d06-ad08-6a181d5839a7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0910769 May 12 15:16:38.371557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['182e22d5-523d-40ba-8f4c-b88eabce6db7'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:38.610276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-c16c36e5-13ed-43ca-a9a6-6911ee6ceecf tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:38.613109 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-c16c36e5-13ed-43ca-a9a6-6911ee6ceecf tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.84 "GET /v2.0/networks?id=8c326986-914c-4d15-83ee-665daa53b37e HTTP/1.1" status: 200 len: 813 time: 0.2834909 May 12 15:16:38.641709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Request body: {'port': {'device_id': 'fdcb764b-85e6-4151-a350-f4cf9fe6096f', 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e', 'admin_state_up': True, 'tenant_id': 'd6a33151cf37459889a9facebe6ff6fd'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:38.748846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 026a86ba-df92-4de2-9f16-6e6b8794d1df completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:38.784404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:38.823633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 026a86ba-df92-4de2-9f16-6e6b8794d1df triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:38.829678 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:39.017231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:39.021293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Usage tracker for resource:port and tenant:d6a33151cf37459889a9facebe6ff6fd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:39.026183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:39.032719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:39.047090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5c3b0fde-81f6-4928-a999-b0b5d6c10d28 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:39.047623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Made reservation on behalf of d6a33151cf37459889a9facebe6ff6fd for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:16:39.048769 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5c3b0fde-81f6-4928-a999-b0b5d6c10d28 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.76 "GET /v2.0/networks?id=8c326986-914c-4d15-83ee-665daa53b37e HTTP/1.1" status: 200 len: 813 time: 0.7786226 May 12 15:16:39.051400 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:39.065703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6482ab5c-3747-4bde-961f-c7374bac1d14 req-ef8fcdbf-7e13-4868-893b-8a2f58261a36 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:39.067313 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6482ab5c-3747-4bde-961f-c7374bac1d14 req-ef8fcdbf-7e13-4868-893b-8a2f58261a36 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 945 time: 0.3347468 May 12 15:16:39.074750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Request body: {'port': {'device_id': 'd4b93c53-ecd2-43df-9024-d05649800b6e', 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e', 'admin_state_up': True, 'tenant_id': 'd6a33151cf37459889a9facebe6ff6fd'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:39.084499 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:39.129294 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 026a86ba-df92-4de2-9f16-6e6b8794d1df, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=026a86ba-df92-4de2-9f16-6e6b8794d1df,segment=NetworkSegment(7c4990b9-5a5f-484e-a357-c9a37d811129),segment_id=7c4990b9-5a5f-484e-a357-c9a37d811129)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:39.138213 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:39.140367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device ef28df6f-7573-4910-9fae-c2b49092303b up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:39.266580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Allocated IP 172.20.0.4 (8c326986-914c-4d15-83ee-665daa53b37e/bbf4de36-cca3-4e54-b76e-de177b2d73c3/137ebbec-a1f6-422a-850e-d348c38613a1) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:16:39.291456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=026a86ba-df92-4de2-9f16-6e6b8794d1df,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:39.313851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43c22075-9101-495f-aa78-66a6282730d4 req-2be48a36-d4bf-4f5d-9afa-13bbd3321d79 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:39.320739 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43c22075-9101-495f-aa78-66a6282730d4 req-2be48a36-d4bf-4f5d-9afa-13bbd3321d79 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.5894127 May 12 15:16:39.335419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port ef28df6f-7573-4910-9fae-c2b49092303b completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:39.341424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port ef28df6f-7573-4910-9fae-c2b49092303b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:39.341607 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:39.390290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88ec39a3-9226-4ee0-9012-4a6efab334d6 req-0c08c1b4-5b6e-4a3c-af37-46574a82e659 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:39.392133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88ec39a3-9226-4ee0-9012-4a6efab334d6 req-0c08c1b4-5b6e-4a3c-af37-46574a82e659 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 945 time: 0.5532699 May 12 15:16:39.509122 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:39.515387 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43c22075-9101-495f-aa78-66a6282730d4 req-f175ba8d-a8b4-4ab6-a14e-665b090226f8 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1927998 May 12 15:16:39.537320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6482ab5c-3747-4bde-961f-c7374bac1d14 req-00fee949-edf8-4aa2-ab26-d1c699bc0810 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3458240 May 12 15:16:39.538716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:39.544523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:39.552094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b8aacb03-fed3-4aed-b3cf-8c58c91ef18e'}, {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '026a86ba-df92-4de2-9f16-6e6b8794d1df'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:39.562290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Usage tracker for resource:port and tenant:d6a33151cf37459889a9facebe6ff6fd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:39.567695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:39.571530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port ef28df6f-7573-4910-9fae-c2b49092303b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=ef28df6f-7573-4910-9fae-c2b49092303b,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:39.580213 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:39.582361 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:39.592910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:39.611812 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:39.612299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-88ec39a3-9226-4ee0-9012-4a6efab334d6 req-f52148d9-5b8b-40b7-af54-726a65ad4b6f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Deleting port 54f3ad03-fdf2-4862-93ff-f60efa594593 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:16:39.612570 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-88ec39a3-9226-4ee0-9012-4a6efab334d6 req-f52148d9-5b8b-40b7-af54-726a65ad4b6f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:39.720439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Network 8c326986-914c-4d15-83ee-665daa53b37e is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:16:39.722095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:16:39.726219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:16:39.732383 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Made reservation on behalf of d6a33151cf37459889a9facebe6ff6fd for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:16:39.737430 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:39.750289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=ef28df6f-7573-4910-9fae-c2b49092303b,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:39.781974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Pushing event updated for resources: {'Port': ['ID=137ebbec-a1f6-422a-850e-d348c38613a1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:39.807487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:39.808397 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:39.837697 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-05cf1269-042d-4a6b-a9e8-a263ad2d2b11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2018044 May 12 15:16:39.842214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:39.847954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:39.848326 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:39.856371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Request body: {'port': {'device_id': 'fdcb764b-85e6-4151-a350-f4cf9fe6096f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:40.012682 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:40.045961 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:40.060542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:40.067212 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:40.068867 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 85b4d43d-f235-4852-bda9-2dc870bb3d11 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:40.285877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:40.294683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c8c5232-1319-403b-916b-25ee745d1040 req-bb0ff3af-2765-4f15-b1c9-5158acad6b0f tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:40.296178 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c8c5232-1319-403b-916b-25ee745d1040 req-bb0ff3af-2765-4f15-b1c9-5158acad6b0f tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=fdcb764b-85e6-4151-a350-f4cf9fe6096f HTTP/1.1" status: 200 len: 931 time: 0.4190397 May 12 15:16:40.312640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab1751e1-b707-4b98-9668-5149121f75de req-6042347e-b2af-490e-aba3-576889483a50 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:40.313497 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 85b4d43d-f235-4852-bda9-2dc870bb3d11 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:40.314090 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab1751e1-b707-4b98-9668-5149121f75de req-6042347e-b2af-490e-aba3-576889483a50 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 944 time: 0.6083231 May 12 15:16:40.323769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 85b4d43d-f235-4852-bda9-2dc870bb3d11 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:40.324166 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:40.330081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Allocated IP 172.20.0.9 (8c326986-914c-4d15-83ee-665daa53b37e/bbf4de36-cca3-4e54-b76e-de177b2d73c3/e8f434eb-a33e-4dbf-9caa-507751f8b4f0) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:16:40.378605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-88ec39a3-9226-4ee0-9012-4a6efab334d6 req-f52148d9-5b8b-40b7-af54-726a65ad4b6f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] For port 54f3ad03-fdf2-4862-93ff-f60efa594593, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=54f3ad03-fdf2-4862-93ff-f60efa594593,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:40.378972 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-88ec39a3-9226-4ee0-9012-4a6efab334d6 req-f52148d9-5b8b-40b7-af54-726a65ad4b6f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:40.545078 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:40.583642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 85b4d43d-f235-4852-bda9-2dc870bb3d11, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85b4d43d-f235-4852-bda9-2dc870bb3d11,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:40.589084 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:40.593584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:40.610019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0c8c5232-1319-403b-916b-25ee745d1040 req-3489cb2c-786f-46f4-a8b5-daf85a34c68f tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Synchronizing usage tracker for tenant:d6a33151cf37459889a9facebe6ff6fd on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:40.619069 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-88ec39a3-9226-4ee0-9012-4a6efab334d6 req-f52148d9-5b8b-40b7-af54-726a65ad4b6f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Calling delete_port for 54f3ad03-fdf2-4862-93ff-f60efa594593 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:16:40.661369 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab1751e1-b707-4b98-9668-5149121f75de req-daa17f7d-7d7b-464b-8fc6-2842137c9820 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3238244 May 12 15:16:40.743348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=85b4d43d-f235-4852-bda9-2dc870bb3d11,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:40.748799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:40.752700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0c8c5232-1319-403b-916b-25ee745d1040 req-3489cb2c-786f-46f4-a8b5-daf85a34c68f tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Unset dirty status for tenant:d6a33151cf37459889a9facebe6ff6fd on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:40.754589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:40.755123 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:40.763565 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c8c5232-1319-403b-916b-25ee745d1040 req-3489cb2c-786f-46f4-a8b5-daf85a34c68f tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4484601 May 12 15:16:40.823541 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b96d86db-602c-4fbe-b53f-e56346b6baf6'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b8aacb03-fed3-4aed-b3cf-8c58c91ef18e', 'code': 200} May 12 15:16:40.824054 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b96d86db-602c-4fbe-b53f-e56346b6baf6'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '026a86ba-df92-4de2-9f16-6e6b8794d1df', 'code': 200} May 12 15:16:40.916929 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:40.958488 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:40.964970 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:41.005188 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 182e22d5-523d-40ba-8f4c-b88eabce6db7 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:41.131887 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-88ec39a3-9226-4ee0-9012-4a6efab334d6 req-f52148d9-5b8b-40b7-af54-726a65ad4b6f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:41.142355 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:41.148311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 182e22d5-523d-40ba-8f4c-b88eabce6db7 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:41.155065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 182e22d5-523d-40ba-8f4c-b88eabce6db7 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:41.155498 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:41.265088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f52148d9-5b8b-40b7-af54-726a65ad4b6f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Pushing event deleted for resources: {'Port': ['ID=54f3ad03-fdf2-4862-93ff-f60efa594593,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:41.298247 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:41.360577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 182e22d5-523d-40ba-8f4c-b88eabce6db7, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=182e22d5-523d-40ba-8f4c-b88eabce6db7,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:41.365665 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:41.402392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-88ec39a3-9226-4ee0-9012-4a6efab334d6 req-f52148d9-5b8b-40b7-af54-726a65ad4b6f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] No DVR routers for this DVR port 54f3ad03-fdf2-4862-93ff-f60efa594593 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:16:41.411665 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:41.415414 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-88ec39a3-9226-4ee0-9012-4a6efab334d6 req-f52148d9-5b8b-40b7-af54-726a65ad4b6f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:41.419320 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a304fd0-80ef-4b27-86c5-a861e6627236', 'name': 'network-vif-deleted', 'tag': '54f3ad03-fdf2-4862-93ff-f60efa594593'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:41.450652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=182e22d5-523d-40ba-8f4c-b88eabce6db7,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:41.456621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0962452-e4da-4cf4-904a-d25478df4e3e req-60608415-5744-41ca-b9eb-e8f9450c0bc2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:41.462358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0962452-e4da-4cf4-904a-d25478df4e3e req-60608415-5744-41ca-b9eb-e8f9450c0bc2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:41.468067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0962452-e4da-4cf4-904a-d25478df4e3e req-60608415-5744-41ca-b9eb-e8f9450c0bc2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:41.473782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0962452-e4da-4cf4-904a-d25478df4e3e req-60608415-5744-41ca-b9eb-e8f9450c0bc2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:41.479709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0962452-e4da-4cf4-904a-d25478df4e3e req-60608415-5744-41ca-b9eb-e8f9450c0bc2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:41.485335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0962452-e4da-4cf4-904a-d25478df4e3e req-60608415-5744-41ca-b9eb-e8f9450c0bc2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:41.490977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0962452-e4da-4cf4-904a-d25478df4e3e req-60608415-5744-41ca-b9eb-e8f9450c0bc2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:41.493487 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0962452-e4da-4cf4-904a-d25478df4e3e req-60608415-5744-41ca-b9eb-e8f9450c0bc2 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5433 time: 0.4147201 May 12 15:16:41.499693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88ec39a3-9226-4ee0-9012-4a6efab334d6 req-f52148d9-5b8b-40b7-af54-726a65ad4b6f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.76 "DELETE /v2.0/ports/54f3ad03-fdf2-4862-93ff-f60efa594593 HTTP/1.1" status: 204 len: 173 time: 2.0760958 May 12 15:16:41.512469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-714645b0-2497-4d65-8a89-6d54e95c4a30 req-c889f6dd-8c46-4751-825c-eb503e2e48a1 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:41.513960 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-714645b0-2497-4d65-8a89-6d54e95c4a30 req-c889f6dd-8c46-4751-825c-eb503e2e48a1 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.3833506 May 12 15:16:41.602210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0962452-e4da-4cf4-904a-d25478df4e3e req-dabbb71e-e4a5-421c-89c0-4cd45676f78b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1014922 May 12 15:16:41.605652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-714645b0-2497-4d65-8a89-6d54e95c4a30 req-d8524ce0-95e9-492d-8d31-9a53f342bd4e tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782743 May 12 15:16:41.615638 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:41.739611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Network 8c326986-914c-4d15-83ee-665daa53b37e is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:16:41.743285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:16:41.747732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:16:41.798849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Pushing event updated for resources: {'Port': ['ID=e8f434eb-a33e-4dbf-9caa-507751f8b4f0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:41.877474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:41.878135 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:41.952303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 54f3ad03-fdf2-4862-93ff-f60efa594593 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:16:41.990620 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 137ebbec-a1f6-422a-850e-d348c38613a1 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:41.999111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:42.005620 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a031f08d-c812-41b5-8590-8b94d7c32c58'] response: {'server_uuid': '6a304fd0-80ef-4b27-86c5-a861e6627236', 'name': 'network-vif-deleted', 'tag': '54f3ad03-fdf2-4862-93ff-f60efa594593', 'status': 'completed', 'code': 200} May 12 15:16:42.013404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 54f3ad03-fdf2-4862-93ff-f60efa594593 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:16:42.013894 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 54f3ad03-fdf2-4862-93ff-f60efa594593 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:16:42.015660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Transition to ACTIVE for port object 137ebbec-a1f6-422a-850e-d348c38613a1 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:16:42.020752 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:42.040062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9e9cb007-8290-4939-a6f6-ffa2b9b9231a req-db8e49e5-d226-4382-aebd-d8669436129e tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Synchronizing usage tracker for tenant:68c66ae0cd45476b87e2e79625b80f69 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:42.049721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a2b23a63-a998-4b2f-a720-86a4a95623ac tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.9797027 May 12 15:16:42.099045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Request body: {'port': {'device_id': 'd4b93c53-ecd2-43df-9024-d05649800b6e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:42.136505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9e9cb007-8290-4939-a6f6-ffa2b9b9231a req-db8e49e5-d226-4382-aebd-d8669436129e tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Unset dirty status for tenant:68c66ae0cd45476b87e2e79625b80f69 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:42.139609 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e9cb007-8290-4939-a6f6-ffa2b9b9231a req-db8e49e5-d226-4382-aebd-d8669436129e tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.2333229 May 12 15:16:42.205977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Pushing event updated for resources: {'Port': ['ID=137ebbec-a1f6-422a-850e-d348c38613a1,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:42.297177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Attempting to bind port 137ebbec-a1f6-422a-850e-d348c38613a1 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:16:42.297907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Attempting to bind port 137ebbec-a1f6-422a-850e-d348c38613a1 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:16:42.298411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Attempting to bind port 137ebbec-a1f6-422a-850e-d348c38613a1 on network 8c326986-914c-4d15-83ee-665daa53b37e {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:42.303877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Port 137ebbec-a1f6-422a-850e-d348c38613a1 on network 8c326986-914c-4d15-83ee-665daa53b37e not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:16:42.304195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Attempting to bind port 137ebbec-a1f6-422a-850e-d348c38613a1 on network 8c326986-914c-4d15-83ee-665daa53b37e {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:42.315383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 16, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:16:42.315724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Checking segment: {'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:16:42.316395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Bound using segment: {'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:16:42.317085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Bound port: 137ebbec-a1f6-422a-850e-d348c38613a1, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:16:42.317462 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:42.319813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-189b4810-5ac8-4014-8d97-f6da383be09d req-0648aebd-3f0c-4a5a-9284-251fa98ba285 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:42.321983 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-189b4810-5ac8-4014-8d97-f6da383be09d req-0648aebd-3f0c-4a5a-9284-251fa98ba285 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.2661932 May 12 15:16:42.388418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:42.411512 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-189b4810-5ac8-4014-8d97-f6da383be09d req-a9725385-b671-4a40-9071-fde2db0717e6 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0805056 May 12 15:16:42.425428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] For port 137ebbec-a1f6-422a-850e-d348c38613a1, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:16:42.428495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] For port 137ebbec-a1f6-422a-850e-d348c38613a1, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=137ebbec-a1f6-422a-850e-d348c38613a1,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:16:42.442621 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:42.478346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3980d2c2-074a-47f0-834f-42f94511851f req-843c27c9-893b-44cf-9cde-13ddb7e9d20a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:42.479061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3980d2c2-074a-47f0-834f-42f94511851f req-843c27c9-893b-44cf-9cde-13ddb7e9d20a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Synchronizing usage tracker for tenant:d6a33151cf37459889a9facebe6ff6fd on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:42.533017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:42.534014 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:42.536342 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] 10.222.0.84 "PUT /v2.0/ports/137ebbec-a1f6-422a-850e-d348c38613a1 HTTP/1.1" status: 200 len: 1091 time: 2.6854248 May 12 15:16:42.536939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fdcb764b-85e6-4151-a350-f4cf9fe6096f', 'tag': '137ebbec-a1f6-422a-850e-d348c38613a1'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:42.563095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dea6c92-4913-4473-b5a2-70bc42c78f45 service neutron] Pushing event updated for resources: {'Port': ['ID=137ebbec-a1f6-422a-850e-d348c38613a1,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:42.569626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3980d2c2-074a-47f0-834f-42f94511851f req-843c27c9-893b-44cf-9cde-13ddb7e9d20a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Unset dirty status for tenant:d6a33151cf37459889a9facebe6ff6fd on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:42.577065 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3980d2c2-074a-47f0-834f-42f94511851f req-843c27c9-893b-44cf-9cde-13ddb7e9d20a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=fdcb764b-85e6-4151-a350-f4cf9fe6096f HTTP/1.1" status: 200 len: 943 time: 0.3150482 May 12 15:16:42.664153 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-478be3b1-23cb-4311-be10-41079e42f3ee None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:42.668393 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3980d2c2-074a-47f0-834f-42f94511851f req-e3473b58-f49c-498e-8ad7-c771d812a3ce tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0902724 May 12 15:16:42.723402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-049e0f84-3f06-4180-b2f0-abba929276a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:42.726939 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-049e0f84-3f06-4180-b2f0-abba929276a4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=d6a33151cf37459889a9facebe6ff6fd&device_id=fdcb764b-85e6-4151-a350-f4cf9fe6096f HTTP/1.1" status: 200 len: 1094 time: 0.1308849 May 12 15:16:42.758967 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:42.824848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ef28df6f-7573-4910-9fae-c2b49092303b'}, {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad'}, {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85b4d43d-f235-4852-bda9-2dc870bb3d11'}, {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c'}, {'server_uuid': '013bfc4f-b074-4b38-a7be-ae5aa7b41b5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '182e22d5-523d-40ba-8f4c-b88eabce6db7'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:42.997129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e8f434eb-a33e-4dbf-9caa-507751f8b4f0 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:43.006925 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:43.021147 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a8ae360f-ecec-4e4b-8fe5-30e69018ccee'] response: {'name': 'network-changed', 'server_uuid': 'fdcb764b-85e6-4151-a350-f4cf9fe6096f', 'tag': '137ebbec-a1f6-422a-850e-d348c38613a1', 'status': 'completed', 'code': 200} May 12 15:16:43.022557 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-321caf9e-ed31-4b05-b67c-9f7b40d5faea service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=137ebbec-a1f6-422a-850e-d348c38613a1 HTTP/1.1" status: 200 len: 217 time: 0.2827404 May 12 15:16:43.074704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Transition to ACTIVE for port object e8f434eb-a33e-4dbf-9caa-507751f8b4f0 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:16:43.084044 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:43.106915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-f1664d35-7b79-420b-963d-390932ac7429 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:43.108458 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-f1664d35-7b79-420b-963d-390932ac7429 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bbf4de36-cca3-4e54-b76e-de177b2d73c3 HTTP/1.1" status: 200 len: 853 time: 0.0786710 May 12 15:16:43.170162 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-d45f0956-9853-4125-954f-6fdf6f8c6afe service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=8c326986-914c-4d15-83ee-665daa53b37e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0540106 May 12 15:16:43.356192 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-08ac2c4c-c87f-4022-9cb0-8137e4ad19e0 service neutron] 10.222.0.84 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1780770 May 12 15:16:43.460042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91e11474-749f-4975-b185-5019865e909f service neutron] Pushing event updated for resources: {'Port': ['ID=e8f434eb-a33e-4dbf-9caa-507751f8b4f0,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:43.527237 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-a4a855b0-5fa4-46f7-a3c7-f18692abe2dc service neutron] 10.222.0.84 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1642370 May 12 15:16:43.566234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05b7f0fa-5a21-41d9-82c4-28b36862a4cd req-85d40a62-de15-4e10-ad66-5acbadcce640 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:43.567573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05b7f0fa-5a21-41d9-82c4-28b36862a4cd req-85d40a62-de15-4e10-ad66-5acbadcce640 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.5818689 May 12 15:16:43.672587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05b7f0fa-5a21-41d9-82c4-28b36862a4cd req-e69bd94f-2981-4be4-9db5-f130b0d6b26b tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0953259 May 12 15:16:43.685641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-554d6682-5557-4248-94d1-2d88962c4caf req-b4c431a7-cb8a-4ab0-ab9c-60a9728c4065 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:43.691395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-554d6682-5557-4248-94d1-2d88962c4caf req-b4c431a7-cb8a-4ab0-ab9c-60a9728c4065 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:43.697291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-554d6682-5557-4248-94d1-2d88962c4caf req-b4c431a7-cb8a-4ab0-ab9c-60a9728c4065 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:43.703313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-554d6682-5557-4248-94d1-2d88962c4caf req-b4c431a7-cb8a-4ab0-ab9c-60a9728c4065 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:43.709114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-554d6682-5557-4248-94d1-2d88962c4caf req-b4c431a7-cb8a-4ab0-ab9c-60a9728c4065 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:43.715430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e01cb59c-9757-4e37-bece-9e09b6fe6bb2 req-bb1916f1-8e90-4257-8c16-7136ed6a66d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:43.715982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-554d6682-5557-4248-94d1-2d88962c4caf req-b4c431a7-cb8a-4ab0-ab9c-60a9728c4065 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:43.717696 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e01cb59c-9757-4e37-bece-9e09b6fe6bb2 req-bb1916f1-8e90-4257-8c16-7136ed6a66d1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=d6a33151cf37459889a9facebe6ff6fd&device_id=fdcb764b-85e6-4151-a350-f4cf9fe6096f HTTP/1.1" status: 200 len: 1094 time: 0.0984244 May 12 15:16:43.721796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-554d6682-5557-4248-94d1-2d88962c4caf req-b4c431a7-cb8a-4ab0-ab9c-60a9728c4065 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:43.723676 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-554d6682-5557-4248-94d1-2d88962c4caf req-b4c431a7-cb8a-4ab0-ab9c-60a9728c4065 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5433 time: 0.5192337 May 12 15:16:43.724443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Attempting to bind port e8f434eb-a33e-4dbf-9caa-507751f8b4f0 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:16:43.724770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Attempting to bind port e8f434eb-a33e-4dbf-9caa-507751f8b4f0 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:16:43.725096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Attempting to bind port e8f434eb-a33e-4dbf-9caa-507751f8b4f0 on network 8c326986-914c-4d15-83ee-665daa53b37e {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:43.753824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d48f1d6-50eb-4522-823c-b0cdb0787ad4 req-612fae9a-399f-4c45-b75f-7481737845c5 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:43.755260 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d48f1d6-50eb-4522-823c-b0cdb0787ad4 req-612fae9a-399f-4c45-b75f-7481737845c5 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.76 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 944 time: 0.2972467 May 12 15:16:43.757932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Port e8f434eb-a33e-4dbf-9caa-507751f8b4f0 on network 8c326986-914c-4d15-83ee-665daa53b37e not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:16:43.758251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Attempting to bind port e8f434eb-a33e-4dbf-9caa-507751f8b4f0 on network 8c326986-914c-4d15-83ee-665daa53b37e {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:16:43.801512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 16, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:16:43.801839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Checking segment: {'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:16:43.802225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Bound using segment: {'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:16:43.802669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Bound port: e8f434eb-a33e-4dbf-9caa-507751f8b4f0, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:16:43.803012 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:43.921461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e01cb59c-9757-4e37-bece-9e09b6fe6bb2 req-f0458a4c-0e72-430e-9cf8-2570f32d255e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:43.923186 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e01cb59c-9757-4e37-bece-9e09b6fe6bb2 req-f0458a4c-0e72-430e-9cf8-2570f32d255e service neutron] 10.222.0.84 "GET /v2.0/networks?id=8c326986-914c-4d15-83ee-665daa53b37e HTTP/1.1" status: 200 len: 914 time: 0.1910934 May 12 15:16:43.935305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-554d6682-5557-4248-94d1-2d88962c4caf req-d473b772-43f5-4d6b-a46f-5d9244a424e0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2026560 May 12 15:16:43.948884 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-8d48f1d6-50eb-4522-823c-b0cdb0787ad4 req-14445a3d-3162-4031-aaac-1c76d04aab01 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Deleting port 14990298-685a-4dd8-a308-ee8dcbbb6d93 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:16:43.949234 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8d48f1d6-50eb-4522-823c-b0cdb0787ad4 req-14445a3d-3162-4031-aaac-1c76d04aab01 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:43.985170 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f4b33190-027e-47d1-a605-c4f0b4fa0616'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ef28df6f-7573-4910-9fae-c2b49092303b', 'code': 200} May 12 15:16:43.986126 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f4b33190-027e-47d1-a605-c4f0b4fa0616'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad', 'code': 200} May 12 15:16:43.986581 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f4b33190-027e-47d1-a605-c4f0b4fa0616'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85b4d43d-f235-4852-bda9-2dc870bb3d11', 'code': 200} May 12 15:16:43.987221 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f4b33190-027e-47d1-a605-c4f0b4fa0616'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c', 'code': 200} May 12 15:16:43.987699 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f4b33190-027e-47d1-a605-c4f0b4fa0616'] response: {'server_uuid': '013bfc4f-b074-4b38-a7be-ae5aa7b41b5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '182e22d5-523d-40ba-8f4c-b88eabce6db7', 'code': 200} May 12 15:16:44.070106 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e01cb59c-9757-4e37-bece-9e09b6fe6bb2 req-c47d6cb3-b8a4-47fc-a3ea-3217d0103811 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=137ebbec-a1f6-422a-850e-d348c38613a1 HTTP/1.1" status: 200 len: 217 time: 0.1396935 May 12 15:16:44.188776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e01cb59c-9757-4e37-bece-9e09b6fe6bb2 req-46d7633a-811e-4e5b-8c2c-f431380cca8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:44.190166 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e01cb59c-9757-4e37-bece-9e09b6fe6bb2 req-46d7633a-811e-4e5b-8c2c-f431380cca8a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bbf4de36-cca3-4e54-b76e-de177b2d73c3 HTTP/1.1" status: 200 len: 853 time: 0.0707884 May 12 15:16:44.294119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] For port e8f434eb-a33e-4dbf-9caa-507751f8b4f0, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:16:44.325802 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e01cb59c-9757-4e37-bece-9e09b6fe6bb2 req-d4865de3-c994-44dd-b105-4697425da1f4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=8c326986-914c-4d15-83ee-665daa53b37e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1286614 May 12 15:16:44.339950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] For port e8f434eb-a33e-4dbf-9caa-507751f8b4f0, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8f434eb-a33e-4dbf-9caa-507751f8b4f0,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:16:44.362388 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:44.432575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e9b8e7-b8c2-4206-8c24-9b208d3368e6 req-d943e6b0-3a21-42cd-8d38-d2b3870fb44f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:44.434594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6e9b8e7-b8c2-4206-8c24-9b208d3368e6 req-d943e6b0-3a21-42cd-8d38-d2b3870fb44f tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 944 time: 0.2963219 May 12 15:16:44.471919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-255148cf-473a-44e1-a499-7078b19b04c3 req-859c61a0-0992-4b2c-a940-994619e2d35e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:44.473397 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-255148cf-473a-44e1-a499-7078b19b04c3 req-859c61a0-0992-4b2c-a940-994619e2d35e service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 1096 time: 0.2409422 May 12 15:16:44.492528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:44.493312 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:44.494800 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-91e11474-749f-4975-b185-5019865e909f service neutron] 10.222.0.76 "PUT /v2.0/ports/e8f434eb-a33e-4dbf-9caa-507751f8b4f0 HTTP/1.1" status: 200 len: 1091 time: 2.4003038 May 12 15:16:44.496980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd4b93c53-ecd2-43df-9024-d05649800b6e', 'tag': 'e8f434eb-a33e-4dbf-9caa-507751f8b4f0'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:44.513408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-8d48f1d6-50eb-4522-823c-b0cdb0787ad4 req-14445a3d-3162-4031-aaac-1c76d04aab01 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] For port 14990298-685a-4dd8-a308-ee8dcbbb6d93, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=14990298-685a-4dd8-a308-ee8dcbbb6d93,segment=NetworkSegment(619405e4-e83d-45d8-8f13-c0a176ec94ed),segment_id=619405e4-e83d-45d8-8f13-c0a176ec94ed)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:44.513890 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8d48f1d6-50eb-4522-823c-b0cdb0787ad4 req-14445a3d-3162-4031-aaac-1c76d04aab01 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:44.536862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02c57e0c-e8c9-47aa-8609-4e790e6d9b25 req-d49c6b6e-522d-410c-ba60-d3a16bea71ed tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:44.538633 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02c57e0c-e8c9-47aa-8609-4e790e6d9b25 req-d49c6b6e-522d-410c-ba60-d3a16bea71ed tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.4637733 May 12 15:16:44.550786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ba1dad-43fb-4204-84d8-0a709ab6e5e2 req-e99e91a6-ed21-4023-aae6-30ad01801f84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:44.551257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ba1dad-43fb-4204-84d8-0a709ab6e5e2 req-e99e91a6-ed21-4023-aae6-30ad01801f84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:44.551724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ba1dad-43fb-4204-84d8-0a709ab6e5e2 req-e99e91a6-ed21-4023-aae6-30ad01801f84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:44.552183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ba1dad-43fb-4204-84d8-0a709ab6e5e2 req-e99e91a6-ed21-4023-aae6-30ad01801f84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:44.552636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ba1dad-43fb-4204-84d8-0a709ab6e5e2 req-e99e91a6-ed21-4023-aae6-30ad01801f84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:44.553097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ba1dad-43fb-4204-84d8-0a709ab6e5e2 req-e99e91a6-ed21-4023-aae6-30ad01801f84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:44.553580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ba1dad-43fb-4204-84d8-0a709ab6e5e2 req-e99e91a6-ed21-4023-aae6-30ad01801f84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:44.555549 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d7ba1dad-43fb-4204-84d8-0a709ab6e5e2 req-e99e91a6-ed21-4023-aae6-30ad01801f84 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 6490 time: 0.3241744 May 12 15:16:44.567082 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e01cb59c-9757-4e37-bece-9e09b6fe6bb2 req-08a374fa-2c3b-4c14-95cd-b18a4182bc79 service neutron] 10.222.0.84 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2246981 May 12 15:16:44.580468 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-255148cf-473a-44e1-a499-7078b19b04c3 req-e9d81640-f00c-4ba2-b862-e7da702c3955 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0992961 May 12 15:16:44.694070 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d7ba1dad-43fb-4204-84d8-0a709ab6e5e2 req-a6bb5144-f3ce-4514-9bbd-360ab4a2c5b3 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=98320268-f290-4c75-8a2a-57916de87f04&id=8814ef16-03ed-468a-b207-7c8497a79fc0&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1306827 May 12 15:16:44.735659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-8d48f1d6-50eb-4522-823c-b0cdb0787ad4 req-14445a3d-3162-4031-aaac-1c76d04aab01 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Calling delete_port for 14990298-685a-4dd8-a308-ee8dcbbb6d93 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:16:44.751316 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e01cb59c-9757-4e37-bece-9e09b6fe6bb2 req-4da3a11d-f0ab-4599-b7de-d790030bb0f7 service neutron] 10.222.0.84 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1682880 May 12 15:16:44.771194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91e11474-749f-4975-b185-5019865e909f service neutron] Pushing event updated for resources: {'Port': ['ID=e8f434eb-a33e-4dbf-9caa-507751f8b4f0,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:44.786007 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6e9b8e7-b8c2-4206-8c24-9b208d3368e6 req-f44781df-242b-4bfc-a3cc-33878dc43f9c tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/security-groups?id=84fde8a0-0025-4028-a28e-5b3152f4f62d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3380506 May 12 15:16:44.808770 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-32b4be66-bfc4-40d4-9248-c5bc188fb3da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:44.861155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02c57e0c-e8c9-47aa-8609-4e790e6d9b25 req-82e7d744-b311-4fe4-91f4-413892aef5dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2754016 May 12 15:16:44.964698 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-26c713d6-30d4-4980-b429-8c5f31ab8ab0'] response: {'name': 'network-changed', 'server_uuid': 'd4b93c53-ecd2-43df-9024-d05649800b6e', 'tag': 'e8f434eb-a33e-4dbf-9caa-507751f8b4f0', 'status': 'completed', 'code': 200} May 12 15:16:44.983105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-7f5a5dbd-2570-49f6-b87c-4c824bc81a64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:44.984813 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-7f5a5dbd-2570-49f6-b87c-4c824bc81a64 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=d6a33151cf37459889a9facebe6ff6fd&device_id=d4b93c53-ecd2-43df-9024-d05649800b6e HTTP/1.1" status: 200 len: 1094 time: 0.4384034 May 12 15:16:45.118116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-3e195290-d57d-4bbf-9714-cb4f09681e7c service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e8f434eb-a33e-4dbf-9caa-507751f8b4f0 HTTP/1.1" status: 200 len: 217 time: 0.1130600 May 12 15:16:45.124000 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8d48f1d6-50eb-4522-823c-b0cdb0787ad4 req-14445a3d-3162-4031-aaac-1c76d04aab01 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:45.368269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14445a3d-3162-4031-aaac-1c76d04aab01 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Pushing event deleted for resources: {'Port': ['ID=14990298-685a-4dd8-a308-ee8dcbbb6d93,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:45.426573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fe5f270-0286-480d-b856-512d755b50b3 req-59d629f8-9bcb-4b12-9cbe-2c8860b48895 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:45.428243 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9fe5f270-0286-480d-b856-512d755b50b3 req-59d629f8-9bcb-4b12-9cbe-2c8860b48895 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=fdcb764b-85e6-4151-a350-f4cf9fe6096f HTTP/1.1" status: 200 len: 943 time: 0.5126734 May 12 15:16:45.466557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-22108dd7-dba0-4137-a6ce-fa6d447fdebe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:45.467942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-22108dd7-dba0-4137-a6ce-fa6d447fdebe service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bbf4de36-cca3-4e54-b76e-de177b2d73c3 HTTP/1.1" status: 200 len: 853 time: 0.3417983 May 12 15:16:45.490408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-8d48f1d6-50eb-4522-823c-b0cdb0787ad4 req-14445a3d-3162-4031-aaac-1c76d04aab01 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] No DVR routers for this DVR port 14990298-685a-4dd8-a308-ee8dcbbb6d93 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:16:45.529280 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8d48f1d6-50eb-4522-823c-b0cdb0787ad4 req-14445a3d-3162-4031-aaac-1c76d04aab01 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:45.552943 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-f51ebfef-c6ae-404c-a2a5-1a6b991d131f service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=8c326986-914c-4d15-83ee-665daa53b37e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0667665 May 12 15:16:45.592461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d48f1d6-50eb-4522-823c-b0cdb0787ad4 req-14445a3d-3162-4031-aaac-1c76d04aab01 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.76 "DELETE /v2.0/ports/14990298-685a-4dd8-a308-ee8dcbbb6d93 HTTP/1.1" status: 204 len: 173 time: 1.8264389 May 12 15:16:45.605981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2a64d64-40fa-4b89-a894-abc13271117b req-863bb6ab-a7f8-44ad-8ad0-b3199a8899a4 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:45.607510 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b2a64d64-40fa-4b89-a894-abc13271117b req-863bb6ab-a7f8-44ad-8ad0-b3199a8899a4 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.5499499 May 12 15:16:45.661811 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9fe5f270-0286-480d-b856-512d755b50b3 req-717b0b03-ff65-40db-b0ae-16feb5460a11 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2032230 May 12 15:16:45.740832 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b2a64d64-40fa-4b89-a894-abc13271117b req-81c0fb11-9690-457f-8330-28dd4dad1fb1 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822685 May 12 15:16:45.763193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-cc37402f-5d43-47f9-992c-b0c69a8e3ed0 service neutron] 10.222.0.76 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1992157 May 12 15:16:45.999187 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8617000a-4af6-42ec-a3c3-acc7a0a6bd1c req-165b0c4c-5de2-4981-8e20-6a1cf5ea5f93 service neutron] 10.222.0.76 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2277200 May 12 15:16:46.001744 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:46.036098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207a0878-2f22-4822-b798-60d93cdfa71f req-d1cb0659-8873-46db-9500-ad57d3d57434 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:46.043320 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207a0878-2f22-4822-b798-60d93cdfa71f req-d1cb0659-8873-46db-9500-ad57d3d57434 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:46.050430 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207a0878-2f22-4822-b798-60d93cdfa71f req-d1cb0659-8873-46db-9500-ad57d3d57434 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:46.060501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207a0878-2f22-4822-b798-60d93cdfa71f req-d1cb0659-8873-46db-9500-ad57d3d57434 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:46.066846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207a0878-2f22-4822-b798-60d93cdfa71f req-d1cb0659-8873-46db-9500-ad57d3d57434 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:46.073777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207a0878-2f22-4822-b798-60d93cdfa71f req-d1cb0659-8873-46db-9500-ad57d3d57434 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:46.080180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207a0878-2f22-4822-b798-60d93cdfa71f req-d1cb0659-8873-46db-9500-ad57d3d57434 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:46.089278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-207a0878-2f22-4822-b798-60d93cdfa71f req-d1cb0659-8873-46db-9500-ad57d3d57434 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5433 time: 0.1671338 May 12 15:16:46.109397 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:46.213941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-62a252ae-fe1a-479a-9798-abfbfe488b77 req-3a4730ca-d5cb-4909-80dd-f7e14ef41c14 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Synchronizing usage tracker for tenant:68c66ae0cd45476b87e2e79625b80f69 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:46.268519 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-207a0878-2f22-4822-b798-60d93cdfa71f req-95769bdc-bae0-4832-90cd-4d6b4e7a4f73 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1725435 May 12 15:16:46.302176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-62a252ae-fe1a-479a-9798-abfbfe488b77 req-3a4730ca-d5cb-4909-80dd-f7e14ef41c14 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] Unset dirty status for tenant:68c66ae0cd45476b87e2e79625b80f69 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:46.320599 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62a252ae-fe1a-479a-9798-abfbfe488b77 req-3a4730ca-d5cb-4909-80dd-f7e14ef41c14 tempest-LiveMigrationTest-1182209170 tempest-LiveMigrationTest-1182209170-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 210 time: 0.1993878 May 12 15:16:46.634460 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d471c593-186c-4012-b95c-0eaab01893ec req-dc2b974b-294e-4972-89c5-36a288638a7a service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.2065556 May 12 15:16:46.654258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 137ebbec-a1f6-422a-850e-d348c38613a1 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:16:46.753914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3baaa133-079e-4a13-99e6-a369bcae9858 req-5a83e0af-4d8e-4f34-bd82-37831c0d925a tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:46.761896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3baaa133-079e-4a13-99e6-a369bcae9858 req-5a83e0af-4d8e-4f34-bd82-37831c0d925a tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.2554343 May 12 15:16:46.767758 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46de40d4-f826-4c2d-9d33-9bcc75142a94 req-1089712d-fb24-4c6e-8612-d9e1f5234877 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:46.769313 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46de40d4-f826-4c2d-9d33-9bcc75142a94 req-1089712d-fb24-4c6e-8612-d9e1f5234877 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=d6a33151cf37459889a9facebe6ff6fd&device_id=d4b93c53-ecd2-43df-9024-d05649800b6e HTTP/1.1" status: 200 len: 1094 time: 0.4229770 May 12 15:16:46.846579 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 137ebbec-a1f6-422a-850e-d348c38613a1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=137ebbec-a1f6-422a-850e-d348c38613a1,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:46.869983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '137ebbec-a1f6-422a-850e-d348c38613a1', 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e', 'port_id': '137ebbec-a1f6-422a-850e-d348c38613a1', 'mac_address': 'fa:16:3e:17:51:6a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 565, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bbf4de36-cca3-4e54-b76e-de177b2d73c3', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:16:46.928608 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:46.949607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 137ebbec-a1f6-422a-850e-d348c38613a1 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:46.968037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 137ebbec-a1f6-422a-850e-d348c38613a1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=137ebbec-a1f6-422a-850e-d348c38613a1,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:46.973162 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d471c593-186c-4012-b95c-0eaab01893ec req-d2aed2fe-e300-4965-ad84-dcc13d6d774e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4 HTTP/1.1" status: 200 len: 210 time: 0.1218970 May 12 15:16:46.975843 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:46.985227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4', 'name': 'network-vif-deleted', 'tag': '14990298-685a-4dd8-a308-ee8dcbbb6d93'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:47.035408 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3baaa133-079e-4a13-99e6-a369bcae9858 req-4303c86f-05b3-4d7d-b31d-7620db534c1b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2723753 May 12 15:16:47.085542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=137ebbec-a1f6-422a-850e-d348c38613a1,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:47.249988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7795d4a9-cd12-4779-879b-391349e1c8ec req-00d4f5ce-5eda-456e-8bcc-b4ae85b49b4c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:47.251459 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7795d4a9-cd12-4779-879b-391349e1c8ec req-00d4f5ce-5eda-456e-8bcc-b4ae85b49b4c tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 945 time: 0.4874136 May 12 15:16:47.257661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46de40d4-f826-4c2d-9d33-9bcc75142a94 req-525d3c45-1cc9-469a-b64c-b4bdd8e24f78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:47.259407 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46de40d4-f826-4c2d-9d33-9bcc75142a94 req-525d3c45-1cc9-469a-b64c-b4bdd8e24f78 service neutron] 10.222.0.76 "GET /v2.0/networks?id=8c326986-914c-4d15-83ee-665daa53b37e HTTP/1.1" status: 200 len: 914 time: 0.4423995 May 12 15:16:47.367399 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46de40d4-f826-4c2d-9d33-9bcc75142a94 req-cac4fc6b-5192-4f87-b27a-9b4b9dac50d1 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e8f434eb-a33e-4dbf-9caa-507751f8b4f0 HTTP/1.1" status: 200 len: 217 time: 0.0857573 May 12 15:16:47.370270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d471c593-186c-4012-b95c-0eaab01893ec req-7d1d0288-8d2c-47c9-bafc-6d4d82fb95f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:47.371606 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d471c593-186c-4012-b95c-0eaab01893ec req-7d1d0288-8d2c-47c9-bafc-6d4d82fb95f6 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 909 time: 0.3731658 May 12 15:16:47.421122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['137ebbec-a1f6-422a-850e-d348c38613a1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:47.459342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7795d4a9-cd12-4779-879b-391349e1c8ec req-61b247c4-4a93-496a-89eb-782a343911fa tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/security-groups?id=b520f0c2-32b3-4656-bbec-ee430aa330d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1955841 May 12 15:16:47.635737 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:47.720799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d5c9932-c847-4a88-9999-b6058e7a9ae1 req-a5223a8c-cb31-4c82-b15b-228e0c9a776d tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:47.722260 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d5c9932-c847-4a88-9999-b6058e7a9ae1 req-a5223a8c-cb31-4c82-b15b-228e0c9a776d tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=fdcb764b-85e6-4151-a350-f4cf9fe6096f HTTP/1.1" status: 200 len: 944 time: 0.5800796 May 12 15:16:47.742029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46de40d4-f826-4c2d-9d33-9bcc75142a94 req-2c0c2f04-1ea0-455f-9ab3-77738b84d35f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:47.743659 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46de40d4-f826-4c2d-9d33-9bcc75142a94 req-2c0c2f04-1ea0-455f-9ab3-77738b84d35f service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bbf4de36-cca3-4e54-b76e-de177b2d73c3 HTTP/1.1" status: 200 len: 853 time: 0.3623216 May 12 15:16:47.837814 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46de40d4-f826-4c2d-9d33-9bcc75142a94 req-b5164c96-8fce-4cbe-9bc7-64b04566183a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=8c326986-914c-4d15-83ee-665daa53b37e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0636508 May 12 15:16:47.856310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d471c593-186c-4012-b95c-0eaab01893ec req-0070723b-f961-47d3-84c7-f2a9b5f0544d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:47.857721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d471c593-186c-4012-b95c-0eaab01893ec req-0070723b-f961-47d3-84c7-f2a9b5f0544d service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4752669 May 12 15:16:47.891263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d5c9932-c847-4a88-9999-b6058e7a9ae1 req-615c3317-f2af-4a31-a842-8ef186b2e8f8 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1600056 May 12 15:16:47.952257 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1c40c2cd-cfe2-4ef7-b472-05edbe1458d9'] response: {'server_uuid': '3d0d84d8-3dfc-42b2-9d73-91fe952dc6d4', 'name': 'network-vif-deleted', 'tag': '14990298-685a-4dd8-a308-ee8dcbbb6d93', 'status': 'completed', 'code': 200} May 12 15:16:47.969480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e8f434eb-a33e-4dbf-9caa-507751f8b4f0 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:16:48.006919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9fc2885-bb46-488a-b290-bd3f96bae1be req-49bd4360-0419-4533-b75a-351a53fbae97 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:48.015025 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9fc2885-bb46-488a-b290-bd3f96bae1be req-49bd4360-0419-4533-b75a-351a53fbae97 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.3742204 May 12 15:16:48.104245 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9fc2885-bb46-488a-b290-bd3f96bae1be req-d32df922-b964-4b21-9c94-64dc9d4f0fe4 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0881507 May 12 15:16:48.134930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e8f434eb-a33e-4dbf-9caa-507751f8b4f0, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8f434eb-a33e-4dbf-9caa-507751f8b4f0,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:48.150183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 14990298-685a-4dd8-a308-ee8dcbbb6d93 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:16:48.160941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46de40d4-f826-4c2d-9d33-9bcc75142a94 req-1fec7974-a051-411f-8a9c-b7928c947e1a service neutron] 10.222.0.76 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3074963 May 12 15:16:48.191722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'e8f434eb-a33e-4dbf-9caa-507751f8b4f0', 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e', 'port_id': 'e8f434eb-a33e-4dbf-9caa-507751f8b4f0', 'mac_address': 'fa:16:3e:69:82:13', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 565, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bbf4de36-cca3-4e54-b76e-de177b2d73c3', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:16:48.193365 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 14990298-685a-4dd8-a308-ee8dcbbb6d93 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:16:48.193784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 14990298-685a-4dd8-a308-ee8dcbbb6d93 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:16:48.263079 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:48.274289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55942) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:48.303349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e8f434eb-a33e-4dbf-9caa-507751f8b4f0 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:16:48.336842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e8f434eb-a33e-4dbf-9caa-507751f8b4f0, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8f434eb-a33e-4dbf-9caa-507751f8b4f0,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:48.343804 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:48.495701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-d8f23a31-e1b0-4469-9301-40b02c061c99 admin admin] Deleting subnet ed7d4325-c4dc-4592-8d41-1f3fe41da585 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:16:48.501653 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8f23a31-e1b0-4469-9301-40b02c061c99 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:48.515796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=e8f434eb-a33e-4dbf-9caa-507751f8b4f0,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:48.567980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['e8f434eb-a33e-4dbf-9caa-507751f8b4f0'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:48.573977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8f23a31-e1b0-4469-9301-40b02c061c99 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:48.587489 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46de40d4-f826-4c2d-9d33-9bcc75142a94 req-0809cec9-fee8-488a-8e1b-0ee1e3a591df service neutron] 10.222.0.76 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3888364 May 12 15:16:48.607447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7354da-43fa-4614-8c55-d5e195eea239 req-d7a09b88-5138-426d-a0f2-4c44525a287b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:48.613177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7354da-43fa-4614-8c55-d5e195eea239 req-d7a09b88-5138-426d-a0f2-4c44525a287b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:48.619639 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7354da-43fa-4614-8c55-d5e195eea239 req-d7a09b88-5138-426d-a0f2-4c44525a287b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:48.625430 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7354da-43fa-4614-8c55-d5e195eea239 req-d7a09b88-5138-426d-a0f2-4c44525a287b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:48.631107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7354da-43fa-4614-8c55-d5e195eea239 req-d7a09b88-5138-426d-a0f2-4c44525a287b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:48.637154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7354da-43fa-4614-8c55-d5e195eea239 req-d7a09b88-5138-426d-a0f2-4c44525a287b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:48.643247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7354da-43fa-4614-8c55-d5e195eea239 req-d7a09b88-5138-426d-a0f2-4c44525a287b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:48.644881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b7354da-43fa-4614-8c55-d5e195eea239 req-d7a09b88-5138-426d-a0f2-4c44525a287b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5433 time: 0.3941720 May 12 15:16:48.653708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a386bb4b-53c2-4670-89e0-1bd0d229a109 req-6c52fbcb-4a93-4ec1-91e1-9b515fa54970 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:48.655123 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a386bb4b-53c2-4670-89e0-1bd0d229a109 req-6c52fbcb-4a93-4ec1-91e1-9b515fa54970 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.76 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 945 time: 0.4931099 May 12 15:16:48.663006 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8f23a31-e1b0-4469-9301-40b02c061c99 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:48.738383 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9c7821d-7013-4db0-965a-17183f4eb81c req-cbda0bfa-1e3f-4516-8f06-309c3f75664d tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:48.739877 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9c7821d-7013-4db0-965a-17183f4eb81c req-cbda0bfa-1e3f-4516-8f06-309c3f75664d tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.3386161 May 12 15:16:48.759269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8f23a31-e1b0-4469-9301-40b02c061c99 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:48.785612 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b7354da-43fa-4614-8c55-d5e195eea239 req-0ecc81f5-9cc6-4a5f-ba7e-3185cb7bfd3f tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1293116 May 12 15:16:48.809369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-a386bb4b-53c2-4670-89e0-1bd0d229a109 req-97376ff3-e221-4f86-8bb9-b4b20ea26155 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Deleting port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:16:48.809369 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a386bb4b-53c2-4670-89e0-1bd0d229a109 req-97376ff3-e221-4f86-8bb9-b4b20ea26155 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:48.810223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8f23a31-e1b0-4469-9301-40b02c061c99 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:48.816767 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d8f23a31-e1b0-4469-9301-40b02c061c99 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/ed7d4325-c4dc-4592-8d41-1f3fe41da585 HTTP/1.1" status: 204 len: 168 time: 0.5411453 May 12 15:16:48.822176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8f23a31-e1b0-4469-9301-40b02c061c99 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ed7d4325-c4dc-4592-8d41-1f3fe41da585,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:48.829149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55960) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:48.863850 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9c7821d-7013-4db0-965a-17183f4eb81c req-27a7b500-c2a4-4c85-8c45-ac09cef4124d tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1159298 May 12 15:16:49.083047 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e575646d-0a38-4292-a12b-bab5ac4d5de1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:49.216925 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e575646d-0a38-4292-a12b-bab5ac4d5de1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:49.243956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e575646d-0a38-4292-a12b-bab5ac4d5de1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e8211761-0dd9-424f-b732-629fd2d77e28']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:49.257768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-a386bb4b-53c2-4670-89e0-1bd0d229a109 req-97376ff3-e221-4f86-8bb9-b4b20ea26155 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] For port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=0a9596a5-4318-4dc7-ace0-c18b1ee4f359,segment=NetworkSegment(4d6939e6-0762-4f32-ab66-c216826b2cf3),segment_id=4d6939e6-0762-4f32-ab66-c216826b2cf3)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:49.258114 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a386bb4b-53c2-4670-89e0-1bd0d229a109 req-97376ff3-e221-4f86-8bb9-b4b20ea26155 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:49.258785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e575646d-0a38-4292-a12b-bab5ac4d5de1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '619405e4-e83d-45d8-8f13-c0a176ec94ed') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:49.258785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e575646d-0a38-4292-a12b-bab5ac4d5de1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '619405e4-e83d-45d8-8f13-c0a176ec94ed') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:49.271216 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e575646d-0a38-4292-a12b-bab5ac4d5de1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:49.293614 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e575646d-0a38-4292-a12b-bab5ac4d5de1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:49.301293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e575646d-0a38-4292-a12b-bab5ac4d5de1 admin admin] Releasing vlan 579 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:16:49.301860 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e575646d-0a38-4292-a12b-bab5ac4d5de1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: timer() May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:16:49.317075 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:16:49.348880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6b08a6-d63b-452c-ad3a-baac232a6fb3 req-fc2301e6-16eb-4538-b773-b63952918a17 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:49.355628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6b08a6-d63b-452c-ad3a-baac232a6fb3 req-fc2301e6-16eb-4538-b773-b63952918a17 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:49.361449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6b08a6-d63b-452c-ad3a-baac232a6fb3 req-fc2301e6-16eb-4538-b773-b63952918a17 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:49.367142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6b08a6-d63b-452c-ad3a-baac232a6fb3 req-fc2301e6-16eb-4538-b773-b63952918a17 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:49.372982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6b08a6-d63b-452c-ad3a-baac232a6fb3 req-fc2301e6-16eb-4538-b773-b63952918a17 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:49.378647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6b08a6-d63b-452c-ad3a-baac232a6fb3 req-fc2301e6-16eb-4538-b773-b63952918a17 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:49.385135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6b08a6-d63b-452c-ad3a-baac232a6fb3 req-fc2301e6-16eb-4538-b773-b63952918a17 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:49.387017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a6b08a6-d63b-452c-ad3a-baac232a6fb3 req-fc2301e6-16eb-4538-b773-b63952918a17 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5433 time: 0.3647325 May 12 15:16:49.401457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55974) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:49.407552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6413ae0f-b590-44eb-b336-1f903353ad8b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Request body: {'floatingip': {'port_id': '026a86ba-df92-4de2-9f16-6e6b8794d1df'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:49.463431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-a386bb4b-53c2-4670-89e0-1bd0d229a109 req-97376ff3-e221-4f86-8bb9-b4b20ea26155 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Calling delete_port for 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:16:49.466381 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e575646d-0a38-4292-a12b-bab5ac4d5de1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:49.509246 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e575646d-0a38-4292-a12b-bab5ac4d5de1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:49.514799 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6413ae0f-b590-44eb-b336-1f903353ad8b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for floatingip, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:49.636234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a40a2fe5-8d76-46cc-935b-edb58c4a0b3e req-77b3662d-1fb7-47e8-b844-ad8166f1b165 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:49.638204 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a40a2fe5-8d76-46cc-935b-edb58c4a0b3e req-77b3662d-1fb7-47e8-b844-ad8166f1b165 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 945 time: 0.6170266 May 12 15:16:49.671431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e575646d-0a38-4292-a12b-bab5ac4d5de1 admin admin] Pushing event deleted for resources: {'Network': ['ID=e8211761-0dd9-424f-b732-629fd2d77e28,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:49.698791 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e575646d-0a38-4292-a12b-bab5ac4d5de1 admin admin] 10.222.0.82 "DELETE /v2.0/networks/e8211761-0dd9-424f-b732-629fd2d77e28 HTTP/1.1" status: 204 len: 168 time: 0.8651791 May 12 15:16:49.699575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55980) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:49.853558 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a386bb4b-53c2-4670-89e0-1bd0d229a109 req-97376ff3-e221-4f86-8bb9-b4b20ea26155 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:49.865150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['0a9596a5-4318-4dc7-ace0-c18b1ee4f359'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:16:49.870914 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a40a2fe5-8d76-46cc-935b-edb58c4a0b3e req-77a71bb9-e5b8-4dd9-9c5c-b260e9446c77 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/security-groups?id=b520f0c2-32b3-4656-bbec-ee430aa330d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2083743 May 12 15:16:49.877928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-19af3f40-5b34-4de0-9207-0140062259c6 admin admin] Deleting subnet 361dca53-0db0-4571-81ea-2e9c24261de5 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:16:49.901746 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19af3f40-5b34-4de0-9207-0140062259c6 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:49.954638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97376ff3-e221-4f86-8bb9-b4b20ea26155 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Pushing event deleted for resources: {'Port': ['ID=0a9596a5-4318-4dc7-ace0-c18b1ee4f359,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:49.970177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e8f434eb-a33e-4dbf-9caa-507751f8b4f0 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:50.047629 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19af3f40-5b34-4de0-9207-0140062259c6 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:50.049691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-a386bb4b-53c2-4670-89e0-1bd0d229a109 req-97376ff3-e221-4f86-8bb9-b4b20ea26155 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] No DVR routers for this DVR port 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:16:50.052599 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a386bb4b-53c2-4670-89e0-1bd0d229a109 req-97376ff3-e221-4f86-8bb9-b4b20ea26155 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:50.064832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5634d60a-5a37-486a-b1f1-6c8de07fa45b req-a2a54e4f-4fcc-4d0d-84e3-60c02c6801da tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:50.073568 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5634d60a-5a37-486a-b1f1-6c8de07fa45b req-a2a54e4f-4fcc-4d0d-84e3-60c02c6801da tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.5190740 May 12 15:16:50.093519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port e8f434eb-a33e-4dbf-9caa-507751f8b4f0 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:50.100119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port e8f434eb-a33e-4dbf-9caa-507751f8b4f0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:50.101141 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:50.145567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e8edf139-ac47-4665-b440-955365fe722e', 'name': 'network-vif-deleted', 'tag': '0a9596a5-4318-4dc7-ace0-c18b1ee4f359'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:50.218183 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19af3f40-5b34-4de0-9207-0140062259c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:50.229208 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5634d60a-5a37-486a-b1f1-6c8de07fa45b req-caa6f8ff-5e2b-4ee1-a511-48ab2d5f4111 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1536531 May 12 15:16:50.231679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a386bb4b-53c2-4670-89e0-1bd0d229a109 req-97376ff3-e221-4f86-8bb9-b4b20ea26155 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.76 "DELETE /v2.0/ports/0a9596a5-4318-4dc7-ace0-c18b1ee4f359 HTTP/1.1" status: 204 len: 173 time: 1.5693610 May 12 15:16:50.292147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a2bf456-385c-43f5-b359-2223a684d5b0 req-64977bd1-6982-4152-b87a-5e0899420688 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:50.293600 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a2bf456-385c-43f5-b359-2223a684d5b0 req-64977bd1-6982-4152-b87a-5e0899420688 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=fdcb764b-85e6-4151-a350-f4cf9fe6096f HTTP/1.1" status: 200 len: 944 time: 0.1985281 May 12 15:16:50.296185 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:50.350592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e8f434eb-a33e-4dbf-9caa-507751f8b4f0, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8f434eb-a33e-4dbf-9caa-507751f8b4f0,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:50.353368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd4b93c53-ecd2-43df-9024-d05649800b6e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8f434eb-a33e-4dbf-9caa-507751f8b4f0'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:50.365893 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:50.367370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:16:50.391422 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19af3f40-5b34-4de0-9207-0140062259c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:50.408291 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a2bf456-385c-43f5-b359-2223a684d5b0 req-71b07c21-d77b-4c3a-bf1b-93f732cc2a61 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0982077 May 12 15:16:50.523690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:16:50.524681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 0a9596a5-4318-4dc7-ace0-c18b1ee4f359 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:16:50.526275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=e8f434eb-a33e-4dbf-9caa-507751f8b4f0,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:50.553168 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e314efac-9bf4-43ec-ac3e-084435f91e0c'] response: {'server_uuid': 'e8edf139-ac47-4665-b440-955365fe722e', 'name': 'network-vif-deleted', 'tag': '0a9596a5-4318-4dc7-ace0-c18b1ee4f359', 'status': 'completed', 'code': 200} May 12 15:16:50.656927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d5cc533-327a-4de3-b51a-762f00a3b3b3 req-eb16ffe4-9643-4d4b-ac26-9c02ca07ff74 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:50.665037 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d5cc533-327a-4de3-b51a-762f00a3b3b3 req-eb16ffe4-9643-4d4b-ac26-9c02ca07ff74 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.1822598 May 12 15:16:50.701636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 137ebbec-a1f6-422a-850e-d348c38613a1 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:16:50.745851 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d5cc533-327a-4de3-b51a-762f00a3b3b3 req-88b2cd21-b71e-4717-b0a6-c508d67a069e tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797694 May 12 15:16:50.797372 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6f493fce-c0ca-44a0-b647-88e965915a53'] response: {'server_uuid': 'd4b93c53-ecd2-43df-9024-d05649800b6e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8f434eb-a33e-4dbf-9caa-507751f8b4f0', 'code': 200} May 12 15:16:50.845411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 137ebbec-a1f6-422a-850e-d348c38613a1 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:16:50.869073 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19af3f40-5b34-4de0-9207-0140062259c6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=361dca53-0db0-4571-81ea-2e9c24261de5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:50.878241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 137ebbec-a1f6-422a-850e-d348c38613a1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:16:50.878703 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:50.940718 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19af3f40-5b34-4de0-9207-0140062259c6 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:50.953046 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-19af3f40-5b34-4de0-9207-0140062259c6 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/361dca53-0db0-4571-81ea-2e9c24261de5 HTTP/1.1" status: 204 len: 168 time: 1.2524488 May 12 15:16:50.956601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56002) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:51.066102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30ee22bb-57e2-4d18-a662-44601197937f req-24f12765-4ca1-4599-84b0-63778f341695 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:51.078886 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30ee22bb-57e2-4d18-a662-44601197937f req-24f12765-4ca1-4599-84b0-63778f341695 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=d4b93c53-ecd2-43df-9024-d05649800b6e HTTP/1.1" status: 200 len: 1096 time: 0.2028346 May 12 15:16:51.097500 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6413ae0f-b590-44eb-b336-1f903353ad8b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:51.112790 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6413ae0f-b590-44eb-b336-1f903353ad8b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:51.144683 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:51.189918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 137ebbec-a1f6-422a-850e-d348c38613a1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=137ebbec-a1f6-422a-850e-d348c38613a1,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:51.203313 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:51.315682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-85b76b80-cfa6-47cb-96e3-d5744185f38c req-735bdec4-6f31-4ec4-8786-766ef7aa03a2 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Synchronizing usage tracker for tenant:0221a2702f9c420a9143d37995213f9d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:51.398308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=137ebbec-a1f6-422a-850e-d348c38613a1,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:51.406789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30ee22bb-57e2-4d18-a662-44601197937f req-7c9da409-daa3-42de-ba23-ac057ac3f70f service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3184707 May 12 15:16:51.410498 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-6413ae0f-b590-44eb-b336-1f903353ad8b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Floating IP dfa393cb-fc56-4e68-84b5-0cc2616fa159 associated. External IP: 172.25.8.64, port: 026a86ba-df92-4de2-9f16-6e6b8794d1df. May 12 15:16:51.414871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-85b76b80-cfa6-47cb-96e3-d5744185f38c req-735bdec4-6f31-4ec4-8786-766ef7aa03a2 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] Unset dirty status for tenant:0221a2702f9c420a9143d37995213f9d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:51.416817 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85b76b80-cfa6-47cb-96e3-d5744185f38c req-735bdec4-6f31-4ec4-8786-766ef7aa03a2 tempest-ServerTagsTestJSON-1407352129 tempest-ServerTagsTestJSON-1407352129-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8edf139-ac47-4665-b440-955365fe722e HTTP/1.1" status: 200 len: 210 time: 0.2245138 May 12 15:16:51.475155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e71f371e-1dd3-490f-b6af-15715f401ef1 req-eef8fad2-e406-49c2-9873-b5cdfc6726ae tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:51.476102 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c934e3f5-2e5f-47f6-9c1e-c5cf2f5f9997 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:51.482706 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e71f371e-1dd3-490f-b6af-15715f401ef1 req-eef8fad2-e406-49c2-9873-b5cdfc6726ae tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.1555288 May 12 15:16:51.544503 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e71f371e-1dd3-490f-b6af-15715f401ef1 req-dadf7a0b-fe86-4104-b82c-46f221ad8df8 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606980 May 12 15:16:51.636897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d805793-4167-4b3f-9903-33b4b7105ecc req-c8fad256-80ba-41e6-a4f0-cac972e07723 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:51.638531 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d805793-4167-4b3f-9903-33b4b7105ecc req-c8fad256-80ba-41e6-a4f0-cac972e07723 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=fdcb764b-85e6-4151-a350-f4cf9fe6096f HTTP/1.1" status: 200 len: 945 time: 0.0839603 May 12 15:16:51.691937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d805793-4167-4b3f-9903-33b4b7105ecc req-5782bc23-a2cf-4b70-a095-aeccd509c6e0 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438175 May 12 15:16:51.727889 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c934e3f5-2e5f-47f6-9c1e-c5cf2f5f9997 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:51.855879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-c934e3f5-2e5f-47f6-9c1e-c5cf2f5f9997 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cbad95e3-1420-461b-8eca-a2f4771201e7']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:51.882350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-c934e3f5-2e5f-47f6-9c1e-c5cf2f5f9997 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5188e866-f311-4b2f-8076-1c31b8762965') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:51.882646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-c934e3f5-2e5f-47f6-9c1e-c5cf2f5f9997 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5188e866-f311-4b2f-8076-1c31b8762965') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:51.980779 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c934e3f5-2e5f-47f6-9c1e-c5cf2f5f9997 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:52.018955 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c934e3f5-2e5f-47f6-9c1e-c5cf2f5f9997 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:52.036200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687e2118-0e90-43c6-aa32-81479148f9b7 req-a643444b-4ed3-414a-8517-1a381fe24f91 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:52.036491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c934e3f5-2e5f-47f6-9c1e-c5cf2f5f9997 admin admin] Releasing vlan 593 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:16:52.037161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c934e3f5-2e5f-47f6-9c1e-c5cf2f5f9997 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:52.038613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-687e2118-0e90-43c6-aa32-81479148f9b7 req-a643444b-4ed3-414a-8517-1a381fe24f91 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.1225898 May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: timer() May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:16:52.054931 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:16:52.104821 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-687e2118-0e90-43c6-aa32-81479148f9b7 req-80140322-127c-4342-92fa-9a7188cc4199 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0588293 May 12 15:16:52.156021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6413ae0f-b590-44eb-b336-1f903353ad8b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Router 82fdce0c-213a-480d-a72d-d6fec22a5428 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:16:52.238203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c934e3f5-2e5f-47f6-9c1e-c5cf2f5f9997 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:52.266882 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c934e3f5-2e5f-47f6-9c1e-c5cf2f5f9997 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:52.295640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c934e3f5-2e5f-47f6-9c1e-c5cf2f5f9997 admin admin] Pushing event deleted for resources: {'Network': ['ID=cbad95e3-1420-461b-8eca-a2f4771201e7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:52.301880 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c934e3f5-2e5f-47f6-9c1e-c5cf2f5f9997 admin admin] 10.222.0.82 "DELETE /v2.0/networks/cbad95e3-1420-461b-8eca-a2f4771201e7 HTTP/1.1" status: 204 len: 168 time: 1.3389316 May 12 15:16:52.435465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6413ae0f-b590-44eb-b336-1f903353ad8b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:16:52.441368 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6413ae0f-b590-44eb-b336-1f903353ad8b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:52.448921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-baa597af-49d7-4808-a61b-98e1f327855c None None] Sync routers for ids ['82fdce0c-213a-480d-a72d-d6fec22a5428'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:16:52.463363 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-baa597af-49d7-4808-a61b-98e1f327855c None None] Routers {'82fdce0c-213a-480d-a72d-d6fec22a5428'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:16:52.464422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-baa597af-49d7-4808-a61b-98e1f327855c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:16:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['82fdce0c-213a-480d-a72d-d6fec22a5428'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:52.538219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56018) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:52.545349 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6413ae0f-b590-44eb-b336-1f903353ad8b tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "PUT /v2.0/floatingips/dfa393cb-fc56-4e68-84b5-0cc2616fa159 HTTP/1.1" status: 200 len: 990 time: 3.1421292 May 12 15:16:52.553907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': '026a86ba-df92-4de2-9f16-6e6b8794d1df'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:52.620397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56028) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:52.676853 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1f9f3975-76a4-41ee-8c91-6cc65a3693b1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=68c66ae0cd45476b87e2e79625b80f69&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1366308 May 12 15:16:52.677716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56032) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:52.817002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdcb764b-85e6-4151-a350-f4cf9fe6096f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '137ebbec-a1f6-422a-850e-d348c38613a1'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:16:52.895980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-baa597af-49d7-4808-a61b-98e1f327855c None None] Set router 82fdce0c-213a-480d-a72d-d6fec22a5428 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:16:52.996375 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2bbd6514-13ba-46e6-9f4a-837ef121d3f3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:53.019550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-575c25d1-0f75-4828-8cd3-1721781b221a admin admin] Deleting subnet 445d4ea4-9d5e-46f7-a0d1-71a9c4f87159 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:16:53.026466 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2bbd6514-13ba-46e6-9f4a-837ef121d3f3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:53.026935 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0ac9472f-7f6d-49ab-8e9d-7cb06324a916'] response: {'name': 'network-changed', 'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'tag': '026a86ba-df92-4de2-9f16-6e6b8794d1df', 'status': 'completed', 'code': 200} May 12 15:16:53.027827 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-575c25d1-0f75-4828-8cd3-1721781b221a admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:53.099236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bff90a7-c533-4304-bb39-34149aa5af4e req-00d3a0e0-3d39-4597-9188-7b38a5f50eba tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:53.107238 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8bff90a7-c533-4304-bb39-34149aa5af4e req-00d3a0e0-3d39-4597-9188-7b38a5f50eba tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.3796360 May 12 15:16:53.143911 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2bbd6514-13ba-46e6-9f4a-837ef121d3f3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:53.168835 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-575c25d1-0f75-4828-8cd3-1721781b221a admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:53.175852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bbd6514-13ba-46e6-9f4a-837ef121d3f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=84fde8a0-0025-4028-a28e-5b3152f4f62d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:53.190944 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2bbd6514-13ba-46e6-9f4a-837ef121d3f3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:53.192249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2bbd6514-13ba-46e6-9f4a-837ef121d3f3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/84fde8a0-0025-4028-a28e-5b3152f4f62d HTTP/1.1" status: 204 len: 168 time: 0.5133615 May 12 15:16:53.230871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8bff90a7-c533-4304-bb39-34149aa5af4e req-47cabe5d-dad4-4062-a2ad-702107a8c3aa tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1227005 May 12 15:16:53.254863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-d871c3c8-5e3d-48ba-8a13-2b425c998258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:53.255345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-d871c3c8-5e3d-48ba-8a13-2b425c998258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:53.255826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-d871c3c8-5e3d-48ba-8a13-2b425c998258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:53.256369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-d871c3c8-5e3d-48ba-8a13-2b425c998258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:53.256829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-d871c3c8-5e3d-48ba-8a13-2b425c998258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:53.257281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-d871c3c8-5e3d-48ba-8a13-2b425c998258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:53.257774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-d871c3c8-5e3d-48ba-8a13-2b425c998258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:53.260286 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-d871c3c8-5e3d-48ba-8a13-2b425c998258 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=42581a8af83242e0bb61f84a30bd27a7&device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 6490 time: 0.2377787 May 12 15:16:53.298970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca84ae1c-651f-485c-a3fb-f96c225e5cb0 req-5e4a2242-cbf4-4586-8705-cf250d23454b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:53.302427 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-575c25d1-0f75-4828-8cd3-1721781b221a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:53.310067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca84ae1c-651f-485c-a3fb-f96c225e5cb0 req-5e4a2242-cbf4-4586-8705-cf250d23454b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=fdcb764b-85e6-4151-a350-f4cf9fe6096f HTTP/1.1" status: 200 len: 945 time: 0.3900058 May 12 15:16:53.421348 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca84ae1c-651f-485c-a3fb-f96c225e5cb0 req-b704b07a-0504-43a3-af02-c950b2b8e70d tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1103067 May 12 15:16:53.484099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-5a9a7897-dd85-46d7-916f-88645811d1a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:53.485932 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-5a9a7897-dd85-46d7-916f-88645811d1a1 service neutron] 10.222.0.84 "GET /v2.0/networks?id=939fdac4-3043-4213-bd31-a421a6c659bc HTTP/1.1" status: 200 len: 913 time: 0.2143044 May 12 15:16:53.490837 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-575c25d1-0f75-4828-8cd3-1721781b221a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:53.518903 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e5dbb813-1e3c-4102-bcb4-03e0381d635b'] response: {'server_uuid': 'fdcb764b-85e6-4151-a350-f4cf9fe6096f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '137ebbec-a1f6-422a-850e-d348c38613a1', 'code': 200} May 12 15:16:53.720834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-575c25d1-0f75-4828-8cd3-1721781b221a admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:53.726595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-575c25d1-0f75-4828-8cd3-1721781b221a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=445d4ea4-9d5e-46f7-a0d1-71a9c4f87159,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:53.753433 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-baa597af-49d7-4808-a61b-98e1f327855c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:14:06Z', 'revision_number': 4, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port': {'id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:0b:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_gateway', 'standard_attr_id': 981, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:52Z', 'updated_at': '2022-05-12T15:14:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'dfa393cb-fc56-4e68-84b5-0cc2616fa159', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'floating_ip_address': '172.25.8.64', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'port_id': '026a86ba-df92-4de2-9f16-6e6b8794d1df', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1031, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'mac_address': 'fa:16:3e:3a:da:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:15:06Z', 'updated_at': '2022-05-12T15:16:50Z', 'revision_number': 1, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '27d87447-eec9-4938-9dce-782d012459ac', 'name': '', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'mac_address': 'fa:16:3e:d6:d1:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_interface', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:03Z', 'updated_at': '2022-05-12T15:14:16Z', 'revision_number': 5, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'subnets': [{'id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:53.766045 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-baa597af-49d7-4808-a61b-98e1f327855c None None] Checking router: 82fdce0c-213a-480d-a72d-d6fec22a5428 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:16:53.775137 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-b2910470-a060-4d0a-91e1-a3b7a652d6f4 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=026a86ba-df92-4de2-9f16-6e6b8794d1df HTTP/1.1" status: 200 len: 998 time: 0.2778888 May 12 15:16:53.782931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34b547cc-dbfb-4c6c-b75d-bfda01a28139 req-fb0ad908-9661-4fc7-8ec3-7b3aec9a2ec8 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:53.784419 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34b547cc-dbfb-4c6c-b75d-bfda01a28139 req-fb0ad908-9661-4fc7-8ec3-7b3aec9a2ec8 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.1463678 May 12 15:16:53.790071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-baa597af-49d7-4808-a61b-98e1f327855c None None] Routers {'82fdce0c-213a-480d-a72d-d6fec22a5428'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:16:53.790706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-baa597af-49d7-4808-a61b-98e1f327855c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:16:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['82fdce0c-213a-480d-a72d-d6fec22a5428'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:53.840814 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-575c25d1-0f75-4828-8cd3-1721781b221a admin admin] 10.222.0.82 "DELETE /v2.0/subnets/445d4ea4-9d5e-46f7-a0d1-71a9c4f87159 HTTP/1.1" status: 204 len: 168 time: 1.2188876 May 12 15:16:53.841880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56048) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:53.890086 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34b547cc-dbfb-4c6c-b75d-bfda01a28139 req-e726d995-1586-4975-9ce7-4649635329bd tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0914598 May 12 15:16:53.985513 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56054) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:54.006061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb24b616-8f5a-49f2-b3d5-e046dd2bd505 req-e8f9863f-703f-4d82-ac79-7d843b5367e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:54.007830 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-eb24b616-8f5a-49f2-b3d5-e046dd2bd505 req-e8f9863f-703f-4d82-ac79-7d843b5367e5 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=fdcb764b-85e6-4151-a350-f4cf9fe6096f HTTP/1.1" status: 200 len: 1096 time: 0.3639250 May 12 15:16:54.012163 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-153945a0-db54-47ac-aefb-6aa662dd88d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:54.017815 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-153945a0-db54-47ac-aefb-6aa662dd88d3 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c7af977d-fe6b-4182-af40-d4c2523b54a3 HTTP/1.1" status: 200 len: 851 time: 0.2316170 May 12 15:16:54.079161 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-73a49012-758f-45e5-98e6-f3665f73d53f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=385682058f81452b82f06eb277dee5eb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0919645 May 12 15:16:54.081320 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56058) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:54.124054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-baa597af-49d7-4808-a61b-98e1f327855c None None] Set router 82fdce0c-213a-480d-a72d-d6fec22a5428 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:16:54.132468 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad5b9843-1adb-40a3-8921-460e9a86d520 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:54.156853 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-eb24b616-8f5a-49f2-b3d5-e046dd2bd505 req-435738d1-e872-4125-9000-2be01d6d861e service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1380620 May 12 15:16:54.201694 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0ac30ebc-2519-4e05-9389-9ce43a9e6f72 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:54.268501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-dd3137de-caa1-44b5-8a14-51e921693cff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:54.269997 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-dd3137de-caa1-44b5-8a14-51e921693cff service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=939fdac4-3043-4213-bd31-a421a6c659bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2283859 May 12 15:16:54.279173 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0ac30ebc-2519-4e05-9389-9ce43a9e6f72 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:54.396923 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0ac30ebc-2519-4e05-9389-9ce43a9e6f72 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:54.404727 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad5b9843-1adb-40a3-8921-460e9a86d520 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:54.454135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ad5b9843-1adb-40a3-8921-460e9a86d520 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1d7499f3-5bbd-4f94-822c-977c4f67540a']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:54.473123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ad5b9843-1adb-40a3-8921-460e9a86d520 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4d6939e6-0762-4f32-ab66-c216826b2cf3') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:54.473621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ad5b9843-1adb-40a3-8921-460e9a86d520 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4d6939e6-0762-4f32-ab66-c216826b2cf3') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:54.489343 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad5b9843-1adb-40a3-8921-460e9a86d520 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:54.496242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ac30ebc-2519-4e05-9389-9ce43a9e6f72 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ca8979b-061c-40c5-93f2-1759fedb5d51,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:54.512223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad5b9843-1adb-40a3-8921-460e9a86d520 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:54.519871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ad5b9843-1adb-40a3-8921-460e9a86d520 admin admin] Releasing vlan 574 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:16:54.520274 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad5b9843-1adb-40a3-8921-460e9a86d520 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:54.521820 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0ac30ebc-2519-4e05-9389-9ce43a9e6f72 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:54.524131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0ac30ebc-2519-4e05-9389-9ce43a9e6f72 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5ca8979b-061c-40c5-93f2-1759fedb5d51 HTTP/1.1" status: 204 len: 168 time: 0.4405861 May 12 15:16:54.531593 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-3314b4b8-2a78-4e27-8365-6b60d48571e5 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Synchronizing usage tracker for tenant:60b7c456959149269dc444554ba6a6c2 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:54.586361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ffb8311-3106-4997-9ed6-18ecc4611710 req-5f0e9117-32e0-4d96-bf7f-fb365acecfe9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:54.593590 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ffb8311-3106-4997-9ed6-18ecc4611710 req-5f0e9117-32e0-4d96-bf7f-fb365acecfe9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.1389482 May 12 15:16:54.619911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-3314b4b8-2a78-4e27-8365-6b60d48571e5 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Unset dirty status for tenant:60b7c456959149269dc444554ba6a6c2 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:54.627779 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-3314b4b8-2a78-4e27-8365-6b60d48571e5 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--495028888&fields=id&tenant_id=60b7c456959149269dc444554ba6a6c2 HTTP/1.1" status: 200 len: 267 time: 0.2157016 May 12 15:16:54.660722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ffb8311-3106-4997-9ed6-18ecc4611710 req-273a4023-1d3b-466a-816f-ca34b2eda3f1 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0660837 May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: timer() May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:16:54.691749 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:16:54.748087 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad5b9843-1adb-40a3-8921-460e9a86d520 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:54.755970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-baa597af-49d7-4808-a61b-98e1f327855c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:14:06Z', 'revision_number': 4, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port': {'id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:0b:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_gateway', 'standard_attr_id': 981, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:52Z', 'updated_at': '2022-05-12T15:14:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'dfa393cb-fc56-4e68-84b5-0cc2616fa159', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'floating_ip_address': '172.25.8.64', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'port_id': '026a86ba-df92-4de2-9f16-6e6b8794d1df', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1031, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'mac_address': 'fa:16:3e:3a:da:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:15:06Z', 'updated_at': '2022-05-12T15:16:50Z', 'revision_number': 1, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '27d87447-eec9-4938-9dce-782d012459ac', 'name': '', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'mac_address': 'fa:16:3e:d6:d1:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_interface', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:03Z', 'updated_at': '2022-05-12T15:14:16Z', 'revision_number': 5, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'subnets': [{'id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:16:54.772472 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-baa597af-49d7-4808-a61b-98e1f327855c None None] The sync data for ids ['82fdce0c-213a-480d-a72d-d6fec22a5428'] in n-d-841483-1 is: [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:14:06Z', 'revision_number': 4, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port': {'id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:0b:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_gateway', 'standard_attr_id': 981, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:52Z', 'updated_at': '2022-05-12T15:14:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'dfa393cb-fc56-4e68-84b5-0cc2616fa159', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'floating_ip_address': '172.25.8.64', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'port_id': '026a86ba-df92-4de2-9f16-6e6b8794d1df', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1031, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'mac_address': 'fa:16:3e:3a:da:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c486a19-424b-424e-985d-46ac71f03934', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:15:06Z', 'updated_at': '2022-05-12T15:16:50Z', 'revision_number': 1, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '27d87447-eec9-4938-9dce-782d012459ac', 'name': '', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'mac_address': 'fa:16:3e:d6:d1:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_interface', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:03Z', 'updated_at': '2022-05-12T15:14:16Z', 'revision_number': 5, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'subnets': [{'id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:16:54.801575 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:16:54.838514 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad5b9843-1adb-40a3-8921-460e9a86d520 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:54.880416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad5b9843-1adb-40a3-8921-460e9a86d520 admin admin] Pushing event deleted for resources: {'Network': ['ID=1d7499f3-5bbd-4f94-822c-977c4f67540a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:54.886278 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ad5b9843-1adb-40a3-8921-460e9a86d520 admin admin] 10.222.0.82 "DELETE /v2.0/networks/1d7499f3-5bbd-4f94-822c-977c4f67540a HTTP/1.1" status: 204 len: 168 time: 1.0388837 May 12 15:16:54.975042 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-2f1a9ebf-d625-4dd8-bdb5-ef99cf1b6b8a service neutron] 10.222.0.84 "GET /v2.0/networks/939fdac4-3043-4213-bd31-a421a6c659bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2822742 May 12 15:16:55.078594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-e5b192f2-9860-4a58-b57e-5b6b691b0237 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:55.079467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-e5b192f2-9860-4a58-b57e-5b6b691b0237 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Synchronizing usage tracker for tenant:60b7c456959149269dc444554ba6a6c2 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:55.116666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9759dfc7-90fb-4f1d-9bf9-bbb313a1b998 req-2fa332ad-a873-46a1-971a-7dee1c2fc483 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:55.120154 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9759dfc7-90fb-4f1d-9bf9-bbb313a1b998 req-2fa332ad-a873-46a1-971a-7dee1c2fc483 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=fdcb764b-85e6-4151-a350-f4cf9fe6096f HTTP/1.1" status: 200 len: 945 time: 0.2350469 May 12 15:16:55.137084 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-137de27b-799b-43b9-98a5-8445acc1beac None None] New status for floating IP dfa393cb-fc56-4e68-84b5-0cc2616fa159: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:16:55.279113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56082) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:55.325133 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59d21931-229c-4a0e-bb03-58dd95a9c830 req-3d54a20d-e1e1-41b3-9567-1ef327e704fb service neutron] 10.222.0.84 "GET /v2.0/networks/939fdac4-3043-4213-bd31-a421a6c659bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3334997 May 12 15:16:55.337956 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9759dfc7-90fb-4f1d-9bf9-bbb313a1b998 req-8b6488a8-1591-4c78-97da-d1e346a9bdef tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2001998 May 12 15:16:55.339470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-e5b192f2-9860-4a58-b57e-5b6b691b0237 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Unset dirty status for tenant:60b7c456959149269dc444554ba6a6c2 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:55.350763 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-e5b192f2-9860-4a58-b57e-5b6b691b0237 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/networks?id=944a3072-30fa-47bc-9620-9dfd43f531e1 HTTP/1.1" status: 200 len: 815 time: 0.7184424 May 12 15:16:55.361129 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-20fa5525-6319-4fd1-9acb-14e388beca95 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/quotas/60b7c456959149269dc444554ba6a6c2 HTTP/1.1" status: 200 len: 375 time: 0.0129011 May 12 15:16:55.379881 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3dcbbe82-bfd2-4ccc-9915-971435e09ac6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0221a2702f9c420a9143d37995213f9d&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0993462 May 12 15:16:55.382763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56086) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:55.634534 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-24b00327-1fba-4b12-ae90-b572b1f04b81 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=60b7c456959149269dc444554ba6a6c2&fields=id HTTP/1.1" status: 200 len: 348 time: 0.2631664 May 12 15:16:55.706482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-18272d63-a477-4ada-9b8d-efb120f64660 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:55.747020 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-18272d63-a477-4ada-9b8d-efb120f64660 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:55.807816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f79290d-6a7b-4bd9-8288-8af47e2b5329 req-b99e32de-6af2-495c-be51-a94e6d5d2ce9 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:55.815392 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4f79290d-6a7b-4bd9-8288-8af47e2b5329 req-b99e32de-6af2-495c-be51-a94e6d5d2ce9 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.1683419 May 12 15:16:55.845663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-18272d63-a477-4ada-9b8d-efb120f64660 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:55.874958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18272d63-a477-4ada-9b8d-efb120f64660 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b520f0c2-32b3-4656-bbec-ee430aa330d2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:16:55.883959 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-18272d63-a477-4ada-9b8d-efb120f64660 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:55.885239 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-18272d63-a477-4ada-9b8d-efb120f64660 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b520f0c2-32b3-4656-bbec-ee430aa330d2 HTTP/1.1" status: 204 len: 168 time: 0.4998472 May 12 15:16:55.916647 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4f79290d-6a7b-4bd9-8288-8af47e2b5329 req-e8485b93-c5f7-4ee1-865a-ea80aca9d3d7 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0999086 May 12 15:16:56.253273 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-ec1f88c3-81ae-4612-b877-ac5fcc2c8f62 service neutron] 10.222.0.82 "GET /v2.0/networks/944a3072-30fa-47bc-9620-9dfd43f531e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5347898 May 12 15:16:56.256292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12dacbf7-147c-4841-bead-f24e6e75139a req-14b4dfc8-ffc4-4765-ac1d-adb6ce083bd6 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:56.270492 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12dacbf7-147c-4841-bead-f24e6e75139a req-14b4dfc8-ffc4-4765-ac1d-adb6ce083bd6 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.1828470 May 12 15:16:56.421225 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12dacbf7-147c-4841-bead-f24e6e75139a req-88304180-d33f-49bf-8ce5-9416acb2b3c9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1460488 May 12 15:16:56.481921 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1ef1d3c-b8d1-4533-85c3-337ef7a06181 service neutron] 10.222.0.82 "GET /v2.0/networks/944a3072-30fa-47bc-9620-9dfd43f531e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1836379 May 12 15:16:56.659291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0ff1ca1-a083-4d17-90ca-6fc4b51445d6 req-d06f6f00-4697-49d3-86b2-f24e9970462b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:56.661106 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0ff1ca1-a083-4d17-90ca-6fc4b51445d6 req-d06f6f00-4697-49d3-86b2-f24e9970462b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=fdcb764b-85e6-4151-a350-f4cf9fe6096f HTTP/1.1" status: 200 len: 945 time: 0.0990229 May 12 15:16:56.726822 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0ff1ca1-a083-4d17-90ca-6fc4b51445d6 req-00ace5ca-cf57-42bc-9642-94bb34d5ca88 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575860 May 12 15:16:56.969016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79bb1c6e-e406-4031-b996-eee143c9024b req-0a1dbc75-f9d1-4e9c-b1d7-8d8816767d12 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:56.972103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-79bb1c6e-e406-4031-b996-eee143c9024b req-0a1dbc75-f9d1-4e9c-b1d7-8d8816767d12 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4b93c53-ecd2-43df-9024-d05649800b6e HTTP/1.1" status: 200 len: 945 time: 0.1189604 May 12 15:16:57.046653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f20dcabf-394a-47f9-bd8f-13af3ab87eb4 req-1d357e45-78e4-4cce-9f2b-6bcdff6a780b tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 210 time: 0.0731766 May 12 15:16:57.077889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-79bb1c6e-e406-4031-b996-eee143c9024b req-1c8b908f-9d17-412c-8432-f96c0abe0094 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620241 May 12 15:16:57.438744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dc31864-4e15-466b-9560-b07cb096217c req-fd9da573-7835-458c-8510-f6eb30c52479 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:57.441022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9dc31864-4e15-466b-9560-b07cb096217c req-fd9da573-7835-458c-8510-f6eb30c52479 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.2371974 May 12 15:16:57.494111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9dc31864-4e15-466b-9560-b07cb096217c req-d12e7a51-f143-48c1-8010-8f895d624fa6 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452249 May 12 15:16:57.725695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ccbe74a-0236-4154-a1c5-c7eb2fdf5caf req-662bff8f-d895-47fe-80a6-cc618fd90841 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:57.727446 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ccbe74a-0236-4154-a1c5-c7eb2fdf5caf req-662bff8f-d895-47fe-80a6-cc618fd90841 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.1106846 May 12 15:16:57.793034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ccbe74a-0236-4154-a1c5-c7eb2fdf5caf req-622d58af-09f5-4b01-8886-0c51985531d5 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574739 May 12 15:16:57.996832 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-0a86e9b4-0377-4ff6-a65d-e549a1bf0c46 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=4e05bf2d5a814ea6880baa36c838e794&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0831370 May 12 15:16:58.189687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-e58ec00a-a150-4915-9cda-ae5e78b56f93 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:58.189961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-e58ec00a-a150-4915-9cda-ae5e78b56f93 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/networks?id=8c326986-914c-4d15-83ee-665daa53b37e HTTP/1.1" status: 200 len: 813 time: 0.2984667 May 12 15:16:58.249606 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-508f5736-f2e2-4806-aa71-1c681ac8711c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/quotas/d6a33151cf37459889a9facebe6ff6fd HTTP/1.1" status: 200 len: 375 time: 0.0524690 May 12 15:16:58.350570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-80298f22-08b8-41b9-b112-c087d3235c6d tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:58.352483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-80298f22-08b8-41b9-b112-c087d3235c6d tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3423049 May 12 15:16:58.393532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-b7ef6946-c178-4278-9aab-ceae14303d89 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/quotas/4e05bf2d5a814ea6880baa36c838e794 HTTP/1.1" status: 200 len: 375 time: 0.0270514 May 12 15:16:58.593540 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-21853bcd-a79b-482e-bc95-6d567d0d4715 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4e05bf2d5a814ea6880baa36c838e794&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1845303 May 12 15:16:58.628108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-b09d54d9-8be0-44a4-bc40-19c37ab649b8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:58.628108 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-b09d54d9-8be0-44a4-bc40-19c37ab649b8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.76 "GET /v2.0/networks?id=944a3072-30fa-47bc-9620-9dfd43f531e1 HTTP/1.1" status: 200 len: 815 time: 0.4223146 May 12 15:16:58.644180 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-636e462c-8884-4cf3-86be-2ffd039a17ff tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=d6a33151cf37459889a9facebe6ff6fd&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3936720 May 12 15:16:58.882593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-4f546116-4db0-4008-8b1f-34d0bf17a6bd tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=60b7c456959149269dc444554ba6a6c2 HTTP/1.1" status: 200 len: 379 time: 0.2363303 May 12 15:16:58.910550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Request body: {'port': {'device_id': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'admin_state_up': True, 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'security_groups': ['68ef6c87-3499-4eee-a9ec-ab87d41c4f8b']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:16:59.170420 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e28f3b2e-fe7b-4c5c-b643-4139cdf9765f req-a7e728e3-f15b-46e7-bc17-b63c97ccc1c3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 210 time: 0.1104193 May 12 15:16:59.370966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56222) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:16:59.393546 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-abe78962-2285-4f19-8244-1449653425f4 service neutron] 10.222.0.82 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7468305 May 12 15:16:59.480939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b159a0d2-bb8f-474a-ab8f-c9ed3e82882e req-95c2f2fd-05fd-4fd4-97dc-85ef0d9f5239 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:59.481708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b159a0d2-bb8f-474a-ab8f-c9ed3e82882e req-95c2f2fd-05fd-4fd4-97dc-85ef0d9f5239 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Synchronizing usage tracker for tenant:d6a33151cf37459889a9facebe6ff6fd on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:16:59.503993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b159a0d2-bb8f-474a-ab8f-c9ed3e82882e req-95c2f2fd-05fd-4fd4-97dc-85ef0d9f5239 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Unset dirty status for tenant:d6a33151cf37459889a9facebe6ff6fd on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:16:59.506210 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b159a0d2-bb8f-474a-ab8f-c9ed3e82882e req-95c2f2fd-05fd-4fd4-97dc-85ef0d9f5239 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.84 "GET /v2.0/ports?device_id=fdcb764b-85e6-4151-a350-f4cf9fe6096f HTTP/1.1" status: 200 len: 945 time: 0.1898088 May 12 15:16:59.536912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e791d3e9-7d40-47e1-a65c-4af66db7ed5d req-31a72e85-cbdd-46a7-95f5-6ee2ec86bb7b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:16:59.538431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e791d3e9-7d40-47e1-a65c-4af66db7ed5d req-31a72e85-cbdd-46a7-95f5-6ee2ec86bb7b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.76 "GET /v2.0/ports?device_id=d4b93c53-ecd2-43df-9024-d05649800b6e HTTP/1.1" status: 200 len: 945 time: 0.7787807 May 12 15:16:59.541038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:59.600403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-b159a0d2-bb8f-474a-ab8f-c9ed3e82882e req-0e4b148e-57bb-4c5e-8fd8-54cc35244d3c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Deleting port 137ebbec-a1f6-422a-850e-d348c38613a1 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:16:59.600994 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b159a0d2-bb8f-474a-ab8f-c9ed3e82882e req-0e4b148e-57bb-4c5e-8fd8-54cc35244d3c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:59.635269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Usage tracker for resource:port and tenant:60b7c456959149269dc444554ba6a6c2 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:59.668640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:59.701974 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e5e3116-e47d-4fa3-8ceb-d5227eb1f073 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:59.719328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:59.730319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2e5e3116-e47d-4fa3-8ceb-d5227eb1f073 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:16:59.734360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2e5e3116-e47d-4fa3-8ceb-d5227eb1f073 admin admin] Usage tracker for resource:security_group_rule and tenant:2eabf7e873134ab88b448951d052c1bf is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:16:59.737292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2e5e3116-e47d-4fa3-8ceb-d5227eb1f073 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:16:59.743973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2e5e3116-e47d-4fa3-8ceb-d5227eb1f073 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:16:59.800223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-e791d3e9-7d40-47e1-a65c-4af66db7ed5d req-b3d88c70-c924-45ce-b1df-3e51b39b7553 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Deleting port e8f434eb-a33e-4dbf-9caa-507751f8b4f0 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:16:59.800787 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e791d3e9-7d40-47e1-a65c-4af66db7ed5d req-b3d88c70-c924-45ce-b1df-3e51b39b7553 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:59.852681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Made reservation on behalf of 60b7c456959149269dc444554ba6a6c2 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:16:59.856088 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:59.922472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b159a0d2-bb8f-474a-ab8f-c9ed3e82882e req-0e4b148e-57bb-4c5e-8fd8-54cc35244d3c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] For port 137ebbec-a1f6-422a-850e-d348c38613a1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=137ebbec-a1f6-422a-850e-d348c38613a1,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:16:59.923074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b159a0d2-bb8f-474a-ab8f-c9ed3e82882e req-0e4b148e-57bb-4c5e-8fd8-54cc35244d3c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:16:59.984502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-28f440e3-7d4f-4caa-9e56-7eb99ab2ef5a service neutron] 10.222.0.82 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5707183 May 12 15:17:00.036771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c36bfaa-0378-4336-ad24-8aff5d24f6ca req-5dfa1b6e-dc23-4cd2-8529-1b69d6155a48 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:00.044221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c36bfaa-0378-4336-ad24-8aff5d24f6ca req-5dfa1b6e-dc23-4cd2-8529-1b69d6155a48 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.6366615 May 12 15:17:00.155650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-b159a0d2-bb8f-474a-ab8f-c9ed3e82882e req-0e4b148e-57bb-4c5e-8fd8-54cc35244d3c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Calling delete_port for 137ebbec-a1f6-422a-850e-d348c38613a1 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:17:00.298202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c36bfaa-0378-4336-ad24-8aff5d24f6ca req-e48df713-d10a-4fdd-9dab-1011e6cc6ab0 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2530200 May 12 15:17:00.372570 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-320f3245-f946-4a6c-b0ef-0d2a33c5dc73 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=4e05bf2d5a814ea6880baa36c838e794&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1110849 May 12 15:17:00.455310 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e5e3116-e47d-4fa3-8ceb-d5227eb1f073 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:00.501171 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e5e3116-e47d-4fa3-8ceb-d5227eb1f073 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:00.606904 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2e5e3116-e47d-4fa3-8ceb-d5227eb1f073 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2eabf7e873134ab88b448951d052c1bf&name=default HTTP/1.1" status: 200 len: 2983 time: 1.2072787 May 12 15:17:00.625195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56242) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:00.645119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-e791d3e9-7d40-47e1-a65c-4af66db7ed5d req-b3d88c70-c924-45ce-b1df-3e51b39b7553 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] For port e8f434eb-a33e-4dbf-9caa-507751f8b4f0, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8f434eb-a33e-4dbf-9caa-507751f8b4f0,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:00.646122 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e791d3e9-7d40-47e1-a65c-4af66db7ed5d req-b3d88c70-c924-45ce-b1df-3e51b39b7553 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:00.748175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab0543c5-660a-4a12-83bb-08b15b28dcf6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:00.790455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab0543c5-660a-4a12-83bb-08b15b28dcf6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:00.819729 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-887e8606-5aa5-477a-b798-f79dbed512aa req-30f65df9-0186-452b-92bb-6c1c10e526d6 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 210 time: 0.3286991 May 12 15:17:00.869679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-e791d3e9-7d40-47e1-a65c-4af66db7ed5d req-b3d88c70-c924-45ce-b1df-3e51b39b7553 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Calling delete_port for e8f434eb-a33e-4dbf-9caa-507751f8b4f0 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:17:00.906458 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab0543c5-660a-4a12-83bb-08b15b28dcf6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:00.962733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab0543c5-660a-4a12-83bb-08b15b28dcf6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e75165d-e84d-4610-8de5-1717e2cbde9e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:00.977819 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b159a0d2-bb8f-474a-ab8f-c9ed3e82882e req-0e4b148e-57bb-4c5e-8fd8-54cc35244d3c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:00.987088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-e20176b7-d788-4264-b659-0ab7e2faaf03 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:00.989131 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-e20176b7-d788-4264-b659-0ab7e2faaf03 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5866904 May 12 15:17:01.060063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Request body: {'port': {'device_id': '71f83a02-9762-4c31-8aff-f37bf97aa06b', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '4e05bf2d5a814ea6880baa36c838e794'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:01.102757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e4b148e-57bb-4c5e-8fd8-54cc35244d3c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Pushing event deleted for resources: {'Port': ['ID=137ebbec-a1f6-422a-850e-d348c38613a1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:01.147748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e5e3116-e47d-4fa3-8ceb-d5227eb1f073 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e75165d-e84d-4610-8de5-1717e2cbde9e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:01.247645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Allocated IP 172.20.0.6 (944a3072-30fa-47bc-9620-9dfd43f531e1/1972ca52-439b-4a99-be07-5a8a9346589c/d3bf5047-6e8a-4d30-bf27-76571b79026a) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:17:01.251554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3375f6e-1ac3-4aa4-aa68-124bbca2a517 req-80de6666-7e83-46a7-a832-bf9b68363476 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 210 time: 0.1050885 May 12 15:17:01.266711 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab0543c5-660a-4a12-83bb-08b15b28dcf6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:01.270178 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ab0543c5-660a-4a12-83bb-08b15b28dcf6 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5e75165d-e84d-4610-8de5-1717e2cbde9e HTTP/1.1" status: 204 len: 168 time: 0.6357503 May 12 15:17:01.270178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-b159a0d2-bb8f-474a-ab8f-c9ed3e82882e req-0e4b148e-57bb-4c5e-8fd8-54cc35244d3c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] No DVR routers for this DVR port 137ebbec-a1f6-422a-850e-d348c38613a1 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:17:01.295699 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b159a0d2-bb8f-474a-ab8f-c9ed3e82882e req-0e4b148e-57bb-4c5e-8fd8-54cc35244d3c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:01.301885 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b159a0d2-bb8f-474a-ab8f-c9ed3e82882e req-0e4b148e-57bb-4c5e-8fd8-54cc35244d3c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.84 "DELETE /v2.0/ports/137ebbec-a1f6-422a-850e-d348c38613a1 HTTP/1.1" status: 204 len: 173 time: 1.7901616 May 12 15:17:01.303318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdcb764b-85e6-4151-a350-f4cf9fe6096f', 'name': 'network-vif-deleted', 'tag': '137ebbec-a1f6-422a-850e-d348c38613a1'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:01.335590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-218c18be-3f59-4b53-9fdf-d4b6d142d1c6 req-de0644dd-117b-4e48-a583-a6728b9b0f19 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:01.345717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-218c18be-3f59-4b53-9fdf-d4b6d142d1c6 req-de0644dd-117b-4e48-a583-a6728b9b0f19 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.6112497 May 12 15:17:01.428271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:01.435766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Usage tracker for resource:port and tenant:4e05bf2d5a814ea6880baa36c838e794 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:01.442406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:01.458543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:01.490156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Made reservation on behalf of 4e05bf2d5a814ea6880baa36c838e794 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:17:01.498028 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:01.516938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:01.542610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:01.548047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Usage tracker for resource:security_group_rule and tenant:4e05bf2d5a814ea6880baa36c838e794 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:01.554728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:01.564477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:01.627571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-218c18be-3f59-4b53-9fdf-d4b6d142d1c6 req-609ef560-ee7d-443b-8f47-bb1674f7f215 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2827508 May 12 15:17:01.728668 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a6e8e445-a71d-45a5-b7cc-a2ea4e417adb'] response: {'server_uuid': 'fdcb764b-85e6-4151-a350-f4cf9fe6096f', 'name': 'network-vif-deleted', 'tag': '137ebbec-a1f6-422a-850e-d348c38613a1', 'status': 'completed', 'code': 200} May 12 15:17:01.734689 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e791d3e9-7d40-47e1-a65c-4af66db7ed5d req-b3d88c70-c924-45ce-b1df-3e51b39b7553 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:01.798097 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:01.806891 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:01.874195 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:01.884980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3d88c70-c924-45ce-b1df-3e51b39b7553 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Pushing event deleted for resources: {'Port': ['ID=e8f434eb-a33e-4dbf-9caa-507751f8b4f0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:01.921651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6b03284d-e876-4ec6-9035-8aded6b25eb3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:02.030219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e8f434eb-a33e-4dbf-9caa-507751f8b4f0 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:17:02.035502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9faf37f6-e3cb-4075-9aa4-dfcb0ce2a258 req-cf50e4be-da8e-4a1a-ba1e-01cfed7e7b98 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 210 time: 0.0772955 May 12 15:17:02.041513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Allocated IP 192.168.233.176 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/8ab2c56a-0051-490d-aebb-ad60abc4bb93) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:17:02.109313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: e8f434eb-a33e-4dbf-9caa-507751f8b4f0 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:17:02.109863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e8f434eb-a33e-4dbf-9caa-507751f8b4f0 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:17:02.123171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Transition to ACTIVE for port object d3bf5047-6e8a-4d30-bf27-76571b79026a will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:17:02.126324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-e791d3e9-7d40-47e1-a65c-4af66db7ed5d req-b3d88c70-c924-45ce-b1df-3e51b39b7553 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] No DVR routers for this DVR port e8f434eb-a33e-4dbf-9caa-507751f8b4f0 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:17:02.132268 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e791d3e9-7d40-47e1-a65c-4af66db7ed5d req-b3d88c70-c924-45ce-b1df-3e51b39b7553 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:02.134714 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:02.135854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd4b93c53-ecd2-43df-9024-d05649800b6e', 'name': 'network-vif-deleted', 'tag': 'e8f434eb-a33e-4dbf-9caa-507751f8b4f0'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:02.184990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e791d3e9-7d40-47e1-a65c-4af66db7ed5d req-b3d88c70-c924-45ce-b1df-3e51b39b7553 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.76 "DELETE /v2.0/ports/e8f434eb-a33e-4dbf-9caa-507751f8b4f0 HTTP/1.1" status: 204 len: 173 time: 2.6335919 May 12 15:17:02.204180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2806a8e3-a988-4d9b-a86e-882c4469440e req-3eba9f0f-a28b-4ec4-ac64-08bfec271515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:02.214437 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2806a8e3-a988-4d9b-a86e-882c4469440e req-3eba9f0f-a28b-4ec4-ac64-08bfec271515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 945 time: 0.3835080 May 12 15:17:02.299295 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-318f280b-4170-4cd7-8d05-21a3a80fc563 req-b1289158-7c7a-4a82-b962-654e89196f37 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 210 time: 0.0822437 May 12 15:17:02.318495 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:02.351337 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2806a8e3-a988-4d9b-a86e-882c4469440e req-ad8a7c7e-d9d5-44a0-a7e3-1bdde040a767 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1356082 May 12 15:17:02.436835 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-319dbbf1-1dad-4a3e-ae49-0cdf5e190586'] response: {'server_uuid': 'd4b93c53-ecd2-43df-9024-d05649800b6e', 'name': 'network-vif-deleted', 'tag': 'e8f434eb-a33e-4dbf-9caa-507751f8b4f0', 'status': 'completed', 'code': 200} May 12 15:17:02.527496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Network 944a3072-30fa-47bc-9620-9dfd43f531e1 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:17:02.531800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:17:02.556761 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:17:02.615108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Pushing event updated for resources: {'Port': ['ID=d3bf5047-6e8a-4d30-bf27-76571b79026a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:02.771542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:02.780468 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:02.783387 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 137ebbec-a1f6-422a-850e-d348c38613a1 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:17:02.858969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-b71ce0ac-a84b-40fb-a51c-7ed01b8d281a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:02.860700 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-b71ce0ac-a84b-40fb-a51c-7ed01b8d281a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.76 "GET /v2.0/networks?id=8c326986-914c-4d15-83ee-665daa53b37e HTTP/1.1" status: 200 len: 813 time: 0.7803538 May 12 15:17:02.877138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Request body: {'port': {'device_id': 'ab5ed14f-8344-46e1-b6e8-3bb09abee741', 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e', 'admin_state_up': True, 'tenant_id': 'd6a33151cf37459889a9facebe6ff6fd'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:02.892030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 137ebbec-a1f6-422a-850e-d348c38613a1 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:17:02.892377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 137ebbec-a1f6-422a-850e-d348c38613a1 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:17:02.908074 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d1c7c660-e965-4065-aff0-e10fb4c652d3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 4.0025954 May 12 15:17:02.935425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Request body: {'port': {'device_id': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:03.026755 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-551a7a5f-9ecb-4f51-b434-4f3fb7ffcdeb None None] Provisioning for port d3bf5047-6e8a-4d30-bf27-76571b79026a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:17:03.032134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-551a7a5f-9ecb-4f51-b434-4f3fb7ffcdeb None None] Provisioning complete for port d3bf5047-6e8a-4d30-bf27-76571b79026a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:17:03.033758 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-551a7a5f-9ecb-4f51-b434-4f3fb7ffcdeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:03.150501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-551a7a5f-9ecb-4f51-b434-4f3fb7ffcdeb None None] Port d3bf5047-6e8a-4d30-bf27-76571b79026a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:17:03.153491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecb55c97-82e1-424d-826e-f3dc0a11b6af req-b45c8a98-f70d-49ee-abb2-37b798082d63 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:03.154396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ecb55c97-82e1-424d-826e-f3dc0a11b6af req-b45c8a98-f70d-49ee-abb2-37b798082d63 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Synchronizing usage tracker for tenant:60b7c456959149269dc444554ba6a6c2 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:17:03.199083 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:03.243410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ecb55c97-82e1-424d-826e-f3dc0a11b6af req-b45c8a98-f70d-49ee-abb2-37b798082d63 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Unset dirty status for tenant:60b7c456959149269dc444554ba6a6c2 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:17:03.244835 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecb55c97-82e1-424d-826e-f3dc0a11b6af req-b45c8a98-f70d-49ee-abb2-37b798082d63 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 931 time: 0.5687530 May 12 15:17:03.283796 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:03.319335 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:03.349450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Usage tracker for resource:port and tenant:d6a33151cf37459889a9facebe6ff6fd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:03.363756 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:03.387606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-2a6c98f1-fb7d-4b45-a365-790fb70d4384 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:03.387744 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-2a6c98f1-fb7d-4b45-a365-790fb70d4384 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.84 "GET /v2.0/networks?id=8c326986-914c-4d15-83ee-665daa53b37e HTTP/1.1" status: 200 len: 813 time: 0.6883798 May 12 15:17:03.388999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:03.401798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Transition to ACTIVE for port object 8ab2c56a-0051-490d-aebb-ad60abc4bb93 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:17:03.409776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Request body: {'port': {'device_id': 'ca7efd55-1093-4424-8b8a-43e0eeface30', 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e', 'admin_state_up': True, 'tenant_id': 'd6a33151cf37459889a9facebe6ff6fd'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:03.441971 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecb55c97-82e1-424d-826e-f3dc0a11b6af req-57643535-4c75-45c3-95dc-32e5a925d39e tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1909814 May 12 15:17:03.511482 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7604b361-c3f3-4da4-b41d-76917c5ca675 req-34bef44e-5dbf-4831-af13-2b38196c4633 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:03.513137 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7604b361-c3f3-4da4-b41d-76917c5ca675 req-34bef44e-5dbf-4831-af13-2b38196c4633 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.2273283 May 12 15:17:03.527969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Made reservation on behalf of d6a33151cf37459889a9facebe6ff6fd for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:17:03.531373 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:03.642834 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7604b361-c3f3-4da4-b41d-76917c5ca675 req-51902198-98ca-4df1-8e53-ec4797bc90b4 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0803478 May 12 15:17:03.689728 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-035ef853-281c-44e3-8c45-8a630e98b092 req-0c13c940-3bee-46c1-ba78-ebddd98e28fb service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.6067271 May 12 15:17:03.720052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:03.749466 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:03.753170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Usage tracker for resource:port and tenant:d6a33151cf37459889a9facebe6ff6fd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:03.761660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:03.772418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d3bf5047-6e8a-4d30-bf27-76571b79026a {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:17:03.782109 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:03.808392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Transition to ACTIVE for port object d3bf5047-6e8a-4d30-bf27-76571b79026a will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:17:03.827243 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:03.879256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:03.971484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:17:03.983775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:17:03.992166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Made reservation on behalf of d6a33151cf37459889a9facebe6ff6fd for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:17:03.996183 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:04.006302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:17:04.034664 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c0f50665-5b0d-4723-ad87-6d08af238805 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:17:04.044084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Pushing event updated for resources: {'Port': ['ID=8ab2c56a-0051-490d-aebb-ad60abc4bb93,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:04.056886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Allocated IP 172.20.0.11 (8c326986-914c-4d15-83ee-665daa53b37e/bbf4de36-cca3-4e54-b76e-de177b2d73c3/6f3b6fed-1d08-415e-857d-eb8cff28711f) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:17:04.221953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ecd23ac9-c458-4e29-b795-593935a80401 req-6531abe6-c9ea-4570-a631-b8f6f576b57c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Synchronizing usage tracker for tenant:d6a33151cf37459889a9facebe6ff6fd on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:17:04.270367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c0f50665-5b0d-4723-ad87-6d08af238805, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c0f50665-5b0d-4723-ad87-6d08af238805,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:04.270950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:04.271609 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:04.293019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'c0f50665-5b0d-4723-ad87-6d08af238805', 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726', 'port_id': 'c0f50665-5b0d-4723-ad87-6d08af238805', 'mac_address': 'fa:16:3e:ac:96:8f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 587, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2c6ef05c-5190-47b2-bba9-0d2bdacd727d', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:17:04.362251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-035ef853-281c-44e3-8c45-8a630e98b092 req-3b91fb6c-5fff-4ed8-95cc-68a0885607a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:04.363759 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-035ef853-281c-44e3-8c45-8a630e98b092 req-3b91fb6c-5fff-4ed8-95cc-68a0885607a7 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=593ec496e5db4078be8dc940596be321&device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 1097 time: 0.4695468 May 12 15:17:04.372203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Pushing event updated for resources: {'Port': ['ID=d3bf5047-6e8a-4d30-bf27-76571b79026a,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:04.375450 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:04.394989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id c0f50665-5b0d-4723-ad87-6d08af238805 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:17:04.398322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ecd23ac9-c458-4e29-b795-593935a80401 req-6531abe6-c9ea-4570-a631-b8f6f576b57c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Unset dirty status for tenant:d6a33151cf37459889a9facebe6ff6fd on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:17:04.399647 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecd23ac9-c458-4e29-b795-593935a80401 req-6531abe6-c9ea-4570-a631-b8f6f576b57c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 210 time: 0.5082076 May 12 15:17:04.416804 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c0f50665-5b0d-4723-ad87-6d08af238805, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c0f50665-5b0d-4723-ad87-6d08af238805,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:04.424653 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:04.434118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c1ca6e0-4e74-41bc-b5d4-cf6524e680d3 req-9729f38e-02c9-46e2-9f6f-6e2aa6e5168b tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:04.435819 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1c1ca6e0-4e74-41bc-b5d4-cf6524e680d3 req-9729f38e-02c9-46e2-9f6f-6e2aa6e5168b tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 936 time: 0.3142715 May 12 15:17:04.459780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Attempting to bind port d3bf5047-6e8a-4d30-bf27-76571b79026a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:17:04.460107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Attempting to bind port d3bf5047-6e8a-4d30-bf27-76571b79026a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '51a763ab-4327-4303-92e7-963b2e4c87d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:17:04.460436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Attempting to bind port d3bf5047-6e8a-4d30-bf27-76571b79026a on network 944a3072-30fa-47bc-9620-9dfd43f531e1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:17:04.471708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Port d3bf5047-6e8a-4d30-bf27-76571b79026a on network 944a3072-30fa-47bc-9620-9dfd43f531e1 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:17:04.472034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Attempting to bind port d3bf5047-6e8a-4d30-bf27-76571b79026a on network 944a3072-30fa-47bc-9620-9dfd43f531e1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:17:04.480361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 17, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:17:04.480933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Checking segment: {'id': '51a763ab-4327-4303-92e7-963b2e4c87d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:17:04.481635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Bound using segment: {'id': '51a763ab-4327-4303-92e7-963b2e4c87d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:17:04.482427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Bound port: d3bf5047-6e8a-4d30-bf27-76571b79026a, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '51a763ab-4327-4303-92e7-963b2e4c87d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:17:04.483872 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:04.535004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c0f50665-5b0d-4723-ad87-6d08af238805,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:04.539991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c0f50665-5b0d-4723-ad87-6d08af238805'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:17:04.566226 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1c1ca6e0-4e74-41bc-b5d4-cf6524e680d3 req-6e75677f-767a-4fa7-90b5-d32708784bd5 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1225238 May 12 15:17:04.590819 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-3db0bc55-36a1-4fbc-b1c5-edb038e545b1 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 3.5440776 May 12 15:17:04.600356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Request body: {'port': {'device_id': '71f83a02-9762-4c31-8aff-f37bf97aa06b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:04.646723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] For port d3bf5047-6e8a-4d30-bf27-76571b79026a, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:17:04.650962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] For port d3bf5047-6e8a-4d30-bf27-76571b79026a, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d3bf5047-6e8a-4d30-bf27-76571b79026a,segment=NetworkSegment(51a763ab-4327-4303-92e7-963b2e4c87d0),segment_id=51a763ab-4327-4303-92e7-963b2e4c87d0)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:17:04.662159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:04.662667 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:04.663413 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:04.665839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:04.665839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:04.665839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:04.665839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:04.666200 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:04.666671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:04.667062 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:04.667441 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:04.667995 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:04.669067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:04.683990 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4ecd15dd-b119-4a90-8340-c083a5bca914 None None] Provisioning for port 8ab2c56a-0051-490d-aebb-ad60abc4bb93 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:17:04.699391 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4ecd15dd-b119-4a90-8340-c083a5bca914 None None] Provisioning complete for port 8ab2c56a-0051-490d-aebb-ad60abc4bb93 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:17:04.699767 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4ecd15dd-b119-4a90-8340-c083a5bca914 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:04.821794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:04.823518 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:04.827587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] 10.222.0.76 "PUT /v2.0/ports/d3bf5047-6e8a-4d30-bf27-76571b79026a HTTP/1.1" status: 200 len: 1091 time: 1.9099319 May 12 15:17:04.828293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'tag': 'd3bf5047-6e8a-4d30-bf27-76571b79026a'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:04.920469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4ecd15dd-b119-4a90-8340-c083a5bca914 None None] Port 8ab2c56a-0051-490d-aebb-ad60abc4bb93 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:17:05.045159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ac7ef2d-bbf9-410e-8134-223c5e362689 service neutron] Pushing event updated for resources: {'Port': ['ID=d3bf5047-6e8a-4d30-bf27-76571b79026a,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:05.073790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-035ef853-281c-44e3-8c45-8a630e98b092 req-b9f9a3db-772a-4166-922b-9d7b5552130d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:05.075244 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-035ef853-281c-44e3-8c45-8a630e98b092 req-b9f9a3db-772a-4166-922b-9d7b5552130d service neutron] 10.222.0.84 "GET /v2.0/networks?id=dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 200 len: 907 time: 0.6342759 May 12 15:17:05.104011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d046f3-e657-49b3-beea-0f37955bba29 req-7a12bc1b-09b3-49d3-a72b-8cbb05355f78 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:05.105569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2d046f3-e657-49b3-beea-0f37955bba29 req-7a12bc1b-09b3-49d3-a72b-8cbb05355f78 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 943 time: 0.3938637 May 12 15:17:05.150351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-c8baa454-aeb4-4386-ae8f-0337bbf63d1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:05.151832 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-c8baa454-aeb4-4386-ae8f-0337bbf63d1a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=60b7c456959149269dc444554ba6a6c2&device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 1094 time: 0.2533553 May 12 15:17:05.168303 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-035ef853-281c-44e3-8c45-8a630e98b092 req-ee4ec45e-9b35-4c13-b1b4-7ee3fa284647 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f0d25bc9-ee34-4065-92d8-0ccb85b91668 HTTP/1.1" status: 200 len: 217 time: 0.0826879 May 12 15:17:05.170845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3f1c2b6-de19-4149-9c6f-2af719f27e18 req-64421dd2-8b40-4455-90cf-a5bc47d09f00 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:05.171016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:05.172284 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3f1c2b6-de19-4149-9c6f-2af719f27e18 req-64421dd2-8b40-4455-90cf-a5bc47d09f00 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.2276862 May 12 15:17:05.177976 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:05.270772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-f326f4c1-0c83-41d4-8f22-a7b98c99a106 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=d3bf5047-6e8a-4d30-bf27-76571b79026a HTTP/1.1" status: 200 len: 217 time: 0.1093469 May 12 15:17:05.276933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2d046f3-e657-49b3-beea-0f37955bba29 req-703f5906-0ae4-40e4-a048-1ac8a96d0d41 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1637452 May 12 15:17:05.327454 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:05.358946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3f1c2b6-de19-4149-9c6f-2af719f27e18 req-ee55f389-16ea-4ba1-8cb5-87accc201361 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1284034 May 12 15:17:05.368084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-3e675f20-74c7-42cb-963a-d51879e744c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:05.370478 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-3e675f20-74c7-42cb-963a-d51879e744c5 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=1972ca52-439b-4a99-be07-5a8a9346589c HTTP/1.1" status: 200 len: 854 time: 0.0900598 May 12 15:17:05.450824 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4830dee4-f66b-4508-aecc-531c7c00a362'] response: {'name': 'network-changed', 'server_uuid': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'tag': 'd3bf5047-6e8a-4d30-bf27-76571b79026a', 'status': 'completed', 'code': 200} May 12 15:17:05.480028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-9785a8d3-ecb8-483f-bcc4-584768b6d98a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:05.481556 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-9785a8d3-ecb8-483f-bcc4-584768b6d98a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=944a3072-30fa-47bc-9620-9dfd43f531e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1044285 May 12 15:17:05.492977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-035ef853-281c-44e3-8c45-8a630e98b092 req-7beb85b4-25c9-4133-ba45-7563e2308210 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:05.494453 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-035ef853-281c-44e3-8c45-8a630e98b092 req-7beb85b4-25c9-4133-ba45-7563e2308210 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 200 len: 846 time: 0.3175449 May 12 15:17:05.522554 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Network 8c326986-914c-4d15-83ee-665daa53b37e is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:17:05.569911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:17:05.589336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:17:05.619205 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-035ef853-281c-44e3-8c45-8a630e98b092 req-b369f95e-0f1b-492e-b33a-8770b180e8c5 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbc2e49c-2591-4534-a48c-cea8e23115f4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1067765 May 12 15:17:05.738456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Allocated IP 172.20.0.9 (8c326986-914c-4d15-83ee-665daa53b37e/bbf4de36-cca3-4e54-b76e-de177b2d73c3/347edf1f-11b3-4ee3-8fb0-b951abe3dd4f) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:17:05.744152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Pushing event updated for resources: {'Port': ['ID=6f3b6fed-1d08-415e-857d-eb8cff28711f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:05.770447 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-2c9affd1-4d3f-402f-8d67-f10b225cb017 service neutron] 10.222.0.76 "GET /v2.0/networks/944a3072-30fa-47bc-9620-9dfd43f531e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2819276 May 12 15:17:05.857972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:05.859665 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:05.909514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4835bbe-47f0-4fa5-b398-e5b569b1654a req-8b5091a8-22f0-4c4f-9e50-fd6d19b11433 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:05.919370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d4835bbe-47f0-4fa5-b398-e5b569b1654a req-8b5091a8-22f0-4c4f-9e50-fd6d19b11433 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 932 time: 0.3461833 May 12 15:17:05.993637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56370) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:06.010117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616385c7-bef0-41f4-bf87-172051696480 req-c8903640-d472-4c3d-9487-77e9606c3169 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:06.010117 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-616385c7-bef0-41f4-bf87-172051696480 req-c8903640-d472-4c3d-9487-77e9606c3169 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 936 time: 0.2985654 May 12 15:17:06.026185 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1673de37-e6b3-4bcc-bce8-7f2cc551ee16 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.1454759 May 12 15:17:06.053240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Request body: {'port': {'device_id': 'ab5ed14f-8344-46e1-b6e8-3bb09abee741', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:06.078105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c0f50665-5b0d-4723-ad87-6d08af238805 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:17:06.099167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d4835bbe-47f0-4fa5-b398-e5b569b1654a req-e5e0ed4d-fea4-4fd2-9854-12d0284763dd tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1752262 May 12 15:17:06.204289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf60c74-d4ba-4a74-9ab8-ec00502c950b req-d6de614f-7af2-47f7-95bf-1b1a421be6b2 service neutron] 10.222.0.76 "GET /v2.0/networks/944a3072-30fa-47bc-9620-9dfd43f531e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4071064 May 12 15:17:06.243420 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port c0f50665-5b0d-4723-ad87-6d08af238805 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:17:06.243420 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:06.280187 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-616385c7-bef0-41f4-bf87-172051696480 req-c3cca2fe-4c96-4323-b8f9-a80ed83f37fb tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2574811 May 12 15:17:06.329714 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-035ef853-281c-44e3-8c45-8a630e98b092 req-31307e68-3827-4d06-960d-e454519392ba service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6926949 May 12 15:17:06.628033 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6de299a4-dc6d-46f0-ad56-a4ec1891f250 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:06.650862 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:06.714834 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c404b13c-0df0-43be-82ae-456d361c1059', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0f50665-5b0d-4723-ad87-6d08af238805'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:06.729463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c0f50665-5b0d-4723-ad87-6d08af238805, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c0f50665-5b0d-4723-ad87-6d08af238805,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:06.735405 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:06.740281 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:06.821205 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-035ef853-281c-44e3-8c45-8a630e98b092 req-a88f4522-495e-4413-90f7-acd832bf2f3b service neutron] 10.222.0.84 "GET /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4666193 May 12 15:17:06.921148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c0f50665-5b0d-4723-ad87-6d08af238805,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:06.943836 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6de299a4-dc6d-46f0-ad56-a4ec1891f250 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:06.963989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6de299a4-dc6d-46f0-ad56-a4ec1891f250 admin admin] Usage tracker for resource:security_group_rule and tenant:b81d38817fdb40b1a52db7a94c611650 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:06.971793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6de299a4-dc6d-46f0-ad56-a4ec1891f250 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:06.993034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6de299a4-dc6d-46f0-ad56-a4ec1891f250 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:07.027877 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:07.107369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc1355e3-ce1a-4676-8bea-54420f69292e req-fb50cbfa-aa2b-4a70-ac7e-b80a40c28ceb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:07.109219 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc1355e3-ce1a-4676-8bea-54420f69292e req-fb50cbfa-aa2b-4a70-ac7e-b80a40c28ceb service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=60b7c456959149269dc444554ba6a6c2&device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 1094 time: 0.8072588 May 12 15:17:07.193034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53fb5c58-02a9-4ff5-977f-1fd2e6baa3d9 req-f2e7637b-3258-4132-b42d-7e13c8fae033 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:07.193034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-53fb5c58-02a9-4ff5-977f-1fd2e6baa3d9 req-f2e7637b-3258-4132-b42d-7e13c8fae033 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.2928395 May 12 15:17:07.276739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8ab2c56a-0051-490d-aebb-ad60abc4bb93 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:17:07.291875 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:07.341596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Transition to ACTIVE for port object 8ab2c56a-0051-490d-aebb-ad60abc4bb93 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:17:07.355083 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:07.449058 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6de299a4-dc6d-46f0-ad56-a4ec1891f250 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:07.489866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9ed48ee-ffad-477c-977f-ea28b256f531 req-822ccf35-0c48-40a5-bb4f-5db14582f070 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:07.489866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9ed48ee-ffad-477c-977f-ea28b256f531 req-822ccf35-0c48-40a5-bb4f-5db14582f070 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 943 time: 0.8391924 May 12 15:17:07.499853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Pushing event updated for resources: {'Port': ['ID=8ab2c56a-0051-490d-aebb-ad60abc4bb93,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:07.499853 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:07.542825 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6de299a4-dc6d-46f0-ad56-a4ec1891f250 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:07.755830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc1355e3-ce1a-4676-8bea-54420f69292e req-8a3d0b2c-e4f6-4e06-a7ec-1473b81636b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:07.755830 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc1355e3-ce1a-4676-8bea-54420f69292e req-8a3d0b2c-e4f6-4e06-a7ec-1473b81636b0 service neutron] 10.222.0.76 "GET /v2.0/networks?id=944a3072-30fa-47bc-9620-9dfd43f531e1 HTTP/1.1" status: 200 len: 916 time: 0.6260693 May 12 15:17:07.778323 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-53fb5c58-02a9-4ff5-977f-1fd2e6baa3d9 req-f3e4b1d0-f3fc-4e73-adae-e2adb15d680f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5729616 May 12 15:17:07.778323 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6de299a4-dc6d-46f0-ad56-a4ec1891f250 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b81d38817fdb40b1a52db7a94c611650&name=default HTTP/1.1" status: 200 len: 2983 time: 1.7620850 May 12 15:17:07.797958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56412) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:08.021031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc1355e3-ce1a-4676-8bea-54420f69292e req-8370ed8e-c8b5-48a7-84b5-61027d65af65 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=d3bf5047-6e8a-4d30-bf27-76571b79026a HTTP/1.1" status: 200 len: 217 time: 0.2246130 May 12 15:17:08.021031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de299a4-dc6d-46f0-ad56-a4ec1891f250 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a478f4c-e5cd-4bfd-b319-3488b10c4123,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:08.026743 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-19d92601-0610-4565-ade4-de36bc559a02'] response: {'server_uuid': 'c404b13c-0df0-43be-82ae-456d361c1059', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0f50665-5b0d-4723-ad87-6d08af238805', 'code': 200} May 12 15:17:08.377571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9ed48ee-ffad-477c-977f-ea28b256f531 req-9875798f-f1bc-435f-82f4-0da834ab646d tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.8361740 May 12 15:17:08.436766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6f3b6fed-1d08-415e-857d-eb8cff28711f {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:17:08.442919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:08.465515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc1355e3-ce1a-4676-8bea-54420f69292e req-554a2db8-be7e-4278-beab-9d9ac45d7470 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:08.465515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc1355e3-ce1a-4676-8bea-54420f69292e req-554a2db8-be7e-4278-beab-9d9ac45d7470 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=1972ca52-439b-4a99-be07-5a8a9346589c HTTP/1.1" status: 200 len: 854 time: 0.4201808 May 12 15:17:08.470731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Transition to ACTIVE for port object 6f3b6fed-1d08-415e-857d-eb8cff28711f will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:17:08.488897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e0a75c62-51eb-4861-a3d3-1d833def9845 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:08.506796 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:08.551582 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e0a75c62-51eb-4861-a3d3-1d833def9845 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:08.626532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Pushing event updated for resources: {'Port': ['ID=6f3b6fed-1d08-415e-857d-eb8cff28711f,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:08.741275 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e0a75c62-51eb-4861-a3d3-1d833def9845 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:08.803555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0a75c62-51eb-4861-a3d3-1d833def9845 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a478f4c-e5cd-4bfd-b319-3488b10c4123,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:08.810098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Attempting to bind port 8ab2c56a-0051-490d-aebb-ad60abc4bb93 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:17:08.810098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Attempting to bind port 8ab2c56a-0051-490d-aebb-ad60abc4bb93 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:17:08.810098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Attempting to bind port 8ab2c56a-0051-490d-aebb-ad60abc4bb93 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:17:08.818417 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e0a75c62-51eb-4861-a3d3-1d833def9845 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:08.818417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e0a75c62-51eb-4861-a3d3-1d833def9845 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4a478f4c-e5cd-4bfd-b319-3488b10c4123 HTTP/1.1" status: 204 len: 168 time: 1.0064611 May 12 15:17:08.831707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Network 8c326986-914c-4d15-83ee-665daa53b37e is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:17:08.838703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1562b3a0-96b2-4a2f-ac68-7d1be5528853 req-80856564-1711-4aa2-ad51-04fb02e37c10 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:08.838703 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1562b3a0-96b2-4a2f-ac68-7d1be5528853 req-80856564-1711-4aa2-ad51-04fb02e37c10 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 932 time: 0.6386087 May 12 15:17:08.869274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc1355e3-ce1a-4676-8bea-54420f69292e req-eef2a7a8-5a71-49ae-8480-b43a70afeafb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:08.869274 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc1355e3-ce1a-4676-8bea-54420f69292e req-eef2a7a8-5a71-49ae-8480-b43a70afeafb service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=944a3072-30fa-47bc-9620-9dfd43f531e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3929935 May 12 15:17:08.919805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:17:08.919805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:17:08.943700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1562b3a0-96b2-4a2f-ac68-7d1be5528853 req-cbce9766-f49b-45e0-b3bf-0ac75b0baff6 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1006744 May 12 15:17:08.974276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-247480d1-adf5-4389-b296-94d73fc25a12 req-523e4eaa-ec92-4fb5-9f35-80a39facb0a2 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:08.985583 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-247480d1-adf5-4389-b296-94d73fc25a12 req-523e4eaa-ec92-4fb5-9f35-80a39facb0a2 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 948 time: 0.3544829 May 12 15:17:09.029292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Port 8ab2c56a-0051-490d-aebb-ad60abc4bb93 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:17:09.029292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Attempting to bind port 8ab2c56a-0051-490d-aebb-ad60abc4bb93 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:17:09.110085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 17, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:17:09.110085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:17:09.110085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:17:09.110085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Bound port: 8ab2c56a-0051-490d-aebb-ad60abc4bb93, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:17:09.110085 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:09.138569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Pushing event updated for resources: {'Port': ['ID=347edf1f-11b3-4ee3-8fb0-b951abe3dd4f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:09.264168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:09.264168 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:09.304363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Attempting to bind port 6f3b6fed-1d08-415e-857d-eb8cff28711f on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:17:09.305308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Attempting to bind port 6f3b6fed-1d08-415e-857d-eb8cff28711f by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:17:09.306405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Attempting to bind port 6f3b6fed-1d08-415e-857d-eb8cff28711f on network 8c326986-914c-4d15-83ee-665daa53b37e {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:17:09.314792 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-a3dbc5aa-d252-491d-95a5-e555bd88648c tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 5.9083645 May 12 15:17:09.318079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] For port 8ab2c56a-0051-490d-aebb-ad60abc4bb93, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:17:09.320674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Port 6f3b6fed-1d08-415e-857d-eb8cff28711f on network 8c326986-914c-4d15-83ee-665daa53b37e not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:17:09.332265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Attempting to bind port 6f3b6fed-1d08-415e-857d-eb8cff28711f on network 8c326986-914c-4d15-83ee-665daa53b37e {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:17:09.364230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Request body: {'port': {'device_id': 'ca7efd55-1093-4424-8b8a-43e0eeface30', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:09.402689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-247480d1-adf5-4389-b296-94d73fc25a12 req-d4c60127-5099-486b-b6b0-d7a8d797e266 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4249911 May 12 15:17:09.423495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 17, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:17:09.423835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Checking segment: {'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:17:09.424224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Bound using segment: {'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:17:09.424661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Bound port: 6f3b6fed-1d08-415e-857d-eb8cff28711f, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:17:09.425218 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:09.449069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] For port 8ab2c56a-0051-490d-aebb-ad60abc4bb93, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8ab2c56a-0051-490d-aebb-ad60abc4bb93,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:17:09.465690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc1355e3-ce1a-4676-8bea-54420f69292e req-33f4a198-c6c1-4818-ad4a-2cf9f676be98 service neutron] 10.222.0.76 "GET /v2.0/networks/944a3072-30fa-47bc-9620-9dfd43f531e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5926998 May 12 15:17:09.486304 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:09.687349 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:09.687933 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:09.692266 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] 10.222.0.76 "PUT /v2.0/ports/8ab2c56a-0051-490d-aebb-ad60abc4bb93 HTTP/1.1" status: 200 len: 1096 time: 5.1012149 May 12 15:17:09.706411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '71f83a02-9762-4c31-8aff-f37bf97aa06b', 'tag': '8ab2c56a-0051-490d-aebb-ad60abc4bb93'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:09.864349 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aad2dff9-f87c-4353-a1d3-9ba6ab053e7b req-7959febe-c74b-4ac5-b080-1ed8c8413321 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:09.870824 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aad2dff9-f87c-4353-a1d3-9ba6ab053e7b req-7959febe-c74b-4ac5-b080-1ed8c8413321 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.6337130 May 12 15:17:09.923474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] For port 6f3b6fed-1d08-415e-857d-eb8cff28711f, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:17:09.926986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] For port 6f3b6fed-1d08-415e-857d-eb8cff28711f, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=6f3b6fed-1d08-415e-857d-eb8cff28711f,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:17:09.955966 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:10.032096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:10.035102 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:10.035102 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] 10.222.0.76 "PUT /v2.0/ports/6f3b6fed-1d08-415e-857d-eb8cff28711f HTTP/1.1" status: 200 len: 1092 time: 4.0010517 May 12 15:17:10.038019 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:10.063354 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aad2dff9-f87c-4353-a1d3-9ba6ab053e7b req-398f5c2d-144c-46e9-999a-6a3d800b697e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1746352 May 12 15:17:10.080353 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc1355e3-ce1a-4676-8bea-54420f69292e req-e0ad0e98-a44e-444f-bcc4-8c93048db027 service neutron] 10.222.0.76 "GET /v2.0/networks/944a3072-30fa-47bc-9620-9dfd43f531e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5830686 May 12 15:17:10.096302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bcda316-153b-4525-a4cf-63e53c2ae694 req-90c31d86-9f39-402a-b6d5-ff0a5ae24299 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:10.105967 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6bcda316-153b-4525-a4cf-63e53c2ae694 req-90c31d86-9f39-402a-b6d5-ff0a5ae24299 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 943 time: 0.4213588 May 12 15:17:10.107812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d7ba97d-f28c-40dd-a8eb-a0a84d18f6ea service neutron] Pushing event updated for resources: {'Port': ['ID=8ab2c56a-0051-490d-aebb-ad60abc4bb93,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:10.205520 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8985b566-e40f-4153-9d7e-d24307066c41'] response: {'name': 'network-changed', 'server_uuid': '71f83a02-9762-4c31-8aff-f37bf97aa06b', 'tag': '8ab2c56a-0051-490d-aebb-ad60abc4bb93', 'status': 'completed', 'code': 200} May 12 15:17:10.208834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3386e4b7-08b6-4a22-84c5-cad410f14fec service neutron] Pushing event updated for resources: {'Port': ['ID=6f3b6fed-1d08-415e-857d-eb8cff28711f,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:10.315703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-06139588-96d9-4249-a888-24c1c1310058 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:10.316904 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-06139588-96d9-4249-a888-24c1c1310058 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=4e05bf2d5a814ea6880baa36c838e794&device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 1099 time: 0.5694203 May 12 15:17:10.339564 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6bcda316-153b-4525-a4cf-63e53c2ae694 req-71d12ad2-966c-4ae6-b470-1cb60a528bb8 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1323755 May 12 15:17:10.488495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-8736551f-aee9-44c0-827a-47b2a1eb9494 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:10.495137 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-8736551f-aee9-44c0-827a-47b2a1eb9494 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=d6a33151cf37459889a9facebe6ff6fd&device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 1095 time: 0.3880765 May 12 15:17:10.527724 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-1dd4cdef-0dfe-4b25-afdb-872c2ca9c146 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.176&port_id=8ab2c56a-0051-490d-aebb-ad60abc4bb93 HTTP/1.1" status: 200 len: 217 time: 0.1903932 May 12 15:17:10.840678 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-07d6250f-4aec-4189-a177-597e6c1254ac service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6f3b6fed-1d08-415e-857d-eb8cff28711f HTTP/1.1" status: 200 len: 217 time: 0.3341632 May 12 15:17:10.873633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-90a32b88-e8da-457d-9bf2-0ec4ab6dc64e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:10.874970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-90a32b88-e8da-457d-9bf2-0ec4ab6dc64e service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2536886 May 12 15:17:10.989616 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-47bd7517-d3a6-437e-bbc5-4bc1c9fc565e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:10.991695 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-47bd7517-d3a6-437e-bbc5-4bc1c9fc565e service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bbf4de36-cca3-4e54-b76e-de177b2d73c3 HTTP/1.1" status: 200 len: 853 time: 0.1055224 May 12 15:17:11.001023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06a7ea33-eaad-4ba0-8523-ef323a39c02f req-afa42420-cd23-465d-9cd0-22993335bd38 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:11.010692 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06a7ea33-eaad-4ba0-8523-ef323a39c02f req-afa42420-cd23-465d-9cd0-22993335bd38 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 944 time: 0.6635382 May 12 15:17:11.076249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-13a1144b-6ec0-4f0e-959e-ba0c0c5fc281 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:11.078164 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-13a1144b-6ec0-4f0e-959e-ba0c0c5fc281 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1458955 May 12 15:17:11.083855 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-10495bbf-2dda-428b-83f1-7d5939a1f8fc service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=8c326986-914c-4d15-83ee-665daa53b37e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0692515 May 12 15:17:11.251450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-4d6c39d9-5c87-494e-958d-f36aae78d6a5 service neutron] 10.222.0.76 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1492248 May 12 15:17:11.356290 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06a7ea33-eaad-4ba0-8523-ef323a39c02f req-3f11b304-6bd7-4742-a4ca-e47d25632ad2 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3379836 May 12 15:17:11.366735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04471a30-a4e4-4999-8975-75aaf9b208a0 req-73c2cdd1-79b8-409f-b00e-781faa98cbd8 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:11.381772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04471a30-a4e4-4999-8975-75aaf9b208a0 req-73c2cdd1-79b8-409f-b00e-781faa98cbd8 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 948 time: 0.7474170 May 12 15:17:11.478453 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04471a30-a4e4-4999-8975-75aaf9b208a0 req-cfc3f0d8-dac2-4fc1-97b7-7caac1e77f67 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0987818 May 12 15:17:11.544626 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-1195e1aa-d810-42a7-bbd2-d443c4a9cbb0 service neutron] 10.222.0.76 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2953236 May 12 15:17:11.715822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:17:11.767283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:11.797059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-900db8ee-1ca9-4451-8e51-3e44ba1f1929 req-1f96e0dc-0ef4-41fe-8533-813c7145c661 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:11.812870 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-900db8ee-1ca9-4451-8e51-3e44ba1f1929 req-1f96e0dc-0ef4-41fe-8533-813c7145c661 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.1638443 May 12 15:17:11.928229 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-900db8ee-1ca9-4451-8e51-3e44ba1f1929 req-000ab64f-2968-4b4a-9586-cdc47d182472 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1257691 May 12 15:17:11.984766 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-6fc3f2d2-f5cd-4124-8264-91591c870d13 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8994367 May 12 15:17:11.991769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Transition to ACTIVE for port object 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:17:12.019348 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:12.130460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fbb5d03-7c0f-45e9-a171-c0c62b5ebb75 req-83035039-91a2-4581-a035-33a4a00b1133 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:12.137010 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4fbb5d03-7c0f-45e9-a171-c0c62b5ebb75 req-83035039-91a2-4581-a035-33a4a00b1133 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 943 time: 0.2076564 May 12 15:17:12.208361 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4fbb5d03-7c0f-45e9-a171-c0c62b5ebb75 req-e069d588-efba-40dd-bff2-bd645bfbd1f3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0654514 May 12 15:17:12.209549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ab5ed14f-8344-46e1-b6e8-3bb09abee741', 'tag': '6f3b6fed-1d08-415e-857d-eb8cff28711f'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:12.345299 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8ea8c0ec-78e2-4a1a-8d6c-b85695b46679'] response: {'name': 'network-changed', 'server_uuid': 'ab5ed14f-8344-46e1-b6e8-3bb09abee741', 'tag': '6f3b6fed-1d08-415e-857d-eb8cff28711f', 'status': 'completed', 'code': 200} May 12 15:17:12.420350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Pushing event updated for resources: {'Port': ['ID=347edf1f-11b3-4ee3-8fb0-b951abe3dd4f,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:12.600952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a241ab23-37ae-4646-beff-ee44b8fa4fdd req-e469d376-caaf-4473-b9d9-3a8611bc5907 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:12.614275 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a241ab23-37ae-4646-beff-ee44b8fa4fdd req-e469d376-caaf-4473-b9d9-3a8611bc5907 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=d6a33151cf37459889a9facebe6ff6fd&device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 1095 time: 0.2484448 May 12 15:17:12.678620 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b24d9aa5-6254-4f4c-ac33-9e8aa9151a85 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:12.784269 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:12.844894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Attempting to bind port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:17:12.844894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Attempting to bind port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:17:12.844894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Attempting to bind port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f on network 8c326986-914c-4d15-83ee-665daa53b37e {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:17:12.844894 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-193398f2-dc6f-4da0-b14c-5778f7023df9 req-e54a5b1a-ed60-4682-bac9-ee8c6d79eaeb service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8477943 May 12 15:17:12.875630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f on network 8c326986-914c-4d15-83ee-665daa53b37e not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:17:12.875630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Attempting to bind port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f on network 8c326986-914c-4d15-83ee-665daa53b37e {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:17:12.894775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 17, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:17:12.908231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Checking segment: {'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:17:12.908231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Bound using segment: {'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:17:12.908231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Bound port: 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd15583e1-352d-4594-8d9f-2e9d574c2f64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:17:12.908231 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:13.088041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27781c70-0add-4d11-a815-f510faac15dd req-8ddf8c94-3dbd-4dcc-8e8c-d969186878b2 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:13.088041 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27781c70-0add-4d11-a815-f510faac15dd req-8ddf8c94-3dbd-4dcc-8e8c-d969186878b2 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 944 time: 0.2513611 May 12 15:17:13.134781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39d141a6-967f-4bdd-a489-3e196aab8f15 req-4191d1c0-dd23-4107-9199-c8341ae68ab3 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:13.143749 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39d141a6-967f-4bdd-a489-3e196aab8f15 req-4191d1c0-dd23-4107-9199-c8341ae68ab3 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 948 time: 0.3110402 May 12 15:17:13.146986 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a241ab23-37ae-4646-beff-ee44b8fa4fdd req-d05031e1-c562-463c-8fdb-ccbd2d6d0246 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:13.148882 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a241ab23-37ae-4646-beff-ee44b8fa4fdd req-d05031e1-c562-463c-8fdb-ccbd2d6d0246 service neutron] 10.222.0.76 "GET /v2.0/networks?id=8c326986-914c-4d15-83ee-665daa53b37e HTTP/1.1" status: 200 len: 914 time: 0.5385644 May 12 15:17:13.251677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] For port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:17:13.261645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] For port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=347edf1f-11b3-4ee3-8fb0-b951abe3dd4f,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:17:13.285742 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:13.390799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27781c70-0add-4d11-a815-f510faac15dd req-3942556f-3cf0-432e-9126-09ac32946258 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2558384 May 12 15:17:13.390799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a241ab23-37ae-4646-beff-ee44b8fa4fdd req-c40afdd9-6f5a-4bfb-bd63-a9223e1acb71 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6f3b6fed-1d08-415e-857d-eb8cff28711f HTTP/1.1" status: 200 len: 217 time: 0.1896007 May 12 15:17:13.416318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39d141a6-967f-4bdd-a489-3e196aab8f15 req-0cb20fcc-8cef-40ef-9065-aeb99aabc58c tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2632484 May 12 15:17:13.483655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:13.483655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:13.493021 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] 10.222.0.84 "PUT /v2.0/ports/347edf1f-11b3-4ee3-8fb0-b951abe3dd4f HTTP/1.1" status: 200 len: 1091 time: 4.1412838 May 12 15:17:13.502796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da15111e-0654-4e7c-8d3d-08e4e8aa5453 req-7eb8a6da-b09e-4de4-8a70-9e7ecb46b4d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:13.502796 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da15111e-0654-4e7c-8d3d-08e4e8aa5453 req-7eb8a6da-b09e-4de4-8a70-9e7ecb46b4d4 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=4e05bf2d5a814ea6880baa36c838e794&device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 1099 time: 0.5675166 May 12 15:17:13.708729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a241ab23-37ae-4646-beff-ee44b8fa4fdd req-a53ee525-29da-4a47-89aa-83ad734c3e90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:13.714878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15afd0a4-0a39-4f8f-9c40-c7e8f6affe41 service neutron] Pushing event updated for resources: {'Port': ['ID=347edf1f-11b3-4ee3-8fb0-b951abe3dd4f,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:13.718169 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a241ab23-37ae-4646-beff-ee44b8fa4fdd req-a53ee525-29da-4a47-89aa-83ad734c3e90 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=bbf4de36-cca3-4e54-b76e-de177b2d73c3 HTTP/1.1" status: 200 len: 853 time: 0.2996879 May 12 15:17:13.895767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da15111e-0654-4e7c-8d3d-08e4e8aa5453 req-3c138b8c-dd1e-4293-a6a7-25d98886c0fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:13.899918 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da15111e-0654-4e7c-8d3d-08e4e8aa5453 req-3c138b8c-dd1e-4293-a6a7-25d98886c0fb service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.3862441 May 12 15:17:13.942381 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a241ab23-37ae-4646-beff-ee44b8fa4fdd req-b117b046-28ca-4867-b2f3-03a7ca07f07c service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=8c326986-914c-4d15-83ee-665daa53b37e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1462405 May 12 15:17:13.980185 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da15111e-0654-4e7c-8d3d-08e4e8aa5453 req-b896b613-f006-4d93-8ace-086cdeb9592c service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.176&port_id=8ab2c56a-0051-490d-aebb-ad60abc4bb93 HTTP/1.1" status: 200 len: 217 time: 0.0734475 May 12 15:17:13.982302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3b5b0eaf-d40e-48be-9174-0bc653c15cad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:13.983655 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-3b5b0eaf-d40e-48be-9174-0bc653c15cad service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=d6a33151cf37459889a9facebe6ff6fd&device_id=ca7efd55-1093-4424-8b8a-43e0eeface30 HTTP/1.1" status: 200 len: 1094 time: 0.3049173 May 12 15:17:14.107720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 6f3b6fed-1d08-415e-857d-eb8cff28711f details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:17:14.114835 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-891c7ddd-79cb-44ad-9636-a3f6643d5c63 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=347edf1f-11b3-4ee3-8fb0-b951abe3dd4f HTTP/1.1" status: 200 len: 217 time: 0.0906632 May 12 15:17:14.215686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da15111e-0654-4e7c-8d3d-08e4e8aa5453 req-7521a568-8de1-4d24-9080-b23462a5bf80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:14.233284 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da15111e-0654-4e7c-8d3d-08e4e8aa5453 req-7521a568-8de1-4d24-9080-b23462a5bf80 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2387376 May 12 15:17:14.373659 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a241ab23-37ae-4646-beff-ee44b8fa4fdd req-1fb2ac4b-870b-4788-9acb-19c015419938 service neutron] 10.222.0.76 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4092228 May 12 15:17:14.421530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 6f3b6fed-1d08-415e-857d-eb8cff28711f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=6f3b6fed-1d08-415e-857d-eb8cff28711f,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:14.442322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '6f3b6fed-1d08-415e-857d-eb8cff28711f', 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e', 'port_id': '6f3b6fed-1d08-415e-857d-eb8cff28711f', 'mac_address': 'fa:16:3e:64:af:ba', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 565, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bbf4de36-cca3-4e54-b76e-de177b2d73c3', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:17:14.520130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ca7efd55-1093-4424-8b8a-43e0eeface30', 'tag': '347edf1f-11b3-4ee3-8fb0-b951abe3dd4f'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:14.529317 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:14.557708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6f3b6fed-1d08-415e-857d-eb8cff28711f {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:17:14.563121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-f8aaf7f5-ede5-46ca-9be4-a831da8d1c4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:14.566097 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-f8aaf7f5-ede5-46ca-9be4-a831da8d1c4b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bbf4de36-cca3-4e54-b76e-de177b2d73c3 HTTP/1.1" status: 200 len: 853 time: 0.4408817 May 12 15:17:14.580054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 6f3b6fed-1d08-415e-857d-eb8cff28711f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=6f3b6fed-1d08-415e-857d-eb8cff28711f,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:14.601251 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:14.605008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 8ab2c56a-0051-490d-aebb-ad60abc4bb93 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:17:14.623793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c681dd-b245-4596-b243-48eb49be2d18 req-f8392fbc-f1e1-4e79-a212-2b1a90e2461a tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:14.632422 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8c681dd-b245-4596-b243-48eb49be2d18 req-f8392fbc-f1e1-4e79-a212-2b1a90e2461a tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 943 time: 0.7678058 May 12 15:17:14.643960 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-8e84372a-895a-4cdf-b892-ec917169aaa7 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=8c326986-914c-4d15-83ee-665daa53b37e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0713899 May 12 15:17:14.685258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46d15c0a-20bc-42ca-b783-3b0c1f74caf4 req-a15bb82c-c6cd-47ae-9486-90837192e67e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:14.694311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46d15c0a-20bc-42ca-b783-3b0c1f74caf4 req-a15bb82c-c6cd-47ae-9486-90837192e67e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.9744284 May 12 15:17:14.780406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da15111e-0654-4e7c-8d3d-08e4e8aa5453 req-a5906a2f-82a1-4bb0-bc87-b1827892f277 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:14.782945 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da15111e-0654-4e7c-8d3d-08e4e8aa5453 req-a5906a2f-82a1-4bb0-bc87-b1827892f277 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.5293078 May 12 15:17:14.789816 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46d15c0a-20bc-42ca-b783-3b0c1f74caf4 req-d92a0d31-7f84-4050-8a0e-e6191fd969c1 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0935175 May 12 15:17:14.874378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56554) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:14.910795 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8c681dd-b245-4596-b243-48eb49be2d18 req-ec3ff3b0-04ce-4b69-ac82-2f37bdcb2ef3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2750831 May 12 15:17:14.939347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a241ab23-37ae-4646-beff-ee44b8fa4fdd req-d8bee0e2-0613-4af0-8058-b32fc9a69403 service neutron] 10.222.0.76 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5423031 May 12 15:17:14.986399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 8ab2c56a-0051-490d-aebb-ad60abc4bb93, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8ab2c56a-0051-490d-aebb-ad60abc4bb93,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:15.062231 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '8ab2c56a-0051-490d-aebb-ad60abc4bb93', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '8ab2c56a-0051-490d-aebb-ad60abc4bb93', 'mac_address': 'fa:16:3e:dc:99:01', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.176'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:17:15.199900 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ddb5e1e9-990e-4acb-b196-33653c664d45 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:15.211021 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-0ca8b103-dcc5-4dbc-9730-53e5c35aa1be service neutron] 10.222.0.84 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5534680 May 12 15:17:15.243413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ddb5e1e9-990e-4acb-b196-33653c664d45 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:15.243413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ddb5e1e9-990e-4acb-b196-33653c664d45 admin admin] Usage tracker for resource:security_group_rule and tenant:bd6a4770ede34021b4360f563c2cda1f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:15.254168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ddb5e1e9-990e-4acb-b196-33653c664d45 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:15.262721 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c135a689-a867-459f-bdf7-26c88f100609 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:15.305857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ddb5e1e9-990e-4acb-b196-33653c664d45 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:15.334222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=6f3b6fed-1d08-415e-857d-eb8cff28711f,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:15.341670 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:15.381459 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8ab2c56a-0051-490d-aebb-ad60abc4bb93 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:17:15.387527 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da15111e-0654-4e7c-8d3d-08e4e8aa5453 req-f0a06fc7-de58-4dd3-b17e-32e71efe5898 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5945492 May 12 15:17:15.412370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 8ab2c56a-0051-490d-aebb-ad60abc4bb93, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8ab2c56a-0051-490d-aebb-ad60abc4bb93,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:15.453970 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:15.502851 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d7d87f40-89ff-4a0f-b90a-6605cd0c7043 req-29c5dfd0-15ec-412b-8bc6-f6e18adedd59 service neutron] 10.222.0.84 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2837729 May 12 15:17:15.583022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81d075bf-4ac3-4247-9fba-886d82437202 req-d0ba5b50-07be-4149-8fea-af5769bbb5ad tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:15.595460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=8ab2c56a-0051-490d-aebb-ad60abc4bb93,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:15.595678 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81d075bf-4ac3-4247-9fba-886d82437202 req-d0ba5b50-07be-4149-8fea-af5769bbb5ad tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 945 time: 0.5259106 May 12 15:17:15.614754 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-da15111e-0654-4e7c-8d3d-08e4e8aa5453 req-6bd5db76-5461-4468-8816-e43a4e075e26 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2081838 May 12 15:17:15.702911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-707f0ac2-feba-49aa-a556-8f61bf3f31d3 req-eb721f3f-cbdc-479e-bb24-58de95ba843f tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:15.704807 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-707f0ac2-feba-49aa-a556-8f61bf3f31d3 req-eb721f3f-cbdc-479e-bb24-58de95ba843f tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 949 time: 0.3613338 May 12 15:17:15.718601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['6f3b6fed-1d08-415e-857d-eb8cff28711f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:17:15.721720 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81d075bf-4ac3-4247-9fba-886d82437202 req-21068f76-352f-4c71-b822-00a8c44f7197 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1249721 May 12 15:17:15.774710 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['8ab2c56a-0051-490d-aebb-ad60abc4bb93'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:17:15.779439 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ddb5e1e9-990e-4acb-b196-33653c664d45 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:15.785793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-707f0ac2-feba-49aa-a556-8f61bf3f31d3 req-994dd567-03f1-474b-9c34-6f0a0c495d00 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0675695 May 12 15:17:15.795897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ddb5e1e9-990e-4acb-b196-33653c664d45 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:15.858484 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ddb5e1e9-990e-4acb-b196-33653c664d45 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bd6a4770ede34021b4360f563c2cda1f&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9707084 May 12 15:17:15.860190 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddb5e1e9-990e-4acb-b196-33653c664d45 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c636777-ee3c-4984-ac3a-0353e640e53d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:15.861143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56570) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:15.902269 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1809862a-f1a1-4cc9-9235-45f83a8d1582'] response: {'name': 'network-changed', 'server_uuid': 'ca7efd55-1093-4424-8b8a-43e0eeface30', 'tag': '347edf1f-11b3-4ee3-8fb0-b951abe3dd4f', 'status': 'completed', 'code': 200} May 12 15:17:16.034985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4ea7df8-8a6e-4f04-bbe8-cfebba898932 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:16.039016 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:16.072857 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4ea7df8-8a6e-4f04-bbe8-cfebba898932 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:16.142739 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:16.217749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe5bc3e9-5e18-4b85-8d83-4e6398aa2f3a req-71a67974-ea2a-4c47-897e-ba8f8349c3d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:16.219373 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fe5bc3e9-5e18-4b85-8d83-4e6398aa2f3a req-71a67974-ea2a-4c47-897e-ba8f8349c3d4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=d6a33151cf37459889a9facebe6ff6fd&device_id=ca7efd55-1093-4424-8b8a-43e0eeface30 HTTP/1.1" status: 200 len: 1094 time: 0.2796357 May 12 15:17:16.261898 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4ea7df8-8a6e-4f04-bbe8-cfebba898932 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:16.399913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4ea7df8-8a6e-4f04-bbe8-cfebba898932 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c636777-ee3c-4984-ac3a-0353e640e53d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:16.418219 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4ea7df8-8a6e-4f04-bbe8-cfebba898932 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:16.421086 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e4ea7df8-8a6e-4f04-bbe8-cfebba898932 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3c636777-ee3c-4984-ac3a-0353e640e53d HTTP/1.1" status: 204 len: 168 time: 0.5565102 May 12 15:17:16.458895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e699e8f7-e412-4986-bb04-1f3604265cc4 req-7743b3ee-05e9-48c0-ba8a-70adff40e4e3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:16.470665 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e699e8f7-e412-4986-bb04-1f3604265cc4 req-7743b3ee-05e9-48c0-ba8a-70adff40e4e3 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 943 time: 0.1702509 May 12 15:17:16.500417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1767d0a-3fe4-4be6-867c-a7a12c20c7d8 req-03eda402-5305-4e61-8bfd-2a5a8b50a6fd tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:16.503142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe5bc3e9-5e18-4b85-8d83-4e6398aa2f3a req-a796c583-67e6-4433-af61-15d77822778e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:16.505779 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fe5bc3e9-5e18-4b85-8d83-4e6398aa2f3a req-a796c583-67e6-4433-af61-15d77822778e service neutron] 10.222.0.84 "GET /v2.0/networks?id=8c326986-914c-4d15-83ee-665daa53b37e HTTP/1.1" status: 200 len: 914 time: 0.2754636 May 12 15:17:16.507368 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1767d0a-3fe4-4be6-867c-a7a12c20c7d8 req-03eda402-5305-4e61-8bfd-2a5a8b50a6fd tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.3397231 May 12 15:17:16.588832 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e699e8f7-e412-4986-bb04-1f3604265cc4 req-0d955068-d52d-464f-a718-7a24c99bef1d tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1170475 May 12 15:17:16.632478 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fe5bc3e9-5e18-4b85-8d83-4e6398aa2f3a req-ff2f57fc-d3f3-42ef-b7bb-1634e42c8be5 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=347edf1f-11b3-4ee3-8fb0-b951abe3dd4f HTTP/1.1" status: 200 len: 217 time: 0.1187685 May 12 15:17:16.654431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1767d0a-3fe4-4be6-867c-a7a12c20c7d8 req-0da97fa5-eb2b-4dc1-bfcc-862c8abd6466 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1449063 May 12 15:17:16.741779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe5bc3e9-5e18-4b85-8d83-4e6398aa2f3a req-b96d1181-d1df-442c-a6fd-9dc87c50f753 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:16.744615 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fe5bc3e9-5e18-4b85-8d83-4e6398aa2f3a req-b96d1181-d1df-442c-a6fd-9dc87c50f753 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=bbf4de36-cca3-4e54-b76e-de177b2d73c3 HTTP/1.1" status: 200 len: 853 time: 0.1034453 May 12 15:17:16.806566 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fe5bc3e9-5e18-4b85-8d83-4e6398aa2f3a req-1edcf7af-d2b5-416f-ae27-3f09d4c04ef8 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=8c326986-914c-4d15-83ee-665daa53b37e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0527821 May 12 15:17:16.820767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:17:17.071966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56590) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:17.078749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=347edf1f-11b3-4ee3-8fb0-b951abe3dd4f,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:17.098236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '347edf1f-11b3-4ee3-8fb0-b951abe3dd4f', 'network_id': '8c326986-914c-4d15-83ee-665daa53b37e', 'port_id': '347edf1f-11b3-4ee3-8fb0-b951abe3dd4f', 'mac_address': 'fa:16:3e:ad:e0:ac', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 565, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bbf4de36-cca3-4e54-b76e-de177b2d73c3', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:17:17.176616 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:17.197936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:17:17.204360 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a48a15c4-f9f7-4931-b6bc-b80f8492f545 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:17.228506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=347edf1f-11b3-4ee3-8fb0-b951abe3dd4f,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:17.243191 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:17.261845 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fe5bc3e9-5e18-4b85-8d83-4e6398aa2f3a req-42cdbed5-cbf7-450a-9342-6220e458ea5a service neutron] 10.222.0.84 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4436629 May 12 15:17:17.313596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a48a15c4-f9f7-4931-b6bc-b80f8492f545 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:17.343710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a48a15c4-f9f7-4931-b6bc-b80f8492f545 admin admin] Usage tracker for resource:security_group_rule and tenant:a09ff3a03f7c488eb59b12a868654f96 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:17.355063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a48a15c4-f9f7-4931-b6bc-b80f8492f545 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:17.381917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a48a15c4-f9f7-4931-b6bc-b80f8492f545 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:17.382111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=347edf1f-11b3-4ee3-8fb0-b951abe3dd4f,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:17.417469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbb57a94-e49d-48b3-bed6-f34b2cbfa4b4 req-5e193e66-d70d-42d9-9628-40ff164efb8c tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:17.424886 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bbb57a94-e49d-48b3-bed6-f34b2cbfa4b4 req-5e193e66-d70d-42d9-9628-40ff164efb8c tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 949 time: 0.4613333 May 12 15:17:17.501417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bbb57a94-e49d-48b3-bed6-f34b2cbfa4b4 req-326ea0b1-7b41-4f3e-a4e4-3df5085be503 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701427 May 12 15:17:17.514456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae70a42-df42-4bed-9ac3-20bf85491a8e req-a25c355c-3496-4978-99ba-82c5a44ae38b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:17.563701 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bae70a42-df42-4bed-9ac3-20bf85491a8e req-a25c355c-3496-4978-99ba-82c5a44ae38b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 945 time: 0.4813018 May 12 15:17:17.570887 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fe5bc3e9-5e18-4b85-8d83-4e6398aa2f3a req-82f92531-cec4-4c7e-bb01-177c07f51e1b service neutron] 10.222.0.84 "GET /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2966366 May 12 15:17:17.606479 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:17.767313 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a48a15c4-f9f7-4931-b6bc-b80f8492f545 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:17.772536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['347edf1f-11b3-4ee3-8fb0-b951abe3dd4f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:17:17.834517 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a48a15c4-f9f7-4931-b6bc-b80f8492f545 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:17.877034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bae70a42-df42-4bed-9ac3-20bf85491a8e req-a1f5bcc4-c0c0-4302-9feb-4146ebf1c6e0 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3283620 May 12 15:17:18.004859 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a48a15c4-f9f7-4931-b6bc-b80f8492f545 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a09ff3a03f7c488eb59b12a868654f96&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9311461 May 12 15:17:18.006934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a48a15c4-f9f7-4931-b6bc-b80f8492f545 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1db2bb05-ba1f-470b-99f1-edf8eefae606,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:18.010126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56606) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:18.056475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30cfd994-15cf-49fb-bdd7-b382ff46b74a req-188aab0c-7d78-48a7-a2bb-84b4b5cdac07 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:18.068019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30cfd994-15cf-49fb-bdd7-b382ff46b74a req-188aab0c-7d78-48a7-a2bb-84b4b5cdac07 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 943 time: 0.3128474 May 12 15:17:18.144159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d3bf5047-6e8a-4d30-bf27-76571b79026a details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:17:18.145852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 6f3b6fed-1d08-415e-857d-eb8cff28711f up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:17:18.191873 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a7b30f7-bfd0-4497-a7a2-64e48af7b742 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:18.207155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30cfd994-15cf-49fb-bdd7-b382ff46b74a req-7bc15c8d-4de2-4293-aa1e-8fe6584165eb tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1292813 May 12 15:17:18.247421 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a7b30f7-bfd0-4497-a7a2-64e48af7b742 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:18.292716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592805d0-fe06-42b3-8f73-e5186b5833c6 req-6c6250d6-5ab8-466d-97dd-cc5d5bac8ba9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:18.306941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-592805d0-fe06-42b3-8f73-e5186b5833c6 req-6c6250d6-5ab8-466d-97dd-cc5d5bac8ba9 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.1942093 May 12 15:17:18.392160 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a7b30f7-bfd0-4497-a7a2-64e48af7b742 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:18.438590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a7b30f7-bfd0-4497-a7a2-64e48af7b742 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1db2bb05-ba1f-470b-99f1-edf8eefae606,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:18.451583 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a7b30f7-bfd0-4497-a7a2-64e48af7b742 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:18.455730 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3a7b30f7-bfd0-4497-a7a2-64e48af7b742 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1db2bb05-ba1f-470b-99f1-edf8eefae606 HTTP/1.1" status: 204 len: 168 time: 0.4412541 May 12 15:17:18.456175 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-592805d0-fe06-42b3-8f73-e5186b5833c6 req-24bd40b8-7d73-41f4-b0a6-785d0a869d5f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1570530 May 12 15:17:18.550078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d3bf5047-6e8a-4d30-bf27-76571b79026a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d3bf5047-6e8a-4d30-bf27-76571b79026a,segment=NetworkSegment(51a763ab-4327-4303-92e7-963b2e4c87d0),segment_id=51a763ab-4327-4303-92e7-963b2e4c87d0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:18.593571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'd3bf5047-6e8a-4d30-bf27-76571b79026a', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'port_id': 'd3bf5047-6e8a-4d30-bf27-76571b79026a', 'mac_address': 'fa:16:3e:69:4f:36', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 597, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:17:18.790293 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 6f3b6fed-1d08-415e-857d-eb8cff28711f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:17:18.796339 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:18.824012 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 6f3b6fed-1d08-415e-857d-eb8cff28711f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:17:18.824683 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:18.876336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af33aba7-7b22-4fb3-aacc-5d9491fd2e7a req-7d8725f4-244a-4247-a4a6-c849b52b2505 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:18.877978 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af33aba7-7b22-4fb3-aacc-5d9491fd2e7a req-7d8725f4-244a-4247-a4a6-c849b52b2505 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 949 time: 0.1912982 May 12 15:17:18.896095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d3bf5047-6e8a-4d30-bf27-76571b79026a {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:17:18.930785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d3bf5047-6e8a-4d30-bf27-76571b79026a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d3bf5047-6e8a-4d30-bf27-76571b79026a,segment=NetworkSegment(51a763ab-4327-4303-92e7-963b2e4c87d0),segment_id=51a763ab-4327-4303-92e7-963b2e4c87d0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:18.943183 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af33aba7-7b22-4fb3-aacc-5d9491fd2e7a req-573c133d-b287-487b-a730-eddaacf29a37 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554130 May 12 15:17:18.973576 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:19.116030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d3bf5047-6e8a-4d30-bf27-76571b79026a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:19.150925 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:19.162477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fbe1398-7535-42eb-8bdc-ec9af5630d6a req-ec0e1d91-60f1-4734-a698-eedc04c2d70b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:19.166209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4fbe1398-7535-42eb-8bdc-ec9af5630d6a req-ec0e1d91-60f1-4734-a698-eedc04c2d70b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 945 time: 0.1298704 May 12 15:17:19.199396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 6f3b6fed-1d08-415e-857d-eb8cff28711f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=6f3b6fed-1d08-415e-857d-eb8cff28711f,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:19.200625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ab5ed14f-8344-46e1-b6e8-3bb09abee741', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f3b6fed-1d08-415e-857d-eb8cff28711f'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:19.221703 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:19.223761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 8ab2c56a-0051-490d-aebb-ad60abc4bb93 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:17:19.265447 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4fbe1398-7535-42eb-8bdc-ec9af5630d6a req-52446768-624a-425d-a826-06e334e11f62 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0800405 May 12 15:17:19.495604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['d3bf5047-6e8a-4d30-bf27-76571b79026a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:17:19.560226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c84ed2-5603-4676-a4f6-41c15d0d9a94 req-3c7af466-016a-4d7d-9a4d-b7805626525e tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:19.570356 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19c84ed2-5603-4676-a4f6-41c15d0d9a94 req-3c7af466-016a-4d7d-9a4d-b7805626525e tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 944 time: 0.1586776 May 12 15:17:19.592590 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-79d9be88-dbd4-4cec-9b18-95217e6999d0'] response: {'server_uuid': 'ab5ed14f-8344-46e1-b6e8-3bb09abee741', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f3b6fed-1d08-415e-857d-eb8cff28711f', 'code': 200} May 12 15:17:19.644905 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19c84ed2-5603-4676-a4f6-41c15d0d9a94 req-edc3ac13-abeb-4f7a-bfa5-c0ca475670b5 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0733578 May 12 15:17:19.732170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad486a9-8a57-46e2-bb07-078287bbb389 req-410c1914-bba1-446e-8c85-bf3539fde0af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:19.734145 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dad486a9-8a57-46e2-bb07-078287bbb389 req-410c1914-bba1-446e-8c85-bf3539fde0af service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 1097 time: 0.3407617 May 12 15:17:19.811491 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dad486a9-8a57-46e2-bb07-078287bbb389 req-4725676a-cf29-4731-b0f3-3eaa3465e33c service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704238 May 12 15:17:19.818723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=6f3b6fed-1d08-415e-857d-eb8cff28711f,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:19.925205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb6b15d5-e24d-4938-b41e-1d4de8aa7d55 req-ab95a9fc-2951-4e99-9a31-775e274e4e3f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:19.930432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb6b15d5-e24d-4938-b41e-1d4de8aa7d55 req-ab95a9fc-2951-4e99-9a31-775e274e4e3f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.2029560 May 12 15:17:19.958640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 8ab2c56a-0051-490d-aebb-ad60abc4bb93 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:17:19.983583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 8ab2c56a-0051-490d-aebb-ad60abc4bb93 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:17:19.985937 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:20.040331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb6b15d5-e24d-4938-b41e-1d4de8aa7d55 req-5d982027-063c-4f6c-b9d2-b8ccb58a97e3 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0980415 May 12 15:17:20.262938 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aac7a2c-e36f-4595-83dd-c5c57e36b1ca req-8bbafa45-b560-41f3-af67-4f8235ea866f tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:20.264738 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4aac7a2c-e36f-4595-83dd-c5c57e36b1ca req-8bbafa45-b560-41f3-af67-4f8235ea866f tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 949 time: 0.1410189 May 12 15:17:20.325297 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:20.394024 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 8ab2c56a-0051-490d-aebb-ad60abc4bb93, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8ab2c56a-0051-490d-aebb-ad60abc4bb93,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:20.399101 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4aac7a2c-e36f-4595-83dd-c5c57e36b1ca req-7124a2bd-1d6b-4468-bc40-daf470a1cd76 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1260931 May 12 15:17:20.406394 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:20.547682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=8ab2c56a-0051-490d-aebb-ad60abc4bb93,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:20.793077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fdf751f-01f0-4d2f-9637-f9f22983bb1d req-0cf65219-8bfd-472c-90d1-2a9d99413e61 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:20.806189 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7fdf751f-01f0-4d2f-9637-f9f22983bb1d req-0cf65219-8bfd-472c-90d1-2a9d99413e61 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 946 time: 0.3145373 May 12 15:17:20.903976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:17:20.935417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7fdf751f-01f0-4d2f-9637-f9f22983bb1d req-05578302-0878-4a0a-8a12-30346e448cbc tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1282375 May 12 15:17:21.029677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8771276-6e05-4c2f-a0f2-1ebc99071fc9 req-576b1e2d-350b-4612-ba54-69c709ab83e7 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:21.048202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8771276-6e05-4c2f-a0f2-1ebc99071fc9 req-576b1e2d-350b-4612-ba54-69c709ab83e7 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 944 time: 0.2368793 May 12 15:17:21.147978 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8771276-6e05-4c2f-a0f2-1ebc99071fc9 req-1a92d6ac-61c4-40a4-a456-626bdf9cf3d0 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0987282 May 12 15:17:21.171242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:17:21.200394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:17:21.201122 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:21.511240 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:21.604977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=347edf1f-11b3-4ee3-8fb0-b951abe3dd4f,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:21.606647 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '71f83a02-9762-4c31-8aff-f37bf97aa06b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8ab2c56a-0051-490d-aebb-ad60abc4bb93'}, {'server_uuid': 'ca7efd55-1093-4424-8b8a-43e0eeface30', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '347edf1f-11b3-4ee3-8fb0-b951abe3dd4f'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:21.621100 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:21.777986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=347edf1f-11b3-4ee3-8fb0-b951abe3dd4f,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:21.809870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-220270b1-1c07-4224-a7f1-7d5a8642ce20 req-ffc64b65-c735-4f03-8e5a-8a73559c96bb tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:21.817500 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-220270b1-1c07-4224-a7f1-7d5a8642ce20 req-ffc64b65-c735-4f03-8e5a-8a73559c96bb tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 950 time: 0.2268908 May 12 15:17:21.874398 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-220270b1-1c07-4224-a7f1-7d5a8642ce20 req-f23099a9-6a93-4b4d-b4ce-c6202a17814c tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559378 May 12 15:17:21.911078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcbba872-7d66-466b-b390-571ef215ac98 req-fb5888fc-7c67-4321-b776-b944c254b56b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:21.918985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fcbba872-7d66-466b-b390-571ef215ac98 req-fb5888fc-7c67-4321-b776-b944c254b56b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.2051356 May 12 15:17:21.985520 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e08b95b1-7d56-4c54-b1b0-cde663173d97'] response: {'server_uuid': '71f83a02-9762-4c31-8aff-f37bf97aa06b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8ab2c56a-0051-490d-aebb-ad60abc4bb93', 'code': 200} May 12 15:17:21.986462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fcbba872-7d66-466b-b390-571ef215ac98 req-812d7a50-b4a0-4884-a2f7-ddf666537c2c tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665224 May 12 15:17:21.986743 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e08b95b1-7d56-4c54-b1b0-cde663173d97'] response: {'server_uuid': 'ca7efd55-1093-4424-8b8a-43e0eeface30', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '347edf1f-11b3-4ee3-8fb0-b951abe3dd4f', 'code': 200} May 12 15:17:22.145956 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d3bf5047-6e8a-4d30-bf27-76571b79026a up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:17:22.325706 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa3381c9-0302-43ce-b73e-7635d1e31adc req-bd1ef7f2-8636-41a3-a366-ac0255fc3590 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:22.327248 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa3381c9-0302-43ce-b73e-7635d1e31adc req-bd1ef7f2-8636-41a3-a366-ac0255fc3590 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 946 time: 0.1507125 May 12 15:17:22.344888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port d3bf5047-6e8a-4d30-bf27-76571b79026a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:17:22.366138 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port d3bf5047-6e8a-4d30-bf27-76571b79026a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:17:22.368836 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:22.376074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a8f5ece-c33a-413a-8237-4b6950512130 req-44c29f68-d4bb-42d1-835b-0308c4250ec7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:22.382479 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a8f5ece-c33a-413a-8237-4b6950512130 req-44c29f68-d4bb-42d1-835b-0308c4250ec7 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 1101 time: 0.2498980 May 12 15:17:22.388645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37995ab3-bc80-4a3d-ba87-e22e75358b65 req-14624b03-adbf-4c5a-bd64-4e85a7b3f6e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:22.390157 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-37995ab3-bc80-4a3d-ba87-e22e75358b65 req-14624b03-adbf-4c5a-bd64-4e85a7b3f6e7 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=ca7efd55-1093-4424-8b8a-43e0eeface30 HTTP/1.1" status: 200 len: 1096 time: 0.3109291 May 12 15:17:22.479044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa3381c9-0302-43ce-b73e-7635d1e31adc req-7f8d87dd-7cf1-4911-8d53-e11e98545f56 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1356506 May 12 15:17:22.496201 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a8f5ece-c33a-413a-8237-4b6950512130 req-8d587726-b711-4e1c-bb39-4eb82c3502c5 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1051054 May 12 15:17:22.504094 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-37995ab3-bc80-4a3d-ba87-e22e75358b65 req-ae35d4df-8021-4cfe-9c1b-cd7ba17efa11 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508935 May 12 15:17:22.684819 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:22.759655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d3bf5047-6e8a-4d30-bf27-76571b79026a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d3bf5047-6e8a-4d30-bf27-76571b79026a,segment=NetworkSegment(51a763ab-4327-4303-92e7-963b2e4c87d0),segment_id=51a763ab-4327-4303-92e7-963b2e4c87d0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:22.769018 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:22.829649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeccbf13-1a24-495f-afa4-2f08ab770d80 req-0ed36d80-ff1c-4e74-a38b-310253ac4228 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:22.832106 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aeccbf13-1a24-495f-afa4-2f08ab770d80 req-0ed36d80-ff1c-4e74-a38b-310253ac4228 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 944 time: 0.2563508 May 12 15:17:22.840721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5a0392b-5efe-422b-924e-326af2a011b9 req-2c756f6b-a7c7-4225-ae60-236df2960503 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:22.849624 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a5a0392b-5efe-422b-924e-326af2a011b9 req-2c756f6b-a7c7-4225-ae60-236df2960503 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ca7efd55-1093-4424-8b8a-43e0eeface30 HTTP/1.1" status: 200 len: 945 time: 0.1584632 May 12 15:17:22.933766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d3bf5047-6e8a-4d30-bf27-76571b79026a,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:22.954000 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a5a0392b-5efe-422b-924e-326af2a011b9 req-994cb27f-152a-4c70-954f-80cf4822c4e8 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1038990 May 12 15:17:22.996142 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aeccbf13-1a24-495f-afa4-2f08ab770d80 req-326c4735-1f38-4901-98ba-694e7c39a629 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1350274 May 12 15:17:23.300182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4adb4b27-cb83-4ac9-a769-4f38d598069d req-c0443206-67f7-4e63-987a-50452b93e5be tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:23.315519 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4adb4b27-cb83-4ac9-a769-4f38d598069d req-c0443206-67f7-4e63-987a-50452b93e5be tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.1554983 May 12 15:17:23.326492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9046c0d8-7d50-4b04-97ba-14e71fea35b3 req-acb36ae8-c9f6-4975-9414-c98097b93870 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:23.327459 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9046c0d8-7d50-4b04-97ba-14e71fea35b3 req-acb36ae8-c9f6-4975-9414-c98097b93870 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 950 time: 0.2213583 May 12 15:17:23.418172 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4adb4b27-cb83-4ac9-a769-4f38d598069d req-a528fe9d-e037-45a1-8dd7-aadea598314e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1016188 May 12 15:17:23.428132 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9046c0d8-7d50-4b04-97ba-14e71fea35b3 req-3f3481ab-9ef7-4254-b75c-39d09f0954ca tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0864737 May 12 15:17:23.988831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd3bf5047-6e8a-4d30-bf27-76571b79026a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:24.035576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be02030-0366-4442-afd3-2ae251573b70 req-12d03b16-8cb5-488d-9e7e-5d24ff61bba4 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:24.043625 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7be02030-0366-4442-afd3-2ae251573b70 req-12d03b16-8cb5-488d-9e7e-5d24ff61bba4 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.1974905 May 12 15:17:24.094119 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7be02030-0366-4442-afd3-2ae251573b70 req-dbcd142b-32e8-4c2d-bdd3-da5ea91fde26 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493398 May 12 15:17:24.157883 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f9006c0a-6d31-43c7-9183-4264a469ef39'] response: {'server_uuid': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd3bf5047-6e8a-4d30-bf27-76571b79026a', 'code': 200} May 12 15:17:24.250486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2b7ca88-2b03-42b3-85e1-094346f5a9c7 req-5a733aa8-6876-4eb1-ae1c-3992442a44db tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:24.252288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2b7ca88-2b03-42b3-85e1-094346f5a9c7 req-5a733aa8-6876-4eb1-ae1c-3992442a44db tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ca7efd55-1093-4424-8b8a-43e0eeface30 HTTP/1.1" status: 200 len: 945 time: 0.1299801 May 12 15:17:24.402008 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2b7ca88-2b03-42b3-85e1-094346f5a9c7 req-900e2017-e74d-4724-ae4e-13085ced530f tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1279449 May 12 15:17:24.491971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c12be4df-c88f-4234-9932-fef3363237ad req-6e4b6090-c6c9-4b9e-9cf5-d7c87c82a172 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:24.497125 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c12be4df-c88f-4234-9932-fef3363237ad req-6e4b6090-c6c9-4b9e-9cf5-d7c87c82a172 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 1096 time: 0.2456808 May 12 15:17:24.510162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-591b20b9-a5ea-4ca5-a6cd-bcafcf238953 req-5754b230-f9db-4c23-b4e5-ff4237b1ca62 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:24.518541 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-591b20b9-a5ea-4ca5-a6cd-bcafcf238953 req-5754b230-f9db-4c23-b4e5-ff4237b1ca62 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 945 time: 0.1977055 May 12 15:17:24.599938 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c12be4df-c88f-4234-9932-fef3363237ad req-90f8c273-d9c8-469a-9e2c-b2e88c2bc8b5 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0964622 May 12 15:17:24.682032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-591b20b9-a5ea-4ca5-a6cd-bcafcf238953 req-215c79a8-85e9-4488-89c6-eb5594045286 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1623216 May 12 15:17:24.759251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab569884-1405-4e5f-8e92-7437e495f04e req-4a05a1f8-88de-4bc4-931f-923d79388260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:24.761040 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab569884-1405-4e5f-8e92-7437e495f04e req-4a05a1f8-88de-4bc4-931f-923d79388260 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.1755033 May 12 15:17:24.846388 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab569884-1405-4e5f-8e92-7437e495f04e req-d021b178-9dde-451e-84aa-a7086f50fb7d tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689416 May 12 15:17:25.086283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4721cc5-ba89-47b7-b91c-da11c5d52ef6 req-02a8b04d-1c12-4e62-a964-6819e65e50c6 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:25.087957 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4721cc5-ba89-47b7-b91c-da11c5d52ef6 req-02a8b04d-1c12-4e62-a964-6819e65e50c6 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 950 time: 0.0988126 May 12 15:17:25.160277 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4721cc5-ba89-47b7-b91c-da11c5d52ef6 req-89344d88-d9f5-48e1-89a0-794a79fa783d tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646696 May 12 15:17:26.015046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757f79d9-c09c-4d92-a831-a46888988fbb req-4822e7ba-ae91-453f-8817-625e3379b2cc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:26.016881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-757f79d9-c09c-4d92-a831-a46888988fbb req-4822e7ba-ae91-453f-8817-625e3379b2cc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.2409754 May 12 15:17:26.124668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-757f79d9-c09c-4d92-a831-a46888988fbb req-3d68098e-9c15-4dca-afb6-f56dec230ae6 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1012647 May 12 15:17:26.362471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ed6b15-131a-42f3-84d8-67228da5e516 req-8f01f1db-47cb-45d5-b943-164c5b497afb tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:26.364442 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5ed6b15-131a-42f3-84d8-67228da5e516 req-8f01f1db-47cb-45d5-b943-164c5b497afb tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ca7efd55-1093-4424-8b8a-43e0eeface30 HTTP/1.1" status: 200 len: 945 time: 0.1957874 May 12 15:17:26.430117 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5ed6b15-131a-42f3-84d8-67228da5e516 req-2cc020ce-3d5c-4a1b-8fc6-0172608cd13e tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566232 May 12 15:17:26.447635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a731bd2-a1b5-4a0b-9127-f312477030b3 req-1cde9ca7-3d75-4f98-b07e-f5c940e17b83 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:26.455823 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a731bd2-a1b5-4a0b-9127-f312477030b3 req-1cde9ca7-3d75-4f98-b07e-f5c940e17b83 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 945 time: 0.1538012 May 12 15:17:26.521222 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a731bd2-a1b5-4a0b-9127-f312477030b3 req-6c8cc0b2-f85d-4b04-b044-a0af09cbff05 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0644176 May 12 15:17:26.704028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5bab9d0-0a7c-4528-9ce8-c154c3a56fd1 req-5fd8850a-f380-4276-8979-fc53f1976b14 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:26.704799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-e5bab9d0-0a7c-4528-9ce8-c154c3a56fd1 req-5fd8850a-f380-4276-8979-fc53f1976b14 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Synchronizing usage tracker for tenant:d6a33151cf37459889a9facebe6ff6fd on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:17:26.744175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-e5bab9d0-0a7c-4528-9ce8-c154c3a56fd1 req-5fd8850a-f380-4276-8979-fc53f1976b14 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Unset dirty status for tenant:d6a33151cf37459889a9facebe6ff6fd on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:17:26.751514 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e5bab9d0-0a7c-4528-9ce8-c154c3a56fd1 req-5fd8850a-f380-4276-8979-fc53f1976b14 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.84 "GET /v2.0/ports?device_id=ca7efd55-1093-4424-8b8a-43e0eeface30 HTTP/1.1" status: 200 len: 945 time: 0.2245631 May 12 15:17:26.888187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-e5bab9d0-0a7c-4528-9ce8-c154c3a56fd1 req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Deleting port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:17:26.888187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e5bab9d0-0a7c-4528-9ce8-c154c3a56fd1 req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:26.950342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0f16a0a-c0d1-4b6a-aea1-973532c73226 req-34eb2062-4f90-4d7e-92af-6c993dc2e505 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:26.952208 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0f16a0a-c0d1-4b6a-aea1-973532c73226 req-34eb2062-4f90-4d7e-92af-6c993dc2e505 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 950 time: 0.4005237 May 12 15:17:26.972205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4f1ee7e-09ca-4c27-a9f2-5d8570d1dd52 req-e9c3e6b4-f2bf-477f-a8a2-443b9a85263b tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:26.983836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4f1ee7e-09ca-4c27-a9f2-5d8570d1dd52 req-e9c3e6b4-f2bf-477f-a8a2-443b9a85263b tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 945 time: 0.1460938 May 12 15:17:27.003015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56888) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:27.010506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-01aebd89-a79f-44d5-ac75-1ba1e5316013 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Request body: {'floatingip': {'port_id': 'd3bf5047-6e8a-4d30-bf27-76571b79026a'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:27.132137 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01aebd89-a79f-44d5-ac75-1ba1e5316013 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:27.415109 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0f16a0a-c0d1-4b6a-aea1-973532c73226 req-6aa25e09-28c5-4937-af27-e34c7fb02bdb tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4298728 May 12 15:17:27.507308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-e5bab9d0-0a7c-4528-9ce8-c154c3a56fd1 req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] For port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=347edf1f-11b3-4ee3-8fb0-b951abe3dd4f,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:27.508601 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e5bab9d0-0a7c-4528-9ce8-c154c3a56fd1 req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:27.665239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-e5bab9d0-0a7c-4528-9ce8-c154c3a56fd1 req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Calling delete_port for 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:17:27.764963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c3ea73d-3129-4944-912b-ecff1a84b67d req-0e5c282b-88e0-48df-8228-8b9cebadb5aa tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:27.767491 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5c3ea73d-3129-4944-912b-ecff1a84b67d req-0e5c282b-88e0-48df-8228-8b9cebadb5aa tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.4235232 May 12 15:17:27.869535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d480fce8-f7d9-4d86-9f32-36f80f8d19d2 req-e474a682-92a4-42e1-9d00-bbefe3f66467 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:27.871116 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d480fce8-f7d9-4d86-9f32-36f80f8d19d2 req-e474a682-92a4-42e1-9d00-bbefe3f66467 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.76 "GET /v2.0/ports?device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 946 time: 0.4922211 May 12 15:17:27.885674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43b00f10-5237-470f-840a-154e41fb1926 req-0d608970-2a6b-436c-9312-ad92d9266b2f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:27.886380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-43b00f10-5237-470f-840a-154e41fb1926 req-0d608970-2a6b-436c-9312-ad92d9266b2f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Synchronizing usage tracker for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:17:27.994487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-d480fce8-f7d9-4d86-9f32-36f80f8d19d2 req-4d009026-8db9-418a-8570-ee7343e0825b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Deleting port 6f3b6fed-1d08-415e-857d-eb8cff28711f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:17:27.994835 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d480fce8-f7d9-4d86-9f32-36f80f8d19d2 req-4d009026-8db9-418a-8570-ee7343e0825b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:28.011390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ccf20c-b02b-4210-85df-cffa0ca7a270 req-430217f6-94d9-417a-8f7d-e30df17ebdf8 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:28.013562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-80ccf20c-b02b-4210-85df-cffa0ca7a270 req-430217f6-94d9-417a-8f7d-e30df17ebdf8 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.76 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 950 time: 0.4707232 May 12 15:17:28.063996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-43b00f10-5237-470f-840a-154e41fb1926 req-0d608970-2a6b-436c-9312-ad92d9266b2f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Unset dirty status for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:17:28.065167 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-43b00f10-5237-470f-840a-154e41fb1926 req-0d608970-2a6b-436c-9312-ad92d9266b2f tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 1.0210347 May 12 15:17:28.068115 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e5bab9d0-0a7c-4528-9ce8-c154c3a56fd1 req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:28.080836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['6f3b6fed-1d08-415e-857d-eb8cff28711f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:17:28.144013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['347edf1f-11b3-4ee3-8fb0-b951abe3dd4f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:17:28.183568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Pushing event deleted for resources: {'Port': ['ID=347edf1f-11b3-4ee3-8fb0-b951abe3dd4f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:28.262113 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5c3ea73d-3129-4944-912b-ecff1a84b67d req-996485cb-f641-49af-b496-4d6acab15dca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3549545 May 12 15:17:28.320198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-80ccf20c-b02b-4210-85df-cffa0ca7a270 req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Deleting port 8ab2c56a-0051-490d-aebb-ad60abc4bb93 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:17:28.323253 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-80ccf20c-b02b-4210-85df-cffa0ca7a270 req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:28.561297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:28.561676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:28.562181 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:28.562879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:28.563272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:28.563629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:28.563881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:28.564208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:28.564511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:28.564988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:28.565312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:28.565632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:28.580865 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0826b96-01b3-4d08-a853-2f1d57d81e2d req-2aaba60f-b78b-4670-929c-1f8d2fc8faec tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:28.589017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0826b96-01b3-4d08-a853-2f1d57d81e2d req-2aaba60f-b78b-4670-929c-1f8d2fc8faec tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ca7efd55-1093-4424-8b8a-43e0eeface30 HTTP/1.1" status: 200 len: 945 time: 0.9252002 May 12 15:17:28.594367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5bab9d0-0a7c-4528-9ce8-c154c3a56fd1 req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] No DVR routers for this DVR port 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:17:28.608920 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e5bab9d0-0a7c-4528-9ce8-c154c3a56fd1 req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:28.611677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ca7efd55-1093-4424-8b8a-43e0eeface30', 'name': 'network-vif-deleted', 'tag': '347edf1f-11b3-4ee3-8fb0-b951abe3dd4f'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:28.646238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-43b00f10-5237-470f-840a-154e41fb1926 req-550742c4-a74e-4dff-ada9-4478973fc3ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Deleting port 182e22d5-523d-40ba-8f4c-b88eabce6db7 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:17:28.646563 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-43b00f10-5237-470f-840a-154e41fb1926 req-550742c4-a74e-4dff-ada9-4478973fc3ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:28.720539 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0826b96-01b3-4d08-a853-2f1d57d81e2d req-612f8ffe-b348-4015-a0de-79dacd267a28 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/security-groups?id=814df81a-d1a0-4fdb-b4e6-962fafacfe9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1311548 May 12 15:17:28.776401 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e5bab9d0-0a7c-4528-9ce8-c154c3a56fd1 req-8f4eb657-d585-4922-b10a-87d283d9746a tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.84 "DELETE /v2.0/ports/347edf1f-11b3-4ee3-8fb0-b951abe3dd4f HTTP/1.1" status: 204 len: 173 time: 2.0196207 May 12 15:17:28.990486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-d480fce8-f7d9-4d86-9f32-36f80f8d19d2 req-4d009026-8db9-418a-8570-ee7343e0825b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] For port 6f3b6fed-1d08-415e-857d-eb8cff28711f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=6f3b6fed-1d08-415e-857d-eb8cff28711f,segment=NetworkSegment(d15583e1-352d-4594-8d9f-2e9d574c2f64),segment_id=d15583e1-352d-4594-8d9f-2e9d574c2f64)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:28.991128 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d480fce8-f7d9-4d86-9f32-36f80f8d19d2 req-4d009026-8db9-418a-8570-ee7343e0825b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:29.080970 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-01aebd89-a79f-44d5-ac75-1ba1e5316013 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] It took 0.24 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:17:29.174931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-d480fce8-f7d9-4d86-9f32-36f80f8d19d2 req-4d009026-8db9-418a-8570-ee7343e0825b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Calling delete_port for 6f3b6fed-1d08-415e-857d-eb8cff28711f owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:17:29.293077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57054) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:29.364620 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01aebd89-a79f-44d5-ac75-1ba1e5316013 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:29.391097 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01aebd89-a79f-44d5-ac75-1ba1e5316013 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:29.408863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-43b00f10-5237-470f-840a-154e41fb1926 req-550742c4-a74e-4dff-ada9-4478973fc3ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] For port 182e22d5-523d-40ba-8f4c-b88eabce6db7, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=182e22d5-523d-40ba-8f4c-b88eabce6db7,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:29.409218 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-43b00f10-5237-470f-840a-154e41fb1926 req-550742c4-a74e-4dff-ada9-4478973fc3ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:29.470422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-80ccf20c-b02b-4210-85df-cffa0ca7a270 req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] For port 8ab2c56a-0051-490d-aebb-ad60abc4bb93, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=8ab2c56a-0051-490d-aebb-ad60abc4bb93,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:29.471069 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-80ccf20c-b02b-4210-85df-cffa0ca7a270 req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:29.535354 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c1dc9772-357e-4570-9844-77a87ed56598'] response: {'server_uuid': 'ca7efd55-1093-4424-8b8a-43e0eeface30', 'name': 'network-vif-deleted', 'tag': '347edf1f-11b3-4ee3-8fb0-b951abe3dd4f', 'status': 'completed', 'code': 200} May 12 15:17:29.560844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-43b00f10-5237-470f-840a-154e41fb1926 req-550742c4-a74e-4dff-ada9-4478973fc3ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Calling delete_port for 182e22d5-523d-40ba-8f4c-b88eabce6db7 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:17:29.629042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9648f9f9-5263-4c11-9550-6dbb92eadba1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:29.641103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-80ccf20c-b02b-4210-85df-cffa0ca7a270 req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Calling delete_port for 8ab2c56a-0051-490d-aebb-ad60abc4bb93 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:17:29.673080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9648f9f9-5263-4c11-9550-6dbb92eadba1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:29.681907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9648f9f9-5263-4c11-9550-6dbb92eadba1 admin admin] Usage tracker for resource:security_group_rule and tenant:20a4ec9e3217431f9181a14b308d89e4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:29.686317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9648f9f9-5263-4c11-9550-6dbb92eadba1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:29.695280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9648f9f9-5263-4c11-9550-6dbb92eadba1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:29.722538 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d480fce8-f7d9-4d86-9f32-36f80f8d19d2 req-4d009026-8db9-418a-8570-ee7343e0825b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:29.788947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d009026-8db9-418a-8570-ee7343e0825b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Pushing event deleted for resources: {'Port': ['ID=6f3b6fed-1d08-415e-857d-eb8cff28711f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:29.792723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9146e555-4375-4d48-9e12-3a2a30ab24ae req-2a93901e-31a3-49fd-9043-1e2589837ce5 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:29.800384 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9146e555-4375-4d48-9e12-3a2a30ab24ae req-2a93901e-31a3-49fd-9043-1e2589837ce5 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 950 time: 0.8260150 May 12 15:17:29.912096 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-01aebd89-a79f-44d5-ac75-1ba1e5316013 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Floating IP 1764867b-4de0-4394-b192-67b196123be1 associated. External IP: 172.25.8.53, port: d3bf5047-6e8a-4d30-bf27-76571b79026a. May 12 15:17:29.939785 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-43b00f10-5237-470f-840a-154e41fb1926 req-550742c4-a74e-4dff-ada9-4478973fc3ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:29.977711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f0d25bc9-ee34-4065-92d8-0ccb85b91668'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:17:29.985820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-d480fce8-f7d9-4d86-9f32-36f80f8d19d2 req-4d009026-8db9-418a-8570-ee7343e0825b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] No DVR routers for this DVR port 6f3b6fed-1d08-415e-857d-eb8cff28711f on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:17:29.993216 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9146e555-4375-4d48-9e12-3a2a30ab24ae req-bb883169-a747-4872-b8af-7b01e5ee6f97 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/security-groups?id=6b03284d-e876-4ec6-9035-8aded6b25eb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1925433 May 12 15:17:30.007206 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d480fce8-f7d9-4d86-9f32-36f80f8d19d2 req-4d009026-8db9-418a-8570-ee7343e0825b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:30.010758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-550742c4-a74e-4dff-ada9-4478973fc3ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event deleted for resources: {'Port': ['ID=182e22d5-523d-40ba-8f4c-b88eabce6db7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:30.125890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee330108-4ed4-4174-8dc8-408c5c1a4ec9 req-ca57ecdd-e992-473c-8048-55eabed8d8dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:30.135171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-43b00f10-5237-470f-840a-154e41fb1926 req-550742c4-a74e-4dff-ada9-4478973fc3ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] No DVR routers for this DVR port 182e22d5-523d-40ba-8f4c-b88eabce6db7 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:17:30.136598 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee330108-4ed4-4174-8dc8-408c5c1a4ec9 req-ca57ecdd-e992-473c-8048-55eabed8d8dc tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=013bfc4f-b074-4b38-a7be-ae5aa7b41b5f HTTP/1.1" status: 200 len: 945 time: 0.5034182 May 12 15:17:30.140502 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-43b00f10-5237-470f-840a-154e41fb1926 req-550742c4-a74e-4dff-ada9-4478973fc3ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:30.143029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-43b00f10-5237-470f-840a-154e41fb1926 req-550742c4-a74e-4dff-ada9-4478973fc3ca tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "DELETE /v2.0/ports/182e22d5-523d-40ba-8f4c-b88eabce6db7 HTTP/1.1" status: 204 len: 173 time: 2.0703108 May 12 15:17:30.155143 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 6f3b6fed-1d08-415e-857d-eb8cff28711f no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:17:30.156116 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d480fce8-f7d9-4d86-9f32-36f80f8d19d2 req-4d009026-8db9-418a-8570-ee7343e0825b tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.76 "DELETE /v2.0/ports/6f3b6fed-1d08-415e-857d-eb8cff28711f HTTP/1.1" status: 204 len: 173 time: 2.2535954 May 12 15:17:30.169217 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9648f9f9-5263-4c11-9550-6dbb92eadba1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:30.175345 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-80ccf20c-b02b-4210-85df-cffa0ca7a270 req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:30.177135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9648f9f9-5263-4c11-9550-6dbb92eadba1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:30.250117 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9648f9f9-5263-4c11-9550-6dbb92eadba1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=20a4ec9e3217431f9181a14b308d89e4&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9555008 May 12 15:17:30.251323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9648f9f9-5263-4c11-9550-6dbb92eadba1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d619ee82-65a7-4581-9826-53cc55582911,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:30.254342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57064) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:30.306513 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Pushing event deleted for resources: {'Port': ['ID=8ab2c56a-0051-490d-aebb-ad60abc4bb93,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:30.341723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 6f3b6fed-1d08-415e-857d-eb8cff28711f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:17:30.342453 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 6f3b6fed-1d08-415e-857d-eb8cff28711f not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:17:30.344272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 8ab2c56a-0051-490d-aebb-ad60abc4bb93 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:17:30.344444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:30.344660 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:30.345025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:30.345591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:30.345951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:30.346316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:30.346835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:30.347136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:30.347597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:30.348051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:30.348601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:30.349112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:17:30.390071 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee330108-4ed4-4174-8dc8-408c5c1a4ec9 req-6dc2a2cb-9c14-48fc-810a-8c1ba6745111 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2522597 May 12 15:17:30.432117 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0664eb88-c80e-4bb6-b514-4a5cb14ccded admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:30.472633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 8ab2c56a-0051-490d-aebb-ad60abc4bb93 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:17:30.472968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 8ab2c56a-0051-490d-aebb-ad60abc4bb93 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:17:30.473379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c0f50665-5b0d-4723-ad87-6d08af238805 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:17:30.486604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0664eb88-c80e-4bb6-b514-4a5cb14ccded admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:30.554007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-80ccf20c-b02b-4210-85df-cffa0ca7a270 req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] No DVR routers for this DVR port 8ab2c56a-0051-490d-aebb-ad60abc4bb93 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:17:30.559460 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-80ccf20c-b02b-4210-85df-cffa0ca7a270 req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:30.562472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '71f83a02-9762-4c31-8aff-f37bf97aa06b', 'name': 'network-vif-deleted', 'tag': '8ab2c56a-0051-490d-aebb-ad60abc4bb93'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:30.586455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0664eb88-c80e-4bb6-b514-4a5cb14ccded admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:30.647729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0664eb88-c80e-4bb6-b514-4a5cb14ccded admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d619ee82-65a7-4581-9826-53cc55582911,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:30.658766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0664eb88-c80e-4bb6-b514-4a5cb14ccded admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:30.660540 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0664eb88-c80e-4bb6-b514-4a5cb14ccded admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d619ee82-65a7-4581-9826-53cc55582911 HTTP/1.1" status: 204 len: 168 time: 0.4030902 May 12 15:17:30.736756 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-12ec31e7-14f7-4df7-ba10-bf85293485cc'] response: {'server_uuid': '71f83a02-9762-4c31-8aff-f37bf97aa06b', 'name': 'network-vif-deleted', 'tag': '8ab2c56a-0051-490d-aebb-ad60abc4bb93', 'status': 'completed', 'code': 200} May 12 15:17:30.776188 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-80ccf20c-b02b-4210-85df-cffa0ca7a270 req-b82d9a44-994f-4004-9b35-ed1388e1e837 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.76 "DELETE /v2.0/ports/8ab2c56a-0051-490d-aebb-ad60abc4bb93 HTTP/1.1" status: 204 len: 173 time: 2.7552993 May 12 15:17:30.868288 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:30.937016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c0f50665-5b0d-4723-ad87-6d08af238805, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c0f50665-5b0d-4723-ad87-6d08af238805,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:30.949195 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c404b13c-0df0-43be-82ae-456d361c1059', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c0f50665-5b0d-4723-ad87-6d08af238805'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:30.962994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:17:31.010221 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:31.090498 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9bb25ff0-98c9-4411-b968-095ee950b857 req-1d9a2e64-28f1-407e-a170-3cb604de6473 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] 10.222.0.82 "GET /v2.0/ports?device_id=ab5ed14f-8344-46e1-b6e8-3bb09abee741 HTTP/1.1" status: 200 len: 210 time: 0.1350164 May 12 15:17:31.106208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c0f50665-5b0d-4723-ad87-6d08af238805,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:31.112932 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:17:31.113471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 347edf1f-11b3-4ee3-8fb0-b951abe3dd4f not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:17:31.114060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 182e22d5-523d-40ba-8f4c-b88eabce6db7 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:17:31.200717 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-df7ba337-5ae4-4dab-a9fb-143e859838f7'] response: {'server_uuid': 'c404b13c-0df0-43be-82ae-456d361c1059', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c0f50665-5b0d-4723-ad87-6d08af238805', 'code': 200} May 12 15:17:31.201379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 182e22d5-523d-40ba-8f4c-b88eabce6db7 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:17:31.202162 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 182e22d5-523d-40ba-8f4c-b88eabce6db7 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:17:31.253963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57094) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:31.284105 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-801eff49-722f-4bd2-aa42-df9d201e3533 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:31.288295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-01aebd89-a79f-44d5-ac75-1ba1e5316013 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:17:31.305686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3e97a491-ced2-4d67-86a3-790328dbe97b tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:31.307111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3e97a491-ced2-4d67-86a3-790328dbe97b tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/networks?id=c3c7ba99-d7de-4515-b784-ef9ce8b08726 HTTP/1.1" status: 200 len: 805 time: 0.4140036 May 12 15:17:31.316543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-801eff49-722f-4bd2-aa42-df9d201e3533 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:31.321022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-801eff49-722f-4bd2-aa42-df9d201e3533 admin admin] Usage tracker for resource:security_group_rule and tenant:31b75da6bf1a4a428c3f4d956fefc95f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:31.324380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-801eff49-722f-4bd2-aa42-df9d201e3533 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:31.330610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-801eff49-722f-4bd2-aa42-df9d201e3533 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:31.425520 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-801eff49-722f-4bd2-aa42-df9d201e3533 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:31.434721 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-801eff49-722f-4bd2-aa42-df9d201e3533 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:31.489957 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-801eff49-722f-4bd2-aa42-df9d201e3533 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=31b75da6bf1a4a428c3f4d956fefc95f&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2348473 May 12 15:17:31.492140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-801eff49-722f-4bd2-aa42-df9d201e3533 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=09dcacb7-7279-418e-af34-4bac86046b31,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:31.494957 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57100) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:31.592415 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-b40a9acb-5af3-461e-ac60-a6e1bbe6cee7 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/quotas/7d73e66034f94885ae45429129883002 HTTP/1.1" status: 200 len: 375 time: 0.2770891 May 12 15:17:31.593752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6595a3ce-8a1f-477f-b3a7-78d0a2971480 req-f0fa652f-8a77-4f9a-aae0-fbdde7f50fb2 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Synchronizing usage tracker for tenant:4e05bf2d5a814ea6880baa36c838e794 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:17:31.621504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ab5ed14f-8344-46e1-b6e8-3bb09abee741', 'name': 'network-vif-deleted', 'tag': '6f3b6fed-1d08-415e-857d-eb8cff28711f'}, {'server_uuid': '013bfc4f-b074-4b38-a7be-ae5aa7b41b5f', 'name': 'network-vif-deleted', 'tag': '182e22d5-523d-40ba-8f4c-b88eabce6db7'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:31.675886 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-232b35cf-8b0a-48a0-884d-f86ec043e13c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:31.708296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-232b35cf-8b0a-48a0-884d-f86ec043e13c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:31.730750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6595a3ce-8a1f-477f-b3a7-78d0a2971480 req-f0fa652f-8a77-4f9a-aae0-fbdde7f50fb2 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] Unset dirty status for tenant:4e05bf2d5a814ea6880baa36c838e794 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:17:31.731880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6595a3ce-8a1f-477f-b3a7-78d0a2971480 req-f0fa652f-8a77-4f9a-aae0-fbdde7f50fb2 tempest-ServerDiagnosticsNegativeTest-2097986693 tempest-ServerDiagnosticsNegativeTest-2097986693-project] 10.222.0.82 "GET /v2.0/ports?device_id=71f83a02-9762-4c31-8aff-f37bf97aa06b HTTP/1.1" status: 200 len: 210 time: 0.2204261 May 12 15:17:31.762691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-01aebd89-a79f-44d5-ac75-1ba1e5316013 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:17:31.767765 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01aebd89-a79f-44d5-ac75-1ba1e5316013 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:31.779225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51cb7a63-3391-4ef3-b814-c5e43d0a48f5 None None] Sync routers for ids ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:17:31.784409 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-232b35cf-8b0a-48a0-884d-f86ec043e13c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:31.790226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51cb7a63-3391-4ef3-b814-c5e43d0a48f5 None None] Routers {'1131f7ae-7566-4efd-ac8e-02ea4717a2aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:17:31.791021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-51cb7a63-3391-4ef3-b814-c5e43d0a48f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:17:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:17:31.800264 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:17:31.813212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-232b35cf-8b0a-48a0-884d-f86ec043e13c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=09dcacb7-7279-418e-af34-4bac86046b31,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:31.820756 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-232b35cf-8b0a-48a0-884d-f86ec043e13c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:31.822688 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-232b35cf-8b0a-48a0-884d-f86ec043e13c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/09dcacb7-7279-418e-af34-4bac86046b31 HTTP/1.1" status: 204 len: 168 time: 0.3268139 May 12 15:17:31.839215 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-01aebd89-a79f-44d5-ac75-1ba1e5316013 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "PUT /v2.0/floatingips/1764867b-4de0-4394-b192-67b196123be1 HTTP/1.1" status: 200 len: 990 time: 4.8350825 May 12 15:17:31.844382 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-c62a7823-3543-4ed7-883c-7685afaa9403 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=7d73e66034f94885ae45429129883002&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2383561 May 12 15:17:31.911747 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9cc739fc-2f22-4c76-ad02-58c20f637b24'] response: {'server_uuid': 'ab5ed14f-8344-46e1-b6e8-3bb09abee741', 'name': 'network-vif-deleted', 'tag': '6f3b6fed-1d08-415e-857d-eb8cff28711f', 'status': 'completed', 'code': 200} May 12 15:17:31.912201 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9cc739fc-2f22-4c76-ad02-58c20f637b24'] response: {'server_uuid': '013bfc4f-b074-4b38-a7be-ae5aa7b41b5f', 'name': 'network-vif-deleted', 'tag': '182e22d5-523d-40ba-8f4c-b88eabce6db7', 'status': 'completed', 'code': 200} May 12 15:17:32.030124 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-51cb7a63-3391-4ef3-b814-c5e43d0a48f5 None None] Set router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:17:32.120856 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27e8fd3e-caf6-409e-a3a4-643cd1a37a5b service neutron] 10.222.0.82 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2665534 May 12 15:17:32.166028 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:32.260021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef1405ac-0415-44bb-99af-72c38c9d27b2 req-b023adf0-b549-412b-8e06-9c754ae86c0e tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:32.261517 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef1405ac-0415-44bb-99af-72c38c9d27b2 req-b023adf0-b549-412b-8e06-9c754ae86c0e tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.76 "GET /v2.0/ports?device_id=c404b13c-0df0-43be-82ae-456d361c1059 HTTP/1.1" status: 200 len: 943 time: 0.3012052 May 12 15:17:32.297208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da11e9cb-394d-44eb-a67e-23bce3c1003c req-c13e6ce7-182b-4cf1-9485-5796e4ea9d72 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:32.299321 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da11e9cb-394d-44eb-a67e-23bce3c1003c req-c13e6ce7-182b-4cf1-9485-5796e4ea9d72 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 945 time: 0.2820864 May 12 15:17:32.422311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-ef1405ac-0415-44bb-99af-72c38c9d27b2 req-aca87454-a30b-4f0d-a7bb-517902e5d3ea tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Deleting port c0f50665-5b0d-4723-ad87-6d08af238805 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:17:32.422691 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ef1405ac-0415-44bb-99af-72c38c9d27b2 req-aca87454-a30b-4f0d-a7bb-517902e5d3ea tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:32.432196 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-51cb7a63-3391-4ef3-b814-c5e43d0a48f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194'}], 'enable_snat': True}, 'gw_port_id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:16:20Z', 'revision_number': 4, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port': {'id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:79:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1085, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:15Z', 'updated_at': '2022-05-12T15:16:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '1764867b-4de0-4394-b192-67b196123be1', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'floating_ip_address': '172.25.8.53', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'port_id': 'd3bf5047-6e8a-4d30-bf27-76571b79026a', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 1093, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'mac_address': 'fa:16:3e:69:4f:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:16:28Z', 'updated_at': '2022-05-12T15:17:28Z', 'revision_number': 1, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '68f43459-2da5-4601-a6c1-9d5d57573727', 'name': '', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'mac_address': 'fa:16:3e:90:e0:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 1086, 'fixed_ips': [{'subnet_id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:19Z', 'updated_at': '2022-05-12T15:16:30Z', 'revision_number': 5, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'subnets': [{'id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:17:32.435275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51cb7a63-3391-4ef3-b814-c5e43d0a48f5 None None] Checking router: 1131f7ae-7566-4efd-ac8e-02ea4717a2aa for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:17:32.453827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51cb7a63-3391-4ef3-b814-c5e43d0a48f5 None None] Routers {'1131f7ae-7566-4efd-ac8e-02ea4717a2aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:17:32.455217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-51cb7a63-3391-4ef3-b814-c5e43d0a48f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:17:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:17:32.488828 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-aca871e2-aa0a-461c-b5b0-738615a5c487 service neutron] 10.222.0.82 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3592582 May 12 15:17:32.514594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da11e9cb-394d-44eb-a67e-23bce3c1003c req-19446607-e43f-4721-866a-56d93d0a3a11 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1832657 May 12 15:17:32.689064 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-51cb7a63-3391-4ef3-b814-c5e43d0a48f5 None None] Set router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:17:32.791122 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57142) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:32.869227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'tag': 'd3bf5047-6e8a-4d30-bf27-76571b79026a'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:32.933724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-3a4cb59c-f355-4b30-8f61-ed1b17151985 admin admin] Deleting subnet bbf4de36-cca3-4e54-b76e-de177b2d73c3 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:17:32.943453 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a4cb59c-f355-4b30-8f61-ed1b17151985 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:32.997149 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc62127e-a675-49ff-b5b6-b24fd4fd9fd0 req-61bbb615-f2ba-4cfd-8a86-d3af289b1aff tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 210 time: 0.1208091 May 12 15:17:33.151246 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-745f9ae3-068b-4cd0-a456-b65bc4c8f350'] response: {'name': 'network-changed', 'server_uuid': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'tag': 'd3bf5047-6e8a-4d30-bf27-76571b79026a', 'status': 'completed', 'code': 200} May 12 15:17:33.186965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-ef1405ac-0415-44bb-99af-72c38c9d27b2 req-aca87454-a30b-4f0d-a7bb-517902e5d3ea tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] For port c0f50665-5b0d-4723-ad87-6d08af238805, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c0f50665-5b0d-4723-ad87-6d08af238805,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:33.186965 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ef1405ac-0415-44bb-99af-72c38c9d27b2 req-aca87454-a30b-4f0d-a7bb-517902e5d3ea tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:33.331243 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a4cb59c-f355-4b30-8f61-ed1b17151985 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:33.472109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-ef1405ac-0415-44bb-99af-72c38c9d27b2 req-aca87454-a30b-4f0d-a7bb-517902e5d3ea tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Calling delete_port for c0f50665-5b0d-4723-ad87-6d08af238805 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:17:33.528627 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a4cb59c-f355-4b30-8f61-ed1b17151985 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:33.672016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a4cb59c-f355-4b30-8f61-ed1b17151985 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:33.735507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57174) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:33.755374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29de0578-356a-4c47-bf9a-d1623d416e69 req-29b2b48f-4fc4-48d1-9c78-bbcadf848c33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:33.761198 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29de0578-356a-4c47-bf9a-d1623d416e69 req-29b2b48f-4fc4-48d1-9c78-bbcadf848c33 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=60b7c456959149269dc444554ba6a6c2&device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 1096 time: 0.6258156 May 12 15:17:33.771001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a4cb59c-f355-4b30-8f61-ed1b17151985 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bbf4de36-cca3-4e54-b76e-de177b2d73c3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:33.786847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-51cb7a63-3391-4ef3-b814-c5e43d0a48f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194'}], 'enable_snat': True}, 'gw_port_id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:16:20Z', 'revision_number': 4, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port': {'id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:79:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1085, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:15Z', 'updated_at': '2022-05-12T15:16:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '1764867b-4de0-4394-b192-67b196123be1', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'floating_ip_address': '172.25.8.53', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'port_id': 'd3bf5047-6e8a-4d30-bf27-76571b79026a', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 1093, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'mac_address': 'fa:16:3e:69:4f:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:16:28Z', 'updated_at': '2022-05-12T15:17:28Z', 'revision_number': 1, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '68f43459-2da5-4601-a6c1-9d5d57573727', 'name': '', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'mac_address': 'fa:16:3e:90:e0:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 1086, 'fixed_ips': [{'subnet_id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:19Z', 'updated_at': '2022-05-12T15:16:30Z', 'revision_number': 5, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'subnets': [{'id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:17:33.805668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51cb7a63-3391-4ef3-b814-c5e43d0a48f5 None None] The sync data for ids ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'] in n-d-841483-1 is: [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194'}], 'enable_snat': True}, 'gw_port_id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:16:20Z', 'revision_number': 4, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port': {'id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:79:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1085, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:15Z', 'updated_at': '2022-05-12T15:16:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '1764867b-4de0-4394-b192-67b196123be1', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'floating_ip_address': '172.25.8.53', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'port_id': 'd3bf5047-6e8a-4d30-bf27-76571b79026a', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 1093, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'mac_address': 'fa:16:3e:69:4f:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:16:28Z', 'updated_at': '2022-05-12T15:17:28Z', 'revision_number': 1, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '68f43459-2da5-4601-a6c1-9d5d57573727', 'name': '', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'mac_address': 'fa:16:3e:90:e0:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 1086, 'fixed_ips': [{'subnet_id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:19Z', 'updated_at': '2022-05-12T15:16:30Z', 'revision_number': 5, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'subnets': [{'id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:17:33.839169 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ef1405ac-0415-44bb-99af-72c38c9d27b2 req-aca87454-a30b-4f0d-a7bb-517902e5d3ea tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:34.016483 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a4cb59c-f355-4b30-8f61-ed1b17151985 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:34.050458 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3a4cb59c-f355-4b30-8f61-ed1b17151985 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/bbf4de36-cca3-4e54-b76e-de177b2d73c3 HTTP/1.1" status: 204 len: 168 time: 1.2558131 May 12 15:17:34.051079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57188) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:34.199895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca87454-a30b-4f0d-a7bb-517902e5d3ea tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Pushing event deleted for resources: {'Port': ['ID=c0f50665-5b0d-4723-ad87-6d08af238805,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:34.303804 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d51b667c-881b-4823-b265-06504893087d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:34.310520 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4654231-31d2-4572-91fb-ab6fb3e347dc None None] New status for floating IP 1764867b-4de0-4394-b192-67b196123be1: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:17:34.479192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-ef1405ac-0415-44bb-99af-72c38c9d27b2 req-aca87454-a30b-4f0d-a7bb-517902e5d3ea tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] No DVR routers for this DVR port c0f50665-5b0d-4723-ad87-6d08af238805 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:17:34.485168 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ef1405ac-0415-44bb-99af-72c38c9d27b2 req-aca87454-a30b-4f0d-a7bb-517902e5d3ea tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:34.499278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-edeffdcb-aa50-430c-bef9-dfdc559cb4e6 req-3d89ebc0-6e27-4ad2-af4b-d28057d51b32 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 210 time: 0.1885273 May 12 15:17:34.539749 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4e3832e0-8513-497e-b4e2-212a02a20b7e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4e05bf2d5a814ea6880baa36c838e794&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8001237 May 12 15:17:34.541705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57204) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:34.548652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef1405ac-0415-44bb-99af-72c38c9d27b2 req-aca87454-a30b-4f0d-a7bb-517902e5d3ea tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.76 "DELETE /v2.0/ports/c0f50665-5b0d-4723-ad87-6d08af238805 HTTP/1.1" status: 204 len: 173 time: 2.2695282 May 12 15:17:34.622604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d51b667c-881b-4823-b265-06504893087d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:34.656849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d51b667c-881b-4823-b265-06504893087d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8c326986-914c-4d15-83ee-665daa53b37e']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:17:34.672330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d51b667c-881b-4823-b265-06504893087d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd15583e1-352d-4594-8d9f-2e9d574c2f64') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:17:34.672841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d51b667c-881b-4823-b265-06504893087d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd15583e1-352d-4594-8d9f-2e9d574c2f64') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:17:34.673861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e1b29279-8013-468c-824e-13dbdcf1f9e9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:34.689547 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d51b667c-881b-4823-b265-06504893087d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:34.712659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d51b667c-881b-4823-b265-06504893087d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:34.722746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d51b667c-881b-4823-b265-06504893087d admin admin] Releasing vlan 565 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:17:34.723197 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d51b667c-881b-4823-b265-06504893087d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:34.734786 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e1b29279-8013-468c-824e-13dbdcf1f9e9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: timer() May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:17:34.841783 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:17:34.879947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29de0578-356a-4c47-bf9a-d1623d416e69 req-9435c94e-68cd-4aa5-a280-a6496f2abd10 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:34.881467 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29de0578-356a-4c47-bf9a-d1623d416e69 req-9435c94e-68cd-4aa5-a280-a6496f2abd10 service neutron] 10.222.0.76 "GET /v2.0/networks?id=944a3072-30fa-47bc-9620-9dfd43f531e1 HTTP/1.1" status: 200 len: 916 time: 1.1132159 May 12 15:17:34.883915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d51b667c-881b-4823-b265-06504893087d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:34.920032 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e1b29279-8013-468c-824e-13dbdcf1f9e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:34.964784 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d51b667c-881b-4823-b265-06504893087d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:34.965357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1b29279-8013-468c-824e-13dbdcf1f9e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b03284d-e876-4ec6-9035-8aded6b25eb3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:34.975300 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e1b29279-8013-468c-824e-13dbdcf1f9e9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:34.978748 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e1b29279-8013-468c-824e-13dbdcf1f9e9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6b03284d-e876-4ec6-9035-8aded6b25eb3 HTTP/1.1" status: 204 len: 168 time: 0.4324763 May 12 15:17:35.077047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d51b667c-881b-4823-b265-06504893087d admin admin] Pushing event deleted for resources: {'Network': ['ID=8c326986-914c-4d15-83ee-665daa53b37e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:35.103043 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d51b667c-881b-4823-b265-06504893087d admin admin] 10.222.0.82 "DELETE /v2.0/networks/8c326986-914c-4d15-83ee-665daa53b37e HTTP/1.1" status: 204 len: 168 time: 1.0505929 May 12 15:17:35.143416 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29de0578-356a-4c47-bf9a-d1623d416e69 req-15b0b241-406b-4616-bca4-59662b6d32d2 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=d3bf5047-6e8a-4d30-bf27-76571b79026a HTTP/1.1" status: 200 len: 1000 time: 0.2516181 May 12 15:17:35.153326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c404b13c-0df0-43be-82ae-456d361c1059', 'name': 'network-vif-deleted', 'tag': 'c0f50665-5b0d-4723-ad87-6d08af238805'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:35.232497 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-61254042-94f1-4da2-b966-ac7fa743b446'] response: {'server_uuid': 'c404b13c-0df0-43be-82ae-456d361c1059', 'name': 'network-vif-deleted', 'tag': 'c0f50665-5b0d-4723-ad87-6d08af238805', 'status': 'completed', 'code': 200} May 12 15:17:35.236272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-7d94e3bd-5460-4af5-ada2-0deb7c817bb2 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:35.242135 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-7d94e3bd-5460-4af5-ada2-0deb7c817bb2 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.84 "GET /v2.0/networks?id=c3c7ba99-d7de-4515-b784-ef9ce8b08726 HTTP/1.1" status: 200 len: 805 time: 0.3917706 May 12 15:17:35.272785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Request body: {'port': {'device_id': 'c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa', 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726', 'admin_state_up': True, 'tenant_id': '7d73e66034f94885ae45429129883002'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:35.449369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57236) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:35.451665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29de0578-356a-4c47-bf9a-d1623d416e69 req-2d3cd7df-3ea6-4f08-bf7a-9263c21980c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:35.454007 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29de0578-356a-4c47-bf9a-d1623d416e69 req-2d3cd7df-3ea6-4f08-bf7a-9263c21980c1 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=1972ca52-439b-4a99-be07-5a8a9346589c HTTP/1.1" status: 200 len: 854 time: 0.2949252 May 12 15:17:35.564233 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-35230897-4ec2-4482-b2cd-60dc71b241aa admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d6a33151cf37459889a9facebe6ff6fd&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1106992 May 12 15:17:35.566802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57242) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:35.852878 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bdac2ce9-609a-41cb-8284-78791619786d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:35.852878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d0ef9745-7681-4b78-b78a-fcf7a9e929ad req-ef31f633-5935-4327-b26e-5394a6c7b5f9 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Synchronizing usage tracker for tenant:7d73e66034f94885ae45429129883002 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:17:35.856051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:35.862726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29de0578-356a-4c47-bf9a-d1623d416e69 req-9104be64-cb16-4774-a965-d1ca0b1bfbe5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:35.862726 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29de0578-356a-4c47-bf9a-d1623d416e69 req-9104be64-cb16-4774-a965-d1ca0b1bfbe5 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=944a3072-30fa-47bc-9620-9dfd43f531e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3934007 May 12 15:17:35.865645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Usage tracker for resource:port and tenant:7d73e66034f94885ae45429129883002 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:35.901928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:35.916601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57248) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:35.917017 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bdac2ce9-609a-41cb-8284-78791619786d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:35.918715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:35.941943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6cc495a-04a5-4cc0-b477-0419fae09ac4 req-086b6c3e-5daf-4a43-bcb9-bbd0bf249b2e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:35.943232 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f6cc495a-04a5-4cc0-b477-0419fae09ac4 req-086b6c3e-5daf-4a43-bcb9-bbd0bf249b2e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 946 time: 0.3569088 May 12 15:17:36.026687 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8571512-da44-4271-b423-643e681f8006 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:36.043731 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f6cc495a-04a5-4cc0-b477-0419fae09ac4 req-c84c7ef3-af40-457d-9f57-e84bb37ac5aa tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0913577 May 12 15:17:36.045767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Made reservation on behalf of 7d73e66034f94885ae45429129883002 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:17:36.049993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:36.060445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d0ef9745-7681-4b78-b78a-fcf7a9e929ad req-ef31f633-5935-4327-b26e-5394a6c7b5f9 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Unset dirty status for tenant:7d73e66034f94885ae45429129883002 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:17:36.066908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0ef9745-7681-4b78-b78a-fcf7a9e929ad req-ef31f633-5935-4327-b26e-5394a6c7b5f9 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 210 time: 0.3428078 May 12 15:17:36.088234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e8571512-da44-4271-b423-643e681f8006 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:36.095150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e8571512-da44-4271-b423-643e681f8006 admin admin] Usage tracker for resource:security_group_rule and tenant:b8c4d8a131a748b29dfa043c845ddd39 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:36.100663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e8571512-da44-4271-b423-643e681f8006 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:36.121691 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bdac2ce9-609a-41cb-8284-78791619786d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:36.169208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdac2ce9-609a-41cb-8284-78791619786d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=814df81a-d1a0-4fdb-b4e6-962fafacfe9e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:36.172828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c0f50665-5b0d-4723-ad87-6d08af238805 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:17:36.190092 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bdac2ce9-609a-41cb-8284-78791619786d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:36.194430 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bdac2ce9-609a-41cb-8284-78791619786d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/814df81a-d1a0-4fdb-b4e6-962fafacfe9e HTTP/1.1" status: 204 len: 168 time: 0.6248918 May 12 15:17:36.244353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e8571512-da44-4271-b423-643e681f8006 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:36.321540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: c0f50665-5b0d-4723-ad87-6d08af238805 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:17:36.321540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c0f50665-5b0d-4723-ad87-6d08af238805 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:17:36.386879 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29de0578-356a-4c47-bf9a-d1623d416e69 req-37c4b471-d4ff-415b-a37f-458562975fdf service neutron] 10.222.0.76 "GET /v2.0/networks/944a3072-30fa-47bc-9620-9dfd43f531e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5172184 May 12 15:17:36.670792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Allocated IP 172.20.0.3 (c3c7ba99-d7de-4515-b784-ef9ce8b08726/2c6ef05c-5190-47b2-bba9-0d2bdacd727d/62a79e7a-b21f-4f5b-935e-b7b9c9759c49) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:17:36.698739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa71bb60-ce65-4c85-a18c-8a825bf947e5 req-c719d935-d3b8-4e4e-8ede-4945d3cae3b7 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:36.698739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-aa71bb60-ce65-4c85-a18c-8a825bf947e5 req-c719d935-d3b8-4e4e-8ede-4945d3cae3b7 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Synchronizing usage tracker for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:17:36.766127 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29de0578-356a-4c47-bf9a-d1623d416e69 req-c606c94e-b3e6-40d8-a978-2afccd92cafa service neutron] 10.222.0.76 "GET /v2.0/networks/944a3072-30fa-47bc-9620-9dfd43f531e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3691926 May 12 15:17:36.807707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-aa71bb60-ce65-4c85-a18c-8a825bf947e5 req-c719d935-d3b8-4e4e-8ede-4945d3cae3b7 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Unset dirty status for tenant:593ec496e5db4078be8dc940596be321 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:17:36.808484 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-aa71bb60-ce65-4c85-a18c-8a825bf947e5 req-c719d935-d3b8-4e4e-8ede-4945d3cae3b7 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 946 time: 0.7010460 May 12 15:17:36.829645 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8571512-da44-4271-b423-643e681f8006 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:36.879554 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8571512-da44-4271-b423-643e681f8006 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:36.959835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57278) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:37.124191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-aa71bb60-ce65-4c85-a18c-8a825bf947e5 req-7ff0c1b4-8f30-4616-a6f1-9211e25fe159 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Deleting port f0d25bc9-ee34-4065-92d8-0ccb85b91668 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:17:37.124670 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-aa71bb60-ce65-4c85-a18c-8a825bf947e5 req-7ff0c1b4-8f30-4616-a6f1-9211e25fe159 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:37.201212 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e8571512-da44-4271-b423-643e681f8006 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b8c4d8a131a748b29dfa043c845ddd39&name=default HTTP/1.1" status: 200 len: 2983 time: 1.2800901 May 12 15:17:37.209412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57294) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:37.210887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8571512-da44-4271-b423-643e681f8006 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=326d3a68-d7df-4afa-a8e5-3321ee6e0452,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:37.312700 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-529896b5-7122-4255-baa5-dc8e4db792a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:37.332485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-529896b5-7122-4255-baa5-dc8e4db792a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:37.337757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-529896b5-7122-4255-baa5-dc8e4db792a7 admin admin] Usage tracker for resource:security_group_rule and tenant:2f9ca5c274944d9a91b21e20ae6579f0 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:37.343255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-529896b5-7122-4255-baa5-dc8e4db792a7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:37.349763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-529896b5-7122-4255-baa5-dc8e4db792a7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:37.461445 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-529896b5-7122-4255-baa5-dc8e4db792a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:37.528746 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-529896b5-7122-4255-baa5-dc8e4db792a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:37.566933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-529896b5-7122-4255-baa5-dc8e4db792a7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2f9ca5c274944d9a91b21e20ae6579f0&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5963047 May 12 15:17:37.578497 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e13a099a-dbbe-4536-aa01-fd63bbae498a req-67c8257b-ae43-4713-a052-564ff6375ddf tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 210 time: 0.2574220 May 12 15:17:37.578497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57300) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:37.578497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57302) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:37.636720 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-331eb3c5-2a33-4984-b4c8-125ca22d655b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:37.653337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-529896b5-7122-4255-baa5-dc8e4db792a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ffec3cc-a138-40d5-b291-099d198449a6,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:37.656747 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:37.694160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8f53380-f64e-4161-bc7a-aa2239901efe req-4625e5bf-43f3-4a75-b2c7-93a589264ab0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:37.706971 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8f53380-f64e-4161-bc7a-aa2239901efe req-4625e5bf-43f3-4a75-b2c7-93a589264ab0 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 946 time: 0.4621944 May 12 15:17:37.760082 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e5d5ec67-4cbf-4c15-b68e-eb12e48dcce8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:37.802541 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8f53380-f64e-4161-bc7a-aa2239901efe req-e8cd18fd-d06e-49c6-99d1-14e34bea5bae tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0953097 May 12 15:17:37.828516 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-331eb3c5-2a33-4984-b4c8-125ca22d655b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:37.837182 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e5d5ec67-4cbf-4c15-b68e-eb12e48dcce8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:37.947439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Request body: {'network': {'name': 'tempest-ServerAddressesTestJSON-924419251-network', 'tenant_id': 'db6e84e56b464218b2cf98e48803ecc6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:37.954149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-aa71bb60-ce65-4c85-a18c-8a825bf947e5 req-7ff0c1b4-8f30-4616-a6f1-9211e25fe159 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] For port f0d25bc9-ee34-4065-92d8-0ccb85b91668, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f0d25bc9-ee34-4065-92d8-0ccb85b91668,segment=NetworkSegment(76dd0247-55ca-4461-a3a9-cbb7a4a1c0db),segment_id=76dd0247-55ca-4461-a3a9-cbb7a4a1c0db)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:37.954149 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-aa71bb60-ce65-4c85-a18c-8a825bf947e5 req-7ff0c1b4-8f30-4616-a6f1-9211e25fe159 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:37.956185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:37.961256 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Usage tracker for resource:network and tenant:db6e84e56b464218b2cf98e48803ecc6 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:37.967381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:37.976464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:37.994245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Made reservation on behalf of db6e84e56b464218b2cf98e48803ecc6 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:17:37.999047 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:38.016023 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:38.042940 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:38.045167 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e5d5ec67-4cbf-4c15-b68e-eb12e48dcce8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:38.061283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Usage tracker for resource:security_group_rule and tenant:db6e84e56b464218b2cf98e48803ecc6 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:38.068970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:38.083723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:38.087588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5d5ec67-4cbf-4c15-b68e-eb12e48dcce8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ffec3cc-a138-40d5-b291-099d198449a6,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:38.098494 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e5d5ec67-4cbf-4c15-b68e-eb12e48dcce8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:38.098494 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e5d5ec67-4cbf-4c15-b68e-eb12e48dcce8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0ffec3cc-a138-40d5-b291-099d198449a6 HTTP/1.1" status: 204 len: 168 time: 0.5190773 May 12 15:17:38.106206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-aa71bb60-ce65-4c85-a18c-8a825bf947e5 req-7ff0c1b4-8f30-4616-a6f1-9211e25fe159 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Calling delete_port for f0d25bc9-ee34-4065-92d8-0ccb85b91668 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:17:38.160865 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:38.218157 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-331eb3c5-2a33-4984-b4c8-125ca22d655b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:38.285675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-331eb3c5-2a33-4984-b4c8-125ca22d655b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=326d3a68-d7df-4afa-a8e5-3321ee6e0452,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:38.318450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Network c3c7ba99-d7de-4515-b784-ef9ce8b08726 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:17:38.326623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:17:38.350875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:17:38.393475 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Pushing event updated for resources: {'Port': ['ID=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:38.406812 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:38.415335 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:38.523298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 577} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:17:38.548735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4e395d42-6618-448b-86db-de531277b740,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:38.561746 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:38.561746 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Added segment c10b7492-dfc4-4db2-a596-efed2db5a402 of type vlan for network 816f8c56-908e-4b85-8d9f-fbb5d302b775 May 12 15:17:38.628852 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:38.859330 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:38.860261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:38.860837 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:38.910978 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-331eb3c5-2a33-4984-b4c8-125ca22d655b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:38.910978 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-331eb3c5-2a33-4984-b4c8-125ca22d655b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/326d3a68-d7df-4afa-a8e5-3321ee6e0452 HTTP/1.1" status: 204 len: 168 time: 1.6883087 May 12 15:17:38.974082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:38.975466 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:39.092552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57326) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:39.124605 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ca1ed63-1d40-413a-844f-fe6a37417916 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:39.140272 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-27102874-12f6-4bb6-88ed-aad195943c67 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.8763795 May 12 15:17:39.151021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0ca1ed63-1d40-413a-844f-fe6a37417916 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:39.159485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Request body: {'port': {'device_id': 'c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:39.179403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] Pushing event updated for resources: {'Network': ['ID=816f8c56-908e-4b85-8d9f-fbb5d302b775,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:39.190700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-42eb6b3b-6e7e-4ee2-991e-7614083878ad admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 1.6121016 May 12 15:17:39.190700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57332) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:39.201349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 816f8c56-908e-4b85-8d9f-fbb5d302b775 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:17:39.203430 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Request body: {'subnet': {'network_id': '816f8c56-908e-4b85-8d9f-fbb5d302b775', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerAddressesTestJSON-924419251-subnet', 'tenant_id': 'db6e84e56b464218b2cf98e48803ecc6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:39.205943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0ca1ed63-1d40-413a-844f-fe6a37417916 admin admin] Usage tracker for resource:security_group_rule and tenant:657ccdff50a0409b858a5d3ca61f95b9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:39.214521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:39.216763 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-aa71bb60-ce65-4c85-a18c-8a825bf947e5 req-7ff0c1b4-8f30-4616-a6f1-9211e25fe159 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:39.218710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0ca1ed63-1d40-413a-844f-fe6a37417916 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:39.234058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2c5021-aa8c-4571-a7de-cce47bce3bbe req-29bb0bf1-2379-40d0-8c52-5088282126e7 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:39.235865 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be2c5021-aa8c-4571-a7de-cce47bce3bbe req-29bb0bf1-2379-40d0-8c52-5088282126e7 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 931 time: 0.4402924 May 12 15:17:39.237431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Usage tracker for resource:subnet and tenant:db6e84e56b464218b2cf98e48803ecc6 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:39.246201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:39.275636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0ca1ed63-1d40-413a-844f-fe6a37417916 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:39.282189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:39.296273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ff0c1b4-8f30-4616-a6f1-9211e25fe159 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Pushing event deleted for resources: {'Port': ['ID=f0d25bc9-ee34-4065-92d8-0ccb85b91668,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:39.326442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc0a556a-4353-4962-8806-15f4764a6493 req-659cb42f-e68e-4668-80a0-4cc4258c8f6b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:39.328095 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc0a556a-4353-4962-8806-15f4764a6493 req-659cb42f-e68e-4668-80a0-4cc4258c8f6b tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/ports?device_id=15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f HTTP/1.1" status: 200 len: 946 time: 0.3036602 May 12 15:17:39.352173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Made reservation on behalf of db6e84e56b464218b2cf98e48803ecc6 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:17:39.354993 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:39.454647 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be2c5021-aa8c-4571-a7de-cce47bce3bbe req-2ee26a00-b829-429d-89b1-75373700ccb7 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2045345 May 12 15:17:39.468352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-aa71bb60-ce65-4c85-a18c-8a825bf947e5 req-7ff0c1b4-8f30-4616-a6f1-9211e25fe159 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] No DVR routers for this DVR port f0d25bc9-ee34-4065-92d8-0ccb85b91668 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:17:39.481067 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-aa71bb60-ce65-4c85-a18c-8a825bf947e5 req-7ff0c1b4-8f30-4616-a6f1-9211e25fe159 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:39.481067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f', 'name': 'network-vif-deleted', 'tag': 'f0d25bc9-ee34-4065-92d8-0ccb85b91668'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:39.512073 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:39.571422 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e2071ba2-4303-4754-af9c-1fff4b438dbf'] response: {'server_uuid': '15613bbc-4fb7-4a2e-9bb7-1eb02ff8fc1f', 'name': 'network-vif-deleted', 'tag': 'f0d25bc9-ee34-4065-92d8-0ccb85b91668', 'status': 'completed', 'code': 200} May 12 15:17:39.576782 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-aa71bb60-ce65-4c85-a18c-8a825bf947e5 req-7ff0c1b4-8f30-4616-a6f1-9211e25fe159 tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.84 "DELETE /v2.0/ports/f0d25bc9-ee34-4065-92d8-0ccb85b91668 HTTP/1.1" status: 204 len: 173 time: 2.7527018 May 12 15:17:39.691604 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc0a556a-4353-4962-8806-15f4764a6493 req-9f66d385-95c4-4b1b-8d46-e8bd8e0d420e tempest-ServersTestJSON-583449433 tempest-ServersTestJSON-583449433-project] 10.222.0.82 "GET /v2.0/security-groups?id=6de33d80-c657-4853-a4a3-0c0960619be7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3413734 May 12 15:17:39.695724 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ca1ed63-1d40-413a-844f-fe6a37417916 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:39.715350 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ca1ed63-1d40-413a-844f-fe6a37417916 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:39.782986 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:39.790877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ca1ed63-1d40-413a-844f-fe6a37417916 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56d8def2-ff80-4c76-9b5d-3cefdfc0308a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:39.796504 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0ca1ed63-1d40-413a-844f-fe6a37417916 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=657ccdff50a0409b858a5d3ca61f95b9&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7030368 May 12 15:17:39.802892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57348) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:39.872757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8a7d56be-ab61-4354-a111-fee7fdf5fe28,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:39.880854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Checking segment: {'id': 'c10b7492-dfc4-4db2-a596-efed2db5a402', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '816f8c56-908e-4b85-8d9f-fbb5d302b775'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:17:39.881210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Network hostable DHCP agents. Network: 816f8c56-908e-4b85-8d9f-fbb5d302b775, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:17:39.904828 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Network 816f8c56-908e-4b85-8d9f-fbb5d302b775 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:17:39.917695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 816f8c56-908e-4b85-8d9f-fbb5d302b775) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:17:39.942183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afbb33fd-f2a1-4e80-bcea-eb6dfc282eb4 None None] Network 816f8c56-908e-4b85-8d9f-fbb5d302b775 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:17:39.947150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:39.947150 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:40.012225 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-43ee7287-e5b2-4c86-8cb9-e03639bd3262 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:40.059684 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-43ee7287-e5b2-4c86-8cb9-e03639bd3262 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:40.148528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b57f5f16-e352-4e40-b596-af5659b770b3 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.9566934 May 12 15:17:40.174715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:17:40.183473 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:40.202474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Transition to ACTIVE for port object 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:17:40.204974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-43ee7287-e5b2-4c86-8cb9-e03639bd3262 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:40.235874 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:40.284058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43ee7287-e5b2-4c86-8cb9-e03639bd3262 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56d8def2-ff80-4c76-9b5d-3cefdfc0308a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:40.297623 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-43ee7287-e5b2-4c86-8cb9-e03639bd3262 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:40.298549 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-43ee7287-e5b2-4c86-8cb9-e03639bd3262 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/56d8def2-ff80-4c76-9b5d-3cefdfc0308a HTTP/1.1" status: 204 len: 168 time: 0.4444983 May 12 15:17:40.331503 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5b6085b-5f3c-47e9-988f-8f1832ff3fba None None] Network 816f8c56-908e-4b85-8d9f-fbb5d302b775 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:17:40.456236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Pushing event updated for resources: {'Port': ['ID=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:40.525846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Attempting to bind port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:17:40.526233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Attempting to bind port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:17:40.526566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Attempting to bind port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 on network c3c7ba99-d7de-4515-b784-ef9ce8b08726 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:17:40.544990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 on network c3c7ba99-d7de-4515-b784-ef9ce8b08726 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:17:40.545359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Attempting to bind port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 on network c3c7ba99-d7de-4515-b784-ef9ce8b08726 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:17:40.560271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 17, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:17:40.560605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Checking segment: {'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:17:40.560992 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Bound using segment: {'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:17:40.565639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Bound port: 62a79e7a-b21f-4f5b-935e-b7b9c9759c49, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:17:40.566300 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:40.743162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] For port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:17:40.746713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] For port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:17:40.755200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:40.876183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61fd83a0-35dd-49e9-9fca-6b93ba0d6f1d req-6b7ab43a-8c54-4814-a570-55522fab7466 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:40.882148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Pushing event updated for resources: {'Port': ['ID=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:40.882831 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61fd83a0-35dd-49e9-9fca-6b93ba0d6f1d req-6b7ab43a-8c54-4814-a570-55522fab7466 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 943 time: 0.2383585 May 12 15:17:40.884741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57380) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:40.888221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:40.888221 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:40.895721 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-3ee1497b-e1a7-4859-88e9-40bc30936030 service neutron] 10.222.0.84 "PUT /v2.0/ports/62a79e7a-b21f-4f5b-935e-b7b9c9759c49 HTTP/1.1" status: 200 len: 1091 time: 1.7388935 May 12 15:17:40.954256 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61fd83a0-35dd-49e9-9fca-6b93ba0d6f1d req-eff3208b-9f79-4f6a-8930-94e4b9482988 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556421 May 12 15:17:40.966409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f0d25bc9-ee34-4065-92d8-0ccb85b91668 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:17:41.040087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: f0d25bc9-ee34-4065-92d8-0ccb85b91668 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:17:41.041452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f0d25bc9-ee34-4065-92d8-0ccb85b91668 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:17:41.068189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-1dfb2951-20ad-4e72-8573-151d6b118e44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:41.071708 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-1dfb2951-20ad-4e72-8573-151d6b118e44 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=7d73e66034f94885ae45429129883002&device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 1094 time: 0.1083312 May 12 15:17:41.167863 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-de79e0a3-764c-4fc3-91c3-81fdd1a02892 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=62a79e7a-b21f-4f5b-935e-b7b9c9759c49 HTTP/1.1" status: 200 len: 217 time: 0.0816536 May 12 15:17:41.253351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-8771ea03-4f92-42f9-ab76-81037a87fe96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:41.254820 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-8771ea03-4f92-42f9-ab76-81037a87fe96 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=2c6ef05c-5190-47b2-bba9-0d2bdacd727d HTTP/1.1" status: 200 len: 845 time: 0.0795021 May 12 15:17:41.290357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-1a1b66c0-796a-42cd-ac0a-fd2d72a08baf admin admin] Deleting subnet 84c2082e-f394-46d5-8a8f-8e3a70d54fc1 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:17:41.321170 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a1b66c0-796a-42cd-ac0a-fd2d72a08baf admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:41.392561 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-347b1b98-e41b-4c7e-a7ae-14cec318c3d4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=c3c7ba99-d7de-4515-b784-ef9ce8b08726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1253567 May 12 15:17:41.497280 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a1b66c0-796a-42cd-ac0a-fd2d72a08baf admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:41.608554 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a1b66c0-796a-42cd-ac0a-fd2d72a08baf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:41.682489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa', 'tag': '62a79e7a-b21f-4f5b-935e-b7b9c9759c49'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:41.687497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-4ed753b2-376d-4517-b053-040b702b4b26 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:41.687497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-4ed753b2-376d-4517-b053-040b702b4b26 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Synchronizing usage tracker for tenant:db6e84e56b464218b2cf98e48803ecc6 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:17:41.744752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-4ed753b2-376d-4517-b053-040b702b4b26 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Unset dirty status for tenant:db6e84e56b464218b2cf98e48803ecc6 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:17:41.746013 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-4ed753b2-376d-4517-b053-040b702b4b26 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/networks?id=816f8c56-908e-4b85-8d9f-fbb5d302b775 HTTP/1.1" status: 200 len: 813 time: 0.3820076 May 12 15:17:41.768167 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-65cc9ebf-06c9-44ac-a085-8ee023c366d4'] response: {'name': 'network-changed', 'server_uuid': 'c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa', 'tag': '62a79e7a-b21f-4f5b-935e-b7b9c9759c49', 'status': 'completed', 'code': 200} May 12 15:17:41.781519 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-6dabc3f1-6ee7-4ff3-8608-b7c5a2168772 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/quotas/db6e84e56b464218b2cf98e48803ecc6 HTTP/1.1" status: 200 len: 375 time: 0.0170965 May 12 15:17:41.781519 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a1b66c0-796a-42cd-ac0a-fd2d72a08baf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:41.786770 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-c7b4c253-f0a6-4b65-9949-20fb5903ba81 service neutron] 10.222.0.84 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3858902 May 12 15:17:41.844488 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a1b66c0-796a-42cd-ac0a-fd2d72a08baf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:41.942073 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-bf2eaf7d-3776-4487-aae6-68a8b38ae8ec tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=db6e84e56b464218b2cf98e48803ecc6&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1479657 May 12 15:17:41.948058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a1b66c0-796a-42cd-ac0a-fd2d72a08baf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=84c2082e-f394-46d5-8a8f-8e3a70d54fc1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:41.957455 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1a1b66c0-796a-42cd-ac0a-fd2d72a08baf admin admin] 10.222.0.82 "DELETE /v2.0/subnets/84c2082e-f394-46d5-8a8f-8e3a70d54fc1 HTTP/1.1" status: 204 len: 168 time: 1.0693662 May 12 15:17:41.965667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57426) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:42.050819 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee17c485-b36d-49a2-aea4-44d1e36c7ac5 req-0f83ab86-fe92-474a-a7ea-8255890002ee service neutron] 10.222.0.84 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2576528 May 12 15:17:42.231536 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c424bda2-5c89-4574-9601-4fe8c8fd8d3b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:42.295770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4916d843-e8f8-4d71-af97-2589492d6a46 req-a96e38ae-a88b-4f2c-b01d-ff488d43a1db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:42.297259 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4916d843-e8f8-4d71-af97-2589492d6a46 req-a96e38ae-a88b-4f2c-b01d-ff488d43a1db service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=7d73e66034f94885ae45429129883002&device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 1094 time: 0.1526406 May 12 15:17:42.339840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-23e987d8-748e-4762-b8a9-bc18ef136c93 service neutron] 10.222.0.82 "GET /v2.0/networks/816f8c56-908e-4b85-8d9f-fbb5d302b775?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3755133 May 12 15:17:42.497414 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c424bda2-5c89-4574-9601-4fe8c8fd8d3b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:42.557073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-c424bda2-5c89-4574-9601-4fe8c8fd8d3b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dbc2e49c-2591-4534-a48c-cea8e23115f4']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:17:42.568400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4916d843-e8f8-4d71-af97-2589492d6a46 req-4b690cee-d835-4290-b74b-52e61353deb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:42.573402 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4916d843-e8f8-4d71-af97-2589492d6a46 req-4b690cee-d835-4290-b74b-52e61353deb5 service neutron] 10.222.0.84 "GET /v2.0/networks?id=c3c7ba99-d7de-4515-b784-ef9ce8b08726 HTTP/1.1" status: 200 len: 906 time: 0.2675579 May 12 15:17:42.579433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-c424bda2-5c89-4574-9601-4fe8c8fd8d3b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:17:42.579433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-c424bda2-5c89-4574-9601-4fe8c8fd8d3b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '76dd0247-55ca-4461-a3a9-cbb7a4a1c0db') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:17:42.663756 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-de46d957-8fec-441d-80cb-178a5b914e99 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:42.669953 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4916d843-e8f8-4d71-af97-2589492d6a46 req-2d736dde-23e1-4c96-afe5-a8199d90437d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=62a79e7a-b21f-4f5b-935e-b7b9c9759c49 HTTP/1.1" status: 200 len: 217 time: 0.0892222 May 12 15:17:42.695676 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c424bda2-5c89-4574-9601-4fe8c8fd8d3b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:42.728862 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c424bda2-5c89-4574-9601-4fe8c8fd8d3b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:42.740187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c424bda2-5c89-4574-9601-4fe8c8fd8d3b admin admin] Releasing vlan 558 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:17:42.740598 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c424bda2-5c89-4574-9601-4fe8c8fd8d3b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:42.772376 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:42.774734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4916d843-e8f8-4d71-af97-2589492d6a46 req-4983f492-6b1b-4631-aa4d-f8d2560b088d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: timer() May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:17:42.775235 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:17:42.777178 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4916d843-e8f8-4d71-af97-2589492d6a46 req-4983f492-6b1b-4631-aa4d-f8d2560b088d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=2c6ef05c-5190-47b2-bba9-0d2bdacd727d HTTP/1.1" status: 200 len: 845 time: 0.0998149 May 12 15:17:42.795462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-9f4673e2-6310-49b0-bc04-a6572f04a1c0 service neutron] 10.222.0.82 "GET /v2.0/networks/816f8c56-908e-4b85-8d9f-fbb5d302b775?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3955498 May 12 15:17:42.820144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57460) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:42.848967 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4916d843-e8f8-4d71-af97-2589492d6a46 req-bf0b4874-19df-4e25-a999-9e1345c0f963 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=c3c7ba99-d7de-4515-b784-ef9ce8b08726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0651495 May 12 15:17:42.983215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:17:43.053227 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c424bda2-5c89-4574-9601-4fe8c8fd8d3b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:43.058247 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4916d843-e8f8-4d71-af97-2589492d6a46 req-40a15796-a86a-48a8-9145-219ff4995ff4 service neutron] 10.222.0.84 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2011189 May 12 15:17:43.070325 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c424bda2-5c89-4574-9601-4fe8c8fd8d3b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:43.189879 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-199d5350-7d78-4cb4-bee2-e9062a0480cd req-2c23cf97-3a11-41fc-a726-d1fb966245ab tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0931749 May 12 15:17:43.204715 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6dcc4e9a-1c1d-45d5-9e5e-def8d8ef2313 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:43.248464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6dcc4e9a-1c1d-45d5-9e5e-def8d8ef2313 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:43.253639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6dcc4e9a-1c1d-45d5-9e5e-def8d8ef2313 admin admin] Usage tracker for resource:security_group_rule and tenant:73eea8c8c17e4e4189357af598240a7d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:43.256586 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c424bda2-5c89-4574-9601-4fe8c8fd8d3b admin admin] 10.222.0.82 "DELETE /v2.0/networks/dbc2e49c-2591-4534-a48c-cea8e23115f4 HTTP/1.1" status: 204 len: 168 time: 1.2901907 May 12 15:17:43.262808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c424bda2-5c89-4574-9601-4fe8c8fd8d3b admin admin] Pushing event deleted for resources: {'Network': ['ID=dbc2e49c-2591-4534-a48c-cea8e23115f4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:43.268665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6dcc4e9a-1c1d-45d5-9e5e-def8d8ef2313 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:43.307769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6dcc4e9a-1c1d-45d5-9e5e-def8d8ef2313 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:43.312628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:43.313198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0e2b57-5bd6-44a0-bd79-ee223be47022 req-4def2ed3-7913-43b3-bbee-4920773b7952 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:43.324047 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd0e2b57-5bd6-44a0-bd79-ee223be47022 req-4def2ed3-7913-43b3-bbee-4920773b7952 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 943 time: 0.5439906 May 12 15:17:43.348910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '62a79e7a-b21f-4f5b-935e-b7b9c9759c49', 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726', 'port_id': '62a79e7a-b21f-4f5b-935e-b7b9c9759c49', 'mac_address': 'fa:16:3e:05:a7:67', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 587, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2c6ef05c-5190-47b2-bba9-0d2bdacd727d', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:17:43.421322 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4916d843-e8f8-4d71-af97-2589492d6a46 req-1e9066cc-2783-4e7e-8b3b-c0aee0aff9c1 service neutron] 10.222.0.84 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3562391 May 12 15:17:43.486439 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6dcc4e9a-1c1d-45d5-9e5e-def8d8ef2313 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:43.496957 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6dcc4e9a-1c1d-45d5-9e5e-def8d8ef2313 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:43.501473 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:43.515438 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bfabef9e-4bc4-47cf-ba7b-4261aee2e01e req-5d2fdf93-d54c-4c11-b54d-89e4241ded55 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 210 time: 0.1782973 May 12 15:17:43.529523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57484) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:43.542630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:17:43.564641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:43.581166 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:43.588634 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd0e2b57-5bd6-44a0-bd79-ee223be47022 req-bfdcf5d9-0555-4711-bd54-4bf30b2b18c6 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2593205 May 12 15:17:43.677833 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:43.736950 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6dcc4e9a-1c1d-45d5-9e5e-def8d8ef2313 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=73eea8c8c17e4e4189357af598240a7d&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9023907 May 12 15:17:43.741338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57490) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:43.743143 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7fc4b522-18e5-4233-a5dc-0ff8505dfd13 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=593ec496e5db4078be8dc940596be321&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1792605 May 12 15:17:43.743143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57494) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:43.743143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dcc4e9a-1c1d-45d5-9e5e-def8d8ef2313 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=020f3f74-6223-4d9f-9702-da3e2cfa4863,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:43.847237 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4485cd78-1381-415a-9285-7b73913af9f8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:43.891973 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4485cd78-1381-415a-9285-7b73913af9f8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:43.974489 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4485cd78-1381-415a-9285-7b73913af9f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:43.993931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4485cd78-1381-415a-9285-7b73913af9f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6de33d80-c657-4853-a4a3-0c0960619be7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:44.002739 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4485cd78-1381-415a-9285-7b73913af9f8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:44.004195 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4485cd78-1381-415a-9285-7b73913af9f8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6de33d80-c657-4853-a4a3-0c0960619be7 HTTP/1.1" status: 204 len: 168 time: 0.2661521 May 12 15:17:44.008867 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0406c5c6-69ce-42ef-a491-c5b291973b0e req-afbd6ee4-966c-4fe1-852e-621b61a9fa05 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1891298 May 12 15:17:44.031584 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad5a67ae-eb7c-48bc-b44e-6d89b51c6ac8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:44.051663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['62a79e7a-b21f-4f5b-935e-b7b9c9759c49'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:17:44.071054 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad5a67ae-eb7c-48bc-b44e-6d89b51c6ac8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:44.129349 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad5a67ae-eb7c-48bc-b44e-6d89b51c6ac8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:44.144369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad5a67ae-eb7c-48bc-b44e-6d89b51c6ac8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=020f3f74-6223-4d9f-9702-da3e2cfa4863,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:44.153103 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad5a67ae-eb7c-48bc-b44e-6d89b51c6ac8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:44.154432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ad5a67ae-eb7c-48bc-b44e-6d89b51c6ac8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/020f3f74-6223-4d9f-9702-da3e2cfa4863 HTTP/1.1" status: 204 len: 168 time: 0.4239767 May 12 15:17:44.688446 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0072ab6-268f-4fd3-b49e-14ef6a38e5d7 req-b9d451a1-aee9-43b7-b124-a9c2212718d9 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 210 time: 0.0561874 May 12 15:17:44.876931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d57e9d-c7b2-4649-84ff-be6452a8333c req-bdcc0e49-10c8-4fda-b96f-5edfb3f31327 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:44.884628 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60d57e9d-c7b2-4649-84ff-be6452a8333c req-bdcc0e49-10c8-4fda-b96f-5edfb3f31327 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 944 time: 0.1441669 May 12 15:17:44.888396 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c1e17ef7-458e-4a1a-908b-8bdfe27328a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:44.943060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60d57e9d-c7b2-4649-84ff-be6452a8333c req-45ab4202-d8ed-4223-bed0-d370de794b4a tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0521653 May 12 15:17:45.165482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-8c09ab3d-f715-462c-82a5-d8eb51077749 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:45.167171 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-8c09ab3d-f715-462c-82a5-d8eb51077749 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.76 "GET /v2.0/networks?id=816f8c56-908e-4b85-8d9f-fbb5d302b775 HTTP/1.1" status: 200 len: 813 time: 0.2054567 May 12 15:17:45.180907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Request body: {'port': {'device_id': '729893e7-28d4-4b8b-87e3-9cfc0f7a7708', 'network_id': '816f8c56-908e-4b85-8d9f-fbb5d302b775', 'admin_state_up': True, 'tenant_id': 'db6e84e56b464218b2cf98e48803ecc6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:45.338630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eb28ffae-0edc-4313-85c9-3065ff7af9f7 req-e52761fb-9ea8-4db5-896f-c6b78cf374e6 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1363151 May 12 15:17:45.516777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:45.528337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Usage tracker for resource:port and tenant:db6e84e56b464218b2cf98e48803ecc6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:45.537912 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:45.547492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:45.564754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Made reservation on behalf of db6e84e56b464218b2cf98e48803ecc6 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:17:45.572939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:45.602481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1e93abf7-b403-4409-aad5-ece4707efa50 req-efb76644-ef7c-4f0b-aec9-08b72c95dba3 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0802777 May 12 15:17:45.915419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Allocated IP 172.20.0.4 (816f8c56-908e-4b85-8d9f-fbb5d302b775/8a7d56be-ab61-4354-a111-fee7fdf5fe28/d3bc3247-3265-4689-b2d2-150ee40d9459) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:17:45.972061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57562) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:46.031971 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99c26c59-b0e5-40aa-9841-177df35d49b2 req-e231fbc3-1274-46da-a899-0fc46da82ade tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 210 time: 0.0928319 May 12 15:17:46.068374 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:46.131599 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:46.280063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8505e654-4338-4a97-802f-95a6b12efdb3 req-cbd357e8-b418-4f06-9aa9-b7b4568d50e8 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:46.281898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8505e654-4338-4a97-802f-95a6b12efdb3 req-cbd357e8-b418-4f06-9aa9-b7b4568d50e8 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 944 time: 0.1275136 May 12 15:17:46.320012 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:46.363444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30653958-a583-4ff6-8a65-0d1b70869d04 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:46.377672 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:46.411072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8505e654-4338-4a97-802f-95a6b12efdb3 req-9f6f1e17-a7db-4f99-9973-b959ac0bfda1 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1212924 May 12 15:17:46.456844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-30653958-a583-4ff6-8a65-0d1b70869d04 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:46.459544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-30653958-a583-4ff6-8a65-0d1b70869d04 admin admin] Usage tracker for resource:security_group_rule and tenant:039382b4af274cff9dff13d1757d8fe5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:46.464158 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-30653958-a583-4ff6-8a65-0d1b70869d04 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:46.486472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-30653958-a583-4ff6-8a65-0d1b70869d04 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:46.529757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3446b18-7ef9-4fc1-a6cd-ff19b18f0e21 req-5176883a-6270-483d-bb06-2dbce483cc5d service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.1076217 May 12 15:17:46.540372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Network 816f8c56-908e-4b85-8d9f-fbb5d302b775 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:17:46.593017 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30653958-a583-4ff6-8a65-0d1b70869d04 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:46.594159 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:17:46.599556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:17:46.634520 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30653958-a583-4ff6-8a65-0d1b70869d04 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:46.693564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30653958-a583-4ff6-8a65-0d1b70869d04 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=94259b57-3374-4798-9869-77ca6d29b5da,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:46.700372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Pushing event updated for resources: {'Port': ['ID=d3bc3247-3265-4689-b2d2-150ee40d9459,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:46.726755 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-30653958-a583-4ff6-8a65-0d1b70869d04 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=039382b4af274cff9dff13d1757d8fe5&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7598345 May 12 15:17:46.729461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57584) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:46.752150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:46.753051 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:46.823922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3446b18-7ef9-4fc1-a6cd-ff19b18f0e21 req-56dc21f7-4393-4c22-9781-a8abe529e20f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.2387874 May 12 15:17:46.826626 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1abff0d8-a3a3-4b4d-9fb4-2811156020b0 req-3ef25fca-fdc6-43ed-8e29-47aebc40902b tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1150620 May 12 15:17:46.846591 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-2e258c41-65fc-49b6-aa47-78d2847de941 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6697190 May 12 15:17:46.867835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Request body: {'port': {'device_id': '729893e7-28d4-4b8b-87e3-9cfc0f7a7708', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:46.879185 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3446b18-7ef9-4fc1-a6cd-ff19b18f0e21 req-c9bc0de3-1fa4-422b-bce1-1110fc0d4bda service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0304229 May 12 15:17:46.911910 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f44c8308-7cc2-4a4f-983f-278926948560 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:46.982899 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:17:46.983913 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f44c8308-7cc2-4a4f-983f-278926948560 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:47.056965 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:47.079611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3446b18-7ef9-4fc1-a6cd-ff19b18f0e21 req-d0957447-f988-472f-af71-a05f88653995 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:47.081889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3446b18-7ef9-4fc1-a6cd-ff19b18f0e21 req-d0957447-f988-472f-af71-a05f88653995 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1907811 May 12 15:17:47.101943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:17:47.126237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:17:47.126237 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:47.173215 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f44c8308-7cc2-4a4f-983f-278926948560 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:47.297007 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:47.325565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a33c53c-4f60-402e-a48b-a64596ad4bec req-74bf04e0-1205-4278-8397-cc174dbf2848 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:47.333415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '62a79e7a-b21f-4f5b-935e-b7b9c9759c49'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:47.342168 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a33c53c-4f60-402e-a48b-a64596ad4bec req-74bf04e0-1205-4278-8397-cc174dbf2848 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 931 time: 0.1667590 May 12 15:17:47.374766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:47.385326 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:47.394351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1a33c53c-4f60-402e-a48b-a64596ad4bec req-746f0b2e-4d39-42f1-bfaf-b2fb00445760 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Synchronizing usage tracker for tenant:db6e84e56b464218b2cf98e48803ecc6 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:17:47.422653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f44c8308-7cc2-4a4f-983f-278926948560 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=94259b57-3374-4798-9869-77ca6d29b5da,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:47.432038 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f44c8308-7cc2-4a4f-983f-278926948560 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:47.432948 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f44c8308-7cc2-4a4f-983f-278926948560 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/94259b57-3374-4798-9869-77ca6d29b5da HTTP/1.1" status: 204 len: 168 time: 0.7021096 May 12 15:17:47.455198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1a33c53c-4f60-402e-a48b-a64596ad4bec req-746f0b2e-4d39-42f1-bfaf-b2fb00445760 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Unset dirty status for tenant:db6e84e56b464218b2cf98e48803ecc6 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:17:47.465199 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a33c53c-4f60-402e-a48b-a64596ad4bec req-746f0b2e-4d39-42f1-bfaf-b2fb00445760 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/security-groups?id=4e395d42-6618-448b-86db-de531277b740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1187119 May 12 15:17:47.476124 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1d2d9f27-a9ed-4d04-8555-d37d45d580d1'] response: {'server_uuid': 'c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '62a79e7a-b21f-4f5b-935e-b7b9c9759c49', 'code': 200} May 12 15:17:47.604650 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57608) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:47.619080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:47.628213 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:47.751656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2028aeb-89b2-46ec-b73a-5acc99b5890d req-5942d599-6be3-4f87-a9cb-5fd6152e0667 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:47.758649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d3bc3247-3265-4689-b2d2-150ee40d9459 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:17:47.761252 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2028aeb-89b2-46ec-b73a-5acc99b5890d req-5942d599-6be3-4f87-a9cb-5fd6152e0667 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 945 time: 0.1265905 May 12 15:17:47.765321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ed3f42e-64de-49ac-94d8-5edac50089e0 req-ecf26f4a-073a-4f40-9584-a92339167783 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:47.767307 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ed3f42e-64de-49ac-94d8-5edac50089e0 req-ecf26f4a-073a-4f40-9584-a92339167783 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 1096 time: 0.1780427 May 12 15:17:47.771905 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:47.822502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Transition to ACTIVE for port object d3bc3247-3265-4689-b2d2-150ee40d9459 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:17:47.831295 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ed3f42e-64de-49ac-94d8-5edac50089e0 req-6dd6295b-9fa3-4117-b002-a85fa3cd45ed service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554423 May 12 15:17:47.832152 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:47.834599 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2028aeb-89b2-46ec-b73a-5acc99b5890d req-97611c62-3c54-4510-9482-8495a6a699a3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646491 May 12 15:17:47.929187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:47.935821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:47.942854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Usage tracker for resource:floatingip and tenant:95dd8f9e0e0f4857960aab14d84dc751 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:47.946773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:47.953826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:47.973479 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:48.005774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Pushing event updated for resources: {'Port': ['ID=d3bc3247-3265-4689-b2d2-150ee40d9459,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:48.090217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Attempting to bind port d3bc3247-3265-4689-b2d2-150ee40d9459 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:17:48.090553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Attempting to bind port d3bc3247-3265-4689-b2d2-150ee40d9459 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'c10b7492-dfc4-4db2-a596-efed2db5a402', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '816f8c56-908e-4b85-8d9f-fbb5d302b775'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:17:48.090879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Attempting to bind port d3bc3247-3265-4689-b2d2-150ee40d9459 on network 816f8c56-908e-4b85-8d9f-fbb5d302b775 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:17:48.095561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Port d3bc3247-3265-4689-b2d2-150ee40d9459 on network 816f8c56-908e-4b85-8d9f-fbb5d302b775 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:17:48.095878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Attempting to bind port d3bc3247-3265-4689-b2d2-150ee40d9459 on network 816f8c56-908e-4b85-8d9f-fbb5d302b775 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:17:48.101697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 17, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:17:48.102094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Checking segment: {'id': 'c10b7492-dfc4-4db2-a596-efed2db5a402', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '816f8c56-908e-4b85-8d9f-fbb5d302b775'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:17:48.102516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Bound using segment: {'id': 'c10b7492-dfc4-4db2-a596-efed2db5a402', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '816f8c56-908e-4b85-8d9f-fbb5d302b775'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:17:48.102951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Bound port: d3bc3247-3265-4689-b2d2-150ee40d9459, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c10b7492-dfc4-4db2-a596-efed2db5a402', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '816f8c56-908e-4b85-8d9f-fbb5d302b775'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:17:48.103292 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:48.117528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30633dbf-c685-4106-b7c9-d2972f897c8e req-39b099ad-a358-4972-b03b-3fd36d340d84 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0568190 May 12 15:17:48.196549 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:48.201702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] For port d3bc3247-3265-4689-b2d2-150ee40d9459, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:17:48.205223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] For port d3bc3247-3265-4689-b2d2-150ee40d9459, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d3bc3247-3265-4689-b2d2-150ee40d9459,segment=NetworkSegment(c10b7492-dfc4-4db2-a596-efed2db5a402),segment_id=c10b7492-dfc4-4db2-a596-efed2db5a402)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:17:48.219401 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:48.297186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:48.298236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:48.301670 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] 10.222.0.76 "PUT /v2.0/ports/d3bc3247-3265-4689-b2d2-150ee40d9459 HTTP/1.1" status: 200 len: 1091 time: 1.4420235 May 12 15:17:48.312416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '729893e7-28d4-4b8b-87e3-9cfc0f7a7708', 'tag': 'd3bc3247-3265-4689-b2d2-150ee40d9459'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:48.384733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Allocated IP 172.25.8.22 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/9b7a270d-8e2a-49f4-806c-f96e834fe5d2) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:17:48.511063 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fb153d98-ebfa-4a22-9bcb-3efe698b2f70'] response: {'name': 'network-changed', 'server_uuid': '729893e7-28d4-4b8b-87e3-9cfc0f7a7708', 'tag': 'd3bc3247-3265-4689-b2d2-150ee40d9459', 'status': 'completed', 'code': 200} May 12 15:17:48.512045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7103e81-4892-4184-96fc-70f3b7325b89 service neutron] Pushing event updated for resources: {'Port': ['ID=d3bc3247-3265-4689-b2d2-150ee40d9459,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:48.585498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-81f756b8-1409-4642-bd3d-1be94940e9b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:48.585498 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-81f756b8-1409-4642-bd3d-1be94940e9b7 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=db6e84e56b464218b2cf98e48803ecc6&device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 1094 time: 0.2231519 May 12 15:17:48.687351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:48.863777 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-36b18c19-db47-4bda-abc2-492267856b20 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=d3bc3247-3265-4689-b2d2-150ee40d9459 HTTP/1.1" status: 200 len: 217 time: 0.2681737 May 12 15:17:48.965203 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-301c7e77-cd13-41a1-85ea-df22fb0e61f7 req-8e5e3502-3938-43ce-acf6-9bd6fdd65f2f tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.2830746 May 12 15:17:48.972545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-f06e28c4-e8c0-4c8f-8726-3827e95f2d3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:48.974840 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-f06e28c4-e8c0-4c8f-8726-3827e95f2d3b service neutron] 10.222.0.76 "GET /v2.0/subnets?id=8a7d56be-ab61-4354-a111-fee7fdf5fe28 HTTP/1.1" status: 200 len: 853 time: 0.1022236 May 12 15:17:49.064364 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cf9e0fe-0273-4e47-af3a-ba6f89dd4fb9 req-2a8a8d08-0471-47fd-9ef5-ee6930e1b732 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:49.071730 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-7d50e4fe-2db4-45c0-a460-354961fca788 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=816f8c56-908e-4b85-8d9f-fbb5d302b775&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0882285 May 12 15:17:49.073165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2cf9e0fe-0273-4e47-af3a-ba6f89dd4fb9 req-2a8a8d08-0471-47fd-9ef5-ee6930e1b732 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 943 time: 0.3064473 May 12 15:17:49.148575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:49.289356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event updated for resources: {'Port': ['ID=9b7a270d-8e2a-49f4-806c-f96e834fe5d2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:49.304134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:17:49.308838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:17:49.309520 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-b9f9ce11-7473-4499-a6eb-fb753d4843fc service neutron] 10.222.0.76 "GET /v2.0/networks/816f8c56-908e-4b85-8d9f-fbb5d302b775?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2245207 May 12 15:17:49.332564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:17:49.386241 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2cf9e0fe-0273-4e47-af3a-ba6f89dd4fb9 req-4570e41b-f8c0-4ae3-b859-93ecc9bfdd9a tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/security-groups?id=4e395d42-6618-448b-86db-de531277b740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3118908 May 12 15:17:49.433234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3ab2990-0c91-44d5-9bfb-060e41c57dfc req-987e1069-f411-4b5d-929e-18dd631c05fa tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:49.440406 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3ab2990-0c91-44d5-9bfb-060e41c57dfc req-987e1069-f411-4b5d-929e-18dd631c05fa tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 945 time: 0.2739606 May 12 15:17:49.515352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3ab2990-0c91-44d5-9bfb-060e41c57dfc req-e85150b5-ff8f-4c7d-a7ac-70eb6b25aff5 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0639508 May 12 15:17:49.529860 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8aa13db-d7a4-4205-9d35-085fdad6e57c req-dd620454-a124-4cfe-a2a7-d4d8dc261040 service neutron] 10.222.0.76 "GET /v2.0/networks/816f8c56-908e-4b85-8d9f-fbb5d302b775?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2119808 May 12 15:17:49.561313 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:49.654594 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:49.722375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26547fa6-8e60-4e1e-a1a1-a0a0494b76a1 req-5de8d69f-469e-465b-93fc-80a0af2bfebb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:49.724108 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-26547fa6-8e60-4e1e-a1a1-a0a0494b76a1 req-5de8d69f-469e-465b-93fc-80a0af2bfebb service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=db6e84e56b464218b2cf98e48803ecc6&device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 1094 time: 0.1371226 May 12 15:17:49.869837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65c70c09-f8f0-40ee-ab65-41e6bcc27bd2 req-7c2119a2-6013-4e29-bea5-6ef7e969ad37 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0549960 May 12 15:17:49.938644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26547fa6-8e60-4e1e-a1a1-a0a0494b76a1 req-a9df7e4f-81b0-4ee7-86df-ef6aab85d970 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:49.938644 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-26547fa6-8e60-4e1e-a1a1-a0a0494b76a1 req-a9df7e4f-81b0-4ee7-86df-ef6aab85d970 service neutron] 10.222.0.76 "GET /v2.0/networks?id=816f8c56-908e-4b85-8d9f-fbb5d302b775 HTTP/1.1" status: 200 len: 914 time: 0.2054992 May 12 15:17:49.975004 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:49.980908 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:50.025629 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-26547fa6-8e60-4e1e-a1a1-a0a0494b76a1 req-9bdbfc76-8637-4aa4-a67f-bc620aed9339 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=d3bc3247-3265-4689-b2d2-150ee40d9459 HTTP/1.1" status: 200 len: 217 time: 0.0763485 May 12 15:17:50.084695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event updated for resources: {'Port': ['ID=9b7a270d-8e2a-49f4-806c-f96e834fe5d2,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:50.106601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26547fa6-8e60-4e1e-a1a1-a0a0494b76a1 req-f585a060-3dd6-41b8-9316-86250a853c4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:50.106601 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-26547fa6-8e60-4e1e-a1a1-a0a0494b76a1 req-f585a060-3dd6-41b8-9316-86250a853c4f service neutron] 10.222.0.76 "GET /v2.0/subnets?id=8a7d56be-ab61-4354-a111-fee7fdf5fe28 HTTP/1.1" status: 200 len: 853 time: 0.0775628 May 12 15:17:50.160013 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:50.183340 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-26547fa6-8e60-4e1e-a1a1-a0a0494b76a1 req-84416020-73d8-4e26-9bee-9bef9e7320b1 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=816f8c56-908e-4b85-8d9f-fbb5d302b775&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0699508 May 12 15:17:50.188535 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:50.188535 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-286545de-9a69-4cf3-b2ff-c4abfd5839ba tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.5792747 May 12 15:17:50.193020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57676) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:50.193020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Request body: {'network': {'name': 'tempest-FloatingIPAdminTestJSON-test-network-1107475098'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:50.296010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:50.319192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Usage tracker for resource:network and tenant:95dd8f9e0e0f4857960aab14d84dc751 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:50.323353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:50.332605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:50.367377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Made reservation on behalf of 95dd8f9e0e0f4857960aab14d84dc751 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:17:50.370988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:50.387744 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:50.420951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:50.425349 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Usage tracker for resource:security_group_rule and tenant:95dd8f9e0e0f4857960aab14d84dc751 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:50.431938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:50.439060 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-26547fa6-8e60-4e1e-a1a1-a0a0494b76a1 req-3fd59f31-13c2-48bc-9bb3-3a5a7ccd169d service neutron] 10.222.0.76 "GET /v2.0/networks/816f8c56-908e-4b85-8d9f-fbb5d302b775?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2434993 May 12 15:17:50.440345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:50.648167 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-26547fa6-8e60-4e1e-a1a1-a0a0494b76a1 req-b16169fe-8a73-4156-aaf4-0b5a87c9b0d0 service neutron] 10.222.0.76 "GET /v2.0/networks/816f8c56-908e-4b85-8d9f-fbb5d302b775?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1953495 May 12 15:17:50.651860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1914a1-e8f0-4bef-8700-717ecef0c3c8 req-94dafc27-4e1f-471b-a9f1-d2d8914dd00d tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:50.666629 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f1914a1-e8f0-4bef-8700-717ecef0c3c8 req-94dafc27-4e1f-471b-a9f1-d2d8914dd00d tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 943 time: 0.1752548 May 12 15:17:50.730414 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:50.730414 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:50.757093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f1914a1-e8f0-4bef-8700-717ecef0c3c8 req-ba926a9e-bd2a-47d1-861b-062c1df5a1d9 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/security-groups?id=4e395d42-6618-448b-86db-de531277b740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563827 May 12 15:17:50.777440 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 578} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:17:50.794503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event updated for resources: {'SecurityGroup': ['ID=47ceeba5-ba9a-4cf7-baf6-63682fed41bd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:50.799202 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:50.799540 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Added segment 552e469d-e661-4820-8f94-8f488d9d7b95 of type vlan for network 70c3b272-514b-4f1f-8862-a798ee0e6c77 May 12 15:17:50.808091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488011f8-afde-4266-a71e-7a779a4f4a05 req-4d1e9e63-0490-4c16-899a-946ffd9070e2 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:50.811248 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-488011f8-afde-4266-a71e-7a779a4f4a05 req-4d1e9e63-0490-4c16-899a-946ffd9070e2 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 945 time: 0.1487806 May 12 15:17:50.831622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:50.874214 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:50.880243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:50.881230 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:50.890485 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-488011f8-afde-4266-a71e-7a779a4f4a05 req-db2a5912-4fd3-42bf-9bfd-3e6f8bfc613a tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731518 May 12 15:17:51.013263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event updated for resources: {'Network': ['ID=70c3b272-514b-4f1f-8862-a798ee0e6c77,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:51.034495 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2103e683-36ef-4a13-93d9-ec2c69d10e7c tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 0.8468108 May 12 15:17:51.036307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57704) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:51.040211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 70c3b272-514b-4f1f-8862-a798ee0e6c77 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:17:51.045342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Request body: {'subnet': {'network_id': '70c3b272-514b-4f1f-8862-a798ee0e6c77', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:51.191873 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46051dca-f92d-461b-ab09-7527d39ef3b1 req-9799be52-27c9-4a9d-accf-1d1bc9cba261 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1047683 May 12 15:17:51.271045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:51.283118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Usage tracker for resource:subnet and tenant:95dd8f9e0e0f4857960aab14d84dc751 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:51.283118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:51.283118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:51.298950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Made reservation on behalf of 95dd8f9e0e0f4857960aab14d84dc751 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:17:51.306765 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:51.540896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2435a86-4d98-4a8a-b94f-b764325860fc req-f659aecb-6e31-4b37-a741-8b9f05e887be tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:51.555635 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b2435a86-4d98-4a8a-b94f-b764325860fc req-f659aecb-6e31-4b37-a741-8b9f05e887be tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 945 time: 0.1326385 May 12 15:17:51.594933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b2435a86-4d98-4a8a-b94f-b764325860fc req-b971471b-9557-4312-b9dc-c1e92ed1893c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472682 May 12 15:17:51.728563 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:51.821593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event updated for resources: {'Subnet': ['ID=87cb2896-86a6-4766-afcf-56a287c0970b,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:51.831503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Checking segment: {'id': '552e469d-e661-4820-8f94-8f488d9d7b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '70c3b272-514b-4f1f-8862-a798ee0e6c77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:17:51.831503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Network hostable DHCP agents. Network: 70c3b272-514b-4f1f-8862-a798ee0e6c77, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:17:51.882974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Network 70c3b272-514b-4f1f-8862-a798ee0e6c77 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:17:51.898810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 70c3b272-514b-4f1f-8862-a798ee0e6c77) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:17:51.903684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:51.903684 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:51.914546 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fca59bb6-3514-4ed9-8a57-04ebed4a9300 None None] Network 70c3b272-514b-4f1f-8862-a798ee0e6c77 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:17:51.945704 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e37280ac-a0f7-4108-a365-66c6ec190991 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.8987706 May 12 15:17:51.945704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57724) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:51.959261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Request body: {'router': {'name': 'tempest-FloatingIPAdminTestJSON-router-993642210', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:17:51.975005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:51.980530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Usage tracker for resource:router and tenant:95dd8f9e0e0f4857960aab14d84dc751 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:51.987556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:51.999607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:52.014998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:52.014998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:52.052254 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:52.183393 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db5796ac-b8d7-4ba1-9f2a-31fd430f6a6c req-e1c0e741-4e08-4e20-b3f6-7f552200b113 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:52.205003 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db5796ac-b8d7-4ba1-9f2a-31fd430f6a6c req-e1c0e741-4e08-4e20-b3f6-7f552200b113 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 943 time: 0.1627266 May 12 15:17:52.278430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d3bc3247-3265-4689-b2d2-150ee40d9459 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:17:52.286652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db5796ac-b8d7-4ba1-9f2a-31fd430f6a6c req-e3b02422-53e5-4a6b-bdbb-694415f7cdec tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/security-groups?id=4e395d42-6618-448b-86db-de531277b740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0648656 May 12 15:17:52.481997 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc50a249-ce0c-4487-87e7-e8b9b7badc00 req-865c54ec-f51f-4b4c-ad52-b4e10f94e248 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0496655 May 12 15:17:52.499255 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:52.511117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-70c3b272-514b-4f1f-8862-a798ee0e6c77', 'network_id': '70c3b272-514b-4f1f-8862-a798ee0e6c77', 'tenant_id': '95dd8f9e0e0f4857960aab14d84dc751', 'fixed_ips': [{'subnet_id': '87cb2896-86a6-4766-afcf-56a287c0970b'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:17:52.511986 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:52.682305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d3bc3247-3265-4689-b2d2-150ee40d9459, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d3bc3247-3265-4689-b2d2-150ee40d9459,segment=NetworkSegment(c10b7492-dfc4-4db2-a596-efed2db5a402),segment_id=c10b7492-dfc4-4db2-a596-efed2db5a402)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:52.707663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'd3bc3247-3265-4689-b2d2-150ee40d9459', 'network_id': '816f8c56-908e-4b85-8d9f-fbb5d302b775', 'port_id': 'd3bc3247-3265-4689-b2d2-150ee40d9459', 'mac_address': 'fa:16:3e:fa:ca:c2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 577, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8a7d56be-ab61-4354-a111-fee7fdf5fe28', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:17:52.866193 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:52.916285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d3bc3247-3265-4689-b2d2-150ee40d9459 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:17:52.944385 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:52.954998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Allocated IP 172.20.0.2 (70c3b272-514b-4f1f-8862-a798ee0e6c77/87cb2896-86a6-4766-afcf-56a287c0970b/5921f20a-9cd4-4e8b-9a44-c099e7291457) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:17:52.958943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d3bc3247-3265-4689-b2d2-150ee40d9459, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d3bc3247-3265-4689-b2d2-150ee40d9459,segment=NetworkSegment(c10b7492-dfc4-4db2-a596-efed2db5a402),segment_id=c10b7492-dfc4-4db2-a596-efed2db5a402)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:52.978395 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:52.983646 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:53.089893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfe9df64-88dc-487e-82fb-7bde62946bdb req-511d7759-7be5-4614-940d-dee40d8291f0 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:53.096837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cfe9df64-88dc-487e-82fb-7bde62946bdb req-511d7759-7be5-4614-940d-dee40d8291f0 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 945 time: 0.1984661 May 12 15:17:53.148041 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cfe9df64-88dc-487e-82fb-7bde62946bdb req-85f4002a-66aa-4525-947e-98626dcc83ce tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497663 May 12 15:17:53.185679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d3bc3247-3265-4689-b2d2-150ee40d9459,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:53.252268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['d3bc3247-3265-4689-b2d2-150ee40d9459'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:17:53.263141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Allocated IP 172.25.8.191 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/2d3f421a-3c65-42c5-bcb6-9b82cd6a4785) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:17:53.437676 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:53.484234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Transition to ACTIVE for port object 5921f20a-9cd4-4e8b-9a44-c099e7291457 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:17:53.533766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Transition to ACTIVE for port object 5921f20a-9cd4-4e8b-9a44-c099e7291457 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:17:53.608240 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:53.610764 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:53.668322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e6f7fc2-08ef-4852-a73c-8fe1faf29745 req-070d805f-1602-4034-b8d2-4233f3a676eb tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:53.671658 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e6f7fc2-08ef-4852-a73c-8fe1faf29745 req-070d805f-1602-4034-b8d2-4233f3a676eb tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 944 time: 0.1826704 May 12 15:17:53.680992 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:53.793151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:17:53.804776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:17:53.813323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:17:53.832238 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e6f7fc2-08ef-4852-a73c-8fe1faf29745 req-ac925d79-5f94-4cb0-8db3-869b62029281 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/security-groups?id=4e395d42-6618-448b-86db-de531277b740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1308076 May 12 15:17:53.844079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Network 70c3b272-514b-4f1f-8862-a798ee0e6c77 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:17:53.864841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Pushing event updated for resources: {'Port': ['ID=5921f20a-9cd4-4e8b-9a44-c099e7291457,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:53.878082 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:17:53.887920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:17:54.197191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Attempting to bind port 5921f20a-9cd4-4e8b-9a44-c099e7291457 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:17:54.197191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Attempting to bind port 5921f20a-9cd4-4e8b-9a44-c099e7291457 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '552e469d-e661-4820-8f94-8f488d9d7b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '70c3b272-514b-4f1f-8862-a798ee0e6c77'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:17:54.197191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Attempting to bind port 5921f20a-9cd4-4e8b-9a44-c099e7291457 on network 70c3b272-514b-4f1f-8862-a798ee0e6c77 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:17:54.228945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 17, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:17:54.228945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Checking segment: {'id': '552e469d-e661-4820-8f94-8f488d9d7b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '70c3b272-514b-4f1f-8862-a798ee0e6c77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:17:54.228945 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:54.228945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Bound using segment: {'id': '552e469d-e661-4820-8f94-8f488d9d7b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '70c3b272-514b-4f1f-8862-a798ee0e6c77'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:17:54.228945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Bound port: 5921f20a-9cd4-4e8b-9a44-c099e7291457, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '552e469d-e661-4820-8f94-8f488d9d7b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '70c3b272-514b-4f1f-8862-a798ee0e6c77'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:17:54.228945 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:54.280742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event updated for resources: {'Port': ['ID=2d3f421a-3c65-42c5-bcb6-9b82cd6a4785,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:54.321139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a38f1e69-eb17-470a-bbd5-f0cfeb8d2760 req-20f83ef5-e586-4c13-ba19-80ee5e3f2596 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1691325 May 12 15:17:54.494604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] For port 5921f20a-9cd4-4e8b-9a44-c099e7291457, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:17:54.500206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] For port 5921f20a-9cd4-4e8b-9a44-c099e7291457, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5921f20a-9cd4-4e8b-9a44-c099e7291457,segment=NetworkSegment(552e469d-e661-4820-8f94-8f488d9d7b95),segment_id=552e469d-e661-4820-8f94-8f488d9d7b95)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:17:54.504823 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:54.608094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9e0b609-9e13-459a-9fa7-d8c0f5be14e3 None None] Pushing event updated for resources: {'Port': ['ID=5921f20a-9cd4-4e8b-9a44-c099e7291457,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:54.689832 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:55.192931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5121ae0-8cec-46cd-9088-d309d1f888c8 req-b0de48cc-4ab7-4782-b9c8-9c25ace2e255 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:55.206075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5121ae0-8cec-46cd-9088-d309d1f888c8 req-b0de48cc-4ab7-4782-b9c8-9c25ace2e255 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 944 time: 0.1360714 May 12 15:17:55.324633 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5121ae0-8cec-46cd-9088-d309d1f888c8 req-ad23c932-717c-45e9-a65b-433baf80f87b tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/security-groups?id=4e395d42-6618-448b-86db-de531277b740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1247847 May 12 15:17:55.410383 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:55.550043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8991853-a539-40a4-ba32-39e9c7c39f68 req-78bb8108-d223-4da5-a920-33b21a9b0599 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0590291 May 12 15:17:55.730955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Router c14edcf0-ff24-4200-8381-63260d7a0553 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:17:55.945495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:17:55.957775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19655f52-e91a-4eff-8cb1-893d25498094 None None] Sync routers for ids ['c14edcf0-ff24-4200-8381-63260d7a0553'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:17:55.972035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19655f52-e91a-4eff-8cb1-893d25498094 None None] Routers {'c14edcf0-ff24-4200-8381-63260d7a0553'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:17:55.974018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-19655f52-e91a-4eff-8cb1-893d25498094 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:17:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c14edcf0-ff24-4200-8381-63260d7a0553'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:17:55.985351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:55.988653 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e8d4bb3d-4bdd-46ef-bbcb-a5796abe3d3d tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 891 time: 4.0462308 May 12 15:17:55.990730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57818) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:56.058518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-19655f52-e91a-4eff-8cb1-893d25498094 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:17:56.079856 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19655f52-e91a-4eff-8cb1-893d25498094 None None] Routers {'c14edcf0-ff24-4200-8381-63260d7a0553'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:17:56.080964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-19655f52-e91a-4eff-8cb1-893d25498094 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:17:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c14edcf0-ff24-4200-8381-63260d7a0553'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:17:56.169741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c564433-3a2a-4362-99c3-508d92dd717f None None] Network 70c3b272-514b-4f1f-8862-a798ee0e6c77 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:17:56.348346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-19655f52-e91a-4eff-8cb1-893d25498094 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:17:56.348346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19655f52-e91a-4eff-8cb1-893d25498094 None None] The sync data for ids ['c14edcf0-ff24-4200-8381-63260d7a0553'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:17:56.363277 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d3bc3247-3265-4689-b2d2-150ee40d9459 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:17:56.451071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-dd05e18e-5dce-40a2-ba90-3bb811b3632f None None] Provisioning for port 5921f20a-9cd4-4e8b-9a44-c099e7291457 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:17:56.494003 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port d3bc3247-3265-4689-b2d2-150ee40d9459 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:17:56.502746 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port d3bc3247-3265-4689-b2d2-150ee40d9459 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:17:56.503365 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:56.777745 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:56.826129 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '729893e7-28d4-4b8b-87e3-9cfc0f7a7708', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd3bc3247-3265-4689-b2d2-150ee40d9459'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:17:56.868021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5921f20a-9cd4-4e8b-9a44-c099e7291457 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:17:56.921832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d3bc3247-3265-4689-b2d2-150ee40d9459, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d3bc3247-3265-4689-b2d2-150ee40d9459,segment=NetworkSegment(c10b7492-dfc4-4db2-a596-efed2db5a402),segment_id=c10b7492-dfc4-4db2-a596-efed2db5a402)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:56.951299 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:56.964672 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e75ce5c2-d35d-44f3-9d68-b862a4100c2b req-85f45089-00c4-411a-b98c-d20af86022fe tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:56.972278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e75ce5c2-d35d-44f3-9d68-b862a4100c2b req-85f45089-00c4-411a-b98c-d20af86022fe tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 944 time: 0.3206897 May 12 15:17:57.032316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:17:57.048289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411d9bc9-32c7-45d6-a36e-f054ab5db7f0 req-825227c8-87f1-4e97-bf92-83a3f0b974fe tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:57.070199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411d9bc9-32c7-45d6-a36e-f054ab5db7f0 req-825227c8-87f1-4e97-bf92-83a3f0b974fe tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:57.091368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411d9bc9-32c7-45d6-a36e-f054ab5db7f0 req-825227c8-87f1-4e97-bf92-83a3f0b974fe tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:57.098485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411d9bc9-32c7-45d6-a36e-f054ab5db7f0 req-825227c8-87f1-4e97-bf92-83a3f0b974fe tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:57.108613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411d9bc9-32c7-45d6-a36e-f054ab5db7f0 req-825227c8-87f1-4e97-bf92-83a3f0b974fe tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:57.116658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411d9bc9-32c7-45d6-a36e-f054ab5db7f0 req-825227c8-87f1-4e97-bf92-83a3f0b974fe tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:57.123707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d3bc3247-3265-4689-b2d2-150ee40d9459,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:57.124084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411d9bc9-32c7-45d6-a36e-f054ab5db7f0 req-825227c8-87f1-4e97-bf92-83a3f0b974fe tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:57.127434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 5921f20a-9cd4-4e8b-9a44-c099e7291457 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:17:57.133331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-411d9bc9-32c7-45d6-a36e-f054ab5db7f0 req-825227c8-87f1-4e97-bf92-83a3f0b974fe tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5433 time: 0.5325894 May 12 15:17:57.218942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 5921f20a-9cd4-4e8b-9a44-c099e7291457 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:17:57.219309 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:57.324861 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e75ce5c2-d35d-44f3-9d68-b862a4100c2b req-7eb29e67-959a-4d9c-91c2-bfcf5a3132a0 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/security-groups?id=4e395d42-6618-448b-86db-de531277b740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3509042 May 12 15:17:57.410092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:57.418389 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-411d9bc9-32c7-45d6-a36e-f054ab5db7f0 req-3e01feae-be3e-4384-b018-b1da3d826ffc tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2838209 May 12 15:17:57.431698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '62a79e7a-b21f-4f5b-935e-b7b9c9759c49', 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726', 'port_id': '62a79e7a-b21f-4f5b-935e-b7b9c9759c49', 'mac_address': 'fa:16:3e:05:a7:67', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 587, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2c6ef05c-5190-47b2-bba9-0d2bdacd727d', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:17:57.565341 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d0dc19bd-d377-4061-a9f3-baf8190ed64b'] response: {'server_uuid': '729893e7-28d4-4b8b-87e3-9cfc0f7a7708', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd3bc3247-3265-4689-b2d2-150ee40d9459', 'code': 200} May 12 15:17:57.603993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-149bf33e-2a47-4e29-a83e-b11c11d5c783 None None] Provisioning complete for port 5921f20a-9cd4-4e8b-9a44-c099e7291457 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:17:57.606270 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-149bf33e-2a47-4e29-a83e-b11c11d5c783 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:57.666083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57882) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:57.668032 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:57.689094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:17:57.693839 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:57.706031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4264143e-786a-45a4-aba4-19c6c3d0791e req-d0ef9574-d750-4487-9f84-d16dc0af3e76 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1286016 May 12 15:17:57.744477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57f43e97-cb30-4d42-a308-9ad368eb8f0f req-d8f054a9-8c3b-4366-916a-b4c2bf773e3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:57.746080 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-57f43e97-cb30-4d42-a308-9ad368eb8f0f req-d8f054a9-8c3b-4366-916a-b4c2bf773e3c service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 1096 time: 0.1679034 May 12 15:17:57.775603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:57.795959 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 5921f20a-9cd4-4e8b-9a44-c099e7291457, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5921f20a-9cd4-4e8b-9a44-c099e7291457,segment=NetworkSegment(552e469d-e661-4820-8f94-8f488d9d7b95),segment_id=552e469d-e661-4820-8f94-8f488d9d7b95)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:17:57.834000 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:57.844326 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-57f43e97-cb30-4d42-a308-9ad368eb8f0f req-25623a4b-3843-4cd9-94de-ea689fd6c816 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=4e395d42-6618-448b-86db-de531277b740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822811 May 12 15:17:57.935390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:57.948037 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:57.964594 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5c40db27-7b2a-4b56-96fb-65a197b68064 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:57.988520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5c40db27-7b2a-4b56-96fb-65a197b68064 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:57.992891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bccb18ff-c290-4930-a5b6-8c9452150c25 req-2eb01aa5-0e3b-4b20-924f-db197db14581 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:57.995952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5c40db27-7b2a-4b56-96fb-65a197b68064 admin admin] Usage tracker for resource:security_group_rule and tenant:2db042a65c154b6585a8e7124dc0c21a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:57.998908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bccb18ff-c290-4930-a5b6-8c9452150c25 req-2eb01aa5-0e3b-4b20-924f-db197db14581 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:58.000737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5c40db27-7b2a-4b56-96fb-65a197b68064 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:58.009907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bccb18ff-c290-4930-a5b6-8c9452150c25 req-2eb01aa5-0e3b-4b20-924f-db197db14581 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:58.010464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5c40db27-7b2a-4b56-96fb-65a197b68064 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:58.022956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bccb18ff-c290-4930-a5b6-8c9452150c25 req-2eb01aa5-0e3b-4b20-924f-db197db14581 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:58.028767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bccb18ff-c290-4930-a5b6-8c9452150c25 req-2eb01aa5-0e3b-4b20-924f-db197db14581 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:58.034843 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bccb18ff-c290-4930-a5b6-8c9452150c25 req-2eb01aa5-0e3b-4b20-924f-db197db14581 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:58.050288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bccb18ff-c290-4930-a5b6-8c9452150c25 req-2eb01aa5-0e3b-4b20-924f-db197db14581 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:58.056433 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bccb18ff-c290-4930-a5b6-8c9452150c25 req-2eb01aa5-0e3b-4b20-924f-db197db14581 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5433 time: 0.2145424 May 12 15:17:58.066996 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:58.114105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=5921f20a-9cd4-4e8b-9a44-c099e7291457,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:58.130080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['62a79e7a-b21f-4f5b-935e-b7b9c9759c49'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:17:58.195427 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5c40db27-7b2a-4b56-96fb-65a197b68064 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:58.210001 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5c40db27-7b2a-4b56-96fb-65a197b68064 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:58.269080 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5c40db27-7b2a-4b56-96fb-65a197b68064 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2db042a65c154b6585a8e7124dc0c21a&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5953529 May 12 15:17:58.269234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57894) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:58.269813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c40db27-7b2a-4b56-96fb-65a197b68064 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f6a529f-5d47-4cf5-a4ef-8af9654b82fd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:58.400176 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-def90830-25e3-47fe-97c8-9f381f552864 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:58.473294 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-def90830-25e3-47fe-97c8-9f381f552864 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:58.574311 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-def90830-25e3-47fe-97c8-9f381f552864 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:58.586428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-def90830-25e3-47fe-97c8-9f381f552864 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f6a529f-5d47-4cf5-a4ef-8af9654b82fd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:17:58.590605 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-def90830-25e3-47fe-97c8-9f381f552864 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:58.598670 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-def90830-25e3-47fe-97c8-9f381f552864 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2f6a529f-5d47-4cf5-a4ef-8af9654b82fd HTTP/1.1" status: 204 len: 168 time: 0.3181360 May 12 15:17:58.833798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5921f20a-9cd4-4e8b-9a44-c099e7291457 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:17:58.929503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ea11986-426a-4baa-9827-45bc07719e50 req-84a22114-83b2-4baa-8bf7-ba7a9dda883e tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:17:58.933438 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ea11986-426a-4baa-9827-45bc07719e50 req-84a22114-83b2-4baa-8bf7-ba7a9dda883e tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 945 time: 0.3911598 May 12 15:17:58.936005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Allocated IP 172.20.0.1 (70c3b272-514b-4f1f-8862-a798ee0e6c77/87cb2896-86a6-4766-afcf-56a287c0970b/cd5e8e86-8bbd-4127-a29d-556bd372ff1c) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:17:59.045699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:17:59.365365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57918) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:59.390893 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8e94121-a75c-4e75-9a1e-22695ae7cc4b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:59.394429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 5921f20a-9cd4-4e8b-9a44-c099e7291457 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:17:59.395305 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:59.415342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b8e94121-a75c-4e75-9a1e-22695ae7cc4b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:17:59.420102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b8e94121-a75c-4e75-9a1e-22695ae7cc4b admin admin] Usage tracker for resource:security_group_rule and tenant:91530de2d7c24e6f8d0e33a52ec74844 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:17:59.423619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b8e94121-a75c-4e75-9a1e-22695ae7cc4b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:17:59.427042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cdda3df6-2500-4b52-9df3-cf634c22956b req-a42b424c-dd65-462f-bd6e-7af262202433 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.4924150 May 12 15:17:59.452893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b8e94121-a75c-4e75-9a1e-22695ae7cc4b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:17:59.462244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:17:59.462244 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:59.608121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8e94121-a75c-4e75-9a1e-22695ae7cc4b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:59.613224 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8e94121-a75c-4e75-9a1e-22695ae7cc4b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:59.678521 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ea11986-426a-4baa-9827-45bc07719e50 req-1ac801c4-c236-43f2-a130-f9fb73b91bf5 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/security-groups?id=4e395d42-6618-448b-86db-de531277b740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7370865 May 12 15:17:59.687202 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b8e94121-a75c-4e75-9a1e-22695ae7cc4b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=91530de2d7c24e6f8d0e33a52ec74844&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3179584 May 12 15:17:59.690011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57922) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:17:59.840371 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:59.875491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Transition to ACTIVE for port object cd5e8e86-8bbd-4127-a29d-556bd372ff1c will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:17:59.918163 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:17:59.942415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e94121-a75c-4e75-9a1e-22695ae7cc4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6fea1a2e-4f89-4572-bf8d-d09bd92e77e2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:00.006144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-216bdda5-94ed-48fa-8a17-6e42a2574598 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:00.028647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Network 70c3b272-514b-4f1f-8862-a798ee0e6c77 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:18:00.033532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:18:00.037692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:18:00.044763 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:00.098827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event updated for resources: {'Port': ['ID=cd5e8e86-8bbd-4127-a29d-556bd372ff1c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:00.103507 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-216bdda5-94ed-48fa-8a17-6e42a2574598 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:00.127341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '62a79e7a-b21f-4f5b-935e-b7b9c9759c49'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:00.141034 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:00.147344 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:00.157886 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:00.244512 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-216bdda5-94ed-48fa-8a17-6e42a2574598 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:00.282515 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-dcc8b3a2-3b2b-46ed-bd16-81f0fbcdc266'] response: {'server_uuid': 'c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '62a79e7a-b21f-4f5b-935e-b7b9c9759c49', 'code': 200} May 12 15:18:00.286082 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-216bdda5-94ed-48fa-8a17-6e42a2574598 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:00.287272 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-216bdda5-94ed-48fa-8a17-6e42a2574598 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6fea1a2e-4f89-4572-bf8d-d09bd92e77e2 HTTP/1.1" status: 204 len: 168 time: 0.5957408 May 12 15:18:00.295722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-216bdda5-94ed-48fa-8a17-6e42a2574598 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6fea1a2e-4f89-4572-bf8d-d09bd92e77e2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:00.346326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:00.536732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-98ee9874-f4e4-442c-a01e-95e5466e2ba8 None None] Provisioning for port cd5e8e86-8bbd-4127-a29d-556bd372ff1c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:18:00.549570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-98ee9874-f4e4-442c-a01e-95e5466e2ba8 None None] Provisioning complete for port cd5e8e86-8bbd-4127-a29d-556bd372ff1c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:18:00.550439 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-98ee9874-f4e4-442c-a01e-95e5466e2ba8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:00.686083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57954) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:00.746313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-98ee9874-f4e4-442c-a01e-95e5466e2ba8 None None] Port cd5e8e86-8bbd-4127-a29d-556bd372ff1c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:18:01.092001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e074b9f-bb69-47b1-9d06-f83feaa1b360 req-d3001012-074f-4cb9-a325-2f8c4d5f8ad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:01.092511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e074b9f-bb69-47b1-9d06-f83feaa1b360 req-d3001012-074f-4cb9-a325-2f8c4d5f8ad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:01.094091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e074b9f-bb69-47b1-9d06-f83feaa1b360 req-d3001012-074f-4cb9-a325-2f8c4d5f8ad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:01.107793 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e074b9f-bb69-47b1-9d06-f83feaa1b360 req-d3001012-074f-4cb9-a325-2f8c4d5f8ad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:01.108849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e074b9f-bb69-47b1-9d06-f83feaa1b360 req-d3001012-074f-4cb9-a325-2f8c4d5f8ad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:01.110465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e074b9f-bb69-47b1-9d06-f83feaa1b360 req-d3001012-074f-4cb9-a325-2f8c4d5f8ad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:01.111054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e074b9f-bb69-47b1-9d06-f83feaa1b360 req-d3001012-074f-4cb9-a325-2f8c4d5f8ad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:01.116633 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9e074b9f-bb69-47b1-9d06-f83feaa1b360 req-d3001012-074f-4cb9-a325-2f8c4d5f8ad3 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 6490 time: 0.4255910 May 12 15:18:01.144594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c69e4b5b-9e39-4533-aa76-3bdee3c311ee req-c837706d-e049-4c50-8e36-f02af83cc32c tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.2846332 May 12 15:18:01.181013 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:01.223743 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9e074b9f-bb69-47b1-9d06-f83feaa1b360 req-47f4d44c-07bb-4163-b7bf-7c63f6f77023 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=98320268-f290-4c75-8a2a-57916de87f04&id=8814ef16-03ed-468a-b207-7c8497a79fc0&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0993636 May 12 15:18:01.810778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61707fc2-9a0f-4a42-be20-d027a15e36d8 req-8272e5de-3f7d-4eb4-b75d-b9ff819a71e0 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:01.812714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61707fc2-9a0f-4a42-be20-d027a15e36d8 req-8272e5de-3f7d-4eb4-b75d-b9ff819a71e0 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 945 time: 0.7731621 May 12 15:18:01.818282 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:01.843700 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:01.961189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event updated for resources: {'Port': ['ID=cd5e8e86-8bbd-4127-a29d-556bd372ff1c,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:02.015715 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61707fc2-9a0f-4a42-be20-d027a15e36d8 req-221b3586-c919-43ab-9e8c-6f95e9285a68 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/security-groups?id=4e395d42-6618-448b-86db-de531277b740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1914721 May 12 15:18:02.018154 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:02.134563 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:02.516694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Network 70c3b272-514b-4f1f-8862-a798ee0e6c77 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:18:02.517817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:18:02.907450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4273566a-b999-41bf-b919-a3a9bdc89c79 req-7c0da221-65b6-4b62-a283-283f11d6f36d tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.2287779 May 12 15:18:03.001295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0234fb1c-8069-40ed-9337-2d2efde508b2 None None] Provisioning complete for port cd5e8e86-8bbd-4127-a29d-556bd372ff1c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:18:03.001710 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0234fb1c-8069-40ed-9337-2d2efde508b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:03.016706 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Router c14edcf0-ff24-4200-8381-63260d7a0553 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:18:03.129131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0234fb1c-8069-40ed-9337-2d2efde508b2 None None] Port cd5e8e86-8bbd-4127-a29d-556bd372ff1c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:18:03.408424 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:18:03.419555 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-428e4c10-d24c-4052-8932-8f7465b0396d None None] Sync routers for ids ['c14edcf0-ff24-4200-8381-63260d7a0553'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:18:03.440034 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-428e4c10-d24c-4052-8932-8f7465b0396d None None] Routers {'c14edcf0-ff24-4200-8381-63260d7a0553'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:18:03.440964 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-428e4c10-d24c-4052-8932-8f7465b0396d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:17:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c14edcf0-ff24-4200-8381-63260d7a0553'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:03.462385 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58032) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:03.470871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Request body: {'port': {'network_id': '70c3b272-514b-4f1f-8862-a798ee0e6c77', 'name': 'tempest-FloatingIPAdminTestJSON-887208531'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:18:03.478153 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5516c641-5a30-44c3-afd9-4c6e7b7e4e1e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "PUT /v2.0/routers/c14edcf0-ff24-4200-8381-63260d7a0553/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.4634120 May 12 15:18:03.546279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9ae0a3b-b221-4679-90f1-8a7be3457135 req-a3cf3ec5-1ec5-49c2-a7c6-89e85415cf80 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:03.554949 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9ae0a3b-b221-4679-90f1-8a7be3457135 req-a3cf3ec5-1ec5-49c2-a7c6-89e85415cf80 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 945 time: 0.2207837 May 12 15:18:03.680904 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-428e4c10-d24c-4052-8932-8f7465b0396d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:03.703581 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-428e4c10-d24c-4052-8932-8f7465b0396d None None] Routers {'c14edcf0-ff24-4200-8381-63260d7a0553'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:18:03.704113 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-428e4c10-d24c-4052-8932-8f7465b0396d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:17:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c14edcf0-ff24-4200-8381-63260d7a0553'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:03.734952 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9ae0a3b-b221-4679-90f1-8a7be3457135 req-8df958c3-c0aa-4b53-9bcb-1a34a8dd9068 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/security-groups?id=4e395d42-6618-448b-86db-de531277b740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1743281 May 12 15:18:03.808592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:03.824510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Usage tracker for resource:port and tenant:95dd8f9e0e0f4857960aab14d84dc751 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:03.834733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:03.845181 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:03.849641 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-428e4c10-d24c-4052-8932-8f7465b0396d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:03.850462 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-428e4c10-d24c-4052-8932-8f7465b0396d None None] The sync data for ids ['c14edcf0-ff24-4200-8381-63260d7a0553'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:18:03.858345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Made reservation on behalf of 95dd8f9e0e0f4857960aab14d84dc751 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:18:03.862172 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:03.891069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] device_id is not set on port 9d90f3d3-86be-4b91-80f9-5f7745ab3044 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:18:04.190730 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41520a74-af7f-4860-8f10-edb4630706c5 req-57e9c9d7-706b-48d5-bc9b-1c5148ec45a3 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0736368 May 12 15:18:04.234308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Allocated IP 172.20.0.9 (70c3b272-514b-4f1f-8862-a798ee0e6c77/87cb2896-86a6-4766-afcf-56a287c0970b/9d90f3d3-86be-4b91-80f9-5f7745ab3044) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:18:04.393503 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-e80f5692-0efd-4fa7-961e-d89f606193f3 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 658 time: 0.3021145 May 12 15:18:04.683635 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:04.704117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-170e68de-c5fd-4ddd-9fd2-77fee58a0b27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:04.704589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-170e68de-c5fd-4ddd-9fd2-77fee58a0b27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:04.705203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-170e68de-c5fd-4ddd-9fd2-77fee58a0b27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:04.705817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-170e68de-c5fd-4ddd-9fd2-77fee58a0b27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:04.706405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-170e68de-c5fd-4ddd-9fd2-77fee58a0b27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:04.707064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-170e68de-c5fd-4ddd-9fd2-77fee58a0b27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:04.708036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-170e68de-c5fd-4ddd-9fd2-77fee58a0b27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:04.710523 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-170e68de-c5fd-4ddd-9fd2-77fee58a0b27 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=05b4f1ce61294fb29efb0a765ed28561&device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 6501 time: 0.2416253 May 12 15:18:04.731202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Transition to ACTIVE for port object 9d90f3d3-86be-4b91-80f9-5f7745ab3044 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:18:04.863088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8840e8be-a521-4ae2-b91e-7c85277ff6d5 req-e2290ba0-81e1-4a11-b63f-8b8b31a4c0cf tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:04.863842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-8840e8be-a521-4ae2-b91e-7c85277ff6d5 req-e2290ba0-81e1-4a11-b63f-8b8b31a4c0cf tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Synchronizing usage tracker for tenant:db6e84e56b464218b2cf98e48803ecc6 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:18:04.950197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-8840e8be-a521-4ae2-b91e-7c85277ff6d5 req-e2290ba0-81e1-4a11-b63f-8b8b31a4c0cf tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Unset dirty status for tenant:db6e84e56b464218b2cf98e48803ecc6 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:18:04.951324 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8840e8be-a521-4ae2-b91e-7c85277ff6d5 req-e2290ba0-81e1-4a11-b63f-8b8b31a4c0cf tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.76 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 945 time: 0.3611364 May 12 15:18:05.001990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-6faa6113-028f-4b4c-b229-108dcdcaaea2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:05.003243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-6faa6113-028f-4b4c-b229-108dcdcaaea2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:05.003845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-6faa6113-028f-4b4c-b229-108dcdcaaea2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:05.005653 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-6faa6113-028f-4b4c-b229-108dcdcaaea2 service neutron] 10.222.0.84 "GET /v2.0/networks?id=13468259-dd20-42ac-88ec-2614ebea6ccc&id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&id=187794df-e6cb-4ee3-8b40-6b546c229bd2&id=187794df-e6cb-4ee3-8b40-6b546c229bd2 HTTP/1.1" status: 200 len: 2298 time: 0.2643945 May 12 15:18:05.016725 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:05.122304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1028183d-9dc0-44a1-8c56-385f537ffd9c req-d0fa0a1a-8452-422f-b2a1-335d03bb712d tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:05.131232 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1028183d-9dc0-44a1-8c56-385f537ffd9c req-d0fa0a1a-8452-422f-b2a1-335d03bb712d tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 945 time: 0.1338966 May 12 15:18:05.199697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1028183d-9dc0-44a1-8c56-385f537ffd9c req-d24a9237-848d-4615-aca7-d5c1869fd330 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/security-groups?id=4e395d42-6618-448b-86db-de531277b740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667050 May 12 15:18:05.280066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Network 70c3b272-514b-4f1f-8862-a798ee0e6c77 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:18:05.291641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:18:05.295724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event updated for resources: {'Port': ['ID=9d90f3d3-86be-4b91-80f9-5f7745ab3044,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:05.300686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-8840e8be-a521-4ae2-b91e-7c85277ff6d5 req-fba5a57b-0bc0-47ce-9a2a-3d835353d029 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Deleting port d3bc3247-3265-4689-b2d2-150ee40d9459 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:05.301030 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8840e8be-a521-4ae2-b91e-7c85277ff6d5 req-fba5a57b-0bc0-47ce-9a2a-3d835353d029 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:05.331760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:18:05.420792 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-b2bdc73a-3d9a-4996-ba2a-388012eba4c9 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=04429346-9f7d-4f32-8c65-290ee17fda8a HTTP/1.1" status: 200 len: 1001 time: 0.3682733 May 12 15:18:05.520764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:05.521263 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:05.525478 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-122ee2bc-8428-4e80-9ed4-3a0626cac088 req-75a0169a-e597-4d2e-a564-9d2116409428 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1046283 May 12 15:18:05.637581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-4a21ab2d-91e9-428a-85fc-0ce4d2ab3861 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:05.639009 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-4a21ab2d-91e9-428a-85fc-0ce4d2ab3861 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4ecb64d7-7b16-437b-8f3e-4996d58043f6 HTTP/1.1" status: 200 len: 856 time: 0.2084162 May 12 15:18:05.651173 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e1e1f115-d338-42eb-94d7-2de2ee00bce7 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.1858087 May 12 15:18:05.656423 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58094) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:05.779059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0b3e5eb4-e732-4a58-b3b5-1090577bdf17 None None] Provisioning for port 9d90f3d3-86be-4b91-80f9-5f7745ab3044 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:18:05.798266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0b3e5eb4-e732-4a58-b3b5-1090577bdf17 None None] Provisioning complete for port 9d90f3d3-86be-4b91-80f9-5f7745ab3044 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:18:05.802973 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b3e5eb4-e732-4a58-b3b5-1090577bdf17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:05.902206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58100) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:05.966126 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0b3e5eb4-e732-4a58-b3b5-1090577bdf17 None None] Port 9d90f3d3-86be-4b91-80f9-5f7745ab3044 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:18:06.086746 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-421401ee-76ea-4142-856b-ff1218af0fab admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:06.136224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-8840e8be-a521-4ae2-b91e-7c85277ff6d5 req-fba5a57b-0bc0-47ce-9a2a-3d835353d029 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] For port d3bc3247-3265-4689-b2d2-150ee40d9459, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d3bc3247-3265-4689-b2d2-150ee40d9459,segment=NetworkSegment(c10b7492-dfc4-4db2-a596-efed2db5a402),segment_id=c10b7492-dfc4-4db2-a596-efed2db5a402)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:06.136735 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8840e8be-a521-4ae2-b91e-7c85277ff6d5 req-fba5a57b-0bc0-47ce-9a2a-3d835353d029 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:06.154739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-70608b93-052a-4b68-a0a3-57503ad3a127 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:06.155657 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-70608b93-052a-4b68-a0a3-57503ad3a127 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=13468259-dd20-42ac-88ec-2614ebea6ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5030551 May 12 15:18:06.161138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'project_id': '95dd8f9e0e0f4857960aab14d84dc751', 'port_id': '9d90f3d3-86be-4b91-80f9-5f7745ab3044'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:18:06.190130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:06.203414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-421401ee-76ea-4142-856b-ff1218af0fab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:06.206250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Usage tracker for resource:floatingip and tenant:95dd8f9e0e0f4857960aab14d84dc751 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:06.210424 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:06.219138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:06.229192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-421401ee-76ea-4142-856b-ff1218af0fab admin admin] Usage tracker for resource:security_group_rule and tenant:6fbc5ecb42f64a2190bdde8b7e0475ad is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:06.238947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-421401ee-76ea-4142-856b-ff1218af0fab admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:06.250885 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:06.282557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-421401ee-76ea-4142-856b-ff1218af0fab admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:06.345294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-8840e8be-a521-4ae2-b91e-7c85277ff6d5 req-fba5a57b-0bc0-47ce-9a2a-3d835353d029 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Calling delete_port for d3bc3247-3265-4689-b2d2-150ee40d9459 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:06.600936 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-fe27d7de-8563-4c28-96dd-38064068ef10 service neutron] 10.222.0.84 "GET /v2.0/networks/13468259-dd20-42ac-88ec-2614ebea6ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3699787 May 12 15:18:06.617880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83f186c7-272e-46c8-bd10-ad4353653897 req-8aaf7257-5974-4ccb-97a9-a0b29b51212c tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:06.624958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83f186c7-272e-46c8-bd10-ad4353653897 req-8aaf7257-5974-4ccb-97a9-a0b29b51212c tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 945 time: 0.1921577 May 12 15:18:06.629880 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-421401ee-76ea-4142-856b-ff1218af0fab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:06.684111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83f186c7-272e-46c8-bd10-ad4353653897 req-24d953cf-4964-4960-b522-a4e2607b86ec tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/security-groups?id=4e395d42-6618-448b-86db-de531277b740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576160 May 12 15:18:06.684821 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:06.686905 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-421401ee-76ea-4142-856b-ff1218af0fab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:06.830738 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bccfc583-584b-4002-84e2-8da08d76d09d req-785a30cb-f4c0-44a0-86bc-24a030945665 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0793302 May 12 15:18:06.847181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-421401ee-76ea-4142-856b-ff1218af0fab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2da06424-c454-4441-b837-0cd26c36847f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:06.859377 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8840e8be-a521-4ae2-b91e-7c85277ff6d5 req-fba5a57b-0bc0-47ce-9a2a-3d835353d029 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:06.880175 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-421401ee-76ea-4142-856b-ff1218af0fab admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6fbc5ecb42f64a2190bdde8b7e0475ad&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9754839 May 12 15:18:06.881107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58120) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:06.933272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fba5a57b-0bc0-47ce-9a2a-3d835353d029 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Pushing event deleted for resources: {'Port': ['ID=d3bc3247-3265-4689-b2d2-150ee40d9459,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:06.946083 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-b242ab21-45a8-42b9-86c3-7d9fe3b55289 service neutron] 10.222.0.84 "GET /v2.0/networks/13468259-dd20-42ac-88ec-2614ebea6ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3330979 May 12 15:18:07.027695 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d79bbaa7-4459-40ff-82f5-8518ae5e4d46 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:07.069059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Allocated IP 172.25.8.211 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/d53d8581-dde5-4eaf-acdc-4e2d175b4544) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:18:07.073023 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-186d1704-3c8e-4c04-a794-df2f9dbcf24d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.21&port_id=d96ca9ce-4a19-49f0-bef3-e0e31ace478a HTTP/1.1" status: 200 len: 217 time: 0.0926826 May 12 15:18:07.081192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d79bbaa7-4459-40ff-82f5-8518ae5e4d46 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:07.171352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-8840e8be-a521-4ae2-b91e-7c85277ff6d5 req-fba5a57b-0bc0-47ce-9a2a-3d835353d029 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] No DVR routers for this DVR port d3bc3247-3265-4689-b2d2-150ee40d9459 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:07.192033 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8840e8be-a521-4ae2-b91e-7c85277ff6d5 req-fba5a57b-0bc0-47ce-9a2a-3d835353d029 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:07.208292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '729893e7-28d4-4b8b-87e3-9cfc0f7a7708', 'name': 'network-vif-deleted', 'tag': 'd3bc3247-3265-4689-b2d2-150ee40d9459'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:07.250164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-2e210fc6-e98a-4932-ac2e-5e384798695f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:07.253010 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-2e210fc6-e98a-4932-ac2e-5e384798695f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=34e89d1d-72aa-4216-94d6-f37b8a0c162b HTTP/1.1" status: 200 len: 797 time: 0.1510251 May 12 15:18:07.259035 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8840e8be-a521-4ae2-b91e-7c85277ff6d5 req-fba5a57b-0bc0-47ce-9a2a-3d835353d029 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.76 "DELETE /v2.0/ports/d3bc3247-3265-4689-b2d2-150ee40d9459 HTTP/1.1" status: 204 len: 173 time: 2.3013577 May 12 15:18:07.360952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:07.364188 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b56655e0-eb77-4d87-a577-7589e1ce6711'] response: {'server_uuid': '729893e7-28d4-4b8b-87e3-9cfc0f7a7708', 'name': 'network-vif-deleted', 'tag': 'd3bc3247-3265-4689-b2d2-150ee40d9459', 'status': 'completed', 'code': 200} May 12 15:18:07.406595 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d79bbaa7-4459-40ff-82f5-8518ae5e4d46 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:07.430302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-e4b31b37-f8cd-4b49-b243-6f4b9fe0106a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:07.432165 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-e4b31b37-f8cd-4b49-b243-6f4b9fe0106a service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.1696334 May 12 15:18:07.462515 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:07.633306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d79bbaa7-4459-40ff-82f5-8518ae5e4d46 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2da06424-c454-4441-b837-0cd26c36847f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:07.693517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:18:07.695617 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d79bbaa7-4459-40ff-82f5-8518ae5e4d46 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:07.697038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d79bbaa7-4459-40ff-82f5-8518ae5e4d46 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2da06424-c454-4441-b837-0cd26c36847f HTTP/1.1" status: 204 len: 168 time: 0.8142717 May 12 15:18:07.700045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:18:07.706130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:18:07.759345 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-60863205-acb1-41fe-84ef-177b2b57b0b3 service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3150613 May 12 15:18:07.825838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Pushing event updated for resources: {'Port': ['ID=d53d8581-dde5-4eaf-acdc-4e2d175b4544,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:08.320852 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-76bc6a22-0a72-4dc7-8e21-302d60754a5d service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5518866 May 12 15:18:08.393369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d3bc3247-3265-4689-b2d2-150ee40d9459 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:08.461893 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-8226a319-9475-4c4e-8630-1b1e360308fa service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.182&port_id=be802a6d-cca9-42fd-bdc5-6c9f78035217 HTTP/1.1" status: 200 len: 217 time: 0.0913339 May 12 15:18:08.468732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: d3bc3247-3265-4689-b2d2-150ee40d9459 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:18:08.469070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d3bc3247-3265-4689-b2d2-150ee40d9459 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:18:08.509488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58152) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:08.518264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b15fe5a-aff7-4811-a363-6d3171401a84 req-f4bee7c9-b594-49db-837b-0507de114155 tempest-ServerAddressesTestJSON-1075907825 tempest-ServerAddressesTestJSON-1075907825-project] 10.222.0.82 "GET /v2.0/ports?device_id=729893e7-28d4-4b8b-87e3-9cfc0f7a7708 HTTP/1.1" status: 200 len: 210 time: 0.3579688 May 12 15:18:08.540970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-310467f0-017e-416a-aa9a-99c242c8dcff req-da6a07ab-e1b0-4011-a127-e068cb228d4e tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0838563 May 12 15:18:08.627662 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:08.661051 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-18542059-727d-4476-8571-bc8e66dbdd7d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:08.686492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-18542059-727d-4476-8571-bc8e66dbdd7d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:08.690098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-b787acb6-831c-4607-b44f-8378b951adca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:08.691543 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-b787acb6-831c-4607-b44f-8378b951adca service neutron] 10.222.0.84 "GET /v2.0/subnets?id=34e89d1d-72aa-4216-94d6-f37b8a0c162b HTTP/1.1" status: 200 len: 797 time: 0.2195809 May 12 15:18:08.694516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-18542059-727d-4476-8571-bc8e66dbdd7d admin admin] Usage tracker for resource:security_group_rule and tenant:2c1612af4a974e6ea77eb4b4a1f5bd6f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:08.703368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-18542059-727d-4476-8571-bc8e66dbdd7d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:08.751774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-18542059-727d-4476-8571-bc8e66dbdd7d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:08.800130 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:18:08.817749 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:08.838702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-5832aca5-d702-4e57-9cf4-c2303fa0da06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:08.840420 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-5832aca5-d702-4e57-9cf4-c2303fa0da06 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.1340005 May 12 15:18:08.981189 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-18542059-727d-4476-8571-bc8e66dbdd7d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:09.001123 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-18542059-727d-4476-8571-bc8e66dbdd7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:09.024887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e89dbd2-6859-43c4-ab5c-2f2eaa72952d req-0b1d33b7-586a-4a54-b2ae-102c6eb195ab tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:09.031880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e89dbd2-6859-43c4-ab5c-2f2eaa72952d req-0b1d33b7-586a-4a54-b2ae-102c6eb195ab tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:09.040043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e89dbd2-6859-43c4-ab5c-2f2eaa72952d req-0b1d33b7-586a-4a54-b2ae-102c6eb195ab tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:09.046442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e89dbd2-6859-43c4-ab5c-2f2eaa72952d req-0b1d33b7-586a-4a54-b2ae-102c6eb195ab tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:09.052857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e89dbd2-6859-43c4-ab5c-2f2eaa72952d req-0b1d33b7-586a-4a54-b2ae-102c6eb195ab tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:09.059166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e89dbd2-6859-43c4-ab5c-2f2eaa72952d req-0b1d33b7-586a-4a54-b2ae-102c6eb195ab tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:09.065526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e89dbd2-6859-43c4-ab5c-2f2eaa72952d req-0b1d33b7-586a-4a54-b2ae-102c6eb195ab tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:09.073694 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-bca71cd0-727c-480b-904c-7b97bdfd6ede service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2243822 May 12 15:18:09.074479 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e89dbd2-6859-43c4-ab5c-2f2eaa72952d req-0b1d33b7-586a-4a54-b2ae-102c6eb195ab tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5444 time: 0.3503284 May 12 15:18:09.077803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18542059-727d-4476-8571-bc8e66dbdd7d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7aeb0b49-c09a-4100-8fca-d4c07c71d049,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:09.102473 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-18542059-727d-4476-8571-bc8e66dbdd7d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2c1612af4a974e6ea77eb4b4a1f5bd6f&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5916624 May 12 15:18:09.105892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58164) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:09.199479 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e89dbd2-6859-43c4-ab5c-2f2eaa72952d req-a3ee7353-b418-4321-b6c7-2ce0d5911f94 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1239071 May 12 15:18:09.258771 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-e77582f9-65c0-4fe9-82d2-7032ec3440d1 service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1777153 May 12 15:18:09.300173 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:09.306496 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4b65614e-de44-4fac-a9c3-89b4a3bb0922 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:09.341293 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-5be229b6-9824-47f9-81cf-91a3976539a2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.217&port_id=857536b0-998d-4731-a09f-f8fca9f18d3e HTTP/1.1" status: 200 len: 217 time: 0.0738313 May 12 15:18:09.343728 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4b65614e-de44-4fac-a9c3-89b4a3bb0922 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:09.355514 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:09.439719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-25539995-f754-40f2-959e-5970912a9bf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:09.441702 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-25539995-f754-40f2-959e-5970912a9bf6 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=34e89d1d-72aa-4216-94d6-f37b8a0c162b HTTP/1.1" status: 200 len: 797 time: 0.0918229 May 12 15:18:09.497966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Pushing event updated for resources: {'Port': ['ID=d53d8581-dde5-4eaf-acdc-4e2d175b4544,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:09.513536 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:09.548857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-6bec7319-8cac-4c28-9645-08c8145fd7ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:09.550693 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-6bec7319-8cac-4c28-9645-08c8145fd7ec service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.1007948 May 12 15:18:09.702836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58180) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:09.819012 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4b65614e-de44-4fac-a9c3-89b4a3bb0922 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:09.861861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-a3954fd1-c9c4-4e19-86d5-03ca7bcf5f69 admin admin] Deleting subnet 8a7d56be-ab61-4354-a111-fee7fdf5fe28 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:18:09.873690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27229c78-1319-4324-b9eb-63734582b635 req-e93f4e11-2ce4-43d0-9a2c-cbdb7753eb29 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0987883 May 12 15:18:09.881111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3954fd1-c9c4-4e19-86d5-03ca7bcf5f69 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:09.884813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b65614e-de44-4fac-a9c3-89b4a3bb0922 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7aeb0b49-c09a-4100-8fca-d4c07c71d049,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:09.906704 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4b65614e-de44-4fac-a9c3-89b4a3bb0922 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:09.908089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4b65614e-de44-4fac-a9c3-89b4a3bb0922 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7aeb0b49-c09a-4100-8fca-d4c07c71d049 HTTP/1.1" status: 204 len: 168 time: 0.7994888 May 12 15:18:09.909729 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Floating IP 5f8bd5d0-a45f-4398-b013-11de29b0c989 associated. External IP: 172.25.8.211, port: 9d90f3d3-86be-4b91-80f9-5f7745ab3044. May 12 15:18:09.938685 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-9b9d8ea4-0d54-49d8-950a-d9d496ed9e3e service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3801322 May 12 15:18:10.014774 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3954fd1-c9c4-4e19-86d5-03ca7bcf5f69 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:10.254060 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3954fd1-c9c4-4e19-86d5-03ca7bcf5f69 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:10.404445 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-30861dac-5a56-4581-912c-91d0a5f963bf service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4554360 May 12 15:18:10.494756 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-a836b1a6-3f3d-4261-8ed9-e966f00d9b0e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.117&port_id=4834ab3b-6306-4f41-81ec-4af4df1f4c1b HTTP/1.1" status: 200 len: 217 time: 0.0785983 May 12 15:18:10.576652 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3954fd1-c9c4-4e19-86d5-03ca7bcf5f69 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:10.680346 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3954fd1-c9c4-4e19-86d5-03ca7bcf5f69 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:10.713652 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a3954fd1-c9c4-4e19-86d5-03ca7bcf5f69 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/8a7d56be-ab61-4354-a111-fee7fdf5fe28 HTTP/1.1" status: 204 len: 168 time: 0.9978876 May 12 15:18:10.714597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Router c14edcf0-ff24-4200-8381-63260d7a0553 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:18:10.715910 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-ddd45465-f9b2-4012-af08-99a4caa6af82 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:10.717341 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-ddd45465-f9b2-4012-af08-99a4caa6af82 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=34e89d1d-72aa-4216-94d6-f37b8a0c162b HTTP/1.1" status: 200 len: 797 time: 0.2129714 May 12 15:18:10.718006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58204) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:10.718771 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3954fd1-c9c4-4e19-86d5-03ca7bcf5f69 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8a7d56be-ab61-4354-a111-fee7fdf5fe28,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:10.965422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee02260d-4636-4c65-90ca-b8ff6d465d66 req-53911d50-cbb1-4e2a-8026-21d0504c6687 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:10.973721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee02260d-4636-4c65-90ca-b8ff6d465d66 req-53911d50-cbb1-4e2a-8026-21d0504c6687 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:10.981485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee02260d-4636-4c65-90ca-b8ff6d465d66 req-53911d50-cbb1-4e2a-8026-21d0504c6687 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:10.991322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee02260d-4636-4c65-90ca-b8ff6d465d66 req-53911d50-cbb1-4e2a-8026-21d0504c6687 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:11.000623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee02260d-4636-4c65-90ca-b8ff6d465d66 req-53911d50-cbb1-4e2a-8026-21d0504c6687 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:11.008159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee02260d-4636-4c65-90ca-b8ff6d465d66 req-53911d50-cbb1-4e2a-8026-21d0504c6687 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:11.014151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee02260d-4636-4c65-90ca-b8ff6d465d66 req-53911d50-cbb1-4e2a-8026-21d0504c6687 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:11.023153 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee02260d-4636-4c65-90ca-b8ff6d465d66 req-53911d50-cbb1-4e2a-8026-21d0504c6687 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5444 time: 0.4062665 May 12 15:18:11.086276 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c05248d-38e4-4653-8ebf-029a500f29ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:11.390776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:18:11.413612 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63c14ad7-204c-49a9-b455-5f9921b61da6 None None] Sync routers for ids ['c14edcf0-ff24-4200-8381-63260d7a0553'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:18:11.429257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee02260d-4636-4c65-90ca-b8ff6d465d66 req-d7d98bb0-242e-487e-83ac-d3de7ca59906 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.3921547 May 12 15:18:11.451689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e16fb8a-7e29-4dfb-ba52-cd3c369b51c1 req-8f18466f-9621-4e04-a1b9-c54d98d62e11 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.2900062 May 12 15:18:11.457276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63c14ad7-204c-49a9-b455-5f9921b61da6 None None] Routers {'c14edcf0-ff24-4200-8381-63260d7a0553'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:18:11.457276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-63c14ad7-204c-49a9-b455-5f9921b61da6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:17:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c14edcf0-ff24-4200-8381-63260d7a0553'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:11.523252 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:11.615583 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9232d499-7674-483a-8198-ab3a60876fbe tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 987 time: 5.9580467 May 12 15:18:11.619747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58232) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:11.652910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-63c14ad7-204c-49a9-b455-5f9921b61da6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:11.660994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-70a92250-f604-4509-a780-4e5fe8099b40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:11.660994 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-70a92250-f604-4509-a780-4e5fe8099b40 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.7563107 May 12 15:18:11.691033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63c14ad7-204c-49a9-b455-5f9921b61da6 None None] Routers {'c14edcf0-ff24-4200-8381-63260d7a0553'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:18:11.691033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-63c14ad7-204c-49a9-b455-5f9921b61da6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:17:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c14edcf0-ff24-4200-8381-63260d7a0553'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:11.742774 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c05248d-38e4-4653-8ebf-029a500f29ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:11.802283 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-63c14ad7-204c-49a9-b455-5f9921b61da6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:11.803324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63c14ad7-204c-49a9-b455-5f9921b61da6 None None] The sync data for ids ['c14edcf0-ff24-4200-8381-63260d7a0553'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:18:11.805955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-1c05248d-38e4-4653-8ebf-029a500f29ae admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['816f8c56-908e-4b85-8d9f-fbb5d302b775']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:11.827770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-1c05248d-38e4-4653-8ebf-029a500f29ae admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c10b7492-dfc4-4db2-a596-efed2db5a402') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:11.827770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-1c05248d-38e4-4653-8ebf-029a500f29ae admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c10b7492-dfc4-4db2-a596-efed2db5a402') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:11.852506 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c05248d-38e4-4653-8ebf-029a500f29ae admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:11.870555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6b3523f4-08b4-4444-bc81-b8e33dd95322 tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] 10.222.0.82 "GET /v2.0/floatingips/5f8bd5d0-a45f-4398-b013-11de29b0c989 HTTP/1.1" status: 200 len: 982 time: 0.2484002 May 12 15:18:11.873785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58238) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:11.880762 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c05248d-38e4-4653-8ebf-029a500f29ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:11.947593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1c05248d-38e4-4653-8ebf-029a500f29ae admin admin] Releasing vlan 577 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:18:11.947593 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c05248d-38e4-4653-8ebf-029a500f29ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: timer() May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:18:11.962994 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:18:12.131678 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c05248d-38e4-4653-8ebf-029a500f29ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:12.148286 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c05248d-38e4-4653-8ebf-029a500f29ae admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:12.154131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-90071de2-3e3c-446a-940c-0e4724a7184c tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] 10.222.0.82 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 3818 time: 0.2759402 May 12 15:18:12.157367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58252) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:12.203508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c05248d-38e4-4653-8ebf-029a500f29ae admin admin] Pushing event deleted for resources: {'Network': ['ID=816f8c56-908e-4b85-8d9f-fbb5d302b775,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:12.328887 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1c05248d-38e4-4653-8ebf-029a500f29ae admin admin] 10.222.0.82 "DELETE /v2.0/networks/816f8c56-908e-4b85-8d9f-fbb5d302b775 HTTP/1.1" status: 204 len: 168 time: 1.5894065 May 12 15:18:12.342392 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-13d8bf28-156c-4e45-9203-9e3b2827bd92 service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6694705 May 12 15:18:12.549840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-bb7ecc65-6707-43ea-b33e-cc50dbe56781 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Deleting port d53d8581-dde5-4eaf-acdc-4e2d175b4544 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:12.550180 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb7ecc65-6707-43ea-b33e-cc50dbe56781 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:12.664097 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-177cfc2c-be83-4bf7-8741-05793a9df643 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:12.675037 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-7e7ee0f7-8b8d-4396-9978-b3a9aca6454b service neutron] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3051977 May 12 15:18:12.698640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58270) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:12.797322 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:12.856505 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-e6a0240b-054e-4c29-bd01-bf3daea5fe57 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=a2eb37f9-aba2-47d2-9756-11109b082c05 HTTP/1.1" status: 200 len: 217 time: 0.1646421 May 12 15:18:12.986638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-435774e8-961d-4782-b1cc-4a563a7260fa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.001131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-435774e8-961d-4782-b1cc-4a563a7260fa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.011563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-435774e8-961d-4782-b1cc-4a563a7260fa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.024532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-435774e8-961d-4782-b1cc-4a563a7260fa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.032900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-435774e8-961d-4782-b1cc-4a563a7260fa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.039717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-435774e8-961d-4782-b1cc-4a563a7260fa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.057152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-435774e8-961d-4782-b1cc-4a563a7260fa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.057152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-435774e8-961d-4782-b1cc-4a563a7260fa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Synchronizing usage tracker for tenant:05b4f1ce61294fb29efb0a765ed28561 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:18:13.083796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-2fc5d864-2a6f-430d-8a0b-e8c5c3f9f503 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.086575 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-2fc5d864-2a6f-430d-8a0b-e8c5c3f9f503 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=a98bb094-ea48-4784-b33c-d20b0aad5132 HTTP/1.1" status: 200 len: 797 time: 0.2199857 May 12 15:18:13.149880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-435774e8-961d-4782-b1cc-4a563a7260fa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Unset dirty status for tenant:05b4f1ce61294fb29efb0a765ed28561 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:18:13.151018 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-435774e8-961d-4782-b1cc-4a563a7260fa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5444 time: 0.6848423 May 12 15:18:13.183475 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b64af736-0142-478c-bfc0-0b149b0495c1 req-2621ee65-dc0e-45ef-a9fc-46358014ff34 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1296890 May 12 15:18:13.196153 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5d6e695e-373e-463b-8710-5d5bb954eb1d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=db6e84e56b464218b2cf98e48803ecc6&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4956636 May 12 15:18:13.199382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58280) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:13.346894 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb7ecc65-6707-43ea-b33e-cc50dbe56781 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:13.347604 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb7ecc65-6707-43ea-b33e-cc50dbe56781 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:13.500250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-c682bb9b-00f6-4473-bed6-f8b1a1fce196 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.501931 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-c682bb9b-00f6-4473-bed6-f8b1a1fce196 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "GET /v2.0/ports/d96ca9ce-4a19-49f0-bef3-e0e31ace478a?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.3285437 May 12 15:18:13.592493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd51fc8-e8e7-474f-9b66-b7b1f134a7df req-05102fe4-1776-4cc1-a16f-0f312bd7a813 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.599422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd51fc8-e8e7-474f-9b66-b7b1f134a7df req-05102fe4-1776-4cc1-a16f-0f312bd7a813 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.606318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd51fc8-e8e7-474f-9b66-b7b1f134a7df req-05102fe4-1776-4cc1-a16f-0f312bd7a813 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.612803 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd51fc8-e8e7-474f-9b66-b7b1f134a7df req-05102fe4-1776-4cc1-a16f-0f312bd7a813 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.621252 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd51fc8-e8e7-474f-9b66-b7b1f134a7df req-05102fe4-1776-4cc1-a16f-0f312bd7a813 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.627532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd51fc8-e8e7-474f-9b66-b7b1f134a7df req-05102fe4-1776-4cc1-a16f-0f312bd7a813 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.636424 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd51fc8-e8e7-474f-9b66-b7b1f134a7df req-05102fe4-1776-4cc1-a16f-0f312bd7a813 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.639337 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cdd51fc8-e8e7-474f-9b66-b7b1f134a7df req-05102fe4-1776-4cc1-a16f-0f312bd7a813 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 5444 time: 0.6333463 May 12 15:18:13.650225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-bb7ecc65-6707-43ea-b33e-cc50dbe56781 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Calling delete_port for d53d8581-dde5-4eaf-acdc-4e2d175b4544 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:13.777223 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23e1dec8-14aa-46df-96d1-5e663d685916 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:13.797271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-4e86e480-8395-46da-b877-d96ea54b182d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "GET /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.2804668 May 12 15:18:13.814683 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cdd51fc8-e8e7-474f-9b66-b7b1f134a7df req-1eb57af5-154f-427a-946b-6c79b8b3cdba tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1282537 May 12 15:18:13.815991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-97356c24-4ae1-4522-a5a6-7651a1f861d3 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:18:13.862812 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23e1dec8-14aa-46df-96d1-5e663d685916 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:13.932543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-6d4ca832-d92b-4aae-941a-95ab975bbbd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:13.934083 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-6d4ca832-d92b-4aae-941a-95ab975bbbd0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=187794df-e6cb-4ee3-8b40-6b546c229bd2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.8395035 May 12 15:18:14.073682 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23e1dec8-14aa-46df-96d1-5e663d685916 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:14.110177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23e1dec8-14aa-46df-96d1-5e663d685916 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4e395d42-6618-448b-86db-de531277b740,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:14.164185 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb7ecc65-6707-43ea-b33e-cc50dbe56781 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:14.182386 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-97356c24-4ae1-4522-a5a6-7651a1f861d3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:14.206469 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-fb03dd82-2b38-4287-9b7d-3b71de5d387c service neutron] 10.222.0.84 "GET /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2377357 May 12 15:18:14.241687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb7ecc65-6707-43ea-b33e-cc50dbe56781 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event deleted for resources: {'Port': ['ID=d53d8581-dde5-4eaf-acdc-4e2d175b4544,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:14.243922 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23e1dec8-14aa-46df-96d1-5e663d685916 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:14.245086 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-23e1dec8-14aa-46df-96d1-5e663d685916 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4e395d42-6618-448b-86db-de531277b740 HTTP/1.1" status: 204 len: 168 time: 1.0419245 May 12 15:18:14.453762 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb7ecc65-6707-43ea-b33e-cc50dbe56781 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:14.454277 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-bb7ecc65-6707-43ea-b33e-cc50dbe56781 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Floating IP 5f8bd5d0-a45f-4398-b013-11de29b0c989 disassociated (deleted). External IP: 172.25.8.211, port: 9d90f3d3-86be-4b91-80f9-5f7745ab3044. May 12 15:18:14.805019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-efd62f1a-1360-416a-b874-3df5d6a1ba0f req-6d76a757-6767-4a06-83cb-0bbc363e7240 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1087782 May 12 15:18:14.816081 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7f58ede8-a15a-4a19-8e51-be5610f73a70 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:14.986158 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-5497312c-a76f-49fe-ae8a-1044feaa1dde service neutron] 10.222.0.84 "GET /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7663071 May 12 15:18:15.095655 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-c640ec88-2524-4cb1-9724-babae8f707af service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=39390bec-fdd9-4910-a8d2-6718da722725 HTTP/1.1" status: 200 len: 217 time: 0.0875542 May 12 15:18:15.097797 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 39390bec-fdd9-4910-a8d2-6718da722725 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:15.108877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-97356c24-4ae1-4522-a5a6-7651a1f861d3 service neutron] For port d96ca9ce-4a19-49f0-bef3-e0e31ace478a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d96ca9ce-4a19-49f0-bef3-e0e31ace478a,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:15.341031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-97356c24-4ae1-4522-a5a6-7651a1f861d3 service neutron] For port d96ca9ce-4a19-49f0-bef3-e0e31ace478a, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:18:15.544529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-97356c24-4ae1-4522-a5a6-7651a1f861d3 service neutron] device_id is not set on port d96ca9ce-4a19-49f0-bef3-e0e31ace478a yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:18:15.560230 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:15.566989 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-97356c24-4ae1-4522-a5a6-7651a1f861d3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:15.607397 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-97356c24-4ae1-4522-a5a6-7651a1f861d3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:15.630577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bb7ecc65-6707-43ea-b33e-cc50dbe56781 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Router c14edcf0-ff24-4200-8381-63260d7a0553 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:18:15.659519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 39390bec-fdd9-4910-a8d2-6718da722725, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=39390bec-fdd9-4910-a8d2-6718da722725,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:15.664552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '39390bec-fdd9-4910-a8d2-6718da722725'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:15.684044 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:15.684943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 04429346-9f7d-4f32-8c65-290ee17fda8a no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:15.876454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-dc373080-81d8-4241-8e74-6ed70e93f30c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:15.915107 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a2725f46-6e16-4ac1-8583-ab2cb0787bf0'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '39390bec-fdd9-4910-a8d2-6718da722725', 'code': 200} May 12 15:18:15.924878 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-dc373080-81d8-4241-8e74-6ed70e93f30c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=a98bb094-ea48-4784-b33c-d20b0aad5132 HTTP/1.1" status: 200 len: 797 time: 0.8178310 May 12 15:18:15.995640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=39390bec-fdd9-4910-a8d2-6718da722725,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:16.103130 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:16.184827 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:16.200937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:16.203212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:16.203766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:16.204268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:16.205568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:16.206102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:16.206741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:16.210612 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:16.211137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:16.211667 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:16.212181 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:16.212782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:16.231270 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:16.306499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 04429346-9f7d-4f32-8c65-290ee17fda8a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=04429346-9f7d-4f32-8c65-290ee17fda8a,segment=NetworkSegment(a64e84dc-d91c-44e1-ab35-6c9b54a1b65b),segment_id=a64e84dc-d91c-44e1-ab35-6c9b54a1b65b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:16.318447 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:16.320153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a2eb37f9-aba2-47d2-9756-11109b082c05 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:16.333120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97356c24-4ae1-4522-a5a6-7651a1f861d3 service neutron] Pushing event updated for resources: {'Port': ['ID=d96ca9ce-4a19-49f0-bef3-e0e31ace478a,revision_number=6']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:16.453564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63cc329-00aa-4c06-9573-3d65a046a710 req-f30bcefe-06da-436a-b65c-5fa1094819c8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:16.460874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63cc329-00aa-4c06-9573-3d65a046a710 req-f30bcefe-06da-436a-b65c-5fa1094819c8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:16.468438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63cc329-00aa-4c06-9573-3d65a046a710 req-f30bcefe-06da-436a-b65c-5fa1094819c8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:16.476396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63cc329-00aa-4c06-9573-3d65a046a710 req-f30bcefe-06da-436a-b65c-5fa1094819c8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:16.478105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58386) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:16.479873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-97356c24-4ae1-4522-a5a6-7651a1f861d3 service neutron] No DVR routers for this DVR port d96ca9ce-4a19-49f0-bef3-e0e31ace478a on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:16.483160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63cc329-00aa-4c06-9573-3d65a046a710 req-f30bcefe-06da-436a-b65c-5fa1094819c8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:16.488775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-48891c34-49b2-49ec-a8d9-6e3a8be3604c None None] Provisioning complete for port d96ca9ce-4a19-49f0-bef3-e0e31ace478a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:18:16.488861 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48891c34-49b2-49ec-a8d9-6e3a8be3604c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:16.489359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63cc329-00aa-4c06-9573-3d65a046a710 req-f30bcefe-06da-436a-b65c-5fa1094819c8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:16.510093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e63cc329-00aa-4c06-9573-3d65a046a710 req-f30bcefe-06da-436a-b65c-5fa1094819c8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 4666 time: 1.0161040 May 12 15:18:16.559762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-97356c24-4ae1-4522-a5a6-7651a1f861d3 service neutron] In _notify_port_updated(), no bound segment for port d96ca9ce-4a19-49f0-bef3-e0e31ace478a on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:18:16.559762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-97356c24-4ae1-4522-a5a6-7651a1f861d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:16.559762 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-97356c24-4ae1-4522-a5a6-7651a1f861d3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:16.559762 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-97356c24-4ae1-4522-a5a6-7651a1f861d3 service neutron] 10.222.0.84 "PUT /v2.0/ports/d96ca9ce-4a19-49f0-bef3-e0e31ace478a HTTP/1.1" status: 200 len: 1031 time: 2.7473409 May 12 15:18:16.560258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=04429346-9f7d-4f32-8c65-290ee17fda8a,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:16.597894 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-48891c34-49b2-49ec-a8d9-6e3a8be3604c None None] Port d96ca9ce-4a19-49f0-bef3-e0e31ace478a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:18:16.614231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-939e679f-adf4-4a23-a24d-59e15600adcb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:16.618122 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-939e679f-adf4-4a23-a24d-59e15600adcb service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=187794df-e6cb-4ee3-8b40-6b546c229bd2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.6824913 May 12 15:18:16.622191 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dbb76653-fb46-4f0a-8ae3-bc051f28bdaa req-bed89ce0-14e8-47e7-ae0a-d49b369bdf9e tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.2391996 May 12 15:18:16.637337 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:16.664787 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e63cc329-00aa-4c06-9573-3d65a046a710 req-34fe92f7-b07a-4fe7-97e1-c0c491f249d4 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1537113 May 12 15:18:16.690708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb7ecc65-6707-43ea-b33e-cc50dbe56781 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:18:16.691370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a2eb37f9-aba2-47d2-9756-11109b082c05, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a2eb37f9-aba2-47d2-9756-11109b082c05,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:16.714503 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c697a663-45de-4047-b328-be886e07b9ef None None] Sync routers for ids ['c14edcf0-ff24-4200-8381-63260d7a0553'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:18:16.727456 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:16.728832 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c697a663-45de-4047-b328-be886e07b9ef None None] Routers {'c14edcf0-ff24-4200-8381-63260d7a0553'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:18:16.729364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device be802a6d-cca9-42fd-bdc5-6c9f78035217 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:16.729572 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c697a663-45de-4047-b328-be886e07b9ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:18:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c14edcf0-ff24-4200-8381-63260d7a0553'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:16.734958 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb7ecc65-6707-43ea-b33e-cc50dbe56781 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:16.849844 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c697a663-45de-4047-b328-be886e07b9ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:16.872335 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c697a663-45de-4047-b328-be886e07b9ef None None] Routers {'c14edcf0-ff24-4200-8381-63260d7a0553'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:18:16.872969 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c697a663-45de-4047-b328-be886e07b9ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:18:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c14edcf0-ff24-4200-8381-63260d7a0553'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:17.025562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bb7ecc65-6707-43ea-b33e-cc50dbe56781 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "DELETE /v2.0/floatingips/5f8bd5d0-a45f-4398-b013-11de29b0c989 HTTP/1.1" status: 204 len: 168 time: 4.8609550 May 12 15:18:17.026024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58430) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:17.032798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:18:17.038570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:17.043127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Usage tracker for resource:floatingip and tenant:e789dc0daf7e432194e9ce61ee72428c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:17.046720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:17.053307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:17.067271 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c697a663-45de-4047-b328-be886e07b9ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:17.067927 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c697a663-45de-4047-b328-be886e07b9ef None None] The sync data for ids ['c14edcf0-ff24-4200-8381-63260d7a0553'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:18:17.072026 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:17.119041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a2eb37f9-aba2-47d2-9756-11109b082c05,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:17.125209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-9a32dd45-e237-40fc-ac41-239662831b6e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:17.126723 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-9a32dd45-e237-40fc-ac41-239662831b6e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "GET /v2.0/ports/be802a6d-cca9-42fd-bdc5-6c9f78035217?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.4743435 May 12 15:18:17.156573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-de6d7310-86e1-4126-b23f-75e466d0d908 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:18:17.328064 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:17.359976 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:17.374338 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc955783-7e09-4e6b-9fbd-7c3209111967 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:17.387173 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-b2502191-821f-4c60-a69a-7b0d96e752ec service neutron] 10.222.0.84 "GET /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7325530 May 12 15:18:17.423100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port be802a6d-cca9-42fd-bdc5-6c9f78035217, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=be802a6d-cca9-42fd-bdc5-6c9f78035217,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:17.435102 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:17.438914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4834ab3b-6306-4f41-81ec-4af4df1f4c1b no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:17.542584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dc955783-7e09-4e6b-9fbd-7c3209111967 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:17.547332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dc955783-7e09-4e6b-9fbd-7c3209111967 admin admin] Usage tracker for resource:security_group_rule and tenant:14c74d4ce1144c60934ec02bbe5f60d7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:17.551560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dc955783-7e09-4e6b-9fbd-7c3209111967 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:17.557235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dc955783-7e09-4e6b-9fbd-7c3209111967 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:17.607238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Allocated IP 172.25.8.237 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/28d44599-da82-4a82-bdba-f11b4cf347a3) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:18:17.652687 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc955783-7e09-4e6b-9fbd-7c3209111967 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:17.653833 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-de6d7310-86e1-4126-b23f-75e466d0d908 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:17.754769 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ff02edea-e8f4-4313-9846-a0df7b1bbe65 req-b4355b2e-5b4e-45b6-9820-d831921b3f7f service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.2124338 May 12 15:18:17.754769 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc955783-7e09-4e6b-9fbd-7c3209111967 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:17.866793 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dc955783-7e09-4e6b-9fbd-7c3209111967 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=14c74d4ce1144c60934ec02bbe5f60d7&name=default HTTP/1.1" status: 200 len: 2983 time: 1.3147066 May 12 15:18:17.872787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58470) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:17.911526 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:17.922719 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=be802a6d-cca9-42fd-bdc5-6c9f78035217,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:17.951285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '04429346-9f7d-4f32-8c65-290ee17fda8a'}, {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a2eb37f9-aba2-47d2-9756-11109b082c05'}, {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'be802a6d-cca9-42fd-bdc5-6c9f78035217'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:17.994261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc955783-7e09-4e6b-9fbd-7c3209111967 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9b8edb83-2247-4042-9537-f7387d57b64f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:18.037113 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:18.083029 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:18.093980 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a6540655-3dcb-4fa6-b347-d2cf59a4b0aa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:18.133536 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a6540655-3dcb-4fa6-b347-d2cf59a4b0aa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:18.186293 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4834ab3b-6306-4f41-81ec-4af4df1f4c1b,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:18.199318 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:18.200469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 857536b0-998d-4731-a09f-f8fca9f18d3e no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:18.251508 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-156ecfab-c201-48a1-a0fe-5d0efca2346c req-bec79735-0bdc-4e05-af33-ea21b03b6aa5 service neutron] 10.222.0.84 "GET /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8505597 May 12 15:18:18.309841 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14e705d2-c681-40bd-b65b-aa3c40c0c0ed req-f7271dae-857f-46b2-b6c4-3e2a79db20ff tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1286635 May 12 15:18:18.348763 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:18.437861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-de6d7310-86e1-4126-b23f-75e466d0d908 service neutron] For port be802a6d-cca9-42fd-bdc5-6c9f78035217, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=be802a6d-cca9-42fd-bdc5-6c9f78035217,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:18.541920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Pushing event updated for resources: {'Port': ['ID=28d44599-da82-4a82-bdba-f11b4cf347a3,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:18.558906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-de6d7310-86e1-4126-b23f-75e466d0d908 service neutron] For port be802a6d-cca9-42fd-bdc5-6c9f78035217, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:18:18.559709 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a6540655-3dcb-4fa6-b347-d2cf59a4b0aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:18.609985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:18:18.623492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:18:18.635102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:18:18.663935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6540655-3dcb-4fa6-b347-d2cf59a4b0aa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b8edb83-2247-4042-9537-f7387d57b64f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:18.667332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4834ab3b-6306-4f41-81ec-4af4df1f4c1b,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:18.736296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-de6d7310-86e1-4126-b23f-75e466d0d908 service neutron] device_id is not set on port be802a6d-cca9-42fd-bdc5-6c9f78035217 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:18:18.758702 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a6540655-3dcb-4fa6-b347-d2cf59a4b0aa admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:18.758806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a6540655-3dcb-4fa6-b347-d2cf59a4b0aa admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9b8edb83-2247-4042-9537-f7387d57b64f HTTP/1.1" status: 204 len: 168 time: 0.8850617 May 12 15:18:18.768532 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-de6d7310-86e1-4126-b23f-75e466d0d908 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:18.805774 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-de6d7310-86e1-4126-b23f-75e466d0d908 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:18.817708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6065de86-3b3d-41fa-89f8-538554a44269 req-516b3304-7cef-43f5-a9f5-296e4e07acaf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:18.824551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6065de86-3b3d-41fa-89f8-538554a44269 req-516b3304-7cef-43f5-a9f5-296e4e07acaf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:18.830763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6065de86-3b3d-41fa-89f8-538554a44269 req-516b3304-7cef-43f5-a9f5-296e4e07acaf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:18.837230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6065de86-3b3d-41fa-89f8-538554a44269 req-516b3304-7cef-43f5-a9f5-296e4e07acaf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:18.843810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6065de86-3b3d-41fa-89f8-538554a44269 req-516b3304-7cef-43f5-a9f5-296e4e07acaf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:18.849869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6065de86-3b3d-41fa-89f8-538554a44269 req-516b3304-7cef-43f5-a9f5-296e4e07acaf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:18.852461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6065de86-3b3d-41fa-89f8-538554a44269 req-516b3304-7cef-43f5-a9f5-296e4e07acaf tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 4656 time: 0.3022773 May 12 15:18:18.900403 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:18.923058 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:18.976994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6065de86-3b3d-41fa-89f8-538554a44269 req-f0b6703c-3cc0-4120-adea-1a9fd9ea0eaa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=f02964c6-c413-4fee-8742-d14649e5864e&id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1178718 May 12 15:18:19.026527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 857536b0-998d-4731-a09f-f8fca9f18d3e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=857536b0-998d-4731-a09f-f8fca9f18d3e,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:19.031236 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fad7f00f-49c0-4047-ab39-f70f82ef3a07'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '04429346-9f7d-4f32-8c65-290ee17fda8a', 'code': 200} May 12 15:18:19.031236 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fad7f00f-49c0-4047-ab39-f70f82ef3a07'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a2eb37f9-aba2-47d2-9756-11109b082c05', 'code': 200} May 12 15:18:19.033620 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fad7f00f-49c0-4047-ab39-f70f82ef3a07'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'be802a6d-cca9-42fd-bdc5-6c9f78035217', 'code': 200} May 12 15:18:19.040119 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:19.041178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device d96ca9ce-4a19-49f0-bef3-e0e31ace478a no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:19.043550 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:19.338568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de6d7310-86e1-4126-b23f-75e466d0d908 service neutron] Pushing event updated for resources: {'Port': ['ID=be802a6d-cca9-42fd-bdc5-6c9f78035217,revision_number=7']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:19.426327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device d96ca9ce-4a19-49f0-bef3-e0e31ace478a not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:18:19.429717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=857536b0-998d-4731-a09f-f8fca9f18d3e,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:19.451143 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:19.572908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7e811330-0775-468c-868f-24f37fe9863f req-dd358c52-1f28-4e2a-8b32-277f863fda01 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f126623-0718-483a-8852-efb8350ac373 HTTP/1.1" status: 200 len: 210 time: 0.0933514 May 12 15:18:19.660889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-de6d7310-86e1-4126-b23f-75e466d0d908 service neutron] No DVR routers for this DVR port be802a6d-cca9-42fd-bdc5-6c9f78035217 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:19.687061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:19.697263 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:19.767178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58516) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:19.847990 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:19.881613 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-40497413-4abe-423e-b7b7-60a7fe8af250 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:19.931542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:19.950835 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:19.952887 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:19.969979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-40497413-4abe-423e-b7b7-60a7fe8af250 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:19.972275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-de6d7310-86e1-4126-b23f-75e466d0d908 service neutron] In _notify_port_updated(), no bound segment for port be802a6d-cca9-42fd-bdc5-6c9f78035217 on network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:18:19.973511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-de6d7310-86e1-4126-b23f-75e466d0d908 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:19.974128 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-de6d7310-86e1-4126-b23f-75e466d0d908 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:19.975979 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-de6d7310-86e1-4126-b23f-75e466d0d908 service neutron] 10.222.0.84 "PUT /v2.0/ports/be802a6d-cca9-42fd-bdc5-6c9f78035217 HTTP/1.1" status: 200 len: 1033 time: 2.8258634 May 12 15:18:19.978613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-40497413-4abe-423e-b7b7-60a7fe8af250 admin admin] Usage tracker for resource:security_group_rule and tenant:18738234180542dbad8129111a95b49b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:19.985483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Pushing event updated for resources: {'Port': ['ID=28d44599-da82-4a82-bdba-f11b4cf347a3,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:20.015172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cab28c29-7556-4ec6-a5c2-7adef755fa16 None None] Provisioning complete for port be802a6d-cca9-42fd-bdc5-6c9f78035217 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:18:20.015534 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cab28c29-7556-4ec6-a5c2-7adef755fa16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:20.036352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-40497413-4abe-423e-b7b7-60a7fe8af250 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:20.060461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-40497413-4abe-423e-b7b7-60a7fe8af250 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:20.068132 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:20.071471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9cf03d3-6aa9-452b-847a-87d870e71d71 req-eda77fdb-adfc-4828-b6c3-4770a4372bed tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1881118 May 12 15:18:20.074129 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:20.080285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d52040bd-5466-4165-9182-47699ecbfc1e tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.0530465 May 12 15:18:20.081036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58526) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:20.091597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-cab28c29-7556-4ec6-a5c2-7adef755fa16 None None] Port be802a6d-cca9-42fd-bdc5-6c9f78035217 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:18:20.119750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-d3b6c6bb-e668-45d9-95d1-98df63e11c2c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Deleting port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:20.119750 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-d3b6c6bb-e668-45d9-95d1-98df63e11c2c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:20.242962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d3ee8da-665c-48d6-8fa0-af19b64ebd91 req-a2ff4e69-2a69-42c7-85be-f858a16101a2 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:20.254360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d3ee8da-665c-48d6-8fa0-af19b64ebd91 req-a2ff4e69-2a69-42c7-85be-f858a16101a2 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 945 time: 0.1250162 May 12 15:18:20.439031 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-40497413-4abe-423e-b7b7-60a7fe8af250 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:20.448185 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-40497413-4abe-423e-b7b7-60a7fe8af250 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:20.520222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40497413-4abe-423e-b7b7-60a7fe8af250 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=46e285f9-093f-4b54-920d-4f784404b6a6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:20.521541 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d3ee8da-665c-48d6-8fa0-af19b64ebd91 req-c96df8b8-903d-4553-bfbe-608e94c7e3a0 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2651649 May 12 15:18:20.529174 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-40497413-4abe-423e-b7b7-60a7fe8af250 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=18738234180542dbad8129111a95b49b&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7507532 May 12 15:18:20.532587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58542) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:20.540386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:18:20.551363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:20.560560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Usage tracker for resource:floatingip and tenant:674db78af00a401b9ac414457189584e is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:20.565326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:20.575711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:20.602606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-d3b6c6bb-e668-45d9-95d1-98df63e11c2c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] For port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4834ab3b-6306-4f41-81ec-4af4df1f4c1b,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:20.603329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-d3b6c6bb-e668-45d9-95d1-98df63e11c2c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:20.617931 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:20.645355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4c0737fa-ad85-43c6-9c92-a39559d1a411 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:20.651888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4c0737fa-ad85-43c6-9c92-a39559d1a411 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/networks?id=c3c7ba99-d7de-4515-b784-ef9ce8b08726 HTTP/1.1" status: 200 len: 805 time: 0.3417189 May 12 15:18:20.720953 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-f214fa07-5ec6-473f-9afa-5b3b2c159ff7 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/quotas/7d73e66034f94885ae45429129883002 HTTP/1.1" status: 200 len: 375 time: 0.0682001 May 12 15:18:20.750706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-d3b6c6bb-e668-45d9-95d1-98df63e11c2c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Calling delete_port for 4834ab3b-6306-4f41-81ec-4af4df1f4c1b owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:20.784188 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15a4975c-c9e0-47f4-b9f1-8da369cd9e11 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:20.838223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15a4975c-c9e0-47f4-b9f1-8da369cd9e11 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:20.876264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-9bb203b1-5bf1-4968-aa08-a7a280066edc tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=7d73e66034f94885ae45429129883002&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1469524 May 12 15:18:20.958645 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15a4975c-c9e0-47f4-b9f1-8da369cd9e11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:20.982990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15a4975c-c9e0-47f4-b9f1-8da369cd9e11 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=46e285f9-093f-4b54-920d-4f784404b6a6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:20.995227 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-d3b6c6bb-e668-45d9-95d1-98df63e11c2c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:21.026364 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:21.035005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4834ab3b-6306-4f41-81ec-4af4df1f4c1b'}, {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '857536b0-998d-4731-a09f-f8fca9f18d3e'}, {'server_uuid': 'c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '62a79e7a-b21f-4f5b-935e-b7b9c9759c49'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:21.063704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3b6c6bb-e668-45d9-95d1-98df63e11c2c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event deleted for resources: {'Port': ['ID=4834ab3b-6306-4f41-81ec-4af4df1f4c1b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:21.104913 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15a4975c-c9e0-47f4-b9f1-8da369cd9e11 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:21.106055 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-15a4975c-c9e0-47f4-b9f1-8da369cd9e11 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/46e285f9-093f-4b54-920d-4f784404b6a6 HTTP/1.1" status: 204 len: 168 time: 0.5725870 May 12 15:18:21.177098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-d3b6c6bb-e668-45d9-95d1-98df63e11c2c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] No DVR routers for this DVR port 4834ab3b-6306-4f41-81ec-4af4df1f4c1b on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:21.180906 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-d3b6c6bb-e668-45d9-95d1-98df63e11c2c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:21.183605 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-d3b6c6bb-e668-45d9-95d1-98df63e11c2c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "DELETE /v2.0/ports/4834ab3b-6306-4f41-81ec-4af4df1f4c1b HTTP/1.1" status: 204 len: 173 time: 1.2021711 May 12 15:18:21.184322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-deleted', 'tag': '4834ab3b-6306-4f41-81ec-4af4df1f4c1b'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:21.244946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-6093e825-1e3e-472f-bd8b-1562d51ed409 service neutron] 10.222.0.82 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3674276 May 12 15:18:21.261975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Deleting port 04429346-9f7d-4f32-8c65-290ee17fda8a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:21.262475 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:21.466212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94dc34c0-55a7-46f1-9254-b78247ff6654 req-81f038b2-42a0-4d9c-bcce-9f83db9c39aa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:21.472895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94dc34c0-55a7-46f1-9254-b78247ff6654 req-81f038b2-42a0-4d9c-bcce-9f83db9c39aa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:21.478920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94dc34c0-55a7-46f1-9254-b78247ff6654 req-81f038b2-42a0-4d9c-bcce-9f83db9c39aa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:21.486085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94dc34c0-55a7-46f1-9254-b78247ff6654 req-81f038b2-42a0-4d9c-bcce-9f83db9c39aa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:21.494917 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-94dc34c0-55a7-46f1-9254-b78247ff6654 req-81f038b2-42a0-4d9c-bcce-9f83db9c39aa tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 3143 time: 0.5874867 May 12 15:18:21.547592 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Allocated IP 172.25.8.131 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/8211b60e-57db-45a1-a346-441150eac736) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:18:21.602470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] For port 04429346-9f7d-4f32-8c65-290ee17fda8a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=04429346-9f7d-4f32-8c65-290ee17fda8a,segment=NetworkSegment(a64e84dc-d91c-44e1-ab35-6c9b54a1b65b),segment_id=a64e84dc-d91c-44e1-ab35-6c9b54a1b65b)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:21.603221 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:21.630229 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-94dc34c0-55a7-46f1-9254-b78247ff6654 req-9625aada-b10f-4179-9f22-b6a12c9480f4 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1340835 May 12 15:18:21.773316 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-e708bbb7-81f5-426a-975f-18e4e67898fa service neutron] 10.222.0.82 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5272999 May 12 15:18:21.851733 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:21.892571 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:21.976837 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:18:21.992417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:18:21.995642 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:18:22.072448 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Pushing event updated for resources: {'Port': ['ID=8211b60e-57db-45a1-a346-441150eac736,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:22.153567 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:22.248653 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:22.294450 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1351a32e-130d-4a4c-b273-a562db2b5282 req-68fd782b-47c8-49db-90e5-6d6a57bb56d2 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9f126623-0718-483a-8852-efb8350ac373 HTTP/1.1" status: 200 len: 210 time: 0.2367833 May 12 15:18:22.478394 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6e221600-48ea-4315-bc83-6d322fedf5b4'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4834ab3b-6306-4f41-81ec-4af4df1f4c1b', 'code': 200} May 12 15:18:22.479213 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6e221600-48ea-4315-bc83-6d322fedf5b4'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '857536b0-998d-4731-a09f-f8fca9f18d3e', 'code': 200} May 12 15:18:22.479972 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6e221600-48ea-4315-bc83-6d322fedf5b4'] response: {'server_uuid': 'c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '62a79e7a-b21f-4f5b-935e-b7b9c9759c49', 'code': 200} May 12 15:18:22.607865 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6ad7fe55-b685-4696-ac17-01761d5e3363'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-deleted', 'tag': '4834ab3b-6306-4f41-81ec-4af4df1f4c1b', 'status': 'completed', 'code': 200} May 12 15:18:22.643953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bb0bb4c-5315-4aac-bc40-a9ea04d2224b req-0f04b7fb-8244-4044-a35c-f4a6e8ce3474 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:22.649083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-6bb0bb4c-5315-4aac-bc40-a9ea04d2224b req-0f04b7fb-8244-4044-a35c-f4a6e8ce3474 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Synchronizing usage tracker for tenant:7d73e66034f94885ae45429129883002 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:18:22.684638 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:22.686575 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:22.686895 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Floating IP b8015aab-2a22-4ed4-8692-3f7185b4feae disassociated. External IP: 172.25.8.175, port: 04429346-9f7d-4f32-8c65-290ee17fda8a. May 12 15:18:22.687234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Calling delete_port for 04429346-9f7d-4f32-8c65-290ee17fda8a owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:22.701560 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:22.756535 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:22.774877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-6bb0bb4c-5315-4aac-bc40-a9ea04d2224b req-0f04b7fb-8244-4044-a35c-f4a6e8ce3474 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Unset dirty status for tenant:7d73e66034f94885ae45429129883002 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:18:22.776374 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6bb0bb4c-5315-4aac-bc40-a9ea04d2224b req-0f04b7fb-8244-4044-a35c-f4a6e8ce3474 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.84 "GET /v2.0/ports?device_id=c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa HTTP/1.1" status: 200 len: 943 time: 1.0832100 May 12 15:18:22.880762 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12b9b74d-6403-4e75-8ef6-525bdbf2274e req-b994ffc2-c998-48fd-98b8-532183b18981 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 210 time: 0.1770597 May 12 15:18:22.883081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-6bb0bb4c-5315-4aac-bc40-a9ea04d2224b req-caaa8c24-1aed-4fbc-9375-bfbdb5a2aeac tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Deleting port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:22.883610 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6bb0bb4c-5315-4aac-bc40-a9ea04d2224b req-caaa8c24-1aed-4fbc-9375-bfbdb5a2aeac tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:22.946402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-565fc23d-7898-44bf-b917-71a421002ce8 req-68ee9c9d-9108-4c08-8d74-ac2647ac43ee tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0728605 May 12 15:18:23.037295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Pushing event updated for resources: {'Port': ['ID=8211b60e-57db-45a1-a346-441150eac736,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:23.067708 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:23.140176 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:23.233503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event deleted for resources: {'Port': ['ID=04429346-9f7d-4f32-8c65-290ee17fda8a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:23.355472 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:23.357517 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8ee4cefc-3c27-4ed1-a925-83356b723914 tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.2751768 May 12 15:18:23.363309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58634) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:23.373758 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22c55393-ea51-4589-be4c-55b341a80205 req-030e3f4f-c8df-4bf8-89fc-04dcc2214623 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.2566669 May 12 15:18:23.551620 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6bb0bb4c-5315-4aac-bc40-a9ea04d2224b req-caaa8c24-1aed-4fbc-9375-bfbdb5a2aeac tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] For port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:23.553626 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6bb0bb4c-5315-4aac-bc40-a9ea04d2224b req-caaa8c24-1aed-4fbc-9375-bfbdb5a2aeac tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:23.683654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-265d6773-4701-4c44-81ac-6b410a1b23f7 tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Synchronizing usage tracker for tenant:e789dc0daf7e432194e9ce61ee72428c on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:18:23.785166 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1643acf-cf31-420d-a84f-5307bc97f38c req-5677cd9d-8c86-4110-86fc-63684d096050 tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0982964 May 12 15:18:23.790190 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-26003ae1-202e-4e9a-8461-bdb68fa3cbf1 req-a2d4ed97-4acc-402d-9327-2e68aeb087a9 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.2085378 May 12 15:18:23.862972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-265d6773-4701-4c44-81ac-6b410a1b23f7 tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Unset dirty status for tenant:e789dc0daf7e432194e9ce61ee72428c on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:18:23.870107 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-265d6773-4701-4c44-81ac-6b410a1b23f7 tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] 10.222.0.82 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 3701 time: 0.4899657 May 12 15:18:23.872556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58644) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:23.928741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Router be64a9da-126d-4279-98a4-e0a9cc891b26 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:18:23.951361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-6bb0bb4c-5315-4aac-bc40-a9ea04d2224b req-caaa8c24-1aed-4fbc-9375-bfbdb5a2aeac tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Calling delete_port for 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:23.994024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9cc13b-dcd3-4e8a-a241-a493888d9f61 req-352f58eb-34e1-4cb5-9712-a184b392559e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:24.000066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9cc13b-dcd3-4e8a-a241-a493888d9f61 req-352f58eb-34e1-4cb5-9712-a184b392559e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:24.007543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9cc13b-dcd3-4e8a-a241-a493888d9f61 req-352f58eb-34e1-4cb5-9712-a184b392559e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:24.014532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5c9cc13b-dcd3-4e8a-a241-a493888d9f61 req-352f58eb-34e1-4cb5-9712-a184b392559e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 2410 time: 0.4082639 May 12 15:18:24.019026 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-07923318-1e25-41ed-ad75-b424a2bdd92a tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Synchronizing usage tracker for tenant:95dd8f9e0e0f4857960aab14d84dc751 on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:18:24.089539 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5c9cc13b-dcd3-4e8a-a241-a493888d9f61 req-65b00d21-d051-4b51-b10f-436126b1e034 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0740337 May 12 15:18:24.096464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-07923318-1e25-41ed-ad75-b424a2bdd92a tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Unset dirty status for tenant:95dd8f9e0e0f4857960aab14d84dc751 on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:18:24.101503 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-07923318-1e25-41ed-ad75-b424a2bdd92a tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 690 time: 0.2258806 May 12 15:18:24.102339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58654) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:24.456987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9bc942a-d509-4eb4-a874-edac1ee1a5cd req-20af8b84-f2c3-45d7-8b75-7b83b15447aa tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 210 time: 0.2355142 May 12 15:18:24.465786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-7d726e6f-ae47-49b7-b342-5851dc256b1f tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Deleting port 8211b60e-57db-45a1-a346-441150eac736 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:24.465918 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d726e6f-ae47-49b7-b342-5851dc256b1f tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:24.565786 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6bb0bb4c-5315-4aac-bc40-a9ea04d2224b req-caaa8c24-1aed-4fbc-9375-bfbdb5a2aeac tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:24.655378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caaa8c24-1aed-4fbc-9375-bfbdb5a2aeac tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Pushing event deleted for resources: {'Port': ['ID=62a79e7a-b21f-4f5b-935e-b7b9c9759c49,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:24.667110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-3becb6d0-2e2d-4c3f-b09a-32f03ce133de tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:24.668640 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-3becb6d0-2e2d-4c3f-b09a-32f03ce133de tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.84 "GET /v2.0/networks?id=c3c7ba99-d7de-4515-b784-ef9ce8b08726 HTTP/1.1" status: 200 len: 805 time: 0.5954542 May 12 15:18:24.715956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Request body: {'port': {'device_id': '8617af39-06d3-45c2-bfd2-78bad9d75c03', 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726', 'admin_state_up': True, 'tenant_id': '7d73e66034f94885ae45429129883002'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:18:24.716124 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19a4e711-dcae-40f8-97ac-087891e50cf5 req-d6d316ef-02c9-42f9-8e9b-287048243c3c tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.0786078 May 12 15:18:24.728412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ed77d3a-1560-434a-bda0-937d272f2d57 req-6bb38188-9f5b-47d2-83ec-cbcc97200d58 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:24.735420 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ed77d3a-1560-434a-bda0-937d272f2d57 req-6bb38188-9f5b-47d2-83ec-cbcc97200d58 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 945 time: 0.5128181 May 12 15:18:24.765517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:18:24.784979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4fa9198-bb14-45a3-bb0d-99ac38f0a9c1 None None] Sync routers for ids ['be64a9da-126d-4279-98a4-e0a9cc891b26'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:18:24.799470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4fa9198-bb14-45a3-bb0d-99ac38f0a9c1 None None] Routers {'be64a9da-126d-4279-98a4-e0a9cc891b26'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:18:24.800087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a4fa9198-bb14-45a3-bb0d-99ac38f0a9c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:18:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['be64a9da-126d-4279-98a4-e0a9cc891b26'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:24.820455 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d726e6f-ae47-49b7-b342-5851dc256b1f tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:24.820747 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d726e6f-ae47-49b7-b342-5851dc256b1f tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:24.929067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-6bb0bb4c-5315-4aac-bc40-a9ea04d2224b req-caaa8c24-1aed-4fbc-9375-bfbdb5a2aeac tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] No DVR routers for this DVR port 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:24.934188 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6bb0bb4c-5315-4aac-bc40-a9ea04d2224b req-caaa8c24-1aed-4fbc-9375-bfbdb5a2aeac tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:24.965665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa', 'name': 'network-vif-deleted', 'tag': '62a79e7a-b21f-4f5b-935e-b7b9c9759c49'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:24.973433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:24.993505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Usage tracker for resource:port and tenant:7d73e66034f94885ae45429129883002 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:25.010744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-7d726e6f-ae47-49b7-b342-5851dc256b1f tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Calling delete_port for 8211b60e-57db-45a1-a346-441150eac736 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:25.030000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:25.053777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] No DVR routers for this DVR port 04429346-9f7d-4f32-8c65-290ee17fda8a on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:25.056609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:25.060241 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:25.077674 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-1da29edf-565f-4675-a076-9ca5b471af6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "DELETE /v2.0/ports/04429346-9f7d-4f32-8c65-290ee17fda8a HTTP/1.1" status: 204 len: 173 time: 3.8873775 May 12 15:18:25.082850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Made reservation on behalf of 7d73e66034f94885ae45429129883002 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:18:25.084013 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ed77d3a-1560-434a-bda0-937d272f2d57 req-25458e15-372c-4c43-9583-b0a1828961c5 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3477652 May 12 15:18:25.088155 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:25.197575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-f38b7810-ddc8-4e8a-ab3a-acf7aa450216 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Deleting port a2eb37f9-aba2-47d2-9756-11109b082c05 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:25.197575 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-f38b7810-ddc8-4e8a-ab3a-acf7aa450216 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:25.231127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:25.243060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87f0bd68-2b61-4b06-8dc0-74de070ed2ef req-8c60bb28-6245-401a-b3a9-3ba28581f39f tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0563862 May 12 15:18:25.276599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-a4fa9198-bb14-45a3-bb0d-99ac38f0a9c1 None None] Set router be64a9da-126d-4279-98a4-e0a9cc891b26 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:18:25.308591 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b50cf3c3-cf33-442e-bbd4-8ee1aec1df2c'] response: {'server_uuid': 'c9fb9a65-2ae6-47f4-8ab3-2aa7cc590efa', 'name': 'network-vif-deleted', 'tag': '62a79e7a-b21f-4f5b-935e-b7b9c9759c49', 'status': 'completed', 'code': 200} May 12 15:18:25.329034 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6bb0bb4c-5315-4aac-bc40-a9ea04d2224b req-caaa8c24-1aed-4fbc-9375-bfbdb5a2aeac tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.84 "DELETE /v2.0/ports/62a79e7a-b21f-4f5b-935e-b7b9c9759c49 HTTP/1.1" status: 204 len: 173 time: 2.5435462 May 12 15:18:25.383689 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d726e6f-ae47-49b7-b342-5851dc256b1f tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:25.570134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d726e6f-ae47-49b7-b342-5851dc256b1f tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Pushing event deleted for resources: {'Port': ['ID=8211b60e-57db-45a1-a346-441150eac736,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:25.719808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:18:25.722183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 62a79e7a-b21f-4f5b-935e-b7b9c9759c49 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:18:25.791616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a4fa9198-bb14-45a3-bb0d-99ac38f0a9c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:11:55Z', 'revision_number': 4, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '60462079-9a62-4718-a485-d1d0aa343c39', 'name': '', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'mac_address': 'fa:16:3e:09:47:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_interface', 'standard_attr_id': 861, 'fixed_ips': [{'subnet_id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:53Z', 'updated_at': '2022-05-12T15:12:06Z', 'revision_number': 5, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'subnets': [{'id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:25.798740 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d726e6f-ae47-49b7-b342-5851dc256b1f tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:25.805083 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4fa9198-bb14-45a3-bb0d-99ac38f0a9c1 None None] Checking router: be64a9da-126d-4279-98a4-e0a9cc891b26 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:18:25.820149 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d726e6f-ae47-49b7-b342-5851dc256b1f tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:25.823772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7d726e6f-ae47-49b7-b342-5851dc256b1f tempest-FloatingIPAdminTestJSON-815134310 tempest-FloatingIPAdminTestJSON-815134310-project] 10.222.0.82 "DELETE /v2.0/floatingips/b97426f3-b0a8-4b3d-b839-12ea43cb2e26 HTTP/1.1" status: 204 len: 168 time: 1.7179451 May 12 15:18:25.823897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4fa9198-bb14-45a3-bb0d-99ac38f0a9c1 None None] Routers {'be64a9da-126d-4279-98a4-e0a9cc891b26'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:18:25.824524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a4fa9198-bb14-45a3-bb0d-99ac38f0a9c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:18:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['be64a9da-126d-4279-98a4-e0a9cc891b26'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:25.824919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58696) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:25.934595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb79c1d9-6302-4c51-a549-5673a8a55e65 req-7dc23130-bbd7-49ed-a08e-375ebdf1caf6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:25.940343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb79c1d9-6302-4c51-a549-5673a8a55e65 req-7dc23130-bbd7-49ed-a08e-375ebdf1caf6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:25.946802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb79c1d9-6302-4c51-a549-5673a8a55e65 req-7dc23130-bbd7-49ed-a08e-375ebdf1caf6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:25.954197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb79c1d9-6302-4c51-a549-5673a8a55e65 req-7dc23130-bbd7-49ed-a08e-375ebdf1caf6 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 2410 time: 0.4775612 May 12 15:18:25.981366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b202e65f-ca35-4851-86f9-77600203c30d req-ad67426d-b3f7-43d5-be08-074c2932de2f tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 210 time: 0.1587589 May 12 15:18:26.088287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a9b5704e-c857-44b8-b8de-ae147339ad28 tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Deleting port 28d44599-da82-4a82-bdba-f11b4cf347a3 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:26.088632 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a9b5704e-c857-44b8-b8de-ae147339ad28 tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:26.107533 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-a4fa9198-bb14-45a3-bb0d-99ac38f0a9c1 None None] Set router be64a9da-126d-4279-98a4-e0a9cc891b26 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:18:26.125242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-f38b7810-ddc8-4e8a-ab3a-acf7aa450216 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] For port a2eb37f9-aba2-47d2-9756-11109b082c05, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a2eb37f9-aba2-47d2-9756-11109b082c05,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:26.125960 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-f38b7810-ddc8-4e8a-ab3a-acf7aa450216 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:26.275844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-f38b7810-ddc8-4e8a-ab3a-acf7aa450216 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Calling delete_port for a2eb37f9-aba2-47d2-9756-11109b082c05 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:26.360205 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a9b5704e-c857-44b8-b8de-ae147339ad28 tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:26.360542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a9b5704e-c857-44b8-b8de-ae147339ad28 tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:26.450541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Allocated IP 172.20.0.8 (c3c7ba99-d7de-4515-b784-ef9ce8b08726/2c6ef05c-5190-47b2-bba9-0d2bdacd727d/6bc1aefc-4b55-42c5-90cb-a9601d36d06c) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:18:26.529137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a9b5704e-c857-44b8-b8de-ae147339ad28 tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Calling delete_port for 28d44599-da82-4a82-bdba-f11b4cf347a3 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:26.564163 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a4fa9198-bb14-45a3-bb0d-99ac38f0a9c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:11:55Z', 'revision_number': 4, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '60462079-9a62-4718-a485-d1d0aa343c39', 'name': '', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'mac_address': 'fa:16:3e:09:47:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_interface', 'standard_attr_id': 861, 'fixed_ips': [{'subnet_id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:53Z', 'updated_at': '2022-05-12T15:12:06Z', 'revision_number': 5, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'subnets': [{'id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:26.569377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4fa9198-bb14-45a3-bb0d-99ac38f0a9c1 None None] The sync data for ids ['be64a9da-126d-4279-98a4-e0a9cc891b26'] in n-d-841483-1 is: [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:11:55Z', 'revision_number': 4, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '60462079-9a62-4718-a485-d1d0aa343c39', 'name': '', 'network_id': '13468259-dd20-42ac-88ec-2614ebea6ccc', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'mac_address': 'fa:16:3e:09:47:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_interface', 'standard_attr_id': 861, 'fixed_ips': [{'subnet_id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:53Z', 'updated_at': '2022-05-12T15:12:06Z', 'revision_number': 5, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'subnets': [{'id': '4ecb64d7-7b16-437b-8f3e-4996d58043f6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:18:26.665137 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fffea2be-c719-46d3-b61a-e247bfdd6bb2 req-91e27957-4d88-4e6c-ba9f-da0392fe86f9 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.1468017 May 12 15:18:26.668273 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb79c1d9-6302-4c51-a549-5673a8a55e65 req-eb2c1417-6350-4c0f-81b0-5cf8295738d0 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7136405 May 12 15:18:26.811801 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-f38b7810-ddc8-4e8a-ab3a-acf7aa450216 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:26.828169 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a9b5704e-c857-44b8-b8de-ae147339ad28 tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:26.830211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-511f1297-21f1-481d-a730-b27dc7fa480b req-b583cc37-1703-46c9-bb2d-b0d18715bf9d tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:26.830929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-511f1297-21f1-481d-a730-b27dc7fa480b req-b583cc37-1703-46c9-bb2d-b0d18715bf9d tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Synchronizing usage tracker for tenant:60b7c456959149269dc444554ba6a6c2 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:18:26.925647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f38b7810-ddc8-4e8a-ab3a-acf7aa450216 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event deleted for resources: {'Port': ['ID=a2eb37f9-aba2-47d2-9756-11109b082c05,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:26.954895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9b5704e-c857-44b8-b8de-ae147339ad28 tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Pushing event deleted for resources: {'Port': ['ID=28d44599-da82-4a82-bdba-f11b4cf347a3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:27.003231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-511f1297-21f1-481d-a730-b27dc7fa480b req-b583cc37-1703-46c9-bb2d-b0d18715bf9d tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Unset dirty status for tenant:60b7c456959149269dc444554ba6a6c2 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:18:27.004381 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-511f1297-21f1-481d-a730-b27dc7fa480b req-b583cc37-1703-46c9-bb2d-b0d18715bf9d tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.76 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 945 time: 1.5153561 May 12 15:18:27.026680 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-762955f1-6cd1-4534-8023-47218a62c2ba None None] New status for floating IP b8015aab-2a22-4ed4-8692-3f7185b4feae: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:18:27.080414 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-967cf47b-9e46-4665-85aa-b12ab5bc37b4 req-7d8bd119-ba0b-4e32-9479-202a565aee92 tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1413817 May 12 15:18:27.106065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-f38b7810-ddc8-4e8a-ab3a-acf7aa450216 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] No DVR routers for this DVR port a2eb37f9-aba2-47d2-9756-11109b082c05 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:27.119680 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:27.123000 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-f38b7810-ddc8-4e8a-ab3a-acf7aa450216 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:27.148232 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a9b5704e-c857-44b8-b8de-ae147339ad28 tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:27.161968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-470f0a67-238e-4b44-bcf1-c69cd4fdf50c req-ed665844-3b72-4851-9d87-dd814fdf0b69 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:27.164937 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-f38b7810-ddc8-4e8a-ab3a-acf7aa450216 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "DELETE /v2.0/ports/a2eb37f9-aba2-47d2-9756-11109b082c05 HTTP/1.1" status: 204 len: 173 time: 2.0563521 May 12 15:18:27.168375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Deleting port d3bf5047-6e8a-4d30-bf27-76571b79026a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:27.168722 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:27.169041 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-470f0a67-238e-4b44-bcf1-c69cd4fdf50c req-ed665844-3b72-4851-9d87-dd814fdf0b69 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 945 time: 0.3313568 May 12 15:18:27.265972 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-470f0a67-238e-4b44-bcf1-c69cd4fdf50c req-e849fbef-1f68-4d40-ae2b-c8d0897f152a tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0959702 May 12 15:18:27.268032 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a9b5704e-c857-44b8-b8de-ae147339ad28 tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:27.281075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a9b5704e-c857-44b8-b8de-ae147339ad28 tempest-FloatingIPAdminTestJSON-8920498 tempest-FloatingIPAdminTestJSON-8920498-project-admin] 10.222.0.82 "DELETE /v2.0/floatingips/dc63e06c-2ca3-46d8-81ad-9f666f9cd50f HTTP/1.1" status: 204 len: 168 time: 1.4543190 May 12 15:18:27.282144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58724) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:27.312589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-deleted', 'tag': '04429346-9f7d-4f32-8c65-290ee17fda8a'}, {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-deleted', 'tag': 'a2eb37f9-aba2-47d2-9756-11109b082c05'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:27.365838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Deleting port 857536b0-998d-4731-a09f-f8fca9f18d3e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:27.366550 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:27.519139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-88ed83c9-f688-4af5-b873-59fe9410f718 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Deleting port 9d90f3d3-86be-4b91-80f9-5f7745ab3044 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:27.519715 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88ed83c9-f688-4af5-b873-59fe9410f718 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:27.623244 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5c172f09-516b-4e50-8f63-db3ba473f8f9 req-1f1988d7-c842-42f4-b74e-fcfcbb1f05a0 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 210 time: 0.0710750 May 12 15:18:27.700486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:27.793313 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6334c4af-c9e2-4f0a-8892-1ec15a8d9ad9'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-deleted', 'tag': '04429346-9f7d-4f32-8c65-290ee17fda8a', 'status': 'completed', 'code': 200} May 12 15:18:27.794000 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6334c4af-c9e2-4f0a-8892-1ec15a8d9ad9'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-deleted', 'tag': 'a2eb37f9-aba2-47d2-9756-11109b082c05', 'status': 'completed', 'code': 200} May 12 15:18:28.001461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Network c3c7ba99-d7de-4515-b784-ef9ce8b08726 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:18:28.029275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:18:28.032312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:18:28.071577 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Pushing event updated for resources: {'Port': ['ID=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:28.135115 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40b7691c-1a31-454c-968b-62a8a3b144f3 req-146b54e7-7ff0-46c3-8a0d-960f42d00b99 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.1207933 May 12 15:18:28.218134 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88ed83c9-f688-4af5-b873-59fe9410f718 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:28.258194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] For port d3bf5047-6e8a-4d30-bf27-76571b79026a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d3bf5047-6e8a-4d30-bf27-76571b79026a,segment=NetworkSegment(51a763ab-4327-4303-92e7-963b2e4c87d0),segment_id=51a763ab-4327-4303-92e7-963b2e4c87d0)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:28.258761 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:28.281321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:28.282258 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:28.392116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-88ed83c9-f688-4af5-b873-59fe9410f718 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Calling delete_port for 9d90f3d3-86be-4b91-80f9-5f7745ab3044 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:28.412902 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-8f316f5c-5af8-443f-89b5-2b8f353d8920 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.7062106 May 12 15:18:28.423647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] For port 857536b0-998d-4731-a09f-f8fca9f18d3e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=857536b0-998d-4731-a09f-f8fca9f18d3e,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:28.424091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:28.444259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Request body: {'port': {'device_id': '8617af39-06d3-45c2-bfd2-78bad9d75c03', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:18:28.506146 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83d647e4-61c9-4caa-958b-847c423fdb22 req-bf6b4b46-b135-4a3f-84df-fbd91e8711a1 tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0783033 May 12 15:18:28.518095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21cb430c-3da9-4b26-9893-f1069767a138 req-f802d0b0-b6ed-41e9-b305-620cacd2ab24 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:28.519134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d3bf5047-6e8a-4d30-bf27-76571b79026a no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:28.524461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21cb430c-3da9-4b26-9893-f1069767a138 req-f802d0b0-b6ed-41e9-b305-620cacd2ab24 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:28.527491 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21cb430c-3da9-4b26-9893-f1069767a138 req-f802d0b0-b6ed-41e9-b305-620cacd2ab24 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 1677 time: 0.5122566 May 12 15:18:28.676659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Calling delete_port for 857536b0-998d-4731-a09f-f8fca9f18d3e owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:28.680168 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88ed83c9-f688-4af5-b873-59fe9410f718 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:28.744561 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:28.757339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ed83c9-f688-4af5-b873-59fe9410f718 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event deleted for resources: {'Port': ['ID=9d90f3d3-86be-4b91-80f9-5f7745ab3044,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:28.832648 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd3bf5047-6e8a-4d30-bf27-76571b79026a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:28.853084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21cb430c-3da9-4b26-9893-f1069767a138 req-f93dadc8-71fb-4b43-8ff8-290f2333f5b9 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1957722 May 12 15:18:28.860940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d3bf5047-6e8a-4d30-bf27-76571b79026a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d3bf5047-6e8a-4d30-bf27-76571b79026a,segment=NetworkSegment(51a763ab-4327-4303-92e7-963b2e4c87d0),segment_id=51a763ab-4327-4303-92e7-963b2e4c87d0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:28.869000 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:29.016151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d3bf5047-6e8a-4d30-bf27-76571b79026a,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:29.061963 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88ed83c9-f688-4af5-b873-59fe9410f718 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:29.122312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-88ed83c9-f688-4af5-b873-59fe9410f718 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "DELETE /v2.0/ports/9d90f3d3-86be-4b91-80f9-5f7745ab3044 HTTP/1.1" status: 204 len: 168 time: 1.8388705 May 12 15:18:29.130307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58770) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:29.198590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7859e2a2-d971-488a-ac24-d62482ec4020 req-8913bca3-a1e0-44e2-a342-877bdde002db tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:29.200080 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7859e2a2-d971-488a-ac24-d62482ec4020 req-8913bca3-a1e0-44e2-a342-877bdde002db tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 943 time: 0.3455803 May 12 15:18:29.249861 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:29.249861 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:29.250132 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Floating IP 1764867b-4de0-4394-b192-67b196123be1 disassociated. External IP: 172.25.8.53, port: d3bf5047-6e8a-4d30-bf27-76571b79026a. May 12 15:18:29.250447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Calling delete_port for d3bf5047-6e8a-4d30-bf27-76571b79026a owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:29.273048 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7859e2a2-d971-488a-ac24-d62482ec4020 req-f4a8cd78-477b-44db-91a7-09bbf16bd843 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0622795 May 12 15:18:29.290546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23cdb9c8-0dd9-4dba-a651-bda15eb2cdad tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:29.291244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-23cdb9c8-0dd9-4dba-a651-bda15eb2cdad tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Synchronizing usage tracker for tenant:95dd8f9e0e0f4857960aab14d84dc751 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:18:29.302129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efa4fd2f-7066-4ea5-bc48-2779415d8aeb req-f18bd6e5-7ace-492e-82e3-bbe39940108f tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:29.304136 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-efa4fd2f-7066-4ea5-bc48-2779415d8aeb req-f18bd6e5-7ace-492e-82e3-bbe39940108f tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 931 time: 0.2376432 May 12 15:18:29.312032 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:29.315684 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:29.378279 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1653487f-a647-4bb3-81eb-09a45b441e39'] response: {'server_uuid': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd3bf5047-6e8a-4d30-bf27-76571b79026a', 'code': 200} May 12 15:18:29.379668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-efa4fd2f-7066-4ea5-bc48-2779415d8aeb req-d164508f-c76d-470c-87a7-8f86624c145a tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652757 May 12 15:18:29.380493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-23cdb9c8-0dd9-4dba-a651-bda15eb2cdad tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Unset dirty status for tenant:95dd8f9e0e0f4857960aab14d84dc751 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:18:29.382632 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-23cdb9c8-0dd9-4dba-a651-bda15eb2cdad tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "GET /v2.0/ports?device_id=c14edcf0-ff24-4200-8381-63260d7a0553 HTTP/1.1" status: 200 len: 913 time: 0.2528534 May 12 15:18:29.385151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58778) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:29.395048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event deleted for resources: {'Port': ['ID=857536b0-998d-4731-a09f-f8fca9f18d3e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:29.406525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:29.406866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:29.407198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:29.407533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:29.407846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:29.408167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:29.408483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:29.408797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:29.409112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:29.409469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:29.409766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:29.410079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:29.625767 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22b828a7-d010-4409-994b-466a3e5bd9eb req-851f6026-d49e-433a-a080-c278e9f409d3 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.1210668 May 12 15:18:29.637906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] No DVR routers for this DVR port 857536b0-998d-4731-a09f-f8fca9f18d3e on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:29.643787 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:29.651129 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:18:29.651677 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:18:29.724672 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-34592a82-1b0b-4456-831b-83245319ea6c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "DELETE /v2.0/ports/857536b0-998d-4731-a09f-f8fca9f18d3e HTTP/1.1" status: 204 len: 173 time: 2.5191469 May 12 15:18:29.795283 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-deleted', 'tag': '857536b0-998d-4731-a09f-f8fca9f18d3e'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:29.838071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-13228bfa-b2b8-4496-9fbd-d4e0153a1f91 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Deleting port 39390bec-fdd9-4910-a8d2-6718da722725 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:29.838410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-13228bfa-b2b8-4496-9fbd-d4e0153a1f91 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:29.939314 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ea8fc2c7-4335-4a33-ae10-0460ad2f6b30'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-deleted', 'tag': '857536b0-998d-4731-a09f-f8fca9f18d3e', 'status': 'completed', 'code': 200} May 12 15:18:30.033518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2df7ed20-5f29-4b01-be91-8b2d3fba52dc req-b5c9eebb-0dd8-4b07-a377-3293d1b9bd89 tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1932871 May 12 15:18:30.152454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Deleting port d3bf5047-6e8a-4d30-bf27-76571b79026a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:30.152821 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:30.213903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-528f375e-9fc8-4134-b6d0-cde4cf31f2da req-761956b2-769a-4229-a7c3-7f233345ba01 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:30.215585 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-528f375e-9fc8-4134-b6d0-cde4cf31f2da req-761956b2-769a-4229-a7c3-7f233345ba01 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 943 time: 0.1589720 May 12 15:18:30.326210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-528f375e-9fc8-4134-b6d0-cde4cf31f2da req-b6b6826a-1cce-42b3-bb92-1fd29afd2d5e tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups?id=5d05f580-8d94-4f7a-847b-79c969006d42&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0714738 May 12 15:18:30.358954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-13228bfa-b2b8-4496-9fbd-d4e0153a1f91 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] For port 39390bec-fdd9-4910-a8d2-6718da722725, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=39390bec-fdd9-4910-a8d2-6718da722725,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:30.359542 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-13228bfa-b2b8-4496-9fbd-d4e0153a1f91 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:30.432398 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:30.493592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6bc1aefc-4b55-42c5-90cb-a9601d36d06c {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:18:30.511149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-13228bfa-b2b8-4496-9fbd-d4e0153a1f91 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Calling delete_port for 39390bec-fdd9-4910-a8d2-6718da722725 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:30.581035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:30.667640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Transition to ACTIVE for port object 6bc1aefc-4b55-42c5-90cb-a9601d36d06c will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:18:30.676210 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:30.891878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3058980a-8735-4dc6-8bab-9231f0b74124 req-d0b6501b-7abb-41e3-8216-7da42d645caa tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:30.893363 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3058980a-8735-4dc6-8bab-9231f0b74124 req-d0b6501b-7abb-41e3-8216-7da42d645caa tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 931 time: 0.3394840 May 12 15:18:30.902000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a79af9dd-dc1f-48f1-8011-2e621c0247cf req-3d043ef8-f213-4ad9-aca8-9df75441f8e6 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:30.903563 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a79af9dd-dc1f-48f1-8011-2e621c0247cf req-3d043ef8-f213-4ad9-aca8-9df75441f8e6 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 943 time: 0.3963311 May 12 15:18:30.992141 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3058980a-8735-4dc6-8bab-9231f0b74124 req-0d904509-c66a-4626-ac9f-16c78449f413 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0866125 May 12 15:18:31.008452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a79af9dd-dc1f-48f1-8011-2e621c0247cf req-13740ced-d8e7-45aa-8d99-eb20b54952ef tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups?id=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0859153 May 12 15:18:31.031789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] For port d3bf5047-6e8a-4d30-bf27-76571b79026a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d3bf5047-6e8a-4d30-bf27-76571b79026a,segment=NetworkSegment(51a763ab-4327-4303-92e7-963b2e4c87d0),segment_id=51a763ab-4327-4303-92e7-963b2e4c87d0)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:31.032429 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:31.080708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Pushing event updated for resources: {'Port': ['ID=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:31.088855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Deleting port cd5e8e86-8bbd-4127-a29d-556bd372ff1c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:31.089200 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:31.208707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1fe5359-25a4-4e65-bfef-dc74f4973eff req-1a728d85-c03c-45df-a03b-0c5917d3a740 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.0556531 May 12 15:18:31.246477 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-13228bfa-b2b8-4496-9fbd-d4e0153a1f91 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:31.393004 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f8cd2797-7009-4b18-ac79-02bfb0576fb8 req-f2a8ceca-ef82-4e92-a262-6ae7d422b8eb tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0620217 May 12 15:18:31.393578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13228bfa-b2b8-4496-9fbd-d4e0153a1f91 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event deleted for resources: {'Port': ['ID=39390bec-fdd9-4910-a8d2-6718da722725,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:31.459861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:31.506831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Attempting to bind port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:18:31.507156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Attempting to bind port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:18:31.507660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Attempting to bind port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c on network c3c7ba99-d7de-4515-b784-ef9ce8b08726 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:18:31.564004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c on network c3c7ba99-d7de-4515-b784-ef9ce8b08726 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:18:31.564321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Attempting to bind port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c on network c3c7ba99-d7de-4515-b784-ef9ce8b08726 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:18:31.588402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-13228bfa-b2b8-4496-9fbd-d4e0153a1f91 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] No DVR routers for this DVR port 39390bec-fdd9-4910-a8d2-6718da722725 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:31.592229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 18, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:18:31.592555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Checking segment: {'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:18:31.592923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Bound using segment: {'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:18:31.593351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Bound port: 6bc1aefc-4b55-42c5-90cb-a9601d36d06c, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '75265c81-b0a3-4707-85cf-250efb72702a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:18:31.593709 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:31.604302 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-13228bfa-b2b8-4496-9fbd-d4e0153a1f91 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:31.642775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Calling delete_port for cd5e8e86-8bbd-4127-a29d-556bd372ff1c owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:31.663808 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-12b4683c-10b2-473a-ab0c-fc218bdf4225 req-13228bfa-b2b8-4496-9fbd-d4e0153a1f91 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.84 "DELETE /v2.0/ports/39390bec-fdd9-4910-a8d2-6718da722725 HTTP/1.1" status: 204 len: 173 time: 1.9331284 May 12 15:18:31.672808 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:31.673148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:31.673720 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Floating IP 1764867b-4de0-4394-b192-67b196123be1 disassociated. External IP: 172.25.8.53, port: d3bf5047-6e8a-4d30-bf27-76571b79026a. May 12 15:18:31.674286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Calling delete_port for d3bf5047-6e8a-4d30-bf27-76571b79026a owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:31.738267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31a2248e-8ed9-4a40-b285-816b2fc35d38 req-26f6160c-c603-495f-8deb-f1f69a0740df tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 210 time: 0.1596215 May 12 15:18:31.778570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] For port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:18:31.787703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] For port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:18:31.805257 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:31.918667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:31.919273 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:31.920930 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] 10.222.0.84 "PUT /v2.0/ports/6bc1aefc-4b55-42c5-90cb-a9601d36d06c HTTP/1.1" status: 200 len: 1091 time: 3.4888897 May 12 15:18:31.940362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-deleted', 'tag': '39390bec-fdd9-4910-a8d2-6718da722725'}, {'name': 'network-changed', 'server_uuid': '8617af39-06d3-45c2-bfd2-78bad9d75c03', 'tag': '6bc1aefc-4b55-42c5-90cb-a9601d36d06c'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:31.965805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b8c8478-bbce-4d70-813f-c379ed2b24e6 service neutron] Pushing event updated for resources: {'Port': ['ID=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:31.975205 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:32.102677 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ca3c92b4-c548-45bb-bf98-ab535d59299b'] response: {'server_uuid': '86573116-6413-4a6b-9619-662f524d2cc3', 'name': 'network-vif-deleted', 'tag': '39390bec-fdd9-4910-a8d2-6718da722725', 'status': 'completed', 'code': 200} May 12 15:18:32.102933 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ca3c92b4-c548-45bb-bf98-ab535d59299b'] response: {'name': 'network-changed', 'server_uuid': '8617af39-06d3-45c2-bfd2-78bad9d75c03', 'tag': '6bc1aefc-4b55-42c5-90cb-a9601d36d06c', 'status': 'completed', 'code': 200} May 12 15:18:32.110693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Pushing event deleted for resources: {'Port': ['ID=d3bf5047-6e8a-4d30-bf27-76571b79026a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:32.165605 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:32.348639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-d101e9ee-4ec0-4160-a030-93f3a8863bc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:32.352735 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-d101e9ee-4ec0-4160-a030-93f3a8863bc5 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=7d73e66034f94885ae45429129883002&device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 1094 time: 0.3114724 May 12 15:18:32.452814 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0e13b47-361a-45fc-bd0d-06399aac2ae8 req-8d0c026d-d3ff-4ebf-a575-eb17fe28dbff tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 210 time: 0.0896931 May 12 15:18:32.591267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb27790-c53d-4817-ad7c-4d6908c0ef54 req-492dd7c0-1eb8-40b8-b03d-ed06c1452259 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:32.598925 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2eb27790-c53d-4817-ad7c-4d6908c0ef54 req-492dd7c0-1eb8-40b8-b03d-ed06c1452259 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 943 time: 0.3183808 May 12 15:18:32.665230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2eb27790-c53d-4817-ad7c-4d6908c0ef54 req-b41f2ada-f06f-49d1-b47a-169f9ad112d1 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653403 May 12 15:18:32.735858 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-03927a16-8a8c-4d1e-91d7-b2dda9713339 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=6bc1aefc-4b55-42c5-90cb-a9601d36d06c HTTP/1.1" status: 200 len: 217 time: 0.3673086 May 12 15:18:32.738297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:18:32.781962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f142b25-2a72-489b-b2fe-8e895b23a551 req-8dedae80-1233-4618-8f44-74bb56401abb tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.0773695 May 12 15:18:32.897263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d536b3b-3c4b-44b7-b202-0ed52dc36385 req-5b7b048c-ed87-4656-a6d4-36684cd25f46 tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0627644 May 12 15:18:32.898618 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:32.963627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event deleted for resources: {'Port': ['ID=cd5e8e86-8bbd-4127-a29d-556bd372ff1c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:33.041297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:33.041776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:33.042172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:33.042890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:33.042890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:33.043284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:33.043523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:33.043845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:33.044194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:33.044512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:33.044826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:33.045307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:18:33.053629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-9333df70-e4a7-49ae-9850-da0246df8ac5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:33.055341 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-9333df70-e4a7-49ae-9850-da0246df8ac5 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=2c6ef05c-5190-47b2-bba9-0d2bdacd727d HTTP/1.1" status: 200 len: 845 time: 0.3084960 May 12 15:18:33.151512 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a2cabfc-3d3b-4026-b2cc-eb6b6e65c0dd req-ba11fd46-5dba-4a50-a2e3-29bdeba29979 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 210 time: 0.0661380 May 12 15:18:33.227067 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-129849bb-e81b-4f98-9467-6adb38a9fd10 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=c3c7ba99-d7de-4515-b784-ef9ce8b08726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0941567 May 12 15:18:33.337118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:18:33.347385 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8be7eb1a-ecc3-4651-9d3b-9a253c2270ec None None] Sync routers for ids ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:18:33.372973 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8be7eb1a-ecc3-4651-9d3b-9a253c2270ec None None] Routers {'1131f7ae-7566-4efd-ac8e-02ea4717a2aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:18:33.373922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8be7eb1a-ecc3-4651-9d3b-9a253c2270ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:18:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:33.434519 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:33.436245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] No DVR routers for this DVR port d3bf5047-6e8a-4d30-bf27-76571b79026a on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:33.440514 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:33.473765 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-511f1297-21f1-481d-a730-b27dc7fa480b req-2cf5e9c3-b279-4c58-b1c0-e5ff433efe19 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.76 "DELETE /v2.0/ports/d3bf5047-6e8a-4d30-bf27-76571b79026a HTTP/1.1" status: 204 len: 173 time: 6.4390614 May 12 15:18:33.499875 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-1d953efb-ac76-4b36-9ae1-8a93d6402693 service neutron] 10.222.0.84 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2498181 May 12 15:18:33.743520 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a18bc0e-33bd-4ad9-9dec-ca9126564076 req-af06b5ee-3e7d-4fb0-b63f-fc2370a384b2 service neutron] 10.222.0.84 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2356973 May 12 15:18:33.774896 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8be7eb1a-ecc3-4651-9d3b-9a253c2270ec None None] Set router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:18:34.031021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0a4f95f-5895-4ba6-aa14-5412744b8207 req-08691811-091b-4181-8653-b965e66181c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:34.037735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3abdc4d-6bd6-424b-acf2-1ed4c168612e req-b55c3524-ea81-41f3-961a-21570d9e51c7 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 210 time: 0.4214408 May 12 15:18:34.041255 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0a4f95f-5895-4ba6-aa14-5412744b8207 req-08691811-091b-4181-8653-b965e66181c3 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=7d73e66034f94885ae45429129883002&device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 1094 time: 0.1848752 May 12 15:18:34.105005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'name': 'network-vif-deleted', 'tag': 'd3bf5047-6e8a-4d30-bf27-76571b79026a'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:34.281185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8be7eb1a-ecc3-4651-9d3b-9a253c2270ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194'}], 'enable_snat': True}, 'gw_port_id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:16:20Z', 'revision_number': 4, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port': {'id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:79:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1085, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:15Z', 'updated_at': '2022-05-12T15:16:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '68f43459-2da5-4601-a6c1-9d5d57573727', 'name': '', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'mac_address': 'fa:16:3e:90:e0:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 1086, 'fixed_ips': [{'subnet_id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:19Z', 'updated_at': '2022-05-12T15:16:30Z', 'revision_number': 5, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'subnets': [{'id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:34.285772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8be7eb1a-ecc3-4651-9d3b-9a253c2270ec None None] Checking router: 1131f7ae-7566-4efd-ac8e-02ea4717a2aa for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:18:34.298829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8be7eb1a-ecc3-4651-9d3b-9a253c2270ec None None] Routers {'1131f7ae-7566-4efd-ac8e-02ea4717a2aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:18:34.299684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8be7eb1a-ecc3-4651-9d3b-9a253c2270ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:18:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:34.367318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0a4f95f-5895-4ba6-aa14-5412744b8207 req-11a5abe9-3772-4d86-943d-e377aa034a92 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:34.368993 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0a4f95f-5895-4ba6-aa14-5412744b8207 req-11a5abe9-3772-4d86-943d-e377aa034a92 service neutron] 10.222.0.84 "GET /v2.0/networks?id=c3c7ba99-d7de-4515-b784-ef9ce8b08726 HTTP/1.1" status: 200 len: 906 time: 0.3257091 May 12 15:18:34.451699 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0a4f95f-5895-4ba6-aa14-5412744b8207 req-2d89a320-c35c-4844-8774-22df14170420 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=6bc1aefc-4b55-42c5-90cb-a9601d36d06c HTTP/1.1" status: 200 len: 217 time: 0.0729730 May 12 15:18:34.575348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0a4f95f-5895-4ba6-aa14-5412744b8207 req-ef3c97d4-45fd-4486-bc0a-85e23297c9fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:34.578716 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0a4f95f-5895-4ba6-aa14-5412744b8207 req-ef3c97d4-45fd-4486-bc0a-85e23297c9fc service neutron] 10.222.0.84 "GET /v2.0/subnets?id=2c6ef05c-5190-47b2-bba9-0d2bdacd727d HTTP/1.1" status: 200 len: 845 time: 0.1169925 May 12 15:18:34.605809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-92af0050-12b0-43a8-a3aa-c504db19dfe5 req-53516ea1-7159-43b3-b10b-e1624795d4f6 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.2897727 May 12 15:18:34.619599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8be7eb1a-ecc3-4651-9d3b-9a253c2270ec None None] Set router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:18:34.638148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a35bf563-7556-4246-8e9f-ec7c7206f868 req-2b0c9927-600f-4d70-a7d5-d32ea9ef19f8 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:34.660701 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a35bf563-7556-4246-8e9f-ec7c7206f868 req-2b0c9927-600f-4d70-a7d5-d32ea9ef19f8 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 943 time: 0.7057250 May 12 15:18:34.699017 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0a4f95f-5895-4ba6-aa14-5412744b8207 req-83c4269b-9721-4163-8531-80a023bcf580 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=c3c7ba99-d7de-4515-b784-ef9ce8b08726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1118591 May 12 15:18:34.705546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Router c14edcf0-ff24-4200-8381-63260d7a0553 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:18:34.761235 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a35bf563-7556-4246-8e9f-ec7c7206f868 req-8d908b08-0e24-4e9a-83f4-3c7b3a644a5b tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0954731 May 12 15:18:34.929753 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0a4f95f-5895-4ba6-aa14-5412744b8207 req-4be3c307-eff5-456d-8d02-a4577709941d service neutron] 10.222.0.84 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2213295 May 12 15:18:34.931415 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5795d549-2d12-44a0-849b-38aae1c24b08'] response: {'server_uuid': 'fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9', 'name': 'network-vif-deleted', 'tag': 'd3bf5047-6e8a-4d30-bf27-76571b79026a', 'status': 'completed', 'code': 200} May 12 15:18:35.015305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8eac3202-2bf8-470d-bfd0-ac491bf44361 req-d76ce88a-94eb-420b-9ac1-ff8abb0a7941 tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1058187 May 12 15:18:35.106414 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0a4f95f-5895-4ba6-aa14-5412744b8207 req-d35d3135-0fe9-4d76-8dad-25345ee37ab0 service neutron] 10.222.0.84 "GET /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1700394 May 12 15:18:35.363780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dfed3a44-a6b8-4c80-90cb-5aecc1e8c9f4 req-1616ee64-4eda-4b21-a9d1-02d4f5239349 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/ports?device_id=86573116-6413-4a6b-9619-662f524d2cc3 HTTP/1.1" status: 200 len: 210 time: 0.1409094 May 12 15:18:35.408701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:18:35.415324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8be7eb1a-ecc3-4651-9d3b-9a253c2270ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194'}], 'enable_snat': True}, 'gw_port_id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:16:20Z', 'revision_number': 4, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port': {'id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:79:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1085, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:15Z', 'updated_at': '2022-05-12T15:16:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '68f43459-2da5-4601-a6c1-9d5d57573727', 'name': '', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'mac_address': 'fa:16:3e:90:e0:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 1086, 'fixed_ips': [{'subnet_id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:19Z', 'updated_at': '2022-05-12T15:16:30Z', 'revision_number': 5, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'subnets': [{'id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:35.424691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8be7eb1a-ecc3-4651-9d3b-9a253c2270ec None None] The sync data for ids ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'] in n-d-841483-1 is: [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194'}], 'enable_snat': True}, 'gw_port_id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:16:20Z', 'revision_number': 4, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port': {'id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:79:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1085, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:15Z', 'updated_at': '2022-05-12T15:16:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '68f43459-2da5-4601-a6c1-9d5d57573727', 'name': '', 'network_id': '944a3072-30fa-47bc-9620-9dfd43f531e1', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'mac_address': 'fa:16:3e:90:e0:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 1086, 'fixed_ips': [{'subnet_id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:19Z', 'updated_at': '2022-05-12T15:16:30Z', 'revision_number': 5, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'subnets': [{'id': '1972ca52-439b-4a99-be07-5a8a9346589c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:18:35.435179 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff1577bd-2b18-4087-9ad5-5947580040ee None None] Sync routers for ids ['c14edcf0-ff24-4200-8381-63260d7a0553'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:18:35.463340 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff1577bd-2b18-4087-9ad5-5947580040ee None None] Routers {'c14edcf0-ff24-4200-8381-63260d7a0553'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:18:35.467265 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ff1577bd-2b18-4087-9ad5-5947580040ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:18:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c14edcf0-ff24-4200-8381-63260d7a0553'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:35.471684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58880) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:35.471963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3df53eb9-f638-4ad8-bcb7-b7b9438f0d28 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "PUT /v2.0/routers/c14edcf0-ff24-4200-8381-63260d7a0553/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.0856535 May 12 15:18:35.593367 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b702928-7890-4ee2-ad95-07339786a720 req-8b1f402b-873d-4551-b9b0-045e608bc892 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa8a2aa3-d9f5-4cdb-874c-42c93e7ccbd9 HTTP/1.1" status: 200 len: 210 time: 0.0931814 May 12 15:18:35.731791 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ff1577bd-2b18-4087-9ad5-5947580040ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:35.750671 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff1577bd-2b18-4087-9ad5-5947580040ee None None] Routers {'c14edcf0-ff24-4200-8381-63260d7a0553'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:18:35.754719 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ff1577bd-2b18-4087-9ad5-5947580040ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:18:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c14edcf0-ff24-4200-8381-63260d7a0553'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:35.858086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63f4bc99-1fb0-4e6e-b67e-1ea2e4f193a5 None None] New status for floating IP 1764867b-4de0-4394-b192-67b196123be1: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:18:35.873763 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ff1577bd-2b18-4087-9ad5-5947580040ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:35.874395 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff1577bd-2b18-4087-9ad5-5947580040ee None None] The sync data for ids ['c14edcf0-ff24-4200-8381-63260d7a0553'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:18:35.909943 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5fde7b9f-05d6-4145-a878-646fed8d891c req-a609349c-34c7-4bb3-b909-6c5556457044 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.0639026 May 12 15:18:36.014102 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:36.030105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aeb3b78-d664-4fc1-8ec1-49706a70ae30 req-4c4044b7-f6ca-448c-8cdf-dd7de28a7ec5 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:36.039204 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4aeb3b78-d664-4fc1-8ec1-49706a70ae30 req-4c4044b7-f6ca-448c-8cdf-dd7de28a7ec5 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 943 time: 0.1093102 May 12 15:18:36.102261 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4aeb3b78-d664-4fc1-8ec1-49706a70ae30 req-246e9b33-ef01-445f-8d6c-1e0551f2b638 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580349 May 12 15:18:36.257853 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:36.274140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Deleting port 2d3f421a-3c65-42c5-bcb6-9b82cd6a4785 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:36.274635 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:36.423280 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8282093-2496-4351-aae4-bc0fcff53ab1 req-84776d3d-90a7-432c-b5cb-e8d9912f8d47 tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0451233 May 12 15:18:36.532743 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:36.571914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58908) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:36.649094 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2ea0d4c-bd4a-4eca-9743-878cba5c510c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:36.680521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Calling delete_port for 2d3f421a-3c65-42c5-bcb6-9b82cd6a4785 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:36.684229 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2ea0d4c-bd4a-4eca-9743-878cba5c510c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:36.762785 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2ea0d4c-bd4a-4eca-9743-878cba5c510c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:36.802142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2ea0d4c-bd4a-4eca-9743-878cba5c510c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d05f580-8d94-4f7a-847b-79c969006d42,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:36.807680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58918) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:36.840207 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2ea0d4c-bd4a-4eca-9743-878cba5c510c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:36.841325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b2ea0d4c-bd4a-4eca-9743-878cba5c510c tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "DELETE /v2.0/security-groups/5d05f580-8d94-4f7a-847b-79c969006d42 HTTP/1.1" status: 204 len: 168 time: 0.2681570 May 12 15:18:36.845240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58922) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:36.869361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58926) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:36.882371 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-6f6c5a4f-8014-45e2-b6f3-6eae46f572bc tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] show failed (client error): The resource could not be found. May 12 15:18:36.883388 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6f6c5a4f-8014-45e2-b6f3-6eae46f572bc tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "GET /v2.0/security-groups/5d05f580-8d94-4f7a-847b-79c969006d42 HTTP/1.1" status: 404 len: 347 time: 0.0371637 May 12 15:18:36.886397 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58932) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:37.096285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-84272c6e-25b8-4c34-8ddf-8ccea2f22f83 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Deleting port f870e17a-1996-41a8-bb25-d9cef52647e3 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:37.096617 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84272c6e-25b8-4c34-8ddf-8ccea2f22f83 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:37.146177 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:37.185101 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 6bc1aefc-4b55-42c5-90cb-a9601d36d06c details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:18:37.293240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event deleted for resources: {'Port': ['ID=2d3f421a-3c65-42c5-bcb6-9b82cd6a4785,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:37.382759 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d17765fa-b681-4ecd-ae2f-f7561c835847 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:37.384553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-da5eb393-ac25-4dff-81b6-bd2e8e7b9bb8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:37.395847 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84272c6e-25b8-4c34-8ddf-8ccea2f22f83 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:37.396307 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84272c6e-25b8-4c34-8ddf-8ccea2f22f83 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:37.466228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e6f01a1-10fb-4a8b-ba55-7687d5838378 req-9f189a88-96f8-414b-b1b2-97f3c1bec9b1 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.3734779 May 12 15:18:37.500821 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:37.513648 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:37.517764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '6bc1aefc-4b55-42c5-90cb-a9601d36d06c', 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726', 'port_id': '6bc1aefc-4b55-42c5-90cb-a9601d36d06c', 'mac_address': 'fa:16:3e:8a:bc:d4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 587, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2c6ef05c-5190-47b2-bba9-0d2bdacd727d', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:18:37.642225 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:37.657720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-84272c6e-25b8-4c34-8ddf-8ccea2f22f83 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Calling delete_port for f870e17a-1996-41a8-bb25-d9cef52647e3 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:37.661275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6bc1aefc-4b55-42c5-90cb-a9601d36d06c {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:18:37.680964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:37.695614 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:37.757840 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:37.760326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-da5eb393-ac25-4dff-81b6-bd2e8e7b9bb8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:37.761698 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:37.788889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:37.793163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:37.793729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Fanout notify agent at l3_agent the message router_deleted on router c14edcf0-ff24-4200-8381-63260d7a0553 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:18:37.815261 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:37.819147 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9bb104f9-5f5a-4eb6-bfad-b591af238efa tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "DELETE /v2.0/routers/c14edcf0-ff24-4200-8381-63260d7a0553 HTTP/1.1" status: 204 len: 168 time: 2.3434029 May 12 15:18:37.822012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58942) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:37.951037 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d17765fa-b681-4ecd-ae2f-f7561c835847 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:37.965551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-da5eb393-ac25-4dff-81b6-bd2e8e7b9bb8 admin admin] Usage tracker for resource:security_group_rule and tenant:d40e23c2bff449759f48ebfccd345164 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:37.976195 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2dfbeb1-0f10-4cf6-bec6-df8fffa5f129 req-f5ad80d8-4339-4ddb-8f81-79856f2eb251 tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.2530034 May 12 15:18:37.981254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-da5eb393-ac25-4dff-81b6-bd2e8e7b9bb8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:38.003464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-da5eb393-ac25-4dff-81b6-bd2e8e7b9bb8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:38.064256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['6bc1aefc-4b55-42c5-90cb-a9601d36d06c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:18:38.132389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39ffee76-4542-4e8a-84db-fcaad59e6d0f req-c0165f26-d6e5-4ed8-82e7-3f6bf900db94 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:38.135471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-6ddf77df-9171-4417-99b9-731e230d034e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Deleting subnet 87cb2896-86a6-4766-afcf-56a287c0970b {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:18:38.139809 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ddf77df-9171-4417-99b9-731e230d034e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.142005 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39ffee76-4542-4e8a-84db-fcaad59e6d0f req-c0165f26-d6e5-4ed8-82e7-3f6bf900db94 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 943 time: 0.8206449 May 12 15:18:38.176913 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d17765fa-b681-4ecd-ae2f-f7561c835847 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.203714 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ddf77df-9171-4417-99b9-731e230d034e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.215868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d17765fa-b681-4ecd-ae2f-f7561c835847 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=68ef6c87-3499-4eee-a9ec-ab87d41c4f8b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:38.288163 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39ffee76-4542-4e8a-84db-fcaad59e6d0f req-94a56453-28a6-4650-a2b7-37830b4b88bd tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1443770 May 12 15:18:38.300826 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84272c6e-25b8-4c34-8ddf-8ccea2f22f83 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.370604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ddf77df-9171-4417-99b9-731e230d034e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.375717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84272c6e-25b8-4c34-8ddf-8ccea2f22f83 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event deleted for resources: {'Port': ['ID=f870e17a-1996-41a8-bb25-d9cef52647e3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:38.472534 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ddf77df-9171-4417-99b9-731e230d034e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.484439 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d17765fa-b681-4ecd-ae2f-f7561c835847 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.485565 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d17765fa-b681-4ecd-ae2f-f7561c835847 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "DELETE /v2.0/security-groups/68ef6c87-3499-4eee-a9ec-ab87d41c4f8b HTTP/1.1" status: 204 len: 168 time: 1.6769376 May 12 15:18:38.493801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58946) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:38.521049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ddf77df-9171-4417-99b9-731e230d034e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event deleted for resources: {'Subnet': ['ID=87cb2896-86a6-4766-afcf-56a287c0970b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:38.528352 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ddf77df-9171-4417-99b9-731e230d034e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.529909 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe429f73-6f6e-4974-bc2a-df0b32937e2a None None] Network 70c3b272-514b-4f1f-8862-a798ee0e6c77 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:18:38.530553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-da5eb393-ac25-4dff-81b6-bd2e8e7b9bb8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.533660 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-36ec4bc4-7eb9-4b5d-86da-2b58d26e922c tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] show failed (client error): The resource could not be found. May 12 15:18:38.538665 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-36ec4bc4-7eb9-4b5d-86da-2b58d26e922c tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "GET /v2.0/security-groups/68ef6c87-3499-4eee-a9ec-ab87d41c4f8b HTTP/1.1" status: 404 len: 347 time: 0.0381927 May 12 15:18:38.538849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58952) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:38.542875 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6ddf77df-9171-4417-99b9-731e230d034e tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "DELETE /v2.0/subnets/87cb2896-86a6-4766-afcf-56a287c0970b HTTP/1.1" status: 204 len: 168 time: 0.7187934 May 12 15:18:38.544742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58956) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:38.609257 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84272c6e-25b8-4c34-8ddf-8ccea2f22f83 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.612970 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84272c6e-25b8-4c34-8ddf-8ccea2f22f83 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.617483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-84272c6e-25b8-4c34-8ddf-8ccea2f22f83 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "DELETE /v2.0/floatingips/b8015aab-2a22-4ed4-8692-3f7185b4feae HTTP/1.1" status: 204 len: 168 time: 1.7268543 May 12 15:18:38.617483 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-da5eb393-ac25-4dff-81b6-bd2e8e7b9bb8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.624860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58960) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:38.719663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-11cf3fca-9ff4-42b9-a677-7de4fda16310 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Deleting port be802a6d-cca9-42fd-bdc5-6c9f78035217 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:38.720090 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11cf3fca-9ff4-42b9-a677-7de4fda16310 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.791280 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.807541 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83253fa8-c262-404b-89a5-a5bbfaf948ae req-64e2b7ec-122a-4c0f-9d66-ed5a965c57c3 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.2015338 May 12 15:18:38.823826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a56e71ba-9265-4102-8520-17f8a5e57a8f None None] DHCP port deletion for 70c3b272-514b-4f1f-8862-a798ee0e6c77 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:18:38.826074 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-da5eb393-ac25-4dff-81b6-bd2e8e7b9bb8 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d40e23c2bff449759f48ebfccd345164&name=default HTTP/1.1" status: 200 len: 2983 time: 1.9557416 May 12 15:18:38.827014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58964) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:38.828088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-b8641094-9120-40bc-b0f3-01a4c54bea39 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Deleting port 44699307-5ea5-44b0-ad14-e5bde41eec9a {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:38.828428 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b8641094-9120-40bc-b0f3-01a4c54bea39 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.833769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a56e71ba-9265-4102-8520-17f8a5e57a8f None None] Deleting port 5921f20a-9cd4-4e8b-9a44-c099e7291457 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:38.834896 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a56e71ba-9265-4102-8520-17f8a5e57a8f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.848403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Deleting port 5921f20a-9cd4-4e8b-9a44-c099e7291457 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:38.848873 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:38.853687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da5eb393-ac25-4dff-81b6-bd2e8e7b9bb8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f82290b-0837-4390-a8b3-f573468a119f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:39.027591 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a2337b86-fe48-4d79-9250-d74e48312be5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:39.051555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a56e71ba-9265-4102-8520-17f8a5e57a8f None None] For port 5921f20a-9cd4-4e8b-9a44-c099e7291457, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5921f20a-9cd4-4e8b-9a44-c099e7291457,segment=NetworkSegment(552e469d-e661-4820-8f94-8f488d9d7b95),segment_id=552e469d-e661-4820-8f94-8f488d9d7b95)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:39.052279 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a56e71ba-9265-4102-8520-17f8a5e57a8f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:39.079692 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a2337b86-fe48-4d79-9250-d74e48312be5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:39.095610 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b8641094-9120-40bc-b0f3-01a4c54bea39 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:39.095932 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b8641094-9120-40bc-b0f3-01a4c54bea39 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:39.213761 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11cf3fca-9ff4-42b9-a677-7de4fda16310 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:39.231003 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a56e71ba-9265-4102-8520-17f8a5e57a8f None None] Calling delete_port for 5921f20a-9cd4-4e8b-9a44-c099e7291457 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:39.288980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-b8641094-9120-40bc-b0f3-01a4c54bea39 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Calling delete_port for 44699307-5ea5-44b0-ad14-e5bde41eec9a owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:39.314820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] For port 5921f20a-9cd4-4e8b-9a44-c099e7291457, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5921f20a-9cd4-4e8b-9a44-c099e7291457,segment=NetworkSegment(552e469d-e661-4820-8f94-8f488d9d7b95),segment_id=552e469d-e661-4820-8f94-8f488d9d7b95)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:39.315944 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:39.323337 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a56e71ba-9265-4102-8520-17f8a5e57a8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:39.371841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a56e71ba-9265-4102-8520-17f8a5e57a8f None None] Pushing event deleted for resources: {'Port': ['ID=5921f20a-9cd4-4e8b-9a44-c099e7291457,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:39.388675 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a56e71ba-9265-4102-8520-17f8a5e57a8f None None] No DVR routers for this DVR port 5921f20a-9cd4-4e8b-9a44-c099e7291457 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:39.415700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e173bc24-3715-477c-a39e-a5a3f5166882 req-775f6cc0-2e39-49b0-a5a1-c31492a8000a tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0619445 May 12 15:18:39.422329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-11cf3fca-9ff4-42b9-a677-7de4fda16310 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Calling delete_port for be802a6d-cca9-42fd-bdc5-6c9f78035217 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:39.536047 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a2337b86-fe48-4d79-9250-d74e48312be5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:39.558788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2337b86-fe48-4d79-9250-d74e48312be5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f82290b-0837-4390-a8b3-f573468a119f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:39.569509 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a2337b86-fe48-4d79-9250-d74e48312be5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:39.573129 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a2337b86-fe48-4d79-9250-d74e48312be5 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4f82290b-0837-4390-a8b3-f573468a119f HTTP/1.1" status: 204 len: 168 time: 0.7141614 May 12 15:18:39.621821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Calling delete_port for 5921f20a-9cd4-4e8b-9a44-c099e7291457 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:39.626434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cda6d035-a7b2-4bae-8338-7e23ab4b63ad req-52a7fad7-d677-4afb-93b6-778558e40d83 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:39.627885 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cda6d035-a7b2-4bae-8338-7e23ab4b63ad req-52a7fad7-d677-4afb-93b6-778558e40d83 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 944 time: 0.2045846 May 12 15:18:39.673824 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b8641094-9120-40bc-b0f3-01a4c54bea39 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:39.726633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8641094-9120-40bc-b0f3-01a4c54bea39 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Pushing event deleted for resources: {'Port': ['ID=44699307-5ea5-44b0-ad14-e5bde41eec9a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:39.738018 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cda6d035-a7b2-4bae-8338-7e23ab4b63ad req-5fa815e4-0538-44da-8630-72a6ac27bbd3 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0990250 May 12 15:18:39.779704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:18:39.780015 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:18:39.800206 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11cf3fca-9ff4-42b9-a677-7de4fda16310 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:39.847745 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b8641094-9120-40bc-b0f3-01a4c54bea39 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:39.852480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11cf3fca-9ff4-42b9-a677-7de4fda16310 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event deleted for resources: {'Port': ['ID=be802a6d-cca9-42fd-bdc5-6c9f78035217,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:39.875547 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b8641094-9120-40bc-b0f3-01a4c54bea39 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:39.878006 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b8641094-9120-40bc-b0f3-01a4c54bea39 tempest-ServersTestBootFromVolume-391628837 tempest-ServersTestBootFromVolume-391628837-project] 10.222.0.82 "DELETE /v2.0/floatingips/1764867b-4de0-4394-b192-67b196123be1 HTTP/1.1" status: 204 len: 168 time: 1.3381994 May 12 15:18:39.881718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58978) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:39.967627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58982) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:40.078551 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11cf3fca-9ff4-42b9-a677-7de4fda16310 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:40.090867 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-11cf3fca-9ff4-42b9-a677-7de4fda16310 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "DELETE /v2.0/ports/be802a6d-cca9-42fd-bdc5-6c9f78035217 HTTP/1.1" status: 204 len: 168 time: 1.4652178 May 12 15:18:40.093405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58986) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:40.153600 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-38806a29-cd25-46c3-ac65-302a5d6345f5 req-9b771330-d955-4769-bd12-32ce50ca72d1 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.1872175 May 12 15:18:40.156120 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28cd9233-d9f5-49b5-84ce-4f98dc579383 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:40.159695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3c74a96c-2777-4405-91ab-fc05aa84f47a tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Deleting port d96ca9ce-4a19-49f0-bef3-e0e31ace478a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:40.160041 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c74a96c-2777-4405-91ab-fc05aa84f47a tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:40.223956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-28cd9233-d9f5-49b5-84ce-4f98dc579383 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:40.243565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-28cd9233-d9f5-49b5-84ce-4f98dc579383 admin admin] Usage tracker for resource:security_group_rule and tenant:ecbaae4c1d0543bc8fe39f06f1d36625 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:40.249243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-28cd9233-d9f5-49b5-84ce-4f98dc579383 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:40.258431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-28cd9233-d9f5-49b5-84ce-4f98dc579383 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:40.283412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Deleting port 5921f20a-9cd4-4e8b-9a44-c099e7291457 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:40.283948 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:40.448866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] The port '5921f20a-9cd4-4e8b-9a44-c099e7291457' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:18:40.563759 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28cd9233-d9f5-49b5-84ce-4f98dc579383 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:40.573328 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28cd9233-d9f5-49b5-84ce-4f98dc579383 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:40.619316 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:40.632115 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c74a96c-2777-4405-91ab-fc05aa84f47a tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:40.712985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28cd9233-d9f5-49b5-84ce-4f98dc579383 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb93ba29-3c38-4012-a383-089a74b3249c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:40.719642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-28cd9233-d9f5-49b5-84ce-4f98dc579383 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ecbaae4c1d0543bc8fe39f06f1d36625&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7487860 May 12 15:18:40.723783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58992) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:40.727570 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-648357b7-a5a5-4ae2-beb9-9d973a0760eb req-81eff74c-a666-4dd9-9fcf-d035ccc6a66d tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0679839 May 12 15:18:40.767854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['70c3b272-514b-4f1f-8862-a798ee0e6c77']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:40.781826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3c74a96c-2777-4405-91ab-fc05aa84f47a tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Calling delete_port for d96ca9ce-4a19-49f0-bef3-e0e31ace478a owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:40.799381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5921f20a-9cd4-4e8b-9a44-c099e7291457 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:40.831584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '552e469d-e661-4820-8f94-8f488d9d7b95') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:40.831799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '552e469d-e661-4820-8f94-8f488d9d7b95') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:40.850547 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:40.871449 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84ebcb18-8d4a-4d99-8e73-f5af8637f5ab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:40.874908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 5921f20a-9cd4-4e8b-9a44-c099e7291457 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:18:40.875793 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:40.877984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5921f20a-9cd4-4e8b-9a44-c099e7291457 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:18:40.893781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Releasing vlan 578 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:18:40.894190 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: timer() May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:18:40.909577 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:18:40.965784 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84ebcb18-8d4a-4d99-8e73-f5af8637f5ab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.038955 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.044390 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4812fd51-6f1c-4f67-9c40-5a31cc964187 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.061004 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.077184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event deleted for resources: {'Network': ['ID=70c3b272-514b-4f1f-8862-a798ee0e6c77,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:41.083097 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1038b2fc-36ba-428a-9bd5-1bd0eebaf338 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "DELETE /v2.0/networks/70c3b272-514b-4f1f-8862-a798ee0e6c77 HTTP/1.1" status: 204 len: 168 time: 2.5370665 May 12 15:18:41.086836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58998) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:41.089228 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c74a96c-2777-4405-91ab-fc05aa84f47a tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.127780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d3641c9-87eb-4fe0-a586-eab7a5e8e57f req-97abed87-ed7d-4743-b139-5064268a204b tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:41.129133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0d3641c9-87eb-4fe0-a586-eab7a5e8e57f req-97abed87-ed7d-4743-b139-5064268a204b tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 944 time: 0.2297633 May 12 15:18:41.133971 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84ebcb18-8d4a-4d99-8e73-f5af8637f5ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.172897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84ebcb18-8d4a-4d99-8e73-f5af8637f5ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb93ba29-3c38-4012-a383-089a74b3249c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:41.233360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 6bc1aefc-4b55-42c5-90cb-a9601d36d06c up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:18:41.257864 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84ebcb18-8d4a-4d99-8e73-f5af8637f5ab admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.258999 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-84ebcb18-8d4a-4d99-8e73-f5af8637f5ab admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/eb93ba29-3c38-4012-a383-089a74b3249c HTTP/1.1" status: 204 len: 168 time: 0.5341461 May 12 15:18:41.281875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c74a96c-2777-4405-91ab-fc05aa84f47a tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event deleted for resources: {'Port': ['ID=d96ca9ce-4a19-49f0-bef3-e0e31ace478a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:41.290666 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0d3641c9-87eb-4fe0-a586-eab7a5e8e57f req-3f193566-cf3e-4ea6-90c2-3adeb6ea8c38 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1390626 May 12 15:18:41.407978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-0af31945-f35d-4f30-8934-701ee3acae64 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Deleting port 9b7a270d-8e2a-49f4-806c-f96e834fe5d2 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:41.408524 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0af31945-f35d-4f30-8934-701ee3acae64 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.431714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:18:41.438175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:18:41.438848 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.487103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73538c64-df3a-4466-a4c4-75d77fa0bf17 req-c1b9fad1-11f6-476a-9670-4aa4a16ecc50 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.0880980 May 12 15:18:41.597289 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.603913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-4812fd51-6f1c-4f67-9c40-5a31cc964187 admin admin] Deleting port 68f43459-2da5-4601-a6c1-9d5d57573727 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:41.604477 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4812fd51-6f1c-4f67-9c40-5a31cc964187 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.632759 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8617af39-06d3-45c2-bfd2-78bad9d75c03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6bc1aefc-4b55-42c5-90cb-a9601d36d06c'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:41.664123 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:41.679136 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.728367 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c74a96c-2777-4405-91ab-fc05aa84f47a tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.730562 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3c74a96c-2777-4405-91ab-fc05aa84f47a tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "DELETE /v2.0/ports/d96ca9ce-4a19-49f0-bef3-e0e31ace478a HTTP/1.1" status: 204 len: 168 time: 1.6362450 May 12 15:18:41.735810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59010) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:41.769992 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ac8eccde-10d3-4f9d-9251-0feb64114950'] response: {'server_uuid': '8617af39-06d3-45c2-bfd2-78bad9d75c03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6bc1aefc-4b55-42c5-90cb-a9601d36d06c', 'code': 200} May 12 15:18:41.771260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:41.857108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59014) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:41.881682 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-602da43f-3e04-4d92-9621-134d2db99562 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.939316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-f58ae60f-fa52-4157-9a93-e4ed5c17ee5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Deleting subnet a98bb094-ea48-4784-b33c-d20b0aad5132 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:18:41.944266 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0af31945-f35d-4f30-8934-701ee3acae64 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.944638 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0af31945-f35d-4f30-8934-701ee3acae64 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:41.958020 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f58ae60f-fa52-4157-9a93-e4ed5c17ee5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.022696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-602da43f-3e04-4d92-9621-134d2db99562 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:42.058334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-602da43f-3e04-4d92-9621-134d2db99562 admin admin] Usage tracker for resource:security_group_rule and tenant:841721ac35bd405f91c842e554bc47bd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:42.071047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-602da43f-3e04-4d92-9621-134d2db99562 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:42.077355 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fe806cba-d43e-4ee6-b11a-f739c9600a5a req-d1bae34d-23e8-4af5-bf9f-8132056616ac tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0566154 May 12 15:18:42.092470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-602da43f-3e04-4d92-9621-134d2db99562 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:42.103815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-4812fd51-6f1c-4f67-9c40-5a31cc964187 admin admin] For port 68f43459-2da5-4601-a6c1-9d5d57573727, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=68f43459-2da5-4601-a6c1-9d5d57573727,segment=NetworkSegment(51a763ab-4327-4303-92e7-963b2e4c87d0),segment_id=51a763ab-4327-4303-92e7-963b2e4c87d0)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:42.104164 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4812fd51-6f1c-4f67-9c40-5a31cc964187 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.118476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-0af31945-f35d-4f30-8934-701ee3acae64 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Calling delete_port for 9b7a270d-8e2a-49f4-806c-f96e834fe5d2 owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:42.176084 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f58ae60f-fa52-4157-9a93-e4ed5c17ee5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.235022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-659e67d2-5bd5-4721-b920-9ca20c6d30fd req-0a569bb3-e678-4664-b7f7-1556478b1e7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:42.236491 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-659e67d2-5bd5-4721-b920-9ca20c6d30fd req-0a569bb3-e678-4664-b7f7-1556478b1e7c service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 1096 time: 0.4065189 May 12 15:18:42.244814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-4812fd51-6f1c-4f67-9c40-5a31cc964187 admin admin] Calling delete_port for 68f43459-2da5-4601-a6c1-9d5d57573727 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:42.356003 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-659e67d2-5bd5-4721-b920-9ca20c6d30fd req-b3ec3501-737c-44ae-aa90-f5c96b4b30e2 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1114595 May 12 15:18:42.371052 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f58ae60f-fa52-4157-9a93-e4ed5c17ee5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.393427 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-602da43f-3e04-4d92-9621-134d2db99562 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.399070 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-602da43f-3e04-4d92-9621-134d2db99562 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.432644 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0af31945-f35d-4f30-8934-701ee3acae64 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.485926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0af31945-f35d-4f30-8934-701ee3acae64 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Pushing event deleted for resources: {'Port': ['ID=9b7a270d-8e2a-49f4-806c-f96e834fe5d2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:42.510279 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-602da43f-3e04-4d92-9621-134d2db99562 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=841721ac35bd405f91c842e554bc47bd&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6521070 May 12 15:18:42.516071 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-602da43f-3e04-4d92-9621-134d2db99562 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=520e01b0-7314-4626-a999-66c73f7eabf8,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:42.521293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59024) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:42.564394 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f58ae60f-fa52-4157-9a93-e4ed5c17ee5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.619044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f58ae60f-fa52-4157-9a93-e4ed5c17ee5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event deleted for resources: {'Subnet': ['ID=a98bb094-ea48-4784-b33c-d20b0aad5132,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:42.626165 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f58ae60f-fa52-4157-9a93-e4ed5c17ee5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.637805 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f58ae60f-fa52-4157-9a93-e4ed5c17ee5d tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "DELETE /v2.0/subnets/a98bb094-ea48-4784-b33c-d20b0aad5132 HTTP/1.1" status: 204 len: 168 time: 0.9009516 May 12 15:18:42.640769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59030) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:42.648035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d818584-4856-47d2-8ccd-403fcfa19b1f None None] Network 187794df-e6cb-4ee3-8b40-6b546c229bd2 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:18:42.688407 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0af31945-f35d-4f30-8934-701ee3acae64 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.690546 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0af31945-f35d-4f30-8934-701ee3acae64 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.691711 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0af31945-f35d-4f30-8934-701ee3acae64 tempest-FloatingIPAdminTestJSON-1660923656 tempest-FloatingIPAdminTestJSON-1660923656-project] 10.222.0.82 "DELETE /v2.0/floatingips/105b9a9f-588c-4526-9773-99dbf71cd484 HTTP/1.1" status: 204 len: 168 time: 1.6037784 May 12 15:18:42.720464 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dbd18e28-3828-477a-a301-6e0803ec7de5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.727640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-5519b90b-e13b-4b85-b326-9a33f7342b85 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Deleting subnet 34e89d1d-72aa-4216-94d6-f37b8a0c162b {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:18:42.727924 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21b46930-bede-49d9-9448-7fddf3c64863 req-4a980092-e349-4e34-b144-d35176de7264 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.0980656 May 12 15:18:42.731366 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5519b90b-e13b-4b85-b326-9a33f7342b85 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.745531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0305f64-58b3-48b7-954a-f59446ff4e0b req-007d9b23-7955-4669-8150-a1d5e3d0964a tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:42.752439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0305f64-58b3-48b7-954a-f59446ff4e0b req-007d9b23-7955-4669-8150-a1d5e3d0964a tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 945 time: 0.3432083 May 12 15:18:42.766547 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4812fd51-6f1c-4f67-9c40-5a31cc964187 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.808781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5519b90b-e13b-4b85-b326-9a33f7342b85 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.839690 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4edcfd8a-06d9-4898-837a-191611418bd8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.845117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4812fd51-6f1c-4f67-9c40-5a31cc964187 admin admin] Pushing event deleted for resources: {'Port': ['ID=68f43459-2da5-4601-a6c1-9d5d57573727,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:42.889021 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:42.938670 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0305f64-58b3-48b7-954a-f59446ff4e0b req-f4513c4a-6794-40de-bb90-75930c020429 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1851707 May 12 15:18:42.964957 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5519b90b-e13b-4b85-b326-9a33f7342b85 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:43.020889 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4edcfd8a-06d9-4898-837a-191611418bd8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:43.048151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-475e1f1a-1a36-4b2c-ad4a-d54bb5daf721 None None] DHCP port deletion for 187794df-e6cb-4ee3-8b40-6b546c229bd2 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:18:43.054167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-475e1f1a-1a36-4b2c-ad4a-d54bb5daf721 None None] Deleting port 80316dbd-bbfa-49eb-a448-99afe53e8a57 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:43.054675 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-475e1f1a-1a36-4b2c-ad4a-d54bb5daf721 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:43.102101 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5519b90b-e13b-4b85-b326-9a33f7342b85 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:43.129020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59038) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:43.152547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5519b90b-e13b-4b85-b326-9a33f7342b85 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event deleted for resources: {'Subnet': ['ID=34e89d1d-72aa-4216-94d6-f37b8a0c162b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:43.155256 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5519b90b-e13b-4b85-b326-9a33f7342b85 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:43.186897 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5519b90b-e13b-4b85-b326-9a33f7342b85 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "DELETE /v2.0/subnets/34e89d1d-72aa-4216-94d6-f37b8a0c162b HTTP/1.1" status: 204 len: 168 time: 0.5449393 May 12 15:18:43.196018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59046) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:43.289254 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4812fd51-6f1c-4f67-9c40-5a31cc964187 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:43.295170 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18ca2089-1c5f-42fb-b456-c9d423dd66e3 None None] Network 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:18:43.400362 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:43.408478 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24d9a0ff-d6c0-4b61-97be-74d77ae3ea62 req-597b4d1b-d609-465f-b936-5e4a7dd7c0ed tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0974004 May 12 15:18:43.413319 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4edcfd8a-06d9-4898-837a-191611418bd8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:43.420204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Deleting port 80316dbd-bbfa-49eb-a448-99afe53e8a57 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:43.420550 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:43.559295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-475e1f1a-1a36-4b2c-ad4a-d54bb5daf721 None None] For port 80316dbd-bbfa-49eb-a448-99afe53e8a57, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=80316dbd-bbfa-49eb-a448-99afe53e8a57,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:43.559629 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-475e1f1a-1a36-4b2c-ad4a-d54bb5daf721 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:43.601166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4edcfd8a-06d9-4898-837a-191611418bd8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=520e01b0-7314-4626-a999-66c73f7eabf8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:43.621334 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4edcfd8a-06d9-4898-837a-191611418bd8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:43.625292 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4edcfd8a-06d9-4898-837a-191611418bd8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/520e01b0-7314-4626-a999-66c73f7eabf8 HTTP/1.1" status: 204 len: 168 time: 1.1028137 May 12 15:18:43.693192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c89b1789-fbd9-4ccf-a9dc-97639a9725a2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=95dd8f9e0e0f4857960aab14d84dc751&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5588326 May 12 15:18:43.695129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59052) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:43.739831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-475e1f1a-1a36-4b2c-ad4a-d54bb5daf721 None None] Calling delete_port for 80316dbd-bbfa-49eb-a448-99afe53e8a57 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:43.840579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] For port 80316dbd-bbfa-49eb-a448-99afe53e8a57, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=80316dbd-bbfa-49eb-a448-99afe53e8a57,segment=NetworkSegment(4d535119-7517-4056-aef4-603b1fd140c2),segment_id=4d535119-7517-4056-aef4-603b1fd140c2)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:43.841204 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:43.935045 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-475e1f1a-1a36-4b2c-ad4a-d54bb5daf721 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:43.987723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07cca62d-4740-4340-828b-6bdd5b273ebf None None] DHCP port deletion for 86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:18:44.012185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-475e1f1a-1a36-4b2c-ad4a-d54bb5daf721 None None] No DVR routers for this DVR port 80316dbd-bbfa-49eb-a448-99afe53e8a57 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:44.014935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-475e1f1a-1a36-4b2c-ad4a-d54bb5daf721 None None] Pushing event deleted for resources: {'Port': ['ID=80316dbd-bbfa-49eb-a448-99afe53e8a57,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:44.028046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-07cca62d-4740-4340-828b-6bdd5b273ebf None None] Deleting port 8092a31e-f22d-4b85-9a51-6929599fcf39 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:44.028535 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-07cca62d-4740-4340-828b-6bdd5b273ebf None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:44.072871 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e4efc7d-95de-4b2f-b743-c7feaabd4336 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:44.080054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Calling delete_port for 80316dbd-bbfa-49eb-a448-99afe53e8a57 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:44.110799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7bc7de4c-b7a9-409d-9e26-c4fdb3d8ece7 req-6a8f3d5a-e520-4cb3-a848-ed8d86e9ca36 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.0853193 May 12 15:18:44.132509 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e4efc7d-95de-4b2f-b743-c7feaabd4336 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:44.198960 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:18:44.199509 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:18:44.362995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4812fd51-6f1c-4f67-9c40-5a31cc964187 admin admin] Router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:18:44.374168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-07cca62d-4740-4340-828b-6bdd5b273ebf None None] For port 8092a31e-f22d-4b85-9a51-6929599fcf39, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=8092a31e-f22d-4b85-9a51-6929599fcf39,segment=NetworkSegment(b6fbbd36-13c3-4b1d-bb92-589caea03666),segment_id=b6fbbd36-13c3-4b1d-bb92-589caea03666)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:44.375430 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-07cca62d-4740-4340-828b-6bdd5b273ebf None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:44.382623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1673d267-a285-4ff7-8c41-5cfe88c97f29 req-9341255b-c993-4745-9615-bd8e09342b52 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:44.384209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1673d267-a285-4ff7-8c41-5cfe88c97f29 req-9341255b-c993-4745-9615-bd8e09342b52 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 945 time: 0.2442648 May 12 15:18:44.454119 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e4efc7d-95de-4b2f-b743-c7feaabd4336 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:44.499574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e4efc7d-95de-4b2f-b743-c7feaabd4336 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47ceeba5-ba9a-4cf7-baf6-63682fed41bd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:44.525531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-07cca62d-4740-4340-828b-6bdd5b273ebf None None] Calling delete_port for 8092a31e-f22d-4b85-9a51-6929599fcf39 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:44.586999 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1673d267-a285-4ff7-8c41-5cfe88c97f29 req-2f6274a8-c0eb-4e11-819e-aa8b4bb7bbed tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1459141 May 12 15:18:44.595522 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e4efc7d-95de-4b2f-b743-c7feaabd4336 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:44.606180 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1e4efc7d-95de-4b2f-b743-c7feaabd4336 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/47ceeba5-ba9a-4cf7-baf6-63682fed41bd HTTP/1.1" status: 204 len: 168 time: 0.8943148 May 12 15:18:44.685543 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-344725d5-c188-4d07-804f-18fc565793fe req-d1b1975f-4938-457d-a4ff-8bad7ebd96da tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0760791 May 12 15:18:44.698813 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-07cca62d-4740-4340-828b-6bdd5b273ebf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:44.702051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Deleting port 80316dbd-bbfa-49eb-a448-99afe53e8a57 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:44.702403 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:44.712594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4812fd51-6f1c-4f67-9c40-5a31cc964187 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:18:44.721997 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4812fd51-6f1c-4f67-9c40-5a31cc964187 admin admin] 10.222.0.82 "PUT /v2.0/routers/1131f7ae-7566-4efd-ac8e-02ea4717a2aa/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8384085 May 12 15:18:44.723245 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5625efcc-9a26-4def-b1e2-165501e3c268 None None] Sync routers for ids ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:18:44.727012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59086) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:44.754731 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5625efcc-9a26-4def-b1e2-165501e3c268 None None] Routers {'1131f7ae-7566-4efd-ac8e-02ea4717a2aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:18:44.756199 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5625efcc-9a26-4def-b1e2-165501e3c268 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:18:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:44.908256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07cca62d-4740-4340-828b-6bdd5b273ebf None None] Pushing event deleted for resources: {'Port': ['ID=8092a31e-f22d-4b85-9a51-6929599fcf39,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:44.935509 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8092a31e-f22d-4b85-9a51-6929599fcf39 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:44.978108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] The port '80316dbd-bbfa-49eb-a448-99afe53e8a57' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:18:45.004658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07cca62d-4740-4340-828b-6bdd5b273ebf None None] No DVR routers for this DVR port 8092a31e-f22d-4b85-9a51-6929599fcf39 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:45.075267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 8092a31e-f22d-4b85-9a51-6929599fcf39 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:18:45.075598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8092a31e-f22d-4b85-9a51-6929599fcf39 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:18:45.075989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 80316dbd-bbfa-49eb-a448-99afe53e8a57 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:45.178046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 80316dbd-bbfa-49eb-a448-99afe53e8a57 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:18:45.182196 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:45.186193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 80316dbd-bbfa-49eb-a448-99afe53e8a57 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:18:45.197619 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cfec66c6-2a17-4d50-bcd4-e284f2c667a9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:45.279134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59108) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:45.290510 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-5625efcc-9a26-4def-b1e2-165501e3c268 None None] Set router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:18:45.306460 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:45.365480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['187794df-e6cb-4ee3-8b40-6b546c229bd2']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:45.381978 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-591a134f-f8d2-4cc6-8582-154955abbae8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:45.406282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4d535119-7517-4056-aef4-603b1fd140c2') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:45.406576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4d535119-7517-4056-aef4-603b1fd140c2') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:45.424675 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:45.457804 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:45.467488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Releasing vlan 581 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:18:45.468071 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:45.541535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-591a134f-f8d2-4cc6-8582-154955abbae8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:45.545522 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-511b8fe7-cf2d-4a0e-93ec-e3fbedd66582 req-bdc57693-f8c7-4b6f-bac7-ccb02a0baf1b tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.1518421 May 12 15:18:45.556858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-591a134f-f8d2-4cc6-8582-154955abbae8 admin admin] Usage tracker for resource:security_group_rule and tenant:674db78af00a401b9ac414457189584e is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:45.562282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-591a134f-f8d2-4cc6-8582-154955abbae8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:45.572433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-591a134f-f8d2-4cc6-8582-154955abbae8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:45.608990 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:45.637701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] Deleting port e2ce627a-e325-4d84-8e5d-f1e1fd58d98d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:45.638357 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: timer() May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:18:45.654466 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:18:45.669900 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:45.714271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:45.735145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event deleted for resources: {'Network': ['ID=187794df-e6cb-4ee3-8b40-6b546c229bd2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:45.771859 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f5ca0c8f-20ca-417c-871b-bdd78940a0ee tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "DELETE /v2.0/networks/187794df-e6cb-4ee3-8b40-6b546c229bd2 HTTP/1.1" status: 204 len: 168 time: 2.5745683 May 12 15:18:45.774280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59144) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:45.814841 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:18:45.837515 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5625efcc-9a26-4def-b1e2-165501e3c268 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194'}], 'enable_snat': True}, 'gw_port_id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:18:42Z', 'revision_number': 5, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port': {'id': 'e2ce627a-e325-4d84-8e5d-f1e1fd58d98d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:79:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1085, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:16:15Z', 'updated_at': '2022-05-12T15:16:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:45.860123 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5625efcc-9a26-4def-b1e2-165501e3c268 None None] Checking router: 1131f7ae-7566-4efd-ac8e-02ea4717a2aa for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:18:45.878180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] For port e2ce627a-e325-4d84-8e5d-f1e1fd58d98d, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e2ce627a-e325-4d84-8e5d-f1e1fd58d98d,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:45.878542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:45.890801 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5625efcc-9a26-4def-b1e2-165501e3c268 None None] Routers {'1131f7ae-7566-4efd-ac8e-02ea4717a2aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:18:45.894635 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5625efcc-9a26-4def-b1e2-165501e3c268 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:18:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:45.935323 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09d994e0-a560-4c62-b634-6238e3c443a8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:46.001675 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:46.020292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] Calling delete_port for e2ce627a-e325-4d84-8e5d-f1e1fd58d98d owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:46.113124 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:46.178003 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-5625efcc-9a26-4def-b1e2-165501e3c268 None None] Set router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:18:46.186170 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09d994e0-a560-4c62-b634-6238e3c443a8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:46.237254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-09d994e0-a560-4c62-b634-6238e3c443a8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['86d71e93-6e6b-4e00-b1ac-48b27c2b0f06']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:46.273961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-09d994e0-a560-4c62-b634-6238e3c443a8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b6fbbd36-13c3-4b1d-bb92-589caea03666') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:46.277119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-09d994e0-a560-4c62-b634-6238e3c443a8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b6fbbd36-13c3-4b1d-bb92-589caea03666') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:46.291794 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5625efcc-9a26-4def-b1e2-165501e3c268 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:18:45Z', 'revision_number': 6, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:46.297126 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5625efcc-9a26-4def-b1e2-165501e3c268 None None] The sync data for ids ['1131f7ae-7566-4efd-ac8e-02ea4717a2aa'] in n-d-841483-1 is: [{'id': '1131f7ae-7566-4efd-ac8e-02ea4717a2aa', 'name': 'tempest-ServersTestBootFromVolume-659148527-router', 'tenant_id': '60b7c456959149269dc444554ba6a6c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:16:14Z', 'updated_at': '2022-05-12T15:18:45Z', 'revision_number': 6, 'project_id': '60b7c456959149269dc444554ba6a6c2', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:18:46.320103 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09d994e0-a560-4c62-b634-6238e3c443a8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:46.362225 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09d994e0-a560-4c62-b634-6238e3c443a8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:46.379761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-09d994e0-a560-4c62-b634-6238e3c443a8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Releasing vlan 571 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:18:46.381451 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09d994e0-a560-4c62-b634-6238e3c443a8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: timer() May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:18:46.398034 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:18:46.430125 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e37b34-cc65-4d3c-8777-d530583541c9 req-c65dc83e-d085-45dc-a888-153326bf802c tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1342356 May 12 15:18:46.517092 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09d994e0-a560-4c62-b634-6238e3c443a8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:46.540947 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09d994e0-a560-4c62-b634-6238e3c443a8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:46.547255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09d994e0-a560-4c62-b634-6238e3c443a8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] Pushing event deleted for resources: {'Network': ['ID=86d71e93-6e6b-4e00-b1ac-48b27c2b0f06,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:46.555814 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-09d994e0-a560-4c62-b634-6238e3c443a8 tempest-TaggedBootDevicesTest_v242-1831620495 tempest-TaggedBootDevicesTest_v242-1831620495-project] 10.222.0.82 "DELETE /v2.0/networks/86d71e93-6e6b-4e00-b1ac-48b27c2b0f06 HTTP/1.1" status: 204 len: 168 time: 0.7803218 May 12 15:18:46.581434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60223480-392e-4cd1-8143-46d07dbbcf8e req-24ddb21c-01f2-427e-9309-d4d1ed886d48 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:46.584679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60223480-392e-4cd1-8143-46d07dbbcf8e req-24ddb21c-01f2-427e-9309-d4d1ed886d48 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 945 time: 0.2879493 May 12 15:18:46.587618 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-591a134f-f8d2-4cc6-8582-154955abbae8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:46.612185 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-591a134f-f8d2-4cc6-8582-154955abbae8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:46.695987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-591a134f-f8d2-4cc6-8582-154955abbae8 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=674db78af00a401b9ac414457189584e&name=default HTTP/1.1" status: 200 len: 2983 time: 1.4156296 May 12 15:18:46.699084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59200) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:46.731672 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-591a134f-f8d2-4cc6-8582-154955abbae8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d2e5e1d-c6b9-404e-b227-979368b37faf,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:46.746993 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60223480-392e-4cd1-8143-46d07dbbcf8e req-ae7f56a3-a853-4ab0-a785-76be588b7b45 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1613765 May 12 15:18:46.775616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 68f43459-2da5-4601-a6c1-9d5d57573727 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:46.839186 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-65309c77-3642-4194-8338-e319bdf15a11 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:46.862541 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 68f43459-2da5-4601-a6c1-9d5d57573727 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:18:46.862541 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 68f43459-2da5-4601-a6c1-9d5d57573727 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:18:46.878697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-beb0681c-b82b-4fd0-a63a-cb761925fe38 req-fc7f2345-3825-4865-aaa8-ff0a03737402 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.0994601 May 12 15:18:46.879459 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:46.889815 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-65309c77-3642-4194-8338-e319bdf15a11 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:46.946258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] Pushing event deleted for resources: {'Port': ['ID=e2ce627a-e325-4d84-8e5d-f1e1fd58d98d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:46.988965 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-65309c77-3642-4194-8338-e319bdf15a11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:47.030376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65309c77-3642-4194-8338-e319bdf15a11 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d2e5e1d-c6b9-404e-b227-979368b37faf,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:47.061057 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-65309c77-3642-4194-8338-e319bdf15a11 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:47.069100 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-65309c77-3642-4194-8338-e319bdf15a11 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5d2e5e1d-c6b9-404e-b227-979368b37faf HTTP/1.1" status: 204 len: 168 time: 0.3687072 May 12 15:18:47.202455 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:47.538279 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:47.541976 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:47.573298 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:47.573970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1131f7ae-7566-4efd-ac8e-02ea4717a2aa {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:18:47.607563 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:47.608299 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:47.610653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ffbab9df-bcfd-49f8-9bb8-2d76285a2e28 admin admin] 10.222.0.82 "DELETE /v2.0/routers/1131f7ae-7566-4efd-ac8e-02ea4717a2aa HTTP/1.1" status: 204 len: 168 time: 2.8809638 May 12 15:18:47.612653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59258) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:47.704032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-b977df7d-8258-4c83-a152-f7d8c61018bf admin admin] Deleting subnet 1972ca52-439b-4a99-be07-5a8a9346589c {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:18:47.713963 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b977df7d-8258-4c83-a152-f7d8c61018bf admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:47.793169 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1f09285-5f75-4890-b886-499da7ad67bf req-4a67eacd-3f11-44fa-a2c7-1b867e9e0b8e tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0725231 May 12 15:18:47.797127 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b977df7d-8258-4c83-a152-f7d8c61018bf admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:47.863365 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59264) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:47.918403 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a4aa1db3-1408-450b-be23-bbf273c1cb36 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:47.934124 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b977df7d-8258-4c83-a152-f7d8c61018bf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:47.968504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a4aa1db3-1408-450b-be23-bbf273c1cb36 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:47.980005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a4aa1db3-1408-450b-be23-bbf273c1cb36 admin admin] Usage tracker for resource:security_group_rule and tenant:e789dc0daf7e432194e9ce61ee72428c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:48.040476 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b977df7d-8258-4c83-a152-f7d8c61018bf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:48.075631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a4aa1db3-1408-450b-be23-bbf273c1cb36 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:48.082927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59272) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:48.112837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b977df7d-8258-4c83-a152-f7d8c61018bf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1972ca52-439b-4a99-be07-5a8a9346589c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:48.116188 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b977df7d-8258-4c83-a152-f7d8c61018bf admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:48.123583 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b977df7d-8258-4c83-a152-f7d8c61018bf admin admin] 10.222.0.82 "DELETE /v2.0/subnets/1972ca52-439b-4a99-be07-5a8a9346589c HTTP/1.1" status: 204 len: 168 time: 0.5096922 May 12 15:18:48.126741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59278) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:48.133480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd462137-ac34-42ce-803c-b70fbf220484 None None] Network 944a3072-30fa-47bc-9620-9dfd43f531e1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:18:48.171123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a4aa1db3-1408-450b-be23-bbf273c1cb36 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:48.185985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4082a236-6837-495b-8b66-3d8c4a08838f req-6d0daa6b-2054-4f51-a592-9a6aa0abbc7d tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.0813375 May 12 15:18:48.345600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e55e3959-f773-40a5-9474-590f788e41bd req-bf33cb36-fca5-4261-a4e9-f0b042cf025b tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:48.353838 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e55e3959-f773-40a5-9474-590f788e41bd req-bf33cb36-fca5-4261-a4e9-f0b042cf025b tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 945 time: 0.3749807 May 12 15:18:48.385716 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3b7ccc9e-fbe4-4e08-bab8-92c727ce85bf admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:48.388432 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:48.399660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Deleting port b35ebd98-cef6-4408-89c1-4c0186cfb834 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:48.400005 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:48.416995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3b7ccc9e-fbe4-4e08-bab8-92c727ce85bf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:48.428150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3b7ccc9e-fbe4-4e08-bab8-92c727ce85bf admin admin] Usage tracker for resource:security_group_rule and tenant:3bbaaa773b244c3796d0881cbba6ce37 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:48.435510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3b7ccc9e-fbe4-4e08-bab8-92c727ce85bf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:48.447514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3b7ccc9e-fbe4-4e08-bab8-92c727ce85bf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:48.473895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e55e3959-f773-40a5-9474-590f788e41bd req-4c0f93ab-dfc8-4181-b6e5-7201bb1127da tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1189289 May 12 15:18:48.490794 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a4aa1db3-1408-450b-be23-bbf273c1cb36 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:48.506388 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a4aa1db3-1408-450b-be23-bbf273c1cb36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:48.573595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4aa1db3-1408-450b-be23-bbf273c1cb36 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86df535e-1fae-44b4-b7fc-dae7c81c3c34,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:48.587042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a4aa1db3-1408-450b-be23-bbf273c1cb36 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e789dc0daf7e432194e9ce61ee72428c&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7192023 May 12 15:18:48.588048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59284) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:48.592638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eabb00c6-6511-443d-ba62-b9d527aed840 None None] DHCP port deletion for 944a3072-30fa-47bc-9620-9dfd43f531e1 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:18:48.597428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-eabb00c6-6511-443d-ba62-b9d527aed840 None None] Deleting port b35ebd98-cef6-4408-89c1-4c0186cfb834 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:48.598023 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eabb00c6-6511-443d-ba62-b9d527aed840 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:48.712147 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3b7ccc9e-fbe4-4e08-bab8-92c727ce85bf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:48.723312 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3b7ccc9e-fbe4-4e08-bab8-92c727ce85bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:48.849951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] For port b35ebd98-cef6-4408-89c1-4c0186cfb834, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b35ebd98-cef6-4408-89c1-4c0186cfb834,segment=NetworkSegment(51a763ab-4327-4303-92e7-963b2e4c87d0),segment_id=51a763ab-4327-4303-92e7-963b2e4c87d0)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:48.850708 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:48.852960 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3b7ccc9e-fbe4-4e08-bab8-92c727ce85bf admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3bbaaa773b244c3796d0881cbba6ce37&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7684636 May 12 15:18:48.858057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59288) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:48.858933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b7ccc9e-fbe4-4e08-bab8-92c727ce85bf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ea3f91f2-ff70-4866-9247-8f587adbe3de,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:48.866488 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-97f1b2fc-4307-4015-99e8-35c1fc46b25a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:48.917946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e2ce627a-e325-4d84-8e5d-f1e1fd58d98d no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:48.928786 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5853a92-208e-4988-92e9-834e47bafa34 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:48.979512 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: e2ce627a-e325-4d84-8e5d-f1e1fd58d98d {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:18:48.980165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e2ce627a-e325-4d84-8e5d-f1e1fd58d98d not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:18:48.980747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b35ebd98-cef6-4408-89c1-4c0186cfb834 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:48.984314 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5853a92-208e-4988-92e9-834e47bafa34 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:49.020353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Calling delete_port for b35ebd98-cef6-4408-89c1-4c0186cfb834 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:49.091372 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5853a92-208e-4988-92e9-834e47bafa34 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:49.097053 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-97f1b2fc-4307-4015-99e8-35c1fc46b25a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:49.108838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5853a92-208e-4988-92e9-834e47bafa34 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea3f91f2-ff70-4866-9247-8f587adbe3de,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:49.111244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-eabb00c6-6511-443d-ba62-b9d527aed840 None None] For port b35ebd98-cef6-4408-89c1-4c0186cfb834, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b35ebd98-cef6-4408-89c1-4c0186cfb834,segment=NetworkSegment(51a763ab-4327-4303-92e7-963b2e4c87d0),segment_id=51a763ab-4327-4303-92e7-963b2e4c87d0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:49.111874 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eabb00c6-6511-443d-ba62-b9d527aed840 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:49.121485 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5853a92-208e-4988-92e9-834e47bafa34 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:49.122627 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a5853a92-208e-4988-92e9-834e47bafa34 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ea3f91f2-ff70-4866-9247-8f587adbe3de HTTP/1.1" status: 204 len: 168 time: 0.2607393 May 12 15:18:49.277322 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:49.281766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-eabb00c6-6511-443d-ba62-b9d527aed840 None None] Calling delete_port for b35ebd98-cef6-4408-89c1-4c0186cfb834 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:49.350190 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-97f1b2fc-4307-4015-99e8-35c1fc46b25a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:49.357255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] No DVR routers for this DVR port b35ebd98-cef6-4408-89c1-4c0186cfb834 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:49.373659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Pushing event deleted for resources: {'Port': ['ID=b35ebd98-cef6-4408-89c1-4c0186cfb834,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:49.440282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97f1b2fc-4307-4015-99e8-35c1fc46b25a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86df535e-1fae-44b4-b7fc-dae7c81c3c34,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:49.572009 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-97f1b2fc-4307-4015-99e8-35c1fc46b25a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:49.573277 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-97f1b2fc-4307-4015-99e8-35c1fc46b25a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/86df535e-1fae-44b4-b7fc-dae7c81c3c34 HTTP/1.1" status: 204 len: 168 time: 0.9850380 May 12 15:18:49.587793 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:49.594370 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:49.702138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['944a3072-30fa-47bc-9620-9dfd43f531e1']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:49.725262 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-eabb00c6-6511-443d-ba62-b9d527aed840 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:18:49.729408 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-eabb00c6-6511-443d-ba62-b9d527aed840 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:18:49.733874 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 6bc1aefc-4b55-42c5-90cb-a9601d36d06c details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:18:49.752843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '51a763ab-4327-4303-92e7-963b2e4c87d0') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:49.753025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '51a763ab-4327-4303-92e7-963b2e4c87d0') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:18:49.769706 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd8c11db-98e7-4a90-8cda-db71582aaec5 req-e1deb69f-eff9-4961-87ef-d5022068a221 tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.2312167 May 12 15:18:49.795276 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cef29a9c-1875-4d91-95a1-0f333c8e97d4 req-ceec2b51-cfdd-4310-84f7-096ffa53fde5 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.1805832 May 12 15:18:49.807470 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:49.844593 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59312) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:49.864345 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:49.891371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Releasing vlan 597 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:18:49.891782 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:49.924505 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c51ca00-c6ec-4b8b-9940-91352233a5d4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: timer() May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:18:49.936702 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:18:49.989619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2c51ca00-c6ec-4b8b-9940-91352233a5d4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:49.999780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2c51ca00-c6ec-4b8b-9940-91352233a5d4 admin admin] Usage tracker for resource:security_group_rule and tenant:cc66cbb25d8c4b33b877a726813405ce is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:50.007138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2c51ca00-c6ec-4b8b-9940-91352233a5d4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:50.038180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2c51ca00-c6ec-4b8b-9940-91352233a5d4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:50.110878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:50.129708 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:50.142605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] Pushing event deleted for resources: {'Network': ['ID=944a3072-30fa-47bc-9620-9dfd43f531e1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:50.168786 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d92c3c61-da5f-480d-9e0d-bb99f61b8811 admin admin] 10.222.0.82 "DELETE /v2.0/networks/944a3072-30fa-47bc-9620-9dfd43f531e1 HTTP/1.1" status: 204 len: 168 time: 2.0407743 May 12 15:18:50.173962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:50.191238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '6bc1aefc-4b55-42c5-90cb-a9601d36d06c', 'network_id': 'c3c7ba99-d7de-4515-b784-ef9ce8b08726', 'port_id': '6bc1aefc-4b55-42c5-90cb-a9601d36d06c', 'mac_address': 'fa:16:3e:8a:bc:d4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 587, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2c6ef05c-5190-47b2-bba9-0d2bdacd727d', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:18:50.261576 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-eabb00c6-6511-443d-ba62-b9d527aed840 None None] Deleting port b35ebd98-cef6-4408-89c1-4c0186cfb834 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:50.262210 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eabb00c6-6511-443d-ba62-b9d527aed840 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:50.303439 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:50.311510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6049f38a-fce6-4e21-abbd-7b218bcc2dca req-5cd2d3d4-cf59-4dea-9ff3-2d671f74d47b tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:50.313033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6049f38a-fce6-4e21-abbd-7b218bcc2dca req-5cd2d3d4-cf59-4dea-9ff3-2d671f74d47b tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 945 time: 0.2177334 May 12 15:18:50.384189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 6bc1aefc-4b55-42c5-90cb-a9601d36d06c {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:18:50.412305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6049f38a-fce6-4e21-abbd-7b218bcc2dca req-58a417b0-cdd3-4866-a4fa-28743f8daa13 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0907419 May 12 15:18:50.432481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-eabb00c6-6511-443d-ba62-b9d527aed840 None None] The port 'b35ebd98-cef6-4408-89c1-4c0186cfb834' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:18:50.469443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:50.478935 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:50.517782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59328) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:50.527282 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c51ca00-c6ec-4b8b-9940-91352233a5d4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:50.538955 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c51ca00-c6ec-4b8b-9940-91352233a5d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:50.589989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:50.636005 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-65af270f-b219-458c-9e01-92316ba0af6c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=60b7c456959149269dc444554ba6a6c2&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1145339 May 12 15:18:50.642244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59334) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:50.691958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['6bc1aefc-4b55-42c5-90cb-a9601d36d06c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:18:50.701331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2c51ca00-c6ec-4b8b-9940-91352233a5d4 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=cc66cbb25d8c4b33b877a726813405ce&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8553760 May 12 15:18:50.703942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59338) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:50.726444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c51ca00-c6ec-4b8b-9940-91352233a5d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc7111d5-76cc-424e-9b6f-140ae072a51d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:50.815422 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70161ade-37a9-45c3-a404-dff12805ef70 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:50.931066 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70161ade-37a9-45c3-a404-dff12805ef70 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:51.122791 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8992e802-5fbe-43a5-a3ab-2ee391a3b1fd req-ec5fdebd-8c5d-464d-aa71-7174ed9f466d tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.1169636 May 12 15:18:51.246308 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-69025917-c7e7-49f2-a81a-484bed319b29 req-b644ef00-f090-4a07-be74-e33694c2ca80 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1291838 May 12 15:18:51.250982 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70161ade-37a9-45c3-a404-dff12805ef70 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:51.267467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 6bc1aefc-4b55-42c5-90cb-a9601d36d06c no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:51.290754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70161ade-37a9-45c3-a404-dff12805ef70 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=76d1888c-b8d7-463e-9024-d0050580818c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:51.306619 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70161ade-37a9-45c3-a404-dff12805ef70 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:51.318509 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-70161ade-37a9-45c3-a404-dff12805ef70 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/76d1888c-b8d7-463e-9024-d0050580818c HTTP/1.1" status: 204 len: 168 time: 0.6741269 May 12 15:18:51.335303 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-78608f86-9919-466a-af62-9e6820ece135 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:51.340337 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-54fb2f27-ff98-4228-82da-6a6870199716 req-b6ad879f-e34a-4e13-b766-4db05d29f0a4 tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0467539 May 12 15:18:51.396416 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-78608f86-9919-466a-af62-9e6820ece135 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:51.477475 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-78608f86-9919-466a-af62-9e6820ece135 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:51.499974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78608f86-9919-466a-af62-9e6820ece135 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc7111d5-76cc-424e-9b6f-140ae072a51d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:51.507709 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-78608f86-9919-466a-af62-9e6820ece135 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:51.509440 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-78608f86-9919-466a-af62-9e6820ece135 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cc7111d5-76cc-424e-9b6f-140ae072a51d HTTP/1.1" status: 204 len: 168 time: 0.7968328 May 12 15:18:51.587397 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:51.611137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59370) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:51.625405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id 6bc1aefc-4b55-42c5-90cb-a9601d36d06c {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:18:51.648871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:51.654978 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:51.721329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59875e63-2d6c-4e0d-93f0-77e7484868b3 req-8ecd2147-4a6e-4fbb-b3d8-29df1f70668a tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:51.733217 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59875e63-2d6c-4e0d-93f0-77e7484868b3 req-8ecd2147-4a6e-4fbb-b3d8-29df1f70668a tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 944 time: 0.1333318 May 12 15:18:51.741611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:51.808020 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59875e63-2d6c-4e0d-93f0-77e7484868b3 req-6cb105ff-88e7-4c24-96c2-e5109c63152a tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0738993 May 12 15:18:51.888988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Request body: {'network': {'name': 'tempest-FloatingIPNegativeTestJSON-test-network-740136338'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:18:51.894799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:51.899944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Usage tracker for resource:network and tenant:97c1bf81263543a888f23243db1936dd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:51.903631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:51.911206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:51.923875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Made reservation on behalf of 97c1bf81263543a888f23243db1936dd for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:18:51.927855 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:51.940520 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:51.959677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:51.963817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Usage tracker for resource:security_group_rule and tenant:97c1bf81263543a888f23243db1936dd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:51.966779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:51.975111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:52.107729 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:52.122225 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:52.171518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 577} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:18:52.183698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8f5da08d-4741-41cf-b6ca-21af85faa464,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:52.191882 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:52.192298 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Added segment 6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f of type vlan for network 674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3 May 12 15:18:52.232176 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:52.309378 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:52.315668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:52.316142 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:52.687185 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 793 time: 1.0724630 May 12 15:18:52.687185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff76dea0-8f2d-4528-8419-0b9dc5f0d8e8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event updated for resources: {'Network': ['ID=674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:52.688768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59412) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:52.696870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:18:52.714392 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-51edf533-e3b1-4579-b66f-7db173f26230 req-5611d7a5-61c9-4340-bbca-ffd13e5fec09 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.1378484 May 12 15:18:52.727953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Request body: {'subnet': {'network_id': '674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:18:52.952483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-929379c4-4816-4259-b5c6-bea07a42400f tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:52.953223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-929379c4-4816-4259-b5c6-bea07a42400f tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Synchronizing usage tracker for tenant:7d73e66034f94885ae45429129883002 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:18:52.990630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-929379c4-4816-4259-b5c6-bea07a42400f tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Unset dirty status for tenant:7d73e66034f94885ae45429129883002 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:18:52.991779 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-929379c4-4816-4259-b5c6-bea07a42400f tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.84 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 943 time: 0.2181754 May 12 15:18:53.024625 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22107521-7a81-419a-af58-cacc38487637 req-7698fbf2-eb44-4ce6-8835-ce19ccf5a7ef tempest-ServersAdmin275Test-1815515875 tempest-ServersAdmin275Test-1815515875-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.2576044 May 12 15:18:53.093545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59424) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:53.179526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Deleting port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:53.179871 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:53.191028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:53.196555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Usage tracker for resource:subnet and tenant:97c1bf81263543a888f23243db1936dd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:53.200184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:53.207091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:53.260468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Made reservation on behalf of 97c1bf81263543a888f23243db1936dd for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:18:53.268866 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 6bc1aefc-4b55-42c5-90cb-a9601d36d06c up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:18:53.290183 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:53.506171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:18:53.506171 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:53.609916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Request body: {'network': {'name': 'tempest-ListServerFiltersTestJSON-1240372507-network', 'tenant_id': '07c1472fa162425e9303d95e5e843c64'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:18:53.632336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:53.641731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Usage tracker for resource:network and tenant:07c1472fa162425e9303d95e5e843c64 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:53.647427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:53.665522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:53.749305 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:53.790445 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8617af39-06d3-45c2-bfd2-78bad9d75c03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6bc1aefc-4b55-42c5-90cb-a9601d36d06c'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:53.804643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:53.820755 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:53.914019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb65e444-19f6-4e32-9610-97c0bac12ccd req-16bd613f-02ad-4c16-9522-bbdf672afb3c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:53.923573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb65e444-19f6-4e32-9610-97c0bac12ccd req-16bd613f-02ad-4c16-9522-bbdf672afb3c tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 943 time: 0.8569224 May 12 15:18:53.928401 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:53.987394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:54.039438 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32882a04-f3da-477b-9f17-076a939aa1ef req-9c38f8d8-d3b8-432e-922a-58e1190778ba service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=e61c54ab0c934f419cc4fd1467ea2fe3&device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.3634839 May 12 15:18:54.046457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Made reservation on behalf of 07c1472fa162425e9303d95e5e843c64 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:18:54.049076 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.054842 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27729f92-f9ea-4761-9948-98e331bbeb47 req-6c24707e-884f-4198-95f3-afb21dfb9013 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.0547836 May 12 15:18:54.105943 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.132892 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32882a04-f3da-477b-9f17-076a939aa1ef req-3bcada81-aac3-40a8-a31b-1345b9c032e6 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=e61c54ab0c934f419cc4fd1467ea2fe3&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0701301 May 12 15:18:54.135074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] For port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:54.135660 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.145238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:54.157266 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb65e444-19f6-4e32-9610-97c0bac12ccd req-766762b0-f8b6-42d9-9681-4423f449fa1d tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2320879 May 12 15:18:54.168927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Checking segment: {'id': '6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:18:54.172645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Network hostable DHCP agents. Network: 674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:18:54.241722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event updated for resources: {'Subnet': ['ID=47a3363b-4cb0-42be-951a-7f0b619f2d69,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:54.277186 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fa179d77-0b79-4a92-98a8-8c3043d711e6'] response: {'server_uuid': '8617af39-06d3-45c2-bfd2-78bad9d75c03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6bc1aefc-4b55-42c5-90cb-a9601d36d06c', 'code': 200} May 12 15:18:54.284417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Network 674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:18:54.356218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:18:54.364503 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-572d1098-e7f2-4cfe-a78d-d0c647f89fd4 None None] Network 674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:18:54.365307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32882a04-f3da-477b-9f17-076a939aa1ef req-9b15226b-d692-4699-98f8-b28ac56022b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:54.367910 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32882a04-f3da-477b-9f17-076a939aa1ef req-9b15226b-d692-4699-98f8-b28ac56022b3 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2198572 May 12 15:18:54.371160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Usage tracker for resource:security_group_rule and tenant:07c1472fa162425e9303d95e5e843c64 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:54.420156 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a309ef22-b802-43b6-8d15-460ea5f2bb98 req-6fa0fea1-75a9-455b-91c7-5946b4279632 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.0997322 May 12 15:18:54.421611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:54.422195 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.445458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:54.508454 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-73f2e90a-78b0-4733-b4e5-f4365b04a484 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.7892392 May 12 15:18:54.508667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59452) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:54.514486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-fb0aeee9-8b09-4ddb-abc2-30f8d02962f8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Request body: {'router': {'name': 'tempest-FloatingIPNegativeTestJSON-router-2081444208', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:18:54.531493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fb0aeee9-8b09-4ddb-abc2-30f8d02962f8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:54.541288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fb0aeee9-8b09-4ddb-abc2-30f8d02962f8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Usage tracker for resource:router and tenant:97c1bf81263543a888f23243db1936dd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:54.549298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fb0aeee9-8b09-4ddb-abc2-30f8d02962f8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:54.561078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Calling delete_port for 6bc1aefc-4b55-42c5-90cb-a9601d36d06c owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:54.565088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fb0aeee9-8b09-4ddb-abc2-30f8d02962f8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:54.592570 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb0aeee9-8b09-4ddb-abc2-30f8d02962f8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.594172 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb0aeee9-8b09-4ddb-abc2-30f8d02962f8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.627230 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb0aeee9-8b09-4ddb-abc2-30f8d02962f8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.646519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:54.671000 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb0aeee9-8b09-4ddb-abc2-30f8d02962f8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.710295 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb0aeee9-8b09-4ddb-abc2-30f8d02962f8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.714617 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fb0aeee9-8b09-4ddb-abc2-30f8d02962f8 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 715 time: 0.2022719 May 12 15:18:54.715391 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59462) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:54.775152 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:18:54.775480 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:18:54.831135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.838060 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.871098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3', 'network_id': '674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3', 'tenant_id': '97c1bf81263543a888f23243db1936dd', 'fixed_ips': [{'subnet_id': '47a3363b-4cb0-42be-951a-7f0b619f2d69'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:18:54.871991 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.886145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 553} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:18:54.895883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fd2954d6-4234-4a13-a827-ff9f705a5cfa,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:54.902392 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.902727 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Added segment 8d117579-62ca-4ff1-b65e-77a41d98571a of type vlan for network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d May 12 15:18:54.945895 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.993158 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:54.994288 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:54.995068 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:55.089586 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Allocated IP 172.20.0.2 (674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3/47a3363b-4cb0-42be-951a-7f0b619f2d69/b70ef405-82b6-4381-8ce4-2ee29d93182b) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:18:55.160188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] Pushing event updated for resources: {'Network': ['ID=0ff32f81-3ca6-41e0-8986-06dbed4ab52d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:55.194496 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e4b5fd4e-2326-456c-9dbc-23ff49581ace admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 2.0997097 May 12 15:18:55.197498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59478) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:55.208032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Request body: {'subnet': {'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d', 'cidr': '172.20.0.0/28', 'name': 'tempest-ListServerFiltersTestJSON-1240372507-subnet', 'tenant_id': '07c1472fa162425e9303d95e5e843c64', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:18:55.222907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:55.236167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Usage tracker for resource:subnet and tenant:07c1472fa162425e9303d95e5e843c64 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:55.246023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:55.256144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:55.276781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Deleting port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:18:55.277422 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:55.315690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:18:55.400447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Made reservation on behalf of 07c1472fa162425e9303d95e5e843c64 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:18:55.415689 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:55.573500 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:55.588027 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Transition to ACTIVE for port object b70ef405-82b6-4381-8ce4-2ee29d93182b will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:18:55.624499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Transition to ACTIVE for port object b70ef405-82b6-4381-8ce4-2ee29d93182b will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:18:55.645666 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:55.770534 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Network 674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:18:55.777603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:18:55.784920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:18:55.785113 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32882a04-f3da-477b-9f17-076a939aa1ef req-f903a67f-e901-40c6-b939-59ead670f8cc tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.76 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.1402035 May 12 15:18:55.840226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Pushing event updated for resources: {'Port': ['ID=b70ef405-82b6-4381-8ce4-2ee29d93182b,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:55.920592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Attempting to bind port b70ef405-82b6-4381-8ce4-2ee29d93182b on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:18:55.921251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Attempting to bind port b70ef405-82b6-4381-8ce4-2ee29d93182b by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:18:55.921468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Attempting to bind port b70ef405-82b6-4381-8ce4-2ee29d93182b on network 674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:18:55.928763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 18, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:18:55.929176 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Checking segment: {'id': '6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:18:55.929600 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:55.929980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Bound using segment: {'id': '6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:18:55.930435 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Bound port: b70ef405-82b6-4381-8ce4-2ee29d93182b, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:18:55.930842 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:55.987315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b30b294-9f7d-4475-baf1-caf1b77c4f2e req-faeb185e-902c-4595-a996-0df632abad14 tempest-ServersAdmin275Test-130708063 tempest-ServersAdmin275Test-130708063-project] 10.222.0.82 "GET /v2.0/ports?device_id=15c39f4c-083c-45e3-a575-99c3a7e32bc6 HTTP/1.1" status: 200 len: 210 time: 0.4799440 May 12 15:18:56.016103 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87973e86-5684-4440-9561-a5a3ceb34f87 req-b083af4d-da1c-4564-8cec-2b92a6b8bf30 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.0688651 May 12 15:18:56.128877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] For port b70ef405-82b6-4381-8ce4-2ee29d93182b, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:18:56.135130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] For port b70ef405-82b6-4381-8ce4-2ee29d93182b, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b70ef405-82b6-4381-8ce4-2ee29d93182b,segment=NetworkSegment(6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f),segment_id=6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:18:56.143846 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:56.149552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] For port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,segment=NetworkSegment(75265c81-b0a3-4707-85cf-250efb72702a),segment_id=75265c81-b0a3-4707-85cf-250efb72702a)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:56.149944 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:56.283629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59528) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:56.356712 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:56.366824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e520cab3-6395-4c3a-b18c-eb2de44fb6cd None None] Pushing event updated for resources: {'Port': ['ID=b70ef405-82b6-4381-8ce4-2ee29d93182b,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:56.425346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Calling delete_port for 6bc1aefc-4b55-42c5-90cb-a9601d36d06c owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:18:56.440152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c4585df-80ac-4943-912e-64f6076a6ade req-0642f221-f86d-4867-83d4-72e82c9a4890 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.1511700 May 12 15:18:56.441976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59532) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:56.565641 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:56.676006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=34e2be1a-2cbe-4227-a0bf-50d20740aa45,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:56.830134 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:56.970229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b70ef405-82b6-4381-8ce4-2ee29d93182b up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:18:57.104254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe693b52-6176-4669-bb35-8ab5e489c038 req-593d0661-0a95-4560-af32-3a6f13afcbf9 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:57.120772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fe693b52-6176-4669-bb35-8ab5e489c038 req-593d0661-0a95-4560-af32-3a6f13afcbf9 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/ports?device_id=8617af39-06d3-45c2-bfd2-78bad9d75c03 HTTP/1.1" status: 200 len: 945 time: 1.6025023 May 12 15:18:57.185084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port b70ef405-82b6-4381-8ce4-2ee29d93182b completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:18:57.283620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 6bc1aefc-4b55-42c5-90cb-a9601d36d06c no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:18:57.324744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Pushing event deleted for resources: {'Port': ['ID=6bc1aefc-4b55-42c5-90cb-a9601d36d06c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:57.369603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 6bc1aefc-4b55-42c5-90cb-a9601d36d06c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:18:57.369964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 6bc1aefc-4b55-42c5-90cb-a9601d36d06c not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:18:57.391895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Checking segment: {'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:18:57.392535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Network hostable DHCP agents. Network: 0ff32f81-3ca6-41e0-8986-06dbed4ab52d, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:18:57.434422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] No DVR routers for this DVR port 6bc1aefc-4b55-42c5-90cb-a9601d36d06c on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:18:57.440888 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:57.449670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8617af39-06d3-45c2-bfd2-78bad9d75c03', 'name': 'network-vif-deleted', 'tag': '6bc1aefc-4b55-42c5-90cb-a9601d36d06c'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:18:57.462051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Allocated IP 172.20.0.1 (674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3/47a3363b-4cb0-42be-951a-7f0b619f2d69/1ebc52d1-efdd-4a8c-aeeb-ceb652fdbc23) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:18:57.486582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:18:57.492747 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd144fe5-dd27-4079-a228-595d90cc29ec req-a60b4d59-bae8-4a4c-8651-bc9c7e37d515 tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.84 "DELETE /v2.0/ports/6bc1aefc-4b55-42c5-90cb-a9601d36d06c HTTP/1.1" status: 204 len: 173 time: 4.4934964 May 12 15:18:57.522765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 0ff32f81-3ca6-41e0-8986-06dbed4ab52d) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:18:57.526922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:57.527679 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:57.532579 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02337717-7e8b-41b8-bfa3-ecd93011905e None None] Network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:18:57.567413 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fe693b52-6176-4669-bb35-8ab5e489c038 req-2d263680-4cd5-4750-b74d-3b66e256a37f tempest-ImagesTestJSON-749708852 tempest-ImagesTestJSON-749708852-project] 10.222.0.82 "GET /v2.0/security-groups?id=cac695a8-4e75-4439-8978-1a574d6875af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4442370 May 12 15:18:57.578339 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5cee047e-5da9-4e78-af39-d8812fc63445 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:57.593515 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-41cfcf6d-f6de-458e-8b1d-30e3679131a2 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 2.3841796 May 12 15:18:57.598603 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-30f9d2d9-2a6c-4dd3-b4b4-e74558d96b0c'] response: {'server_uuid': '8617af39-06d3-45c2-bfd2-78bad9d75c03', 'name': 'network-vif-deleted', 'tag': '6bc1aefc-4b55-42c5-90cb-a9601d36d06c', 'status': 'completed', 'code': 200} May 12 15:18:57.662437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5cee047e-5da9-4e78-af39-d8812fc63445 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:57.669656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5cee047e-5da9-4e78-af39-d8812fc63445 admin admin] Usage tracker for resource:security_group_rule and tenant:ecba14f0b2534151ada27b470fbe293a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:57.690854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5cee047e-5da9-4e78-af39-d8812fc63445 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:57.746735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59554) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:57.937009 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d405e7ab-3e79-4e36-9079-44378e8b43db admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:57.964354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d405e7ab-3e79-4e36-9079-44378e8b43db admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:18:57.969236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d405e7ab-3e79-4e36-9079-44378e8b43db admin admin] Usage tracker for resource:security_group_rule and tenant:e61c54ab0c934f419cc4fd1467ea2fe3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:18:57.972885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d405e7ab-3e79-4e36-9079-44378e8b43db admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:18:57.982951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d405e7ab-3e79-4e36-9079-44378e8b43db admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:57.987356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5cee047e-5da9-4e78-af39-d8812fc63445 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:18:58.067526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-0ff32f81-3ca6-41e0-8986-06dbed4ab52d', 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d', 'tenant_id': '07c1472fa162425e9303d95e5e843c64', 'fixed_ips': [{'subnet_id': '34e2be1a-2cbe-4227-a0bf-50d20740aa45'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:18:58.074021 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:58.120078 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22de438c-ee4c-4a3d-b305-152a82b055eb req-ef1e692a-1100-4640-90bb-eb50c79e0d14 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.2201006 May 12 15:18:58.171066 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d405e7ab-3e79-4e36-9079-44378e8b43db admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:58.180053 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d405e7ab-3e79-4e36-9079-44378e8b43db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:58.296538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d405e7ab-3e79-4e36-9079-44378e8b43db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bc93f53c-1eb0-400e-9381-9df892fa40ac,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:58.314487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa416e18-36ac-42a5-b0a7-a78efdae914a None None] Network 674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:18:58.360270 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d405e7ab-3e79-4e36-9079-44378e8b43db admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e61c54ab0c934f419cc4fd1467ea2fe3&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6127658 May 12 15:18:58.361201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59570) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:58.547897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:58.579060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-64a9aed0-0df0-4801-83c0-5883dc0dd6ab None None] Provisioning for port b70ef405-82b6-4381-8ce4-2ee29d93182b completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:18:58.599772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-64a9aed0-0df0-4801-83c0-5883dc0dd6ab None None] Provisioning complete for port b70ef405-82b6-4381-8ce4-2ee29d93182b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:18:58.600265 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64a9aed0-0df0-4801-83c0-5883dc0dd6ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:58.713183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Allocated IP 172.20.0.2 (0ff32f81-3ca6-41e0-8986-06dbed4ab52d/34e2be1a-2cbe-4227-a0bf-50d20740aa45/7ec1c0e6-e3cc-4075-87ff-0216985d1d2b) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:18:58.857289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Transition to ACTIVE for port object 1ebc52d1-efdd-4a8c-aeeb-ceb652fdbc23 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:18:58.879688 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fd30042a-a9ce-476d-83ea-fb474d454bd8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:58.883030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3955096-2031-4d51-a669-8b8ae82aa5d8 req-5a3261e6-1de8-419a-98f3-c5ffc9e5a865 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9&device_id=9f126623-0718-483a-8852-efb8350ac373 HTTP/1.1" status: 200 len: 210 time: 0.0895543 May 12 15:18:58.915206 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64a9aed0-0df0-4801-83c0-5883dc0dd6ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:58.985688 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5cee047e-5da9-4e78-af39-d8812fc63445 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.014056 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fd30042a-a9ce-476d-83ea-fb474d454bd8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.026604 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5cee047e-5da9-4e78-af39-d8812fc63445 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.137332 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5cee047e-5da9-4e78-af39-d8812fc63445 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ecba14f0b2534151ada27b470fbe293a&name=default HTTP/1.1" status: 200 len: 2983 time: 2.6832981 May 12 15:18:59.144424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59588) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:18:59.169361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-0854d89f-5593-4291-a7df-2c3ad0ba62b2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:59.178675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-0854d89f-5593-4291-a7df-2c3ad0ba62b2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/networks?id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d HTTP/1.1" status: 200 len: 816 time: 0.7011402 May 12 15:18:59.183663 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.197555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Transition to ACTIVE for port object 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:18:59.213663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cee047e-5da9-4e78-af39-d8812fc63445 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bec30c23-1b14-428a-9eac-701b7beeac59,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:59.219064 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Transition to ACTIVE for port object 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:18:59.229164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-64a9aed0-0df0-4801-83c0-5883dc0dd6ab None None] For port b70ef405-82b6-4381-8ce4-2ee29d93182b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b70ef405-82b6-4381-8ce4-2ee29d93182b,segment=NetworkSegment(6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f),segment_id=6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:18:59.233455 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.236565 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-3a9dfb20-659b-4dec-bcc6-d3a6476bb9df tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/quotas/07c1472fa162425e9303d95e5e843c64 HTTP/1.1" status: 200 len: 375 time: 0.0568588 May 12 15:18:59.271745 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.309786 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64a9aed0-0df0-4801-83c0-5883dc0dd6ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.316649 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f801d7d6-5f3a-453f-b28f-b994da24b9c7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.340231 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Pushing event updated for resources: {'Port': ['ID=7ec1c0e6-e3cc-4075-87ff-0216985d1d2b,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:59.360739 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f801d7d6-5f3a-453f-b28f-b994da24b9c7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.458368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a9aed0-0df0-4801-83c0-5883dc0dd6ab None None] Pushing event updated for resources: {'Port': ['ID=b70ef405-82b6-4381-8ce4-2ee29d93182b,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:59.463826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:18:59.468843 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:18:59.475237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:18:59.494861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fd30042a-a9ce-476d-83ea-fb474d454bd8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.529529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Network 674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:18:59.538088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:18:59.544913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd30042a-a9ce-476d-83ea-fb474d454bd8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc93f53c-1eb0-400e-9381-9df892fa40ac,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:59.558026 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:18:59.584626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event updated for resources: {'Port': ['ID=1ebc52d1-efdd-4a8c-aeeb-ceb652fdbc23,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:59.602588 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6db561bf-4510-4107-9d23-622a58d20568 req-485a106e-4f1a-42a4-849f-e0ef607b03b4 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a666a664b8e246d0aa19ae71604a8be8&device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.1677313 May 12 15:18:59.604725 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f801d7d6-5f3a-453f-b28f-b994da24b9c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.646659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f801d7d6-5f3a-453f-b28f-b994da24b9c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bec30c23-1b14-428a-9eac-701b7beeac59,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:18:59.660144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6db561bf-4510-4107-9d23-622a58d20568 req-d3d10dfc-2290-484f-96a2-cff370991d68 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=a666a664b8e246d0aa19ae71604a8be8&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0463743 May 12 15:18:59.660275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Attempting to bind port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:18:59.661927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Attempting to bind port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:18:59.662721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Attempting to bind port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b on network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:18:59.685957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 18, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:18:59.686400 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Checking segment: {'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:18:59.686855 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.687316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Bound using segment: {'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:18:59.687971 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Bound port: 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:18:59.688711 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.739247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9fd702f8-d297-41dc-a052-2e547893ac58 req-bfebe3ce-502e-4bf7-aa4d-11e4f161f34b tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.1457508 May 12 15:18:59.766382 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fd30042a-a9ce-476d-83ea-fb474d454bd8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.770219 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fd30042a-a9ce-476d-83ea-fb474d454bd8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bc93f53c-1eb0-400e-9381-9df892fa40ac HTTP/1.1" status: 204 len: 168 time: 1.3941038 May 12 15:18:59.773081 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.783998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f801d7d6-5f3a-453f-b28f-b994da24b9c7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:18:59.788452 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f801d7d6-5f3a-453f-b28f-b994da24b9c7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bec30c23-1b14-428a-9eac-701b7beeac59 HTTP/1.1" status: 204 len: 168 time: 0.6411216 May 12 15:18:59.877770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db561bf-4510-4107-9d23-622a58d20568 req-4db7e037-38d1-4578-a3a6-f58c4792c2de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:18:59.880383 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6db561bf-4510-4107-9d23-622a58d20568 req-4db7e037-38d1-4578-a3a6-f58c4792c2de service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2132535 May 12 15:18:59.967915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] For port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:18:59.977554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] For port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7ec1c0e6-e3cc-4075-87ff-0216985d1d2b,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:18:59.994905 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:00.205813 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-12553a81-5976-44f6-bbfc-d0f804081c6a tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=07c1472fa162425e9303d95e5e843c64&fields=id HTTP/1.1" status: 200 len: 255 time: 0.8066263 May 12 15:19:00.207394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d958a452-10b7-42ce-85a8-a311ba3f129a None None] Provisioning complete for port b70ef405-82b6-4381-8ce4-2ee29d93182b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:00.209232 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d958a452-10b7-42ce-85a8-a311ba3f129a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:00.342155 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ef2db6a-436e-4d95-84de-ccb0215faf7d None None] Pushing event updated for resources: {'Port': ['ID=7ec1c0e6-e3cc-4075-87ff-0216985d1d2b,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:00.488857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59620) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:00.527693 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54b4ec51-b399-402c-8cdd-2d56bede8768 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:00.532718 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-325d848f-e42f-40ef-ae9a-8ce57be449f8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:00.590218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59626) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:00.592119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-325d848f-e42f-40ef-ae9a-8ce57be449f8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:00.623017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-325d848f-e42f-40ef-ae9a-8ce57be449f8 admin admin] Usage tracker for resource:security_group_rule and tenant:a70092c0c8cd40c687cf2707c1898018 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:00.628778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-325d848f-e42f-40ef-ae9a-8ce57be449f8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:00.632071 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2500d52-d3c3-489e-9bf3-c23eae9c30a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:00.650285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-325d848f-e42f-40ef-ae9a-8ce57be449f8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:00.666848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0b16b606-3736-4be4-b2d6-59c9ca4f9a7e None None] Provisioning for port 1ebc52d1-efdd-4a8c-aeeb-ceb652fdbc23 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:00.668854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f2500d52-d3c3-489e-9bf3-c23eae9c30a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:00.680774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f2500d52-d3c3-489e-9bf3-c23eae9c30a7 admin admin] Usage tracker for resource:security_group_rule and tenant:9a623900e87348cb96841a4d4b4ccd3a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:00.684711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f2500d52-d3c3-489e-9bf3-c23eae9c30a7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:00.684878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0b16b606-3736-4be4-b2d6-59c9ca4f9a7e None None] Provisioning complete for port 1ebc52d1-efdd-4a8c-aeeb-ceb652fdbc23 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:00.686423 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b16b606-3736-4be4-b2d6-59c9ca4f9a7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:00.700952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f2500d52-d3c3-489e-9bf3-c23eae9c30a7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:00.796925 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0b16b606-3736-4be4-b2d6-59c9ca4f9a7e None None] Port 1ebc52d1-efdd-4a8c-aeeb-ceb652fdbc23 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:19:00.910352 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:00.911484 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2500d52-d3c3-489e-9bf3-c23eae9c30a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:00.916519 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-325d848f-e42f-40ef-ae9a-8ce57be449f8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:00.920411 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2500d52-d3c3-489e-9bf3-c23eae9c30a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:00.937955 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-325d848f-e42f-40ef-ae9a-8ce57be449f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:00.978598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b70ef405-82b6-4381-8ce4-2ee29d93182b up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:00.999582 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f2500d52-d3c3-489e-9bf3-c23eae9c30a7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9a623900e87348cb96841a4d4b4ccd3a&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3972111 May 12 15:19:01.005151 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-325d848f-e42f-40ef-ae9a-8ce57be449f8 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a70092c0c8cd40c687cf2707c1898018&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5139196 May 12 15:19:01.006105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2500d52-d3c3-489e-9bf3-c23eae9c30a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=082ac20f-681c-43ed-9f63-3c14f857e972,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:01.008511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59640) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:01.008763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59642) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:01.101571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-66bd1bb1-703a-4260-824e-31882e0d2043 service neutron] 10.222.0.82 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8830574 May 12 15:19:01.103997 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6db561bf-4510-4107-9d23-622a58d20568 req-f1344ccf-c937-4994-9dfa-19e6503a274f tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.76 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.0565789 May 12 15:19:01.104130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b70ef405-82b6-4381-8ce4-2ee29d93182b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:01.104512 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:01.105781 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30d5004e-d766-4500-9823-07b0d9a87500 req-3ecc44cf-b5c9-4427-98db-8164d3746c38 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=fa996eb5-2f63-4bf0-89c0-3ae1fa2b6dc9 HTTP/1.1" status: 200 len: 210 time: 0.0835640 May 12 15:19:01.183874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-325d848f-e42f-40ef-ae9a-8ce57be449f8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1fb5aa7-12c3-4691-8d54-bfcb5cdbec7f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:01.260995 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d45ed24-5636-4d4b-ae27-5535816555d7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:01.313337 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2085507a-d2d1-4e65-b462-407a77882383 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:01.382414 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2085507a-d2d1-4e65-b462-407a77882383 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:01.412702 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:01.457230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59648) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:01.528509 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2085507a-d2d1-4e65-b462-407a77882383 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:01.530553 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d45ed24-5636-4d4b-ae27-5535816555d7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:01.560272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:01.576882 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2085507a-d2d1-4e65-b462-407a77882383 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1fb5aa7-12c3-4691-8d54-bfcb5cdbec7f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:01.615951 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2085507a-d2d1-4e65-b462-407a77882383 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:01.619577 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2085507a-d2d1-4e65-b462-407a77882383 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d1fb5aa7-12c3-4691-8d54-bfcb5cdbec7f HTTP/1.1" status: 204 len: 168 time: 0.6082387 May 12 15:19:01.629581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-3e5ee25a-a26a-4dfa-8622-28dd2a5de9f2 admin admin] Deleting subnet 2c6ef05c-5190-47b2-bba9-0d2bdacd727d {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:19:01.634470 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e5ee25a-a26a-4dfa-8622-28dd2a5de9f2 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:01.733894 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e5ee25a-a26a-4dfa-8622-28dd2a5de9f2 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:01.765357 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d45ed24-5636-4d4b-ae27-5535816555d7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:01.807925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d45ed24-5636-4d4b-ae27-5535816555d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=082ac20f-681c-43ed-9f63-3c14f857e972,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:01.818060 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d45ed24-5636-4d4b-ae27-5535816555d7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:01.819745 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4d45ed24-5636-4d4b-ae27-5535816555d7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/082ac20f-681c-43ed-9f63-3c14f857e972 HTTP/1.1" status: 204 len: 168 time: 0.8099728 May 12 15:19:01.848195 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e5ee25a-a26a-4dfa-8622-28dd2a5de9f2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:01.866951 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc6caf50-6333-4fe4-9a20-6bf5ac52ff22 None None] Network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:19:01.950002 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e5ee25a-a26a-4dfa-8622-28dd2a5de9f2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:02.042221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e5ee25a-a26a-4dfa-8622-28dd2a5de9f2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2c6ef05c-5190-47b2-bba9-0d2bdacd727d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:02.049644 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e5ee25a-a26a-4dfa-8622-28dd2a5de9f2 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:02.059748 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3e5ee25a-a26a-4dfa-8622-28dd2a5de9f2 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/2c6ef05c-5190-47b2-bba9-0d2bdacd727d HTTP/1.1" status: 204 len: 168 time: 0.5946383 May 12 15:19:02.062557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59658) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:02.180508 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:02.183958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ac396d7c-beb5-4330-b7a7-f4c734f45df7 None None] Provisioning for port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:02.206388 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ac396d7c-beb5-4330-b7a7-f4c734f45df7 None None] Provisioning complete for port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:02.206970 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ac396d7c-beb5-4330-b7a7-f4c734f45df7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:02.259634 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e829412-17bb-4763-99ed-7eb6f8636bfe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:02.440602 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:02.444778 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-a9168ac8-f37a-48b5-9217-799b95e752c9 service neutron] 10.222.0.82 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.2844059 May 12 15:19:02.459994 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:02.642166 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e829412-17bb-4763-99ed-7eb6f8636bfe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:02.707957 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-3e829412-17bb-4763-99ed-7eb6f8636bfe admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c3c7ba99-d7de-4515-b784-ef9ce8b08726']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:02.744501 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ac396d7c-beb5-4330-b7a7-f4c734f45df7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:02.781721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-3e829412-17bb-4763-99ed-7eb6f8636bfe admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '75265c81-b0a3-4707-85cf-250efb72702a') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:02.782018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-3e829412-17bb-4763-99ed-7eb6f8636bfe admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '75265c81-b0a3-4707-85cf-250efb72702a') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:02.803880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event updated for resources: {'Port': ['ID=1ebc52d1-efdd-4a8c-aeeb-ceb652fdbc23,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:02.825185 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e829412-17bb-4763-99ed-7eb6f8636bfe admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:02.868860 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e829412-17bb-4763-99ed-7eb6f8636bfe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:02.869073 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ac396d7c-beb5-4330-b7a7-f4c734f45df7 None None] For port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7ec1c0e6-e3cc-4075-87ff-0216985d1d2b,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:02.876780 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ac396d7c-beb5-4330-b7a7-f4c734f45df7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:02.882407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3e829412-17bb-4763-99ed-7eb6f8636bfe admin admin] Releasing vlan 587 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:19:02.883072 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e829412-17bb-4763-99ed-7eb6f8636bfe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: timer() May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:19:02.962813 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:19:03.004079 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:03.198901 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac396d7c-beb5-4330-b7a7-f4c734f45df7 None None] Pushing event updated for resources: {'Port': ['ID=7ec1c0e6-e3cc-4075-87ff-0216985d1d2b,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:03.247775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c793e091-a75f-4f25-82dd-6ba69318a37d None None] Provisioning complete for port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:03.248123 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c793e091-a75f-4f25-82dd-6ba69318a37d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:03.291526 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ade70157-22b5-4b28-b87b-7e41b0eb40c5 req-f9754f28-f04f-4d6a-986d-b5dd1a205f7d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=a666a664b8e246d0aa19ae71604a8be8&device_id=9f126623-0718-483a-8852-efb8350ac373 HTTP/1.1" status: 200 len: 210 time: 0.0737684 May 12 15:19:03.357985 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ade70157-22b5-4b28-b87b-7e41b0eb40c5 req-ebe4f3a1-03d4-422a-b30f-be502184fec0 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=a666a664b8e246d0aa19ae71604a8be8&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0481398 May 12 15:19:03.360654 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e829412-17bb-4763-99ed-7eb6f8636bfe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:03.483709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e829412-17bb-4763-99ed-7eb6f8636bfe admin admin] Pushing event deleted for resources: {'Network': ['ID=c3c7ba99-d7de-4515-b784-ef9ce8b08726,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:03.487203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e829412-17bb-4763-99ed-7eb6f8636bfe admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:03.641646 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3e829412-17bb-4763-99ed-7eb6f8636bfe admin admin] 10.222.0.82 "DELETE /v2.0/networks/c3c7ba99-d7de-4515-b784-ef9ce8b08726 HTTP/1.1" status: 204 len: 168 time: 1.5760090 May 12 15:19:03.665664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-54b4ec51-b399-402c-8cdd-2d56bede8768 admin admin] Deleting port 60462079-9a62-4718-a485-d1d0aa343c39 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:03.667373 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54b4ec51-b399-402c-8cdd-2d56bede8768 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:03.721246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-79f78171-e763-487f-bac1-bc3946b06b5e req-aa49e524-16dc-4dd9-8826-aace9e414fcd tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f126623-0718-483a-8852-efb8350ac373 HTTP/1.1" status: 200 len: 210 time: 0.3954520 May 12 15:19:03.741251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Network 674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:03.863261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ade70157-22b5-4b28-b87b-7e41b0eb40c5 req-a5572559-cde6-4f09-8b80-392f376f5477 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:03.866563 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ade70157-22b5-4b28-b87b-7e41b0eb40c5 req-a5572559-cde6-4f09-8b80-392f376f5477 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4417114 May 12 15:19:03.917979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59726) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:03.986777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:04.050970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5568668d-1342-45d6-91dc-d27f5f2b9360 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7d73e66034f94885ae45429129883002&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1314142 May 12 15:19:04.054224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59732) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:04.145579 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3bcfbb9-38bc-4a7f-973f-b3435f31853f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:04.178820 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3bcfbb9-38bc-4a7f-973f-b3435f31853f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:04.252914 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3bcfbb9-38bc-4a7f-973f-b3435f31853f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:04.290942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3bcfbb9-38bc-4a7f-973f-b3435f31853f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cac695a8-4e75-4439-8978-1a574d6875af,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:04.351389 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3bcfbb9-38bc-4a7f-973f-b3435f31853f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:04.357939 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e3bcfbb9-38bc-4a7f-973f-b3435f31853f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cac695a8-4e75-4439-8978-1a574d6875af HTTP/1.1" status: 204 len: 168 time: 0.3015611 May 12 15:19:04.389122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-54b4ec51-b399-402c-8cdd-2d56bede8768 admin admin] For port 60462079-9a62-4718-a485-d1d0aa343c39, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=60462079-9a62-4718-a485-d1d0aa343c39,segment=NetworkSegment(a64e84dc-d91c-44e1-ab35-6c9b54a1b65b),segment_id=a64e84dc-d91c-44e1-ab35-6c9b54a1b65b)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:04.389540 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54b4ec51-b399-402c-8cdd-2d56bede8768 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:04.405286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-512f78f1-35a0-411f-b16d-f8f98608d5d5 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:04.411410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d38a4c3d-4916-431c-afeb-547eac07ed6b None None] Provisioning complete for port 1ebc52d1-efdd-4a8c-aeeb-ceb652fdbc23 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:04.412789 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d38a4c3d-4916-431c-afeb-547eac07ed6b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:04.414758 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-512f78f1-35a0-411f-b16d-f8f98608d5d5 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/networks?id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d HTTP/1.1" status: 200 len: 816 time: 1.0737748 May 12 15:19:04.499916 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d38a4c3d-4916-431c-afeb-547eac07ed6b None None] Port 1ebc52d1-efdd-4a8c-aeeb-ceb652fdbc23 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:19:04.762066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-c8184254-4f6f-41fe-b134-e4dbb5c9cc84 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:04.770516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-c8184254-4f6f-41fe-b134-e4dbb5c9cc84 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Synchronizing usage tracker for tenant:07c1472fa162425e9303d95e5e843c64 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:04.805431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-c8184254-4f6f-41fe-b134-e4dbb5c9cc84 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Unset dirty status for tenant:07c1472fa162425e9303d95e5e843c64 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:04.807203 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-c8184254-4f6f-41fe-b134-e4dbb5c9cc84 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.76 "GET /v2.0/networks?id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d HTTP/1.1" status: 200 len: 816 time: 0.3707683 May 12 15:19:04.821002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Request body: {'port': {'device_id': 'dddc3497-3d22-480f-bded-055cda976c60', 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d', 'admin_state_up': True, 'tenant_id': '07c1472fa162425e9303d95e5e843c64'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:04.822365 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-80fd4362-28cb-48f0-ba02-e2d2904c2f06 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/quotas/07c1472fa162425e9303d95e5e843c64 HTTP/1.1" status: 200 len: 375 time: 0.4066260 May 12 15:19:04.830431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-54b4ec51-b399-402c-8cdd-2d56bede8768 admin admin] Calling delete_port for 60462079-9a62-4718-a485-d1d0aa343c39 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:04.884002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:04.966095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Router de2b1b2a-3800-4013-9a65-05bad4650925 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:19:05.020021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:05.033037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Usage tracker for resource:port and tenant:07c1472fa162425e9303d95e5e843c64 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:05.040525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:05.048041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:05.085987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Made reservation on behalf of 07c1472fa162425e9303d95e5e843c64 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:05.093869 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:05.163267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:05.163267 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:05.300287 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-76ea328f-c844-40fb-af71-dfd75e8b429e service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 658 time: 0.1861980 May 12 15:19:05.321442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:19:05.340418 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22d26362-56e7-4901-9d07-12df4378cb54 req-bfbd9867-2220-41ae-87ad-4134fd714ecd tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f126623-0718-483a-8852-efb8350ac373 HTTP/1.1" status: 200 len: 210 time: 0.3671851 May 12 15:19:05.369658 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8b2f5547-a7fb-4823-8cef-49ae9477f56f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "PUT /v2.0/routers/de2b1b2a-3800-4013-9a65-05bad4650925/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.6531134 May 12 15:19:05.376114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59782) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:05.408877 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-ca1d7947-c9cb-48f7-ad07-5e3da673fe6d tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=07c1472fa162425e9303d95e5e843c64&fields=id HTTP/1.1" status: 200 len: 255 time: 0.5856113 May 12 15:19:05.475847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-429d88ed-1d7d-429e-8bcb-edda75236dc7 None None] Sync routers for ids ['de2b1b2a-3800-4013-9a65-05bad4650925'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:19:05.486940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-429d88ed-1d7d-429e-8bcb-edda75236dc7 None None] Routers {'de2b1b2a-3800-4013-9a65-05bad4650925'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:19:05.487561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-429d88ed-1d7d-429e-8bcb-edda75236dc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:18:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['de2b1b2a-3800-4013-9a65-05bad4650925'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:05.524769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Request body: {'port': {'network_id': '674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3', 'name': 'tempest-FloatingIPNegativeTestJSON-213598777'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:05.554815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Allocated IP 172.20.0.11 (0ff32f81-3ca6-41e0-8986-06dbed4ab52d/34e2be1a-2cbe-4227-a0bf-50d20740aa45/2a00c7fc-ced7-44c0-b374-110741ae6468) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:05.566204 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-0bbb168a-8922-465e-b79d-31ec8bca6d9f service neutron] 10.222.0.82 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1560416 May 12 15:19:05.571988 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ade70157-22b5-4b28-b87b-7e41b0eb40c5 req-b119a0e0-75bd-4c62-99a1-cb15c58642e6 tempest-ServerShowV247Test-195429932 tempest-ServerShowV247Test-195429932-project] 10.222.0.84 "GET /v2.0/ports?device_id=9f126623-0718-483a-8852-efb8350ac373 HTTP/1.1" status: 200 len: 210 time: 0.1938567 May 12 15:19:05.579079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-429d88ed-1d7d-429e-8bcb-edda75236dc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:05.626137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-429d88ed-1d7d-429e-8bcb-edda75236dc7 None None] Routers {'de2b1b2a-3800-4013-9a65-05bad4650925'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:19:05.627109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-429d88ed-1d7d-429e-8bcb-edda75236dc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:18:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['de2b1b2a-3800-4013-9a65-05bad4650925'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:05.800889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-429d88ed-1d7d-429e-8bcb-edda75236dc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:05.801210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-429d88ed-1d7d-429e-8bcb-edda75236dc7 None None] The sync data for ids ['de2b1b2a-3800-4013-9a65-05bad4650925'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:19:05.802051 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-7246b420-c543-4930-9b49-eb530add9608 service neutron] 10.222.0.82 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2342713 May 12 15:19:05.884313 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54b4ec51-b399-402c-8cdd-2d56bede8768 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:05.996872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b4ec51-b399-402c-8cdd-2d56bede8768 admin admin] Pushing event deleted for resources: {'Port': ['ID=60462079-9a62-4718-a485-d1d0aa343c39,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:06.014196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-bef3d798-3221-43ea-aa01-008b1ec2a308 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:06.014833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-bef3d798-3221-43ea-aa01-008b1ec2a308 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:06.015962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-bef3d798-3221-43ea-aa01-008b1ec2a308 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:06.016434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-bef3d798-3221-43ea-aa01-008b1ec2a308 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:06.016925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-bef3d798-3221-43ea-aa01-008b1ec2a308 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:06.017606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-bef3d798-3221-43ea-aa01-008b1ec2a308 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:06.018067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-bef3d798-3221-43ea-aa01-008b1ec2a308 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:06.036120 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-bef3d798-3221-43ea-aa01-008b1ec2a308 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=42581a8af83242e0bb61f84a30bd27a7&device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 6490 time: 0.5952795 May 12 15:19:06.390558 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:06.429025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:06.590363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Usage tracker for resource:port and tenant:97c1bf81263543a888f23243db1936dd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:06.619340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:06.648703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54b4ec51-b399-402c-8cdd-2d56bede8768 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:06.692119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:06.710442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Transition to ACTIVE for port object 2a00c7fc-ced7-44c0-b374-110741ae6468 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:06.733168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Made reservation on behalf of 97c1bf81263543a888f23243db1936dd for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:06.743462 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:06.853320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] device_id is not set on port 505241b0-19ae-4efc-a8a0-2ea513dcd94c yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:19:06.890312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-6ca827ce-2129-418e-8d7a-eb7f91ae3e2f tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=51555c8decb74fe7a10ce69cc90bf9e8&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0534353 May 12 15:19:07.029746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Allocated IP 172.20.0.9 (674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3/47a3363b-4cb0-42be-951a-7f0b619f2d69/505241b0-19ae-4efc-a8a0-2ea513dcd94c) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:07.204011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-ab2ecd8f-6b7c-4351-9f95-84ef1b3cfb7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:07.204762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-ab2ecd8f-6b7c-4351-9f95-84ef1b3cfb7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:07.204762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-ab2ecd8f-6b7c-4351-9f95-84ef1b3cfb7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:07.206409 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-ab2ecd8f-6b7c-4351-9f95-84ef1b3cfb7d service neutron] 10.222.0.84 "GET /v2.0/networks?id=939fdac4-3043-4213-bd31-a421a6c659bc&id=e6a7ff8f-d7ef-4614-8958-ef6026371726&id=e6a7ff8f-d7ef-4614-8958-ef6026371726&id=e6a7ff8f-d7ef-4614-8958-ef6026371726&id=e6a7ff8f-d7ef-4614-8958-ef6026371726&id=c5f75c23-a033-42fa-b7cd-dcbda413fa9a&id=c5f75c23-a033-42fa-b7cd-dcbda413fa9a HTTP/1.1" status: 200 len: 2293 time: 1.1318443 May 12 15:19:07.485641 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:07.515657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59902) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:07.562520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59906) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:07.662428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-54b4ec51-b399-402c-8cdd-2d56bede8768 admin admin] Router be64a9da-126d-4279-98a4-e0a9cc891b26 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:19:07.669414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-70b6691a-aa6f-4bd9-b550-8a7ae11c72c7 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:07.671178 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-70b6691a-aa6f-4bd9-b550-8a7ae11c72c7 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/networks?id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d HTTP/1.1" status: 200 len: 816 time: 0.4363322 May 12 15:19:07.671768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Pushing event updated for resources: {'Port': ['ID=2a00c7fc-ced7-44c0-b374-110741ae6468,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:07.699941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-89c03b6e-4faa-4301-81d9-f7189fbea950 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/quotas/07c1472fa162425e9303d95e5e843c64 HTTP/1.1" status: 200 len: 375 time: 0.0166464 May 12 15:19:07.706603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:07.710776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-39f9d652-e880-45e1-87c9-fd2968ff8e58 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:07.712468 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-39f9d652-e880-45e1-87c9-fd2968ff8e58 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.8122752 May 12 15:19:07.721970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-5e8cf737-8333-4a8a-b5ec-c29a5ac6cd1d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=026a86ba-df92-4de2-9f16-6e6b8794d1df HTTP/1.1" status: 200 len: 1000 time: 0.5033555 May 12 15:19:07.723321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:07.744758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:07.888613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-56261d3f-7015-46a6-b0d7-50b97a0887a7 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/quotas/51555c8decb74fe7a10ce69cc90bf9e8 HTTP/1.1" status: 200 len: 375 time: 0.0618820 May 12 15:19:07.904971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:07.928786 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aff867d3-631b-477e-aca3-6da7d6afe665 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:07.937261 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a581556f-1517-4d81-8571-3ff486bb39d1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:07.978534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Transition to ACTIVE for port object 505241b0-19ae-4efc-a8a0-2ea513dcd94c will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:07.981822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-aff867d3-631b-477e-aca3-6da7d6afe665 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:07.996886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:07.997532 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:08.002723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-aff867d3-631b-477e-aca3-6da7d6afe665 admin admin] Usage tracker for resource:security_group_rule and tenant:5588c3c9f87748468e5cf5a582aabcbd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:08.007825 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-73d76c09-ef1b-4907-8de5-aeb86fddb58d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:08.009262 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-73d76c09-ef1b-4907-8de5-aeb86fddb58d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c7af977d-fe6b-4182-af40-d4c2523b54a3 HTTP/1.1" status: 200 len: 851 time: 0.2064033 May 12 15:19:08.010090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-aff867d3-631b-477e-aca3-6da7d6afe665 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:08.014088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a581556f-1517-4d81-8571-3ff486bb39d1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:08.031965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-aff867d3-631b-477e-aca3-6da7d6afe665 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:08.035939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a581556f-1517-4d81-8571-3ff486bb39d1 admin admin] Usage tracker for resource:security_group_rule and tenant:a666a664b8e246d0aa19ae71604a8be8 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:08.071275 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-cff7fd7c-c1ac-4b53-8954-1cd1ac59244c tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=51555c8decb74fe7a10ce69cc90bf9e8&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1687419 May 12 15:19:08.071840 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a581556f-1517-4d81-8571-3ff486bb39d1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:08.088127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a581556f-1517-4d81-8571-3ff486bb39d1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:08.103114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ef00adc1-6f33-4216-b075-334eb868a3eb tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=07c1472fa162425e9303d95e5e843c64&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3876562 May 12 15:19:08.123220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-54b4ec51-b399-402c-8cdd-2d56bede8768 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:19:08.130950 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-fc99d299-fa03-4832-8d29-dc600037d5f2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.3139329 May 12 15:19:08.142409 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9f86e7c-4404-4437-a095-f0e420657735 None None] Sync routers for ids ['be64a9da-126d-4279-98a4-e0a9cc891b26'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:19:08.158535 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9f86e7c-4404-4437-a095-f0e420657735 None None] Routers {'be64a9da-126d-4279-98a4-e0a9cc891b26'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:19:08.159749 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f9f86e7c-4404-4437-a095-f0e420657735 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:18:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['be64a9da-126d-4279-98a4-e0a9cc891b26'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:08.196001 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0de7cb00-eee4-4509-9400-67db8d553519 None None] Provisioning for port 2a00c7fc-ced7-44c0-b374-110741ae6468 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:08.205446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0de7cb00-eee4-4509-9400-67db8d553519 None None] Provisioning complete for port 2a00c7fc-ced7-44c0-b374-110741ae6468 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:08.205897 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0de7cb00-eee4-4509-9400-67db8d553519 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:08.303442 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-54b4ec51-b399-402c-8cdd-2d56bede8768 admin admin] 10.222.0.82 "PUT /v2.0/routers/be64a9da-126d-4279-98a4-e0a9cc891b26/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 11.9163992 May 12 15:19:08.304911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59938) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:08.338698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0de7cb00-eee4-4509-9400-67db8d553519 None None] Port 2a00c7fc-ced7-44c0-b374-110741ae6468 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:19:08.365963 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a581556f-1517-4d81-8571-3ff486bb39d1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:08.371922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Request body: {'port': {'device_id': 'dddc3497-3d22-480f-bded-055cda976c60', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:08.552780 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-f9f86e7c-4404-4437-a095-f0e420657735 None None] Set router be64a9da-126d-4279-98a4-e0a9cc891b26 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:19:08.785437 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:08.788053 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a581556f-1517-4d81-8571-3ff486bb39d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:08.870524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Network 674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:08.873841 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aff867d3-631b-477e-aca3-6da7d6afe665 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:08.893807 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-300fd7d1-e5bf-4ccf-bcf3-25aa336eb466 service neutron] 10.222.0.82 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7886999 May 12 15:19:08.897967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:08.905694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:08.966661 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f9f86e7c-4404-4437-a095-f0e420657735 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:19:05Z', 'revision_number': 5, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:08.974685 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9f86e7c-4404-4437-a095-f0e420657735 None None] Checking router: be64a9da-126d-4279-98a4-e0a9cc891b26 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:19:08.987732 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9f86e7c-4404-4437-a095-f0e420657735 None None] Routers {'be64a9da-126d-4279-98a4-e0a9cc891b26'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:19:08.988411 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f9f86e7c-4404-4437-a095-f0e420657735 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:18:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['be64a9da-126d-4279-98a4-e0a9cc891b26'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:09.008054 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aff867d3-631b-477e-aca3-6da7d6afe665 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:09.082347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-475d0b59-f6b5-47b7-97e2-5ead23302c1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:09.084822 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-475d0b59-f6b5-47b7-97e2-5ead23302c1e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=939fdac4-3043-4213-bd31-a421a6c659bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 1.0576313 May 12 15:19:09.118443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3abc477a-2a04-4d15-b704-820b19e5e82b req-ae3c8af2-3129-49fa-b66c-0174fde5db34 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 210 time: 0.6727810 May 12 15:19:09.142381 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:09.156187 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a581556f-1517-4d81-8571-3ff486bb39d1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a666a664b8e246d0aa19ae71604a8be8&name=default HTTP/1.1" status: 200 len: 2983 time: 1.6270549 May 12 15:19:09.232636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59980) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:09.314794 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:09.335775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a581556f-1517-4d81-8571-3ff486bb39d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aab937f6-8798-4509-9dfb-72228d989ba6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:09.394571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f02e7f42-c006-4849-82c1-b87e1ff348da None None] Provisioning for port 505241b0-19ae-4efc-a8a0-2ea513dcd94c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:09.402910 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-f9f86e7c-4404-4437-a095-f0e420657735 None None] Set router be64a9da-126d-4279-98a4-e0a9cc891b26 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:19:09.404290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f02e7f42-c006-4849-82c1-b87e1ff348da None None] Provisioning complete for port 505241b0-19ae-4efc-a8a0-2ea513dcd94c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:09.404793 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f02e7f42-c006-4849-82c1-b87e1ff348da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:09.416266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event updated for resources: {'Port': ['ID=505241b0-19ae-4efc-a8a0-2ea513dcd94c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:09.469573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:09.470194 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:09.484473 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aff867d3-631b-477e-aca3-6da7d6afe665 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5588c3c9f87748468e5cf5a582aabcbd&name=default HTTP/1.1" status: 200 len: 2983 time: 1.9032040 May 12 15:19:09.530425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59996) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:09.583660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f02e7f42-c006-4849-82c1-b87e1ff348da None None] Port 505241b0-19ae-4efc-a8a0-2ea513dcd94c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:19:09.608929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aff867d3-631b-477e-aca3-6da7d6afe665 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=65e812f6-9ae3-4ba1-81e0-132e439318f2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:09.626400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-473fc08a-1bb5-4666-b10d-8d697caf3dd7 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:09.627916 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-473fc08a-1bb5-4666-b10d-8d697caf3dd7 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.84 "GET /v2.0/networks?id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d HTTP/1.1" status: 200 len: 816 time: 1.5030549 May 12 15:19:09.630694 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-b3f7e877-eda2-48d6-a8ec-b2c062d47079 service neutron] 10.222.0.84 "GET /v2.0/networks/939fdac4-3043-4213-bd31-a421a6c659bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5118940 May 12 15:19:09.664678 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b315d2b1-9553-4759-b7be-100e6a203e3c tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 4.2854362 May 12 15:19:09.681311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60006) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:09.687800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Request body: {'port': {'device_id': '91efc3d2-c9e0-4867-98a8-80db504551ad', 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d', 'admin_state_up': True, 'tenant_id': '07c1472fa162425e9303d95e5e843c64'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:09.805323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:09.856533 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4fd2aa2a-8309-4385-90aa-ab72fd61982b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:09.890466 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f9f86e7c-4404-4437-a095-f0e420657735 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:19:05Z', 'revision_number': 5, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:09.895953 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9f86e7c-4404-4437-a095-f0e420657735 None None] The sync data for ids ['be64a9da-126d-4279-98a4-e0a9cc891b26'] in n-d-841483-1 is: [{'id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'name': 'tempest-TaggedBootDevicesTest_v242-1696652975-router', 'tenant_id': '05b4f1ce61294fb29efb0a765ed28561', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4'}], 'enable_snat': True}, 'gw_port_id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:11:40Z', 'updated_at': '2022-05-12T15:19:05Z', 'revision_number': 5, 'project_id': '05b4f1ce61294fb29efb0a765ed28561', 'gw_port': {'id': 'a9fcd520-c18d-4516-9fc0-3db76c87dad6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:64:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be64a9da-126d-4279-98a4-e0a9cc891b26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 844, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:11:43Z', 'updated_at': '2022-05-12T15:11:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:19:09.896923 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-6e325286-ac93-4a40-aa81-7f50b23ce7dc service neutron] 10.222.0.82 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9805222 May 12 15:19:09.932581 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:09.946450 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4fd2aa2a-8309-4385-90aa-ab72fd61982b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:09.960414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] Deleting port a9fcd520-c18d-4516-9fc0-3db76c87dad6 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:09.962660 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:10.175587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:10.203369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Usage tracker for resource:floatingip and tenant:97c1bf81263543a888f23243db1936dd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:10.214216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:10.253598 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:10.288254 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-b36d0410-bf79-40d1-89fb-aa64d48aee67 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=51555c8decb74fe7a10ce69cc90bf9e8&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0466182 May 12 15:19:10.591141 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:10.611621 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7b2b4ec5-d5f1-4a65-a908-57f112c7ece4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:10.612949 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-379577ed-2972-44f6-8448-16f9e7fb968b req-e147289b-6755-4988-9ca1-f7a97c4f7740 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 210 time: 0.3770790 May 12 15:19:10.688170 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4fd2aa2a-8309-4385-90aa-ab72fd61982b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:10.701256 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14fc2a64-3619-426a-bcd7-451e27278985 req-fda5f0fd-8b83-44ac-9bb4-244837eac6f0 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 210 time: 0.1958728 May 12 15:19:10.758726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fd2aa2a-8309-4385-90aa-ab72fd61982b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aab937f6-8798-4509-9dfb-72228d989ba6,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:10.773281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 60462079-9a62-4718-a485-d1d0aa343c39 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:19:10.798749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] For port a9fcd520-c18d-4516-9fc0-3db76c87dad6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a9fcd520-c18d-4516-9fc0-3db76c87dad6,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:10.799103 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:10.835991 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7b2b4ec5-d5f1-4a65-a908-57f112c7ece4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:10.836539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 60462079-9a62-4718-a485-d1d0aa343c39 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:19:10.836673 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4fd2aa2a-8309-4385-90aa-ab72fd61982b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:10.836918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 60462079-9a62-4718-a485-d1d0aa343c39 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:19:10.838828 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4fd2aa2a-8309-4385-90aa-ab72fd61982b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/aab937f6-8798-4509-9dfb-72228d989ba6 HTTP/1.1" status: 204 len: 168 time: 1.6039479 May 12 15:19:10.866413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:10.885450 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-526827bf-b110-4d75-8b60-a5714d260ea5 service neutron] 10.222.0.84 "GET /v2.0/networks/939fdac4-3043-4213-bd31-a421a6c659bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.2183335 May 12 15:19:10.887099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Usage tracker for resource:port and tenant:07c1472fa162425e9303d95e5e843c64 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:10.894276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:10.991051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:11.024837 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-8aabbb9a-db2e-4cbc-892d-58345bd655c8 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.199&port_id=ef28df6f-7573-4910-9fae-c2b49092303b HTTP/1.1" status: 200 len: 217 time: 0.1044557 May 12 15:19:11.045287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] Calling delete_port for a9fcd520-c18d-4516-9fc0-3db76c87dad6 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:11.086231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Made reservation on behalf of 07c1472fa162425e9303d95e5e843c64 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:11.089710 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:11.151339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-66aae4da-8cd4-4daf-8cee-19719520d26a tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:11.155421 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-66aae4da-8cd4-4daf-8cee-19719520d26a tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.8652050 May 12 15:19:11.170645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Request body: {'port': {'device_id': '83974c4d-f657-4217-bb7b-39254f34c4f9', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '51555c8decb74fe7a10ce69cc90bf9e8'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:11.363090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2a00c7fc-ced7-44c0-b374-110741ae6468 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:19:11.406269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:11.439985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:11.445225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Usage tracker for resource:port and tenant:51555c8decb74fe7a10ce69cc90bf9e8 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:11.446808 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7b2b4ec5-d5f1-4a65-a908-57f112c7ece4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:11.448726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:11.454538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:11.489229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-d564dad1-f51a-4b4c-b0b2-cdec673c92c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:11.492762 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-d564dad1-f51a-4b4c-b0b2-cdec673c92c9 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=722dd775-53fe-4359-9d8f-d74143e5ced9 HTTP/1.1" status: 200 len: 797 time: 0.4613037 May 12 15:19:11.499541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Made reservation on behalf of 51555c8decb74fe7a10ce69cc90bf9e8 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:11.503518 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:11.511649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b2b4ec5-d5f1-4a65-a908-57f112c7ece4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=65e812f6-9ae3-4ba1-81e0-132e439318f2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:11.521466 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:11.545034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:11.548862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Usage tracker for resource:security_group_rule and tenant:51555c8decb74fe7a10ce69cc90bf9e8 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:11.551716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:11.559364 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:11.605574 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:11.607033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Transition to ACTIVE for port object 2a00c7fc-ced7-44c0-b374-110741ae6468 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:11.614485 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7b2b4ec5-d5f1-4a65-a908-57f112c7ece4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:11.618675 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7b2b4ec5-d5f1-4a65-a908-57f112c7ece4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/65e812f6-9ae3-4ba1-81e0-132e439318f2 HTTP/1.1" status: 204 len: 168 time: 2.0872164 May 12 15:19:11.624511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:11.664692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] Pushing event deleted for resources: {'Port': ['ID=a9fcd520-c18d-4516-9fc0-3db76c87dad6,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:11.671840 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:11.795810 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:11.954736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Pushing event updated for resources: {'Port': ['ID=2a00c7fc-ced7-44c0-b374-110741ae6468,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:12.200128 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:12.202608 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:12.204976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60154) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:12.259926 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:12.260451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] Fanout notify agent at l3_agent the message router_deleted on router be64a9da-126d-4279-98a4-e0a9cc891b26 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:19:12.368878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-569df8c7-214b-44e9-9616-500dfa34458d req-023f30ca-e8da-4ef9-90c0-cbca401ad334 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 210 time: 0.1064529 May 12 15:19:12.369612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60164) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:12.379068 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad966628-ec7e-4008-8652-4c9575846f32 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:12.388805 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:12.409487 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:12.482657 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:12.484436 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b877f073-d9cf-427b-8f76-5d372693dd27 admin admin] 10.222.0.82 "DELETE /v2.0/routers/be64a9da-126d-4279-98a4-e0a9cc891b26 HTTP/1.1" status: 204 len: 168 time: 4.1785944 May 12 15:19:12.489067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60170) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:12.590969 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-9c32bea7-66bf-4aa2-8fe5-5d1713e0a8bb admin admin] Deleting subnet 4ecb64d7-7b16-437b-8f3e-4996d58043f6 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:19:12.594390 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c32bea7-66bf-4aa2-8fe5-5d1713e0a8bb admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:12.618489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Allocated IP 172.20.0.9 (0ff32f81-3ca6-41e0-8986-06dbed4ab52d/34e2be1a-2cbe-4227-a0bf-50d20740aa45/e795cd0b-ae34-4489-9acc-774faf0d6935) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:12.638415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ad966628-ec7e-4008-8652-4c9575846f32 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:12.646462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-64d7c2fb-6734-4fd0-8687-738d05b2aabe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:12.648696 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-64d7c2fb-6734-4fd0-8687-738d05b2aabe service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e6a7ff8f-d7ef-4614-8958-ef6026371726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 1.1453664 May 12 15:19:12.649778 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d245bde2-4db6-4696-b289-1003478506da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:12.671398 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestMultiTenantJSON-2115621494-network', 'tenant_id': 'f304b3ab44174793b8f251ca5bae6bc1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:12.673346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ad966628-ec7e-4008-8652-4c9575846f32 admin admin] Usage tracker for resource:security_group_rule and tenant:38b650b54f274b84ae6cdb03958133da is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:12.676688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:12.681899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Usage tracker for resource:network and tenant:f304b3ab44174793b8f251ca5bae6bc1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:12.686381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:12.691076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ad966628-ec7e-4008-8652-4c9575846f32 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:12.750924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:12.755006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b7d21fce-afb7-42cc-82c4-78d280cb5d2d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:12.759545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ad966628-ec7e-4008-8652-4c9575846f32 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:12.770146 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c32bea7-66bf-4aa2-8fe5-5d1713e0a8bb admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:12.793133 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:12.818097 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a030e078-1a44-44f8-99fc-4cffd10e36c3 req-b91b896f-f118-4577-9439-64184dd5883c tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 210 time: 0.5784459 May 12 15:19:12.912567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Made reservation on behalf of f304b3ab44174793b8f251ca5bae6bc1 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:12.915787 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:12.960499 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:12.987983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a9fcd520-c18d-4516-9fc0-3db76c87dad6 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:19:13.006547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Allocated IP 192.168.233.61 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/42e13906-c0fd-470d-885c-c2d2c7e2cbfd) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:13.025310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:13.041234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Usage tracker for resource:security_group_rule and tenant:f304b3ab44174793b8f251ca5bae6bc1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:13.055385 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: a9fcd520-c18d-4516-9fc0-3db76c87dad6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:19:13.055715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a9fcd520-c18d-4516-9fc0-3db76c87dad6 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:19:13.058747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:13.076944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:13.148761 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c32bea7-66bf-4aa2-8fe5-5d1713e0a8bb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:13.212995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Allocated IP 172.25.8.141 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/5f39e22f-c5d0-45ac-af8c-e3be19b01d0c) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:13.234453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Attempting to bind port 2a00c7fc-ced7-44c0-b374-110741ae6468 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:13.235074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Attempting to bind port 2a00c7fc-ced7-44c0-b374-110741ae6468 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:13.235660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Attempting to bind port 2a00c7fc-ced7-44c0-b374-110741ae6468 on network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:13.256348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Port 2a00c7fc-ced7-44c0-b374-110741ae6468 on network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:13.256938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Attempting to bind port 2a00c7fc-ced7-44c0-b374-110741ae6468 on network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:13.269801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ae0cb4bd-e44a-40ba-9653-617963942e38 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:13.272159 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ae0cb4bd-e44a-40ba-9653-617963942e38 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.84 "GET /v2.0/networks?id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d HTTP/1.1" status: 200 len: 816 time: 1.0831692 May 12 15:19:13.283018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 19, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:19:13.283608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Checking segment: {'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:13.284151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Bound using segment: {'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:19:13.284796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Bound port: 2a00c7fc-ced7-44c0-b374-110741ae6468, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:19:13.285364 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:13.366051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Request body: {'port': {'device_id': '0ddbfd7d-b0df-4738-9d34-ea82ba255187', 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d', 'admin_state_up': True, 'tenant_id': '07c1472fa162425e9303d95e5e843c64'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:13.378225 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c32bea7-66bf-4aa2-8fe5-5d1713e0a8bb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:13.456808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c32bea7-66bf-4aa2-8fe5-5d1713e0a8bb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4ecb64d7-7b16-437b-8f3e-4996d58043f6,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:13.459472 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c32bea7-66bf-4aa2-8fe5-5d1713e0a8bb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:13.475622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f36d831-1d79-45ee-9133-3c342b38fdc1 None None] Network 13468259-dd20-42ac-88ec-2614ebea6ccc requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:19:13.496777 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9c32bea7-66bf-4aa2-8fe5-5d1713e0a8bb admin admin] 10.222.0.82 "DELETE /v2.0/subnets/4ecb64d7-7b16-437b-8f3e-4996d58043f6 HTTP/1.1" status: 204 len: 168 time: 1.0048687 May 12 15:19:13.501549 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:13.504192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60216) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:13.508908 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:13.532297 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:13.667929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Transition to ACTIVE for port object 42e13906-c0fd-470d-885c-c2d2c7e2cbfd will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:13.676251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 588} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:19:13.685894 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:13.686241 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Added segment 95b43f05-4421-4ae6-99ff-55a5c256ee01 of type vlan for network 5cc57423-d06b-48b4-8acf-9dcfbe4dc681 May 12 15:19:13.715376 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:13.790493 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ed71d24-e070-4d83-918f-bff53b1a69b1 req-bac4cb04-c26d-4cdf-b120-754493abfe71 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 210 time: 0.2311532 May 12 15:19:13.803569 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:13.805570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=32ee1ea1-656f-486b-9369-2586dedf1884,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:13.853133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:13.857536 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-044d9c83-d4ff-4fc1-9f00-37bc0e0d6b63 service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.1695969 May 12 15:19:13.880558 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:13.882225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:13.883712 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:13.909922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5ed01c9e-878b-4715-af45-ad4ca0d2e67c None None] DHCP port deletion for 13468259-dd20-42ac-88ec-2614ebea6ccc request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:19:13.915914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5ed01c9e-878b-4715-af45-ad4ca0d2e67c None None] Deleting port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:13.916283 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ed01c9e-878b-4715-af45-ad4ca0d2e67c None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:13.943964 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:13.996502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Usage tracker for resource:port and tenant:07c1472fa162425e9303d95e5e843c64 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:14.011058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:14.044812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:14.054573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:14.121247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:14.123551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:14.193934 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.8008513 May 12 15:19:14.200140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Deleting port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:14.200521 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:14.211441 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad966628-ec7e-4008-8652-4c9575846f32 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:14.225192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60254) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:14.237077 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5ed01c9e-878b-4715-af45-ad4ca0d2e67c None None] For port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6,segment=NetworkSegment(a64e84dc-d91c-44e1-ab35-6c9b54a1b65b),segment_id=a64e84dc-d91c-44e1-ab35-6c9b54a1b65b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:14.237589 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ed01c9e-878b-4715-af45-ad4ca0d2e67c None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:14.261697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Request body: {'subnet': {'network_id': '5cc57423-d06b-48b4-8acf-9dcfbe4dc681', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestMultiTenantJSON-2115621494-subnet', 'tenant_id': 'f304b3ab44174793b8f251ca5bae6bc1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:14.265837 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad966628-ec7e-4008-8652-4c9575846f32 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:14.288026 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c932361-8c07-4ac0-b3dc-8765d6942a38 admin admin] Pushing event updated for resources: {'Network': ['ID=5cc57423-d06b-48b4-8acf-9dcfbe4dc681,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:14.302456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Pushing event updated for resources: {'Port': ['ID=42e13906-c0fd-470d-885c-c2d2c7e2cbfd,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:14.332328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:14.346870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:14.347647 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:14.370470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Made reservation on behalf of 07c1472fa162425e9303d95e5e843c64 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:14.373951 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:14.448367 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-19b92cf8-20e2-4da3-8029-24cffd6564f4 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 3.2814939 May 12 15:19:14.466814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Request body: {'port': {'device_id': '83974c4d-f657-4217-bb7b-39254f34c4f9', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:14.467702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Usage tracker for resource:subnet and tenant:f304b3ab44174793b8f251ca5bae6bc1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:14.476096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5ed01c9e-878b-4715-af45-ad4ca0d2e67c None None] Calling delete_port for f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:14.493743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:14.522742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d462f63c-6fc7-43e4-95d9-c57d6ff873f0 req-b644f7e6-3aae-4b5d-9b39-188f69651034 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:14.523584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d462f63c-6fc7-43e4-95d9-c57d6ff873f0 req-b644f7e6-3aae-4b5d-9b39-188f69651034 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Synchronizing usage tracker for tenant:51555c8decb74fe7a10ce69cc90bf9e8 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:14.536714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 5cc57423-d06b-48b4-8acf-9dcfbe4dc681 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:19:14.569868 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:14.596423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:14.630545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] For port 2a00c7fc-ced7-44c0-b374-110741ae6468, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:19:14.642895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Made reservation on behalf of f304b3ab44174793b8f251ca5bae6bc1 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:14.646220 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:14.672415 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:14.675800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f4ba0432-ea76-4c8f-abad-6b1558d9a2cf None None] Provisioning for port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:14.682303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f4ba0432-ea76-4c8f-abad-6b1558d9a2cf None None] Provisioning complete for port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:14.682864 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f4ba0432-ea76-4c8f-abad-6b1558d9a2cf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:14.735456 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ed01c9e-878b-4715-af45-ad4ca0d2e67c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:14.753369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad966628-ec7e-4008-8652-4c9575846f32 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=671bcdee-ce07-42dd-b8b4-a09be34a8437,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:14.759226 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ad966628-ec7e-4008-8652-4c9575846f32 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=38b650b54f274b84ae6cdb03958133da&name=default HTTP/1.1" status: 200 len: 2983 time: 2.5491431 May 12 15:19:14.795454 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ed01c9e-878b-4715-af45-ad4ca0d2e67c None None] Pushing event deleted for resources: {'Port': ['ID=f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:14.803587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f4ba0432-ea76-4c8f-abad-6b1558d9a2cf None None] Port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:19:14.807038 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ed01c9e-878b-4715-af45-ad4ca0d2e67c None None] No DVR routers for this DVR port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:19:14.831128 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-40813fdc-f499-4b0c-95ea-b8b85282e59a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:14.862076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:19:14.884612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60282) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:14.904871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:19:14.905209 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:19:14.921349 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] For port 2a00c7fc-ced7-44c0-b374-110741ae6468, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2a00c7fc-ced7-44c0-b374-110741ae6468,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:19:14.926171 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-3649e02f-f58f-4262-bd88-3c4b6ab571b7 service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.0278871 May 12 15:19:14.950230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] For port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6,segment=NetworkSegment(a64e84dc-d91c-44e1-ab35-6c9b54a1b65b),segment_id=a64e84dc-d91c-44e1-ab35-6c9b54a1b65b)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:14.950591 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:14.962169 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:14.981776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Transition to ACTIVE for port object e795cd0b-ae34-4489-9acc-774faf0d6935 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:15.105189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Calling delete_port for f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:15.125987 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:15.130701 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-611faa34-24da-4a7c-9371-ba0cffd1f3b6 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.10&port_id=85b4d43d-f235-4852-bda9-2dc870bb3d11 HTTP/1.1" status: 200 len: 217 time: 0.1726751 May 12 15:19:15.140273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60292) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:15.150190 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d462f63c-6fc7-43e4-95d9-c57d6ff873f0 req-b644f7e6-3aae-4b5d-9b39-188f69651034 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Unset dirty status for tenant:51555c8decb74fe7a10ce69cc90bf9e8 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:15.151452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d462f63c-6fc7-43e4-95d9-c57d6ff873f0 req-b644f7e6-3aae-4b5d-9b39-188f69651034 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 935 time: 1.1157565 May 12 15:19:15.152245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:15.152857 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:15.154238 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-df4096c5-1158-4e59-9597-831924d56650 service neutron] 10.222.0.76 "PUT /v2.0/ports/2a00c7fc-ced7-44c0-b374-110741ae6468 HTTP/1.1" status: 200 len: 1092 time: 7.0113463 May 12 15:19:15.165925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dddc3497-3d22-480f-bded-055cda976c60', 'tag': '2a00c7fc-ced7-44c0-b374-110741ae6468'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:15.248185 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5da9642-42b6-432d-a761-ff4d364e82fc req-2c891034-35f4-49a0-8be5-45742dccd9ee tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 210 time: 0.1523051 May 12 15:19:15.252687 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:15.328531 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3f4bab12-6b6c-4479-9514-e40653c47c4c'] response: {'name': 'network-changed', 'server_uuid': 'dddc3497-3d22-480f-bded-055cda976c60', 'tag': '2a00c7fc-ced7-44c0-b374-110741ae6468', 'status': 'completed', 'code': 200} May 12 15:19:15.330298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:15.337710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:15.343752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:15.348263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d462f63c-6fc7-43e4-95d9-c57d6ff873f0 req-86c922dd-1a08-470a-ad79-2d6b9859469e tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Synchronizing usage tracker for tenant:51555c8decb74fe7a10ce69cc90bf9e8 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:15.403036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df4096c5-1158-4e59-9597-831924d56650 service neutron] Pushing event updated for resources: {'Port': ['ID=2a00c7fc-ced7-44c0-b374-110741ae6468,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:15.468698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d462f63c-6fc7-43e4-95d9-c57d6ff873f0 req-86c922dd-1a08-470a-ad79-2d6b9859469e tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Unset dirty status for tenant:51555c8decb74fe7a10ce69cc90bf9e8 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:15.470315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d462f63c-6fc7-43e4-95d9-c57d6ff873f0 req-86c922dd-1a08-470a-ad79-2d6b9859469e tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/security-groups?id=b7d21fce-afb7-42cc-82c4-78d280cb5d2d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2719197 May 12 15:19:15.472588 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:19:15.472982 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:19:15.553283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d110d77-2536-4322-af5f-cf4fd90375d1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:15.609562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-e4711706-cf21-46a2-8c66-6022b01aa9c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:15.611072 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-e4711706-cf21-46a2-8c66-6022b01aa9c9 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=722dd775-53fe-4359-9d8f-d74143e5ced9 HTTP/1.1" status: 200 len: 797 time: 0.4459503 May 12 15:19:15.611986 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:15.778816 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d2f6520-e9b2-455b-aa85-b45801d6e641 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:15.785312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 42e13906-c0fd-470d-885c-c2d2c7e2cbfd {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:19:15.793574 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:15.809843 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Transition to ACTIVE for port object 42e13906-c0fd-470d-885c-c2d2c7e2cbfd will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:15.813327 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:15.888123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event updated for resources: {'Port': ['ID=5f39e22f-c5d0-45ac-af8c-e3be19b01d0c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:15.898548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5d2f6520-e9b2-455b-aa85-b45801d6e641 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:15.958154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5d2f6520-e9b2-455b-aa85-b45801d6e641 admin admin] Usage tracker for resource:security_group_rule and tenant:095266932c8b47abbe47aca4b76516a3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:15.965047 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d110d77-2536-4322-af5f-cf4fd90375d1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:15.982410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Deleting port f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:15.982635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:15.982735 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:15.983457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5d2f6520-e9b2-455b-aa85-b45801d6e641 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:16.008597 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.019008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Pushing event updated for resources: {'Port': ['ID=42e13906-c0fd-470d-885c-c2d2c7e2cbfd,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:16.022991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:16.026582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5d2f6520-e9b2-455b-aa85-b45801d6e641 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:16.063937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:16.066013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] The port 'f74f8ded-b37b-4b5a-b53c-fc2ebcf826e6' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:19:16.107268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Allocated IP 172.20.0.3 (0ff32f81-3ca6-41e0-8986-06dbed4ab52d/34e2be1a-2cbe-4227-a0bf-50d20740aa45/466cb97c-6736-42bb-8e25-772f0b5535db) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:16.113495 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.192114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-d8257ed6-a8a3-4cad-9a7a-6035bb054bce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:16.193961 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-d8257ed6-a8a3-4cad-9a7a-6035bb054bce service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=07c1472fa162425e9303d95e5e843c64&device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 1095 time: 0.9674807 May 12 15:19:16.270509 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.282393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Pushing event updated for resources: {'Port': ['ID=e795cd0b-ae34-4489-9acc-774faf0d6935,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:16.289072 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.311151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Attempting to bind port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:16.311578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Attempting to bind port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:16.311947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Attempting to bind port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:16.319923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:16.320300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Attempting to bind port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:16.327070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['13468259-dd20-42ac-88ec-2614ebea6ccc']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:16.335505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 19, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:19:16.335840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:16.336234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:19:16.336668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Bound port: 42e13906-c0fd-470d-885c-c2d2c7e2cbfd, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:19:16.337478 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.357824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:16.358132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a64e84dc-d91c-44e1-ab35-6c9b54a1b65b') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:16.361539 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.366826 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-73608179-8fec-4e46-b4f9-ac56bf54daf0 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=2a00c7fc-ced7-44c0-b374-110741ae6468 HTTP/1.1" status: 200 len: 217 time: 0.1504669 May 12 15:19:16.392737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-97ba92a8-05c5-4d59-8aca-53d2fdcedd75 None None] Provisioning for port e795cd0b-ae34-4489-9acc-774faf0d6935 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:16.399996 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-97ba92a8-05c5-4d59-8aca-53d2fdcedd75 None None] Provisioning complete for port e795cd0b-ae34-4489-9acc-774faf0d6935 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:16.400363 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-97ba92a8-05c5-4d59-8aca-53d2fdcedd75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.412640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:16.413281 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.440797 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.493563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-97ba92a8-05c5-4d59-8aca-53d2fdcedd75 None None] Port e795cd0b-ae34-4489-9acc-774faf0d6935 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:19:16.519653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6d98704-8f0b-4aad-b6b8-794ef4c03bb3 req-cb785780-557d-4a4b-b815-825535599151 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 210 time: 0.0877390 May 12 15:19:16.537532 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.542855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Releasing vlan 584 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:19:16.543515 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: timer() May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:19:16.559725 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:19:16.605207 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d110d77-2536-4322-af5f-cf4fd90375d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.608833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-8f0b1dec-3f68-4488-9c02-10e5b29f6086 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:16.610319 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-8f0b1dec-3f68-4488-9c02-10e5b29f6086 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e6a7ff8f-d7ef-4614-8958-ef6026371726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.8077149 May 12 15:19:16.699474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] For port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:19:16.709257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] For port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=42e13906-c0fd-470d-885c-c2d2c7e2cbfd,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:19:16.712678 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.721113 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.754723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c687227b-891f-4ef3-8df3-ff7f6bcba26e,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:16.757108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d110d77-2536-4322-af5f-cf4fd90375d1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=671bcdee-ce07-42dd-b8b4-a09be34a8437,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:16.775645 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.825268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-c7a821d0-045a-4b3e-b79b-287875156bea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:16.826744 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-c7a821d0-045a-4b3e-b79b-287875156bea service neutron] 10.222.0.76 "GET /v2.0/subnets?id=34e2be1a-2cbe-4227-a0bf-50d20740aa45 HTTP/1.1" status: 200 len: 855 time: 0.4015160 May 12 15:19:16.854854 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.906167 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-a168560b-b583-4fd2-9575-acaac471ebf2 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 7.2367246 May 12 15:19:16.907193 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d110d77-2536-4322-af5f-cf4fd90375d1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.908199 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1d110d77-2536-4322-af5f-cf4fd90375d1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/671bcdee-ce07-42dd-b8b4-a09be34a8437 HTTP/1.1" status: 204 len: 168 time: 2.0219007 May 12 15:19:16.912269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] Pushing event deleted for resources: {'Network': ['ID=13468259-dd20-42ac-88ec-2614ebea6ccc,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:16.940087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:16.940711 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:16.942781 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] 10.222.0.76 "PUT /v2.0/ports/42e13906-c0fd-470d-885c-c2d2c7e2cbfd HTTP/1.1" status: 200 len: 1095 time: 2.4832423 May 12 15:19:16.946945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '83974c4d-f657-4217-bb7b-39254f34c4f9', 'tag': '42e13906-c0fd-470d-885c-c2d2c7e2cbfd'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:16.959171 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-28329f75-6ddf-4e3c-9dab-fa61546d4e05 admin admin] 10.222.0.82 "DELETE /v2.0/networks/13468259-dd20-42ac-88ec-2614ebea6ccc HTTP/1.1" status: 204 len: 168 time: 3.4504848 May 12 15:19:16.963215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60314) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:17.027001 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d2f6520-e9b2-455b-aa85-b45801d6e641 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:17.028668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Checking segment: {'id': '95b43f05-4421-4ae6-99ff-55a5c256ee01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '5cc57423-d06b-48b4-8acf-9dcfbe4dc681'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:17.029123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Network hostable DHCP agents. Network: 5cc57423-d06b-48b4-8acf-9dcfbe4dc681, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:19:17.054105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc903c31-1ecd-4e17-8fea-faec58fd0968 service neutron] Pushing event updated for resources: {'Port': ['ID=42e13906-c0fd-470d-885c-c2d2c7e2cbfd,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:17.073718 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-281b9e30-abbc-4bb0-b9e0-b6727ba05595'] response: {'name': 'network-changed', 'server_uuid': '83974c4d-f657-4217-bb7b-39254f34c4f9', 'tag': '42e13906-c0fd-470d-885c-c2d2c7e2cbfd', 'status': 'completed', 'code': 200} May 12 15:19:17.115775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Request body: {'port': {'device_id': '91efc3d2-c9e0-4867-98a8-80db504551ad', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:17.147422 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-f587f1fe-0dc3-4cbf-b1dd-eb726e76c680 service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4656634 May 12 15:19:17.166739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccfec428-f6c9-40ec-a45e-6f29bc363084 req-cc2afab3-f25b-4a42-ab68-89933cd78847 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:17.175049 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d2f6520-e9b2-455b-aa85-b45801d6e641 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:17.176587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ccfec428-f6c9-40ec-a45e-6f29bc363084 req-cc2afab3-f25b-4a42-ab68-89933cd78847 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 947 time: 0.5598211 May 12 15:19:17.333577 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ccfec428-f6c9-40ec-a45e-6f29bc363084 req-f8af5165-815a-4a68-8987-71ed4b5853a3 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/security-groups?id=b7d21fce-afb7-42cc-82c4-78d280cb5d2d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1553438 May 12 15:19:17.357137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-5759ac3d-6d87-4c15-a314-99ec0fff2b35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:17.357137 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-5759ac3d-6d87-4c15-a314-99ec0fff2b35 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=51555c8decb74fe7a10ce69cc90bf9e8&device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 1098 time: 0.2798791 May 12 15:19:17.465066 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5d2f6520-e9b2-455b-aa85-b45801d6e641 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=095266932c8b47abbe47aca4b76516a3&name=default HTTP/1.1" status: 200 len: 2983 time: 2.3176563 May 12 15:19:17.483387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60328) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:17.508541 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fdeabf82-4612-4fbe-8a04-10660837e0de service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.61&port_id=42e13906-c0fd-470d-885c-c2d2c7e2cbfd HTTP/1.1" status: 200 len: 217 time: 0.1460810 May 12 15:19:17.587254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Network 5cc57423-d06b-48b4-8acf-9dcfbe4dc681 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:19:17.603088 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:17.609114 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:17.647629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d2f6520-e9b2-455b-aa85-b45801d6e641 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83a5c44d-db34-4217-8158-d232f2f42bbb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:17.689353 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-a7d894d8-033d-4323-a108-fe1f1c00e1a3 service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5182209 May 12 15:19:17.705710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 5cc57423-d06b-48b4-8acf-9dcfbe4dc681) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:17.706369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-c90b8e26-1aaf-4e8e-b169-3161e1549442 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:17.708708 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-c90b8e26-1aaf-4e8e-b169-3161e1549442 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1907670 May 12 15:19:17.711685 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Transition to ACTIVE for port object 466cb97c-6736-42bb-8e25-772f0b5535db will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:17.713865 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc49db63-3aec-4a73-be36-66cc6166f0be req-5bfeff60-abf4-4629-bfbb-8ed5c6248c67 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 210 time: 0.0745440 May 12 15:19:17.719766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-061e7c2c-520b-4b3f-b4ab-bb8f220d9b31 None None] Network 5cc57423-d06b-48b4-8acf-9dcfbe4dc681 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:19:17.920837 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-0b50ac1e-284d-4d38-b916-97f7fa710c0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:17.922987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-0b50ac1e-284d-4d38-b916-97f7fa710c0b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2064974 May 12 15:19:17.944019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:17.944703 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:17.994765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-801ec17a-092c-4785-bc59-f38f8bf69e81 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:17.996362 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-801ec17a-092c-4785-bc59-f38f8bf69e81 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 1.1297138 May 12 15:19:17.997690 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-6c1603a1-e224-43cb-b02e-f1e6dcc60302 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.80&port_id=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c HTTP/1.1" status: 200 len: 217 time: 0.2822888 May 12 15:19:17.998235 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:18.027125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf727089-bcb8-4717-ba5a-bdd0992956c5 None None] Network 5cc57423-d06b-48b4-8acf-9dcfbe4dc681 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:19:18.116115 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-44757251-b6ff-4d54-b8ca-f5d7b45648aa service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1859415 May 12 15:19:18.147241 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3078cf72-2844-4fd5-8074-f70166408e19 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 3.9161162 May 12 15:19:18.257485 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cbbf67fb-26d0-4f47-888c-91ff295ee8f3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:18.282265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-058d2e23-e9b6-4769-97fa-7500f63efaba admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:18.315532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-6e87bd05-64a4-4d8e-8287-21866ec90d42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:18.317663 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-6e87bd05-64a4-4d8e-8287-21866ec90d42 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=722dd775-53fe-4359-9d8f-d74143e5ced9 HTTP/1.1" status: 200 len: 797 time: 0.3021462 May 12 15:19:18.350784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c14a11a3-71ab-4002-93b9-e6e0065e498d req-fb7000af-bd12-4185-a228-00cc119e3280 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2258141 May 12 15:19:18.435631 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:18.479542 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:18.608315 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:18.626689 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-058d2e23-e9b6-4769-97fa-7500f63efaba admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:18.682212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:18.706583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:18.710429 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-21e43928-0932-4400-9af9-f13cca4326ab service neutron] 10.222.0.76 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6921163 May 12 15:19:18.711171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:18.932167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Pushing event updated for resources: {'Port': ['ID=466cb97c-6736-42bb-8e25-772f0b5535db,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:19.039186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60376) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:19.055746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestMultiTenantJSON-1998828965-network', 'tenant_id': '75cd4b579aef4e258133356e6e447b43'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:19.078263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a9d7070-9680-4f08-810c-4ddac8074792 req-d2c38512-26ad-4ae4-b965-f94cc01fa4b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:19.079710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a9d7070-9680-4f08-810c-4ddac8074792 req-d2c38512-26ad-4ae4-b965-f94cc01fa4b5 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=51555c8decb74fe7a10ce69cc90bf9e8&device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 1098 time: 0.6248109 May 12 15:19:19.081748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:19.116582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Usage tracker for resource:network and tenant:75cd4b579aef4e258133356e6e447b43 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:19.123439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:19.138230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a869daa-b1c0-4423-8548-cea5f576c5f7 req-4d54babc-ea2e-4828-a3da-c4ab2547699a tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:19.139703 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a869daa-b1c0-4423-8548-cea5f576c5f7 req-4d54babc-ea2e-4828-a3da-c4ab2547699a tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 947 time: 0.5077729 May 12 15:19:19.152986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1e3cf513-f80e-4ef6-aca6-6daf1d3a5b85 None None] Provisioning for port 466cb97c-6736-42bb-8e25-772f0b5535db completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:19.158551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1e3cf513-f80e-4ef6-aca6-6daf1d3a5b85 None None] Provisioning complete for port 466cb97c-6736-42bb-8e25-772f0b5535db triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:19.159029 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1e3cf513-f80e-4ef6-aca6-6daf1d3a5b85 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:19.198481 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:19.199054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:19.229189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1e3cf513-f80e-4ef6-aca6-6daf1d3a5b85 None None] Port 466cb97c-6736-42bb-8e25-772f0b5535db cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:19:19.243315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:19.244070 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:19.256280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Made reservation on behalf of 75cd4b579aef4e258133356e6e447b43 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:19.258489 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:19.275562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-7a390ca6-f988-471b-a1b8-6b26483d669e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:19.277004 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-7a390ca6-f988-471b-a1b8-6b26483d669e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e6a7ff8f-d7ef-4614-8958-ef6026371726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.9314821 May 12 15:19:19.277615 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-058d2e23-e9b6-4769-97fa-7500f63efaba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:19.300120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event updated for resources: {'Port': ['ID=5f39e22f-c5d0-45ac-af8c-e3be19b01d0c,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:19.309604 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:19.324548 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a869daa-b1c0-4423-8548-cea5f576c5f7 req-47458740-353f-48f1-8f35-7271aa512a0f tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/security-groups?id=b7d21fce-afb7-42cc-82c4-78d280cb5d2d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1267836 May 12 15:19:19.336078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c04fcc2-083a-4a4b-9209-9a593948bcca req-fcc3d7c0-562e-4551-a2ba-22716fc059b0 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:19.337641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c04fcc2-083a-4a4b-9209-9a593948bcca req-fcc3d7c0-562e-4551-a2ba-22716fc059b0 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 931 time: 0.4180925 May 12 15:19:19.377673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-058d2e23-e9b6-4769-97fa-7500f63efaba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83a5c44d-db34-4217-8158-d232f2f42bbb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:19.380534 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-058d2e23-e9b6-4769-97fa-7500f63efaba admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:19.381664 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-058d2e23-e9b6-4769-97fa-7500f63efaba admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/83a5c44d-db34-4217-8158-d232f2f42bbb HTTP/1.1" status: 204 len: 168 time: 1.8442020 May 12 15:19:19.415959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:19.436229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a9d7070-9680-4f08-810c-4ddac8074792 req-5ab7161a-8bb9-402d-be96-9f0c9d90f5ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:19.437683 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a9d7070-9680-4f08-810c-4ddac8074792 req-5ab7161a-8bb9-402d-be96-9f0c9d90f5ee service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.3510261 May 12 15:19:19.440342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Usage tracker for resource:security_group_rule and tenant:75cd4b579aef4e258133356e6e447b43 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:19.449972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:19.457328 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:19.458956 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-949cd326-5532-424b-8be8-87fc4df3d020 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 9.7237840 May 12 15:19:19.460582 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-dd19772d-e300-40b5-b09f-d8f04f351114 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 6.1520030 May 12 15:19:19.481648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60386) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:19.483705 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95d4ccf6-0e0b-47b8-88bd-5eb61b92d39c req-1ccbf0aa-318f-4c3a-a494-314ac76a6df9 service neutron] 10.222.0.76 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6471035 May 12 15:19:19.495075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-39c3de62-583e-4e08-8c3d-3b18aef35ad2 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Request body: {'floatingip': {'port_id': '505241b0-19ae-4efc-a8a0-2ea513dcd94c', 'fixed_ip_address': '172.20.0.9'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:19.524166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:19.541992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a9d7070-9680-4f08-810c-4ddac8074792 req-ab968f13-8a34-43dd-b492-4e92536400d0 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.61&port_id=42e13906-c0fd-470d-885c-c2d2c7e2cbfd HTTP/1.1" status: 200 len: 217 time: 0.0878823 May 12 15:19:19.554228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Request body: {'port': {'device_id': '0ddbfd7d-b0df-4738-9d34-ea82ba255187', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:19.561530 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c04fcc2-083a-4a4b-9209-9a593948bcca req-489ab0e8-baca-4b00-8607-64d9df44298f tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2060101 May 12 15:19:19.610486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-cbbf67fb-26d0-4f47-888c-91ff295ee8f3 admin admin] Deleting port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:19.610825 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cbbf67fb-26d0-4f47-888c-91ff295ee8f3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:19.762762 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39c3de62-583e-4e08-8c3d-3b18aef35ad2 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for floatingip, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:19.764327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a9d7070-9680-4f08-810c-4ddac8074792 req-b43bb8f5-25df-4cee-aa38-d1f6f853283e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:19.765781 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a9d7070-9680-4f08-810c-4ddac8074792 req-b43bb8f5-25df-4cee-aa38-d1f6f853283e service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2155545 May 12 15:19:19.816956 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-439d3a8a-c61d-4f48-bb4f-275eda6dfa94 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=54887606d1e448bbba4720d03f57d6d1&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1157517 May 12 15:19:20.074241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-cbbf67fb-26d0-4f47-888c-91ff295ee8f3 admin admin] For port 78867492-bce0-46a9-bcbd-e2e2cbd76ff5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=78867492-bce0-46a9-bcbd-e2e2cbd76ff5,segment=NetworkSegment(b6ca0527-0ae0-46e1-98b3-d59b1f312d8d),segment_id=b6ca0527-0ae0-46e1-98b3-d59b1f312d8d)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:20.074933 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] It took 0.26 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:19:20.075033 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cbbf67fb-26d0-4f47-888c-91ff295ee8f3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:20.137441 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:20.147252 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-a27d7de6-f5fc-44e4-80c8-7bee9e378018 service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8354840 May 12 15:19:20.232697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-cbbf67fb-26d0-4f47-888c-91ff295ee8f3 admin admin] Calling delete_port for 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:20.307086 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:20.319315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-eac08d13-b815-4ede-8b42-e2f3ba64eeba tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:20.320799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-eac08d13-b815-4ede-8b42-e2f3ba64eeba tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4524808 May 12 15:19:20.326291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a9d7070-9680-4f08-810c-4ddac8074792 req-9868d63b-5cd9-40b5-aa63-c2c16930e248 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:20.327623 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a9d7070-9680-4f08-810c-4ddac8074792 req-9868d63b-5cd9-40b5-aa63-c2c16930e248 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.5058432 May 12 15:19:20.330210 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:20.357767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e795cd0b-ae34-4489-9acc-774faf0d6935 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:19:20.384497 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:20.440302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Transition to ACTIVE for port object e795cd0b-ae34-4489-9acc-774faf0d6935 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:20.456438 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-39c3de62-583e-4e08-8c3d-3b18aef35ad2 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] update failed (client error): The resource could not be found. May 12 15:19:20.457523 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-39c3de62-583e-4e08-8c3d-3b18aef35ad2 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "PUT /v2.0/floatingips/622b9876-d8e0-4e97-9a2f-da36639c3dda HTTP/1.1" status: 404 len: 507 time: 0.9729078 May 12 15:19:20.498049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d785d44d-8158-4c1b-8f31-ac21d24df6dd req-00e6361d-f19b-4cac-93e7-732997a99dfa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:20.499540 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d785d44d-8158-4c1b-8f31-ac21d24df6dd req-00e6361d-f19b-4cac-93e7-732997a99dfa service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=07c1472fa162425e9303d95e5e843c64&device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 1095 time: 0.8787715 May 12 15:19:20.502647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60418) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:20.511951 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:20.585995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-02a4d232-d92c-40ad-bbd2-3b7df3ce4c5a tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/quotas/54887606d1e448bbba4720d03f57d6d1 HTTP/1.1" status: 200 len: 375 time: 0.2518229 May 12 15:19:20.610936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 568} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:19:20.724661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eac3407a-9b2c-4c59-8835-1cbc3550dbe3,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:20.753152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-33d6526a-c2c3-4385-8c35-d55c376ae022 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=54887606d1e448bbba4720d03f57d6d1&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1432276 May 12 15:19:20.756730 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:20.757077 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Added segment 75791975-1c41-4f7d-9e8f-621f8acfb6b8 of type vlan for network 79f95263-b773-4ed2-a217-3981203759e0 May 12 15:19:20.853791 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:20.893476 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-72b798e7-0588-4910-8652-e36564e8282f service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7216666 May 12 15:19:20.994689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a9d7070-9680-4f08-810c-4ddac8074792 req-26025093-f70a-48a1-8fd8-4e4d8d11e81b service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4857726 May 12 15:19:21.047991 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cbbf67fb-26d0-4f47-888c-91ff295ee8f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:21.059573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138adeaf-d151-436c-81b5-b56112e707aa req-5d1941b3-f5a9-4c65-a10b-2e199075fd26 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:21.066905 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-138adeaf-d151-436c-81b5-b56112e707aa req-5d1941b3-f5a9-4c65-a10b-2e199075fd26 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 947 time: 0.5536389 May 12 15:19:21.173823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4f0cc16d-de0c-495c-b7bc-0f75fd5f29d4 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Deleting port 5f39e22f-c5d0-45ac-af8c-e3be19b01d0c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:21.174163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f0cc16d-de0c-495c-b7bc-0f75fd5f29d4 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:21.194764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbbf67fb-26d0-4f47-888c-91ff295ee8f3 admin admin] Pushing event deleted for resources: {'Port': ['ID=78867492-bce0-46a9-bcbd-e2e2cbd76ff5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:21.234473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Pushing event updated for resources: {'Port': ['ID=e795cd0b-ae34-4489-9acc-774faf0d6935,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:21.260681 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:21.261716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:21.262286 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:21.273841 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-0842d453-0090-468a-a862-6c5ca9394fd7 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.158&port_id=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad HTTP/1.1" status: 200 len: 217 time: 0.2613895 May 12 15:19:21.546989 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-138adeaf-d151-436c-81b5-b56112e707aa req-e4300e75-fa4c-4b82-a9ac-09979af72f90 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/security-groups?id=b7d21fce-afb7-42cc-82c4-78d280cb5d2d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4781072 May 12 15:19:21.599705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d785d44d-8158-4c1b-8f31-ac21d24df6dd req-ce9b8ef5-dce0-45ad-a181-68ae40923226 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:21.601785 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d785d44d-8158-4c1b-8f31-ac21d24df6dd req-ce9b8ef5-dce0-45ad-a181-68ae40923226 service neutron] 10.222.0.76 "GET /v2.0/networks?id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d HTTP/1.1" status: 200 len: 917 time: 1.0863197 May 12 15:19:21.861163 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 2.8190720 May 12 15:19:21.885770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60474) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:21.899093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-8e58b311-cbe5-4119-b7fb-80fff2b30c42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:21.900475 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-8e58b311-cbe5-4119-b7fb-80fff2b30c42 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=722dd775-53fe-4359-9d8f-d74143e5ced9 HTTP/1.1" status: 200 len: 797 time: 0.5952289 May 12 15:19:21.908716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60476) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:21.918405 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d7f0dfe-8ea0-4887-88bc-88575c813912 admin admin] Pushing event updated for resources: {'Network': ['ID=79f95263-b773-4ed2-a217-3981203759e0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:21.928931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Request body: {'subnet': {'network_id': '79f95263-b773-4ed2-a217-3981203759e0', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestMultiTenantJSON-1998828965-subnet', 'tenant_id': '75cd4b579aef4e258133356e6e447b43', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:21.931238 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a9d7070-9680-4f08-810c-4ddac8074792 req-3c58bc3f-969d-4062-8ef2-9ca6f1ed670f service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9242058 May 12 15:19:21.936062 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 79f95263-b773-4ed2-a217-3981203759e0 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:19:21.937307 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d785d44d-8158-4c1b-8f31-ac21d24df6dd req-f1d32382-e523-44c5-964c-ee05071edcac service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=2a00c7fc-ced7-44c0-b374-110741ae6468 HTTP/1.1" status: 200 len: 217 time: 0.3266003 May 12 15:19:21.948269 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdec40f6-22a4-4253-9af4-240384813a7c req-b8532c69-55af-49d8-a84f-adad08778c13 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 210 time: 0.1171000 May 12 15:19:21.983193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:21.987753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Attempting to bind port e795cd0b-ae34-4489-9acc-774faf0d6935 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:21.988253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Attempting to bind port e795cd0b-ae34-4489-9acc-774faf0d6935 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:21.988733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Attempting to bind port e795cd0b-ae34-4489-9acc-774faf0d6935 on network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:22.048103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Usage tracker for resource:subnet and tenant:75cd4b579aef4e258133356e6e447b43 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:22.061158 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:22.079246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fde4afa-88b3-483e-a5d8-bfb7d4e157c3 req-235a7dc0-067a-4684-b4f4-847e9d90408c tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:22.080793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5fde4afa-88b3-483e-a5d8-bfb7d4e157c3 req-235a7dc0-067a-4684-b4f4-847e9d90408c tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 931 time: 0.7168713 May 12 15:19:22.083479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Port e795cd0b-ae34-4489-9acc-774faf0d6935 on network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:22.084038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Attempting to bind port e795cd0b-ae34-4489-9acc-774faf0d6935 on network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:22.091833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:22.136462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 19, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:19:22.136800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Checking segment: {'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:22.137184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Bound using segment: {'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:19:22.137644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Bound port: e795cd0b-ae34-4489-9acc-774faf0d6935, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:19:22.139810 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:22.150011 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7fe21d7-86fe-4960-9949-6fa651df7fb7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:22.190965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d7fe21d7-86fe-4960-9949-6fa651df7fb7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:22.198492 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cbbf67fb-26d0-4f47-888c-91ff295ee8f3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:22.203963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d7fe21d7-86fe-4960-9949-6fa651df7fb7 admin admin] Usage tracker for resource:security_group_rule and tenant:4640c489a3ee44c690045fc0c2a263ea is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:22.210569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5fde4afa-88b3-483e-a5d8-bfb7d4e157c3 req-38efcd37-e6f9-4ade-b44f-56e7a0cb7fd6 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0987694 May 12 15:19:22.219617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Made reservation on behalf of 75cd4b579aef4e258133356e6e447b43 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:22.222126 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:22.224556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d7fe21d7-86fe-4960-9949-6fa651df7fb7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:22.236751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d785d44d-8158-4c1b-8f31-ac21d24df6dd req-3c536ee3-525f-4bcb-babd-651d8535d0ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:22.238202 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d785d44d-8158-4c1b-8f31-ac21d24df6dd req-3c536ee3-525f-4bcb-babd-651d8535d0ed service neutron] 10.222.0.76 "GET /v2.0/subnets?id=34e2be1a-2cbe-4227-a0bf-50d20740aa45 HTTP/1.1" status: 200 len: 855 time: 0.2563891 May 12 15:19:22.242293 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f0cc16d-de0c-495c-b7bc-0f75fd5f29d4 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:22.242511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d7fe21d7-86fe-4960-9949-6fa651df7fb7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:22.242624 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f0cc16d-de0c-495c-b7bc-0f75fd5f29d4 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:22.539914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4f0cc16d-de0c-495c-b7bc-0f75fd5f29d4 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Calling delete_port for 5f39e22f-c5d0-45ac-af8c-e3be19b01d0c owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:22.587859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 466cb97c-6736-42bb-8e25-772f0b5535db {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:19:22.612921 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:22.685230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Transition to ACTIVE for port object 466cb97c-6736-42bb-8e25-772f0b5535db will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:22.691018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-ed1b06fd-f66d-42a3-955f-878f360e7236 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:22.693194 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-ed1b06fd-f66d-42a3-955f-878f360e7236 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=e6a7ff8f-d7ef-4614-8958-ef6026371726&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.7581944 May 12 15:19:22.694672 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7fe21d7-86fe-4960-9949-6fa651df7fb7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:22.706973 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:22.730598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 2a00c7fc-ced7-44c0-b374-110741ae6468 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:19:22.805720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] For port e795cd0b-ae34-4489-9acc-774faf0d6935, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:19:22.806509 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:19:22.891053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cbbf67fb-26d0-4f47-888c-91ff295ee8f3 admin admin] Router 301de57f-75b6-4323-a891-da62f7306fd1 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:19:22.921836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 2a00c7fc-ced7-44c0-b374-110741ae6468, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2a00c7fc-ced7-44c0-b374-110741ae6468,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:22.939534 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-580d8b20-cb8c-4a0e-8c01-16835741eb6c tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=54887606d1e448bbba4720d03f57d6d1&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0457406 May 12 15:19:22.943985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '2a00c7fc-ced7-44c0-b374-110741ae6468', 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d', 'port_id': '2a00c7fc-ced7-44c0-b374-110741ae6468', 'mac_address': 'fa:16:3e:23:6a:91', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 553, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '34e2be1a-2cbe-4227-a0bf-50d20740aa45', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:19:22.947901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] For port e795cd0b-ae34-4489-9acc-774faf0d6935, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e795cd0b-ae34-4489-9acc-774faf0d6935,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:19:23.012098 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:23.015736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Pushing event updated for resources: {'Port': ['ID=466cb97c-6736-42bb-8e25-772f0b5535db,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:23.042246 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:23.043235 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7fe21d7-86fe-4960-9949-6fa651df7fb7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:23.078923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2a00c7fc-ced7-44c0-b374-110741ae6468 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:19:23.097520 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d7fe21d7-86fe-4960-9949-6fa651df7fb7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4640c489a3ee44c690045fc0c2a263ea&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1813197 May 12 15:19:23.098615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60490) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:23.104448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 2a00c7fc-ced7-44c0-b374-110741ae6468, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2a00c7fc-ced7-44c0-b374-110741ae6468,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:23.109903 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:23.111030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 42e13906-c0fd-470d-885c-c2d2c7e2cbfd details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:19:23.218803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d785d44d-8158-4c1b-8f31-ac21d24df6dd req-e8dee0f1-e8f6-4942-9c25-138be681ea4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:23.220232 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d785d44d-8158-4c1b-8f31-ac21d24df6dd req-e8dee0f1-e8f6-4942-9c25-138be681ea4b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.9322534 May 12 15:19:23.275244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:23.275880 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:23.277216 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] 10.222.0.84 "PUT /v2.0/ports/e795cd0b-ae34-4489-9acc-774faf0d6935 HTTP/1.1" status: 200 len: 1091 time: 6.2699332 May 12 15:19:23.280031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '91efc3d2-c9e0-4867-98a8-80db504551ad', 'tag': 'e795cd0b-ae34-4489-9acc-774faf0d6935'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:23.358780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=2a00c7fc-ced7-44c0-b374-110741ae6468,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:23.378629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:23.378982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:23.379299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:23.379751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:23.380174 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:23.380505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:23.380972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:23.381313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:23.381638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:23.381974 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:23.382275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:23.382589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:23.394228 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=42e13906-c0fd-470d-885c-c2d2c7e2cbfd,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:23.412087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '42e13906-c0fd-470d-885c-c2d2c7e2cbfd', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '42e13906-c0fd-470d-885c-c2d2c7e2cbfd', 'mac_address': 'fa:16:3e:01:69:b2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.61'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:19:23.477619 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:23.489710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-54ea5a0b-09b9-4bb6-9afb-538bb9beb3a3 req-ca7cbf98-f090-48a5-a2ff-e653d1c73b50 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 210 time: 0.3894424 May 12 15:19:23.496699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 42e13906-c0fd-470d-885c-c2d2c7e2cbfd {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:19:23.525424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=42e13906-c0fd-470d-885c-c2d2c7e2cbfd,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:23.532415 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:23.533717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7fe21d7-86fe-4960-9949-6fa651df7fb7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2399886d-223e-4b1a-a08d-9f58b8a32f8d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:23.617942 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-14801b74-f907-4139-acf3-6d0ade0b088c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:23.662228 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd404466-d702-4034-8360-1e362d7f7788 req-ff0cc920-5547-4ed0-986d-96bcb0c9bf7a tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:23.663981 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd404466-d702-4034-8360-1e362d7f7788 req-ff0cc920-5547-4ed0-986d-96bcb0c9bf7a tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 947 time: 0.7311242 May 12 15:19:23.716016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=42e13906-c0fd-470d-885c-c2d2c7e2cbfd,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:23.722378 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-8a978dc5-1ab0-4525-9880-976384b58bf2 service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9588857 May 12 15:19:23.741094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c533a94-d4cd-48d8-8c92-a953a67eba5a service neutron] Pushing event updated for resources: {'Port': ['ID=e795cd0b-ae34-4489-9acc-774faf0d6935,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:23.743745 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f0cc16d-de0c-495c-b7bc-0f75fd5f29d4 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:23.757360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['2a00c7fc-ced7-44c0-b374-110741ae6468'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:19:23.781997 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-14801b74-f907-4139-acf3-6d0ade0b088c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:23.793505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['42e13906-c0fd-470d-885c-c2d2c7e2cbfd'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:19:23.845183 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd404466-d702-4034-8360-1e362d7f7788 req-a892b739-42fd-497e-a83d-684f3499d729 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/security-groups?id=b7d21fce-afb7-42cc-82c4-78d280cb5d2d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1417172 May 12 15:19:23.875894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-025fd4f2-63ad-45ce-abee-c3251ab7516a tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:23.877334 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-025fd4f2-63ad-45ce-abee-c3251ab7516a tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.8029439 May 12 15:19:23.888162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cbbf67fb-26d0-4f47-888c-91ff295ee8f3 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:19:23.900729 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21b81f6c-a021-4ec7-8f61-e80d234d5119 None None] Sync routers for ids ['301de57f-75b6-4323-a891-da62f7306fd1'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:19:23.901243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Attempting to bind port 466cb97c-6736-42bb-8e25-772f0b5535db on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:23.901605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Attempting to bind port 466cb97c-6736-42bb-8e25-772f0b5535db by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:23.901930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Attempting to bind port 466cb97c-6736-42bb-8e25-772f0b5535db on network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:23.904133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f0cc16d-de0c-495c-b7bc-0f75fd5f29d4 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event deleted for resources: {'Port': ['ID=5f39e22f-c5d0-45ac-af8c-e3be19b01d0c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:23.915812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Request body: {'port': {'device_id': '3105e403-7d5f-4c02-9e2c-f6f26de448a3', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '54887606d1e448bbba4720d03f57d6d1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:23.942164 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cbbf67fb-26d0-4f47-888c-91ff295ee8f3 admin admin] 10.222.0.82 "PUT /v2.0/routers/301de57f-75b6-4323-a891-da62f7306fd1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.9756761 May 12 15:19:23.946715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Port 466cb97c-6736-42bb-8e25-772f0b5535db on network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:23.947258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Attempting to bind port 466cb97c-6736-42bb-8e25-772f0b5535db on network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:23.956800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21b81f6c-a021-4ec7-8f61-e80d234d5119 None None] Routers {'301de57f-75b6-4323-a891-da62f7306fd1'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:19:23.957578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-21b81f6c-a021-4ec7-8f61-e80d234d5119 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:19:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['301de57f-75b6-4323-a891-da62f7306fd1'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:23.980007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60500) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:23.981058 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:23.990546 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-892ffd82-1462-4148-b88e-76cf36cf151e'] response: {'name': 'network-changed', 'server_uuid': '91efc3d2-c9e0-4867-98a8-80db504551ad', 'tag': 'e795cd0b-ae34-4489-9acc-774faf0d6935', 'status': 'completed', 'code': 200} May 12 15:19:24.012883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2625d12-d2a2-49a8-b8ed-249b78915e88 req-9c0b2f0a-5a0c-4ffe-b1d2-6eb6b46c8737 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:24.014400 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2625d12-d2a2-49a8-b8ed-249b78915e88 req-9c0b2f0a-5a0c-4ffe-b1d2-6eb6b46c8737 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 943 time: 0.3614347 May 12 15:19:24.060506 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-14801b74-f907-4139-acf3-6d0ade0b088c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:24.096661 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-14801b74-f907-4139-acf3-6d0ade0b088c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:24.101146 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-14801b74-f907-4139-acf3-6d0ade0b088c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2399886d-223e-4b1a-a08d-9f58b8a32f8d HTTP/1.1" status: 204 len: 168 time: 0.9293196 May 12 15:19:24.109652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14801b74-f907-4139-acf3-6d0ade0b088c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2399886d-223e-4b1a-a08d-9f58b8a32f8d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:24.150586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 19, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:19:24.150950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Checking segment: {'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:24.151333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Bound using segment: {'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:19:24.151769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Bound port: 466cb97c-6736-42bb-8e25-772f0b5535db, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8d117579-62ca-4ff1-b65e-77a41d98571a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:19:24.152110 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:24.157945 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2625d12-d2a2-49a8-b8ed-249b78915e88 req-40038908-9efd-4285-b089-f83ae002b9d1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1230977 May 12 15:19:24.163223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:24.171551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Usage tracker for resource:port and tenant:54887606d1e448bbba4720d03f57d6d1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:24.174782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:24.182541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:24.199436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Made reservation on behalf of 54887606d1e448bbba4720d03f57d6d1 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:24.202981 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:24.220292 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:24.237721 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d785d44d-8158-4c1b-8f31-ac21d24df6dd req-05d8bca6-6814-40e6-92e0-04a152ae1e36 service neutron] 10.222.0.76 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9641354 May 12 15:19:24.238523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:24.243678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Usage tracker for resource:security_group_rule and tenant:54887606d1e448bbba4720d03f57d6d1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:24.246849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:24.253852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:24.345902 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-21b81f6c-a021-4ec7-8f61-e80d234d5119 None None] Set router 301de57f-75b6-4323-a891-da62f7306fd1 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:19:24.350487 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:24.360279 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:24.533446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Pushing event updated for resources: {'Subnet': ['ID=36a465da-fc0b-4eba-894d-7c0c06e6a50c,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:24.547069 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Allocated IP 192.168.233.190 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/21fb42a3-a101-46b8-acaa-9a763a096933) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:24.569898 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-8fbf5ee6-e208-49f5-99d4-665aa0a81230 service neutron] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8369768 May 12 15:19:24.572366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-3f0da929-b08c-4a10-9804-d2941e064657 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:24.573828 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-3f0da929-b08c-4a10-9804-d2941e064657 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=07c1472fa162425e9303d95e5e843c64&device_id=91efc3d2-c9e0-4867-98a8-80db504551ad HTTP/1.1" status: 200 len: 1094 time: 0.9489827 May 12 15:19:24.574617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Checking segment: {'id': '75791975-1c41-4f7d-9e8f-621f8acfb6b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': '79f95263-b773-4ed2-a217-3981203759e0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:24.575046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Network hostable DHCP agents. Network: 79f95263-b773-4ed2-a217-3981203759e0, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:19:24.661230 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f0cc16d-de0c-495c-b7bc-0f75fd5f29d4 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:24.774814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-21b81f6c-a021-4ec7-8f61-e80d234d5119 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '301de57f-75b6-4323-a891-da62f7306fd1', 'name': 'tempest-TaggedBootDevicesTest_v242-265683194-router', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245'}], 'enable_snat': True}, 'gw_port_id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:12:01Z', 'updated_at': '2022-05-12T15:19:20Z', 'revision_number': 5, 'project_id': '0e49c03c26594e7fa192a1a667415ff3', 'gw_port': {'id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:49:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '301de57f-75b6-4323-a891-da62f7306fd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 875, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:02Z', 'updated_at': '2022-05-12T15:12:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:24.779659 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-2bdf274c-20e1-46ce-8817-de9b2e1d1c45 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=097f632d-3127-4539-ba4a-3e2739125cf8 HTTP/1.1" status: 200 len: 217 time: 0.1760345 May 12 15:19:24.780182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21b81f6c-a021-4ec7-8f61-e80d234d5119 None None] Checking router: 301de57f-75b6-4323-a891-da62f7306fd1 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:19:24.781570 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-488a8f96-f223-42ec-b2c7-c1a3754def67 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e795cd0b-ae34-4489-9acc-774faf0d6935 HTTP/1.1" status: 200 len: 217 time: 0.1739419 May 12 15:19:24.793703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21b81f6c-a021-4ec7-8f61-e80d234d5119 None None] Routers {'301de57f-75b6-4323-a891-da62f7306fd1'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:19:24.794429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-21b81f6c-a021-4ec7-8f61-e80d234d5119 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:19:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['301de57f-75b6-4323-a891-da62f7306fd1'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:24.825071 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:24.845756 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Transition to ACTIVE for port object 21fb42a3-a101-46b8-acaa-9a763a096933 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:24.906590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Network 79f95263-b773-4ed2-a217-3981203759e0 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:19:24.925642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] For port 466cb97c-6736-42bb-8e25-772f0b5535db, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:19:24.937926 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f0cc16d-de0c-495c-b7bc-0f75fd5f29d4 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:24.939337 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4f0cc16d-de0c-495c-b7bc-0f75fd5f29d4 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "DELETE /v2.0/floatingips/622b9876-d8e0-4e97-9a2f-da36639c3dda HTTP/1.1" status: 204 len: 168 time: 4.4291563 May 12 15:19:24.941072 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:25.027950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60524) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:25.059932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05f643a7-471e-4c64-9ec6-e00550cd0907 req-cc974e84-ca16-4bc1-8313-ca9f19b1c04b tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 210 time: 0.2951570 May 12 15:19:25.062629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-66b7edc8-7991-4ca0-b495-082ea58920ab tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Request body: {'floatingip': {'floating_network_id': '674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3', 'port_id': '505241b0-19ae-4efc-a8a0-2ea513dcd94c', 'fixed_ip_address': '172.20.0.9'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:25.070001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-66b7edc8-7991-4ca0-b495-082ea58920ab tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:25.072120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-21b81f6c-a021-4ec7-8f61-e80d234d5119 None None] Set router 301de57f-75b6-4323-a891-da62f7306fd1 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:19:25.074718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-66b7edc8-7991-4ca0-b495-082ea58920ab tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Usage tracker for resource:floatingip and tenant:97c1bf81263543a888f23243db1936dd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:25.077816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-66b7edc8-7991-4ca0-b495-082ea58920ab tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:25.084257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-66b7edc8-7991-4ca0-b495-082ea58920ab tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:25.098897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] For port 466cb97c-6736-42bb-8e25-772f0b5535db, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=466cb97c-6736-42bb-8e25-772f0b5535db,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:19:25.117991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 79f95263-b773-4ed2-a217-3981203759e0) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:25.129692 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d785d44d-8158-4c1b-8f31-ac21d24df6dd req-4e7dd975-bbd9-47b2-8e83-98d8936a17fc service neutron] 10.222.0.76 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8566043 May 12 15:19:25.136718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Pushing event updated for resources: {'SecurityGroup': ['ID=31d58a41-3845-471a-98c8-ed2f43418af7,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:25.137444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:25.141295 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66b7edc8-7991-4ca0-b495-082ea58920ab tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:25.157631 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:25.173062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:25.173666 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:25.221244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-0d43047f-548c-4bc6-a9ec-f1fc7497e8a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:25.222701 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-0d43047f-548c-4bc6-a9ec-f1fc7497e8a1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=34e2be1a-2cbe-4227-a0bf-50d20740aa45 HTTP/1.1" status: 200 len: 855 time: 0.4014370 May 12 15:19:25.224783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-c3192a03-c07e-4342-98e5-ca5fa6dd50b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:25.226121 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-c3192a03-c07e-4342-98e5-ca5fa6dd50b1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=6457d378-be74-408c-98d5-b411738c6998 HTTP/1.1" status: 200 len: 797 time: 0.4059436 May 12 15:19:25.262174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Pushing event updated for resources: {'Port': ['ID=21fb42a3-a101-46b8-acaa-9a763a096933,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:25.279268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:25.283087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:25.286426 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:25.362801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71f1131e-7cb3-458c-884e-f3b7cfafc8d1 req-27bb295c-e804-4d0f-af38-34c57ecbdc11 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:25.365370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71f1131e-7cb3-458c-884e-f3b7cfafc8d1 req-27bb295c-e804-4d0f-af38-34c57ecbdc11 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 948 time: 0.3080270 May 12 15:19:25.407464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:25.408583 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:25.420340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-217abf85-d96a-4468-ab93-06bb92f58005 None None] Network 79f95263-b773-4ed2-a217-3981203759e0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:19:25.492086 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-78d9b1b3-1988-4e3a-ad2d-5fd46db41af9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.5851030 May 12 15:19:25.517911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Request body: {'port': {'device_id': '3105e403-7d5f-4c02-9e2c-f6f26de448a3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:25.629179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71f1131e-7cb3-458c-884e-f3b7cfafc8d1 req-6e478c73-cefb-4fb5-8073-675ee83d767d tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/security-groups?id=b7d21fce-afb7-42cc-82c4-78d280cb5d2d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2519755 May 12 15:19:25.714843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:25.715455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:25.717005 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] 10.222.0.84 "PUT /v2.0/ports/466cb97c-6736-42bb-8e25-772f0b5535db HTTP/1.1" status: 200 len: 1091 time: 6.2269747 May 12 15:19:25.810546 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a7bf7cf6-9c66-4e3e-9a05-c12595ad460c admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 3.9133713 May 12 15:19:25.849624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8419831-db2a-4e9f-b43e-4812ed2516cc req-285fd59e-f45d-4ee1-99d8-a37aedbae2a4 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:25.851223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8419831-db2a-4e9f-b43e-4812ed2516cc req-285fd59e-f45d-4ee1-99d8-a37aedbae2a4 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 943 time: 0.4037540 May 12 15:19:25.910658 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:25.929761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c8d994fd-960b-4c8a-ade4-ba1538ba0c93 None None] Provisioning for port 21fb42a3-a101-46b8-acaa-9a763a096933 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:25.952523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c8d994fd-960b-4c8a-ade4-ba1538ba0c93 None None] Provisioning complete for port 21fb42a3-a101-46b8-acaa-9a763a096933 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:25.952899 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c8d994fd-960b-4c8a-ade4-ba1538ba0c93 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:25.964280 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8419831-db2a-4e9f-b43e-4812ed2516cc req-5aa26ddd-61a4-49d7-a7dd-7016552e9bf0 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1026351 May 12 15:19:25.984270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebe9bc62-faf1-4ebc-b17a-c61bf76aec51 service neutron] Pushing event updated for resources: {'Port': ['ID=466cb97c-6736-42bb-8e25-772f0b5535db,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:25.991247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0ddbfd7d-b0df-4738-9d34-ea82ba255187', 'tag': '466cb97c-6736-42bb-8e25-772f0b5535db'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:26.031811 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:26.066965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] Deleting port 49fa16f5-ab90-402d-8b5a-04aca0a68917 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:26.067776 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:26.108452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ceccca8a-f094-401f-9dab-fcb58f4b4c51 None None] Network 79f95263-b773-4ed2-a217-3981203759e0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:19:26.132052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-ce92c1df-30b4-4ef8-855b-580d45ebfbc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:26.133742 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-ce92c1df-30b4-4ef8-855b-580d45ebfbc1 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=c5f75c23-a033-42fa-b7cd-dcbda413fa9a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.8901632 May 12 15:19:26.142344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-b2548925-77e8-4bee-a3f3-1fb51d248bd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:26.143943 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-b2548925-77e8-4bee-a3f3-1fb51d248bd2 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.9014485 May 12 15:19:26.145680 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2e2732f4-0441-4691-8bb7-3a4712f1babd'] response: {'name': 'network-changed', 'server_uuid': '0ddbfd7d-b0df-4738-9d34-ea82ba255187', 'tag': '466cb97c-6736-42bb-8e25-772f0b5535db', 'status': 'completed', 'code': 200} May 12 15:19:26.155518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-d0889267-d642-4177-afd1-f2c2560ed853 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:26.157110 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-d0889267-d642-4177-afd1-f2c2560ed853 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=07c1472fa162425e9303d95e5e843c64&device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 1094 time: 0.3338242 May 12 15:19:26.311416 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c8d994fd-960b-4c8a-ade4-ba1538ba0c93 None None] Port 21fb42a3-a101-46b8-acaa-9a763a096933 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:19:26.394095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-21b81f6c-a021-4ec7-8f61-e80d234d5119 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '301de57f-75b6-4323-a891-da62f7306fd1', 'name': 'tempest-TaggedBootDevicesTest_v242-265683194-router', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245'}], 'enable_snat': True}, 'gw_port_id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:12:01Z', 'updated_at': '2022-05-12T15:19:20Z', 'revision_number': 5, 'project_id': '0e49c03c26594e7fa192a1a667415ff3', 'gw_port': {'id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:49:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '301de57f-75b6-4323-a891-da62f7306fd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 875, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:02Z', 'updated_at': '2022-05-12T15:12:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:26.437353 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21b81f6c-a021-4ec7-8f61-e80d234d5119 None None] The sync data for ids ['301de57f-75b6-4323-a891-da62f7306fd1'] in n-d-841483-1 is: [{'id': '301de57f-75b6-4323-a891-da62f7306fd1', 'name': 'tempest-TaggedBootDevicesTest_v242-265683194-router', 'tenant_id': '0e49c03c26594e7fa192a1a667415ff3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245'}], 'enable_snat': True}, 'gw_port_id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:12:01Z', 'updated_at': '2022-05-12T15:19:20Z', 'revision_number': 5, 'project_id': '0e49c03c26594e7fa192a1a667415ff3', 'gw_port': {'id': '49fa16f5-ab90-402d-8b5a-04aca0a68917', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:49:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '301de57f-75b6-4323-a891-da62f7306fd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 875, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:12:02Z', 'updated_at': '2022-05-12T15:12:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:19:26.583530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 21fb42a3-a101-46b8-acaa-9a763a096933 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:19:26.594806 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:26.620446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Transition to ACTIVE for port object 21fb42a3-a101-46b8-acaa-9a763a096933 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:26.630160 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:26.668112 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-809cf1b7-2238-4ad2-b721-91ab6eb933d1 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=466cb97c-6736-42bb-8e25-772f0b5535db HTTP/1.1" status: 200 len: 217 time: 0.4829867 May 12 15:19:26.670516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60560) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:26.687394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-419f884e-a1b3-424a-8e71-c14f4a4188a8 req-7bf3aa6f-1de5-4d54-8bf3-8ad0e6245ff6 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:26.687991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-419f884e-a1b3-424a-8e71-c14f4a4188a8 req-7bf3aa6f-1de5-4d54-8bf3-8ad0e6245ff6 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Synchronizing usage tracker for tenant:54887606d1e448bbba4720d03f57d6d1 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:26.744319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 2a00c7fc-ced7-44c0-b374-110741ae6468 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:26.801030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-52f0a28c-b4a2-416f-b573-82faf2fe5799 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:26.809059 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-52f0a28c-b4a2-416f-b573-82faf2fe5799 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=34e2be1a-2cbe-4227-a0bf-50d20740aa45 HTTP/1.1" status: 200 len: 855 time: 0.1185358 May 12 15:19:26.850125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Pushing event updated for resources: {'Port': ['ID=21fb42a3-a101-46b8-acaa-9a763a096933,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:26.881194 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:19:26.982576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-419f884e-a1b3-424a-8e71-c14f4a4188a8 req-7bf3aa6f-1de5-4d54-8bf3-8ad0e6245ff6 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Unset dirty status for tenant:54887606d1e448bbba4720d03f57d6d1 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:26.983997 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-419f884e-a1b3-424a-8e71-c14f4a4188a8 req-7bf3aa6f-1de5-4d54-8bf3-8ad0e6245ff6 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 936 time: 0.5258489 May 12 15:19:27.031299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:19:27.032805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 78867492-bce0-46a9-bcbd-e2e2cbd76ff5 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:19:27.044919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Attempting to bind port 21fb42a3-a101-46b8-acaa-9a763a096933 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:27.045252 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Attempting to bind port 21fb42a3-a101-46b8-acaa-9a763a096933 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:27.045597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Attempting to bind port 21fb42a3-a101-46b8-acaa-9a763a096933 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:27.070888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Port 21fb42a3-a101-46b8-acaa-9a763a096933 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:27.071144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Attempting to bind port 21fb42a3-a101-46b8-acaa-9a763a096933 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:27.087814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 2a00c7fc-ced7-44c0-b374-110741ae6468 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:27.088280 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-16348400-9c71-44f7-9792-d41000a36b6b service neutron] 10.222.0.84 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9061990 May 12 15:19:27.093263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 19, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:19:27.093621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:27.094009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:19:27.094559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Bound port: 21fb42a3-a101-46b8-acaa-9a763a096933, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:19:27.094836 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:27.098072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 2a00c7fc-ced7-44c0-b374-110741ae6468 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:27.100104 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:27.102572 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-09ce754b-49c0-4ef8-a54c-b213ca377bab service neutron] 10.222.0.84 "GET /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9164197 May 12 15:19:27.170676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-419f884e-a1b3-424a-8e71-c14f4a4188a8 req-3148ae3c-348a-487f-abfe-ed7c87778223 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Synchronizing usage tracker for tenant:54887606d1e448bbba4720d03f57d6d1 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:27.171255 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-66b7edc8-7991-4ca0-b495-082ea58920ab tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:19:27.172271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-66b7edc8-7991-4ca0-b495-082ea58920ab tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 400 len: 373 time: 2.1410816 May 12 15:19:27.187572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-test-network-1641268880'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:27.199661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60580) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:27.274641 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:27.293667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] For port 49fa16f5-ab90-402d-8b5a-04aca0a68917, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=49fa16f5-ab90-402d-8b5a-04aca0a68917,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:27.294032 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:27.306451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '505241b0-19ae-4efc-a8a0-2ea513dcd94c', 'fixed_ip_address': '172.20.0.9'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:27.306668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dddc3497-3d22-480f-bded-055cda976c60', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2a00c7fc-ced7-44c0-b374-110741ae6468'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:27.312951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:27.317593 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 2a00c7fc-ced7-44c0-b374-110741ae6468, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2a00c7fc-ced7-44c0-b374-110741ae6468,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:27.322016 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:27.323670 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 42e13906-c0fd-470d-885c-c2d2c7e2cbfd up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:27.324077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Usage tracker for resource:network and tenant:7e2beffeb6054995b634cf99959399f4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:27.331774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:27.337095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:27.357467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Usage tracker for resource:floatingip and tenant:97c1bf81263543a888f23243db1936dd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:27.360840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:27.377513 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:27.415006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-419f884e-a1b3-424a-8e71-c14f4a4188a8 req-3148ae3c-348a-487f-abfe-ed7c87778223 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Unset dirty status for tenant:54887606d1e448bbba4720d03f57d6d1 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:27.423445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-419f884e-a1b3-424a-8e71-c14f4a4188a8 req-3148ae3c-348a-487f-abfe-ed7c87778223 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/security-groups?id=31d58a41-3845-471a-98c8-ed2f43418af7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4277534 May 12 15:19:27.431702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:27.468370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Made reservation on behalf of 7e2beffeb6054995b634cf99959399f4 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:27.469809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=2a00c7fc-ced7-44c0-b374-110741ae6468,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:27.471887 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:27.490589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] For port 21fb42a3-a101-46b8-acaa-9a763a096933, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:19:27.503410 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:27.509077 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:27.517668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:27.518429 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:27.522838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1532fc6e-64cb-41ae-8746-0933f898215b req-5a6e70cc-808b-4f22-8bdd-46c5386f36e9 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:27.523558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1532fc6e-64cb-41ae-8746-0933f898215b req-5a6e70cc-808b-4f22-8bdd-46c5386f36e9 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Synchronizing usage tracker for tenant:f304b3ab44174793b8f251ca5bae6bc1 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:27.529299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] For port 21fb42a3-a101-46b8-acaa-9a763a096933, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=21fb42a3-a101-46b8-acaa-9a763a096933,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:19:27.534037 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:27.560949 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:27.601338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] Calling delete_port for 49fa16f5-ab90-402d-8b5a-04aca0a68917 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:27.643720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:27.666802 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:27.688032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-9708c0ef-ca67-4d11-94db-5be2a2c8e490 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:27.689803 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-9708c0ef-ca67-4d11-94db-5be2a2c8e490 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.8658006 May 12 15:19:27.705288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=42e13906-c0fd-470d-885c-c2d2c7e2cbfd,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:27.710875 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:27.783756 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Usage tracker for resource:security_group_rule and tenant:7e2beffeb6054995b634cf99959399f4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:27.788378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=42e13906-c0fd-470d-885c-c2d2c7e2cbfd,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:27.807470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:27.818768 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-1dd8b765-caf8-4e68-bfcb-db91bf22d204 service neutron] 10.222.0.84 "GET /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6733117 May 12 15:19:27.835970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b2b9df2-3cd0-4908-a652-9713f27bb871 req-6a94d8af-aaed-4880-b030-e92d5727ee36 service neutron] 10.222.0.84 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7324777 May 12 15:19:27.854153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1532fc6e-64cb-41ae-8746-0933f898215b req-5a6e70cc-808b-4f22-8bdd-46c5386f36e9 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Unset dirty status for tenant:f304b3ab44174793b8f251ca5bae6bc1 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:27.855290 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1532fc6e-64cb-41ae-8746-0933f898215b req-5a6e70cc-808b-4f22-8bdd-46c5386f36e9 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/networks?id=5cc57423-d06b-48b4-8acf-9dcfbe4dc681 HTTP/1.1" status: 200 len: 825 time: 0.7714064 May 12 15:19:27.874481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:27.875094 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:27.876404 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] 10.222.0.84 "PUT /v2.0/ports/21fb42a3-a101-46b8-acaa-9a763a096933 HTTP/1.1" status: 200 len: 1096 time: 2.3630419 May 12 15:19:27.880727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3105e403-7d5f-4c02-9e2c-f6f26de448a3', 'tag': '21fb42a3-a101-46b8-acaa-9a763a096933'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:27.885510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:27.917980 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-13111d4e-5d7e-4624-8325-c0dc4b727e7e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e HTTP/1.1" status: 200 len: 217 time: 0.0684609 May 12 15:19:27.935544 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1532fc6e-64cb-41ae-8746-0933f898215b req-cab422a9-f864-486a-882c-b2c093c15eab tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/quotas/f304b3ab44174793b8f251ca5bae6bc1 HTTP/1.1" status: 200 len: 375 time: 0.0581052 May 12 15:19:28.024449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb9af93f-ba8d-4ab9-9555-7bfa01bc63e3 service neutron] Pushing event updated for resources: {'Port': ['ID=21fb42a3-a101-46b8-acaa-9a763a096933,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:28.063937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1532fc6e-64cb-41ae-8746-0933f898215b req-cd00fafd-c88d-427a-83ab-16df028ef7ba tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=f304b3ab44174793b8f251ca5bae6bc1&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1096597 May 12 15:19:28.091690 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-5b709451-531e-4ae2-9706-acb2f2bd3109 service neutron] 10.222.0.84 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3854539 May 12 15:19:28.156410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-6b82582e-57a7-4f02-8fdd-18d7b741dbdc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:28.157902 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-6b82582e-57a7-4f02-8fdd-18d7b741dbdc service neutron] 10.222.0.84 "GET /v2.0/subnets?id=6457d378-be74-408c-98d5-b411738c6998 HTTP/1.1" status: 200 len: 797 time: 0.1978908 May 12 15:19:28.216219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d769f03e-f5bb-43a0-8fc2-931a7082ed0d req-1add8f25-ac0f-4eea-ae69-a1712be7e500 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:28.217694 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d769f03e-f5bb-43a0-8fc2-931a7082ed0d req-1add8f25-ac0f-4eea-ae69-a1712be7e500 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 949 time: 0.6630595 May 12 15:19:28.322521 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:28.379233 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d769f03e-f5bb-43a0-8fc2-931a7082ed0d req-b2e1e4af-ea1f-4b24-b1c6-9d5d0a87f7bd tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/security-groups?id=b7d21fce-afb7-42cc-82c4-78d280cb5d2d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1410637 May 12 15:19:28.386740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d6d03a0-193a-4c41-babd-a379fa017b47 req-9b48e5a9-3d00-4477-91ee-29df3a7ce603 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:28.388173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d6d03a0-193a-4c41-babd-a379fa017b47 req-9b48e5a9-3d00-4477-91ee-29df3a7ce603 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=07c1472fa162425e9303d95e5e843c64&device_id=91efc3d2-c9e0-4867-98a8-80db504551ad HTTP/1.1" status: 200 len: 1094 time: 0.4299922 May 12 15:19:28.389873 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:28.393170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] Pushing event deleted for resources: {'Port': ['ID=49fa16f5-ab90-402d-8b5a-04aca0a68917,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:28.403051 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1532fc6e-64cb-41ae-8746-0933f898215b req-2732b5fa-9202-4b1c-a281-c0a7f4371e43 service neutron] 10.222.0.82 "GET /v2.0/networks/5cc57423-d06b-48b4-8acf-9dcfbe4dc681?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3165114 May 12 15:19:28.403051 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:28.428192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-164dd91c-9418-4b86-8b2d-dd880c389577 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:28.429690 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-164dd91c-9418-4b86-8b2d-dd880c389577 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=54887606d1e448bbba4720d03f57d6d1&device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 1099 time: 0.4326353 May 12 15:19:28.531219 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:28.551101 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-27e3c80e-ae2d-4c20-ac0c-2f6207de7d62 req-2a0db73d-c8ff-4ce3-bae7-2dbe263a2490 service neutron] 10.222.0.84 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4485714 May 12 15:19:28.556830 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-3f2c13bd-b712-4c54-a52f-0ddad60fc777 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.190&port_id=21fb42a3-a101-46b8-acaa-9a763a096933 HTTP/1.1" status: 200 len: 217 time: 0.1091549 May 12 15:19:28.621004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-2a8af334-ee35-4f98-90ed-d2a03de58885 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:28.621994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 581} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:19:28.622490 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-2a8af334-ee35-4f98-90ed-d2a03de58885 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=c5f75c23-a033-42fa-b7cd-dcbda413fa9a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1161 time: 0.4446719 May 12 15:19:28.634636 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:28.687579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0d7a9811-8986-41ae-b595-b5d1ada20e95,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:28.712357 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:28.712695 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Added segment 8d095e1b-5127-4deb-b7f8-edd087607a01 of type vlan for network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 May 12 15:19:28.810143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-dd9fb97e-a453-4607-96b6-34f568a50648 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:28.811477 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-dd9fb97e-a453-4607-96b6-34f568a50648 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2428744 May 12 15:19:28.867950 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:28.886719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d6d03a0-193a-4c41-babd-a379fa017b47 req-e63c80dd-96ec-464b-9c97-a27830a22e82 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:28.888141 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d6d03a0-193a-4c41-babd-a379fa017b47 req-e63c80dd-96ec-464b-9c97-a27830a22e82 service neutron] 10.222.0.84 "GET /v2.0/networks?id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d HTTP/1.1" status: 200 len: 917 time: 0.4924946 May 12 15:19:28.897542 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1532fc6e-64cb-41ae-8746-0933f898215b req-4e7487db-a365-42de-92cf-c399b5d934cc service neutron] 10.222.0.82 "GET /v2.0/networks/5cc57423-d06b-48b4-8acf-9dcfbe4dc681?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4827683 May 12 15:19:28.985761 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d6d03a0-193a-4c41-babd-a379fa017b47 req-239792b8-f07b-49cd-8cf4-6d8c3104add7 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e795cd0b-ae34-4489-9acc-774faf0d6935 HTTP/1.1" status: 200 len: 217 time: 0.0858707 May 12 15:19:29.058628 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1db69748-9df8-4dcb-a594-3b65b59ed462'] response: {'server_uuid': 'dddc3497-3d22-480f-bded-055cda976c60', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2a00c7fc-ced7-44c0-b374-110741ae6468', 'code': 200} May 12 15:19:29.059948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Allocated IP 172.25.8.97 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/a53ab622-c701-453e-a3e2-64d5b2ec4acd) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:29.064574 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:29.071696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:29.072487 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:29.084684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7aca8b3-9a11-4d75-8443-c90b0510de6c req-95ab7668-cc57-4101-b849-4289f2829862 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:29.086563 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7aca8b3-9a11-4d75-8443-c90b0510de6c req-95ab7668-cc57-4101-b849-4289f2829862 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 943 time: 0.5695786 May 12 15:19:29.126646 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a1ca5a73-4814-49ed-a53c-9f8a27949161'] response: {'name': 'network-changed', 'server_uuid': '3105e403-7d5f-4c02-9e2c-f6f26de448a3', 'tag': '21fb42a3-a101-46b8-acaa-9a763a096933', 'status': 'completed', 'code': 200} May 12 15:19:29.139651 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:29.148395 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:29.287078 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:29.287613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 301de57f-75b6-4323-a891-da62f7306fd1 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:19:29.294395 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-36f726d5-b2dd-4c2c-adba-afb01d865cc3 service neutron] 10.222.0.84 "GET /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6150277 May 12 15:19:29.326008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d6d03a0-193a-4c41-babd-a379fa017b47 req-7552aaf6-6fe4-4908-a030-af072017bfa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:29.327477 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d6d03a0-193a-4c41-babd-a379fa017b47 req-7552aaf6-6fe4-4908-a030-af072017bfa8 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=34e2be1a-2cbe-4227-a0bf-50d20740aa45 HTTP/1.1" status: 200 len: 855 time: 0.3293772 May 12 15:19:29.385986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-fea12a4a-ce7f-4e39-8821-833eec0745bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:29.387456 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-fea12a4a-ce7f-4e39-8821-833eec0745bc service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.4792824 May 12 15:19:29.394840 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55a65b30-c0f0-4b04-b1ed-2fecd2ecc2da req-8cc44932-016f-44e5-8ca0-de9f6d3791bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:29.396487 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-55a65b30-c0f0-4b04-b1ed-2fecd2ecc2da req-8cc44932-016f-44e5-8ca0-de9f6d3791bc service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=07c1472fa162425e9303d95e5e843c64&device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 1094 time: 0.7189507 May 12 15:19:29.528114 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:29.531521 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5e7e9cdb-f4d7-4d9a-b51b-07b38d5f57b3 admin admin] 10.222.0.82 "DELETE /v2.0/routers/301de57f-75b6-4323-a891-da62f7306fd1 HTTP/1.1" status: 204 len: 168 time: 5.5424585 May 12 15:19:29.592610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60602) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:29.645883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 799 time: 2.9667709 May 12 15:19:29.656604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-761b1ffe-e850-4e12-9e1b-b9545662c463 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Pushing event updated for resources: {'Network': ['ID=2acc598d-7e3b-4207-90c0-22b91b2e80c4,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:29.669939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ff2018-6f56-4192-8934-b085f2beb55e req-b9eb42b4-1cca-4a8d-98fc-807b1bda9d19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:29.671108 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:19:29.671398 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-00ff2018-6f56-4192-8934-b085f2beb55e req-b9eb42b4-1cca-4a8d-98fc-807b1bda9d19 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 1097 time: 0.5177405 May 12 15:19:29.691467 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7aca8b3-9a11-4d75-8443-c90b0510de6c req-31bae69e-8a16-4c67-95ca-39002ec10ef1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5783200 May 12 15:19:29.772685 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:29.778871 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4437645d-a2f6-435e-ab71-643a833d9dcb req-08cbf047-f678-431b-adee-8b3e7544d8c0 service neutron] 10.222.0.84 "GET /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4750786 May 12 15:19:29.831096 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-771fa3ed-bf18-497a-b607-7180cea8b7f1 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4235785 May 12 15:19:29.838025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Deleting subnet 4081ed9c-dabb-4f65-a1dc-a63a854f2f4a {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:19:29.863511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d6d03a0-193a-4c41-babd-a379fa017b47 req-efb3833e-9829-4ec2-986f-16955e22407f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:29.867179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55a65b30-c0f0-4b04-b1ed-2fecd2ecc2da req-5bdd7516-d602-40ad-99ce-c9572029d027 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:29.867354 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d6d03a0-193a-4c41-babd-a379fa017b47 req-efb3833e-9829-4ec2-986f-16955e22407f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4811051 May 12 15:19:29.869625 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-55a65b30-c0f0-4b04-b1ed-2fecd2ecc2da req-5bdd7516-d602-40ad-99ce-c9572029d027 service neutron] 10.222.0.84 "GET /v2.0/networks?id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d HTTP/1.1" status: 200 len: 917 time: 0.4389441 May 12 15:19:29.877167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06e2066f-75d0-43ff-9629-adcd0001487b req-a7b24f81-f70b-47a9-902c-acc648362baf tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:29.884931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06e2066f-75d0-43ff-9629-adcd0001487b req-a7b24f81-f70b-47a9-902c-acc648362baf tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 948 time: 0.6131458 May 12 15:19:29.885291 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:29.969228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06e2066f-75d0-43ff-9629-adcd0001487b req-31ee1248-e290-4ec4-94b4-2ac2477ab644 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/security-groups?id=31d58a41-3845-471a-98c8-ed2f43418af7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0834355 May 12 15:19:29.974906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:30.121230 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-55a65b30-c0f0-4b04-b1ed-2fecd2ecc2da req-7ed9187e-78a8-4edf-9f27-295eb6794380 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=466cb97c-6736-42bb-8e25-772f0b5535db HTTP/1.1" status: 200 len: 217 time: 0.1769018 May 12 15:19:30.169537 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f3c7de5-4d05-4d5b-8915-009c6ef74f36 req-3934f62b-2995-483c-8620-50ed65f5e79d tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 210 time: 0.2060637 May 12 15:19:30.200942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:30.204427 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:30.206619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:30.215398 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:30.246566 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-00ff2018-6f56-4192-8934-b085f2beb55e req-cdf544b2-090a-40a4-b012-6b6e92e1a660 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5553482 May 12 15:19:30.279941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event updated for resources: {'Port': ['ID=a53ab622-c701-453e-a3e2-64d5b2ec4acd,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:30.316477 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d6d03a0-193a-4c41-babd-a379fa017b47 req-f68e6686-1bf6-4679-972b-fa6f9fd6caf2 service neutron] 10.222.0.84 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4281576 May 12 15:19:30.326097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55a65b30-c0f0-4b04-b1ed-2fecd2ecc2da req-77fed18b-d937-46b3-8299-cffa9a7193b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:30.327805 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-55a65b30-c0f0-4b04-b1ed-2fecd2ecc2da req-77fed18b-d937-46b3-8299-cffa9a7193b7 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=34e2be1a-2cbe-4227-a0bf-50d20740aa45 HTTP/1.1" status: 200 len: 855 time: 0.1949153 May 12 15:19:30.330092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60612) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:30.335721 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cbcdcee8-5292-457a-8db8-2354a92732c4 req-084df0de-e3b4-43db-9b9a-9637b9583823 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4521117 May 12 15:19:30.339092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Request body: {'port': {'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4', 'binding:host_id': 'n-h2-841483-1', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1991134968'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:30.347109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:30.392650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Usage tracker for resource:port and tenant:082f7024cd214931b964a6ce0104131f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:30.400094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:30.409600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:30.435073 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:30.468613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Made reservation on behalf of 082f7024cd214931b964a6ce0104131f for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:30.470933 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:30.475328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3533016-7ee4-4c68-aab7-1e4f63416579 req-7fee1dc7-f1bd-4fd6-8eb9-e636e0e0e03d tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:30.476796 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3533016-7ee4-4c68-aab7-1e4f63416579 req-7fee1dc7-f1bd-4fd6-8eb9-e636e0e0e03d tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 949 time: 0.3688893 May 12 15:19:30.530891 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:30.570467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:30.610997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Usage tracker for resource:security_group_rule and tenant:082f7024cd214931b964a6ce0104131f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:30.615067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3533016-7ee4-4c68-aab7-1e4f63416579 req-0933868c-ee11-4061-807c-7aa5ec30b892 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/security-groups?id=b7d21fce-afb7-42cc-82c4-78d280cb5d2d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1065333 May 12 15:19:30.618677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:30.632460 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d6d03a0-193a-4c41-babd-a379fa017b47 req-ec51e173-3b3e-4fdc-8042-9a6dda38c663 service neutron] 10.222.0.84 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2814360 May 12 15:19:30.632460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Deleting port a53ab622-c701-453e-a3e2-64d5b2ec4acd {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:30.632460 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:30.632850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:30.705513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55a65b30-c0f0-4b04-b1ed-2fecd2ecc2da req-5b5acffe-6b40-43cc-a978-f60ebae12b11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:30.706771 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-55a65b30-c0f0-4b04-b1ed-2fecd2ecc2da req-5b5acffe-6b40-43cc-a978-f60ebae12b11 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3563101 May 12 15:19:30.747800 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:30.809225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 49fa16f5-ab90-402d-8b5a-04aca0a68917 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:19:30.828987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:30.829921 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:30.843540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 49fa16f5-ab90-402d-8b5a-04aca0a68917 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:19:30.844150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 49fa16f5-ab90-402d-8b5a-04aca0a68917 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:19:30.994781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Calling delete_port for a53ab622-c701-453e-a3e2-64d5b2ec4acd owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:31.037251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4081ed9c-dabb-4f65-a1dc-a63a854f2f4a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:31.066655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:31.073017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:31.073017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:31.073504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:31.073901 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '83974c4d-f657-4217-bb7b-39254f34c4f9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '42e13906-c0fd-470d-885c-c2d2c7e2cbfd'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:31.074034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:31.074399 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:31.074813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:31.075246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:31.075656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:31.076066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:31.076491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:31.076884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:31.077289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:31.091577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9da029b-55e2-4644-96d9-4f6a03e14e75 None None] Network aceafe3e-7a49-42ba-b541-5d9652123c2b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:19:31.119117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40e84d1b-9e22-4211-9a09-a079adf6d66a req-3817d0ee-97d9-4e69-ad74-0c123ed82d41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:31.120579 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-40e84d1b-9e22-4211-9a09-a079adf6d66a req-3817d0ee-97d9-4e69-ad74-0c123ed82d41 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=54887606d1e448bbba4720d03f57d6d1&device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 1099 time: 0.6344640 May 12 15:19:31.171673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1532fc6e-64cb-41ae-8746-0933f898215b req-11fac4d0-25d7-4ff9-9579-d6b454697d99 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:31.173172 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1532fc6e-64cb-41ae-8746-0933f898215b req-11fac4d0-25d7-4ff9-9579-d6b454697d99 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.76 "GET /v2.0/networks?id=5cc57423-d06b-48b4-8acf-9dcfbe4dc681 HTTP/1.1" status: 200 len: 825 time: 0.6001787 May 12 15:19:31.183054 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c878e0fb-712f-4a5d-9ad2-133d3d04e169 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/4081ed9c-dabb-4f65-a1dc-a63a854f2f4a HTTP/1.1" status: 204 len: 168 time: 1.5796063 May 12 15:19:31.186278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60622) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:31.201952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Request body: {'port': {'device_id': 'babd9d8f-521c-4ddd-be6a-f66817bcc244', 'network_id': '5cc57423-d06b-48b4-8acf-9dcfbe4dc681', 'admin_state_up': True, 'tenant_id': 'f304b3ab44174793b8f251ca5bae6bc1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:31.225596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee18de6-226e-4931-bc22-c3de0fcc42dd req-72622226-8cb2-493c-ac40-780b37d3503a tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:31.233294 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bee18de6-226e-4931-bc22-c3de0fcc42dd req-72622226-8cb2-493c-ac40-780b37d3503a tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 943 time: 0.3345809 May 12 15:19:31.372358 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:31.480014 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-55a65b30-c0f0-4b04-b1ed-2fecd2ecc2da req-aae8431d-31de-495e-981a-1aa0db5bfcd2 service neutron] 10.222.0.84 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7635279 May 12 15:19:31.481009 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e795cd0b-ae34-4489-9acc-774faf0d6935 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:19:31.493292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fbb5aac-d4f4-4b26-9c4b-033017894fec None None] DHCP port deletion for aceafe3e-7a49-42ba-b541-5d9652123c2b request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:19:31.500420 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-7fbb5aac-d4f4-4b26-9c4b-033017894fec None None] Deleting port 5c46c678-2e72-48d4-9add-5571a817d0fe {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:31.500918 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7fbb5aac-d4f4-4b26-9c4b-033017894fec None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:31.576779 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:31.594755 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bee18de6-226e-4931-bc22-c3de0fcc42dd req-cbae8855-243a-4274-af91-9f23e13fe7e1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3519714 May 12 15:19:31.594755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event deleted for resources: {'Port': ['ID=a53ab622-c701-453e-a3e2-64d5b2ec4acd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:31.621437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d2bdd3-b2c3-4f9f-b2ed-d4538a3822af req-85856fef-b02d-440c-88b1-efa33048d874 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:31.622849 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4d2bdd3-b2c3-4f9f-b2ed-d4538a3822af req-85856fef-b02d-440c-88b1-efa33048d874 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 948 time: 0.5359249 May 12 15:19:31.642034 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:31.647579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:31.668749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Usage tracker for resource:port and tenant:f304b3ab44174793b8f251ca5bae6bc1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:31.675642 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:31.678716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:31.697531 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b1803f18-b20f-428d-82a5-14ac2c69df34'] response: {'server_uuid': '83974c4d-f657-4217-bb7b-39254f34c4f9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '42e13906-c0fd-470d-885c-c2d2c7e2cbfd', 'code': 200} May 12 15:19:31.697747 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] device_id is not set on port 1f151708-7ccb-477f-af5d-5964cad20d70 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:19:31.765112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:31.814815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Deleting port 5c46c678-2e72-48d4-9add-5571a817d0fe {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:31.815163 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:31.815675 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e795cd0b-ae34-4489-9acc-774faf0d6935, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e795cd0b-ae34-4489-9acc-774faf0d6935,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:31.824286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40e84d1b-9e22-4211-9a09-a079adf6d66a req-1c5bdcca-80e2-4e88-a641-b52779d9284d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:31.825798 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-40e84d1b-9e22-4211-9a09-a079adf6d66a req-1c5bdcca-80e2-4e88-a641-b52779d9284d service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.6972959 May 12 15:19:31.845893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'e795cd0b-ae34-4489-9acc-774faf0d6935', 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d', 'port_id': 'e795cd0b-ae34-4489-9acc-774faf0d6935', 'mac_address': 'fa:16:3e:41:31:02', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 553, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '34e2be1a-2cbe-4227-a0bf-50d20740aa45', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:19:31.866557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4d2bdd3-b2c3-4f9f-b2ed-d4538a3822af req-77069dc1-ef0b-4393-85fe-097a2633a761 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/security-groups?id=31d58a41-3845-471a-98c8-ed2f43418af7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1887555 May 12 15:19:31.898424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Made reservation on behalf of f304b3ab44174793b8f251ca5bae6bc1 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:31.901890 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:31.922712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=899a377e-7288-4d76-8728-d6e9ec4dddcc,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:31.934634 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eee5ec75-03a5-4308-a41a-d7ebcc9c6a1c req-7342e2bc-efd2-4cad-b67f-2fcb501fc354 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 210 time: 0.0921211 May 12 15:19:31.952213 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-55a65b30-c0f0-4b04-b1ed-2fecd2ecc2da req-11428447-3815-4315-85eb-d2423400f851 service neutron] 10.222.0.84 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4514387 May 12 15:19:31.958912 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-40e84d1b-9e22-4211-9a09-a079adf6d66a req-b78ea26e-c7cd-4087-b883-9cd2dc3a27b7 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.190&port_id=21fb42a3-a101-46b8-acaa-9a763a096933 HTTP/1.1" status: 200 len: 217 time: 0.1159201 May 12 15:19:32.009490 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:32.047281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e795cd0b-ae34-4489-9acc-774faf0d6935 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:19:32.052382 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-7fbb5aac-d4f4-4b26-9c4b-033017894fec None None] For port 5c46c678-2e72-48d4-9add-5571a817d0fe, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5c46c678-2e72-48d4-9add-5571a817d0fe,segment=NetworkSegment(b6ca0527-0ae0-46e1-98b3-d59b1f312d8d),segment_id=b6ca0527-0ae0-46e1-98b3-d59b1f312d8d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:32.052894 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7fbb5aac-d4f4-4b26-9c4b-033017894fec None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:32.081135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc69e7d-1b20-4f08-840e-b3304b1e2a55 req-ebcf35a7-11f4-40dd-b793-40f30a72baa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:32.083265 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-edc69e7d-1b20-4f08-840e-b3304b1e2a55 req-ebcf35a7-11f4-40dd-b793-40f30a72baa4 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 1100 time: 0.3215072 May 12 15:19:32.087904 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] create failed (client error): The resource could not be found. May 12 15:19:32.088907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-63f1bc14-1319-4cf5-94f5-5d9e36649c5f tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 404 len: 507 time: 4.8820074 May 12 15:19:32.101435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60630) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:32.186922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-7fbb5aac-d4f4-4b26-9c4b-033017894fec None None] Calling delete_port for 5c46c678-2e72-48d4-9add-5571a817d0fe owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:32.215950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e795cd0b-ae34-4489-9acc-774faf0d6935, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e795cd0b-ae34-4489-9acc-774faf0d6935,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:32.238589 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:32.240184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 466cb97c-6736-42bb-8e25-772f0b5535db details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:19:32.262338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] For port 5c46c678-2e72-48d4-9add-5571a817d0fe, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5c46c678-2e72-48d4-9add-5571a817d0fe,segment=NetworkSegment(b6ca0527-0ae0-46e1-98b3-d59b1f312d8d),segment_id=b6ca0527-0ae0-46e1-98b3-d59b1f312d8d)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:32.262678 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:32.281791 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-edc69e7d-1b20-4f08-840e-b3304b1e2a55 req-d73fcf5a-54d8-4424-a8b5-82e403886e92 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=b7d21fce-afb7-42cc-82c4-78d280cb5d2d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1444418 May 12 15:19:32.306670 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:32.346980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 466cb97c-6736-42bb-8e25-772f0b5535db, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=466cb97c-6736-42bb-8e25-772f0b5535db,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:32.359028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=e795cd0b-ae34-4489-9acc-774faf0d6935,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:32.366692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c5459432-2bb7-4635-918e-fecca257adaf tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Deleting port 505241b0-19ae-4efc-a8a0-2ea513dcd94c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:32.367375 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c5459432-2bb7-4635-918e-fecca257adaf tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:32.369005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '466cb97c-6736-42bb-8e25-772f0b5535db', 'network_id': '0ff32f81-3ca6-41e0-8986-06dbed4ab52d', 'port_id': '466cb97c-6736-42bb-8e25-772f0b5535db', 'mac_address': 'fa:16:3e:2c:b6:c3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 553, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '34e2be1a-2cbe-4227-a0bf-50d20740aa45', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:19:32.403547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Calling delete_port for 5c46c678-2e72-48d4-9add-5571a817d0fe owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:32.404608 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7fbb5aac-d4f4-4b26-9c4b-033017894fec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:32.465296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40e84d1b-9e22-4211-9a09-a079adf6d66a req-91d53eed-3a02-49a5-a7e6-140bad4ee072 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:32.466673 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-40e84d1b-9e22-4211-9a09-a079adf6d66a req-91d53eed-3a02-49a5-a7e6-140bad4ee072 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.3643823 May 12 15:19:32.475713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5af3c45d-2c77-4b99-9843-b894a9f23b20 req-bc737d89-3603-4691-a9f3-8d25e1dcffe8 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:32.477476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5af3c45d-2c77-4b99-9843-b894a9f23b20 req-bc737d89-3603-4691-a9f3-8d25e1dcffe8 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 949 time: 0.3417337 May 12 15:19:32.479675 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fbb5aac-d4f4-4b26-9c4b-033017894fec None None] Pushing event deleted for resources: {'Port': ['ID=5c46c678-2e72-48d4-9add-5571a817d0fe,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:32.491386 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fbb5aac-d4f4-4b26-9c4b-033017894fec None None] No DVR routers for this DVR port 5c46c678-2e72-48d4-9add-5571a817d0fe on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:19:32.502220 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:19:32.507455 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:19:32.508005 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:32.528692 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 466cb97c-6736-42bb-8e25-772f0b5535db {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:19:32.538624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] device_id is not set on port 1f151708-7ccb-477f-af5d-5964cad20d70 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:19:32.546338 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 466cb97c-6736-42bb-8e25-772f0b5535db, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=466cb97c-6736-42bb-8e25-772f0b5535db,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:32.550849 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:32.554629 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5af3c45d-2c77-4b99-9843-b894a9f23b20 req-3bc70ba5-e16e-4596-a344-5e54b440cda2 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/security-groups?id=b7d21fce-afb7-42cc-82c4-78d280cb5d2d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443602 May 12 15:19:32.616476 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:32.636517 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=466cb97c-6736-42bb-8e25-772f0b5535db,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:32.664666 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Transition to ACTIVE for port object 1f151708-7ccb-477f-af5d-5964cad20d70 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:32.666616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Allocated IP 172.20.0.7 (5cc57423-d06b-48b4-8acf-9dcfbe4dc681/c687227b-891f-4ef3-8df3-ff7f6bcba26e/d54385d2-8834-44e8-aee3-938c5a10714a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:32.755045 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:32.787449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edd3326f-28ae-488e-82d2-10433704973a req-a6a6b010-640e-4ed8-b13b-1135683d0f70 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:32.789381 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-edd3326f-28ae-488e-82d2-10433704973a req-a6a6b010-640e-4ed8-b13b-1135683d0f70 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 944 time: 0.0891232 May 12 15:19:32.829219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5c46c678-2e72-48d4-9add-5571a817d0fe no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:19:32.841215 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-edd3326f-28ae-488e-82d2-10433704973a req-9861bf69-0121-4991-b4a6-1c5da41c403b tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459697 May 12 15:19:32.870908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 5c46c678-2e72-48d4-9add-5571a817d0fe {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:19:32.871254 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5c46c678-2e72-48d4-9add-5571a817d0fe not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:19:32.899866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40e84d1b-9e22-4211-9a09-a079adf6d66a req-a18d63eb-943a-4bbf-b311-2c8fae9de831 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:32.901337 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-40e84d1b-9e22-4211-9a09-a079adf6d66a req-a18d63eb-943a-4bbf-b311-2c8fae9de831 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.3997200 May 12 15:19:32.982405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['e795cd0b-ae34-4489-9acc-774faf0d6935'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:19:33.043369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Deleting port 5c46c678-2e72-48d4-9add-5571a817d0fe {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:33.044434 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:33.054172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['466cb97c-6736-42bb-8e25-772f0b5535db'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:19:33.104011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Pushing event updated for resources: {'Port': ['ID=1f151708-7ccb-477f-af5d-5964cad20d70,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:33.124902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] The port '5c46c678-2e72-48d4-9add-5571a817d0fe' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:19:33.183307 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c5459432-2bb7-4635-918e-fecca257adaf tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:33.235368 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1bab1aa-1f7c-4828-8818-3216ffbb095c req-da931047-f3e2-4dbc-8696-a75c5d093268 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 210 time: 0.1086934 May 12 15:19:33.335865 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:33.372297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca7b768-643c-4afd-a737-94fb58cac786 req-29448b52-996b-4982-a2ef-817716a9ebfb tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:33.380348 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ca7b768-643c-4afd-a737-94fb58cac786 req-29448b52-996b-4982-a2ef-817716a9ebfb tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 948 time: 0.3965528 May 12 15:19:33.410031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c5459432-2bb7-4635-918e-fecca257adaf tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Calling delete_port for 505241b0-19ae-4efc-a8a0-2ea513dcd94c owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:33.425825 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aceafe3e-7a49-42ba-b541-5d9652123c2b']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:33.438822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Checking segment: {'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:33.439183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Network hostable DHCP agents. Network: 2acc598d-7e3b-4207-90c0-22b91b2e80c4, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:19:33.445616 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b6ca0527-0ae0-46e1-98b3-d59b1f312d8d') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:33.445945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b6ca0527-0ae0-46e1-98b3-d59b1f312d8d') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:33.461966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ca7b768-643c-4afd-a737-94fb58cac786 req-7f18b4fd-ccb4-4ce8-8c84-92b1c66301f2 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/security-groups?id=31d58a41-3845-471a-98c8-ed2f43418af7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806983 May 12 15:19:33.470242 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:33.494227 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:33.500881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Releasing vlan 562 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:19:33.501278 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:33.514803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 21fb42a3-a101-46b8-acaa-9a763a096933 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: timer() May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:19:33.515003 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:19:33.579137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:19:33.595657 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-40e84d1b-9e22-4211-9a09-a079adf6d66a req-c5f0ede8-eb92-4f7f-9572-a25d0d21d1b4 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6815336 May 12 15:19:33.608346 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:33.613083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 2acc598d-7e3b-4207-90c0-22b91b2e80c4) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:33.618999 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:33.645190 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efe86aa3-7008-4043-9b24-da0322d58669 None None] Network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:19:33.657997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Pushing event deleted for resources: {'Network': ['ID=aceafe3e-7a49-42ba-b541-5d9652123c2b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:33.667017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:33.671287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:33.671627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:33.671982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:33.672340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:33.672677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:33.673008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:33.673672 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:33.674430 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:33.674769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:33.675090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:33.675413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:33.675735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:33.678090 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:33.690271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e03882bc-a19f-4807-ba4f-a5d05ffa4c67 admin admin] 10.222.0.82 "DELETE /v2.0/networks/aceafe3e-7a49-42ba-b541-5d9652123c2b HTTP/1.1" status: 204 len: 168 time: 2.4951782 May 12 15:19:33.784704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:33.785037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:33.785448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:33.803859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:33.804211 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:33.809153 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 2 to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 May 12 15:19:33.863018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:33.863352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:33.864554 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:33.884500 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c5459432-2bb7-4635-918e-fecca257adaf tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:33.886447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 21fb42a3-a101-46b8-acaa-9a763a096933, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=21fb42a3-a101-46b8-acaa-9a763a096933,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:33.894508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:33.894791 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:33.915382 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '21fb42a3-a101-46b8-acaa-9a763a096933', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '21fb42a3-a101-46b8-acaa-9a763a096933', 'mac_address': 'fa:16:3e:46:5d:85', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.190'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:19:33.933833 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 3 to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 May 12 15:19:33.953581 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-40e84d1b-9e22-4211-9a09-a079adf6d66a req-7ee4d439-480b-4668-b703-b137b12c1699 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3450711 May 12 15:19:33.966939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5459432-2bb7-4635-918e-fecca257adaf tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event deleted for resources: {'Port': ['ID=505241b0-19ae-4efc-a8a0-2ea513dcd94c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:33.983997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace6069b-faee-4ae4-bfca-22670c1b8bf3 req-eeb3a9fa-8288-4032-8948-b112151a75ba tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:33.999096 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:34.003251 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ace6069b-faee-4ae4-bfca-22670c1b8bf3 req-eeb3a9fa-8288-4032-8948-b112151a75ba tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 949 time: 0.3151238 May 12 15:19:34.037672 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60646) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:34.045764 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:34.066931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:34.067240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:34.067240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:34.075565 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ace6069b-faee-4ae4-bfca-22670c1b8bf3 req-3ec21e75-4549-4f74-8d42-df74337276a9 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/security-groups?id=b7d21fce-afb7-42cc-82c4-78d280cb5d2d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717888 May 12 15:19:34.081312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 21fb42a3-a101-46b8-acaa-9a763a096933 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:19:34.105063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 21fb42a3-a101-46b8-acaa-9a763a096933, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=21fb42a3-a101-46b8-acaa-9a763a096933,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:34.125544 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:34.154413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Network 5cc57423-d06b-48b4-8acf-9dcfbe4dc681 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:34.179725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:34.181609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Pushing event updated for resources: {'Port': ['ID=d54385d2-8834-44e8-aee3-938c5a10714a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:34.183760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:34.184084 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:34.184784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:34.224665 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 4 to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 May 12 15:19:34.229817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=21fb42a3-a101-46b8-acaa-9a763a096933,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:34.252169 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-78c35ce6-d8f9-4c10-84fd-87428afa3906 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=05b4f1ce61294fb29efb0a765ed28561&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1931944 May 12 15:19:34.256062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60652) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:34.285131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:34.286322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:34.286322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:34.320240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:34.320740 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:34.325144 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 5 to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 May 12 15:19:34.337897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aab372a6-43b0-45cb-8be8-c9835b7531d0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:34.351307 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c5459432-2bb7-4635-918e-fecca257adaf tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:34.361451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:34.362184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:34.363012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec9dd96-7891-46e7-8231-6fda7c693efc req-10cabe65-b03a-4f34-8185-e142a924ede1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:34.364760 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ec9dd96-7891-46e7-8231-6fda7c693efc req-10cabe65-b03a-4f34-8185-e142a924ede1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 944 time: 0.3042715 May 12 15:19:34.368310 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:34.368761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:34.369426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:34.387160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:34.387544 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:34.390873 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 6 to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 May 12 15:19:34.396151 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aab372a6-43b0-45cb-8be8-c9835b7531d0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:34.408547 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c5459432-2bb7-4635-918e-fecca257adaf tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "DELETE /v2.0/ports/505241b0-19ae-4efc-a8a0-2ea513dcd94c HTTP/1.1" status: 204 len: 168 time: 2.3049738 May 12 15:19:34.412576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60658) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:34.460318 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1532fc6e-64cb-41ae-8746-0933f898215b req-1d974e3b-277d-43a7-b8d6-d96a3a221187 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.2760613 May 12 15:19:34.461182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:34.461557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:34.461969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:34.462095 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ec9dd96-7891-46e7-8231-6fda7c693efc req-7c7c4daa-82f3-4f2d-b68b-d3b267b91f2d tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0843937 May 12 15:19:34.474531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Request body: {'port': {'device_id': 'babd9d8f-521c-4ddd-be6a-f66817bcc244', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:34.498591 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aab372a6-43b0-45cb-8be8-c9835b7531d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:34.503731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:34.504058 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:34.511034 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 7 to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 May 12 15:19:34.528211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aab372a6-43b0-45cb-8be8-c9835b7531d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f02964c6-c413-4fee-8742-d14649e5864e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:34.532020 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aab372a6-43b0-45cb-8be8-c9835b7531d0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:34.537318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-aab372a6-43b0-45cb-8be8-c9835b7531d0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f02964c6-c413-4fee-8742-d14649e5864e HTTP/1.1" status: 204 len: 168 time: 0.2800848 May 12 15:19:34.548741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:34.549121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:34.549462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:34.560464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:34.560735 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:34.563355 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 8 to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 May 12 15:19:34.587814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['21fb42a3-a101-46b8-acaa-9a763a096933'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:19:34.631741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:34.632322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:34.632423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:34.644816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:34.645076 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:34.647543 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 9 to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 May 12 15:19:34.665574 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:34.686030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5f3ee4d-7489-4d59-a50b-5a8d5e4ef60e tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:34.686738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c5f3ee4d-7489-4d59-a50b-5a8d5e4ef60e tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Synchronizing usage tracker for tenant:97c1bf81263543a888f23243db1936dd on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:34.693582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:34.694046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:34.694253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:34.706464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:34.706812 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:34.732541 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 10 to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 May 12 15:19:34.750893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a01a68a-366b-441b-b246-7993fdc1f900 req-fd60c884-a054-4f95-a3a2-c5ed79729b5c tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:34.753277 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a01a68a-366b-441b-b246-7993fdc1f900 req-fd60c884-a054-4f95-a3a2-c5ed79729b5c tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 931 time: 0.2133391 May 12 15:19:34.774099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:34.774436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:34.774777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:34.783053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c5f3ee4d-7489-4d59-a50b-5a8d5e4ef60e tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Unset dirty status for tenant:97c1bf81263543a888f23243db1936dd on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:34.784319 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c5f3ee4d-7489-4d59-a50b-5a8d5e4ef60e tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "GET /v2.0/ports?device_id=de2b1b2a-3800-4013-9a65-05bad4650925 HTTP/1.1" status: 200 len: 913 time: 0.3706331 May 12 15:19:34.785034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port 1f151708-7ccb-477f-af5d-5964cad20d70 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:34.785357 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port 1f151708-7ccb-477f-af5d-5964cad20d70 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:34.786438 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:34.794105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8734d18d-8159-4cbf-8b04-b67ffb8a6e71 req-3cfcfc94-b2e5-421e-affa-45bfe92df787 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:34.795934 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8734d18d-8159-4cbf-8b04-b67ffb8a6e71 req-3cfcfc94-b2e5-421e-affa-45bfe92df787 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 949 time: 0.1703100 May 12 15:19:34.796612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60668) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:34.930460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0a01a68a-366b-441b-b246-7993fdc1f900 req-236d4af8-0232-4277-b6ac-4f8c7ff96398 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Synchronizing usage tracker for tenant:f304b3ab44174793b8f251ca5bae6bc1 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:35.016913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60674) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:35.068432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0a01a68a-366b-441b-b246-7993fdc1f900 req-236d4af8-0232-4277-b6ac-4f8c7ff96398 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Unset dirty status for tenant:f304b3ab44174793b8f251ca5bae6bc1 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:35.069603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a01a68a-366b-441b-b246-7993fdc1f900 req-236d4af8-0232-4277-b6ac-4f8c7ff96398 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/security-groups?id=32ee1ea1-656f-486b-9369-2586dedf1884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2937748 May 12 15:19:35.084734 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8734d18d-8159-4cbf-8b04-b67ffb8a6e71 req-a6f5ed1e-8c34-404f-95fd-9dddfa16eb26 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/security-groups?id=b7d21fce-afb7-42cc-82c4-78d280cb5d2d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1796732 May 12 15:19:35.151303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] For port 1f151708-7ccb-477f-af5d-5964cad20d70, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:19:35.151595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempted to set empty binding levels {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:66}} May 12 15:19:35.162332 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:35.230561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:35.230561 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:35.234901 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1161b6ad-d473-4d5f-8965-36ced9de7d20 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0e49c03c26594e7fa192a1a667415ff3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2143919 May 12 15:19:35.235919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60678) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:35.285798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Pushing event updated for resources: {'Port': ['ID=1f151708-7ccb-477f-af5d-5964cad20d70,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:35.300957 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1d8615f6-1ca3-4c16-bdcd-0a554182d20b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 980 time: 4.9696417 May 12 15:19:35.306950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60682) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:35.398705 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e52f4a52-12a2-47ae-9058-ff9635ebf017 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:35.443488 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9a77f219-73e7-4c39-9dbb-20a435e67cfd tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Deleting port 1f151708-7ccb-477f-af5d-5964cad20d70 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:35.443736 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a77f219-73e7-4c39-9dbb-20a435e67cfd tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:35.444222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d54385d2-8834-44e8-aee3-938c5a10714a {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:19:35.449447 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e52f4a52-12a2-47ae-9058-ff9635ebf017 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:35.461628 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:35.497850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Transition to ACTIVE for port object d54385d2-8834-44e8-aee3-938c5a10714a will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:35.500628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e795cd0b-ae34-4489-9acc-774faf0d6935 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:35.506913 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:35.558290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec8f534-388e-449c-82a9-6321f8165406 req-fa8fc711-edff-4f5a-8501-8902d72ad977 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:35.566672 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ec8f534-388e-449c-82a9-6321f8165406 req-fa8fc711-edff-4f5a-8501-8902d72ad977 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 949 time: 0.3331342 May 12 15:19:35.621969 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port e795cd0b-ae34-4489-9acc-774faf0d6935 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:35.630496 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port e795cd0b-ae34-4489-9acc-774faf0d6935 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:35.631128 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:35.641644 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e52f4a52-12a2-47ae-9058-ff9635ebf017 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:35.697640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e52f4a52-12a2-47ae-9058-ff9635ebf017 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6948a56f-1582-47bb-8204-45bc3d46bc6f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:35.700609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Pushing event updated for resources: {'Port': ['ID=d54385d2-8834-44e8-aee3-938c5a10714a,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:35.713926 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ec8f534-388e-449c-82a9-6321f8165406 req-f0da32ae-e739-41a8-9353-b81e348f85f8 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/security-groups?id=31d58a41-3845-471a-98c8-ed2f43418af7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1373348 May 12 15:19:35.735730 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e52f4a52-12a2-47ae-9058-ff9635ebf017 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:35.736977 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e52f4a52-12a2-47ae-9058-ff9635ebf017 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6948a56f-1582-47bb-8204-45bc3d46bc6f HTTP/1.1" status: 204 len: 168 time: 0.4990745 May 12 15:19:35.791246 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:35.791975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Attempting to bind port d54385d2-8834-44e8-aee3-938c5a10714a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:35.792507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Attempting to bind port d54385d2-8834-44e8-aee3-938c5a10714a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '95b43f05-4421-4ae6-99ff-55a5c256ee01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '5cc57423-d06b-48b4-8acf-9dcfbe4dc681'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:35.793040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Attempting to bind port d54385d2-8834-44e8-aee3-938c5a10714a on network 5cc57423-d06b-48b4-8acf-9dcfbe4dc681 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:35.798401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Port d54385d2-8834-44e8-aee3-938c5a10714a on network 5cc57423-d06b-48b4-8acf-9dcfbe4dc681 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:35.798947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Attempting to bind port d54385d2-8834-44e8-aee3-938c5a10714a on network 5cc57423-d06b-48b4-8acf-9dcfbe4dc681 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:35.805374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 19, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:19:35.805823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Checking segment: {'id': '95b43f05-4421-4ae6-99ff-55a5c256ee01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '5cc57423-d06b-48b4-8acf-9dcfbe4dc681'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:35.806265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Bound using segment: {'id': '95b43f05-4421-4ae6-99ff-55a5c256ee01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '5cc57423-d06b-48b4-8acf-9dcfbe4dc681'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:19:35.807010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Bound port: d54385d2-8834-44e8-aee3-938c5a10714a, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '95b43f05-4421-4ae6-99ff-55a5c256ee01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '5cc57423-d06b-48b4-8acf-9dcfbe4dc681'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:19:35.807784 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:35.829004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '91efc3d2-c9e0-4867-98a8-80db504551ad', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e795cd0b-ae34-4489-9acc-774faf0d6935'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:35.867921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e795cd0b-ae34-4489-9acc-774faf0d6935, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e795cd0b-ae34-4489-9acc-774faf0d6935,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:35.877806 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:35.878761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 466cb97c-6736-42bb-8e25-772f0b5535db up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:35.916637 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fe2e49f7-e2f6-40aa-b9af-7893a0432d71'] response: {'server_uuid': '91efc3d2-c9e0-4867-98a8-80db504551ad', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e795cd0b-ae34-4489-9acc-774faf0d6935', 'code': 200} May 12 15:19:35.919863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] For port d54385d2-8834-44e8-aee3-938c5a10714a, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:19:35.923830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] For port d54385d2-8834-44e8-aee3-938c5a10714a, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d54385d2-8834-44e8-aee3-938c5a10714a,segment=NetworkSegment(95b43f05-4421-4ae6-99ff-55a5c256ee01),segment_id=95b43f05-4421-4ae6-99ff-55a5c256ee01)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:19:35.933828 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:36.033375 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=e795cd0b-ae34-4489-9acc-774faf0d6935,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:36.052343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 466cb97c-6736-42bb-8e25-772f0b5535db completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:36.057958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 466cb97c-6736-42bb-8e25-772f0b5535db triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:36.058326 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:36.088008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:36.088628 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:36.090183 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1532fc6e-64cb-41ae-8746-0933f898215b req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] 10.222.0.76 "PUT /v2.0/ports/d54385d2-8834-44e8-aee3-938c5a10714a HTTP/1.1" status: 200 len: 1091 time: 1.6231275 May 12 15:19:36.091647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'babd9d8f-521c-4ddd-be6a-f66817bcc244', 'tag': 'd54385d2-8834-44e8-aee3-938c5a10714a'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:36.129263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-141f9494-37fb-419b-8c96-dd37b27025d9 service neutron] Pushing event updated for resources: {'Port': ['ID=d54385d2-8834-44e8-aee3-938c5a10714a,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:36.148185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad5e5683-4f48-40bd-908c-e526c4d75c50 req-fbdd6a6f-5661-4516-8d7c-b4ebe9dd4021 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:36.149764 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad5e5683-4f48-40bd-908c-e526c4d75c50 req-fbdd6a6f-5661-4516-8d7c-b4ebe9dd4021 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=91efc3d2-c9e0-4867-98a8-80db504551ad HTTP/1.1" status: 200 len: 1096 time: 0.1407840 May 12 15:19:36.186216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-9a77f219-73e7-4c39-9dbb-20a435e67cfd tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] For port 1f151708-7ccb-477f-af5d-5964cad20d70, host n-h2-841483-1, got binding levels [] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:36.186935 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a77f219-73e7-4c39-9dbb-20a435e67cfd tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:36.264574 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad5e5683-4f48-40bd-908c-e526c4d75c50 req-4b142bd9-a2f9-4c8d-bc29-32993ecd8d59 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0648165 May 12 15:19:36.273920 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:36.279077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1532fc6e-64cb-41ae-8746-0933f898215b req-0a19885c-1cb5-4ca3-8495-e38ec88c781c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:36.280662 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1532fc6e-64cb-41ae-8746-0933f898215b req-0a19885c-1cb5-4ca3-8495-e38ec88c781c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=f304b3ab44174793b8f251ca5bae6bc1&device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 1094 time: 0.1290357 May 12 15:19:36.304054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 466cb97c-6736-42bb-8e25-772f0b5535db, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=466cb97c-6736-42bb-8e25-772f0b5535db,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:36.308149 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:36.389338 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1532fc6e-64cb-41ae-8746-0933f898215b req-98fb6058-0ddb-4e95-9bd9-6bbd6ec41368 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d54385d2-8834-44e8-aee3-938c5a10714a HTTP/1.1" status: 200 len: 217 time: 0.1020780 May 12 15:19:36.396720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=466cb97c-6736-42bb-8e25-772f0b5535db,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:36.409263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9a77f219-73e7-4c39-9dbb-20a435e67cfd tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Calling delete_port for 1f151708-7ccb-477f-af5d-5964cad20d70 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:36.458241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1532fc6e-64cb-41ae-8746-0933f898215b req-3e71fc60-12cf-45b0-8849-cc0886b437f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:36.459569 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1532fc6e-64cb-41ae-8746-0933f898215b req-3e71fc60-12cf-45b0-8849-cc0886b437f1 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c687227b-891f-4ef3-8df3-ff7f6bcba26e HTTP/1.1" status: 200 len: 865 time: 0.0638137 May 12 15:19:36.509937 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1532fc6e-64cb-41ae-8746-0933f898215b req-ba48e29d-1f4f-4745-afab-8c0dc792e302 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=5cc57423-d06b-48b4-8acf-9dcfbe4dc681&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0447321 May 12 15:19:36.529831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d91bde5-64de-48bb-9b3c-d203de7978e9 req-af37d20c-54ea-45aa-9914-d5b08dd79579 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:36.531260 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d91bde5-64de-48bb-9b3c-d203de7978e9 req-af37d20c-54ea-45aa-9914-d5b08dd79579 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.76 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 949 time: 0.8135817 May 12 15:19:36.544483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79344a01-7214-4181-9676-8586cd2225c7 req-064789fb-e9d7-4e7a-bc7b-944c8327651c tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:36.546021 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-79344a01-7214-4181-9676-8586cd2225c7 req-064789fb-e9d7-4e7a-bc7b-944c8327651c tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 944 time: 0.8685899 May 12 15:19:36.667120 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1532fc6e-64cb-41ae-8746-0933f898215b req-9440a61e-8c53-4786-86e2-eadd12060c5f service neutron] 10.222.0.76 "GET /v2.0/networks/5cc57423-d06b-48b4-8acf-9dcfbe4dc681?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1516347 May 12 15:19:36.710403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-8d91bde5-64de-48bb-9b3c-d203de7978e9 req-87c286ae-05fd-4c4a-8be9-e8511a9876e5 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Deleting port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:36.710746 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8d91bde5-64de-48bb-9b3c-d203de7978e9 req-87c286ae-05fd-4c4a-8be9-e8511a9876e5 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:36.743360 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a77f219-73e7-4c39-9dbb-20a435e67cfd tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:36.751397 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-79344a01-7214-4181-9676-8586cd2225c7 req-b06d7603-e318-46bd-ab5f-dce1b893c868 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1522155 May 12 15:19:36.796161 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75f698a5-14d0-4731-b81a-11d8d0eef015 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:36.837632 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-666cece6-fd89-4865-9dfd-6866370bcf75'] response: {'name': 'network-changed', 'server_uuid': 'babd9d8f-521c-4ddd-be6a-f66817bcc244', 'tag': 'd54385d2-8834-44e8-aee3-938c5a10714a', 'status': 'completed', 'code': 200} May 12 15:19:36.838123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60718) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:36.854251 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1532fc6e-64cb-41ae-8746-0933f898215b req-972725ed-df81-49d2-9bf2-4abf2903c215 service neutron] 10.222.0.76 "GET /v2.0/networks/5cc57423-d06b-48b4-8acf-9dcfbe4dc681?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1795862 May 12 15:19:36.897249 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a77f219-73e7-4c39-9dbb-20a435e67cfd tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Pushing event deleted for resources: {'Port': ['ID=1f151708-7ccb-477f-af5d-5964cad20d70,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:36.914701 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a77f219-73e7-4c39-9dbb-20a435e67cfd tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:36.970326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcfbd5ab-203c-45eb-ba9c-bef4e029bee6 req-ef18eed9-39bf-4e19-b5e3-068ee3d1490b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:36.971780 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fcfbd5ab-203c-45eb-ba9c-bef4e029bee6 req-ef18eed9-39bf-4e19-b5e3-068ee3d1490b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=f304b3ab44174793b8f251ca5bae6bc1&device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 1094 time: 0.0725651 May 12 15:19:37.002461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-1747196083-network', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:37.038128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cbfa396-d228-4c98-91e4-2bd4f34ce55c req-f2f141bf-dc4f-4baa-913d-9a10ef08a817 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:37.039852 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9cbfa396-d228-4c98-91e4-2bd4f34ce55c req-f2f141bf-dc4f-4baa-913d-9a10ef08a817 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 943 time: 0.5826480 May 12 15:19:37.091773 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9a77f219-73e7-4c39-9dbb-20a435e67cfd tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "DELETE /v2.0/ports/1f151708-7ccb-477f-af5d-5964cad20d70 HTTP/1.1" status: 204 len: 168 time: 1.7815671 May 12 15:19:37.129214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60724) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:37.168891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:37.184101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Usage tracker for resource:network and tenant:6357a1184f074ce2a5b5f19b5ce06e85 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:37.188539 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:37.197305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:37.263733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Made reservation on behalf of 6357a1184f074ce2a5b5f19b5ce06e85 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:37.267545 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:37.280544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcfbd5ab-203c-45eb-ba9c-bef4e029bee6 req-552309f2-dfe0-4995-a899-8a2aba3a61db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:37.283018 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fcfbd5ab-203c-45eb-ba9c-bef4e029bee6 req-552309f2-dfe0-4995-a899-8a2aba3a61db service neutron] 10.222.0.76 "GET /v2.0/networks?id=5cc57423-d06b-48b4-8acf-9dcfbe4dc681 HTTP/1.1" status: 200 len: 926 time: 0.3054545 May 12 15:19:37.293024 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:37.315481 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-61807bfe-97e4-4a6b-87de-e311df2d7927 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] GET failed (client error): The resource could not be found. May 12 15:19:37.316064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-61807bfe-97e4-4a6b-87de-e311df2d7927 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Synchronizing usage tracker for tenant:082f7024cd214931b964a6ce0104131f on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:37.320617 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9cbfa396-d228-4c98-91e4-2bd4f34ce55c req-add55e6e-8a38-412d-8bea-28c4993744ad tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/security-groups?id=32ee1ea1-656f-486b-9369-2586dedf1884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2654233 May 12 15:19:37.389176 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fcfbd5ab-203c-45eb-ba9c-bef4e029bee6 req-6614b636-fe8b-4dda-94ec-b504663c5238 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d54385d2-8834-44e8-aee3-938c5a10714a HTTP/1.1" status: 200 len: 217 time: 0.0978913 May 12 15:19:37.391968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:37.396797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Usage tracker for resource:security_group_rule and tenant:6357a1184f074ce2a5b5f19b5ce06e85 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:37.423970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-61807bfe-97e4-4a6b-87de-e311df2d7927 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Unset dirty status for tenant:082f7024cd214931b964a6ce0104131f on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:37.429638 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-61807bfe-97e4-4a6b-87de-e311df2d7927 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "GET /v2.0/ports/1f151708-7ccb-477f-af5d-5964cad20d70 HTTP/1.1" status: 404 len: 333 time: 0.2895975 May 12 15:19:37.438525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60728) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:37.443464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:37.465678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Request body: {'port': {'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-44320580'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:37.470312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:37.475987 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:37.518588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 21fb42a3-a101-46b8-acaa-9a763a096933 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:37.554238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be33caf8-fc5d-4c81-9532-ebd26330683a req-8011c188-d50e-4947-9a83-b5c54a65cd9e tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:37.555766 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be33caf8-fc5d-4c81-9532-ebd26330683a req-8011c188-d50e-4947-9a83-b5c54a65cd9e tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 949 time: 0.6469707 May 12 15:19:37.570765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:37.571265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:37.601094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcfbd5ab-203c-45eb-ba9c-bef4e029bee6 req-37909e25-f845-49b2-8220-daf688bf449b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:37.602565 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fcfbd5ab-203c-45eb-ba9c-bef4e029bee6 req-37909e25-f845-49b2-8220-daf688bf449b service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c687227b-891f-4ef3-8df3-ff7f6bcba26e HTTP/1.1" status: 200 len: 865 time: 0.2029233 May 12 15:19:37.603638 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:37.616690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 579} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:19:37.626509 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:37.626769 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Added segment 03b93164-9692-40b8-b556-05bf788275b7 of type vlan for network de9b95bc-97c4-4188-a1d0-c125f35032b0 May 12 15:19:37.655644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 21fb42a3-a101-46b8-acaa-9a763a096933 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:37.662346 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:37.662566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Made reservation on behalf of 082f7024cd214931b964a6ce0104131f for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:37.665133 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:37.665693 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 21fb42a3-a101-46b8-acaa-9a763a096933 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:37.666277 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:37.703733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be33caf8-fc5d-4c81-9532-ebd26330683a req-72d5c00c-a935-47da-b6d0-481b09f2b0bf tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/security-groups?id=b7d21fce-afb7-42cc-82c4-78d280cb5d2d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1341391 May 12 15:19:37.707009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-8d91bde5-64de-48bb-9b3c-d203de7978e9 req-87c286ae-05fd-4c4a-8be9-e8511a9876e5 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] For port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=42e13906-c0fd-470d-885c-c2d2c7e2cbfd,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:37.707428 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8d91bde5-64de-48bb-9b3c-d203de7978e9 req-87c286ae-05fd-4c4a-8be9-e8511a9876e5 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:37.721855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] device_id is not set on port afe3dc44-affc-4219-933b-2e023850e738 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:19:37.757816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6129a729-7067-4e3e-90a0-194e985be9c6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:37.760940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:37.762005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:37.762644 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:37.800220 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fcfbd5ab-203c-45eb-ba9c-bef4e029bee6 req-05cd04bf-8925-4074-bea3-3658d495b62b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=5cc57423-d06b-48b4-8acf-9dcfbe4dc681&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1093130 May 12 15:19:37.919428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0ddbfd7d-b0df-4738-9d34-ea82ba255187', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '466cb97c-6736-42bb-8e25-772f0b5535db'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:37.930236 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:37.969896 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 21fb42a3-a101-46b8-acaa-9a763a096933, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=21fb42a3-a101-46b8-acaa-9a763a096933,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:37.975358 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:38.018898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] Pushing event updated for resources: {'Network': ['ID=de9b95bc-97c4-4188-a1d0-c125f35032b0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:38.030403 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2a309c58-7ca3-4d62-8c2a-19901d44e798 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.1912966 May 12 15:19:38.033417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60736) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:38.043761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network de9b95bc-97c4-4188-a1d0-c125f35032b0 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:19:38.045083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Request body: {'subnet': {'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-1747196083-subnet', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:38.057729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-8d91bde5-64de-48bb-9b3c-d203de7978e9 req-87c286ae-05fd-4c4a-8be9-e8511a9876e5 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Calling delete_port for 42e13906-c0fd-470d-885c-c2d2c7e2cbfd owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:38.061020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:38.071107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Usage tracker for resource:subnet and tenant:6357a1184f074ce2a5b5f19b5ce06e85 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:38.075364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:38.079591 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fcfbd5ab-203c-45eb-ba9c-bef4e029bee6 req-2cdcc444-63e7-4104-a643-8888298baeb9 service neutron] 10.222.0.76 "GET /v2.0/networks/5cc57423-d06b-48b4-8acf-9dcfbe4dc681?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2221532 May 12 15:19:38.084291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:38.175100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8926e4c-5068-4d94-96f5-7166fff2372c req-eca9ff53-bba2-4824-9859-651c1520a185 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:38.182845 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8926e4c-5068-4d94-96f5-7166fff2372c req-eca9ff53-bba2-4824-9859-651c1520a185 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 949 time: 0.7028973 May 12 15:19:38.191292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Made reservation on behalf of 6357a1184f074ce2a5b5f19b5ce06e85 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:38.194272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=21fb42a3-a101-46b8-acaa-9a763a096933,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:38.194783 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:38.263203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-75f698a5-14d0-4731-b81a-11d8d0eef015 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Deleting port 1ebc52d1-efdd-4a8c-aeeb-ceb652fdbc23 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:38.263543 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75f698a5-14d0-4731-b81a-11d8d0eef015 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:38.343324 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fcfbd5ab-203c-45eb-ba9c-bef4e029bee6 req-94ec1c08-eaac-4354-ab7a-094c4eddb93a service neutron] 10.222.0.76 "GET /v2.0/networks/5cc57423-d06b-48b4-8acf-9dcfbe4dc681?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2565136 May 12 15:19:38.380236 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8926e4c-5068-4d94-96f5-7166fff2372c req-9a37b766-d2d5-4850-ad62-bdea4054c640 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/security-groups?id=31d58a41-3845-471a-98c8-ed2f43418af7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1959817 May 12 15:19:38.436068 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d93897e4-421b-46f4-a32b-93559bddca23'] response: {'server_uuid': '0ddbfd7d-b0df-4738-9d34-ea82ba255187', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '466cb97c-6736-42bb-8e25-772f0b5535db', 'code': 200} May 12 15:19:38.479587 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:38.606905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f6980e11-e336-4f1d-9b2b-4462912e9abb,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:38.616608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Checking segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:38.616960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Network hostable DHCP agents. Network: de9b95bc-97c4-4188-a1d0-c125f35032b0, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:19:38.643538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Network de9b95bc-97c4-4188-a1d0-c125f35032b0 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:19:38.656187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae8e724-163c-434d-bb83-8cfeefcd9be9 req-c31230c3-d9f7-40f0-b8b6-f0c97868337c tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:38.656778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, de9b95bc-97c4-4188-a1d0-c125f35032b0) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:38.657669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ae8e724-163c-434d-bb83-8cfeefcd9be9 req-c31230c3-d9f7-40f0-b8b6-f0c97868337c tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 945 time: 0.6102724 May 12 15:19:38.662302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23adf7f7-325f-4a36-8507-6f5135f76cd1 req-39c238be-af20-44a8-bb3d-c58719ebf2af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:38.663767 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-23adf7f7-325f-4a36-8507-6f5135f76cd1 req-39c238be-af20-44a8-bb3d-c58719ebf2af service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 1096 time: 0.1266520 May 12 15:19:38.665174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:38.665792 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:38.671115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7daf4fe9-a47f-4267-b32a-66520dd12748 None None] Network de9b95bc-97c4-4188-a1d0-c125f35032b0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:19:38.713141 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c06275fd-1fd0-4b7f-a73f-0f4c072bdd42 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.6774428 May 12 15:19:38.715017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60742) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:38.724058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:38.728312 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-23adf7f7-325f-4a36-8507-6f5135f76cd1 req-1e1d3a58-be33-4cb2-ae3f-26c15403046c service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563273 May 12 15:19:38.730515 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:38.734508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Usage tracker for resource:router and tenant:6357a1184f074ce2a5b5f19b5ce06e85 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:38.739472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:38.745938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:38.758864 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:38.760469 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:38.771507 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75f698a5-14d0-4731-b81a-11d8d0eef015 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:38.779788 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:38.800126 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8d91bde5-64de-48bb-9b3c-d203de7978e9 req-87c286ae-05fd-4c4a-8be9-e8511a9876e5 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:38.859621 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 42e13906-c0fd-470d-885c-c2d2c7e2cbfd no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:19:38.861758 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:38.901478 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 42e13906-c0fd-470d-885c-c2d2c7e2cbfd {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:19:38.901805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 42e13906-c0fd-470d-885c-c2d2c7e2cbfd not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:19:38.957051 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-de9b95bc-97c4-4188-a1d0-c125f35032b0', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:19:38.958578 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:38.972304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-75f698a5-14d0-4731-b81a-11d8d0eef015 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Calling delete_port for 1ebc52d1-efdd-4a8c-aeeb-ceb652fdbc23 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:39.011496 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ae8e724-163c-434d-bb83-8cfeefcd9be9 req-1a9cc304-bc36-4c90-a694-6d584fd0f0ac tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3287969 May 12 15:19:39.023086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87c286ae-05fd-4c4a-8be9-e8511a9876e5 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Pushing event deleted for resources: {'Port': ['ID=42e13906-c0fd-470d-885c-c2d2c7e2cbfd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:39.158355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-8d91bde5-64de-48bb-9b3c-d203de7978e9 req-87c286ae-05fd-4c4a-8be9-e8511a9876e5 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] No DVR routers for this DVR port 42e13906-c0fd-470d-885c-c2d2c7e2cbfd on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:19:39.178135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ec420c4-4acd-4bae-aead-57e9dc39bee5 req-a51a7ada-9eb1-41eb-a196-310dfd331aed tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:39.181208 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ec420c4-4acd-4bae-aead-57e9dc39bee5 req-a51a7ada-9eb1-41eb-a196-310dfd331aed tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 943 time: 0.6399484 May 12 15:19:39.184997 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8d91bde5-64de-48bb-9b3c-d203de7978e9 req-87c286ae-05fd-4c4a-8be9-e8511a9876e5 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:39.187790 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '83974c4d-f657-4217-bb7b-39254f34c4f9', 'name': 'network-vif-deleted', 'tag': '42e13906-c0fd-470d-885c-c2d2c7e2cbfd'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:39.219910 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:39.235677 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Allocated IP 172.20.0.2 (de9b95bc-97c4-4188-a1d0-c125f35032b0/f6980e11-e336-4f1d-9b2b-4462912e9abb/52453936-18ac-4c9e-b3fd-f71cdb9de4ad) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:39.309156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c388ca8f-f4ba-4076-a0b2-5d157dab07b8 req-93978357-c0fb-4d38-b87a-6020a41a988c tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Synchronizing usage tracker for tenant:51555c8decb74fe7a10ce69cc90bf9e8 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:39.328911 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:39.360085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d91bde5-64de-48bb-9b3c-d203de7978e9 req-87c286ae-05fd-4c4a-8be9-e8511a9876e5 tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.76 "DELETE /v2.0/ports/42e13906-c0fd-470d-885c-c2d2c7e2cbfd HTTP/1.1" status: 204 len: 173 time: 2.8089802 May 12 15:19:39.445076 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ec420c4-4acd-4bae-aead-57e9dc39bee5 req-af132d8e-2469-4dbb-8dd8-0d3b581379f0 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/security-groups?id=32ee1ea1-656f-486b-9369-2586dedf1884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2387264 May 12 15:19:39.445771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c388ca8f-f4ba-4076-a0b2-5d157dab07b8 req-93978357-c0fb-4d38-b87a-6020a41a988c tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] Unset dirty status for tenant:51555c8decb74fe7a10ce69cc90bf9e8 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:39.446765 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c388ca8f-f4ba-4076-a0b2-5d157dab07b8 req-93978357-c0fb-4d38-b87a-6020a41a988c tempest-ImagesNegativeTestJSON-341820084 tempest-ImagesNegativeTestJSON-341820084-project] 10.222.0.82 "GET /v2.0/ports?device_id=83974c4d-f657-4217-bb7b-39254f34c4f9 HTTP/1.1" status: 200 len: 210 time: 0.2311275 May 12 15:19:39.455112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:39.459948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:39.464954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:39.465924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:39.466978 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:39.470071 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Pushing event updated for resources: {'Port': ['ID=afe3dc44-affc-4219-933b-2e023850e738,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:39.588116 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-aafe7846-02e8-4cd8-b339-fb83b6045c68'] response: {'server_uuid': '83974c4d-f657-4217-bb7b-39254f34c4f9', 'name': 'network-vif-deleted', 'tag': '42e13906-c0fd-470d-885c-c2d2c7e2cbfd', 'status': 'completed', 'code': 200} May 12 15:19:39.591660 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1dd98193-fe85-4ab6-bafa-396cf4ad6cdf tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 958 time: 2.1451769 May 12 15:19:39.594698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60752) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:39.604924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Request body: {'port': {'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:39.668393 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:39.681712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Transition to ACTIVE for port object 52453936-18ac-4c9e-b3fd-f71cdb9de4ad will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:39.711127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Transition to ACTIVE for port object 52453936-18ac-4c9e-b3fd-f71cdb9de4ad will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:39.717920 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:39.721892 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:39.722195 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75f698a5-14d0-4731-b81a-11d8d0eef015 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:39.751133 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:39.860584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Network de9b95bc-97c4-4188-a1d0-c125f35032b0 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:39.866887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:39.874458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:39.891308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Pushing event updated for resources: {'Port': ['ID=52453936-18ac-4c9e-b3fd-f71cdb9de4ad,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:39.991373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Allocated IP 172.25.8.233 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/632ac19e-3420-4802-a558-9e900049a9cd) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:40.056805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Attempting to bind port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:40.057258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Attempting to bind port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:40.057735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Attempting to bind port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad on network de9b95bc-97c4-4188-a1d0-c125f35032b0 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:40.063831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 19, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:19:40.064340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Checking segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:40.064817 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:40.065239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Bound using segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:19:40.065750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Bound port: 52453936-18ac-4c9e-b3fd-f71cdb9de4ad, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:19:40.066160 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:40.159634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75f698a5-14d0-4731-b81a-11d8d0eef015 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event deleted for resources: {'Port': ['ID=1ebc52d1-efdd-4a8c-aeeb-ceb652fdbc23,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:40.183519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] For port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:19:40.187730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] For port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=52453936-18ac-4c9e-b3fd-f71cdb9de4ad,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:19:40.192870 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:40.248869 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:40.291930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cef630ba-995d-4f78-bbc5-393ef3e75cf1 None None] Pushing event updated for resources: {'Port': ['ID=52453936-18ac-4c9e-b3fd-f71cdb9de4ad,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:40.307938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:40.381733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:40.384553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:40.388901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:40.398079 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:40.435395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Pushing event updated for resources: {'Port': ['ID=632ac19e-3420-4802-a558-9e900049a9cd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:40.437186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3105e403-7d5f-4c02-9e2c-f6f26de448a3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '21fb42a3-a101-46b8-acaa-9a763a096933'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:40.521725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b94d7d-7efd-4d05-b3b0-7a5257f940df req-3f3c4ec4-1870-4c70-aa00-949ae34a96c9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:40.523196 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59b94d7d-7efd-4d05-b3b0-7a5257f940df req-3f3c4ec4-1870-4c70-aa00-949ae34a96c9 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 950 time: 0.8706136 May 12 15:19:40.560952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75f698a5-14d0-4731-b81a-11d8d0eef015 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:40.690450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1183fc98-876c-4abf-93ea-68fb78776281 req-ac589a17-0597-4d65-90af-dbb64e334741 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:40.692631 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1183fc98-876c-4abf-93ea-68fb78776281 req-ac589a17-0597-4d65-90af-dbb64e334741 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 945 time: 0.4694986 May 12 15:19:40.851196 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:40.858145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d54385d2-8834-44e8-aee3-938c5a10714a details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:19:40.864238 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59b94d7d-7efd-4d05-b3b0-7a5257f940df req-04d66290-eb0a-44a4-a731-591e52316ace tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/security-groups?id=31d58a41-3845-471a-98c8-ed2f43418af7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2973409 May 12 15:19:41.048315 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bbfe83ce-d20b-44dc-b377-d8715e1bb3fc'] response: {'server_uuid': '3105e403-7d5f-4c02-9e2c-f6f26de448a3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '21fb42a3-a101-46b8-acaa-9a763a096933', 'code': 200} May 12 15:19:41.050623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 52453936-18ac-4c9e-b3fd-f71cdb9de4ad up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:41.135805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d54385d2-8834-44e8-aee3-938c5a10714a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d54385d2-8834-44e8-aee3-938c5a10714a,segment=NetworkSegment(95b43f05-4421-4ae6-99ff-55a5c256ee01),segment_id=95b43f05-4421-4ae6-99ff-55a5c256ee01)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:41.158416 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'd54385d2-8834-44e8-aee3-938c5a10714a', 'network_id': '5cc57423-d06b-48b4-8acf-9dcfbe4dc681', 'port_id': 'd54385d2-8834-44e8-aee3-938c5a10714a', 'mac_address': 'fa:16:3e:0d:80:a8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 588, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c687227b-891f-4ef3-8df3-ff7f6bcba26e', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:19:41.166750 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1183fc98-876c-4abf-93ea-68fb78776281 req-a88d4def-1a80-457a-99f8-36508985ce9b tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4598401 May 12 15:19:41.206262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75f698a5-14d0-4731-b81a-11d8d0eef015 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Router de2b1b2a-3800-4013-9a65-05bad4650925 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:19:41.280767 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:41.327471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d54385d2-8834-44e8-aee3-938c5a10714a {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:19:41.363063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:41.388708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d54385d2-8834-44e8-aee3-938c5a10714a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d54385d2-8834-44e8-aee3-938c5a10714a,segment=NetworkSegment(95b43f05-4421-4ae6-99ff-55a5c256ee01),segment_id=95b43f05-4421-4ae6-99ff-55a5c256ee01)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:41.400911 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:41.424035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] device_id is not set on port afe3dc44-affc-4219-933b-2e023850e738 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:19:41.489917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:41.506336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d54385d2-8834-44e8-aee3-938c5a10714a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:41.540138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fea87cf5-2756-4e9c-aa4c-e444c1a8e582 req-718a4003-2059-49e0-85d2-13fc332697ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:41.541504 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fea87cf5-2756-4e9c-aa4c-e444c1a8e582 req-718a4003-2059-49e0-85d2-13fc332697ce service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 1101 time: 0.4973364 May 12 15:19:41.554339 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-300baa83-dc42-4440-bcfc-72fa2f44d140 None None] Network de9b95bc-97c4-4188-a1d0-c125f35032b0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:19:41.595624 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:41.595942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75f698a5-14d0-4731-b81a-11d8d0eef015 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:19:41.597713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Transition to ACTIVE for port object afe3dc44-affc-4219-933b-2e023850e738 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:41.607196 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-75f698a5-14d0-4731-b81a-11d8d0eef015 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "PUT /v2.0/routers/de2b1b2a-3800-4013-9a65-05bad4650925/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.8086002 May 12 15:19:41.610079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60768) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:41.618554 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e343f53-7494-4890-9753-6b5279781060 None None] Sync routers for ids ['de2b1b2a-3800-4013-9a65-05bad4650925'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:19:41.639312 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e343f53-7494-4890-9753-6b5279781060 None None] Routers {'de2b1b2a-3800-4013-9a65-05bad4650925'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:19:41.640343 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5e343f53-7494-4890-9753-6b5279781060 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:19:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['de2b1b2a-3800-4013-9a65-05bad4650925'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:41.649785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['d54385d2-8834-44e8-aee3-938c5a10714a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:19:41.657242 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fea87cf5-2756-4e9c-aa4c-e444c1a8e582 req-a094b2cb-3905-43e9-989f-6acd505967d2 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=31d58a41-3845-471a-98c8-ed2f43418af7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1068494 May 12 15:19:41.733579 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5e343f53-7494-4890-9753-6b5279781060 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:41.743608 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e343f53-7494-4890-9753-6b5279781060 None None] Routers {'de2b1b2a-3800-4013-9a65-05bad4650925'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:19:41.744605 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5e343f53-7494-4890-9753-6b5279781060 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:19:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['de2b1b2a-3800-4013-9a65-05bad4650925'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:41.761620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7f368007-30b1-48c9-8689-73367a62ae0a None None] Provisioning for port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:41.795753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7f368007-30b1-48c9-8689-73367a62ae0a None None] Provisioning complete for port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:41.796174 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7f368007-30b1-48c9-8689-73367a62ae0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:41.812309 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5e343f53-7494-4890-9753-6b5279781060 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:41.812957 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e343f53-7494-4890-9753-6b5279781060 None None] The sync data for ids ['de2b1b2a-3800-4013-9a65-05bad4650925'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:19:41.839745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:19:41.842596 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:41.951157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c20d7d0-4ec9-43c7-b756-59a87a307266 req-7bda6729-f28f-43b3-9057-03aa87aa2e61 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:41.952566 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c20d7d0-4ec9-43c7-b756-59a87a307266 req-7bda6729-f28f-43b3-9057-03aa87aa2e61 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 943 time: 0.8505154 May 12 15:19:42.047859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:19:42.061520 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0cb6991c-3de1-483c-ab6a-f5da90243501 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:42.062991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Sync routers for ids ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:19:42.079414 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:42.084231 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-23c84438-95ea-414d-bff2-58223ed8aa97 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 3.3656666 May 12 15:19:42.084576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60774) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:42.106271 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Routers {'bac46c5e-a9b9-49a6-89a8-7b3f401caed2'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:19:42.107043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:19:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:42.189045 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7f368007-30b1-48c9-8689-73367a62ae0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:42.243185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Pushing event updated for resources: {'Port': ['ID=afe3dc44-affc-4219-933b-2e023850e738,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:42.260500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8182c3b2-8980-4073-bb7f-eb5c723bc7fe req-bab4d4bd-995a-4d18-92c7-37cf238468af tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:42.267395 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8182c3b2-8980-4073-bb7f-eb5c723bc7fe req-bab4d4bd-995a-4d18-92c7-37cf238468af tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 946 time: 0.8163080 May 12 15:19:42.341248 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c20d7d0-4ec9-43c7-b756-59a87a307266 req-a9e0e1c7-48e3-4250-8834-a2068b8f9fe5 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/security-groups?id=32ee1ea1-656f-486b-9369-2586dedf1884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3707809 May 12 15:19:42.341962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:42.342296 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:42.342731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:42.397703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-7f368007-30b1-48c9-8689-73367a62ae0a None None] For port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=52453936-18ac-4c9e-b3fd-f71cdb9de4ad,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:42.414092 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7f368007-30b1-48c9-8689-73367a62ae0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:42.444063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:42.444452 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:42.500932 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f368007-30b1-48c9-8689-73367a62ae0a None None] Pushing event updated for resources: {'Port': ['ID=52453936-18ac-4c9e-b3fd-f71cdb9de4ad,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:42.518049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Set router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:19:42.573905 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 2 to bind port afe3dc44-affc-4219-933b-2e023850e738 May 12 15:19:42.597080 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0cb6991c-3de1-483c-ab6a-f5da90243501 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:42.631858 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0cb6991c-3de1-483c-ab6a-f5da90243501 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:42.637331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8182c3b2-8980-4073-bb7f-eb5c723bc7fe req-661e6cd9-b465-4d42-bdd8-3a38aa9cd64a tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3691251 May 12 15:19:42.658008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:42.658343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:42.658678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:42.712646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:42.713025 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:42.715248 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 3 to bind port afe3dc44-affc-4219-933b-2e023850e738 May 12 15:19:42.742953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:42.743315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:42.743652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:42.749831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0cb6991c-3de1-483c-ab6a-f5da90243501 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:42.751490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0cb6991c-3de1-483c-ab6a-f5da90243501 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Fanout notify agent at l3_agent the message router_deleted on router de2b1b2a-3800-4013-9a65-05bad4650925 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:19:42.757715 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4fbeb004-3103-421c-bba0-438a576f56e6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:42.791202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:42.791886 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:42.796699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-55414b24-131d-41af-bb83-0000b28d5f7a None None] Provisioning complete for port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:42.797159 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-55414b24-131d-41af-bb83-0000b28d5f7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:42.803632 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 4 to bind port afe3dc44-affc-4219-933b-2e023850e738 May 12 15:19:42.861703 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:42.882957 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0cb6991c-3de1-483c-ab6a-f5da90243501 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:42.884486 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0cb6991c-3de1-483c-ab6a-f5da90243501 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "DELETE /v2.0/routers/de2b1b2a-3800-4013-9a65-05bad4650925 HTTP/1.1" status: 204 len: 168 time: 1.2733679 May 12 15:19:42.890580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60784) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:42.891852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 52453936-18ac-4c9e-b3fd-f71cdb9de4ad up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:42.898366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:42.898782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:42.899189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:42.939951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:42.941257 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:42.945967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d54385d2-8834-44e8-aee3-938c5a10714a up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:42.960538 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 5 to bind port afe3dc44-affc-4219-933b-2e023850e738 May 12 15:19:43.007858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:43.008096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:43.008428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:43.018400 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:43.040335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a543f85-c611-4b6a-afbe-ce7e09a30d5b req-848d903c-0bd1-484b-9c12-04a1b78dabc6 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:43.042488 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a543f85-c611-4b6a-afbe-ce7e09a30d5b req-848d903c-0bd1-484b-9c12-04a1b78dabc6 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 950 time: 0.4608717 May 12 15:19:43.047526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-987806f9-5e02-4ca4-b4f8-cdd693391c79 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Deleting subnet 47a3363b-4cb0-42be-951a-7f0b619f2d69 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:19:43.049883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:43.050383 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:43.057204 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 6 to bind port afe3dc44-affc-4219-933b-2e023850e738 May 12 15:19:43.067631 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-987806f9-5e02-4ca4-b4f8-cdd693391c79 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:43.142857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:43.143201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:43.143557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:43.171360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:43.171933 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:43.174082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7f2609-e43a-4f72-b18c-8694ef13be8d req-f030ba4c-8133-49b6-aceb-d7f3a95e1158 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:43.175598 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e7f2609-e43a-4f72-b18c-8694ef13be8d req-f030ba4c-8133-49b6-aceb-d7f3a95e1158 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=91efc3d2-c9e0-4867-98a8-80db504551ad HTTP/1.1" status: 200 len: 945 time: 0.3544109 May 12 15:19:43.177563 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:43.177909 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:43.182361 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 7 to bind port afe3dc44-affc-4219-933b-2e023850e738 May 12 15:19:43.190822 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-987806f9-5e02-4ca4-b4f8-cdd693391c79 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:43.198929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port d54385d2-8834-44e8-aee3-938c5a10714a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:43.224559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port d54385d2-8834-44e8-aee3-938c5a10714a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:43.225194 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:43.274589 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a543f85-c611-4b6a-afbe-ce7e09a30d5b req-737a2406-07d5-454f-a5b8-ee8a53357f8b tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/security-groups?id=31d58a41-3845-471a-98c8-ed2f43418af7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2189481 May 12 15:19:43.278613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:43.278947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:43.279284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:43.300455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:43.302102 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:43.319223 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 8 to bind port afe3dc44-affc-4219-933b-2e023850e738 May 12 15:19:43.321428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233'}], 'enable_snat': True}, 'gw_port_id': '632ac19e-3420-4802-a558-9e900049a9cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:19:40Z', 'revision_number': 3, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port': {'id': '632ac19e-3420-4802-a558-9e900049a9cd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:3a:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1391, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:39Z', 'updated_at': '2022-05-12T15:19:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:43.352591 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e7f2609-e43a-4f72-b18c-8694ef13be8d req-e52397a0-502a-4a8e-a3c2-ace53a0ae331 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1324778 May 12 15:19:43.376573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:43.376916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:43.377379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:43.392860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:43.393192 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:43.411973 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 9 to bind port afe3dc44-affc-4219-933b-2e023850e738 May 12 15:19:43.412493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Checking router: bac46c5e-a9b9-49a6-89a8-7b3f401caed2 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:19:43.412841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Updating router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 port 632ac19e-3420-4802-a558-9e900049a9cd binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:19:43.461280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:43.461634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:43.461890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:43.468354 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-987806f9-5e02-4ca4-b4f8-cdd693391c79 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:43.505351 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:43.516813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Allocated IP 172.20.0.1 (de9b95bc-97c4-4188-a1d0-c125f35032b0/f6980e11-e336-4f1d-9b2b-4462912e9abb/314d24d4-b40e-49e9-a854-c0e11db13316) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:43.526405 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:43.544004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:43.544339 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:43.547619 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 10 to bind port afe3dc44-affc-4219-933b-2e023850e738 May 12 15:19:43.580675 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'babd9d8f-521c-4ddd-be6a-f66817bcc244', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd54385d2-8834-44e8-aee3-938c5a10714a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:43.597419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d54385d2-8834-44e8-aee3-938c5a10714a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d54385d2-8834-44e8-aee3-938c5a10714a,segment=NetworkSegment(95b43f05-4421-4ae6-99ff-55a5c256ee01),segment_id=95b43f05-4421-4ae6-99ff-55a5c256ee01)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:43.640703 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:43.644464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:43.645090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:43.645470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:43.659653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:43.659980 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port afe3dc44-affc-4219-933b-2e023850e738 on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:43.660650 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:43.701643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a5e4b1-8cf7-416d-8c90-8bf671f7245e req-08a1edce-8087-4c17-9587-7d601f6a30d5 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:43.709088 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3a5e4b1-8cf7-416d-8c90-8bf671f7245e req-08a1edce-8087-4c17-9587-7d601f6a30d5 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 944 time: 0.1663349 May 12 15:19:43.746386 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:43.768310 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-987806f9-5e02-4ca4-b4f8-cdd693391c79 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:43.771976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Transition to ACTIVE for port object 314d24d4-b40e-49e9-a854-c0e11db13316 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:43.804895 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:43.807244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d54385d2-8834-44e8-aee3-938c5a10714a,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:43.890051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Network de9b95bc-97c4-4188-a1d0-c125f35032b0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:43.892844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:43.897626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:43.943508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Pushing event updated for resources: {'Port': ['ID=314d24d4-b40e-49e9-a854-c0e11db13316,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:43.972353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:43.994717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-987806f9-5e02-4ca4-b4f8-cdd693391c79 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event deleted for resources: {'Subnet': ['ID=47a3363b-4cb0-42be-951a-7f0b619f2d69,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:44.003664 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-987806f9-5e02-4ca4-b4f8-cdd693391c79 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.010901 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-987806f9-5e02-4ca4-b4f8-cdd693391c79 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "DELETE /v2.0/subnets/47a3363b-4cb0-42be-951a-7f0b619f2d69 HTTP/1.1" status: 204 len: 168 time: 1.1180503 May 12 15:19:44.013370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6c8356b-9b87-4126-8e63-31ca74799982 None None] Network 674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:19:44.035707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60800) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:44.040578 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.050828 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3a5e4b1-8cf7-416d-8c90-8bf671f7245e req-e43cdb57-3cac-4189-9d99-ada4eea93b8e tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/security-groups?id=32ee1ea1-656f-486b-9369-2586dedf1884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3407304 May 12 15:19:44.135788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Transition to ACTIVE for port object 632ac19e-3420-4802-a558-9e900049a9cd will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:44.163565 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.347972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] For port afe3dc44-affc-4219-933b-2e023850e738, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:19:44.348785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempted to set empty binding levels {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:66}} May 12 15:19:44.359938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.408761 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.410984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79e4cad9-8d42-4913-9bf7-ab01882f69e2 None None] Pushing event updated for resources: {'Port': ['ID=632ac19e-3420-4802-a558-9e900049a9cd,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:44.415491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Attempting to bind port 632ac19e-3420-4802-a558-9e900049a9cd on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:44.415698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Attempting to bind port 632ac19e-3420-4802-a558-9e900049a9cd by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:44.415913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Attempting to bind port 632ac19e-3420-4802-a558-9e900049a9cd on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:44.422774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-70b6056e-0f97-4ed6-9cff-606d4af82c0b None None] Provisioning for port 314d24d4-b40e-49e9-a854-c0e11db13316 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:44.428906 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 19, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:19:44.429276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:44.429716 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.430107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:19:44.430624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Bound port: 632ac19e-3420-4802-a558-9e900049a9cd, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:19:44.430938 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.458563 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9175b79e-4112-4620-8bba-2f2590583eec'] response: {'server_uuid': 'babd9d8f-521c-4ddd-be6a-f66817bcc244', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd54385d2-8834-44e8-aee3-938c5a10714a', 'code': 200} May 12 15:19:44.466613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-70b6056e-0f97-4ed6-9cff-606d4af82c0b None None] Provisioning complete for port 314d24d4-b40e-49e9-a854-c0e11db13316 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:44.466986 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-70b6056e-0f97-4ed6-9cff-606d4af82c0b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.518889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] In _notify_port_updated(), no bound segment for port afe3dc44-affc-4219-933b-2e023850e738 on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88152) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:19:44.520299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:44.520998 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.522342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "PUT /v2.0/ports/afe3dc44-affc-4219-933b-2e023850e738 HTTP/1.1" status: 200 len: 973 time: 4.9267616 May 12 15:19:44.532344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60808) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:44.570247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-70b6056e-0f97-4ed6-9cff-606d4af82c0b None None] Port 314d24d4-b40e-49e9-a854-c0e11db13316 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:19:44.581090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] For port 632ac19e-3420-4802-a558-9e900049a9cd, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:19:44.595022 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] For port 632ac19e-3420-4802-a558-9e900049a9cd, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=632ac19e-3420-4802-a558-9e900049a9cd,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:19:44.601657 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.608958 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.678746 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50caa839-d907-406c-996e-09048cd07402 None None] DHCP port deletion for 674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:19:44.689161 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-50caa839-d907-406c-996e-09048cd07402 None None] Deleting port b70ef405-82b6-4381-8ce4-2ee29d93182b {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:44.689920 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-50caa839-d907-406c-996e-09048cd07402 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.723706 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baaa922f-30c2-4e9d-bfbb-6ba07d61a193 req-485a59f5-d75c-418e-8538-4909bbb402d5 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:44.732561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Routers {'bac46c5e-a9b9-49a6-89a8-7b3f401caed2'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:19:44.732561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:19:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:44.733298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-baaa922f-30c2-4e9d-bfbb-6ba07d61a193 req-485a59f5-d75c-418e-8538-4909bbb402d5 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 945 time: 0.7955446 May 12 15:19:44.739846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60814) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:44.743478 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.750283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.814992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Deleting port b70ef405-82b6-4381-8ce4-2ee29d93182b {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:44.815580 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.844247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79e4cad9-8d42-4913-9bf7-ab01882f69e2 None None] Pushing event updated for resources: {'Port': ['ID=632ac19e-3420-4802-a558-9e900049a9cd,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:44.851528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Pushing event updated for resources: {'Port': ['ID=314d24d4-b40e-49e9-a854-c0e11db13316,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:44.900590 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:44.921049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eb6d69e-491c-4d72-907e-dbbc2fdd223b tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Pushing event updated for resources: {'Port': ['ID=afe3dc44-affc-4219-933b-2e023850e738,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:44.954069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b70ef405-82b6-4381-8ce4-2ee29d93182b no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:19:44.996642 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-55909bed-f912-4e71-a5b1-8b86807ed2c4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:45.010749 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-baaa922f-30c2-4e9d-bfbb-6ba07d61a193 req-730f3285-2c9a-4182-8350-8fb051609c27 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2757528 May 12 15:19:45.066186 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6b83d4dd-5dc7-464d-a2b5-9f5c4985d798 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=51555c8decb74fe7a10ce69cc90bf9e8&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3251257 May 12 15:19:45.077378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60822) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:45.118892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Network de9b95bc-97c4-4188-a1d0-c125f35032b0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:45.122395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:45.164297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] Set router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:19:45.171487 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d885622e-ac9c-44dc-ab4d-e2c6027970b8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:45.250118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96451326-6e37-47b8-8520-c247bbab3060 req-cd06d900-023d-436a-92ee-ce7860a353d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.251627 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96451326-6e37-47b8-8520-c247bbab3060 req-cd06d900-023d-436a-92ee-ce7860a353d4 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 1096 time: 0.6175771 May 12 15:19:45.315175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d885622e-ac9c-44dc-ab4d-e2c6027970b8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:45.335534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.336273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.336874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.338206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.348333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.351476 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.352254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.352871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.353520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.354274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.354911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.355891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.356511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.357112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.357866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.358477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.359181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.361013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.362238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.363047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.364875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.365682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.366402 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.367146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.367773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.368456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.369142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.370039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.371005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.371814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.372443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.375444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Synchronizing usage tracker for tenant:082f7024cd214931b964a6ce0104131f on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:45.423945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-50caa839-d907-406c-996e-09048cd07402 None None] For port b70ef405-82b6-4381-8ce4-2ee29d93182b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b70ef405-82b6-4381-8ce4-2ee29d93182b,segment=NetworkSegment(6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f),segment_id=6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:45.424490 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-50caa839-d907-406c-996e-09048cd07402 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:45.443636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe44e4d-d3db-4ef5-bb6f-5a4f3c350865 req-2cce8d04-f2a2-4f74-a987-e17419895b80 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:45.450118 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ffe44e4d-d3db-4ef5-bb6f-5a4f3c350865 req-2cce8d04-f2a2-4f74-a987-e17419895b80 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 950 time: 0.7937207 May 12 15:19:45.452521 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d885622e-ac9c-44dc-ab4d-e2c6027970b8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:45.491637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d885622e-ac9c-44dc-ab4d-e2c6027970b8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b7d21fce-afb7-42cc-82c4-78d280cb5d2d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:45.526136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Unset dirty status for tenant:082f7024cd214931b964a6ce0104131f on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:45.531676 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-25258822-8a9f-48f2-ab59-134a338ff68f tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 28003 time: 0.9943938 May 12 15:19:45.531823 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:45.545538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60828) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:45.553611 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d885622e-ac9c-44dc-ab4d-e2c6027970b8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:45.562089 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d885622e-ac9c-44dc-ab4d-e2c6027970b8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b7d21fce-afb7-42cc-82c4-78d280cb5d2d HTTP/1.1" status: 204 len: 168 time: 0.4789844 May 12 15:19:45.594400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] For port b70ef405-82b6-4381-8ce4-2ee29d93182b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b70ef405-82b6-4381-8ce4-2ee29d93182b,segment=NetworkSegment(6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f),segment_id=6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:45.594756 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:45.663055 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-50caa839-d907-406c-996e-09048cd07402 None None] Calling delete_port for b70ef405-82b6-4381-8ce4-2ee29d93182b owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:45.736115 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Calling delete_port for b70ef405-82b6-4381-8ce4-2ee29d93182b owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:45.767596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:19:45.834367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e6c656f-c0ff-4372-ba65-ef8646be5205 None None] Provisioning complete for port 314d24d4-b40e-49e9-a854-c0e11db13316 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:45.834733 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e6c656f-c0ff-4372-ba65-ef8646be5205 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:45.840786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96451326-6e37-47b8-8520-c247bbab3060 req-fafb91f8-4b93-4130-9be2-ee5914ccc005 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=32ee1ea1-656f-486b-9369-2586dedf1884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4614820 May 12 15:19:45.880753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ffe44e4d-d3db-4ef5-bb6f-5a4f3c350865 req-0c46b436-5c71-4de4-8721-b8e91195c2c4 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/security-groups?id=31d58a41-3845-471a-98c8-ed2f43418af7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3788559 May 12 15:19:45.890870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port b70ef405-82b6-4381-8ce4-2ee29d93182b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b70ef405-82b6-4381-8ce4-2ee29d93182b,segment=NetworkSegment(6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f),segment_id=6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:45.936327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-488313f4-2288-41ec-978f-515b98eb5c77 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Deleting port afe3dc44-affc-4219-933b-2e023850e738 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:45.936670 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-488313f4-2288-41ec-978f-515b98eb5c77 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:45.943384 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:46.001707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33fa0b27-d6a5-4e5c-858b-de69cdb942cd req-249f1a7f-4f9c-4486-aa68-70f4d70ece57 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:46.003416 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33fa0b27-d6a5-4e5c-858b-de69cdb942cd req-249f1a7f-4f9c-4486-aa68-70f4d70ece57 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 946 time: 0.5837564 May 12 15:19:46.004196 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:19:46.004707 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:19:46.105259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:19:46.116361 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-69513d52-4398-47a6-87d0-145b2cea62c8 admin admin] 10.222.0.82 "PUT /v2.0/routers/bac46c5e-a9b9-49a6-89a8-7b3f401caed2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0306997 May 12 15:19:46.140879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e6c656f-c0ff-4372-ba65-ef8646be5205 None None] Port 314d24d4-b40e-49e9-a854-c0e11db13316 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:19:46.143161 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-50caa839-d907-406c-996e-09048cd07402 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:19:46.143161 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-50caa839-d907-406c-996e-09048cd07402 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:19:46.155437 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:46.161298 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:46.164204 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=b70ef405-82b6-4381-8ce4-2ee29d93182b,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:46.177553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233'}], 'enable_snat': True}, 'gw_port_id': '632ac19e-3420-4802-a558-9e900049a9cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 4, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port': {'id': '632ac19e-3420-4802-a558-9e900049a9cd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:3a:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1391, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:39Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '314d24d4-b40e-49e9-a854-c0e11db13316', 'name': '', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'mac_address': 'fa:16:3e:a8:8a:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_interface', 'standard_attr_id': 1392, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:43Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 2, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'subnets': [{'id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:46.183469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6360c1d-5d50-4c82-82ec-aefefc184b6a None None] The sync data for ids ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'] in n-d-841483-1 is: [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233'}], 'enable_snat': True}, 'gw_port_id': '632ac19e-3420-4802-a558-9e900049a9cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 4, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port': {'id': '632ac19e-3420-4802-a558-9e900049a9cd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:3a:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1391, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:39Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '314d24d4-b40e-49e9-a854-c0e11db13316', 'name': '', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'mac_address': 'fa:16:3e:a8:8a:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_interface', 'standard_attr_id': 1392, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:43Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 2, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'subnets': [{'id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:19:46.201014 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33fa0b27-d6a5-4e5c-858b-de69cdb942cd req-636fabae-f831-4c5b-8f86-839a2a859a46 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1885068 May 12 15:19:46.463650 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-488313f4-2288-41ec-978f-515b98eb5c77 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] For port afe3dc44-affc-4219-933b-2e023850e738, host n-h2-841483-1, got binding levels [] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:46.464137 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-488313f4-2288-41ec-978f-515b98eb5c77 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:46.543274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Deleting port b70ef405-82b6-4381-8ce4-2ee29d93182b {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:46.544116 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:46.643786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-50caa839-d907-406c-996e-09048cd07402 None None] Deleting port b70ef405-82b6-4381-8ce4-2ee29d93182b {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:46.644324 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-50caa839-d907-406c-996e-09048cd07402 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:46.689981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-488313f4-2288-41ec-978f-515b98eb5c77 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Calling delete_port for afe3dc44-affc-4219-933b-2e023850e738 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:46.838598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7135705a-d514-42f0-906c-a1c2e2419e70 req-521d0b59-ea20-4e5e-a2ea-fc0c07440342 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:46.845553 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7135705a-d514-42f0-906c-a1c2e2419e70 req-521d0b59-ea20-4e5e-a2ea-fc0c07440342 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 945 time: 0.7926025 May 12 15:19:46.944799 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-488313f4-2288-41ec-978f-515b98eb5c77 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:46.970021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-50caa839-d907-406c-996e-09048cd07402 None None] For port b70ef405-82b6-4381-8ce4-2ee29d93182b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b70ef405-82b6-4381-8ce4-2ee29d93182b,segment=NetworkSegment(6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f),segment_id=6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:46.970400 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-50caa839-d907-406c-996e-09048cd07402 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:47.067915 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-488313f4-2288-41ec-978f-515b98eb5c77 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:47.070804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-488313f4-2288-41ec-978f-515b98eb5c77 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Pushing event deleted for resources: {'Port': ['ID=afe3dc44-affc-4219-933b-2e023850e738,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:47.098740 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7135705a-d514-42f0-906c-a1c2e2419e70 req-5317fbc2-aa39-4905-9715-7342fbcb4450 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/security-groups?id=32ee1ea1-656f-486b-9369-2586dedf1884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2523191 May 12 15:19:47.120207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-50caa839-d907-406c-996e-09048cd07402 None None] Calling delete_port for b70ef405-82b6-4381-8ce4-2ee29d93182b owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:47.226231 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-50caa839-d907-406c-996e-09048cd07402 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:47.245832 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-488313f4-2288-41ec-978f-515b98eb5c77 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "DELETE /v2.0/ports/afe3dc44-affc-4219-933b-2e023850e738 HTTP/1.1" status: 204 len: 168 time: 1.6948569 May 12 15:19:47.250623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60870) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:47.271027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] For port b70ef405-82b6-4381-8ce4-2ee29d93182b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b70ef405-82b6-4381-8ce4-2ee29d93182b,segment=NetworkSegment(6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f),segment_id=6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:47.271692 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:47.311207 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-3b09e1c7-4344-4fae-850f-504978d967ce tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] GET failed (client error): The resource could not be found. May 12 15:19:47.312025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3b09e1c7-4344-4fae-850f-504978d967ce tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Synchronizing usage tracker for tenant:082f7024cd214931b964a6ce0104131f on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:47.338974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3b09e1c7-4344-4fae-850f-504978d967ce tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Unset dirty status for tenant:082f7024cd214931b964a6ce0104131f on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:47.348033 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3b09e1c7-4344-4fae-850f-504978d967ce tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "GET /v2.0/ports/afe3dc44-affc-4219-933b-2e023850e738 HTTP/1.1" status: 404 len: 333 time: 0.0960741 May 12 15:19:47.349429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60874) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:47.355670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1600840029', 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:47.358747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50caa839-d907-406c-996e-09048cd07402 None None] Pushing event deleted for resources: {'Port': ['ID=b70ef405-82b6-4381-8ce4-2ee29d93182b,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:47.363140 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50caa839-d907-406c-996e-09048cd07402 None None] No DVR routers for this DVR port b70ef405-82b6-4381-8ce4-2ee29d93182b on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:19:47.368700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:47.385238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:47.401919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Made reservation on behalf of 082f7024cd214931b964a6ce0104131f for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:47.404635 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:47.443667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] device_id is not set on port 63321a35-c52c-44fe-baa5-1f6c30ed308d yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:19:47.443877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Calling delete_port for b70ef405-82b6-4381-8ce4-2ee29d93182b owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:47.518518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58ff1a47-8d88-4f8f-b155-89b0fb1e0a31 req-bc1ee7a9-a97d-452f-af4a-fe62c557a74b tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:47.527876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58ff1a47-8d88-4f8f-b155-89b0fb1e0a31 req-bc1ee7a9-a97d-452f-af4a-fe62c557a74b tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:47.536891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58ff1a47-8d88-4f8f-b155-89b0fb1e0a31 req-bc1ee7a9-a97d-452f-af4a-fe62c557a74b tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:47.538764 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58ff1a47-8d88-4f8f-b155-89b0fb1e0a31 req-bc1ee7a9-a97d-452f-af4a-fe62c557a74b tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187&device_id=91efc3d2-c9e0-4867-98a8-80db504551ad&device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 2417 time: 0.5889978 May 12 15:19:47.597201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60878) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:47.615520 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:47.637177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Request body: {'security_group': {'name': 'tempest-securitygroup--762069356', 'description': 'tempest-description--1728344787'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:47.646126 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:19:47.646456 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:19:47.650374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:47.662595 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58ff1a47-8d88-4f8f-b155-89b0fb1e0a31 req-e77a3332-dca1-4820-8461-5c4bf2a2d7c3 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0799201 May 12 15:19:47.663194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Usage tracker for resource:security_group and tenant:6357a1184f074ce2a5b5f19b5ce06e85 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:47.667674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:47.674147 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:47.759994 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:47.816251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:47.831066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Usage tracker for resource:security_group_rule and tenant:6357a1184f074ce2a5b5f19b5ce06e85 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:47.857857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:47.869176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:47.873063 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:47.980722 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:47.985310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-cd50ba24-3b2d-4ab8-97e5-8d036f5e704b tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=0f298b0647e84cc79385c8bd9e26dff4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1004140 May 12 15:19:48.040814 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.059882 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.089993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:48.097538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:48.107648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:48.108490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:48.109085 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.131186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Pushing event updated for resources: {'Port': ['ID=63321a35-c52c-44fe-baa5-1f6c30ed308d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:48.149210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9b49946f-705a-41e4-a057-53a4ddde6ae4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:48.152049 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.156405 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-285937c2-52c2-455f-8fb3-5f86e4d99105 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1781 time: 0.5322144 May 12 15:19:48.157198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60898) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:48.163273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c6a9cec1-30c4-4878-9c2f-8395bacdb25f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Request body: {'security_group_rule': {'security_group_id': '9b49946f-705a-41e4-a057-53a4ddde6ae4', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:48.167064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a6e545-e4f4-49c0-a544-d6000f70c9b3 req-1f5fa7ee-c326-4c2a-b6d2-6ebc1a0985cf tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:48.169068 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-486f6874-dec4-4210-b1aa-1769f39dfa05 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 0.8184519 May 12 15:19:48.169206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9a6e545-e4f4-49c0-a544-d6000f70c9b3 req-1f5fa7ee-c326-4c2a-b6d2-6ebc1a0985cf tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 945 time: 0.2900393 May 12 15:19:48.173504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60902) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:48.174595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c6a9cec1-30c4-4878-9c2f-8395bacdb25f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:48.180454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c6a9cec1-30c4-4878-9c2f-8395bacdb25f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Usage tracker for resource:security_group_rule and tenant:6357a1184f074ce2a5b5f19b5ce06e85 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:48.184351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c6a9cec1-30c4-4878-9c2f-8395bacdb25f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:48.192943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c6a9cec1-30c4-4878-9c2f-8395bacdb25f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:48.209816 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6a9cec1-30c4-4878-9c2f-8395bacdb25f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.252720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-4df4741d-fd5d-4567-9308-16f3d4150d3c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:48.260664 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-4df4741d-fd5d-4567-9308-16f3d4150d3c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2739236 May 12 15:19:48.272271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6a9cec1-30c4-4878-9c2f-8395bacdb25f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.275972 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6a9cec1-30c4-4878-9c2f-8395bacdb25f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.307338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a9cec1-30c4-4878-9c2f-8395bacdb25f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1649cec1-1f1a-443e-9802-c39e7b2ae520,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:48.308572 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-4d756474-c7f1-4db8-a38e-54201260a497 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/quotas/0f298b0647e84cc79385c8bd9e26dff4 HTTP/1.1" status: 200 len: 375 time: 0.0468521 May 12 15:19:48.317369 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9a6e545-e4f4-49c0-a544-d6000f70c9b3 req-5199664f-43a0-4442-aed5-0112b916ea8f tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1403110 May 12 15:19:48.321211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8307d30e-26b4-4053-980f-2a621b20e0dd tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:48.321952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8307d30e-26b4-4053-980f-2a621b20e0dd tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Synchronizing usage tracker for tenant:082f7024cd214931b964a6ce0104131f on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:48.327078 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6a9cec1-30c4-4878-9c2f-8395bacdb25f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.328404 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c6a9cec1-30c4-4878-9c2f-8395bacdb25f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1698763 May 12 15:19:48.331754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60906) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:48.338881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-9fe62e31-eec0-4439-b4b9-f96a10dd2b14 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Request body: {'security_group_rule': {'security_group_id': '9b49946f-705a-41e4-a057-53a4ddde6ae4', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:48.346276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9fe62e31-eec0-4439-b4b9-f96a10dd2b14 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:48.351258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9fe62e31-eec0-4439-b4b9-f96a10dd2b14 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Usage tracker for resource:security_group_rule and tenant:6357a1184f074ce2a5b5f19b5ce06e85 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:48.355621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9fe62e31-eec0-4439-b4b9-f96a10dd2b14 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:48.363065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9fe62e31-eec0-4439-b4b9-f96a10dd2b14 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:48.388467 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fe62e31-eec0-4439-b4b9-f96a10dd2b14 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.411295 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-67492852-833e-4082-8bdc-505d6a3f2f43 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=0f298b0647e84cc79385c8bd9e26dff4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0924652 May 12 15:19:48.419843 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31cd8af4-93fe-4110-9ba0-899a94d0ef59 req-688a8c5b-a700-4517-986a-02c33724f421 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0612383 May 12 15:19:48.425020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8307d30e-26b4-4053-980f-2a621b20e0dd tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Unset dirty status for tenant:082f7024cd214931b964a6ce0104131f on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:48.427618 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8307d30e-26b4-4053-980f-2a621b20e0dd tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "GET /v2.0/ports/63321a35-c52c-44fe-baa5-1f6c30ed308d HTTP/1.1" status: 200 len: 955 time: 0.2525630 May 12 15:19:48.430248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60912) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:48.476766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fe62e31-eec0-4439-b4b9-f96a10dd2b14 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.483463 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fe62e31-eec0-4439-b4b9-f96a10dd2b14 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.514227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fe62e31-eec0-4439-b4b9-f96a10dd2b14 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b0fa3ff1-da2b-4a51-9b69-f7f671ce93e5,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:48.527200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fe62e31-eec0-4439-b4b9-f96a10dd2b14 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.531457 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9fe62e31-eec0-4439-b4b9-f96a10dd2b14 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1949706 May 12 15:19:48.531642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60916) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:48.541734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:48.547945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:48.553337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Usage tracker for resource:floatingip and tenant:6357a1184f074ce2a5b5f19b5ce06e85 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:48.562198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Deleting port b70ef405-82b6-4381-8ce4-2ee29d93182b {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:48.563192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.569496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:48.584438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:48.618285 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.643201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-4758ae92-1c99-433d-8eb7-91d8b0dc130e tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Deleting port 63321a35-c52c-44fe-baa5-1f6c30ed308d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:48.643885 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4758ae92-1c99-433d-8eb7-91d8b0dc130e tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.843754 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31cd8af4-93fe-4110-9ba0-899a94d0ef59 req-e9659cd7-1119-4df0-a6db-f840e69ab1bd service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.3382263 May 12 15:19:48.916725 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:48.939441 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 632ac19e-3420-4802-a558-9e900049a9cd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:48.975230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] The port 'b70ef405-82b6-4381-8ce4-2ee29d93182b' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:19:49.038047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 632ac19e-3420-4802-a558-9e900049a9cd completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:49.044723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 632ac19e-3420-4802-a558-9e900049a9cd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:49.045099 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:49.060459 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31cd8af4-93fe-4110-9ba0-899a94d0ef59 req-2a839c1f-15c3-4876-83c5-758cfb295d91 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1433418 May 12 15:19:49.097325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Allocated IP 172.25.8.158 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/5216ae84-ec28-449f-bbf3-9c41da698f86) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:49.185866 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Sync routers for ids ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:19:49.197496 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:49.199906 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Routers {'bac46c5e-a9b9-49a6-89a8-7b3f401caed2'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:19:49.200661 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:19:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:49.266075 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:49.299271 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 632ac19e-3420-4802-a558-9e900049a9cd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=632ac19e-3420-4802-a558-9e900049a9cd,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:49.311918 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:49.317956 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:49.382263 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:49.387362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=632ac19e-3420-4802-a558-9e900049a9cd,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:49.424813 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be4c5b4d-16a9-4080-8c17-91d28c14f295 req-2c350416-b066-491b-ad20-8044ca329373 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 210 time: 0.4432836 May 12 15:19:49.465544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:49.476815 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Set router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:19:49.484700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:49.493675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:49.600701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event updated for resources: {'Port': ['ID=5216ae84-ec28-449f-bbf3-9c41da698f86,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:49.622701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:49.634504 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:49.728365 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:49.728657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6e9fdd3d-ad3c-4682-b8b4-926d4e2b9e3f') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:49.734544 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:49.780447 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:49.795211 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4758ae92-1c99-433d-8eb7-91d8b0dc130e tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:49.893516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a70b5f3-a78a-4e86-bfca-12d4dbc22cf3 req-e8ee8da4-7b8c-4ba0-ac7d-b56b7d76e623 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:49.894917 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a70b5f3-a78a-4e86-bfca-12d4dbc22cf3 req-e8ee8da4-7b8c-4ba0-ac7d-b56b7d76e623 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 945 time: 1.2064579 May 12 15:19:49.958880 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233'}], 'enable_snat': True}, 'gw_port_id': '632ac19e-3420-4802-a558-9e900049a9cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 4, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port': {'id': '632ac19e-3420-4802-a558-9e900049a9cd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:3a:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1391, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:39Z', 'updated_at': '2022-05-12T15:19:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '314d24d4-b40e-49e9-a854-c0e11db13316', 'name': '', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'mac_address': 'fa:16:3e:a8:8a:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_interface', 'standard_attr_id': 1392, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:43Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 2, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'subnets': [{'id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:49.963835 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Checking router: bac46c5e-a9b9-49a6-89a8-7b3f401caed2 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:19:49.964262 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Updating router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 port 314d24d4-b40e-49e9-a854-c0e11db13316 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:19:49.966822 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:49.991223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-4758ae92-1c99-433d-8eb7-91d8b0dc130e tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Calling delete_port for 63321a35-c52c-44fe-baa5-1f6c30ed308d owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:50.003614 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:50.012407 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:50.034712 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:50.063644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Releasing vlan 577 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:19:50.064231 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: timer() May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:19:50.096381 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:19:50.185777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31cd8af4-93fe-4110-9ba0-899a94d0ef59 req-cf53dd27-3919-48d4-b88b-da15fe1898e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:50.187110 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31cd8af4-93fe-4110-9ba0-899a94d0ef59 req-cf53dd27-3919-48d4-b88b-da15fe1898e5 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 1.1032884 May 12 15:19:50.284827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event updated for resources: {'Port': ['ID=5216ae84-ec28-449f-bbf3-9c41da698f86,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:50.297605 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:50.302882 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a70b5f3-a78a-4e86-bfca-12d4dbc22cf3 req-a8af21c2-9179-4d8a-8cd2-f46784cb7ce9 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/security-groups?id=32ee1ea1-656f-486b-9369-2586dedf1884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3212452 May 12 15:19:50.329015 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:50.329820 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:50.334440 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:50.335140 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-58dacedf-ea4d-42ea-99d3-0b1001340d5c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.8025098 May 12 15:19:50.407428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] Pushing event deleted for resources: {'Network': ['ID=674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:50.430344 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4758ae92-1c99-433d-8eb7-91d8b0dc130e tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:50.519192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-37e2bb59-f0c4-4ce9-9f2a-28da179bf7b0 tempest-FloatingIPNegativeTestJSON-1484004498 tempest-FloatingIPNegativeTestJSON-1484004498-project] 10.222.0.82 "DELETE /v2.0/networks/674768c4-6f9d-46c8-b1fa-fdf9e6ddfca3 HTTP/1.1" status: 204 len: 168 time: 6.4670563 May 12 15:19:50.530822 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4758ae92-1c99-433d-8eb7-91d8b0dc130e tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:50.533128 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4758ae92-1c99-433d-8eb7-91d8b0dc130e tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "DELETE /v2.0/ports/63321a35-c52c-44fe-baa5-1f6c30ed308d HTTP/1.1" status: 204 len: 168 time: 2.1017582 May 12 15:19:50.536482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60954) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:50.560730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4758ae92-1c99-433d-8eb7-91d8b0dc130e tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Pushing event deleted for resources: {'Port': ['ID=63321a35-c52c-44fe-baa5-1f6c30ed308d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:50.569150 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:50.570970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-ee4557b2-c963-4d4d-a1d4-3d4ff78426c2 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=0f298b0647e84cc79385c8bd9e26dff4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1422029 May 12 15:19:50.591072 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-aca2c16f-46a8-4743-b9dc-a403588a06a1 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] GET failed (client error): The resource could not be found. May 12 15:19:50.591606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-aca2c16f-46a8-4743-b9dc-a403588a06a1 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Synchronizing usage tracker for tenant:082f7024cd214931b964a6ce0104131f on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:50.599121 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Transition to ACTIVE for port object 314d24d4-b40e-49e9-a854-c0e11db13316 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:50.610602 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:50.612395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-aca2c16f-46a8-4743-b9dc-a403588a06a1 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Unset dirty status for tenant:082f7024cd214931b964a6ce0104131f on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:50.619211 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aca2c16f-46a8-4743-b9dc-a403588a06a1 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "GET /v2.0/ports/63321a35-c52c-44fe-baa5-1f6c30ed308d HTTP/1.1" status: 404 len: 333 time: 0.0814569 May 12 15:19:50.620504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60958) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:50.626842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Request body: {'port': {'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-716990899'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:50.634280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:50.649805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:50.672770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Made reservation on behalf of 082f7024cd214931b964a6ce0104131f for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:50.675532 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:50.708995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] device_id is not set on port b6a2d395-78e8-4752-b321-36ab0571013a yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:19:50.749665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dfc9178-c1f2-4bf7-be1c-689813bea86e req-380c7ea7-03a3-4c1b-bfeb-1f9e1c19ae90 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:50.753873 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55d042f7-55bb-466c-a36e-3c4b1fb4cc8e None None] Pushing event updated for resources: {'Port': ['ID=314d24d4-b40e-49e9-a854-c0e11db13316,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:50.757936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6dfc9178-c1f2-4bf7-be1c-689813bea86e req-380c7ea7-03a3-4c1b-bfeb-1f9e1c19ae90 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 950 time: 0.5400782 May 12 15:19:50.871023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6dfc9178-c1f2-4bf7-be1c-689813bea86e req-064b695c-8cc2-490d-9dde-c4850e50ae6d tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/security-groups?id=31d58a41-3845-471a-98c8-ed2f43418af7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1070426 May 12 15:19:50.884924 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d042f7-55bb-466c-a36e-3c4b1fb4cc8e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:50.885641 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d042f7-55bb-466c-a36e-3c4b1fb4cc8e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:50.886062 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d042f7-55bb-466c-a36e-3c4b1fb4cc8e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:50.886394 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d042f7-55bb-466c-a36e-3c4b1fb4cc8e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:50.886706 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d042f7-55bb-466c-a36e-3c4b1fb4cc8e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:50.887114 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d042f7-55bb-466c-a36e-3c4b1fb4cc8e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:50.887435 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d042f7-55bb-466c-a36e-3c4b1fb4cc8e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:50.887995 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d042f7-55bb-466c-a36e-3c4b1fb4cc8e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:50.888352 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d042f7-55bb-466c-a36e-3c4b1fb4cc8e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:50.888769 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d042f7-55bb-466c-a36e-3c4b1fb4cc8e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:50.889114 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d042f7-55bb-466c-a36e-3c4b1fb4cc8e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:50.889595 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d042f7-55bb-466c-a36e-3c4b1fb4cc8e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:19:50.924784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 632ac19e-3420-4802-a558-9e900049a9cd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:51.034357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-d98c11d0-19f3-4338-908f-772dc9638081 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:51.038734 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-d98c11d0-19f3-4338-908f-772dc9638081 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4593756 May 12 15:19:51.064787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7954362-d773-4946-87f7-aed83c1a42ee req-8bdce185-6044-4401-9812-d9dbdf2ac998 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:51.072500 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7954362-d773-4946-87f7-aed83c1a42ee req-8bdce185-6044-4401-9812-d9dbdf2ac998 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 945 time: 0.3308117 May 12 15:19:51.076219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 632ac19e-3420-4802-a558-9e900049a9cd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:51.076589 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:51.093111 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Attempting to bind port 314d24d4-b40e-49e9-a854-c0e11db13316 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:51.093664 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Attempting to bind port 314d24d4-b40e-49e9-a854-c0e11db13316 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:51.094134 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Attempting to bind port 314d24d4-b40e-49e9-a854-c0e11db13316 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:51.111818 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 19, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:19:51.112332 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Checking segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:51.112824 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:51.113944 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Bound using segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:19:51.114683 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Bound port: 314d24d4-b40e-49e9-a854-c0e11db13316, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:19:51.116476 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:51.125532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60974) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:51.130794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Request body: {'port': {'device_id': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '0f298b0647e84cc79385c8bd9e26dff4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:51.141589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:51.173965 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:51.280906 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] For port 314d24d4-b40e-49e9-a854-c0e11db13316, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:19:51.284620 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] For port 314d24d4-b40e-49e9-a854-c0e11db13316, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=314d24d4-b40e-49e9-a854-c0e11db13316,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:19:51.295927 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:51.315660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:51.318360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Pushing event updated for resources: {'Port': ['ID=b6a2d395-78e8-4752-b321-36ab0571013a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:51.325190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:51.329103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:51.331600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:51.334899 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:51.392611 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Routers {'bac46c5e-a9b9-49a6-89a8-7b3f401caed2'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:19:51.393581 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:19:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:51.425289 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2f83b444-64da-46f7-b3be-9a35f8cf63cc tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 959 time: 0.8034952 May 12 15:19:51.426055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60982) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:51.442860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Request body: {'port': {'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:51.507154 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55d042f7-55bb-466c-a36e-3c4b1fb4cc8e None None] Pushing event updated for resources: {'Port': ['ID=314d24d4-b40e-49e9-a854-c0e11db13316,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:51.520454 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-5425fed6-eec2-4454-a16f-f66984a09478 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--762069356&fields=id&tenant_id=6357a1184f074ce2a5b5f19b5ce06e85 HTTP/1.1" status: 200 len: 267 time: 0.4735568 May 12 15:19:51.530590 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7954362-d773-4946-87f7-aed83c1a42ee req-1bb3ff68-6407-4449-b13a-6cc63cd979a4 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/security-groups?id=32ee1ea1-656f-486b-9369-2586dedf1884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4569516 May 12 15:19:51.535201 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-783f5d52-fda1-4b6f-8390-856a9c40fcfb admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=97c1bf81263543a888f23243db1936dd&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4060616 May 12 15:19:51.540908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60986) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:51.704826 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] Set router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:19:51.705455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:51.722151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-013b0751-ef59-48e8-b806-2fa4e4941e9e req-662ca822-e921-4217-abfb-1c1ddff0ddcd tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:51.723743 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-013b0751-ef59-48e8-b806-2fa4e4941e9e req-662ca822-e921-4217-abfb-1c1ddff0ddcd tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.84 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 950 time: 0.3625968 May 12 15:19:51.726268 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3f42e22-d75c-49fe-8055-24ac0dc61387 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:51.743496 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86b0b85d-79fb-4239-8d12-8c5ff69e62ba req-f5fc0110-69c0-46e1-a120-2c4a895ab1c8 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 210 time: 0.0576503 May 12 15:19:51.766571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:51.776499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Usage tracker for resource:port and tenant:0f298b0647e84cc79385c8bd9e26dff4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:51.781715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:51.798888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:51.815641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-f38e6660-ec18-4f1a-8a89-7948d7e18a44 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:51.818209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-f38e6660-ec18-4f1a-8a89-7948d7e18a44 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 812 time: 0.2958720 May 12 15:19:51.826688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Made reservation on behalf of 0f298b0647e84cc79385c8bd9e26dff4 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:51.831123 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:51.857649 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:51.870613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-24bcc32c-7112-4f1b-b80e-d077b6944448 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/quotas/6357a1184f074ce2a5b5f19b5ce06e85 HTTP/1.1" status: 200 len: 375 time: 0.0451078 May 12 15:19:51.875989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:51.884599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Usage tracker for resource:security_group_rule and tenant:0f298b0647e84cc79385c8bd9e26dff4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:51.935516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:51.949989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:52.018934 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-1ba09745-b96b-4d8d-8963-db2e998082d2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1403182 May 12 15:19:52.029601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] device_id is not set on port b6a2d395-78e8-4752-b321-36ab0571013a yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:19:52.038095 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:52.075314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Transition to ACTIVE for port object b6a2d395-78e8-4752-b321-36ab0571013a will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:52.088902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3f42e22-d75c-49fe-8055-24ac0dc61387 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:52.095457 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:52.107892 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233'}], 'enable_snat': True}, 'gw_port_id': '632ac19e-3420-4802-a558-9e900049a9cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 4, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port': {'id': '632ac19e-3420-4802-a558-9e900049a9cd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:3a:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1391, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:39Z', 'updated_at': '2022-05-12T15:19:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '314d24d4-b40e-49e9-a854-c0e11db13316', 'name': '', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'mac_address': 'fa:16:3e:a8:8a:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_interface', 'standard_attr_id': 1392, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:43Z', 'updated_at': '2022-05-12T15:19:51Z', 'revision_number': 4, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'subnets': [{'id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:52.116354 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92253d31-3d30-4df4-a77f-26765e39c105 None None] The sync data for ids ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'] in n-d-841483-1 is: [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233'}], 'enable_snat': True}, 'gw_port_id': '632ac19e-3420-4802-a558-9e900049a9cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 4, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port': {'id': '632ac19e-3420-4802-a558-9e900049a9cd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:3a:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1391, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:39Z', 'updated_at': '2022-05-12T15:19:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '314d24d4-b40e-49e9-a854-c0e11db13316', 'name': '', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'mac_address': 'fa:16:3e:a8:8a:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_interface', 'standard_attr_id': 1392, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:43Z', 'updated_at': '2022-05-12T15:19:51Z', 'revision_number': 4, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'subnets': [{'id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:19:52.173769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-013b0751-ef59-48e8-b806-2fa4e4941e9e req-edb9deee-9478-47f4-9d51-152c3eb4ff1a tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Deleting port 21fb42a3-a101-46b8-acaa-9a763a096933 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:52.174267 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-013b0751-ef59-48e8-b806-2fa4e4941e9e req-edb9deee-9478-47f4-9d51-152c3eb4ff1a tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:52.208654 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:52.226258 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:52.310788 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-f2bcd47d-02c1-44f7-9f27-05240676598f service neutron] 10.222.0.82 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2760122 May 12 15:19:52.446101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Pushing event updated for resources: {'Port': ['ID=b6a2d395-78e8-4752-b321-36ab0571013a,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:52.464354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Pushing event updated for resources: {'SecurityGroup': ['ID=741e94d4-5b74-4583-8ee0-e67ced7944a0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:52.499634 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3f42e22-d75c-49fe-8055-24ac0dc61387 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:52.523263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f42e22-d75c-49fe-8055-24ac0dc61387 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f5da08d-4741-41cf-b6ca-21af85faa464,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:52.632549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:52.632779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:52.632958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:52.641655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3f42e22-d75c-49fe-8055-24ac0dc61387 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:52.642926 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d3f42e22-d75c-49fe-8055-24ac0dc61387 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8f5da08d-4741-41cf-b6ca-21af85faa464 HTTP/1.1" status: 204 len: 168 time: 1.1010087 May 12 15:19:52.666165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:52.667572 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:52.671662 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 2 to bind port b6a2d395-78e8-4752-b321-36ab0571013a May 12 15:19:52.672202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-2742880d-fd8e-4f44-a352-73a8bdb5e18e service neutron] 10.222.0.82 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3605726 May 12 15:19:52.673333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Allocated IP 192.168.233.3 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/c341671e-a3e5-49ab-82c1-794b06d15b7a) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:52.714132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:52.714694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:52.715134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:52.729149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:52.729611 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:52.739492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f841e52-4512-4235-81a5-21e3a6d560ec req-ca60a42f-9d58-45a6-8400-cf65a0bcf0b8 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:52.741173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f841e52-4512-4235-81a5-21e3a6d560ec req-ca60a42f-9d58-45a6-8400-cf65a0bcf0b8 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 950 time: 0.1861780 May 12 15:19:52.750745 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 3 to bind port b6a2d395-78e8-4752-b321-36ab0571013a May 12 15:19:52.792372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:52.792808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:52.793927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:52.811939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:52.819548 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:52.824413 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 4 to bind port b6a2d395-78e8-4752-b321-36ab0571013a May 12 15:19:52.838013 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-013b0751-ef59-48e8-b806-2fa4e4941e9e req-edb9deee-9478-47f4-9d51-152c3eb4ff1a tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] For port 21fb42a3-a101-46b8-acaa-9a763a096933, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=21fb42a3-a101-46b8-acaa-9a763a096933,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:52.838626 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-013b0751-ef59-48e8-b806-2fa4e4941e9e req-edb9deee-9478-47f4-9d51-152c3eb4ff1a tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:52.902767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 314d24d4-b40e-49e9-a854-c0e11db13316 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:53.020844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 314d24d4-b40e-49e9-a854-c0e11db13316 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:53.041081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 314d24d4-b40e-49e9-a854-c0e11db13316 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:53.042195 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:53.046002 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f841e52-4512-4235-81a5-21e3a6d560ec req-0860f915-55f2-4e04-afe8-e51a6d403315 tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/security-groups?id=31d58a41-3845-471a-98c8-ed2f43418af7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2912452 May 12 15:19:53.183477 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:53.222056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Transition to ACTIVE for port object c341671e-a3e5-49ab-82c1-794b06d15b7a will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:53.288740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-013b0751-ef59-48e8-b806-2fa4e4941e9e req-edb9deee-9478-47f4-9d51-152c3eb4ff1a tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Calling delete_port for 21fb42a3-a101-46b8-acaa-9a763a096933 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:53.335126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:53.335428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:53.335944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:53.355881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:53.356419 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:53.359481 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 5 to bind port b6a2d395-78e8-4752-b321-36ab0571013a May 12 15:19:53.388003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:53.388341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:53.388678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:53.409290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:53.409701 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:53.410590 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 6 to bind port b6a2d395-78e8-4752-b321-36ab0571013a May 12 15:19:53.431672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:53.431672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:53.431672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:53.437945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:53.438277 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:53.440295 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:53.471680 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 7 to bind port b6a2d395-78e8-4752-b321-36ab0571013a May 12 15:19:53.505371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-241658a3-2e9f-4c79-9c9f-0ecb82bec55f req-bfce5f85-ef24-4496-ac48-7fe28d248972 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 210 time: 0.0888114 May 12 15:19:53.506540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:53.506867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:53.507530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:53.520652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:53.520652 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:53.521818 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:53.522360 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 8 to bind port b6a2d395-78e8-4752-b321-36ab0571013a May 12 15:19:53.533246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 314d24d4-b40e-49e9-a854-c0e11db13316, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=314d24d4-b40e-49e9-a854-c0e11db13316,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:53.542446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:53.542806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:53.543117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:53.549646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:53.549968 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:53.550358 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 9 to bind port b6a2d395-78e8-4752-b321-36ab0571013a May 12 15:19:53.553013 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:53.560511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-013b0751-ef59-48e8-b806-2fa4e4941e9e req-edb9deee-9478-47f4-9d51-152c3eb4ff1a tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:53.657857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:53.658195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:53.658535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:53.664664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Pushing event updated for resources: {'Port': ['ID=c341671e-a3e5-49ab-82c1-794b06d15b7a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:53.677379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edb9deee-9478-47f4-9d51-152c3eb4ff1a tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Pushing event deleted for resources: {'Port': ['ID=21fb42a3-a101-46b8-acaa-9a763a096933,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:53.690757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['21fb42a3-a101-46b8-acaa-9a763a096933'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:19:53.702670 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b1aa11b-b410-477d-af19-d05342e4c087 req-58a04998-77a4-4105-b959-4b962b3517c0 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 210 time: 0.0782025 May 12 15:19:53.714805 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:53.724956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2216be-9adb-4fad-b6b4-88ce471821c7 req-e2a3cfef-d0e2-4b61-94cc-0c1ed0657801 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:53.733118 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be2216be-9adb-4fad-b6b4-88ce471821c7 req-e2a3cfef-d0e2-4b61-94cc-0c1ed0657801 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 945 time: 0.4879603 May 12 15:19:53.749939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:53.755518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:53.834616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:53.835105 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:53.840089 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempt 10 to bind port b6a2d395-78e8-4752-b321-36ab0571013a May 12 15:19:53.850410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-013b0751-ef59-48e8-b806-2fa4e4941e9e req-edb9deee-9478-47f4-9d51-152c3eb4ff1a tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] No DVR routers for this DVR port 21fb42a3-a101-46b8-acaa-9a763a096933 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:19:53.855008 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-013b0751-ef59-48e8-b806-2fa4e4941e9e req-edb9deee-9478-47f4-9d51-152c3eb4ff1a tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:53.865205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3105e403-7d5f-4c02-9e2c-f6f26de448a3', 'name': 'network-vif-deleted', 'tag': '21fb42a3-a101-46b8-acaa-9a763a096933'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:53.897821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:53.899540 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-013b0751-ef59-48e8-b806-2fa4e4941e9e req-edb9deee-9478-47f4-9d51-152c3eb4ff1a tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.84 "DELETE /v2.0/ports/21fb42a3-a101-46b8-acaa-9a763a096933 HTTP/1.1" status: 204 len: 173 time: 2.1686606 May 12 15:19:53.900354 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:53.901806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:53.902168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:53.902471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempting to bind port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:53.906972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=314d24d4-b40e-49e9-a854-c0e11db13316,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:53.923384 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:53.923718 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Failed to bind port b6a2d395-78e8-4752-b321-36ab0571013a on host n-h2-841483-1 for vnic_type normal using segments [{'id': '8d095e1b-5127-4deb-b7f8-edd087607a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '2acc598d-7e3b-4207-90c0-22b91b2e80c4'}] May 12 15:19:53.924074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:54.166011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32808) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:54.171839 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1809ebd7-9003-4bf2-9097-8ce25b72dc8c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 3.0964332 May 12 15:19:54.184019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Request body: {'port': {'device_id': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:54.188549 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-48fe5554-85ef-4cbf-be98-378f02b0938c'] response: {'server_uuid': '3105e403-7d5f-4c02-9e2c-f6f26de448a3', 'name': 'network-vif-deleted', 'tag': '21fb42a3-a101-46b8-acaa-9a763a096933', 'status': 'completed', 'code': 200} May 12 15:19:54.200797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] For port b6a2d395-78e8-4752-b321-36ab0571013a, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:19:54.201174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attempted to set empty binding levels {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:66}} May 12 15:19:54.215192 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:54.228683 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be2216be-9adb-4fad-b6b4-88ce471821c7 req-f9fa61d8-761f-4859-bb1f-e32a8f548f53 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/security-groups?id=32ee1ea1-656f-486b-9369-2586dedf1884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4943752 May 12 15:19:54.405133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Pushing event updated for resources: {'Port': ['ID=b6a2d395-78e8-4752-b321-36ab0571013a,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:54.426482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] In _notify_port_updated(), no bound segment for port b6a2d395-78e8-4752-b321-36ab0571013a on network 2acc598d-7e3b-4207-90c0-22b91b2e80c4 {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:19:54.427575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:54.430068 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:54.438257 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8fdf3479-fcf8-4139-a9ac-6674e9ebe1a8 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "PUT /v2.0/ports/b6a2d395-78e8-4752-b321-36ab0571013a HTTP/1.1" status: 200 len: 974 time: 3.0035803 May 12 15:19:54.439285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32816) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:54.457654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1714487969'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:54.481322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c1a056f0-1c55-46d3-b848-7fb65788b8bd None None] Provisioning for port c341671e-a3e5-49ab-82c1-794b06d15b7a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:54.487412 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c1a056f0-1c55-46d3-b848-7fb65788b8bd None None] Provisioning complete for port c341671e-a3e5-49ab-82c1-794b06d15b7a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:54.487983 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c1a056f0-1c55-46d3-b848-7fb65788b8bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:54.507674 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:54.510190 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:54.524881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6aeaa2d7-48e8-4b02-9f4c-86d790dfc148 req-5f99dfe4-48c1-4eaf-bc0b-efa4f077102f tempest-TenantUsagesTestJSON-1757041210 tempest-TenantUsagesTestJSON-1757041210-project] 10.222.0.82 "GET /v2.0/ports?device_id=3105e403-7d5f-4c02-9e2c-f6f26de448a3 HTTP/1.1" status: 200 len: 210 time: 0.0784314 May 12 15:19:54.525883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Usage tracker for resource:network and tenant:474c82a3dfe24a42ae9d88d67006b265 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:54.531215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:54.540819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:54.565215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ca66c35a-4ee7-47e5-9c31-0844fbac24d4 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Deleting port b6a2d395-78e8-4752-b321-36ab0571013a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:54.565800 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca66c35a-4ee7-47e5-9c31-0844fbac24d4 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:54.571138 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c1a056f0-1c55-46d3-b848-7fb65788b8bd None None] Port c341671e-a3e5-49ab-82c1-794b06d15b7a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:19:54.603684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Made reservation on behalf of 474c82a3dfe24a42ae9d88d67006b265 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:54.607246 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:54.635884 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:54.705637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:54.752537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Usage tracker for resource:security_group_rule and tenant:474c82a3dfe24a42ae9d88d67006b265 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:54.768897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:54.811572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:54.854661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-ca66c35a-4ee7-47e5-9c31-0844fbac24d4 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] For port b6a2d395-78e8-4752-b321-36ab0571013a, host n-h2-841483-1, got binding levels [] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:54.855245 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca66c35a-4ee7-47e5-9c31-0844fbac24d4 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:54.871475 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 314d24d4-b40e-49e9-a854-c0e11db13316 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:19:54.951371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 314d24d4-b40e-49e9-a854-c0e11db13316 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:54.952533 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:55.049904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7edbdbf0-5cee-44d5-96f9-ec6263c7c4ad req-b2f9777d-8251-455f-be75-ab45ada2d327 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:55.050715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7edbdbf0-5cee-44d5-96f9-ec6263c7c4ad req-b2f9777d-8251-455f-be75-ab45ada2d327 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Synchronizing usage tracker for tenant:0f298b0647e84cc79385c8bd9e26dff4 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:55.054346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ca66c35a-4ee7-47e5-9c31-0844fbac24d4 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Calling delete_port for b6a2d395-78e8-4752-b321-36ab0571013a owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:55.097760 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-498b3c65-a757-4d58-9e6c-7efd2d904a80 req-e68a7171-0659-4e07-b635-1c30bedc814e tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:55.099306 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-498b3c65-a757-4d58-9e6c-7efd2d904a80 req-e68a7171-0659-4e07-b635-1c30bedc814e tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 946 time: 0.3347719 May 12 15:19:55.139134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7edbdbf0-5cee-44d5-96f9-ec6263c7c4ad req-b2f9777d-8251-455f-be75-ab45ada2d327 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Unset dirty status for tenant:0f298b0647e84cc79385c8bd9e26dff4 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:55.140181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7edbdbf0-5cee-44d5-96f9-ec6263c7c4ad req-b2f9777d-8251-455f-be75-ab45ada2d327 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 934 time: 0.4428926 May 12 15:19:55.171185 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:55.230124 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:55.260032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-c03926d0-6a1f-46ea-91e9-5382d6fa4b04 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:55.260731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-c03926d0-6a1f-46ea-91e9-5382d6fa4b04 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Synchronizing usage tracker for tenant:6357a1184f074ce2a5b5f19b5ce06e85 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:55.265271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca66c35a-4ee7-47e5-9c31-0844fbac24d4 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:55.311316 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-498b3c65-a757-4d58-9e6c-7efd2d904a80 req-97e309c4-fe5b-43b9-8c4b-26560b743bed tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1988666 May 12 15:19:55.320485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 573} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:19:55.342710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca66c35a-4ee7-47e5-9c31-0844fbac24d4 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Pushing event deleted for resources: {'Port': ['ID=b6a2d395-78e8-4752-b321-36ab0571013a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:55.344770 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca66c35a-4ee7-47e5-9c31-0844fbac24d4 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:55.360529 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ca66c35a-4ee7-47e5-9c31-0844fbac24d4 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "DELETE /v2.0/ports/b6a2d395-78e8-4752-b321-36ab0571013a HTTP/1.1" status: 204 len: 168 time: 0.9199753 May 12 15:19:55.361427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32830) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:55.372110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7edbdbf0-5cee-44d5-96f9-ec6263c7c4ad req-4683a39d-1f88-4373-b394-0ba48deb1a71 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Synchronizing usage tracker for tenant:0f298b0647e84cc79385c8bd9e26dff4 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:55.390134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c341671e-a3e5-49ab-82c1-794b06d15b7a {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:19:55.395075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0ad030b9-c6e1-4b7f-94b9-08cd7f589891,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:55.402077 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:55.402077 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Added segment 09634c20-a08f-4ec1-bfd2-67b02eef0803 of type vlan for network 7d76bd1a-568e-42be-801e-4192db4bb211 May 12 15:19:55.419109 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-437a1f1d-8b0a-4603-abcc-dca7803b2b20 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] GET failed (client error): The resource could not be found. May 12 15:19:55.419646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-437a1f1d-8b0a-4603-abcc-dca7803b2b20 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Synchronizing usage tracker for tenant:082f7024cd214931b964a6ce0104131f on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:55.422516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-c03926d0-6a1f-46ea-91e9-5382d6fa4b04 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Unset dirty status for tenant:6357a1184f074ce2a5b5f19b5ce06e85 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:55.423818 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-c03926d0-6a1f-46ea-91e9-5382d6fa4b04 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 812 time: 0.4070168 May 12 15:19:55.427357 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:55.477830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Transition to ACTIVE for port object c341671e-a3e5-49ab-82c1-794b06d15b7a will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:55.484064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7edbdbf0-5cee-44d5-96f9-ec6263c7c4ad req-4683a39d-1f88-4373-b394-0ba48deb1a71 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Unset dirty status for tenant:0f298b0647e84cc79385c8bd9e26dff4 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:55.494665 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7edbdbf0-5cee-44d5-96f9-ec6263c7c4ad req-4683a39d-1f88-4373-b394-0ba48deb1a71 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/security-groups?id=741e94d4-5b74-4583-8ee0-e67ced7944a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3456454 May 12 15:19:55.495702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-437a1f1d-8b0a-4603-abcc-dca7803b2b20 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] Unset dirty status for tenant:082f7024cd214931b964a6ce0104131f on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:55.497452 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-437a1f1d-8b0a-4603-abcc-dca7803b2b20 tempest-PortsAdminExtendedAttrsTestJSON-1371454872 tempest-PortsAdminExtendedAttrsTestJSON-1371454872-project-admin] 10.222.0.82 "GET /v2.0/ports/b6a2d395-78e8-4752-b321-36ab0571013a HTTP/1.1" status: 404 len: 333 time: 0.1328690 May 12 15:19:55.503258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32834) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:55.509650 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:55.515086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-0e669cf6-a38e-4ea4-b825-783f58f102d8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Synchronizing usage tracker for tenant:6357a1184f074ce2a5b5f19b5ce06e85 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:55.536987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:55.541004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-0e669cf6-a38e-4ea4-b825-783f58f102d8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Unset dirty status for tenant:6357a1184f074ce2a5b5f19b5ce06e85 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:55.552010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 21fb42a3-a101-46b8-acaa-9a763a096933 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:19:55.555760 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-0e669cf6-a38e-4ea4-b825-783f58f102d8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6357a1184f074ce2a5b5f19b5ce06e85 HTTP/1.1" status: 200 len: 379 time: 0.0964391 May 12 15:19:55.570222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Request body: {'port': {'device_id': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'admin_state_up': True, 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'security_groups': ['9b49946f-705a-41e4-a057-53a4ddde6ae4']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:55.636907 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:55.642973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:55.643609 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:55.719088 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 21fb42a3-a101-46b8-acaa-9a763a096933 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:19:55.719428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 21fb42a3-a101-46b8-acaa-9a763a096933 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:19:55.872321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:55.882454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Usage tracker for resource:port and tenant:6357a1184f074ce2a5b5f19b5ce06e85 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:55.886799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:55.894924 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:55.914776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Made reservation on behalf of 6357a1184f074ce2a5b5f19b5ce06e85 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:55.918457 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:56.047616 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3571384-39e6-4729-862f-05de236a1921 req-fb2c5db0-86f4-4fbe-bf34-03489c613a3c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 210 time: 0.2937355 May 12 15:19:56.076884 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'Network': ['ID=7d76bd1a-568e-42be-801e-4192db4bb211,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:56.088631 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 7d76bd1a-568e-42be-801e-4192db4bb211 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:19:56.139175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Allocated IP 172.20.0.8 (de9b95bc-97c4-4188-a1d0-c125f35032b0/f6980e11-e336-4f1d-9b2b-4462912e9abb/860dc344-70ad-4ff8-9592-ee8e988a4f26) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:19:56.167221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Pushing event updated for resources: {'Port': ['ID=c341671e-a3e5-49ab-82c1-794b06d15b7a,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:56.183693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9c82938c-29a0-442f-b2cb-ce947637ce27 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 2.0164161 May 12 15:19:56.212164 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca47577d-7470-483b-81be-4750c95461f9 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:56.229848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Attempting to bind port c341671e-a3e5-49ab-82c1-794b06d15b7a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:56.229848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Attempting to bind port c341671e-a3e5-49ab-82c1-794b06d15b7a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:56.229848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Attempting to bind port c341671e-a3e5-49ab-82c1-794b06d15b7a on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:56.232455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Port c341671e-a3e5-49ab-82c1-794b06d15b7a on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:56.232949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Attempting to bind port c341671e-a3e5-49ab-82c1-794b06d15b7a on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:56.304641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 19, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:19:56.305230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:56.307891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:19:56.308507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Bound port: c341671e-a3e5-49ab-82c1-794b06d15b7a, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:19:56.309028 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:56.423725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32848) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:56.455944 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:56.478634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Transition to ACTIVE for port object 860dc344-70ad-4ff8-9592-ee8e988a4f26 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:56.510515 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:56.625174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Network de9b95bc-97c4-4188-a1d0-c125f35032b0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:19:56.631106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:19:56.655173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:19:56.693561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491cf151-d4dc-4ff5-8bb4-037f60254af4 req-d580e3d4-83d7-471c-8d23-e203a57d2edb tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:56.700892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-491cf151-d4dc-4ff5-8bb4-037f60254af4 req-d580e3d4-83d7-471c-8d23-e203a57d2edb tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 945 time: 0.6425130 May 12 15:19:56.725933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:56.726739 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:56.743357 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca47577d-7470-483b-81be-4750c95461f9 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:56.756783 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9ba7ff58-414b-46c7-af4f-4bdef9b8f052 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=54887606d1e448bbba4720d03f57d6d1&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3301921 May 12 15:19:56.756783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event updated for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:56.758767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32856) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:56.822019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-ca47577d-7470-483b-81be-4750c95461f9 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2acc598d-7e3b-4207-90c0-22b91b2e80c4']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:56.838398 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f6dcb66a-b554-4c62-b56c-97890cb2ace3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:56.840946 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-aeba02ff-7d54-4571-8222-7832c801d3bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2837541 May 12 15:19:56.861254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-ca47577d-7470-483b-81be-4750c95461f9 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8d095e1b-5127-4deb-b7f8-edd087607a01') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:56.861583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-ca47577d-7470-483b-81be-4750c95461f9 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8d095e1b-5127-4deb-b7f8-edd087607a01') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:19:56.877232 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f6dcb66a-b554-4c62-b56c-97890cb2ace3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:56.903592 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca47577d-7470-483b-81be-4750c95461f9 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:56.941842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] For port c341671e-a3e5-49ab-82c1-794b06d15b7a, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:19:56.947776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Request body: {'port': {'device_id': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:56.956540 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-491cf151-d4dc-4ff5-8bb4-037f60254af4 req-d6f7ec89-e944-4ed8-a462-e8a108973745 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/security-groups?id=32ee1ea1-656f-486b-9369-2586dedf1884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2548091 May 12 15:19:56.964402 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] For port c341671e-a3e5-49ab-82c1-794b06d15b7a, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:19:56.968148 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca47577d-7470-483b-81be-4750c95461f9 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:56.988317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf9d39c4-31e1-4d43-adcd-eb8d7fcf6211 req-a5fb3d34-62e9-486c-bf62-f7fe1cc39ec7 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:57.000080 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf9d39c4-31e1-4d43-adcd-eb8d7fcf6211 req-a5fb3d34-62e9-486c-bf62-f7fe1cc39ec7 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 946 time: 0.4031260 May 12 15:19:57.004332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ca47577d-7470-483b-81be-4750c95461f9 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Releasing vlan 581 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:19:57.006486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f6dcb66a-b554-4c62-b56c-97890cb2ace3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:57.006948 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca47577d-7470-483b-81be-4750c95461f9 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:57.014046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-462e5470-f0ee-49c7-a3df-915720ecb1db None None] Provisioning for port 860dc344-70ad-4ff8-9592-ee8e988a4f26 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:19:57.034011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6dcb66a-b554-4c62-b56c-97890cb2ace3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=31d58a41-3845-471a-98c8-ed2f43418af7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:57.042440 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-462e5470-f0ee-49c7-a3df-915720ecb1db None None] Provisioning complete for port 860dc344-70ad-4ff8-9592-ee8e988a4f26 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:19:57.042938 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-462e5470-f0ee-49c7-a3df-915720ecb1db None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:57.091618 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: timer() May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:19:57.102363 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:19:57.127370 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f6dcb66a-b554-4c62-b56c-97890cb2ace3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:57.131702 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f6dcb66a-b554-4c62-b56c-97890cb2ace3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/31d58a41-3845-471a-98c8-ed2f43418af7 HTTP/1.1" status: 204 len: 168 time: 0.3687675 May 12 15:19:57.158488 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:57.161485 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-462e5470-f0ee-49c7-a3df-915720ecb1db None None] Port 860dc344-70ad-4ff8-9592-ee8e988a4f26 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:19:57.197734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:57.198401 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:57.200039 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] 10.222.0.76 "PUT /v2.0/ports/c341671e-a3e5-49ab-82c1-794b06d15b7a HTTP/1.1" status: 200 len: 1094 time: 3.0204499 May 12 15:19:57.382312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'tag': 'c341671e-a3e5-49ab-82c1-794b06d15b7a'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:57.388906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5167e4ee-2d8b-4cb4-be2f-50041562ae48 service neutron] Pushing event updated for resources: {'Port': ['ID=c341671e-a3e5-49ab-82c1-794b06d15b7a,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:57.468176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f2fc49d-d86b-47f4-b780-64f945cc6701 req-62baf6a2-a914-4d2d-af57-a9c3cca6a977 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:57.469030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9f2fc49d-d86b-47f4-b780-64f945cc6701 req-62baf6a2-a914-4d2d-af57-a9c3cca6a977 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Synchronizing usage tracker for tenant:f304b3ab44174793b8f251ca5bae6bc1 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:19:57.547195 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf9d39c4-31e1-4d43-adcd-eb8d7fcf6211 req-ade8e2f5-cd8c-4abc-a234-69f6b2f8a3a6 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5070987 May 12 15:19:57.598581 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca47577d-7470-483b-81be-4750c95461f9 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:57.612595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9f2fc49d-d86b-47f4-b780-64f945cc6701 req-62baf6a2-a914-4d2d-af57-a9c3cca6a977 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Unset dirty status for tenant:f304b3ab44174793b8f251ca5bae6bc1 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:19:57.616326 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f2fc49d-d86b-47f4-b780-64f945cc6701 req-62baf6a2-a914-4d2d-af57-a9c3cca6a977 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.76 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 945 time: 0.3866320 May 12 15:19:57.627418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca47577d-7470-483b-81be-4750c95461f9 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:57.646374 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca47577d-7470-483b-81be-4750c95461f9 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] Pushing event deleted for resources: {'Network': ['ID=2acc598d-7e3b-4207-90c0-22b91b2e80c4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:57.656182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ca47577d-7470-483b-81be-4750c95461f9 tempest-PortsAdminExtendedAttrsTestJSON-1146233696 tempest-PortsAdminExtendedAttrsTestJSON-1146233696-project] 10.222.0.82 "DELETE /v2.0/networks/2acc598d-7e3b-4207-90c0-22b91b2e80c4 HTTP/1.1" status: 204 len: 168 time: 2.1297858 May 12 15:19:57.697182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-979acd03-7c74-4465-ba63-4a3c78bb316a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:57.712694 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-979acd03-7c74-4465-ba63-4a3c78bb316a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0f298b0647e84cc79385c8bd9e26dff4&device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 1097 time: 0.2838542 May 12 15:19:57.846192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-9f2fc49d-d86b-47f4-b780-64f945cc6701 req-6ce3127c-6fd5-41fc-bf36-7488680dcb4d tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Deleting port d54385d2-8834-44e8-aee3-938c5a10714a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:19:57.846745 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9f2fc49d-d86b-47f4-b780-64f945cc6701 req-6ce3127c-6fd5-41fc-bf36-7488680dcb4d tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:57.870033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32872) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:57.878696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-783b8a7d-ab30-44af-9191-3d85478a8da2 req-f3e56a04-c8f1-47aa-9e74-add3279d48aa tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:57.887428 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-783b8a7d-ab30-44af-9191-3d85478a8da2 req-f3e56a04-c8f1-47aa-9e74-add3279d48aa tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 946 time: 0.5493174 May 12 15:19:57.939638 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-29ae62bb-230e-48f3-8438-24d43846fa07 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:57.970048 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-cf799084-6597-46a1-bdc6-b431cb906826 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.3&port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a HTTP/1.1" status: 200 len: 217 time: 0.2505784 May 12 15:19:58.012175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32878) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:58.048873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-29ae62bb-230e-48f3-8438-24d43846fa07 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:58.062923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-29ae62bb-230e-48f3-8438-24d43846fa07 admin admin] Usage tracker for resource:security_group_rule and tenant:d7cdb81378eb4b0d8c9e1365d32c5dbe is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:58.070350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-29ae62bb-230e-48f3-8438-24d43846fa07 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:58.080920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-29ae62bb-230e-48f3-8438-24d43846fa07 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:58.087895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-783b8a7d-ab30-44af-9191-3d85478a8da2 req-d6a1a52b-5409-4f36-aa9d-6ca5eb7de453 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/security-groups?id=741e94d4-5b74-4583-8ee0-e67ced7944a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1993697 May 12 15:19:58.112361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1ee6f9c0-9945-4df3-8898-2737488aeb63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:58.114509 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-1ee6f9c0-9945-4df3-8898-2737488aeb63 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1279345 May 12 15:19:58.196047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1668a348-74dc-422d-81f1-243f3d52be4d req-0fb0970c-bd4a-49d9-b9fa-9ea0fbe55e6d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:58.204117 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1668a348-74dc-422d-81f1-243f3d52be4d req-0fb0970c-bd4a-49d9-b9fa-9ea0fbe55e6d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 931 time: 0.3676434 May 12 15:19:58.266261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9f2fc49d-d86b-47f4-b780-64f945cc6701 req-6ce3127c-6fd5-41fc-bf36-7488680dcb4d tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] For port d54385d2-8834-44e8-aee3-938c5a10714a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d54385d2-8834-44e8-aee3-938c5a10714a,segment=NetworkSegment(95b43f05-4421-4ae6-99ff-55a5c256ee01),segment_id=95b43f05-4421-4ae6-99ff-55a5c256ee01)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:19:58.266537 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9f2fc49d-d86b-47f4-b780-64f945cc6701 req-6ce3127c-6fd5-41fc-bf36-7488680dcb4d tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:58.343663 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-29ae62bb-230e-48f3-8438-24d43846fa07 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:58.357292 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-29ae62bb-230e-48f3-8438-24d43846fa07 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:58.410395 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1668a348-74dc-422d-81f1-243f3d52be4d req-920fafea-fcc7-43e4-bc99-afa0d70b9e69 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2048075 May 12 15:19:58.443319 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-29ae62bb-230e-48f3-8438-24d43846fa07 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d7cdb81378eb4b0d8c9e1365d32c5dbe&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5392716 May 12 15:19:58.446006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32888) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:58.484720 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-433ef792-27db-41eb-93f4-7e61f6664a3f'] response: {'name': 'network-changed', 'server_uuid': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'tag': 'c341671e-a3e5-49ab-82c1-794b06d15b7a', 'status': 'completed', 'code': 200} May 12 15:19:58.508334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29ae62bb-230e-48f3-8438-24d43846fa07 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=29b99e18-37ac-4ab7-85eb-b767c9674e1d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:58.537054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-005f96a2-135b-469e-9ce4-b78ab6c19151 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:58.538623 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-005f96a2-135b-469e-9ce4-b78ab6c19151 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.4133418 May 12 15:19:58.673065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-9f2fc49d-d86b-47f4-b780-64f945cc6701 req-6ce3127c-6fd5-41fc-bf36-7488680dcb4d tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Calling delete_port for d54385d2-8834-44e8-aee3-938c5a10714a owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:19:58.741495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 860dc344-70ad-4ff8-9592-ee8e988a4f26 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:19:58.758281 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:58.770189 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f6570a2-f4f3-4cfb-87a9-a7277af0ffa5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:58.791991 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d285dc0a-a793-4f70-af16-1b5ffb555d29 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7e2beffeb6054995b634cf99959399f4&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7692194 May 12 15:19:58.806987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Transition to ACTIVE for port object 860dc344-70ad-4ff8-9592-ee8e988a4f26 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:19:58.807678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32894) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:58.824896 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:58.836128 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f6570a2-f4f3-4cfb-87a9-a7277af0ffa5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:58.879488 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-af9252ca-12fa-4b53-ad26-9d01f0ad41af service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3309665 May 12 15:19:58.984530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-521a3675-0b14-4a56-a7cf-f82eeb5e706a req-3917b752-9e0b-4472-a87b-7dd690e503f0 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:58.986007 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-521a3675-0b14-4a56-a7cf-f82eeb5e706a req-3917b752-9e0b-4472-a87b-7dd690e503f0 tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 945 time: 0.4113698 May 12 15:19:59.109604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Pushing event updated for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:59.160613 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-249f202b-c85e-4ade-97ba-45fc6b803990 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:59.189252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9f2fc49d-d86b-47f4-b780-64f945cc6701 req-6ce3127c-6fd5-41fc-bf36-7488680dcb4d tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:59.200318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86929460-3428-4189-b42c-3d84de2af3e5 req-bcdb0b45-1d23-4e6d-a401-3aa7dc96f338 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:59.207957 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86929460-3428-4189-b42c-3d84de2af3e5 req-bcdb0b45-1d23-4e6d-a401-3aa7dc96f338 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 946 time: 0.4988434 May 12 15:19:59.275065 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f6570a2-f4f3-4cfb-87a9-a7277af0ffa5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:59.312912 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-249f202b-c85e-4ade-97ba-45fc6b803990 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:59.319017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f6570a2-f4f3-4cfb-87a9-a7277af0ffa5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=29b99e18-37ac-4ab7-85eb-b767c9674e1d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:59.332652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-521a3675-0b14-4a56-a7cf-f82eeb5e706a req-f9a290ef-1053-4bd4-bc05-f0ec387b68ac tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/security-groups?id=32ee1ea1-656f-486b-9369-2586dedf1884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3257787 May 12 15:19:59.374392 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f6570a2-f4f3-4cfb-87a9-a7277af0ffa5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:59.390779 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8f6570a2-f4f3-4cfb-87a9-a7277af0ffa5 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/29b99e18-37ac-4ab7-85eb-b767c9674e1d HTTP/1.1" status: 204 len: 168 time: 0.9424217 May 12 15:19:59.396536 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15e995f3-b43d-4aac-8bf0-7e0f95a2a015 req-f0b43e15-b6ba-41d6-b41c-87841ac71176 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5023348 May 12 15:19:59.419380 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86929460-3428-4189-b42c-3d84de2af3e5 req-b360dded-5651-4d4c-8e1c-af40ddfd0ca1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2101617 May 12 15:19:59.541203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ce3127c-6fd5-41fc-bf36-7488680dcb4d tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Pushing event deleted for resources: {'Port': ['ID=d54385d2-8834-44e8-aee3-938c5a10714a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:59.575321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32904) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:19:59.598306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-249f202b-c85e-4ade-97ba-45fc6b803990 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:59.624784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Attempting to bind port 860dc344-70ad-4ff8-9592-ee8e988a4f26 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:19:59.625327 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Attempting to bind port 860dc344-70ad-4ff8-9592-ee8e988a4f26 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:19:59.625483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Attempting to bind port 860dc344-70ad-4ff8-9592-ee8e988a4f26 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:59.633160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-249f202b-c85e-4ade-97ba-45fc6b803990 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0d7a9811-8986-41ae-b595-b5d1ada20e95,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:19:59.634732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Request body: {'subnet': {'network_id': '7d76bd1a-568e-42be-801e-4192db4bb211', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:19:59.636985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Port 860dc344-70ad-4ff8-9592-ee8e988a4f26 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:19:59.637114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Attempting to bind port 860dc344-70ad-4ff8-9592-ee8e988a4f26 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:19:59.650207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-9f2fc49d-d86b-47f4-b780-64f945cc6701 req-6ce3127c-6fd5-41fc-bf36-7488680dcb4d tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] No DVR routers for this DVR port d54385d2-8834-44e8-aee3-938c5a10714a on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:19:59.654967 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9f2fc49d-d86b-47f4-b780-64f945cc6701 req-6ce3127c-6fd5-41fc-bf36-7488680dcb4d tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:59.657769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'babd9d8f-521c-4ddd-be6a-f66817bcc244', 'name': 'network-vif-deleted', 'tag': 'd54385d2-8834-44e8-aee3-938c5a10714a'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:19:59.666582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 19, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:19:59.666926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Checking segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:19:59.667310 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Bound using segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:19:59.667891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Bound port: 860dc344-70ad-4ff8-9592-ee8e988a4f26, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:19:59.668101 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:59.724690 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f2fc49d-d86b-47f4-b780-64f945cc6701 req-6ce3127c-6fd5-41fc-bf36-7488680dcb4d tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.76 "DELETE /v2.0/ports/d54385d2-8834-44e8-aee3-938c5a10714a HTTP/1.1" status: 204 len: 173 time: 2.0830400 May 12 15:19:59.731420 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-249f202b-c85e-4ade-97ba-45fc6b803990 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:59.732494 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-249f202b-c85e-4ade-97ba-45fc6b803990 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0d7a9811-8986-41ae-b595-b5d1ada20e95 HTTP/1.1" status: 204 len: 168 time: 0.9237325 May 12 15:19:59.811857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:19:59.814994 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:19:59.819889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:19:59.832785 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:59.857786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:19:59.870055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Usage tracker for resource:subnet and tenant:474c82a3dfe24a42ae9d88d67006b265 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:19:59.876520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:19:59.886732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:19:59.899268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c66c764c-4585-41ba-9ab9-51868f8cfc5a req-23d993ee-e2d5-4c26-8ab6-393ec404a539 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:59.901115 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c66c764c-4585-41ba-9ab9-51868f8cfc5a req-23d993ee-e2d5-4c26-8ab6-393ec404a539 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0f298b0647e84cc79385c8bd9e26dff4&device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 1097 time: 0.4110765 May 12 15:19:59.914628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79974680-e9bb-43a3-957b-781136d432d0 req-573b9b4e-f1ce-4dd4-bedf-5c37173ad4c8 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:59.916129 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-79974680-e9bb-43a3-957b-781136d432d0 req-573b9b4e-f1ce-4dd4-bedf-5c37173ad4c8 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 946 time: 0.3418789 May 12 15:19:59.938447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Made reservation on behalf of 474c82a3dfe24a42ae9d88d67006b265 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:19:59.942892 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:59.978540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7fa1d27-baff-41f8-8e61-303226678150 req-1a063b03-7fea-4a68-b62b-4aaf347425ef tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:59.980837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7fa1d27-baff-41f8-8e61-303226678150 req-1a063b03-7fea-4a68-b62b-4aaf347425ef tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 943 time: 0.3516164 May 12 15:19:59.986121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:19:59.987484 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:19:59.988696 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] 10.222.0.84 "PUT /v2.0/ports/860dc344-70ad-4ff8-9592-ee8e988a4f26 HTTP/1.1" status: 200 len: 1091 time: 3.1239014 May 12 15:20:00.023176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-691d4add-64f0-4a85-a491-60b0d81a1ca4 service neutron] Pushing event updated for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:00.185291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-34833037-a56b-4a3b-a25a-39db45eeb6b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:00.187536 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-34833037-a56b-4a3b-a25a-39db45eeb6b4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 1094 time: 0.1055148 May 12 15:20:00.292660 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-79974680-e9bb-43a3-957b-781136d432d0 req-31369489-e4e5-4d80-8e55-11fd22451e1c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/security-groups?id=741e94d4-5b74-4583-8ee0-e67ced7944a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3307886 May 12 15:20:00.345605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7fa1d27-baff-41f8-8e61-303226678150 req-d2c3aa8e-4b92-4adb-8102-74db30e2a196 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2274177 May 12 15:20:00.376840 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-c8029e04-e93f-40ea-b096-209273142ea2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26 HTTP/1.1" status: 200 len: 217 time: 0.1730788 May 12 15:20:00.419403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c66c764c-4585-41ba-9ab9-51868f8cfc5a req-e43b9140-e50e-496f-9eef-b6b5ecbcba4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:00.428922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c66c764c-4585-41ba-9ab9-51868f8cfc5a req-e43b9140-e50e-496f-9eef-b6b5ecbcba4f service neutron] 10.222.0.76 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.5102952 May 12 15:20:00.482265 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0760c684-8956-41bf-b738-f9fb7781b77e'] response: {'server_uuid': 'babd9d8f-521c-4ddd-be6a-f66817bcc244', 'name': 'network-vif-deleted', 'tag': 'd54385d2-8834-44e8-aee3-938c5a10714a', 'status': 'completed', 'code': 200} May 12 15:20:00.504245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32934) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:00.554818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-bc1a4007-f142-4825-8dc9-6b05b5d5f341 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:00.556951 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-bc1a4007-f142-4825-8dc9-6b05b5d5f341 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.1725760 May 12 15:20:00.644516 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c66c764c-4585-41ba-9ab9-51868f8cfc5a req-f04fdf2b-0b3f-4984-bd16-eeedf5ae28ee service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.3&port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a HTTP/1.1" status: 200 len: 217 time: 0.1387100 May 12 15:20:00.698078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-28ad1867-3903-4211-b9a5-a65ad6634c1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:00.700042 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-28ad1867-3903-4211-b9a5-a65ad6634c1a service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1310508 May 12 15:20:00.791414 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-114b8231-01b7-40cd-90bf-679702dd609c req-dea34426-c326-4d98-9ba5-f7a39f321c1f tempest-ServersNegativeTestMultiTenantJSON-315162900 tempest-ServersNegativeTestMultiTenantJSON-315162900-project] 10.222.0.82 "GET /v2.0/ports?device_id=babd9d8f-521c-4ddd-be6a-f66817bcc244 HTTP/1.1" status: 200 len: 210 time: 0.1595149 May 12 15:20:00.862455 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-455ba848-5dbb-4ba5-9b0c-9c9639626b59 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1548307 May 12 15:20:00.880878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-987301de-de8c-4e0e-8d47-f8abb43b2844 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=082f7024cd214931b964a6ce0104131f&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2850034 May 12 15:20:00.884771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32944) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:00.891017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c66c764c-4585-41ba-9ab9-51868f8cfc5a req-dccff51a-6458-4619-be4e-813ae82ab969 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:00.892502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c66c764c-4585-41ba-9ab9-51868f8cfc5a req-dccff51a-6458-4619-be4e-813ae82ab969 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1768506 May 12 15:20:00.908448 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:00.963052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d54385d2-8834-44e8-aee3-938c5a10714a no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:01.013657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: d54385d2-8834-44e8-aee3-938c5a10714a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:20:01.014523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d54385d2-8834-44e8-aee3-938c5a10714a not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:20:01.043817 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef9c6e08-a57f-45f1-896b-0f7e84adb3e2 req-c168e99d-0ae2-4678-a4e0-5a1d65396085 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1710474 May 12 15:20:01.061080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d79e861-4d15-40fd-b18b-332475de3a4b req-2e3df9ca-d776-4a72-8873-593cf8e8dc42 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:01.062544 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d79e861-4d15-40fd-b18b-332475de3a4b req-2e3df9ca-d776-4a72-8873-593cf8e8dc42 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 946 time: 0.4396491 May 12 15:20:01.118225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'Subnet': ['ID=0bff4903-0a06-4cb5-83f0-77c88b761e29,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:01.155742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Checking segment: {'id': '09634c20-a08f-4ec1-bfd2-67b02eef0803', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '7d76bd1a-568e-42be-801e-4192db4bb211'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:01.156107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Network hostable DHCP agents. Network: 7d76bd1a-568e-42be-801e-4192db4bb211, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:20:01.166635 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-853ee29a-6536-40cc-8147-bfb7ac642029 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:01.191372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d79e861-4d15-40fd-b18b-332475de3a4b req-b688a14a-2de0-4297-93e9-3ad0841f1a02 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1120670 May 12 15:20:01.217934 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-853ee29a-6536-40cc-8147-bfb7ac642029 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:01.278210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c66c764c-4585-41ba-9ab9-51868f8cfc5a req-c751c6dc-214d-46c0-94ae-3ffbf173f8a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:01.279688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c66c764c-4585-41ba-9ab9-51868f8cfc5a req-c751c6dc-214d-46c0-94ae-3ffbf173f8a5 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.3725462 May 12 15:20:01.281567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Network 7d76bd1a-568e-42be-801e-4192db4bb211 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:20:01.283599 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-853ee29a-6536-40cc-8147-bfb7ac642029 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:01.329055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-853ee29a-6536-40cc-8147-bfb7ac642029 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=899a377e-7288-4d76-8728-d6e9ec4dddcc,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:01.354158 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-853ee29a-6536-40cc-8147-bfb7ac642029 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:01.355268 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-853ee29a-6536-40cc-8147-bfb7ac642029 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/899a377e-7288-4d76-8728-d6e9ec4dddcc HTTP/1.1" status: 204 len: 168 time: 0.4665065 May 12 15:20:01.408982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 7d76bd1a-568e-42be-801e-4192db4bb211) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:01.419353 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e8435dc-3cb3-4b08-85e1-433528f6347d None None] Network 7d76bd1a-568e-42be-801e-4192db4bb211 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:01.439884 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:01.440459 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:01.570353 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c66c764c-4585-41ba-9ab9-51868f8cfc5a req-39d3aebf-1677-4732-b724-8ae62f4f8d0c service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2788668 May 12 15:20:01.708586 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-7d76bd1a-568e-42be-801e-4192db4bb211', 'network_id': '7d76bd1a-568e-42be-801e-4192db4bb211', 'tenant_id': '474c82a3dfe24a42ae9d88d67006b265', 'fixed_ips': [{'subnet_id': '0bff4903-0a06-4cb5-83f0-77c88b761e29'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:20:01.709831 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:01.775111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f6899a57-be62-41e9-95c3-f9a1402b11fa tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 2.1982884 May 12 15:20:01.778727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32984) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:01.785350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-108723284'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:01.791820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:01.795970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Usage tracker for resource:network and tenant:474c82a3dfe24a42ae9d88d67006b265 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:01.799684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:01.807434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:01.822758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Made reservation on behalf of 474c82a3dfe24a42ae9d88d67006b265 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:01.826732 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:01.862318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 564} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:20:01.873947 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:01.874345 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Added segment 0e56ffaa-9259-4d30-8f4a-1ddeec47517b of type vlan for network c3bfc2e7-b3ab-4fff-824f-ce558c6da32c May 12 15:20:01.903604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:01.940606 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:01.948726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:01.949793 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:01.951034 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Allocated IP 2001:db8:0:ffff::2 (7d76bd1a-568e-42be-801e-4192db4bb211/0bff4903-0a06-4cb5-83f0-77c88b761e29/3b830b86-8a0b-4d94-96ba-c9968e7ee2d2) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:01.997592 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c66c764c-4585-41ba-9ab9-51868f8cfc5a req-aa6b70c8-d2df-4db3-a27f-79eadb24fe95 service neutron] 10.222.0.76 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3749447 May 12 15:20:02.020244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4f668b-5902-4c82-b9fb-d496a364b341 req-d2077d59-747d-4ce1-84d9-d3656d42f7ef tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:02.021218 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f4f668b-5902-4c82-b9fb-d496a364b341 req-d2077d59-747d-4ce1-84d9-d3656d42f7ef tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 943 time: 0.2449844 May 12 15:20:02.029131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba002cd-572d-4411-8650-d9b9485937fa req-896fe50c-f9e0-419b-a7af-a86b5e140b2e tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:02.030766 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4ba002cd-572d-4411-8650-d9b9485937fa req-896fe50c-f9e0-419b-a7af-a86b5e140b2e tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 946 time: 0.4593832 May 12 15:20:02.105257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f4f668b-5902-4c82-b9fb-d496a364b341 req-0e7cde18-859a-42dd-8b2a-d0fe9665851a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0734165 May 12 15:20:02.119979 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4ba002cd-572d-4411-8650-d9b9485937fa req-666c9b9b-1696-41ec-8775-26b0a5041669 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/security-groups?id=741e94d4-5b74-4583-8ee0-e67ced7944a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0729008 May 12 15:20:02.190478 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:02.237558 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.4571702 May 12 15:20:02.241504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33008) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:02.247673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Request body: {'subnet': {'network_id': 'c3bfc2e7-b3ab-4fff-824f-ce558c6da32c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:02.257900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f930c4dc-c189-48cb-8213-55d2c382ca13 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'Network': ['ID=c3bfc2e7-b3ab-4fff-824f-ce558c6da32c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:02.274617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network c3bfc2e7-b3ab-4fff-824f-ce558c6da32c details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:20:02.372514 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44b32cfb-2376-40c6-ae37-8446a06e8976 req-d40fdd93-e5fc-4896-aa68-b0ca8c67af52 tempest-FlavorsV2NegativeTest-1144989424 tempest-FlavorsV2NegativeTest-1144989424-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=6cf4c0b0120941f990e3ff8885ce87e4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1044874 May 12 15:20:02.399587 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:02.415217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Transition to ACTIVE for port object 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:02.442068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Transition to ACTIVE for port object 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:02.460351 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:02.483898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:02.503578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:02.511879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Usage tracker for resource:subnet and tenant:474c82a3dfe24a42ae9d88d67006b265 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:02.516708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:02.537013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:02.567812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33024) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:02.583175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Made reservation on behalf of 474c82a3dfe24a42ae9d88d67006b265 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:02.586684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:02.616814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Pushing event updated for resources: {'Port': ['ID=3b830b86-8a0b-4d94-96ba-c9968e7ee2d2,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:02.631359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Network 7d76bd1a-568e-42be-801e-4192db4bb211 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:02.633180 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:02.636500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:02.639855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b32cfb-2376-40c6-ae37-8446a06e8976 req-b8b8578a-f501-4085-8269-6f1b16e19353 tempest-FlavorsV2NegativeTest-1144989424 tempest-FlavorsV2NegativeTest-1144989424-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:02.650123 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44b32cfb-2376-40c6-ae37-8446a06e8976 req-b8b8578a-f501-4085-8269-6f1b16e19353 tempest-FlavorsV2NegativeTest-1144989424 tempest-FlavorsV2NegativeTest-1144989424-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2765651 May 12 15:20:02.689156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-5e43fe07-e486-4cc7-a048-1cc49bb1560d admin admin] Deleting subnet c687227b-891f-4ef3-8df3-ff7f6bcba26e {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:20:02.702186 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e43fe07-e486-4cc7-a048-1cc49bb1560d admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:02.755938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Attempting to bind port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:20:02.756305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Attempting to bind port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '09634c20-a08f-4ec1-bfd2-67b02eef0803', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '7d76bd1a-568e-42be-801e-4192db4bb211'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:20:02.756659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Attempting to bind port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 on network 7d76bd1a-568e-42be-801e-4192db4bb211 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:20:02.770765 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e43fe07-e486-4cc7-a048-1cc49bb1560d admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:02.771075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 19, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:20:02.771443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Checking segment: {'id': '09634c20-a08f-4ec1-bfd2-67b02eef0803', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '7d76bd1a-568e-42be-801e-4192db4bb211'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:02.771841 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:02.772227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Bound using segment: {'id': '09634c20-a08f-4ec1-bfd2-67b02eef0803', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '7d76bd1a-568e-42be-801e-4192db4bb211'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:20:02.772694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Bound port: 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '09634c20-a08f-4ec1-bfd2-67b02eef0803', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': '7d76bd1a-568e-42be-801e-4192db4bb211'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:20:02.773061 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:02.804285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44b32cfb-2376-40c6-ae37-8446a06e8976 req-cdb3ae62-32fc-4b78-89b6-0a981cc6dc3e tempest-FlavorsV2NegativeTest-1144989424 tempest-FlavorsV2NegativeTest-1144989424-project] 10.222.0.82 "GET /v2.0/quotas/6cf4c0b0120941f990e3ff8885ce87e4 HTTP/1.1" status: 200 len: 375 time: 0.1532955 May 12 15:20:02.842333 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e43fe07-e486-4cc7-a048-1cc49bb1560d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:02.881085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] For port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:20:02.885552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] For port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3b830b86-8a0b-4d94-96ba-c9968e7ee2d2,segment=NetworkSegment(09634c20-a08f-4ec1-bfd2-67b02eef0803),segment_id=09634c20-a08f-4ec1-bfd2-67b02eef0803)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:20:02.896886 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:02.926060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44b32cfb-2376-40c6-ae37-8446a06e8976 req-efd66711-873c-4a70-9884-5ed7690ce678 tempest-FlavorsV2NegativeTest-1144989424 tempest-FlavorsV2NegativeTest-1144989424-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6cf4c0b0120941f990e3ff8885ce87e4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1199634 May 12 15:20:02.942939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e43fe07-e486-4cc7-a048-1cc49bb1560d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:03.009602 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf1702bd-35e0-4766-8224-8c8d964a1018 None None] Pushing event updated for resources: {'Port': ['ID=3b830b86-8a0b-4d94-96ba-c9968e7ee2d2,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:03.019119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c341671e-a3e5-49ab-82c1-794b06d15b7a details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:20:03.055232 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-076026c1-62b2-4eb5-9416-c9e59f24c0fb'] response: {'name': 'network-changed', 'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'status': 'completed', 'code': 200} May 12 15:20:03.057316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e43fe07-e486-4cc7-a048-1cc49bb1560d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c687227b-891f-4ef3-8df3-ff7f6bcba26e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:03.058597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fefd9be-7c55-4a3e-bd10-0ed010025ee2 req-e0d479e0-7bd2-48fc-99bb-915025ccb129 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:03.059825 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e43fe07-e486-4cc7-a048-1cc49bb1560d admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:03.060991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0fefd9be-7c55-4a3e-bd10-0ed010025ee2 req-e0d479e0-7bd2-48fc-99bb-915025ccb129 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=07c1472fa162425e9303d95e5e843c64&device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 1097 time: 0.3051863 May 12 15:20:03.066552 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5e43fe07-e486-4cc7-a048-1cc49bb1560d admin admin] 10.222.0.82 "DELETE /v2.0/subnets/c687227b-891f-4ef3-8df3-ff7f6bcba26e HTTP/1.1" status: 204 len: 168 time: 0.4975064 May 12 15:20:03.069569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33046) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:03.192672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c341671e-a3e5-49ab-82c1-794b06d15b7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:03.193511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-707d5f37-4049-4bc6-8552-63e352e30c5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:03.208633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b98cfa4-bd7d-40c6-b769-c970de8bcd6f req-47648ff4-bc43-464f-8cf5-644a66711ed8 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:03.210424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b98cfa4-bd7d-40c6-b769-c970de8bcd6f req-47648ff4-bc43-464f-8cf5-644a66711ed8 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 946 time: 0.3915927 May 12 15:20:03.223507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'c341671e-a3e5-49ab-82c1-794b06d15b7a', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'c341671e-a3e5-49ab-82c1-794b06d15b7a', 'mac_address': 'fa:16:3e:d9:ea:a1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:20:03.337025 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:03.380388 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c341671e-a3e5-49ab-82c1-794b06d15b7a {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:20:03.412860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c341671e-a3e5-49ab-82c1-794b06d15b7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:03.422427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b98cfa4-bd7d-40c6-b769-c970de8bcd6f req-252245a9-5ab2-4cf4-a0a5-fce50447d0f6 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1932509 May 12 15:20:03.426337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fefd9be-7c55-4a3e-bd10-0ed010025ee2 req-3635a430-ecf7-4aaf-8b2f-3629e12dae4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:03.428425 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0fefd9be-7c55-4a3e-bd10-0ed010025ee2 req-3635a430-ecf7-4aaf-8b2f-3629e12dae4c service neutron] 10.222.0.76 "GET /v2.0/networks?id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d HTTP/1.1" status: 200 len: 917 time: 0.3353465 May 12 15:20:03.431717 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:03.548314 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-707d5f37-4049-4bc6-8552-63e352e30c5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:03.562743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1c1423a-3635-4b22-aa7e-ed23db6d2ddf req-692e8c83-b6f0-45ec-9e3f-176034ab997f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:03.564452 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a1c1423a-3635-4b22-aa7e-ed23db6d2ddf req-692e8c83-b6f0-45ec-9e3f-176034ab997f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 1094 time: 0.3684487 May 12 15:20:03.698230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0fefd9be-7c55-4a3e-bd10-0ed010025ee2 req-196f392e-fd71-4cff-99b4-9dccc99d347b service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=2a00c7fc-ced7-44c0-b374-110741ae6468 HTTP/1.1" status: 200 len: 217 time: 0.2561259 May 12 15:20:03.768481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 860dc344-70ad-4ff8-9592-ee8e988a4f26 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:20:03.771836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c341671e-a3e5-49ab-82c1-794b06d15b7a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:20:03.790719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1c1423a-3635-4b22-aa7e-ed23db6d2ddf req-28059ea3-d188-48b8-88c3-d93617778eb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:03.792185 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a1c1423a-3635-4b22-aa7e-ed23db6d2ddf req-28059ea3-d188-48b8-88c3-d93617778eb4 service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.2076378 May 12 15:20:03.802944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-707d5f37-4049-4bc6-8552-63e352e30c5f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5cc57423-d06b-48b4-8acf-9dcfbe4dc681']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:03.843844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-707d5f37-4049-4bc6-8552-63e352e30c5f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '95b43f05-4421-4ae6-99ff-55a5c256ee01') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:03.844560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-707d5f37-4049-4bc6-8552-63e352e30c5f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '95b43f05-4421-4ae6-99ff-55a5c256ee01') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:03.879307 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-707d5f37-4049-4bc6-8552-63e352e30c5f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:03.917850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c341671e-a3e5-49ab-82c1-794b06d15b7a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:03.920283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-707d5f37-4049-4bc6-8552-63e352e30c5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:03.940171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-707d5f37-4049-4bc6-8552-63e352e30c5f admin admin] Releasing vlan 588 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:20:03.940588 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-707d5f37-4049-4bc6-8552-63e352e30c5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: timer() May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:20:03.975606 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:20:03.998009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33064) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:04.091330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fefd9be-7c55-4a3e-bd10-0ed010025ee2 req-9c88761c-feaa-46ce-86c3-f4da651d8c81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:04.093679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0fefd9be-7c55-4a3e-bd10-0ed010025ee2 req-9c88761c-feaa-46ce-86c3-f4da651d8c81 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=34e2be1a-2cbe-4227-a0bf-50d20740aa45 HTTP/1.1" status: 200 len: 855 time: 0.3137045 May 12 15:20:04.134159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.objects.ports [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88152) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:20:04.186466 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a1c1423a-3635-4b22-aa7e-ed23db6d2ddf req-4ab6dfa9-7737-46a9-abb0-078acf6369c0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26 HTTP/1.1" status: 200 len: 217 time: 0.3660550 May 12 15:20:04.262227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1c1423a-3635-4b22-aa7e-ed23db6d2ddf req-ef8fcc8b-1468-4dc3-a609-83cb33dba99c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:04.263927 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a1c1423a-3635-4b22-aa7e-ed23db6d2ddf req-ef8fcc8b-1468-4dc3-a609-83cb33dba99c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.0666046 May 12 15:20:04.311365 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:04.319593 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-707d5f37-4049-4bc6-8552-63e352e30c5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:04.324655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-707d5f37-4049-4bc6-8552-63e352e30c5f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:04.348589 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:04.390611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-707d5f37-4049-4bc6-8552-63e352e30c5f admin admin] Pushing event deleted for resources: {'Network': ['ID=5cc57423-d06b-48b4-8acf-9dcfbe4dc681,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:04.403043 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-707d5f37-4049-4bc6-8552-63e352e30c5f admin admin] 10.222.0.82 "DELETE /v2.0/networks/5cc57423-d06b-48b4-8acf-9dcfbe4dc681 HTTP/1.1" status: 204 len: 168 time: 1.3323514 May 12 15:20:04.408367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33078) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:04.436367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'port_id': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'mac_address': 'fa:16:3e:ad:b5:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 579, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:20:04.487856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-db200d7e-2c2b-4f7b-a9f3-203234cf2ff4 admin admin] Deleting subnet 36a465da-fc0b-4eba-894d-7c0c06e6a50c {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:20:04.495818 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db200d7e-2c2b-4f7b-a9f3-203234cf2ff4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:04.514644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'Subnet': ['ID=8bb5348d-ba26-4492-b99e-7c45af59ff21,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:04.532914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Request body: {'network': {'name': 'tempest-RoutersAdminTest-163080178', 'router:external': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:04.539699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:04.544597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Usage tracker for resource:network and tenant:a0824ae235484071b39cd368d3b3aa19 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:04.549037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:04.556474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1c1423a-3635-4b22-aa7e-ed23db6d2ddf req-5254cc71-3995-4f03-bdbb-1739c0105c3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:04.557006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:04.557988 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a1c1423a-3635-4b22-aa7e-ed23db6d2ddf req-5254cc71-3995-4f03-bdbb-1739c0105c3e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2840521 May 12 15:20:04.575176 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:04.593587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Made reservation on behalf of a0824ae235484071b39cd368d3b3aa19 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:04.597585 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:04.620231 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 860dc344-70ad-4ff8-9592-ee8e988a4f26 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:20:04.624154 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:04.663831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:04.673365 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:04.680554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dabfa772-b39a-4e5c-9dcb-3ff00eb31e66 req-706ac0f8-96a4-49b1-af64-9d14d9113d9d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:04.683856 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dabfa772-b39a-4e5c-9dcb-3ff00eb31e66 req-706ac0f8-96a4-49b1-af64-9d14d9113d9d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 943 time: 0.8996196 May 12 15:20:04.692391 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:04.705091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Usage tracker for resource:security_group_rule and tenant:a0824ae235484071b39cd368d3b3aa19 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:04.721588 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a1c1423a-3635-4b22-aa7e-ed23db6d2ddf req-0869b95e-5f77-4291-bee4-ccead9c8e030 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1523035 May 12 15:20:04.724446 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db200d7e-2c2b-4f7b-a9f3-203234cf2ff4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:04.750759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:04.774349 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:04.818489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee18569-f48e-4bf3-af7f-3b7f8d88bafd req-a36b3068-0914-4ff5-8b79-a85859f90479 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:04.828003 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ee18569-f48e-4bf3-af7f-3b7f8d88bafd req-a36b3068-0914-4ff5-8b79-a85859f90479 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 947 time: 0.7436502 May 12 15:20:04.840313 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dabfa772-b39a-4e5c-9dcb-3ff00eb31e66 req-97af81f0-114f-4716-a460-12808c463ab7 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1412351 May 12 15:20:04.841123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Checking segment: {'id': '0e56ffaa-9259-4d30-8f4a-1ddeec47517b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'c3bfc2e7-b3ab-4fff-824f-ce558c6da32c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:04.841537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Network hostable DHCP agents. Network: c3bfc2e7-b3ab-4fff-824f-ce558c6da32c, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:20:04.886803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a97835d-cdf2-4c4e-be7c-66c38cedd064 None None] Network 7d76bd1a-568e-42be-801e-4192db4bb211 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:04.912521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fefd9be-7c55-4a3e-bd10-0ed010025ee2 req-fdf29963-4dc2-4f32-94d0-2c941b38b14c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:04.914473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0fefd9be-7c55-4a3e-bd10-0ed010025ee2 req-fdf29963-4dc2-4f32-94d0-2c941b38b14c service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=0ff32f81-3ca6-41e0-8986-06dbed4ab52d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.7777877 May 12 15:20:04.991230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ee18569-f48e-4bf3-af7f-3b7f8d88bafd req-ea06c0e3-8862-417c-b7a8-28a2f4a7e91b tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/security-groups?id=741e94d4-5b74-4583-8ee0-e67ced7944a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1621752 May 12 15:20:05.006139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33088) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:05.011903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Network c3bfc2e7-b3ab-4fff-824f-ce558c6da32c is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:20:05.050327 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db200d7e-2c2b-4f7b-a9f3-203234cf2ff4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.060327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:05.130962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c341671e-a3e5-49ab-82c1-794b06d15b7a up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:05.148600 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a1c1423a-3635-4b22-aa7e-ed23db6d2ddf req-ad290f68-e8f1-4066-9507-a116452746ff service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3919685 May 12 15:20:05.158552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0965ae22-d963-44ef-82af-18a582c397af None None] Provisioning for port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:05.171244 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db200d7e-2c2b-4f7b-a9f3-203234cf2ff4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.184508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:05.225691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, c3bfc2e7-b3ab-4fff-824f-ce558c6da32c) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:05.227503 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['860dc344-70ad-4ff8-9592-ee8e988a4f26'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:20:05.252353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:05.252698 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.261000 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db200d7e-2c2b-4f7b-a9f3-203234cf2ff4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.270263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f355543-fc5a-4634-84bd-4c882d0ecc0b None None] Network c3bfc2e7-b3ab-4fff-824f-ce558c6da32c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:05.276625 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-db200d7e-2c2b-4f7b-a9f3-203234cf2ff4 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/36a465da-fc0b-4eba-894d-7c0c06e6a50c HTTP/1.1" status: 204 len: 168 time: 0.8668218 May 12 15:20:05.281662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33094) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:05.285533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db200d7e-2c2b-4f7b-a9f3-203234cf2ff4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=36a465da-fc0b-4eba-894d-7c0c06e6a50c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:05.365023 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2ea38c5b-9c0b-4c22-8f90-5d95b4fe1d14 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.392723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:05.409954 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0fefd9be-7c55-4a3e-bd10-0ed010025ee2 req-c09b1fc8-9f92-4a58-94d9-3c409fc8a6e0 service neutron] 10.222.0.76 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4668338 May 12 15:20:05.413508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2ea38c5b-9c0b-4c22-8f90-5d95b4fe1d14 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:05.418585 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cc55cbd6-61b2-4559-9ae6-753628ba5535 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 3.1760430 May 12 15:20:05.421735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33098) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:05.431491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:05.431860 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.431981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Request body: {'port': {'network_id': 'c3bfc2e7-b3ab-4fff-824f-ce558c6da32c', 'name': 'tempest-NetworksIpV6TestAttrs-2143052111'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:05.450991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2ea38c5b-9c0b-4c22-8f90-5d95b4fe1d14 admin admin] Usage tracker for resource:security_group_rule and tenant:6cf4c0b0120941f990e3ff8885ce87e4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:05.457415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2ea38c5b-9c0b-4c22-8f90-5d95b4fe1d14 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:05.477345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf7aa9ed-a182-41cb-8bb2-862fd28297f2 req-d3f672e9-71cc-44fe-a900-b8ba1a9da763 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:05.483688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf7aa9ed-a182-41cb-8bb2-862fd28297f2 req-d3f672e9-71cc-44fe-a900-b8ba1a9da763 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:05.490032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf7aa9ed-a182-41cb-8bb2-862fd28297f2 req-d3f672e9-71cc-44fe-a900-b8ba1a9da763 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:05.495710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf7aa9ed-a182-41cb-8bb2-862fd28297f2 req-d3f672e9-71cc-44fe-a900-b8ba1a9da763 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:05.501505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf7aa9ed-a182-41cb-8bb2-862fd28297f2 req-d3f672e9-71cc-44fe-a900-b8ba1a9da763 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:05.508506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf7aa9ed-a182-41cb-8bb2-862fd28297f2 req-d3f672e9-71cc-44fe-a900-b8ba1a9da763 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:05.514748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf7aa9ed-a182-41cb-8bb2-862fd28297f2 req-d3f672e9-71cc-44fe-a900-b8ba1a9da763 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:05.516666 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf7aa9ed-a182-41cb-8bb2-862fd28297f2 req-d3f672e9-71cc-44fe-a900-b8ba1a9da763 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5433 time: 0.3920088 May 12 15:20:05.529356 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.537787 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-92eb1f25-bc34-46ec-8919-0257f515ae8c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.587647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2ea38c5b-9c0b-4c22-8f90-5d95b4fe1d14 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:05.597092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de629fa-e21c-4c26-8b59-0e979b48368e req-0eb9722c-3027-4811-984c-6238eb92b666 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:05.599219 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0de629fa-e21c-4c26-8b59-0e979b48368e req-0eb9722c-3027-4811-984c-6238eb92b666 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 946 time: 0.4732006 May 12 15:20:05.602379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port c341671e-a3e5-49ab-82c1-794b06d15b7a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:05.619818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port c341671e-a3e5-49ab-82c1-794b06d15b7a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:05.619818 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.620751 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.696201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 593} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:20:05.722878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-92eb1f25-bc34-46ec-8919-0257f515ae8c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.731855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:05.740523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Usage tracker for resource:port and tenant:474c82a3dfe24a42ae9d88d67006b265 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:05.751211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:05.761916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:05.765079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-92eb1f25-bc34-46ec-8919-0257f515ae8c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['79f95263-b773-4ed2-a217-3981203759e0']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:05.765229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37283c3a-0a68-4ee5-8c0a-2a733f18c7f0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:05.768030 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.768361 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Added segment 279b1471-6284-470c-ab12-e2a80d2f35a1 of type vlan for network c3b6dec8-1eff-4f03-b450-8f4eab49b5bc May 12 15:20:05.783190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-92eb1f25-bc34-46ec-8919-0257f515ae8c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '75791975-1c41-4f7d-9e8f-621f8acfb6b8') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:05.783503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-92eb1f25-bc34-46ec-8919-0257f515ae8c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '75791975-1c41-4f7d-9e8f-621f8acfb6b8') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:05.790864 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf7aa9ed-a182-41cb-8bb2-862fd28297f2 req-16cc0edf-8639-4360-ada6-c137db617239 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2108417 May 12 15:20:05.797495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Made reservation on behalf of 474c82a3dfe24a42ae9d88d67006b265 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:05.802057 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.805630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0de629fa-e21c-4c26-8b59-0e979b48368e req-8ff81aaa-e11f-44c3-bb2c-8b73e558236c tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1816168 May 12 15:20:05.814733 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-92eb1f25-bc34-46ec-8919-0257f515ae8c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.839647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] device_id is not set on port 64ebd533-3247-4dc6-a4f8-173e6ebced5b yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:20:05.845044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0fefd9be-7c55-4a3e-bd10-0ed010025ee2 req-6183bb97-8103-4c60-99c5-59dd8644cfa7 service neutron] 10.222.0.76 "GET /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4198630 May 12 15:20:05.868786 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.870976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-c3bfc2e7-b3ab-4fff-824f-ce558c6da32c', 'network_id': 'c3bfc2e7-b3ab-4fff-824f-ce558c6da32c', 'tenant_id': '474c82a3dfe24a42ae9d88d67006b265', 'fixed_ips': [{'subnet_id': '8bb5348d-ba26-4492-b99e-7c45af59ff21'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:20:05.871460 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.893526 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-92eb1f25-bc34-46ec-8919-0257f515ae8c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.919391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-92eb1f25-bc34-46ec-8919-0257f515ae8c admin admin] Releasing vlan 568 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:20:05.919796 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-92eb1f25-bc34-46ec-8919-0257f515ae8c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: timer() May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:20:05.936636 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:20:05.987146 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2ea38c5b-9c0b-4c22-8f90-5d95b4fe1d14 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.993531 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:05.994520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:05.995100 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:06.021247 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2ea38c5b-9c0b-4c22-8f90-5d95b4fe1d14 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:06.081472 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:06.149062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-92eb1f25-bc34-46ec-8919-0257f515ae8c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:06.177241 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-92eb1f25-bc34-46ec-8919-0257f515ae8c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:06.178293 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:06.188021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92eb1f25-bc34-46ec-8919-0257f515ae8c admin admin] Pushing event deleted for resources: {'Network': ['ID=79f95263-b773-4ed2-a217-3981203759e0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:06.200666 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Allocated IP 2001:db8::f816:3eff:fe5a:9832 (c3bfc2e7-b3ab-4fff-824f-ce558c6da32c/8bb5348d-ba26-4492-b99e-7c45af59ff21/64ebd533-3247-4dc6-a4f8-173e6ebced5b) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:06.204848 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-92eb1f25-bc34-46ec-8919-0257f515ae8c admin admin] 10.222.0.82 "DELETE /v2.0/networks/79f95263-b773-4ed2-a217-3981203759e0 HTTP/1.1" status: 204 len: 168 time: 0.9212346 May 12 15:20:06.240024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2ea38c5b-9c0b-4c22-8f90-5d95b4fe1d14 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6cf4c0b0120941f990e3ff8885ce87e4&name=default HTTP/1.1" status: 200 len: 2983 time: 1.2296994 May 12 15:20:06.242871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33110) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:06.244638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ea38c5b-9c0b-4c22-8f90-5d95b4fe1d14 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a50bb919-7547-45d1-889c-3c34e68bea21,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:06.255998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 870 time: 2.2510667 May 12 15:20:06.271398 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33112) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:06.289634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Request body: {'subnet': {'network_id': 'c3b6dec8-1eff-4f03-b450-8f4eab49b5bc', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:06.295537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8417c87a-eb11-451d-a550-af92c763bf91 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event updated for resources: {'Network': ['ID=c3b6dec8-1eff-4f03-b450-8f4eab49b5bc,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:06.353647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:06.367561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network c3b6dec8-1eff-4f03-b450-8f4eab49b5bc details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:20:06.445317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Usage tracker for resource:subnet and tenant:a0824ae235484071b39cd368d3b3aa19 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:06.479284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:06.482186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33118) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:06.527850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3b830b86-8a0b-4d94-96ba-c9968e7ee2d2,segment=NetworkSegment(09634c20-a08f-4ec1-bfd2-67b02eef0803),segment_id=09634c20-a08f-4ec1-bfd2-67b02eef0803)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:06.556767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:06.565153 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:06.599910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62161b0c-8dae-4011-96f3-77e94d5e0310 req-c5de2810-8393-4a64-8379-58bcea65c083 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:06.605761 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6eb36fe1-ccc0-43c5-8ba1-7c380ecf5fc3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:06.607286 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62161b0c-8dae-4011-96f3-77e94d5e0310 req-c5de2810-8393-4a64-8379-58bcea65c083 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.4591651 May 12 15:20:06.620627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c341671e-a3e5-49ab-82c1-794b06d15b7a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:06.634327 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:06.658875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Transition to ACTIVE for port object 64ebd533-3247-4dc6-a4f8-173e6ebced5b will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:06.665243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c341671e-a3e5-49ab-82c1-794b06d15b7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:06.678061 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62161b0c-8dae-4011-96f3-77e94d5e0310 req-db9b4c0f-14f1-4322-98a9-a89114a1724f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0696173 May 12 15:20:06.682510 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:06.695914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=3b830b86-8a0b-4d94-96ba-c9968e7ee2d2,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:06.696119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Made reservation on behalf of a0824ae235484071b39cd368d3b3aa19 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:06.702556 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:06.715101 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6eb36fe1-ccc0-43c5-8ba1-7c380ecf5fc3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:06.743931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-480269f4-b78b-45a8-9f37-afb3f6575e82 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f304b3ab44174793b8f251ca5bae6bc1&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2479329 May 12 15:20:06.751766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33126) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:06.776224 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c06a1d6c-50ca-4126-b78e-351249e78cea None None] Provisioning complete for port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:06.776224 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c06a1d6c-50ca-4126-b78e-351249e78cea None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:06.819127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abed651-9b88-4935-ba84-639009aa6df0 req-a25278e7-10fb-4da9-ab63-a57160bfcd5d tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:06.820654 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9abed651-9b88-4935-ba84-639009aa6df0 req-a25278e7-10fb-4da9-ab63-a57160bfcd5d tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 947 time: 0.5270622 May 12 15:20:06.890067 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:06.920726 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9abed651-9b88-4935-ba84-639009aa6df0 req-f628e527-fc8e-47e6-b1de-83b878dac21a tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/security-groups?id=741e94d4-5b74-4583-8ee0-e67ced7944a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0884113 May 12 15:20:06.953780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:06.961098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Network c3bfc2e7-b3ab-4fff-824f-ce558c6da32c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:06.984737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:06.987139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:06.994622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:06.995251 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:07.000029 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea691281-079b-4730-b9f5-09594ca69edb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:07.001933 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6eb36fe1-ccc0-43c5-8ba1-7c380ecf5fc3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:07.052289 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea691281-079b-4730-b9f5-09594ca69edb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:07.169893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eb36fe1-ccc0-43c5-8ba1-7c380ecf5fc3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a50bb919-7547-45d1-889c-3c34e68bea21,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:07.177428 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea691281-079b-4730-b9f5-09594ca69edb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:07.183050 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Allocated IP 2001:db8::f816:3eff:feb8:92ad (c3bfc2e7-b3ab-4fff-824f-ce558c6da32c/8bb5348d-ba26-4492-b99e-7c45af59ff21/1442d61c-a20e-4306-aff5-c111db29ac13) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:07.226659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea691281-079b-4730-b9f5-09594ca69edb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=32ee1ea1-656f-486b-9369-2586dedf1884,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:07.240615 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6eb36fe1-ccc0-43c5-8ba1-7c380ecf5fc3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:07.241974 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6eb36fe1-ccc0-43c5-8ba1-7c380ecf5fc3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a50bb919-7547-45d1-889c-3c34e68bea21 HTTP/1.1" status: 204 len: 168 time: 0.9918206 May 12 15:20:07.252041 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 951 time: 1.8284836 May 12 15:20:07.253753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33136) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:07.256570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef26e0be-dcb0-4d0e-bdca-d6f456de2fa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'Port': ['ID=64ebd533-3247-4dc6-a4f8-173e6ebced5b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:07.266525 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea691281-079b-4730-b9f5-09594ca69edb admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:07.267665 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ea691281-079b-4730-b9f5-09594ca69edb admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/32ee1ea1-656f-486b-9369-2586dedf1884 HTTP/1.1" status: 204 len: 168 time: 0.5149724 May 12 15:20:07.350706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-b2b26cfb-a7cd-433b-a9d2-386a34312969 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Deleting subnet 8bb5348d-ba26-4492-b99e-7c45af59ff21 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:20:07.366544 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1b52686a-1938-4ecf-b2e2-c94a0a21b34e'] response: {'server_uuid': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c341671e-a3e5-49ab-82c1-794b06d15b7a', 'code': 200} May 12 15:20:07.434397 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c341671e-a3e5-49ab-82c1-794b06d15b7a,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:07.476375 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:07.476375 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:07.580548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2deccf54-c405-4f57-9ce1-f128d92d8df1 req-d6890042-9f02-476a-af54-d230628930b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:07.582773 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2deccf54-c405-4f57-9ce1-f128d92d8df1 req-d6890042-9f02-476a-af54-d230628930b0 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 1099 time: 0.4035895 May 12 15:20:07.623016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aac6c0c-c6f7-4dcf-af14-e420cc100220 req-f93f12a6-f655-44c8-ae7b-9f071b25d78a tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:07.636043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9aac6c0c-c6f7-4dcf-af14-e420cc100220 req-f93f12a6-f655-44c8-ae7b-9f071b25d78a tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 946 time: 0.5187078 May 12 15:20:07.690878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 860dc344-70ad-4ff8-9592-ee8e988a4f26 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:07.736167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9aac6c0c-c6f7-4dcf-af14-e420cc100220 req-0adf64b9-a2c4-4eff-ac22-ed75ed04e040 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0991149 May 12 15:20:07.790175 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:07.809855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Transition to ACTIVE for port object 1442d61c-a20e-4306-aff5-c111db29ac13 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:07.822897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ee5a36-29db-4124-9285-df1da7c68436 req-e6b2461a-8708-40ed-86a5-804645bdadc7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:07.829072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ee5a36-29db-4124-9285-df1da7c68436 req-e6b2461a-8708-40ed-86a5-804645bdadc7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:07.835449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ee5a36-29db-4124-9285-df1da7c68436 req-e6b2461a-8708-40ed-86a5-804645bdadc7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:07.837883 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Transition to ACTIVE for port object 1442d61c-a20e-4306-aff5-c111db29ac13 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:07.841363 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 860dc344-70ad-4ff8-9592-ee8e988a4f26 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:07.844975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ee5a36-29db-4124-9285-df1da7c68436 req-e6b2461a-8708-40ed-86a5-804645bdadc7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:07.848820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 860dc344-70ad-4ff8-9592-ee8e988a4f26 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:07.849534 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:07.852678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ee5a36-29db-4124-9285-df1da7c68436 req-e6b2461a-8708-40ed-86a5-804645bdadc7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:07.858074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b2b26cfb-a7cd-433b-a9d2-386a34312969 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:07.859527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ee5a36-29db-4124-9285-df1da7c68436 req-e6b2461a-8708-40ed-86a5-804645bdadc7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:07.867466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ee5a36-29db-4124-9285-df1da7c68436 req-e6b2461a-8708-40ed-86a5-804645bdadc7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:07.875434 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83ee5a36-29db-4124-9285-df1da7c68436 req-e6b2461a-8708-40ed-86a5-804645bdadc7 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5433 time: 0.4626565 May 12 15:20:07.894911 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2deccf54-c405-4f57-9ce1-f128d92d8df1 req-b360d231-40a9-4da7-afca-1cb94776cf27 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=741e94d4-5b74-4583-8ee0-e67ced7944a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3027828 May 12 15:20:07.895858 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:07.959491 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b2b26cfb-a7cd-433b-a9d2-386a34312969 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:08.022118 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Network c3bfc2e7-b3ab-4fff-824f-ce558c6da32c is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:08.032642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83ee5a36-29db-4124-9285-df1da7c68436 req-4dd35c71-b754-4b2a-86d9-18cc19645cce tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1559560 May 12 15:20:08.042721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:08.048523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33160) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:08.050044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:08.161065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Pushing event updated for resources: {'Port': ['ID=1442d61c-a20e-4306-aff5-c111db29ac13,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:08.161360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.objects.ports [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88152) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:20:08.161751 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:08.226360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-d0c397b5-eb66-4d81-ba0f-69270d4af22e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:08.233111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-d0c397b5-eb66-4d81-ba0f-69270d4af22e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:08.239264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-d0c397b5-eb66-4d81-ba0f-69270d4af22e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:08.245446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-d0c397b5-eb66-4d81-ba0f-69270d4af22e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:08.251364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-d0c397b5-eb66-4d81-ba0f-69270d4af22e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:08.257695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-d0c397b5-eb66-4d81-ba0f-69270d4af22e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:08.263632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-d0c397b5-eb66-4d81-ba0f-69270d4af22e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:08.264950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-d0c397b5-eb66-4d81-ba0f-69270d4af22e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Synchronizing usage tracker for tenant:42581a8af83242e0bb61f84a30bd27a7 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:20:08.290457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-d0c397b5-eb66-4d81-ba0f-69270d4af22e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Unset dirty status for tenant:42581a8af83242e0bb61f84a30bd27a7 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:20:08.291904 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-d0c397b5-eb66-4d81-ba0f-69270d4af22e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5433 time: 0.5384202 May 12 15:20:08.318879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Attempting to bind port 1442d61c-a20e-4306-aff5-c111db29ac13 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:20:08.319237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Attempting to bind port 1442d61c-a20e-4306-aff5-c111db29ac13 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '0e56ffaa-9259-4d30-8f4a-1ddeec47517b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'c3bfc2e7-b3ab-4fff-824f-ce558c6da32c'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:20:08.319587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Attempting to bind port 1442d61c-a20e-4306-aff5-c111db29ac13 on network c3bfc2e7-b3ab-4fff-824f-ce558c6da32c {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:20:08.323130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event updated for resources: {'Subnet': ['ID=86aa37d6-735f-4645-b451-24e9708aabe6,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:08.331211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 19, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:20:08.332084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Checking segment: {'id': '0e56ffaa-9259-4d30-8f4a-1ddeec47517b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'c3bfc2e7-b3ab-4fff-824f-ce558c6da32c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:08.332848 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:08.333407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Bound using segment: {'id': '0e56ffaa-9259-4d30-8f4a-1ddeec47517b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'c3bfc2e7-b3ab-4fff-824f-ce558c6da32c'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:20:08.334042 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Bound port: 1442d61c-a20e-4306-aff5-c111db29ac13, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0e56ffaa-9259-4d30-8f4a-1ddeec47517b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'c3bfc2e7-b3ab-4fff-824f-ce558c6da32c'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:20:08.334572 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:08.356917 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:08.390104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-e4dc170a-e0a2-444d-bad6-000e8cbf86f6 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:08.391450 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-e4dc170a-e0a2-444d-bad6-000e8cbf86f6 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "GET /v2.0/ports/ef28df6f-7573-4910-9fae-c2b49092303b?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.0900829 May 12 15:20:08.396603 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Checking segment: {'id': '279b1471-6284-470c-ab12-e2a80d2f35a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 593, 'network_id': 'c3b6dec8-1eff-4f03-b450-8f4eab49b5bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:08.401868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Network hostable DHCP agents. Network: c3b6dec8-1eff-4f03-b450-8f4eab49b5bc, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:20:08.445045 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bb18a8df-3131-4de8-ac50-a32a405ca3f0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=75cd4b579aef4e258133356e6e447b43&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3922911 May 12 15:20:08.448840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33172) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:08.455528 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:08.467284 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:08.495588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65c02818-02ce-4629-98f0-3cded3f123f4 req-fab84f50-b40d-4bc5-9421-3febd62de2ce tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:08.497095 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65c02818-02ce-4629-98f0-3cded3f123f4 req-fab84f50-b40d-4bc5-9421-3febd62de2ce tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.5669639 May 12 15:20:08.521421 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] For port 1442d61c-a20e-4306-aff5-c111db29ac13, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:20:08.533864 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Network c3b6dec8-1eff-4f03-b450-8f4eab49b5bc is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:20:08.548601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] For port 1442d61c-a20e-4306-aff5-c111db29ac13, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1442d61c-a20e-4306-aff5-c111db29ac13,segment=NetworkSegment(0e56ffaa-9259-4d30-8f4a-1ddeec47517b),segment_id=0e56ffaa-9259-4d30-8f4a-1ddeec47517b)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:20:08.560163 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:08.569859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71be0e7f-725f-4d02-ad45-1f7d8978ce8c req-59d4317f-f332-4c9c-afbf-abfa8dd9cc6c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:08.571648 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71be0e7f-725f-4d02-ad45-1f7d8978ce8c req-59d4317f-f332-4c9c-afbf-abfa8dd9cc6c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 948 time: 0.3004785 May 12 15:20:08.581773 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b2b26cfb-a7cd-433b-a9d2-386a34312969 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:08.587637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:08.615433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, c3b6dec8-1eff-4f03-b450-8f4eab49b5bc) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:08.629993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d82bff24-b749-47c7-9cfa-e025edb6b1e7 None None] Network c3b6dec8-1eff-4f03-b450-8f4eab49b5bc requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:08.641481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65c02818-02ce-4629-98f0-3cded3f123f4 req-8cc106e2-c4c8-4211-bee5-908eefdb9e78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1375694 May 12 15:20:08.647892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:08.648680 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:08.676995 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f8f0ea56-fda9-4b85-93fa-89a9175eb6ce admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:08.708106 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-46f64baf-9952-48d3-8ce4-96063463681f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 2.4306917 May 12 15:20:08.710558 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-e00b5b37-d809-4a02-9195-998f875d4f13 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "GET /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.3116477 May 12 15:20:08.711047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33180) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:08.729368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-1055c394-de2a-4d4d-b9f7-d7c22236660d service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:08.730824 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71be0e7f-725f-4d02-ad45-1f7d8978ce8c req-b469e107-dbdc-4198-859c-9350c959c62a tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/security-groups?id=741e94d4-5b74-4583-8ee0-e67ced7944a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1492705 May 12 15:20:08.754307 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f8f0ea56-fda9-4b85-93fa-89a9175eb6ce admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:08.799573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminTest-2030211132', 'network_id': 'c3b6dec8-1eff-4f03-b450-8f4eab49b5bc'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:08.811689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:08.846788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Usage tracker for resource:port and tenant:a0824ae235484071b39cd368d3b3aa19 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:08.851338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:08.874029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:08.909136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Made reservation on behalf of a0824ae235484071b39cd368d3b3aa19 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:08.913139 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:08.915464 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f8f0ea56-fda9-4b85-93fa-89a9175eb6ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:08.920415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c32439-82ae-47a6-919b-c220b3ec54ba None None] Pushing event updated for resources: {'Port': ['ID=1442d61c-a20e-4306-aff5-c111db29ac13,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:08.964457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8f0ea56-fda9-4b85-93fa-89a9175eb6ce admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eac3407a-9b2c-4c59-8835-1cbc3550dbe3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:09.042225 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f8f0ea56-fda9-4b85-93fa-89a9175eb6ce admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:09.043861 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f8f0ea56-fda9-4b85-93fa-89a9175eb6ce admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/eac3407a-9b2c-4c59-8835-1cbc3550dbe3 HTTP/1.1" status: 204 len: 168 time: 0.5913780 May 12 15:20:09.098428 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-1055c394-de2a-4d4d-b9f7-d7c22236660d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:09.111328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] device_id is not set on port de0ee6f7-5768-4075-82a8-ae61d89a953d yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:20:09.141084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bffd3884-d999-4376-a527-ac9251219763 req-2f1af175-99af-47f1-9561-4eabc6d4e8b3 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:09.147793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bffd3884-d999-4376-a527-ac9251219763 req-2f1af175-99af-47f1-9561-4eabc6d4e8b3 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 946 time: 0.3055098 May 12 15:20:09.246033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bffd3884-d999-4376-a527-ac9251219763 req-cc1311ad-71e8-4b5c-863b-645af41c40fa tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0927489 May 12 15:20:09.295161 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b3de78b-8b4f-437a-913e-539a10a05aad None None] Network c3b6dec8-1eff-4f03-b450-8f4eab49b5bc requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:09.385567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:09.420926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0986e28-b775-4a4c-a4fb-5b049a19e0ed req-82519d66-7844-47cc-be4f-a7d6a27aa4db tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:09.422766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b2b26cfb-a7cd-433b-a9d2-386a34312969 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:09.427619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0986e28-b775-4a4c-a4fb-5b049a19e0ed req-82519d66-7844-47cc-be4f-a7d6a27aa4db tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:09.433359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0986e28-b775-4a4c-a4fb-5b049a19e0ed req-82519d66-7844-47cc-be4f-a7d6a27aa4db tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:09.439805 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0986e28-b775-4a4c-a4fb-5b049a19e0ed req-82519d66-7844-47cc-be4f-a7d6a27aa4db tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:09.446147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0986e28-b775-4a4c-a4fb-5b049a19e0ed req-82519d66-7844-47cc-be4f-a7d6a27aa4db tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:09.453114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0986e28-b775-4a4c-a4fb-5b049a19e0ed req-82519d66-7844-47cc-be4f-a7d6a27aa4db tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:09.474120 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0986e28-b775-4a4c-a4fb-5b049a19e0ed req-82519d66-7844-47cc-be4f-a7d6a27aa4db tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:09.479666 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0986e28-b775-4a4c-a4fb-5b049a19e0ed req-82519d66-7844-47cc-be4f-a7d6a27aa4db tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 5433 time: 0.1986032 May 12 15:20:09.540084 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b2b26cfb-a7cd-433b-a9d2-386a34312969 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:09.620401 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0986e28-b775-4a4c-a4fb-5b049a19e0ed req-60d98030-a1dd-426c-a06c-8454fe3fed95 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1360557 May 12 15:20:09.667387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2b26cfb-a7cd-433b-a9d2-386a34312969 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Subnet': ['ID=8bb5348d-ba26-4492-b99e-7c45af59ff21,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:09.672149 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f9705a8-7374-424b-8b1f-bd31933b2b5e req-4e401326-dfc0-43eb-828f-6fc9695afefb tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:09.673851 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f9705a8-7374-424b-8b1f-bd31933b2b5e req-4e401326-dfc0-43eb-828f-6fc9695afefb tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=91efc3d2-c9e0-4867-98a8-80db504551ad HTTP/1.1" status: 200 len: 945 time: 0.1553369 May 12 15:20:09.686328 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b2b26cfb-a7cd-433b-a9d2-386a34312969 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/subnets/8bb5348d-ba26-4492-b99e-7c45af59ff21 HTTP/1.1" status: 204 len: 168 time: 2.4297452 May 12 15:20:09.688149 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33218) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:09.749868 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c4edc647-7a54-46b7-88c3-f6664ec4c749'] response: {'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'code': 200} May 12 15:20:09.760814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Allocated IP 172.20.0.14 (c3b6dec8-1eff-4f03-b450-8f4eab49b5bc/86aa37d6-735f-4645-b451-24e9708aabe6/de0ee6f7-5768-4075-82a8-ae61d89a953d) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:09.836869 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f9705a8-7374-424b-8b1f-bd31933b2b5e req-dc532051-92ce-4553-91fc-674f18c5659e tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1502721 May 12 15:20:09.868068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c20f1ac-1ef2-4b91-b751-b4026e80aaef tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:09.869720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c20f1ac-1ef2-4b91-b751-b4026e80aaef tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:09.870412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3c20f1ac-1ef2-4b91-b751-b4026e80aaef tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Synchronizing usage tracker for tenant:474c82a3dfe24a42ae9d88d67006b265 on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:20:09.918380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3c20f1ac-1ef2-4b91-b751-b4026e80aaef tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Unset dirty status for tenant:474c82a3dfe24a42ae9d88d67006b265 on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:20:09.919478 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3c20f1ac-1ef2-4b91-b751-b4026e80aaef tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.2304585 May 12 15:20:09.922599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33236) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:09.970217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-1055c394-de2a-4d4d-b9f7-d7c22236660d service neutron] For port ef28df6f-7573-4910-9fae-c2b49092303b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=ef28df6f-7573-4910-9fae-c2b49092303b,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:10.096967 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b7e16d43-cbbd-4821-8d8e-1e05e9d066ba tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:10.117643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-1055c394-de2a-4d4d-b9f7-d7c22236660d service neutron] For port ef28df6f-7573-4910-9fae-c2b49092303b, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:20:10.196310 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb599e39-ea3d-450a-bd62-2275bf93cfbc None None] Network c3bfc2e7-b3ab-4fff-824f-ce558c6da32c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:10.209110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f41c10b8-b592-4dac-90e1-14ae60d018c0 req-ac0a187d-d2e6-44fe-950c-be53b9b1909c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:10.210524 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f41c10b8-b592-4dac-90e1-14ae60d018c0 req-ac0a187d-d2e6-44fe-950c-be53b9b1909c service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 1096 time: 0.3360279 May 12 15:20:10.241844 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-b7e16d43-cbbd-4821-8d8e-1e05e9d066ba tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] DELETE failed (client error): There was a conflict when trying to complete your request. May 12 15:20:10.242341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b7e16d43-cbbd-4821-8d8e-1e05e9d066ba tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:20:10.243837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b7e16d43-cbbd-4821-8d8e-1e05e9d066ba tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/networks/c3bfc2e7-b3ab-4fff-824f-ce558c6da32c HTTP/1.1" status: 409 len: 405 time: 0.3203061 May 12 15:20:10.245600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-1055c394-de2a-4d4d-b9f7-d7c22236660d service neutron] device_id is not set on port ef28df6f-7573-4910-9fae-c2b49092303b yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:20:10.249740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33250) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:10.254319 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:10.264623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1107085904'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:10.281945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:10.287188 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-1055c394-de2a-4d4d-b9f7-d7c22236660d service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:10.302880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Usage tracker for resource:network and tenant:474c82a3dfe24a42ae9d88d67006b265 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:10.312973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:10.327078 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-1055c394-de2a-4d4d-b9f7-d7c22236660d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:10.335760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:10.351633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a9ec5aa8-98cf-491c-a30e-9ea48135187d None None] Provisioning for port 1442d61c-a20e-4306-aff5-c111db29ac13 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:10.354632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b19d52a-fade-4cc2-b1e2-2e2b05be529d req-7d57da0e-606f-4f8f-8c09-88d1754c84ef tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:10.356136 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b19d52a-fade-4cc2-b1e2-2e2b05be529d req-7d57da0e-606f-4f8f-8c09-88d1754c84ef tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 945 time: 0.2530363 May 12 15:20:10.374267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b76caf7e-a073-4ef5-90b5-ad43da284856 req-31a49a7a-c661-4b75-9d38-5a18c59dbfd6 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:10.375688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b76caf7e-a073-4ef5-90b5-ad43da284856 req-31a49a7a-c661-4b75-9d38-5a18c59dbfd6 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 948 time: 0.2714963 May 12 15:20:10.386419 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f41c10b8-b592-4dac-90e1-14ae60d018c0 req-aaf6f878-b953-40f1-8f4d-c8d40b8546be service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1627038 May 12 15:20:10.466709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b19d52a-fade-4cc2-b1e2-2e2b05be529d req-787e3c16-752c-4798-8e93-3df07bbbc657 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0899322 May 12 15:20:10.481139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b76caf7e-a073-4ef5-90b5-ad43da284856 req-221fecba-88b8-4443-b607-323b34f91253 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/security-groups?id=741e94d4-5b74-4583-8ee0-e67ced7944a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0910575 May 12 15:20:10.492847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33256) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:10.496084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Made reservation on behalf of 474c82a3dfe24a42ae9d88d67006b265 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:10.499597 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:10.571847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-1055c394-de2a-4d4d-b9f7-d7c22236660d service neutron] No DVR routers for this DVR port ef28df6f-7573-4910-9fae-c2b49092303b on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:10.649670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1055c394-de2a-4d4d-b9f7-d7c22236660d service neutron] Pushing event updated for resources: {'Port': ['ID=ef28df6f-7573-4910-9fae-c2b49092303b,revision_number=6']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:10.714703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-1055c394-de2a-4d4d-b9f7-d7c22236660d service neutron] In _notify_port_updated(), no bound segment for port ef28df6f-7573-4910-9fae-c2b49092303b on network e6a7ff8f-d7ef-4614-8958-ef6026371726 {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:20:10.719931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd4b7b11-8057-4ad4-8a57-991f420280ba None None] DHCP port deletion for c3bfc2e7-b3ab-4fff-824f-ce558c6da32c request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:20:10.725806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fd4b7b11-8057-4ad4-8a57-991f420280ba None None] Deleting port 1442d61c-a20e-4306-aff5-c111db29ac13 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:10.726186 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fd4b7b11-8057-4ad4-8a57-991f420280ba None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:10.729133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-1055c394-de2a-4d4d-b9f7-d7c22236660d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:10.732769 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-1055c394-de2a-4d4d-b9f7-d7c22236660d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:10.739182 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-1055c394-de2a-4d4d-b9f7-d7c22236660d service neutron] 10.222.0.84 "PUT /v2.0/ports/ef28df6f-7573-4910-9fae-c2b49092303b HTTP/1.1" status: 200 len: 1028 time: 2.0161738 May 12 15:20:10.753524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-network', 'tenant_id': '40852c97262142aeb6d62097955af83f'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:10.755410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:10.780970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:10.796901 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Usage tracker for resource:network and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:10.803975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:10.818257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:10.834149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 570} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:20:10.844805 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:10.845551 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Added segment a23efafd-4053-444f-a224-b4bef1fae4f1 of type vlan for network 55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4 May 12 15:20:10.856213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2949c30e-3cea-48ce-94be-bca8236106e6 req-74c2a0c1-f8f1-482b-8d0e-68d094a179c9 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:10.859280 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2949c30e-3cea-48ce-94be-bca8236106e6 req-74c2a0c1-f8f1-482b-8d0e-68d094a179c9 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 945 time: 0.2212749 May 12 15:20:10.860386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Made reservation on behalf of 40852c97262142aeb6d62097955af83f for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:10.862624 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:10.903264 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:10.926820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:10.930985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Usage tracker for resource:security_group_rule and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:10.934012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:10.940343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:11.059516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33282) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:11.083917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-fd4b7b11-8057-4ad4-8a57-991f420280ba None None] For port 1442d61c-a20e-4306-aff5-c111db29ac13, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1442d61c-a20e-4306-aff5-c111db29ac13,segment=NetworkSegment(0e56ffaa-9259-4d30-8f4a-1ddeec47517b),segment_id=0e56ffaa-9259-4d30-8f4a-1ddeec47517b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:11.084333 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fd4b7b11-8057-4ad4-8a57-991f420280ba None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.140140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Network c3b6dec8-1eff-4f03-b450-8f4eab49b5bc is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:11.165007 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.166564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:11.182108 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2949c30e-3cea-48ce-94be-bca8236106e6 req-12002f26-97a8-4030-9f7f-5cd808cd2eb4 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3071764 May 12 15:20:11.182754 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.185135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:11.250405 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=84ade4c8-4e24-403c-bd3f-ef329475e913,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:11.251760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fd4b7b11-8057-4ad4-8a57-991f420280ba None None] Calling delete_port for 1442d61c-a20e-4306-aff5-c111db29ac13 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:11.275255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 558} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:20:11.295184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.296277 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.296468 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Added segment 3d061d75-b983-4d78-b567-9627e2250878 of type vlan for network 2d986451-1d91-468d-8a9c-ecc4da7a86bc May 12 15:20:11.364941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-2d1b0043-63ac-4f7d-9ada-9d3f27d39a49 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:11.367144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-2d1b0043-63ac-4f7d-9ada-9d3f27d39a49 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "GET /v2.0/ports/85b4d43d-f235-4852-bda9-2dc870bb3d11?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.6269050 May 12 15:20:11.368310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-b9661e61-4ef8-4530-8499-dbbad4f9e97f req-174b710d-02eb-4f8b-a304-a6dfcfea78fd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:20:11.368691 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fd4b7b11-8057-4ad4-8a57-991f420280ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.369798 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9661e61-4ef8-4530-8499-dbbad4f9e97f req-174b710d-02eb-4f8b-a304-a6dfcfea78fd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0156422 May 12 15:20:11.371834 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.382481 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event updated for resources: {'Port': ['ID=de0ee6f7-5768-4075-82a8-ae61d89a953d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:11.419551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-7ab411ea-8eda-429c-aae9-8243847865a8 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:11.453953 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.460529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:11.461137 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.462636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd4b7b11-8057-4ad4-8a57-991f420280ba None None] Pushing event deleted for resources: {'Port': ['ID=1442d61c-a20e-4306-aff5-c111db29ac13,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:11.467207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd4b7b11-8057-4ad4-8a57-991f420280ba None None] No DVR routers for this DVR port 1442d61c-a20e-4306-aff5-c111db29ac13 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:11.469189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-78b0051c-0863-4a08-a578-cad9c892643c None None] Provisioning complete for port ef28df6f-7573-4910-9fae-c2b49092303b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:11.469189 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-78b0051c-0863-4a08-a578-cad9c892643c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.526827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-78b0051c-0863-4a08-a578-cad9c892643c None None] Port ef28df6f-7573-4910-9fae-c2b49092303b cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:20:11.530259 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7ac3ac-da25-468b-96af-4e6e4b727f0a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.531589 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.532609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:11.533179 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.612377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5e7ac3ac-da25-468b-96af-4e6e4b727f0a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:11.637462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:11.638064 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.654685 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5e7ac3ac-da25-468b-96af-4e6e4b727f0a admin admin] Usage tracker for resource:security_group_rule and tenant:89ff4be0e3074538a851d85d9fc51e42 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:11.661017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5e7ac3ac-da25-468b-96af-4e6e4b727f0a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:11.667942 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 1.4075153 May 12 15:20:11.670912 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 097f632d-3127-4539-ba4a-3e2739125cf8 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:11.674318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33294) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:11.698692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Request body: {'subnet': {'network_id': '55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:11.711736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5e7ac3ac-da25-468b-96af-4e6e4b727f0a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:11.732829 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f7526072-b906-4ff0-9e9d-f8cfaf672929 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1024 time: 3.0163631 May 12 15:20:11.733033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] Pushing event updated for resources: {'Network': ['ID=2d986451-1d91-468d-8a9c-ecc4da7a86bc,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:11.738317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33298) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:11.744461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-557cc3a9-afc3-4e1d-8c7e-114f387f8aa9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'Network': ['ID=55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:11.755106 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 2d986451-1d91-468d-8a9c-ecc4da7a86bc details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:20:11.772942 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-7ab411ea-8eda-429c-aae9-8243847865a8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:11.780853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:20:11.821162 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fbee7bb7-6c64-414e-b3ad-54d614ce55b7 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 1.3267326 May 12 15:20:11.829758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33302) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:11.850701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Request body: {'subnet': {'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-subnet', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:11.860517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:11.871830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Usage tracker for resource:subnet and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:11.878040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:11.890298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:11.939497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:11.946439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9661e61-4ef8-4530-8499-dbbad4f9e97f req-4e8e2a06-5949-49d0-bf8a-66c4a3aa30b3 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.11&fields=device_id HTTP/1.1" status: 200 len: 262 time: 0.5668073 May 12 15:20:11.960690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dbf090-a400-41e7-8026-c1374203e359 req-c60da9bd-c575-41f9-b5d3-abdbd459e1a8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:11.967787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dbf090-a400-41e7-8026-c1374203e359 req-c60da9bd-c575-41f9-b5d3-abdbd459e1a8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:11.974223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dbf090-a400-41e7-8026-c1374203e359 req-c60da9bd-c575-41f9-b5d3-abdbd459e1a8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:11.979888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dbf090-a400-41e7-8026-c1374203e359 req-c60da9bd-c575-41f9-b5d3-abdbd459e1a8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:11.985880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dbf090-a400-41e7-8026-c1374203e359 req-c60da9bd-c575-41f9-b5d3-abdbd459e1a8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:11.993127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dbf090-a400-41e7-8026-c1374203e359 req-c60da9bd-c575-41f9-b5d3-abdbd459e1a8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:11.994973 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-92dbf090-a400-41e7-8026-c1374203e359 req-c60da9bd-c575-41f9-b5d3-abdbd459e1a8 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 4658 time: 0.5155807 May 12 15:20:12.000728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-0e00973d-4efe-49e8-803a-77cf1167eadd tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Deleting port de0ee6f7-5768-4075-82a8-ae61d89a953d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:12.001066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0e00973d-4efe-49e8-803a-77cf1167eadd tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.034338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:12.052964 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.067721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-7ab411ea-8eda-429c-aae9-8243847865a8 service neutron] For port 85b4d43d-f235-4852-bda9-2dc870bb3d11, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85b4d43d-f235-4852-bda9-2dc870bb3d11,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:12.087845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '097f632d-3127-4539-ba4a-3e2739125cf8'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:12.101823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-7ab411ea-8eda-429c-aae9-8243847865a8 service neutron] For port 85b4d43d-f235-4852-bda9-2dc870bb3d11, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:20:12.102030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Made reservation on behalf of 474c82a3dfe24a42ae9d88d67006b265 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:12.102163 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 097f632d-3127-4539-ba4a-3e2739125cf8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=097f632d-3127-4539-ba4a-3e2739125cf8,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:12.105876 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.107138 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.108158 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device b8aacb03-fed3-4aed-b3cf-8c58c91ef18e no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:12.167273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-7ab411ea-8eda-429c-aae9-8243847865a8 service neutron] device_id is not set on port 85b4d43d-f235-4852-bda9-2dc870bb3d11 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:20:12.171407 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-92dbf090-a400-41e7-8026-c1374203e359 req-e9b43220-e2c2-4d94-b478-0b050091b6d9 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=8814ef16-03ed-468a-b207-7c8497a79fc0&id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1450067 May 12 15:20:12.176695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-7ab411ea-8eda-429c-aae9-8243847865a8 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.180316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Made reservation on behalf of 40852c97262142aeb6d62097955af83f for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:12.183542 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.211828 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-7ab411ea-8eda-429c-aae9-8243847865a8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.320496 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=097f632d-3127-4539-ba4a-3e2739125cf8,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:12.394882 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.406121 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-688d7fa4-ffad-48bf-b885-6581d4759a38'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '097f632d-3127-4539-ba4a-3e2739125cf8', 'code': 200} May 12 15:20:12.452421 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:12.462559 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.463341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 026a86ba-df92-4de2-9f16-6e6b8794d1df no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:12.508447 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7ac3ac-da25-468b-96af-4e6e4b727f0a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.595068 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7ac3ac-da25-468b-96af-4e6e4b727f0a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.636671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-7ab411ea-8eda-429c-aae9-8243847865a8 service neutron] No DVR routers for this DVR port 85b4d43d-f235-4852-bda9-2dc870bb3d11 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:12.680220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ab411ea-8eda-429c-aae9-8243847865a8 service neutron] Pushing event updated for resources: {'Port': ['ID=85b4d43d-f235-4852-bda9-2dc870bb3d11,revision_number=6']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:12.680578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:12.687789 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e5e81523-6710-409c-ab7e-b8130d7d8816 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.758052 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5e7ac3ac-da25-468b-96af-4e6e4b727f0a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=89ff4be0e3074538a851d85d9fc51e42&name=default HTTP/1.1" status: 200 len: 2983 time: 1.6871870 May 12 15:20:12.758672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33318) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:12.760842 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.783392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e7ac3ac-da25-468b-96af-4e6e4b727f0a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ddf582e-db97-452e-b8e3-c90ff225a842,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:12.789895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-7ab411ea-8eda-429c-aae9-8243847865a8 service neutron] In _notify_port_updated(), no bound segment for port 85b4d43d-f235-4852-bda9-2dc870bb3d11 on network e6a7ff8f-d7ef-4614-8958-ef6026371726 {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:20:12.790210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-7ab411ea-8eda-429c-aae9-8243847865a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:12.790818 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-7ab411ea-8eda-429c-aae9-8243847865a8 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.792064 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-7ab411ea-8eda-429c-aae9-8243847865a8 service neutron] 10.222.0.84 "PUT /v2.0/ports/85b4d43d-f235-4852-bda9-2dc870bb3d11 HTTP/1.1" status: 200 len: 1026 time: 1.3909757 May 12 15:20:12.797096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3314c2ea-6928-4464-ac04-75bad1c0adf9 None None] Provisioning complete for port 85b4d43d-f235-4852-bda9-2dc870bb3d11 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:12.797533 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3314c2ea-6928-4464-ac04-75bad1c0adf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.854021 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.864344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 026a86ba-df92-4de2-9f16-6e6b8794d1df, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=026a86ba-df92-4de2-9f16-6e6b8794d1df,segment=NetworkSegment(7c4990b9-5a5f-484e-a357-c9a37d811129),segment_id=7c4990b9-5a5f-484e-a357-c9a37d811129)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:12.872417 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.873112 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device ef28df6f-7573-4910-9fae-c2b49092303b no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:12.877034 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0e00973d-4efe-49e8-803a-77cf1167eadd tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.934381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3314c2ea-6928-4464-ac04-75bad1c0adf9 None None] Port 85b4d43d-f235-4852-bda9-2dc870bb3d11 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:20:12.945140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-b4eaa4ea-8c1b-4f8f-802f-8bba4e98cd38 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Deleting port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:12.945511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-b4eaa4ea-8c1b-4f8f-802f-8bba4e98cd38 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:12.995702 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=026a86ba-df92-4de2-9f16-6e6b8794d1df,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:12.998385 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device ef28df6f-7573-4910-9fae-c2b49092303b not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:20:12.998797 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:13.017944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-0e00973d-4efe-49e8-803a-77cf1167eadd tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Calling delete_port for de0ee6f7-5768-4075-82a8-ae61d89a953d owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:13.046723 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-781f0fd9-6f6f-4186-85a8-b84fd947177a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.099386 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.108403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d55ec0a-e199-4332-a660-4318b3fb4ae2 req-ac5b1ead-fd19-4e28-bf34-3352cdf06554 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:13.109977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d55ec0a-e199-4332-a660-4318b3fb4ae2 req-ac5b1ead-fd19-4e28-bf34-3352cdf06554 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 945 time: 0.6250141 May 12 15:20:13.127580 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.159792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6c1ed89-6b95-47ad-a04f-3e0493d43b02 req-8cd9a76f-3dfb-40c4-b078-75e3d228d6dc tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:13.161688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6c1ed89-6b95-47ad-a04f-3e0493d43b02 req-8cd9a76f-3dfb-40c4-b078-75e3d228d6dc tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 946 time: 0.5457234 May 12 15:20:13.166946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:13.174983 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.175509 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 85b4d43d-f235-4852-bda9-2dc870bb3d11 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:13.185532 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-781f0fd9-6f6f-4186-85a8-b84fd947177a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.255620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.objects.ports [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88152) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:20:13.263033 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.282166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:13.308521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 85b4d43d-f235-4852-bda9-2dc870bb3d11 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:20:13.308935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:13.310081 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d55ec0a-e199-4332-a660-4318b3fb4ae2 req-2e5eda12-546f-4baa-baf6-db784d10198b tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1791089 May 12 15:20:13.460688 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.500657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:13.505700 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.557283 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Pushing event updated for resources: {'Subnet': ['ID=5f6d45f7-b8bc-4313-879f-ee173c0a4148,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:13.572232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Checking segment: {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:13.572628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Network hostable DHCP agents. Network: 2d986451-1d91-468d-8a9c-ecc4da7a86bc, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:20:13.574903 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6c1ed89-6b95-47ad-a04f-3e0493d43b02 req-e2b9f040-1dba-406e-9c38-7a436a0e380f tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3800402 May 12 15:20:13.605252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:13.625469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Network 2d986451-1d91-468d-8a9c-ecc4da7a86bc is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:20:13.638307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-b4eaa4ea-8c1b-4f8f-802f-8bba4e98cd38 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] For port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:13.638663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-b4eaa4ea-8c1b-4f8f-802f-8bba4e98cd38 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.640623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'Subnet': ['ID=65487ed9-35b1-4c4b-bca8-cc07e9adfedc,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:13.642843 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Checking segment: {'id': 'a23efafd-4053-444f-a224-b4bef1fae4f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 570, 'network_id': '55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:13.643207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Network hostable DHCP agents. Network: 55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:20:13.654760 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-781f0fd9-6f6f-4186-85a8-b84fd947177a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.667532 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0e00973d-4efe-49e8-803a-77cf1167eadd tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.730833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e00973d-4efe-49e8-803a-77cf1167eadd tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event deleted for resources: {'Port': ['ID=de0ee6f7-5768-4075-82a8-ae61d89a953d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:13.768556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Network 55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:20:13.777121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 2d986451-1d91-468d-8a9c-ecc4da7a86bc) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:13.786535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-b4eaa4ea-8c1b-4f8f-802f-8bba4e98cd38 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Calling delete_port for b8aacb03-fed3-4aed-b3cf-8c58c91ef18e owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:13.787240 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5522298b-8964-4c2c-86dc-b2806deaa059 None None] Network 2d986451-1d91-468d-8a9c-ecc4da7a86bc requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:13.818100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-781f0fd9-6f6f-4186-85a8-b84fd947177a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ddf582e-db97-452e-b8e3-c90ff225a842,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:13.820317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:13.820513 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:13.820889 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.861595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1bc53e6-fe8a-4a6a-ad9e-b9882bceab0f None None] Network 55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:13.861858 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-781f0fd9-6f6f-4186-85a8-b84fd947177a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.862822 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-781f0fd9-6f6f-4186-85a8-b84fd947177a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3ddf582e-db97-452e-b8e3-c90ff225a842 HTTP/1.1" status: 204 len: 168 time: 1.0976388 May 12 15:20:13.876920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f4bc0e-9e9c-4916-b2a8-6d2d29eba75b req-ae0bcaab-54e7-46d6-b8fd-fce86a3b5f30 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:13.882820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f4bc0e-9e9c-4916-b2a8-6d2d29eba75b req-ae0bcaab-54e7-46d6-b8fd-fce86a3b5f30 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:13.888572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f4bc0e-9e9c-4916-b2a8-6d2d29eba75b req-ae0bcaab-54e7-46d6-b8fd-fce86a3b5f30 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:13.894393 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f4bc0e-9e9c-4916-b2a8-6d2d29eba75b req-ae0bcaab-54e7-46d6-b8fd-fce86a3b5f30 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:13.896109 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c52ef376-12d1-4d69-96d9-58cced65f5eb admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 2.0648627 May 12 15:20:13.896841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33340) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:13.900327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f4bc0e-9e9c-4916-b2a8-6d2d29eba75b req-ae0bcaab-54e7-46d6-b8fd-fce86a3b5f30 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:13.902270 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81f4bc0e-9e9c-4916-b2a8-6d2d29eba75b req-ae0bcaab-54e7-46d6-b8fd-fce86a3b5f30 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 3875 time: 0.4209332 May 12 15:20:13.908519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:13.909103 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.915984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:13.921532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:13.926923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Usage tracker for resource:router and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:13.929078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:13.934971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:13.957868 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.958401 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:13.997590 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0e00973d-4efe-49e8-803a-77cf1167eadd tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:14.002192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0e00973d-4efe-49e8-803a-77cf1167eadd tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "DELETE /v2.0/ports/de0ee6f7-5768-4075-82a8-ae61d89a953d HTTP/1.1" status: 204 len: 168 time: 2.1950397 May 12 15:20:14.003198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33344) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:14.015739 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-53b1c2cd-7e44-44a1-ae6b-5c093fb19779 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.3401983 May 12 15:20:14.016380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33348) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:14.023400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'c3b6dec8-1eff-4f03-b450-8f4eab49b5bc', 'external_fixed_ips': [{'subnet_id': '86aa37d6-735f-4645-b451-24e9708aabe6', 'ip_address': '172.20.0.14'}]}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:14.030504 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81f4bc0e-9e9c-4916-b2a8-6d2d29eba75b req-4f5f27ae-9b6f-4652-b636-db91e9dfb9c6 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1121395 May 12 15:20:14.035935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Request body: {'port': {'network_id': '55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4', 'name': 'tempest-NetworksIpV6TestAttrs-639895733'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:14.051341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:14.062926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Usage tracker for resource:router and tenant:a0824ae235484071b39cd368d3b3aa19 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:14.134669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:14.139683 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-b4eaa4ea-8c1b-4f8f-802f-8bba4e98cd38 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:14.141872 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:14.187410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:14.229940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4eaa4ea-8c1b-4f8f-802f-8bba4e98cd38 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event deleted for resources: {'Port': ['ID=b8aacb03-fed3-4aed-b3cf-8c58c91ef18e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:14.285900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63877089-55a1-4ca2-aad7-e3bd419e067b req-bba97248-8001-4aa3-b202-8ab663621b03 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:14.291441 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63877089-55a1-4ca2-aad7-e3bd419e067b req-bba97248-8001-4aa3-b202-8ab663621b03 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 945 time: 0.4811387 May 12 15:20:14.298612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33356) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:14.310450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-61c58fad-f914-4ef1-baa1-4474f2177fa5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Request body: {'floatingip': {'port_id': '860dc344-70ad-4ff8-9592-ee8e988a4f26'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:14.354005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:20:14.354830 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:14.395039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4', 'network_id': '55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4', 'tenant_id': '474c82a3dfe24a42ae9d88d67006b265', 'fixed_ips': [{'subnet_id': '65487ed9-35b1-4c4b-bca8-cc07e9adfedc'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:20:14.395842 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:14.435371 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:14.446619 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:14.449052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b8aacb03-fed3-4aed-b3cf-8c58c91ef18e'}, {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '026a86ba-df92-4de2-9f16-6e6b8794d1df'}, {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad'}, {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:14.493222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-b4eaa4ea-8c1b-4f8f-802f-8bba4e98cd38 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] No DVR routers for this DVR port b8aacb03-fed3-4aed-b3cf-8c58c91ef18e on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:14.497939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-b4eaa4ea-8c1b-4f8f-802f-8bba4e98cd38 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:14.502610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-deleted', 'tag': 'b8aacb03-fed3-4aed-b3cf-8c58c91ef18e'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:14.565590 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-236408d0-06f0-41b0-b3cf-1bd223cc4b65'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b8aacb03-fed3-4aed-b3cf-8c58c91ef18e', 'code': 200} May 12 15:20:14.577921 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-236408d0-06f0-41b0-b3cf-1bd223cc4b65'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '026a86ba-df92-4de2-9f16-6e6b8794d1df', 'code': 200} May 12 15:20:14.579571 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-236408d0-06f0-41b0-b3cf-1bd223cc4b65'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad', 'code': 200} May 12 15:20:14.580302 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-236408d0-06f0-41b0-b3cf-1bd223cc4b65'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c', 'code': 200} May 12 15:20:14.590277 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61c58fad-f914-4ef1-baa1-4474f2177fa5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:14.677998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:14.682342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Usage tracker for resource:port and tenant:474c82a3dfe24a42ae9d88d67006b265 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:14.686710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:14.693920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:14.700236 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-22dacd74-3bd3-4175-9d9f-d2a5e629ea51'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-deleted', 'tag': 'b8aacb03-fed3-4aed-b3cf-8c58c91ef18e', 'status': 'completed', 'code': 200} May 12 15:20:14.718472 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-b4eaa4ea-8c1b-4f8f-802f-8bba4e98cd38 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "DELETE /v2.0/ports/b8aacb03-fed3-4aed-b3cf-8c58c91ef18e HTTP/1.1" status: 204 len: 173 time: 1.9197822 May 12 15:20:14.720748 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:14.754602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Made reservation on behalf of 474c82a3dfe24a42ae9d88d67006b265 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:14.759581 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:14.944095 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:14.968719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd49804-3751-4460-aad9-4ac49c7891dc req-5626dbf2-150c-4d3b-ac7d-d4a43c310020 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:14.982866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2bd49804-3751-4460-aad9-4ac49c7891dc req-5626dbf2-150c-4d3b-ac7d-d4a43c310020 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=91efc3d2-c9e0-4867-98a8-80db504551ad HTTP/1.1" status: 200 len: 945 time: 0.7753606 May 12 15:20:14.985326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Allocated IP 172.20.0.2 (2d986451-1d91-468d-8a9c-ecc4da7a86bc/5f6d45f7-b8bc-4313-879f-ee173c0a4148/445cefc8-5130-4799-911a-f589d3a6c90f) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:14.992942 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-45baf622-abda-4cfc-9d3c-852d5c3738ac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:15.010263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c341671e-a3e5-49ab-82c1-794b06d15b7a details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:20:15.015910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Allocated IP 2001:db8::f816:3eff:feb7:5bb9 (55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4/65487ed9-35b1-4c4b-bca8-cc07e9adfedc/0ace74bf-1a28-48fb-8efb-000370ea66ce) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:15.045895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-dd4cbf86-f9d3-4e34-a4fd-320d8510d379 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Deleting port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:15.046535 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-dd4cbf86-f9d3-4e34-a4fd-320d8510d379 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:15.072414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] device_id is not set on port 3467b562-0aff-4b0c-9e2f-915b241d859b yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:20:15.289374 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2bd49804-3751-4460-aad9-4ac49c7891dc req-1cf6c063-fd30-46a2-b499-f64b6d29b4b3 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3052688 May 12 15:20:15.312447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33410) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:15.334843 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] It took 0.19 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:20:15.616885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-dd4cbf86-f9d3-4e34-a4fd-320d8510d379 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] For port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:15.617410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-dd4cbf86-f9d3-4e34-a4fd-320d8510d379 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:15.706512 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:15.726066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Request body: {'network': {'name': 'tempest-ImagesOneServerNegativeTestJSON-1557462519-network', 'tenant_id': '4789db12ded14c2e8773d2396c9acd32'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:15.774257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c341671e-a3e5-49ab-82c1-794b06d15b7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:15.855798 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:15.866082 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'c341671e-a3e5-49ab-82c1-794b06d15b7a', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'c341671e-a3e5-49ab-82c1-794b06d15b7a', 'mac_address': 'fa:16:3e:d9:ea:a1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:20:15.976393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:15.980069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Transition to ACTIVE for port object 445cefc8-5130-4799-911a-f589d3a6c90f will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:15.984809 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:16.020721 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:16.053859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id c341671e-a3e5-49ab-82c1-794b06d15b7a {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:20:16.066998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Transition to ACTIVE for port object 0ace74bf-1a28-48fb-8efb-000370ea66ce will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:16.074225 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:16.078145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Transition to ACTIVE for port object 445cefc8-5130-4799-911a-f589d3a6c90f will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:16.120425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-dd4cbf86-f9d3-4e34-a4fd-320d8510d379 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Calling delete_port for 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:16.123318 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:16.146419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c341671e-a3e5-49ab-82c1-794b06d15b7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:16.170046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Usage tracker for resource:network and tenant:4789db12ded14c2e8773d2396c9acd32 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:16.183998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:16.209399 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:16.243886 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:16.276277 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Transition to ACTIVE for port object 0ace74bf-1a28-48fb-8efb-000370ea66ce will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:16.286031 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Network 2d986451-1d91-468d-8a9c-ecc4da7a86bc is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:16.291584 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:16.297300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:16.301559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:16.351644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Made reservation on behalf of 4789db12ded14c2e8773d2396c9acd32 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:16.360093 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:16.375573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c341671e-a3e5-49ab-82c1-794b06d15b7a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:20:16.416533 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:16.423616 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:16.443690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:16.446585 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:16.486392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Usage tracker for resource:security_group_rule and tenant:4789db12ded14c2e8773d2396c9acd32 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:16.490357 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:16.493065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:16.497342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Pushing event updated for resources: {'Port': ['ID=445cefc8-5130-4799-911a-f589d3a6c90f,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:16.558723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b0701f-d35f-4cae-85ba-e39072ece489 req-34cd5ebe-c39b-40d5-a83f-987a90f09c9d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:16.565992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b0701f-d35f-4cae-85ba-e39072ece489 req-34cd5ebe-c39b-40d5-a83f-987a90f09c9d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:16.572951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b0701f-d35f-4cae-85ba-e39072ece489 req-34cd5ebe-c39b-40d5-a83f-987a90f09c9d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:16.574333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:16.579906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b0701f-d35f-4cae-85ba-e39072ece489 req-34cd5ebe-c39b-40d5-a83f-987a90f09c9d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:16.589024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1b0701f-d35f-4cae-85ba-e39072ece489 req-34cd5ebe-c39b-40d5-a83f-987a90f09c9d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 3142 time: 1.0593152 May 12 15:20:16.673994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1b0701f-d35f-4cae-85ba-e39072ece489 req-480150f2-3b8f-4cc4-8867-81a477d3f526 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0833993 May 12 15:20:16.677753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c341671e-a3e5-49ab-82c1-794b06d15b7a,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:16.758599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a20149b-5b99-45d8-806e-a9fba3521d7a req-d65bb0d8-36db-4775-b33c-bd0345317663 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:16.759079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Allocated IP 172.25.8.85 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/201e7ec4-04fd-4014-bf97-75995d8a73c1) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:16.765289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a20149b-5b99-45d8-806e-a9fba3521d7a req-d65bb0d8-36db-4775-b33c-bd0345317663 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 945 time: 1.0499084 May 12 15:20:16.773926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Allocated IP 2001:db8::f816:3eff:feb6:e9f2 (55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4/65487ed9-35b1-4c4b-bca8-cc07e9adfedc/3467b562-0aff-4b0c-9e2f-915b241d859b) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:16.873319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Network 55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:16.881110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:16.885870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:16.943770 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:16.964144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Attempting to bind port 445cefc8-5130-4799-911a-f589d3a6c90f on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:20:16.964923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Attempting to bind port 445cefc8-5130-4799-911a-f589d3a6c90f by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:20:16.964923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Attempting to bind port 445cefc8-5130-4799-911a-f589d3a6c90f on network 2d986451-1d91-468d-8a9c-ecc4da7a86bc {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:20:16.976952 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-dd4cbf86-f9d3-4e34-a4fd-320d8510d379 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:16.982806 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:17.018583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Pushing event updated for resources: {'Port': ['ID=0ace74bf-1a28-48fb-8efb-000370ea66ce,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:17.033129 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 20, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:20:17.033526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Checking segment: {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:17.033927 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:17.034306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Bound using segment: {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:20:17.034997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Bound port: 445cefc8-5130-4799-911a-f589d3a6c90f, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:20:17.035630 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:17.100691 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a20149b-5b99-45d8-806e-a9fba3521d7a req-b411168b-213e-4eef-b688-50637bfb8f06 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3071632 May 12 15:20:17.147945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:17.166510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:17.197015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:17.210236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] For port 445cefc8-5130-4799-911a-f589d3a6c90f, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:20:17.213495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] For port 445cefc8-5130-4799-911a-f589d3a6c90f, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=445cefc8-5130-4799-911a-f589d3a6c90f,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:20:17.243885 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:17.247657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Attempting to bind port 0ace74bf-1a28-48fb-8efb-000370ea66ce on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:20:17.248052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Attempting to bind port 0ace74bf-1a28-48fb-8efb-000370ea66ce by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'a23efafd-4053-444f-a224-b4bef1fae4f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 570, 'network_id': '55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:20:17.248421 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Attempting to bind port 0ace74bf-1a28-48fb-8efb-000370ea66ce on network 55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:20:17.265279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Pushing event updated for resources: {'Port': ['ID=201e7ec4-04fd-4014-bf97-75995d8a73c1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:17.308383 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 20, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:20:17.315050 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Checking segment: {'id': 'a23efafd-4053-444f-a224-b4bef1fae4f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 570, 'network_id': '55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:17.315640 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:17.316900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Bound using segment: {'id': 'a23efafd-4053-444f-a224-b4bef1fae4f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 570, 'network_id': '55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:20:17.317495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Bound port: 0ace74bf-1a28-48fb-8efb-000370ea66ce, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a23efafd-4053-444f-a224-b4bef1fae4f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 570, 'network_id': '55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:20:17.317963 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:17.322150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-dd4cbf86-f9d3-4e34-a4fd-320d8510d379 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] No DVR routers for this DVR port 4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:17.337545 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-dd4cbf86-f9d3-4e34-a4fd-320d8510d379 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:17.358062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-deleted', 'tag': '4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:17.370592 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-dd4cbf86-f9d3-4e34-a4fd-320d8510d379 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "DELETE /v2.0/ports/4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad HTTP/1.1" status: 204 len: 173 time: 2.6227469 May 12 15:20:17.424793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85fd568a-f6a4-4fb4-b93a-c32401c0c119 None None] Pushing event updated for resources: {'Port': ['ID=445cefc8-5130-4799-911a-f589d3a6c90f,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:17.428727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd4cbf86-f9d3-4e34-a4fd-320d8510d379 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event deleted for resources: {'Port': ['ID=4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:17.637056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] For port 0ace74bf-1a28-48fb-8efb-000370ea66ce, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:20:17.659205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-116bb8a6-94d7-4848-b2f7-6059d781bb39 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Deleting port 097f632d-3127-4539-ba4a-3e2739125cf8 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:17.660622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-116bb8a6-94d7-4848-b2f7-6059d781bb39 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:17.712965 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:17.737769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] For port 0ace74bf-1a28-48fb-8efb-000370ea66ce, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0ace74bf-1a28-48fb-8efb-000370ea66ce,segment=NetworkSegment(a23efafd-4053-444f-a224-b4bef1fae4f1),segment_id=a23efafd-4053-444f-a224-b4bef1fae4f1)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:20:17.750805 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:17.837841 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:17.840049 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-05bfaf4e-6356-4183-811f-8896de35c04c'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-deleted', 'tag': '4ae3d60d-f0ae-45ec-a2aa-bcb218cf99ad', 'status': 'completed', 'code': 200} May 12 15:20:17.895509 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2be754a8-c3c6-469a-b468-366a09bba711 None None] Pushing event updated for resources: {'Port': ['ID=0ace74bf-1a28-48fb-8efb-000370ea66ce,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:18.062805 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:18.184237 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:18.261875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Transition to ACTIVE for port object 3467b562-0aff-4b0c-9e2f-915b241d859b will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:18.271105 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:18.401285 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:18.470153 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-61c58fad-f914-4ef1-baa1-4474f2177fa5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] It took 0.24 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:20:18.665096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 589} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:20:18.709212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bcceeef8-0214-44d0-9671-29d985971221,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:18.729738 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:18.730194 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Added segment dbf5199c-277c-4a55-97b5-ab215591dbbb of type vlan for network 670dbecd-f547-4abf-b069-62f0c8712c6b May 12 15:20:18.823823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d42c091-d056-42ec-acc3-6316000502ed req-ae8194f3-eeff-4d49-a64e-24252d223ca8 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:18.829564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d42c091-d056-42ec-acc3-6316000502ed req-ae8194f3-eeff-4d49-a64e-24252d223ca8 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:18.842607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d42c091-d056-42ec-acc3-6316000502ed req-ae8194f3-eeff-4d49-a64e-24252d223ca8 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:18.857620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d42c091-d056-42ec-acc3-6316000502ed req-ae8194f3-eeff-4d49-a64e-24252d223ca8 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187&device_id=91efc3d2-c9e0-4867-98a8-80db504551ad&device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 2417 time: 1.1367695 May 12 15:20:18.898038 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61c58fad-f914-4ef1-baa1-4474f2177fa5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:18.904570 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:18.933311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-168c79e7-5722-4ae7-9fdb-11dde45454ed req-cc3ce75a-3e85-4c84-bad4-fa54808541ae tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:18.953086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-116bb8a6-94d7-4848-b2f7-6059d781bb39 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] For port 097f632d-3127-4539-ba4a-3e2739125cf8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=097f632d-3127-4539-ba4a-3e2739125cf8,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:18.954028 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-116bb8a6-94d7-4848-b2f7-6059d781bb39 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:18.961122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-168c79e7-5722-4ae7-9fdb-11dde45454ed req-cc3ce75a-3e85-4c84-bad4-fa54808541ae tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:18.973070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-168c79e7-5722-4ae7-9fdb-11dde45454ed req-cc3ce75a-3e85-4c84-bad4-fa54808541ae tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:18.988372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-168c79e7-5722-4ae7-9fdb-11dde45454ed req-cc3ce75a-3e85-4c84-bad4-fa54808541ae tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 2409 time: 0.9895663 May 12 15:20:19.022039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c341671e-a3e5-49ab-82c1-794b06d15b7a up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:19.022766 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:19.033406 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61c58fad-f914-4ef1-baa1-4474f2177fa5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:19.088972 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:19.160748 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 445cefc8-5130-4799-911a-f589d3a6c90f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:19.396582 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-168c79e7-5722-4ae7-9fdb-11dde45454ed req-7f161591-c952-45ee-a628-8136f0646f95 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4073193 May 12 15:20:19.494320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port c341671e-a3e5-49ab-82c1-794b06d15b7a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:19.505172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Network 55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:19.505934 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:19.518163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] It took 0.55 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:20:19.536125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:19.538780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'Port': ['ID=3467b562-0aff-4b0c-9e2f-915b241d859b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:19.586769 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d42c091-d056-42ec-acc3-6316000502ed req-afdb55a2-111a-414d-89e5-7bf0f622ebeb tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7285013 May 12 15:20:19.590758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ca864d8-1734-4348-b90a-a622b109971a None None] Network 2d986451-1d91-468d-8a9c-ecc4da7a86bc requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:19.596798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:19.602638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:19.609563 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:19.763186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 445cefc8-5130-4799-911a-f589d3a6c90f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:19.772151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ebbeefe5-6432-44aa-90fa-f4042055655b None None] Provisioning for port 445cefc8-5130-4799-911a-f589d3a6c90f completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:19.829950 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-61c58fad-f914-4ef1-baa1-4474f2177fa5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Floating IP 7802e753-504f-4f2e-b585-7d53d932b7ae associated. External IP: 172.25.8.158, port: 860dc344-70ad-4ff8-9592-ee8e988a4f26. May 12 15:20:19.864210 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:19.872855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ebbeefe5-6432-44aa-90fa-f4042055655b None None] Provisioning complete for port 445cefc8-5130-4799-911a-f589d3a6c90f triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:19.873220 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ebbeefe5-6432-44aa-90fa-f4042055655b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:19.899877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 445cefc8-5130-4799-911a-f589d3a6c90f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:19.900247 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:19.945081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8da568c9-1db9-4fff-93aa-b6612e135097 None None] Network 55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:19.950586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-116bb8a6-94d7-4848-b2f7-6059d781bb39 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Calling delete_port for 097f632d-3127-4539-ba4a-3e2739125cf8 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:19.989857 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:20.230464 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:20.231468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:20.232048 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:20.232509 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c341671e-a3e5-49ab-82c1-794b06d15b7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:20.270227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c341671e-a3e5-49ab-82c1-794b06d15b7a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:20.305108 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:20.356768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c923b500-3c91-4f7e-94f7-48eb6d6881df tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 950 time: 6.3309660 May 12 15:20:20.373135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33452) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:20.407540 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5e91a4c0-e72c-4421-8b2c-31f3350c5069'] response: {'server_uuid': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c341671e-a3e5-49ab-82c1-794b06d15b7a', 'code': 200} May 12 15:20:20.452375 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 895 time: 5.1331546 May 12 15:20:20.453275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33458) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:20.464635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Request body: {'subnet': {'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b', 'cidr': '172.20.0.0/28', 'name': 'tempest-ImagesOneServerNegativeTestJSON-1557462519-subnet', 'tenant_id': '4789db12ded14c2e8773d2396c9acd32', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:20.470385 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:20.475368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Usage tracker for resource:subnet and tenant:4789db12ded14c2e8773d2396c9acd32 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:20.479642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:20.486110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:20.498518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Router 78d4ada5-c100-4849-8e75-44ba389f27d8 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:20:20.541113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Made reservation on behalf of 4789db12ded14c2e8773d2396c9acd32 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:20.544489 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:20.570228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9194f485-ef71-4d9a-a8d1-5acc4910ab9e admin admin] Pushing event updated for resources: {'Network': ['ID=670dbecd-f547-4abf-b069-62f0c8712c6b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:20.607181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-61c58fad-f914-4ef1-baa1-4474f2177fa5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:20:20.642662 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ebbeefe5-6432-44aa-90fa-f4042055655b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:20.661832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 670dbecd-f547-4abf-b069-62f0c8712c6b details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:20:20.720323 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Allocated IP 172.20.0.14 (c3b6dec8-1eff-4f03-b450-8f4eab49b5bc/86aa37d6-735f-4645-b451-24e9708aabe6/a24d07db-f26e-4e1c-8712-1a386d8cc5d7) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:20.729444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-e288f679-e2c9-494a-bda1-3b8d29c08825 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Deleting subnet 65487ed9-35b1-4c4b-bca8-cc07e9adfedc {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:20:20.807798 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e288f679-e2c9-494a-bda1-3b8d29c08825 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:20.823875 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c341671e-a3e5-49ab-82c1-794b06d15b7a,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:20.992961 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ebbeefe5-6432-44aa-90fa-f4042055655b None None] For port 445cefc8-5130-4799-911a-f589d3a6c90f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=445cefc8-5130-4799-911a-f589d3a6c90f,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:20.998061 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:21.054989 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ebbeefe5-6432-44aa-90fa-f4042055655b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:21.212429 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-116bb8a6-94d7-4848-b2f7-6059d781bb39 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:21.228183 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:20:21.233220 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:20:21.275766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-116bb8a6-94d7-4848-b2f7-6059d781bb39 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event deleted for resources: {'Port': ['ID=097f632d-3127-4539-ba4a-3e2739125cf8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:21.339098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:20:21.346924 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebbeefe5-6432-44aa-90fa-f4042055655b None None] Pushing event updated for resources: {'Port': ['ID=445cefc8-5130-4799-911a-f589d3a6c90f,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:21.355175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Sync routers for ids ['78d4ada5-c100-4849-8e75-44ba389f27d8'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:20:21.360561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bec2f1e6-591e-445e-8a90-56ddea2d0792 None None] Provisioning complete for port 445cefc8-5130-4799-911a-f589d3a6c90f triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:21.360912 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bec2f1e6-591e-445e-8a90-56ddea2d0792 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:21.396178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-116bb8a6-94d7-4848-b2f7-6059d781bb39 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] No DVR routers for this DVR port 097f632d-3127-4539-ba4a-3e2739125cf8 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:21.438326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Routers {'78d4ada5-c100-4849-8e75-44ba389f27d8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:20:21.438897 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-116bb8a6-94d7-4848-b2f7-6059d781bb39 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:21.439041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['78d4ada5-c100-4849-8e75-44ba389f27d8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:21.459546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-deleted', 'tag': '097f632d-3127-4539-ba4a-3e2739125cf8'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:21.517468 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-116bb8a6-94d7-4848-b2f7-6059d781bb39 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "DELETE /v2.0/ports/097f632d-3127-4539-ba4a-3e2739125cf8 HTTP/1.1" status: 204 len: 173 time: 4.0987477 May 12 15:20:21.626207 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:21.630820 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-89b6969b-4253-402c-8da7-98cf2f648aa3 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 7.7283418 May 12 15:20:21.643009 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33466) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:21.728667 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:21.811873 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:21.830698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Set router 78d4ada5-c100-4849-8e75-44ba389f27d8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:20:21.866892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-18d4d27b-dafe-4a2a-aa63-c8fde6dcddd0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Deleting port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:21.867917 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-18d4d27b-dafe-4a2a-aa63-c8fde6dcddd0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:21.971458 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:21.977745 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e288f679-e2c9-494a-bda1-3b8d29c08825 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:22.038828 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event updated for resources: {'Port': ['ID=a24d07db-f26e-4e1c-8712-1a386d8cc5d7,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:22.042030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61c58fad-f914-4ef1-baa1-4474f2177fa5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:20:22.058052 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83ae5699-9975-4d8c-945f-191145cf513a None None] Sync routers for ids ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:20:22.080559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6d58578-48cf-45fb-b706-8c0de134fd34 req-782f2012-8d44-437f-a7de-ef292e02fa4e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:22.088761 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83ae5699-9975-4d8c-945f-191145cf513a None None] Routers {'bac46c5e-a9b9-49a6-89a8-7b3f401caed2'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:20:22.089725 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-83ae5699-9975-4d8c-945f-191145cf513a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:22.095917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6d58578-48cf-45fb-b706-8c0de134fd34 req-782f2012-8d44-437f-a7de-ef292e02fa4e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:22.108406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6d58578-48cf-45fb-b706-8c0de134fd34 req-782f2012-8d44-437f-a7de-ef292e02fa4e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:22.115497 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f6d58578-48cf-45fb-b706-8c0de134fd34 req-782f2012-8d44-437f-a7de-ef292e02fa4e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 2409 time: 1.4198267 May 12 15:20:22.133881 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0ace74bf-1a28-48fb-8efb-000370ea66ce up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:22.134911 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61c58fad-f914-4ef1-baa1-4474f2177fa5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:22.243103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37a4cac1-e7cd-45ad-b6b8-684105601314 req-09b19c9e-f869-4d61-995f-7e3db801333e tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.&fields=device_id HTTP/1.1" status: 200 len: 463 time: 2.1689909 May 12 15:20:22.256126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Network c3b6dec8-1eff-4f03-b450-8f4eab49b5bc is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:22.321283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:22.325299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5a24db8d-fb66-4b7f-bf96-50956cb218fd,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:22.335335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:22.544389 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-83ae5699-9975-4d8c-945f-191145cf513a None None] Set router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:20:22.581502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bec2f1e6-591e-445e-8a90-56ddea2d0792 None None] Provisioning for port 0ace74bf-1a28-48fb-8efb-000370ea66ce completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:22.655948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 0ace74bf-1a28-48fb-8efb-000370ea66ce completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:22.658082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Checking segment: {'id': 'dbf5199c-277c-4a55-97b5-ab215591dbbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:22.660610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Network hostable DHCP agents. Network: 670dbecd-f547-4abf-b069-62f0c8712c6b, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:20:22.696833 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0ace74bf-1a28-48fb-8efb-000370ea66ce triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:22.699127 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:22.842684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Network 670dbecd-f547-4abf-b069-62f0c8712c6b is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:20:22.887082 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-61c58fad-f914-4ef1-baa1-4474f2177fa5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "PUT /v2.0/floatingips/7802e753-504f-4f2e-b585-7d53d932b7ae HTTP/1.1" status: 200 len: 991 time: 8.5848382 May 12 15:20:22.930258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8804c806-0302-4f2d-9afa-1e39e9de9f6c None None] Provisioning for port 3467b562-0aff-4b0c-9e2f-915b241d859b completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:22.938113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8804c806-0302-4f2d-9afa-1e39e9de9f6c None None] Provisioning complete for port 3467b562-0aff-4b0c-9e2f-915b241d859b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:22.941728 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8804c806-0302-4f2d-9afa-1e39e9de9f6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:22.974708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:23.038160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 670dbecd-f547-4abf-b069-62f0c8712c6b) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:23.064021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:23.064815 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:23.076464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f70ddd3e-e544-4323-99be-10e9042fea12 None None] Network 670dbecd-f547-4abf-b069-62f0c8712c6b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:23.241884 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:23.252808 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-83ae5699-9975-4d8c-945f-191145cf513a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233'}], 'enable_snat': True}, 'gw_port_id': '632ac19e-3420-4802-a558-9e900049a9cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 4, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port': {'id': '632ac19e-3420-4802-a558-9e900049a9cd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:3a:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1391, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:39Z', 'updated_at': '2022-05-12T15:19:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '7802e753-504f-4f2e-b585-7d53d932b7ae', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'floating_ip_address': '172.25.8.158', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'port_id': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1400, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'mac_address': 'fa:16:3e:ad:b5:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:19:49Z', 'updated_at': '2022-05-12T15:20:18Z', 'revision_number': 1, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '314d24d4-b40e-49e9-a854-c0e11db13316', 'name': '', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'mac_address': 'fa:16:3e:a8:8a:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_interface', 'standard_attr_id': 1392, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:43Z', 'updated_at': '2022-05-12T15:19:53Z', 'revision_number': 5, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'subnets': [{'id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:23.258197 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83ae5699-9975-4d8c-945f-191145cf513a None None] Checking router: bac46c5e-a9b9-49a6-89a8-7b3f401caed2 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:20:23.268288 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83ae5699-9975-4d8c-945f-191145cf513a None None] Routers {'bac46c5e-a9b9-49a6-89a8-7b3f401caed2'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:20:23.269342 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-83ae5699-9975-4d8c-945f-191145cf513a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:23.281670 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f6d58578-48cf-45fb-b706-8c0de134fd34 req-7a4f90ee-2ec9-4d3a-a16e-f9dad7d9912c tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 1.0774381 May 12 15:20:23.468047 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e288f679-e2c9-494a-bda1-3b8d29c08825 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:23.611041 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e288f679-e2c9-494a-bda1-3b8d29c08825 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:23.681847 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-83ae5699-9975-4d8c-945f-191145cf513a None None] Set router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:20:23.694282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e288f679-e2c9-494a-bda1-3b8d29c08825 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Subnet': ['ID=65487ed9-35b1-4c4b-bca8-cc07e9adfedc,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:23.704218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-18d4d27b-dafe-4a2a-aa63-c8fde6dcddd0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] For port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:23.705837 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-18d4d27b-dafe-4a2a-aa63-c8fde6dcddd0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:23.785992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e288f679-e2c9-494a-bda1-3b8d29c08825 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:23.830032 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-94bb2504-690b-40f8-9b36-6c3678324af1'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-deleted', 'tag': '097f632d-3127-4539-ba4a-3e2739125cf8', 'status': 'completed', 'code': 200} May 12 15:20:23.832209 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ae6ef6b6-9b21-4df1-b8d1-92bc722b0e12 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 859 time: 3.3772953 May 12 15:20:23.864328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8804c806-0302-4f2d-9afa-1e39e9de9f6c None None] Port 3467b562-0aff-4b0c-9e2f-915b241d859b cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:20:23.868934 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6ec4aa1-d2a1-403d-be98-c665e2cf83cd None None] Network 55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:23.879655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e288f679-e2c9-494a-bda1-3b8d29c08825 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/subnets/65487ed9-35b1-4c4b-bca8-cc07e9adfedc HTTP/1.1" status: 204 len: 168 time: 3.4931269 May 12 15:20:23.895038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33496) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:23.933936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-067f7e41-9f56-48e8-ae8e-cad7d813f788 None None] Network 670dbecd-f547-4abf-b069-62f0c8712c6b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:24.000739 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-490315d4-224e-4027-9630-3fdd885c7285'] response: {'name': 'network-changed', 'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'status': 'completed', 'code': 200} May 12 15:20:24.027428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-18d4d27b-dafe-4a2a-aa63-c8fde6dcddd0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Calling delete_port for c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:24.073703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:24.446457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335cfb92-3331-4898-b474-520884e994ba req-3b0c7306-1eff-4da4-be82-2d8f2152095f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:24.448243 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-335cfb92-3331-4898-b474-520884e994ba req-3b0c7306-1eff-4da4-be82-2d8f2152095f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 945 time: 0.8436975 May 12 15:20:24.476058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9518553-8b1a-4628-bca4-491e97f2cab9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:24.479308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9518553-8b1a-4628-bca4-491e97f2cab9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:24.484748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f9518553-8b1a-4628-bca4-491e97f2cab9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Synchronizing usage tracker for tenant:474c82a3dfe24a42ae9d88d67006b265 on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:20:24.486350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05edfe9-1b0a-4caf-af41-b9c8a8ac54ee req-b878c406-37d7-46c7-9801-eab0c0cb4ab2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:24.488878 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f05edfe9-1b0a-4caf-af41-b9c8a8ac54ee req-b878c406-37d7-46c7-9801-eab0c0cb4ab2 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 1096 time: 0.4766970 May 12 15:20:24.523653 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-83ae5699-9975-4d8c-945f-191145cf513a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233'}], 'enable_snat': True}, 'gw_port_id': '632ac19e-3420-4802-a558-9e900049a9cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 4, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port': {'id': '632ac19e-3420-4802-a558-9e900049a9cd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:3a:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1391, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:39Z', 'updated_at': '2022-05-12T15:19:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '7802e753-504f-4f2e-b585-7d53d932b7ae', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'floating_ip_address': '172.25.8.158', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'port_id': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1400, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'mac_address': 'fa:16:3e:ad:b5:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:19:49Z', 'updated_at': '2022-05-12T15:20:18Z', 'revision_number': 1, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '314d24d4-b40e-49e9-a854-c0e11db13316', 'name': '', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'mac_address': 'fa:16:3e:a8:8a:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_interface', 'standard_attr_id': 1392, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:43Z', 'updated_at': '2022-05-12T15:19:53Z', 'revision_number': 5, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'subnets': [{'id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:24.541948 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83ae5699-9975-4d8c-945f-191145cf513a None None] The sync data for ids ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'] in n-d-841483-1 is: [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233'}], 'enable_snat': True}, 'gw_port_id': '632ac19e-3420-4802-a558-9e900049a9cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 4, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port': {'id': '632ac19e-3420-4802-a558-9e900049a9cd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:3a:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1391, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:39Z', 'updated_at': '2022-05-12T15:19:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '7802e753-504f-4f2e-b585-7d53d932b7ae', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'floating_ip_address': '172.25.8.158', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'port_id': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1400, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'mac_address': 'fa:16:3e:ad:b5:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:19:49Z', 'updated_at': '2022-05-12T15:20:18Z', 'revision_number': 1, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '314d24d4-b40e-49e9-a854-c0e11db13316', 'name': '', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'mac_address': 'fa:16:3e:a8:8a:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_interface', 'standard_attr_id': 1392, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:43Z', 'updated_at': '2022-05-12T15:19:53Z', 'revision_number': 5, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'subnets': [{'id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:20:24.552557 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:20:24.552907 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:20:24.569291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8804c806-0302-4f2d-9afa-1e39e9de9f6c None None] Provisioning complete for port 0ace74bf-1a28-48fb-8efb-000370ea66ce triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:24.569692 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8804c806-0302-4f2d-9afa-1e39e9de9f6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:24.720564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f9518553-8b1a-4628-bca4-491e97f2cab9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Unset dirty status for tenant:474c82a3dfe24a42ae9d88d67006b265 on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:20:24.724994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f9518553-8b1a-4628-bca4-491e97f2cab9 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.8288970 May 12 15:20:24.725862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33518) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:24.740474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:18Z', 'revision_number': 3, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:24.818128 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-335cfb92-3331-4898-b474-520884e994ba req-394740ef-5135-436d-b38f-886a6b204cbf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3106914 May 12 15:20:24.826237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05edfe9-1b0a-4caf-af41-b9c8a8ac54ee req-67753abe-1098-404b-8c63-b7b7013bcbd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:24.828488 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f05edfe9-1b0a-4caf-af41-b9c8a8ac54ee req-67753abe-1098-404b-8c63-b7b7013bcbd0 service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.3273289 May 12 15:20:24.903106 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-18d4d27b-dafe-4a2a-aa63-c8fde6dcddd0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:24.922422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Checking router: 78d4ada5-c100-4849-8e75-44ba389f27d8 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:20:24.927803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Updating router 78d4ada5-c100-4849-8e75-44ba389f27d8 port 201e7ec4-04fd-4014-bf97-75995d8a73c1 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:20:25.077652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18d4d27b-dafe-4a2a-aa63-c8fde6dcddd0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event deleted for resources: {'Port': ['ID=c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:25.159681 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:25.227943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-18d4d27b-dafe-4a2a-aa63-c8fde6dcddd0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] No DVR routers for this DVR port c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:25.231012 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-18d4d27b-dafe-4a2a-aa63-c8fde6dcddd0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:25.238719 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:25.273850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1f95e39-12e3-4de1-9e47-76893f1431d2 None None] New status for floating IP 7802e753-504f-4f2e-b585-7d53d932b7ae: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:20:25.360649 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a43042b-b3be-49e0-a708-2dc8b6a7a6b1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:25.488611 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-6a43042b-b3be-49e0-a708-2dc8b6a7a6b1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] DELETE failed (client error): There was a conflict when trying to complete your request. May 12 15:20:25.489075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6a43042b-b3be-49e0-a708-2dc8b6a7a6b1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:20:25.498557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6a43042b-b3be-49e0-a708-2dc8b6a7a6b1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/networks/55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4 HTTP/1.1" status: 409 len: 405 time: 0.7368195 May 12 15:20:25.511561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33532) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:25.525176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-665529726'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:25.539821 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:25.540055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:25.568547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-1f0a5dce-b3f0-4a91-9fc8-c0a2ea4517cc tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:25.572978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Allocated IP 172.20.0.1 (2d986451-1d91-468d-8a9c-ecc4da7a86bc/5f6d45f7-b8bc-4313-879f-ee173c0a4148/77d485e0-c0f7-452a-ba64-2ff75661cddd) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:25.575393 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-1f0a5dce-b3f0-4a91-9fc8-c0a2ea4517cc tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/networks?id=670dbecd-f547-4abf-b069-62f0c8712c6b HTTP/1.1" status: 200 len: 822 time: 0.6709194 May 12 15:20:25.579434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Usage tracker for resource:network and tenant:474c82a3dfe24a42ae9d88d67006b265 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:25.594005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Quota usage for network was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:25.609267 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:25.613517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:25.625558 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-e398fb2a-1d3d-48a0-a108-9a750f5dcee9 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/quotas/4789db12ded14c2e8773d2396c9acd32 HTTP/1.1" status: 200 len: 375 time: 0.0491924 May 12 15:20:25.778388 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:25.782908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-a05b4927-392d-4a08-bdba-69cfb0e70585 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4789db12ded14c2e8773d2396c9acd32&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1563759 May 12 15:20:25.802820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Transition to ACTIVE for port object 77d485e0-c0f7-452a-ba64-2ff75661cddd will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:25.831604 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f05edfe9-1b0a-4caf-af41-b9c8a8ac54ee req-5fd532b5-8d35-4174-9d67-8807ad77138f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26 HTTP/1.1" status: 200 len: 999 time: 0.9400527 May 12 15:20:25.835471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-deleted', 'tag': 'c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:25.839887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3890d526-2a3f-462a-9c41-f2cfcaae9c0d req-98f532b6-9ef9-418a-b39f-0c06c6f51492 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:25.854131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3890d526-2a3f-462a-9c41-f2cfcaae9c0d req-98f532b6-9ef9-418a-b39f-0c06c6f51492 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 943 time: 0.5751677 May 12 15:20:25.855941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Made reservation on behalf of 474c82a3dfe24a42ae9d88d67006b265 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:25.857955 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8804c806-0302-4f2d-9afa-1e39e9de9f6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:25.859387 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:25.944470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05edfe9-1b0a-4caf-af41-b9c8a8ac54ee req-f02bfefd-4e16-4014-b20e-25691acb3aca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:25.945991 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f05edfe9-1b0a-4caf-af41-b9c8a8ac54ee req-f02bfefd-4e16-4014-b20e-25691acb3aca service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.1035714 May 12 15:20:25.947164 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-18d4d27b-dafe-4a2a-aa63-c8fde6dcddd0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "DELETE /v2.0/ports/c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c HTTP/1.1" status: 204 len: 173 time: 4.4168820 May 12 15:20:25.955268 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:26.043769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06edb6ad-b502-49c8-a3ed-faab58163dfb None None] DHCP port deletion for 55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:20:26.077794 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 0ace74bf-1a28-48fb-8efb-000370ea66ce, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0ace74bf-1a28-48fb-8efb-000370ea66ce,segment=NetworkSegment(a23efafd-4053-444f-a224-b4bef1fae4f1),segment_id=a23efafd-4053-444f-a224-b4bef1fae4f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:26.084382 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-06edb6ad-b502-49c8-a3ed-faab58163dfb None None] Deleting port 0ace74bf-1a28-48fb-8efb-000370ea66ce {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:26.085080 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-06edb6ad-b502-49c8-a3ed-faab58163dfb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:26.110072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3890d526-2a3f-462a-9c41-f2cfcaae9c0d req-9a5b4cd5-63aa-487a-ba07-67cc686c8f96 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2550509 May 12 15:20:26.178154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 580} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:20:26.204954 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:26.292303 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:26.296555 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Added segment 83cf33ba-8af3-43e0-ab16-cb420b840652 of type vlan for network 72b18c14-a959-4cae-9582-f9d6877fbe33 May 12 15:20:26.324571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-0b03a42c-de87-4181-bc35-e3f3b1759c49 service neutron] 10.222.0.82 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5408041 May 12 15:20:26.457807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=0ace74bf-1a28-48fb-8efb-000370ea66ce,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:26.468137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 445cefc8-5130-4799-911a-f589d3a6c90f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:26.520583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:26.521077 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:26.521542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:26.521949 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:26.524041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:26.524041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:26.524508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:26.528727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:26.529160 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:26.529604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:26.530133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:26.530531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:26.554136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Network 2d986451-1d91-468d-8a9c-ecc4da7a86bc is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:26.557766 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-4d442b75-af6c-4723-bc21-7dc9bdacb352 service neutron] 10.222.0.82 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2242835 May 12 15:20:26.570883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Router 4f1687a8-e8cb-4260-ad86-0166e59ee7ed is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:20:26.592240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:26.593821 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:26.598266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:26.672833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Pushing event updated for resources: {'Port': ['ID=77d485e0-c0f7-452a-ba64-2ff75661cddd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:26.728278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Deleting port 026a86ba-df92-4de2-9f16-6e6b8794d1df {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:26.731694 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:26.838033 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:26.942846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05edfe9-1b0a-4caf-af41-b9c8a8ac54ee req-5d69e816-fe41-4d68-ac53-f7482471dde6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:26.944335 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f05edfe9-1b0a-4caf-af41-b9c8a8ac54ee req-5d69e816-fe41-4d68-ac53-f7482471dde6 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.9815502 May 12 15:20:27.060085 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:27.077479 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Transition to ACTIVE for port object 201e7ec4-04fd-4014-bf97-75995d8a73c1 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:27.203906 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1c94ae87-4eb3-4716-a304-2ce564dc6311'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-deleted', 'tag': 'c9c10e1c-0c70-46cc-8bc9-f361a3ee2a6c', 'status': 'completed', 'code': 200} May 12 15:20:27.240031 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:27.255723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:27.256635 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:27.315111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:27.355406 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-06edb6ad-b502-49c8-a3ed-faab58163dfb None None] For port 0ace74bf-1a28-48fb-8efb-000370ea66ce, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0ace74bf-1a28-48fb-8efb-000370ea66ce,segment=NetworkSegment(a23efafd-4053-444f-a224-b4bef1fae4f1),segment_id=a23efafd-4053-444f-a224-b4bef1fae4f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:27.355793 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-06edb6ad-b502-49c8-a3ed-faab58163dfb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:27.375717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 1.8585567 May 12 15:20:27.410346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33560) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:27.508588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Request body: {'subnet': {'network_id': '72b18c14-a959-4cae-9582-f9d6877fbe33', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:27.562312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b4d12cf-6317-4b46-87e2-0366c3b1e7f8 req-558b0449-7b4e-49ed-921e-a3a13a1afa26 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:27.567583 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f05edfe9-1b0a-4caf-af41-b9c8a8ac54ee req-736d2f7b-9265-48b8-83aa-2772f691c906 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5776210 May 12 15:20:27.572467 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b4d12cf-6317-4b46-87e2-0366c3b1e7f8 req-558b0449-7b4e-49ed-921e-a3a13a1afa26 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 945 time: 0.7584746 May 12 15:20:27.703050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:20:27.714981 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Sync routers for ids ['4f1687a8-e8cb-4260-ad86-0166e59ee7ed'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:20:27.731653 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Routers {'4f1687a8-e8cb-4260-ad86-0166e59ee7ed'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:20:27.732494 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['4f1687a8-e8cb-4260-ad86-0166e59ee7ed'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:27.743730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-06edb6ad-b502-49c8-a3ed-faab58163dfb None None] Calling delete_port for 0ace74bf-1a28-48fb-8efb-000370ea66ce owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:27.773244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1c954fb-49d9-4ae3-ad1d-7e5119e47cd2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'Network': ['ID=72b18c14-a959-4cae-9582-f9d6877fbe33,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:27.913637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] For port 026a86ba-df92-4de2-9f16-6e6b8794d1df, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=026a86ba-df92-4de2-9f16-6e6b8794d1df,segment=NetworkSegment(7c4990b9-5a5f-484e-a357-c9a37d811129),segment_id=7c4990b9-5a5f-484e-a357-c9a37d811129)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:27.914480 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:27.922123 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dcc2997c-6e3a-4f08-9a87-aa797bf53693 req-724cfe0d-1cfc-4033-9da5-ef60e09b6f81 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 210 time: 0.1437404 May 12 15:20:27.979560 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b4d12cf-6317-4b46-87e2-0366c3b1e7f8 req-f888962a-7704-4e3c-9ddc-c244faa28090 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4039962 May 12 15:20:27.991941 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 72b18c14-a959-4cae-9582-f9d6877fbe33 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:20:28.044876 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:28.049546 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-91f142b8-febb-4ed7-8a33-978ac9782895 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 876 time: 14.0397162 May 12 15:20:28.052520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33570) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:28.266745 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:28.319662 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Set router 4f1687a8-e8cb-4260-ad86-0166e59ee7ed gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:20:28.376615 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-8804c806-0302-4f2d-9afa-1e39e9de9f6c None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:20:28.377119 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-8804c806-0302-4f2d-9afa-1e39e9de9f6c None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:20:28.462284 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f05edfe9-1b0a-4caf-af41-b9c8a8ac54ee req-39307fe6-d0c2-4a7f-94f2-ca9fc1de7f2f service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8771315 May 12 15:20:28.499270 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-06edb6ad-b502-49c8-a3ed-faab58163dfb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:28.522574 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22bad954-39da-4110-a7a0-75fc8f9eb351 None None] Pushing event updated for resources: {'Port': ['ID=201e7ec4-04fd-4014-bf97-75995d8a73c1,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:28.529797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:28.557635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:28.694352 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06edb6ad-b502-49c8-a3ed-faab58163dfb None None] Pushing event deleted for resources: {'Port': ['ID=0ace74bf-1a28-48fb-8efb-000370ea66ce,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:28.695977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:20:28.726866 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06edb6ad-b502-49c8-a3ed-faab58163dfb None None] No DVR routers for this DVR port 0ace74bf-1a28-48fb-8efb-000370ea66ce on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:28.731587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Attempting to bind port 201e7ec4-04fd-4014-bf97-75995d8a73c1 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:20:28.735992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Attempting to bind port 201e7ec4-04fd-4014-bf97-75995d8a73c1 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:20:28.736519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Attempting to bind port 201e7ec4-04fd-4014-bf97-75995d8a73c1 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:20:28.748157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 20, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:20:28.748807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:28.749210 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:28.749651 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:20:28.750570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Bound port: 201e7ec4-04fd-4014-bf97-75995d8a73c1, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:20:28.750570 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:28.794226 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:28.814082 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:28.855808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 445cefc8-5130-4799-911a-f589d3a6c90f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:28.856169 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:28.867341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Made reservation on behalf of 474c82a3dfe24a42ae9d88d67006b265 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:28.879844 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:28.991854 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4f1687a8-e8cb-4260-ad86-0166e59ee7ed', 'name': '', 'tenant_id': 'a0824ae235484071b39cd368d3b3aa19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'c3b6dec8-1eff-4f03-b450-8f4eab49b5bc', 'external_fixed_ips': [{'subnet_id': '86aa37d6-735f-4645-b451-24e9708aabe6', 'ip_address': '172.20.0.14'}], 'enable_snat': True}, 'gw_port_id': 'a24d07db-f26e-4e1c-8712-1a386d8cc5d7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:14Z', 'updated_at': '2022-05-12T15:20:23Z', 'revision_number': 3, 'project_id': 'a0824ae235484071b39cd368d3b3aa19', 'gw_port': {'id': 'a24d07db-f26e-4e1c-8712-1a386d8cc5d7', 'name': '', 'network_id': 'c3b6dec8-1eff-4f03-b450-8f4eab49b5bc', 'tenant_id': '', 'mac_address': 'fa:16:3e:fa:ea:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f1687a8-e8cb-4260-ad86-0166e59ee7ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1470, 'fixed_ips': [{'subnet_id': '86aa37d6-735f-4645-b451-24e9708aabe6', 'ip_address': '172.20.0.14', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:18Z', 'updated_at': '2022-05-12T15:20:20Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '86aa37d6-735f-4645-b451-24e9708aabe6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:29.000000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8804c806-0302-4f2d-9afa-1e39e9de9f6c None None] Port 0ace74bf-1a28-48fb-8efb-000370ea66ce update to ACTIVE by agent not found {{(pid=88153) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2140}} May 12 15:20:29.000854 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Checking router: 4f1687a8-e8cb-4260-ad86-0166e59ee7ed for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:20:29.001197 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Updating router 4f1687a8-e8cb-4260-ad86-0166e59ee7ed port a24d07db-f26e-4e1c-8712-1a386d8cc5d7 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:20:29.061156 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:29.061740 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:29.061740 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Floating IP dfa393cb-fc56-4e68-84b5-0cc2616fa159 disassociated. External IP: 172.25.8.64, port: 026a86ba-df92-4de2-9f16-6e6b8794d1df. May 12 15:20:29.062102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Calling delete_port for 026a86ba-df92-4de2-9f16-6e6b8794d1df owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:29.132589 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:29.173624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] For port 201e7ec4-04fd-4014-bf97-75995d8a73c1, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:20:29.192968 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:29.194884 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d2339b4f-8549-4c11-b834-8a3fa64e59ba None None] Provisioning for port 77d485e0-c0f7-452a-ba64-2ff75661cddd completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:29.212662 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] For port 201e7ec4-04fd-4014-bf97-75995d8a73c1, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=201e7ec4-04fd-4014-bf97-75995d8a73c1,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:20:29.226810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d2339b4f-8549-4c11-b834-8a3fa64e59ba None None] Provisioning complete for port 77d485e0-c0f7-452a-ba64-2ff75661cddd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:29.227217 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d2339b4f-8549-4c11-b834-8a3fa64e59ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:29.239298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Pushing event updated for resources: {'Port': ['ID=77d485e0-c0f7-452a-ba64-2ff75661cddd,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:29.470062 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:29.672281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Routers {'78d4ada5-c100-4849-8e75-44ba389f27d8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:20:29.672915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['78d4ada5-c100-4849-8e75-44ba389f27d8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:29.733192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Network 2d986451-1d91-468d-8a9c-ecc4da7a86bc is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:29.736040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:29.761167 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:29.822706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0ace74bf-1a28-48fb-8efb-000370ea66ce no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:29.881004 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:29.907258 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Transition to ACTIVE for port object a24d07db-f26e-4e1c-8712-1a386d8cc5d7 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:29.935846 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:30.060612 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e8f87cab-ed1f-415a-ba40-0b1bcebfdd67 req-a9a52f48-95ce-4cd8-90f8-d6df242d5249 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 210 time: 0.4324181 May 12 15:20:30.083589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] Set router 78d4ada5-c100-4849-8e75-44ba389f27d8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:20:30.149728 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Attempting to bind port a24d07db-f26e-4e1c-8712-1a386d8cc5d7 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:20:30.150294 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Attempting to bind port a24d07db-f26e-4e1c-8712-1a386d8cc5d7 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '279b1471-6284-470c-ab12-e2a80d2f35a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 593, 'network_id': 'c3b6dec8-1eff-4f03-b450-8f4eab49b5bc'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:20:30.150573 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Attempting to bind port a24d07db-f26e-4e1c-8712-1a386d8cc5d7 on network c3b6dec8-1eff-4f03-b450-8f4eab49b5bc {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:20:30.168622 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 20, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:20:30.169037 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Checking segment: {'id': '279b1471-6284-470c-ab12-e2a80d2f35a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 593, 'network_id': 'c3b6dec8-1eff-4f03-b450-8f4eab49b5bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:30.169367 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:30.169768 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Bound using segment: {'id': '279b1471-6284-470c-ab12-e2a80d2f35a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 593, 'network_id': 'c3b6dec8-1eff-4f03-b450-8f4eab49b5bc'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:20:30.176282 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Bound port: a24d07db-f26e-4e1c-8712-1a386d8cc5d7, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '279b1471-6284-470c-ab12-e2a80d2f35a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 593, 'network_id': 'c3b6dec8-1eff-4f03-b450-8f4eab49b5bc'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:20:30.176734 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:30.189677 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:30.231744 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eff67fc3-bd69-4c0c-a0bb-0093605487a5 None None] Pushing event updated for resources: {'Port': ['ID=a24d07db-f26e-4e1c-8712-1a386d8cc5d7,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:30.340373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 0ace74bf-1a28-48fb-8efb-000370ea66ce {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:20:30.340698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0ace74bf-1a28-48fb-8efb-000370ea66ce not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:20:30.347632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event deleted for resources: {'Port': ['ID=026a86ba-df92-4de2-9f16-6e6b8794d1df,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:30.368553 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] For port a24d07db-f26e-4e1c-8712-1a386d8cc5d7, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:20:30.375235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Router 78d4ada5-c100-4849-8e75-44ba389f27d8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:20:30.381571 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] For port a24d07db-f26e-4e1c-8712-1a386d8cc5d7, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a24d07db-f26e-4e1c-8712-1a386d8cc5d7,segment=NetworkSegment(279b1471-6284-470c-ab12-e2a80d2f35a1),segment_id=279b1471-6284-470c-ab12-e2a80d2f35a1)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:20:30.396913 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:30.484080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24c7804a-5790-4b6f-8206-eff827368101 req-f7854a9b-ed94-4b52-933f-030082290f10 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:30.493165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24c7804a-5790-4b6f-8206-eff827368101 req-f7854a9b-ed94-4b52-933f-030082290f10 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 943 time: 1.9199958 May 12 15:20:30.535558 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eff67fc3-bd69-4c0c-a0bb-0093605487a5 None None] Pushing event updated for resources: {'Port': ['ID=a24d07db-f26e-4e1c-8712-1a386d8cc5d7,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:30.583639 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Routers {'4f1687a8-e8cb-4260-ad86-0166e59ee7ed'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:20:30.584286 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['4f1687a8-e8cb-4260-ad86-0166e59ee7ed'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:30.606477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22bad954-39da-4110-a7a0-75fc8f9eb351 None None] Pushing event updated for resources: {'Port': ['ID=201e7ec4-04fd-4014-bf97-75995d8a73c1,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:30.613355 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:30.621062 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d2339b4f-8549-4c11-b834-8a3fa64e59ba None None] Port 77d485e0-c0f7-452a-ba64-2ff75661cddd cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:20:30.629953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.objects.ports [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88152) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:20:30.641792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-7532c82a-796c-4ddb-9adb-17682a8e3834 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:30.643730 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-7532c82a-796c-4ddb-9adb-17682a8e3834 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.76 "GET /v2.0/networks?id=670dbecd-f547-4abf-b069-62f0c8712c6b HTTP/1.1" status: 200 len: 822 time: 1.1967902 May 12 15:20:30.645377 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:30.701076 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24c7804a-5790-4b6f-8206-eff827368101 req-a8fd98d2-a00f-4318-9f64-5390db945d18 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups?id=98320268-f290-4c75-8a2a-57916de87f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2080748 May 12 15:20:30.712051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Request body: {'port': {'device_id': 'de22b0a8-a494-4711-8630-31192ae0cb77', 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b', 'admin_state_up': True, 'tenant_id': '4789db12ded14c2e8773d2396c9acd32'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:30.719703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Router 82fdce0c-213a-480d-a72d-d6fec22a5428 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:20:30.820490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Deleting port a24d07db-f26e-4e1c-8712-1a386d8cc5d7 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:30.821351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:30.884861 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-751a773a-5954-422a-a2c2-98c4d0a079ab None None] Provisioning complete for port 77d485e0-c0f7-452a-ba64-2ff75661cddd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:30.889965 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-751a773a-5954-422a-a2c2-98c4d0a079ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:31.064507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-751a773a-5954-422a-a2c2-98c4d0a079ab None None] Port 77d485e0-c0f7-452a-ba64-2ff75661cddd cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:20:31.093860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:27Z', 'revision_number': 2, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:31.106436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-749ea41f-4f12-45e4-97a2-d5d82c181e8f None None] The sync data for ids ['78d4ada5-c100-4849-8e75-44ba389f27d8'] in n-d-841483-1 is: [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:27Z', 'revision_number': 2, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:20:31.107199 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] Set router 4f1687a8-e8cb-4260-ad86-0166e59ee7ed gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:20:31.200876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'Subnet': ['ID=b49490b4-fb59-4edd-af64-7567589c3a29,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:31.267295 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4f1687a8-e8cb-4260-ad86-0166e59ee7ed', 'name': '', 'tenant_id': 'a0824ae235484071b39cd368d3b3aa19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:14Z', 'updated_at': '2022-05-12T15:20:30Z', 'revision_number': 4, 'project_id': 'a0824ae235484071b39cd368d3b3aa19', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:31.274027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:31.278225 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d78bf55-8b23-4bbf-a94d-8f83d0708741 None None] The sync data for ids ['4f1687a8-e8cb-4260-ad86-0166e59ee7ed'] in n-d-841483-1 is: [{'id': '4f1687a8-e8cb-4260-ad86-0166e59ee7ed', 'name': '', 'tenant_id': 'a0824ae235484071b39cd368d3b3aa19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:14Z', 'updated_at': '2022-05-12T15:20:30Z', 'revision_number': 4, 'project_id': 'a0824ae235484071b39cd368d3b3aa19', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:20:31.319445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:20:31.342376 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-29505ddc-23dd-4157-aef2-27e6d391db43 admin admin] 10.222.0.82 "PUT /v2.0/routers/78d4ada5-c100-4849-8e75-44ba389f27d8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 9.6980751 May 12 15:20:31.395853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:20:31.413003 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c18f3090-6c9b-4f8a-afb3-94022f19dc65 None None] Sync routers for ids ['82fdce0c-213a-480d-a72d-d6fec22a5428'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:20:31.429350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c18f3090-6c9b-4f8a-afb3-94022f19dc65 None None] Routers {'82fdce0c-213a-480d-a72d-d6fec22a5428'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:20:31.430145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c18f3090-6c9b-4f8a-afb3-94022f19dc65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['82fdce0c-213a-480d-a72d-d6fec22a5428'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:31.565375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] No DVR routers for this DVR port 026a86ba-df92-4de2-9f16-6e6b8794d1df on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:31.568590 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:31.572361 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-31c1dda8-3f2d-474e-a5de-64b3aba805a9 req-8ce64c71-6e65-4f34-9f4b-097d7fa55e2a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.84 "DELETE /v2.0/ports/026a86ba-df92-4de2-9f16-6e6b8794d1df HTTP/1.1" status: 204 len: 173 time: 5.6115401 May 12 15:20:31.572658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-deleted', 'tag': '026a86ba-df92-4de2-9f16-6e6b8794d1df'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:31.606772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f7e14f1-ff25-46af-9b22-e3dbf70b2e7e req-4955b61b-3375-42d1-8cc9-86df3b1a52b0 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:31.608538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-2f7e14f1-ff25-46af-9b22-e3dbf70b2e7e req-4955b61b-3375-42d1-8cc9-86df3b1a52b0 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Synchronizing usage tracker for tenant:07c1472fa162425e9303d95e5e843c64 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:20:31.654067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-2f7e14f1-ff25-46af-9b22-e3dbf70b2e7e req-4955b61b-3375-42d1-8cc9-86df3b1a52b0 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Unset dirty status for tenant:07c1472fa162425e9303d95e5e843c64 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:20:31.655920 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2f7e14f1-ff25-46af-9b22-e3dbf70b2e7e req-4955b61b-3375-42d1-8cc9-86df3b1a52b0 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.84 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 945 time: 0.5239604 May 12 15:20:31.673267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Usage tracker for resource:port and tenant:4789db12ded14c2e8773d2396c9acd32 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:31.707375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30728965-9a3d-467b-aea0-245699f48eab req-a4228057-5a8a-4ee6-9028-c6167e5ee23a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:31.729988 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30728965-9a3d-467b-aea0-245699f48eab req-a4228057-5a8a-4ee6-9028-c6167e5ee23a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 945 time: 1.4516850 May 12 15:20:31.768015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:31.794412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:31.812263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-2f7e14f1-ff25-46af-9b22-e3dbf70b2e7e req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Deleting port 466cb97c-6736-42bb-8e25-772f0b5535db {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:31.812643 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2f7e14f1-ff25-46af-9b22-e3dbf70b2e7e req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:31.934701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Checking segment: {'id': '83cf33ba-8af3-43e0-ab16-cb420b840652', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '72b18c14-a959-4cae-9582-f9d6877fbe33'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:31.935092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Network hostable DHCP agents. Network: 72b18c14-a959-4cae-9582-f9d6877fbe33, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:20:31.980638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c18f3090-6c9b-4f8a-afb3-94022f19dc65 None None] Set router 82fdce0c-213a-480d-a72d-d6fec22a5428 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:20:32.022702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Made reservation on behalf of 4789db12ded14c2e8773d2396c9acd32 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:32.026371 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:32.094951 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30728965-9a3d-467b-aea0-245699f48eab req-27cf15cd-46e3-4e35-b004-197191fed369 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3634109 May 12 15:20:32.181910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Network 72b18c14-a959-4cae-9582-f9d6877fbe33 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:20:32.397916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b68dbf-8a85-47ae-a5dc-1ed2e0d415d6 req-5d08e6fa-d4ec-4af7-98e8-a3de154222b4 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:32.420197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-90b68dbf-8a85-47ae-a5dc-1ed2e0d415d6 req-5d08e6fa-d4ec-4af7-98e8-a3de154222b4 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ddbfd7d-b0df-4738-9d34-ea82ba255187 HTTP/1.1" status: 200 len: 945 time: 1.2838771 May 12 15:20:32.423533 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 72b18c14-a959-4cae-9582-f9d6877fbe33) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:32.442253 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5374b1d3-ff51-4dfe-8291-b6ee371d8226 None None] Network 72b18c14-a959-4cae-9582-f9d6877fbe33 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:32.479215 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:32.754199 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2f7e14f1-ff25-46af-9b22-e3dbf70b2e7e req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] For port 466cb97c-6736-42bb-8e25-772f0b5535db, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=466cb97c-6736-42bb-8e25-772f0b5535db,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:32.755751 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2f7e14f1-ff25-46af-9b22-e3dbf70b2e7e req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:32.777124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:32.779523 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:32.942040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-2f7e14f1-ff25-46af-9b22-e3dbf70b2e7e req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Calling delete_port for 466cb97c-6736-42bb-8e25-772f0b5535db owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:33.099193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] For port a24d07db-f26e-4e1c-8712-1a386d8cc5d7, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a24d07db-f26e-4e1c-8712-1a386d8cc5d7,segment=NetworkSegment(279b1471-6284-470c-ab12-e2a80d2f35a1),segment_id=279b1471-6284-470c-ab12-e2a80d2f35a1)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:33.099193 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:33.133910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-53b7d1fc-0627-40bb-81f7-6fa016752909 req-1b64fdf3-f448-48c6-acca-13dab889c8c9 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 210 time: 0.2526765 May 12 15:20:33.171016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2f7e14f1-ff25-46af-9b22-e3dbf70b2e7e req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:33.208317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c18f3090-6c9b-4f8a-afb3-94022f19dc65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:14:06Z', 'revision_number': 4, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port': {'id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:0b:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_gateway', 'standard_attr_id': 981, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:52Z', 'updated_at': '2022-05-12T15:14:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '27d87447-eec9-4938-9dce-782d012459ac', 'name': '', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'mac_address': 'fa:16:3e:d6:d1:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_interface', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:03Z', 'updated_at': '2022-05-12T15:14:16Z', 'revision_number': 5, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'subnets': [{'id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:33.219097 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['2a00c7fc-ced7-44c0-b374-110741ae6468'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:20:33.266985 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1793f907-4304-4924-bfc4-2bc37d033c1a'] response: {'server_uuid': '7c486a19-424b-424e-985d-46ac71f03934', 'name': 'network-vif-deleted', 'tag': '026a86ba-df92-4de2-9f16-6e6b8794d1df', 'status': 'completed', 'code': 200} May 12 15:20:33.297313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['e795cd0b-ae34-4489-9acc-774faf0d6935', '466cb97c-6736-42bb-8e25-772f0b5535db'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:20:33.312666 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Pushing event deleted for resources: {'Port': ['ID=466cb97c-6736-42bb-8e25-772f0b5535db,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:33.333071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:33.333952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:33.334492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:33.335020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:33.335729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:33.336253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:33.336798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:33.337318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:33.338025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:33.338547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:33.339063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:33.339591 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:33.465056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c18f3090-6c9b-4f8a-afb3-94022f19dc65 None None] Checking router: 82fdce0c-213a-480d-a72d-d6fec22a5428 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:20:33.489068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-72b18c14-a959-4cae-9582-f9d6877fbe33', 'network_id': '72b18c14-a959-4cae-9582-f9d6877fbe33', 'tenant_id': '474c82a3dfe24a42ae9d88d67006b265', 'fixed_ips': [{'subnet_id': 'b49490b4-fb59-4edd-af64-7567589c3a29'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:20:33.490966 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:33.499294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f7e14f1-ff25-46af-9b22-e3dbf70b2e7e req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] No DVR routers for this DVR port 466cb97c-6736-42bb-8e25-772f0b5535db on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:33.504186 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2f7e14f1-ff25-46af-9b22-e3dbf70b2e7e req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:33.536791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33620) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:33.551165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Request body: {'security_group': {'name': 'tempest-securitygroup--598248995', 'description': 'tempest-description--2053105780'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:33.567646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:33.572452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Usage tracker for resource:security_group and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:33.577228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:33.585597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:33.595212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Calling delete_port for a24d07db-f26e-4e1c-8712-1a386d8cc5d7 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:33.599299 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2f7e14f1-ff25-46af-9b22-e3dbf70b2e7e req-fb93b55b-5c30-42f9-ac7c-f74e31dd1dbd tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.84 "DELETE /v2.0/ports/466cb97c-6736-42bb-8e25-772f0b5535db HTTP/1.1" status: 204 len: 173 time: 1.9363992 May 12 15:20:33.698192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-90b68dbf-8a85-47ae-a5dc-1ed2e0d415d6 req-e4e6c896-8699-41a4-a463-fb6ba38ba2b8 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.2755725 May 12 15:20:33.763751 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:33.812298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-765e2dc8-1c0c-402e-b820-fdc0d078d838 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 818 time: 6.3180895 May 12 15:20:33.813830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Allocated IP 172.20.0.3 (670dbecd-f547-4abf-b069-62f0c8712c6b/5a24db8d-fb66-4b7f-bf96-50956cb218fd/803ac615-40d5-4393-abcc-712ad84a11ed) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:33.822049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33624) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:33.824425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:33.864397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Usage tracker for resource:security_group_rule and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:33.879469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:33.918735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:34.106772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Allocated IP 2001:db8::f816:3eff:feba:8a (72b18c14-a959-4cae-9582-f9d6877fbe33/b49490b4-fb59-4edd-af64-7567589c3a29/cb3f781a-af80-49ef-94ce-4b6c70830c97) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:34.186639 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:34.202039 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:34.308585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event updated for resources: {'SecurityGroup': ['ID=113e667d-ea29-4a75-8d4e-1be835a567e4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:34.316960 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:34.325718 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1fd4a65b-b2af-4ae4-aa10-a38d3ffb1624 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1781 time: 0.7862196 May 12 15:20:34.327108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33630) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:34.337441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d7bba74c-3b76-4da6-b552-587c6b96f883 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Request body: {'security_group_rule': {'security_group_id': '113e667d-ea29-4a75-8d4e-1be835a567e4', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:34.352241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d7bba74c-3b76-4da6-b552-587c6b96f883 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:34.372652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d7bba74c-3b76-4da6-b552-587c6b96f883 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Usage tracker for resource:security_group_rule and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:34.389454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d7bba74c-3b76-4da6-b552-587c6b96f883 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:34.405947 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2cc85fa0-6f4e-4824-a59b-87f4d41e8ed1 req-f9b39afa-e418-41d8-b61d-3254677e3aeb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 210 time: 0.4793959 May 12 15:20:34.418453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d7bba74c-3b76-4da6-b552-587c6b96f883 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:34.478946 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d7bba74c-3b76-4da6-b552-587c6b96f883 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:34.773837 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d7bba74c-3b76-4da6-b552-587c6b96f883 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:34.788033 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d7bba74c-3b76-4da6-b552-587c6b96f883 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:34.826332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 201e7ec4-04fd-4014-bf97-75995d8a73c1 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:34.846520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7bba74c-3b76-4da6-b552-587c6b96f883 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9b86a553-c20b-4778-8038-d098fadc5d29,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:34.874308 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d7bba74c-3b76-4da6-b552-587c6b96f883 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:34.875531 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d7bba74c-3b76-4da6-b552-587c6b96f883 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5472639 May 12 15:20:34.880265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33644) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:34.885908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c5200ead-f2d9-4815-9c4e-1b0b8709b226 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Request body: {'security_group_rule': {'security_group_id': '113e667d-ea29-4a75-8d4e-1be835a567e4', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:34.895852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c5200ead-f2d9-4815-9c4e-1b0b8709b226 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:34.903046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c5200ead-f2d9-4815-9c4e-1b0b8709b226 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Usage tracker for resource:security_group_rule and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:34.908354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c5200ead-f2d9-4815-9c4e-1b0b8709b226 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:34.916402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c5200ead-f2d9-4815-9c4e-1b0b8709b226 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:34.924902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b1005ff9-a24a-4640-8919-3e6bda73e232 req-1228ff9c-7a59-457b-a9a8-8d85042474f2 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Synchronizing usage tracker for tenant:4789db12ded14c2e8773d2396c9acd32 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:20:34.930012 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c18f3090-6c9b-4f8a-afb3-94022f19dc65 None None] Routers {'82fdce0c-213a-480d-a72d-d6fec22a5428'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:20:34.931340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c18f3090-6c9b-4f8a-afb3-94022f19dc65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['82fdce0c-213a-480d-a72d-d6fec22a5428'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:34.950048 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:34.961816 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c5200ead-f2d9-4815-9c4e-1b0b8709b226 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:35.069061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3ce8081-6442-4bf3-8b8a-4c4037b4634e req-d2a20ff5-1fd6-4008-af7b-025d8a1f9ac2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:35.071075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3ce8081-6442-4bf3-8b8a-4c4037b4634e req-d2a20ff5-1fd6-4008-af7b-025d8a1f9ac2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 945 time: 0.7522852 May 12 15:20:35.091391 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:35.105405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 201e7ec4-04fd-4014-bf97-75995d8a73c1 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:35.116012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b1005ff9-a24a-4640-8919-3e6bda73e232 req-1228ff9c-7a59-457b-a9a8-8d85042474f2 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Unset dirty status for tenant:4789db12ded14c2e8773d2396c9acd32 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:20:35.118062 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1005ff9-a24a-4640-8919-3e6bda73e232 req-1228ff9c-7a59-457b-a9a8-8d85042474f2 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 210 time: 0.3310502 May 12 15:20:35.135263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 201e7ec4-04fd-4014-bf97-75995d8a73c1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:35.139054 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:35.164094 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c5200ead-f2d9-4815-9c4e-1b0b8709b226 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:35.177334 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c5200ead-f2d9-4815-9c4e-1b0b8709b226 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:35.236863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5200ead-f2d9-4815-9c4e-1b0b8709b226 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a5276456-5a10-446c-849c-a5e25ef7f96c,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:35.269103 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c5200ead-f2d9-4815-9c4e-1b0b8709b226 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:35.273062 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c5200ead-f2d9-4815-9c4e-1b0b8709b226 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3915832 May 12 15:20:35.280113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33648) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:35.280590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0ddbfd7d-b0df-4738-9d34-ea82ba255187', 'name': 'network-vif-deleted', 'tag': '466cb97c-6736-42bb-8e25-772f0b5535db'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:35.305149 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3ce8081-6442-4bf3-8b8a-4c4037b4634e req-cccd5328-8e5b-4b6f-8196-8425eed78a60 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2099440 May 12 15:20:35.320276 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:35.338712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:35.351681 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:35.374804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:35.397995 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Sync routers for ids ['78d4ada5-c100-4849-8e75-44ba389f27d8'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:20:35.400093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Usage tracker for resource:floatingip and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:35.414737 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Routers {'78d4ada5-c100-4849-8e75-44ba389f27d8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:20:35.416095 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['78d4ada5-c100-4849-8e75-44ba389f27d8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:35.426904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:35.454271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:35.492018 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1271feeb-1182-4619-875b-8b584a600664'] response: {'server_uuid': '0ddbfd7d-b0df-4738-9d34-ea82ba255187', 'name': 'network-vif-deleted', 'tag': '466cb97c-6736-42bb-8e25-772f0b5535db', 'status': 'completed', 'code': 200} May 12 15:20:35.514800 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:35.522666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event deleted for resources: {'Port': ['ID=a24d07db-f26e-4e1c-8712-1a386d8cc5d7,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:35.624995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:35.624995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:35.625344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:35.627848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:35.629990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:35.630661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:35.630999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:35.631322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:35.631646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:35.631964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:35.632280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:35.632594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:20:35.812946 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:35.862561 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Set router 78d4ada5-c100-4849-8e75-44ba389f27d8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:20:35.870197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c18f3090-6c9b-4f8a-afb3-94022f19dc65 None None] Set router 82fdce0c-213a-480d-a72d-d6fec22a5428 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:20:35.935732 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:36.072663 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:36.103093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 466cb97c-6736-42bb-8e25-772f0b5535db no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:36.264936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Allocated IP 172.25.8.178 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/99d5efe6-ef16-4f7b-88da-a85db84c1ce7) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:36.454824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 466cb97c-6736-42bb-8e25-772f0b5535db {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:20:36.455332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 466cb97c-6736-42bb-8e25-772f0b5535db not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:20:36.463023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Transition to ACTIVE for port object cb3f781a-af80-49ef-94ce-4b6c70830c97 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:36.469139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Pushing event updated for resources: {'Port': ['ID=803ac615-40d5-4393-abcc-712ad84a11ed,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:36.535322 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:36.541619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Transition to ACTIVE for port object cb3f781a-af80-49ef-94ce-4b6c70830c97 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:36.694463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Network 670dbecd-f547-4abf-b069-62f0c8712c6b is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:36.726882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:36.739707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:36.775367 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:27Z', 'revision_number': 2, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:36.777046 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:36.790024 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Checking router: 78d4ada5-c100-4849-8e75-44ba389f27d8 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:20:36.790785 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Updating router 78d4ada5-c100-4849-8e75-44ba389f27d8 port 77d485e0-c0f7-452a-ba64-2ff75661cddd binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:20:36.888548 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:36.888914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 201e7ec4-04fd-4014-bf97-75995d8a73c1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=201e7ec4-04fd-4014-bf97-75995d8a73c1,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:36.905098 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:20:36.934316 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:36.945094 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:36.951112 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0c1fa1e-9811-4545-b51b-e4f6b19e74c8 req-96c869d3-6f56-49b9-934c-62029a127bdb tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/ports?device_id=7c486a19-424b-424e-985d-46ac71f03934 HTTP/1.1" status: 200 len: 210 time: 0.4612036 May 12 15:20:36.962637 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:37.004402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Network 72b18c14-a959-4cae-9582-f9d6877fbe33 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:37.020292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:37.035070 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:37.046878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:37.150938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Pushing event updated for resources: {'Port': ['ID=cb3f781a-af80-49ef-94ce-4b6c70830c97,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:37.269458 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:37.285444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:37.296621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:37.300567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:37.546171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event updated for resources: {'Port': ['ID=99d5efe6-ef16-4f7b-88da-a85db84c1ce7,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:37.578071 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:37.605529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:37.605995 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Transition to ACTIVE for port object 77d485e0-c0f7-452a-ba64-2ff75661cddd will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:37.619358 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:37.716409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Attempting to bind port cb3f781a-af80-49ef-94ce-4b6c70830c97 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:20:37.716991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Attempting to bind port cb3f781a-af80-49ef-94ce-4b6c70830c97 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '83cf33ba-8af3-43e0-ab16-cb420b840652', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '72b18c14-a959-4cae-9582-f9d6877fbe33'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:20:37.718534 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Attempting to bind port cb3f781a-af80-49ef-94ce-4b6c70830c97 on network 72b18c14-a959-4cae-9582-f9d6877fbe33 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:20:37.729983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 20, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:20:37.730675 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Checking segment: {'id': '83cf33ba-8af3-43e0-ab16-cb420b840652', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '72b18c14-a959-4cae-9582-f9d6877fbe33'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:37.731247 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:37.732238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Bound using segment: {'id': '83cf33ba-8af3-43e0-ab16-cb420b840652', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '72b18c14-a959-4cae-9582-f9d6877fbe33'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:20:37.732877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Bound port: cb3f781a-af80-49ef-94ce-4b6c70830c97, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '83cf33ba-8af3-43e0-ab16-cb420b840652', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '72b18c14-a959-4cae-9582-f9d6877fbe33'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:20:37.733461 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:37.743467 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:37.747833 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc1f004e-b9a2-4284-bb05-be4e8ad169b7 None None] Pushing event updated for resources: {'Port': ['ID=77d485e0-c0f7-452a-ba64-2ff75661cddd,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:37.770417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=201e7ec4-04fd-4014-bf97-75995d8a73c1,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:37.902782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c18f3090-6c9b-4f8a-afb3-94022f19dc65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:14:06Z', 'revision_number': 4, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port': {'id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:0b:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_gateway', 'standard_attr_id': 981, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:52Z', 'updated_at': '2022-05-12T15:14:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '27d87447-eec9-4938-9dce-782d012459ac', 'name': '', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'mac_address': 'fa:16:3e:d6:d1:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_interface', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:03Z', 'updated_at': '2022-05-12T15:14:16Z', 'revision_number': 5, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'subnets': [{'id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:37.917679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c18f3090-6c9b-4f8a-afb3-94022f19dc65 None None] The sync data for ids ['82fdce0c-213a-480d-a72d-d6fec22a5428'] in n-d-841483-1 is: [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:14:06Z', 'revision_number': 4, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port': {'id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:0b:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_gateway', 'standard_attr_id': 981, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:52Z', 'updated_at': '2022-05-12T15:14:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '27d87447-eec9-4938-9dce-782d012459ac', 'name': '', 'network_id': '939fdac4-3043-4213-bd31-a421a6c659bc', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'mac_address': 'fa:16:3e:d6:d1:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_interface', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:03Z', 'updated_at': '2022-05-12T15:14:16Z', 'revision_number': 5, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'subnets': [{'id': 'c7af977d-fe6b-4182-af40-d4c2523b54a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:20:37.923341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Subnet': ['ID=b49490b4-fb59-4edd-af64-7567589c3a29,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:37.936158 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] For port cb3f781a-af80-49ef-94ce-4b6c70830c97, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:20:37.960794 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] For port cb3f781a-af80-49ef-94ce-4b6c70830c97, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cb3f781a-af80-49ef-94ce-4b6c70830c97,segment=NetworkSegment(83cf33ba-8af3-43e0-ab16-cb420b840652),segment_id=83cf33ba-8af3-43e0-ab16-cb420b840652)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:20:37.976448 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:37.998920 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:38.020024 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:38.103586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47b3a94a-3201-4c0c-a0bd-61734b71967d req-dde9988d-11f4-4f75-be96-05c1171ab2c5 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:38.105133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47b3a94a-3201-4c0c-a0bd-61734b71967d req-dde9988d-11f4-4f75-be96-05c1171ab2c5 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=91efc3d2-c9e0-4867-98a8-80db504551ad HTTP/1.1" status: 200 len: 945 time: 0.9340229 May 12 15:20:38.131626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:38.132292 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:38.158863 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Attempting to bind port 77d485e0-c0f7-452a-ba64-2ff75661cddd on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:20:38.160153 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Attempting to bind port 77d485e0-c0f7-452a-ba64-2ff75661cddd by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:20:38.160583 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Attempting to bind port 77d485e0-c0f7-452a-ba64-2ff75661cddd on network 2d986451-1d91-468d-8a9c-ecc4da7a86bc {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:20:38.177937 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 20, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:20:38.178673 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Checking segment: {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:38.179528 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:38.180221 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Bound using segment: {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:20:38.180917 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Bound port: 77d485e0-c0f7-452a-ba64-2ff75661cddd, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:20:38.181414 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:38.267167 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:38.306807 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:38.401330 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e085adf-3164-4ff2-a9db-be332d932917 None None] Pushing event updated for resources: {'Port': ['ID=cb3f781a-af80-49ef-94ce-4b6c70830c97,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:38.418620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b71db58f-c6c2-4ccd-8ec0-cead85a44de5 req-4d8420b1-9faa-4f27-837e-b0f9f7b593e2 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:38.453971 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b71db58f-c6c2-4ccd-8ec0-cead85a44de5 req-4d8420b1-9faa-4f27-837e-b0f9f7b593e2 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 931 time: 1.0961623 May 12 15:20:38.482162 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77875b95-9255-46d1-bbda-832314183a98 None None] Network 72b18c14-a959-4cae-9582-f9d6877fbe33 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:38.503596 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] For port 77d485e0-c0f7-452a-ba64-2ff75661cddd, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:20:38.509792 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] For port 77d485e0-c0f7-452a-ba64-2ff75661cddd, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=77d485e0-c0f7-452a-ba64-2ff75661cddd,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:20:38.520857 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:38.523012 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e31bb370-0563-46e4-b96c-43b228cbac74 None None] New status for floating IP dfa393cb-fc56-4e68-84b5-0cc2616fa159: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:20:38.568914 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47b3a94a-3201-4c0c-a0bd-61734b71967d req-2bc1eef5-ea45-462a-8678-9971350d8f8f tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3658168 May 12 15:20:38.570373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-3d277680-aff8-4e79-b4df-f1e363c231e5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 7.8623700 May 12 15:20:38.571527 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:38.670802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event updated for resources: {'Port': ['ID=99d5efe6-ef16-4f7b-88da-a85db84c1ce7,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:38.687997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Request body: {'port': {'device_id': 'de22b0a8-a494-4711-8630-31192ae0cb77', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:38.718855 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Routers {'78d4ada5-c100-4849-8e75-44ba389f27d8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:20:38.725439 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['78d4ada5-c100-4849-8e75-44ba389f27d8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:38.841693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca3fb952-b2ab-4e1b-ba0c-3e25955e24e7 req-5a93588f-f6ec-4b22-8b2c-e9eb77ed35d6 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:38.842875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ca3fb952-b2ab-4e1b-ba0c-3e25955e24e7 req-5a93588f-f6ec-4b22-8b2c-e9eb77ed35d6 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Synchronizing usage tracker for tenant:07c1472fa162425e9303d95e5e843c64 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:20:38.846141 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:38.858543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['72b18c14-a959-4cae-9582-f9d6877fbe33']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:38.892620 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:38.916602 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3744c54d-aa33-44dc-978d-611e36f7a121 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.6091137 May 12 15:20:38.945174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '83cf33ba-8af3-43e0-ab16-cb420b840652') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:38.946236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '83cf33ba-8af3-43e0-ab16-cb420b840652') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:38.949490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ca3fb952-b2ab-4e1b-ba0c-3e25955e24e7 req-5a93588f-f6ec-4b22-8b2c-e9eb77ed35d6 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Unset dirty status for tenant:07c1472fa162425e9303d95e5e843c64 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:20:38.952083 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca3fb952-b2ab-4e1b-ba0c-3e25955e24e7 req-5a93588f-f6ec-4b22-8b2c-e9eb77ed35d6 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.84 "GET /v2.0/ports?device_id=91efc3d2-c9e0-4867-98a8-80db504551ad HTTP/1.1" status: 200 len: 945 time: 0.6395092 May 12 15:20:38.995197 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:38.997123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 4f1687a8-e8cb-4260-ad86-0166e59ee7ed {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:20:39.060067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33710) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:39.076330 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:39.105178 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc1f004e-b9a2-4284-bb05-be4e8ad169b7 None None] Pushing event updated for resources: {'Port': ['ID=77d485e0-c0f7-452a-ba64-2ff75661cddd,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:39.232846 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b71db58f-c6c2-4ccd-8ec0-cead85a44de5 req-486af121-a213-4bd4-b89d-9af7dc03c711 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7779019 May 12 15:20:39.252250 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:39.256667 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cd2d8463-59a1-4ef6-aea1-8792c4abb1ce tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "DELETE /v2.0/routers/4f1687a8-e8cb-4260-ad86-0166e59ee7ed HTTP/1.1" status: 204 len: 168 time: 11.1981471 May 12 15:20:39.256667 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:39.258665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33724) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:39.292275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 201e7ec4-04fd-4014-bf97-75995d8a73c1 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:39.302625 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] Set router 78d4ada5-c100-4849-8e75-44ba389f27d8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:20:39.339531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Releasing vlan 580 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:20:39.340092 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:39.341848 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-ca3fb952-b2ab-4e1b-ba0c-3e25955e24e7 req-2a29a1fd-c921-407d-8149-fc4e6a3b3095 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Deleting port e795cd0b-ae34-4489-9acc-774faf0d6935 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:39.342315 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ca3fb952-b2ab-4e1b-ba0c-3e25955e24e7 req-2a29a1fd-c921-407d-8149-fc4e6a3b3095 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: timer() May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:20:39.374627 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:20:39.478158 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-59668037-fb1a-40f4-9437-e165d218e7eb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Deleting subnet 86aa37d6-735f-4645-b451-24e9708aabe6 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:20:39.520200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-59668037-fb1a-40f4-9437-e165d218e7eb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:39.531198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-71a3aa68-4e47-4618-b9ad-aed6c817beff tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Synchronizing usage tracker for tenant:40852c97262142aeb6d62097955af83f on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:20:39.542736 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') May 12 15:20:39.542736 n-d-841483-1 neutron-server[88152]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] May 12 15:20:39.542736 n-d-841483-1 neutron-server[88152]: [parameters: {'id': '72b18c14-a959-4cae-9582-f9d6877fbe33'}] May 12 15:20:39.542736 n-d-841483-1 neutron-server[88152]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:20:39.543158 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:20:39.563895 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:39.580139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 201e7ec4-04fd-4014-bf97-75995d8a73c1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:39.580820 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:39.658535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-71a3aa68-4e47-4618-b9ad-aed6c817beff tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Unset dirty status for tenant:40852c97262142aeb6d62097955af83f on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:20:39.670335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-71a3aa68-4e47-4618-b9ad-aed6c817beff tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--598248995&fields=id&tenant_id=40852c97262142aeb6d62097955af83f HTTP/1.1" status: 200 len: 267 time: 0.3579822 May 12 15:20:39.786395 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-59668037-fb1a-40f4-9437-e165d218e7eb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:39.792929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 860dc344-70ad-4ff8-9592-ee8e988a4f26 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:20:39.817690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af13b528-71ff-46b9-a71e-36388317db9b None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:20:39.977168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-8499712f-054c-4197-9c2d-fec89a4bc9a2 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:39.978484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-8499712f-054c-4197-9c2d-fec89a4bc9a2 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Synchronizing usage tracker for tenant:40852c97262142aeb6d62097955af83f on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:20:39.996615 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93b264ba-f8b7-49d5-8610-a1e68d176ad1 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:40.039087 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:38Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:40.047326 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70d9881c-c44c-4e50-bb88-c7a9b391f27b None None] The sync data for ids ['78d4ada5-c100-4849-8e75-44ba389f27d8'] in n-d-841483-1 is: [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:38Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:20:40.057340 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:40.111421 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-59668037-fb1a-40f4-9437-e165d218e7eb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:40.121488 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Deleting port cb3f781a-af80-49ef-94ce-4b6c70830c97 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:40.121891 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:40.265247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:40.294800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-8499712f-054c-4197-9c2d-fec89a4bc9a2 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Unset dirty status for tenant:40852c97262142aeb6d62097955af83f on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:20:40.302862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ca3fb952-b2ab-4e1b-ba0c-3e25955e24e7 req-2a29a1fd-c921-407d-8149-fc4e6a3b3095 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] For port e795cd0b-ae34-4489-9acc-774faf0d6935, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e795cd0b-ae34-4489-9acc-774faf0d6935,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:40.303543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ca3fb952-b2ab-4e1b-ba0c-3e25955e24e7 req-2a29a1fd-c921-407d-8149-fc4e6a3b3095 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:40.307377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-8499712f-054c-4197-9c2d-fec89a4bc9a2 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/networks?id=2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 200 len: 817 time: 0.6357007 May 12 15:20:40.319832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'port_id': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'mac_address': 'fa:16:3e:ad:b5:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 579, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:20:40.329520 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93b264ba-f8b7-49d5-8610-a1e68d176ad1 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:40.396558 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-59668037-fb1a-40f4-9437-e165d218e7eb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:40.431180 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af13b528-71ff-46b9-a71e-36388317db9b None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:20:40.507072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-ca3fb952-b2ab-4e1b-ba0c-3e25955e24e7 req-2a29a1fd-c921-407d-8149-fc4e6a3b3095 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Calling delete_port for e795cd0b-ae34-4489-9acc-774faf0d6935 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:40.527793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-61a4ad8a-53e9-4449-b690-e1651c29e903 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/quotas/40852c97262142aeb6d62097955af83f HTTP/1.1" status: 200 len: 375 time: 0.2195055 May 12 15:20:40.543351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59668037-fb1a-40f4-9437-e165d218e7eb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=86aa37d6-735f-4645-b451-24e9708aabe6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:40.576403 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-59668037-fb1a-40f4-9437-e165d218e7eb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:40.594132 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-59668037-fb1a-40f4-9437-e165d218e7eb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "DELETE /v2.0/subnets/86aa37d6-735f-4645-b451-24e9708aabe6 HTTP/1.1" status: 204 len: 168 time: 1.3313847 May 12 15:20:40.594911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33738) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:40.905047 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:40.941752 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec212276-c0b7-4264-a562-3299e02968e7 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:40.953032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 860dc344-70ad-4ff8-9592-ee8e988a4f26 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:20:41.041744 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:41.067505 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93b264ba-f8b7-49d5-8610-a1e68d176ad1 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:41.068472 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:41.073951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] For port cb3f781a-af80-49ef-94ce-4b6c70830c97, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cb3f781a-af80-49ef-94ce-4b6c70830c97,segment=NetworkSegment(83cf33ba-8af3-43e0-ab16-cb420b840652),segment_id=83cf33ba-8af3-43e0-ab16-cb420b840652)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:41.074590 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:41.119391 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e226a6cb-ab8d-437a-a78e-c92c082af23e req-32a969e6-dbf7-4b53-a04d-389810417065 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:41.126783 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e226a6cb-ab8d-437a-a78e-c92c082af23e req-32a969e6-dbf7-4b53-a04d-389810417065 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=91efc3d2-c9e0-4867-98a8-80db504551ad HTTP/1.1" status: 200 len: 945 time: 1.1617217 May 12 15:20:41.201375 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec212276-c0b7-4264-a562-3299e02968e7 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:41.262634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ec212276-c0b7-4264-a562-3299e02968e7 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c3b6dec8-1eff-4f03-b450-8f4eab49b5bc']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:41.288374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ec212276-c0b7-4264-a562-3299e02968e7 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '279b1471-6284-470c-ab12-e2a80d2f35a1') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:41.288689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ec212276-c0b7-4264-a562-3299e02968e7 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '279b1471-6284-470c-ab12-e2a80d2f35a1') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:41.305652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93b264ba-f8b7-49d5-8610-a1e68d176ad1 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=98320268-f290-4c75-8a2a-57916de87f04,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:41.322218 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec212276-c0b7-4264-a562-3299e02968e7 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:41.362570 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec212276-c0b7-4264-a562-3299e02968e7 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:41.384123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ec212276-c0b7-4264-a562-3299e02968e7 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Releasing vlan 593 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:20:41.384539 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec212276-c0b7-4264-a562-3299e02968e7 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:41.418018 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-31258365-ab62-46da-a2c2-633b4cc36fc4 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=40852c97262142aeb6d62097955af83f&fields=id HTTP/1.1" status: 200 len: 348 time: 0.8326790 May 12 15:20:41.438254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Calling delete_port for cb3f781a-af80-49ef-94ce-4b6c70830c97 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:41.472035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['860dc344-70ad-4ff8-9592-ee8e988a4f26'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:20:41.539712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 77d485e0-c0f7-452a-ba64-2ff75661cddd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: timer() May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:20:41.611716 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:20:41.631168 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec212276-c0b7-4264-a562-3299e02968e7 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:41.666946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec212276-c0b7-4264-a562-3299e02968e7 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network c3b6dec8-1eff-4f03-b450-8f4eab49b5bc {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:124}} May 12 15:20:41.669974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec212276-c0b7-4264-a562-3299e02968e7 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:41.673153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec212276-c0b7-4264-a562-3299e02968e7 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event deleted for resources: {'Network': ['ID=c3b6dec8-1eff-4f03-b450-8f4eab49b5bc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:41.678939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ca3fb952-b2ab-4e1b-ba0c-3e25955e24e7 req-2a29a1fd-c921-407d-8149-fc4e6a3b3095 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:41.808215 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ec212276-c0b7-4264-a562-3299e02968e7 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "DELETE /v2.0/networks/c3b6dec8-1eff-4f03-b450-8f4eab49b5bc HTTP/1.1" status: 204 len: 168 time: 1.2089312 May 12 15:20:41.838974 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 803ac615-40d5-4393-abcc-712ad84a11ed {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:20:41.855500 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:41.864878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['2a00c7fc-ced7-44c0-b374-110741ae6468'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:20:41.899143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Transition to ACTIVE for port object 803ac615-40d5-4393-abcc-712ad84a11ed will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:42.055084 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93b264ba-f8b7-49d5-8610-a1e68d176ad1 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:42.056586 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-93b264ba-f8b7-49d5-8610-a1e68d176ad1 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "DELETE /v2.0/security-groups/98320268-f290-4c75-8a2a-57916de87f04 HTTP/1.1" status: 204 len: 168 time: 2.9875360 May 12 15:20:42.056859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a29a1fd-c921-407d-8149-fc4e6a3b3095 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Pushing event deleted for resources: {'Port': ['ID=e795cd0b-ae34-4489-9acc-774faf0d6935,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:42.059329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-87615524-416a-4a4f-b3cd-68dd09cd366b service neutron] 10.222.0.82 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5506520 May 12 15:20:42.061479 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:42.066294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33778) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:42.069311 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:42.076774 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e226a6cb-ab8d-437a-a78e-c92c082af23e req-d165e7d1-99df-43ea-b8e2-b924b5444c8f tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9488518 May 12 15:20:42.092791 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-af356e0c-ced5-4859-9353-465258429af6 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] show failed (client error): The resource could not be found. May 12 15:20:42.093528 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:42.096734 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-af356e0c-ced5-4859-9353-465258429af6 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "GET /v2.0/security-groups/98320268-f290-4c75-8a2a-57916de87f04 HTTP/1.1" status: 404 len: 347 time: 0.0269332 May 12 15:20:42.097864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca3fb952-b2ab-4e1b-ba0c-3e25955e24e7 req-2a29a1fd-c921-407d-8149-fc4e6a3b3095 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] No DVR routers for this DVR port e795cd0b-ae34-4489-9acc-774faf0d6935 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:42.100043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33782) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:42.105981 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ca3fb952-b2ab-4e1b-ba0c-3e25955e24e7 req-2a29a1fd-c921-407d-8149-fc4e6a3b3095 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:42.108950 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca3fb952-b2ab-4e1b-ba0c-3e25955e24e7 req-2a29a1fd-c921-407d-8149-fc4e6a3b3095 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.84 "DELETE /v2.0/ports/e795cd0b-ae34-4489-9acc-774faf0d6935 HTTP/1.1" status: 204 len: 173 time: 3.1488888 May 12 15:20:42.212905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] No DVR routers for this DVR port cb3f781a-af80-49ef-94ce-4b6c70830c97 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:42.261045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Port': ['ID=cb3f781a-af80-49ef-94ce-4b6c70830c97,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:42.282051 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e795cd0b-ae34-4489-9acc-774faf0d6935 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:42.336663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '91efc3d2-c9e0-4867-98a8-80db504551ad', 'name': 'network-vif-deleted', 'tag': 'e795cd0b-ae34-4489-9acc-774faf0d6935'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:42.557986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d9b0b3a1-135f-40f5-a039-48682caececf tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Deleting port a791c1da-d5c6-42db-89a7-413eb8230f3b {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:42.558360 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9b0b3a1-135f-40f5-a039-48682caececf tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:42.587498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: e795cd0b-ae34-4489-9acc-774faf0d6935 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:20:42.587979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e795cd0b-ae34-4489-9acc-774faf0d6935 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:20:42.691309 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:42.740632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['72b18c14-a959-4cae-9582-f9d6877fbe33']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:42.756304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '83cf33ba-8af3-43e0-ab16-cb420b840652') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:42.756970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '83cf33ba-8af3-43e0-ab16-cb420b840652') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:42.770708 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:42.794141 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:42.801174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Releasing vlan 580 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:20:42.801942 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:42.893096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33798) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:42.922447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b1c96818-c925-4270-bdd7-009236fe7917 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Request body: {'router': {'name': 'tempest-router--1966362508', 'project_id': '3cf671c3821b43b78ba03dc12b8ab49a'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:42.961803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b1c96818-c925-4270-bdd7-009236fe7917 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:43.128689 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: timer() May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:20:43.140049 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:20:43.161423 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9b0b3a1-135f-40f5-a039-48682caececf tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.161423 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9b0b3a1-135f-40f5-a039-48682caececf tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.161878 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.166577 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0fc337cd-450e-45e8-9782-87e609fc0fa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.258425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 77d485e0-c0f7-452a-ba64-2ff75661cddd completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:43.336361 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 77d485e0-c0f7-452a-ba64-2ff75661cddd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:43.336728 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.348450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b1c96818-c925-4270-bdd7-009236fe7917 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Usage tracker for resource:router and tenant:3cf671c3821b43b78ba03dc12b8ab49a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:43.374826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d9b0b3a1-135f-40f5-a039-48682caececf tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Calling delete_port for a791c1da-d5c6-42db-89a7-413eb8230f3b owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:43.451998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b1c96818-c925-4270-bdd7-009236fe7917 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:43.481190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b1c96818-c925-4270-bdd7-009236fe7917 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:43.528445 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b1c96818-c925-4270-bdd7-009236fe7917 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.529417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b1c96818-c925-4270-bdd7-009236fe7917 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.569006 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.570078 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b1c96818-c925-4270-bdd7-009236fe7917 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.590540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Network': ['ID=72b18c14-a959-4cae-9582-f9d6877fbe33,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:43.598998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9f1f6f1e-0fec-4a1c-b3a5-60e0b44139b2 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/networks/72b18c14-a959-4cae-9582-f9d6877fbe33 HTTP/1.1" status: 204 len: 168 time: 9.7738440 May 12 15:20:43.604382 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33812) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:43.610594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1208331709'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:43.623600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:43.629699 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b1c96818-c925-4270-bdd7-009236fe7917 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.633677 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.718241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Usage tracker for resource:network and tenant:474c82a3dfe24a42ae9d88d67006b265 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:43.731390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Quota usage for network was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:43.736087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 77d485e0-c0f7-452a-ba64-2ff75661cddd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=77d485e0-c0f7-452a-ba64-2ff75661cddd,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:43.748729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Attempting to bind port 803ac615-40d5-4393-abcc-712ad84a11ed on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:20:43.749163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Attempting to bind port 803ac615-40d5-4393-abcc-712ad84a11ed by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'dbf5199c-277c-4a55-97b5-ab215591dbbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:20:43.749600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Attempting to bind port 803ac615-40d5-4393-abcc-712ad84a11ed on network 670dbecd-f547-4abf-b069-62f0c8712c6b {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:20:43.752784 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.770926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:43.774903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Port 803ac615-40d5-4393-abcc-712ad84a11ed on network 670dbecd-f547-4abf-b069-62f0c8712c6b not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:20:43.775788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Attempting to bind port 803ac615-40d5-4393-abcc-712ad84a11ed on network 670dbecd-f547-4abf-b069-62f0c8712c6b {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:20:43.776073 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b1c96818-c925-4270-bdd7-009236fe7917 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.780733 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b1c96818-c925-4270-bdd7-009236fe7917 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 723 time: 0.8823617 May 12 15:20:43.782355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33824) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:43.796079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Pushing event updated for resources: {'Port': ['ID=803ac615-40d5-4393-abcc-712ad84a11ed,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:43.809571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Made reservation on behalf of 474c82a3dfe24a42ae9d88d67006b265 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:43.817567 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.856407 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9b0b3a1-135f-40f5-a039-48682caececf tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.866769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 860dc344-70ad-4ff8-9592-ee8e988a4f26 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:43.882571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 20, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:20:43.882914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Checking segment: {'id': 'dbf5199c-277c-4a55-97b5-ab215591dbbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:43.883461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Bound using segment: {'id': 'dbf5199c-277c-4a55-97b5-ab215591dbbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:20:43.883968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Bound port: 803ac615-40d5-4393-abcc-712ad84a11ed, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dbf5199c-277c-4a55-97b5-ab215591dbbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:20:43.884466 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:43.896153 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-a4cf3393-e365-409d-b631-a6394e7a60e9 service neutron] 10.222.0.82 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.8153496 May 12 15:20:43.986278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 562} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:20:43.988554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=77d485e0-c0f7-452a-ba64-2ff75661cddd,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:43.992502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 860dc344-70ad-4ff8-9592-ee8e988a4f26 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:43.992872 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.019328 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.020071 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Added segment 8e38f702-5f8a-4007-9036-e58a5340df3d of type vlan for network 456e06c5-b128-42dd-9173-117bbe50ba11 May 12 15:20:44.082286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9b0b3a1-135f-40f5-a039-48682caececf tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event deleted for resources: {'Port': ['ID=a791c1da-d5c6-42db-89a7-413eb8230f3b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:44.152780 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.178682 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-774dec3f-cf4b-4223-a9ce-2007aa446b9a tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.286351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.291919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:44.292507 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.310992 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.358763 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-33850fd8-4fd1-41f3-a1c4-7d6f10f41865'] response: {'server_uuid': '91efc3d2-c9e0-4867-98a8-80db504551ad', 'name': 'network-vif-deleted', 'tag': 'e795cd0b-ae34-4489-9acc-774faf0d6935', 'status': 'completed', 'code': 200} May 12 15:20:44.389442 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:44.422226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:44.435764 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.547995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'Network': ['ID=456e06c5-b128-42dd-9173-117bbe50ba11,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:44.555104 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9b0b3a1-135f-40f5-a039-48682caececf tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.564889 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9b0b3a1-135f-40f5-a039-48682caececf tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.567127 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d9b0b3a1-135f-40f5-a039-48682caececf tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "DELETE /v2.0/floatingips/dfa393cb-fc56-4e68-84b5-0cc2616fa159 HTTP/1.1" status: 204 len: 168 time: 2.4651682 May 12 15:20:44.574646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33846) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:44.588531 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-eb0c252a-5354-4163-9e55-5a253bc58b78 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.9827044 May 12 15:20:44.634841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33856) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:44.663258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Request body: {'subnet': {'network_id': '456e06c5-b128-42dd-9173-117bbe50ba11', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:44.700121 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-774dec3f-cf4b-4223-a9ce-2007aa446b9a tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.702676 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-774dec3f-cf4b-4223-a9ce-2007aa446b9a tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.734445 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:44.738226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 456e06c5-b128-42dd-9173-117bbe50ba11 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:20:44.786630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c6df60d6-4ebe-4052-8734-be5085ca1eec tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Deleting port 85b4d43d-f235-4852-bda9-2dc870bb3d11 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:44.787057 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6df60d6-4ebe-4052-8734-be5085ca1eec tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.798795 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-774dec3f-cf4b-4223-a9ce-2007aa446b9a tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.799215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-774dec3f-cf4b-4223-a9ce-2007aa446b9a tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 68d92c1e-622b-4716-a5d7-c87f1de825ad {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:20:44.882576 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3f593c0-8984-486a-94ca-aba3bc4d495a req-d06eb030-9674-4fe9-b29f-3ca11f1431e0 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 210 time: 0.1247511 May 12 15:20:44.891840 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-774dec3f-cf4b-4223-a9ce-2007aa446b9a tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:44.905961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-774dec3f-cf4b-4223-a9ce-2007aa446b9a tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "DELETE /v2.0/routers/68d92c1e-622b-4716-a5d7-c87f1de825ad HTTP/1.1" status: 204 len: 168 time: 1.1105213 May 12 15:20:44.913876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] For port 803ac615-40d5-4393-abcc-712ad84a11ed, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:20:44.925135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] For port 803ac615-40d5-4393-abcc-712ad84a11ed, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=803ac615-40d5-4393-abcc-712ad84a11ed,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:20:44.945075 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:45.062117 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1642b8ae-86be-41d8-a2ad-2f2290be92bb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:45.089897 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1fffbae5-912a-4f4e-b839-0046f1807725'] response: {'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'code': 200} May 12 15:20:45.107243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b51a4c3-80cd-48e0-80db-3278e98fda57 req-8c5b1068-6f6a-4762-a923-c34e4c09a284 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:45.120573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b51a4c3-80cd-48e0-80db-3278e98fda57 req-8c5b1068-6f6a-4762-a923-c34e4c09a284 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 943 time: 1.2069502 May 12 15:20:45.170334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33866) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:45.193881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:45.194678 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:45.197012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-18697d92-4670-4d65-be61-f0e823752930 service neutron] 10.222.0.76 "PUT /v2.0/ports/803ac615-40d5-4393-abcc-712ad84a11ed HTTP/1.1" status: 200 len: 1091 time: 6.5438702 May 12 15:20:45.238675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'de22b0a8-a494-4711-8630-31192ae0cb77', 'tag': '803ac615-40d5-4393-abcc-712ad84a11ed'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:45.322466 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b51a4c3-80cd-48e0-80db-3278e98fda57 req-e0b91aa3-61f2-4fa6-81e1-c9bdc645353b tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2005088 May 12 15:20:45.364043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18697d92-4670-4d65-be61-f0e823752930 service neutron] Pushing event updated for resources: {'Port': ['ID=803ac615-40d5-4393-abcc-712ad84a11ed,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:45.485037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:45.496526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Usage tracker for resource:subnet and tenant:474c82a3dfe24a42ae9d88d67006b265 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:45.501454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:45.514275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:45.544788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Made reservation on behalf of 474c82a3dfe24a42ae9d88d67006b265 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:45.551162 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:45.647073 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2d11117c-9068-4696-a8c0-ba4954423860'] response: {'name': 'network-changed', 'server_uuid': 'de22b0a8-a494-4711-8630-31192ae0cb77', 'tag': '803ac615-40d5-4393-abcc-712ad84a11ed', 'status': 'completed', 'code': 200} May 12 15:20:45.655554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-66226f05-9328-4265-9f9a-ef662f8ac1c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:45.657045 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-66226f05-9328-4265-9f9a-ef662f8ac1c5 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=4789db12ded14c2e8773d2396c9acd32&device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 1094 time: 0.2743390 May 12 15:20:45.771906 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6df60d6-4ebe-4052-8734-be5085ca1eec tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:45.775031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-116926b7-ccff-4f78-ab7e-92c5778a5484 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=803ac615-40d5-4393-abcc-712ad84a11ed HTTP/1.1" status: 200 len: 217 time: 0.0885220 May 12 15:20:45.887736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-596811065', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}, 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:45.901702 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 77d485e0-c0f7-452a-ba64-2ff75661cddd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:45.912871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:45.934271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce26fbe6-abd2-4526-9d4b-3ce004a9bb4d req-05ca6268-efe3-4f61-85b5-6f7283f4f966 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:45.948408 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce26fbe6-abd2-4526-9d4b-3ce004a9bb4d req-05ca6268-efe3-4f61-85b5-6f7283f4f966 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 948 time: 0.3903615 May 12 15:20:45.972454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Usage tracker for resource:router and tenant:e87ae982708240299f16d4cfc5f73d5d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:45.978298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:45.996228 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:46.006166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-942971f9-7191-44da-8c18-656d44dd2fc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:46.011413 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-942971f9-7191-44da-8c18-656d44dd2fc8 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5a24db8d-fb66-4b7f-bf96-50956cb218fd HTTP/1.1" status: 200 len: 862 time: 0.2250397 May 12 15:20:46.048827 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:46.063864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c6df60d6-4ebe-4052-8734-be5085ca1eec tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Calling delete_port for 85b4d43d-f235-4852-bda9-2dc870bb3d11 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:46.073928 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 77d485e0-c0f7-452a-ba64-2ff75661cddd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:46.074546 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:46.176482 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:46.395226 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce26fbe6-abd2-4526-9d4b-3ce004a9bb4d req-fe8088df-e651-4827-9196-9f1fa22e7408 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/security-groups?id=741e94d4-5b74-4583-8ee0-e67ced7944a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4450758 May 12 15:20:46.437676 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-5520b562-d743-4542-80cb-abe3af9eab0a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=670dbecd-f547-4abf-b069-62f0c8712c6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.4113233 May 12 15:20:46.445184 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:46.447098 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:46.479203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:46.676004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-8d611233-142f-4e27-bfcd-ed71d3acc46d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:46.678429 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-8d611233-142f-4e27-bfcd-ed71d3acc46d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.84 "GET /v2.0/networks?id=2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 200 len: 817 time: 0.5047598 May 12 15:20:46.697552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f134ac7e-a7c6-4af9-9a71-9d19fb409536 req-de02e728-5273-4bc8-844d-48edafa4d498 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:46.697927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'Subnet': ['ID=1b3d33d6-162f-4b6a-ac94-8221aa7af0be,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:46.705787 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f134ac7e-a7c6-4af9-9a71-9d19fb409536 req-de02e728-5273-4bc8-844d-48edafa4d498 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 946 time: 0.8762124 May 12 15:20:46.731758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Checking segment: {'id': '8e38f702-5f8a-4007-9036-e58a5340df3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '456e06c5-b128-42dd-9173-117bbe50ba11'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:46.732114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Network hostable DHCP agents. Network: 456e06c5-b128-42dd-9173-117bbe50ba11, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:20:46.739192 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6df60d6-4ebe-4052-8734-be5085ca1eec tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:46.746275 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-86b16975-c7a7-43d5-8790-9340cc0e21f4 service neutron] 10.222.0.76 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2904897 May 12 15:20:46.753307 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b0e643f1-5643-4d85-b908-ea9e22d135fb req-2bd6fd10-f608-4c85-8992-9e84d15f39f3 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 210 time: 0.1499100 May 12 15:20:46.806232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6df60d6-4ebe-4052-8734-be5085ca1eec tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event deleted for resources: {'Port': ['ID=85b4d43d-f235-4852-bda9-2dc870bb3d11,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:46.881461 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:46.918301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-3f4b2061-153b-4e13-a320-3c77a319a53c tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Synchronizing usage tracker for tenant:40852c97262142aeb6d62097955af83f on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:20:46.931538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Network 456e06c5-b128-42dd-9173-117bbe50ba11 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:20:46.959625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-3f4b2061-153b-4e13-a320-3c77a319a53c tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Unset dirty status for tenant:40852c97262142aeb6d62097955af83f on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:20:46.961994 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-3f4b2061-153b-4e13-a320-3c77a319a53c tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=40852c97262142aeb6d62097955af83f HTTP/1.1" status: 200 len: 379 time: 0.2541089 May 12 15:20:46.972991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Request body: {'port': {'device_id': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'admin_state_up': True, 'tenant_id': '40852c97262142aeb6d62097955af83f', 'security_groups': ['113e667d-ea29-4a75-8d4e-1be835a567e4']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:46.984376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f134ac7e-a7c6-4af9-9a71-9d19fb409536 req-2aaa7b19-5b37-4b11-bc82-c1ce46051f0a tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2768695 May 12 15:20:46.998139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 456e06c5-b128-42dd-9173-117bbe50ba11) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:47.009646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:47.010019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94a490c5-12d3-4904-9113-e48d0a06f9d1 None None] Network 456e06c5-b128-42dd-9173-117bbe50ba11 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:47.010566 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:47.060613 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6df60d6-4ebe-4052-8734-be5085ca1eec tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:47.152450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae3378a-510d-4e53-82df-61ffd9fe175a req-d7d47e3f-4fd8-45af-ab7e-24ae034f5594 service neutron] 10.222.0.76 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3888788 May 12 15:20:47.205064 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c341671e-a3e5-49ab-82c1-794b06d15b7a no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:47.243733 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c6df60d6-4ebe-4052-8734-be5085ca1eec tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "DELETE /v2.0/ports/85b4d43d-f235-4852-bda9-2dc870bb3d11 HTTP/1.1" status: 204 len: 168 time: 2.6583557 May 12 15:20:47.297733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33906) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:47.334876 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-270d2b4d-4603-43d5-b8bc-95cb9153aa64 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 2.6916170 May 12 15:20:47.341980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33912) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:47.351545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:47.397517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Usage tracker for resource:port and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:47.409153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:47.543802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-75656ff9-e109-46dc-bd63-34d37dd7b803 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Deleting port ef28df6f-7573-4910-9fae-c2b49092303b {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:47.544436 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75656ff9-e109-46dc-bd63-34d37dd7b803 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:47.558548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:47.643982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fbbcb57-d49a-4224-a6cc-92640bc6ceea req-1a1ea95e-a96a-4bf2-af37-3c1202ffd1d3 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:47.649907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-6fbbcb57-d49a-4224-a6cc-92640bc6ceea req-1a1ea95e-a96a-4bf2-af37-3c1202ffd1d3 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Synchronizing usage tracker for tenant:07c1472fa162425e9303d95e5e843c64 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:20:47.660200 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:47.677008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Made reservation on behalf of 40852c97262142aeb6d62097955af83f for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:47.680605 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:47.717147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-456e06c5-b128-42dd-9173-117bbe50ba11', 'network_id': '456e06c5-b128-42dd-9173-117bbe50ba11', 'tenant_id': '474c82a3dfe24a42ae9d88d67006b265', 'fixed_ips': [{'subnet_id': '1b3d33d6-162f-4b6a-ac94-8221aa7af0be'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:20:47.718565 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:47.741185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af3420e-e515-4e8a-a1c5-a6067a03d8d3 req-c0fe969e-4b87-4360-b07c-912c7da3752f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:47.748466 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3af3420e-e515-4e8a-a1c5-a6067a03d8d3 req-c0fe969e-4b87-4360-b07c-912c7da3752f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 943 time: 0.8273752 May 12 15:20:47.764266 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:47.767003 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:47.833930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c341671e-a3e5-49ab-82c1-794b06d15b7a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:47.845251 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3af3420e-e515-4e8a-a1c5-a6067a03d8d3 req-c0be18ad-d7e0-4d5f-b833-de874fd3750c tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0915904 May 12 15:20:47.957836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c341671e-a3e5-49ab-82c1-794b06d15b7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:47.976384 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:48.026683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-6fbbcb57-d49a-4224-a6cc-92640bc6ceea req-1a1ea95e-a96a-4bf2-af37-3c1202ffd1d3 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Unset dirty status for tenant:07c1472fa162425e9303d95e5e843c64 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:20:48.028188 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6fbbcb57-d49a-4224-a6cc-92640bc6ceea req-1a1ea95e-a96a-4bf2-af37-3c1202ffd1d3 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.76 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 946 time: 0.9413114 May 12 15:20:48.145871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0bba5ef0-0c45-404e-8342-50f1d172c8e8 req-8f9e6238-fdef-4255-ba05-9708ac7772a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 210 time: 0.0841827 May 12 15:20:48.201258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-322875b4-bdd5-4e05-b399-b0a3a8b742ff req-d6488b04-8ebf-44cc-8449-f714e6376d24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:48.207221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-322875b4-bdd5-4e05-b399-b0a3a8b742ff req-d6488b04-8ebf-44cc-8449-f714e6376d24 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=4789db12ded14c2e8773d2396c9acd32&device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 1094 time: 0.9063609 May 12 15:20:48.250837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Allocated IP 172.20.0.13 (2d986451-1d91-468d-8a9c-ecc4da7a86bc/5f6d45f7-b8bc-4313-879f-ee173c0a4148/4a88f583-55ea-4849-8a87-dbc693ed07d0) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:48.326886 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-630f8cd1-4990-4f11-9723-71c5f6ec95f8'] response: {'server_uuid': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c341671e-a3e5-49ab-82c1-794b06d15b7a', 'code': 200} May 12 15:20:48.476334 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c341671e-a3e5-49ab-82c1-794b06d15b7a,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:48.505203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Allocated IP 2001:db8::2 (456e06c5-b128-42dd-9173-117bbe50ba11/1b3d33d6-162f-4b6a-ac94-8221aa7af0be/7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:48.893055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:48.896437 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:48.912202 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Transition to ACTIVE for port object 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:48.938458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Transition to ACTIVE for port object 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:48.955599 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:49.034374 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:49.037618 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Network 456e06c5-b128-42dd-9173-117bbe50ba11 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:49.041421 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:49.044326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:49.098762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Pushing event updated for resources: {'Port': ['ID=7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:49.102995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-6fbbcb57-d49a-4224-a6cc-92640bc6ceea req-464a7e21-2318-4ce4-ae44-f2498ded29a1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Deleting port 2a00c7fc-ced7-44c0-b374-110741ae6468 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:49.103541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6fbbcb57-d49a-4224-a6cc-92640bc6ceea req-464a7e21-2318-4ce4-ae44-f2498ded29a1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:49.113087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-322875b4-bdd5-4e05-b399-b0a3a8b742ff req-6362d1cf-2aeb-4c20-bf30-afd80e1a58a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:49.114752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-322875b4-bdd5-4e05-b399-b0a3a8b742ff req-6362d1cf-2aeb-4c20-bf30-afd80e1a58a1 service neutron] 10.222.0.76 "GET /v2.0/networks?id=670dbecd-f547-4abf-b069-62f0c8712c6b HTTP/1.1" status: 200 len: 923 time: 0.8576877 May 12 15:20:49.118130 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75656ff9-e109-46dc-bd63-34d37dd7b803 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:49.167586 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Attempting to bind port 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:20:49.167953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Attempting to bind port 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '8e38f702-5f8a-4007-9036-e58a5340df3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '456e06c5-b128-42dd-9173-117bbe50ba11'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:20:49.168312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Attempting to bind port 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 on network 456e06c5-b128-42dd-9173-117bbe50ba11 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:20:49.175486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 20, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:20:49.176122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Checking segment: {'id': '8e38f702-5f8a-4007-9036-e58a5340df3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '456e06c5-b128-42dd-9173-117bbe50ba11'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:49.176526 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:49.176911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Bound using segment: {'id': '8e38f702-5f8a-4007-9036-e58a5340df3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '456e06c5-b128-42dd-9173-117bbe50ba11'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:20:49.177379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Bound port: 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8e38f702-5f8a-4007-9036-e58a5340df3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '456e06c5-b128-42dd-9173-117bbe50ba11'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:20:49.177771 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:49.275105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9127343-2597-4bbf-9ce3-a18ae36ad2b2 req-f2ada9e8-1595-40ed-a0ea-44811b8356cf tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:49.281918 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9127343-2597-4bbf-9ce3-a18ae36ad2b2 req-f2ada9e8-1595-40ed-a0ea-44811b8356cf tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 946 time: 0.8340492 May 12 15:20:49.418895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] For port 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:20:49.474875 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] For port 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61,segment=NetworkSegment(8e38f702-5f8a-4007-9036-e58a5340df3d),segment_id=8e38f702-5f8a-4007-9036-e58a5340df3d)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:20:49.504663 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:49.587223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:49.616057 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-322875b4-bdd5-4e05-b399-b0a3a8b742ff req-ae2181c9-2fac-4a0d-a25a-b27d382f72b2 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=803ac615-40d5-4393-abcc-712ad84a11ed HTTP/1.1" status: 200 len: 217 time: 0.4743152 May 12 15:20:49.652147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-75656ff9-e109-46dc-bd63-34d37dd7b803 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Calling delete_port for ef28df6f-7573-4910-9fae-c2b49092303b owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:49.654937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Transition to ACTIVE for port object 4a88f583-55ea-4849-8a87-dbc693ed07d0 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:49.678820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1099ebe2-6a3c-496a-b4dc-1686dfcde9d0 None None] Pushing event updated for resources: {'Port': ['ID=7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:49.708888 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:49.774587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Subnet': ['ID=1b3d33d6-162f-4b6a-ac94-8221aa7af0be,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:49.919546 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:49.950477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['456e06c5-b128-42dd-9173-117bbe50ba11']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:49.964496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8e38f702-5f8a-4007-9036-e58a5340df3d') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:49.964876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8e38f702-5f8a-4007-9036-e58a5340df3d') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:49.988145 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:50.009632 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:50.022020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Releasing vlan 562 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:20:50.022504 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:50.051876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9127343-2597-4bbf-9ce3-a18ae36ad2b2 req-b0adf39a-1161-4afd-bf39-fe02b494745d tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/security-groups?id=fd2954d6-4234-4a13-a827-ff9f705a5cfa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7690961 May 12 15:20:50.057334 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: timer() May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:20:50.133447 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:20:50.137088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-322875b4-bdd5-4e05-b399-b0a3a8b742ff req-7cc2ba7d-9a35-4712-bd6a-6c058e48c62a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:50.139134 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-322875b4-bdd5-4e05-b399-b0a3a8b742ff req-7cc2ba7d-9a35-4712-bd6a-6c058e48c62a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5a24db8d-fb66-4b7f-bf96-50956cb218fd HTTP/1.1" status: 200 len: 862 time: 0.4443092 May 12 15:20:50.142900 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:50.147041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6fbbcb57-d49a-4224-a6cc-92640bc6ceea req-464a7e21-2318-4ce4-ae44-f2498ded29a1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] For port 2a00c7fc-ced7-44c0-b374-110741ae6468, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2a00c7fc-ced7-44c0-b374-110741ae6468,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:50.147507 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6fbbcb57-d49a-4224-a6cc-92640bc6ceea req-464a7e21-2318-4ce4-ae44-f2498ded29a1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:50.164707 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') May 12 15:20:50.164707 n-d-841483-1 neutron-server[88151]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] May 12 15:20:50.164707 n-d-841483-1 neutron-server[88151]: [parameters: {'id': '456e06c5-b128-42dd-9173-117bbe50ba11'}] May 12 15:20:50.164707 n-d-841483-1 neutron-server[88151]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:20:50.165157 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:20:50.169984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:50.319616 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-322875b4-bdd5-4e05-b399-b0a3a8b742ff req-99772f7e-24de-4d2a-a295-2fd45de466d8 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=670dbecd-f547-4abf-b069-62f0c8712c6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1681519 May 12 15:20:50.326945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event updated for resources: {'Port': ['ID=4a88f583-55ea-4849-8a87-dbc693ed07d0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:50.401198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-6fbbcb57-d49a-4224-a6cc-92640bc6ceea req-464a7e21-2318-4ce4-ae44-f2498ded29a1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Calling delete_port for 2a00c7fc-ced7-44c0-b374-110741ae6468 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:50.457767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dba1436-c280-4d6e-b38e-d899550d6a2c req-05b26351-78aa-49c5-9a61-39d891b7a801 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:50.464787 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4dba1436-c280-4d6e-b38e-d899550d6a2c req-05b26351-78aa-49c5-9a61-39d891b7a801 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 943 time: 0.7687395 May 12 15:20:50.471055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Network 2d986451-1d91-468d-8a9c-ecc4da7a86bc is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:50.474821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:50.483010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:50.615471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:50.616138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:50.641816 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4dba1436-c280-4d6e-b38e-d899550d6a2c req-12645cf2-ff26-479e-b882-429f1e80ab55 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1758966 May 12 15:20:50.666727 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:50.737059 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-d399ebe8-b8b0-4b7c-bba5-048eae44e9a7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.7678177 May 12 15:20:50.752100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Deleting port 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:50.752324 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:50.808707 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75656ff9-e109-46dc-bd63-34d37dd7b803 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:50.858998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Request body: {'port': {'device_id': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:50.914831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-09f4bfe3-1c16-4a69-8b9e-7d55f1cb9184 None None] Provisioning for port 4a88f583-55ea-4849-8a87-dbc693ed07d0 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:50.923222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-09f4bfe3-1c16-4a69-8b9e-7d55f1cb9184 None None] Provisioning complete for port 4a88f583-55ea-4849-8a87-dbc693ed07d0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:50.923712 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-09f4bfe3-1c16-4a69-8b9e-7d55f1cb9184 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:50.932972 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6fbbcb57-d49a-4224-a6cc-92640bc6ceea req-464a7e21-2318-4ce4-ae44-f2498ded29a1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:50.944766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1e4794a-6482-433d-af79-b141b1ca9d98 req-a2965dba-cec4-43d3-a5ce-1e25cc00df28 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:50.954173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f1e4794a-6482-433d-af79-b141b1ca9d98 req-a2965dba-cec4-43d3-a5ce-1e25cc00df28 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 932 time: 0.6554914 May 12 15:20:50.976572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Allocated IP 172.25.8.44 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/9fb302e9-6f6c-4b61-b81f-d0ffbf3a07ff) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:20:50.978967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75656ff9-e109-46dc-bd63-34d37dd7b803 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event deleted for resources: {'Port': ['ID=ef28df6f-7573-4910-9fae-c2b49092303b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:50.982650 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-322875b4-bdd5-4e05-b399-b0a3a8b742ff req-81c9fb22-f9c7-4a44-98b8-32a3e7cb929d service neutron] 10.222.0.76 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6455228 May 12 15:20:51.033323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-464a7e21-2318-4ce4-ae44-f2498ded29a1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Pushing event deleted for resources: {'Port': ['ID=2a00c7fc-ced7-44c0-b374-110741ae6468,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:51.071911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-09f4bfe3-1c16-4a69-8b9e-7d55f1cb9184 None None] Port 4a88f583-55ea-4849-8a87-dbc693ed07d0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:20:51.185832 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:51.212713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 803ac615-40d5-4393-abcc-712ad84a11ed details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:20:51.512661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 2a00c7fc-ced7-44c0-b374-110741ae6468 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:51.571982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 2a00c7fc-ced7-44c0-b374-110741ae6468 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:20:51.572678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 2a00c7fc-ced7-44c0-b374-110741ae6468 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:20:51.576831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7bde5e8-34f6-43c2-9352-11d7b407152f None None] Network 456e06c5-b128-42dd-9173-117bbe50ba11 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:51.598358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-6fbbcb57-d49a-4224-a6cc-92640bc6ceea req-464a7e21-2318-4ce4-ae44-f2498ded29a1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] No DVR routers for this DVR port 2a00c7fc-ced7-44c0-b374-110741ae6468 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:51.664727 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6fbbcb57-d49a-4224-a6cc-92640bc6ceea req-464a7e21-2318-4ce4-ae44-f2498ded29a1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:51.666774 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6fbbcb57-d49a-4224-a6cc-92640bc6ceea req-464a7e21-2318-4ce4-ae44-f2498ded29a1 tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.76 "DELETE /v2.0/ports/2a00c7fc-ced7-44c0-b374-110741ae6468 HTTP/1.1" status: 204 len: 173 time: 2.8156002 May 12 15:20:51.667226 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dddc3497-3d22-480f-bded-055cda976c60', 'name': 'network-vif-deleted', 'tag': '2a00c7fc-ced7-44c0-b374-110741ae6468'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:51.780493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4825cd5d-b11b-47c1-89c0-14f4d74c1d56 None None] Provisioning for port 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:51.989526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] For port 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61,segment=NetworkSegment(8e38f702-5f8a-4007-9036-e58a5340df3d),segment_id=8e38f702-5f8a-4007-9036-e58a5340df3d)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:51.990097 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:51.991896 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:52.068858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 803ac615-40d5-4393-abcc-712ad84a11ed, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=803ac615-40d5-4393-abcc-712ad84a11ed,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:52.099250 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '803ac615-40d5-4393-abcc-712ad84a11ed', 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b', 'port_id': '803ac615-40d5-4393-abcc-712ad84a11ed', 'mac_address': 'fa:16:3e:46:46:04', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 589, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5a24db8d-fb66-4b7f-bf96-50956cb218fd', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:20:52.124259 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:52.156094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Calling delete_port for 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:52.171551 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:52.192379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 803ac615-40d5-4393-abcc-712ad84a11ed {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:20:52.196496 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:52.207323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:52.207831 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:52.208430 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75656ff9-e109-46dc-bd63-34d37dd7b803 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:52.227542 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-322875b4-bdd5-4e05-b399-b0a3a8b742ff req-5760cc9c-3858-46cc-b73d-d44bd4b7c915 service neutron] 10.222.0.76 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.2377253 May 12 15:20:52.257892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-75656ff9-e109-46dc-bd63-34d37dd7b803 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "DELETE /v2.0/ports/ef28df6f-7573-4910-9fae-c2b49092303b HTTP/1.1" status: 204 len: 168 time: 4.9432409 May 12 15:20:52.259374 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:52.263445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34010) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:52.349798 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:52.366317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 803ac615-40d5-4393-abcc-712ad84a11ed, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=803ac615-40d5-4393-abcc-712ad84a11ed,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:52.391522 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:52.417644 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f1e4794a-6482-433d-af79-b141b1ca9d98 req-f1ded97d-a8e2-4890-ae4a-c23a56f31492 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 1.4624288 May 12 15:20:52.480747 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Port': ['ID=7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:52.482999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Pushing event updated for resources: {'Port': ['ID=9fb302e9-6f6c-4b61-b81f-d0ffbf3a07ff,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:52.488973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] No DVR routers for this DVR port 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:52.491021 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:20:52.516738 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-464b55b8-889a-4227-bd3b-fca07d20d9e3 req-9e1a7b2b-ed0b-4305-b18f-24d88fa5e02b tempest-ListServerFiltersTestJSON-1746953655 tempest-ListServerFiltersTestJSON-1746953655-project] 10.222.0.82 "GET /v2.0/ports?device_id=dddc3497-3d22-480f-bded-055cda976c60 HTTP/1.1" status: 200 len: 210 time: 0.3562598 May 12 15:20:52.573998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:20:52.587250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:52.594957 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:20:52.614262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Could not find standard attr ID for object 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:20:52.616876 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a581c89c-e0fd-4219-bf41-f1b6f0a58eee None None] DHCP port deletion for 456e06c5-b128-42dd-9173-117bbe50ba11 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:20:52.628274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=803ac615-40d5-4393-abcc-712ad84a11ed,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:52.640382 n-d-841483-1 neutron-server[88153]: INFO neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No ports have port_id starting with 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 May 12 15:20:52.698698 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3ee27d11-c4c5-4572-8834-8a5f6c1c9ab3'] response: {'server_uuid': 'dddc3497-3d22-480f-bded-055cda976c60', 'name': 'network-vif-deleted', 'tag': '2a00c7fc-ced7-44c0-b374-110741ae6468', 'status': 'completed', 'code': 200} May 12 15:20:52.726676 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['803ac615-40d5-4393-abcc-712ad84a11ed'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:20:52.748704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-6d9d4d2b-bc14-4958-b2a0-de103ac486a0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Deleting subnet 6457d378-be74-408c-98d5-b411738c6998 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:20:52.753839 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d9d4d2b-bc14-4958-b2a0-de103ac486a0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:52.841233 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:52.885339 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4a88f583-55ea-4849-8a87-dbc693ed07d0 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:20:52.895614 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:52.929865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Transition to ACTIVE for port object 4a88f583-55ea-4849-8a87-dbc693ed07d0 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:20:52.933997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['456e06c5-b128-42dd-9173-117bbe50ba11']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:52.961241 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:53.006911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8e38f702-5f8a-4007-9036-e58a5340df3d') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:53.007564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8e38f702-5f8a-4007-9036-e58a5340df3d') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:53.051529 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d9d4d2b-bc14-4958-b2a0-de103ac486a0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:53.109417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:53.158131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Pushing event updated for resources: {'Port': ['ID=4a88f583-55ea-4849-8a87-dbc693ed07d0,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:53.161943 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:53.213723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c341671e-a3e5-49ab-82c1-794b06d15b7a details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:20:53.241017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Releasing vlan 562 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:20:53.241531 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: timer() May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:20:53.257504 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:20:53.323816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55b4a68a-e383-4337-bc1a-bb38e4797ad3 req-9c58c542-800e-43b8-b30a-195c634d4058 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:53.337967 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55b4a68a-e383-4337-bc1a-bb38e4797ad3 req-9c58c542-800e-43b8-b30a-195c634d4058 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 944 time: 0.5550756 May 12 15:20:53.430961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Attempting to bind port 4a88f583-55ea-4849-8a87-dbc693ed07d0 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:20:53.431254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Attempting to bind port 4a88f583-55ea-4849-8a87-dbc693ed07d0 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:20:53.431596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Attempting to bind port 4a88f583-55ea-4849-8a87-dbc693ed07d0 on network 2d986451-1d91-468d-8a9c-ecc4da7a86bc {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:20:53.447054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Port 4a88f583-55ea-4849-8a87-dbc693ed07d0 on network 2d986451-1d91-468d-8a9c-ecc4da7a86bc not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:20:53.447373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Attempting to bind port 4a88f583-55ea-4849-8a87-dbc693ed07d0 on network 2d986451-1d91-468d-8a9c-ecc4da7a86bc {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:20:53.457479 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:53.470156 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:53.515687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 20, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:20:53.516017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Checking segment: {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:53.516328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Bound using segment: {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:20:53.516782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Bound port: 4a88f583-55ea-4849-8a87-dbc693ed07d0, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:20:53.517131 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:53.552989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Network': ['ID=456e06c5-b128-42dd-9173-117bbe50ba11,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:53.559624 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3867b99a-ec9f-4f81-b7e0-29b442f9ec9a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/networks/456e06c5-b128-42dd-9173-117bbe50ba11 HTTP/1.1" status: 204 len: 168 time: 6.2155781 May 12 15:20:53.562348 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55b4a68a-e383-4337-bc1a-bb38e4797ad3 req-bd6ab0ab-e8a1-426d-b892-eb6ad9296207 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2232773 May 12 15:20:53.563300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34038) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:53.617595 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:53.692925 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c341671e-a3e5-49ab-82c1-794b06d15b7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:53.737614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'c341671e-a3e5-49ab-82c1-794b06d15b7a', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'c341671e-a3e5-49ab-82c1-794b06d15b7a', 'mac_address': 'fa:16:3e:d9:ea:a1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:20:53.741232 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d9d4d2b-bc14-4958-b2a0-de103ac486a0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:53.759275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34048) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:53.773449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:20:53.826760 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-823985249'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:53.868913 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:53.914610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c341671e-a3e5-49ab-82c1-794b06d15b7a {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:20:53.927448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:53.987903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:20:53.989946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7dc7a2ab-f369-43f9-b539-8bb3f6c2ec61 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:20:54.012657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c341671e-a3e5-49ab-82c1-794b06d15b7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:54.028465 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:54.123595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c341671e-a3e5-49ab-82c1-794b06d15b7a,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:54.151918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:20:54.164166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-36e27ec8-1b46-4123-822a-a229b4f27fd4 admin admin] Deleting subnet 34e2be1a-2cbe-4227-a0bf-50d20740aa45 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:20:54.167128 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:54.176488 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c341671e-a3e5-49ab-82c1-794b06d15b7a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:20:54.192375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:54.215313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:54.216106 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:54.217499 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] 10.222.0.84 "PUT /v2.0/ports/4a88f583-55ea-4849-8a87-dbc693ed07d0 HTTP/1.1" status: 200 len: 1092 time: 3.3707564 May 12 15:20:54.225551 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-36e27ec8-1b46-4123-822a-a229b4f27fd4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:54.301062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Usage tracker for resource:network and tenant:474c82a3dfe24a42ae9d88d67006b265 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:54.308278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Quota usage for network was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:54.392742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:54.410169 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-36e27ec8-1b46-4123-822a-a229b4f27fd4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:54.463801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0bdb9fd-4d66-4e35-8185-d65ba5801b7b service neutron] Pushing event updated for resources: {'Port': ['ID=4a88f583-55ea-4849-8a87-dbc693ed07d0,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:54.587995 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-36e27ec8-1b46-4123-822a-a229b4f27fd4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:54.650868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-36882b82-e4af-4ae4-ba91-873a1c34ab50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:54.658226 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-36882b82-e4af-4ae4-ba91-873a1c34ab50 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=40852c97262142aeb6d62097955af83f&device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 1095 time: 0.3645816 May 12 15:20:54.737991 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:54.744341 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d9d4d2b-bc14-4958-b2a0-de103ac486a0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:54.784378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Made reservation on behalf of 474c82a3dfe24a42ae9d88d67006b265 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:54.787085 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:54.817890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:54.868892 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-3c88f76c-b669-4d9e-86f3-e9682205efdf service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0 HTTP/1.1" status: 200 len: 217 time: 0.1820016 May 12 15:20:54.996422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 559} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:20:55.027691 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:55.028165 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Added segment da66a25d-ea11-44ee-aba6-96605c1569da of type vlan for network fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0 May 12 15:20:55.061344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-144b9a06-6b84-45f1-8554-8bf7668d1652 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:55.066625 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-144b9a06-6b84-45f1-8554-8bf7668d1652 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5f6d45f7-b8bc-4313-879f-ee173c0a4148 HTTP/1.1" status: 200 len: 856 time: 0.1795375 May 12 15:20:55.099104 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:55.155002 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-36e27ec8-1b46-4123-822a-a229b4f27fd4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:55.209903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c341671e-a3e5-49ab-82c1-794b06d15b7a up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:55.262783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36e27ec8-1b46-4123-822a-a229b4f27fd4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=34e2be1a-2cbe-4227-a0bf-50d20740aa45,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:55.274435 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-36e27ec8-1b46-4123-822a-a229b4f27fd4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:55.281030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87e1fb76-d6b8-47af-9dfc-fbbebe50c8fd None None] Network 0ff32f81-3ca6-41e0-8986-06dbed4ab52d requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:55.310561 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-36e27ec8-1b46-4123-822a-a229b4f27fd4 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/34e2be1a-2cbe-4227-a0bf-50d20740aa45 HTTP/1.1" status: 204 len: 168 time: 1.5475233 May 12 15:20:55.333369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34074) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:55.334034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d9d4d2b-bc14-4958-b2a0-de103ac486a0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event deleted for resources: {'Subnet': ['ID=6457d378-be74-408c-98d5-b411738c6998,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:55.337281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-489607f0-6d59-448c-8ffc-345fc8b4f58a None None] Network c5f75c23-a033-42fa-b7cd-dcbda413fa9a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:55.359627 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d9d4d2b-bc14-4958-b2a0-de103ac486a0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:55.386268 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:55.395816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:55.396453 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:55.528376 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:55.560019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-44c4e7bb-b56f-4fa1-876f-f240f954bc01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:55.562125 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-44c4e7bb-b56f-4fa1-876f-f240f954bc01 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2d986451-1d91-468d-8a9c-ecc4da7a86bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4885950 May 12 15:20:55.794367 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-fe4ea08e-940a-4d44-951a-75dc8a1daa67 service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2202952 May 12 15:20:55.794891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Deleting port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:55.795352 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:55.803660 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'Network': ['ID=fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:55.829156 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6d9d4d2b-bc14-4958-b2a0-de103ac486a0 tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "DELETE /v2.0/subnets/6457d378-be74-408c-98d5-b411738c6998 HTTP/1.1" status: 204 len: 168 time: 3.4164793 May 12 15:20:55.831730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34078) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:55.863283 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:20:55.897203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14829830-0f9a-4d3b-a4fd-26cbaf32fad6 req-9ee4da51-6037-4622-a2c6-458a1233cdba tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:55.901961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14829830-0f9a-4d3b-a4fd-26cbaf32fad6 req-9ee4da51-6037-4622-a2c6-458a1233cdba tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 944 time: 2.2038214 May 12 15:20:55.990271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0a692e61-048a-4a75-afb2-2389c6470203 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 2.3742838 May 12 15:20:55.994688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14829830-0f9a-4d3b-a4fd-26cbaf32fad6 req-b4555301-03c4-4107-8ee6-79c5dc4aec08 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0834749 May 12 15:20:55.998252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34082) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:56.007557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Request body: {'subnet': {'network_id': 'fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:20:56.035528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Router c18d2ea9-5bea-4046-a11f-4e95d84a3b8d is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:20:56.160559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-2303af51-391c-44dc-bc75-7e3430a76e5e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Deleting subnet 722dd775-53fe-4359-9d8f-d74143e5ced9 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:20:56.206099 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port c341671e-a3e5-49ab-82c1-794b06d15b7a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:56.206475 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:56.221911 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2303af51-391c-44dc-bc75-7e3430a76e5e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:56.480626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:20:56.511128 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5029a984-1d9f-42fb-be30-6f833ce1e29f None None] Sync routers for ids ['c18d2ea9-5bea-4046-a11f-4e95d84a3b8d'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:20:56.536197 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5029a984-1d9f-42fb-be30-6f833ce1e29f None None] Routers {'c18d2ea9-5bea-4046-a11f-4e95d84a3b8d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:20:56.536792 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5029a984-1d9f-42fb-be30-6f833ce1e29f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:20:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c18d2ea9-5bea-4046-a11f-4e95d84a3b8d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:56.551632 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2303af51-391c-44dc-bc75-7e3430a76e5e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:56.650346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-686a2812-1606-4158-82c7-84a6b7af26c3 None None] DHCP port deletion for c5f75c23-a033-42fa-b7cd-dcbda413fa9a request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:20:56.700078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8cae617-12c6-49fd-85dc-ef66f5209ad4 None None] DHCP port deletion for 0ff32f81-3ca6-41e0-8986-06dbed4ab52d request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:20:56.707387 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f8cae617-12c6-49fd-85dc-ef66f5209ad4 None None] Deleting port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:56.708092 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f8cae617-12c6-49fd-85dc-ef66f5209ad4 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:56.739581 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5029a984-1d9f-42fb-be30-6f833ce1e29f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:56.743502 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:56.749881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-28df031c-8c5e-4e05-be8d-94ddcb2b54c1 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 883 time: 11.5643070 May 12 15:20:56.756965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34090) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:56.758442 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2303af51-391c-44dc-bc75-7e3430a76e5e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:56.761557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-686a2812-1606-4158-82c7-84a6b7af26c3 None None] Deleting port d775410b-5243-4cfd-98b4-580efdd2099c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:56.761934 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-686a2812-1606-4158-82c7-84a6b7af26c3 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:56.774540 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5029a984-1d9f-42fb-be30-6f833ce1e29f None None] Routers {'c18d2ea9-5bea-4046-a11f-4e95d84a3b8d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:20:56.775167 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5029a984-1d9f-42fb-be30-6f833ce1e29f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:20:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c18d2ea9-5bea-4046-a11f-4e95d84a3b8d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:56.952442 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5029a984-1d9f-42fb-be30-6f833ce1e29f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:20:56.959408 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5029a984-1d9f-42fb-be30-6f833ce1e29f None None] The sync data for ids ['c18d2ea9-5bea-4046-a11f-4e95d84a3b8d'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:20:56.989023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96e49090-03f7-4ed7-902d-2edcfd214d42 req-5bd1b68d-ea37-4b61-8ca8-07f3f2afc4ff tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:56.991033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96e49090-03f7-4ed7-902d-2edcfd214d42 req-5bd1b68d-ea37-4b61-8ca8-07f3f2afc4ff tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 944 time: 0.5067739 May 12 15:20:57.074129 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:57.158424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c341671e-a3e5-49ab-82c1-794b06d15b7a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:20:57.164218 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c13bfdea-5b30-41fb-8317-baae6137c238 req-27db7c05-cddf-4ec3-9b49-57df59a969ed service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.3383002 May 12 15:20:57.174023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2303af51-391c-44dc-bc75-7e3430a76e5e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:57.188134 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96e49090-03f7-4ed7-902d-2edcfd214d42 req-8bf4bb54-0b3d-48d8-a1ba-49438f5e01c4 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1887317 May 12 15:20:57.249572 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-900d24f8-7842-499e-b402-8661b1a90c53 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/routers/c18d2ea9-5bea-4046-a11f-4e95d84a3b8d HTTP/1.1" status: 200 len: 919 time: 0.4871428 May 12 15:20:57.250914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34098) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:57.333882 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2303af51-391c-44dc-bc75-7e3430a76e5e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event deleted for resources: {'Subnet': ['ID=722dd775-53fe-4359-9d8f-d74143e5ced9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:57.339090 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2303af51-391c-44dc-bc75-7e3430a76e5e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:57.359532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:20:57.369553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Usage tracker for resource:subnet and tenant:474c82a3dfe24a42ae9d88d67006b265 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:20:57.374536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c341671e-a3e5-49ab-82c1-794b06d15b7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:57.382721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:20:57.387632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b333f7a-ffde-483c-bb9a-9d10c209e68d None None] Network e6a7ff8f-d7ef-4614-8958-ef6026371726 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:20:57.406416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:20:57.428554 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2303af51-391c-44dc-bc75-7e3430a76e5e tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "DELETE /v2.0/subnets/722dd775-53fe-4359-9d8f-d74143e5ced9 HTTP/1.1" status: 204 len: 168 time: 1.5707686 May 12 15:20:57.438377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f6e69150-f190-4480-9f5f-54c1b8829df7 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "GET /v2.0/ports?device_id=c18d2ea9-5bea-4046-a11f-4e95d84a3b8d HTTP/1.1" status: 200 len: 205 time: 0.1789923 May 12 15:20:57.440412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34102) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:57.443894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34104) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:57.446197 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:57.446985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 803ac615-40d5-4393-abcc-712ad84a11ed up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:20:57.516621 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2ca82acc-aed5-4dc7-9a05-665ffa6bc9c5'] response: {'name': 'network-changed', 'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'status': 'completed', 'code': 200} May 12 15:20:57.544914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Made reservation on behalf of 474c82a3dfe24a42ae9d88d67006b265 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:20:57.549015 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:57.746815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-686a2812-1606-4158-82c7-84a6b7af26c3 None None] For port d775410b-5243-4cfd-98b4-580efdd2099c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d775410b-5243-4cfd-98b4-580efdd2099c,segment=NetworkSegment(ed0c42e2-53e7-41f7-b08b-1540aadbe724),segment_id=ed0c42e2-53e7-41f7-b08b-1540aadbe724)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:57.747428 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-686a2812-1606-4158-82c7-84a6b7af26c3 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:57.777216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f8cae617-12c6-49fd-85dc-ef66f5209ad4 None None] For port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7ec1c0e6-e3cc-4075-87ff-0216985d1d2b,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:57.777696 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f8cae617-12c6-49fd-85dc-ef66f5209ad4 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:58.029575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-686a2812-1606-4158-82c7-84a6b7af26c3 None None] Calling delete_port for d775410b-5243-4cfd-98b4-580efdd2099c owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:58.131209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] For port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7ec1c0e6-e3cc-4075-87ff-0216985d1d2b,segment=NetworkSegment(8d117579-62ca-4ff1-b65e-77a41d98571a),segment_id=8d117579-62ca-4ff1-b65e-77a41d98571a)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:20:58.131209 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:58.264862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:20:58.480179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.objects.ports [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88151) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:20:58.493364 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:58.722795 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:58.786998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f8cae617-12c6-49fd-85dc-ef66f5209ad4 None None] Calling delete_port for 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:58.891786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event updated for resources: {'Subnet': ['ID=34174834-9ac2-4c62-90dd-12153f953383,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:58.912472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Calling delete_port for 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:20:58.922084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c341671e-a3e5-49ab-82c1-794b06d15b7a,revision_number=10']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:59.013762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 803ac615-40d5-4393-abcc-712ad84a11ed completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:20:59.061266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 803ac615-40d5-4393-abcc-712ad84a11ed triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:20:59.061623 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:59.101873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-473fe274-3e87-4a99-a7e6-eada968b5764 req-ec642795-ac05-4146-9957-9efa2945ec97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:59.103344 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-473fe274-3e87-4a99-a7e6-eada968b5764 req-ec642795-ac05-4146-9957-9efa2945ec97 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=40852c97262142aeb6d62097955af83f&device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 1095 time: 1.6702664 May 12 15:20:59.132178 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:59.147084 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:59.171695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Deleting port 9fb302e9-6f6c-4b61-b81f-d0ffbf3a07ff {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:59.172797 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:59.214221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Deleting port d775410b-5243-4cfd-98b4-580efdd2099c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:20:59.215072 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:59.283210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28ff605f-8d38-43ee-a4d0-b557e941e9bb req-81e3441c-e3d6-4582-9f93-98ee1a40e6c0 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:59.290286 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28ff605f-8d38-43ee-a4d0-b557e941e9bb req-81e3441c-e3d6-4582-9f93-98ee1a40e6c0 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 944 time: 1.6727486 May 12 15:20:59.388913 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-686a2812-1606-4158-82c7-84a6b7af26c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:59.401473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-473fe274-3e87-4a99-a7e6-eada968b5764 req-e99509dd-a62b-4a36-a823-eadd058d1c17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:59.402968 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-473fe274-3e87-4a99-a7e6-eada968b5764 req-e99509dd-a62b-4a36-a823-eadd058d1c17 service neutron] 10.222.0.84 "GET /v2.0/networks?id=2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 200 len: 918 time: 0.2843986 May 12 15:20:59.404709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Checking segment: {'id': 'da66a25d-ea11-44ee-aba6-96605c1569da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:20:59.404709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Network hostable DHCP agents. Network: fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:20:59.495376 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-473fe274-3e87-4a99-a7e6-eada968b5764 req-03f25f56-8b11-40a0-93d1-0245a341fed2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0 HTTP/1.1" status: 200 len: 217 time: 0.0739515 May 12 15:20:59.506794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28ff605f-8d38-43ee-a4d0-b557e941e9bb req-ef1add44-5292-49af-812b-c474483182c3 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1651771 May 12 15:20:59.589123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-473fe274-3e87-4a99-a7e6-eada968b5764 req-a91fb4f1-1645-408c-88e6-15648f7449e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:59.590590 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-473fe274-3e87-4a99-a7e6-eada968b5764 req-a91fb4f1-1645-408c-88e6-15648f7449e0 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5f6d45f7-b8bc-4313-879f-ee173c0a4148 HTTP/1.1" status: 200 len: 856 time: 0.0796456 May 12 15:20:59.591310 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Network fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:20:59.669992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-686a2812-1606-4158-82c7-84a6b7af26c3 None None] Pushing event deleted for resources: {'Port': ['ID=d775410b-5243-4cfd-98b4-580efdd2099c,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:20:59.678451 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-686a2812-1606-4158-82c7-84a6b7af26c3 None None] No DVR routers for this DVR port d775410b-5243-4cfd-98b4-580efdd2099c on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:20:59.682381 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c4e0ff80-d8f3-4692-b470-9cc844aecf9f'] response: {'server_uuid': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c341671e-a3e5-49ab-82c1-794b06d15b7a', 'code': 200} May 12 15:20:59.694722 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f8cae617-12c6-49fd-85dc-ef66f5209ad4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:59.734896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:20:59.742154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:20:59.742733 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:59.853647 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-344799f0-b723-4da1-8d07-0f085bc70d1f tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 3.8221998 May 12 15:20:59.853647 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:20:59.853647 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:20:59.854046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] The port 'd775410b-5243-4cfd-98b4-580efdd2099c' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:20:59.856698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34114) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:20:59.868078 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:20:59.898822 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7a559e2-7df3-4e13-a316-bbe8a26e1c98 None None] Network fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:00.059427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77defed2-ec71-415b-86ca-6598b820b6cb None None] DHCP port deletion for e6a7ff8f-d7ef-4614-8958-ef6026371726 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:21:00.063604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4a88f583-55ea-4849-8a87-dbc693ed07d0 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:21:00.126468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-77defed2-ec71-415b-86ca-6598b820b6cb None None] Deleting port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:00.127177 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-77defed2-ec71-415b-86ca-6598b820b6cb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:00.191552 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:00.205791 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:00.209342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-473fe274-3e87-4a99-a7e6-eada968b5764 req-a9bd955f-e75f-4889-8aae-46ab43ad45c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:00.222256 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-473fe274-3e87-4a99-a7e6-eada968b5764 req-a9bd955f-e75f-4889-8aae-46ab43ad45c6 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2d986451-1d91-468d-8a9c-ecc4da7a86bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.6156750 May 12 15:21:00.400449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Calling delete_port for 9fb302e9-6f6c-4b61-b81f-d0ffbf3a07ff owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:00.477282 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8cae617-12c6-49fd-85dc-ef66f5209ad4 None None] Pushing event deleted for resources: {'Port': ['ID=7ec1c0e6-e3cc-4075-87ff-0216985d1d2b,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:00.507967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Deleting port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:00.509258 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:00.544334 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8cae617-12c6-49fd-85dc-ef66f5209ad4 None None] No DVR routers for this DVR port 7ec1c0e6-e3cc-4075-87ff-0216985d1d2b on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:21:00.628225 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:00.662075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c5f75c23-a033-42fa-b7cd-dcbda413fa9a']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:00.681429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ed0c42e2-53e7-41f7-b08b-1540aadbe724') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:00.681779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ed0c42e2-53e7-41f7-b08b-1540aadbe724') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:00.694585 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:00.718498 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:00.731487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Releasing vlan 599 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:21:00.731891 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:00.744322 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:00.781029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] The port '7ec1c0e6-e3cc-4075-87ff-0216985d1d2b' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:21:00.866683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 803ac615-40d5-4393-abcc-712ad84a11ed, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=803ac615-40d5-4393-abcc-712ad84a11ed,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: timer() May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:21:00.897309 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:21:00.918213 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:00.950659 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:00.963376 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-473fe274-3e87-4a99-a7e6-eada968b5764 req-2739641d-cd9e-466e-a074-6c8fe285711c service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7228293 May 12 15:21:00.969342 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] It took 0.23 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:21:00.983637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event deleted for resources: {'Network': ['ID=c5f75c23-a033-42fa-b7cd-dcbda413fa9a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:01.028405 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef900a6-8977-4b0a-a1a7-2b575dfc49d8 req-70602e6a-50a1-4032-aab1-9e409936d75b tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:01.036015 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ef900a6-8977-4b0a-a1a7-2b575dfc49d8 req-70602e6a-50a1-4032-aab1-9e409936d75b tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 944 time: 1.1324530 May 12 15:21:01.054065 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:01.082504 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fb95f3a1-2fd6-409b-82e0-b4ca0ef3c06d tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "DELETE /v2.0/networks/c5f75c23-a033-42fa-b7cd-dcbda413fa9a HTTP/1.1" status: 204 len: 168 time: 3.6347961 May 12 15:21:01.091963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34124) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:01.127655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:01.154599 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:01.250660 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:01.278218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0ff32f81-3ca6-41e0-8986-06dbed4ab52d']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:01.307348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8d117579-62ca-4ff1-b65e-77a41d98571a') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:01.307828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8d117579-62ca-4ff1-b65e-77a41d98571a') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:01.322635 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ef900a6-8977-4b0a-a1a7-2b575dfc49d8 req-8f577692-74fb-4001-8494-c340a0595da4 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2766502 May 12 15:21:01.329411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Deleting port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:01.329778 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:01.349037 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:01.370366 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:01.380573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Releasing vlan 553 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:21:01.381511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:01.404687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25521fac-2750-4606-b44e-1be74cb949c3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0', 'network_id': 'fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0', 'tenant_id': '474c82a3dfe24a42ae9d88d67006b265', 'fixed_ips': [{'subnet_id': '34174834-9ac2-4c62-90dd-12153f953383'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:21:01.422105 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-25521fac-2750-4606-b44e-1be74cb949c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:01.600666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-77defed2-ec71-415b-86ca-6598b820b6cb None None] For port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=92b1b7a4-91a0-4aea-a3ac-f070053d04b4,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:01.600888 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-77defed2-ec71-415b-86ca-6598b820b6cb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:01.636584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d775410b-5243-4cfd-98b4-580efdd2099c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: timer() May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:21:01.672097 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:21:01.679292 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-473fe274-3e87-4a99-a7e6-eada968b5764 req-310b2f8a-8b36-4f5b-9eb8-bcec3bfdb113 service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5384734 May 12 15:21:01.685666 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:01.691977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:01.700491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de22b0a8-a494-4711-8630-31192ae0cb77', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '803ac615-40d5-4393-abcc-712ad84a11ed'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:21:01.743368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] Pushing event deleted for resources: {'Network': ['ID=0ff32f81-3ca6-41e0-8986-06dbed4ab52d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:01.772909 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-096cbd92-f458-457b-bfef-995bb85a60ac admin admin] 10.222.0.82 "DELETE /v2.0/networks/0ff32f81-3ca6-41e0-8986-06dbed4ab52d HTTP/1.1" status: 204 len: 168 time: 6.4309487 May 12 15:21:01.817877 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:01.960458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Subnet': ['ID=34174834-9ac2-4c62-90dd-12153f953383,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:02.062561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: d775410b-5243-4cfd-98b4-580efdd2099c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:21:02.062561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d775410b-5243-4cfd-98b4-580efdd2099c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:21:02.091004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-77defed2-ec71-415b-86ca-6598b820b6cb None None] Calling delete_port for 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:02.212326 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:02.323559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:02.360795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:02.368260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'da66a25d-ea11-44ee-aba6-96605c1569da') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:02.369672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'da66a25d-ea11-44ee-aba6-96605c1569da') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:02.372215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:02.390148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:02.406187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=803ac615-40d5-4393-abcc-712ad84a11ed,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:02.420633 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:02.443301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Releasing vlan 559 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:21:02.443753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:02.457363 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'port_id': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'mac_address': 'fa:16:3e:c6:9e:79', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 558, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:21:02.508154 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:02.537200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34138) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:02.563725 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:02.567096 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:02.587547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4a88f583-55ea-4849-8a87-dbc693ed07d0 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:21:02.630007 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-77defed2-ec71-415b-86ca-6598b820b6cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: timer() May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:21:02.646494 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:21:02.658197 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:02.717761 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:02.744947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] For port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=92b1b7a4-91a0-4aea-a3ac-f070053d04b4,segment=NetworkSegment(e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357),segment_id=e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:02.746690 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:02.758079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Network': ['ID=fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:02.776344 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a2b95195-a2b9-4a10-8ad4-7da6bbff5e02 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/networks/fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0 HTTP/1.1" status: 204 len: 168 time: 2.9028997 May 12 15:21:02.777431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77defed2-ec71-415b-86ca-6598b820b6cb None None] Pushing event deleted for resources: {'Port': ['ID=92b1b7a4-91a0-4aea-a3ac-f070053d04b4,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:02.779267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 update to DOWN by agent not found {{(pid=88153) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2140}} May 12 15:21:02.782494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34142) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:02.798712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77defed2-ec71-415b-86ca-6598b820b6cb None None] No DVR routers for this DVR port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:21:02.807812 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-25521fac-2750-4606-b44e-1be74cb949c3 None None] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') May 12 15:21:02.807812 n-d-841483-1 neutron-server[88153]: [SQL: INSERT INTO ports (project_id, id, name, network_id, mac_address, admin_state_up, `status`, device_id, device_owner, ip_allocation, standard_attr_id) VALUES (%(project_id)s, %(id)s, %(name)s, %(network_id)s, %(mac_address)s, %(admin_state_up)s, %(status)s, %(device_id)s, %(device_owner)s, %(ip_allocation)s, %(standard_attr_id)s)] May 12 15:21:02.807812 n-d-841483-1 neutron-server[88153]: [parameters: {'project_id': '474c82a3dfe24a42ae9d88d67006b265', 'id': 'a2b96dc4-dd90-4ce4-935f-9fed4c42c72a', 'name': '', 'network_id': 'fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0', 'mac_address': 'fa:16:3e:1c:03:e2', 'admin_state_up': 1, 'status': 'DOWN', 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0', 'device_owner': 'network:dhcp', 'ip_allocation': None, 'standard_attr_id': 1497}] May 12 15:21:02.807812 n-d-841483-1 neutron-server[88153]: (Background on this error at: http://sqlalche.me/e/13/e3q8) {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:21:02.808244 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-25521fac-2750-4606-b44e-1be74cb949c3 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:21:02.819354 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:02.830890 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:02.887768 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-c49a01c7-44d1-4bd7-ab92-eea1324b8212 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] DELETE failed (client error): The resource could not be found. May 12 15:21:02.888270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c49a01c7-44d1-4bd7-ab92-eea1324b8212 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:21:02.897080 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c49a01c7-44d1-4bd7-ab92-eea1324b8212 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/subnets/34174834-9ac2-4c62-90dd-12153f953383 HTTP/1.1" status: 404 len: 337 time: 0.1127632 May 12 15:21:02.898765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34146) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:02.959939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Calling delete_port for 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:02.962679 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-9a0af49b-c4cc-4885-a96b-30ad5065bb6a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] DELETE failed (client error): The resource could not be found. May 12 15:21:02.963184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9a0af49b-c4cc-4885-a96b-30ad5065bb6a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:21:02.964884 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9a0af49b-c4cc-4885-a96b-30ad5065bb6a tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/networks/fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0 HTTP/1.1" status: 404 len: 339 time: 0.0649800 May 12 15:21:02.967399 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34150) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:03.008287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4a88f583-55ea-4849-8a87-dbc693ed07d0,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:03.035978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Pushing event deleted for resources: {'Port': ['ID=9fb302e9-6f6c-4b61-b81f-d0ffbf3a07ff,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:03.071810 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-66033ec9-347f-4d0f-8e27-7993b4ce6881 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] DELETE failed (client error): The resource could not be found. May 12 15:21:03.072255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-66033ec9-347f-4d0f-8e27-7993b4ce6881 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:21:03.074340 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-66033ec9-347f-4d0f-8e27-7993b4ce6881 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/subnets/1b3d33d6-162f-4b6a-ac94-8221aa7af0be HTTP/1.1" status: 404 len: 337 time: 0.1059458 May 12 15:21:03.077425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34154) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:03.161248 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-30590261-a480-4e2d-9a5d-c315acf3e3f3 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] DELETE failed (client error): The resource could not be found. May 12 15:21:03.162183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-30590261-a480-4e2d-9a5d-c315acf3e3f3 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:21:03.165343 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-30590261-a480-4e2d-9a5d-c315acf3e3f3 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/networks/456e06c5-b128-42dd-9173-117bbe50ba11 HTTP/1.1" status: 404 len: 339 time: 0.0874538 May 12 15:21:03.171805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34158) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:03.193721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['4a88f583-55ea-4849-8a87-dbc693ed07d0'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:21:03.283341 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-01bd93fc-86a8-4686-81a2-4231557aab50 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] DELETE failed (client error): The resource could not be found. May 12 15:21:03.284918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-01bd93fc-86a8-4686-81a2-4231557aab50 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:21:03.286984 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-01bd93fc-86a8-4686-81a2-4231557aab50 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/subnets/b49490b4-fb59-4edd-af64-7567589c3a29 HTTP/1.1" status: 404 len: 337 time: 0.1139860 May 12 15:21:03.292378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34162) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:03.309104 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-25521fac-2750-4606-b44e-1be74cb949c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:03.319733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ffae5ce8-a195-4ecb-bb07-683c57803f0b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=07c1472fa162425e9303d95e5e843c64&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7808285 May 12 15:21:03.324800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34168) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:03.348484 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-aa674d7f-709b-433e-a486-73ff8bd6cfcf tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] DELETE failed (client error): The resource could not be found. May 12 15:21:03.349226 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-aa674d7f-709b-433e-a486-73ff8bd6cfcf tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:21:03.353296 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aa674d7f-709b-433e-a486-73ff8bd6cfcf tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/networks/72b18c14-a959-4cae-9582-f9d6877fbe33 HTTP/1.1" status: 404 len: 339 time: 0.0574014 May 12 15:21:03.354181 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34174) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:03.359497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a00f75d-2376-4f0b-a2b7-d713ebcd1ea3 req-e8ab8ff9-464e-4759-95de-242581b39752 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:03.362377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a00f75d-2376-4f0b-a2b7-d713ebcd1ea3 req-e8ab8ff9-464e-4759-95de-242581b39752 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 944 time: 1.6768034 May 12 15:21:03.406024 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:21:03.406520 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:21:03.420999 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:03.528882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5d7a937-4e0d-4c2d-a595-f793f137535e None None] Network fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:03.552195 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a67a3453-5349-43b8-9426-566b8cd4d02c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:03.555516 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a00f75d-2376-4f0b-a2b7-d713ebcd1ea3 req-9f956bc2-0256-45dd-93ce-72e08d60cd29 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1848116 May 12 15:21:03.576993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5d7a937-4e0d-4c2d-a595-f793f137535e None None] Network fbb1b6ef-b428-4e1d-89f1-c3dc714b8df0 could not be found, it might have been deleted concurrently. {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:220}} May 12 15:21:03.600979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b644229b-a9b0-4f0d-92c0-7a79348e0295 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Deleting port 3467b562-0aff-4b0c-9e2f-915b241d859b {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:03.601324 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b644229b-a9b0-4f0d-92c0-7a79348e0295 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:03.714633 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f9e4b008-88ff-4463-8248-19e21c012e0c'] response: {'server_uuid': 'de22b0a8-a494-4711-8630-31192ae0cb77', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '803ac615-40d5-4393-abcc-712ad84a11ed', 'code': 200} May 12 15:21:03.763452 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a67a3453-5349-43b8-9426-566b8cd4d02c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:03.847438 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:03.858183 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:03.945403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Deleting port 92b1b7a4-91a0-4aea-a3ac-f070053d04b4 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:03.946001 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.000288 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a67a3453-5349-43b8-9426-566b8cd4d02c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.024972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a67a3453-5349-43b8-9426-566b8cd4d02c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd2954d6-4234-4a13-a827-ff9f705a5cfa,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:04.027824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b644229b-a9b0-4f0d-92c0-7a79348e0295 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.044981 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a67a3453-5349-43b8-9426-566b8cd4d02c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.060263 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a67a3453-5349-43b8-9426-566b8cd4d02c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fd2954d6-4234-4a13-a827-ff9f705a5cfa HTTP/1.1" status: 204 len: 168 time: 0.7261183 May 12 15:21:04.068657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] The port '92b1b7a4-91a0-4aea-a3ac-f070053d04b4' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:21:04.127190 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.131023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Fanout notify agent at l3_agent the message router_deleted on router c18d2ea9-5bea-4046-a11f-4e95d84a3b8d {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:21:04.187571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e78a62-e620-4137-9be2-27af22d5e0d7 req-4ceda64f-8fec-4309-b1d1-fcb136d0b6bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:04.189376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22e78a62-e620-4137-9be2-27af22d5e0d7 req-4ceda64f-8fec-4309-b1d1-fcb136d0b6bf service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 1096 time: 0.4280982 May 12 15:21:04.505448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b644229b-a9b0-4f0d-92c0-7a79348e0295 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Calling delete_port for 3467b562-0aff-4b0c-9e2f-915b241d859b owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:04.522953 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.528950 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3586243b-49ba-438e-9611-54b70d14e7dd tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "DELETE /v2.0/routers/c18d2ea9-5bea-4046-a11f-4e95d84a3b8d HTTP/1.1" status: 204 len: 168 time: 7.0718789 May 12 15:21:04.533783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34198) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:04.545784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1475549869', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'enable_snat': False}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:04.558824 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22e78a62-e620-4137-9be2-27af22d5e0d7 req-12fd18ae-32d3-4a03-b221-640033e60688 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2540522 May 12 15:21:04.561917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.562783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:04.571125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Usage tracker for resource:router and tenant:a0824ae235484071b39cd368d3b3aa19 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:04.575954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:04.586517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:04.607536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4acd63e-47c0-4114-84c9-dee129073889 req-da0f54d9-00fd-4d4c-9c24-7faa544f4413 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:04.616011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4acd63e-47c0-4114-84c9-dee129073889 req-da0f54d9-00fd-4d4c-9c24-7faa544f4413 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 945 time: 0.7498648 May 12 15:21:04.633203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.634193 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.640754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3378a535-4097-4c2c-980b-d8de45000816 req-082a4192-47af-4275-a2ab-36b25f16c7f0 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:04.647975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3378a535-4097-4c2c-980b-d8de45000816 req-082a4192-47af-4275-a2ab-36b25f16c7f0 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 945 time: 0.8006303 May 12 15:21:04.654979 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e6a7ff8f-d7ef-4614-8958-ef6026371726']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:04.669023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.677969 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b644229b-a9b0-4f0d-92c0-7a79348e0295 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.695665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:04.696059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e8cf4804-6bdf-4f7d-a2bb-43c45fbaf357') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:04.726217 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.757226 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b644229b-a9b0-4f0d-92c0-7a79348e0295 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.759973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b644229b-a9b0-4f0d-92c0-7a79348e0295 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Port': ['ID=3467b562-0aff-4b0c-9e2f-915b241d859b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:04.773247 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b644229b-a9b0-4f0d-92c0-7a79348e0295 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/ports/3467b562-0aff-4b0c-9e2f-915b241d859b HTTP/1.1" status: 204 len: 168 time: 1.4172411 May 12 15:21:04.773866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4acd63e-47c0-4114-84c9-dee129073889 req-154fae2f-ced6-4288-a205-77388a7a657b tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1486962 May 12 15:21:04.776939 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.779195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34214) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:04.816929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3378a535-4097-4c2c-980b-d8de45000816 req-cda6d046-80ba-4175-a54b-da14c735a130 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1679821 May 12 15:21:04.852034 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4a88f583-55ea-4849-8a87-dbc693ed07d0 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:04.905231 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-f0561e4f-8b18-4311-a34a-cd9a7f6548e8 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] DELETE failed (client error): The resource could not be found. May 12 15:21:04.907667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f0561e4f-8b18-4311-a34a-cd9a7f6548e8 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:21:04.910184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f0561e4f-8b18-4311-a34a-cd9a7f6548e8 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/subnets/65487ed9-35b1-4c4b-bca8-cc07e9adfedc HTTP/1.1" status: 404 len: 337 time: 0.0898271 May 12 15:21:04.918209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34224) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:04.922310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Releasing vlan 594 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:21:04.922734 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: timer() May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:21:04.975975 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:21:05.004531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 4a88f583-55ea-4849-8a87-dbc693ed07d0 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:21:05.012396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 4a88f583-55ea-4849-8a87-dbc693ed07d0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:05.013028 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.184575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30697cf4-1205-48c6-94f0-6d6ba4c1adeb tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.228429 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.288110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:05.298266 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.310461 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.431863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4a88f583-55ea-4849-8a87-dbc693ed07d0,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:05.506215 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30697cf4-1205-48c6-94f0-6d6ba4c1adeb tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.532732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-30697cf4-1205-48c6-94f0-6d6ba4c1adeb tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:05.546622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-30697cf4-1205-48c6-94f0-6d6ba4c1adeb tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a23efafd-4053-444f-a224-b4bef1fae4f1') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:05.547086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-30697cf4-1205-48c6-94f0-6d6ba4c1adeb tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a23efafd-4053-444f-a224-b4bef1fae4f1') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:05.565772 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30697cf4-1205-48c6-94f0-6d6ba4c1adeb tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.583365 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30697cf4-1205-48c6-94f0-6d6ba4c1adeb tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.589822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-30697cf4-1205-48c6-94f0-6d6ba4c1adeb tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Releasing vlan 570 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:21:05.590253 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30697cf4-1205-48c6-94f0-6d6ba4c1adeb tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.715705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: timer() May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:21:05.757080 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:21:05.760260 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.792150 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.797270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] Pushing event deleted for resources: {'Network': ['ID=e6a7ff8f-d7ef-4614-8958-ef6026371726,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:05.799875 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30697cf4-1205-48c6-94f0-6d6ba4c1adeb tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.833852 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30697cf4-1205-48c6-94f0-6d6ba4c1adeb tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.836561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-30697cf4-1205-48c6-94f0-6d6ba4c1adeb tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/networks/55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4 HTTP/1.1" status: 204 len: 168 time: 0.8674483 May 12 15:21:05.836721 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.842396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34254) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:05.852135 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bf6141b5-3bdf-4693-9d87-f487ae20043a tempest-TaggedBootDevicesTest-1560073896 tempest-TaggedBootDevicesTest-1560073896-project] 10.222.0.82 "DELETE /v2.0/networks/e6a7ff8f-d7ef-4614-8958-ef6026371726 HTTP/1.1" status: 204 len: 168 time: 4.7593989 May 12 15:21:05.855454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30697cf4-1205-48c6-94f0-6d6ba4c1adeb tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Network': ['ID=55b3feb1-70ab-4b1d-aad5-6eb556ce7bb4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:05.886185 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:05.949663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-224bc226-2604-49d0-8629-cae712ce3dcb req-5f299c54-c984-4744-8be2-b137f002e572 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:05.951597 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-224bc226-2604-49d0-8629-cae712ce3dcb req-5f299c54-c984-4744-8be2-b137f002e572 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 945 time: 0.9703586 May 12 15:21:06.043931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5dd1a1df-c1f1-4e13-91d7-87540cd65225 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Deleting port 64ebd533-3247-4dc6-a4f8-173e6ebced5b {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:06.044269 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5dd1a1df-c1f1-4e13-91d7-87540cd65225 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:06.097128 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-224bc226-2604-49d0-8629-cae712ce3dcb req-428b13e0-0fdc-4acd-8b14-a3c860a5d58a tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1235263 May 12 15:21:06.109890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Allocated IP 172.25.8.25 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/e4b82386-ff82-46dc-a56d-2762388c523f) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:21:06.235151 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0b00fa72-eb16-47a0-80f0-56c0a6d0b27b'] response: {'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'code': 200} May 12 15:21:06.375907 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:06.496464 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:06.672704 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5dd1a1df-c1f1-4e13-91d7-87540cd65225 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:06.756815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:21:06.765506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event updated for resources: {'Port': ['ID=e4b82386-ff82-46dc-a56d-2762388c523f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:06.767190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:06.775765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:21:06.856436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5dd1a1df-c1f1-4e13-91d7-87540cd65225 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Calling delete_port for 64ebd533-3247-4dc6-a4f8-173e6ebced5b owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:06.885730 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a4319222-c380-4fc9-aa58-7b43e582f6d6 req-a12ac0a1-3c90-49c1-a3f3-05ff1fd68b82 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.4579096 May 12 15:21:06.929232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa8f82d-7858-4a8e-9a55-a0a2aa1a9ba8 req-73fcf752-9032-401d-822c-d9cbaa0d5bc7 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:06.937090 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7fa8f82d-7858-4a8e-9a55-a0a2aa1a9ba8 req-73fcf752-9032-401d-822c-d9cbaa0d5bc7 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 945 time: 0.4500782 May 12 15:21:07.019341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9fe2503-fc8f-40dc-844d-643f34f9b39d req-c8cbfa2c-1744-46cf-b72a-cbb6e160f398 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:07.020823 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9fe2503-fc8f-40dc-844d-643f34f9b39d req-c8cbfa2c-1744-46cf-b72a-cbb6e160f398 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 945 time: 0.4537585 May 12 15:21:07.038703 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7fa8f82d-7858-4a8e-9a55-a0a2aa1a9ba8 req-a1723bc6-743b-4dd3-9e5a-36a62b308f03 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1009943 May 12 15:21:07.098400 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5dd1a1df-c1f1-4e13-91d7-87540cd65225 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:07.251266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a7f22bc-69c2-4508-97b8-4b3c81507cd4 req-bab7ba98-b33c-4613-8a41-addb5916f974 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:07.253340 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7a7f22bc-69c2-4508-97b8-4b3c81507cd4 req-bab7ba98-b33c-4613-8a41-addb5916f974 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 1097 time: 0.7631326 May 12 15:21:07.406077 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7a7f22bc-69c2-4508-97b8-4b3c81507cd4 req-a808a5e5-22b0-4e0c-80e6-c57d72252521 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1334894 May 12 15:21:07.454649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4319222-c380-4fc9-aa58-7b43e582f6d6 req-d79bdaae-a8fa-4c1a-85fb-2c5bf6af3f6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:07.456236 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a4319222-c380-4fc9-aa58-7b43e582f6d6 req-d79bdaae-a8fa-4c1a-85fb-2c5bf6af3f6c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 1096 time: 0.3192673 May 12 15:21:07.463734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:07.476140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dd1a1df-c1f1-4e13-91d7-87540cd65225 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Port': ['ID=64ebd533-3247-4dc6-a4f8-173e6ebced5b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:07.488590 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5dd1a1df-c1f1-4e13-91d7-87540cd65225 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:07.505044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9fe2503-fc8f-40dc-844d-643f34f9b39d req-ecba2412-7744-4b87-991d-72559721e521 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4633567 May 12 15:21:07.509213 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5dd1a1df-c1f1-4e13-91d7-87540cd65225 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/ports/64ebd533-3247-4dc6-a4f8-173e6ebced5b HTTP/1.1" status: 204 len: 168 time: 1.6622829 May 12 15:21:07.509884 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34298) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:07.554264 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-193f38ff-22cc-4240-8ef9-79aecef875ef tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] DELETE failed (client error): The resource could not be found. May 12 15:21:07.554759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-193f38ff-22cc-4240-8ef9-79aecef875ef tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:21:07.559842 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-193f38ff-22cc-4240-8ef9-79aecef875ef tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/subnets/8bb5348d-ba26-4492-b99e-7c45af59ff21 HTTP/1.1" status: 404 len: 337 time: 0.0489316 May 12 15:21:07.560342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34304) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:07.690294 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55e6218c-48e8-4896-8fa2-95062c2172c9 req-0b019db8-6c2c-4ea8-b6a8-5053b907c7a5 tempest-ServersAaction247Test-1332385993 tempest-ServersAaction247Test-1332385993-project] 10.222.0.82 "GET /v2.0/ports?device_id=13b49ce6-3bde-4e25-8df1-91dbf1b43ff0 HTTP/1.1" status: 200 len: 210 time: 0.1265578 May 12 15:21:07.743157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-35715ecd-6c7d-48ea-bed2-bed1f4926fe1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:07.974892 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-35715ecd-6c7d-48ea-bed2-bed1f4926fe1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:08.013575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-35715ecd-6c7d-48ea-bed2-bed1f4926fe1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c3bfc2e7-b3ab-4fff-824f-ce558c6da32c']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:08.029625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-35715ecd-6c7d-48ea-bed2-bed1f4926fe1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0e56ffaa-9259-4d30-8f4a-1ddeec47517b') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:08.029888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-35715ecd-6c7d-48ea-bed2-bed1f4926fe1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0e56ffaa-9259-4d30-8f4a-1ddeec47517b') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:08.050151 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-35715ecd-6c7d-48ea-bed2-bed1f4926fe1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:08.083653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b37dcc51-6d7b-4d1f-9a7d-b17a16065410 req-b3910698-a863-423b-9f83-5a41aa7fd1f2 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:08.085526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b37dcc51-6d7b-4d1f-9a7d-b17a16065410 req-b3910698-a863-423b-9f83-5a41aa7fd1f2 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.1920047 May 12 15:21:08.086725 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-35715ecd-6c7d-48ea-bed2-bed1f4926fe1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:08.098534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-35715ecd-6c7d-48ea-bed2-bed1f4926fe1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Releasing vlan 564 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:21:08.098944 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-35715ecd-6c7d-48ea-bed2-bed1f4926fe1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: timer() May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:21:08.178005 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:21:08.364970 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:08.462173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b37dcc51-6d7b-4d1f-9a7d-b17a16065410 req-81cfc284-6e6d-46d6-818d-d60773487cd7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2832041 May 12 15:21:08.467061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4319222-c380-4fc9-aa58-7b43e582f6d6 req-130abb33-1bd7-4553-b22d-f3ef7a91188a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:08.468594 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a4319222-c380-4fc9-aa58-7b43e582f6d6 req-130abb33-1bd7-4553-b22d-f3ef7a91188a service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.7241213 May 12 15:21:08.474505 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-35715ecd-6c7d-48ea-bed2-bed1f4926fe1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:08.548331 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-35715ecd-6c7d-48ea-bed2-bed1f4926fe1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:08.722146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35715ecd-6c7d-48ea-bed2-bed1f4926fe1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Network': ['ID=c3bfc2e7-b3ab-4fff-824f-ce558c6da32c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:08.745940 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-35715ecd-6c7d-48ea-bed2-bed1f4926fe1 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/networks/c3bfc2e7-b3ab-4fff-824f-ce558c6da32c HTTP/1.1" status: 204 len: 168 time: 1.1843863 May 12 15:21:08.747013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34334) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:08.824881 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a4319222-c380-4fc9-aa58-7b43e582f6d6 req-82ce7692-e20e-4a64-9df2-b314f9f73f8d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26 HTTP/1.1" status: 200 len: 1001 time: 0.1607652 May 12 15:21:08.848966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-9e7e1318-3fa7-48a8-bd26-71bd4f6b6b19 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Deleting subnet 0bff4903-0a06-4cb5-83f0-77c88b761e29 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:21:08.854104 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9e7e1318-3fa7-48a8-bd26-71bd4f6b6b19 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:08.856557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 860dc344-70ad-4ff8-9592-ee8e988a4f26 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:08.920833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f26489c9-59dd-4279-a424-e10b2be42f8a req-8fb5dd73-c664-4474-920c-987a21b46018 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:08.931217 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f26489c9-59dd-4279-a424-e10b2be42f8a req-8fb5dd73-c664-4474-920c-987a21b46018 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 945 time: 0.3846488 May 12 15:21:08.999560 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9e7e1318-3fa7-48a8-bd26-71bd4f6b6b19 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:09.137549 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f26489c9-59dd-4279-a424-e10b2be42f8a req-a0517196-a90f-46cc-99b8-24a6368dde07 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1975970 May 12 15:21:09.155763 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e821e2f0-cb65-4edf-a038-249f9fe7feff req-95179f85-3665-46ff-a11d-3c34e0370685 tempest-ServersAaction247Test-1332385993 tempest-ServersAaction247Test-1332385993-project] 10.222.0.82 "GET /v2.0/ports?device_id=13b49ce6-3bde-4e25-8df1-91dbf1b43ff0 HTTP/1.1" status: 200 len: 210 time: 0.0985279 May 12 15:21:09.241304 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:09.253987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9e7e1318-3fa7-48a8-bd26-71bd4f6b6b19 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:09.288291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:21:09.316606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:09.328657 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:09.462791 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9e7e1318-3fa7-48a8-bd26-71bd4f6b6b19 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:09.475270 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-521e05fa-2b06-48ec-8825-8c384768bbaf'] response: {'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'code': 200} May 12 15:21:09.476385 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:09.538838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e7e1318-3fa7-48a8-bd26-71bd4f6b6b19 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Subnet': ['ID=0bff4903-0a06-4cb5-83f0-77c88b761e29,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:09.547021 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9e7e1318-3fa7-48a8-bd26-71bd4f6b6b19 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:09.547532 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0d731f4-fd02-43dc-98a1-9ee7a40046e6 None None] Network 7d76bd1a-568e-42be-801e-4192db4bb211 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:09.572636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4319222-c380-4fc9-aa58-7b43e582f6d6 req-9bd28a4a-99c9-4dec-bd50-5d3cab013ae6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:09.574969 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a4319222-c380-4fc9-aa58-7b43e582f6d6 req-9bd28a4a-99c9-4dec-bd50-5d3cab013ae6 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.7219017 May 12 15:21:09.575381 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9e7e1318-3fa7-48a8-bd26-71bd4f6b6b19 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/subnets/0bff4903-0a06-4cb5-83f0-77c88b761e29 HTTP/1.1" status: 204 len: 168 time: 0.8214197 May 12 15:21:09.575952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34352) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:09.608484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc70dd64-b9a0-42e6-9201-89548d043efe req-e3e553f0-af2e-41c1-9d9c-7d4bc96862dd tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:09.617518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc70dd64-b9a0-42e6-9201-89548d043efe req-e3e553f0-af2e-41c1-9d9c-7d4bc96862dd tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 945 time: 0.1959071 May 12 15:21:09.698700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc70dd64-b9a0-42e6-9201-89548d043efe req-7f15f928-a7eb-4728-bc78-0ec4b082045f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0800683 May 12 15:21:09.890806 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:09.928967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Deleting port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:09.929311 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:09.982511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4319222-c380-4fc9-aa58-7b43e582f6d6 req-d49d53c9-99d9-44cc-ab79-958d8ec34e8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:09.984045 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a4319222-c380-4fc9-aa58-7b43e582f6d6 req-d49d53c9-99d9-44cc-ab79-958d8ec34e8b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3735731 May 12 15:21:10.021160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Router 31de324f-60f7-49ba-bdfe-cb8bc79011d7 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:21:10.132888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29d53c06-5e15-478e-a641-76183f777e69 None None] DHCP port deletion for 7d76bd1a-568e-42be-801e-4192db4bb211 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:21:10.137352 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-29d53c06-5e15-478e-a641-76183f777e69 None None] Deleting port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:10.137778 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-29d53c06-5e15-478e-a641-76183f777e69 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:10.155279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1aa462-cddd-4e3f-b1da-cb6095e4a3c9 req-9444b996-ab2b-4c69-a1e4-31b9651031ba tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:10.163695 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd1aa462-cddd-4e3f-b1da-cb6095e4a3c9 req-9444b996-ab2b-4c69-a1e4-31b9651031ba tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.3777614 May 12 15:21:10.256971 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd1aa462-cddd-4e3f-b1da-cb6095e4a3c9 req-ee8e3d7d-5eb7-4b34-83ac-34b6e065318d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0872512 May 12 15:21:10.310291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7963098-4ba4-4c43-9eb3-30b006d398a1 req-c3ef708a-28a9-4927-83c6-f067408bc641 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:10.320666 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7963098-4ba4-4c43-9eb3-30b006d398a1 req-c3ef708a-28a9-4927-83c6-f067408bc641 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 945 time: 0.2904687 May 12 15:21:10.448204 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7963098-4ba4-4c43-9eb3-30b006d398a1 req-473f7235-7e59-4b29-a823-0461955ac4b2 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1173682 May 12 15:21:10.508385 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-29d53c06-5e15-478e-a641-76183f777e69 None None] For port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3b830b86-8a0b-4d94-96ba-c9968e7ee2d2,segment=NetworkSegment(09634c20-a08f-4ec1-bfd2-67b02eef0803),segment_id=09634c20-a08f-4ec1-bfd2-67b02eef0803)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:10.508788 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-29d53c06-5e15-478e-a641-76183f777e69 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:10.599986 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-648efa9c-75f6-4222-a169-b5a0df6cbcbe req-9fc415ba-3527-44e5-8a73-b85d8cb1400a service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=13b49ce6-3bde-4e25-8df1-91dbf1b43ff0 HTTP/1.1" status: 200 len: 210 time: 0.1784008 May 12 15:21:10.634143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d0fcae1-0ce2-4c46-b3c0-46191206fd3d req-da51f248-e3b3-430a-affd-b068db0b6273 tempest-ServersAaction247Test-1332385993 tempest-ServersAaction247Test-1332385993-project] 10.222.0.82 "GET /v2.0/ports?device_id=13b49ce6-3bde-4e25-8df1-91dbf1b43ff0 HTTP/1.1" status: 200 len: 210 time: 0.1108599 May 12 15:21:10.707971 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-29d53c06-5e15-478e-a641-76183f777e69 None None] Calling delete_port for 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:10.794078 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a4319222-c380-4fc9-aa58-7b43e582f6d6 req-dff0cb30-90f2-4c39-8769-3533b75b954a service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8026330 May 12 15:21:10.812342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:10.826277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b20e81c3-e094-4fde-a161-e7db7d0e5ce7 req-b68a13c6-70af-4cfd-bf9d-6017f3789daa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:10.832746 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b20e81c3-e094-4fde-a161-e7db7d0e5ce7 req-b68a13c6-70af-4cfd-bf9d-6017f3789daa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.1844862 May 12 15:21:10.839406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34382) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:10.845136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d9e20300-68cd-4b53-bcbf-7012179d2621 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Request body: {'floatingip': {'port_id': '4a88f583-55ea-4849-8a87-dbc693ed07d0'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:10.852705 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-29d53c06-5e15-478e-a641-76183f777e69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:10.966591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29d53c06-5e15-478e-a641-76183f777e69 None None] No DVR routers for this DVR port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:21:10.986668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:21:10.987251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:21:10.993628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29d53c06-5e15-478e-a641-76183f777e69 None None] Pushing event deleted for resources: {'Port': ['ID=3b830b86-8a0b-4d94-96ba-c9968e7ee2d2,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:11.061865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] For port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3b830b86-8a0b-4d94-96ba-c9968e7ee2d2,segment=NetworkSegment(09634c20-a08f-4ec1-bfd2-67b02eef0803),segment_id=09634c20-a08f-4ec1-bfd2-67b02eef0803)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:11.062284 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:11.089631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:21:11.100998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Sync routers for ids ['31de324f-60f7-49ba-bdfe-cb8bc79011d7'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:21:11.123420 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Routers {'31de324f-60f7-49ba-bdfe-cb8bc79011d7'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:11.124947 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:20:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['31de324f-60f7-49ba-bdfe-cb8bc79011d7'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:11.231888 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9e20300-68cd-4b53-bcbf-7012179d2621 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:11.251525 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:11.253474 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6c0a9a4a-7976-4c00-94a1-32c535abee8c tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 907 time: 6.7183983 May 12 15:21:11.261131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Calling delete_port for 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:11.306223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34398) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:11.550476 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a4319222-c380-4fc9-aa58-7b43e582f6d6 req-0f1cc620-1c53-4878-9feb-a5fd68d2763b service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6602266 May 12 15:21:11.554403 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Set router 31de324f-60f7-49ba-bdfe-cb8bc79011d7 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:21:11.602988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:21:11.603597 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:21:11.667934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b75aa2-4b30-4e39-aca3-e883f18dac68 req-9291652f-051c-4db4-907a-48f8019bfd1d tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:11.677082 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9b75aa2-4b30-4e39-aca3-e883f18dac68 req-9291652f-051c-4db4-907a-48f8019bfd1d tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 945 time: 0.7250981 May 12 15:21:11.841967 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9b75aa2-4b30-4e39-aca3-e883f18dac68 req-daf0bfdc-9dba-4695-9259-2c2325bf87d9 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1608627 May 12 15:21:11.946767 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c8aa7e8e-c115-40d1-8e45-34f4a7cc3394 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/routers/31de324f-60f7-49ba-bdfe-cb8bc79011d7 HTTP/1.1" status: 200 len: 908 time: 0.6326191 May 12 15:21:11.947341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34410) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:11.961930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1475549869', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'enable_snat': True}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:11.972809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:11.984706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Usage tracker for resource:router and tenant:a0824ae235484071b39cd368d3b3aa19 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:11.992764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Quota usage for router was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:12.007066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attempting to reserve 1 items for resource router. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:12.036594 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:12.037720 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:12.060613 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:12.194379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Deleting port 3b830b86-8a0b-4d94-96ba-c9968e7ee2d2 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:12.194766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:12.309431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24eb3498-dd7d-4bbc-bc8a-631856828288 req-60ad379d-ebdc-47c8-846d-9c7c2f46b231 tempest-ServersAaction247Test-1332385993 tempest-ServersAaction247Test-1332385993-project] 10.222.0.82 "GET /v2.0/ports?device_id=13b49ce6-3bde-4e25-8df1-91dbf1b43ff0 HTTP/1.1" status: 200 len: 210 time: 0.1091316 May 12 15:21:12.342370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] The port '3b830b86-8a0b-4d94-96ba-c9968e7ee2d2' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:21:12.423126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7381506b-e49a-4a71-93b7-8d8f9665b540 req-73825d80-1ba1-43c5-bf89-9cb57ed28cd7 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:12.424606 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7381506b-e49a-4a71-93b7-8d8f9665b540 req-73825d80-1ba1-43c5-bf89-9cb57ed28cd7 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 945 time: 0.1863568 May 12 15:21:12.445827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '31de324f-60f7-49ba-bdfe-cb8bc79011d7', 'name': 'tempest-snat-router-1475549869', 'tenant_id': 'a0824ae235484071b39cd368d3b3aa19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.25'}], 'enable_snat': False}, 'gw_port_id': 'e4b82386-ff82-46dc-a56d-2762388c523f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:04Z', 'updated_at': '2022-05-12T15:21:07Z', 'revision_number': 3, 'project_id': 'a0824ae235484071b39cd368d3b3aa19', 'gw_port': {'id': 'e4b82386-ff82-46dc-a56d-2762388c523f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:55:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '31de324f-60f7-49ba-bdfe-cb8bc79011d7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1499, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.25', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:05Z', 'updated_at': '2022-05-12T15:21:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:12.460670 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Checking router: 31de324f-60f7-49ba-bdfe-cb8bc79011d7 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:21:12.463173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Updating router 31de324f-60f7-49ba-bdfe-cb8bc79011d7 port e4b82386-ff82-46dc-a56d-2762388c523f binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:21:12.551440 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7381506b-e49a-4a71-93b7-8d8f9665b540 req-b8318de1-614a-4c79-ac92-24ba22d621fb tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1177421 May 12 15:21:12.614360 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:12.787976 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9e20300-68cd-4b53-bcbf-7012179d2621 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:12.800675 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9e20300-68cd-4b53-bcbf-7012179d2621 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:12.894234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 860dc344-70ad-4ff8-9592-ee8e988a4f26 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:21:12.919924 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:12.947202 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b9301b98-986c-4428-866f-acafd4850008 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:13.012725 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:13.053797 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:13.214392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7d76bd1a-568e-42be-801e-4192db4bb211']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:13.247489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '09634c20-a08f-4ec1-bfd2-67b02eef0803') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:13.253634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '09634c20-a08f-4ec1-bfd2-67b02eef0803') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:13.340296 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-d9e20300-68cd-4b53-bcbf-7012179d2621 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Floating IP 4ee874b2-35ce-4deb-960e-3fee8a1cd250 associated. External IP: 172.25.8.178, port: 4a88f583-55ea-4849-8a87-dbc693ed07d0. May 12 15:21:13.346773 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:13.462539 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:13.520066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Releasing vlan 573 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:21:13.526081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: timer() May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:21:13.594592 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:21:13.635557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:13.686092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-041075e5-dcad-4d0d-b948-ac14f233d58e req-2d8fed13-a486-42e5-8172-ca437732161f tempest-ServersAaction247Test-1332385993 tempest-ServersAaction247Test-1332385993-project] 10.222.0.82 "GET /v2.0/ports?device_id=13b49ce6-3bde-4e25-8df1-91dbf1b43ff0 HTTP/1.1" status: 200 len: 210 time: 0.1310732 May 12 15:21:13.734382 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'port_id': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'mac_address': 'fa:16:3e:ad:b5:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 579, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:21:13.859735 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:21:13.869782 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:13.879193 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:13.934751 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] 10.222.0.82 "DELETE /v2.0/networks/7d76bd1a-568e-42be-801e-4192db4bb211 HTTP/1.1" status: 204 len: 168 time: 4.3457365 May 12 15:21:13.941093 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:13.963408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdca1c00-e3db-48b4-a9e7-f3ee1bc3b8f4 tempest-NetworksIpV6TestAttrs-1449213883 tempest-NetworksIpV6TestAttrs-1449213883-project] Pushing event deleted for resources: {'Network': ['ID=7d76bd1a-568e-42be-801e-4192db4bb211,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:13.995641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 860dc344-70ad-4ff8-9592-ee8e988a4f26 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:21:14.130689 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:14.147338 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:14.373440 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['860dc344-70ad-4ff8-9592-ee8e988a4f26'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:21:14.397310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eef1823-4934-4d74-84c0-d50e9f3a9155 req-606281b9-e6e3-4b6e-bedc-28520d688a54 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:14.405023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3eef1823-4934-4d74-84c0-d50e9f3a9155 req-606281b9-e6e3-4b6e-bedc-28520d688a54 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 945 time: 1.4672620 May 12 15:21:14.485300 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] It took 0.21 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:21:14.621802 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:14.688608 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:14.812552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34484) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:14.861253 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3eef1823-4934-4d74-84c0-d50e9f3a9155 req-1e97349e-9df1-4957-bca1-1c8a262f31bb tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4441876 May 12 15:21:14.913059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:14.992066 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6afd57ab-a56e-40c2-8e84-7537e12c4ad2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:14.997468 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:15.018120 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d9e20300-68cd-4b53-bcbf-7012179d2621 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Router 78d4ada5-c100-4849-8e75-44ba389f27d8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:21:15.034026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Transition to ACTIVE for port object e4b82386-ff82-46dc-a56d-2762388c523f will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:21:15.094474 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:15.243425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Allocated IP 172.25.8.20 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/9fdbd676-760b-4c4f-8919-1c8456ed186e) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:21:15.403081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Attempting to bind port e4b82386-ff82-46dc-a56d-2762388c523f on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:21:15.403441 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Attempting to bind port e4b82386-ff82-46dc-a56d-2762388c523f by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:21:15.403925 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Attempting to bind port e4b82386-ff82-46dc-a56d-2762388c523f on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:21:15.422761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 20, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:21:15.423135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:21:15.423533 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:15.424133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:21:15.424811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Bound port: e4b82386-ff82-46dc-a56d-2762388c523f, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:21:15.425076 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:15.570827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d9e20300-68cd-4b53-bcbf-7012179d2621 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:21:15.581210 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9e20300-68cd-4b53-bcbf-7012179d2621 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:15.597122 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c88db5a-d8f8-4a7a-8781-88de968159a1 None None] Sync routers for ids ['78d4ada5-c100-4849-8e75-44ba389f27d8'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:21:15.616109 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f405499f-c19f-4bb9-9005-c9d4813f7404 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=474c82a3dfe24a42ae9d88d67006b265&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8024163 May 12 15:21:15.628607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34502) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:15.629779 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c88db5a-d8f8-4a7a-8781-88de968159a1 None None] Routers {'78d4ada5-c100-4849-8e75-44ba389f27d8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:15.639655 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6c88db5a-d8f8-4a7a-8781-88de968159a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['78d4ada5-c100-4849-8e75-44ba389f27d8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:15.708297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d8a2956-48db-4dbd-b5b8-4cda3c909e0a None None] Pushing event updated for resources: {'Port': ['ID=e4b82386-ff82-46dc-a56d-2762388c523f,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:15.795908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d9e20300-68cd-4b53-bcbf-7012179d2621 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "PUT /v2.0/floatingips/4ee874b2-35ce-4deb-960e-3fee8a1cd250 HTTP/1.1" status: 200 len: 992 time: 4.9551842 May 12 15:21:15.799907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:21:15.824260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] For port e4b82386-ff82-46dc-a56d-2762388c523f, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:21:15.829860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] For port e4b82386-ff82-46dc-a56d-2762388c523f, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e4b82386-ff82-46dc-a56d-2762388c523f,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:21:15.842939 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:15.914926 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:15.942642 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00bbf708-205d-4230-b9e7-27b0d28adacb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:15.987754 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00bbf708-205d-4230-b9e7-27b0d28adacb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:16.060204 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6c88db5a-d8f8-4a7a-8781-88de968159a1 None None] Set router 78d4ada5-c100-4849-8e75-44ba389f27d8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:21:16.227929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Routers {'31de324f-60f7-49ba-bdfe-cb8bc79011d7'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:16.228564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['31de324f-60f7-49ba-bdfe-cb8bc79011d7'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:16.290072 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:16.301253 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:16.339074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d8a2956-48db-4dbd-b5b8-4cda3c909e0a None None] Pushing event updated for resources: {'Port': ['ID=e4b82386-ff82-46dc-a56d-2762388c523f,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:16.484114 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00bbf708-205d-4230-b9e7-27b0d28adacb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:16.532208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] Set router 31de324f-60f7-49ba-bdfe-cb8bc79011d7 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:21:16.542233 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:16.663197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00bbf708-205d-4230-b9e7-27b0d28adacb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ad030b9-c6e1-4b7f-94b9-08cd7f589891,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:16.663197 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00bbf708-205d-4230-b9e7-27b0d28adacb admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:16.664774 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-00bbf708-205d-4230-b9e7-27b0d28adacb admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0ad030b9-c6e1-4b7f-94b9-08cd7f589891 HTTP/1.1" status: 204 len: 168 time: 0.9956508 May 12 15:21:16.727236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event updated for resources: {'Port': ['ID=9fdbd676-760b-4c4f-8919-1c8456ed186e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:16.740846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:21:16.742460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:16.744783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:21:16.778317 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6c88db5a-d8f8-4a7a-8781-88de968159a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '4ee874b2-35ce-4deb-960e-3fee8a1cd250', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'floating_ip_address': '172.25.8.178', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'port_id': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1485, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'mac_address': 'fa:16:3e:c6:9e:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:20:37Z', 'updated_at': '2022-05-12T15:21:12Z', 'revision_number': 1, 'project_id': '40852c97262142aeb6d62097955af83f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:43Z', 'revision_number': 5, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:16.797435 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c88db5a-d8f8-4a7a-8781-88de968159a1 None None] Checking router: 78d4ada5-c100-4849-8e75-44ba389f27d8 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:21:16.820200 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c88db5a-d8f8-4a7a-8781-88de968159a1 None None] Routers {'78d4ada5-c100-4849-8e75-44ba389f27d8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:16.821019 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6c88db5a-d8f8-4a7a-8781-88de968159a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['78d4ada5-c100-4849-8e75-44ba389f27d8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:16.951053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 860dc344-70ad-4ff8-9592-ee8e988a4f26 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:17.097936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 860dc344-70ad-4ff8-9592-ee8e988a4f26 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:17.098518 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:17.274103 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:17.331968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:17.336935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:21:17.348408 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:17.381597 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6c88db5a-d8f8-4a7a-8781-88de968159a1 None None] Set router 78d4ada5-c100-4849-8e75-44ba389f27d8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:21:17.547440 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '31de324f-60f7-49ba-bdfe-cb8bc79011d7', 'name': 'tempest-snat-router-1475549869', 'tenant_id': 'a0824ae235484071b39cd368d3b3aa19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.25'}], 'enable_snat': False}, 'gw_port_id': 'e4b82386-ff82-46dc-a56d-2762388c523f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:04Z', 'updated_at': '2022-05-12T15:21:07Z', 'revision_number': 3, 'project_id': 'a0824ae235484071b39cd368d3b3aa19', 'gw_port': {'id': 'e4b82386-ff82-46dc-a56d-2762388c523f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:55:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '31de324f-60f7-49ba-bdfe-cb8bc79011d7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1499, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.25', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:05Z', 'updated_at': '2022-05-12T15:21:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:17.564200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b73f562-72bb-4c55-8ed3-41fd9b7bb2d9 None None] The sync data for ids ['31de324f-60f7-49ba-bdfe-cb8bc79011d7'] in n-d-841483-1 is: [{'id': '31de324f-60f7-49ba-bdfe-cb8bc79011d7', 'name': 'tempest-snat-router-1475549869', 'tenant_id': 'a0824ae235484071b39cd368d3b3aa19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.25'}], 'enable_snat': False}, 'gw_port_id': 'e4b82386-ff82-46dc-a56d-2762388c523f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:04Z', 'updated_at': '2022-05-12T15:21:07Z', 'revision_number': 3, 'project_id': 'a0824ae235484071b39cd368d3b3aa19', 'gw_port': {'id': 'e4b82386-ff82-46dc-a56d-2762388c523f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:55:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '31de324f-60f7-49ba-bdfe-cb8bc79011d7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1499, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.25', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:05Z', 'updated_at': '2022-05-12T15:21:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:21:17.624487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=10']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:17.644333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6cb1083-d2d0-4b7c-842f-13bd7e993fea req-6e9465fb-d2ea-45c9-b48c-fe867fe632a5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:17.654824 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6cb1083-d2d0-4b7c-842f-13bd7e993fea req-6e9465fb-d2ea-45c9-b48c-fe867fe632a5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 945 time: 0.1659696 May 12 15:21:17.659768 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:17.851053 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6cb1083-d2d0-4b7c-842f-13bd7e993fea req-3ea34207-55cf-40bc-858f-193b53fe4851 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1952384 May 12 15:21:17.937183 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9a6756fd-968c-413e-80b5-e2b7700897af'] response: {'name': 'network-changed', 'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'status': 'completed', 'code': 200} May 12 15:21:17.946811 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:18.265031 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0c86327f-ce96-42e1-9e6c-69a40de7fde9'] response: {'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'code': 200} May 12 15:21:18.358072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e4b82386-ff82-46dc-a56d-2762388c523f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:18.519143 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6c88db5a-d8f8-4a7a-8781-88de968159a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '4ee874b2-35ce-4deb-960e-3fee8a1cd250', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'floating_ip_address': '172.25.8.178', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'port_id': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1485, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'mac_address': 'fa:16:3e:c6:9e:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:20:37Z', 'updated_at': '2022-05-12T15:21:12Z', 'revision_number': 1, 'project_id': '40852c97262142aeb6d62097955af83f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:43Z', 'revision_number': 5, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:18.534627 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c88db5a-d8f8-4a7a-8781-88de968159a1 None None] The sync data for ids ['78d4ada5-c100-4849-8e75-44ba389f27d8'] in n-d-841483-1 is: [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '4ee874b2-35ce-4deb-960e-3fee8a1cd250', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'floating_ip_address': '172.25.8.178', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'port_id': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1485, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'mac_address': 'fa:16:3e:c6:9e:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:20:37Z', 'updated_at': '2022-05-12T15:21:12Z', 'revision_number': 1, 'project_id': '40852c97262142aeb6d62097955af83f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:43Z', 'revision_number': 5, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:21:18.677010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port e4b82386-ff82-46dc-a56d-2762388c523f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:21:18.688256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port e4b82386-ff82-46dc-a56d-2762388c523f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:18.688627 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:19.019600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-494d70bb-dd68-4741-a934-6b17a2e0b562 req-977765f3-3d15-48bd-abc2-a45c4f4a1f98 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:19.031182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-494d70bb-dd68-4741-a934-6b17a2e0b562 req-977765f3-3d15-48bd-abc2-a45c4f4a1f98 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 949 time: 0.2590344 May 12 15:21:19.088299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70d69d58-5437-44a1-a035-1ee4e3c995a9 None None] New status for floating IP 4ee874b2-35ce-4deb-960e-3fee8a1cd250: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:21:19.157600 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-494d70bb-dd68-4741-a934-6b17a2e0b562 req-e99246e5-02d6-49ee-8923-9830f06a0c38 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/security-groups?id=741e94d4-5b74-4583-8ee0-e67ced7944a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1132095 May 12 15:21:19.157600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34586) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:19.442151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d03a3443-c254-43ad-842c-fe89f59eb607 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-1241520643', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:19.444253 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:19.496043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d03a3443-c254-43ad-842c-fe89f59eb607 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:19.507535 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:19.516857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d03a3443-c254-43ad-842c-fe89f59eb607 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Usage tracker for resource:router and tenant:c995197740fb4eab89e62ffe0b62783d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:19.532519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d03a3443-c254-43ad-842c-fe89f59eb607 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:19.555434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d03a3443-c254-43ad-842c-fe89f59eb607 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:19.585352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c0f95b2-a691-43d1-b8be-26cd64e1226b req-2fd31ba3-a51d-4d87-9b51-8f3d4ef5a587 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:19.587731 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c0f95b2-a691-43d1-b8be-26cd64e1226b req-2fd31ba3-a51d-4d87-9b51-8f3d4ef5a587 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=40852c97262142aeb6d62097955af83f&device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 1097 time: 1.3054900 May 12 15:21:19.593328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port e4b82386-ff82-46dc-a56d-2762388c523f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e4b82386-ff82-46dc-a56d-2762388c523f,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:19.599831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d03a3443-c254-43ad-842c-fe89f59eb607 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:19.600912 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d03a3443-c254-43ad-842c-fe89f59eb607 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:19.641452 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d03a3443-c254-43ad-842c-fe89f59eb607 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:19.672528 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:19.702387 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d03a3443-c254-43ad-842c-fe89f59eb607 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:19.771952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d03a3443-c254-43ad-842c-fe89f59eb607 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:19.781966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d03a3443-c254-43ad-842c-fe89f59eb607 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 0.6339550 May 12 15:21:19.782729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34606) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:19.801337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-199075884'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:19.816048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:19.840466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Usage tracker for resource:network and tenant:c995197740fb4eab89e62ffe0b62783d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:19.853576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:19.874725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:19.919182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Made reservation on behalf of c995197740fb4eab89e62ffe0b62783d for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:21:19.923174 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:19.967634 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:20.027311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:20.044686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Usage tracker for resource:security_group_rule and tenant:c995197740fb4eab89e62ffe0b62783d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:20.055333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:20.069512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:20.109437 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=e4b82386-ff82-46dc-a56d-2762388c523f,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:20.334941 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:20.355070 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:20.506989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e4b82386-ff82-46dc-a56d-2762388c523f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:20.524871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d533b3d4-8ae6-436f-9a30-a014d8316617,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:20.562902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 588} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:21:20.585984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:20.586770 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Added segment cf597cb4-44a2-466d-867b-86ad3091743a of type vlan for network 50dc0c23-2977-4989-b609-20b428ab0210 May 12 15:21:20.666599 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:20.669056 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c3b32847-8f24-4a7d-b0e8-6214e618c5e5 req-3ee96313-a7d2-4114-96a9-7f45983aa546 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=aa618eb476744c8e944af98a4537b7a0&device_id=13b49ce6-3bde-4e25-8df1-91dbf1b43ff0 HTTP/1.1" status: 200 len: 210 time: 0.6567395 May 12 15:21:20.680347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c0f95b2-a691-43d1-b8be-26cd64e1226b req-8bbf4eaf-114f-44bc-bcb8-165fe22ab49a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:20.681880 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c0f95b2-a691-43d1-b8be-26cd64e1226b req-8bbf4eaf-114f-44bc-bcb8-165fe22ab49a service neutron] 10.222.0.84 "GET /v2.0/networks?id=2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 200 len: 918 time: 1.0137403 May 12 15:21:20.734682 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:20.743427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:20.744623 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:20.792293 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c3b32847-8f24-4a7d-b0e8-6214e618c5e5 req-62dbaa57-c557-4bb1-bcce-bea696d4efaf service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=aa618eb476744c8e944af98a4537b7a0&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1015375 May 12 15:21:20.977878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port e4b82386-ff82-46dc-a56d-2762388c523f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:20.978448 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:21.097974 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event updated for resources: {'Network': ['ID=50dc0c23-2977-4989-b609-20b428ab0210,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:21.131698 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a3bc7c69-9919-4ee1-8b18-ac1503cd91a1 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 1.3469274 May 12 15:21:21.132503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34650) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:21.142197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Request body: {'subnet': {'network_id': '50dc0c23-2977-4989-b609-20b428ab0210', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:21.237635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b32847-8f24-4a7d-b0e8-6214e618c5e5 req-01984763-87b7-4b15-b0be-396662a095dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:21.239373 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c3b32847-8f24-4a7d-b0e8-6214e618c5e5 req-01984763-87b7-4b15-b0be-396662a095dc service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4297476 May 12 15:21:21.242068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 50dc0c23-2977-4989-b609-20b428ab0210 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:21:21.319463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c341671e-a3e5-49ab-82c1-794b06d15b7a no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:21.335612 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c0f95b2-a691-43d1-b8be-26cd64e1226b req-7fbb60e8-44a4-47ef-a2f6-dad15150add8 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0 HTTP/1.1" status: 200 len: 1002 time: 0.5406516 May 12 15:21:21.479816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Router e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:21:21.484274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:21.493607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Usage tracker for resource:subnet and tenant:c995197740fb4eab89e62ffe0b62783d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:21.505484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:21.520896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:21.603002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Made reservation on behalf of c995197740fb4eab89e62ffe0b62783d for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:21:21.614418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:21.665658 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1e912699-ac16-49de-9c0c-8e04f786a569 req-e9a3fc2d-8fb0-4959-893d-e93f3fdb8b39 tempest-ServersAaction247Test-1332385993 tempest-ServersAaction247Test-1332385993-project] 10.222.0.82 "GET /v2.0/ports?device_id=13b49ce6-3bde-4e25-8df1-91dbf1b43ff0 HTTP/1.1" status: 200 len: 210 time: 0.5301616 May 12 15:21:21.776379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c0f95b2-a691-43d1-b8be-26cd64e1226b req-20ae5451-7a6d-449b-8ae8-553fa9f5e227 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:21.778687 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c0f95b2-a691-43d1-b8be-26cd64e1226b req-20ae5451-7a6d-449b-8ae8-553fa9f5e227 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5f6d45f7-b8bc-4313-879f-ee173c0a4148 HTTP/1.1" status: 200 len: 856 time: 0.4221535 May 12 15:21:21.949970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:21:21.965144 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Sync routers for ids ['e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:21:21.978512 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Routers {'e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:21.979287 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:22.020757 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:22.022004 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ca1cae88-f7b6-470e-957b-e34965029e1b tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 906 time: 10.0737338 May 12 15:21:22.028491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34672) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:22.166844 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:22.170776 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:22.176222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c0f95b2-a691-43d1-b8be-26cd64e1226b req-eafaa2b2-44ff-4c8e-912b-a343af63398a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:22.178957 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c0f95b2-a691-43d1-b8be-26cd64e1226b req-eafaa2b2-44ff-4c8e-912b-a343af63398a service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2d986451-1d91-468d-8a9c-ecc4da7a86bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3845499 May 12 15:21:22.321366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c341671e-a3e5-49ab-82c1-794b06d15b7a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:21:22.349765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c341671e-a3e5-49ab-82c1-794b06d15b7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:22.363544 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:22.364687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Checking segment: {'id': 'cf597cb4-44a2-466d-867b-86ad3091743a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '50dc0c23-2977-4989-b609-20b428ab0210'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:21:22.367357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Network hostable DHCP agents. Network: 50dc0c23-2977-4989-b609-20b428ab0210, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:21:22.410940 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event updated for resources: {'Subnet': ['ID=5f771c35-bd94-4a21-a94d-6c5900db0ac2,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:22.440484 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Set router e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:21:22.529915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f29bff0-572b-41e1-8e8d-bb8c5cfd9314 req-59da6f90-4d76-46a3-9737-7fa87effa3fa tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:22.544077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f29bff0-572b-41e1-8e8d-bb8c5cfd9314 req-59da6f90-4d76-46a3-9737-7fa87effa3fa tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 945 time: 0.4274120 May 12 15:21:22.667451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Network 50dc0c23-2977-4989-b609-20b428ab0210 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:21:22.687500 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f22dd516-1481-40de-a530-f1d535f72252 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/routers/e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6 HTTP/1.1" status: 200 len: 907 time: 0.6562960 May 12 15:21:22.708539 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c0f95b2-a691-43d1-b8be-26cd64e1226b req-ee659889-f5aa-44bc-a2ac-a85de5eb2a3e service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5210662 May 12 15:21:22.709012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34692) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:22.711536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c341671e-a3e5-49ab-82c1-794b06d15b7a,revision_number=11']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:22.933909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 50dc0c23-2977-4989-b609-20b428ab0210) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:22.943308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a5df720-5b21-48ab-afae-11e6e6668e7d None None] Network 50dc0c23-2977-4989-b609-20b428ab0210 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:22.959880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:22.960598 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:23.014185 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f29bff0-572b-41e1-8e8d-bb8c5cfd9314 req-79a72af6-81dd-4d5c-8c1a-68cbf5cd8d39 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3197203 May 12 15:21:23.038887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c42adcd2-6496-43ee-b426-b78aba65af05 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.9051325 May 12 15:21:23.044208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34700) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:23.053996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30552bad-68f8-4eea-9338-c96fb0648d8f req-8d619b9f-e626-4b12-8871-92255fc577b3 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:23.061776 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30552bad-68f8-4eea-9338-c96fb0648d8f req-8d619b9f-e626-4b12-8871-92255fc577b3 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 947 time: 0.5137632 May 12 15:21:23.084568 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Request body: {'network': {'name': 'tempest-router-network01--1099372119'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:23.090280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:23.100008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Usage tracker for resource:network and tenant:c995197740fb4eab89e62ffe0b62783d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:23.103747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:23.110038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:23.138817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Made reservation on behalf of c995197740fb4eab89e62ffe0b62783d for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:21:23.142523 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:23.177966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30552bad-68f8-4eea-9338-c96fb0648d8f req-11303a04-7a15-49af-863d-c4fe6908e5c9 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/security-groups?id=741e94d4-5b74-4583-8ee0-e67ced7944a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1151006 May 12 15:21:23.226196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 571} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:21:23.255932 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c3b32847-8f24-4a7d-b0e8-6214e618c5e5 req-8c954886-7e66-4a57-ac6c-5a1df73abe4d tempest-ServersAaction247Test-1332385993 tempest-ServersAaction247Test-1332385993-project] 10.222.0.84 "GET /v2.0/ports?device_id=13b49ce6-3bde-4e25-8df1-91dbf1b43ff0 HTTP/1.1" status: 200 len: 210 time: 0.1258228 May 12 15:21:23.261869 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:23.262226 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Added segment e2292273-67f3-4b0b-9739-5797d1f7e47f of type vlan for network e9216267-d2ff-4740-934f-af19b9c825a0 May 12 15:21:23.312104 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6', 'name': 'tempest-snat-router-1475549869', 'tenant_id': 'a0824ae235484071b39cd368d3b3aa19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.20'}], 'enable_snat': True}, 'gw_port_id': '9fdbd676-760b-4c4f-8919-1c8456ed186e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:12Z', 'updated_at': '2022-05-12T15:21:17Z', 'revision_number': 3, 'project_id': 'a0824ae235484071b39cd368d3b3aa19', 'gw_port': {'id': '9fdbd676-760b-4c4f-8919-1c8456ed186e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:3d:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1501, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:14Z', 'updated_at': '2022-05-12T15:21:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:23.321692 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Checking router: e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:21:23.323397 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Updating router e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6 port 9fdbd676-760b-4c4f-8919-1c8456ed186e binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:21:23.352871 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:23.432227 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:23.440189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:23.440915 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:23.463775 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:23.511529 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-02f2f1cb-dc94-458b-b819-da1db829b733'] response: {'server_uuid': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c341671e-a3e5-49ab-82c1-794b06d15b7a', 'code': 200} May 12 15:21:23.513274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 803ac615-40d5-4393-abcc-712ad84a11ed details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:21:23.614778 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:23.899740 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.8225732 May 12 15:21:23.921746 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-50dc0c23-2977-4989-b609-20b428ab0210', 'network_id': '50dc0c23-2977-4989-b609-20b428ab0210', 'tenant_id': 'c995197740fb4eab89e62ffe0b62783d', 'fixed_ips': [{'subnet_id': '5f771c35-bd94-4a21-a94d-6c5900db0ac2'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:21:23.925504 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:23.930995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-539411a7-4bac-4029-a1a2-a03b00f6bafa req-31776014-cd72-4159-8d65-7c55d5c556e5 tempest-ServersAaction247Test-1332385993 tempest-ServersAaction247Test-1332385993-project] 10.222.0.82 "GET /v2.0/ports?device_id=13b49ce6-3bde-4e25-8df1-91dbf1b43ff0 HTTP/1.1" status: 200 len: 210 time: 0.4699905 May 12 15:21:23.942665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34712) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:23.980223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Request body: {'network': {'name': 'tempest-router-network02--2007255155'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:23.991876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:24.004713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Usage tracker for resource:network and tenant:c995197740fb4eab89e62ffe0b62783d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:24.018615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:24.042972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:24.056593 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34714) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:24.080328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c03dc7fb-284b-49d0-bc10-191cfeb97907 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event updated for resources: {'Network': ['ID=e9216267-d2ff-4740-934f-af19b9c825a0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:24.110324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Made reservation on behalf of c995197740fb4eab89e62ffe0b62783d for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:21:24.114802 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:24.190630 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 565} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:21:24.217759 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:24.218750 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Added segment 1742cf6b-24d1-4c6c-9add-e38963a43ba0 of type vlan for network bd2ab330-e973-403a-a5cd-1f870a5cee26 May 12 15:21:24.244920 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c0f95b2-a691-43d1-b8be-26cd64e1226b req-2be6a149-adc8-4143-b8d8-264d867cfb87 service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.4081440 May 12 15:21:24.279140 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:24.367168 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:24.377765 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:24.380147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:24.380785 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:24.394930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network e9216267-d2ff-4740-934f-af19b9c825a0 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:21:24.404188 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Transition to ACTIVE for port object 9fdbd676-760b-4c4f-8919-1c8456ed186e will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:21:24.420800 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:24.503899 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:24.532582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Deleting port 9fdbd676-760b-4c4f-8919-1c8456ed186e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:24.533033 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:24.588345 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Attempting to bind port 9fdbd676-760b-4c4f-8919-1c8456ed186e on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:21:24.588724 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Attempting to bind port 9fdbd676-760b-4c4f-8919-1c8456ed186e by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:21:24.589865 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Attempting to bind port 9fdbd676-760b-4c4f-8919-1c8456ed186e on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:21:24.605943 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 21, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:21:24.606369 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:21:24.606712 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:24.607098 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:21:24.607558 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Bound port: 9fdbd676-760b-4c4f-8919-1c8456ed186e, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:21:24.607923 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:24.678477 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8115ebcd-82b5-412c-ad65-7f753989d934 None None] Pushing event updated for resources: {'Port': ['ID=9fdbd676-760b-4c4f-8919-1c8456ed186e,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:24.756637 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8115ebcd-82b5-412c-ad65-7f753989d934 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:24.757053 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8115ebcd-82b5-412c-ad65-7f753989d934 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:24.757350 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8115ebcd-82b5-412c-ad65-7f753989d934 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:24.757821 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8115ebcd-82b5-412c-ad65-7f753989d934 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:24.758148 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8115ebcd-82b5-412c-ad65-7f753989d934 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:24.758469 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8115ebcd-82b5-412c-ad65-7f753989d934 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:24.758787 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8115ebcd-82b5-412c-ad65-7f753989d934 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:24.759124 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8115ebcd-82b5-412c-ad65-7f753989d934 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:24.759438 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8115ebcd-82b5-412c-ad65-7f753989d934 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:24.759750 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8115ebcd-82b5-412c-ad65-7f753989d934 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:24.760093 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8115ebcd-82b5-412c-ad65-7f753989d934 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:24.760403 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8115ebcd-82b5-412c-ad65-7f753989d934 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:24.767927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 803ac615-40d5-4393-abcc-712ad84a11ed, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=803ac615-40d5-4393-abcc-712ad84a11ed,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:24.806568 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event updated for resources: {'Network': ['ID=bd2ab330-e973-403a-a5cd-1f870a5cee26,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:24.826495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34730) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:24.828926 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e23ed2d8-3704-491c-8c20-4be488716037 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.8692262 May 12 15:21:24.839070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network bd2ab330-e973-403a-a5cd-1f870a5cee26 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:21:24.840385 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] For port 9fdbd676-760b-4c4f-8919-1c8456ed186e, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:21:24.843676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Request body: {'subnet': {'network_id': 'e9216267-d2ff-4740-934f-af19b9c825a0', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:24.845425 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] For port 9fdbd676-760b-4c4f-8919-1c8456ed186e, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9fdbd676-760b-4c4f-8919-1c8456ed186e,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:21:24.858875 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:25.008089 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Routers {'e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:25.010146 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:25.170080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:25.176197 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] Set router e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:21:25.183148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Allocated IP 172.20.0.2 (50dc0c23-2977-4989-b609-20b428ab0210/5f771c35-bd94-4a21-a94d-6c5900db0ac2/6559328b-364e-4433-8e8b-4b6b907b793c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:21:25.187913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Usage tracker for resource:subnet and tenant:c995197740fb4eab89e62ffe0b62783d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:25.191313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:25.197886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:25.223354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] For port 9fdbd676-760b-4c4f-8919-1c8456ed186e, host n-d-841483-1, got binding levels [] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:25.223730 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:25.238589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Made reservation on behalf of c995197740fb4eab89e62ffe0b62783d for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:21:25.250834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:25.293800 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6', 'name': 'tempest-snat-router-1475549869', 'tenant_id': 'a0824ae235484071b39cd368d3b3aa19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:12Z', 'updated_at': '2022-05-12T15:21:24Z', 'revision_number': 4, 'project_id': 'a0824ae235484071b39cd368d3b3aa19', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:25.301931 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab55338a-023b-4525-95e9-8ce86ff1cccc None None] The sync data for ids ['e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6'] in n-d-841483-1 is: [{'id': 'e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6', 'name': 'tempest-snat-router-1475549869', 'tenant_id': 'a0824ae235484071b39cd368d3b3aa19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:12Z', 'updated_at': '2022-05-12T15:21:24Z', 'revision_number': 4, 'project_id': 'a0824ae235484071b39cd368d3b3aa19', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:21:25.303728 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8115ebcd-82b5-412c-ad65-7f753989d934 None None] Pushing event updated for resources: {'Port': ['ID=9fdbd676-760b-4c4f-8919-1c8456ed186e,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:25.437378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a63fb3-9518-4a47-a51a-df570bb0da25 req-9bf70196-9623-48f2-8a37-ca032e28b3ad tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:25.443133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85a63fb3-9518-4a47-a51a-df570bb0da25 req-9bf70196-9623-48f2-8a37-ca032e28b3ad tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.76 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 947 time: 1.0063834 May 12 15:21:25.552182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f6dfb92-3596-4bfa-af74-0bdd57537ce0 req-b3653758-c829-4256-ab07-5b2e69e79b53 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:25.559166 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f6dfb92-3596-4bfa-af74-0bdd57537ce0 req-b3653758-c829-4256-ab07-5b2e69e79b53 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 945 time: 0.8490078 May 12 15:21:25.603738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Calling delete_port for 9fdbd676-760b-4c4f-8919-1c8456ed186e owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:25.623209 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '803ac615-40d5-4393-abcc-712ad84a11ed', 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b', 'port_id': '803ac615-40d5-4393-abcc-712ad84a11ed', 'mac_address': 'fa:16:3e:46:46:04', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 589, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5a24db8d-fb66-4b7f-bf96-50956cb218fd', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:21:25.701025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b75ad5-a162-40e0-b7fe-3369972be270 req-c0606295-fda1-4169-924a-694ddfaa598e tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:25.710598 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f1b75ad5-a162-40e0-b7fe-3369972be270 req-c0606295-fda1-4169-924a-694ddfaa598e tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 947 time: 1.0017042 May 12 15:21:25.730000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-85a63fb3-9518-4a47-a51a-df570bb0da25 req-db33913f-81cc-4b6c-923d-08323e38356e tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Deleting port c341671e-a3e5-49ab-82c1-794b06d15b7a {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:25.730000 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-85a63fb3-9518-4a47-a51a-df570bb0da25 req-db33913f-81cc-4b6c-923d-08323e38356e tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:25.884434 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:25.915551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f1b75ad5-a162-40e0-b7fe-3369972be270 req-b5073ae2-b1be-44e8-9413-b7ad659a328c tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/security-groups?id=741e94d4-5b74-4583-8ee0-e67ced7944a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2041721 May 12 15:21:25.920718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Transition to ACTIVE for port object 6559328b-364e-4433-8e8b-4b6b907b793c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:21:25.924863 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:25.934161 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f6dfb92-3596-4bfa-af74-0bdd57537ce0 req-12b37253-3180-407d-a6f2-7d3efdd5379c tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3738775 May 12 15:21:25.989409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 803ac615-40d5-4393-abcc-712ad84a11ed {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:21:26.017866 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Transition to ACTIVE for port object 6559328b-364e-4433-8e8b-4b6b907b793c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:21:26.039883 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:26.144468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 803ac615-40d5-4393-abcc-712ad84a11ed, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=803ac615-40d5-4393-abcc-712ad84a11ed,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:26.153343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Network 50dc0c23-2977-4989-b609-20b428ab0210 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:21:26.185508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:26.193571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:21:26.203647 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:26.258687 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:21:26.259029 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:21:26.392571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:26.420127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Attempting to bind port 6559328b-364e-4433-8e8b-4b6b907b793c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:21:26.421157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Attempting to bind port 6559328b-364e-4433-8e8b-4b6b907b793c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'cf597cb4-44a2-466d-867b-86ad3091743a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '50dc0c23-2977-4989-b609-20b428ab0210'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:21:26.421769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Attempting to bind port 6559328b-364e-4433-8e8b-4b6b907b793c on network 50dc0c23-2977-4989-b609-20b428ab0210 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:21:26.429645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['803ac615-40d5-4393-abcc-712ad84a11ed'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:21:26.514601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 21, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:21:26.515629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Checking segment: {'id': 'cf597cb4-44a2-466d-867b-86ad3091743a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '50dc0c23-2977-4989-b609-20b428ab0210'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:21:26.517135 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:26.518707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Bound using segment: {'id': 'cf597cb4-44a2-466d-867b-86ad3091743a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '50dc0c23-2977-4989-b609-20b428ab0210'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:21:26.520424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Bound port: 6559328b-364e-4433-8e8b-4b6b907b793c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf597cb4-44a2-466d-867b-86ad3091743a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '50dc0c23-2977-4989-b609-20b428ab0210'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:21:26.521314 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:26.599078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Pushing event updated for resources: {'Port': ['ID=6559328b-364e-4433-8e8b-4b6b907b793c,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:26.618107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34754) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:26.632417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:26.632762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:26.633068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:26.633403 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:26.633722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:26.634034 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:26.634342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:26.635338 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:26.635663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:26.636118 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:26.636436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:26.636802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:26.639975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Checking segment: {'id': 'e2292273-67f3-4b0b-9739-5797d1f7e47f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': 'e9216267-d2ff-4740-934f-af19b9c825a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:21:26.640388 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Network hostable DHCP agents. Network: e9216267-d2ff-4740-934f-af19b9c825a0, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:21:26.690437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event updated for resources: {'Subnet': ['ID=4e99b016-ec0d-4958-9013-a86d9c1e1fb7,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:26.727900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Network e9216267-d2ff-4740-934f-af19b9c825a0 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:21:26.754986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, e9216267-d2ff-4740-934f-af19b9c825a0) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:26.759404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:26.759993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:26.794086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=803ac615-40d5-4393-abcc-712ad84a11ed,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:26.806602 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52cb8bae-22e5-46bb-b5bd-67ab16921fee None None] Network e9216267-d2ff-4740-934f-af19b9c825a0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:26.808400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Deleting port 9fdbd676-760b-4c4f-8919-1c8456ed186e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:26.808826 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:26.884687 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42f05cf3-4f96-44f4-b991-a614470df727 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:26.927401 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-11e63db3-5590-4d6f-834f-9e1a4388c554 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0954049 May 12 15:21:26.931290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-42f05cf3-4f96-44f4-b991-a614470df727 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:26.933828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34760) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:26.949810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Request body: {'subnet': {'network_id': 'bd2ab330-e973-403a-a5cd-1f870a5cee26', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:26.976159 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-42f05cf3-4f96-44f4-b991-a614470df727 admin admin] Usage tracker for resource:security_group_rule and tenant:aa618eb476744c8e944af98a4537b7a0 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:27.018638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-85a63fb3-9518-4a47-a51a-df570bb0da25 req-db33913f-81cc-4b6c-923d-08323e38356e tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] For port c341671e-a3e5-49ab-82c1-794b06d15b7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c341671e-a3e5-49ab-82c1-794b06d15b7a,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:27.019198 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-85a63fb3-9518-4a47-a51a-df570bb0da25 req-db33913f-81cc-4b6c-923d-08323e38356e tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:27.058895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-42f05cf3-4f96-44f4-b991-a614470df727 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:27.063539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] For port 6559328b-364e-4433-8e8b-4b6b907b793c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:21:27.070531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] For port 6559328b-364e-4433-8e8b-4b6b907b793c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6559328b-364e-4433-8e8b-4b6b907b793c,segment=NetworkSegment(cf597cb4-44a2-466d-867b-86ad3091743a),segment_id=cf597cb4-44a2-466d-867b-86ad3091743a)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:21:27.076567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ae9695-1f2f-4af4-a1d7-3896f1b7a40c req-3a13b3a1-350b-4c23-8f2b-ec475f4a6146 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:27.087267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-54ae9695-1f2f-4af4-a1d7-3896f1b7a40c req-3a13b3a1-350b-4c23-8f2b-ec475f4a6146 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 944 time: 0.6227858 May 12 15:21:27.139201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-42f05cf3-4f96-44f4-b991-a614470df727 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:27.292248 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:27.386242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-85a63fb3-9518-4a47-a51a-df570bb0da25 req-db33913f-81cc-4b6c-923d-08323e38356e tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Calling delete_port for c341671e-a3e5-49ab-82c1-794b06d15b7a owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:27.427574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:27.438344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Usage tracker for resource:subnet and tenant:c995197740fb4eab89e62ffe0b62783d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:27.458373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:27.459355 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71208503-74d2-4f6b-a4f6-a1411c24a2fd None None] Pushing event updated for resources: {'Port': ['ID=6559328b-364e-4433-8e8b-4b6b907b793c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:27.474318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:27.480249 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-e9216267-d2ff-4740-934f-af19b9c825a0', 'network_id': 'e9216267-d2ff-4740-934f-af19b9c825a0', 'tenant_id': 'c995197740fb4eab89e62ffe0b62783d', 'fixed_ips': [{'subnet_id': '4e99b016-ec0d-4958-9013-a86d9c1e1fb7'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:21:27.481166 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:27.481319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] For port 9fdbd676-760b-4c4f-8919-1c8456ed186e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9fdbd676-760b-4c4f-8919-1c8456ed186e,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:27.481647 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:27.486812 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-54ae9695-1f2f-4af4-a1d7-3896f1b7a40c req-8160fd25-e67b-4576-9374-e99ec2ef46b4 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3978503 May 12 15:21:27.640830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Calling delete_port for 9fdbd676-760b-4c4f-8919-1c8456ed186e owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:27.683859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af0845e-b1b8-4cc5-acd5-003b9a361f7b req-2b7dec12-54cd-4e0a-8bbb-6ca7dfc2dfd0 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:27.691984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Made reservation on behalf of c995197740fb4eab89e62ffe0b62783d for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:21:27.692799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3af0845e-b1b8-4cc5-acd5-003b9a361f7b req-2b7dec12-54cd-4e0a-8bbb-6ca7dfc2dfd0 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 947 time: 0.4891620 May 12 15:21:27.695553 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:27.720324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Allocated IP 172.20.0.2 (e9216267-d2ff-4740-934f-af19b9c825a0/4e99b016-ec0d-4958-9013-a86d9c1e1fb7/ce785187-df6c-4dbd-9f80-35d4d2621dea) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:21:27.777221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3af0845e-b1b8-4cc5-acd5-003b9a361f7b req-9e99b5e5-4862-483e-a812-945e87296336 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/security-groups?id=741e94d4-5b74-4583-8ee0-e67ced7944a0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782001 May 12 15:21:27.791137 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-85a63fb3-9518-4a47-a51a-df570bb0da25 req-db33913f-81cc-4b6c-923d-08323e38356e tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:27.867457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db33913f-81cc-4b6c-923d-08323e38356e tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Pushing event deleted for resources: {'Port': ['ID=c341671e-a3e5-49ab-82c1-794b06d15b7a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:27.883042 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11c24be5-f9d5-4a38-ac60-66741a8750d6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:27.909619 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42f05cf3-4f96-44f4-b991-a614470df727 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:27.996138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42f05cf3-4f96-44f4-b991-a614470df727 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:28.167296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42f05cf3-4f96-44f4-b991-a614470df727 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fd7f835e-8f8e-40bf-b528-87da9bb6407f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:28.198786 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-42f05cf3-4f96-44f4-b991-a614470df727 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=aa618eb476744c8e944af98a4537b7a0&name=default HTTP/1.1" status: 200 len: 2983 time: 1.5719178 May 12 15:21:28.201092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34774) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:28.270284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-85a63fb3-9518-4a47-a51a-df570bb0da25 req-db33913f-81cc-4b6c-923d-08323e38356e tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] No DVR routers for this DVR port c341671e-a3e5-49ab-82c1-794b06d15b7a on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:21:28.288158 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-85a63fb3-9518-4a47-a51a-df570bb0da25 req-db33913f-81cc-4b6c-923d-08323e38356e tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:28.291343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'name': 'network-vif-deleted', 'tag': 'c341671e-a3e5-49ab-82c1-794b06d15b7a'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:21:28.390963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85a63fb3-9518-4a47-a51a-df570bb0da25 req-db33913f-81cc-4b6c-923d-08323e38356e tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.76 "DELETE /v2.0/ports/c341671e-a3e5-49ab-82c1-794b06d15b7a HTTP/1.1" status: 204 len: 173 time: 2.9336443 May 12 15:21:28.473469 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:28.499445 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c341671e-a3e5-49ab-82c1-794b06d15b7a no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:28.564449 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a6949d03-358c-4d1d-bbc6-11ac57a7d348'] response: {'server_uuid': '718f978e-5e5b-4d10-a8c0-2524be63274e', 'name': 'network-vif-deleted', 'tag': 'c341671e-a3e5-49ab-82c1-794b06d15b7a', 'status': 'completed', 'code': 200} May 12 15:21:28.573546 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Transition to ACTIVE for port object ce785187-df6c-4dbd-9f80-35d4d2621dea will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:21:28.576336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6559328b-364e-4433-8e8b-4b6b907b793c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:28.695919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c8f30db-51af-4895-8eeb-d1bfa3d4e8b5 req-f3dd8e19-8690-4bc8-8def-51ec58ec18f9 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:28.702168 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c8f30db-51af-4895-8eeb-d1bfa3d4e8b5 req-f3dd8e19-8690-4bc8-8def-51ec58ec18f9 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.76 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 944 time: 0.7630963 May 12 15:21:28.761631 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: c341671e-a3e5-49ab-82c1-794b06d15b7a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:21:28.761631 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c341671e-a3e5-49ab-82c1-794b06d15b7a not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:21:28.762004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 803ac615-40d5-4393-abcc-712ad84a11ed no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:28.840919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:28.871962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Transition to ACTIVE for port object ce785187-df6c-4dbd-9f80-35d4d2621dea will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:21:28.900799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 6559328b-364e-4433-8e8b-4b6b907b793c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:21:28.905572 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:28.995226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-11c24be5-f9d5-4a38-ac60-66741a8750d6 admin admin] Deleting port 27d87447-eec9-4938-9dce-782d012459ac {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:28.996006 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11c24be5-f9d5-4a38-ac60-66741a8750d6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:29.043594 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Pushing event updated for resources: {'Port': ['ID=ce785187-df6c-4dbd-9f80-35d4d2621dea,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:29.071529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abbcfb4f-ec71-4a42-beab-2caa4b4aca7b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:29.123620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Network e9216267-d2ff-4740-934f-af19b9c825a0 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:21:29.127359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:29.133410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:21:29.190103 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abbcfb4f-ec71-4a42-beab-2caa4b4aca7b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:29.288100 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:29.300308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-3c8f30db-51af-4895-8eeb-d1bfa3d4e8b5 req-d82e208f-c0f6-46b8-b5f2-3e38e2630410 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Deleting port 803ac615-40d5-4393-abcc-712ad84a11ed {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:29.300656 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3c8f30db-51af-4895-8eeb-d1bfa3d4e8b5 req-d82e208f-c0f6-46b8-b5f2-3e38e2630410 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:29.324716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-11c24be5-f9d5-4a38-ac60-66741a8750d6 admin admin] For port 27d87447-eec9-4938-9dce-782d012459ac, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=27d87447-eec9-4938-9dce-782d012459ac,segment=NetworkSegment(7c4990b9-5a5f-484e-a357-c9a37d811129),segment_id=7c4990b9-5a5f-484e-a357-c9a37d811129)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:29.325283 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11c24be5-f9d5-4a38-ac60-66741a8750d6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:29.402090 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abbcfb4f-ec71-4a42-beab-2caa4b4aca7b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:29.406598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id 803ac615-40d5-4393-abcc-712ad84a11ed {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:21:29.443910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 803ac615-40d5-4393-abcc-712ad84a11ed, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=803ac615-40d5-4393-abcc-712ad84a11ed,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:29.458583 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:29.496324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Attempting to bind port ce785187-df6c-4dbd-9f80-35d4d2621dea on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:21:29.496983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Attempting to bind port ce785187-df6c-4dbd-9f80-35d4d2621dea by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'e2292273-67f3-4b0b-9739-5797d1f7e47f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': 'e9216267-d2ff-4740-934f-af19b9c825a0'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:21:29.497197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Attempting to bind port ce785187-df6c-4dbd-9f80-35d4d2621dea on network e9216267-d2ff-4740-934f-af19b9c825a0 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:21:29.529755 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 21, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:21:29.530257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Checking segment: {'id': 'e2292273-67f3-4b0b-9739-5797d1f7e47f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': 'e9216267-d2ff-4740-934f-af19b9c825a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:21:29.530763 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:29.531252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Bound using segment: {'id': 'e2292273-67f3-4b0b-9739-5797d1f7e47f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': 'e9216267-d2ff-4740-934f-af19b9c825a0'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:21:29.531851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Bound port: ce785187-df6c-4dbd-9f80-35d4d2621dea, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e2292273-67f3-4b0b-9739-5797d1f7e47f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': 'e9216267-d2ff-4740-934f-af19b9c825a0'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:21:29.532325 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:29.549109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:29.549930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eed0afeb-b4cb-468c-bbb2-4bfda45ec9e9 None None] Network 50dc0c23-2977-4989-b609-20b428ab0210 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:29.597052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abbcfb4f-ec71-4a42-beab-2caa4b4aca7b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd7f835e-8f8e-40bf-b528-87da9bb6407f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:29.632790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event updated for resources: {'Subnet': ['ID=5bc660fd-561c-4d1f-82c5-5164a9efd5bd,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:29.643307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event deleted for resources: {'Port': ['ID=9fdbd676-760b-4c4f-8919-1c8456ed186e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:29.688259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Checking segment: {'id': '1742cf6b-24d1-4c6c-9add-e38963a43ba0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': 'bd2ab330-e973-403a-a5cd-1f870a5cee26'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:21:29.689766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Network hostable DHCP agents. Network: bd2ab330-e973-403a-a5cd-1f870a5cee26, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:21:29.737196 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=803ac615-40d5-4393-abcc-712ad84a11ed,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:29.750441 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f703b3b0-d043-4148-99b7-819d3f1f7948 None None] Provisioning for port 6559328b-364e-4433-8e8b-4b6b907b793c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:21:29.760410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f703b3b0-d043-4148-99b7-819d3f1f7948 None None] Provisioning complete for port 6559328b-364e-4433-8e8b-4b6b907b793c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:29.760928 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f703b3b0-d043-4148-99b7-819d3f1f7948 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:29.810591 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abbcfb4f-ec71-4a42-beab-2caa4b4aca7b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:29.812571 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-abbcfb4f-ec71-4a42-beab-2caa4b4aca7b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fd7f835e-8f8e-40bf-b528-87da9bb6407f HTTP/1.1" status: 204 len: 168 time: 1.6081638 May 12 15:21:29.874912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-11c24be5-f9d5-4a38-ac60-66741a8750d6 admin admin] Calling delete_port for 27d87447-eec9-4938-9dce-782d012459ac owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:29.923043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Network bd2ab330-e973-403a-a5cd-1f870a5cee26 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:21:29.936378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] For port ce785187-df6c-4dbd-9f80-35d4d2621dea, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:21:29.951316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] For port ce785187-df6c-4dbd-9f80-35d4d2621dea, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce785187-df6c-4dbd-9f80-35d4d2621dea,segment=NetworkSegment(e2292273-67f3-4b0b-9739-5797d1f7e47f),segment_id=e2292273-67f3-4b0b-9739-5797d1f7e47f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:21:29.961050 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:30.025862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, bd2ab330-e973-403a-a5cd-1f870a5cee26) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:30.074334 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c682d61a-b3b0-408c-b693-3ac527a84da2 None None] Network bd2ab330-e973-403a-a5cd-1f870a5cee26 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:30.131564 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:30.182754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:30.183502 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:30.205668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-962b3163-f02a-42ee-b0d1-31a0f286e55d req-d5c8796b-b916-416b-962c-2488472bc071 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Synchronizing usage tracker for tenant:0f298b0647e84cc79385c8bd9e26dff4 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:21:30.264029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-139bbc14-95e2-48f1-9728-931a842ba154 req-d6bcc46a-49bd-4943-9b68-7591636fddec tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:30.265564 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-139bbc14-95e2-48f1-9728-931a842ba154 req-d6bcc46a-49bd-4943-9b68-7591636fddec tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 944 time: 1.4857273 May 12 15:21:30.268891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-962b3163-f02a-42ee-b0d1-31a0f286e55d req-d5c8796b-b916-416b-962c-2488472bc071 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] Unset dirty status for tenant:0f298b0647e84cc79385c8bd9e26dff4 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:21:30.285994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-962b3163-f02a-42ee-b0d1-31a0f286e55d req-d5c8796b-b916-416b-962c-2488472bc071 tempest-ImagesOneServerTestJSON-436818434 tempest-ImagesOneServerTestJSON-436818434-project] 10.222.0.82 "GET /v2.0/ports?device_id=718f978e-5e5b-4d10-a8c0-2524be63274e HTTP/1.1" status: 200 len: 210 time: 0.1454682 May 12 15:21:30.308418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11c24be5-f9d5-4a38-ac60-66741a8750d6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:30.401104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11c24be5-f9d5-4a38-ac60-66741a8750d6 admin admin] Pushing event deleted for resources: {'Port': ['ID=27d87447-eec9-4938-9dce-782d012459ac,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:30.457580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 803ac615-40d5-4393-abcc-712ad84a11ed details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:21:30.529834 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-139bbc14-95e2-48f1-9728-931a842ba154 req-b4d757ff-2e9f-481c-9665-38fb7d8496c0 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2394514 May 12 15:21:30.694323 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:30.700293 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:30.737706 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-36f4e8cf-bf77-4d17-838d-af8298fb6a39 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 3.7988389 May 12 15:21:30.742749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34808) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:30.809801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-3c8f30db-51af-4895-8eeb-d1bfa3d4e8b5 req-d82e208f-c0f6-46b8-b5f2-3e38e2630410 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] For port 803ac615-40d5-4393-abcc-712ad84a11ed, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=803ac615-40d5-4393-abcc-712ad84a11ed,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:30.811877 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3c8f30db-51af-4895-8eeb-d1bfa3d4e8b5 req-d82e208f-c0f6-46b8-b5f2-3e38e2630410 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:30.911433 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f902d5dd-1a22-46d7-a371-7c7f52eb2b07 None None] Pushing event updated for resources: {'Port': ['ID=ce785187-df6c-4dbd-9f80-35d4d2621dea,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:30.976294 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11c24be5-f9d5-4a38-ac60-66741a8750d6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:31.092353 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 803ac615-40d5-4393-abcc-712ad84a11ed, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=803ac615-40d5-4393-abcc-712ad84a11ed,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:31.107583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-3c8f30db-51af-4895-8eeb-d1bfa3d4e8b5 req-d82e208f-c0f6-46b8-b5f2-3e38e2630410 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Calling delete_port for 803ac615-40d5-4393-abcc-712ad84a11ed owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:31.121500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '803ac615-40d5-4393-abcc-712ad84a11ed', 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b', 'port_id': '803ac615-40d5-4393-abcc-712ad84a11ed', 'mac_address': 'fa:16:3e:46:46:04', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 589, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5a24db8d-fb66-4b7f-bf96-50956cb218fd', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:21:31.270393 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:31.341116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34816) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:31.358828 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3c8f30db-51af-4895-8eeb-d1bfa3d4e8b5 req-d82e208f-c0f6-46b8-b5f2-3e38e2630410 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:31.547350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 803ac615-40d5-4393-abcc-712ad84a11ed {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:21:31.577450 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:31.584213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Fanout notify agent at l3_agent the message router_deleted on router e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:21:31.589216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-bd2ab330-e973-403a-a5cd-1f870a5cee26', 'network_id': 'bd2ab330-e973-403a-a5cd-1f870a5cee26', 'tenant_id': 'c995197740fb4eab89e62ffe0b62783d', 'fixed_ips': [{'subnet_id': '5bc660fd-561c-4d1f-82c5-5164a9efd5bd'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:21:31.598662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d82e208f-c0f6-46b8-b5f2-3e38e2630410 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Pushing event deleted for resources: {'Port': ['ID=803ac615-40d5-4393-abcc-712ad84a11ed,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:31.614385 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:31.684408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueTestJSON-288887235-network', 'tenant_id': '9e2382be0c6f4779ae64026a57628773'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:31.713792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:31.726087 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:31.731858 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4c04d319-0191-4edb-87ce-22385caccdfb tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "DELETE /v2.0/routers/e7f587ab-1d34-4a71-a7db-7d8b2c3f99e6 HTTP/1.1" status: 204 len: 168 time: 9.0191426 May 12 15:21:31.736997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-3c8f30db-51af-4895-8eeb-d1bfa3d4e8b5 req-d82e208f-c0f6-46b8-b5f2-3e38e2630410 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] No DVR routers for this DVR port 803ac615-40d5-4393-abcc-712ad84a11ed on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:21:31.755530 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3c8f30db-51af-4895-8eeb-d1bfa3d4e8b5 req-d82e208f-c0f6-46b8-b5f2-3e38e2630410 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:31.767154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34832) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:31.769977 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c8f30db-51af-4895-8eeb-d1bfa3d4e8b5 req-d82e208f-c0f6-46b8-b5f2-3e38e2630410 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.76 "DELETE /v2.0/ports/803ac615-40d5-4393-abcc-712ad84a11ed HTTP/1.1" status: 204 len: 173 time: 3.0642529 May 12 15:21:31.776624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de22b0a8-a494-4711-8630-31192ae0cb77', 'name': 'network-vif-deleted', 'tag': '803ac615-40d5-4393-abcc-712ad84a11ed'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:21:31.786216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Usage tracker for resource:network and tenant:9e2382be0c6f4779ae64026a57628773 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:31.812094 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f703b3b0-d043-4148-99b7-819d3f1f7948 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:31.816641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:31.827249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:31.863329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Made reservation on behalf of 9e2382be0c6f4779ae64026a57628773 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:21:31.867313 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:31.905297 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:31.933663 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8940ad97-2ef1-4c2a-92e7-9f102106086e'] response: {'server_uuid': 'de22b0a8-a494-4711-8630-31192ae0cb77', 'name': 'network-vif-deleted', 'tag': '803ac615-40d5-4393-abcc-712ad84a11ed', 'status': 'completed', 'code': 200} May 12 15:21:31.938292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:31.945125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Usage tracker for resource:security_group_rule and tenant:9e2382be0c6f4779ae64026a57628773 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:31.949030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:31.958408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:32.083590 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:32.112545 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:32.134844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 567} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:21:32.152863 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:32.152863 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Added segment ccba5697-f062-48f7-986e-3317afc51896 of type vlan for network e7794860-7444-4123-96d5-ca3febf5e162 May 12 15:21:32.194195 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:32.207123 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Allocated IP 172.20.0.2 (bd2ab330-e973-403a-a5cd-1f870a5cee26/5bc660fd-561c-4d1f-82c5-5164a9efd5bd/f8447eb0-2acd-4fb0-840e-937cef316aa8) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:21:32.236281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34840) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:32.279539 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f046542-1c6c-4513-9f2d-68191e399ef1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:32.284592 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:32.285954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:32.286531 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:32.497875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] Pushing event updated for resources: {'Network': ['ID=e7794860-7444-4123-96d5-ca3febf5e162,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:32.509526 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1224c0a5-0c91-4ef2-9c8e-d8f4c388ab55 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 1.1629884 May 12 15:21:32.510415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34846) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:32.530071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Request body: {'subnet': {'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueTestJSON-288887235-subnet', 'tenant_id': '9e2382be0c6f4779ae64026a57628773', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:32.542453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:32.554015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Usage tracker for resource:subnet and tenant:9e2382be0c6f4779ae64026a57628773 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:32.563215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:32.577646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:32.593976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Made reservation on behalf of 9e2382be0c6f4779ae64026a57628773 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:21:32.602587 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:32.608021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 803ac615-40d5-4393-abcc-712ad84a11ed no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:32.647067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network e7794860-7444-4123-96d5-ca3febf5e162 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:21:32.662891 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ce785187-df6c-4dbd-9f80-35d4d2621dea up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:32.898323 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d7e8df84-9e6d-4e1d-8a11-b2a1ada18cbc admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0f298b0647e84cc79385c8bd9e26dff4&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6233811 May 12 15:21:32.899320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34856) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:32.952208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 803ac615-40d5-4393-abcc-712ad84a11ed {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:21:32.952550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 803ac615-40d5-4393-abcc-712ad84a11ed not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:21:32.994647 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81f648a3-481b-4cf4-b05c-34fc736ee1d9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:32.997164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-11c24be5-f9d5-4a38-ac60-66741a8750d6 admin admin] Router 82fdce0c-213a-480d-a72d-d6fec22a5428 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:21:33.040085 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81f648a3-481b-4cf4-b05c-34fc736ee1d9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:33.059948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d2493b8-5b0e-4629-a5f7-f3a90f50960d None None] Network e9216267-d2ff-4740-934f-af19b9c825a0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:33.087362 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:33.098477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f703b3b0-d043-4148-99b7-819d3f1f7948 None None] For port 6559328b-364e-4433-8e8b-4b6b907b793c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6559328b-364e-4433-8e8b-4b6b907b793c,segment=NetworkSegment(cf597cb4-44a2-466d-867b-86ad3091743a),segment_id=cf597cb4-44a2-466d-867b-86ad3091743a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:33.179979 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55a23036-ff7a-4f0d-ad0a-556d7982e500 req-585379f3-3ce5-4acc-9685-b4cf346b05cf tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=de22b0a8-a494-4711-8630-31192ae0cb77 HTTP/1.1" status: 200 len: 210 time: 1.1816516 May 12 15:21:33.216299 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81f648a3-481b-4cf4-b05c-34fc736ee1d9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:33.224236 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:33.239534 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Transition to ACTIVE for port object f8447eb0-2acd-4fb0-840e-937cef316aa8 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:21:33.244881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81f648a3-481b-4cf4-b05c-34fc736ee1d9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=741e94d4-5b74-4583-8ee0-e67ced7944a0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:33.265910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Transition to ACTIVE for port object f8447eb0-2acd-4fb0-840e-937cef316aa8 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:21:33.305561 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f703b3b0-d043-4148-99b7-819d3f1f7948 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:33.326667 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81f648a3-481b-4cf4-b05c-34fc736ee1d9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:33.327948 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-81f648a3-481b-4cf4-b05c-34fc736ee1d9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/741e94d4-5b74-4583-8ee0-e67ced7944a0 HTTP/1.1" status: 204 len: 168 time: 0.4276166 May 12 15:21:33.395546 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:33.527586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Pushing event updated for resources: {'Subnet': ['ID=eae80ee9-f335-4892-af0b-41490fc3c6b5,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:33.541094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:33.541497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:33.541832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:33.542192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:33.542526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:33.542853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:33.543184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:33.543494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:33.544002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:33.544329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:33.544654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:33.544972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:33.551445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Checking segment: {'id': 'ccba5697-f062-48f7-986e-3317afc51896', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:21:33.551445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Network hostable DHCP agents. Network: e7794860-7444-4123-96d5-ca3febf5e162, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:21:33.573794 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:33.577724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Network e7794860-7444-4123-96d5-ca3febf5e162 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:21:33.617322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, e7794860-7444-4123-96d5-ca3febf5e162) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:33.634064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:33.636605 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:33.679064 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:33.691056 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-271cda3e-d429-4a71-a0c5-dd638d393b76 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.1773863 May 12 15:21:33.692952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34872) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:33.699251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueTestJSON-288887235-router', 'tenant_id': '9e2382be0c6f4779ae64026a57628773', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:33.710697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:33.721078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Usage tracker for resource:router and tenant:9e2382be0c6f4779ae64026a57628773 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:33.726801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:33.741432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:33.776872 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:33.778540 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:33.804200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c999ccb9-3978-4f48-bbc3-a2f56d6d4b8e None None] Network e7794860-7444-4123-96d5-ca3febf5e162 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:33.806579 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:33.810742 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:33.825912 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ce785187-df6c-4dbd-9f80-35d4d2621dea completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:21:33.847222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f703b3b0-d043-4148-99b7-819d3f1f7948 None None] Pushing event updated for resources: {'Port': ['ID=6559328b-364e-4433-8e8b-4b6b907b793c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:33.881297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-11c24be5-f9d5-4a38-ac60-66741a8750d6 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:21:34.059592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f041026-eec4-429c-9696-82e1d17ac048 None None] Sync routers for ids ['82fdce0c-213a-480d-a72d-d6fec22a5428'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:21:34.077677 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Pushing event updated for resources: {'Port': ['ID=f8447eb0-2acd-4fb0-840e-937cef316aa8,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:34.123706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Network bd2ab330-e973-403a-a5cd-1f870a5cee26 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:21:34.137474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:34.141166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:21:34.156387 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b089d4af-f692-41cf-92f7-96716965d57e None None] Provisioning for port ce785187-df6c-4dbd-9f80-35d4d2621dea completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:21:34.168830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f041026-eec4-429c-9696-82e1d17ac048 None None] Routers {'82fdce0c-213a-480d-a72d-d6fec22a5428'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:34.171317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3f041026-eec4-429c-9696-82e1d17ac048 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['82fdce0c-213a-480d-a72d-d6fec22a5428'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:34.173940 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-11c24be5-f9d5-4a38-ac60-66741a8750d6 admin admin] 10.222.0.82 "PUT /v2.0/routers/82fdce0c-213a-480d-a72d-d6fec22a5428/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 10.1080191 May 12 15:21:34.197179 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34884) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:34.263425 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:34.506648 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6559328b-364e-4433-8e8b-4b6b907b793c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:34.512377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34898) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:34.532327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Request body: {'security_group': {'name': 'tempest-securitygroup--2027795239', 'description': 'tempest-description--656489586'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:34.564596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:34.638607 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:34.639733 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b089d4af-f692-41cf-92f7-96716965d57e None None] Provisioning complete for port ce785187-df6c-4dbd-9f80-35d4d2621dea triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:34.640100 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b089d4af-f692-41cf-92f7-96716965d57e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:34.647124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Usage tracker for resource:security_group and tenant:4789db12ded14c2e8773d2396c9acd32 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:34.907032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:34.920083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34908) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:34.920845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Deleting port e4b82386-ff82-46dc-a56d-2762388c523f {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:34.921182 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:35.015037 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:35.058282 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:35.116922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:35.183079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Attempting to bind port f8447eb0-2acd-4fb0-840e-937cef316aa8 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:21:35.183473 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Attempting to bind port f8447eb0-2acd-4fb0-840e-937cef316aa8 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '1742cf6b-24d1-4c6c-9add-e38963a43ba0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': 'bd2ab330-e973-403a-a5cd-1f870a5cee26'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:21:35.183857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Attempting to bind port f8447eb0-2acd-4fb0-840e-937cef316aa8 on network bd2ab330-e973-403a-a5cd-1f870a5cee26 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:21:35.185908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 6559328b-364e-4433-8e8b-4b6b907b793c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:35.186567 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:35.224430 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:35.264741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] For port e4b82386-ff82-46dc-a56d-2762388c523f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e4b82386-ff82-46dc-a56d-2762388c523f,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:35.265465 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:35.294511 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:35.310359 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b089d4af-f692-41cf-92f7-96716965d57e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:35.332342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 21, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:21:35.332750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Checking segment: {'id': '1742cf6b-24d1-4c6c-9add-e38963a43ba0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': 'bd2ab330-e973-403a-a5cd-1f870a5cee26'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:21:35.333123 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:35.333569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Bound using segment: {'id': '1742cf6b-24d1-4c6c-9add-e38963a43ba0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': 'bd2ab330-e973-403a-a5cd-1f870a5cee26'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:21:35.334079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Bound port: f8447eb0-2acd-4fb0-840e-937cef316aa8, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1742cf6b-24d1-4c6c-9add-e38963a43ba0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': 'bd2ab330-e973-403a-a5cd-1f870a5cee26'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:21:35.335236 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:35.347856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Allocated IP 172.25.8.125 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/f98e71fb-41e6-42df-a52d-3c2ba1a4a299) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:21:35.445023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Request body: {'network': {'name': 'tempest-SecurityGroupRulesTestJSON-146742826-network', 'tenant_id': '67102e89b0f44ceb80da8f2ae55a97d3'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:35.457326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca5109fb-f550-4fba-8d77-f37976d3e601 None None] Network e7794860-7444-4123-96d5-ca3febf5e162 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:35.545763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-3f041026-eec4-429c-9696-82e1d17ac048 None None] Set router 82fdce0c-213a-480d-a72d-d6fec22a5428 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:21:35.571387 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Calling delete_port for e4b82386-ff82-46dc-a56d-2762388c523f owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:35.618627 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:35.619925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:35.622757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:35.653118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Usage tracker for resource:security_group_rule and tenant:4789db12ded14c2e8773d2396c9acd32 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:35.682569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:35.708112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:35.726515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Usage tracker for resource:network and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:35.734519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:35.740909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:35.777568 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:35.789942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Pushing event updated for resources: {'Port': ['ID=f98e71fb-41e6-42df-a52d-3c2ba1a4a299,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:35.809013 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:21:35.810379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:35.819322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:21:35.984479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Made reservation on behalf of 67102e89b0f44ceb80da8f2ae55a97d3 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:21:35.988598 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:35.993418 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b089d4af-f692-41cf-92f7-96716965d57e None None] For port ce785187-df6c-4dbd-9f80-35d4d2621dea, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce785187-df6c-4dbd-9f80-35d4d2621dea,segment=NetworkSegment(e2292273-67f3-4b0b-9739-5797d1f7e47f),segment_id=e2292273-67f3-4b0b-9739-5797d1f7e47f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:36.045176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Allocated IP 172.20.0.1 (e9216267-d2ff-4740-934f-af19b9c825a0/4e99b016-ec0d-4958-9013-a86d9c1e1fb7/843be0c7-90bb-4f5e-bdb8-b3267881699e) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:21:36.049004 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:36.100719 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b089d4af-f692-41cf-92f7-96716965d57e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:36.117269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:36.155307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Usage tracker for resource:security_group_rule and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:36.163538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:36.223698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b089d4af-f692-41cf-92f7-96716965d57e None None] Pushing event updated for resources: {'Port': ['ID=ce785187-df6c-4dbd-9f80-35d4d2621dea,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:36.252231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:36.303505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] For port f8447eb0-2acd-4fb0-840e-937cef316aa8, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:21:36.356210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] For port f8447eb0-2acd-4fb0-840e-937cef316aa8, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f8447eb0-2acd-4fb0-840e-937cef316aa8,segment=NetworkSegment(1742cf6b-24d1-4c6c-9add-e38963a43ba0),segment_id=1742cf6b-24d1-4c6c-9add-e38963a43ba0)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:21:36.359155 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4c9df507-5adc-499c-b37f-d003c9187bff None None] Provisioning complete for port 6559328b-364e-4433-8e8b-4b6b907b793c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:36.359686 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c9df507-5adc-499c-b37f-d003c9187bff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:36.372806 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:36.388926 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:36.406916 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:36.465089 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:36.520628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Pushing event updated for resources: {'SecurityGroup': ['ID=dccab3db-6ebb-412b-a448-1044f25ca467,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:36.523018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] Deleting port 42d2caf6-4185-4201-91dc-c0881fe15eea {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:36.523351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:36.553699 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:36.603858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62b32a01-6028-43a0-b6f7-bdb2b85f15a1 None None] Pushing event updated for resources: {'Port': ['ID=f8447eb0-2acd-4fb0-840e-937cef316aa8,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:36.613680 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3f041026-eec4-429c-9696-82e1d17ac048 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:21:30Z', 'revision_number': 5, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port': {'id': '42d2caf6-4185-4201-91dc-c0881fe15eea', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:0b:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'device_owner': 'network:router_gateway', 'standard_attr_id': 981, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:13:52Z', 'updated_at': '2022-05-12T15:14:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:36.618471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:36.618863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:36.619785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:36.620121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:36.620447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:36.620818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:36.621147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:36.621486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:36.621806 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:36.622144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:36.622436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:36.622749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:21:36.656831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f041026-eec4-429c-9696-82e1d17ac048 None None] Checking router: 82fdce0c-213a-480d-a72d-d6fec22a5428 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:21:36.692737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f041026-eec4-429c-9696-82e1d17ac048 None None] Routers {'82fdce0c-213a-480d-a72d-d6fec22a5428'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:36.693366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3f041026-eec4-429c-9696-82e1d17ac048 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['82fdce0c-213a-480d-a72d-d6fec22a5428'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:36.942570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-3f041026-eec4-429c-9696-82e1d17ac048 None None] Set router 82fdce0c-213a-480d-a72d-d6fec22a5428 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:21:37.033185 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:37.037538 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cf09042b-535f-4c28-aa13-a3ad476a82a3 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1781 time: 2.5215032 May 12 15:21:37.037538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] For port 42d2caf6-4185-4201-91dc-c0881fe15eea, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=42d2caf6-4185-4201-91dc-c0881fe15eea,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:37.037789 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:37.041107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34922) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:37.155086 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:37.261652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3f041026-eec4-429c-9696-82e1d17ac048 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:21:36Z', 'revision_number': 6, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:37.267538 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f041026-eec4-429c-9696-82e1d17ac048 None None] The sync data for ids ['82fdce0c-213a-480d-a72d-d6fec22a5428'] in n-d-841483-1 is: [{'id': '82fdce0c-213a-480d-a72d-d6fec22a5428', 'name': 'tempest-TaggedBootDevicesTest-1360490356-router', 'tenant_id': '42581a8af83242e0bb61f84a30bd27a7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:13:48Z', 'updated_at': '2022-05-12T15:21:36Z', 'revision_number': 6, 'project_id': '42581a8af83242e0bb61f84a30bd27a7', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:21:37.389688 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9d27ae99-a5bf-4851-9b1a-95b4e6988423 None None] Provisioning complete for port ce785187-df6c-4dbd-9f80-35d4d2621dea triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:37.390132 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9d27ae99-a5bf-4851-9b1a-95b4e6988423 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:37.489376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] Calling delete_port for 42d2caf6-4185-4201-91dc-c0881fe15eea owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:37.532236 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:37.537756 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event deleted for resources: {'Port': ['ID=e4b82386-ff82-46dc-a56d-2762388c523f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:37.615934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1b1ae37b-157d-4c44-8c6d-2299b62cd521 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Request body: {'security_group_rule': {'security_group_id': 'dccab3db-6ebb-412b-a448-1044f25ca467', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:37.634507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1b1ae37b-157d-4c44-8c6d-2299b62cd521 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:37.656809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1b1ae37b-157d-4c44-8c6d-2299b62cd521 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Usage tracker for resource:security_group_rule and tenant:4789db12ded14c2e8773d2396c9acd32 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:37.666225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1b1ae37b-157d-4c44-8c6d-2299b62cd521 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:37.681645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1b1ae37b-157d-4c44-8c6d-2299b62cd521 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:37.710648 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:37.779655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Transition to ACTIVE for port object 843be0c7-90bb-4f5e-bdb8-b3267881699e will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:21:37.835878 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:37.879452 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.000606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 575} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:21:38.035884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b1ae37b-157d-4c44-8c6d-2299b62cd521 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.065124 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.146382 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Router 8920755b-88bb-4da0-8c62-e9fdd7957b7d is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:21:38.296349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad01a2db-83e9-47d3-a95f-30789f973bc0 None None] Network bd2ab330-e973-403a-a5cd-1f870a5cee26 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:38.471532 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-01db44b4-07d7-4739-be7f-806747b0645c None None] Provisioning for port f8447eb0-2acd-4fb0-840e-937cef316aa8 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:21:38.472211 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.479524 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.513328 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.514026 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Added segment b8738567-af05-4709-a836-3104f41f85d6 of type vlan for network 5fd35e22-a617-45b1-9db5-23866cd0c735 May 12 15:21:38.528557 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.528557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 31de324f-60f7-49ba-bdfe-cb8bc79011d7 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:21:38.559026 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a1535ad-b137-4862-9e74-feb198d99967,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:38.574885 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b1ae37b-157d-4c44-8c6d-2299b62cd521 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.592750 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b1ae37b-157d-4c44-8c6d-2299b62cd521 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.606164 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.641579 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ce785187-df6c-4dbd-9f80-35d4d2621dea up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:38.655856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b1ae37b-157d-4c44-8c6d-2299b62cd521 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6db949d2-f0ac-45ed-96d5-8af56386bd0c,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:38.660940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:21:38.676063 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Sync routers for ids ['8920755b-88bb-4da0-8c62-e9fdd7957b7d'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:21:38.689834 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Routers {'8920755b-88bb-4da0-8c62-e9fdd7957b7d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:38.690871 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8920755b-88bb-4da0-8c62-e9fdd7957b7d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:38.725199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Network e9216267-d2ff-4740-934f-af19b9c825a0 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:21:38.739114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:38.753914 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.758821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:21:38.811370 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b1ae37b-157d-4c44-8c6d-2299b62cd521 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.816174 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1b1ae37b-157d-4c44-8c6d-2299b62cd521 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.7642274 May 12 15:21:38.816383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34932) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:38.819269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.823164 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6fb7cc39-e03d-486c-ac7d-5a3176755de2 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 5.1263211 May 12 15:21:38.823727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d5611b33-2440-41aa-9798-5c007ffae806 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Request body: {'security_group_rule': {'security_group_id': 'dccab3db-6ebb-412b-a448-1044f25ca467', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:38.828238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34936) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:38.860766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d5611b33-2440-41aa-9798-5c007ffae806 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:38.966549 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.967915 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-279842d5-e622-4f23-a98e-00dd520ac1d4 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "DELETE /v2.0/routers/31de324f-60f7-49ba-bdfe-cb8bc79011d7 HTTP/1.1" status: 204 len: 168 time: 7.1768281 May 12 15:21:38.968872 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:38.978648 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ce785187-df6c-4dbd-9f80-35d4d2621dea triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:38.979011 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.024914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34940) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:39.026267 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d5611b33-2440-41aa-9798-5c007ffae806 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Usage tracker for resource:security_group_rule and tenant:4789db12ded14c2e8773d2396c9acd32 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:39.035273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d5611b33-2440-41aa-9798-5c007ffae806 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:39.036041 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.041174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event updated for resources: {'Port': ['ID=843be0c7-90bb-4f5e-bdb8-b3267881699e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:39.054980 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:21:39.081010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d5611b33-2440-41aa-9798-5c007ffae806 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:39.097349 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1804826497', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}, 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:39.206926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:39.232976 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Set router 8920755b-88bb-4da0-8c62-e9fdd7957b7d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:21:39.264645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Usage tracker for resource:router and tenant:e87ae982708240299f16d4cfc5f73d5d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:39.273471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] Pushing event deleted for resources: {'Port': ['ID=42d2caf6-4185-4201-91dc-c0881fe15eea,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:39.283726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:39.323781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5611b33-2440-41aa-9798-5c007ffae806 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.375210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa905483-ff32-44b6-8da3-ff2ac0092328 None None] Provisioning for port 843be0c7-90bb-4f5e-bdb8-b3267881699e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:21:39.396638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa905483-ff32-44b6-8da3-ff2ac0092328 None None] Provisioning complete for port 843be0c7-90bb-4f5e-bdb8-b3267881699e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:39.396928 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa905483-ff32-44b6-8da3-ff2ac0092328 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.455926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:39.458767 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.522643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fa905483-ff32-44b6-8da3-ff2ac0092328 None None] Port 843be0c7-90bb-4f5e-bdb8-b3267881699e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:21:39.559015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f8447eb0-2acd-4fb0-840e-937cef316aa8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:39.651000 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5611b33-2440-41aa-9798-5c007ffae806 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.661076 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5611b33-2440-41aa-9798-5c007ffae806 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.676351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.679841 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.692652 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'name': 'tempest-ServerRescueTestJSON-288887235-router', 'tenant_id': '9e2382be0c6f4779ae64026a57628773', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125'}], 'enable_snat': True}, 'gw_port_id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:33Z', 'updated_at': '2022-05-12T15:21:36Z', 'revision_number': 3, 'project_id': '9e2382be0c6f4779ae64026a57628773', 'gw_port': {'id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:21:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1535, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:35Z', 'updated_at': '2022-05-12T15:21:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:39.710006 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Checking router: 8920755b-88bb-4da0-8c62-e9fdd7957b7d for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:21:39.710349 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Updating router 8920755b-88bb-4da0-8c62-e9fdd7957b7d port f98e71fb-41e6-42df-a52d-3c2ba1a4a299 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:21:39.711252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f8447eb0-2acd-4fb0-840e-937cef316aa8 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:21:39.722268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f8447eb0-2acd-4fb0-840e-937cef316aa8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:39.722909 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.732088 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.733176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:39.734144 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.755526 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.756060 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 82fdce0c-213a-480d-a72d-d6fec22a5428 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:21:39.815863 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.816948 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.857290 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.871929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5611b33-2440-41aa-9798-5c007ffae806 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b5229997-ee9e-4279-bc37-36159a4273f2,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:39.873162 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.958580 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5611b33-2440-41aa-9798-5c007ffae806 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:39.960241 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d5611b33-2440-41aa-9798-5c007ffae806 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.1429968 May 12 15:21:39.978321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34948) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:39.991268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:40.077849 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:40.134274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:40.156332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-664517f9-d7ce-4685-a186-29e19481281c None None] Provisioning complete for port f8447eb0-2acd-4fb0-840e-937cef316aa8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:40.157088 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-664517f9-d7ce-4685-a186-29e19481281c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:40.205090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Usage tracker for resource:floatingip and tenant:4789db12ded14c2e8773d2396c9acd32 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:40.228905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:40.245419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:40.292640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port f8447eb0-2acd-4fb0-840e-937cef316aa8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f8447eb0-2acd-4fb0-840e-937cef316aa8,segment=NetworkSegment(1742cf6b-24d1-4c6c-9add-e38963a43ba0),segment_id=1742cf6b-24d1-4c6c-9add-e38963a43ba0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:40.412147 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:40.467074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:40.647771 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=f8447eb0-2acd-4fb0-840e-937cef316aa8,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:40.653813 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:40.671936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 27d87447-eec9-4938-9dce-782d012459ac no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:40.684916 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Transition to ACTIVE for port object f98e71fb-41e6-42df-a52d-3c2ba1a4a299 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:21:40.707365 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:40.760775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 27d87447-eec9-4938-9dce-782d012459ac {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:21:40.761093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 27d87447-eec9-4938-9dce-782d012459ac not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:21:40.761511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 42d2caf6-4185-4201-91dc-c0881fe15eea no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:40.805245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 42d2caf6-4185-4201-91dc-c0881fe15eea {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:21:40.805635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 42d2caf6-4185-4201-91dc-c0881fe15eea not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:21:40.817506 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:40.883714 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78650f51-a522-48a4-b672-0b0718e7ff21 None None] Pushing event updated for resources: {'Port': ['ID=f98e71fb-41e6-42df-a52d-3c2ba1a4a299,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:40.903808 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 5.8149729 May 12 15:21:40.907065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34960) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:40.915092 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Attempting to bind port f98e71fb-41e6-42df-a52d-3c2ba1a4a299 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:21:40.917970 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Attempting to bind port f98e71fb-41e6-42df-a52d-3c2ba1a4a299 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:21:40.918518 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Attempting to bind port f98e71fb-41e6-42df-a52d-3c2ba1a4a299 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:21:40.921008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Request body: {'subnet': {'network_id': '5fd35e22-a617-45b1-9db5-23866cd0c735', 'cidr': '172.20.0.0/28', 'name': 'tempest-SecurityGroupRulesTestJSON-146742826-subnet', 'tenant_id': '67102e89b0f44ceb80da8f2ae55a97d3', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:40.930645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f384992a-0606-4208-9739-bf4f3d179df1 admin admin] Pushing event updated for resources: {'Network': ['ID=5fd35e22-a617-45b1-9db5-23866cd0c735,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:40.931560 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 21, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:21:40.931939 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:21:40.933336 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:40.936175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:40.936351 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:21:40.936351 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Bound port: f98e71fb-41e6-42df-a52d-3c2ba1a4a299, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:21:40.936765 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:40.946505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 5fd35e22-a617-45b1-9db5-23866cd0c735 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:21:40.959528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Usage tracker for resource:subnet and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:40.963183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:40.981116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f8447eb0-2acd-4fb0-840e-937cef316aa8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:41.002394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:41.031984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:41.033498 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:41.034138 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-919f9f2e-a383-4aac-8800-265829fc785e admin admin] 10.222.0.82 "DELETE /v2.0/routers/82fdce0c-213a-480d-a72d-d6fec22a5428 HTTP/1.1" status: 204 len: 168 time: 6.8358083 May 12 15:21:41.048727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34964) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:41.073424 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] For port f98e71fb-41e6-42df-a52d-3c2ba1a4a299, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:21:41.075203 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:41.081643 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] For port f98e71fb-41e6-42df-a52d-3c2ba1a4a299, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f98e71fb-41e6-42df-a52d-3c2ba1a4a299,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:21:41.097160 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:41.194082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Allocated IP 172.25.8.195 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/7e956cfd-ea61-49e2-ad47-2c4efb5430e3) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:21:41.203345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f8447eb0-2acd-4fb0-840e-937cef316aa8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:41.203720 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:41.256860 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Routers {'8920755b-88bb-4da0-8c62-e9fdd7957b7d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:41.257524 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8920755b-88bb-4da0-8c62-e9fdd7957b7d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:41.387875 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:41.405301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Made reservation on behalf of 67102e89b0f44ceb80da8f2ae55a97d3 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:21:41.409906 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:41.500257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e4b82386-ff82-46dc-a56d-2762388c523f no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:41.557283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-98675040-cb19-4438-8a43-ab318e19e796 admin admin] Deleting subnet c7af977d-fe6b-4182-af40-d4c2523b54a3 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:21:41.560232 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98675040-cb19-4438-8a43-ab318e19e796 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:41.569329 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: e4b82386-ff82-46dc-a56d-2762388c523f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:21:41.569588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e4b82386-ff82-46dc-a56d-2762388c523f not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:21:41.612811 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98675040-cb19-4438-8a43-ab318e19e796 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:41.614678 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] Set router 8920755b-88bb-4da0-8c62-e9fdd7957b7d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:21:41.693181 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98675040-cb19-4438-8a43-ab318e19e796 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:41.735526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Allocated IP 172.20.0.1 (e7794860-7444-4123-96d5-ca3febf5e162/eae80ee9-f335-4892-af0b-41490fc3c6b5/26754046-3c27-423b-a836-8c5b0f061d5a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:21:41.787217 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98675040-cb19-4438-8a43-ab318e19e796 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:41.815191 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78650f51-a522-48a4-b672-0b0718e7ff21 None None] Pushing event updated for resources: {'Port': ['ID=f98e71fb-41e6-42df-a52d-3c2ba1a4a299,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:41.849835 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98675040-cb19-4438-8a43-ab318e19e796 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:41.856065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d1e3cb1-d653-410b-a518-c555553e7da1 None None] Network 939fdac4-3043-4213-bd31-a421a6c659bc requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:41.859915 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-98675040-cb19-4438-8a43-ab318e19e796 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/c7af977d-fe6b-4182-af40-d4c2523b54a3 HTTP/1.1" status: 204 len: 168 time: 0.7883899 May 12 15:21:41.860819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98675040-cb19-4438-8a43-ab318e19e796 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c7af977d-fe6b-4182-af40-d4c2523b54a3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:41.866139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34974) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:41.927530 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:41.963692 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:41.998448 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:42.027636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Deleting port dd07ec66-993d-4fad-af43-9102ed08c6af {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:42.028141 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:42.042302 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'name': 'tempest-ServerRescueTestJSON-288887235-router', 'tenant_id': '9e2382be0c6f4779ae64026a57628773', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125'}], 'enable_snat': True}, 'gw_port_id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:33Z', 'updated_at': '2022-05-12T15:21:36Z', 'revision_number': 3, 'project_id': '9e2382be0c6f4779ae64026a57628773', 'gw_port': {'id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:21:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1535, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:35Z', 'updated_at': '2022-05-12T15:21:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:42.046913 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c2178ec-8627-401b-8efb-8c92a6e1ebbd None None] The sync data for ids ['8920755b-88bb-4da0-8c62-e9fdd7957b7d'] in n-d-841483-1 is: [{'id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'name': 'tempest-ServerRescueTestJSON-288887235-router', 'tenant_id': '9e2382be0c6f4779ae64026a57628773', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125'}], 'enable_snat': True}, 'gw_port_id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:33Z', 'updated_at': '2022-05-12T15:21:36Z', 'revision_number': 3, 'project_id': '9e2382be0c6f4779ae64026a57628773', 'gw_port': {'id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:21:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1535, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:35Z', 'updated_at': '2022-05-12T15:21:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:21:42.070820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Pushing event updated for resources: {'Port': ['ID=26754046-3c27-423b-a836-8c5b0f061d5a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:42.098093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Network e7794860-7444-4123-96d5-ca3febf5e162 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:21:42.103120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:42.112941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:21:42.235343 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:42.245264 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:42.506011 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b69c6f01-8490-42a1-af75-3f9bb3c05b1f None None] DHCP port deletion for 939fdac4-3043-4213-bd31-a421a6c659bc request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:21:42.512279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b69c6f01-8490-42a1-af75-3f9bb3c05b1f None None] Deleting port dd07ec66-993d-4fad-af43-9102ed08c6af {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:42.512862 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b69c6f01-8490-42a1-af75-3f9bb3c05b1f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:42.635015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] For port dd07ec66-993d-4fad-af43-9102ed08c6af, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=dd07ec66-993d-4fad-af43-9102ed08c6af,segment=NetworkSegment(7c4990b9-5a5f-484e-a357-c9a37d811129),segment_id=7c4990b9-5a5f-484e-a357-c9a37d811129)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:42.635583 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:42.644474 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:42.705524 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:42.823926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b69c6f01-8490-42a1-af75-3f9bb3c05b1f None None] For port dd07ec66-993d-4fad-af43-9102ed08c6af, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=dd07ec66-993d-4fad-af43-9102ed08c6af,segment=NetworkSegment(7c4990b9-5a5f-484e-a357-c9a37d811129),segment_id=7c4990b9-5a5f-484e-a357-c9a37d811129)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:42.824592 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b69c6f01-8490-42a1-af75-3f9bb3c05b1f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:42.965129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:21:42.972845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Checking segment: {'id': 'b8738567-af05-4709-a836-3104f41f85d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': '5fd35e22-a617-45b1-9db5-23866cd0c735'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:21:42.973710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Network hostable DHCP agents. Network: 5fd35e22-a617-45b1-9db5-23866cd0c735, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:21:42.989192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:42.994572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b8720075-d50c-4374-a8ba-4140078ca9f1,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:42.997791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:21:43.010721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b69c6f01-8490-42a1-af75-3f9bb3c05b1f None None] Calling delete_port for dd07ec66-993d-4fad-af43-9102ed08c6af owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:43.044168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f98e71fb-41e6-42df-a52d-3c2ba1a4a299 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:43.060493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Calling delete_port for dd07ec66-993d-4fad-af43-9102ed08c6af owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:43.088003 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.110400 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] It took 0.45 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:21:43.149315 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-aad255a0-1be9-410c-887d-643ff806dc19 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.210991 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.223359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f98e71fb-41e6-42df-a52d-3c2ba1a4a299 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:21:43.230882 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b69c6f01-8490-42a1-af75-3f9bb3c05b1f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.260955 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.276212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Pushing event updated for resources: {'Port': ['ID=7e956cfd-ea61-49e2-ad47-2c4efb5430e3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:43.279801 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.295951 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.348501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f98e71fb-41e6-42df-a52d-3c2ba1a4a299 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:43.348910 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.360194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Network 5fd35e22-a617-45b1-9db5-23866cd0c735 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:21:43.391115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b69c6f01-8490-42a1-af75-3f9bb3c05b1f None None] No DVR routers for this DVR port dd07ec66-993d-4fad-af43-9102ed08c6af on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:21:43.400728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 5fd35e22-a617-45b1-9db5-23866cd0c735) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:43.403915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b69c6f01-8490-42a1-af75-3f9bb3c05b1f None None] Pushing event deleted for resources: {'Port': ['ID=dd07ec66-993d-4fad-af43-9102ed08c6af,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:43.407691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:43.408635 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.418686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a8bf3e3-a5ca-418a-a903-16d833013a35 None None] Network 5fd35e22-a617-45b1-9db5-23866cd0c735 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:43.421602 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.508725 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.604092 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:21:43.604403 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:21:43.626574 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.657004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event updated for resources: {'Port': ['ID=843be0c7-90bb-4f5e-bdb8-b3267881699e,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:43.666559 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-92363647-fa8e-4850-9d90-2cc73acdddd5 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 2.7563779 May 12 15:21:43.675579 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.734066 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.762403 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port f98e71fb-41e6-42df-a52d-3c2ba1a4a299, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f98e71fb-41e6-42df-a52d-3c2ba1a4a299,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:43.781908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.799238 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.799904 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.882255 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58c3a618-4fdb-4b42-b2c7-8a8f27ed595c None None] Network 5fd35e22-a617-45b1-9db5-23866cd0c735 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:43.922995 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dd07ec66-993d-4fad-af43-9102ed08c6af no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:43.931170 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:43.972737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Allocated IP 172.25.8.26 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/8719cc60-3862-418d-92c9-555ff81643c2) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:21:44.032008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Network e9216267-d2ff-4740-934f-af19b9c825a0 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:21:44.058201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: dd07ec66-993d-4fad-af43-9102ed08c6af {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:21:44.058620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dd07ec66-993d-4fad-af43-9102ed08c6af not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:21:44.081266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:44.091963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-6d0e3db7-d827-4332-bf7a-1d4d2cbd3515 req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-1801523407', 'description': 'tempest-description-1452329442'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:44.098846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-6d0e3db7-d827-4332-bf7a-1d4d2cbd3515 req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:44.103228 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6d0e3db7-d827-4332-bf7a-1d4d2cbd3515 req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:44.107125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Deleting port dd07ec66-993d-4fad-af43-9102ed08c6af {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:44.107125 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:44.113670 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=f98e71fb-41e6-42df-a52d-3c2ba1a4a299,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:44.134244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Pushing event updated for resources: {'Port': ['ID=26754046-3c27-423b-a836-8c5b0f061d5a,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:44.142577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6d0e3db7-d827-4332-bf7a-1d4d2cbd3515 req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:44.181342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-6d0e3db7-d827-4332-bf7a-1d4d2cbd3515 req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:44.234446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] The port 'dd07ec66-993d-4fad-af43-9102ed08c6af' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:21:44.245333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc973563-0c9e-4d31-a3ed-ce77776afb4f req-8db98d04-94b9-4bf2-b73e-32e13ae05c06 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:44.246424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc973563-0c9e-4d31-a3ed-ce77776afb4f req-8db98d04-94b9-4bf2-b73e-32e13ae05c06 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 946 time: 0.4899988 May 12 15:21:44.247200 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6d0e3db7-d827-4332-bf7a-1d4d2cbd3515 req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:44.372006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Network e7794860-7444-4123-96d5-ca3febf5e162 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:21:44.374611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:44.488217 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:44.494151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-63e169cc-fd02-41a1-9a28-10a1bf282ec6 None None] Provisioning complete for port 843be0c7-90bb-4f5e-bdb8-b3267881699e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:44.494979 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-63e169cc-fd02-41a1-9a28-10a1bf282ec6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:44.523753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-6d0e3db7-d827-4332-bf7a-1d4d2cbd3515 req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:44.552737 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:44.557948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-63e169cc-fd02-41a1-9a28-10a1bf282ec6 None None] Port 843be0c7-90bb-4f5e-bdb8-b3267881699e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:21:44.691547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Pushing event updated for resources: {'Port': ['ID=7e956cfd-ea61-49e2-ad47-2c4efb5430e3,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:44.713164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6d0e3db7-d827-4332-bf7a-1d4d2cbd3515 req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group_rule and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:44.713448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Router 8920755b-88bb-4da0-8c62-e9fdd7957b7d has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:21:44.714327 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:44.727014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6d0e3db7-d827-4332-bf7a-1d4d2cbd3515 req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:44.758287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-6d0e3db7-d827-4332-bf7a-1d4d2cbd3515 req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:44.778585 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc973563-0c9e-4d31-a3ed-ce77776afb4f req-4d3a3dd0-d11e-4597-9c86-154d0e1a1408 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5212948 May 12 15:21:44.787879 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:44.792761 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:44.795344 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:44.796193 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5014eb79-7ead-4472-b903-821a126dd397 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.8162961 May 12 15:21:44.829415 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-977df7c8-8235-479f-8e0f-38282c459763 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:44.865988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['939fdac4-3043-4213-bd31-a421a6c659bc']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:44.897942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7c4990b9-5a5f-484e-a357-c9a37d811129') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:44.898262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7c4990b9-5a5f-484e-a357-c9a37d811129') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:44.925576 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:44.936820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:21:44.943200 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5cd7fe21-f817-41e3-96ff-b4531dae023e admin admin] 10.222.0.82 "PUT /v2.0/routers/8920755b-88bb-4da0-8c62-e9fdd7957b7d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.0844967 May 12 15:21:44.949074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Sync routers for ids ['8920755b-88bb-4da0-8c62-e9fdd7957b7d'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:21:44.964297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f98e71fb-41e6-42df-a52d-3c2ba1a4a299 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:44.983590 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:45.011512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Releasing vlan 550 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:21:45.011512 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: timer() May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:21:45.028547 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:21:45.035760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Routers {'8920755b-88bb-4da0-8c62-e9fdd7957b7d'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:45.036477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8920755b-88bb-4da0-8c62-e9fdd7957b7d'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:45.050016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Router 0a20e216-0f20-463c-92e2-94e5c5a92acd is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:21:45.106763 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6d0e3db7-d827-4332-bf7a-1d4d2cbd3515 req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:45.210001 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:45.213453 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6d0e3db7-d827-4332-bf7a-1d4d2cbd3515 req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:45.291885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f98e71fb-41e6-42df-a52d-3c2ba1a4a299 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:45.292186 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:45.331372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Pushing event updated for resources: {'Port': ['ID=8719cc60-3862-418d-92c9-555ff81643c2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:45.352434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Set router 8920755b-88bb-4da0-8c62-e9fdd7957b7d gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:21:45.450068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:21:45.450982 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:45.456058 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:45.481843 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:45.484579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:21:45.566422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6464c06f-18f1-44f2-b445-c0d4145846c8,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:45.569528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] Pushing event deleted for resources: {'Network': ['ID=939fdac4-3043-4213-bd31-a421a6c659bc,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:45.636368 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6d0e3db7-d827-4332-bf7a-1d4d2cbd3515 req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:45.637669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d0e3db7-d827-4332-bf7a-1d4d2cbd3515 req-6d949032-9cad-43f3-9d3f-83dd2184cec0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1812 time: 1.5493941 May 12 15:21:45.639032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a81f2382-b6db-448d-95c8-b4e6dfb1ee0e admin admin] 10.222.0.82 "DELETE /v2.0/networks/939fdac4-3043-4213-bd31-a421a6c659bc HTTP/1.1" status: 204 len: 168 time: 3.7670143 May 12 15:21:45.642616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35042) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:45.673153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:21:45.678365 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-184739fa-a127-4ebb-a8fd-98d1a82d3782 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "PUT /v2.0/routers/0a20e216-0f20-463c-92e2-94e5c5a92acd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 14.9353817 May 12 15:21:45.683594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35050) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:45.692114 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb1db008-2a8e-4c22-a6ab-bf57051b5327 None None] Sync routers for ids ['0a20e216-0f20-463c-92e2-94e5c5a92acd'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:21:45.706980 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb1db008-2a8e-4c22-a6ab-bf57051b5327 None None] Routers {'0a20e216-0f20-463c-92e2-94e5c5a92acd'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:45.708236 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-cb1db008-2a8e-4c22-a6ab-bf57051b5327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0a20e216-0f20-463c-92e2-94e5c5a92acd'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:45.787347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'name': 'tempest-ServerRescueTestJSON-288887235-router', 'tenant_id': '9e2382be0c6f4779ae64026a57628773', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125'}], 'enable_snat': True}, 'gw_port_id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:33Z', 'updated_at': '2022-05-12T15:21:42Z', 'revision_number': 4, 'project_id': '9e2382be0c6f4779ae64026a57628773', 'gw_port': {'id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:21:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1535, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:35Z', 'updated_at': '2022-05-12T15:21:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '26754046-3c27-423b-a836-8c5b0f061d5a', 'name': '', 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162', 'tenant_id': '9e2382be0c6f4779ae64026a57628773', 'mac_address': 'fa:16:3e:b9:b7:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1550, 'fixed_ips': [{'subnet_id': 'eae80ee9-f335-4892-af0b-41490fc3c6b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:41Z', 'updated_at': '2022-05-12T15:21:43Z', 'revision_number': 2, 'project_id': '9e2382be0c6f4779ae64026a57628773', 'subnets': [{'id': 'eae80ee9-f335-4892-af0b-41490fc3c6b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:45.792988 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Checking router: 8920755b-88bb-4da0-8c62-e9fdd7957b7d for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:21:45.793620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Updating router 8920755b-88bb-4da0-8c62-e9fdd7957b7d port 26754046-3c27-423b-a836-8c5b0f061d5a binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:21:45.802186 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-cb1db008-2a8e-4c22-a6ab-bf57051b5327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:45.812616 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb1db008-2a8e-4c22-a6ab-bf57051b5327 None None] Routers {'0a20e216-0f20-463c-92e2-94e5c5a92acd'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:45.813682 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-cb1db008-2a8e-4c22-a6ab-bf57051b5327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0a20e216-0f20-463c-92e2-94e5c5a92acd'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:45.887137 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-cb1db008-2a8e-4c22-a6ab-bf57051b5327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:45.887836 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb1db008-2a8e-4c22-a6ab-bf57051b5327 None None] The sync data for ids ['0a20e216-0f20-463c-92e2-94e5c5a92acd'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:21:45.899053 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:46.048589 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:46.163744 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:46.248429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-5f3201fc-a5ec-40ee-8ca9-40880169f282 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:46.250198 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-5f3201fc-a5ec-40ee-8ca9-40880169f282 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/networks?id=670dbecd-f547-4abf-b069-62f0c8712c6b HTTP/1.1" status: 200 len: 822 time: 0.7912197 May 12 15:21:46.328872 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:46.343625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Transition to ACTIVE for port object 26754046-3c27-423b-a836-8c5b0f061d5a will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:21:46.351671 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:46.395407 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c799fab0-13d4-44a3-93fc-be66b885cf06 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:46.496653 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7901fa8-5411-43c3-bf12-f86790090e77 None None] Pushing event updated for resources: {'Port': ['ID=26754046-3c27-423b-a836-8c5b0f061d5a,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:46.595758 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-ddc8c928-6b35-4c39-814d-4f3ef9a4217a tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/quotas/4789db12ded14c2e8773d2396c9acd32 HTTP/1.1" status: 200 len: 375 time: 0.2734947 May 12 15:21:46.602001 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Attempting to bind port 26754046-3c27-423b-a836-8c5b0f061d5a on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:21:46.602363 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Attempting to bind port 26754046-3c27-423b-a836-8c5b0f061d5a by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ccba5697-f062-48f7-986e-3317afc51896', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:21:46.602720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Attempting to bind port 26754046-3c27-423b-a836-8c5b0f061d5a on network e7794860-7444-4123-96d5-ca3febf5e162 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:21:46.608164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 21, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:21:46.608528 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Checking segment: {'id': 'ccba5697-f062-48f7-986e-3317afc51896', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:21:46.608922 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:46.609302 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Bound using segment: {'id': 'ccba5697-f062-48f7-986e-3317afc51896', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:21:46.609848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Bound port: 26754046-3c27-423b-a836-8c5b0f061d5a, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ccba5697-f062-48f7-986e-3317afc51896', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:21:46.610324 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:46.710509 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] For port 26754046-3c27-423b-a836-8c5b0f061d5a, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:21:46.714611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] For port 26754046-3c27-423b-a836-8c5b0f061d5a, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=26754046-3c27-423b-a836-8c5b0f061d5a,segment=NetworkSegment(ccba5697-f062-48f7-986e-3317afc51896),segment_id=ccba5697-f062-48f7-986e-3317afc51896)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:21:46.720365 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:46.739577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-f4521a43-4bb5-47e6-8aa4-1a771717c7c4 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:46.741131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-f4521a43-4bb5-47e6-8aa4-1a771717c7c4 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/networks?id=e7794860-7444-4123-96d5-ca3febf5e162 HTTP/1.1" status: 200 len: 810 time: 0.8191729 May 12 15:21:46.786946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c799fab0-13d4-44a3-93fc-be66b885cf06 admin admin] Deleting port 2b0f41b8-aaa6-4b9c-b597-703f558651d5 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:46.786946 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c799fab0-13d4-44a3-93fc-be66b885cf06 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:46.802957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7901fa8-5411-43c3-bf12-f86790090e77 None None] Pushing event updated for resources: {'Port': ['ID=26754046-3c27-423b-a836-8c5b0f061d5a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:46.822177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Routers {'8920755b-88bb-4da0-8c62-e9fdd7957b7d'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:46.823188 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8920755b-88bb-4da0-8c62-e9fdd7957b7d'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:46.865522 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-3f1cf350-e917-402e-9379-1cb34d1e6ea2 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/quotas/9e2382be0c6f4779ae64026a57628773 HTTP/1.1" status: 200 len: 375 time: 0.0637724 May 12 15:21:46.979372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-c799fab0-13d4-44a3-93fc-be66b885cf06 admin admin] For port 2b0f41b8-aaa6-4b9c-b597-703f558651d5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2b0f41b8-aaa6-4b9c-b597-703f558651d5,segment=NetworkSegment(9a5ce622-a3ea-4c31-b698-fca2808b112c),segment_id=9a5ce622-a3ea-4c31-b698-fca2808b112c)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:46.979778 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c799fab0-13d4-44a3-93fc-be66b885cf06 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:47.066098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 860dc344-70ad-4ff8-9592-ee8e988a4f26 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:47.066704 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:47.111645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c799fab0-13d4-44a3-93fc-be66b885cf06 admin admin] Calling delete_port for 2b0f41b8-aaa6-4b9c-b597-703f558651d5 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:47.170139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] Set router 8920755b-88bb-4da0-8c62-e9fdd7957b7d gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:21:47.332489 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3aafa095-ef5f-43ee-b303-bf228639a142 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4789db12ded14c2e8773d2396c9acd32&fields=id HTTP/1.1" status: 200 len: 255 time: 0.6728466 May 12 15:21:47.432850 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:47.463267 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c799fab0-13d4-44a3-93fc-be66b885cf06 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:47.482916 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:47.487656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:21:47.495115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:47.513146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c799fab0-13d4-44a3-93fc-be66b885cf06 admin admin] Pushing event deleted for resources: {'Port': ['ID=2b0f41b8-aaa6-4b9c-b597-703f558651d5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:47.560803 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-ae975a2e-ff67-4625-8db5-577aeb9c4dd0 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=9e2382be0c6f4779ae64026a57628773&fields=id HTTP/1.1" status: 200 len: 255 time: 0.6856637 May 12 15:21:47.691601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=11']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:47.708345 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:47.725257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'name': 'tempest-ServerRescueTestJSON-288887235-router', 'tenant_id': '9e2382be0c6f4779ae64026a57628773', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125'}], 'enable_snat': True}, 'gw_port_id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:33Z', 'updated_at': '2022-05-12T15:21:42Z', 'revision_number': 4, 'project_id': '9e2382be0c6f4779ae64026a57628773', 'gw_port': {'id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:21:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1535, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:35Z', 'updated_at': '2022-05-12T15:21:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '26754046-3c27-423b-a836-8c5b0f061d5a', 'name': '', 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162', 'tenant_id': '9e2382be0c6f4779ae64026a57628773', 'mac_address': 'fa:16:3e:b9:b7:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1550, 'fixed_ips': [{'subnet_id': 'eae80ee9-f335-4892-af0b-41490fc3c6b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:41Z', 'updated_at': '2022-05-12T15:21:46Z', 'revision_number': 4, 'project_id': '9e2382be0c6f4779ae64026a57628773', 'subnets': [{'id': 'eae80ee9-f335-4892-af0b-41490fc3c6b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:47.729991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c592a5c0-c286-4900-a349-04a84c55fb5b None None] The sync data for ids ['8920755b-88bb-4da0-8c62-e9fdd7957b7d'] in n-d-841483-1 is: [{'id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'name': 'tempest-ServerRescueTestJSON-288887235-router', 'tenant_id': '9e2382be0c6f4779ae64026a57628773', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125'}], 'enable_snat': True}, 'gw_port_id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:33Z', 'updated_at': '2022-05-12T15:21:42Z', 'revision_number': 4, 'project_id': '9e2382be0c6f4779ae64026a57628773', 'gw_port': {'id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:21:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1535, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:35Z', 'updated_at': '2022-05-12T15:21:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '26754046-3c27-423b-a836-8c5b0f061d5a', 'name': '', 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162', 'tenant_id': '9e2382be0c6f4779ae64026a57628773', 'mac_address': 'fa:16:3e:b9:b7:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1550, 'fixed_ips': [{'subnet_id': 'eae80ee9-f335-4892-af0b-41490fc3c6b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:41Z', 'updated_at': '2022-05-12T15:21:46Z', 'revision_number': 4, 'project_id': '9e2382be0c6f4779ae64026a57628773', 'subnets': [{'id': 'eae80ee9-f335-4892-af0b-41490fc3c6b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:21:47.734888 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-79c064a9-eb42-4f9b-9a30-0b3cc8517e9f tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:21:47.739810 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-79c064a9-eb42-4f9b-9a30-0b3cc8517e9f tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "PUT /v2.0/routers/0a20e216-0f20-463c-92e2-94e5c5a92acd/add_router_interface HTTP/1.1" status: 400 len: 438 time: 1.8194289 May 12 15:21:47.740539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35066) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:48.005314 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c799fab0-13d4-44a3-93fc-be66b885cf06 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:48.132143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-e261b228-c286-4261-99ff-231252ef0a39 service neutron] 10.222.0.82 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7826798 May 12 15:21:48.307106 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:48.391940 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-cb0a9e12-0cb5-49b5-b042-a2bf809f8fec service neutron] 10.222.0.82 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8096678 May 12 15:21:48.418310 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c799fab0-13d4-44a3-93fc-be66b885cf06 admin admin] Router 9b2fa912-d414-4854-a39a-4ff1d3393c44 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:21:48.634942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c799fab0-13d4-44a3-93fc-be66b885cf06 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:21:48.649086 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c799fab0-13d4-44a3-93fc-be66b885cf06 admin admin] 10.222.0.82 "PUT /v2.0/routers/9b2fa912-d414-4854-a39a-4ff1d3393c44/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0036540 May 12 15:21:48.651511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35072) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:48.655998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7e400d9-7f69-464d-a1df-cb4c08b35f84 None None] Sync routers for ids ['9b2fa912-d414-4854-a39a-4ff1d3393c44'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:21:48.671112 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7e400d9-7f69-464d-a1df-cb4c08b35f84 None None] Routers {'9b2fa912-d414-4854-a39a-4ff1d3393c44'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:48.671853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c7e400d9-7f69-464d-a1df-cb4c08b35f84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9b2fa912-d414-4854-a39a-4ff1d3393c44'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:48.956730 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-2335d67b-7eab-444b-877a-e02fe8c64d34 service neutron] 10.222.0.82 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8121016 May 12 15:21:48.959469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c7e400d9-7f69-464d-a1df-cb4c08b35f84 None None] Set router 9b2fa912-d414-4854-a39a-4ff1d3393c44 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:21:48.983672 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-11a80f51-6683-4d0c-b559-23dfc277b4e5 service neutron] 10.222.0.82 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5381570 May 12 15:21:49.056560 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:49.123136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Router 252b9228-6855-4c38-8dc5-a270efa179ff is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:21:49.189452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 860dc344-70ad-4ff8-9592-ee8e988a4f26 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:21:49.191639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 26754046-3c27-423b-a836-8c5b0f061d5a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:49.438976 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06af944d-0be3-4146-a417-ca9c20dd5a3b req-f8cb59ec-5fe4-4401-a6a8-946db19e923f service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.1051543 May 12 15:21:49.627522 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:21:49.631326 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d851aa37-e700-4aa5-a024-3e8b7812b44e req-bc142bbb-820b-4aa5-a141-4635b3e9f408 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/6464c06f-18f1-44f2-b445-c0d4145846c8 HTTP/1.1" status: 200 len: 1807 time: 0.2398057 May 12 15:21:49.656578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 26754046-3c27-423b-a836-8c5b0f061d5a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:21:49.671353 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 26754046-3c27-423b-a836-8c5b0f061d5a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:49.671854 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:49.689056 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:49.713137 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06af944d-0be3-4146-a417-ca9c20dd5a3b req-32efa686-fb94-4c97-a057-7ba57f9b08a7 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.1381681 May 12 15:21:49.722060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] Deleting port 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:49.722534 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:49.728775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-d851aa37-e700-4aa5-a024-3e8b7812b44e req-f15aab00-1219-4f53-b606-dffdd2f368b2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '6464c06f-18f1-44f2-b445-c0d4145846c8', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:49.729080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-d851aa37-e700-4aa5-a024-3e8b7812b44e req-f15aab00-1219-4f53-b606-dffdd2f368b2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '6464c06f-18f1-44f2-b445-c0d4145846c8', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:49.770654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-d851aa37-e700-4aa5-a024-3e8b7812b44e req-f15aab00-1219-4f53-b606-dffdd2f368b2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:49.800973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d851aa37-e700-4aa5-a024-3e8b7812b44e req-f15aab00-1219-4f53-b606-dffdd2f368b2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group_rule and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:49.810947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d851aa37-e700-4aa5-a024-3e8b7812b44e req-f15aab00-1219-4f53-b606-dffdd2f368b2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:49.875060 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b64be05e-c0ce-4d32-b4bd-47442384e37b req-1400ec3a-c865-4bb4-9328-9115b1d86c60 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:49.877793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b64be05e-c0ce-4d32-b4bd-47442384e37b req-1400ec3a-c865-4bb4-9328-9115b1d86c60 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.4133008 May 12 15:21:49.929752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-d851aa37-e700-4aa5-a024-3e8b7812b44e req-f15aab00-1219-4f53-b606-dffdd2f368b2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:50.016481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:21:50.028217 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06af944d-0be3-4146-a417-ca9c20dd5a3b req-964e1830-e4d6-4e88-8262-87e6f1306b9c service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0500405 May 12 15:21:50.030034 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-765688ba-3f59-4318-8590-5c7cd56ffdef None None] Sync routers for ids ['252b9228-6855-4c38-8dc5-a270efa179ff'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:21:50.065084 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-765688ba-3f59-4318-8590-5c7cd56ffdef None None] Routers {'252b9228-6855-4c38-8dc5-a270efa179ff'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:50.070541 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-765688ba-3f59-4318-8590-5c7cd56ffdef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['252b9228-6855-4c38-8dc5-a270efa179ff'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:50.096629 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:50.098765 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-366d7239-d871-441b-b3cf-18b49169897c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 11.0760379 May 12 15:21:50.114843 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35112) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:50.136431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1231dde1-7935-4e19-a1d5-adb16043b83f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'enable_snat': False}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:50.203581 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:50.238805 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-765688ba-3f59-4318-8590-5c7cd56ffdef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:50.239365 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:50.259598 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-765688ba-3f59-4318-8590-5c7cd56ffdef None None] Routers {'252b9228-6855-4c38-8dc5-a270efa179ff'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:50.261301 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-765688ba-3f59-4318-8590-5c7cd56ffdef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['252b9228-6855-4c38-8dc5-a270efa179ff'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:50.270221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'port_id': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'mac_address': 'fa:16:3e:ad:b5:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 579, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:21:50.387139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c7e400d9-7f69-464d-a1df-cb4c08b35f84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'name': 'tempest-TaggedBootDevicesTest-712902579-router', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.186'}], 'enable_snat': True}, 'gw_port_id': '09ea88a5-8b36-412b-ae6c-f2a8e7beae7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:14:13Z', 'updated_at': '2022-05-12T15:21:47Z', 'revision_number': 5, 'project_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'gw_port': {'id': '09ea88a5-8b36-412b-ae6c-f2a8e7beae7f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:3e:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 998, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:14:15Z', 'updated_at': '2022-05-12T15:14:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:50.426707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7e400d9-7f69-464d-a1df-cb4c08b35f84 None None] Checking router: 9b2fa912-d414-4854-a39a-4ff1d3393c44 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:21:50.444640 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-765688ba-3f59-4318-8590-5c7cd56ffdef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:50.451181 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-765688ba-3f59-4318-8590-5c7cd56ffdef None None] The sync data for ids ['252b9228-6855-4c38-8dc5-a270efa179ff'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:21:50.461763 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:50.492946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 26754046-3c27-423b-a836-8c5b0f061d5a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=26754046-3c27-423b-a836-8c5b0f061d5a,segment=NetworkSegment(ccba5697-f062-48f7-986e-3317afc51896),segment_id=ccba5697-f062-48f7-986e-3317afc51896)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:50.498088 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 860dc344-70ad-4ff8-9592-ee8e988a4f26 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:21:50.503668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7e400d9-7f69-464d-a1df-cb4c08b35f84 None None] Routers {'9b2fa912-d414-4854-a39a-4ff1d3393c44'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:50.504713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c7e400d9-7f69-464d-a1df-cb4c08b35f84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9b2fa912-d414-4854-a39a-4ff1d3393c44'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:50.565894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06af944d-0be3-4146-a417-ca9c20dd5a3b req-3c349fe3-2ab0-48fa-8c2f-dbe4e4ad744f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:50.567488 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06af944d-0be3-4146-a417-ca9c20dd5a3b req-3c349fe3-2ab0-48fa-8c2f-dbe4e4ad744f service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.5317776 May 12 15:21:50.616300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] For port 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=09ea88a5-8b36-412b-ae6c-f2a8e7beae7f,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:50.617083 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:50.660806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:50.671128 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:50.703646 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b64be05e-c0ce-4d32-b4bd-47442384e37b req-6e9de576-c870-44c3-8489-3b1dbf2048e6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.7714221 May 12 15:21:50.773116 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:50.816092 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-867fba89-1419-4072-afec-04c597fa2c7b'] response: {'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'code': 200} May 12 15:21:50.839130 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d851aa37-e700-4aa5-a024-3e8b7812b44e req-f15aab00-1219-4f53-b606-dffdd2f368b2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:50.861990 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:21:50.887050 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d851aa37-e700-4aa5-a024-3e8b7812b44e req-f15aab00-1219-4f53-b606-dffdd2f368b2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:50.945580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=26754046-3c27-423b-a836-8c5b0f061d5a,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:50.953150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c7e400d9-7f69-464d-a1df-cb4c08b35f84 None None] Set router 9b2fa912-d414-4854-a39a-4ff1d3393c44 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:21:50.965121 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d851aa37-e700-4aa5-a024-3e8b7812b44e req-f15aab00-1219-4f53-b606-dffdd2f368b2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:51.004032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['860dc344-70ad-4ff8-9592-ee8e988a4f26'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:21:51.017966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] Calling delete_port for 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:51.020923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f15aab00-1219-4f53-b606-dffdd2f368b2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2551aca6-d61c-4c29-9ff5-d4ceb09d4738,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:51.028753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab5e28e0-4ffb-451e-a370-9c4adf1a8eee req-5ade5b80-c3f4-40f6-8926-3ec13fb335af tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 210 time: 0.1036556 May 12 15:21:51.036024 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d851aa37-e700-4aa5-a024-3e8b7812b44e req-f15aab00-1219-4f53-b606-dffdd2f368b2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:51.057714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d851aa37-e700-4aa5-a024-3e8b7812b44e req-f15aab00-1219-4f53-b606-dffdd2f368b2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 1.4141793 May 12 15:21:51.273589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=12']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:51.290068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c7e400d9-7f69-464d-a1df-cb4c08b35f84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'name': 'tempest-TaggedBootDevicesTest-712902579-router', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:14:13Z', 'updated_at': '2022-05-12T15:21:49Z', 'revision_number': 6, 'project_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:51.321845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7e400d9-7f69-464d-a1df-cb4c08b35f84 None None] The sync data for ids ['9b2fa912-d414-4854-a39a-4ff1d3393c44'] in n-d-841483-1 is: [{'id': '9b2fa912-d414-4854-a39a-4ff1d3393c44', 'name': 'tempest-TaggedBootDevicesTest-712902579-router', 'tenant_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:14:13Z', 'updated_at': '2022-05-12T15:21:49Z', 'revision_number': 6, 'project_id': 'a8ccc27e73294a6abe2cb2107c8a9a66', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:21:51.346889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-7ce19e9d-2930-4d9d-973f-9ff7acfe4b67 req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-479403998', 'description': 'tempest-description-1933486400'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:51.353610 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5efad0a0-04f8-421b-a1fe-7a3044914f28 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:51.468527 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:51.542916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] Pushing event deleted for resources: {'Port': ['ID=09ea88a5-8b36-412b-ae6c-f2a8e7beae7f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:51.615487 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7bcfe91-bb23-4ef2-be63-a6e990c0193c req-5cd85d7a-81f6-4a39-9837-358f97cd072d tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 210 time: 0.4213483 May 12 15:21:51.678250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-7ce19e9d-2930-4d9d-973f-9ff7acfe4b67 req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:51.704981 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:51.757824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7ce19e9d-2930-4d9d-973f-9ff7acfe4b67 req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:51.790276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7ce19e9d-2930-4d9d-973f-9ff7acfe4b67 req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:52.056463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-7ce19e9d-2930-4d9d-973f-9ff7acfe4b67 req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:52.174574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-64a23015-28db-471d-b4c4-3d5deb7f853f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:52.175200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-64a23015-28db-471d-b4c4-3d5deb7f853f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Synchronizing usage tracker for tenant:9e2382be0c6f4779ae64026a57628773 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:21:52.182450 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7ce19e9d-2930-4d9d-973f-9ff7acfe4b67 req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:52.269187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-64a23015-28db-471d-b4c4-3d5deb7f853f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Unset dirty status for tenant:9e2382be0c6f4779ae64026a57628773 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:21:52.270502 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-64a23015-28db-471d-b4c4-3d5deb7f853f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.76 "GET /v2.0/networks?id=e7794860-7444-4123-96d5-ca3febf5e162 HTTP/1.1" status: 200 len: 810 time: 0.2743149 May 12 15:21:52.272902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:52.275871 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:52.306381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Request body: {'port': {'device_id': '1b949ed9-fdac-46f6-8db0-a707458b85d2', 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162', 'admin_state_up': True, 'tenant_id': '9e2382be0c6f4779ae64026a57628773'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:52.321533 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-7ce19e9d-2930-4d9d-973f-9ff7acfe4b67 req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:52.343348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7ce19e9d-2930-4d9d-973f-9ff7acfe4b67 req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group_rule and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:52.355334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7ce19e9d-2930-4d9d-973f-9ff7acfe4b67 req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:52.427177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-7ce19e9d-2930-4d9d-973f-9ff7acfe4b67 req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:52.445297 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1231dde1-7935-4e19-a1d5-adb16043b83f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:52.536895 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:52.537465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9b2fa912-d414-4854-a39a-4ff1d3393c44 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:21:52.585699 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:52.587302 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6b74f93c-5053-486e-b91d-0c1de0e39a53 admin admin] 10.222.0.82 "DELETE /v2.0/routers/9b2fa912-d414-4854-a39a-4ff1d3393c44 HTTP/1.1" status: 204 len: 168 time: 3.9348755 May 12 15:21:52.590889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35142) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:52.624982 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7ce19e9d-2930-4d9d-973f-9ff7acfe4b67 req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:52.634181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-981238b6-a9c6-487f-8eb4-713ba1afd050 req-3c3666cd-1a99-4fef-a29e-7d9ccf85d8b0 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:52.642754 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-981238b6-a9c6-487f-8eb4-713ba1afd050 req-3c3666cd-1a99-4fef-a29e-7d9ccf85d8b0 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 945 time: 0.5743039 May 12 15:21:52.660794 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7ce19e9d-2930-4d9d-973f-9ff7acfe4b67 req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:52.731773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c18e0d07-ed54-458f-b344-73c879cca4f8,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:52.758489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:52.766395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Usage tracker for resource:port and tenant:9e2382be0c6f4779ae64026a57628773 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:52.784042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:52.799504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:52.856160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-9da87aa4-473a-443d-9eb2-03a90741a0b4 admin admin] Deleting subnet cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:21:52.863932 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9da87aa4-473a-443d-9eb2-03a90741a0b4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:53.005092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 26754046-3c27-423b-a836-8c5b0f061d5a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:53.031599 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9da87aa4-473a-443d-9eb2-03a90741a0b4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:53.106536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 860dc344-70ad-4ff8-9592-ee8e988a4f26 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:21:53.271606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 26754046-3c27-423b-a836-8c5b0f061d5a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:53.294170 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:53.325401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-80e404e7-f549-4fec-991d-cdc34cc564e4 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:53.327460 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-80e404e7-f549-4fec-991d-cdc34cc564e4 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.76 "GET /v2.0/networks?id=670dbecd-f547-4abf-b069-62f0c8712c6b HTTP/1.1" status: 200 len: 822 time: 0.6234038 May 12 15:21:53.343013 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7ce19e9d-2930-4d9d-973f-9ff7acfe4b67 req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:53.345643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Made reservation on behalf of 9e2382be0c6f4779ae64026a57628773 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:21:53.353696 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:53.356657 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ce19e9d-2930-4d9d-973f-9ff7acfe4b67 req-6b6148ff-a28f-4873-b16c-58220c49e8bf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 2.1210186 May 12 15:21:53.382591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Request body: {'port': {'device_id': '4f1860d3-a7e3-4641-b4cd-169837fafc21', 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b', 'admin_state_up': True, 'tenant_id': '4789db12ded14c2e8773d2396c9acd32'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:53.409078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 860dc344-70ad-4ff8-9592-ee8e988a4f26 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:21:53.409643 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:53.640655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Allocated IP 172.20.0.11 (e7794860-7444-4123-96d5-ca3febf5e162/eae80ee9-f335-4892-af0b-41490fc3c6b5/eaeeccb2-8af7-4344-866b-7226dbc22776) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:21:53.654617 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-981238b6-a9c6-487f-8eb4-713ba1afd050 req-f24a1592-1c89-4457-a735-9e68ceb9867d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 1.0109723 May 12 15:21:53.732527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:53.817360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:21:53.817814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 09ea88a5-8b36-412b-ae6c-f2a8e7beae7f not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:21:53.818170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:53.818292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2b0f41b8-aaa6-4b9c-b597-703f558651d5 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:53.824250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Usage tracker for resource:port and tenant:4789db12ded14c2e8773d2396c9acd32 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:53.828565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:53.840532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:53.857340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 2b0f41b8-aaa6-4b9c-b597-703f558651d5 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:21:53.857590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2b0f41b8-aaa6-4b9c-b597-703f558651d5 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:21:53.888002 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:53.888672 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4642151c-b848-4954-aaac-995988018c9e req-3fb7e26a-502f-4639-9b51-fb6560e791a2 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 210 time: 0.2612667 May 12 15:21:53.900117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Made reservation on behalf of 4789db12ded14c2e8773d2396c9acd32 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:21:53.905160 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:53.940926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:21:53.956605 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:53.968871 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:54.020299 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:54.047243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=13']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:54.056183 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:54.118407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5efad0a0-04f8-421b-a1fe-7a3044914f28 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Deleting port 843be0c7-90bb-4f5e-bdb8-b3267881699e {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:54.118614 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5efad0a0-04f8-421b-a1fe-7a3044914f28 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:54.149500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Network e7794860-7444-4123-96d5-ca3febf5e162 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:21:54.156773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:54.165705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:21:54.243339 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9da87aa4-473a-443d-9eb2-03a90741a0b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:54.303081 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43b3bea7-0807-44fe-a63d-8af1b149f97c req-44bd8620-cd19-4de4-8720-ed9cd2f1e52c tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/c18e0d07-ed54-458f-b344-73c879cca4f8 HTTP/1.1" status: 200 len: 1806 time: 0.3529832 May 12 15:21:54.307639 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-43b3bea7-0807-44fe-a63d-8af1b149f97c req-540548fa-f1df-41d4-82ab-9c02f90f9462 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '10.2.3.124/24', 'security_group_id': 'c18e0d07-ed54-458f-b344-73c879cca4f8', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:54.307966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-43b3bea7-0807-44fe-a63d-8af1b149f97c req-540548fa-f1df-41d4-82ab-9c02f90f9462 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '10.2.3.124/24', 'security_group_id': 'c18e0d07-ed54-458f-b344-73c879cca4f8', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:54.314499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-43b3bea7-0807-44fe-a63d-8af1b149f97c req-540548fa-f1df-41d4-82ab-9c02f90f9462 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:54.318564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-43b3bea7-0807-44fe-a63d-8af1b149f97c req-540548fa-f1df-41d4-82ab-9c02f90f9462 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group_rule and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:54.321587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-43b3bea7-0807-44fe-a63d-8af1b149f97c req-540548fa-f1df-41d4-82ab-9c02f90f9462 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:54.327525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-43b3bea7-0807-44fe-a63d-8af1b149f97c req-540548fa-f1df-41d4-82ab-9c02f90f9462 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:54.364357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:54.365508 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:54.369917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Pushing event updated for resources: {'Port': ['ID=eaeeccb2-8af7-4344-866b-7226dbc22776,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:54.405873 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-a59e0005-ec16-4eff-8be7-187a6093fcb1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.1192787 May 12 15:21:54.419829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Request body: {'port': {'device_id': '1b949ed9-fdac-46f6-8db0-a707458b85d2', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:54.563704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:54.588701 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-43b3bea7-0807-44fe-a63d-8af1b149f97c req-540548fa-f1df-41d4-82ab-9c02f90f9462 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:54.598083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b7b059-308c-483e-a704-5db2a3db19b1 req-eaaa1899-1750-4967-9a7f-19621493161b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:54.599603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63b7b059-308c-483e-a704-5db2a3db19b1 req-eaaa1899-1750-4967-9a7f-19621493161b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 932 time: 0.6481316 May 12 15:21:54.726647 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9da87aa4-473a-443d-9eb2-03a90741a0b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:54.778168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f70279ae-78b7-4395-8668-380842364516 None None] Network 55fd03f8-edf5-46b5-a343-d05b647d0c02 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:21:54.786180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Allocated IP 172.20.0.12 (670dbecd-f547-4abf-b069-62f0c8712c6b/5a24db8d-fb66-4b7f-bf96-50956cb218fd/632953d6-f6ad-4465-b608-8f2b459ee5e2) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:21:54.792998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9da87aa4-473a-443d-9eb2-03a90741a0b4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:54.811480 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5efad0a0-04f8-421b-a1fe-7a3044914f28 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:54.816347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9da87aa4-473a-443d-9eb2-03a90741a0b4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:54.856612 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9da87aa4-473a-443d-9eb2-03a90741a0b4 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/cc5afb2b-3d10-44e8-976a-5c2db5ff7f0c HTTP/1.1" status: 204 len: 168 time: 2.2641649 May 12 15:21:54.857885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35162) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:55.006897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63b7b059-308c-483e-a704-5db2a3db19b1 req-e40a5a13-7c47-483f-8b28-40c83ad0d896 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3770421 May 12 15:21:55.071705 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-43b3bea7-0807-44fe-a63d-8af1b149f97c req-540548fa-f1df-41d4-82ab-9c02f90f9462 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:55.088130 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:55.135990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Deleting port 2aacd053-a6fc-4b9c-a864-3492866aab49 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:55.136329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:55.139045 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-163bf549-a5df-4958-862b-354ac23a1399'] response: {'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'code': 200} May 12 15:21:55.234203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82fff1ff-d26d-496e-86e7-8abeb4c8a486 None None] DHCP port deletion for 55fd03f8-edf5-46b5-a343-d05b647d0c02 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:21:55.240201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-82fff1ff-d26d-496e-86e7-8abeb4c8a486 None None] Deleting port 2aacd053-a6fc-4b9c-a864-3492866aab49 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:55.240897 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-82fff1ff-d26d-496e-86e7-8abeb4c8a486 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:55.366663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id eaeeccb2-8af7-4344-866b-7226dbc22776 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:21:55.397285 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:55.477323 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:55.487205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Transition to ACTIVE for port object eaeeccb2-8af7-4344-866b-7226dbc22776 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:21:55.499726 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:55.607039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-82fff1ff-d26d-496e-86e7-8abeb4c8a486 None None] For port 2aacd053-a6fc-4b9c-a864-3492866aab49, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2aacd053-a6fc-4b9c-a864-3492866aab49,segment=NetworkSegment(9a5ce622-a3ea-4c31-b698-fca2808b112c),segment_id=9a5ce622-a3ea-4c31-b698-fca2808b112c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:55.607852 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-82fff1ff-d26d-496e-86e7-8abeb4c8a486 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:55.661496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5efad0a0-04f8-421b-a1fe-7a3044914f28 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Calling delete_port for 843be0c7-90bb-4f5e-bdb8-b3267881699e owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:55.773852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-82fff1ff-d26d-496e-86e7-8abeb4c8a486 None None] Calling delete_port for 2aacd053-a6fc-4b9c-a864-3492866aab49 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:55.785397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] For port 2aacd053-a6fc-4b9c-a864-3492866aab49, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2aacd053-a6fc-4b9c-a864-3492866aab49,segment=NetworkSegment(9a5ce622-a3ea-4c31-b698-fca2808b112c),segment_id=9a5ce622-a3ea-4c31-b698-fca2808b112c)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:21:55.785780 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:55.885240 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-82fff1ff-d26d-496e-86e7-8abeb4c8a486 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:55.921647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Pushing event updated for resources: {'Port': ['ID=eaeeccb2-8af7-4344-866b-7226dbc22776,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:55.935657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82fff1ff-d26d-496e-86e7-8abeb4c8a486 None None] No DVR routers for this DVR port 2aacd053-a6fc-4b9c-a864-3492866aab49 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:21:55.937399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82fff1ff-d26d-496e-86e7-8abeb4c8a486 None None] Pushing event deleted for resources: {'Port': ['ID=2aacd053-a6fc-4b9c-a864-3492866aab49,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:55.992760 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:55.994157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-43b3bea7-0807-44fe-a63d-8af1b149f97c req-540548fa-f1df-41d4-82ab-9c02f90f9462 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:56.078658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-540548fa-f1df-41d4-82ab-9c02f90f9462 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4d289248-836d-44a2-9829-44b957357e9a,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:56.091970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Calling delete_port for 2aacd053-a6fc-4b9c-a864-3492866aab49 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:21:56.158188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Attempting to bind port eaeeccb2-8af7-4344-866b-7226dbc22776 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:21:56.158568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Attempting to bind port eaeeccb2-8af7-4344-866b-7226dbc22776 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'ccba5697-f062-48f7-986e-3317afc51896', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:21:56.158891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Attempting to bind port eaeeccb2-8af7-4344-866b-7226dbc22776 on network e7794860-7444-4123-96d5-ca3febf5e162 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:21:56.172007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Port eaeeccb2-8af7-4344-866b-7226dbc22776 on network e7794860-7444-4123-96d5-ca3febf5e162 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:21:56.172356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Attempting to bind port eaeeccb2-8af7-4344-866b-7226dbc22776 on network e7794860-7444-4123-96d5-ca3febf5e162 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:21:56.184087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 21, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:21:56.184421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Checking segment: {'id': 'ccba5697-f062-48f7-986e-3317afc51896', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:21:56.184951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Bound using segment: {'id': 'ccba5697-f062-48f7-986e-3317afc51896', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:21:56.185409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Bound port: eaeeccb2-8af7-4344-866b-7226dbc22776, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ccba5697-f062-48f7-986e-3317afc51896', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:21:56.185917 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:56.241879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Network 670dbecd-f547-4abf-b069-62f0c8712c6b is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:21:56.264352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:21:56.292857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:21:56.329167 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:21:56.329807 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:21:56.344045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Pushing event updated for resources: {'Port': ['ID=632953d6-f6ad-4465-b608-8f2b459ee5e2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:56.355747 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-43b3bea7-0807-44fe-a63d-8af1b149f97c req-540548fa-f1df-41d4-82ab-9c02f90f9462 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:56.361966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43b3bea7-0807-44fe-a63d-8af1b149f97c req-540548fa-f1df-41d4-82ab-9c02f90f9462 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 792 time: 2.0580540 May 12 15:21:56.407496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] For port eaeeccb2-8af7-4344-866b-7226dbc22776, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:21:56.411936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] For port eaeeccb2-8af7-4344-866b-7226dbc22776, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=eaeeccb2-8af7-4344-866b-7226dbc22776,segment=NetworkSegment(ccba5697-f062-48f7-986e-3317afc51896),segment_id=ccba5697-f062-48f7-986e-3317afc51896)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:21:56.428774 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:56.512973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:56.513702 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:56.515420 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] 10.222.0.76 "PUT /v2.0/ports/eaeeccb2-8af7-4344-866b-7226dbc22776 HTTP/1.1" status: 200 len: 1092 time: 2.1033404 May 12 15:21:56.515980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1b949ed9-fdac-46f6-8db0-a707458b85d2', 'tag': 'eaeeccb2-8af7-4344-866b-7226dbc22776'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:21:56.539278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5364a9ea-5e62-4eb5-beee-745f747dc22c service neutron] Pushing event updated for resources: {'Port': ['ID=eaeeccb2-8af7-4344-866b-7226dbc22776,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:56.615377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-931c8c60-9cec-426a-b548-2785a50cdcdd req-290af62d-8c86-4d30-ab4e-7ba3e040349d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:56.616841 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-931c8c60-9cec-426a-b548-2785a50cdcdd req-290af62d-8c86-4d30-ab4e-7ba3e040349d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 946 time: 0.7556183 May 12 15:21:56.631923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:56.632638 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:56.676483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-89c7c2da-8010-48a9-b8b7-7e3f52849dd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:56.676483 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-89c7c2da-8010-48a9-b8b7-7e3f52849dd7 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9e2382be0c6f4779ae64026a57628773&device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 1095 time: 0.1157925 May 12 15:21:56.796633 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-cc341d54-8f95-416b-b8f2-44aa56abd972 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=eaeeccb2-8af7-4344-866b-7226dbc22776 HTTP/1.1" status: 200 len: 217 time: 0.1128123 May 12 15:21:56.820767 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-931c8c60-9cec-426a-b548-2785a50cdcdd req-3d6c0168-950f-4bfd-be93-87f36ecee230 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1796803 May 12 15:21:56.826291 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-3f86f5e4-88b4-4f5c-82e0-fb07283ae487 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.4612832 May 12 15:21:56.865549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Request body: {'port': {'device_id': '4f1860d3-a7e3-4641-b4cd-169837fafc21', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:56.883113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Deleting port 2aacd053-a6fc-4b9c-a864-3492866aab49 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:21:56.883113 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:56.903037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35144c12-5139-46fb-ad5d-76de62aa2b51 req-e4b04871-d508-4b78-8400-288956ae1e9c tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:56.903037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-35144c12-5139-46fb-ad5d-76de62aa2b51 req-e4b04871-d508-4b78-8400-288956ae1e9c tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Synchronizing usage tracker for tenant:4789db12ded14c2e8773d2396c9acd32 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:21:56.911951 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1231dde1-7935-4e19-a1d5-adb16043b83f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:56.954000 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1231dde1-7935-4e19-a1d5-adb16043b83f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:56.981649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-38163a2f-3260-4789-8ef1-20d3c13c94f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:56.982987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-38163a2f-3260-4789-8ef1-20d3c13c94f0 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=eae80ee9-f335-4892-af0b-41490fc3c6b5 HTTP/1.1" status: 200 len: 850 time: 0.1721914 May 12 15:21:57.000125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2aacd053-a6fc-4b9c-a864-3492866aab49 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:21:57.054934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] The port '2aacd053-a6fc-4b9c-a864-3492866aab49' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:21:57.077709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-35144c12-5139-46fb-ad5d-76de62aa2b51 req-e4b04871-d508-4b78-8400-288956ae1e9c tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Unset dirty status for tenant:4789db12ded14c2e8773d2396c9acd32 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:21:57.082860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35144c12-5139-46fb-ad5d-76de62aa2b51 req-e4b04871-d508-4b78-8400-288956ae1e9c tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 932 time: 0.5897477 May 12 15:21:57.084607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 2aacd053-a6fc-4b9c-a864-3492866aab49 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:21:57.084952 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2aacd053-a6fc-4b9c-a864-3492866aab49 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:21:57.104384 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-172055b0-757a-4b72-8ab6-f91fee6a9162 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e7794860-7444-4123-96d5-ca3febf5e162&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0944502 May 12 15:21:57.114161 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5efad0a0-04f8-421b-a1fe-7a3044914f28 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:57.216327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5efad0a0-04f8-421b-a1fe-7a3044914f28 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event deleted for resources: {'Port': ['ID=843be0c7-90bb-4f5e-bdb8-b3267881699e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:57.416776 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:57.451796 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:57.505991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-35144c12-5139-46fb-ad5d-76de62aa2b51 req-3f9bb141-20bc-448f-8de3-59c8899ca45e tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Synchronizing usage tracker for tenant:4789db12ded14c2e8773d2396c9acd32 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:21:57.507943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['55fd03f8-edf5-46b5-a343-d05b647d0c02']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:57.561858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9a5ce622-a3ea-4c31-b698-fca2808b112c') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:57.562160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9a5ce622-a3ea-4c31-b698-fca2808b112c') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:57.597522 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-0cb4f2a9-daf9-40f8-ba2e-fcba32077aa5 service neutron] 10.222.0.76 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4818740 May 12 15:21:57.599689 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:57.714579 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:57.732473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Releasing vlan 595 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:21:57.732900 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: timer() May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:21:57.746940 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:21:57.865580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1231dde1-7935-4e19-a1d5-adb16043b83f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Router 252b9228-6855-4c38-8dc5-a270efa179ff has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:21:57.867074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-35144c12-5139-46fb-ad5d-76de62aa2b51 req-3f9bb141-20bc-448f-8de3-59c8899ca45e tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Unset dirty status for tenant:4789db12ded14c2e8773d2396c9acd32 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:21:57.874786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35144c12-5139-46fb-ad5d-76de62aa2b51 req-3f9bb141-20bc-448f-8de3-59c8899ca45e tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7909834 May 12 15:21:57.879627 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:57.913843 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:57.922512 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2c44d28-f8ec-4081-959f-d98a7d05a2c0 req-bc362ea1-4ee3-4c73-95cd-2cf3d77dd468 service neutron] 10.222.0.76 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3153553 May 12 15:21:57.930395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] Pushing event deleted for resources: {'Network': ['ID=55fd03f8-edf5-46b5-a343-d05b647d0c02,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:57.935379 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d0886342-babe-4f83-8fba-32ffe466e2a4 admin admin] 10.222.0.82 "DELETE /v2.0/networks/55fd03f8-edf5-46b5-a343-d05b647d0c02 HTTP/1.1" status: 204 len: 168 time: 3.0700223 May 12 15:21:58.008925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-629ed297-466c-4e38-afef-f75609c555f2 req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-1806555052', 'description': 'tempest-description-1889434376'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:58.076214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-629ed297-466c-4e38-afef-f75609c555f2 req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:58.106836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35194) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:58.161217 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-629ed297-466c-4e38-afef-f75609c555f2 req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:58.184279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-629ed297-466c-4e38-afef-f75609c555f2 req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:58.190432 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5efad0a0-04f8-421b-a1fe-7a3044914f28 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:58.193083 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2ab08232-12bc-49a0-b172-b9151304015c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=42581a8af83242e0bb61f84a30bd27a7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0847800 May 12 15:21:58.196672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35198) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:58.208271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-629ed297-466c-4e38-afef-f75609c555f2 req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 1 items for resource security_group. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:58.332962 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-629ed297-466c-4e38-afef-f75609c555f2 req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:58.379005 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3df49973-ec24-4ae9-a19d-3ab84e212ae0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:58.565839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-629ed297-466c-4e38-afef-f75609c555f2 req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:21:58.573996 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3df49973-ec24-4ae9-a19d-3ab84e212ae0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:58.577878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-629ed297-466c-4e38-afef-f75609c555f2 req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group_rule and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:21:58.586359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-629ed297-466c-4e38-afef-f75609c555f2 req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:21:58.647023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3df49973-ec24-4ae9-a19d-3ab84e212ae0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:58.679691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3df49973-ec24-4ae9-a19d-3ab84e212ae0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8814ef16-03ed-468a-b207-7c8497a79fc0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:58.685634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c0b8fc-acde-4ae3-857f-f624c75e73cc req-99093daf-4e23-4221-84ad-8928a5825ff9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:58.688248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3df49973-ec24-4ae9-a19d-3ab84e212ae0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:58.691939 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3df49973-ec24-4ae9-a19d-3ab84e212ae0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8814ef16-03ed-468a-b207-7c8497a79fc0 HTTP/1.1" status: 204 len: 168 time: 0.4911714 May 12 15:21:58.694859 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7c0b8fc-acde-4ae3-857f-f624c75e73cc req-99093daf-4e23-4221-84ad-8928a5825ff9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 944 time: 0.8396151 May 12 15:21:58.710782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1231dde1-7935-4e19-a1d5-adb16043b83f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:21:58.716014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-629ed297-466c-4e38-afef-f75609c555f2 req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:21:58.739660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-903864c2-b5f8-4017-b475-4d2fc7822e9f None None] Sync routers for ids ['252b9228-6855-4c38-8dc5-a270efa179ff'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:21:58.763681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-903864c2-b5f8-4017-b475-4d2fc7822e9f None None] Routers {'252b9228-6855-4c38-8dc5-a270efa179ff'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:58.764859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-903864c2-b5f8-4017-b475-4d2fc7822e9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['252b9228-6855-4c38-8dc5-a270efa179ff'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:58.842061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1231dde1-7935-4e19-a1d5-adb16043b83f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:58.843259 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1231dde1-7935-4e19-a1d5-adb16043b83f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "PUT /v2.0/routers/252b9228-6855-4c38-8dc5-a270efa179ff HTTP/1.1" status: 200 len: 921 time: 8.7146630 May 12 15:21:58.847948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35204) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:58.890116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7c0b8fc-acde-4ae3-857f-f624c75e73cc req-eda15432-463e-4c7c-8895-c74ef48287fa tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1942539 May 12 15:21:58.892868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5efad0a0-04f8-421b-a1fe-7a3044914f28 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Router 0a20e216-0f20-463c-92e2-94e5c5a92acd has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:21:58.943140 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-903864c2-b5f8-4017-b475-4d2fc7822e9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:58.955093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-903864c2-b5f8-4017-b475-4d2fc7822e9f None None] Routers {'252b9228-6855-4c38-8dc5-a270efa179ff'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:58.956066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-903864c2-b5f8-4017-b475-4d2fc7822e9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['252b9228-6855-4c38-8dc5-a270efa179ff'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:59.027507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-903864c2-b5f8-4017-b475-4d2fc7822e9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:59.027924 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-903864c2-b5f8-4017-b475-4d2fc7822e9f None None] The sync data for ids ['252b9228-6855-4c38-8dc5-a270efa179ff'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:21:59.243172 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d3340d06-9974-490c-8454-b9e211c37070 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/routers/252b9228-6855-4c38-8dc5-a270efa179ff HTTP/1.1" status: 200 len: 921 time: 0.3947375 May 12 15:21:59.243770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35212) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:59.249108 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4bcbec26-c102-43df-ad33-1e01fa7559ee'] response: {'name': 'network-changed', 'server_uuid': '1b949ed9-fdac-46f6-8db0-a707458b85d2', 'tag': 'eaeeccb2-8af7-4344-866b-7226dbc22776', 'status': 'completed', 'code': 200} May 12 15:21:59.414875 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-629ed297-466c-4e38-afef-f75609c555f2 req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:59.416151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5efad0a0-04f8-421b-a1fe-7a3044914f28 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:21:59.419752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 632953d6-f6ad-4465-b608-8f2b459ee5e2 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:21:59.431863 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e09fa6a2-4142-40bd-b612-53c0b78d3158 None None] Sync routers for ids ['0a20e216-0f20-463c-92e2-94e5c5a92acd'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:21:59.450493 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e09fa6a2-4142-40bd-b612-53c0b78d3158 None None] Routers {'0a20e216-0f20-463c-92e2-94e5c5a92acd'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:59.451395 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e09fa6a2-4142-40bd-b612-53c0b78d3158 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0a20e216-0f20-463c-92e2-94e5c5a92acd'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:59.455429 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:59.460007 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-629ed297-466c-4e38-afef-f75609c555f2 req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:59.541324 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e09fa6a2-4142-40bd-b612-53c0b78d3158 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:59.554926 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e09fa6a2-4142-40bd-b612-53c0b78d3158 None None] Routers {'0a20e216-0f20-463c-92e2-94e5c5a92acd'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:21:59.555883 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e09fa6a2-4142-40bd-b612-53c0b78d3158 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0a20e216-0f20-463c-92e2-94e5c5a92acd'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:59.564762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74e77575-b154-49f1-8302-480b7a23bf73 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:59.565606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-74e77575-b154-49f1-8302-480b7a23bf73 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Synchronizing usage tracker for tenant:a0824ae235484071b39cd368d3b3aa19 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:21:59.583937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e159886-f5fc-48fb-9e45-ccfa2f5a1d5b req-ad791c95-e831-4e9f-bb6f-9c5eed485282 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:59.587636 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e159886-f5fc-48fb-9e45-ccfa2f5a1d5b req-ad791c95-e831-4e9f-bb6f-9c5eed485282 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9e2382be0c6f4779ae64026a57628773&device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 1095 time: 0.3409581 May 12 15:21:59.649375 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e09fa6a2-4142-40bd-b612-53c0b78d3158 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:21:59.649935 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e09fa6a2-4142-40bd-b612-53c0b78d3158 None None] The sync data for ids ['0a20e216-0f20-463c-92e2-94e5c5a92acd'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:21:59.650097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35216) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:59.712209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-74e77575-b154-49f1-8302-480b7a23bf73 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Unset dirty status for tenant:a0824ae235484071b39cd368d3b3aa19 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:21:59.715695 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-74e77575-b154-49f1-8302-480b7a23bf73 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/ports?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&device_id=252b9228-6855-4c38-8dc5-a270efa179ff&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.4597504 May 12 15:21:59.720356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35220) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:59.721874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Transition to ACTIVE for port object 632953d6-f6ad-4465-b608-8f2b459ee5e2 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:21:59.731088 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5efad0a0-04f8-421b-a1fe-7a3044914f28 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "PUT /v2.0/routers/0a20e216-0f20-463c-92e2-94e5c5a92acd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 11.9694819 May 12 15:21:59.731088 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-629ed297-466c-4e38-afef-f75609c555f2 req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:59.737949 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-629ed297-466c-4e38-afef-f75609c555f2 req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1812 time: 1.7346466 May 12 15:21:59.738637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35224) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:59.746961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7dd287d-de4b-49e3-b10b-dcf60b710077 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event updated for resources: {'SecurityGroup': ['ID=dbd855f9-e86b-4956-aa84-f5297280e69d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:21:59.751025 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:21:59.893054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e159886-f5fc-48fb-9e45-ccfa2f5a1d5b req-50ccb8db-a269-4137-b6e0-fc0869a9a2e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:59.894743 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e159886-f5fc-48fb-9e45-ccfa2f5a1d5b req-50ccb8db-a269-4137-b6e0-fc0869a9a2e0 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e7794860-7444-4123-96d5-ca3febf5e162 HTTP/1.1" status: 200 len: 911 time: 0.3010449 May 12 15:21:59.937978 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-4edfeb40-b075-4cf6-97c1-8e3755ca1ff6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] delete failed (client error): The resource could not be found. May 12 15:21:59.944588 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4edfeb40-b075-4cf6-97c1-8e3755ca1ff6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "DELETE /v2.0/routers/tempest-non_exist_router-1661080517 HTTP/1.1" status: 404 len: 335 time: 0.2025008 May 12 15:21:59.945202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35232) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:21:59.993855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1154aa5-2544-457e-bd6f-d015090d090e tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:21:59.994752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d1154aa5-2544-457e-bd6f-d015090d090e tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Synchronizing usage tracker for tenant:a0824ae235484071b39cd368d3b3aa19 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:21:59.997964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-045d52be-2acd-439b-a53f-3bdc7c2c5a09 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Request body: {'router': {'external_gateway_info': {'network_id': '0a20e216-0f20-463c-92e2-94e5c5a92acd'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:21:59.999247 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e159886-f5fc-48fb-9e45-ccfa2f5a1d5b req-c8d58a8f-a2e4-440e-a4e4-e75764588a18 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=eaeeccb2-8af7-4344-866b-7226dbc22776 HTTP/1.1" status: 200 len: 217 time: 0.0904880 May 12 15:22:00.052884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d1154aa5-2544-457e-bd6f-d015090d090e tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Unset dirty status for tenant:a0824ae235484071b39cd368d3b3aa19 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:22:00.054205 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d1154aa5-2544-457e-bd6f-d015090d090e tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 881 time: 0.3329506 May 12 15:22:00.059370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35236) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:00.120392 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e5c04270-3ef7-46b6-b94a-45e89dfed754 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "GET /v2.0/ports?device_id=252b9228-6855-4c38-8dc5-a270efa179ff HTTP/1.1" status: 200 len: 205 time: 0.0599422 May 12 15:22:00.124435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35240) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:00.167534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b8d9158-9b59-4c9f-b53e-95d9bf14e247 req-e29a7a58-deab-450b-a571-f48704df7b9d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:00.174981 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b8d9158-9b59-4c9f-b53e-95d9bf14e247 req-e29a7a58-deab-450b-a571-f48704df7b9d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.9488566 May 12 15:22:00.215628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e159886-f5fc-48fb-9e45-ccfa2f5a1d5b req-42a9e374-a498-43d1-b390-abbe1ccd93bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:00.217249 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e159886-f5fc-48fb-9e45-ccfa2f5a1d5b req-42a9e374-a498-43d1-b390-abbe1ccd93bd service neutron] 10.222.0.76 "GET /v2.0/subnets?id=eae80ee9-f335-4892-af0b-41490fc3c6b5 HTTP/1.1" status: 200 len: 850 time: 0.2089505 May 12 15:22:00.280898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Pushing event updated for resources: {'Port': ['ID=632953d6-f6ad-4465-b608-8f2b459ee5e2,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:00.286301 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e159886-f5fc-48fb-9e45-ccfa2f5a1d5b req-380b502d-2525-4e96-8485-c433cd53438b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e7794860-7444-4123-96d5-ca3febf5e162&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0559847 May 12 15:22:00.337925 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-521d557d-3769-4902-b947-f8eb908fdfb4 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a8ccc27e73294a6abe2cb2107c8a9a66&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6796207 May 12 15:22:00.381461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35244) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:00.397060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device eaeeccb2-8af7-4344-866b-7226dbc22776 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:22:00.554817 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:00.564135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port eaeeccb2-8af7-4344-866b-7226dbc22776, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=eaeeccb2-8af7-4344-866b-7226dbc22776,segment=NetworkSegment(ccba5697-f062-48f7-986e-3317afc51896),segment_id=ccba5697-f062-48f7-986e-3317afc51896)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:00.580920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'eaeeccb2-8af7-4344-866b-7226dbc22776', 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162', 'port_id': 'eaeeccb2-8af7-4344-866b-7226dbc22776', 'mac_address': 'fa:16:3e:95:ee:0d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 567, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eae80ee9-f335-4892-af0b-41490fc3c6b5', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:22:00.596299 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b8d9158-9b59-4c9f-b53e-95d9bf14e247 req-5c6fe341-400d-4384-a9fb-da0bbe2f8ad7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4200690 May 12 15:22:00.676804 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:00.706823 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id eaeeccb2-8af7-4344-866b-7226dbc22776 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:22:00.723352 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port eaeeccb2-8af7-4344-866b-7226dbc22776, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=eaeeccb2-8af7-4344-866b-7226dbc22776,segment=NetworkSegment(ccba5697-f062-48f7-986e-3317afc51896),segment_id=ccba5697-f062-48f7-986e-3317afc51896)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:00.733604 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:00.745182 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e159886-f5fc-48fb-9e45-ccfa2f5a1d5b req-5ce770df-1c18-4ff0-9da4-889925648b11 service neutron] 10.222.0.76 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4485369 May 12 15:22:00.802453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99057bf2-03c7-4a25-98da-c15202cdfc5e req-9b445395-8847-46ad-bc02-0edde6a84ea8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:00.803817 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ab4946d-e86f-4dec-bd85-88d17d2e8fab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:00.803987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99057bf2-03c7-4a25-98da-c15202cdfc5e req-9b445395-8847-46ad-bc02-0edde6a84ea8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 946 time: 0.8558571 May 12 15:22:00.823152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=eaeeccb2-8af7-4344-866b-7226dbc22776,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:00.940144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['eaeeccb2-8af7-4344-866b-7226dbc22776'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:22:01.010060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99057bf2-03c7-4a25-98da-c15202cdfc5e req-f8b72859-8d68-40df-a85a-b7c7480bb148 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1315856 May 12 15:22:01.121634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c7409a0b-1a55-4c5d-84cd-8c99822071be req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-2080832358', 'description': 'tempest-description-1690085895'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:01.159576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c7409a0b-1a55-4c5d-84cd-8c99822071be req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:01.175995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c7409a0b-1a55-4c5d-84cd-8c99822071be req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:01.180669 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-045d52be-2acd-439b-a53f-3bdc7c2c5a09 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:01.194519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c7409a0b-1a55-4c5d-84cd-8c99822071be req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:01.201839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Attempting to bind port 632953d6-f6ad-4465-b608-8f2b459ee5e2 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:22:01.202210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Attempting to bind port 632953d6-f6ad-4465-b608-8f2b459ee5e2 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'dbf5199c-277c-4a55-97b5-ab215591dbbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:22:01.202549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Attempting to bind port 632953d6-f6ad-4465-b608-8f2b459ee5e2 on network 670dbecd-f547-4abf-b069-62f0c8712c6b {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:22:01.205961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c7409a0b-1a55-4c5d-84cd-8c99822071be req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 1 items for resource security_group. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:01.233730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Port 632953d6-f6ad-4465-b608-8f2b459ee5e2 on network 670dbecd-f547-4abf-b069-62f0c8712c6b not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:22:01.234472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Attempting to bind port 632953d6-f6ad-4465-b608-8f2b459ee5e2 on network 670dbecd-f547-4abf-b069-62f0c8712c6b {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:22:01.264246 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e159886-f5fc-48fb-9e45-ccfa2f5a1d5b req-2b35de2c-bba9-429b-aedd-91008fa24f03 service neutron] 10.222.0.76 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5022988 May 12 15:22:01.297166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e85fa0a3-4966-42a4-a94b-8492546d5eab req-428f9ad3-0976-4972-91e5-ff39d5549616 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:01.300526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e85fa0a3-4966-42a4-a94b-8492546d5eab req-428f9ad3-0976-4972-91e5-ff39d5549616 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 944 time: 0.5135508 May 12 15:22:01.303051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 21, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:22:01.303391 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Checking segment: {'id': 'dbf5199c-277c-4a55-97b5-ab215591dbbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:22:01.303776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Bound using segment: {'id': 'dbf5199c-277c-4a55-97b5-ab215591dbbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:22:01.304214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Bound port: 632953d6-f6ad-4465-b608-8f2b459ee5e2, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dbf5199c-277c-4a55-97b5-ab215591dbbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:22:01.304551 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:01.306559 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ab4946d-e86f-4dec-bd85-88d17d2e8fab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:01.327106 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-045d52be-2acd-439b-a53f-3bdc7c2c5a09 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] update failed (client error): The resource could not be found. May 12 15:22:01.333225 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-045d52be-2acd-439b-a53f-3bdc7c2c5a09 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "PUT /v2.0/routers/0a20e216-0f20-463c-92e2-94e5c5a92acd HTTP/1.1" status: 404 len: 339 time: 1.3385499 May 12 15:22:01.338274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35248) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:01.409970 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c7409a0b-1a55-4c5d-84cd-8c99822071be req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:01.440696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c7409a0b-1a55-4c5d-84cd-8c99822071be req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:01.447544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c7409a0b-1a55-4c5d-84cd-8c99822071be req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group_rule and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:01.450996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c7409a0b-1a55-4c5d-84cd-8c99822071be req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group_rule was recalculated. Used quota:12. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:01.472875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c7409a0b-1a55-4c5d-84cd-8c99822071be req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 12; quota limit: 100; headroom:88 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:01.489204 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:01.523086 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e85fa0a3-4966-42a4-a94b-8492546d5eab req-dddcddcb-833f-43fc-a665-8a6370999be1 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1922998 May 12 15:22:01.524237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] For port 632953d6-f6ad-4465-b608-8f2b459ee5e2, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:22:01.529156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] For port 632953d6-f6ad-4465-b608-8f2b459ee5e2, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=632953d6-f6ad-4465-b608-8f2b459ee5e2,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:22:01.551462 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:01.599195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Deleting port 8719cc60-3862-418d-92c9-555ff81643c2 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:01.599562 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:01.647979 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:01.648998 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:01.651455 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] 10.222.0.76 "PUT /v2.0/ports/632953d6-f6ad-4465-b608-8f2b459ee5e2 HTTP/1.1" status: 200 len: 1092 time: 4.7900817 May 12 15:22:01.661043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f1860d3-a7e3-4641-b4cd-169837fafc21', 'tag': '632953d6-f6ad-4465-b608-8f2b459ee5e2'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:01.695117 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c7409a0b-1a55-4c5d-84cd-8c99822071be req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:01.700157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38a1fc2f-710d-42b5-8efb-4644e656027f service neutron] Pushing event updated for resources: {'Port': ['ID=632953d6-f6ad-4465-b608-8f2b459ee5e2,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:01.724712 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ab4946d-e86f-4dec-bd85-88d17d2e8fab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:01.753687 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c7409a0b-1a55-4c5d-84cd-8c99822071be req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:01.803262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event updated for resources: {'SecurityGroup': ['ID=057a4553-3a0d-4b43-95bc-db43081f665c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:01.865705 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c7409a0b-1a55-4c5d-84cd-8c99822071be req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:01.867358 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7409a0b-1a55-4c5d-84cd-8c99822071be req-fd3cce6a-5983-4f87-9607-ab22e360b798 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1812 time: 0.7504368 May 12 15:22:01.885203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-83614ca6-3a66-4bf6-9474-29139c8eb1e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:01.886895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-83614ca6-3a66-4bf6-9474-29139c8eb1e9 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=4789db12ded14c2e8773d2396c9acd32&device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 1095 time: 0.1720099 May 12 15:22:01.930767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ab4946d-e86f-4dec-bd85-88d17d2e8fab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9cda2b9-397a-4d35-ad65-13e8a26f2766,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:02.049636 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ab4946d-e86f-4dec-bd85-88d17d2e8fab admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:02.053987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ab4946d-e86f-4dec-bd85-88d17d2e8fab admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f9cda2b9-397a-4d35-ad65-13e8a26f2766 HTTP/1.1" status: 204 len: 168 time: 1.6689358 May 12 15:22:02.154671 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:02.176122 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:02.218100 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:02.248891 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-51340f16-a01e-48e4-a4d1-95e819160bac service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=632953d6-f6ad-4465-b608-8f2b459ee5e2 HTTP/1.1" status: 200 len: 217 time: 0.3552229 May 12 15:22:02.414011 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device eaeeccb2-8af7-4344-866b-7226dbc22776 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:22:02.423186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21af460f-fb32-4fbe-be49-a93ac2eaeb90 req-2fdd4f75-0a98-4fba-b1b1-a6f569bd654f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:02.425338 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21af460f-fb32-4fbe-be49-a93ac2eaeb90 req-2fdd4f75-0a98-4fba-b1b1-a6f569bd654f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.2745047 May 12 15:22:02.441378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-c86f048d-abd9-45c8-920b-cab59ada2c83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:02.442821 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-c86f048d-abd9-45c8-920b-cab59ada2c83 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5a24db8d-fb66-4b7f-bf96-50956cb218fd HTTP/1.1" status: 200 len: 862 time: 0.1870668 May 12 15:22:02.457216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e4eec0b-6132-4ceb-aabe-c6f475244672 req-1bacfadf-2dd4-41f0-bfa8-5e3954410ba2 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:02.464033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e4eec0b-6132-4ceb-aabe-c6f475244672 req-1bacfadf-2dd4-41f0-bfa8-5e3954410ba2 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 945 time: 0.3471932 May 12 15:22:02.534592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port eaeeccb2-8af7-4344-866b-7226dbc22776 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:22:02.543664 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port eaeeccb2-8af7-4344-866b-7226dbc22776 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:22:02.544215 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:02.603448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-1ed0a311-9a5c-4f07-b1d0-f240a339efe0 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=670dbecd-f547-4abf-b069-62f0c8712c6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1084266 May 12 15:22:02.686740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Calling delete_port for 8719cc60-3862-418d-92c9-555ff81643c2 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:22:02.701680 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:02.736826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1b949ed9-fdac-46f6-8db0-a707458b85d2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eaeeccb2-8af7-4344-866b-7226dbc22776'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:02.752214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port eaeeccb2-8af7-4344-866b-7226dbc22776, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=eaeeccb2-8af7-4344-866b-7226dbc22776,segment=NetworkSegment(ccba5697-f062-48f7-986e-3317afc51896),segment_id=ccba5697-f062-48f7-986e-3317afc51896)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:02.757813 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:02.867111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=eaeeccb2-8af7-4344-866b-7226dbc22776,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:02.886873 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e4eec0b-6132-4ceb-aabe-c6f475244672 req-36a183f4-290c-4c65-838a-00e433045e0b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4219501 May 12 15:22:02.905932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21af460f-fb32-4fbe-be49-a93ac2eaeb90 req-3b2c72eb-e6c3-4082-b435-b7cda136774c tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4620922 May 12 15:22:02.960742 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-95b2194e-2537-428c-ba01-28c8bca7649b service neutron] 10.222.0.76 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3408122 May 12 15:22:03.057841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Allocated IP 172.20.0.1 (50dc0c23-2977-4989-b609-20b428ab0210/5f771c35-bd94-4a21-a94d-6c5900db0ac2/986ca089-12d7-4947-a38d-f9e6f70953a8) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:22:03.190595 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8c64e151-bf60-49ab-aa9f-685b6419bba7'] response: {'name': 'network-changed', 'server_uuid': '4f1860d3-a7e3-4641-b4cd-169837fafc21', 'tag': '632953d6-f6ad-4465-b608-8f2b459ee5e2', 'status': 'completed', 'code': 200} May 12 15:22:03.429410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:03.453339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9bb13c5-81f8-4012-96d5-eabf35a70444 req-899d1a00-e852-4ba1-bde2-deec00e48cf3 service neutron] 10.222.0.76 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4804130 May 12 15:22:03.513415 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7b337d7-acc4-46f8-9ed1-0e4e95217ab9 req-4052dd7f-ed9a-4540-a667-9fb2ccd3eb4f tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/dbd855f9-e86b-4956-aa84-f5297280e69d HTTP/1.1" status: 200 len: 1807 time: 0.3294258 May 12 15:22:03.587484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af3a6f4c-899b-4371-a3b5-8e12e5ddc2b1 req-6f8b6c7f-5ac7-465a-b1fa-13f514a54011 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:03.587484 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af3a6f4c-899b-4371-a3b5-8e12e5ddc2b1 req-6f8b6c7f-5ac7-465a-b1fa-13f514a54011 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 946 time: 0.3811135 May 12 15:22:03.605256 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:03.605256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Transition to ACTIVE for port object 986ca089-12d7-4947-a38d-f9e6f70953a8 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:22:03.640681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Pushing event deleted for resources: {'Port': ['ID=8719cc60-3862-418d-92c9-555ff81643c2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:03.667472 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7b337d7-acc4-46f8-9ed1-0e4e95217ab9 req-1ebcf548-9b5d-4cb5-bc4d-4a8cee3c13cf tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/057a4553-3a0d-4b43-95bc-db43081f665c HTTP/1.1" status: 200 len: 1807 time: 0.1527989 May 12 15:22:03.688849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-d7b337d7-acc4-46f8-9ed1-0e4e95217ab9 req-9b669589-1fcd-4dbd-be7c-d3a43c141192 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': None, 'security_group_id': 'dbd855f9-e86b-4956-aa84-f5297280e69d', 'remote_group_id': '057a4553-3a0d-4b43-95bc-db43081f665c', 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:03.689466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-d7b337d7-acc4-46f8-9ed1-0e4e95217ab9 req-9b669589-1fcd-4dbd-be7c-d3a43c141192 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': None, 'security_group_id': 'dbd855f9-e86b-4956-aa84-f5297280e69d', 'remote_group_id': '057a4553-3a0d-4b43-95bc-db43081f665c', 'port_range_min': 22, 'port_range_max': 22}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:03.704933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-d7b337d7-acc4-46f8-9ed1-0e4e95217ab9 req-9b669589-1fcd-4dbd-be7c-d3a43c141192 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:03.722481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af3a6f4c-899b-4371-a3b5-8e12e5ddc2b1 req-43f6e487-3633-4117-8cf5-53677525d868 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1447742 May 12 15:22:03.728645 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:03.741308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d7b337d7-acc4-46f8-9ed1-0e4e95217ab9 req-9b669589-1fcd-4dbd-be7c-d3a43c141192 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group_rule and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:03.758877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d7b337d7-acc4-46f8-9ed1-0e4e95217ab9 req-9b669589-1fcd-4dbd-be7c-d3a43c141192 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group_rule was recalculated. Used quota:14. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:03.774929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-d7b337d7-acc4-46f8-9ed1-0e4e95217ab9 req-9b669589-1fcd-4dbd-be7c-d3a43c141192 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 14; quota limit: 100; headroom:86 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:03.822040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef618b99-c3b4-4ee5-ba6e-fe2c0e8bb8cb req-ebd6576d-507b-42ce-8047-09faa33df291 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:03.830391 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef618b99-c3b4-4ee5-ba6e-fe2c0e8bb8cb req-ebd6576d-507b-42ce-8047-09faa33df291 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=4789db12ded14c2e8773d2396c9acd32&device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 1095 time: 0.2764747 May 12 15:22:03.918657 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:03.921125 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:03.966235 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:03.967059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Fanout notify agent at l3_agent the message router_deleted on router 252b9228-6855-4c38-8dc5-a270efa179ff {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:22:03.975111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:04.027622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Network 50dc0c23-2977-4989-b609-20b428ab0210 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:22:04.035448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:22:04.037967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:22:04.075278 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d7b337d7-acc4-46f8-9ed1-0e4e95217ab9 req-9b669589-1fcd-4dbd-be7c-d3a43c141192 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:04.107356 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:04.108757 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b7b67d7a-b5d2-4498-8119-2e813b278f75 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "DELETE /v2.0/routers/252b9228-6855-4c38-8dc5-a270efa179ff HTTP/1.1" status: 204 len: 168 time: 3.9830070 May 12 15:22:04.115896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35296) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:04.128491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3d42334e-8e59-4adc-8629-d4c7a5d560bf tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1742863274', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:04.144697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef618b99-c3b4-4ee5-ba6e-fe2c0e8bb8cb req-a796e87d-8bcf-4dfd-b020-9580fd5f583e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:04.146344 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef618b99-c3b4-4ee5-ba6e-fe2c0e8bb8cb req-a796e87d-8bcf-4dfd-b020-9580fd5f583e service neutron] 10.222.0.76 "GET /v2.0/networks?id=670dbecd-f547-4abf-b069-62f0c8712c6b HTTP/1.1" status: 200 len: 923 time: 0.3060112 May 12 15:22:04.146730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3d42334e-8e59-4adc-8629-d4c7a5d560bf tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:04.149344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event updated for resources: {'Port': ['ID=986ca089-12d7-4947-a38d-f9e6f70953a8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:04.158974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3d42334e-8e59-4adc-8629-d4c7a5d560bf tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Usage tracker for resource:router and tenant:e87ae982708240299f16d4cfc5f73d5d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:04.164088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3d42334e-8e59-4adc-8629-d4c7a5d560bf tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:04.167302 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:04.218143 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d7b337d7-acc4-46f8-9ed1-0e4e95217ab9 req-9b669589-1fcd-4dbd-be7c-d3a43c141192 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:04.242800 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d7b337d7-acc4-46f8-9ed1-0e4e95217ab9 req-9b669589-1fcd-4dbd-be7c-d3a43c141192 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:04.252232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ff2db1-08b2-401b-8cca-d5ce98b67a28 req-f2488476-9e5d-4822-adde-c38d2efaeb6c tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:04.256118 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-92ff2db1-08b2-401b-8cca-d5ce98b67a28 req-f2488476-9e5d-4822-adde-c38d2efaeb6c tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 944 time: 0.3672712 May 12 15:22:04.257652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef618b99-c3b4-4ee5-ba6e-fe2c0e8bb8cb req-aa4bd117-2c3b-45d2-822f-83e1555d099c service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=632953d6-f6ad-4465-b608-8f2b459ee5e2 HTTP/1.1" status: 200 len: 217 time: 0.1014881 May 12 15:22:04.288895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b669589-1fcd-4dbd-be7c-d3a43c141192 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ef8ab874-074f-443c-a441-23be4023d95a,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:04.374408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef618b99-c3b4-4ee5-ba6e-fe2c0e8bb8cb req-b6e27eee-c2f0-4946-aa60-15f4c73dec0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:04.376854 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef618b99-c3b4-4ee5-ba6e-fe2c0e8bb8cb req-b6e27eee-c2f0-4946-aa60-15f4c73dec0f service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5a24db8d-fb66-4b7f-bf96-50956cb218fd HTTP/1.1" status: 200 len: 862 time: 0.0919831 May 12 15:22:04.390138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3d42334e-8e59-4adc-8629-d4c7a5d560bf tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:04.396954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d8a23260-20b7-4053-9445-91bfc8bdf89b None None] Provisioning for port 986ca089-12d7-4947-a38d-f9e6f70953a8 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:22:04.405121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d8a23260-20b7-4053-9445-91bfc8bdf89b None None] Provisioning complete for port 986ca089-12d7-4947-a38d-f9e6f70953a8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:22:04.405542 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d8a23260-20b7-4053-9445-91bfc8bdf89b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:04.444031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-92ff2db1-08b2-401b-8cca-d5ce98b67a28 req-3faa1d26-2e86-4fda-ac4e-36e001c4ae03 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1575646 May 12 15:22:04.445232 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d42334e-8e59-4adc-8629-d4c7a5d560bf tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:04.446631 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d42334e-8e59-4adc-8629-d4c7a5d560bf tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:04.479591 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d42334e-8e59-4adc-8629-d4c7a5d560bf tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:04.519559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d8a23260-20b7-4053-9445-91bfc8bdf89b None None] Port 986ca089-12d7-4947-a38d-f9e6f70953a8 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:22:04.526318 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d42334e-8e59-4adc-8629-d4c7a5d560bf tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:04.555504 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef618b99-c3b4-4ee5-ba6e-fe2c0e8bb8cb req-48a7ff57-6694-40d4-8f32-12c3253498e0 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=670dbecd-f547-4abf-b069-62f0c8712c6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1249428 May 12 15:22:04.562702 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4b13ccce-55c4-4e9e-87f4-4eba14fe49fa'] response: {'server_uuid': '1b949ed9-fdac-46f6-8db0-a707458b85d2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eaeeccb2-8af7-4344-866b-7226dbc22776', 'code': 200} May 12 15:22:04.573675 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d7b337d7-acc4-46f8-9ed1-0e4e95217ab9 req-9b669589-1fcd-4dbd-be7c-d3a43c141192 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:04.587409 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7b337d7-acc4-46f8-9ed1-0e4e95217ab9 req-9b669589-1fcd-4dbd-be7c-d3a43c141192 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 806 time: 0.9103625 May 12 15:22:04.625664 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d42334e-8e59-4adc-8629-d4c7a5d560bf tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:04.626849 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3d42334e-8e59-4adc-8629-d4c7a5d560bf tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.5081723 May 12 15:22:04.630304 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35304) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:04.638369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Request body: {'router': {'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:04.751266 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:05.166575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b87d29af-d76a-4c59-94f8-1cf7a3da0a23 req-30e691cb-846f-43bb-a412-402dd4b1401d tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:05.168001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b87d29af-d76a-4c59-94f8-1cf7a3da0a23 req-30e691cb-846f-43bb-a412-402dd4b1401d tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.1882701 May 12 15:22:05.223374 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef618b99-c3b4-4ee5-ba6e-fe2c0e8bb8cb req-b52d9328-b8f2-4be1-a3da-b334285e8bfc service neutron] 10.222.0.76 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6349244 May 12 15:22:05.250036 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b87d29af-d76a-4c59-94f8-1cf7a3da0a23 req-701c8521-0178-4006-85dd-d2326b66904b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0747609 May 12 15:22:05.377740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-169b2142-07f0-4501-8e14-27b654e30484 req-b2fbbdbb-5585-4e76-b6c6-4c16b9fec6af tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:05.379291 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-169b2142-07f0-4501-8e14-27b654e30484 req-b2fbbdbb-5585-4e76-b6c6-4c16b9fec6af tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.3435264 May 12 15:22:05.449462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef618b99-c3b4-4ee5-ba6e-fe2c0e8bb8cb req-57920020-900a-4fb5-b180-cc1cc8e7f1ab service neutron] 10.222.0.76 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2023761 May 12 15:22:05.461166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-4b02c71f-b7d1-4a5b-ae8d-5382afdb775e req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-643163986', 'description': 'tempest-description-1742103407'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:05.503694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4b02c71f-b7d1-4a5b-ae8d-5382afdb775e req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:05.512477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4b02c71f-b7d1-4a5b-ae8d-5382afdb775e req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:05.516941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4b02c71f-b7d1-4a5b-ae8d-5382afdb775e req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group was recalculated. Used quota:5. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:05.534734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4b02c71f-b7d1-4a5b-ae8d-5382afdb775e req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 1 items for resource security_group. Total usage: 5; quota limit: 100; headroom:95 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:05.538528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:05.546719 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-169b2142-07f0-4501-8e14-27b654e30484 req-798ba789-4c61-4240-a0d7-2f76f5ab3ac8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0949488 May 12 15:22:05.562624 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4b02c71f-b7d1-4a5b-ae8d-5382afdb775e req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:05.592616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc0944f-174c-4051-b191-090f8c05aabe req-6c7d68e2-7a39-4acf-93da-45946b01c856 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:05.595334 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6dc0944f-174c-4051-b191-090f8c05aabe req-6c7d68e2-7a39-4acf-93da-45946b01c856 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 1097 time: 0.8850486 May 12 15:22:05.609067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4b02c71f-b7d1-4a5b-ae8d-5382afdb775e req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:05.619372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4b02c71f-b7d1-4a5b-ae8d-5382afdb775e req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group_rule and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:05.622540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4b02c71f-b7d1-4a5b-ae8d-5382afdb775e req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group_rule was recalculated. Used quota:15. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:05.636963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4b02c71f-b7d1-4a5b-ae8d-5382afdb775e req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 15; quota limit: 100; headroom:85 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:05.752444 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4b02c71f-b7d1-4a5b-ae8d-5382afdb775e req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:05.765380 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4b02c71f-b7d1-4a5b-ae8d-5382afdb775e req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:05.809529 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6dc0944f-174c-4051-b191-090f8c05aabe req-4319c448-ab5a-415d-ac37-712564063aea service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1646926 May 12 15:22:05.860102 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4b02c71f-b7d1-4a5b-ae8d-5382afdb775e req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:05.861801 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b02c71f-b7d1-4a5b-ae8d-5382afdb775e req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.4806931 May 12 15:22:05.881666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-164bbf83-166d-4c05-ab8f-68f66e452f37 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d28dd915-dc30-4c92-9285-860328e255cc,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:05.942858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e4982a-d04d-4e9f-96b9-a0f049ba04e5 req-513df078-b266-4e58-bae6-606ef40bb1f5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:05.959405 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66e4982a-d04d-4e9f-96b9-a0f049ba04e5 req-513df078-b266-4e58-bae6-606ef40bb1f5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 946 time: 0.1571710 May 12 15:22:06.028677 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66e4982a-d04d-4e9f-96b9-a0f049ba04e5 req-b2430f03-36e4-45b2-b0a8-7fb8b4d57f51 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0682087 May 12 15:22:06.086454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f2ece4cb-efb8-4604-adc0-c610450288da req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-939976710', 'description': 'tempest-description-458278151'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:06.097996 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:22:06.102627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f2ece4cb-efb8-4604-adc0-c610450288da req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:06.114611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f2ece4cb-efb8-4604-adc0-c610450288da req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:06.118477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f2ece4cb-efb8-4604-adc0-c610450288da req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:06.131290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f2ece4cb-efb8-4604-adc0-c610450288da req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 1 items for resource security_group. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:06.163998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75187fac-0c10-4e55-b6a0-21ebdfca3d6f req-83e1758d-0265-47b3-bf75-ae3292dec330 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:06.165954 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75187fac-0c10-4e55-b6a0-21ebdfca3d6f req-83e1758d-0265-47b3-bf75-ae3292dec330 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 944 time: 0.1221004 May 12 15:22:06.167442 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f2ece4cb-efb8-4604-adc0-c610450288da req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:06.174054 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:06.183611 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:06.223318 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:06.232764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f2ece4cb-efb8-4604-adc0-c610450288da req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:06.237503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f2ece4cb-efb8-4604-adc0-c610450288da req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group_rule and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:06.240497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f2ece4cb-efb8-4604-adc0-c610450288da req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group_rule was recalculated. Used quota:17. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:06.246849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f2ece4cb-efb8-4604-adc0-c610450288da req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 17; quota limit: 100; headroom:83 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:06.253941 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:06.328428 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f2ece4cb-efb8-4604-adc0-c610450288da req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:06.334955 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75187fac-0c10-4e55-b6a0-21ebdfca3d6f req-7476857d-d1fa-4e8f-8aa2-5a06937ab7b0 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1542871 May 12 15:22:06.340624 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f2ece4cb-efb8-4604-adc0-c610450288da req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:06.434081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d960ec06-899d-4180-810f-064f51163f18,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:06.437326 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f2ece4cb-efb8-4604-adc0-c610450288da req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:06.442769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 632953d6-f6ad-4465-b608-8f2b459ee5e2 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:22:06.443443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2ece4cb-efb8-4604-adc0-c610450288da req-f7daf1ab-3857-487e-a2e7-493d36fa59e2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1810 time: 0.3671398 May 12 15:22:06.570194 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-247fe46c-7a1a-44e4-b45f-b459612d2f7c req-c6da6545-4258-4191-8006-e4525f1a9ab9 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/d28dd915-dc30-4c92-9285-860328e255cc HTTP/1.1" status: 200 len: 1806 time: 0.1033354 May 12 15:22:06.712656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-247fe46c-7a1a-44e4-b45f-b459612d2f7c req-0a5a13b6-495b-4a1f-97ad-9f7e3ba7eec9 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/d960ec06-899d-4180-810f-064f51163f18 HTTP/1.1" status: 200 len: 1805 time: 0.1337867 May 12 15:22:06.729703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-247fe46c-7a1a-44e4-b45f-b459612d2f7c req-6ce13075-f1a4-412d-98e9-459d2d9e4ed3 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': None, 'security_group_id': 'd28dd915-dc30-4c92-9285-860328e255cc', 'remote_group_id': 'd960ec06-899d-4180-810f-064f51163f18', 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:06.730302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-247fe46c-7a1a-44e4-b45f-b459612d2f7c req-6ce13075-f1a4-412d-98e9-459d2d9e4ed3 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': None, 'security_group_id': 'd28dd915-dc30-4c92-9285-860328e255cc', 'remote_group_id': 'd960ec06-899d-4180-810f-064f51163f18', 'port_range_min': 22, 'port_range_max': 22}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:06.740351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-247fe46c-7a1a-44e4-b45f-b459612d2f7c req-6ce13075-f1a4-412d-98e9-459d2d9e4ed3 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:06.750146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-247fe46c-7a1a-44e4-b45f-b459612d2f7c req-6ce13075-f1a4-412d-98e9-459d2d9e4ed3 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group_rule and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:06.754710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-247fe46c-7a1a-44e4-b45f-b459612d2f7c req-6ce13075-f1a4-412d-98e9-459d2d9e4ed3 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group_rule was recalculated. Used quota:19. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:06.769141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b51645ca-bc8f-42c0-9a4e-e3598d55e251 req-aefdc8f3-4440-4b8a-ac2a-306d68088cad tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:06.776371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b51645ca-bc8f-42c0-9a4e-e3598d55e251 req-aefdc8f3-4440-4b8a-ac2a-306d68088cad tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.1450984 May 12 15:22:06.779505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-247fe46c-7a1a-44e4-b45f-b459612d2f7c req-6ce13075-f1a4-412d-98e9-459d2d9e4ed3 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 19; quota limit: 100; headroom:81 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:06.849108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event updated for resources: {'Port': ['ID=986ca089-12d7-4947-a38d-f9e6f70953a8,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:06.864552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b51645ca-bc8f-42c0-9a4e-e3598d55e251 req-a3c97b26-595c-45f4-acd2-ef5d37aa1226 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0852270 May 12 15:22:06.944151 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-247fe46c-7a1a-44e4-b45f-b459612d2f7c req-6ce13075-f1a4-412d-98e9-459d2d9e4ed3 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:06.950283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:06.975677 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 632953d6-f6ad-4465-b608-8f2b459ee5e2, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=632953d6-f6ad-4465-b608-8f2b459ee5e2,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:07.010780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '632953d6-f6ad-4465-b608-8f2b459ee5e2', 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b', 'port_id': '632953d6-f6ad-4465-b608-8f2b459ee5e2', 'mac_address': 'fa:16:3e:08:8e:b1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 589, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5a24db8d-fb66-4b7f-bf96-50956cb218fd', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:22:07.021058 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-247fe46c-7a1a-44e4-b45f-b459612d2f7c req-6ce13075-f1a4-412d-98e9-459d2d9e4ed3 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:07.029992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-247fe46c-7a1a-44e4-b45f-b459612d2f7c req-6ce13075-f1a4-412d-98e9-459d2d9e4ed3 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:07.051552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ce13075-f1a4-412d-98e9-459d2d9e4ed3 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6cb616b3-93b4-4cb7-a518-275a2f2606ba,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:07.120786 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-247fe46c-7a1a-44e4-b45f-b459612d2f7c req-6ce13075-f1a4-412d-98e9-459d2d9e4ed3 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:07.122403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-247fe46c-7a1a-44e4-b45f-b459612d2f7c req-6ce13075-f1a4-412d-98e9-459d2d9e4ed3 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 806 time: 0.4019637 May 12 15:22:07.197339 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:07.214816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca1c181f-9d2a-4539-9c40-0559c57320af req-927d3b79-2724-468c-9abb-e909f775e8ec tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:07.216239 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca1c181f-9d2a-4539-9c40-0559c57320af req-927d3b79-2724-468c-9abb-e909f775e8ec tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.1421149 May 12 15:22:07.256671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 632953d6-f6ad-4465-b608-8f2b459ee5e2 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:22:07.263207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Allocated IP 172.25.8.69 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/dcb1c6e0-7275-4c7b-aaa0-83facd43fb3f) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:22:07.293647 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 632953d6-f6ad-4465-b608-8f2b459ee5e2, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=632953d6-f6ad-4465-b608-8f2b459ee5e2,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:07.299149 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca1c181f-9d2a-4539-9c40-0559c57320af req-74682535-50a6-4db7-b0fc-d1241da4068e tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0738635 May 12 15:22:07.302691 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:07.428930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=632953d6-f6ad-4465-b608-8f2b459ee5e2,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:07.442684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b027afbc-4481-490f-921e-ecee48130e2c req-a8daded6-0250-45fe-932b-34ff6d4b9bd8 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/d960ec06-899d-4180-810f-064f51163f18 HTTP/1.1" status: 200 len: 1805 time: 0.0929105 May 12 15:22:07.510964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Network 50dc0c23-2977-4989-b609-20b428ab0210 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:22:07.511772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['632953d6-f6ad-4465-b608-8f2b459ee5e2'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:22:07.517753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:22:07.766741 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b027afbc-4481-490f-921e-ecee48130e2c req-d33df30d-078c-4a34-8a38-31cfc2528be7 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:07.852051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35346) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:07.865822 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b027afbc-4481-490f-921e-ecee48130e2c req-d33df30d-078c-4a34-8a38-31cfc2528be7 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:07.896876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15293b32-9786-4fff-b4e1-5a8b23fb1400 req-c65c8b0e-1b74-483b-a32d-541d3f053044 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:07.906445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15293b32-9786-4fff-b4e1-5a8b23fb1400 req-c65c8b0e-1b74-483b-a32d-541d3f053044 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 946 time: 0.4621332 May 12 15:22:07.925599 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:07.930440 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Router 0a20e216-0f20-463c-92e2-94e5c5a92acd has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:22:07.980314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6681008e-bc32-4641-81d2-99126c62bc97 None None] Provisioning complete for port 986ca089-12d7-4947-a38d-f9e6f70953a8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:22:07.980692 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6681008e-bc32-4641-81d2-99126c62bc97 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:07.981986 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15293b32-9786-4fff-b4e1-5a8b23fb1400 req-7dcdf4f8-cad3-44e6-bee7-c75db94bd81f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0738888 May 12 15:22:08.056130 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b027afbc-4481-490f-921e-ecee48130e2c req-d33df30d-078c-4a34-8a38-31cfc2528be7 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:08.128137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d33df30d-078c-4a34-8a38-31cfc2528be7 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d960ec06-899d-4180-810f-064f51163f18,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:08.129131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6681008e-bc32-4641-81d2-99126c62bc97 None None] Port 986ca089-12d7-4947-a38d-f9e6f70953a8 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:22:08.137752 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bffa5557-cfd0-4b43-aa1d-853b6e44fe6e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:08.154703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b027afbc-4481-490f-921e-ecee48130e2c req-d33df30d-078c-4a34-8a38-31cfc2528be7 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:08.156329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b027afbc-4481-490f-921e-ecee48130e2c req-d33df30d-078c-4a34-8a38-31cfc2528be7 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "DELETE /v2.0/security-groups/d960ec06-899d-4180-810f-064f51163f18 HTTP/1.1" status: 204 len: 173 time: 0.6716008 May 12 15:22:08.163485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bffa5557-cfd0-4b43-aa1d-853b6e44fe6e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:08.167878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bffa5557-cfd0-4b43-aa1d-853b6e44fe6e admin admin] Usage tracker for resource:security_group_rule and tenant:d7c296e1707e42e1bccda7daad8991ab is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:08.171394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bffa5557-cfd0-4b43-aa1d-853b6e44fe6e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:08.186097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bffa5557-cfd0-4b43-aa1d-853b6e44fe6e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:08.309104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:22:08.326182 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d4d2efdf-09bc-40eb-be0d-ad11f073d2d6 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "PUT /v2.0/routers/0a20e216-0f20-463c-92e2-94e5c5a92acd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.9845457 May 12 15:22:08.326182 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:08.328622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcee0c77-c789-446e-9183-a64a499b28bb None None] Sync routers for ids ['0a20e216-0f20-463c-92e2-94e5c5a92acd'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:22:08.335104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35356) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:08.350528 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcee0c77-c789-446e-9183-a64a499b28bb None None] Routers {'0a20e216-0f20-463c-92e2-94e5c5a92acd'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:22:08.352423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dcee0c77-c789-446e-9183-a64a499b28bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0a20e216-0f20-463c-92e2-94e5c5a92acd'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:08.436113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:22:08.443343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 632953d6-f6ad-4465-b608-8f2b459ee5e2 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:22:08.443998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Pushing event updated for resources: {'Port': ['ID=dcb1c6e0-7275-4c7b-aaa0-83facd43fb3f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:08.449766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:22:08.452316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:22:08.498932 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dcee0c77-c789-446e-9183-a64a499b28bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:08.531067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcee0c77-c789-446e-9183-a64a499b28bb None None] Routers {'0a20e216-0f20-463c-92e2-94e5c5a92acd'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:22:08.532013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dcee0c77-c789-446e-9183-a64a499b28bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0a20e216-0f20-463c-92e2-94e5c5a92acd'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:08.610969 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dcee0c77-c789-446e-9183-a64a499b28bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:08.611655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcee0c77-c789-446e-9183-a64a499b28bb None None] The sync data for ids ['0a20e216-0f20-463c-92e2-94e5c5a92acd'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:22:08.635937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 632953d6-f6ad-4465-b608-8f2b459ee5e2 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:22:08.642812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 632953d6-f6ad-4465-b608-8f2b459ee5e2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:22:08.643431 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:08.687172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4b81ce-91c8-4e63-9041-53fd863188ed req-84262f67-7343-4ebe-bb42-65b012caca07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:08.690725 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cc4b81ce-91c8-4e63-9041-53fd863188ed req-84262f67-7343-4ebe-bb42-65b012caca07 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 1097 time: 0.5124140 May 12 15:22:08.747656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5624e5d-ce8e-4c60-8a1f-c6732c4d5a4c req-6c0d8bd5-f801-4824-83e5-982699f0dffb tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:08.756226 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5624e5d-ce8e-4c60-8a1f-c6732c4d5a4c req-6c0d8bd5-f801-4824-83e5-982699f0dffb tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 945 time: 0.4998479 May 12 15:22:08.787911 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bffa5557-cfd0-4b43-aa1d-853b6e44fe6e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:08.797706 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:08.810784 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bffa5557-cfd0-4b43-aa1d-853b6e44fe6e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:08.832086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f1860d3-a7e3-4641-b4cd-169837fafc21', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '632953d6-f6ad-4465-b608-8f2b459ee5e2'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:08.844899 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 632953d6-f6ad-4465-b608-8f2b459ee5e2, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=632953d6-f6ad-4465-b608-8f2b459ee5e2,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:08.854691 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bffa5557-cfd0-4b43-aa1d-853b6e44fe6e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d7c296e1707e42e1bccda7daad8991ab&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9995835 May 12 15:22:08.859305 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:08.864390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35364) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:08.871297 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4b3a70c3-e629-4d75-aaca-0620f0558159 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:08.947232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=632953d6-f6ad-4465-b608-8f2b459ee5e2,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:08.953614 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-74180e83-11ef-41ea-a553-620a9c3f490a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:08.989832 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-74180e83-11ef-41ea-a553-620a9c3f490a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:09.016902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1222bdda-034e-4299-b8b9-847a91f97cd5 req-40521b0d-9275-4492-aeaf-80c7b5b0e979 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:09.018703 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1222bdda-034e-4299-b8b9-847a91f97cd5 req-40521b0d-9275-4492-aeaf-80c7b5b0e979 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.6823690 May 12 15:22:09.029375 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5624e5d-ce8e-4c60-8a1f-c6732c4d5a4c req-8e56ccc2-2c15-4b6e-89c4-d5df86b5524e tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2720625 May 12 15:22:09.114817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bffa5557-cfd0-4b43-aa1d-853b6e44fe6e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=78c1ca49-1d31-401c-bb2f-13f8320b9dfd,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:09.179708 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1222bdda-034e-4299-b8b9-847a91f97cd5 req-8551a965-c582-48d5-8c75-5ea434bc3eee tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1457109 May 12 15:22:09.197035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4b81ce-91c8-4e63-9041-53fd863188ed req-d6db3542-c201-447f-aa73-1cbadaa5f4b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:09.198788 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cc4b81ce-91c8-4e63-9041-53fd863188ed req-d6db3542-c201-447f-aa73-1cbadaa5f4b0 service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.4607551 May 12 15:22:09.206982 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-74180e83-11ef-41ea-a553-620a9c3f490a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:09.220430 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-4b3a70c3-e629-4d75-aaca-0620f0558159 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] delete failed (client error): There was a conflict when trying to complete your request. May 12 15:22:09.224442 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4b3a70c3-e629-4d75-aaca-0620f0558159 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "DELETE /v2.0/routers/0a20e216-0f20-463c-92e2-94e5c5a92acd HTTP/1.1" status: 409 len: 329 time: 0.8829942 May 12 15:22:09.225832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35372) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:09.241516 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1c45e8f-ce29-4a63-8ce3-a99b187c3f73 req-bf0d0693-ee39-4fab-8665-0c691d4f90b5 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/d28dd915-dc30-4c92-9285-860328e255cc HTTP/1.1" status: 200 len: 1806 time: 0.1690204 May 12 15:22:09.321332 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e0fa05c8-f7e2-4fef-a3b7-310644894e19'] response: {'server_uuid': '4f1860d3-a7e3-4641-b4cd-169837fafc21', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '632953d6-f6ad-4465-b608-8f2b459ee5e2', 'code': 200} May 12 15:22:09.548829 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-74180e83-11ef-41ea-a553-620a9c3f490a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:09.562502 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-74180e83-11ef-41ea-a553-620a9c3f490a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/78c1ca49-1d31-401c-bb2f-13f8320b9dfd HTTP/1.1" status: 204 len: 168 time: 0.6840212 May 12 15:22:09.617347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74180e83-11ef-41ea-a553-620a9c3f490a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=78c1ca49-1d31-401c-bb2f-13f8320b9dfd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:09.779984 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cc4b81ce-91c8-4e63-9041-53fd863188ed req-c18a17d7-9489-4e26-98a3-a483d382e627 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26 HTTP/1.1" status: 200 len: 1001 time: 0.5653553 May 12 15:22:09.811166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee5d6f20-5adc-4d00-9bf0-2494005adc44 req-5f2a5ea6-5cad-4d37-baaa-b95a2b0f91b6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:09.812615 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee5d6f20-5adc-4d00-9bf0-2494005adc44 req-5f2a5ea6-5cad-4d37-baaa-b95a2b0f91b6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 946 time: 0.3282957 May 12 15:22:09.840267 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:09.869141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57cbb461-f17b-4244-8b34-c27bde428c48 req-dfb40098-03b9-4508-b73c-9a2b1a630f63 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:09.870630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57cbb461-f17b-4244-8b34-c27bde428c48 req-dfb40098-03b9-4508-b73c-9a2b1a630f63 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.4230227 May 12 15:22:09.884050 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee5d6f20-5adc-4d00-9bf0-2494005adc44 req-86db42c6-b89a-4cd0-8655-cca0005ee6bc tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0608189 May 12 15:22:09.959406 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57cbb461-f17b-4244-8b34-c27bde428c48 req-88405f0b-9abd-45b9-ad66-ecf99c961c55 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0743206 May 12 15:22:10.035210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-bfa1afa6-3ed6-49ca-b2fd-9dc0915f835b req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-1689832186', 'description': 'tempest-description-121108288'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:10.046024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-bfa1afa6-3ed6-49ca-b2fd-9dc0915f835b req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:10.054654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe3f47c7-1e9b-4576-9e10-d124c0801022 req-bc28c6d0-ede9-44bf-85ba-6cae901c8bc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:10.056286 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fe3f47c7-1e9b-4576-9e10-d124c0801022 req-bc28c6d0-ede9-44bf-85ba-6cae901c8bc4 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 1097 time: 0.4920902 May 12 15:22:10.077621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4b81ce-91c8-4e63-9041-53fd863188ed req-754a36a2-9808-425c-95ec-4051d6b56244 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:10.079954 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cc4b81ce-91c8-4e63-9041-53fd863188ed req-754a36a2-9808-425c-95ec-4051d6b56244 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.2905118 May 12 15:22:10.085779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-bfa1afa6-3ed6-49ca-b2fd-9dc0915f835b req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:10.093664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-bfa1afa6-3ed6-49ca-b2fd-9dc0915f835b req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:10.106333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-bfa1afa6-3ed6-49ca-b2fd-9dc0915f835b req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 1 items for resource security_group. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:10.153996 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bfa1afa6-3ed6-49ca-b2fd-9dc0915f835b req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:10.232358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-bfa1afa6-3ed6-49ca-b2fd-9dc0915f835b req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:10.238631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-bfa1afa6-3ed6-49ca-b2fd-9dc0915f835b req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group_rule and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:10.242155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-bfa1afa6-3ed6-49ca-b2fd-9dc0915f835b req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group_rule was recalculated. Used quota:17. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:10.248738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-bfa1afa6-3ed6-49ca-b2fd-9dc0915f835b req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 17; quota limit: 100; headroom:83 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:10.329598 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bfa1afa6-3ed6-49ca-b2fd-9dc0915f835b req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:10.342370 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bfa1afa6-3ed6-49ca-b2fd-9dc0915f835b req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:10.403624 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af78d7bd-dcb4-463f-b4b9-bcd6202dc0a7 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:10.635744 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fe3f47c7-1e9b-4576-9e10-d124c0801022 req-330bbdbd-ddc2-4d8b-a70e-1e48991ba4dd service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5717764 May 12 15:22:10.818976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4b81ce-91c8-4e63-9041-53fd863188ed req-d68db8f0-f3c1-4f80-9c19-19d81703b344 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:10.820772 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cc4b81ce-91c8-4e63-9041-53fd863188ed req-d68db8f0-f3c1-4f80-9c19-19d81703b344 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3402851 May 12 15:22:10.829315 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:10.918437 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:10.920697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35406) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:11.020087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c274df9d-d2cc-4c81-9d1a-729224f5463a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:11.050692 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bfa1afa6-3ed6-49ca-b2fd-9dc0915f835b req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:11.052418 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bfa1afa6-3ed6-49ca-b2fd-9dc0915f835b req-e011aa97-53b5-4be1-a395-3382d08528e0 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 1.0222449 May 12 15:22:11.162911 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cc4b81ce-91c8-4e63-9041-53fd863188ed req-0313ca4f-1ba0-4f34-85bb-b0fecceea44c service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3284795 May 12 15:22:11.227054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab189d6-aca1-486f-9019-76846741ab92 req-5773efa9-bfed-4beb-a970-d7efc4f3ab6a tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:11.228640 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cab189d6-aca1-486f-9019-76846741ab92 req-5773efa9-bfed-4beb-a970-d7efc4f3ab6a tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 946 time: 0.5533149 May 12 15:22:11.336404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestJSON-360610849-network', 'tenant_id': '4e5a10df576841e2a4752a9d47fb790a'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:11.340865 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:11.350788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3edec5-8518-43cc-a84b-68f9986c0b8b req-8d48fd73-cd60-45c7-95ee-eb6e373bb89d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:11.352048 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b3edec5-8518-43cc-a84b-68f9986c0b8b req-8d48fd73-cd60-45c7-95ee-eb6e373bb89d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9e2382be0c6f4779ae64026a57628773&device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 1097 time: 0.7154250 May 12 15:22:11.358521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Usage tracker for resource:network and tenant:4e5a10df576841e2a4752a9d47fb790a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:11.379894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Router 5aff139c-1195-4f11-9450-493179af890f is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:22:11.396570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:11.409664 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cc4b81ce-91c8-4e63-9041-53fd863188ed req-11c2fe83-821a-459b-a5cb-047d55ec14ef service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2237353 May 12 15:22:11.457086 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cab189d6-aca1-486f-9019-76846741ab92 req-a07e0338-de25-4035-9adf-942c1d6a360c tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1801639 May 12 15:22:11.477427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:11.483420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-af78d7bd-dcb4-463f-b4b9-bcd6202dc0a7 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Deleting port 986ca089-12d7-4947-a38d-f9e6f70953a8 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:11.483754 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af78d7bd-dcb4-463f-b4b9-bcd6202dc0a7 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:11.575682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Made reservation on behalf of 4e5a10df576841e2a4752a9d47fb790a for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:22:11.577925 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:11.650603 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:11.726871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:22:11.734167 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:11.736219 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f9f1f3f2-673d-4f69-98f0-3236fa605d86 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "PUT /v2.0/routers/5aff139c-1195-4f11-9450-493179af890f HTTP/1.1" status: 200 len: 879 time: 7.1051474 May 12 15:22:11.738539 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b249d008-9dfb-4328-995f-65ad189c42cc None None] Sync routers for ids ['5aff139c-1195-4f11-9450-493179af890f'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:22:11.739055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35430) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:11.754201 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b249d008-9dfb-4328-995f-65ad189c42cc None None] Routers {'5aff139c-1195-4f11-9450-493179af890f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:22:11.755197 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b249d008-9dfb-4328-995f-65ad189c42cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5aff139c-1195-4f11-9450-493179af890f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:11.785196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb0c6cf7-1f15-47a2-99ad-f1b8736eb4b2 req-a1258a99-121c-4076-826f-35482d406328 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:11.786687 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb0c6cf7-1f15-47a2-99ad-f1b8736eb4b2 req-a1258a99-121c-4076-826f-35482d406328 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.5718148 May 12 15:22:11.787887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:11.799141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3edec5-8518-43cc-a84b-68f9986c0b8b req-c854aefe-cacc-454e-a99c-017d740ac473 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:11.800548 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b3edec5-8518-43cc-a84b-68f9986c0b8b req-c854aefe-cacc-454e-a99c-017d740ac473 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e7794860-7444-4123-96d5-ca3febf5e162 HTTP/1.1" status: 200 len: 911 time: 0.4375174 May 12 15:22:11.859633 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b249d008-9dfb-4328-995f-65ad189c42cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:11.870038 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b249d008-9dfb-4328-995f-65ad189c42cc None None] Routers {'5aff139c-1195-4f11-9450-493179af890f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:22:11.870956 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b249d008-9dfb-4328-995f-65ad189c42cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5aff139c-1195-4f11-9450-493179af890f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:11.902738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Usage tracker for resource:security_group_rule and tenant:4e5a10df576841e2a4752a9d47fb790a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:11.913159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:11.936418 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b3edec5-8518-43cc-a84b-68f9986c0b8b req-57d39359-5564-42d1-9114-a728da9b4dd9 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=eaeeccb2-8af7-4344-866b-7226dbc22776 HTTP/1.1" status: 200 len: 217 time: 0.1047690 May 12 15:22:11.941857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:11.942546 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b249d008-9dfb-4328-995f-65ad189c42cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:11.943018 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b249d008-9dfb-4328-995f-65ad189c42cc None None] The sync data for ids ['5aff139c-1195-4f11-9450-493179af890f'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:22:11.952761 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e7b6a907-bdbe-4049-af4a-5aceff78501a tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/routers/5aff139c-1195-4f11-9450-493179af890f HTTP/1.1" status: 200 len: 920 time: 0.2124221 May 12 15:22:11.955141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35436) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:12.035859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16643e66-9638-4837-977f-9c9328e76913 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:12.037559 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-16643e66-9638-4837-977f-9c9328e76913 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/ports?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&device_id=5aff139c-1195-4f11-9450-493179af890f&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.0812466 May 12 15:22:12.040686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35440) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:12.054780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb0c6cf7-1f15-47a2-99ad-f1b8736eb4b2 req-bf261620-b5c1-4275-b6cb-e467f0cf3599 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2530844 May 12 15:22:12.069670 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af78d7bd-dcb4-463f-b4b9-bcd6202dc0a7 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:12.195630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-487362cc-1830-4c15-95b4-a9bf5033b064 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:12.197007 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-487362cc-1830-4c15-95b4-a9bf5033b064 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 881 time: 0.1554267 May 12 15:22:12.199793 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35450) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:12.214192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-af78d7bd-dcb4-463f-b4b9-bcd6202dc0a7 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Calling delete_port for 986ca089-12d7-4947-a38d-f9e6f70953a8 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:22:12.245910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3edec5-8518-43cc-a84b-68f9986c0b8b req-5c243e0a-edfe-4bd7-8646-3eb98b306525 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:12.247293 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b3edec5-8518-43cc-a84b-68f9986c0b8b req-5c243e0a-edfe-4bd7-8646-3eb98b306525 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=eae80ee9-f335-4892-af0b-41490fc3c6b5 HTTP/1.1" status: 200 len: 850 time: 0.2836227 May 12 15:22:12.251076 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9688e0d4-be98-4015-ae2c-73ddfd3f8a17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "GET /v2.0/ports?device_id=5aff139c-1195-4f11-9450-493179af890f HTTP/1.1" status: 200 len: 205 time: 0.0496643 May 12 15:22:12.253985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35454) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:12.256189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5fb2a85-aabb-4083-ad05-2506f4fc80c4 req-4a145785-9921-4c26-bcd4-279b03e5d6fa tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:12.257661 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5fb2a85-aabb-4083-ad05-2506f4fc80c4 req-4a145785-9921-4c26-bcd4-279b03e5d6fa tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 946 time: 0.6838751 May 12 15:22:12.384626 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b3edec5-8518-43cc-a84b-68f9986c0b8b req-b4e2fa76-2f43-4397-9ba1-7fc98956926f service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e7794860-7444-4123-96d5-ca3febf5e162&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1260312 May 12 15:22:12.457876 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:12.561896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5fb2a85-aabb-4083-ad05-2506f4fc80c4 req-41881606-05e3-476c-984b-3726731382e8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2919579 May 12 15:22:12.662783 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:12.663857 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2f2b6d17-8d59-4539-9931-ce19e2aa3292 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:12.676008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Deleting port dcb1c6e0-7275-4c7b-aaa0-83facd43fb3f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:12.676448 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:12.843842 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:12.848081 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:12.857172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ffcbbf-83ea-4930-808d-b1dc99448210 req-982760d3-c07e-4571-93c5-217faa8add07 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:12.862355 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83ffcbbf-83ea-4930-808d-b1dc99448210 req-982760d3-c07e-4571-93c5-217faa8add07 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.6189339 May 12 15:22:12.868985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:12.880322 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:12.884326 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b3edec5-8518-43cc-a84b-68f9986c0b8b req-3645d3c8-8feb-4542-9730-227703921747 service neutron] 10.222.0.76 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4868205 May 12 15:22:12.957880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bef48029-5fd1-4712-9b08-77b63d94713f req-60eb3718-4398-419a-9476-6a6254466fcd tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/c274df9d-d2cc-4c81-9d1a-729224f5463a HTTP/1.1" status: 200 len: 1806 time: 0.3479257 May 12 15:22:13.001618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Calling delete_port for dcb1c6e0-7275-4c7b-aaa0-83facd43fb3f owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:22:13.022553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 559} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:22:13.053648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-bef48029-5fd1-4712-9b08-77b63d94713f req-edfc9320-c5b2-4524-b387-6805b8d923bd tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': 'c274df9d-d2cc-4c81-9d1a-729224f5463a', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:13.053965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-bef48029-5fd1-4712-9b08-77b63d94713f req-edfc9320-c5b2-4524-b387-6805b8d923bd tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': 'c274df9d-d2cc-4c81-9d1a-729224f5463a', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:13.108011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-bef48029-5fd1-4712-9b08-77b63d94713f req-edfc9320-c5b2-4524-b387-6805b8d923bd tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:13.110658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f062c40f-1191-4fb3-8b41-aaf353c9847a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:13.127265 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83ffcbbf-83ea-4930-808d-b1dc99448210 req-85f62285-2245-4d66-9103-e507e077b5f0 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2501202 May 12 15:22:13.128224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-bef48029-5fd1-4712-9b08-77b63d94713f req-edfc9320-c5b2-4524-b387-6805b8d923bd tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group_rule and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:13.137199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-bef48029-5fd1-4712-9b08-77b63d94713f req-edfc9320-c5b2-4524-b387-6805b8d923bd tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group_rule was recalculated. Used quota:19. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:13.152021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-bef48029-5fd1-4712-9b08-77b63d94713f req-edfc9320-c5b2-4524-b387-6805b8d923bd tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 19; quota limit: 100; headroom:81 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:13.186868 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af78d7bd-dcb4-463f-b4b9-bcd6202dc0a7 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.195019 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.286362 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.286362 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Added segment 17355787-57e0-48f5-9070-811e461a6000 of type vlan for network aab37dc4-92bf-4fd9-8482-5e3a3f715d61 May 12 15:22:13.339254 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b3edec5-8518-43cc-a84b-68f9986c0b8b req-305be9e4-e9df-4b76-aeb5-c5500cbdd0aa service neutron] 10.222.0.76 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4387720 May 12 15:22:13.339969 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af78d7bd-dcb4-463f-b4b9-bcd6202dc0a7 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event deleted for resources: {'Port': ['ID=986ca089-12d7-4947-a38d-f9e6f70953a8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:13.378077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Pushing event deleted for resources: {'Port': ['ID=dcb1c6e0-7275-4c7b-aaa0-83facd43fb3f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:13.423109 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bef48029-5fd1-4712-9b08-77b63d94713f req-edfc9320-c5b2-4524-b387-6805b8d923bd tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.465273 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.491116 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.511148 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bef48029-5fd1-4712-9b08-77b63d94713f req-edfc9320-c5b2-4524-b387-6805b8d923bd tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.535475 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bef48029-5fd1-4712-9b08-77b63d94713f req-edfc9320-c5b2-4524-b387-6805b8d923bd tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.632128 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.632943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:13.633530 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.637024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edfc9320-c5b2-4524-b387-6805b8d923bd tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=41029ed9-303a-40d3-bc39-aea5d01e3065,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:13.685849 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.688611 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.711321 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.711892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Fanout notify agent at l3_agent the message router_deleted on router 5aff139c-1195-4f11-9450-493179af890f {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:22:13.729861 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.734306 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c4c18a40-12a0-4114-b111-e2b92ed587c4 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "DELETE /v2.0/routers/5aff139c-1195-4f11-9450-493179af890f HTTP/1.1" status: 204 len: 168 time: 1.4760373 May 12 15:22:13.735539 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35498) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:13.741253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-448e8780-d7d8-4e0c-8d98-a5da98092fc8 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-603758599', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:13.748194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-448e8780-d7d8-4e0c-8d98-a5da98092fc8 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:13.752763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-448e8780-d7d8-4e0c-8d98-a5da98092fc8 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Usage tracker for resource:router and tenant:e87ae982708240299f16d4cfc5f73d5d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:13.755677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-448e8780-d7d8-4e0c-8d98-a5da98092fc8 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:13.762247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-448e8780-d7d8-4e0c-8d98-a5da98092fc8 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:13.772986 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-448e8780-d7d8-4e0c-8d98-a5da98092fc8 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.774000 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-448e8780-d7d8-4e0c-8d98-a5da98092fc8 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.789560 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-448e8780-d7d8-4e0c-8d98-a5da98092fc8 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.800041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a45ff93-33fb-4e1d-9ade-07847e8d867e req-9f17e7ff-de78-4ec1-840e-190a6fff0569 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:13.801502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a45ff93-33fb-4e1d-9ade-07847e8d867e req-9f17e7ff-de78-4ec1-840e-190a6fff0569 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 946 time: 0.5641713 May 12 15:22:13.808905 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-448e8780-d7d8-4e0c-8d98-a5da98092fc8 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.834055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-448e8780-d7d8-4e0c-8d98-a5da98092fc8 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.835383 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-448e8780-d7d8-4e0c-8d98-a5da98092fc8 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.0984046 May 12 15:22:13.838560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35502) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:13.843771 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'enable_snat': True}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:13.846151 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bef48029-5fd1-4712-9b08-77b63d94713f req-edfc9320-c5b2-4524-b387-6805b8d923bd tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.847271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bef48029-5fd1-4712-9b08-77b63d94713f req-edfc9320-c5b2-4524-b387-6805b8d923bd tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.8223445 May 12 15:22:13.859774 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 2.8999846 May 12 15:22:13.859774 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af78d7bd-dcb4-463f-b4b9-bcd6202dc0a7 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:13.864945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35508) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:13.869723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3d88050-d7a2-4a0c-8496-ed7badb274c0 admin admin] Pushing event updated for resources: {'Network': ['ID=aab37dc4-92bf-4fd9-8482-5e3a3f715d61,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:13.874396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Request body: {'subnet': {'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestJSON-360610849-subnet', 'tenant_id': '4e5a10df576841e2a4752a9d47fb790a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:13.882842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network aab37dc4-92bf-4fd9-8482-5e3a3f715d61 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:22:13.891443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:13.898399 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Usage tracker for resource:subnet and tenant:4e5a10df576841e2a4752a9d47fb790a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:13.962147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:14.026673 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a45ff93-33fb-4e1d-9ade-07847e8d867e req-7faaf9c0-2866-4803-adfd-4f9b3e720cad tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2122951 May 12 15:22:14.027538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:14.111396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Made reservation on behalf of 4e5a10df576841e2a4752a9d47fb790a for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:22:14.113836 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:14.273294 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:14.550181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af78d7bd-dcb4-463f-b4b9-bcd6202dc0a7 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Router 0a20e216-0f20-463c-92e2-94e5c5a92acd has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:22:14.557773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c863a8f3-a006-4b71-a40d-a60ff1b224b5 req-24942732-cfa5-4f7a-863a-a3cb301342b2 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:14.559242 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c863a8f3-a006-4b71-a40d-a60ff1b224b5 req-24942732-cfa5-4f7a-863a-a3cb301342b2 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.5919006 May 12 15:22:14.608952 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:14.641638 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:14.782773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73e46d68-e610-40e2-bdfc-4b9c60918569 req-57689051-436d-4642-97bd-f71293316e07 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:14.784331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73e46d68-e610-40e2-bdfc-4b9c60918569 req-57689051-436d-4642-97bd-f71293316e07 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 946 time: 0.6466599 May 12 15:22:14.793633 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c863a8f3-a006-4b71-a40d-a60ff1b224b5 req-ff36f0fd-2adb-4031-83b9-2c95fe84fd31 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2265034 May 12 15:22:14.798885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af78d7bd-dcb4-463f-b4b9-bcd6202dc0a7 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:22:14.816666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20ca5d45-43e1-4ba4-9bea-71b71b207c6b None None] Sync routers for ids ['0a20e216-0f20-463c-92e2-94e5c5a92acd'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:22:14.838071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20ca5d45-43e1-4ba4-9bea-71b71b207c6b None None] Routers {'0a20e216-0f20-463c-92e2-94e5c5a92acd'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:22:14.838877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-20ca5d45-43e1-4ba4-9bea-71b71b207c6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:21:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0a20e216-0f20-463c-92e2-94e5c5a92acd'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:14.843299 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-af78d7bd-dcb4-463f-b4b9-bcd6202dc0a7 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "PUT /v2.0/routers/0a20e216-0f20-463c-92e2-94e5c5a92acd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.5968781 May 12 15:22:14.856953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35516) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:14.906676 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9e3ed7c5-4fbe-4adf-b5ff-abec7b2ef900 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:14.908674 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-20ca5d45-43e1-4ba4-9bea-71b71b207c6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:14.920527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20ca5d45-43e1-4ba4-9bea-71b71b207c6b None None] Routers {'0a20e216-0f20-463c-92e2-94e5c5a92acd'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:22:14.921130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-20ca5d45-43e1-4ba4-9bea-71b71b207c6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:22:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0a20e216-0f20-463c-92e2-94e5c5a92acd'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:14.924044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Allocated IP 172.25.8.201 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/22433adf-20fe-47d7-8db0-04b028b6ec3a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:22:14.957865 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-763c5096-dbc1-47ef-8d58-e6d44bdd9225 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] show failed (client error): The resource could not be found. May 12 15:22:14.962401 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-763c5096-dbc1-47ef-8d58-e6d44bdd9225 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "GET /v2.0/routers/tempest-non_exist_router-2061075742 HTTP/1.1" status: 404 len: 335 time: 0.0993366 May 12 15:22:14.975743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35520) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:14.987342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-20ca5d45-43e1-4ba4-9bea-71b71b207c6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:14.987738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20ca5d45-43e1-4ba4-9bea-71b71b207c6b None None] The sync data for ids ['0a20e216-0f20-463c-92e2-94e5c5a92acd'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:22:14.989983 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73e46d68-e610-40e2-bdfc-4b9c60918569 req-ea624994-e7f8-497e-b777-8c2c567a7709 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1954014 May 12 15:22:14.998250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8c7da716-fb74-41c3-9069-746f513ab62d tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Request body: {'router': {'name': 'new_name'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:15.085883 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-8c7da716-fb74-41c3-9069-746f513ab62d tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] update failed (client error): The resource could not be found. May 12 15:22:15.089554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8c7da716-fb74-41c3-9069-746f513ab62d tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "PUT /v2.0/routers/tempest-non_exist_router-969818082 HTTP/1.1" status: 404 len: 334 time: 0.0960464 May 12 15:22:15.090627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35532) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:15.096173 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:15.097159 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-361c8d17-fa2a-4673-9a1d-aa8a13f946b3 req-a54214c5-7d81-4d36-9b3e-f625ce08b639 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/c274df9d-d2cc-4c81-9d1a-729224f5463a HTTP/1.1" status: 200 len: 2400 time: 0.2561693 May 12 15:22:15.107461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-361c8d17-fa2a-4673-9a1d-aa8a13f946b3 req-1979fea4-2e33-4943-bb0b-5c3c4dc9a588 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'icmp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': 'c274df9d-d2cc-4c81-9d1a-729224f5463a', 'remote_group_id': None}]} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:15.107778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-361c8d17-fa2a-4673-9a1d-aa8a13f946b3 req-1979fea4-2e33-4943-bb0b-5c3c4dc9a588 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'icmp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': 'c274df9d-d2cc-4c81-9d1a-729224f5463a', 'remote_group_id': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:15.115485 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:15.120953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-361c8d17-fa2a-4673-9a1d-aa8a13f946b3 req-1979fea4-2e33-4943-bb0b-5c3c4dc9a588 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:15.159792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-361c8d17-fa2a-4673-9a1d-aa8a13f946b3 req-1979fea4-2e33-4943-bb0b-5c3c4dc9a588 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Usage tracker for resource:security_group_rule and tenant:67102e89b0f44ceb80da8f2ae55a97d3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:15.172845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4a88f583-55ea-4849-8a87-dbc693ed07d0 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:22:15.179667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-dd3084b9-6f66-4206-9174-5a7bc4e90403 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Deleting subnet 5bc660fd-561c-4d1f-82c5-5164a9efd5bd {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:22:15.182741 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd3084b9-6f66-4206-9174-5a7bc4e90403 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:15.198879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-361c8d17-fa2a-4673-9a1d-aa8a13f946b3 req-1979fea4-2e33-4943-bb0b-5c3c4dc9a588 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Quota usage for security_group_rule was recalculated. Used quota:20. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:15.231290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c90f4328-5e3e-4311-a3b6-84cff19a6919,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:15.250882 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd3084b9-6f66-4206-9174-5a7bc4e90403 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:15.251241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-361c8d17-fa2a-4673-9a1d-aa8a13f946b3 req-1979fea4-2e33-4943-bb0b-5c3c4dc9a588 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 20; quota limit: 100; headroom:80 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:15.285995 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:15.323154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:15.337293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Checking segment: {'id': '17355787-57e0-48f5-9070-811e461a6000', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:22:15.337636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Network hostable DHCP agents. Network: aab37dc4-92bf-4fd9-8482-5e3a3f715d61, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:22:15.338288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'port_id': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'mac_address': 'fa:16:3e:c6:9e:79', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 558, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:22:15.372868 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-361c8d17-fa2a-4673-9a1d-aa8a13f946b3 req-1979fea4-2e33-4943-bb0b-5c3c4dc9a588 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:15.387624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:22:15.395077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:22:15.398087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f371c05-6eec-44a0-9d92-612a0bb1eb31 req-b9d847be-d6bd-41ec-9f27-897730d24dcf tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:15.399718 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f371c05-6eec-44a0-9d92-612a0bb1eb31 req-b9d847be-d6bd-41ec-9f27-897730d24dcf tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 946 time: 0.2470860 May 12 15:22:15.400347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Network aab37dc4-92bf-4fd9-8482-5e3a3f715d61 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:22:15.403914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:22:15.416663 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:15.434698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event updated for resources: {'Port': ['ID=22433adf-20fe-47d7-8db0-04b028b6ec3a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:15.434916 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-361c8d17-fa2a-4673-9a1d-aa8a13f946b3 req-1979fea4-2e33-4943-bb0b-5c3c4dc9a588 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:15.437143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, aab37dc4-92bf-4fd9-8482-5e3a3f715d61) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:22:15.444180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:15.444719 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:15.448247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 4a88f583-55ea-4849-8a87-dbc693ed07d0 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:22:15.450148 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-361c8d17-fa2a-4673-9a1d-aa8a13f946b3 req-1979fea4-2e33-4943-bb0b-5c3c4dc9a588 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:15.459221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6610882-778f-44c7-9191-9bd8ceb92e35 None None] Network aab37dc4-92bf-4fd9-8482-5e3a3f715d61 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:22:15.494900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1979fea4-2e33-4943-bb0b-5c3c4dc9a588 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7aeb4d4f-548d-4779-8154-a9062f98aa9d,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:15.508043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f371c05-6eec-44a0-9d92-612a0bb1eb31 req-ec36778d-f923-40af-ae6f-08761a7586c1 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0976136 May 12 15:22:15.542455 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-98938a93-7792-41a1-af5a-206cdd8efcb4 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 1.6550112 May 12 15:22:15.542455 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-361c8d17-fa2a-4673-9a1d-aa8a13f946b3 req-1979fea4-2e33-4943-bb0b-5c3c4dc9a588 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:15.542455 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-361c8d17-fa2a-4673-9a1d-aa8a13f946b3 req-1979fea4-2e33-4943-bb0b-5c3c4dc9a588 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 791 time: 0.4358535 May 12 15:22:15.561313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:15.709365 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd3084b9-6f66-4206-9174-5a7bc4e90403 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:15.783863 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:15.862708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d54f9a9d-c72e-44af-8b1c-bd6642f8a242 None None] Network aab37dc4-92bf-4fd9-8482-5e3a3f715d61 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:22:15.869216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b65a9d-5a21-44f7-a239-7512745f1ce6 req-41f00c61-6112-4a09-a750-c3d7aa3b41c2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:15.871247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15b65a9d-5a21-44f7-a239-7512745f1ce6 req-41f00c61-6112-4a09-a750-c3d7aa3b41c2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 946 time: 0.2322636 May 12 15:22:15.884043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcb50fc0-702b-4a27-84e2-b56711e6ccd7 req-d82eb497-fbf6-4a69-910d-22c6336497a6 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:15.885538 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fcb50fc0-702b-4a27-84e2-b56711e6ccd7 req-d82eb497-fbf6-4a69-910d-22c6336497a6 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 945 time: 0.1581967 May 12 15:22:15.966386 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15b65a9d-5a21-44f7-a239-7512745f1ce6 req-7d16849a-5fb5-4871-9183-f1086fbc7100 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0797043 May 12 15:22:15.974554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4a88f583-55ea-4849-8a87-dbc693ed07d0,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:15.976864 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fcb50fc0-702b-4a27-84e2-b56711e6ccd7 req-23c3bf4d-89bd-4e52-af0f-a03feac82162 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0750449 May 12 15:22:15.998062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:16.028122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['4a88f583-55ea-4849-8a87-dbc693ed07d0'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:22:16.073377 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:16.092269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd3084b9-6f66-4206-9174-5a7bc4e90403 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:16.182320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd3084b9-6f66-4206-9174-5a7bc4e90403 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event deleted for resources: {'Subnet': ['ID=5bc660fd-561c-4d1f-82c5-5164a9efd5bd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:16.190091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd3084b9-6f66-4206-9174-5a7bc4e90403 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:16.197348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7a93a9a-7d1f-4f96-95ee-ce1db84eef12 None None] Network bd2ab330-e973-403a-a5cd-1f870a5cee26 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:22:16.200151 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0086d623-ccf2-49d7-b029-d276872d38de req-0c2c901f-3374-4a34-86dc-b9b76f8d916d tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/c274df9d-d2cc-4c81-9d1a-729224f5463a HTTP/1.1" status: 200 len: 2999 time: 0.1410713 May 12 15:22:16.328204 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dd3084b9-6f66-4206-9174-5a7bc4e90403 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "DELETE /v2.0/subnets/5bc660fd-561c-4d1f-82c5-5164a9efd5bd HTTP/1.1" status: 204 len: 168 time: 1.2353971 May 12 15:22:16.330899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35580) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:16.456877 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:16.631890 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:16.636632 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:16.646652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-5aab7e70-d2b7-4e69-aa73-ebad71606bac tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Deleting subnet 4e99b016-ec0d-4958-9013-a86d9c1e1fb7 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:22:16.653737 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5aab7e70-d2b7-4e69-aa73-ebad71606bac tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:16.810321 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5aab7e70-d2b7-4e69-aa73-ebad71606bac tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:16.823318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb4e8099-4aa5-4994-81e6-59a5320c0b5d None None] DHCP port deletion for bd2ab330-e973-403a-a5cd-1f870a5cee26 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:22:16.831571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bb4e8099-4aa5-4994-81e6-59a5320c0b5d None None] Deleting port f8447eb0-2acd-4fb0-840e-937cef316aa8 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:16.833209 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bb4e8099-4aa5-4994-81e6-59a5320c0b5d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:16.871427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e4a7ccf-fb4b-452a-84d8-4570f3149b51 req-94872b9f-e8f6-4120-814c-4e7c354ca14d tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:16.879786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e4a7ccf-fb4b-452a-84d8-4570f3149b51 req-94872b9f-e8f6-4120-814c-4e7c354ca14d tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.3959272 May 12 15:22:17.025564 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e4a7ccf-fb4b-452a-84d8-4570f3149b51 req-72dd92cd-dbb3-4495-9282-a583d60db51b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1437707 May 12 15:22:17.121597 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5aab7e70-d2b7-4e69-aa73-ebad71606bac tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:17.297964 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5aab7e70-d2b7-4e69-aa73-ebad71606bac tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:17.373257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f8447eb0-2acd-4fb0-840e-937cef316aa8 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:22:17.412501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Router 5cedf3d2-1819-451e-9a53-b2e919095fe0 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:22:17.442244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4a88f583-55ea-4849-8a87-dbc693ed07d0 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:22:17.481092 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5aab7e70-d2b7-4e69-aa73-ebad71606bac tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:17.490999 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5aab7e70-d2b7-4e69-aa73-ebad71606bac tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "DELETE /v2.0/subnets/4e99b016-ec0d-4958-9013-a86d9c1e1fb7 HTTP/1.1" status: 204 len: 168 time: 1.1589003 May 12 15:22:17.492519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aab7e70-d2b7-4e69-aa73-ebad71606bac tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event deleted for resources: {'Subnet': ['ID=4e99b016-ec0d-4958-9013-a86d9c1e1fb7,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:17.496186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35638) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:17.550229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf87ec7f-132e-4b53-9cd8-b99311710ae0 None None] Network e9216267-d2ff-4740-934f-af19b9c825a0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:22:17.764191 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:17.803483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3d307e1-8422-4784-9c2f-c661a57a7d6c req-a9687df8-38b8-4a65-ad5c-0a9e95fdf35f tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-group-rules/7aeb4d4f-548d-4779-8154-a9062f98aa9d HTTP/1.1" status: 200 len: 783 time: 0.2560077 May 12 15:22:17.810090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Deleting port f8447eb0-2acd-4fb0-840e-937cef316aa8 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:17.810468 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:17.851461 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bb4e8099-4aa5-4994-81e6-59a5320c0b5d None None] For port f8447eb0-2acd-4fb0-840e-937cef316aa8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f8447eb0-2acd-4fb0-840e-937cef316aa8,segment=NetworkSegment(1742cf6b-24d1-4c6c-9add-e38963a43ba0),segment_id=1742cf6b-24d1-4c6c-9add-e38963a43ba0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:17.852429 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bb4e8099-4aa5-4994-81e6-59a5320c0b5d None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:17.868742 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:17.888821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:22:17.902769 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4f17571-1a72-4965-9279-44775627ad4f None None] Sync routers for ids ['5cedf3d2-1819-451e-9a53-b2e919095fe0'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:22:17.924380 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4f17571-1a72-4965-9279-44775627ad4f None None] Routers {'5cedf3d2-1819-451e-9a53-b2e919095fe0'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:22:17.925469 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:17.926323 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a4f17571-1a72-4965-9279-44775627ad4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:22:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5cedf3d2-1819-451e-9a53-b2e919095fe0'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:17.939875 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d1b80c06-0b20-42e7-8f65-df91e56cbcb6 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "PUT /v2.0/routers/5cedf3d2-1819-451e-9a53-b2e919095fe0 HTTP/1.1" status: 200 len: 914 time: 4.0892799 May 12 15:22:17.942702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35670) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:18.019302 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3d307e1-8422-4784-9c2f-c661a57a7d6c req-ed26b196-0dd1-4775-a8f9-75daa7381497 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/c274df9d-d2cc-4c81-9d1a-729224f5463a HTTP/1.1" status: 200 len: 2999 time: 0.1097097 May 12 15:22:18.068048 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b3d307e1-8422-4784-9c2f-c661a57a7d6c req-144efe61-ad8e-4a12-a7b0-eaabd48e7133 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:18.080361 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b3d307e1-8422-4784-9c2f-c661a57a7d6c req-144efe61-ad8e-4a12-a7b0-eaabd48e7133 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:18.121373 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a4f17571-1a72-4965-9279-44775627ad4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:18.132120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bb4e8099-4aa5-4994-81e6-59a5320c0b5d None None] Calling delete_port for f8447eb0-2acd-4fb0-840e-937cef316aa8 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:22:18.149926 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4f17571-1a72-4965-9279-44775627ad4f None None] Routers {'5cedf3d2-1819-451e-9a53-b2e919095fe0'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:22:18.152106 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a4f17571-1a72-4965-9279-44775627ad4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:22:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5cedf3d2-1819-451e-9a53-b2e919095fe0'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:18.331105 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a4f17571-1a72-4965-9279-44775627ad4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:18.331529 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4f17571-1a72-4965-9279-44775627ad4f None None] The sync data for ids ['5cedf3d2-1819-451e-9a53-b2e919095fe0'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:22:18.395768 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c19848c7-eb88-4e3b-8e7b-5778ff0c4e56 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/routers/5cedf3d2-1819-451e-9a53-b2e919095fe0 HTTP/1.1" status: 200 len: 920 time: 0.4478137 May 12 15:22:18.402652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35686) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:18.471572 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bb4e8099-4aa5-4994-81e6-59a5320c0b5d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:18.529098 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b3d307e1-8422-4784-9c2f-c661a57a7d6c req-144efe61-ad8e-4a12-a7b0-eaabd48e7133 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:18.542027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b337393-394e-437e-9e32-7f645ad7808f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:18.547570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb4e8099-4aa5-4994-81e6-59a5320c0b5d None None] No DVR routers for this DVR port f8447eb0-2acd-4fb0-840e-937cef316aa8 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:22:18.554896 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1b337393-394e-437e-9e32-7f645ad7808f tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/ports?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&device_id=5cedf3d2-1819-451e-9a53-b2e919095fe0&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.1493776 May 12 15:22:18.556833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35690) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:18.572889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 4a88f583-55ea-4849-8a87-dbc693ed07d0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:22:18.573352 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:18.628133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-144efe61-ad8e-4a12-a7b0-eaabd48e7133 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=7aeb4d4f-548d-4779-8154-a9062f98aa9d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:18.637054 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b3d307e1-8422-4784-9c2f-c661a57a7d6c req-144efe61-ad8e-4a12-a7b0-eaabd48e7133 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:18.653592 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3d307e1-8422-4784-9c2f-c661a57a7d6c req-144efe61-ad8e-4a12-a7b0-eaabd48e7133 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/7aeb4d4f-548d-4779-8154-a9062f98aa9d HTTP/1.1" status: 204 len: 173 time: 0.6332226 May 12 15:22:18.658714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb4e8099-4aa5-4994-81e6-59a5320c0b5d None None] Pushing event deleted for resources: {'Port': ['ID=f8447eb0-2acd-4fb0-840e-937cef316aa8,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:18.674167 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:18.712214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] For port f8447eb0-2acd-4fb0-840e-937cef316aa8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f8447eb0-2acd-4fb0-840e-937cef316aa8,segment=NetworkSegment(1742cf6b-24d1-4c6c-9add-e38963a43ba0),segment_id=1742cf6b-24d1-4c6c-9add-e38963a43ba0)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:18.712482 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:18.836043 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:18.875958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-6dd316e6-7b79-427a-9c8b-070619fbb6ec tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:18.876159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] DHCP port deletion for e9216267-d2ff-4740-934f-af19b9c825a0 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:22:18.879420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-6dd316e6-7b79-427a-9c8b-070619fbb6ec tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Synchronizing usage tracker for tenant:4e5a10df576841e2a4752a9d47fb790a on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:22:18.892654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] Deleting port ce785187-df6c-4dbd-9f80-35d4d2621dea {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:18.892654 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:18.916544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7109879a-768c-4652-b5c3-5e65ee40bf41 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:18.920144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7109879a-768c-4652-b5c3-5e65ee40bf41 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 881 time: 0.3619468 May 12 15:22:18.924460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35696) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:18.988050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Calling delete_port for f8447eb0-2acd-4fb0-840e-937cef316aa8 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:22:19.016762 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-726fad2b-72be-475c-aa59-dff734b33374 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cedf3d2-1819-451e-9a53-b2e919095fe0 HTTP/1.1" status: 200 len: 205 time: 0.0898364 May 12 15:22:19.019646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35700) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:19.038977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ce785187-df6c-4dbd-9f80-35d4d2621dea no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:22:19.085452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:19.117332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-6dd316e6-7b79-427a-9c8b-070619fbb6ec tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Unset dirty status for tenant:4e5a10df576841e2a4752a9d47fb790a on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:22:19.118198 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-6dd316e6-7b79-427a-9c8b-070619fbb6ec tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/networks?id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61 HTTP/1.1" status: 200 len: 813 time: 0.7221506 May 12 15:22:19.138185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:19.152715 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:19.153658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 860dc344-70ad-4ff8-9592-ee8e988a4f26 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:22:19.175158 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-06652e89-0aa9-4a41-a3af-829d77ac08e9 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/quotas/4e5a10df576841e2a4752a9d47fb790a HTTP/1.1" status: 200 len: 375 time: 0.0495756 May 12 15:22:19.261918 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-18d750b5-2f47-4993-8d6b-d2a00fe51e72 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4e5a10df576841e2a4752a9d47fb790a&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0858409 May 12 15:22:19.301345 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:19.415648 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:22:19.416264 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:22:19.448375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba740489-5bd3-4385-a19c-2bc71ecddf6a req-6624aecf-20d9-4459-b659-12da15e04ffc tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:19.456510 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba740489-5bd3-4385-a19c-2bc71ecddf6a req-6624aecf-20d9-4459-b659-12da15e04ffc tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 945 time: 0.4361014 May 12 15:22:19.495537 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4a88f583-55ea-4849-8a87-dbc693ed07d0,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:19.522569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-445b7f73-6ddf-4621-9166-38c42b37204c service neutron] 10.222.0.82 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2597516 May 12 15:22:19.550849 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:19.559810 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:19.560648 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba740489-5bd3-4385-a19c-2bc71ecddf6a req-565d38cd-80a6-485a-84c1-06230c491734 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0980453 May 12 15:22:19.575153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Deleting port 22433adf-20fe-47d7-8db0-04b028b6ec3a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:19.575578 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:19.615033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ce785187-df6c-4dbd-9f80-35d4d2621dea, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce785187-df6c-4dbd-9f80-35d4d2621dea,segment=NetworkSegment(e2292273-67f3-4b0b-9739-5797d1f7e47f),segment_id=e2292273-67f3-4b0b-9739-5797d1f7e47f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:19.617349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] For port ce785187-df6c-4dbd-9f80-35d4d2621dea, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce785187-df6c-4dbd-9f80-35d4d2621dea,segment=NetworkSegment(e2292273-67f3-4b0b-9739-5797d1f7e47f),segment_id=e2292273-67f3-4b0b-9739-5797d1f7e47f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:19.617767 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:19.631880 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:19.770954 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-83c20ea8-a8da-46d4-a71e-325e8f850be0 service neutron] 10.222.0.82 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2471988 May 12 15:22:19.918672 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Deleting port f8447eb0-2acd-4fb0-840e-937cef316aa8 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:19.919611 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:20.045674 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:20.058343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] Calling delete_port for ce785187-df6c-4dbd-9f80-35d4d2621dea owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:22:20.114312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] The port 'f8447eb0-2acd-4fb0-840e-937cef316aa8' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:22:20.160147 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:20.270224 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:20.276948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ce785187-df6c-4dbd-9f80-35d4d2621dea,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:20.312964 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:20.343496 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:20.385236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Calling delete_port for 22433adf-20fe-47d7-8db0-04b028b6ec3a owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:22:20.386694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bd2ab330-e973-403a-a5cd-1f870a5cee26']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:20.405972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1742cf6b-24d1-4c6c-9add-e38963a43ba0') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:20.405972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1742cf6b-24d1-4c6c-9add-e38963a43ba0') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:20.419767 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:20.442984 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:22:20.443347 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:22:20.444162 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:20.452700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Releasing vlan 565 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:22:20.455505 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:20.483664 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 632953d6-f6ad-4465-b608-8f2b459ee5e2 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: timer() May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:22:20.627647 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:22:20.694633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 632953d6-f6ad-4465-b608-8f2b459ee5e2, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=632953d6-f6ad-4465-b608-8f2b459ee5e2,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:20.711242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=14']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:20.716549 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:20.717167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '632953d6-f6ad-4465-b608-8f2b459ee5e2', 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b', 'port_id': '632953d6-f6ad-4465-b608-8f2b459ee5e2', 'mac_address': 'fa:16:3e:08:8e:b1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 589, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5a24db8d-fb66-4b7f-bf96-50956cb218fd', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:22:20.778531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Pushing event deleted for resources: {'Port': ['ID=22433adf-20fe-47d7-8db0-04b028b6ec3a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:20.847051 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:20.895788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 632953d6-f6ad-4465-b608-8f2b459ee5e2 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:22:20.923451 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 632953d6-f6ad-4465-b608-8f2b459ee5e2, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=632953d6-f6ad-4465-b608-8f2b459ee5e2,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:20.933231 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:20.949504 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.003436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] Deleting port ce785187-df6c-4dbd-9f80-35d4d2621dea {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:21.003922 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.061324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a68be05-3665-4bf1-a097-f124a1ec30d7 req-9f6ad9cf-70d0-479f-accc-35d3f52d02aa tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:21.063149 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a68be05-3665-4bf1-a097-f124a1ec30d7 req-9f6ad9cf-70d0-479f-accc-35d3f52d02aa tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.8683467 May 12 15:22:21.064249 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.081604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d19ca541-ba40-4f97-aa71-fd2e57e3d4bf req-05d319c8-de4c-48f1-8861-e5b5f18b1dc5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:21.083073 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d19ca541-ba40-4f97-aa71-fd2e57e3d4bf req-05d319c8-de4c-48f1-8861-e5b5f18b1dc5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 946 time: 0.9669073 May 12 15:22:21.124510 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.148192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "DELETE /v2.0/networks/bd2ab330-e973-403a-a5cd-1f870a5cee26 HTTP/1.1" status: 204 len: 168 time: 3.6503453 May 12 15:22:21.159684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=632953d6-f6ad-4465-b608-8f2b459ee5e2,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:21.161450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35726) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:21.180902 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['632953d6-f6ad-4465-b608-8f2b459ee5e2'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:22:21.200976 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.203394 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.281322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fba2b05d-c516-4e86-a961-00f66664b64c tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event deleted for resources: {'Network': ['ID=bd2ab330-e973-403a-a5cd-1f870a5cee26,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:21.291652 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.292615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Fanout notify agent at l3_agent the message router_deleted on router 5cedf3d2-1819-451e-9a53-b2e919095fe0 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:22:21.329163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.341955 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-032e3491-7837-4fb7-9e29-d87092cdad20 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "DELETE /v2.0/routers/5cedf3d2-1819-451e-9a53-b2e919095fe0 HTTP/1.1" status: 204 len: 168 time: 2.3210909 May 12 15:22:21.342655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35730) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:21.353701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a08ff0bf-ed4d-4370-8b4e-ee915115edea tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-2104511013', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:21.373377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a08ff0bf-ed4d-4370-8b4e-ee915115edea tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:21.383866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a08ff0bf-ed4d-4370-8b4e-ee915115edea tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Usage tracker for resource:router and tenant:e87ae982708240299f16d4cfc5f73d5d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:21.387609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a08ff0bf-ed4d-4370-8b4e-ee915115edea tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:21.397380 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d19ca541-ba40-4f97-aa71-fd2e57e3d4bf req-6f0c78bf-46c4-49ec-b90c-cb197bb002b4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2813597 May 12 15:22:21.404070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a08ff0bf-ed4d-4370-8b4e-ee915115edea tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:21.428629 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a08ff0bf-ed4d-4370-8b4e-ee915115edea tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.438569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a08ff0bf-ed4d-4370-8b4e-ee915115edea tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.442115 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a68be05-3665-4bf1-a097-f124a1ec30d7 req-c988ed67-b582-44ce-83cf-d6bed408981b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3620412 May 12 15:22:21.480062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a08ff0bf-ed4d-4370-8b4e-ee915115edea tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.512165 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.522589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a08ff0bf-ed4d-4370-8b4e-ee915115edea tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.526268 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3b3c44a7-85fb-4d9b-b3fc-2406e7f4a039'] response: {'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'code': 200} May 12 15:22:21.557537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Deleting port ce785187-df6c-4dbd-9f80-35d4d2621dea {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:21.557537 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.581576 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a08ff0bf-ed4d-4370-8b4e-ee915115edea tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.582785 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a08ff0bf-ed4d-4370-8b4e-ee915115edea tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.2391698 May 12 15:22:21.585442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35742) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:21.590485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'enable_snat': False}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:21.699721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] For port ce785187-df6c-4dbd-9f80-35d4d2621dea, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce785187-df6c-4dbd-9f80-35d4d2621dea,segment=NetworkSegment(e2292273-67f3-4b0b-9739-5797d1f7e47f),segment_id=e2292273-67f3-4b0b-9739-5797d1f7e47f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:21.700288 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:21.765691 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d760be71-cfc7-4b5e-b0a0-7b64826bafaf req-e5b5bcd4-7596-4506-b382-999fdd180492 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/c274df9d-d2cc-4c81-9d1a-729224f5463a HTTP/1.1" status: 200 len: 2400 time: 0.2778912 May 12 15:22:21.768860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58158d08-7ae7-4d88-9dba-7c644be7016a req-25795a4e-8f91-4dc6-aec1-4e6b718f409e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 210 time: 0.0968075 May 12 15:22:21.943255 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] Calling delete_port for ce785187-df6c-4dbd-9f80-35d4d2621dea owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:22:21.948252 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d760be71-cfc7-4b5e-b0a0-7b64826bafaf req-d1d8460e-e270-493b-8ad3-fbf7891c2511 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:22.078954 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:22.133407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] No DVR routers for this DVR port ce785187-df6c-4dbd-9f80-35d4d2621dea on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:22:22.142473 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae742bd5-29da-42f5-a1e8-39adbd4c062e None None] Pushing event deleted for resources: {'Port': ['ID=ce785187-df6c-4dbd-9f80-35d4d2621dea,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:22.240974 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d760be71-cfc7-4b5e-b0a0-7b64826bafaf req-d1d8460e-e270-493b-8ad3-fbf7891c2511 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:22.364559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] For port ce785187-df6c-4dbd-9f80-35d4d2621dea, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce785187-df6c-4dbd-9f80-35d4d2621dea,segment=NetworkSegment(e2292273-67f3-4b0b-9739-5797d1f7e47f),segment_id=e2292273-67f3-4b0b-9739-5797d1f7e47f)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:22.365226 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:22.379372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-2e121e0c-cf5b-4fcb-b8d4-b4b49910b1ee tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:22.380893 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-2e121e0c-cf5b-4fcb-b8d4-b4b49910b1ee tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.84 "GET /v2.0/networks?id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61 HTTP/1.1" status: 200 len: 813 time: 0.3735549 May 12 15:22:22.431836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Request body: {'port': {'device_id': '6e3189ff-eb13-4d53-bb96-0f93c430e9f5', 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61', 'admin_state_up': True, 'tenant_id': '4e5a10df576841e2a4752a9d47fb790a'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:22.478695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 632953d6-f6ad-4465-b608-8f2b459ee5e2 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:22:22.526759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Calling delete_port for ce785187-df6c-4dbd-9f80-35d4d2621dea owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:22:22.585578 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d760be71-cfc7-4b5e-b0a0-7b64826bafaf req-d1d8460e-e270-493b-8ad3-fbf7891c2511 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:22.607188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1d8460e-e270-493b-8ad3-fbf7891c2511 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c274df9d-d2cc-4c81-9d1a-729224f5463a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:22.639241 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d760be71-cfc7-4b5e-b0a0-7b64826bafaf req-d1d8460e-e270-493b-8ad3-fbf7891c2511 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:22.651308 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d760be71-cfc7-4b5e-b0a0-7b64826bafaf req-d1d8460e-e270-493b-8ad3-fbf7891c2511 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "DELETE /v2.0/security-groups/c274df9d-d2cc-4c81-9d1a-729224f5463a HTTP/1.1" status: 204 len: 173 time: 0.8723209 May 12 15:22:22.696226 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:22.702157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:22:22.702478 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:22:22.730943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id 632953d6-f6ad-4465-b608-8f2b459ee5e2 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:22:22.731798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f101e48f-aa5f-4bb3-a5ae-7c2abd02287f req-4a35d0fb-b51c-4336-a74e-9c40fb900be5 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:22.739251 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f101e48f-aa5f-4bb3-a5ae-7c2abd02287f req-4a35d0fb-b51c-4336-a74e-9c40fb900be5 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.6712847 May 12 15:22:22.780916 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 632953d6-f6ad-4465-b608-8f2b459ee5e2, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=632953d6-f6ad-4465-b608-8f2b459ee5e2,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:22.799930 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:22.874262 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f101e48f-aa5f-4bb3-a5ae-7c2abd02287f req-aa713f5e-20be-4ab7-ae51-589095907518 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1301343 May 12 15:22:22.925015 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:22.938040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=632953d6-f6ad-4465-b608-8f2b459ee5e2,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:22.940481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2010c6d8-307e-42ea-aa65-08e83cca420f req-dba4b0c0-6de7-4445-9fe6-135aa174d612 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:22.945661 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2010c6d8-307e-42ea-aa65-08e83cca420f req-dba4b0c0-6de7-4445-9fe6-135aa174d612 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1897817 May 12 15:22:23.034542 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2010c6d8-307e-42ea-aa65-08e83cca420f req-097420ad-bfac-44fd-acf8-1c40df2e34e2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0815332 May 12 15:22:23.168855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a44cf856-67bb-49ec-a779-d14894aee606 req-acda1ee3-9e87-4988-8880-c3bec3edf477 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:23.176625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:23.176851 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a44cf856-67bb-49ec-a779-d14894aee606 req-acda1ee3-9e87-4988-8880-c3bec3edf477 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 944 time: 0.1088297 May 12 15:22:23.181363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Usage tracker for resource:port and tenant:4e5a10df576841e2a4752a9d47fb790a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:23.184344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:23.200731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:23.227919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Deleting port ce785187-df6c-4dbd-9f80-35d4d2621dea {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:23.228261 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:23.240234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Made reservation on behalf of 4e5a10df576841e2a4752a9d47fb790a for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:22:23.243751 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:23.305108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] The port 'ce785187-df6c-4dbd-9f80-35d4d2621dea' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:22:23.515075 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:23.527113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:23.538639 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a44cf856-67bb-49ec-a779-d14894aee606 req-c922bcb9-cf33-4614-b720-bc78ea30f32e tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3608646 May 12 15:22:23.595488 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-5b2e2f31-a9a3-47f1-9d6d-71bc27e25511 req-c04385a3-2fbe-42e0-aece-453f1191bdd2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] show failed (client error): The resource could not be found. May 12 15:22:23.601511 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b2e2f31-a9a3-47f1-9d6d-71bc27e25511 req-c04385a3-2fbe-42e0-aece-453f1191bdd2 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/d960ec06-899d-4180-810f-064f51163f18 HTTP/1.1" status: 404 len: 352 time: 0.0256753 May 12 15:22:23.608414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e9216267-d2ff-4740-934f-af19b9c825a0']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:23.628819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Allocated IP 172.20.0.11 (aab37dc4-92bf-4fd9-8482-5e3a3f715d61/c90f4328-5e3e-4311-a3b6-84cff19a6919/a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:22:23.643208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e2292273-67f3-4b0b-9739-5797d1f7e47f') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:23.643594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e2292273-67f3-4b0b-9739-5797d1f7e47f') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:23.657806 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:23.669352 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:23.711191 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:23.741356 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:23.751433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47b78e9d-f301-4272-9ece-09bb74fae5f8 req-9fe04f0c-e4fc-44cd-8f59-a8721fe207ff tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:23.758447 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47b78e9d-f301-4272-9ece-09bb74fae5f8 req-9fe04f0c-e4fc-44cd-8f59-a8721fe207ff tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.5794942 May 12 15:22:23.804558 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a87d140-4dbf-4a6b-b935-8f955b2745ce req-57e9daa7-3b9d-4674-a892-54c09cb917ee tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 210 time: 0.1035480 May 12 15:22:23.810387 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Releasing vlan 571 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:22:23.810920 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: timer() May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:22:23.860040 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:22:24.021461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Allocated IP 172.25.8.143 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/7e44420a-5632-4b1b-8e91-fba9f805536e) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:22:24.055689 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:24.170931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47b78e9d-f301-4272-9ece-09bb74fae5f8 req-6c78b8b8-8ee3-490e-9eaa-81ce1578b263 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4114125 May 12 15:22:24.200396 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:24.209545 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:24.234088 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-47128f28-10d2-4287-9af4-7632c2dfc531'] response: {'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'code': 200} May 12 15:22:24.254893 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "DELETE /v2.0/networks/e9216267-d2ff-4740-934f-af19b9c825a0 HTTP/1.1" status: 204 len: 168 time: 3.0777817 May 12 15:22:24.256337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35766) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:24.260767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-791a040c-2316-4cb1-8f76-7923c521d485 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event deleted for resources: {'Network': ['ID=e9216267-d2ff-4740-934f-af19b9c825a0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:24.272553 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:24.326482 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd8288bf-c5e4-482c-9e16-be027f8928b7 req-5dea2b4e-a4a7-456b-88a5-f7eb3befddfe tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:24.334313 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd8288bf-c5e4-482c-9e16-be027f8928b7 req-5dea2b4e-a4a7-456b-88a5-f7eb3befddfe tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2727344 May 12 15:22:24.352819 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:24.406148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Network aab37dc4-92bf-4fd9-8482-5e3a3f715d61 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:22:24.411134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:22:24.416208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-25f3bd68-d48c-4984-afa8-189e120ebd9a tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Deleting subnet 5f771c35-bd94-4a21-a94d-6c5900db0ac2 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:22:24.421203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:22:24.430131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd8288bf-c5e4-482c-9e16-be027f8928b7 req-3be03ad2-d736-4fba-b3d4-90d4a6a907f8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0945754 May 12 15:22:24.447108 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25f3bd68-d48c-4984-afa8-189e120ebd9a tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:24.463953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Pushing event updated for resources: {'Port': ['ID=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:24.505412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:24.506109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:24.514292 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:24.553066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25f3bd68-d48c-4984-afa8-189e120ebd9a tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:24.609362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:22:24.612840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-981c2c7f-430a-4bc1-97bd-1a987f9da659 req-293c3871-2653-4857-bf84-2f59dee1e7d7 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/d28dd915-dc30-4c92-9285-860328e255cc HTTP/1.1" status: 200 len: 1806 time: 0.1268070 May 12 15:22:24.614064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:22:24.618851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:22:24.644707 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-579a6681-0a68-4081-abce-bbc4c44ffadc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.2193425 May 12 15:22:24.663784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Pushing event updated for resources: {'Port': ['ID=7e44420a-5632-4b1b-8e91-fba9f805536e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:24.674650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Request body: {'port': {'device_id': '6e3189ff-eb13-4d53-bb96-0f93c430e9f5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:24.697208 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-981c2c7f-430a-4bc1-97bd-1a987f9da659 req-00a7d1b5-fe68-4e49-9aac-7d838b7d6b62 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:24.774801 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-981c2c7f-430a-4bc1-97bd-1a987f9da659 req-00a7d1b5-fe68-4e49-9aac-7d838b7d6b62 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:24.846936 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25f3bd68-d48c-4984-afa8-189e120ebd9a tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:24.924297 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-981c2c7f-430a-4bc1-97bd-1a987f9da659 req-00a7d1b5-fe68-4e49-9aac-7d838b7d6b62 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:24.964940 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce7402e9-2283-411b-8378-0312e326c4e1 req-d8852169-355f-4f43-afe2-d98b002bd246 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:24.972539 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce7402e9-2283-411b-8378-0312e326c4e1 req-d8852169-355f-4f43-afe2-d98b002bd246 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.2342899 May 12 15:22:24.977072 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-981c2c7f-430a-4bc1-97bd-1a987f9da659 req-00a7d1b5-fe68-4e49-9aac-7d838b7d6b62 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:24.977542 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-981c2c7f-430a-4bc1-97bd-1a987f9da659 req-00a7d1b5-fe68-4e49-9aac-7d838b7d6b62 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "DELETE /v2.0/security-groups/d28dd915-dc30-4c92-9285-860328e255cc HTTP/1.1" status: 204 len: 173 time: 0.3626647 May 12 15:22:24.978334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a7d1b5-fe68-4e49-9aac-7d838b7d6b62 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d28dd915-dc30-4c92-9285-860328e255cc,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:25.065472 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce7402e9-2283-411b-8378-0312e326c4e1 req-320c1284-18ee-4172-a330-33fd10203304 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0887389 May 12 15:22:25.068851 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25f3bd68-d48c-4984-afa8-189e120ebd9a tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:25.149709 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:25.191801 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25f3bd68-d48c-4984-afa8-189e120ebd9a tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:25.196207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f0ad60d-7529-4b22-8b42-11686c5e4f21 None None] Network 50dc0c23-2977-4989-b609-20b428ab0210 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:22:25.203138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25f3bd68-d48c-4984-afa8-189e120ebd9a tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event deleted for resources: {'Subnet': ['ID=5f771c35-bd94-4a21-a94d-6c5900db0ac2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:25.215208 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-25f3bd68-d48c-4984-afa8-189e120ebd9a tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "DELETE /v2.0/subnets/5f771c35-bd94-4a21-a94d-6c5900db0ac2 HTTP/1.1" status: 204 len: 168 time: 0.9531472 May 12 15:22:25.215901 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35782) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:25.527704 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:25.583390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Deleting port 6559328b-364e-4433-8e8b-4b6b907b793c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:25.584107 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:25.615911 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:25.660941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cef3589-66c8-4391-b29c-6068afd69934 req-8f11534f-5f99-4379-926c-2c449ed0d457 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:25.668017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9cef3589-66c8-4391-b29c-6068afd69934 req-8f11534f-5f99-4379-926c-2c449ed0d457 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 944 time: 0.3047678 May 12 15:22:25.690022 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8fc3485c-2073-4bd0-8d28-1388fc08bfd9 None None] DHCP port deletion for 50dc0c23-2977-4989-b609-20b428ab0210 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:22:25.695704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8fc3485c-2073-4bd0-8d28-1388fc08bfd9 None None] Deleting port 6559328b-364e-4433-8e8b-4b6b907b793c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:25.698518 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fc3485c-2073-4bd0-8d28-1388fc08bfd9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:25.707114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e8fd154-f017-428e-ad33-2caca359c2d1 req-947c5587-ed34-4309-8f8f-0d327329b304 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:25.708567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e8fd154-f017-428e-ad33-2caca359c2d1 req-947c5587-ed34-4309-8f8f-0d327329b304 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 932 time: 0.2458391 May 12 15:22:25.894261 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9cef3589-66c8-4391-b29c-6068afd69934 req-c8d94883-1fc0-4a9a-8dfa-720db514a101 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1958542 May 12 15:22:25.901422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f2e06a-4b16-427a-bb34-080ebc80477b req-2274fd8e-9694-47c2-95d2-63466ec20d44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:25.913187 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45f2e06a-4b16-427a-bb34-080ebc80477b req-2274fd8e-9694-47c2-95d2-63466ec20d44 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 1095 time: 0.4797566 May 12 15:22:25.928909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6e8fd154-f017-428e-ad33-2caca359c2d1 req-bd8f551b-a9ca-49f5-974e-8e46665a456f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Synchronizing usage tracker for tenant:4e5a10df576841e2a4752a9d47fb790a on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:22:25.962034 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8fc3485c-2073-4bd0-8d28-1388fc08bfd9 None None] For port 6559328b-364e-4433-8e8b-4b6b907b793c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6559328b-364e-4433-8e8b-4b6b907b793c,segment=NetworkSegment(cf597cb4-44a2-466d-867b-86ad3091743a),segment_id=cf597cb4-44a2-466d-867b-86ad3091743a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:25.962497 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fc3485c-2073-4bd0-8d28-1388fc08bfd9 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:25.990879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] For port 6559328b-364e-4433-8e8b-4b6b907b793c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6559328b-364e-4433-8e8b-4b6b907b793c,segment=NetworkSegment(cf597cb4-44a2-466d-867b-86ad3091743a),segment_id=cf597cb4-44a2-466d-867b-86ad3091743a)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:25.991537 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:26.010275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6e8fd154-f017-428e-ad33-2caca359c2d1 req-bd8f551b-a9ca-49f5-974e-8e46665a456f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Unset dirty status for tenant:4e5a10df576841e2a4752a9d47fb790a on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:22:26.020646 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e8fd154-f017-428e-ad33-2caca359c2d1 req-bd8f551b-a9ca-49f5-974e-8e46665a456f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2793124 May 12 15:22:26.121419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8fc3485c-2073-4bd0-8d28-1388fc08bfd9 None None] Calling delete_port for 6559328b-364e-4433-8e8b-4b6b907b793c owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:22:26.237551 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fc3485c-2073-4bd0-8d28-1388fc08bfd9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:26.247195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f2e06a-4b16-427a-bb34-080ebc80477b req-74031ebd-f328-4170-9006-05a4447c13ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:26.248718 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45f2e06a-4b16-427a-bb34-080ebc80477b req-74031ebd-f328-4170-9006-05a4447c13ea service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.3348334 May 12 15:22:26.322164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Calling delete_port for 6559328b-364e-4433-8e8b-4b6b907b793c owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:22:26.338716 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fc3485c-2073-4bd0-8d28-1388fc08bfd9 None None] Pushing event deleted for resources: {'Port': ['ID=6559328b-364e-4433-8e8b-4b6b907b793c,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:26.343785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fc3485c-2073-4bd0-8d28-1388fc08bfd9 None None] No DVR routers for this DVR port 6559328b-364e-4433-8e8b-4b6b907b793c on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:22:26.431783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:22:26.450723 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:26.460439 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:26.474459 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:26.481962 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45f2e06a-4b16-427a-bb34-080ebc80477b req-8ce4fefc-2098-450f-9ce5-b240d483d044 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26 HTTP/1.1" status: 200 len: 999 time: 0.1848238 May 12 15:22:26.485406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Transition to ACTIVE for port object a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:22:26.612375 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f648871-ed97-484b-8327-451c56f8909b req-c279bfa9-06ce-44b3-8a3a-7dbbca0dd846 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/057a4553-3a0d-4b43-95bc-db43081f665c HTTP/1.1" status: 200 len: 1807 time: 0.6756980 May 12 15:22:26.755378 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:26.760712 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2f648871-ed97-484b-8327-451c56f8909b req-268778f4-fb14-4caf-aa49-54ecece70916 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:26.792198 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2f648871-ed97-484b-8327-451c56f8909b req-268778f4-fb14-4caf-aa49-54ecece70916 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:26.842889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54e8b841-2c3f-4a1c-879b-792bdba4a349 req-222dfd51-dac4-4a4e-81da-67e6978f9a54 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:26.845346 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-54e8b841-2c3f-4a1c-879b-792bdba4a349 req-222dfd51-dac4-4a4e-81da-67e6978f9a54 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.76 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 944 time: 0.5355120 May 12 15:22:26.871585 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:22:26.871585 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:22:26.951780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c2c0f6-9e24-46f6-b666-1fd0fec195ff req-8a2e06ac-6665-44fc-847b-67bba5a00cd1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:26.960370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81c2c0f6-9e24-46f6-b666-1fd0fec195ff req-8a2e06ac-6665-44fc-847b-67bba5a00cd1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.6473897 May 12 15:22:26.977044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6559328b-364e-4433-8e8b-4b6b907b793c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:22:27.018568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Pushing event updated for resources: {'Port': ['ID=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:27.025102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81c2c0f6-9e24-46f6-b666-1fd0fec195ff req-29af1168-364f-48d3-8c0d-0fa48ef1a5c9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636322 May 12 15:22:27.030947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f2e06a-4b16-427a-bb34-080ebc80477b req-0d443ac4-43a8-49d0-a8ee-28ea4d1068b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:27.033210 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45f2e06a-4b16-427a-bb34-080ebc80477b req-0d443ac4-43a8-49d0-a8ee-28ea4d1068b6 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.3237576 May 12 15:22:27.037286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 6559328b-364e-4433-8e8b-4b6b907b793c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:22:27.037889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6559328b-364e-4433-8e8b-4b6b907b793c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:22:27.052293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-54e8b841-2c3f-4a1c-879b-792bdba4a349 req-8c3b1636-8136-4419-ae3a-eaedd32f1617 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Deleting port 632953d6-f6ad-4465-b608-8f2b459ee5e2 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:27.052805 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-54e8b841-2c3f-4a1c-879b-792bdba4a349 req-8c3b1636-8136-4419-ae3a-eaedd32f1617 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:27.215432 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2f648871-ed97-484b-8327-451c56f8909b req-268778f4-fb14-4caf-aa49-54ecece70916 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:27.249277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Attempting to bind port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:22:27.249725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Attempting to bind port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '17355787-57e0-48f5-9070-811e461a6000', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:22:27.250173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Attempting to bind port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f on network aab37dc4-92bf-4fd9-8482-5e3a3f715d61 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:22:27.263243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f on network aab37dc4-92bf-4fd9-8482-5e3a3f715d61 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:22:27.263871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Attempting to bind port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f on network aab37dc4-92bf-4fd9-8482-5e3a3f715d61 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:22:27.280011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 22, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:22:27.280444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Checking segment: {'id': '17355787-57e0-48f5-9070-811e461a6000', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:22:27.280893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Bound using segment: {'id': '17355787-57e0-48f5-9070-811e461a6000', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:22:27.281957 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Bound port: a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '17355787-57e0-48f5-9070-811e461a6000', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:22:27.282389 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:27.294068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-268778f4-fb14-4caf-aa49-54ecece70916 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=057a4553-3a0d-4b43-95bc-db43081f665c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:27.312862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f2e06a-4b16-427a-bb34-080ebc80477b req-70344927-561e-4261-9877-26cbfa649b0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:27.314490 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45f2e06a-4b16-427a-bb34-080ebc80477b req-70344927-561e-4261-9877-26cbfa649b0f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2377689 May 12 15:22:27.366336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Router 2d850e53-8c48-48c4-9bc4-a417d87aa7c2 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:22:27.389893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Deleting port 6559328b-364e-4433-8e8b-4b6b907b793c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:27.390240 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:27.417601 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2f648871-ed97-484b-8327-451c56f8909b req-268778f4-fb14-4caf-aa49-54ecece70916 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:27.418711 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f648871-ed97-484b-8327-451c56f8909b req-268778f4-fb14-4caf-aa49-54ecece70916 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "DELETE /v2.0/security-groups/057a4553-3a0d-4b43-95bc-db43081f665c HTTP/1.1" status: 204 len: 173 time: 0.8056324 May 12 15:22:27.557543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] The port '6559328b-364e-4433-8e8b-4b6b907b793c' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:22:27.680208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] For port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:22:27.726836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] For port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:22:27.739104 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:27.743498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-382864b7-7bc2-4fa7-8081-14ec8d432d44 req-f9685cac-7d47-41b6-a6e1-289236516e50 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:27.745017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-382864b7-7bc2-4fa7-8081-14ec8d432d44 req-f9685cac-7d47-41b6-a6e1-289236516e50 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.5316923 May 12 15:22:27.780668 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45f2e06a-4b16-427a-bb34-080ebc80477b req-481f3f8f-0d7b-4d29-a896-2a73507d83e3 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4397302 May 12 15:22:27.791475 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:27.844619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:22:27.859854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6f771d6-ecee-46b7-bfbc-080beac4a178 None None] Sync routers for ids ['2d850e53-8c48-48c4-9bc4-a417d87aa7c2'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:22:27.866776 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:22:27.898136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-54e8b841-2c3f-4a1c-879b-792bdba4a349 req-8c3b1636-8136-4419-ae3a-eaedd32f1617 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] For port 632953d6-f6ad-4465-b608-8f2b459ee5e2, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=632953d6-f6ad-4465-b608-8f2b459ee5e2,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:27.898485 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-54e8b841-2c3f-4a1c-879b-792bdba4a349 req-8c3b1636-8136-4419-ae3a-eaedd32f1617 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:27.909459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:27.910978 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:27.911774 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] 10.222.0.84 "PUT /v2.0/ports/a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f HTTP/1.1" status: 200 len: 1092 time: 3.2429421 May 12 15:22:27.919009 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:27.923573 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d542de1b-df23-486a-b87d-4d87254406b2 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "PUT /v2.0/routers/2d850e53-8c48-48c4-9bc4-a417d87aa7c2 HTTP/1.1" status: 200 len: 916 time: 6.3337741 May 12 15:22:27.923573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6e3189ff-eb13-4d53-bb96-0f93c430e9f5', 'tag': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:27.923860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['50dc0c23-2977-4989-b609-20b428ab0210']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:27.938958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-382864b7-7bc2-4fa7-8081-14ec8d432d44 req-54ba7ba8-4019-4dcd-9ae2-68499790228e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1758463 May 12 15:22:27.944170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35796) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:27.977883 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6f771d6-ecee-46b7-bfbc-080beac4a178 None None] Routers {'2d850e53-8c48-48c4-9bc4-a417d87aa7c2'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:22:27.978659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b6f771d6-ecee-46b7-bfbc-080beac4a178 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:22:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2d850e53-8c48-48c4-9bc4-a417d87aa7c2'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:28.050491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b6f771d6-ecee-46b7-bfbc-080beac4a178 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:28.068922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32b04cb3-749d-4ce3-82c2-1dbcaaad4144 service neutron] Pushing event updated for resources: {'Port': ['ID=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:28.074877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6f771d6-ecee-46b7-bfbc-080beac4a178 None None] Routers {'2d850e53-8c48-48c4-9bc4-a417d87aa7c2'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:22:28.075629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b6f771d6-ecee-46b7-bfbc-080beac4a178 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:22:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2d850e53-8c48-48c4-9bc4-a417d87aa7c2'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:28.128355 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45f2e06a-4b16-427a-bb34-080ebc80477b req-1f193f0e-2420-4e5e-b5d9-7679a02508df service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3332486 May 12 15:22:28.138664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-f0932d9f-fb26-4830-85ef-cfa35a0e6038 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:28.140357 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-f0932d9f-fb26-4830-85ef-cfa35a0e6038 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e5a10df576841e2a4752a9d47fb790a&device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 1095 time: 0.1544533 May 12 15:22:28.151842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cf597cb4-44a2-466d-867b-86ad3091743a') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:28.152137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cf597cb4-44a2-466d-867b-86ad3091743a') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:28.167209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-54e8b841-2c3f-4a1c-879b-792bdba4a349 req-8c3b1636-8136-4419-ae3a-eaedd32f1617 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Calling delete_port for 632953d6-f6ad-4465-b608-8f2b459ee5e2 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:22:28.202445 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b6f771d6-ecee-46b7-bfbc-080beac4a178 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:28.203688 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6f771d6-ecee-46b7-bfbc-080beac4a178 None None] The sync data for ids ['2d850e53-8c48-48c4-9bc4-a417d87aa7c2'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:22:28.271745 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-97fdbcc8-54b9-419d-b0d5-3e2713d813e4 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f HTTP/1.1" status: 200 len: 217 time: 0.1060467 May 12 15:22:28.343712 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:28.358865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-3b587332-e825-4838-9da8-fb8e9ebcb02b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:28.361818 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-3b587332-e825-4838-9da8-fb8e9ebcb02b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c90f4328-5e3e-4311-a3b6-84cff19a6919 HTTP/1.1" status: 200 len: 853 time: 0.0830376 May 12 15:22:28.396181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b35ccbbf-31b3-4f87-ad0b-7f747505fa85 req-bc8c9177-f2af-4730-b52d-38b6796b1200 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:28.403642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b35ccbbf-31b3-4f87-ad0b-7f747505fa85 req-bc8c9177-f2af-4730-b52d-38b6796b1200 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.8424520 May 12 15:22:28.445226 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:28.517338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Releasing vlan 588 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:22:28.517797 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: timer() May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:22:28.546053 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:22:28.598496 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-9a0b0c8a-73c0-4d9b-baaa-dcba7ea1e88e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2251065 May 12 15:22:28.791244 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-8a39b154-a155-4178-a3e5-2a5ce2d36049 service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1736660 May 12 15:22:28.829847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b35ccbbf-31b3-4f87-ad0b-7f747505fa85 req-47fefd37-84ff-4c8e-b4d3-a8117af78fc4 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4247842 May 12 15:22:28.898468 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3f4cf17c-9e05-42bd-8fce-6f8b665e20b9 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/routers/2d850e53-8c48-48c4-9bc4-a417d87aa7c2 HTTP/1.1" status: 200 len: 922 time: 0.9502804 May 12 15:22:28.901289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35808) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:28.906832 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:28.945086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a8e8e75-c610-42c3-aef9-e0d74e8e49bc req-c8ed5409-9de8-4ab1-bb73-e59c3d90b321 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:28.952442 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a8e8e75-c610-42c3-aef9-e0d74e8e49bc req-c8ed5409-9de8-4ab1-bb73-e59c3d90b321 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f1860d3-a7e3-4641-b4cd-169837fafc21 HTTP/1.1" status: 200 len: 944 time: 0.7535505 May 12 15:22:29.007603 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:29.020563 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "DELETE /v2.0/networks/50dc0c23-2977-4989-b609-20b428ab0210 HTTP/1.1" status: 204 len: 168 time: 3.8034625 May 12 15:22:29.024608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35814) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:29.050135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3caaa264-37e7-497c-8c52-0375f7cefbba tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Pushing event deleted for resources: {'Network': ['ID=50dc0c23-2977-4989-b609-20b428ab0210,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:29.089469 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a8e8e75-c610-42c3-aef9-e0d74e8e49bc req-099eb756-7728-4fb6-bed4-585816fb48bb tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1359921 May 12 15:22:29.094968 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-54e8b841-2c3f-4a1c-879b-792bdba4a349 req-8c3b1636-8136-4419-ae3a-eaedd32f1617 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:29.119742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f7d77808-00e0-47e9-b0ef-76e0f0b1895f tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Synchronizing usage tracker for tenant:c995197740fb4eab89e62ffe0b62783d on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:22:29.119742 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ae1ad3a-55b8-4ca9-b341-5c0ae37184f1 req-9b0a3bd6-16cd-42f4-9217-8a5cfbc83c8f service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3188081 May 12 15:22:29.131995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-807644c8-a60d-47b5-b271-9172598d78e9 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:29.133716 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-807644c8-a60d-47b5-b271-9172598d78e9 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/ports?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&device_id=2d850e53-8c48-48c4-9bc4-a417d87aa7c2&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.2305756 May 12 15:22:29.137252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35820) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:29.160995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f7d77808-00e0-47e9-b0ef-76e0f0b1895f tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Unset dirty status for tenant:c995197740fb4eab89e62ffe0b62783d on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:22:29.162870 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f7d77808-00e0-47e9-b0ef-76e0f0b1895f tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "GET /v2.0/ports?device_id=0a20e216-0f20-463c-92e2-94e5c5a92acd HTTP/1.1" status: 200 len: 205 time: 0.1355119 May 12 15:22:29.167822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35824) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:29.257717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c3b1636-8136-4419-ae3a-eaedd32f1617 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Pushing event deleted for resources: {'Port': ['ID=632953d6-f6ad-4465-b608-8f2b459ee5e2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:29.374023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3097e1c-8ce0-4fe2-92b5-d27d2485df23 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:29.391776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-54e8b841-2c3f-4a1c-879b-792bdba4a349 req-8c3b1636-8136-4419-ae3a-eaedd32f1617 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] No DVR routers for this DVR port 632953d6-f6ad-4465-b608-8f2b459ee5e2 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:22:29.395757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8fcf2f0-1fa9-4576-abd8-9cfa912d65d8 req-bdef4cc9-bcbb-4919-bc78-977c2b4b9de7 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/dbd855f9-e86b-4956-aa84-f5297280e69d HTTP/1.1" status: 200 len: 1807 time: 0.2196820 May 12 15:22:29.397609 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-54e8b841-2c3f-4a1c-879b-792bdba4a349 req-8c3b1636-8136-4419-ae3a-eaedd32f1617 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:29.399437 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-54e8b841-2c3f-4a1c-879b-792bdba4a349 req-8c3b1636-8136-4419-ae3a-eaedd32f1617 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.76 "DELETE /v2.0/ports/632953d6-f6ad-4465-b608-8f2b459ee5e2 HTTP/1.1" status: 204 len: 173 time: 2.5295033 May 12 15:22:29.399860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f1860d3-a7e3-4641-b4cd-169837fafc21', 'name': 'network-vif-deleted', 'tag': '632953d6-f6ad-4465-b608-8f2b459ee5e2'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:29.477626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26371549-1de3-4a18-a8d7-42de3dffcf19 req-b5605fc2-7d07-4dfc-9dab-ec74f1f99374 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:29.479097 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-26371549-1de3-4a18-a8d7-42de3dffcf19 req-b5605fc2-7d07-4dfc-9dab-ec74f1f99374 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.3822036 May 12 15:22:29.544184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-26371549-1de3-4a18-a8d7-42de3dffcf19 req-67cbe81b-74a9-49be-8dc0-1b8914975806 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0592968 May 12 15:22:29.544801 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b8fcf2f0-1fa9-4576-abd8-9cfa912d65d8 req-57645719-4f28-48d3-8ed0-3da1d639151a tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:29.610548 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b8fcf2f0-1fa9-4576-abd8-9cfa912d65d8 req-57645719-4f28-48d3-8ed0-3da1d639151a tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:29.618053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e681545-6585-431f-9e00-f85c97952d76 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:29.619726 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5e681545-6585-431f-9e00-f85c97952d76 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 881 time: 0.4815564 May 12 15:22:29.626521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35830) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:29.697876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-79f459a9-57fd-43ea-9ae1-319a64a63499 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d850e53-8c48-48c4-9bc4-a417d87aa7c2 HTTP/1.1" status: 200 len: 205 time: 0.0669391 May 12 15:22:29.699977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35834) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:29.772438 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3097e1c-8ce0-4fe2-92b5-d27d2485df23 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:29.775202 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3097e1c-8ce0-4fe2-92b5-d27d2485df23 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:29.797933 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8b3e09e0-1ba2-457d-8be6-b46699e2b373'] response: {'name': 'network-changed', 'server_uuid': '6e3189ff-eb13-4d53-bb96-0f93c430e9f5', 'tag': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f', 'status': 'completed', 'code': 200} May 12 15:22:29.835541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3097e1c-8ce0-4fe2-92b5-d27d2485df23 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:29.836416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d3097e1c-8ce0-4fe2-92b5-d27d2485df23 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Fanout notify agent at l3_agent the message router_deleted on router 0a20e216-0f20-463c-92e2-94e5c5a92acd {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:22:29.857902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3097e1c-8ce0-4fe2-92b5-d27d2485df23 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:29.859821 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d3097e1c-8ce0-4fe2-92b5-d27d2485df23 tempest-RoutersNegativeTest-1881556971 tempest-RoutersNegativeTest-1881556971-project] 10.222.0.82 "DELETE /v2.0/routers/0a20e216-0f20-463c-92e2-94e5c5a92acd HTTP/1.1" status: 204 len: 168 time: 0.6906374 May 12 15:22:29.945621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e013189-d1ad-4be7-8569-38c8bb636f4c req-0cee0de9-b599-48e0-9061-0f3049900a20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:29.947649 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b8fcf2f0-1fa9-4576-abd8-9cfa912d65d8 req-57645719-4f28-48d3-8ed0-3da1d639151a tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:29.951750 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e013189-d1ad-4be7-8569-38c8bb636f4c req-0cee0de9-b599-48e0-9061-0f3049900a20 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e5a10df576841e2a4752a9d47fb790a&device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 1095 time: 0.1482916 May 12 15:22:29.988015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57645719-4f28-48d3-8ed0-3da1d639151a tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbd855f9-e86b-4956-aa84-f5297280e69d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:30.010153 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b8fcf2f0-1fa9-4576-abd8-9cfa912d65d8 req-57645719-4f28-48d3-8ed0-3da1d639151a tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:30.011301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8fcf2f0-1fa9-4576-abd8-9cfa912d65d8 req-57645719-4f28-48d3-8ed0-3da1d639151a tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "DELETE /v2.0/security-groups/dbd855f9-e86b-4956-aa84-f5297280e69d HTTP/1.1" status: 204 len: 173 time: 0.6048756 May 12 15:22:30.020219 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:30.125119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e013189-d1ad-4be7-8569-38c8bb636f4c req-4ce84cd7-f309-44b2-ac12-569f42444254 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:30.127495 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e013189-d1ad-4be7-8569-38c8bb636f4c req-4ce84cd7-f309-44b2-ac12-569f42444254 service neutron] 10.222.0.84 "GET /v2.0/networks?id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61 HTTP/1.1" status: 200 len: 914 time: 0.1711555 May 12 15:22:30.146992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78bc9857-6e0e-43ef-81a5-1a0d5a1af22e req-9a483da5-ba5e-4f65-a04c-da647a4ee46b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:30.153815 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78bc9857-6e0e-43ef-81a5-1a0d5a1af22e req-9a483da5-ba5e-4f65-a04c-da647a4ee46b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.3335123 May 12 15:22:30.292486 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78bc9857-6e0e-43ef-81a5-1a0d5a1af22e req-f156ab85-fc98-4c2e-94ba-d89c063577ea tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1374848 May 12 15:22:30.393867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35848) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:30.432188 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b075ce94-b13f-47f5-b479-dab8b59bd0b6'] response: {'server_uuid': '4f1860d3-a7e3-4641-b4cd-169837fafc21', 'name': 'network-vif-deleted', 'tag': '632953d6-f6ad-4465-b608-8f2b459ee5e2', 'status': 'completed', 'code': 200} May 12 15:22:30.461271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e013189-d1ad-4be7-8569-38c8bb636f4c req-a69cec62-d8b7-431d-9d44-46c0ea1503cd service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f HTTP/1.1" status: 200 len: 217 time: 0.3257744 May 12 15:22:30.476803 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:30.499030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Deleting port 7e44420a-5632-4b1b-8e91-fba9f805536e {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:30.500066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:30.526825 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 632953d6-f6ad-4465-b608-8f2b459ee5e2 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:22:30.568723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51c5cd25-e72a-400d-bc8f-5fb2afb571d7 req-a6aae89c-7eff-4d3c-bf14-17a22ff4fd1d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:30.570212 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-51c5cd25-e72a-400d-bc8f-5fb2afb571d7 req-a6aae89c-7eff-4d3c-bf14-17a22ff4fd1d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2633080 May 12 15:22:30.594986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e013189-d1ad-4be7-8569-38c8bb636f4c req-03cc8aab-45b1-4906-9b7c-d766c1bfc620 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:30.596603 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e013189-d1ad-4be7-8569-38c8bb636f4c req-03cc8aab-45b1-4906-9b7c-d766c1bfc620 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c90f4328-5e3e-4311-a3b6-84cff19a6919 HTTP/1.1" status: 200 len: 853 time: 0.1270447 May 12 15:22:30.650972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 632953d6-f6ad-4465-b608-8f2b459ee5e2 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:22:30.651457 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e013189-d1ad-4be7-8569-38c8bb636f4c req-89467576-d685-43b9-b0d2-1dfa6751676d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0478215 May 12 15:22:30.657568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 632953d6-f6ad-4465-b608-8f2b459ee5e2 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:22:30.768689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-51c5cd25-e72a-400d-bc8f-5fb2afb571d7 req-aca46718-41eb-4eaf-a5f9-aef5a9cd4499 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1781783 May 12 15:22:30.810639 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e013189-d1ad-4be7-8569-38c8bb636f4c req-e17e6e15-29f6-4bac-8de4-e1e74b6a2f70 service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1511621 May 12 15:22:30.893814 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4df9945e-319d-448c-a50f-bb8d0a931060 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c995197740fb4eab89e62ffe0b62783d&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4945326 May 12 15:22:30.900220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35860) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:30.935500 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:30.955936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-def8a6c4-6c3a-4d89-859e-dbeef6b0d59e req-cd46fcd2-cc7f-42c3-ada9-82def0e5854d tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/c18e0d07-ed54-458f-b344-73c879cca4f8 HTTP/1.1" status: 200 len: 2406 time: 0.1346066 May 12 15:22:30.970562 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e013189-d1ad-4be7-8569-38c8bb636f4c req-ebfcb132-b679-4434-af8f-d0336c754a7d service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1540365 May 12 15:22:31.326526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Calling delete_port for 7e44420a-5632-4b1b-8e91-fba9f805536e owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:22:31.367204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c7d35c-9f3e-44cb-82fd-1887dda2ed5e req-ad619451-2bd0-473e-b1dc-aed43bf7bddc tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:31.371264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-97c7d35c-9f3e-44cb-82fd-1887dda2ed5e req-ad619451-2bd0-473e-b1dc-aed43bf7bddc tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.6964536 May 12 15:22:31.509163 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93f865a9-f61f-44b7-a2fb-b30a4052016d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:31.533361 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-97c7d35c-9f3e-44cb-82fd-1887dda2ed5e req-76611899-fb08-4559-8201-146f79d4015e tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1285880 May 12 15:22:31.549661 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-def8a6c4-6c3a-4d89-859e-dbeef6b0d59e req-06e81767-bc69-459f-8d8a-38a8a40cf716 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:31.581840 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93f865a9-f61f-44b7-a2fb-b30a4052016d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:31.632370 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-def8a6c4-6c3a-4d89-859e-dbeef6b0d59e req-06e81767-bc69-459f-8d8a-38a8a40cf716 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:31.806543 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93f865a9-f61f-44b7-a2fb-b30a4052016d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:31.869063 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-def8a6c4-6c3a-4d89-859e-dbeef6b0d59e req-06e81767-bc69-459f-8d8a-38a8a40cf716 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:31.881485 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:31.917485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93f865a9-f61f-44b7-a2fb-b30a4052016d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d533b3d4-8ae6-436f-9a30-a014d8316617,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:31.962950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Pushing event deleted for resources: {'Port': ['ID=7e44420a-5632-4b1b-8e91-fba9f805536e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:31.966832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06e81767-bc69-459f-8d8a-38a8a40cf716 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c18e0d07-ed54-458f-b344-73c879cca4f8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:32.059319 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-def8a6c4-6c3a-4d89-859e-dbeef6b0d59e req-06e81767-bc69-459f-8d8a-38a8a40cf716 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:32.066156 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-def8a6c4-6c3a-4d89-859e-dbeef6b0d59e req-06e81767-bc69-459f-8d8a-38a8a40cf716 tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "DELETE /v2.0/security-groups/c18e0d07-ed54-458f-b344-73c879cca4f8 HTTP/1.1" status: 204 len: 173 time: 1.0939806 May 12 15:22:32.083033 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93f865a9-f61f-44b7-a2fb-b30a4052016d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:32.084117 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-93f865a9-f61f-44b7-a2fb-b30a4052016d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d533b3d4-8ae6-436f-9a30-a014d8316617 HTTP/1.1" status: 204 len: 168 time: 1.1739457 May 12 15:22:32.118917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3841a2-0229-40f2-b256-1c6f05bb6e7d req-3b6e505e-aed2-47da-b1fd-4dba7f0a055e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:32.129594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b3841a2-0229-40f2-b256-1c6f05bb6e7d req-3b6e505e-aed2-47da-b1fd-4dba7f0a055e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.3056107 May 12 15:22:32.163420 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:32.199548 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:32.433429 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b3841a2-0229-40f2-b256-1c6f05bb6e7d req-5504e77b-b7c1-43c8-a3c4-c99a1b938a5d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3029368 May 12 15:22:32.441704 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:32.448628 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:32.540547 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:32.541223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Fanout notify agent at l3_agent the message router_deleted on router 2d850e53-8c48-48c4-9bc4-a417d87aa7c2 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:22:32.561903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-520408a8-dba6-4650-a56c-974c723a4fa7 req-9d648358-3f6b-45f7-ba2b-e0de9090c14f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:32.563615 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-520408a8-dba6-4650-a56c-974c723a4fa7 req-9d648358-3f6b-45f7-ba2b-e0de9090c14f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.1810415 May 12 15:22:32.569478 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:32.570697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e3709023-95fc-4385-90a2-978ed8eeed17 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "DELETE /v2.0/routers/2d850e53-8c48-48c4-9bc4-a417d87aa7c2 HTTP/1.1" status: 204 len: 168 time: 2.8697610 May 12 15:22:32.574284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35888) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:32.581108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-716499863', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:32.595417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:32.602560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Usage tracker for resource:router and tenant:e87ae982708240299f16d4cfc5f73d5d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:32.606516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:32.618606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:32.638471 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:32.640909 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:32.660663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:32.794165 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-44bda0d7-806c-49dc-bcf4-e94fce836590 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:32.803419 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-44bda0d7-806c-49dc-bcf4-e94fce836590 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/networks?id=670dbecd-f547-4abf-b069-62f0c8712c6b HTTP/1.1" status: 200 len: 822 time: 0.1945393 May 12 15:22:32.828315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-7f0f6bb4-92d4-4664-a2bc-27b3f279e3df tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/quotas/4789db12ded14c2e8773d2396c9acd32 HTTP/1.1" status: 200 len: 375 time: 0.0237560 May 12 15:22:32.846004 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-520408a8-dba6-4650-a56c-974c723a4fa7 req-a1b75bb2-e942-4d30-ba94-7209aa72405a tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2740400 May 12 15:22:32.977876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b61d25c-d44c-4088-890c-baa1df66350b req-5aa10697-4fed-40d5-9e29-18e797acbe2f tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "GET /v2.0/security-groups/6464c06f-18f1-44f2-b445-c0d4145846c8 HTTP/1.1" status: 200 len: 2401 time: 0.0785658 May 12 15:22:33.020457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-bfca23cc-3b57-48d3-b6cf-fe05177239f7 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Synchronizing usage tracker for tenant:4789db12ded14c2e8773d2396c9acd32 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:22:33.040357 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:33.125587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-bfca23cc-3b57-48d3-b6cf-fe05177239f7 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Unset dirty status for tenant:4789db12ded14c2e8773d2396c9acd32 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:22:33.129896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-bfca23cc-3b57-48d3-b6cf-fe05177239f7 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4789db12ded14c2e8773d2396c9acd32&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2998374 May 12 15:22:33.135709 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1b61d25c-d44c-4088-890c-baa1df66350b req-8a616975-f223-470a-a77e-7766ac39c0da tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:33.200608 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:22:33.419289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35912) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:33.461900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:33.470099 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-1192f7e7-e24d-41ea-b286-02c34e1cf0ca service neutron] 10.222.0.82 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3141582 May 12 15:22:33.506031 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:33.506739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f', 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61', 'port_id': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f', 'mac_address': 'fa:16:3e:3d:84:57', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 559, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c90f4328-5e3e-4311-a3b6-84cff19a6919', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:22:33.540518 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:33.633985 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1b61d25c-d44c-4088-890c-baa1df66350b req-8a616975-f223-470a-a77e-7766ac39c0da tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:33.657816 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:33.663688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-098087ef-fe64-4a85-9071-121dde6fde88 service neutron] 10.222.0.82 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1926563 May 12 15:22:33.710074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:22:33.726815 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1b61d25c-d44c-4088-890c-baa1df66350b req-8a616975-f223-470a-a77e-7766ac39c0da tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:33.756347 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1b61d25c-d44c-4088-890c-baa1df66350b req-8a616975-f223-470a-a77e-7766ac39c0da tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:33.757951 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:33.761301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b289eadd-e7b2-4160-a8fc-a2371d32b881 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group': {'name': 'default'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:33.762258 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-b289eadd-e7b2-4160-a8fc-a2371d32b881 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. May 12 15:22:33.762853 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-b289eadd-e7b2-4160-a8fc-a2371d32b881 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): There was a conflict when trying to complete your request. May 12 15:22:33.770791 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b289eadd-e7b2-4160-a8fc-a2371d32b881 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.3469129 May 12 15:22:33.771202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35920) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:33.771481 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35922) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:33.773303 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b61d25c-d44c-4088-890c-baa1df66350b req-8a616975-f223-470a-a77e-7766ac39c0da tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] 10.222.0.82 "DELETE /v2.0/security-groups/6464c06f-18f1-44f2-b445-c0d4145846c8 HTTP/1.1" status: 204 len: 173 time: 0.7847073 May 12 15:22:33.773847 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:33.779818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a616975-f223-470a-a77e-7766ac39c0da tempest-SecurityGroupRulesTestJSON-1325550191 tempest-SecurityGroupRulesTestJSON-1325550191-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6464c06f-18f1-44f2-b445-c0d4145846c8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:33.848912 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group': {'name': 'tempest-secgroup--9769429'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:33.896350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:33.919166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:33.927059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:33.939908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:33.978588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:33.990563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:33.990811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:33.991552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:33.991842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:33.992169 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:33.992491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:33.993014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:33.993444 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:33.994555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:33.994937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:33.995266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:33.995586 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:34.015071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Allocated IP 172.25.8.142 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/5092ce3e-087b-4123-a2b0-daf2848b42fb) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:22:34.018320 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:34.036633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-5b76e6f6-eee4-42a5-b2c8-c54a46e90d33 admin admin] Deleting subnet b8720075-d50c-4374-a8ba-4140078ca9f1 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:22:34.037624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10126401-f132-4bee-9886-c47911fcc729 req-21fafdba-30c9-4eda-8bf3-627d47e5e765 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:34.040302 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10126401-f132-4bee-9886-c47911fcc729 req-21fafdba-30c9-4eda-8bf3-627d47e5e765 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1569850 May 12 15:22:34.041021 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:34.062142 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b76e6f6-eee4-42a5-b2c8-c54a46e90d33 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:34.126970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:22:34.250740 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10126401-f132-4bee-9886-c47911fcc729 req-74279d86-8537-41a8-86ab-dc8633fbcde6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1438692 May 12 15:22:34.292611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a808560-c353-451e-9b8a-97ffe1c0de7c req-6e0793b0-ad05-4a67-8bb1-26cc40fe46f8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:34.298015 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a808560-c353-451e-9b8a-97ffe1c0de7c req-6e0793b0-ad05-4a67-8bb1-26cc40fe46f8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.2563541 May 12 15:22:34.381895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:34.415341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:34.433985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a808560-c353-451e-9b8a-97ffe1c0de7c req-d746f9c7-5bfc-4909-8fa7-07e4b12bc58e tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1280055 May 12 15:22:34.441211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:34.540737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:34.574306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b76e6f6-eee4-42a5-b2c8-c54a46e90d33 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:34.687193 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b76e6f6-eee4-42a5-b2c8-c54a46e90d33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:34.748484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8d2110-9d73-4261-8b2c-d4e193179d75 req-0432485b-be8d-4e07-8615-e2513894f7b3 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:34.754350 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cf8d2110-9d73-4261-8b2c-d4e193179d75 req-0432485b-be8d-4e07-8615-e2513894f7b3 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 945 time: 0.2425058 May 12 15:22:34.768697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c8ea8dc-caa5-4fac-8f9a-79ae0df6d2f9 req-28ec09c3-7bcd-4a66-82a9-fef65bdf9bf9 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 210 time: 0.0778942 May 12 15:22:34.865018 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cf8d2110-9d73-4261-8b2c-d4e193179d75 req-e39d1e5f-6e05-4447-be75-57fdb187132f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0941343 May 12 15:22:34.874485 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:34.893293 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:34.901052 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:34.931513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:34.947379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:34.959989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:34.980140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:34.994897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2042e517-a24f-4039-ab4d-5bb5ed0c8dae,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:35.015263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:35.015263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:35.017192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:35.017192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:35.017192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:35.017687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:35.018093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:35.018606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:35.019010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:35.019395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:35.019780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:35.020167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:35.023903 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b76e6f6-eee4-42a5-b2c8-c54a46e90d33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:35.083644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b76e6f6-eee4-42a5-b2c8-c54a46e90d33 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b8720075-d50c-4374-a8ba-4140078ca9f1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:35.094908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b76e6f6-eee4-42a5-b2c8-c54a46e90d33 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:35.101035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:35.110586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a606b3bb-478b-42a8-aaa8-d5438ced081b req-899fc162-6700-49f9-942d-2e25622676b6 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:35.112055 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a606b3bb-478b-42a8-aaa8-d5438ced081b req-899fc162-6700-49f9-942d-2e25622676b6 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.1772599 May 12 15:22:35.123050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32c5995-a9db-4a6f-a512-e398f2810962 req-4bbc6bed-7ac8-40a8-9bff-474be231918d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:35.124449 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b32c5995-a9db-4a6f-a512-e398f2810962 req-4bbc6bed-7ac8-40a8-9bff-474be231918d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1090934 May 12 15:22:35.188823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:22:35.195081 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5b76e6f6-eee4-42a5-b2c8-c54a46e90d33 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/b8720075-d50c-4374-a8ba-4140078ca9f1 HTTP/1.1" status: 204 len: 168 time: 1.3928628 May 12 15:22:35.196086 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a606b3bb-478b-42a8-aaa8-d5438ced081b req-e50fc94c-84ac-46c9-aec7-eda002d01b8b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699353 May 12 15:22:35.198940 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35952) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:35.199103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:22:35.210648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:22:35.223961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b32c5995-a9db-4a6f-a512-e398f2810962 req-775a2bf4-b623-4ece-881c-4abf4ae7bd91 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0854211 May 12 15:22:35.274136 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:35.275061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Pushing event updated for resources: {'Port': ['ID=5092ce3e-087b-4123-a2b0-daf2848b42fb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:35.286009 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:35.398553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event updated for resources: {'SecurityGroup': ['ID=054e8268-0c50-4491-b3f6-d836e54d84a8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:35.422325 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5572c93f-ec61-4b13-9fde-8342764df968 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:35.455461 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:35.459266 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-56112f5d-e216-4405-aa00-c528588ab9d6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1743 time: 1.6516268 May 12 15:22:35.464755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35958) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:35.473064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-211442b4-aa74-414c-8303-5938185bebdc tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '054e8268-0c50-4491-b3f6-d836e54d84a8', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:35.480474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-211442b4-aa74-414c-8303-5938185bebdc tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:35.542748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-211442b4-aa74-414c-8303-5938185bebdc tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:35.558644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-211442b4-aa74-414c-8303-5938185bebdc tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:35.573736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-211442b4-aa74-414c-8303-5938185bebdc tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:35.602428 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-211442b4-aa74-414c-8303-5938185bebdc tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:35.820223 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5572c93f-ec61-4b13-9fde-8342764df968 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:35.839851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25bb828e-f0a4-4a62-ae9f-bd1ebd21891b req-6698d6aa-da0f-4a62-8cea-c7fdc09ff939 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:35.841366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25bb828e-f0a4-4a62-ae9f-bd1ebd21891b req-6698d6aa-da0f-4a62-8cea-c7fdc09ff939 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.4757540 May 12 15:22:35.862144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-275c75cf-6dbe-4a5b-aae5-3fc9f0d53cab tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:35.863515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-275c75cf-6dbe-4a5b-aae5-3fc9f0d53cab tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.76 "GET /v2.0/networks?id=670dbecd-f547-4abf-b069-62f0c8712c6b HTTP/1.1" status: 200 len: 822 time: 0.4505689 May 12 15:22:35.869818 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-211442b4-aa74-414c-8303-5938185bebdc tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:35.878979 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-211442b4-aa74-414c-8303-5938185bebdc tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:35.886219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-5572c93f-ec61-4b13-9fde-8342764df968 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5fd35e22-a617-45b1-9db5-23866cd0c735']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:35.900310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Request body: {'port': {'device_id': '5db95aab-1524-4c89-b6a8-c4ac8dbf3751', 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b', 'admin_state_up': True, 'tenant_id': '4789db12ded14c2e8773d2396c9acd32'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:35.917297 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:35.932311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-5572c93f-ec61-4b13-9fde-8342764df968 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b8738567-af05-4709-a836-3104f41f85d6') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:35.932605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-5572c93f-ec61-4b13-9fde-8342764df968 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b8738567-af05-4709-a836-3104f41f85d6') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:35.976749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-211442b4-aa74-414c-8303-5938185bebdc tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fa44dcf5-ed2e-4c0c-9fc3-6484ba4418e4,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:35.988047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba17f86-8b34-4338-9c32-fbae4c25dc65 req-1ee28844-5bde-481a-aaed-2da72e3cad96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:35.989529 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2ba17f86-8b34-4338-9c32-fbae4c25dc65 req-1ee28844-5bde-481a-aaed-2da72e3cad96 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=40852c97262142aeb6d62097955af83f&device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 1097 time: 0.2813566 May 12 15:22:35.992445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-238cc0c5-1916-4741-8c97-2ee8dc0ce9c3 req-5d9b9650-d617-4f0b-abe7-535921e46435 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:35.993927 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-238cc0c5-1916-4741-8c97-2ee8dc0ce9c3 req-5d9b9650-d617-4f0b-abe7-535921e46435 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.4091723 May 12 15:22:36.002479 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-211442b4-aa74-414c-8303-5938185bebdc tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:36.004443 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-211442b4-aa74-414c-8303-5938185bebdc tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5379024 May 12 15:22:36.025107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35968) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:36.037140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-0b5503a6-bbc9-4e2c-8663-365a0ee7a463 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '054e8268-0c50-4491-b3f6-d836e54d84a8', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:36.048708 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5572c93f-ec61-4b13-9fde-8342764df968 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:36.065570 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25bb828e-f0a4-4a62-ae9f-bd1ebd21891b req-e0a2d137-1ce2-4eea-9f43-9b39f3632d79 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2009659 May 12 15:22:36.093247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0b5503a6-bbc9-4e2c-8663-365a0ee7a463 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:36.114460 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5572c93f-ec61-4b13-9fde-8342764df968 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:36.139378 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-238cc0c5-1916-4741-8c97-2ee8dc0ce9c3 req-ecc57e68-a219-44c8-9155-c8e87186e25c tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1277313 May 12 15:22:36.140300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5572c93f-ec61-4b13-9fde-8342764df968 admin admin] Releasing vlan 575 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:22:36.140833 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5572c93f-ec61-4b13-9fde-8342764df968 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: timer() May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:22:36.161591 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:22:36.317892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0b5503a6-bbc9-4e2c-8663-365a0ee7a463 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:36.331657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0b5503a6-bbc9-4e2c-8663-365a0ee7a463 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:36.344315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0b5503a6-bbc9-4e2c-8663-365a0ee7a463 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:36.404957 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0b5503a6-bbc9-4e2c-8663-365a0ee7a463 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:36.417378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:36.450959 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33742275-c9c1-4b56-baa9-399da132171c req-4a2a05e5-01ec-4d1a-87b8-daac62c9c4a7 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 210 time: 0.1182833 May 12 15:22:36.456411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:36.458328 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5572c93f-ec61-4b13-9fde-8342764df968 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:36.485029 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5572c93f-ec61-4b13-9fde-8342764df968 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:36.497676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5572c93f-ec61-4b13-9fde-8342764df968 admin admin] Pushing event deleted for resources: {'Network': ['ID=5fd35e22-a617-45b1-9db5-23866cd0c735,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:36.503817 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5572c93f-ec61-4b13-9fde-8342764df968 admin admin] 10.222.0.82 "DELETE /v2.0/networks/5fd35e22-a617-45b1-9db5-23866cd0c735 HTTP/1.1" status: 204 len: 168 time: 1.3042655 May 12 15:22:36.509718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba17f86-8b34-4338-9c32-fbae4c25dc65 req-0997fd46-c7f3-4e0c-9019-ed892991af9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:36.511427 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2ba17f86-8b34-4338-9c32-fbae4c25dc65 req-0997fd46-c7f3-4e0c-9019-ed892991af9e service neutron] 10.222.0.84 "GET /v2.0/networks?id=2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 200 len: 918 time: 0.5101187 May 12 15:22:36.511569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Made reservation on behalf of 4789db12ded14c2e8773d2396c9acd32 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:22:36.515012 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:36.588699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f09426b0-1326-469f-bc08-15524a0542f4 req-d2950bc9-62de-44ca-be81-65094e030cab tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:36.590065 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f09426b0-1326-469f-bc08-15524a0542f4 req-d2950bc9-62de-44ca-be81-65094e030cab tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 945 time: 0.2516668 May 12 15:22:36.739168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35978) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:36.753009 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2ba17f86-8b34-4338-9c32-fbae4c25dc65 req-673aee25-4b78-4d51-bafa-9e10b5a66676 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0 HTTP/1.1" status: 200 len: 1002 time: 0.2269609 May 12 15:22:36.771491 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f09426b0-1326-469f-bc08-15524a0542f4 req-b3082f1e-18dc-464a-9a04-bb2517b77afc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1688313 May 12 15:22:36.798819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Allocated IP 172.20.0.4 (670dbecd-f547-4abf-b069-62f0c8712c6b/5a24db8d-fb66-4b7f-bf96-50956cb218fd/e5cef5d1-de9a-4a98-991a-e31c8958610d) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:22:36.816426 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bcea093-a707-43f8-86ed-4d6ab8d40bb1 req-104f0636-800d-4592-a42a-5e999d5882ca tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:36.817972 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5bcea093-a707-43f8-86ed-4d6ab8d40bb1 req-104f0636-800d-4592-a42a-5e999d5882ca tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2143271 May 12 15:22:36.831874 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-0b5503a6-bbc9-4e2c-8663-365a0ee7a463 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): There was a conflict when trying to complete your request. May 12 15:22:36.832893 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0b5503a6-bbc9-4e2c-8663-365a0ee7a463 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.8049080 May 12 15:22:36.835925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35982) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:36.847180 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:36.936692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba17f86-8b34-4338-9c32-fbae4c25dc65 req-603754d5-2dd8-4a9f-9e9a-3c220bd7626a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:36.938713 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2ba17f86-8b34-4338-9c32-fbae4c25dc65 req-603754d5-2dd8-4a9f-9e9a-3c220bd7626a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5f6d45f7-b8bc-4313-879f-ee173c0a4148 HTTP/1.1" status: 200 len: 856 time: 0.1679316 May 12 15:22:36.954581 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ee1e7a6-4409-44f2-afb0-799191d92516 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=67102e89b0f44ceb80da8f2ae55a97d3&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2081492 May 12 15:22:36.960643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35986) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:36.977216 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5bcea093-a707-43f8-86ed-4d6ab8d40bb1 req-afa16b7d-f30d-4e07-bf45-a33a5ea7a921 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1421587 May 12 15:22:37.116162 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:37.173635 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6f6f209-2637-4c01-9ded-c9f1c8c36081 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:37.186575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:37.200025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:22:37.225709 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:37.254870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543b5d07-fc4a-4c61-aa5e-950c1b02f767 req-3fd24b98-e44d-4836-8dba-183132ea9a58 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:37.256543 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-543b5d07-fc4a-4c61-aa5e-950c1b02f767 req-3fd24b98-e44d-4836-8dba-183132ea9a58 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.3391933 May 12 15:22:37.261541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba17f86-8b34-4338-9c32-fbae4c25dc65 req-e18f1c78-7467-4547-b75e-9b8aa51b6b9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:37.274102 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2ba17f86-8b34-4338-9c32-fbae4c25dc65 req-e18f1c78-7467-4547-b75e-9b8aa51b6b9e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2d986451-1d91-468d-8a9c-ecc4da7a86bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3160326 May 12 15:22:37.294436 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6f6f209-2637-4c01-9ded-c9f1c8c36081 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:37.370217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:22:37.379193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:22:37.379790 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:37.420257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Router eeca6956-8683-47fc-8d85-20f9d0868c4b is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:22:37.429895 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:37.449835 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-543b5d07-fc4a-4c61-aa5e-950c1b02f767 req-1308ffb0-b6da-4c6b-9823-5665b1e78b44 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1816828 May 12 15:22:37.523639 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=054e8268-0c50-4491-b3f6-d836e54d84a8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:37.563742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:37.564960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:37.566128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:37.567170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:37.567626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:37.568704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:37.569832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:37.569965 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2ba17f86-8b34-4338-9c32-fbae4c25dc65 req-b5220585-509d-4094-9d37-37e75a946459 service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2854147 May 12 15:22:37.570445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:37.571733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:37.575258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:37.575764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:37.576169 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:22:37.614659 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:37.620692 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:37.649271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6f6f209-2637-4c01-9ded-c9f1c8c36081 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:37.658598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:37.659623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e3189ff-eb13-4d53-bb96-0f93c430e9f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:37.667917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:37.671346 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-98dfcaf6-c234-4ba2-9a25-762c24af91f3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "DELETE /v2.0/security-groups/054e8268-0c50-4491-b3f6-d836e54d84a8 HTTP/1.1" status: 204 len: 168 time: 0.8316774 May 12 15:22:37.674469 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:37.680045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36008) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:37.736007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6f6f209-2637-4c01-9ded-c9f1c8c36081 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a1535ad-b137-4862-9e74-feb198d99967,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:37.790783 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6f6f209-2637-4c01-9ded-c9f1c8c36081 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:37.791729 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b6f6f209-2637-4c01-9ded-c9f1c8c36081 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7a1535ad-b137-4862-9e74-feb198d99967 HTTP/1.1" status: 204 len: 168 time: 0.8028796 May 12 15:22:37.801546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11019510-f435-430e-bf22-4a81b58f1c8d req-e97cc3ae-4c23-4fd4-8359-c3e73481e594 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:37.809769 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11019510-f435-430e-bf22-4a81b58f1c8d req-e97cc3ae-4c23-4fd4-8359-c3e73481e594 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 812 time: 0.5393362 May 12 15:22:37.819735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:37.845645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:22:37.847128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Network 670dbecd-f547-4abf-b069-62f0c8712c6b is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:22:37.857507 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e09641e1-d3df-43c5-a600-fd129d541808 None None] Sync routers for ids ['eeca6956-8683-47fc-8d85-20f9d0868c4b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:22:37.867565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:22:37.878747 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e09641e1-d3df-43c5-a600-fd129d541808 None None] Routers {'eeca6956-8683-47fc-8d85-20f9d0868c4b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:22:37.879644 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e09641e1-d3df-43c5-a600-fd129d541808 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:22:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['eeca6956-8683-47fc-8d85-20f9d0868c4b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:37.902745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:22:37.910592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-413e55e0-48b7-4b5a-b01d-f571fc059484 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Synchronizing usage tracker for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:22:37.917434 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2ba17f86-8b34-4338-9c32-fbae4c25dc65 req-ebc6b777-55d2-4467-8387-ac16047e73e4 service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2932632 May 12 15:22:37.918178 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:37.923192 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-123660f1-34e3-4298-bdda-4e97b90186b0 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 5.3469772 May 12 15:22:37.923804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36016) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:37.929151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:37.999089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11019510-f435-430e-bf22-4a81b58f1c8d req-bd3069ba-1c23-4e1a-998b-d7e5d72cb7ab tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/quotas/6357a1184f074ce2a5b5f19b5ce06e85 HTTP/1.1" status: 200 len: 375 time: 0.1880596 May 12 15:22:38.034535 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e09641e1-d3df-43c5-a600-fd129d541808 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:38.048536 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e09641e1-d3df-43c5-a600-fd129d541808 None None] Routers {'eeca6956-8683-47fc-8d85-20f9d0868c4b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:22:38.049219 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e09641e1-d3df-43c5-a600-fd129d541808 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:22:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['eeca6956-8683-47fc-8d85-20f9d0868c4b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:38.071714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Pushing event updated for resources: {'Port': ['ID=e5cef5d1-de9a-4a98-991a-e31c8958610d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:38.132724 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:38.133377 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:38.161053 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e09641e1-d3df-43c5-a600-fd129d541808 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:38.161895 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e09641e1-d3df-43c5-a600-fd129d541808 None None] The sync data for ids ['eeca6956-8683-47fc-8d85-20f9d0868c4b'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:22:38.162625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-450ee252-678c-41aa-a76f-c5525d6aca25 req-a3d64018-0ee3-4e46-b9b6-a138296bfd61 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:38.170830 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-450ee252-678c-41aa-a76f-c5525d6aca25 req-a3d64018-0ee3-4e46-b9b6-a138296bfd61 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.5365200 May 12 15:22:38.189155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-01642822-b61c-4492-94c8-525182a3557f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2928059 May 12 15:22:38.204099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Request body: {'port': {'device_id': '5db95aab-1524-4c89-b6a8-c4ac8dbf3751', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:38.285311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-413e55e0-48b7-4b5a-b01d-f571fc059484 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Unset dirty status for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:22:38.287302 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-413e55e0-48b7-4b5a-b01d-f571fc059484 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.5594864 May 12 15:22:38.294277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36022) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:38.347791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-af364518-4f5a-418a-b464-495c4fb22ffb tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group': {'name': 'tempest-secgroup--471492738'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:38.363160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-af364518-4f5a-418a-b464-495c4fb22ffb tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:38.391927 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-450ee252-678c-41aa-a76f-c5525d6aca25 req-8e341578-bd99-49c6-a01b-9d66e787d129 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2199147 May 12 15:22:38.400504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-af364518-4f5a-418a-b464-495c4fb22ffb tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:38.414359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11019510-f435-430e-bf22-4a81b58f1c8d req-04edfe0d-29d3-488c-9f27-4ff1925f3ef8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&fields=id HTTP/1.1" status: 200 len: 394 time: 0.4143090 May 12 15:22:38.416524 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:38.687301 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af364518-4f5a-418a-b464-495c4fb22ffb tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:38.770116 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:38.792730 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:38.793419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-af364518-4f5a-418a-b464-495c4fb22ffb tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:38.803711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Deleting port 5092ce3e-087b-4123-a2b0-daf2848b42fb {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:22:38.804655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:38.808673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-af364518-4f5a-418a-b464-495c4fb22ffb tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:38.815929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-af364518-4f5a-418a-b464-495c4fb22ffb tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:38.839247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36044) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:38.844891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-af364518-4f5a-418a-b464-495c4fb22ffb tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:38.963288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11019510-f435-430e-bf22-4a81b58f1c8d req-126b2043-a42b-47a1-8464-460eb446e46d service neutron] 10.222.0.82 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5351725 May 12 15:22:38.981414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Request body: {'network': {'name': 'tempest-SecurityGroupsTestJSON-1592922589-network', 'tenant_id': '86574e26b5194d1f92a51749f063fa69'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:38.989593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:38.997345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1486f4a-b768-4138-b9a6-53c172cb507a req-75c2aa3d-5da5-4a09-862e-c8ac9ef0d2d5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:38.998090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f1486f4a-b768-4138-b9a6-53c172cb507a req-75c2aa3d-5da5-4a09-862e-c8ac9ef0d2d5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Synchronizing usage tracker for tenant:4789db12ded14c2e8773d2396c9acd32 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:22:39.002854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Usage tracker for resource:network and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:39.008177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:39.016031 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.023168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:39.149074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Calling delete_port for 5092ce3e-087b-4123-a2b0-daf2848b42fb owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:22:39.176778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Made reservation on behalf of 86574e26b5194d1f92a51749f063fa69 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:22:39.179192 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.194388 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f1486f4a-b768-4138-b9a6-53c172cb507a req-75c2aa3d-5da5-4a09-862e-c8ac9ef0d2d5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Unset dirty status for tenant:4789db12ded14c2e8773d2396c9acd32 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:22:39.195532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f1486f4a-b768-4138-b9a6-53c172cb507a req-75c2aa3d-5da5-4a09-862e-c8ac9ef0d2d5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 931 time: 0.5394318 May 12 15:22:39.204304 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.213568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4a88f583-55ea-4849-8a87-dbc693ed07d0 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:22:39.223949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:39.225809 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af364518-4f5a-418a-b464-495c4fb22ffb tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.230883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Usage tracker for resource:security_group_rule and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:39.236731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:39.245665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:39.259645 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af364518-4f5a-418a-b464-495c4fb22ffb tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.362034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11019510-f435-430e-bf22-4a81b58f1c8d req-859af2d0-3d78-4e3e-9ebc-ffa88540d21b service neutron] 10.222.0.82 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3723547 May 12 15:22:39.384116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f1486f4a-b768-4138-b9a6-53c172cb507a req-a971773b-52e7-43b3-b67c-e4b5a24edbe8 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1753714 May 12 15:22:39.387379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af364518-4f5a-418a-b464-495c4fb22ffb tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event updated for resources: {'SecurityGroup': ['ID=496c6000-c916-407c-9459-ae22dcf36e2e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:39.408562 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.439704 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af364518-4f5a-418a-b464-495c4fb22ffb tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.447947 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-af364518-4f5a-418a-b464-495c4fb22ffb tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 1.1470988 May 12 15:22:39.451201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36052) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:39.459335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:39.471069 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-82d82b92-5d5f-4e41-bc8a-2c2cd602852e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '496c6000-c916-407c-9459-ae22dcf36e2e', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:39.473985 n-d-841483-1 neutron-server[88152]: WARNING neutron.api.v2.base [None req-82d82b92-5d5f-4e41-bc8a-2c2cd602852e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. May 12 15:22:39.474818 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-82d82b92-5d5f-4e41-bc8a-2c2cd602852e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:39.478624 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.479375 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-82d82b92-5d5f-4e41-bc8a-2c2cd602852e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0271666 May 12 15:22:39.483356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36056) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:39.526608 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-82d3cccc-5d60-4036-9d98-30441d523f99'] response: {'server_uuid': '6e3189ff-eb13-4d53-bb96-0f93c430e9f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f', 'code': 200} May 12 15:22:39.576079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4a88f583-55ea-4849-8a87-dbc693ed07d0,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:39.633622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.646893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e5cef5d1-de9a-4a98-991a-e31c8958610d {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:22:39.659343 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.689902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.746777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b0aae945-e0f0-419f-88b0-e0606e730ccb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:39.767365 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48307637-c05a-496a-9fa2-c50a0e321412 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.768989 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.824472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Transition to ACTIVE for port object e5cef5d1-de9a-4a98-991a-e31c8958610d will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:22:39.831219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 566} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:22:39.851217 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.883167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Pushing event deleted for resources: {'Port': ['ID=5092ce3e-087b-4123-a2b0-daf2848b42fb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:39.933354 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48307637-c05a-496a-9fa2-c50a0e321412 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:39.945214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Pushing event updated for resources: {'Port': ['ID=e5cef5d1-de9a-4a98-991a-e31c8958610d,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:40.025113 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:40.094163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:40.094505 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Added segment 2b9a3118-674a-42bd-be1d-3a0efcec85f0 of type vlan for network b50584ea-1073-48d4-a2bc-43b11374a495 May 12 15:22:40.158583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a69df6e1-0d62-456d-9260-f31da6f3cba3 req-5ac62bdf-7961-4444-9778-06770e408496 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:40.160149 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a69df6e1-0d62-456d-9260-f31da6f3cba3 req-5ac62bdf-7961-4444-9778-06770e408496 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.4519291 May 12 15:22:40.168111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e18a880-581f-4394-930c-86966e1c2319 req-c993e60c-f2f3-4636-b338-41adcb40183d tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:40.169642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e18a880-581f-4394-930c-86966e1c2319 req-c993e60c-f2f3-4636-b338-41adcb40183d tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.4968889 May 12 15:22:40.308083 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a69df6e1-0d62-456d-9260-f31da6f3cba3 req-011a0cf8-0a1a-4454-a536-2b04b1abdbad tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1330769 May 12 15:22:40.317736 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e18a880-581f-4394-930c-86966e1c2319 req-c5ae43e0-8627-4c5d-8365-9ef91dbb1c9c tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1345398 May 12 15:22:40.319889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Attempting to bind port e5cef5d1-de9a-4a98-991a-e31c8958610d on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:22:40.320189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Attempting to bind port e5cef5d1-de9a-4a98-991a-e31c8958610d by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'dbf5199c-277c-4a55-97b5-ab215591dbbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:22:40.320511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Attempting to bind port e5cef5d1-de9a-4a98-991a-e31c8958610d on network 670dbecd-f547-4abf-b069-62f0c8712c6b {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:22:40.325540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Port e5cef5d1-de9a-4a98-991a-e31c8958610d on network 670dbecd-f547-4abf-b069-62f0c8712c6b not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:22:40.325861 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Attempting to bind port e5cef5d1-de9a-4a98-991a-e31c8958610d on network 670dbecd-f547-4abf-b069-62f0c8712c6b {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:22:40.341737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 22, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:22:40.342080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Checking segment: {'id': 'dbf5199c-277c-4a55-97b5-ab215591dbbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:22:40.342743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Bound using segment: {'id': 'dbf5199c-277c-4a55-97b5-ab215591dbbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:22:40.343212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Bound port: e5cef5d1-de9a-4a98-991a-e31c8958610d, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dbf5199c-277c-4a55-97b5-ab215591dbbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:22:40.344214 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:40.372079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94aa17a4-106f-4a58-865a-6674dccd8196 req-de6011c1-aa11-4f5c-af57-baa5266efb88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:40.373908 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-94aa17a4-106f-4a58-865a-6674dccd8196 req-de6011c1-aa11-4f5c-af57-baa5266efb88 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 1097 time: 0.8773808 May 12 15:22:40.518625 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:40.560615 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a79f3738-e38d-4c40-ae25-96a269954c05 req-651721f8-f6ee-4193-83f8-e7458fec9bd1 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 210 time: 0.0996637 May 12 15:22:40.585926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] For port e5cef5d1-de9a-4a98-991a-e31c8958610d, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:22:40.606022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] For port e5cef5d1-de9a-4a98-991a-e31c8958610d, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e5cef5d1-de9a-4a98-991a-e31c8958610d,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:22:40.610711 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48307637-c05a-496a-9fa2-c50a0e321412 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:40.620061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:40.651858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48307637-c05a-496a-9fa2-c50a0e321412 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=496c6000-c916-407c-9459-ae22dcf36e2e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:40.654663 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-94aa17a4-106f-4a58-865a-6674dccd8196 req-42c3c792-573e-4d0a-962f-76b573bc35ce service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2261510 May 12 15:22:40.718119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c854fe-5e01-46b7-8cb3-8755a09b938a req-2c748202-d16b-4abf-b3f3-c2ca82bec05c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:40.720281 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-40c854fe-5e01-46b7-8cb3-8755a09b938a req-2c748202-d16b-4abf-b3f3-c2ca82bec05c service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 1097 time: 1.0711956 May 12 15:22:40.740058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4abff076-2a20-4682-a84e-d9579ba8d1e1 req-209c2ebd-71ee-4f0c-8c0c-0876cd762c0d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:40.741580 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4abff076-2a20-4682-a84e-d9579ba8d1e1 req-209c2ebd-71ee-4f0c-8c0c-0876cd762c0d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 944 time: 0.2455709 May 12 15:22:40.783570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:40.784052 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:40.785417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] 10.222.0.76 "PUT /v2.0/ports/e5cef5d1-de9a-4a98-991a-e31c8958610d HTTP/1.1" status: 200 len: 1091 time: 2.5885887 May 12 15:22:40.790723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5db95aab-1524-4c89-b6a8-c4ac8dbf3751', 'tag': 'e5cef5d1-de9a-4a98-991a-e31c8958610d'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:40.825187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79b56e42-0e83-4cf5-96a5-cabdbde6825c service neutron] Pushing event updated for resources: {'Port': ['ID=e5cef5d1-de9a-4a98-991a-e31c8958610d,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:40.831124 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:40.833529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:40.834463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:40.835031 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:40.850561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4abff076-2a20-4682-a84e-d9579ba8d1e1 req-5b75dacc-051e-471f-9053-9da8ef6411e3 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0992732 May 12 15:22:40.891212 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:40.920261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6303f677-4c35-4532-8cc0-a0dfaacb3394 req-7878b835-517c-4b8e-b290-bf99a2112151 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:40.923463 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6303f677-4c35-4532-8cc0-a0dfaacb3394 req-7878b835-517c-4b8e-b290-bf99a2112151 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 943 time: 0.2589641 May 12 15:22:40.926878 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2896911c-9885-414b-8c18-af47bbfce335'] response: {'name': 'network-changed', 'server_uuid': '5db95aab-1524-4c89-b6a8-c4ac8dbf3751', 'tag': 'e5cef5d1-de9a-4a98-991a-e31c8958610d', 'status': 'completed', 'code': 200} May 12 15:22:41.036256 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-40c854fe-5e01-46b7-8cb3-8755a09b938a req-49508b76-31ba-4ac1-a60b-0fedc7cc00e8 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2561166 May 12 15:22:41.055199 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48307637-c05a-496a-9fa2-c50a0e321412 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:41.057576 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-48307637-c05a-496a-9fa2-c50a0e321412 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "DELETE /v2.0/security-groups/496c6000-c916-407c-9459-ae22dcf36e2e HTTP/1.1" status: 204 len: 168 time: 1.5698304 May 12 15:22:41.112949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36080) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:41.114546 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 2.2749555 May 12 15:22:41.117091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-483546a6-481d-4227-b00c-9db239dae29f admin admin] Pushing event updated for resources: {'Network': ['ID=b50584ea-1073-48d4-a2bc-43b11374a495,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:41.128122 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36086) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:41.131676 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network b50584ea-1073-48d4-a2bc-43b11374a495 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:22:41.148322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Request body: {'subnet': {'network_id': 'b50584ea-1073-48d4-a2bc-43b11374a495', 'cidr': '172.20.0.0/28', 'name': 'tempest-SecurityGroupsTestJSON-1592922589-subnet', 'tenant_id': '86574e26b5194d1f92a51749f063fa69', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:41.161465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:41.173424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Usage tracker for resource:subnet and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:41.177488 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6303f677-4c35-4532-8cc0-a0dfaacb3394 req-a84283f9-87b0-4808-9799-24342726c8e6 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2164779 May 12 15:22:41.184001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Router eeca6956-8683-47fc-8d85-20f9d0868c4b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:22:41.185092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:41.198716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-92d28a3b-5af5-4974-8912-91eb4d4cdbf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:41.200410 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-92d28a3b-5af5-4974-8912-91eb4d4cdbf0 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=4789db12ded14c2e8773d2396c9acd32&device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 1094 time: 0.2760611 May 12 15:22:41.201689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:41.229525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-535ab63c-d11c-43da-87de-18d9af3a86de tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Synchronizing usage tracker for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:22:41.303317 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-e5a6595f-de18-48da-8cca-2418490d40b8 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e5cef5d1-de9a-4a98-991a-e31c8958610d HTTP/1.1" status: 200 len: 217 time: 0.0915899 May 12 15:22:41.313754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Made reservation on behalf of 86574e26b5194d1f92a51749f063fa69 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:22:41.316453 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:41.399390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-cfc3ae92-946c-4066-881c-000a7dd4f8fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:41.401031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-cfc3ae92-946c-4066-881c-000a7dd4f8fe service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5a24db8d-fb66-4b7f-bf96-50956cb218fd HTTP/1.1" status: 200 len: 862 time: 0.0914607 May 12 15:22:41.415579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-535ab63c-d11c-43da-87de-18d9af3a86de tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Unset dirty status for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:22:41.420336 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-535ab63c-d11c-43da-87de-18d9af3a86de tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.3009713 May 12 15:22:41.447211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36098) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:41.459530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-024b61cb-6b34-457c-933b-edcb5e4b7295 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group': {'name': 'tempest-secgroup--1126219713'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:41.465466 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-b17bc43d-a485-4f35-afb3-d9c9aebf27b1 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=670dbecd-f547-4abf-b069-62f0c8712c6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0576262 May 12 15:22:41.504377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-024b61cb-6b34-457c-933b-edcb5e4b7295 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:41.508275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:22:41.516539 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:41.520784 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6fc07129-1f2e-48b1-9228-32c51c404892 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "PUT /v2.0/routers/eeca6956-8683-47fc-8d85-20f9d0868c4b HTTP/1.1" status: 200 len: 705 time: 3.5937333 May 12 15:22:41.522072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36102) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:41.523368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f82c976d-1f49-4835-9fc9-2eb594b0b973 None None] Sync routers for ids ['eeca6956-8683-47fc-8d85-20f9d0868c4b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:22:41.527790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:41.542583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f82c976d-1f49-4835-9fc9-2eb594b0b973 None None] Routers {'eeca6956-8683-47fc-8d85-20f9d0868c4b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:22:41.543307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f82c976d-1f49-4835-9fc9-2eb594b0b973 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:22:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['eeca6956-8683-47fc-8d85-20f9d0868c4b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:41.666283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-024b61cb-6b34-457c-933b-edcb5e4b7295 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:41.674292 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ad1680c-b34e-495f-8281-c4cd9f86b353 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/routers/eeca6956-8683-47fc-8d85-20f9d0868c4b HTTP/1.1" status: 200 len: 740 time: 0.1511195 May 12 15:22:41.678274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36112) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:41.713685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f82c976d-1f49-4835-9fc9-2eb594b0b973 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:41.724625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f82c976d-1f49-4835-9fc9-2eb594b0b973 None None] Routers {'eeca6956-8683-47fc-8d85-20f9d0868c4b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:22:41.725584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f82c976d-1f49-4835-9fc9-2eb594b0b973 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:22:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['eeca6956-8683-47fc-8d85-20f9d0868c4b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:41.741141 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0c359687-64d9-483d-a674-2f343bcb70e1 tempest-RoutersAdminTest-1194955050 tempest-RoutersAdminTest-1194955050-project-admin] 10.222.0.82 "GET /v2.0/ports?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&device_id=eeca6956-8683-47fc-8d85-20f9d0868c4b HTTP/1.1" status: 200 len: 205 time: 0.0617621 May 12 15:22:41.741834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36116) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:41.751058 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-024b61cb-6b34-457c-933b-edcb5e4b7295 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:41.804494 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cb5c09f3-c076-4567-a343-fdb6c49e9e33 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "GET /v2.0/ports?device_id=eeca6956-8683-47fc-8d85-20f9d0868c4b HTTP/1.1" status: 200 len: 205 time: 0.0576606 May 12 15:22:41.807509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36120) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:41.839342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f82c976d-1f49-4835-9fc9-2eb594b0b973 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:22:41.839930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f82c976d-1f49-4835-9fc9-2eb594b0b973 None None] The sync data for ids ['eeca6956-8683-47fc-8d85-20f9d0868c4b'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:22:41.859458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-024b61cb-6b34-457c-933b-edcb5e4b7295 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:41.869541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-024b61cb-6b34-457c-933b-edcb5e4b7295 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:41.880715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33f82c57-7087-4190-9516-6f14c49ff76c req-28a12d82-7758-4db7-a28d-f6f6e88066ad tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:41.882574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33f82c57-7087-4190-9516-6f14c49ff76c req-28a12d82-7758-4db7-a28d-f6f6e88066ad tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.4269845 May 12 15:22:41.884467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-024b61cb-6b34-457c-933b-edcb5e4b7295 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:41.907400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-024b61cb-6b34-457c-933b-edcb5e4b7295 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:41.948731 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-4c444ec8-f4a7-419a-83f7-ee2cd4c9f327 service neutron] 10.222.0.76 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4456606 May 12 15:22:42.100352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33f82c57-7087-4190-9516-6f14c49ff76c req-69bd8e41-ae10-49b0-846f-a4acb6079640 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1951144 May 12 15:22:42.147995 n-d-841483-1 neutron-server[88153]: WARNING neutron.notifiers.nova [-] Nova event matching ['req-89c1fceb-18c9-4348-aa38-4cd4c0a794d0']: {'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'code': 422} returned with failed status May 12 15:22:42.162977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e75e9b4-ef85-440e-b1be-6f6f6e286652 req-512637ac-99a8-4eb3-b5ad-0ed855226327 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:42.164455 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e75e9b4-ef85-440e-b1be-6f6f6e286652 req-512637ac-99a8-4eb3-b5ad-0ed855226327 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.3708191 May 12 15:22:42.183017 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-024b61cb-6b34-457c-933b-edcb5e4b7295 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:42.204315 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-625447e2-33ef-4c0a-9ceb-e4bc563eb70e tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:42.210964 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-024b61cb-6b34-457c-933b-edcb5e4b7295 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:42.257603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6abff3b5-80f9-4383-9cd0-43abecd4e6db req-5c486340-6beb-4c0d-b957-716eb1c3a4de service neutron] 10.222.0.76 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3007643 May 12 15:22:42.378536 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-82a45587-a366-48ef-bba7-89c5009cdb6a req-15d57a3c-bc28-43cf-bec7-53419f3fb2fc tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 210 time: 0.1196344 May 12 15:22:42.419880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-024b61cb-6b34-457c-933b-edcb5e4b7295 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f0bb139f-6128-4636-9720-21c1572ecc30,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:42.439876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e75e9b4-ef85-440e-b1be-6f6f6e286652 req-ebb5a2a8-0590-487a-9df4-0917a7110065 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2610643 May 12 15:22:42.440591 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-024b61cb-6b34-457c-933b-edcb5e4b7295 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:42.441704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-024b61cb-6b34-457c-933b-edcb5e4b7295 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 0.9933670 May 12 15:22:42.447551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36130) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:42.456993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-12878763-17a3-43cf-b1c0-748fc4b30ce0 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': 'f0bb139f-6128-4636-9720-21c1572ecc30', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:42.457994 n-d-841483-1 neutron-server[88152]: WARNING neutron.api.v2.base [None req-12878763-17a3-43cf-b1c0-748fc4b30ce0 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. May 12 15:22:42.458696 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-12878763-17a3-43cf-b1c0-748fc4b30ce0 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:42.459656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-12878763-17a3-43cf-b1c0-748fc4b30ce0 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0108571 May 12 15:22:42.462544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36134) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:42.564053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43336b42-30d9-4725-a1e6-066eef7890bb req-875fdeea-a7aa-422f-84e0-b151e0b2c441 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:42.565742 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43336b42-30d9-4725-a1e6-066eef7890bb req-875fdeea-a7aa-422f-84e0-b151e0b2c441 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=4789db12ded14c2e8773d2396c9acd32&device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 1094 time: 0.1943641 May 12 15:22:42.566658 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8265d715-d91f-4180-9e0b-8cac89ba4c00 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:42.633150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11019510-f435-430e-bf22-4a81b58f1c8d req-10ede986-b6f8-4c42-af45-ee62e303bceb tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:42.634614 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-11019510-f435-430e-bf22-4a81b58f1c8d req-10ede986-b6f8-4c42-af45-ee62e303bceb tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 812 time: 0.8279197 May 12 15:22:42.638500 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-625447e2-33ef-4c0a-9ceb-e4bc563eb70e tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:42.646431 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-625447e2-33ef-4c0a-9ceb-e4bc563eb70e tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:42.680846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Request body: {'port': {'device_id': '7e3b9823-cd1e-48ee-8ba8-507d787c43bb', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'admin_state_up': True, 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:42.683277 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e1e1aec1-efc0-494f-ad7a-ad7a18cf5f9d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:42.777525 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-625447e2-33ef-4c0a-9ceb-e4bc563eb70e tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:42.778079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-625447e2-33ef-4c0a-9ceb-e4bc563eb70e tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Fanout notify agent at l3_agent the message router_deleted on router eeca6956-8683-47fc-8d85-20f9d0868c4b {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:22:42.786942 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8265d715-d91f-4180-9e0b-8cac89ba4c00 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:42.799138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:42.850729 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:42.885171 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-625447e2-33ef-4c0a-9ceb-e4bc563eb70e tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:42.890432 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-625447e2-33ef-4c0a-9ceb-e4bc563eb70e tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "DELETE /v2.0/routers/eeca6956-8683-47fc-8d85-20f9d0868c4b HTTP/1.1" status: 204 len: 168 time: 1.0819340 May 12 15:22:42.893203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36146) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:42.905547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Pushing event updated for resources: {'Subnet': ['ID=92a8d5fe-fb2b-414d-9ae2-15fb02337cd9,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:42.955680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43336b42-30d9-4725-a1e6-066eef7890bb req-f0d79264-5613-4f70-95ef-e4cba939d8bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:42.957210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43336b42-30d9-4725-a1e6-066eef7890bb req-f0d79264-5613-4f70-95ef-e4cba939d8bb service neutron] 10.222.0.76 "GET /v2.0/networks?id=670dbecd-f547-4abf-b069-62f0c8712c6b HTTP/1.1" status: 200 len: 923 time: 0.3522193 May 12 15:22:42.959902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Checking segment: {'id': '2b9a3118-674a-42bd-be1d-3a0efcec85f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'b50584ea-1073-48d4-a2bc-43b11374a495'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:22:42.960325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Network hostable DHCP agents. Network: b50584ea-1073-48d4-a2bc-43b11374a495, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:22:42.964435 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8265d715-d91f-4180-9e0b-8cac89ba4c00 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:42.978249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:42.985265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Usage tracker for resource:port and tenant:6357a1184f074ce2a5b5f19b5ce06e85 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:42.987331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-83cc17a3-9d1d-4e79-9348-abf7acdefe63 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "GET /v2.0/ports?device_id=eeca6956-8683-47fc-8d85-20f9d0868c4b HTTP/1.1" status: 200 len: 205 time: 0.0878863 May 12 15:22:42.988106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36154) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:42.992354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Quota usage for port was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:43.061426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:43.062815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0711602-afe8-49b4-8d7b-8b7169c5b311 req-3dbf447e-239a-45c5-900f-5bfc54156a72 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:43.064500 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0711602-afe8-49b4-8d7b-8b7169c5b311 req-3dbf447e-239a-45c5-900f-5bfc54156a72 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 943 time: 0.5039392 May 12 15:22:43.073654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Network b50584ea-1073-48d4-a2bc-43b11374a495 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:22:43.075109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8265d715-d91f-4180-9e0b-8cac89ba4c00 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f0bb139f-6128-4636-9720-21c1572ecc30,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:43.081057 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43336b42-30d9-4725-a1e6-066eef7890bb req-71d238a1-7123-49ad-913d-42c416d48f65 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e5cef5d1-de9a-4a98-991a-e31c8958610d HTTP/1.1" status: 200 len: 217 time: 0.1111443 May 12 15:22:43.087249 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-195d1ee7-a81f-474f-9c13-31b60de19453 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] delete failed (client error): The resource could not be found. May 12 15:22:43.091818 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-195d1ee7-a81f-474f-9c13-31b60de19453 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "DELETE /v2.0/routers/eeca6956-8683-47fc-8d85-20f9d0868c4b HTTP/1.1" status: 404 len: 336 time: 0.1021516 May 12 15:22:43.092807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36160) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:43.107375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-838cb29c-defb-466a-8ab5-bbf24bfc3584 req-446bbabe-2ef4-4366-a14d-b45144ea23e4 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:43.108892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-838cb29c-defb-466a-8ab5-bbf24bfc3584 req-446bbabe-2ef4-4366-a14d-b45144ea23e4 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 944 time: 0.3712506 May 12 15:22:43.151468 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8265d715-d91f-4180-9e0b-8cac89ba4c00 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:43.152538 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8265d715-d91f-4180-9e0b-8cac89ba4c00 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "DELETE /v2.0/security-groups/f0bb139f-6128-4636-9720-21c1572ecc30 HTTP/1.1" status: 204 len: 168 time: 0.6890275 May 12 15:22:43.175880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36166) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:43.181095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, b50584ea-1073-48d4-a2bc-43b11374a495) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:22:43.182692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Made reservation on behalf of 6357a1184f074ce2a5b5f19b5ce06e85 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:22:43.186229 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:43.192132 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40336141-8041-4a22-b329-512e2f7194b1 None None] Network b50584ea-1073-48d4-a2bc-43b11374a495 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:22:43.206250 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f90e00ff-5aa8-4f74-b82d-ae0aef31b6b8 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d850e53-8c48-48c4-9bc4-a417d87aa7c2 HTTP/1.1" status: 200 len: 205 time: 0.1097391 May 12 15:22:43.208023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:43.208697 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:43.216808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36170) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:43.313011 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4a88f583-55ea-4849-8a87-dbc693ed07d0 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:22:43.332325 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-90dbc48d-e9b1-41fc-b692-5f2bd94f29ff admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 2.2031603 May 12 15:22:43.364869 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5381d606-b5a7-4733-8466-2fa52fc242ad service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.3126998 May 12 15:22:43.459692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43336b42-30d9-4725-a1e6-066eef7890bb req-eefa4a1e-d137-4663-be8c-a36b7752e6b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:43.461133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43336b42-30d9-4725-a1e6-066eef7890bb req-eefa4a1e-d137-4663-be8c-a36b7752e6b5 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5a24db8d-fb66-4b7f-bf96-50956cb218fd HTTP/1.1" status: 200 len: 862 time: 0.3478107 May 12 15:22:43.463469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Allocated IP 172.20.0.13 (de9b95bc-97c4-4188-a1d0-c125f35032b0/f6980e11-e336-4f1d-9b2b-4462912e9abb/7e0c7266-ad09-4620-bfdc-81de7da01d15) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:22:43.476394 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0711602-afe8-49b4-8d7b-8b7169c5b311 req-7fa25d16-fdfd-443c-85f5-82027f9f5518 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3968661 May 12 15:22:43.531924 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-53a85b05-2249-4bce-bf95-7f1e1041ec63 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] delete failed (client error): The resource could not be found. May 12 15:22:43.535503 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-53a85b05-2249-4bce-bf95-7f1e1041ec63 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "DELETE /v2.0/routers/2d850e53-8c48-48c4-9bc4-a417d87aa7c2 HTTP/1.1" status: 404 len: 336 time: 0.3108330 May 12 15:22:43.535953 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-838cb29c-defb-466a-8ab5-bbf24bfc3584 req-ec86e05b-c50e-4809-96ca-5bdec52e4d03 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3882580 May 12 15:22:43.543095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36182) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:43.629325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43336b42-30d9-4725-a1e6-066eef7890bb req-09caabca-8b45-4427-81d3-d71d27ca77b7 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=670dbecd-f547-4abf-b069-62f0c8712c6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1468644 May 12 15:22:43.652412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-63ef7661-ec96-411f-9279-221c7d0ffdd1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Synchronizing usage tracker for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:22:43.693230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6919fede-5255-4b4b-9430-5255bc28640b tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "GET /v2.0/ports?device_id=5cedf3d2-1819-451e-9a53-b2e919095fe0 HTTP/1.1" status: 200 len: 205 time: 0.1437485 May 12 15:22:43.704236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36192) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:43.803350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1912d863-20e3-461e-8cda-ba65678764f0 None None] Network b50584ea-1073-48d4-a2bc-43b11374a495 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:22:43.950033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1d8e68e-26dc-491e-9400-86664f567e38 req-c732ce0e-57a4-49cf-be13-ab736eb358bd tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 210 time: 0.1486723 May 12 15:22:43.950588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-63ef7661-ec96-411f-9279-221c7d0ffdd1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Unset dirty status for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:22:43.951753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-63ef7661-ec96-411f-9279-221c7d0ffdd1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.7749469 May 12 15:22:43.957414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36196) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:43.961687 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-e19660e4-36b8-4b22-95bb-416ce2a1f87c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] delete failed (client error): The resource could not be found. May 12 15:22:43.965181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e19660e4-36b8-4b22-95bb-416ce2a1f87c tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "DELETE /v2.0/routers/5cedf3d2-1819-451e-9a53-b2e919095fe0 HTTP/1.1" status: 404 len: 336 time: 0.1631711 May 12 15:22:43.967720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36200) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:44.029891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-99f11989-8984-4f3b-b085-f6dccd294f3c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group': {'name': 'tempest-secgroup--1970563488'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:44.046802 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:44.050454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-99f11989-8984-4f3b-b085-f6dccd294f3c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:44.065967 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0fb7a0a6-d052-49c2-8e79-586e8713b102 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "GET /v2.0/ports?device_id=5aff139c-1195-4f11-9450-493179af890f HTTP/1.1" status: 200 len: 205 time: 0.0817370 May 12 15:22:44.074370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36204) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:44.084551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-99f11989-8984-4f3b-b085-f6dccd294f3c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:44.145303 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43336b42-30d9-4725-a1e6-066eef7890bb req-0a59b70c-714d-4b14-8823-dd14049cbe3a service neutron] 10.222.0.76 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4962902 May 12 15:22:44.159946 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-da6c740b-d66e-4aec-9dcf-8fd5fb4611d7 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] delete failed (client error): The resource could not be found. May 12 15:22:44.160280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a238b17d-029b-46a5-90ce-8b9493d5ee25 req-45793956-855b-4fde-b63b-3ec6d8d463f0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:44.160945 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-da6c740b-d66e-4aec-9dcf-8fd5fb4611d7 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "DELETE /v2.0/routers/5aff139c-1195-4f11-9450-493179af890f HTTP/1.1" status: 404 len: 336 time: 0.0856767 May 12 15:22:44.165851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36208) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:44.166802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Transition to ACTIVE for port object 7e0c7266-ad09-4620-bfdc-81de7da01d15 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:22:44.169707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a238b17d-029b-46a5-90ce-8b9493d5ee25 req-45793956-855b-4fde-b63b-3ec6d8d463f0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.4802971 May 12 15:22:44.219514 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7c1afa08-3801-447e-a8f6-a5d5eb001582 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "GET /v2.0/ports?device_id=252b9228-6855-4c38-8dc5-a270efa179ff HTTP/1.1" status: 200 len: 205 time: 0.0511396 May 12 15:22:44.220461 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-99f11989-8984-4f3b-b085-f6dccd294f3c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:44.239661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36212) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:44.244273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-99f11989-8984-4f3b-b085-f6dccd294f3c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:44.248076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-99f11989-8984-4f3b-b085-f6dccd294f3c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:44.251490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-99f11989-8984-4f3b-b085-f6dccd294f3c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:44.257118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-99f11989-8984-4f3b-b085-f6dccd294f3c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:44.329515 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-99f11989-8984-4f3b-b085-f6dccd294f3c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:44.331709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a238b17d-029b-46a5-90ce-8b9493d5ee25 req-b53f268f-c369-431b-8b25-b1dccdd471de tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1608968 May 12 15:22:44.369520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57750adf-3b12-44e6-a8f8-762383eda67d req-fe9e77cd-c59b-4d99-9c45-ab72d05cf09b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:44.377704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57750adf-3b12-44e6-a8f8-762383eda67d req-fe9e77cd-c59b-4d99-9c45-ab72d05cf09b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.2972293 May 12 15:22:44.441989 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-99f11989-8984-4f3b-b085-f6dccd294f3c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:44.443522 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43336b42-30d9-4725-a1e6-066eef7890bb req-36f1b5be-87ba-43db-b5c9-f35a1ae8fe6e service neutron] 10.222.0.76 "GET /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2708349 May 12 15:22:44.456523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-acaaa1be-a1a5-4347-9c32-2d2f4ed69b71 req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-876196712', 'description': 'tempest-description-151769209'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:44.462582 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-e26e68c0-c53b-4d86-b81b-4e8cacae9ebe tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] delete failed (client error): The resource could not be found. May 12 15:22:44.466448 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36220) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:44.466942 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e26e68c0-c53b-4d86-b81b-4e8cacae9ebe tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "DELETE /v2.0/routers/252b9228-6855-4c38-8dc5-a270efa179ff HTTP/1.1" status: 404 len: 336 time: 0.1359973 May 12 15:22:44.472864 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:44.482182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57750adf-3b12-44e6-a8f8-762383eda67d req-76838bd5-0618-4687-a9c0-692a3e18f699 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1026764 May 12 15:22:44.482914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-acaaa1be-a1a5-4347-9c32-2d2f4ed69b71 req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:44.550802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5cef3f2b-feb4-4a5e-afdd-6fcbae8d8204 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "GET /v2.0/ports?device_id=c18d2ea9-5bea-4046-a11f-4e95d84a3b8d HTTP/1.1" status: 200 len: 205 time: 0.0830989 May 12 15:22:44.552369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-acaaa1be-a1a5-4347-9c32-2d2f4ed69b71 req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:44.555324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36228) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:44.566261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e5cef5d1-de9a-4a98-991a-e31c8958610d details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:22:44.616932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event updated for resources: {'Port': ['ID=7e0c7266-ad09-4620-bfdc-81de7da01d15,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:44.651269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-acaaa1be-a1a5-4347-9c32-2d2f4ed69b71 req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:44.654711 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-43d3ff40-6aa3-45f5-9856-e8d6bd642b31 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] delete failed (client error): The resource could not be found. May 12 15:22:44.659011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-43d3ff40-6aa3-45f5-9856-e8d6bd642b31 tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "DELETE /v2.0/routers/c18d2ea9-5bea-4046-a11f-4e95d84a3b8d HTTP/1.1" status: 404 len: 336 time: 0.0994182 May 12 15:22:44.660043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36236) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:44.662885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-acaaa1be-a1a5-4347-9c32-2d2f4ed69b71 req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:44.672437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Network de9b95bc-97c4-4188-a1d0-c125f35032b0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:22:44.680118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:22:44.698596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:22:44.720806 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-929e09c1-be74-4326-a703-f74bb459e93e tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] DELETE failed (client error): The resource could not be found. May 12 15:22:44.721300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-929e09c1-be74-4326-a703-f74bb459e93e tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:22:44.725430 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-929e09c1-be74-4326-a703-f74bb459e93e tempest-RoutersAdminTest-1049680539 tempest-RoutersAdminTest-1049680539-project] 10.222.0.82 "DELETE /v2.0/subnets/86aa37d6-735f-4645-b451-24e9708aabe6 HTTP/1.1" status: 404 len: 337 time: 0.0622487 May 12 15:22:44.736600 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-acaaa1be-a1a5-4347-9c32-2d2f4ed69b71 req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:44.771389 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99f11989-8984-4f3b-b085-f6dccd294f3c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event updated for resources: {'SecurityGroup': ['ID=abbae0c8-87fc-4661-8d8d-b3cf8f6eb365,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:44.781989 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-99f11989-8984-4f3b-b085-f6dccd294f3c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:44.781989 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-99f11989-8984-4f3b-b085-f6dccd294f3c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 0.8199875 May 12 15:22:44.795713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36242) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:44.824950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3ad5bfe0-8e27-40f7-8c10-3654f24cbfd9 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': 'abbae0c8-87fc-4661-8d8d-b3cf8f6eb365', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:44.839816 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-3ad5bfe0-8e27-40f7-8c10-3654f24cbfd9 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. May 12 15:22:44.840771 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-3ad5bfe0-8e27-40f7-8c10-3654f24cbfd9 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:44.841287 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9cd8b745-2494-4010-9594-4ccebc581277 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:44.845547 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3ad5bfe0-8e27-40f7-8c10-3654f24cbfd9 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0457673 May 12 15:22:44.852643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36248) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:44.853068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-acaaa1be-a1a5-4347-9c32-2d2f4ed69b71 req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:44.860906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-122eeb4f-325b-4673-9c82-6503acb735b5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': 'abbae0c8-87fc-4661-8d8d-b3cf8f6eb365', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:44.861637 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-122eeb4f-325b-4673-9c82-6503acb735b5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. May 12 15:22:44.862120 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-122eeb4f-325b-4673-9c82-6503acb735b5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:44.866060 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-122eeb4f-325b-4673-9c82-6503acb735b5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0094199 May 12 15:22:44.871074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36252) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:44.874890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-acaaa1be-a1a5-4347-9c32-2d2f4ed69b71 req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group_rule and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:44.889688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-67e99da9-5153-45ff-8535-2e5ac138b731 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': 'abbae0c8-87fc-4661-8d8d-b3cf8f6eb365', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:44.890784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-acaaa1be-a1a5-4347-9c32-2d2f4ed69b71 req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:44.891095 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-67e99da9-5153-45ff-8535-2e5ac138b731 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. May 12 15:22:44.891605 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-67e99da9-5153-45ff-8535-2e5ac138b731 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:44.896609 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-67e99da9-5153-45ff-8535-2e5ac138b731 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0164962 May 12 15:22:44.900769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36256) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:44.906800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-acaaa1be-a1a5-4347-9c32-2d2f4ed69b71 req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:44.915958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e5cef5d1-de9a-4a98-991a-e31c8958610d, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e5cef5d1-de9a-4a98-991a-e31c8958610d,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:44.922866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3678454c-d288-4ed7-94a5-92898d583ff2 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': 'abbae0c8-87fc-4661-8d8d-b3cf8f6eb365', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '256'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:44.925009 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-3678454c-d288-4ed7-94a5-92898d583ff2 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. May 12 15:22:44.925319 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-3678454c-d288-4ed7-94a5-92898d583ff2 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:44.926412 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3678454c-d288-4ed7-94a5-92898d583ff2 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0246973 May 12 15:22:44.930370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36260) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:44.936316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:44.938682 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:44.978073 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'e5cef5d1-de9a-4a98-991a-e31c8958610d', 'network_id': '670dbecd-f547-4abf-b069-62f0c8712c6b', 'port_id': 'e5cef5d1-de9a-4a98-991a-e31c8958610d', 'mac_address': 'fa:16:3e:d6:db:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 589, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5a24db8d-fb66-4b7f-bf96-50956cb218fd', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:22:44.992888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbbd419a-f0bd-4966-8de7-8efc340975e8 req-8eddd611-d471-431c-b55e-c9c6edc4a089 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:44.995890 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbbd419a-f0bd-4966-8de7-8efc340975e8 req-8eddd611-d471-431c-b55e-c9c6edc4a089 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 943 time: 0.2409344 May 12 15:22:45.025181 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-11019510-f435-430e-bf22-4a81b58f1c8d req-ed4275a8-ad72-48ff-b338-cca9dc870f1c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.3552101 May 12 15:22:45.035034 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-946a3a13-5e98-4995-a087-829e240c4483 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:45.053041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Request body: {'port': {'device_id': '7e3b9823-cd1e-48ee-8ba8-507d787c43bb', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:45.103429 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:45.116888 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-acaaa1be-a1a5-4347-9c32-2d2f4ed69b71 req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:45.118747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c3aca1b2-b613-4d54-b66a-1065612daff0 None None] Provisioning for port 7e0c7266-ad09-4620-bfdc-81de7da01d15 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:22:45.128963 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-acaaa1be-a1a5-4347-9c32-2d2f4ed69b71 req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:45.133064 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-946a3a13-5e98-4995-a087-829e240c4483 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:45.135643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e5cef5d1-de9a-4a98-991a-e31c8958610d {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:22:45.140828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c3aca1b2-b613-4d54-b66a-1065612daff0 None None] Provisioning complete for port 7e0c7266-ad09-4620-bfdc-81de7da01d15 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:22:45.141446 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3aca1b2-b613-4d54-b66a-1065612daff0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:45.165941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbbd419a-f0bd-4966-8de7-8efc340975e8 req-6d6f42c7-1472-4234-bdb4-578930f37867 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1041362 May 12 15:22:45.172528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36268) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:45.242210 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-acaaa1be-a1a5-4347-9c32-2d2f4ed69b71 req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:45.246254 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acaaa1be-a1a5-4347-9c32-2d2f4ed69b71 req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1806 time: 0.8095019 May 12 15:22:45.259419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60496e91-45d1-41cd-8f90-5c946e6a65aa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5f153cae-50a1-4084-94aa-1b5bb113ef0a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:45.275468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e5cef5d1-de9a-4a98-991a-e31c8958610d, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e5cef5d1-de9a-4a98-991a-e31c8958610d,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:45.285281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c3aca1b2-b613-4d54-b66a-1065612daff0 None None] Port 7e0c7266-ad09-4620-bfdc-81de7da01d15 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:22:45.291364 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:45.298759 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:45.400663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=e5cef5d1-de9a-4a98-991a-e31c8958610d,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:45.425603 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-946a3a13-5e98-4995-a087-829e240c4483 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:45.508563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['e5cef5d1-de9a-4a98-991a-e31c8958610d'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:22:45.548453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-c32864ed-b06f-44b3-b9dd-94b9bff0b75b tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:45.555174 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-c32864ed-b06f-44b3-b9dd-94b9bff0b75b tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/networks?id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61 HTTP/1.1" status: 200 len: 813 time: 0.2731490 May 12 15:22:45.628626 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-68684380-0c26-4f7f-8360-8e4aff80f56c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/quotas/4e5a10df576841e2a4752a9d47fb790a HTTP/1.1" status: 200 len: 375 time: 0.0724332 May 12 15:22:45.636137 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-14a4b749-ed0c-407f-9a43-5e4eb504cfdd admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:45.710690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-14a4b749-ed0c-407f-9a43-5e4eb504cfdd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:45.714649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-14a4b749-ed0c-407f-9a43-5e4eb504cfdd admin admin] Usage tracker for resource:security_group_rule and tenant:e87ae982708240299f16d4cfc5f73d5d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:45.717555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-14a4b749-ed0c-407f-9a43-5e4eb504cfdd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:45.718899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-946a3a13-5e98-4995-a087-829e240c4483 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=abbae0c8-87fc-4661-8d8d-b3cf8f6eb365,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:45.725138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-946a3a13-5e98-4995-a087-829e240c4483 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:45.726365 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-946a3a13-5e98-4995-a087-829e240c4483 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "DELETE /v2.0/security-groups/abbae0c8-87fc-4661-8d8d-b3cf8f6eb365 HTTP/1.1" status: 204 len: 168 time: 0.7748399 May 12 15:22:45.728462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36284) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:45.740875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-14a4b749-ed0c-407f-9a43-5e4eb504cfdd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:45.811402 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ff2cd4-5724-45c8-8127-d28fade63a0e req-72571dce-b160-4a0c-836e-b113f3b53145 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:45.813455 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86ff2cd4-5724-45c8-8127-d28fade63a0e req-72571dce-b160-4a0c-836e-b113f3b53145 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 944 time: 0.2488360 May 12 15:22:45.854400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f613a990-af68-42fc-9188-27867cd32dfe tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Synchronizing usage tracker for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:22:45.867524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7e0c7266-ad09-4620-bfdc-81de7da01d15 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:22:45.879716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:45.892727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f613a990-af68-42fc-9188-27867cd32dfe tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Unset dirty status for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:22:45.897684 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f613a990-af68-42fc-9188-27867cd32dfe tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.1644785 May 12 15:22:45.900482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36288) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:45.907428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-02afd3e8-f7b0-4c16-a646-fbf3c9851945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group': {'name': 'tempest-secgroup--1075158177'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:45.913123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Transition to ACTIVE for port object 7e0c7266-ad09-4620-bfdc-81de7da01d15 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:22:45.916001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-02afd3e8-f7b0-4c16-a646-fbf3c9851945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:45.923976 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:45.961119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-02afd3e8-f7b0-4c16-a646-fbf3c9851945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:45.986900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-0a1b527c-e76b-4376-af11-ee6f3c149132 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4e5a10df576841e2a4752a9d47fb790a&fields=id HTTP/1.1" status: 200 len: 255 time: 0.3575106 May 12 15:22:46.033267 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.083933 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02afd3e8-f7b0-4c16-a646-fbf3c9851945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.099025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Pushing event updated for resources: {'Port': ['ID=7e0c7266-ad09-4620-bfdc-81de7da01d15,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:46.119988 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86ff2cd4-5724-45c8-8127-d28fade63a0e req-4cffa497-1935-4be3-b10b-ad3acd3100fd tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2905307 May 12 15:22:46.140557 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.165333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-02afd3e8-f7b0-4c16-a646-fbf3c9851945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:46.216397 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-14a4b749-ed0c-407f-9a43-5e4eb504cfdd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.245216 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-14a4b749-ed0c-407f-9a43-5e4eb504cfdd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.275939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-02afd3e8-f7b0-4c16-a646-fbf3c9851945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:46.278629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Attempting to bind port 7e0c7266-ad09-4620-bfdc-81de7da01d15 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:22:46.278966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Attempting to bind port 7e0c7266-ad09-4620-bfdc-81de7da01d15 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:22:46.279306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Attempting to bind port 7e0c7266-ad09-4620-bfdc-81de7da01d15 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:22:46.285202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-02afd3e8-f7b0-4c16-a646-fbf3c9851945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:46.287833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Port 7e0c7266-ad09-4620-bfdc-81de7da01d15 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:22:46.288155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Attempting to bind port 7e0c7266-ad09-4620-bfdc-81de7da01d15 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:22:46.296359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 22, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:22:46.297003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Checking segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:22:46.297412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Bound using segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:22:46.297848 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Bound port: 7e0c7266-ad09-4620-bfdc-81de7da01d15, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:22:46.298195 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.320098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-02afd3e8-f7b0-4c16-a646-fbf3c9851945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:46.452683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] For port 7e0c7266-ad09-4620-bfdc-81de7da01d15, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:22:46.458410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] For port 7e0c7266-ad09-4620-bfdc-81de7da01d15, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=7e0c7266-ad09-4620-bfdc-81de7da01d15,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:22:46.465768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-1f539486-3111-416e-b4c0-06d94d9a7955 service neutron] 10.222.0.82 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4509044 May 12 15:22:46.469605 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.498842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14a4b749-ed0c-407f-9a43-5e4eb504cfdd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=20d95cef-6d30-45c4-b2ba-f145d61fedf8,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:46.507360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-14a4b749-ed0c-407f-9a43-5e4eb504cfdd admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e87ae982708240299f16d4cfc5f73d5d&name=default HTTP/1.1" status: 200 len: 2983 time: 1.3310971 May 12 15:22:46.564192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36302) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:46.569179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e5cef5d1-de9a-4a98-991a-e31c8958610d up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:22:46.650750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port e5cef5d1-de9a-4a98-991a-e31c8958610d completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:22:46.652144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:46.652766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.654544 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-11019510-f435-430e-bf22-4a81b58f1c8d req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] 10.222.0.84 "PUT /v2.0/ports/7e0c7266-ad09-4620-bfdc-81de7da01d15 HTTP/1.1" status: 200 len: 1092 time: 1.6078415 May 12 15:22:46.656596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port e5cef5d1-de9a-4a98-991a-e31c8958610d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:22:46.657022 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.661638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7e3b9823-cd1e-48ee-8ba8-507d787c43bb', 'tag': '7e0c7266-ad09-4620-bfdc-81de7da01d15'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:46.680380 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02afd3e8-f7b0-4c16-a646-fbf3c9851945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.690217 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02afd3e8-f7b0-4c16-a646-fbf3c9851945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.712157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-aeb917da-991f-4ad5-8fd3-58f105dd34e7 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:46.713676 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-aeb917da-991f-4ad5-8fd3-58f105dd34e7 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/networks?id=e7794860-7444-4123-96d5-ca3febf5e162 HTTP/1.1" status: 200 len: 810 time: 0.4550414 May 12 15:22:46.777774 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fa80c2da-aa19-4744-9ddb-e7e2ae0eaafb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.788934 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-1dd56889-f763-42cd-8b8e-190a57cdb791 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/quotas/9e2382be0c6f4779ae64026a57628773 HTTP/1.1" status: 200 len: 375 time: 0.0525479 May 12 15:22:46.789638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaa94762-8003-43d9-b1b5-3721a63f7447 service neutron] Pushing event updated for resources: {'Port': ['ID=7e0c7266-ad09-4620-bfdc-81de7da01d15,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:46.795553 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.800060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02afd3e8-f7b0-4c16-a646-fbf3c9851945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event updated for resources: {'SecurityGroup': ['ID=79123273-645e-439a-addb-ce7630487d5d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:46.804009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-da072775-eedc-41dd-9f24-cbc573cd0ad3 service neutron] 10.222.0.82 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3374178 May 12 15:22:46.813865 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02afd3e8-f7b0-4c16-a646-fbf3c9851945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.815121 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-02afd3e8-f7b0-4c16-a646-fbf3c9851945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 0.9136846 May 12 15:22:46.822409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36308) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:46.832395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-660f3df9-b555-45d8-ad91-2a4e407922c3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '79123273-645e-439a-addb-ce7630487d5d', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:46.833130 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-660f3df9-b555-45d8-ad91-2a4e407922c3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 May 12 15:22:46.833658 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-660f3df9-b555-45d8-ad91-2a4e407922c3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:46.834714 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-660f3df9-b555-45d8-ad91-2a4e407922c3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0111902 May 12 15:22:46.839362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36312) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:46.848536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-de328571-0980-4744-bf43-9ff782dcc605 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '79123273-645e-439a-addb-ce7630487d5d', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:46.862178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5db95aab-1524-4c89-b6a8-c4ac8dbf3751', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e5cef5d1-de9a-4a98-991a-e31c8958610d'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:46.864609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-de328571-0980-4744-bf43-9ff782dcc605 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:46.873914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-de328571-0980-4744-bf43-9ff782dcc605 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:46.875282 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e5cef5d1-de9a-4a98-991a-e31c8958610d, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e5cef5d1-de9a-4a98-991a-e31c8958610d,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:46.881192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-de328571-0980-4744-bf43-9ff782dcc605 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:46.881836 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fa80c2da-aa19-4744-9ddb-e7e2ae0eaafb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.883278 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:46.887905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-de328571-0980-4744-bf43-9ff782dcc605 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:46.952349 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11019510-f435-430e-bf22-4a81b58f1c8d req-f0259969-73fe-46d5-9b08-df16afc5e27f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:46.955520 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-11019510-f435-430e-bf22-4a81b58f1c8d req-f0259969-73fe-46d5-9b08-df16afc5e27f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 1095 time: 0.2334945 May 12 15:22:46.957461 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-de328571-0980-4744-bf43-9ff782dcc605 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:46.958752 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-de328571-0980-4744-bf43-9ff782dcc605 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.1173501 May 12 15:22:46.965638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36318) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:46.972343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6128375f-906c-4fba-be1c-df8392ef8197 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '79123273-645e-439a-addb-ce7630487d5d', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:46.973111 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-6128375f-906c-4fba-be1c-df8392ef8197 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 May 12 15:22:46.973685 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-6128375f-906c-4fba-be1c-df8392ef8197 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:46.974642 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6128375f-906c-4fba-be1c-df8392ef8197 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0076697 May 12 15:22:46.987495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=e5cef5d1-de9a-4a98-991a-e31c8958610d,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:46.995786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36322) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:47.011273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-83636ac3-5b40-4d5c-bdf0-0e3b62085ea5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '79123273-645e-439a-addb-ce7630487d5d', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:47.018112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-83636ac3-5b40-4d5c-bdf0-0e3b62085ea5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:47.026786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-83636ac3-5b40-4d5c-bdf0-0e3b62085ea5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:47.030021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-83636ac3-5b40-4d5c-bdf0-0e3b62085ea5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:47.057567 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-11019510-f435-430e-bf22-4a81b58f1c8d req-e6a5d241-778c-4cf3-abad-8ad69dde8fef service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=7e0c7266-ad09-4620-bfdc-81de7da01d15 HTTP/1.1" status: 200 len: 217 time: 0.0810294 May 12 15:22:47.071413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-83636ac3-5b40-4d5c-bdf0-0e3b62085ea5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:47.087651 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fa80c2da-aa19-4744-9ddb-e7e2ae0eaafb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:47.113913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa80c2da-aa19-4744-9ddb-e7e2ae0eaafb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=20d95cef-6d30-45c4-b2ba-f145d61fedf8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:47.143027 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-c2092805-3efa-4f79-9997-2f2617d0a3ed tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=9e2382be0c6f4779ae64026a57628773&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3184278 May 12 15:22:47.157210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-827f4b47-1618-4115-8b02-05e3785b5dbb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:47.158887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-827f4b47-1618-4115-8b02-05e3785b5dbb service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b&tenant_id=40852c97262142aeb6d62097955af83f HTTP/1.1" status: 200 len: 1095 time: 0.2793512 May 12 15:22:47.178816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11019510-f435-430e-bf22-4a81b58f1c8d req-84ef19ba-d78a-4c14-9820-5ffb3a1b532a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:47.180539 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-11019510-f435-430e-bf22-4a81b58f1c8d req-84ef19ba-d78a-4c14-9820-5ffb3a1b532a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.1160326 May 12 15:22:47.188953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Request body: {'port': {'binding:host_id': 'n-h2-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:47.231769 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fa80c2da-aa19-4744-9ddb-e7e2ae0eaafb admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:47.236044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fa80c2da-aa19-4744-9ddb-e7e2ae0eaafb admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/20d95cef-6d30-45c4-b2ba-f145d61fedf8 HTTP/1.1" status: 204 len: 168 time: 0.6682808 May 12 15:22:47.255285 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-83636ac3-5b40-4d5c-bdf0-0e3b62085ea5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:47.257844 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-83636ac3-5b40-4d5c-bdf0-0e3b62085ea5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.2590616 May 12 15:22:47.259372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36340) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:47.266730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-31eb36b8-4077-45b5-9808-98125d9d4320 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '79123273-645e-439a-addb-ce7630487d5d', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:47.267342 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-31eb36b8-4077-45b5-9808-98125d9d4320 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 May 12 15:22:47.267886 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-31eb36b8-4077-45b5-9808-98125d9d4320 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:47.268852 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-31eb36b8-4077-45b5-9808-98125d9d4320 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0084395 May 12 15:22:47.271694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36344) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:47.277962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-815f0b3d-384d-4216-b075-e06f39cffa1e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '79123273-645e-439a-addb-ce7630487d5d', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:47.288659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-815f0b3d-384d-4216-b075-e06f39cffa1e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:47.306088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-815f0b3d-384d-4216-b075-e06f39cffa1e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:47.310410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11019510-f435-430e-bf22-4a81b58f1c8d req-3ff9f04b-2c11-4159-ad2c-011356ab013d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:47.312239 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-11019510-f435-430e-bf22-4a81b58f1c8d req-3ff9f04b-2c11-4159-ad2c-011356ab013d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1226993 May 12 15:22:47.313963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-815f0b3d-384d-4216-b075-e06f39cffa1e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:47.347948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-815f0b3d-384d-4216-b075-e06f39cffa1e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:47.426672 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-815f0b3d-384d-4216-b075-e06f39cffa1e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Project 0f5f77410c674422986162733d4c0337 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:22:47.457359 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-815f0b3d-384d-4216-b075-e06f39cffa1e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:47.459091 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-815f0b3d-384d-4216-b075-e06f39cffa1e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.1863766 May 12 15:22:47.462218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36352) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:47.474095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7f075fbd-5809-4402-a22e-7540184fe3db tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '79123273-645e-439a-addb-ce7630487d5d', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:47.474848 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-7f075fbd-5809-4402-a22e-7540184fe3db tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 May 12 15:22:47.475556 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-7f075fbd-5809-4402-a22e-7540184fe3db tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:47.477053 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7f075fbd-5809-4402-a22e-7540184fe3db tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0136883 May 12 15:22:47.480596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36356) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:47.498867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-16809e36-5bef-4d98-905f-54a959f10e33 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '79123273-645e-439a-addb-ce7630487d5d', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:47.507067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-16809e36-5bef-4d98-905f-54a959f10e33 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:47.511339 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-16809e36-5bef-4d98-905f-54a959f10e33 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:47.514688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-16809e36-5bef-4d98-905f-54a959f10e33 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:47.528140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-16809e36-5bef-4d98-905f-54a959f10e33 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:47.554164 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:47.564637 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-11019510-f435-430e-bf22-4a81b58f1c8d req-d57c829a-6a73-49b5-89ad-cba3e3f6744f service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2434795 May 12 15:22:47.565612 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-16809e36-5bef-4d98-905f-54a959f10e33 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Project 0f5f77410c674422986162733d4c0337 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:22:47.606580 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-16809e36-5bef-4d98-905f-54a959f10e33 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:47.608346 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-16809e36-5bef-4d98-905f-54a959f10e33 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.1267684 May 12 15:22:47.613556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36360) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:47.627017 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:47.660648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36364) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:47.670182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e7809b5a-a1cc-4661-8348-5ef70054b255 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '79123273-645e-439a-addb-ce7630487d5d', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:47.681302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2b38074-940d-4018-a10c-940245e0b407 req-33112345-39a0-4522-afd2-1043218ae605 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:47.683485 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e2b38074-940d-4018-a10c-940245e0b407 req-33112345-39a0-4522-afd2-1043218ae605 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 944 time: 0.4995973 May 12 15:22:47.685329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-b1e7545f-40d4-4450-bd64-01842d37448e service neutron] 10.222.0.82 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5415428 May 12 15:22:47.699616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e7809b5a-a1cc-4661-8348-5ef70054b255 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:47.707283 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e7809b5a-a1cc-4661-8348-5ef70054b255 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:47.714231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e7809b5a-a1cc-4661-8348-5ef70054b255 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:47.735384 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e7809b5a-a1cc-4661-8348-5ef70054b255 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:47.786303 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-e7809b5a-a1cc-4661-8348-5ef70054b255 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Project 0f5f77410c674422986162733d4c0337 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:22:47.795814 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c5c1a4a0-19e3-43b1-8b4b-5e7b62fe260b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a0824ae235484071b39cd368d3b3aa19&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1337540 May 12 15:22:47.811604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36368) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:47.836408 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-11019510-f435-430e-bf22-4a81b58f1c8d req-69a049d9-31eb-473b-b989-948d13d3c2b5 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2524207 May 12 15:22:47.853765 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-e7809b5a-a1cc-4661-8348-5ef70054b255 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:47.854776 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e7809b5a-a1cc-4661-8348-5ef70054b255 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.2402303 May 12 15:22:47.857868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36372) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:47.893439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e2b38074-940d-4018-a10c-940245e0b407 req-086a4fe0-921c-4201-a8c4-897bda887fae tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1953752 May 12 15:22:47.939986 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfa83d98-548b-4f75-9ff5-894993e0ff54 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:47.989589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfa83d98-548b-4f75-9ff5-894993e0ff54 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:48.000087 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84c32723-1ee5-4b4d-aff3-c31e4584c945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:48.010506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-945ea9e5-3d2b-49da-808f-f35e3f1d8daf req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-1897320484', 'description': 'tempest-description-1401659996'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:48.024344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-945ea9e5-3d2b-49da-808f-f35e3f1d8daf req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:48.040111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-555b233c-c36d-4411-9847-25ec814d12c3 service neutron] 10.222.0.82 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3409932 May 12 15:22:48.040946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-945ea9e5-3d2b-49da-808f-f35e3f1d8daf req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:48.045415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-945ea9e5-3d2b-49da-808f-f35e3f1d8daf req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:48.050764 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84c32723-1ee5-4b4d-aff3-c31e4584c945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:48.055278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-945ea9e5-3d2b-49da-808f-f35e3f1d8daf req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:48.078906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-945ea9e5-3d2b-49da-808f-f35e3f1d8daf req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:48.108238 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84c32723-1ee5-4b4d-aff3-c31e4584c945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:48.121663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-945ea9e5-3d2b-49da-808f-f35e3f1d8daf req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:48.125861 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:48.130074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfa83d98-548b-4f75-9ff5-894993e0ff54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:48.130310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-945ea9e5-3d2b-49da-808f-f35e3f1d8daf req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group_rule and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:48.134254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-945ea9e5-3d2b-49da-808f-f35e3f1d8daf req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:48.142128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-945ea9e5-3d2b-49da-808f-f35e3f1d8daf req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:48.151769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84c32723-1ee5-4b4d-aff3-c31e4584c945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=79123273-645e-439a-addb-ce7630487d5d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:48.166392 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84c32723-1ee5-4b4d-aff3-c31e4584c945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:48.170248 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-84c32723-1ee5-4b4d-aff3-c31e4584c945 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "DELETE /v2.0/security-groups/79123273-645e-439a-addb-ce7630487d5d HTTP/1.1" status: 204 len: 168 time: 0.3116295 May 12 15:22:48.173190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36376) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:48.176458 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfa83d98-548b-4f75-9ff5-894993e0ff54 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:48.180060 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bfa83d98-548b-4f75-9ff5-894993e0ff54 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/37283c3a-0a68-4ee5-8c0a-2a733f18c7f0 HTTP/1.1" status: 204 len: 168 time: 0.3644342 May 12 15:22:48.180060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfa83d98-548b-4f75-9ff5-894993e0ff54 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37283c3a-0a68-4ee5-8c0a-2a733f18c7f0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:48.305263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5b2011bb-96c7-4485-9fcf-515ad3345d6d tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Synchronizing usage tracker for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:22:48.346243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5b2011bb-96c7-4485-9fcf-515ad3345d6d tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Unset dirty status for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:22:48.349121 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5b2011bb-96c7-4485-9fcf-515ad3345d6d tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.1739888 May 12 15:22:48.360208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36386) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:48.368625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:22:48.384669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d65f0219-9263-42fd-8108-a5525d6d405f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group': {'name': 'tempest-secgroup--957473'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:48.400780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d65f0219-9263-42fd-8108-a5525d6d405f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:48.412753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d65f0219-9263-42fd-8108-a5525d6d405f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:48.439544 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d65f0219-9263-42fd-8108-a5525d6d405f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:48.446929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4a88f583-55ea-4849-8a87-dbc693ed07d0 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:22:48.469574 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:48.538606 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-945ea9e5-3d2b-49da-808f-f35e3f1d8daf req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:48.548449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Transition to ACTIVE for port object 4a88f583-55ea-4849-8a87-dbc693ed07d0 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:22:48.558096 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-945ea9e5-3d2b-49da-808f-f35e3f1d8daf req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:48.572630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d65f0219-9263-42fd-8108-a5525d6d405f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:48.576694 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:48.587653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d65f0219-9263-42fd-8108-a5525d6d405f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:48.593897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d65f0219-9263-42fd-8108-a5525d6d405f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:48.696544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-6da2304c-680c-49fe-9749-45d9c27e5868 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:48.698214 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-6da2304c-680c-49fe-9749-45d9c27e5868 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.84 "GET /v2.0/networks?id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61 HTTP/1.1" status: 200 len: 813 time: 0.2309875 May 12 15:22:48.699186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d65f0219-9263-42fd-8108-a5525d6d405f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:48.737584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Request body: {'port': {'device_id': 'c6664985-1799-40f2-b048-f9f4daa5401e', 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61', 'admin_state_up': True, 'tenant_id': '4e5a10df576841e2a4752a9d47fb790a'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:48.819401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9887b154-c2ee-411c-adde-fd90b2df6d88,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:48.835055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-945ea9e5-3d2b-49da-808f-f35e3f1d8daf req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:48.841462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-945ea9e5-3d2b-49da-808f-f35e3f1d8daf req-11cd544b-5023-4da4-8c3b-f8867ed92626 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1808 time: 0.8956113 May 12 15:22:48.903862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Pushing event updated for resources: {'Port': ['ID=4a88f583-55ea-4849-8a87-dbc693ed07d0,revision_number=9']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:48.950278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fc25c30-b90b-4b06-9038-91163e6d1fd5 req-cfa79d66-5e29-4eae-ae9b-6759fd4d5f58 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:48.956030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:48.960202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9fc25c30-b90b-4b06-9038-91163e6d1fd5 req-cfa79d66-5e29-4eae-ae9b-6759fd4d5f58 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 945 time: 0.4988446 May 12 15:22:48.965151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Usage tracker for resource:port and tenant:4e5a10df576841e2a4752a9d47fb790a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:48.971218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:48.985568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:49.005446 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-dd7fdc14-7048-41d6-9e8a-214da9e9fd57'] response: {'name': 'network-changed', 'server_uuid': '7e3b9823-cd1e-48ee-8ba8-507d787c43bb', 'tag': '7e0c7266-ad09-4620-bfdc-81de7da01d15', 'status': 'completed', 'code': 200} May 12 15:22:49.020369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Made reservation on behalf of 4e5a10df576841e2a4752a9d47fb790a for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:22:49.034675 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:49.055615 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8b4bf180-4abb-407b-b0f5-9a6255d85743'] response: {'server_uuid': '5db95aab-1524-4c89-b6a8-c4ac8dbf3751', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e5cef5d1-de9a-4a98-991a-e31c8958610d', 'code': 200} May 12 15:22:49.057258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] No DVR routers for this DVR port 4a88f583-55ea-4849-8a87-dbc693ed07d0 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:22:49.278208 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9fc25c30-b90b-4b06-9038-91163e6d1fd5 req-fcd8c6a6-c7fc-44ef-bdc7-f25afcaf0a41 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3167782 May 12 15:22:49.301175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d65f0219-9263-42fd-8108-a5525d6d405f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:49.350433 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d65f0219-9263-42fd-8108-a5525d6d405f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:49.568814 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00c9d537-8174-4f1c-8660-4528a44952b5 req-97fc2e07-8f24-4196-844a-6d0345f5a0f6 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 210 time: 0.1385429 May 12 15:22:49.603802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c8ed157-9352-4edb-9130-b40d0f8a8e79 req-e6d86d73-acbb-4edf-9390-4adcfdc3a519 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:49.606358 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c8ed157-9352-4edb-9130-b40d0f8a8e79 req-e6d86d73-acbb-4edf-9390-4adcfdc3a519 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 1095 time: 0.5874040 May 12 15:22:49.625639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d65f0219-9263-42fd-8108-a5525d6d405f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event updated for resources: {'SecurityGroup': ['ID=02c14ace-a262-4081-9a0a-e9a8a241293f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:49.801867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Attempting to bind port 4a88f583-55ea-4849-8a87-dbc693ed07d0 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:22:49.802322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Attempting to bind port 4a88f583-55ea-4849-8a87-dbc693ed07d0 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:22:49.802723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Attempting to bind port 4a88f583-55ea-4849-8a87-dbc693ed07d0 on network 2d986451-1d91-468d-8a9c-ecc4da7a86bc {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:22:49.814561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96f0eb3a-8e35-4a7d-894b-67b33c8b7329 req-d58e8833-3b44-495c-aceb-4a24e062822e tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 210 time: 0.0591326 May 12 15:22:49.818854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Port 4a88f583-55ea-4849-8a87-dbc693ed07d0 on network 2d986451-1d91-468d-8a9c-ecc4da7a86bc not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:22:49.819272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Attempting to bind port 4a88f583-55ea-4849-8a87-dbc693ed07d0 on network 2d986451-1d91-468d-8a9c-ecc4da7a86bc {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:22:49.831577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f59d2128-ac3f-47e4-8d0f-2fa08362c8c1 req-d8ddd9db-2a27-40b1-9cdc-b8f1e3de329d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:49.833061 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f59d2128-ac3f-47e4-8d0f-2fa08362c8c1 req-d8ddd9db-2a27-40b1-9cdc-b8f1e3de329d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 944 time: 0.3466878 May 12 15:22:49.835937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 22, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:22:49.836346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Checking segment: {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:22:49.836799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Bound using segment: {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:22:49.837284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Bound port: 4a88f583-55ea-4849-8a87-dbc693ed07d0, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:22:49.837748 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:49.849412 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d65f0219-9263-42fd-8108-a5525d6d405f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:49.849412 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d65f0219-9263-42fd-8108-a5525d6d405f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1742 time: 1.4834433 May 12 15:22:49.851238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36420) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:49.879658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c3427b40-84e3-4c07-a046-cb2b3e35c0e3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '02c14ace-a262-4081-9a0a-e9a8a241293f', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': 'bad_group_id'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:49.886943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe898e01-4830-41d5-918e-be02837ff896 req-050537cb-d9d7-422c-8cc4-1759c6230469 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:49.887972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36424) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:49.888746 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fe898e01-4830-41d5-918e-be02837ff896 req-050537cb-d9d7-422c-8cc4-1759c6230469 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 1096 time: 0.6632066 May 12 15:22:49.891606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c3427b40-84e3-4c07-a046-cb2b3e35c0e3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:49.922760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Allocated IP 172.20.0.12 (aab37dc4-92bf-4fd9-8482-5e3a3f715d61/c90f4328-5e3e-4311-a3b6-84cff19a6919/4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:22:49.942916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c3427b40-84e3-4c07-a046-cb2b3e35c0e3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:49.947291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c3427b40-84e3-4c07-a046-cb2b3e35c0e3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:49.977957 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c8ed157-9352-4edb-9130-b40d0f8a8e79 req-bafded0a-fd85-44c2-92c4-c962b1c25a96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:49.979381 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c8ed157-9352-4edb-9130-b40d0f8a8e79 req-bafded0a-fd85-44c2-92c4-c962b1c25a96 service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.3398471 May 12 15:22:49.991696 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fe898e01-4830-41d5-918e-be02837ff896 req-5252ca8a-8c0c-4f2b-9520-85e2f3fb08e6 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957007 May 12 15:22:50.007154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c3427b40-84e3-4c07-a046-cb2b3e35c0e3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:50.080748 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c8ed157-9352-4edb-9130-b40d0f8a8e79 req-e5ddb0bf-5ce1-4a67-8071-bd2f5851aaae service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=7e0c7266-ad09-4620-bfdc-81de7da01d15 HTTP/1.1" status: 200 len: 217 time: 0.0936139 May 12 15:22:50.090410 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f59d2128-ac3f-47e4-8d0f-2fa08362c8c1 req-146e2525-64b5-4d79-815d-832b9ed50415 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2364168 May 12 15:22:50.133866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0fc3d399-28d6-4d9b-96c2-44fce98601b4 tempest-AgentManagementNegativeTest-973696411 tempest-AgentManagementNegativeTest-973696411-project] 10.222.0.82 "GET /v2.0/agents HTTP/1.1" status: 200 len: 207 time: 0.2419071 May 12 15:22:50.140718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:22:50.158471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:22:50.177840 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:50.237878 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-c3427b40-84e3-4c07-a046-cb2b3e35c0e3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The resource could not be found. May 12 15:22:50.239005 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c3427b40-84e3-4c07-a046-cb2b3e35c0e3 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.3839848 May 12 15:22:50.254779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36440) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:50.287231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ed09d4a0-1dc2-409e-8094-dc03c9abbbe5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '02c14ace-a262-4081-9a0a-e9a8a241293f', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': '7c5b67c5-4e71-401e-afd3-5dd83a7a7304'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:50.324710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ed09d4a0-1dc2-409e-8094-dc03c9abbbe5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:50.341567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c8ed157-9352-4edb-9130-b40d0f8a8e79 req-6ace31b2-6ea5-4ff3-917e-5d1da5770a34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:50.342917 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c8ed157-9352-4edb-9130-b40d0f8a8e79 req-6ace31b2-6ea5-4ff3-917e-5d1da5770a34 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.2539210 May 12 15:22:50.343893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ed09d4a0-1dc2-409e-8094-dc03c9abbbe5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:50.379504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0019ab76-1c67-4590-bf83-a3b495032999 req-8212e2c7-95c5-4a9d-a2b1-37950d9c1e6b tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:50.386537 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0019ab76-1c67-4590-bf83-a3b495032999 req-8212e2c7-95c5-4a9d-a2b1-37950d9c1e6b tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 944 time: 0.4031048 May 12 15:22:50.391848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:50.392471 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:50.393904 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] 10.222.0.76 "PUT /v2.0/ports/4a88f583-55ea-4849-8a87-dbc693ed07d0 HTTP/1.1" status: 200 len: 1092 time: 3.2111695 May 12 15:22:50.439699 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ed09d4a0-1dc2-409e-8094-dc03c9abbbe5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:50.460803 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:50.529252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ed09d4a0-1dc2-409e-8094-dc03c9abbbe5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:50.597595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b732be4-4657-480e-8e81-76054b3d046e service neutron] Pushing event updated for resources: {'Port': ['ID=4a88f583-55ea-4849-8a87-dbc693ed07d0,revision_number=10']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:50.608082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36450) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:50.646645 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0019ab76-1c67-4590-bf83-a3b495032999 req-95a35473-16ab-4ed9-ae7b-f04f5be61837 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2584944 May 12 15:22:50.685688 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:50.686247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a6d77b-530d-4662-aec5-7972485b048a req-dcb46744-c740-4429-8d0b-315cdf367926 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:50.688643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65a6d77b-530d-4662-aec5-7972485b048a req-dcb46744-c740-4429-8d0b-315cdf367926 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/networks?id=b50584ea-1073-48d4-a2bc-43b11374a495 HTTP/1.1" status: 200 len: 813 time: 0.4286520 May 12 15:22:50.704733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c2249ed-75e8-477b-87ac-64776ffd6cd5 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:50.706280 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c2249ed-75e8-477b-87ac-64776ffd6cd5 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.76 "GET /v2.0/networks?id=e7794860-7444-4123-96d5-ca3febf5e162 HTTP/1.1" status: 200 len: 810 time: 0.4503648 May 12 15:22:50.707374 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-ed09d4a0-1dc2-409e-8094-dc03c9abbbe5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The resource could not be found. May 12 15:22:50.710558 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ed09d4a0-1dc2-409e-8094-dc03c9abbbe5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.4490163 May 12 15:22:50.711217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c8ed157-9352-4edb-9130-b40d0f8a8e79 req-d9f0fee9-97e4-401c-a575-138477170a43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:50.712766 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c8ed157-9352-4edb-9130-b40d0f8a8e79 req-d9f0fee9-97e4-401c-a575-138477170a43 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2800903 May 12 15:22:50.713222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36458) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:50.717983 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65a6d77b-530d-4662-aec5-7972485b048a req-3fc8806f-a1e7-43a0-a87a-f3babb49a7eb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/quotas/86574e26b5194d1f92a51749f063fa69 HTTP/1.1" status: 200 len: 375 time: 0.0219460 May 12 15:22:50.721346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Request body: {'port': {'device_id': '31e1782e-1e75-4738-9a0c-d51f4a6ee62c', 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162', 'admin_state_up': True, 'tenant_id': '9e2382be0c6f4779ae64026a57628773'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:50.769995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65a6d77b-530d-4662-aec5-7972485b048a req-b879c3f4-d304-4928-aa49-c26f665f8e90 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=86574e26b5194d1f92a51749f063fa69&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0509279 May 12 15:22:50.926337 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8f1dc657-8fc6-41cc-b15d-695e2d4e96a9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:50.988871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8f1dc657-8fc6-41cc-b15d-695e2d4e96a9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:51.015318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-1a3c59d3-d8ee-492b-be5a-7f383f5f4a7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:51.016479 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-1a3c59d3-d8ee-492b-be5a-7f383f5f4a7b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=40852c97262142aeb6d62097955af83f&device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 1096 time: 0.5217226 May 12 15:22:51.016733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8f1dc657-8fc6-41cc-b15d-695e2d4e96a9 admin admin] Usage tracker for resource:security_group_rule and tenant:5989cbfd0c024baa955e56067e08bbfe is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:51.028028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8f1dc657-8fc6-41cc-b15d-695e2d4e96a9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:51.063730 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:51.081050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8f1dc657-8fc6-41cc-b15d-695e2d4e96a9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:51.101531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:22:51.132860 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4a03dc0-15e7-454c-87f2-371d78fc3176 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:51.194478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:51.222476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65a6d77b-530d-4662-aec5-7972485b048a req-898b4f2e-c00f-4753-8ecf-d114cd427660 service neutron] 10.222.0.82 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4474957 May 12 15:22:51.235629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31f0bcdf-563a-4593-a362-fcacbc2a42a6 req-3a6d8a12-bafb-491e-9de8-084b5006699e tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:51.237360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31f0bcdf-563a-4593-a362-fcacbc2a42a6 req-3a6d8a12-bafb-491e-9de8-084b5006699e tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 945 time: 0.4651339 May 12 15:22:51.248834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Usage tracker for resource:port and tenant:9e2382be0c6f4779ae64026a57628773 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:51.256062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:51.259348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-0d785db2-865f-415d-ab46-c4477b3976e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:51.260818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-0d785db2-865f-415d-ab46-c4477b3976e4 service neutron] 10.222.0.76 "GET /v2.0/networks?id=2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 200 len: 918 time: 0.2362621 May 12 15:22:51.270905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Network aab37dc4-92bf-4fd9-8482-5e3a3f715d61 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:22:51.287395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:51.291692 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c8ed157-9352-4edb-9130-b40d0f8a8e79 req-f5823c6d-edce-4f10-9de2-c386fccf14c1 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4966621 May 12 15:22:51.292609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:22:51.300238 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4a03dc0-15e7-454c-87f2-371d78fc3176 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:51.308025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Pushing event updated for resources: {'Port': ['ID=4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:51.311169 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 7e0c7266-ad09-4620-bfdc-81de7da01d15 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:22:51.319263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:22:51.481682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31f0bcdf-563a-4593-a362-fcacbc2a42a6 req-e006aed8-9e8e-4b42-975d-b7aba8d8460f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2177103 May 12 15:22:51.486021 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-2174a11d-bc1e-4c17-9760-29da2bc64252 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0 HTTP/1.1" status: 200 len: 1000 time: 0.1523771 May 12 15:22:51.486708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Made reservation on behalf of 9e2382be0c6f4779ae64026a57628773 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:22:51.490252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:51.525044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65a6d77b-530d-4662-aec5-7972485b048a req-38cbe984-bf32-4c36-9ff7-ff10f4bbecc7 service neutron] 10.222.0.82 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2847793 May 12 15:22:51.543328 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-757342a4-fe27-45c7-b3ad-782de6811c7b req-df0f877a-1415-48c0-89af-2695051bddf7 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.1632271 May 12 15:22:51.591754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:51.592525 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:51.600317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 7e0c7266-ad09-4620-bfdc-81de7da01d15, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=7e0c7266-ad09-4620-bfdc-81de7da01d15,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:51.620287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '7e0c7266-ad09-4620-bfdc-81de7da01d15', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'port_id': '7e0c7266-ad09-4620-bfdc-81de7da01d15', 'mac_address': 'fa:16:3e:c7:c5:63', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 579, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:22:51.630624 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a013c2d6-0625-44d9-b275-3ee64f8952c2'] response: {'name': 'network-changed', 'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'status': 'completed', 'code': 200} May 12 15:22:51.673086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-99ab53f2-cf7e-411a-a9b6-f2a0671bec62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:51.675059 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-99ab53f2-cf7e-411a-a9b6-f2a0671bec62 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5f6d45f7-b8bc-4313-879f-ee173c0a4148 HTTP/1.1" status: 200 len: 856 time: 0.1450372 May 12 15:22:51.685167 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:51.704996 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7e0c7266-ad09-4620-bfdc-81de7da01d15 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:22:51.724040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 7e0c7266-ad09-4620-bfdc-81de7da01d15, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=7e0c7266-ad09-4620-bfdc-81de7da01d15,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:51.733989 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:51.871472 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=7e0c7266-ad09-4620-bfdc-81de7da01d15,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:51.878239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-7420747b-5c99-4054-b51a-c1d359b73173 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:51.879957 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-7420747b-5c99-4054-b51a-c1d359b73173 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=2d986451-1d91-468d-8a9c-ecc4da7a86bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1932180 May 12 15:22:51.948358 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4a03dc0-15e7-454c-87f2-371d78fc3176 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:51.980936 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-757342a4-fe27-45c7-b3ad-782de6811c7b req-98610203-a838-478f-937e-2f0f47a4bd3b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.1032398 May 12 15:22:52.023847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-103fbd9c-7c69-4734-aca8-bb3b7b532a87 req-20172584-3348-4b99-84f1-f2967fc645cb tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 210 time: 0.1088784 May 12 15:22:52.034442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a3c3679-9296-4838-ba35-5fc6a35bbae4 req-60123d08-af0a-470a-93d1-69d9d89f70a8 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:52.035959 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a3c3679-9296-4838-ba35-5fc6a35bbae4 req-60123d08-af0a-470a-93d1-69d9d89f70a8 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 932 time: 0.2567689 May 12 15:22:52.046332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4a03dc0-15e7-454c-87f2-371d78fc3176 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=02c14ace-a262-4081-9a0a-e9a8a241293f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:52.065592 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-904d4bd4-496d-4a3c-8b1f-185e125cd74c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.3331475 May 12 15:22:52.079725 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4a03dc0-15e7-454c-87f2-371d78fc3176 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:52.080829 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b4a03dc0-15e7-454c-87f2-371d78fc3176 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "DELETE /v2.0/security-groups/02c14ace-a262-4081-9a0a-e9a8a241293f HTTP/1.1" status: 204 len: 168 time: 1.3656490 May 12 15:22:52.082626 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['7e0c7266-ad09-4620-bfdc-81de7da01d15'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:22:52.082798 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-757342a4-fe27-45c7-b3ad-782de6811c7b req-d16aeb4b-55b1-4e61-9802-1ec00638dc9f service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0778711 May 12 15:22:52.088951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36480) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:52.091350 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c8ed157-9352-4edb-9130-b40d0f8a8e79 req-cd0d61ea-2952-436f-a122-ec8604baa388 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7733479 May 12 15:22:52.098122 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Request body: {'port': {'device_id': 'c6664985-1799-40f2-b048-f9f4daa5401e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:52.313249 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8f1dc657-8fc6-41cc-b15d-695e2d4e96a9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:52.332648 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a3c3679-9296-4838-ba35-5fc6a35bbae4 req-c62e243a-1958-4487-b6f4-6a85f1303faf tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2812600 May 12 15:22:52.343697 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8f1dc657-8fc6-41cc-b15d-695e2d4e96a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:52.385541 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8f1dc657-8fc6-41cc-b15d-695e2d4e96a9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5989cbfd0c024baa955e56067e08bbfe&name=default HTTP/1.1" status: 200 len: 2983 time: 1.7764006 May 12 15:22:52.392967 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-45cfe688-e663-48bf-a494-50c7d0fca0b5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.3006873 May 12 15:22:52.393894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36486) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:52.399366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36488) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:52.399922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-696fb959-66d9-4ee4-9401-aef6cd9eaf7a service neutron] 10.222.0.76 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5084958 May 12 15:22:52.457764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-02a12ee5-a301-4827-83b3-abbb00033079 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '28916b12-961f-4e5f-88f5-b4f85c5c306d', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:52.480118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-02a12ee5-a301-4827-83b3-abbb00033079 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:52.495337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Allocated IP 172.20.0.8 (e7794860-7444-4123-96d5-ca3febf5e162/eae80ee9-f335-4892-af0b-41490fc3c6b5/31c449ad-4a28-4740-9037-350aab14340e) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:22:52.502459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-02a12ee5-a301-4827-83b3-abbb00033079 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:52.508353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-02a12ee5-a301-4827-83b3-abbb00033079 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:52.513192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757342a4-fe27-45c7-b3ad-782de6811c7b req-755877e2-9f93-4e94-ac43-85bbec787637 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:52.514724 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-757342a4-fe27-45c7-b3ad-782de6811c7b req-755877e2-9f93-4e94-ac43-85bbec787637 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3866172 May 12 15:22:52.515436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f1dc657-8fc6-41cc-b15d-695e2d4e96a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19c195ed-51bb-4dea-bfc5-9ae3dde71c78,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:52.528611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-02a12ee5-a301-4827-83b3-abbb00033079 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:52.537350 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:52.652184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d988276f-bace-45ab-98c6-c484044d4029 req-9ec7bea0-b0f9-4a4f-96e4-bbf907d0577d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:52.653689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d988276f-bace-45ab-98c6-c484044d4029 req-9ec7bea0-b0f9-4a4f-96e4-bbf907d0577d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 945 time: 0.4474709 May 12 15:22:52.670034 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3f8a2607-056a-4345-88f5-66fb4202d335 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:52.739264 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-02a12ee5-a301-4827-83b3-abbb00033079 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The resource could not be found. May 12 15:22:52.745208 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-02a12ee5-a301-4827-83b3-abbb00033079 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.3378999 May 12 15:22:52.745414 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-03dc91d2-c175-4a98-86b4-29e702f8f50a service neutron] 10.222.0.76 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3260000 May 12 15:22:52.746612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36496) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:52.759471 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3f8a2607-056a-4345-88f5-66fb4202d335 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:52.770535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group': {'name': 'tempest-secgroup--268000148'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:52.782874 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d988276f-bace-45ab-98c6-c484044d4029 req-698235f4-d3f5-4fc9-8b2e-3c5c9b9a4697 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1210291 May 12 15:22:52.785658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:52.798640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:52.804414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:52.819833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c174bfa1-493d-4de2-b9a1-5a7369ecf1d2 req-8216f5bc-10aa-49db-a690-3a1fbec7362f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:52.826683 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c174bfa1-493d-4de2-b9a1-5a7369ecf1d2 req-8216f5bc-10aa-49db-a690-3a1fbec7362f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 945 time: 0.3129823 May 12 15:22:52.830166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:52.944294 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:52.976662 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c174bfa1-493d-4de2-b9a1-5a7369ecf1d2 req-0271b0e5-2608-451d-a271-478380e6d0e0 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1490052 May 12 15:22:53.009923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:53.019279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:53.073102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:53.079479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:53.087557 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3f8a2607-056a-4345-88f5-66fb4202d335 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:53.105942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3328ed6-b3be-4ee5-b1cc-d42c8aa3989a req-722aa780-37e8-4b38-98c9-acf478665de3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 210 time: 0.0977392 May 12 15:22:53.110906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:53.146345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:22:53.154798 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:53.174931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Transition to ACTIVE for port object 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:22:53.189165 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:53.200578 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:53.214529 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['eaeeccb2-8af7-4344-866b-7226dbc22776'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:22:53.338284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 7e0c7266-ad09-4620-bfdc-81de7da01d15 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:22:53.368352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Network e7794860-7444-4123-96d5-ca3febf5e162 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:22:53.373250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Pushing event updated for resources: {'Port': ['ID=4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:53.412587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:22:53.473961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:22:53.497049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:53.503645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b10aa0-b768-4ba3-a4a0-986c7e636ef9 req-bc947d42-f8aa-4420-8815-0990888102f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:53.505860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63b10aa0-b768-4ba3-a4a0-986c7e636ef9 req-bc947d42-f8aa-4420-8815-0990888102f2 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=40852c97262142aeb6d62097955af83f&device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 1096 time: 0.6658299 May 12 15:22:53.516440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f8a2607-056a-4345-88f5-66fb4202d335 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19c195ed-51bb-4dea-bfc5-9ae3dde71c78,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:53.531110 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:53.710307 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3f8a2607-056a-4345-88f5-66fb4202d335 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:53.711536 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3f8a2607-056a-4345-88f5-66fb4202d335 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/19c195ed-51bb-4dea-bfc5-9ae3dde71c78 HTTP/1.1" status: 204 len: 168 time: 1.3150911 May 12 15:22:53.744425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 7e0c7266-ad09-4620-bfdc-81de7da01d15 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:22:53.804199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 7e0c7266-ad09-4620-bfdc-81de7da01d15 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:22:53.804664 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:53.812526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d6ab7649-ae0c-465c-8df2-c38dd824b992,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:53.837105 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:53.838629 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-63bee329-7f89-42c0-b29b-1b45d7d3052c tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 1.0917959 May 12 15:22:53.855372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36522) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:53.890524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group': {'name': 'tempest-secgroup--1988939195'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:53.929098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:53.970679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:54.017830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:54.047272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:54.061028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b10aa0-b768-4ba3-a4a0-986c7e636ef9 req-2f716f46-ebfe-44d0-bb12-99cc350cdf5c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:54.062537 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63b10aa0-b768-4ba3-a4a0-986c7e636ef9 req-2f716f46-ebfe-44d0-bb12-99cc350cdf5c service neutron] 10.222.0.76 "GET /v2.0/networks?id=2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 200 len: 918 time: 0.5407448 May 12 15:22:54.097445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f94c484-8195-4d9a-bfc1-cb9c9d72d7ac req-44b6c099-c5f0-4c63-98c4-40caa124f3c7 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:54.099263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f94c484-8195-4d9a-bfc1-cb9c9d72d7ac req-44b6c099-c5f0-4c63-98c4-40caa124f3c7 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 945 time: 1.0026102 May 12 15:22:54.122729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36936df0-1fca-4f54-9094-1e13ee167d60 req-98af4f07-59ef-4ff8-bc17-4d5e1e4842c2 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:54.138160 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-36936df0-1fca-4f54-9094-1e13ee167d60 req-98af4f07-59ef-4ff8-bc17-4d5e1e4842c2 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 931 time: 0.6301677 May 12 15:22:54.166305 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:54.287529 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:54.298010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a6d77b-530d-4662-aec5-7972485b048a req-a179fd8f-6ff9-4d97-b43b-a560f54e2ab3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:54.299190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-65a6d77b-530d-4662-aec5-7972485b048a req-a179fd8f-6ff9-4d97-b43b-a560f54e2ab3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Synchronizing usage tracker for tenant:86574e26b5194d1f92a51749f063fa69 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:22:54.338286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7e3b9823-cd1e-48ee-8ba8-507d787c43bb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7e0c7266-ad09-4620-bfdc-81de7da01d15'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:54.366397 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 7e0c7266-ad09-4620-bfdc-81de7da01d15, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=7e0c7266-ad09-4620-bfdc-81de7da01d15,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:22:54.380675 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:54.399278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:54.430939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:54.438205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Pushing event updated for resources: {'Port': ['ID=31c449ad-4a28-4740-9037-350aab14340e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:54.476325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-36936df0-1fca-4f54-9094-1e13ee167d60 req-a22646e5-3e5e-469b-aeed-5d128722c3b4 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3371840 May 12 15:22:54.493767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=7e0c7266-ad09-4620-bfdc-81de7da01d15,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:54.497240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:54.498036 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:54.570955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Attempting to bind port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:22:54.571346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Attempting to bind port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '17355787-57e0-48f5-9070-811e461a6000', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:22:54.571677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Attempting to bind port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 on network aab37dc4-92bf-4fd9-8482-5e3a3f715d61 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:22:54.577497 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-0c3443bd-3694-498f-8956-3e445f321ec9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.8598073 May 12 15:22:54.578198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-65a6d77b-530d-4662-aec5-7972485b048a req-a179fd8f-6ff9-4d97-b43b-a560f54e2ab3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Unset dirty status for tenant:86574e26b5194d1f92a51749f063fa69 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:22:54.579434 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-65a6d77b-530d-4662-aec5-7972485b048a req-a179fd8f-6ff9-4d97-b43b-a560f54e2ab3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.84 "GET /v2.0/networks?id=b50584ea-1073-48d4-a2bc-43b11374a495 HTTP/1.1" status: 200 len: 813 time: 1.1578274 May 12 15:22:54.580151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 on network aab37dc4-92bf-4fd9-8482-5e3a3f715d61 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:22:54.580530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Attempting to bind port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 on network aab37dc4-92bf-4fd9-8482-5e3a3f715d61 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:22:54.586499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 22, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:22:54.586837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Checking segment: {'id': '17355787-57e0-48f5-9070-811e461a6000', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:22:54.587219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Bound using segment: {'id': '17355787-57e0-48f5-9070-811e461a6000', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:22:54.587668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Bound port: 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '17355787-57e0-48f5-9070-811e461a6000', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:22:54.587994 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:54.602813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:54.603761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'port': {'device_id': '9848e953-d1fb-4bb4-8995-1f62bf3efd1c', 'network_id': 'b50584ea-1073-48d4-a2bc-43b11374a495', 'admin_state_up': True, 'tenant_id': '86574e26b5194d1f92a51749f063fa69'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:54.628990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Request body: {'port': {'device_id': '31e1782e-1e75-4738-9a0c-d51f4a6ee62c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:54.637823 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f94c484-8195-4d9a-bfc1-cb9c9d72d7ac req-2165b685-f204-4629-b214-26e096b38056 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4916358 May 12 15:22:54.639136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:54.968373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36554) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:55.011965 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63b10aa0-b768-4ba3-a4a0-986c7e636ef9 req-57f9ef03-5c08-4358-b76b-d0293f64812b service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0 HTTP/1.1" status: 200 len: 1000 time: 0.5824971 May 12 15:22:55.061570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:55.070245 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:55.085538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:port and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:55.091277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] For port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:22:55.094220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:55.110557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:55.119613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] For port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:22:55.128724 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:55.144016 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:55.166045 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:55.225972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b10aa0-b768-4ba3-a4a0-986c7e636ef9 req-996fac5e-1814-47fc-8656-02992f345b26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:55.227731 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63b10aa0-b768-4ba3-a4a0-986c7e636ef9 req-996fac5e-1814-47fc-8656-02992f345b26 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5f6d45f7-b8bc-4313-879f-ee173c0a4148 HTTP/1.1" status: 200 len: 856 time: 0.1979861 May 12 15:22:55.251103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f97be356-ad5d-4378-99af-7cc03d7d8f29 req-97b61488-49e6-4f5c-a766-90db4c4b669e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:55.259845 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f97be356-ad5d-4378-99af-7cc03d7d8f29 req-97b61488-49e6-4f5c-a766-90db4c4b669e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 944 time: 0.5602696 May 12 15:22:55.290669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f66384c6-f352-4f7c-95f6-e9ea8b489d0d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:55.350842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df59fb5b-d07b-464a-8ade-ef119e02ac47 req-302dde25-ca58-4d1c-b749-9bcd704752db tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:55.359146 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df59fb5b-d07b-464a-8ade-ef119e02ac47 req-302dde25-ca58-4d1c-b749-9bcd704752db tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 945 time: 0.4380007 May 12 15:22:55.377256 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:55.381684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9b91fea8-83bd-434f-8e3d-21341fd038e1 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 1.5219533 May 12 15:22:55.414755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36560) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:55.443960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-dce2281a-2bef-4510-8612-fcd699597c01 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': 'd6ab7649-ae0c-465c-8df2-c38dd824b992', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '2001:db8::/48', 'remote_group_id': 'f66384c6-f352-4f7c-95f6-e9ea8b489d0d'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:55.462757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-dce2281a-2bef-4510-8612-fcd699597c01 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:55.471172 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df59fb5b-d07b-464a-8ade-ef119e02ac47 req-695666ad-9205-4c30-af32-7cb92bd90da4 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1110311 May 12 15:22:55.488315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Pushing event updated for resources: {'Port': ['ID=4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:55.491650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Made reservation on behalf of 86574e26b5194d1f92a51749f063fa69 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:22:55.497306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:55.504325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-dce2281a-2bef-4510-8612-fcd699597c01 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:55.508623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-dce2281a-2bef-4510-8612-fcd699597c01 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:55.516054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-dce2281a-2bef-4510-8612-fcd699597c01 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:55.538519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairTestJSON-test-network-641066816'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:55.545962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f97be356-ad5d-4378-99af-7cc03d7d8f29 req-4b468c99-5158-4bd4-aa71-71997c7a149d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2857423 May 12 15:22:55.586835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:55.630257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:55.630986 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:55.632430 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-77a80f00-a853-4e24-9a09-8249f67c2538 service neutron] 10.222.0.84 "PUT /v2.0/ports/4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 HTTP/1.1" status: 200 len: 1092 time: 3.5438333 May 12 15:22:55.632897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c6664985-1799-40f2-b048-f9f4daa5401e', 'tag': '4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:55.658989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Usage tracker for resource:network and tenant:daa0af99633f4135975c6cd122c15437 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:55.675522 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-dce2281a-2bef-4510-8612-fcd699597c01 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:55.681602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dce2281a-2bef-4510-8612-fcd699597c01 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.2643263 May 12 15:22:55.688477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36568) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:55.775651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:55.794499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b10aa0-b768-4ba3-a4a0-986c7e636ef9 req-18f402c5-cd0d-4eda-ac36-71bcd95f4b35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:55.797226 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63b10aa0-b768-4ba3-a4a0-986c7e636ef9 req-18f402c5-cd0d-4eda-ac36-71bcd95f4b35 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=2d986451-1d91-468d-8a9c-ecc4da7a86bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5265999 May 12 15:22:55.889789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:55.991809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Made reservation on behalf of daa0af99633f4135975c6cd122c15437 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:22:55.999845 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:56.065665 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:56.149610 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fae93656-27a3-49be-a492-93f7ccb0db01 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:56.152862 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85cecc1c-32fd-4a0a-81d8-1cae95d4b2ca req-7529a070-7a91-4670-8b6c-217a2419f2cf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 210 time: 0.0833402 May 12 15:22:56.206974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:56.229119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Usage tracker for resource:security_group_rule and tenant:daa0af99633f4135975c6cd122c15437 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:56.229641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4346ea-f61d-422d-bbd5-fd81741dbd35 req-713c1b54-96ef-4e1c-b5e8-49edbf5501b3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:56.237657 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f4346ea-f61d-422d-bbd5-fd81741dbd35 req-713c1b54-96ef-4e1c-b5e8-49edbf5501b3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.5506949 May 12 15:22:56.240444 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fae93656-27a3-49be-a492-93f7ccb0db01 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:56.248384 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:56.251368 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63b10aa0-b768-4ba3-a4a0-986c7e636ef9 req-72193ff8-c500-49e5-982a-48ad074d4759 service neutron] 10.222.0.76 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4086332 May 12 15:22:56.292025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:56.293771 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-96102c40-7db7-4d34-b7cd-92267adf2468'] response: {'server_uuid': '7e3b9823-cd1e-48ee-8ba8-507d787c43bb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7e0c7266-ad09-4620-bfdc-81de7da01d15', 'code': 200} May 12 15:22:56.324843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-26aef85a-3b45-4258-bde1-83975e855a82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:56.353687 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-26aef85a-3b45-4258-bde1-83975e855a82 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e5a10df576841e2a4752a9d47fb790a&device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 1095 time: 0.5778263 May 12 15:22:56.384149 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:22:56.469334 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f4346ea-f61d-422d-bbd5-fd81741dbd35 req-06e0e376-6bb2-4c58-a52e-160ad31c2ad2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2306454 May 12 15:22:56.544585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Allocated IP 172.20.0.14 (b50584ea-1073-48d4-a2bc-43b11374a495/92a8d5fe-fb2b-414d-9ae2-15fb02337cd9/3665052f-787a-44a4-bee0-3335df3f44a6) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:22:56.662360 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fae93656-27a3-49be-a492-93f7ccb0db01 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:56.684572 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-ef01e1d5-5e62-4458-952c-c40adcecd44c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 HTTP/1.1" status: 200 len: 217 time: 0.2665324 May 12 15:22:56.751280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fae93656-27a3-49be-a492-93f7ccb0db01 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f66384c6-f352-4f7c-95f6-e9ea8b489d0d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:56.807270 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63b10aa0-b768-4ba3-a4a0-986c7e636ef9 req-2cc9bc04-0c9d-47d2-9bfd-a7583c3defd9 service neutron] 10.222.0.76 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4967580 May 12 15:22:56.811609 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fae93656-27a3-49be-a492-93f7ccb0db01 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:56.813551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fae93656-27a3-49be-a492-93f7ccb0db01 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "DELETE /v2.0/security-groups/f66384c6-f352-4f7c-95f6-e9ea8b489d0d HTTP/1.1" status: 204 len: 168 time: 1.1177797 May 12 15:22:56.836850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36580) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:56.868484 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-aca62be2-5acc-444a-b6ff-23f80d371b57'] response: {'name': 'network-changed', 'server_uuid': 'c6664985-1799-40f2-b048-f9f4daa5401e', 'tag': '4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31', 'status': 'completed', 'code': 200} May 12 15:22:56.923442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9c3cc3a-866c-4892-8b16-580f03fc0d2e req-55b991a1-3e53-4cc2-a9dd-761d8463b9e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:56.925236 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9c3cc3a-866c-4892-8b16-580f03fc0d2e req-55b991a1-3e53-4cc2-a9dd-761d8463b9e8 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 1097 time: 0.4291666 May 12 15:22:56.948058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 31c449ad-4a28-4740-9037-350aab14340e {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:22:56.990480 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:57.046506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Transition to ACTIVE for port object 31c449ad-4a28-4740-9037-350aab14340e will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:22:57.065284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-15f146a7-c60c-4c33-b3ca-eb55ba1b53f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:57.066982 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-15f146a7-c60c-4c33-b3ca-eb55ba1b53f0 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c90f4328-5e3e-4311-a3b6-84cff19a6919 HTTP/1.1" status: 200 len: 853 time: 0.3264642 May 12 15:22:57.089715 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:57.247031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-21dbdd40-86de-4b66-8afa-5766ce836caa tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Synchronizing usage tracker for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:22:57.262533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Pushing event updated for resources: {'Port': ['ID=31c449ad-4a28-4740-9037-350aab14340e,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:57.318484 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-b540839c-d41e-41d9-8235-f2dd42523cc7 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2197747 May 12 15:22:57.331158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-322d1298-5209-44de-be3f-59b40ab331e1 req-1ea6b921-8fae-4eb7-a116-8eae2bd47672 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:57.332820 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-322d1298-5209-44de-be3f-59b40ab331e1 req-1ea6b921-8fae-4eb7-a116-8eae2bd47672 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 931 time: 0.6592913 May 12 15:22:57.352601 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9c3cc3a-866c-4892-8b16-580f03fc0d2e req-10d749c5-98a4-43b8-8e4f-a5c9f7a1f42b service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4196165 May 12 15:22:57.392737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-21dbdd40-86de-4b66-8afa-5766ce836caa tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Unset dirty status for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:22:57.396699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-21dbdd40-86de-4b66-8afa-5766ce836caa tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4510 time: 0.5549664 May 12 15:22:57.396854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36586) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:57.428378 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:57.456708 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:57.459696 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-322d1298-5209-44de-be3f-59b40ab331e1 req-f134c954-54be-4471-bad5-dfb7cf806320 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1108737 May 12 15:22:57.558866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e9f8ee-2f7d-4b1b-9cdc-bf88b0e4a556 req-24628df7-94e3-4ef3-8d55-7aacfbcfbacd tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:57.567797 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22e9f8ee-2f7d-4b1b-9cdc-bf88b0e4a556 req-24628df7-94e3-4ef3-8d55-7aacfbcfbacd tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 945 time: 0.3959403 May 12 15:22:57.607109 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-71bc0e5f-fe90-4ff2-9ea1-0b68202f6936 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:57.666287 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22e9f8ee-2f7d-4b1b-9cdc-bf88b0e4a556 req-e07db74b-79f4-4550-8420-215ce672b98c tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0970345 May 12 15:22:57.674098 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-71bc0e5f-fe90-4ff2-9ea1-0b68202f6936 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:57.823917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 578} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:22:57.824543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94d40548-6ca5-4675-bf44-959627a0aead req-ffa5f45d-a08e-4763-a05c-673f4bd94fd6 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:57.826842 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-94d40548-6ca5-4675-bf44-959627a0aead req-ffa5f45d-a08e-4763-a05c-673f4bd94fd6 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 944 time: 0.1555109 May 12 15:22:57.828390 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-71bc0e5f-fe90-4ff2-9ea1-0b68202f6936 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:57.912285 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-1bf36089-4dc7-4534-8326-08dacfd24adb service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5167596 May 12 15:22:57.933347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71bc0e5f-fe90-4ff2-9ea1-0b68202f6936 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d6ab7649-ae0c-465c-8df2-c38dd824b992,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:57.934904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event updated for resources: {'SecurityGroup': ['ID=55a107aa-9703-4b76-af87-33ac05de7e52,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:57.963230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-94d40548-6ca5-4675-bf44-959627a0aead req-d9271e26-b490-4477-b24c-a991b7f14f72 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1264904 May 12 15:22:57.982528 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-71bc0e5f-fe90-4ff2-9ea1-0b68202f6936 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:57.989154 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-71bc0e5f-fe90-4ff2-9ea1-0b68202f6936 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "DELETE /v2.0/security-groups/d6ab7649-ae0c-465c-8df2-c38dd824b992 HTTP/1.1" status: 204 len: 168 time: 0.5913649 May 12 15:22:58.003023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36592) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:58.083463 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:58.083879 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Added segment 240bdfeb-be72-4a71-bbb7-fa83b0fb806e of type vlan for network 964ad372-fe57-4fd7-9c44-852ac0957b3c May 12 15:22:58.148070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f86b491-3739-4bca-bfd6-18b778e138bc req-08d3b6d5-e494-4970-bbdd-82580b9c6d80 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:58.150676 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f86b491-3739-4bca-bfd6-18b778e138bc req-08d3b6d5-e494-4970-bbdd-82580b9c6d80 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 945 time: 0.2620497 May 12 15:22:58.154400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-984313e6-660f-4d8e-9ca4-6bb4839763e9 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Synchronizing usage tracker for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:22:58.180829 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:58.212372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Attempting to bind port 31c449ad-4a28-4740-9037-350aab14340e on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:22:58.212713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Attempting to bind port 31c449ad-4a28-4740-9037-350aab14340e by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'ccba5697-f062-48f7-986e-3317afc51896', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:22:58.213166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Attempting to bind port 31c449ad-4a28-4740-9037-350aab14340e on network e7794860-7444-4123-96d5-ca3febf5e162 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:22:58.243366 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:58.251039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Port 31c449ad-4a28-4740-9037-350aab14340e on network e7794860-7444-4123-96d5-ca3febf5e162 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:22:58.251366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Attempting to bind port 31c449ad-4a28-4740-9037-350aab14340e on network e7794860-7444-4123-96d5-ca3febf5e162 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:22:58.273278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 22, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:22:58.273905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Checking segment: {'id': 'ccba5697-f062-48f7-986e-3317afc51896', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:22:58.274382 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Bound using segment: {'id': 'ccba5697-f062-48f7-986e-3317afc51896', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:22:58.274846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Bound port: 31c449ad-4a28-4740-9037-350aab14340e, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ccba5697-f062-48f7-986e-3317afc51896', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:22:58.275198 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:58.315703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-984313e6-660f-4d8e-9ca4-6bb4839763e9 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Unset dirty status for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:22:58.328213 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-984313e6-660f-4d8e-9ca4-6bb4839763e9 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.3130097 May 12 15:22:58.343705 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be097650-d783-447d-9324-3dabb0d85e2e req-514bb681-d20b-4e43-a294-98f7ffbdc74d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 210 time: 0.2069654 May 12 15:22:58.345940 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36596) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:58.352559 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c5bbbaa-08b2-4210-bd88-3031887d505d req-2b8387b5-3b9c-43b4-add4-1071353d85f4 service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4248295 May 12 15:22:58.396751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0a0edb06-5360-4f7f-a64b-04570ff126ea tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group': {'name': 'tempest-secgroup--36279941'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:58.427653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a0edb06-5360-4f7f-a64b-04570ff126ea tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:58.472507 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f86b491-3739-4bca-bfd6-18b778e138bc req-4b536905-e2b9-43d5-9647-31387f5d6cd5 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3090253 May 12 15:22:58.499916 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:58.508909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:58.509604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:58.528446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a0edb06-5360-4f7f-a64b-04570ff126ea tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:58.566980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:58.568306 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a0edb06-5360-4f7f-a64b-04570ff126ea tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:58.648293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a0edb06-5360-4f7f-a64b-04570ff126ea tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:58.661090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0a0edb06-5360-4f7f-a64b-04570ff126ea tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:58.667421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0a0edb06-5360-4f7f-a64b-04570ff126ea tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:58.697794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a0edb06-5360-4f7f-a64b-04570ff126ea tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:58.781894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] For port 31c449ad-4a28-4740-9037-350aab14340e, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:22:58.787790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] For port 31c449ad-4a28-4740-9037-350aab14340e, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=31c449ad-4a28-4740-9037-350aab14340e,segment=NetworkSegment(ccba5697-f062-48f7-986e-3317afc51896),segment_id=ccba5697-f062-48f7-986e-3317afc51896)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:22:58.913930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Network b50584ea-1073-48d4-a2bc-43b11374a495 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:22:58.940674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:22:58.943156 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:58.963126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:22:59.003824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baa6a950-83c9-4149-aa18-62874c7a6bef req-6b165dc0-bc3d-4c37-b93f-63c5fffe8fc6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:59.005833 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-baa6a950-83c9-4149-aa18-62874c7a6bef req-6b165dc0-bc3d-4c37-b93f-63c5fffe8fc6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.3149993 May 12 15:22:59.028087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:59.028834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:59.030301 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] 10.222.0.76 "PUT /v2.0/ports/31c449ad-4a28-4740-9037-350aab14340e HTTP/1.1" status: 200 len: 1091 time: 4.4097614 May 12 15:22:59.032821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '31e1782e-1e75-4738-9a0c-d51f4a6ee62c', 'tag': '31c449ad-4a28-4740-9037-350aab14340e'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:22:59.033652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1efe2c4b-3dbd-4cad-8e6e-3ecea11c832b req-aecde1cf-7114-436d-b3da-525143fabe90 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:59.035478 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1efe2c4b-3dbd-4cad-8e6e-3ecea11c832b req-aecde1cf-7114-436d-b3da-525143fabe90 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 943 time: 0.2562957 May 12 15:22:59.054195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event updated for resources: {'Network': ['ID=964ad372-fe57-4fd7-9c44-852ac0957b3c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:59.064005 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-75ed8fb1-884b-41d1-baa6-e8bd5860af0b tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 793 time: 4.0806758 May 12 15:22:59.076125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 964ad372-fe57-4fd7-9c44-852ac0957b3c details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:22:59.078045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36608) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:59.110310 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Request body: {'subnet': {'network_id': '964ad372-fe57-4fd7-9c44-852ac0957b3c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:59.125537 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1efe2c4b-3dbd-4cad-8e6e-3ecea11c832b req-bc0cfcb3-4550-4d16-b82d-ee8c3bdd9d2b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0810037 May 12 15:22:59.176457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-baa6a950-83c9-4149-aa18-62874c7a6bef req-7ae5a50d-ad00-4029-be3c-f882a28b1eda tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1534624 May 12 15:22:59.227929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'Port': ['ID=3665052f-787a-44a4-bee0-3335df3f44a6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:59.250245 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a0edb06-5360-4f7f-a64b-04570ff126ea tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:59.262796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:59.263766 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a0edb06-5360-4f7f-a64b-04570ff126ea tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:59.281613 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:59.390380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a0edb06-5360-4f7f-a64b-04570ff126ea tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event updated for resources: {'SecurityGroup': ['ID=09d4344c-ee66-4757-8d6e-20b929c76c95,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:59.413723 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a0edb06-5360-4f7f-a64b-04570ff126ea tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:59.418947 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0a0edb06-5360-4f7f-a64b-04570ff126ea tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1744 time: 1.0642064 May 12 15:22:59.419371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36614) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:59.435683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1b1ba4db-5f7c-457b-b0d8-b51ec7b7baec tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '09d4344c-ee66-4757-8d6e-20b929c76c95', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:59.464192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1b1ba4db-5f7c-457b-b0d8-b51ec7b7baec tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:59.605017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1b1ba4db-5f7c-457b-b0d8-b51ec7b7baec tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:59.616881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1b1ba4db-5f7c-457b-b0d8-b51ec7b7baec tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:59.625830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1b1ba4db-5f7c-457b-b0d8-b51ec7b7baec tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:59.628328 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-65a6d77b-530d-4662-aec5-7972485b048a req-b61df6de-ff30-4eca-bd5f-8547f9f8dbeb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 5.0308962 May 12 15:22:59.672713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Request body: {'port': {'device_id': '9848e953-d1fb-4bb4-8995-1f62bf3efd1c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:59.726028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:59.739027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd66c16c-ff20-4b96-bf97-b8c8bdbec731 req-47f38562-c3bf-453c-9db7-88031b14b8dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:59.740903 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd66c16c-ff20-4b96-bf97-b8c8bdbec731 req-47f38562-c3bf-453c-9db7-88031b14b8dc service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e5a10df576841e2a4752a9d47fb790a&device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 1095 time: 0.9513199 May 12 15:22:59.751204 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-1b1ba4db-5f7c-457b-b0d8-b51ec7b7baec tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:59.751704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4778c217-c36d-49b7-9bc5-8c9b8b7b858a service neutron] Pushing event updated for resources: {'Port': ['ID=31c449ad-4a28-4740-9037-350aab14340e,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:22:59.754819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Usage tracker for resource:subnet and tenant:daa0af99633f4135975c6cd122c15437 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:59.756109 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1b1ba4db-5f7c-457b-b0d8-b51ec7b7baec tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.3357487 May 12 15:22:59.757662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36620) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:59.770587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-416d9787-d27f-4971-9480-13cba68cbbca tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group_rule': {'security_group_id': '09d4344c-ee66-4757-8d6e-20b929c76c95', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:22:59.777560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-416d9787-d27f-4971-9480-13cba68cbbca tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:22:59.782867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-416d9787-d27f-4971-9480-13cba68cbbca tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:22:59.784699 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:59.786023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-416d9787-d27f-4971-9480-13cba68cbbca tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:22:59.793030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-416d9787-d27f-4971-9480-13cba68cbbca tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:59.799585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:22:59.829701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514f5f0f-d3d8-4417-84b3-f1b58b37ace6 req-1e78b67b-714c-449e-93b2-c232af1a8b11 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:59.850121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-514f5f0f-d3d8-4417-84b3-f1b58b37ace6 req-1e78b67b-714c-449e-93b2-c232af1a8b11 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 944 time: 0.4008179 May 12 15:22:59.867730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-accffe5a-6095-42a8-b34f-e9045002accd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:59.869359 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-accffe5a-6095-42a8-b34f-e9045002accd service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9e2382be0c6f4779ae64026a57628773&device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 1094 time: 0.6310346 May 12 15:22:59.874916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a406deb7-738a-437a-aeb6-3bea872443cb req-0a784c01-5a46-4c7d-9a02-2a43ccaac3c7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:22:59.876581 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a406deb7-738a-437a-aeb6-3bea872443cb req-0a784c01-5a46-4c7d-9a02-2a43ccaac3c7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 945 time: 0.4153268 May 12 15:22:59.949931 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-416d9787-d27f-4971-9480-13cba68cbbca tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:22:59.953828 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-416d9787-d27f-4971-9480-13cba68cbbca tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.1861241 May 12 15:22:59.956523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36626) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:22:59.966289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Made reservation on behalf of daa0af99633f4135975c6cd122c15437 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:22:59.970941 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:22:59.972161 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-514f5f0f-d3d8-4417-84b3-f1b58b37ace6 req-95595939-4d4d-46d6-a997-87cc77a1e39d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0943594 May 12 15:22:59.987253 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a406deb7-738a-437a-aeb6-3bea872443cb req-4eb15976-05e5-44c1-8096-316b4f66b8c8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1015506 May 12 15:23:00.257019 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a1f3a2b4-6bc1-4c4f-9715-1a45e581591d'] response: {'name': 'network-changed', 'server_uuid': '31e1782e-1e75-4738-9a0c-d51f4a6ee62c', 'tag': '31c449ad-4a28-4740-9037-350aab14340e', 'status': 'completed', 'code': 200} May 12 15:23:00.457188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea372672-5041-4242-8e51-a3759693afd6 req-97496019-ab61-40fc-8df0-6f0c0cfce24a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:00.458786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea372672-5041-4242-8e51-a3759693afd6 req-97496019-ab61-40fc-8df0-6f0c0cfce24a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 932 time: 0.2699897 May 12 15:23:00.488302 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:00.531666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed69bf0b-5caf-4554-a842-2085fb5321a0 req-5d761554-185c-43dd-837d-4d33c509dfb8 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:00.533312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed69bf0b-5caf-4554-a842-2085fb5321a0 req-5d761554-185c-43dd-837d-4d33c509dfb8 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.76 "GET /v2.0/ports?device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 945 time: 0.2530673 May 12 15:23:00.545481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87c52b60-cd47-41e4-a9c3-f8d6f2b34017 req-cd7c1feb-99d3-40b6-8503-acdad5ad9362 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:00.553771 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87c52b60-cd47-41e4-a9c3-f8d6f2b34017 req-cd7c1feb-99d3-40b6-8503-acdad5ad9362 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 945 time: 0.2301466 May 12 15:23:00.579468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ea372672-5041-4242-8e51-a3759693afd6 req-2569a7c0-096b-4f88-9cb4-7661b5427747 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Synchronizing usage tracker for tenant:86574e26b5194d1f92a51749f063fa69 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:00.622590 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-04465d16-10ee-4d25-8b44-4d9035670cd1 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=31c449ad-4a28-4740-9037-350aab14340e HTTP/1.1" status: 200 len: 217 time: 0.3674502 May 12 15:23:00.623790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd66c16c-ff20-4b96-bf97-b8c8bdbec731 req-6428f599-caa6-4632-8d9f-d091707d5f89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:00.625958 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd66c16c-ff20-4b96-bf97-b8c8bdbec731 req-6428f599-caa6-4632-8d9f-d091707d5f89 service neutron] 10.222.0.84 "GET /v2.0/networks?id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61 HTTP/1.1" status: 200 len: 914 time: 0.8679800 May 12 15:23:00.637170 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87c52b60-cd47-41e4-a9c3-f8d6f2b34017 req-4b5e8d31-74d7-4ca0-b553-2d4527d95d1f tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups?id=bcceeef8-0214-44d0-9671-29d985971221&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0820396 May 12 15:23:00.639703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ea372672-5041-4242-8e51-a3759693afd6 req-2569a7c0-096b-4f88-9cb4-7661b5427747 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Unset dirty status for tenant:86574e26b5194d1f92a51749f063fa69 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:00.641285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea372672-5041-4242-8e51-a3759693afd6 req-2569a7c0-096b-4f88-9cb4-7661b5427747 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1759260 May 12 15:23:00.790222 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aac48ee7-4298-42f0-98d9-e6af8ac4fcfe tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:00.799735 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd66c16c-ff20-4b96-bf97-b8c8bdbec731 req-cb225c56-d3eb-445d-a3f1-2a55a932d092 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 HTTP/1.1" status: 200 len: 217 time: 0.1617498 May 12 15:23:00.858228 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aac48ee7-4298-42f0-98d9-e6af8ac4fcfe tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:00.920656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb27b2e4-96a9-4dc7-a4a4-32d70245d7ce req-7c0a47eb-c33c-423a-a37e-6a80faf695f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:00.925773 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb27b2e4-96a9-4dc7-a4a4-32d70245d7ce req-7c0a47eb-c33c-423a-a37e-6a80faf695f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.1211302 May 12 15:23:01.007481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc3ce91-878b-4ebd-b3ac-d2735117fe36 req-0d2ac64e-6372-4fa1-830e-553ecb60aeb7 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:01.015083 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dcc3ce91-878b-4ebd-b3ac-d2735117fe36 req-0d2ac64e-6372-4fa1-830e-553ecb60aeb7 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 943 time: 0.2552502 May 12 15:23:01.072894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-97faa5b9-43df-4a30-9786-bcd23847b7a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:01.074450 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-97faa5b9-43df-4a30-9786-bcd23847b7a1 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=eae80ee9-f335-4892-af0b-41490fc3c6b5 HTTP/1.1" status: 200 len: 850 time: 0.1469066 May 12 15:23:01.090923 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aac48ee7-4298-42f0-98d9-e6af8ac4fcfe tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:01.123305 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:01.132015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-ed69bf0b-5caf-4554-a842-2085fb5321a0 req-26977fb9-b37f-49d3-95e8-bb6d897a5b67 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Deleting port e5cef5d1-de9a-4a98-991a-e31c8958610d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:01.132347 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed69bf0b-5caf-4554-a842-2085fb5321a0 req-26977fb9-b37f-49d3-95e8-bb6d897a5b67 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:01.210696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event updated for resources: {'Subnet': ['ID=126daff2-fa1d-4ce6-a721-83e207b54aab,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:01.212918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aac48ee7-4298-42f0-98d9-e6af8ac4fcfe tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=09d4344c-ee66-4757-8d6e-20b929c76c95,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:01.245479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd66c16c-ff20-4b96-bf97-b8c8bdbec731 req-6e90dc22-18e8-4733-aa6f-757a3db6920b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:01.247182 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd66c16c-ff20-4b96-bf97-b8c8bdbec731 req-6e90dc22-18e8-4733-aa6f-757a3db6920b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c90f4328-5e3e-4311-a3b6-84cff19a6919 HTTP/1.1" status: 200 len: 853 time: 0.4322121 May 12 15:23:01.337680 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:23:01.362424 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd66c16c-ff20-4b96-bf97-b8c8bdbec731 req-9dda4d4e-d38d-4e1e-9bab-5c376ecc40c5 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1050639 May 12 15:23:01.464542 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aac48ee7-4298-42f0-98d9-e6af8ac4fcfe tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:01.469138 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aac48ee7-4298-42f0-98d9-e6af8ac4fcfe tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "DELETE /v2.0/security-groups/09d4344c-ee66-4757-8d6e-20b929c76c95 HTTP/1.1" status: 204 len: 168 time: 1.5125675 May 12 15:23:01.469907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36638) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:01.473970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dcc3ce91-878b-4ebd-b3ac-d2735117fe36 req-23b53a31-46c5-4428-8c87-feaa12c93a7c tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4577949 May 12 15:23:01.481552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Checking segment: {'id': '240bdfeb-be72-4a71-bbb7-fa83b0fb806e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '964ad372-fe57-4fd7-9c44-852ac0957b3c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:23:01.481985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Network hostable DHCP agents. Network: 964ad372-fe57-4fd7-9c44-852ac0957b3c, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:23:01.520799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb27b2e4-96a9-4dc7-a4a4-32d70245d7ce req-7a7fc8d4-398b-4cf1-a4d5-8597ff88228d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5571916 May 12 15:23:01.580690 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-e38fb558-0bc7-46b7-8d6b-fecd9b53410d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e7794860-7444-4123-96d5-ca3febf5e162&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1993759 May 12 15:23:01.774065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5129beb1-0106-4da2-948b-abe8eb87b9b5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Synchronizing usage tracker for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:01.796810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:01.819129 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31', 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61', 'port_id': '4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31', 'mac_address': 'fa:16:3e:4e:3c:67', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 559, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c90f4328-5e3e-4311-a3b6-84cff19a6919', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:23:01.884413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Network 964ad372-fe57-4fd7-9c44-852ac0957b3c is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:23:01.890743 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:01.918642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:23:01.958072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:01.963165 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:01.991653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f79d5cd-4e4a-447b-9a58-ff3ffab97e58 req-72747a2a-7117-4aa9-80c1-5953d2223e0f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:01.993280 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f79d5cd-4e4a-447b-9a58-ff3ffab97e58 req-72747a2a-7117-4aa9-80c1-5953d2223e0f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 944 time: 0.1892157 May 12 15:23:01.995295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-ed69bf0b-5caf-4554-a842-2085fb5321a0 req-26977fb9-b37f-49d3-95e8-bb6d897a5b67 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] For port e5cef5d1-de9a-4a98-991a-e31c8958610d, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e5cef5d1-de9a-4a98-991a-e31c8958610d,segment=NetworkSegment(dbf5199c-277c-4a55-97b5-ab215591dbbb),segment_id=dbf5199c-277c-4a55-97b5-ab215591dbbb)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:01.995754 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed69bf0b-5caf-4554-a842-2085fb5321a0 req-26977fb9-b37f-49d3-95e8-bb6d897a5b67 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:02.064381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:02.100188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-840877a7-2254-4504-85ee-f3c959a46a55 req-9dbbaf82-f35e-4ab7-930c-bb2871370034 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:02.116291 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-840877a7-2254-4504-85ee-f3c959a46a55 req-9dbbaf82-f35e-4ab7-930c-bb2871370034 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 945 time: 0.3981738 May 12 15:23:02.135764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 964ad372-fe57-4fd7-9c44-852ac0957b3c) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:02.141519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:02.142097 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:02.151588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a68b4ce1-b58c-4604-be11-82ee341bfc2e None None] Network 964ad372-fe57-4fd7-9c44-852ac0957b3c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:23:02.165152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5129beb1-0106-4da2-948b-abe8eb87b9b5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Unset dirty status for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:02.170088 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5129beb1-0106-4da2-948b-abe8eb87b9b5 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.6779983 May 12 15:23:02.188808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36648) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:02.235142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-aaef1c76-94d0-4b62-8b04-c355f476e265 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group': {'name': 'tempest-secgroup--1773655145'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:02.289771 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-aaef1c76-94d0-4b62-8b04-c355f476e265 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:02.294165 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd66c16c-ff20-4b96-bf97-b8c8bdbec731 req-1069d361-7671-4ffd-9da3-4a152e2b4933 service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9188323 May 12 15:23:02.304590 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ab8df5f0-5dd2-4804-845d-af0e8fe1babc tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 3.2232368 May 12 15:23:02.339075 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:02.343477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:02.379210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-ed69bf0b-5caf-4554-a842-2085fb5321a0 req-26977fb9-b37f-49d3-95e8-bb6d897a5b67 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Calling delete_port for e5cef5d1-de9a-4a98-991a-e31c8958610d owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:02.459417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36652) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:02.515893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Request body: {'port': {'network_id': '964ad372-fe57-4fd7-9c44-852ac0957b3c', 'name': 'tempest-AllowedAddressPairTestJSON-1844769345'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:02.543616 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd66c16c-ff20-4b96-bf97-b8c8bdbec731 req-e91a9670-623b-4372-b4af-85dd0aa95e28 service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2408977 May 12 15:23:02.545479 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-61e930b8-4f8d-4411-9be8-147a24017e28 service neutron] 10.222.0.76 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8023720 May 12 15:23:02.643388 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-aaef1c76-94d0-4b62-8b04-c355f476e265 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:02.680082 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-964ad372-fe57-4fd7-9c44-852ac0957b3c', 'network_id': '964ad372-fe57-4fd7-9c44-852ac0957b3c', 'tenant_id': 'daa0af99633f4135975c6cd122c15437', 'fixed_ips': [{'subnet_id': '126daff2-fa1d-4ce6-a721-83e207b54aab'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:23:02.680896 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:02.753992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-840877a7-2254-4504-85ee-f3c959a46a55 req-ce90e843-d54f-483f-94d7-8cdd886aaa57 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.6366358 May 12 15:23:02.789728 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f79d5cd-4e4a-447b-9a58-ff3ffab97e58 req-daeae83a-50bd-45cd-8e6e-0478ebf5d835 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7703781 May 12 15:23:02.823751 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aaef1c76-94d0-4b62-8b04-c355f476e265 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:02.866473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3665052f-787a-44a4-bee0-3335df3f44a6 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:23:03.095361 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed69bf0b-5caf-4554-a842-2085fb5321a0 req-26977fb9-b37f-49d3-95e8-bb6d897a5b67 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:03.163656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf5e4d91-0c3d-4df5-946c-b52b2f00fbbc req-bccf0ed7-30d8-4001-af22-aff64059b426 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/ports?device_id=5db95aab-1524-4c89-b6a8-c4ac8dbf3751 HTTP/1.1" status: 200 len: 210 time: 0.1149206 May 12 15:23:03.191967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26977fb9-b37f-49d3-95e8-bb6d897a5b67 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Pushing event deleted for resources: {'Port': ['ID=e5cef5d1-de9a-4a98-991a-e31c8958610d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:03.254196 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Allocated IP 172.20.0.2 (964ad372-fe57-4fd7-9c44-852ac0957b3c/126daff2-fa1d-4ce6-a721-83e207b54aab/cbd15264-d9b5-43e6-9659-cabbaba9ac01) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:23:03.326104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:03.331739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Usage tracker for resource:port and tenant:daa0af99633f4135975c6cd122c15437 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:03.335723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:03.342174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:03.428056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Made reservation on behalf of daa0af99633f4135975c6cd122c15437 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:03.429062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:03.431862 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:03.468576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-ed69bf0b-5caf-4554-a842-2085fb5321a0 req-26977fb9-b37f-49d3-95e8-bb6d897a5b67 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] No DVR routers for this DVR port e5cef5d1-de9a-4a98-991a-e31c8958610d on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:23:03.473926 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed69bf0b-5caf-4554-a842-2085fb5321a0 req-26977fb9-b37f-49d3-95e8-bb6d897a5b67 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:03.485511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5db95aab-1524-4c89-b6a8-c4ac8dbf3751', 'name': 'network-vif-deleted', 'tag': 'e5cef5d1-de9a-4a98-991a-e31c8958610d'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:03.501497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-aaef1c76-94d0-4b62-8b04-c355f476e265 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:03.505486 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b8a430e2-411d-4cfa-85b9-6430f7787379 req-df7fe79b-0249-4b08-b866-71c6e07992ef service neutron] 10.222.0.76 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8960004 May 12 15:23:03.506612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Transition to ACTIVE for port object 3665052f-787a-44a4-bee0-3335df3f44a6 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:03.509937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-aaef1c76-94d0-4b62-8b04-c355f476e265 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Usage tracker for resource:security_group_rule and tenant:0f5f77410c674422986162733d4c0337 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:03.513892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-aaef1c76-94d0-4b62-8b04-c355f476e265 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:03.521496 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:03.544201 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed69bf0b-5caf-4554-a842-2085fb5321a0 req-26977fb9-b37f-49d3-95e8-bb6d897a5b67 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.76 "DELETE /v2.0/ports/e5cef5d1-de9a-4a98-991a-e31c8958610d HTTP/1.1" status: 204 len: 173 time: 2.6200745 May 12 15:23:03.544987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-aaef1c76-94d0-4b62-8b04-c355f476e265 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:03.552875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] device_id is not set on port ef55421d-c37e-4cbd-b89c-b51db8cae969 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:23:03.783905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37b131c7-92a9-4fd1-a983-a8f00985d456 req-5f76ec9a-a797-4ba1-b071-f4af7b51927c tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:03.784887 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:03.786632 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37b131c7-92a9-4fd1-a983-a8f00985d456 req-5f76ec9a-a797-4ba1-b071-f4af7b51927c tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 932 time: 0.5847964 May 12 15:23:03.799028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Transition to ACTIVE for port object cbd15264-d9b5-43e6-9659-cabbaba9ac01 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:03.835619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Transition to ACTIVE for port object cbd15264-d9b5-43e6-9659-cabbaba9ac01 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:03.848772 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:03.855662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51dd5a67-5703-43ac-adee-970d1e76ef12 req-ca1c24bb-8c3a-4977-93c7-050513e86775 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:03.866037 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-51dd5a67-5703-43ac-adee-970d1e76ef12 req-ca1c24bb-8c3a-4977-93c7-050513e86775 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 943 time: 0.3723197 May 12 15:23:03.903796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Pushing event updated for resources: {'Port': ['ID=3665052f-787a-44a4-bee0-3335df3f44a6,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:03.928456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Network 964ad372-fe57-4fd7-9c44-852ac0957b3c is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:23:03.931715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:03.935170 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:23:03.943966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Pushing event updated for resources: {'Port': ['ID=cbd15264-d9b5-43e6-9659-cabbaba9ac01,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:03.976987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37b131c7-92a9-4fd1-a983-a8f00985d456 req-3af66467-f02e-44f2-81a8-0e1225579865 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1752930 May 12 15:23:04.011563 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Allocated IP 172.20.0.11 (964ad372-fe57-4fd7-9c44-852ac0957b3c/126daff2-fa1d-4ce6-a721-83e207b54aab/ef55421d-c37e-4cbd-b89c-b51db8cae969) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:23:04.022305 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aaef1c76-94d0-4b62-8b04-c355f476e265 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:04.025267 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Attempting to bind port 3665052f-787a-44a4-bee0-3335df3f44a6 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:23:04.025806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Attempting to bind port 3665052f-787a-44a4-bee0-3335df3f44a6 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '2b9a3118-674a-42bd-be1d-3a0efcec85f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'b50584ea-1073-48d4-a2bc-43b11374a495'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:23:04.026232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Attempting to bind port 3665052f-787a-44a4-bee0-3335df3f44a6 on network b50584ea-1073-48d4-a2bc-43b11374a495 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:23:04.033268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Port 3665052f-787a-44a4-bee0-3335df3f44a6 on network b50584ea-1073-48d4-a2bc-43b11374a495 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:23:04.033822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Attempting to bind port 3665052f-787a-44a4-bee0-3335df3f44a6 on network b50584ea-1073-48d4-a2bc-43b11374a495 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:23:04.038145 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aaef1c76-94d0-4b62-8b04-c355f476e265 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:04.042654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Attempting to bind port cbd15264-d9b5-43e6-9659-cabbaba9ac01 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:23:04.043183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Attempting to bind port cbd15264-d9b5-43e6-9659-cabbaba9ac01 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '240bdfeb-be72-4a71-bbb7-fa83b0fb806e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '964ad372-fe57-4fd7-9c44-852ac0957b3c'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:23:04.043706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Attempting to bind port cbd15264-d9b5-43e6-9659-cabbaba9ac01 on network 964ad372-fe57-4fd7-9c44-852ac0957b3c {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:23:04.048169 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-51dd5a67-5703-43ac-adee-970d1e76ef12 req-838cd9c1-6364-4f45-8f20-774bea07c81e tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1757455 May 12 15:23:04.052279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 22, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:23:04.052877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Checking segment: {'id': '240bdfeb-be72-4a71-bbb7-fa83b0fb806e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '964ad372-fe57-4fd7-9c44-852ac0957b3c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:23:04.053485 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:04.054026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Bound using segment: {'id': '240bdfeb-be72-4a71-bbb7-fa83b0fb806e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '964ad372-fe57-4fd7-9c44-852ac0957b3c'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:23:04.054819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Bound port: cbd15264-d9b5-43e6-9659-cabbaba9ac01, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '240bdfeb-be72-4a71-bbb7-fa83b0fb806e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '964ad372-fe57-4fd7-9c44-852ac0957b3c'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:23:04.055363 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:04.066387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 22, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:23:04.066387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Checking segment: {'id': '2b9a3118-674a-42bd-be1d-3a0efcec85f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'b50584ea-1073-48d4-a2bc-43b11374a495'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:23:04.066387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Bound using segment: {'id': '2b9a3118-674a-42bd-be1d-3a0efcec85f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'b50584ea-1073-48d4-a2bc-43b11374a495'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:23:04.066387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Bound port: 3665052f-787a-44a4-bee0-3335df3f44a6, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2b9a3118-674a-42bd-be1d-3a0efcec85f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'b50584ea-1073-48d4-a2bc-43b11374a495'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:23:04.066387 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:04.144265 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-40bc354f-46a3-47ee-a07d-dd5a743a7d79'] response: {'server_uuid': '5db95aab-1524-4c89-b6a8-c4ac8dbf3751', 'name': 'network-vif-deleted', 'tag': 'e5cef5d1-de9a-4a98-991a-e31c8958610d', 'status': 'completed', 'code': 200} May 12 15:23:04.154245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaef1c76-94d0-4b62-8b04-c355f476e265 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event updated for resources: {'SecurityGroup': ['ID=02df4787-6ff9-4a01-90c2-168707ccb42b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:04.170099 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aaef1c76-94d0-4b62-8b04-c355f476e265 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:04.174541 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aaef1c76-94d0-4b62-8b04-c355f476e265 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 1.9774873 May 12 15:23:04.175019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36668) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:04.183380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6470f788-6f5c-404d-99b2-4dffa9d27ecd tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Request body: {'security_group': {'name': 'default'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:04.184303 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-6470f788-6f5c-404d-99b2-4dffa9d27ecd tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. May 12 15:23:04.185071 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-6470f788-6f5c-404d-99b2-4dffa9d27ecd tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] update failed (client error): There was a conflict when trying to complete your request. May 12 15:23:04.191113 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6470f788-6f5c-404d-99b2-4dffa9d27ecd tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "PUT /v2.0/security-groups/02df4787-6ff9-4a01-90c2-168707ccb42b HTTP/1.1" status: 409 len: 330 time: 0.0101719 May 12 15:23:04.197287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] For port cbd15264-d9b5-43e6-9659-cabbaba9ac01, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:23:04.201799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36674) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:04.202760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] For port cbd15264-d9b5-43e6-9659-cabbaba9ac01, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cbd15264-d9b5-43e6-9659-cabbaba9ac01,segment=NetworkSegment(240bdfeb-be72-4a71-bbb7-fa83b0fb806e),segment_id=240bdfeb-be72-4a71-bbb7-fa83b0fb806e)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:23:04.215663 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:04.245192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] For port 3665052f-787a-44a4-bee0-3335df3f44a6, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:23:04.269443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] For port 3665052f-787a-44a4-bee0-3335df3f44a6, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3665052f-787a-44a4-bee0-3335df3f44a6,segment=NetworkSegment(2b9a3118-674a-42bd-be1d-3a0efcec85f0),segment_id=2b9a3118-674a-42bd-be1d-3a0efcec85f0)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:23:04.286589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:04.355477 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0b48903c-6904-45a3-bc08-44da4eef1a7e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:04.379661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a678a0d8-bb8d-4b1e-b1d9-8226e957ad6a None None] Pushing event updated for resources: {'Port': ['ID=cbd15264-d9b5-43e6-9659-cabbaba9ac01,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:04.417101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:04.417945 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:04.419669 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-65a6d77b-530d-4662-aec5-7972485b048a req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] 10.222.0.84 "PUT /v2.0/ports/3665052f-787a-44a4-bee0-3335df3f44a6 HTTP/1.1" status: 200 len: 1092 time: 4.7595057 May 12 15:23:04.423145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9848e953-d1fb-4bb4-8995-1f62bf3efd1c', 'tag': '3665052f-787a-44a4-bee0-3335df3f44a6'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:04.452421 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0b48903c-6904-45a3-bc08-44da4eef1a7e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:04.465135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a13d3341-b0d8-45ea-94cc-f22f2c9d9b58 service neutron] Pushing event updated for resources: {'Port': ['ID=3665052f-787a-44a4-bee0-3335df3f44a6,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:04.571284 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0b48903c-6904-45a3-bc08-44da4eef1a7e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:04.587851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b48903c-6904-45a3-bc08-44da4eef1a7e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=02df4787-6ff9-4a01-90c2-168707ccb42b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:04.616561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e5cef5d1-de9a-4a98-991a-e31c8958610d no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:23:04.622838 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0b48903c-6904-45a3-bc08-44da4eef1a7e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:04.623965 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0b48903c-6904-45a3-bc08-44da4eef1a7e tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "DELETE /v2.0/security-groups/02df4787-6ff9-4a01-90c2-168707ccb42b HTTP/1.1" status: 204 len: 168 time: 0.4210789 May 12 15:23:04.627156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a6d77b-530d-4662-aec5-7972485b048a req-bbfbaac5-d966-4a5d-b256-8dfda4aaded9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:04.628572 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-65a6d77b-530d-4662-aec5-7972485b048a req-bbfbaac5-d966-4a5d-b256-8dfda4aaded9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=86574e26b5194d1f92a51749f063fa69&device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 1095 time: 0.1321619 May 12 15:23:04.629040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36680) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:04.673310 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: e5cef5d1-de9a-4a98-991a-e31c8958610d {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:23:04.696246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e5cef5d1-de9a-4a98-991a-e31c8958610d not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:23:04.721951 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-65a6d77b-530d-4662-aec5-7972485b048a req-e8db22bf-6ddc-4425-a3ad-7c0a90474ac6 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=3665052f-787a-44a4-bee0-3335df3f44a6 HTTP/1.1" status: 200 len: 217 time: 0.0778308 May 12 15:23:04.802317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7c5de114-147e-46e6-844a-e6d0411dc1f6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Synchronizing usage tracker for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:04.821814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a6d77b-530d-4662-aec5-7972485b048a req-693cc923-38aa-43ba-84d5-77c852b0a71d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:04.823250 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-65a6d77b-530d-4662-aec5-7972485b048a req-693cc923-38aa-43ba-84d5-77c852b0a71d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=92a8d5fe-fb2b-414d-9ae2-15fb02337cd9 HTTP/1.1" status: 200 len: 853 time: 0.0915465 May 12 15:23:04.838241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44851304-42f9-41f3-91ba-4ab24e67439b req-7cc15505-2a5b-411d-81da-a83df5fe0938 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:04.842166 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44851304-42f9-41f3-91ba-4ab24e67439b req-7cc15505-2a5b-411d-81da-a83df5fe0938 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.7476995 May 12 15:23:04.854719 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:04.864804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7c5de114-147e-46e6-844a-e6d0411dc1f6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] Unset dirty status for tenant:0f5f77410c674422986162733d4c0337 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:04.866701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-887db315-49bc-4e9b-bb82-0d3cc6573c91 req-bf1360f0-aeb7-4fb4-bff3-7c7766cb12ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:04.867865 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:23:04.869858 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7c5de114-147e-46e6-844a-e6d0411dc1f6 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.2390325 May 12 15:23:04.870784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36684) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:04.871544 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-887db315-49bc-4e9b-bb82-0d3cc6573c91 req-bf1360f0-aeb7-4fb4-bff3-7c7766cb12ba service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9e2382be0c6f4779ae64026a57628773&device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 1094 time: 0.6180549 May 12 15:23:04.896644 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-65a6d77b-530d-4662-aec5-7972485b048a req-7fea69b2-dc49-42f6-bbdf-f264c3003552 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b50584ea-1073-48d4-a2bc-43b11374a495&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0657022 May 12 15:23:04.899405 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-06d6f441-03b9-4b2f-b52a-d992b570195f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] delete failed (client error): The resource could not be found. May 12 15:23:04.903751 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-06d6f441-03b9-4b2f-b52a-d992b570195f tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "DELETE /v2.0/security-groups/a9ba691d-25a2-4d02-99c8-9eaba2d7406a HTTP/1.1" status: 404 len: 347 time: 0.0232222 May 12 15:23:04.921442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36688) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:05.004009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Transition to ACTIVE for port object ef55421d-c37e-4cbd-b89c-b51db8cae969 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:05.032836 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-c9c8f19f-ae2d-4f51-a107-292b0520b445 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] show failed (client error): The resource could not be found. May 12 15:23:05.034242 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c9c8f19f-ae2d-4f51-a107-292b0520b445 tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "GET /v2.0/security-groups/eaa4fa82-676f-438d-ab87-49f3a62e0cdb HTTP/1.1" status: 404 len: 347 time: 0.1082895 May 12 15:23:05.041678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cbd15264-d9b5-43e6-9659-cabbaba9ac01 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:23:05.047493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36694) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:05.047994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81dc6bce-7c07-43dc-903e-78a029b83593 req-6797295a-85bc-453a-b260-996862da6b3b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:05.049537 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81dc6bce-7c07-43dc-903e-78a029b83593 req-6797295a-85bc-453a-b260-996862da6b3b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 945 time: 0.4699233 May 12 15:23:05.079768 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-21190f12-da80-4cd6-96d0-5b24be73a4bf tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] show failed (client error): The resource could not be found. May 12 15:23:05.085477 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-21190f12-da80-4cd6-96d0-5b24be73a4bf tempest-NegativeSecGroupIPv6Test-1676524625 tempest-NegativeSecGroupIPv6Test-1676524625-project] 10.222.0.82 "GET /v2.0/security-group-rules/4ecba670-087b-4f7f-934a-4d0f4b3cf01e HTTP/1.1" status: 404 len: 356 time: 0.0320194 May 12 15:23:05.085676 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44851304-42f9-41f3-91ba-4ab24e67439b req-5313b278-30c0-4ebf-be5c-338ef2a11278 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2320747 May 12 15:23:05.085793 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-65a6d77b-530d-4662-aec5-7972485b048a req-ae4e3827-f7a6-41c0-8700-8a12617d5877 service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1786575 May 12 15:23:05.166687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port cbd15264-d9b5-43e6-9659-cabbaba9ac01 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:05.227211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-887db315-49bc-4e9b-bb82-0d3cc6573c91 req-e605f9b7-9f90-45e2-aabc-d6a37d9e4f93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:05.228679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-887db315-49bc-4e9b-bb82-0d3cc6573c91 req-e605f9b7-9f90-45e2-aabc-d6a37d9e4f93 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e7794860-7444-4123-96d5-ca3febf5e162 HTTP/1.1" status: 200 len: 911 time: 0.3366735 May 12 15:23:05.232790 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81dc6bce-7c07-43dc-903e-78a029b83593 req-690f831a-f7a5-40a1-9cfc-26aaef6648e3 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1662288 May 12 15:23:05.308377 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-65a6d77b-530d-4662-aec5-7972485b048a req-397695db-5fc4-489c-aa2c-ed8767d276f0 service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2182198 May 12 15:23:05.365501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:23:05.439510 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:05.452024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-887db315-49bc-4e9b-bb82-0d3cc6573c91 req-b6a8bdb6-dfb0-4896-9722-dac51e366817 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=31c449ad-4a28-4740-9037-350aab14340e HTTP/1.1" status: 200 len: 217 time: 0.2167804 May 12 15:23:05.479652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:05.486128 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a49f511d-c018-49bc-8550-aa9aa3205f8c'] response: {'name': 'network-changed', 'server_uuid': '9848e953-d1fb-4bb4-8995-1f62bf3efd1c', 'tag': '3665052f-787a-44a4-bee0-3335df3f44a6', 'status': 'completed', 'code': 200} May 12 15:23:05.488498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:05.488924 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:05.590982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36706) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:05.630947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Network 964ad372-fe57-4fd7-9c44-852ac0957b3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:23:05.645927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:05.648930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:23:05.653916 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:05.693039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c6664985-1799-40f2-b048-f9f4daa5401e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:05.709054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:05.716774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45327db6-0d02-4050-aee5-054d5bbbb82b req-c088bcf7-38ba-4014-a4fa-998e7d719175 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:05.719490 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45327db6-0d02-4050-aee5-054d5bbbb82b req-c088bcf7-38ba-4014-a4fa-998e7d719175 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=86574e26b5194d1f92a51749f063fa69&device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 1095 time: 0.1713760 May 12 15:23:05.721274 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:05.757654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event updated for resources: {'Port': ['ID=ef55421d-c37e-4cbd-b89c-b51db8cae969,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:05.773853 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-887db315-49bc-4e9b-bb82-0d3cc6573c91 req-271561a5-f9d5-436b-9b62-d66b08de81e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:05.775682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-887db315-49bc-4e9b-bb82-0d3cc6573c91 req-271561a5-f9d5-436b-9b62-d66b08de81e1 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=eae80ee9-f335-4892-af0b-41490fc3c6b5 HTTP/1.1" status: 200 len: 850 time: 0.2656467 May 12 15:23:05.813092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:05.822274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cbc2e5c-2f46-4791-b2dd-8238c12a55cb None None] Network 964ad372-fe57-4fd7-9c44-852ac0957b3c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:23:05.845775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4021567d-8356-43bf-9737-9aea08257b23 req-1e99debf-1d1b-4dc4-88ed-55f8f4a983b9 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:05.847945 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4021567d-8356-43bf-9737-9aea08257b23 req-1e99debf-1d1b-4dc4-88ed-55f8f4a983b9 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 945 time: 0.4604580 May 12 15:23:05.896307 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-887db315-49bc-4e9b-bb82-0d3cc6573c91 req-18291c35-a5cc-4c93-8d00-d73bce53e7d8 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e7794860-7444-4123-96d5-ca3febf5e162&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1038592 May 12 15:23:05.913880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45327db6-0d02-4050-aee5-054d5bbbb82b req-8ed784cd-a5fa-4b2e-979e-90d115cbd88a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:05.916050 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45327db6-0d02-4050-aee5-054d5bbbb82b req-8ed784cd-a5fa-4b2e-979e-90d115cbd88a service neutron] 10.222.0.84 "GET /v2.0/networks?id=b50584ea-1073-48d4-a2bc-43b11374a495 HTTP/1.1" status: 200 len: 914 time: 0.1878161 May 12 15:23:05.924110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-59f48e94-986a-432f-9288-af7c5e4d6ffe None None] Provisioning for port cbd15264-d9b5-43e6-9659-cabbaba9ac01 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:05.933016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-59f48e94-986a-432f-9288-af7c5e4d6ffe None None] Provisioning complete for port cbd15264-d9b5-43e6-9659-cabbaba9ac01 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:05.933372 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-59f48e94-986a-432f-9288-af7c5e4d6ffe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:05.957766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:05.958375 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:05.994975 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45327db6-0d02-4050-aee5-054d5bbbb82b req-e2efb6d1-37cc-4747-b3a1-20ad43f3a355 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=3665052f-787a-44a4-bee0-3335df3f44a6 HTTP/1.1" status: 200 len: 217 time: 0.0672565 May 12 15:23:06.096749 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a55030fb-6b97-437a-aebd-900a83c21566 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 3.6321895 May 12 15:23:06.100330 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4021567d-8356-43bf-9737-9aea08257b23 req-348d1eac-5029-4093-97e3-117edd9ef444 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2173550 May 12 15:23:06.104797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36714) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:06.111498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Request body: {'port': {'network_id': '964ad372-fe57-4fd7-9c44-852ac0957b3c', 'name': 'tempest-AllowedAddressPairTestJSON-1540239439', 'allowed_address_pairs': [{'ip_address': '172.20.0.11', 'mac_address': 'fa:16:3e:e9:b2:b5'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:06.180854 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-59f48e94-986a-432f-9288-af7c5e4d6ffe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:06.208704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45327db6-0d02-4050-aee5-054d5bbbb82b req-4edf6c33-e7a2-48e5-a0f4-e62618113310 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:06.210945 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45327db6-0d02-4050-aee5-054d5bbbb82b req-4edf6c33-e7a2-48e5-a0f4-e62618113310 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=92a8d5fe-fb2b-414d-9ae2-15fb02337cd9 HTTP/1.1" status: 200 len: 853 time: 0.1875701 May 12 15:23:06.223993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-59f48e94-986a-432f-9288-af7c5e4d6ffe None None] For port cbd15264-d9b5-43e6-9659-cabbaba9ac01, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cbd15264-d9b5-43e6-9659-cabbaba9ac01,segment=NetworkSegment(240bdfeb-be72-4a71-bbb7-fa83b0fb806e),segment_id=240bdfeb-be72-4a71-bbb7-fa83b0fb806e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:06.236325 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-59f48e94-986a-432f-9288-af7c5e4d6ffe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:06.301604 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45327db6-0d02-4050-aee5-054d5bbbb82b req-e5b7ee37-d508-4109-b268-230cec1cdc68 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b50584ea-1073-48d4-a2bc-43b11374a495&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0834293 May 12 15:23:06.314288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7b0646a2-609d-4dc9-a8c5-ba29bf812d8e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0f5f77410c674422986162733d4c0337&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7217627 May 12 15:23:06.317505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36720) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:06.317810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:06.342635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59f48e94-986a-432f-9288-af7c5e4d6ffe None None] Pushing event updated for resources: {'Port': ['ID=cbd15264-d9b5-43e6-9659-cabbaba9ac01,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:06.393718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Usage tracker for resource:port and tenant:daa0af99633f4135975c6cd122c15437 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:06.413279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:06.434991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:06.455991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb1f3bea-3e49-4d0e-b0ba-804e6d93e873 req-cf65c362-b0f6-4559-8e0d-9023d7c5bbf2 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:06.462152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb1f3bea-3e49-4d0e-b0ba-804e6d93e873 req-cf65c362-b0f6-4559-8e0d-9023d7c5bbf2 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 944 time: 0.7463653 May 12 15:23:06.466970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-887db315-49bc-4e9b-bb82-0d3cc6573c91 req-af87e1b1-363e-4a62-a400-7c8d4a3e14d4 service neutron] 10.222.0.76 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5487931 May 12 15:23:06.509784 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0cb4459b-5b85-468a-93af-ae2f80c9a697 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:06.510355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Made reservation on behalf of daa0af99633f4135975c6cd122c15437 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:06.526899 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45327db6-0d02-4050-aee5-054d5bbbb82b req-e6caf415-7015-49f7-b0a4-3c93a65c5c87 service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2102253 May 12 15:23:06.568607 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0cb4459b-5b85-468a-93af-ae2f80c9a697 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:06.570090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-05a2c660-da69-465f-845b-0362837ce9da None None] Provisioning for port ef55421d-c37e-4cbd-b89c-b51db8cae969 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:06.576356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-05a2c660-da69-465f-845b-0362837ce9da None None] Provisioning complete for port ef55421d-c37e-4cbd-b89c-b51db8cae969 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:06.576801 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-05a2c660-da69-465f-845b-0362837ce9da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:06.613287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 31c449ad-4a28-4740-9037-350aab14340e details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:23:06.649988 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-05a2c660-da69-465f-845b-0362837ce9da None None] Port ef55421d-c37e-4cbd-b89c-b51db8cae969 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:06.721606 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45327db6-0d02-4050-aee5-054d5bbbb82b req-0aee1b48-0c71-4b81-87a7-040e6d325a2e service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1847396 May 12 15:23:06.730582 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0cb4459b-5b85-468a-93af-ae2f80c9a697 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:06.750827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb4459b-5b85-468a-93af-ae2f80c9a697 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2042e517-a24f-4039-ab4d-5bb5ed0c8dae,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:06.764431 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0cb4459b-5b85-468a-93af-ae2f80c9a697 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:06.766072 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0cb4459b-5b85-468a-93af-ae2f80c9a697 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2042e517-a24f-4039-ab4d-5bb5ed0c8dae HTTP/1.1" status: 204 len: 168 time: 0.4279356 May 12 15:23:06.820389 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-05a2c660-da69-465f-845b-0362837ce9da None None] Provisioning complete for port cbd15264-d9b5-43e6-9659-cabbaba9ac01 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:06.820756 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-05a2c660-da69-465f-845b-0362837ce9da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:06.862184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb1f3bea-3e49-4d0e-b0ba-804e6d93e873 req-519e0dba-0501-4638-95bf-c2cbbeae1282 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3933957 May 12 15:23:06.932701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27ec03de-0b62-4a81-b23e-4eecfa527c32 req-07f9cf05-28f5-4aa8-8d36-2a922daae7d3 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:06.940910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27ec03de-0b62-4a81-b23e-4eecfa527c32 req-07f9cf05-28f5-4aa8-8d36-2a922daae7d3 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 943 time: 0.6243989 May 12 15:23:06.950970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 31c449ad-4a28-4740-9037-350aab14340e, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=31c449ad-4a28-4740-9037-350aab14340e,segment=NetworkSegment(ccba5697-f062-48f7-986e-3317afc51896),segment_id=ccba5697-f062-48f7-986e-3317afc51896)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:06.986950 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:07.023841 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4623dd20-4fe0-4830-aaa3-6195ed4ebb65'] response: {'server_uuid': 'c6664985-1799-40f2-b048-f9f4daa5401e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31', 'code': 200} May 12 15:23:07.033289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '31c449ad-4a28-4740-9037-350aab14340e', 'network_id': 'e7794860-7444-4123-96d5-ca3febf5e162', 'port_id': '31c449ad-4a28-4740-9037-350aab14340e', 'mac_address': 'fa:16:3e:87:92:d5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 567, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eae80ee9-f335-4892-af0b-41490fc3c6b5', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:23:07.035896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27ec03de-0b62-4a81-b23e-4eecfa527c32 req-ce98b536-ec36-4850-af71-940f36a59cf9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0940351 May 12 15:23:07.043375 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-887db315-49bc-4e9b-bb82-0d3cc6573c91 req-04c6b654-a90c-4ffa-be9e-58089142966e service neutron] 10.222.0.76 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5663044 May 12 15:23:07.045260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cbd15264-d9b5-43e6-9659-cabbaba9ac01 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:23:07.058225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] device_id is not set on port 2cc0fcdf-da7d-4801-86d9-9eb084bdb0b2 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:23:07.222373 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:07.242686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32ada779-38ad-46e0-b8d1-b49e777ec201 req-0f291abc-70ce-47e3-ad70-35dbbba42566 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:07.247542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 31c449ad-4a28-4740-9037-350aab14340e {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:23:07.251291 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32ada779-38ad-46e0-b8d1-b49e777ec201 req-0f291abc-70ce-47e3-ad70-35dbbba42566 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 1097 time: 0.1383533 May 12 15:23:07.254656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port cbd15264-d9b5-43e6-9659-cabbaba9ac01 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:07.255303 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:07.286156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Allocated IP 172.20.0.9 (964ad372-fe57-4fd7-9c44-852ac0957b3c/126daff2-fa1d-4ce6-a721-83e207b54aab/2cc0fcdf-da7d-4801-86d9-9eb084bdb0b2) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:23:07.320664 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32ada779-38ad-46e0-b8d1-b49e777ec201 req-c46891f8-48d8-40b5-834f-999ad3f3dfd7 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631940 May 12 15:23:07.351915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 31c449ad-4a28-4740-9037-350aab14340e, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=31c449ad-4a28-4740-9037-350aab14340e,segment=NetworkSegment(ccba5697-f062-48f7-986e-3317afc51896),segment_id=ccba5697-f062-48f7-986e-3317afc51896)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:07.361414 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:07.424842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b99691c6-8053-4b8e-bf5a-ba51ce28be2d None None] Provisioning complete for port ef55421d-c37e-4cbd-b89c-b51db8cae969 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:07.425170 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b99691c6-8053-4b8e-bf5a-ba51ce28be2d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:07.547405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b99691c6-8053-4b8e-bf5a-ba51ce28be2d None None] Port ef55421d-c37e-4cbd-b89c-b51db8cae969 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:07.551347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=31c449ad-4a28-4740-9037-350aab14340e,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:07.602918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['31c449ad-4a28-4740-9037-350aab14340e'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:07.621863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f45434f0-cb3f-4b37-b94d-18bf5be3a8a3 req-88b128ab-6d0a-421f-86de-af8cb7be52ff tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:07.623337 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f45434f0-cb3f-4b37-b94d-18bf5be3a8a3 req-88b128ab-6d0a-421f-86de-af8cb7be52ff tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.2934239 May 12 15:23:07.691681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206a100b-e1c0-404d-a599-26b7b3f17702 req-f58ca5b0-e575-4964-abd5-f5cb096510ba tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:07.693166 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-206a100b-e1c0-404d-a599-26b7b3f17702 req-f58ca5b0-e575-4964-abd5-f5cb096510ba tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 945 time: 0.3620884 May 12 15:23:07.749356 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f45434f0-cb3f-4b37-b94d-18bf5be3a8a3 req-0b586fb8-f4be-439e-a0ce-35d9539b3419 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1153913 May 12 15:23:07.759367 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:07.791596 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-206a100b-e1c0-404d-a599-26b7b3f17702 req-153dec5d-9869-4d50-8654-23737ffa8329 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0840116 May 12 15:23:07.794073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Transition to ACTIVE for port object 2cc0fcdf-da7d-4801-86d9-9eb084bdb0b2 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:07.823097 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:07.901354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Network 964ad372-fe57-4fd7-9c44-852ac0957b3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:23:07.904695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:07.907790 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:23:08.005212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event updated for resources: {'Port': ['ID=2cc0fcdf-da7d-4801-86d9-9eb084bdb0b2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:08.044833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:08.045560 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:08.081445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36768) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:08.082044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-24717193-c105-4d96-99e4-613d4091e952 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 999 time: 1.9749951 May 12 15:23:08.101019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ffb8cd1-e9d9-4be0-886d-e2b5425c8c29 req-6ebfb44f-9409-4ca0-9c01-6adb9c9db745 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:08.102708 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ffb8cd1-e9d9-4be0-886d-e2b5425c8c29 req-6ebfb44f-9409-4ca0-9c01-6adb9c9db745 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 946 time: 0.1381993 May 12 15:23:08.198059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad214941-f62b-4ea4-bf15-e3777f93b4de tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:08.203897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad214941-f62b-4ea4-bf15-e3777f93b4de tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:08.209717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad214941-f62b-4ea4-bf15-e3777f93b4de tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:08.211420 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ad214941-f62b-4ea4-bf15-e3777f93b4de tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2468 time: 0.1279325 May 12 15:23:08.214836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36776) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:08.225402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ffb8cd1-e9d9-4be0-886d-e2b5425c8c29 req-c49a366f-3091-4580-bba4-d723573fd150 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1171372 May 12 15:23:08.284142 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-11d516ae-9bd1-4bd9-afda-30d9705744df None None] Provisioning for port 2cc0fcdf-da7d-4801-86d9-9eb084bdb0b2 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:08.289422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-11d516ae-9bd1-4bd9-afda-30d9705744df None None] Provisioning complete for port 2cc0fcdf-da7d-4801-86d9-9eb084bdb0b2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:08.289639 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-11d516ae-9bd1-4bd9-afda-30d9705744df None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:08.307366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36780) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:08.323112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cb90aba-a699-4cae-a003-677aa1220d95 req-ebee2178-babf-41e0-b13c-e5da929c9b3e tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:08.326326 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0cb90aba-a699-4cae-a003-677aa1220d95 req-ebee2178-babf-41e0-b13c-e5da929c9b3e tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 944 time: 0.1829557 May 12 15:23:08.385299 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0cb90aba-a699-4cae-a003-677aa1220d95 req-b8b3a90e-213b-4d94-9e40-93a97678f34f tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500684 May 12 15:23:08.408349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-11d516ae-9bd1-4bd9-afda-30d9705744df None None] Port 2cc0fcdf-da7d-4801-86d9-9eb084bdb0b2 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:08.430252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ee3f5909-d6a3-4844-a154-efbebc307c55 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Deleting port 2cc0fcdf-da7d-4801-86d9-9eb084bdb0b2 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:08.430907 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee3f5909-d6a3-4844-a154-efbebc307c55 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:08.480008 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08e0cd60-aa7c-4e61-be17-1060630b8e20 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:08.530099 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08e0cd60-aa7c-4e61-be17-1060630b8e20 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:08.535801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a88795ab-180f-4933-99ce-4c94f1cbfc47 req-0269c20a-eb04-431c-8a59-68dc531456a6 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:08.537646 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a88795ab-180f-4933-99ce-4c94f1cbfc47 req-0269c20a-eb04-431c-8a59-68dc531456a6 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 944 time: 0.0899932 May 12 15:23:08.601669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a88795ab-180f-4933-99ce-4c94f1cbfc47 req-b829b902-bc04-4b52-b551-4c5c2f924cd8 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552776 May 12 15:23:08.616327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 31c449ad-4a28-4740-9037-350aab14340e up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:23:08.702851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 31c449ad-4a28-4740-9037-350aab14340e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:08.708031 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 31c449ad-4a28-4740-9037-350aab14340e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:08.708399 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:08.746793 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08e0cd60-aa7c-4e61-be17-1060630b8e20 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:08.799974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08e0cd60-aa7c-4e61-be17-1060630b8e20 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=dccab3db-6ebb-412b-a448-1044f25ca467,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:08.805701 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee3f5909-d6a3-4844-a154-efbebc307c55 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:08.851464 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:08.893212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 31c449ad-4a28-4740-9037-350aab14340e, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=31c449ad-4a28-4740-9037-350aab14340e,segment=NetworkSegment(ccba5697-f062-48f7-986e-3317afc51896),segment_id=ccba5697-f062-48f7-986e-3317afc51896)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:08.898686 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:08.932604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08e0cd60-aa7c-4e61-be17-1060630b8e20 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:08.933751 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-08e0cd60-aa7c-4e61-be17-1060630b8e20 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "DELETE /v2.0/security-groups/dccab3db-6ebb-412b-a448-1044f25ca467 HTTP/1.1" status: 204 len: 168 time: 0.6251354 May 12 15:23:08.939722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36798) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:08.968830 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-e344f2f6-3a11-46f5-8cec-01e5dee04b39 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] show failed (client error): The resource could not be found. May 12 15:23:08.969947 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e344f2f6-3a11-46f5-8cec-01e5dee04b39 tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "GET /v2.0/security-groups/dccab3db-6ebb-412b-a448-1044f25ca467 HTTP/1.1" status: 404 len: 347 time: 0.0282643 May 12 15:23:08.972923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36802) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:09.003450 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=31c449ad-4a28-4740-9037-350aab14340e,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:09.024873 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '31e1782e-1e75-4738-9a0c-d51f4a6ee62c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '31c449ad-4a28-4740-9037-350aab14340e'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:09.041004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ee3f5909-d6a3-4844-a154-efbebc307c55 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Calling delete_port for 2cc0fcdf-da7d-4801-86d9-9eb084bdb0b2 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:09.196909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-da28f32c-2586-47d4-9f1e-7999a716cfae tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Deleting port 7e956cfd-ea61-49e2-ad47-2c4efb5430e3 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:09.197249 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-da28f32c-2586-47d4-9f1e-7999a716cfae tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:09.199023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee3f5909-d6a3-4844-a154-efbebc307c55 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:09.249630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee3f5909-d6a3-4844-a154-efbebc307c55 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event deleted for resources: {'Port': ['ID=2cc0fcdf-da7d-4801-86d9-9eb084bdb0b2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:09.260939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f705e281-498e-425d-99c0-3a9dea1a6214 req-ba61702a-1c54-4852-8939-6f7eed61b19d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:09.262372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f705e281-498e-425d-99c0-3a9dea1a6214 req-ba61702a-1c54-4852-8939-6f7eed61b19d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.3727891 May 12 15:23:09.387918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3665052f-787a-44a4-bee0-3335df3f44a6 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:23:09.471865 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e54a148-37f1-4808-a893-0c9d62265581 req-0ac55f36-63b3-4be5-89e2-e287a9ac506d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:09.473342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e54a148-37f1-4808-a893-0c9d62265581 req-0ac55f36-63b3-4be5-89e2-e287a9ac506d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 945 time: 0.4375162 May 12 15:23:09.502950 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee3f5909-d6a3-4844-a154-efbebc307c55 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:09.507269 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f705e281-498e-425d-99c0-3a9dea1a6214 req-85a5031e-1af0-4095-9660-6d538b8f5c95 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2329555 May 12 15:23:09.510212 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ee3f5909-d6a3-4844-a154-efbebc307c55 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "DELETE /v2.0/ports/2cc0fcdf-da7d-4801-86d9-9eb084bdb0b2 HTTP/1.1" status: 204 len: 168 time: 1.2940357 May 12 15:23:09.512557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36818) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:09.579995 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 3665052f-787a-44a4-bee0-3335df3f44a6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3665052f-787a-44a4-bee0-3335df3f44a6,segment=NetworkSegment(2b9a3118-674a-42bd-be1d-3a0efcec85f0),segment_id=2b9a3118-674a-42bd-be1d-3a0efcec85f0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:09.599459 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-da28f32c-2586-47d4-9f1e-7999a716cfae tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:09.600190 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-da28f32c-2586-47d4-9f1e-7999a716cfae tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:09.607711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '3665052f-787a-44a4-bee0-3335df3f44a6', 'network_id': 'b50584ea-1073-48d4-a2bc-43b11374a495', 'port_id': '3665052f-787a-44a4-bee0-3335df3f44a6', 'mac_address': 'fa:16:3e:5f:eb:a0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 566, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '92a8d5fe-fb2b-414d-9ae2-15fb02337cd9', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:23:09.615077 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-cb3c6945-6e1d-494f-8fcc-9652be48f663'] response: {'server_uuid': '31e1782e-1e75-4738-9a0c-d51f4a6ee62c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '31c449ad-4a28-4740-9037-350aab14340e', 'code': 200} May 12 15:23:09.694598 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:09.705156 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-b6a67e5d-ba66-43e4-ab1a-59a89e810a2a tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] GET failed (client error): The resource could not be found. May 12 15:23:09.705996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b6a67e5d-ba66-43e4-ab1a-59a89e810a2a tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Synchronizing usage tracker for tenant:daa0af99633f4135975c6cd122c15437 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:09.718083 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3665052f-787a-44a4-bee0-3335df3f44a6 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:23:09.728378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b6a67e5d-ba66-43e4-ab1a-59a89e810a2a tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Unset dirty status for tenant:daa0af99633f4135975c6cd122c15437 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:09.729788 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b6a67e5d-ba66-43e4-ab1a-59a89e810a2a tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "GET /v2.0/ports/2cc0fcdf-da7d-4801-86d9-9eb084bdb0b2 HTTP/1.1" status: 404 len: 333 time: 0.2163544 May 12 15:23:09.734326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36824) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:09.740209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Request body: {'port': {'network_id': '964ad372-fe57-4fd7-9c44-852ac0957b3c', 'name': 'tempest-AllowedAddressPairTestJSON-1203634943'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:09.744059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 3665052f-787a-44a4-bee0-3335df3f44a6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3665052f-787a-44a4-bee0-3335df3f44a6,segment=NetworkSegment(2b9a3118-674a-42bd-be1d-3a0efcec85f0),segment_id=2b9a3118-674a-42bd-be1d-3a0efcec85f0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:09.750999 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:09.813521 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e54a148-37f1-4808-a893-0c9d62265581 req-b097d3aa-e035-4f9c-b3f8-732ad988244b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2991707 May 12 15:23:09.846004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=3665052f-787a-44a4-bee0-3335df3f44a6,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:09.910064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:09.911046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-da28f32c-2586-47d4-9f1e-7999a716cfae tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Calling delete_port for 7e956cfd-ea61-49e2-ad47-2c4efb5430e3 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:09.920133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:09.930799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Made reservation on behalf of daa0af99633f4135975c6cd122c15437 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:09.934252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:09.957704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] device_id is not set on port 0f090698-b4ed-4700-a031-65e58415db5a yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:23:10.099384 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3665052f-787a-44a4-bee0-3335df3f44a6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:10.103071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Allocated IP 172.20.0.8 (964ad372-fe57-4fd7-9c44-852ac0957b3c/126daff2-fa1d-4ce6-a721-83e207b54aab/0f090698-b4ed-4700-a031-65e58415db5a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:23:10.190610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6117fee8-6ec2-441b-b18e-07f53674bfcb req-65eeaf07-243b-426b-aebe-321634d65fae tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:10.192075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6117fee8-6ec2-441b-b18e-07f53674bfcb req-65eeaf07-243b-426b-aebe-321634d65fae tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 946 time: 0.3197622 May 12 15:23:10.197625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e19f8720-ec64-4863-8406-3d8c6bdc7181 req-99fd68b2-9dd6-4176-ae95-3a652e72ba74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:10.199023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e19f8720-ec64-4863-8406-3d8c6bdc7181 req-99fd68b2-9dd6-4176-ae95-3a652e72ba74 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 1096 time: 0.3278148 May 12 15:23:10.210599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a7dd9c6-d534-469f-98d2-0d39d6bb5b33 req-6b4e407f-84e2-4661-881f-ce858cd01320 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:10.211997 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a7dd9c6-d534-469f-98d2-0d39d6bb5b33 req-6b4e407f-84e2-4661-881f-ce858cd01320 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 945 time: 0.2740507 May 12 15:23:10.320134 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-da28f32c-2586-47d4-9f1e-7999a716cfae tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:10.372123 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e19f8720-ec64-4863-8406-3d8c6bdc7181 req-0ca81a92-f7e2-4a29-b831-4cbfb3fc7b6a service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1584980 May 12 15:23:10.383215 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:10.383975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da28f32c-2586-47d4-9f1e-7999a716cfae tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Pushing event deleted for resources: {'Port': ['ID=7e956cfd-ea61-49e2-ad47-2c4efb5430e3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:10.388358 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6117fee8-6ec2-441b-b18e-07f53674bfcb req-ce22b1f2-b072-40f5-8f30-0219d555b67f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1859038 May 12 15:23:10.391590 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a7dd9c6-d534-469f-98d2-0d39d6bb5b33 req-b0260806-454d-483f-a7d1-ea3399c07695 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1539340 May 12 15:23:10.416108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Transition to ACTIVE for port object 0f090698-b4ed-4700-a031-65e58415db5a will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:10.481184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:10.525665 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-da28f32c-2586-47d4-9f1e-7999a716cfae tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:10.548190 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-da28f32c-2586-47d4-9f1e-7999a716cfae tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:10.550294 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-da28f32c-2586-47d4-9f1e-7999a716cfae tempest-ImagesOneServerNegativeTestJSON-1416762847 tempest-ImagesOneServerNegativeTestJSON-1416762847-project] 10.222.0.82 "DELETE /v2.0/floatingips/871a5a8f-6c9a-432a-9d4d-a656a85f07a2 HTTP/1.1" status: 204 len: 168 time: 1.5765765 May 12 15:23:10.570693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Network 964ad372-fe57-4fd7-9c44-852ac0957b3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:23:10.574563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:10.579091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:23:10.663496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:10.664166 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:10.674373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event updated for resources: {'Port': ['ID=0f090698-b4ed-4700-a031-65e58415db5a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:10.700876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ac3761-0c20-4e45-b8c1-0cadac05695f req-f7a954fd-97fc-4685-ba1b-fa916b583164 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:10.709472 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7ac3761-0c20-4e45-b8c1-0cadac05695f req-f7a954fd-97fc-4685-ba1b-fa916b583164 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.1290619 May 12 15:23:10.723793 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-347d89c0-e453-4be4-aa8c-9959feba88f0 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 0.9880717 May 12 15:23:10.725976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36840) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:10.732081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c9045975-9fa7-42af-acb6-d78c7389d614 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.11', 'mac_address': 'fa:16:3e:e9:b2:b5'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:10.783286 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7ac3761-0c20-4e45-b8c1-0cadac05695f req-bfefeb86-df3c-4a0b-9636-ecafd06f5081 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725067 May 12 15:23:10.953094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-37f26a67-5fa7-49d6-905e-c1c8a64cf622 None None] Provisioning for port 0f090698-b4ed-4700-a031-65e58415db5a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:10.961767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-37f26a67-5fa7-49d6-905e-c1c8a64cf622 None None] Provisioning complete for port 0f090698-b4ed-4700-a031-65e58415db5a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:10.962287 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-37f26a67-5fa7-49d6-905e-c1c8a64cf622 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:10.981845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9cfc090-536e-435f-952e-4e8918875d23 req-81b42e36-9e6f-4c37-89fe-a1704b967524 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:10.991131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9cfc090-536e-435f-952e-4e8918875d23 req-81b42e36-9e6f-4c37-89fe-a1704b967524 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.1751451 May 12 15:23:11.021967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-37f26a67-5fa7-49d6-905e-c1c8a64cf622 None None] Port 0f090698-b4ed-4700-a031-65e58415db5a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:11.078642 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9045975-9fa7-42af-acb6-d78c7389d614 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:11.109757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9cfc090-536e-435f-952e-4e8918875d23 req-fe2aa9b7-07d0-46d5-b938-27c7a8420e24 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1164598 May 12 15:23:11.166687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6562ac2f-3c71-4061-84fa-58d4ddc6e902 req-ad07ae7b-90bc-43ee-a552-ff6d9e560e2a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:11.170664 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6562ac2f-3c71-4061-84fa-58d4ddc6e902 req-ad07ae7b-90bc-43ee-a552-ff6d9e560e2a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 946 time: 0.1577864 May 12 15:23:11.300998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6562ac2f-3c71-4061-84fa-58d4ddc6e902 req-1884419c-f3cd-493d-9621-b0abf6698eec tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1248448 May 12 15:23:11.371411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ec1871-df5b-4fb0-bc4c-1adc92ed101f req-a4fd6d7b-34e9-4f12-a528-183ce1b8dd95 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:11.380400 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06ec1871-df5b-4fb0-bc4c-1adc92ed101f req-a4fd6d7b-34e9-4f12-a528-183ce1b8dd95 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 945 time: 0.1441240 May 12 15:23:11.388686 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9045975-9fa7-42af-acb6-d78c7389d614 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:11.399120 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9045975-9fa7-42af-acb6-d78c7389d614 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:11.403305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3665052f-787a-44a4-bee0-3335df3f44a6 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:23:11.459068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06ec1871-df5b-4fb0-bc4c-1adc92ed101f req-7b8d014b-7677-4157-9c91-5150cc6b4972 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0754948 May 12 15:23:11.584964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36866) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:11.599410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 3665052f-787a-44a4-bee0-3335df3f44a6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:11.615789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 3665052f-787a-44a4-bee0-3335df3f44a6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:11.616155 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:11.712290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c9045975-9fa7-42af-acb6-d78c7389d614 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] In _notify_port_updated(), no bound segment for port 0f090698-b4ed-4700-a031-65e58415db5a on network 964ad372-fe57-4fd7-9c44-852ac0957b3c {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:23:11.719407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9045975-9fa7-42af-acb6-d78c7389d614 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:11.720203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9045975-9fa7-42af-acb6-d78c7389d614 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:11.721669 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c9045975-9fa7-42af-acb6-d78c7389d614 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "PUT /v2.0/ports/0f090698-b4ed-4700-a031-65e58415db5a HTTP/1.1" status: 200 len: 994 time: 0.9946465 May 12 15:23:11.725176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36870) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:11.758698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9045975-9fa7-42af-acb6-d78c7389d614 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event updated for resources: {'Port': ['ID=0f090698-b4ed-4700-a031-65e58415db5a,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:11.805644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-88f52f26-4fe2-4b80-8702-757243074245 admin admin] Deleting subnet 5a24db8d-fb66-4b7f-bf96-50956cb218fd {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:23:11.819116 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88f52f26-4fe2-4b80-8702-757243074245 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:11.839841 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:11.887186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9848e953-d1fb-4bb4-8995-1f62bf3efd1c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3665052f-787a-44a4-bee0-3335df3f44a6'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:11.891690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-274c34a0-36f5-4ffc-bbbc-12dcd2312806 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Deleting port 0f090698-b4ed-4700-a031-65e58415db5a {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:11.892037 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-274c34a0-36f5-4ffc-bbbc-12dcd2312806 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:11.899085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 3665052f-787a-44a4-bee0-3335df3f44a6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3665052f-787a-44a4-bee0-3335df3f44a6,segment=NetworkSegment(2b9a3118-674a-42bd-be1d-3a0efcec85f0),segment_id=2b9a3118-674a-42bd-be1d-3a0efcec85f0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:11.903660 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:11.985635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bd4d81f5-a30d-4221-bd21-b1b84ffbe2b5 None None] Provisioning complete for port 0f090698-b4ed-4700-a031-65e58415db5a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:11.986344 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bd4d81f5-a30d-4221-bd21-b1b84ffbe2b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:11.996878 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88f52f26-4fe2-4b80-8702-757243074245 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:12.035153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=3665052f-787a-44a4-bee0-3335df3f44a6,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:12.070306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bd4d81f5-a30d-4221-bd21-b1b84ffbe2b5 None None] Port 0f090698-b4ed-4700-a031-65e58415db5a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:12.090530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daa083c1-c1a7-4756-b901-371c8a87a0bd req-ddcd43aa-90d8-4746-b361-c9c76c09b969 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:12.094644 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-daa083c1-c1a7-4756-b901-371c8a87a0bd req-ddcd43aa-90d8-4746-b361-c9c76c09b969 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 945 time: 0.4325607 May 12 15:23:12.279170 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88f52f26-4fe2-4b80-8702-757243074245 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:12.412299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28ff1ea7-c510-47a4-8202-ab19d8a3043a req-4a3b7d28-03ca-4aba-a461-225a76d66766 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:12.414339 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-28ff1ea7-c510-47a4-8202-ab19d8a3043a req-4a3b7d28-03ca-4aba-a461-225a76d66766 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Synchronizing usage tracker for tenant:4e5a10df576841e2a4752a9d47fb790a on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:12.435251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-28ff1ea7-c510-47a4-8202-ab19d8a3043a req-4a3b7d28-03ca-4aba-a461-225a76d66766 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Unset dirty status for tenant:4e5a10df576841e2a4752a9d47fb790a on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:12.438991 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-28ff1ea7-c510-47a4-8202-ab19d8a3043a req-4a3b7d28-03ca-4aba-a461-225a76d66766 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.84 "GET /v2.0/ports?device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 946 time: 0.1229339 May 12 15:23:12.461997 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-daa083c1-c1a7-4756-b901-371c8a87a0bd req-5c7515ce-d8f8-4034-ac14-1b6b209126a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3372195 May 12 15:23:12.485675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a4e1a2d-6233-4136-ac93-39d0a63b1ea5 req-823f787c-cd95-401d-b8b5-f9fcc735328a tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:12.488824 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a4e1a2d-6233-4136-ac93-39d0a63b1ea5 req-823f787c-cd95-401d-b8b5-f9fcc735328a tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.5691123 May 12 15:23:12.520310 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-28ff1ea7-c510-47a4-8202-ab19d8a3043a req-2c85c577-36d3-48e7-8ea5-0ba4204800c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Deleting port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:12.520793 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-28ff1ea7-c510-47a4-8202-ab19d8a3043a req-2c85c577-36d3-48e7-8ea5-0ba4204800c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:12.531053 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88f52f26-4fe2-4b80-8702-757243074245 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:12.546698 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0a535ed6-f864-4176-bffa-567685f8df94'] response: {'server_uuid': '9848e953-d1fb-4bb4-8995-1f62bf3efd1c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3665052f-787a-44a4-bee0-3335df3f44a6', 'code': 200} May 12 15:23:12.620262 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88f52f26-4fe2-4b80-8702-757243074245 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:12.622696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88f52f26-4fe2-4b80-8702-757243074245 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5a24db8d-fb66-4b7f-bf96-50956cb218fd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:12.640292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4a88f583-55ea-4849-8a87-dbc693ed07d0 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:23:12.647497 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a4e1a2d-6233-4136-ac93-39d0a63b1ea5 req-e8f0aff9-ea93-4d47-b57b-6029c66b71b2 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1577237 May 12 15:23:12.653876 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-274c34a0-36f5-4ffc-bbbc-12dcd2312806 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:12.680031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-88f52f26-4fe2-4b80-8702-757243074245 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/5a24db8d-fb66-4b7f-bf96-50956cb218fd HTTP/1.1" status: 204 len: 168 time: 1.0902276 May 12 15:23:12.680733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36894) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:12.732183 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-239781bf-98df-4f05-8d9a-9cc919936fb9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:12.869413 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:12.886060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'port_id': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'mac_address': 'fa:16:3e:c6:9e:79', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 558, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:23:12.918260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-274c34a0-36f5-4ffc-bbbc-12dcd2312806 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Calling delete_port for 0f090698-b4ed-4700-a031-65e58415db5a owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:12.964111 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:12.975299 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:12.983904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4a88f583-55ea-4849-8a87-dbc693ed07d0 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:23:13.010497 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:13.017546 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:13.054180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd1b83b-db44-4506-9493-9f7607dd0ed7 req-ba432d4a-2da9-4b9a-b2d4-26f1458ef5ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:13.055876 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2bd1b83b-db44-4506-9493-9f7607dd0ed7 req-ba432d4a-2da9-4b9a-b2d4-26f1458ef5ea service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 1097 time: 0.4030282 May 12 15:23:13.113719 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=4a88f583-55ea-4849-8a87-dbc693ed07d0,revision_number=11']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:13.140371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-28ff1ea7-c510-47a4-8202-ab19d8a3043a req-2c85c577-36d3-48e7-8ea5-0ba4204800c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] For port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:13.140371 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-28ff1ea7-c510-47a4-8202-ab19d8a3043a req-2c85c577-36d3-48e7-8ea5-0ba4204800c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:13.204017 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0213768-2d2b-4698-8e0e-b70b10423c17 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:13.213182 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2bd1b83b-db44-4506-9493-9f7607dd0ed7 req-03e11f0a-5367-4fcf-ab94-23e2f361aed4 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1375003 May 12 15:23:13.260715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['4a88f583-55ea-4849-8a87-dbc693ed07d0'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:13.292632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-28ff1ea7-c510-47a4-8202-ab19d8a3043a req-2c85c577-36d3-48e7-8ea5-0ba4204800c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Calling delete_port for 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:13.356477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c51649-ec84-4fa2-aa06-4bb9421a2477 req-62102b23-a680-4cfd-b6d0-90a5b5156e45 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:13.358017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7c51649-ec84-4fa2-aa06-4bb9421a2477 req-62102b23-a680-4cfd-b6d0-90a5b5156e45 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.5157013 May 12 15:23:13.441258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94272612-243e-40fc-b035-11f386df7d95 req-0e4adf17-88b4-48ab-87d7-fca7ef527d39 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:13.442765 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-94272612-243e-40fc-b035-11f386df7d95 req-0e4adf17-88b4-48ab-87d7-fca7ef527d39 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=c6664985-1799-40f2-b048-f9f4daa5401e HTTP/1.1" status: 200 len: 946 time: 0.5361879 May 12 15:23:13.493079 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-28ff1ea7-c510-47a4-8202-ab19d8a3043a req-2c85c577-36d3-48e7-8ea5-0ba4204800c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:13.504211 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0213768-2d2b-4698-8e0e-b70b10423c17 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:13.529342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f', '4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:13.542912 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-274c34a0-36f5-4ffc-bbbc-12dcd2312806 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:13.596935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c85c577-36d3-48e7-8ea5-0ba4204800c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Pushing event deleted for resources: {'Port': ['ID=4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:13.609789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a0213768-2d2b-4698-8e0e-b70b10423c17 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['670dbecd-f547-4abf-b069-62f0c8712c6b']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:23:13.637095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-274c34a0-36f5-4ffc-bbbc-12dcd2312806 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event deleted for resources: {'Port': ['ID=0f090698-b4ed-4700-a031-65e58415db5a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:13.637346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-28ff1ea7-c510-47a4-8202-ab19d8a3043a req-2c85c577-36d3-48e7-8ea5-0ba4204800c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] No DVR routers for this DVR port 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:23:13.642282 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-28ff1ea7-c510-47a4-8202-ab19d8a3043a req-2c85c577-36d3-48e7-8ea5-0ba4204800c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:13.647292 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-94272612-243e-40fc-b035-11f386df7d95 req-cb648a2b-951a-4e29-b412-415e8c7be520 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1741204 May 12 15:23:13.647574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c6664985-1799-40f2-b048-f9f4daa5401e', 'name': 'network-vif-deleted', 'tag': '4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:13.667686 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-28ff1ea7-c510-47a4-8202-ab19d8a3043a req-2c85c577-36d3-48e7-8ea5-0ba4204800c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.84 "DELETE /v2.0/ports/4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 HTTP/1.1" status: 204 len: 173 time: 1.2243111 May 12 15:23:13.685809 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a0213768-2d2b-4698-8e0e-b70b10423c17 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dbf5199c-277c-4a55-97b5-ab215591dbbb') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:23:13.686100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a0213768-2d2b-4698-8e0e-b70b10423c17 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dbf5199c-277c-4a55-97b5-ab215591dbbb') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:23:13.713494 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7c51649-ec84-4fa2-aa06-4bb9421a2477 req-2bd30227-7515-4f66-b3cb-fb7a22a6086a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2885485 May 12 15:23:13.759502 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0213768-2d2b-4698-8e0e-b70b10423c17 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:13.836975 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0213768-2d2b-4698-8e0e-b70b10423c17 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:13.931471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a0213768-2d2b-4698-8e0e-b70b10423c17 admin admin] Releasing vlan 589 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:23:13.931888 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0213768-2d2b-4698-8e0e-b70b10423c17 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: timer() May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:23:13.966972 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:23:14.232331 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0213768-2d2b-4698-8e0e-b70b10423c17 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:14.239289 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0213768-2d2b-4698-8e0e-b70b10423c17 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:14.297862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0213768-2d2b-4698-8e0e-b70b10423c17 admin admin] Pushing event deleted for resources: {'Network': ['ID=670dbecd-f547-4abf-b069-62f0c8712c6b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:14.310538 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a0213768-2d2b-4698-8e0e-b70b10423c17 admin admin] 10.222.0.82 "DELETE /v2.0/networks/670dbecd-f547-4abf-b069-62f0c8712c6b HTTP/1.1" status: 204 len: 168 time: 1.6263616 May 12 15:23:14.314522 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-274c34a0-36f5-4ffc-bbbc-12dcd2312806 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:14.327132 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-274c34a0-36f5-4ffc-bbbc-12dcd2312806 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "DELETE /v2.0/ports/0f090698-b4ed-4700-a031-65e58415db5a HTTP/1.1" status: 204 len: 168 time: 2.5984328 May 12 15:23:14.329157 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36908) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:14.440770 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-cb7880d1-dde6-4db0-9969-50d6f9459914 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] GET failed (client error): The resource could not be found. May 12 15:23:14.443321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cb7880d1-dde6-4db0-9969-50d6f9459914 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Synchronizing usage tracker for tenant:daa0af99633f4135975c6cd122c15437 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:14.476604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cb7880d1-dde6-4db0-9969-50d6f9459914 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Unset dirty status for tenant:daa0af99633f4135975c6cd122c15437 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:14.478165 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cb7880d1-dde6-4db0-9969-50d6f9459914 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "GET /v2.0/ports/0f090698-b4ed-4700-a031-65e58415db5a HTTP/1.1" status: 404 len: 333 time: 0.1478977 May 12 15:23:14.481842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36912) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:14.491383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Request body: {'port': {'network_id': '964ad372-fe57-4fd7-9c44-852ac0957b3c', 'name': 'tempest-AllowedAddressPairTestJSON-836233248'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:14.630343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2e723d0-0c41-44b9-9697-05160e7491db req-3c5c4f3c-e9bc-4511-94ea-2c57a1fd1663 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:14.631875 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2e723d0-0c41-44b9-9697-05160e7491db req-3c5c4f3c-e9bc-4511-94ea-2c57a1fd1663 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 946 time: 0.7106609 May 12 15:23:14.644368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4a88f583-55ea-4849-8a87-dbc693ed07d0 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:23:14.653840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36916) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:14.668938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:14.681812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:14.692734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Made reservation on behalf of daa0af99633f4135975c6cd122c15437 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:14.696890 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:14.724643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] device_id is not set on port cf8e58af-1d8b-4e30-99c5-896479073feb yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:23:14.760203 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2e723d0-0c41-44b9-9697-05160e7491db req-7e1fbfa9-34b6-4d51-a762-34db27d98656 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1134067 May 12 15:23:14.774820 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0a2d70c5-cf8c-41b3-8292-ff00f44d598e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4789db12ded14c2e8773d2396c9acd32&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1013653 May 12 15:23:14.775848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 4a88f583-55ea-4849-8a87-dbc693ed07d0 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:14.777852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36922) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:14.790325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c77d83a-7bed-4d2b-80f3-727146c588ee req-0d625f71-5c9c-44bf-9e80-f7613b049edf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:14.792842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 4a88f583-55ea-4849-8a87-dbc693ed07d0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:14.793263 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:14.799589 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c77d83a-7bed-4d2b-80f3-727146c588ee req-0d625f71-5c9c-44bf-9e80-f7613b049edf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 946 time: 0.4344385 May 12 15:23:14.820907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b42fdcf0-1c13-44b6-ae5f-7fe7ec7e9e43 req-33660cc6-d6e0-4d88-a0c0-c4fc9de66aed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:14.823163 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b42fdcf0-1c13-44b6-ae5f-7fe7ec7e9e43 req-33660cc6-d6e0-4d88-a0c0-c4fc9de66aed service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9e2382be0c6f4779ae64026a57628773&device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 1096 time: 0.2530389 May 12 15:23:14.944773 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2332e0ab-a013-41c7-a488-73fbb0838538 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:14.949555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c77d83a-7bed-4d2b-80f3-727146c588ee req-d45714f7-5223-45ae-9116-c67ba3f44edf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1489642 May 12 15:23:15.000171 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:15.031389 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:15.049448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Allocated IP 172.20.0.9 (964ad372-fe57-4fd7-9c44-852ac0957b3c/126daff2-fa1d-4ce6-a721-83e207b54aab/cf8e58af-1d8b-4e30-99c5-896479073feb) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:23:15.049701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:15.049701 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:15.141332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=4a88f583-55ea-4849-8a87-dbc693ed07d0,revision_number=12']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:15.149701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b42fdcf0-1c13-44b6-ae5f-7fe7ec7e9e43 req-8ff30851-71b3-4266-8db2-f0ac00ff91aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:15.151285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b42fdcf0-1c13-44b6-ae5f-7fe7ec7e9e43 req-8ff30851-71b3-4266-8db2-f0ac00ff91aa service neutron] 10.222.0.76 "GET /v2.0/networks?id=e7794860-7444-4123-96d5-ca3febf5e162 HTTP/1.1" status: 200 len: 911 time: 0.3201711 May 12 15:23:15.221400 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1632249b-a6b4-44bd-921a-5a946ee6b3bd'] response: {'server_uuid': 'c6664985-1799-40f2-b048-f9f4daa5401e', 'name': 'network-vif-deleted', 'tag': '4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31', 'status': 'completed', 'code': 200} May 12 15:23:15.240504 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b42fdcf0-1c13-44b6-ae5f-7fe7ec7e9e43 req-6277d21a-b35c-4ae0-987e-89cc9d75d4c8 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=31c449ad-4a28-4740-9037-350aab14340e HTTP/1.1" status: 200 len: 217 time: 0.0759249 May 12 15:23:15.255792 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11b71819-5057-4654-afaa-611ca17a7ce7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:15.283242 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11b71819-5057-4654-afaa-611ca17a7ce7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:15.361287 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11b71819-5057-4654-afaa-611ca17a7ce7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:15.379559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22628e58-2325-42c5-85b8-b1d9a9b9e654 req-01721f85-a45f-4ef0-9806-421ed0eb241f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:15.381143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22628e58-2325-42c5-85b8-b1d9a9b9e654 req-01721f85-a45f-4ef0-9806-421ed0eb241f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.3762250 May 12 15:23:15.387632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b42fdcf0-1c13-44b6-ae5f-7fe7ec7e9e43 req-871c3fb8-cbc3-4fe8-bf11-25112682bb5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:15.389057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11b71819-5057-4654-afaa-611ca17a7ce7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bcceeef8-0214-44d0-9671-29d985971221,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:15.389192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b42fdcf0-1c13-44b6-ae5f-7fe7ec7e9e43 req-871c3fb8-cbc3-4fe8-bf11-25112682bb5b service neutron] 10.222.0.76 "GET /v2.0/subnets?id=eae80ee9-f335-4892-af0b-41490fc3c6b5 HTTP/1.1" status: 200 len: 850 time: 0.1112585 May 12 15:23:15.443098 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11b71819-5057-4654-afaa-611ca17a7ce7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:15.446541 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-11b71819-5057-4654-afaa-611ca17a7ce7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bcceeef8-0214-44d0-9671-29d985971221 HTTP/1.1" status: 204 len: 168 time: 0.6595325 May 12 15:23:15.454557 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:15.458380 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b42fdcf0-1c13-44b6-ae5f-7fe7ec7e9e43 req-fd20a844-7ff2-4c63-8c12-8e66b95a4776 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e7794860-7444-4123-96d5-ca3febf5e162&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0630617 May 12 15:23:15.489424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Transition to ACTIVE for port object cf8e58af-1d8b-4e30-99c5-896479073feb will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:15.498500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc8e0fd8-1d65-4b9e-aaf8-4b3657c9b156 req-b46c18d0-c91a-4cdc-b250-f8996e7dc780 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:15.505826 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc8e0fd8-1d65-4b9e-aaf8-4b3657c9b156 req-b46c18d0-c91a-4cdc-b250-f8996e7dc780 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.2631774 May 12 15:23:15.531244 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:15.619092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22628e58-2325-42c5-85b8-b1d9a9b9e654 req-bab0e39d-edd7-44f5-80e9-9ccf5133eea1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1911004 May 12 15:23:15.651995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Network 964ad372-fe57-4fd7-9c44-852ac0957b3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:23:15.661298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:15.686131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:23:15.721483 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-834466cd-10fc-47bc-9d64-15fcde3d0335'] response: {'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'code': 200} May 12 15:23:15.724549 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc8e0fd8-1d65-4b9e-aaf8-4b3657c9b156 req-b830788f-8058-41c3-945c-7a3bdb805651 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2177951 May 12 15:23:15.724975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event updated for resources: {'Port': ['ID=cf8e58af-1d8b-4e30-99c5-896479073feb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:15.794019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b42fdcf0-1c13-44b6-ae5f-7fe7ec7e9e43 req-5bb14004-817e-4cfb-9272-1e8475da85c9 service neutron] 10.222.0.76 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3272679 May 12 15:23:15.801720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:15.804527 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:15.857924 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b43a5fdd-321e-4d2d-b8bc-53f86508101f tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 1.3741841 May 12 15:23:15.861319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36946) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:15.871827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-cfb83b2c-2c24-4755-9062-a8a4088ec76e tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.0/16', 'mac_address': 'fa:16:3e:e9:b2:b5'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:16.008101 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:16.164349 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:16.173193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1b0579d8-db13-4299-854f-d47feb76ae81 None None] Provisioning for port cf8e58af-1d8b-4e30-99c5-896479073feb completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:16.178754 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1b0579d8-db13-4299-854f-d47feb76ae81 None None] Provisioning complete for port cf8e58af-1d8b-4e30-99c5-896479073feb triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:16.179118 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1b0579d8-db13-4299-854f-d47feb76ae81 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:16.199843 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b42fdcf0-1c13-44b6-ae5f-7fe7ec7e9e43 req-c52ef13f-0607-40ba-8290-316504e910da service neutron] 10.222.0.76 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3969221 May 12 15:23:16.263310 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1b0579d8-db13-4299-854f-d47feb76ae81 None None] Port cf8e58af-1d8b-4e30-99c5-896479073feb cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:16.319984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5b91c2e-35f3-49bf-b58a-8a3731aa9d25 req-da43a6e5-47a0-4907-a882-c3d7f4576370 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:16.326733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5b91c2e-35f3-49bf-b58a-8a3731aa9d25 req-da43a6e5-47a0-4907-a882-c3d7f4576370 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2883658 May 12 15:23:16.366138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f98d319a-cdfa-4cd6-afc9-98d861cbd782 req-fafdd32b-1264-4a8a-9875-7844b29a988d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:16.378002 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f98d319a-cdfa-4cd6-afc9-98d861cbd782 req-fafdd32b-1264-4a8a-9875-7844b29a988d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 947 time: 0.3411136 May 12 15:23:16.495994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5b91c2e-35f3-49bf-b58a-8a3731aa9d25 req-dbd63e84-38f3-4e5b-a46d-394e65de61ad tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1495132 May 12 15:23:16.511793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f98d319a-cdfa-4cd6-afc9-98d861cbd782 req-8b05d021-58f0-4773-a37d-72fce86ee579 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1328156 May 12 15:23:16.640158 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a560642-78d3-4075-8150-6ed0b9d8f221 req-3b280786-d1d0-45d2-87f1-b8feb90c9541 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:16.642202 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a560642-78d3-4075-8150-6ed0b9d8f221 req-3b280786-d1d0-45d2-87f1-b8feb90c9541 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 1098 time: 0.6812093 May 12 15:23:16.750499 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a560642-78d3-4075-8150-6ed0b9d8f221 req-3c8b5b50-5937-4d76-b08d-3d03acc5b956 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1010864 May 12 15:23:16.756894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f850283-65a1-4a16-8380-5128eb894e6c req-5c4d3946-e926-46ea-ac7a-1f07999fdbdf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:16.764367 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f850283-65a1-4a16-8380-5128eb894e6c req-5c4d3946-e926-46ea-ac7a-1f07999fdbdf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 946 time: 0.1290700 May 12 15:23:16.781702 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cfb83b2c-2c24-4755-9062-a8a4088ec76e tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:16.860597 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f850283-65a1-4a16-8380-5128eb894e6c req-1da551ac-a95f-40cd-82cf-57bbe2f72a4c tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0950992 May 12 15:23:16.917896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93ee4190-b419-4c79-aafa-b7ef85e50d4f req-134f3055-4fd0-4051-9f66-044022d09890 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:16.917896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93ee4190-b419-4c79-aafa-b7ef85e50d4f req-134f3055-4fd0-4051-9f66-044022d09890 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.1246898 May 12 15:23:16.981584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93ee4190-b419-4c79-aafa-b7ef85e50d4f req-f9be3f05-2c25-47a9-bb65-ed3b3c8bb025 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0594885 May 12 15:23:17.154564 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cfb83b2c-2c24-4755-9062-a8a4088ec76e tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:17.157230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9dae499-9b08-4aa5-9487-c06e82f0c11a req-d2f86bc6-6864-4524-bfcd-9ef17ff6f2d7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:17.158793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9dae499-9b08-4aa5-9487-c06e82f0c11a req-d2f86bc6-6864-4524-bfcd-9ef17ff6f2d7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1547382 May 12 15:23:17.161295 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cfb83b2c-2c24-4755-9062-a8a4088ec76e tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:17.228039 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9dae499-9b08-4aa5-9487-c06e82f0c11a req-e1ab0501-a40e-45c0-9358-5fc89ee6d688 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0591700 May 12 15:23:17.250515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25104348-2e63-4fac-9f34-d9bd8d861a7e req-da40a49b-14d7-4f99-9a63-cf3f2fabc53f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:17.263775 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25104348-2e63-4fac-9f34-d9bd8d861a7e req-da40a49b-14d7-4f99-9a63-cf3f2fabc53f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.1562686 May 12 15:23:17.362807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfb83b2c-2c24-4755-9062-a8a4088ec76e tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event updated for resources: {'Port': ['ID=cf8e58af-1d8b-4e30-99c5-896479073feb,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:17.363060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25104348-2e63-4fac-9f34-d9bd8d861a7e req-c97829bc-ba5d-455d-9951-9d4616fe6b7a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1000729 May 12 15:23:17.395270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-cfb83b2c-2c24-4755-9062-a8a4088ec76e tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] In _notify_port_updated(), no bound segment for port cf8e58af-1d8b-4e30-99c5-896479073feb on network 964ad372-fe57-4fd7-9c44-852ac0957b3c {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:23:17.395270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cfb83b2c-2c24-4755-9062-a8a4088ec76e tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:17.395837 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cfb83b2c-2c24-4755-9062-a8a4088ec76e tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:17.400035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37000) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:17.400279 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cfb83b2c-2c24-4755-9062-a8a4088ec76e tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "PUT /v2.0/ports/cf8e58af-1d8b-4e30-99c5-896479073feb HTTP/1.1" status: 200 len: 995 time: 1.5376463 May 12 15:23:17.457150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:23:17.598926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:23:17.599254 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4bfb12d0-f9ac-4cc4-bc69-3c7a3f30bd31 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:23:17.673274 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:17.675783 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2b766fc8-bd9d-4569-a9ef-734c14de8a60 None None] Provisioning complete for port cf8e58af-1d8b-4e30-99c5-896479073feb triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:17.676335 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2b766fc8-bd9d-4569-a9ef-734c14de8a60 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:17.737804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a553aca8-9852-462b-9f35-5dee1d719f28 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Deleting port cf8e58af-1d8b-4e30-99c5-896479073feb {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:17.738143 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a553aca8-9852-462b-9f35-5dee1d719f28 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:17.746962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2b766fc8-bd9d-4569-a9ef-734c14de8a60 None None] Port cf8e58af-1d8b-4e30-99c5-896479073feb cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:17.789620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88d0c42f-951a-455b-8cec-b504fead9c0e req-46d05d09-af94-4285-b634-27c093a5d4af tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-SecurityGroupsTestJSON-securitygroup-876196712&fields=id&tenant_id=86574e26b5194d1f92a51749f063fa69 HTTP/1.1" status: 200 len: 267 time: 0.1368370 May 12 15:23:18.102873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37030) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:18.133942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88d0c42f-951a-455b-8cec-b504fead9c0e req-e4869ebf-d405-4bb3-b0f4-da53ae432ecf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:18.141722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88d0c42f-951a-455b-8cec-b504fead9c0e req-e4869ebf-d405-4bb3-b0f4-da53ae432ecf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 946 time: 0.3400998 May 12 15:23:18.205767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-88d0c42f-951a-455b-8cec-b504fead9c0e req-1c92d3f9-5705-4fd8-818d-9499f32607bb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'port': {'security_groups': ['b0aae945-e0f0-419f-88b0-e0606e730ccb', '5f153cae-50a1-4084-94aa-1b5bb113ef0a']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:18.285831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66d5725e-4ff2-4de4-a02b-b1f252e2b016 req-590ad946-a619-496f-a245-8218963c89f7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:18.293332 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66d5725e-4ff2-4de4-a02b-b1f252e2b016 req-590ad946-a619-496f-a245-8218963c89f7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.4200881 May 12 15:23:18.335629 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33dd1e20-e643-4e27-b50b-cc617a3cb963 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:18.372797 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66d5725e-4ff2-4de4-a02b-b1f252e2b016 req-7376852a-2a51-4eaa-a495-b18b159118fc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0785227 May 12 15:23:18.374639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-33dd1e20-e643-4e27-b50b-cc617a3cb963 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:18.380831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-33dd1e20-e643-4e27-b50b-cc617a3cb963 admin admin] Usage tracker for resource:security_group_rule and tenant:188954507c464dc9a1b43a88ee6161a5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:18.385512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-33dd1e20-e643-4e27-b50b-cc617a3cb963 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:18.408905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-33dd1e20-e643-4e27-b50b-cc617a3cb963 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:18.558982 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-88d0c42f-951a-455b-8cec-b504fead9c0e req-1c92d3f9-5705-4fd8-818d-9499f32607bb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:18.570678 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a553aca8-9852-462b-9f35-5dee1d719f28 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:18.640842 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33dd1e20-e643-4e27-b50b-cc617a3cb963 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:18.650750 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33dd1e20-e643-4e27-b50b-cc617a3cb963 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:18.781643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33dd1e20-e643-4e27-b50b-cc617a3cb963 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9232aeb9-fd56-4743-a656-4c18290642ca,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:18.804636 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-33dd1e20-e643-4e27-b50b-cc617a3cb963 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=188954507c464dc9a1b43a88ee6161a5&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7005455 May 12 15:23:18.807100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37068) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:18.933278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a553aca8-9852-462b-9f35-5dee1d719f28 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Calling delete_port for cf8e58af-1d8b-4e30-99c5-896479073feb owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:18.968753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bc524eb9-f21d-4ed3-9440-5fb6f44c6673 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:19.016222 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bc524eb9-f21d-4ed3-9440-5fb6f44c6673 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:19.093489 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bc524eb9-f21d-4ed3-9440-5fb6f44c6673 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:19.122454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc524eb9-f21d-4ed3-9440-5fb6f44c6673 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9232aeb9-fd56-4743-a656-4c18290642ca,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:19.135191 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bc524eb9-f21d-4ed3-9440-5fb6f44c6673 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:19.136320 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bc524eb9-f21d-4ed3-9440-5fb6f44c6673 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9232aeb9-fd56-4743-a656-4c18290642ca HTTP/1.1" status: 204 len: 168 time: 0.3283052 May 12 15:23:19.251740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8e048d4-0304-43cc-b88a-9aa8f5b763e6 req-0109ea3c-f104-4d3c-88fe-2bbbe9e4dc6c tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:19.258628 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8e048d4-0304-43cc-b88a-9aa8f5b763e6 req-0109ea3c-f104-4d3c-88fe-2bbbe9e4dc6c tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 947 time: 0.6007066 May 12 15:23:19.412379 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8e048d4-0304-43cc-b88a-9aa8f5b763e6 req-ef676449-c26c-484f-b5ae-c8a5d2e71d22 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1528161 May 12 15:23:19.458448 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a553aca8-9852-462b-9f35-5dee1d719f28 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:19.664604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a553aca8-9852-462b-9f35-5dee1d719f28 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event deleted for resources: {'Port': ['ID=cf8e58af-1d8b-4e30-99c5-896479073feb,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:19.669684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-88d0c42f-951a-455b-8cec-b504fead9c0e req-1c92d3f9-5705-4fd8-818d-9499f32607bb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] For port 3665052f-787a-44a4-bee0-3335df3f44a6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3665052f-787a-44a4-bee0-3335df3f44a6,segment=NetworkSegment(2b9a3118-674a-42bd-be1d-3a0efcec85f0),segment_id=2b9a3118-674a-42bd-be1d-3a0efcec85f0)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:19.808997 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-88d0c42f-951a-455b-8cec-b504fead9c0e req-1c92d3f9-5705-4fd8-818d-9499f32607bb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:19.848207 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-88d0c42f-951a-455b-8cec-b504fead9c0e req-1c92d3f9-5705-4fd8-818d-9499f32607bb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:19.885704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3665052f-787a-44a4-bee0-3335df3f44a6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:20.223380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88d0c42f-951a-455b-8cec-b504fead9c0e req-1c92d3f9-5705-4fd8-818d-9499f32607bb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:20.224061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-88d0c42f-951a-455b-8cec-b504fead9c0e req-1c92d3f9-5705-4fd8-818d-9499f32607bb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:20.238007 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88d0c42f-951a-455b-8cec-b504fead9c0e req-1c92d3f9-5705-4fd8-818d-9499f32607bb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "PUT /v2.0/ports/3665052f-787a-44a4-bee0-3335df3f44a6 HTTP/1.1" status: 200 len: 982 time: 2.0950971 May 12 15:23:20.241592 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9848e953-d1fb-4bb4-8995-1f62bf3efd1c', 'tag': '3665052f-787a-44a4-bee0-3335df3f44a6'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:20.285508 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a553aca8-9852-462b-9f35-5dee1d719f28 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:20.331805 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640ac90b-8fb4-4a9d-97e3-b79747d1e002 req-f845e215-e833-456a-bcf2-991b41060b41 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:20.340116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-640ac90b-8fb4-4a9d-97e3-b79747d1e002 req-f845e215-e833-456a-bcf2-991b41060b41 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.7123675 May 12 15:23:20.467614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c92d3f9-5705-4fd8-818d-9499f32607bb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'Port': ['ID=3665052f-787a-44a4-bee0-3335df3f44a6,revision_number=6']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:20.520510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3665052f-787a-44a4-bee0-3335df3f44a6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:20.525302 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a553aca8-9852-462b-9f35-5dee1d719f28 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "DELETE /v2.0/ports/cf8e58af-1d8b-4e30-99c5-896479073feb HTTP/1.1" status: 204 len: 168 time: 3.1239846 May 12 15:23:20.527747 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37112) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:20.555171 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-640ac90b-8fb4-4a9d-97e3-b79747d1e002 req-6ebb1c05-363e-4549-ac16-cfb54e95ce76 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2137318 May 12 15:23:20.629111 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-a8a92826-cc46-4984-b78f-2ff62eb7f46e tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] GET failed (client error): The resource could not be found. May 12 15:23:20.630227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a8a92826-cc46-4984-b78f-2ff62eb7f46e tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Synchronizing usage tracker for tenant:daa0af99633f4135975c6cd122c15437 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:20.670229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a8a92826-cc46-4984-b78f-2ff62eb7f46e tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Unset dirty status for tenant:daa0af99633f4135975c6cd122c15437 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:20.676144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a8a92826-cc46-4984-b78f-2ff62eb7f46e tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "GET /v2.0/ports/cf8e58af-1d8b-4e30-99c5-896479073feb HTTP/1.1" status: 404 len: 333 time: 0.1404433 May 12 15:23:20.677013 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37118) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:20.682708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Request body: {'port': {'network_id': '964ad372-fe57-4fd7-9c44-852ac0957b3c', 'name': 'tempest-AllowedAddressPairTestJSON-927537431'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:20.720826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db71511e-c1a6-4ed2-8e35-09da5c063b55 req-1c46b312-5aa6-443e-8521-d7c68303ffab tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:20.722662 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db71511e-c1a6-4ed2-8e35-09da5c063b55 req-1c46b312-5aa6-443e-8521-d7c68303ffab tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.2433527 May 12 15:23:20.840508 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db71511e-c1a6-4ed2-8e35-09da5c063b55 req-a8662f64-83d4-4229-9529-287f2e59855f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1104791 May 12 15:23:20.846165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a82dae3f-d30e-4d75-8543-92644c0ffb9f req-2e628fdb-d986-48d9-b29a-7b707efb4c18 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-SecurityGroupsTestJSON-securitygroup-1897320484&fields=id&tenant_id=86574e26b5194d1f92a51749f063fa69 HTTP/1.1" status: 200 len: 267 time: 0.0856495 May 12 15:23:20.931367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:20.937832 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e4d14d07-a7ed-4eb4-8bee-f2b8a326c65f'] response: {'name': 'network-changed', 'server_uuid': '9848e953-d1fb-4bb4-8995-1f62bf3efd1c', 'tag': '3665052f-787a-44a4-bee0-3335df3f44a6', 'status': 'completed', 'code': 200} May 12 15:23:20.954744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:20.976991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Made reservation on behalf of daa0af99633f4135975c6cd122c15437 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:20.980523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:21.017236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a82dae3f-d30e-4d75-8543-92644c0ffb9f req-5929e1a0-4d08-49b0-b1c6-a2855dace98d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:21.019979 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a82dae3f-d30e-4d75-8543-92644c0ffb9f req-5929e1a0-4d08-49b0-b1c6-a2855dace98d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 985 time: 0.1572633 May 12 15:23:21.041875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-a82dae3f-d30e-4d75-8543-92644c0ffb9f req-fd9a2182-0988-4a42-ac8e-616a66a86617 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'port': {'security_groups': ['5f153cae-50a1-4084-94aa-1b5bb113ef0a', 'b0aae945-e0f0-419f-88b0-e0606e730ccb', '9887b154-c2ee-411c-adde-fd90b2df6d88']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:21.084388 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] device_id is not set on port ba66bba2-f659-43d4-9932-a22d98aac78d yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:23:21.256446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af789aa2-2146-4f59-a09b-2746cc0db608 req-17c6c0c1-fc30-47e5-a8c1-6a31083c3e1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:21.257998 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af789aa2-2146-4f59-a09b-2746cc0db608 req-17c6c0c1-fc30-47e5-a8c1-6a31083c3e1d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=86574e26b5194d1f92a51749f063fa69&device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 1136 time: 0.2238858 May 12 15:23:21.348171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Allocated IP 172.20.0.3 (964ad372-fe57-4fd7-9c44-852ac0957b3c/126daff2-fa1d-4ce6-a721-83e207b54aab/ba66bba2-f659-43d4-9932-a22d98aac78d) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:23:21.480302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eba9965f-0097-4310-b574-9a2f73a70dc6 req-b281acb2-c874-4fed-8587-27f7901d3ea9 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:21.488302 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eba9965f-0097-4310-b574-9a2f73a70dc6 req-b281acb2-c874-4fed-8587-27f7901d3ea9 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 947 time: 0.3233557 May 12 15:23:21.498334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af789aa2-2146-4f59-a09b-2746cc0db608 req-b1929dfb-b040-4a87-b282-fc7e52eb38cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:21.499930 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af789aa2-2146-4f59-a09b-2746cc0db608 req-b1929dfb-b040-4a87-b282-fc7e52eb38cb service neutron] 10.222.0.84 "GET /v2.0/networks?id=b50584ea-1073-48d4-a2bc-43b11374a495 HTTP/1.1" status: 200 len: 914 time: 0.2352493 May 12 15:23:21.508440 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a82dae3f-d30e-4d75-8543-92644c0ffb9f req-fd9a2182-0988-4a42-ac8e-616a66a86617 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:21.605681 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eba9965f-0097-4310-b574-9a2f73a70dc6 req-4592b5f6-623c-48b1-9296-c37be3771532 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1130130 May 12 15:23:21.633839 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af789aa2-2146-4f59-a09b-2746cc0db608 req-337b0b53-5cae-4ee7-8aa6-43d11ec8378f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=3665052f-787a-44a4-bee0-3335df3f44a6 HTTP/1.1" status: 200 len: 217 time: 0.0773058 May 12 15:23:21.747427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af789aa2-2146-4f59-a09b-2746cc0db608 req-65a13fb0-cbcc-4a8e-9e1b-a2ebe887b3ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:21.749658 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af789aa2-2146-4f59-a09b-2746cc0db608 req-65a13fb0-cbcc-4a8e-9e1b-a2ebe887b3ec service neutron] 10.222.0.84 "GET /v2.0/subnets?id=92a8d5fe-fb2b-414d-9ae2-15fb02337cd9 HTTP/1.1" status: 200 len: 853 time: 0.1030278 May 12 15:23:21.868131 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af789aa2-2146-4f59-a09b-2746cc0db608 req-782f2a43-8679-4884-bb95-b5d19dacf75d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b50584ea-1073-48d4-a2bc-43b11374a495&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0922418 May 12 15:23:21.916792 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:21.997168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-a82dae3f-d30e-4d75-8543-92644c0ffb9f req-fd9a2182-0988-4a42-ac8e-616a66a86617 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] For port 3665052f-787a-44a4-bee0-3335df3f44a6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3665052f-787a-44a4-bee0-3335df3f44a6,segment=NetworkSegment(2b9a3118-674a-42bd-be1d-3a0efcec85f0),segment_id=2b9a3118-674a-42bd-be1d-3a0efcec85f0)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:22.034579 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a82dae3f-d30e-4d75-8543-92644c0ffb9f req-fd9a2182-0988-4a42-ac8e-616a66a86617 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:22.044727 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a82dae3f-d30e-4d75-8543-92644c0ffb9f req-fd9a2182-0988-4a42-ac8e-616a66a86617 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:22.087290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3665052f-787a-44a4-bee0-3335df3f44a6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:22.133072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Transition to ACTIVE for port object ba66bba2-f659-43d4-9932-a22d98aac78d will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:22.218810 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af789aa2-2146-4f59-a09b-2746cc0db608 req-7d75fdc2-1104-48c2-bf1d-298963f3d14b service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3377204 May 12 15:23:22.426613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a82dae3f-d30e-4d75-8543-92644c0ffb9f req-fd9a2182-0988-4a42-ac8e-616a66a86617 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:22.428150 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a82dae3f-d30e-4d75-8543-92644c0ffb9f req-fd9a2182-0988-4a42-ac8e-616a66a86617 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:22.429644 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a82dae3f-d30e-4d75-8543-92644c0ffb9f req-fd9a2182-0988-4a42-ac8e-616a66a86617 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "PUT /v2.0/ports/3665052f-787a-44a4-bee0-3335df3f44a6 HTTP/1.1" status: 200 len: 1021 time: 1.4017856 May 12 15:23:22.462166 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af789aa2-2146-4f59-a09b-2746cc0db608 req-b7c070c1-751b-4c6a-b074-f3f98b9d67e8 service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2362711 May 12 15:23:22.477562 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:22.538165 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9a2182-0988-4a42-ac8e-616a66a86617 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'Port': ['ID=3665052f-787a-44a4-bee0-3335df3f44a6,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:22.586152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3665052f-787a-44a4-bee0-3335df3f44a6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:22.591109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a208658f-1595-4ed5-b47a-673de2040959 req-7d1ba818-add9-43b2-a217-c87630e2e883 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:22.607249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a208658f-1595-4ed5-b47a-673de2040959 req-7d1ba818-add9-43b2-a217-c87630e2e883 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.4132297 May 12 15:23:22.663114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37152) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:22.677882 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Network 964ad372-fe57-4fd7-9c44-852ac0957b3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:23:22.688146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:22.691103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:23:22.761249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event updated for resources: {'Port': ['ID=ba66bba2-f659-43d4-9932-a22d98aac78d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:22.783954 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a208658f-1595-4ed5-b47a-673de2040959 req-749364cb-e415-4f3a-a2bd-4c0f98ea16eb tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1757495 May 12 15:23:22.824547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:22.825313 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:22.872995 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-63aae6c3-c478-4ad1-b85d-6c68ed9573cf tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 2.1924388 May 12 15:23:22.877284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baf5bce8-5ca5-4075-9d23-005cd7cc56f4 req-0cf09e6b-4438-4579-a3d7-634304f41404 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:22.877497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37160) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:22.883053 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-baf5bce8-5ca5-4075-9d23-005cd7cc56f4 req-0cf09e6b-4438-4579-a3d7-634304f41404 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.1998463 May 12 15:23:22.892027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Request body: {'port': {'network_id': '964ad372-fe57-4fd7-9c44-852ac0957b3c', 'name': 'tempest-AllowedAddressPairTestJSON-2020252001'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:22.939508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9848e953-d1fb-4bb4-8995-1f62bf3efd1c', 'tag': '3665052f-787a-44a4-bee0-3335df3f44a6'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:23.028851 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-baf5bce8-5ca5-4075-9d23-005cd7cc56f4 req-f34f3129-d664-4372-8868-c7d896903995 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1394415 May 12 15:23:23.034470 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-809a3a91-8089-4c20-9f96-c21464413a4c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:23.085306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-809a3a91-8089-4c20-9f96-c21464413a4c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:23.153496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-809a3a91-8089-4c20-9f96-c21464413a4c admin admin] Usage tracker for resource:security_group_rule and tenant:e7cdd9fe1ecd4fc0930a61832db3293f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:23.163047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-809a3a91-8089-4c20-9f96-c21464413a4c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:23.167753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b6694413-adf2-4ee6-8ed9-e4200c8553ea None None] Provisioning for port ba66bba2-f659-43d4-9932-a22d98aac78d completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:23.177850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-809a3a91-8089-4c20-9f96-c21464413a4c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:23.181685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b6694413-adf2-4ee6-8ed9-e4200c8553ea None None] Provisioning complete for port ba66bba2-f659-43d4-9932-a22d98aac78d triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:23.182563 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b6694413-adf2-4ee6-8ed9-e4200c8553ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:23.281469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:23.293742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Usage tracker for resource:port and tenant:daa0af99633f4135975c6cd122c15437 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:23.300833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:23.314726 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c9fbec5a-f35b-48d8-b561-058c34838f80'] response: {'name': 'network-changed', 'server_uuid': '9848e953-d1fb-4bb4-8995-1f62bf3efd1c', 'tag': '3665052f-787a-44a4-bee0-3335df3f44a6', 'status': 'completed', 'code': 200} May 12 15:23:23.319853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:23.321307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b6694413-adf2-4ee6-8ed9-e4200c8553ea None None] Port ba66bba2-f659-43d4-9932-a22d98aac78d cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:23.348607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Made reservation on behalf of daa0af99633f4135975c6cd122c15437 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:23.358553 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:23.362604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17507c16-e3aa-4e4e-a940-2502f720fb2c req-809ce725-87c6-428f-8317-e324b74a3796 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:23.370033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-17507c16-e3aa-4e4e-a940-2502f720fb2c req-809ce725-87c6-428f-8317-e324b74a3796 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 1024 time: 0.2778494 May 12 15:23:23.449469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] device_id is not set on port b566c895-2eb4-437e-9717-6803134e1cd8 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:23:23.569687 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-809a3a91-8089-4c20-9f96-c21464413a4c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:23.612024 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-809a3a91-8089-4c20-9f96-c21464413a4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:23.613365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc8b0aa-9c17-4f88-9552-41ca357973a7 req-9bb2aa1a-342b-41ac-ba92-a0c6a49d16bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:23.614849 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5dc8b0aa-9c17-4f88-9552-41ca357973a7 req-9bb2aa1a-342b-41ac-ba92-a0c6a49d16bc service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=86574e26b5194d1f92a51749f063fa69&device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 1175 time: 0.2329895 May 12 15:23:23.621002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Allocated IP 172.20.0.10 (964ad372-fe57-4fd7-9c44-852ac0957b3c/126daff2-fa1d-4ce6-a721-83e207b54aab/b566c895-2eb4-437e-9717-6803134e1cd8) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:23:23.645712 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-17507c16-e3aa-4e4e-a940-2502f720fb2c req-07d77c2f-6f8b-47fb-81b1-448d525a7dc7 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=5f153cae-50a1-4084-94aa-1b5bb113ef0a&id=9887b154-c2ee-411c-adde-fd90b2df6d88&id=b0aae945-e0f0-419f-88b0-e0606e730ccb HTTP/1.1" status: 200 len: 6156 time: 0.2673900 May 12 15:23:23.698807 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-809a3a91-8089-4c20-9f96-c21464413a4c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e7cdd9fe1ecd4fc0930a61832db3293f&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9700696 May 12 15:23:23.702240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-cc537779-9537-4cac-9268-53d68195f411 req-fae0ca24-a796-44c1-b801-7fd98643d5f1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'security_group': {'name': ' tempest-securitygroup -258714256 ', 'description': 'tempest-description-1120724080'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:23.708208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-809a3a91-8089-4c20-9f96-c21464413a4c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d76eb47e-0c1d-4839-81c5-b8cf41deb556,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:23.710870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37174) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:23.728339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cc537779-9537-4cac-9268-53d68195f411 req-fae0ca24-a796-44c1-b801-7fd98643d5f1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:23.757308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cc537779-9537-4cac-9268-53d68195f411 req-fae0ca24-a796-44c1-b801-7fd98643d5f1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 1 items for resource security_group. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:23.800834 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78860b91-84be-48ea-9231-9c51b2efc130 req-7b9158f3-9d4b-4611-8632-17c6c71731a8 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:23.807726 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78860b91-84be-48ea-9231-9c51b2efc130 req-7b9158f3-9d4b-4611-8632-17c6c71731a8 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2404516 May 12 15:23:23.819790 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cc537779-9537-4cac-9268-53d68195f411 req-fae0ca24-a796-44c1-b801-7fd98643d5f1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:23.855368 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43ac66ef-7c3b-40b3-bcd5-4fa5638c995f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:23.873823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cc537779-9537-4cac-9268-53d68195f411 req-fae0ca24-a796-44c1-b801-7fd98643d5f1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:23.897931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cc537779-9537-4cac-9268-53d68195f411 req-fae0ca24-a796-44c1-b801-7fd98643d5f1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group_rule and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:23.908140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cc537779-9537-4cac-9268-53d68195f411 req-fae0ca24-a796-44c1-b801-7fd98643d5f1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:23.913174 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78860b91-84be-48ea-9231-9c51b2efc130 req-060f5de4-ef79-47cf-8c8a-e4449b8a8b96 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1046674 May 12 15:23:23.914872 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43ac66ef-7c3b-40b3-bcd5-4fa5638c995f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:23.927550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cc537779-9537-4cac-9268-53d68195f411 req-fae0ca24-a796-44c1-b801-7fd98643d5f1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:23.995193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc8b0aa-9c17-4f88-9552-41ca357973a7 req-34f4e2f8-e95b-4a5f-b95b-e0f51518b960 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:23.996794 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5dc8b0aa-9c17-4f88-9552-41ca357973a7 req-34f4e2f8-e95b-4a5f-b95b-e0f51518b960 service neutron] 10.222.0.84 "GET /v2.0/networks?id=b50584ea-1073-48d4-a2bc-43b11374a495 HTTP/1.1" status: 200 len: 914 time: 0.3735664 May 12 15:23:24.021825 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43ac66ef-7c3b-40b3-bcd5-4fa5638c995f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:24.048038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43ac66ef-7c3b-40b3-bcd5-4fa5638c995f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d76eb47e-0c1d-4839-81c5-b8cf41deb556,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:24.107392 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5dc8b0aa-9c17-4f88-9552-41ca357973a7 req-e087b55b-cd8a-41ba-94e6-bbf32a19631e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=3665052f-787a-44a4-bee0-3335df3f44a6 HTTP/1.1" status: 200 len: 217 time: 0.1024141 May 12 15:23:24.138269 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43ac66ef-7c3b-40b3-bcd5-4fa5638c995f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:24.139400 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-43ac66ef-7c3b-40b3-bcd5-4fa5638c995f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d76eb47e-0c1d-4839-81c5-b8cf41deb556 HTTP/1.1" status: 204 len: 168 time: 0.4259400 May 12 15:23:24.142012 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cc537779-9537-4cac-9268-53d68195f411 req-fae0ca24-a796-44c1-b801-7fd98643d5f1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:24.154705 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cc537779-9537-4cac-9268-53d68195f411 req-fae0ca24-a796-44c1-b801-7fd98643d5f1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:24.164376 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:24.194174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Transition to ACTIVE for port object b566c895-2eb4-437e-9717-6803134e1cd8 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:24.201711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc8b0aa-9c17-4f88-9552-41ca357973a7 req-f113717b-b560-449b-a40c-08dff273a9a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:24.203372 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5dc8b0aa-9c17-4f88-9552-41ca357973a7 req-f113717b-b560-449b-a40c-08dff273a9a3 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=92a8d5fe-fb2b-414d-9ae2-15fb02337cd9 HTTP/1.1" status: 200 len: 853 time: 0.0838563 May 12 15:23:24.229913 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cc537779-9537-4cac-9268-53d68195f411 req-fae0ca24-a796-44c1-b801-7fd98643d5f1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:24.234364 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc537779-9537-4cac-9268-53d68195f411 req-fae0ca24-a796-44c1-b801-7fd98643d5f1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1787 time: 0.5406911 May 12 15:23:24.241369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fae0ca24-a796-44c1-b801-7fd98643d5f1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c246a045-56d5-4699-8953-672328356429,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:24.288848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba67ba83-0d93-4b78-ac6a-492b5adb19e6 req-9c16cfd6-740f-4a66-9836-eb0e18d94161 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:24.300754 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba67ba83-0d93-4b78-ac6a-492b5adb19e6 req-9c16cfd6-740f-4a66-9836-eb0e18d94161 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.2029247 May 12 15:23:24.316817 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5dc8b0aa-9c17-4f88-9552-41ca357973a7 req-25f534ca-e92e-4a80-ac50-4bcdb2194491 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b50584ea-1073-48d4-a2bc-43b11374a495&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1067982 May 12 15:23:24.380874 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba67ba83-0d93-4b78-ac6a-492b5adb19e6 req-ac5ed419-cf3b-47b1-ab7f-6712406ad0e1 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0781901 May 12 15:23:24.465477 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:24.563508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Network 964ad372-fe57-4fd7-9c44-852ac0957b3c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:23:24.565315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:24.586236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:23:24.626988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event updated for resources: {'Port': ['ID=b566c895-2eb4-437e-9717-6803134e1cd8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:24.837329 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5dc8b0aa-9c17-4f88-9552-41ca357973a7 req-aecfcec2-47fc-4038-bf96-fd30c9f5152d service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5050530 May 12 15:23:24.856064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1223b81b-b816-4dbe-af3b-5a419a8f3502 req-9c1bd60b-5cd0-40b0-88cb-90c3990bccfb tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:24.862958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1223b81b-b816-4dbe-af3b-5a419a8f3502 req-9c1bd60b-5cd0-40b0-88cb-90c3990bccfb tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.4385273 May 12 15:23:24.907082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16c6d0ec-afc4-444a-a3a6-4c568a232cdf req-5b8c9bde-a74c-4847-a937-40008e108b16 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:24.908507 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16c6d0ec-afc4-444a-a3a6-4c568a232cdf req-5b8c9bde-a74c-4847-a937-40008e108b16 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.3476462 May 12 15:23:24.917816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:24.918562 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:24.960927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ce3f3785-3372-4069-8b46-ad24318134e6 None None] Provisioning for port b566c895-2eb4-437e-9717-6803134e1cd8 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:24.970396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ce3f3785-3372-4069-8b46-ad24318134e6 None None] Provisioning complete for port b566c895-2eb4-437e-9717-6803134e1cd8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:24.970943 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ce3f3785-3372-4069-8b46-ad24318134e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:25.006462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1223b81b-b816-4dbe-af3b-5a419a8f3502 req-0e3da51c-34fe-4f60-b865-a432cfdeb972 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1289215 May 12 15:23:25.035437 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dc0967f9-c569-4602-946e-8acbe2666b03 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.1541979 May 12 15:23:25.038379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37204) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:25.053416 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16c6d0ec-afc4-444a-a3a6-4c568a232cdf req-e2a306bc-02c2-43a9-9dfd-2e3b9650a20b tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1145582 May 12 15:23:25.088028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ccb68e17-69c3-40d8-baf2-0bfb483104de tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.11', 'mac_address': 'fa:16:3e:e9:b2:b5'}, {'ip_address': '172.20.0.3', 'mac_address': 'fa:16:3e:7f:37:18'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:25.116785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ce3f3785-3372-4069-8b46-ad24318134e6 None None] Port b566c895-2eb4-437e-9717-6803134e1cd8 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:25.170462 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5dc8b0aa-9c17-4f88-9552-41ca357973a7 req-4999342c-1c67-4d85-b78c-9f465c5cc708 service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3249485 May 12 15:23:25.246038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6fdde87-4057-466e-9af9-34fd1a79e0e1 req-cb6c3dd3-5e59-4284-957d-dfd09f708c0a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/c246a045-56d5-4699-8953-672328356429 HTTP/1.1" status: 200 len: 1782 time: 0.1760216 May 12 15:23:25.386316 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8b6b0a68-a40e-4e43-b88a-8d1e44176ac0 req-3540a95a-6a1e-4d9a-ba68-6da60367e094 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/c246a045-56d5-4699-8953-672328356429 HTTP/1.1" status: 200 len: 1782 time: 0.1059229 May 12 15:23:25.462920 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ccb68e17-69c3-40d8-baf2-0bfb483104de tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:25.513989 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8b6b0a68-a40e-4e43-b88a-8d1e44176ac0 req-dd57e5ff-58a7-428c-98bd-3d162f4b934d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:25.547869 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8b6b0a68-a40e-4e43-b88a-8d1e44176ac0 req-dd57e5ff-58a7-428c-98bd-3d162f4b934d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:25.706659 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8b6b0a68-a40e-4e43-b88a-8d1e44176ac0 req-dd57e5ff-58a7-428c-98bd-3d162f4b934d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:25.742286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd57e5ff-58a7-428c-98bd-3d162f4b934d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c246a045-56d5-4699-8953-672328356429,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:25.753014 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-8b6b0a68-a40e-4e43-b88a-8d1e44176ac0 req-dd57e5ff-58a7-428c-98bd-3d162f4b934d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:25.767603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8b6b0a68-a40e-4e43-b88a-8d1e44176ac0 req-dd57e5ff-58a7-428c-98bd-3d162f4b934d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "DELETE /v2.0/security-groups/c246a045-56d5-4699-8953-672328356429 HTTP/1.1" status: 204 len: 173 time: 0.3685958 May 12 15:23:25.816063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b92d10c-092c-4dc3-9e80-65983134e081 req-da91ca38-89c1-4b2f-9a2e-fc3577d36cb5 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:25.826573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b92d10c-092c-4dc3-9e80-65983134e081 req-da91ca38-89c1-4b2f-9a2e-fc3577d36cb5 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.2114296 May 12 15:23:25.922895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b92d10c-092c-4dc3-9e80-65983134e081 req-9194a4c0-bfff-449e-b56c-e78aca6bec13 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0948849 May 12 15:23:25.962012 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-b9e5ccd7-2337-4484-ac93-2b8fd4c86d98 req-a96c9786-2719-4817-b40d-b4ab5c26bc83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] show failed (client error): The resource could not be found. May 12 15:23:25.988142 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9e5ccd7-2337-4484-ac93-2b8fd4c86d98 req-a96c9786-2719-4817-b40d-b4ab5c26bc83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/c246a045-56d5-4699-8953-672328356429 HTTP/1.1" status: 404 len: 352 time: 0.0460129 May 12 15:23:26.000608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-6886576c-58fa-42f4-99cd-8fb1097959eb req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-199383849', 'description': 'tempest-description-41981137'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:26.008960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-6886576c-58fa-42f4-99cd-8fb1097959eb req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:26.022347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6886576c-58fa-42f4-99cd-8fb1097959eb req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:26.028228 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ccb68e17-69c3-40d8-baf2-0bfb483104de tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:26.036400 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ccb68e17-69c3-40d8-baf2-0bfb483104de tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:26.038496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6886576c-58fa-42f4-99cd-8fb1097959eb req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:26.047224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-6886576c-58fa-42f4-99cd-8fb1097959eb req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 1 items for resource security_group. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:26.065458 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6886576c-58fa-42f4-99cd-8fb1097959eb req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:26.126122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-6886576c-58fa-42f4-99cd-8fb1097959eb req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:26.135792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6886576c-58fa-42f4-99cd-8fb1097959eb req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group_rule and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:26.141870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6886576c-58fa-42f4-99cd-8fb1097959eb req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:26.150250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-6886576c-58fa-42f4-99cd-8fb1097959eb req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:26.290599 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccb68e17-69c3-40d8-baf2-0bfb483104de tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event updated for resources: {'Port': ['ID=b566c895-2eb4-437e-9717-6803134e1cd8,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:26.332458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ccb68e17-69c3-40d8-baf2-0bfb483104de tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] In _notify_port_updated(), no bound segment for port b566c895-2eb4-437e-9717-6803134e1cd8 on network 964ad372-fe57-4fd7-9c44-852ac0957b3c {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:23:26.353864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccb68e17-69c3-40d8-baf2-0bfb483104de tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:26.354834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ccb68e17-69c3-40d8-baf2-0bfb483104de tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:26.367438 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ccb68e17-69c3-40d8-baf2-0bfb483104de tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "PUT /v2.0/ports/b566c895-2eb4-437e-9717-6803134e1cd8 HTTP/1.1" status: 200 len: 1057 time: 1.3207817 May 12 15:23:26.368464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37246) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:26.486734 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6886576c-58fa-42f4-99cd-8fb1097959eb req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:26.515081 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6886576c-58fa-42f4-99cd-8fb1097959eb req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:26.517917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1bc847ff-2f52-4f95-8f14-b4cc0b089705 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Deleting port b566c895-2eb4-437e-9717-6803134e1cd8 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:26.518601 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1bc847ff-2f52-4f95-8f14-b4cc0b089705 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:26.620986 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-6886576c-58fa-42f4-99cd-8fb1097959eb req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:26.621938 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6886576c-58fa-42f4-99cd-8fb1097959eb req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1805 time: 0.6266716 May 12 15:23:26.630975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7e02939-a58a-499f-89a2-a90047a59df3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'SecurityGroup': ['ID=54a649c9-7554-49a7-b278-2f99b9e96651,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:26.660099 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6d3b1a17-9695-40a9-ad00-a3d414589658 None None] Provisioning complete for port b566c895-2eb4-437e-9717-6803134e1cd8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:26.660688 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6d3b1a17-9695-40a9-ad00-a3d414589658 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:26.689724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37254) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:26.691583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db39f56-91a4-495a-b079-38bf61bee4c8 req-9aa2fc67-9335-4077-9eec-084fa17e46f3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:26.700536 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8db39f56-91a4-495a-b079-38bf61bee4c8 req-9aa2fc67-9335-4077-9eec-084fa17e46f3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.3494718 May 12 15:23:26.737666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6d3b1a17-9695-40a9-ad00-a3d414589658 None None] Port b566c895-2eb4-437e-9717-6803134e1cd8 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:26.793049 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8db39f56-91a4-495a-b079-38bf61bee4c8 req-db1308a4-ccaa-47f7-aadf-8264882a0b7d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0914369 May 12 15:23:26.881124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-0e971caf-83b6-49a7-97ba-ecc9c8ff6929 req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-1357858919', 'description': 'tempest-description-1567670058'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:26.887664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0e971caf-83b6-49a7-97ba-ecc9c8ff6929 req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:26.890367 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd1dbe73-89ed-49b4-bf67-82e87cc5c7c0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:26.894505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0e971caf-83b6-49a7-97ba-ecc9c8ff6929 req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:26.898597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0e971caf-83b6-49a7-97ba-ecc9c8ff6929 req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:26.907502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0e971caf-83b6-49a7-97ba-ecc9c8ff6929 req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 1 items for resource security_group. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:26.922700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1bc847ff-2f52-4f95-8f14-b4cc0b089705 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:26.922897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e971caf-83b6-49a7-97ba-ecc9c8ff6929 req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:26.940714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dd1dbe73-89ed-49b4-bf67-82e87cc5c7c0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:26.948217 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0e971caf-83b6-49a7-97ba-ecc9c8ff6929 req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:26.959069 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0e971caf-83b6-49a7-97ba-ecc9c8ff6929 req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group_rule and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:26.963807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0e971caf-83b6-49a7-97ba-ecc9c8ff6929 req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:26.981465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0e971caf-83b6-49a7-97ba-ecc9c8ff6929 req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:27.017051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dd1dbe73-89ed-49b4-bf67-82e87cc5c7c0 admin admin] Usage tracker for resource:security_group_rule and tenant:59739db25a61423487a5a24c71874698 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:27.098545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dd1dbe73-89ed-49b4-bf67-82e87cc5c7c0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:27.106824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1bc847ff-2f52-4f95-8f14-b4cc0b089705 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Calling delete_port for b566c895-2eb4-437e-9717-6803134e1cd8 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:27.143860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dd1dbe73-89ed-49b4-bf67-82e87cc5c7c0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:27.164782 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e971caf-83b6-49a7-97ba-ecc9c8ff6929 req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:27.169354 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e971caf-83b6-49a7-97ba-ecc9c8ff6929 req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:27.230692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'SecurityGroup': ['ID=05e9c670-cc39-4a14-88fe-60d00bd91864,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:27.238170 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e971caf-83b6-49a7-97ba-ecc9c8ff6929 req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:27.239386 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e971caf-83b6-49a7-97ba-ecc9c8ff6929 req-1aa16de0-d543-430c-98e2-67e8e313248a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1808 time: 0.3622310 May 12 15:23:27.247172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ee9ee5d-b06c-4974-90b4-c2db34453974 req-d060e665-15a9-4ef1-83a4-0f704201c4c0 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:27.249576 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ee9ee5d-b06c-4974-90b4-c2db34453974 req-d060e665-15a9-4ef1-83a4-0f704201c4c0 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.1752400 May 12 15:23:27.306570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-7c0e607f-c0f5-42c4-8d13-548370bedcba req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-2053601059', 'description': 'tempest-description-2096140663'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:27.309127 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1bc847ff-2f52-4f95-8f14-b4cc0b089705 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:27.315134 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ee9ee5d-b06c-4974-90b4-c2db34453974 req-9ca7f3e9-3375-4242-92a3-086f40a32c6d tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535820 May 12 15:23:27.317997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-7c0e607f-c0f5-42c4-8d13-548370bedcba req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:27.322838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7c0e607f-c0f5-42c4-8d13-548370bedcba req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:27.326301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7c0e607f-c0f5-42c4-8d13-548370bedcba req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group was recalculated. Used quota:5. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:27.338990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-7c0e607f-c0f5-42c4-8d13-548370bedcba req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 1 items for resource security_group. Total usage: 5; quota limit: 100; headroom:95 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:27.374886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bc847ff-2f52-4f95-8f14-b4cc0b089705 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event deleted for resources: {'Port': ['ID=b566c895-2eb4-437e-9717-6803134e1cd8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:27.427112 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd1dbe73-89ed-49b4-bf67-82e87cc5c7c0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:27.440906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7c0e607f-c0f5-42c4-8d13-548370bedcba req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:27.475695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-7c0e607f-c0f5-42c4-8d13-548370bedcba req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:27.480665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7c0e607f-c0f5-42c4-8d13-548370bedcba req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group_rule and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:27.485424 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7c0e607f-c0f5-42c4-8d13-548370bedcba req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group_rule was recalculated. Used quota:12. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:27.500600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-7c0e607f-c0f5-42c4-8d13-548370bedcba req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 12; quota limit: 100; headroom:88 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:27.559325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd1dbe73-89ed-49b4-bf67-82e87cc5c7c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:27.613560 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7c0e607f-c0f5-42c4-8d13-548370bedcba req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:27.619046 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dd1dbe73-89ed-49b4-bf67-82e87cc5c7c0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=59739db25a61423487a5a24c71874698&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9268816 May 12 15:23:27.620754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37278) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:27.620974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd1dbe73-89ed-49b4-bf67-82e87cc5c7c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7c17c783-4648-4d25-9821-ac60f7cdb847,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:27.635727 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7c0e607f-c0f5-42c4-8d13-548370bedcba req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:27.714696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e8e0e0d8-e930-41af-8e5d-681965361b35,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:27.721996 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7c0e607f-c0f5-42c4-8d13-548370bedcba req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:27.723176 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c0e607f-c0f5-42c4-8d13-548370bedcba req-cd43abad-ee9a-4999-ae03-50d7ae03deac tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1808 time: 0.4249904 May 12 15:23:27.754163 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae6a3088-c64e-4870-9a62-67ab5b1113b0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:27.820861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae6a3088-c64e-4870-9a62-67ab5b1113b0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:27.916496 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1bc847ff-2f52-4f95-8f14-b4cc0b089705 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:27.936859 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1bc847ff-2f52-4f95-8f14-b4cc0b089705 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "DELETE /v2.0/ports/b566c895-2eb4-437e-9717-6803134e1cd8 HTTP/1.1" status: 204 len: 168 time: 1.5655015 May 12 15:23:27.938106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9957eef8-2adc-490f-a240-c9b38bac5fb2 req-d88a139b-de13-45f8-91be-e11bfbfef411 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Synchronizing usage tracker for tenant:86574e26b5194d1f92a51749f063fa69 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:27.940332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37292) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:27.965902 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae6a3088-c64e-4870-9a62-67ab5b1113b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:27.990777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9957eef8-2adc-490f-a240-c9b38bac5fb2 req-d88a139b-de13-45f8-91be-e11bfbfef411 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Unset dirty status for tenant:86574e26b5194d1f92a51749f063fa69 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:27.997586 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-801a6dfc-1c27-4e5c-96f1-19e67ddb8621 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] GET failed (client error): The resource could not be found. May 12 15:23:27.997974 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9957eef8-2adc-490f-a240-c9b38bac5fb2 req-d88a139b-de13-45f8-91be-e11bfbfef411 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=86574e26b5194d1f92a51749f063fa69 HTTP/1.1" status: 200 len: 10909 time: 0.2411938 May 12 15:23:27.998110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-801a6dfc-1c27-4e5c-96f1-19e67ddb8621 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Synchronizing usage tracker for tenant:daa0af99633f4135975c6cd122c15437 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:28.016147 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-801a6dfc-1c27-4e5c-96f1-19e67ddb8621 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Unset dirty status for tenant:daa0af99633f4135975c6cd122c15437 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:28.019875 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-801a6dfc-1c27-4e5c-96f1-19e67ddb8621 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "GET /v2.0/ports/b566c895-2eb4-437e-9717-6803134e1cd8 HTTP/1.1" status: 404 len: 333 time: 0.0760016 May 12 15:23:28.020146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37296) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:28.035183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae6a3088-c64e-4870-9a62-67ab5b1113b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7c17c783-4648-4d25-9821-ac60f7cdb847,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:28.072222 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae6a3088-c64e-4870-9a62-67ab5b1113b0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:28.081727 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ae6a3088-c64e-4870-9a62-67ab5b1113b0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7c17c783-4648-4d25-9821-ac60f7cdb847 HTTP/1.1" status: 204 len: 168 time: 0.4597077 May 12 15:23:28.104330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-83edbd71-ac1f-46db-aadf-a65f634e8ba5 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Deleting port ba66bba2-f659-43d4-9932-a22d98aac78d {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:28.106281 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-83edbd71-ac1f-46db-aadf-a65f634e8ba5 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:28.134656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9957eef8-2adc-490f-a240-c9b38bac5fb2 req-546e49a7-7496-469d-afc1-57fe6aa246af tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/b0aae945-e0f0-419f-88b0-e0606e730ccb HTTP/1.1" status: 200 len: 2985 time: 0.0912917 May 12 15:23:28.152831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-349a70ce-75b2-47f4-9aae-4912cfa6c92d req-3e74d158-7901-4d40-8355-3f722ef22810 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:28.161257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-349a70ce-75b2-47f4-9aae-4912cfa6c92d req-3e74d158-7901-4d40-8355-3f722ef22810 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.1876080 May 12 15:23:28.267464 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-349a70ce-75b2-47f4-9aae-4912cfa6c92d req-d9676bcc-4f12-429f-ae87-d16a4dd817c8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1047592 May 12 15:23:28.276693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9957eef8-2adc-490f-a240-c9b38bac5fb2 req-92654b09-6f81-410a-b165-420c7a0695e8 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/b0aae945-e0f0-419f-88b0-e0606e730ccb HTTP/1.1" status: 200 len: 2985 time: 0.0935736 May 12 15:23:28.404492 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e97e592-811c-463b-a3e7-2d79795e4952 req-da36ddce-2492-429c-b831-4117a7dc91eb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/54a649c9-7554-49a7-b278-2f99b9e96651 HTTP/1.1" status: 200 len: 1800 time: 0.1031384 May 12 15:23:28.599329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-83edbd71-ac1f-46db-aadf-a65f634e8ba5 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:28.606741 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e97e592-811c-463b-a3e7-2d79795e4952 req-c13622ba-3dae-4426-ab0c-0919fc545c75 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:28.659310 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e97e592-811c-463b-a3e7-2d79795e4952 req-c13622ba-3dae-4426-ab0c-0919fc545c75 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:28.699143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5158f7a0-0f5b-4914-aa95-5766e252ae7e req-49cf1a00-a25f-4354-b4e7-f035a35df2ef tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:28.700699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5158f7a0-0f5b-4914-aa95-5766e252ae7e req-49cf1a00-a25f-4354-b4e7-f035a35df2ef tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.2169425 May 12 15:23:28.752483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-83edbd71-ac1f-46db-aadf-a65f634e8ba5 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Calling delete_port for ba66bba2-f659-43d4-9932-a22d98aac78d owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:28.765547 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5158f7a0-0f5b-4914-aa95-5766e252ae7e req-afdec573-5537-480f-82da-997b3bdac441 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538108 May 12 15:23:28.799128 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e97e592-811c-463b-a3e7-2d79795e4952 req-c13622ba-3dae-4426-ab0c-0919fc545c75 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:28.820151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13622ba-3dae-4426-ab0c-0919fc545c75 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=54a649c9-7554-49a7-b278-2f99b9e96651,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:28.836544 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0e97e592-811c-463b-a3e7-2d79795e4952 req-c13622ba-3dae-4426-ab0c-0919fc545c75 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:28.856752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e97e592-811c-463b-a3e7-2d79795e4952 req-c13622ba-3dae-4426-ab0c-0919fc545c75 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "DELETE /v2.0/security-groups/54a649c9-7554-49a7-b278-2f99b9e96651 HTTP/1.1" status: 204 len: 173 time: 0.4446087 May 12 15:23:28.903943 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-66fd8a06-93e8-4152-8bbd-d41dddc6705b req-b8b66be4-8c28-4ae1-a418-3703ca3affa2 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] show failed (client error): The resource could not be found. May 12 15:23:28.919425 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66fd8a06-93e8-4152-8bbd-d41dddc6705b req-b8b66be4-8c28-4ae1-a418-3703ca3affa2 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/54a649c9-7554-49a7-b278-2f99b9e96651 HTTP/1.1" status: 404 len: 352 time: 0.0545025 May 12 15:23:28.999051 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-83edbd71-ac1f-46db-aadf-a65f634e8ba5 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:29.007762 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed85a4a7-7074-4db0-a02c-7bea291eca4a req-35e3b527-2751-425a-8af6-d08c5083a2b3 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/05e9c670-cc39-4a14-88fe-60d00bd91864 HTTP/1.1" status: 200 len: 1803 time: 0.0777879 May 12 15:23:29.148593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83edbd71-ac1f-46db-aadf-a65f634e8ba5 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event deleted for resources: {'Port': ['ID=ba66bba2-f659-43d4-9932-a22d98aac78d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:29.178130 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed85a4a7-7074-4db0-a02c-7bea291eca4a req-861d1a9a-27cd-4641-9596-a00e7701e939 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:29.224710 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed85a4a7-7074-4db0-a02c-7bea291eca4a req-861d1a9a-27cd-4641-9596-a00e7701e939 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:29.237184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-83edbd71-ac1f-46db-aadf-a65f634e8ba5 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:29.266380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37340) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:29.277372 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-83edbd71-ac1f-46db-aadf-a65f634e8ba5 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "DELETE /v2.0/ports/ba66bba2-f659-43d4-9932-a22d98aac78d HTTP/1.1" status: 204 len: 168 time: 1.2534416 May 12 15:23:29.277966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37346) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:29.299474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e525b7d-ecbe-412e-89dc-10f5efbb3a51 req-caadf2d0-bafc-4305-84b5-4a6a56fb0c2e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:29.308579 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e525b7d-ecbe-412e-89dc-10f5efbb3a51 req-caadf2d0-bafc-4305-84b5-4a6a56fb0c2e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2215145 May 12 15:23:29.332280 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-18a8b4ca-b371-4365-8b08-d6ce7f88fc9c tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] GET failed (client error): The resource could not be found. May 12 15:23:29.332816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-18a8b4ca-b371-4365-8b08-d6ce7f88fc9c tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Synchronizing usage tracker for tenant:daa0af99633f4135975c6cd122c15437 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:29.375240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-18a8b4ca-b371-4365-8b08-d6ce7f88fc9c tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Unset dirty status for tenant:daa0af99633f4135975c6cd122c15437 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:29.380203 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-18a8b4ca-b371-4365-8b08-d6ce7f88fc9c tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "GET /v2.0/ports/ba66bba2-f659-43d4-9932-a22d98aac78d HTTP/1.1" status: 404 len: 333 time: 0.1012101 May 12 15:23:29.381345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37352) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:29.386180 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e525b7d-ecbe-412e-89dc-10f5efbb3a51 req-3ea29fd5-c7d1-4bcc-a245-57b46b4f2af9 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0726986 May 12 15:23:29.395156 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed85a4a7-7074-4db0-a02c-7bea291eca4a req-861d1a9a-27cd-4641-9596-a00e7701e939 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:29.426082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-861d1a9a-27cd-4641-9596-a00e7701e939 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=05e9c670-cc39-4a14-88fe-60d00bd91864,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:29.442273 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ed85a4a7-7074-4db0-a02c-7bea291eca4a req-861d1a9a-27cd-4641-9596-a00e7701e939 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:29.468470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed85a4a7-7074-4db0-a02c-7bea291eca4a req-861d1a9a-27cd-4641-9596-a00e7701e939 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "DELETE /v2.0/security-groups/05e9c670-cc39-4a14-88fe-60d00bd91864 HTTP/1.1" status: 204 len: 173 time: 0.4596276 May 12 15:23:29.510928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1997878807-network', 'tenant_id': '011dcf6c7b624a28bb2d8ed8db38754f'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:29.519162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:29.528596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Usage tracker for resource:network and tenant:011dcf6c7b624a28bb2d8ed8db38754f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:29.535175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:29.547176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-a3b9c999-86f2-4453-a1ca-b77b38e44c15 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Deleting port ef55421d-c37e-4cbd-b89c-b51db8cae969 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:29.547689 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3b9c999-86f2-4453-a1ca-b77b38e44c15 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:29.582093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:29.619112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Made reservation on behalf of 011dcf6c7b624a28bb2d8ed8db38754f for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:29.621807 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:29.666068 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:29.699907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:29.708419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Usage tracker for resource:security_group_rule and tenant:011dcf6c7b624a28bb2d8ed8db38754f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:29.713742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:29.740543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:29.798397 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28a5d47-a765-4023-ac7a-e384aac4c046 req-aacc1e26-1b0d-4642-a6bc-57244ac2d4aa tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:29.799959 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e28a5d47-a765-4023-ac7a-e384aac4c046 req-aacc1e26-1b0d-4642-a6bc-57244ac2d4aa tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.2557337 May 12 15:23:29.815288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-440c7039-05a5-4135-9d97-dd9f25002a85 req-5736cf6c-eb40-45a2-981d-fb148357b1b5 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:29.816919 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-440c7039-05a5-4135-9d97-dd9f25002a85 req-5736cf6c-eb40-45a2-981d-fb148357b1b5 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2341716 May 12 15:23:29.891286 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e28a5d47-a765-4023-ac7a-e384aac4c046 req-f54b832d-d94c-4403-b92e-aa833abe7964 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0846670 May 12 15:23:29.895741 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3b9c999-86f2-4453-a1ca-b77b38e44c15 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:29.896052 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-440c7039-05a5-4135-9d97-dd9f25002a85 req-edfba7d8-64f9-45b7-bf6a-895d69a3d56e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0622294 May 12 15:23:29.980628 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-c4b469fb-dec5-49f0-a93c-aae1997231b3 req-956cd09d-1469-48ea-8ec2-985c78485ab0 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] show failed (client error): The resource could not be found. May 12 15:23:29.981707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4b469fb-dec5-49f0-a93c-aae1997231b3 req-956cd09d-1469-48ea-8ec2-985c78485ab0 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/05e9c670-cc39-4a14-88fe-60d00bd91864 HTTP/1.1" status: 404 len: 352 time: 0.0299830 May 12 15:23:30.164327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e854e94-1f91-42cd-8bdb-67c1f67cd145 req-d12595fd-24e1-4dea-a824-8214f2b718a6 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:30.164327 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e854e94-1f91-42cd-8bdb-67c1f67cd145 req-d12595fd-24e1-4dea-a824-8214f2b718a6 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.1106942 May 12 15:23:30.166713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-a3b9c999-86f2-4453-a1ca-b77b38e44c15 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Calling delete_port for ef55421d-c37e-4cbd-b89c-b51db8cae969 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:30.279393 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:30.303919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:30.327819 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e854e94-1f91-42cd-8bdb-67c1f67cd145 req-4aea75f4-4644-4b6c-99e5-99b8b498f6a5 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1542721 May 12 15:23:30.353483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-91c1bbe2-475b-4a42-bb8f-6fc9960c0a47 req-6775bdf5-a90d-4be8-afc9-99b8935d9fe5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/e8e0e0d8-e930-41af-8e5d-681965361b35 HTTP/1.1" status: 200 len: 1803 time: 0.1473725 May 12 15:23:30.374069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 573} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:23:30.399379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d4634bb-4ec1-45f3-ba4a-767fb8000e74,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:30.459254 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:30.459685 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Added segment 70920b24-31ad-40cc-b105-d50702bf12f1 of type vlan for network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 May 12 15:23:30.460940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3b9c999-86f2-4453-a1ca-b77b38e44c15 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:30.506860 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-91c1bbe2-475b-4a42-bb8f-6fc9960c0a47 req-37add3b9-e47b-4744-a08c-1e109a5fca74 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:30.586895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3b9c999-86f2-4453-a1ca-b77b38e44c15 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event deleted for resources: {'Port': ['ID=ef55421d-c37e-4cbd-b89c-b51db8cae969,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:30.614564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-91c1bbe2-475b-4a42-bb8f-6fc9960c0a47 req-37add3b9-e47b-4744-a08c-1e109a5fca74 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:30.707041 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:30.721067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-900c0689-4afd-45c0-82ba-abb430d6de78 req-08238769-8904-4554-b9dd-5f35710ff118 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:30.722896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-900c0689-4afd-45c0-82ba-abb430d6de78 req-08238769-8904-4554-b9dd-5f35710ff118 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1938858 May 12 15:23:30.724606 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-91c1bbe2-475b-4a42-bb8f-6fc9960c0a47 req-37add3b9-e47b-4744-a08c-1e109a5fca74 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:30.774943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37add3b9-e47b-4744-a08c-1e109a5fca74 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8e0e0d8-e930-41af-8e5d-681965361b35,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:30.831052 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3b9c999-86f2-4453-a1ca-b77b38e44c15 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:30.850498 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:23:30.864005 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a3b9c999-86f2-4453-a1ca-b77b38e44c15 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "DELETE /v2.0/ports/ef55421d-c37e-4cbd-b89c-b51db8cae969 HTTP/1.1" status: 204 len: 168 time: 1.4818170 May 12 15:23:30.864900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37388) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:30.870120 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-900c0689-4afd-45c0-82ba-abb430d6de78 req-01203938-b386-458c-9a1d-5456554d7ab8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1395550 May 12 15:23:30.875714 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-91c1bbe2-475b-4a42-bb8f-6fc9960c0a47 req-37add3b9-e47b-4744-a08c-1e109a5fca74 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:30.890567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-91c1bbe2-475b-4a42-bb8f-6fc9960c0a47 req-37add3b9-e47b-4744-a08c-1e109a5fca74 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "DELETE /v2.0/security-groups/e8e0e0d8-e930-41af-8e5d-681965361b35 HTTP/1.1" status: 204 len: 173 time: 0.5300307 May 12 15:23:30.961566 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-23c6cb5a-a3e6-4926-ae12-000b470791b7 req-9ee7cd9e-7748-4249-9700-5e917e7d5b6d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] show failed (client error): The resource could not be found. May 12 15:23:30.969661 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23c6cb5a-a3e6-4926-ae12-000b470791b7 req-9ee7cd9e-7748-4249-9700-5e917e7d5b6d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/e8e0e0d8-e930-41af-8e5d-681965361b35 HTTP/1.1" status: 404 len: 352 time: 0.0233142 May 12 15:23:30.971964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-bf83049e-157d-4107-a595-64f819232e07 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Deleting subnet 126daff2-fa1d-4ce6-a721-83e207b54aab {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:23:30.978794 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf83049e-157d-4107-a595-64f819232e07 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:31.042753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:31.043735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:31.044327 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:31.169891 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf83049e-157d-4107-a595-64f819232e07 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:31.214772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-430e2f8d-4a10-4263-9267-ae5c80d3b1fd req-433a19b0-620d-4c7a-a843-484f7274a0b0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:31.216431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-430e2f8d-4a10-4263-9267-ae5c80d3b1fd req-433a19b0-620d-4c7a-a843-484f7274a0b0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1794806 May 12 15:23:31.230205 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.9627132 May 12 15:23:31.235384 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37398) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:31.246433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Request body: {'subnet': {'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1997878807-subnet', 'tenant_id': '011dcf6c7b624a28bb2d8ed8db38754f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:31.252866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:31.257033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Usage tracker for resource:subnet and tenant:011dcf6c7b624a28bb2d8ed8db38754f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:31.260275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:31.267341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:31.278441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bcb5125-0890-4d95-add0-8ea1fe9ad7f6 req-9018aecf-f1e5-4394-8c46-348311898008 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:31.280405 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0bcb5125-0890-4d95-add0-8ea1fe9ad7f6 req-9018aecf-f1e5-4394-8c46-348311898008 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1527553 May 12 15:23:31.292052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Made reservation on behalf of 011dcf6c7b624a28bb2d8ed8db38754f for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:31.294445 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:31.311468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-210c6bc0-fa8c-4f60-b7b5-d159ef7bbf0e admin admin] Pushing event updated for resources: {'Network': ['ID=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:31.323749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:23:31.402883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0bcb5125-0890-4d95-add0-8ea1fe9ad7f6 req-a4dfca72-a90f-4699-b13a-ced0d7a83737 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0797222 May 12 15:23:31.419937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-430e2f8d-4a10-4263-9267-ae5c80d3b1fd req-94fd88a0-ca25-4e4a-8d7e-609ed33edc1a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1923079 May 12 15:23:31.554017 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf83049e-157d-4107-a595-64f819232e07 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:31.559293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0d39ebd4-b2d8-4f37-8f06-ec8f5689e814 req-7c5a0d6e-f66f-4aaa-82cc-bde9c97a4e27 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Synchronizing usage tracker for tenant:86574e26b5194d1f92a51749f063fa69 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:31.618700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0d39ebd4-b2d8-4f37-8f06-ec8f5689e814 req-7c5a0d6e-f66f-4aaa-82cc-bde9c97a4e27 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Unset dirty status for tenant:86574e26b5194d1f92a51749f063fa69 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:31.620019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0d39ebd4-b2d8-4f37-8f06-ec8f5689e814 req-7c5a0d6e-f66f-4aaa-82cc-bde9c97a4e27 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=86574e26b5194d1f92a51749f063fa69 HTTP/1.1" status: 200 len: 6156 time: 0.1737952 May 12 15:23:31.667208 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:31.732591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f187ef6-2a0c-41b0-99e9-63989a07fee7 req-938ac40a-f830-4c70-909f-91ff70368e1e tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:31.736615 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f187ef6-2a0c-41b0-99e9-63989a07fee7 req-938ac40a-f830-4c70-909f-91ff70368e1e tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.1662831 May 12 15:23:31.750930 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0d39ebd4-b2d8-4f37-8f06-ec8f5689e814 req-3cb9d9a8-739e-4cbe-91a7-cb74a374d63d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/b0aae945-e0f0-419f-88b0-e0606e730ccb HTTP/1.1" status: 200 len: 2985 time: 0.1163297 May 12 15:23:31.755918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf83049e-157d-4107-a595-64f819232e07 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:31.791281 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf83049e-157d-4107-a595-64f819232e07 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:31.802232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0ff5192a-946b-4444-900a-788b8ddc74b6,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:31.807327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9587b8b2-486f-43da-8590-25acb02e72eb None None] Network 964ad372-fe57-4fd7-9c44-852ac0957b3c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:23:31.839626 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f187ef6-2a0c-41b0-99e9-63989a07fee7 req-db70eee6-0e0c-4999-88bc-f24315839304 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0986941 May 12 15:23:31.872145 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bf83049e-157d-4107-a595-64f819232e07 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "DELETE /v2.0/subnets/126daff2-fa1d-4ce6-a721-83e207b54aab HTTP/1.1" status: 204 len: 168 time: 0.9990208 May 12 15:23:31.872145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Checking segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:23:31.872145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Network hostable DHCP agents. Network: aa894a26-e7a0-42ea-b7f1-9a9c136eacd6, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:23:31.872463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37410) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:31.886978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf83049e-157d-4107-a595-64f819232e07 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event deleted for resources: {'Subnet': ['ID=126daff2-fa1d-4ce6-a721-83e207b54aab,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:31.890544 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0d39ebd4-b2d8-4f37-8f06-ec8f5689e814 req-6fedfefb-f945-42dd-abba-176aec17e952 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/b0aae945-e0f0-419f-88b0-e0606e730ccb HTTP/1.1" status: 200 len: 2985 time: 0.1140673 May 12 15:23:31.916102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:23:31.938584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, aa894a26-e7a0-42ea-b7f1-9a9c136eacd6) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:31.944089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:31.944986 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:31.970937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93ebeb46-590f-4e14-b13c-f659a4010a24 None None] Network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:23:32.001302 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-975bd6b0-9ab2-4035-94bf-de02e3ed7ac3 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.7627327 May 12 15:23:32.186647 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:32.236586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Deleting port cbd15264-d9b5-43e6-9659-cabbaba9ac01 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:32.237799 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:32.287177 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:32.315577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65db1962-5f94-48fb-8387-038d0d0fb12b req-ded66882-68cd-4c75-8804-7cad021f24e5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:32.317318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65db1962-5f94-48fb-8387-038d0d0fb12b req-ded66882-68cd-4c75-8804-7cad021f24e5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2829814 May 12 15:23:32.336259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4415b3f6-7acc-47a4-bddc-3556c7bf2428 req-6dc8d849-fae8-4a15-805e-2edf2958bf18 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:32.337732 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4415b3f6-7acc-47a4-bddc-3556c7bf2428 req-6dc8d849-fae8-4a15-805e-2edf2958bf18 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2977617 May 12 15:23:32.349642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3cd4fdc7-4cbb-4aa0-9411-563af50d4d30 None None] Network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:23:32.413893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aee7373c-bba4-4e1e-a15b-806c01b3d30b None None] DHCP port deletion for 964ad372-fe57-4fd7-9c44-852ac0957b3c request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:23:32.432171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-aee7373c-bba4-4e1e-a15b-806c01b3d30b None None] Deleting port cbd15264-d9b5-43e6-9659-cabbaba9ac01 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:32.432521 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-aee7373c-bba4-4e1e-a15b-806c01b3d30b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:32.475913 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65db1962-5f94-48fb-8387-038d0d0fb12b req-72197a34-e11e-4269-97c6-a1a94b067c84 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1484222 May 12 15:23:32.483811 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4415b3f6-7acc-47a4-bddc-3556c7bf2428 req-9d830630-8f60-4ced-bcb4-5187347295dd tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1286035 May 12 15:23:32.550011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-4015b4ac-9c41-4108-8397-e6e36392e3a8 req-2d41395c-0f4f-40cc-b2fa-2ccb83a6d2a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-883775541', 'description': 'tempest-description-391037023'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:32.557860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4015b4ac-9c41-4108-8397-e6e36392e3a8 req-2d41395c-0f4f-40cc-b2fa-2ccb83a6d2a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:32.582045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4015b4ac-9c41-4108-8397-e6e36392e3a8 req-2d41395c-0f4f-40cc-b2fa-2ccb83a6d2a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 1 items for resource security_group. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:32.593094 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] For port cbd15264-d9b5-43e6-9659-cabbaba9ac01, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cbd15264-d9b5-43e6-9659-cabbaba9ac01,segment=NetworkSegment(240bdfeb-be72-4a71-bbb7-fa83b0fb806e),segment_id=240bdfeb-be72-4a71-bbb7-fa83b0fb806e)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:32.593484 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:32.720763 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4015b4ac-9c41-4108-8397-e6e36392e3a8 req-2d41395c-0f4f-40cc-b2fa-2ccb83a6d2a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:32.735460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Calling delete_port for cbd15264-d9b5-43e6-9659-cabbaba9ac01 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:32.818465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-aee7373c-bba4-4e1e-a15b-806c01b3d30b None None] For port cbd15264-d9b5-43e6-9659-cabbaba9ac01, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cbd15264-d9b5-43e6-9659-cabbaba9ac01,segment=NetworkSegment(240bdfeb-be72-4a71-bbb7-fa83b0fb806e),segment_id=240bdfeb-be72-4a71-bbb7-fa83b0fb806e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:32.818793 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-aee7373c-bba4-4e1e-a15b-806c01b3d30b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:32.961300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-aee7373c-bba4-4e1e-a15b-806c01b3d30b None None] Calling delete_port for cbd15264-d9b5-43e6-9659-cabbaba9ac01 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:32.978712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4015b4ac-9c41-4108-8397-e6e36392e3a8 req-2d41395c-0f4f-40cc-b2fa-2ccb83a6d2a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:32.996247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4015b4ac-9c41-4108-8397-e6e36392e3a8 req-2d41395c-0f4f-40cc-b2fa-2ccb83a6d2a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group_rule and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:33.003048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4015b4ac-9c41-4108-8397-e6e36392e3a8 req-2d41395c-0f4f-40cc-b2fa-2ccb83a6d2a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:33.015499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4015b4ac-9c41-4108-8397-e6e36392e3a8 req-2d41395c-0f4f-40cc-b2fa-2ccb83a6d2a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:33.039005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cbd15264-d9b5-43e6-9659-cabbaba9ac01 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:23:33.083357 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: from cryptography.utils import int_from_bytes May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: from cryptography.utils import int_from_bytes May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/relationships.py:1994: SAWarning: Setting backref / back_populates on relationship QosNetworkPolicyBinding.port to refer to viewonly relationship Port.qos_network_policy_binding should include sync_backref=False set on the QosNetworkPolicyBinding.port relationship. (this warning may be suppressed after 10 occurrences) May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn_limited( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/relationships.py:1994: SAWarning: Setting backref / back_populates on relationship Tag.standard_attr to refer to viewonly relationship StandardAttribute.tags should include sync_backref=False set on the Tag.standard_attr relationship. (this warning may be suppressed after 10 occurrences) May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn_limited( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.091116 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.095404 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.095404 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.095404 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.095404 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.095404 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.095404 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.095404 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.095404 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.095404 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.095404 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.095404 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.095404 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.095404 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:23:33.095404 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:23:33.102221 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-aee7373c-bba4-4e1e-a15b-806c01b3d30b None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:23:33.102565 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-aee7373c-bba4-4e1e-a15b-806c01b3d30b None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:23:33.115493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No active binding found for port cbd15264-d9b5-43e6-9659-cabbaba9ac01 {{(pid=88153) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:224}} May 12 15:23:33.115864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cbd15264-d9b5-43e6-9659-cabbaba9ac01 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:23:33.157623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event deleted for resources: {'Port': ['ID=cbd15264-d9b5-43e6-9659-cabbaba9ac01,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:33.160534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] No DVR routers for this DVR port cbd15264-d9b5-43e6-9659-cabbaba9ac01 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:23:33.167944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-5f6fc9f3-6a93-4c6c-b10f-ffab912f3a3e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:33.169417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-5f6fc9f3-6a93-4c6c-b10f-ffab912f3a3e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 812 time: 0.2895749 May 12 15:23:33.305027 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-966f3d37-ee0e-4383-9f33-5bcf5f3d5a8b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/quotas/011dcf6c7b624a28bb2d8ed8db38754f HTTP/1.1" status: 200 len: 375 time: 0.1040399 May 12 15:23:33.377937 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4015b4ac-9c41-4108-8397-e6e36392e3a8 req-2d41395c-0f4f-40cc-b2fa-2ccb83a6d2a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:33.382800 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-fc670a8b-6fb6-4440-a776-3b7fdf2fe383 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0773134 May 12 15:23:33.384289 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:33.412625 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4015b4ac-9c41-4108-8397-e6e36392e3a8 req-2d41395c-0f4f-40cc-b2fa-2ccb83a6d2a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:33.504727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['964ad372-fe57-4fd7-9c44-852ac0957b3c']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:23:33.541399 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '240bdfeb-be72-4a71-bbb7-fa83b0fb806e') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:23:33.541705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '240bdfeb-be72-4a71-bbb7-fa83b0fb806e') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:23:33.572524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d41395c-0f4f-40cc-b2fa-2ccb83a6d2a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d07e6569-0a4a-44ce-88a8-cf53c16de2ab,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:33.578817 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:33.585276 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4015b4ac-9c41-4108-8397-e6e36392e3a8 req-2d41395c-0f4f-40cc-b2fa-2ccb83a6d2a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:33.586482 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4015b4ac-9c41-4108-8397-e6e36392e3a8 req-2d41395c-0f4f-40cc-b2fa-2ccb83a6d2a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1806 time: 1.0552213 May 12 15:23:33.604169 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-aee7373c-bba4-4e1e-a15b-806c01b3d30b None None] Deleting port cbd15264-d9b5-43e6-9659-cabbaba9ac01 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:33.605226 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-aee7373c-bba4-4e1e-a15b-806c01b3d30b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:33.618703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:33.630348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Releasing vlan 578 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:23:33.630628 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: timer() May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:23:33.645427 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:23:33.647949 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-76001b10-f3d5-466b-a454-bc8ce1b5a319 service neutron] 10.222.0.82 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2551446 May 12 15:23:33.682495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-aee7373c-bba4-4e1e-a15b-806c01b3d30b None None] The port 'cbd15264-d9b5-43e6-9659-cabbaba9ac01' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:23:33.849141 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:33.877776 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:33.889542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] Pushing event deleted for resources: {'Network': ['ID=964ad372-fe57-4fd7-9c44-852ac0957b3c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:33.895437 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-452a923e-f542-4796-945e-6c9ce8d4b324 tempest-AllowedAddressPairTestJSON-1592859879 tempest-AllowedAddressPairTestJSON-1592859879-project] 10.222.0.82 "DELETE /v2.0/networks/964ad372-fe57-4fd7-9c44-852ac0957b3c HTTP/1.1" status: 204 len: 168 time: 2.0085034 May 12 15:23:33.949359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-8ee37192-360d-4cee-a52c-ac5abd664b3b service neutron] 10.222.0.82 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2479830 May 12 15:23:33.966007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-695c5626-00d7-4888-8107-eff52cfb2dad req-42a35881-195d-45bf-a22c-6d2a054bd308 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:33.968557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-695c5626-00d7-4888-8107-eff52cfb2dad req-42a35881-195d-45bf-a22c-6d2a054bd308 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2475672 May 12 15:23:34.032663 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-695c5626-00d7-4888-8107-eff52cfb2dad req-281dcd9d-13dd-493f-bc35-933ad9d4d393 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0534723 May 12 15:23:34.110173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-27e4cbed-30e0-46ef-a62e-55440b59cb66 req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-1365988305', 'description': 'tempest-description-1630540229'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:34.137135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-27e4cbed-30e0-46ef-a62e-55440b59cb66 req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:34.147478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-27e4cbed-30e0-46ef-a62e-55440b59cb66 req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:34.155657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-27e4cbed-30e0-46ef-a62e-55440b59cb66 req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:34.169572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-27e4cbed-30e0-46ef-a62e-55440b59cb66 req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 1 items for resource security_group. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:34.205307 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-27e4cbed-30e0-46ef-a62e-55440b59cb66 req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:34.245668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37468) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:34.267055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-27e4cbed-30e0-46ef-a62e-55440b59cb66 req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:34.274354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-27e4cbed-30e0-46ef-a62e-55440b59cb66 req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group_rule and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:34.290693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-27e4cbed-30e0-46ef-a62e-55440b59cb66 req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:34.297885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-27e4cbed-30e0-46ef-a62e-55440b59cb66 req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:34.521588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9718bf14-269d-4066-83bf-974b1ed13281 req-39cd56db-a368-490e-932c-dd403bf00585 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:34.523528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9718bf14-269d-4066-83bf-974b1ed13281 req-39cd56db-a368-490e-932c-dd403bf00585 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.1910043 May 12 15:23:34.542633 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-910621b1-d266-468a-ae15-94dc2d6cd729 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=daa0af99633f4135975c6cd122c15437&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2924726 May 12 15:23:34.542633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37484) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:34.544521 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-27e4cbed-30e0-46ef-a62e-55440b59cb66 req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:34.560462 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-27e4cbed-30e0-46ef-a62e-55440b59cb66 req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:34.634274 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9718bf14-269d-4066-83bf-974b1ed13281 req-5b154d73-268e-4012-b9fb-c10ecb791f54 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0922127 May 12 15:23:34.635784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'SecurityGroup': ['ID=738c04a9-a3ef-44bd-b2b5-86400e968436,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:34.644941 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-760a00dc-674a-4d90-800e-2a6926d5a99a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:34.647744 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-27e4cbed-30e0-46ef-a62e-55440b59cb66 req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:34.663960 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27e4cbed-30e0-46ef-a62e-55440b59cb66 req-49c95bc1-8b4f-4a2e-81eb-35e4280bcd83 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1808 time: 0.5535512 May 12 15:23:34.705128 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-760a00dc-674a-4d90-800e-2a6926d5a99a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:34.794973 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-760a00dc-674a-4d90-800e-2a6926d5a99a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:34.804712 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83c8ba1a-22d7-4a2a-9ea3-b03b23c592f3 req-30bb3798-64c9-4e1d-a7b9-afb1cd881c13 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 210 time: 0.0676789 May 12 15:23:34.835634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-760a00dc-674a-4d90-800e-2a6926d5a99a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=55a107aa-9703-4b76-af87-33ac05de7e52,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:34.844574 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-760a00dc-674a-4d90-800e-2a6926d5a99a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:34.845479 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-760a00dc-674a-4d90-800e-2a6926d5a99a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/55a107aa-9703-4b76-af87-33ac05de7e52 HTTP/1.1" status: 204 len: 168 time: 0.3008802 May 12 15:23:34.979527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e66a8a0-45ce-471e-ab0f-986dd17ee969 req-35662464-34ca-4d54-a1b2-ececa242bf74 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:34.986769 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e66a8a0-45ce-471e-ab0f-986dd17ee969 req-35662464-34ca-4d54-a1b2-ececa242bf74 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1457491 May 12 15:23:35.153618 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e66a8a0-45ce-471e-ab0f-986dd17ee969 req-ad643366-21bc-4c6d-9b42-deab5a379af4 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1654327 May 12 15:23:35.241318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-9264bd60-d24d-4b65-aafe-88d79e258c4b tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:35.249119 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-9264bd60-d24d-4b65-aafe-88d79e258c4b tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 812 time: 0.2395148 May 12 15:23:35.266939 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-95695021-fc5f-491a-b8fd-d1f2b4634644 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/quotas/6357a1184f074ce2a5b5f19b5ce06e85 HTTP/1.1" status: 200 len: 375 time: 0.0158575 May 12 15:23:35.657438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-a14b5422-d93f-497c-a086-25c71afd5058 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:35.658825 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-a14b5422-d93f-497c-a086-25c71afd5058 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/networks?id=b50584ea-1073-48d4-a2bc-43b11374a495 HTTP/1.1" status: 200 len: 813 time: 0.1963575 May 12 15:23:35.672592 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-01034f45-6394-40e7-8dea-ebee2d912432 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&fields=id HTTP/1.1" status: 200 len: 440 time: 0.4042399 May 12 15:23:35.685100 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-ecc2b61d-c68a-4675-ac7b-8eb8e7bfc087 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/quotas/86574e26b5194d1f92a51749f063fa69 HTTP/1.1" status: 200 len: 375 time: 0.0105557 May 12 15:23:35.940587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37548) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:35.946626 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-517e126e-464e-45eb-b8c0-254ad7b4c911 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=86574e26b5194d1f92a51749f063fa69&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2384126 May 12 15:23:35.991323 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-5b7bba76-bc82-4a8a-bff8-64c4fa2cf3ec service neutron] 10.222.0.82 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3028119 May 12 15:23:36.058562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-dfb1de04-5dd3-45e9-8780-cdf8798e8627 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:36.059698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-dfb1de04-5dd3-45e9-8780-cdf8798e8627 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Synchronizing usage tracker for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:36.111965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-dfb1de04-5dd3-45e9-8780-cdf8798e8627 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Unset dirty status for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:36.111965 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-dfb1de04-5dd3-45e9-8780-cdf8798e8627 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 812 time: 0.2694101 May 12 15:23:36.142634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Request body: {'port': {'device_id': '19d9f265-5c0e-4464-8b8a-97af703db06f', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'admin_state_up': True, 'tenant_id': '011dcf6c7b624a28bb2d8ed8db38754f'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:36.242369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsTestJSON-test-network-1731010983'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:36.260548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:36.269992 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Usage tracker for resource:network and tenant:e5f221bbde0b4f28b287cbb78999d605 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:36.274624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:36.285268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:36.324033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Made reservation on behalf of e5f221bbde0b4f28b287cbb78999d605 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:36.328160 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:36.333257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-ea01c8f8-8f8b-4c52-bfd9-20cc42fa2108 service neutron] 10.222.0.82 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3778398 May 12 15:23:36.355131 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:36.376697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:36.381320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Usage tracker for resource:security_group_rule and tenant:e5f221bbde0b4f28b287cbb78999d605 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:36.384366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:36.391416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:36.394330 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-bb2af243-b89c-4d5c-9413-1f21f6ed813c service neutron] 10.222.0.82 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4016891 May 12 15:23:36.394446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:36.400403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Usage tracker for resource:port and tenant:011dcf6c7b624a28bb2d8ed8db38754f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:36.407188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:36.422225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:36.454634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Made reservation on behalf of 011dcf6c7b624a28bb2d8ed8db38754f for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:36.459130 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:36.545926 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6cb9634d-9276-4cc9-b9ff-1ba046068b5f service neutron] 10.222.0.82 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1980515 May 12 15:23:36.705659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:36.720388 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:36.763314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 575} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:23:36.763513 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-457a43b5-00f8-4824-a2d2-ec05988db022 req-ee2f4514-c4e8-4a94-82c4-020b2a466f08 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:36.766299 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-457a43b5-00f8-4824-a2d2-ec05988db022 req-ee2f4514-c4e8-4a94-82c4-020b2a466f08 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1276660 May 12 15:23:36.776992 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Allocated IP 172.20.0.3 (aa894a26-e7a0-42ea-b7f1-9a9c136eacd6/0ff5192a-946b-4444-900a-788b8ddc74b6/5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:23:36.788190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d9337e61-2ae3-4e11-99e7-11d6851719fa,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:36.802156 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:36.802500 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Added segment 08bb1710-24c4-4cf5-ba55-66d36930efa1 of type vlan for network d5df59b8-76b6-4317-a45d-19571e77f5cb May 12 15:23:36.805492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:36.805836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:36.806260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:36.806599 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:36.806924 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:36.807380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:36.807701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:36.808210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:36.808686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:36.809157 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:36.809668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:36.810137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:36.863985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-457a43b5-00f8-4824-a2d2-ec05988db022 req-84038b1e-f60c-4948-8b2e-860456129971 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0902708 May 12 15:23:36.926539 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:36.989230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9984781f-34e9-4fc1-ac5a-c41c4002bf5e req-3824cc02-77b6-4cc6-b225-8b38af3cddb9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:36.991431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9984781f-34e9-4fc1-ac5a-c41c4002bf5e req-3824cc02-77b6-4cc6-b225-8b38af3cddb9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.1264017 May 12 15:23:37.048388 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69f573be-85a2-4d98-b5e2-0736bc8ca51b req-0f551f98-10c2-4e5e-a009-2086e8f31add tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 210 time: 0.0556054 May 12 15:23:37.129522 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9984781f-34e9-4fc1-ac5a-c41c4002bf5e req-1469d40d-6276-419c-a658-c93ba0e9c788 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0785069 May 12 15:23:37.169213 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] It took 0.22 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:23:37.236037 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:37.251376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:37.252671 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:37.305318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d29166b3-440d-4fd8-821a-ee3261cdd962 req-e11532d0-b20b-4922-b1ff-d616074a5493 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 210 time: 0.1499665 May 12 15:23:37.323219 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:37.420500 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b68f1bdb-9570-4970-9f0f-4b50108d9c89 req-f6c33a88-91a5-4613-82a7-d91f76da25fe tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 210 time: 0.1133516 May 12 15:23:37.458284 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:37.562496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:23:37.589468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:37.604524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Pushing event updated for resources: {'Network': ['ID=d5df59b8-76b6-4317-a45d-19571e77f5cb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:37.612826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:23:37.617971 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network d5df59b8-76b6-4317-a45d-19571e77f5cb details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:23:37.675554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdfac59b-0e36-4522-9e81-8e8c08cc0ef7 req-30bf8445-6020-4cde-a864-780681637623 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:37.677143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cdfac59b-0e36-4522-9e81-8e8c08cc0ef7 req-30bf8445-6020-4cde-a864-780681637623 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1465757 May 12 15:23:37.709448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Pushing event updated for resources: {'Port': ['ID=5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:37.723393 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-68c2ddc1-1cab-4e01-a091-71e03c1fa64a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 792 time: 1.7781315 May 12 15:23:37.723393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37588) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:37.729170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Request body: {'subnet': {'network_id': 'd5df59b8-76b6-4317-a45d-19571e77f5cb', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:37.767705 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cdfac59b-0e36-4522-9e81-8e8c08cc0ef7 req-aa8e109a-1f3f-4a7c-a552-fe9e061c247c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836532 May 12 15:23:37.852709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:37.853368 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:37.888533 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-9200385b-b341-4ac5-98b0-bd521b47128d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7692671 May 12 15:23:37.894854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:37.905971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Request body: {'port': {'device_id': '19d9f265-5c0e-4464-8b8a-97af703db06f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:37.968976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Usage tracker for resource:subnet and tenant:e5f221bbde0b4f28b287cbb78999d605 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:37.972986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:37.988565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:38.028513 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c57e23d3-97c9-483c-8c8e-7dc6be7f9828 req-9e644cf9-eb96-4b18-a3c7-c9c133e9f303 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:38.037707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c57e23d3-97c9-483c-8c8e-7dc6be7f9828 req-9e644cf9-eb96-4b18-a3c7-c9c133e9f303 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1160200 May 12 15:23:38.067245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Made reservation on behalf of e5f221bbde0b4f28b287cbb78999d605 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:38.083680 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:38.099662 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c57e23d3-97c9-483c-8c8e-7dc6be7f9828 req-ef89ca90-9dce-4bc4-9ac4-1e4b3dc76173 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585618 May 12 15:23:38.275911 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:38.587345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950ae34e-589d-4f52-8f89-058576b46533 req-55f378be-1f57-483c-926e-c3deebc80441 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:38.589332 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-950ae34e-589d-4f52-8f89-058576b46533 req-55f378be-1f57-483c-926e-c3deebc80441 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 931 time: 0.3193467 May 12 15:23:38.598502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c279978-9377-4d33-89ba-0a30f7e4cdf5 req-74c53f10-cfb7-42ae-adfa-e3522e895c72 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:38.605526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1c279978-9377-4d33-89ba-0a30f7e4cdf5 req-74c53f10-cfb7-42ae-adfa-e3522e895c72 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.2134905 May 12 15:23:38.687310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-950ae34e-589d-4f52-8f89-058576b46533 req-02d2cd2c-86b4-415d-b23a-6a40e7790511 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780969 May 12 15:23:38.707286 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1c279978-9377-4d33-89ba-0a30f7e4cdf5 req-689cc073-1e9a-475d-bfbb-e75b6b8cb6b5 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1007130 May 12 15:23:38.804355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-bb0cd642-08fc-470a-bcb0-c193552155fd tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:38.805806 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-bb0cd642-08fc-470a-bcb0-c193552155fd tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 812 time: 0.2457128 May 12 15:23:38.846625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Request body: {'port': {'device_id': '4719dce9-d654-490a-915f-8e3c7942fc48', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'admin_state_up': True, 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:39.019724 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f47a78d0-d0f1-4bc1-8087-c2df49a0ae10 req-c05bc5a9-9723-4e84-899f-7b5aae200024 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 210 time: 0.2124186 May 12 15:23:39.033684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f070029a-4ffa-4756-8a18-5bd64ed6d93e req-0d2bbea8-7f2d-447a-a868-fd8a558cad68 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 210 time: 0.0552099 May 12 15:23:39.220627 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:39.300283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7f411e6-a92d-488c-b3d8-d1377508da5d req-a910cdf8-c6d4-40f7-a169-70d62424a0f7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:39.308628 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7f411e6-a92d-488c-b3d8-d1377508da5d req-a910cdf8-c6d4-40f7-a169-70d62424a0f7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1278682 May 12 15:23:39.361485 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7f411e6-a92d-488c-b3d8-d1377508da5d req-024e5c94-4fab-4a6b-ac25-2bcb2a3567e5 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515864 May 12 15:23:39.473875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:39.495329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Usage tracker for resource:port and tenant:6357a1184f074ce2a5b5f19b5ce06e85 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:39.504419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Quota usage for port was recalculated. Used quota:5. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:39.523289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attempting to reserve 1 items for resource port. Total usage: 5; quota limit: 500; headroom:495 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:39.559081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58991e2a-88bb-440c-b7eb-06427606dc54 req-b812ff93-4e7a-4df7-9a68-e15ef61541fd tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:39.561352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58991e2a-88bb-440c-b7eb-06427606dc54 req-b812ff93-4e7a-4df7-9a68-e15ef61541fd tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.0929854 May 12 15:23:39.573055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Pushing event updated for resources: {'Subnet': ['ID=85a3b2e6-e361-468d-829f-f002d3131adc,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:39.617325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58991e2a-88bb-440c-b7eb-06427606dc54 req-d2f9e885-e396-4eed-bf43-ea6687ca79cf tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492704 May 12 15:23:39.627005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Made reservation on behalf of 6357a1184f074ce2a5b5f19b5ce06e85 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:39.630453 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:39.667817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Checking segment: {'id': '08bb1710-24c4-4cf5-ba55-66d36930efa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': 'd5df59b8-76b6-4317-a45d-19571e77f5cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:23:39.668177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Network hostable DHCP agents. Network: d5df59b8-76b6-4317-a45d-19571e77f5cb, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:23:39.684834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-dfd4dbf3-1aeb-40fc-bbec-be8e178ff8b2 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:39.687057 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-dfd4dbf3-1aeb-40fc-bbec-be8e178ff8b2 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.84 "GET /v2.0/networks?id=b50584ea-1073-48d4-a2bc-43b11374a495 HTTP/1.1" status: 200 len: 813 time: 0.5483570 May 12 15:23:39.736556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:23:39.749940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'port': {'device_id': 'caefe380-1876-4938-83a7-078804c994b7', 'network_id': 'b50584ea-1073-48d4-a2bc-43b11374a495', 'admin_state_up': True, 'tenant_id': '86574e26b5194d1f92a51749f063fa69'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:39.767697 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:39.883056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Transition to ACTIVE for port object 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:39.888623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Network d5df59b8-76b6-4317-a45d-19571e77f5cb is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:23:39.899242 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:39.960519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39129df5-2a88-4545-93fe-88337d9e3ca1 req-7d6fc6e9-01ea-4854-a3bc-3f11d0de66db tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:39.962093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39129df5-2a88-4545-93fe-88337d9e3ca1 req-7d6fc6e9-01ea-4854-a3bc-3f11d0de66db tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1659176 May 12 15:23:40.019101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, d5df59b8-76b6-4317-a45d-19571e77f5cb) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:40.019718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79eee501-01f7-4f83-9152-bf90bebb619f req-eefaf1d1-3c82-4c98-8978-fd5941a17530 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:40.027151 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-79eee501-01f7-4f83-9152-bf90bebb619f req-eefaf1d1-3c82-4c98-8978-fd5941a17530 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 943 time: 0.1674981 May 12 15:23:40.032999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7df231e7-28b6-42fb-a1d9-dfe57138c2f0 None None] Network d5df59b8-76b6-4317-a45d-19571e77f5cb requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:23:40.049341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:40.050176 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:40.074567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39129df5-2a88-4545-93fe-88337d9e3ca1 req-c08c4c8a-1636-4525-a163-12d2cee4ced4 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1015935 May 12 15:23:40.121044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-79eee501-01f7-4f83-9152-bf90bebb619f req-99755ded-e3cd-4b15-ab32-ceff87b7ea09 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0930741 May 12 15:23:40.252489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Pushing event updated for resources: {'Port': ['ID=5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:40.413302 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9af26755-094f-46c9-a244-6b202928dc07 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.6889002 May 12 15:23:40.423277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37652) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:40.433850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-d5df59b8-76b6-4317-a45d-19571e77f5cb', 'network_id': 'd5df59b8-76b6-4317-a45d-19571e77f5cb', 'tenant_id': 'e5f221bbde0b4f28b287cbb78999d605', 'fixed_ips': [{'subnet_id': '85a3b2e6-e361-468d-829f-f002d3131adc'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:23:40.434536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:40.434860 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:40.438665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Allocated IP 172.20.0.5 (de9b95bc-97c4-4188-a1d0-c125f35032b0/f6980e11-e336-4f1d-9b2b-4462912e9abb/bdd6d277-b9d3-4e93-bfc7-66dd6ac96203) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:23:40.449348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:port and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:40.452637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Request body: {'port': {'network_id': 'd5df59b8-76b6-4317-a45d-19571e77f5cb', 'name': 'tempest-ExtraDHCPOptionsTestJSON-1515116590'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:40.459166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:40.478568 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cebd8eea-691d-47af-92e7-2817cecb0a8d req-4490a4d1-477e-4947-8340-f6eab2188741 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 210 time: 0.1352592 May 12 15:23:40.485447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:40.490449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Attempting to bind port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:23:40.490955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Attempting to bind port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:23:40.491455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Attempting to bind port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:23:40.531426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:23:40.532013 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Attempting to bind port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:23:40.539349 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Made reservation on behalf of 86574e26b5194d1f92a51749f063fa69 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:40.543476 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:40.573631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 23, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:23:40.574235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Checking segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:23:40.574799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Bound using segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:23:40.575397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Bound port: 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:23:40.575897 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:40.674328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Allocated IP 172.20.0.2 (d5df59b8-76b6-4317-a45d-19571e77f5cb/85a3b2e6-e361-468d-829f-f002d3131adc/67345a4c-a941-4873-9405-aa12f9b0f3fc) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:23:40.703373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65aa737d-c069-45c9-b468-06be3201d59f req-7e70baf2-718c-475c-a83f-ad042c5f1ca6 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 210 time: 0.0736077 May 12 15:23:40.719817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e4fd659-36f4-46c0-9ad5-4ff024a8b94e req-1a7c3c1c-bdb9-48be-a2fc-70da34a0251d tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:40.727199 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e4fd659-36f4-46c0-9ad5-4ff024a8b94e req-1a7c3c1c-bdb9-48be-a2fc-70da34a0251d tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.4724154 May 12 15:23:40.829440 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e4fd659-36f4-46c0-9ad5-4ff024a8b94e req-95944204-d21e-43ce-bf13-fe00cae892df tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1013005 May 12 15:23:40.837896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:40.842869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Usage tracker for resource:port and tenant:e5f221bbde0b4f28b287cbb78999d605 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:40.846427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:40.852704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:40.874642 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Made reservation on behalf of e5f221bbde0b4f28b287cbb78999d605 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:40.879027 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:40.965297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] device_id is not set on port 72803d30-cee5-43a3-bdf8-5e7cef7b7e4a yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:23:41.051949 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:41.059738 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:41.075177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Transition to ACTIVE for port object 67345a4c-a941-4873-9405-aa12f9b0f3fc will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:41.109208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Transition to ACTIVE for port object 67345a4c-a941-4873-9405-aa12f9b0f3fc will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:41.114237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2cb1843-bbc0-4462-8b63-e9c7a19a213e req-d8855215-2f05-473d-b7fd-bd5a24291467 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:41.117534 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:41.121578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e2cb1843-bbc0-4462-8b63-e9c7a19a213e req-d8855215-2f05-473d-b7fd-bd5a24291467 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2290130 May 12 15:23:41.143403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Transition to ACTIVE for port object bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:41.150877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] For port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:23:41.171956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] For port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:23:41.179040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Allocated IP 172.20.0.12 (b50584ea-1073-48d4-a2bc-43b11374a495/92a8d5fe-fb2b-414d-9ae2-15fb02337cd9/a306c21a-a934-4a55-8955-3ede562c61c1) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:23:41.182421 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:41.206032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Network d5df59b8-76b6-4317-a45d-19571e77f5cb is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:23:41.210181 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:41.244179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:23:41.258245 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e2cb1843-bbc0-4462-8b63-e9c7a19a213e req-dbb7b8cd-ec52-4791-8e69-f5ce1227b6c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1357083 May 12 15:23:41.271142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Allocated IP 172.20.0.8 (d5df59b8-76b6-4317-a45d-19571e77f5cb/85a3b2e6-e361-468d-829f-f002d3131adc/72803d30-cee5-43a3-bdf8-5e7cef7b7e4a) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:23:41.292424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Pushing event updated for resources: {'Port': ['ID=67345a4c-a941-4873-9405-aa12f9b0f3fc,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:41.477795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:41.477795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:41.477795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:41.477795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:41.479191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:41.479191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:41.479191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:41.479191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:41.480263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:41.480263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:41.480263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:41.480263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:41.488686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Attempting to bind port 67345a4c-a941-4873-9405-aa12f9b0f3fc on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:23:41.488686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Attempting to bind port 67345a4c-a941-4873-9405-aa12f9b0f3fc by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '08bb1710-24c4-4cf5-ba55-66d36930efa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': 'd5df59b8-76b6-4317-a45d-19571e77f5cb'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:23:41.488686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Attempting to bind port 67345a4c-a941-4873-9405-aa12f9b0f3fc on network d5df59b8-76b6-4317-a45d-19571e77f5cb {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:23:41.507013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 23, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:23:41.507013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Checking segment: {'id': '08bb1710-24c4-4cf5-ba55-66d36930efa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': 'd5df59b8-76b6-4317-a45d-19571e77f5cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:23:41.507013 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:41.507013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Bound using segment: {'id': '08bb1710-24c4-4cf5-ba55-66d36930efa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': 'd5df59b8-76b6-4317-a45d-19571e77f5cb'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:23:41.507013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Bound port: 67345a4c-a941-4873-9405-aa12f9b0f3fc, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '08bb1710-24c4-4cf5-ba55-66d36930efa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': 'd5df59b8-76b6-4317-a45d-19571e77f5cb'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:23:41.507013 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:41.514029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:41.514029 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:41.514029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] 10.222.0.76 "PUT /v2.0/ports/5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d HTTP/1.1" status: 200 len: 1091 time: 3.6059499 May 12 15:23:41.514029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '19d9f265-5c0e-4464-8b8a-97af703db06f', 'tag': '5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:41.552610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34db94cc-fec0-4791-96a1-9b73a3f79e88 service neutron] Pushing event updated for resources: {'Port': ['ID=5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:41.569573 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:41.597722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['7e0c7266-ad09-4620-bfdc-81de7da01d15'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:41.741116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Network de9b95bc-97c4-4188-a1d0-c125f35032b0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:23:41.771797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:41.821752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:23:41.855615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2d4785a-1abc-4aba-ba31-21ee3804b8b6 req-7f96d4d3-81b6-4652-9210-47da100288b9 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:41.877248 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:23:41.881905 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2d4785a-1abc-4aba-ba31-21ee3804b8b6 req-7f96d4d3-81b6-4652-9210-47da100288b9 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 943 time: 0.6065040 May 12 15:23:41.888792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] For port 67345a4c-a941-4873-9405-aa12f9b0f3fc, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:23:41.896636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] For port 67345a4c-a941-4873-9405-aa12f9b0f3fc, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=67345a4c-a941-4873-9405-aa12f9b0f3fc,segment=NetworkSegment(08bb1710-24c4-4cf5-ba55-66d36930efa1),segment_id=08bb1710-24c4-4cf5-ba55-66d36930efa1)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:23:41.907933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event updated for resources: {'Port': ['ID=bdd6d277-b9d3-4e93-bfc7-66dd6ac96203,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:41.918726 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:41.987554 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:42.001710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:42.002628 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:42.059955 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2d4785a-1abc-4aba-ba31-21ee3804b8b6 req-c2ed013d-d259-4875-b460-bdc52f5d8a1b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1853967 May 12 15:23:42.136049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:42.148932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8668a08-1b97-495c-b587-12742505b6d3 req-8fa91585-045a-418c-aa77-043c5c91219d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:42.157978 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8668a08-1b97-495c-b587-12742505b6d3 req-8fa91585-045a-418c-aa77-043c5c91219d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/networks?id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61 HTTP/1.1" status: 200 len: 813 time: 0.7316108 May 12 15:23:42.194371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8668a08-1b97-495c-b587-12742505b6d3 req-1bb4e842-9ba1-4eb2-ae88-f49a4a177fb2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/quotas/4e5a10df576841e2a4752a9d47fb790a HTTP/1.1" status: 200 len: 375 time: 0.0349455 May 12 15:23:42.213964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-b877cdd5-1036-40c9-a034-dedf367ffadf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:42.215875 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-b877cdd5-1036-40c9-a034-dedf367ffadf service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 1094 time: 0.6066797 May 12 15:23:42.236221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d8b99f4-95d2-4732-87a8-c44a0b8cd905 None None] Pushing event updated for resources: {'Port': ['ID=67345a4c-a941-4873-9405-aa12f9b0f3fc,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:42.318986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-499ef95f-3a9b-4e80-b3c7-fcad3e460255 None None] Provisioning for port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:42.319363 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-0a70156b-418e-4382-93c8-76ecb5aad3ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.4770432 May 12 15:23:42.321689 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-22a364c1-af77-4f58-b69c-6e730fbaf206 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d HTTP/1.1" status: 200 len: 217 time: 0.0944624 May 12 15:23:42.323430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:42.326962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-499ef95f-3a9b-4e80-b3c7-fcad3e460255 None None] Provisioning complete for port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:42.327775 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-499ef95f-3a9b-4e80-b3c7-fcad3e460255 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:42.413906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Transition to ACTIVE for port object 72803d30-cee5-43a3-bdf8-5e7cef7b7e4a will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:42.445801 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-499ef95f-3a9b-4e80-b3c7-fcad3e460255 None None] Port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:42.481884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-d2fe6fd9-51d9-4f96-bc10-8f142c7fd2ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:42.483745 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-d2fe6fd9-51d9-4f96-bc10-8f142c7fd2ca service neutron] 10.222.0.76 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.1522291 May 12 15:23:42.493474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3665052f-787a-44a4-bee0-3335df3f44a6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:42.497729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Request body: {'port': {'device_id': '4719dce9-d654-490a-915f-8e3c7942fc48', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:42.573841 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:42.612342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Network b50584ea-1073-48d4-a2bc-43b11374a495 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:23:42.627256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:42.639527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:23:42.672989 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-06bdfbbf-1126-464f-b227-6a6ac2e204b2 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1180544 May 12 15:23:42.679203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e0a977-be1d-4928-b318-b3c62e08f918 req-0255971c-6dbf-4156-87fb-c704a00647c0 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:42.680839 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10e0a977-be1d-4928-b318-b3c62e08f918 req-0255971c-6dbf-4156-87fb-c704a00647c0 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 931 time: 0.2803645 May 12 15:23:42.688133 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5840d7f-4ffd-478f-8236-34efb6054900 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:42.715910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8668a08-1b97-495c-b587-12742505b6d3 req-e9469b09-c1b9-4ea8-a196-df171a2749aa tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4e5a10df576841e2a4752a9d47fb790a&fields=id HTTP/1.1" status: 200 len: 255 time: 0.5202568 May 12 15:23:42.725429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'Port': ['ID=a306c21a-a934-4a55-8955-3ede562c61c1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:42.755881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Network d5df59b8-76b6-4317-a45d-19571e77f5cb is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:23:42.763483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:42.768190 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:23:42.826113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Pushing event updated for resources: {'Port': ['ID=72803d30-cee5-43a3-bdf8-5e7cef7b7e4a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:42.870342 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bd501e04-aa8a-4cca-a507-a30ebb7436ed'] response: {'name': 'network-changed', 'server_uuid': '19d9f265-5c0e-4464-8b8a-97af703db06f', 'tag': '5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d', 'status': 'completed', 'code': 200} May 12 15:23:42.871088 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:42.885796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:42.889198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:42.889650 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:42.894008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:42.894363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:42.894711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:42.895047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:42.895395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:42.895710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:42.897611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:42.898771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:42.899110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:23:42.924332 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:42.935213 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10e0a977-be1d-4928-b318-b3c62e08f918 req-e73186eb-bcbf-4a13-9ec7-5641314453e2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2185223 May 12 15:23:42.972357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:42.973069 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:43.059030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-410c4710-db4b-47ac-b056-a8f8ab9b41fe req-68dffffc-aeb7-49aa-8ae8-edd0653e693f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:43.060492 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-410c4710-db4b-47ac-b056-a8f8ab9b41fe req-68dffffc-aeb7-49aa-8ae8-edd0653e693f service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 1096 time: 0.4778242 May 12 15:23:43.094970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 67345a4c-a941-4873-9405-aa12f9b0f3fc up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:23:43.108209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:43.108924 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:43.136889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4d0cbcbc-df61-43f2-a067-8d36a67e8c9f tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 935 time: 2.7098589 May 12 15:23:43.148192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37696) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:43.190699 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-83e49750-c6fc-400c-8f6d-afad94ddd014 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.4479029 May 12 15:23:43.216833 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 67345a4c-a941-4873-9405-aa12f9b0f3fc completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:43.247308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Request body: {'port': {'network_id': 'd5df59b8-76b6-4317-a45d-19571e77f5cb', 'name': 'tempest-ExtraDHCPOptionsTestJSON-556737636', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:43.247881 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.api.validators [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] bootfile-name is not in valid_values {{(pid=88152) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} May 12 15:23:43.248746 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.api.validators [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] tftp-server is not in valid_values {{(pid=88152) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} May 12 15:23:43.249096 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.api.validators [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] server-ip-address is not in valid_values {{(pid=88152) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} May 12 15:23:43.249306 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-bcdbba66-75e5-48ac-99b2-7d6f32d218c1 service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5594153 May 12 15:23:43.258587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Request body: {'port': {'device_id': 'caefe380-1876-4938-83a7-078804c994b7', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:43.425468 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-410c4710-db4b-47ac-b056-a8f8ab9b41fe req-49e0f500-bf18-4301-b6c3-455f72e439a9 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3532195 May 12 15:23:43.492078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61a7cf79-36d4-4240-ac1c-974e28f73aea req-1ce6efb4-2a3e-48e3-8dfb-898beb5e3ce2 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:43.497640 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61a7cf79-36d4-4240-ac1c-974e28f73aea req-1ce6efb4-2a3e-48e3-8dfb-898beb5e3ce2 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 932 time: 0.4889388 May 12 15:23:43.503207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:43.503543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23904acf-9e37-40e7-a3e5-f823089ef460 None None] Network d5df59b8-76b6-4317-a45d-19571e77f5cb requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:23:43.512318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Usage tracker for resource:port and tenant:e5f221bbde0b4f28b287cbb78999d605 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:43.528161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:43.538047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:43.574111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:43.583017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f30ad7ba-61c6-41b5-976e-fad98bcd83ca req-cde09319-8916-43b4-b38e-708e4748b982 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:43.584636 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f30ad7ba-61c6-41b5-976e-fad98bcd83ca req-cde09319-8916-43b4-b38e-708e4748b982 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.4389560 May 12 15:23:43.589314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Made reservation on behalf of e5f221bbde0b4f28b287cbb78999d605 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:43.593734 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:43.622290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-61a7cf79-36d4-4240-ac1c-974e28f73aea req-e28da945-90c5-4100-babf-d5349a1e6565 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Synchronizing usage tracker for tenant:86574e26b5194d1f92a51749f063fa69 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:43.659708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] device_id is not set on port 010164cb-f89c-4222-bceb-71a6b01d8a48 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:23:43.690814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0ec929a6-419c-4f9a-9357-ac5317d09430 None None] Provisioning for port 67345a4c-a941-4873-9405-aa12f9b0f3fc completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:43.694533 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ad01fea4-9e6a-44d8-86f6-584d09338dc8 req-81aa4107-9d23-4eb7-8847-19f2a33a27f4 service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2729640 May 12 15:23:43.697608 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0ec929a6-419c-4f9a-9357-ac5317d09430 None None] Provisioning complete for port 67345a4c-a941-4873-9405-aa12f9b0f3fc triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:43.697979 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0ec929a6-419c-4f9a-9357-ac5317d09430 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:43.711469 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f30ad7ba-61c6-41b5-976e-fad98bcd83ca req-b1a320f0-80a2-4943-b4ba-535d69152ccd tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1083524 May 12 15:23:43.719982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-61a7cf79-36d4-4240-ac1c-974e28f73aea req-e28da945-90c5-4100-babf-d5349a1e6565 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Unset dirty status for tenant:86574e26b5194d1f92a51749f063fa69 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:43.734887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61a7cf79-36d4-4240-ac1c-974e28f73aea req-e28da945-90c5-4100-babf-d5349a1e6565 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2285872 May 12 15:23:43.900340 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0ec929a6-419c-4f9a-9357-ac5317d09430 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:43.934866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:23:43.956122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0ec929a6-419c-4f9a-9357-ac5317d09430 None None] For port 67345a4c-a941-4873-9405-aa12f9b0f3fc, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=67345a4c-a941-4873-9405-aa12f9b0f3fc,segment=NetworkSegment(08bb1710-24c4-4cf5-ba55-66d36930efa1),segment_id=08bb1710-24c4-4cf5-ba55-66d36930efa1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:43.962122 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:43.963017 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0ec929a6-419c-4f9a-9357-ac5317d09430 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:44.038946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Allocated IP 172.20.0.7 (d5df59b8-76b6-4317-a45d-19571e77f5cb/85a3b2e6-e361-468d-829f-f002d3131adc/010164cb-f89c-4222-bceb-71a6b01d8a48) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:23:44.048082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5546a836-786c-47fe-899b-c96a744377fa req-e8e99b7c-25e5-4428-907a-a7e8513e9b07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:44.050025 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5546a836-786c-47fe-899b-c96a744377fa req-e8e99b7c-25e5-4428-907a-a7e8513e9b07 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 1094 time: 0.2311010 May 12 15:23:44.053250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Transition to ACTIVE for port object bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:44.064408 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ec929a6-419c-4f9a-9357-ac5317d09430 None None] Pushing event updated for resources: {'Port': ['ID=67345a4c-a941-4873-9405-aa12f9b0f3fc,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:44.108214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85e28490-fb5a-4e78-bb8b-248ce50fc7ef req-f21f96da-69e0-4293-ab3a-f7b752c3b87e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:44.110152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85e28490-fb5a-4e78-bb8b-248ce50fc7ef req-f21f96da-69e0-4293-ab3a-f7b752c3b87e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 943 time: 0.2304730 May 12 15:23:44.120988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1037cb41-3ec6-4b64-b271-392dffea5858 req-15d2ea1b-ccc3-4658-9a73-61092b1c3b08 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:44.122758 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1037cb41-3ec6-4b64-b271-392dffea5858 req-15d2ea1b-ccc3-4658-9a73-61092b1c3b08 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2110069 May 12 15:23:44.223214 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1037cb41-3ec6-4b64-b271-392dffea5858 req-40da4bd9-6d05-4d70-a71e-e1a7e9430756 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0880442 May 12 15:23:44.237025 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:44.312682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8813f2ea-9e97-47ee-a458-d9f7931d4d17 None None] Provisioning for port 72803d30-cee5-43a3-bdf8-5e7cef7b7e4a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:44.320794 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8813f2ea-9e97-47ee-a458-d9f7931d4d17 None None] Provisioning complete for port 72803d30-cee5-43a3-bdf8-5e7cef7b7e4a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:44.321737 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8813f2ea-9e97-47ee-a458-d9f7931d4d17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:44.342515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85e28490-fb5a-4e78-bb8b-248ce50fc7ef req-cabc3360-94a8-4a1a-a42a-3094cc6f6c25 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2179694 May 12 15:23:44.555830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8813f2ea-9e97-47ee-a458-d9f7931d4d17 None None] Port 72803d30-cee5-43a3-bdf8-5e7cef7b7e4a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:44.569655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8813f2ea-9e97-47ee-a458-d9f7931d4d17 None None] Provisioning complete for port 67345a4c-a941-4873-9405-aa12f9b0f3fc triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:44.570435 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8813f2ea-9e97-47ee-a458-d9f7931d4d17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:44.731577 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:44.754821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Transition to ACTIVE for port object 010164cb-f89c-4222-bceb-71a6b01d8a48 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:44.797165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Pushing event updated for resources: {'Port': ['ID=bdd6d277-b9d3-4e93-bfc7-66dd6ac96203,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:44.821588 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] It took 0.24 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:23:44.836992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:23:44.850963 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:44.876320 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-303c9bf7-73fd-47f0-820c-b2b70ccdb99b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:44.886656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5546a836-786c-47fe-899b-c96a744377fa req-9775e5c0-ecab-4edb-85a4-1b06b1dca3ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:44.888225 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5546a836-786c-47fe-899b-c96a744377fa req-9775e5c0-ecab-4edb-85a4-1b06b1dca3ac service neutron] 10.222.0.76 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 913 time: 0.8296096 May 12 15:23:44.954059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e091460f-6ca5-4efc-b83e-c46d8cf11f0d req-88acc2b9-7ad7-433d-97ec-45729ffee8bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:44.955626 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e091460f-6ca5-4efc-b83e-c46d8cf11f0d req-88acc2b9-7ad7-433d-97ec-45729ffee8bf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 943 time: 0.3031538 May 12 15:23:44.965071 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Network d5df59b8-76b6-4317-a45d-19571e77f5cb is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:23:44.984418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:23:44.987163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:23:45.005689 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5546a836-786c-47fe-899b-c96a744377fa req-b9920db6-b2ef-44be-b309-af7a65d3b091 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d HTTP/1.1" status: 200 len: 217 time: 0.1014521 May 12 15:23:45.015568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a306c21a-a934-4a55-8955-3ede562c61c1 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:23:45.026139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Attempting to bind port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:23:45.027078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Attempting to bind port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:23:45.027078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Attempting to bind port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:23:45.034002 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:45.040468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:45.043510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Pushing event updated for resources: {'Port': ['ID=010164cb-f89c-4222-bceb-71a6b01d8a48,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:45.067824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfab1168-2b16-4ab3-9104-86962d77d71a req-1f176903-97b1-45f1-93f3-42fb81d26d01 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:45.069325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cfab1168-2b16-4ab3-9104-86962d77d71a req-1f176903-97b1-45f1-93f3-42fb81d26d01 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.5189898 May 12 15:23:45.075951 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'port_id': '5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d', 'mac_address': 'fa:16:3e:ba:b6:21', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 573, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0ff5192a-946b-4444-900a-788b8ddc74b6', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:23:45.093238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:23:45.093585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Attempting to bind port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:23:45.113368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 67345a4c-a941-4873-9405-aa12f9b0f3fc up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:23:45.119207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Transition to ACTIVE for port object a306c21a-a934-4a55-8955-3ede562c61c1 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:23:45.124294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 23, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:23:45.124816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Checking segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:23:45.125217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Bound using segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:23:45.125672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Bound port: bdd6d277-b9d3-4e93-bfc7-66dd6ac96203, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:23:45.127134 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:45.135413 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e091460f-6ca5-4efc-b83e-c46d8cf11f0d req-b116fe1a-ae88-42fa-872a-19459662a7e5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1671398 May 12 15:23:45.146725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:45.147112 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:45.164054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-282859e3-0a76-4c4a-80e7-4853ab55abe9 None None] Provisioning complete for port 72803d30-cee5-43a3-bdf8-5e7cef7b7e4a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:45.164558 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-282859e3-0a76-4c4a-80e7-4853ab55abe9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:45.189659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:45.249210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cfab1168-2b16-4ab3-9104-86962d77d71a req-627e3156-ed33-4963-877c-a42099fde784 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1639655 May 12 15:23:45.277836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1e3e8d78-d5b3-437a-b9e9-ab93ab27da0c tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1151 time: 2.1178968 May 12 15:23:45.278966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37716) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:45.334684 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:45.352925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5546a836-786c-47fe-899b-c96a744377fa req-6fddeb8c-e6f0-42fd-b6c2-88a984b470f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:45.357325 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-282859e3-0a76-4c4a-80e7-4853ab55abe9 None None] Port 72803d30-cee5-43a3-bdf8-5e7cef7b7e4a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:45.362516 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5546a836-786c-47fe-899b-c96a744377fa req-6fddeb8c-e6f0-42fd-b6c2-88a984b470f0 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.3394816 May 12 15:23:45.386627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:23:45.418000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:45.421774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 67345a4c-a941-4873-9405-aa12f9b0f3fc triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:45.422375 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:45.457838 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:45.507394 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5546a836-786c-47fe-899b-c96a744377fa req-3a63fad6-2118-4250-a33d-a43a89802b1a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1149731 May 12 15:23:45.601376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f2110de5-7c92-408f-a558-5a96b91a30a2 None None] Provisioning for port 010164cb-f89c-4222-bceb-71a6b01d8a48 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:45.608688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] For port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:23:45.611250 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:45.611510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Pushing event updated for resources: {'Port': ['ID=a306c21a-a934-4a55-8955-3ede562c61c1,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:45.624497 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f2110de5-7c92-408f-a558-5a96b91a30a2 None None] Provisioning complete for port 010164cb-f89c-4222-bceb-71a6b01d8a48 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:45.625161 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f2110de5-7c92-408f-a558-5a96b91a30a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:45.662669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] For port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bdd6d277-b9d3-4e93-bfc7-66dd6ac96203,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:23:45.689996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d44ffa91-5d4b-4705-89ca-3b6f6586cda0 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:45.695880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d44ffa91-5d4b-4705-89ca-3b6f6586cda0 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:45.699346 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:45.703064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d44ffa91-5d4b-4705-89ca-3b6f6586cda0 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:45.704039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d44ffa91-5d4b-4705-89ca-3b6f6586cda0 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Synchronizing usage tracker for tenant:e5f221bbde0b4f28b287cbb78999d605 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:45.717443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:45.718757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b81d423-bc7f-4c9e-9acd-b099872a4040 req-18e33dcc-7608-40cf-aff0-e978096825c6 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:45.720309 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b81d423-bc7f-4c9e-9acd-b099872a4040 req-18e33dcc-7608-40cf-aff0-e978096825c6 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.2233233 May 12 15:23:45.739279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89de3013-a348-487b-87fe-8bf2234fc622 req-cf7beb2d-72fa-45b2-9d3c-3de1417b939c tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:45.751088 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89de3013-a348-487b-87fe-8bf2234fc622 req-cf7beb2d-72fa-45b2-9d3c-3de1417b939c tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 944 time: 0.2561920 May 12 15:23:45.810633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:45.812337 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:45.814017 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] 10.222.0.84 "PUT /v2.0/ports/bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 HTTP/1.1" status: 200 len: 1091 time: 3.4448214 May 12 15:23:45.814641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4719dce9-d654-490a-915f-8e3c7942fc48', 'tag': 'bdd6d277-b9d3-4e93-bfc7-66dd6ac96203'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:45.829561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f2110de5-7c92-408f-a558-5a96b91a30a2 None None] Port 010164cb-f89c-4222-bceb-71a6b01d8a48 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:45.867861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Attempting to bind port a306c21a-a934-4a55-8955-3ede562c61c1 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:23:45.868471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Attempting to bind port a306c21a-a934-4a55-8955-3ede562c61c1 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '2b9a3118-674a-42bd-be1d-3a0efcec85f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'b50584ea-1073-48d4-a2bc-43b11374a495'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:23:45.868983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Attempting to bind port a306c21a-a934-4a55-8955-3ede562c61c1 on network b50584ea-1073-48d4-a2bc-43b11374a495 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:23:45.873041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d3a151-c7a2-4559-a3bc-38f87931f081 service neutron] Pushing event updated for resources: {'Port': ['ID=bdd6d277-b9d3-4e93-bfc7-66dd6ac96203,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:45.879270 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5546a836-786c-47fe-899b-c96a744377fa req-383a8f42-1931-4f57-9f59-67824311c99b service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3570364 May 12 15:23:45.902357 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b81d423-bc7f-4c9e-9acd-b099872a4040 req-62ff83a5-47f5-49c3-91e3-0a9563634b77 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1282747 May 12 15:23:45.905876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d44ffa91-5d4b-4705-89ca-3b6f6586cda0 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Unset dirty status for tenant:e5f221bbde0b4f28b287cbb78999d605 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:45.907394 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d44ffa91-5d4b-4705-89ca-3b6f6586cda0 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2617 time: 0.6264608 May 12 15:23:45.916282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37732) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:45.938636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Port a306c21a-a934-4a55-8955-3ede562c61c1 on network b50584ea-1073-48d4-a2bc-43b11374a495 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:23:45.939364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Attempting to bind port a306c21a-a934-4a55-8955-3ede562c61c1 on network b50584ea-1073-48d4-a2bc-43b11374a495 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:23:45.989819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 23, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:23:45.990991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Checking segment: {'id': '2b9a3118-674a-42bd-be1d-3a0efcec85f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'b50584ea-1073-48d4-a2bc-43b11374a495'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:23:45.991732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Bound using segment: {'id': '2b9a3118-674a-42bd-be1d-3a0efcec85f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'b50584ea-1073-48d4-a2bc-43b11374a495'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:23:45.992124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Bound port: a306c21a-a934-4a55-8955-3ede562c61c1, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2b9a3118-674a-42bd-be1d-3a0efcec85f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'b50584ea-1073-48d4-a2bc-43b11374a495'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:23:45.992766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:46.039744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89de3013-a348-487b-87fe-8bf2234fc622 req-440ab6d2-aa7a-4a8b-b8ca-c43a7d81f745 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2873709 May 12 15:23:46.080669 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:46.126163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-7fdedbd8-abed-4918-a06b-61813ecb33c4 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Deleting port 010164cb-f89c-4222-bceb-71a6b01d8a48 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:46.126889 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7fdedbd8-abed-4918-a06b-61813ecb33c4 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:46.140948 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:46.236098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-35732348-6d97-4e37-8d9b-39e9d8e1fa29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:46.237903 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-35732348-6d97-4e37-8d9b-39e9d8e1fa29 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 1094 time: 0.3494251 May 12 15:23:46.390687 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5332911-37a8-4d84-892f-dcb098107d30 req-aa95117c-4a6e-42ff-bb80-97b55efd369d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?name=does_not_exist&fields=id&tenant_id=4e5a10df576841e2a4752a9d47fb790a HTTP/1.1" status: 200 len: 221 time: 0.1223335 May 12 15:23:46.453603 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4372a682-dfef-4ade-82c4-b84f1f5efeb3'] response: {'name': 'network-changed', 'server_uuid': '4719dce9-d654-490a-915f-8e3c7942fc48', 'tag': 'bdd6d277-b9d3-4e93-bfc7-66dd6ac96203', 'status': 'completed', 'code': 200} May 12 15:23:46.460075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe98835a-0824-4d5b-9221-43c784739c04 req-c1db65a3-963a-4e67-ac05-9a7fb9b51a52 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:46.463860 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5546a836-786c-47fe-899b-c96a744377fa req-109fa67e-3088-4a78-9c6b-f292d11e0b13 service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5733759 May 12 15:23:46.466637 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-4125102b-b396-4dfe-b3b6-5ddd88d5e0be service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 HTTP/1.1" status: 200 len: 217 time: 0.2097018 May 12 15:23:46.466917 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fe98835a-0824-4d5b-9221-43c784739c04 req-c1db65a3-963a-4e67-ac05-9a7fb9b51a52 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 944 time: 0.3052583 May 12 15:23:46.468032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] For port a306c21a-a934-4a55-8955-3ede562c61c1, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:23:46.487636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] For port a306c21a-a934-4a55-8955-3ede562c61c1, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a306c21a-a934-4a55-8955-3ede562c61c1,segment=NetworkSegment(2b9a3118-674a-42bd-be1d-3a0efcec85f0),segment_id=2b9a3118-674a-42bd-be1d-3a0efcec85f0)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:23:46.530184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:46.558380 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fe98835a-0824-4d5b-9221-43c784739c04 req-2ba1347f-31fb-4649-abf3-520af8e58c3f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0857325 May 12 15:23:46.584845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7fdedbd8-abed-4918-a06b-61813ecb33c4 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:46.613232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:46.613932 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:46.615343 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] 10.222.0.84 "PUT /v2.0/ports/a306c21a-a934-4a55-8955-3ede562c61c1 HTTP/1.1" status: 200 len: 1092 time: 3.3614547 May 12 15:23:46.634302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-7a913c95-2dba-41b5-9af6-0a1df496c2a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:46.635971 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-7a913c95-2dba-41b5-9af6-0a1df496c2a1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.1503892 May 12 15:23:46.642155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6712e8f2-4da6-4578-8b24-fc605ea18968 service neutron] Pushing event updated for resources: {'Port': ['ID=a306c21a-a934-4a55-8955-3ede562c61c1,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:46.725852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-7fdedbd8-abed-4918-a06b-61813ecb33c4 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Calling delete_port for 010164cb-f89c-4222-bceb-71a6b01d8a48 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:46.830041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:23:46.855705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-161e088e-af77-4f50-af20-c71218b9ed99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:46.856759 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-161e088e-af77-4f50-af20-c71218b9ed99 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=86574e26b5194d1f92a51749f063fa69&device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 1095 time: 0.1481173 May 12 15:23:46.869443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-d1d3b187-2b3f-4440-89e6-54ba855ae9f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:46.871018 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-d1d3b187-2b3f-4440-89e6-54ba855ae9f2 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2258012 May 12 15:23:46.905236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:46.911017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:46.911511 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:46.972233 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-10c89f86-bcf7-45b9-a660-5d8aa347f98a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a306c21a-a934-4a55-8955-3ede562c61c1 HTTP/1.1" status: 200 len: 217 time: 0.1001008 May 12 15:23:46.991077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a4e8e6-45a0-40b2-a6fa-5cc83e779e83 req-0e620806-24ea-4917-9530-250270751b69 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:46.992526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85a4e8e6-45a0-40b2-a6fa-5cc83e779e83 req-0e620806-24ea-4917-9530-250270751b69 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 943 time: 0.2742898 May 12 15:23:47.002850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb91299-915d-4a66-a7fa-d873c42cd7f3 req-a5a68587-58a4-4049-bc02-326253002e99 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:47.004277 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9eb91299-915d-4a66-a7fa-d873c42cd7f3 req-a5a68587-58a4-4049-bc02-326253002e99 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2115376 May 12 15:23:47.039957 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:47.057360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d75c723-37ec-4e5a-aa43-da30e1d43da4 req-8ef7f0a4-ac42-447c-ab54-a7758a0f77d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:47.058838 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d75c723-37ec-4e5a-aa43-da30e1d43da4 req-8ef7f0a4-ac42-447c-ab54-a7758a0f77d1 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9e2382be0c6f4779ae64026a57628773&device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 1096 time: 0.3035069 May 12 15:23:47.074129 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:47.075087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '19d9f265-5c0e-4464-8b8a-97af703db06f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:47.081951 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:47.090598 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7fdedbd8-abed-4918-a06b-61813ecb33c4 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:47.133657 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85a4e8e6-45a0-40b2-a6fa-5cc83e779e83 req-6c65eff9-e04e-42f8-b620-871f262a6cfb tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1262531 May 12 15:23:47.152641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:47.161665 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9eb91299-915d-4a66-a7fa-d873c42cd7f3 req-47c73b79-b2d7-410f-88dc-67ed95b169fa tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1352518 May 12 15:23:47.180888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fdedbd8-abed-4918-a06b-61813ecb33c4 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Pushing event deleted for resources: {'Port': ['ID=010164cb-f89c-4222-bceb-71a6b01d8a48,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:47.233663 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-052d7ca8-1221-44cf-b57a-a5192539bf61'] response: {'server_uuid': '19d9f265-5c0e-4464-8b8a-97af703db06f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d', 'code': 200} May 12 15:23:47.272544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d75c723-37ec-4e5a-aa43-da30e1d43da4 req-8be8c08b-fc80-4df7-89cc-7f5aa405def8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:47.274070 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d75c723-37ec-4e5a-aa43-da30e1d43da4 req-8be8c08b-fc80-4df7-89cc-7f5aa405def8 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e7794860-7444-4123-96d5-ca3febf5e162 HTTP/1.1" status: 200 len: 911 time: 0.2048464 May 12 15:23:47.347863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-84c41206-88f7-471d-92c4-9cccde0f1c70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:47.349676 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-84c41206-88f7-471d-92c4-9cccde0f1c70 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=92a8d5fe-fb2b-414d-9ae2-15fb02337cd9 HTTP/1.1" status: 200 len: 853 time: 0.3281381 May 12 15:23:47.512393 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d75c723-37ec-4e5a-aa43-da30e1d43da4 req-1c1feb39-314d-4ec3-a9db-c0645e6addce service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=31c449ad-4a28-4740-9037-350aab14340e HTTP/1.1" status: 200 len: 217 time: 0.1615090 May 12 15:23:47.517192 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-7dafe1a8-f9d8-41c8-803f-08ad04ad59a4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b50584ea-1073-48d4-a2bc-43b11374a495&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1022422 May 12 15:23:47.521437 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-5955578d-7fce-4f61-b9b7-4597d0db9901 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5945411 May 12 15:23:47.606258 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:47.712464 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7fdedbd8-abed-4918-a06b-61813ecb33c4 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:47.746036 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7fdedbd8-abed-4918-a06b-61813ecb33c4 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] 10.222.0.82 "DELETE /v2.0/ports/010164cb-f89c-4222-bceb-71a6b01d8a48 HTTP/1.1" status: 204 len: 168 time: 1.8285072 May 12 15:23:47.752074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37772) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:47.762640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-2b956c5b-280f-4282-9ed1-7b820c558e47 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Request body: {'port': {'name': 'tempest-new-port-name-354950438', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:47.763025 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.api.validators [None req-2b956c5b-280f-4282-9ed1-7b820c558e47 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] bootfile-name is not in valid_values {{(pid=88152) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} May 12 15:23:47.764488 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.api.validators [None req-2b956c5b-280f-4282-9ed1-7b820c558e47 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] tftp-server is not in valid_values {{(pid=88152) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} May 12 15:23:47.764488 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.api.validators [None req-2b956c5b-280f-4282-9ed1-7b820c558e47 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] server-ip-address is not in valid_values {{(pid=88152) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} May 12 15:23:47.775738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d75c723-37ec-4e5a-aa43-da30e1d43da4 req-72d701fc-8f59-4fdc-a5ba-9942ef0f675e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:47.777170 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d75c723-37ec-4e5a-aa43-da30e1d43da4 req-72d701fc-8f59-4fdc-a5ba-9942ef0f675e service neutron] 10.222.0.76 "GET /v2.0/subnets?id=eae80ee9-f335-4892-af0b-41490fc3c6b5 HTTP/1.1" status: 200 len: 850 time: 0.2579830 May 12 15:23:47.831233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7755f79d-44ce-46b7-9060-1ef1d7775d36 req-4014d253-b05d-4998-9d0f-c78188d7cb8f tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:47.833129 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7755f79d-44ce-46b7-9060-1ef1d7775d36 req-4014d253-b05d-4998-9d0f-c78188d7cb8f tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 944 time: 0.4218664 May 12 15:23:47.847665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03c8a6fb-353f-47fb-96d1-493ca3f32eb5 req-091abeea-1450-4edb-804e-618c7bfbe8ec tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:47.849163 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03c8a6fb-353f-47fb-96d1-493ca3f32eb5 req-091abeea-1450-4edb-804e-618c7bfbe8ec tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.5435097 May 12 15:23:47.851254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc049485-0087-4ea1-8307-223c8ff71934 req-dcfc4dbd-5cc6-475a-a254-cd014845447a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:47.852912 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc049485-0087-4ea1-8307-223c8ff71934 req-dcfc4dbd-5cc6-475a-a254-cd014845447a service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 1096 time: 0.4459963 May 12 15:23:47.867421 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d75c723-37ec-4e5a-aa43-da30e1d43da4 req-ab84eb93-064e-4c54-9f8c-79415d1e209e service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e7794860-7444-4123-96d5-ca3febf5e162&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0797346 May 12 15:23:47.976607 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-5ee8eb92-680c-4e8c-88ef-ac7445b2036b service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4202030 May 12 15:23:47.990124 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-be804f0b-c0ac-43e6-a5fe-0ca292b7ace1 req-f1973ab0-aff6-4217-ab94-61a2ff6cad2a service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4326081 May 12 15:23:48.019852 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7755f79d-44ce-46b7-9060-1ef1d7775d36 req-512ad558-c05d-4db8-ad80-cfb94e0c0db4 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1655314 May 12 15:23:48.028157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc049485-0087-4ea1-8307-223c8ff71934 req-266fe81f-6b33-4b76-a317-acae0e43adc3 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1524737 May 12 15:23:48.037890 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03c8a6fb-353f-47fb-96d1-493ca3f32eb5 req-390a6f83-6ec6-4fc7-8c29-3078f0675805 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1803505 May 12 15:23:48.044835 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2b956c5b-280f-4282-9ed1-7b820c558e47 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:48.344322 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d75c723-37ec-4e5a-aa43-da30e1d43da4 req-bc44be50-e502-4756-8a84-c62d6a216e41 service neutron] 10.222.0.76 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4662249 May 12 15:23:48.443296 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f44a5d2-b11c-4fcc-b033-3ee5571778f4 req-0f0ee5cf-314a-4171-a21a-955f82e31f39 service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4503260 May 12 15:23:48.457049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'caefe380-1876-4938-83a7-078804c994b7', 'tag': 'a306c21a-a934-4a55-8955-3ede562c61c1'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:48.478681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94d6c5b-827c-443d-ade9-c5d6628f35d3 req-0dcf8fb8-fce1-4e4d-a9ce-8f4caf4a553e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:48.480090 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a94d6c5b-827c-443d-ade9-c5d6628f35d3 req-0dcf8fb8-fce1-4e4d-a9ce-8f4caf4a553e service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 1094 time: 0.3212693 May 12 15:23:48.506935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d99b1f9-4fd2-4467-b659-20e1bfae8a92 req-81f6f178-590e-477a-9c51-a79be01c0d72 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:48.508400 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d99b1f9-4fd2-4467-b659-20e1bfae8a92 req-81f6f178-590e-477a-9c51-a79be01c0d72 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 945 time: 0.1847749 May 12 15:23:48.523871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00434d67-af2c-4a8d-a450-403bfac7c611 req-dd528562-af3d-4478-b395-39aeb4b5515f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:48.525316 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00434d67-af2c-4a8d-a450-403bfac7c611 req-dd528562-af3d-4478-b395-39aeb4b5515f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2618093 May 12 15:23:48.588447 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2b956c5b-280f-4282-9ed1-7b820c558e47 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:48.599633 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d75c723-37ec-4e5a-aa43-da30e1d43da4 req-17a24122-bd2d-4536-90ff-8af962667c1c service neutron] 10.222.0.76 "GET /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2460766 May 12 15:23:48.602972 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2b956c5b-280f-4282-9ed1-7b820c558e47 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:48.649167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94d6c5b-827c-443d-ade9-c5d6628f35d3 req-fe9977d0-dd9b-41b6-8ae8-a869213d57ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:48.650557 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a94d6c5b-827c-443d-ade9-c5d6628f35d3 req-fe9977d0-dd9b-41b6-8ae8-a869213d57ac service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.1547716 May 12 15:23:48.661263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d99b1f9-4fd2-4467-b659-20e1bfae8a92 req-eef558b2-7c68-4744-b954-3af2867349cb tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1336851 May 12 15:23:48.687317 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00434d67-af2c-4a8d-a450-403bfac7c611 req-8d5e382a-dafe-4d4b-9e71-0743901f54ca tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1400530 May 12 15:23:48.762731 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a94d6c5b-827c-443d-ade9-c5d6628f35d3 req-b9469f32-75fc-4c76-a7e0-3f6cdd90e44a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 HTTP/1.1" status: 200 len: 217 time: 0.1035357 May 12 15:23:48.776495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b956c5b-280f-4282-9ed1-7b820c558e47 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Pushing event updated for resources: {'Port': ['ID=72803d30-cee5-43a3-bdf8-5e7cef7b7e4a,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:48.810160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2b956c5b-280f-4282-9ed1-7b820c558e47 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] In _notify_port_updated(), no bound segment for port 72803d30-cee5-43a3-bdf8-5e7cef7b7e4a on network d5df59b8-76b6-4317-a45d-19571e77f5cb {{(pid=88152) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:23:48.820419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b956c5b-280f-4282-9ed1-7b820c558e47 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:48.821122 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2b956c5b-280f-4282-9ed1-7b820c558e47 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:48.824999 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2b956c5b-280f-4282-9ed1-7b820c558e47 tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] 10.222.0.82 "PUT /v2.0/ports/72803d30-cee5-43a3-bdf8-5e7cef7b7e4a HTTP/1.1" status: 200 len: 1135 time: 1.0683706 May 12 15:23:48.825661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37786) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:48.870162 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-448a0d50-0805-4f1b-b512-04288d716e87'] response: {'name': 'network-changed', 'server_uuid': 'caefe380-1876-4938-83a7-078804c994b7', 'tag': 'a306c21a-a934-4a55-8955-3ede562c61c1', 'status': 'completed', 'code': 200} May 12 15:23:48.936679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17c71ccc-4076-4b8f-890e-3d5ec32f5a9a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:48.937376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-17c71ccc-4076-4b8f-890e-3d5ec32f5a9a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Synchronizing usage tracker for tenant:e5f221bbde0b4f28b287cbb78999d605 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:49.001589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94d6c5b-827c-443d-ade9-c5d6628f35d3 req-e0cdc93d-232e-45af-b3e1-7fec39ca3f16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:49.004486 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a94d6c5b-827c-443d-ade9-c5d6628f35d3 req-e0cdc93d-232e-45af-b3e1-7fec39ca3f16 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.2336550 May 12 15:23:49.160465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e4d6d7d-2f79-4068-ac0b-26a38d08d813 req-4b193bd4-a9c2-474e-b980-e52c860e42ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:49.160672 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e4d6d7d-2f79-4068-ac0b-26a38d08d813 req-4b193bd4-a9c2-474e-b980-e52c860e42ea service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=86574e26b5194d1f92a51749f063fa69&device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 1095 time: 0.2890990 May 12 15:23:49.178244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-17c71ccc-4076-4b8f-890e-3d5ec32f5a9a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Unset dirty status for tenant:e5f221bbde0b4f28b287cbb78999d605 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:49.179373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-17c71ccc-4076-4b8f-890e-3d5ec32f5a9a tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] 10.222.0.82 "GET /v2.0/ports/72803d30-cee5-43a3-bdf8-5e7cef7b7e4a HTTP/1.1" status: 200 len: 1135 time: 0.3520391 May 12 15:23:49.184705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37798) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:49.226871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-46e8beaf-61dc-49a8-904b-6e9c30650a08 None None] Provisioning complete for port 72803d30-cee5-43a3-bdf8-5e7cef7b7e4a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:49.227449 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-46e8beaf-61dc-49a8-904b-6e9c30650a08 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:49.345296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94d6c5b-827c-443d-ade9-c5d6628f35d3 req-61fa1ef0-f84e-4cc1-9c1d-374ce111497f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:49.347016 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a94d6c5b-827c-443d-ade9-c5d6628f35d3 req-61fa1ef0-f84e-4cc1-9c1d-374ce111497f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3316228 May 12 15:23:49.365062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-11c4ab96-f09d-42c0-a845-8020f789847b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Deleting port 72803d30-cee5-43a3-bdf8-5e7cef7b7e4a {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:49.365418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11c4ab96-f09d-42c0-a845-8020f789847b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:49.369945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-46e8beaf-61dc-49a8-904b-6e9c30650a08 None None] Port 72803d30-cee5-43a3-bdf8-5e7cef7b7e4a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:23:49.412619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6466c896-0733-49ba-a1d5-2f3fe3119fa5 req-24a9eb3a-fdf2-443e-9ca8-b50a28dab4f6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:49.414266 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6466c896-0733-49ba-a1d5-2f3fe3119fa5 req-24a9eb3a-fdf2-443e-9ca8-b50a28dab4f6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 943 time: 0.4705970 May 12 15:23:49.473862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9c031b7-ef36-4085-9f9a-9ce1022003bc req-dccbad4d-8a3e-49c5-9fec-189b1a568278 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:49.479086 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9c031b7-ef36-4085-9f9a-9ce1022003bc req-dccbad4d-8a3e-49c5-9fec-189b1a568278 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.4219813 May 12 15:23:49.495315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e4d6d7d-2f79-4068-ac0b-26a38d08d813 req-75237f8b-dbd3-4679-a45c-5a8b33091ee6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:49.497031 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e4d6d7d-2f79-4068-ac0b-26a38d08d813 req-75237f8b-dbd3-4679-a45c-5a8b33091ee6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=b50584ea-1073-48d4-a2bc-43b11374a495 HTTP/1.1" status: 200 len: 914 time: 0.3281095 May 12 15:23:49.563994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6466c896-0733-49ba-a1d5-2f3fe3119fa5 req-43590e70-2b42-4ef5-9c49-efbfa08b535e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1326408 May 12 15:23:49.597249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9c031b7-ef36-4085-9f9a-9ce1022003bc req-d5e4831e-033d-4abd-bdca-6e27394f4d9e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1098158 May 12 15:23:49.629900 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e4d6d7d-2f79-4068-ac0b-26a38d08d813 req-6392b7f7-d463-4544-8949-405a5c3b266e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a306c21a-a934-4a55-8955-3ede562c61c1 HTTP/1.1" status: 200 len: 217 time: 0.1252968 May 12 15:23:49.712033 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a94d6c5b-827c-443d-ade9-c5d6628f35d3 req-a7b2de3e-e24e-47fa-a0e4-e649bdc8fed7 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3449969 May 12 15:23:49.722300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e4d6d7d-2f79-4068-ac0b-26a38d08d813 req-8f3b663e-3adc-4cb0-a9a0-d21fded08f34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:49.725523 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e4d6d7d-2f79-4068-ac0b-26a38d08d813 req-8f3b663e-3adc-4cb0-a9a0-d21fded08f34 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=92a8d5fe-fb2b-414d-9ae2-15fb02337cd9 HTTP/1.1" status: 200 len: 853 time: 0.0821295 May 12 15:23:49.869915 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e4d6d7d-2f79-4068-ac0b-26a38d08d813 req-c9c059db-ce38-4361-964b-1a66cf953ab5 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b50584ea-1073-48d4-a2bc-43b11374a495&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1140449 May 12 15:23:49.964969 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11c4ab96-f09d-42c0-a845-8020f789847b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:50.027061 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a94d6c5b-827c-443d-ade9-c5d6628f35d3 req-393301cc-1f32-4051-86ce-148d44eda916 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3002498 May 12 15:23:50.087302 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e4d6d7d-2f79-4068-ac0b-26a38d08d813 req-107923dd-7425-4745-8f7b-9c3425e87b8d service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2081578 May 12 15:23:50.252297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-11c4ab96-f09d-42c0-a845-8020f789847b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Calling delete_port for 72803d30-cee5-43a3-bdf8-5e7cef7b7e4a owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:50.312046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eaa0424-20f4-44e8-af3c-a94613dac861 req-3d88f66c-ec7d-40e6-86a2-8da8fd89d456 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:50.313929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3eaa0424-20f4-44e8-af3c-a94613dac861 req-3d88f66c-ec7d-40e6-86a2-8da8fd89d456 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.5447333 May 12 15:23:50.332662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83dd945b-8a8c-4b97-90b3-d6639fed69dc req-66becb2e-8785-422b-a3b3-2880749e83a7 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:50.337088 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83dd945b-8a8c-4b97-90b3-d6639fed69dc req-66becb2e-8785-422b-a3b3-2880749e83a7 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 944 time: 0.6208653 May 12 15:23:50.400103 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e4d6d7d-2f79-4068-ac0b-26a38d08d813 req-f21f869f-a617-4a95-9b94-811a4d30b470 service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3057446 May 12 15:23:50.438284 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3eaa0424-20f4-44e8-af3c-a94613dac861 req-56e43095-793e-41a0-90bb-396751b8fb30 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1171048 May 12 15:23:50.443594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83dd945b-8a8c-4b97-90b3-d6639fed69dc req-d91cc55a-cd0d-470c-978a-e9ed0464f277 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0878894 May 12 15:23:50.610055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11c4ab96-f09d-42c0-a845-8020f789847b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:50.726708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11c4ab96-f09d-42c0-a845-8020f789847b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Pushing event deleted for resources: {'Port': ['ID=72803d30-cee5-43a3-bdf8-5e7cef7b7e4a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:50.927157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11c4ab96-f09d-42c0-a845-8020f789847b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:50.948787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49af0066-5880-4dd5-b524-c675e7037529 req-c3f0324f-34a7-46ec-bbab-b1995779cb46 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:50.950286 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49af0066-5880-4dd5-b524-c675e7037529 req-c3f0324f-34a7-46ec-bbab-b1995779cb46 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2771266 May 12 15:23:50.977462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-11c4ab96-f09d-42c0-a845-8020f789847b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] 10.222.0.82 "DELETE /v2.0/ports/72803d30-cee5-43a3-bdf8-5e7cef7b7e4a HTTP/1.1" status: 204 len: 168 time: 1.7909763 May 12 15:23:50.980180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37812) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:50.987856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8d6db22-9d64-4220-a39a-8a10f3703301 req-4e1d636b-8814-4589-84cf-ec2619f146c5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:50.989578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e8d6db22-9d64-4220-a39a-8a10f3703301 req-4e1d636b-8814-4589-84cf-ec2619f146c5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 945 time: 0.2752957 May 12 15:23:51.034421 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49af0066-5880-4dd5-b524-c675e7037529 req-306a4c8f-851e-4738-8e97-ad0de924498a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0754867 May 12 15:23:51.061175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-71000e89-ec7c-40a3-ad01-80d72be783ca tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Deleting subnet 85a3b2e6-e361-468d-829f-f002d3131adc {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:23:51.065952 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71000e89-ec7c-40a3-ad01-80d72be783ca tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:51.074130 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e8d6db22-9d64-4220-a39a-8a10f3703301 req-6ede3105-840b-4742-9fbb-9dde1e1bf76d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698357 May 12 15:23:51.146366 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71000e89-ec7c-40a3-ad01-80d72be783ca tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:51.244341 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71000e89-ec7c-40a3-ad01-80d72be783ca tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:51.246877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce3088a7-5724-4b86-9529-715e39f5b5db req-bf483766-7136-417a-931b-de427ea85d97 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:51.249289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce3088a7-5724-4b86-9529-715e39f5b5db req-bf483766-7136-417a-931b-de427ea85d97 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 943 time: 0.0975506 May 12 15:23:51.315792 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce3088a7-5724-4b86-9529-715e39f5b5db req-010be3c9-c573-4170-9f2a-98ed135eed3c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599854 May 12 15:23:51.449474 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71000e89-ec7c-40a3-ad01-80d72be783ca tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:51.496792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71000e89-ec7c-40a3-ad01-80d72be783ca tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Pushing event deleted for resources: {'Subnet': ['ID=85a3b2e6-e361-468d-829f-f002d3131adc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:51.501964 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71000e89-ec7c-40a3-ad01-80d72be783ca tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:51.508533 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae05c012-e21f-4368-8ea6-4ddbb385f217 None None] Network d5df59b8-76b6-4317-a45d-19571e77f5cb requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:23:51.520027 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-71000e89-ec7c-40a3-ad01-80d72be783ca tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] 10.222.0.82 "DELETE /v2.0/subnets/85a3b2e6-e361-468d-829f-f002d3131adc HTTP/1.1" status: 204 len: 168 time: 0.5362022 May 12 15:23:51.520602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37842) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:51.673812 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-446ef23e-37b4-4792-99ba-4c1c28495ca8 req-0c8e89b9-ad83-4ce8-9a53-f3d2b6eb356e service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.3011997 May 12 15:23:51.677085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5f6c342-1ad2-4d94-a0bb-6fc613e60ceb req-031ef590-ed68-47ed-b1e1-e62ae5c70046 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:51.678570 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:51.685898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5f6c342-1ad2-4d94-a0bb-6fc613e60ceb req-031ef590-ed68-47ed-b1e1-e62ae5c70046 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2073264 May 12 15:23:51.697581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Deleting port 67345a4c-a941-4873-9405-aa12f9b0f3fc {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:51.697924 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:51.742512 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a306c21a-a934-4a55-8955-3ede562c61c1 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:23:51.786370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5f6c342-1ad2-4d94-a0bb-6fc613e60ceb req-50500ea0-2dec-44cc-9a93-41a8755f9c30 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651383 May 12 15:23:51.832475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306584b5-ed2d-4f43-8913-73bfd0bd5e46 req-c2f31934-893d-4a56-8de3-260dcf3d0e63 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:51.834221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-306584b5-ed2d-4f43-8913-73bfd0bd5e46 req-c2f31934-893d-4a56-8de3-260dcf3d0e63 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 945 time: 0.1748362 May 12 15:23:51.891524 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-306584b5-ed2d-4f43-8913-73bfd0bd5e46 req-97c81026-1b5d-4dff-833e-3865ac33a88e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499203 May 12 15:23:51.978939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a306c21a-a934-4a55-8955-3ede562c61c1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a306c21a-a934-4a55-8955-3ede562c61c1,segment=NetworkSegment(2b9a3118-674a-42bd-be1d-3a0efcec85f0),segment_id=2b9a3118-674a-42bd-be1d-3a0efcec85f0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:52.001194 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'a306c21a-a934-4a55-8955-3ede562c61c1', 'network_id': 'b50584ea-1073-48d4-a2bc-43b11374a495', 'port_id': 'a306c21a-a934-4a55-8955-3ede562c61c1', 'mac_address': 'fa:16:3e:29:c5:ba', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 566, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '92a8d5fe-fb2b-414d-9ae2-15fb02337cd9', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:23:52.070839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] For port 67345a4c-a941-4873-9405-aa12f9b0f3fc, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=67345a4c-a941-4873-9405-aa12f9b0f3fc,segment=NetworkSegment(08bb1710-24c4-4cf5-ba55-66d36930efa1),segment_id=08bb1710-24c4-4cf5-ba55-66d36930efa1)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:52.071440 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:52.073782 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:52.096800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8073ba2-a1f5-43c6-8fee-0aec28f490fc req-41cdbfff-b0e8-4334-970f-9ace4d6e8457 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:52.098373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8073ba2-a1f5-43c6-8fee-0aec28f490fc req-41cdbfff-b0e8-4334-970f-9ace4d6e8457 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.1854184 May 12 15:23:52.099182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a306c21a-a934-4a55-8955-3ede562c61c1 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:23:52.116039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a306c21a-a934-4a55-8955-3ede562c61c1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a306c21a-a934-4a55-8955-3ede562c61c1,segment=NetworkSegment(2b9a3118-674a-42bd-be1d-3a0efcec85f0),segment_id=2b9a3118-674a-42bd-be1d-3a0efcec85f0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:52.126348 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:52.127544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:23:52.213493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59315ab1-e7b6-40ed-904c-5aac0bba63d7 req-486cc8e4-c3d5-46d3-a7e2-b577ebae7dc4 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:52.215073 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59315ab1-e7b6-40ed-904c-5aac0bba63d7 req-486cc8e4-c3d5-46d3-a7e2-b577ebae7dc4 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 944 time: 0.1707454 May 12 15:23:52.226113 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8073ba2-a1f5-43c6-8fee-0aec28f490fc req-d3524c7a-013d-446d-8cf5-cb3895c122da tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1198955 May 12 15:23:52.232343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-446ef23e-37b4-4792-99ba-4c1c28495ca8 req-17055df6-3ada-45cb-87fa-f162ce98afe8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:52.233852 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-446ef23e-37b4-4792-99ba-4c1c28495ca8 req-17055df6-3ada-45cb-87fa-f162ce98afe8 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=40852c97262142aeb6d62097955af83f&device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 1098 time: 0.5039723 May 12 15:23:52.241622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Calling delete_port for 67345a4c-a941-4873-9405-aa12f9b0f3fc owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:52.342551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59315ab1-e7b6-40ed-904c-5aac0bba63d7 req-4f82328f-98a6-4df6-bf8b-2d3d47a62430 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1044104 May 12 15:23:52.391418 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3df21fb0-0d9f-48b2-b050-c2531ccc252e None None] DHCP port deletion for d5df59b8-76b6-4317-a45d-19571e77f5cb request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:23:52.426763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bdd6d277-b9d3-4e93-bfc7-66dd6ac96203,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:52.446588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3df21fb0-0d9f-48b2-b050-c2531ccc252e None None] Deleting port 67345a4c-a941-4873-9405-aa12f9b0f3fc {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:52.446995 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3df21fb0-0d9f-48b2-b050-c2531ccc252e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:52.512738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'bdd6d277-b9d3-4e93-bfc7-66dd6ac96203', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'port_id': 'bdd6d277-b9d3-4e93-bfc7-66dd6ac96203', 'mac_address': 'fa:16:3e:5e:0f:ee', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 579, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:23:52.558132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a95a3f44-bace-4948-905d-0ff10318e3cb req-be5435ab-f149-4f46-a1b8-548c92ab12be tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:52.560030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a95a3f44-bace-4948-905d-0ff10318e3cb req-be5435ab-f149-4f46-a1b8-548c92ab12be tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1588395 May 12 15:23:52.562822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-446ef23e-37b4-4792-99ba-4c1c28495ca8 req-705a4b29-a32e-4953-ae27-7dd329b5597a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:52.564559 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-446ef23e-37b4-4792-99ba-4c1c28495ca8 req-705a4b29-a32e-4953-ae27-7dd329b5597a service neutron] 10.222.0.76 "GET /v2.0/networks?id=2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 200 len: 918 time: 0.2883759 May 12 15:23:52.565878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:52.642492 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a95a3f44-bace-4948-905d-0ff10318e3cb req-10db510d-9300-46ff-8cb0-3c14d3bf9523 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0680068 May 12 15:23:52.672420 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3df21fb0-0d9f-48b2-b050-c2531ccc252e None None] The port '67345a4c-a941-4873-9405-aa12f9b0f3fc' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:23:52.708790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a306c21a-a934-4a55-8955-3ede562c61c1,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:52.726011 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:52.770685 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Pushing event deleted for resources: {'Port': ['ID=67345a4c-a941-4873-9405-aa12f9b0f3fc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:52.774422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:23:52.806425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] No DVR routers for this DVR port 67345a4c-a941-4873-9405-aa12f9b0f3fc on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:23:52.808477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bdd6d277-b9d3-4e93-bfc7-66dd6ac96203,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:52.814707 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:52.885249 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=bdd6d277-b9d3-4e93-bfc7-66dd6ac96203,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:53.016151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 67345a4c-a941-4873-9405-aa12f9b0f3fc no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:23:53.066573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 67345a4c-a941-4873-9405-aa12f9b0f3fc {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:23:53.066904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 67345a4c-a941-4873-9405-aa12f9b0f3fc not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:23:53.108166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04915e59-f69a-45d6-b8e2-a0100c0afa92 req-f64a13e3-85bc-447d-b999-028497823b7a tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:53.110509 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04915e59-f69a-45d6-b8e2-a0100c0afa92 req-f64a13e3-85bc-447d-b999-028497823b7a tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "GET /v2.0/ports?device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 945 time: 0.3153641 May 12 15:23:53.117611 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-446ef23e-37b4-4792-99ba-4c1c28495ca8 req-c8e7287c-1880-48ae-b894-f24c20fd2d97 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0 HTTP/1.1" status: 200 len: 1002 time: 0.4979122 May 12 15:23:53.119690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5c5f02-67b8-4957-9a29-a71ea2c46282 req-54278d61-d561-4d4c-a538-e04fd98034c9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:53.121095 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a5c5f02-67b8-4957-9a29-a71ea2c46282 req-54278d61-d561-4d4c-a538-e04fd98034c9 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.1604791 May 12 15:23:53.130931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3626380-742a-4137-98c2-cbef1462154a req-c9102904-3600-4de9-91e0-3a37794e16be tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:53.132404 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3626380-742a-4137-98c2-cbef1462154a req-c9102904-3600-4de9-91e0-3a37794e16be tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 944 time: 0.2495887 May 12 15:23:53.173223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a306c21a-a934-4a55-8955-3ede562c61c1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:53.180379 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:53.222614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d5df59b8-76b6-4317-a45d-19571e77f5cb']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:23:53.238748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-446ef23e-37b4-4792-99ba-4c1c28495ca8 req-90ada9e6-8d90-4646-926c-4eb0f65af956 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:53.240193 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-446ef23e-37b4-4792-99ba-4c1c28495ca8 req-90ada9e6-8d90-4646-926c-4eb0f65af956 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5f6d45f7-b8bc-4313-879f-ee173c0a4148 HTTP/1.1" status: 200 len: 856 time: 0.1103797 May 12 15:23:53.241832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '08bb1710-24c4-4cf5-ba55-66d36930efa1') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:23:53.242127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '08bb1710-24c4-4cf5-ba55-66d36930efa1') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:23:53.243094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['bdd6d277-b9d3-4e93-bfc7-66dd6ac96203'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:53.252254 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3626380-742a-4137-98c2-cbef1462154a req-e3adacc8-e909-4398-acf2-02af20b06ca9 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0885203 May 12 15:23:53.285742 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a5c5f02-67b8-4957-9a29-a71ea2c46282 req-60db4347-6b53-4234-a56d-02279dc8e295 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1522529 May 12 15:23:53.301958 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:53.317371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-04915e59-f69a-45d6-b8e2-a0100c0afa92 req-bf85959a-cbfb-4b72-a959-933d3fc988d5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Deleting port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:53.317758 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-04915e59-f69a-45d6-b8e2-a0100c0afa92 req-bf85959a-cbfb-4b72-a959-933d3fc988d5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:53.334830 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:53.359838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Releasing vlan 575 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:23:53.360062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: timer() May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:23:53.380987 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:23:53.553278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-446ef23e-37b4-4792-99ba-4c1c28495ca8 req-5e3c9530-6a0b-4e2f-9782-3a55ace7a4e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:53.554920 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-446ef23e-37b4-4792-99ba-4c1c28495ca8 req-5e3c9530-6a0b-4e2f-9782-3a55ace7a4e5 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=2d986451-1d91-468d-8a9c-ecc4da7a86bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3015714 May 12 15:23:53.561941 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:53.574732 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:53.712404 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] 10.222.0.82 "DELETE /v2.0/networks/d5df59b8-76b6-4317-a45d-19571e77f5cb HTTP/1.1" status: 204 len: 168 time: 2.1891298 May 12 15:23:53.721496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2c08432-c1ce-4d63-aabe-6fbf0265fe7b tempest-ExtraDHCPOptionsTestJSON-1893985433 tempest-ExtraDHCPOptionsTestJSON-1893985433-project] Pushing event deleted for resources: {'Network': ['ID=d5df59b8-76b6-4317-a45d-19571e77f5cb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:53.803754 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-446ef23e-37b4-4792-99ba-4c1c28495ca8 req-7d429958-1370-4b77-8514-78b260ff1a91 service neutron] 10.222.0.76 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2245522 May 12 15:23:53.968764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b171729a-66db-48dd-9ef9-42ed71d19707 req-d7c317f6-fb62-4888-acca-67bc2cc7705d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:53.976895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b171729a-66db-48dd-9ef9-42ed71d19707 req-d7c317f6-fb62-4888-acca-67bc2cc7705d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 945 time: 0.5107892 May 12 15:23:53.998570 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-446ef23e-37b4-4792-99ba-4c1c28495ca8 req-450e1178-82b8-4850-8392-f7cf361dbaf8 service neutron] 10.222.0.76 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1848269 May 12 15:23:54.002785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a23f91-db9f-476a-8782-cf7fa38d5e92 req-46a411b7-8850-4fa2-90c9-8aeec75d1261 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:54.004239 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40a23f91-db9f-476a-8782-cf7fa38d5e92 req-46a411b7-8850-4fa2-90c9-8aeec75d1261 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.5074954 May 12 15:23:54.102867 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40a23f91-db9f-476a-8782-cf7fa38d5e92 req-fb1751a6-4f2a-4da0-a47e-b64561dd6b17 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0844362 May 12 15:23:54.109985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-04915e59-f69a-45d6-b8e2-a0100c0afa92 req-bf85959a-cbfb-4b72-a959-933d3fc988d5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] For port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:54.110631 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-04915e59-f69a-45d6-b8e2-a0100c0afa92 req-bf85959a-cbfb-4b72-a959-933d3fc988d5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:54.135479 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b171729a-66db-48dd-9ef9-42ed71d19707 req-7b9e9733-3627-4de2-839a-dfbba985cf62 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1506617 May 12 15:23:54.135479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37876) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:54.334385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-04915e59-f69a-45d6-b8e2-a0100c0afa92 req-bf85959a-cbfb-4b72-a959-933d3fc988d5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Calling delete_port for 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:54.531339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-45aae058-1b2b-41b3-80c6-5e477a464d0c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e5f221bbde0b4f28b287cbb78999d605&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3987610 May 12 15:23:54.534290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37890) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:54.545808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7ca65b0-1deb-43af-9799-d3d681f7c310 req-f7665257-443e-4010-8cbf-f2a6f2bd5b4f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:54.547231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7ca65b0-1deb-43af-9799-d3d681f7c310 req-f7665257-443e-4010-8cbf-f2a6f2bd5b4f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2731822 May 12 15:23:54.599068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-450a0c37-a3df-4985-a4f5-b23880fefaf2 req-a2ce852f-aab5-4e58-a4d8-0566ad08375f tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:54.600420 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-450a0c37-a3df-4985-a4f5-b23880fefaf2 req-a2ce852f-aab5-4e58-a4d8-0566ad08375f tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 945 time: 0.3276949 May 12 15:23:54.600739 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-814d548e-50a6-4d88-8d0d-8e53d49b89a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:54.627318 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-814d548e-50a6-4d88-8d0d-8e53d49b89a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:54.683352 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-814d548e-50a6-4d88-8d0d-8e53d49b89a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:54.686436 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7ca65b0-1deb-43af-9799-d3d681f7c310 req-0f206b9e-1c92-4270-9680-b2e03010170e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1006413 May 12 15:23:54.690035 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-04915e59-f69a-45d6-b8e2-a0100c0afa92 req-bf85959a-cbfb-4b72-a959-933d3fc988d5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:54.704559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-814d548e-50a6-4d88-8d0d-8e53d49b89a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9337e61-2ae3-4e11-99e7-11d6851719fa,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:54.704919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:54.720435 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-814d548e-50a6-4d88-8d0d-8e53d49b89a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:54.720435 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-814d548e-50a6-4d88-8d0d-8e53d49b89a9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d9337e61-2ae3-4e11-99e7-11d6851719fa HTTP/1.1" status: 204 len: 168 time: 0.1786001 May 12 15:23:54.749494 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-450a0c37-a3df-4985-a4f5-b23880fefaf2 req-409bde1a-e052-405a-ab69-62dcf25977ae tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1275604 May 12 15:23:54.752563 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf85959a-cbfb-4b72-a959-933d3fc988d5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Pushing event deleted for resources: {'Port': ['ID=5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:54.929157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-04915e59-f69a-45d6-b8e2-a0100c0afa92 req-bf85959a-cbfb-4b72-a959-933d3fc988d5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] No DVR routers for this DVR port 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:23:54.939532 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-04915e59-f69a-45d6-b8e2-a0100c0afa92 req-bf85959a-cbfb-4b72-a959-933d3fc988d5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:54.942255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '19d9f265-5c0e-4464-8b8a-97af703db06f', 'name': 'network-vif-deleted', 'tag': '5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:54.998697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04915e59-f69a-45d6-b8e2-a0100c0afa92 req-bf85959a-cbfb-4b72-a959-933d3fc988d5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "DELETE /v2.0/ports/5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d HTTP/1.1" status: 204 len: 173 time: 1.8762245 May 12 15:23:55.068715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d630c866-9874-4c43-ab41-a7823d9c6e3e req-91a42938-4226-44ec-a531-f82c7198c15e tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:55.075530 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d630c866-9874-4c43-ab41-a7823d9c6e3e req-91a42938-4226-44ec-a531-f82c7198c15e tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.1898425 May 12 15:23:55.085569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c945db9-c136-48e4-b341-63d5ad78b0c4 req-47ed14d6-36b3-4f19-affc-4445e383eb69 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:55.086980 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c945db9-c136-48e4-b341-63d5ad78b0c4 req-47ed14d6-36b3-4f19-affc-4445e383eb69 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 944 time: 0.1558485 May 12 15:23:55.161827 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c945db9-c136-48e4-b341-63d5ad78b0c4 req-4bf5fb4e-6edd-468b-a4f0-b1a1c4a5241c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621731 May 12 15:23:55.172843 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d630c866-9874-4c43-ab41-a7823d9c6e3e req-e7bebdc1-a065-4132-b2ab-02cc42c70d0e tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0958488 May 12 15:23:55.279577 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-dc08c788-fda1-41ec-ae47-74baeb7e2bc8'] response: {'server_uuid': '19d9f265-5c0e-4464-8b8a-97af703db06f', 'name': 'network-vif-deleted', 'tag': '5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d', 'status': 'completed', 'code': 200} May 12 15:23:55.524687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ab84b3d5-d095-4cda-8d0c-2759fcd4fa42 req-6dd59bb7-8593-4fa2-be37-82c487ce9d89 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Synchronizing usage tracker for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:55.564346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ab84b3d5-d095-4cda-8d0c-2759fcd4fa42 req-6dd59bb7-8593-4fa2-be37-82c487ce9d89 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Unset dirty status for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:55.565534 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab84b3d5-d095-4cda-8d0c-2759fcd4fa42 req-6dd59bb7-8593-4fa2-be37-82c487ce9d89 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=19d9f265-5c0e-4464-8b8a-97af703db06f HTTP/1.1" status: 200 len: 210 time: 0.0945747 May 12 15:23:55.587422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb50edaa-1fd4-41fb-bc4f-16fcda4a68ca req-c4739e39-b712-4a81-a2ff-a74cdef29363 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:55.594037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:23:55.594962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eb50edaa-1fd4-41fb-bc4f-16fcda4a68ca req-c4739e39-b712-4a81-a2ff-a74cdef29363 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1760340 May 12 15:23:55.648622 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eb50edaa-1fd4-41fb-bc4f-16fcda4a68ca req-ff8a0186-af2b-4bd1-b2ba-d282e6ff6720 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523336 May 12 15:23:55.688138 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:55.695678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:55.696050 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:55.871780 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:55.907410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4719dce9-d654-490a-915f-8e3c7942fc48', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bdd6d277-b9d3-4e93-bfc7-66dd6ac96203'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:55.931213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bdd6d277-b9d3-4e93-bfc7-66dd6ac96203,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:55.941971 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:55.943053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a306c21a-a934-4a55-8955-3ede562c61c1 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:23:55.973204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77518424-c49c-4b39-aa03-f5a4ecd972c0 req-57d8b64b-f6bc-4a62-91bf-85d15a2bacb2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:55.980277 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77518424-c49c-4b39-aa03-f5a4ecd972c0 req-57d8b64b-f6bc-4a62-91bf-85d15a2bacb2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1752701 May 12 15:23:56.002834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37958) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:56.020485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd92efb3-441a-4b23-a2fd-bfb6a7a83898 req-0c9706a6-e2dc-4171-8e08-149ac06aacc3 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:56.022016 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd92efb3-441a-4b23-a2fd-bfb6a7a83898 req-0c9706a6-e2dc-4171-8e08-149ac06aacc3 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.76 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.1741776 May 12 15:23:56.102931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=bdd6d277-b9d3-4e93-bfc7-66dd6ac96203,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:56.156317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-9f332f3f-4053-4c75-af57-663dbaa95225 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] Request body: {'port': {'network_id': '16a9caf0-d674-401b-ae13-c0da7684cfae', 'name': 'tempest-NetworksNegativeTestJSON-1337527592'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:56.161350 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77518424-c49c-4b39-aa03-f5a4ecd972c0 req-d0ff430c-d548-47de-b403-c319a20dd494 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1799083 May 12 15:23:56.161879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port a306c21a-a934-4a55-8955-3ede562c61c1 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:23:56.175568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port a306c21a-a934-4a55-8955-3ede562c61c1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:23:56.175992 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:56.184281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-dd92efb3-441a-4b23-a2fd-bfb6a7a83898 req-f4cb7716-abba-4912-b240-6acaadd97cf3 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Deleting port 31c449ad-4a28-4740-9037-350aab14340e {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:23:56.184824 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd92efb3-441a-4b23-a2fd-bfb6a7a83898 req-f4cb7716-abba-4912-b240-6acaadd97cf3 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:56.246377 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-9f332f3f-4053-4c75-af57-663dbaa95225 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] POST failed (client error): The resource could not be found. May 12 15:23:56.247011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9f332f3f-4053-4c75-af57-663dbaa95225 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:23:56.253649 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bd37d074-0f84-498d-8ef4-60cea5251b5b'] response: {'server_uuid': '4719dce9-d654-490a-915f-8e3c7942fc48', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bdd6d277-b9d3-4e93-bfc7-66dd6ac96203', 'code': 200} May 12 15:23:56.253960 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9f332f3f-4053-4c75-af57-663dbaa95225 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 404 len: 339 time: 0.2499743 May 12 15:23:56.256417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37974) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:56.323697 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-03ce6c22-94bd-4263-9b96-db4f4701ae02 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] DELETE failed (client error): The resource could not be found. May 12 15:23:56.324282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-03ce6c22-94bd-4263-9b96-db4f4701ae02 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:23:56.331364 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-03ce6c22-94bd-4263-9b96-db4f4701ae02 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] 10.222.0.82 "DELETE /v2.0/networks/a443bdc5-2f6f-47b3-84a7-61d331102a45 HTTP/1.1" status: 404 len: 339 time: 0.0739052 May 12 15:23:56.334936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37980) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:56.392906 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:56.453873 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a306c21a-a934-4a55-8955-3ede562c61c1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a306c21a-a934-4a55-8955-3ede562c61c1,segment=NetworkSegment(2b9a3118-674a-42bd-be1d-3a0efcec85f0),segment_id=2b9a3118-674a-42bd-be1d-3a0efcec85f0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:56.464001 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:56.485862 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-f4f1f7c8-e9ca-4373-8dd8-75bdb95a4795 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] DELETE failed (client error): The resource could not be found. May 12 15:23:56.486332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f4f1f7c8-e9ca-4373-8dd8-75bdb95a4795 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:23:56.491776 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f4f1f7c8-e9ca-4373-8dd8-75bdb95a4795 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] 10.222.0.82 "DELETE /v2.0/ports/92b64898-bf88-4ed0-b38a-a92638807794 HTTP/1.1" status: 404 len: 333 time: 0.1521292 May 12 15:23:56.492734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37984) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:56.542427 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-ee9ea7cd-09d5-42c3-bedc-7a4458d2d168 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] DELETE failed (client error): The resource could not be found. May 12 15:23:56.542884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ee9ea7cd-09d5-42c3-bedc-7a4458d2d168 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:23:56.549320 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ee9ea7cd-09d5-42c3-bedc-7a4458d2d168 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] 10.222.0.82 "DELETE /v2.0/subnets/bf3dd97f-b932-4011-9d75-4c3b313f713b HTTP/1.1" status: 404 len: 337 time: 0.0517204 May 12 15:23:56.550166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37990) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:56.582765 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-cf20ffea-6e46-4def-9838-4f7c37df1551 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] GET failed (client error): The resource could not be found. May 12 15:23:56.587984 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cf20ffea-6e46-4def-9838-4f7c37df1551 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] 10.222.0.82 "GET /v2.0/networks/c45dd36b-a5fd-49c6-8f2c-f0ed7134aab7 HTTP/1.1" status: 404 len: 339 time: 0.0337250 May 12 15:23:56.588617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37994) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:56.636111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a306c21a-a934-4a55-8955-3ede562c61c1,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:56.656956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28b94404-2bac-4403-94b8-794e7b744f27 req-b7b84910-1252-4c90-8729-b8c91eb215f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:56.658747 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-28b94404-2bac-4403-94b8-794e7b744f27 req-b7b84910-1252-4c90-8729-b8c91eb215f5 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 1096 time: 0.2534277 May 12 15:23:56.659916 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-a7c83f81-0ee2-4aa9-be9f-126ff853eb11 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] GET failed (client error): The resource could not be found. May 12 15:23:56.669014 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a7c83f81-0ee2-4aa9-be9f-126ff853eb11 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] 10.222.0.82 "GET /v2.0/ports/cfc83851-e4f8-4c3c-be92-47a5ab069a26 HTTP/1.1" status: 404 len: 333 time: 0.0758331 May 12 15:23:56.705654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38002) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:56.770510 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-29ff52ed-f923-4444-8716-45a2f952014c tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] GET failed (client error): The resource could not be found. May 12 15:23:56.776655 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-29ff52ed-f923-4444-8716-45a2f952014c tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] 10.222.0.82 "GET /v2.0/subnets/b6da4f79-711d-49d2-b5cc-f4e1d54f2e46 HTTP/1.1" status: 404 len: 337 time: 0.0620191 May 12 15:23:56.777601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38006) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:56.780330 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-28b94404-2bac-4403-94b8-794e7b744f27 req-82ad3ab9-f03c-4cc4-ab8a-bd7053071249 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1026466 May 12 15:23:56.787140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ce61332b-81f2-4f0e-b61b-cc1d5b34a263 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] Request body: {'network': {'name': 'new_name'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:56.812251 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-ce61332b-81f2-4f0e-b61b-cc1d5b34a263 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] PUT failed (client error): The resource could not be found. May 12 15:23:56.813035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ce61332b-81f2-4f0e-b61b-cc1d5b34a263 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:23:56.818299 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ce61332b-81f2-4f0e-b61b-cc1d5b34a263 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] 10.222.0.82 "PUT /v2.0/networks/34a37733-ceee-45ee-9cb4-3f5c6e24d3e8 HTTP/1.1" status: 404 len: 339 time: 0.0368481 May 12 15:23:56.819108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38010) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:56.825342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-98075662-2584-43e3-b973-46e62378a37c tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] Request body: {'port': {'name': 'new_name'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:56.870658 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-98075662-2584-43e3-b973-46e62378a37c tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] PUT failed (client error): The resource could not be found. May 12 15:23:56.871248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-98075662-2584-43e3-b973-46e62378a37c tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:23:56.872495 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-98075662-2584-43e3-b973-46e62378a37c tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] 10.222.0.82 "PUT /v2.0/ports/71a61aab-ab26-4037-92c2-48d5b5e4290e HTTP/1.1" status: 404 len: 333 time: 0.0522838 May 12 15:23:56.878138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38014) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:56.880303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:23:56.884097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2bc8d519-aa99-43df-80c2-c302db826505 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] Request body: {'subnet': {'name': 'new_name'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:56.908863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fca5ecd-fd83-407c-a9aa-9105fd922762 req-776cf9ad-9e1f-421e-83d3-10a9c3c6c20c tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:56.911110 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4fca5ecd-fd83-407c-a9aa-9105fd922762 req-776cf9ad-9e1f-421e-83d3-10a9c3c6c20c tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 946 time: 0.6102676 May 12 15:23:56.925128 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-2bc8d519-aa99-43df-80c2-c302db826505 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] PUT failed (client error): The resource could not be found. May 12 15:23:56.925907 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:23:56.926097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2bc8d519-aa99-43df-80c2-c302db826505 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:23:56.926563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 5f6d15fa-c2c0-472a-8e0b-21b4c8d3377d not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:23:56.927655 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2bc8d519-aa99-43df-80c2-c302db826505 tempest-NetworksNegativeTestJSON-125824051 tempest-NetworksNegativeTestJSON-125824051-project] 10.222.0.82 "PUT /v2.0/subnets/f8e54fd7-9e51-4af1-83e0-1b0766d8e672 HTTP/1.1" status: 404 len: 337 time: 0.0488632 May 12 15:23:56.971190 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1834c7b4-f8cf-41e9-bece-7180c84f24b3 req-ef1aae48-23a9-4d4f-a86a-1376de39b24b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:56.972710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1834c7b4-f8cf-41e9-bece-7180c84f24b3 req-ef1aae48-23a9-4d4f-a86a-1376de39b24b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 945 time: 0.3231878 May 12 15:23:57.078890 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4fca5ecd-fd83-407c-a9aa-9105fd922762 req-f909397c-f78c-4a37-8f5a-2a71963740fe tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1349082 May 12 15:23:57.086600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-dd92efb3-441a-4b23-a2fd-bfb6a7a83898 req-f4cb7716-abba-4912-b240-6acaadd97cf3 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] For port 31c449ad-4a28-4740-9037-350aab14340e, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=31c449ad-4a28-4740-9037-350aab14340e,segment=NetworkSegment(ccba5697-f062-48f7-986e-3317afc51896),segment_id=ccba5697-f062-48f7-986e-3317afc51896)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:23:57.086795 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd92efb3-441a-4b23-a2fd-bfb6a7a83898 req-f4cb7716-abba-4912-b240-6acaadd97cf3 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:57.132946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1834c7b4-f8cf-41e9-bece-7180c84f24b3 req-6328f8bd-47b7-4415-9d3e-f8b3a48a152b tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1505878 May 12 15:23:57.309112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-dd92efb3-441a-4b23-a2fd-bfb6a7a83898 req-f4cb7716-abba-4912-b240-6acaadd97cf3 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Calling delete_port for 31c449ad-4a28-4740-9037-350aab14340e owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:23:57.408112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38022) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:57.500100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7db991a6-7e00-47db-acf4-1fee434943e6 req-20c1f574-3a4e-40ba-ae3e-d2b3465edf16 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:57.501473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7db991a6-7e00-47db-acf4-1fee434943e6 req-20c1f574-3a4e-40ba-ae3e-d2b3465edf16 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 945 time: 0.2001066 May 12 15:23:57.627662 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e5021963-256b-4458-b85e-8ae3826d9635 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:57.644225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e5021963-256b-4458-b85e-8ae3826d9635 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:57.648493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e5021963-256b-4458-b85e-8ae3826d9635 admin admin] Usage tracker for resource:security_group_rule and tenant:e157d0d85c504dd79a876302be649c2a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:57.651573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e5021963-256b-4458-b85e-8ae3826d9635 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:57.658103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e5021963-256b-4458-b85e-8ae3826d9635 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:57.683327 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7db991a6-7e00-47db-acf4-1fee434943e6 req-adb59d19-89a7-431b-8e32-427859f82ec2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1707916 May 12 15:23:57.707918 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd92efb3-441a-4b23-a2fd-bfb6a7a83898 req-f4cb7716-abba-4912-b240-6acaadd97cf3 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:57.724186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['eaeeccb2-8af7-4344-866b-7226dbc22776'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:23:57.764791 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e5021963-256b-4458-b85e-8ae3826d9635 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:57.770687 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e5021963-256b-4458-b85e-8ae3826d9635 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:57.792669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4cb7716-abba-4912-b240-6acaadd97cf3 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Pushing event deleted for resources: {'Port': ['ID=31c449ad-4a28-4740-9037-350aab14340e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:57.837475 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e5021963-256b-4458-b85e-8ae3826d9635 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e157d0d85c504dd79a876302be649c2a&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4277050 May 12 15:23:57.844967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38034) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:57.846071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5021963-256b-4458-b85e-8ae3826d9635 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=231fa024-2394-4a38-9c2e-016d33a641f2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:57.938915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-dd92efb3-441a-4b23-a2fd-bfb6a7a83898 req-f4cb7716-abba-4912-b240-6acaadd97cf3 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] No DVR routers for this DVR port 31c449ad-4a28-4740-9037-350aab14340e on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:23:57.964483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07f3250f-4ef3-4d94-8238-454355de8127 req-64b4c130-ef24-4d7f-b6d2-194707bafa82 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:57.973380 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a0e8da9-1bf5-4b03-ac42-d5d1982f8474 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:57.980526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-07f3250f-4ef3-4d94-8238-454355de8127 req-64b4c130-ef24-4d7f-b6d2-194707bafa82 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.3708284 May 12 15:23:57.983980 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd92efb3-441a-4b23-a2fd-bfb6a7a83898 req-f4cb7716-abba-4912-b240-6acaadd97cf3 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:57.992557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '31e1782e-1e75-4738-9a0c-d51f4a6ee62c', 'name': 'network-vif-deleted', 'tag': '31c449ad-4a28-4740-9037-350aab14340e'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:58.021708 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a0e8da9-1bf5-4b03-ac42-d5d1982f8474 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:58.045170 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd92efb3-441a-4b23-a2fd-bfb6a7a83898 req-f4cb7716-abba-4912-b240-6acaadd97cf3 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.76 "DELETE /v2.0/ports/31c449ad-4a28-4740-9037-350aab14340e HTTP/1.1" status: 204 len: 173 time: 2.0116401 May 12 15:23:58.119123 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c79d8188-5a91-4481-9fb2-d623e6777979'] response: {'server_uuid': '31e1782e-1e75-4738-9a0c-d51f4a6ee62c', 'name': 'network-vif-deleted', 'tag': '31c449ad-4a28-4740-9037-350aab14340e', 'status': 'completed', 'code': 200} May 12 15:23:58.135286 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-07f3250f-4ef3-4d94-8238-454355de8127 req-48ea81c3-ee1f-40c5-a7df-84d77d0f8af0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1521733 May 12 15:23:58.137936 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a0e8da9-1bf5-4b03-ac42-d5d1982f8474 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:58.182316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a0e8da9-1bf5-4b03-ac42-d5d1982f8474 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=231fa024-2394-4a38-9c2e-016d33a641f2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:58.204920 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a0e8da9-1bf5-4b03-ac42-d5d1982f8474 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:58.206666 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9a0e8da9-1bf5-4b03-ac42-d5d1982f8474 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/231fa024-2394-4a38-9c2e-016d33a641f2 HTTP/1.1" status: 204 len: 168 time: 0.3543975 May 12 15:23:58.309682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'caefe380-1876-4938-83a7-078804c994b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a306c21a-a934-4a55-8955-3ede562c61c1'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:23:58.380158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4f2908e9-3e5f-4d8a-9725-7a2a0ba7c919 req-537048e0-7bd0-438a-9f15-7ef725329e1a tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Synchronizing usage tracker for tenant:9e2382be0c6f4779ae64026a57628773 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:23:58.408744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4f2908e9-3e5f-4d8a-9725-7a2a0ba7c919 req-537048e0-7bd0-438a-9f15-7ef725329e1a tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Unset dirty status for tenant:9e2382be0c6f4779ae64026a57628773 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:23:58.411250 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4f2908e9-3e5f-4d8a-9725-7a2a0ba7c919 req-537048e0-7bd0-438a-9f15-7ef725329e1a tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=31e1782e-1e75-4738-9a0c-d51f4a6ee62c HTTP/1.1" status: 200 len: 210 time: 0.0979519 May 12 15:23:58.443400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38b491e6-9868-4e5f-bdc9-6a1e01d838e4 req-8a361598-c4ec-4fe1-855c-35264f734999 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:58.445150 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-38b491e6-9868-4e5f-bdc9-6a1e01d838e4 req-8a361598-c4ec-4fe1-855c-35264f734999 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 946 time: 0.1770201 May 12 15:23:58.502482 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-38b491e6-9868-4e5f-bdc9-6a1e01d838e4 req-438fc1ae-2801-425f-8d72-6f086fd12bdb tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509698 May 12 15:23:58.673308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c941135b-a61c-4dae-94e8-5b6d1c2db323 req-9d34763b-1dd0-4d27-9933-934b769b7ee4 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:58.677972 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c941135b-a61c-4dae-94e8-5b6d1c2db323 req-9d34763b-1dd0-4d27-9933-934b769b7ee4 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1091909 May 12 15:23:58.813680 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c941135b-a61c-4dae-94e8-5b6d1c2db323 req-c6eab16f-d8e4-44e8-99ca-0015e742ae84 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1298375 May 12 15:23:58.876889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 31c449ad-4a28-4740-9037-350aab14340e no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:23:58.919633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-b0f4cb8f-88f3-4406-83c4-7244f13cb018 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:58.929373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-b0f4cb8f-88f3-4406-83c4-7244f13cb018 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 812 time: 0.2882607 May 12 15:23:58.962748 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-dcd99aad-2a38-46fb-af4e-dc61279634c3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/quotas/011dcf6c7b624a28bb2d8ed8db38754f HTTP/1.1" status: 200 len: 375 time: 0.0321844 May 12 15:23:58.964720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 31c449ad-4a28-4740-9037-350aab14340e {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:23:58.965306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 31c449ad-4a28-4740-9037-350aab14340e not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:23:59.053264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-8a99ce00-2997-4b90-8125-92b7adbf3037 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0859187 May 12 15:23:59.289308 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e35cff05-90ec-4286-b96b-630fee4ac624'] response: {'server_uuid': 'caefe380-1876-4938-83a7-078804c994b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a306c21a-a934-4a55-8955-3ede562c61c1', 'code': 200} May 12 15:23:59.385555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-e3490af1-6a07-45ad-b6fb-2cd23335541a service neutron] 10.222.0.82 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3310299 May 12 15:23:59.394913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38094) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:23:59.494247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a701014f-907b-449c-b690-7a6fe888ec1e req-334bb458-d4b1-428f-aec4-f0471b40ed8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:59.496867 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a701014f-907b-449c-b690-7a6fe888ec1e req-334bb458-d4b1-428f-aec4-f0471b40ed8d service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 1097 time: 0.0952156 May 12 15:23:59.550939 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a701014f-907b-449c-b690-7a6fe888ec1e req-48029736-d90c-4987-a236-45ed29c8fc9b service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479598 May 12 15:23:59.570832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Request body: {'network': {'name': 'tempest-TagsExtTest-test-network-858351276'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:23:59.576697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:59.580652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Usage tracker for resource:network and tenant:6b5a1b17b82943a8bf198305bcf7aea6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:59.583708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:59.589566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:59.596862 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-7d5f8d24-10e8-4acd-adf1-9265b85b2e7b service neutron] 10.222.0.82 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2096665 May 12 15:23:59.606465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd86220-3a5a-4fdb-a28d-8a8648ef242b req-4f641740-a55e-4527-b788-2d5cd810f570 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:59.608569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecd86220-3a5a-4fdb-a28d-8a8648ef242b req-4f641740-a55e-4527-b788-2d5cd810f570 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 945 time: 0.2198844 May 12 15:23:59.609640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Made reservation on behalf of 6b5a1b17b82943a8bf198305bcf7aea6 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:23:59.613954 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:59.628567 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:59.648482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:23:59.653871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Usage tracker for resource:security_group_rule and tenant:6b5a1b17b82943a8bf198305bcf7aea6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:23:59.658012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:23:59.664127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:23:59.668190 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecd86220-3a5a-4fdb-a28d-8a8648ef242b req-eaf5d548-2d94-4f21-8bfb-376c9e8b41b3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537217 May 12 15:23:59.804200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:59.817594 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:59.882323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Pushing event updated for resources: {'SecurityGroup': ['ID=33c3ec82-c16e-4cdc-b99c-33be4f3d7bd0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:23:59.901741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e24f4ef9-e777-4e73-b407-b8d307c3fd34 req-a222f11b-907d-4ae5-9363-7e114edc43aa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:23:59.910971 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e24f4ef9-e777-4e73-b407-b8d307c3fd34 req-a222f11b-907d-4ae5-9363-7e114edc43aa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 947 time: 0.1054049 May 12 15:23:59.913195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 589} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:23:59.924772 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:23:59.925288 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Added segment e5d8a6a0-c3d7-4731-af72-b087ae1cd96c of type vlan for network d1a135b1-316c-47d6-9c50-16438ea53de8 May 12 15:23:59.964249 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:00.005940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:00.017025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:00.018049 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:00.035376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e24f4ef9-e777-4e73-b407-b8d307c3fd34 req-0c1a21f1-1f66-40ca-b2e1-e21ff4283eec tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1235151 May 12 15:24:00.068541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ed9ad70-d8a7-485a-bac0-0ed58c6b0869 req-7bfe6570-088b-42f1-81ee-9c0d55f159df tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:00.082342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ed9ad70-d8a7-485a-bac0-0ed58c6b0869 req-7bfe6570-088b-42f1-81ee-9c0d55f159df tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 946 time: 0.1522534 May 12 15:24:00.161204 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ed9ad70-d8a7-485a-bac0-0ed58c6b0869 req-7354f20b-8117-4ab1-96a2-42e175a4b863 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0722971 May 12 15:24:00.327615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Pushing event updated for resources: {'Network': ['ID=d1a135b1-316c-47d6-9c50-16438ea53de8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:00.339701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network d1a135b1-316c-47d6-9c50-16438ea53de8 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:24:00.352012 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1a1ddc5a-5179-4f24-b239-9a9ee0a9178b tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 778 time: 0.9559302 May 12 15:24:00.356319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38128) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:00.366363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Request body: {'subnet': {'network_id': 'd1a135b1-316c-47d6-9c50-16438ea53de8', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:00.478885 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1cfb9ae-0f7c-4f96-8d32-26ee73b77a05 req-ec2b1f44-862a-4da9-9536-8be6fe7b057a tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=914409b3-8c2c-4574-af4a-2eb14f6d1ad9 HTTP/1.1" status: 200 len: 210 time: 0.1883361 May 12 15:24:00.623657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4a89ef7-c056-4779-bbdb-45b0fdb62835 req-8c48dabd-647e-46e7-b2a0-b1b2fb9defd8 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:00.641339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4a89ef7-c056-4779-bbdb-45b0fdb62835 req-8c48dabd-647e-46e7-b2a0-b1b2fb9defd8 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2669356 May 12 15:24:00.727389 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:00.738254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Usage tracker for resource:subnet and tenant:6b5a1b17b82943a8bf198305bcf7aea6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:00.742142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:00.758072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:00.781871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Made reservation on behalf of 6b5a1b17b82943a8bf198305bcf7aea6 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:24:00.787432 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:00.797121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4a89ef7-c056-4779-bbdb-45b0fdb62835 req-226297c3-e1fe-49b7-85f0-2166ef1a8625 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1527481 May 12 15:24:00.881816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-38a1204a-811e-4feb-9a27-71e02399edd6 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:00.883705 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-38a1204a-811e-4feb-9a27-71e02399edd6 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.76 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 947 time: 0.2029800 May 12 15:24:01.233780 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:01.240509 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Deleting port 4a88f583-55ea-4849-8a87-dbc693ed07d0 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:24:01.241252 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:01.329372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Pushing event updated for resources: {'Subnet': ['ID=241c4d7c-a9c4-4133-9c16-acfdba71a6da,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:01.340076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Checking segment: {'id': 'e5d8a6a0-c3d7-4731-af72-b087ae1cd96c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'd1a135b1-316c-47d6-9c50-16438ea53de8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:24:01.340076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Network hostable DHCP agents. Network: d1a135b1-316c-47d6-9c50-16438ea53de8, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:24:01.359462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Network d1a135b1-316c-47d6-9c50-16438ea53de8 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:24:01.371464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, d1a135b1-316c-47d6-9c50-16438ea53de8) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:01.379220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:01.379843 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:01.383403 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d448a921-ca0a-4ea8-8722-ff772831a76e None None] Network d1a135b1-316c-47d6-9c50-16438ea53de8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:24:01.414838 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8e946c5a-2c52-4825-ae2b-5845edcbf6a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0569880 May 12 15:24:01.415971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38150) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:01.422249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Request body: {'port': {'network_id': 'd1a135b1-316c-47d6-9c50-16438ea53de8', 'name': 'tempest-TagsExtTest-352487168'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:01.494309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c785a3db-db18-4815-96c4-4c69846151ea req-ec86706d-95a1-469a-99f1-506414c4bdf0 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:01.504834 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c785a3db-db18-4815-96c4-4c69846151ea req-ec86706d-95a1-469a-99f1-506414c4bdf0 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.4673107 May 12 15:24:01.609273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e3c5d0b-1e6c-4ad6-8204-74c6eea29e24 req-ecb81d68-45ac-4f6e-8807-c3f711dcc653 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:01.610813 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e3c5d0b-1e6c-4ad6-8204-74c6eea29e24 req-ecb81d68-45ac-4f6e-8807-c3f711dcc653 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.4983935 May 12 15:24:01.714264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c785a3db-db18-4815-96c4-4c69846151ea req-475e1d04-a8f8-4a4d-8a91-41430b85b502 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2082090 May 12 15:24:01.727134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-d1a135b1-316c-47d6-9c50-16438ea53de8', 'network_id': 'd1a135b1-316c-47d6-9c50-16438ea53de8', 'tenant_id': '6b5a1b17b82943a8bf198305bcf7aea6', 'fixed_ips': [{'subnet_id': '241c4d7c-a9c4-4133-9c16-acfdba71a6da'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:24:01.728695 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:01.767221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e3c5d0b-1e6c-4ad6-8204-74c6eea29e24 req-e08a5c40-44dd-4020-993c-c5ec1bc87a30 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1491783 May 12 15:24:01.789360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] For port 4a88f583-55ea-4849-8a87-dbc693ed07d0, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4a88f583-55ea-4849-8a87-dbc693ed07d0,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:01.789360 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:01.858486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:01.918535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Usage tracker for resource:port and tenant:6b5a1b17b82943a8bf198305bcf7aea6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:01.922519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:01.934010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:01.953260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Allocated IP 172.20.0.2 (d1a135b1-316c-47d6-9c50-16438ea53de8/241c4d7c-a9c4-4133-9c16-acfdba71a6da/9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:24:01.960930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Made reservation on behalf of 6b5a1b17b82943a8bf198305bcf7aea6 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:24:01.969048 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:02.030333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] device_id is not set on port e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:24:02.084008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-0b7ab6b8-7a93-4df1-81ce-8ab53d778b1b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:02.085590 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-0b7ab6b8-7a93-4df1-81ce-8ab53d778b1b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 812 time: 0.4886010 May 12 15:24:02.107743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Request body: {'port': {'device_id': '914409b3-8c2c-4574-af4a-2eb14f6d1ad9', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'admin_state_up': True, 'tenant_id': '011dcf6c7b624a28bb2d8ed8db38754f'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:02.257379 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:02.258321 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:02.271387 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Transition to ACTIVE for port object 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:02.304964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Transition to ACTIVE for port object 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:02.313188 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:02.378275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Network d1a135b1-316c-47d6-9c50-16438ea53de8 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:24:02.387065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:02.393502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:24:02.415102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:02.433794 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:02.458299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Allocated IP 172.20.0.8 (d1a135b1-316c-47d6-9c50-16438ea53de8/241c4d7c-a9c4-4133-9c16-acfdba71a6da/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:24:02.471186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Made reservation on behalf of 011dcf6c7b624a28bb2d8ed8db38754f for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:24:02.474991 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:02.480258 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:02.480850 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:02.481234 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Floating IP 4ee874b2-35ce-4deb-960e-3fee8a1cd250 disassociated. External IP: 172.25.8.178, port: 4a88f583-55ea-4849-8a87-dbc693ed07d0. May 12 15:24:02.481723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Calling delete_port for 4a88f583-55ea-4849-8a87-dbc693ed07d0 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:24:02.500830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Pushing event updated for resources: {'Port': ['ID=9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:02.522572 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Attempting to bind port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:24:02.523179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Attempting to bind port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'e5d8a6a0-c3d7-4731-af72-b087ae1cd96c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'd1a135b1-316c-47d6-9c50-16438ea53de8'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:24:02.523868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Attempting to bind port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c on network d1a135b1-316c-47d6-9c50-16438ea53de8 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:24:02.530523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 23, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:24:02.531888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Checking segment: {'id': 'e5d8a6a0-c3d7-4731-af72-b087ae1cd96c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'd1a135b1-316c-47d6-9c50-16438ea53de8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:24:02.532625 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:02.533939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Bound using segment: {'id': 'e5d8a6a0-c3d7-4731-af72-b087ae1cd96c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'd1a135b1-316c-47d6-9c50-16438ea53de8'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:24:02.534582 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Bound port: 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e5d8a6a0-c3d7-4731-af72-b087ae1cd96c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'd1a135b1-316c-47d6-9c50-16438ea53de8'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:24:02.535117 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:02.557673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee469c97-432f-49c5-9047-6a9bc440c1ee req-7a419166-9f72-4daa-82d8-9c9ee43a6f76 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:02.565462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee469c97-432f-49c5-9047-6a9bc440c1ee req-7a419166-9f72-4daa-82d8-9c9ee43a6f76 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 946 time: 0.5261397 May 12 15:24:02.595900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09697053-5cd7-43b1-aca3-1212dae7068c req-a66e6dea-6ce0-4094-a2c5-bd3094a4a362 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:02.603024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09697053-5cd7-43b1-aca3-1212dae7068c req-a66e6dea-6ce0-4094-a2c5-bd3094a4a362 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 947 time: 0.6158159 May 12 15:24:02.668849 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee469c97-432f-49c5-9047-6a9bc440c1ee req-f7576ea7-a398-41ac-9efe-55c17c2c5b62 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1010482 May 12 15:24:02.745998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] For port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:24:02.756444 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] For port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c,segment=NetworkSegment(e5d8a6a0-c3d7-4731-af72-b087ae1cd96c),segment_id=e5d8a6a0-c3d7-4731-af72-b087ae1cd96c)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:24:02.756999 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09697053-5cd7-43b1-aca3-1212dae7068c req-1f6e492b-5790-40d5-be99-2cd83ff8d432 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=113e667d-ea29-4a75-8d4e-1be835a567e4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1520984 May 12 15:24:02.768173 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:02.861868 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:02.879680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Transition to ACTIVE for port object e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:02.944417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Allocated IP 172.20.0.10 (aa894a26-e7a0-42ea-b7f1-9a9c136eacd6/0ff5192a-946b-4444-900a-788b8ddc74b6/c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:24:02.969127 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:02.985079 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:03.017696 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4724f5-8c10-427f-ac74-6ff2701f8eaa None None] Pushing event updated for resources: {'Port': ['ID=9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:03.121226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event deleted for resources: {'Port': ['ID=4a88f583-55ea-4849-8a87-dbc693ed07d0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:03.216295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Network d1a135b1-316c-47d6-9c50-16438ea53de8 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:24:03.230346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:03.233271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:24:03.271733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Pushing event updated for resources: {'Port': ['ID=e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:03.272530 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdff7c45-c2b8-4e05-bbcb-16bf88eaccc7 req-b76fe83d-3aee-4f2b-8780-4ff87a5b64ad tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=914409b3-8c2c-4574-af4a-2eb14f6d1ad9 HTTP/1.1" status: 200 len: 210 time: 0.2264087 May 12 15:24:03.390688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6b92515-4b7c-4381-9b30-f5ee35ecdcfa req-d4b3ba51-6c59-4b86-af35-7ff9dc459260 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-SecurityGroupsTestJSON-securitygroup-883775541&fields=id&tenant_id=86574e26b5194d1f92a51749f063fa69 HTTP/1.1" status: 200 len: 267 time: 0.2660365 May 12 15:24:03.643205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:03.643854 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:03.707922 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-237c8061-f7ed-49ba-a205-8322e3b099bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 921 time: 2.2906816 May 12 15:24:03.712794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd452c44-948d-48e4-8be0-d54a56e035ed req-d5b3a7e0-73bc-48ee-95e5-1923846ceeec tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:03.713284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38180) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:03.720377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd452c44-948d-48e4-8be0-d54a56e035ed req-d5b3a7e0-73bc-48ee-95e5-1923846ceeec tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.2345433 May 12 15:24:03.728088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a7312651-aec6-4017-8614-fa6647116e3c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Request body: {'router': {'name': 'tempest-TagsExtTest-router-92245931', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:03.744654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Router 78d4ada5-c100-4849-8e75-44ba389f27d8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:24:03.749239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a7312651-aec6-4017-8614-fa6647116e3c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:03.763944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a7312651-aec6-4017-8614-fa6647116e3c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Usage tracker for resource:router and tenant:6b5a1b17b82943a8bf198305bcf7aea6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:03.770237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a7312651-aec6-4017-8614-fa6647116e3c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:03.783258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b92515-4b7c-4381-9b30-f5ee35ecdcfa req-a873c86c-dd1f-4312-81b4-829f0c07b444 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:03.785052 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6b92515-4b7c-4381-9b30-f5ee35ecdcfa req-a873c86c-dd1f-4312-81b4-829f0c07b444 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 946 time: 0.3836524 May 12 15:24:03.789985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2018d569-c136-41aa-ae31-fd5da056ec10 req-3ea20306-67b7-4cf9-a326-925e4cb27f3e tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:03.790968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-2018d569-c136-41aa-ae31-fd5da056ec10 req-3ea20306-67b7-4cf9-a326-925e4cb27f3e tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Synchronizing usage tracker for tenant:9e2382be0c6f4779ae64026a57628773 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:24:03.802572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a7312651-aec6-4017-8614-fa6647116e3c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:03.809195 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:03.824743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-2018d569-c136-41aa-ae31-fd5da056ec10 req-3ea20306-67b7-4cf9-a326-925e4cb27f3e tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Unset dirty status for tenant:9e2382be0c6f4779ae64026a57628773 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:24:03.826452 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2018d569-c136-41aa-ae31-fd5da056ec10 req-3ea20306-67b7-4cf9-a326-925e4cb27f3e tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 946 time: 0.7325287 May 12 15:24:03.831028 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7312651-aec6-4017-8614-fa6647116e3c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:03.832028 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7312651-aec6-4017-8614-fa6647116e3c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:03.868077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-a6b92515-4b7c-4381-9b30-f5ee35ecdcfa req-2dd62513-72c7-41a0-9734-62b83619f891 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'port': {'security_groups': ['b0aae945-e0f0-419f-88b0-e0606e730ccb', 'd07e6569-0a4a-44ce-88a8-cf53c16de2ab']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:03.897701 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd452c44-948d-48e4-8be0-d54a56e035ed req-cfd8faca-4c82-44cc-86bb-34a3cb735826 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/security-groups?id=9f046542-1c6c-4513-9f2d-68191e399ef1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1759539 May 12 15:24:03.913902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7312651-aec6-4017-8614-fa6647116e3c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:03.941718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-2018d569-c136-41aa-ae31-fd5da056ec10 req-54bd7b01-1e35-4fa3-8319-306a37ee9c7f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Deleting port eaeeccb2-8af7-4344-866b-7226dbc22776 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:24:03.942064 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2018d569-c136-41aa-ae31-fd5da056ec10 req-54bd7b01-1e35-4fa3-8319-306a37ee9c7f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:04.028916 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:04.166084 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7312651-aec6-4017-8614-fa6647116e3c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:04.207999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:24:04.212420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:24:04.221332 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1963a9d4-0466-4c51-a7f6-5cca129a65b0 None None] Sync routers for ids ['78d4ada5-c100-4849-8e75-44ba389f27d8'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:24:04.233275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:04.238654 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1963a9d4-0466-4c51-a7f6-5cca129a65b0 None None] Routers {'78d4ada5-c100-4849-8e75-44ba389f27d8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:24:04.239281 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1963a9d4-0466-4c51-a7f6-5cca129a65b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:23:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['78d4ada5-c100-4849-8e75-44ba389f27d8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:04.280375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Pushing event updated for resources: {'Port': ['ID=c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:04.283325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:24:04.334853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-302f36e2-253f-4f9c-a794-0cedb5a93baf None None] Network d1a135b1-316c-47d6-9c50-16438ea53de8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:24:04.341478 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7312651-aec6-4017-8614-fa6647116e3c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:04.342893 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a7312651-aec6-4017-8614-fa6647116e3c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 698 time: 0.6280725 May 12 15:24:04.355164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38196) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:04.400047 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a6b92515-4b7c-4381-9b30-f5ee35ecdcfa req-2dd62513-72c7-41a0-9734-62b83619f891 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:04.439823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8cfebf5e-8363-4a51-9cf2-76210d169557 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Request body: {'subnetpool': {'name': 'tempest-TagsExtTest-Subnetpool-2039867307', 'prefixes': ['172.20.0.0/16']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:04.472921 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:04.473627 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:04.528251 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-1963a9d4-0466-4c51-a7f6-5cca129a65b0 None None] Set router 78d4ada5-c100-4849-8e75-44ba389f27d8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:24:04.534103 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-c0593d24-8e52-4832-8ae1-2d2cb41cf364 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.4373152 May 12 15:24:04.548201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Request body: {'port': {'device_id': '914409b3-8c2c-4574-af4a-2eb14f6d1ad9', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:04.572220 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6bf0e797-5be1-43ee-aa52-684238e5b97e None None] Provisioning for port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:24:04.580304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8cfebf5e-8363-4a51-9cf2-76210d169557 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:04.592789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] No DVR routers for this DVR port 4a88f583-55ea-4849-8a87-dbc693ed07d0 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:24:04.605707 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:04.620454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2018d569-c136-41aa-ae31-fd5da056ec10 req-54bd7b01-1e35-4fa3-8319-306a37ee9c7f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] For port eaeeccb2-8af7-4344-866b-7226dbc22776, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=eaeeccb2-8af7-4344-866b-7226dbc22776,segment=NetworkSegment(ccba5697-f062-48f7-986e-3317afc51896),segment_id=ccba5697-f062-48f7-986e-3317afc51896)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:04.620858 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2018d569-c136-41aa-ae31-fd5da056ec10 req-54bd7b01-1e35-4fa3-8319-306a37ee9c7f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:04.621782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'name': 'network-vif-deleted', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:24:04.627642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b28410c3-7f46-47fe-8f68-1ccdde9dab75 req-bda44e81-bc0b-4abf-8621-046d98b11e3d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.76 "DELETE /v2.0/ports/4a88f583-55ea-4849-8a87-dbc693ed07d0 HTTP/1.1" status: 204 len: 173 time: 3.7380772 May 12 15:24:04.759966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdf17c01-0450-4159-8614-d2285adc3c9b req-3b29790c-961c-49e7-8dde-3d7a2c68cee9 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:04.765823 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdf17c01-0450-4159-8614-d2285adc3c9b req-3b29790c-961c-49e7-8dde-3d7a2c68cee9 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.7142732 May 12 15:24:04.787474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-2018d569-c136-41aa-ae31-fd5da056ec10 req-54bd7b01-1e35-4fa3-8319-306a37ee9c7f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Calling delete_port for eaeeccb2-8af7-4344-866b-7226dbc22776 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:24:04.926175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4a88f583-55ea-4849-8a87-dbc693ed07d0 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:24:04.936060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdf17c01-0450-4159-8614-d2285adc3c9b req-e8e4e3b0-7cc9-4ab6-acfd-ba466e6f1beb tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1521988 May 12 15:24:04.966046 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:05.046950 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1963a9d4-0466-4c51-a7f6-5cca129a65b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:43Z', 'revision_number': 5, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:05.052672 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1963a9d4-0466-4c51-a7f6-5cca129a65b0 None None] Checking router: 78d4ada5-c100-4849-8e75-44ba389f27d8 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:24:05.066261 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1963a9d4-0466-4c51-a7f6-5cca129a65b0 None None] Routers {'78d4ada5-c100-4849-8e75-44ba389f27d8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:24:05.069249 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1963a9d4-0466-4c51-a7f6-5cca129a65b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:23:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['78d4ada5-c100-4849-8e75-44ba389f27d8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:05.079355 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 4a88f583-55ea-4849-8a87-dbc693ed07d0 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:24:05.079623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4a88f583-55ea-4849-8a87-dbc693ed07d0 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:24:05.097893 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8cfebf5e-8363-4a51-9cf2-76210d169557 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks [] for subnetpool, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:05.115110 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8cfebf5e-8363-4a51-9cf2-76210d169557 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 748 time: 0.7423222 May 12 15:24:05.122889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38208) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:05.132268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-732e47fa-a4dd-44e1-a8aa-d31cfdfb7846 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', '241c4d7c-a9c4-4133-9c16-acfdba71a6da', 'tempest-TagsExtTest-Tag-770602701') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:05.200164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:24:05.396008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:24:05.406452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b34d71e1-802c-441f-b361-3727940e7ac0 None None] Provisioning for port e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:24:05.425337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:05.425904 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:05.453126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5ed7451a-58b2-46e9-b0f3-bd6d6c804ae6 req-53366d07-ad8f-4472-9fd1-b40ba1f447cc tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Synchronizing usage tracker for tenant:40852c97262142aeb6d62097955af83f on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:24:05.521995 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-1963a9d4-0466-4c51-a7f6-5cca129a65b0 None None] Set router 78d4ada5-c100-4849-8e75-44ba389f27d8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:24:05.567684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5ed7451a-58b2-46e9-b0f3-bd6d6c804ae6 req-53366d07-ad8f-4472-9fd1-b40ba1f447cc tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Unset dirty status for tenant:40852c97262142aeb6d62097955af83f on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:24:05.590594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ed7451a-58b2-46e9-b0f3-bd6d6c804ae6 req-53366d07-ad8f-4472-9fd1-b40ba1f447cc tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=17f9211c-f8ad-44dd-bb38-efaa81c9494b HTTP/1.1" status: 200 len: 210 time: 0.1972506 May 12 15:24:05.684757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b34d71e1-802c-441f-b361-3727940e7ac0 None None] Provisioning complete for port e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:05.685893 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b34d71e1-802c-441f-b361-3727940e7ac0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:05.785461 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b34d71e1-802c-441f-b361-3727940e7ac0 None None] Port e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:24:05.827159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-a6b92515-4b7c-4381-9b30-f5ee35ecdcfa req-2dd62513-72c7-41a0-9734-62b83619f891 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] For port a306c21a-a934-4a55-8955-3ede562c61c1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a306c21a-a934-4a55-8955-3ede562c61c1,segment=NetworkSegment(2b9a3118-674a-42bd-be1d-3a0efcec85f0),segment_id=2b9a3118-674a-42bd-be1d-3a0efcec85f0)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:05.872406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:24:05.881875 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:05.891304 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a6b92515-4b7c-4381-9b30-f5ee35ecdcfa req-2dd62513-72c7-41a0-9734-62b83619f891 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:05.903604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Transition to ACTIVE for port object c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:05.906844 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a6b92515-4b7c-4381-9b30-f5ee35ecdcfa req-2dd62513-72c7-41a0-9734-62b83619f891 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:05.919389 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:05.947241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3665052f-787a-44a4-bee0-3335df3f44a6', 'a306c21a-a934-4a55-8955-3ede562c61c1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:24:06.009718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Pushing event updated for resources: {'Port': ['ID=c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:06.065830 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:06.074547 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1963a9d4-0466-4c51-a7f6-5cca129a65b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:43Z', 'revision_number': 5, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:06.081509 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b92515-4b7c-4381-9b30-f5ee35ecdcfa req-2dd62513-72c7-41a0-9734-62b83619f891 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:06.082163 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-a6b92515-4b7c-4381-9b30-f5ee35ecdcfa req-2dd62513-72c7-41a0-9734-62b83619f891 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:06.097840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1a138d74-f355-4c6e-9ede-5a7b46b96264 None None] Provisioning complete for port e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:06.098398 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1a138d74-f355-4c6e-9ede-5a7b46b96264 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:06.103962 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1963a9d4-0466-4c51-a7f6-5cca129a65b0 None None] The sync data for ids ['78d4ada5-c100-4849-8e75-44ba389f27d8'] in n-d-841483-1 is: [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:43Z', 'revision_number': 5, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:24:06.105779 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6b92515-4b7c-4381-9b30-f5ee35ecdcfa req-2dd62513-72c7-41a0-9734-62b83619f891 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "PUT /v2.0/ports/a306c21a-a934-4a55-8955-3ede562c61c1 HTTP/1.1" status: 200 len: 982 time: 2.2522945 May 12 15:24:06.192867 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1a138d74-f355-4c6e-9ede-5a7b46b96264 None None] Port e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:24:06.214422 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-89305570-837f-4dbe-b912-815470f4ef8b'] response: {'server_uuid': '17f9211c-f8ad-44dd-bb38-efaa81c9494b', 'name': 'network-vif-deleted', 'tag': '4a88f583-55ea-4849-8a87-dbc693ed07d0', 'status': 'completed', 'code': 200} May 12 15:24:06.234612 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2018d569-c136-41aa-ae31-fd5da056ec10 req-54bd7b01-1e35-4fa3-8319-306a37ee9c7f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:06.246650 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-732e47fa-a4dd-44e1-a8aa-d31cfdfb7846 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "PUT /v2.0/subnets/241c4d7c-a9c4-4133-9c16-acfdba71a6da/tags/tempest-TagsExtTest-Tag-770602701 HTTP/1.1" status: 201 len: 201 time: 1.1224148 May 12 15:24:06.252149 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38220) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:06.262344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-87a58ab6-68be-4972-9e0c-dcf07b5070c1 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', 'e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9', 'tempest-TagsExtTest-Tag-587047537') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:06.285178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c,segment=NetworkSegment(e5d8a6a0-c3d7-4731-af72-b087ae1cd96c),segment_id=e5d8a6a0-c3d7-4731-af72-b087ae1cd96c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:06.311684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a306c21a-a934-4a55-8955-3ede562c61c1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:24:06.355759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dd62513-72c7-41a0-9734-62b83619f891 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'Port': ['ID=a306c21a-a934-4a55-8955-3ede562c61c1,revision_number=6']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:06.473339 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:06.523554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f8e587fb-8f2f-4eeb-b6a3-e6264f701f36 req-d0654a4d-8e86-4120-85b3-5defd5b3aee0 tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.82 "GET /v2.0/ports?device_id=1b949ed9-fdac-46f6-8db0-a707458b85d2 HTTP/1.1" status: 200 len: 210 time: 0.1355791 May 12 15:24:06.565288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e0cdce-ec62-4e96-b920-a8d5696439fb req-52a81ce6-93b7-4707-8b93-e65237d314d5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:06.574532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7e0cdce-ec62-4e96-b920-a8d5696439fb req-52a81ce6-93b7-4707-8b93-e65237d314d5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=914409b3-8c2c-4574-af4a-2eb14f6d1ad9 HTTP/1.1" status: 200 len: 944 time: 0.4414797 May 12 15:24:06.695873 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7e0cdce-ec62-4e96-b920-a8d5696439fb req-35c80ca0-01fd-47f9-a2dc-99a4604c3ec0 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1109908 May 12 15:24:06.705470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-87a58ab6-68be-4972-9e0c-dcf07b5070c1 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "PUT /v2.0/ports/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9/tags/tempest-TagsExtTest-Tag-587047537 HTTP/1.1" status: 201 len: 201 time: 0.4475121 May 12 15:24:06.707539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38228) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:06.740358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-475a4128-2682-4a1f-a047-d0e3b652f05d tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', 'af7c8895-ebb8-47f1-9ffe-cb44562572ed', 'tempest-TagsExtTest-Tag-295265291') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:06.785425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48976098-505d-4d9f-a39d-a87521801334 None None] New status for floating IP 4ee874b2-35ce-4deb-960e-3fee8a1cd250: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:24:06.787816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54bd7b01-1e35-4fa3-8319-306a37ee9c7f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Pushing event deleted for resources: {'Port': ['ID=eaeeccb2-8af7-4344-866b-7226dbc22776,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:06.835754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-2018d569-c136-41aa-ae31-fd5da056ec10 req-54bd7b01-1e35-4fa3-8319-306a37ee9c7f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] No DVR routers for this DVR port eaeeccb2-8af7-4344-866b-7226dbc22776 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:24:06.840956 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2018d569-c136-41aa-ae31-fd5da056ec10 req-54bd7b01-1e35-4fa3-8319-306a37ee9c7f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:06.844045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1b949ed9-fdac-46f6-8db0-a707458b85d2', 'name': 'network-vif-deleted', 'tag': 'eaeeccb2-8af7-4344-866b-7226dbc22776'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:24:06.891987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Attempting to bind port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:24:06.892366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Attempting to bind port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:24:06.892691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Attempting to bind port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:24:06.895803 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2018d569-c136-41aa-ae31-fd5da056ec10 req-54bd7b01-1e35-4fa3-8319-306a37ee9c7f tempest-ServerRescueTestJSON-1267192115 tempest-ServerRescueTestJSON-1267192115-project] 10.222.0.76 "DELETE /v2.0/ports/eaeeccb2-8af7-4344-866b-7226dbc22776 HTTP/1.1" status: 204 len: 173 time: 3.0583229 May 12 15:24:06.899248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:24:06.899608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Attempting to bind port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:24:06.907255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 24, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:24:06.907600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Checking segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:24:06.908181 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Bound using segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:24:06.908410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Bound port: c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:24:06.908756 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:07.043645 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a07b1785-1bc0-4b8b-a527-85dfc0c506ce req-06479407-0db4-4343-9fb7-4056a10c18e7 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/d07e6569-0a4a-44ce-88a8-cf53c16de2ab HTTP/1.1" status: 200 len: 1801 time: 0.2411954 May 12 15:24:07.045690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device eaeeccb2-8af7-4344-866b-7226dbc22776 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:24:07.062636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] For port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:24:07.066022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] For port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:24:07.068897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:07.077788 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:07.108070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: eaeeccb2-8af7-4344-866b-7226dbc22776 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:24:07.108401 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device eaeeccb2-8af7-4344-866b-7226dbc22776 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:24:07.115322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c4eb5b-470a-4902-94cd-65c10784e61b req-0b575cf1-b6e5-478d-9fa3-5026123fc942 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:07.117191 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5c4eb5b-470a-4902-94cd-65c10784e61b req-0b575cf1-b6e5-478d-9fa3-5026123fc942 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.3074818 May 12 15:24:07.138192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-475a4128-2682-4a1f-a047-d0e3b652f05d tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "PUT /v2.0/routers/af7c8895-ebb8-47f1-9ffe-cb44562572ed/tags/tempest-TagsExtTest-Tag-295265291 HTTP/1.1" status: 201 len: 201 time: 0.4283481 May 12 15:24:07.145978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38236) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:07.166532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-64a6093f-cfd7-4f4d-a012-46f9763c46dd tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', '58df5eba-028d-45d6-9170-fc3541e3bc02', 'tempest-TagsExtTest-Tag-562899712') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:07.180772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:07.181275 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-a07b1785-1bc0-4b8b-a527-85dfc0c506ce req-f1f896b9-fe66-41ff-8ad0-f9aa99dfc7d1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] delete failed (client error): There was a conflict when trying to complete your request. May 12 15:24:07.181435 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:07.182360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a07b1785-1bc0-4b8b-a527-85dfc0c506ce req-f1f896b9-fe66-41ff-8ad0-f9aa99dfc7d1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "DELETE /v2.0/security-groups/d07e6569-0a4a-44ce-88a8-cf53c16de2ab HTTP/1.1" status: 409 len: 341 time: 0.1260605 May 12 15:24:07.182684 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] 10.222.0.76 "PUT /v2.0/ports/c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 HTTP/1.1" status: 200 len: 1092 time: 2.6409652 May 12 15:24:07.205146 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5c4eb5b-470a-4902-94cd-65c10784e61b req-04d6f907-ab87-431b-9540-6605eb924929 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732853 May 12 15:24:07.230827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae9275ec-6495-4b92-8608-f9117a718afe service neutron] Pushing event updated for resources: {'Port': ['ID=c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:07.246149 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-64a6093f-cfd7-4f4d-a012-46f9763c46dd tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "PUT /v2.0/subnetpools/58df5eba-028d-45d6-9170-fc3541e3bc02/tags/tempest-TagsExtTest-Tag-562899712 HTTP/1.1" status: 201 len: 201 time: 0.0992236 May 12 15:24:07.249747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38242) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:07.256877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-20119b90-8612-4c3c-bb79-9a1927b9dca8 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', '241c4d7c-a9c4-4133-9c16-acfdba71a6da') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:07.383017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-b355f723-b2b6-44ef-aec9-2bf4c6755853 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:07.384961 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-b355f723-b2b6-44ef-aec9-2bf4c6755853 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=914409b3-8c2c-4574-af4a-2eb14f6d1ad9 HTTP/1.1" status: 200 len: 1095 time: 0.1225321 May 12 15:24:07.390797 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-cc4c0c93-5e18-4ec4-b341-7037133e4e57'] response: {'server_uuid': '1b949ed9-fdac-46f6-8db0-a707458b85d2', 'name': 'network-vif-deleted', 'tag': 'eaeeccb2-8af7-4344-866b-7226dbc22776', 'status': 'completed', 'code': 200} May 12 15:24:07.401575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-20119b90-8612-4c3c-bb79-9a1927b9dca8 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/subnets/241c4d7c-a9c4-4133-9c16-acfdba71a6da/tags HTTP/1.1" status: 200 len: 240 time: 0.1499979 May 12 15:24:07.403415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38252) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:07.409528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-5b9f7609-0780-44ea-a448-26bc65df3141 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '241c4d7c-a9c4-4133-9c16-acfdba71a6da', 'tempest-TagsExtTest-Tag-770602701') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:07.556272 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-ec263b7a-373e-4d5b-b80d-db86168b5cc1 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 HTTP/1.1" status: 200 len: 217 time: 0.1593544 May 12 15:24:07.595808 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5b9f7609-0780-44ea-a448-26bc65df3141 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/subnets/241c4d7c-a9c4-4133-9c16-acfdba71a6da/tags/tempest-TagsExtTest-Tag-770602701 HTTP/1.1" status: 204 len: 168 time: 0.1911736 May 12 15:24:07.602525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38260) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:07.611378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38262) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:07.625976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-ad2d42a2-b207-4178-8fa6-1c9d212121bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnets', '241c4d7c-a9c4-4133-9c16-acfdba71a6da', 'tempest-TagsExtTest-Tag-770602701') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:07.651948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-cc946727-1eb5-401c-8512-81ae2f15d242 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:07.653409 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-cc946727-1eb5-401c-8512-81ae2f15d242 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.0905664 May 12 15:24:07.761959 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-0a07303a-ccf8-419b-ab72-3ae4d549f05f service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1024854 May 12 15:24:07.850138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38276) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:07.978600 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-a9a3d7c5-0d3e-464e-bcd6-bc6b5f0daa8d service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2104397 May 12 15:24:08.058333 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33583cb8-5720-4600-87f5-9390010cbc99 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:08.072484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afc07cb9-d439-41c4-b495-c2cad099edaa req-bc9ad55c-aa8b-4837-bf78-c3e7473a32a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:08.074218 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afc07cb9-d439-41c4-b495-c2cad099edaa req-bc9ad55c-aa8b-4837-bf78-c3e7473a32a9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=86574e26b5194d1f92a51749f063fa69&device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 1136 time: 0.1858923 May 12 15:24:08.136138 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33583cb8-5720-4600-87f5-9390010cbc99 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:08.254371 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a606ab4c-1abf-44de-8993-6a84e0564532 req-26b8ed0f-9685-41bb-8e72-64e628a7b6af service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2647824 May 12 15:24:08.278495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afc07cb9-d439-41c4-b495-c2cad099edaa req-eb64cd71-f64c-4a62-930b-bfa525cedbff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:08.280306 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afc07cb9-d439-41c4-b495-c2cad099edaa req-eb64cd71-f64c-4a62-930b-bfa525cedbff service neutron] 10.222.0.84 "GET /v2.0/networks?id=b50584ea-1073-48d4-a2bc-43b11374a495 HTTP/1.1" status: 200 len: 914 time: 0.1924517 May 12 15:24:08.349190 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'caefe380-1876-4938-83a7-078804c994b7', 'tag': 'a306c21a-a934-4a55-8955-3ede562c61c1'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:24:08.369644 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afc07cb9-d439-41c4-b495-c2cad099edaa req-c9685871-8f30-40f9-8555-54249e393b2a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a306c21a-a934-4a55-8955-3ede562c61c1 HTTP/1.1" status: 200 len: 217 time: 0.0730608 May 12 15:24:08.439569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afc07cb9-d439-41c4-b495-c2cad099edaa req-78375a01-979d-4ad5-abef-5159b7b1dae2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:08.441009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d7ee46-342e-4c53-9873-8b415fb989db req-f38a3d66-db48-40e7-9db4-ba0275989ce8 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:08.441164 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afc07cb9-d439-41c4-b495-c2cad099edaa req-78375a01-979d-4ad5-abef-5159b7b1dae2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=92a8d5fe-fb2b-414d-9ae2-15fb02337cd9 HTTP/1.1" status: 200 len: 853 time: 0.0654504 May 12 15:24:08.442743 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09d7ee46-342e-4c53-9873-8b415fb989db req-f38a3d66-db48-40e7-9db4-ba0275989ce8 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.6534362 May 12 15:24:08.466779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24a22b0a-2d6c-457a-a586-8b7ac1913567 req-c9867f1a-7e44-4865-ae35-7bb867054755 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:08.468325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24a22b0a-2d6c-457a-a586-8b7ac1913567 req-c9867f1a-7e44-4865-ae35-7bb867054755 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 985 time: 0.5135539 May 12 15:24:08.495521 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afc07cb9-d439-41c4-b495-c2cad099edaa req-a08b5497-1b93-4486-90ff-df0d28697a62 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b50584ea-1073-48d4-a2bc-43b11374a495&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0479605 May 12 15:24:08.636471 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afc07cb9-d439-41c4-b495-c2cad099edaa req-7cedf1fe-e7c1-48fc-944b-fba26c223c43 service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1351056 May 12 15:24:08.673790 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ad2d42a2-b207-4178-8fa6-1c9d212121bf tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/subnets/241c4d7c-a9c4-4133-9c16-acfdba71a6da/tags/tempest-TagsExtTest-Tag-770602701 HTTP/1.1" status: 204 len: 168 time: 1.0701251 May 12 15:24:08.674461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38302) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:08.693078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-c0779611-8806-498d-9626-73b491d69606 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', '241c4d7c-a9c4-4133-9c16-acfdba71a6da') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:08.771373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24a22b0a-2d6c-457a-a586-8b7ac1913567 req-e846d727-a05a-4167-bf01-431b658968f2 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&id=d07e6569-0a4a-44ce-88a8-cf53c16de2ab&fields=id&fields=name HTTP/1.1" status: 200 len: 401 time: 0.1531732 May 12 15:24:08.772048 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33583cb8-5720-4600-87f5-9390010cbc99 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:08.798270 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afc07cb9-d439-41c4-b495-c2cad099edaa req-146beb89-9141-4b87-bbdc-f031a3127441 service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1500297 May 12 15:24:08.836840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33583cb8-5720-4600-87f5-9390010cbc99 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=113e667d-ea29-4a75-8d4e-1be835a567e4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:08.851984 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09d7ee46-342e-4c53-9873-8b415fb989db req-7e6dc3e7-e72f-4820-ad16-edac0bfc3206 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4017487 May 12 15:24:08.960817 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c5dcd48c-ba84-4a72-af6e-fd2a9cde86ce'] response: {'name': 'network-changed', 'server_uuid': 'caefe380-1876-4938-83a7-078804c994b7', 'tag': 'a306c21a-a934-4a55-8955-3ede562c61c1', 'status': 'completed', 'code': 200} May 12 15:24:08.966339 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33583cb8-5720-4600-87f5-9390010cbc99 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:08.969853 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-33583cb8-5720-4600-87f5-9390010cbc99 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "DELETE /v2.0/security-groups/113e667d-ea29-4a75-8d4e-1be835a567e4 HTTP/1.1" status: 204 len: 168 time: 1.3549032 May 12 15:24:08.971018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38308) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:09.128318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c0779611-8806-498d-9626-73b491d69606 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/subnets/241c4d7c-a9c4-4133-9c16-acfdba71a6da/tags HTTP/1.1" status: 200 len: 205 time: 0.4427741 May 12 15:24:09.130803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:24:09.149377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38312) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:09.158515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-170ee991-6e6e-4dbb-8811-0e97b54859e0 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', 'e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:09.263695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:09.264108 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:09.274888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-283a1b42-f87a-4c5c-9db3-9a3758c8f834 req-e06d803a-d828-491e-8083-68f8a3587832 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:09.284014 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-283a1b42-f87a-4c5c-9db3-9a3758c8f834 req-e06d803a-d828-491e-8083-68f8a3587832 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=914409b3-8c2c-4574-af4a-2eb14f6d1ad9 HTTP/1.1" status: 200 len: 944 time: 0.3811157 May 12 15:24:09.459870 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-88a94a67-c8ed-41cd-a4b5-93fdefa6f334 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] show failed (client error): The resource could not be found. May 12 15:24:09.464635 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-88a94a67-c8ed-41cd-a4b5-93fdefa6f334 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups/113e667d-ea29-4a75-8d4e-1be835a567e4 HTTP/1.1" status: 404 len: 347 time: 0.4913836 May 12 15:24:09.464635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '914409b3-8c2c-4574-af4a-2eb14f6d1ad9', 'tag': 'c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:24:09.475622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38318) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:09.492223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-283a1b42-f87a-4c5c-9db3-9a3758c8f834 req-ca96e566-28f7-4279-92f7-4b2b0a2e58dc tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2066534 May 12 15:24:09.520985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-170ee991-6e6e-4dbb-8811-0e97b54859e0 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/ports/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9/tags HTTP/1.1" status: 200 len: 240 time: 0.3691933 May 12 15:24:09.524998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38324) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:09.537214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-94a5d79b-71b4-42b1-81a4-4c2b22735664 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9', 'tempest-TagsExtTest-Tag-587047537') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:09.587764 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4405d670-4d8c-4b56-b96c-c1fe70920957'] response: {'name': 'network-changed', 'server_uuid': '914409b3-8c2c-4574-af4a-2eb14f6d1ad9', 'tag': 'c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735', 'status': 'completed', 'code': 200} May 12 15:24:09.611703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbd24b15-9f3c-415c-90f0-36f115c610cd req-7976bda1-5012-49cf-b628-a1f92b8cf00d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:09.613206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bbd24b15-9f3c-415c-90f0-36f115c610cd req-7976bda1-5012-49cf-b628-a1f92b8cf00d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.3478160 May 12 15:24:09.618275 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46c28701-7427-4475-91ed-465740ccebaa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:09.755368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-bb8d33e3-88d6-491a-94ee-a8c5c330bb08 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Deleting port 99d5efe6-ef16-4f7b-88da-a85db84c1ce7 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:24:09.755602 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb8d33e3-88d6-491a-94ee-a8c5c330bb08 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:09.812033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bbd24b15-9f3c-415c-90f0-36f115c610cd req-581e44c9-b335-462d-9e55-96dd76a83fef tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1356328 May 12 15:24:09.823781 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-94a5d79b-71b4-42b1-81a4-4c2b22735664 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/ports/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9/tags/tempest-TagsExtTest-Tag-587047537 HTTP/1.1" status: 204 len: 168 time: 0.2975702 May 12 15:24:09.827209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38330) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:09.841048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-60257f0b-5b9b-4ce0-9485-dfacfbbf1b41 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'ports', 'e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9', 'tempest-TagsExtTest-Tag-587047537') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:09.962832 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-426e5774-e956-4ff3-8a75-01948d003fc6 req-1ef62481-c7e9-486f-b00b-e107ed5f8b3b service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.5778215 May 12 15:24:09.968972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80def4f9-6f3e-46c4-8c14-00acbfdba2af req-d67b5e95-0a51-4e57-8186-6b8818ce94cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:09.970358 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-80def4f9-6f3e-46c4-8c14-00acbfdba2af req-d67b5e95-0a51-4e57-8186-6b8818ce94cb service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=86574e26b5194d1f92a51749f063fa69&device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 1136 time: 0.9550419 May 12 15:24:09.997202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-125afe3a-b7d0-420d-9a52-a645c827b4b0 req-4324058f-b935-467c-ba1b-78370b6a918a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:09.999489 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-125afe3a-b7d0-420d-9a52-a645c827b4b0 req-4324058f-b935-467c-ba1b-78370b6a918a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=914409b3-8c2c-4574-af4a-2eb14f6d1ad9 HTTP/1.1" status: 200 len: 1095 time: 0.3186274 May 12 15:24:10.176380 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-60257f0b-5b9b-4ce0-9485-dfacfbbf1b41 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/ports/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9/tags/tempest-TagsExtTest-Tag-587047537 HTTP/1.1" status: 204 len: 168 time: 0.3480184 May 12 15:24:10.180027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38340) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:10.191122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57345725-3410-4459-8bef-6373722c8aa2 req-411081d0-f625-4dfe-bf99-0d107d1d4861 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:10.192555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57345725-3410-4459-8bef-6373722c8aa2 req-411081d0-f625-4dfe-bf99-0d107d1d4861 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 985 time: 0.2413390 May 12 15:24:10.200040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-4fd10f6e-f9ae-44f0-8d72-10cb107bf80e tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', 'e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:10.213105 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb8d33e3-88d6-491a-94ee-a8c5c330bb08 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:10.213449 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb8d33e3-88d6-491a-94ee-a8c5c330bb08 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:10.243467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f443881-215e-48f0-8b86-9f0dd6425d3a req-0fe936b9-733a-4bee-83e1-adc715bd03fc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:10.244919 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f443881-215e-48f0-8b86-9f0dd6425d3a req-0fe936b9-733a-4bee-83e1-adc715bd03fc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2553566 May 12 15:24:10.359426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-bb8d33e3-88d6-491a-94ee-a8c5c330bb08 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Calling delete_port for 99d5efe6-ef16-4f7b-88da-a85db84c1ce7 owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:24:10.399009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57345725-3410-4459-8bef-6373722c8aa2 req-6e90636e-506c-4a2d-af80-c007f25a6968 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=b0aae945-e0f0-419f-88b0-e0606e730ccb&id=d07e6569-0a4a-44ce-88a8-cf53c16de2ab&fields=id&fields=name HTTP/1.1" status: 200 len: 401 time: 0.1692865 May 12 15:24:10.399652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-46c28701-7427-4475-91ed-465740ccebaa admin admin] Deleting port 26754046-3c27-423b-a836-8c5b0f061d5a {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:24:10.399988 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46c28701-7427-4475-91ed-465740ccebaa admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:10.525469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80def4f9-6f3e-46c4-8c14-00acbfdba2af req-8c0aca94-8d34-4d36-b23f-89dac675a81f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:10.533733 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-80def4f9-6f3e-46c4-8c14-00acbfdba2af req-8c0aca94-8d34-4d36-b23f-89dac675a81f service neutron] 10.222.0.84 "GET /v2.0/networks?id=b50584ea-1073-48d4-a2bc-43b11374a495 HTTP/1.1" status: 200 len: 914 time: 0.5250673 May 12 15:24:10.545955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-125afe3a-b7d0-420d-9a52-a645c827b4b0 req-cf4d134f-a14c-4303-87f9-a884a387b3a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:10.547370 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-125afe3a-b7d0-420d-9a52-a645c827b4b0 req-cf4d134f-a14c-4303-87f9-a884a387b3a6 service neutron] 10.222.0.76 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 913 time: 0.5256701 May 12 15:24:10.609587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f443881-215e-48f0-8b86-9f0dd6425d3a req-094d5716-e51a-455f-b006-db2b014e9bff tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3427615 May 12 15:24:10.663790 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4fd10f6e-f9ae-44f0-8d72-10cb107bf80e tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/ports/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9/tags HTTP/1.1" status: 200 len: 205 time: 0.4814594 May 12 15:24:10.667894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38364) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:10.690939 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-80def4f9-6f3e-46c4-8c14-00acbfdba2af req-f89d408f-b4d0-4213-8633-7d1b7ef50785 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a306c21a-a934-4a55-8955-3ede562c61c1 HTTP/1.1" status: 200 len: 217 time: 0.1557138 May 12 15:24:10.692724 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-125afe3a-b7d0-420d-9a52-a645c827b4b0 req-cb466014-82f8-4175-b4f3-dbd506331743 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 HTTP/1.1" status: 200 len: 217 time: 0.0825789 May 12 15:24:10.725006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-0594a31f-2fe6-4fac-bec0-2f29da3ef9ed tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', 'af7c8895-ebb8-47f1-9ffe-cb44562572ed') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:10.729469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426e5774-e956-4ff3-8a75-01948d003fc6 req-69d1bb86-a08d-4196-9890-2c7cbb805980 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:10.730945 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-426e5774-e956-4ff3-8a75-01948d003fc6 req-69d1bb86-a08d-4196-9890-2c7cbb805980 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 1095 time: 0.6246397 May 12 15:24:10.955399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:24:11.017828 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e2930f9-e86f-4648-bf3b-0e78bfc85dfb req-8f9a93ce-3e0e-42f9-826f-eb65741c9431 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-SecurityGroupsTestJSON-securitygroup-1365988305&fields=id&tenant_id=86574e26b5194d1f92a51749f063fa69 HTTP/1.1" status: 200 len: 267 time: 0.2310681 May 12 15:24:11.096394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80def4f9-6f3e-46c4-8c14-00acbfdba2af req-b2aa9e64-e46a-4670-ac94-29072529065b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:11.097844 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-80def4f9-6f3e-46c4-8c14-00acbfdba2af req-b2aa9e64-e46a-4670-ac94-29072529065b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=92a8d5fe-fb2b-414d-9ae2-15fb02337cd9 HTTP/1.1" status: 200 len: 853 time: 0.4009185 May 12 15:24:11.102305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-125afe3a-b7d0-420d-9a52-a645c827b4b0 req-11586fc3-957c-4f16-a636-1b02d2bc0b20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:11.103645 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-125afe3a-b7d0-420d-9a52-a645c827b4b0 req-11586fc3-957c-4f16-a636-1b02d2bc0b20 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.3709834 May 12 15:24:11.107737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-46c28701-7427-4475-91ed-465740ccebaa admin admin] For port 26754046-3c27-423b-a836-8c5b0f061d5a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=26754046-3c27-423b-a836-8c5b0f061d5a,segment=NetworkSegment(ccba5697-f062-48f7-986e-3317afc51896),segment_id=ccba5697-f062-48f7-986e-3317afc51896)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:11.108755 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46c28701-7427-4475-91ed-465740ccebaa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:11.190498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:11.200377 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb8d33e3-88d6-491a-94ee-a8c5c330bb08 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:11.202376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0594a31f-2fe6-4fac-bec0-2f29da3ef9ed tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/routers/af7c8895-ebb8-47f1-9ffe-cb44562572ed/tags HTTP/1.1" status: 200 len: 240 time: 0.5327408 May 12 15:24:11.206857 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-125afe3a-b7d0-420d-9a52-a645c827b4b0 req-8a11b43a-df48-409f-81bb-5ef2712d0019 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0956643 May 12 15:24:11.210058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38372) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:11.229302 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'port_id': 'c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735', 'mac_address': 'fa:16:3e:ff:f2:6c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 573, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0ff5192a-946b-4444-900a-788b8ddc74b6', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:24:11.243731 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-80def4f9-6f3e-46c4-8c14-00acbfdba2af req-f36908b9-ba68-44a4-a0e1-074e147edca5 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b50584ea-1073-48d4-a2bc-43b11374a495&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1336889 May 12 15:24:11.273062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c96259a0-cc19-47d0-a919-56fdff68c7e2 req-0144b416-4815-4947-88ce-3644db357607 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:11.280480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c96259a0-cc19-47d0-a919-56fdff68c7e2 req-0144b416-4815-4947-88ce-3644db357607 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=914409b3-8c2c-4574-af4a-2eb14f6d1ad9 HTTP/1.1" status: 200 len: 944 time: 0.4453592 May 12 15:24:11.293615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-cef86096-05b4-4aa0-bb05-47345a5bb4d6 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'af7c8895-ebb8-47f1-9ffe-cb44562572ed', 'tempest-TagsExtTest-Tag-295265291') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:11.300300 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:11.303663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-46c28701-7427-4475-91ed-465740ccebaa admin admin] Calling delete_port for 26754046-3c27-423b-a836-8c5b0f061d5a owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:24:11.337530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:24:11.361595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:11.369575 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:11.407343 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c96259a0-cc19-47d0-a919-56fdff68c7e2 req-6d285fcb-1a96-4abf-b58e-348d10aaf47c tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1258454 May 12 15:24:11.433753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb8d33e3-88d6-491a-94ee-a8c5c330bb08 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event deleted for resources: {'Port': ['ID=99d5efe6-ef16-4f7b-88da-a85db84c1ce7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:11.456981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2930f9-e86f-4648-bf3b-0e78bfc85dfb req-865eeff4-4e5f-419f-bfda-de2cb734407e tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:11.465691 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e2930f9-e86f-4648-bf3b-0e78bfc85dfb req-865eeff4-4e5f-419f-bfda-de2cb734407e tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 985 time: 0.4362128 May 12 15:24:11.471968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-2e2930f9-e86f-4648-bf3b-0e78bfc85dfb req-b39f4802-02dc-425d-b6c1-434b4359009a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'port': {'security_groups': ['b0aae945-e0f0-419f-88b0-e0606e730ccb', 'd07e6569-0a4a-44ce-88a8-cf53c16de2ab', '738c04a9-a3ef-44bd-b2b5-86400e968436']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:11.538917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:11.576246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426e5774-e956-4ff3-8a75-01948d003fc6 req-45c4ff55-d079-41c5-8f11-4b576a3b2946 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:11.577777 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-426e5774-e956-4ff3-8a75-01948d003fc6 req-45c4ff55-d079-41c5-8f11-4b576a3b2946 service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.6742551 May 12 15:24:11.591926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:24:11.729827 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2e2930f9-e86f-4648-bf3b-0e78bfc85dfb req-b39f4802-02dc-425d-b6c1-434b4359009a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:11.864204 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb8d33e3-88d6-491a-94ee-a8c5c330bb08 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:11.874640 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-80def4f9-6f3e-46c4-8c14-00acbfdba2af req-0c872143-40f4-42cd-bdae-8e5538ee2a77 service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6022868 May 12 15:24:11.882015 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cef86096-05b4-4aa0-bb05-47345a5bb4d6 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/routers/af7c8895-ebb8-47f1-9ffe-cb44562572ed/tags/tempest-TagsExtTest-Tag-295265291 HTTP/1.1" status: 204 len: 168 time: 0.6351659 May 12 15:24:11.882015 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-426e5774-e956-4ff3-8a75-01948d003fc6 req-a263ad49-90f6-42f1-b338-c56df6ce2607 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26 HTTP/1.1" status: 200 len: 999 time: 0.2738233 May 12 15:24:11.883689 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-125afe3a-b7d0-420d-9a52-a645c827b4b0 req-8669b009-03c9-480a-a332-403601000f18 service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6376710 May 12 15:24:11.886730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38378) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:11.890823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4ae186-c406-4868-8b29-effaeb13529e req-e701e276-b168-4061-9a5e-ff001eead6e2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:11.892373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a4ae186-c406-4868-8b29-effaeb13529e req-e701e276-b168-4061-9a5e-ff001eead6e2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2542360 May 12 15:24:11.893413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-7d7db6a7-ad42-47a2-bb57-cc70119945be tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'routers', 'af7c8895-ebb8-47f1-9ffe-cb44562572ed', 'tempest-TagsExtTest-Tag-295265291') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:12.007717 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46c28701-7427-4475-91ed-465740ccebaa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:12.053949 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a4ae186-c406-4868-8b29-effaeb13529e req-5255f234-97b7-491f-a74a-c825879ae9fe tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1497958 May 12 15:24:12.067509 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46c28701-7427-4475-91ed-465740ccebaa admin admin] Pushing event deleted for resources: {'Port': ['ID=26754046-3c27-423b-a836-8c5b0f061d5a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:12.386289 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb8d33e3-88d6-491a-94ee-a8c5c330bb08 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:12.403455 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bb8d33e3-88d6-491a-94ee-a8c5c330bb08 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "DELETE /v2.0/floatingips/4ee874b2-35ce-4deb-960e-3fee8a1cd250 HTTP/1.1" status: 204 len: 168 time: 2.9092803 May 12 15:24:12.462639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426e5774-e956-4ff3-8a75-01948d003fc6 req-ba71c45c-a1c6-4e52-884f-89d3e814c31f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:12.464087 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-426e5774-e956-4ff3-8a75-01948d003fc6 req-ba71c45c-a1c6-4e52-884f-89d3e814c31f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.5743766 May 12 15:24:12.556132 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-125afe3a-b7d0-420d-9a52-a645c827b4b0 req-6ca2ddb1-22e3-4d90-9abb-1bc97a3772c3 service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5596490 May 12 15:24:12.599693 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-80def4f9-6f3e-46c4-8c14-00acbfdba2af req-b7b031c1-0fbd-4a99-a03f-005bebc2d227 service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7133641 May 12 15:24:12.614016 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7d7db6a7-ad42-47a2-bb57-cc70119945be tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/routers/af7c8895-ebb8-47f1-9ffe-cb44562572ed/tags/tempest-TagsExtTest-Tag-295265291 HTTP/1.1" status: 204 len: 168 time: 0.7263207 May 12 15:24:12.615944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38396) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:12.626500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-d1c2448c-aae9-48ed-b7bf-9e5574bbcf06 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', 'af7c8895-ebb8-47f1-9ffe-cb44562572ed') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:12.660540 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eb261d37-fcc1-4a56-b133-a8998b4793f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:12.707704 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46c28701-7427-4475-91ed-465740ccebaa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:12.712487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426e5774-e956-4ff3-8a75-01948d003fc6 req-3573c5fc-2b31-4290-8a9b-efac572b393b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:12.714511 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-426e5774-e956-4ff3-8a75-01948d003fc6 req-3573c5fc-2b31-4290-8a9b-efac572b393b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2256100 May 12 15:24:12.730405 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-2e2930f9-e86f-4648-bf3b-0e78bfc85dfb req-b39f4802-02dc-425d-b6c1-434b4359009a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] For port a306c21a-a934-4a55-8955-3ede562c61c1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a306c21a-a934-4a55-8955-3ede562c61c1,segment=NetworkSegment(2b9a3118-674a-42bd-be1d-3a0efcec85f0),segment_id=2b9a3118-674a-42bd-be1d-3a0efcec85f0)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:12.875698 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d1c2448c-aae9-48ed-b7bf-9e5574bbcf06 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/routers/af7c8895-ebb8-47f1-9ffe-cb44562572ed/tags HTTP/1.1" status: 200 len: 205 time: 0.2576740 May 12 15:24:12.878254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38400) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:12.884697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-0206aa07-1043-443d-b709-9c058b32e854 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', '58df5eba-028d-45d6-9170-fc3541e3bc02') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:12.900191 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:12.915588 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2e2930f9-e86f-4648-bf3b-0e78bfc85dfb req-b39f4802-02dc-425d-b6c1-434b4359009a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:12.936671 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2e2930f9-e86f-4648-bf3b-0e78bfc85dfb req-b39f4802-02dc-425d-b6c1-434b4359009a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:12.949814 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0206aa07-1043-443d-b709-9c058b32e854 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/subnetpools/58df5eba-028d-45d6-9170-fc3541e3bc02/tags HTTP/1.1" status: 200 len: 240 time: 0.0682487 May 12 15:24:12.949814 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-426e5774-e956-4ff3-8a75-01948d003fc6 req-d34037be-6122-4c01-b275-6a237f21c779 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1816647 May 12 15:24:12.950124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38404) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:12.955207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:24:12.956253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-77f3bf2f-7a60-4bd7-b47d-613820ba81e5 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '58df5eba-028d-45d6-9170-fc3541e3bc02', 'tempest-TagsExtTest-Tag-562899712') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:12.987854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb5d8034-3c2c-480c-a9f2-43dea480c762 req-9e7a7aa6-75ce-4012-abd7-45dcd696c5be tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:12.989363 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb5d8034-3c2c-480c-a9f2-43dea480c762 req-9e7a7aa6-75ce-4012-abd7-45dcd696c5be tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.3521776 May 12 15:24:13.004342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3665052f-787a-44a4-bee0-3335df3f44a6', 'a306c21a-a934-4a55-8955-3ede562c61c1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:24:13.071631 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-77f3bf2f-7a60-4bd7-b47d-613820ba81e5 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/subnetpools/58df5eba-028d-45d6-9170-fc3541e3bc02/tags/tempest-TagsExtTest-Tag-562899712 HTTP/1.1" status: 204 len: 168 time: 0.1198242 May 12 15:24:13.074084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38410) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:13.079586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-75b690eb-7f29-4e84-9517-c43a2383829f tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnetpools', '58df5eba-028d-45d6-9170-fc3541e3bc02', 'tempest-TagsExtTest-Tag-562899712') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:13.142242 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-426e5774-e956-4ff3-8a75-01948d003fc6 req-841a469a-7c50-4561-abc1-53c112fe4e40 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1773088 May 12 15:24:13.175319 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-75b690eb-7f29-4e84-9517-c43a2383829f tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/subnetpools/58df5eba-028d-45d6-9170-fc3541e3bc02/tags/tempest-TagsExtTest-Tag-562899712 HTTP/1.1" status: 204 len: 168 time: 0.0997710 May 12 15:24:13.176392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38418) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:13.182516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-ff9ac81f-5654-457e-84cb-65860b2d5c63 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', '58df5eba-028d-45d6-9170-fc3541e3bc02') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:13.182711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:24:13.193614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:13.194118 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:13.223649 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ff9ac81f-5654-457e-84cb-65860b2d5c63 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/subnetpools/58df5eba-028d-45d6-9170-fc3541e3bc02/tags HTTP/1.1" status: 200 len: 205 time: 0.0459435 May 12 15:24:13.225352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38422) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:13.238444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-467791e7-1044-46ef-a604-d0a5c1fd2dcc tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '58df5eba-028d-45d6-9170-fc3541e3bc02') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:13.273449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2930f9-e86f-4648-bf3b-0e78bfc85dfb req-b39f4802-02dc-425d-b6c1-434b4359009a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:13.274013 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2e2930f9-e86f-4648-bf3b-0e78bfc85dfb req-b39f4802-02dc-425d-b6c1-434b4359009a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:13.275653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e2930f9-e86f-4648-bf3b-0e78bfc85dfb req-b39f4802-02dc-425d-b6c1-434b4359009a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "PUT /v2.0/ports/a306c21a-a934-4a55-8955-3ede562c61c1 HTTP/1.1" status: 200 len: 1021 time: 1.8083212 May 12 15:24:13.276198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'caefe380-1876-4938-83a7-078804c994b7', 'tag': 'a306c21a-a934-4a55-8955-3ede562c61c1'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:24:13.319094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb5d8034-3c2c-480c-a9f2-43dea480c762 req-8629c631-045c-4923-ab64-420e05ffb33f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3127694 May 12 15:24:13.340496 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-467791e7-1044-46ef-a604-d0a5c1fd2dcc tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/subnetpools/58df5eba-028d-45d6-9170-fc3541e3bc02/tags HTTP/1.1" status: 204 len: 168 time: 0.1118455 May 12 15:24:13.340693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b39f4802-02dc-425d-b6c1-434b4359009a tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'Port': ['ID=a306c21a-a934-4a55-8955-3ede562c61c1,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:13.342461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38432) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:13.358991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-06e2911d-68e6-4966-a22d-79f9249cb744 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', 'af7c8895-ebb8-47f1-9ffe-cb44562572ed') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:13.484899 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a306c21a-a934-4a55-8955-3ede562c61c1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:24:13.504451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38440) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:13.541400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Request body: {'security_group': {'name': 'tempest-securitygroup--47908330', 'description': 'tempest-description--1717212876'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:13.620217 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:13.638929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-46c28701-7427-4475-91ed-465740ccebaa admin admin] Router 8920755b-88bb-4da0-8c62-e9fdd7957b7d has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:24:13.671334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:13.676407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Usage tracker for resource:security_group and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:13.679995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:13.685581 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '914409b3-8c2c-4574-af4a-2eb14f6d1ad9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:24:13.689337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:13.712919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:13.738133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:13.763846 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-06e2911d-68e6-4966-a22d-79f9249cb744 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/routers/af7c8895-ebb8-47f1-9ffe-cb44562572ed/tags HTTP/1.1" status: 204 len: 168 time: 0.4130661 May 12 15:24:13.768650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:13.772733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Usage tracker for resource:security_group_rule and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:13.776176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:13.782908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:13.800736 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:13.833877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38454) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:13.841984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-efeba1c2-646e-4b5d-bd1a-460f613773f0 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', 'e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:13.892864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:13.907469 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:13.922525 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:13.978663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8608e463-6f23-456a-983e-4341787ed2c8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:14.000103 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:14.004596 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-56fff88b-9107-425a-9b84-ba4c319bcaa8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 0.4966226 May 12 15:24:14.004596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38464) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:14.016543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-dd2ea5e1-2833-40cc-bfb9-0e5f346d474f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Request body: {'security_group_rule': {'security_group_id': '8608e463-6f23-456a-983e-4341787ed2c8', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:14.031200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dd2ea5e1-2833-40cc-bfb9-0e5f346d474f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:14.043204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dd2ea5e1-2833-40cc-bfb9-0e5f346d474f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Usage tracker for resource:security_group_rule and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:14.050367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dd2ea5e1-2833-40cc-bfb9-0e5f346d474f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:14.061836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dd2ea5e1-2833-40cc-bfb9-0e5f346d474f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:14.081658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf833b86-4933-40f0-8739-2e0f14f5b35f req-ab444d60-1415-4b79-a6d8-6171f285dce5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:14.083501 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cf833b86-4933-40f0-8739-2e0f14f5b35f req-ab444d60-1415-4b79-a6d8-6171f285dce5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=914409b3-8c2c-4574-af4a-2eb14f6d1ad9 HTTP/1.1" status: 200 len: 945 time: 0.5742931 May 12 15:24:14.095438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-46c28701-7427-4475-91ed-465740ccebaa admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:24:14.109212 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-425fe2df-3d68-4703-ae75-a3163123648d None None] Sync routers for ids ['8920755b-88bb-4da0-8c62-e9fdd7957b7d'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:24:14.118878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd2ea5e1-2833-40cc-bfb9-0e5f346d474f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:14.125261 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-425fe2df-3d68-4703-ae75-a3163123648d None None] Routers {'8920755b-88bb-4da0-8c62-e9fdd7957b7d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:24:14.126666 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-425fe2df-3d68-4703-ae75-a3163123648d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:23:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8920755b-88bb-4da0-8c62-e9fdd7957b7d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:14.207356 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cf833b86-4933-40f0-8739-2e0f14f5b35f req-f05da875-3f4b-4e8e-a602-f687ff576922 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1096632 May 12 15:24:14.243774 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-46c28701-7427-4475-91ed-465740ccebaa admin admin] 10.222.0.82 "PUT /v2.0/routers/8920755b-88bb-4da0-8c62-e9fdd7957b7d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.3876033 May 12 15:24:14.248947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38470) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:14.284957 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd2ea5e1-2833-40cc-bfb9-0e5f346d474f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:14.292745 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd2ea5e1-2833-40cc-bfb9-0e5f346d474f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:14.332886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd2ea5e1-2833-40cc-bfb9-0e5f346d474f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f17481c7-1074-4c38-9cc2-cffcc05f07ba,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:14.354551 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd2ea5e1-2833-40cc-bfb9-0e5f346d474f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:14.360847 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dd2ea5e1-2833-40cc-bfb9-0e5f346d474f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3553152 May 12 15:24:14.366078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38478) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:14.380520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4ec55040-5b3e-445c-a1ec-83ce29811557 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Request body: {'security_group_rule': {'security_group_id': '8608e463-6f23-456a-983e-4341787ed2c8', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:14.393254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4ec55040-5b3e-445c-a1ec-83ce29811557 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:14.398534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4ec55040-5b3e-445c-a1ec-83ce29811557 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Usage tracker for resource:security_group_rule and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:14.402167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4ec55040-5b3e-445c-a1ec-83ce29811557 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:14.411123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4ec55040-5b3e-445c-a1ec-83ce29811557 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:14.446203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ec55040-5b3e-445c-a1ec-83ce29811557 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:14.468704 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-425fe2df-3d68-4703-ae75-a3163123648d None None] Set router 8920755b-88bb-4da0-8c62-e9fdd7957b7d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:24:14.536194 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ec55040-5b3e-445c-a1ec-83ce29811557 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:14.542646 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ec55040-5b3e-445c-a1ec-83ce29811557 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:14.575585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ec55040-5b3e-445c-a1ec-83ce29811557 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=19a6b289-7258-4984-92d3-7883c9dea69d,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:14.592902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ec55040-5b3e-445c-a1ec-83ce29811557 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:14.595353 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ec55040-5b3e-445c-a1ec-83ce29811557 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2272542 May 12 15:24:14.598874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38482) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:14.616618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:14.629688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:14.639836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Usage tracker for resource:floatingip and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:14.648237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:14.661874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:14.687695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:14.799017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5688c70-58b4-418b-b27f-9da8700d174f req-c77bcb2c-a013-40ce-a560-432948c2cc0b tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/738c04a9-a3ef-44bd-b2b5-86400e968436 HTTP/1.1" status: 200 len: 1803 time: 0.5148375 May 12 15:24:14.809562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-efeba1c2-646e-4b5d-bd1a-460f613773f0 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/ports/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9/tags HTTP/1.1" status: 204 len: 168 time: 0.9722171 May 12 15:24:14.811712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38488) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:14.820191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58c88fb2-7602-497c-bb32-f42f5cf1c410 req-4c1c4306-3ff4-4377-b1d4-aab43ddcd9e8 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:14.820744 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b46c4048-429a-4367-973f-ba920b196758 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:14.827772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58c88fb2-7602-497c-bb32-f42f5cf1c410 req-4c1c4306-3ff4-4377-b1d4-aab43ddcd9e8 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 1.1877530 May 12 15:24:14.865030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-966b4f11-3b44-472f-af53-bf4f1db63359 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '241c4d7c-a9c4-4133-9c16-acfdba71a6da') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:14.890766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:14.916748 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-425fe2df-3d68-4703-ae75-a3163123648d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'name': 'tempest-ServerRescueTestJSON-288887235-router', 'tenant_id': '9e2382be0c6f4779ae64026a57628773', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125'}], 'enable_snat': True}, 'gw_port_id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:33Z', 'updated_at': '2022-05-12T15:24:11Z', 'revision_number': 5, 'project_id': '9e2382be0c6f4779ae64026a57628773', 'gw_port': {'id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:21:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1535, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:35Z', 'updated_at': '2022-05-12T15:21:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:14.921627 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-425fe2df-3d68-4703-ae75-a3163123648d None None] Checking router: 8920755b-88bb-4da0-8c62-e9fdd7957b7d for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:24:14.922810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38492) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:14.930455 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-425fe2df-3d68-4703-ae75-a3163123648d None None] Routers {'8920755b-88bb-4da0-8c62-e9fdd7957b7d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:24:14.931052 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-425fe2df-3d68-4703-ae75-a3163123648d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:24:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8920755b-88bb-4da0-8c62-e9fdd7957b7d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:14.932392 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:15.055233 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58c88fb2-7602-497c-bb32-f42f5cf1c410 req-c1086a62-c4a8-4892-8514-4b454fe1a05f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2265117 May 12 15:24:15.061424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Allocated IP 172.25.8.98 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/566a9985-5619-40f3-99a4-11c4f7d053ee) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:24:15.080568 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-b5688c70-58b4-418b-b27f-9da8700d174f req-c29202be-c1fd-47a8-a195-06f36ac220d1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] delete failed (client error): There was a conflict when trying to complete your request. May 12 15:24:15.092242 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5688c70-58b4-418b-b27f-9da8700d174f req-c29202be-c1fd-47a8-a195-06f36ac220d1 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "DELETE /v2.0/security-groups/738c04a9-a3ef-44bd-b2b5-86400e968436 HTTP/1.1" status: 409 len: 341 time: 0.2478061 May 12 15:24:15.146580 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-425fe2df-3d68-4703-ae75-a3163123648d None None] Set router 8920755b-88bb-4da0-8c62-e9fdd7957b7d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:24:15.206666 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6f9a72c0-407d-4c7e-b457-a9c97708847d'] response: {'name': 'network-changed', 'server_uuid': 'caefe380-1876-4938-83a7-078804c994b7', 'tag': 'a306c21a-a934-4a55-8955-3ede562c61c1', 'status': 'completed', 'code': 200} May 12 15:24:15.207151 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-08899a07-a3a2-4cf7-8138-a0ddead43065'] response: {'server_uuid': '914409b3-8c2c-4574-af4a-2eb14f6d1ad9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735', 'code': 200} May 12 15:24:15.360173 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b745e8f-16ba-45e1-836f-454d9943a28a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:15.396887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-966b4f11-3b44-472f-af53-bf4f1db63359 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/subnets/241c4d7c-a9c4-4133-9c16-acfdba71a6da/tags HTTP/1.1" status: 204 len: 168 time: 0.5517004 May 12 15:24:15.404230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38504) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:15.421908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-bd048fa0-ba0e-48ad-8bb9-b180b04b1a54 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', '241c4d7c-a9c4-4133-9c16-acfdba71a6da', 'tempest-TagsExtTest-Tag-1016556107') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:15.480194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7b745e8f-16ba-45e1-836f-454d9943a28a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:15.510494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7b745e8f-16ba-45e1-836f-454d9943a28a admin admin] Usage tracker for resource:security_group_rule and tenant:b4727919db444fdba5bdc093b191e512 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:15.514932 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:15.522160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7b745e8f-16ba-45e1-836f-454d9943a28a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:15.535212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7b745e8f-16ba-45e1-836f-454d9943a28a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:15.574618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45972692-438b-4a7a-8e6c-e833f114e982 req-85c42961-97ba-4d19-a4f1-fcfceaac0c19 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:15.584773 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45972692-438b-4a7a-8e6c-e833f114e982 req-85c42961-97ba-4d19-a4f1-fcfceaac0c19 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2796440 May 12 15:24:15.596199 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-425fe2df-3d68-4703-ae75-a3163123648d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'name': 'tempest-ServerRescueTestJSON-288887235-router', 'tenant_id': '9e2382be0c6f4779ae64026a57628773', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125'}], 'enable_snat': True}, 'gw_port_id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:33Z', 'updated_at': '2022-05-12T15:24:11Z', 'revision_number': 5, 'project_id': '9e2382be0c6f4779ae64026a57628773', 'gw_port': {'id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:21:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1535, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:35Z', 'updated_at': '2022-05-12T15:21:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:15.603036 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-425fe2df-3d68-4703-ae75-a3163123648d None None] The sync data for ids ['8920755b-88bb-4da0-8c62-e9fdd7957b7d'] in n-d-841483-1 is: [{'id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'name': 'tempest-ServerRescueTestJSON-288887235-router', 'tenant_id': '9e2382be0c6f4779ae64026a57628773', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125'}], 'enable_snat': True}, 'gw_port_id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:21:33Z', 'updated_at': '2022-05-12T15:24:11Z', 'revision_number': 5, 'project_id': '9e2382be0c6f4779ae64026a57628773', 'gw_port': {'id': 'f98e71fb-41e6-42df-a52d-3c2ba1a4a299', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:21:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8920755b-88bb-4da0-8c62-e9fdd7957b7d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1535, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:21:35Z', 'updated_at': '2022-05-12T15:21:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:24:15.608869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] Deleting port f98e71fb-41e6-42df-a52d-3c2ba1a4a299 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:24:15.609206 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:15.660183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd6d075d-4ec0-4db4-ba47-dba1325877c9 req-cfd89191-b1bb-44eb-82e4-0a17146f7d45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:15.662294 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dd6d075d-4ec0-4db4-ba47-dba1325877c9 req-cfd89191-b1bb-44eb-82e4-0a17146f7d45 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=86574e26b5194d1f92a51749f063fa69&device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 1175 time: 0.2589028 May 12 15:24:15.669468 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:15.678663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f67c27e-6860-4a53-82c4-d0569a532a0f req-28d04cf3-5c7d-4f1f-a42f-ec519eb35805 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:15.680537 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f67c27e-6860-4a53-82c4-d0569a532a0f req-28d04cf3-5c7d-4f1f-a42f-ec519eb35805 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=914409b3-8c2c-4574-af4a-2eb14f6d1ad9 HTTP/1.1" status: 200 len: 1097 time: 0.2742612 May 12 15:24:15.752175 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45972692-438b-4a7a-8e6c-e833f114e982 req-b6994108-2957-40d9-b993-af4d5502acdc tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1662481 May 12 15:24:15.822623 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f67c27e-6860-4a53-82c4-d0569a532a0f req-1ebe3888-9eb0-4c80-b0fd-f76f213bdb5a service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1189854 May 12 15:24:15.860025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd6d075d-4ec0-4db4-ba47-dba1325877c9 req-1ea23aa6-03ab-41ce-833f-0e7402693aca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:15.861544 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dd6d075d-4ec0-4db4-ba47-dba1325877c9 req-1ea23aa6-03ab-41ce-833f-0e7402693aca service neutron] 10.222.0.84 "GET /v2.0/networks?id=b50584ea-1073-48d4-a2bc-43b11374a495 HTTP/1.1" status: 200 len: 914 time: 0.1856470 May 12 15:24:15.865781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:15.966012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bd048fa0-ba0e-48ad-8bb9-b180b04b1a54 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "PUT /v2.0/subnets/241c4d7c-a9c4-4133-9c16-acfdba71a6da/tags/tempest-TagsExtTest-Tag-1016556107 HTTP/1.1" status: 201 len: 201 time: 0.5554647 May 12 15:24:15.979839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38516) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:16.016363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-5d44de52-2c43-424e-9090-cfed9c742cfd tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', 'e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9', 'tempest-TagsExtTest-Tag-704917355') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:16.017757 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dd6d075d-4ec0-4db4-ba47-dba1325877c9 req-d12dde50-debc-4731-97c9-16bba3be65bb service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a306c21a-a934-4a55-8955-3ede562c61c1 HTTP/1.1" status: 200 len: 217 time: 0.1447780 May 12 15:24:16.019895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:24:16.023045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:16.028808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:24:16.030154 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:16.072144 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b745e8f-16ba-45e1-836f-454d9943a28a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:16.093026 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b745e8f-16ba-45e1-836f-454d9943a28a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:16.115624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] For port f98e71fb-41e6-42df-a52d-3c2ba1a4a299, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f98e71fb-41e6-42df-a52d-3c2ba1a4a299,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:16.115988 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:16.134184 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:16.147491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event updated for resources: {'Port': ['ID=566a9985-5619-40f3-99a4-11c4f7d053ee,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:16.183451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd6d075d-4ec0-4db4-ba47-dba1325877c9 req-c0cf109d-b31b-4704-adb2-b81a4bc9f828 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:16.185053 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dd6d075d-4ec0-4db4-ba47-dba1325877c9 req-c0cf109d-b31b-4704-adb2-b81a4bc9f828 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=92a8d5fe-fb2b-414d-9ae2-15fb02337cd9 HTTP/1.1" status: 200 len: 853 time: 0.1574385 May 12 15:24:16.192091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:16.274043 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dd6d075d-4ec0-4db4-ba47-dba1325877c9 req-4f9ac0ba-afb8-4ae9-9f49-a80bbc9e8327 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b50584ea-1073-48d4-a2bc-43b11374a495&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0486355 May 12 15:24:16.368976 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:16.376829 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7b745e8f-16ba-45e1-836f-454d9943a28a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b4727919db444fdba5bdc093b191e512&name=default HTTP/1.1" status: 200 len: 2983 time: 1.3953481 May 12 15:24:16.388470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38522) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:16.407070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] Calling delete_port for f98e71fb-41e6-42df-a52d-3c2ba1a4a299 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:24:16.495798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b745e8f-16ba-45e1-836f-454d9943a28a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0410bce-61f7-49dc-84e9-363af3fa784d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:16.508960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461d2e4b-e558-4e13-a309-d03019c3948e req-e0a93f75-de0a-49c0-b15c-d0509ec16e3f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:16.514599 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-461d2e4b-e558-4e13-a309-d03019c3948e req-e0a93f75-de0a-49c0-b15c-d0509ec16e3f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=914409b3-8c2c-4574-af4a-2eb14f6d1ad9 HTTP/1.1" status: 200 len: 946 time: 0.6932938 May 12 15:24:16.565285 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dd6d075d-4ec0-4db4-ba47-dba1325877c9 req-31e8b2bb-a905-41c0-9a09-c7fae6b72965 service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2722082 May 12 15:24:16.668995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-461d2e4b-e558-4e13-a309-d03019c3948e req-1d979f96-f6e3-41b4-88cd-28c778ba045c tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1408229 May 12 15:24:16.673022 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-956b8f5d-e2f1-442c-a7b7-d8227c7f9ecb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:16.692182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7a538b5-7409-490a-9f18-93eec7df53d1 req-ad519f96-a087-4478-82d7-760227c5f3be tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:16.694930 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7a538b5-7409-490a-9f18-93eec7df53d1 req-ad519f96-a087-4478-82d7-760227c5f3be tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 1024 time: 0.5583146 May 12 15:24:16.752920 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dd6d075d-4ec0-4db4-ba47-dba1325877c9 req-b6be0765-651b-43d2-9e28-844fc2513f56 service neutron] 10.222.0.84 "GET /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1784987 May 12 15:24:16.756822 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:16.762367 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:16.797925 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-956b8f5d-e2f1-442c-a7b7-d8227c7f9ecb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:16.805854 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5d44de52-2c43-424e-9090-cfed9c742cfd tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "PUT /v2.0/ports/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9/tags/tempest-TagsExtTest-Tag-704917355 HTTP/1.1" status: 201 len: 201 time: 0.8220315 May 12 15:24:16.818590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38526) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:16.838916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event updated for resources: {'Port': ['ID=566a9985-5619-40f3-99a4-11c4f7d053ee,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:16.878787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-9bd0542a-dc71-4cbd-aaa0-faa7260ab812 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', 'af7c8895-ebb8-47f1-9ffe-cb44562572ed', 'tempest-TagsExtTest-Tag-1588758145') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:16.904198 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:16.929525 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:16.930920 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e46551df-cdd7-4f5f-8c09-56cdb3982b89 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.3299291 May 12 15:24:16.994061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 26754046-3c27-423b-a836-8c5b0f061d5a no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:24:17.043869 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 26754046-3c27-423b-a836-8c5b0f061d5a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:24:17.044837 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 26754046-3c27-423b-a836-8c5b0f061d5a not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:24:17.211152 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:17.219800 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7a538b5-7409-490a-9f18-93eec7df53d1 req-d7a0dbec-b2ef-45d6-8a56-d58d0286aa85 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=738c04a9-a3ef-44bd-b2b5-86400e968436&id=b0aae945-e0f0-419f-88b0-e0606e730ccb&id=d07e6569-0a4a-44ce-88a8-cf53c16de2ab&fields=id&fields=name HTTP/1.1" status: 200 len: 516 time: 0.4099591 May 12 15:24:17.283840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] Pushing event deleted for resources: {'Port': ['ID=f98e71fb-41e6-42df-a52d-3c2ba1a4a299,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:17.367295 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-956b8f5d-e2f1-442c-a7b7-d8227c7f9ecb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:17.446889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-956b8f5d-e2f1-442c-a7b7-d8227c7f9ecb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0410bce-61f7-49dc-84e9-363af3fa784d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:17.470415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b3bed40-5792-4889-aaac-15616bb17c3b req-a369415d-c454-410b-99dd-2b3a9516e17f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:17.471914 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b3bed40-5792-4889-aaac-15616bb17c3b req-a369415d-c454-410b-99dd-2b3a9516e17f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.6601672 May 12 15:24:17.511498 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9bd0542a-dc71-4cbd-aaa0-faa7260ab812 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "PUT /v2.0/routers/af7c8895-ebb8-47f1-9ffe-cb44562572ed/tags/tempest-TagsExtTest-Tag-1588758145 HTTP/1.1" status: 201 len: 201 time: 0.6887212 May 12 15:24:17.515221 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:17.515438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38534) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:17.521759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-eab7a850-f924-45bc-8ed1-58b85337f892 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', '58df5eba-028d-45d6-9170-fc3541e3bc02', 'tempest-TagsExtTest-Tag-2069323261') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:17.555426 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-956b8f5d-e2f1-442c-a7b7-d8227c7f9ecb admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:17.556445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-956b8f5d-e2f1-442c-a7b7-d8227c7f9ecb admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c0410bce-61f7-49dc-84e9-363af3fa784d HTTP/1.1" status: 204 len: 168 time: 1.1049681 May 12 15:24:17.613597 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:17.628716 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-eab7a850-f924-45bc-8ed1-58b85337f892 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "PUT /v2.0/subnetpools/58df5eba-028d-45d6-9170-fc3541e3bc02/tags/tempest-TagsExtTest-Tag-2069323261 HTTP/1.1" status: 201 len: 201 time: 0.1099539 May 12 15:24:17.628927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38540) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:17.634563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-46cfc552-fa55-402b-9ec1-70501aa991e3 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnets', '241c4d7c-a9c4-4133-9c16-acfdba71a6da', {'tags': ['tempest-TagsExtTest-Tag-996205884', 'tempest-TagsExtTest-Tag-179109808', 'tempest-TagsExtTest-Tag-2006909575']}) {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:17.735976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b3bed40-5792-4889-aaac-15616bb17c3b req-f1967940-cf84-4765-8c4b-c317905e542c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2487352 May 12 15:24:17.739704 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:17.742799 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:17.786930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a98e0969-fb06-4609-bef9-4f0047395bff req-afee7ff5-6f65-4ada-8be3-977cc5c71039 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:17.788547 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a98e0969-fb06-4609-bef9-4f0047395bff req-afee7ff5-6f65-4ada-8be3-977cc5c71039 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.4239254 May 12 15:24:17.811522 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:17.812203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8920755b-88bb-4da0-8c62-e9fdd7957b7d {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:24:17.828173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16bc849e-cbdb-4cf1-9a4d-9d50ec8d66c8 req-a20ddafe-d9b2-4dd8-80e4-da586919ff8d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:17.828903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-16bc849e-cbdb-4cf1-9a4d-9d50ec8d66c8 req-a20ddafe-d9b2-4dd8-80e4-da586919ff8d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Synchronizing usage tracker for tenant:86574e26b5194d1f92a51749f063fa69 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:24:17.843776 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:17.847712 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-61fc7d6f-20a2-4c9f-9160-2d227bd85c45 admin admin] 10.222.0.82 "DELETE /v2.0/routers/8920755b-88bb-4da0-8c62-e9fdd7957b7d HTTP/1.1" status: 204 len: 168 time: 3.5651379 May 12 15:24:17.848667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38556) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:17.878982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-16bc849e-cbdb-4cf1-9a4d-9d50ec8d66c8 req-a20ddafe-d9b2-4dd8-80e4-da586919ff8d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Unset dirty status for tenant:86574e26b5194d1f92a51749f063fa69 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:24:17.880644 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-16bc849e-cbdb-4cf1-9a4d-9d50ec8d66c8 req-a20ddafe-d9b2-4dd8-80e4-da586919ff8d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.84 "GET /v2.0/ports?device_id=caefe380-1876-4938-83a7-078804c994b7 HTTP/1.1" status: 200 len: 1024 time: 0.3495293 May 12 15:24:17.963527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-16bc849e-cbdb-4cf1-9a4d-9d50ec8d66c8 req-91d45368-2eaa-4e04-8dac-7bd14cf802db tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Deleting port a306c21a-a934-4a55-8955-3ede562c61c1 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:24:17.963872 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-16bc849e-cbdb-4cf1-9a4d-9d50ec8d66c8 req-91d45368-2eaa-4e04-8dac-7bd14cf802db tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:17.978519 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a98e0969-fb06-4609-bef9-4f0047395bff req-77374901-e6c0-471a-b761-0f92371628ef tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1817973 May 12 15:24:17.982080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38564) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:18.011268 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-46cfc552-fa55-402b-9ec1-70501aa991e3 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "PUT /v2.0/subnets/241c4d7c-a9c4-4133-9c16-acfdba71a6da/tags HTTP/1.1" status: 200 len: 316 time: 0.3791907 May 12 15:24:18.017339 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38570) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:18.024937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-35a5fa79-0691-4a70-9c9c-b1611f0d76c3 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '241c4d7c-a9c4-4133-9c16-acfdba71a6da') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:18.025353 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-121df0d0-dd0d-484f-9419-8125ce26287d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:18.063874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-fa870cfc-2a32-4f94-b25c-bf544bd821ce admin admin] Deleting subnet eae80ee9-f335-4892-af0b-41490fc3c6b5 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:24:18.067527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-121df0d0-dd0d-484f-9419-8125ce26287d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:18.072145 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-1dc1b8b3-2c49-458f-85ca-b79d819917ca tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Synchronizing usage tracker for tenant:40852c97262142aeb6d62097955af83f on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:24:18.076159 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fa870cfc-2a32-4f94-b25c-bf544bd821ce admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:18.104956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-121df0d0-dd0d-484f-9419-8125ce26287d admin admin] Usage tracker for resource:security_group_rule and tenant:5a13ba7ba0a5490cb1af2008010b920b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:18.113281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-121df0d0-dd0d-484f-9419-8125ce26287d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:18.161896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-121df0d0-dd0d-484f-9419-8125ce26287d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:18.193981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-1dc1b8b3-2c49-458f-85ca-b79d819917ca tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Unset dirty status for tenant:40852c97262142aeb6d62097955af83f on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:24:18.195110 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-1dc1b8b3-2c49-458f-85ca-b79d819917ca tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--47908330&fields=id&tenant_id=40852c97262142aeb6d62097955af83f HTTP/1.1" status: 200 len: 267 time: 0.2780006 May 12 15:24:18.200412 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fa870cfc-2a32-4f94-b25c-bf544bd821ce admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:18.287071 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-35a5fa79-0691-4a70-9c9c-b1611f0d76c3 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/subnets/241c4d7c-a9c4-4133-9c16-acfdba71a6da/tags HTTP/1.1" status: 204 len: 168 time: 0.2664473 May 12 15:24:18.289061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38576) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:18.294954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-46ce14b3-4833-472d-be13-d8588da17855 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '241c4d7c-a9c4-4133-9c16-acfdba71a6da', 'tempest-TagsExtTest-Tag-996205884') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:18.335914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-16bc849e-cbdb-4cf1-9a4d-9d50ec8d66c8 req-91d45368-2eaa-4e04-8dac-7bd14cf802db tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] For port a306c21a-a934-4a55-8955-3ede562c61c1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a306c21a-a934-4a55-8955-3ede562c61c1,segment=NetworkSegment(2b9a3118-674a-42bd-be1d-3a0efcec85f0),segment_id=2b9a3118-674a-42bd-be1d-3a0efcec85f0)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:18.336279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-16bc849e-cbdb-4cf1-9a4d-9d50ec8d66c8 req-91d45368-2eaa-4e04-8dac-7bd14cf802db tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:18.400567 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fa870cfc-2a32-4f94-b25c-bf544bd821ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:18.485474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-16bc849e-cbdb-4cf1-9a4d-9d50ec8d66c8 req-91d45368-2eaa-4e04-8dac-7bd14cf802db tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Calling delete_port for a306c21a-a934-4a55-8955-3ede562c61c1 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:24:18.508944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fff3411-4bbf-4c53-bbb2-51c9fd5fefd5 req-0be9ee84-4ba1-43b7-8392-9309476d70b2 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:18.510412 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8fff3411-4bbf-4c53-bbb2-51c9fd5fefd5 req-0be9ee84-4ba1-43b7-8392-9309476d70b2 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=914409b3-8c2c-4574-af4a-2eb14f6d1ad9 HTTP/1.1" status: 200 len: 946 time: 0.4068322 May 12 15:24:18.564112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-6c4e8822-822e-4195-a884-de2050d10355 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:18.565597 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-6c4e8822-822e-4195-a884-de2050d10355 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/networks?id=2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 200 len: 817 time: 0.3270628 May 12 15:24:18.576811 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-46ce14b3-4833-472d-be13-d8588da17855 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] show failed (client error): The resource could not be found. May 12 15:24:18.578171 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-46ce14b3-4833-472d-be13-d8588da17855 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/subnets/241c4d7c-a9c4-4133-9c16-acfdba71a6da/tags/tempest-TagsExtTest-Tag-996205884 HTTP/1.1" status: 404 len: 328 time: 0.2898455 May 12 15:24:18.581073 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38580) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:18.583125 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-121df0d0-dd0d-484f-9419-8125ce26287d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:18.587204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-281b1b3b-abc7-4268-a88a-a22e61574195 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '241c4d7c-a9c4-4133-9c16-acfdba71a6da', 'tempest-TagsExtTest-Tag-179109808') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:18.604453 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-121df0d0-dd0d-484f-9419-8125ce26287d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:18.622480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-8c9766d3-42bf-4a93-bffe-458d48e93f1b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/quotas/40852c97262142aeb6d62097955af83f HTTP/1.1" status: 200 len: 375 time: 0.0474596 May 12 15:24:18.633953 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fa870cfc-2a32-4f94-b25c-bf544bd821ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:18.670085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8fff3411-4bbf-4c53-bbb2-51c9fd5fefd5 req-49445056-9701-4ce8-bd45-75d408cd3e81 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1423082 May 12 15:24:18.715095 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-281b1b3b-abc7-4268-a88a-a22e61574195 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] show failed (client error): The resource could not be found. May 12 15:24:18.716915 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-281b1b3b-abc7-4268-a88a-a22e61574195 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/subnets/241c4d7c-a9c4-4133-9c16-acfdba71a6da/tags/tempest-TagsExtTest-Tag-179109808 HTTP/1.1" status: 404 len: 328 time: 0.1341739 May 12 15:24:18.720178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38586) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:18.724933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-561d8137-af0a-4122-be14-8f499ef14c52 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '241c4d7c-a9c4-4133-9c16-acfdba71a6da', 'tempest-TagsExtTest-Tag-2006909575') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:18.751590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa870cfc-2a32-4f94-b25c-bf544bd821ce admin admin] Pushing event deleted for resources: {'Subnet': ['ID=eae80ee9-f335-4892-af0b-41490fc3c6b5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:18.754141 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fa870cfc-2a32-4f94-b25c-bf544bd821ce admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:18.761232 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-121df0d0-dd0d-484f-9419-8125ce26287d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5a13ba7ba0a5490cb1af2008010b920b&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7764802 May 12 15:24:18.763548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-121df0d0-dd0d-484f-9419-8125ce26287d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=798005ce-e13e-4b5e-a72c-33f28d06553f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:18.765830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38590) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:18.772762 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-16bc849e-cbdb-4cf1-9a4d-9d50ec8d66c8 req-91d45368-2eaa-4e04-8dac-7bd14cf802db tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:18.789171 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fa870cfc-2a32-4f94-b25c-bf544bd821ce admin admin] 10.222.0.82 "DELETE /v2.0/subnets/eae80ee9-f335-4892-af0b-41490fc3c6b5 HTTP/1.1" status: 204 len: 168 time: 0.9357529 May 12 15:24:18.789704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38594) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:18.807604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3665052f-787a-44a4-bee0-3335df3f44a6', 'a306c21a-a934-4a55-8955-3ede562c61c1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:24:18.845842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91d45368-2eaa-4e04-8dac-7bd14cf802db tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event deleted for resources: {'Port': ['ID=a306c21a-a934-4a55-8955-3ede562c61c1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:18.869111 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:24:18.985092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-16bc849e-cbdb-4cf1-9a4d-9d50ec8d66c8 req-91d45368-2eaa-4e04-8dac-7bd14cf802db tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] No DVR routers for this DVR port a306c21a-a934-4a55-8955-3ede562c61c1 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:24:18.988718 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-16bc849e-cbdb-4cf1-9a4d-9d50ec8d66c8 req-91d45368-2eaa-4e04-8dac-7bd14cf802db tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:18.993841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'caefe380-1876-4938-83a7-078804c994b7', 'name': 'network-vif-deleted', 'tag': 'a306c21a-a934-4a55-8955-3ede562c61c1'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:24:19.046660 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42f093b0-fae9-4788-a238-ee6b510881f4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:19.060601 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-16bc849e-cbdb-4cf1-9a4d-9d50ec8d66c8 req-91d45368-2eaa-4e04-8dac-7bd14cf802db tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.84 "DELETE /v2.0/ports/a306c21a-a934-4a55-8955-3ede562c61c1 HTTP/1.1" status: 204 len: 173 time: 1.1729162 May 12 15:24:19.116016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f98e71fb-41e6-42df-a52d-3c2ba1a4a299 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:24:19.135953 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-561d8137-af0a-4122-be14-8f499ef14c52 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] show failed (client error): The resource could not be found. May 12 15:24:19.135953 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-561d8137-af0a-4122-be14-8f499ef14c52 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/subnets/241c4d7c-a9c4-4133-9c16-acfdba71a6da/tags/tempest-TagsExtTest-Tag-2006909575 HTTP/1.1" status: 404 len: 329 time: 0.4106009 May 12 15:24:19.137278 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42f093b0-fae9-4788-a238-ee6b510881f4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:19.144360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38600) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:19.157620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-72913938-b49d-44aa-942f-adbd293ccd43 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=40852c97262142aeb6d62097955af83f&fields=id HTTP/1.1" status: 200 len: 348 time: 0.5152469 May 12 15:24:19.160328 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15bc0ad8-793e-4af2-89af-7cc7b067472a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:19.166913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-548cc9ee-5860-4cca-90d9-4b1460304d62 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'ports', 'e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9', {'tags': ['tempest-TagsExtTest-Tag-1947472588', 'tempest-TagsExtTest-Tag-1904613732', 'tempest-TagsExtTest-Tag-1494180610']}) {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:19.225264 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42f093b0-fae9-4788-a238-ee6b510881f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:19.241011 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: f98e71fb-41e6-42df-a52d-3c2ba1a4a299 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:24:19.242078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f98e71fb-41e6-42df-a52d-3c2ba1a4a299 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:24:19.275148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42f093b0-fae9-4788-a238-ee6b510881f4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:19.277683 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-42f093b0-fae9-4788-a238-ee6b510881f4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/798005ce-e13e-4b5e-a72c-33f28d06553f HTTP/1.1" status: 204 len: 168 time: 0.5079510 May 12 15:24:19.295415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42f093b0-fae9-4788-a238-ee6b510881f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=798005ce-e13e-4b5e-a72c-33f28d06553f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:19.673361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6824ab5f-0046-4197-9ff4-3897b8271193 req-a1f12a3d-5512-4654-b3a5-bcdb25a28782 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:19.676704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6824ab5f-0046-4197-9ff4-3897b8271193 req-a1f12a3d-5512-4654-b3a5-bcdb25a28782 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.6285956 May 12 15:24:19.727315 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15bc0ad8-793e-4af2-89af-7cc7b067472a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:19.746243 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-548cc9ee-5860-4cca-90d9-4b1460304d62 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "PUT /v2.0/ports/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9/tags HTTP/1.1" status: 200 len: 318 time: 0.6009510 May 12 15:24:19.746471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38616) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:19.759520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-659819a3-7e3e-4bb6-88b7-f6c1915e7f5c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', 'e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:19.802186 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-5fe57680-52de-473b-8bbe-e8de897403b8 service neutron] 10.222.0.82 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5866930 May 12 15:24:19.899187 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-659819a3-7e3e-4bb6-88b7-f6c1915e7f5c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/ports/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9/tags HTTP/1.1" status: 204 len: 168 time: 0.1517432 May 12 15:24:19.902765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38622) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:19.909251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-d41129bd-86bd-4861-9653-c40858159f27 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9', 'tempest-TagsExtTest-Tag-1947472588') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:19.931560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-15bc0ad8-793e-4af2-89af-7cc7b067472a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e7794860-7444-4123-96d5-ca3febf5e162']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:19.951766 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6824ab5f-0046-4197-9ff4-3897b8271193 req-86c9b828-2bbd-4cd9-8aca-510c8e35e87e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2598600 May 12 15:24:19.963454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-15bc0ad8-793e-4af2-89af-7cc7b067472a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ccba5697-f062-48f7-986e-3317afc51896') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:19.963693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-15bc0ad8-793e-4af2-89af-7cc7b067472a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ccba5697-f062-48f7-986e-3317afc51896') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:19.992849 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15bc0ad8-793e-4af2-89af-7cc7b067472a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:20.057909 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15bc0ad8-793e-4af2-89af-7cc7b067472a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:20.083191 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-d41129bd-86bd-4861-9653-c40858159f27 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] show failed (client error): The resource could not be found. May 12 15:24:20.084648 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d41129bd-86bd-4861-9653-c40858159f27 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/ports/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9/tags/tempest-TagsExtTest-Tag-1947472588 HTTP/1.1" status: 404 len: 329 time: 0.1822555 May 12 15:24:20.085556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-15bc0ad8-793e-4af2-89af-7cc7b067472a admin admin] Releasing vlan 567 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:24:20.085796 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15bc0ad8-793e-4af2-89af-7cc7b067472a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:20.095576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38632) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:20.100379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-11947690-9988-4a6d-bc6d-b19866bb1324 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9', 'tempest-TagsExtTest-Tag-1904613732') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:20.179660 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-11947690-9988-4a6d-bc6d-b19866bb1324 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] show failed (client error): The resource could not be found. May 12 15:24:20.183284 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-11947690-9988-4a6d-bc6d-b19866bb1324 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/ports/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9/tags/tempest-TagsExtTest-Tag-1904613732 HTTP/1.1" status: 404 len: 329 time: 0.0841589 May 12 15:24:20.183640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38638) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-867a868b-7aa1-4d88-b77f-a8be5b5173d7 service neutron] 10.222.0.82 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3844929 May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: timer() May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:24:20.188170 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:24:20.192458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-f9d5f883-c09b-4980-8a9f-3cd5d0c84226 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9', 'tempest-TagsExtTest-Tag-1494180610') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:20.308783 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15bc0ad8-793e-4af2-89af-7cc7b067472a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:20.340365 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15bc0ad8-793e-4af2-89af-7cc7b067472a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:20.357829 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-f9d5f883-c09b-4980-8a9f-3cd5d0c84226 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] show failed (client error): The resource could not be found. May 12 15:24:20.383760 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15bc0ad8-793e-4af2-89af-7cc7b067472a admin admin] Pushing event deleted for resources: {'Network': ['ID=e7794860-7444-4123-96d5-ca3febf5e162,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:20.385557 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f9d5f883-c09b-4980-8a9f-3cd5d0c84226 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/ports/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9/tags/tempest-TagsExtTest-Tag-1494180610 HTTP/1.1" status: 404 len: 329 time: 0.1995919 May 12 15:24:20.389657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38648) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:20.408217 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-345bc5cf-61ae-4331-b918-314b571d5834 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'routers', 'af7c8895-ebb8-47f1-9ffe-cb44562572ed', {'tags': ['tempest-TagsExtTest-Tag-231237540', 'tempest-TagsExtTest-Tag-1103314709', 'tempest-TagsExtTest-Tag-658219709']}) {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:20.525089 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6e8b4473-5f7f-4ba4-b10c-4aadc2ea1eb9'] response: {'server_uuid': 'caefe380-1876-4938-83a7-078804c994b7', 'name': 'network-vif-deleted', 'tag': 'a306c21a-a934-4a55-8955-3ede562c61c1', 'status': 'completed', 'code': 200} May 12 15:24:20.583691 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-15bc0ad8-793e-4af2-89af-7cc7b067472a admin admin] 10.222.0.82 "DELETE /v2.0/networks/e7794860-7444-4123-96d5-ca3febf5e162 HTTP/1.1" status: 204 len: 168 time: 1.7933240 May 12 15:24:20.628763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8394ebb0-4a2d-4fd0-8c7e-af4a4b0253c6 req-bb1c331c-0f1b-468e-9755-713adcfa3f23 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:20.635889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8394ebb0-4a2d-4fd0-8c7e-af4a4b0253c6 req-bb1c331c-0f1b-468e-9755-713adcfa3f23 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.4345477 May 12 15:24:20.675043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-345bc5cf-61ae-4331-b918-314b571d5834 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "PUT /v2.0/routers/af7c8895-ebb8-47f1-9ffe-cb44562572ed/tags HTTP/1.1" status: 200 len: 316 time: 0.2702961 May 12 15:24:20.675667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38666) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:20.680414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-34e1a92e-d302-4bb0-ac0b-4673db3a9a65 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', 'af7c8895-ebb8-47f1-9ffe-cb44562572ed') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:20.708086 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8394ebb0-4a2d-4fd0-8c7e-af4a4b0253c6 req-205812f5-e5cb-46bb-b063-a00f3374b61c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712302 May 12 15:24:20.844435 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bff27df-6716-47cc-a39b-055530d236b4 req-69b59c59-7ea5-4df0-b490-656eb2afb871 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 210 time: 0.0730669 May 12 15:24:20.979450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db094c02-24e7-4920-b296-be06f1e1fbaf req-4aa8f8cd-c6a0-4a9f-9ea0-9869c9b54447 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/d07e6569-0a4a-44ce-88a8-cf53c16de2ab HTTP/1.1" status: 200 len: 1801 time: 0.1127098 May 12 15:24:20.980144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38682) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:21.020525 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-34e1a92e-d302-4bb0-ac0b-4673db3a9a65 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/routers/af7c8895-ebb8-47f1-9ffe-cb44562572ed/tags HTTP/1.1" status: 204 len: 168 time: 0.3441334 May 12 15:24:21.021400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38686) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:21.026920 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-98876411-a0cf-4f06-8aa4-7fa8564a6bda tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'af7c8895-ebb8-47f1-9ffe-cb44562572ed', 'tempest-TagsExtTest-Tag-231237540') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:21.098182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7b98fb42-2e77-479d-a4c3-23ffa4f6687e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9e2382be0c6f4779ae64026a57628773&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1166615 May 12 15:24:21.099214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38692) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:21.115770 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-db094c02-24e7-4920-b296-be06f1e1fbaf req-638f1e71-cc01-498b-b16e-bb411f1e6958 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:21.189217 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-db094c02-24e7-4920-b296-be06f1e1fbaf req-638f1e71-cc01-498b-b16e-bb411f1e6958 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:21.276972 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c84a463e-01e8-48b5-b959-822e89c37f12 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:21.326012 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-db094c02-24e7-4920-b296-be06f1e1fbaf req-638f1e71-cc01-498b-b16e-bb411f1e6958 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:21.346626 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c84a463e-01e8-48b5-b959-822e89c37f12 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:21.367225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-638f1e71-cc01-498b-b16e-bb411f1e6958 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d07e6569-0a4a-44ce-88a8-cf53c16de2ab,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:21.419390 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-db094c02-24e7-4920-b296-be06f1e1fbaf req-638f1e71-cc01-498b-b16e-bb411f1e6958 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:21.421643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db094c02-24e7-4920-b296-be06f1e1fbaf req-638f1e71-cc01-498b-b16e-bb411f1e6958 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "DELETE /v2.0/security-groups/d07e6569-0a4a-44ce-88a8-cf53c16de2ab HTTP/1.1" status: 204 len: 173 time: 0.4382303 May 12 15:24:21.453780 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c84a463e-01e8-48b5-b959-822e89c37f12 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:21.489548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c84a463e-01e8-48b5-b959-822e89c37f12 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f046542-1c6c-4513-9f2d-68191e399ef1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:21.498646 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c84a463e-01e8-48b5-b959-822e89c37f12 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:21.500322 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c84a463e-01e8-48b5-b959-822e89c37f12 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9f046542-1c6c-4513-9f2d-68191e399ef1 HTTP/1.1" status: 204 len: 168 time: 0.3977716 May 12 15:24:21.596911 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-98876411-a0cf-4f06-8aa4-7fa8564a6bda tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] show failed (client error): The resource could not be found. May 12 15:24:21.601230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38714) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:21.606662 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-98876411-a0cf-4f06-8aa4-7fa8564a6bda tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/routers/af7c8895-ebb8-47f1-9ffe-cb44562572ed/tags/tempest-TagsExtTest-Tag-231237540 HTTP/1.1" status: 404 len: 328 time: 0.5814729 May 12 15:24:21.609437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-ec7a514c-3b42-44e9-98db-da4e21e2a5c5 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'af7c8895-ebb8-47f1-9ffe-cb44562572ed', 'tempest-TagsExtTest-Tag-1103314709') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:21.742569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a306c21a-a934-4a55-8955-3ede562c61c1 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:24:21.843773 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: a306c21a-a934-4a55-8955-3ede562c61c1 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:24:21.844303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a306c21a-a934-4a55-8955-3ede562c61c1 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:24:22.022228 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-ec7a514c-3b42-44e9-98db-da4e21e2a5c5 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] show failed (client error): The resource could not be found. May 12 15:24:22.025794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ec7a514c-3b42-44e9-98db-da4e21e2a5c5 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/routers/af7c8895-ebb8-47f1-9ffe-cb44562572ed/tags/tempest-TagsExtTest-Tag-1103314709 HTTP/1.1" status: 404 len: 329 time: 0.4208028 May 12 15:24:22.026286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38734) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:22.032017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c829d26-c3aa-4523-97d9-f0d616cfe174 req-75aa64a8-8b94-4c06-bda8-0a1293fb6d64 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/738c04a9-a3ef-44bd-b2b5-86400e968436 HTTP/1.1" status: 200 len: 1803 time: 0.3244274 May 12 15:24:22.032479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-921a4318-43aa-4ba2-9fba-4f7fa2ce93a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'af7c8895-ebb8-47f1-9ffe-cb44562572ed', 'tempest-TagsExtTest-Tag-658219709') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:22.194484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd689c14-9f68-4f41-a1b5-7bc54e779e2b req-e6454ef5-2d64-4285-bf9f-a7a6078b66df tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:22.195887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd689c14-9f68-4f41-a1b5-7bc54e779e2b req-e6454ef5-2d64-4285-bf9f-a7a6078b66df tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2512248 May 12 15:24:22.207985 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9c829d26-c3aa-4523-97d9-f0d616cfe174 req-74e46e8b-d1a9-4686-bc0d-b44f16d7d1fa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:22.289894 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-921a4318-43aa-4ba2-9fba-4f7fa2ce93a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] show failed (client error): The resource could not be found. May 12 15:24:22.292092 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-921a4318-43aa-4ba2-9fba-4f7fa2ce93a9 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/routers/af7c8895-ebb8-47f1-9ffe-cb44562572ed/tags/tempest-TagsExtTest-Tag-658219709 HTTP/1.1" status: 404 len: 328 time: 0.2648928 May 12 15:24:22.296872 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38748) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:22.300903 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9c829d26-c3aa-4523-97d9-f0d616cfe174 req-74e46e8b-d1a9-4686-bc0d-b44f16d7d1fa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:22.305798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-ee2d4a63-11a7-4ed6-9551-5519a650adc8 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnetpools', '58df5eba-028d-45d6-9170-fc3541e3bc02', {'tags': ['tempest-TagsExtTest-Tag-1783875468', 'tempest-TagsExtTest-Tag-720514282', 'tempest-TagsExtTest-Tag-1888163115']}) {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:22.407264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd689c14-9f68-4f41-a1b5-7bc54e779e2b req-8e0db328-dc6f-4b37-b06d-47a1a251df0a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2002649 May 12 15:24:22.453263 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9c829d26-c3aa-4523-97d9-f0d616cfe174 req-74e46e8b-d1a9-4686-bc0d-b44f16d7d1fa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:22.531677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74e46e8b-d1a9-4686-bc0d-b44f16d7d1fa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=738c04a9-a3ef-44bd-b2b5-86400e968436,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:22.571992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9c829d26-c3aa-4523-97d9-f0d616cfe174 req-74e46e8b-d1a9-4686-bc0d-b44f16d7d1fa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:22.587979 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c829d26-c3aa-4523-97d9-f0d616cfe174 req-74e46e8b-d1a9-4686-bc0d-b44f16d7d1fa tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "DELETE /v2.0/security-groups/738c04a9-a3ef-44bd-b2b5-86400e968436 HTTP/1.1" status: 204 len: 173 time: 0.5533922 May 12 15:24:22.610610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-aedbe626-764f-485f-981a-2e9c60e0cf62 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:22.615028 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-aedbe626-764f-485f-981a-2e9c60e0cf62 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.84 "GET /v2.0/networks?id=2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 200 len: 817 time: 0.2745812 May 12 15:24:22.617212 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ee2d4a63-11a7-4ed6-9551-5519a650adc8 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "PUT /v2.0/subnetpools/58df5eba-028d-45d6-9170-fc3541e3bc02/tags HTTP/1.1" status: 200 len: 317 time: 0.3182311 May 12 15:24:22.620263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38762) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:22.626544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-6865b2ad-d489-4f5e-a248-d3cc36f87e7e tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '58df5eba-028d-45d6-9170-fc3541e3bc02') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:22.719609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-57b586a2-3d10-4c4a-88a7-36dc6f44c9d2 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Synchronizing usage tracker for tenant:40852c97262142aeb6d62097955af83f on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:24:22.733204 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6865b2ad-d489-4f5e-a248-d3cc36f87e7e tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/subnetpools/58df5eba-028d-45d6-9170-fc3541e3bc02/tags HTTP/1.1" status: 204 len: 168 time: 0.1077721 May 12 15:24:22.734379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38770) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:22.740558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-59445375-69f0-407a-80a3-efe60b8c1fd4 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '58df5eba-028d-45d6-9170-fc3541e3bc02', 'tempest-TagsExtTest-Tag-1783875468') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:22.789719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-57b586a2-3d10-4c4a-88a7-36dc6f44c9d2 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Unset dirty status for tenant:40852c97262142aeb6d62097955af83f on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:24:22.802666 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-57b586a2-3d10-4c4a-88a7-36dc6f44c9d2 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=40852c97262142aeb6d62097955af83f HTTP/1.1" status: 200 len: 378 time: 0.1628308 May 12 15:24:22.809023 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-59445375-69f0-407a-80a3-efe60b8c1fd4 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] show failed (client error): The resource could not be found. May 12 15:24:22.810932 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-59445375-69f0-407a-80a3-efe60b8c1fd4 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/subnetpools/58df5eba-028d-45d6-9170-fc3541e3bc02/tags/tempest-TagsExtTest-Tag-1783875468 HTTP/1.1" status: 404 len: 329 time: 0.0743847 May 12 15:24:22.814480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38774) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:22.831985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-83d6d442-b67f-4b74-ae73-2dd7efa09a97 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '58df5eba-028d-45d6-9170-fc3541e3bc02', 'tempest-TagsExtTest-Tag-720514282') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:22.860589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Request body: {'port': {'device_id': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'admin_state_up': True, 'tenant_id': '40852c97262142aeb6d62097955af83f', 'security_groups': ['8608e463-6f23-456a-983e-4341787ed2c8']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:22.863427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-298ddee2-8004-45fb-8a46-5abb8d5e044d req-6bcf996a-bbec-48dc-838f-fe60dfb176fc tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 210 time: 0.0888789 May 12 15:24:22.963347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38780) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:23.005793 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-83d6d442-b67f-4b74-ae73-2dd7efa09a97 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] show failed (client error): The resource could not be found. May 12 15:24:23.007690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-83d6d442-b67f-4b74-ae73-2dd7efa09a97 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/subnetpools/58df5eba-028d-45d6-9170-fc3541e3bc02/tags/tempest-TagsExtTest-Tag-720514282 HTTP/1.1" status: 404 len: 328 time: 0.1856470 May 12 15:24:23.015709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38788) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:23.033956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-8784c95d-ceb2-491e-be40-23c344f5127a tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '58df5eba-028d-45d6-9170-fc3541e3bc02', 'tempest-TagsExtTest-Tag-1888163115') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:23.054339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-16186362-fa23-4df5-bf77-479549411f55 req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-2107754248', 'description': 'tempest-description-2075386817'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:23.064022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:23.069691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Usage tracker for resource:port and tenant:40852c97262142aeb6d62097955af83f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:23.072301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-16186362-fa23-4df5-bf77-479549411f55 req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:23.074354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:23.082588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:23.085945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-16186362-fa23-4df5-bf77-479549411f55 req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:23.096279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Made reservation on behalf of 40852c97262142aeb6d62097955af83f for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:24:23.101412 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:23.103756 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5eb17e0-3977-43a2-b596-3d61c3d831bf req-e06f37d8-c7f0-46e4-9765-7e8fe485e5d9 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:23.111436 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5eb17e0-3977-43a2-b596-3d61c3d831bf req-e06f37d8-c7f0-46e4-9765-7e8fe485e5d9 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2469964 May 12 15:24:23.114393 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-16186362-fa23-4df5-bf77-479549411f55 req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:23.135035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-16186362-fa23-4df5-bf77-479549411f55 req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 1 items for resource security_group. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:23.171487 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-8784c95d-ceb2-491e-be40-23c344f5127a tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] show failed (client error): The resource could not be found. May 12 15:24:23.172526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8784c95d-ceb2-491e-be40-23c344f5127a tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/subnetpools/58df5eba-028d-45d6-9170-fc3541e3bc02/tags/tempest-TagsExtTest-Tag-1888163115 HTTP/1.1" status: 404 len: 329 time: 0.1558652 May 12 15:24:23.175604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38794) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:23.182589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-5cc8a36c-749f-4240-884c-c8fdf1646def tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '58df5eba-028d-45d6-9170-fc3541e3bc02') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:23.201310 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-16186362-fa23-4df5-bf77-479549411f55 req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:23.225986 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5eb17e0-3977-43a2-b596-3d61c3d831bf req-4a1d589f-ed4f-46f4-ad86-e81d9ac3a95d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1135256 May 12 15:24:23.233483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1062208242-network', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:23.238506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:23.253557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Usage tracker for resource:network and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:23.262537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:23.274691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:23.314229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Made reservation on behalf of f4660a6351274a7796c2eb1e55a41ec9 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:24:23.316780 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:23.352420 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:23.380922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-16186362-fa23-4df5-bf77-479549411f55 req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:23.398587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Allocated IP 172.20.0.12 (2d986451-1d91-468d-8a9c-ecc4da7a86bc/5f6d45f7-b8bc-4313-879f-ee173c0a4148/0ce28f36-b32c-468c-81e3-0dd235e15282) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:24:23.411755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-16186362-fa23-4df5-bf77-479549411f55 req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Usage tracker for resource:security_group_rule and tenant:86574e26b5194d1f92a51749f063fa69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:23.420519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-16186362-fa23-4df5-bf77-479549411f55 req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:23.428818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:23.459330 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5cc8a36c-749f-4240-884c-c8fdf1646def tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/subnetpools/58df5eba-028d-45d6-9170-fc3541e3bc02/tags HTTP/1.1" status: 204 len: 168 time: 0.2827125 May 12 15:24:23.460700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-16186362-fa23-4df5-bf77-479549411f55 req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:23.463175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Usage tracker for resource:security_group_rule and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:23.469082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38802) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:23.487475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:23.505003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:23.519502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-d46be002-6f85-48b2-823c-3ea1c554a519 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', 'af7c8895-ebb8-47f1-9ffe-cb44562572ed') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:23.676700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:23.704448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Transition to ACTIVE for port object 0ce28f36-b32c-468c-81e3-0dd235e15282 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:23.744721 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:23.786369 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-16186362-fa23-4df5-bf77-479549411f55 req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:23.789749 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d46be002-6f85-48b2-823c-3ea1c554a519 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/routers/af7c8895-ebb8-47f1-9ffe-cb44562572ed/tags HTTP/1.1" status: 204 len: 168 time: 0.3040152 May 12 15:24:23.796947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38814) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:23.799746 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-16186362-fa23-4df5-bf77-479549411f55 req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:23.824048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.tag.tag_plugin [None req-ef4ad8b6-41d5-4e97-b5ab-cfe7ab111abc tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', 'e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:23.914098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event updated for resources: {'Port': ['ID=0ce28f36-b32c-468c-81e3-0dd235e15282,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:23.934713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Network 2d986451-1d91-468d-8a9c-ecc4da7a86bc is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:24:23.936398 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:23.938724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:24:23.988959 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-16186362-fa23-4df5-bf77-479549411f55 req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:23.990306 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16186362-fa23-4df5-bf77-479549411f55 req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1808 time: 0.9658802 May 12 15:24:23.990981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fef05c04-8e5f-476c-8815-ec482a032050 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'SecurityGroup': ['ID=99a8018d-d6d0-4f97-9412-53de815d8b52,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:24.039414 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:24.064526 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:24.067847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:24.068796 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:24.096045 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ef4ad8b6-41d5-4e97-b5ab-cfe7ab111abc tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/ports/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9/tags HTTP/1.1" status: 204 len: 168 time: 0.2976191 May 12 15:24:24.099510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38832) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:24.113936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.tag.tag_plugin [None req-4eac97e5-483c-40b7-9cc4-f53c72ba3c1a tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '241c4d7c-a9c4-4133-9c16-acfdba71a6da') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:24.127705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a76e72-5c3a-4c8f-b2e4-3a352de9e15b req-039b476e-6d60-4700-8ff6-f5d8559b2db5 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:24.133948 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65a76e72-5c3a-4c8f-b2e4-3a352de9e15b req-039b476e-6d60-4700-8ff6-f5d8559b2db5 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2382414 May 12 15:24:24.155488 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 583} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:24:24.195725 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-3aa64413-1267-4400-aaef-d7310c5f0466 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.3414364 May 12 15:24:24.239960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Request body: {'port': {'device_id': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:24.267039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e234105-42d1-4432-9990-ff28bab05ed4,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:24.279454 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:24.279794 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Added segment c54a2125-ccc2-41a0-9a49-29870f0679c2 of type vlan for network e1655f9a-2478-49d5-a6ca-4fec717d6816 May 12 15:24:24.317461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65a76e72-5c3a-4c8f-b2e4-3a352de9e15b req-b0d11cc2-8a0c-4a7c-9e9c-9c76e9b0b32e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1564610 May 12 15:24:24.369701 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:24.390599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-58facb4a-e735-4a31-8e2f-3cb2988cae9f None None] Provisioning for port 0ce28f36-b32c-468c-81e3-0dd235e15282 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:24:24.395880 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-58facb4a-e735-4a31-8e2f-3cb2988cae9f None None] Provisioning complete for port 0ce28f36-b32c-468c-81e3-0dd235e15282 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:24.396244 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-58facb4a-e735-4a31-8e2f-3cb2988cae9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:24.470665 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-58facb4a-e735-4a31-8e2f-3cb2988cae9f None None] Port 0ce28f36-b32c-468c-81e3-0dd235e15282 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:24:24.487950 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:24.513425 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4eac97e5-483c-40b7-9cc4-f53c72ba3c1a tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/subnets/241c4d7c-a9c4-4133-9c16-acfdba71a6da/tags HTTP/1.1" status: 204 len: 168 time: 0.4079185 May 12 15:24:24.516325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38840) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:24.538113 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:24.540597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:24.541253 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:24.707682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9356f60e-6c4d-4c76-8be3-07b63f77f283 req-dd6be895-e375-47d0-bf9b-0729a2435f1d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/99a8018d-d6d0-4f97-9412-53de815d8b52 HTTP/1.1" status: 200 len: 1803 time: 0.2889178 May 12 15:24:24.716772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.7508864 May 12 15:24:24.724808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38844) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:24.737971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-821c6512-726c-4ece-8af4-c518f5be700e admin admin] Pushing event updated for resources: {'Network': ['ID=e1655f9a-2478-49d5-a6ca-4fec717d6816,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:24.744954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-9356f60e-6c4d-4c76-8be3-07b63f77f283 req-b9fcc587-f48f-4b5c-9649-b840146955b6 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Request body: {'security_group': {'name': 'tempest-sg-hth-552490454', 'description': 'tempest-description-hth-740032073'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:24.750981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network e1655f9a-2478-49d5-a6ca-4fec717d6816 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:24:24.781154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Request body: {'subnet': {'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1062208242-subnet', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:24.823694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:24.830889 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9356f60e-6c4d-4c76-8be3-07b63f77f283 req-b9fcc587-f48f-4b5c-9649-b840146955b6 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:24.873842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dbc3037-a534-4ad4-b863-cf23e3516e8d req-e660bab9-415e-4981-90f2-b4825c59dba5 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:24.877860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7dbc3037-a534-4ad4-b863-cf23e3516e8d req-e660bab9-415e-4981-90f2-b4825c59dba5 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 932 time: 0.4570947 May 12 15:24:24.879540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Usage tracker for resource:subnet and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:24.887697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:24.907176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:24.968642 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ed9f48d2-eef9-4377-ad81-eab14203d1a4 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks [] for subnetpool, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:24.972250 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ed9f48d2-eef9-4377-ad81-eab14203d1a4 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/subnetpools/58df5eba-028d-45d6-9170-fc3541e3bc02 HTTP/1.1" status: 204 len: 168 time: 0.4522207 May 12 15:24:24.973291 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9356f60e-6c4d-4c76-8be3-07b63f77f283 req-b9fcc587-f48f-4b5c-9649-b840146955b6 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:24.975448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38850) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:24.977338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Made reservation on behalf of f4660a6351274a7796c2eb1e55a41ec9 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:24:24.979746 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:24.999106 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9356f60e-6c4d-4c76-8be3-07b63f77f283 req-b9fcc587-f48f-4b5c-9649-b840146955b6 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:25.001454 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9356f60e-6c4d-4c76-8be3-07b63f77f283 req-b9fcc587-f48f-4b5c-9649-b840146955b6 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:25.002651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9356f60e-6c4d-4c76-8be3-07b63f77f283 req-b9fcc587-f48f-4b5c-9649-b840146955b6 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "PUT /v2.0/security-groups/99a8018d-d6d0-4f97-9412-53de815d8b52 HTTP/1.1" status: 200 len: 1775 time: 0.2787583 May 12 15:24:25.017857 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7dbc3037-a534-4ad4-b863-cf23e3516e8d req-5704ea17-48e3-4e34-9bad-a63eec951a45 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1266739 May 12 15:24:25.031926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fb25a193-e8ba-4264-a1db-5874124fcf1c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Synchronizing usage tracker for tenant:6b5a1b17b82943a8bf198305bcf7aea6 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:24:25.101819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fb25a193-e8ba-4264-a1db-5874124fcf1c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Unset dirty status for tenant:6b5a1b17b82943a8bf198305bcf7aea6 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:24:25.105593 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fb25a193-e8ba-4264-a1db-5874124fcf1c tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "GET /v2.0/ports?device_id=af7c8895-ebb8-47f1-9ffe-cb44562572ed HTTP/1.1" status: 200 len: 205 time: 0.1284032 May 12 15:24:25.106180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38862) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:25.154838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9fcc587-f48f-4b5c-9649-b840146955b6 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event updated for resources: {'SecurityGroup': ['ID=99a8018d-d6d0-4f97-9412-53de815d8b52,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:25.187462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3147428-d792-408d-9b4a-b84b9f5658f5 req-c36b0518-1920-4c5b-8f17-52c88e0d1d89 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/99a8018d-d6d0-4f97-9412-53de815d8b52 HTTP/1.1" status: 200 len: 1775 time: 0.1022084 May 12 15:24:25.305108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0ce28f36-b32c-468c-81e3-0dd235e15282 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:24:25.316107 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:25.339502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Transition to ACTIVE for port object 0ce28f36-b32c-468c-81e3-0dd235e15282 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:25.366768 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f06cfff9-3c7f-4fad-8e32-217c72fcd85e tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:25.429321 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:25.593783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad2d0a15-9d4a-4b7b-a770-def5c6f2496f req-95ab3d9e-bfc0-4bab-b5c6-7acb7c886169 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:25.600743 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad2d0a15-9d4a-4b7b-a770-def5c6f2496f req-95ab3d9e-bfc0-4bab-b5c6-7acb7c886169 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.3989949 May 12 15:24:25.622635 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:25.701209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60efdfcc-cac0-4607-b37a-f7b7ed672447 req-384a41a7-06fc-4545-8b73-97698f8a3b38 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:25.708969 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60efdfcc-cac0-4607-b37a-f7b7ed672447 req-384a41a7-06fc-4545-8b73-97698f8a3b38 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2661731 May 12 15:24:25.759937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad2d0a15-9d4a-4b7b-a770-def5c6f2496f req-0592573f-86a6-4689-b858-bb84e91472c3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1583173 May 12 15:24:25.840661 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60efdfcc-cac0-4607-b37a-f7b7ed672447 req-f42fe72c-14e4-4340-b65f-731157c6942d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1305540 May 12 15:24:25.841913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=83787d82-d8a5-4f12-a025-f44dcf581189,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:25.857017 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f06cfff9-3c7f-4fad-8e32-217c72fcd85e tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:25.860026 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f06cfff9-3c7f-4fad-8e32-217c72fcd85e tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:25.877885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Checking segment: {'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:24:25.879056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Network hostable DHCP agents. Network: e1655f9a-2478-49d5-a6ca-4fec717d6816, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:24:25.913744 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f06cfff9-3c7f-4fad-8e32-217c72fcd85e tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:25.914447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f06cfff9-3c7f-4fad-8e32-217c72fcd85e tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Fanout notify agent at l3_agent the message router_deleted on router af7c8895-ebb8-47f1-9ffe-cb44562572ed {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:24:25.947247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f95c7fdd-4960-4ad6-acfa-a479c6342229 req-c05afa23-6073-4071-84ca-0efa123f631e tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/99a8018d-d6d0-4f97-9412-53de815d8b52 HTTP/1.1" status: 200 len: 1775 time: 0.1218305 May 12 15:24:25.986499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Network e1655f9a-2478-49d5-a6ca-4fec717d6816 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:24:26.001242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Pushing event updated for resources: {'Port': ['ID=0ce28f36-b32c-468c-81e3-0dd235e15282,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:26.010985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f06cfff9-3c7f-4fad-8e32-217c72fcd85e tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.014988 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f06cfff9-3c7f-4fad-8e32-217c72fcd85e tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/routers/af7c8895-ebb8-47f1-9ffe-cb44562572ed HTTP/1.1" status: 204 len: 168 time: 0.8932381 May 12 15:24:26.017968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38878) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:26.080984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, e1655f9a-2478-49d5-a6ca-4fec717d6816) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:26.089612 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65b0bbfb-f6d7-423d-84ae-8e8a7e0ddf1d None None] Network e1655f9a-2478-49d5-a6ca-4fec717d6816 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:24:26.105186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:26.105717 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.111544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e8ea515a-5a5a-410d-ae38-4ff3bc55ba9f tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Deleting port e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:24:26.111884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8ea515a-5a5a-410d-ae38-4ff3bc55ba9f tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.176173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-314418fd-c283-4ecf-971f-b590dffcc3d4 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.4395933 May 12 15:24:26.179989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38888) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:26.187028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:26.191710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:26.195587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Usage tracker for resource:router and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:26.198478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:26.204942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:26.240354 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f95c7fdd-4960-4ad6-acfa-a479c6342229 req-40af89aa-7938-4197-9c3b-d0a3d3ebc0a9 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.245606 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.246766 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.346946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-e1655f9a-2478-49d5-a6ca-4fec717d6816', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:24:26.348197 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.357107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a9a3fa-570a-4f9e-928b-638af8ca9e3e req-cda116a7-360a-4d6b-981f-6db4b95ea757 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:26.359132 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-97a9a3fa-570a-4f9e-928b-638af8ca9e3e req-cda116a7-360a-4d6b-981f-6db4b95ea757 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.3430061 May 12 15:24:26.380066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f95c7fdd-4960-4ad6-acfa-a479c6342229 req-40af89aa-7938-4197-9c3b-d0a3d3ebc0a9 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.390705 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.458456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Attempting to bind port 0ce28f36-b32c-468c-81e3-0dd235e15282 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:24:26.458798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Attempting to bind port 0ce28f36-b32c-468c-81e3-0dd235e15282 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:24:26.459121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Attempting to bind port 0ce28f36-b32c-468c-81e3-0dd235e15282 on network 2d986451-1d91-468d-8a9c-ecc4da7a86bc {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:24:26.473857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Port 0ce28f36-b32c-468c-81e3-0dd235e15282 on network 2d986451-1d91-468d-8a9c-ecc4da7a86bc not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:24:26.474153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Attempting to bind port 0ce28f36-b32c-468c-81e3-0dd235e15282 on network 2d986451-1d91-468d-8a9c-ecc4da7a86bc {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:24:26.492457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 24, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:24:26.492839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Checking segment: {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:24:26.493173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Bound using segment: {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:24:26.493715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Bound port: 0ce28f36-b32c-468c-81e3-0dd235e15282, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3d061d75-b983-4d78-b567-9627e2250878', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:24:26.494063 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.513879 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8ea515a-5a5a-410d-ae38-4ff3bc55ba9f tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.584676 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Allocated IP 172.20.0.2 (e1655f9a-2478-49d5-a6ca-4fec717d6816/83787d82-d8a5-4f12-a025-f44dcf581189/b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:24:26.648094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-97a9a3fa-570a-4f9e-928b-638af8ca9e3e req-fef10d7e-939e-4d48-833b-c32484c16315 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2703652 May 12 15:24:26.780862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:24:26.782662 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.784091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0ce28f36-b32c-468c-81e3-0dd235e15282,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:24:26.786338 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f95c7fdd-4960-4ad6-acfa-a479c6342229 req-40af89aa-7938-4197-9c3b-d0a3d3ebc0a9 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.812388 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40af89aa-7938-4197-9c3b-d0a3d3ebc0a9 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=99a8018d-d6d0-4f97-9412-53de815d8b52,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:26.890126 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.900993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Transition to ACTIVE for port object b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:26.920430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.935355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e8ea515a-5a5a-410d-ae38-4ff3bc55ba9f tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Calling delete_port for e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:24:26.935998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Transition to ACTIVE for port object b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:26.942017 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.944747 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f95c7fdd-4960-4ad6-acfa-a479c6342229 req-40af89aa-7938-4197-9c3b-d0a3d3ebc0a9 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:26.957995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f95c7fdd-4960-4ad6-acfa-a479c6342229 req-40af89aa-7938-4197-9c3b-d0a3d3ebc0a9 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "DELETE /v2.0/security-groups/99a8018d-d6d0-4f97-9412-53de815d8b52 HTTP/1.1" status: 204 len: 173 time: 1.0028355 May 12 15:24:27.021853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Network e1655f9a-2478-49d5-a6ca-4fec717d6816 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:24:27.030934 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:27.034438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:27.035056 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:27.036533 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] 10.222.0.84 "PUT /v2.0/ports/0ce28f36-b32c-468c-81e3-0dd235e15282 HTTP/1.1" status: 200 len: 1092 time: 2.8091865 May 12 15:24:27.037229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:24:27.045666 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:24:27.277777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c51fa41b-a3b7-45f2-b9b3-937781f62ebf service neutron] Pushing event updated for resources: {'Port': ['ID=0ce28f36-b32c-468c-81e3-0dd235e15282,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:27.285221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01455dba-5095-4cd9-b8b9-5eabc286111e req-411206fa-8fda-4f7d-bc50-4812be1df34d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:27.293859 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01455dba-5095-4cd9-b8b9-5eabc286111e req-411206fa-8fda-4f7d-bc50-4812be1df34d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.4392366 May 12 15:24:27.335882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Pushing event updated for resources: {'Port': ['ID=b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:27.339927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Attempting to bind port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:24:27.339927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Attempting to bind port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:24:27.339927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Attempting to bind port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b on network e1655f9a-2478-49d5-a6ca-4fec717d6816 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:24:27.347208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 24, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:24:27.347753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Checking segment: {'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:24:27.348105 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:27.348999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Bound using segment: {'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:24:27.349551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Bound port: b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:24:27.349980 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:27.428780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-f4302f80-5030-4384-9c22-724262ba820d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:27.430325 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-f4302f80-5030-4384-9c22-724262ba820d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=40852c97262142aeb6d62097955af83f&device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 1095 time: 0.3163984 May 12 15:24:27.523307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] For port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:24:27.528270 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] For port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:24:27.533692 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-53953168-d2d8-4679-953c-b81ace886078 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0ce28f36-b32c-468c-81e3-0dd235e15282 HTTP/1.1" status: 200 len: 217 time: 0.0843914 May 12 15:24:27.546616 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:27.559963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01455dba-5095-4cd9-b8b9-5eabc286111e req-103b2a62-36a5-4c78-b33a-2f60b4f6fa60 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2646229 May 12 15:24:27.600111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8ea515a-5a5a-410d-ae38-4ff3bc55ba9f tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:27.676923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8ea515a-5a5a-410d-ae38-4ff3bc55ba9f tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Pushing event deleted for resources: {'Port': ['ID=e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:27.721800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9b7cdf9-e473-4e8f-a722-7d54933dc8e6 None None] Pushing event updated for resources: {'Port': ['ID=b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:27.834823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-0f9c0fe2-ebd2-4c13-9204-833c7d2a931a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:27.836428 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-0f9c0fe2-ebd2-4c13-9204-833c7d2a931a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5f6d45f7-b8bc-4313-879f-ee173c0a4148 HTTP/1.1" status: 200 len: 856 time: 0.2968514 May 12 15:24:27.907868 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8ea515a-5a5a-410d-ae38-4ff3bc55ba9f tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:27.939047 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e8ea515a-5a5a-410d-ae38-4ff3bc55ba9f tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/ports/e52e91b4-a21b-4e9b-a4a4-a7f1c8a31ed9 HTTP/1.1" status: 204 len: 168 time: 1.9199641 May 12 15:24:27.942127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38912) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:27.953787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3faeafd-6a60-42d4-8ff8-aa70e1ef85e4 req-f2ef5496-92c0-4fb4-8f08-be30b4af680c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:27.960789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3faeafd-6a60-42d4-8ff8-aa70e1ef85e4 req-f2ef5496-92c0-4fb4-8f08-be30b4af680c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.6635921 May 12 15:24:28.026693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-3f9d4d30-89fc-48da-860e-e92997a229cb tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Deleting subnet 241c4d7c-a9c4-4133-9c16-acfdba71a6da {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:24:28.031287 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3f9d4d30-89fc-48da-860e-e92997a229cb tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:28.117573 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3f9d4d30-89fc-48da-860e-e92997a229cb tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:28.170566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-03084570-f366-4d37-b4f2-4082205ad85f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:28.172099 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-03084570-f366-4d37-b4f2-4082205ad85f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2d986451-1d91-468d-8a9c-ecc4da7a86bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3256559 May 12 15:24:28.212070 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:28.288049 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3faeafd-6a60-42d4-8ff8-aa70e1ef85e4 req-6d95fdfc-eab9-4791-87eb-7dba98254c08 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3262219 May 12 15:24:28.301994 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:28.357787 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-fa4e2bf0-c302-421a-98e3-5b9913d6c6ce service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1738925 May 12 15:24:28.383207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dfeebc-4d44-4d28-8560-bbd4cef86d45 req-fdb8d25b-92d2-4dd4-b967-74821000166f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:28.392409 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9dfeebc-4d44-4d28-8560-bbd4cef86d45 req-fdb8d25b-92d2-4dd4-b967-74821000166f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.5804832 May 12 15:24:28.476192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9dfeebc-4d44-4d28-8560-bbd4cef86d45 req-51a1932b-9813-4914-86b7-f77bda30cd11 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0826502 May 12 15:24:28.497662 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d562f26f-462c-4a3d-822f-99b353520899'] response: {'name': 'network-changed', 'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'status': 'completed', 'code': 200} May 12 15:24:28.507653 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3f9d4d30-89fc-48da-860e-e92997a229cb tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:28.572122 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-29daa1f6-cce5-4f82-801a-d7293348cf3d req-a41c4bed-57c8-4963-aeb0-92667a4c56a2 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] show failed (client error): The resource could not be found. May 12 15:24:28.579137 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29daa1f6-cce5-4f82-801a-d7293348cf3d req-a41c4bed-57c8-4963-aeb0-92667a4c56a2 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/738c04a9-a3ef-44bd-b2b5-86400e968436 HTTP/1.1" status: 404 len: 352 time: 0.0665390 May 12 15:24:28.593474 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49ee8f63-9b44-43cf-be8f-060eb87983b9 req-c104f9e6-0a68-4575-8dc3-d3c404deb2a0 service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2260573 May 12 15:24:28.657026 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3f9d4d30-89fc-48da-860e-e92997a229cb tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:28.660410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Allocated IP 172.25.8.102 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/1682faa0-a8c8-4629-bbe3-885bbde7d3bf) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:24:28.807272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f9d4d30-89fc-48da-860e-e92997a229cb tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Pushing event deleted for resources: {'Subnet': ['ID=241c4d7c-a9c4-4133-9c16-acfdba71a6da,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:28.814832 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3f9d4d30-89fc-48da-860e-e92997a229cb tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:28.820982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9196e553-a36d-4339-8216-fdb5ac1b23b0 None None] Network d1a135b1-316c-47d6-9c50-16438ea53de8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:24:28.832684 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3f9d4d30-89fc-48da-860e-e92997a229cb tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/subnets/241c4d7c-a9c4-4133-9c16-acfdba71a6da HTTP/1.1" status: 204 len: 168 time: 0.8895557 May 12 15:24:28.835096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38930) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:29.015599 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:29.029954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c63120-1174-4f82-aeb3-f85b3d3f1620 req-64f630f6-d1a0-41ea-9f66-e8ffeccf54cf tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:29.037482 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52c63120-1174-4f82-aeb3-f85b3d3f1620 req-64f630f6-d1a0-41ea-9f66-e8ffeccf54cf tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.2820773 May 12 15:24:29.065631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02fb837c-b97d-403c-afaf-e52a5ac75546 req-a2a4d8e3-166c-403b-b67e-64467b68c1ef tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:29.067187 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02fb837c-b97d-403c-afaf-e52a5ac75546 req-a2a4d8e3-166c-403b-b67e-64467b68c1ef tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.3737490 May 12 15:24:29.135714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:24:29.180827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-168ced0f-09df-440d-8f79-77a3954aa99d req-ce81bb1c-e491-43c2-9a4f-49e132fae49c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:29.182431 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-168ced0f-09df-440d-8f79-77a3954aa99d req-ce81bb1c-e491-43c2-9a4f-49e132fae49c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=40852c97262142aeb6d62097955af83f&device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 1095 time: 0.4472308 May 12 15:24:29.188887 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:29.228897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Deleting port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:24:29.229339 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:29.251498 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52c63120-1174-4f82-aeb3-f85b3d3f1620 req-a3f308de-9ebc-4ea0-842f-285998791803 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2130530 May 12 15:24:29.270799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:24:29.312638 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02fb837c-b97d-403c-afaf-e52a5ac75546 req-94b6abd6-6ea8-4e9f-b620-5347152ebc17 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1874492 May 12 15:24:29.327656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fef2e998-fbb1-49a7-b694-64e32536eea7 None None] DHCP port deletion for d1a135b1-316c-47d6-9c50-16438ea53de8 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:24:29.332419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fef2e998-fbb1-49a7-b694-64e32536eea7 None None] Deleting port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:24:29.332840 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fef2e998-fbb1-49a7-b694-64e32536eea7 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:29.383096 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:29.420966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17d23975-63d0-41ab-a0f9-a4b92c925c07 None None] Network e1655f9a-2478-49d5-a6ca-4fec717d6816 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:24:29.458885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-168ced0f-09df-440d-8f79-77a3954aa99d req-87282bf8-b029-4374-aa3a-cae7f4c5c13e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:29.460481 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-168ced0f-09df-440d-8f79-77a3954aa99d req-87282bf8-b029-4374-aa3a-cae7f4c5c13e service neutron] 10.222.0.84 "GET /v2.0/networks?id=2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 200 len: 918 time: 0.2680373 May 12 15:24:29.479684 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-78f103ba-7127-4cee-98c5-bf5a7b349529 req-b771e8e7-0d85-4112-9174-aead5e3f14d6 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] show failed (client error): The resource could not be found. May 12 15:24:29.491756 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78f103ba-7127-4cee-98c5-bf5a7b349529 req-b771e8e7-0d85-4112-9174-aead5e3f14d6 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/d07e6569-0a4a-44ce-88a8-cf53c16de2ab HTTP/1.1" status: 404 len: 352 time: 0.1441970 May 12 15:24:29.590947 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-168ced0f-09df-440d-8f79-77a3954aa99d req-a20af5b1-14e0-4adb-87be-5d70468948ce service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0ce28f36-b32c-468c-81e3-0dd235e15282 HTTP/1.1" status: 200 len: 217 time: 0.0901065 May 12 15:24:29.650060 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:24:29.664937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Pushing event updated for resources: {'Port': ['ID=1682faa0-a8c8-4629-bbe3-885bbde7d3bf,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:29.679678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:29.682633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:24:29.728884 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-2b0113e3-d161-4d1b-921e-edd85c45dd39 req-4f3cbaf0-43fa-4641-8dde-11aa5b85a1a2 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] show failed (client error): The resource could not be found. May 12 15:24:29.745760 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b0113e3-d161-4d1b-921e-edd85c45dd39 req-4f3cbaf0-43fa-4641-8dde-11aa5b85a1a2 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/e8e0e0d8-e930-41af-8e5d-681965361b35 HTTP/1.1" status: 404 len: 352 time: 0.1793823 May 12 15:24:29.764983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4cbad5f0-e831-4919-a983-5fb04403dbb6 None None] Provisioning for port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:24:29.788379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4cbad5f0-e831-4919-a983-5fb04403dbb6 None None] Provisioning complete for port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:29.788752 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cbad5f0-e831-4919-a983-5fb04403dbb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:29.929122 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-168ced0f-09df-440d-8f79-77a3954aa99d req-bc2bed66-757b-4050-b656-1f2ef2cdb40f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:29.930579 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-168ced0f-09df-440d-8f79-77a3954aa99d req-bc2bed66-757b-4050-b656-1f2ef2cdb40f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5f6d45f7-b8bc-4313-879f-ee173c0a4148 HTTP/1.1" status: 200 len: 856 time: 0.3321376 May 12 15:24:30.012205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-519e82c5-6e31-4033-a6ff-cd08cf7e536e req-0a54584d-5870-4b65-8dbf-f2767eb2eb14 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:30.020903 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-519e82c5-6e31-4033-a6ff-cd08cf7e536e req-0a54584d-5870-4b65-8dbf-f2767eb2eb14 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.5070658 May 12 15:24:30.069715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] For port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c,segment=NetworkSegment(e5d8a6a0-c3d7-4731-af72-b087ae1cd96c),segment_id=e5d8a6a0-c3d7-4731-af72-b087ae1cd96c)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:30.070584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:30.173716 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-fef2e998-fbb1-49a7-b694-64e32536eea7 None None] For port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c,segment=NetworkSegment(e5d8a6a0-c3d7-4731-af72-b087ae1cd96c),segment_id=e5d8a6a0-c3d7-4731-af72-b087ae1cd96c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:30.174292 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fef2e998-fbb1-49a7-b694-64e32536eea7 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:30.232248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Calling delete_port for 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:24:30.251199 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-519e82c5-6e31-4033-a6ff-cd08cf7e536e req-b3633ffa-d856-41b9-b445-eb2713516124 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2290931 May 12 15:24:30.354627 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:30.374154 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-12d8a52d-67f5-4830-889e-3b59b8139712 req-0ffc4b1a-1df1-480e-8384-41e95734c34f tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] show failed (client error): The resource could not be found. May 12 15:24:30.394614 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12d8a52d-67f5-4830-889e-3b59b8139712 req-0ffc4b1a-1df1-480e-8384-41e95734c34f tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/05e9c670-cc39-4a14-88fe-60d00bd91864 HTTP/1.1" status: 404 len: 352 time: 0.0914731 May 12 15:24:30.415930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4704c8bb-1d1a-449c-8b15-d91f867325b1 req-0a97293f-12bf-41f1-bfc5-3b57e7df11d5 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:30.428167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4704c8bb-1d1a-449c-8b15-d91f867325b1 req-0a97293f-12bf-41f1-bfc5-3b57e7df11d5 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.4256239 May 12 15:24:30.431299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fef2e998-fbb1-49a7-b694-64e32536eea7 None None] Calling delete_port for 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:24:30.464786 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cbad5f0-e831-4919-a983-5fb04403dbb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:30.478948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] No DVR routers for this DVR port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:24:30.527905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Pushing event deleted for resources: {'Port': ['ID=9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:30.559129 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-fef2e998-fbb1-49a7-b694-64e32536eea7 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:24:30.560121 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-fef2e998-fbb1-49a7-b694-64e32536eea7 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:24:30.562269 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4cbad5f0-e831-4919-a983-5fb04403dbb6 None None] For port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:30.568353 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cbad5f0-e831-4919-a983-5fb04403dbb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:30.607533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-168ced0f-09df-440d-8f79-77a3954aa99d req-2d4a9033-915a-451f-9fea-2188a2477ea4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:30.609029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-168ced0f-09df-440d-8f79-77a3954aa99d req-2d4a9033-915a-451f-9fea-2188a2477ea4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2d986451-1d91-468d-8a9c-ecc4da7a86bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.6699908 May 12 15:24:30.662043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cbad5f0-e831-4919-a983-5fb04403dbb6 None None] Pushing event updated for resources: {'Port': ['ID=b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:30.695047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e40cd0db-228f-49e5-b06b-b23d740fa0a5 None None] Provisioning complete for port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:30.695363 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e40cd0db-228f-49e5-b06b-b23d740fa0a5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:30.708244 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:30.720336 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4704c8bb-1d1a-449c-8b15-d91f867325b1 req-5d8a2027-e2e9-407e-98ed-d7c402f8583d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2909131 May 12 15:24:30.767350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d1a135b1-316c-47d6-9c50-16438ea53de8']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:30.804286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e5d8a6a0-c3d7-4731-af72-b087ae1cd96c') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:30.804579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e5d8a6a0-c3d7-4731-af72-b087ae1cd96c') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:30.879416 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:30.923828 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-5fac7932-a0a3-449d-a6e5-c93dd3e6f94c req-314d8509-248d-4c67-89d4-165dd3076388 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] show failed (client error): The resource could not be found. May 12 15:24:30.929977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5fac7932-a0a3-449d-a6e5-c93dd3e6f94c req-314d8509-248d-4c67-89d4-165dd3076388 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/54a649c9-7554-49a7-b278-2f99b9e96651 HTTP/1.1" status: 404 len: 352 time: 0.0781002 May 12 15:24:30.961810 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:30.966159 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-168ced0f-09df-440d-8f79-77a3954aa99d req-c7077576-7490-4363-bb0d-286cd1a12b20 service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3394346 May 12 15:24:30.973537 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Releasing vlan 589 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:24:30.975907 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: timer() May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:24:31.009237 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:24:31.041376 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:31.061814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fef2e998-fbb1-49a7-b694-64e32536eea7 None None] Deleting port 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:24:31.062195 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fef2e998-fbb1-49a7-b694-64e32536eea7 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:31.158714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:24:31.221001 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fef2e998-fbb1-49a7-b694-64e32536eea7 None None] The port '9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:24:31.222809 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:31.261496 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:31.297020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:31.298217 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:31.316751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] Pushing event deleted for resources: {'Network': ['ID=d1a135b1-316c-47d6-9c50-16438ea53de8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:31.332252 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7d7e27a4-0174-455f-bbd7-0df218db1656 tempest-TagsExtTest-1757705290 tempest-TagsExtTest-1757705290-project] 10.222.0.82 "DELETE /v2.0/networks/d1a135b1-316c-47d6-9c50-16438ea53de8 HTTP/1.1" status: 204 len: 168 time: 2.4961364 May 12 15:24:31.352942 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-168ced0f-09df-440d-8f79-77a3954aa99d req-7ce0e91d-1969-433f-8a83-e8470b3d1f6c service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3358889 May 12 15:24:31.562087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34f8b870-69c7-4bba-8ba8-9220100031c9 req-bf620b4e-9846-438b-8614-2cbe2bed914f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:31.568207 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34f8b870-69c7-4bba-8ba8-9220100031c9 req-bf620b4e-9846-438b-8614-2cbe2bed914f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.6249981 May 12 15:24:31.584823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc75ad3f-4d6f-44c1-817b-2173ed955801 req-2cde2beb-5493-40bb-b3c7-064e425035df tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:31.592410 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc75ad3f-4d6f-44c1-817b-2173ed955801 req-2cde2beb-5493-40bb-b3c7-064e425035df tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.4729207 May 12 15:24:31.664053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38974) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:31.710817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:24:31.752030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:24:31.752284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9ea3cc77-e6b0-4318-9ac5-37c6bdf9eb2c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:24:31.772143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc75ad3f-4d6f-44c1-817b-2173ed955801 req-800c9f0d-84a2-4039-8f8e-e89c65537978 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1785698 May 12 15:24:31.804795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0ce28f36-b32c-468c-81e3-0dd235e15282 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:24:31.812277 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34f8b870-69c7-4bba-8ba8-9220100031c9 req-852e108c-86e1-455f-b31e-f4d5d072b946 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2416508 May 12 15:24:31.895476 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-86dfd06b-c49b-4083-afbc-c01b6be87304 req-ced933e1-258c-4a29-9c67-b4e559c9ed82 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] show failed (client error): The resource could not be found. May 12 15:24:31.898099 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86dfd06b-c49b-4083-afbc-c01b6be87304 req-ced933e1-258c-4a29-9c67-b4e559c9ed82 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/c246a045-56d5-4699-8953-672328356429 HTTP/1.1" status: 404 len: 352 time: 0.0625522 May 12 15:24:31.900791 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:31.968465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0ce28f36-b32c-468c-81e3-0dd235e15282,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:31.982748 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'port_id': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'mac_address': 'fa:16:3e:c4:85:6e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 558, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:24:32.039230 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-29965114-d586-480f-ad73-c98d3ae05eb2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6b5a1b17b82943a8bf198305bcf7aea6&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3739474 May 12 15:24:32.041789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38984) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:32.104141 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:32.183414 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0ce28f36-b32c-468c-81e3-0dd235e15282 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:24:32.207174 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0ce28f36-b32c-468c-81e3-0dd235e15282,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:32.233231 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:32.279035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c30dc83b-2bf0-4523-9e2f-ea2bed9f971c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:32.313346 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c30dc83b-2bf0-4523-9e2f-ea2bed9f971c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:32.379950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=0ce28f36-b32c-468c-81e3-0dd235e15282,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:32.429840 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:32.437616 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c30dc83b-2bf0-4523-9e2f-ea2bed9f971c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:32.454510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3756deea-97b8-4b86-9230-d76dcd8030b4 req-e71ff15f-fcc5-436c-bb30-72dd6338b3aa tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:32.455780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c30dc83b-2bf0-4523-9e2f-ea2bed9f971c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33c3ec82-c16e-4cdc-b99c-33be4f3d7bd0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:32.455977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3756deea-97b8-4b86-9230-d76dcd8030b4 req-e71ff15f-fcc5-436c-bb30-72dd6338b3aa tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=914409b3-8c2c-4574-af4a-2eb14f6d1ad9 HTTP/1.1" status: 200 len: 946 time: 0.4295819 May 12 15:24:32.477133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d3a614b-b0d0-4ec0-b3b6-2d88d19cc9b3 req-8a99783c-502c-4b32-aed5-f196b6a31d9d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:32.484558 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d3a614b-b0d0-4ec0-b3b6-2d88d19cc9b3 req-8a99783c-502c-4b32-aed5-f196b6a31d9d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.4566648 May 12 15:24:32.507560 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c30dc83b-2bf0-4523-9e2f-ea2bed9f971c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:32.511346 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c30dc83b-2bf0-4523-9e2f-ea2bed9f971c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/33c3ec82-c16e-4cdc-b99c-33be4f3d7bd0 HTTP/1.1" status: 204 len: 168 time: 0.4658203 May 12 15:24:32.557334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:24:32.568253 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3756deea-97b8-4b86-9230-d76dcd8030b4 req-078ea12c-585d-49bb-81b0-673436edf2f3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0809557 May 12 15:24:32.581239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e47827e-2e7e-44da-bea7-1b2438e363f8 req-e5a56e3f-288e-4ad5-b711-361863c81b54 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:32.583837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-2e47827e-2e7e-44da-bea7-1b2438e363f8 req-e5a56e3f-288e-4ad5-b711-361863c81b54 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Synchronizing usage tracker for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:24:32.605295 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d3a614b-b0d0-4ec0-b3b6-2d88d19cc9b3 req-2f88523c-3897-4e2c-89b1-91328ad8bdcc tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1112199 May 12 15:24:32.618074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['0ce28f36-b32c-468c-81e3-0dd235e15282'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:24:32.628333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-2e47827e-2e7e-44da-bea7-1b2438e363f8 req-e5a56e3f-288e-4ad5-b711-361863c81b54 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Unset dirty status for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:24:32.633090 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2e47827e-2e7e-44da-bea7-1b2438e363f8 req-e5a56e3f-288e-4ad5-b711-361863c81b54 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "GET /v2.0/ports?device_id=914409b3-8c2c-4574-af4a-2eb14f6d1ad9 HTTP/1.1" status: 200 len: 946 time: 0.1787477 May 12 15:24:32.869971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-2e47827e-2e7e-44da-bea7-1b2438e363f8 req-01b8ddc1-945d-4710-9589-d751dff8b150 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Deleting port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:24:32.870925 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2e47827e-2e7e-44da-bea7-1b2438e363f8 req-01b8ddc1-945d-4710-9589-d751dff8b150 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:33.023539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdc25119-0d4e-4bdd-b47f-598ce1f22a56 req-b5f43bcd-96a9-4dc4-bb40-0c613c380622 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:33.026123 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdc25119-0d4e-4bdd-b47f-598ce1f22a56 req-b5f43bcd-96a9-4dc4-bb40-0c613c380622 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2269886 May 12 15:24:33.030558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:24:33.088829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Sync routers for ids ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:24:33.156952 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Routers {'0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:24:33.158040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:24:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:33.170458 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:33.170835 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d91c404b-ccfd-483b-aa82-5993c2693bc6 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 6.9893415 May 12 15:24:33.177065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39006) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:33.308356 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdc25119-0d4e-4bdd-b47f-598ce1f22a56 req-b7ac8505-8080-4401-9d99-b8bab915155e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2453604 May 12 15:24:33.537146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2e47827e-2e7e-44da-bea7-1b2438e363f8 req-01b8ddc1-945d-4710-9589-d751dff8b150 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] For port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:33.541359 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2e47827e-2e7e-44da-bea7-1b2438e363f8 req-01b8ddc1-945d-4710-9589-d751dff8b150 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:33.564560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Set router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:24:33.709969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-2e47827e-2e7e-44da-bea7-1b2438e363f8 req-01b8ddc1-945d-4710-9589-d751dff8b150 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Calling delete_port for c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:24:33.961799 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2e47827e-2e7e-44da-bea7-1b2438e363f8 req-01b8ddc1-945d-4710-9589-d751dff8b150 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:33.981836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:24:34.102778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:30Z', 'revision_number': 3, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:28Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:34.115431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Checking router: 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:24:34.116087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Updating router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c port 1682faa0-a8c8-4629-bbe3-885bbde7d3bf binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:24:34.126501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01b8ddc1-945d-4710-9589-d751dff8b150 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Pushing event deleted for resources: {'Port': ['ID=c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:34.172040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-521bc110-f19d-4fba-b169-839fdb985aac req-a6ff60e1-821d-4e4a-abe6-cd2b445db4ad tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:34.179011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-521bc110-f19d-4fba-b169-839fdb985aac req-a6ff60e1-821d-4e4a-abe6-cd2b445db4ad tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 945 time: 0.7523613 May 12 15:24:34.217336 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:34.287277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0526465a-51c1-4213-8b7f-4fb69c1977e8 req-b1b646cf-f641-4570-9294-d3b9d595b02c tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:34.296240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0526465a-51c1-4213-8b7f-4fb69c1977e8 req-b1b646cf-f641-4570-9294-d3b9d595b02c tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 1024 time: 0.4040358 May 12 15:24:34.324227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-2e47827e-2e7e-44da-bea7-1b2438e363f8 req-01b8ddc1-945d-4710-9589-d751dff8b150 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] No DVR routers for this DVR port c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:24:34.331924 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2e47827e-2e7e-44da-bea7-1b2438e363f8 req-01b8ddc1-945d-4710-9589-d751dff8b150 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:34.338033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '914409b3-8c2c-4574-af4a-2eb14f6d1ad9', 'name': 'network-vif-deleted', 'tag': 'c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:24:34.374398 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2e47827e-2e7e-44da-bea7-1b2438e363f8 req-01b8ddc1-945d-4710-9589-d751dff8b150 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "DELETE /v2.0/ports/c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 HTTP/1.1" status: 204 len: 173 time: 1.7352791 May 12 15:24:34.378768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-521bc110-f19d-4fba-b169-839fdb985aac req-8709208c-cac6-4c1a-8ea7-9b07441fad48 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1989088 May 12 15:24:34.590209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0526465a-51c1-4213-8b7f-4fb69c1977e8 req-07ca2705-18c5-4280-8bf4-ddcd1c8e088d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Synchronizing usage tracker for tenant:86574e26b5194d1f92a51749f063fa69 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:24:34.684526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0526465a-51c1-4213-8b7f-4fb69c1977e8 req-07ca2705-18c5-4280-8bf4-ddcd1c8e088d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Unset dirty status for tenant:86574e26b5194d1f92a51749f063fa69 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:24:34.697998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0526465a-51c1-4213-8b7f-4fb69c1977e8 req-07ca2705-18c5-4280-8bf4-ddcd1c8e088d tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=5f153cae-50a1-4084-94aa-1b5bb113ef0a&id=9887b154-c2ee-411c-adde-fd90b2df6d88&id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 516 time: 0.4008174 May 12 15:24:35.014146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b447eb9b-2beb-4c2c-99d3-868e9679f5a2 req-688e3f42-a7c0-48df-9472-1676d60e44ca tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:35.019500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b447eb9b-2beb-4c2c-99d3-868e9679f5a2 req-688e3f42-a7c0-48df-9472-1676d60e44ca tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Synchronizing usage tracker for tenant:86574e26b5194d1f92a51749f063fa69 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:24:35.068094 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:35.077046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b447eb9b-2beb-4c2c-99d3-868e9679f5a2 req-688e3f42-a7c0-48df-9472-1676d60e44ca tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Unset dirty status for tenant:86574e26b5194d1f92a51749f063fa69 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:24:35.088765 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b447eb9b-2beb-4c2c-99d3-868e9679f5a2 req-688e3f42-a7c0-48df-9472-1676d60e44ca tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.84 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 1024 time: 0.2242928 May 12 15:24:35.101116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Transition to ACTIVE for port object 1682faa0-a8c8-4629-bbe3-885bbde7d3bf will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:35.120419 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:35.160831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e3b532-99cb-4c62-9aa9-01db7d0e8864 req-2c7683ad-ffe6-46ae-b802-b6aade10c2ff tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:35.178152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56e3b532-99cb-4c62-9aa9-01db7d0e8864 req-2c7683ad-ffe6-46ae-b802-b6aade10c2ff tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.5805118 May 12 15:24:35.315940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-b447eb9b-2beb-4c2c-99d3-868e9679f5a2 req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Deleting port 3665052f-787a-44a4-bee0-3335df3f44a6 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:24:35.316220 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b447eb9b-2beb-4c2c-99d3-868e9679f5a2 req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:35.367554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56e3b532-99cb-4c62-9aa9-01db7d0e8864 req-72742a16-37ea-415f-9596-3bc05a446f4d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1884415 May 12 15:24:35.379637 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:35.470367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Attempting to bind port 1682faa0-a8c8-4629-bbe3-885bbde7d3bf on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:24:35.470639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Attempting to bind port 1682faa0-a8c8-4629-bbe3-885bbde7d3bf by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:24:35.471042 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Attempting to bind port 1682faa0-a8c8-4629-bbe3-885bbde7d3bf on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:24:35.479431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 24, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:24:35.479855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:24:35.480187 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:35.480568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:24:35.481066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Bound port: 1682faa0-a8c8-4629-bbe3-885bbde7d3bf, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:24:35.481427 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:35.510472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd30cbbb-4e48-44e8-b1fd-4abfed30070a req-89393d31-005c-4599-b0a1-7744b9becb93 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:35.519908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-925be286-20d7-4b0c-8cf2-80f09054b72a None None] Pushing event updated for resources: {'Port': ['ID=1682faa0-a8c8-4629-bbe3-885bbde7d3bf,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:35.522144 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd30cbbb-4e48-44e8-b1fd-4abfed30070a req-89393d31-005c-4599-b0a1-7744b9becb93 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.6652987 May 12 15:24:35.632896 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] For port 1682faa0-a8c8-4629-bbe3-885bbde7d3bf, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:24:35.655173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] For port 1682faa0-a8c8-4629-bbe3-885bbde7d3bf, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1682faa0-a8c8-4629-bbe3-885bbde7d3bf,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:24:35.671559 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:35.754622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-925be286-20d7-4b0c-8cf2-80f09054b72a None None] Pushing event updated for resources: {'Port': ['ID=1682faa0-a8c8-4629-bbe3-885bbde7d3bf,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:35.779781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Routers {'0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:24:35.782395 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:24:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:35.848196 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0ce28f36-b32c-468c-81e3-0dd235e15282 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:24:35.851054 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1fb38737-51df-4e63-af6d-b38b72642a5e req-c9a2f249-16ff-4727-8a0d-98e325c0e338 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=914409b3-8c2c-4574-af4a-2eb14f6d1ad9 HTTP/1.1" status: 200 len: 210 time: 0.1423385 May 12 15:24:35.888652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd30cbbb-4e48-44e8-b1fd-4abfed30070a req-db795b8c-16b9-4608-8ef0-a79be1923868 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3655078 May 12 15:24:35.965444 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c53b3568-ae70-4100-bd61-8ba7f21a54c2'] response: {'server_uuid': '914409b3-8c2c-4574-af4a-2eb14f6d1ad9', 'name': 'network-vif-deleted', 'tag': 'c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735', 'status': 'completed', 'code': 200} May 12 15:24:36.160104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b447eb9b-2beb-4c2c-99d3-868e9679f5a2 req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] For port 3665052f-787a-44a4-bee0-3335df3f44a6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3665052f-787a-44a4-bee0-3335df3f44a6,segment=NetworkSegment(2b9a3118-674a-42bd-be1d-3a0efcec85f0),segment_id=2b9a3118-674a-42bd-be1d-3a0efcec85f0)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:36.160788 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b447eb9b-2beb-4c2c-99d3-868e9679f5a2 req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:36.270604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 0ce28f36-b32c-468c-81e3-0dd235e15282 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:24:36.334095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 0ce28f36-b32c-468c-81e3-0dd235e15282 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:36.337807 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:36.396637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Allocated IP 172.20.0.1 (e1655f9a-2478-49d5-a6ca-4fec717d6816/83787d82-d8a5-4f12-a025-f44dcf581189/42a2c229-d13e-4ea9-b530-c7d65e4999da) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:24:36.530462 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] Set router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:24:36.541260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-b447eb9b-2beb-4c2c-99d3-868e9679f5a2 req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Calling delete_port for 3665052f-787a-44a4-bee0-3335df3f44a6 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:24:36.706093 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:36.725183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Transition to ACTIVE for port object 42a2c229-d13e-4ea9-b530-c7d65e4999da will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:36.760545 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:36.812381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Network e1655f9a-2478-49d5-a6ca-4fec717d6816 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:24:36.821424 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:36.836627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:24:36.853243 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:36.895814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0ce28f36-b32c-468c-81e3-0dd235e15282,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:36.899652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:24:36.908159 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:37.078590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39078) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:37.101316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:24:37.117210 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:37.155129 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b447eb9b-2beb-4c2c-99d3-868e9679f5a2 req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:37.251842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:24:37.252179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device c64aa0e6-ce2d-4eb8-9cbf-0a0219d08735 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:24:37.285803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=0ce28f36-b32c-468c-81e3-0dd235e15282,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:37.318259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-600db6f0-3161-45d8-845e-476ef4f94c34 req-53ef9ce3-fda6-4783-8c83-b409907adc8b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:37.330077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-600db6f0-3161-45d8-845e-476ef4f94c34 req-53ef9ce3-fda6-4783-8c83-b409907adc8b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 945 time: 1.1587534 May 12 15:24:37.398636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c20b4ca7-8cc6-4fbc-9599-40a12caf954b req-37a136dc-2581-45d2-b432-02a78eac3f71 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:37.414297 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c20b4ca7-8cc6-4fbc-9599-40a12caf954b req-37a136dc-2581-45d2-b432-02a78eac3f71 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/ports?device_id=9848e953-d1fb-4bb4-8995-1f62bf3efd1c HTTP/1.1" status: 200 len: 1024 time: 1.0257108 May 12 15:24:37.458134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:30Z', 'revision_number': 3, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:37.468094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-18250b0f-6733-474d-86f0-6c3b96533f4d None None] Provisioning for port 42a2c229-d13e-4ea9-b530-c7d65e4999da completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:24:37.482785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-18250b0f-6733-474d-86f0-6c3b96533f4d None None] Provisioning complete for port 42a2c229-d13e-4ea9-b530-c7d65e4999da triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:37.485876 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-18250b0f-6733-474d-86f0-6c3b96533f4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:37.514328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event deleted for resources: {'Port': ['ID=3665052f-787a-44a4-bee0-3335df3f44a6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:37.541404 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a49e8998-f0f0-4a70-9eda-9c9117d9c010 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:37.564091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-b447eb9b-2beb-4c2c-99d3-868e9679f5a2 req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] No DVR routers for this DVR port 3665052f-787a-44a4-bee0-3335df3f44a6 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:24:37.568396 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c20b4ca7-8cc6-4fbc-9599-40a12caf954b req-8b7a5738-612e-4d17-a1d3-255ddb235dd5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups?id=5f153cae-50a1-4084-94aa-1b5bb113ef0a&id=9887b154-c2ee-411c-adde-fd90b2df6d88&id=b0aae945-e0f0-419f-88b0-e0606e730ccb&fields=id&fields=name HTTP/1.1" status: 200 len: 516 time: 0.1527607 May 12 15:24:37.568530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:37.568960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:37.569173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Pushing event updated for resources: {'Port': ['ID=42a2c229-d13e-4ea9-b530-c7d65e4999da,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:37.569276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:37.569542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:37.569876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:37.570192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:37.570559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:37.570889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:37.571254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:37.571584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:37.571892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:37.572219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:37.575727 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b447eb9b-2beb-4c2c-99d3-868e9679f5a2 req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:37.610397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a49e8998-f0f0-4a70-9eda-9c9117d9c010 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:37.618632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a49e8998-f0f0-4a70-9eda-9c9117d9c010 admin admin] Usage tracker for resource:security_group_rule and tenant:b343637187684432b6b2cb0861fa79de is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:37.627048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a49e8998-f0f0-4a70-9eda-9c9117d9c010 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:37.628797 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bc80699-0875-4f33-b6f2-e95aed902bf0 None None] The sync data for ids ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'] in n-d-841483-1 is: [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:30Z', 'revision_number': 3, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:24:37.657290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a49e8998-f0f0-4a70-9eda-9c9117d9c010 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:37.673516 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-600db6f0-3161-45d8-845e-476ef4f94c34 req-1e200741-b1c7-446c-a0dc-1810c592467f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.3417342 May 12 15:24:37.707130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-18250b0f-6733-474d-86f0-6c3b96533f4d None None] Port 42a2c229-d13e-4ea9-b530-c7d65e4999da cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:24:37.804727 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b447eb9b-2beb-4c2c-99d3-868e9679f5a2 req-f8ec963a-a68e-4961-b496-5a078a70bcaf tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.84 "DELETE /v2.0/ports/3665052f-787a-44a4-bee0-3335df3f44a6 HTTP/1.1" status: 204 len: 173 time: 2.7105329 May 12 15:24:37.823368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3665052f-787a-44a4-bee0-3335df3f44a6 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:24:37.905379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 3665052f-787a-44a4-bee0-3335df3f44a6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:24:37.905763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3665052f-787a-44a4-bee0-3335df3f44a6 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:24:37.967361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9848e953-d1fb-4bb4-8995-1f62bf3efd1c', 'name': 'network-vif-deleted', 'tag': '3665052f-787a-44a4-bee0-3335df3f44a6'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:24:37.973023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a49e8998-f0f0-4a70-9eda-9c9117d9c010 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:37.989344 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a49e8998-f0f0-4a70-9eda-9c9117d9c010 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:38.103517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a49e8998-f0f0-4a70-9eda-9c9117d9c010 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=45c06ef4-371e-4c75-9fe9-31a43be1991e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:38.116166 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a49e8998-f0f0-4a70-9eda-9c9117d9c010 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b343637187684432b6b2cb0861fa79de&name=default HTTP/1.1" status: 200 len: 2983 time: 1.0365047 May 12 15:24:38.116781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39100) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:38.163148 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:38.227813 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fdf0489f-d967-4b8f-9713-242edb406c74 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:38.269360 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fdf0489f-d967-4b8f-9713-242edb406c74 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:38.365871 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fdf0489f-d967-4b8f-9713-242edb406c74 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:38.415282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdf0489f-d967-4b8f-9713-242edb406c74 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=45c06ef4-371e-4c75-9fe9-31a43be1991e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:38.433466 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fdf0489f-d967-4b8f-9713-242edb406c74 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:38.437873 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fdf0489f-d967-4b8f-9713-242edb406c74 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/45c06ef4-371e-4c75-9fe9-31a43be1991e HTTP/1.1" status: 204 len: 168 time: 0.3173501 May 12 15:24:38.738748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e695bd0a-c1ba-450e-b68b-0d3ee11e792f req-cf43a76e-08ca-431d-aa60-fe5f6a268d78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:38.742053 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e695bd0a-c1ba-450e-b68b-0d3ee11e792f req-cf43a76e-08ca-431d-aa60-fe5f6a268d78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.6893487 May 12 15:24:38.760591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e10f0d-0eb3-4a2d-b205-86e88d0dbda6 req-4f2e7489-15f4-4611-b5f6-87fbccaf713e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:38.762880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19e10f0d-0eb3-4a2d-b205-86e88d0dbda6 req-4f2e7489-15f4-4611-b5f6-87fbccaf713e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.8700154 May 12 15:24:38.847042 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:38.862593 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:38.898950 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e695bd0a-c1ba-450e-b68b-0d3ee11e792f req-09b590e1-3ad8-4265-aa52-f97184244974 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1333365 May 12 15:24:38.971443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19e10f0d-0eb3-4a2d-b205-86e88d0dbda6 req-645483d5-383f-4166-a06d-a738ddb5a8a7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1880667 May 12 15:24:38.993786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Pushing event updated for resources: {'Port': ['ID=42a2c229-d13e-4ea9-b530-c7d65e4999da,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:39.019415 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:39.040179 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-95743db6-36a6-46da-adaa-2e2973d873e1'] response: {'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'code': 200} May 12 15:24:39.084152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39122) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:39.131469 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a5de0969-09ea-4eeb-a29d-a7cc72cd3b6c'] response: {'server_uuid': '9848e953-d1fb-4bb4-8995-1f62bf3efd1c', 'name': 'network-vif-deleted', 'tag': '3665052f-787a-44a4-bee0-3335df3f44a6', 'status': 'completed', 'code': 200} May 12 15:24:39.143995 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9b47bd87-baac-4d30-93fb-e204d1675f85 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:39.166604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1682faa0-a8c8-4629-bbe3-885bbde7d3bf up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:24:39.277812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9b47bd87-baac-4d30-93fb-e204d1675f85 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:39.302231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9b47bd87-baac-4d30-93fb-e204d1675f85 admin admin] Usage tracker for resource:security_group_rule and tenant:13574e566c1445979b465489d40946dc is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:39.332507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9b47bd87-baac-4d30-93fb-e204d1675f85 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:39.346892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9b47bd87-baac-4d30-93fb-e204d1675f85 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:39.417325 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 1682faa0-a8c8-4629-bbe3-885bbde7d3bf completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:24:39.427379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 1682faa0-a8c8-4629-bbe3-885bbde7d3bf triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:39.427699 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:39.450886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1945ca27-bbd4-434b-9199-0c09a9c12cb0 req-453ec3fb-db9d-4f22-b9b2-20b2e4c9675a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:39.452963 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1945ca27-bbd4-434b-9199-0c09a9c12cb0 req-453ec3fb-db9d-4f22-b9b2-20b2e4c9675a service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 1097 time: 0.2827895 May 12 15:24:39.511488 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Network e1655f9a-2478-49d5-a6ca-4fec717d6816 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:24:39.514588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:39.629026 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1945ca27-bbd4-434b-9199-0c09a9c12cb0 req-486afb26-c331-493b-856b-e40fc2d2cf94 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1640339 May 12 15:24:39.643039 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9b47bd87-baac-4d30-93fb-e204d1675f85 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:39.648980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9b47bd87-baac-4d30-93fb-e204d1675f85 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:39.766305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeb4c44d-d2a9-4e44-b93e-ec750c473ee0 req-e73ac1eb-c277-4e5e-85d9-7d3be91a83e0 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:39.770038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eeb4c44d-d2a9-4e44-b93e-ec750c473ee0 req-e73ac1eb-c277-4e5e-85d9-7d3be91a83e0 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.4174690 May 12 15:24:39.788691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b47bd87-baac-4d30-93fb-e204d1675f85 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=462a2d57-27d1-43a1-9707-6fb8d7f3ac86,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:39.813023 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9b47bd87-baac-4d30-93fb-e204d1675f85 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=13574e566c1445979b465489d40946dc&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7279480 May 12 15:24:39.815636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39140) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:39.835955 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:39.882368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 1682faa0-a8c8-4629-bbe3-885bbde7d3bf, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1682faa0-a8c8-4629-bbe3-885bbde7d3bf,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:39.889887 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:39.923906 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f98edc26-7f4e-4735-9ce7-08653b430ef4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:39.968827 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f98edc26-7f4e-4735-9ce7-08653b430ef4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:39.996631 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0fe1faba-a154-43c5-9087-a75c383349ec None None] Provisioning complete for port 42a2c229-d13e-4ea9-b530-c7d65e4999da triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:39.996991 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0fe1faba-a154-43c5-9087-a75c383349ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:40.056305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=1682faa0-a8c8-4629-bbe3-885bbde7d3bf,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:40.065296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eeb4c44d-d2a9-4e44-b93e-ec750c473ee0 req-e9115bd1-f26d-4918-aa32-56b5e917e36b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1151068 May 12 15:24:40.073328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:24:40.113843 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0fe1faba-a154-43c5-9087-a75c383349ec None None] Port 42a2c229-d13e-4ea9-b530-c7d65e4999da cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:24:40.121678 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f98edc26-7f4e-4735-9ce7-08653b430ef4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:40.143496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f98edc26-7f4e-4735-9ce7-08653b430ef4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=462a2d57-27d1-43a1-9707-6fb8d7f3ac86,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:40.146865 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f98edc26-7f4e-4735-9ce7-08653b430ef4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:40.147999 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f98edc26-7f4e-4735-9ce7-08653b430ef4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/462a2d57-27d1-43a1-9707-6fb8d7f3ac86 HTTP/1.1" status: 204 len: 168 time: 0.3313904 May 12 15:24:40.361826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:24:40.369129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca905678-bcc1-47f2-aa62-af882ea42ead req-b89ed9f4-d8bc-481c-97db-2388bd67e56f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:40.371646 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca905678-bcc1-47f2-aa62-af882ea42ead req-b89ed9f4-d8bc-481c-97db-2388bd67e56f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 1095 time: 0.1456532 May 12 15:24:40.384226 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Sync routers for ids ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:24:40.399715 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Routers {'0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:24:40.400350 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:24:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:40.453641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d68427c5-4c9a-4ce5-8732-fa9aa70afbef admin admin] 10.222.0.82 "PUT /v2.0/routers/0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.2638795 May 12 15:24:40.508591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4142e9dd-b022-4486-987d-76a9f06a54b9 req-aefa5585-2887-481a-906a-ecfc726154d7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:40.524707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4142e9dd-b022-4486-987d-76a9f06a54b9 req-aefa5585-2887-481a-906a-ecfc726154d7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.6274133 May 12 15:24:40.626643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4142e9dd-b022-4486-987d-76a9f06a54b9 req-1074543c-f6e7-4644-9b62-a0f74c7d1e8a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1008158 May 12 15:24:40.643084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fee8a8f4-84a1-4922-bddf-582fb19e236d req-2c5486f2-946d-4837-bb86-698a4f359ac4 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/9887b154-c2ee-411c-adde-fd90b2df6d88 HTTP/1.1" status: 200 len: 1803 time: 0.4454498 May 12 15:24:40.695415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca905678-bcc1-47f2-aa62-af882ea42ead req-edb1bbeb-591e-439a-a960-fc58f0e7b40c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:40.696788 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca905678-bcc1-47f2-aa62-af882ea42ead req-edb1bbeb-591e-439a-a960-fc58f0e7b40c service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.3155372 May 12 15:24:40.776568 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Set router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:24:40.907308 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca905678-bcc1-47f2-aa62-af882ea42ead req-7fdc6275-bf9a-4acb-959c-7fd03d2dd81b service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26 HTTP/1.1" status: 200 len: 999 time: 0.2018106 May 12 15:24:40.958219 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fee8a8f4-84a1-4922-bddf-582fb19e236d req-ce970b37-446a-434b-a756-b4fe0b1902a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:40.998615 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fee8a8f4-84a1-4922-bddf-582fb19e236d req-ce970b37-446a-434b-a756-b4fe0b1902a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:41.013845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61e9ff7e-498c-4dae-af92-e585ec7221ae req-ce20f29a-b92f-4e45-9b69-4a60402e362f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:41.015348 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61e9ff7e-498c-4dae-af92-e585ec7221ae req-ce20f29a-b92f-4e45-9b69-4a60402e362f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1927500 May 12 15:24:41.093380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca905678-bcc1-47f2-aa62-af882ea42ead req-db564596-e87c-4cf4-8377-815dde1d3cd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:41.099568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1682faa0-a8c8-4629-bbe3-885bbde7d3bf up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:24:41.110530 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca905678-bcc1-47f2-aa62-af882ea42ead req-db564596-e87c-4cf4-8377-815dde1d3cd5 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.1842198 May 12 15:24:41.127723 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61e9ff7e-498c-4dae-af92-e585ec7221ae req-dbea3da3-30cf-42f3-87c8-b81ef989493a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1031840 May 12 15:24:41.167902 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fee8a8f4-84a1-4922-bddf-582fb19e236d req-ce970b37-446a-434b-a756-b4fe0b1902a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:41.223153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce970b37-446a-434b-a756-b4fe0b1902a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9887b154-c2ee-411c-adde-fd90b2df6d88,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:41.234892 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-fee8a8f4-84a1-4922-bddf-582fb19e236d req-ce970b37-446a-434b-a756-b4fe0b1902a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:41.260197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fee8a8f4-84a1-4922-bddf-582fb19e236d req-ce970b37-446a-434b-a756-b4fe0b1902a5 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "DELETE /v2.0/security-groups/9887b154-c2ee-411c-adde-fd90b2df6d88 HTTP/1.1" status: 204 len: 173 time: 0.6160853 May 12 15:24:41.324284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca905678-bcc1-47f2-aa62-af882ea42ead req-293fff44-c53c-4c89-b333-2a8dbf06579c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:41.326947 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca905678-bcc1-47f2-aa62-af882ea42ead req-293fff44-c53c-4c89-b333-2a8dbf06579c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2096064 May 12 15:24:41.458694 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:38Z', 'revision_number': 2, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:41.464547 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Checking router: 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:24:41.465172 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Updating router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c port 42a2c229-d13e-4ea9-b530-c7d65e4999da binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:24:41.491622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 1682faa0-a8c8-4629-bbe3-885bbde7d3bf triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:41.492248 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:41.602866 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:41.660686 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca905678-bcc1-47f2-aa62-af882ea42ead req-6a4d973d-1f11-4320-ade1-43c8ee58501a service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3249431 May 12 15:24:41.691193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f395c650-4a66-43dd-bb50-192a790b8277 req-72612a6e-734b-4500-bf0a-bc6beea57014 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:41.709717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-72612a6e-734b-4500-bf0a-bc6beea57014 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 812 time: 0.4150426 May 12 15:24:41.742692 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-de582f8d-cede-4089-aacc-3dbdd0cf81f6 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/quotas/011dcf6c7b624a28bb2d8ed8db38754f HTTP/1.1" status: 200 len: 375 time: 0.0319090 May 12 15:24:41.835014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39202) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:41.859031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1481014839', 'description': 'tempest-description--663264467'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:41.882934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:41.896633 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-376824a2-ce03-48d9-bdbc-48d1debe8ce1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1529970 May 12 15:24:41.967950 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca905678-bcc1-47f2-aa62-af882ea42ead req-819206d2-898c-4128-b1ea-020bf1682bd8 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3006752 May 12 15:24:41.969936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39208) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:42.135950 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-23541755-86ea-4d3d-b67f-901b661542f5 service neutron] 10.222.0.82 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2380350 May 12 15:24:42.157941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Usage tracker for resource:security_group and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:42.169629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:42.175800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-334282524-network', 'tenant_id': '201385419c7a4181b53703681dcc450a'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:42.181377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:42.186365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Usage tracker for resource:network and tenant:201385419c7a4181b53703681dcc450a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:42.189937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:42.197424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:42.222665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Made reservation on behalf of 201385419c7a4181b53703681dcc450a for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:24:42.226601 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.232750 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.245109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:42.246165 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Transition to ACTIVE for port object 42a2c229-d13e-4ea9-b530-c7d65e4999da will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:42.259571 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.261748 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.292475 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.297542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:42.302616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Usage tracker for resource:security_group_rule and tenant:201385419c7a4181b53703681dcc450a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:42.306207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:42.314650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:42.361962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:42.374262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Usage tracker for resource:security_group_rule and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:42.405171 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-b2b7f8c2-9d22-4d01-b593-4f92f04c821c service neutron] 10.222.0.82 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2680981 May 12 15:24:42.408678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:42.459959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ec3838-f0ae-48ef-b82c-b0df2a8c46b6 req-7a3a8d0a-d4b7-4155-a7c2-4330a31f2eee tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:42.466838 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.468669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73ec3838-f0ae-48ef-b82c-b0df2a8c46b6 req-7a3a8d0a-d4b7-4155-a7c2-4330a31f2eee tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.3816218 May 12 15:24:42.472263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:42.478308 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.495038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 592} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:24:42.539571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.540730 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Added segment 650c5875-3b46-4c4d-bad9-5c4ae442fa2c of type vlan for network a0b076c1-3c74-4e19-9134-7326ad81f4c1 May 12 15:24:42.546023 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88624df9-29ad-4db9-8894-eb1961efbc6c None None] Pushing event updated for resources: {'Port': ['ID=42a2c229-d13e-4ea9-b530-c7d65e4999da,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:42.562073 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88624df9-29ad-4db9-8894-eb1961efbc6c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:42.562829 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88624df9-29ad-4db9-8894-eb1961efbc6c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:42.563383 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88624df9-29ad-4db9-8894-eb1961efbc6c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:42.563923 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88624df9-29ad-4db9-8894-eb1961efbc6c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:42.564515 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88624df9-29ad-4db9-8894-eb1961efbc6c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:42.565064 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88624df9-29ad-4db9-8894-eb1961efbc6c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:42.565623 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88624df9-29ad-4db9-8894-eb1961efbc6c None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:42.566240 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88624df9-29ad-4db9-8894-eb1961efbc6c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:42.566793 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88624df9-29ad-4db9-8894-eb1961efbc6c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:42.567336 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88624df9-29ad-4db9-8894-eb1961efbc6c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:42.567891 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88624df9-29ad-4db9-8894-eb1961efbc6c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:42.568815 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88624df9-29ad-4db9-8894-eb1961efbc6c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:42.672784 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6a6c66ad-d817-4a63-afaa-155ba437f13d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.676351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.693889 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Attempting to bind port 42a2c229-d13e-4ea9-b530-c7d65e4999da on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:24:42.694635 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Attempting to bind port 42a2c229-d13e-4ea9-b530-c7d65e4999da by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:24:42.701994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73ec3838-f0ae-48ef-b82c-b0df2a8c46b6 req-396d8a9e-f363-4585-a229-f734c8b0eb5f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2236135 May 12 15:24:42.703077 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Attempting to bind port 42a2c229-d13e-4ea9-b530-c7d65e4999da on network e1655f9a-2478-49d5-a6ca-4fec717d6816 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:24:42.716481 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 24, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:24:42.717041 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Checking segment: {'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:24:42.717639 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.718154 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Bound using segment: {'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:24:42.718758 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Bound port: 42a2c229-d13e-4ea9-b530-c7d65e4999da, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:24:42.719253 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.764880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=598fd7fc-133f-4176-ac37-5445c6a8ca15,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:42.808139 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.809649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:42.810602 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.917083 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:42.982091 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] For port 42a2c229-d13e-4ea9-b530-c7d65e4999da, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:24:42.988313 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] For port 42a2c229-d13e-4ea9-b530-c7d65e4999da, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=42a2c229-d13e-4ea9-b530-c7d65e4999da,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:24:43.001310 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:43.015328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] Pushing event updated for resources: {'Network': ['ID=a0b076c1-3c74-4e19-9134-7326ad81f4c1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:43.023085 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3da1f126-3913-4356-81c8-f2254d6ef658 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 1.0490370 May 12 15:24:43.024075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39228) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:43.033935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Request body: {'subnet': {'network_id': 'a0b076c1-3c74-4e19-9134-7326ad81f4c1', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-334282524-subnet', 'tenant_id': '201385419c7a4181b53703681dcc450a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:43.038714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network a0b076c1-3c74-4e19-9134-7326ad81f4c1 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:24:43.049836 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:43.050003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:43.056217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Usage tracker for resource:subnet and tenant:201385419c7a4181b53703681dcc450a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:43.057698 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-68fbc7bf-2478-4935-9a74-39baaba48745 req-a7dc4f96-c216-45f8-9278-ec0d017a5b35 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "GET /v2.0/security-groups/5f153cae-50a1-4084-94aa-1b5bb113ef0a HTTP/1.1" status: 200 len: 1801 time: 0.2907193 May 12 15:24:43.061061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:43.072655 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:43.081648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:43.102851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Made reservation on behalf of 201385419c7a4181b53703681dcc450a for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:24:43.106100 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:43.178346 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Routers {'0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:24:43.179235 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:24:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:43.255645 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:43.256889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1781 time: 1.4209073 May 12 15:24:43.260572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8d7b8995-77e9-4755-a140-038fd74473e0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:43.263429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39234) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:43.281479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e4b629de-9906-4d4a-a2a1-fb535d360a55 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Request body: {'security_group_rule': {'security_group_id': '8d7b8995-77e9-4755-a140-038fd74473e0', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:43.331757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e4b629de-9906-4d4a-a2a1-fb535d360a55 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:43.347266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:43.347799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:43.348340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:43.348841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:43.349405 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:43.349902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:43.350392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:43.350899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:43.351403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:43.351889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:43.352377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:43.352875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e96dce46-3c8a-430f-8e0c-f3184010881b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:43.366731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e4b629de-9906-4d4a-a2a1-fb535d360a55 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Usage tracker for resource:security_group_rule and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:43.368026 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88624df9-29ad-4db9-8894-eb1961efbc6c None None] Pushing event updated for resources: {'Port': ['ID=42a2c229-d13e-4ea9-b530-c7d65e4999da,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:43.385819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e4b629de-9906-4d4a-a2a1-fb535d360a55 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:43.403890 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-68fbc7bf-2478-4935-9a74-39baaba48745 req-a639714c-9a5f-4eba-bea4-db9b8c118de4 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:43.406845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e4b629de-9906-4d4a-a2a1-fb535d360a55 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:43.471426 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31cdb2ad-9ec0-4c9e-b993-d2a756ecb8aa req-29056a60-ec09-4ace-be76-5462cf4dc158 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:43.482990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31cdb2ad-9ec0-4c9e-b993-d2a756ecb8aa req-29056a60-ec09-4ace-be76-5462cf4dc158 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.5533986 May 12 15:24:43.525663 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-68fbc7bf-2478-4935-9a74-39baaba48745 req-a639714c-9a5f-4eba-bea4-db9b8c118de4 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:43.533031 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] Set router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:24:43.586035 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31cdb2ad-9ec0-4c9e-b993-d2a756ecb8aa req-41784452-3cc3-4554-bb9d-e9b0018f772c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1013145 May 12 15:24:43.586890 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4b629de-9906-4d4a-a2a1-fb535d360a55 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:43.643075 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-68fbc7bf-2478-4935-9a74-39baaba48745 req-a639714c-9a5f-4eba-bea4-db9b8c118de4 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:43.707069 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a639714c-9a5f-4eba-bea4-db9b8c118de4 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f153cae-50a1-4084-94aa-1b5bb113ef0a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:43.712780 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-68fbc7bf-2478-4935-9a74-39baaba48745 req-a639714c-9a5f-4eba-bea4-db9b8c118de4 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:43.714446 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-68fbc7bf-2478-4935-9a74-39baaba48745 req-a639714c-9a5f-4eba-bea4-db9b8c118de4 tempest-SecurityGroupsTestJSON-942431974 tempest-SecurityGroupsTestJSON-942431974-project] 10.222.0.82 "DELETE /v2.0/security-groups/5f153cae-50a1-4084-94aa-1b5bb113ef0a HTTP/1.1" status: 204 len: 173 time: 0.6272030 May 12 15:24:43.728253 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39242) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:43.916045 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4b629de-9906-4d4a-a2a1-fb535d360a55 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:43.997255 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:44.011243 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:42Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:44.016370 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22b504fd-1859-48be-bb9a-33df5331ee21 None None] The sync data for ids ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'] in n-d-841483-1 is: [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:42Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:24:44.021625 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4b629de-9906-4d4a-a2a1-fb535d360a55 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:44.061796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-0d870732-e52d-4f52-8cfc-74fed7a305e5 admin admin] Deleting subnet 92a8d5fe-fb2b-414d-9ae2-15fb02337cd9 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:24:44.079056 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d870732-e52d-4f52-8cfc-74fed7a305e5 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:44.103231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Pushing event updated for resources: {'Subnet': ['ID=8a51f48a-793d-44a2-bd4d-24c656b1e922,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:44.124662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Checking segment: {'id': '650c5875-3b46-4c4d-bad9-5c4ae442fa2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 592, 'network_id': 'a0b076c1-3c74-4e19-9134-7326ad81f4c1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:24:44.128292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Network hostable DHCP agents. Network: a0b076c1-3c74-4e19-9134-7326ad81f4c1, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:24:44.157791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Network a0b076c1-3c74-4e19-9134-7326ad81f4c1 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:24:44.172328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, a0b076c1-3c74-4e19-9134-7326ad81f4c1) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:44.177972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:44.178857 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:44.179241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b629de-9906-4d4a-a2a1-fb535d360a55 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9cffb37e-17cb-4ace-99f8-66f2f20c9f68,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:44.185511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba99ba42-d096-482e-b291-2e7c47faf3bc None None] Network a0b076c1-3c74-4e19-9134-7326ad81f4c1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:24:44.229013 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d870732-e52d-4f52-8cfc-74fed7a305e5 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:44.296557 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d870732-e52d-4f52-8cfc-74fed7a305e5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:44.308477 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ebbb5071-3cbd-4390-b9b8-d05563df7b9a admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 1.2735007 May 12 15:24:44.471542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d870732-e52d-4f52-8cfc-74fed7a305e5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:44.888915 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8cd1f53e-e1ee-4ce7-abb7-cf8c795f46fe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:44.897868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab2d599a-57f3-4464-9916-77334392a79b None None] Network a0b076c1-3c74-4e19-9134-7326ad81f4c1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:24:44.908834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f395c650-4a66-43dd-bb50-192a790b8277 req-0f98d1e4-74ee-42b5-ab6f-7ebff466e6af tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:44.913253 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-0f98d1e4-74ee-42b5-ab6f-7ebff466e6af tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 812 time: 0.4214036 May 12 15:24:44.913502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d870732-e52d-4f52-8cfc-74fed7a305e5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=92a8d5fe-fb2b-414d-9ae2-15fb02337cd9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:44.923586 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4b629de-9906-4d4a-a2a1-fb535d360a55 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:44.924789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e4b629de-9906-4d4a-a2a1-fb535d360a55 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.6598940 May 12 15:24:44.930271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Request body: {'port': {'device_id': '1c19b34d-18f4-4f8e-9635-2edf259c0ca5', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'admin_state_up': True, 'tenant_id': '011dcf6c7b624a28bb2d8ed8db38754f'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:44.935159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39266) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:44.952166 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d870732-e52d-4f52-8cfc-74fed7a305e5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:44.958935 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0d870732-e52d-4f52-8cfc-74fed7a305e5 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/92a8d5fe-fb2b-414d-9ae2-15fb02337cd9 HTTP/1.1" status: 204 len: 168 time: 1.2272081 May 12 15:24:44.963388 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39270) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:44.977595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-779ef8dd-d483-4006-836b-d7f5f329995f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Request body: {'security_group_rule': {'security_group_id': '8d7b8995-77e9-4755-a140-038fd74473e0', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:44.998744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-779ef8dd-d483-4006-836b-d7f5f329995f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:45.165114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 42a2c229-d13e-4ea9-b530-c7d65e4999da up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:24:45.198617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b1eed0c-e08e-46d8-b0bb-a9758d81cb01 req-ef27bce0-61f0-4886-ae44-a8664741e448 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:45.200316 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7b1eed0c-e08e-46d8-b0bb-a9758d81cb01 req-ef27bce0-61f0-4886-ae44-a8664741e448 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 1.3732803 May 12 15:24:45.201495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-779ef8dd-d483-4006-836b-d7f5f329995f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Usage tracker for resource:security_group_rule and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:45.224251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-779ef8dd-d483-4006-836b-d7f5f329995f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:45.251604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d31a78ba-d28e-4d6f-8b5b-305cb02a7954 req-8c5006a5-3cf5-4174-a865-a76f4aad54b4 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:45.261169 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d31a78ba-d28e-4d6f-8b5b-305cb02a7954 req-8c5006a5-3cf5-4174-a865-a76f4aad54b4 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 1.3256555 May 12 15:24:45.281531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-779ef8dd-d483-4006-836b-d7f5f329995f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:45.285572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39280) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:45.300165 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-20c79990-5e1d-4c13-88d4-84740d5f98ca tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Request body: {'floatingip': {'port_id': '0ce28f36-b32c-468c-81e3-0dd235e15282'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:45.383373 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a8e3ac43-fc00-47cb-b492-e0feede5fb09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:45.410692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:45.423875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Usage tracker for resource:port and tenant:011dcf6c7b624a28bb2d8ed8db38754f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:45.435482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:45.461674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:45.472996 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7b1eed0c-e08e-46d8-b0bb-a9758d81cb01 req-5f1e0d16-aa3e-4ff4-886d-b55343429234 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2649076 May 12 15:24:45.502630 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-20c79990-5e1d-4c13-88d4-84740d5f98ca tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:45.529674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Made reservation on behalf of 011dcf6c7b624a28bb2d8ed8db38754f for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:24:45.533664 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:45.654398 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 42a2c229-d13e-4ea9-b530-c7d65e4999da completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:24:45.665058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39288) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:45.666136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 42a2c229-d13e-4ea9-b530-c7d65e4999da triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:45.666716 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:45.818358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1910166583-network', 'tenant_id': '194a99873f4a4aea856e9a232cadc973'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:45.834455 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:45.854596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Allocated IP 172.20.0.2 (aa894a26-e7a0-42ea-b7f1-9a9c136eacd6/0ff5192a-946b-4444-900a-788b8ddc74b6/975b04d5-ca4b-4584-8ccd-28c9788e8532) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:24:45.872399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 42a2c229-d13e-4ea9-b530-c7d65e4999da, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=42a2c229-d13e-4ea9-b530-c7d65e4999da,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:45.878037 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:45.962773 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=42a2c229-d13e-4ea9-b530-c7d65e4999da,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:45.972136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:45.972533 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:45.972875 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:45.973247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:45.973602 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:45.973918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:45.974242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:45.974564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:45.974882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:45.975197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:45.975563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:45.975931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:24:45.986123 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-779ef8dd-d483-4006-836b-d7f5f329995f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.013674 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.139482 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.208430 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:46.210229 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.247866 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.260099 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c123a9dc-5b70-4c89-aba5-818d8f2ed254 req-31d5dca7-55fe-404e-85c4-36e96750a2bd tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 210 time: 0.5899420 May 12 15:24:46.285592 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Usage tracker for resource:network and tenant:194a99873f4a4aea856e9a232cadc973 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:46.343620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:46.352604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:24:46.357821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:46.360982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:24:46.437713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:46.439550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Pushing event updated for resources: {'Port': ['ID=975b04d5-ca4b-4584-8ccd-28c9788e8532,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:46.452640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:46.453426 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.480527 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-116415f5-6006-4735-8c95-0edd10756bb7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5568871 May 12 15:24:46.490617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-4951dff9-1822-4f1f-baea-38c92d47c7a2 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:24:46.491569 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-4951dff9-1822-4f1f-baea-38c92d47c7a2 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0051415 May 12 15:24:46.594183 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a8e3ac43-fc00-47cb-b492-e0feede5fb09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.627100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Made reservation on behalf of 194a99873f4a4aea856e9a232cadc973 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:24:46.629327 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.644336 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-779ef8dd-d483-4006-836b-d7f5f329995f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.673947 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-779ef8dd-d483-4006-836b-d7f5f329995f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.675814 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.688740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Request body: {'port': {'device_id': '1c19b34d-18f4-4f8e-9635-2edf259c0ca5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:46.711563 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a8e3ac43-fc00-47cb-b492-e0feede5fb09 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b50584ea-1073-48d4-a2bc-43b11374a495']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:46.808222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a8e3ac43-fc00-47cb-b492-e0feede5fb09 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2b9a3118-674a-42bd-be1d-3a0efcec85f0') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:46.808444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a8e3ac43-fc00-47cb-b492-e0feede5fb09 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2b9a3118-674a-42bd-be1d-3a0efcec85f0') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:46.822450 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.829536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:46.832648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-779ef8dd-d483-4006-836b-d7f5f329995f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=26152152-2c91-434d-8874-24cb5a6a0c5e,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:46.842350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eb9c9e9-9ea5-4056-9f22-dfa16e4f2970 req-7c500386-91b0-4c29-afba-e4517b0c07c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:46.843706 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5eb9c9e9-9ea5-4056-9f22-dfa16e4f2970 req-7c500386-91b0-4c29-afba-e4517b0c07c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.7866013 May 12 15:24:46.859662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Usage tracker for resource:security_group_rule and tenant:194a99873f4a4aea856e9a232cadc973 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:46.873318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:46.877728 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a8e3ac43-fc00-47cb-b492-e0feede5fb09 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.914348 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-779ef8dd-d483-4006-836b-d7f5f329995f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.916100 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-779ef8dd-d483-4006-836b-d7f5f329995f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.9757943 May 12 15:24:46.922553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:46.927821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39300) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:46.936062 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a8e3ac43-fc00-47cb-b492-e0feede5fb09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:46.961043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:46.988361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a8e3ac43-fc00-47cb-b492-e0feede5fb09 admin admin] Releasing vlan 566 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:24:46.988361 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a8e3ac43-fc00-47cb-b492-e0feede5fb09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: timer() May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:24:47.003609 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:24:47.011116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:47.070196 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5eb9c9e9-9ea5-4056-9f22-dfa16e4f2970 req-bf716b4e-62a5-4724-859e-6dc3534e18d3 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2153940 May 12 15:24:47.078315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd418be3-cb37-46d7-85c5-56c921571e01 req-31b2e38c-5f3e-45ab-b8a4-00b3f416901f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:47.079772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd418be3-cb37-46d7-85c5-56c921571e01 req-31b2e38c-5f3e-45ab-b8a4-00b3f416901f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.6332495 May 12 15:24:47.085555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Usage tracker for resource:floatingip and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:47.092188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:47.114384 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 42a2c229-d13e-4ea9-b530-c7d65e4999da up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:24:47.133983 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:47.295608 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 42a2c229-d13e-4ea9-b530-c7d65e4999da triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:47.296449 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:47.319008 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a8e3ac43-fc00-47cb-b492-e0feede5fb09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:47.332931 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:47.371140 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a8e3ac43-fc00-47cb-b492-e0feede5fb09 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:47.373066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 975b04d5-ca4b-4584-8ccd-28c9788e8532 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:24:47.397550 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:47.399604 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd418be3-cb37-46d7-85c5-56c921571e01 req-ba4228bb-f629-4386-bf11-8a9833bda3e7 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3041074 May 12 15:24:47.419882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e3ac43-fc00-47cb-b492-e0feede5fb09 admin admin] Pushing event deleted for resources: {'Network': ['ID=b50584ea-1073-48d4-a2bc-43b11374a495,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:47.442086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Transition to ACTIVE for port object 975b04d5-ca4b-4584-8ccd-28c9788e8532 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:47.455775 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:47.613553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-20c79990-5e1d-4c13-88d4-84740d5f98ca tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] It took 0.30 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:24:47.655748 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:47.781671 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a8e3ac43-fc00-47cb-b492-e0feede5fb09 admin admin] 10.222.0.82 "DELETE /v2.0/networks/b50584ea-1073-48d4-a2bc-43b11374a495 HTTP/1.1" status: 204 len: 168 time: 2.7900660 May 12 15:24:47.865983 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:47.889508 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-20c79990-5e1d-4c13-88d4-84740d5f98ca tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:47.890522 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:47.921533 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-20c79990-5e1d-4c13-88d4-84740d5f98ca tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:48.022146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Pushing event updated for resources: {'Port': ['ID=975b04d5-ca4b-4584-8ccd-28c9788e8532,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:48.045215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 574} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:24:48.084167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Attempting to bind port 975b04d5-ca4b-4584-8ccd-28c9788e8532 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:24:48.084500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Attempting to bind port 975b04d5-ca4b-4584-8ccd-28c9788e8532 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:24:48.085196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Attempting to bind port 975b04d5-ca4b-4584-8ccd-28c9788e8532 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:24:48.089933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17d7e430-8d13-4a9c-a45d-ba03bb0cb8df,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:48.090119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Port 975b04d5-ca4b-4584-8ccd-28c9788e8532 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:24:48.090810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Attempting to bind port 975b04d5-ca4b-4584-8ccd-28c9788e8532 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:24:48.098369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 24, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:24:48.099042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Checking segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:24:48.099201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Bound using segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:24:48.099843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Bound port: 975b04d5-ca4b-4584-8ccd-28c9788e8532, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:24:48.100200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:48.103552 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:48.103893 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Added segment 11587d91-1040-4305-909d-7bb402f0367c of type vlan for network 7a7f1973-5daf-4c04-a068-b6dd69512e7a May 12 15:24:48.138963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39320) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:48.213064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] For port 975b04d5-ca4b-4584-8ccd-28c9788e8532, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:24:48.217266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] For port 975b04d5-ca4b-4584-8ccd-28c9788e8532, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=975b04d5-ca4b-4584-8ccd-28c9788e8532,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:24:48.223050 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:48.261578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1452c12-d4e1-4c8c-b060-d5524c59ab18 req-f65eba06-4b64-4c62-b943-32351dc0a322 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:48.264033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1452c12-d4e1-4c8c-b060-d5524c59ab18 req-f65eba06-4b64-4c62-b943-32351dc0a322 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 943 time: 0.4895053 May 12 15:24:48.314595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Pushing event updated for resources: {'Port': ['ID=975b04d5-ca4b-4584-8ccd-28c9788e8532,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:48.319471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:48.320114 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:48.321575 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-6377e968-19f7-4375-a9b9-85ca57398e6f service neutron] 10.222.0.76 "PUT /v2.0/ports/975b04d5-ca4b-4584-8ccd-28c9788e8532 HTTP/1.1" status: 200 len: 1091 time: 1.8233945 May 12 15:24:48.322152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c19b34d-18f4-4f8e-9635-2edf259c0ca5', 'tag': '975b04d5-ca4b-4584-8ccd-28c9788e8532'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:24:48.362965 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:48.441239 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-20c79990-5e1d-4c13-88d4-84740d5f98ca tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Floating IP eee03cda-2cfe-4a56-9504-393b66249c30 associated. External IP: 172.25.8.98, port: 0ce28f36-b32c-468c-81e3-0dd235e15282. May 12 15:24:48.450116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f395c650-4a66-43dd-bb50-192a790b8277 req-2585f68b-e5c1-4815-a25c-876e1254acdb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:48.451603 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-2585f68b-e5c1-4815-a25c-876e1254acdb service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 1094 time: 0.0924201 May 12 15:24:48.504237 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-140df9d5-908a-4c6d-958b-9d716222063d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=86574e26b5194d1f92a51749f063fa69&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3537657 May 12 15:24:48.515996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39328) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:48.537821 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-d602391f-870f-4d6c-baf3-556aac0be0fe service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=975b04d5-ca4b-4584-8ccd-28c9788e8532 HTTP/1.1" status: 200 len: 217 time: 0.0795853 May 12 15:24:48.538080 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1452c12-d4e1-4c8c-b060-d5524c59ab18 req-40464f4f-4d59-4486-9943-2cd7f8eef8c5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2470210 May 12 15:24:48.611774 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:48.612740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:48.613317 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:48.645960 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:48.654079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f395c650-4a66-43dd-bb50-192a790b8277 req-ed95df86-c0e3-4c4b-9ce7-54d91b7de153 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:48.654852 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-ed95df86-c0e3-4c4b-9ce7-54d91b7de153 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.1114626 May 12 15:24:48.739788 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-97b8a417-f85e-4de2-8e48-cb60772e815d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0780778 May 12 15:24:48.794761 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be2c6bc-1fb2-4995-b837-e8cb060fc92c req-d5c241ad-5b5a-4d97-abcd-ee61f8335a48 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:48.802014 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5be2c6bc-1fb2-4995-b837-e8cb060fc92c req-d5c241ad-5b5a-4d97-abcd-ee61f8335a48 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.7164032 May 12 15:24:48.931846 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 3.2361357 May 12 15:24:48.932097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39342) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:48.941784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Request body: {'subnet': {'network_id': '7a7f1973-5daf-4c04-a068-b6dd69512e7a', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1910166583-subnet', 'tenant_id': '194a99873f4a4aea856e9a232cadc973', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:48.952253 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-b7b69514-e7e2-4441-b687-dcbe60cf83ec service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2058718 May 12 15:24:48.954047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:48.979206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Usage tracker for resource:subnet and tenant:194a99873f4a4aea856e9a232cadc973 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:48.985684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:48.992344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5930e1b-736f-4602-976e-fb05e6496c95 admin admin] Pushing event updated for resources: {'Network': ['ID=7a7f1973-5daf-4c04-a068-b6dd69512e7a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:49.009686 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8bcb444c-1f20-46b7-8682-9baa90380b53 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:49.025427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 7a7f1973-5daf-4c04-a068-b6dd69512e7a details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:24:49.048722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5be2c6bc-1fb2-4995-b837-e8cb060fc92c req-b228d380-2ea1-485b-aa7b-c95c0bed1525 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2458067 May 12 15:24:49.050651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:49.101122 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Made reservation on behalf of 194a99873f4a4aea856e9a232cadc973 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:24:49.104490 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:49.225988 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-31e8f736-24c5-479f-a5bc-9899e5bc24cb'] response: {'name': 'network-changed', 'server_uuid': '1c19b34d-18f4-4f8e-9635-2edf259c0ca5', 'tag': '975b04d5-ca4b-4584-8ccd-28c9788e8532', 'status': 'completed', 'code': 200} May 12 15:24:49.240982 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8bcb444c-1f20-46b7-8682-9baa90380b53 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:49.287804 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-19f4c447-6434-4095-aaae-ab853831518f service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3283646 May 12 15:24:49.509194 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:49.542268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca2a1d02-ea42-47cb-9e88-0ad770bf961e req-390bdc2b-9ce5-4d00-936b-0da60afb20e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:49.544732 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca2a1d02-ea42-47cb-9e88-0ad770bf961e req-390bdc2b-9ce5-4d00-936b-0da60afb20e0 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 1094 time: 0.1690640 May 12 15:24:49.582642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39354) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:49.610202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Allocated IP 172.25.8.224 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/ae4c16c8-09ae-4f89-aee7-857d7f243a74) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:24:49.686959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f1533468-fd8e-4b1f-ae08-989d2aa533f1,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:49.702729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee01067-569d-44cb-ad63-727191c9ad5b req-76f7f484-2470-4a1e-abf8-7081b4701a88 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:49.704275 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ee01067-569d-44cb-ad63-727191c9ad5b req-76f7f484-2470-4a1e-abf8-7081b4701a88 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.6200469 May 12 15:24:49.707190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Checking segment: {'id': '11587d91-1040-4305-909d-7bb402f0367c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 574, 'network_id': '7a7f1973-5daf-4c04-a068-b6dd69512e7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:24:49.707190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Network hostable DHCP agents. Network: 7a7f1973-5daf-4c04-a068-b6dd69512e7a, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:24:49.757536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca2a1d02-ea42-47cb-9e88-0ad770bf961e req-4f68427d-eeeb-4849-a77b-170d841503b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:49.759101 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca2a1d02-ea42-47cb-9e88-0ad770bf961e req-4f68427d-eeeb-4849-a77b-170d841503b6 service neutron] 10.222.0.76 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 913 time: 0.2004390 May 12 15:24:49.762322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Network 7a7f1973-5daf-4c04-a068-b6dd69512e7a is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:24:49.805366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-20c79990-5e1d-4c13-88d4-84740d5f98ca tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Router 78d4ada5-c100-4849-8e75-44ba389f27d8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:24:49.811351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8bcb444c-1f20-46b7-8682-9baa90380b53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:49.846590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 7a7f1973-5daf-4c04-a068-b6dd69512e7a) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:49.849026 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca2a1d02-ea42-47cb-9e88-0ad770bf961e req-dfcca829-e5fa-4821-a14f-e4c075b1d41d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=975b04d5-ca4b-4584-8ccd-28c9788e8532 HTTP/1.1" status: 200 len: 217 time: 0.0820694 May 12 15:24:49.852433 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f739072a-009b-4149-99bc-3e41a64ed45f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:49.855077 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2902d900-9cb6-4713-9a18-396e56d422d3 None None] Network 7a7f1973-5daf-4c04-a068-b6dd69512e7a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:24:49.859020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bcb444c-1f20-46b7-8682-9baa90380b53 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b0aae945-e0f0-419f-88b0-e0606e730ccb,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:49.862775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:49.863369 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:49.925997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f739072a-009b-4149-99bc-3e41a64ed45f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:49.940711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f739072a-009b-4149-99bc-3e41a64ed45f admin admin] Usage tracker for resource:security_group_rule and tenant:73388623753046e4bfe59b33b1050250 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:49.946104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f739072a-009b-4149-99bc-3e41a64ed45f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:49.967780 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a63f548b-28da-4dc3-b56d-2629729c7873 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.0256464 May 12 15:24:49.967780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f739072a-009b-4149-99bc-3e41a64ed45f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:49.974829 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ee01067-569d-44cb-ad63-727191c9ad5b req-d7e198d2-3245-4f08-b52e-ad301f33f809 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2059879 May 12 15:24:49.980442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca2a1d02-ea42-47cb-9e88-0ad770bf961e req-e91efb3d-2fa8-41dd-b35e-8c80bc08f0bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:49.982245 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca2a1d02-ea42-47cb-9e88-0ad770bf961e req-e91efb3d-2fa8-41dd-b35e-8c80bc08f0bc service neutron] 10.222.0.76 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.1141346 May 12 15:24:49.987700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-340e8ec2-c286-433c-9ccf-1146b3abc30c req-4ee17c2b-e01a-4129-b689-1f7f8cb2a3ff tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:49.994826 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-340e8ec2-c286-433c-9ccf-1146b3abc30c req-4ee17c2b-e01a-4129-b689-1f7f8cb2a3ff tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.7058024 May 12 15:24:50.051631 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8bcb444c-1f20-46b7-8682-9baa90380b53 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:50.055342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8bcb444c-1f20-46b7-8682-9baa90380b53 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b0aae945-e0f0-419f-88b0-e0606e730ccb HTTP/1.1" status: 204 len: 168 time: 1.5310893 May 12 15:24:50.059818 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca2a1d02-ea42-47cb-9e88-0ad770bf961e req-6499ed9b-a007-4060-a36a-a59230dedc84 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0627890 May 12 15:24:50.255858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39368) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:50.307636 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:50.383862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff636dec-6f6e-4031-92ea-8bf056d1ae46 None None] Network 7a7f1973-5daf-4c04-a068-b6dd69512e7a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:24:50.422201 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-340e8ec2-c286-433c-9ccf-1146b3abc30c req-59bc740c-4e13-4baf-8081-5d6bc4ccbdbb tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4258490 May 12 15:24:50.520928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-20c79990-5e1d-4c13-88d4-84740d5f98ca tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:24:50.530022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-434f6278-a8ec-4451-bb2d-fe375fc9a69b admin admin] Deleting subnet 8a51f48a-793d-44a2-bd4d-24c656b1e922 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:24:50.536163 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-20c79990-5e1d-4c13-88d4-84740d5f98ca tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:50.567655 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-434f6278-a8ec-4451-bb2d-fe375fc9a69b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:50.634483 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f739072a-009b-4149-99bc-3e41a64ed45f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:50.677208 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-434f6278-a8ec-4451-bb2d-fe375fc9a69b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:50.687151 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f739072a-009b-4149-99bc-3e41a64ed45f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:50.718308 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-20c79990-5e1d-4c13-88d4-84740d5f98ca tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "PUT /v2.0/floatingips/eee03cda-2cfe-4a56-9504-393b66249c30 HTTP/1.1" status: 200 len: 991 time: 5.4302821 May 12 15:24:50.724055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:24:50.736016 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:50.787081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95dfcc10-82a8-4e84-b62a-0456ccfff2bf None None] Sync routers for ids ['78d4ada5-c100-4849-8e75-44ba389f27d8'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:24:50.802136 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca2a1d02-ea42-47cb-9e88-0ad770bf961e req-64e24a1c-af01-4279-bfc5-d8bed4ed3bdf service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7323277 May 12 15:24:50.837524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95dfcc10-82a8-4e84-b62a-0456ccfff2bf None None] Routers {'78d4ada5-c100-4849-8e75-44ba389f27d8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:24:50.838441 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-95dfcc10-82a8-4e84-b62a-0456ccfff2bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:24:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['78d4ada5-c100-4849-8e75-44ba389f27d8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:50.868961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21862d22-7865-469f-8b2d-c74e81a998bb req-23260c56-f572-4bab-bccd-75b1540738e4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:50.877434 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21862d22-7865-469f-8b2d-c74e81a998bb req-23260c56-f572-4bab-bccd-75b1540738e4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 943 time: 0.6285102 May 12 15:24:50.928351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:24:50.941785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:50.956749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:24:50.962659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f739072a-009b-4149-99bc-3e41a64ed45f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2d7c77a-f9c2-4163-b3cf-c1660f6f877a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:50.975953 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f739072a-009b-4149-99bc-3e41a64ed45f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=73388623753046e4bfe59b33b1050250&name=default HTTP/1.1" status: 200 len: 2983 time: 1.3884256 May 12 15:24:50.979170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39390) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:50.987059 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ca2a1d02-ea42-47cb-9e88-0ad770bf961e req-b7be9d3f-63bd-4702-a8b7-717b436278de service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1717989 May 12 15:24:51.005709 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-434f6278-a8ec-4451-bb2d-fe375fc9a69b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:51.056807 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9ae20748-5b21-4163-ac6e-53fe0dcb1bda admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:51.057076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-95dfcc10-82a8-4e84-b62a-0456ccfff2bf None None] Set router 78d4ada5-c100-4849-8e75-44ba389f27d8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:24:51.076985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event updated for resources: {'Port': ['ID=ae4c16c8-09ae-4f89-aee7-857d7f243a74,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:51.094507 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9ae20748-5b21-4163-ac6e-53fe0dcb1bda admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:51.146697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21862d22-7865-469f-8b2d-c74e81a998bb req-ba2e98f0-fb42-432d-840a-97716c231245 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2674670 May 12 15:24:51.179507 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9ae20748-5b21-4163-ac6e-53fe0dcb1bda admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:51.210411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ec9a3e0-8b0f-44a8-a8ed-eb153a815af6 req-8c4d0749-e87c-4925-8738-cb3962af64c8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:51.210636 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9ae20748-5b21-4163-ac6e-53fe0dcb1bda admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:51.211905 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9ae20748-5b21-4163-ac6e-53fe0dcb1bda admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d2d7c77a-f9c2-4163-b3cf-c1660f6f877a HTTP/1.1" status: 204 len: 168 time: 0.2317610 May 12 15:24:51.212985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ae20748-5b21-4163-ac6e-53fe0dcb1bda admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2d7c77a-f9c2-4163-b3cf-c1660f6f877a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:51.232305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ec9a3e0-8b0f-44a8-a8ed-eb153a815af6 req-8c4d0749-e87c-4925-8738-cb3962af64c8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.4877906 May 12 15:24:51.304810 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ebe8fb27-6e2c-408a-964d-f4711390f5e1'] response: {'name': 'network-changed', 'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'status': 'completed', 'code': 200} May 12 15:24:51.343037 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:51.389427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ec9a3e0-8b0f-44a8-a8ed-eb153a815af6 req-da3dac0e-9072-4161-bf40-f4488145cbcc tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1532404 May 12 15:24:51.392518 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-434f6278-a8ec-4451-bb2d-fe375fc9a69b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:51.503957 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39408) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:51.537712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6162157a-30a1-485c-b1e4-07a6c02b8b39 req-caaf17bd-83f4-472d-b43b-56f17016f017 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:51.539266 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6162157a-30a1-485c-b1e4-07a6c02b8b39 req-caaf17bd-83f4-472d-b43b-56f17016f017 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=40852c97262142aeb6d62097955af83f&device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 1097 time: 0.2094734 May 12 15:24:51.685084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-95dfcc10-82a8-4e84-b62a-0456ccfff2bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'eee03cda-2cfe-4a56-9504-393b66249c30', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'floating_ip_address': '172.25.8.98', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'port_id': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1770, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'mac_address': 'fa:16:3e:c4:85:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:24:16Z', 'updated_at': '2022-05-12T15:24:47Z', 'revision_number': 1, 'project_id': '40852c97262142aeb6d62097955af83f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:43Z', 'revision_number': 5, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:51.692948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95dfcc10-82a8-4e84-b62a-0456ccfff2bf None None] Checking router: 78d4ada5-c100-4849-8e75-44ba389f27d8 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:24:51.704273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95dfcc10-82a8-4e84-b62a-0456ccfff2bf None None] Routers {'78d4ada5-c100-4849-8e75-44ba389f27d8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:24:51.705312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-95dfcc10-82a8-4e84-b62a-0456ccfff2bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:24:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['78d4ada5-c100-4849-8e75-44ba389f27d8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:51.706273 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-434f6278-a8ec-4451-bb2d-fe375fc9a69b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:51.764145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6162157a-30a1-485c-b1e4-07a6c02b8b39 req-7a368105-6733-45a7-a3a4-88ce202aca77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:51.765652 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6162157a-30a1-485c-b1e4-07a6c02b8b39 req-7a368105-6733-45a7-a3a4-88ce202aca77 service neutron] 10.222.0.84 "GET /v2.0/networks?id=2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 200 len: 918 time: 0.2203305 May 12 15:24:51.767728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-434f6278-a8ec-4451-bb2d-fe375fc9a69b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8a51f48a-793d-44a2-bd4d-24c656b1e922,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:51.774866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Request body: {'network': {'name': 'tempest-ServersTestFqdnHostnames-709355631-network', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:51.782259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:51.797606 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-434f6278-a8ec-4451-bb2d-fe375fc9a69b admin admin] 10.222.0.82 "DELETE /v2.0/subnets/8a51f48a-793d-44a2-bd4d-24c656b1e922 HTTP/1.1" status: 204 len: 168 time: 1.5405240 May 12 15:24:51.810262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39416) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:51.853302 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:51.861750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Usage tracker for resource:network and tenant:5ef041b6d09e485b8dc7bd49d87599d2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:51.866135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:51.876694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:51.880880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39420) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:51.892401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Made reservation on behalf of 5ef041b6d09e485b8dc7bd49d87599d2 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:24:51.894747 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:51.926458 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:51.946814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-95dfcc10-82a8-4e84-b62a-0456ccfff2bf None None] Set router 78d4ada5-c100-4849-8e75-44ba389f27d8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:24:51.957530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:51.965438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Usage tracker for resource:security_group_rule and tenant:5ef041b6d09e485b8dc7bd49d87599d2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:51.970139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:51.978754 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6162157a-30a1-485c-b1e4-07a6c02b8b39 req-09e71805-ad01-4547-a1f9-bc7eebc3ad42 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0ce28f36-b32c-468c-81e3-0dd235e15282 HTTP/1.1" status: 200 len: 999 time: 0.1978819 May 12 15:24:51.979639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:52.073490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6162157a-30a1-485c-b1e4-07a6c02b8b39 req-47741217-9fd1-4c66-aaa0-1ed93be75537 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:52.075476 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6162157a-30a1-485c-b1e4-07a6c02b8b39 req-47741217-9fd1-4c66-aaa0-1ed93be75537 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5f6d45f7-b8bc-4313-879f-ee173c0a4148 HTTP/1.1" status: 200 len: 856 time: 0.0849979 May 12 15:24:52.128038 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a806468d-fcce-4cbf-800a-e1f5854e9dd4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:52.180493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a806468d-fcce-4cbf-800a-e1f5854e9dd4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:52.189946 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:52.190892 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c05f1df-bf06-47a6-9e1d-77f8f2aeb0d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:52.194590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a806468d-fcce-4cbf-800a-e1f5854e9dd4 admin admin] Usage tracker for resource:security_group_rule and tenant:72661a7725af479184d92072db7e4c08 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:52.200380 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:52.202784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a806468d-fcce-4cbf-800a-e1f5854e9dd4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:52.226903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6162157a-30a1-485c-b1e4-07a6c02b8b39 req-6d815d2e-3c02-4b4d-9a71-72b9c9a6b9e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:52.227495 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6162157a-30a1-485c-b1e4-07a6c02b8b39 req-6d815d2e-3c02-4b4d-9a71-72b9c9a6b9e8 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2d986451-1d91-468d-8a9c-ecc4da7a86bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1459811 May 12 15:24:52.231675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a806468d-fcce-4cbf-800a-e1f5854e9dd4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:52.244560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c68c831-1a24-4f14-87e7-4f78e8680e4a req-adfd4b41-83ec-4318-a4b1-3ee06261fcc5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:52.245813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-6162157a-30a1-485c-b1e4-07a6c02b8b39 req-2f308f94-5bb2-4f20-b197-9649f5930168 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:24:52.246960 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6162157a-30a1-485c-b1e4-07a6c02b8b39 req-2f308f94-5bb2-4f20-b197-9649f5930168 service neutron] 10.222.0.84 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0091164 May 12 15:24:52.247859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 551} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:24:52.252118 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5c68c831-1a24-4f14-87e7-4f78e8680e4a req-adfd4b41-83ec-4318-a4b1-3ee06261fcc5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.5998755 May 12 15:24:52.275716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=780798cc-34a7-4b5a-a144-0494fb1e03ee,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:52.288369 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:52.288722 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Added segment 5485588e-9f93-46e8-b3b1-a219b499e8ce of type vlan for network d17b8c7a-f043-4c59-bfab-832deab11818 May 12 15:24:52.325064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f5fdcfd-9d54-4d83-bd50-b02f4661a05e req-8eb9fe2f-6f37-4510-b748-4a246edb36a7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:52.332229 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4f5fdcfd-9d54-4d83-bd50-b02f4661a05e req-8eb9fe2f-6f37-4510-b748-4a246edb36a7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.8606699 May 12 15:24:52.378630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-95dfcc10-82a8-4e84-b62a-0456ccfff2bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'eee03cda-2cfe-4a56-9504-393b66249c30', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'floating_ip_address': '172.25.8.98', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'port_id': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1770, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'mac_address': 'fa:16:3e:c4:85:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:24:16Z', 'updated_at': '2022-05-12T15:24:47Z', 'revision_number': 1, 'project_id': '40852c97262142aeb6d62097955af83f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:43Z', 'revision_number': 5, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:52.384121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95dfcc10-82a8-4e84-b62a-0456ccfff2bf None None] The sync data for ids ['78d4ada5-c100-4849-8e75-44ba389f27d8'] in n-d-841483-1 is: [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'eee03cda-2cfe-4a56-9504-393b66249c30', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'floating_ip_address': '172.25.8.98', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'port_id': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1770, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'mac_address': 'fa:16:3e:c4:85:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:24:16Z', 'updated_at': '2022-05-12T15:24:47Z', 'revision_number': 1, 'project_id': '40852c97262142aeb6d62097955af83f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:43Z', 'revision_number': 5, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:24:52.403163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:52.445205 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6162157a-30a1-485c-b1e4-07a6c02b8b39 req-3a47aeaf-05c3-4d36-b6ff-a27814bef6c7 service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1899059 May 12 15:24:52.515022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5c68c831-1a24-4f14-87e7-4f78e8680e4a req-ef2fa66a-bdf1-4cb7-b8c5-34b2ffc8bff1 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2620287 May 12 15:24:52.539352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4f5fdcfd-9d54-4d83-bd50-b02f4661a05e req-af6f6071-29a6-4e36-baa1-ed2417e462bf tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2048519 May 12 15:24:52.544087 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:52.545073 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:52.546177 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:52.689926 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:52.694930 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.1733978 May 12 15:24:52.702087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39430) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:52.706942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b12a268-d0df-498e-9369-0c84ba0df46f admin admin] Pushing event updated for resources: {'Network': ['ID=d17b8c7a-f043-4c59-bfab-832deab11818,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:52.713409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Request body: {'subnet': {'network_id': 'd17b8c7a-f043-4c59-bfab-832deab11818', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestFqdnHostnames-709355631-subnet', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:52.718418 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2510c7e-94b7-4b1a-80fa-d9076b6015f1 None None] New status for floating IP eee03cda-2cfe-4a56-9504-393b66249c30: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:24:52.728926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network d17b8c7a-f043-4c59-bfab-832deab11818 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:24:52.734594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:52.740853 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6162157a-30a1-485c-b1e4-07a6c02b8b39 req-f671f1c9-26b0-4e95-af4d-5f8f39fe8ff8 service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2877934 May 12 15:24:52.741729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Usage tracker for resource:subnet and tenant:5ef041b6d09e485b8dc7bd49d87599d2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:52.744927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:52.751721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:52.773765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Made reservation on behalf of 5ef041b6d09e485b8dc7bd49d87599d2 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:24:52.776683 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:52.931083 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:52.946543 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c05f1df-bf06-47a6-9e1d-77f8f2aeb0d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.089275 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.124481 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a806468d-fcce-4cbf-800a-e1f5854e9dd4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.125525 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 975b04d5-ca4b-4584-8ccd-28c9788e8532 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:24:53.170974 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-2c05f1df-bf06-47a6-9e1d-77f8f2aeb0d4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a0b076c1-3c74-4e19-9134-7326ad81f4c1']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:53.180165 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a806468d-fcce-4cbf-800a-e1f5854e9dd4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.227576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-2c05f1df-bf06-47a6-9e1d-77f8f2aeb0d4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '650c5875-3b46-4c4d-bad9-5c4ae442fa2c') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:53.227913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-2c05f1df-bf06-47a6-9e1d-77f8f2aeb0d4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '650c5875-3b46-4c4d-bad9-5c4ae442fa2c') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:53.283610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event updated for resources: {'Port': ['ID=ae4c16c8-09ae-4f89-aee7-857d7f243a74,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:53.287215 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c05f1df-bf06-47a6-9e1d-77f8f2aeb0d4 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.338332 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.348010 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a806468d-fcce-4cbf-800a-e1f5854e9dd4 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=72661a7725af479184d92072db7e4c08&name=default HTTP/1.1" status: 200 len: 2983 time: 1.2799413 May 12 15:24:53.348257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3176788e-e7ce-46a6-a3b3-044c40356055,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:53.349524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39436) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:53.351884 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a806468d-fcce-4cbf-800a-e1f5854e9dd4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b6f7c30-58ad-4de9-8a57-997278cb2320,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:53.368715 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c05f1df-bf06-47a6-9e1d-77f8f2aeb0d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.369881 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 975b04d5-ca4b-4584-8ccd-28c9788e8532, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=975b04d5-ca4b-4584-8ccd-28c9788e8532,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:53.374467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Checking segment: {'id': '5485588e-9f93-46e8-b3b1-a219b499e8ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd17b8c7a-f043-4c59-bfab-832deab11818'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:24:53.374814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Network hostable DHCP agents. Network: d17b8c7a-f043-4c59-bfab-832deab11818, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:24:53.379507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21f7ecac-d329-449a-9986-38af14663f90 req-a06375d0-ae3a-42e2-9dc8-4e7ff5ec5c97 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:53.386684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21f7ecac-d329-449a-9986-38af14663f90 req-a06375d0-ae3a-42e2-9dc8-4e7ff5ec5c97 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 943 time: 0.7095568 May 12 15:24:53.388402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '975b04d5-ca4b-4584-8ccd-28c9788e8532', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'port_id': '975b04d5-ca4b-4584-8ccd-28c9788e8532', 'mac_address': 'fa:16:3e:ae:ae:91', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 573, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0ff5192a-946b-4444-900a-788b8ddc74b6', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:24:53.420670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2c05f1df-bf06-47a6-9e1d-77f8f2aeb0d4 admin admin] Releasing vlan 592 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:24:53.421073 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c05f1df-bf06-47a6-9e1d-77f8f2aeb0d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.425937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Network d17b8c7a-f043-4c59-bfab-832deab11818 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: timer() May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:24:53.439857 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:24:53.445700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f7cf8f15-a9e9-4fb9-aaa8-02a540832098 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.457307 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.458720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, d17b8c7a-f043-4c59-bfab-832deab11818) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:53.470455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:53.471016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.475694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8327884f-9316-4c56-9101-aba07e4fd854 None None] Network d17b8c7a-f043-4c59-bfab-832deab11818 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:24:53.489717 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f7cf8f15-a9e9-4fb9-aaa8-02a540832098 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.521028 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0b1a0bdd-fe1e-44fd-8807-8785bc28e374 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.8178158 May 12 15:24:53.530634 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.531899 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ccc8de16-29e9-4a11-b973-62545092b07f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 6.5997264 May 12 15:24:53.535999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39440) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:53.551885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbaf6468-1d7d-4438-8305-6b2a6a275c5d req-0f926d69-090a-43d8-b5a3-118f75baaeac tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:53.560569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 975b04d5-ca4b-4584-8ccd-28c9788e8532 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:24:53.561998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dbaf6468-1d7d-4438-8305-6b2a6a275c5d req-0f926d69-090a-43d8-b5a3-118f75baaeac tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.5603280 May 12 15:24:53.581194 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 975b04d5-ca4b-4584-8ccd-28c9788e8532, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=975b04d5-ca4b-4584-8ccd-28c9788e8532,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:53.594641 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.597495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Request body: {'router': {'name': 'tempest-ServersTestFqdnHostnames-709355631-router', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:24:53.603560 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21f7ecac-d329-449a-9986-38af14663f90 req-95ca2918-ef02-4420-93c9-7a26d64e92b7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2157123 May 12 15:24:53.620096 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f7cf8f15-a9e9-4fb9-aaa8-02a540832098 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.622383 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c05f1df-bf06-47a6-9e1d-77f8f2aeb0d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.634893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:24:53.645628 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c05f1df-bf06-47a6-9e1d-77f8f2aeb0d4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.661438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c05f1df-bf06-47a6-9e1d-77f8f2aeb0d4 admin admin] Pushing event deleted for resources: {'Network': ['ID=a0b076c1-3c74-4e19-9134-7326ad81f4c1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:53.668927 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2c05f1df-bf06-47a6-9e1d-77f8f2aeb0d4 admin admin] 10.222.0.82 "DELETE /v2.0/networks/a0b076c1-3c74-4e19-9134-7326ad81f4c1 HTTP/1.1" status: 204 len: 168 time: 1.8564339 May 12 15:24:53.672472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39446) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:53.675297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Usage tracker for resource:router and tenant:5ef041b6d09e485b8dc7bd49d87599d2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:24:53.692670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:24:53.698735 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f7cf8f15-a9e9-4fb9-aaa8-02a540832098 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.700085 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f7cf8f15-a9e9-4fb9-aaa8-02a540832098 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8b6f7c30-58ad-4de9-8a57-997278cb2320 HTTP/1.1" status: 204 len: 168 time: 0.3490326 May 12 15:24:53.701266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7cf8f15-a9e9-4fb9-aaa8-02a540832098 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b6f7c30-58ad-4de9-8a57-997278cb2320,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:53.720079 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dbaf6468-1d7d-4438-8305-6b2a6a275c5d req-5b50e819-6598-4545-82be-53b5f03d88db tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1568484 May 12 15:24:53.745317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:24:53.757644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=975b04d5-ca4b-4584-8ccd-28c9788e8532,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:53.808027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-28b22591-8bc4-423a-8b83-d8d1a1524583 admin admin] Deleting subnet f1533468-fd8e-4b1f-ae08-989d2aa533f1 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:24:53.817204 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.818350 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.821154 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28b22591-8bc4-423a-8b83-d8d1a1524583 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.854104 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:53.861039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['975b04d5-ca4b-4584-8ccd-28c9788e8532'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:24:53.947977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-d17b8c7a-f043-4c59-bfab-832deab11818', 'network_id': 'd17b8c7a-f043-4c59-bfab-832deab11818', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'fixed_ips': [{'subnet_id': '3176788e-e7ce-46a6-a3b3-044c40356055'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:24:53.948654 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:54.018759 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28b22591-8bc4-423a-8b83-d8d1a1524583 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:54.119422 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28b22591-8bc4-423a-8b83-d8d1a1524583 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:54.197669 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Allocated IP 172.20.0.2 (d17b8c7a-f043-4c59-bfab-832deab11818/3176788e-e7ce-46a6-a3b3-044c40356055/ccb803d6-3575-4208-82c6-8d8046f62b21) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:24:54.271628 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:54.315919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af9d1f71-55ed-4bb8-82d2-4b7724c3f951 req-6c69c275-ad64-4205-9eaf-ab34aa7672cb tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:54.328350 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af9d1f71-55ed-4bb8-82d2-4b7724c3f951 req-6c69c275-ad64-4205-9eaf-ab34aa7672cb tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.5145881 May 12 15:24:54.331922 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28b22591-8bc4-423a-8b83-d8d1a1524583 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:54.475837 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28b22591-8bc4-423a-8b83-d8d1a1524583 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f1533468-fd8e-4b1f-ae08-989d2aa533f1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:54.504028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d67acba-c750-4145-bd88-1ea416fc4f2b req-49560547-e68c-4da0-9c06-19170129f5c7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:54.511089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d67acba-c750-4145-bd88-1ea416fc4f2b req-49560547-e68c-4da0-9c06-19170129f5c7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.5811524 May 12 15:24:54.523839 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28b22591-8bc4-423a-8b83-d8d1a1524583 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:54.561970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-28b22591-8bc4-423a-8b83-d8d1a1524583 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/f1533468-fd8e-4b1f-ae08-989d2aa533f1 HTTP/1.1" status: 204 len: 168 time: 0.8882830 May 12 15:24:54.565069 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:54.566038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39468) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:54.579578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Transition to ACTIVE for port object ccb803d6-3575-4208-82c6-8d8046f62b21 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:54.583189 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af9d1f71-55ed-4bb8-82d2-4b7724c3f951 req-ef7bcb62-8a00-4e78-b070-39546176e605 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2535877 May 12 15:24:54.604699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Transition to ACTIVE for port object ccb803d6-3575-4208-82c6-8d8046f62b21 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:54.614615 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:54.697693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d67acba-c750-4145-bd88-1ea416fc4f2b req-9a8547f1-ac0e-4789-a7c5-3ba12fcdf9c8 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1856005 May 12 15:24:54.711753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Network d17b8c7a-f043-4c59-bfab-832deab11818 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:24:54.716949 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:54.738992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:24:54.745418 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Pushing event updated for resources: {'Port': ['ID=ccb803d6-3575-4208-82c6-8d8046f62b21,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:54.797041 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:54.853256 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:54.854601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Attempting to bind port ccb803d6-3575-4208-82c6-8d8046f62b21 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:24:54.855030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Attempting to bind port ccb803d6-3575-4208-82c6-8d8046f62b21 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '5485588e-9f93-46e8-b3b1-a219b499e8ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd17b8c7a-f043-4c59-bfab-832deab11818'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:24:54.855313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Attempting to bind port ccb803d6-3575-4208-82c6-8d8046f62b21 on network d17b8c7a-f043-4c59-bfab-832deab11818 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:24:54.862693 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 24, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:24:54.863056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Checking segment: {'id': '5485588e-9f93-46e8-b3b1-a219b499e8ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd17b8c7a-f043-4c59-bfab-832deab11818'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:24:54.863448 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:54.863828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Bound using segment: {'id': '5485588e-9f93-46e8-b3b1-a219b499e8ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd17b8c7a-f043-4c59-bfab-832deab11818'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:24:54.864293 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Bound port: ccb803d6-3575-4208-82c6-8d8046f62b21, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5485588e-9f93-46e8-b3b1-a219b499e8ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd17b8c7a-f043-4c59-bfab-832deab11818'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:24:54.864724 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:54.973034 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2a36dd6b-1deb-4319-831d-0f9b5df0f406 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:54.976655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] For port ccb803d6-3575-4208-82c6-8d8046f62b21, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:24:54.982303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] For port ccb803d6-3575-4208-82c6-8d8046f62b21, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ccb803d6-3575-4208-82c6-8d8046f62b21,segment=NetworkSegment(5485588e-9f93-46e8-b3b1-a219b499e8ce),segment_id=5485588e-9f93-46e8-b3b1-a219b499e8ce)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:24:54.987102 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:54.997720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-0a4ba6db-b03d-4ea2-928b-1deed35ed2d2 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Synchronizing usage tracker for tenant:f4660a6351274a7796c2eb1e55a41ec9 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:24:55.111213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2deeb2a7-8226-48e2-902c-aca29ab7e538 None None] Pushing event updated for resources: {'Port': ['ID=ccb803d6-3575-4208-82c6-8d8046f62b21,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:55.125764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 975b04d5-ca4b-4584-8ccd-28c9788e8532 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:24:55.171444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Allocated IP 172.25.8.19 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/a5606f55-73cb-4764-be8a-a7dc3a19b0d3) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:24:55.180296 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-0a4ba6db-b03d-4ea2-928b-1deed35ed2d2 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Unset dirty status for tenant:f4660a6351274a7796c2eb1e55a41ec9 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:24:55.184470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-0a4ba6db-b03d-4ea2-928b-1deed35ed2d2 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1481014839&fields=id&tenant_id=f4660a6351274a7796c2eb1e55a41ec9 HTTP/1.1" status: 200 len: 267 time: 0.4388783 May 12 15:24:55.216734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 975b04d5-ca4b-4584-8ccd-28c9788e8532 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:24:55.222930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 975b04d5-ca4b-4584-8ccd-28c9788e8532 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:55.224185 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:55.353649 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2a36dd6b-1deb-4319-831d-0f9b5df0f406 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:55.415180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-2a36dd6b-1deb-4319-831d-0f9b5df0f406 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7a7f1973-5daf-4c04-a068-b6dd69512e7a']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:55.447169 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:55.454994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-2a36dd6b-1deb-4319-831d-0f9b5df0f406 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '11587d91-1040-4305-909d-7bb402f0367c') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:55.454994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-2a36dd6b-1deb-4319-831d-0f9b5df0f406 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '11587d91-1040-4305-909d-7bb402f0367c') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:55.572648 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2a36dd6b-1deb-4319-831d-0f9b5df0f406 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:55.592956 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:55.621149 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:55.654251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c19b34d-18f4-4f8e-9635-2edf259c0ca5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '975b04d5-ca4b-4584-8ccd-28c9788e8532'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:24:55.667560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 975b04d5-ca4b-4584-8ccd-28c9788e8532, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=975b04d5-ca4b-4584-8ccd-28c9788e8532,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:55.680449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-73f904d1-da01-47e2-bb04-e26b1362cf05 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:55.680785 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:55.681917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-73f904d1-da01-47e2-bb04-e26b1362cf05 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Synchronizing usage tracker for tenant:f4660a6351274a7796c2eb1e55a41ec9 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:24:55.717212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:24:55.719304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-361a84ab-7d9b-4f3a-a2ee-a132409ca0cf req-76e1baa9-cfab-4c8f-a9be-0342d27d1b51 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:55.720292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:24:55.724765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:24:55.727461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-361a84ab-7d9b-4f3a-a2ee-a132409ca0cf req-76e1baa9-cfab-4c8f-a9be-0342d27d1b51 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 944 time: 0.5243294 May 12 15:24:55.736389 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2a36dd6b-1deb-4319-831d-0f9b5df0f406 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:55.778210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2a36dd6b-1deb-4319-831d-0f9b5df0f406 admin admin] Releasing vlan 574 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:24:55.778643 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2a36dd6b-1deb-4319-831d-0f9b5df0f406 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: timer() May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:24:55.795824 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:24:55.798223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Pushing event updated for resources: {'Port': ['ID=a5606f55-73cb-4764-be8a-a7dc3a19b0d3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:55.817266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=975b04d5-ca4b-4584-8ccd-28c9788e8532,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:55.870849 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:24:55.871473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-73f904d1-da01-47e2-bb04-e26b1362cf05 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Unset dirty status for tenant:f4660a6351274a7796c2eb1e55a41ec9 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:24:55.872296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-73f904d1-da01-47e2-bb04-e26b1362cf05 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/networks?id=e1655f9a-2478-49d5-a6ca-4fec717d6816 HTTP/1.1" status: 200 len: 811 time: 0.6678748 May 12 15:24:55.917309 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-361a84ab-7d9b-4f3a-a2ee-a132409ca0cf req-39e3eefc-a551-409e-9bae-8f5b505556da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1883261 May 12 15:24:55.918798 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-220ee7a1-2e35-42ef-97a0-007a972f8b32 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/quotas/f4660a6351274a7796c2eb1e55a41ec9 HTTP/1.1" status: 200 len: 375 time: 0.0375664 May 12 15:24:55.930737 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2a36dd6b-1deb-4319-831d-0f9b5df0f406 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:55.936944 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2a36dd6b-1deb-4319-831d-0f9b5df0f406 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:56.020043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2a36dd6b-1deb-4319-831d-0f9b5df0f406 admin admin] 10.222.0.82 "DELETE /v2.0/networks/7a7f1973-5daf-4c04-a068-b6dd69512e7a HTTP/1.1" status: 204 len: 168 time: 1.4357059 May 12 15:24:56.030673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a36dd6b-1deb-4319-831d-0f9b5df0f406 admin admin] Pushing event deleted for resources: {'Network': ['ID=7a7f1973-5daf-4c04-a068-b6dd69512e7a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:56.107759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-cd65e3fa-8f03-4268-8983-68274334a344 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Synchronizing usage tracker for tenant:f4660a6351274a7796c2eb1e55a41ec9 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:24:56.188314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-cd65e3fa-8f03-4268-8983-68274334a344 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Unset dirty status for tenant:f4660a6351274a7796c2eb1e55a41ec9 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:24:56.202653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-cd65e3fa-8f03-4268-8983-68274334a344 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=f4660a6351274a7796c2eb1e55a41ec9&fields=id HTTP/1.1" status: 200 len: 348 time: 0.2296386 May 12 15:24:56.283009 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39514) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:56.348511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d81eb8b7-3528-4c8d-be91-cb3e9dc7b6bc req-13189936-3f13-407d-ba22-4f881f2a34ee tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:56.357199 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d81eb8b7-3528-4c8d-be91-cb3e9dc7b6bc req-13189936-3f13-407d-ba22-4f881f2a34ee tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2442369 May 12 15:24:56.445958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d81eb8b7-3528-4c8d-be91-cb3e9dc7b6bc req-14350ba4-f8c3-499e-92f4-f8b05be3a0fe tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0865450 May 12 15:24:56.479490 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-92fc73fb-20fb-40ba-9686-8fa8e33d886e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=201385419c7a4181b53703681dcc450a&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1894944 May 12 15:24:56.483137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39524) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:56.488440 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4d00fbee-902c-4663-8ff7-792115949468 service neutron] 10.222.0.82 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2812915 May 12 15:24:56.513059 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:56.741043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5202f9e7-eff6-41f0-a73a-21ec072dc216 None None] Network d17b8c7a-f043-4c59-bfab-832deab11818 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:24:56.748322 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-d5721532-6760-4fb1-8133-c240d45bcda4 service neutron] 10.222.0.82 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2489638 May 12 15:24:56.788006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-307c6ac8-7537-46c0-86e9-502cf86ba7c9 req-b433ce59-ddb4-4c3f-85c8-032d524cb6c2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:56.796998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-307c6ac8-7537-46c0-86e9-502cf86ba7c9 req-b433ce59-ddb4-4c3f-85c8-032d524cb6c2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1482601 May 12 15:24:56.864171 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8cb4108a-8b3c-4167-bff9-c23e894a2034 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:56.867313 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-307c6ac8-7537-46c0-86e9-502cf86ba7c9 req-68c5375b-2a78-4342-8a36-f0a0f7fcb4f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0683558 May 12 15:24:56.931704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8cb4108a-8b3c-4167-bff9-c23e894a2034 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:57.079281 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f96e023f-cb76-4611-bd71-329082c80966'] response: {'server_uuid': '1c19b34d-18f4-4f8e-9635-2edf259c0ca5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '975b04d5-ca4b-4584-8ccd-28c9788e8532', 'code': 200} May 12 15:24:57.147989 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:57.212334 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-db2a1731-4236-4f3a-a5b1-64e568c970dc None None] Provisioning for port ccb803d6-3575-4208-82c6-8d8046f62b21 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:24:57.240446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0b66a9b-5252-4239-9711-6dde420bd1c1 req-cbd02d35-68fa-4608-b6bc-848c55530f13 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:57.250559 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0b66a9b-5252-4239-9711-6dde420bd1c1 req-cbd02d35-68fa-4608-b6bc-848c55530f13 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1834891 May 12 15:24:57.284284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ccb803d6-3575-4208-82c6-8d8046f62b21 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:24:57.400414 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0b66a9b-5252-4239-9711-6dde420bd1c1 req-59288534-9024-4827-866c-e044d64cf2d3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1476963 May 12 15:24:57.511058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ccb803d6-3575-4208-82c6-8d8046f62b21 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:24:57.518240 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ccb803d6-3575-4208-82c6-8d8046f62b21 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:57.518619 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:57.634278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-796e6674-a30b-4ea1-ae67-0d0e5048e46a req-7faedda5-0e91-4585-ab3d-15ad1968112b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:57.639185 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-796e6674-a30b-4ea1-ae67-0d0e5048e46a req-7faedda5-0e91-4585-ab3d-15ad1968112b service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 1096 time: 0.6222711 May 12 15:24:57.648655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8cb4108a-8b3c-4167-bff9-c23e894a2034 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:57.695893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cb4108a-8b3c-4167-bff9-c23e894a2034 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=598fd7fc-133f-4176-ac37-5445c6a8ca15,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:57.716996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Router c0ee1ba5-20b8-4cf8-88a4-413629d7d227 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:24:57.775597 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:57.813187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f2e8a10f-42ab-447f-9e7f-8e3b4d5a6dbe None None] Provisioning complete for port ccb803d6-3575-4208-82c6-8d8046f62b21 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:57.813600 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f2e8a10f-42ab-447f-9e7f-8e3b4d5a6dbe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:57.841428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c97701e0-f489-426f-825a-3f4354ce3c4c req-a26ba6fd-ac90-4371-b0c1-2a6185fecbca tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:57.843798 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c97701e0-f489-426f-825a-3f4354ce3c4c req-a26ba6fd-ac90-4371-b0c1-2a6185fecbca tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 945 time: 0.1959021 May 12 15:24:57.857613 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8cb4108a-8b3c-4167-bff9-c23e894a2034 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:57.858776 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8cb4108a-8b3c-4167-bff9-c23e894a2034 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/598fd7fc-133f-4176-ac37-5445c6a8ca15 HTTP/1.1" status: 204 len: 168 time: 1.3746896 May 12 15:24:57.898828 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-796e6674-a30b-4ea1-ae67-0d0e5048e46a req-3002ed58-842d-4eff-af37-d223edc6c9a9 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2394266 May 12 15:24:57.907411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ccb803d6-3575-4208-82c6-8d8046f62b21, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ccb803d6-3575-4208-82c6-8d8046f62b21,segment=NetworkSegment(5485588e-9f93-46e8-b3b1-a219b499e8ce),segment_id=5485588e-9f93-46e8-b3b1-a219b499e8ce)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:24:57.933646 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c97701e0-f489-426f-825a-3f4354ce3c4c req-e5d4a562-8035-4977-a2e2-0a441a8891b5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0767014 May 12 15:24:57.955101 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:58.028905 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4733ab76-b501-4ea5-9f7c-13f705dafbe0 req-b4c9f5ef-366d-4221-98d5-5ac5a2e85988 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 210 time: 0.0858905 May 12 15:24:58.062667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:24:58.092795 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:58.102411 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-19b47a1a-e0e2-4dab-b226-6c0a4cf5934b admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 4.5647986 May 12 15:24:58.105078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39568) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:58.125983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Sync routers for ids ['c0ee1ba5-20b8-4cf8-88a4-413629d7d227'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:24:58.158350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ccb803d6-3575-4208-82c6-8d8046f62b21,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:24:58.164988 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Routers {'c0ee1ba5-20b8-4cf8-88a4-413629d7d227'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:24:58.166236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:24:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c0ee1ba5-20b8-4cf8-88a4-413629d7d227'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:58.337638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37362ffb-c84d-4081-ba34-142fb804e351 req-28c1554a-2875-40d3-9296-fb6688972f54 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:58.340514 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37362ffb-c84d-4081-ba34-142fb804e351 req-28c1554a-2875-40d3-9296-fb6688972f54 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2461143 May 12 15:24:58.349466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8cba539-c22b-4afd-9734-2a1313837b6f req-4cad3b70-c1fc-45c8-bd4c-f605a6774d74 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:58.351395 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f8cba539-c22b-4afd-9734-2a1313837b6f req-4cad3b70-c1fc-45c8-bd4c-f605a6774d74 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1444664 May 12 15:24:58.556337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Set router c0ee1ba5-20b8-4cf8-88a4-413629d7d227 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:24:58.599791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39580) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:58.618199 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37362ffb-c84d-4081-ba34-142fb804e351 req-3c68b19c-41b3-4597-a7dd-e9bd78875bc5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2608831 May 12 15:24:58.618199 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f8cba539-c22b-4afd-9734-2a1313837b6f req-ddb28c03-dc9c-4111-a5b9-855137e34e95 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2484066 May 12 15:24:58.797455 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5ed96cc7-a36d-4d87-b283-3958aa83599c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=194a99873f4a4aea856e9a232cadc973&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1962047 May 12 15:24:58.806235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39594) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:24:58.904391 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9bd02b8-e0be-4a70-94e8-6507de8aa3cc req-2a6f93e1-da52-476a-9279-72402a8ef314 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:58.911824 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9bd02b8-e0be-4a70-94e8-6507de8aa3cc req-2a6f93e1-da52-476a-9279-72402a8ef314 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1460538 May 12 15:24:58.970448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9bd02b8-e0be-4a70-94e8-6507de8aa3cc req-ecb7c137-20b5-4f7c-8db7-032ffae531b0 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0574024 May 12 15:24:59.025625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'name': 'tempest-ServersTestFqdnHostnames-709355631-router', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.19'}], 'enable_snat': True}, 'gw_port_id': 'a5606f55-73cb-4764-be8a-a7dc3a19b0d3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:53Z', 'updated_at': '2022-05-12T15:24:56Z', 'revision_number': 3, 'project_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'gw_port': {'id': 'a5606f55-73cb-4764-be8a-a7dc3a19b0d3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:57:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1846, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:54Z', 'updated_at': '2022-05-12T15:24:55Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:24:59.032150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Checking router: c0ee1ba5-20b8-4cf8-88a4-413629d7d227 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:24:59.032588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Updating router c0ee1ba5-20b8-4cf8-88a4-413629d7d227 port a5606f55-73cb-4764-be8a-a7dc3a19b0d3 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:24:59.157759 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:59.192507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ccb803d6-3575-4208-82c6-8d8046f62b21 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:24:59.332372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c5356d-3639-46a5-8529-f489eb6b58c0 req-5a2c2785-554a-48b0-937c-5e0de012cfa3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:59.341586 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60c5356d-3639-46a5-8529-f489eb6b58c0 req-5a2c2785-554a-48b0-937c-5e0de012cfa3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 945 time: 0.2160916 May 12 15:24:59.405751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0e5974b-17f2-4d03-8a00-ea579f1373ff req-c4907e09-6d67-4a8d-8e79-2fe337724368 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:59.407221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0e5974b-17f2-4d03-8a00-ea579f1373ff req-c4907e09-6d67-4a8d-8e79-2fe337724368 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1791227 May 12 15:24:59.417426 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60c5356d-3639-46a5-8529-f489eb6b58c0 req-41fa37f3-064d-47df-b0b4-004f5db50271 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0749052 May 12 15:24:59.509416 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0e5974b-17f2-4d03-8a00-ea579f1373ff req-8dd30a6e-0dd5-4abe-a6de-b8a1fa70e8c5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0901000 May 12 15:24:59.542521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ccb803d6-3575-4208-82c6-8d8046f62b21 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:24:59.543128 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:59.633437 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-154b72e8-1c60-4783-bbb9-fcda25318dde admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:59.653997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-3a9e50ac-f297-4d20-86f7-d295877b02df tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:59.655706 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-3a9e50ac-f297-4d20-86f7-d295877b02df tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.76 "GET /v2.0/networks?id=e1655f9a-2478-49d5-a6ca-4fec717d6816 HTTP/1.1" status: 200 len: 811 time: 0.3257172 May 12 15:24:59.663425 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-001cd2cd-deac-4b53-b34f-a7b859b7f5e7 req-c96abfe2-cd2d-4c59-a896-c07ba0920a3d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 210 time: 0.0759275 May 12 15:24:59.675446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f395c650-4a66-43dd-bb50-192a790b8277 req-63f18fce-8748-44c3-85bc-071e588811fe tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:59.679084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-f395c650-4a66-43dd-bb50-192a790b8277 req-63f18fce-8748-44c3-85bc-071e588811fe tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Synchronizing usage tracker for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:24:59.785801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-f395c650-4a66-43dd-bb50-192a790b8277 req-63f18fce-8748-44c3-85bc-071e588811fe tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Unset dirty status for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:24:59.787208 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-63f18fce-8748-44c3-85bc-071e588811fe tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "GET /v2.0/ports?device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 945 time: 0.7288592 May 12 15:24:59.789019 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-154b72e8-1c60-4783-bbb9-fcda25318dde admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:59.802089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef60fb9-4e1b-4e8b-a241-06fe35d88080 req-c415afcd-b885-4896-b119-31d2b8adf51f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:24:59.812552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ef60fb9-4e1b-4e8b-a241-06fe35d88080 req-c415afcd-b885-4896-b119-31d2b8adf51f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1108062 May 12 15:24:59.880853 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ef60fb9-4e1b-4e8b-a241-06fe35d88080 req-b27120f5-cf53-413e-8aec-b9528a8e08f9 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0639679 May 12 15:24:59.923821 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:59.946995 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Transition to ACTIVE for port object a5606f55-73cb-4764-be8a-a7dc3a19b0d3 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:24:59.963208 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-331edcda-afe2-4a19-9e52-4d1476b31944 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f4660a6351274a7796c2eb1e55a41ec9 HTTP/1.1" status: 200 len: 380 time: 0.2806876 May 12 15:24:59.969006 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:24:59.986509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Request body: {'port': {'device_id': '3d46f981-e448-45e2-8221-e0c06f862ad5', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'admin_state_up': True, 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'security_groups': ['8d7b8995-77e9-4755-a140-038fd74473e0']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:00.008299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8bb2edd-fe5a-4409-8e67-9219c2cbaa65 req-cf3cc2fd-3226-4ec3-9f03-14f4f129ff76 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:00.010916 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8bb2edd-fe5a-4409-8e67-9219c2cbaa65 req-cf3cc2fd-3226-4ec3-9f03-14f4f129ff76 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1466408 May 12 15:25:00.082425 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8bb2edd-fe5a-4409-8e67-9219c2cbaa65 req-3493409a-77d8-481f-890f-f62f313839d7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637090 May 12 15:25:00.083024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-f395c650-4a66-43dd-bb50-192a790b8277 req-1aa0c9f1-0f2b-43d4-95b6-69c63ede313d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Deleting port 975b04d5-ca4b-4584-8ccd-28c9788e8532 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:25:00.083468 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f395c650-4a66-43dd-bb50-192a790b8277 req-1aa0c9f1-0f2b-43d4-95b6-69c63ede313d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:00.136613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Attempting to bind port a5606f55-73cb-4764-be8a-a7dc3a19b0d3 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:25:00.138024 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Attempting to bind port a5606f55-73cb-4764-be8a-a7dc3a19b0d3 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:25:00.139564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Attempting to bind port a5606f55-73cb-4764-be8a-a7dc3a19b0d3 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:00.149325 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd31e434-665f-4985-873f-7709ea82ef74 None None] Pushing event updated for resources: {'Port': ['ID=a5606f55-73cb-4764-be8a-a7dc3a19b0d3,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:00.158373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 24, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:25:00.159170 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:25:00.160335 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:00.160335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:25:00.160618 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Bound port: a5606f55-73cb-4764-be8a-a7dc3a19b0d3, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:25:00.160977 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:00.217963 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-154b72e8-1c60-4783-bbb9-fcda25318dde admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:00.248649 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] For port a5606f55-73cb-4764-be8a-a7dc3a19b0d3, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:25:00.251950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] For port a5606f55-73cb-4764-be8a-a7dc3a19b0d3, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a5606f55-73cb-4764-be8a-a7dc3a19b0d3,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:25:00.257181 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:00.298748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-154b72e8-1c60-4783-bbb9-fcda25318dde admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17d7e430-8d13-4a9c-a45d-ba03bb0cb8df,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:00.311821 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:00.341727 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-154b72e8-1c60-4783-bbb9-fcda25318dde admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:00.342936 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-154b72e8-1c60-4783-bbb9-fcda25318dde admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/17d7e430-8d13-4a9c-a45d-ba03bb0cb8df HTTP/1.1" status: 204 len: 168 time: 1.5210011 May 12 15:25:00.383682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd31e434-665f-4985-873f-7709ea82ef74 None None] Pushing event updated for resources: {'Port': ['ID=a5606f55-73cb-4764-be8a-a7dc3a19b0d3,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:00.400374 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Routers {'c0ee1ba5-20b8-4cf8-88a4-413629d7d227'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:25:00.401213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:24:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c0ee1ba5-20b8-4cf8-88a4-413629d7d227'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:00.425138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:00.716037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:00.773172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Made reservation on behalf of f4660a6351274a7796c2eb1e55a41ec9 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:25:00.777114 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:00.850885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] Set router c0ee1ba5-20b8-4cf8-88a4-413629d7d227 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:25:00.922887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f395c650-4a66-43dd-bb50-192a790b8277 req-1aa0c9f1-0f2b-43d4-95b6-69c63ede313d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] For port 975b04d5-ca4b-4584-8ccd-28c9788e8532, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=975b04d5-ca4b-4584-8ccd-28c9788e8532,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:00.923250 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f395c650-4a66-43dd-bb50-192a790b8277 req-1aa0c9f1-0f2b-43d4-95b6-69c63ede313d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:00.934146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add88a30-7574-47d3-8517-9f0c0d103ecc req-3b74699a-5270-47ea-910b-259b2baf039f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:00.944140 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-add88a30-7574-47d3-8517-9f0c0d103ecc req-3b74699a-5270-47ea-910b-259b2baf039f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 945 time: 0.2721393 May 12 15:25:01.075384 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-add88a30-7574-47d3-8517-9f0c0d103ecc req-5de522ac-563b-46b0-98b5-6c0c527f48d3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1297190 May 12 15:25:01.096286 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74a5efa4-eccf-4a77-9b0e-962dbb7654ba req-7079fea3-39c4-4400-9d2d-c8b3b9d1d563 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 210 time: 0.1482162 May 12 15:25:01.199933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-f395c650-4a66-43dd-bb50-192a790b8277 req-1aa0c9f1-0f2b-43d4-95b6-69c63ede313d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Calling delete_port for 975b04d5-ca4b-4584-8ccd-28c9788e8532 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:25:01.428421 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'name': 'tempest-ServersTestFqdnHostnames-709355631-router', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.19'}], 'enable_snat': True}, 'gw_port_id': 'a5606f55-73cb-4764-be8a-a7dc3a19b0d3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:53Z', 'updated_at': '2022-05-12T15:24:56Z', 'revision_number': 3, 'project_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'gw_port': {'id': 'a5606f55-73cb-4764-be8a-a7dc3a19b0d3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:57:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1846, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:54Z', 'updated_at': '2022-05-12T15:25:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:01.434908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9aa7fb2a-1961-4716-be0b-f83aebfb6286 None None] The sync data for ids ['c0ee1ba5-20b8-4cf8-88a4-413629d7d227'] in n-d-841483-1 is: [{'id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'name': 'tempest-ServersTestFqdnHostnames-709355631-router', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.19'}], 'enable_snat': True}, 'gw_port_id': 'a5606f55-73cb-4764-be8a-a7dc3a19b0d3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:53Z', 'updated_at': '2022-05-12T15:24:56Z', 'revision_number': 3, 'project_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'gw_port': {'id': 'a5606f55-73cb-4764-be8a-a7dc3a19b0d3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:57:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1846, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:54Z', 'updated_at': '2022-05-12T15:25:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:25:01.441272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39656) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:01.489652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56889fb4-81a4-40d3-b635-85fc211a6850 req-a77e5678-31f2-4cd5-86f5-8f0cf747d436 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:01.501335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56889fb4-81a4-40d3-b635-85fc211a6850 req-a77e5678-31f2-4cd5-86f5-8f0cf747d436 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1143019 May 12 15:25:01.564526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56889fb4-81a4-40d3-b635-85fc211a6850 req-f6adb7cf-58cb-4a3d-b4eb-fce0a8a1c052 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620680 May 12 15:25:01.623980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f395c650-4a66-43dd-bb50-192a790b8277 req-1aa0c9f1-0f2b-43d4-95b6-69c63ede313d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:01.636846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['975b04d5-ca4b-4584-8ccd-28c9788e8532'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:25:01.711019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aa0c9f1-0f2b-43d4-95b6-69c63ede313d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Pushing event deleted for resources: {'Port': ['ID=975b04d5-ca4b-4584-8ccd-28c9788e8532,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:01.786480 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ee8aa9a8-36c1-46e8-b7e7-3c25a4e08bc5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:01.805013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ee8aa9a8-36c1-46e8-b7e7-3c25a4e08bc5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:01.809759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ee8aa9a8-36c1-46e8-b7e7-3c25a4e08bc5 admin admin] Usage tracker for resource:security_group_rule and tenant:86773bc93d9646d9b68adc1a8d4cc1fb is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:01.813648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ee8aa9a8-36c1-46e8-b7e7-3c25a4e08bc5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:01.818569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ee8aa9a8-36c1-46e8-b7e7-3c25a4e08bc5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:01.829367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-f395c650-4a66-43dd-bb50-192a790b8277 req-1aa0c9f1-0f2b-43d4-95b6-69c63ede313d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] No DVR routers for this DVR port 975b04d5-ca4b-4584-8ccd-28c9788e8532 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:25:01.832359 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f395c650-4a66-43dd-bb50-192a790b8277 req-1aa0c9f1-0f2b-43d4-95b6-69c63ede313d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:01.845669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c19b34d-18f4-4f8e-9635-2edf259c0ca5', 'name': 'network-vif-deleted', 'tag': '975b04d5-ca4b-4584-8ccd-28c9788e8532'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:01.855275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Allocated IP 172.20.0.14 (e1655f9a-2478-49d5-a6ca-4fec717d6816/83787d82-d8a5-4f12-a025-f44dcf581189/d4f9886d-fb34-4a11-9462-3343e8a12db0) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:25:01.870286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Allocated IP 172.20.0.1 (d17b8c7a-f043-4c59-bfab-832deab11818/3176788e-e7ce-46a6-a3b3-044c40356055/cb75c658-7e4d-4d2f-a743-00f05fb7c2c8) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:25:01.968114 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f395c650-4a66-43dd-bb50-192a790b8277 req-1aa0c9f1-0f2b-43d4-95b6-69c63ede313d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "DELETE /v2.0/ports/975b04d5-ca4b-4584-8ccd-28c9788e8532 HTTP/1.1" status: 204 len: 173 time: 2.1424704 May 12 15:25:01.993206 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ee8aa9a8-36c1-46e8-b7e7-3c25a4e08bc5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:02.001174 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ee8aa9a8-36c1-46e8-b7e7-3c25a4e08bc5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:02.042312 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b9f72cd7-f015-4056-b716-fcd0147048e8'] response: {'server_uuid': '1c19b34d-18f4-4f8e-9635-2edf259c0ca5', 'name': 'network-vif-deleted', 'tag': '975b04d5-ca4b-4584-8ccd-28c9788e8532', 'status': 'completed', 'code': 200} May 12 15:25:02.098905 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ee8aa9a8-36c1-46e8-b7e7-3c25a4e08bc5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=86773bc93d9646d9b68adc1a8d4cc1fb&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6539209 May 12 15:25:02.117276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39676) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:02.137174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee8aa9a8-36c1-46e8-b7e7-3c25a4e08bc5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a04d12d7-6242-42f1-a2a9-930518cd4cae,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:02.324082 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:02.325172 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:02.382853 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8315912c-98ed-4a20-9edd-d04e32218916 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:02.408581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Transition to ACTIVE for port object cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:25:02.420722 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:02.453448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Transition to ACTIVE for port object d4f9886d-fb34-4a11-9462-3343e8a12db0 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:25:02.480333 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:02.506765 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8315912c-98ed-4a20-9edd-d04e32218916 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:02.618638 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-03325afe-2951-4350-9b8d-ba759c634153 req-42698192-aedb-491a-8308-9120b564c528 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 210 time: 0.0888886 May 12 15:25:02.672730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Network d17b8c7a-f043-4c59-bfab-832deab11818 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:25:02.677341 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:02.677998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-abba6765-1f61-4316-aba9-63d50be4f2ee req-b84936aa-ef44-433f-b7e1-38f8d3cab92b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 210 time: 0.1223323 May 12 15:25:02.740886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abdb768c-d9a2-40fd-a058-e1e83532aab4 req-eca876aa-1632-471c-84f4-4915960d158b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:02.749619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:25:02.750238 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-abdb768c-d9a2-40fd-a058-e1e83532aab4 req-eca876aa-1632-471c-84f4-4915960d158b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 932 time: 0.1933954 May 12 15:25:02.768973 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8315912c-98ed-4a20-9edd-d04e32218916 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:02.790480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8315912c-98ed-4a20-9edd-d04e32218916 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a04d12d7-6242-42f1-a2a9-930518cd4cae,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:02.819484 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8315912c-98ed-4a20-9edd-d04e32218916 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:02.831909 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8315912c-98ed-4a20-9edd-d04e32218916 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a04d12d7-6242-42f1-a2a9-930518cd4cae HTTP/1.1" status: 204 len: 168 time: 0.7132411 May 12 15:25:02.850076 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-abdb768c-d9a2-40fd-a058-e1e83532aab4 req-1658433e-5222-4fd6-901b-a04a57b7017d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0988410 May 12 15:25:02.884485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Pushing event updated for resources: {'Port': ['ID=cb75c658-7e4d-4d2f-a743-00f05fb7c2c8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:02.903922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:25:03.025097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03325afe-2951-4350-9b8d-ba759c634153 req-5fcdf9ec-429f-4a65-b21e-ed12c954088a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:03.028096 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-03325afe-2951-4350-9b8d-ba759c634153 req-5fcdf9ec-429f-4a65-b21e-ed12c954088a service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&shared=False HTTP/1.1" status: 200 len: 913 time: 0.4008703 May 12 15:25:03.038212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Network e1655f9a-2478-49d5-a6ca-4fec717d6816 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:25:03.082977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:25:03.099954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd8abed-1134-4a68-9811-2c6e8779859f req-37b9933a-7c7d-40d6-8acc-15a795e5fc9c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:03.110945 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cd8abed-1134-4a68-9811-2c6e8779859f req-37b9933a-7c7d-40d6-8acc-15a795e5fc9c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1753578 May 12 15:25:03.219628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a5606f55-73cb-4764-be8a-a7dc3a19b0d3 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:25:03.249327 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:25:03.251545 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cd8abed-1134-4a68-9811-2c6e8779859f req-33e29ba2-74eb-4302-8111-39623cb76a8a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1393731 May 12 15:25:03.347512 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa3648b7-209a-42dd-9835-6e19a65d041d None None] Provisioning for port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:25:03.355221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa3648b7-209a-42dd-9835-6e19a65d041d None None] Provisioning complete for port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:25:03.356394 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa3648b7-209a-42dd-9835-6e19a65d041d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:03.441686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port a5606f55-73cb-4764-be8a-a7dc3a19b0d3 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:25:03.451735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a5606f55-73cb-4764-be8a-a7dc3a19b0d3 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:25:03.452153 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:03.481497 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fa3648b7-209a-42dd-9835-6e19a65d041d None None] Port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:25:03.524767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event updated for resources: {'Port': ['ID=d4f9886d-fb34-4a11-9462-3343e8a12db0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:03.564088 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:03.613516 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:03.643913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1126dc5a-8ed8-47d2-86e1-19a27d6baa64 None None] Provisioning for port d4f9886d-fb34-4a11-9462-3343e8a12db0 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:25:03.658394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1126dc5a-8ed8-47d2-86e1-19a27d6baa64 None None] Provisioning complete for port d4f9886d-fb34-4a11-9462-3343e8a12db0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:25:03.658771 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1126dc5a-8ed8-47d2-86e1-19a27d6baa64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:03.695193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:03.695887 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:03.724934 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port a5606f55-73cb-4764-be8a-a7dc3a19b0d3, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a5606f55-73cb-4764-be8a-a7dc3a19b0d3,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:03.733996 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:03.749906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39718) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:03.757094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03325afe-2951-4350-9b8d-ba759c634153 req-a4df13ad-7ea1-4e1a-9701-4221cc9eb83c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:03.758905 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-03325afe-2951-4350-9b8d-ba759c634153 req-a4df13ad-7ea1-4e1a-9701-4221cc9eb83c service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.6987481 May 12 15:25:03.763592 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-4a7b4515-975c-45ee-b1c6-40060911a041 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.7829444 May 12 15:25:03.774692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Request body: {'port': {'device_id': '3d46f981-e448-45e2-8221-e0c06f862ad5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:03.798558 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb1389d9-2f7d-4eb3-834f-66eb6a6130c1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:03.836692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bb1389d9-2f7d-4eb3-834f-66eb6a6130c1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:03.842688 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=a5606f55-73cb-4764-be8a-a7dc3a19b0d3,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:03.843732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bb1389d9-2f7d-4eb3-834f-66eb6a6130c1 admin admin] Usage tracker for resource:security_group_rule and tenant:591b0ef6a7e24168acdc2a91a604fdda is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:03.847874 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1126dc5a-8ed8-47d2-86e1-19a27d6baa64 None None] Port d4f9886d-fb34-4a11-9462-3343e8a12db0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:25:03.853860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bb1389d9-2f7d-4eb3-834f-66eb6a6130c1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:03.867605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bb1389d9-2f7d-4eb3-834f-66eb6a6130c1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:03.936216 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:04.019341 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d987ef75-7652-4a37-be92-36d1c62409ec req-86d75ac6-886b-409f-a419-db0e119ba314 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 210 time: 0.0669417 May 12 15:25:04.075742 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:04.119073 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb1389d9-2f7d-4eb3-834f-66eb6a6130c1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:04.134376 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb1389d9-2f7d-4eb3-834f-66eb6a6130c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:04.204439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb1389d9-2f7d-4eb3-834f-66eb6a6130c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dbf64b9d-0214-45b2-8673-712619d22f0c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:04.226697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bb1389d9-2f7d-4eb3-834f-66eb6a6130c1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=591b0ef6a7e24168acdc2a91a604fdda&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4720016 May 12 15:25:04.234022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39738) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:04.246689 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb17260-2752-4bad-a2a9-fd4efc6dbff5 req-6a8e118e-2492-4457-b9e5-24313acefc44 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:04.249236 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdb17260-2752-4bad-a2a9-fd4efc6dbff5 req-6a8e118e-2492-4457-b9e5-24313acefc44 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 932 time: 0.2050703 May 12 15:25:04.326454 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdb17260-2752-4bad-a2a9-fd4efc6dbff5 req-c50eff7f-0fc9-4f27-83fd-3664b59cc135 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0684714 May 12 15:25:04.499299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22083da1-2bee-4380-acee-8ae717926f65 req-00d316d5-fccb-414b-968e-6de12d0da9af tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:04.500953 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22083da1-2bee-4380-acee-8ae717926f65 req-00d316d5-fccb-414b-968e-6de12d0da9af tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.0993965 May 12 15:25:04.530398 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e896d62d-90ab-4cc2-ac71-ae87f6b1d6df admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:04.550046 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22083da1-2bee-4380-acee-8ae717926f65 req-722da437-d6bd-44e7-8cd5-b0121b7814f6 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429680 May 12 15:25:04.587143 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e896d62d-90ab-4cc2-ac71-ae87f6b1d6df admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:04.644968 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:04.661114 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:04.825020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d4f9886d-fb34-4a11-9462-3343e8a12db0 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:04.836860 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:04.839484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Pushing event updated for resources: {'Port': ['ID=cb75c658-7e4d-4d2f-a743-00f05fb7c2c8,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:04.844567 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:04.862248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e896d62d-90ab-4cc2-ac71-ae87f6b1d6df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:04.877583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Transition to ACTIVE for port object d4f9886d-fb34-4a11-9462-3343e8a12db0 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:25:04.900421 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:05.004547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e896d62d-90ab-4cc2-ac71-ae87f6b1d6df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbf64b9d-0214-45b2-8673-712619d22f0c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:05.123285 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e896d62d-90ab-4cc2-ac71-ae87f6b1d6df admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:05.124413 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e896d62d-90ab-4cc2-ac71-ae87f6b1d6df admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/dbf64b9d-0214-45b2-8673-712619d22f0c HTTP/1.1" status: 204 len: 168 time: 0.8897042 May 12 15:25:05.146083 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a5606f55-73cb-4764-be8a-a7dc3a19b0d3 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:25:05.149608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-03325afe-2951-4350-9b8d-ba759c634153 req-40ecaeb5-8ce2-4ba6-9af3-008100180d8d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Synchronizing usage tracker for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:25:05.311054 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a434b862-573c-49d2-bc42-23dd735e05a9 req-a725f44d-a2c6-4041-9b09-0c82cf7497b4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 210 time: 0.0982118 May 12 15:25:05.339245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Network d17b8c7a-f043-4c59-bfab-832deab11818 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:25:05.340999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Pushing event updated for resources: {'Port': ['ID=d4f9886d-fb34-4a11-9462-3343e8a12db0,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:05.367523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a5606f55-73cb-4764-be8a-a7dc3a19b0d3 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:25:05.369378 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:05.443216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-03325afe-2951-4350-9b8d-ba759c634153 req-40ecaeb5-8ce2-4ba6-9af3-008100180d8d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Unset dirty status for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:25:05.448256 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-03325afe-2951-4350-9b8d-ba759c634153 req-40ecaeb5-8ce2-4ba6-9af3-008100180d8d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "GET /v2.0/ports?device_id=1c19b34d-18f4-4f8e-9635-2edf259c0ca5 HTTP/1.1" status: 200 len: 210 time: 0.3631477 May 12 15:25:05.455252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:25:05.656454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6114493-d514-45b8-8306-e5d5ab8e4d9c req-8fb5748e-c236-4d6d-81aa-8ed43d3c642f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:05.665931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6114493-d514-45b8-8306-e5d5ab8e4d9c req-8fb5748e-c236-4d6d-81aa-8ed43d3c642f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 944 time: 0.1957757 May 12 15:25:05.868674 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1f3076d8-d70c-4718-a758-a812df50c92b None None] Provisioning complete for port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:25:05.869551 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1f3076d8-d70c-4718-a758-a812df50c92b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:05.932652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Attempting to bind port d4f9886d-fb34-4a11-9462-3343e8a12db0 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:25:05.933263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Attempting to bind port d4f9886d-fb34-4a11-9462-3343e8a12db0 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:25:05.933445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Attempting to bind port d4f9886d-fb34-4a11-9462-3343e8a12db0 on network e1655f9a-2478-49d5-a6ca-4fec717d6816 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:05.940995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Port d4f9886d-fb34-4a11-9462-3343e8a12db0 on network e1655f9a-2478-49d5-a6ca-4fec717d6816 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:25:05.941322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Attempting to bind port d4f9886d-fb34-4a11-9462-3343e8a12db0 on network e1655f9a-2478-49d5-a6ca-4fec717d6816 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:05.952667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 25, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:25:05.952991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Checking segment: {'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:25:05.953425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Bound using segment: {'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:25:05.953834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Bound port: d4f9886d-fb34-4a11-9462-3343e8a12db0, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:25:05.954179 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:05.959071 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6114493-d514-45b8-8306-e5d5ab8e4d9c req-90be2d4f-cdb6-4215-b59e-992cc8db9899 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2895439 May 12 15:25:06.018920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1f3076d8-d70c-4718-a758-a812df50c92b None None] Port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:25:06.030438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19608f94-25ea-4fd0-99d6-c3e785f1be2b req-1a4ca1db-a816-402b-acd9-f43940665397 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:06.039132 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19608f94-25ea-4fd0-99d6-c3e785f1be2b req-1a4ca1db-a816-402b-acd9-f43940665397 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1974149 May 12 15:25:06.098284 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19608f94-25ea-4fd0-99d6-c3e785f1be2b req-f4f58312-ad73-4107-9865-dffa73b8e096 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0578272 May 12 15:25:06.169804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39830) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:06.183017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Router c0ee1ba5-20b8-4cf8-88a4-413629d7d227 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:25:06.198373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] For port d4f9886d-fb34-4a11-9462-3343e8a12db0, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:25:06.204497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] For port d4f9886d-fb34-4a11-9462-3343e8a12db0, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d4f9886d-fb34-4a11-9462-3343e8a12db0,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:25:06.287493 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:06.352069 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eff0be89-6d56-4a98-9e1c-3ba62bb41e12 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:06.374791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-eff0be89-6d56-4a98-9e1c-3ba62bb41e12 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:06.381545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-eff0be89-6d56-4a98-9e1c-3ba62bb41e12 admin admin] Usage tracker for resource:security_group_rule and tenant:bd97faaedc8146c6abbade75f5a9e223 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:06.387239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-eff0be89-6d56-4a98-9e1c-3ba62bb41e12 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:06.396929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-eff0be89-6d56-4a98-9e1c-3ba62bb41e12 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:06.447464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:06.448117 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:06.450014 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] 10.222.0.76 "PUT /v2.0/ports/d4f9886d-fb34-4a11-9462-3343e8a12db0 HTTP/1.1" status: 200 len: 1092 time: 2.6792843 May 12 15:25:06.450657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3d46f981-e448-45e2-8221-e0c06f862ad5', 'tag': 'd4f9886d-fb34-4a11-9462-3343e8a12db0'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:06.494592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4092a48-a7aa-4c67-9043-2c8ee2e6a91f service neutron] Pushing event updated for resources: {'Port': ['ID=d4f9886d-fb34-4a11-9462-3343e8a12db0,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:06.562555 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-46a9f094-4034-4d7e-8223-52bf05539a9a'] response: {'name': 'network-changed', 'server_uuid': '3d46f981-e448-45e2-8221-e0c06f862ad5', 'tag': 'd4f9886d-fb34-4a11-9462-3343e8a12db0', 'status': 'completed', 'code': 200} May 12 15:25:06.583445 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eff0be89-6d56-4a98-9e1c-3ba62bb41e12 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:06.589895 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eff0be89-6d56-4a98-9e1c-3ba62bb41e12 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:06.595391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:25:06.609046 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Sync routers for ids ['c0ee1ba5-20b8-4cf8-88a4-413629d7d227'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:25:06.620262 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Routers {'c0ee1ba5-20b8-4cf8-88a4-413629d7d227'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:25:06.622127 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:24:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c0ee1ba5-20b8-4cf8-88a4-413629d7d227'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:06.623273 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d2e3e2b5-c779-4e1e-abfe-05aea9d1c116 admin admin] 10.222.0.82 "PUT /v2.0/routers/c0ee1ba5-20b8-4cf8-88a4-413629d7d227/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.5155928 May 12 15:25:06.627190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39852) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:06.654897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-eff0be89-6d56-4a98-9e1c-3ba62bb41e12 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bd97faaedc8146c6abbade75f5a9e223&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4834559 May 12 15:25:06.657605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39858) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:06.669591 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-7cd10120-f663-4e07-9074-7f1e626f9908 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:06.671127 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-7cd10120-f663-4e07-9074-7f1e626f9908 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=f4660a6351274a7796c2eb1e55a41ec9&device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 1095 time: 0.1725938 May 12 15:25:06.729422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eff0be89-6d56-4a98-9e1c-3ba62bb41e12 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cda43e1c-697b-4151-8e6b-a7b20bdf3064,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:06.801073 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ec6e2417-1ab0-461c-9a39-d63ad0847618 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:06.813199 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-b58271f7-d623-4132-af79-20e6438d521f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d4f9886d-fb34-4a11-9462-3343e8a12db0 HTTP/1.1" status: 200 len: 217 time: 0.1265402 May 12 15:25:06.922818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39872) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:06.923222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-808622151-network', 'tenant_id': 'a6cd12a079ad4d6cab1eec444076547b'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:06.924664 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ec6e2417-1ab0-461c-9a39-d63ad0847618 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:06.927931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-d91ccf62-e52d-4abc-88c2-1bf6d4833763 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:06.929332 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-d91ccf62-e52d-4abc-88c2-1bf6d4833763 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=83787d82-d8a5-4f12-a025-f44dcf581189 HTTP/1.1" status: 200 len: 850 time: 0.1082740 May 12 15:25:06.931719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:06.979237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Usage tracker for resource:network and tenant:a6cd12a079ad4d6cab1eec444076547b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:06.986544 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Set router c0ee1ba5-20b8-4cf8-88a4-413629d7d227 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:25:06.986821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:07.008820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:07.035925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Made reservation on behalf of a6cd12a079ad4d6cab1eec444076547b for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:25:07.039174 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:07.064584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-6862ee2d-edfc-47c8-8f24-35d5eb405125 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:07.067379 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-6862ee2d-edfc-47c8-8f24-35d5eb405125 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e1655f9a-2478-49d5-a6ca-4fec717d6816&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1323233 May 12 15:25:07.068261 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:07.132893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:07.190173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Usage tracker for resource:security_group_rule and tenant:a6cd12a079ad4d6cab1eec444076547b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:07.207388 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:07.216872 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:07.265847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c65c5405-515e-478a-92ee-81cecc3ca8e2 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:07.267398 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c65c5405-515e-478a-92ee-81cecc3ca8e2 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 812 time: 0.4489605 May 12 15:25:07.272368 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ec6e2417-1ab0-461c-9a39-d63ad0847618 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:07.306172 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-d8e04536-6757-4533-9541-b98ca4167c51 service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2219915 May 12 15:25:07.312358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec6e2417-1ab0-461c-9a39-d63ad0847618 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cda43e1c-697b-4151-8e6b-a7b20bdf3064,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:07.327927 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-4497c5d3-f37b-4da4-a85a-b208f268bc52 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/quotas/011dcf6c7b624a28bb2d8ed8db38754f HTTP/1.1" status: 200 len: 375 time: 0.0494196 May 12 15:25:07.399593 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ec6e2417-1ab0-461c-9a39-d63ad0847618 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:07.404291 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ec6e2417-1ab0-461c-9a39-d63ad0847618 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cda43e1c-697b-4151-8e6b-a7b20bdf3064 HTTP/1.1" status: 204 len: 168 time: 0.7453651 May 12 15:25:07.424843 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'name': 'tempest-ServersTestFqdnHostnames-709355631-router', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.19'}], 'enable_snat': True}, 'gw_port_id': 'a5606f55-73cb-4764-be8a-a7dc3a19b0d3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:53Z', 'updated_at': '2022-05-12T15:25:03Z', 'revision_number': 4, 'project_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'gw_port': {'id': 'a5606f55-73cb-4764-be8a-a7dc3a19b0d3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:57:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1846, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:54Z', 'updated_at': '2022-05-12T15:25:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'cb75c658-7e4d-4d2f-a743-00f05fb7c2c8', 'name': '', 'network_id': 'd17b8c7a-f043-4c59-bfab-832deab11818', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'mac_address': 'fa:16:3e:a6:1a:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'device_owner': 'network:router_interface', 'standard_attr_id': 1847, 'fixed_ips': [{'subnet_id': '3176788e-e7ce-46a6-a3b3-044c40356055', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:25:00Z', 'updated_at': '2022-05-12T15:25:04Z', 'revision_number': 2, 'project_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'subnets': [{'id': '3176788e-e7ce-46a6-a3b3-044c40356055', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:07.436598 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Checking router: c0ee1ba5-20b8-4cf8-88a4-413629d7d227 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:25:07.437714 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Updating router c0ee1ba5-20b8-4cf8-88a4-413629d7d227 port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:25:07.495603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-998a84bb-328e-430d-80d2-5b6579cd20fc tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0979757 May 12 15:25:07.507681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-40d1a43c-46f0-4ebc-a60e-4fef8d164049 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:25:07.515017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-40d1a43c-46f0-4ebc-a60e-4fef8d164049 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0162449 May 12 15:25:07.582894 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:07.595751 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-87176c3b-62aa-471e-8e23-cd31b94a06e7 req-86f511fe-4fe7-4bc0-a54c-1c9ff7263b5c service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2845418 May 12 15:25:07.598073 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:07.612272 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:07.650836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 580} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:25:07.702019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-621a5fe4-e5a6-40c0-aa8f-174d5997c831 req-05a54a07-e702-4394-9f83-94f5ebbd2ddb tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:07.703818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-621a5fe4-e5a6-40c0-aa8f-174d5997c831 req-05a54a07-e702-4394-9f83-94f5ebbd2ddb tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 944 time: 0.5762258 May 12 15:25:07.728775 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:07.729265 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Added segment ce9be9ba-77e9-4d69-90ae-2dc7b4342400 of type vlan for network f7e46f81-02b8-4bcd-a6ce-ea0d95d06100 May 12 15:25:07.738107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=298d5ce2-0e39-4957-ba55-bb703769d021,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:07.791277 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:07.814793 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be362a7-6cbb-42f9-9dfc-02565fa2bcdc req-f971e424-489e-4c76-b384-689cc9df5487 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:07.816452 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4be362a7-6cbb-42f9-9dfc-02565fa2bcdc req-f971e424-489e-4c76-b384-689cc9df5487 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=f4660a6351274a7796c2eb1e55a41ec9&device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 1095 time: 0.1618032 May 12 15:25:07.872221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-621a5fe4-e5a6-40c0-aa8f-174d5997c831 req-de818eaf-98d6-40e8-9427-b614686cd273 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1594286 May 12 15:25:07.930665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39884) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:07.945672 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-a4dbe234-cf6c-4885-848c-c337356e6db7 service neutron] 10.222.0.82 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4293966 May 12 15:25:07.963281 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:07.964650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:07.966042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:07.994352 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9338e5b3-fb3e-47ca-8abb-88957670790f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:08.055954 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:08.071517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9338e5b3-fb3e-47ca-8abb-88957670790f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:08.072003 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Transition to ACTIVE for port object cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:25:08.082087 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:08.104448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9338e5b3-fb3e-47ca-8abb-88957670790f admin admin] Usage tracker for resource:security_group_rule and tenant:ba6adf342f384bd0a973880542a3634e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:08.113575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9338e5b3-fb3e-47ca-8abb-88957670790f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:08.238926 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fb93f0b-47cc-4ed6-9500-0c2b17775127 None None] Pushing event updated for resources: {'Port': ['ID=cb75c658-7e4d-4d2f-a743-00f05fb7c2c8,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:08.328925 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.7002950 May 12 15:25:08.329836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3032b600-3e26-45de-80df-4dbf95fdb827 admin admin] Pushing event updated for resources: {'Network': ['ID=f7e46f81-02b8-4bcd-a6ce-ea0d95d06100,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:08.342053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9338e5b3-fb3e-47ca-8abb-88957670790f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:08.343565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39888) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:08.355102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network f7e46f81-02b8-4bcd-a6ce-ea0d95d06100 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:25:08.365065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be362a7-6cbb-42f9-9dfc-02565fa2bcdc req-56a97cd3-1628-4b50-beb1-b572f02676f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:08.366539 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4be362a7-6cbb-42f9-9dfc-02565fa2bcdc req-56a97cd3-1628-4b50-beb1-b572f02676f9 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e1655f9a-2478-49d5-a6ca-4fec717d6816 HTTP/1.1" status: 200 len: 912 time: 0.5399334 May 12 15:25:08.366664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Request body: {'subnet': {'network_id': 'f7e46f81-02b8-4bcd-a6ce-ea0d95d06100', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-808622151-subnet', 'tenant_id': 'a6cd12a079ad4d6cab1eec444076547b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:08.391752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-5c902eca-e5bc-47d2-a4e1-f9ccd566f825 service neutron] 10.222.0.82 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4355326 May 12 15:25:08.393033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:08.435438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Usage tracker for resource:subnet and tenant:a6cd12a079ad4d6cab1eec444076547b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:08.438746 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Attempting to bind port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:25:08.439106 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Attempting to bind port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '5485588e-9f93-46e8-b3b1-a219b499e8ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd17b8c7a-f043-4c59-bfab-832deab11818'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:25:08.439455 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Attempting to bind port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 on network d17b8c7a-f043-4c59-bfab-832deab11818 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:08.445910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:08.448694 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 24, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:25:08.449059 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Checking segment: {'id': '5485588e-9f93-46e8-b3b1-a219b499e8ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd17b8c7a-f043-4c59-bfab-832deab11818'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:25:08.449967 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:08.450351 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Bound using segment: {'id': '5485588e-9f93-46e8-b3b1-a219b499e8ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd17b8c7a-f043-4c59-bfab-832deab11818'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:25:08.451011 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Bound port: cb75c658-7e4d-4d2f-a743-00f05fb7c2c8, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5485588e-9f93-46e8-b3b1-a219b499e8ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd17b8c7a-f043-4c59-bfab-832deab11818'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:25:08.451378 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:08.494412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb44436b-0e45-4d13-b51c-cc90e8fd1f2a req-0bc0586b-d015-429d-8ee6-79bd2ff32d5e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:08.494817 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4be362a7-6cbb-42f9-9dfc-02565fa2bcdc req-295b529e-6c4d-46d7-b610-89bc9a11a300 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d4f9886d-fb34-4a11-9462-3343e8a12db0 HTTP/1.1" status: 200 len: 217 time: 0.1184893 May 12 15:25:08.506668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb44436b-0e45-4d13-b51c-cc90e8fd1f2a req-0bc0586b-d015-429d-8ee6-79bd2ff32d5e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.4694984 May 12 15:25:08.513750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:08.591278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Made reservation on behalf of a6cd12a079ad4d6cab1eec444076547b for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:25:08.594113 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:08.633558 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] For port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:25:08.634470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be362a7-6cbb-42f9-9dfc-02565fa2bcdc req-b46bdc8c-e811-4d09-aa1c-9d9c74b8414c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:08.636586 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4be362a7-6cbb-42f9-9dfc-02565fa2bcdc req-b46bdc8c-e811-4d09-aa1c-9d9c74b8414c service neutron] 10.222.0.76 "GET /v2.0/subnets?id=83787d82-d8a5-4f12-a025-f44dcf581189 HTTP/1.1" status: 200 len: 850 time: 0.1249726 May 12 15:25:08.643844 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] For port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cb75c658-7e4d-4d2f-a743-00f05fb7c2c8,segment=NetworkSegment(5485588e-9f93-46e8-b3b1-a219b499e8ce),segment_id=5485588e-9f93-46e8-b3b1-a219b499e8ce)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:25:08.650434 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:08.722678 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9338e5b3-fb3e-47ca-8abb-88957670790f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:08.728073 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fb93f0b-47cc-4ed6-9500-0c2b17775127 None None] Pushing event updated for resources: {'Port': ['ID=cb75c658-7e4d-4d2f-a743-00f05fb7c2c8,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:08.731854 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9338e5b3-fb3e-47ca-8abb-88957670790f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:08.763001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb44436b-0e45-4d13-b51c-cc90e8fd1f2a req-8f700562-f3cc-4b3e-866e-14ef8401fdcb tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2541935 May 12 15:25:08.769079 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c2dfde2-5c45-414b-a597-e403d8f23ca8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:08.779977 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Routers {'c0ee1ba5-20b8-4cf8-88a4-413629d7d227'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:25:08.781170 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:24:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c0ee1ba5-20b8-4cf8-88a4-413629d7d227'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:08.807860 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9338e5b3-fb3e-47ca-8abb-88957670790f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ba6adf342f384bd0a973880542a3634e&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8758090 May 12 15:25:08.809746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9338e5b3-fb3e-47ca-8abb-88957670790f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61ca42b4-e6d9-465b-aa09-872c5ef11ccb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:08.812886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39898) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:08.898333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be362a7-6cbb-42f9-9dfc-02565fa2bcdc req-d74f2faa-2b2d-4ff3-b3d8-394f76aed5e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:08.899929 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4be362a7-6cbb-42f9-9dfc-02565fa2bcdc req-d74f2faa-2b2d-4ff3-b3d8-394f76aed5e0 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e1655f9a-2478-49d5-a6ca-4fec717d6816&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2515411 May 12 15:25:08.943996 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b2d4d2bf-b1fb-4bd5-b174-4babc928ee82 req-db6389f9-f30c-4f98-8ce6-e8252345e0f1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 210 time: 0.2105529 May 12 15:25:09.061990 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8d23983-f528-40dd-ae14-cd192e26513a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:09.103399 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8d23983-f528-40dd-ae14-cd192e26513a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:09.162290 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4be362a7-6cbb-42f9-9dfc-02565fa2bcdc req-8954c8e7-5038-4d2b-9c79-b5e1c607320c service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2505198 May 12 15:25:09.187654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 975b04d5-ca4b-4584-8ccd-28c9788e8532 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:25:09.197848 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] Set router c0ee1ba5-20b8-4cf8-88a4-413629d7d227 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:25:09.254376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 975b04d5-ca4b-4584-8ccd-28c9788e8532 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:25:09.254724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 975b04d5-ca4b-4584-8ccd-28c9788e8532 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:25:09.363298 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8d23983-f528-40dd-ae14-cd192e26513a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:09.437028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8d23983-f528-40dd-ae14-cd192e26513a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61ca42b4-e6d9-465b-aa09-872c5ef11ccb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:09.442749 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8d23983-f528-40dd-ae14-cd192e26513a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:09.443873 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a8d23983-f528-40dd-ae14-cd192e26513a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/61ca42b4-e6d9-465b-aa09-872c5ef11ccb HTTP/1.1" status: 204 len: 168 time: 0.6288974 May 12 15:25:09.465819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a35732e0-951c-4122-88bd-c354d9a15cfd req-46a05ced-0099-4fa6-9153-bfee4b0dbc87 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:09.471502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a35732e0-951c-4122-88bd-c354d9a15cfd req-46a05ced-0099-4fa6-9153-bfee4b0dbc87 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 944 time: 0.3407485 May 12 15:25:09.480363 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:09.483977 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4be362a7-6cbb-42f9-9dfc-02565fa2bcdc req-f41770b9-ce72-408e-a39b-41f51bfa1f8e service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2967649 May 12 15:25:09.579313 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'name': 'tempest-ServersTestFqdnHostnames-709355631-router', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.19'}], 'enable_snat': True}, 'gw_port_id': 'a5606f55-73cb-4764-be8a-a7dc3a19b0d3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:53Z', 'updated_at': '2022-05-12T15:25:03Z', 'revision_number': 4, 'project_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'gw_port': {'id': 'a5606f55-73cb-4764-be8a-a7dc3a19b0d3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:57:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1846, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:54Z', 'updated_at': '2022-05-12T15:25:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'cb75c658-7e4d-4d2f-a743-00f05fb7c2c8', 'name': '', 'network_id': 'd17b8c7a-f043-4c59-bfab-832deab11818', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'mac_address': 'fa:16:3e:a6:1a:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'device_owner': 'network:router_interface', 'standard_attr_id': 1847, 'fixed_ips': [{'subnet_id': '3176788e-e7ce-46a6-a3b3-044c40356055', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:25:00Z', 'updated_at': '2022-05-12T15:25:08Z', 'revision_number': 4, 'project_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'subnets': [{'id': '3176788e-e7ce-46a6-a3b3-044c40356055', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:09.583765 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f5acce1-140f-40e6-84df-9f40c394a60e None None] The sync data for ids ['c0ee1ba5-20b8-4cf8-88a4-413629d7d227'] in n-d-841483-1 is: [{'id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'name': 'tempest-ServersTestFqdnHostnames-709355631-router', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.19'}], 'enable_snat': True}, 'gw_port_id': 'a5606f55-73cb-4764-be8a-a7dc3a19b0d3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:53Z', 'updated_at': '2022-05-12T15:25:03Z', 'revision_number': 4, 'project_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'gw_port': {'id': 'a5606f55-73cb-4764-be8a-a7dc3a19b0d3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:57:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1846, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:54Z', 'updated_at': '2022-05-12T15:25:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'cb75c658-7e4d-4d2f-a743-00f05fb7c2c8', 'name': '', 'network_id': 'd17b8c7a-f043-4c59-bfab-832deab11818', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'mac_address': 'fa:16:3e:a6:1a:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'device_owner': 'network:router_interface', 'standard_attr_id': 1847, 'fixed_ips': [{'subnet_id': '3176788e-e7ce-46a6-a3b3-044c40356055', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:25:00Z', 'updated_at': '2022-05-12T15:25:08Z', 'revision_number': 4, 'project_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'subnets': [{'id': '3176788e-e7ce-46a6-a3b3-044c40356055', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:25:09.602353 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a35732e0-951c-4122-88bd-c354d9a15cfd req-c57d50a7-7323-47dd-a325-e44f45c81423 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1126807 May 12 15:25:09.655252 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Pushing event updated for resources: {'Subnet': ['ID=fe9703cc-c92d-49d5-a472-5d84a4499fa3,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:09.667544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Checking segment: {'id': 'ce9be9ba-77e9-4d69-90ae-2dc7b4342400', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': 'f7e46f81-02b8-4bcd-a6ce-ea0d95d06100'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:25:09.668275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Network hostable DHCP agents. Network: f7e46f81-02b8-4bcd-a6ce-ea0d95d06100, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:25:09.738321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Network f7e46f81-02b8-4bcd-a6ce-ea0d95d06100 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:25:09.756905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, f7e46f81-02b8-4bcd-a6ce-ea0d95d06100) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:25:09.762207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:09.763259 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:09.770368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a3a5b1e-86f9-43f0-ad55-574730901cf7 None None] Network f7e46f81-02b8-4bcd-a6ce-ea0d95d06100 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:25:09.773959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-7c2dfde2-5c45-414b-a597-e403d8f23ca8 admin admin] Deleting port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:25:09.774410 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c2dfde2-5c45-414b-a597-e403d8f23ca8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:09.953509 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:25:10.035481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7cceca62-1136-4be5-912a-060885fb5adc admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.6828141 May 12 15:25:10.088511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-7c2dfde2-5c45-414b-a597-e403d8f23ca8 admin admin] For port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cb75c658-7e4d-4d2f-a743-00f05fb7c2c8,segment=NetworkSegment(5485588e-9f93-46e8-b3b1-a219b499e8ce),segment_id=5485588e-9f93-46e8-b3b1-a219b499e8ce)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:10.088885 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c2dfde2-5c45-414b-a597-e403d8f23ca8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:10.248583 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8590de4f-fe9e-4d08-9814-6b4050681998 req-c38ad67d-8035-4849-9461-d021fb110d5f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 210 time: 0.0523570 May 12 15:25:10.355568 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-7c2dfde2-5c45-414b-a597-e403d8f23ca8 admin admin] Calling delete_port for cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:25:10.443992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d0b2289-ec8a-4f6e-a4b7-577a80517c28 req-ec40d616-b585-4d66-b297-e6305a8c827e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:10.446557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d0b2289-ec8a-4f6e-a4b7-577a80517c28 req-ec40d616-b585-4d66-b297-e6305a8c827e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.4798667 May 12 15:25:10.532344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b560180d-dba0-477a-9acc-17e7f75f184b None None] Network f7e46f81-02b8-4bcd-a6ce-ea0d95d06100 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:25:10.798639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:10.799293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-87f5ee9c-8e44-412c-9d6e-7ad9bc18385a tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:10.806274 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-87f5ee9c-8e44-412c-9d6e-7ad9bc18385a tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.84 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 812 time: 0.5724323 May 12 15:25:10.829994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f', 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61', 'port_id': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f', 'mac_address': 'fa:16:3e:3d:84:57', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 559, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c90f4328-5e3e-4311-a3b6-84cff19a6919', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:25:10.845176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Request body: {'port': {'device_id': '9748d189-ba6b-4829-b15d-3781082b5a02', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'admin_state_up': True, 'tenant_id': '011dcf6c7b624a28bb2d8ed8db38754f'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:10.900554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d0b2289-ec8a-4f6e-a4b7-577a80517c28 req-a5a4ee01-0b52-497e-b63c-a9a19b271f4a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4398155 May 12 15:25:11.042239 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:11.096862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:11.115491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:11.122530 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:11.201526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d4f9886d-fb34-4a11-9462-3343e8a12db0 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:25:11.204059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39948) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:11.222038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:11.243685 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-66979246-network', 'tenant_id': 'e26ee81143ac497e9077f54cf06751f6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:11.256737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:25:11.269859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:11.298787 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:11.302362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Made reservation on behalf of 011dcf6c7b624a28bb2d8ed8db38754f for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:25:11.309077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:11.322023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Usage tracker for resource:network and tenant:e26ee81143ac497e9077f54cf06751f6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:11.352820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:25:11.355245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:11.374291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:11.406017 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c2dfde2-5c45-414b-a597-e403d8f23ca8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:11.518336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:11.584053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c2dfde2-5c45-414b-a597-e403d8f23ca8 admin admin] Pushing event deleted for resources: {'Port': ['ID=cb75c658-7e4d-4d2f-a743-00f05fb7c2c8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:11.630274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No active binding found for port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 {{(pid=88153) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:224}} May 12 15:25:11.630786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:284}} May 12 15:25:11.661947 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-295b8b64-ed73-4453-aea0-b5644756e9db req-95b85ec4-294a-4258-8335-613aa8901851 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 210 time: 0.0810583 May 12 15:25:11.762198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Port cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 not found, will not notify nova. {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:294}} May 12 15:25:11.823328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Made reservation on behalf of e26ee81143ac497e9077f54cf06751f6 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:25:11.826876 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:11.861752 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:11.897240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Allocated IP 172.20.0.9 (aa894a26-e7a0-42ea-b7f1-9a9c136eacd6/0ff5192a-946b-4444-900a-788b8ddc74b6/4ec57409-cad0-41cc-88d2-9dde7b41a0fe) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:25:11.926732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:11.940376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Usage tracker for resource:security_group_rule and tenant:e26ee81143ac497e9077f54cf06751f6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:11.946911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:11.976078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74acdc81-a7bd-452b-b49a-812f7bea58d0 req-73ea2793-8890-4d69-96fa-234585469540 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:11.977820 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-74acdc81-a7bd-452b-b49a-812f7bea58d0 req-73ea2793-8890-4d69-96fa-234585469540 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e5a10df576841e2a4752a9d47fb790a&device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 1096 time: 0.7777398 May 12 15:25:11.978857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:12.052217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d4f9886d-fb34-4a11-9462-3343e8a12db0, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d4f9886d-fb34-4a11-9462-3343e8a12db0,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:12.104395 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'd4f9886d-fb34-4a11-9462-3343e8a12db0', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'port_id': 'd4f9886d-fb34-4a11-9462-3343e8a12db0', 'mac_address': 'fa:16:3e:e5:fa:56', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 583, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:25:12.217418 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:12.251456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d4f9886d-fb34-4a11-9462-3343e8a12db0 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:12.276562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d4f9886d-fb34-4a11-9462-3343e8a12db0, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d4f9886d-fb34-4a11-9462-3343e8a12db0,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:12.283343 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:12.390089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74acdc81-a7bd-452b-b49a-812f7bea58d0 req-ad18a8ef-cbe5-4e1d-8a2d-7788c1a6f436 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:12.392332 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-74acdc81-a7bd-452b-b49a-812f7bea58d0 req-ad18a8ef-cbe5-4e1d-8a2d-7788c1a6f436 service neutron] 10.222.0.84 "GET /v2.0/networks?id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61 HTTP/1.1" status: 200 len: 914 time: 0.3818746 May 12 15:25:12.498800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d4f9886d-fb34-4a11-9462-3343e8a12db0,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:12.503699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['d4f9886d-fb34-4a11-9462-3343e8a12db0'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:25:12.508213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0acc2d12-1f34-47d5-844d-7706b9b2d6f5 req-88a4eaef-ee1b-44ed-bc0a-0401f468c1a9 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:12.520101 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0acc2d12-1f34-47d5-844d-7706b9b2d6f5 req-88a4eaef-ee1b-44ed-bc0a-0401f468c1a9 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 944 time: 1.5972612 May 12 15:25:12.612690 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c2dfde2-5c45-414b-a597-e403d8f23ca8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:12.636591 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0acc2d12-1f34-47d5-844d-7706b9b2d6f5 req-de745840-4ba2-43e2-96cf-121ab29a8a93 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1145151 May 12 15:25:12.722618 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:12.742605 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:12.757137 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3398f33e-d3b9-42e1-83f4-d28ccc60c1cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:12.825702 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-74acdc81-a7bd-452b-b49a-812f7bea58d0 req-c35d22f4-c152-481b-bcc9-bf82346548e2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f HTTP/1.1" status: 200 len: 217 time: 0.4224973 May 12 15:25:12.827707 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:12.850088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f98170-c85e-4109-af34-9d1779ba4339 req-557605fe-e3de-4c11-9824-4ca3c2e59c38 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:12.870927 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81f98170-c85e-4109-af34-9d1779ba4339 req-557605fe-e3de-4c11-9824-4ca3c2e59c38 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 945 time: 0.7078605 May 12 15:25:12.911762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74acdc81-a7bd-452b-b49a-812f7bea58d0 req-2c2e7486-a9f4-406f-afb6-70ccb6b3f8f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:12.913508 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-74acdc81-a7bd-452b-b49a-812f7bea58d0 req-2c2e7486-a9f4-406f-afb6-70ccb6b3f8f0 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c90f4328-5e3e-4311-a3b6-84cff19a6919 HTTP/1.1" status: 200 len: 853 time: 0.0677738 May 12 15:25:12.976142 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-74acdc81-a7bd-452b-b49a-812f7bea58d0 req-4481738c-a66f-44d1-8965-f411ec60db4f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0532732 May 12 15:25:12.987519 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:12.989430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 572} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:25:13.028473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81f98170-c85e-4109-af34-9d1779ba4339 req-bb4ba10d-3aae-44d1-a564-dd9415e7507e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1563420 May 12 15:25:13.117430 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:13.150813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dc40e143-20d8-4863-a350-73ca69960d28,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:13.170929 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:13.171308 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Added segment 1a838211-5d88-4a84-8328-b9db47519b68 of type vlan for network e6b3cebb-d75c-448f-8af1-b9526e41edd0 May 12 15:25:13.200751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:25:13.209679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:25:13.220611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:25:13.247252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Pushing event updated for resources: {'Port': ['ID=4ec57409-cad0-41cc-88d2-9dde7b41a0fe,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:13.313918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:13.348720 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-74acdc81-a7bd-452b-b49a-812f7bea58d0 req-0784d2e3-7199-4f06-825e-0113d3ddd75f service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3537042 May 12 15:25:13.358451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:13.359096 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:13.360607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdefdb0a-3265-4683-b604-b029ea553009 req-a20ba30d-b948-4da6-a3b1-790ce5e870a1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:13.362398 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdefdb0a-3265-4683-b604-b029ea553009 req-a20ba30d-b948-4da6-a3b1-790ce5e870a1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 931 time: 0.4139998 May 12 15:25:13.494424 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:13.495378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:13.496528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:13.612187 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-f7574b0c-1043-4187-9983-0292150af3da tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.7708700 May 12 15:25:13.619642 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 880 time: 2.4142470 May 12 15:25:13.624688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40016) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:13.628381 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdefdb0a-3265-4683-b604-b029ea553009 req-cad49af8-9fd7-4863-87e4-0110190fa935 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2437806 May 12 15:25:13.664049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Request body: {'port': {'device_id': '9748d189-ba6b-4829-b15d-3781082b5a02', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:13.678572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7c2dfde2-5c45-414b-a597-e403d8f23ca8 admin admin] Router c0ee1ba5-20b8-4cf8-88a4-413629d7d227 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:25:13.798111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Request body: {'subnet': {'network_id': 'e6b3cebb-d75c-448f-8af1-b9526e41edd0', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-66979246-subnet', 'tenant_id': 'e26ee81143ac497e9077f54cf06751f6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:13.860508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5672015f-8646-42c8-b0b9-9bc6861bd5ec admin admin] Pushing event updated for resources: {'Network': ['ID=e6b3cebb-d75c-448f-8af1-b9526e41edd0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:13.871608 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network e6b3cebb-d75c-448f-8af1-b9526e41edd0 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:25:13.881818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:13.894230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Usage tracker for resource:subnet and tenant:e26ee81143ac497e9077f54cf06751f6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:13.901737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:13.908146 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-74acdc81-a7bd-452b-b49a-812f7bea58d0 req-03153a81-da03-4c52-b39d-9e8761756dce service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5393720 May 12 15:25:13.913396 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:13.915528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:13.980489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Made reservation on behalf of e26ee81143ac497e9077f54cf06751f6 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:25:13.983115 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:14.002714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:25:14.227261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:25:14.227959 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:14.280564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40028) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:14.413524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7c2dfde2-5c45-414b-a597-e403d8f23ca8 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:25:14.427529 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a22f9257-d456-4f18-bb5d-d805865063df None None] Sync routers for ids ['c0ee1ba5-20b8-4cf8-88a4-413629d7d227'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:25:14.480137 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7c2dfde2-5c45-414b-a597-e403d8f23ca8 admin admin] 10.222.0.82 "PUT /v2.0/routers/c0ee1ba5-20b8-4cf8-88a4-413629d7d227/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.5474045 May 12 15:25:14.486604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40040) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:14.495044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a22f9257-d456-4f18-bb5d-d805865063df None None] Routers {'c0ee1ba5-20b8-4cf8-88a4-413629d7d227'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:25:14.498310 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a22f9257-d456-4f18-bb5d-d805865063df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:24:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c0ee1ba5-20b8-4cf8-88a4-413629d7d227'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:14.562152 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e8f3288-2a8e-42ff-b18c-15216be67883 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:14.595614 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:14.621272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0e8f3288-2a8e-42ff-b18c-15216be67883 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:14.634945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ee48352-c622-4f60-8c62-88a74a7c3538 req-3be81347-a9b0-4d87-966e-62561078c89a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:14.637550 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4ee48352-c622-4f60-8c62-88a74a7c3538 req-3be81347-a9b0-4d87-966e-62561078c89a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 945 time: 0.7955499 May 12 15:25:14.654277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0e8f3288-2a8e-42ff-b18c-15216be67883 admin admin] Usage tracker for resource:security_group_rule and tenant:fec16329040746d6b7dd64aa32aff79f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:14.663099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0e8f3288-2a8e-42ff-b18c-15216be67883 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:14.680041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0e8f3288-2a8e-42ff-b18c-15216be67883 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:14.756209 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-a22f9257-d456-4f18-bb5d-d805865063df None None] Set router c0ee1ba5-20b8-4cf8-88a4-413629d7d227 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:25:14.758201 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:14.802851 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4ee48352-c622-4f60-8c62-88a74a7c3538 req-72e525f9-ae23-4fb6-9f24-86cd485398e7 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1533632 May 12 15:25:14.816882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47cb2190-22c0-4cbf-8ceb-d60a5cba137d req-af82964a-ac25-40e6-b0db-123910b6fefa tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:14.816882 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47cb2190-22c0-4cbf-8ceb-d60a5cba137d req-af82964a-ac25-40e6-b0db-123910b6fefa tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 945 time: 0.5150042 May 12 15:25:14.863196 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:14.922847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e3189ff-eb13-4d53-bb96-0f93c430e9f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:14.967754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4ec57409-cad0-41cc-88d2-9dde7b41a0fe {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:14.970555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:14.991980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:14.994553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Pushing event updated for resources: {'Subnet': ['ID=047b8e26-cb14-4f10-bb0f-6c8308c0d636,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:15.039025 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:15.041151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Transition to ACTIVE for port object 4ec57409-cad0-41cc-88d2-9dde7b41a0fe will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:25:15.050754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Checking segment: {'id': '1a838211-5d88-4a84-8328-b9db47519b68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': 'e6b3cebb-d75c-448f-8af1-b9526e41edd0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:25:15.051238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Network hostable DHCP agents. Network: e6b3cebb-d75c-448f-8af1-b9526e41edd0, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:25:15.062595 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:15.120399 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-baaf88ff-7334-4f3d-89a5-2bce61977ba5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:15.132252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:15.171563 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47cb2190-22c0-4cbf-8ceb-d60a5cba137d req-24d440c8-ef9e-41b8-9f00-a2f19f88930c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3389189 May 12 15:25:15.318150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-512a7e1b-7c4b-4649-80c9-3716b8ce3752 req-4254bab8-adb9-4781-9d5b-3cd9c4badac9 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:15.319633 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-512a7e1b-7c4b-4649-80c9-3716b8ce3752 req-4254bab8-adb9-4781-9d5b-3cd9c4badac9 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 943 time: 0.3423274 May 12 15:25:15.327380 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d4f9886d-fb34-4a11-9462-3343e8a12db0 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:25:15.344005 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e8f3288-2a8e-42ff-b18c-15216be67883 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:15.359171 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:15.420876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-512a7e1b-7c4b-4649-80c9-3716b8ce3752 req-32f93608-f982-4e27-a6c9-a26557efa5a7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0888178 May 12 15:25:15.426401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] Deleting port a5606f55-73cb-4764-be8a-a7dc3a19b0d3 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:25:15.426967 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:15.450411 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e8f3288-2a8e-42ff-b18c-15216be67883 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:15.515330 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port d4f9886d-fb34-4a11-9462-3343e8a12db0 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:25:15.530172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a22f9257-d456-4f18-bb5d-d805865063df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'name': 'tempest-ServersTestFqdnHostnames-709355631-router', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.19'}], 'enable_snat': True}, 'gw_port_id': 'a5606f55-73cb-4764-be8a-a7dc3a19b0d3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:53Z', 'updated_at': '2022-05-12T15:25:11Z', 'revision_number': 5, 'project_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'gw_port': {'id': 'a5606f55-73cb-4764-be8a-a7dc3a19b0d3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:57:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1846, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:54Z', 'updated_at': '2022-05-12T15:25:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:15.550508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port d4f9886d-fb34-4a11-9462-3343e8a12db0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:25:15.550882 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:15.566072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Pushing event updated for resources: {'Port': ['ID=4ec57409-cad0-41cc-88d2-9dde7b41a0fe,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:15.568801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Network e6b3cebb-d75c-448f-8af1-b9526e41edd0 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:25:15.581785 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4eb4997f-f94b-4942-8b79-b98be29fd4e1'] response: {'server_uuid': '6e3189ff-eb13-4d53-bb96-0f93c430e9f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f', 'code': 200} May 12 15:25:15.593165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a22f9257-d456-4f18-bb5d-d805865063df None None] Checking router: c0ee1ba5-20b8-4cf8-88a4-413629d7d227 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:25:15.623506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a22f9257-d456-4f18-bb5d-d805865063df None None] Routers {'c0ee1ba5-20b8-4cf8-88a4-413629d7d227'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:25:15.624137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a22f9257-d456-4f18-bb5d-d805865063df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:25:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c0ee1ba5-20b8-4cf8-88a4-413629d7d227'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:15.625719 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0e8f3288-2a8e-42ff-b18c-15216be67883 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=fec16329040746d6b7dd64aa32aff79f&name=default HTTP/1.1" status: 200 len: 2983 time: 1.3424926 May 12 15:25:15.650508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40052) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:15.725859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e8f3288-2a8e-42ff-b18c-15216be67883 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ed06ee9-69d3-4b94-a9da-4736814ad612,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:15.743236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, e6b3cebb-d75c-448f-8af1-b9526e41edd0) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:25:15.769657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:15.770546 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:15.799786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] For port a5606f55-73cb-4764-be8a-a7dc3a19b0d3, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a5606f55-73cb-4764-be8a-a7dc3a19b0d3,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:15.800397 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:15.864050 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-109652e8-e7bd-4ce1-88b6-458a05ab8a57 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 2.2101524 May 12 15:25:15.870454 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-a22f9257-d456-4f18-bb5d-d805865063df None None] Set router c0ee1ba5-20b8-4cf8-88a4-413629d7d227 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:25:15.875507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Attempting to bind port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:25:15.876099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Attempting to bind port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:25:15.881613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Attempting to bind port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:15.888778 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f6727eb-ee68-4648-baf9-a2e15541b782 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:15.894209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:25:15.897838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Attempting to bind port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:15.926599 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 25, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:25:15.933752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Checking segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:25:15.934555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Bound using segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:25:15.937168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Bound port: 4ec57409-cad0-41cc-88d2-9dde7b41a0fe, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:25:15.938919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:15.977322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] Calling delete_port for a5606f55-73cb-4764-be8a-a7dc3a19b0d3 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:25:16.074531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a22f9257-d456-4f18-bb5d-d805865063df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'name': 'tempest-ServersTestFqdnHostnames-709355631-router', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:53Z', 'updated_at': '2022-05-12T15:25:15Z', 'revision_number': 6, 'project_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:16.076188 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f6727eb-ee68-4648-baf9-a2e15541b782 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:16.077915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f1c01c9-ac0c-4f66-a5d0-b5e824384108 None None] Network e6b3cebb-d75c-448f-8af1-b9526e41edd0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:25:16.317813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] For port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:25:16.331979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] For port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4ec57409-cad0-41cc-88d2-9dde7b41a0fe,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:25:16.337370 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:16.364804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b5c13d-d41b-4780-8f0a-65ac17478f59 req-2ba0bc03-643e-401d-8f5a-f8b50cf9fb57 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:16.366531 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61b5c13d-d41b-4780-8f0a-65ac17478f59 req-2ba0bc03-643e-401d-8f5a-f8b50cf9fb57 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 945 time: 0.2025771 May 12 15:25:16.425292 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f6727eb-ee68-4648-baf9-a2e15541b782 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:16.470562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:16.471163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:16.472505 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] 10.222.0.84 "PUT /v2.0/ports/4ec57409-cad0-41cc-88d2-9dde7b41a0fe HTTP/1.1" status: 200 len: 1091 time: 2.8126905 May 12 15:25:16.475191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9748d189-ba6b-4829-b15d-3781082b5a02', 'tag': '4ec57409-cad0-41cc-88d2-9dde7b41a0fe'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:16.485074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f6727eb-ee68-4648-baf9-a2e15541b782 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ed06ee9-69d3-4b94-a9da-4736814ad612,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:16.485964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a22f9257-d456-4f18-bb5d-d805865063df None None] The sync data for ids ['c0ee1ba5-20b8-4cf8-88a4-413629d7d227'] in n-d-841483-1 is: [{'id': 'c0ee1ba5-20b8-4cf8-88a4-413629d7d227', 'name': 'tempest-ServersTestFqdnHostnames-709355631-router', 'tenant_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:53Z', 'updated_at': '2022-05-12T15:25:15Z', 'revision_number': 6, 'project_id': '5ef041b6d09e485b8dc7bd49d87599d2', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:25:16.492186 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:16.499238 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f6727eb-ee68-4648-baf9-a2e15541b782 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:16.502895 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4f6727eb-ee68-4648-baf9-a2e15541b782 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9ed06ee9-69d3-4b94-a9da-4736814ad612 HTTP/1.1" status: 204 len: 168 time: 0.8485243 May 12 15:25:16.514351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42e5876-4ed0-47bc-92fa-479c9e06cd6a service neutron] Pushing event updated for resources: {'Port': ['ID=4ec57409-cad0-41cc-88d2-9dde7b41a0fe,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:16.558813 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:16.568339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61b5c13d-d41b-4780-8f0a-65ac17478f59 req-44ecb843-53ae-42d0-84a6-d2505b1eeb77 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1940522 May 12 15:25:16.586094 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:16.693087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c3d37eb1-7716-42f2-b2e6-bc553b7c3d36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:16.698220 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-c3d37eb1-7716-42f2-b2e6-bc553b7c3d36 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 1094 time: 0.1430640 May 12 15:25:16.808370 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:16.863715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ac15299-1297-4c72-8a1c-82931cf070c0 None None] Network e6b3cebb-d75c-448f-8af1-b9526e41edd0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:25:16.873108 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-be1b35ce-39ee-4059-9d14-e7bc0191a8a8 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4ec57409-cad0-41cc-88d2-9dde7b41a0fe HTTP/1.1" status: 200 len: 217 time: 0.1576018 May 12 15:25:16.896668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] Pushing event deleted for resources: {'Port': ['ID=a5606f55-73cb-4764-be8a-a7dc3a19b0d3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:17.117526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac9f25b2-27ac-4247-ad5d-de751ae8ce44 req-efa47ebb-d668-42d9-93bc-3b0952372f50 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:17.128631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-b4960b22-7be2-4288-b4fe-59ef81363a45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:17.128631 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-b4960b22-7be2-4288-b4fe-59ef81363a45 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.2507794 May 12 15:25:17.129301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac9f25b2-27ac-4247-ad5d-de751ae8ce44 req-efa47ebb-d668-42d9-93bc-3b0952372f50 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.7115381 May 12 15:25:17.216712 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-9835d954-0456-49c2-89ef-f48abc3899f4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0782015 May 12 15:25:17.249956 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d4f9886d-fb34-4a11-9462-3343e8a12db0, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d4f9886d-fb34-4a11-9462-3343e8a12db0,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:17.283022 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:17.324415 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:17.343536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40084) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:17.456361 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d4f9886d-fb34-4a11-9462-3343e8a12db0,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:17.468342 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-471d42ce-36e2-4f37-9fda-175bcfb5b5eb service neutron] 10.222.0.84 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2406561 May 12 15:25:17.506875 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:25:17.582558 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:25:17.584173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cb75c658-7e4d-4d2f-a743-00f05fb7c2c8 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:25:17.588415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3d46f981-e448-45e2-8221-e0c06f862ad5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd4f9886d-fb34-4a11-9462-3343e8a12db0'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:17.639056 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:17.688002 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bf5f9b9a-b129-4395-a1b7-a4fb55016106 req-bdf48906-5dca-4d91-aea8-d627a49c590c service neutron] 10.222.0.84 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2129018 May 12 15:25:17.761846 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac9f25b2-27ac-4247-ad5d-de751ae8ce44 req-e69034c5-68c3-4b3f-9dd2-780539cdb52e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6315448 May 12 15:25:17.763134 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c827d098-25a1-49fa-aeb2-b87fb1024afd admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:17.808214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c827d098-25a1-49fa-aeb2-b87fb1024afd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:17.813584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c827d098-25a1-49fa-aeb2-b87fb1024afd admin admin] Usage tracker for resource:security_group_rule and tenant:8467a32ab94f44a6af5d21f257e7394b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:17.819611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c827d098-25a1-49fa-aeb2-b87fb1024afd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:17.828732 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:17.833667 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:17.837837 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c827d098-25a1-49fa-aeb2-b87fb1024afd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:17.891766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-e6219ea1-c585-4c25-b4e3-7dddd063a2dd tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:17.893752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-e6219ea1-c585-4c25-b4e3-7dddd063a2dd tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/networks?id=f7e46f81-02b8-4bcd-a6ce-ea0d95d06100 HTTP/1.1" status: 200 len: 808 time: 0.7628620 May 12 15:25:17.984945 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:17.985946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router c0ee1ba5-20b8-4cf8-88a4-413629d7d227 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:25:18.002308 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-19938565-045d-4337-97f0-77badd302554 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/quotas/a6cd12a079ad4d6cab1eec444076547b HTTP/1.1" status: 200 len: 375 time: 0.0656259 May 12 15:25:18.099206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-a34c9384-33bf-40c1-9901-a35ae5159ed1 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=a6cd12a079ad4d6cab1eec444076547b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0886428 May 12 15:25:18.163854 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:18.167770 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-27bb567e-5495-46a9-91b3-75eb0a35b4e3 admin admin] 10.222.0.82 "DELETE /v2.0/routers/c0ee1ba5-20b8-4cf8-88a4-413629d7d227 HTTP/1.1" status: 204 len: 168 time: 3.6772237 May 12 15:25:18.168070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40094) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:18.304742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-2244dd6c-2a74-4b96-8bed-3f7d31ba49f4 admin admin] Deleting subnet 3176788e-e7ce-46a6-a3b3-044c40356055 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:25:18.305985 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c827d098-25a1-49fa-aeb2-b87fb1024afd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:18.307916 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2244dd6c-2a74-4b96-8bed-3f7d31ba49f4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:18.353890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18a72e5-e4b6-4436-af0e-e28fee5a3c29 req-b3dd5029-fef8-4539-aaf5-922fcc5882e8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:18.356803 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c18a72e5-e4b6-4436-af0e-e28fee5a3c29 req-b3dd5029-fef8-4539-aaf5-922fcc5882e8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 943 time: 0.4888322 May 12 15:25:18.357540 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c827d098-25a1-49fa-aeb2-b87fb1024afd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:18.400217 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2244dd6c-2a74-4b96-8bed-3f7d31ba49f4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:18.462781 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c18a72e5-e4b6-4436-af0e-e28fee5a3c29 req-2fa35e10-74be-4b49-8d83-10cf976c3b2d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0951042 May 12 15:25:18.469948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c827d098-25a1-49fa-aeb2-b87fb1024afd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a9848e45-e2ae-4e2d-8731-5e004046e8f7,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:18.479924 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c827d098-25a1-49fa-aeb2-b87fb1024afd admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8467a32ab94f44a6af5d21f257e7394b&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1286848 May 12 15:25:18.489781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40098) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:18.546622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2244dd6c-2a74-4b96-8bed-3f7d31ba49f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:18.597898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-a13b461f-535e-44e9-930f-93a5f2d3b427 service neutron] 10.222.0.82 "GET /v2.0/networks/f7e46f81-02b8-4bcd-a6ce-ea0d95d06100?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4686337 May 12 15:25:18.614399 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-665ac352-d941-4524-bd5c-fc469dc511b2'] response: {'server_uuid': '3d46f981-e448-45e2-8221-e0c06f862ad5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd4f9886d-fb34-4a11-9462-3343e8a12db0', 'code': 200} May 12 15:25:18.626252 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e7ee1908-3352-4a9d-b1f7-3f3b85d4e924'] response: {'name': 'network-changed', 'server_uuid': '9748d189-ba6b-4829-b15d-3781082b5a02', 'tag': '4ec57409-cad0-41cc-88d2-9dde7b41a0fe', 'status': 'completed', 'code': 200} May 12 15:25:18.671954 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2244dd6c-2a74-4b96-8bed-3f7d31ba49f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:18.726259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2244dd6c-2a74-4b96-8bed-3f7d31ba49f4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3176788e-e7ce-46a6-a3b3-044c40356055,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:18.732475 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2244dd6c-2a74-4b96-8bed-3f7d31ba49f4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:18.741252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb961787-ac02-4d35-9e2b-7ce9ff735d42 None None] Network d17b8c7a-f043-4c59-bfab-832deab11818 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:25:18.796448 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2244dd6c-2a74-4b96-8bed-3f7d31ba49f4 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/3176788e-e7ce-46a6-a3b3-044c40356055 HTTP/1.1" status: 204 len: 168 time: 0.6272795 May 12 15:25:18.799084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40104) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:18.826517 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-80b0214d-6857-4db9-94b1-b7b83ab49c38 service neutron] 10.222.0.82 "GET /v2.0/networks/f7e46f81-02b8-4bcd-a6ce-ea0d95d06100?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2268748 May 12 15:25:18.979891 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-783b8179-4bfa-457f-aaf0-fdd8f5597bc7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:19.074646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a5606f55-73cb-4764-be8a-a7dc3a19b0d3 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:25:19.081743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05ea7d7c-9030-4a00-8fbf-c6f14eef42db req-4a971f05-9448-44fd-9bb1-156785bfcd4d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:19.092623 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05ea7d7c-9030-4a00-8fbf-c6f14eef42db req-4a971f05-9448-44fd-9bb1-156785bfcd4d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.2614489 May 12 15:25:19.093231 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-783b8179-4bfa-457f-aaf0-fdd8f5597bc7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:19.176200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: a5606f55-73cb-4764-be8a-a7dc3a19b0d3 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:25:19.176519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a5606f55-73cb-4764-be8a-a7dc3a19b0d3 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:25:19.185152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c41208b-e544-4c61-be69-97e98f388881 None None] DHCP port deletion for d17b8c7a-f043-4c59-bfab-832deab11818 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:25:19.189763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1c41208b-e544-4c61-be69-97e98f388881 None None] Deleting port ccb803d6-3575-4208-82c6-8d8046f62b21 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:25:19.190239 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1c41208b-e544-4c61-be69-97e98f388881 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:19.242934 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05ea7d7c-9030-4a00-8fbf-c6f14eef42db req-feb1db6f-adc4-4728-8470-39f48114d680 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1524429 May 12 15:25:19.418748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5888f695-d841-407c-99c1-9f7755efb8bb req-5c5a3ad0-8a1e-4244-bd03-bebcc5ba114d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:19.422601 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5888f695-d841-407c-99c1-9f7755efb8bb req-5c5a3ad0-8a1e-4244-bd03-bebcc5ba114d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 1094 time: 0.7943916 May 12 15:25:19.444829 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:19.519842 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb7f12be-575b-4998-8940-dd391a6aa473 req-8269f17b-d188-49f5-9340-e39f0192fde3 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/ports?device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 210 time: 0.1350181 May 12 15:25:19.611600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f71b494a-00f9-47fb-96cc-8c62c1b5591a req-46be1407-1544-4b93-ac79-e89d6cb2242c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:19.613310 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c93cd40d-72b7-4a4e-afed-24af096c1fb6 req-81c91731-36bd-4819-b632-9c99c5f45f9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:19.614964 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c93cd40d-72b7-4a4e-afed-24af096c1fb6 req-81c91731-36bd-4819-b632-9c99c5f45f9b service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 1097 time: 0.8792901 May 12 15:25:19.615145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f71b494a-00f9-47fb-96cc-8c62c1b5591a req-46be1407-1544-4b93-ac79-e89d6cb2242c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.3665264 May 12 15:25:19.615658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1c41208b-e544-4c61-be69-97e98f388881 None None] For port ccb803d6-3575-4208-82c6-8d8046f62b21, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ccb803d6-3575-4208-82c6-8d8046f62b21,segment=NetworkSegment(5485588e-9f93-46e8-b3b1-a219b499e8ce),segment_id=5485588e-9f93-46e8-b3b1-a219b499e8ce)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:19.620976 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1c41208b-e544-4c61-be69-97e98f388881 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:19.630921 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-783b8179-4bfa-457f-aaf0-fdd8f5597bc7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:19.676302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Deleting port ccb803d6-3575-4208-82c6-8d8046f62b21 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:25:19.676705 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:19.724179 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-783b8179-4bfa-457f-aaf0-fdd8f5597bc7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9848e45-e2ae-4e2d-8731-5e004046e8f7,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:19.753686 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-783b8179-4bfa-457f-aaf0-fdd8f5597bc7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:19.762865 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-783b8179-4bfa-457f-aaf0-fdd8f5597bc7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a9848e45-e2ae-4e2d-8731-5e004046e8f7 HTTP/1.1" status: 204 len: 168 time: 1.2644010 May 12 15:25:19.859700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f71b494a-00f9-47fb-96cc-8c62c1b5591a req-b52a57b7-98c9-4c4c-bfaf-b46c6309e1ab tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2300258 May 12 15:25:19.885583 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c93cd40d-72b7-4a4e-afed-24af096c1fb6 req-a749513d-f1a4-48aa-acc1-defbf37cedd1 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2513859 May 12 15:25:19.934844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1c41208b-e544-4c61-be69-97e98f388881 None None] Calling delete_port for ccb803d6-3575-4208-82c6-8d8046f62b21 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:25:19.967993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5888f695-d841-407c-99c1-9f7755efb8bb req-f5868f9f-b2eb-4143-bade-854cb111b0c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:19.969730 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5888f695-d841-407c-99c1-9f7755efb8bb req-f5868f9f-b2eb-4143-bade-854cb111b0c3 service neutron] 10.222.0.84 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 913 time: 0.5168195 May 12 15:25:19.995235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4ec57409-cad0-41cc-88d2-9dde7b41a0fe details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:25:20.029822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f273f99b-1b44-40ef-bd29-3e039936eba1 req-fe6db8c8-7a65-47db-93f2-68fc32b8e62d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:20.032981 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f273f99b-1b44-40ef-bd29-3e039936eba1 req-fe6db8c8-7a65-47db-93f2-68fc32b8e62d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 943 time: 0.2158289 May 12 15:25:20.099598 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5888f695-d841-407c-99c1-9f7755efb8bb req-1cc34c9d-d930-434e-8dd7-a619a288e4fa service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4ec57409-cad0-41cc-88d2-9dde7b41a0fe HTTP/1.1" status: 200 len: 217 time: 0.1231587 May 12 15:25:20.157735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f273f99b-1b44-40ef-bd29-3e039936eba1 req-16c4505a-4f87-4e6e-b057-467a60f8b6ba tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1141520 May 12 15:25:20.264402 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1c41208b-e544-4c61-be69-97e98f388881 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:20.359974 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c41208b-e544-4c61-be69-97e98f388881 None None] No DVR routers for this DVR port ccb803d6-3575-4208-82c6-8d8046f62b21 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:25:20.363668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c41208b-e544-4c61-be69-97e98f388881 None None] Pushing event deleted for resources: {'Port': ['ID=ccb803d6-3575-4208-82c6-8d8046f62b21,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:20.428997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] For port ccb803d6-3575-4208-82c6-8d8046f62b21, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ccb803d6-3575-4208-82c6-8d8046f62b21,segment=NetworkSegment(5485588e-9f93-46e8-b3b1-a219b499e8ce),segment_id=5485588e-9f93-46e8-b3b1-a219b499e8ce)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:20.429645 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:20.500167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4ec57409-cad0-41cc-88d2-9dde7b41a0fe,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:20.545472 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '4ec57409-cad0-41cc-88d2-9dde7b41a0fe', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'port_id': '4ec57409-cad0-41cc-88d2-9dde7b41a0fe', 'mac_address': 'fa:16:3e:d6:d1:ef', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 573, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0ff5192a-946b-4444-900a-788b8ddc74b6', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:25:20.698408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Calling delete_port for ccb803d6-3575-4208-82c6-8d8046f62b21 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:25:20.777836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5888f695-d841-407c-99c1-9f7755efb8bb req-2c96df25-8c9c-478a-97f6-9a2c81166ebe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:20.779204 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5888f695-d841-407c-99c1-9f7755efb8bb req-2c96df25-8c9c-478a-97f6-9a2c81166ebe service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.6544266 May 12 15:25:20.844137 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:20.935860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4ec57409-cad0-41cc-88d2-9dde7b41a0fe {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:20.976102 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5888f695-d841-407c-99c1-9f7755efb8bb req-6de2892e-ad15-4a59-9e4a-7796e27bbebd service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1859152 May 12 15:25:21.023940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4ec57409-cad0-41cc-88d2-9dde7b41a0fe,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:21.040416 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:21.101051 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b24b7d44-4f1d-4e46-93f6-0cb02d340831 req-bb350e24-e95f-4ee7-9458-a6df05ffd9b0 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/ports?device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 210 time: 0.1754198 May 12 15:25:21.136044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d459ace2-2113-4d70-aab8-ab580c0ba066 req-8e099c96-2a98-421f-af9c-d2da5d4bfd90 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:21.138557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d459ace2-2113-4d70-aab8-ab580c0ba066 req-8e099c96-2a98-421f-af9c-d2da5d4bfd90 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.6182501 May 12 15:25:21.302488 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d459ace2-2113-4d70-aab8-ab580c0ba066 req-3f70da4c-a366-4911-be94-67d2f5c2482e tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1561301 May 12 15:25:21.361921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ccb803d6-3575-4208-82c6-8d8046f62b21 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:25:21.556100 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:25:21.559432 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:25:21.677909 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: ccb803d6-3575-4208-82c6-8d8046f62b21 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:25:21.678582 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ccb803d6-3575-4208-82c6-8d8046f62b21 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:25:21.680521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['4ec57409-cad0-41cc-88d2-9dde7b41a0fe'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:25:21.815546 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4ec57409-cad0-41cc-88d2-9dde7b41a0fe,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:21.967147 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5888f695-d841-407c-99c1-9f7755efb8bb req-81409b72-0d81-467a-835c-7481059fe110 service neutron] 10.222.0.84 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9730625 May 12 15:25:22.080428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04bde705-1ad4-4572-9133-f14af8d638c3 req-fa2dfac1-eb52-4867-809d-92e71017eb82 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:22.088639 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04bde705-1ad4-4572-9133-f14af8d638c3 req-fa2dfac1-eb52-4867-809d-92e71017eb82 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.5738068 May 12 15:25:22.092120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Deleting port ccb803d6-3575-4208-82c6-8d8046f62b21 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:25:22.092494 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:22.118303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-904f4f43-473c-4487-bcef-69462397bd3a req-40e90858-f0ad-439e-9fd0-d7bc84e1e87c tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:22.123070 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-904f4f43-473c-4487-bcef-69462397bd3a req-40e90858-f0ad-439e-9fd0-d7bc84e1e87c tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 944 time: 0.4706471 May 12 15:25:22.273934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] The port 'ccb803d6-3575-4208-82c6-8d8046f62b21' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:25:22.293460 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-904f4f43-473c-4487-bcef-69462397bd3a req-5eaaf00d-155d-441e-9205-1aa3573cff7e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1635189 May 12 15:25:22.298932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04bde705-1ad4-4572-9133-f14af8d638c3 req-c1ca5bed-5e58-448d-8798-e168c52409fc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1748259 May 12 15:25:22.363031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-8a61468a-047e-4f73-87a9-1bfc2024006f tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:22.363781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-8a61468a-047e-4f73-87a9-1bfc2024006f tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Synchronizing usage tracker for tenant:a6cd12a079ad4d6cab1eec444076547b on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:25:22.638660 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5888f695-d841-407c-99c1-9f7755efb8bb req-d3df248a-ca20-4e92-9db9-3eddba18d5de service neutron] 10.222.0.84 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6562219 May 12 15:25:22.647493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-8a61468a-047e-4f73-87a9-1bfc2024006f tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Unset dirty status for tenant:a6cd12a079ad4d6cab1eec444076547b on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:25:22.649003 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-8a61468a-047e-4f73-87a9-1bfc2024006f tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.84 "GET /v2.0/networks?id=f7e46f81-02b8-4bcd-a6ce-ea0d95d06100 HTTP/1.1" status: 200 len: 808 time: 1.0197973 May 12 15:25:22.687110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Request body: {'port': {'device_id': 'fd93ffe4-6418-4f8b-a86f-c14f441dc937', 'network_id': 'f7e46f81-02b8-4bcd-a6ce-ea0d95d06100', 'admin_state_up': True, 'tenant_id': 'a6cd12a079ad4d6cab1eec444076547b'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:22.714028 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:22.785119 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1bfaaca-ff41-4d02-9c57-e637f6a20592 req-31319788-21fd-4a61-8e16-9c3048aeb0a8 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/ports?device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 210 time: 0.0817950 May 12 15:25:22.854423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d17b8c7a-f043-4c59-bfab-832deab11818']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:22.894854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5485588e-9f93-46e8-b3b1-a219b499e8ce') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:22.897969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5485588e-9f93-46e8-b3b1-a219b499e8ce') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:22.934330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f4f5ef-565a-4ad9-9250-165f7e0f3ea2 req-547b6297-781b-413a-b0e4-46f08bed7051 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:22.936857 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e8f4f5ef-565a-4ad9-9250-165f7e0f3ea2 req-547b6297-781b-413a-b0e4-46f08bed7051 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1497803 May 12 15:25:22.978359 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:23.030003 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:23.051746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:23.062741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Releasing vlan 551 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:25:23.063282 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: timer() May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:25:23.079778 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:25:23.084546 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e8f4f5ef-565a-4ad9-9250-165f7e0f3ea2 req-6ca9f99a-699a-4e0d-ac75-2f2ffb421253 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1379499 May 12 15:25:23.093807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Usage tracker for resource:port and tenant:a6cd12a079ad4d6cab1eec444076547b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:23.142861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:23.165168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:23.196625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Made reservation on behalf of a6cd12a079ad4d6cab1eec444076547b for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:25:23.197427 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:23.227146 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:23.333975 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:23.469861 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] 10.222.0.82 "DELETE /v2.0/networks/d17b8c7a-f043-4c59-bfab-832deab11818 HTTP/1.1" status: 204 len: 168 time: 4.6615939 May 12 15:25:23.475361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91f3bc1a-4210-4b1d-8011-3e2277cb283d admin admin] Pushing event deleted for resources: {'Network': ['ID=d17b8c7a-f043-4c59-bfab-832deab11818,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:23.543857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aef40289-b456-4133-8b5f-50276e211dbe req-858cc339-b923-401b-b04c-ae682881a9ca tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:23.545564 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aef40289-b456-4133-8b5f-50276e211dbe req-858cc339-b923-401b-b04c-ae682881a9ca tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.2267966 May 12 15:25:23.555633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40194) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:23.589159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ccc4568d-a50f-44dc-b752-068da1bf7bb5 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Request body: {'floatingip': {'port_id': 'd4f9886d-fb34-4a11-9462-3343e8a12db0'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:23.810268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Allocated IP 172.20.0.12 (f7e46f81-02b8-4bcd-a6ce-ea0d95d06100/fe9703cc-c92d-49d5-a472-5d84a4499fa3/fc6625bc-4109-4dee-b76b-c8531108ac3d) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:25:23.952601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40214) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:23.960772 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccc4568d-a50f-44dc-b752-068da1bf7bb5 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:24.005257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4ec57409-cad0-41cc-88d2-9dde7b41a0fe up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:25:24.140243 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:24.147956 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:25:24.160175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:25:24.160772 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:24.182398 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:24.313094 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6634a05-86fb-4429-95c9-a2d910b5f94e req-3727cf23-dcd7-46b3-975f-b9c0158d3103 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:24.320734 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6634a05-86fb-4429-95c9-a2d910b5f94e req-3727cf23-dcd7-46b3-975f-b9c0158d3103 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.5290787 May 12 15:25:24.345961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-930f5573-9332-4dd2-9475-018d622d47e9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5ef041b6d09e485b8dc7bd49d87599d2&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2948694 May 12 15:25:24.352045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40220) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:24.509532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Network f7e46f81-02b8-4bcd-a6ce-ea0d95d06100 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:25:24.518912 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:24.523827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:25:24.536819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:25:24.549637 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6634a05-86fb-4429-95c9-a2d910b5f94e req-5975df96-e8c8-4c93-bb8f-df94bb12a0e3 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2279007 May 12 15:25:24.586371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Pushing event updated for resources: {'Port': ['ID=fc6625bc-4109-4dee-b76b-c8531108ac3d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:24.605373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9748d189-ba6b-4829-b15d-3781082b5a02', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4ec57409-cad0-41cc-88d2-9dde7b41a0fe'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:24.634623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4ec57409-cad0-41cc-88d2-9dde7b41a0fe,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:24.639652 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:24.724040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:24.724705 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:24.767107 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bbe735aa-fd3e-4037-89ef-e67a24ae9f3c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.0935500 May 12 15:25:24.788746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Request body: {'port': {'device_id': 'fd93ffe4-6418-4f8b-a86f-c14f441dc937', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:24.829226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4ec57409-cad0-41cc-88d2-9dde7b41a0fe,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:24.927715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-516a97c4-52c0-46b0-ab3f-e7b775ff36c9 req-065668be-71cf-4d17-8153-af1ced150331 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:24.936113 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-516a97c4-52c0-46b0-ab3f-e7b775ff36c9 req-065668be-71cf-4d17-8153-af1ced150331 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 944 time: 1.1571736 May 12 15:25:25.030252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:25.338756 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7ce6b05f-6249-4e59-a019-8c12a1bff8fa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:25.381127 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-516a97c4-52c0-46b0-ab3f-e7b775ff36c9 req-177142d9-ab3c-458a-ae47-b1bf096b7b78 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4439266 May 12 15:25:25.452371 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7ce6b05f-6249-4e59-a019-8c12a1bff8fa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:25.614874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-070a2695-f2bf-43aa-a6b1-18d3dbd2cbb5 req-4ca72d03-4e9a-4ae1-a2bc-e0366f30f870 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:25.628809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-070a2695-f2bf-43aa-a6b1-18d3dbd2cbb5 req-4ca72d03-4e9a-4ae1-a2bc-e0366f30f870 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/ports?device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 932 time: 0.7181532 May 12 15:25:25.641979 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-ccc4568d-a50f-44dc-b752-068da1bf7bb5 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:25:25.645525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fc6625bc-4109-4dee-b76b-c8531108ac3d {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:25.655252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:25.680944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Transition to ACTIVE for port object fc6625bc-4109-4dee-b76b-c8531108ac3d will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:25:25.691366 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:25.806654 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ce003fdd-588f-4fae-b073-caf65d9e5760'] response: {'server_uuid': '9748d189-ba6b-4829-b15d-3781082b5a02', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4ec57409-cad0-41cc-88d2-9dde7b41a0fe', 'code': 200} May 12 15:25:25.822022 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccc4568d-a50f-44dc-b752-068da1bf7bb5 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:25.923181 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccc4568d-a50f-44dc-b752-068da1bf7bb5 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:26.076888 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Pushing event updated for resources: {'Port': ['ID=fc6625bc-4109-4dee-b76b-c8531108ac3d,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:26.192633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Attempting to bind port fc6625bc-4109-4dee-b76b-c8531108ac3d on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:25:26.194126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Attempting to bind port fc6625bc-4109-4dee-b76b-c8531108ac3d by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'ce9be9ba-77e9-4d69-90ae-2dc7b4342400', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': 'f7e46f81-02b8-4bcd-a6ce-ea0d95d06100'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:25:26.194640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Attempting to bind port fc6625bc-4109-4dee-b76b-c8531108ac3d on network f7e46f81-02b8-4bcd-a6ce-ea0d95d06100 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:26.210378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Port fc6625bc-4109-4dee-b76b-c8531108ac3d on network f7e46f81-02b8-4bcd-a6ce-ea0d95d06100 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:25:26.210710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Attempting to bind port fc6625bc-4109-4dee-b76b-c8531108ac3d on network f7e46f81-02b8-4bcd-a6ce-ea0d95d06100 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:26.215654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b8aae9-d47c-4574-980d-2f1199130464 req-32d9cfdf-3eb6-4fe2-a288-ac34a0731fb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:26.217496 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-77b8aae9-d47c-4574-980d-2f1199130464 req-32d9cfdf-3eb6-4fe2-a288-ac34a0731fb7 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 1095 time: 0.2855291 May 12 15:25:26.240376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 25, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:25:26.240865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Checking segment: {'id': 'ce9be9ba-77e9-4d69-90ae-2dc7b4342400', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': 'f7e46f81-02b8-4bcd-a6ce-ea0d95d06100'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:25:26.241262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Bound using segment: {'id': 'ce9be9ba-77e9-4d69-90ae-2dc7b4342400', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': 'f7e46f81-02b8-4bcd-a6ce-ea0d95d06100'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:25:26.241737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Bound port: fc6625bc-4109-4dee-b76b-c8531108ac3d, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ce9be9ba-77e9-4d69-90ae-2dc7b4342400', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': 'f7e46f81-02b8-4bcd-a6ce-ea0d95d06100'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:25:26.242085 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:26.254795 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-070a2695-f2bf-43aa-a6b1-18d3dbd2cbb5 req-4dc9e0bc-d015-445d-ab63-1313c37abf81 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/security-groups?id=298d5ce2-0e39-4957-ba55-bb703769d021&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6248546 May 12 15:25:26.384848 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7ce6b05f-6249-4e59-a019-8c12a1bff8fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:26.597717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ce6b05f-6249-4e59-a019-8c12a1bff8fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=780798cc-34a7-4b5a-a144-0494fb1e03ee,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:26.623807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] For port fc6625bc-4109-4dee-b76b-c8531108ac3d, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:25:26.627360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] For port fc6625bc-4109-4dee-b76b-c8531108ac3d, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fc6625bc-4109-4dee-b76b-c8531108ac3d,segment=NetworkSegment(ce9be9ba-77e9-4d69-90ae-2dc7b4342400),segment_id=ce9be9ba-77e9-4d69-90ae-2dc7b4342400)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:25:26.661072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-422419ea-ae1d-4537-a46e-71955ceeaef8 req-964e9422-6330-4fc2-89dd-e7affe88bfd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:26.662887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-422419ea-ae1d-4537-a46e-71955ceeaef8 req-964e9422-6330-4fc2-89dd-e7affe88bfd1 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 1096 time: 0.6065040 May 12 15:25:26.678984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32ecacbf-24f7-4383-b5d6-952351589701 req-4547d302-f380-42bb-8378-89a1268bed3b tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:26.687805 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32ecacbf-24f7-4383-b5d6-952351589701 req-4547d302-f380-42bb-8378-89a1268bed3b tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.6329820 May 12 15:25:26.690050 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7ce6b05f-6249-4e59-a019-8c12a1bff8fa admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:26.693714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7ce6b05f-6249-4e59-a019-8c12a1bff8fa admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/780798cc-34a7-4b5a-a144-0494fb1e03ee HTTP/1.1" status: 204 len: 168 time: 2.3328984 May 12 15:25:26.717054 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:26.786800 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-ccc4568d-a50f-44dc-b752-068da1bf7bb5 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Floating IP 1e912ac0-4533-40c7-8964-36d5a7e48d0d associated. External IP: 172.25.8.224, port: d4f9886d-fb34-4a11-9462-3343e8a12db0. May 12 15:25:26.836143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:26.836824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:26.838622 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] 10.222.0.84 "PUT /v2.0/ports/fc6625bc-4109-4dee-b76b-c8531108ac3d HTTP/1.1" status: 200 len: 1092 time: 2.0571923 May 12 15:25:26.839450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd93ffe4-6418-4f8b-a86f-c14f441dc937', 'tag': 'fc6625bc-4109-4dee-b76b-c8531108ac3d'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:27.044410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bedcf3c5-a153-4aa9-86d6-e6d7b70a4ec8 service neutron] Pushing event updated for resources: {'Port': ['ID=fc6625bc-4109-4dee-b76b-c8531108ac3d,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:27.098329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b8aae9-d47c-4574-980d-2f1199130464 req-7b4e0136-eee0-4292-b157-58a6b10eb7be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:27.099673 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-77b8aae9-d47c-4574-980d-2f1199130464 req-7b4e0136-eee0-4292-b157-58a6b10eb7be service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.8604712 May 12 15:25:27.184698 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32ecacbf-24f7-4383-b5d6-952351589701 req-8c14b0fd-5516-4846-b0fb-a77cbad4d177 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4956415 May 12 15:25:27.237249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-422419ea-ae1d-4537-a46e-71955ceeaef8 req-60ed8eed-0f07-42d2-b335-acf3f89aa063 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5440805 May 12 15:25:27.269624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9b9e7c1-22b1-4c98-b560-7e80f0253089 req-49983701-b892-4264-8bcd-6e885afecb30 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:27.282200 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9b9e7c1-22b1-4c98-b560-7e80f0253089 req-49983701-b892-4264-8bcd-6e885afecb30 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.7650402 May 12 15:25:27.358658 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-77b8aae9-d47c-4574-980d-2f1199130464 req-3ee46b94-2f58-430f-8115-4446900bd4db service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26 HTTP/1.1" status: 200 len: 999 time: 0.2466183 May 12 15:25:27.374318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-86b811ad-77e7-4aca-a97c-a66df490c22d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:27.374318 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-86b811ad-77e7-4aca-a97c-a66df490c22d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=a6cd12a079ad4d6cab1eec444076547b&device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 1095 time: 0.4508135 May 12 15:25:27.408793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9b9e7c1-22b1-4c98-b560-7e80f0253089 req-76945ffa-9650-45ed-9057-27d8c742cdeb tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1252878 May 12 15:25:27.644002 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-95112686-f73f-4c02-92b7-5c6d38cb7fc8 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=fc6625bc-4109-4dee-b76b-c8531108ac3d HTTP/1.1" status: 200 len: 217 time: 0.1119497 May 12 15:25:27.882147 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-b20212f2-3ca9-42fe-86c5-9e242119113e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:27.883799 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-b20212f2-3ca9-42fe-86c5-9e242119113e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=fe9703cc-c92d-49d5-a472-5d84a4499fa3 HTTP/1.1" status: 200 len: 848 time: 0.1534870 May 12 15:25:27.943470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b8aae9-d47c-4574-980d-2f1199130464 req-49c5c05c-78a5-4f4b-83b3-594eaa595cca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:27.945199 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-77b8aae9-d47c-4574-980d-2f1199130464 req-49c5c05c-78a5-4f4b-83b3-594eaa595cca service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.3003325 May 12 15:25:28.111862 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-f3faa50c-98e2-4fc1-bfc7-83e3eabcb221 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=f7e46f81-02b8-4bcd-a6ce-ea0d95d06100&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2202356 May 12 15:25:28.194341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ccc4568d-a50f-44dc-b752-068da1bf7bb5 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:25:28.264695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19891d26-2209-4b31-87b3-1bb86eccb57b req-2ce57f98-cbd9-4225-961f-58ffabcb1653 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:28.282884 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19891d26-2209-4b31-87b3-1bb86eccb57b req-2ce57f98-cbd9-4225-961f-58ffabcb1653 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 945 time: 0.8508945 May 12 15:25:28.450969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b8aae9-d47c-4574-980d-2f1199130464 req-b7c399c5-51c4-4bb8-9d77-1b16a094c978 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:28.453540 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-77b8aae9-d47c-4574-980d-2f1199130464 req-b7c399c5-51c4-4bb8-9d77-1b16a094c978 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4810252 May 12 15:25:28.644338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40306) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:28.697967 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19891d26-2209-4b31-87b3-1bb86eccb57b req-bf799f39-764b-4a44-8c53-d38f921b9598 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4063621 May 12 15:25:28.710712 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-d7247334-1c8b-4c52-9b48-483c223ec1b0 service neutron] 10.222.0.84 "GET /v2.0/networks/f7e46f81-02b8-4bcd-a6ce-ea0d95d06100?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5869727 May 12 15:25:28.713142 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-77b8aae9-d47c-4574-980d-2f1199130464 req-8d796884-6e02-4615-bb04-960b8cdafb49 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2450185 May 12 15:25:28.715746 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9c1ebd0e-d55f-464f-a1f7-a1e9e68396c0'] response: {'name': 'network-changed', 'server_uuid': 'fd93ffe4-6418-4f8b-a86f-c14f441dc937', 'tag': 'fc6625bc-4109-4dee-b76b-c8531108ac3d', 'status': 'completed', 'code': 200} May 12 15:25:28.880629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Request body: {'network': {'name': 'tempest-ListServersNegativeTestJSON-17831334-network', 'tenant_id': '61d51b592d944a47ba438d18c03cb747'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:29.091728 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd160ce5-f459-4507-9ed6-99d61cd0f602 req-9738f399-dbf2-44d5-9e7b-49f864621886 service neutron] 10.222.0.84 "GET /v2.0/networks/f7e46f81-02b8-4bcd-a6ce-ea0d95d06100?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3698227 May 12 15:25:29.094360 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-77b8aae9-d47c-4574-980d-2f1199130464 req-570fa0be-40af-4a6a-996f-7255a9e2b019 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3119097 May 12 15:25:29.097205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:29.143175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Usage tracker for resource:network and tenant:61d51b592d944a47ba438d18c03cb747 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:29.199940 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:29.239066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:29.325847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ccc4568d-a50f-44dc-b752-068da1bf7bb5 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:25:29.332657 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccc4568d-a50f-44dc-b752-068da1bf7bb5 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:29.336331 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b245ec34-bae1-47eb-9664-0b94384cbd1a None None] Sync routers for ids ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:25:29.360695 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b245ec34-bae1-47eb-9664-0b94384cbd1a None None] Routers {'0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:25:29.361329 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b245ec34-bae1-47eb-9664-0b94384cbd1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:25:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:29.408865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e2b550-02e7-4a9b-99cf-58ea6177bd85 req-2ca264ed-d5aa-4e4a-8acf-53321ae6c648 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:29.410478 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d2e2b550-02e7-4a9b-99cf-58ea6177bd85 req-2ca264ed-d5aa-4e4a-8acf-53321ae6c648 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=a6cd12a079ad4d6cab1eec444076547b&device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 1095 time: 0.1880624 May 12 15:25:29.437732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Made reservation on behalf of 61d51b592d944a47ba438d18c03cb747 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:25:29.439937 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:29.495786 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:29.545900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:29.550148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Usage tracker for resource:security_group_rule and tenant:61d51b592d944a47ba438d18c03cb747 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:29.553602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:29.561617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:29.668068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ccc4568d-a50f-44dc-b752-068da1bf7bb5 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "PUT /v2.0/floatingips/1e912ac0-4533-40c7-8964-36d5a7e48d0d HTTP/1.1" status: 200 len: 992 time: 6.1104534 May 12 15:25:29.677545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3d46f981-e448-45e2-8221-e0c06f862ad5', 'tag': 'd4f9886d-fb34-4a11-9462-3343e8a12db0'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:29.700953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2be4d6f3-4339-4cff-85ac-c797ce4a2527 req-2a02932b-76e7-4baa-874f-a920d9d2745c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:29.710738 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2be4d6f3-4339-4cff-85ac-c797ce4a2527 req-2a02932b-76e7-4baa-874f-a920d9d2745c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/ports?device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 944 time: 0.6193130 May 12 15:25:29.773324 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-b245ec34-bae1-47eb-9664-0b94384cbd1a None None] Set router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:25:29.789513 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2be4d6f3-4339-4cff-85ac-c797ce4a2527 req-035316a9-3ad5-4df1-99d9-34e6033c208a tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/security-groups?id=298d5ce2-0e39-4957-ba55-bb703769d021&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0775678 May 12 15:25:29.821956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaaf1717-0293-47c2-b903-693b3c6c3211 req-746b1006-fa73-425b-8357-418016b7e610 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:29.830139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aaaf1717-0293-47c2-b903-693b3c6c3211 req-746b1006-fa73-425b-8357-418016b7e610 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.7341354 May 12 15:25:30.025711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e2b550-02e7-4a9b-99cf-58ea6177bd85 req-c4c7217b-1cf7-444e-9809-aff5bd73e0ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:30.027985 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d2e2b550-02e7-4a9b-99cf-58ea6177bd85 req-c4c7217b-1cf7-444e-9809-aff5bd73e0ca service neutron] 10.222.0.84 "GET /v2.0/networks?id=f7e46f81-02b8-4bcd-a6ce-ea0d95d06100 HTTP/1.1" status: 200 len: 909 time: 0.6107347 May 12 15:25:30.051239 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aaaf1717-0293-47c2-b903-693b3c6c3211 req-b4567c27-4858-44f5-963e-909ed47f57e6 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2118287 May 12 15:25:30.063158 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:30.076026 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:30.100375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 563} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:25:30.127285 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:30.127675 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Added segment 5d5228f0-c77a-4aaf-9047-f3d0bd244b1c of type vlan for network 7ae70819-776e-45f8-bf36-c5eb46788b03 May 12 15:25:30.185961 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d2e2b550-02e7-4a9b-99cf-58ea6177bd85 req-c931edfc-84d7-41f9-8cbe-8d815ab38183 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=fc6625bc-4109-4dee-b76b-c8531108ac3d HTTP/1.1" status: 200 len: 217 time: 0.1456103 May 12 15:25:30.188450 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:30.258727 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:30.263965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:30.266066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:30.325897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e2b550-02e7-4a9b-99cf-58ea6177bd85 req-2a4161f1-2afe-4b49-b8e2-0a332d4590c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:30.327482 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d2e2b550-02e7-4a9b-99cf-58ea6177bd85 req-2a4161f1-2afe-4b49-b8e2-0a332d4590c2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=fe9703cc-c92d-49d5-a472-5d84a4499fa3 HTTP/1.1" status: 200 len: 848 time: 0.1350389 May 12 15:25:30.401081 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d2e2b550-02e7-4a9b-99cf-58ea6177bd85 req-26fcefc9-aa07-4ca7-b25c-9ac7efdf8b08 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=f7e46f81-02b8-4bcd-a6ce-ea0d95d06100&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0652826 May 12 15:25:30.523737 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b245ec34-bae1-47eb-9664-0b94384cbd1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '1e912ac0-4533-40c7-8964-36d5a7e48d0d', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'floating_ip_address': '172.25.8.224', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'port_id': 'd4f9886d-fb34-4a11-9462-3343e8a12db0', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 1830, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'mac_address': 'fa:16:3e:e5:fa:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d46f981-e448-45e2-8221-e0c06f862ad5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:24:51Z', 'updated_at': '2022-05-12T15:25:25Z', 'revision_number': 1, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:45Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:30.548272 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b245ec34-bae1-47eb-9664-0b94384cbd1a None None] Checking router: 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:25:30.583159 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b245ec34-bae1-47eb-9664-0b94384cbd1a None None] Routers {'0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:25:30.584101 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b245ec34-bae1-47eb-9664-0b94384cbd1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:25:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:30.614714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17376624-9ead-4836-b04e-2a57fe200253,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:30.642986 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d2e2b550-02e7-4a9b-99cf-58ea6177bd85 req-03e3bd72-2d1a-42a6-98b3-46c07dd1f553 service neutron] 10.222.0.84 "GET /v2.0/networks/f7e46f81-02b8-4bcd-a6ce-ea0d95d06100?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2357943 May 12 15:25:30.675715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] Pushing event updated for resources: {'Network': ['ID=7ae70819-776e-45f8-bf36-c5eb46788b03,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:30.684763 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cab00cbe-81ea-43db-9482-0e7d61d9f4c4 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 2.0286350 May 12 15:25:30.689521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40324) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:30.691683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 7ae70819-776e-45f8-bf36-c5eb46788b03 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:25:30.699055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Request body: {'subnet': {'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03', 'cidr': '172.20.0.0/28', 'name': 'tempest-ListServersNegativeTestJSON-17831334-subnet', 'tenant_id': '61d51b592d944a47ba438d18c03cb747', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:30.708879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:30.720606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Usage tracker for resource:subnet and tenant:61d51b592d944a47ba438d18c03cb747 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:30.728010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:30.741684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:30.768681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-201b9072-cb9a-4097-8426-532180517467 req-b03b5b25-422d-4e16-b2c2-f42dfd3fa721 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:30.778907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-201b9072-cb9a-4097-8426-532180517467 req-b03b5b25-422d-4e16-b2c2-f42dfd3fa721 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.5393009 May 12 15:25:30.822624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Made reservation on behalf of 61d51b592d944a47ba438d18c03cb747 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:25:30.825985 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:30.986648 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d2e2b550-02e7-4a9b-99cf-58ea6177bd85 req-6b6eb0de-da72-4bde-abbf-7562d9f47f75 service neutron] 10.222.0.84 "GET /v2.0/networks/f7e46f81-02b8-4bcd-a6ce-ea0d95d06100?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3338943 May 12 15:25:30.991197 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-b245ec34-bae1-47eb-9664-0b94384cbd1a None None] Set router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:25:31.171409 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a77888-21e1-4031-b811-993d275972e7 req-978b0a2f-8011-46ad-8186-778a63d20e53 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:31.179318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3a77888-21e1-4031-b811-993d275972e7 req-978b0a2f-8011-46ad-8186-778a63d20e53 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.8228304 May 12 15:25:31.187120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40334) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:31.220069 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:31.438693 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-083175e3-2e9c-411b-98c6-c74aeb6e3571 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:31.444377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-201b9072-cb9a-4097-8426-532180517467 req-d7b4a26a-04cf-4def-a283-297a0a7304c2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6635246 May 12 15:25:31.496586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-083175e3-2e9c-411b-98c6-c74aeb6e3571 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:31.506050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-083175e3-2e9c-411b-98c6-c74aeb6e3571 admin admin] Usage tracker for resource:security_group_rule and tenant:2a76b17e72e94e52a844ea091e3f0525 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:31.507620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Checking segment: {'id': '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:25:31.508177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Network hostable DHCP agents. Network: 7ae70819-776e-45f8-bf36-c5eb46788b03, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:25:31.512295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-083175e3-2e9c-411b-98c6-c74aeb6e3571 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:31.522332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-083175e3-2e9c-411b-98c6-c74aeb6e3571 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:31.532461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3a77888-21e1-4031-b811-993d275972e7 req-555b53b1-e7c6-4bd3-a417-77e54f06a122 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3504488 May 12 15:25:31.537112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7cb1634d-8705-40fa-abd9-508349cb9ba7,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:31.587357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Network 7ae70819-776e-45f8-bf36-c5eb46788b03 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:25:31.610887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 7ae70819-776e-45f8-bf36-c5eb46788b03) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:25:31.618140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:31.618833 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:31.620708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b2b0ddf-6490-49c4-816f-8653dd14ddb7 None None] Network 7ae70819-776e-45f8-bf36-c5eb46788b03 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:25:31.660784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-516ce761-94a9-4cd4-a6cf-1772f302b3a4 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.9697027 May 12 15:25:31.662033 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b245ec34-bae1-47eb-9664-0b94384cbd1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '1e912ac0-4533-40c7-8964-36d5a7e48d0d', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'floating_ip_address': '172.25.8.224', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'port_id': 'd4f9886d-fb34-4a11-9462-3343e8a12db0', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 1830, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'mac_address': 'fa:16:3e:e5:fa:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d46f981-e448-45e2-8221-e0c06f862ad5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:24:51Z', 'updated_at': '2022-05-12T15:25:25Z', 'revision_number': 1, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:45Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:25:31.672071 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b245ec34-bae1-47eb-9664-0b94384cbd1a None None] The sync data for ids ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'] in n-d-841483-1 is: [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '1e912ac0-4533-40c7-8964-36d5a7e48d0d', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'floating_ip_address': '172.25.8.224', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'port_id': 'd4f9886d-fb34-4a11-9462-3343e8a12db0', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 1830, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'mac_address': 'fa:16:3e:e5:fa:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d46f981-e448-45e2-8221-e0c06f862ad5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:24:51Z', 'updated_at': '2022-05-12T15:25:25Z', 'revision_number': 1, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:45Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:25:31.785694 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-083175e3-2e9c-411b-98c6-c74aeb6e3571 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:31.797794 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-083175e3-2e9c-411b-98c6-c74aeb6e3571 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:31.860869 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b3e4a215-117f-473e-817c-89e2e83e55ed'] response: {'name': 'network-changed', 'server_uuid': '3d46f981-e448-45e2-8221-e0c06f862ad5', 'tag': 'd4f9886d-fb34-4a11-9462-3343e8a12db0', 'status': 'completed', 'code': 200} May 12 15:25:31.928178 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2041a34-147f-4645-b229-698dcfcb841d req-141534f4-0c0d-4807-8bcc-e36260db3178 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:31.940056 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2041a34-147f-4645-b229-698dcfcb841d req-141534f4-0c0d-4807-8bcc-e36260db3178 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 945 time: 0.2287602 May 12 15:25:31.961002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-083175e3-2e9c-411b-98c6-c74aeb6e3571 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33c4b3a2-6c2e-4308-a0d9-09fec02dbd0b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:31.970741 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-083175e3-2e9c-411b-98c6-c74aeb6e3571 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2a76b17e72e94e52a844ea091e3f0525&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7824297 May 12 15:25:31.972307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40346) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:32.101868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f11f4a56-ffe9-4b86-9639-441537459be9 req-817e2595-81fa-47c8-9932-6b418a9138bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:32.103718 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f11f4a56-ffe9-4b86-9639-441537459be9 req-817e2595-81fa-47c8-9932-6b418a9138bf service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=f4660a6351274a7796c2eb1e55a41ec9&device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 1097 time: 0.2239211 May 12 15:25:32.155817 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-210dd037-2871-466c-89cd-9ba1d9a534d6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:32.176507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0125db1d-76fe-4dbf-b502-a49a397215f1 None None] New status for floating IP 1e912ac0-4533-40c7-8964-36d5a7e48d0d: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:25:32.208193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2041a34-147f-4645-b229-698dcfcb841d req-92ab4f28-c03b-449f-8fd1-ae9de2328eef tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2672052 May 12 15:25:32.271050 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-210dd037-2871-466c-89cd-9ba1d9a534d6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:32.295557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e90e816e-011f-48d6-808d-115b25b3f51d req-d8800dcb-2b27-40a2-b15b-03a5ef64c974 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:32.299701 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e90e816e-011f-48d6-808d-115b25b3f51d req-d8800dcb-2b27-40a2-b15b-03a5ef64c974 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/ports?device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 944 time: 0.2935648 May 12 15:25:32.305506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fc6625bc-4109-4dee-b76b-c8531108ac3d details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:25:32.379115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f11f4a56-ffe9-4b86-9639-441537459be9 req-5c8207d6-98b7-411a-8572-fb712a3b4cb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:32.381240 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f11f4a56-ffe9-4b86-9639-441537459be9 req-5c8207d6-98b7-411a-8572-fb712a3b4cb7 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e1655f9a-2478-49d5-a6ca-4fec717d6816 HTTP/1.1" status: 200 len: 912 time: 0.2548027 May 12 15:25:32.392911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcb6f967-a0cb-49cf-b2fa-70dc0a6e5d50 None None] Network 7ae70819-776e-45f8-bf36-c5eb46788b03 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:25:32.423634 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e90e816e-011f-48d6-808d-115b25b3f51d req-87fb2f5e-e2e0-449f-8470-cc3545e5a800 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/security-groups?id=298d5ce2-0e39-4957-ba55-bb703769d021&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1178403 May 12 15:25:32.539255 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-210dd037-2871-466c-89cd-9ba1d9a534d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:32.587016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-210dd037-2871-466c-89cd-9ba1d9a534d6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:32.592958 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-210dd037-2871-466c-89cd-9ba1d9a534d6 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/33c4b3a2-6c2e-4308-a0d9-09fec02dbd0b HTTP/1.1" status: 204 len: 168 time: 0.6130993 May 12 15:25:32.594025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-210dd037-2871-466c-89cd-9ba1d9a534d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33c4b3a2-6c2e-4308-a0d9-09fec02dbd0b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:32.608782 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f11f4a56-ffe9-4b86-9639-441537459be9 req-bb75fbd3-7263-497c-b035-152d64af5e9b service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d4f9886d-fb34-4a11-9462-3343e8a12db0 HTTP/1.1" status: 200 len: 1000 time: 0.2171235 May 12 15:25:32.616299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port fc6625bc-4109-4dee-b76b-c8531108ac3d, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fc6625bc-4109-4dee-b76b-c8531108ac3d,segment=NetworkSegment(ce9be9ba-77e9-4d69-90ae-2dc7b4342400),segment_id=ce9be9ba-77e9-4d69-90ae-2dc7b4342400)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:32.641052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'fc6625bc-4109-4dee-b76b-c8531108ac3d', 'network_id': 'f7e46f81-02b8-4bcd-a6ce-ea0d95d06100', 'port_id': 'fc6625bc-4109-4dee-b76b-c8531108ac3d', 'mac_address': 'fa:16:3e:b3:69:88', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 580, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fe9703cc-c92d-49d5-a472-5d84a4499fa3', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:25:32.720551 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:32.752564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f11f4a56-ffe9-4b86-9639-441537459be9 req-f721bccc-1239-4aac-bf2b-de0a6b596943 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:32.754800 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f11f4a56-ffe9-4b86-9639-441537459be9 req-f721bccc-1239-4aac-bf2b-de0a6b596943 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=83787d82-d8a5-4f12-a025-f44dcf581189 HTTP/1.1" status: 200 len: 850 time: 0.1383128 May 12 15:25:32.873768 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:25:32.876128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f11f4a56-ffe9-4b86-9639-441537459be9 req-18813187-88cb-4292-8e73-c7d219471d8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:32.879100 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f11f4a56-ffe9-4b86-9639-441537459be9 req-18813187-88cb-4292-8e73-c7d219471d8d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e1655f9a-2478-49d5-a6ca-4fec717d6816&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1166928 May 12 15:25:32.951604 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:32.994369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fc6625bc-4109-4dee-b76b-c8531108ac3d {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:33.012959 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port fc6625bc-4109-4dee-b76b-c8531108ac3d, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fc6625bc-4109-4dee-b76b-c8531108ac3d,segment=NetworkSegment(ce9be9ba-77e9-4d69-90ae-2dc7b4342400),segment_id=ce9be9ba-77e9-4d69-90ae-2dc7b4342400)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:33.141969 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f11f4a56-ffe9-4b86-9639-441537459be9 req-5a524775-4de8-43ef-bbe3-f1750394a131 service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2367477 May 12 15:25:33.160090 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:33.241964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-6701c8dd-2cfb-498a-9430-e36d0f5256c6 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:33.242684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b9d1de11-eee3-473a-8967-40166f494e83 req-6701c8dd-2cfb-498a-9430-e36d0f5256c6 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Synchronizing usage tracker for tenant:61d51b592d944a47ba438d18c03cb747 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:25:33.288483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=fc6625bc-4109-4dee-b76b-c8531108ac3d,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:33.298634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cb7be95-7590-448e-bd5a-050cf57cde11 req-89e7ebad-2dc2-4e9a-9df1-5af45517213d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:33.308742 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6cb7be95-7590-448e-bd5a-050cf57cde11 req-89e7ebad-2dc2-4e9a-9df1-5af45517213d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.5394537 May 12 15:25:33.342460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40374) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:33.363604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b9d1de11-eee3-473a-8967-40166f494e83 req-6701c8dd-2cfb-498a-9430-e36d0f5256c6 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Unset dirty status for tenant:61d51b592d944a47ba438d18c03cb747 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:25:33.371332 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-6701c8dd-2cfb-498a-9430-e36d0f5256c6 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/networks?id=7ae70819-776e-45f8-bf36-c5eb46788b03 HTTP/1.1" status: 200 len: 816 time: 0.6418843 May 12 15:25:33.372894 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b845343-1ac3-4a69-977d-399fea3f12ca admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:33.404971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6b845343-1ac3-4a69-977d-399fea3f12ca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:33.412837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-166c8dd6-9fe4-4207-b5f6-7afa9745c555 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/quotas/61d51b592d944a47ba438d18c03cb747 HTTP/1.1" status: 200 len: 375 time: 0.0400879 May 12 15:25:33.413057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6b845343-1ac3-4a69-977d-399fea3f12ca admin admin] Usage tracker for resource:security_group_rule and tenant:4868c068d21a4cdbbbbb9b6603725105 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:33.418410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6b845343-1ac3-4a69-977d-399fea3f12ca admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:33.435217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6b845343-1ac3-4a69-977d-399fea3f12ca admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:33.444311 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f11f4a56-ffe9-4b86-9639-441537459be9 req-291c138f-4004-424f-9323-265610492660 service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2962508 May 12 15:25:33.467259 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6cb7be95-7590-448e-bd5a-050cf57cde11 req-934067fd-39b0-4bb2-b8f8-d0038095052c tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1575179 May 12 15:25:33.501006 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-6220cfcb-059a-4f17-984e-6c6360f46fa4 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=61d51b592d944a47ba438d18c03cb747&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0864418 May 12 15:25:33.555942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['fc6625bc-4109-4dee-b76b-c8531108ac3d'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:25:33.564582 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b845343-1ac3-4a69-977d-399fea3f12ca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:33.573263 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b845343-1ac3-4a69-977d-399fea3f12ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:33.617864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b845343-1ac3-4a69-977d-399fea3f12ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8c36ec74-ed23-45dd-bd97-de4839a2883a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:33.655545 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6b845343-1ac3-4a69-977d-399fea3f12ca admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4868c068d21a4cdbbbbb9b6603725105&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3112154 May 12 15:25:33.658175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40380) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:33.740483 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b28b76a7-bdb0-4176-8d62-279cc2c42af7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:33.925000 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-0e51716d-6c81-4224-9ef1-5784306eb8e9 service neutron] 10.222.0.82 "GET /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4228156 May 12 15:25:33.934604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b28b76a7-bdb0-4176-8d62-279cc2c42af7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:33.994173 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b28b76a7-bdb0-4176-8d62-279cc2c42af7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:34.013545 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b28b76a7-bdb0-4176-8d62-279cc2c42af7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:34.017152 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b28b76a7-bdb0-4176-8d62-279cc2c42af7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8c36ec74-ed23-45dd-bd97-de4839a2883a HTTP/1.1" status: 204 len: 168 time: 0.3552356 May 12 15:25:34.017152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b28b76a7-bdb0-4176-8d62-279cc2c42af7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c36ec74-ed23-45dd-bd97-de4839a2883a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:34.132005 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-b585d135-2744-4787-b0e0-bef3bcbf7a07 service neutron] 10.222.0.82 "GET /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2009606 May 12 15:25:34.149700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd9bb58e-1b1f-4fd3-a439-799002fcebde req-3cdc4af8-88da-4fee-8031-46e9185a743e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:34.156689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd9bb58e-1b1f-4fd3-a439-799002fcebde req-3cdc4af8-88da-4fee-8031-46e9185a743e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.2000456 May 12 15:25:34.238088 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd9bb58e-1b1f-4fd3-a439-799002fcebde req-3e196022-5ad1-44eb-a499-0f79f7ace9a2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0804088 May 12 15:25:34.549774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-577ee566-4447-4e95-94c1-85f52429f63b req-09f159b0-b749-4b4b-8f17-29cb5e5fbac8 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:34.552012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-577ee566-4447-4e95-94c1-85f52429f63b req-09f159b0-b749-4b4b-8f17-29cb5e5fbac8 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/ports?device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 945 time: 0.1802971 May 12 15:25:34.638319 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-577ee566-4447-4e95-94c1-85f52429f63b req-9673b338-295c-4f5e-a4f5-6cea2fe4a2f8 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/security-groups?id=298d5ce2-0e39-4957-ba55-bb703769d021&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780892 May 12 15:25:34.871814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3512eb4-c2a1-4dda-bf7b-8ff4f81e2a60 req-991cc603-f8fb-4498-a8ec-ef348454384d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:34.882605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3512eb4-c2a1-4dda-bf7b-8ff4f81e2a60 req-991cc603-f8fb-4498-a8ec-ef348454384d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 945 time: 0.2252686 May 12 15:25:34.950105 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3512eb4-c2a1-4dda-bf7b-8ff4f81e2a60 req-c9e40311-0656-4a5c-b354-781b106d44fb tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667055 May 12 15:25:35.104342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f13e9306-6138-4e4b-85b6-00febff9df86 req-87f1ecfa-9d98-42ff-8129-16df5b8113d4 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 210 time: 0.1109929 May 12 15:25:35.189726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4831d4a2-bfa0-45d3-8e11-69026f03f1f7 req-6ec4d253-7b79-4bd2-a596-1f186de2fde6 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:35.191469 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4831d4a2-bfa0-45d3-8e11-69026f03f1f7 req-6ec4d253-7b79-4bd2-a596-1f186de2fde6 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.1526992 May 12 15:25:35.264918 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4831d4a2-bfa0-45d3-8e11-69026f03f1f7 req-3413b082-5d1c-47b2-bbba-e412d9e8632f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0669215 May 12 15:25:35.506731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddfe3b19-1ad2-42fa-8718-8496a107d61a req-0511bbde-abdd-4696-906b-78c8d631f292 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:35.524655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ddfe3b19-1ad2-42fa-8718-8496a107d61a req-0511bbde-abdd-4696-906b-78c8d631f292 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1417224 May 12 15:25:35.620001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ddfe3b19-1ad2-42fa-8718-8496a107d61a req-fd4619ba-79ef-4b65-a183-d5733f874466 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0882154 May 12 15:25:36.098214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d214229-0949-45b7-8cab-8bba2d945da9 req-13c52fc4-9ca6-4b90-ae8f-0a943e6dbce9 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:36.109891 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d214229-0949-45b7-8cab-8bba2d945da9 req-13c52fc4-9ca6-4b90-ae8f-0a943e6dbce9 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/ports?device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 945 time: 0.1959581 May 12 15:25:36.116404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fc6625bc-4109-4dee-b76b-c8531108ac3d up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:25:36.169218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bc7b4b8-7245-42f5-8126-fa7892bccea4 req-e791a3e6-13db-48b0-82b2-f979d011ebac tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:36.181734 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5bc7b4b8-7245-42f5-8126-fa7892bccea4 req-e791a3e6-13db-48b0-82b2-f979d011ebac tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 945 time: 0.3396714 May 12 15:25:36.257926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port fc6625bc-4109-4dee-b76b-c8531108ac3d completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:25:36.271902 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port fc6625bc-4109-4dee-b76b-c8531108ac3d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:25:36.272445 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:36.294167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d214229-0949-45b7-8cab-8bba2d945da9 req-4b8bea87-d0b9-48b6-a436-31cee5a392dc tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/security-groups?id=298d5ce2-0e39-4957-ba55-bb703769d021&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1830428 May 12 15:25:36.354488 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5bc7b4b8-7245-42f5-8126-fa7892bccea4 req-9fb36e01-9b8f-4f27-866a-34f7b0d9ad05 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1693428 May 12 15:25:36.482243 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:36.518041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd93ffe4-6418-4f8b-a86f-c14f441dc937', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fc6625bc-4109-4dee-b76b-c8531108ac3d'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:36.529605 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port fc6625bc-4109-4dee-b76b-c8531108ac3d, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fc6625bc-4109-4dee-b76b-c8531108ac3d,segment=NetworkSegment(ce9be9ba-77e9-4d69-90ae-2dc7b4342400),segment_id=ce9be9ba-77e9-4d69-90ae-2dc7b4342400)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:36.533932 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:36.546647 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b32afeb-a996-4f56-90c2-1f712fc55c29 req-28a50b33-f651-434f-8f8b-eb658371e401 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 210 time: 0.0783327 May 12 15:25:36.603855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f3e210-864d-4706-b27b-c13afbdb7025 req-7cfce247-606b-4116-b73f-83f3fcba9b97 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:36.606421 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-98f3e210-864d-4706-b27b-c13afbdb7025 req-7cfce247-606b-4116-b73f-83f3fcba9b97 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.1035314 May 12 15:25:36.614027 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=fc6625bc-4109-4dee-b76b-c8531108ac3d,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:36.619030 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-80de63b6-14f7-4f6c-9a17-5ea571f3c251'] response: {'server_uuid': 'fd93ffe4-6418-4f8b-a86f-c14f441dc937', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fc6625bc-4109-4dee-b76b-c8531108ac3d', 'code': 200} May 12 15:25:36.656570 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-98f3e210-864d-4706-b27b-c13afbdb7025 req-33d26cf2-842a-45d3-a7a8-d82d1d07bcaa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0439365 May 12 15:25:36.841527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c151ac57-87de-4f56-a315-88cdcdaffb59 req-7a2e4436-59db-455a-a095-0c7491b1b455 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:36.843368 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c151ac57-87de-4f56-a315-88cdcdaffb59 req-7a2e4436-59db-455a-a095-0c7491b1b455 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.1105852 May 12 15:25:36.894111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c151ac57-87de-4f56-a315-88cdcdaffb59 req-f1957b08-1010-4786-9fdd-cdede2386ade tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446441 May 12 15:25:37.191275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea089523-92ed-4dd7-96f6-37a86848513e req-b89c2fd8-bcda-40b5-8a70-a0a5248b17bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:37.192729 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ea089523-92ed-4dd7-96f6-37a86848513e req-b89c2fd8-bcda-40b5-8a70-a0a5248b17bf service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 1097 time: 0.2302296 May 12 15:25:37.206762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-1b068c3b-dc51-4ce7-b666-ae356fcfd6d6 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:37.208144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-1b068c3b-dc51-4ce7-b666-ae356fcfd6d6 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.84 "GET /v2.0/networks?id=7ae70819-776e-45f8-bf36-c5eb46788b03 HTTP/1.1" status: 200 len: 816 time: 0.2140300 May 12 15:25:37.246398 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ea089523-92ed-4dd7-96f6-37a86848513e req-42988015-9b4b-4cc4-afbe-7bfb7e971f66 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=298d5ce2-0e39-4957-ba55-bb703769d021&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372655 May 12 15:25:37.251337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Request body: {'port': {'device_id': 'd270cb8f-b1c9-42ca-9c3e-d51f878d58ee', 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03', 'admin_state_up': True, 'tenant_id': '61d51b592d944a47ba438d18c03cb747'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:37.454606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:37.458886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Usage tracker for resource:port and tenant:61d51b592d944a47ba438d18c03cb747 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:37.462429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:37.477469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:37.519224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Made reservation on behalf of 61d51b592d944a47ba438d18c03cb747 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:25:37.523167 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:37.712485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e406a5b7-8423-436b-bf08-ebbcd31ea2ee req-1da7e266-ca91-4d9e-9a05-6b829916371b tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:37.714585 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e406a5b7-8423-436b-bf08-ebbcd31ea2ee req-1da7e266-ca91-4d9e-9a05-6b829916371b tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/ports?device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 946 time: 0.2550550 May 12 15:25:37.811124 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e406a5b7-8423-436b-bf08-ebbcd31ea2ee req-ef43b995-35a1-440a-a929-901feba9adb0 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/security-groups?id=298d5ce2-0e39-4957-ba55-bb703769d021&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0858419 May 12 15:25:37.839601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00a8c3d8-15e8-49a7-9a6b-27080c7aeb54 req-204eb5b9-167f-4def-8296-c7b7bace0f60 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:37.855434 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00a8c3d8-15e8-49a7-9a6b-27080c7aeb54 req-204eb5b9-167f-4def-8296-c7b7bace0f60 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 945 time: 0.3482966 May 12 15:25:37.882509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Allocated IP 172.20.0.3 (7ae70819-776e-45f8-bf36-c5eb46788b03/7cb1634d-8705-40fa-abd9-508349cb9ba7/82b1a321-6a8f-4285-8002-cdef4cd9cfdb) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:25:37.898408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2681775-34fd-46d3-adcf-ca2a83e0ae70 req-815fab46-39b8-4d28-a8d0-ab9e827bb007 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:37.900089 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2681775-34fd-46d3-adcf-ca2a83e0ae70 req-815fab46-39b8-4d28-a8d0-ab9e827bb007 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e5a10df576841e2a4752a9d47fb790a&device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 1097 time: 0.2209606 May 12 15:25:37.963389 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00a8c3d8-15e8-49a7-9a6b-27080c7aeb54 req-267e2841-6d3f-4965-992e-bb7252c9507c tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1065171 May 12 15:25:38.139431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2681775-34fd-46d3-adcf-ca2a83e0ae70 req-7665d3c1-efbe-4081-9ed0-737a6f654117 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:38.140822 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2681775-34fd-46d3-adcf-ca2a83e0ae70 req-7665d3c1-efbe-4081-9ed0-737a6f654117 service neutron] 10.222.0.84 "GET /v2.0/networks?id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61 HTTP/1.1" status: 200 len: 914 time: 0.1554840 May 12 15:25:38.169114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9460ba5-7139-4d85-a6e1-6cc0b977d624 req-598958ac-3d80-41d6-9ee7-03a1cd22add8 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 210 time: 0.0763345 May 12 15:25:38.334838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-83275b6c-520e-4d74-b1a5-d53a4c2c7c3a tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:38.336538 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-83275b6c-520e-4d74-b1a5-d53a4c2c7c3a tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.84 "GET /v2.0/networks?id=7ae70819-776e-45f8-bf36-c5eb46788b03 HTTP/1.1" status: 200 len: 816 time: 0.3721406 May 12 15:25:38.360860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aef0053-af29-4185-8634-20bab4acab8b req-9ed849ae-8cc4-4768-b6b5-5c0cf9c833db tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:38.368012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4aef0053-af29-4185-8634-20bab4acab8b req-9ed849ae-8cc4-4768-b6b5-5c0cf9c833db tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.2016418 May 12 15:25:38.408682 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:38.518105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Request body: {'port': {'device_id': '55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32', 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03', 'admin_state_up': True, 'tenant_id': '61d51b592d944a47ba438d18c03cb747'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:38.537763 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2681775-34fd-46d3-adcf-ca2a83e0ae70 req-2304134f-d71e-4a2c-aee5-16e9279919d0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f HTTP/1.1" status: 200 len: 217 time: 0.1226215 May 12 15:25:38.594001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-051b14de-bfbb-40a3-8e8c-d51292186f6a req-23bd6eaf-f615-4e61-a310-ce73d7a0e5d4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:38.594697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-051b14de-bfbb-40a3-8e8c-d51292186f6a req-23bd6eaf-f615-4e61-a310-ce73d7a0e5d4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Synchronizing usage tracker for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:25:38.601409 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:38.684672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.84', 55543) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:38.728120 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4aef0053-af29-4185-8634-20bab4acab8b req-bb91e8be-9116-44e9-89b3-467ad38be62a tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.3589733 May 12 15:25:38.827829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17eabc9-6cf1-4e8c-b078-7f3656639a50 req-976f40dc-1e1a-4fcd-8062-d67134765fb6 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:38.829336 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b17eabc9-6cf1-4e8c-b078-7f3656639a50 req-976f40dc-1e1a-4fcd-8062-d67134765fb6 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.3165324 May 12 15:25:38.835542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:38.858886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Usage tracker for resource:port and tenant:61d51b592d944a47ba438d18c03cb747 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:38.863399 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:38.873910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:38.908088 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b17eabc9-6cf1-4e8c-b078-7f3656639a50 req-81746778-f2cd-45cc-8ae7-e9c57ec01c5a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695221 May 12 15:25:38.910993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Made reservation on behalf of 61d51b592d944a47ba438d18c03cb747 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:25:38.917728 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:38.960865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-051b14de-bfbb-40a3-8e8c-d51292186f6a req-23bd6eaf-f615-4e61-a310-ce73d7a0e5d4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Unset dirty status for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:25:38.962120 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-051b14de-bfbb-40a3-8e8c-d51292186f6a req-23bd6eaf-f615-4e61-a310-ce73d7a0e5d4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.84 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 945 time: 0.5483859 May 12 15:25:38.975606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Network 7ae70819-776e-45f8-bf36-c5eb46788b03 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:25:38.990893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:25:39.025857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2681775-34fd-46d3-adcf-ca2a83e0ae70 req-31fb28ae-559f-4aa9-9741-11ffe6bb21a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:39.027787 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2681775-34fd-46d3-adcf-ca2a83e0ae70 req-31fb28ae-559f-4aa9-9741-11ffe6bb21a3 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c90f4328-5e3e-4311-a3b6-84cff19a6919 HTTP/1.1" status: 200 len: 853 time: 0.4288509 May 12 15:25:39.031126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:25:39.092561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Pushing event updated for resources: {'Port': ['ID=82b1a321-6a8f-4285-8002-cdef4cd9cfdb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:39.215236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Allocated IP 172.20.0.5 (7ae70819-776e-45f8-bf36-c5eb46788b03/7cb1634d-8705-40fa-abd9-508349cb9ba7/903a522b-68b1-4bb2-9050-a8d2c3377b04) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:25:39.237982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dd5a11f-63ff-4ad7-a438-1b57d8a893f8 req-97772dda-21f8-438d-a201-c9dd4457190b tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:39.239495 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8dd5a11f-63ff-4ad7-a438-1b57d8a893f8 req-97772dda-21f8-438d-a201-c9dd4457190b tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/ports?device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 946 time: 0.2293589 May 12 15:25:39.289069 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2681775-34fd-46d3-adcf-ca2a83e0ae70 req-59b62dfb-7a6a-4554-ba3f-6459d7a52609 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2048781 May 12 15:25:39.295380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:39.295980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:39.300473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:39.300806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:39.301136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:39.301484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:39.301617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f473f90-dc5c-47f9-9a4b-27fe4c4ac39a req-cadc07db-7479-4dfc-93a9-38761a1117db tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:39.301811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:39.302134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:39.302453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:39.302770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:39.302934 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f473f90-dc5c-47f9-9a4b-27fe4c4ac39a req-cadc07db-7479-4dfc-93a9-38761a1117db tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 945 time: 0.2209854 May 12 15:25:39.303086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:39.303399 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:39.303711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:39.304018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:39.373871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8dd5a11f-63ff-4ad7-a438-1b57d8a893f8 req-07d456cd-1d2d-402d-b39f-afd47278ba7c tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/security-groups?id=298d5ce2-0e39-4957-ba55-bb703769d021&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1144814 May 12 15:25:39.429094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-051b14de-bfbb-40a3-8e8c-d51292186f6a req-889de288-ff5a-4fed-8570-31cd667152a1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Deleting port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:25:39.429676 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-051b14de-bfbb-40a3-8e8c-d51292186f6a req-889de288-ff5a-4fed-8570-31cd667152a1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:39.462829 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f473f90-dc5c-47f9-9a4b-27fe4c4ac39a req-8778574d-68c3-4430-b659-fc1601a18321 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1412215 May 12 15:25:39.514078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-461d2c0a-40f1-4376-8da9-e8892981a62c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:39.515509 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-461d2c0a-40f1-4376-8da9-e8892981a62c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.84 "GET /v2.0/networks?id=7ae70819-776e-45f8-bf36-c5eb46788b03 HTTP/1.1" status: 200 len: 816 time: 0.8237135 May 12 15:25:39.523570 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a1c71e20-abd0-4362-b8f0-043531c725b7 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2762296 May 12 15:25:39.537285 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:39.598178 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-68e33e86-dff0-45b2-8048-9f9c1743c04a req-3b2d093d-bae1-4bf9-97e2-3cf1ba413d75 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 210 time: 0.0504620 May 12 15:25:39.601881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Request body: {'port': {'device_id': 'd270cb8f-b1c9-42ca-9c3e-d51f878d58ee', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:39.623057 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:39.650678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Request body: {'port': {'device_id': 'fb219e29-6ed8-4f1b-98dc-8002eaaece2e', 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03', 'admin_state_up': True, 'tenant_id': '61d51b592d944a47ba438d18c03cb747'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:39.701285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Network 7ae70819-776e-45f8-bf36-c5eb46788b03 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:25:39.704302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:25:39.706904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:25:39.756092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Pushing event updated for resources: {'Port': ['ID=903a522b-68b1-4bb2-9050-a8d2c3377b04,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:39.812445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:39.813121 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:39.888180 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e0e1968d-ab29-4881-85cc-5729473fdc4e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3738542 May 12 15:25:39.911554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Request body: {'port': {'device_id': '55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:39.997796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-051b14de-bfbb-40a3-8e8c-d51292186f6a req-889de288-ff5a-4fed-8570-31cd667152a1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] For port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4ec57409-cad0-41cc-88d2-9dde7b41a0fe,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:39.998345 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-051b14de-bfbb-40a3-8e8c-d51292186f6a req-889de288-ff5a-4fed-8570-31cd667152a1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:40.133981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:25:40.143871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-051b14de-bfbb-40a3-8e8c-d51292186f6a req-889de288-ff5a-4fed-8570-31cd667152a1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Calling delete_port for 4ec57409-cad0-41cc-88d2-9dde7b41a0fe owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:25:40.229282 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:40.359771 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:40.379154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:40.396646 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:40.397657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc279c3-d692-4877-9f16-ff0d427a92ce req-98e94953-692c-4e7e-b69d-f16b3ca3a2ad tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:40.405541 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1fc279c3-d692-4877-9f16-ff0d427a92ce req-98e94953-692c-4e7e-b69d-f16b3ca3a2ad tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.3419793 May 12 15:25:40.406948 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-051b14de-bfbb-40a3-8e8c-d51292186f6a req-889de288-ff5a-4fed-8570-31cd667152a1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:40.446889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:40.448087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e3189ff-eb13-4d53-bb96-0f93c430e9f5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:40.456856 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:40.498820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Usage tracker for resource:port and tenant:61d51b592d944a47ba438d18c03cb747 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:40.502051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:40.509021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:40.558394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f173c982-5720-432d-87f8-99ed5f447f71 req-24014773-25dc-4169-afdc-356e2e748221 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:40.564308 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f173c982-5720-432d-87f8-99ed5f447f71 req-24014773-25dc-4169-afdc-356e2e748221 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 946 time: 0.4395466 May 12 15:25:40.576689 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2681775-34fd-46d3-adcf-ca2a83e0ae70 req-b8b45a71-3958-434e-b02b-f157ff6f095b service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.2628403 May 12 15:25:40.584589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:40.634692 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1fc279c3-d692-4877-9f16-ff0d427a92ce req-463df059-d72a-4379-bcb5-d1ed12137daf tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2280915 May 12 15:25:40.644802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Made reservation on behalf of 61d51b592d944a47ba438d18c03cb747 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:25:40.660523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:40.671491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-889de288-ff5a-4fed-8570-31cd667152a1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Pushing event deleted for resources: {'Port': ['ID=4ec57409-cad0-41cc-88d2-9dde7b41a0fe,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:40.748495 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-cb6f98ab-e06d-4f5d-88eb-2f38605b6901'] response: {'server_uuid': '6e3189ff-eb13-4d53-bb96-0f93c430e9f5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f', 'code': 200} May 12 15:25:40.894318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-051b14de-bfbb-40a3-8e8c-d51292186f6a req-889de288-ff5a-4fed-8570-31cd667152a1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] No DVR routers for this DVR port 4ec57409-cad0-41cc-88d2-9dde7b41a0fe on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:25:40.908785 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-051b14de-bfbb-40a3-8e8c-d51292186f6a req-889de288-ff5a-4fed-8570-31cd667152a1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:40.920495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9748d189-ba6b-4829-b15d-3781082b5a02', 'name': 'network-vif-deleted', 'tag': '4ec57409-cad0-41cc-88d2-9dde7b41a0fe'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:40.975239 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-051b14de-bfbb-40a3-8e8c-d51292186f6a req-889de288-ff5a-4fed-8570-31cd667152a1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.84 "DELETE /v2.0/ports/4ec57409-cad0-41cc-88d2-9dde7b41a0fe HTTP/1.1" status: 204 len: 173 time: 1.9874530 May 12 15:25:41.101549 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f173c982-5720-432d-87f8-99ed5f447f71 req-41bb6706-e53f-43b2-a573-cd245d16b002 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5226057 May 12 15:25:41.118185 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2681775-34fd-46d3-adcf-ca2a83e0ae70 req-d314876a-eb71-47a2-928d-0ec496880719 service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4970753 May 12 15:25:41.238759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 903a522b-68b1-4bb2-9050-a8d2c3377b04 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:41.249597 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:41.267942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Transition to ACTIVE for port object 903a522b-68b1-4bb2-9050-a8d2c3377b04 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:25:41.288995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-36cecab2-a66e-4fe2-9e90-e00775196ae9 req-e0ee0765-e53c-4d54-999f-3888bc921714 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=9748d189-ba6b-4829-b15d-3781082b5a02 HTTP/1.1" status: 200 len: 210 time: 0.1852143 May 12 15:25:41.295377 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:41.534646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-830430b0-82b5-42d3-bfa3-437323724f29 req-a1a110ce-007b-4155-93c3-fa6f64a0711d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Synchronizing usage tracker for tenant:61d51b592d944a47ba438d18c03cb747 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:25:41.552857 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-91e6da20-da79-499e-96df-df1b2cb99c8b'] response: {'server_uuid': '9748d189-ba6b-4829-b15d-3781082b5a02', 'name': 'network-vif-deleted', 'tag': '4ec57409-cad0-41cc-88d2-9dde7b41a0fe', 'status': 'completed', 'code': 200} May 12 15:25:41.598716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Pushing event updated for resources: {'Port': ['ID=903a522b-68b1-4bb2-9050-a8d2c3377b04,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:41.657232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-830430b0-82b5-42d3-bfa3-437323724f29 req-a1a110ce-007b-4155-93c3-fa6f64a0711d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Unset dirty status for tenant:61d51b592d944a47ba438d18c03cb747 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:25:41.672088 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-830430b0-82b5-42d3-bfa3-437323724f29 req-a1a110ce-007b-4155-93c3-fa6f64a0711d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 210 time: 0.3431497 May 12 15:25:41.744184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Attempting to bind port 903a522b-68b1-4bb2-9050-a8d2c3377b04 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:25:41.744528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Attempting to bind port 903a522b-68b1-4bb2-9050-a8d2c3377b04 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:25:41.744949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Attempting to bind port 903a522b-68b1-4bb2-9050-a8d2c3377b04 on network 7ae70819-776e-45f8-bf36-c5eb46788b03 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:41.755744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Port 903a522b-68b1-4bb2-9050-a8d2c3377b04 on network 7ae70819-776e-45f8-bf36-c5eb46788b03 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:25:41.756069 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Attempting to bind port 903a522b-68b1-4bb2-9050-a8d2c3377b04 on network 7ae70819-776e-45f8-bf36-c5eb46788b03 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:41.769025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 25, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:25:41.769376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Checking segment: {'id': '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:25:41.769782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Bound using segment: {'id': '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:25:41.770209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Bound port: 903a522b-68b1-4bb2-9050-a8d2c3377b04, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:25:41.770553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:41.859608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 82b1a321-6a8f-4285-8002-cdef4cd9cfdb {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:41.877061 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:41.913444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Transition to ACTIVE for port object 82b1a321-6a8f-4285-8002-cdef4cd9cfdb will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:25:41.925321 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:41.982546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] For port 903a522b-68b1-4bb2-9050-a8d2c3377b04, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:25:42.010159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] For port 903a522b-68b1-4bb2-9050-a8d2c3377b04, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=903a522b-68b1-4bb2-9050-a8d2c3377b04,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:25:42.015400 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:42.090702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:42.091317 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:42.093004 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] 10.222.0.84 "PUT /v2.0/ports/903a522b-68b1-4bb2-9050-a8d2c3377b04 HTTP/1.1" status: 200 len: 1091 time: 2.1897972 May 12 15:25:42.095363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32', 'tag': '903a522b-68b1-4bb2-9050-a8d2c3377b04'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:42.129983 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-445066ff-2ef9-4103-89be-79f88486fc61 req-87462576-c46d-4883-8cdc-194b0a81dca4 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:42.131300 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-445066ff-2ef9-4103-89be-79f88486fc61 req-87462576-c46d-4883-8cdc-194b0a81dca4 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.2249713 May 12 15:25:42.144378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4ec57409-cad0-41cc-88d2-9dde7b41a0fe no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:25:42.203372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Allocated IP 172.20.0.12 (7ae70819-776e-45f8-bf36-c5eb46788b03/7cb1634d-8705-40fa-abd9-508349cb9ba7/ca8260ac-22c8-4968-9ce8-5404534a00c8) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:25:42.224576 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 4ec57409-cad0-41cc-88d2-9dde7b41a0fe {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:25:42.225214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4ec57409-cad0-41cc-88d2-9dde7b41a0fe not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:25:42.253224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee4d65d1-c002-4305-9c12-2451182f0c23 service neutron] Pushing event updated for resources: {'Port': ['ID=903a522b-68b1-4bb2-9050-a8d2c3377b04,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:42.260018 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-33cf9a6d-16ae-4a56-a88c-2631ffe49ed1'] response: {'name': 'network-changed', 'server_uuid': '55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32', 'tag': '903a522b-68b1-4bb2-9050-a8d2c3377b04', 'status': 'completed', 'code': 200} May 12 15:25:42.283735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-445066ff-2ef9-4103-89be-79f88486fc61 req-c25e03e2-6b70-44a7-862e-f5ee15f0da17 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1441541 May 12 15:25:42.331603 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-72da646c-c40c-4211-8bc1-a257e3a9c276 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:42.333072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-72da646c-c40c-4211-8bc1-a257e3a9c276 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=61d51b592d944a47ba438d18c03cb747&device_id=55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32 HTTP/1.1" status: 200 len: 1094 time: 0.1504350 May 12 15:25:42.373770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Pushing event updated for resources: {'Port': ['ID=82b1a321-6a8f-4285-8002-cdef4cd9cfdb,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:42.528472 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-519fe572-5dde-4050-a477-5d061c54d945 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=903a522b-68b1-4bb2-9050-a8d2c3377b04 HTTP/1.1" status: 200 len: 217 time: 0.1786242 May 12 15:25:42.545567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Attempting to bind port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:25:42.545909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Attempting to bind port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:25:42.546247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Attempting to bind port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb on network 7ae70819-776e-45f8-bf36-c5eb46788b03 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:42.556801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb on network 7ae70819-776e-45f8-bf36-c5eb46788b03 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:25:42.558126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Attempting to bind port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb on network 7ae70819-776e-45f8-bf36-c5eb46788b03 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:42.575987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 25, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:25:42.576332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Checking segment: {'id': '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:25:42.576730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Bound using segment: {'id': '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:25:42.577180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Bound port: 82b1a321-6a8f-4285-8002-cdef4cd9cfdb, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:25:42.577580 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:42.624667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-f6996885-d8f6-44a7-ac00-bc955ee2fcc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:42.626038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-f6996885-d8f6-44a7-ac00-bc955ee2fcc0 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7cb1634d-8705-40fa-abd9-508349cb9ba7 HTTP/1.1" status: 200 len: 856 time: 0.0876422 May 12 15:25:42.638518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-421f9f82-239f-4932-93a1-a4feda584bae req-8807506a-8d96-4287-997c-3b7e18619025 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:42.640219 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-421f9f82-239f-4932-93a1-a4feda584bae req-8807506a-8d96-4287-997c-3b7e18619025 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.1751504 May 12 15:25:42.682007 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1e7985f3-5eba-456c-a35b-e93d67048023 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:42.746720 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-0614bbc0-944d-4d69-801a-a07297cc31d6 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=7ae70819-776e-45f8-bf36-c5eb46788b03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1044939 May 12 15:25:42.766431 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:42.788394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] For port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:25:42.797764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] For port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=82b1a321-6a8f-4285-8002-cdef4cd9cfdb,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:25:42.810713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:42.926688 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:42.930682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Pushing event updated for resources: {'Port': ['ID=82b1a321-6a8f-4285-8002-cdef4cd9cfdb,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:42.940344 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9dca425b-5dd4-4ce0-bb25-02ef6279adcf req-82405d59-54e7-440e-946f-e0f6093e36af tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 210 time: 0.1155403 May 12 15:25:42.956100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:42.956684 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:42.958271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7a3625a-3d5c-4918-8ab3-f1180b45e8aa service neutron] 10.222.0.84 "PUT /v2.0/ports/82b1a321-6a8f-4285-8002-cdef4cd9cfdb HTTP/1.1" status: 200 len: 1091 time: 3.3658597 May 12 15:25:42.988416 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:43.152241 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-421f9f82-239f-4932-93a1-a4feda584bae req-2b2d81c6-d7ec-432a-b6e3-5fedae155617 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4044080 May 12 15:25:43.162872 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Network 7ae70819-776e-45f8-bf36-c5eb46788b03 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:25:43.177051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:25:43.183645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:25:43.253647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Pushing event updated for resources: {'Port': ['ID=ca8260ac-22c8-4968-9ce8-5404534a00c8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:43.287965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:43.287965 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:43.288973 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-66ea5d0a-c946-408c-bf1e-e7a0b5e5e772 service neutron] 10.222.0.84 "GET /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5069790 May 12 15:25:43.302228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a764e1fb-4078-4b6b-98db-ac62098e4b2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:43.304062 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a764e1fb-4078-4b6b-98db-ac62098e4b2b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=61d51b592d944a47ba438d18c03cb747&device_id=d270cb8f-b1c9-42ca-9c3e-d51f878d58ee HTTP/1.1" status: 200 len: 1094 time: 0.2388496 May 12 15:25:43.378004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-a4834d32-f7b1-4423-9df9-2c8a6f070235 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:43.379534 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-a4834d32-f7b1-4423-9df9-2c8a6f070235 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 812 time: 0.2595451 May 12 15:25:43.410759 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-226f453e-1fea-44a9-9347-5e6e7c6b47b9 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=82b1a321-6a8f-4285-8002-cdef4cd9cfdb HTTP/1.1" status: 200 len: 217 time: 0.0838664 May 12 15:25:43.442106 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-111f3edc-5881-40f4-97e0-6c1b813a954b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/quotas/011dcf6c7b624a28bb2d8ed8db38754f HTTP/1.1" status: 200 len: 375 time: 0.0355616 May 12 15:25:43.510149 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a55f7dd9-1272-48e1-857c-ae0589dce99d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.9163468 May 12 15:25:43.528878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Request body: {'port': {'device_id': 'fb219e29-6ed8-4f1b-98dc-8002eaaece2e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:43.554268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd270cb8f-b1c9-42ca-9c3e-d51f878d58ee', 'tag': '82b1a321-6a8f-4285-8002-cdef4cd9cfdb'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:43.581452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-f69cf163-20d8-4024-9c6d-d45581b53e81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:43.582889 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-f69cf163-20d8-4024-9c6d-d45581b53e81 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7cb1634d-8705-40fa-abd9-508349cb9ba7 HTTP/1.1" status: 200 len: 856 time: 0.1641471 May 12 15:25:43.730002 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:43.742787 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-53049ea3-fab1-476d-895d-ae7189b107ad service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=7ae70819-776e-45f8-bf36-c5eb46788b03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1435871 May 12 15:25:43.824207 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-115f9a4f-5906-4c49-b6a9-11c4e0d31fd2 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&fields=id HTTP/1.1" status: 200 len: 210 time: 0.3792019 May 12 15:25:43.980033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-a7be2a78-9538-4a1f-993d-2ef0267948f8 service neutron] 10.222.0.84 "GET /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5989022 May 12 15:25:44.032051 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-c1ee6e21-a53c-4d68-90f3-2cc7d22c7053 service neutron] 10.222.0.82 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1996393 May 12 15:25:44.045870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d269fff-d716-4b69-8812-ddedcdc2a3cb req-674ae29f-a741-4aa5-af70-8ba3994af2ed tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:44.062476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d269fff-d716-4b69-8812-ddedcdc2a3cb req-674ae29f-a741-4aa5-af70-8ba3994af2ed tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.3018522 May 12 15:25:44.181663 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-221f3ccc-40e1-4d5d-affd-d4ce2190a2e9 service neutron] 10.222.0.84 "GET /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4018221 May 12 15:25:44.255037 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d269fff-d716-4b69-8812-ddedcdc2a3cb req-cee9fa01-f866-47b7-8382-6298c96013eb tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1900876 May 12 15:25:44.377347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-99f03931-3158-44da-ad7e-fe930df74680 service neutron] 10.222.0.82 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3095417 May 12 15:25:44.394227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f54484-0dc6-4914-81d3-b30c6fa281a8 req-3791e302-8921-49ee-a87e-211016a00f80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:44.400876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75f54484-0dc6-4914-81d3-b30c6fa281a8 req-3791e302-8921-49ee-a87e-211016a00f80 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=61d51b592d944a47ba438d18c03cb747&device_id=55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32 HTTP/1.1" status: 200 len: 1094 time: 0.2391312 May 12 15:25:44.457994 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f313d02a-a518-4a8a-80be-e2329eaa1e6c'] response: {'name': 'network-changed', 'server_uuid': 'd270cb8f-b1c9-42ca-9c3e-d51f878d58ee', 'tag': '82b1a321-6a8f-4285-8002-cdef4cd9cfdb', 'status': 'completed', 'code': 200} May 12 15:25:44.508094 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7634b565-240a-445a-af80-0a0519b0e1d5 service neutron] 10.222.0.84 "GET /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3167620 May 12 15:25:44.681793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f54484-0dc6-4914-81d3-b30c6fa281a8 req-bde86132-16f3-4c3b-bbd0-98a5c2c5ceb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:44.684291 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75f54484-0dc6-4914-81d3-b30c6fa281a8 req-bde86132-16f3-4c3b-bbd0-98a5c2c5ceb0 service neutron] 10.222.0.84 "GET /v2.0/networks?id=7ae70819-776e-45f8-bf36-c5eb46788b03 HTTP/1.1" status: 200 len: 917 time: 0.2681868 May 12 15:25:44.732522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ca8260ac-22c8-4968-9ce8-5404534a00c8 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:44.748449 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:44.772284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Transition to ACTIVE for port object ca8260ac-22c8-4968-9ce8-5404534a00c8 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:25:44.780862 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:44.814862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7666928-3106-428f-92c4-59179430be49 req-d789e61f-7b2d-42e5-a017-161137d532fa tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:44.816508 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7666928-3106-428f-92c4-59179430be49 req-d789e61f-7b2d-42e5-a017-161137d532fa tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/ports?device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 946 time: 0.2853045 May 12 15:25:44.818009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75f54484-0dc6-4914-81d3-b30c6fa281a8 req-282a8e2c-e8c3-4772-9b38-fcb3020d9d54 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=903a522b-68b1-4bb2-9050-a8d2c3377b04 HTTP/1.1" status: 200 len: 217 time: 0.1052756 May 12 15:25:44.824077 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1008eb66-5835-4ed3-b087-5591b490740d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:44.835014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dd66974-a0c7-4acc-bbb9-9a5a4c8f6518 req-e7267290-dfcd-4cfc-b182-2a0ea97234ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:44.836513 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2dd66974-a0c7-4acc-bbb9-9a5a4c8f6518 req-e7267290-dfcd-4cfc-b182-2a0ea97234ff service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=61d51b592d944a47ba438d18c03cb747&device_id=d270cb8f-b1c9-42ca-9c3e-d51f878d58ee HTTP/1.1" status: 200 len: 1094 time: 0.1655214 May 12 15:25:45.025656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Pushing event updated for resources: {'Port': ['ID=ca8260ac-22c8-4968-9ce8-5404534a00c8,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:45.030008 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7666928-3106-428f-92c4-59179430be49 req-c63f8b62-549e-4d9d-ae67-8c621ff93ed7 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/security-groups?id=298d5ce2-0e39-4957-ba55-bb703769d021&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1790733 May 12 15:25:45.034150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f54484-0dc6-4914-81d3-b30c6fa281a8 req-b87e0f83-5bea-446b-a4ce-560509b27517 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:45.036389 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75f54484-0dc6-4914-81d3-b30c6fa281a8 req-b87e0f83-5bea-446b-a4ce-560509b27517 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7cb1634d-8705-40fa-abd9-508349cb9ba7 HTTP/1.1" status: 200 len: 856 time: 0.1780698 May 12 15:25:45.101875 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75f54484-0dc6-4914-81d3-b30c6fa281a8 req-e3c05d29-05a7-4f05-b5d3-7e7c0c3f9469 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=7ae70819-776e-45f8-bf36-c5eb46788b03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0551050 May 12 15:25:45.120607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d4dd15d-a132-4a5f-811f-f21f3ee71b18 req-d7ff2905-1017-43d5-9a4a-b289f7924402 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:45.122440 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d4dd15d-a132-4a5f-811f-f21f3ee71b18 req-d7ff2905-1017-43d5-9a4a-b289f7924402 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 944 time: 0.3167617 May 12 15:25:45.222486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dd66974-a0c7-4acc-bbb9-9a5a4c8f6518 req-0e07e55c-9d52-4ae4-8134-906fc3d86c15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:45.225417 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2dd66974-a0c7-4acc-bbb9-9a5a4c8f6518 req-0e07e55c-9d52-4ae4-8134-906fc3d86c15 service neutron] 10.222.0.84 "GET /v2.0/networks?id=7ae70819-776e-45f8-bf36-c5eb46788b03 HTTP/1.1" status: 200 len: 917 time: 0.3784509 May 12 15:25:45.229862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Attempting to bind port ca8260ac-22c8-4968-9ce8-5404534a00c8 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:25:45.230202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Attempting to bind port ca8260ac-22c8-4968-9ce8-5404534a00c8 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:25:45.230533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Attempting to bind port ca8260ac-22c8-4968-9ce8-5404534a00c8 on network 7ae70819-776e-45f8-bf36-c5eb46788b03 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:45.345824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Port ca8260ac-22c8-4968-9ce8-5404534a00c8 on network 7ae70819-776e-45f8-bf36-c5eb46788b03 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:25:45.346533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Attempting to bind port ca8260ac-22c8-4968-9ce8-5404534a00c8 on network 7ae70819-776e-45f8-bf36-c5eb46788b03 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:45.350142 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2dd66974-a0c7-4acc-bbb9-9a5a4c8f6518 req-3ad4f1f8-6eb0-463d-88d3-1d3f5712529d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=82b1a321-6a8f-4285-8002-cdef4cd9cfdb HTTP/1.1" status: 200 len: 217 time: 0.0988641 May 12 15:25:45.357017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 25, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:25:45.357789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Checking segment: {'id': '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:25:45.358611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Bound using segment: {'id': '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:25:45.359299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Bound port: ca8260ac-22c8-4968-9ce8-5404534a00c8, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:25:45.359900 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:45.365749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6d4dd15d-a132-4a5f-811f-f21f3ee71b18 req-24025228-7e96-4974-92ba-c3d3aa08f252 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Synchronizing usage tracker for tenant:61d51b592d944a47ba438d18c03cb747 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:25:45.433109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6d4dd15d-a132-4a5f-811f-f21f3ee71b18 req-24025228-7e96-4974-92ba-c3d3aa08f252 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Unset dirty status for tenant:61d51b592d944a47ba438d18c03cb747 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:25:45.445617 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d4dd15d-a132-4a5f-811f-f21f3ee71b18 req-24025228-7e96-4974-92ba-c3d3aa08f252 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2819164 May 12 15:25:45.457377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75f54484-0dc6-4914-81d3-b30c6fa281a8 req-b5d3c3c0-fd1a-4620-84bc-a31572eee065 service neutron] 10.222.0.84 "GET /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3332379 May 12 15:25:45.544413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dd66974-a0c7-4acc-bbb9-9a5a4c8f6518 req-0b514ad7-f899-4cc4-be6c-6d3b7441d73e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:45.545951 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2dd66974-a0c7-4acc-bbb9-9a5a4c8f6518 req-0b514ad7-f899-4cc4-be6c-6d3b7441d73e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7cb1634d-8705-40fa-abd9-508349cb9ba7 HTTP/1.1" status: 200 len: 856 time: 0.1700919 May 12 15:25:45.610432 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2dd66974-a0c7-4acc-bbb9-9a5a4c8f6518 req-377b9672-d43d-491f-a785-f784c30ea47b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=7ae70819-776e-45f8-bf36-c5eb46788b03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0539622 May 12 15:25:45.616559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] For port ca8260ac-22c8-4968-9ce8-5404534a00c8, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:25:45.621237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] For port ca8260ac-22c8-4968-9ce8-5404534a00c8, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=ca8260ac-22c8-4968-9ce8-5404534a00c8,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:25:45.649807 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:45.650124 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c63eff23-53f5-437f-9037-039ca0976696 req-85d583bb-b219-43c3-ad15-aa5adf710513 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 210 time: 0.0602891 May 12 15:25:45.690083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cdf5b58-5420-4e62-b3bf-348f16270cc1 req-2b0deefd-8253-4380-9da6-0a2165f2c305 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:45.692790 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cdf5b58-5420-4e62-b3bf-348f16270cc1 req-2b0deefd-8253-4380-9da6-0a2165f2c305 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.3764181 May 12 15:25:45.755411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cdf5b58-5420-4e62-b3bf-348f16270cc1 req-dd779dba-28e3-4ed5-87a5-65f7266f5bdc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494099 May 12 15:25:45.757484 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75f54484-0dc6-4914-81d3-b30c6fa281a8 req-8d9ea13c-a94b-4de7-b08f-3b2d22644cbe service neutron] 10.222.0.84 "GET /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2912054 May 12 15:25:45.785769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:45.786369 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:45.787710 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] 10.222.0.84 "PUT /v2.0/ports/ca8260ac-22c8-4968-9ce8-5404534a00c8 HTTP/1.1" status: 200 len: 1092 time: 2.2634654 May 12 15:25:45.840057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6984e3-0687-4c25-a4c1-280d996e5180 service neutron] Pushing event updated for resources: {'Port': ['ID=ca8260ac-22c8-4968-9ce8-5404534a00c8,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:45.863872 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2dd66974-a0c7-4acc-bbb9-9a5a4c8f6518 req-080723c9-8790-4dec-9be9-b8cc32d86a71 service neutron] 10.222.0.84 "GET /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2411389 May 12 15:25:46.011634 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:46.142800 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:46.173136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 903a522b-68b1-4bb2-9050-a8d2c3377b04 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:25:46.192312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:25:46.231741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-d95cdcb5-cdb5-4308-a66d-ffeab8d8b11e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:46.233562 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-d95cdcb5-cdb5-4308-a66d-ffeab8d8b11e service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=61d51b592d944a47ba438d18c03cb747&device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 1095 time: 0.3581495 May 12 15:25:46.239851 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2dd66974-a0c7-4acc-bbb9-9a5a4c8f6518 req-f25c759d-5444-4801-aeb2-314b0019741e service neutron] 10.222.0.84 "GET /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3656826 May 12 15:25:46.258080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4026e3-389f-48ab-bc85-68ccdf96c466 req-124ff98e-1998-4536-82d7-d2be2c9536f5 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:46.259550 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4026e3-389f-48ab-bc85-68ccdf96c466 req-124ff98e-1998-4536-82d7-d2be2c9536f5 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.84 "GET /v2.0/ports?device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 946 time: 0.2371366 May 12 15:25:46.290220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ccf976-a487-478b-a37c-c0ffdd6cb205 req-a1e60010-6d70-462d-9594-d1afd6d01a7f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:46.299359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4ccf976-a487-478b-a37c-c0ffdd6cb205 req-a1e60010-6d70-462d-9594-d1afd6d01a7f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.2757065 May 12 15:25:46.428446 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-ad670446-60ee-4ad7-a43b-715dd8db1c3f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ca8260ac-22c8-4968-9ce8-5404534a00c8 HTTP/1.1" status: 200 len: 217 time: 0.1572239 May 12 15:25:46.475191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fb219e29-6ed8-4f1b-98dc-8002eaaece2e', 'tag': 'ca8260ac-22c8-4968-9ce8-5404534a00c8'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:46.479035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-1a4026e3-389f-48ab-bc85-68ccdf96c466 req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Deleting port fc6625bc-4109-4dee-b76b-c8531108ac3d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:25:46.480375 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1a4026e3-389f-48ab-bc85-68ccdf96c466 req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:46.635266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b494d41-953c-4638-b7ef-33c202b76b20 req-8774d1fc-0071-4f71-8f92-ea4bd7b6a6a0 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:46.644167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b494d41-953c-4638-b7ef-33c202b76b20 req-8774d1fc-0071-4f71-8f92-ea4bd7b6a6a0 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.8045409 May 12 15:25:46.720366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d1de11-eee3-473a-8967-40166f494e83 req-9d10668a-fe8f-4f8e-ba23-5bdf05747ab7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:46.722005 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-9d10668a-fe8f-4f8e-ba23-5bdf05747ab7 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7cb1634d-8705-40fa-abd9-508349cb9ba7 HTTP/1.1" status: 200 len: 856 time: 0.2325852 May 12 15:25:46.734899 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 903a522b-68b1-4bb2-9050-a8d2c3377b04, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=903a522b-68b1-4bb2-9050-a8d2c3377b04,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:46.772575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '903a522b-68b1-4bb2-9050-a8d2c3377b04', 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03', 'port_id': '903a522b-68b1-4bb2-9050-a8d2c3377b04', 'mac_address': 'fa:16:3e:c3:0e:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 563, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7cb1634d-8705-40fa-abd9-508349cb9ba7', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:25:46.853533 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-6c520eb7-80ba-4e31-a3b4-0a628cb8b3f0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=7ae70819-776e-45f8-bf36-c5eb46788b03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0935912 May 12 15:25:46.870801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-33b00441-e9e8-4f3a-92f9-46c14870f2b7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:46.872315 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-33b00441-e9e8-4f3a-92f9-46c14870f2b7 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.84 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 812 time: 0.4458072 May 12 15:25:46.896360 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:46.937379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 903a522b-68b1-4bb2-9050-a8d2c3377b04 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:46.963189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Request body: {'port': {'device_id': '12215d44-186e-4901-81f8-0c2cf89b7793', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'admin_state_up': True, 'tenant_id': '011dcf6c7b624a28bb2d8ed8db38754f'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:46.970531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 903a522b-68b1-4bb2-9050-a8d2c3377b04, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=903a522b-68b1-4bb2-9050-a8d2c3377b04,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:46.975603 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:46.976301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0ce28f36-b32c-468c-81e3-0dd235e15282 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:25:47.093104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-1a4026e3-389f-48ab-bc85-68ccdf96c466 req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] For port fc6625bc-4109-4dee-b76b-c8531108ac3d, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fc6625bc-4109-4dee-b76b-c8531108ac3d,segment=NetworkSegment(ce9be9ba-77e9-4d69-90ae-2dc7b4342400),segment_id=ce9be9ba-77e9-4d69-90ae-2dc7b4342400)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:47.093489 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1a4026e3-389f-48ab-bc85-68ccdf96c466 req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:47.208512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:47.222314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Usage tracker for resource:port and tenant:011dcf6c7b624a28bb2d8ed8db38754f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:47.225676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:47.241348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:47.270354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40698) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:47.300406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Made reservation on behalf of 011dcf6c7b624a28bb2d8ed8db38754f for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:25:47.306173 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:47.344013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-1a4026e3-389f-48ab-bc85-68ccdf96c466 req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Calling delete_port for fc6625bc-4109-4dee-b76b-c8531108ac3d owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:25:47.397486 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b494d41-953c-4638-b7ef-33c202b76b20 req-7a437d94-da17-4520-893f-65c710720d62 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.7524314 May 12 15:25:47.406646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0ce28f36-b32c-468c-81e3-0dd235e15282,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:47.425340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'port_id': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'mac_address': 'fa:16:3e:c4:85:6e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 558, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:25:47.444509 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4ccf976-a487-478b-a37c-c0ffdd6cb205 req-48ea01de-9e90-43c2-b72b-4bb6a3904ba0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.1439831 May 12 15:25:47.500925 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=903a522b-68b1-4bb2-9050-a8d2c3377b04,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:47.524539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.525594 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.526171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.526927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.527601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.528270 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.528827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.529443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.529922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.530481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.530996 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.531568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.562260 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:47.612098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 0ce28f36-b32c-468c-81e3-0dd235e15282 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:47.650306 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-e30d8043-2839-43bc-adac-cbfa75f509e3 service neutron] 10.222.0.84 "GET /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7742100 May 12 15:25:47.677025 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:47.681829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0ce28f36-b32c-468c-81e3-0dd235e15282,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:47.684771 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf786b3b-a7e6-4823-876d-8f0a9f31252d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:47.688831 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:47.770796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=0ce28f36-b32c-468c-81e3-0dd235e15282,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:47.816670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cf786b3b-a7e6-4823-876d-8f0a9f31252d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:47.840434 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1a4026e3-389f-48ab-bc85-68ccdf96c466 req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:47.847914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cf786b3b-a7e6-4823-876d-8f0a9f31252d admin admin] Usage tracker for resource:security_group_rule and tenant:cf848bee657b45d2a3ee03b6b99c020b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:47.852517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cf786b3b-a7e6-4823-876d-8f0a9f31252d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:47.866942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cf786b3b-a7e6-4823-876d-8f0a9f31252d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:47.914653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Pushing event deleted for resources: {'Port': ['ID=fc6625bc-4109-4dee-b76b-c8531108ac3d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:47.949413 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['0ce28f36-b32c-468c-81e3-0dd235e15282'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:25:47.978207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.978552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.978856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.979684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.980017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.980343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.980831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.981151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.981493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.981810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.982144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:47.982462 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:25:48.021419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Allocated IP 172.20.0.2 (aa894a26-e7a0-42ea-b7f1-9a9c136eacd6/0ff5192a-946b-4444-900a-788b8ddc74b6/64936beb-03d4-4182-81be-074a96507608) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:25:48.044290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d480516-119f-4439-8fa9-ed2f46f48dc3 req-39a86d4e-ec02-45cc-bdac-635df1d80f0f tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:48.051251 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d480516-119f-4439-8fa9-ed2f46f48dc3 req-39a86d4e-ec02-45cc-bdac-635df1d80f0f tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/ports?device_id=fd93ffe4-6418-4f8b-a86f-c14f441dc937 HTTP/1.1" status: 200 len: 946 time: 0.3881998 May 12 15:25:48.055846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-1a4026e3-389f-48ab-bc85-68ccdf96c466 req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] No DVR routers for this DVR port fc6625bc-4109-4dee-b76b-c8531108ac3d on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:25:48.074647 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1a4026e3-389f-48ab-bc85-68ccdf96c466 req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:48.079226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd93ffe4-6418-4f8b-a86f-c14f441dc937', 'name': 'network-vif-deleted', 'tag': 'fc6625bc-4109-4dee-b76b-c8531108ac3d'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:48.101421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ce1e1a-0d3d-4993-9f0e-d6275c24af98 req-83ab1fe4-88bf-4c66-b986-dc4463c1759f tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:48.109313 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81ce1e1a-0d3d-4993-9f0e-d6275c24af98 req-83ab1fe4-88bf-4c66-b986-dc4463c1759f tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 944 time: 0.3777828 May 12 15:25:48.126893 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4026e3-389f-48ab-bc85-68ccdf96c466 req-726963cb-9f7c-478c-af34-6249787e9c14 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.84 "DELETE /v2.0/ports/fc6625bc-4109-4dee-b76b-c8531108ac3d HTTP/1.1" status: 204 len: 173 time: 1.8239012 May 12 15:25:48.171812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['903a522b-68b1-4bb2-9050-a8d2c3377b04'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:25:48.178653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d480516-119f-4439-8fa9-ed2f46f48dc3 req-9e75804f-4071-4a08-abda-2c9761b64922 tempest-VolumesActionsTest-1338788226 tempest-VolumesActionsTest-1338788226-project] 10.222.0.82 "GET /v2.0/security-groups?id=298d5ce2-0e39-4957-ba55-bb703769d021&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1264663 May 12 15:25:48.225034 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b9d1de11-eee3-473a-8967-40166f494e83 req-3d347807-aba0-4fff-8cbb-fd252432b731 service neutron] 10.222.0.84 "GET /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5121293 May 12 15:25:48.235335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 82b1a321-6a8f-4285-8002-cdef4cd9cfdb details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:25:48.243470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fc6625bc-4109-4dee-b76b-c8531108ac3d no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:25:48.256355 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81ce1e1a-0d3d-4993-9f0e-d6275c24af98 req-291aa256-d821-4f92-8977-bebdecbd777b tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1460536 May 12 15:25:48.362469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: fc6625bc-4109-4dee-b76b-c8531108ac3d {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:25:48.363354 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fc6625bc-4109-4dee-b76b-c8531108ac3d not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:25:48.365828 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b94a085a-c301-435b-beab-ed8f26dc5697'] response: {'name': 'network-changed', 'server_uuid': 'fb219e29-6ed8-4f1b-98dc-8002eaaece2e', 'tag': 'ca8260ac-22c8-4968-9ce8-5404534a00c8', 'status': 'completed', 'code': 200} May 12 15:25:48.514451 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:25:48.608399 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d4702aab-4f63-4dda-954c-8883564be02f req-d75ab1dd-a4a3-4d0c-b687-cf8b926cbdb3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 210 time: 0.1025381 May 12 15:25:48.709861 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:48.710933 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ce24f8f2-c27c-4d7d-a7a2-ab7b3e571e37'] response: {'server_uuid': 'fd93ffe4-6418-4f8b-a86f-c14f441dc937', 'name': 'network-vif-deleted', 'tag': 'fc6625bc-4109-4dee-b76b-c8531108ac3d', 'status': 'completed', 'code': 200} May 12 15:25:48.714962 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf786b3b-a7e6-4823-876d-8f0a9f31252d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:48.717041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=82b1a321-6a8f-4285-8002-cdef4cd9cfdb,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:48.740104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '82b1a321-6a8f-4285-8002-cdef4cd9cfdb', 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03', 'port_id': '82b1a321-6a8f-4285-8002-cdef4cd9cfdb', 'mac_address': 'fa:16:3e:3f:9a:42', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 563, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7cb1634d-8705-40fa-abd9-508349cb9ba7', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:25:48.745778 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf786b3b-a7e6-4823-876d-8f0a9f31252d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:48.881410 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:48.887158 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cf786b3b-a7e6-4823-876d-8f0a9f31252d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=cf848bee657b45d2a3ee03b6b99c020b&name=default HTTP/1.1" status: 200 len: 2983 time: 1.6076019 May 12 15:25:48.887760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40726) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:48.891638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf786b3b-a7e6-4823-876d-8f0a9f31252d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e1160b5-357a-41c1-9fd1-838268c0dda5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:48.924878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36bfba0-8230-4b57-a2aa-3606532a62b5 req-e5c95f06-51a3-4430-a7d2-97d14567917a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:48.926699 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e36bfba0-8230-4b57-a2aa-3606532a62b5 req-e5c95f06-51a3-4430-a7d2-97d14567917a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=61d51b592d944a47ba438d18c03cb747&device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 1095 time: 0.4677389 May 12 15:25:48.941193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 82b1a321-6a8f-4285-8002-cdef4cd9cfdb {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:48.997521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=82b1a321-6a8f-4285-8002-cdef4cd9cfdb,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:49.049208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6976ceb5-b6f0-4f82-80d1-13e0b62f7618 req-726bacf5-a516-46ae-9cd0-4a88b90057c9 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:49.051157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6976ceb5-b6f0-4f82-80d1-13e0b62f7618 req-726bacf5-a516-46ae-9cd0-4a88b90057c9 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 945 time: 0.2004519 May 12 15:25:49.066274 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:49.134124 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6976ceb5-b6f0-4f82-80d1-13e0b62f7618 req-d751699d-1bd9-4ffc-bb7e-61c1278b9262 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0745583 May 12 15:25:49.316271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36bfba0-8230-4b57-a2aa-3606532a62b5 req-10bf0bc2-44e2-483b-96b0-76be11845c09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:49.317742 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e36bfba0-8230-4b57-a2aa-3606532a62b5 req-10bf0bc2-44e2-483b-96b0-76be11845c09 service neutron] 10.222.0.84 "GET /v2.0/networks?id=7ae70819-776e-45f8-bf36-c5eb46788b03 HTTP/1.1" status: 200 len: 917 time: 0.3747025 May 12 15:25:49.335435 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:49.378146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6da1fb1-16e9-4510-add5-27cb322c13e2 req-51dd2f91-1c11-46dd-a492-d84bfe216a9a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:49.385366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e6da1fb1-16e9-4510-add5-27cb322c13e2 req-51dd2f91-1c11-46dd-a492-d84bfe216a9a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.1457019 May 12 15:25:49.413424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=82b1a321-6a8f-4285-8002-cdef4cd9cfdb,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:49.572681 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e6da1fb1-16e9-4510-add5-27cb322c13e2 req-4206b9cb-dbfd-45bf-be47-f20ca485771d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1793706 May 12 15:25:49.580874 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['82b1a321-6a8f-4285-8002-cdef4cd9cfdb'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:25:49.700330 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84f09bb1-42af-4218-9f4f-ef45ab7fba8d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:49.755750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:25:49.821216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76e0ec56-c4e5-416c-beff-5908274ef8f9 req-a36546ff-5ddf-471e-b903-b05811a7d861 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:49.821661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:25:49.841311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-76e0ec56-c4e5-416c-beff-5908274ef8f9 req-a36546ff-5ddf-471e-b903-b05811a7d861 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 944 time: 0.2686431 May 12 15:25:49.841813 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e36bfba0-8230-4b57-a2aa-3606532a62b5 req-89ead6a8-5627-4018-8234-46ead3ef1ad7 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ca8260ac-22c8-4968-9ce8-5404534a00c8 HTTP/1.1" status: 200 len: 217 time: 0.4700012 May 12 15:25:49.845999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:25:50.141028 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-76e0ec56-c4e5-416c-beff-5908274ef8f9 req-ff16b591-ee35-4355-b8a2-9d51b836f510 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2986438 May 12 15:25:50.189605 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device ca8260ac-22c8-4968-9ce8-5404534a00c8 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:25:50.195251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 903a522b-68b1-4bb2-9050-a8d2c3377b04 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:25:50.215919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84f09bb1-42af-4218-9f4f-ef45ab7fba8d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:50.235153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Pushing event updated for resources: {'Port': ['ID=64936beb-03d4-4182-81be-074a96507608,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:50.329150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:50.330134 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:50.380191 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-39f8e076-26e1-4a7b-815f-c230baffc495 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.4211922 May 12 15:25:50.383937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36bfba0-8230-4b57-a2aa-3606532a62b5 req-7efb312e-faec-4d4b-b8f9-09f58ac66e1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:50.386628 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e36bfba0-8230-4b57-a2aa-3606532a62b5 req-7efb312e-faec-4d4b-b8f9-09f58ac66e1c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7cb1634d-8705-40fa-abd9-508349cb9ba7 HTTP/1.1" status: 200 len: 856 time: 0.5431037 May 12 15:25:50.406150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Request body: {'port': {'device_id': '12215d44-186e-4901-81f8-0c2cf89b7793', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:25:50.445007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 903a522b-68b1-4bb2-9050-a8d2c3377b04 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:25:50.461444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-351eb822-e173-4a18-83bc-cf8f42bc748c req-0f580ef7-c857-49fc-b381-8aee9aba10ce tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:50.462959 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-351eb822-e173-4a18-83bc-cf8f42bc748c req-0f580ef7-c857-49fc-b381-8aee9aba10ce tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 931 time: 0.2600286 May 12 15:25:50.495926 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e36bfba0-8230-4b57-a2aa-3606532a62b5 req-ba443720-2fa5-4321-814d-8102b5cd5152 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=7ae70819-776e-45f8-bf36-c5eb46788b03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0962288 May 12 15:25:50.598539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 903a522b-68b1-4bb2-9050-a8d2c3377b04 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:25:50.599165 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:50.656371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-351eb822-e173-4a18-83bc-cf8f42bc748c req-ea45e69b-0766-4656-9524-c1ba211a51e0 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0995340 May 12 15:25:50.677348 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e36bfba0-8230-4b57-a2aa-3606532a62b5 req-dc523320-efca-4728-bc1e-3608337cde4d service neutron] 10.222.0.84 "GET /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1630254 May 12 15:25:50.682920 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84f09bb1-42af-4218-9f4f-ef45ab7fba8d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:50.718820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61dbaabc-58cb-4cb7-b555-9f727b0dff11 req-40a362c8-a17b-46fc-bef2-5bb79dc37903 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:50.720443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61dbaabc-58cb-4cb7-b555-9f727b0dff11 req-40a362c8-a17b-46fc-bef2-5bb79dc37903 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 945 time: 0.2564785 May 12 15:25:50.721796 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e59af3b-d250-4400-bf01-8e41b04fbdb2 req-883e1603-62bf-4573-aca1-79c7ee6930b6 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.9974105 May 12 15:25:50.787921 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84f09bb1-42af-4218-9f4f-ef45ab7fba8d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e1160b5-357a-41c1-9fd1-838268c0dda5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:50.988157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61dbaabc-58cb-4cb7-b555-9f727b0dff11 req-72379356-a7f9-4c3d-b7aa-093f04f278f4 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2614703 May 12 15:25:51.041917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port ca8260ac-22c8-4968-9ce8-5404534a00c8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=ca8260ac-22c8-4968-9ce8-5404534a00c8,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:51.083956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9e8324-069d-4554-a661-4bfd7298309f req-3eb2a8c6-3811-48a7-ae7c-c78381b4beab tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:51.101121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee9e8324-069d-4554-a661-4bfd7298309f req-3eb2a8c6-3811-48a7-ae7c-c78381b4beab tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.2987099 May 12 15:25:51.111158 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84f09bb1-42af-4218-9f4f-ef45ab7fba8d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:51.120585 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-84f09bb1-42af-4218-9f4f-ef45ab7fba8d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9e1160b5-357a-41c1-9fd1-838268c0dda5 HTTP/1.1" status: 204 len: 168 time: 2.2269681 May 12 15:25:51.120837 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'ca8260ac-22c8-4968-9ce8-5404534a00c8', 'network_id': '7ae70819-776e-45f8-bf36-c5eb46788b03', 'port_id': 'ca8260ac-22c8-4968-9ce8-5404534a00c8', 'mac_address': 'fa:16:3e:ee:48:a8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 563, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7cb1634d-8705-40fa-abd9-508349cb9ba7', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:25:51.248888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee9e8324-069d-4554-a661-4bfd7298309f req-821408ab-160f-49fb-84c0-c38c30e396a9 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1429851 May 12 15:25:51.535972 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:51.586011 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:51.598336 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b22c3759-0e27-4c64-a0ce-6fa221e60a37 req-7747477e-ba65-4e46-9409-1f5db2aa2a79 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.2511404 May 12 15:25:51.693746 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ca8260ac-22c8-4968-9ce8-5404534a00c8 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:51.708247 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:51.734631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea45b5e9-beba-4d07-b6e4-72a9e88c7095 req-c213a52c-8b4b-4aef-b89f-e9c269222893 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:51.743891 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea45b5e9-beba-4d07-b6e4-72a9e88c7095 req-c213a52c-8b4b-4aef-b89f-e9c269222893 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 944 time: 0.2621326 May 12 15:25:51.803205 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 903a522b-68b1-4bb2-9050-a8d2c3377b04, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=903a522b-68b1-4bb2-9050-a8d2c3377b04,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:51.809070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port ca8260ac-22c8-4968-9ce8-5404534a00c8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=ca8260ac-22c8-4968-9ce8-5404534a00c8,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:51.811145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '903a522b-68b1-4bb2-9050-a8d2c3377b04'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:51.823364 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:51.827556 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:51.829127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0ce28f36-b32c-468c-81e3-0dd235e15282 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:25:51.900603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea45b5e9-beba-4d07-b6e4-72a9e88c7095 req-2a065fdf-77c3-4ce0-bc9f-e5574fd79145 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1529977 May 12 15:25:52.019691 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e36bfba0-8230-4b57-a2aa-3606532a62b5 req-4ccaa566-35a0-45c3-b238-0b5b294c8f13 service neutron] 10.222.0.84 "GET /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.3280766 May 12 15:25:52.055488 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-31d3f3ed-1863-4f2a-a8f0-0980f0c20fa5'] response: {'server_uuid': '55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '903a522b-68b1-4bb2-9050-a8d2c3377b04', 'code': 200} May 12 15:25:52.065280 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b22c3759-0e27-4c64-a0ce-6fa221e60a37 req-57ea13b1-aebe-4b95-a82d-8c79d9a96714 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.1236601 May 12 15:25:52.127856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40784) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:52.189585 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b22c3759-0e27-4c64-a0ce-6fa221e60a37 req-55d9d9d8-e77d-4f22-b256-e3ed76f56cbb service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1190736 May 12 15:25:52.207026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 0ce28f36-b32c-468c-81e3-0dd235e15282 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:25:52.207438 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:52.278795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f776318-bf54-4a3b-827d-6fa9fe257da2 req-8e4f9ad9-6cad-4a9c-856d-f16ec899e8e6 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:52.280245 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f776318-bf54-4a3b-827d-6fa9fe257da2 req-8e4f9ad9-6cad-4a9c-856d-f16ec899e8e6 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 931 time: 0.2993739 May 12 15:25:52.338778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=ca8260ac-22c8-4968-9ce8-5404534a00c8,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:52.381012 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5993a58d-bc73-45f0-8f5a-bdf9047178e7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:52.446785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f776318-bf54-4a3b-827d-6fa9fe257da2 req-d34de278-b02a-4438-882d-65ff206f7165 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734260 May 12 15:25:52.496141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcd44f28-5b23-46af-94f1-d710ccc9ff07 req-859036df-825f-417e-ab6f-d0e11ed15149 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:52.498011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fcd44f28-5b23-46af-94f1-d710ccc9ff07 req-859036df-825f-417e-ab6f-d0e11ed15149 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 945 time: 0.2518182 May 12 15:25:52.503408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5993a58d-bc73-45f0-8f5a-bdf9047178e7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:25:52.522117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['ca8260ac-22c8-4968-9ce8-5404534a00c8'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:25:52.526803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5993a58d-bc73-45f0-8f5a-bdf9047178e7 admin admin] Usage tracker for resource:security_group_rule and tenant:54bb2f6db900425d959f6650d7e28d41 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:25:52.537851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5993a58d-bc73-45f0-8f5a-bdf9047178e7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:25:52.574101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5993a58d-bc73-45f0-8f5a-bdf9047178e7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:25:52.590472 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=903a522b-68b1-4bb2-9050-a8d2c3377b04,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:52.609825 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fcd44f28-5b23-46af-94f1-d710ccc9ff07 req-020e53b6-86d3-48c3-a423-ed8e011ba89c tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1054800 May 12 15:25:52.854443 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5993a58d-bc73-45f0-8f5a-bdf9047178e7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:52.859154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5878a34-beb5-481f-b8a2-049e1fb508e1 req-ff16a795-69a8-48bc-80a7-8c716b380fb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:52.861289 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e5878a34-beb5-481f-b8a2-049e1fb508e1 req-ff16a795-69a8-48bc-80a7-8c716b380fb3 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32 HTTP/1.1" status: 200 len: 1096 time: 0.6687953 May 12 15:25:52.862545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b22c3759-0e27-4c64-a0ce-6fa221e60a37 req-378f39ef-bd61-46bd-b663-0f63cf507752 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:52.864028 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b22c3759-0e27-4c64-a0ce-6fa221e60a37 req-378f39ef-bd61-46bd-b663-0f63cf507752 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.5334520 May 12 15:25:52.870916 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5993a58d-bc73-45f0-8f5a-bdf9047178e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:52.991526 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5993a58d-bc73-45f0-8f5a-bdf9047178e7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=54bb2f6db900425d959f6650d7e28d41&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8314900 May 12 15:25:52.992972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40798) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:25:53.017197 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:53.025875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5993a58d-bc73-45f0-8f5a-bdf9047178e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eaea63d8-0949-4fc8-90da-3328c712d6fb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:53.035335 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e5878a34-beb5-481f-b8a2-049e1fb508e1 req-fcb52185-3939-469a-a10e-c27264e4778d service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1349719 May 12 15:25:53.092272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e47d6c3-8d99-4329-be35-890b4d118cc9 req-99a0a3a0-07a3-4e24-87c5-fc521b8bccc2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:53.115657 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e47d6c3-8d99-4329-be35-890b4d118cc9 req-99a0a3a0-07a3-4e24-87c5-fc521b8bccc2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.4059832 May 12 15:25:53.173517 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0ce28f36-b32c-468c-81e3-0dd235e15282,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:53.204223 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:53.320001 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 82b1a321-6a8f-4285-8002-cdef4cd9cfdb up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:25:53.360393 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e59af3b-d250-4400-bf01-8e41b04fbdb2 req-fdf9eb48-54c7-48c4-872e-4b473ee01f71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:53.361911 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e59af3b-d250-4400-bf01-8e41b04fbdb2 req-fdf9eb48-54c7-48c4-872e-4b473ee01f71 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5&tenant_id=4e5a10df576841e2a4752a9d47fb790a HTTP/1.1" status: 200 len: 1095 time: 0.5441897 May 12 15:25:53.405262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 64936beb-03d4-4182-81be-074a96507608 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:53.414918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:53.433775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Transition to ACTIVE for port object 64936beb-03d4-4182-81be-074a96507608 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:25:53.462683 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:53.639666 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e47d6c3-8d99-4329-be35-890b4d118cc9 req-5c0639a3-3ffb-4a16-ae06-4b3b55df2ae0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5225604 May 12 15:25:53.681482 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0fe4260c-811c-4843-a0b8-ba342e7536b9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:53.713204 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=0ce28f36-b32c-468c-81e3-0dd235e15282,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:53.723669 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:25:53.735750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:25:53.736124 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:53.765092 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0fe4260c-811c-4843-a0b8-ba342e7536b9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:53.782304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279aab52-1121-4cb3-90a2-190f38db945c req-2c54aaff-d56e-4e25-b229-02466cadfce3 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:53.784067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-279aab52-1121-4cb3-90a2-190f38db945c req-2c54aaff-d56e-4e25-b229-02466cadfce3 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 945 time: 0.5743389 May 12 15:25:53.873485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Pushing event updated for resources: {'Port': ['ID=64936beb-03d4-4182-81be-074a96507608,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:53.957829 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:53.994434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e59af3b-d250-4400-bf01-8e41b04fbdb2 req-4adeabb2-3a78-40a5-851c-ebdf37fe7126 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:53.997976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e59af3b-d250-4400-bf01-8e41b04fbdb2 req-4adeabb2-3a78-40a5-851c-ebdf37fe7126 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e5a10df576841e2a4752a9d47fb790a&device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 1095 time: 0.5671458 May 12 15:25:54.002752 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=82b1a321-6a8f-4285-8002-cdef4cd9cfdb,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:54.009410 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:54.067929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-279aab52-1121-4cb3-90a2-190f38db945c req-1c854e10-44de-4a36-be0e-8ec572e83e5d tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2721364 May 12 15:25:54.108857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Attempting to bind port 64936beb-03d4-4182-81be-074a96507608 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:25:54.110571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Attempting to bind port 64936beb-03d4-4182-81be-074a96507608 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:25:54.111487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Attempting to bind port 64936beb-03d4-4182-81be-074a96507608 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:54.120567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282'}, {'server_uuid': 'd270cb8f-b1c9-42ca-9c3e-d51f878d58ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '82b1a321-6a8f-4285-8002-cdef4cd9cfdb'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:54.126029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Port 64936beb-03d4-4182-81be-074a96507608 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:25:54.127025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Attempting to bind port 64936beb-03d4-4182-81be-074a96507608 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:25:54.152818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 25, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:25:54.153158 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Checking segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:25:54.153578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Bound using segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:25:54.154023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Bound port: 64936beb-03d4-4182-81be-074a96507608, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:25:54.154392 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:54.191261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=82b1a321-6a8f-4285-8002-cdef4cd9cfdb,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:54.333672 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0fe4260c-811c-4843-a0b8-ba342e7536b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:54.404777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe4260c-811c-4843-a0b8-ba342e7536b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eaea63d8-0949-4fc8-90da-3328c712d6fb,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:54.420042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] For port 64936beb-03d4-4182-81be-074a96507608, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:25:54.429576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] For port 64936beb-03d4-4182-81be-074a96507608, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=64936beb-03d4-4182-81be-074a96507608,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:25:54.430886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e59af3b-d250-4400-bf01-8e41b04fbdb2 req-fda0e2e1-0463-45f2-8c62-c939c8f4fee4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:54.433808 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e59af3b-d250-4400-bf01-8e41b04fbdb2 req-fda0e2e1-0463-45f2-8c62-c939c8f4fee4 service neutron] 10.222.0.84 "GET /v2.0/networks?id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61 HTTP/1.1" status: 200 len: 914 time: 0.4100780 May 12 15:25:54.438605 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0fe4260c-811c-4843-a0b8-ba342e7536b9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:54.440226 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0fe4260c-811c-4843-a0b8-ba342e7536b9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/eaea63d8-0949-4fc8-90da-3328c712d6fb HTTP/1.1" status: 204 len: 168 time: 1.4441113 May 12 15:25:54.463225 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:54.577471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e59af3b-d250-4400-bf01-8e41b04fbdb2 req-f46ac279-f303-4efc-9e60-a23d99ca3ca0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f HTTP/1.1" status: 200 len: 217 time: 0.1358633 May 12 15:25:54.595567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c49a693-7822-4d3a-bbd7-81feae3ae5c1 req-db240faf-b4aa-43bc-902f-0f02be0c09ed tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:54.603683 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c49a693-7822-4d3a-bbd7-81feae3ae5c1 req-db240faf-b4aa-43bc-902f-0f02be0c09ed tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 943 time: 0.6919067 May 12 15:25:54.731967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:54.731967 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:54.733288 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] 10.222.0.84 "PUT /v2.0/ports/64936beb-03d4-4182-81be-074a96507608 HTTP/1.1" status: 200 len: 1091 time: 4.3328748 May 12 15:25:54.733997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86a3054b-0feb-4f40-928f-228417bb8bee service neutron] Pushing event updated for resources: {'Port': ['ID=64936beb-03d4-4182-81be-074a96507608,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:54.747924 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '12215d44-186e-4901-81f8-0c2cf89b7793', 'tag': '64936beb-03d4-4182-81be-074a96507608'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:54.772767 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c49a693-7822-4d3a-bbd7-81feae3ae5c1 req-ff442a61-cb7c-43e5-9ba8-b153b6ba1a0a tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1679962 May 12 15:25:54.815700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c748357-4651-4d1a-840b-da304db81ab5 req-578eebaa-59c6-41c5-916d-27c2d331eb15 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:54.827978 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c748357-4651-4d1a-840b-da304db81ab5 req-578eebaa-59c6-41c5-916d-27c2d331eb15 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.5591159 May 12 15:25:54.878275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e59af3b-d250-4400-bf01-8e41b04fbdb2 req-ede772c4-97e1-4f44-9fbd-7236034bf5b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:54.883182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e59af3b-d250-4400-bf01-8e41b04fbdb2 req-ede772c4-97e1-4f44-9fbd-7236034bf5b9 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c90f4328-5e3e-4311-a3b6-84cff19a6919 HTTP/1.1" status: 200 len: 853 time: 0.2746344 May 12 15:25:54.918093 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e560663a-fa4d-4fdc-ba38-56f193b1f7f8'] response: {'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'code': 200} May 12 15:25:54.918977 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e560663a-fa4d-4fdc-ba38-56f193b1f7f8'] response: {'server_uuid': 'd270cb8f-b1c9-42ca-9c3e-d51f878d58ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '82b1a321-6a8f-4285-8002-cdef4cd9cfdb', 'code': 200} May 12 15:25:54.922556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-a6bcdf27-3954-4170-95b8-113d7cc61d96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:54.926608 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-a6bcdf27-3954-4170-95b8-113d7cc61d96 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 1094 time: 0.1128840 May 12 15:25:55.006191 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e59af3b-d250-4400-bf01-8e41b04fbdb2 req-5e0a2b58-09f8-4746-ae5d-e99b4d9867ba service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1157334 May 12 15:25:55.030671 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c748357-4651-4d1a-840b-da304db81ab5 req-b394fb1f-75e0-42ca-9100-c67c86af80cf tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2014134 May 12 15:25:55.147892 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-3c9d9c37-d660-41a2-9c25-5d6b17abcd02 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=64936beb-03d4-4182-81be-074a96507608 HTTP/1.1" status: 200 len: 217 time: 0.1632519 May 12 15:25:55.275829 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6d5c8390-2d0f-4511-8de9-6773837b4cf8'] response: {'name': 'network-changed', 'server_uuid': '12215d44-186e-4901-81f8-0c2cf89b7793', 'tag': '64936beb-03d4-4182-81be-074a96507608', 'status': 'completed', 'code': 200} May 12 15:25:55.282184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-d4062433-c534-47a6-bc58-a3dd9ad5d72a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:55.283657 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-d4062433-c534-47a6-bc58-a3dd9ad5d72a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.1222219 May 12 15:25:55.369074 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-688cc385-c23f-4823-a32b-f0ad1f69065e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0703659 May 12 15:25:55.595729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8a90c54-6277-42f0-b526-c6b23eac587a req-5f665de2-2b75-417c-bc0e-bed1ad7426b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:55.599118 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8a90c54-6277-42f0-b526-c6b23eac587a req-5f665de2-2b75-417c-bc0e-bed1ad7426b9 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=d270cb8f-b1c9-42ca-9c3e-d51f878d58ee HTTP/1.1" status: 200 len: 1096 time: 0.5114601 May 12 15:25:55.726569 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-6c8c7387-387c-46b1-b6ba-0c34df5ab81e service neutron] 10.222.0.84 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3480351 May 12 15:25:55.793773 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8a90c54-6277-42f0-b526-c6b23eac587a req-15524694-8139-4aad-bf18-40c15d5b5cd6 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1869314 May 12 15:25:55.853479 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e59af3b-d250-4400-bf01-8e41b04fbdb2 req-8d69b5ee-2b96-4630-a35f-943949db17cb service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8383071 May 12 15:25:55.877607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9bf6b89-6a63-4154-b5c1-64bb9c80025f req-bdf3268b-f720-4ecc-bda2-753b23730876 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:55.885780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9bf6b89-6a63-4154-b5c1-64bb9c80025f req-bdf3268b-f720-4ecc-bda2-753b23730876 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.4315078 May 12 15:25:55.950597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97e37d59-e817-463c-ad21-5e9e016d7903 req-c71adde7-5ee8-4152-a347-5d43103a3d6f tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:55.959695 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-97e37d59-e817-463c-ad21-5e9e016d7903 req-c71adde7-5ee8-4152-a347-5d43103a3d6f tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 945 time: 0.2976837 May 12 15:25:56.014429 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9bf6b89-6a63-4154-b5c1-64bb9c80025f req-73e94a3b-bfd2-403f-bd50-e9fb557dc347 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1259711 May 12 15:25:56.070753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-97e37d59-e817-463c-ad21-5e9e016d7903 req-fd47f9a1-5519-4fad-9b19-330a56cca89c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1099761 May 12 15:25:56.109165 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-50b7e870-faa2-48eb-b5cf-071a5af5a437 req-4dd067ab-f235-4053-af7f-50e35194aa8b service neutron] 10.222.0.84 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3612299 May 12 15:25:56.247094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device ca8260ac-22c8-4968-9ce8-5404534a00c8 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:25:56.489070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port ca8260ac-22c8-4968-9ce8-5404534a00c8 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:25:56.495974 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port ca8260ac-22c8-4968-9ce8-5404534a00c8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:25:56.496789 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:56.541951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6cd9c36-7a94-44e1-8e60-30e081a0d656 req-6da84550-fb2e-4b6a-ac42-58aa9c3c8624 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:56.545791 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6cd9c36-7a94-44e1-8e60-30e081a0d656 req-6da84550-fb2e-4b6a-ac42-58aa9c3c8624 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 1094 time: 0.2950912 May 12 15:25:56.670206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e59af3b-d250-4400-bf01-8e41b04fbdb2 req-eccab86a-efe0-4d78-b5b3-ce6da6efb652 service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5769048 May 12 15:25:56.723091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be69246-bfe7-4192-a282-545ba5aecaa0 req-ebe14ad2-1751-4787-bf7b-8b66725e98ff tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:56.724680 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0be69246-bfe7-4192-a282-545ba5aecaa0 req-ebe14ad2-1751-4787-bf7b-8b66725e98ff tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.4669592 May 12 15:25:56.864308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24944f34-fe8d-4176-9215-dff69f0862d8 req-bc049d10-26ea-41b2-9479-08f06ad8099c tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:56.879106 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24944f34-fe8d-4176-9215-dff69f0862d8 req-bc049d10-26ea-41b2-9479-08f06ad8099c tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 943 time: 0.4957561 May 12 15:25:56.920879 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:57.040680 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fb219e29-6ed8-4f1b-98dc-8002eaaece2e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ca8260ac-22c8-4968-9ce8-5404534a00c8'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:25:57.052783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6cd9c36-7a94-44e1-8e60-30e081a0d656 req-627ac083-b6ca-4f31-8884-61c2c2ad6935 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:57.054547 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6cd9c36-7a94-44e1-8e60-30e081a0d656 req-627ac083-b6ca-4f31-8884-61c2c2ad6935 service neutron] 10.222.0.84 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 913 time: 0.4982071 May 12 15:25:57.059680 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port ca8260ac-22c8-4968-9ce8-5404534a00c8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=ca8260ac-22c8-4968-9ce8-5404534a00c8,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:57.061424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0be69246-bfe7-4192-a282-545ba5aecaa0 req-8dc5995e-b1df-4630-ae59-4f4beb493e57 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.3073630 May 12 15:25:57.071144 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:57.118155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-24944f34-fe8d-4176-9215-dff69f0862d8 req-e87dedb8-64dd-47b8-b696-14fe34d86967 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2372255 May 12 15:25:57.295980 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fbc4dbdd-588b-4229-872e-e1c9bf0ad43c'] response: {'server_uuid': 'fb219e29-6ed8-4f1b-98dc-8002eaaece2e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ca8260ac-22c8-4968-9ce8-5404534a00c8', 'code': 200} May 12 15:25:57.355417 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6cd9c36-7a94-44e1-8e60-30e081a0d656 req-3d08c455-64d2-4659-a8e0-8834bbb9738e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=64936beb-03d4-4182-81be-074a96507608 HTTP/1.1" status: 200 len: 217 time: 0.2755234 May 12 15:25:57.388344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=ca8260ac-22c8-4968-9ce8-5404534a00c8,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:57.519424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6cd9c36-7a94-44e1-8e60-30e081a0d656 req-29f456ed-78e4-42b5-9c95-ad6c27f30f05 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:57.521183 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6cd9c36-7a94-44e1-8e60-30e081a0d656 req-29f456ed-78e4-42b5-9c95-ad6c27f30f05 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.1586175 May 12 15:25:57.676045 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6cd9c36-7a94-44e1-8e60-30e081a0d656 req-ea4b6c61-7ac7-4263-84c0-5342ffc0850b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1462703 May 12 15:25:57.910141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d5908f2-ff72-455f-998a-be5d85d5f91e req-d3168198-f6d8-4659-b8f0-a5ecd6a788fb tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:57.933575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d5908f2-ff72-455f-998a-be5d85d5f91e req-d3168198-f6d8-4659-b8f0-a5ecd6a788fb tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.5953755 May 12 15:25:58.027160 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6cd9c36-7a94-44e1-8e60-30e081a0d656 req-6767e45c-12c1-4d48-bc10-419515f08d7d service neutron] 10.222.0.84 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3422866 May 12 15:25:58.101689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d5908f2-ff72-455f-998a-be5d85d5f91e req-18ced400-6b9f-4993-98ad-e20eaa0b77f4 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1666169 May 12 15:25:58.129314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb3f0823-0ccb-43c4-b930-557db5707547 req-31e53487-24e9-4b24-bb32-20f5d920f5d3 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:58.147281 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb3f0823-0ccb-43c4-b930-557db5707547 req-31e53487-24e9-4b24-bb32-20f5d920f5d3 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 946 time: 0.5376558 May 12 15:25:58.251233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b84b20-5897-49fc-96ab-663ac90679e3 req-aff63ac5-d687-4d25-94c0-2bc0065289e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:58.259146 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33b84b20-5897-49fc-96ab-663ac90679e3 req-aff63ac5-d687-4d25-94c0-2bc0065289e7 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 1097 time: 0.7665975 May 12 15:25:58.294063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 64936beb-03d4-4182-81be-074a96507608 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:25:58.333896 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6cd9c36-7a94-44e1-8e60-30e081a0d656 req-3126d8a4-7811-4f25-9443-a7a6a7ed2588 service neutron] 10.222.0.84 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2942295 May 12 15:25:58.418623 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb3f0823-0ccb-43c4-b930-557db5707547 req-5c3f65ab-0550-4159-abdf-b1584a581893 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2538853 May 12 15:25:58.612599 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33b84b20-5897-49fc-96ab-663ac90679e3 req-3e64531b-3316-4165-a40b-d8ae04b5e70f service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3448315 May 12 15:25:58.727829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d88a95a7-d299-4248-836a-531773b85821 req-41e1a61f-e75b-4660-8f7d-de704950b883 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:58.741889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d88a95a7-d299-4248-836a-531773b85821 req-41e1a61f-e75b-4660-8f7d-de704950b883 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.2992070 May 12 15:25:58.767615 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 64936beb-03d4-4182-81be-074a96507608, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=64936beb-03d4-4182-81be-074a96507608,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:58.802681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '64936beb-03d4-4182-81be-074a96507608', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'port_id': '64936beb-03d4-4182-81be-074a96507608', 'mac_address': 'fa:16:3e:cb:c5:b8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 573, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0ff5192a-946b-4444-900a-788b8ddc74b6', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:25:58.859723 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d88a95a7-d299-4248-836a-531773b85821 req-a1146eca-38a1-4228-920b-dd8ccd25874e tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1168354 May 12 15:25:58.980803 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:59.007405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 64936beb-03d4-4182-81be-074a96507608 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:25:59.029678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 64936beb-03d4-4182-81be-074a96507608, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=64936beb-03d4-4182-81be-074a96507608,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:25:59.034819 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:25:59.115954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88d0d74f-05da-4e25-8cc6-8c409cdfee98 req-d1cc0d20-c4fc-4556-8ba7-88cef7f9116a tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:59.124405 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88d0d74f-05da-4e25-8cc6-8c409cdfee98 req-d1cc0d20-c4fc-4556-8ba7-88cef7f9116a tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 943 time: 0.2575102 May 12 15:25:59.145285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=64936beb-03d4-4182-81be-074a96507608,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:25:59.241992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88d0d74f-05da-4e25-8cc6-8c409cdfee98 req-d151853c-6748-4867-ad49-b3361f1834af tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1161919 May 12 15:25:59.467221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ab2d59-a4c3-467c-9755-bef2878f9f94 req-462bbac7-6533-49dc-8dd7-6e0d7b61044f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:59.478062 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89ab2d59-a4c3-467c-9755-bef2878f9f94 req-462bbac7-6533-49dc-8dd7-6e0d7b61044f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.1179001 May 12 15:25:59.494058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['64936beb-03d4-4182-81be-074a96507608'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:25:59.543203 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89ab2d59-a4c3-467c-9755-bef2878f9f94 req-fd2a0bc8-92bd-4f83-b652-fd6ff864127f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0639348 May 12 15:25:59.842024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c92e9b35-ca21-49e9-b82c-91303525b34f req-ad061831-583c-4129-af83-e9a139d67820 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:25:59.849218 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c92e9b35-ca21-49e9-b82c-91303525b34f req-ad061831-583c-4129-af83-e9a139d67820 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 946 time: 0.1669521 May 12 15:25:59.975578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c92e9b35-ca21-49e9-b82c-91303525b34f req-479ce747-b430-46dd-a0a7-6c7effc47ec2 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1250100 May 12 15:26:00.347095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0102c16-2b18-4ad6-9d9a-96a2f10ecb0c req-5f5f1799-aa05-4760-a426-ceb6f983abeb tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:00.356094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0102c16-2b18-4ad6-9d9a-96a2f10ecb0c req-5f5f1799-aa05-4760-a426-ceb6f983abeb tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.2723644 May 12 15:26:00.436897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0102c16-2b18-4ad6-9d9a-96a2f10ecb0c req-805d2f74-6835-4769-b2a6-8415824042c5 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0771885 May 12 15:26:00.582465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df9373f1-ef99-4516-a47d-369a8f2f5277 req-8bd8ff8e-54bb-4898-98d0-efb8c1b63b43 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:00.586318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df9373f1-ef99-4516-a47d-369a8f2f5277 req-8bd8ff8e-54bb-4898-98d0-efb8c1b63b43 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 944 time: 0.1477101 May 12 15:26:00.680059 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-df9373f1-ef99-4516-a47d-369a8f2f5277 req-cc9a3cb3-ce6a-421e-b3bd-fa2a4a59c65f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0862455 May 12 15:26:00.988948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f8bdee-e126-4fca-95b8-428b3df6a60f req-0b48cabc-c35d-4be9-8a8d-3b7adf1bd590 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:01.000698 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05f8bdee-e126-4fca-95b8-428b3df6a60f req-0b48cabc-c35d-4be9-8a8d-3b7adf1bd590 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.1361520 May 12 15:26:01.074232 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05f8bdee-e126-4fca-95b8-428b3df6a60f req-633fcbc5-f5a6-4112-88da-1b6851028fca tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0722332 May 12 15:26:01.477562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138df2de-de67-4c5d-a53b-8039d867cd3a req-616da611-e3dd-40fb-81ab-913cc1846bb6 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:01.489156 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-138df2de-de67-4c5d-a53b-8039d867cd3a req-616da611-e3dd-40fb-81ab-913cc1846bb6 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 946 time: 0.2279365 May 12 15:26:01.863221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-138df2de-de67-4c5d-a53b-8039d867cd3a req-574af132-acbc-45c7-a38a-6fcbfb4fc24a tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3727133 May 12 15:26:01.931523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca40d033-d964-46a8-9718-dadf311e9067 req-2e19e15c-70f8-4d7c-a41f-7af5e0f78ebd tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:01.946812 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca40d033-d964-46a8-9718-dadf311e9067 req-2e19e15c-70f8-4d7c-a41f-7af5e0f78ebd tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.2043238 May 12 15:26:02.063402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca40d033-d964-46a8-9718-dadf311e9067 req-f70defa0-6942-4a44-855d-b23585b21768 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1148770 May 12 15:26:02.312387 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:02.325014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 64936beb-03d4-4182-81be-074a96507608 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:26:02.363360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac99326d-5fe3-450f-b5af-ddff537e6e98 req-37749a5f-d1dd-47a9-a230-ce63a3c60e47 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:02.370996 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac99326d-5fe3-450f-b5af-ddff537e6e98 req-37749a5f-d1dd-47a9-a230-ce63a3c60e47 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 944 time: 0.2772169 May 12 15:26:02.544288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 64936beb-03d4-4182-81be-074a96507608 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:26:02.552223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 64936beb-03d4-4182-81be-074a96507608 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:26:02.552732 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:02.648300 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ac99326d-5fe3-450f-b5af-ddff537e6e98 req-7291cdd2-4ec9-424e-a08a-7f264682f45e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2759712 May 12 15:26:02.694184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e532996d-fe67-42ee-9bf0-3dade1d12dcb req-e754b687-63e4-4438-b985-934ca152c2c0 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:02.705575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e532996d-fe67-42ee-9bf0-3dade1d12dcb req-e754b687-63e4-4438-b985-934ca152c2c0 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32 HTTP/1.1" status: 200 len: 945 time: 0.3711889 May 12 15:26:02.817076 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e532996d-fe67-42ee-9bf0-3dade1d12dcb req-db77c86e-f37a-414f-96b8-2ceb000a9a53 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1103282 May 12 15:26:02.939843 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:03.007665 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 64936beb-03d4-4182-81be-074a96507608, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=64936beb-03d4-4182-81be-074a96507608,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:03.008624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '12215d44-186e-4901-81f8-0c2cf89b7793', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '64936beb-03d4-4182-81be-074a96507608'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:26:03.019178 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:03.118643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6dd902-7154-491a-ab30-f612cce8383f req-24e27c13-f183-4f9e-b5f2-3b818e52c0c7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:03.126608 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c6dd902-7154-491a-ab30-f612cce8383f req-24e27c13-f183-4f9e-b5f2-3b818e52c0c7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.2646425 May 12 15:26:03.173466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=64936beb-03d4-4182-81be-074a96507608,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:03.201609 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c6dd902-7154-491a-ab30-f612cce8383f req-6b0d324b-e08c-413a-a76a-6e7fae46b385 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0736392 May 12 15:26:03.241199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c00ee96-172b-4b47-9959-053be6b5e10c req-769611fa-42d4-4538-a08c-e93346ea0f94 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:03.261575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c00ee96-172b-4b47-9959-053be6b5e10c req-769611fa-42d4-4538-a08c-e93346ea0f94 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=d270cb8f-b1c9-42ca-9c3e-d51f878d58ee HTTP/1.1" status: 200 len: 945 time: 0.2444351 May 12 15:26:03.314365 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-73d2ec86-2a14-452b-9178-fbecbc0e0df2'] response: {'server_uuid': '12215d44-186e-4901-81f8-0c2cf89b7793', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '64936beb-03d4-4182-81be-074a96507608', 'code': 200} May 12 15:26:03.332457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c00ee96-172b-4b47-9959-053be6b5e10c req-3bb10804-723d-4f59-aeec-6e5923bdf91a tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694973 May 12 15:26:03.692232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8d56261-12e6-49ed-8ef5-0d8e23d5b711 req-f8009bf6-4e0d-48a7-867b-7ec170811032 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:03.694642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e8d56261-12e6-49ed-8ef5-0d8e23d5b711 req-f8009bf6-4e0d-48a7-867b-7ec170811032 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 1096 time: 0.2342722 May 12 15:26:03.717529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71ac0118-9dfe-4ea4-8899-3f9a82d0ea21 req-fa148e9e-7584-449e-b39d-2f22f85dbbac tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:03.726219 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71ac0118-9dfe-4ea4-8899-3f9a82d0ea21 req-fa148e9e-7584-449e-b39d-2f22f85dbbac tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.1617546 May 12 15:26:03.822620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71ac0118-9dfe-4ea4-8899-3f9a82d0ea21 req-4e2f99f3-3071-40a2-9060-a5c08a3ec51e tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0950916 May 12 15:26:04.044012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e8d56261-12e6-49ed-8ef5-0d8e23d5b711 req-2bd2f8f1-86e3-441e-a090-ffbf99554e8c service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2742496 May 12 15:26:04.164851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-effb3539-973d-4fde-90f7-3075aad4dc70 req-e67da2bd-5b0d-4bd0-be54-92a02c8a9985 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:04.172611 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-effb3539-973d-4fde-90f7-3075aad4dc70 req-e67da2bd-5b0d-4bd0-be54-92a02c8a9985 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=d270cb8f-b1c9-42ca-9c3e-d51f878d58ee HTTP/1.1" status: 200 len: 945 time: 0.1220157 May 12 15:26:04.225248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-415a6a82-b207-4da9-aa50-199c19c53d7a req-c3ce9560-2e80-40fc-a8b3-5d1fbd058db5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:04.232605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-415a6a82-b207-4da9-aa50-199c19c53d7a req-c3ce9560-2e80-40fc-a8b3-5d1fbd058db5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.3503606 May 12 15:26:04.262414 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-effb3539-973d-4fde-90f7-3075aad4dc70 req-e6085e16-9dad-4802-824f-2f5fe97145d6 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0887771 May 12 15:26:04.348333 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-415a6a82-b207-4da9-aa50-199c19c53d7a req-7fbc6b9e-0ea4-4f18-b323-cfc72c4e9542 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1147537 May 12 15:26:04.527497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adfb462c-889c-4376-adfa-11ccde214b40 req-29d1f741-b6e8-4fec-b8cf-7a03b4336639 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:04.535143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-adfb462c-889c-4376-adfa-11ccde214b40 req-29d1f741-b6e8-4fec-b8cf-7a03b4336639 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.1208949 May 12 15:26:04.589766 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-adfb462c-889c-4376-adfa-11ccde214b40 req-d6a8e0c5-b566-415a-a8b1-052a69000bd2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533352 May 12 15:26:05.274019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31160af8-7a5d-4614-ae5e-8af5826636cc req-5f0b749b-c70b-4d86-9a1e-5bde90d3a061 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:05.297961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31160af8-7a5d-4614-ae5e-8af5826636cc req-5f0b749b-c70b-4d86-9a1e-5bde90d3a061 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.1744452 May 12 15:26:05.415420 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31160af8-7a5d-4614-ae5e-8af5826636cc req-6d458918-3764-48ad-ab41-440a30e8c417 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1146529 May 12 15:26:05.774594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba625f51-0fe8-4bff-9a82-d2a2cf5ea7c8 req-2b2e1c42-10e9-4ae6-aea2-f9d0d95f018c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:05.777051 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba625f51-0fe8-4bff-9a82-d2a2cf5ea7c8 req-2b2e1c42-10e9-4ae6-aea2-f9d0d95f018c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=d270cb8f-b1c9-42ca-9c3e-d51f878d58ee HTTP/1.1" status: 200 len: 945 time: 0.2719879 May 12 15:26:05.827008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e6f21a-0c34-448c-9214-d379ef13b017 req-86b802f4-920e-4b3a-bda8-a513cd94b3b8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:05.828497 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48e6f21a-0c34-448c-9214-d379ef13b017 req-86b802f4-920e-4b3a-bda8-a513cd94b3b8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.1740749 May 12 15:26:05.896779 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba625f51-0fe8-4bff-9a82-d2a2cf5ea7c8 req-00a5a1ea-827c-489e-b909-ad2a0d7280a5 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1113288 May 12 15:26:05.958586 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48e6f21a-0c34-448c-9214-d379ef13b017 req-e6b20574-66ce-4388-a0d1-119d503727ce tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0869718 May 12 15:26:06.167255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc37bc0d-7812-44fd-badf-036704adf1e4 req-85bc04e3-729c-473e-b916-ca8f163642e3 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:06.175342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc37bc0d-7812-44fd-badf-036704adf1e4 req-85bc04e3-729c-473e-b916-ca8f163642e3 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.1408241 May 12 15:26:06.289968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc37bc0d-7812-44fd-badf-036704adf1e4 req-3a0c8f00-ec07-4835-84ca-81b56da0b445 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1133571 May 12 15:26:06.780771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab17e6c-9c84-4b2e-9ff6-e1ce1b3ae186 req-973d85d6-bdf7-4437-a8a5-308010ad6a84 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:06.787298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bab17e6c-9c84-4b2e-9ff6-e1ce1b3ae186 req-973d85d6-bdf7-4437-a8a5-308010ad6a84 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.1582663 May 12 15:26:06.881893 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bab17e6c-9c84-4b2e-9ff6-e1ce1b3ae186 req-0a8cbacb-fe68-40ae-a392-70480c473e39 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0695622 May 12 15:26:07.256766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f66270a8-85fb-41b6-ae2c-8c7d5a0c9300 req-55d1696b-7eca-4e35-85ea-c2c747ff5862 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:07.258445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f66270a8-85fb-41b6-ae2c-8c7d5a0c9300 req-55d1696b-7eca-4e35-85ea-c2c747ff5862 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=d270cb8f-b1c9-42ca-9c3e-d51f878d58ee HTTP/1.1" status: 200 len: 945 time: 0.2036467 May 12 15:26:07.284464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8560c1a8-38d4-427b-95b2-581285815da2 req-dcee52f4-2757-41b4-b3e6-18ddc7b96722 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:07.286214 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8560c1a8-38d4-427b-95b2-581285815da2 req-dcee52f4-2757-41b4-b3e6-18ddc7b96722 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.1460824 May 12 15:26:07.430337 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8560c1a8-38d4-427b-95b2-581285815da2 req-cc9e3528-266b-4482-855b-ff77cb1c769b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1181009 May 12 15:26:07.473371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f66270a8-85fb-41b6-ae2c-8c7d5a0c9300 req-82a793d5-2281-445f-8b8a-a49c820b3c7e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2077885 May 12 15:26:08.066854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87d38ec8-00b8-4ac0-8f30-1809fbf62adf req-415208dd-0894-4ef5-bd8e-255838659984 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:08.071855 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87d38ec8-00b8-4ac0-8f30-1809fbf62adf req-415208dd-0894-4ef5-bd8e-255838659984 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.3777604 May 12 15:26:08.334396 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87d38ec8-00b8-4ac0-8f30-1809fbf62adf req-25bee9ce-ad11-496e-bf20-67cfca2768bc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2577834 May 12 15:26:08.401559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e45741c0-17ee-47b2-95b2-4e1521e0e62a req-5a8c56cd-ec19-4510-b98a-967197b87bd8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:08.404461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e45741c0-17ee-47b2-95b2-4e1521e0e62a req-5a8c56cd-ec19-4510-b98a-967197b87bd8 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.2496080 May 12 15:26:08.548159 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e45741c0-17ee-47b2-95b2-4e1521e0e62a req-4ef87515-5c5b-4f30-9845-16fb2f40f027 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1388261 May 12 15:26:09.065991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d55466af-57b0-4ca4-b42b-7c946b1cd3a4 req-9f189ab8-682a-4f75-8e44-9ad154093f3f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:09.067643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d55466af-57b0-4ca4-b42b-7c946b1cd3a4 req-9f189ab8-682a-4f75-8e44-9ad154093f3f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.4323173 May 12 15:26:09.115039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-824d8f3f-4d81-44b4-8b46-7ff7fb7fd2f3 req-07743365-8387-4e94-9f55-6be40dd72b64 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:09.122993 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-824d8f3f-4d81-44b4-8b46-7ff7fb7fd2f3 req-07743365-8387-4e94-9f55-6be40dd72b64 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=d270cb8f-b1c9-42ca-9c3e-d51f878d58ee HTTP/1.1" status: 200 len: 945 time: 0.3036125 May 12 15:26:09.156833 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d55466af-57b0-4ca4-b42b-7c946b1cd3a4 req-b1cda2cb-e341-4c35-ac39-4349f58f33af tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0787683 May 12 15:26:09.203746 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-824d8f3f-4d81-44b4-8b46-7ff7fb7fd2f3 req-c8301737-3a7c-4286-8ff9-feac4487be8b tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0796638 May 12 15:26:09.779059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1971829-46b3-4d1b-ba3b-4649c45a23ee req-93f98943-3fca-4679-b290-5d4dd4accd71 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:09.781149 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1971829-46b3-4d1b-ba3b-4649c45a23ee req-93f98943-3fca-4679-b290-5d4dd4accd71 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.2185431 May 12 15:26:09.849843 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1971829-46b3-4d1b-ba3b-4649c45a23ee req-418c31a0-7813-4f12-a9bb-00e4188732b0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593135 May 12 15:26:09.874536 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:26:10.546256 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29ae7863-d500-4700-a9d7-38c5ac57196e req-a94a2106-eddd-4b8d-9cf3-d3f40544b528 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:10.569587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29ae7863-d500-4700-a9d7-38c5ac57196e req-a94a2106-eddd-4b8d-9cf3-d3f40544b528 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.3587694 May 12 15:26:10.678655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29ae7863-d500-4700-a9d7-38c5ac57196e req-e90af795-5f3f-47f8-a481-4e396d9171f6 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1077650 May 12 15:26:11.164930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62c99940-f434-4bb6-9c57-cba7dcf5f86a req-70671b11-6494-4b4e-930d-da734fcdc6a4 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:11.180531 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62c99940-f434-4bb6-9c57-cba7dcf5f86a req-70671b11-6494-4b4e-930d-da734fcdc6a4 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=d270cb8f-b1c9-42ca-9c3e-d51f878d58ee HTTP/1.1" status: 200 len: 945 time: 0.2882249 May 12 15:26:11.339924 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62c99940-f434-4bb6-9c57-cba7dcf5f86a req-ad061bdd-6489-4b02-ab8b-76f51da700b4 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1585269 May 12 15:26:11.695345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c24fb01-6882-41b9-b508-c8b8dac70d68 req-f8293a0f-8256-4ba8-980b-7e2dc6b39732 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:11.697884 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c24fb01-6882-41b9-b508-c8b8dac70d68 req-f8293a0f-8256-4ba8-980b-7e2dc6b39732 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.1563096 May 12 15:26:11.814163 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c24fb01-6882-41b9-b508-c8b8dac70d68 req-aca501ba-c089-45a1-994e-5cef445c1296 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1097009 May 12 15:26:12.029908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7e20f4-ced4-4ba3-aa34-6579b1a0de56 req-74d1c5c6-7414-4f77-843c-168cdafd6dcc tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:12.031619 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a7e20f4-ced4-4ba3-aa34-6579b1a0de56 req-74d1c5c6-7414-4f77-843c-168cdafd6dcc tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.0975821 May 12 15:26:12.080782 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a7e20f4-ced4-4ba3-aa34-6579b1a0de56 req-64657e05-5975-4386-aec6-62b99f7c1226 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435126 May 12 15:26:12.386121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0ce28f36-b32c-468c-81e3-0dd235e15282 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:26:12.550981 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:12.583062 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:26:12.597372 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0ce28f36-b32c-468c-81e3-0dd235e15282,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:12.603548 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:12.653174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c26f400e-9bc2-4a45-b553-c8487342aecb req-15ddd444-9c81-4b6e-a81a-f54c11819def tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:12.654875 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c26f400e-9bc2-4a45-b553-c8487342aecb req-15ddd444-9c81-4b6e-a81a-f54c11819def tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 946 time: 0.1919191 May 12 15:26:12.702309 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-493fc723-bc5f-40e7-bcfd-f395596bd71b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:12.704231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e6b4188-ef00-486b-be5f-5d1468772ccc req-56e4acf8-2abf-4dc2-986c-02c86742ea81 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:12.706021 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e6b4188-ef00-486b-be5f-5d1468772ccc req-56e4acf8-2abf-4dc2-986c-02c86742ea81 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1619575 May 12 15:26:12.707721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=0ce28f36-b32c-468c-81e3-0dd235e15282,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:12.754376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c26f400e-9bc2-4a45-b553-c8487342aecb req-b0cc84ea-e60d-4a1c-955d-77478986c274 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0907180 May 12 15:26:12.802085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e6b4188-ef00-486b-be5f-5d1468772ccc req-06919711-fada-4978-8a26-723512fcdeb6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0719705 May 12 15:26:12.949027 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:13.083630 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f3840a8-7beb-43e4-8d31-63235c15f34b req-d5de2a8c-4475-40c1-ad3e-bda63a8bc5c9 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:13.105804 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f3840a8-7beb-43e4-8d31-63235c15f34b req-d5de2a8c-4475-40c1-ad3e-bda63a8bc5c9 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1487811 May 12 15:26:13.132466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54e11e4-71a1-4ecb-9b51-c8e54b31cfab req-fcb25eda-02d7-4705-bb20-317a4be08b92 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:13.133882 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a54e11e4-71a1-4ecb-9b51-c8e54b31cfab req-fcb25eda-02d7-4705-bb20-317a4be08b92 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.2241728 May 12 15:26:13.183975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f3840a8-7beb-43e4-8d31-63235c15f34b req-d0d94980-241e-4585-9cee-87015daed083 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0772803 May 12 15:26:13.205490 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a54e11e4-71a1-4ecb-9b51-c8e54b31cfab req-e2e02a8d-f7ce-4e8a-beef-ee2506d47dcc tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630393 May 12 15:26:13.309517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f59c14-e32b-46a8-9924-c6719e69224b req-00677841-72ff-458c-b4cb-ccee3c1b6d45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:13.314148 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03f59c14-e32b-46a8-9924-c6719e69224b req-00677841-72ff-458c-b4cb-ccee3c1b6d45 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=40852c97262142aeb6d62097955af83f&device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 1095 time: 0.1033847 May 12 15:26:13.326285 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f3c7940d-fc91-4c48-a529-dd0a14a2526e'] response: {'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'code': 200} May 12 15:26:13.553421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec7cbdf-5b2b-4da3-b8b0-b615d329bb7a req-e80a611a-f32a-4bb8-a3c8-ddf46a8f9178 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:13.554885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-4ec7cbdf-5b2b-4da3-b8b0-b615d329bb7a req-e80a611a-f32a-4bb8-a3c8-ddf46a8f9178 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Synchronizing usage tracker for tenant:61d51b592d944a47ba438d18c03cb747 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:26:13.576392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-4ec7cbdf-5b2b-4da3-b8b0-b615d329bb7a req-e80a611a-f32a-4bb8-a3c8-ddf46a8f9178 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Unset dirty status for tenant:61d51b592d944a47ba438d18c03cb747 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:26:13.578935 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4ec7cbdf-5b2b-4da3-b8b0-b615d329bb7a req-e80a611a-f32a-4bb8-a3c8-ddf46a8f9178 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.84 "GET /v2.0/ports?device_id=d270cb8f-b1c9-42ca-9c3e-d51f878d58ee HTTP/1.1" status: 200 len: 945 time: 0.1293790 May 12 15:26:13.646879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f59c14-e32b-46a8-9924-c6719e69224b req-e378e20b-0a24-41d9-9863-20f80b78520c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:13.648914 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03f59c14-e32b-46a8-9924-c6719e69224b req-e378e20b-0a24-41d9-9863-20f80b78520c service neutron] 10.222.0.84 "GET /v2.0/networks?id=2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 200 len: 918 time: 0.3247199 May 12 15:26:13.725871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-4ec7cbdf-5b2b-4da3-b8b0-b615d329bb7a req-b5359130-c564-4b6e-93e7-ac0e784f2699 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Deleting port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:26:13.726598 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4ec7cbdf-5b2b-4da3-b8b0-b615d329bb7a req-b5359130-c564-4b6e-93e7-ac0e784f2699 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:13.866359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-201635cf-7e7e-4577-abe6-bda2eafe053a req-a5402515-9155-4915-a747-5595afd94b74 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:13.867849 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-201635cf-7e7e-4577-abe6-bda2eafe053a req-a5402515-9155-4915-a747-5595afd94b74 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.4332469 May 12 15:26:13.875999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6c16b03-ab5f-4ee0-81e8-efc3ac14f0dc req-20340054-9b5d-437f-8dae-f693408a9c8e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:13.882710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6c16b03-ab5f-4ee0-81e8-efc3ac14f0dc req-20340054-9b5d-437f-8dae-f693408a9c8e tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=d270cb8f-b1c9-42ca-9c3e-d51f878d58ee HTTP/1.1" status: 200 len: 945 time: 0.4498961 May 12 15:26:13.981144 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-201635cf-7e7e-4577-abe6-bda2eafe053a req-314f7b7c-7e9d-4c24-9da0-09210b697fc2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0761437 May 12 15:26:13.989461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03f59c14-e32b-46a8-9924-c6719e69224b req-9757b5be-1dde-4443-9ec9-18165cc36133 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0ce28f36-b32c-468c-81e3-0dd235e15282 HTTP/1.1" status: 200 len: 999 time: 0.3311887 May 12 15:26:14.015626 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6c16b03-ab5f-4ee0-81e8-efc3ac14f0dc req-e5599e01-2f82-418c-9985-3b19db9d25fa tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1319752 May 12 15:26:14.081101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-4ec7cbdf-5b2b-4da3-b8b0-b615d329bb7a req-b5359130-c564-4b6e-93e7-ac0e784f2699 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] For port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=82b1a321-6a8f-4285-8002-cdef4cd9cfdb,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:14.081853 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4ec7cbdf-5b2b-4da3-b8b0-b615d329bb7a req-b5359130-c564-4b6e-93e7-ac0e784f2699 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:14.157235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f59c14-e32b-46a8-9924-c6719e69224b req-9c9eaf09-11ec-406c-924b-b44e322fcb49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:14.158699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03f59c14-e32b-46a8-9924-c6719e69224b req-9c9eaf09-11ec-406c-924b-b44e322fcb49 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5f6d45f7-b8bc-4313-879f-ee173c0a4148 HTTP/1.1" status: 200 len: 856 time: 0.1421535 May 12 15:26:14.364762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-4ec7cbdf-5b2b-4da3-b8b0-b615d329bb7a req-b5359130-c564-4b6e-93e7-ac0e784f2699 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Calling delete_port for 82b1a321-6a8f-4285-8002-cdef4cd9cfdb owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:26:14.399138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f59c14-e32b-46a8-9924-c6719e69224b req-0cfa8047-4a7a-48c3-b628-65f758c1eac3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:14.400656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03f59c14-e32b-46a8-9924-c6719e69224b req-0cfa8047-4a7a-48c3-b628-65f758c1eac3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2d986451-1d91-468d-8a9c-ecc4da7a86bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1551986 May 12 15:26:14.438153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55c31c6a-8215-4cb4-8921-d0c40ee3223b req-97d38880-a44d-4db4-b553-3e91ce1aef71 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:14.439630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55c31c6a-8215-4cb4-8921-d0c40ee3223b req-97d38880-a44d-4db4-b553-3e91ce1aef71 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.2273729 May 12 15:26:14.483090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c3a76c-77e4-43bb-9ffa-81cdff04c41c req-e1788a24-15fa-4a53-85a6-e2832e84bd25 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:14.485520 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52c3a76c-77e4-43bb-9ffa-81cdff04c41c req-e1788a24-15fa-4a53-85a6-e2832e84bd25 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.3214495 May 12 15:26:14.578373 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4ec7cbdf-5b2b-4da3-b8b0-b615d329bb7a req-b5359130-c564-4b6e-93e7-ac0e784f2699 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:14.599282 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52c3a76c-77e4-43bb-9ffa-81cdff04c41c req-c8e3007d-4a32-4208-b9b5-b0fbd437cf1c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636311 May 12 15:26:14.633886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['903a522b-68b1-4bb2-9050-a8d2c3377b04', 'ca8260ac-22c8-4968-9ce8-5404534a00c8'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:26:14.639353 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55c31c6a-8215-4cb4-8921-d0c40ee3223b req-ad339694-ef42-4dab-80b9-f98870aca2ed tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1924722 May 12 15:26:14.642125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5359130-c564-4b6e-93e7-ac0e784f2699 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Pushing event deleted for resources: {'Port': ['ID=82b1a321-6a8f-4285-8002-cdef4cd9cfdb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:14.725964 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03f59c14-e32b-46a8-9924-c6719e69224b req-ca2377ae-bdcb-4917-bc10-954de841713e service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3152995 May 12 15:26:14.758655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-4ec7cbdf-5b2b-4da3-b8b0-b615d329bb7a req-b5359130-c564-4b6e-93e7-ac0e784f2699 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] No DVR routers for this DVR port 82b1a321-6a8f-4285-8002-cdef4cd9cfdb on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:26:14.762026 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4ec7cbdf-5b2b-4da3-b8b0-b615d329bb7a req-b5359130-c564-4b6e-93e7-ac0e784f2699 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:14.780127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd270cb8f-b1c9-42ca-9c3e-d51f878d58ee', 'name': 'network-vif-deleted', 'tag': '82b1a321-6a8f-4285-8002-cdef4cd9cfdb'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:26:14.796194 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4ec7cbdf-5b2b-4da3-b8b0-b615d329bb7a req-b5359130-c564-4b6e-93e7-ac0e784f2699 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.84 "DELETE /v2.0/ports/82b1a321-6a8f-4285-8002-cdef4cd9cfdb HTTP/1.1" status: 204 len: 173 time: 1.1681714 May 12 15:26:14.880480 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cfb85913-3e45-4da8-a3c6-5c559967b352 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:14.965542 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9200095a-24fe-4fcc-8040-879bd1587d51 req-31a3403f-9457-4c71-affd-7fcac4ee4ea4 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.1061273 May 12 15:26:15.150601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9200095a-24fe-4fcc-8040-879bd1587d51 req-c092eaa6-94e1-4aa0-a5c8-5b4ebbf65104 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:15.152656 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9200095a-24fe-4fcc-8040-879bd1587d51 req-c092eaa6-94e1-4aa0-a5c8-5b4ebbf65104 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 1097 time: 0.1388128 May 12 15:26:15.179074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e7bd8e8-c046-4ed3-a73f-f87650734ec8 req-aae658d9-99b8-4dec-84c5-78db85e50ed6 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:15.185781 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e7bd8e8-c046-4ed3-a73f-f87650734ec8 req-aae658d9-99b8-4dec-84c5-78db85e50ed6 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.3153834 May 12 15:26:15.207158 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03f59c14-e32b-46a8-9924-c6719e69224b req-3fc3eb93-423e-4c5e-b0b7-94cd6ad3143b service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4738846 May 12 15:26:15.257538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f2f992-07af-4dd5-b2ec-a393464960b4 req-74643bac-d82b-485e-b8ea-05754cc1c7e6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:15.264669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95f2f992-07af-4dd5-b2ec-a393464960b4 req-74643bac-d82b-485e-b8ea-05754cc1c7e6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.3959918 May 12 15:26:15.309404 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e7bd8e8-c046-4ed3-a73f-f87650734ec8 req-5e2e5a82-8fa9-4da2-80c9-85ccbf6f8035 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1225548 May 12 15:26:15.364936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95f2f992-07af-4dd5-b2ec-a393464960b4 req-8a5eb08a-4d77-4474-879e-4b9d00c64a0b tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0992150 May 12 15:26:15.507398 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d8d0dfb3-ad57-45b2-8e22-3a55b6e0ec81'] response: {'server_uuid': 'd270cb8f-b1c9-42ca-9c3e-d51f878d58ee', 'name': 'network-vif-deleted', 'tag': '82b1a321-6a8f-4285-8002-cdef4cd9cfdb', 'status': 'completed', 'code': 200} May 12 15:26:15.645082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9200095a-24fe-4fcc-8040-879bd1587d51 req-0132fda1-1a7a-4740-97be-c1cad0107619 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:15.646773 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9200095a-24fe-4fcc-8040-879bd1587d51 req-0132fda1-1a7a-4740-97be-c1cad0107619 service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.4703643 May 12 15:26:15.742326 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9200095a-24fe-4fcc-8040-879bd1587d51 req-7c0a8f7f-0f44-4402-892f-4951c035e4e2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=7e0c7266-ad09-4620-bfdc-81de7da01d15 HTTP/1.1" status: 200 len: 217 time: 0.0877991 May 12 15:26:15.853145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9200095a-24fe-4fcc-8040-879bd1587d51 req-d2743be7-3ed1-4cc9-a8c2-2834a5a82ccd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:15.859518 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9200095a-24fe-4fcc-8040-879bd1587d51 req-d2743be7-3ed1-4cc9-a8c2-2834a5a82ccd service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.1069462 May 12 15:26:15.866222 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7da9d643-5652-476d-b2bf-cd128a53ff1d req-c13b3e56-4f9e-4a3e-b07d-8518d229f8cf tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=d270cb8f-b1c9-42ca-9c3e-d51f878d58ee HTTP/1.1" status: 200 len: 210 time: 0.1413267 May 12 15:26:15.948254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ccfefd-a5da-4815-8f76-7d3ffb9e8db5 req-cdef030f-40f6-4cac-9d63-cff4b7199698 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:15.955452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2ccfefd-a5da-4815-8f76-7d3ffb9e8db5 req-cdef030f-40f6-4cac-9d63-cff4b7199698 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.3446538 May 12 15:26:16.024011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2ccfefd-a5da-4815-8f76-7d3ffb9e8db5 req-71537505-4f50-44d7-a112-6f3982d3dec8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674257 May 12 15:26:16.030593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9200095a-24fe-4fcc-8040-879bd1587d51 req-eb49344d-3f58-492d-890b-bc037c30e841 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:16.033554 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:16.037427 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9200095a-24fe-4fcc-8040-879bd1587d51 req-eb49344d-3f58-492d-890b-bc037c30e841 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1731379 May 12 15:26:16.148638 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:16.324104 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9200095a-24fe-4fcc-8040-879bd1587d51 req-c333e225-eb5f-4e3a-84c2-0a3063c1b5bd service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2686536 May 12 15:26:16.331118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-50a182d3-ea19-49d9-be30-fef1df95f848 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:16.339570 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-50a182d3-ea19-49d9-be30-fef1df95f848 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 812 time: 0.2651041 May 12 15:26:16.410705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:26:16.419339 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 82b1a321-6a8f-4285-8002-cdef4cd9cfdb no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:26:16.448247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-0f64d64b-c29e-423e-87c3-0fed4d8c3323 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/quotas/6357a1184f074ce2a5b5f19b5ce06e85 HTTP/1.1" status: 200 len: 375 time: 0.1069014 May 12 15:26:16.556376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44590716-f83d-43fb-8e06-53599ef55367 req-fd22fae2-688f-4545-afeb-263ea41f47f0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:16.565979 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44590716-f83d-43fb-8e06-53599ef55367 req-fd22fae2-688f-4545-afeb-263ea41f47f0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 944 time: 0.2233651 May 12 15:26:16.590843 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 82b1a321-6a8f-4285-8002-cdef4cd9cfdb {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:26:16.595159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 82b1a321-6a8f-4285-8002-cdef4cd9cfdb not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:26:16.628566 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-cbe74fd5-25a9-4a4c-8219-7037ff166f80 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&fields=id HTTP/1.1" status: 200 len: 486 time: 0.1793540 May 12 15:26:16.674890 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9200095a-24fe-4fcc-8040-879bd1587d51 req-1e729e1c-3c49-48db-8291-211cf6d4b4e7 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3443043 May 12 15:26:16.712334 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44590716-f83d-43fb-8e06-53599ef55367 req-6f691c03-da77-47d6-813e-a6d3b09cacde tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1452842 May 12 15:26:16.808228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-9e99e58d-f81a-4858-a642-2f403295eedd service neutron] 10.222.0.82 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1787338 May 12 15:26:16.857224 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:16.879910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f', 'network_id': 'aab37dc4-92bf-4fd9-8482-5e3a3f715d61', 'port_id': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f', 'mac_address': 'fa:16:3e:3d:84:57', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 559, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c90f4328-5e3e-4311-a3b6-84cff19a6919', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:26:16.968200 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:16.993462 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:26:17.014029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:17.022203 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:17.115816 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:17.148773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41eeb2ea-6ad2-4fb2-b2b4-53727eb37b54 req-b8d6f9d5-d141-46e8-94b2-8a3adefe7772 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:17.150247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41eeb2ea-6ad2-4fb2-b2b4-53727eb37b54 req-b8d6f9d5-d141-46e8-94b2-8a3adefe7772 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.1841013 May 12 15:26:17.154445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-9ed93ad8-a67e-4f59-b359-8092b4ce0e54 service neutron] 10.222.0.82 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3454487 May 12 15:26:17.216624 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41eeb2ea-6ad2-4fb2-b2b4-53727eb37b54 req-a4f8abf5-a21c-4d87-b9ee-37b32a9b9930 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0540340 May 12 15:26:17.397847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:26:17.490269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb82f228-97dc-4434-8160-20192985cdca req-88f73687-19a4-4779-a4dd-3292b6ac6e6c tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:17.500812 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb82f228-97dc-4434-8160-20192985cdca req-88f73687-19a4-4779-a4dd-3292b6ac6e6c tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1499407 May 12 15:26:17.564139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb82f228-97dc-4434-8160-20192985cdca req-a28753be-ce6c-430e-bf42-346b17c1f9d8 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0600381 May 12 15:26:17.657938 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:17.708204 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0fe438a-289f-4433-8834-98b9bb70a805 req-6dd19ac1-60eb-4f9b-83c9-ce5123db6252 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 210 time: 0.0676451 May 12 15:26:17.783949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d22ce56-8dc5-44d3-88c0-810d8c81c133 req-c0c91d4d-4fdb-48ca-bc28-52d012622366 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:17.785927 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d22ce56-8dc5-44d3-88c0-810d8c81c133 req-c0c91d4d-4fdb-48ca-bc28-52d012622366 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.2083426 May 12 15:26:17.878318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d22ce56-8dc5-44d3-88c0-810d8c81c133 req-b5ae9ccb-a1c6-4d4c-8351-c4f24f7b4382 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0851967 May 12 15:26:18.120694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-100e2b98-f7b4-4cfd-8076-7c4244ae51e0 req-72585939-99f3-4f2b-ac53-25e5f01e0eab tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:18.122528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-100e2b98-f7b4-4cfd-8076-7c4244ae51e0 req-72585939-99f3-4f2b-ac53-25e5f01e0eab tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 945 time: 0.1466138 May 12 15:26:18.207086 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-100e2b98-f7b4-4cfd-8076-7c4244ae51e0 req-d1fbe6e1-e81e-435a-89bd-f23e7ebc1fe0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0784814 May 12 15:26:18.519984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaa775c4-4165-49e5-bbed-a94b986345da req-680c7106-ccef-41d5-923f-896a0f145253 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:18.521813 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eaa775c4-4165-49e5-bbed-a94b986345da req-680c7106-ccef-41d5-923f-896a0f145253 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.1163516 May 12 15:26:18.595043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eaa775c4-4165-49e5-bbed-a94b986345da req-e6b6ec82-5934-4768-9a3d-0c2b9a98b236 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0616047 May 12 15:26:18.856729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3b41950-ece6-4f83-8733-fca9067961f0 req-e35c65cf-c401-4049-96ef-d4eb51939ae3 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:18.864722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3b41950-ece6-4f83-8733-fca9067961f0 req-e35c65cf-c401-4049-96ef-d4eb51939ae3 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1048436 May 12 15:26:18.927561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3b41950-ece6-4f83-8733-fca9067961f0 req-d7a76e25-dbf9-492a-9274-08f668d95d32 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0614941 May 12 15:26:19.282319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-fef14521-0906-48a6-812e-74ded76ba921 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:19.283793 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-fef14521-0906-48a6-812e-74ded76ba921 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.76 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 812 time: 0.3251073 May 12 15:26:19.298208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Request body: {'port': {'device_id': 'e8119d65-58b3-47a9-a67c-cb954ba4751e', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'admin_state_up': True, 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:26:19.368709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6382707f-fb1d-46b0-91d2-2c3e58c1b162 req-bcb8c7b1-3bca-47f1-a3c8-1b1eac0e5cb3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 210 time: 0.0948610 May 12 15:26:19.559544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:26:19.564587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Usage tracker for resource:port and tenant:6357a1184f074ce2a5b5f19b5ce06e85 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:26:19.569339 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Quota usage for port was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:26:19.578061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attempting to reserve 1 items for resource port. Total usage: 6; quota limit: 500; headroom:494 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:26:19.596909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Made reservation on behalf of 6357a1184f074ce2a5b5f19b5ce06e85 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:26:19.608235 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:19.648846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ff6275-d44d-4a16-9f33-f83608fc6bd9 req-8814148a-7a86-44dc-9929-bb30afdaef39 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:19.656591 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69ff6275-d44d-4a16-9f33-f83608fc6bd9 req-8814148a-7a86-44dc-9929-bb30afdaef39 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.1777282 May 12 15:26:19.757091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69ff6275-d44d-4a16-9f33-f83608fc6bd9 req-8c9bafc4-1d55-4a8f-af2f-2d32a33582ce tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0949800 May 12 15:26:19.827587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Allocated IP 172.20.0.14 (de9b95bc-97c4-4188-a1d0-c125f35032b0/f6980e11-e336-4f1d-9b2b-4462912e9abb/a1c53249-987d-432e-8065-6336089a1cc1) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:26:19.890006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9a93111-8b02-44c6-8feb-3ad6e62fab3f req-467ffece-c502-42af-ba4e-7c6fba5582f7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:19.892659 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9a93111-8b02-44c6-8feb-3ad6e62fab3f req-467ffece-c502-42af-ba4e-7c6fba5582f7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 945 time: 0.1876495 May 12 15:26:20.073305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9a93111-8b02-44c6-8feb-3ad6e62fab3f req-467bf48c-5230-4231-b7dd-855b95c6e071 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1600497 May 12 15:26:20.329769 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:20.377169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Transition to ACTIVE for port object a1c53249-987d-432e-8065-6336089a1cc1 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:26:20.407668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f8eddc1-4b30-40f7-b50f-d6ec4655656d req-5d21984e-aa63-4833-b563-cac8c26b82f1 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:20.412834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:20.417173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f8eddc1-4b30-40f7-b50f-d6ec4655656d req-5d21984e-aa63-4833-b563-cac8c26b82f1 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:20.420696 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f8eddc1-4b30-40f7-b50f-d6ec4655656d req-5d21984e-aa63-4833-b563-cac8c26b82f1 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32&device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 1682 time: 0.1810305 May 12 15:26:20.460106 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['7e0c7266-ad09-4620-bfdc-81de7da01d15', 'bdd6d277-b9d3-4e93-bfc7-66dd6ac96203'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:26:20.505092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f8eddc1-4b30-40f7-b50f-d6ec4655656d req-93e5e024-2838-4e77-b33a-7b7e88d07097 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739386 May 12 15:26:20.522646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:26:20.574190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event updated for resources: {'Port': ['ID=a1c53249-987d-432e-8065-6336089a1cc1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:20.607604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Network de9b95bc-97c4-4188-a1d0-c125f35032b0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:26:20.610103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:26:20.619822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:26:20.671799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:26:20.672303 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:20.772690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:20.773368 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:20.820573 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-495ffea4-2aee-4a2e-9333-56b0312a36f4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5269017 May 12 15:26:20.838535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Request body: {'port': {'device_id': 'e8119d65-58b3-47a9-a67c-cb954ba4751e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:26:20.938143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c33aa3a-bc9f-4e5b-bffc-7e22b393f70f req-95e9751f-de17-44b4-81af-e67ba52d3c2b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:20.939834 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c33aa3a-bc9f-4e5b-bffc-7e22b393f70f req-95e9751f-de17-44b4-81af-e67ba52d3c2b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1492550 May 12 15:26:21.027189 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c33aa3a-bc9f-4e5b-bffc-7e22b393f70f req-d1a09c62-dd02-412e-a02a-727fccba00a7 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0817840 May 12 15:26:21.100658 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:21.193300 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:21.253316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e3189ff-eb13-4d53-bb96-0f93c430e9f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:26:21.263650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-46e49583-5966-427c-9ac3-2f8336c237d7 None None] Provisioning for port a1c53249-987d-432e-8065-6336089a1cc1 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:26:21.277473 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:21.283999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-46e49583-5966-427c-9ac3-2f8336c237d7 None None] Provisioning complete for port a1c53249-987d-432e-8065-6336089a1cc1 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:26:21.284875 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-46e49583-5966-427c-9ac3-2f8336c237d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:21.375483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-46e49583-5966-427c-9ac3-2f8336c237d7 None None] Port a1c53249-987d-432e-8065-6336089a1cc1 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:26:21.386638 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:21.387566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0ce28f36-b32c-468c-81e3-0dd235e15282 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:26:21.525198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9211cf25-05cf-4e87-bba4-a8916fe662dc req-fe6f636a-32a6-4ae9-a9e4-0bd4de9a69e6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:21.534319 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9211cf25-05cf-4e87-bba4-a8916fe662dc req-fe6f636a-32a6-4ae9-a9e4-0bd4de9a69e6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 932 time: 0.3314800 May 12 15:26:21.562871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2df9c8c7-d301-478b-a39d-e3ddaa0527fb req-145b49a7-675a-41b9-b8df-a26bc905e166 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:21.565373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2df9c8c7-d301-478b-a39d-e3ddaa0527fb req-145b49a7-675a-41b9-b8df-a26bc905e166 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.2546268 May 12 15:26:21.655159 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9211cf25-05cf-4e87-bba4-a8916fe662dc req-348d34f2-6393-4545-881e-c300ee8c0726 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1195915 May 12 15:26:21.674860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2df9c8c7-d301-478b-a39d-e3ddaa0527fb req-27132751-5327-4dee-9f2a-59c325b3c398 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0981567 May 12 15:26:21.772395 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,revision_number=10']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:21.925308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a1c53249-987d-432e-8065-6336089a1cc1 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:26:21.958867 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:21.999371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Transition to ACTIVE for port object a1c53249-987d-432e-8065-6336089a1cc1 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:26:22.011253 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:22.162598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6c3f117-a77e-466b-95ff-1200cb5a90d4 req-e3371393-91d0-4a00-a1a9-93a3729eecbf tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:22.171925 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6c3f117-a77e-466b-95ff-1200cb5a90d4 req-e3371393-91d0-4a00-a1a9-93a3729eecbf tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.1846201 May 12 15:26:22.266830 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6c3f117-a77e-466b-95ff-1200cb5a90d4 req-153149d5-78c8-4be5-8170-e60f72eb1151 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0832818 May 12 15:26:22.343649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Pushing event updated for resources: {'Port': ['ID=a1c53249-987d-432e-8065-6336089a1cc1,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:22.393989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Attempting to bind port a1c53249-987d-432e-8065-6336089a1cc1 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:26:22.394409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Attempting to bind port a1c53249-987d-432e-8065-6336089a1cc1 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:26:22.394796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Attempting to bind port a1c53249-987d-432e-8065-6336089a1cc1 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:26:22.401826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Port a1c53249-987d-432e-8065-6336089a1cc1 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:26:22.402236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Attempting to bind port a1c53249-987d-432e-8065-6336089a1cc1 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:26:22.408472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 26, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:26:22.408886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Checking segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:26:22.409578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Bound using segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:26:22.409995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Bound port: a1c53249-987d-432e-8065-6336089a1cc1, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:26:22.410402 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:22.454462 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7b643796-3955-415f-a1f0-989f0c8922c8'] response: {'server_uuid': '6e3189ff-eb13-4d53-bb96-0f93c430e9f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f', 'code': 200} May 12 15:26:22.899377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c3c62e6-0115-465f-bdf0-8b40b12f7bbe req-57f56851-dde7-493a-a068-918c2b7029de tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:22.902312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5c3c62e6-0115-465f-bdf0-8b40b12f7bbe req-57f56851-dde7-493a-a068-918c2b7029de tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1769075 May 12 15:26:23.122033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5c3c62e6-0115-465f-bdf0-8b40b12f7bbe req-db3b82f9-6d3b-403b-b9ae-a804d150ec7d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1900070 May 12 15:26:23.142947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] For port a1c53249-987d-432e-8065-6336089a1cc1, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:26:23.158955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] For port a1c53249-987d-432e-8065-6336089a1cc1, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a1c53249-987d-432e-8065-6336089a1cc1,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:26:23.193430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:23.197039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c309652-38a9-44a9-a147-32ec5f737725 req-bb21cf69-2019-4cdc-a32f-1cec2250900e tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:23.203561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c309652-38a9-44a9-a147-32ec5f737725 req-bb21cf69-2019-4cdc-a32f-1cec2250900e tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.2487931 May 12 15:26:23.310961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fba234fb-4155-4a83-a4aa-1304c51eefc1 req-488ac838-7ff8-4ff3-a9cb-805ed8f11ffc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:23.312666 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fba234fb-4155-4a83-a4aa-1304c51eefc1 req-488ac838-7ff8-4ff3-a9cb-805ed8f11ffc service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 1098 time: 0.3621202 May 12 15:26:23.376550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Pushing event updated for resources: {'Port': ['ID=a1c53249-987d-432e-8065-6336089a1cc1,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:23.432780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:23.433600 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:23.435004 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-b0b23e8a-a633-47f9-bfac-7e0537f01b6f service neutron] 10.222.0.76 "PUT /v2.0/ports/a1c53249-987d-432e-8065-6336089a1cc1 HTTP/1.1" status: 200 len: 1092 time: 2.6043327 May 12 15:26:23.436898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e8119d65-58b3-47a9-a67c-cb954ba4751e', 'tag': 'a1c53249-987d-432e-8065-6336089a1cc1'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:26:23.456970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-989f8de2-8f26-4a45-8acd-1f7f853eb69b service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.6077802 May 12 15:26:23.468912 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fba234fb-4155-4a83-a4aa-1304c51eefc1 req-b375931f-22ee-4301-99e2-2ae7b8225f3b service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0747867 May 12 15:26:23.586078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-a6e1b423-2e16-448f-abf7-b02a9f406227 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:23.587777 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-a6e1b423-2e16-448f-abf7-b02a9f406227 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 1095 time: 0.1004193 May 12 15:26:23.599428 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c309652-38a9-44a9-a147-32ec5f737725 req-aca5ccc0-c5b4-4db6-a75a-69b33ed53fea tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.3895900 May 12 15:26:23.691698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8be0789-398e-494d-a939-aac504c5a856 req-bde9b216-60cf-4a73-816d-c75a0b1fb700 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:23.706394 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f8be0789-398e-494d-a939-aac504c5a856 req-bde9b216-60cf-4a73-816d-c75a0b1fb700 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 944 time: 0.2315755 May 12 15:26:23.733487 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-399bbc4e-335e-4a53-a7cf-e7f73010fe4f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a1c53249-987d-432e-8065-6336089a1cc1 HTTP/1.1" status: 200 len: 217 time: 0.1387177 May 12 15:26:23.780203 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f8be0789-398e-494d-a939-aac504c5a856 req-b5b30768-02f3-48d0-a5b6-6a3a6aa82c1a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0728364 May 12 15:26:23.858184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-8cf91d4c-1dc7-4bcb-a28f-a686a0d2bcd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:23.860513 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-8cf91d4c-1dc7-4bcb-a28f-a686a0d2bcd4 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.1177440 May 12 15:26:23.901300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b692e078-6ebe-4456-8940-d6b0ca86df08 req-e60a6ea5-f69c-4c85-b7b2-1433afd396b8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:23.903174 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b692e078-6ebe-4456-8940-d6b0ca86df08 req-e60a6ea5-f69c-4c85-b7b2-1433afd396b8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.1176927 May 12 15:26:23.966533 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b692e078-6ebe-4456-8940-d6b0ca86df08 req-deb34d11-622a-44cc-8ac4-d2f8657007fc tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576458 May 12 15:26:23.976553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-21d63dba-8d99-4037-8db5-8929b4b9f03c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:23.979792 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-21d63dba-8d99-4037-8db5-8929b4b9f03c service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1114566 May 12 15:26:24.204003 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-2f742a2f-4f3f-4761-9ab6-98742e09dd8e service neutron] 10.222.0.76 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2173975 May 12 15:26:24.214495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d11df41-1033-4932-b184-c7ba2eaceda0 req-4e06e681-d398-4235-b517-91083d843224 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:24.219692 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d11df41-1033-4932-b184-c7ba2eaceda0 req-4e06e681-d398-4235-b517-91083d843224 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.1095209 May 12 15:26:24.339918 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d11df41-1033-4932-b184-c7ba2eaceda0 req-7c152102-f055-490a-9847-10e570e52015 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1098845 May 12 15:26:24.394028 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-071559a9-32b9-4efa-b6e2-2b7c30d7e9b5 req-1fb870c9-fb8f-4742-8209-3fbc9067f7de service neutron] 10.222.0.76 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1770828 May 12 15:26:24.395635 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-abb2665b-d7bd-4525-aa68-90b16dfb7cb3'] response: {'name': 'network-changed', 'server_uuid': 'e8119d65-58b3-47a9-a67c-cb954ba4751e', 'tag': 'a1c53249-987d-432e-8065-6336089a1cc1', 'status': 'completed', 'code': 200} May 12 15:26:24.559425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe491db-9a5a-4058-8283-372ed7d74775 req-5269c1a9-9575-425f-92bf-e60fb6049103 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:24.561250 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bfe491db-9a5a-4058-8283-372ed7d74775 req-5269c1a9-9575-425f-92bf-e60fb6049103 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1631246 May 12 15:26:24.638179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf1d4ae6-47ff-491e-a835-40d7c6c5e566 req-89b994ab-0b26-460a-a75d-2e978ff65af2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:24.641418 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cf1d4ae6-47ff-491e-a835-40d7c6c5e566 req-89b994ab-0b26-460a-a75d-2e978ff65af2 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 1095 time: 0.1434782 May 12 15:26:24.671604 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bfe491db-9a5a-4058-8283-372ed7d74775 req-fcd7ab68-cb38-492d-b9fd-3d59423f0326 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1036730 May 12 15:26:24.916570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf1d4ae6-47ff-491e-a835-40d7c6c5e566 req-d92fe006-204c-431d-a03e-760942824e31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:24.929888 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cf1d4ae6-47ff-491e-a835-40d7c6c5e566 req-d92fe006-204c-431d-a03e-760942824e31 service neutron] 10.222.0.76 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.2809300 May 12 15:26:24.971975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18412e03-6be8-4839-9e16-c1251aaf92e0 req-f10d7455-23dc-495a-b548-72c6bc4eb633 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:24.980335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18412e03-6be8-4839-9e16-c1251aaf92e0 req-f10d7455-23dc-495a-b548-72c6bc4eb633 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.0938802 May 12 15:26:25.096273 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18412e03-6be8-4839-9e16-c1251aaf92e0 req-8c3fec56-1074-4dac-af3b-fb45038b0a68 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1146479 May 12 15:26:25.170259 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cf1d4ae6-47ff-491e-a835-40d7c6c5e566 req-279bc848-e110-4724-aab6-7c65a67a712a service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a1c53249-987d-432e-8065-6336089a1cc1 HTTP/1.1" status: 200 len: 217 time: 0.2332859 May 12 15:26:25.310227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf1d4ae6-47ff-491e-a835-40d7c6c5e566 req-19bcf096-a2a8-4ac8-b498-1d5be79919cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:25.320446 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cf1d4ae6-47ff-491e-a835-40d7c6c5e566 req-19bcf096-a2a8-4ac8-b498-1d5be79919cb service neutron] 10.222.0.76 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.1370695 May 12 15:26:25.400632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f235cc62-b8ae-4ea5-ae13-2bbd3dfee179 req-cb601069-b685-464f-994d-b14a929ec46c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:25.430869 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f235cc62-b8ae-4ea5-ae13-2bbd3dfee179 req-cb601069-b685-464f-994d-b14a929ec46c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 944 time: 0.1939838 May 12 15:26:25.437010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-69aa258c-b116-4e71-8b4d-67ab1d4f20fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:25.440718 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-69aa258c-b116-4e71-8b4d-67ab1d4f20fb service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb&tenant_id=40852c97262142aeb6d62097955af83f HTTP/1.1" status: 200 len: 1095 time: 0.3536942 May 12 15:26:25.538458 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f235cc62-b8ae-4ea5-ae13-2bbd3dfee179 req-e57257df-04a8-4b38-ac9d-d577ce62b644 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1054490 May 12 15:26:25.760930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf1d4ae6-47ff-491e-a835-40d7c6c5e566 req-54f2f181-c9a2-490d-8dbe-f0565f7a525b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:25.762510 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cf1d4ae6-47ff-491e-a835-40d7c6c5e566 req-54f2f181-c9a2-490d-8dbe-f0565f7a525b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4340124 May 12 15:26:25.891739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c1d74d-019e-4a29-a226-4ec011efc920 req-340a8610-1929-4b6d-8c83-508935be6060 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:25.901871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60c1d74d-019e-4a29-a226-4ec011efc920 req-340a8610-1929-4b6d-8c83-508935be6060 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.2560754 May 12 15:26:25.961728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c27ac237-5b2d-47e5-b76d-79455ebbd9d1 req-867a57d2-a9a3-4f4b-a006-5b8bbe5f6a3b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:25.982068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c27ac237-5b2d-47e5-b76d-79455ebbd9d1 req-867a57d2-a9a3-4f4b-a006-5b8bbe5f6a3b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1998959 May 12 15:26:26.009480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb42a005-a1ec-48c9-8966-f361b90769da req-ea6dadbe-aad0-4868-925b-543f257995e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:26.011833 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bb42a005-a1ec-48c9-8966-f361b90769da req-ea6dadbe-aad0-4868-925b-543f257995e8 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=f4660a6351274a7796c2eb1e55a41ec9&device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 1097 time: 0.4582829 May 12 15:26:26.020833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-6af7af6b-3ab9-47a7-a8fd-be6c838b15f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:26.022536 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-6af7af6b-3ab9-47a7-a8fd-be6c838b15f9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=40852c97262142aeb6d62097955af83f&device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 1095 time: 0.5405660 May 12 15:26:26.059321 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60c1d74d-019e-4a29-a226-4ec011efc920 req-cac80bec-c0a8-4786-bfa8-7457272b0850 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1559224 May 12 15:26:26.085890 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c27ac237-5b2d-47e5-b76d-79455ebbd9d1 req-0d2a04f2-c98c-4cbb-b6ca-576b59489191 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0967534 May 12 15:26:26.360529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-5662b976-38e1-4402-ac44-fa8d18d0a0b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:26.370131 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-5662b976-38e1-4402-ac44-fa8d18d0a0b8 service neutron] 10.222.0.84 "GET /v2.0/networks?id=2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 200 len: 918 time: 0.3047342 May 12 15:26:26.570987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-efa59e2a-0f43-44dc-8d71-3383e2b785b9 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0ce28f36-b32c-468c-81e3-0dd235e15282 HTTP/1.1" status: 200 len: 999 time: 0.1896877 May 12 15:26:26.578334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dadc7d-6898-4431-adea-3ec0e82cec1a req-acc6d4b8-c402-4e38-8083-a8198d43f10b tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:26.585240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9dadc7d-6898-4431-adea-3ec0e82cec1a req-acc6d4b8-c402-4e38-8083-a8198d43f10b tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32 HTTP/1.1" status: 200 len: 945 time: 0.2405648 May 12 15:26:26.625640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb42a005-a1ec-48c9-8966-f361b90769da req-8394a649-e1b7-462b-9eb2-39f2d002eb8b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:26.627084 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bb42a005-a1ec-48c9-8966-f361b90769da req-8394a649-e1b7-462b-9eb2-39f2d002eb8b service neutron] 10.222.0.76 "GET /v2.0/networks?id=e1655f9a-2478-49d5-a6ca-4fec717d6816 HTTP/1.1" status: 200 len: 912 time: 0.6010530 May 12 15:26:26.632230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31720d88-5512-4ce4-9cb3-26ce6718907b req-13fae0d3-472e-418a-aff3-f25006123c00 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:26.633944 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31720d88-5512-4ce4-9cb3-26ce6718907b req-13fae0d3-472e-418a-aff3-f25006123c00 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.84 "GET /v2.0/ports?device_id=55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32 HTTP/1.1" status: 200 len: 945 time: 0.4020731 May 12 15:26:26.694768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9dadc7d-6898-4431-adea-3ec0e82cec1a req-0dfbfb6e-9dfd-4991-861f-3c91f547c157 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/security-groups?id=17376624-9ead-4836-b04e-2a57fe200253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1086490 May 12 15:26:26.711086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-353e9763-79ff-4d4f-89ef-49b5194f39ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:26.713170 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-353e9763-79ff-4d4f-89ef-49b5194f39ca service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5f6d45f7-b8bc-4313-879f-ee173c0a4148 HTTP/1.1" status: 200 len: 856 time: 0.0893834 May 12 15:26:26.732106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-31720d88-5512-4ce4-9cb3-26ce6718907b req-f5451cc9-6f79-4e8d-a061-c2f271683208 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Deleting port 903a522b-68b1-4bb2-9050-a8d2c3377b04 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:26:26.732437 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-31720d88-5512-4ce4-9cb3-26ce6718907b req-f5451cc9-6f79-4e8d-a061-c2f271683208 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:26.773142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a636359e-69f9-4b41-ba1e-8d4545613a15 req-79874029-5f28-49f1-8ad0-41e7e3fe810f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:26.779533 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a636359e-69f9-4b41-ba1e-8d4545613a15 req-79874029-5f28-49f1-8ad0-41e7e3fe810f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.3518424 May 12 15:26:26.844306 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bb42a005-a1ec-48c9-8966-f361b90769da req-89c4ffe3-03e1-4f27-9f14-222c61ec5c81 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d4f9886d-fb34-4a11-9462-3343e8a12db0 HTTP/1.1" status: 200 len: 1002 time: 0.1193571 May 12 15:26:26.857786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a636359e-69f9-4b41-ba1e-8d4545613a15 req-244851cf-65ad-432a-8ddc-0b92a5a034f4 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0772805 May 12 15:26:27.008985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb42a005-a1ec-48c9-8966-f361b90769da req-d0d24fc0-17de-409e-bdbe-ccc26951ea56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:27.011434 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bb42a005-a1ec-48c9-8966-f361b90769da req-d0d24fc0-17de-409e-bdbe-ccc26951ea56 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=83787d82-d8a5-4f12-a025-f44dcf581189 HTTP/1.1" status: 200 len: 850 time: 0.0817077 May 12 15:26:27.027250 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cf1d4ae6-47ff-491e-a835-40d7c6c5e566 req-b356ed7e-1b2d-4a36-bf67-d027bc0aa13a service neutron] 10.222.0.76 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.2576876 May 12 15:26:27.270348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47f5e0a1-a060-46b7-8273-d8cfcf57725d req-0d9a4a9a-f98d-47d5-ad6f-08d5ad38d7ff tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:27.277873 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47f5e0a1-a060-46b7-8273-d8cfcf57725d req-0d9a4a9a-f98d-47d5-ad6f-08d5ad38d7ff tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.3045421 May 12 15:26:27.316385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-31720d88-5512-4ce4-9cb3-26ce6718907b req-f5451cc9-6f79-4e8d-a061-c2f271683208 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] For port 903a522b-68b1-4bb2-9050-a8d2c3377b04, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=903a522b-68b1-4bb2-9050-a8d2c3377b04,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:27.316755 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-31720d88-5512-4ce4-9cb3-26ce6718907b req-f5451cc9-6f79-4e8d-a061-c2f271683208 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:27.333113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec350b23-ff0f-40d9-825b-85288d1b3403 req-b36b013b-11f9-4b75-bf14-54c2e6fb36c8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:27.334391 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec350b23-ff0f-40d9-825b-85288d1b3403 req-b36b013b-11f9-4b75-bf14-54c2e6fb36c8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 944 time: 0.3033226 May 12 15:26:27.356381 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cf1d4ae6-47ff-491e-a835-40d7c6c5e566 req-d8188406-af49-4e24-8b6f-64b19ab5241e service neutron] 10.222.0.76 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2842195 May 12 15:26:27.403134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32984fb5-fccb-43ec-a243-57190ae12d83 req-8786bcb9-5cd6-4c20-ac4f-dd344cc10497 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:27.403939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-32984fb5-fccb-43ec-a243-57190ae12d83 req-8786bcb9-5cd6-4c20-ac4f-dd344cc10497 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Synchronizing usage tracker for tenant:61d51b592d944a47ba438d18c03cb747 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:26:27.442145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-d3dff087-a6c1-4fd3-aca8-7c43a373ba42 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:27.443542 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec350b23-ff0f-40d9-825b-85288d1b3403 req-4232513a-5b21-4580-b436-abf42d897937 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0997119 May 12 15:26:27.443961 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-d3dff087-a6c1-4fd3-aca8-7c43a373ba42 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2d986451-1d91-468d-8a9c-ecc4da7a86bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5501397 May 12 15:26:27.514493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a1c53249-987d-432e-8065-6336089a1cc1 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:26:27.572115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb42a005-a1ec-48c9-8966-f361b90769da req-50aec47d-99e3-4460-a79f-9cd795fcf333 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:27.575026 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bb42a005-a1ec-48c9-8966-f361b90769da req-50aec47d-99e3-4460-a79f-9cd795fcf333 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e1655f9a-2478-49d5-a6ca-4fec717d6816&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5463474 May 12 15:26:27.616165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-32984fb5-fccb-43ec-a243-57190ae12d83 req-8786bcb9-5cd6-4c20-ac4f-dd344cc10497 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Unset dirty status for tenant:61d51b592d944a47ba438d18c03cb747 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:26:27.617208 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32984fb5-fccb-43ec-a243-57190ae12d83 req-8786bcb9-5cd6-4c20-ac4f-dd344cc10497 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.84 "GET /v2.0/ports?device_id=fb219e29-6ed8-4f1b-98dc-8002eaaece2e HTTP/1.1" status: 200 len: 946 time: 0.7694187 May 12 15:26:27.771804 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47f5e0a1-a060-46b7-8273-d8cfcf57725d req-be79cf74-d80e-4b24-860a-cd3522fb3c21 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.4929874 May 12 15:26:27.804346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-31720d88-5512-4ce4-9cb3-26ce6718907b req-f5451cc9-6f79-4e8d-a061-c2f271683208 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Calling delete_port for 903a522b-68b1-4bb2-9050-a8d2c3377b04 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:26:27.807984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a1c53249-987d-432e-8065-6336089a1cc1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a1c53249-987d-432e-8065-6336089a1cc1,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:27.838869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-32984fb5-fccb-43ec-a243-57190ae12d83 req-c0b913f7-02c9-4592-a49e-8236b031922c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Deleting port ca8260ac-22c8-4968-9ce8-5404534a00c8 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:26:27.838869 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-32984fb5-fccb-43ec-a243-57190ae12d83 req-c0b913f7-02c9-4592-a49e-8236b031922c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:27.846466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'a1c53249-987d-432e-8065-6336089a1cc1', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'port_id': 'a1c53249-987d-432e-8065-6336089a1cc1', 'mac_address': 'fa:16:3e:bf:70:2b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 579, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:26:27.892547 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-6d30a970-cf3f-4267-b11b-096647e329d2 service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4298987 May 12 15:26:27.934344 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:27.962394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a1c53249-987d-432e-8065-6336089a1cc1 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:26:27.987987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a1c53249-987d-432e-8065-6336089a1cc1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a1c53249-987d-432e-8065-6336089a1cc1,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:27.996856 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:28.110990 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a1c53249-987d-432e-8065-6336089a1cc1,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:28.184084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eeadfc3-ea0a-4e08-a683-54cae7d50b90 req-fc54e1de-0517-47bd-9184-b0ef7e24f547 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:28.185653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9eeadfc3-ea0a-4e08-a683-54cae7d50b90 req-fc54e1de-0517-47bd-9184-b0ef7e24f547 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.4263849 May 12 15:26:28.217607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a1c53249-987d-432e-8065-6336089a1cc1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:26:28.251388 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bb42a005-a1ec-48c9-8966-f361b90769da req-105c196b-a79d-4ecb-a2fb-5310e2d7780c service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6691389 May 12 15:26:28.286715 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9eeadfc3-ea0a-4e08-a683-54cae7d50b90 req-2a720034-0bc7-4a39-ab4b-ea0c0224224d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0679893 May 12 15:26:28.299135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ae9514c-b090-4ea8-9719-5dd253227549 req-9ca9c8a8-9684-4411-9c29-30d4df525e1f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:28.307095 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2ae9514c-b090-4ea8-9719-5dd253227549 req-9ca9c8a8-9684-4411-9c29-30d4df525e1f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.2996635 May 12 15:26:28.376056 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2ae9514c-b090-4ea8-9719-5dd253227549 req-3a731588-4bc4-4709-b3cb-c899a02af2b2 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0678444 May 12 15:26:28.377095 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-31720d88-5512-4ce4-9cb3-26ce6718907b req-f5451cc9-6f79-4e8d-a061-c2f271683208 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:28.434094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['903a522b-68b1-4bb2-9050-a8d2c3377b04', 'ca8260ac-22c8-4968-9ce8-5404534a00c8'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:26:28.509143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5451cc9-6f79-4e8d-a061-c2f271683208 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Pushing event deleted for resources: {'Port': ['ID=903a522b-68b1-4bb2-9050-a8d2c3377b04,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:28.600494 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d9e7d8c-fa03-4194-8373-05542d882982 req-4b4b3ab1-7b6b-486f-ac50-7bf7c7ee0893 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.82 "GET /v2.0/ports?device_id=55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32 HTTP/1.1" status: 200 len: 210 time: 0.0964427 May 12 15:26:28.611234 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-087d4e55-44f2-4f27-a3a2-3aaefe17edc8 service neutron] 10.222.0.84 "GET /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7078493 May 12 15:26:28.734952 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bb42a005-a1ec-48c9-8966-f361b90769da req-bdc5c380-913b-49df-9a10-b7942ff8ecef service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4671564 May 12 15:26:28.825145 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-31720d88-5512-4ce4-9cb3-26ce6718907b req-f5451cc9-6f79-4e8d-a061-c2f271683208 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] No DVR routers for this DVR port 903a522b-68b1-4bb2-9050-a8d2c3377b04 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:26:28.825938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-32984fb5-fccb-43ec-a243-57190ae12d83 req-c0b913f7-02c9-4592-a49e-8236b031922c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] For port ca8260ac-22c8-4968-9ce8-5404534a00c8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=ca8260ac-22c8-4968-9ce8-5404534a00c8,segment=NetworkSegment(5d5228f0-c77a-4aaf-9047-f3d0bd244b1c),segment_id=5d5228f0-c77a-4aaf-9047-f3d0bd244b1c)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:28.826150 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-32984fb5-fccb-43ec-a243-57190ae12d83 req-c0b913f7-02c9-4592-a49e-8236b031922c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:28.831806 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-31720d88-5512-4ce4-9cb3-26ce6718907b req-f5451cc9-6f79-4e8d-a061-c2f271683208 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:28.934439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32', 'name': 'network-vif-deleted', 'tag': '903a522b-68b1-4bb2-9050-a8d2c3377b04'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:26:29.070023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-32984fb5-fccb-43ec-a243-57190ae12d83 req-c0b913f7-02c9-4592-a49e-8236b031922c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Calling delete_port for ca8260ac-22c8-4968-9ce8-5404534a00c8 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:26:29.079103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31720d88-5512-4ce4-9cb3-26ce6718907b req-f5451cc9-6f79-4e8d-a061-c2f271683208 tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.84 "DELETE /v2.0/ports/903a522b-68b1-4bb2-9050-a8d2c3377b04 HTTP/1.1" status: 204 len: 173 time: 2.4364798 May 12 15:26:29.171256 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c2d5ea9-f47d-4a23-9d87-49371738e009 req-a96b925c-2ca7-4797-924a-d69f38c71499 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:29.178591 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c2d5ea9-f47d-4a23-9d87-49371738e009 req-a96b925c-2ca7-4797-924a-d69f38c71499 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.3564050 May 12 15:26:29.224420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfce9a2d-2fc5-4fe7-8011-3407d3989d8b req-e3fee86f-669a-45a6-8e5b-f56187878740 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:29.226296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bfce9a2d-2fc5-4fe7-8011-3407d3989d8b req-e3fee86f-669a-45a6-8e5b-f56187878740 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 945 time: 0.2449756 May 12 15:26:29.334025 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c2d5ea9-f47d-4a23-9d87-49371738e009 req-e26603a8-b793-457a-8ac9-cbcd6ae0085d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1544733 May 12 15:26:29.380748 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bfce9a2d-2fc5-4fe7-8011-3407d3989d8b req-5e6a2fc9-0219-4420-ba33-0c54cea33aca tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1475437 May 12 15:26:29.477557 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-32984fb5-fccb-43ec-a243-57190ae12d83 req-c0b913f7-02c9-4592-a49e-8236b031922c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:29.544476 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a1c53249-987d-432e-8065-6336089a1cc1 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:26:29.619597 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ce6da9e9-e034-4c9f-8162-de7e47b26b44'] response: {'server_uuid': '55861a33-ccd4-4b3c-9ebb-1e6ccd1a3c32', 'name': 'network-vif-deleted', 'tag': '903a522b-68b1-4bb2-9050-a8d2c3377b04', 'status': 'completed', 'code': 200} May 12 15:26:29.684877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b913f7-02c9-4592-a49e-8236b031922c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Pushing event deleted for resources: {'Port': ['ID=ca8260ac-22c8-4968-9ce8-5404534a00c8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:29.807787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a294a79c-8e62-4a84-ac08-78e391fb9c4d req-71670f00-7df4-4ccf-8d9e-84a6d484d282 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:29.809435 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a294a79c-8e62-4a84-ac08-78e391fb9c4d req-71670f00-7df4-4ccf-8d9e-84a6d484d282 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.1652327 May 12 15:26:29.839710 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port a1c53249-987d-432e-8065-6336089a1cc1 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:26:29.846822 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port a1c53249-987d-432e-8065-6336089a1cc1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:26:29.847493 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:29.909832 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a294a79c-8e62-4a84-ac08-78e391fb9c4d req-89a2dadb-b5cb-4cbf-8185-9b915b62f317 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0923407 May 12 15:26:29.993476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-32984fb5-fccb-43ec-a243-57190ae12d83 req-c0b913f7-02c9-4592-a49e-8236b031922c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] No DVR routers for this DVR port ca8260ac-22c8-4968-9ce8-5404534a00c8 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:26:30.000055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-32984fb5-fccb-43ec-a243-57190ae12d83 req-c0b913f7-02c9-4592-a49e-8236b031922c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:30.006046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fb219e29-6ed8-4f1b-98dc-8002eaaece2e', 'name': 'network-vif-deleted', 'tag': 'ca8260ac-22c8-4968-9ce8-5404534a00c8'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:26:30.037762 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32984fb5-fccb-43ec-a243-57190ae12d83 req-c0b913f7-02c9-4592-a49e-8236b031922c tempest-ListServersNegativeTestJSON-1629452866 tempest-ListServersNegativeTestJSON-1629452866-project] 10.222.0.84 "DELETE /v2.0/ports/ca8260ac-22c8-4968-9ce8-5404534a00c8 HTTP/1.1" status: 204 len: 173 time: 2.3686643 May 12 15:26:30.225819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-226057fb-fec9-4108-8086-403e56885219 req-377912d6-d002-4669-978e-88216ff256b5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:30.234147 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:30.249009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-226057fb-fec9-4108-8086-403e56885219 req-377912d6-d002-4669-978e-88216ff256b5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.2705154 May 12 15:26:30.299823 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e8119d65-58b3-47a9-a67c-cb954ba4751e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1c53249-987d-432e-8065-6336089a1cc1'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:26:30.333325 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a1c53249-987d-432e-8065-6336089a1cc1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a1c53249-987d-432e-8065-6336089a1cc1,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:30.341296 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:30.386272 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-226057fb-fec9-4108-8086-403e56885219 req-d43bbf60-51ca-465e-b20e-0d6608fb53f6 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1358376 May 12 15:26:30.484224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-041b8206-8c54-4dd4-9157-8004438c3dc6 req-4d2c2e7d-3dec-42fa-9178-a10395657261 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:30.492415 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-041b8206-8c54-4dd4-9157-8004438c3dc6 req-4d2c2e7d-3dec-42fa-9178-a10395657261 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.2151124 May 12 15:26:30.500818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a1c53249-987d-432e-8065-6336089a1cc1,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:30.522306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 903a522b-68b1-4bb2-9050-a8d2c3377b04 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:26:30.601701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 903a522b-68b1-4bb2-9050-a8d2c3377b04 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:26:30.604568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 903a522b-68b1-4bb2-9050-a8d2c3377b04 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:26:30.605444 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device ca8260ac-22c8-4968-9ce8-5404534a00c8 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:26:30.651835 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: ca8260ac-22c8-4968-9ce8-5404534a00c8 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:26:30.652739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device ca8260ac-22c8-4968-9ce8-5404534a00c8 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:26:30.756958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-041b8206-8c54-4dd4-9157-8004438c3dc6 req-ee39da3b-4eb4-48b3-b75f-7b4ad69a6d94 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2441161 May 12 15:26:30.853022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-931b89de-ed8d-4005-96c9-65fcf04508ba req-bfcec59c-87ab-44ec-a5e9-6c44e1a83daf tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:30.858981 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-931b89de-ed8d-4005-96c9-65fcf04508ba req-bfcec59c-87ab-44ec-a5e9-6c44e1a83daf tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1785939 May 12 15:26:30.960052 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bb03a344-ec55-46c6-8e0f-86be42d69ffd'] response: {'server_uuid': 'fb219e29-6ed8-4f1b-98dc-8002eaaece2e', 'name': 'network-vif-deleted', 'tag': 'ca8260ac-22c8-4968-9ce8-5404534a00c8', 'status': 'completed', 'code': 200} May 12 15:26:30.973796 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-931b89de-ed8d-4005-96c9-65fcf04508ba req-8ea4ea20-7583-4f70-97db-f3af9fd906ff tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1085660 May 12 15:26:31.054403 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a5fc5769-b947-4512-ae40-594a9c058d0a'] response: {'server_uuid': 'e8119d65-58b3-47a9-a67c-cb954ba4751e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1c53249-987d-432e-8065-6336089a1cc1', 'code': 200} May 12 15:26:31.461761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05522f4e-9267-4c83-b5e4-6e2c6b6a6a71 req-9d52a96b-d721-4562-afb4-1fceb09d5a3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:31.468335 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-05522f4e-9267-4c83-b5e4-6e2c6b6a6a71 req-9d52a96b-d721-4562-afb4-1fceb09d5a3f service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 1097 time: 0.3506992 May 12 15:26:31.551408 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-05522f4e-9267-4c83-b5e4-6e2c6b6a6a71 req-f295c805-de2d-49ca-a468-8c4d365787cd service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0776408 May 12 15:26:31.763600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b7dfaec-21d6-40ff-8ff1-d43a983eeac6 req-ba7cefb4-2806-4bc2-b518-5a216e988eb3 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:31.766837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b7dfaec-21d6-40ff-8ff1-d43a983eeac6 req-ba7cefb4-2806-4bc2-b518-5a216e988eb3 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.4317117 May 12 15:26:31.843785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5368c2-913e-4436-9b0f-90f5f97c97a8 req-5cfea3ef-accc-404e-a1be-c54a0f034ad9 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:31.852921 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c5368c2-913e-4436-9b0f-90f5f97c97a8 req-5cfea3ef-accc-404e-a1be-c54a0f034ad9 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 946 time: 0.4089103 May 12 15:26:31.953115 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c5368c2-913e-4436-9b0f-90f5f97c97a8 req-11de5e68-3431-47fe-a1d3-bc69be652afa tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0981753 May 12 15:26:31.975138 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b7dfaec-21d6-40ff-8ff1-d43a983eeac6 req-ced18ae5-88bc-4a41-a9ae-d19ea5540c5d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2002323 May 12 15:26:32.084971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41570) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:32.250290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-cf005f48-4040-48df-b503-eb572a08c7b0 admin admin] Deleting subnet 7cb1634d-8705-40fa-abd9-508349cb9ba7 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:26:32.262159 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf005f48-4040-48df-b503-eb572a08c7b0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:32.332370 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:32.380255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf005f48-4040-48df-b503-eb572a08c7b0 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:32.521310 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf005f48-4040-48df-b503-eb572a08c7b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:32.910313 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf005f48-4040-48df-b503-eb572a08c7b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:33.148257 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf005f48-4040-48df-b503-eb572a08c7b0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:33.158477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf005f48-4040-48df-b503-eb572a08c7b0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7cb1634d-8705-40fa-abd9-508349cb9ba7,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:33.170021 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cf005f48-4040-48df-b503-eb572a08c7b0 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/7cb1634d-8705-40fa-abd9-508349cb9ba7 HTTP/1.1" status: 204 len: 168 time: 1.0837078 May 12 15:26:33.173773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41582) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:33.364321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-210d78b1-f815-40c7-9d96-5c389777327e req-d310a965-475f-4ed9-a717-feb47608f112 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:33.371099 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-210d78b1-f815-40c7-9d96-5c389777327e req-d310a965-475f-4ed9-a717-feb47608f112 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.7716041 May 12 15:26:33.503191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77aff5d1-edd6-4248-8bc3-acbe23adfa66 req-e4e34d3f-9259-456c-8112-7555079c5ce3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:33.511202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77aff5d1-edd6-4248-8bc3-acbe23adfa66 req-e4e34d3f-9259-456c-8112-7555079c5ce3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.9135764 May 12 15:26:33.617652 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2972a44d-aef4-4756-87fa-e30d761452ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:33.640431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-210d78b1-f815-40c7-9d96-5c389777327e req-e4ae0755-76f7-40dd-b6f8-ecd5bd48c3c3 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2574832 May 12 15:26:33.718960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41590) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:33.742527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77aff5d1-edd6-4248-8bc3-acbe23adfa66 req-9465e8e1-aafc-4395-94ab-d125edc0bfca tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2303262 May 12 15:26:33.840153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-8425d2a8-4998-4ca4-971a-75700b5aefce admin admin] Deleting subnet fe9703cc-c92d-49d5-a472-5d84a4499fa3 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:26:33.843752 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8425d2a8-4998-4ca4-971a-75700b5aefce admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:33.934542 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2972a44d-aef4-4756-87fa-e30d761452ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:34.003293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-2972a44d-aef4-4756-87fa-e30d761452ea admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7ae70819-776e-45f8-bf36-c5eb46788b03']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:26:34.032423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-2972a44d-aef4-4756-87fa-e30d761452ea admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:26:34.033131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-2972a44d-aef4-4756-87fa-e30d761452ea admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5d5228f0-c77a-4aaf-9047-f3d0bd244b1c') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:26:34.060275 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8425d2a8-4998-4ca4-971a-75700b5aefce admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:34.061233 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2972a44d-aef4-4756-87fa-e30d761452ea admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:34.100699 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2972a44d-aef4-4756-87fa-e30d761452ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:34.120531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2972a44d-aef4-4756-87fa-e30d761452ea admin admin] Releasing vlan 563 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:26:34.121281 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2972a44d-aef4-4756-87fa-e30d761452ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:34.191037 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8425d2a8-4998-4ca4-971a-75700b5aefce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: timer() May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:26:34.261957 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:26:34.270595 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2972a44d-aef4-4756-87fa-e30d761452ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:34.305582 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2972a44d-aef4-4756-87fa-e30d761452ea admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:34.340134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2972a44d-aef4-4756-87fa-e30d761452ea admin admin] Pushing event deleted for resources: {'Network': ['ID=7ae70819-776e-45f8-bf36-c5eb46788b03,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:34.348436 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2972a44d-aef4-4756-87fa-e30d761452ea admin admin] 10.222.0.82 "DELETE /v2.0/networks/7ae70819-776e-45f8-bf36-c5eb46788b03 HTTP/1.1" status: 204 len: 168 time: 1.1724267 May 12 15:26:34.437302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58676a74-8887-46d6-a660-c171b40142b4 req-ebc255f4-9348-44b4-859b-25cfb3bbe8c0 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:34.444773 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58676a74-8887-46d6-a660-c171b40142b4 req-ebc255f4-9348-44b4-859b-25cfb3bbe8c0 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 946 time: 0.5330312 May 12 15:26:34.516180 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58676a74-8887-46d6-a660-c171b40142b4 req-e55e2657-1b75-4a68-8e5b-6524c96deec4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703390 May 12 15:26:34.520383 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8425d2a8-4998-4ca4-971a-75700b5aefce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:34.635813 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8425d2a8-4998-4ca4-971a-75700b5aefce admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:34.653732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8425d2a8-4998-4ca4-971a-75700b5aefce admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fe9703cc-c92d-49d5-a472-5d84a4499fa3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:34.668006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f7cff77-aba4-4650-b8a3-53b9704d4567 req-8e8edbbb-0bd8-4be1-9175-a6648c43ebe7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:34.684032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f7cff77-aba4-4650-b8a3-53b9704d4567 req-8e8edbbb-0bd8-4be1-9175-a6648c43ebe7 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.5498106 May 12 15:26:34.762987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8425d2a8-4998-4ca4-971a-75700b5aefce admin admin] 10.222.0.82 "DELETE /v2.0/subnets/fe9703cc-c92d-49d5-a472-5d84a4499fa3 HTTP/1.1" status: 204 len: 168 time: 1.0180175 May 12 15:26:34.765528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41602) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:34.843659 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a7c1355-d4d3-47f0-880b-9838ce254729 req-4b644d08-c62b-4aec-8292-07e9db5f446d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?name=default&fields=id&tenant_id=6357a1184f074ce2a5b5f19b5ce06e85 HTTP/1.1" status: 200 len: 267 time: 0.1277080 May 12 15:26:34.922822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41610) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:34.958301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f7cff77-aba4-4650-b8a3-53b9704d4567 req-63e336fc-a74c-45cf-8c7d-97edbf3a1b46 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2711744 May 12 15:26:35.001234 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d382555b-ae50-44a7-bfc6-18f40eb8784b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:35.201173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-48e3196a-9aca-4308-adf3-d79dd9c36e8d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=61d51b592d944a47ba438d18c03cb747&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2708609 May 12 15:26:35.209951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41616) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:35.261069 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d382555b-ae50-44a7-bfc6-18f40eb8784b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:35.411036 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a607fd62-4ab4-4a97-99c6-14b52101ac63 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:35.485550 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a607fd62-4ab4-4a97-99c6-14b52101ac63 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:35.508750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a7c1355-d4d3-47f0-880b-9838ce254729 req-a20ac29a-6ef2-4f26-8a34-96b23a66be45 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:35.517992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a7c1355-d4d3-47f0-880b-9838ce254729 req-a20ac29a-6ef2-4f26-8a34-96b23a66be45 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 946 time: 0.6629193 May 12 15:26:35.523733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-4a7c1355-d4d3-47f0-880b-9838ce254729 req-82edd3ef-0276-4d01-b95a-16e17a2f03d3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Request body: {'port': {'security_groups': []}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:26:35.599001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d382555b-ae50-44a7-bfc6-18f40eb8784b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f7e46f81-02b8-4bcd-a6ce-ea0d95d06100']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:26:35.662909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d382555b-ae50-44a7-bfc6-18f40eb8784b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ce9be9ba-77e9-4d69-90ae-2dc7b4342400') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:26:35.663474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d382555b-ae50-44a7-bfc6-18f40eb8784b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ce9be9ba-77e9-4d69-90ae-2dc7b4342400') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:26:35.672634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c060c5e-2f65-4f24-8210-0fb1f9a4604e req-8ed43584-7e18-402c-bdfa-eed456bda081 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:35.694234 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c060c5e-2f65-4f24-8210-0fb1f9a4604e req-8ed43584-7e18-402c-bdfa-eed456bda081 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.5383086 May 12 15:26:35.698241 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d382555b-ae50-44a7-bfc6-18f40eb8784b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:35.741305 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d382555b-ae50-44a7-bfc6-18f40eb8784b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:35.763006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d382555b-ae50-44a7-bfc6-18f40eb8784b admin admin] Releasing vlan 580 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:26:35.763424 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d382555b-ae50-44a7-bfc6-18f40eb8784b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: timer() May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:26:35.898580 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:26:35.908678 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c060c5e-2f65-4f24-8210-0fb1f9a4604e req-4df9cf6a-e159-408c-8998-23b1164b6537 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2133672 May 12 15:26:35.924833 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a607fd62-4ab4-4a97-99c6-14b52101ac63 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:35.948111 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4a7c1355-d4d3-47f0-880b-9838ce254729 req-82edd3ef-0276-4d01-b95a-16e17a2f03d3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:35.952053 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d382555b-ae50-44a7-bfc6-18f40eb8784b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:35.987148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d382555b-ae50-44a7-bfc6-18f40eb8784b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:36.005574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d382555b-ae50-44a7-bfc6-18f40eb8784b admin admin] Pushing event deleted for resources: {'Network': ['ID=f7e46f81-02b8-4bcd-a6ce-ea0d95d06100,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:36.079679 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d382555b-ae50-44a7-bfc6-18f40eb8784b admin admin] 10.222.0.82 "DELETE /v2.0/networks/f7e46f81-02b8-4bcd-a6ce-ea0d95d06100 HTTP/1.1" status: 204 len: 168 time: 1.3124385 May 12 15:26:36.082728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41622) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:36.086337 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a607fd62-4ab4-4a97-99c6-14b52101ac63 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:36.095635 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a607fd62-4ab4-4a97-99c6-14b52101ac63 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/17376624-9ead-4836-b04e-2a57fe200253 HTTP/1.1" status: 204 len: 168 time: 0.8840261 May 12 15:26:36.104458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a607fd62-4ab4-4a97-99c6-14b52101ac63 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17376624-9ead-4836-b04e-2a57fe200253,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:36.282635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-3b7fd965-4cd9-40ad-99a0-5a36ecf7e7ba admin admin] Deleting subnet 047b8e26-cb14-4f10-bb0f-6c8308c0d636 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:26:36.302070 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b7fd965-4cd9-40ad-99a0-5a36ecf7e7ba admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:36.417435 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b7fd965-4cd9-40ad-99a0-5a36ecf7e7ba admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:36.582319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d405d28a-74b3-4190-a7d7-446123ccdbe3 req-b59fc51e-486e-4d85-8985-10d731b65046 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:36.592756 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d405d28a-74b3-4190-a7d7-446123ccdbe3 req-b59fc51e-486e-4d85-8985-10d731b65046 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.4819191 May 12 15:26:36.637227 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b7fd965-4cd9-40ad-99a0-5a36ecf7e7ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:36.862324 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d405d28a-74b3-4190-a7d7-446123ccdbe3 req-7a77f317-cfa2-4207-bb01-04d0b28d10dd tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2683005 May 12 15:26:36.865283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b7fd965-4cd9-40ad-99a0-5a36ecf7e7ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:36.884303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-4a7c1355-d4d3-47f0-880b-9838ce254729 req-82edd3ef-0276-4d01-b95a-16e17a2f03d3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] For port a1c53249-987d-432e-8065-6336089a1cc1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a1c53249-987d-432e-8065-6336089a1cc1,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:36.979959 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4a7c1355-d4d3-47f0-880b-9838ce254729 req-82edd3ef-0276-4d01-b95a-16e17a2f03d3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:36.993036 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4a7c1355-d4d3-47f0-880b-9838ce254729 req-82edd3ef-0276-4d01-b95a-16e17a2f03d3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:37.011648 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a1c53249-987d-432e-8065-6336089a1cc1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:26:37.062939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b7fd965-4cd9-40ad-99a0-5a36ecf7e7ba admin admin] Pushing event deleted for resources: {'Subnet': ['ID=047b8e26-cb14-4f10-bb0f-6c8308c0d636,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:37.065522 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b7fd965-4cd9-40ad-99a0-5a36ecf7e7ba admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:37.092073 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3b7fd965-4cd9-40ad-99a0-5a36ecf7e7ba admin admin] 10.222.0.82 "DELETE /v2.0/subnets/047b8e26-cb14-4f10-bb0f-6c8308c0d636 HTTP/1.1" status: 204 len: 168 time: 1.0078657 May 12 15:26:37.093306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41636) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:37.111609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['7e0c7266-ad09-4620-bfdc-81de7da01d15', 'bdd6d277-b9d3-4e93-bfc7-66dd6ac96203'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:26:37.395061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a7c1355-d4d3-47f0-880b-9838ce254729 req-82edd3ef-0276-4d01-b95a-16e17a2f03d3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:37.399628 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4a7c1355-d4d3-47f0-880b-9838ce254729 req-82edd3ef-0276-4d01-b95a-16e17a2f03d3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:37.420315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a7c1355-d4d3-47f0-880b-9838ce254729 req-82edd3ef-0276-4d01-b95a-16e17a2f03d3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "PUT /v2.0/ports/a1c53249-987d-432e-8065-6336089a1cc1 HTTP/1.1" status: 200 len: 905 time: 1.9013216 May 12 15:26:37.425858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e8119d65-58b3-47a9-a67c-cb954ba4751e', 'tag': 'a1c53249-987d-432e-8065-6336089a1cc1'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:26:37.550581 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66ecd62c-c491-4e27-9740-80f6a97b7a54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:37.552587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a1c53249-987d-432e-8065-6336089a1cc1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:26:37.646026 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82edd3ef-0276-4d01-b95a-16e17a2f03d3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event updated for resources: {'Port': ['ID=a1c53249-987d-432e-8065-6336089a1cc1,revision_number=6']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:37.752099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ed6d772-5f18-4f6d-98c3-03137ba14bb8 req-32efa7fd-7829-45bb-99f4-d0278cd2dd18 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:37.771972 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ed6d772-5f18-4f6d-98c3-03137ba14bb8 req-32efa7fd-7829-45bb-99f4-d0278cd2dd18 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.5520978 May 12 15:26:37.976549 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66ecd62c-c491-4e27-9740-80f6a97b7a54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:37.996263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-dcc92958-d0e4-47ea-bdc1-c9d9b0eaf932 None None] Provisioning complete for port a1c53249-987d-432e-8065-6336089a1cc1 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:26:37.996710 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dcc92958-d0e4-47ea-bdc1-c9d9b0eaf932 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:38.044111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-66ecd62c-c491-4e27-9740-80f6a97b7a54 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e6b3cebb-d75c-448f-8af1-b9526e41edd0']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:26:38.083206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-66ecd62c-c491-4e27-9740-80f6a97b7a54 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1a838211-5d88-4a84-8328-b9db47519b68') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:26:38.083943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-66ecd62c-c491-4e27-9740-80f6a97b7a54 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1a838211-5d88-4a84-8328-b9db47519b68') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:26:38.117722 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66ecd62c-c491-4e27-9740-80f6a97b7a54 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:38.167175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66ecd62c-c491-4e27-9740-80f6a97b7a54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:38.186178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-66ecd62c-c491-4e27-9740-80f6a97b7a54 admin admin] Releasing vlan 572 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:26:38.188298 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66ecd62c-c491-4e27-9740-80f6a97b7a54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:38.316941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41662) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: timer() May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:26:38.318258 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:26:38.424437 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66ecd62c-c491-4e27-9740-80f6a97b7a54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:38.460201 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66ecd62c-c491-4e27-9740-80f6a97b7a54 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:38.473063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66ecd62c-c491-4e27-9740-80f6a97b7a54 admin admin] Pushing event deleted for resources: {'Network': ['ID=e6b3cebb-d75c-448f-8af1-b9526e41edd0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:38.482696 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-66ecd62c-c491-4e27-9740-80f6a97b7a54 admin admin] 10.222.0.82 "DELETE /v2.0/networks/e6b3cebb-d75c-448f-8af1-b9526e41edd0 HTTP/1.1" status: 204 len: 168 time: 1.3880875 May 12 15:26:38.504608 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ed6d772-5f18-4f6d-98c3-03137ba14bb8 req-ad69161c-4c9d-4b89-9e6f-014be3aad27c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7311056 May 12 15:26:38.561745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Request body: {'network': {'name': 'tempest-ServerGroup264TestJSON-442518952-network', 'tenant_id': '0dbf28e6fb124ef7a724e41dfa9d26b6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:26:38.593013 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:26:38.611892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Usage tracker for resource:network and tenant:0dbf28e6fb124ef7a724e41dfa9d26b6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:26:38.627877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:26:38.651117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:26:38.680353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f077deb5-242e-497e-bfea-566d43cfb7b7 req-32fa3dc0-9136-422c-aebe-c732afd9ec2d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:38.693629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Made reservation on behalf of 0dbf28e6fb124ef7a724e41dfa9d26b6 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:26:38.696418 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:38.703750 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f077deb5-242e-497e-bfea-566d43cfb7b7 req-32fa3dc0-9136-422c-aebe-c732afd9ec2d tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.8432066 May 12 15:26:38.739229 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:38.796757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:26:38.807266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Usage tracker for resource:security_group_rule and tenant:0dbf28e6fb124ef7a724e41dfa9d26b6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:26:38.812964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:26:38.834430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:26:38.900495 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f077deb5-242e-497e-bfea-566d43cfb7b7 req-e987f258-9d95-4164-81e7-aaa93246d262 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1947782 May 12 15:26:38.904292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41676) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:39.051724 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:39.062823 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:39.106415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 585} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:26:39.106641 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-49a7408d-8a7a-4dee-bc14-02f4100b2f52'] response: {'name': 'network-changed', 'server_uuid': 'e8119d65-58b3-47a9-a67c-cb954ba4751e', 'tag': 'a1c53249-987d-432e-8065-6336089a1cc1', 'status': 'completed', 'code': 200} May 12 15:26:39.247656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=90a2b90c-bafd-492f-a669-ea7aec6b7c0c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:39.255913 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:39.256539 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Added segment be0c11b2-dce8-43d8-a12a-027961592175 of type vlan for network 5dc31d13-7ff5-4bf5-91b0-4b0578ae085a May 12 15:26:39.305495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41684) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:39.317482 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d88fbeed-e341-4806-a563-bea72147a2e0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a6cd12a079ad4d6cab1eec444076547b&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2603576 May 12 15:26:39.323753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:39.343335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-977d9979-9451-42c5-b73d-ad163e0b968c req-551a0772-3c88-4326-973f-38366c25d122 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:39.348651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-977d9979-9451-42c5-b73d-ad163e0b968c req-551a0772-3c88-4326-973f-38366c25d122 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 908 time: 0.4841740 May 12 15:26:39.453404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba1175f4-fccc-4c8a-a243-af8793e650b0 req-369a07a3-6c5e-41d7-a4a4-b146cb41d348 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:39.467892 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ba1175f4-fccc-4c8a-a243-af8793e650b0 req-369a07a3-6c5e-41d7-a4a4-b146cb41d348 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 1059 time: 0.3477647 May 12 15:26:39.539201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-551626bd-3b2e-4ec7-b271-89e24bf588da req-a2fd5b34-f947-4c31-91c4-3778fbc26d28 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:39.551990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-551626bd-3b2e-4ec7-b271-89e24bf588da req-a2fd5b34-f947-4c31-91c4-3778fbc26d28 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.2166455 May 12 15:26:39.651766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:39.652740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:39.653321 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:39.692712 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-551626bd-3b2e-4ec7-b271-89e24bf588da req-2d23bf66-b661-4f17-bca2-86962935eadf tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1394560 May 12 15:26:39.706160 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.3860047 May 12 15:26:39.712214 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c05c7fd-a66a-4b0e-82d6-dd0604ea2fa3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:39.715830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41696) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:39.775914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Request body: {'subnet': {'network_id': '5dc31d13-7ff5-4bf5-91b0-4b0578ae085a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerGroup264TestJSON-442518952-subnet', 'tenant_id': '0dbf28e6fb124ef7a724e41dfa9d26b6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:26:39.810706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:26:39.825915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Usage tracker for resource:subnet and tenant:0dbf28e6fb124ef7a724e41dfa9d26b6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:26:39.843184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:26:39.883590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-063f560d-16fe-4fe7-991d-d7c90b0821dc req-a1a1a47e-cca0-48f9-a691-fac47a4d92a8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:39.888032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-063f560d-16fe-4fe7-991d-d7c90b0821dc req-a1a1a47e-cca0-48f9-a691-fac47a4d92a8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1987407 May 12 15:26:39.911168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:26:39.937865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Pushing event updated for resources: {'Network': ['ID=5dc31d13-7ff5-4bf5-91b0-4b0578ae085a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:39.953119 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-063f560d-16fe-4fe7-991d-d7c90b0821dc req-dc40c87c-a8c5-4b8c-9643-0c54039befb8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0587862 May 12 15:26:39.958312 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c05c7fd-a66a-4b0e-82d6-dd0604ea2fa3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:40.002538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:40.003063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:40.003571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:40.004019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:40.004563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:40.005145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:40.005801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:40.006365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:40.006817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:40.007340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:40.007790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:40.008518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d778e54-cdc2-4abf-af6e-a6262f08074c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:40.026047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 5dc31d13-7ff5-4bf5-91b0-4b0578ae085a details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:26:40.028246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Made reservation on behalf of 0dbf28e6fb124ef7a724e41dfa9d26b6 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:26:40.031109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:40.402863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c857b59-1fff-47aa-8bbd-a17e621da9af req-a8f178ad-337d-4068-8aba-20632b8603f2 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:40.417809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c857b59-1fff-47aa-8bbd-a17e621da9af req-a8f178ad-337d-4068-8aba-20632b8603f2 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.2624803 May 12 15:26:40.557919 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c857b59-1fff-47aa-8bbd-a17e621da9af req-06d24621-b0db-40c6-8ef7-22e86ad68230 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1382895 May 12 15:26:40.578341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de69e416-36f7-4c3e-b007-3a30600f7d20 req-8d3e868c-eea4-44fb-80c8-29102b9757aa tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:40.581620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de69e416-36f7-4c3e-b007-3a30600f7d20 req-8d3e868c-eea4-44fb-80c8-29102b9757aa tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.5146265 May 12 15:26:40.683201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba1175f4-fccc-4c8a-a243-af8793e650b0 req-e5ff3aed-1329-4bf4-a927-bfc3d851ec78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:40.685238 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ba1175f4-fccc-4c8a-a243-af8793e650b0 req-e5ff3aed-1329-4bf4-a927-bfc3d851ec78 service neutron] 10.222.0.76 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 1.1861591 May 12 15:26:40.691321 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:40.769193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de69e416-36f7-4c3e-b007-3a30600f7d20 req-88ff82ce-decc-4068-9da7-3793e19d2e55 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1792872 May 12 15:26:41.019408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6376a9b9-cdd5-44db-8f9e-b9a1b353b6aa,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:41.024486 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ba1175f4-fccc-4c8a-a243-af8793e650b0 req-b974d7f6-6975-4270-943f-1ce4e467e7f3 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a1c53249-987d-432e-8065-6336089a1cc1 HTTP/1.1" status: 200 len: 217 time: 0.3241844 May 12 15:26:41.130007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461c8071-4cdf-4f01-887a-6467e0dfd1fe req-d22a7887-a6b8-4393-82df-047b5a3375d1 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:41.132195 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-461c8071-4cdf-4f01-887a-6467e0dfd1fe req-d22a7887-a6b8-4393-82df-047b5a3375d1 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2691548 May 12 15:26:41.175830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba1175f4-fccc-4c8a-a243-af8793e650b0 req-b03a598b-0d5e-44e8-b77f-afa8e5ff25ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:41.179025 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ba1175f4-fccc-4c8a-a243-af8793e650b0 req-b03a598b-0d5e-44e8-b77f-afa8e5ff25ed service neutron] 10.222.0.76 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.1479599 May 12 15:26:41.182092 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c05c7fd-a66a-4b0e-82d6-dd0604ea2fa3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:41.250857 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-461c8071-4cdf-4f01-887a-6467e0dfd1fe req-eac79956-6e3c-4760-a2ae-f85c4261e3f5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0971105 May 12 15:26:41.329016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91b681ec-b4dd-445a-8e23-5ecef158c2fa req-710964bc-10a8-4504-b70c-54a813571a35 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:41.336394 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-91b681ec-b4dd-445a-8e23-5ecef158c2fa req-710964bc-10a8-4504-b70c-54a813571a35 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.2879813 May 12 15:26:41.398465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Checking segment: {'id': 'be0c11b2-dce8-43d8-a12a-027961592175', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 585, 'network_id': '5dc31d13-7ff5-4bf5-91b0-4b0578ae085a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:26:41.405369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Network hostable DHCP agents. Network: 5dc31d13-7ff5-4bf5-91b0-4b0578ae085a, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:26:41.437437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c05c7fd-a66a-4b0e-82d6-dd0604ea2fa3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=298d5ce2-0e39-4957-ba55-bb703769d021,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:41.491206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-91b681ec-b4dd-445a-8e23-5ecef158c2fa req-dc59ac19-16e4-4829-a2d8-83cfb6bbf1af tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1537981 May 12 15:26:41.510952 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c05c7fd-a66a-4b0e-82d6-dd0604ea2fa3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:41.515852 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3c05c7fd-a66a-4b0e-82d6-dd0604ea2fa3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/298d5ce2-0e39-4957-ba55-bb703769d021 HTTP/1.1" status: 204 len: 168 time: 2.2084239 May 12 15:26:41.519050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Network 5dc31d13-7ff5-4bf5-91b0-4b0578ae085a is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:26:41.538843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba1175f4-fccc-4c8a-a243-af8793e650b0 req-d3cf4e6a-07a6-4892-bcba-d94aabf30a4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:41.542147 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ba1175f4-fccc-4c8a-a243-af8793e650b0 req-d3cf4e6a-07a6-4892-bcba-d94aabf30a4c service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3276806 May 12 15:26:41.859649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc26d77f-c2da-42a0-b533-d711a6f2bcac req-f164409f-587a-46be-beaa-9f8dc95bc429 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:41.861337 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc26d77f-c2da-42a0-b533-d711a6f2bcac req-f164409f-587a-46be-beaa-9f8dc95bc429 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1457727 May 12 15:26:41.869659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-431e2261-2300-45b7-ad1c-c0458332bfcd req-648d1877-25f9-4f52-944a-67c07f0b20d0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:41.877089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-431e2261-2300-45b7-ad1c-c0458332bfcd req-648d1877-25f9-4f52-944a-67c07f0b20d0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.3405044 May 12 15:26:41.982444 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ba1175f4-fccc-4c8a-a243-af8793e650b0 req-30e59959-2e65-4318-9007-77d4083e5a96 service neutron] 10.222.0.76 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4325640 May 12 15:26:41.984051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 5dc31d13-7ff5-4bf5-91b0-4b0578ae085a) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:26:42.031780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8e14b40-6ea5-4d6f-9834-0362d613fa19 None None] Network 5dc31d13-7ff5-4bf5-91b0-4b0578ae085a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:26:42.055630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:42.057814 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:42.083150 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc26d77f-c2da-42a0-b533-d711a6f2bcac req-2f829457-180a-40e6-99df-9258fa281b05 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2006030 May 12 15:26:42.120564 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-431e2261-2300-45b7-ad1c-c0458332bfcd req-962f1e13-4a7d-42aa-a4c1-a244dd689879 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2423384 May 12 15:26:42.390436 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ba1175f4-fccc-4c8a-a243-af8793e650b0 req-114fa714-29db-42f0-aa65-25fcc372d37b service neutron] 10.222.0.76 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4025650 May 12 15:26:42.410402 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1494c15a-e45c-4345-88e3-61b750ab80b0 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.6390083 May 12 15:26:42.485017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23deb4c4-a90c-4d68-a78a-26cf8843f5b2 None None] Network 5dc31d13-7ff5-4bf5-91b0-4b0578ae085a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:26:42.569177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2fa5640-1ee2-412e-8268-3bfd60f1d45e req-4aed605c-cbf1-4118-b390-147c6d558a93 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:42.577554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b2fa5640-1ee2-412e-8268-3bfd60f1d45e req-4aed605c-cbf1-4118-b390-147c6d558a93 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.3168089 May 12 15:26:42.598964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41730) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:42.706843 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b2fa5640-1ee2-412e-8268-3bfd60f1d45e req-d4fe464e-ecc6-4271-8b64-67eee8772d94 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1281834 May 12 15:26:42.747962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec0dbed-74ec-4e69-af89-e24201614567 req-20c3fe56-3cec-41c7-8e8b-f062de396018 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:42.762924 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eec0dbed-74ec-4e69-af89-e24201614567 req-20c3fe56-3cec-41c7-8e8b-f062de396018 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.3459570 May 12 15:26:42.776062 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8dfd85e7-efa0-42d9-b98c-c9657f6f579a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e26ee81143ac497e9077f54cf06751f6&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1722503 May 12 15:26:42.776332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41734) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:42.894504 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eec0dbed-74ec-4e69-af89-e24201614567 req-44917f32-a0a2-4c95-a772-592aecd73240 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1301088 May 12 15:26:42.944072 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-22348156-2d00-4cd8-9517-88a626c1b49d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:43.033001 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-22348156-2d00-4cd8-9517-88a626c1b49d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:43.081057 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-da8a57bb-f0a4-49da-902d-c29b6726f32f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:43.091436 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:43.174855 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-22348156-2d00-4cd8-9517-88a626c1b49d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:43.206986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22348156-2d00-4cd8-9517-88a626c1b49d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dc40e143-20d8-4863-a350-73ca69960d28,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:43.217375 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-22348156-2d00-4cd8-9517-88a626c1b49d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:43.221282 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-22348156-2d00-4cd8-9517-88a626c1b49d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/dc40e143-20d8-4863-a350-73ca69960d28 HTTP/1.1" status: 204 len: 168 time: 0.4439940 May 12 15:26:43.225869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05ac694c-8d7a-40e9-8dac-35b63de433c3 req-c62d2e86-70eb-4ffe-8fd2-b99e8595838b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:43.235927 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05ac694c-8d7a-40e9-8dac-35b63de433c3 req-c62d2e86-70eb-4ffe-8fd2-b99e8595838b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.1262274 May 12 15:26:43.301873 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05ac694c-8d7a-40e9-8dac-35b63de433c3 req-d594a1fb-3285-4900-9cca-31ee8a4abcff tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646460 May 12 15:26:43.626882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-6b739be6-a531-49f7-ac7f-f655d5961cbc tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:43.628413 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-6b739be6-a531-49f7-ac7f-f655d5961cbc tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 812 time: 0.2096884 May 12 15:26:43.645851 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-eaa13a73-314a-45d1-aa5c-6fc9361b7085 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/quotas/6357a1184f074ce2a5b5f19b5ce06e85 HTTP/1.1" status: 200 len: 375 time: 0.0113988 May 12 15:26:43.773723 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-eb4b7dd6-c2e8-4150-83f1-16bb6236f515 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&fields=id HTTP/1.1" status: 200 len: 532 time: 0.1202023 May 12 15:26:43.787057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-021faac7-f146-4ca7-bed7-88293e52110e service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:26:43.795997 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-021faac7-f146-4ca7-bed7-88293e52110e service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0141597 May 12 15:26:44.145755 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-033d4c35-bc92-4975-9438-2d984ead6816 service neutron] 10.222.0.82 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3487177 May 12 15:26:44.332661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ed43e57-d1cc-479d-89a3-2b83bf674d6c req-672c3884-9ba7-4d7c-8a5d-19b3a281f91a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:44.334230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ed43e57-d1cc-479d-89a3-2b83bf674d6c req-672c3884-9ba7-4d7c-8a5d-19b3a281f91a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.4206460 May 12 15:26:44.488437 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ed43e57-d1cc-479d-89a3-2b83bf674d6c req-1d82353e-9c90-4ab1-89c3-68467cba58ab tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1418910 May 12 15:26:44.497432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-d5ec9341-7119-451c-ada7-9e9bfc9c845e service neutron] 10.222.0.82 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3426421 May 12 15:26:44.549755 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 64936beb-03d4-4182-81be-074a96507608 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:26:44.756253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41804) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:44.888314 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-88eafe04-8eba-4aaa-a764-768f22e8baa3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:44.911776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee488a85-b2a5-4178-8ec7-6e14c4f9f308 req-34ada1ec-39b4-4bec-a85c-372c3adbe1b5 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:44.921268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 64936beb-03d4-4182-81be-074a96507608, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=64936beb-03d4-4182-81be-074a96507608,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:44.921548 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee488a85-b2a5-4178-8ec7-6e14c4f9f308 req-34ada1ec-39b4-4bec-a85c-372c3adbe1b5 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.2547655 May 12 15:26:44.952812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '64936beb-03d4-4182-81be-074a96507608', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'port_id': '64936beb-03d4-4182-81be-074a96507608', 'mac_address': 'fa:16:3e:cb:c5:b8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 573, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0ff5192a-946b-4444-900a-788b8ddc74b6', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:26:45.001869 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abadcd59-a8a8-416b-a917-16c691be72eb admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:45.026235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-abadcd59-a8a8-416b-a917-16c691be72eb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:26:45.034306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-abadcd59-a8a8-416b-a917-16c691be72eb admin admin] Usage tracker for resource:security_group_rule and tenant:3d7890c982084f618aec375a07ff7c8d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:26:45.039464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-abadcd59-a8a8-416b-a917-16c691be72eb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:26:45.049017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-abadcd59-a8a8-416b-a917-16c691be72eb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:26:45.055427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee488a85-b2a5-4178-8ec7-6e14c4f9f308 req-de549f53-f672-4e35-bb5c-2b1e514ccb11 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1263340 May 12 15:26:45.113984 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:45.168912 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 64936beb-03d4-4182-81be-074a96507608 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:26:45.202259 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 64936beb-03d4-4182-81be-074a96507608, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=64936beb-03d4-4182-81be-074a96507608,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:45.219278 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:45.260139 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abadcd59-a8a8-416b-a917-16c691be72eb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:45.277075 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abadcd59-a8a8-416b-a917-16c691be72eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:45.329048 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-abadcd59-a8a8-416b-a917-16c691be72eb admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3d7890c982084f618aec375a07ff7c8d&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5711265 May 12 15:26:45.330153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abadcd59-a8a8-416b-a917-16c691be72eb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b8b25b4-3a0b-45c2-a9d2-fdd67c9a6aea,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:45.332933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41824) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:45.360718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=64936beb-03d4-4182-81be-074a96507608,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:45.427449 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13dea852-0069-4b25-a8e0-1a3c35bad903 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:45.430871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-653c1bf8-7b65-470f-9ca6-1e46d8ce4300 req-ae7129db-f1fc-4a20-92fa-06964bb7ae3e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 210 time: 0.1219354 May 12 15:26:45.463395 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13dea852-0069-4b25-a8e0-1a3c35bad903 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:45.477423 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e020b37-043c-4b9a-807f-d047d2d49c65 req-a2a64cf8-2b7e-47c7-9966-2ed957056d3a tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:45.480757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e020b37-043c-4b9a-807f-d047d2d49c65 req-a2a64cf8-2b7e-47c7-9966-2ed957056d3a tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 944 time: 0.3196547 May 12 15:26:45.487074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['64936beb-03d4-4182-81be-074a96507608'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:26:45.569480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e020b37-043c-4b9a-807f-d047d2d49c65 req-f49577bc-c30a-4322-b8be-1e14280ec436 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0766239 May 12 15:26:45.621412 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13dea852-0069-4b25-a8e0-1a3c35bad903 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:45.649252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13dea852-0069-4b25-a8e0-1a3c35bad903 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b8b25b4-3a0b-45c2-a9d2-fdd67c9a6aea,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:45.664446 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13dea852-0069-4b25-a8e0-1a3c35bad903 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:45.667987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-13dea852-0069-4b25-a8e0-1a3c35bad903 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6b8b25b4-3a0b-45c2-a9d2-fdd67c9a6aea HTTP/1.1" status: 204 len: 168 time: 0.3327138 May 12 15:26:45.695081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41842) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:45.695403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41844) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:45.840540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-e498f2f6-a119-4b14-8950-8c2965d6ed8d admin admin] Deleting subnet 6376a9b9-cdd5-44db-8f9e-b9a1b353b6aa {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:26:45.847587 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e498f2f6-a119-4b14-8950-8c2965d6ed8d admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:45.918589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e498f2f6-a119-4b14-8950-8c2965d6ed8d admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:45.961573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abafba2f-5fb0-4992-a61b-d7390e031f19 req-8d0fe71f-cf44-4b81-9661-d4b1547c48a0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:45.969307 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-abafba2f-5fb0-4992-a61b-d7390e031f19 req-8d0fe71f-cf44-4b81-9661-d4b1547c48a0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.2220027 May 12 15:26:46.003377 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98cfc14f-9239-4483-bf0e-6e51f37db48c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.026904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-98cfc14f-9239-4483-bf0e-6e51f37db48c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:26:46.034205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-98cfc14f-9239-4483-bf0e-6e51f37db48c admin admin] Usage tracker for resource:security_group_rule and tenant:69034065ce3942e79532db56b0b441a8 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:26:46.046295 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.059643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-98cfc14f-9239-4483-bf0e-6e51f37db48c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:26:46.068393 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e498f2f6-a119-4b14-8950-8c2965d6ed8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.077307 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-abafba2f-5fb0-4992-a61b-d7390e031f19 req-97998641-0dcf-4b26-b993-3c567102b141 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1067011 May 12 15:26:46.084952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-98cfc14f-9239-4483-bf0e-6e51f37db48c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:26:46.155820 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.194938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e498f2f6-a119-4b14-8950-8c2965d6ed8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.291286 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98cfc14f-9239-4483-bf0e-6e51f37db48c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.301208 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-98cfc14f-9239-4483-bf0e-6e51f37db48c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.305206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e498f2f6-a119-4b14-8950-8c2965d6ed8d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6376a9b9-cdd5-44db-8f9e-b9a1b353b6aa,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:46.325748 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e498f2f6-a119-4b14-8950-8c2965d6ed8d admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.340085 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e498f2f6-a119-4b14-8950-8c2965d6ed8d admin admin] 10.222.0.82 "DELETE /v2.0/subnets/6376a9b9-cdd5-44db-8f9e-b9a1b353b6aa HTTP/1.1" status: 204 len: 168 time: 0.6406088 May 12 15:26:46.341475 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41870) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:46.525583 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-98cfc14f-9239-4483-bf0e-6e51f37db48c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=69034065ce3942e79532db56b0b441a8&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8280118 May 12 15:26:46.529599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98cfc14f-9239-4483-bf0e-6e51f37db48c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bbfcc03b-24c4-4ec5-abf0-1c9a97f45887,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:46.533354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41882) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:46.546231 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f991b5a0-2d14-46d6-98ee-f6f6fd46e99c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.565369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0ce28f36-b32c-468c-81e3-0dd235e15282 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:26:46.577248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 64936beb-03d4-4182-81be-074a96507608 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:26:46.662534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9e4ce8e-bdda-4ff6-ac59-4adf9035a72a req-8191e74f-cb3b-49f8-a372-dbcf2c8ae9ce tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:46.664077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9e4ce8e-bdda-4ff6-ac59-4adf9035a72a req-8191e74f-cb3b-49f8-a372-dbcf2c8ae9ce tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 944 time: 0.3141189 May 12 15:26:46.681374 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c7f13c9-38dc-4c7c-97f8-48c8b8cc2812 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.705647 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f991b5a0-2d14-46d6-98ee-f6f6fd46e99c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.747476 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c7f13c9-38dc-4c7c-97f8-48c8b8cc2812 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.757348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f991b5a0-2d14-46d6-98ee-f6f6fd46e99c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5dc31d13-7ff5-4bf5-91b0-4b0578ae085a']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:26:46.775929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9e4ce8e-bdda-4ff6-ac59-4adf9035a72a req-55c35c59-2871-4fa2-91f5-0bc90c2945c6 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0959029 May 12 15:26:46.792993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f991b5a0-2d14-46d6-98ee-f6f6fd46e99c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'be0c11b2-dce8-43d8-a12a-027961592175') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:26:46.793952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f991b5a0-2d14-46d6-98ee-f6f6fd46e99c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'be0c11b2-dce8-43d8-a12a-027961592175') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:26:46.836885 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c7f13c9-38dc-4c7c-97f8-48c8b8cc2812 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.842957 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f991b5a0-2d14-46d6-98ee-f6f6fd46e99c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.888517 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:26:46.890986 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c7f13c9-38dc-4c7c-97f8-48c8b8cc2812 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bbfcc03b-24c4-4ec5-abf0-1c9a97f45887,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:46.911756 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f991b5a0-2d14-46d6-98ee-f6f6fd46e99c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.916879 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c7f13c9-38dc-4c7c-97f8-48c8b8cc2812 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:46.918141 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9c7f13c9-38dc-4c7c-97f8-48c8b8cc2812 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bbfcc03b-24c4-4ec5-abf0-1c9a97f45887 HTTP/1.1" status: 204 len: 168 time: 0.3837874 May 12 15:26:46.932189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f991b5a0-2d14-46d6-98ee-f6f6fd46e99c admin admin] Releasing vlan 585 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:26:46.932600 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f991b5a0-2d14-46d6-98ee-f6f6fd46e99c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:47.255262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 64936beb-03d4-4182-81be-074a96507608 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:26:47.255761 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: timer() May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:26:47.413713 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:26:47.443139 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f991b5a0-2d14-46d6-98ee-f6f6fd46e99c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:47.450468 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11336f98-4595-4192-a103-7dfc385bcade req-af42f358-02ae-4b1c-a0ac-ed079afa020e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 210 time: 0.2489295 May 12 15:26:47.502236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0ce28f36-b32c-468c-81e3-0dd235e15282,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:47.561507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'port_id': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'mac_address': 'fa:16:3e:c4:85:6e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 558, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:26:47.563097 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f991b5a0-2d14-46d6-98ee-f6f6fd46e99c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:47.613568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f991b5a0-2d14-46d6-98ee-f6f6fd46e99c admin admin] Pushing event deleted for resources: {'Network': ['ID=5dc31d13-7ff5-4bf5-91b0-4b0578ae085a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:47.630819 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f991b5a0-2d14-46d6-98ee-f6f6fd46e99c admin admin] 10.222.0.82 "DELETE /v2.0/networks/5dc31d13-7ff5-4bf5-91b0-4b0578ae085a HTTP/1.1" status: 204 len: 168 time: 1.2882156 May 12 15:26:47.652453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e0599e-b4d2-4097-9218-dd8e894b236e req-65874b90-bcc2-4444-b673-92ac198db541 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:47.653942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23e0599e-b4d2-4097-9218-dd8e894b236e req-65874b90-bcc2-4444-b673-92ac198db541 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e5a10df576841e2a4752a9d47fb790a&device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 1098 time: 0.2019975 May 12 15:26:47.748916 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:47.765994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-89d543c4-1666-4b60-b989-26da7390b0aa tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:47.769738 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-89d543c4-1666-4b60-b989-26da7390b0aa tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 812 time: 0.3504100 May 12 15:26:47.815722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0ce28f36-b32c-468c-81e3-0dd235e15282 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:26:47.820503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Request body: {'port': {'device_id': 'bd320183-5cdb-430c-beea-7c2caa66e5b4', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'admin_state_up': True, 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:26:47.829503 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:47.846911 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:47.855087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0ce28f36-b32c-468c-81e3-0dd235e15282,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:47.863029 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:47.895100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-779dced5-b151-4fa3-bf90-831e321fe987 req-fe444d0b-547e-42d0-a9c0-4ba4d2856641 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:47.904095 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-779dced5-b151-4fa3-bf90-831e321fe987 req-fe444d0b-547e-42d0-a9c0-4ba4d2856641 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 944 time: 0.7998123 May 12 15:26:47.905916 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '12215d44-186e-4901-81f8-0c2cf89b7793', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '64936beb-03d4-4182-81be-074a96507608'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:26:47.944810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 64936beb-03d4-4182-81be-074a96507608, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=64936beb-03d4-4182-81be-074a96507608,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:47.957354 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:47.975708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=0ce28f36-b32c-468c-81e3-0dd235e15282,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:47.985118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41926) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:47.999623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:48.001856 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:48.003624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:48.005042 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:48.010754 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:48.011368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:48.012226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:48.012918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:48.013652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:48.014882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:48.015774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:48.017621 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:48.132423 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-779dced5-b151-4fa3-bf90-831e321fe987 req-b3fa15d9-dc99-4264-a92b-dc52599375cc tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2272696 May 12 15:26:48.183006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=64936beb-03d4-4182-81be-074a96507608,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:48.202019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-61ca1db9-fae1-46e6-a2e2-1dfa3552dda2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0dbf28e6fb124ef7a724e41dfa9d26b6&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2090220 May 12 15:26:48.207493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41930) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:48.229292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:26:48.236042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Usage tracker for resource:port and tenant:6357a1184f074ce2a5b5f19b5ce06e85 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:26:48.239923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Quota usage for port was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:26:48.242569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e0599e-b4d2-4097-9218-dd8e894b236e req-c23c5e87-3aae-4e4e-a08c-ad3b618e4fe3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:48.244535 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23e0599e-b4d2-4097-9218-dd8e894b236e req-c23c5e87-3aae-4e4e-a08c-ad3b618e4fe3 service neutron] 10.222.0.84 "GET /v2.0/networks?id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61 HTTP/1.1" status: 200 len: 914 time: 0.5802267 May 12 15:26:48.260576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attempting to reserve 1 items for resource port. Total usage: 7; quota limit: 500; headroom:493 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:26:48.285794 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Made reservation on behalf of 6357a1184f074ce2a5b5f19b5ce06e85 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:26:48.291590 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:48.306685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['0ce28f36-b32c-468c-81e3-0dd235e15282'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:26:48.450366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23e0599e-b4d2-4097-9218-dd8e894b236e req-77c1415e-e759-4d65-b4af-1d6d7591b1d1 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f HTTP/1.1" status: 200 len: 217 time: 0.1875613 May 12 15:26:48.583809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Allocated IP 172.20.0.6 (de9b95bc-97c4-4188-a1d0-c125f35032b0/f6980e11-e336-4f1d-9b2b-4462912e9abb/4687abde-8849-46ae-a349-bef53372a376) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:26:48.836846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a536e6e-743e-4803-b602-e11c99558b3f req-5500ff61-8bb2-4619-8f65-d3783d5cc10a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:48.854857 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a536e6e-743e-4803-b602-e11c99558b3f req-5500ff61-8bb2-4619-8f65-d3783d5cc10a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.9186199 May 12 15:26:48.914376 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:48.934238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e0599e-b4d2-4097-9218-dd8e894b236e req-d3a5445e-699a-422d-bd96-ab829e1efe1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:48.943655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23e0599e-b4d2-4097-9218-dd8e894b236e req-d3a5445e-699a-422d-bd96-ab829e1efe1d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c90f4328-5e3e-4311-a3b6-84cff19a6919 HTTP/1.1" status: 200 len: 853 time: 0.3240237 May 12 15:26:48.947209 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:48.949562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Transition to ACTIVE for port object 4687abde-8849-46ae-a349-bef53372a376 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:26:49.007560 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:49.154038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Network de9b95bc-97c4-4188-a1d0-c125f35032b0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:26:49.155430 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23e0599e-b4d2-4097-9218-dd8e894b236e req-8b8c592c-f974-4bed-becd-029b26fc6049 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aab37dc4-92bf-4fd9-8482-5e3a3f715d61&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1760309 May 12 15:26:49.159065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:26:49.162608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:26:49.176549 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a536e6e-743e-4803-b602-e11c99558b3f req-690a0253-1701-4258-a1fe-120953ce4b7d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3207352 May 12 15:26:49.179949 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:49.236060 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2f22a71-5ebc-4e4b-82f0-253e9aa4400d req-d8ac0e47-2c78-4ba3-b2b1-6b5c96c11907 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:49.256279 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e2f22a71-5ebc-4e4b-82f0-253e9aa4400d req-d8ac0e47-2c78-4ba3-b2b1-6b5c96c11907 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 945 time: 0.8048429 May 12 15:26:49.292853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event updated for resources: {'Port': ['ID=4687abde-8849-46ae-a349-bef53372a376,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:49.309785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['7e0c7266-ad09-4620-bfdc-81de7da01d15', 'bdd6d277-b9d3-4e93-bfc7-66dd6ac96203'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:26:49.341126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:49.344882 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:49.413339 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e42f66e9-5cfa-48d4-91a4-5c33dab6fe78 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6025879 May 12 15:26:49.438449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Request body: {'port': {'device_id': 'bd320183-5cdb-430c-beea-7c2caa66e5b4', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:26:49.483954 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-98e3cca5-752b-4ea5-b039-f76bd56396f1'] response: {'server_uuid': '12215d44-186e-4901-81f8-0c2cf89b7793', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '64936beb-03d4-4182-81be-074a96507608', 'code': 200} May 12 15:26:49.712467 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:49.786264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9e3c184e-a385-4e28-9c33-d6fd3841c5dd None None] Provisioning for port 4687abde-8849-46ae-a349-bef53372a376 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:26:49.805033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9e3c184e-a385-4e28-9c33-d6fd3841c5dd None None] Provisioning complete for port 4687abde-8849-46ae-a349-bef53372a376 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:26:49.805411 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9e3c184e-a385-4e28-9c33-d6fd3841c5dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:49.917113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9e3c184e-a385-4e28-9c33-d6fd3841c5dd None None] Port 4687abde-8849-46ae-a349-bef53372a376 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:26:49.989706 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23e0599e-b4d2-4097-9218-dd8e894b236e req-934439c7-7fb3-4b3a-9182-b92a00ce253c service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8119137 May 12 15:26:50.011160 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e2f22a71-5ebc-4e4b-82f0-253e9aa4400d req-73785279-b02b-42b6-8ccf-edc4cab64adc tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.7539151 May 12 15:26:50.409989 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:50.420358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4687abde-8849-46ae-a349-bef53372a376 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:26:50.439308 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:50.442204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7b1a599-3621-42b3-84df-3e6552e4113e req-db07a83d-681b-4a65-958a-df22a176fa15 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:50.451571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7b1a599-3621-42b3-84df-3e6552e4113e req-db07a83d-681b-4a65-958a-df22a176fa15 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 931 time: 0.7579951 May 12 15:26:50.470672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Transition to ACTIVE for port object 4687abde-8849-46ae-a349-bef53372a376 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:26:50.474189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=90a2b90c-bafd-492f-a669-ea7aec6b7c0c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:50.483080 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:50.520084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:50.520457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:50.521103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:50.521540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:50.521969 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:50.522338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:50.522749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:50.523136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:50.523528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:50.523918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:50.524308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:50.525552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:26:50.567743 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7b1a599-3621-42b3-84df-3e6552e4113e req-f64c336a-fe9e-4eb2-a72b-c4801a915778 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1147368 May 12 15:26:50.573428 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:50.578961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-14bcfcd3-1c53-4445-a9d0-8c4e7b799907 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/90a2b90c-bafd-492f-a669-ea7aec6b7c0c HTTP/1.1" status: 204 len: 168 time: 2.3687987 May 12 15:26:50.582301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0ce28f36-b32c-468c-81e3-0dd235e15282 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:26:50.647150 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23e0599e-b4d2-4097-9218-dd8e894b236e req-6e570980-5ce3-4f65-bb03-4336f607a9a4 service neutron] 10.222.0.84 "GET /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6289611 May 12 15:26:50.675599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-399d46ec-6d20-4a74-a1af-fef8f4cc6545 req-3b08ae11-6519-4fa2-bccb-7f8065889d2b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:50.692074 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-399d46ec-6d20-4a74-a1af-fef8f4cc6545 req-3b08ae11-6519-4fa2-bccb-7f8065889d2b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.4250278 May 12 15:26:50.720822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Pushing event updated for resources: {'Port': ['ID=4687abde-8849-46ae-a349-bef53372a376,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:50.854643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 0ce28f36-b32c-468c-81e3-0dd235e15282 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:26:50.855145 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:50.874084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-399d46ec-6d20-4a74-a1af-fef8f4cc6545 req-1649b0ad-2ba4-4ecb-9123-9956b19baa7c tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1806395 May 12 15:26:51.036482 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09088e8d-35de-4139-9545-539272a376c3 req-7165808b-2ea4-4692-91ef-6db9b704b791 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:51.061248 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09088e8d-35de-4139-9545-539272a376c3 req-7165808b-2ea4-4692-91ef-6db9b704b791 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.1734896 May 12 15:26:51.150568 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:51.224892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09088e8d-35de-4139-9545-539272a376c3 req-eb930354-75ad-483a-971f-9fd3fffcd682 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1541448 May 12 15:26:51.259640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0ce28f36-b32c-468c-81e3-0dd235e15282,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:51.271849 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:51.489624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:26:51.515366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=0ce28f36-b32c-468c-81e3-0dd235e15282,revision_number=10']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:51.518934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Attempting to bind port 4687abde-8849-46ae-a349-bef53372a376 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:26:51.519859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Attempting to bind port 4687abde-8849-46ae-a349-bef53372a376 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:26:51.521315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Attempting to bind port 4687abde-8849-46ae-a349-bef53372a376 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:26:51.531368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Port 4687abde-8849-46ae-a349-bef53372a376 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:26:51.531643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Attempting to bind port 4687abde-8849-46ae-a349-bef53372a376 on network de9b95bc-97c4-4188-a1d0-c125f35032b0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:26:51.551000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 26, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:26:51.553895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Checking segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:26:51.555689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Bound using segment: {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:26:51.557979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Bound port: 4687abde-8849-46ae-a349-bef53372a376, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '03b93164-9692-40b8-b556-05bf788275b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:26:51.558616 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:51.661150 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d46ac257-114c-4167-b2bc-4528a6aea57c'] response: {'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'code': 200} May 12 15:26:51.798709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d964f01-ee28-46cc-8ef5-e3d372076d53 req-53899b16-cb55-4242-a68d-a6a0b9834a5a tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:51.830636 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d964f01-ee28-46cc-8ef5-e3d372076d53 req-53899b16-cb55-4242-a68d-a6a0b9834a5a tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 947 time: 0.4906476 May 12 15:26:51.948301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] For port 4687abde-8849-46ae-a349-bef53372a376, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:26:51.954569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] For port 4687abde-8849-46ae-a349-bef53372a376, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4687abde-8849-46ae-a349-bef53372a376,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:26:51.966973 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:51.996929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d964f01-ee28-46cc-8ef5-e3d372076d53 req-b361bd06-7b47-4e11-ae42-f766d83c346e tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1634104 May 12 15:26:52.210245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf991641-4b7e-4955-99ac-7893de7866ff req-f2c22266-f462-46b6-9c9f-eb1211c17ffc tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:52.219164 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf991641-4b7e-4955-99ac-7893de7866ff req-f2c22266-f462-46b6-9c9f-eb1211c17ffc tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 943 time: 0.2198548 May 12 15:26:52.376469 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf991641-4b7e-4955-99ac-7893de7866ff req-3a6f17ac-4cd8-4ac4-9c98-320a3e504aec tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1521907 May 12 15:26:52.512913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:52.522446 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:52.522446 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] 10.222.0.84 "PUT /v2.0/ports/4687abde-8849-46ae-a349-bef53372a376 HTTP/1.1" status: 200 len: 1091 time: 3.0940363 May 12 15:26:52.529340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bd320183-5cdb-430c-beea-7c2caa66e5b4', 'tag': '4687abde-8849-46ae-a349-bef53372a376'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:26:53.013173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00129009-c179-4608-a60c-e2d6a9613a51 service neutron] Pushing event updated for resources: {'Port': ['ID=4687abde-8849-46ae-a349-bef53372a376,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:53.069612 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-abfcadf1-bca0-487f-b75e-4b2087a29875 req-e6fba3c6-72fd-4bff-934f-cda9a65938fb service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.4587278 May 12 15:26:53.110109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e9906d86-3479-4e64-be27-c33ed5036204 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:53.112609 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-e9906d86-3479-4e64-be27-c33ed5036204 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 1094 time: 0.3674212 May 12 15:26:53.145945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c07ead48-5ba6-4c25-bd32-f5936214f399 req-bcb857b8-c599-4b78-93ce-df823bf5c928 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:53.147462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c07ead48-5ba6-4c25-bd32-f5936214f399 req-bcb857b8-c599-4b78-93ce-df823bf5c928 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 1098 time: 0.7744844 May 12 15:26:53.251980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc201bb9-be0d-4f8c-aecf-da67f631fa25 req-2f9e2602-4df5-4102-8f7a-1325ed72c2a5 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:53.259979 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc201bb9-be0d-4f8c-aecf-da67f631fa25 req-2f9e2602-4df5-4102-8f7a-1325ed72c2a5 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.5662763 May 12 15:26:53.317260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de68ef5a-6f64-4eb5-b83e-20b3dbd9934e req-47b4df43-a459-4dc4-936e-9e942044c43e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:53.321246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de68ef5a-6f64-4eb5-b83e-20b3dbd9934e req-47b4df43-a459-4dc4-936e-9e942044c43e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.6325092 May 12 15:26:53.366090 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-4119b351-1cba-443e-b1b9-12f8ef66b8d5 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4687abde-8849-46ae-a349-bef53372a376 HTTP/1.1" status: 200 len: 217 time: 0.1934543 May 12 15:26:53.496367 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c07ead48-5ba6-4c25-bd32-f5936214f399 req-dc0a54ef-f7a9-4b33-ab71-6c5a48fc6bc9 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.3319755 May 12 15:26:53.553373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc201bb9-be0d-4f8c-aecf-da67f631fa25 req-633b90cb-858f-4871-bb7f-3411cdb222ef tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2924306 May 12 15:26:53.565645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-6a6ea61e-a796-4508-aad4-4fcabda20a6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:53.580869 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-6a6ea61e-a796-4508-aad4-4fcabda20a6f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.1979311 May 12 15:26:53.584899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abfcadf1-bca0-487f-b75e-4b2087a29875 req-59f6b0a1-6358-4e83-ad3b-595caa7ec758 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:53.586676 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-abfcadf1-bca0-487f-b75e-4b2087a29875 req-59f6b0a1-6358-4e83-ad3b-595caa7ec758 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=f4660a6351274a7796c2eb1e55a41ec9&device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 1097 time: 0.4799292 May 12 15:26:53.675907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de68ef5a-6f64-4eb5-b83e-20b3dbd9934e req-12c562fe-b825-4ede-9f35-a448e7ccbe76 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3274512 May 12 15:26:53.827106 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d6f69140-9ef5-49ad-bd03-bb91dbaead85'] response: {'name': 'network-changed', 'server_uuid': 'bd320183-5cdb-430c-beea-7c2caa66e5b4', 'tag': '4687abde-8849-46ae-a349-bef53372a376', 'status': 'completed', 'code': 200} May 12 15:26:54.132687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abfcadf1-bca0-487f-b75e-4b2087a29875 req-5357e0e8-2bf2-4405-83f6-3883d4ef9413 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:54.137246 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-abfcadf1-bca0-487f-b75e-4b2087a29875 req-5357e0e8-2bf2-4405-83f6-3883d4ef9413 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e1655f9a-2478-49d5-a6ca-4fec717d6816 HTTP/1.1" status: 200 len: 912 time: 0.5257268 May 12 15:26:54.155392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-d7350779-fda7-4950-97d2-7535ea9a4cf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:54.160337 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-d7350779-fda7-4950-97d2-7535ea9a4cf8 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3202865 May 12 15:26:54.170409 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a59f3e6b-5c7c-45d7-ae43-1ec6abcc4237 req-5efd21f0-5308-4c8f-9b7a-c202d7afe2a9 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:54.188165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a59f3e6b-5c7c-45d7-ae43-1ec6abcc4237 req-5efd21f0-5308-4c8f-9b7a-c202d7afe2a9 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 943 time: 0.2201381 May 12 15:26:54.238701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ec20f2-bb39-450b-a666-d713a62cdcbd req-83903ca6-9acb-4a6b-9e9d-ac6ae6aa8a7e tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:54.247894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8ec20f2-bb39-450b-a666-d713a62cdcbd req-83903ca6-9acb-4a6b-9e9d-ac6ae6aa8a7e tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 947 time: 0.2009234 May 12 15:26:54.400843 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8ec20f2-bb39-450b-a666-d713a62cdcbd req-cccbc4b3-b592-4510-8856-0354f77ca02a tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1514845 May 12 15:26:54.427084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a59f3e6b-5c7c-45d7-ae43-1ec6abcc4237 req-83eab308-5321-4d7d-8b26-7834bc6ed5c0 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2379947 May 12 15:26:54.498693 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-abfcadf1-bca0-487f-b75e-4b2087a29875 req-c0074887-db2c-411b-adaa-1eb7fb2d1db9 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d4f9886d-fb34-4a11-9462-3343e8a12db0 HTTP/1.1" status: 200 len: 1002 time: 0.3528640 May 12 15:26:54.632106 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-c81dbe19-d141-4dfe-ba9b-a552f90069ff service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3444684 May 12 15:26:54.709847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abfcadf1-bca0-487f-b75e-4b2087a29875 req-30bd1de3-8f1b-4baf-ae41-2baa8fb5a9f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:54.711326 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-abfcadf1-bca0-487f-b75e-4b2087a29875 req-30bd1de3-8f1b-4baf-ae41-2baa8fb5a9f1 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=83787d82-d8a5-4f12-a025-f44dcf581189 HTTP/1.1" status: 200 len: 850 time: 0.2045214 May 12 15:26:54.941322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27c5d80e-d6e4-4f13-95a7-2b4027472357 req-aade5520-a99b-4fbd-8e20-5d579d96c712 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:54.961114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27c5d80e-d6e4-4f13-95a7-2b4027472357 req-aade5520-a99b-4fbd-8e20-5d579d96c712 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.3166692 May 12 15:26:55.072898 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7505103-1f7e-4aa8-95c1-e7ca1eb088c2 req-1235f0a5-be6a-4b88-b68c-5d4279311de1 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4273539 May 12 15:26:55.083240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27c5d80e-d6e4-4f13-95a7-2b4027472357 req-95f69df9-52bd-46aa-aa34-99603a040ebc tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1194165 May 12 15:26:55.183676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abfcadf1-bca0-487f-b75e-4b2087a29875 req-7624dfef-21c2-49eb-adc1-f7a57400f929 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:55.185752 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-abfcadf1-bca0-487f-b75e-4b2087a29875 req-7624dfef-21c2-49eb-adc1-f7a57400f929 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e1655f9a-2478-49d5-a6ca-4fec717d6816&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3374057 May 12 15:26:55.602210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8550771a-2ea5-45c9-9b05-1cfbcb07ede9 req-93739f2b-f200-487a-93de-5d78fbede620 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:55.604713 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8550771a-2ea5-45c9-9b05-1cfbcb07ede9 req-93739f2b-f200-487a-93de-5d78fbede620 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 1094 time: 0.4119596 May 12 15:26:55.609007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e881802c-980a-4b5f-8a6d-ab32c07a88c9 req-5c793fce-00ce-44db-8e39-bfdf93a6c744 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:55.616344 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e881802c-980a-4b5f-8a6d-ab32c07a88c9 req-5c793fce-00ce-44db-8e39-bfdf93a6c744 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.2849872 May 12 15:26:55.712109 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e881802c-980a-4b5f-8a6d-ab32c07a88c9 req-44ac9c43-f13e-444b-b316-f374996f835b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0945923 May 12 15:26:55.882775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8550771a-2ea5-45c9-9b05-1cfbcb07ede9 req-fa80a5e7-ee8b-40a3-aa6b-d390ac4ce7d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:55.886406 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8550771a-2ea5-45c9-9b05-1cfbcb07ede9 req-fa80a5e7-ee8b-40a3-aa6b-d390ac4ce7d7 service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.2279234 May 12 15:26:55.900272 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-abfcadf1-bca0-487f-b75e-4b2087a29875 req-a5e3e9a3-1ed8-429c-9abe-dea90dc8cf54 service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5922692 May 12 15:26:56.004992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb955f32-8a17-42fc-b7ff-54b942fd2268 req-4399d836-d6e7-425e-b2c3-599baadd4640 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:56.015882 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb955f32-8a17-42fc-b7ff-54b942fd2268 req-4399d836-d6e7-425e-b2c3-599baadd4640 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 947 time: 0.1507244 May 12 15:26:56.140387 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb955f32-8a17-42fc-b7ff-54b942fd2268 req-5ffd9b45-04dc-489e-ab0c-7d5b4bc45901 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1223681 May 12 15:26:56.284113 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8550771a-2ea5-45c9-9b05-1cfbcb07ede9 req-143b0abc-82c6-4f8a-970d-eb949b47de6a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4687abde-8849-46ae-a349-bef53372a376 HTTP/1.1" status: 200 len: 217 time: 0.3827081 May 12 15:26:56.385729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8550771a-2ea5-45c9-9b05-1cfbcb07ede9 req-e29391d6-0874-42a0-b706-3cb220a236b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:56.390729 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8550771a-2ea5-45c9-9b05-1cfbcb07ede9 req-e29391d6-0874-42a0-b706-3cb220a236b1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.0819166 May 12 15:26:56.540379 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-abfcadf1-bca0-487f-b75e-4b2087a29875 req-c94b26a7-f376-4ce4-92f9-90db4fe8e181 service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3962080 May 12 15:26:56.551442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8550771a-2ea5-45c9-9b05-1cfbcb07ede9 req-e76526f3-0c7d-4e3b-acb0-18c79a3e9dd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:56.553276 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8550771a-2ea5-45c9-9b05-1cfbcb07ede9 req-e76526f3-0c7d-4e3b-acb0-18c79a3e9dd0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1497476 May 12 15:26:56.704535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71fac739-0a78-4f81-878e-6eaee5ce42e1 req-296e391f-1c33-4cc3-8258-1ed0a1580e74 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:56.708934 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71fac739-0a78-4f81-878e-6eaee5ce42e1 req-296e391f-1c33-4cc3-8258-1ed0a1580e74 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 943 time: 0.3155091 May 12 15:26:56.863880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71fac739-0a78-4f81-878e-6eaee5ce42e1 req-4f940f5d-11dd-4d4c-bfc0-da33417b904f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1477537 May 12 15:26:56.964919 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8550771a-2ea5-45c9-9b05-1cfbcb07ede9 req-b04fd702-dd2d-4c48-a792-8a01b7c00c05 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4014311 May 12 15:26:57.286547 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8550771a-2ea5-45c9-9b05-1cfbcb07ede9 req-0d86d64e-f339-4bbd-b021-f65de6397482 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3126903 May 12 15:26:57.324881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca69747a-48fe-466b-94f2-2ef558379647 req-af439cfa-806a-4211-b802-575459c42282 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:57.326520 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca69747a-48fe-466b-94f2-2ef558379647 req-af439cfa-806a-4211-b802-575459c42282 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.3005257 May 12 15:26:57.370998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0104733-6225-4ddd-9040-b0b9a5501b6d req-5f9ec8e4-b553-4078-a8ca-2a2360aae93e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:57.378326 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0104733-6225-4ddd-9040-b0b9a5501b6d req-5f9ec8e4-b553-4078-a8ca-2a2360aae93e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.2934659 May 12 15:26:57.500822 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca69747a-48fe-466b-94f2-2ef558379647 req-c826ee5b-1ced-4728-b99f-609bd4407af0 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1663303 May 12 15:26:57.526303 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0104733-6225-4ddd-9040-b0b9a5501b6d req-35efb889-4c9e-4177-82c3-877d3a62a98d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1470549 May 12 15:26:57.820305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3af8c464-dea1-48b5-883c-3565bf3c10ac req-065ff82b-6cfd-4639-9a31-a483f5162de6 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.1906719 May 12 15:26:57.937162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee0597b2-0fee-4c41-92ee-618e5d386105 req-3d656d4e-d7ba-4839-bab4-081fa65ef216 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:57.940159 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee0597b2-0fee-4c41-92ee-618e5d386105 req-3d656d4e-d7ba-4839-bab4-081fa65ef216 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 947 time: 0.2033813 May 12 15:26:58.190255 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee0597b2-0fee-4c41-92ee-618e5d386105 req-731ee6ee-9ac5-4d8d-888a-3ecc1dcb7dbd tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2396336 May 12 15:26:58.364507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40f4d405-987f-40ef-8d1e-bec311113198 req-d7611f3c-5385-461a-a9be-eaf48a7ad5f2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:58.390838 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40f4d405-987f-40ef-8d1e-bec311113198 req-d7611f3c-5385-461a-a9be-eaf48a7ad5f2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.3362052 May 12 15:26:58.549510 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40f4d405-987f-40ef-8d1e-bec311113198 req-4b03d30a-575f-4fc5-8199-2b988d3de86d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1494243 May 12 15:26:58.600940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4687abde-8849-46ae-a349-bef53372a376 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:26:58.989733 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4687abde-8849-46ae-a349-bef53372a376, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4687abde-8849-46ae-a349-bef53372a376,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:59.025712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '4687abde-8849-46ae-a349-bef53372a376', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'port_id': '4687abde-8849-46ae-a349-bef53372a376', 'mac_address': 'fa:16:3e:13:ac:ad', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 579, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:26:59.145184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a4d8a34-bf9b-4065-a296-a5ecfc07a301 req-0a242fe7-55b1-44b7-b88e-7562a6c060b9 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:59.147656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a4d8a34-bf9b-4065-a296-a5ecfc07a301 req-0a242fe7-55b1-44b7-b88e-7562a6c060b9 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.2566471 May 12 15:26:59.174205 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:59.222114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4687abde-8849-46ae-a349-bef53372a376 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:26:59.249773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9f30d42-f8a9-428e-afc7-22d441d03f95 req-23bc56c7-d68c-48c2-b66c-44ed7b04ba6e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:26:59.263311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9f30d42-f8a9-428e-afc7-22d441d03f95 req-23bc56c7-d68c-48c2-b66c-44ed7b04ba6e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 943 time: 0.4622660 May 12 15:26:59.277763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4687abde-8849-46ae-a349-bef53372a376, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4687abde-8849-46ae-a349-bef53372a376,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:26:59.286449 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:59.380399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4687abde-8849-46ae-a349-bef53372a376,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:26:59.449741 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9f30d42-f8a9-428e-afc7-22d441d03f95 req-da098de0-3616-4b14-9102-6d4743493226 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1722350 May 12 15:26:59.460102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a4d8a34-bf9b-4065-a296-a5ecfc07a301 req-c283bc16-94d4-42e5-b546-b4f694b7e29a tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3020408 May 12 15:26:59.600220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42188) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:26:59.695490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['4687abde-8849-46ae-a349-bef53372a376'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:26:59.819708 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5674b706-97ce-42a2-b7fd-289db62a57de req-db796e48-5b67-48dd-bdf9-f0eef90fa390 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.0884018 May 12 15:26:59.895842 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b7f9981-ba87-4cd1-a6d6-d06ccddfcf09 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:26:59.919649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1b7f9981-ba87-4cd1-a6d6-d06ccddfcf09 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:26:59.924879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1b7f9981-ba87-4cd1-a6d6-d06ccddfcf09 admin admin] Usage tracker for resource:security_group_rule and tenant:fcebb0be4bd14705ac74f88a8edcf0b2 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:26:59.929321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1b7f9981-ba87-4cd1-a6d6-d06ccddfcf09 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:26:59.936255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1b7f9981-ba87-4cd1-a6d6-d06ccddfcf09 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:00.054050 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b7f9981-ba87-4cd1-a6d6-d06ccddfcf09 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:00.167763 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b7f9981-ba87-4cd1-a6d6-d06ccddfcf09 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:00.249780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1b7f9981-ba87-4cd1-a6d6-d06ccddfcf09 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=fcebb0be4bd14705ac74f88a8edcf0b2&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6459477 May 12 15:27:00.250184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42206) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:00.254410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7f9981-ba87-4cd1-a6d6-d06ccddfcf09 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d9f017f-d073-4fa5-9695-27897459b99d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:00.292052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cd40fc9-9af6-4601-a358-d375d2e59adb req-96ec03b5-5998-414f-8c9f-3ed92e3d08c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:00.293596 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4cd40fc9-9af6-4601-a358-d375d2e59adb req-96ec03b5-5998-414f-8c9f-3ed92e3d08c0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.2371933 May 12 15:27:00.389764 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d9d5d99-eea1-4651-b876-2b9e1e8a05df admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:00.412797 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4cd40fc9-9af6-4601-a358-d375d2e59adb req-686f8b51-7513-4e51-b557-450e3fec9518 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1129043 May 12 15:27:00.455483 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d9d5d99-eea1-4651-b876-2b9e1e8a05df admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:00.537501 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d9d5d99-eea1-4651-b876-2b9e1e8a05df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:00.557152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d9d5d99-eea1-4651-b876-2b9e1e8a05df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d9f017f-d073-4fa5-9695-27897459b99d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:00.574383 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d9d5d99-eea1-4651-b876-2b9e1e8a05df admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:00.575807 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5d9d5d99-eea1-4651-b876-2b9e1e8a05df admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3d9f017f-d073-4fa5-9695-27897459b99d HTTP/1.1" status: 204 len: 168 time: 0.3240864 May 12 15:27:00.825181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0673b096-7d1e-49ab-83ef-60c2a3f764e7 req-e6f448ac-687c-45df-98a8-7ce52367d359 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:00.835683 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0673b096-7d1e-49ab-83ef-60c2a3f764e7 req-e6f448ac-687c-45df-98a8-7ce52367d359 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 944 time: 0.1250992 May 12 15:27:00.961098 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0673b096-7d1e-49ab-83ef-60c2a3f764e7 req-632f4eda-0fef-4132-98bb-5143b89c5eea tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1244619 May 12 15:27:01.042637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6d8514-5feb-4df3-b1d6-1d03af20f838 req-a0c99d53-6343-463f-ac15-2aa3457be9a6 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:01.052971 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a6d8514-5feb-4df3-b1d6-1d03af20f838 req-a0c99d53-6343-463f-ac15-2aa3457be9a6 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.1979427 May 12 15:27:01.152156 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a6d8514-5feb-4df3-b1d6-1d03af20f838 req-e3e41dc0-7708-466b-83ab-eee1f9db96fa tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0917175 May 12 15:27:01.211946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42224) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:01.251283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0e9bd97-9115-41c8-a3e3-d19c251d013c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:01.292535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d0e9bd97-9115-41c8-a3e3-d19c251d013c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:01.300062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d0e9bd97-9115-41c8-a3e3-d19c251d013c admin admin] Usage tracker for resource:security_group_rule and tenant:938a3902360a494abe485a54a04c206c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:01.310951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d0e9bd97-9115-41c8-a3e3-d19c251d013c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:01.320424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d0e9bd97-9115-41c8-a3e3-d19c251d013c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:01.355126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9601352-28b8-4d30-911e-db3dfcd36546 req-813c4111-1274-44e9-992a-0086c9bae344 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:01.365580 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9601352-28b8-4d30-911e-db3dfcd36546 req-813c4111-1274-44e9-992a-0086c9bae344 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.1798775 May 12 15:27:01.482237 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-88bb6b41-d12d-4786-91ae-765b392e411d req-32744e1c-af19-4147-9862-6be8a8e71def service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.0681634 May 12 15:27:01.502176 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9601352-28b8-4d30-911e-db3dfcd36546 req-9e452248-3c1a-4a35-b81c-7d181ff69caa tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1353636 May 12 15:27:01.578026 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5f926eb-1096-4f88-abc5-2cb2431a019e req-d59c359c-d4ad-4bfb-a7d8-80536a1fdd21 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.0924120 May 12 15:27:01.588474 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0e9bd97-9115-41c8-a3e3-d19c251d013c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:01.597294 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0e9bd97-9115-41c8-a3e3-d19c251d013c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:01.651029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0e9bd97-9115-41c8-a3e3-d19c251d013c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d5931a19-ea74-42c0-9f2d-4c1fe1ce5400,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:01.659259 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d0e9bd97-9115-41c8-a3e3-d19c251d013c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=938a3902360a494abe485a54a04c206c&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4430795 May 12 15:27:01.661373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42232) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:01.798228 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-451169c3-43f0-4d18-9c36-262ec8c30c1a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:01.827185 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-451169c3-43f0-4d18-9c36-262ec8c30c1a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:01.892043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca9cbcf0-7faf-4933-971a-fb3e23245502 req-02ee8b43-8b04-4edc-a10e-67ebff598d2d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:01.898386 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca9cbcf0-7faf-4933-971a-fb3e23245502 req-02ee8b43-8b04-4edc-a10e-67ebff598d2d tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.1811674 May 12 15:27:01.923509 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-451169c3-43f0-4d18-9c36-262ec8c30c1a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:01.953130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-451169c3-43f0-4d18-9c36-262ec8c30c1a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5931a19-ea74-42c0-9f2d-4c1fe1ce5400,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:01.983842 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca9cbcf0-7faf-4933-971a-fb3e23245502 req-c476bbb4-4741-49aa-8c81-0f8b56592ad2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0844879 May 12 15:27:02.000130 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-451169c3-43f0-4d18-9c36-262ec8c30c1a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:02.033033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-451169c3-43f0-4d18-9c36-262ec8c30c1a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d5931a19-ea74-42c0-9f2d-4c1fe1ce5400 HTTP/1.1" status: 204 len: 168 time: 0.3690832 May 12 15:27:02.337878 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:02.378025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c2ad6f6-6cb7-434d-bfd9-155855a130e6 req-728fd382-dfbf-4766-88bc-cc26ad4756bd tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:02.379677 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c2ad6f6-6cb7-434d-bfd9-155855a130e6 req-728fd382-dfbf-4766-88bc-cc26ad4756bd tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 944 time: 0.1472476 May 12 15:27:02.387800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e964edf-dc6f-44a2-a872-0bbb82bc66a9 req-41d3ab44-8ba0-4a32-b30a-4ca63d09474e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:02.389265 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e964edf-dc6f-44a2-a872-0bbb82bc66a9 req-41d3ab44-8ba0-4a32-b30a-4ca63d09474e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.2348990 May 12 15:27:02.532177 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c2ad6f6-6cb7-434d-bfd9-155855a130e6 req-2839b8f6-3566-4e49-8a8d-5ad2d5eb0ae2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1416085 May 12 15:27:02.552742 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e964edf-dc6f-44a2-a872-0bbb82bc66a9 req-e46c9632-d4ee-4100-ac92-9bb516c234d2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1324828 May 12 15:27:02.645095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4687abde-8849-46ae-a349-bef53372a376 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:27:02.849601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 4687abde-8849-46ae-a349-bef53372a376 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:27:02.856896 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 4687abde-8849-46ae-a349-bef53372a376 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:27:02.857589 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:03.073411 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:03.112763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd320183-5cdb-430c-beea-7c2caa66e5b4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4687abde-8849-46ae-a349-bef53372a376'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:27:03.141075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4687abde-8849-46ae-a349-bef53372a376, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4687abde-8849-46ae-a349-bef53372a376,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:03.142823 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de20e527-6821-4219-b2e8-1b2912e6abaf req-14009e7c-6cf0-4474-963b-2ca37c2d9321 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.0778365 May 12 15:27:03.147102 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:03.174821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07763147-c77b-41fe-8e25-131dc9522bdb req-34be177f-0b17-4898-a2a3-eb22f3422003 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:03.181587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-07763147-c77b-41fe-8e25-131dc9522bdb req-34be177f-0b17-4898-a2a3-eb22f3422003 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.4481423 May 12 15:27:03.293221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-07763147-c77b-41fe-8e25-131dc9522bdb req-c4a1b2d8-cbf6-46cc-9ea3-18307a6c6fe8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1048579 May 12 15:27:03.331874 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4687abde-8849-46ae-a349-bef53372a376,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:03.448370 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d62c159b-c960-4eb7-bcdc-8e427b846fb5'] response: {'server_uuid': 'bd320183-5cdb-430c-beea-7c2caa66e5b4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4687abde-8849-46ae-a349-bef53372a376', 'code': 200} May 12 15:27:03.621336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42286) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:03.770700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eca885e-4c19-49e8-a38b-f22a1e454566 req-c680b08f-9001-4fb8-8bf1-8d222c66c8b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:03.772320 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3eca885e-4c19-49e8-a38b-f22a1e454566 req-c680b08f-9001-4fb8-8bf1-8d222c66c8b4 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 1096 time: 0.2029090 May 12 15:27:03.827345 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3eca885e-4c19-49e8-a38b-f22a1e454566 req-c73d57b3-1ab9-4f13-8946-cf3f1c086717 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465920 May 12 15:27:03.900320 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-597735482-network', 'tenant_id': 'e1146a673b454173a1ed844897ff4119'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:27:03.905903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:03.909870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Usage tracker for resource:network and tenant:e1146a673b454173a1ed844897ff4119 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:03.912951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:03.920001 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:03.943329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Made reservation on behalf of e1146a673b454173a1ed844897ff4119 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:27:03.945570 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:03.958973 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:03.999010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:04.009531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Usage tracker for resource:security_group_rule and tenant:e1146a673b454173a1ed844897ff4119 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:04.017614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:04.029971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17f41779-2fb8-46e7-81ac-ad121b66c46c req-5b510ba4-4ec8-4e14-9e15-846c532d017a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:04.037441 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-17f41779-2fb8-46e7-81ac-ad121b66c46c req-5b510ba4-4ec8-4e14-9e15-846c532d017a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.3087313 May 12 15:27:04.061967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:04.082771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c9d9594-4298-4f05-a04a-c63e6efab8e5 req-3dddb3a4-17af-42f0-956f-5a5aaa2fd359 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:04.084219 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c9d9594-4298-4f05-a04a-c63e6efab8e5 req-3dddb3a4-17af-42f0-956f-5a5aaa2fd359 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.2623487 May 12 15:27:04.142483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-17f41779-2fb8-46e7-81ac-ad121b66c46c req-c3ac0f9d-d8b9-4c19-802e-92a765f2b6a0 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1037877 May 12 15:27:04.229359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c9d9594-4298-4f05-a04a-c63e6efab8e5 req-003b13e1-17bb-4c73-8c6b-90194b360c0f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1359429 May 12 15:27:04.375418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:04.384814 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:04.461028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0d800eef-262d-4bd5-ac24-4a3700b73a86,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:04.482004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 589} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:27:04.495389 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:04.495802 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Added segment 3307f62e-6977-4a8d-852e-31dcfd97c476 of type vlan for network 19102399-18db-4840-b998-adc5bada1da0 May 12 15:27:04.533202 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:04.585030 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:04.586060 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:04.591341 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:04.661741 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 1.0384350 May 12 15:27:04.663449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42314) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:04.679626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Request body: {'subnet': {'network_id': '19102399-18db-4840-b998-adc5bada1da0', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-597735482-subnet', 'tenant_id': 'e1146a673b454173a1ed844897ff4119', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:27:04.698613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:04.711539 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Usage tracker for resource:subnet and tenant:e1146a673b454173a1ed844897ff4119 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:04.720409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:04.733681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:04.777494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Made reservation on behalf of e1146a673b454173a1ed844897ff4119 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:27:04.784378 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:04.982063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f75c19d-f6cc-4a89-9458-c2bbd90ff7ce admin admin] Pushing event updated for resources: {'Network': ['ID=19102399-18db-4840-b998-adc5bada1da0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:04.996915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 19102399-18db-4840-b998-adc5bada1da0 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:27:05.233741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9352edb4-3f9d-4449-8b14-4c8af07bf052 req-1d0a8aca-e837-4d12-b2bc-19cc691bedf5 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:05.249527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9352edb4-3f9d-4449-8b14-4c8af07bf052 req-1d0a8aca-e837-4d12-b2bc-19cc691bedf5 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.2234833 May 12 15:27:05.353456 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:05.370811 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9352edb4-3f9d-4449-8b14-4c8af07bf052 req-3f4c4f2d-2b87-4b83-8ff8-3d82d4140aad tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1165056 May 12 15:27:05.533323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5191993e-726b-4897-9b02-25fe32b3009b,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:05.536604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Checking segment: {'id': '3307f62e-6977-4a8d-852e-31dcfd97c476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '19102399-18db-4840-b998-adc5bada1da0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:27:05.537178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Network hostable DHCP agents. Network: 19102399-18db-4840-b998-adc5bada1da0, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:27:05.539064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72839748-390f-43af-a083-8cb16f68b185 req-93d22a7e-f97d-4023-9201-0f1523efbbc8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:05.547109 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72839748-390f-43af-a083-8cb16f68b185 req-93d22a7e-f97d-4023-9201-0f1523efbbc8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.1752288 May 12 15:27:05.567749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Network 19102399-18db-4840-b998-adc5bada1da0 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:27:05.597006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 19102399-18db-4840-b998-adc5bada1da0) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:27:05.601556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:05.604098 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:05.607018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60f01a6f-41e6-4ef6-a1d0-7a62befa463e None None] Network 19102399-18db-4840-b998-adc5bada1da0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:27:05.631714 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fe654169-b3c0-4f5e-b599-6590bd6c0655 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.9669666 May 12 15:27:05.654003 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bea0342c-c3ca-41e1-a090-c45c1411dfef req-a13fc8be-17eb-4f1a-9e97-842314c9d53f tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.0822392 May 12 15:27:05.681751 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72839748-390f-43af-a083-8cb16f68b185 req-7942b725-2e4b-422c-8c25-03e3dcd0b281 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1337464 May 12 15:27:05.936651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-219b3b55-d0eb-4ce8-b090-8cb4a9c169ef req-4b80dc40-f904-4e54-89a8-fad05eff2ad1 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:05.941370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-219b3b55-d0eb-4ce8-b090-8cb4a9c169ef req-4b80dc40-f904-4e54-89a8-fad05eff2ad1 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.1601353 May 12 15:27:05.955043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d53cad34-945b-4239-b814-e1982081bb55 None None] Network 19102399-18db-4840-b998-adc5bada1da0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:27:06.059160 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-219b3b55-d0eb-4ce8-b090-8cb4a9c169ef req-3b46ca73-30dc-40f0-b0a3-5da2456997c9 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0768814 May 12 15:27:06.122750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbcf1375-78b1-4fdc-a397-00e0cb37c845 req-b20149d8-5da9-4115-a065-abaf114b0a03 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:06.136835 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bbcf1375-78b1-4fdc-a397-00e0cb37c845 req-b20149d8-5da9-4115-a065-abaf114b0a03 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.1925855 May 12 15:27:06.196750 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bbcf1375-78b1-4fdc-a397-00e0cb37c845 req-3d4df3d7-e9c3-49ed-a63e-4acbe5ed6243 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585127 May 12 15:27:06.611243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01545dd0-efb3-491a-97de-f5af1bf519cd req-d17dcbf9-55e2-4b66-8791-e4a086867d7e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:06.620945 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01545dd0-efb3-491a-97de-f5af1bf519cd req-d17dcbf9-55e2-4b66-8791-e4a086867d7e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.2324369 May 12 15:27:06.739404 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01545dd0-efb3-491a-97de-f5af1bf519cd req-fbbe54da-3a4f-4a48-b5fd-4221c3aac1f9 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1165717 May 12 15:27:06.797869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3900a53e-c716-48a0-8d54-dac83a5e213e req-db77dbfa-ad13-4ed7-b13b-0008d1a5065e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:06.799507 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3900a53e-c716-48a0-8d54-dac83a5e213e req-db77dbfa-ad13-4ed7-b13b-0008d1a5065e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.1557145 May 12 15:27:06.890525 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3900a53e-c716-48a0-8d54-dac83a5e213e req-6f5219db-7d55-4d6f-804c-5b204c68802c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0841787 May 12 15:27:07.022788 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-614ab70e-78ed-4771-a46f-ebbe653ce959 req-131619c6-7b25-4629-a662-90fa2769c060 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.0894938 May 12 15:27:07.377662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dae4d46c-d969-49c6-a0e9-c4b280ac4d01 req-21aa14ea-7c74-441e-b302-10c0533b87dc tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:07.384868 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dae4d46c-d969-49c6-a0e9-c4b280ac4d01 req-21aa14ea-7c74-441e-b302-10c0533b87dc tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.2959085 May 12 15:27:07.420428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f507f6c8-9625-4cc9-8f6e-385a967be1bf req-b5b7caed-9035-4274-b96a-f1abe3bc54f5 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:07.427341 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f507f6c8-9625-4cc9-8f6e-385a967be1bf req-b5b7caed-9035-4274-b96a-f1abe3bc54f5 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.1893764 May 12 15:27:07.513147 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dae4d46c-d969-49c6-a0e9-c4b280ac4d01 req-33206cb7-381b-479b-a361-cff233e2d0f9 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1271420 May 12 15:27:07.526099 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f507f6c8-9625-4cc9-8f6e-385a967be1bf req-f09b2646-852d-4f1e-afcc-ad63c9260934 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0978277 May 12 15:27:07.932526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f61d32d6-6909-4221-9cf4-35a5886eed8c req-4b25b321-fec0-418c-ae0c-40744dc4831f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:07.935071 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f61d32d6-6909-4221-9cf4-35a5886eed8c req-4b25b321-fec0-418c-ae0c-40744dc4831f tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.1849105 May 12 15:27:08.371710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f61d32d6-6909-4221-9cf4-35a5886eed8c req-0e79900b-8252-459f-b220-a165bce8c663 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3961473 May 12 15:27:08.445189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8515908a-6d02-4359-9d85-71c0431934e5 req-9e4cfd5b-8a7b-4079-8186-c96c4a23b2da tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:08.459198 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8515908a-6d02-4359-9d85-71c0431934e5 req-9e4cfd5b-8a7b-4079-8186-c96c4a23b2da tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.5230095 May 12 15:27:08.561288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8515908a-6d02-4359-9d85-71c0431934e5 req-90428134-53ec-4799-b531-d743dd59ba02 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0963056 May 12 15:27:08.699932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-389e0953-e706-463b-bff7-2c0fc1bd8ab8 req-a0932486-46af-498d-98ce-75c53acc1978 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:08.707310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-389e0953-e706-463b-bff7-2c0fc1bd8ab8 req-a0932486-46af-498d-98ce-75c53acc1978 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.1124477 May 12 15:27:08.776397 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2ea76732-8645-40ea-a319-fac52fd6ca44 req-9d1f9a33-6979-44d7-868a-fde27b814df4 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.0664494 May 12 15:27:08.808894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-389e0953-e706-463b-bff7-2c0fc1bd8ab8 req-93054111-bfad-4c4f-b9ed-38e06761be98 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1006234 May 12 15:27:09.095733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ab46bc7-2355-46e4-bb57-58f31485725c req-0841e015-9765-4904-b8c2-a8bc37a8315f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:09.105042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ab46bc7-2355-46e4-bb57-58f31485725c req-0841e015-9765-4904-b8c2-a8bc37a8315f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.1781545 May 12 15:27:09.141193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb351ce6-4122-49bb-a64c-83dbc4104972 req-c4ff9570-4230-47e0-a2fb-546b3d24783e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:09.148069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb351ce6-4122-49bb-a64c-83dbc4104972 req-c4ff9570-4230-47e0-a2fb-546b3d24783e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.1845598 May 12 15:27:09.199925 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ab46bc7-2355-46e4-bb57-58f31485725c req-d9b21abc-7841-4238-a1e7-9e54e5f2041d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0938563 May 12 15:27:09.224921 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb351ce6-4122-49bb-a64c-83dbc4104972 req-8a23bcf9-319a-4401-8bab-e35c8d0fefb3 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0760221 May 12 15:27:10.004456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d96b4fc6-d368-473f-a72c-afcf31113a9c req-33d4c7b4-1a9a-438e-b7f4-01e8e394bbc1 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:10.012871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d96b4fc6-d368-473f-a72c-afcf31113a9c req-33d4c7b4-1a9a-438e-b7f4-01e8e394bbc1 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.2243261 May 12 15:27:10.064820 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d96b4fc6-d368-473f-a72c-afcf31113a9c req-1beeefae-48d7-4baa-aea8-a7d1cf903232 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0507324 May 12 15:27:10.364285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50bceefd-d8f0-4f4b-af52-2390fe741155 req-62c4f4a0-b22b-4539-8f70-e7a8d0cbd747 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.1765199 May 12 15:27:10.488613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7704da98-3436-4d00-a867-5c6acb34fe4e req-8cbb4f96-0b26-40ff-bd5e-f36ab4669244 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:10.495875 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7704da98-3436-4d00-a867-5c6acb34fe4e req-8cbb4f96-0b26-40ff-bd5e-f36ab4669244 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.2384391 May 12 15:27:10.608488 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7704da98-3436-4d00-a867-5c6acb34fe4e req-589c3e95-bcdd-4977-ba7d-8b43cd20aa8e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1015484 May 12 15:27:10.847437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4951a658-e807-4099-a7e1-ef9689abad97 req-e30bf8e0-d561-4eb5-898a-f157ea9add9e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:10.863992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4951a658-e807-4099-a7e1-ef9689abad97 req-e30bf8e0-d561-4eb5-898a-f157ea9add9e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.1901121 May 12 15:27:10.938249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4951a658-e807-4099-a7e1-ef9689abad97 req-483eeac6-cb6d-40d0-b0ff-ba3cea7463e6 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0727472 May 12 15:27:11.449308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eba56ab3-9352-4c16-9433-628bb99d0fef req-4fb688be-9da2-4bff-8a42-29d1c8515f65 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:11.451321 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eba56ab3-9352-4c16-9433-628bb99d0fef req-4fb688be-9da2-4bff-8a42-29d1c8515f65 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1942210 May 12 15:27:11.566816 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eba56ab3-9352-4c16-9433-628bb99d0fef req-63e4fe34-f1a2-4dae-a1ee-33cb1f1d6547 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1070952 May 12 15:27:11.740668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dcd70aa8-87be-45d1-bbc3-a2d96118920f req-dbf2c57a-8d86-407d-ae69-e9a82ee86600 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.0752096 May 12 15:27:11.924097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed6542f6-b444-41ea-888b-a1c743c2ebb6 req-8fbb0527-3e88-4233-bcd5-533fd1a07d31 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:11.932905 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed6542f6-b444-41ea-888b-a1c743c2ebb6 req-8fbb0527-3e88-4233-bcd5-533fd1a07d31 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.1244366 May 12 15:27:12.019362 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed6542f6-b444-41ea-888b-a1c743c2ebb6 req-3f2996b8-3f83-4dc3-9e4a-25e1efe23b59 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0855806 May 12 15:27:12.194669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7483ef-f09c-411b-876e-f74e44e87886 req-9e228523-fef4-426e-89f8-bc0f5181c1c8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:12.202956 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b7483ef-f09c-411b-876e-f74e44e87886 req-9e228523-fef4-426e-89f8-bc0f5181c1c8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.1226118 May 12 15:27:12.302674 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b7483ef-f09c-411b-876e-f74e44e87886 req-80b1f86f-6d8a-424a-ae58-2249da0cfc83 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0986302 May 12 15:27:12.356068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42480) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:12.585153 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a4fdcf10-971a-43e0-9a7b-ef0f4fbda627 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:12.612455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a4fdcf10-971a-43e0-9a7b-ef0f4fbda627 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:12.619774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a4fdcf10-971a-43e0-9a7b-ef0f4fbda627 admin admin] Usage tracker for resource:security_group_rule and tenant:4ad9e59eb3264c859d72dfd2adcc1abf is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:12.623923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a4fdcf10-971a-43e0-9a7b-ef0f4fbda627 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:12.632476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a4fdcf10-971a-43e0-9a7b-ef0f4fbda627 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:12.643516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52540a00-ca4a-41f9-8bf1-ce9d7a7f75e1 req-279c9e74-42f5-4378-8005-ea9f0f649924 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:12.645443 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-52540a00-ca4a-41f9-8bf1-ce9d7a7f75e1 req-279c9e74-42f5-4378-8005-ea9f0f649924 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 1096 time: 0.1683891 May 12 15:27:12.676560 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-27c98134-4c63-4b84-9bc9-f71ce9e036c6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:12.747198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4687abde-8849-46ae-a349-bef53372a376 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:27:12.834196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb1afe1-81f0-4922-acbf-d854d834b3fb req-763ed30d-5fef-4caa-8e69-9624bc5af98f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:12.842826 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2eb1afe1-81f0-4922-acbf-d854d834b3fb req-763ed30d-5fef-4caa-8e69-9624bc5af98f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1451778 May 12 15:27:12.979096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52540a00-ca4a-41f9-8bf1-ce9d7a7f75e1 req-40bf620f-5297-41d9-a04b-e9d3702c0535 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:12.987906 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-52540a00-ca4a-41f9-8bf1-ce9d7a7f75e1 req-40bf620f-5297-41d9-a04b-e9d3702c0535 service neutron] 10.222.0.84 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 913 time: 0.3143060 May 12 15:27:13.025848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4687abde-8849-46ae-a349-bef53372a376, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4687abde-8849-46ae-a349-bef53372a376,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:13.045398 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '4687abde-8849-46ae-a349-bef53372a376', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'port_id': '4687abde-8849-46ae-a349-bef53372a376', 'mac_address': 'fa:16:3e:13:ac:ad', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 579, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:27:13.061131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4f37acba-26c2-4625-a6fb-9fb82d2a9b70 req-5c1e78a8-cff9-42b2-818a-f208e1b79e25 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.1214001 May 12 15:27:13.104607 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2eb1afe1-81f0-4922-acbf-d854d834b3fb req-ab3e4425-1c8b-4f26-a8b4-da11867e0390 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2608368 May 12 15:27:13.180484 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:13.238463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 4687abde-8849-46ae-a349-bef53372a376 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:27:13.254208 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:13.306092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4687abde-8849-46ae-a349-bef53372a376, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4687abde-8849-46ae-a349-bef53372a376,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:13.328126 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:13.363026 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-52540a00-ca4a-41f9-8bf1-ce9d7a7f75e1 req-a51e346c-c240-4106-9b37-3525e5742810 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=64936beb-03d4-4182-81be-074a96507608 HTTP/1.1" status: 200 len: 217 time: 0.3216717 May 12 15:27:13.529890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4687abde-8849-46ae-a349-bef53372a376,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:13.605313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52540a00-ca4a-41f9-8bf1-ce9d7a7f75e1 req-0032b2c4-2c21-48c7-a205-cfbf8641faf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:13.618961 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-52540a00-ca4a-41f9-8bf1-ce9d7a7f75e1 req-0032b2c4-2c21-48c7-a205-cfbf8641faf2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.2301695 May 12 15:27:13.660882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['4687abde-8849-46ae-a349-bef53372a376'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:27:13.695254 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b0b3e1e-1bcf-43fb-931f-91dcb0d97f85 req-c42efaee-7ed8-4c88-9fed-37bbbe2ba552 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.1974533 May 12 15:27:13.720573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f48338c8-09cf-4adf-aa9a-16ecb07f305a req-42c4a085-748a-43b3-a19a-6f673b8ace7b tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:13.721183 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-52540a00-ca4a-41f9-8bf1-ce9d7a7f75e1 req-ec7701af-6bca-40c0-a1a9-b04e0f801fa8 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0794675 May 12 15:27:13.723172 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a4fdcf10-971a-43e0-9a7b-ef0f4fbda627 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:13.730801 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f48338c8-09cf-4adf-aa9a-16ecb07f305a req-42c4a085-748a-43b3-a19a-6f673b8ace7b tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 944 time: 0.3173103 May 12 15:27:13.759988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a4fdcf10-971a-43e0-9a7b-ef0f4fbda627 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:13.890653 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a4fdcf10-971a-43e0-9a7b-ef0f4fbda627 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4ad9e59eb3264c859d72dfd2adcc1abf&name=default HTTP/1.1" status: 200 len: 2983 time: 1.5323493 May 12 15:27:13.895378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42524) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:13.896116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4fdcf10-971a-43e0-9a7b-ef0f4fbda627 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a17f5243-50d3-4d36-b3fa-8a9f6ccffaff,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:13.932965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a17173-e9bc-4d6b-a525-764b79535375 req-672a978b-a826-43f6-a19b-3fca529b15d4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:13.934532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10a17173-e9bc-4d6b-a525-764b79535375 req-672a978b-a826-43f6-a19b-3fca529b15d4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.3754566 May 12 15:27:14.009961 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a7e29d9-bcd3-4636-8f8b-71d6a7e6e3e4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:14.014711 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-52540a00-ca4a-41f9-8bf1-ce9d7a7f75e1 req-a60f196d-2597-43a1-b197-5267a5c1063d service neutron] 10.222.0.84 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2855523 May 12 15:27:14.072539 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f48338c8-09cf-4adf-aa9a-16ecb07f305a req-01a96314-5d9f-4d9d-944a-a21af8b5847c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3405855 May 12 15:27:14.173687 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10a17173-e9bc-4d6b-a525-764b79535375 req-e6e0d67c-9090-4f94-9643-367ee96d98ea tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2005026 May 12 15:27:14.204915 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-52540a00-ca4a-41f9-8bf1-ce9d7a7f75e1 req-553a78ce-fb47-47a6-9bc2-0579ef671326 service neutron] 10.222.0.84 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1826375 May 12 15:27:14.228035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b0b3e1e-1bcf-43fb-931f-91dcb0d97f85 req-c710c0c6-6633-4962-b63a-a1e767eb1627 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:14.237428 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b0b3e1e-1bcf-43fb-931f-91dcb0d97f85 req-c710c0c6-6633-4962-b63a-a1e767eb1627 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 1096 time: 0.4634421 May 12 15:27:14.273131 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a7e29d9-bcd3-4636-8f8b-71d6a7e6e3e4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:14.386329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a7e29d9-bcd3-4636-8f8b-71d6a7e6e3e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:14.413010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a7e29d9-bcd3-4636-8f8b-71d6a7e6e3e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a17f5243-50d3-4d36-b3fa-8a9f6ccffaff,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:14.435297 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a7e29d9-bcd3-4636-8f8b-71d6a7e6e3e4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:14.440176 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9a7e29d9-bcd3-4636-8f8b-71d6a7e6e3e4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a17f5243-50d3-4d36-b3fa-8a9f6ccffaff HTTP/1.1" status: 204 len: 168 time: 0.5405321 May 12 15:27:14.769069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4687abde-8849-46ae-a349-bef53372a376 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:27:14.863861 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0e1c280f-21ac-4892-bf58-38eb8c21c9f9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:14.908977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee35d1e4-7e3b-4ce3-87f3-9dcb1bd1f983 req-920e847c-2dce-4a24-888a-c2377940c590 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.2923274 May 12 15:27:14.912611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 4687abde-8849-46ae-a349-bef53372a376 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:27:14.913271 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:15.012859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b0b3e1e-1bcf-43fb-931f-91dcb0d97f85 req-c020db1d-25ea-43f9-9699-ba9f6ac4989c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:15.014945 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b0b3e1e-1bcf-43fb-931f-91dcb0d97f85 req-c020db1d-25ea-43f9-9699-ba9f6ac4989c service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.7387807 May 12 15:27:15.027638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fba21795-fb39-4103-8f8b-b65da93eda59 req-fb5b9220-318e-45aa-9e7f-48ea708eb0ed tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:15.036671 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fba21795-fb39-4103-8f8b-b65da93eda59 req-fb5b9220-318e-45aa-9e7f-48ea708eb0ed tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.4390123 May 12 15:27:15.088351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42546) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:15.146949 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e68c0abd-2f52-4e87-8a2c-cd94fcd797b5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:15.198596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e68c0abd-2f52-4e87-8a2c-cd94fcd797b5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:15.208619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e68c0abd-2f52-4e87-8a2c-cd94fcd797b5 admin admin] Usage tracker for resource:security_group_rule and tenant:ce0c01ab9f0d4c9183f3649776d72135 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:15.219457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e68c0abd-2f52-4e87-8a2c-cd94fcd797b5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:15.235568 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:15.237347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e68c0abd-2f52-4e87-8a2c-cd94fcd797b5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:15.269235 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b0b3e1e-1bcf-43fb-931f-91dcb0d97f85 req-accf2ad8-9070-4922-88c2-7661f8f4cf24 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 HTTP/1.1" status: 200 len: 217 time: 0.2064621 May 12 15:27:15.319920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd320183-5cdb-430c-beea-7c2caa66e5b4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4687abde-8849-46ae-a349-bef53372a376'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:27:15.342876 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4687abde-8849-46ae-a349-bef53372a376, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4687abde-8849-46ae-a349-bef53372a376,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:15.349301 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:15.350212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 64936beb-03d4-4182-81be-074a96507608 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:27:15.377988 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fba21795-fb39-4103-8f8b-b65da93eda59 req-844439ed-320d-46a6-93ca-ea12e4cdca1a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3401866 May 12 15:27:15.427081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e68c0abd-2f52-4e87-8a2c-cd94fcd797b5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:15.440121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e68c0abd-2f52-4e87-8a2c-cd94fcd797b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:15.514151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4687abde-8849-46ae-a349-bef53372a376,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:15.605673 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e68c0abd-2f52-4e87-8a2c-cd94fcd797b5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ce0c01ab9f0d4c9183f3649776d72135&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5158396 May 12 15:27:15.608531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42554) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:15.615688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e68c0abd-2f52-4e87-8a2c-cd94fcd797b5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=048e2570-e91c-42b1-a73f-a1f22b220a6d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:15.630802 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:15.702799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b0b3e1e-1bcf-43fb-931f-91dcb0d97f85 req-763e29d5-7fab-413d-9d22-b14e2aca783f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:15.704252 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b0b3e1e-1bcf-43fb-931f-91dcb0d97f85 req-763e29d5-7fab-413d-9d22-b14e2aca783f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.4280696 May 12 15:27:15.709613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 64936beb-03d4-4182-81be-074a96507608, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=64936beb-03d4-4182-81be-074a96507608,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:15.716931 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:15.736065 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a59d013e-db69-479c-a261-d2eba5704e18 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:15.821593 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a59d013e-db69-479c-a261-d2eba5704e18 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:15.919289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=64936beb-03d4-4182-81be-074a96507608,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:15.929028 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a59d013e-db69-479c-a261-d2eba5704e18 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:15.939137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b884510d-5c0e-432d-9426-1d58c7bdd9b2 req-b7f366ad-cb38-44a0-9444-79522c356634 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:15.941372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b884510d-5c0e-432d-9426-1d58c7bdd9b2 req-b7f366ad-cb38-44a0-9444-79522c356634 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.6621244 May 12 15:27:15.997311 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a59d013e-db69-479c-a261-d2eba5704e18 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:16.001599 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a59d013e-db69-479c-a261-d2eba5704e18 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/048e2570-e91c-42b1-a73f-a1f22b220a6d HTTP/1.1" status: 204 len: 168 time: 0.3880572 May 12 15:27:16.007330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a59d013e-db69-479c-a261-d2eba5704e18 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=048e2570-e91c-42b1-a73f-a1f22b220a6d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:16.059679 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:16.140897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b884510d-5c0e-432d-9426-1d58c7bdd9b2 req-36e0e73e-85b7-4eaf-89cb-b9b5d4ccd01e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1772838 May 12 15:27:16.162390 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:16.168674 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a6ef86b-46e1-4036-af0f-19b868d6a13a req-4e43e71e-545f-4318-b8e4-3869fd2b8592 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:16.176947 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a6ef86b-46e1-4036-af0f-19b868d6a13a req-4e43e71e-545f-4318-b8e4-3869fd2b8592 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 945 time: 0.5595422 May 12 15:27:16.287111 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-cecc1855-ba4a-49e9-8cab-fcb09f98bb65'] response: {'server_uuid': 'bd320183-5cdb-430c-beea-7c2caa66e5b4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4687abde-8849-46ae-a349-bef53372a376', 'code': 200} May 12 15:27:16.342278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a6ef86b-46e1-4036-af0f-19b868d6a13a req-1b9fa232-ab77-430d-a007-879b36f457fe tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1550109 May 12 15:27:16.366495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b0b3e1e-1bcf-43fb-931f-91dcb0d97f85 req-4fd09a0e-e993-4454-bfc2-382f86313e11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:16.368082 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b0b3e1e-1bcf-43fb-931f-91dcb0d97f85 req-4fd09a0e-e993-4454-bfc2-382f86313e11 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.6449313 May 12 15:27:16.724031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-26f9d632-30ef-4dfd-afec-1e62cca7a2e1 req-f3ff1650-b8d3-4d4d-ad51-57bb82181c46 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.0956771 May 12 15:27:16.741317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42572) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:16.784746 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b038bb51-d4f5-4676-ae32-a53ed958afb1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:16.810996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b038bb51-d4f5-4676-ae32-a53ed958afb1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:16.821820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b038bb51-d4f5-4676-ae32-a53ed958afb1 admin admin] Usage tracker for resource:security_group_rule and tenant:51e878ea4c684f17b38fac8a9d002b84 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:16.829925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b038bb51-d4f5-4676-ae32-a53ed958afb1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:16.874585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b038bb51-d4f5-4676-ae32-a53ed958afb1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:17.008967 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b0b3e1e-1bcf-43fb-931f-91dcb0d97f85 req-d28ce156-c167-4f93-990e-8334559dc53d service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6324236 May 12 15:27:17.105200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b038bb51-d4f5-4676-ae32-a53ed958afb1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:17.111591 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b038bb51-d4f5-4676-ae32-a53ed958afb1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:17.219418 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b038bb51-d4f5-4676-ae32-a53ed958afb1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=51e878ea4c684f17b38fac8a9d002b84&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4745967 May 12 15:27:17.220968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42588) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:17.267032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b038bb51-d4f5-4676-ae32-a53ed958afb1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c66e43de-b38a-44c4-b108-c5585c04dd34,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:17.331515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9a5b404-ba06-4116-a963-acbb358452cf req-fec0b88d-dd9c-4a54-84ca-3c28924295ce tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:17.335930 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9a5b404-ba06-4116-a963-acbb358452cf req-fec0b88d-dd9c-4a54-84ca-3c28924295ce tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.6109996 May 12 15:27:17.356287 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-396e781a-a53a-4d27-92bb-6c9081f34f3a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:17.421241 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-396e781a-a53a-4d27-92bb-6c9081f34f3a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:17.519477 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-396e781a-a53a-4d27-92bb-6c9081f34f3a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:17.545322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-396e781a-a53a-4d27-92bb-6c9081f34f3a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c66e43de-b38a-44c4-b108-c5585c04dd34,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:17.571812 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-396e781a-a53a-4d27-92bb-6c9081f34f3a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:17.573343 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-396e781a-a53a-4d27-92bb-6c9081f34f3a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c66e43de-b38a-44c4-b108-c5585c04dd34 HTTP/1.1" status: 204 len: 168 time: 0.3511558 May 12 15:27:17.596080 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b0b3e1e-1bcf-43fb-931f-91dcb0d97f85 req-b0cd67db-b6c3-4076-a577-e6c48da08638 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5722971 May 12 15:27:17.637437 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9a5b404-ba06-4116-a963-acbb358452cf req-acf1903b-f12c-4fd1-aa5f-b5250d60e732 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2860386 May 12 15:27:17.672337 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:17.710050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45e5169d-a0ca-4521-ace0-c863f4caeece req-0fa1a7ec-2f1a-49e0-b4f1-fbb06a36dd86 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:17.723215 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45e5169d-a0ca-4521-ace0-c863f4caeece req-0fa1a7ec-2f1a-49e0-b4f1-fbb06a36dd86 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.3087068 May 12 15:27:17.850523 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45e5169d-a0ca-4521-ace0-c863f4caeece req-68774459-adbf-47c1-ba64-eeba7f071c64 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1262393 May 12 15:27:18.209117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e422b6-ba4f-4334-9eac-81d1b6ea498b req-e9a44118-e445-48a5-9852-f5d31a88cb40 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:18.234261 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6e422b6-ba4f-4334-9eac-81d1b6ea498b req-e9a44118-e445-48a5-9852-f5d31a88cb40 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 943 time: 0.1448133 May 12 15:27:18.288810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '12215d44-186e-4901-81f8-0c2cf89b7793', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '64936beb-03d4-4182-81be-074a96507608'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:27:18.364711 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d88fb25-31a6-4b6d-9e2d-55f8b4ecd7be req-61859de9-75ae-40b9-a8f1-5e7d3d8086ac tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.0810564 May 12 15:27:18.392655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6e422b6-ba4f-4334-9eac-81d1b6ea498b req-5358f809-b2ba-4d6b-a9a1-e889c3c91306 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1565931 May 12 15:27:18.534638 n-d-841483-1 neutron-server[88153]: WARNING neutron.notifiers.nova [-] Nova event matching ['req-51f61233-1ced-49d4-a9b6-b52177032a72']: {'server_uuid': '12215d44-186e-4901-81f8-0c2cf89b7793', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '64936beb-03d4-4182-81be-074a96507608', 'code': 422} returned with failed status May 12 15:27:18.800302 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 64936beb-03d4-4182-81be-074a96507608 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:27:19.004635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd89329a-59c2-4607-bf50-45176a5771d5 req-cfeb5e0c-f0f7-4c3d-ab0f-62409684d769 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:19.007353 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd89329a-59c2-4607-bf50-45176a5771d5 req-cfeb5e0c-f0f7-4c3d-ab0f-62409684d769 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1696157 May 12 15:27:19.109129 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd89329a-59c2-4607-bf50-45176a5771d5 req-f787dfc0-d397-4dc6-a20a-2d46f91b8167 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0923362 May 12 15:27:19.441125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d51e6aa5-9b46-4465-81f1-c8babe3d81f3 req-d7596854-0f9c-4af7-bc58-ee23e0bbfd57 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:19.451731 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d51e6aa5-9b46-4465-81f1-c8babe3d81f3 req-d7596854-0f9c-4af7-bc58-ee23e0bbfd57 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.1634150 May 12 15:27:19.608106 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d51e6aa5-9b46-4465-81f1-c8babe3d81f3 req-8102dd61-9adb-49e0-b741-cbf77ec41d19 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1476657 May 12 15:27:19.957702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baeaba53-e710-4e88-9ad6-1638ef6ec91f req-3e8dec03-24be-46cd-a472-9ad42ab15506 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:19.959593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-baeaba53-e710-4e88-9ad6-1638ef6ec91f req-3e8dec03-24be-46cd-a472-9ad42ab15506 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.1648343 May 12 15:27:20.061779 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-baeaba53-e710-4e88-9ad6-1638ef6ec91f req-ae1f7ea9-96e7-42ae-a07e-223ac56eda6d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0933371 May 12 15:27:20.725028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73091174-1277-4ca1-9db0-ea07af5974c7 req-ae2996c5-f696-48be-8bad-a42015f486ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:20.728155 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-73091174-1277-4ca1-9db0-ea07af5974c7 req-ae2996c5-f696-48be-8bad-a42015f486ac service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=f4660a6351274a7796c2eb1e55a41ec9&device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 1097 time: 0.1169543 May 12 15:27:20.919214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73091174-1277-4ca1-9db0-ea07af5974c7 req-77dd43c4-9a0c-43be-8b7f-793f04999625 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:20.920914 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-73091174-1277-4ca1-9db0-ea07af5974c7 req-77dd43c4-9a0c-43be-8b7f-793f04999625 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e1655f9a-2478-49d5-a6ca-4fec717d6816 HTTP/1.1" status: 200 len: 912 time: 0.1795676 May 12 15:27:20.929824 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6194eb83-8550-4229-975f-bc56ea604953 req-e9f06fd3-dc1c-417c-8e91-6707816550b2 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.1293132 May 12 15:27:21.064737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f244eb13-1e36-46fc-b193-686e438056dc req-81b150bc-ebee-4e78-9618-85e536fff81a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:21.072340 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f244eb13-1e36-46fc-b193-686e438056dc req-81b150bc-ebee-4e78-9618-85e536fff81a tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.84 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.3078859 May 12 15:27:21.205678 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-73091174-1277-4ca1-9db0-ea07af5974c7 req-e67f8f5e-0828-457f-bb5f-d2df784f5d69 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d4f9886d-fb34-4a11-9462-3343e8a12db0 HTTP/1.1" status: 200 len: 1002 time: 0.2768753 May 12 15:27:21.222099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df23467-bb31-41bd-bc98-6c20e6ef642a req-c9011c62-8d24-4782-a867-b96cb0ef3b22 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:21.230386 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1df23467-bb31-41bd-bc98-6c20e6ef642a req-c9011c62-8d24-4782-a867-b96cb0ef3b22 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=12215d44-186e-4901-81f8-0c2cf89b7793 HTTP/1.1" status: 200 len: 943 time: 0.7586565 May 12 15:27:21.318907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-f244eb13-1e36-46fc-b193-686e438056dc req-ee9f1ac9-8450-4f16-8748-63cdadeec2d2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Deleting port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:27:21.319253 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f244eb13-1e36-46fc-b193-686e438056dc req-ee9f1ac9-8450-4f16-8748-63cdadeec2d2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:21.365978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-1df23467-bb31-41bd-bc98-6c20e6ef642a req-18cc7b6b-8973-4dc4-920a-2eeab1839694 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Deleting port 64936beb-03d4-4182-81be-074a96507608 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:27:21.366432 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1df23467-bb31-41bd-bc98-6c20e6ef642a req-18cc7b6b-8973-4dc4-920a-2eeab1839694 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:21.431681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73091174-1277-4ca1-9db0-ea07af5974c7 req-7b48d592-aea9-4516-840d-f01d6eb5fa55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:21.439047 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-73091174-1277-4ca1-9db0-ea07af5974c7 req-7b48d592-aea9-4516-840d-f01d6eb5fa55 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=83787d82-d8a5-4f12-a025-f44dcf581189 HTTP/1.1" status: 200 len: 850 time: 0.1996706 May 12 15:27:21.793869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2371dc6c-861b-41a7-aa7d-d6df72305684 req-3fbe4f8e-9e3e-42f1-9c8e-da2aec9b977c tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:21.795559 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2371dc6c-861b-41a7-aa7d-d6df72305684 req-3fbe4f8e-9e3e-42f1-9c8e-da2aec9b977c tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.4378941 May 12 15:27:21.819161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73091174-1277-4ca1-9db0-ea07af5974c7 req-ba128053-59af-4cd0-badc-e3b0c43f2912 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:21.825489 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-73091174-1277-4ca1-9db0-ea07af5974c7 req-ba128053-59af-4cd0-badc-e3b0c43f2912 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e1655f9a-2478-49d5-a6ca-4fec717d6816&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3700619 May 12 15:27:22.082073 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-73091174-1277-4ca1-9db0-ea07af5974c7 req-6386c4df-1ec6-436d-8986-b4cd36f04cfd service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2442884 May 12 15:27:22.103429 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2371dc6c-861b-41a7-aa7d-d6df72305684 req-724a59e1-3b5a-481e-83bc-17fb7c483cbe tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2749634 May 12 15:27:22.223709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f244eb13-1e36-46fc-b193-686e438056dc req-ee9f1ac9-8450-4f16-8748-63cdadeec2d2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] For port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,segment=NetworkSegment(17355787-57e0-48f5-9070-811e461a6000),segment_id=17355787-57e0-48f5-9070-811e461a6000)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:22.225227 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f244eb13-1e36-46fc-b193-686e438056dc req-ee9f1ac9-8450-4f16-8748-63cdadeec2d2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:22.550610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-f244eb13-1e36-46fc-b193-686e438056dc req-ee9f1ac9-8450-4f16-8748-63cdadeec2d2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Calling delete_port for a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:27:22.638081 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-73091174-1277-4ca1-9db0-ea07af5974c7 req-a04b1872-0dea-4d55-af0e-d7cb4e51bd64 service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5459917 May 12 15:27:22.755050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-1df23467-bb31-41bd-bc98-6c20e6ef642a req-18cc7b6b-8973-4dc4-920a-2eeab1839694 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] For port 64936beb-03d4-4182-81be-074a96507608, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=64936beb-03d4-4182-81be-074a96507608,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:22.755760 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1df23467-bb31-41bd-bc98-6c20e6ef642a req-18cc7b6b-8973-4dc4-920a-2eeab1839694 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:22.939207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-1df23467-bb31-41bd-bc98-6c20e6ef642a req-18cc7b6b-8973-4dc4-920a-2eeab1839694 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Calling delete_port for 64936beb-03d4-4182-81be-074a96507608 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:27:23.040320 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f244eb13-1e36-46fc-b193-686e438056dc req-ee9f1ac9-8450-4f16-8748-63cdadeec2d2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:23.141106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee9f1ac9-8450-4f16-8748-63cdadeec2d2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Pushing event deleted for resources: {'Port': ['ID=a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:23.321949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9991b41c-b0a4-4f39-8a6b-21b774ce3c15 req-2a505b7f-5275-4a2f-a4e4-14d0ebe1d92e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:23.328698 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9991b41c-b0a4-4f39-8a6b-21b774ce3c15 req-2a505b7f-5275-4a2f-a4e4-14d0ebe1d92e tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/ports?device_id=6e3189ff-eb13-4d53-bb96-0f93c430e9f5 HTTP/1.1" status: 200 len: 947 time: 0.6422007 May 12 15:27:23.465878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-f244eb13-1e36-46fc-b193-686e438056dc req-ee9f1ac9-8450-4f16-8748-63cdadeec2d2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] No DVR routers for this DVR port a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:27:23.478769 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f244eb13-1e36-46fc-b193-686e438056dc req-ee9f1ac9-8450-4f16-8748-63cdadeec2d2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:23.499574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9991b41c-b0a4-4f39-8a6b-21b774ce3c15 req-6baabaae-09a0-46d1-8dce-d458512bdd4c tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.82 "GET /v2.0/security-groups?id=f062c40f-1191-4fb3-8b41-aaf353c9847a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1698639 May 12 15:27:23.500232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e3189ff-eb13-4d53-bb96-0f93c430e9f5', 'name': 'network-vif-deleted', 'tag': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:27:23.588773 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f244eb13-1e36-46fc-b193-686e438056dc req-ee9f1ac9-8450-4f16-8748-63cdadeec2d2 tempest-ServersNegativeTestJSON-1263142445 tempest-ServersNegativeTestJSON-1263142445-project] 10.222.0.84 "DELETE /v2.0/ports/a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f HTTP/1.1" status: 204 len: 173 time: 2.5063224 May 12 15:27:23.674147 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1df23467-bb31-41bd-bc98-6c20e6ef642a req-18cc7b6b-8973-4dc4-920a-2eeab1839694 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:23.882661 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:27:23.890297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18cc7b6b-8973-4dc4-920a-2eeab1839694 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Pushing event deleted for resources: {'Port': ['ID=64936beb-03d4-4182-81be-074a96507608,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:24.037030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-1df23467-bb31-41bd-bc98-6c20e6ef642a req-18cc7b6b-8973-4dc4-920a-2eeab1839694 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] No DVR routers for this DVR port 64936beb-03d4-4182-81be-074a96507608 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:27:24.041329 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1df23467-bb31-41bd-bc98-6c20e6ef642a req-18cc7b6b-8973-4dc4-920a-2eeab1839694 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:24.043543 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1df23467-bb31-41bd-bc98-6c20e6ef642a req-18cc7b6b-8973-4dc4-920a-2eeab1839694 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "DELETE /v2.0/ports/64936beb-03d4-4182-81be-074a96507608 HTTP/1.1" status: 204 len: 173 time: 2.8123620 May 12 15:27:24.061243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c19f2e91-8ee2-4a90-b03b-eb55bd7cc98c req-629e3d64-8e4b-4e36-8a7a-8b8d4eee06d7 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:24.069017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c19f2e91-8ee2-4a90-b03b-eb55bd7cc98c req-629e3d64-8e4b-4e36-8a7a-8b8d4eee06d7 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.3703485 May 12 15:27:24.142250 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c19f2e91-8ee2-4a90-b03b-eb55bd7cc98c req-844f886e-ef83-477f-b52b-aa777891befd tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0669296 May 12 15:27:24.480555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e151a165-a9b5-4b57-8cbd-03412f0e22ea req-ca7ef592-7dd3-4c78-8567-8ea9b869978d tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.1232035 May 12 15:27:24.755054 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0df30590-447c-4602-b341-5bc9ba038687 req-17853591-105c-4a32-9564-83e48f563c3c tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=c3218244482a42dabbef067e351d4738&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0375330 May 12 15:27:24.847771 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:27:24.947839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:27:24.950912 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:27:24.955884 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df30590-447c-4602-b341-5bc9ba038687 req-a1bf06b7-1fc3-4dca-9905-33db4a972bd5 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:24.963964 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0df30590-447c-4602-b341-5bc9ba038687 req-a1bf06b7-1fc3-4dca-9905-33db4a972bd5 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2080939 May 12 15:27:24.983414 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0df30590-447c-4602-b341-5bc9ba038687 req-8132e71f-3147-422b-840d-55b1e93ebcb2 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/quotas/c3218244482a42dabbef067e351d4738 HTTP/1.1" status: 200 len: 375 time: 0.0177095 May 12 15:27:25.069533 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0df30590-447c-4602-b341-5bc9ba038687 req-339bfa96-aa01-4df6-a81d-2b371ae36e6d tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=c3218244482a42dabbef067e351d4738&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0845878 May 12 15:27:25.256913 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b0237dc5-f259-47d1-a2db-cf41c12835d2'] response: {'server_uuid': '6e3189ff-eb13-4d53-bb96-0f93c430e9f5', 'name': 'network-vif-deleted', 'tag': 'a6bf5612-0dab-4ec9-8b3d-28f94cfd7f1f', 'status': 'completed', 'code': 200} May 12 15:27:25.438621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6cd4e35-d170-4439-8642-10c840112e87 req-1016e19b-1409-489c-a354-e9e01562191b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:25.446789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6cd4e35-d170-4439-8642-10c840112e87 req-1016e19b-1409-489c-a354-e9e01562191b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1855245 May 12 15:27:25.491128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42754) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:25.586848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6cd4e35-d170-4439-8642-10c840112e87 req-551f0c9c-a120-4c7e-9939-aa76883bd610 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1391544 May 12 15:27:25.996920 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-82c48292-c6bc-4f7e-87f0-4b6b3a2f7ef3 req-6734e2c2-7848-4939-9b22-1963cd4ec608 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 210 time: 0.2583380 May 12 15:27:26.133157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1a7696-dc98-4a11-a27a-5bc80818778d req-543ccf0e-fd97-4c3e-97b3-25776d7fcf62 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:26.143894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f1a7696-dc98-4a11-a27a-5bc80818778d req-543ccf0e-fd97-4c3e-97b3-25776d7fcf62 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.2897210 May 12 15:27:26.157003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-beb923c0-7bf0-4586-9c75-a06fbab499ad admin admin] Deleting subnet c90f4328-5e3e-4311-a3b6-84cff19a6919 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:27:26.161813 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-beb923c0-7bf0-4586-9c75-a06fbab499ad admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:26.232973 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-beb923c0-7bf0-4586-9c75-a06fbab499ad admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:26.292320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f1a7696-dc98-4a11-a27a-5bc80818778d req-57059f1b-672d-4f0f-9e97-d24b1aee12ad tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1474059 May 12 15:27:26.300998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-beb923c0-7bf0-4586-9c75-a06fbab499ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:26.331770 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0541cf5a-df51-4575-9e71-41034bc38c1e req-d6001196-de41-4440-95ff-44bc0c7d29e6 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.1404796 May 12 15:27:26.452773 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-beb923c0-7bf0-4586-9c75-a06fbab499ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:26.595945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beb923c0-7bf0-4586-9c75-a06fbab499ad admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c90f4328-5e3e-4311-a3b6-84cff19a6919,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:26.598012 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-beb923c0-7bf0-4586-9c75-a06fbab499ad admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:26.615640 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-beb923c0-7bf0-4586-9c75-a06fbab499ad admin admin] 10.222.0.82 "DELETE /v2.0/subnets/c90f4328-5e3e-4311-a3b6-84cff19a6919 HTTP/1.1" status: 204 len: 168 time: 1.1228538 May 12 15:27:26.618521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42782) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:26.747830 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a584b60b-c0ef-48d6-8804-e135b2f68dea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:26.851338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-fbc0f3f8-abda-48ee-8bfa-6f6dc22728ab tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:26.853510 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-fbc0f3f8-abda-48ee-8bfa-6f6dc22728ab tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 812 time: 0.3662002 May 12 15:27:26.875830 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-38198aeb-b140-4d27-ac5d-29768564f1f1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/quotas/011dcf6c7b624a28bb2d8ed8db38754f HTTP/1.1" status: 200 len: 375 time: 0.0164373 May 12 15:27:27.028180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-53cf7cae-c264-4948-bd15-9125fa1ed831 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Synchronizing usage tracker for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:27:27.044536 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a584b60b-c0ef-48d6-8804-e135b2f68dea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:27.073856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-53cf7cae-c264-4948-bd15-9125fa1ed831 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Unset dirty status for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:27:27.090042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-53cf7cae-c264-4948-bd15-9125fa1ed831 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&fields=id HTTP/1.1" status: 200 len: 210 time: 0.2072508 May 12 15:27:27.108225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a584b60b-c0ef-48d6-8804-e135b2f68dea admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aab37dc4-92bf-4fd9-8482-5e3a3f715d61']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:27.123479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a584b60b-c0ef-48d6-8804-e135b2f68dea admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '17355787-57e0-48f5-9070-811e461a6000') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:27.123968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a584b60b-c0ef-48d6-8804-e135b2f68dea admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '17355787-57e0-48f5-9070-811e461a6000') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:27.139153 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a584b60b-c0ef-48d6-8804-e135b2f68dea admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:27.165529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a584b60b-c0ef-48d6-8804-e135b2f68dea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:27.175120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a584b60b-c0ef-48d6-8804-e135b2f68dea admin admin] Releasing vlan 559 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:27:27.175120 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a584b60b-c0ef-48d6-8804-e135b2f68dea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: timer() May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:27:27.279763 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:27:27.302584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a584b60b-c0ef-48d6-8804-e135b2f68dea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:27.312867 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a584b60b-c0ef-48d6-8804-e135b2f68dea admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:27.324354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '12215d44-186e-4901-81f8-0c2cf89b7793', 'name': 'network-vif-deleted', 'tag': '64936beb-03d4-4182-81be-074a96507608'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:27:27.342209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16924b22-7217-43ba-b5b2-4b32c1bfa25b req-6907f5ee-b32c-4996-8da3-06ce99ffcb44 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 210 time: 0.1606517 May 12 15:27:27.391770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a584b60b-c0ef-48d6-8804-e135b2f68dea admin admin] Pushing event deleted for resources: {'Network': ['ID=aab37dc4-92bf-4fd9-8482-5e3a3f715d61,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:27.409810 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a584b60b-c0ef-48d6-8804-e135b2f68dea admin admin] 10.222.0.82 "DELETE /v2.0/networks/aab37dc4-92bf-4fd9-8482-5e3a3f715d61 HTTP/1.1" status: 204 len: 168 time: 0.7904871 May 12 15:27:27.574238 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-3bc07d65-f6f3-40d0-a4c4-58ba66903648 service neutron] 10.222.0.82 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4831359 May 12 15:27:27.734864 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0df30590-447c-4602-b341-5bc9ba038687 req-105153db-99a5-494b-bacd-a0d9ed1bc178 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=c3218244482a42dabbef067e351d4738&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1523328 May 12 15:27:27.776171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42800) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:27.942436 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d095a121-bbee-4f57-ab5e-91b7c9da88f8 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4e5a10df576841e2a4752a9d47fb790a&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1646185 May 12 15:27:27.948920 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42806) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:28.051935 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2bbb84bb-b871-4542-9b25-458f26650540 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:28.083820 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2bbb84bb-b871-4542-9b25-458f26650540 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:28.140631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61318137-a706-436a-8155-3963a90bc9be req-1f11b3e0-a0f7-4bf3-9eb4-621b7b312cd5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:28.148224 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61318137-a706-436a-8155-3963a90bc9be req-1f11b3e0-a0f7-4bf3-9eb4-621b7b312cd5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.5018468 May 12 15:27:28.177574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-ce4079dc-35ca-4206-b1c7-dd3723e6f445 service neutron] 10.222.0.82 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5996480 May 12 15:27:28.239249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61318137-a706-436a-8155-3963a90bc9be req-ec202b3f-9ca1-4e7d-82c3-a624391d24bb tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0879765 May 12 15:27:28.262549 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2bbb84bb-b871-4542-9b25-458f26650540 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:28.312807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bbb84bb-b871-4542-9b25-458f26650540 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f062c40f-1191-4fb3-8b41-aaf353c9847a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:28.313371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df30590-447c-4602-b341-5bc9ba038687 req-49d45ba5-c3a1-4ade-85cb-1bb9d31d203d tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:28.313371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0df30590-447c-4602-b341-5bc9ba038687 req-49d45ba5-c3a1-4ade-85cb-1bb9d31d203d tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5588512 May 12 15:27:28.345006 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2bbb84bb-b871-4542-9b25-458f26650540 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:28.349221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Request body: {'port': {'device_id': '74c4e466-421f-4802-9f9f-62d06b214e98', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': 'c3218244482a42dabbef067e351d4738'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:27:28.356815 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2bbb84bb-b871-4542-9b25-458f26650540 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f062c40f-1191-4fb3-8b41-aaf353c9847a HTTP/1.1" status: 204 len: 168 time: 0.3930984 May 12 15:27:28.453798 n-d-841483-1 neutron-server[88152]: WARNING neutron.notifiers.nova [-] Nova event matching ['req-dd4c28a4-808d-4185-a60c-8c7f13695e12']: {'server_uuid': '12215d44-186e-4901-81f8-0c2cf89b7793', 'name': 'network-vif-deleted', 'tag': '64936beb-03d4-4182-81be-074a96507608', 'status': 'failed', 'code': 422} returned with failed status May 12 15:27:28.732987 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:28.762987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0de9fe4-4bf7-47cb-b7dd-979ad451b5fa req-16948f4f-d817-42ba-88fc-0a3eb55f0681 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.1276364 May 12 15:27:28.772860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Usage tracker for resource:port and tenant:c3218244482a42dabbef067e351d4738 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:28.794490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:28.811720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:28.839787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Made reservation on behalf of c3218244482a42dabbef067e351d4738 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:27:28.843729 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:28.874975 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:29.029224 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ad4144b-038b-4109-81d0-f093e8dc02bd req-a256ffe0-41bc-40b6-9be4-7769154f1dcc tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 210 time: 0.1628771 May 12 15:27:29.030382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:29.060452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ee90e18-e1b0-4c83-a3d8-ce3bae6c7f9c req-f392db08-e5a2-4085-8329-7ea57395b299 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 210 time: 0.2216341 May 12 15:27:29.067304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Usage tracker for resource:security_group_rule and tenant:c3218244482a42dabbef067e351d4738 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:29.077215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:29.088877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:29.253300 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:29.261280 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:29.476136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b040f386-5ace-40e3-927f-58e3500d7251,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:29.724612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Allocated IP 192.168.233.237 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/55e5edc0-a664-473d-9de3-8c98bec07ca9) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:27:29.751155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ccfc9f8-a46d-4194-9322-2cd1fc58845a req-e6ec8d6d-1c69-4f0a-bcab-ebaff51a8fd5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:29.752762 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ccfc9f8-a46d-4194-9322-2cd1fc58845a req-e6ec8d6d-1c69-4f0a-bcab-ebaff51a8fd5 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.2337351 May 12 15:27:30.043003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42858) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:30.065218 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed85fa1e-c722-4cc8-8526-1420207bc30f req-15c0a15f-af65-4fb1-b084-08a08d3abc53 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.1102598 May 12 15:27:30.076320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ccfc9f8-a46d-4194-9322-2cd1fc58845a req-e93d77c0-ecf3-4f89-95e4-9e1c2c9aa033 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3157001 May 12 15:27:30.345581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1745869140-network', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:27:30.358154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:30.373166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Usage tracker for resource:network and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:30.377109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:30.395837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:30.404530 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62b079f0-def2-4dcf-a546-940101a33b4a req-26421549-608d-4464-a88c-342abe4a6ee6 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 210 time: 0.1457720 May 12 15:27:30.434052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Made reservation on behalf of c5f9faeb50de42b1a07298c25a4e4d6b for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:27:30.438068 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:30.458255 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:30.511564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:30.515506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Usage tracker for resource:security_group_rule and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:30.518425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:30.522283 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d25134d-47fe-4887-bdbc-0a88d710c909 req-079f45cb-0173-4670-bf21-d3dc68aa9135 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 210 time: 0.1341193 May 12 15:27:30.526818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:30.562100 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:30.599860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Transition to ACTIVE for port object 55e5edc0-a664-473d-9de3-8c98bec07ca9 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:27:30.647583 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:30.760613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:27:30.781148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:27:30.798839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:27:30.813315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-b72d707e-f742-4d76-aa4c-fa770eef28ba tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:30.816571 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-b72d707e-f742-4d76-aa4c-fa770eef28ba tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 812 time: 0.3586271 May 12 15:27:30.861860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Request body: {'port': {'device_id': '7a47b071-8332-4fee-b119-b2941bdd643d', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'admin_state_up': True, 'tenant_id': '011dcf6c7b624a28bb2d8ed8db38754f'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:27:30.884282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Pushing event updated for resources: {'Port': ['ID=55e5edc0-a664-473d-9de3-8c98bec07ca9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:30.951434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:30.952104 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:30.999463 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0df30590-447c-4602-b341-5bc9ba038687 req-6e3630af-0ce1-4a17-a9bc-20da73fb435f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.6700609 May 12 15:27:31.035630 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Request body: {'port': {'device_id': '74c4e466-421f-4802-9f9f-62d06b214e98', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:27:31.038912 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:31.086875 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:31.249130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1c68e3f-f95f-4174-93a8-3b036843193e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:31.298434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 598} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:27:31.307773 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e012970f-dbb2-4156-8e09-6fb2b1179a58 None None] Provisioning for port 55e5edc0-a664-473d-9de3-8c98bec07ca9 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:27:31.329208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e012970f-dbb2-4156-8e09-6fb2b1179a58 None None] Provisioning complete for port 55e5edc0-a664-473d-9de3-8c98bec07ca9 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:27:31.330968 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e012970f-dbb2-4156-8e09-6fb2b1179a58 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:31.331334 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:31.331690 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Added segment 37f382a7-d0b1-492c-b3e7-035c86377975 of type vlan for network dbecac63-cd00-4ee6-bec1-19abe557d6e1 May 12 15:27:31.353302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:31.390194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:31.406717 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:31.429116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Made reservation on behalf of 011dcf6c7b624a28bb2d8ed8db38754f for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:27:31.434384 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:31.499751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e012970f-dbb2-4156-8e09-6fb2b1179a58 None None] Port 55e5edc0-a664-473d-9de3-8c98bec07ca9 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:27:31.520824 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:31.614918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:31.616576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:31.617622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:31.646391 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-915781a3-33e6-49c1-a9a1-48fc6da5b34c req-3c31dda5-43c0-42aa-a0fe-c9a2f8add5a0 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.1608260 May 12 15:27:31.860976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] Pushing event updated for resources: {'Network': ['ID=dbecac63-cd00-4ee6-bec1-19abe557d6e1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:31.876811 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e4e09583-5040-4829-8f4a-ed048d9adf0f admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 1.8322833 May 12 15:27:31.880937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42882) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:31.888308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network dbecac63-cd00-4ee6-bec1-19abe557d6e1 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:27:31.893478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Request body: {'subnet': {'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-subnet', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:27:31.904203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:31.911022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Usage tracker for resource:subnet and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:31.918211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:31.931253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:31.937540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Allocated IP 172.20.0.7 (aa894a26-e7a0-42ea-b7f1-9a9c136eacd6/0ff5192a-946b-4444-900a-788b8ddc74b6/d63ea51f-7f5b-4b38-b682-efa710d30256) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:27:31.968049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Made reservation on behalf of c5f9faeb50de42b1a07298c25a4e4d6b for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:27:31.974258 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:31.977075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9279d39f-f602-4379-9023-0339f51fa144 req-ce723b6d-91ad-4bc5-9859-e7ff9a931f95 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 210 time: 0.0783575 May 12 15:27:32.179194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ac5271-ebc1-4080-91c3-8239257bafd4 req-6aa2831b-b234-4c42-9c91-90cfe5aa2d50 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:32.186383 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5ac5271-ebc1-4080-91c3-8239257bafd4 req-6aa2831b-b234-4c42-9c91-90cfe5aa2d50 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.7016907 May 12 15:27:32.351517 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:32.405842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 55e5edc0-a664-473d-9de3-8c98bec07ca9 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:27:32.417364 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:32.438159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Transition to ACTIVE for port object 55e5edc0-a664-473d-9de3-8c98bec07ca9 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:27:32.485228 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:32.653072 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:32.723541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:32.800844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Pushing event updated for resources: {'Port': ['ID=55e5edc0-a664-473d-9de3-8c98bec07ca9,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:32.847447 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:32.892360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5ac5271-ebc1-4080-91c3-8239257bafd4 req-8b16fe5f-7943-411d-ae91-4bc212554333 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4505525 May 12 15:27:32.952078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:32.959865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:27:33.000115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:27:33.009709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:27:33.159888 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-238aa19c-412a-4966-875b-0e37904042a5 req-47af6e32-e67e-44c1-a489-cbadedf13f9e service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.0597394 May 12 15:27:33.160633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Checking segment: {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:27:33.160998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Network hostable DHCP agents. Network: dbecac63-cd00-4ee6-bec1-19abe557d6e1, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:27:33.161997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-387bcd04-6b62-4652-b854-9baf98a4be25 req-3003dd19-b237-4f76-8d99-fa23a264963f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:33.162922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-387bcd04-6b62-4652-b854-9baf98a4be25 req-3003dd19-b237-4f76-8d99-fa23a264963f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Synchronizing usage tracker for tenant:c3218244482a42dabbef067e351d4738 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:27:33.175881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Attempting to bind port 55e5edc0-a664-473d-9de3-8c98bec07ca9 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:27:33.176466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Attempting to bind port 55e5edc0-a664-473d-9de3-8c98bec07ca9 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:27:33.176972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Attempting to bind port 55e5edc0-a664-473d-9de3-8c98bec07ca9 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:27:33.189209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46ebe083-edde-4745-9ef0-ac994d198513 req-4fd1bcbc-5ca9-46eb-9d00-ed58e6637c27 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.0921483 May 12 15:27:33.219007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Pushing event updated for resources: {'Port': ['ID=d63ea51f-7f5b-4b38-b682-efa710d30256,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:33.226917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Port 55e5edc0-a664-473d-9de3-8c98bec07ca9 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:27:33.227307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Attempting to bind port 55e5edc0-a664-473d-9de3-8c98bec07ca9 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:27:33.229194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:33.230178 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:33.236835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Network dbecac63-cd00-4ee6-bec1-19abe557d6e1 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:27:33.260709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 27, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:27:33.261431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:27:33.261765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:27:33.262614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Bound port: 55e5edc0-a664-473d-9de3-8c98bec07ca9, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:27:33.263439 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:33.263575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, dbecac63-cd00-4ee6-bec1-19abe557d6e1) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:27:33.269496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:33.270371 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:33.273438 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-580511b3-61fc-4f44-9aba-11b1046d8867 None None] Network dbecac63-cd00-4ee6-bec1-19abe557d6e1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:27:33.333836 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-387bcd04-6b62-4652-b854-9baf98a4be25 req-3003dd19-b237-4f76-8d99-fa23a264963f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Unset dirty status for tenant:c3218244482a42dabbef067e351d4738 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:27:33.343234 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-56cd4a17-76eb-41c6-bed4-48bddc17a30d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.4810646 May 12 15:27:33.354290 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-387bcd04-6b62-4652-b854-9baf98a4be25 req-3003dd19-b237-4f76-8d99-fa23a264963f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 948 time: 0.9146910 May 12 15:27:33.354520 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-552dc432-a8f0-4c61-b6f8-e6e8fda69cb5 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.4703331 May 12 15:27:33.362478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42910) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:33.369248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Request body: {'port': {'device_id': '7a47b071-8332-4fee-b119-b2941bdd643d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:27:33.446300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-387bcd04-6b62-4652-b854-9baf98a4be25 req-6420b965-8745-4d29-94dc-523cd264f8d8 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Synchronizing usage tracker for tenant:c3218244482a42dabbef067e351d4738 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:27:33.483459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-387bcd04-6b62-4652-b854-9baf98a4be25 req-6420b965-8745-4d29-94dc-523cd264f8d8 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Unset dirty status for tenant:c3218244482a42dabbef067e351d4738 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:27:33.497467 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-387bcd04-6b62-4652-b854-9baf98a4be25 req-6420b965-8745-4d29-94dc-523cd264f8d8 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/security-groups?id=b040f386-5ace-40e3-927f-58e3500d7251&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1352944 May 12 15:27:33.534791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:27:33.541644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:33.553186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Usage tracker for resource:router and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:33.558214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:33.569981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:33.582106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] For port 55e5edc0-a664-473d-9de3-8c98bec07ca9, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:27:33.592871 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:33.594142 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:33.609172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] For port 55e5edc0-a664-473d-9de3-8c98bec07ca9, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=55e5edc0-a664-473d-9de3-8c98bec07ca9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:27:33.628522 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:33.640522 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:33.649070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcf4a876-1444-4a3f-8e13-ac5b2bd150c9 req-a69b6492-c3a4-4987-82c4-77e928535cf2 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:33.650679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fcf4a876-1444-4a3f-8e13-ac5b2bd150c9 req-a69b6492-c3a4-4987-82c4-77e928535cf2 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 931 time: 0.1469662 May 12 15:27:33.657752 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:33.688362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:27:33.693486 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:33.749949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:33.750556 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:33.752069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0df30590-447c-4602-b341-5bc9ba038687 req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] 10.222.0.84 "PUT /v2.0/ports/55e5edc0-a664-473d-9de3-8c98bec07ca9 HTTP/1.1" status: 200 len: 1096 time: 2.7358990 May 12 15:27:33.770534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '74c4e466-421f-4802-9f9f-62d06b214e98', 'tag': '55e5edc0-a664-473d-9de3-8c98bec07ca9'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:27:33.910287 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fcf4a876-1444-4a3f-8e13-ac5b2bd150c9 req-151129e3-8499-44bd-b2f3-305c73deb4c8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2186985 May 12 15:27:33.918541 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fbecc1f6-ba6c-4682-b9d2-7308dc090c57'] response: {'name': 'network-changed', 'server_uuid': '74c4e466-421f-4802-9f9f-62d06b214e98', 'tag': '55e5edc0-a664-473d-9de3-8c98bec07ca9', 'status': 'completed', 'code': 200} May 12 15:27:33.996937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58f539f2-05e4-4fc2-a6f9-c967dca0ef5b service neutron] Pushing event updated for resources: {'Port': ['ID=55e5edc0-a664-473d-9de3-8c98bec07ca9,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:34.037166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Allocated IP 172.20.0.2 (dbecac63-cd00-4ee6-bec1-19abe557d6e1/7cf2ffc4-f41f-40e3-90d1-77e214ee94e3/f6b0d072-4fb0-490d-a7c2-d6cd2ad99893) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:27:34.047618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df30590-447c-4602-b341-5bc9ba038687 req-2f296cca-8172-4947-8792-ac9ea75fac19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:34.051269 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0df30590-447c-4602-b341-5bc9ba038687 req-2f296cca-8172-4947-8792-ac9ea75fac19 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c3218244482a42dabbef067e351d4738&device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 1099 time: 0.2203987 May 12 15:27:34.399557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0df30590-447c-4602-b341-5bc9ba038687 req-adbd7d25-c5ff-4742-80cd-24461df0a2ce service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.237&port_id=55e5edc0-a664-473d-9de3-8c98bec07ca9 HTTP/1.1" status: 200 len: 217 time: 0.3358412 May 12 15:27:34.522051 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:34.534344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Transition to ACTIVE for port object f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:27:34.577768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df30590-447c-4602-b341-5bc9ba038687 req-3c1335e6-33e6-4e27-8e3c-4a7b81cc8819 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:34.579630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0df30590-447c-4602-b341-5bc9ba038687 req-3c1335e6-33e6-4e27-8e3c-4a7b81cc8819 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1671202 May 12 15:27:34.601970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Transition to ACTIVE for port object f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:27:34.615796 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:34.757727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Pushing event updated for resources: {'Port': ['ID=f6b0d072-4fb0-490d-a7c2-d6cd2ad99893,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:34.787412 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Network dbecac63-cd00-4ee6-bec1-19abe557d6e1 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:27:34.788470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:27:34.793466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:27:34.798471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a0f62a7-fdc8-4af8-ab5d-5f7353ce9e80 req-4784f06b-c0c3-404c-ade2-5cab6a687b80 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:34.806636 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a0f62a7-fdc8-4af8-ab5d-5f7353ce9e80 req-4784f06b-c0c3-404c-ade2-5cab6a687b80 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.6196442 May 12 15:27:34.829071 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b3a8240-74ba-4a18-89f4-3e4b2a09a9bf req-8c0a9a78-adcb-47cb-a02a-5bd663f7b139 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.1726232 May 12 15:27:34.921925 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a0f62a7-fdc8-4af8-ab5d-5f7353ce9e80 req-4f4a2e08-37bf-4c35-a653-26d37140ca7f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1139247 May 12 15:27:34.951369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d63ea51f-7f5b-4b38-b682-efa710d30256 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:27:34.962357 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:34.968424 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df30590-447c-4602-b341-5bc9ba038687 req-62490b68-5219-40a1-9d23-174565c3373e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:34.979099 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0df30590-447c-4602-b341-5bc9ba038687 req-62490b68-5219-40a1-9d23-174565c3373e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.3896606 May 12 15:27:34.979361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Transition to ACTIVE for port object d63ea51f-7f5b-4b38-b682-efa710d30256 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:27:34.986608 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:34.994908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:35.035298 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Attempting to bind port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:27:35.035659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Attempting to bind port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:27:35.036015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Attempting to bind port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 on network dbecac63-cd00-4ee6-bec1-19abe557d6e1 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:27:35.050384 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 27, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:27:35.050743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Checking segment: {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:27:35.051060 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:35.051449 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Bound using segment: {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:27:35.051917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Bound port: f6b0d072-4fb0-490d-a7c2-d6cd2ad99893, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:27:35.052283 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:35.173815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Pushing event updated for resources: {'Port': ['ID=d63ea51f-7f5b-4b38-b682-efa710d30256,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:35.188524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] For port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:27:35.202569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] For port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f6b0d072-4fb0-490d-a7c2-d6cd2ad99893,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:27:35.208282 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:35.403655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-513c734f-8c8e-4115-a69a-ab4119450cf3 None None] Pushing event updated for resources: {'Port': ['ID=f6b0d072-4fb0-490d-a7c2-d6cd2ad99893,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:35.688879 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0df30590-447c-4602-b341-5bc9ba038687 req-58cca87e-cbdd-4911-a346-581803eac147 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7015553 May 12 15:27:35.905189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab546ba-5305-4e75-9a92-2f1a38ff848e req-0fc8aa2e-49d9-43e6-9307-bccaf6a28db3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:35.914465 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ab546ba-5305-4e75-9a92-2f1a38ff848e req-0fc8aa2e-49d9-43e6-9307-bccaf6a28db3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 943 time: 0.6912684 May 12 15:27:35.949492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66bb65f2-0520-4da0-b179-fc4708433f43 req-898906f6-9a64-4641-8f41-67d8679e84d5 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:35.958287 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Attempting to bind port d63ea51f-7f5b-4b38-b682-efa710d30256 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:27:35.958925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Attempting to bind port d63ea51f-7f5b-4b38-b682-efa710d30256 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:27:35.959042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Attempting to bind port d63ea51f-7f5b-4b38-b682-efa710d30256 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:27:35.962471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66bb65f2-0520-4da0-b179-fc4708433f43 req-898906f6-9a64-4641-8f41-67d8679e84d5 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 948 time: 0.6303773 May 12 15:27:35.969252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Port d63ea51f-7f5b-4b38-b682-efa710d30256 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:27:35.969808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Attempting to bind port d63ea51f-7f5b-4b38-b682-efa710d30256 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:27:35.978362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 27, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:27:35.979008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Checking segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:27:35.979580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Bound using segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:27:35.980182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Bound port: d63ea51f-7f5b-4b38-b682-efa710d30256, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:27:35.980696 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:36.050331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66bb65f2-0520-4da0-b179-fc4708433f43 req-ee5e89b9-769f-4749-9445-0b6b8fa723b6 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/security-groups?id=b040f386-5ace-40e3-927f-58e3500d7251&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0799894 May 12 15:27:36.135625 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ab546ba-5305-4e75-9a92-2f1a38ff848e req-0994ca58-eb61-4989-a1bc-2499fc7486b0 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2197249 May 12 15:27:36.175514 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0df30590-447c-4602-b341-5bc9ba038687 req-2e969f7f-6b53-473c-add0-396afbccbacb service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4723170 May 12 15:27:36.384409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] For port d63ea51f-7f5b-4b38-b682-efa710d30256, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:27:36.489795 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] For port d63ea51f-7f5b-4b38-b682-efa710d30256, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d63ea51f-7f5b-4b38-b682-efa710d30256,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:27:36.619702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2a13004-4bcd-40a9-8bb0-79ec0490f9d6 req-5fdb8e61-58fb-4415-94ad-121150a77476 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:36.621272 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2a13004-4bcd-40a9-8bb0-79ec0490f9d6 req-5fdb8e61-58fb-4415-94ad-121150a77476 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c3218244482a42dabbef067e351d4738&device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 1099 time: 0.3279293 May 12 15:27:36.628275 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-906b5690-f656-45f3-a22d-589194cdf205 req-43ec4531-ac6f-4b88-9397-20a355bdd533 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=6d25391c2e044b8581019b4aa97f8508&device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.1637154 May 12 15:27:36.632306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:36.860532 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-906b5690-f656-45f3-a22d-589194cdf205 req-f42bafaa-130b-484f-a65f-14ce610b993e service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=6d25391c2e044b8581019b4aa97f8508&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1010466 May 12 15:27:36.871083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:36.872091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:36.875383 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] 10.222.0.76 "PUT /v2.0/ports/d63ea51f-7f5b-4b38-b682-efa710d30256 HTTP/1.1" status: 200 len: 1091 time: 3.5198050 May 12 15:27:36.876156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7a47b071-8332-4fee-b119-b2941bdd643d', 'tag': 'd63ea51f-7f5b-4b38-b682-efa710d30256'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:27:36.939351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:36.954802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1e96fcba-9000-46d1-98d3-610ba5b63131 req-de32ced1-be1e-4188-8e18-5e5ccb43203c tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.1188045 May 12 15:27:37.002644 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:37.082522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e41f05-a7de-47ca-bf54-215efa1ca46d req-9d977998-9805-4f58-b5d0-bad0ff91c7d9 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:37.084398 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6e41f05-a7de-47ca-bf54-215efa1ca46d req-9d977998-9805-4f58-b5d0-bad0ff91c7d9 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.6110659 May 12 15:27:37.122695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2a13004-4bcd-40a9-8bb0-79ec0490f9d6 req-6f001984-e8ce-4528-b18a-88df31e631e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:37.124566 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2a13004-4bcd-40a9-8bb0-79ec0490f9d6 req-6f001984-e8ce-4528-b18a-88df31e631e5 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.4844296 May 12 15:27:37.266893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-677cc4be-352c-4637-9db9-f477b0cdfd7e None None] Network dbecac63-cd00-4ee6-bec1-19abe557d6e1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:27:37.302266 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2a13004-4bcd-40a9-8bb0-79ec0490f9d6 req-6a586148-913f-42f9-ba9d-4bfb3df16668 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.237&port_id=55e5edc0-a664-473d-9de3-8c98bec07ca9 HTTP/1.1" status: 200 len: 217 time: 0.1616926 May 12 15:27:37.341216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Allocated IP 172.25.8.166 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/af55654c-6da1-4098-b5ee-fd99b8cf7864) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:27:37.371983 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6e41f05-a7de-47ca-bf54-215efa1ca46d req-0076f03d-3ed8-4e1b-ac35-987aa8a29c42 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2767141 May 12 15:27:37.516592 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2a13004-4bcd-40a9-8bb0-79ec0490f9d6 req-1d0f373b-c3fe-4bb8-b036-1c76ed78d7a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:37.523138 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2a13004-4bcd-40a9-8bb0-79ec0490f9d6 req-1d0f373b-c3fe-4bb8-b036-1c76ed78d7a3 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2079537 May 12 15:27:37.628022 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:27:37.736737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2a13004-4bcd-40a9-8bb0-79ec0490f9d6 req-2464fc51-a025-4bc7-b0b5-5ee84e58c2b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:37.746780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2a13004-4bcd-40a9-8bb0-79ec0490f9d6 req-2464fc51-a025-4bc7-b0b5-5ee84e58c2b0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.2078817 May 12 15:27:37.801623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-58a76a02-9c92-418f-9437-21902111d51b None None] Provisioning for port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:27:37.813714 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d36642f8-13ef-4bad-957c-343a57cb2e5f'] response: {'name': 'network-changed', 'server_uuid': '7a47b071-8332-4fee-b119-b2941bdd643d', 'tag': 'd63ea51f-7f5b-4b38-b682-efa710d30256', 'status': 'completed', 'code': 200} May 12 15:27:38.036398 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:38.098683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:27:38.125043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:27:38.125453 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:38.171866 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:38.174202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-351213a0-d9d5-4610-929f-20ff863cf68c req-4f689d6c-2faa-403a-803f-e2de52f2199f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:38.187573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f73050c-83ee-48e0-9a1b-7d8f215d551e service neutron] Pushing event updated for resources: {'Port': ['ID=d63ea51f-7f5b-4b38-b682-efa710d30256,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:38.187680 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-351213a0-d9d5-4610-929f-20ff863cf68c req-4f689d6c-2faa-403a-803f-e2de52f2199f tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 948 time: 0.4331412 May 12 15:27:38.234078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906b5690-f656-45f3-a22d-589194cdf205 req-e4af9cf8-0cef-4ba2-81c2-b74e57700ab1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:38.238429 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-906b5690-f656-45f3-a22d-589194cdf205 req-e4af9cf8-0cef-4ba2-81c2-b74e57700ab1 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 1.3567362 May 12 15:27:38.384197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-351213a0-d9d5-4610-929f-20ff863cf68c req-4f734ed2-471d-41dc-8c93-aef0a8916ca2 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/security-groups?id=b040f386-5ace-40e3-927f-58e3500d7251&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1941090 May 12 15:27:38.402105 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2a13004-4bcd-40a9-8bb0-79ec0490f9d6 req-17e43a9a-9d27-4e3f-8550-7b8c49e6e1b1 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5320799 May 12 15:27:38.433652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064b1bd5-3b83-4dfa-9474-2a99654a25b8 req-fa8df073-d4ce-4bd3-b663-62c55b9e7c1d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:38.436090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:27:38.441224 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-064b1bd5-3b83-4dfa-9474-2a99654a25b8 req-fa8df073-d4ce-4bd3-b663-62c55b9e7c1d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 943 time: 0.5688143 May 12 15:27:38.444561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:27:38.450701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:27:38.503783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-ac058a38-f14c-4c11-88f4-20878fd5d77d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:38.505260 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-ac058a38-f14c-4c11-88f4-20878fd5d77d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 1094 time: 1.5094626 May 12 15:27:38.513989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Pushing event updated for resources: {'Port': ['ID=af55654c-6da1-4098-b5ee-fd99b8cf7864,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:38.629756 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:38.670292 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-3b792438-508e-412d-ae5f-09714964a8aa service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d63ea51f-7f5b-4b38-b682-efa710d30256 HTTP/1.1" status: 200 len: 217 time: 0.1507235 May 12 15:27:38.723653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-064b1bd5-3b83-4dfa-9474-2a99654a25b8 req-390898a5-dfce-469c-8f9e-0d5cbd97e5f8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2813222 May 12 15:27:38.737711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f6b0d072-4fb0-490d-a7c2-d6cd2ad99893,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:38.752525 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:38.869755 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2a13004-4bcd-40a9-8bb0-79ec0490f9d6 req-e247cd14-45eb-487e-a2eb-8eda3b0b8e6b service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4240859 May 12 15:27:39.060395 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 55e5edc0-a664-473d-9de3-8c98bec07ca9 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:27:39.067856 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b2ef6cd0-ffd8-4b9a-a27c-e199519e4a05 req-6f126f3d-2c4d-4350-baed-968934721b45 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.82 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.1065767 May 12 15:27:39.137902 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-05179387-6592-40ec-8985-6fe86365f7b6 None None] Provisioning complete for port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:27:39.138500 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-05179387-6592-40ec-8985-6fe86365f7b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:39.220102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=f6b0d072-4fb0-490d-a7c2-d6cd2ad99893,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:39.379116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-c180a3e3-76e7-4c5c-bd5b-185a06bf8f32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:39.385131 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-c180a3e3-76e7-4c5c-bd5b-185a06bf8f32 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.7027855 May 12 15:27:39.427085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 55e5edc0-a664-473d-9de3-8c98bec07ca9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=55e5edc0-a664-473d-9de3-8c98bec07ca9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:39.443187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '55e5edc0-a664-473d-9de3-8c98bec07ca9', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '55e5edc0-a664-473d-9de3-8c98bec07ca9', 'mac_address': 'fa:16:3e:a5:91:30', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.237'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:27:39.475869 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-3d07f3b7-0827-4772-b756-e1ed68721655 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0576057 May 12 15:27:39.520687 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:39.543782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 55e5edc0-a664-473d-9de3-8c98bec07ca9 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:27:39.563774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 55e5edc0-a664-473d-9de3-8c98bec07ca9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=55e5edc0-a664-473d-9de3-8c98bec07ca9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:39.569353 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:39.644541 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-906b5690-f656-45f3-a22d-589194cdf205 req-7eaad0b8-b090-4b64-96a6-74fb18a58857 tempest-ServerShowV254Test-919499272 tempest-ServerShowV254Test-919499272-project] 10.222.0.76 "GET /v2.0/ports?device_id=70d4a223-48fe-47c9-855b-64eeae2c5f0a HTTP/1.1" status: 200 len: 210 time: 0.1271875 May 12 15:27:39.684485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16ff474f-a25f-4cd2-9603-5a138c2c8429 req-f948b234-63ba-4519-9c30-69c2b4d6522b tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:39.685177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=55e5edc0-a664-473d-9de3-8c98bec07ca9,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:39.691975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16ff474f-a25f-4cd2-9603-5a138c2c8429 req-f948b234-63ba-4519-9c30-69c2b4d6522b tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.4628210 May 12 15:27:39.719563 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f747fc8-272e-4d49-8476-8c8c72b9fccf req-b89f1255-efef-46d7-8fcc-8eea135293bc tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:39.726942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f747fc8-272e-4d49-8476-8c8c72b9fccf req-b89f1255-efef-46d7-8fcc-8eea135293bc tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 947 time: 0.5029879 May 12 15:27:39.765176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c80930-0df1-4436-90fe-f6806dade2fd req-bc387468-e6f1-40a7-9029-1300fb878fb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:39.767119 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48c80930-0df1-4436-90fe-f6806dade2fd req-bc387468-e6f1-40a7-9029-1300fb878fb4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 1096 time: 0.4420681 May 12 15:27:39.885140 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16ff474f-a25f-4cd2-9603-5a138c2c8429 req-7533c1d6-28d2-4113-b6ee-afc9aa114ff2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1921954 May 12 15:27:39.887609 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-b16a5dbe-9058-4477-9ce1-0f8f7499533b service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3968413 May 12 15:27:39.928603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f747fc8-272e-4d49-8476-8c8c72b9fccf req-dd527d1f-5cfc-4f58-832f-2e905e487f74 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2008102 May 12 15:27:39.940119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['55e5edc0-a664-473d-9de3-8c98bec07ca9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:27:39.953540 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:40.062399 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c80930-0df1-4436-90fe-f6806dade2fd req-b2d6603e-bddd-496e-baec-2f68ce5ca240 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:40.063844 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48c80930-0df1-4436-90fe-f6806dade2fd req-b2d6603e-bddd-496e-baec-2f68ce5ca240 service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.2751267 May 12 15:27:40.234148 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48c80930-0df1-4436-90fe-f6806dade2fd req-2b1f754d-7d58-435b-a42c-b17aeffe91fc service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4687abde-8849-46ae-a349-bef53372a376 HTTP/1.1" status: 200 len: 217 time: 0.1268001 May 12 15:27:40.391360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c80930-0df1-4436-90fe-f6806dade2fd req-e237787c-a77c-4853-87a2-d503a046088b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:40.392938 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48c80930-0df1-4436-90fe-f6806dade2fd req-e237787c-a77c-4853-87a2-d503a046088b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.1115866 May 12 15:27:40.402366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99e8efba-74c9-4ea9-86ac-6c7dbf439e81 req-41c7b9a5-e09b-461c-a117-d32a49150cf9 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:40.404225 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99e8efba-74c9-4ea9-86ac-6c7dbf439e81 req-41c7b9a5-e09b-461c-a117-d32a49150cf9 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 949 time: 0.3395212 May 12 15:27:40.452751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978131ed-9e26-4ed8-92cb-131744fc02b6 req-07edd937-0023-4cd3-9414-f753f3686e71 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:40.459446 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-978131ed-9e26-4ed8-92cb-131744fc02b6 req-07edd937-0023-4cd3-9414-f753f3686e71 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 943 time: 0.2774773 May 12 15:27:40.556807 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-978131ed-9e26-4ed8-92cb-131744fc02b6 req-a55c1547-9c1b-4e15-b879-4a5589759058 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0963500 May 12 15:27:40.568709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99e8efba-74c9-4ea9-86ac-6c7dbf439e81 req-d7ba2021-dadd-4570-8383-851a70c96ee1 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/security-groups?id=b040f386-5ace-40e3-927f-58e3500d7251&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0896444 May 12 15:27:40.574546 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ddcbb06f-3cb9-40b2-b618-da00c6746879 req-15d796bd-ef96-4b5b-bf0c-efa013e15113 service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6698627 May 12 15:27:40.585171 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:40.600367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c80930-0df1-4436-90fe-f6806dade2fd req-02f09f2a-31b8-4602-9f54-7bf700116a53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:40.602689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48c80930-0df1-4436-90fe-f6806dade2fd req-02f09f2a-31b8-4602-9f54-7bf700116a53 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1963444 May 12 15:27:40.800360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48c80930-0df1-4436-90fe-f6806dade2fd req-1be0ea70-4ab4-4bb9-8016-fdc626a31e43 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1896842 May 12 15:27:40.975569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48c80930-0df1-4436-90fe-f6806dade2fd req-c3d39f76-d9b2-4b17-92a0-05a042a6fa16 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1687140 May 12 15:27:41.034529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43058) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:41.203492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c38eec41-3326-4e94-9896-8f22e788d488 req-0b1dbe17-d618-4acb-88fe-a96fb807a3bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:41.205944 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c38eec41-3326-4e94-9896-8f22e788d488 req-0b1dbe17-d618-4acb-88fe-a96fb807a3bc service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 1094 time: 0.5499945 May 12 15:27:41.267994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-cbe2e641-0c4a-4322-9ab4-9001bc1fd4d5 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:41.269142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-cbe2e641-0c4a-4322-9ab4-9001bc1fd4d5 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Synchronizing usage tracker for tenant:40852c97262142aeb6d62097955af83f on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:27:41.278117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:27:41.282939 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e486ae4d-1a02-46b5-bf63-7a84902e3b34 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:41.305520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e486ae4d-1a02-46b5-bf63-7a84902e3b34 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:41.310992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e486ae4d-1a02-46b5-bf63-7a84902e3b34 admin admin] Usage tracker for resource:security_group_rule and tenant:6d25391c2e044b8581019b4aa97f8508 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:41.314381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e486ae4d-1a02-46b5-bf63-7a84902e3b34 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:41.322188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e486ae4d-1a02-46b5-bf63-7a84902e3b34 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:41.352724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:27:41.400075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:27:41.400583 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:41.414181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee6ba2a-c05a-447f-9c23-2135f92dd840 req-d3e2c7b7-1381-407b-b197-826e1fb21588 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:41.415136 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dee6ba2a-c05a-447f-9c23-2135f92dd840 req-d3e2c7b7-1381-407b-b197-826e1fb21588 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 947 time: 0.2558105 May 12 15:27:41.431238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30fd1713-a070-467e-bde9-b3dde55cf541 req-8ff7dece-4829-4a21-a89a-92522ca473aa tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:41.432766 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30fd1713-a070-467e-bde9-b3dde55cf541 req-8ff7dece-4829-4a21-a89a-92522ca473aa tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.3244164 May 12 15:27:41.448625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-cbe2e641-0c4a-4322-9ab4-9001bc1fd4d5 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Unset dirty status for tenant:40852c97262142aeb6d62097955af83f on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:27:41.449905 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-cbe2e641-0c4a-4322-9ab4-9001bc1fd4d5 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.84 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 947 time: 0.7144094 May 12 15:27:41.536248 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30fd1713-a070-467e-bde9-b3dde55cf541 req-8160dfc5-080b-4ca1-b472-8e63a579563b tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0791385 May 12 15:27:41.583243 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dee6ba2a-c05a-447f-9c23-2135f92dd840 req-25f095c1-72ca-42cc-9b17-a5180633426f tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1494033 May 12 15:27:41.650354 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e486ae4d-1a02-46b5-bf63-7a84902e3b34 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:41.659026 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e486ae4d-1a02-46b5-bf63-7a84902e3b34 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:41.716175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e486ae4d-1a02-46b5-bf63-7a84902e3b34 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c34de37-9e33-4afb-a483-5e45fbe7fe36,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:41.756773 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e486ae4d-1a02-46b5-bf63-7a84902e3b34 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6d25391c2e044b8581019b4aa97f8508&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7209208 May 12 15:27:41.786444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43076) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:41.846456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c38eec41-3326-4e94-9896-8f22e788d488 req-b78e0f57-9d6c-42c2-bd3e-3c19e0ac9702 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:41.847490 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c38eec41-3326-4e94-9896-8f22e788d488 req-b78e0f57-9d6c-42c2-bd3e-3c19e0ac9702 service neutron] 10.222.0.76 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 913 time: 0.6310287 May 12 15:27:41.859135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Deleting port 0ce28f36-b32c-468c-81e3-0dd235e15282 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:27:41.859571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:41.918423 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a5dff1-e6ad-42e9-bacb-f7655c80368d req-1fab0f49-4ebd-4db2-9603-9bc733e04c6e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:41.919970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3a5dff1-e6ad-42e9-bacb-f7655c80368d req-1fab0f49-4ebd-4db2-9603-9bc733e04c6e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 943 time: 0.1609659 May 12 15:27:41.933771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80bcf66c-c1d0-4b72-a282-d7f630d36582 req-697415a2-9383-40cb-a082-79f9c63abeb6 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:41.935274 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-80bcf66c-c1d0-4b72-a282-d7f630d36582 req-697415a2-9383-40cb-a082-79f9c63abeb6 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 949 time: 0.1345222 May 12 15:27:42.012452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3a5dff1-e6ad-42e9-bacb-f7655c80368d req-122798ce-e2f8-49fd-a1a9-b0bf95519322 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0761685 May 12 15:27:42.021071 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-80bcf66c-c1d0-4b72-a282-d7f630d36582 req-49d8997c-fa31-46bb-b5b7-31b5c7a657f8 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/security-groups?id=b040f386-5ace-40e3-927f-58e3500d7251&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690148 May 12 15:27:42.038265 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c38eec41-3326-4e94-9896-8f22e788d488 req-bdd480e5-bec0-4b75-add2-b00bd5192ce8 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d63ea51f-7f5b-4b38-b682-efa710d30256 HTTP/1.1" status: 200 len: 217 time: 0.1527057 May 12 15:27:42.219960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:27:42.231211 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Sync routers for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:27:42.246140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c38eec41-3326-4e94-9896-8f22e788d488 req-d979255f-bdbe-4be8-b6af-33a851645ebc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:42.251316 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c38eec41-3326-4e94-9896-8f22e788d488 req-d979255f-bdbe-4be8-b6af-33a851645ebc service neutron] 10.222.0.76 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.1826141 May 12 15:27:42.251316 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:42.253720 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:27:42.254511 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:27:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:42.341037 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c38eec41-3326-4e94-9896-8f22e788d488 req-e8616fe2-7456-4f2f-84b3-d49aa1628dec service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0727251 May 12 15:27:42.346958 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:42.348365 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2ff76c04-f052-440b-bebc-289cbab0b6ac admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 8.9849608 May 12 15:27:42.354428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43086) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:42.376691 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:42.486921 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:27:42.650150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0ce28f36-b32c-468c-81e3-0dd235e15282,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:42.652570 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:42.681935 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ba201060-1e73-492f-b47b-fa7b5e6a43a0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:42.832962 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:39Z', 'revision_number': 3, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:42.840483 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Checking router: 616c45f4-38af-4ff7-8fb7-f1c61b204b6a for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:27:42.840949 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Updating router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a port af55654c-6da1-4098-b5ee-fd99b8cf7864 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:27:42.909780 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:42.964019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 55e5edc0-a664-473d-9de3-8c98bec07ca9 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:27:43.049829 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c38eec41-3326-4e94-9896-8f22e788d488 req-0d1737c0-1050-4d7d-80c6-91207292b0e5 service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6917377 May 12 15:27:43.050707 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:43.063043 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:43.079186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 55e5edc0-a664-473d-9de3-8c98bec07ca9 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:27:43.089580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 55e5edc0-a664-473d-9de3-8c98bec07ca9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:27:43.090297 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:43.181707 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:43.187067 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2c34de37-9e33-4afb-a483-5e45fbe7fe36 HTTP/1.1" status: 204 len: 168 time: 1.3836603 May 12 15:27:43.205003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c34de37-9e33-4afb-a483-5e45fbe7fe36,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:43.284017 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:43.330212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 55e5edc0-a664-473d-9de3-8c98bec07ca9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=55e5edc0-a664-473d-9de3-8c98bec07ca9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:43.331819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '74c4e466-421f-4802-9f9f-62d06b214e98', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '55e5edc0-a664-473d-9de3-8c98bec07ca9'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:27:43.340563 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:43.341932 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0ce28f36-b32c-468c-81e3-0dd235e15282 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:27:43.363815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e70e232-edc5-46c1-bef0-2411ee32035b req-19a31d75-408e-4cbc-814c-fa3945c5b66f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:43.365373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e70e232-edc5-46c1-bef0-2411ee32035b req-19a31d75-408e-4cbc-814c-fa3945c5b66f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 945 time: 0.5638077 May 12 15:27:43.423386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea539b6d-ace0-428e-8ba0-f8a1d6cad457 req-00824de4-59de-4e8b-8a9a-15bc641f1666 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:43.448619 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea539b6d-ace0-428e-8ba0-f8a1d6cad457 req-00824de4-59de-4e8b-8a9a-15bc641f1666 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 947 time: 0.5649924 May 12 15:27:43.573552 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:43.575757 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:43.602775 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Transition to ACTIVE for port object af55654c-6da1-4098-b5ee-fd99b8cf7864 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:27:43.628225 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:43.666879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0ce28f36-b32c-468c-81e3-0dd235e15282,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:43.687495 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:43.687495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4687abde-8849-46ae-a349-bef53372a376 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:27:43.728919 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e70e232-edc5-46c1-bef0-2411ee32035b req-9aa474f9-39cf-4949-9503-0070ab1e5d0f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3496213 May 12 15:27:43.781988 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea539b6d-ace0-428e-8ba0-f8a1d6cad457 req-823b6927-d012-41d1-8dad-fbf5bfa939f2 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.3324931 May 12 15:27:43.837366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=55e5edc0-a664-473d-9de3-8c98bec07ca9,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:43.856048 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d61cb593-9213-4d58-b128-52cc5d98670b None None] Pushing event updated for resources: {'Port': ['ID=af55654c-6da1-4098-b5ee-fd99b8cf7864,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:43.891744 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d61cb593-9213-4d58-b128-52cc5d98670b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.892092 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d61cb593-9213-4d58-b128-52cc5d98670b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.892433 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d61cb593-9213-4d58-b128-52cc5d98670b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.892767 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d61cb593-9213-4d58-b128-52cc5d98670b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.893444 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d61cb593-9213-4d58-b128-52cc5d98670b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.893781 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d61cb593-9213-4d58-b128-52cc5d98670b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.894103 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d61cb593-9213-4d58-b128-52cc5d98670b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.894421 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d61cb593-9213-4d58-b128-52cc5d98670b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.894738 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d61cb593-9213-4d58-b128-52cc5d98670b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.895054 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d61cb593-9213-4d58-b128-52cc5d98670b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.895386 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d61cb593-9213-4d58-b128-52cc5d98670b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.895680 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d61cb593-9213-4d58-b128-52cc5d98670b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.910402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.910755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.911096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.911488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.911867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.912251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.912578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.912906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.913231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.930412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.931621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.934802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55e45c61-e7d5-494c-88e8-3c29413e49bd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:43.971679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d63ea51f-7f5b-4b38-b682-efa710d30256 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:27:43.986210 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Attempting to bind port af55654c-6da1-4098-b5ee-fd99b8cf7864 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:27:43.986618 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Attempting to bind port af55654c-6da1-4098-b5ee-fd99b8cf7864 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:27:43.987097 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Attempting to bind port af55654c-6da1-4098-b5ee-fd99b8cf7864 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:27:43.998581 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 27, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:27:43.998950 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:27:43.999346 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:43.999732 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:27:44.000196 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Bound port: af55654c-6da1-4098-b5ee-fd99b8cf7864, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:27:44.007468 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:44.150869 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=0ce28f36-b32c-468c-81e3-0dd235e15282,revision_number=11']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:44.154585 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:44.155614 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:44.165020 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Floating IP eee03cda-2cfe-4a56-9504-393b66249c30 disassociated. External IP: 172.25.8.98, port: 0ce28f36-b32c-468c-81e3-0dd235e15282. May 12 15:27:44.165656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Calling delete_port for 0ce28f36-b32c-468c-81e3-0dd235e15282 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:27:44.190745 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] For port af55654c-6da1-4098-b5ee-fd99b8cf7864, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:27:44.209664 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] For port af55654c-6da1-4098-b5ee-fd99b8cf7864, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=af55654c-6da1-4098-b5ee-fd99b8cf7864,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:27:44.227803 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:44.256316 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:27:44.281770 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c38eec41-3326-4e94-9896-8f22e788d488 req-032d864e-2c64-4cf6-8155-f2b5834901a3 service neutron] 10.222.0.76 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.2120385 May 12 15:27:44.370766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:27:44.370984 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:27:44.373608 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:44.408871 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d61cb593-9213-4d58-b128-52cc5d98670b None None] Pushing event updated for resources: {'Port': ['ID=af55654c-6da1-4098-b5ee-fd99b8cf7864,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:44.448507 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:27:44.449080 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:27:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:44.496330 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d63ea51f-7f5b-4b38-b682-efa710d30256, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d63ea51f-7f5b-4b38-b682-efa710d30256,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:44.517641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4687abde-8849-46ae-a349-bef53372a376, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4687abde-8849-46ae-a349-bef53372a376,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:44.533993 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:44.619658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'd63ea51f-7f5b-4b38-b682-efa710d30256', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'port_id': 'd63ea51f-7f5b-4b38-b682-efa710d30256', 'mac_address': 'fa:16:3e:1e:32:54', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 573, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0ff5192a-946b-4444-900a-788b8ddc74b6', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:27:44.694387 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2be366f3-3c62-4d32-8197-d7a5fdb357e4 req-6caa7846-7964-4866-b454-957fe558c0a3 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:44.703182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2be366f3-3c62-4d32-8197-d7a5fdb357e4 req-6caa7846-7964-4866-b454-957fe558c0a3 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 950 time: 0.6308899 May 12 15:27:44.745262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7861ec3e-c2c7-4970-b275-deeb595dff6c req-beed8dfd-8c5b-433d-aac4-325fef2c0767 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:44.753099 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7861ec3e-c2c7-4970-b275-deeb595dff6c req-beed8dfd-8c5b-433d-aac4-325fef2c0767 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 943 time: 0.6875176 May 12 15:27:44.802691 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:27:44.857504 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:44.872271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Deleting port 0ce28f36-b32c-468c-81e3-0dd235e15282 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:27:44.872719 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:44.887407 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2be366f3-3c62-4d32-8197-d7a5fdb357e4 req-b2c08a1b-b488-48d8-8787-3ebd6b955eb8 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/security-groups?id=b040f386-5ace-40e3-927f-58e3500d7251&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1829302 May 12 15:27:44.899714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4687abde-8849-46ae-a349-bef53372a376,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:44.932516 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-aa0d2691-2b7b-402c-ab07-9ba9ebd32f00 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:44.935035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d63ea51f-7f5b-4b38-b682-efa710d30256 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:27:44.969523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d63ea51f-7f5b-4b38-b682-efa710d30256, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d63ea51f-7f5b-4b38-b682-efa710d30256,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:44.983850 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:44.999594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7861ec3e-c2c7-4970-b275-deeb595dff6c req-fa1abe57-b3a1-4315-8aa8-7e91a4460cf5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2450945 May 12 15:27:45.059128 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e76cd97c-bf3c-49d5-a682-71aef7414f1a'] response: {'server_uuid': '74c4e466-421f-4802-9f9f-62d06b214e98', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '55e5edc0-a664-473d-9de3-8c98bec07ca9', 'code': 200} May 12 15:27:45.159427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d63ea51f-7f5b-4b38-b682-efa710d30256,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:45.244540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['d63ea51f-7f5b-4b38-b682-efa710d30256'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:27:45.418889 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:45.470822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] For port 0ce28f36-b32c-468c-81e3-0dd235e15282, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0ce28f36-b32c-468c-81e3-0dd235e15282,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:45.471477 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:45.498307 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:39Z', 'revision_number': 3, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:45.510888 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a7b51c3-74dc-494a-b772-ca328c4ff49e None None] The sync data for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 is: [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:39Z', 'revision_number': 3, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:27:45.587577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2eae5b-7003-4519-a809-27a5c9a5d8ae req-b149e0b5-b2a4-4455-99e4-e9c7594eddae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:45.589083 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a2eae5b-7003-4519-a809-27a5c9a5d8ae req-b149e0b5-b2a4-4455-99e4-e9c7594eddae service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 1101 time: 0.4588850 May 12 15:27:45.622104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da69c55d-8984-4256-bafa-cf9ee2f3d0fa req-f96ae63c-da57-49da-b94e-6aef9f02a6a0 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:45.623621 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da69c55d-8984-4256-bafa-cf9ee2f3d0fa req-f96ae63c-da57-49da-b94e-6aef9f02a6a0 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 945 time: 0.4135327 May 12 15:27:45.687549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de11cf19-f24c-45ba-a073-7fe92321cd55 req-29b4592f-e9c1-436e-aaab-d0cdbddc6839 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:45.689057 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de11cf19-f24c-45ba-a073-7fe92321cd55 req-29b4592f-e9c1-436e-aaab-d0cdbddc6839 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 943 time: 0.4902716 May 12 15:27:45.815457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da69c55d-8984-4256-bafa-cf9ee2f3d0fa req-0a8b3341-c467-485f-8d4f-fcd752a8da72 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups?id=8608e463-6f23-456a-983e-4341787ed2c8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1650527 May 12 15:27:45.823298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a2eae5b-7003-4519-a809-27a5c9a5d8ae req-d7e05e55-c2db-47f3-900e-e8948656968a service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=b040f386-5ace-40e3-927f-58e3500d7251&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1986933 May 12 15:27:46.002945 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:46.002945 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:46.003292 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Floating IP eee03cda-2cfe-4a56-9504-393b66249c30 disassociated. External IP: 172.25.8.98, port: 0ce28f36-b32c-468c-81e3-0dd235e15282. May 12 15:27:46.004654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Calling delete_port for 0ce28f36-b32c-468c-81e3-0dd235e15282 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:27:46.076614 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:46.152945 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de11cf19-f24c-45ba-a073-7fe92321cd55 req-56f341e2-3eae-466e-b47a-71482d05d90c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4263706 May 12 15:27:46.183769 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:46.237529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Allocated IP 172.20.0.1 (dbecac63-cd00-4ee6-bec1-19abe557d6e1/7cf2ffc4-f41f-40e3-90d1-77e214ee94e3/5ca267b9-8aa5-4388-b459-c37844d97daf) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:27:46.352481 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:46.463860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event deleted for resources: {'Port': ['ID=0ce28f36-b32c-468c-81e3-0dd235e15282,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:46.883778 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:46.892918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Router 78d4ada5-c100-4849-8e75-44ba389f27d8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:27:46.922412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Transition to ACTIVE for port object 5ca267b9-8aa5-4388-b459-c37844d97daf will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:27:46.952610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e673ac3e-b80e-441c-bdb6-edf58c61be68 req-dd5e83d2-971b-4418-a24b-25d78845d7c1 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:46.954588 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e673ac3e-b80e-441c-bdb6-edf58c61be68 req-dd5e83d2-971b-4418-a24b-25d78845d7c1 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 950 time: 0.4539871 May 12 15:27:46.962895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4687abde-8849-46ae-a349-bef53372a376 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:27:47.022142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbbe05df-593a-48ab-8143-8afa77611b02 req-c712ff02-9212-49d7-8b17-f1c40f6c241e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:47.032735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bbbe05df-593a-48ab-8143-8afa77611b02 req-c712ff02-9212-49d7-8b17-f1c40f6c241e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 944 time: 0.3390081 May 12 15:27:47.087070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282'}, {'server_uuid': 'bd320183-5cdb-430c-beea-7c2caa66e5b4', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4687abde-8849-46ae-a349-bef53372a376'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:27:47.354985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e673ac3e-b80e-441c-bdb6-edf58c61be68 req-994e53c2-b681-4268-9400-7605e876f079 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/security-groups?id=b040f386-5ace-40e3-927f-58e3500d7251&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3711145 May 12 15:27:47.359673 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:47.403056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device af55654c-6da1-4098-b5ee-fd99b8cf7864 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:27:47.426424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bbbe05df-593a-48ab-8143-8afa77611b02 req-adc403fd-0fb3-4aa0-b470-e3040b07c32d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3813269 May 12 15:27:47.548104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:27:47.553742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Network dbecac63-cd00-4ee6-bec1-19abe557d6e1 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:27:47.569135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:27:47.572684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05932d68-75d9-4172-9bb9-963c587ecca1 None None] Sync routers for ids ['78d4ada5-c100-4849-8e75-44ba389f27d8'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:27:47.622857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05932d68-75d9-4172-9bb9-963c587ecca1 None None] Routers {'78d4ada5-c100-4849-8e75-44ba389f27d8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:27:47.623750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-05932d68-75d9-4172-9bb9-963c587ecca1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:27:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['78d4ada5-c100-4849-8e75-44ba389f27d8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:47.687215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:27:47.704223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] No DVR routers for this DVR port 0ce28f36-b32c-468c-81e3-0dd235e15282 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:27:47.707396 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:47.719919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'name': 'network-vif-deleted', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:27:47.743502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9bb34d7-311c-453a-84aa-6bf142c0c0fd req-8cb93455-0bd7-4aff-9fb1-767b5bd0d26b tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.1825967 May 12 15:27:47.743776 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d0fe0d8-9ae7-4d35-a4c8-61fc617fff84 req-3135950e-c3ab-4b43-b761-286ced1ca521 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.84 "DELETE /v2.0/ports/0ce28f36-b32c-468c-81e3-0dd235e15282 HTTP/1.1" status: 204 len: 173 time: 6.2748141 May 12 15:27:47.826090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Pushing event updated for resources: {'Port': ['ID=5ca267b9-8aa5-4388-b459-c37844d97daf,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:47.908233 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:48.034456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-05932d68-75d9-4172-9bb9-963c587ecca1 None None] Set router 78d4ada5-c100-4849-8e75-44ba389f27d8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:27:48.099216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d63ea51f-7f5b-4b38-b682-efa710d30256 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:27:48.169134 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:48.203555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port af55654c-6da1-4098-b5ee-fd99b8cf7864 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:27:48.246696 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0dee00f4-bc92-4a43-9ec2-52a79657d46f req-c21af220-179e-45e9-8d53-05a567b5a46e tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/ports?device_id=62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb HTTP/1.1" status: 200 len: 210 time: 0.0786889 May 12 15:27:48.291520 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-465c6896-99a2-4889-bc5b-1f2666c07bef None None] Provisioning for port 5ca267b9-8aa5-4388-b459-c37844d97daf completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:27:48.298147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port af55654c-6da1-4098-b5ee-fd99b8cf7864 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:27:48.298550 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:48.334608 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-465c6896-99a2-4889-bc5b-1f2666c07bef None None] Provisioning complete for port 5ca267b9-8aa5-4388-b459-c37844d97daf triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:27:48.334962 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-465c6896-99a2-4889-bc5b-1f2666c07bef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:48.444318 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-dabb737d-af87-4ea7-b2dd-ad97df795fcd'] response: {'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'code': 200} May 12 15:27:48.444530 n-d-841483-1 neutron-server[88153]: WARNING neutron.notifiers.nova [-] Nova event matching ['req-dabb737d-af87-4ea7-b2dd-ad97df795fcd']: {'server_uuid': 'bd320183-5cdb-430c-beea-7c2caa66e5b4', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '4687abde-8849-46ae-a349-bef53372a376', 'code': 422} returned with failed status May 12 15:27:48.474422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b1bdea5-188b-4390-b3b7-625a46fb03f4 req-a1cbbe05-d4ca-4a7d-b716-169de7f3700c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:48.476914 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b1bdea5-188b-4390-b3b7-625a46fb03f4 req-a1cbbe05-d4ca-4a7d-b716-169de7f3700c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.8954866 May 12 15:27:48.513893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-465c6896-99a2-4889-bc5b-1f2666c07bef None None] Port 5ca267b9-8aa5-4388-b459-c37844d97daf cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:27:48.518591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port d63ea51f-7f5b-4b38-b682-efa710d30256 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:27:48.546438 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5bb9d977-7788-4287-a1d8-3703044d516f'] response: {'server_uuid': '62e81ffc-e2bf-40ec-8b75-04e8c6e70eeb', 'name': 'network-vif-deleted', 'tag': '0ce28f36-b32c-468c-81e3-0dd235e15282', 'status': 'completed', 'code': 200} May 12 15:27:48.547708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port d63ea51f-7f5b-4b38-b682-efa710d30256 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:27:48.548281 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:48.607617 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:48.654944 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b1bdea5-188b-4390-b3b7-625a46fb03f4 req-67b51884-90b5-46d9-9262-9a9c9cb290cb tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1665266 May 12 15:27:48.768230 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:48.856261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port af55654c-6da1-4098-b5ee-fd99b8cf7864, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=af55654c-6da1-4098-b5ee-fd99b8cf7864,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:48.870668 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:48.907264 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:48.938843 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-05932d68-75d9-4172-9bb9-963c587ecca1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:43Z', 'revision_number': 5, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:48.959506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05932d68-75d9-4172-9bb9-963c587ecca1 None None] Checking router: 78d4ada5-c100-4849-8e75-44ba389f27d8 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:27:48.984149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d63ea51f-7f5b-4b38-b682-efa710d30256, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d63ea51f-7f5b-4b38-b682-efa710d30256,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:48.989638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05932d68-75d9-4172-9bb9-963c587ecca1 None None] Routers {'78d4ada5-c100-4849-8e75-44ba389f27d8'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:27:48.990514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-05932d68-75d9-4172-9bb9-963c587ecca1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:27:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['78d4ada5-c100-4849-8e75-44ba389f27d8'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:49.063349 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:49.125222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=af55654c-6da1-4098-b5ee-fd99b8cf7864,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:49.147629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:49.148735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:49.149137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:49.149750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:49.150307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:49.150885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:49.151473 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:49.152091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:49.152602 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:49.154173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:49.154173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:49.154173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:49.314058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26c8e940-f0e6-4fdc-b38b-27cf210785ab req-45a9044c-44d0-49fa-9924-5fe3a5f0a277 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:49.315648 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-26c8e940-f0e6-4fdc-b38b-27cf210785ab req-45a9044c-44d0-49fa-9924-5fe3a5f0a277 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.4036081 May 12 15:27:49.333034 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device af55654c-6da1-4098-b5ee-fd99b8cf7864 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:27:49.373200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9bb1a5c-d8b2-40da-bf8b-53883af75554 req-6b30d8a7-570e-445d-9a84-84509a976f37 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:49.376637 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9bb1a5c-d8b2-40da-bf8b-53883af75554 req-6b30d8a7-570e-445d-9a84-84509a976f37 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 950 time: 0.4040408 May 12 15:27:49.422110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d63ea51f-7f5b-4b38-b682-efa710d30256,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:49.435075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-26c8e940-f0e6-4fdc-b38b-27cf210785ab req-fa5ee08c-6f80-4e95-b56b-a89d3bb911dd tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1095943 May 12 15:27:49.450986 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:49.451991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-05932d68-75d9-4172-9bb9-963c587ecca1 None None] Set router 78d4ada5-c100-4849-8e75-44ba389f27d8 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:27:49.467516 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9bb1a5c-d8b2-40da-bf8b-53883af75554 req-9fb3d6af-03c7-447b-a551-606ce5dfbb24 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/security-groups?id=b040f386-5ace-40e3-927f-58e3500d7251&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0899978 May 12 15:27:49.469034 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:49.568532 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:49.581232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port af55654c-6da1-4098-b5ee-fd99b8cf7864 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:27:49.581601 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:49.862790 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27b55948-be20-4007-bea3-5a1759821549 req-61596fd2-3739-4bda-a766-801e82d949a1 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.1106718 May 12 15:27:49.936653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Pushing event updated for resources: {'Port': ['ID=5ca267b9-8aa5-4388-b459-c37844d97daf,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:50.030743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Network dbecac63-cd00-4ee6-bec1-19abe557d6e1 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:27:50.033688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:27:50.087105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-05932d68-75d9-4172-9bb9-963c587ecca1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:43Z', 'revision_number': 5, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:50.091665 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05932d68-75d9-4172-9bb9-963c587ecca1 None None] The sync data for ids ['78d4ada5-c100-4849-8e75-44ba389f27d8'] in n-d-841483-1 is: [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:20:26Z', 'revision_number': 4, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '77d485e0-c0f7-452a-ba64-2ff75661cddd', 'name': '', 'network_id': '2d986451-1d91-468d-8a9c-ecc4da7a86bc', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'mac_address': 'fa:16:3e:26:7e:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1473, 'fixed_ips': [{'subnet_id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:25Z', 'updated_at': '2022-05-12T15:20:43Z', 'revision_number': 5, 'project_id': '40852c97262142aeb6d62097955af83f', 'subnets': [{'id': '5f6d45f7-b8bc-4313-879f-ee173c0a4148', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:27:50.114411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa5befe5-213d-4671-9900-748a2a9d19f2 req-b08cf9a8-e186-43bd-87b4-858e7132c236 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:50.117279 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa5befe5-213d-4671-9900-748a2a9d19f2 req-b08cf9a8-e186-43bd-87b4-858e7132c236 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.3661132 May 12 15:27:50.383776 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa5befe5-213d-4671-9900-748a2a9d19f2 req-ad5b6041-13ef-4b07-b51e-524bd27467d7 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2580183 May 12 15:27:50.446378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7a47b071-8332-4fee-b119-b2941bdd643d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd63ea51f-7f5b-4b38-b682-efa710d30256'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:27:50.472041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ad4c3ff2-652f-4a39-a77c-cdeecbe4f43b None None] Provisioning complete for port 5ca267b9-8aa5-4388-b459-c37844d97daf triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:27:50.472414 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ad4c3ff2-652f-4a39-a77c-cdeecbe4f43b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:50.476895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:27:50.497827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43272) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:50.607983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ad4c3ff2-652f-4a39-a77c-cdeecbe4f43b None None] Port 5ca267b9-8aa5-4388-b459-c37844d97daf cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:27:50.613494 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-426c1f91-7d0e-45cc-a457-e8c57c813e56 req-0acaf86c-1a18-4f82-a1f6-863bd319b8db service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.4177656 May 12 15:27:50.727117 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f79a1cd-fd23-42fa-9afb-bf65a24192cb None None] New status for floating IP eee03cda-2cfe-4a56-9504-393b66249c30: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:27:50.742751 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d1c83922-011c-452c-8bb5-f0922b95f3fd'] response: {'server_uuid': '7a47b071-8332-4fee-b119-b2941bdd643d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd63ea51f-7f5b-4b38-b682-efa710d30256', 'code': 200} May 12 15:27:51.006097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:27:51.016373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Sync routers for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:27:51.034887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:27:51.035815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:27:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:51.045832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f64cc71-c80a-4d6b-aa86-605dd3d93afe req-9f9366a3-bade-43b4-844d-ff6f7ba9512d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:51.050090 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7f64cc71-c80a-4d6b-aa86-605dd3d93afe req-9f9366a3-bade-43b4-844d-ff6f7ba9512d service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 1096 time: 0.1631651 May 12 15:27:51.143317 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7f64cc71-c80a-4d6b-aa86-605dd3d93afe req-d9611bb4-17f9-49f0-b239-1620c9df8d76 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0799539 May 12 15:27:51.151228 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:51.162722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bbec94c6-5da0-450b-b346-89b6636fd46d admin admin] 10.222.0.82 "PUT /v2.0/routers/616c45f4-38af-4ff7-8fb7-f1c61b204b6a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.8053191 May 12 15:27:51.236832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43775ef8-2fc4-4671-8efb-e560c6647eaa req-9b5f8119-852d-4f75-9597-bc769fe350cc tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:51.238421 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43775ef8-2fc4-4671-8efb-e560c6647eaa req-9b5f8119-852d-4f75-9597-bc769fe350cc tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.5663948 May 12 15:27:51.247756 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:51.381095 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43775ef8-2fc4-4671-8efb-e560c6647eaa req-661dfd1d-82c2-446a-91ee-273a04fc6e97 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1197114 May 12 15:27:51.456889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6da7148-19d8-45a4-a175-b33bafa1afd9 req-d2c0aee8-5177-4987-b13c-fe09d30e62e9 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:51.471071 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6da7148-19d8-45a4-a175-b33bafa1afd9 req-d2c0aee8-5177-4987-b13c-fe09d30e62e9 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.5453558 May 12 15:27:51.521890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:27:51.579184 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:51.618995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6da7148-19d8-45a4-a175-b33bafa1afd9 req-c9a963df-a03d-4c32-9b5c-43628a2c536c tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1401920 May 12 15:27:51.695440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8608e463-6f23-456a-983e-4341787ed2c8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:51.738384 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:51.744413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43302) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:51.774001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "DELETE /v2.0/security-groups/8608e463-6f23-456a-983e-4341787ed2c8 HTTP/1.1" status: 204 len: 168 time: 1.2735500 May 12 15:27:51.778805 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:51.801283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:51.809937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:51.814008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:51.819417 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-89524da6-9211-4ed3-ac0e-91b2f030fdf7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] show failed (client error): The resource could not be found. May 12 15:27:51.826207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:51.826895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:51.827395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:51.828628 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-89524da6-9211-4ed3-ac0e-91b2f030fdf7 tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "GET /v2.0/security-groups/8608e463-6f23-456a-983e-4341787ed2c8 HTTP/1.1" status: 404 len: 347 time: 0.0829182 May 12 15:27:51.829437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:51.829584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43308) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:51.830109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:51.830997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:51.832872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:51.833326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8165858a-d5d4-4b69-9b6f-713e58e735fa tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:27:51.852948 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-98605bde-c57a-49e8-b1a4-86f57faa2864 req-6846e429-3090-4108-9e51-edd9bc64ea01 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.2213671 May 12 15:27:52.006474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5258ef67-5762-4658-a72a-616d5f5774bc req-125e5e7a-dbcc-4cdd-9c80-e082f46c4422 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:52.010089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5258ef67-5762-4658-a72a-616d5f5774bc req-125e5e7a-dbcc-4cdd-9c80-e082f46c4422 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2327857 May 12 15:27:52.207906 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5258ef67-5762-4658-a72a-616d5f5774bc req-bf8b1b29-c566-441a-860f-0fb4e5b4ba57 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1835954 May 12 15:27:52.566095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-cc2e1067-dc38-4109-92f3-21aa6750d86b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Deleting port 566a9985-5619-40f3-99a4-11c4f7d053ee {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:27:52.566827 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2e1067-dc38-4109-92f3-21aa6750d86b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:52.602258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43322) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:52.612127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'security_group': {'name': 'tempest-securitygroup--160078060', 'description': 'tempest-description--160358237'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:27:52.628379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:52.639777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:52.661299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:52.685975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:52.715384 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 2, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:52.727382 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Checking router: 616c45f4-38af-4ff7-8fb7-f1c61b204b6a for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:27:52.728820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Updating router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a port 5ca267b9-8aa5-4388-b459-c37844d97daf binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:27:52.731234 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:52.816255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:52.831047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group_rule and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:52.845313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:52.869402 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:52.872742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:53.130003 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2e1067-dc38-4109-92f3-21aa6750d86b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:53.130697 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2e1067-dc38-4109-92f3-21aa6750d86b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:53.175339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74468329-7243-4357-b68c-77cc474d1450 req-79b3adb1-d7ed-4217-9c90-ff0f45a89ad0 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:53.176891 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74468329-7243-4357-b68c-77cc474d1450 req-79b3adb1-d7ed-4217-9c90-ff0f45a89ad0 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.2201612 May 12 15:27:53.223457 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:53.275529 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:53.349627 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74468329-7243-4357-b68c-77cc474d1450 req-e1eb8ff4-db9c-4f09-b95c-144a3cbb2769 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1481078 May 12 15:27:53.392509 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a38d2c29-bf89-4d38-a714-9037ce4b4638,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:53.419969 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:53.426861 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-04b349dc-cd6d-4be2-b4ba-d0702303e70e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 0.8213246 May 12 15:27:53.429870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43348) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:53.448483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a32c600c-bab0-4aaf-8340-17158cce5246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'security_group_rule': {'security_group_id': 'a38d2c29-bf89-4d38-a714-9037ce4b4638', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:27:53.457784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a32c600c-bab0-4aaf-8340-17158cce5246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:53.464806 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a32c600c-bab0-4aaf-8340-17158cce5246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group_rule and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:53.468490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-cc2e1067-dc38-4109-92f3-21aa6750d86b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Calling delete_port for 566a9985-5619-40f3-99a4-11c4f7d053ee owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:27:53.470160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a32c600c-bab0-4aaf-8340-17158cce5246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:53.478529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a32c600c-bab0-4aaf-8340-17158cce5246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:53.618154 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c9bf90d-877b-453d-aa6c-acb837743dcb req-f7d3f97d-3c52-4846-9aa8-8dd1126c420a tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.1267896 May 12 15:27:53.620104 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a32c600c-bab0-4aaf-8340-17158cce5246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:53.672020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-472db02e-5aea-4640-9332-436e22543c56 req-e9ea5ec3-c0d3-4fab-9eb9-93800cfad0a2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:53.687203 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-472db02e-5aea-4640-9332-436e22543c56 req-e9ea5ec3-c0d3-4fab-9eb9-93800cfad0a2 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.4626486 May 12 15:27:53.710326 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2e1067-dc38-4109-92f3-21aa6750d86b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:53.766093 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:53.782603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Transition to ACTIVE for port object 5ca267b9-8aa5-4388-b459-c37844d97daf will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:27:53.799553 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:53.853080 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-472db02e-5aea-4640-9332-436e22543c56 req-eac436c2-3d35-4578-948f-0b691b5f4632 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1549809 May 12 15:27:53.889888 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a32c600c-bab0-4aaf-8340-17158cce5246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:53.898372 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a32c600c-bab0-4aaf-8340-17158cce5246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:53.958871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a32c600c-bab0-4aaf-8340-17158cce5246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d440e4c8-51c0-41fd-9a72-a3bea75fe029,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:53.978191 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a32c600c-bab0-4aaf-8340-17158cce5246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:53.980212 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a32c600c-bab0-4aaf-8340-17158cce5246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5492904 May 12 15:27:53.982996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43360) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:53.989149 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c32ee2c1-380d-4322-a5eb-40652bea2966 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'security_group_rule': {'security_group_id': 'a38d2c29-bf89-4d38-a714-9037ce4b4638', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:27:53.998378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c32ee2c1-380d-4322-a5eb-40652bea2966 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:54.003865 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c32ee2c1-380d-4322-a5eb-40652bea2966 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group_rule and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:54.007262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc2e1067-dc38-4109-92f3-21aa6750d86b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Pushing event deleted for resources: {'Port': ['ID=566a9985-5619-40f3-99a4-11c4f7d053ee,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:54.008811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c32ee2c1-380d-4322-a5eb-40652bea2966 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:54.016752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c32ee2c1-380d-4322-a5eb-40652bea2966 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:54.088110 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c32ee2c1-380d-4322-a5eb-40652bea2966 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:54.158439 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-691d58bc-1395-4b12-8447-933c041f602d None None] Pushing event updated for resources: {'Port': ['ID=5ca267b9-8aa5-4388-b459-c37844d97daf,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:54.198085 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2e1067-dc38-4109-92f3-21aa6750d86b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:54.265088 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2e1067-dc38-4109-92f3-21aa6750d86b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:54.270830 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cc2e1067-dc38-4109-92f3-21aa6750d86b tempest-AttachVolumeShelveTestJSON-694701066 tempest-AttachVolumeShelveTestJSON-694701066-project] 10.222.0.82 "DELETE /v2.0/floatingips/eee03cda-2cfe-4a56-9504-393b66249c30 HTTP/1.1" status: 204 len: 168 time: 2.4400492 May 12 15:27:54.428554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Attempting to bind port 5ca267b9-8aa5-4388-b459-c37844d97daf on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:27:54.428919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Attempting to bind port 5ca267b9-8aa5-4388-b459-c37844d97daf by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:27:54.429500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Attempting to bind port 5ca267b9-8aa5-4388-b459-c37844d97daf on network dbecac63-cd00-4ee6-bec1-19abe557d6e1 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:27:54.442446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 27, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:27:54.443018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Checking segment: {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:27:54.443434 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:54.446234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Bound using segment: {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:27:54.446734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Bound port: 5ca267b9-8aa5-4388-b459-c37844d97daf, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:27:54.447115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:54.468464 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c32ee2c1-380d-4322-a5eb-40652bea2966 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:54.481080 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c32ee2c1-380d-4322-a5eb-40652bea2966 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:54.548243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2c66dc3-edf0-4189-9017-913489a99098 req-f1186e7e-d26a-4b16-8dfa-2cd38deb409f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:54.562185 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b2c66dc3-edf0-4189-9017-913489a99098 req-f1186e7e-d26a-4b16-8dfa-2cd38deb409f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.2313335 May 12 15:27:54.583193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] For port 5ca267b9-8aa5-4388-b459-c37844d97daf, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:27:54.586446 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c32ee2c1-380d-4322-a5eb-40652bea2966 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:54.587612 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c32ee2c1-380d-4322-a5eb-40652bea2966 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.6033759 May 12 15:27:54.589267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c32ee2c1-380d-4322-a5eb-40652bea2966 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2d5425c6-0459-421f-a571-d760a0de6f4c,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:54.590080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] For port 5ca267b9-8aa5-4388-b459-c37844d97daf, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5ca267b9-8aa5-4388-b459-c37844d97daf,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:27:54.591713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43384) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:27:54.599527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:27:54.607655 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:54.612691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:27:54.622087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:floatingip and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:27:54.638481 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:27:54.679183 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b2c66dc3-edf0-4189-9017-913489a99098 req-c9d5638b-df98-401e-8fd7-fdbca0de955f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1142190 May 12 15:27:54.714350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:27:54.736318 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:54.869991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-691d58bc-1395-4b12-8447-933c041f602d None None] Pushing event updated for resources: {'Port': ['ID=5ca267b9-8aa5-4388-b459-c37844d97daf,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:54.925822 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-23b8daf8-b999-4ca2-b735-4ecc0cf77621 req-cb9d82ac-6947-4271-85b6-54543844ec43 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.1479559 May 12 15:27:54.927684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:27:54.931041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:27:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:55.299088 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-23b8daf8-b999-4ca2-b735-4ecc0cf77621 req-1f63b882-0bb6-4dd0-bef9-a6141d2984a1 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.1741755 May 12 15:27:55.327664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d7ccb1-988f-440c-a9de-ea8e496b0a95 req-8108e233-58f0-482b-8729-00eb0f662abe tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:55.337605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33d7ccb1-988f-440c-a9de-ea8e496b0a95 req-8108e233-58f0-482b-8729-00eb0f662abe tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2193279 May 12 15:27:55.341476 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:27:55.501639 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:55.504064 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33d7ccb1-988f-440c-a9de-ea8e496b0a95 req-667fe24b-896a-4c53-a049-c02ff73b665b tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1651199 May 12 15:27:55.505316 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-23b8daf8-b999-4ca2-b735-4ecc0cf77621 req-5e3a742d-a0bf-467d-afa9-03b1a325388f service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0540981 May 12 15:27:55.819838 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1efe3c43-2251-4023-8e11-ab11f96dda43 req-678f7871-dee9-44da-a92f-6bbc20893e0e tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.1061223 May 12 15:27:55.946523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14b0e51c-2cf4-4a42-b1d9-739d7a8fb10e req-8d5179ca-1c42-4b42-871b-beb8947852fd tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:55.956481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14b0e51c-2cf4-4a42-b1d9-739d7a8fb10e req-8d5179ca-1c42-4b42-871b-beb8947852fd tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.1355932 May 12 15:27:56.008414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23b8daf8-b999-4ca2-b735-4ecc0cf77621 req-3a3622d6-1ad3-49b4-a6ed-fb27b5b3de75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:56.010384 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-23b8daf8-b999-4ca2-b735-4ecc0cf77621 req-3a3622d6-1ad3-49b4-a6ed-fb27b5b3de75 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3688147 May 12 15:27:56.076133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14b0e51c-2cf4-4a42-b1d9-739d7a8fb10e req-61bf080d-92cd-4a96-93ae-0d1aff8be3ef tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1181338 May 12 15:27:56.121403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Allocated IP 172.25.8.38 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/cfe0c0ef-42e0-45f7-beb9-49babc2e71c9) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:27:56.272472 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:54Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:27:56.289343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abe1e97f-d13f-4c10-805f-67b9dd1b5e0a None None] The sync data for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 is: [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:54Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:27:56.461806 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:56.501471 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:56.668663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:27:56.670440 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'Port': ['ID=cfe0c0ef-42e0-45f7-beb9-49babc2e71c9,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:56.684575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:27:56.692863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:27:56.831750 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:56.858107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c6e329-15d5-4965-a422-85437b57b2f9 req-7a2c19d2-308e-484a-824d-55f426179d00 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:56.861119 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08c6e329-15d5-4965-a422-85437b57b2f9 req-7a2c19d2-308e-484a-824d-55f426179d00 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1441927 May 12 15:27:56.937075 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:56.986595 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08c6e329-15d5-4965-a422-85437b57b2f9 req-1cc129ac-c5e6-42d3-8a10-87ab88bf9df3 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1016684 May 12 15:27:57.160327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-cd96f4cb-0392-4b15-adb4-8fb3bab56f16 req-762056b0-df62-4842-a985-38108c019144 service neutron] (88152) timed out ('10.222.0.76', 61658) {{(pid=88152) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 15:27:57.184362 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48b9c52c-8106-4da5-9af5-1165978612fa req-10c6728d-a94c-4364-8ccd-1df91e861afc tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.1204751 May 12 15:27:57.371211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5ca267b9-8aa5-4388-b459-c37844d97daf up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:27:57.479840 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:57.494824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:57.518557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dcd1fd3-1de3-4abd-9bc5-3ac8b7e1c0c7 req-c59df43c-37a9-478c-8a9c-4d8ebea7f818 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:57.522587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6dcd1fd3-1de3-4abd-9bc5-3ac8b7e1c0c7 req-c59df43c-37a9-478c-8a9c-4d8ebea7f818 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.2075005 May 12 15:27:57.530703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 5ca267b9-8aa5-4388-b459-c37844d97daf completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:27:57.544488 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 5ca267b9-8aa5-4388-b459-c37844d97daf triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:27:57.544488 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:57.617738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'Port': ['ID=cfe0c0ef-42e0-45f7-beb9-49babc2e71c9,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:57.671745 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6dcd1fd3-1de3-4abd-9bc5-3ac8b7e1c0c7 req-b96abf1a-1505-49be-99be-13eb254748a0 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1417718 May 12 15:27:57.747922 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:57.780013 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:57.781959 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3842edbe-a383-43fd-9d6d-4aabab619d65 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 3.1884871 May 12 15:27:57.797560 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:57.838587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 5ca267b9-8aa5-4388-b459-c37844d97daf, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5ca267b9-8aa5-4388-b459-c37844d97daf,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:27:57.848407 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:57.999585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=5ca267b9-8aa5-4388-b459-c37844d97daf,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:27:58.084590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b387d366-3692-4530-b149-31f4d7b63026 req-322aa6c4-785f-43bc-a198-d203cb65b889 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:27:58.160140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b387d366-3692-4530-b149-31f4d7b63026 req-322aa6c4-785f-43bc-a198-d203cb65b889 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:27:58.161785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-322aa6c4-785f-43bc-a198-d203cb65b889 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--160078060&fields=id&tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b HTTP/1.1" status: 200 len: 267 time: 0.1368155 May 12 15:27:58.516042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01b6a244-cd5a-4302-a2da-ee7913aacfcb req-3e62d78b-02d5-4d1b-90b8-3dae8eb091da tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:58.517911 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01b6a244-cd5a-4302-a2da-ee7913aacfcb req-3e62d78b-02d5-4d1b-90b8-3dae8eb091da tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.4137115 May 12 15:27:58.527767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b387d366-3692-4530-b149-31f4d7b63026 req-7d16217d-c2e2-4ca4-b09c-f7ac0d3e4661 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:58.529481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-7d16217d-c2e2-4ca4-b09c-f7ac0d3e4661 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 815 time: 0.3583949 May 12 15:27:58.561187 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-3afd35a5-c456-4f4a-9b05-ce0e6152c107 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/quotas/c5f9faeb50de42b1a07298c25a4e4d6b HTTP/1.1" status: 200 len: 375 time: 0.0151386 May 12 15:27:58.640377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01b6a244-cd5a-4302-a2da-ee7913aacfcb req-5fbb2859-c632-4cb1-b7ac-29b7715a0561 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1097159 May 12 15:27:58.676889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b387d366-3692-4530-b149-31f4d7b63026 req-56a1c0db-6860-4ffd-8517-d5ab586f32b1 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:27:58.732595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b387d366-3692-4530-b149-31f4d7b63026 req-56a1c0db-6860-4ffd-8517-d5ab586f32b1 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:27:58.738205 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-56a1c0db-6860-4ffd-8517-d5ab586f32b1 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1659968 May 12 15:27:58.948684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2ceacf8-fae7-4f90-b7d9-aa63e5933501 req-17694ed4-41d0-49fc-b064-0239093b8e13 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.0598478 May 12 15:27:58.959178 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-96011f70-937c-49f5-8080-69587071b4df service neutron] 10.222.0.82 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2066565 May 12 15:27:59.119297 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-f188ecf8-4729-4253-a69b-15a7e54a1ca1 service neutron] 10.222.0.82 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1525483 May 12 15:27:59.265818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5ca267b9-8aa5-4388-b459-c37844d97daf up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:27:59.499111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d476e4a1-73c7-411a-8b72-6252cefc28db req-e5066f2a-837e-48ee-b368-fda6964676ad tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:27:59.505493 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d476e4a1-73c7-411a-8b72-6252cefc28db req-e5066f2a-837e-48ee-b368-fda6964676ad tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.2067089 May 12 15:27:59.512075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 5ca267b9-8aa5-4388-b459-c37844d97daf triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:27:59.512443 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:27:59.604861 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d476e4a1-73c7-411a-8b72-6252cefc28db req-c5c3ce0f-ba1d-4e52-90f0-df389b75f346 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0897188 May 12 15:27:59.782304 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-622519f6-d5d9-4c7f-869b-7b94002631e9 req-67f3bfec-e915-4b66-bcd6-5597aac30ed1 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 210 time: 0.1266794 May 12 15:28:00.182716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b6f9dba-ab75-41b2-963d-c1dd26684f12 req-4103c624-5bf4-465e-8be8-daa80117c175 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:00.184272 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b6f9dba-ab75-41b2-963d-c1dd26684f12 req-4103c624-5bf4-465e-8be8-daa80117c175 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2151477 May 12 15:28:00.201204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26350c91-208a-4a28-8529-720cf5fd2078 req-dc565c8d-3c24-477a-af68-c91bf3986695 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:00.202834 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-26350c91-208a-4a28-8529-720cf5fd2078 req-dc565c8d-3c24-477a-af68-c91bf3986695 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1712255 May 12 15:28:00.469764 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-26350c91-208a-4a28-8529-720cf5fd2078 req-e438f599-f98b-461f-b560-bc9237f32b29 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0672252 May 12 15:28:00.475380 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b6f9dba-ab75-41b2-963d-c1dd26684f12 req-97445640-015f-4978-bb62-c41eacdb95c9 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2715530 May 12 15:28:00.922764 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-256efec9-b282-451f-b592-408ea25f9343 req-8fc52d2c-869f-49db-97cf-c0a4eaebe820 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.1607049 May 12 15:28:00.967066 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:28:01.051323 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426dfc62-be4b-482b-a53f-6bba4ab0b4a2 req-c22c4ed0-fb38-4f4c-9a7e-fecab82167cc tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:01.067577 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-426dfc62-be4b-482b-a53f-6bba4ab0b4a2 req-c22c4ed0-fb38-4f4c-9a7e-fecab82167cc tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.2664688 May 12 15:28:01.162328 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-426dfc62-be4b-482b-a53f-6bba4ab0b4a2 req-ea3f7693-b891-4850-a582-3180501f9987 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0938718 May 12 15:28:01.232928 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8bba43d0-4126-4857-b915-04f6e85b2b92 req-629f2d13-c0c9-48f9-b48b-4952ff81d733 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 210 time: 0.0684829 May 12 15:28:01.450359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b387d366-3692-4530-b149-31f4d7b63026 req-c0ea9b57-6da0-40ca-a05d-6daa476f86bc tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:01.452081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b387d366-3692-4530-b149-31f4d7b63026 req-c0ea9b57-6da0-40ca-a05d-6daa476f86bc tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:28:01.487596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b387d366-3692-4530-b149-31f4d7b63026 req-c0ea9b57-6da0-40ca-a05d-6daa476f86bc tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:28:01.488827 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-c0ea9b57-6da0-40ca-a05d-6daa476f86bc tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.84 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 815 time: 0.2612936 May 12 15:28:01.556939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b387d366-3692-4530-b149-31f4d7b63026 req-52cf1a4f-774a-42fb-9c58-4d2e62fdcdd0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:28:01.598714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b387d366-3692-4530-b149-31f4d7b63026 req-52cf1a4f-774a-42fb-9c58-4d2e62fdcdd0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:28:01.600395 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-52cf1a4f-774a-42fb-9c58-4d2e62fdcdd0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b HTTP/1.1" status: 200 len: 379 time: 0.0954943 May 12 15:28:01.611017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'port': {'device_id': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'admin_state_up': True, 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'security_groups': ['a38d2c29-bf89-4d38-a714-9037ce4b4638']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:28:01.885360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:01.902931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:01.939625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464fec3d-24bd-428b-94de-a3831c63987e req-b82f13e0-c38e-455b-99b2-631c563fa495 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:01.949166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4747645f-0d29-44c9-9410-87ae6190df3c req-3bdd4883-5f64-472b-a8c3-378a6909ded0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:01.950105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-4747645f-0d29-44c9-9410-87ae6190df3c req-3bdd4883-5f64-472b-a8c3-378a6909ded0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Synchronizing usage tracker for tenant:f4660a6351274a7796c2eb1e55a41ec9 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:28:01.958449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Made reservation on behalf of c5f9faeb50de42b1a07298c25a4e4d6b for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:28:01.959121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-464fec3d-24bd-428b-94de-a3831c63987e req-b82f13e0-c38e-455b-99b2-631c563fa495 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.1536856 May 12 15:28:01.966708 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:02.047784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-4747645f-0d29-44c9-9410-87ae6190df3c req-3bdd4883-5f64-472b-a8c3-378a6909ded0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Unset dirty status for tenant:f4660a6351274a7796c2eb1e55a41ec9 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:28:02.049073 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4747645f-0d29-44c9-9410-87ae6190df3c req-3bdd4883-5f64-472b-a8c3-378a6909ded0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.76 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.3497534 May 12 15:28:02.119793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-464fec3d-24bd-428b-94de-a3831c63987e req-323e02e3-c92f-4f29-bb10-8a508d2cd445 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1597166 May 12 15:28:02.148501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dede0d2f-ca92-4d9b-bab8-15560c470259 req-6c8ed3aa-07f0-488b-ad42-deb9adf9ddfb tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:02.174200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-4747645f-0d29-44c9-9410-87ae6190df3c req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Deleting port d4f9886d-fb34-4a11-9462-3343e8a12db0 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:02.174659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4747645f-0d29-44c9-9410-87ae6190df3c req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:02.175186 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dede0d2f-ca92-4d9b-bab8-15560c470259 req-6c8ed3aa-07f0-488b-ad42-deb9adf9ddfb tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.4376466 May 12 15:28:02.278710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dede0d2f-ca92-4d9b-bab8-15560c470259 req-0d8b586e-7847-4ad7-938a-29a17f2bdbc6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0971594 May 12 15:28:02.384325 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:02.425849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Allocated IP 172.20.0.4 (dbecac63-cd00-4ee6-bec1-19abe557d6e1/7cf2ffc4-f41f-40e3-90d1-77e214ee94e3/c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:28:02.433179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47af34d5-8415-4548-a738-674de0066fd6 req-d2d4d295-4570-4a51-97ba-f543a7fdc73f tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.0789595 May 12 15:28:02.747306 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dde68569-f6e6-46c9-b462-e86d54edfb5c req-ad11eff7-bb5f-4813-8aa6-a5b47cfc50ea tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 210 time: 0.0720608 May 12 15:28:02.784109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174f9da5-fc9f-43a8-8645-c22a205d9df0 req-dd0ae324-2373-4de0-93d7-1731365cfe63 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:02.793368 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174f9da5-fc9f-43a8-8645-c22a205d9df0 req-dd0ae324-2373-4de0-93d7-1731365cfe63 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.2705288 May 12 15:28:02.875011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-174f9da5-fc9f-43a8-8645-c22a205d9df0 req-90bcc306-e564-47bc-a565-6e85e45951a3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0800519 May 12 15:28:03.019319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-4747645f-0d29-44c9-9410-87ae6190df3c req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] For port d4f9886d-fb34-4a11-9462-3343e8a12db0, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d4f9886d-fb34-4a11-9462-3343e8a12db0,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:03.019319 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4747645f-0d29-44c9-9410-87ae6190df3c req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:03.602511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:03.626306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2be299d-f836-4ac6-9545-9fc2b4c04a77 req-58e21d5d-6645-46ab-b255-6965a9f1f44c tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:03.638992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2be299d-f836-4ac6-9545-9fc2b4c04a77 req-58e21d5d-6645-46ab-b255-6965a9f1f44c tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 946 time: 0.3422854 May 12 15:28:03.702620 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Transition to ACTIVE for port object c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:28:03.773725 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4747645f-0d29-44c9-9410-87ae6190df3c req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:03.774725 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4747645f-0d29-44c9-9410-87ae6190df3c req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:03.775409 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-4747645f-0d29-44c9-9410-87ae6190df3c req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Floating IP 1e912ac0-4533-40c7-8964-36d5a7e48d0d disassociated. External IP: 172.25.8.224, port: d4f9886d-fb34-4a11-9462-3343e8a12db0. May 12 15:28:03.776103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-4747645f-0d29-44c9-9410-87ae6190df3c req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Calling delete_port for d4f9886d-fb34-4a11-9462-3343e8a12db0 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:28:03.785275 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2be299d-f836-4ac6-9545-9fc2b4c04a77 req-133b3bce-0d60-4edf-92ae-faef7c4721fe tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=8d7b8995-77e9-4755-a140-038fd74473e0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1431682 May 12 15:28:03.885569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:03.920355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-922d3c20-1ba2-4e69-91df-955258350dd2 req-d534dac4-d919-451b-bd5a-be8bdf2c0a93 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:03.938137 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-922d3c20-1ba2-4e69-91df-955258350dd2 req-d534dac4-d919-451b-bd5a-be8bdf2c0a93 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2173605 May 12 15:28:04.028044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d4f9886d-fb34-4a11-9462-3343e8a12db0 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:28:04.080399 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-922d3c20-1ba2-4e69-91df-955258350dd2 req-66bb3c41-b3c3-4865-98d8-8cadfae25793 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1378388 May 12 15:28:04.165565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Network dbecac63-cd00-4ee6-bec1-19abe557d6e1 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:28:04.176162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:28:04.182255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:28:04.273071 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8b4bed94-70d8-4856-a334-b13812b488a8 req-444ebc1b-f80f-47d2-a44e-268058eb3bd3 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.1310303 May 12 15:28:04.327916 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:04.455519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'Port': ['ID=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:04.516650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:04.517543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:04.566320 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4747645f-0d29-44c9-9410-87ae6190df3c req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:04.629313 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-af50d333-d998-4ba6-9c41-16432b3231d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.0229313 May 12 15:28:04.653024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event deleted for resources: {'Port': ['ID=d4f9886d-fb34-4a11-9462-3343e8a12db0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:04.662174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Request body: {'port': {'device_id': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:28:04.920502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1d9486fe-45e9-46e0-8990-4f9b92f2038e None None] Provisioning for port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:28:04.926848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1d9486fe-45e9-46e0-8990-4f9b92f2038e None None] Provisioning complete for port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:28:04.927855 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1d9486fe-45e9-46e0-8990-4f9b92f2038e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:04.979258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbce8003-d0bf-4c28-a043-9cd307d6bf3c req-3cb29787-63af-4978-a646-05c699d5f281 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:04.988317 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dbce8003-d0bf-4c28-a043-9cd307d6bf3c req-3cb29787-63af-4978-a646-05c699d5f281 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 931 time: 0.4358413 May 12 15:28:05.004434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1d9486fe-45e9-46e0-8990-4f9b92f2038e None None] Port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:28:05.028262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d755a140-cc04-4955-bb20-cfeacb164655 req-4f44d990-b962-4207-aaa9-5e1fb74dfc08 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:05.035653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d755a140-cc04-4955-bb20-cfeacb164655 req-4f44d990-b962-4207-aaa9-5e1fb74dfc08 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.2994239 May 12 15:28:05.089240 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:05.114001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d755a140-cc04-4955-bb20-cfeacb164655 req-05ecbeaf-9129-4af7-abee-9049d0ac531a tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0769994 May 12 15:28:05.197832 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dbce8003-d0bf-4c28-a043-9cd307d6bf3c req-18ec54ab-f83e-4554-9ea9-8edab6b6d9d7 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=a38d2c29-bf89-4d38-a714-9037ce4b4638&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2084260 May 12 15:28:05.388618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4747645f-0d29-44c9-9410-87ae6190df3c req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:28:05.388618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43636) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:05.554310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-098fd1c0-b290-497b-8bb3-996a7f536c81 req-b26a8267-78ae-49b2-bf5f-d42b98cca15a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 210 time: 0.1773281 May 12 15:28:05.853582 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f28abf29-122d-4ad5-a49f-bca25918b452 req-25f387e5-77cd-4415-a929-91aed5c88ca2 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.0882998 May 12 15:28:05.897117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790b9c09-64eb-40ef-bcda-3219d8ea97b0 req-c57f9978-952c-443b-b701-d3e506c059fb tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:05.899509 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-790b9c09-64eb-40ef-bcda-3219d8ea97b0 req-c57f9978-952c-443b-b701-d3e506c059fb tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2460747 May 12 15:28:05.963914 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-790b9c09-64eb-40ef-bcda-3219d8ea97b0 req-3b8b9fec-8d9e-41f3-8666-1c1cab38efb8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0566885 May 12 15:28:06.133571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4747645f-0d29-44c9-9410-87ae6190df3c req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:28:06.147916 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a520c34f-6552-4702-9d2e-cafb20c7154a None None] Sync routers for ids ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:28:06.192596 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a520c34f-6552-4702-9d2e-cafb20c7154a None None] Routers {'0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:28:06.193652 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a520c34f-6552-4702-9d2e-cafb20c7154a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:27:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:06.311532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-4747645f-0d29-44c9-9410-87ae6190df3c req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] No DVR routers for this DVR port d4f9886d-fb34-4a11-9462-3343e8a12db0 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:28:06.328470 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4747645f-0d29-44c9-9410-87ae6190df3c req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:06.328470 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4747645f-0d29-44c9-9410-87ae6190df3c req-48c3d1d6-4de3-4e21-a476-4a62545f6bee tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.76 "DELETE /v2.0/ports/d4f9886d-fb34-4a11-9462-3343e8a12db0 HTTP/1.1" status: 204 len: 173 time: 4.2562416 May 12 15:28:06.353683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3d46f981-e448-45e2-8221-e0c06f862ad5', 'name': 'network-vif-deleted', 'tag': 'd4f9886d-fb34-4a11-9462-3343e8a12db0'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:06.782849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12dfef53-616d-4d5d-a8cd-b1265b2fb88c req-59c78679-45dc-4551-bfdd-182f29311c62 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:06.792006 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12dfef53-616d-4d5d-a8cd-b1265b2fb88c req-59c78679-45dc-4551-bfdd-182f29311c62 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.4010544 May 12 15:28:06.915429 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-a520c34f-6552-4702-9d2e-cafb20c7154a None None] Set router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:28:06.946503 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12dfef53-616d-4d5d-a8cd-b1265b2fb88c req-2e4dfb7d-4db2-4897-b964-a0e318edc938 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1454725 May 12 15:28:07.114465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3711d115-6dfd-42ca-9fe2-83eff1b26e7a req-d0e35396-66bf-480c-bc56-e77d0370e845 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:07.136163 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3711d115-6dfd-42ca-9fe2-83eff1b26e7a req-d0e35396-66bf-480c-bc56-e77d0370e845 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 931 time: 0.5432575 May 12 15:28:07.221085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31edc038-b061-47ae-b69c-464e21fd2d2c req-f65ccd66-f9e4-4051-b318-bb484584c0f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:07.222855 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31edc038-b061-47ae-b69c-464e21fd2d2c req-f65ccd66-f9e4-4051-b318-bb484584c0f8 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 1095 time: 0.3829663 May 12 15:28:07.253831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:28:07.285063 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3711d115-6dfd-42ca-9fe2-83eff1b26e7a req-1d0544ad-8365-4e9d-890d-0f602ac31059 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=a38d2c29-bf89-4d38-a714-9037ce4b4638&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1479423 May 12 15:28:07.289541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:07.430105 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ec34df8a-29bf-4819-a7b7-afc27360de80'] response: {'server_uuid': '3d46f981-e448-45e2-8221-e0c06f862ad5', 'name': 'network-vif-deleted', 'tag': 'd4f9886d-fb34-4a11-9462-3343e8a12db0', 'status': 'completed', 'code': 200} May 12 15:28:07.441292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Transition to ACTIVE for port object c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:28:07.489024 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:07.696301 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a520c34f-6552-4702-9d2e-cafb20c7154a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:45Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:07.709147 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a520c34f-6552-4702-9d2e-cafb20c7154a None None] Checking router: 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:28:07.725072 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a520c34f-6552-4702-9d2e-cafb20c7154a None None] Routers {'0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:28:07.727224 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a520c34f-6552-4702-9d2e-cafb20c7154a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:27:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:07.854966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b327a35-0815-4b39-b7b1-b1d3e76fb2ea req-0a8d2629-f067-4251-993e-b16d5aef38eb tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=3d46f981-e448-45e2-8221-e0c06f862ad5 HTTP/1.1" status: 200 len: 210 time: 0.0564091 May 12 15:28:07.894489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Pushing event updated for resources: {'Port': ['ID=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:08.017466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5733886-6e1b-4ed8-8043-7d89d433c0bb req-4c5e539f-d54c-4fdb-abb3-3a6bce5806ec tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:08.034508 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5733886-6e1b-4ed8-8043-7d89d433c0bb req-4c5e539f-d54c-4fdb-abb3-3a6bce5806ec tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.6654837 May 12 15:28:08.213640 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5733886-6e1b-4ed8-8043-7d89d433c0bb req-3a8e353c-5002-475d-a566-8752b2144a2c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1721823 May 12 15:28:08.270312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc4b2850-b2f9-4fdf-b432-be59c8a6df49 req-4992c239-a95d-4ac3-ab0b-0077a722273f tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.1342919 May 12 15:28:08.276415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31edc038-b061-47ae-b69c-464e21fd2d2c req-e6070149-450c-44da-bc8a-0fa8984f982c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:08.277693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Attempting to bind port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:28:08.278205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Attempting to bind port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:28:08.278371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Attempting to bind port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb on network dbecac63-cd00-4ee6-bec1-19abe557d6e1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:28:08.278844 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-a520c34f-6552-4702-9d2e-cafb20c7154a None None] Set router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:28:08.283214 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31edc038-b061-47ae-b69c-464e21fd2d2c req-e6070149-450c-44da-bc8a-0fa8984f982c service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 1.0158994 May 12 15:28:08.287619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb on network dbecac63-cd00-4ee6-bec1-19abe557d6e1 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:28:08.287914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Attempting to bind port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb on network dbecac63-cd00-4ee6-bec1-19abe557d6e1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:28:08.308114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 27, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:28:08.308460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Checking segment: {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:28:08.308835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Bound using segment: {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:28:08.309272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Bound port: c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:28:08.309688 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:08.455325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a655541-3da6-436f-aa7f-75005d51ede4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:08.757734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] For port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:28:08.785016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] For port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:28:08.824620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31edc038-b061-47ae-b69c-464e21fd2d2c req-4b09fb67-79f5-4aa0-9239-3f8e427022ba service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26 HTTP/1.1" status: 200 len: 999 time: 0.5264764 May 12 15:28:08.915353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31edc038-b061-47ae-b69c-464e21fd2d2c req-9464f8f5-7310-46be-a5b0-a0a8108783f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:08.918033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31edc038-b061-47ae-b69c-464e21fd2d2c req-9464f8f5-7310-46be-a5b0-a0a8108783f0 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.0859950 May 12 15:28:08.967221 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:09.025304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e4787d7-fa77-4627-a6af-68d680ba72c0 req-9e67d33e-648f-4683-a42e-0f3a747cc1b3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:09.033639 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e4787d7-fa77-4627-a6af-68d680ba72c0 req-9e67d33e-648f-4683-a42e-0f3a747cc1b3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.4319162 May 12 15:28:09.089039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:09.089039 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:09.094203 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] 10.222.0.84 "PUT /v2.0/ports/c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb HTTP/1.1" status: 200 len: 1091 time: 4.4381464 May 12 15:28:09.105335 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a520c34f-6552-4702-9d2e-cafb20c7154a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:45Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:09.113201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-901a44bc-ebed-4c2a-9a43-6043d6ccc2e4 req-c47a142e-3858-4b13-b8d5-cd10a5e32c85 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:09.119717 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a520c34f-6552-4702-9d2e-cafb20c7154a None None] The sync data for ids ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'] in n-d-841483-1 is: [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:45Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:28:09.127402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-901a44bc-ebed-4c2a-9a43-6043d6ccc2e4 req-c47a142e-3858-4b13-b8d5-cd10a5e32c85 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 943 time: 0.3945923 May 12 15:28:09.153883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ecd166c-ed37-42c0-84d0-7d27ae77b35c service neutron] Pushing event updated for resources: {'Port': ['ID=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:09.165316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31edc038-b061-47ae-b69c-464e21fd2d2c req-ca41ec58-7bc3-4099-8815-6154ddda94c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:09.171301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31edc038-b061-47ae-b69c-464e21fd2d2c req-ca41ec58-7bc3-4099-8815-6154ddda94c9 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2444618 May 12 15:28:09.484537 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e4787d7-fa77-4627-a6af-68d680ba72c0 req-bc39f774-7abb-4122-8534-f2449847ce14 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4500265 May 12 15:28:09.489072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31edc038-b061-47ae-b69c-464e21fd2d2c req-21e6df4c-228a-4af2-87ec-c30bb6200d77 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2803965 May 12 15:28:09.494686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'tag': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:09.601228 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-707525d5-0719-4a6f-9ebc-f8e8f6f31b13 None None] New status for floating IP 1e912ac0-4533-40c7-8964-36d5a7e48d0d: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:28:09.738771 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9a655541-3da6-436f-aa7f-75005d51ede4 admin admin] Deleting port 77d485e0-c0f7-452a-ba64-2ff75661cddd {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:09.739688 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a655541-3da6-436f-aa7f-75005d51ede4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:09.799782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b387d366-3692-4530-b149-31f4d7b63026 req-6ad6b249-c601-4a17-8b58-a7b8dbebaae6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:09.801794 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-6ad6b249-c601-4a17-8b58-a7b8dbebaae6 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 1094 time: 0.6366062 May 12 15:28:09.806094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-901a44bc-ebed-4c2a-9a43-6043d6ccc2e4 req-929569e5-850c-449d-8cbc-1990f3df6a75 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=a38d2c29-bf89-4d38-a714-9037ce4b4638&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.6779194 May 12 15:28:09.982086 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-7351a93e-a117-417e-a27a-17f2f440a66f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb HTTP/1.1" status: 200 len: 217 time: 0.1562834 May 12 15:28:10.137241 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-943efda8-ffda-4558-a8c3-efd25e03eb09 req-af515fe2-e37f-4936-8131-61c45a57fa38 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.1488593 May 12 15:28:10.216623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b387d366-3692-4530-b149-31f4d7b63026 req-2971d987-8b96-4cf1-87b5-7c57870e5e0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:10.218484 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-2971d987-8b96-4cf1-87b5-7c57870e5e0d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 HTTP/1.1" status: 200 len: 854 time: 0.2368011 May 12 15:28:10.280161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32e36b16-70df-46b6-97bb-f84174103ccf req-b9debbb5-e44c-474e-8dd6-8c7f04504ac4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:10.290282 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32e36b16-70df-46b6-97bb-f84174103ccf req-b9debbb5-e44c-474e-8dd6-8c7f04504ac4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.4823539 May 12 15:28:10.295912 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2ed883bb-a8e9-4584-b78b-56b92dba0939'] response: {'name': 'network-changed', 'server_uuid': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'tag': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'status': 'completed', 'code': 200} May 12 15:28:10.339835 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31edc038-b061-47ae-b69c-464e21fd2d2c req-14ffd416-5deb-4de6-afb6-0df81c92d8ee service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8326027 May 12 15:28:10.342686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43726) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:10.364103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32e36b16-70df-46b6-97bb-f84174103ccf req-2ff6a5bc-7ccd-497e-a8a7-5612ffe33bc0 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0726876 May 12 15:28:10.379802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b387d366-3692-4530-b149-31f4d7b63026 req-29c8c0c8-155d-4a33-971d-239b1cf46eae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:10.382981 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-29c8c0c8-155d-4a33-971d-239b1cf46eae service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbecac63-cd00-4ee6-bec1-19abe557d6e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1551452 May 12 15:28:10.392528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-9a655541-3da6-436f-aa7f-75005d51ede4 admin admin] For port 77d485e0-c0f7-452a-ba64-2ff75661cddd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=77d485e0-c0f7-452a-ba64-2ff75661cddd,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:10.393133 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a655541-3da6-436f-aa7f-75005d51ede4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:10.441609 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-32a701a4-7b46-4621-8b87-b5bfd06ab035 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:10.481705 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-32a701a4-7b46-4621-8b87-b5bfd06ab035 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:10.580483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9a655541-3da6-436f-aa7f-75005d51ede4 admin admin] Calling delete_port for 77d485e0-c0f7-452a-ba64-2ff75661cddd owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:28:10.583560 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-32a701a4-7b46-4621-8b87-b5bfd06ab035 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:10.607844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32a701a4-7b46-4621-8b87-b5bfd06ab035 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d7b8995-77e9-4755-a140-038fd74473e0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:10.671618 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-32a701a4-7b46-4621-8b87-b5bfd06ab035 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:10.673505 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-32a701a4-7b46-4621-8b87-b5bfd06ab035 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "DELETE /v2.0/security-groups/8d7b8995-77e9-4755-a140-038fd74473e0 HTTP/1.1" status: 204 len: 168 time: 0.3294106 May 12 15:28:10.677346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43738) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:10.707500 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-371abfbd-21fe-4fa0-85fa-54c2ce4fd689 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] show failed (client error): The resource could not be found. May 12 15:28:10.709706 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-371abfbd-21fe-4fa0-85fa-54c2ce4fd689 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups/8d7b8995-77e9-4755-a140-038fd74473e0 HTTP/1.1" status: 404 len: 347 time: 0.0286632 May 12 15:28:10.713922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43742) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:10.822830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67613718-f71d-4b01-b146-0cd5cbf05cf1 req-038f031a-967c-47da-9dff-4b11ee918f2e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:10.835637 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67613718-f71d-4b01-b146-0cd5cbf05cf1 req-038f031a-967c-47da-9dff-4b11ee918f2e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.1594703 May 12 15:28:11.056774 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67613718-f71d-4b01-b146-0cd5cbf05cf1 req-2b56a950-0056-4002-ae1a-94c6d67505c3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2131166 May 12 15:28:11.128176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-926c2c5e-8bf8-4acc-8002-460b9d1a454f req-51a763b8-55f3-41ba-873f-cdc220a9b6c0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:11.138072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-926c2c5e-8bf8-4acc-8002-460b9d1a454f req-51a763b8-55f3-41ba-873f-cdc220a9b6c0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 943 time: 0.1945987 May 12 15:28:11.252258 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-926c2c5e-8bf8-4acc-8002-460b9d1a454f req-fbc262d3-0a3b-4303-8cb3-5aeb86ea554f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=a38d2c29-bf89-4d38-a714-9037ce4b4638&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1124718 May 12 15:28:11.567869 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f6236374-f9e6-44fe-abbd-c4c78cbc93eb req-d23aa3a6-dfba-4ff2-bf8f-11ac99230970 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.1614392 May 12 15:28:11.710702 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-12e8bca1-aeb7-4961-807b-b77b81d24028 service neutron] 10.222.0.84 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.3038349 May 12 15:28:11.713267 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4ce760de-fc15-4116-a96e-bc73a4d0749d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Deleting port ae4c16c8-09ae-4f89-aee7-857d7f243a74 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:11.713823 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ce760de-fc15-4116-a96e-bc73a4d0749d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:11.739946 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a655541-3da6-436f-aa7f-75005d51ede4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:11.954181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb814490-264b-4f3b-a4af-f35baf614da7 req-3ade75c6-4729-4f1e-a670-a033f03c26cb tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:11.963145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb814490-264b-4f3b-a4af-f35baf614da7 req-3ade75c6-4729-4f1e-a670-a033f03c26cb tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2313538 May 12 15:28:12.135611 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb814490-264b-4f3b-a4af-f35baf614da7 req-e99083d7-9969-490b-a58e-b048b19f57ac tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1637940 May 12 15:28:12.204770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a655541-3da6-436f-aa7f-75005d51ede4 admin admin] Pushing event deleted for resources: {'Port': ['ID=77d485e0-c0f7-452a-ba64-2ff75661cddd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:12.450443 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b387d366-3692-4530-b149-31f4d7b63026 req-498ac59e-158b-4a68-a4b9-5b14797815ae service neutron] 10.222.0.84 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6952491 May 12 15:28:12.683503 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4b9afd2f-c16b-4ed6-9a53-0aef8e6dbe43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:12.771438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c87ae03-ace9-4107-8b48-f2f4931119c6 req-6f2e305a-2f53-4395-a863-eacb8b922603 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:12.774210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c87ae03-ace9-4107-8b48-f2f4931119c6 req-6f2e305a-2f53-4395-a863-eacb8b922603 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1642220 May 12 15:28:12.814039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb8b00b-7955-4c6f-87c9-4c6e0ff72a9b req-b33c39ae-934f-4f8a-8684-a1ea23c143ec tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:12.815679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2eb8b00b-7955-4c6f-87c9-4c6e0ff72a9b req-b33c39ae-934f-4f8a-8684-a1ea23c143ec tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.4417870 May 12 15:28:12.853597 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c87ae03-ace9-4107-8b48-f2f4931119c6 req-01e9c609-0696-41b6-ad37-c8d29621e6aa tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0735774 May 12 15:28:12.969039 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a655541-3da6-436f-aa7f-75005d51ede4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:12.995069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2eb8b00b-7955-4c6f-87c9-4c6e0ff72a9b req-ce196187-20bf-4cb5-8bd7-4e1a952556d5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1687489 May 12 15:28:13.023479 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:13.155696 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ce760de-fc15-4116-a96e-bc73a4d0749d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:13.156827 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ce760de-fc15-4116-a96e-bc73a4d0749d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:13.176109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45937e87-9884-4cf7-a473-e474c712f36d req-6e4cf50b-a86a-426b-be3b-5a9577e5703c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:13.178036 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45937e87-9884-4cf7-a473-e474c712f36d req-6e4cf50b-a86a-426b-be3b-5a9577e5703c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 1094 time: 0.6166275 May 12 15:28:13.436241 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45cf5289-ba31-40d7-bcd4-692130f1d6ce req-7ec925d1-3a97-4479-a99b-fd87e4e53287 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.1407719 May 12 15:28:13.484672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4ce760de-fc15-4116-a96e-bc73a4d0749d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Calling delete_port for ae4c16c8-09ae-4f89-aee7-857d7f243a74 owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:28:13.499463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757022f2-64d0-4644-b69d-3e4e5332582c req-fc9e7edf-ef5f-4e70-bf62-62678fdfc30a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:13.515091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-757022f2-64d0-4644-b69d-3e4e5332582c req-fc9e7edf-ef5f-4e70-bf62-62678fdfc30a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 943 time: 0.3118613 May 12 15:28:13.651367 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-757022f2-64d0-4644-b69d-3e4e5332582c req-edd31389-8497-44ae-96f2-3e607608f320 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=a38d2c29-bf89-4d38-a714-9037ce4b4638&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1305523 May 12 15:28:13.808294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-881c14ff-d5b5-440f-9c37-2fb0935a45de req-44ce2f9f-1489-4d28-9fed-9a34fa27e032 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:13.816514 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-881c14ff-d5b5-440f-9c37-2fb0935a45de req-44ce2f9f-1489-4d28-9fed-9a34fa27e032 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2020316 May 12 15:28:13.946274 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-881c14ff-d5b5-440f-9c37-2fb0935a45de req-243cd3a6-2839-49d9-8e7f-6618ea5b6664 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1283231 May 12 15:28:14.180573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45937e87-9884-4cf7-a473-e474c712f36d req-34f00153-a310-4e63-803e-2b0a42eb2c20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:14.181746 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45937e87-9884-4cf7-a473-e474c712f36d req-34f00153-a310-4e63-803e-2b0a42eb2c20 service neutron] 10.222.0.84 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 916 time: 0.8076828 May 12 15:28:14.333576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9a655541-3da6-436f-aa7f-75005d51ede4 admin admin] Router 78d4ada5-c100-4849-8e75-44ba389f27d8 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:28:14.356041 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45937e87-9884-4cf7-a473-e474c712f36d req-4e0ae68c-950f-4a48-98e6-7be529b68929 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb HTTP/1.1" status: 200 len: 217 time: 0.1165011 May 12 15:28:14.391202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff2a5c1f-8612-4436-af53-eb7124b5a23c req-e959bcdd-24e3-475b-88bb-abb04e79a5d8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:14.392725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff2a5c1f-8612-4436-af53-eb7124b5a23c req-e959bcdd-24e3-475b-88bb-abb04e79a5d8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.1675267 May 12 15:28:14.400873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4727061a-c3c3-4fb6-a573-55043678f269 req-fc3f1100-ae6e-4306-9cac-3b4a83841745 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:14.406419 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4727061a-c3c3-4fb6-a573-55043678f269 req-fc3f1100-ae6e-4306-9cac-3b4a83841745 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2562897 May 12 15:28:14.488248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45937e87-9884-4cf7-a473-e474c712f36d req-eee4d479-dd8e-47cc-acdb-446fa0d60262 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:14.490206 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45937e87-9884-4cf7-a473-e474c712f36d req-eee4d479-dd8e-47cc-acdb-446fa0d60262 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 HTTP/1.1" status: 200 len: 854 time: 0.1249323 May 12 15:28:14.496409 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4727061a-c3c3-4fb6-a573-55043678f269 req-5c85d6d5-6dc6-4db6-9824-ece10636b4f8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0605214 May 12 15:28:14.549942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff2a5c1f-8612-4436-af53-eb7124b5a23c req-119a2d8d-596d-4ede-a238-2021a206e81d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1417873 May 12 15:28:14.662410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ce760de-fc15-4116-a96e-bc73a4d0749d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:14.798586 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-579867b3-0b62-4560-b485-49a3bf22ee3c req-c021a3a3-8586-45d5-9a79-52111d9a644e tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.1511562 May 12 15:28:14.830225 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9f67fd56-e811-4394-b3c9-defc013eba7b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:14.880206 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ce760de-fc15-4116-a96e-bc73a4d0749d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:14.889363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ce760de-fc15-4116-a96e-bc73a4d0749d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event deleted for resources: {'Port': ['ID=ae4c16c8-09ae-4f89-aee7-857d7f243a74,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:14.923785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-642e5078-73a0-4b40-a35a-cd2cf5e2a5c6 req-7cc91ca0-1f7c-4537-96ca-5f6f6811383e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:14.925345 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-642e5078-73a0-4b40-a35a-cd2cf5e2a5c6 req-7cc91ca0-1f7c-4537-96ca-5f6f6811383e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1818779 May 12 15:28:14.946706 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ce760de-fc15-4116-a96e-bc73a4d0749d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:14.950903 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ce760de-fc15-4116-a96e-bc73a4d0749d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "DELETE /v2.0/floatingips/1e912ac0-4533-40c7-8964-36d5a7e48d0d HTTP/1.1" status: 204 len: 168 time: 4.2317193 May 12 15:28:14.950903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a655541-3da6-436f-aa7f-75005d51ede4 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:28:14.956279 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9a655541-3da6-436f-aa7f-75005d51ede4 admin admin] 10.222.0.82 "PUT /v2.0/routers/78d4ada5-c100-4849-8e75-44ba389f27d8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 9.5657883 May 12 15:28:14.965153 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b65c155-cd26-444d-ba6f-818bd0c9aea1 None None] Sync routers for ids ['78d4ada5-c100-4849-8e75-44ba389f27d8'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:28:14.966354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43824) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:14.975130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45937e87-9884-4cf7-a473-e474c712f36d req-c8e60f8b-43b3-4624-8822-b47449c648ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:14.977893 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b65c155-cd26-444d-ba6f-818bd0c9aea1 None None] Routers {'78d4ada5-c100-4849-8e75-44ba389f27d8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:28:14.978629 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8b65c155-cd26-444d-ba6f-818bd0c9aea1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:28:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['78d4ada5-c100-4849-8e75-44ba389f27d8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:14.981230 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45937e87-9884-4cf7-a473-e474c712f36d req-c8e60f8b-43b3-4624-8822-b47449c648ab service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbecac63-cd00-4ee6-bec1-19abe557d6e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4810278 May 12 15:28:15.102695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:28:15.200104 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45937e87-9884-4cf7-a473-e474c712f36d req-ac779fb9-153f-40ca-ab6c-68ede179d884 service neutron] 10.222.0.84 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1968017 May 12 15:28:15.285684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-642e5078-73a0-4b40-a35a-cd2cf5e2a5c6 req-835d7a11-89bc-4e86-9324-05181529b87a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3524888 May 12 15:28:15.320748 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:15.337302 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'port_id': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'mac_address': 'fa:16:3e:b0:1d:01', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 598, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:28:15.442967 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:15.456417 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45937e87-9884-4cf7-a473-e474c712f36d req-03b25cea-90c8-431b-9ebc-931fddd062be service neutron] 10.222.0.84 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2554104 May 12 15:28:15.485236 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-8b65c155-cd26-444d-ba6f-818bd0c9aea1 None None] Set router 78d4ada5-c100-4849-8e75-44ba389f27d8 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:28:15.502460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43838) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:15.504932 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:28:15.513758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1177362080', 'description': 'tempest-description--1599226378'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:28:15.527071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:15.533131 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:15.540673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:15.553044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Usage tracker for resource:security_group and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:15.580955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:15.629647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559b4146-ca67-4ffc-8b3e-76443f218ce8 req-f3f55716-b27e-4b73-971c-dbc48a50ab52 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:15.647644 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-559b4146-ca67-4ffc-8b3e-76443f218ce8 req-f3f55716-b27e-4b73-971c-dbc48a50ab52 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 943 time: 0.5002930 May 12 15:28:15.650183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:15.669365 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:15.681847 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:15.719027 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:15.740337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:15.759489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Usage tracker for resource:security_group_rule and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:15.764836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:15.778038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:15.896131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:28:15.959325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:15.969692 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.002675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-559b4146-ca67-4ffc-8b3e-76443f218ce8 req-ce0f3939-4ab2-41e9-9e08-3c96df22ca5a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=a38d2c29-bf89-4d38-a714-9037ce4b4638&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3520236 May 12 15:28:16.009452 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.035155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] Deleting port 201e7ec4-04fd-4014-bf97-75995d8a73c1 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:16.035921 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.112657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fcfaf505-a043-4f21-9574-984ab7e90238,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:16.136188 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.144354 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8d595dcf-3b0f-4640-b41d-80dad29a1739 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1782 time: 0.6401308 May 12 15:28:16.148719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43858) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:16.164670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-050c1175-7287-44d2-99d6-ad734d3ca30a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Request body: {'security_group_rule': {'security_group_id': 'fcfaf505-a043-4f21-9574-984ab7e90238', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:28:16.167402 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.193592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-050c1175-7287-44d2-99d6-ad734d3ca30a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:16.206389 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-050c1175-7287-44d2-99d6-ad734d3ca30a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Usage tracker for resource:security_group_rule and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:16.213477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-050c1175-7287-44d2-99d6-ad734d3ca30a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:16.229499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-050c1175-7287-44d2-99d6-ad734d3ca30a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:16.266807 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-050c1175-7287-44d2-99d6-ad734d3ca30a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.327711 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8b65c155-cd26-444d-ba6f-818bd0c9aea1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85'}], 'enable_snat': True}, 'gw_port_id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:28:11Z', 'revision_number': 5, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port': {'id': '201e7ec4-04fd-4014-bf97-75995d8a73c1', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:82:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1463, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:20:16Z', 'updated_at': '2022-05-12T15:20:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:16.333550 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b65c155-cd26-444d-ba6f-818bd0c9aea1 None None] Checking router: 78d4ada5-c100-4849-8e75-44ba389f27d8 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:28:16.369935 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.388347 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b65c155-cd26-444d-ba6f-818bd0c9aea1 None None] Routers {'78d4ada5-c100-4849-8e75-44ba389f27d8'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:28:16.388967 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8b65c155-cd26-444d-ba6f-818bd0c9aea1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:28:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['78d4ada5-c100-4849-8e75-44ba389f27d8'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:16.437645 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-050c1175-7287-44d2-99d6-ad734d3ca30a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.448494 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-050c1175-7287-44d2-99d6-ad734d3ca30a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.458973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] For port 201e7ec4-04fd-4014-bf97-75995d8a73c1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=201e7ec4-04fd-4014-bf97-75995d8a73c1,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:16.459525 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.570230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-050c1175-7287-44d2-99d6-ad734d3ca30a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e45489ec-12fe-4ad2-adb7-a1c6305aba50,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:16.580034 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-050c1175-7287-44d2-99d6-ad734d3ca30a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.581658 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-050c1175-7287-44d2-99d6-ad734d3ca30a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4311938 May 12 15:28:16.584308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43868) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:16.591338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5389fec1-59af-4f9c-8061-01dee7e639fb tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Request body: {'security_group_rule': {'security_group_id': 'fcfaf505-a043-4f21-9574-984ab7e90238', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:28:16.605308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5389fec1-59af-4f9c-8061-01dee7e639fb tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:16.611833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5389fec1-59af-4f9c-8061-01dee7e639fb tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Usage tracker for resource:security_group_rule and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:16.622333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5389fec1-59af-4f9c-8061-01dee7e639fb tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:16.637841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5389fec1-59af-4f9c-8061-01dee7e639fb tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:16.676078 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5389fec1-59af-4f9c-8061-01dee7e639fb tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.787183 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5389fec1-59af-4f9c-8061-01dee7e639fb tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.807832 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5389fec1-59af-4f9c-8061-01dee7e639fb tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.877323 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-8b65c155-cd26-444d-ba6f-818bd0c9aea1 None None] Set router 78d4ada5-c100-4849-8e75-44ba389f27d8 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:28:16.893739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5389fec1-59af-4f9c-8061-01dee7e639fb tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d5184caf-476c-4394-af65-6e3d90c7b820,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:16.918749 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5389fec1-59af-4f9c-8061-01dee7e639fb tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:16.920622 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5389fec1-59af-4f9c-8061-01dee7e639fb tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3333371 May 12 15:28:16.923579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43876) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:16.949362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:28:16.958880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:16.963551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Usage tracker for resource:floatingip and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:16.967305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:16.981242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:16.981427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] Calling delete_port for 201e7ec4-04fd-4014-bf97-75995d8a73c1 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:28:17.018363 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:17.035185 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8b65c155-cd26-444d-ba6f-818bd0c9aea1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:28:16Z', 'revision_number': 6, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:17.039796 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b65c155-cd26-444d-ba6f-818bd0c9aea1 None None] The sync data for ids ['78d4ada5-c100-4849-8e75-44ba389f27d8'] in n-d-841483-1 is: [{'id': '78d4ada5-c100-4849-8e75-44ba389f27d8', 'name': 'tempest-AttachVolumeShelveTestJSON-1065430717-router', 'tenant_id': '40852c97262142aeb6d62097955af83f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:20:13Z', 'updated_at': '2022-05-12T15:28:16Z', 'revision_number': 6, 'project_id': '40852c97262142aeb6d62097955af83f', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:28:17.045448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed0196d7-1e9f-4690-9157-3acd1380fc35 req-ea46a81f-90af-4cb8-9b49-6278bd170825 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.5269129 May 12 15:28:17.313068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b026aa16-eab2-4fd3-8c94-2b6f4d054e73 req-44fe1155-8a59-4a7d-bb02-c154048561c0 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:17.318743 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b026aa16-eab2-4fd3-8c94-2b6f4d054e73 req-44fe1155-8a59-4a7d-bb02-c154048561c0 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.7428153 May 12 15:28:17.351465 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:17.453238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 77d485e0-c0f7-452a-ba64-2ff75661cddd no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:28:17.526763 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b026aa16-eab2-4fd3-8c94-2b6f4d054e73 req-428117e0-a1a0-4951-8522-930c6ae030b9 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2067213 May 12 15:28:17.562367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 77d485e0-c0f7-452a-ba64-2ff75661cddd {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:28:17.564089 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 77d485e0-c0f7-452a-ba64-2ff75661cddd not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:28:17.600119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7f49d4-0b81-49bf-b231-b5bcc335920c req-2b004ce3-23fe-43bd-8369-95588122ab79 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:17.601780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d7f49d4-0b81-49bf-b231-b5bcc335920c req-2b004ce3-23fe-43bd-8369-95588122ab79 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.3386652 May 12 15:28:17.687534 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:17.756432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d7f49d4-0b81-49bf-b231-b5bcc335920c req-06be9d7f-53a3-4f1f-b5ba-690468c8df39 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1392298 May 12 15:28:17.782874 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:17.786927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Allocated IP 172.25.8.55 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/7d5cbb37-383e-49c5-8545-84e6ee038c9e) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:28:17.955440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] Pushing event deleted for resources: {'Port': ['ID=201e7ec4-04fd-4014-bf97-75995d8a73c1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:18.150564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:18.425509 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:18.486882 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:18.496124 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:18.514487 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-65dc0a22-2a83-436a-818f-e456754951b0 req-827d0de3-cff0-4693-a4c7-ad811cb94fc9 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.0669513 May 12 15:28:18.530127 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:18.544595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f26adb-7078-40df-b2bc-22130a89d835 req-dcfb889d-a3ee-4238-932b-0d878d69ce7c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:18.566902 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6f26adb-7078-40df-b2bc-22130a89d835 req-dcfb889d-a3ee-4238-932b-0d878d69ce7c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 944 time: 0.7751048 May 12 15:28:18.612155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-604e840a-cfe8-479e-be2c-b31210e784d5 req-3f94c472-df5b-411b-bd47-ba4d028d873e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:18.614102 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-604e840a-cfe8-479e-be2c-b31210e784d5 req-3f94c472-df5b-411b-bd47-ba4d028d873e service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 1095 time: 0.1668549 May 12 15:28:18.616290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event updated for resources: {'Port': ['ID=7d5cbb37-383e-49c5-8545-84e6ee038c9e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:18.693472 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6f26adb-7078-40df-b2bc-22130a89d835 req-770dbeac-0764-4db0-a593-869962b76a02 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=a38d2c29-bf89-4d38-a714-9037ce4b4638&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1236711 May 12 15:28:18.694419 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:18.697198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 78d4ada5-c100-4849-8e75-44ba389f27d8 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:28:18.812443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-604e840a-cfe8-479e-be2c-b31210e784d5 req-b3ad5105-3451-4f78-975f-8164ed9a5a2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:18.813956 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-604e840a-cfe8-479e-be2c-b31210e784d5 req-b3ad5105-3451-4f78-975f-8164ed9a5a2a service neutron] 10.222.0.84 "GET /v2.0/networks?id=de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 200 len: 913 time: 0.1918499 May 12 15:28:18.827892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:28:18.830994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:28:18.847717 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:18.851931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5c8717c4-fea8-4ea3-93db-4dcc9b86b20b admin admin] 10.222.0.82 "DELETE /v2.0/routers/78d4ada5-c100-4849-8e75-44ba389f27d8 HTTP/1.1" status: 204 len: 168 time: 3.8816087 May 12 15:28:18.857081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43914) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:18.917002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:28:19.014814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-96e8339d-caf1-4e1e-a3a5-54403971ac0c admin admin] Deleting subnet 5f6d45f7-b8bc-4313-879f-ee173c0a4148 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:28:19.030970 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96e8339d-caf1-4e1e-a3a5-54403971ac0c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:19.044158 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-604e840a-cfe8-479e-be2c-b31210e784d5 req-a03a1945-bd8f-4f2b-90b2-5d3412a8a632 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26 HTTP/1.1" status: 200 len: 999 time: 0.2146580 May 12 15:28:19.089175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8213da7c-698d-43a8-9565-a15bc6543757 req-dae2f3eb-e4d1-4aaa-94ff-b35c6e70b86e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:19.096330 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8213da7c-698d-43a8-9565-a15bc6543757 req-dae2f3eb-e4d1-4aaa-94ff-b35c6e70b86e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.3895531 May 12 15:28:19.123323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:28:19.134938 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96e8339d-caf1-4e1e-a3a5-54403971ac0c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:19.142076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-604e840a-cfe8-479e-be2c-b31210e784d5 req-2cdca1f0-d113-47e8-b380-1c643e26d51c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:19.145210 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-604e840a-cfe8-479e-be2c-b31210e784d5 req-2cdca1f0-d113-47e8-b380-1c643e26d51c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 200 len: 851 time: 0.0938354 May 12 15:28:19.200548 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:19.259086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:28:19.271699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:28:19.273866 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:19.421591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 201e7ec4-04fd-4014-bf97-75995d8a73c1 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:28:19.422419 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:19.483638 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8213da7c-698d-43a8-9565-a15bc6543757 req-bda486bb-9e34-4c93-a743-b5a68291ab27 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3843920 May 12 15:28:19.495133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-604e840a-cfe8-479e-be2c-b31210e784d5 req-783605f4-1e38-4af6-bfe9-43b872f7f3a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:19.497607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 201e7ec4-04fd-4014-bf97-75995d8a73c1 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:28:19.498160 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 201e7ec4-04fd-4014-bf97-75995d8a73c1 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:28:19.506015 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-604e840a-cfe8-479e-be2c-b31210e784d5 req-783605f4-1e38-4af6-bfe9-43b872f7f3a7 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=de9b95bc-97c4-4188-a1d0-c125f35032b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3535917 May 12 15:28:19.579918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbc0f6f2-d793-4eb7-9eb6-c69b5b458d61 req-130937e7-1ffc-4463-9010-9fa1b01fdf41 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:19.582231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbc0f6f2-d793-4eb7-9eb6-c69b5b458d61 req-130937e7-1ffc-4463-9010-9fa1b01fdf41 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.6457953 May 12 15:28:19.619623 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:19.667277 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96e8339d-caf1-4e1e-a3a5-54403971ac0c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:19.668533 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:19.669919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:19.691993 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:19.763503 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbc0f6f2-d793-4eb7-9eb6-c69b5b458d61 req-1d56c049-48ce-426a-a0e4-18bf544f8e68 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1529126 May 12 15:28:19.782936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5819d0b3-8d0f-45e3-aa06-e58896438fb7 req-0ea71425-f7f8-4ebe-a851-423e1a7905e0 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.0623851 May 12 15:28:19.829430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:19.856805 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96e8339d-caf1-4e1e-a3a5-54403971ac0c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:19.862421 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e1650853-dd22-4db3-9a8b-b476be2ca5ee'] response: {'server_uuid': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'code': 200} May 12 15:28:19.908378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e15490e6-7da8-4bab-8791-88ecc66ddc61 None None] Network 2d986451-1d91-468d-8a9c-ecc4da7a86bc requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:28:19.927768 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96e8339d-caf1-4e1e-a3a5-54403971ac0c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:19.942331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96e8339d-caf1-4e1e-a3a5-54403971ac0c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5f6d45f7-b8bc-4313-879f-ee173c0a4148,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:19.948134 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-96e8339d-caf1-4e1e-a3a5-54403971ac0c admin admin] 10.222.0.82 "DELETE /v2.0/subnets/5f6d45f7-b8bc-4313-879f-ee173c0a4148 HTTP/1.1" status: 204 len: 168 time: 1.0843594 May 12 15:28:19.954901 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43938) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:19.983603 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-604e840a-cfe8-479e-be2c-b31210e784d5 req-deccf78a-9f4c-4717-8ac4-ab12b3b11a3b service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4729741 May 12 15:28:20.237438 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-604e840a-cfe8-479e-be2c-b31210e784d5 req-9e006ee9-5d44-4320-9996-7778a2919684 service neutron] 10.222.0.84 "GET /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2183616 May 12 15:28:20.240647 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:20.253725 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:20.325232 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:20.364746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Deleting port 445cefc8-5130-4799-911a-f589d3a6c90f {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:20.365078 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:20.416666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f07a717-abbf-4927-bc16-02e1e02a5169 None None] DHCP port deletion for 2d986451-1d91-468d-8a9c-ecc4da7a86bc request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:28:20.420796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9f07a717-abbf-4927-bc16-02e1e02a5169 None None] Deleting port 445cefc8-5130-4799-911a-f589d3a6c90f {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:20.421368 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9f07a717-abbf-4927-bc16-02e1e02a5169 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:20.447503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event updated for resources: {'Port': ['ID=7d5cbb37-383e-49c5-8545-84e6ee038c9e,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:20.456185 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:20.483440 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:20.486584 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d61003d4-553b-4ffd-88ad-7f83833b55f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 3.5618136 May 12 15:28:20.503356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa02ff14-0131-486e-949a-c6fc7eca0854 req-2fb62dc6-79ed-4410-9c3f-80237a88dcd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:20.505486 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa02ff14-0131-486e-949a-c6fc7eca0854 req-2fb62dc6-79ed-4410-9c3f-80237a88dcd7 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 1096 time: 0.4484413 May 12 15:28:20.535913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e87f4228-8b3c-4d25-ae7d-ae4080015510 req-ca5ab5d8-27b1-426e-90f9-bc39f976b316 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:20.537546 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e87f4228-8b3c-4d25-ae7d-ae4080015510 req-ca5ab5d8-27b1-426e-90f9-bc39f976b316 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 945 time: 0.5596230 May 12 15:28:20.748353 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9f07a717-abbf-4927-bc16-02e1e02a5169 None None] For port 445cefc8-5130-4799-911a-f589d3a6c90f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=445cefc8-5130-4799-911a-f589d3a6c90f,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:20.748722 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9f07a717-abbf-4927-bc16-02e1e02a5169 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:20.819846 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa02ff14-0131-486e-949a-c6fc7eca0854 req-976f4c65-290b-4058-8ac9-e693dfd2a0ae service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=a38d2c29-bf89-4d38-a714-9037ce4b4638&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3025000 May 12 15:28:20.833662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] For port 445cefc8-5130-4799-911a-f589d3a6c90f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=445cefc8-5130-4799-911a-f589d3a6c90f,segment=NetworkSegment(3d061d75-b983-4d78-b567-9627e2250878),segment_id=3d061d75-b983-4d78-b567-9627e2250878)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:20.834084 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:20.858545 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e87f4228-8b3c-4d25-ae7d-ae4080015510 req-f2bf372d-e97b-43c5-8564-a1975bcb5acb tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=a38d2c29-bf89-4d38-a714-9037ce4b4638&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2319672 May 12 15:28:20.879469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9f07a717-abbf-4927-bc16-02e1e02a5169 None None] Calling delete_port for 445cefc8-5130-4799-911a-f589d3a6c90f owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:28:20.992668 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9f07a717-abbf-4927-bc16-02e1e02a5169 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:21.009807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Calling delete_port for 445cefc8-5130-4799-911a-f589d3a6c90f owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:28:21.048457 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f07a717-abbf-4927-bc16-02e1e02a5169 None None] Pushing event deleted for resources: {'Port': ['ID=445cefc8-5130-4799-911a-f589d3a6c90f,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:21.059768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f07a717-abbf-4927-bc16-02e1e02a5169 None None] No DVR routers for this DVR port 445cefc8-5130-4799-911a-f589d3a6c90f on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:28:21.162500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a24b7f-a9e8-4da9-b6a3-ee33b13dacb7 req-5d273c10-a979-45f3-9721-ab112299397f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:21.164837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-82a24b7f-a9e8-4da9-b6a3-ee33b13dacb7 req-5d273c10-a979-45f3-9721-ab112299397f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.4565635 May 12 15:28:21.169087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-c3506190-ee6c-4c50-a9f5-dc46915ec910 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Synchronizing usage tracker for tenant:f4660a6351274a7796c2eb1e55a41ec9 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:28:21.215553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:28:21.216065 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:28:21.267498 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-82a24b7f-a9e8-4da9-b6a3-ee33b13dacb7 req-96bfb7c5-0c99-4ce6-8738-407e55558896 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0934987 May 12 15:28:21.283537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-c3506190-ee6c-4c50-a9f5-dc46915ec910 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Unset dirty status for tenant:f4660a6351274a7796c2eb1e55a41ec9 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:28:21.294621 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-c3506190-ee6c-4c50-a9f5-dc46915ec910 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1177362080&fields=id&tenant_id=f4660a6351274a7796c2eb1e55a41ec9 HTTP/1.1" status: 200 len: 267 time: 0.2544806 May 12 15:28:21.322957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 445cefc8-5130-4799-911a-f589d3a6c90f no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:28:21.445793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 445cefc8-5130-4799-911a-f589d3a6c90f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:28:21.445793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 445cefc8-5130-4799-911a-f589d3a6c90f not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:28:21.605257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-829f218d-998c-4854-bba4-ff1baac8a782 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:21.606806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-829f218d-998c-4854-bba4-ff1baac8a782 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/networks?id=e1655f9a-2478-49d5-a6ca-4fec717d6816 HTTP/1.1" status: 200 len: 811 time: 0.3111029 May 12 15:28:21.629080 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-3979d967-6284-46ed-b287-bbfc82fa3558 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/quotas/f4660a6351274a7796c2eb1e55a41ec9 HTTP/1.1" status: 200 len: 375 time: 0.0147116 May 12 15:28:21.720261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05387f7-7c80-4d4d-b333-025dd014bf86 req-bd3fe2c3-2b14-4846-b3bc-2958d499878d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:21.721821 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f05387f7-7c80-4d4d-b333-025dd014bf86 req-bd3fe2c3-2b14-4846-b3bc-2958d499878d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.2450922 May 12 15:28:21.723657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Deleting port 445cefc8-5130-4799-911a-f589d3a6c90f {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:21.723995 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:21.833992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] The port '445cefc8-5130-4799-911a-f589d3a6c90f' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:28:22.113836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f05387f7-7c80-4d4d-b333-025dd014bf86 req-28ce9812-1e73-4f40-9939-440664612668 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3605382 May 12 15:28:22.154193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-ec60a7e9-0c9e-4695-94e6-7a19643acdcd tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=f4660a6351274a7796c2eb1e55a41ec9&fields=id HTTP/1.1" status: 200 len: 348 time: 0.5044119 May 12 15:28:22.154193 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:22.188560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2d986451-1d91-468d-8a9c-ecc4da7a86bc']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:22.204433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3d061d75-b983-4d78-b567-9627e2250878') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:22.205360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3d061d75-b983-4d78-b567-9627e2250878') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:22.247779 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:22.280698 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:22.288467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Releasing vlan 558 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:28:22.288868 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: timer() May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:28:22.313188 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:28:22.469211 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-214f2f55-7ddc-46d8-b509-de4194a59c08 req-1dea7de2-7527-4009-8b91-950f8be5b974 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.0959077 May 12 15:28:22.635340 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-3b8ea1f0-b055-4be4-b788-ff9cfe055d1e service neutron] 10.222.0.82 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4634097 May 12 15:28:22.636385 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:22.654991 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:22.693314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] Pushing event deleted for resources: {'Network': ['ID=2d986451-1d91-468d-8a9c-ecc4da7a86bc,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:22.841113 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9787c993-b3bf-4bb1-8190-78bc70ef14fc admin admin] 10.222.0.82 "DELETE /v2.0/networks/2d986451-1d91-468d-8a9c-ecc4da7a86bc HTTP/1.1" status: 204 len: 168 time: 2.8850105 May 12 15:28:22.912725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22c65ec9-3c75-4a29-a6ed-456b3f9a3e66 req-8ff87a22-644a-41c7-9654-3f0246c2c51b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:22.921148 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22c65ec9-3c75-4a29-a6ed-456b3f9a3e66 req-8ff87a22-644a-41c7-9654-3f0246c2c51b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 945 time: 0.2596965 May 12 15:28:22.954935 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-93739840-a73f-4b9e-9112-09e7fa8f320c service neutron] 10.222.0.82 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2942481 May 12 15:28:23.003061 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22c65ec9-3c75-4a29-a6ed-456b3f9a3e66 req-6b127f2e-86ce-44fd-9b59-3372d7d253ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=a38d2c29-bf89-4d38-a714-9037ce4b4638&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0809917 May 12 15:28:23.065807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44044) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:23.130564 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e66a5dcd-9361-435c-b584-8f869714ab2b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=40852c97262142aeb6d62097955af83f&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0643992 May 12 15:28:23.133648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44050) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:23.412675 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7aadcf75-4d54-45d8-ae25-5dd76aaee066 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:23.446755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-583bdd20-e9db-4a60-908d-755557d35ded req-956f2e5d-6c46-4e03-b8f1-81ff465c3b08 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:23.448320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-583bdd20-e9db-4a60-908d-755557d35ded req-956f2e5d-6c46-4e03-b8f1-81ff465c3b08 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.2919087 May 12 15:28:23.493299 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7aadcf75-4d54-45d8-ae25-5dd76aaee066 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:23.519340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34ab354f-75e3-4c42-b293-e92470472e36 req-7c682233-1acb-40b8-af6a-e310316da256 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:23.530644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44072) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:23.537428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8c0ac482-5df2-4378-bdb7-06d428853cc8 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'floatingip': {'port_id': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:28:23.541119 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34ab354f-75e3-4c42-b293-e92470472e36 req-7c682233-1acb-40b8-af6a-e310316da256 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 945 time: 0.2689929 May 12 15:28:23.655726 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-583bdd20-e9db-4a60-908d-755557d35ded req-feb5cd32-a5d1-456d-a2cd-b2c62693c13f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1940484 May 12 15:28:23.686954 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c0ac482-5df2-4378-bdb7-06d428853cc8 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:23.727829 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8b63fc06-0b85-49e5-ae41-fafe754bb896 req-a3efc1d1-ad3c-4b16-b5fb-ded1d2a96f5b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 210 time: 0.1246979 May 12 15:28:23.771877 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7aadcf75-4d54-45d8-ae25-5dd76aaee066 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:23.910774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aadcf75-4d54-45d8-ae25-5dd76aaee066 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=84ade4c8-4e24-403c-bd3f-ef329475e913,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:23.920754 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7aadcf75-4d54-45d8-ae25-5dd76aaee066 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:23.924118 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7aadcf75-4d54-45d8-ae25-5dd76aaee066 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/84ade4c8-4e24-403c-bd3f-ef329475e913 HTTP/1.1" status: 204 len: 168 time: 0.7872634 May 12 15:28:24.051664 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7da8898-73cb-4186-a112-873d2fdb7b7f req-67753fe0-c7a3-40b3-8782-b0e5d1caf831 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.0905056 May 12 15:28:24.085681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57531a38-ac2b-41fc-ac7e-5787c0638cec req-c6c02aca-9c46-40a6-8d0a-3f77c748bc56 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:24.094299 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57531a38-ac2b-41fc-ac7e-5787c0638cec req-c6c02aca-9c46-40a6-8d0a-3f77c748bc56 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.2431934 May 12 15:28:24.197982 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57531a38-ac2b-41fc-ac7e-5787c0638cec req-932ebcb5-2f0c-4cac-a5ae-43d9eed79859 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1025267 May 12 15:28:24.400486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcb38776-cadd-4b95-a047-9c8bc9e200cd req-caf34e01-ded6-49cf-a994-93d161773d77 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:24.408043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dcb38776-cadd-4b95-a047-9c8bc9e200cd req-caf34e01-ded6-49cf-a994-93d161773d77 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.1730785 May 12 15:28:24.493890 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dcb38776-cadd-4b95-a047-9c8bc9e200cd req-f3a1284c-e91f-4c8e-99ed-547ee0919bb4 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0765626 May 12 15:28:25.009814 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c0ac482-5df2-4378-bdb7-06d428853cc8 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:25.019047 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c0ac482-5df2-4378-bdb7-06d428853cc8 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:25.080584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f100af2-1829-419e-984f-9980b6dded81 req-738d0211-f54a-4e06-a1e5-bcbce8ee11e6 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 210 time: 0.1522691 May 12 15:28:25.488613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d71a7fca-cd08-4aa4-b1a7-e9e4711ae0e2 req-066c94ce-1e62-4309-9b88-399849c7d5f0 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.1624808 May 12 15:28:25.544860 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-8c0ac482-5df2-4378-bdb7-06d428853cc8 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Floating IP ad94042f-a6a1-4708-ab51-e49f96948e07 associated. External IP: 172.25.8.38, port: c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb. May 12 15:28:25.828127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-0f3d7c4c-25cc-47ec-bc29-ff949002dc9b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:25.833124 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-0f3d7c4c-25cc-47ec-bc29-ff949002dc9b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.76 "GET /v2.0/networks?id=e1655f9a-2478-49d5-a6ca-4fec717d6816 HTTP/1.1" status: 200 len: 811 time: 0.8650079 May 12 15:28:25.901756 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0d9c378-05eb-4bf7-86f3-a1ad51e514b2 req-a23f579a-e2a6-415b-bd17-1f6d74ed25d0 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:25.911921 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0d9c378-05eb-4bf7-86f3-a1ad51e514b2 req-a23f579a-e2a6-415b-bd17-1f6d74ed25d0 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.1763477 May 12 15:28:26.005484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-bc6c523e-3fac-42b7-8399-59a6a8d65072 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Synchronizing usage tracker for tenant:f4660a6351274a7796c2eb1e55a41ec9 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:28:26.085334 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0d9c378-05eb-4bf7-86f3-a1ad51e514b2 req-66cb75be-1e1b-4cef-91a1-1b500c245cd9 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1704323 May 12 15:28:26.116667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-bc6c523e-3fac-42b7-8399-59a6a8d65072 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Unset dirty status for tenant:f4660a6351274a7796c2eb1e55a41ec9 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:28:26.116667 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-bc6c523e-3fac-42b7-8399-59a6a8d65072 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f4660a6351274a7796c2eb1e55a41ec9 HTTP/1.1" status: 200 len: 380 time: 0.2604113 May 12 15:28:26.169146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Request body: {'port': {'device_id': '27edd0de-e2b4-4033-8918-e91ecc2405de', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'admin_state_up': True, 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'security_groups': ['fcfaf505-a043-4f21-9574-984ab7e90238']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:28:26.477154 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-82a1bf81-cfcc-477d-b1f8-91bd2d424c2a req-c70b7bed-c11e-4f3a-8f6c-23c61241bc2e tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 210 time: 0.0765827 May 12 15:28:26.738926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:26.749143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Usage tracker for resource:port and tenant:f4660a6351274a7796c2eb1e55a41ec9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:26.753641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:26.835287 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:26.900293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Made reservation on behalf of f4660a6351274a7796c2eb1e55a41ec9 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:28:26.904259 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:26.981269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f59c2ae0-a0da-4aa8-a140-f462d7804bbc req-a1c3de2c-5ee5-493e-8fa0-4de4f73a3715 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:26.986685 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f59c2ae0-a0da-4aa8-a140-f462d7804bbc req-a1c3de2c-5ee5-493e-8fa0-4de4f73a3715 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=bd320183-5cdb-430c-beea-7c2caa66e5b4 HTTP/1.1" status: 200 len: 943 time: 0.4899995 May 12 15:28:27.085922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-f59c2ae0-a0da-4aa8-a140-f462d7804bbc req-ef096002-518a-4b36-87b6-7f6687f7fcaf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Deleting port 4687abde-8849-46ae-a349-bef53372a376 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:27.086931 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f59c2ae0-a0da-4aa8-a140-f462d7804bbc req-ef096002-518a-4b36-87b6-7f6687f7fcaf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:27.483655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f59c2ae0-a0da-4aa8-a140-f462d7804bbc req-ef096002-518a-4b36-87b6-7f6687f7fcaf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] For port 4687abde-8849-46ae-a349-bef53372a376, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4687abde-8849-46ae-a349-bef53372a376,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:27.483905 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f59c2ae0-a0da-4aa8-a140-f462d7804bbc req-ef096002-518a-4b36-87b6-7f6687f7fcaf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:27.484135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8c0ac482-5df2-4378-bdb7-06d428853cc8 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:28:27.673554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-f59c2ae0-a0da-4aa8-a140-f462d7804bbc req-ef096002-518a-4b36-87b6-7f6687f7fcaf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Calling delete_port for 4687abde-8849-46ae-a349-bef53372a376 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:28:27.804312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Allocated IP 172.20.0.13 (e1655f9a-2478-49d5-a6ca-4fec717d6816/83787d82-d8a5-4f12-a025-f44dcf581189/5284e633-c8cd-4179-ba2d-44d242c89b57) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:28:27.954370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ddb79905-9989-4fde-9529-f0c7c86362de req-a84edef8-ea92-44fc-abae-ae1923efd883 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.7558534 May 12 15:28:28.025779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8c0ac482-5df2-4378-bdb7-06d428853cc8 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:28:28.036768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-568310fb-d827-4539-8cd4-7242a56181e6 None None] Sync routers for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:28:28.061500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-568310fb-d827-4539-8cd4-7242a56181e6 None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:28:28.062698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-568310fb-d827-4539-8cd4-7242a56181e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:28:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:28.067816 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c0ac482-5df2-4378-bdb7-06d428853cc8 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:28.121486 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f59c2ae0-a0da-4aa8-a140-f462d7804bbc req-ef096002-518a-4b36-87b6-7f6687f7fcaf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:28.348404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['7e0c7266-ad09-4620-bfdc-81de7da01d15', 'bdd6d277-b9d3-4e93-bfc7-66dd6ac96203'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:28:28.412388 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef096002-518a-4b36-87b6-7f6687f7fcaf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event deleted for resources: {'Port': ['ID=4687abde-8849-46ae-a349-bef53372a376,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:28.474792 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8c0ac482-5df2-4378-bdb7-06d428853cc8 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "PUT /v2.0/floatingips/ad94042f-a6a1-4708-ab51-e49f96948e07 HTTP/1.1" status: 200 len: 990 time: 4.9351561 May 12 15:28:28.561551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'tag': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:28.654886 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3812ff76-391c-45d3-87eb-395b5d150146 req-7540b75a-65e0-43ea-8963-32877a508052 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.1561325 May 12 15:28:28.658920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-f59c2ae0-a0da-4aa8-a140-f462d7804bbc req-ef096002-518a-4b36-87b6-7f6687f7fcaf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] No DVR routers for this DVR port 4687abde-8849-46ae-a349-bef53372a376 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:28:28.665966 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f59c2ae0-a0da-4aa8-a140-f462d7804bbc req-ef096002-518a-4b36-87b6-7f6687f7fcaf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:28.670079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd320183-5cdb-430c-beea-7c2caa66e5b4', 'name': 'network-vif-deleted', 'tag': '4687abde-8849-46ae-a349-bef53372a376'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:28.682493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d54f00d4-c58b-40bc-928c-a3dfbfe3c39d req-40dfc04d-a3dc-499e-81d1-3ad003b3157d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:28.683771 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d54f00d4-c58b-40bc-928c-a3dfbfe3c39d req-40dfc04d-a3dc-499e-81d1-3ad003b3157d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Synchronizing usage tracker for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:28:28.693357 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f59c2ae0-a0da-4aa8-a140-f462d7804bbc req-ef096002-518a-4b36-87b6-7f6687f7fcaf tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "DELETE /v2.0/ports/4687abde-8849-46ae-a349-bef53372a376 HTTP/1.1" status: 204 len: 173 time: 1.7017987 May 12 15:28:28.719357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d54f00d4-c58b-40bc-928c-a3dfbfe3c39d req-40dfc04d-a3dc-499e-81d1-3ad003b3157d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Unset dirty status for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:28:28.720846 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d54f00d4-c58b-40bc-928c-a3dfbfe3c39d req-40dfc04d-a3dc-499e-81d1-3ad003b3157d tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.2560697 May 12 15:28:28.731124 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:28.740066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a35e197-d9bd-479c-9da2-c35dce7dfde7 req-a7053cee-d06e-47ff-b085-8de45fb5ca7e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:28.753008 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a35e197-d9bd-479c-9da2-c35dce7dfde7 req-a7053cee-d06e-47ff-b085-8de45fb5ca7e tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.5206273 May 12 15:28:28.759285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Transition to ACTIVE for port object 5284e633-c8cd-4179-ba2d-44d242c89b57 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:28:28.819889 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:28.852185 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a35e197-d9bd-479c-9da2-c35dce7dfde7 req-1346daa6-7f6d-4ae5-b727-d06ffa09d8b1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0969868 May 12 15:28:29.062714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-568310fb-d827-4539-8cd4-7242a56181e6 None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:28:29.118970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-d54f00d4-c58b-40bc-928c-a3dfbfe3c39d req-f6c06187-83a5-4229-a647-0b87abd810e4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Deleting port d63ea51f-7f5b-4b38-b682-efa710d30256 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:29.119625 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d54f00d4-c58b-40bc-928c-a3dfbfe3c39d req-f6c06187-83a5-4229-a647-0b87abd810e4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:29.260633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Network e1655f9a-2478-49d5-a6ca-4fec717d6816 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:28:29.328215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:28:29.332200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:28:29.510757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event updated for resources: {'Port': ['ID=5284e633-c8cd-4179-ba2d-44d242c89b57,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:29.517554 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-78132cac-4820-4f2c-bb45-3a8813efffb2'] response: {'name': 'network-changed', 'server_uuid': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'tag': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'status': 'completed', 'code': 200} May 12 15:28:29.557450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9fd0e75-0665-4e28-95c0-497844b965e4 req-c1ca1a63-4efa-419f-bcd2-89c832bedbd5 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:29.564584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:29.565249 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:29.571274 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9fd0e75-0665-4e28-95c0-497844b965e4 req-c1ca1a63-4efa-419f-bcd2-89c832bedbd5 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 932 time: 0.3936598 May 12 15:28:29.708896 n-d-841483-1 neutron-server[88152]: WARNING neutron.notifiers.nova [-] Nova event matching ['req-f8b3eb97-7bb6-465d-b5a4-46af88f02877']: {'server_uuid': 'bd320183-5cdb-430c-beea-7c2caa66e5b4', 'name': 'network-vif-deleted', 'tag': '4687abde-8849-46ae-a349-bef53372a376', 'status': 'failed', 'code': 422} returned with failed status May 12 15:28:29.716843 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44514) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:29.757074 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-a5a89609-d939-4ec7-91d6-41fb3b707823 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.6268656 May 12 15:28:29.795449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Request body: {'port': {'device_id': '27edd0de-e2b4-4033-8918-e91ecc2405de', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:28:30.096197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0da2236f-5506-4e3a-a972-f24ce2659022 req-73f8b1a4-79aa-4cfe-ab1c-e3a8c62fd797 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.2192838 May 12 15:28:30.104196 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9fd0e75-0665-4e28-95c0-497844b965e4 req-ee041de1-b7c5-4b3c-bf8e-9103272f87f6 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=fcfaf505-a043-4f21-9574-984ab7e90238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5311038 May 12 15:28:30.167289 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2488926f-9316-4f49-87ee-fb43ec00d7c6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:30.227323 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2488926f-9316-4f49-87ee-fb43ec00d7c6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:30.245246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2488926f-9316-4f49-87ee-fb43ec00d7c6 admin admin] Usage tracker for resource:security_group_rule and tenant:91cc0e4cbd624dd7b2841555939c4589 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:30.252530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2488926f-9316-4f49-87ee-fb43ec00d7c6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:30.275973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2488926f-9316-4f49-87ee-fb43ec00d7c6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:30.284857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4aaad3b2-4a4b-49de-94cb-7e47c10aecdd None None] Provisioning for port 5284e633-c8cd-4179-ba2d-44d242c89b57 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:28:30.289057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45b4dc20-3345-4c4a-9336-19d46fd6e563 req-195ee92a-2993-4026-a392-cfe048e11fa6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:30.294145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45b4dc20-3345-4c4a-9336-19d46fd6e563 req-195ee92a-2993-4026-a392-cfe048e11fa6 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 1096 time: 0.7138417 May 12 15:28:30.312254 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:30.365912 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-d54f00d4-c58b-40bc-928c-a3dfbfe3c39d req-f6c06187-83a5-4229-a647-0b87abd810e4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] For port d63ea51f-7f5b-4b38-b682-efa710d30256, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d63ea51f-7f5b-4b38-b682-efa710d30256,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:30.366293 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4aaad3b2-4a4b-49de-94cb-7e47c10aecdd None None] Provisioning complete for port 5284e633-c8cd-4179-ba2d-44d242c89b57 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:28:30.366889 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4aaad3b2-4a4b-49de-94cb-7e47c10aecdd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:30.369842 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d54f00d4-c58b-40bc-928c-a3dfbfe3c39d req-f6c06187-83a5-4229-a647-0b87abd810e4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:30.601041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-d54f00d4-c58b-40bc-928c-a3dfbfe3c39d req-f6c06187-83a5-4229-a647-0b87abd810e4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Calling delete_port for d63ea51f-7f5b-4b38-b682-efa710d30256 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:28:30.719396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4aaad3b2-4a4b-49de-94cb-7e47c10aecdd None None] Port 5284e633-c8cd-4179-ba2d-44d242c89b57 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:28:30.793235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-568310fb-d827-4539-8cd4-7242a56181e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ad94042f-a6a1-4708-ab51-e49f96948e07', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.38', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 2012, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:b0:1d:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:27:56Z', 'updated_at': '2022-05-12T15:28:24Z', 'revision_number': 1, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:30.828662 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-568310fb-d827-4539-8cd4-7242a56181e6 None None] Checking router: 616c45f4-38af-4ff7-8fb7-f1c61b204b6a for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:28:30.915632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45b4dc20-3345-4c4a-9336-19d46fd6e563 req-a0af6f16-08a9-443d-8c08-87042b9e189b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:30.918528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45b4dc20-3345-4c4a-9336-19d46fd6e563 req-a0af6f16-08a9-443d-8c08-87042b9e189b service neutron] 10.222.0.84 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 916 time: 0.6194947 May 12 15:28:30.938458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-568310fb-d827-4539-8cd4-7242a56181e6 None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:28:30.939363 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-568310fb-d827-4539-8cd4-7242a56181e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:28:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:30.946447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72fa7f9c-9d52-4c5b-9381-be0e5a2fa02f req-3c5eb49c-1140-4f7c-ab88-2473e179b404 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:30.948203 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72fa7f9c-9d52-4c5b-9381-be0e5a2fa02f req-3c5eb49c-1140-4f7c-ab88-2473e179b404 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=7a47b071-8332-4fee-b119-b2941bdd643d HTTP/1.1" status: 200 len: 945 time: 0.5865929 May 12 15:28:31.121153 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d54f00d4-c58b-40bc-928c-a3dfbfe3c39d req-f6c06187-83a5-4229-a647-0b87abd810e4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:31.308852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6c06187-83a5-4229-a647-0b87abd810e4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Pushing event deleted for resources: {'Port': ['ID=d63ea51f-7f5b-4b38-b682-efa710d30256,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:31.372548 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-568310fb-d827-4539-8cd4-7242a56181e6 None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:28:31.399090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-d54f00d4-c58b-40bc-928c-a3dfbfe3c39d req-f6c06187-83a5-4229-a647-0b87abd810e4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] No DVR routers for this DVR port d63ea51f-7f5b-4b38-b682-efa710d30256 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:28:31.404464 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d54f00d4-c58b-40bc-928c-a3dfbfe3c39d req-f6c06187-83a5-4229-a647-0b87abd810e4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:31.415635 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2488926f-9316-4f49-87ee-fb43ec00d7c6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:31.425810 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d54f00d4-c58b-40bc-928c-a3dfbfe3c39d req-f6c06187-83a5-4229-a647-0b87abd810e4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.76 "DELETE /v2.0/ports/d63ea51f-7f5b-4b38-b682-efa710d30256 HTTP/1.1" status: 204 len: 173 time: 2.5169477 May 12 15:28:31.462071 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45b4dc20-3345-4c4a-9336-19d46fd6e563 req-2a6f59f9-6d47-4edc-85b4-3e1011f0dcad service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb HTTP/1.1" status: 200 len: 998 time: 0.5175233 May 12 15:28:31.529370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7a47b071-8332-4fee-b119-b2941bdd643d', 'name': 'network-vif-deleted', 'tag': 'd63ea51f-7f5b-4b38-b682-efa710d30256'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:31.537180 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2488926f-9316-4f49-87ee-fb43ec00d7c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:31.587716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5284e633-c8cd-4179-ba2d-44d242c89b57 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:28:31.610044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72fa7f9c-9d52-4c5b-9381-be0e5a2fa02f req-0b980bf1-48eb-45f2-b12b-b1113a3eacee tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3593347 May 12 15:28:31.615057 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:31.667841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Transition to ACTIVE for port object 5284e633-c8cd-4179-ba2d-44d242c89b57 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:28:31.688824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:31.708191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45b4dc20-3345-4c4a-9336-19d46fd6e563 req-54f0210c-e088-4f50-90dd-4614906a2e46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:31.717256 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45b4dc20-3345-4c4a-9336-19d46fd6e563 req-54f0210c-e088-4f50-90dd-4614906a2e46 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 HTTP/1.1" status: 200 len: 854 time: 0.2529516 May 12 15:28:31.976776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Pushing event updated for resources: {'Port': ['ID=5284e633-c8cd-4179-ba2d-44d242c89b57,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:32.094359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2488926f-9316-4f49-87ee-fb43ec00d7c6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=91cc0e4cbd624dd7b2841555939c4589&name=default HTTP/1.1" status: 200 len: 2983 time: 2.3756018 May 12 15:28:32.096010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2488926f-9316-4f49-87ee-fb43ec00d7c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8c5111ed-8f1c-4a87-bd20-e925140393c5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:32.099831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44740) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:32.145560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc302392-02ff-43bd-8578-f26fa86a6125 req-66cb762a-7305-4151-8b9e-55fc9442966d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:32.146484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-dc302392-02ff-43bd-8578-f26fa86a6125 req-66cb762a-7305-4151-8b9e-55fc9442966d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Synchronizing usage tracker for tenant:6357a1184f074ce2a5b5f19b5ce06e85 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:28:32.170018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d63ea51f-7f5b-4b38-b682-efa710d30256 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:28:32.196953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Attempting to bind port 5284e633-c8cd-4179-ba2d-44d242c89b57 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:28:32.197402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Attempting to bind port 5284e633-c8cd-4179-ba2d-44d242c89b57 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:28:32.197818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Attempting to bind port 5284e633-c8cd-4179-ba2d-44d242c89b57 on network e1655f9a-2478-49d5-a6ca-4fec717d6816 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:28:32.235496 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: d63ea51f-7f5b-4b38-b682-efa710d30256 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:28:32.235834 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d63ea51f-7f5b-4b38-b682-efa710d30256 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:28:32.259408 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-568310fb-d827-4539-8cd4-7242a56181e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ad94042f-a6a1-4708-ab51-e49f96948e07', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.38', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 2012, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:b0:1d:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:27:56Z', 'updated_at': '2022-05-12T15:28:24Z', 'revision_number': 1, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:32.261449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Port 5284e633-c8cd-4179-ba2d-44d242c89b57 on network e1655f9a-2478-49d5-a6ca-4fec717d6816 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:28:32.262036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Attempting to bind port 5284e633-c8cd-4179-ba2d-44d242c89b57 on network e1655f9a-2478-49d5-a6ca-4fec717d6816 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:28:32.266456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-568310fb-d827-4539-8cd4-7242a56181e6 None None] The sync data for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 is: [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ad94042f-a6a1-4708-ab51-e49f96948e07', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.38', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 2012, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:b0:1d:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:27:56Z', 'updated_at': '2022-05-12T15:28:24Z', 'revision_number': 1, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:28:32.284265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 28, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:28:32.284607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Checking segment: {'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:28:32.285002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Bound using segment: {'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:28:32.285472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Bound port: 5284e633-c8cd-4179-ba2d-44d242c89b57, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c54a2125-ccc2-41a0-9a49-29870f0679c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:28:32.285817 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:32.318088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45b4dc20-3345-4c4a-9336-19d46fd6e563 req-0e9fbd95-e2fa-47ed-88d7-057c23cbc18e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:32.321019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45b4dc20-3345-4c4a-9336-19d46fd6e563 req-0e9fbd95-e2fa-47ed-88d7-057c23cbc18e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbecac63-cd00-4ee6-bec1-19abe557d6e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.6029747 May 12 15:28:32.376962 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:32.410523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-dc302392-02ff-43bd-8578-f26fa86a6125 req-66cb762a-7305-4151-8b9e-55fc9442966d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Unset dirty status for tenant:6357a1184f074ce2a5b5f19b5ce06e85 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:28:32.411772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc302392-02ff-43bd-8578-f26fa86a6125 req-66cb762a-7305-4151-8b9e-55fc9442966d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 908 time: 1.4806862 May 12 15:28:32.476798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af18ea0-ed94-43bc-9c41-d7314644c721 req-4d405559-4bcb-4ceb-9111-922a62c8cdb1 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:32.479172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0af18ea0-ed94-43bc-9c41-d7314644c721 req-4d405559-4bcb-4ceb-9111-922a62c8cdb1 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Synchronizing usage tracker for tenant:6357a1184f074ce2a5b5f19b5ce06e85 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:28:32.508045 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9be5af3-85b8-4454-8b9d-5d185aedcd35 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:32.536696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0af18ea0-ed94-43bc-9c41-d7314644c721 req-4d405559-4bcb-4ceb-9111-922a62c8cdb1 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Unset dirty status for tenant:6357a1184f074ce2a5b5f19b5ce06e85 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:28:32.538728 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0af18ea0-ed94-43bc-9c41-d7314644c721 req-4d405559-4bcb-4ceb-9111-922a62c8cdb1 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.76 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 908 time: 0.4973495 May 12 15:28:32.551278 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9be5af3-85b8-4454-8b9d-5d185aedcd35 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:32.616757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffedff6e-0dcd-4c80-8531-8af7b18710ab req-51c14364-5ec1-4005-8513-fcdc8ba095c4 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:32.618885 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ffedff6e-0dcd-4c80-8531-8af7b18710ab req-51c14364-5ec1-4005-8513-fcdc8ba095c4 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 944 time: 0.7351286 May 12 15:28:32.646200 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c0cee2dc-20c7-472d-8461-9484ad1149f6 None None] New status for floating IP ad94042f-a6a1-4708-ab51-e49f96948e07: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:28:32.710693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-0af18ea0-ed94-43bc-9c41-d7314644c721 req-3e10673d-c245-4bdd-aa6f-79b5a9031d1d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Deleting port a1c53249-987d-432e-8065-6336089a1cc1 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:32.711288 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0af18ea0-ed94-43bc-9c41-d7314644c721 req-3e10673d-c245-4bdd-aa6f-79b5a9031d1d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:32.760812 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60f8be20-bd6c-4efe-bf88-5ca8af1b75bd req-0ef5cbd2-b079-4c99-92ea-293ed1cb79ee tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.0435705 May 12 15:28:32.848474 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ffedff6e-0dcd-4c80-8531-8af7b18710ab req-2d199fcf-54f6-4869-8d43-b956d6e479ab tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=fcfaf505-a043-4f21-9574-984ab7e90238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2175372 May 12 15:28:32.859177 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45b4dc20-3345-4c4a-9336-19d46fd6e563 req-f8dd707f-aa0d-48d5-89c3-0d280c68eaf3 service neutron] 10.222.0.84 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5286124 May 12 15:28:32.860374 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9be5af3-85b8-4454-8b9d-5d185aedcd35 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:32.953260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9be5af3-85b8-4454-8b9d-5d185aedcd35 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c5111ed-8f1c-4a87-bd20-e925140393c5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:32.977634 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9be5af3-85b8-4454-8b9d-5d185aedcd35 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:32.995230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f9be5af3-85b8-4454-8b9d-5d185aedcd35 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8c5111ed-8f1c-4a87-bd20-e925140393c5 HTTP/1.1" status: 204 len: 168 time: 0.8796885 May 12 15:28:33.050512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] For port 5284e633-c8cd-4179-ba2d-44d242c89b57, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:28:33.056440 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e7ca08c8-d70a-4492-85b6-0a22856c3b95'] response: {'server_uuid': '7a47b071-8332-4fee-b119-b2941bdd643d', 'name': 'network-vif-deleted', 'tag': 'd63ea51f-7f5b-4b38-b682-efa710d30256', 'status': 'completed', 'code': 200} May 12 15:28:33.089086 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45b4dc20-3345-4c4a-9336-19d46fd6e563 req-70208889-e524-4e60-b92e-a3a5e3163c67 service neutron] 10.222.0.84 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2149673 May 12 15:28:33.130205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] For port 5284e633-c8cd-4179-ba2d-44d242c89b57, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=5284e633-c8cd-4179-ba2d-44d242c89b57,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:28:33.150085 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:33.297826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Pushing event updated for resources: {'Port': ['ID=5284e633-c8cd-4179-ba2d-44d242c89b57,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:33.309750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:33.310281 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:33.311683 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fbd691-b64c-4f33-a979-b4de327ea373 service neutron] 10.222.0.76 "PUT /v2.0/ports/5284e633-c8cd-4179-ba2d-44d242c89b57 HTTP/1.1" status: 200 len: 1092 time: 3.5334482 May 12 15:28:33.385883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f14c3c8-9944-4322-86e9-f9fbdb721a73 req-279f9114-e9d3-4c31-bd42-c5a89e03369b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=d18a8f9096b94cb99933c9856d18420b&device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.0841384 May 12 15:28:33.434538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0af18ea0-ed94-43bc-9c41-d7314644c721 req-3e10673d-c245-4bdd-aa6f-79b5a9031d1d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] For port a1c53249-987d-432e-8065-6336089a1cc1, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a1c53249-987d-432e-8065-6336089a1cc1,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:33.435236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0af18ea0-ed94-43bc-9c41-d7314644c721 req-3e10673d-c245-4bdd-aa6f-79b5a9031d1d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:33.436481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f14c3c8-9944-4322-86e9-f9fbdb721a73 req-4683b12f-60df-4209-9030-8decaeac0793 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=d18a8f9096b94cb99933c9856d18420b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0441661 May 12 15:28:33.640863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-0af18ea0-ed94-43bc-9c41-d7314644c721 req-3e10673d-c245-4bdd-aa6f-79b5a9031d1d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Calling delete_port for a1c53249-987d-432e-8065-6336089a1cc1 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:28:33.697330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f14c3c8-9944-4322-86e9-f9fbdb721a73 req-884d437c-557d-4950-932f-de02f05b7b16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:33.699648 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f14c3c8-9944-4322-86e9-f9fbdb721a73 req-884d437c-557d-4950-932f-de02f05b7b16 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2574286 May 12 15:28:33.771192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0630d6d4-5b92-4096-bde8-be9205d349d9 req-a20ca3ff-cd5f-4aab-a87a-b53150632f95 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.0670044 May 12 15:28:33.940710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44792) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:33.963273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-23b04813-2f91-488f-acbb-579001f497e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:33.966022 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-23b04813-2f91-488f-acbb-579001f497e4 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=f4660a6351274a7796c2eb1e55a41ec9&device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 1095 time: 0.6005149 May 12 15:28:34.013351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33d07231-7809-4ab8-b18d-8d6470b06c17 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:34.036068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-33d07231-7809-4ab8-b18d-8d6470b06c17 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:34.041139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-33d07231-7809-4ab8-b18d-8d6470b06c17 admin admin] Usage tracker for resource:security_group_rule and tenant:6482651def9b477ebbd6259a8a06c3d8 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:34.044513 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-33d07231-7809-4ab8-b18d-8d6470b06c17 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:34.050636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-33d07231-7809-4ab8-b18d-8d6470b06c17 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:34.063200 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-32845e5f-f271-4798-be00-e15de7af1891 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5284e633-c8cd-4179-ba2d-44d242c89b57 HTTP/1.1" status: 200 len: 217 time: 0.0801244 May 12 15:28:34.189887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-ffd196c3-a87b-4d72-ba0c-a7caf03ef681 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:34.191624 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-ffd196c3-a87b-4d72-ba0c-a7caf03ef681 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=83787d82-d8a5-4f12-a025-f44dcf581189 HTTP/1.1" status: 200 len: 850 time: 0.1200538 May 12 15:28:34.197975 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0af18ea0-ed94-43bc-9c41-d7314644c721 req-3e10673d-c245-4bdd-aa6f-79b5a9031d1d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:34.281059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-95a9f954-a59d-4ec1-a2ad-5c3086779b13 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:34.282176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-95a9f954-a59d-4ec1-a2ad-5c3086779b13 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Synchronizing usage tracker for tenant:e1146a673b454173a1ed844897ff4119 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:28:34.322760 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aa0a4b8-42f3-495c-9984-cc2bf401ac4b req-38e3966e-3475-40ec-8194-b9b879303aa0 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:34.333217 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6aa0a4b8-42f3-495c-9984-cc2bf401ac4b req-38e3966e-3475-40ec-8194-b9b879303aa0 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8119d65-58b3-47a9-a67c-cb954ba4751e HTTP/1.1" status: 200 len: 908 time: 0.3677442 May 12 15:28:34.342112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-95a9f954-a59d-4ec1-a2ad-5c3086779b13 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Unset dirty status for tenant:e1146a673b454173a1ed844897ff4119 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:28:34.366470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-95a9f954-a59d-4ec1-a2ad-5c3086779b13 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/networks?id=19102399-18db-4840-b998-adc5bada1da0 HTTP/1.1" status: 200 len: 813 time: 0.3128886 May 12 15:28:34.395925 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-7862b0d3-ace3-4767-9f3c-7a2de6a400cc tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/quotas/e1146a673b454173a1ed844897ff4119 HTTP/1.1" status: 200 len: 375 time: 0.0282512 May 12 15:28:34.399671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-0af18ea0-ed94-43bc-9c41-d7314644c721 req-3e10673d-c245-4bdd-aa6f-79b5a9031d1d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] No DVR routers for this DVR port a1c53249-987d-432e-8065-6336089a1cc1 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:28:34.402660 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0af18ea0-ed94-43bc-9c41-d7314644c721 req-3e10673d-c245-4bdd-aa6f-79b5a9031d1d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:34.412977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e10673d-c245-4bdd-aa6f-79b5a9031d1d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event deleted for resources: {'Port': ['ID=a1c53249-987d-432e-8065-6336089a1cc1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:34.452508 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0af18ea0-ed94-43bc-9c41-d7314644c721 req-3e10673d-c245-4bdd-aa6f-79b5a9031d1d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.76 "DELETE /v2.0/ports/a1c53249-987d-432e-8065-6336089a1cc1 HTTP/1.1" status: 204 len: 173 time: 1.8880863 May 12 15:28:34.489193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-1f8e08b5-17e1-4933-ac9e-661bae777dc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:34.492950 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-1f8e08b5-17e1-4933-ac9e-661bae777dc9 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e1655f9a-2478-49d5-a6ca-4fec717d6816&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2783940 May 12 15:28:34.505892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-85f89598-eb3d-4e63-b307-f416110de8f3 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=e1146a673b454173a1ed844897ff4119&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0841238 May 12 15:28:34.554351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33d07231-7809-4ab8-b18d-8d6470b06c17 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:34.647126 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33d07231-7809-4ab8-b18d-8d6470b06c17 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:34.666237 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-61fcb743-96e3-4478-a2e4-480a4e56c6c0 service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1659601 May 12 15:28:34.827335 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a91c34fb-3e68-4a1c-8b8e-15ddab7a4ab4 req-94cf8366-8b32-49b2-9bf6-222fad1ad7a4 service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1546981 May 12 15:28:34.920498 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-33d07231-7809-4ab8-b18d-8d6470b06c17 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6482651def9b477ebbd6259a8a06c3d8&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9786806 May 12 15:28:34.924547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44818) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:34.927888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33d07231-7809-4ab8-b18d-8d6470b06c17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f5f440f-021c-4e44-a12d-c73dfd8dd778,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:34.929674 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5f14c3c8-9944-4322-86e9-f9fbdb721a73 req-16418fa4-2e12-405f-bf71-76301aac3ad0 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.76 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.0469086 May 12 15:28:35.034189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99830205-2b89-44af-b05b-1d599e7713d2 req-66132ae0-a988-4ddc-88e6-0654a767e6b4 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:35.041359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99830205-2b89-44af-b05b-1d599e7713d2 req-66132ae0-a988-4ddc-88e6-0654a767e6b4 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 944 time: 0.4854712 May 12 15:28:35.044650 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-42796ef2-c38b-4d29-a286-b1be99c47fb7 service neutron] 10.222.0.82 "GET /v2.0/networks/19102399-18db-4840-b998-adc5bada1da0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4272749 May 12 15:28:35.057616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '27edd0de-e2b4-4033-8918-e91ecc2405de', 'tag': '5284e633-c8cd-4179-ba2d-44d242c89b57'}, {'server_uuid': 'e8119d65-58b3-47a9-a67c-cb954ba4751e', 'name': 'network-vif-deleted', 'tag': 'a1c53249-987d-432e-8065-6336089a1cc1'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:35.187376 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c7cc0a01-81c5-4d23-a7fc-d1ce72f28168 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:35.210089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99830205-2b89-44af-b05b-1d599e7713d2 req-37ba44ca-7457-4106-a0ef-40b2cedaf360 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=fcfaf505-a043-4f21-9574-984ab7e90238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1673987 May 12 15:28:35.271307 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c7cc0a01-81c5-4d23-a7fc-d1ce72f28168 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:35.333896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-15815db7-9288-4273-9523-961c46da0534 service neutron] 10.222.0.82 "GET /v2.0/networks/19102399-18db-4840-b998-adc5bada1da0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2667406 May 12 15:28:35.371497 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c7cc0a01-81c5-4d23-a7fc-d1ce72f28168 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:35.392587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7cc0a01-81c5-4d23-a7fc-d1ce72f28168 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f5f440f-021c-4e44-a12d-c73dfd8dd778,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:35.424500 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c7cc0a01-81c5-4d23-a7fc-d1ce72f28168 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:35.428789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c7cc0a01-81c5-4d23-a7fc-d1ce72f28168 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9f5f440f-021c-4e44-a12d-c73dfd8dd778 HTTP/1.1" status: 204 len: 168 time: 0.4963214 May 12 15:28:35.767272 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9228f607-cbb2-4714-a738-198cddcfcebe req-409e34db-d1e8-4eee-88c8-c7cc60f4d411 tempest-ServerShowV257Test-632599237 tempest-ServerShowV257Test-632599237-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4cf0822-ee12-4114-93de-6cbd61522207 HTTP/1.1" status: 200 len: 210 time: 0.0667877 May 12 15:28:35.781851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-f371efc8-2a5a-4d5a-acc6-4f8f5546ced2 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:35.783555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-f371efc8-2a5a-4d5a-acc6-4f8f5546ced2 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 812 time: 0.3857887 May 12 15:28:35.815693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-2a84e415-82e6-4b33-8788-1d88a7461ea5 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/quotas/011dcf6c7b624a28bb2d8ed8db38754f HTTP/1.1" status: 200 len: 375 time: 0.0210516 May 12 15:28:35.860332 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1763d4d6-29c6-4ff1-981f-e05bbfa5c90f'] response: {'name': 'network-changed', 'server_uuid': '27edd0de-e2b4-4033-8918-e91ecc2405de', 'tag': '5284e633-c8cd-4179-ba2d-44d242c89b57', 'status': 'completed', 'code': 200} May 12 15:28:35.860596 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1763d4d6-29c6-4ff1-981f-e05bbfa5c90f'] response: {'server_uuid': 'e8119d65-58b3-47a9-a67c-cb954ba4751e', 'name': 'network-vif-deleted', 'tag': 'a1c53249-987d-432e-8065-6336089a1cc1', 'status': 'completed', 'code': 200} May 12 15:28:35.935331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-b5f8f625-ae19-48f8-af99-c345d6b18857 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1170204 May 12 15:28:36.034896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206f5787-dead-479b-b503-42511751ecb2 req-8828e03e-f026-4373-8336-0a7cef7bf903 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:36.036397 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-206f5787-dead-479b-b503-42511751ecb2 req-8828e03e-f026-4373-8336-0a7cef7bf903 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=f4660a6351274a7796c2eb1e55a41ec9&device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 1095 time: 0.1511378 May 12 15:28:36.121854 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e632c3c3-b36b-4ef0-a14b-f27ddeb09bcb req-2656ab09-60cf-494d-93f8-71dbea6f522b tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 210 time: 0.0666230 May 12 15:28:36.197835 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a1c53249-987d-432e-8065-6336089a1cc1 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:28:36.258157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-9157af6d-48c6-473c-9352-c58279b360d2 service neutron] 10.222.0.82 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3216896 May 12 15:28:36.292397 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: a1c53249-987d-432e-8065-6336089a1cc1 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:28:36.292767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a1c53249-987d-432e-8065-6336089a1cc1 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:28:36.297376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206f5787-dead-479b-b503-42511751ecb2 req-413d3220-3e3f-45f1-918d-a0bf50258a96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:36.299494 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-206f5787-dead-479b-b503-42511751ecb2 req-413d3220-3e3f-45f1-918d-a0bf50258a96 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e1655f9a-2478-49d5-a6ca-4fec717d6816 HTTP/1.1" status: 200 len: 912 time: 0.2570388 May 12 15:28:36.421855 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-206f5787-dead-479b-b503-42511751ecb2 req-ac7884c4-6a01-4441-803f-e3c34a08312d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5284e633-c8cd-4179-ba2d-44d242c89b57 HTTP/1.1" status: 200 len: 217 time: 0.1112528 May 12 15:28:36.512815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206f5787-dead-479b-b503-42511751ecb2 req-af7e7d40-68ea-45f6-85db-99fa0309a0d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:36.515983 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-206f5787-dead-479b-b503-42511751ecb2 req-af7e7d40-68ea-45f6-85db-99fa0309a0d7 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=83787d82-d8a5-4f12-a025-f44dcf581189 HTTP/1.1" status: 200 len: 850 time: 0.0897694 May 12 15:28:36.540703 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-e4d72261-b549-4cc4-9a93-eb578c76f870 service neutron] 10.222.0.82 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2816808 May 12 15:28:36.695370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206f5787-dead-479b-b503-42511751ecb2 req-79ffc07e-85b9-4075-ae84-8f6d8dc02f7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:36.696856 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-206f5787-dead-479b-b503-42511751ecb2 req-79ffc07e-85b9-4075-ae84-8f6d8dc02f7d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e1655f9a-2478-49d5-a6ca-4fec717d6816&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1740539 May 12 15:28:36.932247 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-206f5787-dead-479b-b503-42511751ecb2 req-a9c7044c-181f-4d29-ad3a-f4a4b3064819 service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2272925 May 12 15:28:37.110458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f42a8649-819d-4833-9e8f-95005501fe5b req-deae5360-f77c-48f9-8348-ad2b75f8dfcc tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:37.118314 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f42a8649-819d-4833-9e8f-95005501fe5b req-deae5360-f77c-48f9-8348-ad2b75f8dfcc tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 944 time: 0.2103095 May 12 15:28:37.126691 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-206f5787-dead-479b-b503-42511751ecb2 req-fbdfa019-c6b2-4fa7-98ef-977a942cb22b service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1856134 May 12 15:28:37.183853 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207b3b06-4189-48f6-bc6a-2f8292aad8fd req-67e11f3f-f90f-492c-a734-56d6122762ff tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:37.195157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-207b3b06-4189-48f6-bc6a-2f8292aad8fd req-67e11f3f-f90f-492c-a734-56d6122762ff tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 945 time: 0.2206903 May 12 15:28:37.320476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-207b3b06-4189-48f6-bc6a-2f8292aad8fd req-cc6c8faf-53ce-4484-b293-6a78c12eb3e7 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1292760 May 12 15:28:37.346849 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f42a8649-819d-4833-9e8f-95005501fe5b req-d2829466-a747-45ed-9af8-374285d15f73 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=fcfaf505-a043-4f21-9574-984ab7e90238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2273140 May 12 15:28:37.454903 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a4151fe-d48e-4ce5-ae54-50710c58a188 req-6e76a545-2d81-4626-b7cf-7240ef54bb0a tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 210 time: 0.0565691 May 12 15:28:37.744855 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa3fb228-b031-4b72-a68e-f583b92a4e89 req-8d420185-305a-4f8c-aa6e-042e169a223a tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 210 time: 0.0567272 May 12 15:28:37.888038 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:28:38.025448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a4d086ac-b28d-483e-bf03-d1952ec6d43d tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:38.034404 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a4d086ac-b28d-483e-bf03-d1952ec6d43d tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.76 "GET /v2.0/networks?id=19102399-18db-4840-b998-adc5bada1da0 HTTP/1.1" status: 200 len: 813 time: 0.6123323 May 12 15:28:38.054872 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Request body: {'port': {'device_id': '774b92e3-9429-4f04-94bb-bbbb9ce9acac', 'network_id': '19102399-18db-4840-b998-adc5bada1da0', 'admin_state_up': True, 'tenant_id': 'e1146a673b454173a1ed844897ff4119'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:28:38.136209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44930) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:38.198552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 5284e633-c8cd-4179-ba2d-44d242c89b57 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:28:38.341164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:38.384882 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Usage tracker for resource:port and tenant:e1146a673b454173a1ed844897ff4119 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:38.388435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:38.410254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:38.447356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Made reservation on behalf of e1146a673b454173a1ed844897ff4119 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:28:38.451664 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:38.510239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 5284e633-c8cd-4179-ba2d-44d242c89b57, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=5284e633-c8cd-4179-ba2d-44d242c89b57,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:38.595449 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '5284e633-c8cd-4179-ba2d-44d242c89b57', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'port_id': '5284e633-c8cd-4179-ba2d-44d242c89b57', 'mac_address': 'fa:16:3e:53:ca:14', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 583, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:28:38.743829 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:38.750011 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ae4095c-7026-45a8-983b-1dc89862ad1a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:38.783684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5284e633-c8cd-4179-ba2d-44d242c89b57 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:28:38.809559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 5284e633-c8cd-4179-ba2d-44d242c89b57, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=5284e633-c8cd-4179-ba2d-44d242c89b57,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:38.815469 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:38.856605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4ae4095c-7026-45a8-983b-1dc89862ad1a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:38.902085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=5284e633-c8cd-4179-ba2d-44d242c89b57,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:38.915059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4ae4095c-7026-45a8-983b-1dc89862ad1a admin admin] Usage tracker for resource:security_group_rule and tenant:d18a8f9096b94cb99933c9856d18420b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:38.936003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4ae4095c-7026-45a8-983b-1dc89862ad1a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:38.965867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4ae4095c-7026-45a8-983b-1dc89862ad1a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:39.009320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['5284e633-c8cd-4179-ba2d-44d242c89b57'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:28:39.028711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee48493-e971-4677-9247-0d84118613e9 req-4a3dc31f-33fd-4d91-bad6-22979230afa1 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:39.030254 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bee48493-e971-4677-9247-0d84118613e9 req-4a3dc31f-33fd-4d91-bad6-22979230afa1 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 945 time: 0.5715528 May 12 15:28:39.049456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b88304b3-e758-4b55-81a8-5db45b090c08 req-0e73ce1a-41ee-4031-b477-7283804b414f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:39.057648 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b88304b3-e758-4b55-81a8-5db45b090c08 req-0e73ce1a-41ee-4031-b477-7283804b414f tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 945 time: 0.4094830 May 12 15:28:39.090777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Allocated IP 172.20.0.4 (19102399-18db-4840-b998-adc5bada1da0/5191993e-726b-4897-9b02-25fe32b3009b/79e7ee47-ef7f-4129-af14-1b599edecfb5) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:28:39.121902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-629704b7-10a2-4e19-9d17-9f8f24150f1a req-07c18499-7646-4c54-8e0e-f91de2896e95 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:39.130529 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-629704b7-10a2-4e19-9d17-9f8f24150f1a req-07c18499-7646-4c54-8e0e-f91de2896e95 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 944 time: 0.4947686 May 12 15:28:39.195101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-77326c8d-48ac-4451-92bd-1c2778902378 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:39.196861 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-77326c8d-48ac-4451-92bd-1c2778902378 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.84 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 812 time: 0.2573137 May 12 15:28:39.273982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Request body: {'port': {'device_id': 'f9302a15-1be7-4138-a1a6-d99a3d9f7a73', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'admin_state_up': True, 'tenant_id': '011dcf6c7b624a28bb2d8ed8db38754f'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:28:39.402802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-bee48493-e971-4677-9247-0d84118613e9 req-28729a1f-96d0-46c6-95ab-ae1afd734c7a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Deleting port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:39.410244 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bee48493-e971-4677-9247-0d84118613e9 req-28729a1f-96d0-46c6-95ab-ae1afd734c7a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:39.544635 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b88304b3-e758-4b55-81a8-5db45b090c08 req-70585d59-758a-4402-82ea-2bd45da7b911 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4860642 May 12 15:28:39.557878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:39.559907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-629704b7-10a2-4e19-9d17-9f8f24150f1a req-289bc09e-314b-4cad-b848-0752c77225fd tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=fcfaf505-a043-4f21-9574-984ab7e90238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4285083 May 12 15:28:39.582109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Usage tracker for resource:port and tenant:011dcf6c7b624a28bb2d8ed8db38754f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:39.601299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:39.612693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:39.655509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Made reservation on behalf of 011dcf6c7b624a28bb2d8ed8db38754f for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:28:39.659966 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:39.789888 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:39.875997 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8bef04f0-a68b-4912-8c9c-782dec3a36b2 req-e5e4d469-8a60-43dd-8d78-6788b6c9644f tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 210 time: 0.1706970 May 12 15:28:39.892353 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-014da841-a67d-42f7-ae16-b30809df07e5 req-b84ee415-31a2-4c2b-b095-218ffce93991 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 210 time: 0.1806412 May 12 15:28:39.921235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Allocated IP 172.20.0.12 (aa894a26-e7a0-42ea-b7f1-9a9c136eacd6/0ff5192a-946b-4444-900a-788b8ddc74b6/569ebc11-2f93-40c8-8de0-286a0930ea01) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:28:39.934157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ae4095c-7026-45a8-983b-1dc89862ad1a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:39.983453 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ae4095c-7026-45a8-983b-1dc89862ad1a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.028916 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4ae4095c-7026-45a8-983b-1dc89862ad1a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d18a8f9096b94cb99933c9856d18420b&name=default HTTP/1.1" status: 200 len: 2983 time: 1.8910210 May 12 15:28:40.035630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44980) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:40.044180 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.073425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ae4095c-7026-45a8-983b-1dc89862ad1a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a12cf0cc-34de-4b2d-99b4-9112b3fe549d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:40.121131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-bee48493-e971-4677-9247-0d84118613e9 req-28729a1f-96d0-46c6-95ab-ae1afd734c7a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] For port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bdd6d277-b9d3-4e93-bfc7-66dd6ac96203,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:40.121684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bee48493-e971-4677-9247-0d84118613e9 req-28729a1f-96d0-46c6-95ab-ae1afd734c7a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.212904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 5284e633-c8cd-4179-ba2d-44d242c89b57 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:28:40.322947 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.333331 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 5284e633-c8cd-4179-ba2d-44d242c89b57 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:28:40.347018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 5284e633-c8cd-4179-ba2d-44d242c89b57 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:28:40.347388 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.354283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-bee48493-e971-4677-9247-0d84118613e9 req-28729a1f-96d0-46c6-95ab-ae1afd734c7a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Calling delete_port for bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:28:40.434430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69cad95c-b7be-4d9e-b724-32c4ac845d4a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.499104 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69cad95c-b7be-4d9e-b724-32c4ac845d4a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.548304 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.579267 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.583216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Network 19102399-18db-4840-b998-adc5bada1da0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:28:40.586771 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bee48493-e971-4677-9247-0d84118613e9 req-28729a1f-96d0-46c6-95ab-ae1afd734c7a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.607122 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:28:40.612692 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 5284e633-c8cd-4179-ba2d-44d242c89b57, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=5284e633-c8cd-4179-ba2d-44d242c89b57,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:40.619719 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '27edd0de-e2b4-4033-8918-e91ecc2405de', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5284e633-c8cd-4179-ba2d-44d242c89b57'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:40.626681 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69cad95c-b7be-4d9e-b724-32c4ac845d4a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.629863 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.665810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:28:40.672458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28729a1f-96d0-46c6-95ab-ae1afd734c7a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event deleted for resources: {'Port': ['ID=bdd6d277-b9d3-4e93-bfc7-66dd6ac96203,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:40.693005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['7e0c7266-ad09-4620-bfdc-81de7da01d15'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:28:40.801011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-bee48493-e971-4677-9247-0d84118613e9 req-28729a1f-96d0-46c6-95ab-ae1afd734c7a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] No DVR routers for this DVR port bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:28:40.806085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:40.807208 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.809715 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-bee48493-e971-4677-9247-0d84118613e9 req-28729a1f-96d0-46c6-95ab-ae1afd734c7a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.814455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4719dce9-d654-490a-915f-8e3c7942fc48', 'name': 'network-vif-deleted', 'tag': 'bdd6d277-b9d3-4e93-bfc7-66dd6ac96203'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:40.829185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69cad95c-b7be-4d9e-b724-32c4ac845d4a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a12cf0cc-34de-4b2d-99b4-9112b3fe549d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:40.831444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Pushing event updated for resources: {'Port': ['ID=79e7ee47-ef7f-4129-af14-1b599edecfb5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:40.917616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:28:40.932519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:28:40.935729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:28:40.974649 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69cad95c-b7be-4d9e-b724-32c4ac845d4a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:40.979511 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-69cad95c-b7be-4d9e-b724-32c4ac845d4a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a12cf0cc-34de-4b2d-99b4-9112b3fe549d HTTP/1.1" status: 204 len: 168 time: 0.9423153 May 12 15:28:41.004912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-39902be6-fb16-495a-828a-3e23a2eec9bc req-7487adb6-b389-4f5c-b166-9f3d31cf85ff tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Synchronizing usage tracker for tenant:6357a1184f074ce2a5b5f19b5ce06e85 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:28:41.011840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bee48493-e971-4677-9247-0d84118613e9 req-28729a1f-96d0-46c6-95ab-ae1afd734c7a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "DELETE /v2.0/ports/bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 HTTP/1.1" status: 204 len: 173 time: 1.9721396 May 12 15:28:41.051292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-39902be6-fb16-495a-828a-3e23a2eec9bc req-7487adb6-b389-4f5c-b166-9f3d31cf85ff tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Unset dirty status for tenant:6357a1184f074ce2a5b5f19b5ce06e85 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:28:41.056206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=5284e633-c8cd-4179-ba2d-44d242c89b57,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:41.058842 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-a6967eb0-914b-4ec3-a9fd-338079a8bd60 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.9976232 May 12 15:28:41.063828 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39902be6-fb16-495a-828a-3e23a2eec9bc req-7487adb6-b389-4f5c-b166-9f3d31cf85ff tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=4719dce9-d654-490a-915f-8e3c7942fc48 HTTP/1.1" status: 200 len: 210 time: 0.1219575 May 12 15:28:41.078781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Request body: {'port': {'device_id': '774b92e3-9429-4f04-94bb-bbbb9ce9acac', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:28:41.107774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f127ce5f-e178-4939-9630-1beb8321b046 req-6cd62f06-ee2e-4316-9c66-cffc1a6bf135 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:41.119880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f127ce5f-e178-4939-9630-1beb8321b046 req-6cd62f06-ee2e-4316-9c66-cffc1a6bf135 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 946 time: 0.2651994 May 12 15:28:41.191869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:41.226157 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:41.229930 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f127ce5f-e178-4939-9630-1beb8321b046 req-3e5e074a-5709-4027-9331-45f1b8765c04 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=fcfaf505-a043-4f21-9574-984ab7e90238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1088011 May 12 15:28:41.299067 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-468ad105-603a-4893-a25d-748d5fee9464'] response: {'server_uuid': '4719dce9-d654-490a-915f-8e3c7942fc48', 'name': 'network-vif-deleted', 'tag': 'bdd6d277-b9d3-4e93-bfc7-66dd6ac96203', 'status': 'completed', 'code': 200} May 12 15:28:41.301217 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-aa75a37f-6b90-4407-aed4-1d74aeb6a762'] response: {'server_uuid': '27edd0de-e2b4-4033-8918-e91ecc2405de', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5284e633-c8cd-4179-ba2d-44d242c89b57', 'code': 200} May 12 15:28:41.304012 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:28:41.453211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:28:41.456749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bdd6d277-b9d3-4e93-bfc7-66dd6ac96203 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:28:41.727788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35637268-8346-41c4-bf34-f09711472a21 req-ac3987ab-dcc6-4587-b245-49cde9533d1c tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:41.734854 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35637268-8346-41c4-bf34-f09711472a21 req-ac3987ab-dcc6-4587-b245-49cde9533d1c tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 932 time: 0.2760305 May 12 15:28:41.767694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2191478-181f-4bd2-9f69-8b9f559ebed5 req-68dfa3d2-a599-43c0-88cf-0f4a5c13251f tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:41.777060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2191478-181f-4bd2-9f69-8b9f559ebed5 req-68dfa3d2-a599-43c0-88cf-0f4a5c13251f tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 931 time: 0.2304494 May 12 15:28:41.823536 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.6057668 May 12 15:28:41.842841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c43c7a54-c8d9-4bb2-a16d-fc1b73be3374 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Pushing event updated for resources: {'Port': ['ID=569ebc11-2f93-40c8-8de0-286a0930ea01,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:41.861373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35637268-8346-41c4-bf34-f09711472a21 req-8ac9a1dc-b850-4483-9f1f-4d2aeef15a97 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1252940 May 12 15:28:41.889967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c2191478-181f-4bd2-9f69-8b9f559ebed5 req-388b398c-35fd-4c0a-8ff5-a1068e7467fd tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Synchronizing usage tracker for tenant:e1146a673b454173a1ed844897ff4119 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:28:41.908208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Request body: {'port': {'device_id': 'f9302a15-1be7-4138-a1a6-d99a3d9f7a73', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:28:41.951612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c2191478-181f-4bd2-9f69-8b9f559ebed5 req-388b398c-35fd-4c0a-8ff5-a1068e7467fd tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Unset dirty status for tenant:e1146a673b454173a1ed844897ff4119 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:28:41.961859 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2191478-181f-4bd2-9f69-8b9f559ebed5 req-388b398c-35fd-4c0a-8ff5-a1068e7467fd tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1837342 May 12 15:28:42.201495 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:42.369422 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:42.637147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-421b641a-c15c-40d2-8bec-99d805b498ac req-1413ba0e-e8b3-487d-a576-7696eecacb2a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:42.646085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-421b641a-c15c-40d2-8bec-99d805b498ac req-1413ba0e-e8b3-487d-a576-7696eecacb2a tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 946 time: 0.1710374 May 12 15:28:42.669878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0eabd93-17a7-4dd9-a0f7-c5d782bf3c36 req-f99558ed-1e66-4152-beae-ada7d1c58655 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:42.671437 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0eabd93-17a7-4dd9-a0f7-c5d782bf3c36 req-f99558ed-1e66-4152-beae-ada7d1c58655 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 1097 time: 1.0028355 May 12 15:28:42.705510 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-59c67c79-ce66-463f-bb39-e302c675cf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:42.737468 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-421b641a-c15c-40d2-8bec-99d805b498ac req-683dc5ca-b4c2-4837-9309-371c238f564b tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=fcfaf505-a043-4f21-9574-984ab7e90238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0893009 May 12 15:28:42.946050 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0eabd93-17a7-4dd9-a0f7-c5d782bf3c36 req-65a39584-a6ca-4421-83be-fea634a9414e service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=fcfaf505-a043-4f21-9574-984ab7e90238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2662098 May 12 15:28:42.986669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5488e1e6-89b7-4d51-99c7-832516529d01 req-a1490cc5-96de-4f40-bf71-71745bb04c30 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:42.998422 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5488e1e6-89b7-4d51-99c7-832516529d01 req-a1490cc5-96de-4f40-bf71-71745bb04c30 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.1358171 May 12 15:28:43.036874 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:43.074246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5488e1e6-89b7-4d51-99c7-832516529d01 req-46c95376-6302-49f9-b466-a03d14f14480 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=6129a729-7067-4e3e-90a0-194e985be9c6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0716918 May 12 15:28:43.194561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e58e77ef-75db-4dd0-a102-f7910ab19c76 req-a652294f-37b1-4153-95ae-ef188ba5b241 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:43.196280 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e58e77ef-75db-4dd0-a102-f7910ab19c76 req-a652294f-37b1-4153-95ae-ef188ba5b241 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 946 time: 0.0987484 May 12 15:28:43.196944 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:28:43.346884 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-e58e77ef-75db-4dd0-a102-f7910ab19c76 req-4a764505-55a2-4d43-a120-17fcb8a8e713 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Deleting port 7e0c7266-ad09-4620-bfdc-81de7da01d15 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:43.347396 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e58e77ef-75db-4dd0-a102-f7910ab19c76 req-4a764505-55a2-4d43-a120-17fcb8a8e713 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:43.366058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 569ebc11-2f93-40c8-8de0-286a0930ea01 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:28:43.377841 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:43.403730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Transition to ACTIVE for port object 569ebc11-2f93-40c8-8de0-286a0930ea01 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:28:43.437919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:43.627898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Pushing event updated for resources: {'Port': ['ID=569ebc11-2f93-40c8-8de0-286a0930ea01,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:43.739772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 79e7ee47-ef7f-4129-af14-1b599edecfb5 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:28:43.785991 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:43.857427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Transition to ACTIVE for port object 79e7ee47-ef7f-4129-af14-1b599edecfb5 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:28:43.870644 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:44.000628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-e58e77ef-75db-4dd0-a102-f7910ab19c76 req-4a764505-55a2-4d43-a120-17fcb8a8e713 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] For port 7e0c7266-ad09-4620-bfdc-81de7da01d15, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=7e0c7266-ad09-4620-bfdc-81de7da01d15,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:44.001779 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e58e77ef-75db-4dd0-a102-f7910ab19c76 req-4a764505-55a2-4d43-a120-17fcb8a8e713 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:44.167099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f69ad98-3dcd-4761-9f14-9b3aec23196e req-ae9bc887-bea7-41da-a7a2-bbe4d7e446f8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:44.168628 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f69ad98-3dcd-4761-9f14-9b3aec23196e req-ae9bc887-bea7-41da-a7a2-bbe4d7e446f8 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 932 time: 0.9713652 May 12 15:28:44.175613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-e58e77ef-75db-4dd0-a102-f7910ab19c76 req-4a764505-55a2-4d43-a120-17fcb8a8e713 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Calling delete_port for 7e0c7266-ad09-4620-bfdc-81de7da01d15 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:28:44.270994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f69ad98-3dcd-4761-9f14-9b3aec23196e req-4e7365c8-3dda-4b9e-ae64-e98aca002089 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665960 May 12 15:28:44.311611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Pushing event updated for resources: {'Port': ['ID=79e7ee47-ef7f-4129-af14-1b599edecfb5,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:44.359371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:44.359708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:44.360203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:44.360909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:44.362935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:44.363415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:44.363904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:44.364404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:44.364876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:44.367201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:44.368997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:44.369508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:44.386199 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Attempting to bind port 569ebc11-2f93-40c8-8de0-286a0930ea01 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:28:44.386825 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Attempting to bind port 569ebc11-2f93-40c8-8de0-286a0930ea01 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:28:44.387352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Attempting to bind port 569ebc11-2f93-40c8-8de0-286a0930ea01 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:28:44.398879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Port 569ebc11-2f93-40c8-8de0-286a0930ea01 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:28:44.399805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Attempting to bind port 569ebc11-2f93-40c8-8de0-286a0930ea01 on network aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:28:44.418601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 28, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:28:44.418935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Checking segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:28:44.422257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Bound using segment: {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:28:44.432263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Bound port: 569ebc11-2f93-40c8-8de0-286a0930ea01, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '70920b24-31ad-40cc-b105-d50702bf12f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 573, 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:28:44.441093 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:44.617733 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e58e77ef-75db-4dd0-a102-f7910ab19c76 req-4a764505-55a2-4d43-a120-17fcb8a8e713 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:44.686446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dc9abeb-ae1e-4712-a7b8-7d7adc8d2ef1 req-ff962c1c-e3c4-4c32-bfef-d9af9b825f2b tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:44.688372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0dc9abeb-ae1e-4712-a7b8-7d7adc8d2ef1 req-ff962c1c-e3c4-4c32-bfef-d9af9b825f2b tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 943 time: 0.2482154 May 12 15:28:44.691813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a764505-55a2-4d43-a120-17fcb8a8e713 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event deleted for resources: {'Port': ['ID=7e0c7266-ad09-4620-bfdc-81de7da01d15,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:44.699185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] For port 569ebc11-2f93-40c8-8de0-286a0930ea01, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:28:44.725607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] For port 569ebc11-2f93-40c8-8de0-286a0930ea01, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=569ebc11-2f93-40c8-8de0-286a0930ea01,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:28:44.765664 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:44.839401 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1daea8ef-8fff-473c-a481-406221e259fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:44.877066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4589ea47-cb85-4e93-8d4f-25c0cfe34476 req-64a44ab9-35a3-4ccf-b83a-98c8c6542672 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:44.895263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4589ea47-cb85-4e93-8d4f-25c0cfe34476 req-64a44ab9-35a3-4ccf-b83a-98c8c6542672 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 946 time: 0.4075582 May 12 15:28:44.900681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-e58e77ef-75db-4dd0-a102-f7910ab19c76 req-4a764505-55a2-4d43-a120-17fcb8a8e713 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] No DVR routers for this DVR port 7e0c7266-ad09-4620-bfdc-81de7da01d15 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:28:44.906398 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e58e77ef-75db-4dd0-a102-f7910ab19c76 req-4a764505-55a2-4d43-a120-17fcb8a8e713 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:44.919531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7e3b9823-cd1e-48ee-8ba8-507d787c43bb', 'name': 'network-vif-deleted', 'tag': '7e0c7266-ad09-4620-bfdc-81de7da01d15'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:45.026013 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0dc9abeb-ae1e-4712-a7b8-7d7adc8d2ef1 req-44fc34b1-2828-4701-850d-576d035ce9a3 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2765672 May 12 15:28:45.074792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Attempting to bind port 79e7ee47-ef7f-4129-af14-1b599edecfb5 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:28:45.075367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Attempting to bind port 79e7ee47-ef7f-4129-af14-1b599edecfb5 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '3307f62e-6977-4a8d-852e-31dcfd97c476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '19102399-18db-4840-b998-adc5bada1da0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:28:45.075926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Attempting to bind port 79e7ee47-ef7f-4129-af14-1b599edecfb5 on network 19102399-18db-4840-b998-adc5bada1da0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:28:45.082640 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4589ea47-cb85-4e93-8d4f-25c0cfe34476 req-c1f9d982-578f-4cc8-a5e3-6e2a0cf8fbf2 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=fcfaf505-a043-4f21-9574-984ab7e90238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1650014 May 12 15:28:45.093727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Port 79e7ee47-ef7f-4129-af14-1b599edecfb5 on network 19102399-18db-4840-b998-adc5bada1da0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:28:45.093727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Attempting to bind port 79e7ee47-ef7f-4129-af14-1b599edecfb5 on network 19102399-18db-4840-b998-adc5bada1da0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:28:45.120535 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e58e77ef-75db-4dd0-a102-f7910ab19c76 req-4a764505-55a2-4d43-a120-17fcb8a8e713 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "DELETE /v2.0/ports/7e0c7266-ad09-4620-bfdc-81de7da01d15 HTTP/1.1" status: 204 len: 173 time: 1.8765199 May 12 15:28:45.133846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 28, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:28:45.134371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Checking segment: {'id': '3307f62e-6977-4a8d-852e-31dcfd97c476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '19102399-18db-4840-b998-adc5bada1da0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:28:45.135031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Bound using segment: {'id': '3307f62e-6977-4a8d-852e-31dcfd97c476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '19102399-18db-4840-b998-adc5bada1da0'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:28:45.135670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Bound port: 79e7ee47-ef7f-4129-af14-1b599edecfb5, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3307f62e-6977-4a8d-852e-31dcfd97c476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '19102399-18db-4840-b998-adc5bada1da0'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:28:45.138498 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:45.160547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Pushing event updated for resources: {'Port': ['ID=569ebc11-2f93-40c8-8de0-286a0930ea01,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:45.188129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:45.188965 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:45.191737 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d78b2916-1718-4017-8d9b-ed8bb3042f32 service neutron] 10.222.0.84 "PUT /v2.0/ports/569ebc11-2f93-40c8-8de0-286a0930ea01 HTTP/1.1" status: 200 len: 1092 time: 3.3156464 May 12 15:28:45.209884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9302a15-1be7-4138-a1a6-d99a3d9f7a73', 'tag': '569ebc11-2f93-40c8-8de0-286a0930ea01'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:45.288634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 7e0c7266-ad09-4620-bfdc-81de7da01d15 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:28:45.322408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1ffae791-c32f-48e8-bf08-f3b39f03b411 req-5a9334ac-02e8-4504-83ba-5b9ac483a58d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Synchronizing usage tracker for tenant:6357a1184f074ce2a5b5f19b5ce06e85 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:28:45.449669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1ffae791-c32f-48e8-bf08-f3b39f03b411 req-5a9334ac-02e8-4504-83ba-5b9ac483a58d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Unset dirty status for tenant:6357a1184f074ce2a5b5f19b5ce06e85 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:28:45.461129 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ffae791-c32f-48e8-bf08-f3b39f03b411 req-5a9334ac-02e8-4504-83ba-5b9ac483a58d tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=7e3b9823-cd1e-48ee-8ba8-507d787c43bb HTTP/1.1" status: 200 len: 210 time: 0.2744105 May 12 15:28:45.488823 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 7e0c7266-ad09-4620-bfdc-81de7da01d15 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:28:45.492592 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-aa9eadf4-2cf3-4a4d-886c-ab3555de86a8'] response: {'server_uuid': '7e3b9823-cd1e-48ee-8ba8-507d787c43bb', 'name': 'network-vif-deleted', 'tag': '7e0c7266-ad09-4620-bfdc-81de7da01d15', 'status': 'completed', 'code': 200} May 12 15:28:45.493749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 7e0c7266-ad09-4620-bfdc-81de7da01d15 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:28:45.601984 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-70e50588-7892-4dac-8e26-2578a8fbf468'] response: {'name': 'network-changed', 'server_uuid': 'f9302a15-1be7-4138-a1a6-d99a3d9f7a73', 'tag': '569ebc11-2f93-40c8-8de0-286a0930ea01', 'status': 'completed', 'code': 200} May 12 15:28:45.627521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] For port 79e7ee47-ef7f-4129-af14-1b599edecfb5, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:28:45.648652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] For port 79e7ee47-ef7f-4129-af14-1b599edecfb5, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=79e7ee47-ef7f-4129-af14-1b599edecfb5,segment=NetworkSegment(3307f62e-6977-4a8d-852e-31dcfd97c476),segment_id=3307f62e-6977-4a8d-852e-31dcfd97c476)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:28:45.660998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:45.746589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:45.747212 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:45.748603 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] 10.222.0.76 "PUT /v2.0/ports/79e7ee47-ef7f-4129-af14-1b599edecfb5 HTTP/1.1" status: 200 len: 1091 time: 4.6778331 May 12 15:28:45.782882 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-02435487-0e4d-4909-87f2-27accc84a0cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:45.784271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-02435487-0e4d-4909-87f2-27accc84a0cd service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 1095 time: 0.2716155 May 12 15:28:45.844611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebc81804-bf2d-4561-9318-a705e0a9794d req-ccbb64c8-990a-4d4e-8d03-d6b39ba1ef69 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:45.847412 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ebc81804-bf2d-4561-9318-a705e0a9794d req-ccbb64c8-990a-4d4e-8d03-d6b39ba1ef69 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 946 time: 0.1948459 May 12 15:28:45.886671 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45166) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:45.900017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-969e17be-a98d-4d2b-917d-bfae52d7f4b3 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Request body: {'floatingip': {'port_id': '5284e633-c8cd-4179-ba2d-44d242c89b57'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:28:45.939770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-120d339d-73ec-4412-a8fb-238c06a46246 service neutron] Pushing event updated for resources: {'Port': ['ID=79e7ee47-ef7f-4129-af14-1b599edecfb5,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:45.954711 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-d23872c0-07c4-4bea-885f-6b7e15d79ee1 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=569ebc11-2f93-40c8-8de0-286a0930ea01 HTTP/1.1" status: 200 len: 217 time: 0.1221383 May 12 15:28:46.026967 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:46.044640 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-969e17be-a98d-4d2b-917d-bfae52d7f4b3 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:46.049835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-578a1d6f-d88e-498e-b3f8-60aa354426f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:46.052274 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-578a1d6f-d88e-498e-b3f8-60aa354426f4 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=e1146a673b454173a1ed844897ff4119&device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 1094 time: 0.2629833 May 12 15:28:46.053953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-fbf3722f-664b-463a-aca5-128bdf9118f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:46.055584 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-fbf3722f-664b-463a-aca5-128bdf9118f9 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.0831747 May 12 15:28:46.128390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa571e98-fa0a-473f-9aa3-8588214a9943 req-8d6b32f1-5eaa-4f48-ad6e-feb336a80620 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:46.136493 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa571e98-fa0a-473f-9aa3-8588214a9943 req-8d6b32f1-5eaa-4f48-ad6e-feb336a80620 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 944 time: 0.4252758 May 12 15:28:46.161234 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:46.239705 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-cb0979e6-1921-4410-af36-27ab6e4a493c service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=79e7ee47-ef7f-4129-af14-1b599edecfb5 HTTP/1.1" status: 200 len: 217 time: 0.1802166 May 12 15:28:46.242525 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-f899b6cf-f18d-4813-afeb-c8c2c0461b2c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1152878 May 12 15:28:46.394441 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa571e98-fa0a-473f-9aa3-8588214a9943 req-ae3a27ff-46dc-4d7c-ac69-aff3b8504fc3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2566559 May 12 15:28:46.463021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-514f3c96-d6c0-457a-9bdc-8a2fb2e2cfcc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:46.464728 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-514f3c96-d6c0-457a-9bdc-8a2fb2e2cfcc service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5191993e-726b-4897-9b02-25fe32b3009b HTTP/1.1" status: 200 len: 853 time: 0.2145295 May 12 15:28:46.556683 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-25c7ba17-a5e4-4ec5-aebb-794042577913 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=19102399-18db-4840-b998-adc5bada1da0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0845203 May 12 15:28:46.722867 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-a6c165c6-298b-4500-9c20-cd8fffbf9989 service neutron] 10.222.0.84 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4173720 May 12 15:28:46.762900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b71d54c-127c-498b-a581-84f4d4567c00 req-82ff3889-cdc7-439e-951d-e37fc8bc1e2d tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:46.775922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7b71d54c-127c-498b-a581-84f4d4567c00 req-82ff3889-cdc7-439e-951d-e37fc8bc1e2d tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 943 time: 0.4816222 May 12 15:28:46.917857 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-ce2444b3-2fed-4832-a210-9374349c5e92 service neutron] 10.222.0.76 "GET /v2.0/networks/19102399-18db-4840-b998-adc5bada1da0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3551860 May 12 15:28:46.958679 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a34ce0a3-dd7b-4d97-9bfc-47d88a847ce5 req-da62c0ca-c2b1-4a24-bab6-ef76d1a090db service neutron] 10.222.0.84 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2268841 May 12 15:28:47.129366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7b71d54c-127c-498b-a581-84f4d4567c00 req-f589b49a-efcb-4d98-a440-218b9844629a tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3525538 May 12 15:28:47.309406 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6b3f6b85-84da-4d46-8db6-1358d3af8e31 req-bc890ced-a502-4654-ba8e-3324030c0870 service neutron] 10.222.0.76 "GET /v2.0/networks/19102399-18db-4840-b998-adc5bada1da0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3825493 May 12 15:28:47.394164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd562418-32a6-48d0-934d-c1e596f3bd1c req-eedbc039-4dfd-492f-aee6-d99220259a68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:47.401767 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd562418-32a6-48d0-934d-c1e596f3bd1c req-eedbc039-4dfd-492f-aee6-d99220259a68 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 1095 time: 0.2918775 May 12 15:28:47.604541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '774b92e3-9429-4f04-94bb-bbbb9ce9acac', 'tag': '79e7ee47-ef7f-4129-af14-1b599edecfb5'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:47.658981 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:47.762125 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-969e17be-a98d-4d2b-917d-bfae52d7f4b3 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:47.774973 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-969e17be-a98d-4d2b-917d-bfae52d7f4b3 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:47.779351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd562418-32a6-48d0-934d-c1e596f3bd1c req-0624f79f-0c1f-45e4-9c41-e15c6684473b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:47.780899 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd562418-32a6-48d0-934d-c1e596f3bd1c req-0624f79f-0c1f-45e4-9c41-e15c6684473b service neutron] 10.222.0.84 "GET /v2.0/networks?id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 200 len: 913 time: 0.3759835 May 12 15:28:47.945133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-254a1271-3907-4964-a54b-a28ec71f4d38 req-c4e1691a-c602-480f-a991-625b92db0b2b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:47.954184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-254a1271-3907-4964-a54b-a28ec71f4d38 req-c4e1691a-c602-480f-a991-625b92db0b2b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 944 time: 0.3116522 May 12 15:28:48.045596 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd562418-32a6-48d0-934d-c1e596f3bd1c req-9bee4e5d-9c0f-4c0c-b2e0-0420f8fa7a91 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=569ebc11-2f93-40c8-8de0-286a0930ea01 HTTP/1.1" status: 200 len: 217 time: 0.2544498 May 12 15:28:48.098141 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-254a1271-3907-4964-a54b-a28ec71f4d38 req-0e635572-be43-4c2a-904d-a54f22520166 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1425476 May 12 15:28:48.142462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45240) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:48.179489 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bacb94cf-dd87-478e-b1fc-4c4a86ce9d32'] response: {'name': 'network-changed', 'server_uuid': '774b92e3-9429-4f04-94bb-bbbb9ce9acac', 'tag': '79e7ee47-ef7f-4129-af14-1b599edecfb5', 'status': 'completed', 'code': 200} May 12 15:28:48.198270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd562418-32a6-48d0-934d-c1e596f3bd1c req-df3fc36f-09da-46e1-b63d-4c893461350e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:48.200557 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd562418-32a6-48d0-934d-c1e596f3bd1c req-df3fc36f-09da-46e1-b63d-4c893461350e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 200 len: 852 time: 0.1465392 May 12 15:28:48.218518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e0808e-5029-43bf-ba67-2edfd91d1e06 req-95e6f473-bcac-43c2-8aa9-c1e7384202b8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:48.220034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7e0808e-5029-43bf-ba67-2edfd91d1e06 req-95e6f473-bcac-43c2-8aa9-c1e7384202b8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.3763957 May 12 15:28:48.243629 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-969e17be-a98d-4d2b-917d-bfae52d7f4b3 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Floating IP 3fc00e80-ba04-4a2e-9c0f-064c15a0b77d associated. External IP: 172.25.8.55, port: 5284e633-c8cd-4179-ba2d-44d242c89b57. May 12 15:28:48.424438 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd562418-32a6-48d0-934d-c1e596f3bd1c req-04f74b26-ab42-45b1-b262-f02c4e6f5f25 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1420596 May 12 15:28:48.441688 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b245a96-5c4c-405f-ba19-f4d7d1fdd51f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:48.513977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8b245a96-5c4c-405f-ba19-f4d7d1fdd51f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:48.519781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8b245a96-5c4c-405f-ba19-f4d7d1fdd51f admin admin] Usage tracker for resource:security_group_rule and tenant:3576c6856dae489da5335776dd07db5e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:48.526613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8b245a96-5c4c-405f-ba19-f4d7d1fdd51f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:48.533938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8b245a96-5c4c-405f-ba19-f4d7d1fdd51f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:48.596397 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7e0808e-5029-43bf-ba67-2edfd91d1e06 req-d8f84edd-86c8-4032-b23f-ad69b1117d28 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3544185 May 12 15:28:48.685304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d501e02-4f4c-4df9-b45e-5bb721bf068f req-9952d24b-5ced-4038-92db-8ac46edeacff tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:48.693131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d501e02-4f4c-4df9-b45e-5bb721bf068f req-9952d24b-5ced-4038-92db-8ac46edeacff tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 943 time: 0.3337548 May 12 15:28:48.715574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d723202-0cbf-4018-8d2d-b948293b8662 req-5a49ed18-6276-4a7f-834c-3053272f7e9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:48.715881 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d723202-0cbf-4018-8d2d-b948293b8662 req-5a49ed18-6276-4a7f-834c-3053272f7e9e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=e1146a673b454173a1ed844897ff4119&device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 1094 time: 0.5142040 May 12 15:28:48.828541 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd562418-32a6-48d0-934d-c1e596f3bd1c req-9fbe5b39-68cf-4dd1-b1f9-f0ce1f630126 service neutron] 10.222.0.84 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3896587 May 12 15:28:48.995119 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b245a96-5c4c-405f-ba19-f4d7d1fdd51f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:49.054601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-969e17be-a98d-4d2b-917d-bfae52d7f4b3 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:28:49.063198 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b245a96-5c4c-405f-ba19-f4d7d1fdd51f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:49.070523 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d501e02-4f4c-4df9-b45e-5bb721bf068f req-b5577a91-6e37-46b0-bf28-e39035e10a53 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3755116 May 12 15:28:49.168282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d723202-0cbf-4018-8d2d-b948293b8662 req-1dc6abc8-4967-422d-8cda-58ad6f774cf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:49.169980 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d723202-0cbf-4018-8d2d-b948293b8662 req-1dc6abc8-4967-422d-8cda-58ad6f774cf1 service neutron] 10.222.0.76 "GET /v2.0/networks?id=19102399-18db-4840-b998-adc5bada1da0 HTTP/1.1" status: 200 len: 914 time: 0.4474156 May 12 15:28:49.296201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 569ebc11-2f93-40c8-8de0-286a0930ea01 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:28:49.309954 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8b245a96-5c4c-405f-ba19-f4d7d1fdd51f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3576c6856dae489da5335776dd07db5e&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1661994 May 12 15:28:49.310742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b245a96-5c4c-405f-ba19-f4d7d1fdd51f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cbe1ab7a-5e89-4858-9dcf-90041d81e673,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:49.313168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45270) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:49.319070 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d723202-0cbf-4018-8d2d-b948293b8662 req-2da1fb23-18d4-4283-862d-3e71a0d36e1d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=79e7ee47-ef7f-4129-af14-1b599edecfb5 HTTP/1.1" status: 200 len: 217 time: 0.1223013 May 12 15:28:49.421640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d723202-0cbf-4018-8d2d-b948293b8662 req-3da3a42c-3b66-40c3-b05c-722ac1ddf656 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:49.423075 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d723202-0cbf-4018-8d2d-b948293b8662 req-3da3a42c-3b66-40c3-b05c-722ac1ddf656 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5191993e-726b-4897-9b02-25fe32b3009b HTTP/1.1" status: 200 len: 853 time: 0.0914998 May 12 15:28:49.472551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 569ebc11-2f93-40c8-8de0-286a0930ea01, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=569ebc11-2f93-40c8-8de0-286a0930ea01,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:49.492581 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '569ebc11-2f93-40c8-8de0-286a0930ea01', 'network_id': 'aa894a26-e7a0-42ea-b7f1-9a9c136eacd6', 'port_id': '569ebc11-2f93-40c8-8de0-286a0930ea01', 'mac_address': 'fa:16:3e:6f:60:f5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 573, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0ff5192a-946b-4444-900a-788b8ddc74b6', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:28:49.533331 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd562418-32a6-48d0-934d-c1e596f3bd1c req-17d5b6de-5a06-48e1-b83c-65a45fc4c62f service neutron] 10.222.0.84 "GET /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6936324 May 12 15:28:49.535373 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d723202-0cbf-4018-8d2d-b948293b8662 req-9fef2d87-b583-4c22-8929-08a051abf9cc service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=19102399-18db-4840-b998-adc5bada1da0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1003740 May 12 15:28:49.595659 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:49.633881 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 569ebc11-2f93-40c8-8de0-286a0930ea01 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:28:49.664837 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 569ebc11-2f93-40c8-8de0-286a0930ea01, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=569ebc11-2f93-40c8-8de0-286a0930ea01,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:49.670354 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-43488c80-cf6c-4be2-838d-78eeb76827f8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:49.680653 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:49.682577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-969e17be-a98d-4d2b-917d-bfae52d7f4b3 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:28:49.699484 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-969e17be-a98d-4d2b-917d-bfae52d7f4b3 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:49.720028 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-43488c80-cf6c-4be2-838d-78eeb76827f8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:49.745904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e342fcd6-dd00-4a59-b95a-0ade612402dc req-85b100bc-f472-495e-b548-04cebdb39df2 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:49.753875 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e342fcd6-dd00-4a59-b95a-0ade612402dc req-85b100bc-f472-495e-b548-04cebdb39df2 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 944 time: 0.3923407 May 12 15:28:49.770178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ab0d099-66d3-4cbd-bd3d-e7044015e8fa None None] Sync routers for ids ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:28:49.775634 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d723202-0cbf-4018-8d2d-b948293b8662 req-dc9b6a92-99ab-42f3-83f4-07838cceb094 service neutron] 10.222.0.76 "GET /v2.0/networks/19102399-18db-4840-b998-adc5bada1da0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2329531 May 12 15:28:49.797395 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ab0d099-66d3-4cbd-bd3d-e7044015e8fa None None] Routers {'0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:28:49.798029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9ab0d099-66d3-4cbd-bd3d-e7044015e8fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:28:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:49.823150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-fc4f1993-b616-48c4-9f23-51113267d58e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:49.825454 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-fc4f1993-b616-48c4-9f23-51113267d58e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.4652228 May 12 15:28:49.884200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=569ebc11-2f93-40c8-8de0-286a0930ea01,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:49.898177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:49.898575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:49.898964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:49.899938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:49.899938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:49.899938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:49.900705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:49.900705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:49.900849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:49.901133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:49.901524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:49.901832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:49.911700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-43488c80-cf6c-4be2-838d-78eeb76827f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:49.930345 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-969e17be-a98d-4d2b-917d-bfae52d7f4b3 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "PUT /v2.0/floatingips/3fc00e80-ba04-4a2e-9c0f-064c15a0b77d HTTP/1.1" status: 200 len: 991 time: 4.0393183 May 12 15:28:49.955653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '27edd0de-e2b4-4033-8918-e91ecc2405de', 'tag': '5284e633-c8cd-4179-ba2d-44d242c89b57'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:49.962225 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-43488c80-cf6c-4be2-838d-78eeb76827f8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:49.963706 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-43488c80-cf6c-4be2-838d-78eeb76827f8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cbe1ab7a-5e89-4858-9dcf-90041d81e673 HTTP/1.1" status: 204 len: 168 time: 0.6473660 May 12 15:28:49.964716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43488c80-cf6c-4be2-838d-78eeb76827f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cbe1ab7a-5e89-4858-9dcf-90041d81e673,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:49.998003 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d723202-0cbf-4018-8d2d-b948293b8662 req-afb8a840-28d8-4812-a345-d537c00337d1 service neutron] 10.222.0.76 "GET /v2.0/networks/19102399-18db-4840-b998-adc5bada1da0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2136579 May 12 15:28:50.071263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-9ab0d099-66d3-4cbd-bd3d-e7044015e8fa None None] Set router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:28:50.074395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Deleting port 860dc344-70ad-4ff8-9592-ee8e988a4f26 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:50.074740 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:50.119305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e342fcd6-dd00-4a59-b95a-0ade612402dc req-d6f95bd2-584e-402c-a62d-f470531bae10 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3642900 May 12 15:28:50.242562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1324759-8be6-4a11-bb5d-4789be8e207a req-5a09a10c-dc7b-4bbb-af8b-111a0599d283 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:50.244084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1324759-8be6-4a11-bb5d-4789be8e207a req-5a09a10c-dc7b-4bbb-af8b-111a0599d283 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.4809411 May 12 15:28:50.261690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['569ebc11-2f93-40c8-8de0-286a0930ea01'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:28:50.337191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 79e7ee47-ef7f-4129-af14-1b599edecfb5 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:28:50.410702 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e442d807-da23-43ac-82ff-5c0c83233607'] response: {'name': 'network-changed', 'server_uuid': '27edd0de-e2b4-4033-8918-e91ecc2405de', 'tag': '5284e633-c8cd-4179-ba2d-44d242c89b57', 'status': 'completed', 'code': 200} May 12 15:28:50.441653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6287a52-2e14-4dd0-85d8-591704cca7dc req-c0af9e4e-2b09-4c55-85cc-f370a19caeef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:50.444013 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a6287a52-2e14-4dd0-85d8-591704cca7dc req-c0af9e4e-2b09-4c55-85cc-f370a19caeef service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=f4660a6351274a7796c2eb1e55a41ec9&device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 1097 time: 0.1237032 May 12 15:28:50.452546 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1324759-8be6-4a11-bb5d-4789be8e207a req-32facd93-83ca-4d35-9826-00cc79c973b6 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1918485 May 12 15:28:50.617323 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45310) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:50.663650 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a9b12ef5-535e-43b5-9f99-519c2cc2b0e9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:50.686411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6287a52-2e14-4dd0-85d8-591704cca7dc req-127199e4-d6b1-463a-86c4-7ab68a1d33f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:50.688347 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a6287a52-2e14-4dd0-85d8-591704cca7dc req-127199e4-d6b1-463a-86c4-7ab68a1d33f7 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e1655f9a-2478-49d5-a6ca-4fec717d6816 HTTP/1.1" status: 200 len: 912 time: 0.2375610 May 12 15:28:50.703350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a9b12ef5-535e-43b5-9f99-519c2cc2b0e9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:50.708267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a9b12ef5-535e-43b5-9f99-519c2cc2b0e9 admin admin] Usage tracker for resource:security_group_rule and tenant:2f1198523588465b8aabe1b1756fae87 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:50.712411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a9b12ef5-535e-43b5-9f99-519c2cc2b0e9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:50.718501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a9b12ef5-535e-43b5-9f99-519c2cc2b0e9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:50.955180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] For port 860dc344-70ad-4ff8-9592-ee8e988a4f26, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=860dc344-70ad-4ff8-9592-ee8e988a4f26,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:50.955536 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:50.987578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 79e7ee47-ef7f-4129-af14-1b599edecfb5, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=79e7ee47-ef7f-4129-af14-1b599edecfb5,segment=NetworkSegment(3307f62e-6977-4a8d-852e-31dcfd97c476),segment_id=3307f62e-6977-4a8d-852e-31dcfd97c476)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:51.010576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebd9d8e-dc5d-4e76-9c43-ff5b9bdbb780 req-2f6689e0-04a7-42a8-a506-cce5425746fc tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:51.012055 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ebd9d8e-dc5d-4e76-9c43-ff5b9bdbb780 req-2f6689e0-04a7-42a8-a506-cce5425746fc tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 943 time: 0.4606390 May 12 15:28:51.025215 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a6287a52-2e14-4dd0-85d8-591704cca7dc req-ce56fd99-3603-49fa-9bce-916a97018507 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5284e633-c8cd-4179-ba2d-44d242c89b57 HTTP/1.1" status: 200 len: 999 time: 0.3302484 May 12 15:28:51.058035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '79e7ee47-ef7f-4129-af14-1b599edecfb5', 'network_id': '19102399-18db-4840-b998-adc5bada1da0', 'port_id': '79e7ee47-ef7f-4129-af14-1b599edecfb5', 'mac_address': 'fa:16:3e:fd:3d:c4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 589, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5191993e-726b-4897-9b02-25fe32b3009b', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:28:51.128544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6287a52-2e14-4dd0-85d8-591704cca7dc req-5449aa99-c1bc-48d6-816f-b0573e47bd15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:51.130493 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a6287a52-2e14-4dd0-85d8-591704cca7dc req-5449aa99-c1bc-48d6-816f-b0573e47bd15 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=83787d82-d8a5-4f12-a025-f44dcf581189 HTTP/1.1" status: 200 len: 850 time: 0.0988212 May 12 15:28:51.171585 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:51.190055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a9b12ef5-535e-43b5-9f99-519c2cc2b0e9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:51.198670 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 79e7ee47-ef7f-4129-af14-1b599edecfb5 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:28:51.200323 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a9b12ef5-535e-43b5-9f99-519c2cc2b0e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:51.226635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 79e7ee47-ef7f-4129-af14-1b599edecfb5, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=79e7ee47-ef7f-4129-af14-1b599edecfb5,segment=NetworkSegment(3307f62e-6977-4a8d-852e-31dcfd97c476),segment_id=3307f62e-6977-4a8d-852e-31dcfd97c476)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:51.256149 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:51.270524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6287a52-2e14-4dd0-85d8-591704cca7dc req-13921a07-7d2c-41a4-900d-06945301b012 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:51.272622 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a6287a52-2e14-4dd0-85d8-591704cca7dc req-13921a07-7d2c-41a4-900d-06945301b012 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e1655f9a-2478-49d5-a6ca-4fec717d6816&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1343720 May 12 15:28:51.325448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 860dc344-70ad-4ff8-9592-ee8e988a4f26 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:28:51.473287 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a9b12ef5-535e-43b5-9f99-519c2cc2b0e9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2f1198523588465b8aabe1b1756fae87&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8523550 May 12 15:28:51.473287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9b12ef5-535e-43b5-9f99-519c2cc2b0e9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f59ba0b3-9630-458c-aefd-b77daaf2a3b1,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:51.499240 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9ab0d099-66d3-4cbd-bd3d-e7044015e8fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '3fc00e80-ba04-4a2e-9c0f-064c15a0b77d', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'port_id': '5284e633-c8cd-4179-ba2d-44d242c89b57', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 2020, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'mac_address': 'fa:16:3e:53:ca:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27edd0de-e2b4-4033-8918-e91ecc2405de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:28:19Z', 'updated_at': '2022-05-12T15:28:47Z', 'revision_number': 1, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:45Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:51.515718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ab0d099-66d3-4cbd-bd3d-e7044015e8fa None None] Checking router: 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:28:51.526613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45328) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:51.528415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=79e7ee47-ef7f-4129-af14-1b599edecfb5,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:51.538780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['79e7ee47-ef7f-4129-af14-1b599edecfb5'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:28:51.559662 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a6287a52-2e14-4dd0-85d8-591704cca7dc req-f91567a6-ae3a-4054-9be6-bf1c65bfc19f service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2808499 May 12 15:28:51.564900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ebd9d8e-dc5d-4e76-9c43-ff5b9bdbb780 req-aeb38648-8534-459d-849a-c1b27e61a95d tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5376258 May 12 15:28:51.735337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ab0d099-66d3-4cbd-bd3d-e7044015e8fa None None] Routers {'0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:28:51.736229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9ab0d099-66d3-4cbd-bd3d-e7044015e8fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:28:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:51.848485 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a6287a52-2e14-4dd0-85d8-591704cca7dc req-1700fb90-5620-4c9c-bd55-6a70f65f422c service neutron] 10.222.0.76 "GET /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2728789 May 12 15:28:51.900859 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:51.901543 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:51.901649 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Floating IP 7802e753-504f-4f2e-b585-7d53d932b7ae disassociated. External IP: 172.25.8.158, port: 860dc344-70ad-4ff8-9592-ee8e988a4f26. May 12 15:28:51.902073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Calling delete_port for 860dc344-70ad-4ff8-9592-ee8e988a4f26 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:28:52.074276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-9ab0d099-66d3-4cbd-bd3d-e7044015e8fa None None] Set router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:28:52.100549 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:52.129429 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:52.230858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59029d42-1c4c-46d8-9c32-a249a5a83947 req-882eb473-e346-487b-ba09-deefdb21013c tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:52.232785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59029d42-1c4c-46d8-9c32-a249a5a83947 req-882eb473-e346-487b-ba09-deefdb21013c tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 945 time: 0.7523320 May 12 15:28:52.338371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203da5b6-76ea-4b55-8711-c062510f92d4 req-514b993b-407c-4886-99a2-60c0d478f324 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:52.340130 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-203da5b6-76ea-4b55-8711-c062510f92d4 req-514b993b-407c-4886-99a2-60c0d478f324 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 944 time: 0.5399535 May 12 15:28:52.354476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59029d42-1c4c-46d8-9c32-a249a5a83947 req-47beca19-ead5-4bbf-a5cb-b9105f2ec5ae tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1136398 May 12 15:28:52.393295 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:52.454226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f59ba0b3-9630-458c-aefd-b77daaf2a3b1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:52.499403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:52.499403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:52.499403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:52.499643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:52.500638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:52.500638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:52.500638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:52.500862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:52.501831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:52.502371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:52.502863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:52.503206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:28:52.555020 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-203da5b6-76ea-4b55-8711-c062510f92d4 req-33e3f051-ad27-4fc4-9a65-fc78f1ec39e8 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b49946f-705a-41e4-a057-53a4ddde6ae4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2038362 May 12 15:28:52.556025 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:52.557184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e9fa54e0-45f5-4797-a884-1f4830cc397f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f59ba0b3-9630-458c-aefd-b77daaf2a3b1 HTTP/1.1" status: 204 len: 168 time: 1.0298667 May 12 15:28:52.558035 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:52.645641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event deleted for resources: {'Port': ['ID=860dc344-70ad-4ff8-9592-ee8e988a4f26,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:52.733432 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9ab0d099-66d3-4cbd-bd3d-e7044015e8fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '3fc00e80-ba04-4a2e-9c0f-064c15a0b77d', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'port_id': '5284e633-c8cd-4179-ba2d-44d242c89b57', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 2020, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'mac_address': 'fa:16:3e:53:ca:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27edd0de-e2b4-4033-8918-e91ecc2405de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:28:19Z', 'updated_at': '2022-05-12T15:28:47Z', 'revision_number': 1, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:45Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:52.741466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ab0d099-66d3-4cbd-bd3d-e7044015e8fa None None] The sync data for ids ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'] in n-d-841483-1 is: [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '3fc00e80-ba04-4a2e-9c0f-064c15a0b77d', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'port_id': '5284e633-c8cd-4179-ba2d-44d242c89b57', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 2020, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'mac_address': 'fa:16:3e:53:ca:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27edd0de-e2b4-4033-8918-e91ecc2405de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:28:19Z', 'updated_at': '2022-05-12T15:28:47Z', 'revision_number': 1, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:45Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:28:53.016365 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:28:53.032395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee7697d-c96e-4d23-8349-52e1d2941111 req-eb29a2fd-fc5f-4947-8ba3-0cd7d5e1576c tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:53.046360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ee7697d-c96e-4d23-8349-52e1d2941111 req-eb29a2fd-fc5f-4947-8ba3-0cd7d5e1576c tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 944 time: 0.2574584 May 12 15:28:53.128547 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2486b034-3bf4-4e2b-8b16-3e6e73d6f41d None None] New status for floating IP 3fc00e80-ba04-4a2e-9c0f-064c15a0b77d: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:28:53.284290 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ee7697d-c96e-4d23-8349-52e1d2941111 req-526fc3b6-4cf3-4d63-b316-24087f48b7d5 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2368197 May 12 15:28:53.315536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 569ebc11-2f93-40c8-8de0-286a0930ea01 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:28:53.494507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:28:53.512418 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b8060fb-88e7-41e4-b579-ee1534bc1d8c None None] Sync routers for ids ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:28:53.565848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b8060fb-88e7-41e4-b579-ee1534bc1d8c None None] Routers {'bac46c5e-a9b9-49a6-89a8-7b3f401caed2'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:28:53.566208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-7b8060fb-88e7-41e4-b579-ee1534bc1d8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:28:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:53.711483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 569ebc11-2f93-40c8-8de0-286a0930ea01 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:28:53.759524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 569ebc11-2f93-40c8-8de0-286a0930ea01 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:28:53.760197 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:53.787644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] No DVR routers for this DVR port 860dc344-70ad-4ff8-9592-ee8e988a4f26 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:28:53.796210 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:53.798140 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58d9493c-f145-4d68-918b-46e6bd3cecc7 req-2fd81249-7f2b-4a3d-99ca-9bfb0041e273 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.84 "DELETE /v2.0/ports/860dc344-70ad-4ff8-9592-ee8e988a4f26 HTTP/1.1" status: 204 len: 173 time: 3.9550290 May 12 15:28:53.799192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-deleted', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:53.885766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0bbfd23d-a393-44fe-a1e5-becc623cce25 req-1d802ef5-cd75-44b4-845f-88c06272054e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Synchronizing usage tracker for tenant:6357a1184f074ce2a5b5f19b5ce06e85 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:28:53.920680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0bbfd23d-a393-44fe-a1e5-becc623cce25 req-1d802ef5-cd75-44b4-845f-88c06272054e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Unset dirty status for tenant:6357a1184f074ce2a5b5f19b5ce06e85 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:28:53.922116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0bbfd23d-a393-44fe-a1e5-becc623cce25 req-1d802ef5-cd75-44b4-845f-88c06272054e tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/ports?device_id=c631fd72-0e73-4c59-8850-fd01dfcb598f HTTP/1.1" status: 200 len: 210 time: 0.1325998 May 12 15:28:53.938835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ab8922-ea70-4a03-94bb-5055c0a5091e req-674972ee-1991-43e6-997c-97ec36612dcd tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:53.947529 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-68ab8922-ea70-4a03-94bb-5055c0a5091e req-674972ee-1991-43e6-997c-97ec36612dcd tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 945 time: 0.2573633 May 12 15:28:54.023782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-7b8060fb-88e7-41e4-b579-ee1534bc1d8c None None] Set router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:28:54.034568 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-68ab8922-ea70-4a03-94bb-5055c0a5091e req-2c9d7946-c44d-4ed1-b38b-3cd9c897041f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0855501 May 12 15:28:54.079097 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1819dfc4-bb21-4335-9732-476c64787827'] response: {'server_uuid': 'c631fd72-0e73-4c59-8850-fd01dfcb598f', 'name': 'network-vif-deleted', 'tag': '860dc344-70ad-4ff8-9592-ee8e988a4f26', 'status': 'completed', 'code': 200} May 12 15:28:54.349239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 79e7ee47-ef7f-4129-af14-1b599edecfb5 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:28:54.519258 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:54.582406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cf83dd1-b47f-4c44-a75b-0ca0c12304fa req-dd31308e-067b-4cc7-ad8c-daa925078261 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:54.591635 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3cf83dd1-b47f-4c44-a75b-0ca0c12304fa req-dd31308e-067b-4cc7-ad8c-daa925078261 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 944 time: 0.1513121 May 12 15:28:54.691004 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3cf83dd1-b47f-4c44-a75b-0ca0c12304fa req-80b92df5-1a36-46d2-a9de-b018c54c65b7 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0995140 May 12 15:28:54.773348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f9302a15-1be7-4138-a1a6-d99a3d9f7a73', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '569ebc11-2f93-40c8-8de0-286a0930ea01'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:54.790055 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 569ebc11-2f93-40c8-8de0-286a0930ea01, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=569ebc11-2f93-40c8-8de0-286a0930ea01,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:54.804375 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:54.850622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 79e7ee47-ef7f-4129-af14-1b599edecfb5 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:28:54.885507 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d151c449-9ffc-4fa5-9489-2455f3d0bb1d'] response: {'server_uuid': 'f9302a15-1be7-4138-a1a6-d99a3d9f7a73', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '569ebc11-2f93-40c8-8de0-286a0930ea01', 'code': 200} May 12 15:28:54.890946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 79e7ee47-ef7f-4129-af14-1b599edecfb5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:28:54.891409 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:55.032196 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=569ebc11-2f93-40c8-8de0-286a0930ea01,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:55.187243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d306d358-1cc7-402e-99d3-c5996dc35d70 req-c0759c7c-1c82-4d1b-9df5-417637cbb919 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:55.191064 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d306d358-1cc7-402e-99d3-c5996dc35d70 req-c0759c7c-1c82-4d1b-9df5-417637cbb919 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 1097 time: 0.1874943 May 12 15:28:55.207338 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:55.222500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-7b8060fb-88e7-41e4-b579-ee1534bc1d8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233'}], 'enable_snat': True}, 'gw_port_id': '632ac19e-3420-4802-a558-9e900049a9cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 4, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port': {'id': '632ac19e-3420-4802-a558-9e900049a9cd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:3a:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1391, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:39Z', 'updated_at': '2022-05-12T15:19:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '314d24d4-b40e-49e9-a854-c0e11db13316', 'name': '', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'mac_address': 'fa:16:3e:a8:8a:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_interface', 'standard_attr_id': 1392, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:43Z', 'updated_at': '2022-05-12T15:19:53Z', 'revision_number': 5, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'subnets': [{'id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:55.231429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b8060fb-88e7-41e4-b579-ee1534bc1d8c None None] Checking router: bac46c5e-a9b9-49a6-89a8-7b3f401caed2 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:28:55.253463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45446) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:55.294400 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 79e7ee47-ef7f-4129-af14-1b599edecfb5, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=79e7ee47-ef7f-4129-af14-1b599edecfb5,segment=NetworkSegment(3307f62e-6977-4a8d-852e-31dcfd97c476),segment_id=3307f62e-6977-4a8d-852e-31dcfd97c476)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:28:55.305311 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:55.354251 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d306d358-1cc7-402e-99d3-c5996dc35d70 req-da7781ea-9ba8-46c4-ab10-3a3f8b6b3cf1 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1549020 May 12 15:28:55.388712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b8060fb-88e7-41e4-b579-ee1534bc1d8c None None] Routers {'bac46c5e-a9b9-49a6-89a8-7b3f401caed2'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:28:55.389488 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-7b8060fb-88e7-41e4-b579-ee1534bc1d8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:28:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:55.403503 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba2463ce-39a9-488d-98e5-54cc6eca430c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:55.435388 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c02bb5-c595-4c32-8d55-b7fbd2cef97d req-ce4612b3-bc6a-408c-8bc1-9483514a9f81 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:55.455178 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3c02bb5-c595-4c32-8d55-b7fbd2cef97d req-ce4612b3-bc6a-408c-8bc1-9483514a9f81 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 946 time: 0.1900229 May 12 15:28:55.478256 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba2463ce-39a9-488d-98e5-54cc6eca430c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:55.590886 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3c02bb5-c595-4c32-8d55-b7fbd2cef97d req-760abb3c-0633-4c4b-9159-43c8e0bfb48f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1307950 May 12 15:28:55.629959 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba2463ce-39a9-488d-98e5-54cc6eca430c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:55.690148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba2463ce-39a9-488d-98e5-54cc6eca430c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:55.693961 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ba2463ce-39a9-488d-98e5-54cc6eca430c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "DELETE /v2.0/security-groups/9b49946f-705a-41e4-a057-53a4ddde6ae4 HTTP/1.1" status: 204 len: 168 time: 0.4359326 May 12 15:28:55.693961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba2463ce-39a9-488d-98e5-54cc6eca430c tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b49946f-705a-41e4-a057-53a4ddde6ae4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:55.694486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45466) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:55.752257 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-89bb1487-e1a7-4dc2-aa23-59ba0052fb08 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] show failed (client error): The resource could not be found. May 12 15:28:55.753279 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-89bb1487-e1a7-4dc2-aa23-59ba0052fb08 tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "GET /v2.0/security-groups/9b49946f-705a-41e4-a057-53a4ddde6ae4 HTTP/1.1" status: 404 len: 347 time: 0.0578210 May 12 15:28:55.756285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45472) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:55.758843 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=79e7ee47-ef7f-4129-af14-1b599edecfb5,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:55.820838 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-7b8060fb-88e7-41e4-b579-ee1534bc1d8c None None] Set router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:28:56.061951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-125e59a6-8078-4159-97b5-c2b1a2c8695a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Deleting port 5216ae84-ec28-449f-bbf3-9c41da698f86 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:56.062287 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125e59a6-8078-4159-97b5-c2b1a2c8695a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:56.080317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964f404e-1606-4ebc-a71a-d24012175962 req-b1e76dd5-e6b5-4214-8f97-ef691a507be5 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:56.086792 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-964f404e-1606-4ebc-a71a-d24012175962 req-b1e76dd5-e6b5-4214-8f97-ef691a507be5 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 945 time: 0.1818888 May 12 15:28:56.151454 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-964f404e-1606-4ebc-a71a-d24012175962 req-d5656f0a-d900-49d1-a6ea-c5980ee568f9 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566075 May 12 15:28:56.376881 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125e59a6-8078-4159-97b5-c2b1a2c8695a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:56.377831 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125e59a6-8078-4159-97b5-c2b1a2c8695a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:56.381861 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-7b8060fb-88e7-41e4-b579-ee1534bc1d8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233'}], 'enable_snat': True}, 'gw_port_id': '632ac19e-3420-4802-a558-9e900049a9cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 4, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port': {'id': '632ac19e-3420-4802-a558-9e900049a9cd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:3a:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1391, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:39Z', 'updated_at': '2022-05-12T15:19:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '314d24d4-b40e-49e9-a854-c0e11db13316', 'name': '', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'mac_address': 'fa:16:3e:a8:8a:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_interface', 'standard_attr_id': 1392, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:43Z', 'updated_at': '2022-05-12T15:19:53Z', 'revision_number': 5, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'subnets': [{'id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:28:56.390886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b8060fb-88e7-41e4-b579-ee1534bc1d8c None None] The sync data for ids ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'] in n-d-841483-1 is: [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233'}], 'enable_snat': True}, 'gw_port_id': '632ac19e-3420-4802-a558-9e900049a9cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:19:44Z', 'revision_number': 4, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port': {'id': '632ac19e-3420-4802-a558-9e900049a9cd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:3a:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1391, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:39Z', 'updated_at': '2022-05-12T15:19:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '314d24d4-b40e-49e9-a854-c0e11db13316', 'name': '', 'network_id': 'de9b95bc-97c4-4188-a1d0-c125f35032b0', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'mac_address': 'fa:16:3e:a8:8a:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_interface', 'standard_attr_id': 1392, 'fixed_ips': [{'subnet_id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:43Z', 'updated_at': '2022-05-12T15:19:53Z', 'revision_number': 5, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'subnets': [{'id': 'f6980e11-e336-4f1d-9b2b-4462912e9abb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:28:56.596205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-125e59a6-8078-4159-97b5-c2b1a2c8695a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Calling delete_port for 5216ae84-ec28-449f-bbf3-9c41da698f86 owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:28:56.886925 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '774b92e3-9429-4f04-94bb-bbbb9ce9acac', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79e7ee47-ef7f-4129-af14-1b599edecfb5'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:28:56.970499 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125e59a6-8078-4159-97b5-c2b1a2c8695a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:56.997560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d45cf61a-4457-4adf-9543-4a22045f3dbe req-93ab9ed9-6b75-499f-9912-ca8de909e8f3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:56.999231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d45cf61a-4457-4adf-9543-4a22045f3dbe req-93ab9ed9-6b75-499f-9912-ca8de909e8f3 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 946 time: 0.1602881 May 12 15:28:57.008794 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bccbe73-a3b0-413d-ab90-809895a2f05c None None] New status for floating IP 7802e753-504f-4f2e-b585-7d53d932b7ae: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:28:57.055880 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6c9643f8-5c4e-4396-8597-282e2b32e01c'] response: {'server_uuid': '774b92e3-9429-4f04-94bb-bbbb9ce9acac', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79e7ee47-ef7f-4129-af14-1b599edecfb5', 'code': 200} May 12 15:28:57.094768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-125e59a6-8078-4159-97b5-c2b1a2c8695a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Pushing event deleted for resources: {'Port': ['ID=5216ae84-ec28-449f-bbf3-9c41da698f86,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:57.108894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d45cf61a-4457-4adf-9543-4a22045f3dbe req-b1235989-b1be-4bdf-8232-94f99381de68 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0970135 May 12 15:28:57.322337 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125e59a6-8078-4159-97b5-c2b1a2c8695a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:57.453123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d97dd7-4971-448b-aa3d-77b4ebea7665 req-e5b41fae-5ee1-4116-925e-e665784a74b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:57.454240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39c92d52-77fc-4f8f-9d4b-ed783d9406e2 req-cdb395c6-f903-4c8c-aa94-865f882b709b tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:57.454652 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2d97dd7-4971-448b-aa3d-77b4ebea7665 req-e5b41fae-5ee1-4116-925e-e665784a74b2 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 1096 time: 0.3031881 May 12 15:28:57.459154 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125e59a6-8078-4159-97b5-c2b1a2c8695a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:57.463000 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-125e59a6-8078-4159-97b5-c2b1a2c8695a tempest-ServerActionsTestJSON-141473808 tempest-ServerActionsTestJSON-141473808-project] 10.222.0.82 "DELETE /v2.0/floatingips/7802e753-504f-4f2e-b585-7d53d932b7ae HTTP/1.1" status: 204 len: 168 time: 1.7051256 May 12 15:28:57.463987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39c92d52-77fc-4f8f-9d4b-ed783d9406e2 req-cdb395c6-f903-4c8c-aa94-865f882b709b tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 945 time: 0.1713560 May 12 15:28:57.494272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45540) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:57.743578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45546) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:57.806252 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2d97dd7-4971-448b-aa3d-77b4ebea7665 req-397f14f2-af46-40f0-adc7-6f7ba9c20bca service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3418729 May 12 15:28:57.810546 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39c92d52-77fc-4f8f-9d4b-ed783d9406e2 req-8eb6b549-91e7-49de-9ac2-fd0ef78aeaad tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3453915 May 12 15:28:58.295344 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d020c713-15ff-4167-8aee-c8f59576ac1e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:58.335032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d020c713-15ff-4167-8aee-c8f59576ac1e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:58.370584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d020c713-15ff-4167-8aee-c8f59576ac1e admin admin] Usage tracker for resource:security_group_rule and tenant:ddb3fbe4f7884af0a3a7cb02b28c91c5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:58.378267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d020c713-15ff-4167-8aee-c8f59576ac1e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:58.397642 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d020c713-15ff-4167-8aee-c8f59576ac1e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:58.546478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45580) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:58.586124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe40093-3045-4dad-a990-77c926c4f800 req-84f66a58-f441-44f3-86a4-fefb6429a861 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:58.587598 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2fe40093-3045-4dad-a990-77c926c4f800 req-84f66a58-f441-44f3-86a4-fefb6429a861 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 946 time: 0.3616135 May 12 15:28:58.677121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2fe40093-3045-4dad-a990-77c926c4f800 req-fd367a41-f9e9-457a-8ad2-2349a205f00b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0758166 May 12 15:28:58.693096 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ed12b575-6880-4661-93c2-791ae663ca07 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:58.733687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ed12b575-6880-4661-93c2-791ae663ca07 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:28:58.739258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ed12b575-6880-4661-93c2-791ae663ca07 admin admin] Usage tracker for resource:security_group_rule and tenant:b2fb231db57e478abc75ddc1b5a7b95b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:28:58.745042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ed12b575-6880-4661-93c2-791ae663ca07 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:28:58.755328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ed12b575-6880-4661-93c2-791ae663ca07 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:28:58.818240 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d020c713-15ff-4167-8aee-c8f59576ac1e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:58.829161 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d020c713-15ff-4167-8aee-c8f59576ac1e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:58.938326 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ed12b575-6880-4661-93c2-791ae663ca07 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:58.945589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ed12b575-6880-4661-93c2-791ae663ca07 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:58.962393 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d020c713-15ff-4167-8aee-c8f59576ac1e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe9f2518-e58f-4c38-b411-636157b431f4,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:58.980744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d020c713-15ff-4167-8aee-c8f59576ac1e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ddb3fbe4f7884af0a3a7cb02b28c91c5&name=default HTTP/1.1" status: 200 len: 2983 time: 1.2335191 May 12 15:28:58.981976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45596) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:59.006804 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ed12b575-6880-4661-93c2-791ae663ca07 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b2fb231db57e478abc75ddc1b5a7b95b&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4587457 May 12 15:28:59.017658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45600) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:28:59.070874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed12b575-6880-4661-93c2-791ae663ca07 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e544d8f-15cf-4e9e-b247-a737fa0948de,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:59.133701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e1c6ec-1065-4e71-bac2-980189e88ec5 req-9141ac26-0446-4709-9180-de1e9aa49dec tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:28:59.135174 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23e1c6ec-1065-4e71-bac2-980189e88ec5 req-9141ac26-0446-4709-9180-de1e9aa49dec tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 945 time: 0.1552117 May 12 15:28:59.137358 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ceaff9e0-4b08-40e7-94d5-00c867068740 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:59.141515 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ad274c9-7b7c-4c29-8321-54e71168d069 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:59.174877 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-937eb34e-7085-4828-84e6-bfebd67a1f45 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:59.189590 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ceaff9e0-4b08-40e7-94d5-00c867068740 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:59.197906 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ad274c9-7b7c-4c29-8321-54e71168d069 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:59.292681 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ad274c9-7b7c-4c29-8321-54e71168d069 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:59.298883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23e1c6ec-1065-4e71-bac2-980189e88ec5 req-ea49c713-28d8-4d79-8b15-db3d5985065b tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1536925 May 12 15:28:59.311015 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ceaff9e0-4b08-40e7-94d5-00c867068740 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:59.337969 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ad274c9-7b7c-4c29-8321-54e71168d069 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:59.342764 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7ad274c9-7b7c-4c29-8321-54e71168d069 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fe9f2518-e58f-4c38-b411-636157b431f4 HTTP/1.1" status: 204 len: 168 time: 0.3591416 May 12 15:28:59.344021 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ceaff9e0-4b08-40e7-94d5-00c867068740 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:28:59.347854 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ceaff9e0-4b08-40e7-94d5-00c867068740 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3e544d8f-15cf-4e9e-b247-a737fa0948de HTTP/1.1" status: 204 len: 168 time: 0.3292689 May 12 15:28:59.349051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ad274c9-7b7c-4c29-8321-54e71168d069 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe9f2518-e58f-4c38-b411-636157b431f4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:59.406467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceaff9e0-4b08-40e7-94d5-00c867068740 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e544d8f-15cf-4e9e-b247-a737fa0948de,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:28:59.726309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-937eb34e-7085-4828-84e6-bfebd67a1f45 admin admin] Deleting port 314d24d4-b40e-49e9-a854-c0e11db13316 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:28:59.726656 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-937eb34e-7085-4828-84e6-bfebd67a1f45 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:00.000702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45670) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:00.050428 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3854e450-7fe1-4667-ad4d-447cf7fd9a96 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:00.078971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3854e450-7fe1-4667-ad4d-447cf7fd9a96 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:00.085097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3854e450-7fe1-4667-ad4d-447cf7fd9a96 admin admin] Usage tracker for resource:security_group_rule and tenant:f8d2cd9de5454189928cff152ac37f67 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:00.089347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3854e450-7fe1-4667-ad4d-447cf7fd9a96 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:00.097551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3854e450-7fe1-4667-ad4d-447cf7fd9a96 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:00.339110 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3854e450-7fe1-4667-ad4d-447cf7fd9a96 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:00.349514 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3854e450-7fe1-4667-ad4d-447cf7fd9a96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:00.388632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3854e450-7fe1-4667-ad4d-447cf7fd9a96 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d9f1547-7be6-48f3-81f3-6d44b4426295,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:00.440795 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3854e450-7fe1-4667-ad4d-447cf7fd9a96 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f8d2cd9de5454189928cff152ac37f67&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4389827 May 12 15:29:00.447550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45690) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:00.522734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25f1810f-6994-452f-b64b-b34a4dc1f8d4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:00.562207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d12abf6e-29ad-4922-b45c-c1571714fead req-ccd28653-2948-4dd2-97c0-3e95c2ad2318 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:00.569982 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d12abf6e-29ad-4922-b45c-c1571714fead req-ccd28653-2948-4dd2-97c0-3e95c2ad2318 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 946 time: 0.5643280 May 12 15:29:00.579623 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25f1810f-6994-452f-b64b-b34a4dc1f8d4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:00.590676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-937eb34e-7085-4828-84e6-bfebd67a1f45 admin admin] For port 314d24d4-b40e-49e9-a854-c0e11db13316, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=314d24d4-b40e-49e9-a854-c0e11db13316,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:00.591435 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-937eb34e-7085-4828-84e6-bfebd67a1f45 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:00.682445 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25f1810f-6994-452f-b64b-b34a4dc1f8d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:00.711209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25f1810f-6994-452f-b64b-b34a4dc1f8d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d9f1547-7be6-48f3-81f3-6d44b4426295,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:00.747194 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25f1810f-6994-452f-b64b-b34a4dc1f8d4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:00.749020 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-25f1810f-6994-452f-b64b-b34a4dc1f8d4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2d9f1547-7be6-48f3-81f3-6d44b4426295 HTTP/1.1" status: 204 len: 168 time: 0.3038800 May 12 15:29:00.835205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-937eb34e-7085-4828-84e6-bfebd67a1f45 admin admin] Calling delete_port for 314d24d4-b40e-49e9-a854-c0e11db13316 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:29:00.887880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d12abf6e-29ad-4922-b45c-c1571714fead req-98bb5ef8-98fc-46c3-a38a-ed0dad8b90b4 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3170483 May 12 15:29:01.257571 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-937eb34e-7085-4828-84e6-bfebd67a1f45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:01.411085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-937eb34e-7085-4828-84e6-bfebd67a1f45 admin admin] Pushing event deleted for resources: {'Port': ['ID=314d24d4-b40e-49e9-a854-c0e11db13316,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:01.982895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae64b863-6bc9-4cff-979e-64998116515c req-b80ca113-39ca-49c8-ae4b-ffbfb9922011 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:01.986618 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae64b863-6bc9-4cff-979e-64998116515c req-b80ca113-39ca-49c8-ae4b-ffbfb9922011 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 946 time: 0.4707482 May 12 15:29:02.243139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae64b863-6bc9-4cff-979e-64998116515c req-32441eb8-4832-4d7d-b1df-5c347bdcb317 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2461174 May 12 15:29:02.245560 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-937eb34e-7085-4828-84e6-bfebd67a1f45 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:02.367497 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:02.882137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-937eb34e-7085-4828-84e6-bfebd67a1f45 admin admin] Router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:29:03.666776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-937eb34e-7085-4828-84e6-bfebd67a1f45 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:29:03.684929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43c59054-4c29-4a12-83f5-0b1730f1b766 None None] Sync routers for ids ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:29:03.704070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43c59054-4c29-4a12-83f5-0b1730f1b766 None None] Routers {'bac46c5e-a9b9-49a6-89a8-7b3f401caed2'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:29:03.705170 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-43c59054-4c29-4a12-83f5-0b1730f1b766 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:28:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:03.750858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3987d4c0-4b54-493b-968e-9e495926f4ff req-dc6d9b5c-50e4-4cd9-b3e1-ec563ebc5d99 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:03.752709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3987d4c0-4b54-493b-968e-9e495926f4ff req-dc6d9b5c-50e4-4cd9-b3e1-ec563ebc5d99 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.84 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 946 time: 0.7199593 May 12 15:29:03.874354 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-937eb34e-7085-4828-84e6-bfebd67a1f45 admin admin] 10.222.0.82 "PUT /v2.0/routers/bac46c5e-a9b9-49a6-89a8-7b3f401caed2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.3702116 May 12 15:29:03.876782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45832) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:03.924116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c725539-3bf4-474e-894c-c0149365a21e req-9ca3b827-7e81-4c90-b610-3235085cf1d9 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:03.925629 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c725539-3bf4-474e-894c-c0149365a21e req-9ca3b827-7e81-4c90-b610-3235085cf1d9 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 946 time: 0.3995299 May 12 15:29:03.983498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-3987d4c0-4b54-493b-968e-9e495926f4ff req-cc725804-bae4-4a08-84c2-c81f2441894f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Deleting port 569ebc11-2f93-40c8-8de0-286a0930ea01 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:29:03.983835 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3987d4c0-4b54-493b-968e-9e495926f4ff req-cc725804-bae4-4a08-84c2-c81f2441894f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:04.306596 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:04.308875 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c725539-3bf4-474e-894c-c0149365a21e req-8510b8da-d289-4b97-88d5-02664114b490 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d4634bb-4ec1-45f3-ba4a-767fb8000e74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3706775 May 12 15:29:04.468628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-43c59054-4c29-4a12-83f5-0b1730f1b766 None None] Set router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:29:04.719987 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-3987d4c0-4b54-493b-968e-9e495926f4ff req-cc725804-bae4-4a08-84c2-c81f2441894f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] For port 569ebc11-2f93-40c8-8de0-286a0930ea01, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=569ebc11-2f93-40c8-8de0-286a0930ea01,segment=NetworkSegment(70920b24-31ad-40cc-b105-d50702bf12f1),segment_id=70920b24-31ad-40cc-b105-d50702bf12f1)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:04.720961 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3987d4c0-4b54-493b-968e-9e495926f4ff req-cc725804-bae4-4a08-84c2-c81f2441894f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:04.962940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:04.986049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-3987d4c0-4b54-493b-968e-9e495926f4ff req-cc725804-bae4-4a08-84c2-c81f2441894f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Calling delete_port for 569ebc11-2f93-40c8-8de0-286a0930ea01 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:29:04.992209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] Deleting port 632ac19e-3420-4802-a558-9e900049a9cd {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:29:04.993380 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:05.268412 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-43c59054-4c29-4a12-83f5-0b1730f1b766 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233'}], 'enable_snat': True}, 'gw_port_id': '632ac19e-3420-4802-a558-9e900049a9cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:29:01Z', 'revision_number': 5, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port': {'id': '632ac19e-3420-4802-a558-9e900049a9cd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:3a:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1391, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:19:39Z', 'updated_at': '2022-05-12T15:19:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:05.282105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43c59054-4c29-4a12-83f5-0b1730f1b766 None None] Checking router: bac46c5e-a9b9-49a6-89a8-7b3f401caed2 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:29:05.319518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43c59054-4c29-4a12-83f5-0b1730f1b766 None None] Routers {'bac46c5e-a9b9-49a6-89a8-7b3f401caed2'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:29:05.321006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-43c59054-4c29-4a12-83f5-0b1730f1b766 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:28:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:05.358391 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3987d4c0-4b54-493b-968e-9e495926f4ff req-cc725804-bae4-4a08-84c2-c81f2441894f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:05.411168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] For port 632ac19e-3420-4802-a558-9e900049a9cd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=632ac19e-3420-4802-a558-9e900049a9cd,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:05.412055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:05.517762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 569ebc11-2f93-40c8-8de0-286a0930ea01 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:29:05.762589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 569ebc11-2f93-40c8-8de0-286a0930ea01 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:29:05.762998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 569ebc11-2f93-40c8-8de0-286a0930ea01 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:29:05.816762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-3987d4c0-4b54-493b-968e-9e495926f4ff req-cc725804-bae4-4a08-84c2-c81f2441894f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] No DVR routers for this DVR port 569ebc11-2f93-40c8-8de0-286a0930ea01 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:29:05.822905 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3987d4c0-4b54-493b-968e-9e495926f4ff req-cc725804-bae4-4a08-84c2-c81f2441894f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:05.834372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-360253c4-5b5c-4411-94d9-9059c13c56c4 req-ec19e65e-a62f-40fc-9033-ffbfb8f8190b tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 210 time: 0.1429577 May 12 15:29:05.837535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc725804-bae4-4a08-84c2-c81f2441894f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Pushing event deleted for resources: {'Port': ['ID=569ebc11-2f93-40c8-8de0-286a0930ea01,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:05.845073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f9302a15-1be7-4138-a1a6-d99a3d9f7a73', 'name': 'network-vif-deleted', 'tag': '569ebc11-2f93-40c8-8de0-286a0930ea01'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:29:05.863657 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3987d4c0-4b54-493b-968e-9e495926f4ff req-cc725804-bae4-4a08-84c2-c81f2441894f tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.84 "DELETE /v2.0/ports/569ebc11-2f93-40c8-8de0-286a0930ea01 HTTP/1.1" status: 204 len: 173 time: 2.0986257 May 12 15:29:05.870843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] Calling delete_port for 632ac19e-3420-4802-a558-9e900049a9cd owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:29:05.926706 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2208a5c8-ccc9-443b-87ce-3cd764460c65'] response: {'server_uuid': 'f9302a15-1be7-4138-a1a6-d99a3d9f7a73', 'name': 'network-vif-deleted', 'tag': '569ebc11-2f93-40c8-8de0-286a0930ea01', 'status': 'completed', 'code': 200} May 12 15:29:06.067158 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-43c59054-4c29-4a12-83f5-0b1730f1b766 None None] Set router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:29:06.310888 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:06.386716 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-43c59054-4c29-4a12-83f5-0b1730f1b766 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:29:04Z', 'revision_number': 6, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:06.400825 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43c59054-4c29-4a12-83f5-0b1730f1b766 None None] The sync data for ids ['bac46c5e-a9b9-49a6-89a8-7b3f401caed2'] in n-d-841483-1 is: [{'id': 'bac46c5e-a9b9-49a6-89a8-7b3f401caed2', 'name': 'tempest-ServerActionsTestJSON-1747196083-router', 'tenant_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:19:38Z', 'updated_at': '2022-05-12T15:29:04Z', 'revision_number': 6, 'project_id': '6357a1184f074ce2a5b5f19b5ce06e85', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:29:06.421426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] Pushing event deleted for resources: {'Port': ['ID=632ac19e-3420-4802-a558-9e900049a9cd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:07.096226 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:07.236470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-399d9246-dc37-48e2-ae2a-ca24856e24a6 req-36afcd2c-6cea-4f19-9952-e3adeda36285 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Synchronizing usage tracker for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:29:07.292946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-399d9246-dc37-48e2-ae2a-ca24856e24a6 req-36afcd2c-6cea-4f19-9952-e3adeda36285 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] Unset dirty status for tenant:011dcf6c7b624a28bb2d8ed8db38754f on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:29:07.321756 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-399d9246-dc37-48e2-ae2a-ca24856e24a6 req-36afcd2c-6cea-4f19-9952-e3adeda36285 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] 10.222.0.82 "GET /v2.0/ports?device_id=f9302a15-1be7-4138-a1a6-d99a3d9f7a73 HTTP/1.1" status: 200 len: 210 time: 0.1379888 May 12 15:29:07.402283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:07.410926 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:07.473997 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:07.474557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] Fanout notify agent at l3_agent the message router_deleted on router bac46c5e-a9b9-49a6-89a8-7b3f401caed2 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:29:07.475409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 314d24d4-b40e-49e9-a854-c0e11db13316 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:29:07.496744 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:07.500584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45940) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:07.503232 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ef7f2fca-2424-48c4-90e2-9063e830bc73 admin admin] 10.222.0.82 "DELETE /v2.0/routers/bac46c5e-a9b9-49a6-89a8-7b3f401caed2 HTTP/1.1" status: 204 len: 168 time: 3.6244760 May 12 15:29:07.577604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-40b95d56-1bed-4698-b19d-baa49b726952 admin admin] Deleting subnet f6980e11-e336-4f1d-9b2b-4462912e9abb {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:29:07.583023 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-40b95d56-1bed-4698-b19d-baa49b726952 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:07.611643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 314d24d4-b40e-49e9-a854-c0e11db13316 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:29:07.618527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 314d24d4-b40e-49e9-a854-c0e11db13316 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:29:07.618861 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 632ac19e-3420-4802-a558-9e900049a9cd no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:29:07.694257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 632ac19e-3420-4802-a558-9e900049a9cd {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:29:07.694594 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 632ac19e-3420-4802-a558-9e900049a9cd not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:29:07.702565 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-40b95d56-1bed-4698-b19d-baa49b726952 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:07.831439 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-40b95d56-1bed-4698-b19d-baa49b726952 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:07.989205 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-40b95d56-1bed-4698-b19d-baa49b726952 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:08.050659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40b95d56-1bed-4698-b19d-baa49b726952 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f6980e11-e336-4f1d-9b2b-4462912e9abb,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:08.062964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10fa2680-5864-4597-a53c-011ad6814135 None None] Network de9b95bc-97c4-4188-a1d0-c125f35032b0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:29:08.063431 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-40b95d56-1bed-4698-b19d-baa49b726952 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:08.084581 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-40b95d56-1bed-4698-b19d-baa49b726952 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/f6980e11-e336-4f1d-9b2b-4462912e9abb HTTP/1.1" status: 204 len: 168 time: 0.5799356 May 12 15:29:08.084919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45952) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:08.298609 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:08.313587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Deleting port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:29:08.314067 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:08.695677 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef22976a-a2a8-468f-9a68-98defb2d0aa8 None None] DHCP port deletion for de9b95bc-97c4-4188-a1d0-c125f35032b0 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:29:08.704878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ef22976a-a2a8-468f-9a68-98defb2d0aa8 None None] Deleting port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:29:08.705611 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ef22976a-a2a8-468f-9a68-98defb2d0aa8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:08.995493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] For port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=52453936-18ac-4c9e-b3fd-f71cdb9de4ad,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:08.996345 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:09.202958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ef22976a-a2a8-468f-9a68-98defb2d0aa8 None None] For port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=52453936-18ac-4c9e-b3fd-f71cdb9de4ad,segment=NetworkSegment(03b93164-9692-40b8-b556-05bf788275b7),segment_id=03b93164-9692-40b8-b556-05bf788275b7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:09.203640 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ef22976a-a2a8-468f-9a68-98defb2d0aa8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:09.471231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Calling delete_port for 52453936-18ac-4c9e-b3fd-f71cdb9de4ad owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:29:09.690424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ef22976a-a2a8-468f-9a68-98defb2d0aa8 None None] Calling delete_port for 52453936-18ac-4c9e-b3fd-f71cdb9de4ad owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:29:09.813020 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:09.863604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 52453936-18ac-4c9e-b3fd-f71cdb9de4ad no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:29:09.939085 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-ef22976a-a2a8-468f-9a68-98defb2d0aa8 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:29:09.942469 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-ef22976a-a2a8-468f-9a68-98defb2d0aa8 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:29:09.980847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 52453936-18ac-4c9e-b3fd-f71cdb9de4ad {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:29:09.981638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 52453936-18ac-4c9e-b3fd-f71cdb9de4ad not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:29:09.987047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] No DVR routers for this DVR port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:29:09.992761 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Pushing event deleted for resources: {'Port': ['ID=52453936-18ac-4c9e-b3fd-f71cdb9de4ad,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:10.332877 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:10.399560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['de9b95bc-97c4-4188-a1d0-c125f35032b0']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:10.431054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '03b93164-9692-40b8-b556-05bf788275b7') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:10.431360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '03b93164-9692-40b8-b556-05bf788275b7') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:10.445427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ef22976a-a2a8-468f-9a68-98defb2d0aa8 None None] Deleting port 52453936-18ac-4c9e-b3fd-f71cdb9de4ad {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:29:10.445815 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ef22976a-a2a8-468f-9a68-98defb2d0aa8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:10.460095 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:10.488235 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:10.503804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Releasing vlan 579 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:29:10.504060 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:10.548350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ef22976a-a2a8-468f-9a68-98defb2d0aa8 None None] The port '52453936-18ac-4c9e-b3fd-f71cdb9de4ad' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: timer() May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:29:10.668849 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:29:10.728217 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:10.763987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:10.818402 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] Pushing event deleted for resources: {'Network': ['ID=de9b95bc-97c4-4188-a1d0-c125f35032b0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:10.826653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-93970a4d-4013-4d6b-8a48-070040494236 admin admin] 10.222.0.82 "DELETE /v2.0/networks/de9b95bc-97c4-4188-a1d0-c125f35032b0 HTTP/1.1" status: 204 len: 168 time: 2.7401776 May 12 15:29:11.167547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46062) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:11.332940 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-91764256-5168-4a7f-a650-d2df57d07cc5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6357a1184f074ce2a5b5f19b5ce06e85&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1634390 May 12 15:29:11.336334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46072) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:11.533327 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7e418e9-5822-4659-96b9-50e7f0ae5c7f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:11.569939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7e418e9-5822-4659-96b9-50e7f0ae5c7f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:11.657430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7e418e9-5822-4659-96b9-50e7f0ae5c7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:11.697592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7e418e9-5822-4659-96b9-50e7f0ae5c7f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6129a729-7067-4e3e-90a0-194e985be9c6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:11.700483 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7e418e9-5822-4659-96b9-50e7f0ae5c7f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:11.719153 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a7e418e9-5822-4659-96b9-50e7f0ae5c7f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6129a729-7067-4e3e-90a0-194e985be9c6 HTTP/1.1" status: 204 len: 168 time: 0.3577948 May 12 15:29:12.697359 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-44774c51-ac4a-46b6-a512-d1db2eb091a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:13.007716 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:13.730732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46184) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:13.910938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Request body: {'network': {'name': 'tempest-ServerAddressesNegativeTestJSON-890341505-network', 'tenant_id': '02fd2a705cfa43a294bf047063566817'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:13.917978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:13.922778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Usage tracker for resource:network and tenant:02fd2a705cfa43a294bf047063566817 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:13.926273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:13.953996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:13.994171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Made reservation on behalf of 02fd2a705cfa43a294bf047063566817 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:29:14.000014 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:14.056999 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:14.112478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:14.118028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Usage tracker for resource:security_group_rule and tenant:02fd2a705cfa43a294bf047063566817 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:14.121370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:14.129021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:14.272760 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:14.286102 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:14.305844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 582} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:29:14.336763 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad3b5a32-ba9c-466e-873b-d2456914babc req-183001f4-b878-4732-8179-51e731519327 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.2871807 May 12 15:29:14.380828 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:14.381289 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Added segment da373224-8462-4e0e-be31-39b312fe2761 of type vlan for network 7c34d3f3-9a49-4501-bf9e-00e6928084e4 May 12 15:29:14.404071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f06114a8-6c81-42c9-a89e-943288e44fb6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:14.499092 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:14.585429 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:14.586440 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:14.587081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:14.660392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3b5a32-ba9c-466e-873b-d2456914babc req-0c602e47-de2a-4593-8ef7-c40cd246ac92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:14.663600 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad3b5a32-ba9c-466e-873b-d2456914babc req-0c602e47-de2a-4593-8ef7-c40cd246ac92 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c3218244482a42dabbef067e351d4738&device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 1101 time: 0.1442847 May 12 15:29:14.834040 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-37c9de6a-a760-4fd6-9863-9a33315b3b4b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:14.863784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] Pushing event updated for resources: {'Network': ['ID=7c34d3f3-9a49-4501-bf9e-00e6928084e4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:14.881359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 7c34d3f3-9a49-4501-bf9e-00e6928084e4 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:29:14.882357 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f23d6f7c-00ec-4988-b65e-d2aa88c135ad admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 894 time: 1.1496727 May 12 15:29:14.883984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46226) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:14.898574 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:29:14.912281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Request body: {'subnet': {'network_id': '7c34d3f3-9a49-4501-bf9e-00e6928084e4', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerAddressesNegativeTestJSON-890341505-subnet', 'tenant_id': '02fd2a705cfa43a294bf047063566817', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:14.932000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:14.943437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Usage tracker for resource:subnet and tenant:02fd2a705cfa43a294bf047063566817 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:14.951787 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:14.992726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:15.035157 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Made reservation on behalf of 02fd2a705cfa43a294bf047063566817 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:29:15.044894 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:15.100380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3b5a32-ba9c-466e-873b-d2456914babc req-a1f7e423-282b-4dd9-a308-06d34be3f923 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:15.103692 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad3b5a32-ba9c-466e-873b-d2456914babc req-a1f7e423-282b-4dd9-a308-06d34be3f923 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.4101505 May 12 15:29:15.237598 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46232) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:15.299586 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad3b5a32-ba9c-466e-873b-d2456914babc req-03bf1089-f4d8-4e14-9d90-709be487587f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.237&port_id=55e5edc0-a664-473d-9de3-8c98bec07ca9 HTTP/1.1" status: 200 len: 217 time: 0.1827118 May 12 15:29:15.519524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3b5a32-ba9c-466e-873b-d2456914babc req-9a40cd99-4a9d-4cfc-ba72-13bf723184ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:15.527548 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad3b5a32-ba9c-466e-873b-d2456914babc req-9a40cd99-4a9d-4cfc-ba72-13bf723184ce service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.2108061 May 12 15:29:15.591366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46244) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:15.644441 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:15.687035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3b5a32-ba9c-466e-873b-d2456914babc req-4efe3be5-fa0f-4073-93e1-cbf2aaea06ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:15.688757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad3b5a32-ba9c-466e-873b-d2456914babc req-4efe3be5-fa0f-4073-93e1-cbf2aaea06ec service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1508076 May 12 15:29:15.745279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=10d54a68-c83a-4e43-a45d-73cca0182498,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:15.833564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-315e1ec5-cf8d-4cb4-a290-d9a8bca0c992 admin admin] Deleting subnet 0ff5192a-946b-4444-900a-788b8ddc74b6 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:29:15.845033 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-315e1ec5-cf8d-4cb4-a290-d9a8bca0c992 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:15.880639 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad3b5a32-ba9c-466e-873b-d2456914babc req-943a43c7-a0e3-478d-bce9-d34b0b4c9327 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1813712 May 12 15:29:15.892257 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03e879a9-0c86-4fc4-b43b-a7186f4c06b2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:15.926239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Checking segment: {'id': 'da373224-8462-4e0e-be31-39b312fe2761', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 582, 'network_id': '7c34d3f3-9a49-4501-bf9e-00e6928084e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:29:15.926600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Network hostable DHCP agents. Network: 7c34d3f3-9a49-4501-bf9e-00e6928084e4, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:29:15.933459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-03e879a9-0c86-4fc4-b43b-a7186f4c06b2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:15.939014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-03e879a9-0c86-4fc4-b43b-a7186f4c06b2 admin admin] Usage tracker for resource:security_group_rule and tenant:e64452ca7e484b10b74ba3bd18359c16 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:15.945631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-03e879a9-0c86-4fc4-b43b-a7186f4c06b2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:15.952939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-03e879a9-0c86-4fc4-b43b-a7186f4c06b2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:16.026851 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:16.091280 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03e879a9-0c86-4fc4-b43b-a7186f4c06b2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:16.103868 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03e879a9-0c86-4fc4-b43b-a7186f4c06b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:16.129165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad3b5a32-ba9c-466e-873b-d2456914babc req-22debe07-7f62-463c-97b1-bd4335951f92 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2383640 May 12 15:29:16.145064 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-315e1ec5-cf8d-4cb4-a290-d9a8bca0c992 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:16.171043 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:16.280099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Network 7c34d3f3-9a49-4501-bf9e-00e6928084e4 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:29:16.284946 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-03e879a9-0c86-4fc4-b43b-a7186f4c06b2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e64452ca7e484b10b74ba3bd18359c16&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6878676 May 12 15:29:16.288415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46254) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:16.309023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e879a9-0c86-4fc4-b43b-a7186f4c06b2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f0cb1a1-0791-465f-a91d-2b2121a0c575,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:16.328695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 7c34d3f3-9a49-4501-bf9e-00e6928084e4) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:29:16.328695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:16.328695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:16.335306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29fa9432-a263-4392-9275-4c16a7a9cd5e None None] Network 7c34d3f3-9a49-4501-bf9e-00e6928084e4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:29:16.356868 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-315e1ec5-cf8d-4cb4-a290-d9a8bca0c992 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:16.441483 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3eb55122-f28c-4594-a4be-475e9467cfd5 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 858 time: 1.5477226 May 12 15:29:16.463376 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f2c111c-1595-41a6-aa4a-f286ebd25147 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:16.482116 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-315e1ec5-cf8d-4cb4-a290-d9a8bca0c992 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:16.518749 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f2c111c-1595-41a6-aa4a-f286ebd25147 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:16.538729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-315e1ec5-cf8d-4cb4-a290-d9a8bca0c992 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0ff5192a-946b-4444-900a-788b8ddc74b6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:16.545107 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-315e1ec5-cf8d-4cb4-a290-d9a8bca0c992 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:16.554148 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-315e1ec5-cf8d-4cb4-a290-d9a8bca0c992 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/0ff5192a-946b-4444-900a-788b8ddc74b6 HTTP/1.1" status: 204 len: 168 time: 1.3122668 May 12 15:29:16.554886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46262) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:16.728781 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f2c111c-1595-41a6-aa4a-f286ebd25147 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:16.774721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f2c111c-1595-41a6-aa4a-f286ebd25147 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f0cb1a1-0791-465f-a91d-2b2121a0c575,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:16.777173 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f2c111c-1595-41a6-aa4a-f286ebd25147 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:16.778325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9f2c111c-1595-41a6-aa4a-f286ebd25147 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8f0cb1a1-0791-465f-a91d-2b2121a0c575 HTTP/1.1" status: 204 len: 168 time: 0.4889452 May 12 15:29:16.920998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbcbb171-d7f8-4a68-b9df-027501a33183 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:17.086498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-274c27f9-3447-4451-823c-7e24ca9da17c None None] Network 7c34d3f3-9a49-4501-bf9e-00e6928084e4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:29:17.545245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46306) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:17.586205 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8a94cfa8-22f0-41fb-815e-a616208f48ab admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:17.650742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8a94cfa8-22f0-41fb-815e-a616208f48ab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:17.664548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8a94cfa8-22f0-41fb-815e-a616208f48ab admin admin] Usage tracker for resource:security_group_rule and tenant:5af27dba84104fe79f407872554b6861 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:17.677617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8a94cfa8-22f0-41fb-815e-a616208f48ab admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:17.687388 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbcbb171-d7f8-4a68-b9df-027501a33183 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:17.698090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8a94cfa8-22f0-41fb-815e-a616208f48ab admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:17.796331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-bbcbb171-d7f8-4a68-b9df-027501a33183 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aa894a26-e7a0-42ea-b7f1-9a9c136eacd6']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:17.844354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-bbcbb171-d7f8-4a68-b9df-027501a33183 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '70920b24-31ad-40cc-b105-d50702bf12f1') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:17.845939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-bbcbb171-d7f8-4a68-b9df-027501a33183 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '70920b24-31ad-40cc-b105-d50702bf12f1') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:17.887615 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbcbb171-d7f8-4a68-b9df-027501a33183 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:17.919347 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:17.936340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbcbb171-d7f8-4a68-b9df-027501a33183 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:17.955927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bbcbb171-d7f8-4a68-b9df-027501a33183 admin admin] Releasing vlan 573 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:29:17.956557 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbcbb171-d7f8-4a68-b9df-027501a33183 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: timer() May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:29:17.982234 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:29:18.086385 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46362) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:18.115250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-cb84c437-bb1e-4cca-87d8-411b10cf3007 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'security_group': {'name': 'tempest-securitygroup--993610156', 'description': 'tempest-description--173120903'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:18.120613 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8a94cfa8-22f0-41fb-815e-a616208f48ab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:18.133298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cb84c437-bb1e-4cca-87d8-411b10cf3007 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:18.160958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cb84c437-bb1e-4cca-87d8-411b10cf3007 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:18.166077 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8a94cfa8-22f0-41fb-815e-a616208f48ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:18.167329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbcbb171-d7f8-4a68-b9df-027501a33183 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:18.212220 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbcbb171-d7f8-4a68-b9df-027501a33183 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:18.216496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbcbb171-d7f8-4a68-b9df-027501a33183 admin admin] Pushing event deleted for resources: {'Network': ['ID=aa894a26-e7a0-42ea-b7f1-9a9c136eacd6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:18.238753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb84c437-bb1e-4cca-87d8-411b10cf3007 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:18.270513 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bbcbb171-d7f8-4a68-b9df-027501a33183 admin admin] 10.222.0.82 "DELETE /v2.0/networks/aa894a26-e7a0-42ea-b7f1-9a9c136eacd6 HTTP/1.1" status: 204 len: 168 time: 1.7141488 May 12 15:29:18.334639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cb84c437-bb1e-4cca-87d8-411b10cf3007 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:18.356380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cb84c437-bb1e-4cca-87d8-411b10cf3007 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group_rule and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:18.366496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cb84c437-bb1e-4cca-87d8-411b10cf3007 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:18.370291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-7c76f27f-87e3-41a9-971f-035c781a9b3f tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:18.371847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-7c76f27f-87e3-41a9-971f-035c781a9b3f tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/networks?id=7c34d3f3-9a49-4501-bf9e-00e6928084e4 HTTP/1.1" status: 200 len: 821 time: 0.4721320 May 12 15:29:18.386788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cb84c437-bb1e-4cca-87d8-411b10cf3007 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:18.388610 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8a94cfa8-22f0-41fb-815e-a616208f48ab admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5af27dba84104fe79f407872554b6861&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8423347 May 12 15:29:18.392670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46392) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:18.397936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a94cfa8-22f0-41fb-815e-a616208f48ab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=515d49c9-70cc-4af2-a72e-04bbafd4bb04,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:18.440738 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-d331dcd2-194a-49c9-a56a-45d2408265b9 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/quotas/02fd2a705cfa43a294bf047063566817 HTTP/1.1" status: 200 len: 375 time: 0.0117073 May 12 15:29:18.555112 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e968eda8-a240-4846-9515-90ebed30e38d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:18.637940 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-452250d0-3eb8-47da-95f1-ec4c130cb817 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=02fd2a705cfa43a294bf047063566817&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1593263 May 12 15:29:18.662017 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e968eda8-a240-4846-9515-90ebed30e38d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:18.764444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb84c437-bb1e-4cca-87d8-411b10cf3007 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:18.805363 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb84c437-bb1e-4cca-87d8-411b10cf3007 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:18.941303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46436) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:18.960195 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb84c437-bb1e-4cca-87d8-411b10cf3007 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:18.963154 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cb84c437-bb1e-4cca-87d8-411b10cf3007 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 0.8757250 May 12 15:29:19.020163 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46444) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:19.027131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-2f2cecb5-c81e-409f-b96f-1f509001f869 service neutron] 10.222.0.82 "GET /v2.0/networks/7c34d3f3-9a49-4501-bf9e-00e6928084e4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3871164 May 12 15:29:19.048405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-cb43b85b-b3b3-40e5-ac3b-d22f1becd788 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'security_group_rule': {'security_group_id': '316ae526-e99a-4991-90e7-1c6c4404d21a', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:19.069456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cb43b85b-b3b3-40e5-ac3b-d22f1becd788 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:19.090692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cb43b85b-b3b3-40e5-ac3b-d22f1becd788 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group_rule and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:19.100649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cb43b85b-b3b3-40e5-ac3b-d22f1becd788 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:19.107695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb84c437-bb1e-4cca-87d8-411b10cf3007 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'SecurityGroup': ['ID=316ae526-e99a-4991-90e7-1c6c4404d21a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:19.129485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cb43b85b-b3b3-40e5-ac3b-d22f1becd788 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:19.153271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-72213bdf-94d9-4fc3-9227-3fce684348d8 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=011dcf6c7b624a28bb2d8ed8db38754f&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1995065 May 12 15:29:19.167463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46462) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:19.175738 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e968eda8-a240-4846-9515-90ebed30e38d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:19.269918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb43b85b-b3b3-40e5-ac3b-d22f1becd788 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:19.324130 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e968eda8-a240-4846-9515-90ebed30e38d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:19.326189 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e968eda8-a240-4846-9515-90ebed30e38d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/515d49c9-70cc-4af2-a72e-04bbafd4bb04 HTTP/1.1" status: 204 len: 168 time: 0.9322546 May 12 15:29:19.327438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e968eda8-a240-4846-9515-90ebed30e38d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=515d49c9-70cc-4af2-a72e-04bbafd4bb04,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:19.412612 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-29c75ebb-579f-4caa-a0b9-96bee006f926 service neutron] 10.222.0.82 "GET /v2.0/networks/7c34d3f3-9a49-4501-bf9e-00e6928084e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3651841 May 12 15:29:19.481135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b2e50342-c149-4e7b-9abb-fbd2524dcc1e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:19.610202 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b2e50342-c149-4e7b-9abb-fbd2524dcc1e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:19.660610 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb43b85b-b3b3-40e5-ac3b-d22f1becd788 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:19.700492 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb43b85b-b3b3-40e5-ac3b-d22f1becd788 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:19.839608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb43b85b-b3b3-40e5-ac3b-d22f1becd788 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3523ec38-a9db-49b8-9565-146fb937b837,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:19.890732 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb43b85b-b3b3-40e5-ac3b-d22f1becd788 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:19.902702 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cb43b85b-b3b3-40e5-ac3b-d22f1becd788 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.8777425 May 12 15:29:19.903881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46538) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:19.918384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-97be0fa0-3515-4cc2-ba92-4b84992f3246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'security_group_rule': {'security_group_id': '316ae526-e99a-4991-90e7-1c6c4404d21a', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:19.933117 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b2e50342-c149-4e7b-9abb-fbd2524dcc1e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:19.940548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-97be0fa0-3515-4cc2-ba92-4b84992f3246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:19.969646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-97be0fa0-3515-4cc2-ba92-4b84992f3246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group_rule and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:19.983457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-97be0fa0-3515-4cc2-ba92-4b84992f3246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:19.986031 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b2e50342-c149-4e7b-9abb-fbd2524dcc1e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:19.987169 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b2e50342-c149-4e7b-9abb-fbd2524dcc1e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7d4634bb-4ec1-45f3-ba4a-767fb8000e74 HTTP/1.1" status: 204 len: 168 time: 0.8175344 May 12 15:29:20.000978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2e50342-c149-4e7b-9abb-fbd2524dcc1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d4634bb-4ec1-45f3-ba4a-767fb8000e74,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:20.225155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-97be0fa0-3515-4cc2-ba92-4b84992f3246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:20.324525 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9fe29048-aa70-4937-9861-c3232050068b req-57b708ee-7bb5-4ec9-87eb-aee81ad6d2dc tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 210 time: 0.3110063 May 12 15:29:20.414852 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-97be0fa0-3515-4cc2-ba92-4b84992f3246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:20.765883 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-97be0fa0-3515-4cc2-ba92-4b84992f3246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:20.781719 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-97be0fa0-3515-4cc2-ba92-4b84992f3246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:20.879358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97be0fa0-3515-4cc2-ba92-4b84992f3246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5467adb5-02a3-4178-ac02-4750866cff68,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:20.945593 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-97be0fa0-3515-4cc2-ba92-4b84992f3246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:20.946892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-97be0fa0-3515-4cc2-ba92-4b84992f3246 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.0393782 May 12 15:29:20.950120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46636) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:20.959246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:21.007620 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:21.027193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:floatingip and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:21.035397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:21.082498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:21.124772 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:21.716662 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:21.830269 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ae2cb25-32e5-44a3-a491-1fc4df260b76 req-7e709d96-55e6-450c-ac29-85d93a2519f8 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 210 time: 0.1545198 May 12 15:29:22.257211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Allocated IP 172.25.8.41 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/10bd793e-ab8d-4717-8218-8df43f04f23e) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:29:22.834946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46830) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:22.887572 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:22.951012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46846) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:22.965231 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:23.128106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'Port': ['ID=10bd793e-ab8d-4717-8218-8df43f04f23e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:23.142255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:29:23.144360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:29:23.148089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:29:23.326130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Request body: {'network': {'name': 'tempest-InstanceActionsTestJSON-2047801791-network', 'tenant_id': '62fe52d879b74b038c6484c343be0c6d'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:23.335003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:23.344971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Usage tracker for resource:network and tenant:62fe52d879b74b038c6484c343be0c6d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:23.356933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f6f26ba9-45c8-4da3-b4d8-f61c5ab45c0e req-b2e8fb2b-6b96-4fc5-807e-228b6c090898 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 210 time: 0.1668217 May 12 15:29:23.363732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:23.424941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:23.455272 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fa992afb-2933-48bb-bb11-c0376cc52ba8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:23.509474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Made reservation on behalf of 62fe52d879b74b038c6484c343be0c6d for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:29:23.516022 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:23.600839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fa992afb-2933-48bb-bb11-c0376cc52ba8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:23.617125 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:23.629561 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:23.638947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fa992afb-2933-48bb-bb11-c0376cc52ba8 admin admin] Usage tracker for resource:security_group_rule and tenant:ddd153e10e1443dc8f4d050de3a90aca is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:23.654394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fa992afb-2933-48bb-bb11-c0376cc52ba8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:23.678785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fa992afb-2933-48bb-bb11-c0376cc52ba8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:23.702291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-298d9881-af8a-4f90-938f-7d5df798aea1 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:23.704060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-298d9881-af8a-4f90-938f-7d5df798aea1 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.84 "GET /v2.0/networks?id=7c34d3f3-9a49-4501-bf9e-00e6928084e4 HTTP/1.1" status: 200 len: 821 time: 0.8398747 May 12 15:29:23.740016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Request body: {'port': {'device_id': '03996107-5ca7-49b6-8024-7fdecb4795b8', 'network_id': '7c34d3f3-9a49-4501-bf9e-00e6928084e4', 'admin_state_up': True, 'tenant_id': '02fd2a705cfa43a294bf047063566817'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:23.746273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:23.769640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Usage tracker for resource:security_group_rule and tenant:62fe52d879b74b038c6484c343be0c6d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:23.782397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:23.794895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:23.829312 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:24.044892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:24.080502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Usage tracker for resource:port and tenant:02fd2a705cfa43a294bf047063566817 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:24.107209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:24.120949 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fa992afb-2933-48bb-bb11-c0376cc52ba8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:24.122122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:24.149085 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fa992afb-2933-48bb-bb11-c0376cc52ba8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:24.245242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa992afb-2933-48bb-bb11-c0376cc52ba8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bc555cc4-5d31-44f9-8771-4df89bfee1ab,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:24.258542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Made reservation on behalf of 02fd2a705cfa43a294bf047063566817 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:29:24.263486 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:24.432789 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:24.570069 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:24.602600 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fa992afb-2933-48bb-bb11-c0376cc52ba8 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ddd153e10e1443dc8f4d050de3a90aca&name=default HTTP/1.1" status: 200 len: 2983 time: 1.7660015 May 12 15:29:24.605226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46912) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:24.887820 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f54caf60-cd2d-442b-a0f9-8ae991ae38df req-4bbcbdb1-6abb-4178-8722-6f41c001b617 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 210 time: 0.1452708 May 12 15:29:24.969571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:24.983814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'Port': ['ID=10bd793e-ab8d-4717-8218-8df43f04f23e,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:24.992883 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:25.028764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bae81ae6-020a-481d-86cd-938bd3b55494,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:25.031694 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:25.056439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 567} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:29:25.059858 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-501637b2-9bf2-4325-b0ad-4db4587c48a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:25.080049 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:25.080706 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Added segment 55a17244-91f1-417b-91ca-c9ffff8c08a6 of type vlan for network 9fcd5c26-ea02-456a-83eb-1bfa9b321252 May 12 15:29:25.088394 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:25.090603 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-be011f8d-3cf1-41df-a18e-9a2e5f967c7d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.1386704 May 12 15:29:25.126669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Allocated IP 172.20.0.9 (7c34d3f3-9a49-4501-bf9e-00e6928084e4/10d54a68-c83a-4e43-a45d-73cca0182498/85ca879e-d214-4ff0-be9a-f3ad428f6bc9) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:29:25.145051 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:25.153084 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-501637b2-9bf2-4325-b0ad-4db4587c48a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:25.221773 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:25.223141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:25.224550 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:25.308061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-501637b2-9bf2-4325-b0ad-4db4587c48a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:25.358467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-501637b2-9bf2-4325-b0ad-4db4587c48a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc555cc4-5d31-44f9-8771-4df89bfee1ab,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:25.487066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-501637b2-9bf2-4325-b0ad-4db4587c48a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:25.488621 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-501637b2-9bf2-4325-b0ad-4db4587c48a9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bc555cc4-5d31-44f9-8771-4df89bfee1ab HTTP/1.1" status: 204 len: 168 time: 0.8818054 May 12 15:29:25.513028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46932) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:25.513523 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 2.5574939 May 12 15:29:25.532480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Request body: {'subnet': {'network_id': '9fcd5c26-ea02-456a-83eb-1bfa9b321252', 'cidr': '172.20.0.0/28', 'name': 'tempest-InstanceActionsTestJSON-2047801791-subnet', 'tenant_id': '62fe52d879b74b038c6484c343be0c6d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:25.576275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57161de5-d8fa-4eea-99c9-cb7063e5a8e8 admin admin] Pushing event updated for resources: {'Network': ['ID=9fcd5c26-ea02-456a-83eb-1bfa9b321252,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:25.585428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:25.594525 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 9fcd5c26-ea02-456a-83eb-1bfa9b321252 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:29:25.785248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Usage tracker for resource:subnet and tenant:62fe52d879b74b038c6484c343be0c6d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:25.804197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:25.853240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:25.867334 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-05435668-4ff2-4b99-9d9d-086f02dc88cb tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--993610156&fields=id&tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b HTTP/1.1" status: 200 len: 267 time: 0.2788596 May 12 15:29:26.015010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Made reservation on behalf of 62fe52d879b74b038c6484c343be0c6d for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:29:26.019095 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:26.297096 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:26.422209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1f5bddc1-39e1-4ff4-9806-f5facac2f841 req-16073132-1b0f-4ddb-8a70-65891ce868d4 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Synchronizing usage tracker for tenant:02fd2a705cfa43a294bf047063566817 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:29:26.498474 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:26.525815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Checking segment: {'id': '55a17244-91f1-417b-91ca-c9ffff8c08a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '9fcd5c26-ea02-456a-83eb-1bfa9b321252'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:29:26.526384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Network hostable DHCP agents. Network: 9fcd5c26-ea02-456a-83eb-1bfa9b321252, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:29:26.541307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Pushing event updated for resources: {'Subnet': ['ID=96c78285-c9d5-4380-8226-d529b98a4bae,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:26.577286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1f5bddc1-39e1-4ff4-9806-f5facac2f841 req-16073132-1b0f-4ddb-8a70-65891ce868d4 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Unset dirty status for tenant:02fd2a705cfa43a294bf047063566817 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:29:26.586423 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f5bddc1-39e1-4ff4-9806-f5facac2f841 req-16073132-1b0f-4ddb-8a70-65891ce868d4 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 210 time: 0.3439710 May 12 15:29:26.629309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-4d58b75d-4730-45d0-9853-9f1e5d972578 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:26.637889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-4d58b75d-4730-45d0-9853-9f1e5d972578 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 815 time: 0.7693608 May 12 15:29:26.669016 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-126c0fcc-30b0-48bf-9c1e-6b5cb08db808 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/quotas/c5f9faeb50de42b1a07298c25a4e4d6b HTTP/1.1" status: 200 len: 375 time: 0.0299540 May 12 15:29:26.732845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Network 9fcd5c26-ea02-456a-83eb-1bfa9b321252 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:29:26.760909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 9fcd5c26-ea02-456a-83eb-1bfa9b321252) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:29:26.767069 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:26.769545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:26.770971 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:26.789976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9037503f-3c9a-4677-93a9-79fef51250fa None None] Network 9fcd5c26-ea02-456a-83eb-1bfa9b321252 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:29:26.956160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Network 7c34d3f3-9a49-4501-bf9e-00e6928084e4 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:29:26.997244 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-95944c4e-b8d5-4149-9727-a69b800d3077 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&fields=id HTTP/1.1" status: 200 len: 440 time: 0.3270061 May 12 15:29:27.009711 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b439a1f6-e22c-479c-ae21-7164bba7ba24 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.4938323 May 12 15:29:27.011564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:29:27.015765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:29:27.136701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8caa8381-f597-455b-aab9-f5e033180933 None None] Network 9fcd5c26-ea02-456a-83eb-1bfa9b321252 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:29:27.154563 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Pushing event updated for resources: {'Port': ['ID=85ca879e-d214-4ff0-be9a-f3ad428f6bc9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:27.312220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:27.312906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:27.501572 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-f2b169e9-5044-414b-921b-522768360d63 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.7666261 May 12 15:29:27.545182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Request body: {'port': {'device_id': '03996107-5ca7-49b6-8024-7fdecb4795b8', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:27.716997 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-449b4033-3bab-45ad-87d9-2edef67151c1 service neutron] 10.222.0.82 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6280284 May 12 15:29:27.763792 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:28.126119 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-514fbd7b-dcd7-474b-ac25-56b2a4124488 service neutron] 10.222.0.82 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3970623 May 12 15:29:28.524811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-3e8c1068-7e91-4c53-9bbf-a6ddaebe2874 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:28.526382 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-3e8c1068-7e91-4c53-9bbf-a6ddaebe2874 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/networks?id=9fcd5c26-ea02-456a-83eb-1bfa9b321252 HTTP/1.1" status: 200 len: 814 time: 0.5615969 May 12 15:29:28.618267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-1e5bcf6b-f257-40ba-882a-9083e324cf92 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/quotas/62fe52d879b74b038c6484c343be0c6d HTTP/1.1" status: 200 len: 375 time: 0.0786185 May 12 15:29:28.724897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-16dbbf26-a60b-4367-b84f-97bcf44ea18b tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=62fe52d879b74b038c6484c343be0c6d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0798142 May 12 15:29:29.017413 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-7c4f3d64-9ef6-48fd-9fce-78143ea2aad3 service neutron] 10.222.0.82 "GET /v2.0/networks/9fcd5c26-ea02-456a-83eb-1bfa9b321252?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2909586 May 12 15:29:29.034032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47024) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:29.182236 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] It took 0.41 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:29:29.260665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:29:29.270284 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:29.287427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Transition to ACTIVE for port object 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:29:29.298456 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-dfbcf628-5ce1-4ab7-934b-00312035c911 service neutron] 10.222.0.82 "GET /v2.0/networks/9fcd5c26-ea02-456a-83eb-1bfa9b321252?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2798681 May 12 15:29:29.318968 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:29.387596 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf0b3bc4-6f50-46c3-bd75-7624ca92641a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:29.434708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bf0b3bc4-6f50-46c3-bd75-7624ca92641a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:29.512446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bf0b3bc4-6f50-46c3-bd75-7624ca92641a admin admin] Usage tracker for resource:security_group_rule and tenant:b773d75b18f74984825cba8dd728ac8f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:29.524197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bf0b3bc4-6f50-46c3-bd75-7624ca92641a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:29.539289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bf0b3bc4-6f50-46c3-bd75-7624ca92641a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:29.542218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc6a21e4-611e-46eb-af61-6f694316906b req-eda350c8-5d5c-4af4-a0ba-f7fb9aedab06 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:29.543722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc6a21e4-611e-46eb-af61-6f694316906b req-eda350c8-5d5c-4af4-a0ba-f7fb9aedab06 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 931 time: 1.0054359 May 12 15:29:29.638517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36cbc935-8a64-4eb0-b8b9-9a51b9ac6065 req-532c8190-d4aa-4705-b0cf-9215d88a8158 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:29.643310 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-36cbc935-8a64-4eb0-b8b9-9a51b9ac6065 req-532c8190-d4aa-4705-b0cf-9215d88a8158 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.84 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 950 time: 0.2056558 May 12 15:29:29.659295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Attempting to bind port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:29:29.659891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Attempting to bind port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'da373224-8462-4e0e-be31-39b312fe2761', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 582, 'network_id': '7c34d3f3-9a49-4501-bf9e-00e6928084e4'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:29:29.660371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Attempting to bind port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 on network 7c34d3f3-9a49-4501-bf9e-00e6928084e4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:29:29.675359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Pushing event updated for resources: {'Port': ['ID=85ca879e-d214-4ff0-be9a-f3ad428f6bc9,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:29.687420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 on network 7c34d3f3-9a49-4501-bf9e-00e6928084e4 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:29:29.687963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Attempting to bind port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 on network 7c34d3f3-9a49-4501-bf9e-00e6928084e4 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:29:29.707141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 29, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:29:29.708999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Checking segment: {'id': 'da373224-8462-4e0e-be31-39b312fe2761', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 582, 'network_id': '7c34d3f3-9a49-4501-bf9e-00e6928084e4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:29:29.709612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Bound using segment: {'id': 'da373224-8462-4e0e-be31-39b312fe2761', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 582, 'network_id': '7c34d3f3-9a49-4501-bf9e-00e6928084e4'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:29:29.710230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Bound port: 85ca879e-d214-4ff0-be9a-f3ad428f6bc9, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'da373224-8462-4e0e-be31-39b312fe2761', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 582, 'network_id': '7c34d3f3-9a49-4501-bf9e-00e6928084e4'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:29:29.710996 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:29.751136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-36cbc935-8a64-4eb0-b8b9-9a51b9ac6065 req-660be0dd-f1c6-4297-9677-1b243baa46f2 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Deleting port 55e5edc0-a664-473d-9de3-8c98bec07ca9 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:29:29.751497 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-36cbc935-8a64-4eb0-b8b9-9a51b9ac6065 req-660be0dd-f1c6-4297-9677-1b243baa46f2 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:29.813519 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc6a21e4-611e-46eb-af61-6f694316906b req-0bf9ab9b-7038-487e-919b-e52902adf8c1 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/security-groups?id=f06114a8-6c81-42c9-a89e-943288e44fb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1883056 May 12 15:29:29.990463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] For port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:29:29.994041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] For port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85ca879e-d214-4ff0-be9a-f3ad428f6bc9,segment=NetworkSegment(da373224-8462-4e0e-be31-39b312fe2761),segment_id=da373224-8462-4e0e-be31-39b312fe2761)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:29:30.038992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:30.168076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-36cbc935-8a64-4eb0-b8b9-9a51b9ac6065 req-660be0dd-f1c6-4297-9677-1b243baa46f2 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] For port 55e5edc0-a664-473d-9de3-8c98bec07ca9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=55e5edc0-a664-473d-9de3-8c98bec07ca9,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:30.168640 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-36cbc935-8a64-4eb0-b8b9-9a51b9ac6065 req-660be0dd-f1c6-4297-9677-1b243baa46f2 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:30.183710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecfbaaae-fed0-4735-897a-a65e8f659388 req-7467b650-b06c-4674-9672-080fdd449a73 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 210 time: 0.1867769 May 12 15:29:30.241662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Pushing event updated for resources: {'Port': ['ID=85ca879e-d214-4ff0-be9a-f3ad428f6bc9,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:30.251387 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:30.251993 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:30.269558 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-251f9aed-bb45-434b-bf75-4898f2159f6d service neutron] 10.222.0.84 "PUT /v2.0/ports/85ca879e-d214-4ff0-be9a-f3ad428f6bc9 HTTP/1.1" status: 200 len: 1091 time: 2.7154951 May 12 15:29:30.270326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '03996107-5ca7-49b6-8024-7fdecb4795b8', 'tag': '85ca879e-d214-4ff0-be9a-f3ad428f6bc9'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:29:30.301971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5439407-5a51-4790-bd8b-2551b6ed1566 req-f553a466-0e57-43a5-8ab9-f598f0b1fa01 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:30.309139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5439407-5a51-4790-bd8b-2551b6ed1566 req-f553a466-0e57-43a5-8ab9-f598f0b1fa01 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 950 time: 0.5175707 May 12 15:29:30.437306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-36cbc935-8a64-4eb0-b8b9-9a51b9ac6065 req-660be0dd-f1c6-4297-9677-1b243baa46f2 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Calling delete_port for 55e5edc0-a664-473d-9de3-8c98bec07ca9 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:29:30.463397 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69289321-d497-4485-a2a9-c31fb9e05efe req-ccae2ff3-e321-40e7-96b0-d9c40e55193a tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 210 time: 0.0950422 May 12 15:29:30.595412 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5439407-5a51-4790-bd8b-2551b6ed1566 req-aff17146-0641-4d6b-9a8a-0168863715df tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/security-groups?id=b040f386-5ace-40e3-927f-58e3500d7251&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2678099 May 12 15:29:30.606523 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5a738441-d598-4e6b-8c63-01aa171242b0'] response: {'name': 'network-changed', 'server_uuid': '03996107-5ca7-49b6-8024-7fdecb4795b8', 'tag': '85ca879e-d214-4ff0-be9a-f3ad428f6bc9', 'status': 'completed', 'code': 200} May 12 15:29:30.674449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-2f46aaa7-bfa1-4723-b2ca-e1f70667bec1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:30.676223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-2f46aaa7-bfa1-4723-b2ca-e1f70667bec1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=02fd2a705cfa43a294bf047063566817&device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 1094 time: 0.1814275 May 12 15:29:30.712281 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf0b3bc4-6f50-46c3-bd75-7624ca92641a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:30.758713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf0b3bc4-6f50-46c3-bd75-7624ca92641a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:30.800704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-a79ffd0d-f3af-48fd-b50c-1ad93321f387 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=85ca879e-d214-4ff0-be9a-f3ad428f6bc9 HTTP/1.1" status: 200 len: 217 time: 0.1022644 May 12 15:29:30.839148 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bf0b3bc4-6f50-46c3-bd75-7624ca92641a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b773d75b18f74984825cba8dd728ac8f&name=default HTTP/1.1" status: 200 len: 2983 time: 1.8042417 May 12 15:29:30.851213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47070) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:30.862128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-b7c83169-6aa8-4772-b073-52c0cd4ede9a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:30.874162 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-b7c83169-6aa8-4772-b073-52c0cd4ede9a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.76 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 815 time: 0.3966773 May 12 15:29:30.920428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-75ae8679-c4b8-4113-96e0-71cc4c4a36ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:30.924218 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-75ae8679-c4b8-4113-96e0-71cc4c4a36ad service neutron] 10.222.0.84 "GET /v2.0/subnets?id=10d54a68-c83a-4e43-a45d-73cca0182498 HTTP/1.1" status: 200 len: 861 time: 0.1062095 May 12 15:29:30.985654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf0b3bc4-6f50-46c3-bd75-7624ca92641a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=49d93e51-e011-43be-8238-93cf85b8f8bc,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:30.992639 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-36cbc935-8a64-4eb0-b8b9-9a51b9ac6065 req-660be0dd-f1c6-4297-9677-1b243baa46f2 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:31.031920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['55e5edc0-a664-473d-9de3-8c98bec07ca9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:29:31.069516 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-062b3cbc-5b53-44d4-a867-8c0d2439c10a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:31.085289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-660be0dd-f1c6-4297-9677-1b243baa46f2 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Pushing event deleted for resources: {'Port': ['ID=55e5edc0-a664-473d-9de3-8c98bec07ca9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:31.136790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-f02d2657-0eeb-41fc-bdf1-8e1d0a564332 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:29:31.159430 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-07883e7c-210b-45a3-8087-c26633850535 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=7c34d3f3-9a49-4501-bf9e-00e6928084e4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2251568 May 12 15:29:31.199734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-062b3cbc-5b53-44d4-a867-8c0d2439c10a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:31.228243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-36cbc935-8a64-4eb0-b8b9-9a51b9ac6065 req-660be0dd-f1c6-4297-9677-1b243baa46f2 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] No DVR routers for this DVR port 55e5edc0-a664-473d-9de3-8c98bec07ca9 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:29:31.240390 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-36cbc935-8a64-4eb0-b8b9-9a51b9ac6065 req-660be0dd-f1c6-4297-9677-1b243baa46f2 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:31.245136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '74c4e466-421f-4802-9f9f-62d06b214e98', 'name': 'network-vif-deleted', 'tag': '55e5edc0-a664-473d-9de3-8c98bec07ca9'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:29:31.264631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-f02d2657-0eeb-41fc-bdf1-8e1d0a564332 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:29:31.266101 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-f02d2657-0eeb-41fc-bdf1-8e1d0a564332 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b HTTP/1.1" status: 200 len: 471 time: 0.3120654 May 12 15:29:31.285269 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'port': {'device_id': 'ac261e00-23bd-428e-af60-6376594bb94f', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'admin_state_up': True, 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'security_groups': ['316ae526-e99a-4991-90e7-1c6c4404d21a']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:31.394625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eee73f80-c5b5-4473-8b2f-2b7deca62759 req-455195ab-9ea4-46f1-a5e6-f9a25911765e tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:31.396708 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eee73f80-c5b5-4473-8b2f-2b7deca62759 req-455195ab-9ea4-46f1-a5e6-f9a25911765e tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 943 time: 0.4273877 May 12 15:29:31.403577 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-36cbc935-8a64-4eb0-b8b9-9a51b9ac6065 req-660be0dd-f1c6-4297-9677-1b243baa46f2 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.84 "DELETE /v2.0/ports/55e5edc0-a664-473d-9de3-8c98bec07ca9 HTTP/1.1" status: 204 len: 173 time: 1.7507374 May 12 15:29:31.609702 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdae1ab9-9f8f-4ffc-b462-ccebedde9b88 req-f88d1d8d-5e30-4b89-aeb5-431344b44755 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 210 time: 0.1247423 May 12 15:29:31.645936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eee73f80-c5b5-4473-8b2f-2b7deca62759 req-c15e6ee6-09f5-417f-a94e-6373789cc913 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/security-groups?id=f06114a8-6c81-42c9-a89e-943288e44fb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2390685 May 12 15:29:31.650133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-60483308-59ff-4b95-89e8-df69d98fabcf service neutron] 10.222.0.84 "GET /v2.0/networks/7c34d3f3-9a49-4501-bf9e-00e6928084e4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4737508 May 12 15:29:31.923375 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a6d0c8b9-295f-4d9c-85a6-b6cb6f3c4745'] response: {'server_uuid': '74c4e466-421f-4802-9f9f-62d06b214e98', 'name': 'network-vif-deleted', 'tag': '55e5edc0-a664-473d-9de3-8c98bec07ca9', 'status': 'completed', 'code': 200} May 12 15:29:31.934740 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-062b3cbc-5b53-44d4-a867-8c0d2439c10a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:31.984635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-062b3cbc-5b53-44d4-a867-8c0d2439c10a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=49d93e51-e011-43be-8238-93cf85b8f8bc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:32.023271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-062b3cbc-5b53-44d4-a867-8c0d2439c10a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:32.024974 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-062b3cbc-5b53-44d4-a867-8c0d2439c10a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/49d93e51-e011-43be-8238-93cf85b8f8bc HTTP/1.1" status: 204 len: 168 time: 1.1701901 May 12 15:29:32.055466 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8561d9b7-e72c-4680-9522-bb05e7263f67 req-44f36f36-c6cb-4386-aa6e-f4fbf8df2c1a tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 210 time: 0.1101115 May 12 15:29:32.057572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:32.076054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:port and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:32.080993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for port was recalculated. Used quota:5. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:32.094682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-150ca8a4-7f6d-42a4-940e-d059a98118eb req-633b990a-f7d3-4c93-a81c-2653209e9553 service neutron] 10.222.0.84 "GET /v2.0/networks/7c34d3f3-9a49-4501-bf9e-00e6928084e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4277031 May 12 15:29:32.097084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-34ece3b3-9ce9-4c1f-baea-3950cfe5a5e5 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:32.097962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-34ece3b3-9ce9-4c1f-baea-3950cfe5a5e5 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Synchronizing usage tracker for tenant:62fe52d879b74b038c6484c343be0c6d on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:29:32.102562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-030a5e69-b17b-442f-a396-163c1f67a86f req-6458b848-2e8c-413f-b2fe-f46de0d9dcbf tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] 10.222.0.82 "GET /v2.0/ports?device_id=74c4e466-421f-4802-9f9f-62d06b214e98 HTTP/1.1" status: 200 len: 210 time: 0.1560531 May 12 15:29:32.104961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource port. Total usage: 5; quota limit: 500; headroom:495 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:32.139510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Made reservation on behalf of c5f9faeb50de42b1a07298c25a4e4d6b for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:29:32.144667 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:32.160323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-34ece3b3-9ce9-4c1f-baea-3950cfe5a5e5 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Unset dirty status for tenant:62fe52d879b74b038c6484c343be0c6d on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:29:32.162834 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-34ece3b3-9ce9-4c1f-baea-3950cfe5a5e5 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.84 "GET /v2.0/networks?id=9fcd5c26-ea02-456a-83eb-1bfa9b321252 HTTP/1.1" status: 200 len: 814 time: 0.7519712 May 12 15:29:32.225656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Request body: {'port': {'device_id': 'a01fffac-1332-4d92-812c-69e704d19ed5', 'network_id': '9fcd5c26-ea02-456a-83eb-1bfa9b321252', 'admin_state_up': True, 'tenant_id': '62fe52d879b74b038c6484c343be0c6d'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:32.368718 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:32.378846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caffb003-ee02-48d8-8b48-9fd0bab137e3 req-5a2f3f5d-1424-49e7-8bba-36db67196ee3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:32.381714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-caffb003-ee02-48d8-8b48-9fd0bab137e3 req-5a2f3f5d-1424-49e7-8bba-36db67196ee3 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=02fd2a705cfa43a294bf047063566817&device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 1094 time: 0.1659808 May 12 15:29:32.619244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:32.619453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caffb003-ee02-48d8-8b48-9fd0bab137e3 req-aae90788-e2cd-4f7c-b3bd-d4541c4756dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:32.620960 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-caffb003-ee02-48d8-8b48-9fd0bab137e3 req-aae90788-e2cd-4f7c-b3bd-d4541c4756dd service neutron] 10.222.0.84 "GET /v2.0/networks?id=7c34d3f3-9a49-4501-bf9e-00e6928084e4 HTTP/1.1" status: 200 len: 922 time: 0.2318757 May 12 15:29:32.623365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Allocated IP 172.20.0.11 (dbecac63-cd00-4ee6-bec1-19abe557d6e1/7cf2ffc4-f41f-40e3-90d1-77e214ee94e3/3283015e-7f0d-447c-b1c3-25d7034f9c29) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:29:32.628792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Usage tracker for resource:port and tenant:62fe52d879b74b038c6484c343be0c6d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:32.636877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:32.667770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:32.723933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-caffb003-ee02-48d8-8b48-9fd0bab137e3 req-e7598677-e63a-4699-a50c-ead103643ec1 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=85ca879e-d214-4ff0-be9a-f3ad428f6bc9 HTTP/1.1" status: 200 len: 217 time: 0.0917470 May 12 15:29:32.725611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Made reservation on behalf of 62fe52d879b74b038c6484c343be0c6d for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:29:32.729939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:32.908393 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45cb5464-38b1-4781-bebc-f6750ebcfc69 req-d14d4e92-028d-4943-abf7-715ff2dfae43 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 210 time: 0.0601189 May 12 15:29:32.916131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caffb003-ee02-48d8-8b48-9fd0bab137e3 req-4d2b9bb1-9520-4e4a-876d-1618e892895f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:32.917837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-caffb003-ee02-48d8-8b48-9fd0bab137e3 req-4d2b9bb1-9520-4e4a-876d-1618e892895f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=10d54a68-c83a-4e43-a45d-73cca0182498 HTTP/1.1" status: 200 len: 861 time: 0.1878936 May 12 15:29:32.984019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-caffb003-ee02-48d8-8b48-9fd0bab137e3 req-e25dabc0-0c41-499b-bd46-200b5d3d2e88 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=7c34d3f3-9a49-4501-bf9e-00e6928084e4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0553551 May 12 15:29:33.097419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-223e2901-812f-4396-9278-85df94d9e91f req-831c37b9-6310-4cd7-8f61-2527296aae99 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:33.099370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-223e2901-812f-4396-9278-85df94d9e91f req-831c37b9-6310-4cd7-8f61-2527296aae99 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 943 time: 0.2990520 May 12 15:29:33.235601 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-223e2901-812f-4396-9278-85df94d9e91f req-cfb8a460-b70e-4726-b08e-98fb32e52cb6 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/security-groups?id=f06114a8-6c81-42c9-a89e-943288e44fb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1270816 May 12 15:29:33.240131 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:33.259471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Transition to ACTIVE for port object 3283015e-7f0d-447c-b1c3-25d7034f9c29 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:29:33.309143 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:33.418240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Network dbecac63-cd00-4ee6-bec1-19abe557d6e1 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:29:33.438306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:29:33.454367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:29:33.468825 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7959e2c3-b869-4b77-bdac-558c50589d64 req-8ae5d700-7aa6-4049-a863-99e318b65699 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 210 time: 0.1657307 May 12 15:29:33.477272 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-caffb003-ee02-48d8-8b48-9fd0bab137e3 req-e3b5df1e-7da2-47f3-a45d-6ca7f7d95b98 service neutron] 10.222.0.84 "GET /v2.0/networks/7c34d3f3-9a49-4501-bf9e-00e6928084e4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4846966 May 12 15:29:33.486905 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:29:33.609943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:33.610594 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:33.689587 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.4153316 May 12 15:29:33.722002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Request body: {'port': {'device_id': 'ac261e00-23bd-428e-af60-6376594bb94f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:33.771743 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-caffb003-ee02-48d8-8b48-9fd0bab137e3 req-21fc1acd-bbd0-4c8a-a99d-19c250ebf243 service neutron] 10.222.0.84 "GET /v2.0/networks/7c34d3f3-9a49-4501-bf9e-00e6928084e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2781415 May 12 15:29:33.843171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Allocated IP 172.20.0.9 (9fcd5c26-ea02-456a-83eb-1bfa9b321252/96c78285-c9d5-4380-8226-d529b98a4bae/88d33cdf-e82f-4136-be41-55530c917cf8) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:29:33.886934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f5e8a89-7e8d-467f-b184-d9d8c9d6be81 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'Port': ['ID=3283015e-7f0d-447c-b1c3-25d7034f9c29,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:33.950145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 55e5edc0-a664-473d-9de3-8c98bec07ca9 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:29:34.069052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 55e5edc0-a664-473d-9de3-8c98bec07ca9 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:29:34.069322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 55e5edc0-a664-473d-9de3-8c98bec07ca9 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:29:34.123310 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:34.142859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d2cb94c4-b8ae-49bc-8d70-6720f130fba2 None None] Provisioning for port 3283015e-7f0d-447c-b1c3-25d7034f9c29 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:29:34.161682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85ca879e-d214-4ff0-be9a-f3ad428f6bc9,segment=NetworkSegment(da373224-8462-4e0e-be31-39b312fe2761),segment_id=da373224-8462-4e0e-be31-39b312fe2761)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:34.182886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d2cb94c4-b8ae-49bc-8d70-6720f130fba2 None None] Provisioning complete for port 3283015e-7f0d-447c-b1c3-25d7034f9c29 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:29:34.183550 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d2cb94c4-b8ae-49bc-8d70-6720f130fba2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:34.320059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d2cb94c4-b8ae-49bc-8d70-6720f130fba2 None None] Port 3283015e-7f0d-447c-b1c3-25d7034f9c29 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:29:34.335611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '85ca879e-d214-4ff0-be9a-f3ad428f6bc9', 'network_id': '7c34d3f3-9a49-4501-bf9e-00e6928084e4', 'port_id': '85ca879e-d214-4ff0-be9a-f3ad428f6bc9', 'mac_address': 'fa:16:3e:c2:7f:6b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 582, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '10d54a68-c83a-4e43-a45d-73cca0182498', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:29:34.548941 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:34.568443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:29:34.572736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06922288-d767-4148-b846-a15d138b9f62 req-7e683641-1c59-47e6-af98-7702cf38e300 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:34.584790 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06922288-d767-4148-b846-a15d138b9f62 req-7e683641-1c59-47e6-af98-7702cf38e300 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 932 time: 0.3661859 May 12 15:29:34.586575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85ca879e-d214-4ff0-be9a-f3ad428f6bc9,segment=NetworkSegment(da373224-8462-4e0e-be31-39b312fe2761),segment_id=da373224-8462-4e0e-be31-39b312fe2761)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:34.594645 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:34.620911 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:34.762711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=85ca879e-d214-4ff0-be9a-f3ad428f6bc9,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:34.810329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:34.959044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['85ca879e-d214-4ff0-be9a-f3ad428f6bc9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:29:34.960104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Network 9fcd5c26-ea02-456a-83eb-1bfa9b321252 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:29:34.976229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:29:34.989839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c80738b8-eed1-43b7-a8a3-bc7606d6f879 req-14ae6076-c20f-40e4-b6e3-9fba3d79d1c3 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:34.998398 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c80738b8-eed1-43b7-a8a3-bc7606d6f879 req-14ae6076-c20f-40e4-b6e3-9fba3d79d1c3 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 943 time: 0.6056836 May 12 15:29:35.053975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:29:35.106847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06922288-d767-4148-b846-a15d138b9f62 req-8e0658e7-1300-46a4-b5d2-0ad7ec1803fd tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5109329 May 12 15:29:35.117276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Pushing event updated for resources: {'Port': ['ID=88d33cdf-e82f-4136-be41-55530c917cf8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:35.157826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3283015e-7f0d-447c-b1c3-25d7034f9c29 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:29:35.178113 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:35.198645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:35.199842 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:35.218457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c80738b8-eed1-43b7-a8a3-bc7606d6f879 req-1e02482e-9b75-45c0-91ba-e9b260455e26 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/security-groups?id=f06114a8-6c81-42c9-a89e-943288e44fb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2187111 May 12 15:29:35.276257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Transition to ACTIVE for port object 3283015e-7f0d-447c-b1c3-25d7034f9c29 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:29:35.291487 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:35.441319 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-feb25750-f5a9-4ba0-b969-e32f3073069d tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.2192941 May 12 15:29:35.548720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-051e91e8-dec6-4210-b0b5-749645921f2c req-efeda99c-07e0-4b8c-848b-ed5ab7db0786 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:35.555874 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-051e91e8-dec6-4210-b0b5-749645921f2c req-efeda99c-07e0-4b8c-848b-ed5ab7db0786 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 931 time: 0.2023370 May 12 15:29:35.674499 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-051e91e8-dec6-4210-b0b5-749645921f2c req-2bf9473f-5e7c-43e9-9532-356034691a48 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1005387 May 12 15:29:36.095528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Request body: {'port': {'device_id': 'a01fffac-1332-4d92-812c-69e704d19ed5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:36.278639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Pushing event updated for resources: {'Port': ['ID=3283015e-7f0d-447c-b1c3-25d7034f9c29,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:36.496081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:36.713180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Attempting to bind port 3283015e-7f0d-447c-b1c3-25d7034f9c29 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:29:36.713573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Attempting to bind port 3283015e-7f0d-447c-b1c3-25d7034f9c29 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:29:36.713879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Attempting to bind port 3283015e-7f0d-447c-b1c3-25d7034f9c29 on network dbecac63-cd00-4ee6-bec1-19abe557d6e1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:29:36.737140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Port 3283015e-7f0d-447c-b1c3-25d7034f9c29 on network dbecac63-cd00-4ee6-bec1-19abe557d6e1 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:29:36.740077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Attempting to bind port 3283015e-7f0d-447c-b1c3-25d7034f9c29 on network dbecac63-cd00-4ee6-bec1-19abe557d6e1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:29:36.782976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae8481c-12e5-4b5c-a25b-5c89f71e80ba req-30107d9f-f1c3-4a20-86cf-7aaa6fb2a483 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:36.795943 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ae8481c-12e5-4b5c-a25b-5c89f71e80ba req-30107d9f-f1c3-4a20-86cf-7aaa6fb2a483 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 944 time: 0.3079605 May 12 15:29:36.821341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 29, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:29:36.822135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Checking segment: {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:29:36.822873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Bound using segment: {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:29:36.823536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Bound port: 3283015e-7f0d-447c-b1c3-25d7034f9c29, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:29:36.824105 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:36.856670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bb0ef99-7f47-443a-93b1-ebb008ecd0b9 req-5da1ef4a-665c-4b81-b413-abc67ffe6696 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:36.871255 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1bb0ef99-7f47-443a-93b1-ebb008ecd0b9 req-5da1ef4a-665c-4b81-b413-abc67ffe6696 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 944 time: 0.2816243 May 12 15:29:37.005231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ae8481c-12e5-4b5c-a25b-5c89f71e80ba req-99c5ea36-8e9b-4fa0-9722-f7e36a1bbe8a tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/security-groups?id=f06114a8-6c81-42c9-a89e-943288e44fb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2077689 May 12 15:29:37.048184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1bb0ef99-7f47-443a-93b1-ebb008ecd0b9 req-40a708aa-1627-4167-8354-5667be81cb60 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1750944 May 12 15:29:37.090399 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] For port 3283015e-7f0d-447c-b1c3-25d7034f9c29, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:29:37.097850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] For port 3283015e-7f0d-447c-b1c3-25d7034f9c29, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3283015e-7f0d-447c-b1c3-25d7034f9c29,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:29:37.296131 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:37.490098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:29:37.510841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:37.511449 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:37.512909 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] 10.222.0.76 "PUT /v2.0/ports/3283015e-7f0d-447c-b1c3-25d7034f9c29 HTTP/1.1" status: 200 len: 1092 time: 3.8068421 May 12 15:29:37.515322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac261e00-23bd-428e-af60-6376594bb94f', 'tag': '3283015e-7f0d-447c-b1c3-25d7034f9c29'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:29:37.524464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf621d7e-a8a5-4239-aad2-a7cadb7f1ec1 service neutron] Pushing event updated for resources: {'Port': ['ID=3283015e-7f0d-447c-b1c3-25d7034f9c29,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:37.592176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcb9e6b2-f54e-4f16-8932-0ea31de1dd8e req-a387cd6f-3a2d-4c70-a338-125763fa6534 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:37.606669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bcb9e6b2-f54e-4f16-8932-0ea31de1dd8e req-a387cd6f-3a2d-4c70-a338-125763fa6534 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 931 time: 0.3164740 May 12 15:29:37.699381 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bcb9e6b2-f54e-4f16-8932-0ea31de1dd8e req-ec277d73-b307-4e97-8fd2-96215eae7a99 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0913951 May 12 15:29:37.750485 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-02f268c7-a8be-4463-aeca-c3dfaf8bb27b'] response: {'name': 'network-changed', 'server_uuid': 'ac261e00-23bd-428e-af60-6376594bb94f', 'tag': '3283015e-7f0d-447c-b1c3-25d7034f9c29', 'status': 'completed', 'code': 200} May 12 15:29:37.762217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:29:37.787393 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:29:37.787766 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:37.942249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-1c6a8b0a-fc55-47ac-83bc-610785a35703 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:37.949901 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-1c6a8b0a-fc55-47ac-83bc-610785a35703 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 1095 time: 0.3597603 May 12 15:29:38.075787 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-ad7b7b4a-771c-45d6-ab6a-2f4368a31805 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=3283015e-7f0d-447c-b1c3-25d7034f9c29 HTTP/1.1" status: 200 len: 217 time: 0.1226022 May 12 15:29:38.146673 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:38.196186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '03996107-5ca7-49b6-8024-7fdecb4795b8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85ca879e-d214-4ff0-be9a-f3ad428f6bc9'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:29:38.226019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85ca879e-d214-4ff0-be9a-f3ad428f6bc9,segment=NetworkSegment(da373224-8462-4e0e-be31-39b312fe2761),segment_id=da373224-8462-4e0e-be31-39b312fe2761)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:38.237069 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:38.255758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 88d33cdf-e82f-4136-be41-55530c917cf8 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:29:38.288200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:38.319330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-980ff525-9678-4a6d-b310-305bd5a99449 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:38.322617 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-980ff525-9678-4a6d-b310-305bd5a99449 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 HTTP/1.1" status: 200 len: 854 time: 0.2335923 May 12 15:29:38.435942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Transition to ACTIVE for port object 88d33cdf-e82f-4136-be41-55530c917cf8 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:29:38.445937 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:38.463728 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=85ca879e-d214-4ff0-be9a-f3ad428f6bc9,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:38.563137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc5803fb-e50b-41f1-9af7-48e7f10fe557 req-b45049bf-f8d8-4acc-98c2-d58f64f9692e tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:38.572115 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc5803fb-e50b-41f1-9af7-48e7f10fe557 req-b45049bf-f8d8-4acc-98c2-d58f64f9692e tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 945 time: 0.2904518 May 12 15:29:38.642593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc5803fb-e50b-41f1-9af7-48e7f10fe557 req-5aa773df-c319-4488-b24c-b94aed9ac168 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/security-groups?id=f06114a8-6c81-42c9-a89e-943288e44fb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689375 May 12 15:29:39.071826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b711cedf-c394-4f7d-a8ee-49cf308e3608 req-b7375e26-b7d9-4ba6-a1cf-95052376f5ff tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:39.076178 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b711cedf-c394-4f7d-a8ee-49cf308e3608 req-b7375e26-b7d9-4ba6-a1cf-95052376f5ff tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 944 time: 0.2307894 May 12 15:29:39.099785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-b18f5829-e36d-45be-a215-b1a5927ec52a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:39.102282 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-b18f5829-e36d-45be-a215-b1a5927ec52a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=dbecac63-cd00-4ee6-bec1-19abe557d6e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.7706280 May 12 15:29:39.106007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Pushing event updated for resources: {'Port': ['ID=88d33cdf-e82f-4136-be41-55530c917cf8,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:39.113107 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-64430b50-9a1c-40de-871b-7eb617b21c62'] response: {'server_uuid': '03996107-5ca7-49b6-8024-7fdecb4795b8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85ca879e-d214-4ff0-be9a-f3ad428f6bc9', 'code': 200} May 12 15:29:39.228968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b711cedf-c394-4f7d-a8ee-49cf308e3608 req-f783f1f2-7f17-43b6-b3b8-641918f8834d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1465435 May 12 15:29:39.373160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Attempting to bind port 88d33cdf-e82f-4136-be41-55530c917cf8 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:29:39.374206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Attempting to bind port 88d33cdf-e82f-4136-be41-55530c917cf8 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '55a17244-91f1-417b-91ca-c9ffff8c08a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '9fcd5c26-ea02-456a-83eb-1bfa9b321252'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:29:39.374718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Attempting to bind port 88d33cdf-e82f-4136-be41-55530c917cf8 on network 9fcd5c26-ea02-456a-83eb-1bfa9b321252 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:29:39.381803 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-590535c2-84b0-4bf0-9939-d09b0bb32a1d req-b19a2247-35f3-4076-bedf-bf3fe10eff91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:39.385253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Port 88d33cdf-e82f-4136-be41-55530c917cf8 on network 9fcd5c26-ea02-456a-83eb-1bfa9b321252 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:29:39.385913 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-590535c2-84b0-4bf0-9939-d09b0bb32a1d req-b19a2247-35f3-4076-bedf-bf3fe10eff91 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 1096 time: 0.1624274 May 12 15:29:39.386552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Attempting to bind port 88d33cdf-e82f-4136-be41-55530c917cf8 on network 9fcd5c26-ea02-456a-83eb-1bfa9b321252 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:29:39.407389 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 29, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:29:39.407987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Checking segment: {'id': '55a17244-91f1-417b-91ca-c9ffff8c08a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '9fcd5c26-ea02-456a-83eb-1bfa9b321252'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:29:39.408584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Bound using segment: {'id': '55a17244-91f1-417b-91ca-c9ffff8c08a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '9fcd5c26-ea02-456a-83eb-1bfa9b321252'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:29:39.409293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Bound port: 88d33cdf-e82f-4136-be41-55530c917cf8, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '55a17244-91f1-417b-91ca-c9ffff8c08a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 567, 'network_id': '9fcd5c26-ea02-456a-83eb-1bfa9b321252'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:29:39.409855 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:39.592851 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-590535c2-84b0-4bf0-9939-d09b0bb32a1d req-f5271abd-f769-451d-b137-589d3e59a79b service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=f06114a8-6c81-42c9-a89e-943288e44fb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1988626 May 12 15:29:39.659122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-086ea0c3-84b4-462b-96ac-0f27b4cdf880 req-8e6399a3-1365-4b19-b8c5-670bf245cf87 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:39.672736 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-086ea0c3-84b4-462b-96ac-0f27b4cdf880 req-8e6399a3-1365-4b19-b8c5-670bf245cf87 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 943 time: 0.2166553 May 12 15:29:39.691144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-d6e69b07-4d60-4a0f-b788-92de80693b68 service neutron] 10.222.0.76 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5791552 May 12 15:29:39.739578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-086ea0c3-84b4-462b-96ac-0f27b4cdf880 req-2c662621-2784-47c4-9dea-0523e4ae57a3 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650778 May 12 15:29:39.993489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] For port 88d33cdf-e82f-4136-be41-55530c917cf8, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:29:40.020544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] For port 88d33cdf-e82f-4136-be41-55530c917cf8, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=88d33cdf-e82f-4136-be41-55530c917cf8,segment=NetworkSegment(55a17244-91f1-417b-91ca-c9ffff8c08a6),segment_id=55a17244-91f1-417b-91ca-c9ffff8c08a6)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:29:40.028795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d51cffc-cf0e-44a9-852e-ddac5b4fda57 req-56f91d6b-d84d-432f-bee4-e86569ce3d87 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:40.031653 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:40.040787 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d51cffc-cf0e-44a9-852e-ddac5b4fda57 req-56f91d6b-d84d-432f-bee4-e86569ce3d87 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 945 time: 0.1875796 May 12 15:29:40.152863 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d51cffc-cf0e-44a9-852e-ddac5b4fda57 req-f1fc4a39-b114-425c-b14f-eee0b09c12e9 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/security-groups?id=f06114a8-6c81-42c9-a89e-943288e44fb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1095891 May 12 15:29:40.162791 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c629ec4d-00e2-4bb5-aea2-eeb9cb22aba5 req-84e262dc-4bf8-43fd-b838-912b40d47db1 service neutron] 10.222.0.76 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4614370 May 12 15:29:40.166116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:40.167295 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:40.168633 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] 10.222.0.84 "PUT /v2.0/ports/88d33cdf-e82f-4136-be41-55530c917cf8 HTTP/1.1" status: 200 len: 1091 time: 4.1810513 May 12 15:29:40.169071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a01fffac-1332-4d92-812c-69e704d19ed5', 'tag': '88d33cdf-e82f-4136-be41-55530c917cf8'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:29:40.305966 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e3cdfa91-cc4d-4e58-bd8e-0029f5e09ee9'] response: {'name': 'network-changed', 'server_uuid': 'a01fffac-1332-4d92-812c-69e704d19ed5', 'tag': '88d33cdf-e82f-4136-be41-55530c917cf8', 'status': 'completed', 'code': 200} May 12 15:29:40.360993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6596d4a-e053-4293-a436-90eb3b0e14de service neutron] Pushing event updated for resources: {'Port': ['ID=88d33cdf-e82f-4136-be41-55530c917cf8,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:40.462724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-76d96def-709a-43c4-a2ca-2b970872b7ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:40.464243 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-76d96def-709a-43c4-a2ca-2b970872b7ec service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=62fe52d879b74b038c6484c343be0c6d&device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 1094 time: 0.2240729 May 12 15:29:40.470478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2513bc2-9548-429c-aefe-347664213ca6 req-827ef742-ae72-41cc-a922-a52df3c3dafc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:40.473923 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b2513bc2-9548-429c-aefe-347664213ca6 req-827ef742-ae72-41cc-a922-a52df3c3dafc service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 1095 time: 0.1699529 May 12 15:29:40.557872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7308c17a-7c17-422e-bcbb-57699b0ba194 req-017f82a2-3e05-4dba-98fe-4914f1e200dc tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:40.565794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7308c17a-7c17-422e-bcbb-57699b0ba194 req-017f82a2-3e05-4dba-98fe-4914f1e200dc tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 944 time: 0.1054986 May 12 15:29:40.625893 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7308c17a-7c17-422e-bcbb-57699b0ba194 req-b2f16af2-3699-4524-a39c-541c2c46df03 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0587423 May 12 15:29:40.716544 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-270435de-df47-438a-b667-8944fb5d68c3 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=88d33cdf-e82f-4136-be41-55530c917cf8 HTTP/1.1" status: 200 len: 217 time: 0.2359424 May 12 15:29:40.717623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2513bc2-9548-429c-aefe-347664213ca6 req-3908e0c6-7ec4-4c5e-80c4-d88041ee7239 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:40.718911 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b2513bc2-9548-429c-aefe-347664213ca6 req-3908e0c6-7ec4-4c5e-80c4-d88041ee7239 service neutron] 10.222.0.76 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 916 time: 0.2373066 May 12 15:29:40.991992 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b2513bc2-9548-429c-aefe-347664213ca6 req-2e218f62-53bc-476e-88c8-e2f455d9fa94 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=3283015e-7f0d-447c-b1c3-25d7034f9c29 HTTP/1.1" status: 200 len: 217 time: 0.2645688 May 12 15:29:41.082035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-b14d8fec-b8f8-4609-9cf3-a43e42072352 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:41.084212 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-b14d8fec-b8f8-4609-9cf3-a43e42072352 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=96c78285-c9d5-4380-8226-d529b98a4bae HTTP/1.1" status: 200 len: 854 time: 0.3587172 May 12 15:29:41.153549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0d5f909-ef4c-4dc8-af65-bbe1434469fc req-ecc591ce-ce5a-4053-aed6-a7870a4f0eaa tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:41.156230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0d5f909-ef4c-4dc8-af65-bbe1434469fc req-ecc591ce-ce5a-4053-aed6-a7870a4f0eaa tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 943 time: 0.1975291 May 12 15:29:41.184254 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-86d63243-cabf-4017-bceb-7aaa6647951b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9fcd5c26-ea02-456a-83eb-1bfa9b321252&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0931213 May 12 15:29:41.191347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2513bc2-9548-429c-aefe-347664213ca6 req-17571cd6-a0ec-4f51-aa1a-e278a1b1daa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:41.192903 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b2513bc2-9548-429c-aefe-347664213ca6 req-17571cd6-a0ec-4f51-aa1a-e278a1b1daa2 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 HTTP/1.1" status: 200 len: 854 time: 0.1940613 May 12 15:29:41.300712 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0d5f909-ef4c-4dc8-af65-bbe1434469fc req-b5b9ca79-0fdb-4ca3-822f-746699007f25 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1357071 May 12 15:29:41.531172 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-457fc6ce-3f98-4110-acbf-851a41a3226f service neutron] 10.222.0.84 "GET /v2.0/networks/9fcd5c26-ea02-456a-83eb-1bfa9b321252?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3371716 May 12 15:29:41.533120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2513bc2-9548-429c-aefe-347664213ca6 req-6fa3d797-05dc-4502-8db5-7078c05bc0c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:41.534708 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b2513bc2-9548-429c-aefe-347664213ca6 req-6fa3d797-05dc-4502-8db5-7078c05bc0c9 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=dbecac63-cd00-4ee6-bec1-19abe557d6e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3353624 May 12 15:29:41.564629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52e431b0-23f0-477b-91d0-fd30f452eee1 req-5dde23cf-3a5e-4e97-a6c7-82205e4ed252 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:41.569275 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52e431b0-23f0-477b-91d0-fd30f452eee1 req-5dde23cf-3a5e-4e97-a6c7-82205e4ed252 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 945 time: 0.1910753 May 12 15:29:41.665372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52e431b0-23f0-477b-91d0-fd30f452eee1 req-f8b29060-d55a-4450-a79b-55bb73605131 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/security-groups?id=f06114a8-6c81-42c9-a89e-943288e44fb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0831499 May 12 15:29:41.839323 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d47c0485-2e6c-47d6-b317-c1732c7fbadd req-febf55fb-24c6-4c1b-9568-836d8f14b123 service neutron] 10.222.0.84 "GET /v2.0/networks/9fcd5c26-ea02-456a-83eb-1bfa9b321252?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3011560 May 12 15:29:41.841427 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b2513bc2-9548-429c-aefe-347664213ca6 req-5d0f797e-a7f6-45a7-8a10-19a14b826773 service neutron] 10.222.0.76 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2794144 May 12 15:29:41.991449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888f2064-1463-4ece-bb4d-874a8c9633a0 req-7dcbf910-6291-417e-b15f-1edd1d9acf9f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:41.994230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-888f2064-1463-4ece-bb4d-874a8c9633a0 req-7dcbf910-6291-417e-b15f-1edd1d9acf9f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 944 time: 0.1797941 May 12 15:29:42.066696 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-888f2064-1463-4ece-bb4d-874a8c9633a0 req-feaa4171-5020-49bc-9909-aea8b39fc2ab tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0667605 May 12 15:29:42.194581 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b2513bc2-9548-429c-aefe-347664213ca6 req-725de2cb-663f-4547-8b20-064a981ff238 service neutron] 10.222.0.76 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3463740 May 12 15:29:42.269152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757e96d2-8fda-4f79-92b4-8f910a80cd41 req-d04aa973-1a12-498f-ae8a-393c69a6ff91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:42.271013 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-757e96d2-8fda-4f79-92b4-8f910a80cd41 req-d04aa973-1a12-498f-ae8a-393c69a6ff91 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=62fe52d879b74b038c6484c343be0c6d&device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 1094 time: 0.2519104 May 12 15:29:42.491920 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757e96d2-8fda-4f79-92b4-8f910a80cd41 req-36b1206c-4e5c-429a-be3c-104436bfc9a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:42.493238 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-757e96d2-8fda-4f79-92b4-8f910a80cd41 req-36b1206c-4e5c-429a-be3c-104436bfc9a9 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9fcd5c26-ea02-456a-83eb-1bfa9b321252 HTTP/1.1" status: 200 len: 915 time: 0.2145681 May 12 15:29:42.507957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 3283015e-7f0d-447c-b1c3-25d7034f9c29 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:29:42.634144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-757e96d2-8fda-4f79-92b4-8f910a80cd41 req-e56322f6-44eb-4f95-a8a2-3eb4c3266adc service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=88d33cdf-e82f-4136-be41-55530c917cf8 HTTP/1.1" status: 200 len: 217 time: 0.1343505 May 12 15:29:42.706812 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f6b8a22e-5fc4-409c-ba58-b271d617c007 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:42.774329 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 3283015e-7f0d-447c-b1c3-25d7034f9c29, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3283015e-7f0d-447c-b1c3-25d7034f9c29,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:42.803807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '3283015e-7f0d-447c-b1c3-25d7034f9c29', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'port_id': '3283015e-7f0d-447c-b1c3-25d7034f9c29', 'mac_address': 'fa:16:3e:05:58:7d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 598, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:29:42.808051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757e96d2-8fda-4f79-92b4-8f910a80cd41 req-a75b2489-69ab-4826-995b-b5e02da1eff2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:42.811712 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-757e96d2-8fda-4f79-92b4-8f910a80cd41 req-a75b2489-69ab-4826-995b-b5e02da1eff2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=96c78285-c9d5-4380-8226-d529b98a4bae HTTP/1.1" status: 200 len: 854 time: 0.1695888 May 12 15:29:42.903906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd8ef7a-1078-492f-b505-cba39dfa9f53 req-e083cb16-4138-4700-b194-505e277e60c4 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:42.930781 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8cd8ef7a-1078-492f-b505-cba39dfa9f53 req-e083cb16-4138-4700-b194-505e277e60c4 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 945 time: 0.5040395 May 12 15:29:42.943655 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-757e96d2-8fda-4f79-92b4-8f910a80cd41 req-9073d123-ee02-48ef-9783-0389dd23956e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9fcd5c26-ea02-456a-83eb-1bfa9b321252&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1227028 May 12 15:29:42.990529 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:43.025086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c90f3511-8eaa-405d-87d6-c7454dc0e0fc req-7b423b8d-4e34-4ef5-8755-6b312014f64b tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:43.040597 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c90f3511-8eaa-405d-87d6-c7454dc0e0fc req-7b423b8d-4e34-4ef5-8755-6b312014f64b tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 943 time: 0.4900088 May 12 15:29:43.055406 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3283015e-7f0d-447c-b1c3-25d7034f9c29 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:29:43.074377 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:43.095522 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 3283015e-7f0d-447c-b1c3-25d7034f9c29, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3283015e-7f0d-447c-b1c3-25d7034f9c29,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:43.105487 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:43.146792 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c90f3511-8eaa-405d-87d6-c7454dc0e0fc req-8535e353-134d-453d-81c9-39a062f17741 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0968077 May 12 15:29:43.163789 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-757e96d2-8fda-4f79-92b4-8f910a80cd41 req-d34d1a15-2233-42c3-a369-ab011e2b4280 service neutron] 10.222.0.84 "GET /v2.0/networks/9fcd5c26-ea02-456a-83eb-1bfa9b321252?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2053354 May 12 15:29:43.218840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8cd8ef7a-1078-492f-b505-cba39dfa9f53 req-cde9d03f-6c98-4039-8cdb-0ae35887a91f tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/security-groups?id=f06114a8-6c81-42c9-a89e-943288e44fb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2855833 May 12 15:29:43.333896 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=3283015e-7f0d-447c-b1c3-25d7034f9c29,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:43.444370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['3283015e-7f0d-447c-b1c3-25d7034f9c29'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:29:43.466713 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-757e96d2-8fda-4f79-92b4-8f910a80cd41 req-5ea17e12-cb04-41d9-b777-6e16311732ef service neutron] 10.222.0.84 "GET /v2.0/networks/9fcd5c26-ea02-456a-83eb-1bfa9b321252?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3031354 May 12 15:29:43.503311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 88d33cdf-e82f-4136-be41-55530c917cf8 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:29:43.528311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96026eb8-877f-4f76-a1a6-d125af39f09c req-2b0dd877-633c-41d4-80df-4360d2c4691e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:43.535382 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96026eb8-877f-4f76-a1a6-d125af39f09c req-2b0dd877-633c-41d4-80df-4360d2c4691e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 945 time: 0.1877949 May 12 15:29:43.593378 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96026eb8-877f-4f76-a1a6-d125af39f09c req-493256e7-1b06-4d2e-b0a2-1d21ea3739b7 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0565093 May 12 15:29:43.761006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 88d33cdf-e82f-4136-be41-55530c917cf8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=88d33cdf-e82f-4136-be41-55530c917cf8,segment=NetworkSegment(55a17244-91f1-417b-91ca-c9ffff8c08a6),segment_id=55a17244-91f1-417b-91ca-c9ffff8c08a6)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:43.810079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '88d33cdf-e82f-4136-be41-55530c917cf8', 'network_id': '9fcd5c26-ea02-456a-83eb-1bfa9b321252', 'port_id': '88d33cdf-e82f-4136-be41-55530c917cf8', 'mac_address': 'fa:16:3e:fd:ad:49', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 567, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96c78285-c9d5-4380-8226-d529b98a4bae', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:29:43.874208 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:43.898281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 88d33cdf-e82f-4136-be41-55530c917cf8 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:29:43.914767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 88d33cdf-e82f-4136-be41-55530c917cf8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=88d33cdf-e82f-4136-be41-55530c917cf8,segment=NetworkSegment(55a17244-91f1-417b-91ca-c9ffff8c08a6),segment_id=55a17244-91f1-417b-91ca-c9ffff8c08a6)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:43.920379 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:43.996115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=88d33cdf-e82f-4136-be41-55530c917cf8,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:44.033672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec7446a5-7607-4b26-b2cd-4bba8f531706 req-302b937e-336a-4ccf-b241-614036b13c7a tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:44.035246 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ec7446a5-7607-4b26-b2cd-4bba8f531706 req-302b937e-336a-4ccf-b241-614036b13c7a tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.84 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 945 time: 0.1128280 May 12 15:29:44.111061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-ec7446a5-7607-4b26-b2cd-4bba8f531706 req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Deleting port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:29:44.111414 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ec7446a5-7607-4b26-b2cd-4bba8f531706 req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:44.267732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['88d33cdf-e82f-4136-be41-55530c917cf8'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:29:44.451933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ec7446a5-7607-4b26-b2cd-4bba8f531706 req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] For port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85ca879e-d214-4ff0-be9a-f3ad428f6bc9,segment=NetworkSegment(da373224-8462-4e0e-be31-39b312fe2761),segment_id=da373224-8462-4e0e-be31-39b312fe2761)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:44.453146 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ec7446a5-7607-4b26-b2cd-4bba8f531706 req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:44.545788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 3283015e-7f0d-447c-b1c3-25d7034f9c29 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:29:44.650586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-ec7446a5-7607-4b26-b2cd-4bba8f531706 req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Calling delete_port for 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:29:44.750447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 3283015e-7f0d-447c-b1c3-25d7034f9c29 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:29:44.759368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 3283015e-7f0d-447c-b1c3-25d7034f9c29 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:29:44.760003 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:44.948932 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ec7446a5-7607-4b26-b2cd-4bba8f531706 req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:44.991480 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e359c676-2e3a-4598-a3d3-e088d6069337 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:45.010334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a06ce71-6297-4b1e-9f3f-62e109f1d9d7 req-5482b831-5833-4906-8eb1-61e6722cd52e tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:45.012836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a06ce71-6297-4b1e-9f3f-62e109f1d9d7 req-5482b831-5833-4906-8eb1-61e6722cd52e tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 944 time: 0.6461740 May 12 15:29:45.026649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f0886ac-62a1-4852-8edd-bf005acaa6a3 req-afbbcc72-8fbc-4b4b-9559-49c70ce7b82f tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:45.026996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Pushing event deleted for resources: {'Port': ['ID=85ca879e-d214-4ff0-be9a-f3ad428f6bc9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:45.038882 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0f0886ac-62a1-4852-8edd-bf005acaa6a3 req-afbbcc72-8fbc-4b4b-9559-49c70ce7b82f tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/ports?device_id=03996107-5ca7-49b6-8024-7fdecb4795b8 HTTP/1.1" status: 200 len: 945 time: 0.5683508 May 12 15:29:45.043434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:45.043961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:45.044097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:45.044432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:45.045489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:45.045870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:45.046625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:45.046739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:45.047478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:45.047707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:45.048080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:45.048534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:45.077627 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:45.117785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ac261e00-23bd-428e-af60-6376594bb94f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3283015e-7f0d-447c-b1c3-25d7034f9c29'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:29:45.138071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 3283015e-7f0d-447c-b1c3-25d7034f9c29, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3283015e-7f0d-447c-b1c3-25d7034f9c29,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:45.143802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ec7446a5-7607-4b26-b2cd-4bba8f531706 req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] No DVR routers for this DVR port 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:29:45.143968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0f0886ac-62a1-4852-8edd-bf005acaa6a3 req-e3e0c335-1f3e-4e2e-875f-a59a5d6e619e tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.82 "GET /v2.0/security-groups?id=f06114a8-6c81-42c9-a89e-943288e44fb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1037900 May 12 15:29:45.146238 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:45.147453 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ec7446a5-7607-4b26-b2cd-4bba8f531706 req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:45.153929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a06ce71-6297-4b1e-9f3f-62e109f1d9d7 req-2275cb5a-ad49-43c9-ab89-b9bdd7fa9cae tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1115298 May 12 15:29:45.154176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '03996107-5ca7-49b6-8024-7fdecb4795b8', 'name': 'network-vif-deleted', 'tag': '85ca879e-d214-4ff0-be9a-f3ad428f6bc9'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:29:45.180928 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ec7446a5-7607-4b26-b2cd-4bba8f531706 req-3df2a887-4cb4-4034-8ad0-1bb1944e6226 tempest-ServerAddressesNegativeTestJSON-191675730 tempest-ServerAddressesNegativeTestJSON-191675730-project] 10.222.0.84 "DELETE /v2.0/ports/85ca879e-d214-4ff0-be9a-f3ad428f6bc9 HTTP/1.1" status: 204 len: 173 time: 1.1388578 May 12 15:29:45.240539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=3283015e-7f0d-447c-b1c3-25d7034f9c29,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:45.256108 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3b7d3f92-3f9d-49e5-a315-816ca5aeac54'] response: {'server_uuid': 'ac261e00-23bd-428e-af60-6376594bb94f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3283015e-7f0d-447c-b1c3-25d7034f9c29', 'code': 200} May 12 15:29:45.304758 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bfcc5082-59bc-4158-8946-3bec4e516b8a'] response: {'server_uuid': '03996107-5ca7-49b6-8024-7fdecb4795b8', 'name': 'network-vif-deleted', 'tag': '85ca879e-d214-4ff0-be9a-f3ad428f6bc9', 'status': 'completed', 'code': 200} May 12 15:29:45.416299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['85ca879e-d214-4ff0-be9a-f3ad428f6bc9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:29:45.526007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 88d33cdf-e82f-4136-be41-55530c917cf8 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:29:45.527285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c78bef-30a9-4310-a8cd-b6a4e62d71d1 req-848b871a-97ba-40e3-b23c-2fba079c10b4 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:45.529268 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20c78bef-30a9-4310-a8cd-b6a4e62d71d1 req-848b871a-97ba-40e3-b23c-2fba079c10b4 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 946 time: 0.1364031 May 12 15:29:45.533639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21b71e9d-a3cc-4eea-9d6b-bab34fbc8fbd req-a3daa04d-d48a-4ffc-9f9c-4bc7d6a2f887 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:45.538834 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-21b71e9d-a3cc-4eea-9d6b-bab34fbc8fbd req-a3daa04d-d48a-4ffc-9f9c-4bc7d6a2f887 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 1097 time: 0.1336882 May 12 15:29:45.590946 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-21b71e9d-a3cc-4eea-9d6b-bab34fbc8fbd req-9c248af8-c94b-4705-8535-cceafee09a46 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451355 May 12 15:29:45.595542 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20c78bef-30a9-4310-a8cd-b6a4e62d71d1 req-1f470530-0fc8-4e07-86aa-25ed90e45bc7 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0565732 May 12 15:29:45.651080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 88d33cdf-e82f-4136-be41-55530c917cf8 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:29:45.656389 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 88d33cdf-e82f-4136-be41-55530c917cf8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:29:45.656951 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:45.764688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47484) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:45.807223 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:45.853047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 88d33cdf-e82f-4136-be41-55530c917cf8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=88d33cdf-e82f-4136-be41-55530c917cf8,segment=NetworkSegment(55a17244-91f1-417b-91ca-c9ffff8c08a6),segment_id=55a17244-91f1-417b-91ca-c9ffff8c08a6)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:45.857886 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:45.947223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef8a29e2-1ba2-467f-8b97-a682f4c705af admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:45.956260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=88d33cdf-e82f-4136-be41-55530c917cf8,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:45.969863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ef8a29e2-1ba2-467f-8b97-a682f4c705af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:45.973942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef8a29e2-1ba2-467f-8b97-a682f4c705af admin admin] Usage tracker for resource:security_group_rule and tenant:431659de5d7d489b8f8104d8a051203b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:45.977296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef8a29e2-1ba2-467f-8b97-a682f4c705af admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:45.983502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ef8a29e2-1ba2-467f-8b97-a682f4c705af admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:46.025176 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:46.106394 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef8a29e2-1ba2-467f-8b97-a682f4c705af admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:46.113246 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef8a29e2-1ba2-467f-8b97-a682f4c705af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:46.154720 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:46.168604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef8a29e2-1ba2-467f-8b97-a682f4c705af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=29be8bc7-cf64-4a44-8f1c-a56ba4cb314a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:46.174073 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ef8a29e2-1ba2-467f-8b97-a682f4c705af admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=431659de5d7d489b8f8104d8a051203b&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4081814 May 12 15:29:46.176989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47492) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:46.262308 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21af65cd-4f72-4ebc-b60e-42e213f7e821 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:46.268871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47500) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:46.314276 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21af65cd-4f72-4ebc-b60e-42e213f7e821 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:46.440116 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21af65cd-4f72-4ebc-b60e-42e213f7e821 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:46.451710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-8e992a59-eba6-4a7e-acad-5a6623ffc2c8 admin admin] Deleting subnet 10d54a68-c83a-4e43-a45d-73cca0182498 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:29:46.456925 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e992a59-eba6-4a7e-acad-5a6623ffc2c8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:46.463245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0345266a-2e94-4c3b-9d59-9d05bab8e341 req-064e4ed6-d638-45c6-953c-006e19fb718f tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:46.464729 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0345266a-2e94-4c3b-9d59-9d05bab8e341 req-064e4ed6-d638-45c6-953c-006e19fb718f tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 945 time: 0.1265466 May 12 15:29:46.469221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21af65cd-4f72-4ebc-b60e-42e213f7e821 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=29be8bc7-cf64-4a44-8f1c-a56ba4cb314a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:46.474415 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21af65cd-4f72-4ebc-b60e-42e213f7e821 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:46.475458 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-21af65cd-4f72-4ebc-b60e-42e213f7e821 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/29be8bc7-cf64-4a44-8f1c-a56ba4cb314a HTTP/1.1" status: 204 len: 168 time: 0.2969081 May 12 15:29:46.517743 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e992a59-eba6-4a7e-acad-5a6623ffc2c8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:46.550321 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0345266a-2e94-4c3b-9d59-9d05bab8e341 req-6d400332-6241-4e62-b9a9-2fb8efd0b25e tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0616534 May 12 15:29:46.596273 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e992a59-eba6-4a7e-acad-5a6623ffc2c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:46.704110 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e992a59-eba6-4a7e-acad-5a6623ffc2c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:46.773296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e992a59-eba6-4a7e-acad-5a6623ffc2c8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=10d54a68-c83a-4e43-a45d-73cca0182498,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:46.776162 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8e992a59-eba6-4a7e-acad-5a6623ffc2c8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:46.791327 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8e992a59-eba6-4a7e-acad-5a6623ffc2c8 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/10d54a68-c83a-4e43-a45d-73cca0182498 HTTP/1.1" status: 204 len: 168 time: 0.5182245 May 12 15:29:46.792418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47512) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:46.824679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba4f19d-ede0-49fc-b290-dbc261e76487 req-f41b1b19-581e-4ca8-a1cb-b1ac3d4aa44a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:46.833344 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ba4f19d-ede0-49fc-b290-dbc261e76487 req-f41b1b19-581e-4ca8-a1cb-b1ac3d4aa44a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 946 time: 0.1094465 May 12 15:29:46.892094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ba4f19d-ede0-49fc-b290-dbc261e76487 req-a6434dbf-a0f5-479a-950a-75761f83ee8e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0574315 May 12 15:29:46.968237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47518) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:46.971957 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-357c7ba7-6551-4203-9ed7-adaf6a461f2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:46.990946 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a48ad7d-1d31-4a9d-a6e2-78c32b0ace06 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:47.014464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9a48ad7d-1d31-4a9d-a6e2-78c32b0ace06 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:47.023218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9a48ad7d-1d31-4a9d-a6e2-78c32b0ace06 admin admin] Usage tracker for resource:security_group_rule and tenant:baa51e6ecfaa4ffc9db1c258a030802b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:47.027955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9a48ad7d-1d31-4a9d-a6e2-78c32b0ace06 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:47.037666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9a48ad7d-1d31-4a9d-a6e2-78c32b0ace06 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:47.140500 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a48ad7d-1d31-4a9d-a6e2-78c32b0ace06 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:47.145646 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a48ad7d-1d31-4a9d-a6e2-78c32b0ace06 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:47.181534 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-357c7ba7-6551-4203-9ed7-adaf6a461f2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:47.198688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9a48ad7d-1d31-4a9d-a6e2-78c32b0ace06 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=baa51e6ecfaa4ffc9db1c258a030802b&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2265537 May 12 15:29:47.199135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47528) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:47.230142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a48ad7d-1d31-4a9d-a6e2-78c32b0ace06 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=daa463f3-7156-461e-9d06-9cdae55139e5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:47.233324 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-357c7ba7-6551-4203-9ed7-adaf6a461f2a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7c34d3f3-9a49-4501-bf9e-00e6928084e4']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:47.252496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-357c7ba7-6551-4203-9ed7-adaf6a461f2a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'da373224-8462-4e0e-be31-39b312fe2761') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:47.253604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-357c7ba7-6551-4203-9ed7-adaf6a461f2a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'da373224-8462-4e0e-be31-39b312fe2761') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:47.257195 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a01fffac-1332-4d92-812c-69e704d19ed5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '88d33cdf-e82f-4136-be41-55530c917cf8'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:29:47.281286 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-357c7ba7-6551-4203-9ed7-adaf6a461f2a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:47.323601 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-357c7ba7-6551-4203-9ed7-adaf6a461f2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:47.331876 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fd85a6f4-bca8-47fc-bc69-af28e7ea409e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:47.336118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-357c7ba7-6551-4203-9ed7-adaf6a461f2a admin admin] Releasing vlan 582 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:29:47.336529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-357c7ba7-6551-4203-9ed7-adaf6a461f2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: timer() May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:29:47.353509 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:29:47.360046 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8bf36b27-d58a-440c-ad9a-0b2a7e657709'] response: {'server_uuid': 'a01fffac-1332-4d92-812c-69e704d19ed5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '88d33cdf-e82f-4136-be41-55530c917cf8', 'code': 200} May 12 15:29:47.374912 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fd85a6f4-bca8-47fc-bc69-af28e7ea409e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:47.438620 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-357c7ba7-6551-4203-9ed7-adaf6a461f2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:47.446191 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fd85a6f4-bca8-47fc-bc69-af28e7ea409e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:47.467082 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-357c7ba7-6551-4203-9ed7-adaf6a461f2a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:47.468007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd85a6f4-bca8-47fc-bc69-af28e7ea409e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=daa463f3-7156-461e-9d06-9cdae55139e5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:47.475145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-357c7ba7-6551-4203-9ed7-adaf6a461f2a admin admin] Pushing event deleted for resources: {'Network': ['ID=7c34d3f3-9a49-4501-bf9e-00e6928084e4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:47.475426 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fd85a6f4-bca8-47fc-bc69-af28e7ea409e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:47.476590 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fd85a6f4-bca8-47fc-bc69-af28e7ea409e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/daa463f3-7156-461e-9d06-9cdae55139e5 HTTP/1.1" status: 204 len: 168 time: 0.2769670 May 12 15:29:47.522309 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-357c7ba7-6551-4203-9ed7-adaf6a461f2a admin admin] 10.222.0.82 "DELETE /v2.0/networks/7c34d3f3-9a49-4501-bf9e-00e6928084e4 HTTP/1.1" status: 204 len: 168 time: 0.7285070 May 12 15:29:47.558069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf19ae8c-1024-4ff5-a92a-bdf1eb841f73 req-9834bab1-cf7d-45b9-8592-42630873100e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:47.559623 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bf19ae8c-1024-4ff5-a92a-bdf1eb841f73 req-9834bab1-cf7d-45b9-8592-42630873100e service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 1096 time: 0.0820198 May 12 15:29:47.612971 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bf19ae8c-1024-4ff5-a92a-bdf1eb841f73 req-ad5bb2db-08cb-4a9c-bdac-10b406257ad9 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426824 May 12 15:29:47.671150 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:47.782640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a790312-13de-4b51-a4bc-7dede962e9dc req-8e468e93-3438-49ff-a086-15e0fc58d239 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:47.784823 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a790312-13de-4b51-a4bc-7dede962e9dc req-8e468e93-3438-49ff-a086-15e0fc58d239 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 945 time: 0.1009481 May 12 15:29:47.855614 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a790312-13de-4b51-a4bc-7dede962e9dc req-20832319-1c52-489e-bae5-6804bd3110a4 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563400 May 12 15:29:47.863125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47542) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:47.947246 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ca63231d-6493-4db6-b949-2b76de2a5648 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=02fd2a705cfa43a294bf047063566817&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0778890 May 12 15:29:47.947246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47548) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:48.182328 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac1ee8d2-1049-45bb-9c21-de21ed52247f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:48.255875 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac1ee8d2-1049-45bb-9c21-de21ed52247f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:48.331139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f509bf47-e606-4ba4-8539-a4ed4fe1edf8 req-abe2c25e-d151-4839-8a0e-17aa5751afe4 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:48.347613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f509bf47-e606-4ba4-8539-a4ed4fe1edf8 req-abe2c25e-d151-4839-8a0e-17aa5751afe4 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 946 time: 0.2228107 May 12 15:29:48.378636 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac1ee8d2-1049-45bb-9c21-de21ed52247f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:48.439811 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac1ee8d2-1049-45bb-9c21-de21ed52247f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:48.443575 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ac1ee8d2-1049-45bb-9c21-de21ed52247f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f06114a8-6c81-42c9-a89e-943288e44fb6 HTTP/1.1" status: 204 len: 168 time: 0.4955223 May 12 15:29:48.449365 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f509bf47-e606-4ba4-8539-a4ed4fe1edf8 req-15a5887a-9b89-4127-972e-d85422171535 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1008594 May 12 15:29:48.450442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac1ee8d2-1049-45bb-9c21-de21ed52247f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f06114a8-6c81-42c9-a89e-943288e44fb6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:48.742398 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-124b814d-6074-44cb-b886-583b10774f91 req-3844f1a4-b20b-4c65-a214-35c7ba048ef9 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:48.746363 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-124b814d-6074-44cb-b886-583b10774f91 req-3844f1a4-b20b-4c65-a214-35c7ba048ef9 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 946 time: 0.1567128 May 12 15:29:48.752707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47582) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:48.759124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4127acd7-fad7-487d-ac91-16f7c3588382 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'floatingip': {'port_id': '3283015e-7f0d-447c-b1c3-25d7034f9c29'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:48.990504 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4127acd7-fad7-487d-ac91-16f7c3588382 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:49.263747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62829a90-628b-44ae-b488-e096d5fe7ec0 req-35fec35f-b112-44a3-9e5a-77db9011e5ed tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:49.280712 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62829a90-628b-44ae-b488-e096d5fe7ec0 req-35fec35f-b112-44a3-9e5a-77db9011e5ed tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 945 time: 0.2496715 May 12 15:29:49.344608 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62829a90-628b-44ae-b488-e096d5fe7ec0 req-28b4fae1-f94a-43ab-8fb8-bd3e2862df98 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0627975 May 12 15:29:49.514913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:29:49.568503 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:29:49.570445 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 85ca879e-d214-4ff0-be9a-f3ad428f6bc9 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:29:50.256956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eac2d3de-2c2c-4113-9f62-0fdd067ad7c6 req-47958c4f-72e8-4c4f-99e2-b7355deeeffa tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:50.268358 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eac2d3de-2c2c-4113-9f62-0fdd067ad7c6 req-47958c4f-72e8-4c4f-99e2-b7355deeeffa tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 945 time: 0.1905587 May 12 15:29:50.303659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6306ac0a-23e3-4048-a28d-c5044361f302 req-0c51f74e-e674-4f7d-a513-315345dd54a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:50.305759 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6306ac0a-23e3-4048-a28d-c5044361f302 req-0c51f74e-e674-4f7d-a513-315345dd54a6 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=62fe52d879b74b038c6484c343be0c6d&device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 1096 time: 0.2639599 May 12 15:29:50.349937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eac2d3de-2c2c-4113-9f62-0fdd067ad7c6 req-0b347701-5687-4859-9b3b-c45527a1eb8b tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0801454 May 12 15:29:50.618934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6306ac0a-23e3-4048-a28d-c5044361f302 req-c29c4e52-1857-4d78-88c0-22b742a7482a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:50.620454 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6306ac0a-23e3-4048-a28d-c5044361f302 req-c29c4e52-1857-4d78-88c0-22b742a7482a service neutron] 10.222.0.84 "GET /v2.0/networks?id=9fcd5c26-ea02-456a-83eb-1bfa9b321252 HTTP/1.1" status: 200 len: 915 time: 0.3074954 May 12 15:29:50.622739 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4127acd7-fad7-487d-ac91-16f7c3588382 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:50.757306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4127acd7-fad7-487d-ac91-16f7c3588382 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:50.876593 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6306ac0a-23e3-4048-a28d-c5044361f302 req-6c850504-bb2b-40d2-8f52-b91bdaf0c6e0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=88d33cdf-e82f-4136-be41-55530c917cf8 HTTP/1.1" status: 200 len: 217 time: 0.2493727 May 12 15:29:51.019856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47656) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:51.023250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6306ac0a-23e3-4048-a28d-c5044361f302 req-011985e0-3228-4574-8345-a4c3d496bb42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:51.024958 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6306ac0a-23e3-4048-a28d-c5044361f302 req-011985e0-3228-4574-8345-a4c3d496bb42 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=96c78285-c9d5-4380-8226-d529b98a4bae HTTP/1.1" status: 200 len: 854 time: 0.1349323 May 12 15:29:51.100547 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6306ac0a-23e3-4048-a28d-c5044361f302 req-538e268a-61ce-4c11-b9ea-54197a86ce41 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9fcd5c26-ea02-456a-83eb-1bfa9b321252&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0665016 May 12 15:29:51.228872 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-4127acd7-fad7-487d-ac91-16f7c3588382 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Floating IP f8768448-30de-4f5a-8cc7-13fa25003fa4 associated. External IP: 172.25.8.41, port: 3283015e-7f0d-447c-b1c3-25d7034f9c29. May 12 15:29:51.448223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Request body: {'network': {'name': 'tempest-VirtualInterfacesTestJSON-468570043-network', 'tenant_id': '6b9a147322704dcf9902a4b65ead092c'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:51.470028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:51.484715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Usage tracker for resource:network and tenant:6b9a147322704dcf9902a4b65ead092c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:51.502558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:51.525508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:51.561968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Made reservation on behalf of 6b9a147322704dcf9902a4b65ead092c for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:29:51.564395 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:51.651447 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:51.689683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:51.695705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Usage tracker for resource:security_group_rule and tenant:6b9a147322704dcf9902a4b65ead092c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:51.700628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:51.718831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:51.753501 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6306ac0a-23e3-4048-a28d-c5044361f302 req-4153ded8-8bba-4261-b0b2-8f421f48e84b service neutron] 10.222.0.84 "GET /v2.0/networks/9fcd5c26-ea02-456a-83eb-1bfa9b321252?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6452627 May 12 15:29:51.891069 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:29:51.894635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4127acd7-fad7-487d-ac91-16f7c3588382 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:29:52.022550 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:52.039917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:52.183941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec4b1cad-7171-4d31-b87b-006f48d1a65c req-7c681f8a-9bf9-4b78-826a-f611bad37c76 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:52.186042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec4b1cad-7171-4d31-b87b-006f48d1a65c req-7c681f8a-9bf9-4b78-826a-f611bad37c76 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 945 time: 0.5995407 May 12 15:29:52.186992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 560} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:29:52.211192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57678d6a-171d-4300-88a3-f9f92011ff42,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:52.241317 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6306ac0a-23e3-4048-a28d-c5044361f302 req-b492dd9a-1864-4c3f-84cf-aa4dd084abb6 service neutron] 10.222.0.84 "GET /v2.0/networks/9fcd5c26-ea02-456a-83eb-1bfa9b321252?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4811931 May 12 15:29:52.248622 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:52.249166 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Added segment cca18641-fdf9-4a98-af11-692bb6253815 of type vlan for network e004e7e3-e16b-4337-9a09-b78996c8469a May 12 15:29:52.321590 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:52.327794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec4b1cad-7171-4d31-b87b-006f48d1a65c req-58641925-0aa6-49a3-87ab-4c8173a19f37 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1177039 May 12 15:29:52.384578 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:52.385584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:52.386170 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:52.388948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4127acd7-fad7-487d-ac91-16f7c3588382 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:29:52.402270 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b891686-1601-4848-bc96-7393d2551a25 None None] Sync routers for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:29:52.404405 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4127acd7-fad7-487d-ac91-16f7c3588382 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:52.418131 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b891686-1601-4848-bc96-7393d2551a25 None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:29:52.418757 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9b891686-1601-4848-bc96-7393d2551a25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:29:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:52.495656 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4127acd7-fad7-487d-ac91-16f7c3588382 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "PUT /v2.0/floatingips/f8768448-30de-4f5a-8cc7-13fa25003fa4 HTTP/1.1" status: 200 len: 991 time: 3.7390828 May 12 15:29:52.498958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac261e00-23bd-428e-af60-6376594bb94f', 'tag': '3283015e-7f0d-447c-b1c3-25d7034f9c29'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:29:52.609936 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a943c759-643a-4f52-9b6b-dbf643969cc1'] response: {'name': 'network-changed', 'server_uuid': 'ac261e00-23bd-428e-af60-6376594bb94f', 'tag': '3283015e-7f0d-447c-b1c3-25d7034f9c29', 'status': 'completed', 'code': 200} May 12 15:29:52.637614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47716) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:52.651566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Pushing event updated for resources: {'Network': ['ID=e004e7e3-e16b-4337-9a09-b78996c8469a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:52.690733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 1.6625571 May 12 15:29:52.696127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47722) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:52.701836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Request body: {'subnet': {'network_id': 'e004e7e3-e16b-4337-9a09-b78996c8469a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VirtualInterfacesTestJSON-468570043-subnet', 'tenant_id': '6b9a147322704dcf9902a4b65ead092c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:29:52.704858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:52.705420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:52.705935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:52.706462 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:52.706965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:52.708013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:52.708517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:52.709020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:52.709570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:52.710039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:52.710505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:52.710985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dabc10a-78bf-40c1-8e84-e9c02acd8167 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:29:52.711099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:52.727624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network e004e7e3-e16b-4337-9a09-b78996c8469a details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:29:52.748562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Usage tracker for resource:subnet and tenant:6b9a147322704dcf9902a4b65ead092c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:52.768463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:52.786549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:52.816018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Made reservation on behalf of 6b9a147322704dcf9902a4b65ead092c for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:29:52.819308 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:52.911904 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-9b891686-1601-4848-bc96-7393d2551a25 None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:29:53.268584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-934bc10c-0392-40a4-9f85-18bead825e33 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:53.395300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-934bc10c-0392-40a4-9f85-18bead825e33 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:53.451464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-934bc10c-0392-40a4-9f85-18bead825e33 admin admin] Usage tracker for resource:security_group_rule and tenant:421584d13d9a40189afd67ea88a72588 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:53.474624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-934bc10c-0392-40a4-9f85-18bead825e33 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:53.518864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-934bc10c-0392-40a4-9f85-18bead825e33 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:53.523543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4cfe98c-9ab8-424a-a252-62972c37e791 req-11e7f603-b68d-4cfd-8d00-61c7b3bf6cda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:53.538757 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4cfe98c-9ab8-424a-a252-62972c37e791 req-11e7f603-b68d-4cfd-8d00-61c7b3bf6cda service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 1097 time: 0.9174628 May 12 15:29:53.817363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd9db23d-3ea3-4bd4-93ac-5667c4e0633c req-07e0e0ad-25a7-4a4c-bc21-8ce62880bc3c tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:53.830765 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd9db23d-3ea3-4bd4-93ac-5667c4e0633c req-07e0e0ad-25a7-4a4c-bc21-8ce62880bc3c tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 945 time: 0.1920028 May 12 15:29:53.891333 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9b891686-1601-4848-bc96-7393d2551a25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ad94042f-a6a1-4708-ab51-e49f96948e07', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.38', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 2012, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:b0:1d:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:27:56Z', 'updated_at': '2022-05-12T15:28:32Z', 'revision_number': 2, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}, {'id': 'f8768448-30de-4f5a-8cc7-13fa25003fa4', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.41', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': '3283015e-7f0d-447c-b1c3-25d7034f9c29', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 2088, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:05:58:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac261e00-23bd-428e-af60-6376594bb94f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:29:23Z', 'updated_at': '2022-05-12T15:29:50Z', 'revision_number': 1, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:53.895949 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b891686-1601-4848-bc96-7393d2551a25 None None] Checking router: 616c45f4-38af-4ff7-8fb7-f1c61b204b6a for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:29:53.910107 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd9db23d-3ea3-4bd4-93ac-5667c4e0633c req-22bb7a2e-4bd9-46db-845d-0a812e091e00 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759919 May 12 15:29:53.912606 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b891686-1601-4848-bc96-7393d2551a25 None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:29:53.913881 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9b891686-1601-4848-bc96-7393d2551a25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:29:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:53.940694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4cfe98c-9ab8-424a-a252-62972c37e791 req-b30c08a9-c707-4d6f-b0b4-c8ed1d9d609a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:53.943310 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4cfe98c-9ab8-424a-a252-62972c37e791 req-b30c08a9-c707-4d6f-b0b4-c8ed1d9d609a service neutron] 10.222.0.76 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 916 time: 0.3852301 May 12 15:29:54.153135 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-9b891686-1601-4848-bc96-7393d2551a25 None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:29:54.270934 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-934bc10c-0392-40a4-9f85-18bead825e33 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:54.275952 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4cfe98c-9ab8-424a-a252-62972c37e791 req-815bcadc-996b-4357-883f-ff0e6e5f5b8f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=3283015e-7f0d-447c-b1c3-25d7034f9c29 HTTP/1.1" status: 200 len: 999 time: 0.3209105 May 12 15:29:54.280644 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-934bc10c-0392-40a4-9f85-18bead825e33 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:54.368531 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:54.545669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-934bc10c-0392-40a4-9f85-18bead825e33 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f2fab8a-e6c5-4043-a10f-678a06a73764,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:54.602993 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-934bc10c-0392-40a4-9f85-18bead825e33 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=421584d13d9a40189afd67ea88a72588&name=default HTTP/1.1" status: 200 len: 2983 time: 1.9640610 May 12 15:29:54.609493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47754) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:54.648800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Checking segment: {'id': 'cca18641-fdf9-4a98-af11-692bb6253815', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 560, 'network_id': 'e004e7e3-e16b-4337-9a09-b78996c8469a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:29:54.649644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Network hostable DHCP agents. Network: e004e7e3-e16b-4337-9a09-b78996c8469a, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:29:54.677094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4cfe98c-9ab8-424a-a252-62972c37e791 req-89fd0556-7a52-41a6-ae2c-a2d6b4f666b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:54.678825 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4cfe98c-9ab8-424a-a252-62972c37e791 req-89fd0556-7a52-41a6-ae2c-a2d6b4f666b8 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 HTTP/1.1" status: 200 len: 854 time: 0.3813727 May 12 15:29:54.679878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Pushing event updated for resources: {'Subnet': ['ID=a57aab88-cfb0-47f4-b8b5-a62366e456cc,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:54.713208 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21d3cc33-f6cd-419f-b36b-145b5aba3c20 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:54.752007 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21d3cc33-f6cd-419f-b36b-145b5aba3c20 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:54.752228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Network e004e7e3-e16b-4337-9a09-b78996c8469a is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:29:54.780890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, e004e7e3-e16b-4337-9a09-b78996c8469a) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:29:54.786170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6de623cd-3702-469a-a9e1-56738b7b295c req-08b37772-8896-44b8-87c7-e347e6e3b42b tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:54.788495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:54.789148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:54.793587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b327d55-9e28-4c90-be90-052cd95ab2ac None None] Network e004e7e3-e16b-4337-9a09-b78996c8469a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:29:54.795234 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6de623cd-3702-469a-a9e1-56738b7b295c req-08b37772-8896-44b8-87c7-e347e6e3b42b tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 945 time: 0.2400007 May 12 15:29:54.851554 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cfc24d12-aeeb-4aa4-9840-f52d480bedcf admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 2.1603148 May 12 15:29:54.887665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4cfe98c-9ab8-424a-a252-62972c37e791 req-f669f12f-bd96-4826-9ba1-9c4cd49fd3a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:54.899685 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4cfe98c-9ab8-424a-a252-62972c37e791 req-f669f12f-bd96-4826-9ba1-9c4cd49fd3a8 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=dbecac63-cd00-4ee6-bec1-19abe557d6e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2069297 May 12 15:29:54.946902 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9b891686-1601-4848-bc96-7393d2551a25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ad94042f-a6a1-4708-ab51-e49f96948e07', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.38', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 2012, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:b0:1d:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:27:56Z', 'updated_at': '2022-05-12T15:28:32Z', 'revision_number': 2, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}, {'id': 'f8768448-30de-4f5a-8cc7-13fa25003fa4', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.41', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': '3283015e-7f0d-447c-b1c3-25d7034f9c29', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 2088, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:05:58:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac261e00-23bd-428e-af60-6376594bb94f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:29:23Z', 'updated_at': '2022-05-12T15:29:50Z', 'revision_number': 1, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:54.955917 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b891686-1601-4848-bc96-7393d2551a25 None None] The sync data for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 is: [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ad94042f-a6a1-4708-ab51-e49f96948e07', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.38', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 2012, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:b0:1d:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:27:56Z', 'updated_at': '2022-05-12T15:28:32Z', 'revision_number': 2, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}, {'id': 'f8768448-30de-4f5a-8cc7-13fa25003fa4', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.41', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': '3283015e-7f0d-447c-b1c3-25d7034f9c29', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 2088, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:05:58:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac261e00-23bd-428e-af60-6376594bb94f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:29:23Z', 'updated_at': '2022-05-12T15:29:50Z', 'revision_number': 1, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:29:54.996924 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6de623cd-3702-469a-a9e1-56738b7b295c req-5014e7e4-49d5-414f-98e5-d3f5ca4fc13c tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1980977 May 12 15:29:55.050595 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21d3cc33-f6cd-419f-b36b-145b5aba3c20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:55.095439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21d3cc33-f6cd-419f-b36b-145b5aba3c20 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f2fab8a-e6c5-4043-a10f-678a06a73764,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:55.130983 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21d3cc33-f6cd-419f-b36b-145b5aba3c20 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:55.134438 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-21d3cc33-f6cd-419f-b36b-145b5aba3c20 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0f2fab8a-e6c5-4043-a10f-678a06a73764 HTTP/1.1" status: 204 len: 168 time: 0.5216789 May 12 15:29:55.303969 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4cfe98c-9ab8-424a-a252-62972c37e791 req-390323a0-1ba2-4d10-8328-a4363407d087 service neutron] 10.222.0.76 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3957086 May 12 15:29:55.334092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47770) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:55.628547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99f0fe8f-0c3a-4aea-a920-96472052348b None None] New status for floating IP f8768448-30de-4f5a-8cc7-13fa25003fa4: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:29:55.819055 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee674e3f-53f5-4f85-a937-a6139a825500 req-308b4d44-6ee5-487b-80a0-dcee7c21db5f service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.4348023 May 12 15:29:55.899748 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4393e5a2-7e0c-49fa-8e11-53dcdabd9a5c None None] Network e004e7e3-e16b-4337-9a09-b78996c8469a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:29:55.907577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-65214d18-8089-4c3c-a8ab-1f827cb2fdba admin admin] Deleting subnet a57aab88-cfb0-47f4-b8b5-a62366e456cc {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:29:55.923760 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65214d18-8089-4c3c-a8ab-1f827cb2fdba admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:56.036222 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65214d18-8089-4c3c-a8ab-1f827cb2fdba admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:56.085054 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee674e3f-53f5-4f85-a937-a6139a825500 req-39d1642b-860b-4a91-9c30-6e153c87c640 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.1308882 May 12 15:29:56.087340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47788) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:56.199113 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65214d18-8089-4c3c-a8ab-1f827cb2fdba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:56.329588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47798) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:56.416152 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65214d18-8089-4c3c-a8ab-1f827cb2fdba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:56.463176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65214d18-8089-4c3c-a8ab-1f827cb2fdba admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a57aab88-cfb0-47f4-b8b5-a62366e456cc,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:56.476360 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65214d18-8089-4c3c-a8ab-1f827cb2fdba admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:56.517334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0635e66b-c11d-4339-ae6c-b1ad228397c3 req-238966ee-a1bf-4490-a5e3-1740a9366ef3 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:56.518587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0635e66b-c11d-4339-ae6c-b1ad228397c3 req-238966ee-a1bf-4490-a5e3-1740a9366ef3 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 945 time: 0.2477996 May 12 15:29:56.532290 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-65214d18-8089-4c3c-a8ab-1f827cb2fdba admin admin] 10.222.0.82 "DELETE /v2.0/subnets/a57aab88-cfb0-47f4-b8b5-a62366e456cc HTTP/1.1" status: 204 len: 168 time: 1.1968012 May 12 15:29:56.538137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47804) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:56.604589 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4cfe98c-9ab8-424a-a252-62972c37e791 req-01b16f94-1149-4284-b2ba-4175bd16dcb0 service neutron] 10.222.0.76 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.2920320 May 12 15:29:56.612172 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee674e3f-53f5-4f85-a937-a6139a825500 req-4bd104d8-bc9b-44e9-8115-ae85bfbf4d8a service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.4301908 May 12 15:29:56.622786 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee5413d0-c7ae-40a0-8a0c-6cf613424bb9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:56.767587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ee5413d0-c7ae-40a0-8a0c-6cf613424bb9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:56.799794 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ee5413d0-c7ae-40a0-8a0c-6cf613424bb9 admin admin] Usage tracker for resource:security_group_rule and tenant:845bfe536a2842808eabe3d2541a6b13 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:56.821405 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0635e66b-c11d-4339-ae6c-b1ad228397c3 req-d459ee90-4a83-4b46-9044-42b75b3fb0e9 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2871857 May 12 15:29:56.837533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ee5413d0-c7ae-40a0-8a0c-6cf613424bb9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:56.843690 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6fb28638-bbb7-4e45-a427-fd3013290b0d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:56.855979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ee5413d0-c7ae-40a0-8a0c-6cf613424bb9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:56.869981 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77bc10a8-3b50-43d4-829a-f265389439de admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:56.874495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6fb28638-bbb7-4e45-a427-fd3013290b0d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:29:56.885171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6fb28638-bbb7-4e45-a427-fd3013290b0d admin admin] Usage tracker for resource:security_group_rule and tenant:a34d55f7540f4896acf27e7c80278080 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:29:56.889659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6fb28638-bbb7-4e45-a427-fd3013290b0d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:29:56.909660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01cf9b0d-d279-4553-bf11-a201c32b2e5a req-1b2653e2-2157-44ad-976b-98edb230bc2a tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:56.911048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-01cf9b0d-d279-4553-bf11-a201c32b2e5a req-1b2653e2-2157-44ad-976b-98edb230bc2a tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Synchronizing usage tracker for tenant:62fe52d879b74b038c6484c343be0c6d on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:29:56.927023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6fb28638-bbb7-4e45-a427-fd3013290b0d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:29:56.957724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee674e3f-53f5-4f85-a937-a6139a825500 req-b7535087-bb0d-407b-9298-6c6fe9b6e73e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:56.959680 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee674e3f-53f5-4f85-a937-a6139a825500 req-b7535087-bb0d-407b-9298-6c6fe9b6e73e service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3197215 May 12 15:29:56.994131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-01cf9b0d-d279-4553-bf11-a201c32b2e5a req-1b2653e2-2157-44ad-976b-98edb230bc2a tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Unset dirty status for tenant:62fe52d879b74b038c6484c343be0c6d on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:29:56.996420 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01cf9b0d-d279-4553-bf11-a201c32b2e5a req-1b2653e2-2157-44ad-976b-98edb230bc2a tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.84 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 945 time: 0.9031746 May 12 15:29:57.110738 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6fb28638-bbb7-4e45-a427-fd3013290b0d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.119418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6fb28638-bbb7-4e45-a427-fd3013290b0d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.121334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-01cf9b0d-d279-4553-bf11-a201c32b2e5a req-ecfa5e66-7266-4d40-9b08-6e25cad45c7f tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Deleting port 88d33cdf-e82f-4136-be41-55530c917cf8 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:29:57.121778 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-01cf9b0d-d279-4553-bf11-a201c32b2e5a req-ecfa5e66-7266-4d40-9b08-6e25cad45c7f tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.171789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6fb28638-bbb7-4e45-a427-fd3013290b0d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a34d55f7540f4896acf27e7c80278080&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8080802 May 12 15:29:57.179525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47814) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:57.206953 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77bc10a8-3b50-43d4-829a-f265389439de admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.237242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fb28638-bbb7-4e45-a427-fd3013290b0d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b82cecbc-9657-403b-99d7-5d1e73ad9973,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:57.267586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-77bc10a8-3b50-43d4-829a-f265389439de admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e004e7e3-e16b-4337-9a09-b78996c8469a']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:57.288108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-77bc10a8-3b50-43d4-829a-f265389439de admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cca18641-fdf9-4a98-af11-692bb6253815') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:57.288523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-77bc10a8-3b50-43d4-829a-f265389439de admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cca18641-fdf9-4a98-af11-692bb6253815') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:29:57.305620 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee5413d0-c7ae-40a0-8a0c-6cf613424bb9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.311368 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77bc10a8-3b50-43d4-829a-f265389439de admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.330367 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-078e1c0f-ceb2-43fb-b897-c1e091d108b9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.345007 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77bc10a8-3b50-43d4-829a-f265389439de admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.367207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-77bc10a8-3b50-43d4-829a-f265389439de admin admin] Releasing vlan 560 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:29:57.367775 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77bc10a8-3b50-43d4-829a-f265389439de admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: timer() May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:29:57.382835 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:29:57.389201 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee5413d0-c7ae-40a0-8a0c-6cf613424bb9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.448144 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-078e1c0f-ceb2-43fb-b897-c1e091d108b9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.540594 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77bc10a8-3b50-43d4-829a-f265389439de admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.560775 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ee5413d0-c7ae-40a0-8a0c-6cf613424bb9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=845bfe536a2842808eabe3d2541a6b13&name=default HTTP/1.1" status: 200 len: 2983 time: 1.3780193 May 12 15:29:57.566584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47822) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:57.581790 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77bc10a8-3b50-43d4-829a-f265389439de admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.588785 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-078e1c0f-ceb2-43fb-b897-c1e091d108b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.613067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77bc10a8-3b50-43d4-829a-f265389439de admin admin] Pushing event deleted for resources: {'Network': ['ID=e004e7e3-e16b-4337-9a09-b78996c8469a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:57.618799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-078e1c0f-ceb2-43fb-b897-c1e091d108b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b82cecbc-9657-403b-99d7-5d1e73ad9973,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:57.621076 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-078e1c0f-ceb2-43fb-b897-c1e091d108b9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.622193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-078e1c0f-ceb2-43fb-b897-c1e091d108b9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b82cecbc-9657-403b-99d7-5d1e73ad9973 HTTP/1.1" status: 204 len: 168 time: 0.4413595 May 12 15:29:57.625895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee5413d0-c7ae-40a0-8a0c-6cf613424bb9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f9b369e3-c66f-46c9-9720-c470608767ed,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:57.631433 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-77bc10a8-3b50-43d4-829a-f265389439de admin admin] 10.222.0.82 "DELETE /v2.0/networks/e004e7e3-e16b-4337-9a09-b78996c8469a HTTP/1.1" status: 204 len: 168 time: 1.0962055 May 12 15:29:57.842737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47830) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:57.933472 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c276350-4348-46f9-85fb-73db77100613 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:57.983372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cf731ae1-618a-4d79-888b-ed5b0b730b64 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6b9a147322704dcf9902a4b65ead092c&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1290517 May 12 15:29:57.983582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47838) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:29:58.043440 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-01cf9b0d-d279-4553-bf11-a201c32b2e5a req-ecfa5e66-7266-4d40-9b08-6e25cad45c7f tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] For port 88d33cdf-e82f-4136-be41-55530c917cf8, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=88d33cdf-e82f-4136-be41-55530c917cf8,segment=NetworkSegment(55a17244-91f1-417b-91ca-c9ffff8c08a6),segment_id=55a17244-91f1-417b-91ca-c9ffff8c08a6)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:29:58.043809 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-01cf9b0d-d279-4553-bf11-a201c32b2e5a req-ecfa5e66-7266-4d40-9b08-6e25cad45c7f tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:58.074832 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c276350-4348-46f9-85fb-73db77100613 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:58.281524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20929ee0-6e1d-48d8-93e3-2da98b4fab9c req-bc2ecba5-af12-4a76-b25a-ad4baec3f91c tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:29:58.283022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20929ee0-6e1d-48d8-93e3-2da98b4fab9c req-bc2ecba5-af12-4a76-b25a-ad4baec3f91c tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 945 time: 0.1771336 May 12 15:29:58.381740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-01cf9b0d-d279-4553-bf11-a201c32b2e5a req-ecfa5e66-7266-4d40-9b08-6e25cad45c7f tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Calling delete_port for 88d33cdf-e82f-4136-be41-55530c917cf8 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:29:58.393281 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20929ee0-6e1d-48d8-93e3-2da98b4fab9c req-ebe802e7-e218-4cc5-85f0-5c8b49952ea6 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/security-groups?id=bae81ae6-020a-481d-86cd-938bd3b55494&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0993469 May 12 15:29:58.501863 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7e64908-cfe0-4c50-97e4-1ba9babd1d84 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:58.554681 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7e64908-cfe0-4c50-97e4-1ba9babd1d84 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:58.562290 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c276350-4348-46f9-85fb-73db77100613 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:58.675209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c276350-4348-46f9-85fb-73db77100613 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9b369e3-c66f-46c9-9720-c470608767ed,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:58.686138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c276350-4348-46f9-85fb-73db77100613 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:58.687276 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0c276350-4348-46f9-85fb-73db77100613 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f9b369e3-c66f-46c9-9720-c470608767ed HTTP/1.1" status: 204 len: 168 time: 1.1049576 May 12 15:29:58.718411 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-01cf9b0d-d279-4553-bf11-a201c32b2e5a req-ecfa5e66-7266-4d40-9b08-6e25cad45c7f tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:58.770320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['88d33cdf-e82f-4136-be41-55530c917cf8'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:29:58.796884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7e64908-cfe0-4c50-97e4-1ba9babd1d84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:58.841185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecfa5e66-7266-4d40-9b08-6e25cad45c7f tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Pushing event deleted for resources: {'Port': ['ID=88d33cdf-e82f-4136-be41-55530c917cf8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:58.891404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7e64908-cfe0-4c50-97e4-1ba9babd1d84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=57678d6a-171d-4300-88a3-f9f92011ff42,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:29:58.951360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-01cf9b0d-d279-4553-bf11-a201c32b2e5a req-ecfa5e66-7266-4d40-9b08-6e25cad45c7f tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] No DVR routers for this DVR port 88d33cdf-e82f-4136-be41-55530c917cf8 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:29:58.955046 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-01cf9b0d-d279-4553-bf11-a201c32b2e5a req-ecfa5e66-7266-4d40-9b08-6e25cad45c7f tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:58.959434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a01fffac-1332-4d92-812c-69e704d19ed5', 'name': 'network-vif-deleted', 'tag': '88d33cdf-e82f-4136-be41-55530c917cf8'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:29:58.986422 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01cf9b0d-d279-4553-bf11-a201c32b2e5a req-ecfa5e66-7266-4d40-9b08-6e25cad45c7f tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.84 "DELETE /v2.0/ports/88d33cdf-e82f-4136-be41-55530c917cf8 HTTP/1.1" status: 204 len: 173 time: 1.9655292 May 12 15:29:58.986748 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7e64908-cfe0-4c50-97e4-1ba9babd1d84 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:29:58.987759 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a7e64908-cfe0-4c50-97e4-1ba9babd1d84 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/57678d6a-171d-4300-88a3-f9f92011ff42 HTTP/1.1" status: 204 len: 168 time: 1.0030384 May 12 15:29:59.069783 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-68885e7a-6f1d-4311-9f0d-a8105ab3573a'] response: {'server_uuid': 'a01fffac-1332-4d92-812c-69e704d19ed5', 'name': 'network-vif-deleted', 'tag': '88d33cdf-e82f-4136-be41-55530c917cf8', 'status': 'completed', 'code': 200} May 12 15:29:59.850757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22bae5ca-cc9d-4091-8524-b7b922d8ac0d req-4e76e3d9-797b-4996-9b81-e4bb81e6efe2 tempest-InstanceActionsTestJSON-1711841081 tempest-InstanceActionsTestJSON-1711841081-project] 10.222.0.82 "GET /v2.0/ports?device_id=a01fffac-1332-4d92-812c-69e704d19ed5 HTTP/1.1" status: 200 len: 210 time: 0.1289084 May 12 15:30:00.619929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b738548-a72b-4016-8dac-c6129afdf500 req-c339315c-96ab-452d-83a9-2288436a3c9d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:00.625902 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b738548-a72b-4016-8dac-c6129afdf500 req-c339315c-96ab-452d-83a9-2288436a3c9d tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 946 time: 0.1098073 May 12 15:30:00.687357 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b738548-a72b-4016-8dac-c6129afdf500 req-b0f9d0d1-6621-4130-9390-7e0588a6a053 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=fcfaf505-a043-4f21-9574-984ab7e90238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0566933 May 12 15:30:01.091091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47972) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:01.220881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-fdfff01d-a86a-48d0-8412-fa9bc6112a7f admin admin] Deleting subnet 96c78285-c9d5-4380-8226-d529b98a4bae {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:30:01.230891 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fdfff01d-a86a-48d0-8412-fa9bc6112a7f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:01.349131 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fdfff01d-a86a-48d0-8412-fa9bc6112a7f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:01.448729 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fdfff01d-a86a-48d0-8412-fa9bc6112a7f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:01.468301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47988) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:01.577734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fdfff01d-a86a-48d0-8412-fa9bc6112a7f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:01.600930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 88d33cdf-e82f-4136-be41-55530c917cf8 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:30:01.688239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdfff01d-a86a-48d0-8412-fa9bc6112a7f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=96c78285-c9d5-4380-8226-d529b98a4bae,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:01.697971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fdfff01d-a86a-48d0-8412-fa9bc6112a7f admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:01.724545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48016) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:01.729324 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fdfff01d-a86a-48d0-8412-fa9bc6112a7f admin admin] 10.222.0.82 "DELETE /v2.0/subnets/96c78285-c9d5-4380-8226-d529b98a4bae HTTP/1.1" status: 204 len: 168 time: 0.6354811 May 12 15:30:01.766268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 88d33cdf-e82f-4136-be41-55530c917cf8 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:30:01.766854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 88d33cdf-e82f-4136-be41-55530c917cf8 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:30:01.920952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7709fd93-3ec3-4c40-9d9b-01438a306b01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:01.976927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Request body: {'network': {'name': 'tempest-ComputeTenantNetworksTest-1052987902-network', 'tenant_id': '4617d4cdf92144e7b999bceb0f7bdb37'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:01.983093 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:02.012691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Usage tracker for resource:network and tenant:4617d4cdf92144e7b999bceb0f7bdb37 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:02.061930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:02.345538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-6195d48e-fa1c-41ae-9f40-8b1000fd9939 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:02.346104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:02.349617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-6195d48e-fa1c-41ae-9f40-8b1000fd9939 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Synchronizing usage tracker for tenant:f4660a6351274a7796c2eb1e55a41ec9 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:30:02.371439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-6195d48e-fa1c-41ae-9f40-8b1000fd9939 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Unset dirty status for tenant:f4660a6351274a7796c2eb1e55a41ec9 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:30:02.373267 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-6195d48e-fa1c-41ae-9f40-8b1000fd9939 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.76 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 946 time: 0.1950054 May 12 15:30:02.390124 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7709fd93-3ec3-4c40-9d9b-01438a306b01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:02.398363 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:02.452147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-7709fd93-3ec3-4c40-9d9b-01438a306b01 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9fcd5c26-ea02-456a-83eb-1bfa9b321252']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:02.483275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Deleting port 5284e633-c8cd-4179-ba2d-44d242c89b57 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:02.483915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:02.490213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-7709fd93-3ec3-4c40-9d9b-01438a306b01 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '55a17244-91f1-417b-91ca-c9ffff8c08a6') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:02.490737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-7709fd93-3ec3-4c40-9d9b-01438a306b01 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '55a17244-91f1-417b-91ca-c9ffff8c08a6') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:02.509703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7709fd93-3ec3-4c40-9d9b-01438a306b01 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:02.539403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Made reservation on behalf of 4617d4cdf92144e7b999bceb0f7bdb37 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:30:02.542841 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:02.581737 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:02.622920 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7709fd93-3ec3-4c40-9d9b-01438a306b01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:02.636605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:02.642079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7709fd93-3ec3-4c40-9d9b-01438a306b01 admin admin] Releasing vlan 567 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:30:02.642507 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7709fd93-3ec3-4c40-9d9b-01438a306b01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: timer() May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:30:02.658663 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:30:02.664777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Usage tracker for resource:security_group_rule and tenant:4617d4cdf92144e7b999bceb0f7bdb37 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:02.897527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aef07c48-fa93-4b67-ad58-93567d272aef req-40a93ad3-f021-4155-8425-100d705213f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:02.913425 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aef07c48-fa93-4b67-ad58-93567d272aef req-40a93ad3-f021-4155-8425-100d705213f0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 946 time: 0.9883816 May 12 15:30:02.923109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:02.983345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:03.185287 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7709fd93-3ec3-4c40-9d9b-01438a306b01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:03.203707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aef07c48-fa93-4b67-ad58-93567d272aef req-f7df8cd5-01bf-4fad-a7d4-127b0d467ae7 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups?id=fcfaf505-a043-4f21-9574-984ab7e90238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2855487 May 12 15:30:03.227881 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7709fd93-3ec3-4c40-9d9b-01438a306b01 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:03.262635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7709fd93-3ec3-4c40-9d9b-01438a306b01 admin admin] Pushing event deleted for resources: {'Network': ['ID=9fcd5c26-ea02-456a-83eb-1bfa9b321252,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:03.289980 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7709fd93-3ec3-4c40-9d9b-01438a306b01 admin admin] 10.222.0.82 "DELETE /v2.0/networks/9fcd5c26-ea02-456a-83eb-1bfa9b321252 HTTP/1.1" status: 204 len: 168 time: 1.5641124 May 12 15:30:03.355735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48100) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:03.385840 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:03.393208 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:03.439741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da90dab4-6638-4609-9ca9-36d054227ec0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:03.450542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 564} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:30:03.464471 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:03.465291 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Added segment e1ff7ea3-ff9c-4513-a88f-bf48ee408851 of type vlan for network fbc3124a-bb79-4ec9-ada9-1a8be11d9f02 May 12 15:30:03.521246 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:03.525843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] For port 5284e633-c8cd-4179-ba2d-44d242c89b57, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=5284e633-c8cd-4179-ba2d-44d242c89b57,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:03.527002 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:03.570124 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:03.571097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:03.571672 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:03.672766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48116) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:03.707867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] Pushing event updated for resources: {'Network': ['ID=fbc3124a-bb79-4ec9-ada9-1a8be11d9f02,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:03.718641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network fbc3124a-bb79-4ec9-ada9-1a8be11d9f02 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:30:03.741978 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-04f437d1-9025-4a84-90c4-cdc822d822a2 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 2.2728179 May 12 15:30:03.848448 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ec81d4d9-a337-4340-b269-87f1d167a681 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=62fe52d879b74b038c6484c343be0c6d&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1727419 May 12 15:30:03.851229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48124) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:03.939706 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-81506720-debf-47cc-85b7-db4b76685715 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:03.969379 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-81506720-debf-47cc-85b7-db4b76685715 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:04.000519 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:04.000904 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:04.001226 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Floating IP 3fc00e80-ba04-4a2e-9c0f-064c15a0b77d disassociated. External IP: 172.25.8.55, port: 5284e633-c8cd-4179-ba2d-44d242c89b57. May 12 15:30:04.001608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Calling delete_port for 5284e633-c8cd-4179-ba2d-44d242c89b57 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:04.047314 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-81506720-debf-47cc-85b7-db4b76685715 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:04.085126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81506720-debf-47cc-85b7-db4b76685715 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bae81ae6-020a-481d-86cd-938bd3b55494,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:04.108099 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-81506720-debf-47cc-85b7-db4b76685715 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:04.110291 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-81506720-debf-47cc-85b7-db4b76685715 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bae81ae6-020a-481d-86cd-938bd3b55494 HTTP/1.1" status: 204 len: 168 time: 0.2580760 May 12 15:30:04.337292 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:04.341635 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a532e719-7d59-46ea-a6a2-0afbce4089f3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:04.382538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a532e719-7d59-46ea-a6a2-0afbce4089f3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:04.394359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a532e719-7d59-46ea-a6a2-0afbce4089f3 admin admin] Usage tracker for resource:security_group_rule and tenant:4b906698039d469d923eeb1c653063c0 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:04.402124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a532e719-7d59-46ea-a6a2-0afbce4089f3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:04.417405 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a532e719-7d59-46ea-a6a2-0afbce4089f3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:04.523580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event deleted for resources: {'Port': ['ID=5284e633-c8cd-4179-ba2d-44d242c89b57,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:04.584878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 5284e633-c8cd-4179-ba2d-44d242c89b57 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:30:04.598323 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-902cc744-9986-4afa-8e94-db58a1e55f95 req-4bfe056d-f872-4249-9cc6-b97150e37950 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 210 time: 0.0965195 May 12 15:30:04.736655 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a532e719-7d59-46ea-a6a2-0afbce4089f3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:04.743768 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a532e719-7d59-46ea-a6a2-0afbce4089f3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:04.755971 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 5284e633-c8cd-4179-ba2d-44d242c89b57 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:30:04.756605 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 5284e633-c8cd-4179-ba2d-44d242c89b57 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:30:04.860812 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a532e719-7d59-46ea-a6a2-0afbce4089f3 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4b906698039d469d923eeb1c653063c0&name=default HTTP/1.1" status: 200 len: 2983 time: 1.5014300 May 12 15:30:04.860812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a532e719-7d59-46ea-a6a2-0afbce4089f3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17d85eb6-b094-44b1-a794-919758d1a039,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:04.867172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48154) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:05.020217 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ac2e2bd-6cf8-4014-aaa6-24a5101b22b8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:05.085194 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ac2e2bd-6cf8-4014-aaa6-24a5101b22b8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:05.121354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:30:05.225866 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ac2e2bd-6cf8-4014-aaa6-24a5101b22b8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:05.257764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ac2e2bd-6cf8-4014-aaa6-24a5101b22b8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17d85eb6-b094-44b1-a794-919758d1a039,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:05.281203 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ac2e2bd-6cf8-4014-aaa6-24a5101b22b8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:05.289786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6ac2e2bd-6cf8-4014-aaa6-24a5101b22b8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/17d85eb6-b094-44b1-a794-919758d1a039 HTTP/1.1" status: 204 len: 168 time: 0.4158115 May 12 15:30:05.439172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:30:05.452959 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-afc94983-3e82-45ab-8f16-8f65dac6cf15 None None] Sync routers for ids ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:30:05.491728 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afc94983-3e82-45ab-8f16-8f65dac6cf15 None None] Routers {'0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:30:05.492581 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-afc94983-3e82-45ab-8f16-8f65dac6cf15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:29:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:05.543537 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] No DVR routers for this DVR port 5284e633-c8cd-4179-ba2d-44d242c89b57 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:30:05.547115 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:05.553128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '27edd0de-e2b4-4033-8918-e91ecc2405de', 'name': 'network-vif-deleted', 'tag': '5284e633-c8cd-4179-ba2d-44d242c89b57'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:30:05.589057 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9c4526ed-562d-4b60-bef6-2c79ecad3577 req-02fcf05f-34f1-413f-954e-e13232b118c0 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.76 "DELETE /v2.0/ports/5284e633-c8cd-4179-ba2d-44d242c89b57 HTTP/1.1" status: 204 len: 173 time: 3.2099519 May 12 15:30:05.673062 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-05222c82-cfa3-4071-9352-eda0a9daf01b'] response: {'server_uuid': '27edd0de-e2b4-4033-8918-e91ecc2405de', 'name': 'network-vif-deleted', 'tag': '5284e633-c8cd-4179-ba2d-44d242c89b57', 'status': 'completed', 'code': 200} May 12 15:30:05.767951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-672a45e2-3119-48da-8c94-b11dd0bd7334 req-dbc76562-2b44-43de-ae06-da5155033521 tempest-ComputeTenantNetworksTest-1489304456 tempest-ComputeTenantNetworksTest-1489304456-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:05.776188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-672a45e2-3119-48da-8c94-b11dd0bd7334 req-dbc76562-2b44-43de-ae06-da5155033521 tempest-ComputeTenantNetworksTest-1489304456 tempest-ComputeTenantNetworksTest-1489304456-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:05.782744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-672a45e2-3119-48da-8c94-b11dd0bd7334 req-dbc76562-2b44-43de-ae06-da5155033521 tempest-ComputeTenantNetworksTest-1489304456 tempest-ComputeTenantNetworksTest-1489304456-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:05.784104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-672a45e2-3119-48da-8c94-b11dd0bd7334 req-dbc76562-2b44-43de-ae06-da5155033521 tempest-ComputeTenantNetworksTest-1489304456 tempest-ComputeTenantNetworksTest-1489304456-project] Synchronizing usage tracker for tenant:4617d4cdf92144e7b999bceb0f7bdb37 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:30:05.808854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-672a45e2-3119-48da-8c94-b11dd0bd7334 req-dbc76562-2b44-43de-ae06-da5155033521 tempest-ComputeTenantNetworksTest-1489304456 tempest-ComputeTenantNetworksTest-1489304456-project] Unset dirty status for tenant:4617d4cdf92144e7b999bceb0f7bdb37 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:30:05.815037 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-672a45e2-3119-48da-8c94-b11dd0bd7334 req-dbc76562-2b44-43de-ae06-da5155033521 tempest-ComputeTenantNetworksTest-1489304456 tempest-ComputeTenantNetworksTest-1489304456-project] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1903 time: 0.3397167 May 12 15:30:05.963238 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-afc94983-3e82-45ab-8f16-8f65dac6cf15 None None] Set router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:30:06.010723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-221b0d41-5434-4074-890f-b4d5f99d2cd9 req-cb6002a5-c9bb-48eb-a426-f8b5cac683d3 tempest-ComputeTenantNetworksTest-1489304456 tempest-ComputeTenantNetworksTest-1489304456-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:06.012122 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-221b0d41-5434-4074-890f-b4d5f99d2cd9 req-cb6002a5-c9bb-48eb-a426-f8b5cac683d3 tempest-ComputeTenantNetworksTest-1489304456 tempest-ComputeTenantNetworksTest-1489304456-project] 10.222.0.82 "GET /v2.0/networks/fbc3124a-bb79-4ec9-ada9-1a8be11d9f02 HTTP/1.1" status: 200 len: 769 time: 0.1594985 May 12 15:30:06.020405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48178) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:06.079212 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eba0962b-f5d6-4b42-877e-68ff9b690431 req-021e4458-10e7-4584-8847-ae83d9e2a4a8 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/ports?device_id=27edd0de-e2b4-4033-8918-e91ecc2405de HTTP/1.1" status: 200 len: 210 time: 0.0581748 May 12 15:30:06.337188 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fce6b944-2698-4859-a396-f8bcac807912 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:06.440975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48188) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:06.486573 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1ac72d9-b1a1-4399-84a6-40f2a7610fea admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:06.552310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c1ac72d9-b1a1-4399-84a6-40f2a7610fea admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:06.562882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c1ac72d9-b1a1-4399-84a6-40f2a7610fea admin admin] Usage tracker for resource:security_group_rule and tenant:c9c2fe205e0b49729def00e5826c72de is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:06.570001 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c1ac72d9-b1a1-4399-84a6-40f2a7610fea admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:06.580815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c1ac72d9-b1a1-4399-84a6-40f2a7610fea admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:06.779974 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-afc94983-3e82-45ab-8f16-8f65dac6cf15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:45Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:06.811603 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-afc94983-3e82-45ab-8f16-8f65dac6cf15 None None] Checking router: 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:30:06.862498 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afc94983-3e82-45ab-8f16-8f65dac6cf15 None None] Routers {'0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:30:06.863859 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1ac72d9-b1a1-4399-84a6-40f2a7610fea admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:06.866724 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-afc94983-3e82-45ab-8f16-8f65dac6cf15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:29:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:06.872025 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1ac72d9-b1a1-4399-84a6-40f2a7610fea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:06.988635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1ac72d9-b1a1-4399-84a6-40f2a7610fea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e3bcd04-8b85-403a-bd08-47adac3613c9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:07.060810 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fce6b944-2698-4859-a396-f8bcac807912 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:07.090532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c1ac72d9-b1a1-4399-84a6-40f2a7610fea admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c9c2fe205e0b49729def00e5826c72de&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6299574 May 12 15:30:07.104542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48200) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:07.178870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-fce6b944-2698-4859-a396-f8bcac807912 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fbc3124a-bb79-4ec9-ada9-1a8be11d9f02']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:07.230021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-fce6b944-2698-4859-a396-f8bcac807912 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e1ff7ea3-ff9c-4513-a88f-bf48ee408851') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:07.230405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-fce6b944-2698-4859-a396-f8bcac807912 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e1ff7ea3-ff9c-4513-a88f-bf48ee408851') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:07.259541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fce6b944-2698-4859-a396-f8bcac807912 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:07.337110 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fce6b944-2698-4859-a396-f8bcac807912 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:07.359258 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-39141774-d4c2-4663-91df-8e9c077cc6dd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:07.385766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fce6b944-2698-4859-a396-f8bcac807912 admin admin] Releasing vlan 564 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:30:07.386807 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fce6b944-2698-4859-a396-f8bcac807912 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: timer() May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:30:07.452317 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:30:07.458139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48210) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:07.474149 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-39141774-d4c2-4663-91df-8e9c077cc6dd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:07.523714 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-afc94983-3e82-45ab-8f16-8f65dac6cf15 None None] Set router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:30:07.663358 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fce6b944-2698-4859-a396-f8bcac807912 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:07.671240 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fce6b944-2698-4859-a396-f8bcac807912 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:07.708816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce6b944-2698-4859-a396-f8bcac807912 admin admin] Pushing event deleted for resources: {'Network': ['ID=fbc3124a-bb79-4ec9-ada9-1a8be11d9f02,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:07.719326 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fce6b944-2698-4859-a396-f8bcac807912 admin admin] 10.222.0.82 "DELETE /v2.0/networks/fbc3124a-bb79-4ec9-ada9-1a8be11d9f02 HTTP/1.1" status: 204 len: 168 time: 1.6977799 May 12 15:30:07.777915 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-39141774-d4c2-4663-91df-8e9c077cc6dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:07.807776 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-39141774-d4c2-4663-91df-8e9c077cc6dd admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:07.809643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-39141774-d4c2-4663-91df-8e9c077cc6dd admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7e3bcd04-8b85-403a-bd08-47adac3613c9 HTTP/1.1" status: 204 len: 168 time: 0.6909466 May 12 15:30:07.810844 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c21e569e-75b5-4261-a1cf-f76a929440ab tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:07.833151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39141774-d4c2-4663-91df-8e9c077cc6dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e3bcd04-8b85-403a-bd08-47adac3613c9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:07.864208 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c21e569e-75b5-4261-a1cf-f76a929440ab tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:07.933244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48230) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:07.987412 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c21e569e-75b5-4261-a1cf-f76a929440ab tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:08.046833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c21e569e-75b5-4261-a1cf-f76a929440ab tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fcfaf505-a043-4f21-9574-984ab7e90238,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:08.070319 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5d2132bd-e5e1-4a8a-ac3f-f6a3e7e2254a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4617d4cdf92144e7b999bceb0f7bdb37&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1324675 May 12 15:30:08.070815 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c21e569e-75b5-4261-a1cf-f76a929440ab tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:08.074392 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c21e569e-75b5-4261-a1cf-f76a929440ab tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "DELETE /v2.0/security-groups/fcfaf505-a043-4f21-9574-984ab7e90238 HTTP/1.1" status: 204 len: 168 time: 0.6105428 May 12 15:30:08.074392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48238) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:08.074630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48240) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:08.107759 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-4debbb3e-cc09-4b36-a763-9ad432f6dc44 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] show failed (client error): The resource could not be found. May 12 15:30:08.108918 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4debbb3e-cc09-4b36-a763-9ad432f6dc44 tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "GET /v2.0/security-groups/fcfaf505-a043-4f21-9574-984ab7e90238 HTTP/1.1" status: 404 len: 347 time: 0.0333903 May 12 15:30:08.111849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48246) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:08.188976 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-afc94983-3e82-45ab-8f16-8f65dac6cf15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:45Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:08.199863 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-afc94983-3e82-45ab-8f16-8f65dac6cf15 None None] The sync data for ids ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'] in n-d-841483-1 is: [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:24:37Z', 'revision_number': 4, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '42a2c229-d13e-4ea9-b530-c7d65e4999da', 'name': '', 'network_id': 'e1655f9a-2478-49d5-a6ca-4fec717d6816', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'mac_address': 'fa:16:3e:ae:61:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1791, 'fixed_ips': [{'subnet_id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:35Z', 'updated_at': '2022-05-12T15:24:45Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'subnets': [{'id': '83787d82-d8a5-4f12-a025-f44dcf581189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:30:08.221546 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-13b4317c-ec99-40d2-bb18-068276013574 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:08.295470 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-13b4317c-ec99-40d2-bb18-068276013574 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:08.425712 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-13b4317c-ec99-40d2-bb18-068276013574 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:08.481932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13b4317c-ec99-40d2-bb18-068276013574 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da90dab4-6638-4609-9ca9-36d054227ec0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:08.492753 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-13b4317c-ec99-40d2-bb18-068276013574 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:08.493942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-13b4317c-ec99-40d2-bb18-068276013574 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/da90dab4-6638-4609-9ca9-36d054227ec0 HTTP/1.1" status: 204 len: 168 time: 0.4200594 May 12 15:30:08.511901 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48260) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:08.556900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Deleting port 7d5cbb37-383e-49c5-8545-84e6ee038c9e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:08.557472 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:08.716480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcedbfcd-49fb-466c-97c0-ea526936e4d3 None None] New status for floating IP 3fc00e80-ba04-4a2e-9c0f-064c15a0b77d: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:30:08.996292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Request body: {'network': {'name': 'tempest-ServerGroupTestJSON-28123570-network', 'tenant_id': '353d3bc3be9843c584641e13595ca055'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:09.014138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:09.023954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Usage tracker for resource:network and tenant:353d3bc3be9843c584641e13595ca055 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:09.034623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:09.038709 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:09.040009 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:09.053556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:09.069055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Made reservation on behalf of 353d3bc3be9843c584641e13595ca055 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:30:09.084756 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:09.102345 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:09.139005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:09.152549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Usage tracker for resource:security_group_rule and tenant:353d3bc3be9843c584641e13595ca055 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:09.156392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:09.167657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:09.291376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Calling delete_port for 7d5cbb37-383e-49c5-8545-84e6ee038c9e owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:09.401551 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:09.409419 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:09.411919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 2 row(s); 1 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:30:09.412315 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:30:09.449416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:09.461714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 599} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:30:09.473471 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:09.474294 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Added segment b9b3325b-c79b-4a26-83a0-152dee070f23 of type vlan for network 2c3462d2-bb87-4375-8260-fad70ee527dc May 12 15:30:09.512185 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:09.553349 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:09.554608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:09.555278 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:09.655710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48296) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:09.658884 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.1458371 May 12 15:30:09.663629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Request body: {'subnet': {'network_id': '2c3462d2-bb87-4375-8260-fad70ee527dc', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerGroupTestJSON-28123570-subnet', 'tenant_id': '353d3bc3be9843c584641e13595ca055', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:09.671468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:09.679581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Usage tracker for resource:subnet and tenant:353d3bc3be9843c584641e13595ca055 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:09.691933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:09.700243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:09.708416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-439d60f9-b40b-4bb8-a9b4-ef50b59a3262 admin admin] Pushing event updated for resources: {'Network': ['ID=2c3462d2-bb87-4375-8260-fad70ee527dc,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:09.719787 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Made reservation on behalf of 353d3bc3be9843c584641e13595ca055 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:30:09.724624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 2c3462d2-bb87-4375-8260-fad70ee527dc details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:30:09.726456 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:09.920900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Deleting port 7d5cbb37-383e-49c5-8545-84e6ee038c9e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:09.921194 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:10.116596 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:10.116913 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:10.397693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Calling delete_port for 7d5cbb37-383e-49c5-8545-84e6ee038c9e owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:10.634171 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:10.717617 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:10.787729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Pushing event deleted for resources: {'Port': ['ID=7d5cbb37-383e-49c5-8545-84e6ee038c9e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:10.824170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5cd005ab-44f1-4a8f-9e54-c87c6ffbd1f4,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:10.919660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Checking segment: {'id': 'b9b3325b-c79b-4a26-83a0-152dee070f23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': '2c3462d2-bb87-4375-8260-fad70ee527dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:30:10.919660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Network hostable DHCP agents. Network: 2c3462d2-bb87-4375-8260-fad70ee527dc, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:30:10.953292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Network 2c3462d2-bb87-4375-8260-fad70ee527dc is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:30:10.957676 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:10.978995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 2c3462d2-bb87-4375-8260-fad70ee527dc) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:30:10.984889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:10.986641 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:10.991208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01c9c345-359f-45ac-8082-3b91fdaccea4 None None] Network 2c3462d2-bb87-4375-8260-fad70ee527dc requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:30:11.007609 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:11.011862 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fbd362ae-91fe-47e0-9fc0-be226fbca75f tempest-AttachVolumeTestJSON-417324087 tempest-AttachVolumeTestJSON-417324087-project] 10.222.0.82 "DELETE /v2.0/floatingips/3fc00e80-ba04-4a2e-9c0f-064c15a0b77d HTTP/1.1" status: 204 len: 168 time: 2.8959546 May 12 15:30:11.039353 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-06153b24-2605-48aa-a99b-8eba4a339d46 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.3825305 May 12 15:30:11.346745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48360) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:11.400093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5ef3f4b5-db1c-438a-9485-c17393055ec7 None None] Network 2c3462d2-bb87-4375-8260-fad70ee527dc requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:30:12.036283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-909dd583-6765-41e3-ba4d-ff4901a4f4a6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:12.084458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-909dd583-6765-41e3-ba4d-ff4901a4f4a6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:12.092065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-909dd583-6765-41e3-ba4d-ff4901a4f4a6 admin admin] Usage tracker for resource:security_group_rule and tenant:03880c1106a2465ba1a3eadbc84524c0 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:12.106253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-909dd583-6765-41e3-ba4d-ff4901a4f4a6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:12.119352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-909dd583-6765-41e3-ba4d-ff4901a4f4a6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:12.280003 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-909dd583-6765-41e3-ba4d-ff4901a4f4a6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:12.287417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-909dd583-6765-41e3-ba4d-ff4901a4f4a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:12.412565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48388) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:12.414601 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-909dd583-6765-41e3-ba4d-ff4901a4f4a6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=03880c1106a2465ba1a3eadbc84524c0&name=default HTTP/1.1" status: 200 len: 2983 time: 1.0609961 May 12 15:30:12.416188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-909dd583-6765-41e3-ba4d-ff4901a4f4a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5636856d-3b32-484b-a20e-85d3872c933a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:12.560810 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3606be5b-d8ba-407e-a4b9-c7b3e1bddec7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:12.596031 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3606be5b-d8ba-407e-a4b9-c7b3e1bddec7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:12.701103 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-92f376a6-d76a-4f59-9b3c-9059db408168 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:12.722019 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3606be5b-d8ba-407e-a4b9-c7b3e1bddec7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:12.759290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3606be5b-d8ba-407e-a4b9-c7b3e1bddec7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5636856d-3b32-484b-a20e-85d3872c933a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:12.783864 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3606be5b-d8ba-407e-a4b9-c7b3e1bddec7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:12.787708 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3606be5b-d8ba-407e-a4b9-c7b3e1bddec7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5636856d-3b32-484b-a20e-85d3872c933a HTTP/1.1" status: 204 len: 168 time: 0.3713729 May 12 15:30:13.027224 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:13.264526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59445d01-3034-4451-a178-b8193928da10 req-506be482-e352-48b5-898e-1f806397dded tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:13.266092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59445d01-3034-4451-a178-b8193928da10 req-506be482-e352-48b5-898e-1f806397dded tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 945 time: 0.3310864 May 12 15:30:13.369543 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59445d01-3034-4451-a178-b8193928da10 req-6b06fb00-445e-4e34-90c8-ba241a24b7b3 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0936978 May 12 15:30:14.381148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae1379da-6c75-4447-b4a0-7914a8a5d07d req-b102fe63-3f43-4b7a-9888-4f3f4472b2f2 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:14.382876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ae1379da-6c75-4447-b4a0-7914a8a5d07d req-b102fe63-3f43-4b7a-9888-4f3f4472b2f2 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Synchronizing usage tracker for tenant:e1146a673b454173a1ed844897ff4119 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:30:14.404084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ae1379da-6c75-4447-b4a0-7914a8a5d07d req-b102fe63-3f43-4b7a-9888-4f3f4472b2f2 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Unset dirty status for tenant:e1146a673b454173a1ed844897ff4119 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:30:14.405508 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae1379da-6c75-4447-b4a0-7914a8a5d07d req-b102fe63-3f43-4b7a-9888-4f3f4472b2f2 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.76 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 945 time: 0.1696184 May 12 15:30:14.638520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-ae1379da-6c75-4447-b4a0-7914a8a5d07d req-bb81a88e-b623-4212-b310-a214425ded03 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Deleting port 79e7ee47-ef7f-4129-af14-1b599edecfb5 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:14.639180 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ae1379da-6c75-4447-b4a0-7914a8a5d07d req-bb81a88e-b623-4212-b310-a214425ded03 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:14.829106 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d531133-1002-4983-848f-6d041d4c867e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:14.852728 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a25536ba-31dd-41d8-a0a9-b19ff792e461 req-6431cb4b-1808-40e0-9cfb-6d7521369ed7 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.7936091 May 12 15:30:15.054746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-abe16085-1a89-4917-95c3-231d4cf521e0 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:15.055418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-abe16085-1a89-4917-95c3-231d4cf521e0 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Synchronizing usage tracker for tenant:353d3bc3be9843c584641e13595ca055 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:30:15.107699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9557f2de-2da2-40ee-920f-cd0fdff025dd req-b11a1db5-a5ea-4698-86c7-91b61001ffa6 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:15.121428 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9557f2de-2da2-40ee-920f-cd0fdff025dd req-b11a1db5-a5ea-4698-86c7-91b61001ffa6 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 945 time: 0.4525778 May 12 15:30:15.151762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-abe16085-1a89-4917-95c3-231d4cf521e0 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Unset dirty status for tenant:353d3bc3be9843c584641e13595ca055 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:30:15.163068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-abe16085-1a89-4917-95c3-231d4cf521e0 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/networks?id=2c3462d2-bb87-4375-8260-fad70ee527dc HTTP/1.1" status: 200 len: 808 time: 0.6793747 May 12 15:30:15.227369 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-a00c14e0-9512-429e-976c-b44304f5083a tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/quotas/353d3bc3be9843c584641e13595ca055 HTTP/1.1" status: 200 len: 375 time: 0.0625260 May 12 15:30:15.381143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a25536ba-31dd-41d8-a0a9-b19ff792e461 req-92193553-6b76-4e33-97b2-69c2403ae237 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:15.385737 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-36e70848-6550-491a-abf3-f2d1c194697e tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=353d3bc3be9843c584641e13595ca055&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1572747 May 12 15:30:15.405240 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a25536ba-31dd-41d8-a0a9-b19ff792e461 req-92193553-6b76-4e33-97b2-69c2403ae237 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 1096 time: 0.4955125 May 12 15:30:15.405995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9557f2de-2da2-40ee-920f-cd0fdff025dd req-8683d6f5-cbf0-4512-89c5-9ccc40232bb2 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2828438 May 12 15:30:15.646542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ae1379da-6c75-4447-b4a0-7914a8a5d07d req-bb81a88e-b623-4212-b310-a214425ded03 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] For port 79e7ee47-ef7f-4129-af14-1b599edecfb5, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=79e7ee47-ef7f-4129-af14-1b599edecfb5,segment=NetworkSegment(3307f62e-6977-4a8d-852e-31dcfd97c476),segment_id=3307f62e-6977-4a8d-852e-31dcfd97c476)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:15.646908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ae1379da-6c75-4447-b4a0-7914a8a5d07d req-bb81a88e-b623-4212-b310-a214425ded03 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:15.703221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-f6606ef9-4b8a-480c-b290-49f88ffccb3c service neutron] 10.222.0.82 "GET /v2.0/networks/2c3462d2-bb87-4375-8260-fad70ee527dc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3165331 May 12 15:30:15.989134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-ae1379da-6c75-4447-b4a0-7914a8a5d07d req-bb81a88e-b623-4212-b310-a214425ded03 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Calling delete_port for 79e7ee47-ef7f-4129-af14-1b599edecfb5 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:16.028930 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:16.126808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a25536ba-31dd-41d8-a0a9-b19ff792e461 req-9cdb1f02-70f8-4e79-8af1-742949fffcd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:16.128197 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a25536ba-31dd-41d8-a0a9-b19ff792e461 req-9cdb1f02-70f8-4e79-8af1-742949fffcd9 service neutron] 10.222.0.84 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 916 time: 0.6744580 May 12 15:30:16.148266 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-54cd0a91-3a51-471a-ad9d-77a4397dc7ed service neutron] 10.222.0.82 "GET /v2.0/networks/2c3462d2-bb87-4375-8260-fad70ee527dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4436557 May 12 15:30:16.197527 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:16.462937 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a25536ba-31dd-41d8-a0a9-b19ff792e461 req-c7634fe9-8eab-4769-a57a-988765d68ec1 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb HTTP/1.1" status: 200 len: 1000 time: 0.2747049 May 12 15:30:16.648570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 79e7ee47-ef7f-4129-af14-1b599edecfb5 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:30:16.919223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ae1379da-6c75-4447-b4a0-7914a8a5d07d req-bb81a88e-b623-4212-b310-a214425ded03 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:17.010234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Port 79e7ee47-ef7f-4129-af14-1b599edecfb5 update to DOWN by agent not found {{(pid=88153) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2140}} May 12 15:30:17.020083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a25536ba-31dd-41d8-a0a9-b19ff792e461 req-44528e62-86f5-402e-a979-842e7ffec654 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:17.023701 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a25536ba-31dd-41d8-a0a9-b19ff792e461 req-44528e62-86f5-402e-a979-842e7ffec654 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 HTTP/1.1" status: 200 len: 854 time: 0.4828048 May 12 15:30:17.038587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd9585a7-44c9-4a75-a559-6cc69684bf9d req-3978937d-43a3-4b0f-9970-7a7d513c4151 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 210 time: 0.1492789 May 12 15:30:17.069056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb0f88fc-01a9-44c3-8aeb-2e1b150554dc req-204950e4-3a79-45c0-bfb2-9486b5da9680 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:17.081681 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb0f88fc-01a9-44c3-8aeb-2e1b150554dc req-204950e4-3a79-45c0-bfb2-9486b5da9680 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=774b92e3-9429-4f04-94bb-bbbb9ce9acac HTTP/1.1" status: 200 len: 945 time: 0.3896368 May 12 15:30:17.132275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb81a88e-b623-4212-b310-a214425ded03 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Pushing event deleted for resources: {'Port': ['ID=79e7ee47-ef7f-4129-af14-1b599edecfb5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:17.159855 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb0f88fc-01a9-44c3-8aeb-2e1b150554dc req-ebd1aa68-2dcb-41df-ac8e-ff6aa5863341 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0770054 May 12 15:30:17.208068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae1379da-6c75-4447-b4a0-7914a8a5d07d req-bb81a88e-b623-4212-b310-a214425ded03 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] No DVR routers for this DVR port 79e7ee47-ef7f-4129-af14-1b599edecfb5 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:30:17.275626 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ae1379da-6c75-4447-b4a0-7914a8a5d07d req-bb81a88e-b623-4212-b310-a214425ded03 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:17.279725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '774b92e3-9429-4f04-94bb-bbbb9ce9acac', 'name': 'network-vif-deleted', 'tag': '79e7ee47-ef7f-4129-af14-1b599edecfb5'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:30:17.319856 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae1379da-6c75-4447-b4a0-7914a8a5d07d req-bb81a88e-b623-4212-b310-a214425ded03 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.76 "DELETE /v2.0/ports/79e7ee47-ef7f-4129-af14-1b599edecfb5 HTTP/1.1" status: 204 len: 173 time: 2.9075155 May 12 15:30:17.335982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a25536ba-31dd-41d8-a0a9-b19ff792e461 req-15b92ad5-bc0f-4ab9-8630-0444dd3cc1f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:17.338768 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a25536ba-31dd-41d8-a0a9-b19ff792e461 req-15b92ad5-bc0f-4ab9-8630-0444dd3cc1f3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbecac63-cd00-4ee6-bec1-19abe557d6e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2150526 May 12 15:30:17.553192 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-98b7bfb0-a5a7-41f5-80b4-709424153448'] response: {'server_uuid': '774b92e3-9429-4f04-94bb-bbbb9ce9acac', 'name': 'network-vif-deleted', 'tag': '79e7ee47-ef7f-4129-af14-1b599edecfb5', 'status': 'completed', 'code': 200} May 12 15:30:17.678631 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a25536ba-31dd-41d8-a0a9-b19ff792e461 req-93243742-bf3a-4074-a8f2-754ba22a2bfd service neutron] 10.222.0.84 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3166761 May 12 15:30:17.678937 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:18.031604 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a25536ba-31dd-41d8-a0a9-b19ff792e461 req-638ab8d1-6def-4cf2-9d1b-7c0e6b1c3bf3 service neutron] 10.222.0.84 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3512762 May 12 15:30:18.276281 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08bf0c65-222f-4bcd-8c3e-9b899006da0b req-cfbe6792-8d0c-426d-8f43-949c72ba77a8 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 210 time: 0.1373851 May 12 15:30:19.636430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48630) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:19.758456 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-454892fa-7a72-4091-9043-043cc0898c5a req-f0277b4d-c337-4114-ac95-9a7e394447b5 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 210 time: 0.1386902 May 12 15:30:20.108390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeIpV6Test-1625705774', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:20.118170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:20.132033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Usage tracker for resource:port and tenant:8f914cadb93148fe9a3fb827546b2c55 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:20.146553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:20.169641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:20.203324 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Made reservation on behalf of 8f914cadb93148fe9a3fb827546b2c55 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:30:20.210009 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:20.267250 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:20.352673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:20.371735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Usage tracker for resource:security_group_rule and tenant:8f914cadb93148fe9a3fb827546b2c55 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:20.389666 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:20.434042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:21.013108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-bbd6fd9c-6fde-4b86-b381-5e9e9d89808c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:21.017933 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-bbd6fd9c-6fde-4b86-b381-5e9e9d89808c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.84 "GET /v2.0/networks?id=2c3462d2-bb87-4375-8260-fad70ee527dc HTTP/1.1" status: 200 len: 808 time: 0.4588871 May 12 15:30:21.020511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:21.027046 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:21.072441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] device_id is not set on port 50121334-d566-4bc0-a56e-ecc34d141532 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:30:21.218535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Request body: {'port': {'device_id': '5fc497ea-091b-44f8-960f-b26e9b13a563', 'network_id': '2c3462d2-bb87-4375-8260-fad70ee527dc', 'admin_state_up': True, 'tenant_id': '353d3bc3be9843c584641e13595ca055'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:21.273811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f227515-bec6-4f1b-9658-73f3105c568c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:21.337462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45d70847-77fd-4757-b21e-a9196cfecd8b req-06eb5476-e50f-4518-aad8-9e58d67f9e1f tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 210 time: 0.1361165 May 12 15:30:21.788818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48680) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:21.803365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:21.812107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Usage tracker for resource:port and tenant:353d3bc3be9843c584641e13595ca055 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:21.831672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:21.849671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Allocated IP 172.25.8.174 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/50121334-d566-4bc0-a56e-ecc34d141532) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:30:21.856542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:21.892868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Made reservation on behalf of 353d3bc3be9843c584641e13595ca055 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:30:21.896658 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:22.212474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48690) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:22.227991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Allocated IP 172.20.0.6 (2c3462d2-bb87-4375-8260-fad70ee527dc/5cd005ab-44f1-4a8f-9e54-c87c6ffbd1f4/86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:30:22.236222 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:22.300008 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-790a729c-59cf-4a53-8612-ae5fa071ae69 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:22.355699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-790a729c-59cf-4a53-8612-ae5fa071ae69 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:22.360961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-790a729c-59cf-4a53-8612-ae5fa071ae69 admin admin] Usage tracker for resource:security_group_rule and tenant:b4f11324f7a941e9964c9cd69a7bf38f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:22.368279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-790a729c-59cf-4a53-8612-ae5fa071ae69 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:22.390376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-790a729c-59cf-4a53-8612-ae5fa071ae69 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:22.483259 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fcb959fa-4463-4885-abc4-078006b2d197 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:22.494594 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:22.517965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fcb959fa-4463-4885-abc4-078006b2d197 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:22.527101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fcb959fa-4463-4885-abc4-078006b2d197 admin admin] Usage tracker for resource:security_group_rule and tenant:ccea68a7ec10491f8c8842f037089234 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:22.535698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fcb959fa-4463-4885-abc4-078006b2d197 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:22.545161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fcb959fa-4463-4885-abc4-078006b2d197 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:22.611129 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a39412df-e329-4371-97e9-f1c1a3450efa req-427824cd-57a9-4ed7-a33f-3dd58de76731 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 210 time: 0.0594449 May 12 15:30:22.684658 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-790a729c-59cf-4a53-8612-ae5fa071ae69 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:22.695270 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-790a729c-59cf-4a53-8612-ae5fa071ae69 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:22.750693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-790a729c-59cf-4a53-8612-ae5fa071ae69 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18b67bce-fba7-4908-b337-582ef2a767e6,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:22.792281 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-790a729c-59cf-4a53-8612-ae5fa071ae69 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b4f11324f7a941e9964c9cd69a7bf38f&name=default HTTP/1.1" status: 200 len: 2983 time: 1.0017774 May 12 15:30:22.794972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48718) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:22.880588 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fcb959fa-4463-4885-abc4-078006b2d197 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:22.919677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:30:22.924389 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fcb959fa-4463-4885-abc4-078006b2d197 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:22.929286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:30:22.931831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:30:23.050457 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11b25afb-ad5e-4fd2-b90a-193ebbb75358 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.062836 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb959fa-4463-4885-abc4-078006b2d197 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8dcda77f-f74d-4487-a744-f7f8382d7dbd,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:23.098154 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fcb959fa-4463-4885-abc4-078006b2d197 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ccea68a7ec10491f8c8842f037089234&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8811417 May 12 15:30:23.100274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48726) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:23.103661 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.145625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Pushing event updated for resources: {'Port': ['ID=50121334-d566-4bc0-a56e-ecc34d141532,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:23.158352 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.231472 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11b25afb-ad5e-4fd2-b90a-193ebbb75358 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.246165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Network 2c3462d2-bb87-4375-8260-fad70ee527dc is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:30:23.251405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:30:23.257350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:23.258032 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.265834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:30:23.269876 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0edbd0a-3e59-46d7-bfe8-62294ddcb8e2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.328213 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0edbd0a-3e59-46d7-bfe8-62294ddcb8e2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.349175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Pushing event updated for resources: {'Port': ['ID=86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:23.393205 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-875e77d0-d8ec-4b7f-9239-2eedf3610bc4 tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1037 time: 3.7546153 May 12 15:30:23.396596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48734) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:23.403502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:23.404421 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.405132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.174'}]}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:23.411855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:23.416370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Usage tracker for resource:router and tenant:8f914cadb93148fe9a3fb827546b2c55 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:23.419775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:23.429198 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c9a05405-27b4-40df-8067-47f6fe3e3d2c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2276328 May 12 15:30:23.438833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:23.444475 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11b25afb-ad5e-4fd2-b90a-193ebbb75358 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.454149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Request body: {'port': {'device_id': '5fc497ea-091b-44f8-960f-b26e9b13a563', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:23.513281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11b25afb-ad5e-4fd2-b90a-193ebbb75358 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18b67bce-fba7-4908-b337-582ef2a767e6,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:23.547513 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.563840 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.606721 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11b25afb-ad5e-4fd2-b90a-193ebbb75358 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.611403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-11b25afb-ad5e-4fd2-b90a-193ebbb75358 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/18b67bce-fba7-4908-b337-582ef2a767e6 HTTP/1.1" status: 204 len: 168 time: 0.8126800 May 12 15:30:23.632084 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0edbd0a-3e59-46d7-bfe8-62294ddcb8e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.636917 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.735072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0edbd0a-3e59-46d7-bfe8-62294ddcb8e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8dcda77f-f74d-4487-a744-f7f8382d7dbd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:23.780611 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.786152 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0edbd0a-3e59-46d7-bfe8-62294ddcb8e2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:23.795652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c0edbd0a-3e59-46d7-bfe8-62294ddcb8e2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8dcda77f-f74d-4487-a744-f7f8382d7dbd HTTP/1.1" status: 204 len: 168 time: 0.6942275 May 12 15:30:24.051633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48760) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:24.430517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:30:24.446289 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:24.485292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Transition to ACTIVE for port object 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:30:24.491635 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:24.719186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48768) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:24.742728 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:24.789893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48772) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:24.795881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6644921-2ddb-49f5-9641-0453045f108b req-bcc93947-53e2-421e-aa54-cf08fdffa446 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:24.798474 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6644921-2ddb-49f5-9641-0453045f108b req-bcc93947-53e2-421e-aa54-cf08fdffa446 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 931 time: 0.8152764 May 12 15:30:24.935080 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6b0f721-a5b3-4dd1-b902-0dc38e88a662 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:24.973121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-439fa11c-22b8-4df2-81e6-e1acf7398736 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:24.990412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c6644921-2ddb-49f5-9641-0453045f108b req-015e67ed-7288-479e-9930-ccb492185caa tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Synchronizing usage tracker for tenant:353d3bc3be9843c584641e13595ca055 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:30:25.023017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c6644921-2ddb-49f5-9641-0453045f108b req-015e67ed-7288-479e-9930-ccb492185caa tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Unset dirty status for tenant:353d3bc3be9843c584641e13595ca055 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:30:25.024307 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6644921-2ddb-49f5-9641-0453045f108b req-015e67ed-7288-479e-9930-ccb492185caa tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/security-groups?id=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1985025 May 12 15:30:25.024705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Pushing event updated for resources: {'Port': ['ID=86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:25.048063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b6b0f721-a5b3-4dd1-b902-0dc38e88a662 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:25.176375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b6b0f721-a5b3-4dd1-b902-0dc38e88a662 admin admin] Usage tracker for resource:security_group_rule and tenant:0fcde70217d24f6aa4ef85ca1dd0adc7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:25.229293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b6b0f721-a5b3-4dd1-b902-0dc38e88a662 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:25.241195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-439fa11c-22b8-4df2-81e6-e1acf7398736 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:25.251794 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b6b0f721-a5b3-4dd1-b902-0dc38e88a662 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:25.266602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-439fa11c-22b8-4df2-81e6-e1acf7398736 admin admin] Usage tracker for resource:security_group_rule and tenant:1c6a241770a54b21a83e70d7657b7778 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:25.279559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-439fa11c-22b8-4df2-81e6-e1acf7398736 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:25.428142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-439fa11c-22b8-4df2-81e6-e1acf7398736 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:25.449212 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:25.491531 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:25.518684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Attempting to bind port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:30:25.519665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Attempting to bind port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'b9b3325b-c79b-4a26-83a0-152dee070f23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': '2c3462d2-bb87-4375-8260-fad70ee527dc'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:30:25.519665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Attempting to bind port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff on network 2c3462d2-bb87-4375-8260-fad70ee527dc {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:30:25.598264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff on network 2c3462d2-bb87-4375-8260-fad70ee527dc not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:30:25.598681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Attempting to bind port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff on network 2c3462d2-bb87-4375-8260-fad70ee527dc {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:30:25.653635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 30, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:30:25.654014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Checking segment: {'id': 'b9b3325b-c79b-4a26-83a0-152dee070f23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': '2c3462d2-bb87-4375-8260-fad70ee527dc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:30:25.654414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Bound using segment: {'id': 'b9b3325b-c79b-4a26-83a0-152dee070f23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': '2c3462d2-bb87-4375-8260-fad70ee527dc'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:30:25.655660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Bound port: 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b9b3325b-c79b-4a26-83a0-152dee070f23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': '2c3462d2-bb87-4375-8260-fad70ee527dc'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:30:25.656063 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:25.746762 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:25.968337 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6b0f721-a5b3-4dd1-b902-0dc38e88a662 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:25.985175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6b0f721-a5b3-4dd1-b902-0dc38e88a662 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.118314 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-439fa11c-22b8-4df2-81e6-e1acf7398736 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.134525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6b0f721-a5b3-4dd1-b902-0dc38e88a662 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3065344-d0f9-45f2-9e63-08c536e0e822,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:26.147226 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-439fa11c-22b8-4df2-81e6-e1acf7398736 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.181136 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b6b0f721-a5b3-4dd1-b902-0dc38e88a662 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0fcde70217d24f6aa4ef85ca1dd0adc7&name=default HTTP/1.1" status: 200 len: 2983 time: 1.4296544 May 12 15:30:26.184868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48812) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:26.193172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] For port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:30:26.247225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] For port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff,segment=NetworkSegment(b9b3325b-c79b-4a26-83a0-152dee070f23),segment_id=b9b3325b-c79b-4a26-83a0-152dee070f23)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:30:26.249429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-439fa11c-22b8-4df2-81e6-e1acf7398736 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e705f965-4299-4312-90e6-dd2a4c0e5d1e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:26.259370 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-439fa11c-22b8-4df2-81e6-e1acf7398736 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1c6a241770a54b21a83e70d7657b7778&name=default HTTP/1.1" status: 200 len: 2983 time: 1.4023576 May 12 15:30:26.259808 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.263451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48818) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:26.367991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Pushing event updated for resources: {'Port': ['ID=86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:26.370349 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.382731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:26.383608 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.384568 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.385158 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-1aac2101-b7a3-4970-95f4-ace2132be834 service neutron] 10.222.0.84 "PUT /v2.0/ports/86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff HTTP/1.1" status: 200 len: 1091 time: 2.9362466 May 12 15:30:26.387741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5fc497ea-091b-44f8-960f-b26e9b13a563', 'tag': '86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:30:26.524580 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9e00c74-ef57-4b2f-98df-8e3308eddd30 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.611243 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9e00c74-ef57-4b2f-98df-8e3308eddd30 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.640026 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.641114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Fanout notify agent at l3_agent the message router_deleted on router a65e572f-cf41-4c5e-9fb1-305ff84c5dd7 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:30:26.651833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdfae42b-0174-4c4b-9be7-02d70ef10b02 req-ccba9170-f0d4-4267-a75d-1e3fe29ee2b6 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:26.653439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cdfae42b-0174-4c4b-9be7-02d70ef10b02 req-ccba9170-f0d4-4267-a75d-1e3fe29ee2b6 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 946 time: 0.7466464 May 12 15:30:26.699235 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9dc233b8-8677-4e3d-b9e0-b36fd835aa99 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.709911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-2e0e139a-235e-4f68-a56f-960437e8b038 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:26.711405 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-2e0e139a-235e-4f68-a56f-960437e8b038 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=353d3bc3be9843c584641e13595ca055&device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 1094 time: 0.2620940 May 12 15:30:26.722898 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-042e39b6-0a9d-4827-983d-0457e097643f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.734355 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9dc233b8-8677-4e3d-b9e0-b36fd835aa99 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.828937 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9dc233b8-8677-4e3d-b9e0-b36fd835aa99 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.836487 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] create failed (client error): There was a conflict when trying to complete your request. May 12 15:30:26.837891 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1d67442e-ec71-4b94-a141-2ef84633194e tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 409 len: 372 time: 3.4400935 May 12 15:30:26.859652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-758f8a51-f679-4076-b8f6-474559fed7ae req-b28d8fe4-aa5f-48b2-b633-12fefbd84b3c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:26.861451 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-758f8a51-f679-4076-b8f6-474559fed7ae req-b28d8fe4-aa5f-48b2-b633-12fefbd84b3c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 943 time: 0.5769298 May 12 15:30:26.866267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48832) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:26.901430 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-46a968a1-46e4-412b-886c-ae98b4b27195 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff HTTP/1.1" status: 200 len: 217 time: 0.0962787 May 12 15:30:26.913513 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9e00c74-ef57-4b2f-98df-8e3308eddd30 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:26.923718 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cdfae42b-0174-4c4b-9be7-02d70ef10b02 req-92a8d24c-6538-464b-84fb-083fbab53a3d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2537546 May 12 15:30:26.924638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dc233b8-8677-4e3d-b9e0-b36fd835aa99 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3065344-d0f9-45f2-9e63-08c536e0e822,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:27.003400 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-758f8a51-f679-4076-b8f6-474559fed7ae req-12012932-6eee-4560-9ad2-e5d613847723 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/security-groups?id=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0959468 May 12 15:30:27.013153 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9dc233b8-8677-4e3d-b9e0-b36fd835aa99 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:27.035479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9e00c74-ef57-4b2f-98df-8e3308eddd30 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e705f965-4299-4312-90e6-dd2a4c0e5d1e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:27.037728 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9dc233b8-8677-4e3d-b9e0-b36fd835aa99 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b3065344-d0f9-45f2-9e63-08c536e0e822 HTTP/1.1" status: 204 len: 168 time: 0.8310590 May 12 15:30:27.046013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e3745950-9c90-4fe2-a692-ab7d3afb2b1c tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Deleting port 50121334-d566-4bc0-a56e-ecc34d141532 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:27.046362 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3745950-9c90-4fe2-a692-ab7d3afb2b1c tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:27.116184 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d811c9e2-8ddb-4449-8daa-df3b3d6da53d'] response: {'name': 'network-changed', 'server_uuid': '5fc497ea-091b-44f8-960f-b26e9b13a563', 'tag': '86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff', 'status': 'completed', 'code': 200} May 12 15:30:27.198286 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9e00c74-ef57-4b2f-98df-8e3308eddd30 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:27.199547 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c9e00c74-ef57-4b2f-98df-8e3308eddd30 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e705f965-4299-4312-90e6-dd2a4c0e5d1e HTTP/1.1" status: 204 len: 168 time: 0.8486948 May 12 15:30:27.211172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-36a686ef-1905-401d-beaf-bf997c8655e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:27.212874 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-36a686ef-1905-401d-beaf-bf997c8655e6 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5cd005ab-44f1-4a8f-9e54-c87c6ffbd1f4 HTTP/1.1" status: 200 len: 848 time: 0.3003447 May 12 15:30:27.315409 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-8620fe7f-31a4-495e-bea4-84a7c280a846 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2c3462d2-bb87-4375-8260-fad70ee527dc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0863948 May 12 15:30:27.448810 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3745950-9c90-4fe2-a692-ab7d3afb2b1c tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:27.748958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e3745950-9c90-4fe2-a692-ab7d3afb2b1c tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Calling delete_port for 50121334-d566-4bc0-a56e-ecc34d141532 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:27.908715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-375b3ead-de09-4128-bc6c-f370cd113580 req-c021590e-9990-49fa-a89a-d1a16252c0a8 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:27.910824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-375b3ead-de09-4128-bc6c-f370cd113580 req-c021590e-9990-49fa-a89a-d1a16252c0a8 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:30:28.028479 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3745950-9c90-4fe2-a692-ab7d3afb2b1c tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:28.047372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-375b3ead-de09-4128-bc6c-f370cd113580 req-c021590e-9990-49fa-a89a-d1a16252c0a8 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:30:28.053898 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-375b3ead-de09-4128-bc6c-f370cd113580 req-c021590e-9990-49fa-a89a-d1a16252c0a8 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.76 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 946 time: 0.9350655 May 12 15:30:28.315306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3745950-9c90-4fe2-a692-ab7d3afb2b1c tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Pushing event deleted for resources: {'Port': ['ID=50121334-d566-4bc0-a56e-ecc34d141532,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:28.466524 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-c00629d8-8b70-4795-9ffc-5335096c6d3c service neutron] 10.222.0.84 "GET /v2.0/networks/2c3462d2-bb87-4375-8260-fad70ee527dc?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0503051 May 12 15:30:28.617542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Deleting port 3283015e-7f0d-447c-b1c3-25d7034f9c29 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:28.617892 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:28.676901 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3745950-9c90-4fe2-a692-ab7d3afb2b1c tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:28.756785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e3745950-9c90-4fe2-a692-ab7d3afb2b1c tempest-RoutersAdminNegativeIpV6Test-1452207053 tempest-RoutersAdminNegativeIpV6Test-1452207053-project-admin] 10.222.0.82 "DELETE /v2.0/ports/50121334-d566-4bc0-a56e-ecc34d141532 HTTP/1.1" status: 204 len: 168 time: 1.8879321 May 12 15:30:28.818134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-611eabd4-064a-4300-9573-02f2e40803d8 req-def025cb-7603-4eb9-a129-a32e2ec5840c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:28.825731 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-611eabd4-064a-4300-9573-02f2e40803d8 req-def025cb-7603-4eb9-a129-a32e2ec5840c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 946 time: 0.4994068 May 12 15:30:28.855709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-042e39b6-0a9d-4827-983d-0457e097643f admin admin] Deleting port 42a2c229-d13e-4ea9-b530-c7d65e4999da {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:28.856072 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-042e39b6-0a9d-4827-983d-0457e097643f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:28.895726 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:30:28.928706 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-611eabd4-064a-4300-9573-02f2e40803d8 req-8831113a-f100-49d2-968e-616c8a400ac7 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0967667 May 12 15:30:28.955611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d97b9810-8101-4f75-ac98-1041f03af6c5 req-cd3f494f-7e6e-4dfe-8be4-3396f1adedb6 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:28.963850 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d97b9810-8101-4f75-ac98-1041f03af6c5 req-cd3f494f-7e6e-4dfe-8be4-3396f1adedb6 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 943 time: 0.5102065 May 12 15:30:29.053648 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ab2ee0e-0aa4-410a-ad29-e3911336181d req-4675f7ce-bcbe-425f-8600-eee0b70d64b1 service neutron] 10.222.0.84 "GET /v2.0/networks/2c3462d2-bb87-4375-8260-fad70ee527dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5608561 May 12 15:30:29.059634 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d97b9810-8101-4f75-ac98-1041f03af6c5 req-78937320-448d-4182-b4a1-b301305e8e3b tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/security-groups?id=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0880146 May 12 15:30:29.518085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-a7c22ac5-031f-444f-8309-a3302866c817 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:29.520451 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-a7c22ac5-031f-444f-8309-a3302866c817 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/networks?id=19102399-18db-4840-b998-adc5bada1da0 HTTP/1.1" status: 200 len: 813 time: 0.3380017 May 12 15:30:29.528796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-042e39b6-0a9d-4827-983d-0457e097643f admin admin] For port 42a2c229-d13e-4ea9-b530-c7d65e4999da, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=42a2c229-d13e-4ea9-b530-c7d65e4999da,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:29.529154 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-042e39b6-0a9d-4827-983d-0457e097643f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:29.551258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48922) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:29.554811 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-b37bac6d-1b65-49cc-8406-bc1bf7c41e7e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/quotas/e1146a673b454173a1ed844897ff4119 HTTP/1.1" status: 200 len: 375 time: 0.0290985 May 12 15:30:29.627218 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-39f6b86f-2f96-4589-8109-03c676bcea86 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=e1146a673b454173a1ed844897ff4119&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0587475 May 12 15:30:29.771861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-042e39b6-0a9d-4827-983d-0457e097643f admin admin] Calling delete_port for 42a2c229-d13e-4ea9-b530-c7d65e4999da owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:29.845022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-8de25556-01e3-48a4-b78c-43b307f96e8c service neutron] 10.222.0.82 "GET /v2.0/networks/19102399-18db-4840-b998-adc5bada1da0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2084374 May 12 15:30:29.861501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb13776d-678c-4c42-a648-a4d847842b64 req-b877c197-7f05-47e2-ab2b-77eadab343e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:29.863655 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1734e9f4-6d6b-4056-8edf-072435f4181a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:29.864152 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb13776d-678c-4c42-a648-a4d847842b64 req-b877c197-7f05-47e2-ab2b-77eadab343e2 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=353d3bc3be9843c584641e13595ca055&device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 1094 time: 0.6873009 May 12 15:30:29.868108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] For port 3283015e-7f0d-447c-b1c3-25d7034f9c29, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3283015e-7f0d-447c-b1c3-25d7034f9c29,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:29.868480 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:29.992943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1734e9f4-6d6b-4056-8edf-072435f4181a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:30.031111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1734e9f4-6d6b-4056-8edf-072435f4181a admin admin] Usage tracker for resource:security_group_rule and tenant:62044d5a018048b2b1992b8f8dd34701 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:30.042694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1734e9f4-6d6b-4056-8edf-072435f4181a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:30.065179 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1734e9f4-6d6b-4056-8edf-072435f4181a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:30.493312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-c37e80bc-4191-4816-ab0e-d215afd40570 service neutron] 10.222.0.82 "GET /v2.0/networks/19102399-18db-4840-b998-adc5bada1da0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6183760 May 12 15:30:30.614793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3167e4a2-b2a4-46cf-9dd5-09b194a08e7c req-28b05b1f-5dce-4b0d-888e-62ce6996ea9e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:30.622551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3167e4a2-b2a4-46cf-9dd5-09b194a08e7c req-28b05b1f-5dce-4b0d-888e-62ce6996ea9e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 946 time: 0.4494669 May 12 15:30:30.703011 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1734e9f4-6d6b-4056-8edf-072435f4181a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:30.718569 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1734e9f4-6d6b-4056-8edf-072435f4181a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:30.756992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 3283015e-7f0d-447c-b1c3-25d7034f9c29 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:30:30.785151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb13776d-678c-4c42-a648-a4d847842b64 req-3790e049-b45c-4395-bbca-db45226b3851 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:30.786642 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb13776d-678c-4c42-a648-a4d847842b64 req-3790e049-b45c-4395-bbca-db45226b3851 service neutron] 10.222.0.84 "GET /v2.0/networks?id=2c3462d2-bb87-4375-8260-fad70ee527dc HTTP/1.1" status: 200 len: 909 time: 0.9099593 May 12 15:30:30.809653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3167e4a2-b2a4-46cf-9dd5-09b194a08e7c req-93cde6e7-07a4-4f56-bf4d-3dea853f379c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1784232 May 12 15:30:30.910912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1734e9f4-6d6b-4056-8edf-072435f4181a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1644a08a-56ff-4aac-8606-0709eac4ff2c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:30.951007 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb13776d-678c-4c42-a648-a4d847842b64 req-1e2da897-7cb9-482f-8b93-d1195e5360c3 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff HTTP/1.1" status: 200 len: 217 time: 0.1156824 May 12 15:30:31.076630 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:31.094462 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:31.095092 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:31.098946 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Floating IP f8768448-30de-4f5a-8cc7-13fa25003fa4 disassociated. External IP: 172.25.8.41, port: 3283015e-7f0d-447c-b1c3-25d7034f9c29. May 12 15:30:31.099615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Calling delete_port for 3283015e-7f0d-447c-b1c3-25d7034f9c29 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:31.100836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1734e9f4-6d6b-4056-8edf-072435f4181a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=62044d5a018048b2b1992b8f8dd34701&name=default HTTP/1.1" status: 200 len: 2983 time: 1.5446160 May 12 15:30:31.145984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ac261e00-23bd-428e-af60-6376594bb94f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3283015e-7f0d-447c-b1c3-25d7034f9c29'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:30:31.164525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48984) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:31.171060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 3283015e-7f0d-447c-b1c3-25d7034f9c29, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3283015e-7f0d-447c-b1c3-25d7034f9c29,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:31.176852 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:31.223197 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-042e39b6-0a9d-4827-983d-0457e097643f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:31.230704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b8dbcbc-66aa-473e-954f-4a6641f3175e req-decd347a-8305-48b8-8bab-3c4d3816d4d6 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 210 time: 0.3032758 May 12 15:30:31.350435 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=3283015e-7f0d-447c-b1c3-25d7034f9c29,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:31.369088 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:31.371735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:31.372379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:31.373065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:31.374394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:31.374950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:31.376141 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:31.378780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:31.379519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:31.380085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:31.381887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:31.382472 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:31.420487 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f2c06bd6-a2d4-409c-a805-c01e621fcf97 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:31.462531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52fa0adf-701d-45fe-9115-1106f2743db1 req-86262957-a507-4c86-9a59-64e350ee9766 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:31.478731 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52fa0adf-701d-45fe-9115-1106f2743db1 req-86262957-a507-4c86-9a59-64e350ee9766 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 943 time: 0.4470422 May 12 15:30:31.555983 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f2c06bd6-a2d4-409c-a805-c01e621fcf97 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:31.610311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-042e39b6-0a9d-4827-983d-0457e097643f admin admin] Pushing event deleted for resources: {'Port': ['ID=42a2c229-d13e-4ea9-b530-c7d65e4999da,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:31.700124 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-463a1224-abbe-4fc7-8045-9e036da739dc'] response: {'server_uuid': 'ac261e00-23bd-428e-af60-6376594bb94f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3283015e-7f0d-447c-b1c3-25d7034f9c29', 'code': 200} May 12 15:30:31.716997 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52fa0adf-701d-45fe-9115-1106f2743db1 req-bea7b1b5-6586-43ff-9c7b-d7227644ea0a tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/security-groups?id=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2373118 May 12 15:30:31.760248 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f2c06bd6-a2d4-409c-a805-c01e621fcf97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:31.800259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2c06bd6-a2d4-409c-a805-c01e621fcf97 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1644a08a-56ff-4aac-8606-0709eac4ff2c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:31.825722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb13776d-678c-4c42-a648-a4d847842b64 req-151162aa-cfc2-48d2-b523-08682e8bde1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:31.827177 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb13776d-678c-4c42-a648-a4d847842b64 req-151162aa-cfc2-48d2-b523-08682e8bde1f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5cd005ab-44f1-4a8f-9e54-c87c6ffbd1f4 HTTP/1.1" status: 200 len: 848 time: 0.8246562 May 12 15:30:31.829454 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f2c06bd6-a2d4-409c-a805-c01e621fcf97 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:31.833349 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f2c06bd6-a2d4-409c-a805-c01e621fcf97 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1644a08a-56ff-4aac-8606-0709eac4ff2c HTTP/1.1" status: 204 len: 168 time: 0.6629519 May 12 15:30:31.847385 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:30:31.847706 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:30:31.942085 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb13776d-678c-4c42-a648-a4d847842b64 req-8de3b58e-9416-4556-9330-14f8729f3099 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2c3462d2-bb87-4375-8260-fad70ee527dc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0934348 May 12 15:30:32.172489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29f5c984-f15e-4237-8260-167b86a308d5 req-0b61737b-1e60-4e6a-a4ee-76320d3a63e9 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:32.176473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29f5c984-f15e-4237-8260-167b86a308d5 req-0b61737b-1e60-4e6a-a4ee-76320d3a63e9 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 944 time: 0.1694756 May 12 15:30:32.378598 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29f5c984-f15e-4237-8260-167b86a308d5 req-4bf76168-7a02-4247-a8e3-09cbfd63f221 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1782055 May 12 15:30:32.382187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Deleting port 3283015e-7f0d-447c-b1c3-25d7034f9c29 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:32.382544 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:32.392531 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:32.409085 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-042e39b6-0a9d-4827-983d-0457e097643f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:32.547737 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e888f99-c5e9-4821-8c38-8a420542dc4a req-50fce256-77d0-46eb-bc4a-0bf2cdd5d39d tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 210 time: 0.0725551 May 12 15:30:32.619305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-517731c1-e1f8-4879-8792-54f8d6e374a5 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:32.621214 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-517731c1-e1f8-4879-8792-54f8d6e374a5 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.76 "GET /v2.0/networks?id=19102399-18db-4840-b998-adc5bada1da0 HTTP/1.1" status: 200 len: 813 time: 0.2041488 May 12 15:30:32.649332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Request body: {'port': {'device_id': '134b4b36-e12c-4748-ab4f-3da58290fc83', 'network_id': '19102399-18db-4840-b998-adc5bada1da0', 'admin_state_up': True, 'tenant_id': 'e1146a673b454173a1ed844897ff4119'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:32.702093 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49038) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:32.809499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:32.814088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Usage tracker for resource:port and tenant:e1146a673b454173a1ed844897ff4119 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:32.817717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:32.825358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:32.850756 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5cb9fa81-07da-4754-a5cf-293c28b857f6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8f914cadb93148fe9a3fb827546b2c55&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1471753 May 12 15:30:32.853655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49044) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:33.045361 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9f2793e-e666-48e7-a6bf-22a6cef77cf8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:33.071206 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb13776d-678c-4c42-a648-a4d847842b64 req-36d72919-70e5-49c2-9559-7cbb99645cec service neutron] 10.222.0.84 "GET /v2.0/networks/2c3462d2-bb87-4375-8260-fad70ee527dc?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0899665 May 12 15:30:33.084137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49052) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:33.095029 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9f2793e-e666-48e7-a6bf-22a6cef77cf8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:33.154603 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db3556f-7d63-4b0a-bb27-2518f242731b req-969c2719-a9ec-4a70-a2d3-e0dc947f304e tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:33.156201 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9db3556f-7d63-4b0a-bb27-2518f242731b req-969c2719-a9ec-4a70-a2d3-e0dc947f304e tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 943 time: 0.1889679 May 12 15:30:33.216430 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9db3556f-7d63-4b0a-bb27-2518f242731b req-fe26ff5a-1b94-4877-8a17-dfed4a905949 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/security-groups?id=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515468 May 12 15:30:33.224274 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9f2793e-e666-48e7-a6bf-22a6cef77cf8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:33.255873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9f2793e-e666-48e7-a6bf-22a6cef77cf8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f227515-bec6-4f1b-9658-73f3105c568c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:33.266096 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9f2793e-e666-48e7-a6bf-22a6cef77cf8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:33.267661 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f9f2793e-e666-48e7-a6bf-22a6cef77cf8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6f227515-bec6-4f1b-9658-73f3105c568c HTTP/1.1" status: 204 len: 168 time: 0.4129181 May 12 15:30:33.371760 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-232ea91f-6d6d-4bbf-8019-bbf9e9006b44 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:33.420704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Made reservation on behalf of e1146a673b454173a1ed844897ff4119 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:30:33.422696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-232ea91f-6d6d-4bbf-8019-bbf9e9006b44 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:33.432889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-232ea91f-6d6d-4bbf-8019-bbf9e9006b44 admin admin] Usage tracker for resource:security_group_rule and tenant:52a142aaf7374d858eb7f6ffed848438 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:33.441909 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:33.442478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-232ea91f-6d6d-4bbf-8019-bbf9e9006b44 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:33.456275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-232ea91f-6d6d-4bbf-8019-bbf9e9006b44 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:33.641837 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-232ea91f-6d6d-4bbf-8019-bbf9e9006b44 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:33.648433 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-232ea91f-6d6d-4bbf-8019-bbf9e9006b44 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:33.705406 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:30:33.841564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49080) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:33.924101 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5b151fc-b255-43a3-b7b1-7763354afce5 req-5ad67bec-b336-4ca9-87fd-6f573b36a8d0 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 210 time: 0.1154265 May 12 15:30:33.943878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-232ea91f-6d6d-4bbf-8019-bbf9e9006b44 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=52a142aaf7374d858eb7f6ffed848438&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8587072 May 12 15:30:33.946687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff,segment=NetworkSegment(b9b3325b-c79b-4a26-83a0-152dee070f23),segment_id=b9b3325b-c79b-4a26-83a0-152dee070f23)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:33.956288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49090) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:33.963191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-232ea91f-6d6d-4bbf-8019-bbf9e9006b44 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=165080b9-a804-4538-a21c-f5203f77f7b1,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:33.963886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff', 'network_id': '2c3462d2-bb87-4375-8260-fad70ee527dc', 'port_id': '86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff', 'mac_address': 'fa:16:3e:14:0e:78', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 599, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5cd005ab-44f1-4a8f-9e54-c87c6ffbd1f4', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:30:34.057202 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:34.089171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:30:34.093958 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ec981119-42d5-4458-bccc-5e03b6d1a32f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:34.133403 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff,segment=NetworkSegment(b9b3325b-c79b-4a26-83a0-152dee070f23),segment_id=b9b3325b-c79b-4a26-83a0-152dee070f23)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:34.138441 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:34.159732 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ec981119-42d5-4458-bccc-5e03b6d1a32f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:34.180251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c27192a-5995-4288-91c0-de767a5c38b7 req-93f4c852-dba2-42e7-863b-c9f502fbf301 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:34.187755 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c27192a-5995-4288-91c0-de767a5c38b7 req-93f4c852-dba2-42e7-863b-c9f502fbf301 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 944 time: 0.4970703 May 12 15:30:34.217622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:34.224084 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ae0e9f7-fc99-423c-b325-2cd5d6207ad1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:34.261253 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5ae0e9f7-fc99-423c-b325-2cd5d6207ad1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:34.279063 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c27192a-5995-4288-91c0-de767a5c38b7 req-ed3c32e7-1ea3-4a98-85fb-7f1285771eaf tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0902867 May 12 15:30:34.295502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5ae0e9f7-fc99-423c-b325-2cd5d6207ad1 admin admin] Usage tracker for resource:security_group_rule and tenant:d4b57068ce56463586d2f831ca663850 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:34.306139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5ae0e9f7-fc99-423c-b325-2cd5d6207ad1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:34.312326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-042e39b6-0a9d-4827-983d-0457e097643f admin admin] Router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:30:34.322070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5ae0e9f7-fc99-423c-b325-2cd5d6207ad1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:34.368774 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cb13776d-678c-4c42-a648-a4d847842b64 req-1ed67134-940f-4214-844d-eaf08ed38376 service neutron] 10.222.0.84 "GET /v2.0/networks/2c3462d2-bb87-4375-8260-fad70ee527dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.0305831 May 12 15:30:34.410219 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ec981119-42d5-4458-bccc-5e03b6d1a32f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:34.462573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec981119-42d5-4458-bccc-5e03b6d1a32f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=165080b9-a804-4538-a21c-f5203f77f7b1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:34.499269 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:30:34.571110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49108) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:34.578244 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ec981119-42d5-4458-bccc-5e03b6d1a32f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:34.579992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ec981119-42d5-4458-bccc-5e03b6d1a32f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/165080b9-a804-4538-a21c-f5203f77f7b1 HTTP/1.1" status: 204 len: 168 time: 0.6223216 May 12 15:30:34.642830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] For port 3283015e-7f0d-447c-b1c3-25d7034f9c29, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3283015e-7f0d-447c-b1c3-25d7034f9c29,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:34.643116 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:34.669006 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ae0e9f7-fc99-423c-b325-2cd5d6207ad1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:34.679235 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ae0e9f7-fc99-423c-b325-2cd5d6207ad1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:34.727289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ae0e9f7-fc99-423c-b325-2cd5d6207ad1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3a318241-7a6b-4673-b954-03ad52500755,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:34.740543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b609d2-b2ca-4d19-b4ad-f4e43b5a51e8 req-8fffe167-f3fb-4e6b-8d38-ac2687356545 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:34.748071 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49b609d2-b2ca-4d19-b4ad-f4e43b5a51e8 req-8fffe167-f3fb-4e6b-8d38-ac2687356545 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 944 time: 0.2401540 May 12 15:30:34.792986 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5ae0e9f7-fc99-423c-b325-2cd5d6207ad1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d4b57068ce56463586d2f831ca663850&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9504881 May 12 15:30:34.793839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49118) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:34.856890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Request body: {'networks': [{'name': 'tempest-network--680038911'}, {'name': 'tempest-network--1179748755'}]} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:34.857202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Request body: {'network': {'name': 'tempest-network--680038911'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:34.857699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Request body: {'network': {'name': 'tempest-network--1179748755'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:34.862772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:34.866763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Usage tracker for resource:network and tenant:2faf83d4488c45e09589f2ce8eead989 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:34.870096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:34.876147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attempting to reserve 2 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:34.890848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Made reservation on behalf of 2faf83d4488c45e09589f2ce8eead989 for: {'network': 2} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:30:34.897427 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:34.925897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49b609d2-b2ca-4d19-b4ad-f4e43b5a51e8 req-2bf6e7da-a277-4d68-9b19-28b938ceb3c7 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/security-groups?id=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1768751 May 12 15:30:34.964979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Allocated IP 172.20.0.13 (19102399-18db-4840-b998-adc5bada1da0/5191993e-726b-4897-9b02-25fe32b3009b/cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:30:34.984837 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:34.994547 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eb4c323b-87d9-4cb5-bcbd-bc7009c83cef admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.017800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:35.032025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Usage tracker for resource:security_group_rule and tenant:2faf83d4488c45e09589f2ce8eead989 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:35.037243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:35.041086 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eb4c323b-87d9-4cb5-bcbd-bc7009c83cef admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.056870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:35.155705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-042e39b6-0a9d-4827-983d-0457e097643f admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:30:35.167803 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6970516f-ca3d-46ae-9caf-8c5616d6aa0f None None] Sync routers for ids ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:30:35.182612 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6970516f-ca3d-46ae-9caf-8c5616d6aa0f None None] Routers {'0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:30:35.184205 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6970516f-ca3d-46ae-9caf-8c5616d6aa0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:30:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:35.286746 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecc43d87-2a15-43f9-a473-9ec777830e1d req-c32f682c-7391-4d96-88f7-94a7099bcdd9 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 210 time: 0.1301222 May 12 15:30:35.297937 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.320868 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.322139 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.402868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49128) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:35.403829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cc06c561-d582-4238-84b9-17efea50a6d3,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:35.457627 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-90ac445e-ec79-4f03-8f53-6b406622eeaf admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.498530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-90ac445e-ec79-4f03-8f53-6b406622eeaf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:35.500601 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eb4c323b-87d9-4cb5-bcbd-bc7009c83cef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.514262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 582} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:30:35.523780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-90ac445e-ec79-4f03-8f53-6b406622eeaf admin admin] Usage tracker for resource:security_group_rule and tenant:147ce35dff014583848a083d2bbbb945 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:35.532378 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-042e39b6-0a9d-4827-983d-0457e097643f admin admin] 10.222.0.82 "PUT /v2.0/routers/0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 11.4761045 May 12 15:30:35.533880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49132) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:35.563142 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6970516f-ca3d-46ae-9caf-8c5616d6aa0f None None] Set router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:30:35.564108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-90ac445e-ec79-4f03-8f53-6b406622eeaf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:35.586591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb4c323b-87d9-4cb5-bcbd-bc7009c83cef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a318241-7a6b-4673-b954-03ad52500755,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:35.588857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-90ac445e-ec79-4f03-8f53-6b406622eeaf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:35.592372 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.592484 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Added segment 561f5ba1-1ff4-4f71-9fa6-b7d9b4cc217e of type vlan for network 6c2315aa-ef30-4793-98c3-5c90e953ced7 May 12 15:30:35.665569 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eb4c323b-87d9-4cb5-bcbd-bc7009c83cef admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.667720 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.668099 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.668427 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Floating IP f8768448-30de-4f5a-8cc7-13fa25003fa4 disassociated. External IP: 172.25.8.41, port: 3283015e-7f0d-447c-b1c3-25d7034f9c29. May 12 15:30:35.668763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Calling delete_port for 3283015e-7f0d-447c-b1c3-25d7034f9c29 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:35.669689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-eb4c323b-87d9-4cb5-bcbd-bc7009c83cef admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3a318241-7a6b-4673-b954-03ad52500755 HTTP/1.1" status: 204 len: 168 time: 0.8746221 May 12 15:30:35.673420 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.704734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:30:35.760035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34ba99e4-10ae-4c15-a069-d02ee1ff2f8c req-325b153f-3e97-43b6-99e0-63e0379c1c2a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:35.766539 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34ba99e4-10ae-4c15-a069-d02ee1ff2f8c req-325b153f-3e97-43b6-99e0-63e0379c1c2a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 944 time: 0.2544143 May 12 15:30:35.770007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 573} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:30:35.800022 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.844574 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.916505 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:35.917082 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Added segment a103d0d0-b561-4333-94e9-96c5c7d6e83f of type vlan for network 51b17c73-df56-4b39-94fe-fc7c9399df6a May 12 15:30:35.928148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:30:35.937079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:30:35.938240 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:36.006140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Pushing event updated for resources: {'Port': ['ID=cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:36.022728 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-90ac445e-ec79-4f03-8f53-6b406622eeaf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:36.066266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Network 19102399-18db-4840-b998-adc5bada1da0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:30:36.071385 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:30:36.078793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34ba99e4-10ae-4c15-a069-d02ee1ff2f8c req-5d878bd7-1d8a-475c-84ee-7b19c4b312c5 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=316ae526-e99a-4991-90e7-1c6c4404d21a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3113244 May 12 15:30:36.081652 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-90ac445e-ec79-4f03-8f53-6b406622eeaf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:36.100830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:30:36.109028 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6970516f-ca3d-46ae-9caf-8c5616d6aa0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:30:30Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:36.114954 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6970516f-ca3d-46ae-9caf-8c5616d6aa0f None None] Checking router: 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:30:36.129823 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:36.179071 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6970516f-ca3d-46ae-9caf-8c5616d6aa0f None None] Routers {'0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:30:36.180017 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6970516f-ca3d-46ae-9caf-8c5616d6aa0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:30:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:36.228001 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:36.229300 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:36.232895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-90ac445e-ec79-4f03-8f53-6b406622eeaf admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=147ce35dff014583848a083d2bbbb945&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8218029 May 12 15:30:36.236792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ac445e-ec79-4f03-8f53-6b406622eeaf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e77e341e-c59b-43e8-86dc-931fcee90269,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:36.242965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49148) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:36.320940 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:36.322446 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:36.349553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5fc497ea-091b-44f8-960f-b26e9b13a563', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:30:36.349679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:36.361200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:36.361316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff,segment=NetworkSegment(b9b3325b-c79b-4a26-83a0-152dee070f23),segment_id=b9b3325b-c79b-4a26-83a0-152dee070f23)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:36.365082 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:36.370679 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:36.528733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1319 time: 1.9469326 May 12 15:30:36.541326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49162) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:36.592436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:36.709135 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6970516f-ca3d-46ae-9caf-8c5616d6aa0f None None] Set router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:30:36.739504 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e978bf7c-7ba4-4d26-a5b4-af87f97ff1c2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:36.757271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7060cf4-753d-416f-b13a-2a1bf343b2a4 req-f4088d7d-211f-4ca4-9e61-66d2500bb318 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:36.758438 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7060cf4-753d-416f-b13a-2a1bf343b2a4 req-f4088d7d-211f-4ca4-9e61-66d2500bb318 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 944 time: 0.6069093 May 12 15:30:36.759104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event updated for resources: {'Network': ['ID=6c2315aa-ef30-4793-98c3-5c90e953ced7,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:36.769199 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:36.772345 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:36.776191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 6c2315aa-ef30-4793-98c3-5c90e953ced7 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:30:36.919044 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-4a520be0-d6f5-4899-bb4d-ee6c4761a77e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 4.2793190 May 12 15:30:36.924461 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:36.941142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Request body: {'port': {'device_id': '134b4b36-e12c-4748-ab4f-3da58290fc83', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:36.957237 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e978bf7c-7ba4-4d26-a5b4-af87f97ff1c2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:37.015733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7060cf4-753d-416f-b13a-2a1bf343b2a4 req-8b062f1c-ae6b-43ba-89ca-7c3ce9654b20 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/security-groups?id=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2210321 May 12 15:30:37.016332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5b70d46-f703-4f60-bda4-1602cf719590 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event updated for resources: {'Network': ['ID=51b17c73-df56-4b39-94fe-fc7c9399df6a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:37.030931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 51b17c73-df56-4b39-94fe-fc7c9399df6a details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:30:37.038040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d01be996-fc9c-4744-ab9f-271086155eb7 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:37.049760 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d01be996-fc9c-4744-ab9f-271086155eb7 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:37.059861 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d01be996-fc9c-4744-ab9f-271086155eb7 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:37.078445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d01be996-fc9c-4744-ab9f-271086155eb7 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:37.079323 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d01be996-fc9c-4744-ab9f-271086155eb7 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Synchronizing usage tracker for tenant:2faf83d4488c45e09589f2ce8eead989 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:30:37.175988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d01be996-fc9c-4744-ab9f-271086155eb7 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Unset dirty status for tenant:2faf83d4488c45e09589f2ce8eead989 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:30:37.188904 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d01be996-fc9c-4744-ab9f-271086155eb7 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2406 time: 0.6296961 May 12 15:30:37.189645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49178) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:37.204836 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6970516f-ca3d-46ae-9caf-8c5616d6aa0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:30:30Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:37.210691 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6970516f-ca3d-46ae-9caf-8c5616d6aa0f None None] The sync data for ids ['0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c'] in n-d-841483-1 is: [{'id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'name': 'tempest-AttachVolumeTestJSON-1062208242-router', 'tenant_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102'}], 'enable_snat': True}, 'gw_port_id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:24:26Z', 'updated_at': '2022-05-12T15:30:30Z', 'revision_number': 5, 'project_id': 'f4660a6351274a7796c2eb1e55a41ec9', 'gw_port': {'id': '1682faa0-a8c8-4629-bbe3-885bbde7d3bf', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:d5:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1790, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:24:28Z', 'updated_at': '2022-05-12T15:24:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:30:37.211474 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9c8c45ec-743a-4a59-aa7d-318643e8f9f2'] response: {'server_uuid': '5fc497ea-091b-44f8-960f-b26e9b13a563', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff', 'code': 200} May 12 15:30:37.213849 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e978bf7c-7ba4-4d26-a5b4-af87f97ff1c2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:37.252234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd723bf5-4013-487d-8139-cd3cd3a1cd0d req-d29cc320-6ead-4448-bed2-afda2f736183 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:37.276263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd723bf5-4013-487d-8139-cd3cd3a1cd0d req-d29cc320-6ead-4448-bed2-afda2f736183 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 932 time: 0.7070460 May 12 15:30:37.339000 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:37.400490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event deleted for resources: {'Port': ['ID=3283015e-7f0d-447c-b1c3-25d7034f9c29,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:37.415395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e978bf7c-7ba4-4d26-a5b4-af87f97ff1c2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e77e341e-c59b-43e8-86dc-931fcee90269,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:37.563393 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e978bf7c-7ba4-4d26-a5b4-af87f97ff1c2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:37.564878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e978bf7c-7ba4-4d26-a5b4-af87f97ff1c2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e77e341e-c59b-43e8-86dc-931fcee90269 HTTP/1.1" status: 204 len: 168 time: 1.3207111 May 12 15:30:37.649793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 42a2c229-d13e-4ea9-b530-c7d65e4999da no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:30:37.687802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd723bf5-4013-487d-8139-cd3cd3a1cd0d req-347f42a7-81e5-4217-a095-d4c51024d2c4 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4102345 May 12 15:30:37.717470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7fc03f70-920d-49e4-bbba-88fb0e7b8de3 req-843f5b6a-d356-4245-bd4a-6a416e674ca8 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 210 time: 0.1427619 May 12 15:30:37.736790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 42a2c229-d13e-4ea9-b530-c7d65e4999da {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:30:37.739530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 42a2c229-d13e-4ea9-b530-c7d65e4999da not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:30:37.766615 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-56b483d8-8c82-480c-86c4-6dae80b8e71b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:37.780744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] Deleting port 1682faa0-a8c8-4629-bbe3-885bbde7d3bf {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:37.781235 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:38.142618 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-56b483d8-8c82-480c-86c4-6dae80b8e71b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:38.187953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-56b483d8-8c82-480c-86c4-6dae80b8e71b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6c2315aa-ef30-4793-98c3-5c90e953ced7']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:38.210255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-56b483d8-8c82-480c-86c4-6dae80b8e71b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '561f5ba1-1ff4-4f71-9fa6-b7d9b4cc217e') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:38.210931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-56b483d8-8c82-480c-86c4-6dae80b8e71b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '561f5ba1-1ff4-4f71-9fa6-b7d9b4cc217e') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:38.229600 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-56b483d8-8c82-480c-86c4-6dae80b8e71b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:38.322124 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-56b483d8-8c82-480c-86c4-6dae80b8e71b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:38.335159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-56b483d8-8c82-480c-86c4-6dae80b8e71b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Releasing vlan 582 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:30:38.335756 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-56b483d8-8c82-480c-86c4-6dae80b8e71b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:38.340788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] For port 1682faa0-a8c8-4629-bbe3-885bbde7d3bf, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1682faa0-a8c8-4629-bbe3-885bbde7d3bf,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:38.341170 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: timer() May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:30:38.353744 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:30:38.498670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c0395f7-b9ef-4bd1-9f45-ffffd834182a req-f3187d0c-71b1-43a1-89e8-a739722b409c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:38.507976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5c0395f7-b9ef-4bd1-9f45-ffffd834182a req-f3187d0c-71b1-43a1-89e8-a739722b409c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 945 time: 0.2663972 May 12 15:30:38.555429 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-56b483d8-8c82-480c-86c4-6dae80b8e71b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:38.616203 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-56b483d8-8c82-480c-86c4-6dae80b8e71b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:38.630019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56b483d8-8c82-480c-86c4-6dae80b8e71b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event deleted for resources: {'Network': ['ID=6c2315aa-ef30-4793-98c3-5c90e953ced7,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:38.701032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5c0395f7-b9ef-4bd1-9f45-ffffd834182a req-8ffa931f-32da-4128-9b46-4c227d878e4c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/security-groups?id=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1870914 May 12 15:30:38.714279 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-56b483d8-8c82-480c-86c4-6dae80b8e71b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "DELETE /v2.0/networks/6c2315aa-ef30-4793-98c3-5c90e953ced7 HTTP/1.1" status: 204 len: 168 time: 1.5179412 May 12 15:30:38.716192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49234) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:38.750434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] Calling delete_port for 1682faa0-a8c8-4629-bbe3-885bbde7d3bf owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:38.798903 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:38.811214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:30:39.064862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-324c0a56-085c-44ee-92d8-982a1333b4ac req-2fc07ddf-adde-4d9a-a254-fb0aa6b86292 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:39.066713 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-324c0a56-085c-44ee-92d8-982a1333b4ac req-2fc07ddf-adde-4d9a-a254-fb0aa6b86292 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 1096 time: 1.7613878 May 12 15:30:39.307516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49252) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:39.318191 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-39960cc7-ea4b-4e93-a842-686b51f7eaf4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:39.416502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc46a224-2976-4d8a-8d31-5425f6e1f487 req-41f722fd-6e4d-4cef-9fcb-3cf195a82cc4 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 210 time: 0.1036735 May 12 15:30:39.577449 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-324c0a56-085c-44ee-92d8-982a1333b4ac req-60f43dd4-1cc5-46fb-bf11-7d2e0d6cbbf7 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4287994 May 12 15:30:39.582287 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:30:39.590693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad952c37-28f3-4d41-ad05-3bef1a4aa24e req-ef711a16-a753-46e3-9d2e-f55d23b9004e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:39.599758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-981fe1f3-fded-4613-9e0b-a4e0a6537004 None None] Sync routers for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:30:39.606904 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad952c37-28f3-4d41-ad05-3bef1a4aa24e req-ef711a16-a753-46e3-9d2e-f55d23b9004e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 932 time: 0.6773810 May 12 15:30:39.615522 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-981fe1f3-fded-4613-9e0b-a4e0a6537004 None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:30:39.616164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-981fe1f3-fded-4613-9e0b-a4e0a6537004 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:30:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:39.647499 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-39960cc7-ea4b-4e93-a842-686b51f7eaf4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:39.742164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-39960cc7-ea4b-4e93-a842-686b51f7eaf4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['51b17c73-df56-4b39-94fe-fc7c9399df6a']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:39.766987 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-39960cc7-ea4b-4e93-a842-686b51f7eaf4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a103d0d0-b561-4333-94e9-96c5c7d6e83f') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:39.767515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-39960cc7-ea4b-4e93-a842-686b51f7eaf4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a103d0d0-b561-4333-94e9-96c5c7d6e83f') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:39.786400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] No DVR routers for this DVR port 3283015e-7f0d-447c-b1c3-25d7034f9c29 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:30:39.792787 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:39.793699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad952c37-28f3-4d41-ad05-3bef1a4aa24e req-038915cd-897d-4df3-8159-e92130cd5488 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1836777 May 12 15:30:39.798090 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-375b3ead-de09-4128-bc6c-f370cd113580 req-681ed936-ec80-47ae-ad25-5f73b5f11243 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.76 "DELETE /v2.0/ports/3283015e-7f0d-447c-b1c3-25d7034f9c29 HTTP/1.1" status: 204 len: 173 time: 11.7433133 May 12 15:30:39.807310 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-39960cc7-ea4b-4e93-a842-686b51f7eaf4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:39.836759 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-39960cc7-ea4b-4e93-a842-686b51f7eaf4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:39.841552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ac261e00-23bd-428e-af60-6376594bb94f', 'name': 'network-vif-deleted', 'tag': '3283015e-7f0d-447c-b1c3-25d7034f9c29'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:30:39.845357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-39960cc7-ea4b-4e93-a842-686b51f7eaf4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Releasing vlan 573 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:30:39.845845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-39960cc7-ea4b-4e93-a842-686b51f7eaf4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:39.865495 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3f15b59-deb8-4777-aeb6-47af9f24605c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: timer() May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:30:39.880483 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:30:39.920102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b3f15b59-deb8-4777-aeb6-47af9f24605c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:39.949242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b3f15b59-deb8-4777-aeb6-47af9f24605c admin admin] Usage tracker for resource:security_group_rule and tenant:5f28025d79c9438a85530b4b7940d8bc is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:39.959967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-981fe1f3-fded-4613-9e0b-a4e0a6537004 None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:30:39.985657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b3f15b59-deb8-4777-aeb6-47af9f24605c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:40.005948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b3f15b59-deb8-4777-aeb6-47af9f24605c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:40.087702 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:40.176393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] Pushing event deleted for resources: {'Port': ['ID=1682faa0-a8c8-4629-bbe3-885bbde7d3bf,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:40.266151 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-39960cc7-ea4b-4e93-a842-686b51f7eaf4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:40.322181 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2273c3cf-5b19-4dcb-958d-9328cfc692fd'] response: {'server_uuid': 'ac261e00-23bd-428e-af60-6376594bb94f', 'name': 'network-vif-deleted', 'tag': '3283015e-7f0d-447c-b1c3-25d7034f9c29', 'status': 'completed', 'code': 200} May 12 15:30:40.326930 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-39960cc7-ea4b-4e93-a842-686b51f7eaf4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:40.342773 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-39960cc7-ea4b-4e93-a842-686b51f7eaf4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "DELETE /v2.0/networks/51b17c73-df56-4b39-94fe-fc7c9399df6a HTTP/1.1" status: 204 len: 168 time: 1.6253121 May 12 15:30:40.347667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49280) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:40.350684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39960cc7-ea4b-4e93-a842-686b51f7eaf4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event deleted for resources: {'Network': ['ID=51b17c73-df56-4b39-94fe-fc7c9399df6a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:40.387416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b07ebe0-fde5-43fc-89cd-8e646b3a48c1 req-51484050-7a18-4fef-99a2-273c502b01d3 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:40.398571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b07ebe0-fde5-43fc-89cd-8e646b3a48c1 req-51484050-7a18-4fef-99a2-273c502b01d3 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 945 time: 0.3664095 May 12 15:30:40.471476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b07ebe0-fde5-43fc-89cd-8e646b3a48c1 req-5737c6de-9bbe-4d39-b80d-3ab7f92ff1ed tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/security-groups?id=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715477 May 12 15:30:40.590185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:30:40.621881 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:40.711940 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a352570-a671-4137-9e48-d497e4c4fcaf req-ac111242-d10f-413a-854b-7160f4269006 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac261e00-23bd-428e-af60-6376594bb94f HTTP/1.1" status: 200 len: 210 time: 0.1268408 May 12 15:30:40.848369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-981fe1f3-fded-4613-9e0b-a4e0a6537004 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ad94042f-a6a1-4708-ab51-e49f96948e07', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.38', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 2012, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:b0:1d:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:27:56Z', 'updated_at': '2022-05-12T15:28:32Z', 'revision_number': 2, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:40.853303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-981fe1f3-fded-4613-9e0b-a4e0a6537004 None None] Checking router: 616c45f4-38af-4ff7-8fb7-f1c61b204b6a for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:30:40.866010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-981fe1f3-fded-4613-9e0b-a4e0a6537004 None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:30:40.866636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-981fe1f3-fded-4613-9e0b-a4e0a6537004 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:30:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:40.936794 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:40.995596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Transition to ACTIVE for port object cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:30:41.026482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:41.028987 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:41.097204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80d44dfd-0577-4e0e-8f73-068f777e6347 req-fc59afeb-0e6a-4447-a1f1-94e3b286e74a tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:41.104291 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-80d44dfd-0577-4e0e-8f73-068f777e6347 req-fc59afeb-0e6a-4447-a1f1-94e3b286e74a tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 944 time: 0.1232052 May 12 15:30:41.108037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-981fe1f3-fded-4613-9e0b-a4e0a6537004 None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:30:41.120907 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:41.173371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-80d44dfd-0577-4e0e-8f73-068f777e6347 req-de8faedc-6ec6-40ec-9e0c-a963dd42b088 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0680668 May 12 15:30:41.182759 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:41.183425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:30:41.360794 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3f15b59-deb8-4777-aeb6-47af9f24605c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:41.505788 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3f15b59-deb8-4777-aeb6-47af9f24605c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:41.639486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9558913-f2fc-4854-bc29-209103a2b8aa tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:41.649597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9558913-f2fc-4854-bc29-209103a2b8aa tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:41.652462 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49312) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:41.657910 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c9558913-f2fc-4854-bc29-209103a2b8aa tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 1.2704787 May 12 15:30:41.658079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1901896644'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:41.667378 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b3f15b59-deb8-4777-aeb6-47af9f24605c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5f28025d79c9438a85530b4b7940d8bc&name=default HTTP/1.1" status: 200 len: 2983 time: 2.1655753 May 12 15:30:41.667596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:41.673514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49316) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:41.705444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Usage tracker for resource:network and tenant:2faf83d4488c45e09589f2ce8eead989 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:41.722949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:41.755655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-981fe1f3-fded-4613-9e0b-a4e0a6537004 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ad94042f-a6a1-4708-ab51-e49f96948e07', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.38', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 2012, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:b0:1d:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:27:56Z', 'updated_at': '2022-05-12T15:28:32Z', 'revision_number': 2, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:41.759434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Pushing event updated for resources: {'Port': ['ID=cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:41.762215 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:41.765856 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-263a8fe0-b470-4f28-88f3-dd9707c8fb5f admin admin] 10.222.0.82 "DELETE /v2.0/routers/0f81d5aa-ec29-4cd2-92f4-1249c2ec9e7c HTTP/1.1" status: 204 len: 168 time: 6.2254133 May 12 15:30:41.766873 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-981fe1f3-fded-4613-9e0b-a4e0a6537004 None None] The sync data for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 is: [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ad94042f-a6a1-4708-ab51-e49f96948e07', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.38', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 2012, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:b0:1d:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:27:56Z', 'updated_at': '2022-05-12T15:28:32Z', 'revision_number': 2, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:30:41.771929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49324) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:41.871033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3f15b59-deb8-4777-aeb6-47af9f24605c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aba46181-f278-42c9-8519-67a3d076a098,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:41.874483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:41.885066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Attempting to bind port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:30:41.885356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Attempting to bind port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '3307f62e-6977-4a8d-852e-31dcfd97c476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '19102399-18db-4840-b998-adc5bada1da0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:30:41.889201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Attempting to bind port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b on network 19102399-18db-4840-b998-adc5bada1da0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:30:41.936188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b on network 19102399-18db-4840-b998-adc5bada1da0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:30:41.936556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Attempting to bind port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b on network 19102399-18db-4840-b998-adc5bada1da0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:30:41.950854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 30, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:30:41.954874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Checking segment: {'id': '3307f62e-6977-4a8d-852e-31dcfd97c476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '19102399-18db-4840-b998-adc5bada1da0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:30:41.955344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Bound using segment: {'id': '3307f62e-6977-4a8d-852e-31dcfd97c476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '19102399-18db-4840-b998-adc5bada1da0'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:30:41.959584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Bound port: cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3307f62e-6977-4a8d-852e-31dcfd97c476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '19102399-18db-4840-b998-adc5bada1da0'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:30:41.960992 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:41.966212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49332) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:42.012019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Made reservation on behalf of 2faf83d4488c45e09589f2ce8eead989 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:30:42.020078 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.048761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-ac2fb0a8-219d-429b-be38-df2e86d7d1ba admin admin] Deleting subnet 83787d82-d8a5-4f12-a025-f44dcf581189 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:30:42.062446 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac2fb0a8-219d-429b-be38-df2e86d7d1ba admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.084625 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8091975c-4e33-4dc5-816d-c13cb50655c0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.142534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] For port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:30:42.151683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] For port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b,segment=NetworkSegment(3307f62e-6977-4a8d-852e-31dcfd97c476),segment_id=3307f62e-6977-4a8d-852e-31dcfd97c476)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:30:42.156770 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac2fb0a8-219d-429b-be38-df2e86d7d1ba admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.178437 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8091975c-4e33-4dc5-816d-c13cb50655c0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.190912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 560} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:30:42.216331 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.273648 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-406f498d-bc62-4c65-80ef-ebd3343950fd None None] New status for floating IP f8768448-30de-4f5a-8cc7-13fa25003fa4: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:30:42.299452 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.300451 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Added segment 0d3c92b7-a0ee-4306-b844-a119919f7c6d of type vlan for network 9d4ee6ea-2b07-4221-abad-7a9aad88d871 May 12 15:30:42.346296 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.407322 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.416349 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:42.417603 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.509572 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75089134-85c2-47a9-919a-7f8d343958e2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.550562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7a7981f-f2db-4f77-8ddc-250e9d1d6f98 req-5f4d99d4-e519-4714-810f-46d2247119d2 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:42.563569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7a7981f-f2db-4f77-8ddc-250e9d1d6f98 req-5f4d99d4-e519-4714-810f-46d2247119d2 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 945 time: 0.8628507 May 12 15:30:42.568737 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac2fb0a8-219d-429b-be38-df2e86d7d1ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.668754 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac2fb0a8-219d-429b-be38-df2e86d7d1ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.679833 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d0d7075f-9db0-494e-b52d-6d08c90a8c09 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.744877 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac2fb0a8-219d-429b-be38-df2e86d7d1ba admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.751340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-534cf46b-0235-4b89-b822-7d7bbc4f568b None None] Network e1655f9a-2478-49d5-a6ca-4fec717d6816 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:30:42.759649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac2fb0a8-219d-429b-be38-df2e86d7d1ba admin admin] Pushing event deleted for resources: {'Subnet': ['ID=83787d82-d8a5-4f12-a025-f44dcf581189,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:42.764676 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ac2fb0a8-219d-429b-be38-df2e86d7d1ba admin admin] 10.222.0.82 "DELETE /v2.0/subnets/83787d82-d8a5-4f12-a025-f44dcf581189 HTTP/1.1" status: 204 len: 168 time: 0.9889226 May 12 15:30:42.771727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:42.773099 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.775277 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] 10.222.0.76 "PUT /v2.0/ports/cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b HTTP/1.1" status: 200 len: 1092 time: 5.8395929 May 12 15:30:42.775798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49348) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:42.779948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '134b4b36-e12c-4748-ab4f-3da58290fc83', 'tag': 'cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:30:42.871505 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 1.2155273 May 12 15:30:42.908001 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49354) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:42.913009 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75089134-85c2-47a9-919a-7f8d343958e2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:42.938358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-284543488'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:42.948708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:42.954484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Usage tracker for resource:network and tenant:2faf83d4488c45e09589f2ce8eead989 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:42.958377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:42.965977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:42.976906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd851b42-fa45-4f20-b729-48a9f73cd957 service neutron] Pushing event updated for resources: {'Port': ['ID=cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:42.978089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64676a93-f0a5-4aee-810e-d13ce14df21f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event updated for resources: {'Network': ['ID=9d4ee6ea-2b07-4221-abad-7a9aad88d871,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:43.008341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Made reservation on behalf of 2faf83d4488c45e09589f2ce8eead989 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:30:43.016641 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:43.030849 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:43.037984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-944bd33d-e83c-4803-bb35-136efd333234 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:43.039642 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-944bd33d-e83c-4803-bb35-136efd333234 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=e1146a673b454173a1ed844897ff4119&device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 1095 time: 0.2163568 May 12 15:30:43.071205 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7a7981f-f2db-4f77-8ddc-250e9d1d6f98 req-36b1f75c-141e-4cce-8be3-742d3fffb79d tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/security-groups?id=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5051076 May 12 15:30:43.123936 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-3cf64939-0fa9-4c48-8b5c-5f0954f3fbfd service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b HTTP/1.1" status: 200 len: 217 time: 0.0759594 May 12 15:30:43.128449 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8091975c-4e33-4dc5-816d-c13cb50655c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:43.132025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Deleting port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:43.132381 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:43.141521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 9d4ee6ea-2b07-4221-abad-7a9aad88d871 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:30:43.214306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 552} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:30:43.231626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8091975c-4e33-4dc5-816d-c13cb50655c0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aba46181-f278-42c9-8519-67a3d076a098,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:43.240083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49364) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:43.242568 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8091975c-4e33-4dc5-816d-c13cb50655c0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:43.244023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8091975c-4e33-4dc5-816d-c13cb50655c0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/aba46181-f278-42c9-8519-67a3d076a098 HTTP/1.1" status: 204 len: 168 time: 1.5695386 May 12 15:30:43.255491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57d60978-84a6-4a2e-9ccb-ebedb5cb44bd req-576f206b-4fd5-43b0-997f-dcab0685d20c tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:43.263335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57d60978-84a6-4a2e-9ccb-ebedb5cb44bd req-576f206b-4fd5-43b0-997f-dcab0685d20c tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 944 time: 0.8709354 May 12 15:30:43.292965 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:43.293467 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Added segment bda6e9f8-6458-4a04-8548-95112ccaa03d of type vlan for network 481d6b8b-f48e-4d12-a19b-7508b057747e May 12 15:30:43.373726 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:43.381322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1682faa0-a8c8-4629-bbe3-885bbde7d3bf no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:30:43.390022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57d60978-84a6-4a2e-9ccb-ebedb5cb44bd req-3d6da4d7-d1f8-43c3-87c6-8772df0330c4 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1256971 May 12 15:30:43.412280 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75089134-85c2-47a9-919a-7f8d343958e2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:43.469791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75089134-85c2-47a9-919a-7f8d343958e2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=316ae526-e99a-4991-90e7-1c6c4404d21a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:43.470044 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a27c0daf-66d9-4972-bd49-c18d1a5fa59c'] response: {'name': 'network-changed', 'server_uuid': '134b4b36-e12c-4748-ab4f-3da58290fc83', 'tag': 'cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b', 'status': 'completed', 'code': 200} May 12 15:30:43.504802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 1682faa0-a8c8-4629-bbe3-885bbde7d3bf {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:30:43.509780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1682faa0-a8c8-4629-bbe3-885bbde7d3bf not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:30:43.526125 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:43.531577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:43.532184 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:43.538978 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:43.596192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75089134-85c2-47a9-919a-7f8d343958e2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:43.600838 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-75089134-85c2-47a9-919a-7f8d343958e2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "DELETE /v2.0/security-groups/316ae526-e99a-4991-90e7-1c6c4404d21a HTTP/1.1" status: 204 len: 168 time: 1.6322873 May 12 15:30:43.601541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49376) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:43.688095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad4ff205-773a-4af1-9138-7eecc287990f None None] DHCP port deletion for e1655f9a-2478-49d5-a6ca-4fec717d6816 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:30:43.697802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ad4ff205-773a-4af1-9138-7eecc287990f None None] Deleting port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:43.698495 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ad4ff205-773a-4af1-9138-7eecc287990f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:43.730753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 0.8214309 May 12 15:30:43.731830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49384) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:43.747623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Request body: {'ports': [{'network_id': '9d4ee6ea-2b07-4221-abad-7a9aad88d871', 'name': 'tempest-port--2062585543', 'admin_state_up': True}, {'network_id': '481d6b8b-f48e-4d12-a19b-7508b057747e', 'admin_state_up': False}]} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:43.748242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Request body: {'port': {'network_id': '9d4ee6ea-2b07-4221-abad-7a9aad88d871', 'name': 'tempest-port--2062585543', 'admin_state_up': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:43.748822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Request body: {'port': {'network_id': '481d6b8b-f48e-4d12-a19b-7508b057747e', 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:43.864953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] For port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:43.865316 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:43.943096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d19353b-f22d-4af8-9e3e-705fc762b858 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event updated for resources: {'Network': ['ID=481d6b8b-f48e-4d12-a19b-7508b057747e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:43.960351 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 481d6b8b-f48e-4d12-a19b-7508b057747e details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:30:44.039109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Calling delete_port for b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:44.121596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-c4a17eef-aa71-4961-aeae-3b15f5e0e70c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:44.121940 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-527adec5-0c1d-4696-884d-39ec492c93b0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] show failed (client error): The resource could not be found. May 12 15:30:44.123716 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-c4a17eef-aa71-4961-aeae-3b15f5e0e70c service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5191993e-726b-4897-9b02-25fe32b3009b HTTP/1.1" status: 200 len: 853 time: 0.9927468 May 12 15:30:44.125084 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:44.130357 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-527adec5-0c1d-4696-884d-39ec492c93b0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups/316ae526-e99a-4991-90e7-1c6c4404d21a HTTP/1.1" status: 404 len: 347 time: 0.4669952 May 12 15:30:44.137035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49398) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:44.178994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] No DVR routers for this DVR port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:30:44.249625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ad4ff205-773a-4af1-9138-7eecc287990f None None] For port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b,segment=NetworkSegment(c54a2125-ccc2-41a0-9a49-29870f0679c2),segment_id=c54a2125-ccc2-41a0-9a49-29870f0679c2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:44.250020 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ad4ff205-773a-4af1-9138-7eecc287990f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:44.488983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2f00acbf-a3a9-46c2-afa7-998c6a927352 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Deleting port 10bd793e-ab8d-4717-8218-8df43f04f23e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:44.488983 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f00acbf-a3a9-46c2-afa7-998c6a927352 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:44.499957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ad4ff205-773a-4af1-9138-7eecc287990f None None] Calling delete_port for b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:44.578660 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:44.627537 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d8ae9ce-9ef8-49ce-a544-dbba7f5f7357 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:44.647912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Usage tracker for resource:port and tenant:2faf83d4488c45e09589f2ce8eead989 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:44.660369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:44.681176 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-ad4ff205-773a-4af1-9138-7eecc287990f None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:30:44.681693 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-ad4ff205-773a-4af1-9138-7eecc287990f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:30:44.688648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attempting to reserve 2 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:44.692566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Pushing event deleted for resources: {'Port': ['ID=b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:44.692876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6d8ae9ce-9ef8-49ce-a544-dbba7f5f7357 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:44.697697 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-24bb6404-019b-4a93-a571-bc685c62f2f6 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=19102399-18db-4840-b998-adc5bada1da0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.5614519 May 12 15:30:44.704328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6d8ae9ce-9ef8-49ce-a544-dbba7f5f7357 admin admin] Usage tracker for resource:security_group_rule and tenant:4f36f84af1d64830a6505ff56759a435 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:44.714282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6d8ae9ce-9ef8-49ce-a544-dbba7f5f7357 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:44.727114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6d8ae9ce-9ef8-49ce-a544-dbba7f5f7357 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:44.743879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ed4b040-b8f0-4586-aead-f7d4a71ec746 req-8c7da7ec-0373-46be-b0b6-46ded3586bf0 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:44.745593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ed4b040-b8f0-4586-aead-f7d4a71ec746 req-8c7da7ec-0373-46be-b0b6-46ded3586bf0 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 945 time: 0.6050477 May 12 15:30:44.746358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Made reservation on behalf of 2faf83d4488c45e09589f2ce8eead989 for: {'port': 2} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:30:44.750855 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:44.809288 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:44.822265 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ccfd891d-f2b5-48f1-91b4-28a1f32a1491 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:44.878946 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f00acbf-a3a9-46c2-afa7-998c6a927352 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:44.879227 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f00acbf-a3a9-46c2-afa7-998c6a927352 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:44.975762 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ed4b040-b8f0-4586-aead-f7d4a71ec746 req-ae7672d1-8978-4dc3-9122-504b82b03422 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/security-groups?id=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2129853 May 12 15:30:44.986823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a85cb10-adcf-4743-bb20-355fc01e5162 req-2a50d9fc-9b0b-44a6-9388-67f5262457fa tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:44.994577 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a85cb10-adcf-4743-bb20-355fc01e5162 req-2a50d9fc-9b0b-44a6-9388-67f5262457fa tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 944 time: 0.4238846 May 12 15:30:45.045506 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-a8d0bbf3-e989-41e4-b944-45188630f0e0 service neutron] 10.222.0.76 "GET /v2.0/networks/19102399-18db-4840-b998-adc5bada1da0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1576631 May 12 15:30:45.160548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] device_id is not set on port 89d59d83-f688-4ff4-bdf6-f1da0b024094 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:30:45.178531 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a85cb10-adcf-4743-bb20-355fc01e5162 req-f96c2224-9270-419e-98e7-edcd6110800c tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1829834 May 12 15:30:45.183510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ad4ff205-773a-4af1-9138-7eecc287990f None None] Deleting port b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:45.184125 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ad4ff205-773a-4af1-9138-7eecc287990f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:45.272047 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d8ae9ce-9ef8-49ce-a544-dbba7f5f7357 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:45.279812 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d8ae9ce-9ef8-49ce-a544-dbba7f5f7357 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:45.311758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ad4ff205-773a-4af1-9138-7eecc287990f None None] The port 'b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:30:45.363247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2f00acbf-a3a9-46c2-afa7-998c6a927352 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Calling delete_port for 10bd793e-ab8d-4717-8218-8df43f04f23e owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:45.392372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6d8ae9ce-9ef8-49ce-a544-dbba7f5f7357 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4f36f84af1d64830a6505ff56759a435&name=default HTTP/1.1" status: 200 len: 2983 time: 2.1264794 May 12 15:30:45.407443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49428) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:45.419035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:45.434892 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:30:45.490648 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:30:45.491192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b5b7d20c-d60a-4d9b-aa4e-5af91d17ad0b not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:30:45.541056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e1655f9a-2478-49d5-a6ca-4fec717d6816']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:45.544876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d8ae9ce-9ef8-49ce-a544-dbba7f5f7357 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cab3e9b0-8ad6-479c-b818-9e2816d10ad2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:45.580486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c54a2125-ccc2-41a0-9a49-29870f0679c2') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:45.581289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c54a2125-ccc2-41a0-9a49-29870f0679c2') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:45.609573 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:45.619503 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:45.680867 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48e15b1f-dea1-45be-a716-b0f68a474d6f req-7f21d9e4-3653-4a77-9f0b-cd8c5e6e1de6 service neutron] 10.222.0.76 "GET /v2.0/networks/19102399-18db-4840-b998-adc5bada1da0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6207163 May 12 15:30:45.681817 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:45.700572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7991830-dde2-4760-b15c-6b0594747eba req-94b7d986-58c4-41b8-bddf-3b8a0db7121c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:45.701293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c7991830-dde2-4760-b15c-6b0594747eba req-94b7d986-58c4-41b8-bddf-3b8a0db7121c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Synchronizing usage tracker for tenant:353d3bc3be9843c584641e13595ca055 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:30:45.715387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Releasing vlan 583 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:30:45.715795 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:45.744984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5f06b772-8937-4bb2-a390-e3827bf69cc6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: timer() May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:30:45.780132 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:30:45.811059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] device_id is not set on port 42b238a3-c157-44b9-9994-1d840f3c16d9 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:30:45.852505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c7991830-dde2-4760-b15c-6b0594747eba req-94b7d986-58c4-41b8-bddf-3b8a0db7121c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Unset dirty status for tenant:353d3bc3be9843c584641e13595ca055 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:30:45.854161 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7991830-dde2-4760-b15c-6b0594747eba req-94b7d986-58c4-41b8-bddf-3b8a0db7121c tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.84 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 945 time: 0.4142599 May 12 15:30:45.908183 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5f06b772-8937-4bb2-a390-e3827bf69cc6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:45.967669 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5f06b772-8937-4bb2-a390-e3827bf69cc6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:45.993208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f06b772-8937-4bb2-a390-e3827bf69cc6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cab3e9b0-8ad6-479c-b818-9e2816d10ad2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:45.997998 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5f06b772-8937-4bb2-a390-e3827bf69cc6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:46.001883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5f06b772-8937-4bb2-a390-e3827bf69cc6 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cab3e9b0-8ad6-479c-b818-9e2816d10ad2 HTTP/1.1" status: 204 len: 168 time: 0.5715406 May 12 15:30:46.026982 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:46.076510 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:46.131121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:46.180010 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:46.188447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Pushing event deleted for resources: {'Network': ['ID=e1655f9a-2478-49d5-a6ca-4fec717d6816,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:46.259978 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f00acbf-a3a9-46c2-afa7-998c6a927352 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:46.321037 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:46.368337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d25e552-50ca-4fd9-9eec-b0405dd006ee req-4420e9a5-e95b-46c3-b988-0001bf3e0dd1 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:46.375455 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d25e552-50ca-4fd9-9eec-b0405dd006ee req-4420e9a5-e95b-46c3-b988-0001bf3e0dd1 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 945 time: 0.2023785 May 12 15:30:46.385815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-c7991830-dde2-4760-b15c-6b0594747eba req-640bf8bb-f4df-470e-b8fa-c4d7833360f1 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Deleting port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:46.386157 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c7991830-dde2-4760-b15c-6b0594747eba req-640bf8bb-f4df-470e-b8fa-c4d7833360f1 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:46.446616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:46.446616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:46.446616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:46.447014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:46.447101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:46.447407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:46.447721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:46.448033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:46.448346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:46.448655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:46.449320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:46.449805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:46.501944 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d25e552-50ca-4fd9-9eec-b0405dd006ee req-b11242ac-73f9-4f25-9353-9c5783da08a4 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/security-groups?id=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1252978 May 12 15:30:46.506771 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:46.514433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f00acbf-a3a9-46c2-afa7-998c6a927352 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event deleted for resources: {'Port': ['ID=10bd793e-ab8d-4717-8218-8df43f04f23e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:46.631822 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c3018620-c233-41ef-a1d9-1361fd725a58 admin admin] 10.222.0.82 "DELETE /v2.0/networks/e1655f9a-2478-49d5-a6ca-4fec717d6816 HTTP/1.1" status: 204 len: 168 time: 3.8433437 May 12 15:30:46.670957 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e38808d-57df-44fe-841d-2ceae558f6cd req-ba7f2620-1a09-4533-9217-77617ca9e26d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:46.672933 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2e38808d-57df-44fe-841d-2ceae558f6cd req-ba7f2620-1a09-4533-9217-77617ca9e26d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=e1146a673b454173a1ed844897ff4119&device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 1095 time: 0.8782094 May 12 15:30:46.673353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event updated for resources: {'Port': ['ID=89d59d83-f688-4ff4-bdf6-f1da0b024094,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:46.708080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe940491-4510-4dee-adaf-4df2594eefa8 req-b24f6f80-a7e0-4b04-b72f-1529c8d5bc1b tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:46.709772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fe940491-4510-4dee-adaf-4df2594eefa8 req-b24f6f80-a7e0-4b04-b72f-1529c8d5bc1b tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 944 time: 0.3147802 May 12 15:30:46.749566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49490) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:46.763266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49494) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:46.773618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Checking segment: {'id': '0d3c92b7-a0ee-4306-b844-a119919f7c6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 560, 'network_id': '9d4ee6ea-2b07-4221-abad-7a9aad88d871'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:30:46.774213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Network hostable DHCP agents. Network: 9d4ee6ea-2b07-4221-abad-7a9aad88d871, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:30:46.799272 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-58724c76-1cc8-43a3-b0f7-6f40e7102967 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:46.804258 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f00acbf-a3a9-46c2-afa7-998c6a927352 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:46.806817 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f00acbf-a3a9-46c2-afa7-998c6a927352 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:46.807931 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2f00acbf-a3a9-46c2-afa7-998c6a927352 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "DELETE /v2.0/floatingips/f8768448-30de-4f5a-8cc7-13fa25003fa4 HTTP/1.1" status: 204 len: 168 time: 2.5986984 May 12 15:30:46.856922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fe940491-4510-4dee-adaf-4df2594eefa8 req-fbd5297e-f13c-4944-b532-e15e20594156 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1371534 May 12 15:30:46.867966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Network 9d4ee6ea-2b07-4221-abad-7a9aad88d871 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:30:46.879182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-58724c76-1cc8-43a3-b0f7-6f40e7102967 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:46.897560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-58724c76-1cc8-43a3-b0f7-6f40e7102967 admin admin] Usage tracker for resource:security_group_rule and tenant:f8432cb5d1214c69a446dca8e10d8c51 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:46.901339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-58724c76-1cc8-43a3-b0f7-6f40e7102967 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:46.907976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 9d4ee6ea-2b07-4221-abad-7a9aad88d871) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:30:46.918946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-58724c76-1cc8-43a3-b0f7-6f40e7102967 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:46.928624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3135210e-d031-4656-add3-f00604084d5c None None] Network 9d4ee6ea-2b07-4221-abad-7a9aad88d871 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:30:46.930818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:30:46.950816 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:47.055669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49504) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:47.179063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c7991830-dde2-4760-b15c-6b0594747eba req-640bf8bb-f4df-470e-b8fa-c4d7833360f1 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] For port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff,segment=NetworkSegment(b9b3325b-c79b-4a26-83a0-152dee070f23),segment_id=b9b3325b-c79b-4a26-83a0-152dee070f23)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:47.179549 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c7991830-dde2-4760-b15c-6b0594747eba req-640bf8bb-f4df-470e-b8fa-c4d7833360f1 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:47.289577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event updated for resources: {'Port': ['ID=42b238a3-c157-44b9-9994-1d840f3c16d9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:47.359362 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-58724c76-1cc8-43a3-b0f7-6f40e7102967 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:47.392927 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-27421802-3a4d-4791-ae12-c458010d1326 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f4660a6351274a7796c2eb1e55a41ec9&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3295119 May 12 15:30:47.394404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49510) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:47.453101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Checking segment: {'id': 'bda6e9f8-6458-4a04-8548-95112ccaa03d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '481d6b8b-f48e-4d12-a19b-7508b057747e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:30:47.453738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Network hostable DHCP agents. Network: 481d6b8b-f48e-4d12-a19b-7508b057747e, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:30:47.460050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-c7991830-dde2-4760-b15c-6b0594747eba req-640bf8bb-f4df-470e-b8fa-c4d7833360f1 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Calling delete_port for 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:47.462831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-58724c76-1cc8-43a3-b0f7-6f40e7102967 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:47.517000 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-58724c76-1cc8-43a3-b0f7-6f40e7102967 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f8432cb5d1214c69a446dca8e10d8c51&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7624302 May 12 15:30:47.521007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49516) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:47.596190 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9484edc-9e8c-4f5d-af89-de77fc9357e7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:47.648019 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a2bc684-cf9d-4839-bdf8-a2b6b33c3b6f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:47.680290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58724c76-1cc8-43a3-b0f7-6f40e7102967 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a1f4a165-dc43-42ed-8a13-5ed78af8d5cc,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:47.691039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Network 481d6b8b-f48e-4d12-a19b-7508b057747e is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:30:47.709055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c9484edc-9e8c-4f5d-af89-de77fc9357e7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:47.710683 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:47.714161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c9484edc-9e8c-4f5d-af89-de77fc9357e7 admin admin] Usage tracker for resource:security_group_rule and tenant:dfd1b70dca9f4f02b13f264edeb32dcd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:47.722317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c9484edc-9e8c-4f5d-af89-de77fc9357e7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:47.728780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 481d6b8b-f48e-4d12-a19b-7508b057747e) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:30:47.737653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c9484edc-9e8c-4f5d-af89-de77fc9357e7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:47.739610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8372d96-ee2e-4f93-b8ca-b3b3d28d68a7 None None] Network 481d6b8b-f48e-4d12-a19b-7508b057747e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:30:47.748937 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a2bc684-cf9d-4839-bdf8-a2b6b33c3b6f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:47.767161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:30:47.776610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:47.786039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:47.787806 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:47.974854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e38808d-57df-44fe-841d-2ceae558f6cd req-6ca6a457-636e-47ee-8301-bb1da83026b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:47.976712 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2e38808d-57df-44fe-841d-2ceae558f6cd req-6ca6a457-636e-47ee-8301-bb1da83026b9 service neutron] 10.222.0.76 "GET /v2.0/networks?id=19102399-18db-4840-b998-adc5bada1da0 HTTP/1.1" status: 200 len: 914 time: 1.2100632 May 12 15:30:47.987523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c7991830-dde2-4760-b15c-6b0594747eba req-640bf8bb-f4df-470e-b8fa-c4d7833360f1 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:48.082414 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-742266fc-e657-4dfa-9a10-0152c5e9a27a tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1450 time: 4.3438370 May 12 15:30:48.086506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49532) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:48.153037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-640bf8bb-f4df-470e-b8fa-c4d7833360f1 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Pushing event deleted for resources: {'Port': ['ID=86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:48.157834 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2e38808d-57df-44fe-841d-2ceae558f6cd req-70150154-c508-4ca7-a0eb-62a10ddfa19a service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b HTTP/1.1" status: 200 len: 217 time: 0.1675563 May 12 15:30:48.199377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8147f3e5-bbbc-4f06-9746-88991710cb20 req-d794dfd8-5451-4e87-afe0-f4b8d1b76667 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:48.209051 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8147f3e5-bbbc-4f06-9746-88991710cb20 req-d794dfd8-5451-4e87-afe0-f4b8d1b76667 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 867 time: 0.3357806 May 12 15:30:48.260657 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a2bc684-cf9d-4839-bdf8-a2b6b33c3b6f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:48.286527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8147f3e5-bbbc-4f06-9746-88991710cb20 req-0501e010-9179-42f5-8f7d-435cc96f91db tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/security-groups?id=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0783679 May 12 15:30:48.306831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a2bc684-cf9d-4839-bdf8-a2b6b33c3b6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e234105-42d1-4432-9990-ff28bab05ed4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:48.308165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e38808d-57df-44fe-841d-2ceae558f6cd req-75d67f68-1b02-4847-bc84-8d4f9e09590f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:48.309411 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2e38808d-57df-44fe-841d-2ceae558f6cd req-75d67f68-1b02-4847-bc84-8d4f9e09590f service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5191993e-726b-4897-9b02-25fe32b3009b HTTP/1.1" status: 200 len: 853 time: 0.1337843 May 12 15:30:48.360889 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-492150b3-16fc-4708-8a9d-36629bab4db1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:48.391703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a2bc684-cf9d-4839-bdf8-a2b6b33c3b6f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:48.393780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9a2bc684-cf9d-4839-bdf8-a2b6b33c3b6f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1e234105-42d1-4432-9990-ff28bab05ed4 HTTP/1.1" status: 204 len: 168 time: 0.9947879 May 12 15:30:48.403077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c7991830-dde2-4760-b15c-6b0594747eba req-640bf8bb-f4df-470e-b8fa-c4d7833360f1 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] No DVR routers for this DVR port 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:30:48.430403 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c7991830-dde2-4760-b15c-6b0594747eba req-640bf8bb-f4df-470e-b8fa-c4d7833360f1 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:48.434823 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2e38808d-57df-44fe-841d-2ceae558f6cd req-50f31826-7bea-453f-9fe4-955a02f2673c service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=19102399-18db-4840-b998-adc5bada1da0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1154134 May 12 15:30:48.435344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5fc497ea-091b-44f8-960f-b26e9b13a563', 'name': 'network-vif-deleted', 'tag': '86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:30:48.447806 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9484edc-9e8c-4f5d-af89-de77fc9357e7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:48.459489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdcfc049-976c-4778-bf51-180ad43caff4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:48.471817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdcfc049-976c-4778-bf51-180ad43caff4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:48.472621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fdcfc049-976c-4778-bf51-180ad43caff4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Synchronizing usage tracker for tenant:2faf83d4488c45e09589f2ce8eead989 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:30:48.505571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fdcfc049-976c-4778-bf51-180ad43caff4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Unset dirty status for tenant:2faf83d4488c45e09589f2ce8eead989 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:30:48.510943 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9484edc-9e8c-4f5d-af89-de77fc9357e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:48.511196 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fdcfc049-976c-4778-bf51-180ad43caff4 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1445 time: 0.4216576 May 12 15:30:48.512443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49540) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:48.562127 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-db91d4c0-47ef-4343-b529-53af5ae2cfa0'] response: {'server_uuid': '5fc497ea-091b-44f8-960f-b26e9b13a563', 'name': 'network-vif-deleted', 'tag': '86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff', 'status': 'completed', 'code': 200} May 12 15:30:48.587928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b485f6cb-9312-4c3f-9c88-b456f4b5f08e req-b9f8bbc1-0641-49df-9427-ccffd9329a20 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:48.589931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b485f6cb-9312-4c3f-9c88-b456f4b5f08e req-b9f8bbc1-0641-49df-9427-ccffd9329a20 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 944 time: 0.3192582 May 12 15:30:48.615540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9484edc-9e8c-4f5d-af89-de77fc9357e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=442ea9e2-258c-4d63-b36a-6df098c863d8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:48.619409 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-492150b3-16fc-4708-8a9d-36629bab4db1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:48.668144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-207a9738-f1a5-480e-855f-ee24d9d7a826 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Deleting port 89d59d83-f688-4ff4-bdf6-f1da0b024094 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:48.668755 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-207a9738-f1a5-480e-855f-ee24d9d7a826 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:48.740623 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b485f6cb-9312-4c3f-9c88-b456f4b5f08e req-07c7f2b1-71c6-4e82-95c0-c7bf69b9724b tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1432421 May 12 15:30:48.770533 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c7991830-dde2-4760-b15c-6b0594747eba req-640bf8bb-f4df-470e-b8fa-c4d7833360f1 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.84 "DELETE /v2.0/ports/86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff HTTP/1.1" status: 204 len: 173 time: 2.8529294 May 12 15:30:48.797265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-492150b3-16fc-4708-8a9d-36629bab4db1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:48.864424 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c9484edc-9e8c-4f5d-af89-de77fc9357e7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=dfd1b70dca9f4f02b13f264edeb32dcd&name=default HTTP/1.1" status: 200 len: 2983 time: 2.0964854 May 12 15:30:48.870403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49552) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:48.873291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:30:48.892604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-492150b3-16fc-4708-8a9d-36629bab4db1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1f4a165-dc43-42ed-8a13-5ed78af8d5cc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:48.897940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-492150b3-16fc-4708-8a9d-36629bab4db1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:48.902300 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-492150b3-16fc-4708-8a9d-36629bab4db1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a1f4a165-dc43-42ed-8a13-5ed78af8d5cc HTTP/1.1" status: 204 len: 168 time: 1.3755095 May 12 15:30:48.985768 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2e38808d-57df-44fe-841d-2ceae558f6cd req-35b0c435-08bf-4f48-9a31-c6acb1794317 service neutron] 10.222.0.76 "GET /v2.0/networks/19102399-18db-4840-b998-adc5bada1da0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5335200 May 12 15:30:49.154752 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e19da0-b5bf-4455-9a71-cf7f8bf51fca admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:49.223321 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2e38808d-57df-44fe-841d-2ceae558f6cd req-b274a8e6-f7df-4566-8dab-2160013aeb0d service neutron] 10.222.0.76 "GET /v2.0/networks/19102399-18db-4840-b998-adc5bada1da0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2310414 May 12 15:30:49.282483 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-207a9738-f1a5-480e-855f-ee24d9d7a826 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:49.298591 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e19da0-b5bf-4455-9a71-cf7f8bf51fca admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:49.327439 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b,segment=NetworkSegment(3307f62e-6977-4a8d-852e-31dcfd97c476),segment_id=3307f62e-6977-4a8d-852e-31dcfd97c476)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:49.368221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b', 'network_id': '19102399-18db-4840-b998-adc5bada1da0', 'port_id': 'cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b', 'mac_address': 'fa:16:3e:99:bc:88', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 589, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5191993e-726b-4897-9b02-25fe32b3009b', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:30:49.493259 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:49.519136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:30:49.528511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-207a9738-f1a5-480e-855f-ee24d9d7a826 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Calling delete_port for 89d59d83-f688-4ff4-bdf6-f1da0b024094 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:49.541603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b,segment=NetworkSegment(3307f62e-6977-4a8d-852e-31dcfd97c476),segment_id=3307f62e-6977-4a8d-852e-31dcfd97c476)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:49.546891 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:49.637707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e275da08-8519-4745-8629-408b5570b3cb req-b6c970da-7b2a-48ae-b02d-7f79f7811f30 tempest-ServerGroupTestJSON-740280972 tempest-ServerGroupTestJSON-740280972-project] 10.222.0.82 "GET /v2.0/ports?device_id=5fc497ea-091b-44f8-960f-b26e9b13a563 HTTP/1.1" status: 200 len: 210 time: 0.0778286 May 12 15:30:49.669978 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:49.711714 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e19da0-b5bf-4455-9a71-cf7f8bf51fca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:49.742690 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-207a9738-f1a5-480e-855f-ee24d9d7a826 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:49.755673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:30:49.817476 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37e19da0-b5bf-4455-9a71-cf7f8bf51fca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=442ea9e2-258c-4d63-b36a-6df098c863d8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:49.835266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-207a9738-f1a5-480e-855f-ee24d9d7a826 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event deleted for resources: {'Port': ['ID=89d59d83-f688-4ff4-bdf6-f1da0b024094,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:49.851227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:30:49.859767 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-207a9738-f1a5-480e-855f-ee24d9d7a826 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:49.880011 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37e19da0-b5bf-4455-9a71-cf7f8bf51fca admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:49.883036 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-37e19da0-b5bf-4455-9a71-cf7f8bf51fca admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/442ea9e2-258c-4d63-b36a-6df098c863d8 HTTP/1.1" status: 204 len: 168 time: 1.0113924 May 12 15:30:49.889026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49586) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:49.889566 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-207a9738-f1a5-480e-855f-ee24d9d7a826 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "DELETE /v2.0/ports/89d59d83-f688-4ff4-bdf6-f1da0b024094 HTTP/1.1" status: 204 len: 168 time: 1.3750513 May 12 15:30:49.965082 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:30:49.966624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 86d2c5e1-37fb-4a93-a7b3-6ed9959c11ff not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:30:50.068161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c6513e92-ad13-46ba-b84d-9fe52b122486 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Deleting port 42b238a3-c157-44b9-9994-1d840f3c16d9 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:50.077175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6513e92-ad13-46ba-b84d-9fe52b122486 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:50.184181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788f2d0d-753e-4d5d-9d4c-707326a30a06 req-896af20c-85d1-498d-acac-894620f3e397 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:50.186025 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-788f2d0d-753e-4d5d-9d4c-707326a30a06 req-896af20c-85d1-498d-acac-894620f3e397 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 945 time: 0.1824944 May 12 15:30:50.310623 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-788f2d0d-753e-4d5d-9d4c-707326a30a06 req-ded4366e-497d-4b69-936d-ab590d6fca7e tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1179428 May 12 15:30:50.514741 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6513e92-ad13-46ba-b84d-9fe52b122486 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:50.580076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49612) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:50.603782 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc39c246-9bf3-47c8-905e-7e262d58a989 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:50.647888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fc39c246-9bf3-47c8-905e-7e262d58a989 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:50.654438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fc39c246-9bf3-47c8-905e-7e262d58a989 admin admin] Usage tracker for resource:security_group_rule and tenant:1362f716c7a54547a0c1725d29e6f88c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:50.657677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fc39c246-9bf3-47c8-905e-7e262d58a989 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:50.679319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fc39c246-9bf3-47c8-905e-7e262d58a989 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:50.830219 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc39c246-9bf3-47c8-905e-7e262d58a989 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:50.836918 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc39c246-9bf3-47c8-905e-7e262d58a989 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:50.866634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:30:50.894085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c6513e92-ad13-46ba-b84d-9fe52b122486 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Calling delete_port for 42b238a3-c157-44b9-9994-1d840f3c16d9 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:50.950745 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fc39c246-9bf3-47c8-905e-7e262d58a989 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1362f716c7a54547a0c1725d29e6f88c&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3658433 May 12 15:30:50.960605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49630) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:51.010673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:30:51.029349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:30:51.029743 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:51.174007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc39c246-9bf3-47c8-905e-7e262d58a989 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c141515-f2a9-4cdd-be6b-50592529118e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:51.216406 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6b5fe17-2f1e-4a38-acc3-f478f195bfde admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:51.275380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08fa15d7-0881-4e12-bbed-60e1d6bc7c14 req-8c73ae1e-9d91-4232-903c-74a9cc22c96c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:51.282849 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08fa15d7-0881-4e12-bbed-60e1d6bc7c14 req-8c73ae1e-9d91-4232-903c-74a9cc22c96c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 945 time: 0.3327758 May 12 15:30:51.365694 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6b5fe17-2f1e-4a38-acc3-f478f195bfde admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:51.373817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-08fa15d7-0881-4e12-bbed-60e1d6bc7c14 req-f8442244-b872-4c21-9426-c756b4f81214 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:30:51.392862 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:51.409459 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6513e92-ad13-46ba-b84d-9fe52b122486 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:51.412440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-08fa15d7-0881-4e12-bbed-60e1d6bc7c14 req-f8442244-b872-4c21-9426-c756b4f81214 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:30:51.421833 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08fa15d7-0881-4e12-bbed-60e1d6bc7c14 req-f8442244-b872-4c21-9426-c756b4f81214 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=a38d2c29-bf89-4d38-a714-9037ce4b4638&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1358023 May 12 15:30:51.456326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '134b4b36-e12c-4748-ab4f-3da58290fc83', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:30:51.478711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b,segment=NetworkSegment(3307f62e-6977-4a8d-852e-31dcfd97c476),segment_id=3307f62e-6977-4a8d-852e-31dcfd97c476)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:51.481550 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:51.548162 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ad0048cd-8c7f-4378-8c86-f9d21cfc667f'] response: {'server_uuid': '134b4b36-e12c-4748-ab4f-3da58290fc83', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b', 'code': 200} May 12 15:30:51.562317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6513e92-ad13-46ba-b84d-9fe52b122486 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event deleted for resources: {'Port': ['ID=42b238a3-c157-44b9-9994-1d840f3c16d9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:51.574133 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6513e92-ad13-46ba-b84d-9fe52b122486 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:51.590694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49662) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:51.590863 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c6513e92-ad13-46ba-b84d-9fe52b122486 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "DELETE /v2.0/ports/42b238a3-c157-44b9-9994-1d840f3c16d9 HTTP/1.1" status: 204 len: 168 time: 1.6981363 May 12 15:30:51.680605 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6b5fe17-2f1e-4a38-acc3-f478f195bfde admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:51.694386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-51aa4d62-7492-4f10-a88f-f4bd4214763b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Synchronizing usage tracker for tenant:2faf83d4488c45e09589f2ce8eead989 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:30:51.709516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:51.722132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-51aa4d62-7492-4f10-a88f-f4bd4214763b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Unset dirty status for tenant:2faf83d4488c45e09589f2ce8eead989 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:30:51.723915 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-51aa4d62-7492-4f10-a88f-f4bd4214763b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.1332052 May 12 15:30:51.727409 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49676) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:51.739444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-877589829'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:51.750061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:51.763309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Usage tracker for resource:network and tenant:2faf83d4488c45e09589f2ce8eead989 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:51.768894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:51.777194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:51.781806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6b5fe17-2f1e-4a38-acc3-f478f195bfde admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c141515-f2a9-4cdd-be6b-50592529118e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:51.797266 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6b5fe17-2f1e-4a38-acc3-f478f195bfde admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:51.800047 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b6b5fe17-2f1e-4a38-acc3-f478f195bfde admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5c141515-f2a9-4cdd-be6b-50592529118e HTTP/1.1" status: 204 len: 168 time: 0.8368070 May 12 15:30:51.829690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49684) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:51.855295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Made reservation on behalf of 2faf83d4488c45e09589f2ce8eead989 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:30:51.858874 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:51.885016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e21d44ad-f92a-4d92-90ad-f2c88da7f4e2 req-e0530e25-fab1-42ca-8989-c23177bceb68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:51.886710 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e21d44ad-f92a-4d92-90ad-f2c88da7f4e2 req-e0530e25-fab1-42ca-8989-c23177bceb68 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 1097 time: 0.2738204 May 12 15:30:51.912008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 587} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:30:51.927890 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:51.928271 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Added segment ccf737d2-05b4-4a90-912b-d653ed8d3225 of type vlan for network 9df654cf-f85f-429b-a5ac-83fe261995b2 May 12 15:30:51.977555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85fa7000-2b23-4ab1-94eb-395f5b9a55e1 req-11b549e0-3cf2-479f-9ce9-c2231fa68da7 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:51.978132 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85fa7000-2b23-4ab1-94eb-395f5b9a55e1 req-11b549e0-3cf2-479f-9ce9-c2231fa68da7 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 946 time: 0.1888456 May 12 15:30:51.980639 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.008764 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e21d44ad-f92a-4d92-90ad-f2c88da7f4e2 req-f40ce4c8-1b97-48b5-95f0-18daa25aac54 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1134424 May 12 15:30:52.020227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-f1efa2a2-77ed-493b-91f2-a1ea25e29480 admin admin] Deleting subnet 5cd005ab-44f1-4a8f-9e54-c87c6ffbd1f4 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:30:52.026417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1efa2a2-77ed-493b-91f2-a1ea25e29480 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.044855 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85fa7000-2b23-4ab1-94eb-395f5b9a55e1 req-c6f9b2a6-2bcc-464f-8030-920ce82caaa2 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0587387 May 12 15:30:52.057536 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.066276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:52.066629 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.135315 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1efa2a2-77ed-493b-91f2-a1ea25e29480 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.201193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event updated for resources: {'Network': ['ID=9df654cf-f85f-429b-a5ac-83fe261995b2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:52.207434 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-20cef684-639f-4999-9165-823bcd1cc15f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 0.4785423 May 12 15:30:52.208882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49696) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:52.222736 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 9df654cf-f85f-429b-a5ac-83fe261995b2 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:30:52.240391 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-338633851'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:52.259845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:52.265716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1efa2a2-77ed-493b-91f2-a1ea25e29480 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.273214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Usage tracker for resource:network and tenant:2faf83d4488c45e09589f2ce8eead989 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:52.280831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Quota usage for network was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:52.306194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:52.390671 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1efa2a2-77ed-493b-91f2-a1ea25e29480 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.432364 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1efa2a2-77ed-493b-91f2-a1ea25e29480 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.441879 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f1efa2a2-77ed-493b-91f2-a1ea25e29480 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/5cd005ab-44f1-4a8f-9e54-c87c6ffbd1f4 HTTP/1.1" status: 204 len: 168 time: 0.6062503 May 12 15:30:52.443656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49704) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:52.446955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1efa2a2-77ed-493b-91f2-a1ea25e29480 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5cd005ab-44f1-4a8f-9e54-c87c6ffbd1f4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:52.592521 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4b08cc4-88c7-4b25-96fd-25cf1179f763 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.592809 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Made reservation on behalf of 2faf83d4488c45e09589f2ce8eead989 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:30:52.597923 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.668174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 553} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:30:52.764567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7a1d0ca-7a90-42c6-9ea7-503ce0bbe319 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:52.765483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7a1d0ca-7a90-42c6-9ea7-503ce0bbe319 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:30:52.781711 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.782342 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Added segment 323bdf68-655b-4936-b7f9-28a27e0e6103 of type vlan for network cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e May 12 15:30:52.840133 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.889617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03d742e-05a7-4b2d-b07c-b85e5d5cd4f5 req-b84d0ce4-3430-45d4-ad88-608170e1f6df tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:52.890417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4b08cc4-88c7-4b25-96fd-25cf1179f763 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.903928 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d03d742e-05a7-4b2d-b07c-b85e5d5cd4f5 req-b84d0ce4-3430-45d4-ad88-608170e1f6df tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 945 time: 0.2167628 May 12 15:30:52.961673 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.978557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f4b08cc4-88c7-4b25-96fd-25cf1179f763 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2c3462d2-bb87-4375-8260-fad70ee527dc']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:52.984130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:52.984796 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:52.995326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7a1d0ca-7a90-42c6-9ea7-503ce0bbe319 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:30:52.996507 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7a1d0ca-7a90-42c6-9ea7-503ce0bbe319 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.84 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 945 time: 0.4077299 May 12 15:30:53.012861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f4b08cc4-88c7-4b25-96fd-25cf1179f763 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b9b3325b-c79b-4a26-83a0-152dee070f23') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:53.013557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f4b08cc4-88c7-4b25-96fd-25cf1179f763 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b9b3325b-c79b-4a26-83a0-152dee070f23') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:53.052302 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 0.8423283 May 12 15:30:53.161778 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4b08cc4-88c7-4b25-96fd-25cf1179f763 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:53.201828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49734) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:53.227851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Request body: {'subnets': [{'network_id': '9df654cf-f85f-429b-a5ac-83fe261995b2', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--1279538561', 'ip_version': 4}, {'network_id': 'cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e', 'cidr': '172.20.0.16/28', 'ip_version': 4}]} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:53.233802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Request body: {'subnet': {'network_id': '9df654cf-f85f-429b-a5ac-83fe261995b2', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--1279538561', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:53.234032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d03d742e-05a7-4b2d-b07c-b85e5d5cd4f5 req-1830e1e4-a00c-4831-8130-1e2c27344541 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=a38d2c29-bf89-4d38-a714-9037ce4b4638&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3197119 May 12 15:30:53.234824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Request body: {'subnet': {'network_id': 'cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e', 'cidr': '172.20.0.16/28', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:53.274139 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4b08cc4-88c7-4b25-96fd-25cf1179f763 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:53.312013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event updated for resources: {'Network': ['ID=cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:53.339188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Deleting port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:30:53.339705 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:53.368617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:53.369240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:53.369741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:53.370288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:53.371135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:53.371898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:53.372031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f4b08cc4-88c7-4b25-96fd-25cf1179f763 admin admin] Releasing vlan 599 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:30:53.372501 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4b08cc4-88c7-4b25-96fd-25cf1179f763 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:53.372795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:53.373032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:53.373446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:53.373815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:53.374173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:53.374501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d902a892-767c-4349-9358-673b16efb7e6 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:30:53.385614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: timer() May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:30:53.400819 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:30:53.484691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03069bfe-7bb1-4589-bca2-ecaa27bcc711 req-1da00adf-6790-4c37-8190-04022fb53c76 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:53.499245 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03069bfe-7bb1-4589-bca2-ecaa27bcc711 req-1da00adf-6790-4c37-8190-04022fb53c76 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 946 time: 0.1838641 May 12 15:30:53.616339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03069bfe-7bb1-4589-bca2-ecaa27bcc711 req-6f0ffe5c-c5c2-44ff-a53d-1b1a3a80c84a tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1161227 May 12 15:30:53.698582 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4b08cc4-88c7-4b25-96fd-25cf1179f763 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:53.900494 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4b08cc4-88c7-4b25-96fd-25cf1179f763 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:53.929940 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f4b08cc4-88c7-4b25-96fd-25cf1179f763 admin admin] 10.222.0.82 "DELETE /v2.0/networks/2c3462d2-bb87-4375-8260-fad70ee527dc HTTP/1.1" status: 204 len: 168 time: 1.4852176 May 12 15:30:53.942032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b08cc4-88c7-4b25-96fd-25cf1179f763 admin admin] Pushing event deleted for resources: {'Network': ['ID=2c3462d2-bb87-4375-8260-fad70ee527dc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:53.974350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:53.979332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Usage tracker for resource:subnet and tenant:2faf83d4488c45e09589f2ce8eead989 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:53.982217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:53.992797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attempting to reserve 2 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:54.097639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Made reservation on behalf of 2faf83d4488c45e09589f2ce8eead989 for: {'subnet': 2} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:30:54.102183 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:54.107876 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:54.377931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] For port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:30:54.377931 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:54.553427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49768) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:54.769840 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:54.770143 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:54.770454 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Floating IP ad94042f-a6a1-4708-ab51-e49f96948e07 disassociated. External IP: 172.25.8.38, port: c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb. May 12 15:30:54.770732 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e564b09a-0a54-4d44-80da-402da866c1fd admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=353d3bc3be9843c584641e13595ca055&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1905782 May 12 15:30:54.770907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Calling delete_port for c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:30:54.802642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49782) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:54.855528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b5a00c9-6f6a-4ea5-be4d-2f65f1252955 req-fe2e9202-b3d2-45f1-a314-c014acca6e8e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:54.864515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b5a00c9-6f6a-4ea5-be4d-2f65f1252955 req-fe2e9202-b3d2-45f1-a314-c014acca6e8e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 945 time: 0.4302156 May 12 15:30:54.956848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b5a00c9-6f6a-4ea5-be4d-2f65f1252955 req-bd12558a-453f-4ab5-96b3-712e8714e25e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=a38d2c29-bf89-4d38-a714-9037ce4b4638&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0764771 May 12 15:30:55.001419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa480f0-a4c0-4ffd-8491-f1b580cffd94 req-3c7224c2-d4ed-4200-8399-2a878a8b0f0c tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:55.026886 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-faa480f0-a4c0-4ffd-8491-f1b580cffd94 req-3c7224c2-d4ed-4200-8399-2a878a8b0f0c tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 946 time: 0.2630839 May 12 15:30:55.104866 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-14400edc-0ae4-4728-86e0-fe59fa98d960 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:55.150514 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-faa480f0-a4c0-4ffd-8491-f1b580cffd94 req-3814cd8b-abcf-4947-9f4c-1ca347fc5667 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1221619 May 12 15:30:55.315169 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-14400edc-0ae4-4728-86e0-fe59fa98d960 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:55.391708 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:55.491085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event deleted for resources: {'Port': ['ID=c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:55.653535 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-14400edc-0ae4-4728-86e0-fe59fa98d960 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:55.676268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14400edc-0ae4-4728-86e0-fe59fa98d960 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8daedc66-d9d8-48ea-a85e-4c2cf4a91f34,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:56.076900 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:56.354323 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-14400edc-0ae4-4728-86e0-fe59fa98d960 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:56.359242 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-14400edc-0ae4-4728-86e0-fe59fa98d960 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8daedc66-d9d8-48ea-a85e-4c2cf4a91f34 HTTP/1.1" status: 204 len: 168 time: 1.5502939 May 12 15:30:56.391182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9001e08-884f-4968-8596-550452c5fe89 req-46ea7eb0-c2cf-4d5b-ab4f-835b055faa73 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 210 time: 0.1441987 May 12 15:30:56.402199 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:30:56.422245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event updated for resources: {'Subnet': ['ID=8cce5248-fc74-41da-a66a-0f6ef2c1b0f2,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:56.432985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Checking segment: {'id': 'ccf737d2-05b4-4a90-912b-d653ed8d3225', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '9df654cf-f85f-429b-a5ac-83fe261995b2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:30:56.433292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Network hostable DHCP agents. Network: 9df654cf-f85f-429b-a5ac-83fe261995b2, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:30:56.966556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Network 9df654cf-f85f-429b-a5ac-83fe261995b2 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:30:57.000445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 9df654cf-f85f-429b-a5ac-83fe261995b2) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:30:57.014538 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cb62012-d025-437a-ba14-eec99d921319 None None] Network 9df654cf-f85f-429b-a5ac-83fe261995b2 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:30:57.025420 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:57.130906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event updated for resources: {'Subnet': ['ID=576160b6-dcea-4a10-8440-4cfa27586eb8,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:57.272695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49902) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:57.474706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:30:57.523318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3211099-18c3-4f1f-a543-25bcba72399c None None] Sync routers for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:30:57.578229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3211099-18c3-4f1f-a543-25bcba72399c None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:30:57.584384 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f3211099-18c3-4f1f-a543-25bcba72399c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:30:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:30:57.633761 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3335c121-a9ca-48a0-ba9d-c600a30b49d2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:57.679956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3335c121-a9ca-48a0-ba9d-c600a30b49d2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:57.692066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20059be9-4a90-4fd2-a849-35ac607a63ca None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-9df654cf-f85f-429b-a5ac-83fe261995b2', 'network_id': '9df654cf-f85f-429b-a5ac-83fe261995b2', 'tenant_id': '2faf83d4488c45e09589f2ce8eead989', 'fixed_ips': [{'subnet_id': '8cce5248-fc74-41da-a66a-0f6ef2c1b0f2'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:30:57.692381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3335c121-a9ca-48a0-ba9d-c600a30b49d2 admin admin] Usage tracker for resource:security_group_rule and tenant:d3a10e9121f04ad6a2d91c1a7b96c463 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:57.695843 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-20059be9-4a90-4fd2-a849-35ac607a63ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:57.743294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] No DVR routers for this DVR port c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:30:57.747017 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:57.751088 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-81f1dc00-61e4-43a1-8689-3671618e8431 req-c7776861-ff33-4412-8538-8e82d4be30d2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.84 "DELETE /v2.0/ports/c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb HTTP/1.1" status: 204 len: 173 time: 4.7428739 May 12 15:30:57.755463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'name': 'network-vif-deleted', 'tag': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:30:57.762902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Checking segment: {'id': '323bdf68-655b-4936-b7f9-28a27e0e6103', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': 'cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:30:57.763295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Network hostable DHCP agents. Network: cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:30:57.775031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3335c121-a9ca-48a0-ba9d-c600a30b49d2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:57.811831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Network cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:30:57.825192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:30:57.831769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:30:57.838494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:57.838967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:57.840460 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:57.867075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-acf55c99-c0eb-4c67-87f6-0e85a73888ec req-b3995168-28a6-42b8-a104-7a6683a40dcb tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=136cbb2d-0756-43b5-bc7e-39006b8a56d3 HTTP/1.1" status: 200 len: 210 time: 0.1647928 May 12 15:30:57.874794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3335c121-a9ca-48a0-ba9d-c600a30b49d2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:57.882995 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7f95ee28-e703-460e-adf0-96748f30eeb3 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1426 time: 4.6749721 May 12 15:30:57.883484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49934) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:57.949342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e5c5961-9be2-4345-b1bf-153a84d1fc42 None None] Network cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:30:57.981775 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d92d6793-a932-47bf-8089-3d000517c5f3'] response: {'server_uuid': '136cbb2d-0756-43b5-bc7e-39006b8a56d3', 'name': 'network-vif-deleted', 'tag': 'c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb', 'status': 'completed', 'code': 200} May 12 15:30:58.052897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b71f09c-a99a-4bfc-8241-8184670b7021 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:58.062505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b71f09c-a99a-4bfc-8241-8184670b7021 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:58.064218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b71f09c-a99a-4bfc-8241-8184670b7021 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:30:58.066403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9b71f09c-a99a-4bfc-8241-8184670b7021 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Synchronizing usage tracker for tenant:2faf83d4488c45e09589f2ce8eead989 on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:30:58.113697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9b71f09c-a99a-4bfc-8241-8184670b7021 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Unset dirty status for tenant:2faf83d4488c45e09589f2ce8eead989 on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:30:58.118143 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9b71f09c-a99a-4bfc-8241-8184670b7021 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2052 time: 0.2306333 May 12 15:30:58.118758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49938) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:58.125913 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3335c121-a9ca-48a0-ba9d-c600a30b49d2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:58.131425 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3335c121-a9ca-48a0-ba9d-c600a30b49d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:58.261308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-f6c90b30-fbaa-4bdd-a041-fe5be2599b0c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Deleting subnet 8cce5248-fc74-41da-a66a-0f6ef2c1b0f2 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:30:58.267682 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f6c90b30-fbaa-4bdd-a041-fe5be2599b0c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:58.277263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3335c121-a9ca-48a0-ba9d-c600a30b49d2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d3a10e9121f04ad6a2d91c1a7b96c463&name=default HTTP/1.1" status: 200 len: 2983 time: 1.0000260 May 12 15:30:58.278976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49946) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:58.340638 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f6c90b30-fbaa-4bdd-a041-fe5be2599b0c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:58.342421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3335c121-a9ca-48a0-ba9d-c600a30b49d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=13c335f3-efa4-4bb4-93a2-691339768b12,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:58.388347 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c4fba6bd-10fa-4f29-bc8a-b609df0d022e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:58.426523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f6c90b30-fbaa-4bdd-a041-fe5be2599b0c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:58.465734 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c4fba6bd-10fa-4f29-bc8a-b609df0d022e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:58.472269 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:30:58.473130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c6f5820f-f0ec-47b0-b9aa-3b0a7399eddb not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:30:58.538160 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f6c90b30-fbaa-4bdd-a041-fe5be2599b0c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:58.564078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18f6ced6-1abc-499d-a4ea-c50645ddeab2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e', 'network_id': 'cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e', 'tenant_id': '2faf83d4488c45e09589f2ce8eead989', 'fixed_ips': [{'subnet_id': '576160b6-dcea-4a10-8440-4cfa27586eb8'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:30:58.565165 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-18f6ced6-1abc-499d-a4ea-c50645ddeab2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:58.600845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6c90b30-fbaa-4bdd-a041-fe5be2599b0c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event deleted for resources: {'Subnet': ['ID=8cce5248-fc74-41da-a66a-0f6ef2c1b0f2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:58.610899 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f6c90b30-fbaa-4bdd-a041-fe5be2599b0c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:58.635683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49956) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:58.675264 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f6c90b30-fbaa-4bdd-a041-fe5be2599b0c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "DELETE /v2.0/subnets/8cce5248-fc74-41da-a66a-0f6ef2c1b0f2 HTTP/1.1" status: 204 len: 168 time: 0.5548551 May 12 15:30:58.678830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49962) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:58.741916 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c4fba6bd-10fa-4f29-bc8a-b609df0d022e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:58.781340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4fba6bd-10fa-4f29-bc8a-b609df0d022e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=13c335f3-efa4-4bb4-93a2-691339768b12,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:58.802404 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c4fba6bd-10fa-4f29-bc8a-b609df0d022e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:58.805625 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c4fba6bd-10fa-4f29-bc8a-b609df0d022e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/13c335f3-efa4-4bb4-93a2-691339768b12 HTTP/1.1" status: 204 len: 168 time: 0.5167234 May 12 15:30:58.900638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-f3211099-18c3-4f1f-a543-25bcba72399c None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:30:58.936316 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-20475bb4-9abc-4ee3-8500-e30aeeb37feb admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:58.998711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-02d52b10-3d7b-4102-9cdf-6e299a34e017 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Deleting subnet 576160b6-dcea-4a10-8440-4cfa27586eb8 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:30:59.010431 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02d52b10-3d7b-4102-9cdf-6e299a34e017 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:59.131904 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02d52b10-3d7b-4102-9cdf-6e299a34e017 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:59.215206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49990) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:59.276930 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02d52b10-3d7b-4102-9cdf-6e299a34e017 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:59.326935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49994) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:59.383327 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-20475bb4-9abc-4ee3-8500-e30aeeb37feb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:59.389726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-20475bb4-9abc-4ee3-8500-e30aeeb37feb admin admin] Usage tracker for resource:security_group_rule and tenant:c327e636feef4b49a1e0418a845e75c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:59.391421 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-10585519-e5f7-4634-8a70-7f2537bf29e6 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:59.394812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-20475bb4-9abc-4ee3-8500-e30aeeb37feb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:59.406241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-20475bb4-9abc-4ee3-8500-e30aeeb37feb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:59.506049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-10585519-e5f7-4634-8a70-7f2537bf29e6 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:59.530329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-20475bb4-9abc-4ee3-8500-e30aeeb37feb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:59.532637 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02d52b10-3d7b-4102-9cdf-6e299a34e017 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server [None req-20059be9-4a90-4fd2-a849-35ac607a63ca None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 8cce5248-fc74-41da-a66a-0f6ef2c1b0f2: This subnet is being modified by another concurrent operation. May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 289, in create_dhcp_port May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 114, in _port_action May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 692, in inner May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kwargs) May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 217, in wrapped May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped May 12 15:30:59.544430 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1452, in create_port May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1419, in _create_port_db May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1441, in create_port_db May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 219, in allocate_ips_for_port_and_store May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ips = self.allocate_ips_for_port(context, port_copy) May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 217, in wrapped May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1014, in wrapper May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 226, in allocate_ips_for_port May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._allocate_ips_for_port(context, port) May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 258, in _allocate_ips_for_port May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 683, in _ipam_get_subnets May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server subnet.lock_register( May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise exception May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 8cce5248-fc74-41da-a66a-0f6ef2c1b0f2: This subnet is being modified by another concurrent operation. May 12 15:30:59.548584 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server May 12 15:30:59.588025 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-20475bb4-9abc-4ee3-8500-e30aeeb37feb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:59.600880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02d52b10-3d7b-4102-9cdf-6e299a34e017 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event deleted for resources: {'Subnet': ['ID=576160b6-dcea-4a10-8440-4cfa27586eb8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:59.687147 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02d52b10-3d7b-4102-9cdf-6e299a34e017 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:59.695366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Request body: {'network': {'name': 'tempest-ServerMetadataNegativeTestJSON-1972596229-network', 'tenant_id': 'eae7db4d964e4147a5dadb670fa36326'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:30:59.707863 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-10585519-e5f7-4634-8a70-7f2537bf29e6 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:59.744868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:59.754463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20475bb4-9abc-4ee3-8500-e30aeeb37feb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b2d8ed1-ec4b-4d7e-a3c3-31ed9b9c49fd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:59.773722 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-20475bb4-9abc-4ee3-8500-e30aeeb37feb admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c327e636feef4b49a1e0418a845e75c3&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1349416 May 12 15:30:59.776612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50022) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:59.792921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Usage tracker for resource:network and tenant:eae7db4d964e4147a5dadb670fa36326 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:59.807562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:59.817653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50026) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:59.818117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10585519-e5f7-4634-8a70-7f2537bf29e6 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a38d2c29-bf89-4d38-a714-9037ce4b4638,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:30:59.818611 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-02d52b10-3d7b-4102-9cdf-6e299a34e017 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "DELETE /v2.0/subnets/576160b6-dcea-4a10-8440-4cfa27586eb8 HTTP/1.1" status: 204 len: 168 time: 1.1385155 May 12 15:30:59.822759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50030) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:59.858218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:59.863196 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-10585519-e5f7-4634-8a70-7f2537bf29e6 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:59.869309 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-10585519-e5f7-4634-8a70-7f2537bf29e6 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "DELETE /v2.0/security-groups/a38d2c29-bf89-4d38-a714-9037ce4b4638 HTTP/1.1" status: 204 len: 168 time: 0.6485386 May 12 15:30:59.871909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50036) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:30:59.880527 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8c595601-49be-4432-ad7b-f2e76296a024 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:59.907956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Made reservation on behalf of eae7db4d964e4147a5dadb670fa36326 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:30:59.911232 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:30:59.949745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8c595601-49be-4432-ad7b-f2e76296a024 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:30:59.961137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8c595601-49be-4432-ad7b-f2e76296a024 admin admin] Usage tracker for resource:security_group_rule and tenant:b161ab61dafb4836ba7626c99497991b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:30:59.968053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8c595601-49be-4432-ad7b-f2e76296a024 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:30:59.976849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8c595601-49be-4432-ad7b-f2e76296a024 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:30:59.997223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a4f0459-8320-4d66-bb25-6703863058c8 None None] Network 9df654cf-f85f-429b-a5ac-83fe261995b2 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:00.091891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7818a71b-7d3a-4f1b-9478-cfe79bdc7105 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:00.098654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7818a71b-7d3a-4f1b-9478-cfe79bdc7105 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Synchronizing usage tracker for tenant:2faf83d4488c45e09589f2ce8eead989 on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:31:00.132581 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2550edc0-ca78-4046-b6f8-b9019ad2e8e0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:00.136411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7818a71b-7d3a-4f1b-9478-cfe79bdc7105 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Unset dirty status for tenant:2faf83d4488c45e09589f2ce8eead989 on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:31:00.137687 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7818a71b-7d3a-4f1b-9478-cfe79bdc7105 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.3080935 May 12 15:31:00.152068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50044) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:00.167623 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8c595601-49be-4432-ad7b-f2e76296a024 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:00.177078 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:00.214762 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-a632980c-8bb1-4dee-b264-023d4b1ffbc2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] show failed (client error): The resource could not be found. May 12 15:31:00.216967 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a632980c-8bb1-4dee-b264-023d4b1ffbc2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups/a38d2c29-bf89-4d38-a714-9037ce4b4638 HTTP/1.1" status: 404 len: 347 time: 0.3136582 May 12 15:31:00.223638 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8c595601-49be-4432-ad7b-f2e76296a024 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:00.246496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50052) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:00.279008 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2550edc0-ca78-4046-b6f8-b9019ad2e8e0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:00.281992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server [None req-18f6ced6-1abc-499d-a4ea-c50645ddeab2 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 576160b6-dcea-4a10-8440-4cfa27586eb8: This subnet is being modified by another concurrent operation. May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 289, in create_dhcp_port May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 114, in _port_action May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 692, in inner May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kwargs) May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 217, in wrapped May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped May 12 15:31:00.282591 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1452, in create_port May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1419, in _create_port_db May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1441, in create_port_db May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 219, in allocate_ips_for_port_and_store May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ips = self.allocate_ips_for_port(context, port_copy) May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 217, in wrapped May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1014, in wrapper May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 226, in allocate_ips_for_port May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._allocate_ips_for_port(context, port) May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 258, in _allocate_ips_for_port May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 683, in _ipam_get_subnets May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server subnet.lock_register( May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise exception May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 576160b6-dcea-4a10-8440-4cfa27586eb8: This subnet is being modified by another concurrent operation. May 12 15:31:00.286790 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server May 12 15:31:00.303398 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-337524c7-649a-4f9f-8aa7-7ec8cdc72ba4 None None] Network cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:00.360839 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b82e9ece-b18f-43ea-a0a9-df467808811c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:00.530378 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2550edc0-ca78-4046-b6f8-b9019ad2e8e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:00.555575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2550edc0-ca78-4046-b6f8-b9019ad2e8e0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b2d8ed1-ec4b-4d7e-a3c3-31ed9b9c49fd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:00.563850 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b82e9ece-b18f-43ea-a0a9-df467808811c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:00.579370 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2550edc0-ca78-4046-b6f8-b9019ad2e8e0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:00.581409 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2550edc0-ca78-4046-b6f8-b9019ad2e8e0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2b2d8ed1-ec4b-4d7e-a3c3-31ed9b9c49fd HTTP/1.1" status: 204 len: 168 time: 0.8010573 May 12 15:31:00.605422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b82e9ece-b18f-43ea-a0a9-df467808811c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:00.620132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Usage tracker for resource:security_group_rule and tenant:eae7db4d964e4147a5dadb670fa36326 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:00.628470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b82e9ece-b18f-43ea-a0a9-df467808811c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '323bdf68-655b-4936-b7f9-28a27e0e6103') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:00.628891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b82e9ece-b18f-43ea-a0a9-df467808811c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '323bdf68-655b-4936-b7f9-28a27e0e6103') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:00.655541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b82e9ece-b18f-43ea-a0a9-df467808811c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:00.667671 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c595601-49be-4432-ad7b-f2e76296a024 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8af1f6a4-f4a4-41a6-9b5e-0741d3a67335,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:00.671300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f3211099-18c3-4f1f-a543-25bcba72399c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:00.690854 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b82e9ece-b18f-43ea-a0a9-df467808811c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:00.701886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b82e9ece-b18f-43ea-a0a9-df467808811c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Releasing vlan 553 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:31:00.702425 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b82e9ece-b18f-43ea-a0a9-df467808811c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:00.714377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:00.735382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-0206e557-7c74-4be4-8aa9-f6890885d24b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Deleting port cfe0c0ef-42e0-45f7-beb9-49babc2e71c9 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:31:00.735495 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0206e557-7c74-4be4-8aa9-f6890885d24b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: timer() May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:31:00.741951 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:31:00.772764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3211099-18c3-4f1f-a543-25bcba72399c None None] Checking router: 616c45f4-38af-4ff7-8fb7-f1c61b204b6a for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:31:00.777727 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8c595601-49be-4432-ad7b-f2e76296a024 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b161ab61dafb4836ba7626c99497991b&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9474456 May 12 15:31:00.784506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3211099-18c3-4f1f-a543-25bcba72399c None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:31:00.785146 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f3211099-18c3-4f1f-a543-25bcba72399c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:30:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:00.802233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50076) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:00.805483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:00.847801 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c358305d-31ca-4df9-8c98-4315ee5d1414 None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:31:01.182631 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b82e9ece-b18f-43ea-a0a9-df467808811c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:01.211791 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b82e9ece-b18f-43ea-a0a9-df467808811c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:01.221802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b82e9ece-b18f-43ea-a0a9-df467808811c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event deleted for resources: {'Network': ['ID=cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:01.224906 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b82e9ece-b18f-43ea-a0a9-df467808811c tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "DELETE /v2.0/networks/cc5c76f5-c0a9-49a8-bf7e-5d5e97d2860e HTTP/1.1" status: 204 len: 168 time: 1.0717883 May 12 15:31:01.227367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50092) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:01.232314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-f3211099-18c3-4f1f-a543-25bcba72399c None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:31:01.264440 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0206e557-7c74-4be4-8aa9-f6890885d24b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:01.264785 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0206e557-7c74-4be4-8aa9-f6890885d24b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:01.316248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50096) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:01.353862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c358305d-31ca-4df9-8c98-4315ee5d1414 None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:31:01.423279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53203b1b-97de-4ec4-b116-60116bf65f5f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:01.591603 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53203b1b-97de-4ec4-b116-60116bf65f5f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:01.632289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-53203b1b-97de-4ec4-b116-60116bf65f5f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9df654cf-f85f-429b-a5ac-83fe261995b2']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:01.650697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-53203b1b-97de-4ec4-b116-60116bf65f5f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ccf737d2-05b4-4a90-912b-d653ed8d3225') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:01.651189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-53203b1b-97de-4ec4-b116-60116bf65f5f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ccf737d2-05b4-4a90-912b-d653ed8d3225') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:01.667326 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53203b1b-97de-4ec4-b116-60116bf65f5f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:01.691790 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53203b1b-97de-4ec4-b116-60116bf65f5f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:01.708102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-53203b1b-97de-4ec4-b116-60116bf65f5f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Releasing vlan 587 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:31:01.708665 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53203b1b-97de-4ec4-b116-60116bf65f5f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:01.730572 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e480076-a473-4938-9898-debe0da0b05c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:01.740510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-0206e557-7c74-4be4-8aa9-f6890885d24b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Calling delete_port for cfe0c0ef-42e0-45f7-beb9-49babc2e71c9 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: timer() May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:31:01.741846 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:31:01.770053 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05fabb3f-8e33-4486-b0fc-f4a7599820c6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:01.824909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-05fabb3f-8e33-4486-b0fc-f4a7599820c6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:01.862644 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53203b1b-97de-4ec4-b116-60116bf65f5f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:01.864927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-05fabb3f-8e33-4486-b0fc-f4a7599820c6 admin admin] Usage tracker for resource:security_group_rule and tenant:b5507491e8554676bf8d37fc3147bdd9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:01.882313 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e480076-a473-4938-9898-debe0da0b05c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:01.890450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-05fabb3f-8e33-4486-b0fc-f4a7599820c6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:01.899955 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53203b1b-97de-4ec4-b116-60116bf65f5f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:01.911826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53203b1b-97de-4ec4-b116-60116bf65f5f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event deleted for resources: {'Network': ['ID=9df654cf-f85f-429b-a5ac-83fe261995b2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:01.918326 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-53203b1b-97de-4ec4-b116-60116bf65f5f tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "DELETE /v2.0/networks/9df654cf-f85f-429b-a5ac-83fe261995b2 HTTP/1.1" status: 204 len: 168 time: 0.6898906 May 12 15:31:01.920994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50114) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:01.926710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-05fabb3f-8e33-4486-b0fc-f4a7599820c6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:01.991998 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.003629 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.128284 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ceffac64-e356-4579-a528-f0ef285b16d2 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.130707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 575} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:31:02.136490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a39e1f7-01b6-46a3-8c68-e528e84cc27b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:02.160853 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e480076-a473-4938-9898-debe0da0b05c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.181219 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.181407 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Added segment c13c5085-1b93-40b2-949d-70da42f91a88 of type vlan for network 344f73bf-bc85-42f0-91df-13b30d1e9dae May 12 15:31:02.218482 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e480076-a473-4938-9898-debe0da0b05c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8af1f6a4-f4a4-41a6-9b5e-0741d3a67335,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:02.248357 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0206e557-7c74-4be4-8aa9-f6890885d24b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.321956 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.343830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0206e557-7c74-4be4-8aa9-f6890885d24b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event deleted for resources: {'Port': ['ID=cfe0c0ef-42e0-45f7-beb9-49babc2e71c9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:02.399495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f3211099-18c3-4f1f-a543-25bcba72399c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:02.421215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3211099-18c3-4f1f-a543-25bcba72399c None None] The sync data for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 is: [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:31:02.501966 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05fabb3f-8e33-4486-b0fc-f4a7599820c6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.502758 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.523815 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ceffac64-e356-4579-a528-f0ef285b16d2 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.527019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcf4c379-a019-4a5c-ad63-065750647ce4 None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:31:02.559837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ceffac64-e356-4579-a528-f0ef285b16d2 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['481d6b8b-f48e-4d12-a19b-7508b057747e']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:02.588512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ceffac64-e356-4579-a528-f0ef285b16d2 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bda6e9f8-6458-4a04-8548-95112ccaa03d') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:02.588803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ceffac64-e356-4579-a528-f0ef285b16d2 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bda6e9f8-6458-4a04-8548-95112ccaa03d') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:02.616940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ceffac64-e356-4579-a528-f0ef285b16d2 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.627452 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] It took 0.20 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:31:02.647760 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ceffac64-e356-4579-a528-f0ef285b16d2 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.648310 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcf4c379-a019-4a5c-ad63-065750647ce4 None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:31:02.649187 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05fabb3f-8e33-4486-b0fc-f4a7599820c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.662583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ceffac64-e356-4579-a528-f0ef285b16d2 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Releasing vlan 552 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:31:02.662989 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ceffac64-e356-4579-a528-f0ef285b16d2 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.728876 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0206e557-7c74-4be4-8aa9-f6890885d24b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.822080 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-05fabb3f-8e33-4486-b0fc-f4a7599820c6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b5507491e8554676bf8d37fc3147bdd9&name=default HTTP/1.1" status: 200 len: 2983 time: 1.4975524 May 12 15:31:02.828220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05fabb3f-8e33-4486-b0fc-f4a7599820c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=316cbeba-8746-476e-b308-528c86f685f5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: timer() May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:31:02.833258 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:31:02.837947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50166) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:02.846706 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ceffac64-e356-4579-a528-f0ef285b16d2 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.856576 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ceffac64-e356-4579-a528-f0ef285b16d2 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.858269 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e480076-a473-4938-9898-debe0da0b05c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.862918 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5e480076-a473-4938-9898-debe0da0b05c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8af1f6a4-f4a4-41a6-9b5e-0741d3a67335 HTTP/1.1" status: 204 len: 168 time: 2.0591519 May 12 15:31:02.867058 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0206e557-7c74-4be4-8aa9-f6890885d24b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.868532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0206e557-7c74-4be4-8aa9-f6890885d24b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "DELETE /v2.0/floatingips/ad94042f-a6a1-4708-ab51-e49f96948e07 HTTP/1.1" status: 204 len: 168 time: 2.6012585 May 12 15:31:02.870014 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.886572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:02.887428 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:02.933584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 894 time: 3.5537093 May 12 15:31:02.938152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50176) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:02.944904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Request body: {'subnet': {'network_id': '344f73bf-bc85-42f0-91df-13b30d1e9dae', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerMetadataNegativeTestJSON-1972596229-subnet', 'tenant_id': 'eae7db4d964e4147a5dadb670fa36326', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:02.973202 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cbe803d-db8d-4275-9787-b1cd350c7340 None None] New status for floating IP ad94042f-a6a1-4708-ab51-e49f96948e07: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:31:03.010265 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:03.026667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Usage tracker for resource:subnet and tenant:eae7db4d964e4147a5dadb670fa36326 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:03.034668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:03.062289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50184) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:03.068924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:03.071305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18edad7a-4d37-4c7e-b4a8-2e6af1e6c8ac admin admin] Pushing event updated for resources: {'Network': ['ID=344f73bf-bc85-42f0-91df-13b30d1e9dae,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:03.073999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceffac64-e356-4579-a528-f0ef285b16d2 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event deleted for resources: {'Network': ['ID=481d6b8b-f48e-4d12-a19b-7508b057747e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:03.095403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1994357423', 'description': 'tempest-description--1386662382'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:03.097886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 344f73bf-bc85-42f0-91df-13b30d1e9dae details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:31:03.129334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:03.129576 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ceffac64-e356-4579-a528-f0ef285b16d2 tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "DELETE /v2.0/networks/481d6b8b-f48e-4d12-a19b-7508b057747e HTTP/1.1" status: 204 len: 168 time: 1.2063994 May 12 15:31:03.136358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50194) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:03.149805 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3f920ec2-bbbe-4f84-82a0-519a0314e515 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:03.194008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:03.202554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Made reservation on behalf of eae7db4d964e4147a5dadb670fa36326 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:03.208443 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:03.225543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3f920ec2-bbbe-4f84-82a0-519a0314e515 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:03.264408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:03.349905 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3f920ec2-bbbe-4f84-82a0-519a0314e515 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:03.404154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f920ec2-bbbe-4f84-82a0-519a0314e515 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=316cbeba-8746-476e-b308-528c86f685f5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:03.421255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:03.430470 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3f920ec2-bbbe-4f84-82a0-519a0314e515 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:03.435256 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3f920ec2-bbbe-4f84-82a0-519a0314e515 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/316cbeba-8746-476e-b308-528c86f685f5 HTTP/1.1" status: 204 len: 168 time: 0.5920219 May 12 15:31:03.655941 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:03.701316 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f0a2086-1826-46fd-b8c2-fd05e5c3b39b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:03.737955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:03.798718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group_rule and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:03.857492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:03.882770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:03.893527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50224) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:03.903592 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f0a2086-1826-46fd-b8c2-fd05e5c3b39b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:03.991072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-6f0a2086-1826-46fd-b8c2-fd05e5c3b39b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9d4ee6ea-2b07-4221-abad-7a9aad88d871']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:04.018151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-6f0a2086-1826-46fd-b8c2-fd05e5c3b39b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0d3c92b7-a0ee-4306-b844-a119919f7c6d') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:04.018561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-6f0a2086-1826-46fd-b8c2-fd05e5c3b39b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0d3c92b7-a0ee-4306-b844-a119919f7c6d') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:04.048617 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f0a2086-1826-46fd-b8c2-fd05e5c3b39b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.077670 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac0dcbb4-0ddf-4df1-a839-89fe434f4809 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.123328 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f0a2086-1826-46fd-b8c2-fd05e5c3b39b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.131786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ac0dcbb4-0ddf-4df1-a839-89fe434f4809 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:04.140975 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.143650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ac0dcbb4-0ddf-4df1-a839-89fe434f4809 admin admin] Usage tracker for resource:security_group_rule and tenant:1f038d4a0ef743c3a0b1ccd64e25881a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:04.150727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6f0a2086-1826-46fd-b8c2-fd05e5c3b39b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Releasing vlan 560 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:31:04.151636 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f0a2086-1826-46fd-b8c2-fd05e5c3b39b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.152912 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ac0dcbb4-0ddf-4df1-a839-89fe434f4809 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:04.168815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ac0dcbb4-0ddf-4df1-a839-89fe434f4809 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: timer() May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:31:04.233059 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:31:04.242265 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.245019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Pushing event updated for resources: {'Subnet': ['ID=82b2bb6a-4dc0-44b3-a673-359e20ac9935,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:04.360348 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac0dcbb4-0ddf-4df1-a839-89fe434f4809 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.366485 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac0dcbb4-0ddf-4df1-a839-89fe434f4809 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.386762 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.503471 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ac0dcbb4-0ddf-4df1-a839-89fe434f4809 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1f038d4a0ef743c3a0b1ccd64e25881a&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6084933 May 12 15:31:04.506301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac0dcbb4-0ddf-4df1-a839-89fe434f4809 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dbc26870-3564-423e-a155-0eb443a059f9,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:04.513627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50252) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:04.616680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Checking segment: {'id': 'c13c5085-1b93-40b2-949d-70da42f91a88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': '344f73bf-bc85-42f0-91df-13b30d1e9dae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:31:04.617380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Network hostable DHCP agents. Network: 344f73bf-bc85-42f0-91df-13b30d1e9dae, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:31:04.634272 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f0a2086-1826-46fd-b8c2-fd05e5c3b39b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.635984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'SecurityGroup': ['ID=82085887-047f-4f61-8ddc-697504fbd406,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:04.658125 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7b4618c9-d045-4074-a94a-93dcaaa2af8f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.661545 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.662769 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-392e6cdc-13c3-48ae-96e5-cd7fa22dbe71 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1782 time: 1.5974648 May 12 15:31:04.667640 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f0a2086-1826-46fd-b8c2-fd05e5c3b39b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.671801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50264) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:04.691111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f18f7daa-ddfd-40bd-b2b4-7b977cf72112 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'security_group_rule': {'security_group_id': '82085887-047f-4f61-8ddc-697504fbd406', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:04.711599 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f18f7daa-ddfd-40bd-b2b4-7b977cf72112 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:04.742468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f18f7daa-ddfd-40bd-b2b4-7b977cf72112 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group_rule and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:04.746488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f18f7daa-ddfd-40bd-b2b4-7b977cf72112 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:04.754847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f18f7daa-ddfd-40bd-b2b4-7b977cf72112 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:04.782740 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7b4618c9-d045-4074-a94a-93dcaaa2af8f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.790665 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f18f7daa-ddfd-40bd-b2b4-7b977cf72112 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.849183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f0a2086-1826-46fd-b8c2-fd05e5c3b39b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] Pushing event deleted for resources: {'Network': ['ID=9d4ee6ea-2b07-4221-abad-7a9aad88d871,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:04.890111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6f0a2086-1826-46fd-b8c2-fd05e5c3b39b tempest-BulkNetworkOpsTest-1376159531 tempest-BulkNetworkOpsTest-1376159531-project] 10.222.0.82 "DELETE /v2.0/networks/9d4ee6ea-2b07-4221-abad-7a9aad88d871 HTTP/1.1" status: 204 len: 168 time: 1.7488172 May 12 15:31:04.899600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Network 344f73bf-bc85-42f0-91df-13b30d1e9dae is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:31:04.921549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 344f73bf-bc85-42f0-91df-13b30d1e9dae) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:04.928830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:04.929428 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.936477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c453727-45a8-496a-8bab-305697dc6f21 None None] Network 344f73bf-bc85-42f0-91df-13b30d1e9dae requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:04.937915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f18f7daa-ddfd-40bd-b2b4-7b977cf72112 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.944577 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f18f7daa-ddfd-40bd-b2b4-7b977cf72112 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:04.977379 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ecd370b4-c33d-41b8-b65c-622c965a0850 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 858 time: 2.0380723 May 12 15:31:05.060539 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f18f7daa-ddfd-40bd-b2b4-7b977cf72112 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0b8488ba-501d-463f-8d76-3fdf5a361f80,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:05.066699 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f18f7daa-ddfd-40bd-b2b4-7b977cf72112 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:05.071198 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f18f7daa-ddfd-40bd-b2b4-7b977cf72112 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3951921 May 12 15:31:05.071198 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7b4618c9-d045-4074-a94a-93dcaaa2af8f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:05.071458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50282) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:05.077070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6564b2cd-4889-4ed5-8007-06488e286c6e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'security_group_rule': {'security_group_id': '82085887-047f-4f61-8ddc-697504fbd406', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:05.078548 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7b4618c9-d045-4074-a94a-93dcaaa2af8f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:05.083311 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7b4618c9-d045-4074-a94a-93dcaaa2af8f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/dbc26870-3564-423e-a155-0eb443a059f9 HTTP/1.1" status: 204 len: 168 time: 0.5685036 May 12 15:31:05.089234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6564b2cd-4889-4ed5-8007-06488e286c6e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:05.098707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6564b2cd-4889-4ed5-8007-06488e286c6e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group_rule and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:05.105212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6564b2cd-4889-4ed5-8007-06488e286c6e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:05.110705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b4618c9-d045-4074-a94a-93dcaaa2af8f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbc26870-3564-423e-a155-0eb443a059f9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:05.125112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6564b2cd-4889-4ed5-8007-06488e286c6e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:05.170105 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6564b2cd-4889-4ed5-8007-06488e286c6e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:05.269329 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7ff863f-b1e5-4b36-85d3-9fe941ad33c5 None None] Network 344f73bf-bc85-42f0-91df-13b30d1e9dae requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:05.303724 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6564b2cd-4889-4ed5-8007-06488e286c6e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:05.308834 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6564b2cd-4889-4ed5-8007-06488e286c6e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:05.392468 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6564b2cd-4889-4ed5-8007-06488e286c6e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:05.399897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50292) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:05.401584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6564b2cd-4889-4ed5-8007-06488e286c6e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3274236 May 12 15:31:05.405011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:05.408959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6564b2cd-4889-4ed5-8007-06488e286c6e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=40816dd4-b740-47e1-af67-4164397c2263,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:05.422173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:05.430979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-7d14f4d8-e33d-42be-b933-331e0f810f7a req-4fd45806-2897-43d7-b3b0-ee3e4793a82e service neutron] (88151) timed out ('10.222.0.82', 55306) {{(pid=88151) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 15:31:05.432241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:floatingip and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:05.443678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:05.450093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:05.462768 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:05.698660 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:05.894228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Allocated IP 172.25.8.17 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/b37a3c82-7bfa-48ff-97f4-5504d9424767) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:31:05.896783 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:31:05.992176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50314) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:06.312458 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:06.386138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:06.503740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:31:06.521111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:06.524441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:31:06.608941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'Port': ['ID=b37a3c82-7bfa-48ff-97f4-5504d9424767,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:06.632521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50338) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:06.634841 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9cae5c18-8cfe-411e-a79c-b125ea8e1ccb admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2faf83d4488c45e09589f2ce8eead989&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6414697 May 12 15:31:06.782668 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a6788912-37d5-47eb-98a8-faf782d1d4b0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:06.853937 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a6788912-37d5-47eb-98a8-faf782d1d4b0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:06.931759 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:06.999326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd917d71-942d-494c-910d-a5552624e399 req-5419dea3-4e63-4630-afec-b231df8799b6 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:07.000348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-bd917d71-942d-494c-910d-a5552624e399 req-5419dea3-4e63-4630-afec-b231df8799b6 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Synchronizing usage tracker for tenant:eae7db4d964e4147a5dadb670fa36326 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:31:07.025049 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a6788912-37d5-47eb-98a8-faf782d1d4b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:07.031903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-bd917d71-942d-494c-910d-a5552624e399 req-5419dea3-4e63-4630-afec-b231df8799b6 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Unset dirty status for tenant:eae7db4d964e4147a5dadb670fa36326 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:31:07.038511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:07.043887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd917d71-942d-494c-910d-a5552624e399 req-5419dea3-4e63-4630-afec-b231df8799b6 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/networks?id=344f73bf-bc85-42f0-91df-13b30d1e9dae HTTP/1.1" status: 200 len: 821 time: 0.2989700 May 12 15:31:07.076607 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd917d71-942d-494c-910d-a5552624e399 req-68ad9103-a7f1-4464-b4ee-fe20e55a9a80 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/quotas/eae7db4d964e4147a5dadb670fa36326 HTTP/1.1" status: 200 len: 375 time: 0.0296605 May 12 15:31:07.106266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6788912-37d5-47eb-98a8-faf782d1d4b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc06c561-d582-4238-84b9-17efea50a6d3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:07.179848 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a6788912-37d5-47eb-98a8-faf782d1d4b0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:07.180993 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a6788912-37d5-47eb-98a8-faf782d1d4b0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cc06c561-d582-4238-84b9-17efea50a6d3 HTTP/1.1" status: 204 len: 168 time: 0.5474315 May 12 15:31:07.213372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd917d71-942d-494c-910d-a5552624e399 req-b65134b4-e445-43ba-9ec8-1150233348f2 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=eae7db4d964e4147a5dadb670fa36326&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1303911 May 12 15:31:07.361161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:07.370659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:07.582853 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd917d71-942d-494c-910d-a5552624e399 req-5ec6a365-c1ab-4abc-bae7-14c02d4c9f25 service neutron] 10.222.0.82 "GET /v2.0/networks/344f73bf-bc85-42f0-91df-13b30d1e9dae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3686020 May 12 15:31:07.699331 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:07.746454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'Port': ['ID=b37a3c82-7bfa-48ff-97f4-5504d9424767,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:07.778321 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:07.798186 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bfc668c6-88d8-4d7c-afa0-69431deae1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.3932981 May 12 15:31:07.899114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd917d71-942d-494c-910d-a5552624e399 req-f9745a2d-1ed0-479d-87f6-9debfeb928ec service neutron] 10.222.0.82 "GET /v2.0/networks/344f73bf-bc85-42f0-91df-13b30d1e9dae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3100145 May 12 15:31:08.372079 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43360696-6760-414f-be88-97e708903ef8 req-010c84bc-ef96-4212-aef3-73842c905ba5 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 210 time: 0.2385836 May 12 15:31:08.654937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-543219db-746b-4760-bc01-3e303815f69c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:31:08.700070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-543219db-746b-4760-bc01-3e303815f69c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:31:08.711317 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-543219db-746b-4760-bc01-3e303815f69c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1994357423&fields=id&tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b HTTP/1.1" status: 200 len: 267 time: 0.1589382 May 12 15:31:09.036578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-3cd4f391-44a2-48c2-b0c3-8f723c373d36 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:09.044449 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-3cd4f391-44a2-48c2-b0c3-8f723c373d36 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 815 time: 0.3315372 May 12 15:31:09.063627 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-79975bd0-f3cc-40c1-b908-171733cd81e6 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/quotas/c5f9faeb50de42b1a07298c25a4e4d6b HTTP/1.1" status: 200 len: 375 time: 0.0183480 May 12 15:31:09.178272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-92e77f2d-13d9-4f06-9b82-c689d5400c11 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:31:09.199985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-92e77f2d-13d9-4f06-9b82-c689d5400c11 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:31:09.213012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-92e77f2d-13d9-4f06-9b82-c689d5400c11 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1422594 May 12 15:31:09.446124 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-b7ddf063-a924-404b-b83c-d01c29c1fe1f service neutron] 10.222.0.82 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2302163 May 12 15:31:09.686998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61d874eb-c2c0-4638-a648-b125a28f78a7 req-900908f5-cc05-49dd-b889-567363d3f498 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 210 time: 0.0674036 May 12 15:31:09.779728 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-f5c88ab6-32a6-45ee-ba7f-620c3aec99a5 service neutron] 10.222.0.82 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3277099 May 12 15:31:09.851662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50458) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:10.155986 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-adfc7065-be47-4d8f-bb4d-777442cf708d req-42d532e6-2146-4388-82c1-f5743683e08a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 210 time: 0.1166115 May 12 15:31:10.422883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd917d71-942d-494c-910d-a5552624e399 req-d4987f45-da97-4846-b8e9-6eb921cf635a tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:10.425096 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd917d71-942d-494c-910d-a5552624e399 req-d4987f45-da97-4846-b8e9-6eb921cf635a tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.84 "GET /v2.0/networks?id=344f73bf-bc85-42f0-91df-13b30d1e9dae HTTP/1.1" status: 200 len: 821 time: 0.3785031 May 12 15:31:10.445501 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3acee072-3b6b-47c8-9cae-fb1951ee963a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:10.466141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Request body: {'port': {'device_id': '9def9006-5a34-482b-a8e8-8de3379c1d5b', 'network_id': '344f73bf-bc85-42f0-91df-13b30d1e9dae', 'admin_state_up': True, 'tenant_id': 'eae7db4d964e4147a5dadb670fa36326'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:10.644625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3acee072-3b6b-47c8-9cae-fb1951ee963a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:10.660359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3acee072-3b6b-47c8-9cae-fb1951ee963a admin admin] Usage tracker for resource:security_group_rule and tenant:62eeb78031584c97bf5bb5ca2da00679 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:10.666459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3acee072-3b6b-47c8-9cae-fb1951ee963a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:10.677168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3acee072-3b6b-47c8-9cae-fb1951ee963a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:10.841689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:10.855942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Usage tracker for resource:port and tenant:eae7db4d964e4147a5dadb670fa36326 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:10.870560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:10.878518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:10.896790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Made reservation on behalf of eae7db4d964e4147a5dadb670fa36326 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:10.900793 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:10.974960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50504) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:11.021783 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4d69cec-65f5-4b5b-acba-1f623581789e req-19515b05-27e2-46a0-9a58-4f66cf195ed2 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 210 time: 0.1109700 May 12 15:31:11.155205 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3acee072-3b6b-47c8-9cae-fb1951ee963a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:11.160571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3acee072-3b6b-47c8-9cae-fb1951ee963a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:11.473842 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3acee072-3b6b-47c8-9cae-fb1951ee963a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=62eeb78031584c97bf5bb5ca2da00679&name=default HTTP/1.1" status: 200 len: 2983 time: 1.6204343 May 12 15:31:11.477446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50524) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:11.570451 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e20ab5aa-4b70-451b-b759-3936b2615478 req-35b7801d-ce6e-43f3-a03d-b8009e843635 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 210 time: 0.1504967 May 12 15:31:11.648943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3acee072-3b6b-47c8-9cae-fb1951ee963a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=68dbd5bf-f393-443a-bc87-5db05e08f1f3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:11.699557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Allocated IP 172.20.0.11 (344f73bf-bc85-42f0-91df-13b30d1e9dae/82b2bb6a-4dc0-44b3-a673-359e20ac9935/18519333-0313-4b0f-92f3-16b15506c1ce) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:31:11.779482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1779922650'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:11.798283 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:11.811620 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:network and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:11.815504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:11.838313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:12.155367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-0ac3834e-e122-435f-ad9a-b777a12c7e17 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:12.156809 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-0ac3834e-e122-435f-ad9a-b777a12c7e17 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.76 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 815 time: 0.4069118 May 12 15:31:12.169747 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:12.173989 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:12.243247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b005e37e-993a-4256-91f0-250ff8d113df req-703da5a4-745e-4b94-bf04-2cab593fae3e tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 210 time: 0.0572360 May 12 15:31:12.307948 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-984e4022-2ce0-4305-bab1-e30ad21fd1da tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b HTTP/1.1" status: 200 len: 380 time: 0.1100023 May 12 15:31:12.313296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:12.569954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'port': {'device_id': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'admin_state_up': True, 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'security_groups': ['82085887-047f-4f61-8ddc-697504fbd406']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:12.701026 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-68a8c59b-96dd-4c7e-bfa4-34eb0a189210 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:12.873913 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61a08a9e-00d7-4a1d-b376-81dcaf955c64 req-5ec9cdfc-6e66-453d-b6db-edf18e1382c2 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 210 time: 0.0566015 May 12 15:31:12.958758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:13.029954 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-97403ad7-3303-4875-b1b9-90a2d5a60e90 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:13.042676 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:13.060595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:security_group_rule and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:13.063899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:13.100269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-97403ad7-3303-4875-b1b9-90a2d5a60e90 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:13.149613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:13.298122 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:13.308616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:13.315648 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-97403ad7-3303-4875-b1b9-90a2d5a60e90 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:13.372076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97403ad7-3303-4875-b1b9-90a2d5a60e90 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=68dbd5bf-f393-443a-bc87-5db05e08f1f3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:13.382761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Made reservation on behalf of c5f9faeb50de42b1a07298c25a4e4d6b for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:13.386846 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:13.400971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:13.449985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-97403ad7-3303-4875-b1b9-90a2d5a60e90 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:13.453496 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-97403ad7-3303-4875-b1b9-90a2d5a60e90 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/68dbd5bf-f393-443a-bc87-5db05e08f1f3 HTTP/1.1" status: 204 len: 168 time: 1.9349446 May 12 15:31:13.606432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50634) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:13.618747 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cb08adc-98db-4558-915c-787044169820 req-fcafa1cb-bc24-4cb8-9c59-e1552fdd8fd0 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 210 time: 0.1151502 May 12 15:31:13.842523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Allocated IP 172.20.0.13 (dbecac63-cd00-4ee6-bec1-19abe557d6e1/7cf2ffc4-f41f-40e3-90d1-77e214ee94e3/d34a63b6-2dbe-47d1-9d15-9dd7ae780c97) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:31:13.935076 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:14.160663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:14.201059 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3316c72-0004-4661-9247-bea594db0312 req-e2d26660-aa55-4b59-b659-dab3b12a5758 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 210 time: 0.1079819 May 12 15:31:14.306550 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:14.397339 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c8611caa-d0e7-48ad-a3d5-6939f049be6d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:14.449462 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50662) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:14.463253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 570} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:31:14.465608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c8611caa-d0e7-48ad-a3d5-6939f049be6d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:14.498500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Network 344f73bf-bc85-42f0-91df-13b30d1e9dae is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:31:14.500192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c8611caa-d0e7-48ad-a3d5-6939f049be6d admin admin] Usage tracker for resource:security_group_rule and tenant:bbb74f6ad6be44c789067d3206c3fd91 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:14.511056 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5f68efa5-3683-434a-a13c-5319bb87a82d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:14.512712 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:14.520721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:14.522876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c8611caa-d0e7-48ad-a3d5-6939f049be6d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:14.530422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'SecurityGroup': ['ID=41c3009a-3470-458d-8287-e9972621d80c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:14.532922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Pushing event updated for resources: {'Port': ['ID=18519333-0313-4b0f-92f3-16b15506c1ce,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:14.551693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:31:14.585907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c8611caa-d0e7-48ad-a3d5-6939f049be6d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:14.588736 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:14.589213 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Added segment 103890b0-4adf-45e6-a455-80f1a7bbc58a of type vlan for network 3b50a8ca-56d5-467e-bd2c-f74e0545d8d4 May 12 15:31:14.619362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Transition to ACTIVE for port object d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:31:14.680129 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:14.700480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:14.701139 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:14.787608 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:14.793595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:14.794202 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:14.811198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5f68efa5-3683-434a-a13c-5319bb87a82d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:14.822478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5f68efa5-3683-434a-a13c-5319bb87a82d admin admin] Usage tracker for resource:security_group_rule and tenant:5a248e634f8d48e9b0321dea795a67c6 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:14.826100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5f68efa5-3683-434a-a13c-5319bb87a82d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:14.827987 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-220c37a7-af70-4f3c-906e-783d4cec50b7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:14.841295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5f68efa5-3683-434a-a13c-5319bb87a82d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:14.858311 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd917d71-942d-494c-910d-a5552624e399 req-077f18dc-c3b4-4469-a5b2-8d6dc331b711 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 4.4009545 May 12 15:31:14.859495 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:14.988693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Request body: {'port': {'device_id': '9def9006-5a34-482b-a8e8-8de3379c1d5b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:15.087032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'Port': ['ID=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:15.098775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8989d4af-832a-4b8d-b661-a1edfc2b15ca req-8f2dfa9b-8904-4f6c-b5ef-3b6e5361a263 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:15.105925 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 4.1235206 May 12 15:31:15.106554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8989d4af-832a-4b8d-b661-a1edfc2b15ca req-8f2dfa9b-8904-4f6c-b5ef-3b6e5361a263 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 932 time: 0.2457347 May 12 15:31:15.108323 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50676) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:15.134518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-2132386998'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:15.140503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:15.145106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:network and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:15.149039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:15.155139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:15.187759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:15.192053 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:15.212576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50682) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:15.305130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 597} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:31:15.360508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Network dbecac63-cd00-4ee6-bec1-19abe557d6e1 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:31:15.363009 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:15.404456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:31:15.471931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8989d4af-832a-4b8d-b661-a1edfc2b15ca req-a46e3d1f-26b4-4308-a761-743daea9741e tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Synchronizing usage tracker for tenant:eae7db4d964e4147a5dadb670fa36326 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:31:15.553884 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5f68efa5-3683-434a-a13c-5319bb87a82d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:15.574977 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:15.574977 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Added segment 5045a395-ccf3-4ecc-8a1b-2fea99b18a46 of type vlan for network 146af6dc-9539-409e-8ef7-00f5631653c8 May 12 15:31:15.586304 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5f68efa5-3683-434a-a13c-5319bb87a82d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:15.679375 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c8611caa-d0e7-48ad-a3d5-6939f049be6d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:15.743268 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c8611caa-d0e7-48ad-a3d5-6939f049be6d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:15.842102 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c8611caa-d0e7-48ad-a3d5-6939f049be6d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bbb74f6ad6be44c789067d3206c3fd91&name=default HTTP/1.1" status: 200 len: 2983 time: 2.2269084 May 12 15:31:15.866545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50692) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:15.885411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bde6766-4928-42c6-b91c-0f0a51ae2dc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Network': ['ID=3b50a8ca-56d5-467e-bd2c-f74e0545d8d4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:15.894116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 3b50a8ca-56d5-467e-bd2c-f74e0545d8d4 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:31:15.949743 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:15.977116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8611caa-d0e7-48ad-a3d5-6939f049be6d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d6aad16-45d8-4f52-b60a-befa1299cab5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:16.033732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f68efa5-3683-434a-a13c-5319bb87a82d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ffaf5a27-cc14-4496-8776-eba54832073b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:16.038735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8989d4af-832a-4b8d-b661-a1edfc2b15ca req-a46e3d1f-26b4-4308-a761-743daea9741e tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Unset dirty status for tenant:eae7db4d964e4147a5dadb670fa36326 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:31:16.049702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:16.050379 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.053506 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8989d4af-832a-4b8d-b661-a1edfc2b15ca req-a46e3d1f-26b4-4308-a761-743daea9741e tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8880103 May 12 15:31:16.059101 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.069207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-134d7cb2-2f11-4db6-af94-efee9f6835a3 None None] Provisioning for port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:31:16.078643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-134d7cb2-2f11-4db6-af94-efee9f6835a3 None None] Provisioning complete for port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:16.079421 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-134d7cb2-2f11-4db6-af94-efee9f6835a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.103928 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.107846 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1fe6d2b8-0414-4b9d-b584-3f5a6bf4cfdc admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.141262 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5f68efa5-3683-434a-a13c-5319bb87a82d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5a248e634f8d48e9b0321dea795a67c6&name=default HTTP/1.1" status: 200 len: 2983 time: 1.6905231 May 12 15:31:16.145194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50700) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:16.157002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1fe6d2b8-0414-4b9d-b584-3f5a6bf4cfdc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:16.168061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-134d7cb2-2f11-4db6-af94-efee9f6835a3 None None] Port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:31:16.175187 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.178184 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.182721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:16.183359 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.222350 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-790cb222-4304-41f8-8526-8e68ef10b6a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.225038 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-ef5ed9a5-da4b-4d68-b05e-48c25492320b tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.8807268 May 12 15:31:16.250840 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Request body: {'port': {'device_id': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:16.316933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1fe6d2b8-0414-4b9d-b584-3f5a6bf4cfdc admin admin] Usage tracker for resource:security_group_rule and tenant:81a720c678f446f5a13fe28f4b1b3343 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:16.320298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Network': ['ID=146af6dc-9539-409e-8ef7-00f5631653c8,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:16.331845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1fe6d2b8-0414-4b9d-b584-3f5a6bf4cfdc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:16.339151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 146af6dc-9539-409e-8ef7-00f5631653c8 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:31:16.339803 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9f77c770-88f1-4a77-8452-530adb5e340c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 1.2303967 May 12 15:31:16.340004 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-790cb222-4304-41f8-8526-8e68ef10b6a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.343626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50706) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:16.351172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1fe6d2b8-0414-4b9d-b584-3f5a6bf4cfdc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:16.360146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'subnet': {'network_id': '3b50a8ca-56d5-467e-bd2c-f74e0545d8d4', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:16.520699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3d9eeab-d658-49b3-a37a-54f7b9db6b3d req-7b50e8dc-d615-47b5-a2d4-da1a11ad7417 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:16.523630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3d9eeab-d658-49b3-a37a-54f7b9db6b3d req-7b50e8dc-d615-47b5-a2d4-da1a11ad7417 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 932 time: 0.7729251 May 12 15:31:16.556145 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-957e1c91-dca4-4b2a-b616-359aa708635a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.588170 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.600554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:16.628234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:subnet and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:16.634657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:16.639223 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-957e1c91-dca4-4b2a-b616-359aa708635a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.666789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:16.678910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3d9eeab-d658-49b3-a37a-54f7b9db6b3d req-d5e4e6a1-5c1b-4b8c-99af-1b2b3f29e07e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1248174 May 12 15:31:16.728321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:16.731863 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.780284 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-790cb222-4304-41f8-8526-8e68ef10b6a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.840812 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-790cb222-4304-41f8-8526-8e68ef10b6a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.842247 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-790cb222-4304-41f8-8526-8e68ef10b6a9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1d6aad16-45d8-4f52-b60a-befa1299cab5 HTTP/1.1" status: 204 len: 168 time: 0.9740701 May 12 15:31:16.843531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-790cb222-4304-41f8-8526-8e68ef10b6a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d6aad16-45d8-4f52-b60a-befa1299cab5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:16.846880 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1fe6d2b8-0414-4b9d-b584-3f5a6bf4cfdc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.855532 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1fe6d2b8-0414-4b9d-b584-3f5a6bf4cfdc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.964970 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-957e1c91-dca4-4b2a-b616-359aa708635a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:16.969329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1fe6d2b8-0414-4b9d-b584-3f5a6bf4cfdc admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=81a720c678f446f5a13fe28f4b1b3343&name=default HTTP/1.1" status: 200 len: 2983 time: 1.7359483 May 12 15:31:16.976616 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50722) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:16.981031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fe6d2b8-0414-4b9d-b584-3f5a6bf4cfdc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=02420c78-b079-4535-8022-4ed60cc7e758,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:17.045575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-957e1c91-dca4-4b2a-b616-359aa708635a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ffaf5a27-cc14-4496-8776-eba54832073b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:17.188100 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-957e1c91-dca4-4b2a-b616-359aa708635a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:17.189887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-957e1c91-dca4-4b2a-b616-359aa708635a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ffaf5a27-cc14-4496-8776-eba54832073b HTTP/1.1" status: 204 len: 168 time: 1.0412204 May 12 15:31:17.274629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 18519333-0313-4b0f-92f3-16b15506c1ce {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:31:17.287586 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:17.288323 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ef01fbf-d713-40a1-9aa0-ee7efb2ec5cc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:17.351698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Transition to ACTIVE for port object 18519333-0313-4b0f-92f3-16b15506c1ce will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:31:17.370716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:17.513813 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:17.522925 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ef01fbf-d713-40a1-9aa0-ee7efb2ec5cc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:17.588573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50736) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:17.639729 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] It took 0.19 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:31:17.663477 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:17.673711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Pushing event updated for resources: {'Port': ['ID=18519333-0313-4b0f-92f3-16b15506c1ce,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:17.724746 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1f8f7843-23b1-49dc-81af-3ca7c74c5321 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:17.808730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1f8f7843-23b1-49dc-81af-3ca7c74c5321 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:17.826047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1f8f7843-23b1-49dc-81af-3ca7c74c5321 admin admin] Usage tracker for resource:security_group_rule and tenant:f52130430b3e4c36b16e08c66b28c7b5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:17.829635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Checking segment: {'id': '103890b0-4adf-45e6-a455-80f1a7bbc58a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 570, 'network_id': '3b50a8ca-56d5-467e-bd2c-f74e0545d8d4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:31:17.830753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network hostable DHCP agents. Network: 3b50a8ca-56d5-467e-bd2c-f74e0545d8d4, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:31:17.835677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Subnet': ['ID=32aa3dbd-054f-4286-81a6-5b1d7f70d6c2,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:17.841164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1f8f7843-23b1-49dc-81af-3ca7c74c5321 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:17.855783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1f8f7843-23b1-49dc-81af-3ca7c74c5321 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:17.860964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:31:17.882359 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:17.886462 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cffc5f4a-90d8-4a75-a6d2-a2f4107625fc req-5915bb88-4815-42fb-846a-b03d11199fcd tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:17.896273 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cffc5f4a-90d8-4a75-a6d2-a2f4107625fc req-5915bb88-4815-42fb-846a-b03d11199fcd tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 944 time: 0.5486758 May 12 15:31:17.927433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Transition to ACTIVE for port object d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:31:17.933494 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:17.983792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Attempting to bind port 18519333-0313-4b0f-92f3-16b15506c1ce on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:31:17.984265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Attempting to bind port 18519333-0313-4b0f-92f3-16b15506c1ce by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'c13c5085-1b93-40b2-949d-70da42f91a88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': '344f73bf-bc85-42f0-91df-13b30d1e9dae'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:31:17.984692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Attempting to bind port 18519333-0313-4b0f-92f3-16b15506c1ce on network 344f73bf-bc85-42f0-91df-13b30d1e9dae {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:31:17.985663 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ef01fbf-d713-40a1-9aa0-ee7efb2ec5cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:17.991465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 3b50a8ca-56d5-467e-bd2c-f74e0545d8d4 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:31:18.052931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ef01fbf-d713-40a1-9aa0-ee7efb2ec5cc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=02420c78-b079-4535-8022-4ed60cc7e758,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:18.071132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 3b50a8ca-56d5-467e-bd2c-f74e0545d8d4) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:18.084067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:18.084956 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:18.099921 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cffc5f4a-90d8-4a75-a6d2-a2f4107625fc req-57be619d-528b-4df6-bce7-d49d3a82a274 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2024615 May 12 15:31:18.106012 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ef01fbf-d713-40a1-9aa0-ee7efb2ec5cc admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:18.112099 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6ef01fbf-d713-40a1-9aa0-ee7efb2ec5cc admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/02420c78-b079-4535-8022-4ed60cc7e758 HTTP/1.1" status: 204 len: 168 time: 1.1293585 May 12 15:31:18.123531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69357a2a-900e-49c8-b9a8-6fb687935506 None None] Network 3b50a8ca-56d5-467e-bd2c-f74e0545d8d4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:18.149061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Port 18519333-0313-4b0f-92f3-16b15506c1ce on network 344f73bf-bc85-42f0-91df-13b30d1e9dae not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:31:18.150261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Attempting to bind port 18519333-0313-4b0f-92f3-16b15506c1ce on network 344f73bf-bc85-42f0-91df-13b30d1e9dae {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:31:18.196305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 31, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:31:18.209429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Checking segment: {'id': 'c13c5085-1b93-40b2-949d-70da42f91a88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': '344f73bf-bc85-42f0-91df-13b30d1e9dae'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:31:18.212576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Bound using segment: {'id': 'c13c5085-1b93-40b2-949d-70da42f91a88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': '344f73bf-bc85-42f0-91df-13b30d1e9dae'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:31:18.213247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Bound port: 18519333-0313-4b0f-92f3-16b15506c1ce, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c13c5085-1b93-40b2-949d-70da42f91a88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': '344f73bf-bc85-42f0-91df-13b30d1e9dae'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:31:18.213785 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:18.238515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-86248dc1-9472-4e88-825d-c1b3f1d80bb9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.8863251 May 12 15:31:18.248936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50756) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:18.284088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b1d6a47-9763-4544-8c52-24ab30ec79d7 req-dc64ac77-e155-4a5e-8b54-0165aa25adc3 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:18.286000 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b1d6a47-9763-4544-8c52-24ab30ec79d7 req-dc64ac77-e155-4a5e-8b54-0165aa25adc3 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 944 time: 0.3874707 May 12 15:31:18.296377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'subnet': {'network_id': '146af6dc-9539-409e-8ef7-00f5631653c8', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:18.303763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Pushing event updated for resources: {'Port': ['ID=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:18.520665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] For port 18519333-0313-4b0f-92f3-16b15506c1ce, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:31:18.523975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] For port 18519333-0313-4b0f-92f3-16b15506c1ce, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=18519333-0313-4b0f-92f3-16b15506c1ce,segment=NetworkSegment(c13c5085-1b93-40b2-949d-70da42f91a88),segment_id=c13c5085-1b93-40b2-949d-70da42f91a88)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:31:18.530897 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:18.613972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Pushing event updated for resources: {'Port': ['ID=18519333-0313-4b0f-92f3-16b15506c1ce,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:18.643673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:18.645427 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:18.647068 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd917d71-942d-494c-910d-a5552624e399 req-3ef4e138-0742-4a3b-b384-bde8c198561a service neutron] 10.222.0.84 "PUT /v2.0/ports/18519333-0313-4b0f-92f3-16b15506c1ce HTTP/1.1" status: 200 len: 1092 time: 3.7607634 May 12 15:31:18.647752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9def9006-5a34-482b-a8e8-8de3379c1d5b', 'tag': '18519333-0313-4b0f-92f3-16b15506c1ce'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:31:18.657238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Attempting to bind port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:31:18.658527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Attempting to bind port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:31:18.661915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Attempting to bind port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 on network dbecac63-cd00-4ee6-bec1-19abe557d6e1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:31:18.669818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 on network dbecac63-cd00-4ee6-bec1-19abe557d6e1 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:31:18.670502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Attempting to bind port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 on network dbecac63-cd00-4ee6-bec1-19abe557d6e1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:31:18.678724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 31, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:31:18.679461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Checking segment: {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:31:18.680070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Bound using segment: {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:31:18.680775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Bound port: d34a63b6-2dbe-47d1-9d15-9dd7ae780c97, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:31:18.681359 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:18.800000 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bdb9caa9-5540-4f19-a893-821d00eab24a'] response: {'name': 'network-changed', 'server_uuid': '9def9006-5a34-482b-a8e8-8de3379c1d5b', 'tag': '18519333-0313-4b0f-92f3-16b15506c1ce', 'status': 'completed', 'code': 200} May 12 15:31:18.806632 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1f8f7843-23b1-49dc-81af-3ca7c74c5321 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:18.844307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-3b50a8ca-56d5-467e-bd2c-f74e0545d8d4', 'network_id': '3b50a8ca-56d5-467e-bd2c-f74e0545d8d4', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'fixed_ips': [{'subnet_id': '32aa3dbd-054f-4286-81a6-5b1d7f70d6c2'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:31:18.845118 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:18.873822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] For port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:31:18.878111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b1d6a47-9763-4544-8c52-24ab30ec79d7 req-8c38cf9a-3288-4caa-bc5e-1c55787a7bcb tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5863311 May 12 15:31:18.879383 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:18.879555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] For port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:31:18.882040 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1f8f7843-23b1-49dc-81af-3ca7c74c5321 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:18.885040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd917d71-942d-494c-910d-a5552624e399 req-e4e3f2f7-a610-4bb6-823d-4a1892580245 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:18.887223 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd917d71-942d-494c-910d-a5552624e399 req-e4e3f2f7-a610-4bb6-823d-4a1892580245 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=eae7db4d964e4147a5dadb670fa36326&device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 1095 time: 0.1565886 May 12 15:31:18.888692 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:18.950713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:subnet and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:18.956997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:18.984542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:19.136615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:19.155403 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:19.231477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50778) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:19.232697 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd917d71-942d-494c-910d-a5552624e399 req-d7395f2b-18df-46d4-8168-f7bbf638b41b service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=18519333-0313-4b0f-92f3-16b15506c1ce HTTP/1.1" status: 200 len: 217 time: 0.2879279 May 12 15:31:19.258749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:19.259367 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:19.260746 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] 10.222.0.76 "PUT /v2.0/ports/d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 HTTP/1.1" status: 200 len: 1092 time: 3.0161610 May 12 15:31:19.391922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Allocated IP 2001:db8::2 (3b50a8ca-56d5-467e-bd2c-f74e0545d8d4/32aa3dbd-054f-4286-81a6-5b1d7f70d6c2/29a11baf-9c87-46a0-a334-f53971e4f87e) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:31:19.451795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f8f7843-23b1-49dc-81af-3ca7c74c5321 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a2ef877d-3e2c-454c-a857-857d683eee88,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:19.459084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1f8f7843-23b1-49dc-81af-3ca7c74c5321 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f52130430b3e4c36b16e08c66b28c7b5&name=default HTTP/1.1" status: 200 len: 2983 time: 1.8661451 May 12 15:31:19.468724 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50788) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:19.612878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cf4df5e-0972-4a5c-aee5-8dc5aa98f1f0 service neutron] Pushing event updated for resources: {'Port': ['ID=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:19.612878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-576c2b87-3413-4d1d-9c6a-6120f9abeeaf admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:19.766725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-576c2b87-3413-4d1d-9c6a-6120f9abeeaf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:19.790181 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-576c2b87-3413-4d1d-9c6a-6120f9abeeaf admin admin] Usage tracker for resource:security_group_rule and tenant:44fcaedc200f438a8f3b32ce8ff36311 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:19.795540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-576c2b87-3413-4d1d-9c6a-6120f9abeeaf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:19.812297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-576c2b87-3413-4d1d-9c6a-6120f9abeeaf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:19.821251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd917d71-942d-494c-910d-a5552624e399 req-d1ef27cb-2720-4850-9cf2-7be00fd9a0d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:19.822765 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd917d71-942d-494c-910d-a5552624e399 req-d1ef27cb-2720-4850-9cf2-7be00fd9a0d1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=82b2bb6a-4dc0-44b3-a673-359e20ac9935 HTTP/1.1" status: 200 len: 861 time: 0.5611982 May 12 15:31:19.938288 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c056d052-503c-4955-a782-44f34c6e73e3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:20.014313 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c056d052-503c-4955-a782-44f34c6e73e3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:20.029647 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:20.047918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Transition to ACTIVE for port object 29a11baf-9c87-46a0-a334-f53971e4f87e will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:31:20.076484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Transition to ACTIVE for port object 29a11baf-9c87-46a0-a334-f53971e4f87e will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:31:20.084570 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:20.092583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68681deb-cb6b-460e-b08a-e6757ec9ac76 req-641d72d2-d294-4bc3-b3a1-e679d902f2db tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:20.103791 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-68681deb-cb6b-460e-b08a-e6757ec9ac76 req-641d72d2-d294-4bc3-b3a1-e679d902f2db tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 944 time: 0.6357343 May 12 15:31:20.123139 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd917d71-942d-494c-910d-a5552624e399 req-2b760e79-d2c7-4c85-850a-15b226dddddd service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=344f73bf-bc85-42f0-91df-13b30d1e9dae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2895899 May 12 15:31:20.178733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-3a8c6ace-864d-49bc-99b6-312577215070 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:20.191075 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-3a8c6ace-864d-49bc-99b6-312577215070 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 1095 time: 0.5825057 May 12 15:31:20.191246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Pushing event updated for resources: {'Port': ['ID=29a11baf-9c87-46a0-a334-f53971e4f87e,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:20.196043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Network 3b50a8ca-56d5-467e-bd2c-f74e0545d8d4 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:31:20.197227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:20.199824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:31:20.333661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Attempting to bind port 29a11baf-9c87-46a0-a334-f53971e4f87e on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:31:20.339429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Attempting to bind port 29a11baf-9c87-46a0-a334-f53971e4f87e by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '103890b0-4adf-45e6-a455-80f1a7bbc58a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 570, 'network_id': '3b50a8ca-56d5-467e-bd2c-f74e0545d8d4'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:31:20.340248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Attempting to bind port 29a11baf-9c87-46a0-a334-f53971e4f87e on network 3b50a8ca-56d5-467e-bd2c-f74e0545d8d4 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:31:20.351982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 31, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:31:20.354054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Checking segment: {'id': '103890b0-4adf-45e6-a455-80f1a7bbc58a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 570, 'network_id': '3b50a8ca-56d5-467e-bd2c-f74e0545d8d4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:31:20.355675 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:20.358765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Bound using segment: {'id': '103890b0-4adf-45e6-a455-80f1a7bbc58a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 570, 'network_id': '3b50a8ca-56d5-467e-bd2c-f74e0545d8d4'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:31:20.359459 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Bound port: 29a11baf-9c87-46a0-a334-f53971e4f87e, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '103890b0-4adf-45e6-a455-80f1a7bbc58a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 570, 'network_id': '3b50a8ca-56d5-467e-bd2c-f74e0545d8d4'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:31:20.360024 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:20.443015 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-68681deb-cb6b-460e-b08a-e6757ec9ac76 req-91ca5256-ee99-4620-b142-ac3b77c8de3d tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3383148 May 12 15:31:20.477870 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-f371b6f7-5d4c-4591-936c-b968269580d8 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 HTTP/1.1" status: 200 len: 217 time: 0.2801697 May 12 15:31:20.535449 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] For port 29a11baf-9c87-46a0-a334-f53971e4f87e, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:31:20.547439 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] For port 29a11baf-9c87-46a0-a334-f53971e4f87e, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=29a11baf-9c87-46a0-a334-f53971e4f87e,segment=NetworkSegment(103890b0-4adf-45e6-a455-80f1a7bbc58a),segment_id=103890b0-4adf-45e6-a455-80f1a7bbc58a)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:31:20.555534 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c056d052-503c-4955-a782-44f34c6e73e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:20.556206 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:20.625772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c056d052-503c-4955-a782-44f34c6e73e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2ef877d-3e2c-454c-a857-857d683eee88,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:20.643847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e274061f-8629-4918-81d3-9d5a39379018 req-1ababd40-e850-4722-a48e-0926d4829f15 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:20.655990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e274061f-8629-4918-81d3-9d5a39379018 req-1ababd40-e850-4722-a48e-0926d4829f15 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 944 time: 0.5450437 May 12 15:31:20.672107 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:20.725690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f96a3311-8806-40ff-99ec-fbb7e6077144 None None] Pushing event updated for resources: {'Port': ['ID=29a11baf-9c87-46a0-a334-f53971e4f87e,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:20.766638 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-576c2b87-3413-4d1d-9c6a-6120f9abeeaf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:20.780517 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-576c2b87-3413-4d1d-9c6a-6120f9abeeaf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:20.787631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Subnet': ['ID=b76f650a-c71f-4cfb-8501-a64b78974ec4,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:20.853205 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c056d052-503c-4955-a782-44f34c6e73e3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:20.866499 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c056d052-503c-4955-a782-44f34c6e73e3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a2ef877d-3e2c-454c-a857-857d683eee88 HTTP/1.1" status: 204 len: 168 time: 1.2984183 May 12 15:31:20.879714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'tag': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:31:20.890443 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd917d71-942d-494c-910d-a5552624e399 req-949eb027-8c81-48a9-bd00-db8e5a565a14 service neutron] 10.222.0.84 "GET /v2.0/networks/344f73bf-bc85-42f0-91df-13b30d1e9dae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7541482 May 12 15:31:20.914876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-0a752586-6b13-463d-b658-418321dc0c98 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:20.916326 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-0a752586-6b13-463d-b658-418321dc0c98 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 HTTP/1.1" status: 200 len: 854 time: 0.4318821 May 12 15:31:20.955911 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e274061f-8629-4918-81d3-9d5a39379018 req-f92d6c20-98d1-4f8a-a4ef-d2676824dc08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2961264 May 12 15:31:20.988501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Checking segment: {'id': '5045a395-ccf3-4ecc-8a1b-2fea99b18a46', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '146af6dc-9539-409e-8ef7-00f5631653c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:31:20.997584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network hostable DHCP agents. Network: 146af6dc-9539-409e-8ef7-00f5631653c8, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:31:21.021145 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-349f58c4-1586-42fd-89bb-305fe2e534ea'] response: {'name': 'network-changed', 'server_uuid': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'tag': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97', 'status': 'completed', 'code': 200} May 12 15:31:21.051852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 146af6dc-9539-409e-8ef7-00f5631653c8 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:31:21.066307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 146af6dc-9539-409e-8ef7-00f5631653c8) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:21.070822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:21.071732 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:21.082831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-818d3cbf-a144-47a4-89a2-7d8bf42ff22c None None] Network 146af6dc-9539-409e-8ef7-00f5631653c8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:21.137480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7c632541-4211-4145-bfd8-f0c44fa00cda tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 2.8752744 May 12 15:31:21.138299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50826) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:21.144102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-299deccb-d6f3-4cfb-b608-48b343372c9a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1375287097', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:21.166816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-299deccb-d6f3-4cfb-b608-48b343372c9a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:21.181332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-299deccb-d6f3-4cfb-b608-48b343372c9a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:router and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:21.186158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-299deccb-d6f3-4cfb-b608-48b343372c9a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:21.220076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-299deccb-d6f3-4cfb-b608-48b343372c9a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:21.244621 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-299deccb-d6f3-4cfb-b608-48b343372c9a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:21.246109 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-299deccb-d6f3-4cfb-b608-48b343372c9a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:21.281005 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-299deccb-d6f3-4cfb-b608-48b343372c9a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:21.311839 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-299deccb-d6f3-4cfb-b608-48b343372c9a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:21.369865 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-299deccb-d6f3-4cfb-b608-48b343372c9a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:21.371089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-299deccb-d6f3-4cfb-b608-48b343372c9a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.2316282 May 12 15:31:21.375008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50832) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:21.549215 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd917d71-942d-494c-910d-a5552624e399 req-fd492660-7452-49f9-b104-be3ac8047a29 service neutron] 10.222.0.84 "GET /v2.0/networks/344f73bf-bc85-42f0-91df-13b30d1e9dae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6115155 May 12 15:31:21.555659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-576c2b87-3413-4d1d-9c6a-6120f9abeeaf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34e92c87-ba2d-4b88-8ed1-22e1effe58da,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:21.605088 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-576c2b87-3413-4d1d-9c6a-6120f9abeeaf admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=44fcaedc200f438a8f3b32ce8ff36311&name=default HTTP/1.1" status: 200 len: 2983 time: 2.3712981 May 12 15:31:21.608334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50842) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:21.672940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 29a11baf-9c87-46a0-a334-f53971e4f87e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:31:21.906622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-50ce792b-0b4e-4758-8bf2-a3e3a0876a2f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:21.940944 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-50ce792b-0b4e-4758-8bf2-a3e3a0876a2f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:22.002494 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 29a11baf-9c87-46a0-a334-f53971e4f87e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:31:22.015550 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-50ce792b-0b4e-4758-8bf2-a3e3a0876a2f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:22.041989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50858) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:22.077522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50ce792b-0b4e-4758-8bf2-a3e3a0876a2f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34e92c87-ba2d-4b88-8ed1-22e1effe58da,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:22.100657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-3ef1c01f-a257-41c2-b392-b9fdd1edf172 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:22.102433 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-3ef1c01f-a257-41c2-b392-b9fdd1edf172 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=dbecac63-cd00-4ee6-bec1-19abe557d6e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 1.0946317 May 12 15:31:22.122393 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-50ce792b-0b4e-4758-8bf2-a3e3a0876a2f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:22.127266 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-50ce792b-0b4e-4758-8bf2-a3e3a0876a2f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/34e92c87-ba2d-4b88-8ed1-22e1effe58da HTTP/1.1" status: 204 len: 168 time: 0.5024862 May 12 15:31:22.295860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d2f092f-25e7-476a-8995-4d0d690ca466 req-6b41c7b6-ad7e-41d2-86a3-6bcf3e05aba4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:22.300199 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d2f092f-25e7-476a-8995-4d0d690ca466 req-6b41c7b6-ad7e-41d2-86a3-6bcf3e05aba4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=eae7db4d964e4147a5dadb670fa36326&device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 1095 time: 0.5599852 May 12 15:31:22.396998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-146af6dc-9539-409e-8ef7-00f5631653c8', 'network_id': '146af6dc-9539-409e-8ef7-00f5631653c8', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'fixed_ips': [{'subnet_id': 'b76f650a-c71f-4cfb-8501-a64b78974ec4'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:31:22.397865 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:22.446154 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f7afd49d-fb71-4cb8-8585-47e8bdcf43a3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:22.628185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f7afd49d-fb71-4cb8-8585-47e8bdcf43a3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:22.662003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f7afd49d-fb71-4cb8-8585-47e8bdcf43a3 admin admin] Usage tracker for resource:security_group_rule and tenant:ffb946342fbf4b21b88ac64d878f1dd0 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:22.682790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f7afd49d-fb71-4cb8-8585-47e8bdcf43a3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:22.690448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c9af77d-727f-4dc6-9393-a5577c908a06 None None] Network 3b50a8ca-56d5-467e-bd2c-f74e0545d8d4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:22.713143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f7afd49d-fb71-4cb8-8585-47e8bdcf43a3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:22.786625 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-673c2504-e864-4bed-918d-9ae270ac5c08 service neutron] 10.222.0.76 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6677575 May 12 15:31:23.032254 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f7afd49d-fb71-4cb8-8585-47e8bdcf43a3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:23.077120 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80fa2383-a26e-4438-8108-ce7905d5e306 req-477c9ebe-ee40-43af-bb7a-4427a5c6a079 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:23.083024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-80fa2383-a26e-4438-8108-ce7905d5e306 req-477c9ebe-ee40-43af-bb7a-4427a5c6a079 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 944 time: 1.2701290 May 12 15:31:23.094792 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f7afd49d-fb71-4cb8-8585-47e8bdcf43a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:23.164324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e26546fc-9f3e-4ca7-afcb-b2364a11f1f9 None None] Provisioning for port 29a11baf-9c87-46a0-a334-f53971e4f87e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:31:23.173297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e26546fc-9f3e-4ca7-afcb-b2364a11f1f9 None None] Provisioning complete for port 29a11baf-9c87-46a0-a334-f53971e4f87e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:23.174294 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e26546fc-9f3e-4ca7-afcb-b2364a11f1f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:23.178264 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f7afd49d-fb71-4cb8-8585-47e8bdcf43a3 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ffb946342fbf4b21b88ac64d878f1dd0&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1278071 May 12 15:31:23.185977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50896) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:23.280805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Allocated IP 2001:db8:1::2 (146af6dc-9539-409e-8ef7-00f5631653c8/b76f650a-c71f-4cfb-8501-a64b78974ec4/f919f925-77db-4728-9eef-3e2fa64aad7e) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:31:23.334934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d2f092f-25e7-476a-8995-4d0d690ca466 req-3f83489d-bf5e-4188-8bd2-5e54b944cd24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:23.340344 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d2f092f-25e7-476a-8995-4d0d690ca466 req-3f83489d-bf5e-4188-8bd2-5e54b944cd24 service neutron] 10.222.0.84 "GET /v2.0/networks?id=344f73bf-bc85-42f0-91df-13b30d1e9dae HTTP/1.1" status: 200 len: 922 time: 1.0217726 May 12 15:31:23.423941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-80fa2383-a26e-4438-8108-ce7905d5e306 req-7ae1e396-d946-4966-bb2f-2e77ed1405cb tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3285077 May 12 15:31:23.495337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690d1451-d39f-4949-8ecb-ed7e30398e24 req-618c2882-e625-44c7-9f6d-24ee56fcda50 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:23.499194 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-690d1451-d39f-4949-8ecb-ed7e30398e24 req-618c2882-e625-44c7-9f6d-24ee56fcda50 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 944 time: 1.0598364 May 12 15:31:23.629757 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:23.645469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7afd49d-fb71-4cb8-8585-47e8bdcf43a3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc97e313-c5c3-4406-a94f-b927eb479e71,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:23.664518 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d2f092f-25e7-476a-8995-4d0d690ca466 req-56109353-c711-4ada-b502-992d8facdf60 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=18519333-0313-4b0f-92f3-16b15506c1ce HTTP/1.1" status: 200 len: 217 time: 0.2587330 May 12 15:31:23.747525 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:23.759175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Transition to ACTIVE for port object f919f925-77db-4728-9eef-3e2fa64aad7e will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:31:23.786924 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Transition to ACTIVE for port object f919f925-77db-4728-9eef-3e2fa64aad7e will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:31:23.809210 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c79e7018-149f-4771-8630-cec67dd0a887 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:23.886326 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5778f3f8-88eb-4b42-9efe-ea428466ea82 req-70982be5-a6a8-46fe-ad43-832f524bd9b4 service neutron] 10.222.0.76 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8442602 May 12 15:31:23.897564 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c79e7018-149f-4771-8630-cec67dd0a887 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:23.926977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d2f092f-25e7-476a-8995-4d0d690ca466 req-3b268e4a-3098-495f-9889-60af8e33ae87 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:23.928617 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d2f092f-25e7-476a-8995-4d0d690ca466 req-3b268e4a-3098-495f-9889-60af8e33ae87 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=82b2bb6a-4dc0-44b3-a673-359e20ac9935 HTTP/1.1" status: 200 len: 861 time: 0.2269335 May 12 15:31:24.077365 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-690d1451-d39f-4949-8ecb-ed7e30398e24 req-c1453a23-7288-4f5c-903a-9a4786f24755 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5129461 May 12 15:31:24.192695 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:24.218595 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d2f092f-25e7-476a-8995-4d0d690ca466 req-9d007344-5588-4c0c-9f20-8740c76084f4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=344f73bf-bc85-42f0-91df-13b30d1e9dae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2773116 May 12 15:31:24.461851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Network 146af6dc-9539-409e-8ef7-00f5631653c8 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:31:24.490451 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Pushing event updated for resources: {'Port': ['ID=f919f925-77db-4728-9eef-3e2fa64aad7e,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:24.500871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:24.504600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:31:24.811158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Allocated IP 2001:db8::1 (3b50a8ca-56d5-467e-bd2c-f74e0545d8d4/32aa3dbd-054f-4286-81a6-5b1d7f70d6c2/80d6dd70-9523-4225-830b-ff1c4ce69403) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:31:24.904267 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d2f092f-25e7-476a-8995-4d0d690ca466 req-a4ea5b2f-3d8a-4a61-ace1-41c361ed0813 service neutron] 10.222.0.84 "GET /v2.0/networks/344f73bf-bc85-42f0-91df-13b30d1e9dae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2959850 May 12 15:31:24.904752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50988) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:24.985370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Attempting to bind port f919f925-77db-4728-9eef-3e2fa64aad7e on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:31:24.987320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Attempting to bind port f919f925-77db-4728-9eef-3e2fa64aad7e by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '5045a395-ccf3-4ecc-8a1b-2fea99b18a46', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '146af6dc-9539-409e-8ef7-00f5631653c8'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:31:24.988304 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Attempting to bind port f919f925-77db-4728-9eef-3e2fa64aad7e on network 146af6dc-9539-409e-8ef7-00f5631653c8 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:31:25.007221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 31, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:31:25.007814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Checking segment: {'id': '5045a395-ccf3-4ecc-8a1b-2fea99b18a46', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '146af6dc-9539-409e-8ef7-00f5631653c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:31:25.008504 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:25.009039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Bound using segment: {'id': '5045a395-ccf3-4ecc-8a1b-2fea99b18a46', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '146af6dc-9539-409e-8ef7-00f5631653c8'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:31:25.010221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Bound port: f919f925-77db-4728-9eef-3e2fa64aad7e, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5045a395-ccf3-4ecc-8a1b-2fea99b18a46', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '146af6dc-9539-409e-8ef7-00f5631653c8'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:31:25.010221 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:25.116563 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:25.160225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] For port f919f925-77db-4728-9eef-3e2fa64aad7e, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:31:25.166946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] For port f919f925-77db-4728-9eef-3e2fa64aad7e, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f919f925-77db-4728-9eef-3e2fa64aad7e,segment=NetworkSegment(5045a395-ccf3-4ecc-8a1b-2fea99b18a46),segment_id=5045a395-ccf3-4ecc-8a1b-2fea99b18a46)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:31:25.176737 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:25.189509 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e26546fc-9f3e-4ca7-afcb-b2364a11f1f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:25.356768 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c79e7018-149f-4771-8630-cec67dd0a887 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:25.360913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Transition to ACTIVE for port object 80d6dd70-9523-4225-830b-ff1c4ce69403 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:31:25.366607 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec7bf9eb-0ca2-41db-83a4-7c6d41c9f880 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:25.413538 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:25.426914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c79e7018-149f-4771-8630-cec67dd0a887 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc97e313-c5c3-4406-a94f-b927eb479e71,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:25.443534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ec7bf9eb-0ca2-41db-83a4-7c6d41c9f880 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:25.484234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ec7bf9eb-0ca2-41db-83a4-7c6d41c9f880 admin admin] Usage tracker for resource:security_group_rule and tenant:8ea31caab251490eba1d6c469dc944d4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:25.499430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ec7bf9eb-0ca2-41db-83a4-7c6d41c9f880 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:25.511905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ec7bf9eb-0ca2-41db-83a4-7c6d41c9f880 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:25.519198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-999c7aa1-f452-4d4b-ae90-4c4e06eac2b0 None None] Pushing event updated for resources: {'Port': ['ID=f919f925-77db-4728-9eef-3e2fa64aad7e,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:25.597908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-268a20aa-5fdf-4466-bc0f-fff517d1846c req-e7a3081a-ebfa-4617-a876-16ff51025223 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:25.599389 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e26546fc-9f3e-4ca7-afcb-b2364a11f1f9 None None] For port 29a11baf-9c87-46a0-a334-f53971e4f87e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=29a11baf-9c87-46a0-a334-f53971e4f87e,segment=NetworkSegment(103890b0-4adf-45e6-a455-80f1a7bbc58a),segment_id=103890b0-4adf-45e6-a455-80f1a7bbc58a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:31:25.599618 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-268a20aa-5fdf-4466-bc0f-fff517d1846c req-e7a3081a-ebfa-4617-a876-16ff51025223 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 944 time: 0.4428682 May 12 15:31:25.604598 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e26546fc-9f3e-4ca7-afcb-b2364a11f1f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:25.691772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 3b50a8ca-56d5-467e-bd2c-f74e0545d8d4 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:31:25.707222 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c79e7018-149f-4771-8630-cec67dd0a887 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:25.708969 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c79e7018-149f-4771-8630-cec67dd0a887 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fc97e313-c5c3-4406-a94f-b927eb479e71 HTTP/1.1" status: 204 len: 168 time: 2.4455774 May 12 15:31:25.758148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:25.763909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:31:25.765371 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:25.785669 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e26546fc-9f3e-4ca7-afcb-b2364a11f1f9 None None] Pushing event updated for resources: {'Port': ['ID=29a11baf-9c87-46a0-a334-f53971e4f87e,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:25.800184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec7bf9eb-0ca2-41db-83a4-7c6d41c9f880 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:25.823714 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec7bf9eb-0ca2-41db-83a4-7c6d41c9f880 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:25.826364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4d61937e-50c4-4173-aab8-85027e33d963 None None] Provisioning complete for port 29a11baf-9c87-46a0-a334-f53971e4f87e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:25.826500 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4d61937e-50c4-4173-aab8-85027e33d963 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:25.952536 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0d2f092f-25e7-476a-8995-4d0d690ca466 req-2d24fa0d-b7fd-4c40-958e-bf490a79e0ef service neutron] 10.222.0.84 "GET /v2.0/networks/344f73bf-bc85-42f0-91df-13b30d1e9dae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.0280743 May 12 15:31:25.980856 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 18519333-0313-4b0f-92f3-16b15506c1ce details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:31:26.000808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec7bf9eb-0ca2-41db-83a4-7c6d41c9f880 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=76e05344-2316-4daa-b0b0-d1a2406a0854,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:26.025726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05f00f8-5fc7-410a-9fa3-688ca2f8375a req-c2767ffe-4b08-4863-8be8-a0b185a15d6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:26.028225 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d05f00f8-5fc7-410a-9fa3-688ca2f8375a req-c2767ffe-4b08-4863-8be8-a0b185a15d6c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 1095 time: 1.9745445 May 12 15:31:26.324677 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-268a20aa-5fdf-4466-bc0f-fff517d1846c req-a3805e82-0572-4fca-afdf-77966763ac71 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6682875 May 12 15:31:26.430574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=80d6dd70-9523-4225-830b-ff1c4ce69403,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:26.601220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dd3d7fa-0f11-42bb-9032-7ef7acd4804e req-4388d156-92c2-4c8c-9682-c53028e719e6 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:26.610403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5dd3d7fa-0f11-42bb-9032-7ef7acd4804e req-4388d156-92c2-4c8c-9682-c53028e719e6 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 944 time: 1.2074859 May 12 15:31:26.641737 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ec7bf9eb-0ca2-41db-83a4-7c6d41c9f880 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8ea31caab251490eba1d6c469dc944d4&name=default HTTP/1.1" status: 200 len: 2983 time: 1.7295444 May 12 15:31:26.648117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51032) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:26.702599 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:26.710370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 18519333-0313-4b0f-92f3-16b15506c1ce, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=18519333-0313-4b0f-92f3-16b15506c1ce,segment=NetworkSegment(c13c5085-1b93-40b2-949d-70da42f91a88),segment_id=c13c5085-1b93-40b2-949d-70da42f91a88)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:31:26.737984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51038) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:26.743226 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05f00f8-5fc7-410a-9fa3-688ca2f8375a req-4cc7e9ff-359f-430c-9996-32b5bc64b160 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:26.744736 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d05f00f8-5fc7-410a-9fa3-688ca2f8375a req-4cc7e9ff-359f-430c-9996-32b5bc64b160 service neutron] 10.222.0.76 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 916 time: 0.6963744 May 12 15:31:26.759354 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '18519333-0313-4b0f-92f3-16b15506c1ce', 'network_id': '344f73bf-bc85-42f0-91df-13b30d1e9dae', 'port_id': '18519333-0313-4b0f-92f3-16b15506c1ce', 'mac_address': 'fa:16:3e:58:1f:c8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 575, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '82b2bb6a-4dc0-44b3-a673-359e20ac9935', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:31:26.778075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5dd3d7fa-0f11-42bb-9032-7ef7acd4804e req-21b439cc-89ca-4e86-90c3-617eac5679f7 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1663876 May 12 15:31:26.814580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-52c9c1b6-b5aa-4994-82de-012bbbf8ca67 None None] Provisioning for port 80d6dd70-9523-4225-830b-ff1c4ce69403 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:31:26.858443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-52c9c1b6-b5aa-4994-82de-012bbbf8ca67 None None] Provisioning complete for port 80d6dd70-9523-4225-830b-ff1c4ce69403 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:26.858822 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-52c9c1b6-b5aa-4994-82de-012bbbf8ca67 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:26.915261 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b99844a-daf1-48fd-abed-4c89698927c6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:26.978931 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d05f00f8-5fc7-410a-9fa3-688ca2f8375a req-d1f93823-fcaf-4922-b59f-1f3d29d29d1a service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 HTTP/1.1" status: 200 len: 217 time: 0.1813731 May 12 15:31:27.007085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-52c9c1b6-b5aa-4994-82de-012bbbf8ca67 None None] Port 80d6dd70-9523-4225-830b-ff1c4ce69403 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:31:27.007738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4b99844a-daf1-48fd-abed-4c89698927c6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:27.011179 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:27.052587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 18519333-0313-4b0f-92f3-16b15506c1ce {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:31:27.088020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 18519333-0313-4b0f-92f3-16b15506c1ce, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=18519333-0313-4b0f-92f3-16b15506c1ce,segment=NetworkSegment(c13c5085-1b93-40b2-949d-70da42f91a88),segment_id=c13c5085-1b93-40b2-949d-70da42f91a88)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:31:27.092623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:31:27.098443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4b99844a-daf1-48fd-abed-4c89698927c6 admin admin] Usage tracker for resource:security_group_rule and tenant:c33a48f3156345a7910ff11664bc1301 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:27.116420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4b99844a-daf1-48fd-abed-4c89698927c6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:27.161356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4b99844a-daf1-48fd-abed-4c89698927c6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:27.273592 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f53f34a2-11a4-45b9-a22d-2b549c6f5411 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:27.279040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:31:27.288720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05f00f8-5fc7-410a-9fa3-688ca2f8375a req-45fe9485-37eb-4973-81e7-4625a22425b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:27.290556 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d05f00f8-5fc7-410a-9fa3-688ca2f8375a req-45fe9485-37eb-4973-81e7-4625a22425b2 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 HTTP/1.1" status: 200 len: 854 time: 0.3005631 May 12 15:31:27.296136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'port_id': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97', 'mac_address': 'fa:16:3e:b1:e8:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 598, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:31:27.300006 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:27.469366 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f53f34a2-11a4-45b9-a22d-2b549c6f5411 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:27.514952 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=18519333-0313-4b0f-92f3-16b15506c1ce,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:27.567211 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:27.724774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:31:27.734616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05f00f8-5fc7-410a-9fa3-688ca2f8375a req-b1ab0cd8-70a9-4ef4-b6a3-2a9b0857a65a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:27.737438 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d05f00f8-5fc7-410a-9fa3-688ca2f8375a req-b1ab0cd8-70a9-4ef4-b6a3-2a9b0857a65a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=dbecac63-cd00-4ee6-bec1-19abe557d6e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4302068 May 12 15:31:27.749055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:27.750792 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b99844a-daf1-48fd-abed-4c89698927c6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:27.771621 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:31:27.777856 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['18519333-0313-4b0f-92f3-16b15506c1ce'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:31:27.798300 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:27.800212 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:27.828623 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b99844a-daf1-48fd-abed-4c89698927c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:27.977076 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f53f34a2-11a4-45b9-a22d-2b549c6f5411 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:28.016947 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:28.028815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f12ecfc-0a37-422e-a090-c1f217c31419 None None] Network 146af6dc-9539-409e-8ef7-00f5631653c8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:28.035029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4b99844a-daf1-48fd-abed-4c89698927c6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c33a48f3156345a7910ff11664bc1301&name=default HTTP/1.1" status: 200 len: 2983 time: 1.2893019 May 12 15:31:28.039550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51066) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:28.043144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b99844a-daf1-48fd-abed-4c89698927c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9aa9736b-7b8b-4d78-ab1b-793566f9ec12,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:28.088956 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f53f34a2-11a4-45b9-a22d-2b549c6f5411 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:28.090280 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f53f34a2-11a4-45b9-a22d-2b549c6f5411 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/76e05344-2316-4daa-b0b0-d1a2406a0854 HTTP/1.1" status: 204 len: 168 time: 1.4111259 May 12 15:31:28.096356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53f34a2-11a4-45b9-a22d-2b549c6f5411 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=76e05344-2316-4daa-b0b0-d1a2406a0854,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:28.105762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 29a11baf-9c87-46a0-a334-f53971e4f87e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:31:28.134922 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d05f00f8-5fc7-410a-9fa3-688ca2f8375a req-e11775f3-7a61-4f58-be99-fcc3c7c63fc4 service neutron] 10.222.0.76 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3820872 May 12 15:31:28.330076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 3b50a8ca-56d5-467e-bd2c-f74e0545d8d4 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:31:28.336163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:28.343826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=80d6dd70-9523-4225-830b-ff1c4ce69403,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:28.358605 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00ada700-079d-4735-814e-694fd8fc1423 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:28.515913 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00ada700-079d-4735-814e-694fd8fc1423 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:28.623822 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d05f00f8-5fc7-410a-9fa3-688ca2f8375a req-3a037151-1a66-4163-ab27-8206bd9a6ae5 service neutron] 10.222.0.76 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4627566 May 12 15:31:28.739135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00ada700-079d-4735-814e-694fd8fc1423 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:28.760567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['d34a63b6-2dbe-47d1-9d15-9dd7ae780c97'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:31:28.762336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00ada700-079d-4735-814e-694fd8fc1423 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9aa9736b-7b8b-4d78-ab1b-793566f9ec12,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:28.792956 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00ada700-079d-4735-814e-694fd8fc1423 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:28.794188 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-00ada700-079d-4735-814e-694fd8fc1423 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9aa9736b-7b8b-4d78-ab1b-793566f9ec12 HTTP/1.1" status: 204 len: 168 time: 0.7479258 May 12 15:31:28.915355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1581013-3159-4c52-84ab-19b8a1e7792e req-66dc3fb8-8cb5-4249-8f79-df57d5f4ff8a tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:28.916891 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1581013-3159-4c52-84ab-19b8a1e7792e req-66dc3fb8-8cb5-4249-8f79-df57d5f4ff8a tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 945 time: 1.1654549 May 12 15:31:28.942955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1cf5791e-1060-4aaf-a77d-e3c61fec04f0 None None] Provisioning for port f919f925-77db-4728-9eef-3e2fa64aad7e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:31:28.967536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:28.996211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62cb4fe3-d0c4-4d82-82d4-d9dcec1c714e req-a479db3b-4198-4244-9fcc-1c9ed265b5bd tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:28.997772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62cb4fe3-d0c4-4d82-82d4-d9dcec1c714e req-a479db3b-4198-4244-9fcc-1c9ed265b5bd tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 945 time: 0.9825854 May 12 15:31:29.102647 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1581013-3159-4c52-84ab-19b8a1e7792e req-3c6dc937-68fe-402c-8f3d-c09c9e15dab2 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1693547 May 12 15:31:29.119973 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62cb4fe3-d0c4-4d82-82d4-d9dcec1c714e req-d493f63b-2965-47c8-a3b1-3f47c085c171 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1132493 May 12 15:31:29.121411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router e4bb4ff8-e436-42c7-96f8-56f195f2e452 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:31:29.181325 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 29a11baf-9c87-46a0-a334-f53971e4f87e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:29.193944 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:29.527230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2f006b71-f4e1-4094-8926-ddc1bcd6c204 None None] Provisioning complete for port 80d6dd70-9523-4225-830b-ff1c4ce69403 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:29.533323 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2f006b71-f4e1-4094-8926-ddc1bcd6c204 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:29.605145 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:31:29.651559 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c58112b1-4461-411b-931c-d610d3ec70a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/e4bb4ff8-e436-42c7-96f8-56f195f2e452/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.2752552 May 12 15:31:29.655335 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51100) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:29.689689 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a119c24-7bbb-4ae8-8014-4cd1faf2d84d None None] Sync routers for ids ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:31:29.718519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2f006b71-f4e1-4094-8926-ddc1bcd6c204 None None] Port 80d6dd70-9523-4225-830b-ff1c4ce69403 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:31:29.815677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83ad9ed0-ecae-4190-850b-9118d1fb5674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:29.817274 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-83ad9ed0-ecae-4190-850b-9118d1fb5674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports/80d6dd70-9523-4225-830b-ff1c4ce69403 HTTP/1.1" status: 200 len: 911 time: 0.1602516 May 12 15:31:29.820067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51106) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:29.845905 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a119c24-7bbb-4ae8-8014-4cd1faf2d84d None None] Routers {'e4bb4ff8-e436-42c7-96f8-56f195f2e452'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:31:29.846666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4a119c24-7bbb-4ae8-8014-4cd1faf2d84d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:31:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:29.889443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72cac2f7-07e7-43c1-92b9-337b9b37cee6 req-d8a9b6d4-7ea0-418e-9176-e1134722f372 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:29.892895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72cac2f7-07e7-43c1-92b9-337b9b37cee6 req-d8a9b6d4-7ea0-418e-9176-e1134722f372 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 946 time: 0.1665776 May 12 15:31:29.930029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51112) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:29.949989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4a119c24-7bbb-4ae8-8014-4cd1faf2d84d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:29.971806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f919f925-77db-4728-9eef-3e2fa64aad7e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:31:30.023502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a119c24-7bbb-4ae8-8014-4cd1faf2d84d None None] Routers {'e4bb4ff8-e436-42c7-96f8-56f195f2e452'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:31:30.024147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4a119c24-7bbb-4ae8-8014-4cd1faf2d84d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:31:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:30.052510 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72cac2f7-07e7-43c1-92b9-337b9b37cee6 req-e5e5100c-0dda-41e4-80a8-e88efe2c3aa4 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1502187 May 12 15:31:30.149122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-4a119c24-7bbb-4ae8-8014-4cd1faf2d84d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:30.149812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a119c24-7bbb-4ae8-8014-4cd1faf2d84d None None] The sync data for ids ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:31:30.257922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f919f925-77db-4728-9eef-3e2fa64aad7e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:31:30.268101 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f919f925-77db-4728-9eef-3e2fa64aad7e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:30.273999 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:30.380736 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ef661db6-6345-49a8-a2e0-5759c1469fe3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:30.459733 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e3c74f77-e1d8-424d-b2d8-1c6aa0fe3161 None None] Provisioning complete for port f919f925-77db-4728-9eef-3e2fa64aad7e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:30.460098 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e3c74f77-e1d8-424d-b2d8-1c6aa0fe3161 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:30.649088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ef661db6-6345-49a8-a2e0-5759c1469fe3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:30.656380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ef661db6-6345-49a8-a2e0-5759c1469fe3 admin admin] Usage tracker for resource:security_group_rule and tenant:f1434787345842318092fd144415d86c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:30.661218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ef661db6-6345-49a8-a2e0-5759c1469fe3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:30.668785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ef661db6-6345-49a8-a2e0-5759c1469fe3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:30.701743 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:30.833817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2914814-5df8-4f73-b269-2e258774db84 req-e274cabe-c0e4-4b2c-8e95-9a6fa7f7d9ea tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:30.841418 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e2914814-5df8-4f73-b269-2e258774db84 req-e274cabe-c0e4-4b2c-8e95-9a6fa7f7d9ea tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 945 time: 0.4110274 May 12 15:31:30.885897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b42d96ac-476f-4cf1-94e0-79f1d2bea22a req-9a082b91-d08f-4c5c-ae65-e8e34122647c tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:30.887452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b42d96ac-476f-4cf1-94e0-79f1d2bea22a req-9a082b91-d08f-4c5c-ae65-e8e34122647c tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 945 time: 0.4606447 May 12 15:31:30.938489 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e3c74f77-e1d8-424d-b2d8-1c6aa0fe3161 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:30.943448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e2914814-5df8-4f73-b269-2e258774db84 req-ef4b1a97-3271-4276-aebb-3919e8d0c6ab tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1008027 May 12 15:31:30.988749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port f919f925-77db-4728-9eef-3e2fa64aad7e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f919f925-77db-4728-9eef-3e2fa64aad7e,segment=NetworkSegment(5045a395-ccf3-4ecc-8a1b-2fea99b18a46),segment_id=5045a395-ccf3-4ecc-8a1b-2fea99b18a46)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:31:30.990557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b42d96ac-476f-4cf1-94e0-79f1d2bea22a req-acb84b96-aba2-4643-a130-c27f860bbefd tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0953720 May 12 15:31:31.002747 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:31.016804 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ef661db6-6345-49a8-a2e0-5759c1469fe3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:31.023064 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ef661db6-6345-49a8-a2e0-5759c1469fe3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:31.156127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef661db6-6345-49a8-a2e0-5759c1469fe3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d15b0c2d-7681-49a9-b8f6-784c5e2de72a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:31.171818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ef661db6-6345-49a8-a2e0-5759c1469fe3 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f1434787345842318092fd144415d86c&name=default HTTP/1.1" status: 200 len: 2983 time: 1.2320251 May 12 15:31:31.172892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51158) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:31.203348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=f919f925-77db-4728-9eef-3e2fa64aad7e,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:31.216583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:31:31.280796 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c8a781c4-6735-48ba-bd8e-f610a717708e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:31.318026 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c8a781c4-6735-48ba-bd8e-f610a717708e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:31.489058 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-e3c74f77-e1d8-424d-b2d8-1c6aa0fe3161 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:31:31.490309 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-e3c74f77-e1d8-424d-b2d8-1c6aa0fe3161 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:31:31.491762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:31:31.502949 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c8a781c4-6735-48ba-bd8e-f610a717708e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:31.505855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:31.506250 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:31.543044 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:31.583559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8732b667-1a2d-41fa-9ee1-ada316aa92d0 req-c6dd3826-7598-424f-abb5-52caf7cb4ee5 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:31.584585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-8732b667-1a2d-41fa-9ee1-ada316aa92d0 req-c6dd3826-7598-424f-abb5-52caf7cb4ee5 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Synchronizing usage tracker for tenant:e1146a673b454173a1ed844897ff4119 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:31:31.608737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8a781c4-6735-48ba-bd8e-f610a717708e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d15b0c2d-7681-49a9-b8f6-784c5e2de72a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:31.661285 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c8a781c4-6735-48ba-bd8e-f610a717708e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:31.669282 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c8a781c4-6735-48ba-bd8e-f610a717708e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d15b0c2d-7681-49a9-b8f6-784c5e2de72a HTTP/1.1" status: 204 len: 168 time: 0.4934666 May 12 15:31:31.723725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-8732b667-1a2d-41fa-9ee1-ada316aa92d0 req-c6dd3826-7598-424f-abb5-52caf7cb4ee5 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Unset dirty status for tenant:e1146a673b454173a1ed844897ff4119 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:31:31.725317 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8732b667-1a2d-41fa-9ee1-ada316aa92d0 req-c6dd3826-7598-424f-abb5-52caf7cb4ee5 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.76 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 946 time: 0.6203094 May 12 15:31:31.731861 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a471961-436a-4c3c-88a5-7827b3f5c874 req-a1c610d2-b6a8-463f-9b7d-6f82fb11e964 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:31.739558 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a471961-436a-4c3c-88a5-7827b3f5c874 req-a1c610d2-b6a8-463f-9b7d-6f82fb11e964 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 946 time: 0.3374312 May 12 15:31:31.822789 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:31.882104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:31:31.883104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:31:31.889474 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:31.952431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a471961-436a-4c3c-88a5-7827b3f5c874 req-b1c1fe35-0f98-49aa-95e3-6e0d1cbd43ec tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2057815 May 12 15:31:32.053844 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0e132f47-4601-4443-8163-46382c8f4b1e'] response: {'server_uuid': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97', 'code': 200} May 12 15:31:32.054644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 18519333-0313-4b0f-92f3-16b15506c1ce up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:31:32.109306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-8732b667-1a2d-41fa-9ee1-ada316aa92d0 req-2a13ad9a-205a-4e6d-9b18-e2a3f534cd19 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Deleting port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:31:32.115055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8732b667-1a2d-41fa-9ee1-ada316aa92d0 req-2a13ad9a-205a-4e6d-9b18-e2a3f534cd19 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:32.357007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:32.382464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:32.382958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:32.383320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:32.383649 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:32.383979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:32.384303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:32.384613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:32.385818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:32.386212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:32.386585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:32.386881 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:32.387196 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:32.397682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51232) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:32.436473 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:32.459969 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 18519333-0313-4b0f-92f3-16b15506c1ce completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:31:32.474639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 18519333-0313-4b0f-92f3-16b15506c1ce triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:32.475383 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:32.504901 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0baf98e6-6a61-4471-b148-2ceeccf6d162 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:32.627993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51238) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:32.628724 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0baf98e6-6a61-4471-b148-2ceeccf6d162 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:32.641615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2adbdba-d3d9-4404-b44f-08bfe964ed22 req-efe4766f-5249-4a97-8228-ccd8df10fc80 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:32.644067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2adbdba-d3d9-4404-b44f-08bfe964ed22 req-efe4766f-5249-4a97-8228-ccd8df10fc80 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 946 time: 0.3780875 May 12 15:31:32.654040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e58d552-c949-4cf4-b9e4-c34d335bea62 req-c8f1422f-1228-42f6-8521-20c74f50254b tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:32.662713 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7e58d552-c949-4cf4-b9e4-c34d335bea62 req-c8f1422f-1228-42f6-8521-20c74f50254b tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 945 time: 0.4474020 May 12 15:31:32.680978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0baf98e6-6a61-4471-b148-2ceeccf6d162 admin admin] Usage tracker for resource:security_group_rule and tenant:78d549838ff84d38aaf5b161f4b7e13e is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:32.686350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0baf98e6-6a61-4471-b148-2ceeccf6d162 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:32.732733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0baf98e6-6a61-4471-b148-2ceeccf6d162 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:32.772504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b079ebe1-9c7a-4cc1-aee3-f0c79fc080f2 req-67448edd-a9fc-4bcf-9f77-fc34527e8862 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:32.774033 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b079ebe1-9c7a-4cc1-aee3-f0c79fc080f2 req-67448edd-a9fc-4bcf-9f77-fc34527e8862 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 1097 time: 0.5828984 May 12 15:31:32.778860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2adbdba-d3d9-4404-b44f-08bfe964ed22 req-c0d840d3-73a0-42d4-87a4-84be25535443 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0993195 May 12 15:31:32.788384 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7e58d552-c949-4cf4-b9e4-c34d335bea62 req-26537522-98b5-43d8-b63c-98f9e9bd881f tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1247280 May 12 15:31:32.835651 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:32.901945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 18519333-0313-4b0f-92f3-16b15506c1ce, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=18519333-0313-4b0f-92f3-16b15506c1ce,segment=NetworkSegment(c13c5085-1b93-40b2-949d-70da42f91a88),segment_id=c13c5085-1b93-40b2-949d-70da42f91a88)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:31:32.911054 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:32.980547 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8261fc01-5398-4627-a408-b2a3d2c86667 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.007431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=18519333-0313-4b0f-92f3-16b15506c1ce,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:33.063589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51250) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:33.116692 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0baf98e6-6a61-4471-b148-2ceeccf6d162 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.123559 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0baf98e6-6a61-4471-b148-2ceeccf6d162 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.150269 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Allocated IP 2001:db8:1::1 (146af6dc-9539-409e-8ef7-00f5631653c8/b76f650a-c71f-4cfb-8501-a64b78974ec4/4b04d71a-7efa-4e22-bc87-fc79b24fbfb8) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:31:33.163967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f919f925-77db-4728-9eef-3e2fa64aad7e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:31:33.276513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8261fc01-5398-4627-a408-b2a3d2c86667 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:33.287908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0baf98e6-6a61-4471-b148-2ceeccf6d162 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b043efe-9103-46d4-88a8-e6241cc6c576,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:33.322762 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b079ebe1-9c7a-4cc1-aee3-f0c79fc080f2 req-c8e7ce8a-5639-4ee8-8609-833da17543c7 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4275548 May 12 15:31:33.328522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8261fc01-5398-4627-a408-b2a3d2c86667 admin admin] Usage tracker for resource:security_group_rule and tenant:c7b17a0d5a534991b6fc6e297b7325e2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:33.333356 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0baf98e6-6a61-4471-b148-2ceeccf6d162 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=78d549838ff84d38aaf5b161f4b7e13e&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9314687 May 12 15:31:33.335003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51260) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:33.335133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f919f925-77db-4728-9eef-3e2fa64aad7e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:33.335494 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.343079 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5bfe3005-c054-412b-bad9-963169c618d8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.393776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8261fc01-5398-4627-a408-b2a3d2c86667 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:33.408430 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5bfe3005-c054-412b-bad9-963169c618d8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:33.422225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5bfe3005-c054-412b-bad9-963169c618d8 admin admin] Usage tracker for resource:security_group_rule and tenant:94071fac300d4bc4a35f8091e9b866ae is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:33.426947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5bfe3005-c054-412b-bad9-963169c618d8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:33.443525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-130cb134-5459-4121-b6d0-c77e011c5528 req-c8c5fb8e-defd-4240-8ded-db7ade67ca99 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:33.451008 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-130cb134-5459-4121-b6d0-c77e011c5528 req-c8c5fb8e-defd-4240-8ded-db7ade67ca99 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 946 time: 0.2693367 May 12 15:31:33.477106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5bfe3005-c054-412b-bad9-963169c618d8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:33.522188 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-130cb134-5459-4121-b6d0-c77e011c5528 req-febb7e9a-f11f-466d-a939-815ebd6c2fde tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/security-groups?id=0d800eef-262d-4bd5-ac24-4a3700b73a86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700173 May 12 15:31:33.547339 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d38ad5a7-231c-493b-b3a3-545dabbc49d1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.567219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8261fc01-5398-4627-a408-b2a3d2c86667 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:33.580032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-8732b667-1a2d-41fa-9ee1-ada316aa92d0 req-2a13ad9a-205a-4e6d-9b18-e2a3f534cd19 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] For port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b,segment=NetworkSegment(3307f62e-6977-4a8d-852e-31dcfd97c476),segment_id=3307f62e-6977-4a8d-852e-31dcfd97c476)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:31:33.580578 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8732b667-1a2d-41fa-9ee1-ada316aa92d0 req-2a13ad9a-205a-4e6d-9b18-e2a3f534cd19 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.591335 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d38ad5a7-231c-493b-b3a3-545dabbc49d1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.684621 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5bfe3005-c054-412b-bad9-963169c618d8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.697826 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5bfe3005-c054-412b-bad9-963169c618d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.714105 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d38ad5a7-231c-493b-b3a3-545dabbc49d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.735213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-8732b667-1a2d-41fa-9ee1-ada316aa92d0 req-2a13ad9a-205a-4e6d-9b18-e2a3f534cd19 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Calling delete_port for cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:31:33.762155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5bfe3005-c054-412b-bad9-963169c618d8 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=94071fac300d4bc4a35f8091e9b866ae&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6974919 May 12 15:31:33.768922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51268) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:33.769116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bfe3005-c054-412b-bad9-963169c618d8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de25a530-a973-440e-8eeb-da39fbf411e3,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:33.783781 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d38ad5a7-231c-493b-b3a3-545dabbc49d1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.787696 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d38ad5a7-231c-493b-b3a3-545dabbc49d1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1b043efe-9103-46d4-88a8-e6241cc6c576 HTTP/1.1" status: 204 len: 168 time: 0.4491704 May 12 15:31:33.803834 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d38ad5a7-231c-493b-b3a3-545dabbc49d1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b043efe-9103-46d4-88a8-e6241cc6c576,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:33.879047 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-522a7dc7-5bce-4046-b11c-653483edacef admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.909288 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.934064 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-522a7dc7-5bce-4046-b11c-653483edacef admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:33.940786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Transition to ACTIVE for port object 4b04d71a-7efa-4e22-bc87-fc79b24fbfb8 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:31:33.976998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:34.010108 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-522a7dc7-5bce-4046-b11c-653483edacef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:34.054540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9def9006-5a34-482b-a8e8-8de3379c1d5b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '18519333-0313-4b0f-92f3-16b15506c1ce'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:31:34.085711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-522a7dc7-5bce-4046-b11c-653483edacef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de25a530-a973-440e-8eeb-da39fbf411e3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:34.112718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 146af6dc-9539-409e-8ef7-00f5631653c8 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:31:34.121709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:34.126315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:31:34.128924 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:34.246009 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-522a7dc7-5bce-4046-b11c-653483edacef admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:34.248890 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-522a7dc7-5bce-4046-b11c-653483edacef admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/de25a530-a973-440e-8eeb-da39fbf411e3 HTTP/1.1" status: 204 len: 168 time: 0.4690139 May 12 15:31:34.359927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=4b04d71a-7efa-4e22-bc87-fc79b24fbfb8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:34.363608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12f79bd2-fb81-44b1-901d-3084b121acbc req-358df685-16be-4151-a9ef-0a95dcb633ba tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:34.365593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12f79bd2-fb81-44b1-901d-3084b121acbc req-358df685-16be-4151-a9ef-0a95dcb633ba tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 946 time: 0.2627628 May 12 15:31:34.408702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96e39fe1-93e8-44eb-8eea-2093ede1ab74 req-88bab660-c1b5-4d81-97d6-3427e342f6e7 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:34.419962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96e39fe1-93e8-44eb-8eea-2093ede1ab74 req-88bab660-c1b5-4d81-97d6-3427e342f6e7 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 946 time: 0.3855348 May 12 15:31:34.690764 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96e39fe1-93e8-44eb-8eea-2093ede1ab74 req-c8314afc-44b7-4515-b526-4029f0853078 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2367613 May 12 15:31:34.699003 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12f79bd2-fb81-44b1-901d-3084b121acbc req-a42cd4ad-52e9-47e3-9e02-d503b4990d56 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3181665 May 12 15:31:34.715494 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8732b667-1a2d-41fa-9ee1-ada316aa92d0 req-2a13ad9a-205a-4e6d-9b18-e2a3f534cd19 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:34.719700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8261fc01-5398-4627-a408-b2a3d2c86667 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:34.740335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7686c776-d643-4038-9b51-0a29d4eaa16c None None] Provisioning for port 4b04d71a-7efa-4e22-bc87-fc79b24fbfb8 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:31:34.786430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7686c776-d643-4038-9b51-0a29d4eaa16c None None] Provisioning complete for port 4b04d71a-7efa-4e22-bc87-fc79b24fbfb8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:34.786430 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7686c776-d643-4038-9b51-0a29d4eaa16c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:34.837930 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8261fc01-5398-4627-a408-b2a3d2c86667 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:34.859279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a13ad9a-205a-4e6d-9b18-e2a3f534cd19 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Pushing event deleted for resources: {'Port': ['ID=cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:34.923329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-8732b667-1a2d-41fa-9ee1-ada316aa92d0 req-2a13ad9a-205a-4e6d-9b18-e2a3f534cd19 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] No DVR routers for this DVR port cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:31:34.932112 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8732b667-1a2d-41fa-9ee1-ada316aa92d0 req-2a13ad9a-205a-4e6d-9b18-e2a3f534cd19 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:34.988000 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-68bfd799-c67b-41dd-b526-9cb5a764758a'] response: {'server_uuid': '9def9006-5a34-482b-a8e8-8de3379c1d5b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '18519333-0313-4b0f-92f3-16b15506c1ce', 'code': 200} May 12 15:31:34.995790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '134b4b36-e12c-4748-ab4f-3da58290fc83', 'name': 'network-vif-deleted', 'tag': 'cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:31:35.007855 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8732b667-1a2d-41fa-9ee1-ada316aa92d0 req-2a13ad9a-205a-4e6d-9b18-e2a3f534cd19 tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.76 "DELETE /v2.0/ports/cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b HTTP/1.1" status: 204 len: 173 time: 3.2535987 May 12 15:31:35.041833 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-7686c776-d643-4038-9b51-0a29d4eaa16c None None] Port 4b04d71a-7efa-4e22-bc87-fc79b24fbfb8 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:31:35.067719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51324) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:35.068039 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8261fc01-5398-4627-a408-b2a3d2c86667 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c7b17a0d5a534991b6fc6e297b7325e2&name=default HTTP/1.1" status: 200 len: 2983 time: 2.4344919 May 12 15:31:35.077582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8261fc01-5398-4627-a408-b2a3d2c86667 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64d49bb3-8fb4-4f75-a83d-14e922c4fb75,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:35.128967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:31:35.130570 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:35.178416 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f6e0dc0b-59a6-4ade-a916-7c9f9d20f67f'] response: {'server_uuid': '134b4b36-e12c-4748-ab4f-3da58290fc83', 'name': 'network-vif-deleted', 'tag': 'cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b', 'status': 'completed', 'code': 200} May 12 15:31:35.227060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2aae5c7-5fad-4b9e-9172-b1908af4752d req-0a70c223-67d6-4fba-873b-26a473ffbb6f tempest-VolumesSnapshotTestJSON-249010609 tempest-VolumesSnapshotTestJSON-249010609-project] 10.222.0.82 "GET /v2.0/ports?device_id=134b4b36-e12c-4748-ab4f-3da58290fc83 HTTP/1.1" status: 200 len: 210 time: 0.1179507 May 12 15:31:35.238066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:31:35.238775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device cb46cb29-1f19-4f5a-b0ad-2f6a5ced884b not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:31:35.323020 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6c57e8cd-6987-4ad0-811e-6827f5f0b49c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:35.377288 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6c57e8cd-6987-4ad0-811e-6827f5f0b49c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:35.505530 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6c57e8cd-6987-4ad0-811e-6827f5f0b49c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:35.578849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c57e8cd-6987-4ad0-811e-6827f5f0b49c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64d49bb3-8fb4-4f75-a83d-14e922c4fb75,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:35.585226 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6c57e8cd-6987-4ad0-811e-6827f5f0b49c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:35.590480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6c57e8cd-6987-4ad0-811e-6827f5f0b49c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/64d49bb3-8fb4-4f75-a83d-14e922c4fb75 HTTP/1.1" status: 204 len: 168 time: 0.5171633 May 12 15:31:35.619321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ae3c4ce-cc11-4e88-a536-f9128848ba6f req-c7a6e9f2-6058-429b-adee-ed4ceaa4c2b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:35.620809 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ae3c4ce-cc11-4e88-a536-f9128848ba6f req-c7a6e9f2-6058-429b-adee-ed4ceaa4c2b0 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 1097 time: 0.4391885 May 12 15:31:35.777114 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ae3c4ce-cc11-4e88-a536-f9128848ba6f req-b7c12fe1-990c-44e6-a6b2-14225dd3edcf service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1455750 May 12 15:31:36.008283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:36.020486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:36.029166 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:36.349495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a1c122d-0361-4afe-9155-34701e1ff4a6 req-48d883c0-ee50-4288-85c1-b58b309eb07e tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:36.351561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a1c122d-0361-4afe-9155-34701e1ff4a6 req-48d883c0-ee50-4288-85c1-b58b309eb07e tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 946 time: 0.3223481 May 12 15:31:36.391221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19159105-b4bf-43aa-b453-c76ddcdd745f req-75d80ee3-e370-44c7-b395-ee3d731049a4 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:36.400899 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19159105-b4bf-43aa-b453-c76ddcdd745f req-75d80ee3-e370-44c7-b395-ee3d731049a4 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 946 time: 0.2564812 May 12 15:31:36.451796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=4b04d71a-7efa-4e22-bc87-fc79b24fbfb8,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:36.480693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a1c122d-0361-4afe-9155-34701e1ff4a6 req-5c909d09-93c5-48f3-8897-435129fa301b tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1225376 May 12 15:31:36.499584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19159105-b4bf-43aa-b453-c76ddcdd745f req-2946b6c9-6c43-464f-85d1-a5a232f90eec tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0973237 May 12 15:31:36.531727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 146af6dc-9539-409e-8ef7-00f5631653c8 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:31:36.533997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:36.824240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router e4bb4ff8-e436-42c7-96f8-56f195f2e452 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:31:36.945746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51392) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:37.029368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-95150116-4217-4fed-87fd-123b3b798a5f None None] Provisioning complete for port 4b04d71a-7efa-4e22-bc87-fc79b24fbfb8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:37.031198 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-95150116-4217-4fed-87fd-123b3b798a5f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:37.098334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-661b0a03-eec9-4ac5-b2eb-a40103f6b182 req-8ec389d6-be72-4df2-8600-e71f2620167d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:37.105583 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-661b0a03-eec9-4ac5-b2eb-a40103f6b182 req-8ec389d6-be72-4df2-8600-e71f2620167d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 946 time: 0.3653574 May 12 15:31:37.116863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51400) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:37.122504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6118e9c7-9efe-4904-8f94-c1a75179a90d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'floatingip': {'port_id': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:37.204130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-95150116-4217-4fed-87fd-123b3b798a5f None None] Port 4b04d71a-7efa-4e22-bc87-fc79b24fbfb8 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:31:37.261730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:31:37.273150 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7c1edc8-4f44-4c79-b178-7d1139b41066 None None] Sync routers for ids ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:31:37.279337 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4e87dbe6-2c93-49d7-9712-cbee97dbee69 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/e4bb4ff8-e436-42c7-96f8-56f195f2e452/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.4574194 May 12 15:31:37.281629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51408) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:37.293769 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7c1edc8-4f44-4c79-b178-7d1139b41066 None None] Routers {'e4bb4ff8-e436-42c7-96f8-56f195f2e452'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:31:37.312915 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6118e9c7-9efe-4904-8f94-c1a75179a90d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:37.318081 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d7c1edc8-4f44-4c79-b178-7d1139b41066 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:31:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:37.450121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d2efa84e-cdae-416a-b1ca-096a22e7d215 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:37.450759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d2efa84e-cdae-416a-b1ca-096a22e7d215 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Synchronizing usage tracker for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:31:37.481232 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d7c1edc8-4f44-4c79-b178-7d1139b41066 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:37.509367 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7c1edc8-4f44-4c79-b178-7d1139b41066 None None] Routers {'e4bb4ff8-e436-42c7-96f8-56f195f2e452'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:31:37.513447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d2efa84e-cdae-416a-b1ca-096a22e7d215 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Unset dirty status for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:31:37.513702 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d7c1edc8-4f44-4c79-b178-7d1139b41066 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:31:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:37.514373 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d2efa84e-cdae-416a-b1ca-096a22e7d215 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports/4b04d71a-7efa-4e22-bc87-fc79b24fbfb8 HTTP/1.1" status: 200 len: 913 time: 0.2280691 May 12 15:31:37.515232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51424) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:37.663992 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d7c1edc8-4f44-4c79-b178-7d1139b41066 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:37.664623 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7c1edc8-4f44-4c79-b178-7d1139b41066 None None] The sync data for ids ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:31:37.977850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-596588003'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:38.045777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:38.092535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Usage tracker for resource:network and tenant:25fa20f86c7841ef87df4011e75435d0 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:38.101903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:38.257254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51446) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:38.477696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:38.524503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Made reservation on behalf of 25fa20f86c7841ef87df4011e75435d0 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:38.528898 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:38.563493 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:38.573012 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-436750c1-6f49-48f3-9674-22b258d23b5b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:38.603922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71480baf-4208-4d91-b3b7-0289edf35fb1 req-659d06db-fd5e-4c8b-b432-205c1d089063 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:38.605594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71480baf-4208-4d91-b3b7-0289edf35fb1 req-659d06db-fd5e-4c8b-b432-205c1d089063 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 946 time: 0.7164397 May 12 15:31:38.847168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:38.860605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Request body: {'network': {'name': 'tempest-ExternalNetworksTestJSON-test-network-55438113'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:38.860746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Usage tracker for resource:security_group_rule and tenant:25fa20f86c7841ef87df4011e75435d0 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:38.868078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:38.870903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:38.876087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Usage tracker for resource:network and tenant:13bfac9f40134d1094df0bd7216b72a3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:38.880661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:38.881481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:38.891623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:39.015738 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.040415 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.100425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Pushing event updated for resources: {'SecurityGroup': ['ID=35491fa3-ab65-4b9b-8269-270c1d660a7d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:39.116446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Made reservation on behalf of 13bfac9f40134d1094df0bd7216b72a3 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:39.119956 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.148296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71480baf-4208-4d91-b3b7-0289edf35fb1 req-58ba18b8-d859-4f90-be42-2525618d3c99 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3351207 May 12 15:31:39.149060 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 590} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:31:39.163338 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.173562 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.174174 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Added segment fb35d0af-7190-42e6-a36f-ad8855fc0de2 of type vlan for network e3da6ceb-9da7-4883-ab26-4b1a93fc9293 May 12 15:31:39.193427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:39.198440 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Usage tracker for resource:security_group_rule and tenant:13bfac9f40134d1094df0bd7216b72a3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:39.202022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:39.208073 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:39.296682 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.302656 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.315603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 560} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:31:39.325959 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.326641 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Added segment de6c73a0-89d7-42fc-abfc-b076ed6e6245 of type vlan for network 87e6b451-eaee-481c-8d53-cea1d91c1b1a May 12 15:31:39.354622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.356588 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6118e9c7-9efe-4904-8f94-c1a75179a90d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.367415 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6118e9c7-9efe-4904-8f94-c1a75179a90d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.396010 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.401754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:39.402576 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.450580 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.586729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c6589b9e-01c0-4e7b-b377-629aafcd0ddb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:39.595773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Pushing event updated for resources: {'Network': ['ID=87e6b451-eaee-481c-8d53-cea1d91c1b1a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:39.607010 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ee74633d-8d43-4f6f-8bb5-5247faab3e14 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 1.3484237 May 12 15:31:39.649959 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 87e6b451-eaee-481c-8d53-cea1d91c1b1a details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:31:39.658230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51490) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:39.681198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-436750c1-6f49-48f3-9674-22b258d23b5b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port 4b04d71a-7efa-4e22-bc87-fc79b24fbfb8 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:31:39.681586 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-436750c1-6f49-48f3-9674-22b258d23b5b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.812642 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-6118e9c7-9efe-4904-8f94-c1a75179a90d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Floating IP 9fbfd049-9e42-4bf4-bede-947490c8e40d associated. External IP: 172.25.8.17, port: d34a63b6-2dbe-47d1-9d15-9dd7ae780c97. May 12 15:31:39.936831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:39.946905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:39.950446 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:40.075616 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 3.1247959 May 12 15:31:40.080460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51532) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:40.115568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Request body: {'subnet': {'network_id': 'e3da6ceb-9da7-4883-ab26-4b1a93fc9293', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:40.176975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Request body: {'network': {'name': 'tempest-network--500975542', 'router:external': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:40.208493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:40.245514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Usage tracker for resource:network and tenant:cf9709fca9b64338a050eef7c36e0c1d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:40.309202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:40.324938 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b65caf3f-d7e4-485b-a933-257e27573a2b tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Pushing event updated for resources: {'Network': ['ID=e3da6ceb-9da7-4883-ab26-4b1a93fc9293,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:40.327977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:40.346858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network e3da6ceb-9da7-4883-ab26-4b1a93fc9293 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:31:40.403070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Made reservation on behalf of cf9709fca9b64338a050eef7c36e0c1d for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:40.406216 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:40.445040 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:40.484993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-436750c1-6f49-48f3-9674-22b258d23b5b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:40.522549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:40.533272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Usage tracker for resource:security_group_rule and tenant:cf9709fca9b64338a050eef7c36e0c1d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:40.537578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:40.543819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:40.644518 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:40.652382 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:40.775483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 592} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:31:40.805437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ef1bdf9-dcdf-459e-88a1-353da4f98ddd,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:40.858247 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:40.858660 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Added segment 20006058-678f-43cd-9d65-0410ff9ee42d of type vlan for network 3ef030b8-de22-4597-910f-c45a0115cbbc May 12 15:31:40.973446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:40.976470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51558) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:40.983756 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-436750c1-6f49-48f3-9674-22b258d23b5b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for 4b04d71a-7efa-4e22-bc87-fc79b24fbfb8 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:31:41.014575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:41.030493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6118e9c7-9efe-4904-8f94-c1a75179a90d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:31:41.057059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ec7fa34-e644-4a8f-beea-509c15527488 req-5f85b72c-09a5-43b6-a421-c10599ff4163 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:41.058592 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ec7fa34-e644-4a8f-beea-509c15527488 req-5f85b72c-09a5-43b6-a421-c10599ff4163 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 946 time: 0.2543371 May 12 15:31:41.065132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Usage tracker for resource:subnet and tenant:25fa20f86c7841ef87df4011e75435d0 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:41.090014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:41.119053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:41.173705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Made reservation on behalf of 25fa20f86c7841ef87df4011e75435d0 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:41.177305 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:41.414996 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ec7fa34-e644-4a8f-beea-509c15527488 req-960be4de-b13b-4c42-b4c5-9d2c59702ccc tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2994542 May 12 15:31:41.453609 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-676de0da-1158-4bd6-abbc-9356fb9a4ba7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:41.478357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-676de0da-1158-4bd6-abbc-9356fb9a4ba7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:41.484110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-676de0da-1158-4bd6-abbc-9356fb9a4ba7 admin admin] Usage tracker for resource:security_group_rule and tenant:0c7f95c7f05b4accaaba4fd6fdf2263e is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:41.488021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-676de0da-1158-4bd6-abbc-9356fb9a4ba7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:41.494990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-676de0da-1158-4bd6-abbc-9356fb9a4ba7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:41.507276 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:41.508497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:41.509085 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:41.680767 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-436750c1-6f49-48f3-9674-22b258d23b5b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:41.760644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-436750c1-6f49-48f3-9674-22b258d23b5b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=4b04d71a-7efa-4e22-bc87-fc79b24fbfb8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:41.791361 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 862 time: 2.1297953 May 12 15:31:41.795166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51580) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:41.807184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6118e9c7-9efe-4904-8f94-c1a75179a90d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:31:41.808723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be35387b-95f8-4fc6-b642-8c1ec5b5d75c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event updated for resources: {'Network': ['ID=3ef030b8-de22-4597-910f-c45a0115cbbc,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:41.827229 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6118e9c7-9efe-4904-8f94-c1a75179a90d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:41.829375 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c1f6cf6-0445-40a9-8fe0-c0bba12fb015 None None] Sync routers for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:31:41.829982 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:41.834947 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 3ef030b8-de22-4597-910f-c45a0115cbbc details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:31:41.980104 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6118e9c7-9efe-4904-8f94-c1a75179a90d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "PUT /v2.0/floatingips/9fbfd049-9e42-4bf4-bede-947490c8e40d HTTP/1.1" status: 200 len: 991 time: 4.8601296 May 12 15:31:41.981483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'tag': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:31:41.988191 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-676de0da-1158-4bd6-abbc-9356fb9a4ba7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:41.993022 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-676de0da-1158-4bd6-abbc-9356fb9a4ba7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:42.091162 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-676de0da-1158-4bd6-abbc-9356fb9a4ba7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0c7f95c7f05b4accaaba4fd6fdf2263e&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1101058 May 12 15:31:42.092340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-676de0da-1158-4bd6-abbc-9356fb9a4ba7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f51aad4-13c9-49ad-ab85-289e5eb043e0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:42.095438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51590) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:42.112290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c1f6cf6-0445-40a9-8fe0-c0bba12fb015 None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:31:42.113852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-2c1f6cf6-0445-40a9-8fe0-c0bba12fb015 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:31:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:42.208653 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-920b9ee0-84b2-4861-9a69-52c8ff715483 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:42.325198 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-920b9ee0-84b2-4861-9a69-52c8ff715483 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:42.424277 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7db99405-6546-49b8-91fd-e19b0611a1c5'] response: {'name': 'network-changed', 'server_uuid': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'tag': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97', 'status': 'completed', 'code': 200} May 12 15:31:42.451205 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-920b9ee0-84b2-4861-9a69-52c8ff715483 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:42.471268 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-920b9ee0-84b2-4861-9a69-52c8ff715483 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:42.472486 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-920b9ee0-84b2-4861-9a69-52c8ff715483 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2f51aad4-13c9-49ad-ab85-289e5eb043e0 HTTP/1.1" status: 204 len: 168 time: 0.3756137 May 12 15:31:42.473887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-920b9ee0-84b2-4861-9a69-52c8ff715483 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f51aad4-13c9-49ad-ab85-289e5eb043e0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:42.510726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-2c1f6cf6-0445-40a9-8fe0-c0bba12fb015 None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:31:42.905370 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:31:42.965987 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6586b5c3-598f-4933-9827-4539d5c6fe8c req-686b8c8d-9cbb-4427-a2f4-e40aa8ff2d84 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:42.967692 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6586b5c3-598f-4933-9827-4539d5c6fe8c req-686b8c8d-9cbb-4427-a2f4-e40aa8ff2d84 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 946 time: 0.2194612 May 12 15:31:43.061562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6586b5c3-598f-4933-9827-4539d5c6fe8c req-17a7bb81-90ff-484f-aa75-29b5b77c1232 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0854805 May 12 15:31:43.082802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Pushing event updated for resources: {'Subnet': ['ID=1b1054bd-b6bb-4c4f-abbe-dd51d2b96ff3,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:43.117216 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28f3419e-1d31-4a09-874d-bd7474502dde tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:43.134611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Checking segment: {'id': 'fb35d0af-7190-42e6-a36f-ad8855fc0de2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': 'e3da6ceb-9da7-4883-ab26-4b1a93fc9293'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:31:43.135202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Network hostable DHCP agents. Network: e3da6ceb-9da7-4883-ab26-4b1a93fc9293, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:31:43.137181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51612) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:43.151091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-436750c1-6f49-48f3-9674-22b258d23b5b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:43.156033 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5f221f65-cd60-44ff-a3d1-0fc95ee47be0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:43.173681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5f221f65-cd60-44ff-a3d1-0fc95ee47be0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:43.178324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5f221f65-cd60-44ff-a3d1-0fc95ee47be0 admin admin] Usage tracker for resource:security_group_rule and tenant:87799a8b75b343b2bb57750ec7b52d68 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:43.179883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-139f8c76-14d4-46bd-b061-a51a5d733173 req-72e94d67-9385-47dd-b7c7-6b6a3d81051c tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:43.180738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-139f8c76-14d4-46bd-b061-a51a5d733173 req-72e94d67-9385-47dd-b7c7-6b6a3d81051c tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Synchronizing usage tracker for tenant:eae7db4d964e4147a5dadb670fa36326 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:31:43.181829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5f221f65-cd60-44ff-a3d1-0fc95ee47be0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:43.191401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5f221f65-cd60-44ff-a3d1-0fc95ee47be0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:43.275530 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:43.287215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4f933d4-ac36-4c7f-a792-edab308d92bd req-f83dacfe-8a84-42ba-94d5-577a1791bd38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:43.289271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4f933d4-ac36-4c7f-a792-edab308d92bd req-f83dacfe-8a84-42ba-94d5-577a1791bd38 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 1097 time: 0.7264454 May 12 15:31:43.305490 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5f221f65-cd60-44ff-a3d1-0fc95ee47be0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:43.310675 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5f221f65-cd60-44ff-a3d1-0fc95ee47be0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:43.327066 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6b823e17-9c55-4aab-9d81-0cdd63ced3de None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:43.386334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-139f8c76-14d4-46bd-b061-a51a5d733173 req-72e94d67-9385-47dd-b7c7-6b6a3d81051c tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Unset dirty status for tenant:eae7db4d964e4147a5dadb670fa36326 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:31:43.387446 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-139f8c76-14d4-46bd-b061-a51a5d733173 req-72e94d67-9385-47dd-b7c7-6b6a3d81051c tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.84 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 946 time: 0.9608982 May 12 15:31:43.390251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-2c1f6cf6-0445-40a9-8fe0-c0bba12fb015 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '9fbfd049-9e42-4bf4-bede-947490c8e40d', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.17', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 2310, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:b1:e8:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:31:06Z', 'updated_at': '2022-05-12T15:31:39Z', 'revision_number': 1, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:43.392813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f221f65-cd60-44ff-a3d1-0fc95ee47be0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c029a06-3181-4b79-a821-bf3bc50b9a0f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:43.396483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c1f6cf6-0445-40a9-8fe0-c0bba12fb015 None None] Checking router: 616c45f4-38af-4ff7-8fb7-f1c61b204b6a for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:31:43.413179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c1f6cf6-0445-40a9-8fe0-c0bba12fb015 None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:31:43.413860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-2c1f6cf6-0445-40a9-8fe0-c0bba12fb015 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:31:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:43.428351 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5f221f65-cd60-44ff-a3d1-0fc95ee47be0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=87799a8b75b343b2bb57750ec7b52d68&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2874782 May 12 15:31:43.428794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51622) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:43.504480 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4d3fdd89-0475-4e60-8589-edb9eda2fcdd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:43.536983 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4d3fdd89-0475-4e60-8589-edb9eda2fcdd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:43.605514 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4d3fdd89-0475-4e60-8589-edb9eda2fcdd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:43.618524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Network e3da6ceb-9da7-4883-ab26-4b1a93fc9293 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:31:43.633352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d3fdd89-0475-4e60-8589-edb9eda2fcdd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c029a06-3181-4b79-a821-bf3bc50b9a0f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:43.637992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4d3fdd89-0475-4e60-8589-edb9eda2fcdd admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:43.639303 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4d3fdd89-0475-4e60-8589-edb9eda2fcdd admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3c029a06-3181-4b79-a821-bf3bc50b9a0f HTTP/1.1" status: 204 len: 168 time: 0.2093792 May 12 15:31:43.689869 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-2c1f6cf6-0445-40a9-8fe0-c0bba12fb015 None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:31:43.748650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, e3da6ceb-9da7-4883-ab26-4b1a93fc9293) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:43.764456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0982f0f3-ff8d-4850-b284-35b4b720f7de None None] Network e3da6ceb-9da7-4883-ab26-4b1a93fc9293 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:43.768105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-139f8c76-14d4-46bd-b061-a51a5d733173 req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Deleting port 18519333-0313-4b0f-92f3-16b15506c1ce {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:31:43.768454 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-139f8c76-14d4-46bd-b061-a51a5d733173 req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:43.806401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:43.806988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:43.906705 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28f3419e-1d31-4a09-874d-bd7474502dde tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:44.018695 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e7247a67-d677-4acb-b272-9ab863cee7b9 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 3.9319470 May 12 15:31:44.023210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51642) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:44.031575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Request body: {'port': {'network_id': 'e3da6ceb-9da7-4883-ab26-4b1a93fc9293', 'name': 'tempest-DHCPAgentSchedulersTestJSON-1298946551'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:44.337963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-28f3419e-1d31-4a09-874d-bd7474502dde tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3ef030b8-de22-4597-910f-c45a0115cbbc']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:44.351950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-e3da6ceb-9da7-4883-ab26-4b1a93fc9293', 'network_id': 'e3da6ceb-9da7-4883-ab26-4b1a93fc9293', 'tenant_id': '25fa20f86c7841ef87df4011e75435d0', 'fixed_ips': [{'subnet_id': '1b1054bd-b6bb-4c4f-abbe-dd51d2b96ff3'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:31:44.352781 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:44.396648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4f933d4-ac36-4c7f-a792-edab308d92bd req-7bb7007f-4882-4960-81e9-ecf18d970d30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:44.396648 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4f933d4-ac36-4c7f-a792-edab308d92bd req-7bb7007f-4882-4960-81e9-ecf18d970d30 service neutron] 10.222.0.76 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 916 time: 1.0797246 May 12 15:31:44.413128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-28f3419e-1d31-4a09-874d-bd7474502dde tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '20006058-678f-43cd-9d65-0410ff9ee42d') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:44.413617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-28f3419e-1d31-4a09-874d-bd7474502dde tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '20006058-678f-43cd-9d65-0410ff9ee42d') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:44.444922 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28f3419e-1d31-4a09-874d-bd7474502dde tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:44.459041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:44.464616 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Usage tracker for resource:port and tenant:25fa20f86c7841ef87df4011e75435d0 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:44.494646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:44.498025 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28f3419e-1d31-4a09-874d-bd7474502dde tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:44.506187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:44.522713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-28f3419e-1d31-4a09-874d-bd7474502dde tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Releasing vlan 592 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:31:44.522956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c3823c-aec6-44b8-ad30-bf70081543e1 req-917a27fe-2e0c-4fdb-a255-0cf37e6722ac tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:44.524058 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28f3419e-1d31-4a09-874d-bd7474502dde tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:44.530317 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0c3823c-aec6-44b8-ad30-bf70081543e1 req-917a27fe-2e0c-4fdb-a255-0cf37e6722ac tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 946 time: 0.2639892 May 12 15:31:44.551074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Made reservation on behalf of 25fa20f86c7841ef87df4011e75435d0 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:44.554939 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:44.596478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] device_id is not set on port 57a83f63-0bb8-4c97-b822-7dff75a6c61a yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:31:44.648008 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0c3823c-aec6-44b8-ad30-bf70081543e1 req-2e6bf77c-2735-43d4-b880-a7d6025dfb80 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1138651 May 12 15:31:44.839425 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c91fd6d0-d630-4ac0-91aa-77f5d76a8306 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:44.850475 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-2c1f6cf6-0445-40a9-8fe0-c0bba12fb015 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '9fbfd049-9e42-4bf4-bede-947490c8e40d', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.17', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 2310, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:b1:e8:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:31:06Z', 'updated_at': '2022-05-12T15:31:39Z', 'revision_number': 1, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:44.866230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c1f6cf6-0445-40a9-8fe0-c0bba12fb015 None None] The sync data for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 is: [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '9fbfd049-9e42-4bf4-bede-947490c8e40d', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.17', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 2310, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:b1:e8:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:31:06Z', 'updated_at': '2022-05-12T15:31:39Z', 'revision_number': 1, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:31:44.901628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Allocated IP 172.20.0.2 (e3da6ceb-9da7-4883-ab26-4b1a93fc9293/1b1054bd-b6bb-4c4f-abbe-dd51d2b96ff3/57a83f63-0bb8-4c97-b822-7dff75a6c61a) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: timer() May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:31:44.973753 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:31:45.114035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28f3419e-1d31-4a09-874d-bd7474502dde tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:45.119398 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4f933d4-ac36-4c7f-a792-edab308d92bd req-adb4240b-8e0d-42d1-b67e-502956d29398 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 HTTP/1.1" status: 200 len: 999 time: 0.4422362 May 12 15:31:45.201507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-436750c1-6f49-48f3-9674-22b258d23b5b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router e4bb4ff8-e436-42c7-96f8-56f195f2e452 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:31:45.203157 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28f3419e-1d31-4a09-874d-bd7474502dde tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 3ef030b8-de22-4597-910f-c45a0115cbbc {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:124}} May 12 15:31:45.366220 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:45.372197 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28f3419e-1d31-4a09-874d-bd7474502dde tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:45.410782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Transition to ACTIVE for port object 57a83f63-0bb8-4c97-b822-7dff75a6c61a will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:31:45.423730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51688) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:45.432104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Request body: {'network': {'router:external': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:45.432867 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-28f3419e-1d31-4a09-874d-bd7474502dde tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "DELETE /v2.0/networks/3ef030b8-de22-4597-910f-c45a0115cbbc HTTP/1.1" status: 204 len: 168 time: 3.6304247 May 12 15:31:45.446193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:45.452997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28f3419e-1d31-4a09-874d-bd7474502dde tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event deleted for resources: {'Network': ['ID=3ef030b8-de22-4597-910f-c45a0115cbbc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:45.454475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Usage tracker for resource:network and tenant:cf9709fca9b64338a050eef7c36e0c1d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:45.460298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:45.471381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:45.481417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4f933d4-ac36-4c7f-a792-edab308d92bd req-50781f5a-a2ec-462e-bdb8-4d2abce08af4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:45.488144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4f933d4-ac36-4c7f-a792-edab308d92bd req-50781f5a-a2ec-462e-bdb8-4d2abce08af4 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 HTTP/1.1" status: 200 len: 854 time: 0.2552984 May 12 15:31:45.505650 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Made reservation on behalf of cf9709fca9b64338a050eef7c36e0c1d for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:45.515952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:45.550166 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:45.681327 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Retry wrapper got retriable exception: Failed to create a duplicate IpamAllocation: for attribute(s) ['ipamallocations.PRIMARY'] with value(s) 172.20.0.2-1949b62c-2585-43c2-9f6a-a6a15c387733 {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:31:45.681848 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:31:45.737291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Pushing event updated for resources: {'Port': ['ID=57a83f63-0bb8-4c97-b822-7dff75a6c61a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:45.774855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Network e3da6ceb-9da7-4883-ab26-4b1a93fc9293 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:31:45.776953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:45.793990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:31:45.976499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-436750c1-6f49-48f3-9674-22b258d23b5b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:31:45.977123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:45.977788 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:46.000252 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-436750c1-6f49-48f3-9674-22b258d23b5b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/e4bb4ff8-e436-42c7-96f8-56f195f2e452/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.4823620 May 12 15:31:46.010418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51728) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:46.013099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 595} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:31:46.047760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 18519333-0313-4b0f-92f3-16b15506c1ce no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:31:46.055732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-139f8c76-14d4-46bd-b061-a51a5d733173 req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] For port 18519333-0313-4b0f-92f3-16b15506c1ce, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=18519333-0313-4b0f-92f3-16b15506c1ce,segment=NetworkSegment(c13c5085-1b93-40b2-949d-70da42f91a88),segment_id=c13c5085-1b93-40b2-949d-70da42f91a88)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:31:46.056271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-139f8c76-14d4-46bd-b061-a51a5d733173 req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:46.153161 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:46.157683 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ba119c7-ae90-433f-a636-b3f754a89ade None None] New status for floating IP 9fbfd049-9e42-4bf4-bede-947490c8e40d: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:31:46.185617 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:46.197794 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08500eb4-d2b0-48ca-9375-735bb023b70c None None] Sync routers for ids ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:31:46.224587 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:46.231391 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08500eb4-d2b0-48ca-9375-735bb023b70c None None] Routers {'e4bb4ff8-e436-42c7-96f8-56f195f2e452'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:31:46.232547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-08500eb4-d2b0-48ca-9375-735bb023b70c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:31:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:46.425799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-08500eb4-d2b0-48ca-9375-735bb023b70c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:46.443317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4f933d4-ac36-4c7f-a792-edab308d92bd req-cb9028ca-d933-4e82-96ee-5d57073f45f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:46.444832 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4f933d4-ac36-4c7f-a792-edab308d92bd req-cb9028ca-d933-4e82-96ee-5d57073f45f7 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=dbecac63-cd00-4ee6-bec1-19abe557d6e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.9422886 May 12 15:31:46.488517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-139f8c76-14d4-46bd-b061-a51a5d733173 req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Calling delete_port for 18519333-0313-4b0f-92f3-16b15506c1ce owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:31:46.568002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08500eb4-d2b0-48ca-9375-735bb023b70c None None] Routers {'e4bb4ff8-e436-42c7-96f8-56f195f2e452'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:31:46.580369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-08500eb4-d2b0-48ca-9375-735bb023b70c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:31:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:46.620401 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-042bee7c-efd7-4085-bace-dc0f85c928e0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.5965719 May 12 15:31:46.637511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51784) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:46.750407 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:46.964035 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:46.964378 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Added segment 6a921987-3605-4165-a89e-ca3828bb55dd of type vlan for network 4ef5840a-d85d-424f-b8d0-f4d47b4b85f4 May 12 15:31:47.009954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-08500eb4-d2b0-48ca-9375-735bb023b70c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:47.010929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08500eb4-d2b0-48ca-9375-735bb023b70c None None] The sync data for ids ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:31:47.107781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Allocated IP 172.20.0.3 (e3da6ceb-9da7-4883-ab26-4b1a93fc9293/1b1054bd-b6bb-4c4f-abbe-dd51d2b96ff3/76c5a47a-b828-4b35-80f5-6695cf372d4d) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:31:47.137013 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:47.154707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b36a468e-c6d6-4cb0-9fa4-2be89c5907ff tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Deleting port 57a83f63-0bb8-4c97-b822-7dff75a6c61a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:31:47.154967 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b36a468e-c6d6-4cb0-9fa4-2be89c5907ff tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:47.194113 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-139f8c76-14d4-46bd-b061-a51a5d733173 req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:47.219989 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:47.221095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:47.221979 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:47.452241 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 836 time: 2.0267584 May 12 15:31:47.452674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51812) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:47.472797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Pushing event deleted for resources: {'Port': ['ID=18519333-0313-4b0f-92f3-16b15506c1ce,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:47.538912 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:47.539220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3ad0de4-6802-47f6-9a66-f6fe5329218b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event updated for resources: {'Network': ['ID=4ef5840a-d85d-424f-b8d0-f4d47b4b85f4,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:47.539675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:47.540170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:47.540694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:47.541786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:47.542552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:47.543244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:47.543752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:47.544240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:47.544723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:47.545202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:47.545757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:47.557737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 4ef5840a-d85d-424f-b8d0-f4d47b4b85f4 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:31:47.562956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79a97d71-94df-42a5-af57-d3c51304f10d req-da00a391-9bfa-402b-b9cf-af26823032a1 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:47.565355 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-79a97d71-94df-42a5-af57-d3c51304f10d req-da00a391-9bfa-402b-b9cf-af26823032a1 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 946 time: 1.5965962 May 12 15:31:47.565698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Request body: {'subnet': {'network_id': '4ef5840a-d85d-424f-b8d0-f4d47b4b85f4', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:47.627444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:47.655392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-139f8c76-14d4-46bd-b061-a51a5d733173 req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] No DVR routers for this DVR port 18519333-0313-4b0f-92f3-16b15506c1ce on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:31:47.659480 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-139f8c76-14d4-46bd-b061-a51a5d733173 req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:47.677140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51818) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:47.684431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9def9006-5a34-482b-a8e8-8de3379c1d5b', 'name': 'network-vif-deleted', 'tag': '18519333-0313-4b0f-92f3-16b15506c1ce'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:31:47.808069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-79a97d71-94df-42a5-af57-d3c51304f10d req-d3cd3f8f-e33a-4b77-9c6f-5a3ceab1592a tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/security-groups?id=5a39e1f7-01b6-46a3-8c68-e528e84cc27b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2341056 May 12 15:31:47.891282 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:47.906319 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:47.930387 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Transition to ACTIVE for port object 76c5a47a-b828-4b35-80f5-6695cf372d4d will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:31:47.971576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Usage tracker for resource:subnet and tenant:cf9709fca9b64338a050eef7c36e0c1d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:47.973519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Transition to ACTIVE for port object 76c5a47a-b828-4b35-80f5-6695cf372d4d will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:31:47.981023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:47.981841 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:47.991012 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b36a468e-c6d6-4cb0-9fa4-2be89c5907ff tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:48.104425 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22659427-e585-4407-825e-888ddbf73fd9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:48.117044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Network e3da6ceb-9da7-4883-ab26-4b1a93fc9293 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:31:48.117855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Pushing event updated for resources: {'Port': ['ID=76c5a47a-b828-4b35-80f5-6695cf372d4d,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:48.120701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:48.127992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:31:48.143594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-22659427-e585-4407-825e-888ddbf73fd9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:48.148995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-22659427-e585-4407-825e-888ddbf73fd9 admin admin] Usage tracker for resource:security_group_rule and tenant:d5da44f3d94e45b7a8be631788cbc6ca is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:48.152363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-22659427-e585-4407-825e-888ddbf73fd9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:48.160923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-22659427-e585-4407-825e-888ddbf73fd9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:48.256308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Attempting to bind port 76c5a47a-b828-4b35-80f5-6695cf372d4d on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:31:48.256967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Attempting to bind port 76c5a47a-b828-4b35-80f5-6695cf372d4d by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'fb35d0af-7190-42e6-a36f-ad8855fc0de2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': 'e3da6ceb-9da7-4883-ab26-4b1a93fc9293'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:31:48.257533 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Attempting to bind port 76c5a47a-b828-4b35-80f5-6695cf372d4d on network e3da6ceb-9da7-4883-ab26-4b1a93fc9293 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:31:48.265081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 31, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:31:48.266072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Checking segment: {'id': 'fb35d0af-7190-42e6-a36f-ad8855fc0de2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': 'e3da6ceb-9da7-4883-ab26-4b1a93fc9293'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:31:48.267359 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:48.267941 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Bound using segment: {'id': 'fb35d0af-7190-42e6-a36f-ad8855fc0de2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': 'e3da6ceb-9da7-4883-ab26-4b1a93fc9293'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:31:48.268604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Bound port: 76c5a47a-b828-4b35-80f5-6695cf372d4d, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb35d0af-7190-42e6-a36f-ad8855fc0de2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': 'e3da6ceb-9da7-4883-ab26-4b1a93fc9293'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:31:48.269173 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:48.294630 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-139f8c76-14d4-46bd-b061-a51a5d733173 req-d7a9cdf7-aa23-406a-967a-b60d0622ebfa tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.84 "DELETE /v2.0/ports/18519333-0313-4b0f-92f3-16b15506c1ce HTTP/1.1" status: 204 len: 173 time: 4.8201063 May 12 15:31:48.298296 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-66317281-e1ba-49b0-8cb7-f86704854feb'] response: {'server_uuid': '9def9006-5a34-482b-a8e8-8de3379c1d5b', 'name': 'network-vif-deleted', 'tag': '18519333-0313-4b0f-92f3-16b15506c1ce', 'status': 'completed', 'code': 200} May 12 15:31:48.305414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b36a468e-c6d6-4cb0-9fa4-2be89c5907ff tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Calling delete_port for 57a83f63-0bb8-4c97-b822-7dff75a6c61a owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:31:48.328216 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7d9dd4e-730a-409e-9674-8eb56b26d590 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:48.344564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:48.367465 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4f933d4-ac36-4c7f-a792-edab308d92bd req-d3099060-9158-42ae-8750-e11b208bceda service neutron] 10.222.0.76 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.9081814 May 12 15:31:48.376520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Made reservation on behalf of cf9709fca9b64338a050eef7c36e0c1d for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:48.378633 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:48.525066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] For port 76c5a47a-b828-4b35-80f5-6695cf372d4d, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:31:48.529550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] For port 76c5a47a-b828-4b35-80f5-6695cf372d4d, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=76c5a47a-b828-4b35-80f5-6695cf372d4d,segment=NetworkSegment(fb35d0af-7190-42e6-a36f-ad8855fc0de2),segment_id=fb35d0af-7190-42e6-a36f-ad8855fc0de2)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:31:48.534370 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:48.691312 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22659427-e585-4407-825e-888ddbf73fd9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:48.700676 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a43ab615-fd17-4c68-a99a-d9d8c3d1c49d None None] Pushing event updated for resources: {'Port': ['ID=76c5a47a-b828-4b35-80f5-6695cf372d4d,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:48.723296 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22659427-e585-4407-825e-888ddbf73fd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:48.769999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22659427-e585-4407-825e-888ddbf73fd9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d5eb85f-8b47-4357-8662-0678495f6e51,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:48.815846 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-22659427-e585-4407-825e-888ddbf73fd9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d5da44f3d94e45b7a8be631788cbc6ca&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1193702 May 12 15:31:48.819406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51844) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:49.014856 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b36a468e-c6d6-4cb0-9fa4-2be89c5907ff tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:49.228412 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54addf30-95f3-436b-9b3c-bacdf319db23 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:49.282342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b36a468e-c6d6-4cb0-9fa4-2be89c5907ff tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Pushing event deleted for resources: {'Port': ['ID=57a83f63-0bb8-4c97-b822-7dff75a6c61a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:49.286574 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4f933d4-ac36-4c7f-a792-edab308d92bd req-54315340-a6c1-4aa1-8ef3-843ca88625e4 service neutron] 10.222.0.76 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8915379 May 12 15:31:49.353752 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 76c5a47a-b828-4b35-80f5-6695cf372d4d up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:31:49.469341 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54addf30-95f3-436b-9b3c-bacdf319db23 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:49.488714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 76c5a47a-b828-4b35-80f5-6695cf372d4d completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:31:49.495376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a1400481-6e42-41b6-a79e-7e8a905d6324 req-319acf90-d993-4b37-93c7-2a946b070235 tempest-ServerMetadataNegativeTestJSON-1736536361 tempest-ServerMetadataNegativeTestJSON-1736536361-project] 10.222.0.82 "GET /v2.0/ports?device_id=9def9006-5a34-482b-a8e8-8de3379c1d5b HTTP/1.1" status: 200 len: 210 time: 0.2211523 May 12 15:31:49.542803 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b36a468e-c6d6-4cb0-9fa4-2be89c5907ff tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:49.568006 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b36a468e-c6d6-4cb0-9fa4-2be89c5907ff tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] 10.222.0.82 "DELETE /v2.0/ports/57a83f63-0bb8-4c97-b822-7dff75a6c61a HTTP/1.1" status: 204 len: 168 time: 2.9019971 May 12 15:31:49.571988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51854) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:49.660427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d7d9dd4e-730a-409e-9674-8eb56b26d590 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port 80d6dd70-9523-4225-830b-ff1c4ce69403 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:31:49.662212 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7d9dd4e-730a-409e-9674-8eb56b26d590 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:49.791972 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54addf30-95f3-436b-9b3c-bacdf319db23 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:49.812327 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d158fb70-9038-4bfa-a3e6-132cc5c47c45 tempest-DHCPAgentSchedulersTestJSON-1752019893 tempest-DHCPAgentSchedulersTestJSON-1752019893-project-admin] 10.222.0.82 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4676 time: 0.2389288 May 12 15:31:49.814177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51864) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:49.832457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-352047421'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:49.875364 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54addf30-95f3-436b-9b3c-bacdf319db23 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d5eb85f-8b47-4357-8662-0678495f6e51,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:49.896922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:49.909680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Usage tracker for resource:network and tenant:25fa20f86c7841ef87df4011e75435d0 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:49.916721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:49.927585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:49.957915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Made reservation on behalf of 25fa20f86c7841ef87df4011e75435d0 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:49.962380 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:50.004978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 587} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:31:50.017973 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:50.019188 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Added segment f2ef53a0-5623-41ec-b401-8dc1a1beaa7c of type vlan for network 19474d90-ed71-4f96-b4e5-45bdc78580fa May 12 15:31:50.052295 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:50.092245 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:50.100251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:50.101120 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:50.320341 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54addf30-95f3-436b-9b3c-bacdf319db23 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:50.321530 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-54addf30-95f3-436b-9b3c-bacdf319db23 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1d5eb85f-8b47-4357-8662-0678495f6e51 HTTP/1.1" status: 204 len: 168 time: 1.5010629 May 12 15:31:50.379478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Pushing event updated for resources: {'Network': ['ID=19474d90-ed71-4f96-b4e5-45bdc78580fa,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:50.400523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 19474d90-ed71-4f96-b4e5-45bdc78580fa details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:31:50.498962 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-21aa45a2-c605-46bb-87f2-721d342aafc0 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 0.6798213 May 12 15:31:50.506326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51878) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:50.506942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.objects.ports [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88151) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:31:50.507413 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:50.529378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7d9dd4e-730a-409e-9674-8eb56b26d590 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:50.639622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51886) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:50.649849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea4ecbbd-8b9d-4c4c-a84b-5ad255ee5829 None None] Network e3da6ceb-9da7-4883-ab26-4b1a93fc9293 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:50.807820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a9da97de-f14f-41cd-89a2-bed69d50d4ca None None] Provisioning for port 76c5a47a-b828-4b35-80f5-6695cf372d4d completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:31:50.822474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d7d9dd4e-730a-409e-9674-8eb56b26d590 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for 80d6dd70-9523-4225-830b-ff1c4ce69403 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:31:50.832783 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a9da97de-f14f-41cd-89a2-bed69d50d4ca None None] Provisioning complete for port 76c5a47a-b828-4b35-80f5-6695cf372d4d triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:50.833298 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a9da97de-f14f-41cd-89a2-bed69d50d4ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:50.970679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event updated for resources: {'Subnet': ['ID=34a2f1b6-9655-4e70-b7a6-9b35afeffd73,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:51.146754 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-25a2193d-0ae7-44f6-877a-e2b966216d13 tempest-DHCPAgentSchedulersTestJSON-1752019893 tempest-DHCPAgentSchedulersTestJSON-1752019893-project-admin] 10.222.0.82 "GET /v2.0/agents/62f64aba-1951-452f-9938-cd517262c713/dhcp-networks HTTP/1.1" status: 200 len: 7273 time: 0.6335857 May 12 15:31:51.153849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51902) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:51.187023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Checking segment: {'id': '6a921987-3605-4165-a89e-ca3828bb55dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '4ef5840a-d85d-424f-b8d0-f4d47b4b85f4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:31:51.187397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Network hostable DHCP agents. Network: 4ef5840a-d85d-424f-b8d0-f4d47b4b85f4, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:31:51.270526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-5d3893b8-898e-4c42-b776-cd0d736b493a admin admin] Deleting subnet 82b2bb6a-4dc0-44b3-a673-359e20ac9935 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:31:51.273707 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d3893b8-898e-4c42-b776-cd0d736b493a admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:51.332929 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d3893b8-898e-4c42-b776-cd0d736b493a admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:51.461894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Network 4ef5840a-d85d-424f-b8d0-f4d47b4b85f4 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:31:51.477496 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a9da97de-f14f-41cd-89a2-bed69d50d4ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:51.524597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a9da97de-f14f-41cd-89a2-bed69d50d4ca None None] For port 76c5a47a-b828-4b35-80f5-6695cf372d4d, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=76c5a47a-b828-4b35-80f5-6695cf372d4d,segment=NetworkSegment(fb35d0af-7190-42e6-a36f-ad8855fc0de2),segment_id=fb35d0af-7190-42e6-a36f-ad8855fc0de2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:31:51.577884 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a9da97de-f14f-41cd-89a2-bed69d50d4ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:51.579437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 4ef5840a-d85d-424f-b8d0-f4d47b4b85f4) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:51.579437 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d3893b8-898e-4c42-b776-cd0d736b493a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:51.677875 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9da97de-f14f-41cd-89a2-bed69d50d4ca None None] Pushing event updated for resources: {'Port': ['ID=76c5a47a-b828-4b35-80f5-6695cf372d4d,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:51.697672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5cce93f4-0874-492b-9d3d-7391a7c95b72 None None] Network 4ef5840a-d85d-424f-b8d0-f4d47b4b85f4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:51.780569 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7d9dd4e-730a-409e-9674-8eb56b26d590 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:51.954947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7d9dd4e-730a-409e-9674-8eb56b26d590 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=80d6dd70-9523-4225-830b-ff1c4ce69403,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:52.315323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:52.316867 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:52.347958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-478eaacc-4895-45ca-9268-502a65fc55ce None None] Network 4ef5840a-d85d-424f-b8d0-f4d47b4b85f4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:52.355252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d3893b8-898e-4c42-b776-cd0d736b493a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:52.469185 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-64474f05-938c-4448-a895-b91c6606edcd tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 4.9979074 May 12 15:31:52.473575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51930) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:52.474636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d3893b8-898e-4c42-b776-cd0d736b493a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=82b2bb6a-4dc0-44b3-a673-359e20ac9935,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:52.489904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Request body: {'floatingip': {'floating_network_id': '4ef5840a-d85d-424f-b8d0-f4d47b4b85f4'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:52.494163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5d3893b8-898e-4c42-b776-cd0d736b493a admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:52.496235 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5d3893b8-898e-4c42-b776-cd0d736b493a admin admin] 10.222.0.82 "DELETE /v2.0/subnets/82b2bb6a-4dc0-44b3-a673-359e20ac9935 HTTP/1.1" status: 204 len: 168 time: 1.8493085 May 12 15:31:52.522261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ac0a100-e2ea-4f4a-aa7e-248fdd58a115 tempest-DHCPAgentSchedulersTestJSON-1752019893 tempest-DHCPAgentSchedulersTestJSON-1752019893-project-admin] Network 19474d90-ed71-4f96-b4e5-45bdc78580fa is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:31:52.529224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51934) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:52.530699 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:52.556675 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7d9dd4e-730a-409e-9674-8eb56b26d590 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:52.572841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Usage tracker for resource:floatingip and tenant:cf9709fca9b64338a050eef7c36e0c1d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:52.587267 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:52.610325 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ac0a100-e2ea-4f4a-aa7e-248fdd58a115 tempest-DHCPAgentSchedulersTestJSON-1752019893 tempest-DHCPAgentSchedulersTestJSON-1752019893-project-admin] 10.222.0.82 "POST /v2.0/agents/62f64aba-1951-452f-9938-cd517262c713/dhcp-networks HTTP/1.1" status: 201 len: 201 time: 1.4552999 May 12 15:31:52.617456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51940) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:52.724167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:52.752505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8536eb12-62e9-44db-b471-6434ad707163 None None] Network 19474d90-ed71-4f96-b4e5-45bdc78580fa requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:53.108118 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:53.269906 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8025b763-c528-4d6e-8629-8d20e337f103 None None] Provisioning complete for port 76c5a47a-b828-4b35-80f5-6695cf372d4d triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:53.270444 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8025b763-c528-4d6e-8629-8d20e337f103 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:53.355504 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 76c5a47a-b828-4b35-80f5-6695cf372d4d up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:31:53.424085 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dafd5f78-3074-4e50-bb2c-623fee34e7e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:53.472586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d7d9dd4e-730a-409e-9674-8eb56b26d590 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router e4bb4ff8-e436-42c7-96f8-56f195f2e452 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:31:53.751543 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5c746d84-332c-4907-a9a0-94363dc813d0 tempest-DHCPAgentSchedulersTestJSON-1752019893 tempest-DHCPAgentSchedulersTestJSON-1752019893-project-admin] 10.222.0.82 "GET /v2.0/agents/62f64aba-1951-452f-9938-cd517262c713/dhcp-networks HTTP/1.1" status: 200 len: 8775 time: 1.0325744 May 12 15:31:53.758519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51964) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:53.760484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d7d9dd4e-730a-409e-9674-8eb56b26d590 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:31:53.776743 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2da52c72-8f18-4202-9b16-6006b047cbf4 None None] Sync routers for ids ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:31:53.801604 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2da52c72-8f18-4202-9b16-6006b047cbf4 None None] Routers {'e4bb4ff8-e436-42c7-96f8-56f195f2e452'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:31:53.805209 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dafd5f78-3074-4e50-bb2c-623fee34e7e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:53.806382 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2da52c72-8f18-4202-9b16-6006b047cbf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:31:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:53.881727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-dafd5f78-3074-4e50-bb2c-623fee34e7e1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['344f73bf-bc85-42f0-91df-13b30d1e9dae']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:53.891250 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d7d9dd4e-730a-409e-9674-8eb56b26d590 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/e4bb4ff8-e436-42c7-96f8-56f195f2e452/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.8795879 May 12 15:31:53.901546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51970) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:53.917662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-dafd5f78-3074-4e50-bb2c-623fee34e7e1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c13c5085-1b93-40b2-949d-70da42f91a88') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:53.923849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-dafd5f78-3074-4e50-bb2c-623fee34e7e1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c13c5085-1b93-40b2-949d-70da42f91a88') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:53.952613 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:53.956819 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dafd5f78-3074-4e50-bb2c-623fee34e7e1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:53.964229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 76c5a47a-b828-4b35-80f5-6695cf372d4d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:31:53.964784 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:53.965341 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2da52c72-8f18-4202-9b16-6006b047cbf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:53.995928 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2da52c72-8f18-4202-9b16-6006b047cbf4 None None] Routers {'e4bb4ff8-e436-42c7-96f8-56f195f2e452'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:31:53.996774 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2da52c72-8f18-4202-9b16-6006b047cbf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:31:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:54.113423 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b54aa1d1-b8e4-486f-a0b6-bb532c1aaa2d tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Synchronizing usage tracker for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:31:54.117892 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dafd5f78-3074-4e50-bb2c-623fee34e7e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:54.245119 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2da52c72-8f18-4202-9b16-6006b047cbf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:54.261513 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2da52c72-8f18-4202-9b16-6006b047cbf4 None None] The sync data for ids ['e4bb4ff8-e436-42c7-96f8-56f195f2e452'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:31:54.481141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51982) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:54.519538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dafd5f78-3074-4e50-bb2c-623fee34e7e1 admin admin] Releasing vlan 575 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:31:54.520203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dafd5f78-3074-4e50-bb2c-623fee34e7e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:54.569292 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-35952b50-2b75-4124-8b73-7f0d80a48596 tempest-DHCPAgentSchedulersTestJSON-1752019893 tempest-DHCPAgentSchedulersTestJSON-1752019893-project-admin] 10.222.0.82 "DELETE /v2.0/agents/62f64aba-1951-452f-9938-cd517262c713/dhcp-networks/19474d90-ed71-4f96-b4e5-45bdc78580fa HTTP/1.1" status: 204 len: 168 time: 0.8021801 May 12 15:31:54.571839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51990) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: timer() May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:31:54.590164 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:31:54.624260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b54aa1d1-b8e4-486f-a0b6-bb532c1aaa2d tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Unset dirty status for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:31:54.633880 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e26ab9db-7d87-44fa-bc02-8a6a4cd220ff None None] Could not find standard attr ID for object 57a83f63-0bb8-4c97-b822-7dff75a6c61a. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:31:54.637423 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b54aa1d1-b8e4-486f-a0b6-bb532c1aaa2d tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports?device_id=e4bb4ff8-e436-42c7-96f8-56f195f2e452 HTTP/1.1" status: 200 len: 205 time: 0.7347388 May 12 15:31:54.645945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51996) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:54.712251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Allocated IP 172.20.0.10 (4ef5840a-d85d-424f-b8d0-f4d47b4b85f4/34a2f1b6-9655-4e70-b7a6-9b35afeffd73/662efaf6-02dd-401f-9d02-307fe69e6e06) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:31:54.728041 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dafd5f78-3074-4e50-bb2c-623fee34e7e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:54.795526 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dafd5f78-3074-4e50-bb2c-623fee34e7e1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:54.899964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dafd5f78-3074-4e50-bb2c-623fee34e7e1 admin admin] Pushing event deleted for resources: {'Network': ['ID=344f73bf-bc85-42f0-91df-13b30d1e9dae,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:54.955569 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dafd5f78-3074-4e50-bb2c-623fee34e7e1 admin admin] 10.222.0.82 "DELETE /v2.0/networks/344f73bf-bc85-42f0-91df-13b30d1e9dae HTTP/1.1" status: 204 len: 168 time: 2.4166791 May 12 15:31:55.152874 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-22c04929-a904-4e48-81fc-d01cf05c5876 tempest-DHCPAgentSchedulersTestJSON-1752019893 tempest-DHCPAgentSchedulersTestJSON-1752019893-project-admin] 10.222.0.82 "GET /v2.0/agents/62f64aba-1951-452f-9938-cd517262c713/dhcp-networks HTTP/1.1" status: 200 len: 8005 time: 0.5775867 May 12 15:31:55.159289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52010) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:55.182558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:55.202750 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff3bdf74-3689-4a4a-97c3-56e71979a987 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:55.215300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:55.218887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Usage tracker for resource:floatingip and tenant:352d2ada27bd455abedc3dabac947fa7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:55.226367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:55.269870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:55.284664 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d8bf452b-3265-491d-a12c-80bce13d4e17 tempest-DHCPAgentSchedulersTestJSON-1752019893 tempest-DHCPAgentSchedulersTestJSON-1752019893-project-admin] 10.222.0.82 "GET /v2.0/networks/e3da6ceb-9da7-4883-ab26-4b1a93fc9293/dhcp-agents HTTP/1.1" status: 200 len: 794 time: 0.1086080 May 12 15:31:55.306125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52016) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:55.347480 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:55.481305 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:55.488885 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a8e44729-1674-48fc-bf80-ae3629d7e1ac tempest-DHCPAgentSchedulersTestJSON-1752019893 tempest-DHCPAgentSchedulersTestJSON-1752019893-project-admin] 10.222.0.82 "GET /v2.0/networks/e3da6ceb-9da7-4883-ab26-4b1a93fc9293/dhcp-agents HTTP/1.1" status: 200 len: 794 time: 0.1814306 May 12 15:31:55.503177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52020) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:55.665023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52026) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:55.777986 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff3bdf74-3689-4a4a-97c3-56e71979a987 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:55.787474 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff3bdf74-3689-4a4a-97c3-56e71979a987 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:55.814909 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:55.820719 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-793db14c-d657-4656-beea-c643dcf48991 tempest-DHCPAgentSchedulersTestJSON-1752019893 tempest-DHCPAgentSchedulersTestJSON-1752019893-project-admin] 10.222.0.82 "GET /v2.0/agents/62f64aba-1951-452f-9938-cd517262c713/dhcp-networks HTTP/1.1" status: 200 len: 7236 time: 0.3098838 May 12 15:31:55.831342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2aa51d29-c40c-40c3-9115-e8860116faef admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=eae7db4d964e4147a5dadb670fa36326&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1622429 May 12 15:31:55.831342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52032) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:55.834688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52034) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:55.928575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Network 4ef5840a-d85d-424f-b8d0-f4d47b4b85f4 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:31:55.932550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:55.938836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:31:55.946814 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff3bdf74-3689-4a4a-97c3-56e71979a987 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:55.947314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff3bdf74-3689-4a4a-97c3-56e71979a987 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Fanout notify agent at l3_agent the message router_deleted on router e4bb4ff8-e436-42c7-96f8-56f195f2e452 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:31:55.974461 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:55.982242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event updated for resources: {'Port': ['ID=662efaf6-02dd-401f-9d02-307fe69e6e06,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:56.001777 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff3bdf74-3689-4a4a-97c3-56e71979a987 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.010525 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ff3bdf74-3689-4a4a-97c3-56e71979a987 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/routers/e4bb4ff8-e436-42c7-96f8-56f195f2e452 HTTP/1.1" status: 204 len: 168 time: 1.3620286 May 12 15:31:56.053951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52044) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:56.164560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-4e5eaa1d-8546-4939-8c5f-8dbad8201e87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting subnet b76f650a-c71f-4cfb-8501-a64b78974ec4 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:31:56.169751 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c155dcf1-1ffe-42fc-a6db-05cdf7acbaaf tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.186029 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4e5eaa1d-8546-4939-8c5f-8dbad8201e87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.232063 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.373987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4e5eaa1d-8546-4939-8c5f-8dbad8201e87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.424651 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.452397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Allocated IP 172.25.8.117 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/ee1ddd8f-5956-4306-9d37-591ab1069ec0) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:31:56.575769 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c155dcf1-1ffe-42fc-a6db-05cdf7acbaaf tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.590474 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.627417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.639957 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-c155dcf1-1ffe-42fc-a6db-05cdf7acbaaf tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['19474d90-ed71-4f96-b4e5-45bdc78580fa']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:56.659789 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.709881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-c155dcf1-1ffe-42fc-a6db-05cdf7acbaaf tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f2ef53a0-5623-41ec-b401-8dc1a1beaa7c') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:56.709881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-c155dcf1-1ffe-42fc-a6db-05cdf7acbaaf tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f2ef53a0-5623-41ec-b401-8dc1a1beaa7c') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:31:56.723210 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c155dcf1-1ffe-42fc-a6db-05cdf7acbaaf tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.737697 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4e5eaa1d-8546-4939-8c5f-8dbad8201e87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.744081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.835575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:31:56.842951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:31:56.855372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:31:56.940565 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c155dcf1-1ffe-42fc-a6db-05cdf7acbaaf tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.943486 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.973001 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c155dcf1-1ffe-42fc-a6db-05cdf7acbaaf tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Releasing vlan 587 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:31:56.973644 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c155dcf1-1ffe-42fc-a6db-05cdf7acbaaf tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:56.997946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Pushing event updated for resources: {'Port': ['ID=ee1ddd8f-5956-4306-9d37-591ab1069ec0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: timer() May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:31:56.999919 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:31:57.011438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a39e1f7-01b6-46a3-8c68-e528e84cc27b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:57.105797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:57.106859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:57.107320 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:57.107722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:57.108412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:57.109045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:57.109645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:57.110816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:57.111625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:57.112632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:57.114544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:57.115292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:31:57.156960 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:57.157562 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:57.159668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d3fdbffb-82f2-4ba1-aea8-ebdaed77432a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5a39e1f7-01b6-46a3-8c68-e528e84cc27b HTTP/1.1" status: 204 len: 168 time: 1.3034999 May 12 15:31:57.177265 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c155dcf1-1ffe-42fc-a6db-05cdf7acbaaf tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:57.207421 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c155dcf1-1ffe-42fc-a6db-05cdf7acbaaf tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:57.210468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c155dcf1-1ffe-42fc-a6db-05cdf7acbaaf tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Pushing event deleted for resources: {'Network': ['ID=19474d90-ed71-4f96-b4e5-45bdc78580fa,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:57.230956 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4e5eaa1d-8546-4939-8c5f-8dbad8201e87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:57.256983 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:57.265411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c155dcf1-1ffe-42fc-a6db-05cdf7acbaaf tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] 10.222.0.82 "DELETE /v2.0/networks/19474d90-ed71-4f96-b4e5-45bdc78580fa HTTP/1.1" status: 204 len: 168 time: 1.4322314 May 12 15:31:57.272144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52064) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:57.282900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e5eaa1d-8546-4939-8c5f-8dbad8201e87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Subnet': ['ID=b76f650a-c71f-4cfb-8501-a64b78974ec4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:57.300511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc6f4883-1bd5-4821-89d5-0250127950d3 None None] Network 146af6dc-9539-409e-8ef7-00f5631653c8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:57.324089 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4e5eaa1d-8546-4939-8c5f-8dbad8201e87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:57.326414 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4e5eaa1d-8546-4939-8c5f-8dbad8201e87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/b76f650a-c71f-4cfb-8501-a64b78974ec4 HTTP/1.1" status: 204 len: 168 time: 1.2679698 May 12 15:31:57.332620 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52068) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:57.335279 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-266cba39-4472-45b3-8831-8622f2c76821 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] DELETE failed (client error): The resource could not be found. May 12 15:31:57.335995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-266cba39-4472-45b3-8831-8622f2c76821 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:31:57.337994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-266cba39-4472-45b3-8831-8622f2c76821 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] 10.222.0.82 "DELETE /v2.0/ports/57a83f63-0bb8-4c97-b822-7dff75a6c61a HTTP/1.1" status: 404 len: 333 time: 0.0630603 May 12 15:31:57.346193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52072) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:57.443125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-1ab364e5-c178-4293-9623-d03dea7785dd tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Deleting subnet 1b1054bd-b6bb-4c4f-abbe-dd51d2b96ff3 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:31:57.446961 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1ab364e5-c178-4293-9623-d03dea7785dd tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:57.602537 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7022f0b0-4dea-4d0d-aaa4-033db852f88f req-b6050a7a-ed1f-4e48-a663-f17d14d96ac4 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.1523550 May 12 15:31:57.604047 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] It took 0.28 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:31:57.651197 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1ab364e5-c178-4293-9623-d03dea7785dd tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:57.737588 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:57.755328 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:57.908921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57b413e5-5aa5-4e86-b8ae-1cc6e814adb9 None None] DHCP port deletion for 146af6dc-9539-409e-8ef7-00f5631653c8 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:31:57.915613 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1ab364e5-c178-4293-9623-d03dea7785dd tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:57.923246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-57b413e5-5aa5-4e86-b8ae-1cc6e814adb9 None None] Deleting port f919f925-77db-4728-9eef-3e2fa64aad7e {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:31:57.923525 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-57b413e5-5aa5-4e86-b8ae-1cc6e814adb9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:57.991929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-be1ad53b-077f-4354-8e59-286f37224ad0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting subnet 32aa3dbd-054f-4286-81a6-5b1d7f70d6c2 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:31:58.053964 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7022f0b0-4dea-4d0d-aaa4-033db852f88f req-c050bb70-569e-48b7-bc82-a0602dd3ee76 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.2346458 May 12 15:31:58.054656 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be1ad53b-077f-4354-8e59-286f37224ad0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:58.081678 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1ab364e5-c178-4293-9623-d03dea7785dd tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:58.152767 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7022f0b0-4dea-4d0d-aaa4-033db852f88f req-3345e4b4-c784-4766-94c1-13080628f61b service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0419621 May 12 15:31:58.156396 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1ab364e5-c178-4293-9623-d03dea7785dd tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:58.183421 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1ab364e5-c178-4293-9623-d03dea7785dd tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] 10.222.0.82 "DELETE /v2.0/subnets/1b1054bd-b6bb-4c4f-abbe-dd51d2b96ff3 HTTP/1.1" status: 204 len: 168 time: 0.8356116 May 12 15:31:58.183613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c554d852-effd-4fd5-adfd-7720ccf84a41 None None] Network e3da6ceb-9da7-4883-ab26-4b1a93fc9293 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:58.186342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52108) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:58.191725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ab364e5-c178-4293-9623-d03dea7785dd tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Pushing event deleted for resources: {'Subnet': ['ID=1b1054bd-b6bb-4c4f-abbe-dd51d2b96ff3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:58.415834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event updated for resources: {'Port': ['ID=662efaf6-02dd-401f-9d02-307fe69e6e06,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:58.434366 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:58.442997 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:58.463566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Deleting port 76c5a47a-b828-4b35-80f5-6695cf372d4d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:31:58.464643 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be1ad53b-077f-4354-8e59-286f37224ad0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:58.466511 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:58.537970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-57b413e5-5aa5-4e86-b8ae-1cc6e814adb9 None None] For port f919f925-77db-4728-9eef-3e2fa64aad7e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f919f925-77db-4728-9eef-3e2fa64aad7e,segment=NetworkSegment(5045a395-ccf3-4ecc-8a1b-2fea99b18a46),segment_id=5045a395-ccf3-4ecc-8a1b-2fea99b18a46)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:31:58.538520 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-57b413e5-5aa5-4e86-b8ae-1cc6e814adb9 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:58.637521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7022f0b0-4dea-4d0d-aaa4-033db852f88f req-1b52bd0e-e8dc-4b95-ad44-dc0be9e8a2c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:31:58.655150 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7022f0b0-4dea-4d0d-aaa4-033db852f88f req-1b52bd0e-e8dc-4b95-ad44-dc0be9e8a2c8 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4861579 May 12 15:31:58.706836 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:58.711104 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3b0064e1-9ffd-4794-82a5-e57763c05c93 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 6.2310677 May 12 15:31:58.711522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52122) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:58.753830 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:58.777280 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:58.789337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-57b413e5-5aa5-4e86-b8ae-1cc6e814adb9 None None] Calling delete_port for f919f925-77db-4728-9eef-3e2fa64aad7e owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:31:58.818496 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fcf9412d-7856-4557-85bd-2a4064890c5e tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "GET /v2.0/floatingips?floating_network_id=4ef5840a-d85d-424f-b8d0-f4d47b4b85f4 HTTP/1.1" status: 200 len: 690 time: 0.1057405 May 12 15:31:58.819148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52128) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:59.012985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52132) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:59.069183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] For port 76c5a47a-b828-4b35-80f5-6695cf372d4d, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=76c5a47a-b828-4b35-80f5-6695cf372d4d,segment=NetworkSegment(fb35d0af-7190-42e6-a36f-ad8855fc0de2),segment_id=fb35d0af-7190-42e6-a36f-ad8855fc0de2)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:31:59.069593 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.132601 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-57b413e5-5aa5-4e86-b8ae-1cc6e814adb9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.163120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Pushing event updated for resources: {'Port': ['ID=ee1ddd8f-5956-4306-9d37-591ab1069ec0,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:59.205599 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be1ad53b-077f-4354-8e59-286f37224ad0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.241153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57b413e5-5aa5-4e86-b8ae-1cc6e814adb9 None None] Pushing event deleted for resources: {'Port': ['ID=f919f925-77db-4728-9eef-3e2fa64aad7e,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:59.251288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f919f925-77db-4728-9eef-3e2fa64aad7e no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:31:59.266792 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.300582 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.304708 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dacacc6c-f37d-4994-bb43-c53170baad7a tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.8011696 May 12 15:31:59.307567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52140) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:59.318253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Request body: {'port': {'name': 'tempest-ExternalNetworksAdminNegativeTestJSON-1095523241', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'fixed_ips': [{'ip_address': '172.25.8.117'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:59.323893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:59.331436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Usage tracker for resource:port and tenant:352d2ada27bd455abedc3dabac947fa7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:59.331639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57b413e5-5aa5-4e86-b8ae-1cc6e814adb9 None None] No DVR routers for this DVR port f919f925-77db-4728-9eef-3e2fa64aad7e on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:31:59.334980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:59.337820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: f919f925-77db-4728-9eef-3e2fa64aad7e {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:31:59.339610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f919f925-77db-4728-9eef-3e2fa64aad7e not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:31:59.367232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:59.370609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Made reservation on behalf of 352d2ada27bd455abedc3dabac947fa7 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:59.372934 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.403589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.410540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Calling delete_port for 76c5a47a-b828-4b35-80f5-6695cf372d4d owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:31:59.426553 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be1ad53b-077f-4354-8e59-286f37224ad0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.430704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:59.460673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-437125850-network', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:31:59.475717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:59.476757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5ec68be4-24fe-447b-911c-885a78a5c385 None None] DHCP port deletion for e3da6ceb-9da7-4883-ab26-4b1a93fc9293 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:31:59.482512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Usage tracker for resource:security_group_rule and tenant:352d2ada27bd455abedc3dabac947fa7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:59.483152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5ec68be4-24fe-447b-911c-885a78a5c385 None None] Deleting port 76c5a47a-b828-4b35-80f5-6695cf372d4d {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:31:59.483897 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ec68be4-24fe-447b-911c-885a78a5c385 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.485506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be1ad53b-077f-4354-8e59-286f37224ad0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Subnet': ['ID=32aa3dbd-054f-4286-81a6-5b1d7f70d6c2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:31:59.487553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:59.496696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Usage tracker for resource:network and tenant:ed8d9bf58283443480f0c62e72d53449 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:59.498015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:59.500283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:59.501496 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be1ad53b-077f-4354-8e59-286f37224ad0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.513221 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-be1ad53b-077f-4354-8e59-286f37224ad0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/32aa3dbd-054f-4286-81a6-5b1d7f70d6c2 HTTP/1.1" status: 204 len: 168 time: 2.1745257 May 12 15:31:59.516209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:31:59.518618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52144) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:31:59.533443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Made reservation on behalf of ed8d9bf58283443480f0c62e72d53449 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:31:59.535670 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.591108 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.607768 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.635069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79a91902-fe2b-4590-b0a8-323617d92ad4 None None] Network 3b50a8ca-56d5-467e-bd2c-f74e0545d8d4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:31:59.680090 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d48ea5a-2a4e-40cf-ab6d-8cbd31d3ad41 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.732847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:31:59.757511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Usage tracker for resource:security_group_rule and tenant:ed8d9bf58283443480f0c62e72d53449 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:31:59.771481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:31:59.781238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Deleting port 662efaf6-02dd-401f-9d02-307fe69e6e06 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:31:59.781605 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.906484 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.913306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d48ea5a-2a4e-40cf-ab6d-8cbd31d3ad41 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.926264 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:31:59.957805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] device_id is not set on port 9f9b843f-fa76-4982-9ec8-3bf5ace88ad5 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:31:59.995825 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:00.030134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-3d48ea5a-2a4e-40cf-ab6d-8cbd31d3ad41 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['146af6dc-9539-409e-8ef7-00f5631653c8']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:00.037438 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.079150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8e20b528-e65b-48a8-b0da-03c20cd932bb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:00.088090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5ec68be4-24fe-447b-911c-885a78a5c385 None None] For port 76c5a47a-b828-4b35-80f5-6695cf372d4d, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=76c5a47a-b828-4b35-80f5-6695cf372d4d,segment=NetworkSegment(fb35d0af-7190-42e6-a36f-ad8855fc0de2),segment_id=fb35d0af-7190-42e6-a36f-ad8855fc0de2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:00.088514 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ec68be4-24fe-447b-911c-885a78a5c385 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.116666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] No DVR routers for this DVR port 76c5a47a-b828-4b35-80f5-6695cf372d4d on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:32:00.143538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-3d48ea5a-2a4e-40cf-ab6d-8cbd31d3ad41 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5045a395-ccf3-4ecc-8a1b-2fea99b18a46') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:00.143835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-3d48ea5a-2a4e-40cf-ab6d-8cbd31d3ad41 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5045a395-ccf3-4ecc-8a1b-2fea99b18a46') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:00.235074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Pushing event deleted for resources: {'Port': ['ID=76c5a47a-b828-4b35-80f5-6695cf372d4d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:00.314688 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5ec68be4-24fe-447b-911c-885a78a5c385 None None] Calling delete_port for 76c5a47a-b828-4b35-80f5-6695cf372d4d owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:00.335110 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.429559 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d48ea5a-2a4e-40cf-ab6d-8cbd31d3ad41 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.434468 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-5ec68be4-24fe-447b-911c-885a78a5c385 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:32:00.434877 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-5ec68be4-24fe-447b-911c-885a78a5c385 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:32:00.437014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48a4836f-b559-4ef2-9721-1ae9977fa434 None None] DHCP port deletion for 3b50a8ca-56d5-467e-bd2c-f74e0545d8d4 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:32:00.439395 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] POST failed (client error): There was a conflict when trying to complete your request. May 12 15:32:00.440074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:32:00.443669 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-48a4836f-b559-4ef2-9721-1ae9977fa434 None None] Deleting port 29a11baf-9c87-46a0-a334-f53971e4f87e {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:00.444129 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48a4836f-b559-4ef2-9721-1ae9977fa434 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.469041 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d48ea5a-2a4e-40cf-ab6d-8cbd31d3ad41 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.486221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3d48ea5a-2a4e-40cf-ab6d-8cbd31d3ad41 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Releasing vlan 597 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:32:00.486950 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d48ea5a-2a4e-40cf-ab6d-8cbd31d3ad41 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: timer() May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:32:00.516216 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:32:00.527285 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-42bcbdc0-eb20-43d1-aea6-27dc021abdc5 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 409 len: 372 time: 1.2174003 May 12 15:32:00.541417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52152) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:00.542110 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.556771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 581} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:32:00.569700 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.569990 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Added segment 60811cb9-2374-4869-8102-d13af82449fc of type vlan for network bca349be-4618-43ae-a547-b8bd2b254da4 May 12 15:32:00.611487 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d48ea5a-2a4e-40cf-ab6d-8cbd31d3ad41 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.640182 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d48ea5a-2a4e-40cf-ab6d-8cbd31d3ad41 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.648470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d48ea5a-2a4e-40cf-ab6d-8cbd31d3ad41 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Network': ['ID=146af6dc-9539-409e-8ef7-00f5631653c8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:00.660998 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3d48ea5a-2a4e-40cf-ab6d-8cbd31d3ad41 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/networks/146af6dc-9539-409e-8ef7-00f5631653c8 HTTP/1.1" status: 204 len: 168 time: 1.1362166 May 12 15:32:00.660998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52156) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:00.709257 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.735556 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.791750 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.793666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e3da6ceb-9da7-4883-ab26-4b1a93fc9293']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:00.805232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port 29a11baf-9c87-46a0-a334-f53971e4f87e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:00.805640 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.863761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-48a4836f-b559-4ef2-9721-1ae9977fa434 None None] For port 29a11baf-9c87-46a0-a334-f53971e4f87e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=29a11baf-9c87-46a0-a334-f53971e4f87e,segment=NetworkSegment(103890b0-4adf-45e6-a455-80f1a7bbc58a),segment_id=103890b0-4adf-45e6-a455-80f1a7bbc58a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:00.864719 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48a4836f-b559-4ef2-9721-1ae9977fa434 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:00.938834 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fb35d0af-7190-42e6-a36f-ad8855fc0de2') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:00.939339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fb35d0af-7190-42e6-a36f-ad8855fc0de2') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:00.952066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5ec68be4-24fe-447b-911c-885a78a5c385 None None] Deleting port 76c5a47a-b828-4b35-80f5-6695cf372d4d {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:00.952878 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ec68be4-24fe-447b-911c-885a78a5c385 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.045149 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17ef7040-f66b-422a-a8da-be4216f1f8bd,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:01.076206 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] It took 0.19 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:32:01.086537 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.132772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-48a4836f-b559-4ef2-9721-1ae9977fa434 None None] Calling delete_port for 29a11baf-9c87-46a0-a334-f53971e4f87e owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:01.135597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-79ca1228-b08f-480a-a6c8-38acf33a9dc8 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Deleting port ee1ddd8f-5956-4306-9d37-591ab1069ec0 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:01.135941 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79ca1228-b08f-480a-a6c8-38acf33a9dc8 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.169044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] For port 29a11baf-9c87-46a0-a334-f53971e4f87e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=29a11baf-9c87-46a0-a334-f53971e4f87e,segment=NetworkSegment(103890b0-4adf-45e6-a455-80f1a7bbc58a),segment_id=103890b0-4adf-45e6-a455-80f1a7bbc58a)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:01.169979 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.209587 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.232424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 76c5a47a-b828-4b35-80f5-6695cf372d4d no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:32:01.243590 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.245353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:01.246009 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.275139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Releasing vlan 590 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:32:01.275542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.297844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5ec68be4-24fe-447b-911c-885a78a5c385 None None] The port '76c5a47a-b828-4b35-80f5-6695cf372d4d' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:32:01.310917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.311290 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: timer() May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:32:01.320828 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:32:01.369221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 76c5a47a-b828-4b35-80f5-6695cf372d4d {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:32:01.372864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 76c5a47a-b828-4b35-80f5-6695cf372d4d not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:32:01.373465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 29a11baf-9c87-46a0-a334-f53971e4f87e no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:32:01.383107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for 29a11baf-9c87-46a0-a334-f53971e4f87e owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:01.490111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.582928 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Port 29a11baf-9c87-46a0-a334-f53971e4f87e update to DOWN by agent not found {{(pid=88153) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2140}} May 12 15:32:01.587304 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No DVR routers for this DVR port 29a11baf-9c87-46a0-a334-f53971e4f87e on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:32:01.607846 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-48a4836f-b559-4ef2-9721-1ae9977fa434 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:32:01.608510 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-48a4836f-b559-4ef2-9721-1ae9977fa434 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:32:01.635222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=29a11baf-9c87-46a0-a334-f53971e4f87e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:01.685358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Calling delete_port for 662efaf6-02dd-401f-9d02-307fe69e6e06 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:01.792723 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.827798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3b50a8ca-56d5-467e-bd2c-f74e0545d8d4']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:01.843039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '103890b0-4adf-45e6-a455-80f1a7bbc58a') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:01.843339 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '103890b0-4adf-45e6-a455-80f1a7bbc58a') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:01.858591 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.879813 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.896506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Releasing vlan 570 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:32:01.896963 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:01.926977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 2.9134259 May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: timer() May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:32:01.931134 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:32:01.933752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52174) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:01.934058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b76eae4-4561-4420-a670-42eb05f4ebcd admin admin] Pushing event updated for resources: {'Network': ['ID=bca349be-4618-43ae-a547-b8bd2b254da4,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:01.942934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Request body: {'subnet': {'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-subnet', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:01.948239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network bca349be-4618-43ae-a547-b8bd2b254da4 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:32:01.971062 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:02.015291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:02.040958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Usage tracker for resource:subnet and tenant:ed8d9bf58283443480f0c62e72d53449 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:02.048244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:02.056071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:02.065622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:02.071212 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:02.076578 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:02.086406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] Pushing event deleted for resources: {'Network': ['ID=e3da6ceb-9da7-4883-ab26-4b1a93fc9293,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:02.120694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-48a4836f-b559-4ef2-9721-1ae9977fa434 None None] Deleting port 29a11baf-9c87-46a0-a334-f53971e4f87e {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:02.121185 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48a4836f-b559-4ef2-9721-1ae9977fa434 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:02.170365 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fc67cb0c-a4fc-4f24-881a-c638155abfc7 tempest-DHCPAgentSchedulersTestJSON-372009415 tempest-DHCPAgentSchedulersTestJSON-372009415-project] 10.222.0.82 "DELETE /v2.0/networks/e3da6ceb-9da7-4883-ab26-4b1a93fc9293 HTTP/1.1" status: 204 len: 168 time: 3.9657612 May 12 15:32:02.228425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-e791d3e9-7d40-47e1-a65c-4af66db7ed5d req-b3d88c70-c924-45ce-b1df-3e51b39b7553 tempest-MultipleCreateTestJSON-50477346 tempest-MultipleCreateTestJSON-50477346-project] (88152) timed out ('10.222.0.76', 61662) {{(pid=88152) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 15:32:02.252214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Network': ['ID=3b50a8ca-56d5-467e-bd2c-f74e0545d8d4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:02.258689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Made reservation on behalf of ed8d9bf58283443480f0c62e72d53449 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:02.275710 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:02.363091 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79ca1228-b08f-480a-a6c8-38acf33a9dc8 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:02.363574 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79ca1228-b08f-480a-a6c8-38acf33a9dc8 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:02.364983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-48a4836f-b559-4ef2-9721-1ae9977fa434 None None] The port '29a11baf-9c87-46a0-a334-f53971e4f87e' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:32:02.438632 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:02.583285 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e28fa1e5-4c22-47bd-8cb3-43ea9541eb22 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/networks/3b50a8ca-56d5-467e-bd2c-f74e0545d8d4 HTTP/1.1" status: 204 len: 168 time: 1.9172351 May 12 15:32:02.584550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52188) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:02.591234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1706579194'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:02.599404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:02.604691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:network and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:02.610146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:02.622331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:02.648961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:02.657731 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:02.705627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52196) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:02.723655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 590} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:32:02.735896 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:02.735896 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Added segment ec07d999-a5e5-4d9e-8863-5aef618b5e17 of type vlan for network 3af91feb-4088-4b4d-836a-7e8054906de2 May 12 15:32:02.744078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-79ca1228-b08f-480a-a6c8-38acf33a9dc8 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Calling delete_port for ee1ddd8f-5956-4306-9d37-591ab1069ec0 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:02.765799 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:02.809947 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:02.872207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event deleted for resources: {'Port': ['ID=662efaf6-02dd-401f-9d02-307fe69e6e06,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:02.992823 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.001149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:03.004157 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.031353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.054810 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.170110 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79ca1228-b08f-480a-a6c8-38acf33a9dc8 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.230542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Pushing event updated for resources: {'Subnet': ['ID=aa771580-393c-41f8-ad67-611be21e45d3,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:03.254435 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.6684272 May 12 15:32:03.262203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52202) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:03.280215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79ca1228-b08f-480a-a6c8-38acf33a9dc8 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Pushing event deleted for resources: {'Port': ['ID=ee1ddd8f-5956-4306-9d37-591ab1069ec0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:03.282886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'subnet': {'network_id': '3af91feb-4088-4b4d-836a-7e8054906de2', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:03.298464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f37a86b5-e46a-4d0b-a98b-f41596171268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Network': ['ID=3af91feb-4088-4b4d-836a-7e8054906de2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:03.309704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 3af91feb-4088-4b4d-836a-7e8054906de2 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:32:03.316928 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0ad1a37a-874f-40e3-aeae-d251ebbdcfec admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=25fa20f86c7841ef87df4011e75435d0&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6055136 May 12 15:32:03.324140 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.375019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52206) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:03.434443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Checking segment: {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:32:03.434861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Network hostable DHCP agents. Network: bca349be-4618-43ae-a547-b8bd2b254da4, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:32:03.456746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:03.462783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:subnet and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:03.466522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:03.475613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:03.483488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Network bca349be-4618-43ae-a547-b8bd2b254da4 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:32:03.497612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:03.504006 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.523790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, bca349be-4618-43ae-a547-b8bd2b254da4) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:03.543076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10b233da-1a25-4779-bfb4-6437ce34f6ce None None] Network bca349be-4618-43ae-a547-b8bd2b254da4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:32:03.547799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:03.549135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.623164 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.663847 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0a73e538-300e-4471-b6d1-d37e9199840e admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 1.7314816 May 12 15:32:03.668065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52212) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:03.677955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:03.685761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:03.696890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Usage tracker for resource:router and tenant:ed8d9bf58283443480f0c62e72d53449 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:03.701874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:03.702033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=34a2f1b6-9655-4e70-b7a6-9b35afeffd73,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:03.710210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:03.710399 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a48c961b-433e-4ca0-a152-bf4db46a0dd1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.728988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.730075 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.746062 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79ca1228-b08f-480a-a6c8-38acf33a9dc8 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.794735 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.830316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-bca349be-4618-43ae-a547-b8bd2b254da4', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:32:03.831986 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.854206 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a48c961b-433e-4ca0-a152-bf4db46a0dd1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.866856 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.895451 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79ca1228-b08f-480a-a6c8-38acf33a9dc8 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:03.896603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-79ca1228-b08f-480a-a6c8-38acf33a9dc8 tempest-ExternalNetworksAdminNegativeTestJSON-782971290 tempest-ExternalNetworksAdminNegativeTestJSON-782971290-project-admin] 10.222.0.82 "DELETE /v2.0/floatingips/fce5cb5a-1af6-4942-a1c8-8f2243c1519b HTTP/1.1" status: 204 len: 168 time: 3.2955074 May 12 15:32:03.930061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4ef5840a-d85d-424f-b8d0-f4d47b4b85f4']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:03.951676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6a921987-3605-4165-a89e-ca3828bb55dd') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:03.952117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6a921987-3605-4165-a89e-ca3828bb55dd') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:03.993628 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:04.012376 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:04.034287 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:04.052897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Releasing vlan 595 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:32:04.053685 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:04.090979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Allocated IP 172.20.0.2 (bca349be-4618-43ae-a547-b8bd2b254da4/aa771580-393c-41f8-ad67-611be21e45d3/c779e8fa-022b-430d-9eb2-833a2d42e6de) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:32:04.174754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Subnet': ['ID=61ef0890-0de1-422e-8893-8072b324254e,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: timer() May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:32:04.191483 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:32:04.228387 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:04.272317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 4ef5840a-d85d-424f-b8d0-f4d47b4b85f4 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:124}} May 12 15:32:04.280642 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a48c961b-433e-4ca0-a152-bf4db46a0dd1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:04.297188 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:04.333643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event deleted for resources: {'Network': ['ID=4ef5840a-d85d-424f-b8d0-f4d47b4b85f4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:04.373281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a48c961b-433e-4ca0-a152-bf4db46a0dd1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=35491fa3-ab65-4b9b-8269-270c1d660a7d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:04.399270 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:04.404358 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-22986c8c-3fae-47e8-9587-94ce2470a278 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "DELETE /v2.0/networks/4ef5840a-d85d-424f-b8d0-f4d47b4b85f4 HTTP/1.1" status: 204 len: 168 time: 5.5672646 May 12 15:32:04.405625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52222) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:04.449706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Checking segment: {'id': 'ec07d999-a5e5-4d9e-8863-5aef618b5e17', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': '3af91feb-4088-4b4d-836a-7e8054906de2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:32:04.450654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network hostable DHCP agents. Network: 3af91feb-4088-4b4d-836a-7e8054906de2, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:32:04.519744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52226) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:04.600491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 3af91feb-4088-4b4d-836a-7e8054906de2 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:32:04.625309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 3af91feb-4088-4b4d-836a-7e8054906de2) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:04.639541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:04.640963 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:04.697977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2db4fb91-58cd-44e6-97d0-fc0e161d8f00 None None] Network 3af91feb-4088-4b4d-836a-7e8054906de2 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:32:04.723384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-46e03102-4d07-499c-9822-1d2d9a5036bb tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Synchronizing usage tracker for tenant:cf9709fca9b64338a050eef7c36e0c1d on resource:floatingip {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:32:04.731554 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-30722464-9931-4a97-aeb7-5685ef65d113 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.4675677 May 12 15:32:04.734415 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a48c961b-433e-4ca0-a152-bf4db46a0dd1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:04.739466 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a48c961b-433e-4ca0-a152-bf4db46a0dd1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/35491fa3-ab65-4b9b-8269-270c1d660a7d HTTP/1.1" status: 204 len: 168 time: 1.3330424 May 12 15:32:04.739712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52236) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:04.767917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5735801a-f1f7-4064-908a-9e6adb656798 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1465394930', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:04.788584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-46e03102-4d07-499c-9822-1d2d9a5036bb tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Unset dirty status for tenant:cf9709fca9b64338a050eef7c36e0c1d on resource:floatingip {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:32:04.789820 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-46e03102-4d07-499c-9822-1d2d9a5036bb tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 996 time: 0.3788850 May 12 15:32:04.792915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52244) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:04.803991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5735801a-f1f7-4064-908a-9e6adb656798 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:04.814339 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5735801a-f1f7-4064-908a-9e6adb656798 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:router and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:04.818615 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5ba0092-bee7-4d48-b392-e64b4d31ae67 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:04.832205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5735801a-f1f7-4064-908a-9e6adb656798 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:04.838867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f5ba0092-bee7-4d48-b392-e64b4d31ae67 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:04.843944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f5ba0092-bee7-4d48-b392-e64b4d31ae67 admin admin] Usage tracker for resource:security_group_rule and tenant:ed2c3e47120d4cb7b7dbaad777a3bdb6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:04.847676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f5ba0092-bee7-4d48-b392-e64b4d31ae67 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:04.853903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f5ba0092-bee7-4d48-b392-e64b4d31ae67 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:04.970144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5ba0092-bee7-4d48-b392-e64b4d31ae67 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:04.982456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5735801a-f1f7-4064-908a-9e6adb656798 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:04.983827 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5ba0092-bee7-4d48-b392-e64b4d31ae67 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:05.032094 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26345954-8ec1-41a4-9560-9a799d008159 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:05.032941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26345954-8ec1-41a4-9560-9a799d008159 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:05.033739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26345954-8ec1-41a4-9560-9a799d008159 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:05.034533 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26345954-8ec1-41a4-9560-9a799d008159 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:05.035135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26345954-8ec1-41a4-9560-9a799d008159 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:05.035736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26345954-8ec1-41a4-9560-9a799d008159 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:05.035911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5ba0092-bee7-4d48-b392-e64b4d31ae67 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=baa7822e-d55d-4971-ad0d-31d688b596fb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:05.036944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26345954-8ec1-41a4-9560-9a799d008159 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:05.038412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-26345954-8ec1-41a4-9560-9a799d008159 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Synchronizing usage tracker for tenant:cf9709fca9b64338a050eef7c36e0c1d on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:32:05.094234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-26345954-8ec1-41a4-9560-9a799d008159 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Unset dirty status for tenant:cf9709fca9b64338a050eef7c36e0c1d on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:32:05.096710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-26345954-8ec1-41a4-9560-9a799d008159 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4645 time: 0.3027501 May 12 15:32:05.099686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52250) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:05.223406 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-b1068935-31d9-44b5-b65f-8ad67e378a7f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] delete failed (client error): The resource could not be found. May 12 15:32:05.226144 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b1068935-31d9-44b5-b65f-8ad67e378a7f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "DELETE /v2.0/floatingips/3372ee34-474e-4985-928f-b4d6f96ace38 HTTP/1.1" status: 404 len: 345 time: 0.1237724 May 12 15:32:05.228014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52256) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:05.236611 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:05.263739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Transition to ACTIVE for port object c779e8fa-022b-430d-9eb2-833a2d42e6de will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:05.294832 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-5c6e9df2-a7b1-41e3-b680-6c650b76809b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] DELETE failed (client error): The resource could not be found. May 12 15:32:05.295549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5c6e9df2-a7b1-41e3-b680-6c650b76809b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:32:05.302747 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5c6e9df2-a7b1-41e3-b680-6c650b76809b tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "DELETE /v2.0/networks/4ef5840a-d85d-424f-b8d0-f4d47b4b85f4 HTTP/1.1" status: 404 len: 339 time: 0.0700009 May 12 15:32:05.306099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52260) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:05.315852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Request body: {'network': {'name': 'tempest-network--1823557440', 'router:external': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:05.324312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:05.329269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Usage tracker for resource:network and tenant:cf9709fca9b64338a050eef7c36e0c1d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:05.333475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:05.340646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:05.349689 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Transition to ACTIVE for port object c779e8fa-022b-430d-9eb2-833a2d42e6de will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:05.359453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Made reservation on behalf of cf9709fca9b64338a050eef7c36e0c1d for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:05.363589 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:05.376104 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:05.419536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 568} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:32:05.440380 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:05.441443 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Added segment 491e98a4-ae2f-480b-a27b-756f893dff95 of type vlan for network 8ba15102-a672-4533-9362-f6c76f494e4e May 12 15:32:05.500889 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:05.506605 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5735801a-f1f7-4064-908a-9e6adb656798 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:05.511231 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5735801a-f1f7-4064-908a-9e6adb656798 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:05.525739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-3af91feb-4088-4b4d-836a-7e8054906de2', 'network_id': '3af91feb-4088-4b4d-836a-7e8054906de2', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'fixed_ips': [{'subnet_id': '61ef0890-0de1-422e-8893-8072b324254e'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:32:05.528755 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:05.559970 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:05.559970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:05.561152 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:05.563686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Pushing event updated for resources: {'Port': ['ID=c779e8fa-022b-430d-9eb2-833a2d42e6de,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:05.591636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52266) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:05.623001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 0.3152361 May 12 15:32:05.645413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52270) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:05.671057 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f5ba0092-bee7-4d48-b392-e64b4d31ae67 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ed2c3e47120d4cb7b7dbaad777a3bdb6&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1496780 May 12 15:32:05.689706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52274) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:05.746641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Allocated IP 2001:db8::2 (3af91feb-4088-4b4d-836a-7e8054906de2/61ef0890-0de1-422e-8893-8072b324254e/bfb73fca-11c4-42f9-942d-9fdf5ebb5e10) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:32:05.824109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:05.865066 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:05.896896 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Network bca349be-4618-43ae-a547-b8bd2b254da4 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:05.901749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:05.910779 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:05.948456 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5735801a-f1f7-4064-908a-9e6adb656798 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:06.009191 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30d87277-e4ea-4811-8c97-0f701def578f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:06.054927 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99eac064-86de-4e67-8cad-ebcd45366584 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:06.065167 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5735801a-f1f7-4064-908a-9e6adb656798 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:06.092296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30d87277-e4ea-4811-8c97-0f701def578f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:06.100806 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b62c2902-10c3-4179-b7bb-3b69632ee4b2 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event updated for resources: {'Network': ['ID=8ba15102-a672-4533-9362-f6c76f494e4e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:06.121719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-99eac064-86de-4e67-8cad-ebcd45366584 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:06.122571 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:06.131259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-99eac064-86de-4e67-8cad-ebcd45366584 admin admin] Usage tracker for resource:security_group_rule and tenant:866d917557b74ca8a59abf8e35ed5573 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:06.136600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-99eac064-86de-4e67-8cad-ebcd45366584 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:06.146694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Transition to ACTIVE for port object bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:06.160136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-99eac064-86de-4e67-8cad-ebcd45366584 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:06.190105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Transition to ACTIVE for port object bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:06.211414 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 8ba15102-a672-4533-9362-f6c76f494e4e details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:32:06.250857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffd489ca-0d22-4151-aea1-799183448d82 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:06.268143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffd489ca-0d22-4151-aea1-799183448d82 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:06.285161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5735801a-f1f7-4064-908a-9e6adb656798 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:06.286430 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffd489ca-0d22-4151-aea1-799183448d82 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:06.288285 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5735801a-f1f7-4064-908a-9e6adb656798 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 1.5394540 May 12 15:32:06.305203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52282) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:06.316054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffd489ca-0d22-4151-aea1-799183448d82 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:06.329093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ffd489ca-0d22-4151-aea1-799183448d82 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2452 time: 0.6803317 May 12 15:32:06.336267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52290) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:06.337229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'port': {'network_id': '3af91feb-4088-4b4d-836a-7e8054906de2', 'name': 'tempest-RoutersIpV6Test-977125716'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:06.573257 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:06.752242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Allocated IP 172.25.8.148 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/96d50894-0a98-4aff-9097-44452345b862) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:32:06.756288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Attempting to bind port c779e8fa-022b-430d-9eb2-833a2d42e6de on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:06.759321 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Attempting to bind port c779e8fa-022b-430d-9eb2-833a2d42e6de by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:06.759941 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Attempting to bind port c779e8fa-022b-430d-9eb2-833a2d42e6de on network bca349be-4618-43ae-a547-b8bd2b254da4 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:06.760670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:06.766507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Network 3af91feb-4088-4b4d-836a-7e8054906de2 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:06.771810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:06.778072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:06.780973 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 31, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:32:06.782272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Checking segment: {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:32:06.783022 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:06.783646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Bound using segment: {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:32:06.783858 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-627df3d8-9ee0-4ec4-810b-fbe5e7092c9f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:06.784554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Bound port: c779e8fa-022b-430d-9eb2-833a2d42e6de, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:32:06.785165 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:06.799391 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Pushing event updated for resources: {'Port': ['ID=bfb73fca-11c4-42f9-942d-9fdf5ebb5e10,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:06.807795 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:port and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:06.831725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:06.937082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:07.000575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99eac064-86de-4e67-8cad-ebcd45366584 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.035876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:07.043129 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.102528 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99eac064-86de-4e67-8cad-ebcd45366584 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.164983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Attempting to bind port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:07.165652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Attempting to bind port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ec07d999-a5e5-4d9e-8863-5aef618b5e17', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': '3af91feb-4088-4b4d-836a-7e8054906de2'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:07.166274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Attempting to bind port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 on network 3af91feb-4088-4b4d-836a-7e8054906de2 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:07.187016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 31, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:32:07.194070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Checking segment: {'id': 'ec07d999-a5e5-4d9e-8863-5aef618b5e17', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': '3af91feb-4088-4b4d-836a-7e8054906de2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:32:07.194793 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.195740 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Bound using segment: {'id': 'ec07d999-a5e5-4d9e-8863-5aef618b5e17', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': '3af91feb-4088-4b4d-836a-7e8054906de2'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:32:07.196713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Bound port: bfb73fca-11c4-42f9-942d-9fdf5ebb5e10, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ec07d999-a5e5-4d9e-8863-5aef618b5e17', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': '3af91feb-4088-4b4d-836a-7e8054906de2'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:32:07.197524 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.248679 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-627df3d8-9ee0-4ec4-810b-fbe5e7092c9f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.293768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-627df3d8-9ee0-4ec4-810b-fbe5e7092c9f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8ba15102-a672-4533-9362-f6c76f494e4e']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:07.311531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-627df3d8-9ee0-4ec4-810b-fbe5e7092c9f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '491e98a4-ae2f-480b-a27b-756f893dff95') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:07.311825 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-627df3d8-9ee0-4ec4-810b-fbe5e7092c9f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '491e98a4-ae2f-480b-a27b-756f893dff95') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:07.325399 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-627df3d8-9ee0-4ec4-810b-fbe5e7092c9f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.325925 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.336434 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30d87277-e4ea-4811-8c97-0f701def578f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.351290 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-627df3d8-9ee0-4ec4-810b-fbe5e7092c9f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.360179 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-627df3d8-9ee0-4ec4-810b-fbe5e7092c9f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Releasing vlan 568 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:32:07.360547 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-627df3d8-9ee0-4ec4-810b-fbe5e7092c9f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.373592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30d87277-e4ea-4811-8c97-0f701def578f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=baa7822e-d55d-4971-ad0d-31d688b596fb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:07.384017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] device_id is not set on port c415100a-0a4a-4e06-bf8f-456f889a4415 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: timer() May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:32:07.398986 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:32:07.448491 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30d87277-e4ea-4811-8c97-0f701def578f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.450423 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-30d87277-e4ea-4811-8c97-0f701def578f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/baa7822e-d55d-4971-ad0d-31d688b596fb HTTP/1.1" status: 204 len: 168 time: 1.7577064 May 12 15:32:07.474840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] For port c779e8fa-022b-430d-9eb2-833a2d42e6de, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:32:07.557485 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-99eac064-86de-4e67-8cad-ebcd45366584 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=866d917557b74ca8a59abf8e35ed5573&name=default HTTP/1.1" status: 200 len: 2983 time: 1.9395833 May 12 15:32:07.565033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52306) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:07.567207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] For port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:32:07.577122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] For port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=bfb73fca-11c4-42f9-942d-9fdf5ebb5e10,segment=NetworkSegment(ec07d999-a5e5-4d9e-8863-5aef618b5e17),segment_id=ec07d999-a5e5-4d9e-8863-5aef618b5e17)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:32:07.586130 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.636917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99eac064-86de-4e67-8cad-ebcd45366584 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d88c026-4f57-429a-a267-66224da8e4ed,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:07.675204 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3a67faf4-1a10-4971-ae91-df4328449908 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.702119 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-627df3d8-9ee0-4ec4-810b-fbe5e7092c9f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.801487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-688e684a-6091-45f4-bdcb-84a1dbafbc16 None None] Pushing event updated for resources: {'Port': ['ID=bfb73fca-11c4-42f9-942d-9fdf5ebb5e10,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:07.816921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-627df3d8-9ee0-4ec4-810b-fbe5e7092c9f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 8ba15102-a672-4533-9362-f6c76f494e4e {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:124}} May 12 15:32:07.816921 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-627df3d8-9ee0-4ec4-810b-fbe5e7092c9f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.825468 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.873022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-627df3d8-9ee0-4ec4-810b-fbe5e7092c9f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event deleted for resources: {'Network': ['ID=8ba15102-a672-4533-9362-f6c76f494e4e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:07.883935 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3a67faf4-1a10-4971-ae91-df4328449908 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.897523 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-627df3d8-9ee0-4ec4-810b-fbe5e7092c9f tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "DELETE /v2.0/networks/8ba15102-a672-4533-9362-f6c76f494e4e HTTP/1.1" status: 204 len: 168 time: 1.5479949 May 12 15:32:07.898465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52312) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:07.903437 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] For port c779e8fa-022b-430d-9eb2-833a2d42e6de, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c779e8fa-022b-430d-9eb2-833a2d42e6de,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:32:07.910739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Request body: {'network': {'name': 'tempest-network--192590337', 'router:external': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:07.916660 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:07.926808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:07.944680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Usage tracker for resource:network and tenant:cf9709fca9b64338a050eef7c36e0c1d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:07.991611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:08.018431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:08.025355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:08.030248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Made reservation on behalf of cf9709fca9b64338a050eef7c36e0c1d for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:08.037589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:08.051893 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:08.071576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:08.084707 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3a67faf4-1a10-4971-ae91-df4328449908 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:08.095075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Allocated IP 2001:db8::173 (3af91feb-4088-4b4d-836a-7e8054906de2/61ef0890-0de1-422e-8893-8072b324254e/c415100a-0a4a-4e06-bf8f-456f889a4415) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:32:08.120361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 577} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:32:08.132949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Pushing event updated for resources: {'Port': ['ID=96d50894-0a98-4aff-9097-44452345b862,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:08.133237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a67faf4-1a10-4971-ae91-df4328449908 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d88c026-4f57-429a-a267-66224da8e4ed,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:08.165817 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:08.165817 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Added segment 95490652-86d9-43c1-9d48-417221bcba07 of type vlan for network 68665c76-fce5-4b01-a06b-837e588070a5 May 12 15:32:08.189302 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3a67faf4-1a10-4971-ae91-df4328449908 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:08.197906 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3a67faf4-1a10-4971-ae91-df4328449908 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4d88c026-4f57-429a-a267-66224da8e4ed HTTP/1.1" status: 204 len: 168 time: 0.6318419 May 12 15:32:08.232758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e0eaf45-4036-4665-9e46-a7be24eb90c2 None None] Pushing event updated for resources: {'Port': ['ID=c779e8fa-022b-430d-9eb2-833a2d42e6de,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:08.324031 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:08.502131 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:08.503239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:08.503691 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:08.654725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 862 time: 0.7517006 May 12 15:32:08.654725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52330) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:08.655061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52332) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:09.056549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecde0aad-36ee-4304-9e68-1fd83d766518 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event updated for resources: {'Network': ['ID=68665c76-fce5-4b01-a06b-837e588070a5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:09.072989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 68665c76-fce5-4b01-a06b-837e588070a5 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:32:09.110627 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3e5bffb5-7e51-47c3-b9ce-61e917e7c801 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=352d2ada27bd455abedc3dabac947fa7&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3238575 May 12 15:32:09.114611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52344) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:09.167632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0274371b-c1ab-404f-a442-b7391175d9b2 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:09.181373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0274371b-c1ab-404f-a442-b7391175d9b2 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] 10.222.0.82 "GET /v2.0/networks/68665c76-fce5-4b01-a06b-837e588070a5 HTTP/1.1" status: 200 len: 756 time: 0.3971348 May 12 15:32:09.184170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52348) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:09.446044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c779e8fa-022b-430d-9eb2-833a2d42e6de up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:32:09.567281 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a6a645f-bb15-4c46-9239-198b9ff0c52e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:09.740434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port c779e8fa-022b-430d-9eb2-833a2d42e6de completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:09.758897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1723b78c-7bcc-4f69-958e-b0ce39ba7dee tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:09.762888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:32:09.766759 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1723b78c-7bcc-4f69-958e-b0ce39ba7dee tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] 10.222.0.82 "GET /v2.0/networks/87e6b451-eaee-481c-8d53-cea1d91c1b1a HTTP/1.1" status: 200 len: 766 time: 0.5792348 May 12 15:32:09.802661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52362) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:09.971876 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a6a645f-bb15-4c46-9239-198b9ff0c52e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:09.984634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:10.133681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b5be969-0f14-4e98-9a49-d425d55db8a8 None None] Network 3af91feb-4088-4b4d-836a-7e8054906de2 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:32:10.379650 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:10.379650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Transition to ACTIVE for port object c415100a-0a4a-4e06-bf8f-456f889a4415 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:10.379650 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:10.526502 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25809aa4-3e1a-4473-8128-8c3c15861c10 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:10.558020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7c209812-884c-4734-acda-4d4e7efe7e84 None None] Provisioning for port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:10.604853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7c209812-884c-4734-acda-4d4e7efe7e84 None None] Provisioning complete for port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:10.618853 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7c209812-884c-4734-acda-4d4e7efe7e84 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:10.654207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=c415100a-0a4a-4e06-bf8f-456f889a4415,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:10.707739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2da38828-4850-460b-862f-bbf6f9ae10a4 None None] Network bca349be-4618-43ae-a547-b8bd2b254da4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:32:10.809059 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a6a645f-bb15-4c46-9239-198b9ff0c52e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:10.819937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 3af91feb-4088-4b4d-836a-7e8054906de2 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:10.852674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:10.869322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:10.883309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:10.883309 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:10.973524 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:11.050360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a6a645f-bb15-4c46-9239-198b9ff0c52e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e20b528-e65b-48a8-b0da-03c20cd932bb,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:11.064496 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a6a645f-bb15-4c46-9239-198b9ff0c52e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:11.069793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1a6a645f-bb15-4c46-9239-198b9ff0c52e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8e20b528-e65b-48a8-b0da-03c20cd932bb HTTP/1.1" status: 204 len: 168 time: 1.9539165 May 12 15:32:11.086452 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25809aa4-3e1a-4473-8128-8c3c15861c10 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:11.179105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-25809aa4-3e1a-4473-8128-8c3c15861c10 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['68665c76-fce5-4b01-a06b-837e588070a5']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:11.221643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-25809aa4-3e1a-4473-8128-8c3c15861c10 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '95490652-86d9-43c1-9d48-417221bcba07') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:11.221643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-25809aa4-3e1a-4473-8128-8c3c15861c10 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '95490652-86d9-43c1-9d48-417221bcba07') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:11.272606 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25809aa4-3e1a-4473-8128-8c3c15861c10 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:11.356508 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25809aa4-3e1a-4473-8128-8c3c15861c10 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:11.401297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-25809aa4-3e1a-4473-8128-8c3c15861c10 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Releasing vlan 577 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:32:11.401677 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25809aa4-3e1a-4473-8128-8c3c15861c10 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:11.793460 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ef003636-26ab-4b98-9060-083d9f37807a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 5.4868314 May 12 15:32:11.807839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52420) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: timer() May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:32:12.122574 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:32:12.258699 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25809aa4-3e1a-4473-8128-8c3c15861c10 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:12.312638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25809aa4-3e1a-4473-8128-8c3c15861c10 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 68665c76-fce5-4b01-a06b-837e588070a5 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:124}} May 12 15:32:12.333658 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25809aa4-3e1a-4473-8128-8c3c15861c10 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:12.355539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25809aa4-3e1a-4473-8128-8c3c15861c10 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event deleted for resources: {'Network': ['ID=68665c76-fce5-4b01-a06b-837e588070a5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:12.377809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-25809aa4-3e1a-4473-8128-8c3c15861c10 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "DELETE /v2.0/networks/68665c76-fce5-4b01-a06b-837e588070a5 HTTP/1.1" status: 204 len: 168 time: 2.5706370 May 12 15:32:12.381273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52436) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:12.388684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Request body: {'network': {'name': 'tempest-network--437462344'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:12.420731 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7c209812-884c-4734-acda-4d4e7efe7e84 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:12.434723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:12.442983 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Usage tracker for resource:network and tenant:cf9709fca9b64338a050eef7c36e0c1d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:12.466066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:12.482984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:12.519431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Made reservation on behalf of cf9709fca9b64338a050eef7c36e0c1d for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:12.522828 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:12.549723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-7c209812-884c-4734-acda-4d4e7efe7e84 None None] For port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=bfb73fca-11c4-42f9-942d-9fdf5ebb5e10,segment=NetworkSegment(ec07d999-a5e5-4d9e-8863-5aef618b5e17),segment_id=ec07d999-a5e5-4d9e-8863-5aef618b5e17)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:12.585961 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7c209812-884c-4734-acda-4d4e7efe7e84 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:12.637321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 576} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:32:12.678790 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:12.679134 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Added segment b39e22c3-7324-4db1-aea0-3d28b4de1fea of type vlan for network bfa0e305-4111-4201-9c5c-3e8b1731a93c May 12 15:32:12.785377 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:12.826938 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-29469339-f066-4249-ae25-027331d4e3a8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:12.870015 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:12.871395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:12.872261 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:12.921653 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:12.935583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c209812-884c-4734-acda-4d4e7efe7e84 None None] Pushing event updated for resources: {'Port': ['ID=bfb73fca-11c4-42f9-942d-9fdf5ebb5e10,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:12.952176 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3f798075-8bd0-4f1f-a6b7-cef58186f44b None None] Provisioning for port c779e8fa-022b-430d-9eb2-833a2d42e6de completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:12.977567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 0.5950992 May 12 15:32:12.983817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3f798075-8bd0-4f1f-a6b7-cef58186f44b None None] Provisioning complete for port c779e8fa-022b-430d-9eb2-833a2d42e6de triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:12.984190 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3f798075-8bd0-4f1f-a6b7-cef58186f44b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:12.999321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52454) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:13.171612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52462) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:13.263723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0f673f7b-b7ff-425e-bf8f-1782fb949492 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Request body: {'network': {'router:external': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:13.313240 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:13.313240 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:32:13.676022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f6468b7-fcf5-4a0f-8135-26958af8a8ad tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event updated for resources: {'Network': ['ID=bfa0e305-4111-4201-9c5c-3e8b1731a93c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:13.829419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network bfa0e305-4111-4201-9c5c-3e8b1731a93c details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:32:14.035953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:14.035953 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:14.177703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f673f7b-b7ff-425e-bf8f-1782fb949492 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:14.247093 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f673f7b-b7ff-425e-bf8f-1782fb949492 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:14.251611 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3f798075-8bd0-4f1f-a6b7-cef58186f44b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:14.635336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-3f798075-8bd0-4f1f-a6b7-cef58186f44b None None] For port c779e8fa-022b-430d-9eb2-833a2d42e6de, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c779e8fa-022b-430d-9eb2-833a2d42e6de,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:14.647508 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3f798075-8bd0-4f1f-a6b7-cef58186f44b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:14.673329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-0f673f7b-b7ff-425e-bf8f-1782fb949492 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Network bfa0e305-4111-4201-9c5c-3e8b1731a93c is not hosted by any dhcp agent {{(pid=88152) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:228}} May 12 15:32:14.673329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f673f7b-b7ff-425e-bf8f-1782fb949492 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:14.677434 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f673f7b-b7ff-425e-bf8f-1782fb949492 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:14.677434 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0f673f7b-b7ff-425e-bf8f-1782fb949492 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "PUT /v2.0/networks/bfa0e305-4111-4201-9c5c-3e8b1731a93c HTTP/1.1" status: 200 len: 857 time: 1.6502857 May 12 15:32:14.677434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f673f7b-b7ff-425e-bf8f-1782fb949492 tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event updated for resources: {'Network': ['ID=bfa0e305-4111-4201-9c5c-3e8b1731a93c,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:14.684855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52490) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:14.753339 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-test-network-1237832142'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:14.768173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:14.798139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Usage tracker for resource:network and tenant:fd1a08f1a29d4cf3bf91e8d8729484ac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:14.852041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-db6b2f53-a770-4d6f-8e2b-69aad47fe965 None None] Provisioning complete for port c779e8fa-022b-430d-9eb2-833a2d42e6de triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:14.858734 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a2db591f-100c-4079-b9bb-23651df7185c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:14.861875 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-db6b2f53-a770-4d6f-8e2b-69aad47fe965 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:14.882184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:14.935264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:15.097936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Made reservation on behalf of fd1a08f1a29d4cf3bf91e8d8729484ac for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:15.116216 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:15.120085 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a2db591f-100c-4079-b9bb-23651df7185c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:15.172820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a2db591f-100c-4079-b9bb-23651df7185c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bfa0e305-4111-4201-9c5c-3e8b1731a93c']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:15.184622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f798075-8bd0-4f1f-a6b7-cef58186f44b None None] Pushing event updated for resources: {'Port': ['ID=c779e8fa-022b-430d-9eb2-833a2d42e6de,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:15.194612 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-72857cac-b758-402a-b8b3-0dd4df0c02b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:15.199383 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:15.209508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a2db591f-100c-4079-b9bb-23651df7185c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b39e22c3-7324-4db1-aea0-3d28b4de1fea') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:15.209804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a2db591f-100c-4079-b9bb-23651df7185c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b39e22c3-7324-4db1-aea0-3d28b4de1fea') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:15.224251 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a2db591f-100c-4079-b9bb-23651df7185c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:15.243948 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a2db591f-100c-4079-b9bb-23651df7185c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:15.251666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a2db591f-100c-4079-b9bb-23651df7185c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Releasing vlan 576 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:32:15.252247 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a2db591f-100c-4079-b9bb-23651df7185c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:15.254766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:15.375216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:15.382700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Usage tracker for resource:security_group_rule and tenant:fd1a08f1a29d4cf3bf91e8d8729484ac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:15.383340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-db6b2f53-a770-4d6f-8e2b-69aad47fe965 None None] Provisioning for port c415100a-0a4a-4e06-bf8f-456f889a4415 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:15.388572 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-db6b2f53-a770-4d6f-8e2b-69aad47fe965 None None] Provisioning complete for port c415100a-0a4a-4e06-bf8f-456f889a4415 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:15.389420 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-db6b2f53-a770-4d6f-8e2b-69aad47fe965 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:15.403831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: timer() May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:32:15.444111 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:32:15.459322 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a2db591f-100c-4079-b9bb-23651df7185c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:15.484846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a2db591f-100c-4079-b9bb-23651df7185c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network bfa0e305-4111-4201-9c5c-3e8b1731a93c {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:124}} May 12 15:32:15.513628 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a2db591f-100c-4079-b9bb-23651df7185c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:15.531259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:15.633196 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a2db591f-100c-4079-b9bb-23651df7185c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] 10.222.0.82 "DELETE /v2.0/networks/bfa0e305-4111-4201-9c5c-3e8b1731a93c HTTP/1.1" status: 204 len: 168 time: 0.9525206 May 12 15:32:15.643241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52508) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:15.672997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Router 3b0baf01-29b6-49bc-81af-4ed638af06f3 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:32:15.759242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-db6b2f53-a770-4d6f-8e2b-69aad47fe965 None None] Port c415100a-0a4a-4e06-bf8f-456f889a4415 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:32:15.766629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2db591f-100c-4079-b9bb-23651df7185c tempest-ExternalNetworksTestJSON-1938192748 tempest-ExternalNetworksTestJSON-1938192748-project-admin] Pushing event deleted for resources: {'Network': ['ID=bfa0e305-4111-4201-9c5c-3e8b1731a93c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:15.785417 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-77783e6b-41fd-4403-b130-ccf35d740fb2 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] DELETE failed (client error): The resource could not be found. May 12 15:32:15.786201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-77783e6b-41fd-4403-b130-ccf35d740fb2 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:32:15.792747 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-77783e6b-41fd-4403-b130-ccf35d740fb2 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] 10.222.0.82 "DELETE /v2.0/subnets/34a2f1b6-9655-4e70-b7a6-9b35afeffd73 HTTP/1.1" status: 404 len: 337 time: 0.1391373 May 12 15:32:15.795823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52518) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:15.807165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-db6b2f53-a770-4d6f-8e2b-69aad47fe965 None None] Provisioning complete for port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:15.812495 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-db6b2f53-a770-4d6f-8e2b-69aad47fe965 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:16.107991 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:16.257892 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9adcf79a-b6b8-42ac-a798-0f02f83852d1 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:16.397985 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:16.748794 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9adcf79a-b6b8-42ac-a798-0f02f83852d1 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:16.867281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9adcf79a-b6b8-42ac-a798-0f02f83852d1 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['87e6b451-eaee-481c-8d53-cea1d91c1b1a']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:16.941127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9adcf79a-b6b8-42ac-a798-0f02f83852d1 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'de6c73a0-89d7-42fc-abfc-b076ed6e6245') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:16.945284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9adcf79a-b6b8-42ac-a798-0f02f83852d1 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'de6c73a0-89d7-42fc-abfc-b076ed6e6245') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:16.989255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9adcf79a-b6b8-42ac-a798-0f02f83852d1 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:17.028126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52544) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:17.136491 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9adcf79a-b6b8-42ac-a798-0f02f83852d1 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:17.161400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9adcf79a-b6b8-42ac-a798-0f02f83852d1 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Releasing vlan 560 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:32:17.161400 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9adcf79a-b6b8-42ac-a798-0f02f83852d1 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:17.254685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c779e8fa-022b-430d-9eb2-833a2d42e6de up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:32:17.470474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c779e8fa-022b-430d-9eb2-833a2d42e6de triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:17.474069 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: timer() May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:32:17.535264 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:32:17.624947 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:17.648380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6b9347d4-ac73-4e48-8036-5b75319fd59c tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Request body: {'quota': {'network': 0, 'port': 0}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:17.665955 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:17.724234 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9adcf79a-b6b8-42ac-a798-0f02f83852d1 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:17.782766 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9adcf79a-b6b8-42ac-a798-0f02f83852d1 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:17.807108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9adcf79a-b6b8-42ac-a798-0f02f83852d1 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] Pushing event deleted for resources: {'Network': ['ID=87e6b451-eaee-481c-8d53-cea1d91c1b1a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:17.809064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=c415100a-0a4a-4e06-bf8f-456f889a4415,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:17.812752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:32:17.828064 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9adcf79a-b6b8-42ac-a798-0f02f83852d1 tempest-ExternalNetworksTestJSON-2028001903 tempest-ExternalNetworksTestJSON-2028001903-project] 10.222.0.82 "DELETE /v2.0/networks/87e6b451-eaee-481c-8d53-cea1d91c1b1a HTTP/1.1" status: 204 len: 168 time: 2.0288465 May 12 15:32:17.840785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Sync routers for ids ['3b0baf01-29b6-49bc-81af-4ed638af06f3'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:32:17.867383 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:17.869340 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-12466901-7acc-4734-a60f-6b03f2e44d99 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 14.1999915 May 12 15:32:17.873998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52558) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:17.885059 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:17.885922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6b9347d4-ac73-4e48-8036-5b75319fd59c tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] 10.222.0.82 "PUT /v2.0/quotas/2dda41f848274f8d996a7c04f3dec241 HTTP/1.1" status: 200 len: 366 time: 0.8543077 May 12 15:32:17.886869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52562) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:17.910504 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:17.921016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:17.955150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Routers {'3b0baf01-29b6-49bc-81af-4ed638af06f3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:32:17.955806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b0baf01-29b6-49bc-81af-4ed638af06f3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:18.005181 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 597} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:32:18.139007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Pushing event updated for resources: {'SecurityGroup': ['ID=84f44d44-ba64-42e5-8f7a-d0981a93ce05,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:18.178322 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:18.180541 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Added segment fecf08dc-b12f-4ce2-aeab-61f7864f17ea of type vlan for network 23f523e9-0880-4d90-990d-969ff64c60e0 May 12 15:32:18.286984 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9e509720-ee99-4790-863f-72bd09352ce5 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] 10.222.0.82 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 468 time: 0.3897150 May 12 15:32:18.312724 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52570) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:18.450024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-274ff97f-8ea0-43ba-ae3a-f9ab583807a6 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] 10.222.0.82 "GET /v2.0/quotas/2dda41f848274f8d996a7c04f3dec241 HTTP/1.1" status: 200 len: 366 time: 0.1139016 May 12 15:32:18.455102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52578) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:18.571904 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:18.707060 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:18.760115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-987d957f-9494-4ae3-8b8a-4bb55dacea71 None None] Provisioning complete for port c415100a-0a4a-4e06-bf8f-456f889a4415 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:18.762157 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-987d957f-9494-4ae3-8b8a-4bb55dacea71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:18.765851 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6998fa4f-b748-4f39-aa8e-b9d77b2008a7 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] 10.222.0.82 "DELETE /v2.0/quotas/2dda41f848274f8d996a7c04f3dec241 HTTP/1.1" status: 204 len: 168 time: 0.2853608 May 12 15:32:18.777418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52584) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:18.787853 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:18.797932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:18.802353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:18.838080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Set router 3b0baf01-29b6-49bc-81af-4ed638af06f3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:32:18.946381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52588) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:19.015378 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fd6d2613-0297-4749-af5a-746fb4bc0d73 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] 10.222.0.82 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 207 time: 0.2213583 May 12 15:32:19.062827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52594) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:19.142847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Pushing event updated for resources: {'Network': ['ID=23f523e9-0880-4d90-990d-969ff64c60e0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:19.157680 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-39b3d4ab-7308-4277-9efb-8cdff6e09560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 803 time: 5.6627438 May 12 15:32:19.178964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 23f523e9-0880-4d90-990d-969ff64c60e0 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:32:19.189116 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5b7fe6f9-cbba-41f8-9168-256c0ea2b32d tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] 10.222.0.82 "GET /v2.0/quotas/2dda41f848274f8d996a7c04f3dec241 HTTP/1.1" status: 200 len: 370 time: 0.0498297 May 12 15:32:19.193803 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52606) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:19.290636 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b79a36e9-a343-40f9-9e16-2e74251020a0 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] 10.222.0.82 "GET /v2.0/quotas/2dda41f848274f8d996a7c04f3dec241/default HTTP/1.1" status: 200 len: 370 time: 0.0818694 May 12 15:32:19.295008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52612) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:19.371223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:19.535983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-987d957f-9494-4ae3-8b8a-4bb55dacea71 None None] Port c415100a-0a4a-4e06-bf8f-456f889a4415 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:32:19.664774 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-12433aaa-cd1c-4a23-856c-c15d00f183fb tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] delete failed (client error): The resource could not be found. May 12 15:32:19.664774 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-12433aaa-cd1c-4a23-856c-c15d00f183fb tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] 10.222.0.82 "DELETE /v2.0/quotas/2dda41f848274f8d996a7c04f3dec241 HTTP/1.1" status: 404 len: 348 time: 0.3657606 May 12 15:32:19.816394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52624) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:19.859142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Request body: {'port': {'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0', 'binding:host_id': 'n-h2-841483-1', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-1734906615'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:19.908782 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:32:19.918470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:19.930270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Usage tracker for resource:port and tenant:8d9d0187e68e4feda08559a57b3c422f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:19.942766 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-381f9fe3-8283-4bbf-b42b-e6e85a1cb22e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=13bfac9f40134d1094df0bd7216b72a3&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9995298 May 12 15:32:19.944168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:19.959181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52630) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:19.967825 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:20.019268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:09Z', 'revision_number': 3, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:20.021734 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:20.029607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Checking router: 3b0baf01-29b6-49bc-81af-4ed638af06f3 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:32:20.031521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Updating router 3b0baf01-29b6-49bc-81af-4ed638af06f3 port 96d50894-0a98-4aff-9097-44452345b862 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:32:20.037581 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Made reservation on behalf of 8d9d0187e68e4feda08559a57b3c422f for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:20.040285 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:20.086362 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:20.173298 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:20.185950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52634) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:20.321877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:20.328615 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-114844c1-3b74-4620-8e06-ea35979554ae admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:20.347470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Usage tracker for resource:security_group_rule and tenant:8d9d0187e68e4feda08559a57b3c422f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:20.355054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Usage tracker for resource:network and tenant:0cd45f3e3f0f473989eb90b400880be4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:20.357593 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:20.400856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:20.424644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:20.502675 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-114844c1-3b74-4620-8e06-ea35979554ae admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:20.557171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Usage tracker for resource:subnet and tenant:0cd45f3e3f0f473989eb90b400880be4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:20.568833 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:20.584886 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:20.587736 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:20.603743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:20.791314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Usage tracker for resource:subnetpool and tenant:0cd45f3e3f0f473989eb90b400880be4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:20.801730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Quota usage for subnetpool was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:20.858117 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-114844c1-3b74-4620-8e06-ea35979554ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:20.979780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-114844c1-3b74-4620-8e06-ea35979554ae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c6589b9e-01c0-4e7b-b377-629aafcd0ddb,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:20.992130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=c415100a-0a4a-4e06-bf8f-456f889a4415,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:20.993371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Usage tracker for resource:port and tenant:0cd45f3e3f0f473989eb90b400880be4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:21.035408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:21.047212 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:21.061691 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-114844c1-3b74-4620-8e06-ea35979554ae admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:21.064025 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-114844c1-3b74-4620-8e06-ea35979554ae admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c6589b9e-01c0-4e7b-b377-629aafcd0ddb HTTP/1.1" status: 204 len: 168 time: 1.1012042 May 12 15:32:21.065266 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:21.177624 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:21.190686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Usage tracker for resource:router and tenant:0cd45f3e3f0f473989eb90b400880be4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:21.190686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] device_id is not set on port 43595a6d-4ed2-4c44-be3d-7267b28a205e yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:32:21.205544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 3af91feb-4088-4b4d-836a-7e8054906de2 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:21.217862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:21.238483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Transition to ACTIVE for port object 96d50894-0a98-4aff-9097-44452345b862 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:21.247709 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:21.361318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ec6ae84-9edf-4687-a69e-b7226ca32fd4,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:21.382916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Allocated IP 172.20.0.1 (bca349be-4618-43ae-a547-b8bd2b254da4/aa771580-393c-41f8-ad67-611be21e45d3/2cefb78b-eff7-47cb-8160-89f1ff42943b) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:32:21.481675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:21.540214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Attempting to bind port 96d50894-0a98-4aff-9097-44452345b862 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:21.543217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Attempting to bind port 96d50894-0a98-4aff-9097-44452345b862 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:21.543821 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Attempting to bind port 96d50894-0a98-4aff-9097-44452345b862 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:21.591846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 32, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:32:21.597999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:32:21.599474 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:21.600692 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:32:21.601642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Bound port: 96d50894-0a98-4aff-9097-44452345b862, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:32:21.602214 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:21.864090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] For port 96d50894-0a98-4aff-9097-44452345b862, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:32:21.880951 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] For port 96d50894-0a98-4aff-9097-44452345b862, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=96d50894-0a98-4aff-9097-44452345b862,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:32:21.883620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1024294-2c2a-4e7f-a658-43c176b4f474 None None] Pushing event updated for resources: {'Port': ['ID=96d50894-0a98-4aff-9097-44452345b862,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:21.900971 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:22.003720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b455ecd3-34e9-445a-8be4-ba555dc1ed56 None None] Provisioning complete for port c415100a-0a4a-4e06-bf8f-456f889a4415 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:22.004104 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b455ecd3-34e9-445a-8be4-ba555dc1ed56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:22.030853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:32:22.194305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b455ecd3-34e9-445a-8be4-ba555dc1ed56 None None] Port c415100a-0a4a-4e06-bf8f-456f889a4415 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:32:22.207855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Usage tracker for resource:floatingip and tenant:0cd45f3e3f0f473989eb90b400880be4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:22.270545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:22.274947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52662) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:22.275553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Routers {'3b0baf01-29b6-49bc-81af-4ed638af06f3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:32:22.276197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b0baf01-29b6-49bc-81af-4ed638af06f3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:22.385653 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1024294-2c2a-4e7f-a658-43c176b4f474 None None] Pushing event updated for resources: {'Port': ['ID=96d50894-0a98-4aff-9097-44452345b862,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:22.483211 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fe3fecf2-797c-4d70-b58f-ac848f842832 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=cf9709fca9b64338a050eef7c36e0c1d&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1875932 May 12 15:32:22.483211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52668) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:22.549129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:32:22.549129 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3c7e72d7-067f-44ba-9f2d-a3fe3208d824 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.7346785 May 12 15:32:22.549129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52672) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:22.562535 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f56631a-6933-45d1-b32f-48c8f8dc084b None None] Sync routers for ids ['0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:32:22.579280 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f56631a-6933-45d1-b32f-48c8f8dc084b None None] Routers {'0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:32:22.579280 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8f56631a-6933-45d1-b32f-48c8f8dc084b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:22.646660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] Set router 3b0baf01-29b6-49bc-81af-4ed638af06f3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:32:22.719776 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8f56631a-6933-45d1-b32f-48c8f8dc084b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:22.728828 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f56631a-6933-45d1-b32f-48c8f8dc084b None None] Routers {'0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:32:22.730728 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8f56631a-6933-45d1-b32f-48c8f8dc084b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:22.817076 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8f56631a-6933-45d1-b32f-48c8f8dc084b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:22.817076 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f56631a-6933-45d1-b32f-48c8f8dc084b None None] The sync data for ids ['0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:32:22.868987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:22.918125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Transition to ACTIVE for port object 2cefb78b-eff7-47cb-8160-89f1ff42943b will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:22.925021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b637937-725b-4e6a-8d82-eb6bd66d943b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:22.925021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0b637937-725b-4e6a-8d82-eb6bd66d943b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Synchronizing usage tracker for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:32:23.012533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0b637937-725b-4e6a-8d82-eb6bd66d943b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Unset dirty status for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:32:23.020189 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0b637937-725b-4e6a-8d82-eb6bd66d943b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports/c415100a-0a4a-4e06-bf8f-456f889a4415 HTTP/1.1" status: 200 len: 983 time: 0.4662848 May 12 15:32:23.025175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52682) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:23.027135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] device_id is not set on port 43595a6d-4ed2-4c44-be3d-7267b28a205e yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:32:23.089780 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:23.360941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Transition to ACTIVE for port object 43595a6d-4ed2-4c44-be3d-7267b28a205e will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:23.378242 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:23.479510 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:23.676993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:09Z', 'revision_number': 3, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:23.680888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Network bca349be-4618-43ae-a547-b8bd2b254da4 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:23.683895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d748d97-945f-4065-a0d9-a98b5a160feb None None] The sync data for ids ['3b0baf01-29b6-49bc-81af-4ed638af06f3'] in n-d-841483-1 is: [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:09Z', 'revision_number': 3, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:32:23.755280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:23.771117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:23.942902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Usage tracker for resource:security_group and tenant:0cd45f3e3f0f473989eb90b400880be4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:23.992616 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Quota usage for security_group was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:24.016071 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-35e5a2bb-a541-4b87-8632-fe296e302386 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:24.133135 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-35e5a2bb-a541-4b87-8632-fe296e302386 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:24.445133 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:24.483011 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-35e5a2bb-a541-4b87-8632-fe296e302386 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:24.501923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Pushing event updated for resources: {'Port': ['ID=2cefb78b-eff7-47cb-8160-89f1ff42943b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:24.548568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3e92d91e-bf34-4b65-acaa-4cfcde7276fa None None] Provisioning for port 2cefb78b-eff7-47cb-8160-89f1ff42943b completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:24.572311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Usage tracker for resource:security_group_rule and tenant:0cd45f3e3f0f473989eb90b400880be4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:24.576639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3e92d91e-bf34-4b65-acaa-4cfcde7276fa None None] Provisioning complete for port 2cefb78b-eff7-47cb-8160-89f1ff42943b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:24.577046 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3e92d91e-bf34-4b65-acaa-4cfcde7276fa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:24.598345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:24.656919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Checking segment: {'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:32:24.657699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Network hostable DHCP agents. Network: 23f523e9-0880-4d90-990d-969ff64c60e0, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:32:24.665206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35e5a2bb-a541-4b87-8632-fe296e302386 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ef1bdf9-dcdf-459e-88a1-353da4f98ddd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:24.723136 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a8683e22-86f1-477d-b04d-f3dc0126ddb9 tempest-QuotasTest-578265832 tempest-QuotasTest-578265832-project-admin] 10.222.0.82 "GET /v2.0/quotas/0cd45f3e3f0f473989eb90b400880be4/details.json HTTP/1.1" status: 200 len: 703 time: 4.4805512 May 12 15:32:24.968616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3e92d91e-bf34-4b65-acaa-4cfcde7276fa None None] Port 2cefb78b-eff7-47cb-8160-89f1ff42943b cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:32:25.010062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e831946a-c6b1-4358-b9f4-0b8b136d86c0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:25.259898 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-35e5a2bb-a541-4b87-8632-fe296e302386 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:25.267443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-35e5a2bb-a541-4b87-8632-fe296e302386 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7ef1bdf9-dcdf-459e-88a1-353da4f98ddd HTTP/1.1" status: 204 len: 168 time: 2.7536426 May 12 15:32:25.286182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Pushing event updated for resources: {'Port': ['ID=43595a6d-4ed2-4c44-be3d-7267b28a205e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:25.488223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 96d50894-0a98-4aff-9097-44452345b862 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:32:25.612930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Network 23f523e9-0880-4d90-990d-969ff64c60e0 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:32:25.629495 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:25.710383 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52726) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:25.922979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 96d50894-0a98-4aff-9097-44452345b862 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:25.931857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 23f523e9-0880-4d90-990d-969ff64c60e0) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:25.966684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:25.977287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 96d50894-0a98-4aff-9097-44452345b862 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:25.978579 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:26.048336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:26.048753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:26.049153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:26.069515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:26.070015 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:26.077479 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 2 to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e May 12 15:32:26.131867 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac15669c-06ed-46c0-a9c8-6449e0f20bd5 None None] Network 23f523e9-0880-4d90-990d-969ff64c60e0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:32:26.175265 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:26.176780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:26.178644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:26.238464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:26.238802 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:26.273067 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 3 to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e May 12 15:32:26.473955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:26.473955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:26.473955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:26.498941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e831946a-c6b1-4358-b9f4-0b8b136d86c0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port c415100a-0a4a-4e06-bf8f-456f889a4415 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:26.498941 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e831946a-c6b1-4358-b9f4-0b8b136d86c0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:26.506531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:26.506531 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:26.506531 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 4 to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e May 12 15:32:26.592023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:26.592363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:26.592697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:26.663648 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f16be4b-7ca3-4af1-85ef-81366b14b635 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:26.698349 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0f16be4b-7ca3-4af1-85ef-81366b14b635 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:26.702887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0f16be4b-7ca3-4af1-85ef-81366b14b635 admin admin] Usage tracker for resource:security_group_rule and tenant:ac35ca8ab94f4337aa73075f9d8500d5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:26.706516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0f16be4b-7ca3-4af1-85ef-81366b14b635 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:26.713768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0f16be4b-7ca3-4af1-85ef-81366b14b635 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:26.729596 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:26.773138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:26.773549 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:26.813120 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 5 to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e May 12 15:32:26.848596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:26.849176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:26.849748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:26.866852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:26.867180 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:26.873660 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 6 to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e May 12 15:32:26.882284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 96d50894-0a98-4aff-9097-44452345b862, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=96d50894-0a98-4aff-9097-44452345b862,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:26.893474 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:26.953694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:26.955229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:26.956418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:26.970737 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e831946a-c6b1-4358-b9f4-0b8b136d86c0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:26.988663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:26.989306 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:26.996650 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:27.005188 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 7 to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e May 12 15:32:27.096022 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:27.211900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=96d50894-0a98-4aff-9097-44452345b862,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:27.276454 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f16be4b-7ca3-4af1-85ef-81366b14b635 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:27.373211 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f16be4b-7ca3-4af1-85ef-81366b14b635 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:27.427683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e831946a-c6b1-4358-b9f4-0b8b136d86c0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for c415100a-0a4a-4e06-bf8f-456f889a4415 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:27.443814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:27.444152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:27.444486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:27.480408 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:27.550764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:27.551337 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:27.586530 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 8 to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e May 12 15:32:27.740490 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0f16be4b-7ca3-4af1-85ef-81366b14b635 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ac35ca8ab94f4337aa73075f9d8500d5&name=default HTTP/1.1" status: 200 len: 2983 time: 1.8923147 May 12 15:32:27.744467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52774) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:27.744467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52776) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:27.757990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Pushing event updated for resources: {'Port': ['ID=2cefb78b-eff7-47cb-8160-89f1ff42943b,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:27.818716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f16be4b-7ca3-4af1-85ef-81366b14b635 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5dc2acd-e680-4875-8a22-b305d8213133,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:27.840689 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:27.841104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:27.841548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:27.860027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:27.860289 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:27.865494 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 9 to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e May 12 15:32:27.879020 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e831946a-c6b1-4358-b9f4-0b8b136d86c0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:27.890344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:27.891297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:27.891708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:27.928402 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:27.928789 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:27.934597 n-d-841483-1 neutron-server[88152]: INFO neutron.plugins.ml2.plugin [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 10 to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e May 12 15:32:28.017104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e831946a-c6b1-4358-b9f4-0b8b136d86c0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=c415100a-0a4a-4e06-bf8f-456f889a4415,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:28.021648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Network bca349be-4618-43ae-a547-b8bd2b254da4 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:28.041651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairIpV6TestJSON-test-network-1293809756'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:28.051592 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-08e6a66e-6f43-4834-8b40-5f9c3be9be51 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:28.095788 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-08e6a66e-6f43-4834-8b40-5f9c3be9be51 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:28.331320 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e831946a-c6b1-4358-b9f4-0b8b136d86c0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:28.484320 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:28.484655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:28.484995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:28.487404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:28.501702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:28.589377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 43595a6d-4ed2-4c44-be3d-7267b28a205e on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:28.589721 n-d-841483-1 neutron-server[88152]: ERROR neutron.plugins.ml2.managers [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 43595a6d-4ed2-4c44-be3d-7267b28a205e on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:28.590310 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:28.789471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Usage tracker for resource:network and tenant:4daabc80fb744e62aca779fa277e241d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:28.798372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:28.808142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:28.886479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Made reservation on behalf of 4daabc80fb744e62aca779fa277e241d for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:28.888731 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:28.899134 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-08e6a66e-6f43-4834-8b40-5f9c3be9be51 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:28.947749 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:28.953235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-51b686b5-c304-4108-a809-7b907edcc1a1 None None] Provisioning complete for port 2cefb78b-eff7-47cb-8160-89f1ff42943b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:28.954127 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-51b686b5-c304-4108-a809-7b907edcc1a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:29.068139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] For port 43595a6d-4ed2-4c44-be3d-7267b28a205e, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:32:29.068532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempted to set empty binding levels {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:66}} May 12 15:32:29.077448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-51b686b5-c304-4108-a809-7b907edcc1a1 None None] Port 2cefb78b-eff7-47cb-8160-89f1ff42943b cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:32:29.089593 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08e6a66e-6f43-4834-8b40-5f9c3be9be51 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5dc2acd-e680-4875-8a22-b305d8213133,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:29.151607 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:29.153807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e831946a-c6b1-4358-b9f4-0b8b136d86c0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:32:29.180526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:29.256423 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Usage tracker for resource:security_group_rule and tenant:4daabc80fb744e62aca779fa277e241d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:29.268850 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-08e6a66e-6f43-4834-8b40-5f9c3be9be51 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:29.268850 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-08e6a66e-6f43-4834-8b40-5f9c3be9be51 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b5dc2acd-e680-4875-8a22-b305d8213133 HTTP/1.1" status: 204 len: 168 time: 1.4920795 May 12 15:32:29.286016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Router 3b0baf01-29b6-49bc-81af-4ed638af06f3 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:32:29.294419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:29.295226 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:29.353634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:29.395920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 96d50894-0a98-4aff-9097-44452345b862 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:32:29.445635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:29.489443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Pushing event updated for resources: {'Port': ['ID=43595a6d-4ed2-4c44-be3d-7267b28a205e,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:29.564121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e831946a-c6b1-4358-b9f4-0b8b136d86c0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:32:29.583367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b099c8b9-da4b-4af9-a631-cc07dabff7f3 None None] Sync routers for ids ['0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:32:29.590109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 96d50894-0a98-4aff-9097-44452345b862 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:29.590109 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:29.592967 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e831946a-c6b1-4358-b9f4-0b8b136d86c0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.5652292 May 12 15:32:29.592967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52806) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:29.693249 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b099c8b9-da4b-4af9-a631-cc07dabff7f3 None None] Routers {'0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:32:29.693249 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b099c8b9-da4b-4af9-a631-cc07dabff7f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:29.784038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-85e2f397-56d2-491c-9eb6-42b68127f2b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 984 time: 9.9647615 May 12 15:32:29.788427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52814) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:29.910852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b099c8b9-da4b-4af9-a631-cc07dabff7f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:30.025800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b099c8b9-da4b-4af9-a631-cc07dabff7f3 None None] Routers {'0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:32:30.030152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b099c8b9-da4b-4af9-a631-cc07dabff7f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:30.229453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52824) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:30.259119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b099c8b9-da4b-4af9-a631-cc07dabff7f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:30.259119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b099c8b9-da4b-4af9-a631-cc07dabff7f3 None None] The sync data for ids ['0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:32:30.325214 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-31250f49-19ff-4b32-ac5e-f3cf7151f3ce admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:30.369490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-755ba00d-b758-42a2-b712-787c6b430541 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Deleting port 43595a6d-4ed2-4c44-be3d-7267b28a205e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:30.370063 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-755ba00d-b758-42a2-b712-787c6b430541 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:30.403788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-31250f49-19ff-4b32-ac5e-f3cf7151f3ce admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:30.414355 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-7d524772-3458-4e3f-b66b-094145eba3a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] remove_router_interface failed (client error): The resource could not be found. May 12 15:32:30.418271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7d524772-3458-4e3f-b66b-094145eba3a0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.8212004 May 12 15:32:30.423510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52830) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:30.424150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:32:30.435053 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Sync routers for ids ['3b0baf01-29b6-49bc-81af-4ed638af06f3'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:32:30.441742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-31250f49-19ff-4b32-ac5e-f3cf7151f3ce admin admin] Usage tracker for resource:security_group_rule and tenant:0cd45f3e3f0f473989eb90b400880be4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:30.448887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-31250f49-19ff-4b32-ac5e-f3cf7151f3ce admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:30.451034 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Routers {'3b0baf01-29b6-49bc-81af-4ed638af06f3'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:32:30.452610 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b0baf01-29b6-49bc-81af-4ed638af06f3'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:30.469251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-31250f49-19ff-4b32-ac5e-f3cf7151f3ce admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:30.479146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-755920cf-7812-4a0d-a7de-8ea7b0ed11d4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Synchronizing usage tracker for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:32:30.482150 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f878622a-9c9d-45d0-baea-78377376b91d admin admin] 10.222.0.82 "PUT /v2.0/routers/3b0baf01-29b6-49bc-81af-4ed638af06f3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 12.6069517 May 12 15:32:30.549315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a95b643a-7eac-4d50-9408-df3c36b8f0b4 req-ea9af153-314e-4d76-8888-4d7a360ca079 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:30.551181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a95b643a-7eac-4d50-9408-df3c36b8f0b4 req-ea9af153-314e-4d76-8888-4d7a360ca079 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 946 time: 0.4794424 May 12 15:32:30.596446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-755920cf-7812-4a0d-a7de-8ea7b0ed11d4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Unset dirty status for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:32:30.597465 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:30.598246 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-755920cf-7812-4a0d-a7de-8ea7b0ed11d4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports?device_id=0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f HTTP/1.1" status: 200 len: 205 time: 0.1736743 May 12 15:32:30.604556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52836) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:30.624284 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:30.838997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2504f1b8-595e-4bf2-876f-12440f8c96d2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:30.867540 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69c1aa2e-8b5e-4c6a-833a-a524fbb63e50 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:30.947569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 594} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:32:30.964404 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a95b643a-7eac-4d50-9408-df3c36b8f0b4 req-bad97c5b-e3cf-43dc-8d3d-754338681087 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4039018 May 12 15:32:30.974904 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:30.975298 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Set router 3b0baf01-29b6-49bc-81af-4ed638af06f3 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:32:30.975664 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Added segment 426b21ab-c085-43bd-9d4e-926b64edbea5 of type vlan for network aecd5d86-5173-456d-9e81-e9cec7c6c409 May 12 15:32:31.054836 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-31250f49-19ff-4b32-ac5e-f3cf7151f3ce admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:31.060646 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-31250f49-19ff-4b32-ac5e-f3cf7151f3ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:31.237620 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:31.257301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-755ba00d-b758-42a2-b712-787c6b430541 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] For port 43595a6d-4ed2-4c44-be3d-7267b28a205e, host n-h2-841483-1, got binding levels [] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:31.278842 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-755ba00d-b758-42a2-b712-787c6b430541 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:31.323714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-31250f49-19ff-4b32-ac5e-f3cf7151f3ce admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0cd45f3e3f0f473989eb90b400880be4&name=default HTTP/1.1" status: 200 len: 2983 time: 1.0892787 May 12 15:32:31.332195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31250f49-19ff-4b32-ac5e-f3cf7151f3ce admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=65460729-047d-4008-9db3-2f51258ff619,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:31.365156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52854) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:31.646808 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:25Z', 'revision_number': 4, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2cefb78b-eff7-47cb-8160-89f1ff42943b', 'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'mac_address': 'fa:16:3e:ee:fd:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 2489, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:20Z', 'updated_at': '2022-05-12T15:32:26Z', 'revision_number': 2, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'subnets': [{'id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:31.653083 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Checking router: 3b0baf01-29b6-49bc-81af-4ed638af06f3 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:32:31.653963 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Updating router 3b0baf01-29b6-49bc-81af-4ed638af06f3 port 2cefb78b-eff7-47cb-8160-89f1ff42943b binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:32:31.656461 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:31.662011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:31.662656 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:31.737304 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18f62072-9807-464b-965b-9ebb222c5a5b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:31.817316 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:31.957903 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 798 time: 4.1809108 May 12 15:32:31.957903 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18f62072-9807-464b-965b-9ebb222c5a5b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:31.983166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52872) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:32.005048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Request body: {'subnet': {'network_id': 'aecd5d86-5173-456d-9e81-e9cec7c6c409', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:32.024398 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21ee70e2-7ad3-4041-a6e5-fd5a6a05a626 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event updated for resources: {'Network': ['ID=aecd5d86-5173-456d-9e81-e9cec7c6c409,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:32.036790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network aecd5d86-5173-456d-9e81-e9cec7c6c409 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:32:32.037917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-11ba151c-69d8-4ccd-86b4-1d6d9ee6b1ab tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:32.038858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-11ba151c-69d8-4ccd-86b4-1d6d9ee6b1ab tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Synchronizing usage tracker for tenant:ed8d9bf58283443480f0c62e72d53449 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:32:32.098844 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18f62072-9807-464b-965b-9ebb222c5a5b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:32.247882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f62072-9807-464b-965b-9ebb222c5a5b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=65460729-047d-4008-9db3-2f51258ff619,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:32.276636 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69c1aa2e-8b5e-4c6a-833a-a524fbb63e50 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:32.291248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69c1aa2e-8b5e-4c6a-833a-a524fbb63e50 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:32.449115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:32.476688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:32.514364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-755ba00d-b758-42a2-b712-787c6b430541 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Calling delete_port for 43595a6d-4ed2-4c44-be3d-7267b28a205e owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:32.565875 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18f62072-9807-464b-965b-9ebb222c5a5b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:32.570518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-18f62072-9807-464b-965b-9ebb222c5a5b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/65460729-047d-4008-9db3-2f51258ff619 HTTP/1.1" status: 204 len: 168 time: 1.2104633 May 12 15:32:32.574506 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69c1aa2e-8b5e-4c6a-833a-a524fbb63e50 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:32.575380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-69c1aa2e-8b5e-4c6a-833a-a524fbb63e50 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Fanout notify agent at l3_agent the message router_deleted on router 0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:32:32.583312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Usage tracker for resource:subnet and tenant:4daabc80fb744e62aca779fa277e241d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:32.593566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-11ba151c-69d8-4ccd-86b4-1d6d9ee6b1ab tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Unset dirty status for tenant:ed8d9bf58283443480f0c62e72d53449 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:32:32.602595 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-11ba151c-69d8-4ccd-86b4-1d6d9ee6b1ab tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 818 time: 1.0651276 May 12 15:32:32.614818 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69c1aa2e-8b5e-4c6a-833a-a524fbb63e50 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:32.616276 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-69c1aa2e-8b5e-4c6a-833a-a524fbb63e50 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/routers/0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f HTTP/1.1" status: 204 len: 168 time: 2.0102754 May 12 15:32:32.621640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52886) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:32.625509 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:32.643297 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-ee8f99f2-7d38-4569-8bf6-b8d2536cb976 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/quotas/ed8d9bf58283443480f0c62e72d53449 HTTP/1.1" status: 200 len: 375 time: 0.0397518 May 12 15:32:32.706965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:32.752107 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:32.802918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-755ba00d-b758-42a2-b712-787c6b430541 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:32.807092 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Transition to ACTIVE for port object 2cefb78b-eff7-47cb-8160-89f1ff42943b will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:32.811867 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:33.009170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Made reservation on behalf of 4daabc80fb744e62aca779fa277e241d for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:33.012874 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:33.057360 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-755ba00d-b758-42a2-b712-787c6b430541 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:33.107885 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-755ba00d-b758-42a2-b712-787c6b430541 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "DELETE /v2.0/ports/43595a6d-4ed2-4c44-be3d-7267b28a205e HTTP/1.1" status: 204 len: 168 time: 3.3128548 May 12 15:32:33.120494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-018937ce-f1e1-4989-87df-e554265cb54c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting subnet 61ef0890-0de1-422e-8893-8072b324254e {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:32:33.123673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52894) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:33.135120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-755ba00d-b758-42a2-b712-787c6b430541 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Pushing event deleted for resources: {'Port': ['ID=43595a6d-4ed2-4c44-be3d-7267b28a205e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:33.137523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-018937ce-f1e1-4989-87df-e554265cb54c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:33.139294 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24c5e9c3-f73b-46fc-816b-ca37a18ef7ff None None] Pushing event updated for resources: {'Port': ['ID=2cefb78b-eff7-47cb-8160-89f1ff42943b,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:33.155266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d77f98-3e55-4431-b28f-da4b05caf70c req-2294aeb1-6fbd-4714-99f7-d11734c5479a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:33.161117 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c5e9c3-f73b-46fc-816b-ca37a18ef7ff None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:33.161339 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c5e9c3-f73b-46fc-816b-ca37a18ef7ff None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:33.163786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86d77f98-3e55-4431-b28f-da4b05caf70c req-2294aeb1-6fbd-4714-99f7-d11734c5479a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 946 time: 0.7123444 May 12 15:32:33.165508 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c5e9c3-f73b-46fc-816b-ca37a18ef7ff None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:33.165893 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c5e9c3-f73b-46fc-816b-ca37a18ef7ff None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:33.166222 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c5e9c3-f73b-46fc-816b-ca37a18ef7ff None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:33.166548 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c5e9c3-f73b-46fc-816b-ca37a18ef7ff None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:33.166865 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c5e9c3-f73b-46fc-816b-ca37a18ef7ff None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:33.173078 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c5e9c3-f73b-46fc-816b-ca37a18ef7ff None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:33.173504 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c5e9c3-f73b-46fc-816b-ca37a18ef7ff None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:33.174013 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c5e9c3-f73b-46fc-816b-ca37a18ef7ff None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:33.174479 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c5e9c3-f73b-46fc-816b-ca37a18ef7ff None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:33.174944 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c5e9c3-f73b-46fc-816b-ca37a18ef7ff None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:33.247031 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-98c7044c-9ec0-4f0e-ae1b-22fc3c36638a tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] GET failed (client error): The resource could not be found. May 12 15:32:33.247932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-98c7044c-9ec0-4f0e-ae1b-22fc3c36638a tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Synchronizing usage tracker for tenant:8d9d0187e68e4feda08559a57b3c422f on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:32:33.292133 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-018937ce-f1e1-4989-87df-e554265cb54c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:33.322424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86d77f98-3e55-4431-b28f-da4b05caf70c req-ee00960a-5c53-4cbc-8c3d-c579f0254128 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1571949 May 12 15:32:33.374336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d0edc71a-a9a4-4c5d-9868-880659d0378c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Synchronizing usage tracker for tenant:ed8d9bf58283443480f0c62e72d53449 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:32:33.409748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b9efcd-53bf-4a92-b684-865840212359 req-ad1625e2-b252-4b6a-be62-ae4ab2266870 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:33.409748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c3b9efcd-53bf-4a92-b684-865840212359 req-ad1625e2-b252-4b6a-be62-ae4ab2266870 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:32:33.430235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d0edc71a-a9a4-4c5d-9868-880659d0378c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Unset dirty status for tenant:ed8d9bf58283443480f0c62e72d53449 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:32:33.476456 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d0edc71a-a9a4-4c5d-9868-880659d0378c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&fields=id HTTP/1.1" status: 200 len: 302 time: 0.8305728 May 12 15:32:33.507299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-98c7044c-9ec0-4f0e-ae1b-22fc3c36638a tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Unset dirty status for tenant:8d9d0187e68e4feda08559a57b3c422f on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:32:33.513169 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Attempting to bind port 2cefb78b-eff7-47cb-8160-89f1ff42943b on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:33.513169 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Attempting to bind port 2cefb78b-eff7-47cb-8160-89f1ff42943b by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:33.513169 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Attempting to bind port 2cefb78b-eff7-47cb-8160-89f1ff42943b on network bca349be-4618-43ae-a547-b8bd2b254da4 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:33.516204 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-98c7044c-9ec0-4f0e-ae1b-22fc3c36638a tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "GET /v2.0/ports/43595a6d-4ed2-4c44-be3d-7267b28a205e HTTP/1.1" status: 404 len: 333 time: 0.3760004 May 12 15:32:33.522322 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 32, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:32:33.522322 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Checking segment: {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:32:33.522322 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:33.522322 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Bound using segment: {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:32:33.522322 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Bound port: 2cefb78b-eff7-47cb-8160-89f1ff42943b, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:32:33.522322 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:33.544959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52904) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:33.608111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c3b9efcd-53bf-4a92-b684-865840212359 req-ad1625e2-b252-4b6a-be62-ae4ab2266870 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:32:33.612257 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c3b9efcd-53bf-4a92-b684-865840212359 req-ad1625e2-b252-4b6a-be62-ae4ab2266870 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.76 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 946 time: 2.0636237 May 12 15:32:33.625510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Request body: {'port': {'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-471448585'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:33.638034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:33.695225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:33.777377 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] For port 2cefb78b-eff7-47cb-8160-89f1ff42943b, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:32:33.795112 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] For port 2cefb78b-eff7-47cb-8160-89f1ff42943b, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2cefb78b-eff7-47cb-8160-89f1ff42943b,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:32:33.808052 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:33.862696 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-1b527045-e04a-48cc-a884-cc4a591052b8 service neutron] 10.222.0.82 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3754263 May 12 15:32:33.876439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Made reservation on behalf of 8d9d0187e68e4feda08559a57b3c422f for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:33.885974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:33.995738 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24c5e9c3-f73b-46fc-816b-ca37a18ef7ff None None] Pushing event updated for resources: {'Port': ['ID=2cefb78b-eff7-47cb-8160-89f1ff42943b,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:34.029936 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Routers {'3b0baf01-29b6-49bc-81af-4ed638af06f3'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:32:34.030632 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b0baf01-29b6-49bc-81af-4ed638af06f3'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:34.167641 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-018937ce-f1e1-4989-87df-e554265cb54c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:34.203255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:34.350520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] device_id is not set on port 30f112aa-f87c-445d-b3bf-a28abff76bdc yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:32:34.511505 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-9c1f0d0a-7c4f-46f0-8141-803a341a6fa0 service neutron] 10.222.0.82 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6567068 May 12 15:32:34.577601 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] Set router 3b0baf01-29b6-49bc-81af-4ed638af06f3 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:32:34.585732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Deleting port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:34.585732 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:34.626141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event updated for resources: {'Subnet': ['ID=8e14ccb3-bcde-425d-ac11-c8bd493ae5f1,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:34.649262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Checking segment: {'id': '426b21ab-c085-43bd-9d4e-926b64edbea5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'aecd5d86-5173-456d-9e81-e9cec7c6c409'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:32:34.649262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Network hostable DHCP agents. Network: aecd5d86-5173-456d-9e81-e9cec7c6c409, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:32:34.706992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Network aecd5d86-5173-456d-9e81-e9cec7c6c409 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:32:34.734968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, aecd5d86-5173-456d-9e81-e9cec7c6c409) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:34.746444 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce598fc6-5b35-4868-beee-5caabf9d5d46 None None] Network aecd5d86-5173-456d-9e81-e9cec7c6c409 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:32:34.748426 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:34.750075 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:34.847208 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e8ddbd5e-05f4-4686-8fe4-7410a06a43b1 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.8666153 May 12 15:32:34.850803 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52934) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:34.902396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Request body: {'port': {'network_id': 'aecd5d86-5173-456d-9e81-e9cec7c6c409', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-500195983'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:35.081929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4061787a-d68f-4a9e-9839-9bc7b1cd2e7d req-47861032-5ece-409d-8ea7-df748e0653b9 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:35.081929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4061787a-d68f-4a9e-9839-9bc7b1cd2e7d req-47861032-5ece-409d-8ea7-df748e0653b9 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 946 time: 0.3226242 May 12 15:32:35.307237 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:35.369268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-aecd5d86-5173-456d-9e81-e9cec7c6c409', 'network_id': 'aecd5d86-5173-456d-9e81-e9cec7c6c409', 'tenant_id': '4daabc80fb744e62aca779fa277e241d', 'fixed_ips': [{'subnet_id': '8e14ccb3-bcde-425d-ac11-c8bd493ae5f1'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:32:35.370183 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:35.391301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:32:35.412187 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5bc28eb-adef-4f21-9099-7bfe5668cee4 req-233791a5-5463-406c-b9b7-e33c250506f0 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 210 time: 0.2795591 May 12 15:32:35.444272 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-018937ce-f1e1-4989-87df-e554265cb54c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:35.654080 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:25Z', 'revision_number': 4, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2cefb78b-eff7-47cb-8160-89f1ff42943b', 'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'mac_address': 'fa:16:3e:ee:fd:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 2489, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:20Z', 'updated_at': '2022-05-12T15:32:33Z', 'revision_number': 4, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'subnets': [{'id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:35.667200 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96c90575-3578-4470-8a82-b9dd13c3ba38 None None] The sync data for ids ['3b0baf01-29b6-49bc-81af-4ed638af06f3'] in n-d-841483-1 is: [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:25Z', 'revision_number': 4, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2cefb78b-eff7-47cb-8160-89f1ff42943b', 'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'mac_address': 'fa:16:3e:ee:fd:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 2489, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:20Z', 'updated_at': '2022-05-12T15:32:33Z', 'revision_number': 4, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'subnets': [{'id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:32:35.685312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4061787a-d68f-4a9e-9839-9bc7b1cd2e7d req-9cee99e0-af4a-4099-8136-eb5933fa823a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5966158 May 12 15:32:35.696346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:35.726194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-018937ce-f1e1-4989-87df-e554265cb54c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Subnet': ['ID=61ef0890-0de1-422e-8893-8072b324254e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:35.729076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Usage tracker for resource:port and tenant:4daabc80fb744e62aca779fa277e241d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:35.741077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:35.847010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:35.903183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Made reservation on behalf of 4daabc80fb744e62aca779fa277e241d for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:35.930575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:36.030713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] device_id is not set on port 39b0dcfb-7db6-479a-9d08-7ab584f1636a yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:32:36.237320 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-018937ce-f1e1-4989-87df-e554265cb54c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:36.258594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] For port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:36.259270 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:36.269234 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:36.284160 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-018937ce-f1e1-4989-87df-e554265cb54c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/61ef0890-0de1-422e-8893-8072b324254e HTTP/1.1" status: 204 len: 168 time: 3.6607802 May 12 15:32:36.309257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52980) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:36.384010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-161d1564-418c-4c90-af08-a4f20fb22673 None None] Network 3af91feb-4088-4b4d-836a-7e8054906de2 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:32:36.426931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Allocated IP 2001:db8::2 (aecd5d86-5173-456d-9e81-e9cec7c6c409/8e14ccb3-bcde-425d-ac11-c8bd493ae5f1/4a5b78b1-740e-40a9-8401-5d9f47128bdd) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:32:36.938804 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:36.970920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:36.971565 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:37.038543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-72284574-2695-41e6-b029-b944265a77e7 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:37.043031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Pushing event updated for resources: {'Port': ['ID=30f112aa-f87c-445d-b3bf-a28abff76bdc,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:37.057722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-72284574-2695-41e6-b029-b944265a77e7 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 818 time: 0.8232117 May 12 15:32:37.079174 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-4ac14d49-6188-4cee-872d-9b74ec5d6eca tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/quotas/ed8d9bf58283443480f0c62e72d53449 HTTP/1.1" status: 200 len: 375 time: 0.0201876 May 12 15:32:37.182643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Network 23f523e9-0880-4d90-990d-969ff64c60e0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:37.270963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:37.291853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:37.308079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:37.308079 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:37.413078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2cefb78b-eff7-47cb-8160-89f1ff42943b up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:32:37.523465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53000) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:37.587277 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1c0fb5fa-1f4c-429e-8ca5-711e957a1abd tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 963 time: 3.9925902 May 12 15:32:37.589896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53008) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:37.636350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Request body: {'port': {'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:38.006910 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:38.132773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Request body: {'network': {'name': 'tempest-RoutersIpV6AdminTest-1173293670', 'router:external': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:38.137197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:38.144708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Usage tracker for resource:network and tenant:281d0c58fa114694a3293de8c107204f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:38.144708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:38.161755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:38.323241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:32:38.347617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Made reservation on behalf of 281d0c58fa114694a3293de8c107204f for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:38.357630 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:38.401744 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:38.411855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:38.439346 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:38.494315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87d72c39-2343-4db3-9a6a-513b257c873d req-355c7af7-4201-49c4-acdc-917aade20048 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:38.494315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87d72c39-2343-4db3-9a6a-513b257c873d req-355c7af7-4201-49c4-acdc-917aade20048 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 946 time: 1.3965950 May 12 15:32:38.494315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] For port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=bfb73fca-11c4-42f9-942d-9fdf5ebb5e10,segment=NetworkSegment(ec07d999-a5e5-4d9e-8863-5aef618b5e17),segment_id=ec07d999-a5e5-4d9e-8863-5aef618b5e17)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:38.494315 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:38.566180 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-d0bdc894-a2db-4ec2-922f-67283e31674f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&fields=id HTTP/1.1" status: 200 len: 302 time: 1.4453337 May 12 15:32:38.695313 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:38.794154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 2cefb78b-eff7-47cb-8160-89f1ff42943b completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:38.803234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-892a0155-ae4a-4ef3-a4f6-f9012fc0116f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:38.805064 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-892a0155-ae4a-4ef3-a4f6-f9012fc0116f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.84 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 818 time: 0.9084933 May 12 15:32:38.885080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Request body: {'port': {'device_id': '8fb6500d-7db4-46cb-945c-e5ef82421deb', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'admin_state_up': True, 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:38.956048 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2cefb78b-eff7-47cb-8160-89f1ff42943b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:38.956048 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:39.010213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:39.021846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:39.058749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:39.058749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:39.058749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:39.058749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:39.058749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:39.058749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:39.058749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:39.058749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:39.058749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:39.058749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:39.058749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:39.058749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:39.081739 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:39.103345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-196348ea-4251-4749-a86f-4181e4ebcfc8 None None] DHCP port deletion for 3af91feb-4088-4b4d-836a-7e8054906de2 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:32:39.110942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Transition to ACTIVE for port object 4a5b78b1-740e-40a9-8401-5d9f47128bdd will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:39.110942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-196348ea-4251-4749-a86f-4181e4ebcfc8 None None] Deleting port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:39.110942 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-196348ea-4251-4749-a86f-4181e4ebcfc8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:39.201856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:39.235969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:39.295501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Transition to ACTIVE for port object 4a5b78b1-740e-40a9-8401-5d9f47128bdd will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:39.351116 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:39.397428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Made reservation on behalf of ed8d9bf58283443480f0c62e72d53449 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:39.401169 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:39.431226 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:39.431727 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:39.432147 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Floating IP 9fbfd049-9e42-4bf4-bede-947490c8e40d disassociated. External IP: 172.25.8.17, port: d34a63b6-2dbe-47d1-9d15-9dd7ae780c97. May 12 15:32:39.432591 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Calling delete_port for d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:39.445883 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:39.551205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Usage tracker for resource:security_group_rule and tenant:281d0c58fa114694a3293de8c107204f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:39.566368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:39.576471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-f1107b1d-3114-45db-9bc0-efebb050c62d service neutron] 10.222.0.82 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0067222 May 12 15:32:39.697096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Network aecd5d86-5173-456d-9e81-e9cec7c6c409 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:39.708100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Allocated IP 2001:db8::20b (aecd5d86-5173-456d-9e81-e9cec7c6c409/8e14ccb3-bcde-425d-ac11-c8bd493ae5f1/39b0dcfb-7db6-479a-9d08-7ab584f1636a) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:32:39.729673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:39.744963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:39.891019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Pushing event updated for resources: {'Port': ['ID=4a5b78b1-740e-40a9-8401-5d9f47128bdd,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:39.903371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-196348ea-4251-4749-a86f-4181e4ebcfc8 None None] For port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=bfb73fca-11c4-42f9-942d-9fdf5ebb5e10,segment=NetworkSegment(ec07d999-a5e5-4d9e-8863-5aef618b5e17),segment_id=ec07d999-a5e5-4d9e-8863-5aef618b5e17)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:39.903371 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-196348ea-4251-4749-a86f-4181e4ebcfc8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:40.001107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] device_id is not set on port 30f112aa-f87c-445d-b3bf-a28abff76bdc yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:32:40.026410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:40.052523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Transition to ACTIVE for port object 30f112aa-f87c-445d-b3bf-a28abff76bdc will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:40.060970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 2cefb78b-eff7-47cb-8160-89f1ff42943b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2cefb78b-eff7-47cb-8160-89f1ff42943b,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:40.069065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-196348ea-4251-4749-a86f-4181e4ebcfc8 None None] Calling delete_port for bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:40.090441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:40.108225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Attempting to bind port 4a5b78b1-740e-40a9-8401-5d9f47128bdd on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:40.108591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Attempting to bind port 4a5b78b1-740e-40a9-8401-5d9f47128bdd by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '426b21ab-c085-43bd-9d4e-926b64edbea5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'aecd5d86-5173-456d-9e81-e9cec7c6c409'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:40.109705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Attempting to bind port 4a5b78b1-740e-40a9-8401-5d9f47128bdd on network aecd5d86-5173-456d-9e81-e9cec7c6c409 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:40.121043 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:40.136593 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:40.201919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 32, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:32:40.202309 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Checking segment: {'id': '426b21ab-c085-43bd-9d4e-926b64edbea5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'aecd5d86-5173-456d-9e81-e9cec7c6c409'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:32:40.202764 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:40.204395 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Bound using segment: {'id': '426b21ab-c085-43bd-9d4e-926b64edbea5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'aecd5d86-5173-456d-9e81-e9cec7c6c409'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:32:40.204893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Bound port: 4a5b78b1-740e-40a9-8401-5d9f47128bdd, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '426b21ab-c085-43bd-9d4e-926b64edbea5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': 'aecd5d86-5173-456d-9e81-e9cec7c6c409'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:32:40.205269 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:40.311622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:32:40.311622 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:32:40.336980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] For port 4a5b78b1-740e-40a9-8401-5d9f47128bdd, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:32:40.336980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] For port 4a5b78b1-740e-40a9-8401-5d9f47128bdd, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4a5b78b1-740e-40a9-8401-5d9f47128bdd,segment=NetworkSegment(426b21ab-c085-43bd-9d4e-926b64edbea5),segment_id=426b21ab-c085-43bd-9d4e-926b64edbea5)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:32:40.336980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:32:40.450792 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:40.464357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Allocated IP 172.20.0.4 (bca349be-4618-43ae-a547-b8bd2b254da4/aa771580-393c-41f8-ad67-611be21e45d3/45ca2419-3316-4890-add7-265905134549) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:32:40.471531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Pushing event updated for resources: {'Port': ['ID=30f112aa-f87c-445d-b3bf-a28abff76bdc,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:40.501878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:40.504612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:40.510363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:40.510363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:40.649427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=2cefb78b-eff7-47cb-8160-89f1ff42943b,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:40.745070 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-196348ea-4251-4749-a86f-4181e4ebcfc8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:40.772300 n-d-841483-1 neutron-server[88153]: INFO neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No ports have port_id starting with bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 May 12 15:32:40.805682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-196348ea-4251-4749-a86f-4181e4ebcfc8 None None] No DVR routers for this DVR port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:32:40.849125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:40.849502 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:40.850052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Deleting port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:40.850500 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:40.920848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-fe659850-148c-4d07-b2d2-28c2fb3fa4b7 service neutron] 10.222.0.82 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7524724 May 12 15:32:40.972452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c53fdd23-4ad0-4986-a9f7-df0376117a7c None None] Pushing event updated for resources: {'Port': ['ID=4a5b78b1-740e-40a9-8401-5d9f47128bdd,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:41.057442 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:41.179416 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 2 to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc May 12 15:32:41.190494 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-196348ea-4251-4749-a86f-4181e4ebcfc8 None None] Pushing event deleted for resources: {'Port': ['ID=bfb73fca-11c4-42f9-942d-9fdf5ebb5e10,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:41.192387 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87d72c39-2343-4db3-9a6a-513b257c873d req-e6943b14-1e8d-4754-9c68-4f0c9d6bab59 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 2.2364082 May 12 15:32:41.207110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Transition to ACTIVE for port object 39b0dcfb-7db6-479a-9d08-7ab584f1636a will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:41.401591 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0e645c7d-35a6-4187-b148-715c81222dd6'] response: {'server_uuid': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97', 'code': 200} May 12 15:32:41.405006 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:32:41.405371 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:32:41.527867 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:41.666961 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:41.694802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Network aecd5d86-5173-456d-9e81-e9cec7c6c409 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:41.707040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:41.707040 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:41.714180 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83907077-1f3d-4725-81f9-1227e1c49096 req-aed10458-f5dd-47c2-a418-1611e2e966a5 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 210 time: 0.1937180 May 12 15:32:41.714180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:41.728750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:41.728750 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:41.785558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 596} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:32:41.793300 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:41.793300 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Added segment 88bf9e39-7798-4951-9f43-c41ad31d5afe of type vlan for network bb9736c7-290f-4580-8c13-53b75603f9df May 12 15:32:41.830706 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:41.910778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port bfb73fca-11c4-42f9-942d-9fdf5ebb5e10 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:41.911170 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:41.941640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] For port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:41.942920 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:41.972465 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:41.976740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:41.976740 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:42.217248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event updated for resources: {'Port': ['ID=39b0dcfb-7db6-479a-9d08-7ab584f1636a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:42.268608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:42.269086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:42.269266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:42.378473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9e91bb1d-8655-4082-9578-cbbf0a9f31b0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 7.4907796 May 12 15:32:42.483160 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 875 time: 4.9584398 May 12 15:32:42.497038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53070) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:42.497353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53072) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:42.521067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=090c2a90-39df-4bad-bc4e-7ad2a286fd62,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:42.526958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2cefb78b-eff7-47cb-8160-89f1ff42943b up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:32:42.715107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9ad51ef-a05b-4749-8c50-4fa1fea0f808 None None] Network aecd5d86-5173-456d-9e81-e9cec7c6c409 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:32:42.733755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] The port 'bfb73fca-11c4-42f9-942d-9fdf5ebb5e10' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:32:42.757335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Request body: {'subnet': {'network_id': 'bb9736c7-290f-4580-8c13-53b75603f9df', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:42.799174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Request body: {'port': {'network_id': 'aecd5d86-5173-456d-9e81-e9cec7c6c409', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-935937477', 'allowed_address_pairs': [{'ip_address': '2001:db8::20b', 'mac_address': 'fa:16:3e:67:6c:cb'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:42.836040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:42.836040 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:42.840718 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 3 to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc May 12 15:32:42.861560 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:42.861938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:42.862251 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Floating IP 9fbfd049-9e42-4bf4-bede-947490c8e40d disassociated. External IP: 172.25.8.17, port: d34a63b6-2dbe-47d1-9d15-9dd7ae780c97. May 12 15:32:42.862587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Calling delete_port for d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:42.863035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:42.883880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42f42260-179b-4342-96a3-f0d6ac88a335 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event updated for resources: {'Network': ['ID=bb9736c7-290f-4580-8c13-53b75603f9df,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:42.932714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network bb9736c7-290f-4580-8c13-53b75603f9df details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:32:42.994940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:42.994940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:42.994940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:42.994940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:43.031551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Usage tracker for resource:subnet and tenant:281d0c58fa114694a3293de8c107204f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:43.062376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:43.062376 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:43.062376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Transition to ACTIVE for port object 45ca2419-3316-4890-add7-265905134549 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:43.071421 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 4 to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc May 12 15:32:43.142336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:43.142336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:43.142336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:43.175365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:43.175365 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:43.175365 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 5 to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc May 12 15:32:43.220417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-38114c31-1a9c-4b1e-bacc-a211524c3016 None None] Provisioning for port 4a5b78b1-740e-40a9-8401-5d9f47128bdd completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:43.302202 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:43.369705 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9b35b674-e2fb-4fc4-8a71-7d0b86cda2a8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:43.479499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2cefb78b-eff7-47cb-8160-89f1ff42943b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:43.479499 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:43.523079 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:43.531246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Pushing event updated for resources: {'Port': ['ID=45ca2419-3316-4890-add7-265905134549,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:43.534851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:43.538083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:43.538083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:43.538083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:43.571937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Network bca349be-4618-43ae-a547-b8bd2b254da4 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:43.661442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:43.661442 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:43.661442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:43.661442 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 6 to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc May 12 15:32:43.682965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:43.802409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:43.802977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:43.824582 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4a5b78b1-740e-40a9-8401-5d9f47128bdd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:32:43.872319 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:43.974471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09e7aaac-2e50-4e88-b8bb-56103166adde req-0b86b05d-cf73-43ef-81b2-c05d5331d092 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 210 time: 0.9742634 May 12 15:32:44.002085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:44.012518 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:44.035336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:44.053233 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 4a5b78b1-740e-40a9-8401-5d9f47128bdd completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:44.068138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Usage tracker for resource:port and tenant:4daabc80fb744e62aca779fa277e241d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:44.068138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:44.080744 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4a5b78b1-740e-40a9-8401-5d9f47128bdd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:44.080744 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:44.115002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:44.119779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3af91feb-4088-4b4d-836a-7e8054906de2']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:44.147873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Made reservation on behalf of 281d0c58fa114694a3293de8c107204f for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:44.150340 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:44.197815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b01fc2c-0605-4258-b24a-eae670aa0f3f req-ca893868-57b1-430a-b593-73b3820f4bc0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:44.205359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b01fc2c-0605-4258-b24a-eae670aa0f3f req-ca893868-57b1-430a-b593-73b3820f4bc0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 944 time: 1.6347995 May 12 15:32:44.208561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ec07d999-a5e5-4d9e-8863-5aef618b5e17') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:44.208978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ec07d999-a5e5-4d9e-8863-5aef618b5e17') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:44.389862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d8f5ec53-b5ec-4adc-a331-b59c0080b163 None None] Provisioning for port 45ca2419-3316-4890-add7-265905134549 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:44.406821 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d8f5ec53-b5ec-4adc-a331-b59c0080b163 None None] Provisioning complete for port 45ca2419-3316-4890-add7-265905134549 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:44.406821 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d8f5ec53-b5ec-4adc-a331-b59c0080b163 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:44.447794 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:44.474587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:44.474587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:44.475210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:44.481216 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:44.507543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:44.508581 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:44.510315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event deleted for resources: {'Port': ['ID=d34a63b6-2dbe-47d1-9d15-9dd7ae780c97,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:44.513796 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:44.524840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Releasing vlan 590 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:32:44.525516 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:44.526140 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 7 to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc May 12 15:32:44.535553 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d91d3d84-dda2-4046-8dc1-9d8efa52de7d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 5.6552656 May 12 15:32:44.578104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Request body: {'port': {'device_id': '8fb6500d-7db4-46cb-945c-e5ef82421deb', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:44.627747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d8f5ec53-b5ec-4adc-a331-b59c0080b163 None None] Port 45ca2419-3316-4890-add7-265905134549 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:32:44.648186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 4a5b78b1-740e-40a9-8401-5d9f47128bdd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4a5b78b1-740e-40a9-8401-5d9f47128bdd,segment=NetworkSegment(426b21ab-c085-43bd-9d4e-926b64edbea5),segment_id=426b21ab-c085-43bd-9d4e-926b64edbea5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: timer() May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:32:44.649433 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:32:44.658333 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:44.747618 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b01fc2c-0605-4258-b24a-eae670aa0f3f req-da7a8fcd-8f7a-48a5-9f07-ed9f433b6f26 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=82085887-047f-4f61-8ddc-697504fbd406&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5409067 May 12 15:32:44.748558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Made reservation on behalf of 4daabc80fb744e62aca779fa277e241d for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:44.922963 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-34c3bcb5-077e-40f4-8c93-ddb53cd025fd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:44.922963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-041efc09-d71c-4e6e-8c8a-fa4be9d00877 None None] Provisioning for port 39b0dcfb-7db6-479a-9d08-7ab584f1636a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:44.966016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-041efc09-d71c-4e6e-8c8a-fa4be9d00877 None None] Provisioning complete for port 39b0dcfb-7db6-479a-9d08-7ab584f1636a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:44.966016 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-041efc09-d71c-4e6e-8c8a-fa4be9d00877 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:44.986748 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:45.013198 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:45.032479 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:45.068483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=4a5b78b1-740e-40a9-8401-5d9f47128bdd,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:45.098027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:45.098367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:45.098708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:45.101412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Network': ['ID=3af91feb-4088-4b4d-836a-7e8054906de2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:45.153651 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-041efc09-d71c-4e6e-8c8a-fa4be9d00877 None None] Port 39b0dcfb-7db6-479a-9d08-7ab584f1636a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:32:45.175393 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-041efc09-d71c-4e6e-8c8a-fa4be9d00877 None None] Provisioning complete for port 4a5b78b1-740e-40a9-8401-5d9f47128bdd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:45.175786 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-041efc09-d71c-4e6e-8c8a-fa4be9d00877 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:45.233657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-a333f823-bb1e-4bff-aecd-8035cfb29ec4 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:45.242121 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-a333f823-bb1e-4bff-aecd-8035cfb29ec4 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.76 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 818 time: 1.4287789 May 12 15:32:45.257809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-195c014a-3220-45f7-82a5-8d4959944b8e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/networks/3af91feb-4088-4b4d-836a-7e8054906de2 HTTP/1.1" status: 204 len: 168 time: 8.9312544 May 12 15:32:45.276915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:45.276915 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:45.279482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53108) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:45.312150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Request body: {'port': {'device_id': '15e319f9-b1d8-4a28-af53-803684c8b243', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'admin_state_up': True, 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:45.356388 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 8 to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc May 12 15:32:45.409715 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:45.486049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] device_id is not set on port 952420bc-30cf-42d3-8cca-47f8ae7adc73 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:32:45.545611 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca687602-957d-4bdd-b887-fed0dc498fef req-01730da0-7612-48fa-ac95-f4bed5070513 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 210 time: 0.2536423 May 12 15:32:45.584928 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c3ae479a-8367-4f1d-a683-a6ab3267e768 None None] Provisioning complete for port 39b0dcfb-7db6-479a-9d08-7ab584f1636a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:45.584928 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3ae479a-8367-4f1d-a683-a6ab3267e768 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:45.610757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-862353349'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:45.630518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:45.722771 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c3ae479a-8367-4f1d-a683-a6ab3267e768 None None] Port 39b0dcfb-7db6-479a-9d08-7ab584f1636a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:32:45.758528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Allocated IP 2001:db8::306 (aecd5d86-5173-456d-9e81-e9cec7c6c409/8e14ccb3-bcde-425d-ac11-c8bd493ae5f1/952420bc-30cf-42d3-8cca-47f8ae7adc73) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:32:45.770473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:45.770473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Usage tracker for resource:port and tenant:ed8d9bf58283443480f0c62e72d53449 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:45.793252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:network and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:45.793252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:45.793252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:45.829641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:45.830699 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:45.830699 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:45.842780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:45.853566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Made reservation on behalf of ed8d9bf58283443480f0c62e72d53449 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:45.862198 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:46.053655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:46.073851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:46.073851 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:46.073851 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 9 to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc May 12 15:32:46.135625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:32:46.151663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:46.151663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:46.151663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:46.155364 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:46.193111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-84b92177-50be-45bb-b246-3d199a437c4d req-e9951f1f-57bd-40c2-a8cd-ffe0f3cc9f32 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 210 time: 0.1720343 May 12 15:32:46.234825 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:46.234825 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:46.234825 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 10 to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc May 12 15:32:46.238784 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:46.253569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:46.257101 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:46.484123 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:46.506154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Transition to ACTIVE for port object 952420bc-30cf-42d3-8cca-47f8ae7adc73 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:46.579508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:32:46.596114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae189925-e700-49e8-adbd-4192a3003756 None None] Sync routers for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:32:46.617444 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae189925-e700-49e8-adbd-4192a3003756 None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:32:46.617444 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ae189925-e700-49e8-adbd-4192a3003756 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:46.629778 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:46.659407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:46.659976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:46.660067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:46.784826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4a5b78b1-740e-40a9-8401-5d9f47128bdd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:32:46.836446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Network aecd5d86-5173-456d-9e81-e9cec7c6c409 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:46.894313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event updated for resources: {'Port': ['ID=952420bc-30cf-42d3-8cca-47f8ae7adc73,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:46.894313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:46.899013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:46.914853 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:46.914853 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:46.962562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 45ca2419-3316-4890-add7-265905134549 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:32:46.971196 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:46.989562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Transition to ACTIVE for port object 45ca2419-3316-4890-add7-265905134549 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:47.009229 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f7552a8b-655d-45b4-8e89-fd70b1af9b6b req-f68a16a7-01d5-451c-b507-05a987d8eff0 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 210 time: 0.1651757 May 12 15:32:47.150972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Allocated IP 172.20.0.12 (bca349be-4618-43ae-a547-b8bd2b254da4/aa771580-393c-41f8-ad67-611be21e45d3/89f8d6b5-809f-446f-bb95-9e0f45b66f60) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:32:47.183692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.objects.ports [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88152) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:32:47.184201 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:47.186472 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ae189925-e700-49e8-adbd-4192a3003756 None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:32:47.280246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] No DVR routers for this DVR port d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:32:47.281961 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4a5b78b1-740e-40a9-8401-5d9f47128bdd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:47.283567 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:47.283763 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:47.475040 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:47.592723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-780b105e-38b0-4d17-801c-31bd4d1b70ea None None] Provisioning for port 952420bc-30cf-42d3-8cca-47f8ae7adc73 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:47.610643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'name': 'network-vif-deleted', 'tag': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:32:47.623305 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c3b9efcd-53bf-4a92-b684-865840212359 req-862167da-b16d-4188-a854-00fb2066fb2c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.76 "DELETE /v2.0/ports/d34a63b6-2dbe-47d1-9d15-9dd7ae780c97 HTTP/1.1" status: 204 len: 173 time: 13.9011691 May 12 15:32:47.666024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Pushing event updated for resources: {'Port': ['ID=45ca2419-3316-4890-add7-265905134549,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:47.688090 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7043f584-0a04-4da7-8a08-361b363f8d3a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1007 time: 5.1607826 May 12 15:32:47.689104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53140) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:47.695062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:47.695412 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 30f112aa-f87c-445d-b3bf-a28abff76bdc on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:32:47.695778 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:47.791869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:47.791869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:47.791869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:47.791869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:47.791869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:47.791869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:47.791869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:47.797477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:47.797477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:47.797477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:47.797477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:47.797477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:47.812754 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-780b105e-38b0-4d17-801c-31bd4d1b70ea None None] Provisioning complete for port 952420bc-30cf-42d3-8cca-47f8ae7adc73 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:47.812754 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-780b105e-38b0-4d17-801c-31bd4d1b70ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:47.817539 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9f3ea459-0a07-4842-86cb-4e6b6267a14b'] response: {'server_uuid': '80845da3-b1a6-4994-ba44-34e52dca4f66', 'name': 'network-vif-deleted', 'tag': 'd34a63b6-2dbe-47d1-9d15-9dd7ae780c97', 'status': 'completed', 'code': 200} May 12 15:32:47.836672 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f582d32d-06fc-48d1-bbf7-b300cbe4d421 req-3e111a2d-4ca8-4cf5-aa09-8c132d0b755f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=80845da3-b1a6-4994-ba44-34e52dca4f66 HTTP/1.1" status: 200 len: 210 time: 0.1394951 May 12 15:32:47.859121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Checking segment: {'id': '88bf9e39-7798-4951-9f43-c41ad31d5afe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': 'bb9736c7-290f-4580-8c13-53b75603f9df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:32:47.859121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Network hostable DHCP agents. Network: bb9736c7-290f-4580-8c13-53b75603f9df, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:32:47.866192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event updated for resources: {'Subnet': ['ID=1fe8a692-ad0f-4592-a201-33f7bc1fdd53,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:47.961356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Network bb9736c7-290f-4580-8c13-53b75603f9df is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:32:47.993683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, bb9736c7-290f-4580-8c13-53b75603f9df) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:47.994718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:47.995065 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:48.049730 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-33ea4801-37c7-498a-9f52-490a80c4d008 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 822 time: 5.4922402 May 12 15:32:48.050799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53148) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:48.061449 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af6cbeed-f184-4a22-b91c-8d0b5c2ae2bd None None] Network bb9736c7-290f-4580-8c13-53b75603f9df requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:32:48.063036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Request body: {'port': {'name': 'tempest-RoutersIpV6AdminTest-1129939975', 'network_id': 'bb9736c7-290f-4580-8c13-53b75603f9df'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:48.080039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:48.082513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 587} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:32:48.086685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Usage tracker for resource:port and tenant:281d0c58fa114694a3293de8c107204f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:48.095243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:48.108749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:48.130778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Made reservation on behalf of 281d0c58fa114694a3293de8c107204f for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:48.136217 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:48.178467 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:48.178998 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Added segment aea0890d-1c8c-4cd4-8e5c-45fff3c1075e of type vlan for network 11ca6d1d-de52-4ba5-a178-0bee9c79e383 May 12 15:32:48.190612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0b7b695-e8a6-4876-8478-ea1e63eecc90 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:48.224628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0b7b695-e8a6-4876-8478-ea1e63eecc90 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:48.224628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0b7b695-e8a6-4876-8478-ea1e63eecc90 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:48.235968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c0b7b695-e8a6-4876-8478-ea1e63eecc90 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Synchronizing usage tracker for tenant:4daabc80fb744e62aca779fa277e241d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:32:48.269341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] device_id is not set on port 98eebad6-3697-45a4-ac01-e85f1ead929b yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:32:48.440748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Allocated IP 2001:db8::2e (bb9736c7-290f-4580-8c13-53b75603f9df/1fe8a692-ad0f-4592-a201-33f7bc1fdd53/98eebad6-3697-45a4-ac01-e85f1ead929b) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:32:48.508769 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:48.538164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-780b105e-38b0-4d17-801c-31bd4d1b70ea None None] Port 952420bc-30cf-42d3-8cca-47f8ae7adc73 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:32:48.683064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] For port 30f112aa-f87c-445d-b3bf-a28abff76bdc, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:32:48.683064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempted to set empty binding levels {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:66}} May 12 15:32:48.716002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c0b7b695-e8a6-4876-8478-ea1e63eecc90 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Unset dirty status for tenant:4daabc80fb744e62aca779fa277e241d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:32:48.716002 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c0b7b695-e8a6-4876-8478-ea1e63eecc90 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2482 time: 0.9753113 May 12 15:32:48.746693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53166) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:48.775115 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:48.784060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9eb30b9a-201f-4968-86ad-31ed0902eefe req-8bda3b30-dfc3-43f8-9afb-e870555b26e7 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 210 time: 0.1966350 May 12 15:32:48.926954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb1030f8-2f94-47d3-a5e6-110910b0aa48 None None] Network bb9736c7-290f-4580-8c13-53b75603f9df requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:32:49.107715 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:49.120826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53186) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:49.304845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ae189925-e700-49e8-adbd-4192a3003756 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:49.323010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae189925-e700-49e8-adbd-4192a3003756 None None] Checking router: 616c45f4-38af-4ff7-8fb7-f1c61b204b6a for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:32:49.381229 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-52effd00-badc-4a2e-ba65-444fa8c9c345 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:49.397372 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:49.460243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae189925-e700-49e8-adbd-4192a3003756 None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:32:49.460243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ae189925-e700-49e8-adbd-4192a3003756 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:49.604696 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-52effd00-badc-4a2e-ba65-444fa8c9c345 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:49.657245 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:49.696236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Transition to ACTIVE for port object 89f8d6b5-809f-446f-bb95-9e0f45b66f60 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:49.739160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ada53070-0def-47be-a11d-a60e83dee57a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Deleting port 952420bc-30cf-42d3-8cca-47f8ae7adc73 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:49.739784 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ada53070-0def-47be-a11d-a60e83dee57a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:49.797494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Network bb9736c7-290f-4580-8c13-53b75603f9df is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:49.798395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event updated for resources: {'Port': ['ID=98eebad6-3697-45a4-ac01-e85f1ead929b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:49.806235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:49.824686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ae189925-e700-49e8-adbd-4192a3003756 None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:32:49.833934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:49.834956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:49.836990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] In _notify_port_updated(), no bound segment for port 30f112aa-f87c-445d-b3bf-a28abff76bdc on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:32:49.838026 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:49.838663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:49.839770 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:49.841626 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "PUT /v2.0/ports/30f112aa-f87c-445d-b3bf-a28abff76bdc HTTP/1.1" status: 200 len: 978 time: 12.2462184 May 12 15:32:49.859037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53198) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:50.065207 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b30c33df-0088-4607-aafc-02e41fc09f3e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1029 time: 1.9984741 May 12 15:32:50.065207 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-52effd00-badc-4a2e-ba65-444fa8c9c345 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:50.065207 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-52effd00-badc-4a2e-ba65-444fa8c9c345 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:50.065207 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-52effd00-badc-4a2e-ba65-444fa8c9c345 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "DELETE /v2.0/security-groups/82085887-047f-4f61-8ddc-697504fbd406 HTTP/1.1" status: 204 len: 168 time: 0.9385653 May 12 15:32:50.065207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53202) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:50.065207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53204) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:50.158074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:50.188896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a157f51-5c7d-43e6-8ec5-aab8053780df tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Pushing event updated for resources: {'Port': ['ID=30f112aa-f87c-445d-b3bf-a28abff76bdc,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:50.255039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52effd00-badc-4a2e-ba65-444fa8c9c345 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=82085887-047f-4f61-8ddc-697504fbd406,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:50.267945 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-2501017a-5cfd-4ce4-a93c-47fb889a4242 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] show failed (client error): The resource could not be found. May 12 15:32:50.267945 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2501017a-5cfd-4ce4-a93c-47fb889a4242 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups/82085887-047f-4f61-8ddc-697504fbd406 HTTP/1.1" status: 404 len: 347 time: 0.1695833 May 12 15:32:50.267945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53216) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:50.310493 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:50.501993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.501993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.501993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.501993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.501993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.501993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.501993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.501993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.501993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.501993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.501993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.501993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.501993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.507964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.507964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.507964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.507964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.507964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.507964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Synchronizing usage tracker for tenant:8d9d0187e68e4feda08559a57b3c422f on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:32:50.520751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Pushing event updated for resources: {'Port': ['ID=89f8d6b5-809f-446f-bb95-9e0f45b66f60,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:50.525446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-8aff23f6-63de-413f-881e-250d8f1afcd4 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Deleting port 98eebad6-3697-45a4-ac01-e85f1ead929b {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:50.525781 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8aff23f6-63de-413f-881e-250d8f1afcd4 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:50.570056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Attempting to bind port 45ca2419-3316-4890-add7-265905134549 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:50.571034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Attempting to bind port 45ca2419-3316-4890-add7-265905134549 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:50.571034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Attempting to bind port 45ca2419-3316-4890-add7-265905134549 on network bca349be-4618-43ae-a547-b8bd2b254da4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:50.614516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Unset dirty status for tenant:8d9d0187e68e4feda08559a57b3c422f on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:32:50.634284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Network bca349be-4618-43ae-a547-b8bd2b254da4 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:50.634284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:50.657129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53224) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:50.657129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:50.659513 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ab04847c-b38e-41b1-a1e5-4250a72feb07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 16112 time: 0.7770865 May 12 15:32:50.713901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Port 45ca2419-3316-4890-add7-265905134549 on network bca349be-4618-43ae-a547-b8bd2b254da4 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:50.713901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Attempting to bind port 45ca2419-3316-4890-add7-265905134549 on network bca349be-4618-43ae-a547-b8bd2b254da4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:50.730009 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ae189925-e700-49e8-adbd-4192a3003756 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:32:50.735320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae189925-e700-49e8-adbd-4192a3003756 None None] The sync data for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 is: [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:32:50.843984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 32, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:32:50.843984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Checking segment: {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:32:50.843984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Bound using segment: {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:32:50.843984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Bound port: 45ca2419-3316-4890-add7-265905134549, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:32:50.843984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:50.938389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Deleting port b37a3c82-7bfa-48ff-97f4-5504d9424767 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:50.938389 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:50.986458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:50.988254 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:50.993985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:51.005676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:51.007087 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:51.057087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2902fd0a-6a79-4c27-95d2-0cebae936a93 None None] Provisioning for port 89f8d6b5-809f-446f-bb95-9e0f45b66f60 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:51.057087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2902fd0a-6a79-4c27-95d2-0cebae936a93 None None] Provisioning complete for port 89f8d6b5-809f-446f-bb95-9e0f45b66f60 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:51.066558 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2902fd0a-6a79-4c27-95d2-0cebae936a93 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:51.119307 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 5.5519884 May 12 15:32:51.123925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4204c9bd-c9a2-4c76-adaa-e309c7ccd214 req-cdaf207a-9425-46ba-8ba7-e1cc8cc536af tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:51.123925 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4204c9bd-c9a2-4c76-adaa-e309c7ccd214 req-cdaf207a-9425-46ba-8ba7-e1cc8cc536af tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 932 time: 1.0021255 May 12 15:32:51.139693 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ada53070-0def-47be-a11d-a60e83dee57a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:51.192717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53230) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:51.200950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2902fd0a-6a79-4c27-95d2-0cebae936a93 None None] Port 89f8d6b5-809f-446f-bb95-9e0f45b66f60 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:32:51.220883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'subnet': {'network_id': '11ca6d1d-de52-4ba5-a178-0bee9c79e383', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:51.308866 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bec53f9a-17dd-4bd7-b9c6-17c22c8bbc42 None None] New status for floating IP 9fbfd049-9e42-4bf4-bede-947490c8e40d: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:32:51.492353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ada53070-0def-47be-a11d-a60e83dee57a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Calling delete_port for 952420bc-30cf-42d3-8cca-47f8ae7adc73 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:51.585831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8aff23f6-63de-413f-881e-250d8f1afcd4 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:51.800394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-8aff23f6-63de-413f-881e-250d8f1afcd4 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Calling delete_port for 98eebad6-3697-45a4-ac01-e85f1ead929b owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:51.820930 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-5c3b450e-9f8e-4d2d-9c27-6704a32efa6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 6.5230882 May 12 15:32:51.833009 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e5314587-871d-4156-bc69-4744908ab5f4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Deleting port 30f112aa-f87c-445d-b3bf-a28abff76bdc {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:51.833564 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e5314587-871d-4156-bc69-4744908ab5f4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:51.881258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ab545fe-65c8-4f74-b499-d231e67dbe53 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Network': ['ID=11ca6d1d-de52-4ba5-a178-0bee9c79e383,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:51.908662 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 11ca6d1d-de52-4ba5-a178-0bee9c79e383 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:32:51.946364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Request body: {'port': {'device_id': '15e319f9-b1d8-4a28-af53-803684c8b243', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:52.248897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:52.248897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:52.414090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4204c9bd-c9a2-4c76-adaa-e309c7ccd214 req-eed6ebe8-41b5-4603-aeb1-0e61ce343bb2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Synchronizing usage tracker for tenant:ed8d9bf58283443480f0c62e72d53449 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:32:52.432513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-e5314587-871d-4156-bc69-4744908ab5f4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] For port 30f112aa-f87c-445d-b3bf-a28abff76bdc, host n-h2-841483-1, got binding levels [] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:32:52.432513 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e5314587-871d-4156-bc69-4744908ab5f4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:52.448948 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ada53070-0def-47be-a11d-a60e83dee57a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:52.494107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] For port 45ca2419-3316-4890-add7-265905134549, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:32:52.523586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Calling delete_port for b37a3c82-7bfa-48ff-97f4-5504d9424767 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:52.566636 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:52.646435 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 2 row(s); 1 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:32:52.646435 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:32:52.662377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:52.668228 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4204c9bd-c9a2-4c76-adaa-e309c7ccd214 req-eed6ebe8-41b5-4603-aeb1-0e61ce343bb2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Unset dirty status for tenant:ed8d9bf58283443480f0c62e72d53449 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:32:52.668228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4204c9bd-c9a2-4c76-adaa-e309c7ccd214 req-eed6ebe8-41b5-4603-aeb1-0e61ce343bb2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.4749668 May 12 15:32:52.668228 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8aff23f6-63de-413f-881e-250d8f1afcd4 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:52.759684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:subnet and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:52.780262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:52.780262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:52.793316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aff23f6-63de-413f-881e-250d8f1afcd4 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event deleted for resources: {'Port': ['ID=98eebad6-3697-45a4-ac01-e85f1ead929b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:52.804252 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:52.804252 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:52.838301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ada53070-0def-47be-a11d-a60e83dee57a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event deleted for resources: {'Port': ['ID=952420bc-30cf-42d3-8cca-47f8ae7adc73,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:52.848627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e5314587-871d-4156-bc69-4744908ab5f4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Calling delete_port for 30f112aa-f87c-445d-b3bf-a28abff76bdc owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:52.879135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] For port 45ca2419-3316-4890-add7-265905134549, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=45ca2419-3316-4890-add7-265905134549,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:32:53.065608 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8aff23f6-63de-413f-881e-250d8f1afcd4 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:53.416605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Deleting port b37a3c82-7bfa-48ff-97f4-5504d9424767 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:53.416605 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:53.533266 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:53.548036 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:53.758454 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8aff23f6-63de-413f-881e-250d8f1afcd4 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "DELETE /v2.0/ports/98eebad6-3697-45a4-ac01-e85f1ead929b HTTP/1.1" status: 204 len: 168 time: 3.6628575 May 12 15:32:53.773517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53264) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:53.778128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:53.797417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:53.797417 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] 10.222.0.84 "PUT /v2.0/ports/45ca2419-3316-4890-add7-265905134549 HTTP/1.1" status: 200 len: 1091 time: 9.2365158 May 12 15:32:53.827000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8fb6500d-7db4-46cb-945c-e5ef82421deb', 'tag': '45ca2419-3316-4890-add7-265905134549'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:32:54.036800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'bb9736c7-290f-4580-8c13-53b75603f9df', 'external_fixed_ips': [{'subnet_id': '1fe8a692-ad0f-4592-a201-33f7bc1fdd53', 'ip_address': '2001:db8::2e'}]}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:54.055818 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-dbffce29-1123-4c7f-8d00-aa81bd4eb90a'] response: {'name': 'network-changed', 'server_uuid': '8fb6500d-7db4-46cb-945c-e5ef82421deb', 'tag': '45ca2419-3316-4890-add7-265905134549', 'status': 'completed', 'code': 200} May 12 15:32:54.120642 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e5314587-871d-4156-bc69-4744908ab5f4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:54.130673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:54.130673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Checking segment: {'id': 'aea0890d-1c8c-4cd4-8e5c-45fff3c1075e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '11ca6d1d-de52-4ba5-a178-0bee9c79e383'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:32:54.136216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network hostable DHCP agents. Network: 11ca6d1d-de52-4ba5-a178-0bee9c79e383, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:32:54.141131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Subnet': ['ID=72723c37-b245-4008-9464-488728e67f28,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:54.157306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Usage tracker for resource:router and tenant:281d0c58fa114694a3293de8c107204f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:54.168722 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e5314587-871d-4156-bc69-4744908ab5f4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:54.175395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:54.192357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:54.255516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 11ca6d1d-de52-4ba5-a178-0bee9c79e383 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:32:54.255516 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:54.255516 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:54.255516 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:54.255516 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:54.354478 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:32:54.372770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 11ca6d1d-de52-4ba5-a178-0bee9c79e383) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:54.388343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9486a4e8-df87-4fdf-9880-594e010a7e82 None None] Network 11ca6d1d-de52-4ba5-a178-0bee9c79e383 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:32:54.444944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b60bd37-c34c-4032-9ba8-46088580def0 service neutron] Pushing event updated for resources: {'Port': ['ID=45ca2419-3316-4890-add7-265905134549,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:54.479121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ada53070-0def-47be-a11d-a60e83dee57a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:54.479121 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ada53070-0def-47be-a11d-a60e83dee57a tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "DELETE /v2.0/ports/952420bc-30cf-42d3-8cca-47f8ae7adc73 HTTP/1.1" status: 204 len: 168 time: 5.6732922 May 12 15:32:54.507216 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e5314587-871d-4156-bc69-4744908ab5f4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "DELETE /v2.0/ports/30f112aa-f87c-445d-b3bf-a28abff76bdc HTTP/1.1" status: 204 len: 168 time: 3.8050101 May 12 15:32:54.507216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53276) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:54.507216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53280) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:54.635646 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-6e256530-d7c5-4de1-beba-1f6935c784f7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] GET failed (client error): The resource could not be found. May 12 15:32:54.635646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6e256530-d7c5-4de1-beba-1f6935c784f7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Synchronizing usage tracker for tenant:8d9d0187e68e4feda08559a57b3c422f on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:32:54.722463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Calling delete_port for b37a3c82-7bfa-48ff-97f4-5504d9424767 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:32:54.759838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:54.760268 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:54.764608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5314587-871d-4156-bc69-4744908ab5f4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Pushing event deleted for resources: {'Port': ['ID=30f112aa-f87c-445d-b3bf-a28abff76bdc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:54.781180 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-c3281379-9014-4152-bdb1-f0733eb48753 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] GET failed (client error): The resource could not be found. May 12 15:32:54.781764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c3281379-9014-4152-bdb1-f0733eb48753 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Synchronizing usage tracker for tenant:4daabc80fb744e62aca779fa277e241d on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:32:54.795188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 89f8d6b5-809f-446f-bb95-9e0f45b66f60 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:32:54.797077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3d843d2d-6041-4f16-a6b2-7fe355bcb422 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 3.6087332 May 12 15:32:54.804634 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:54.807952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53288) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:54.828832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a24d0b40-f78c-47ba-a955-99e80bfcba7a req-9ecec1e3-98dc-415b-80d3-8ac295d81575 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:54.830423 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a24d0b40-f78c-47ba-a955-99e80bfcba7a req-9ecec1e3-98dc-415b-80d3-8ac295d81575 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 932 time: 0.7537062 May 12 15:32:54.834399 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-231ebf4c-7a74-4561-b417-fe04a00f93c3 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1706411384', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:54.846234 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:54.858063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c3281379-9014-4152-bdb1-f0733eb48753 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Unset dirty status for tenant:4daabc80fb744e62aca779fa277e241d on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:32:54.872905 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c3281379-9014-4152-bdb1-f0733eb48753 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "GET /v2.0/ports/952420bc-30cf-42d3-8cca-47f8ae7adc73 HTTP/1.1" status: 404 len: 333 time: 0.3084335 May 12 15:32:54.878110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53292) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:54.884965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6e256530-d7c5-4de1-beba-1f6935c784f7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Unset dirty status for tenant:8d9d0187e68e4feda08559a57b3c422f on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:32:54.884965 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6e256530-d7c5-4de1-beba-1f6935c784f7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "GET /v2.0/ports/30f112aa-f87c-445d-b3bf-a28abff76bdc HTTP/1.1" status: 404 len: 333 time: 0.3152363 May 12 15:32:54.891323 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53296) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:54.907066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-231ebf4c-7a74-4561-b417-fe04a00f93c3 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:54.911644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Request body: {'port': {'network_id': 'aecd5d86-5173-456d-9e81-e9cec7c6c409', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1518081634'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:54.916722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-231ebf4c-7a74-4561-b417-fe04a00f93c3 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:router and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:54.916722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-75c9cb6a-32db-4df7-8bb6-9d6f6f461978 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:54.916722 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-75c9cb6a-32db-4df7-8bb6-9d6f6f461978 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 1094 time: 0.9640024 May 12 15:32:54.916722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-231ebf4c-7a74-4561-b417-fe04a00f93c3 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:54.916722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Transition to ACTIVE for port object 89f8d6b5-809f-446f-bb95-9e0f45b66f60 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:54.924351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-1836833765', 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:54.927226 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-231ebf4c-7a74-4561-b417-fe04a00f93c3 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:54.927226 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:54.944217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-11ca6d1d-de52-4ba5-a178-0bee9c79e383', 'network_id': '11ca6d1d-de52-4ba5-a178-0bee9c79e383', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'fixed_ips': [{'subnet_id': '72723c37-b245-4008-9464-488728e67f28'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:32:54.944217 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:55.034041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:55.201622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Allocated IP 2001:db8::2 (11ca6d1d-de52-4ba5-a178-0bee9c79e383/72723c37-b245-4008-9464-488728e67f28/6d15237b-4640-455e-aa3a-951755fcf99e) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:32:55.224975 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-8056e056-1c78-48db-874e-7b4bbb0a5a53 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=45ca2419-3316-4890-add7-265905134549 HTTP/1.1" status: 200 len: 217 time: 0.3047817 May 12 15:32:55.232138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-231ebf4c-7a74-4561-b417-fe04a00f93c3 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:55.233552 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-231ebf4c-7a74-4561-b417-fe04a00f93c3 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:55.561462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Pushing event updated for resources: {'Port': ['ID=89f8d6b5-809f-446f-bb95-9e0f45b66f60,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:55.651905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:55.656546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-9aa20190-ec64-45b9-8e83-1e771a717d04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:55.661860 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-9aa20190-ec64-45b9-8e83-1e771a717d04 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.4192595 May 12 15:32:55.743767 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-231ebf4c-7a74-4561-b417-fe04a00f93c3 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:55.819558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Made reservation on behalf of 8d9d0187e68e4feda08559a57b3c422f for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:55.819558 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:55.876289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a24d0b40-f78c-47ba-a955-99e80bfcba7a req-467c7159-b2be-4f93-82c2-686a191e2990 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9343772 May 12 15:32:55.894923 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:55.916335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Transition to ACTIVE for port object 6d15237b-4640-455e-aa3a-951755fcf99e will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:55.973785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Transition to ACTIVE for port object 6d15237b-4640-455e-aa3a-951755fcf99e will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:56.003372 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:56.021782 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:56.025703 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-231ebf4c-7a74-4561-b417-fe04a00f93c3 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:56.084562 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-231ebf4c-7a74-4561-b417-fe04a00f93c3 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:56.088467 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-231ebf4c-7a74-4561-b417-fe04a00f93c3 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 1.2655730 May 12 15:32:56.089450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53310) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:56.095489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d9035772-91ae-4e1c-b258-bbd6770ee90b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:56.096988 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-d9035772-91ae-4e1c-b258-bbd6770ee90b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4139705 May 12 15:32:56.117091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Network 11ca6d1d-de52-4ba5-a178-0bee9c79e383 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:56.120008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:56.124524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:56.126865 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Pushing event updated for resources: {'Port': ['ID=6d15237b-4640-455e-aa3a-951755fcf99e,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:56.198092 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:56.215373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] device_id is not set on port 6c9f656d-ae17-4501-8d50-2243aa810367 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:32:56.312551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Attempting to bind port 6d15237b-4640-455e-aa3a-951755fcf99e on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:56.312551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Attempting to bind port 6d15237b-4640-455e-aa3a-951755fcf99e by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'aea0890d-1c8c-4cd4-8e5c-45fff3c1075e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '11ca6d1d-de52-4ba5-a178-0bee9c79e383'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:56.312551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Attempting to bind port 6d15237b-4640-455e-aa3a-951755fcf99e on network 11ca6d1d-de52-4ba5-a178-0bee9c79e383 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:56.341761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 32, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:32:56.341761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Checking segment: {'id': 'aea0890d-1c8c-4cd4-8e5c-45fff3c1075e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '11ca6d1d-de52-4ba5-a178-0bee9c79e383'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:32:56.341761 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:56.341761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Bound using segment: {'id': 'aea0890d-1c8c-4cd4-8e5c-45fff3c1075e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '11ca6d1d-de52-4ba5-a178-0bee9c79e383'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:32:56.341761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Bound port: 6d15237b-4640-455e-aa3a-951755fcf99e, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aea0890d-1c8c-4cd4-8e5c-45fff3c1075e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '11ca6d1d-de52-4ba5-a178-0bee9c79e383'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:32:56.341761 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:56.400468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:56.434727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Attempting to bind port 89f8d6b5-809f-446f-bb95-9e0f45b66f60 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:32:56.435421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Attempting to bind port 89f8d6b5-809f-446f-bb95-9e0f45b66f60 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:32:56.435421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Attempting to bind port 89f8d6b5-809f-446f-bb95-9e0f45b66f60 on network bca349be-4618-43ae-a547-b8bd2b254da4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:56.438968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event deleted for resources: {'Port': ['ID=b37a3c82-7bfa-48ff-97f4-5504d9424767,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:56.447397 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] For port 6d15237b-4640-455e-aa3a-951755fcf99e, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:32:56.451265 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] For port 6d15237b-4640-455e-aa3a-951755fcf99e, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6d15237b-4640-455e-aa3a-951755fcf99e,segment=NetworkSegment(aea0890d-1c8c-4cd4-8e5c-45fff3c1075e),segment_id=aea0890d-1c8c-4cd4-8e5c-45fff3c1075e)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:32:56.461032 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:56.520547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:56.521119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Port 89f8d6b5-809f-446f-bb95-9e0f45b66f60 on network bca349be-4618-43ae-a547-b8bd2b254da4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:32:56.521471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Attempting to bind port 89f8d6b5-809f-446f-bb95-9e0f45b66f60 on network bca349be-4618-43ae-a547-b8bd2b254da4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:32:56.538890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 32, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:32:56.539222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Checking segment: {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:32:56.539812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Bound using segment: {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:32:56.540421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Bound port: 89f8d6b5-809f-446f-bb95-9e0f45b66f60, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:32:56.540935 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:56.580923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87442c27-d6d2-48c2-b5f5-e97c31dcc034 None None] Pushing event updated for resources: {'Port': ['ID=6d15237b-4640-455e-aa3a-951755fcf99e,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:56.695120 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:56.721879 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-3ac8d856-923c-4c3e-84b2-615b02704efc service neutron] 10.222.0.84 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5505295 May 12 15:32:56.726748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Made reservation on behalf of 4daabc80fb744e62aca779fa277e241d for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:32:56.726748 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:56.882288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] device_id is not set on port 53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:32:56.909512 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:32:57.051255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:57.051255 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-de2c753f-f6f2-4273-bfe2-fb102c42842f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "DELETE /v2.0/floatingips/9fbfd049-9e42-4bf4-bede-947490c8e40d HTTP/1.1" status: 204 len: 168 time: 6.7780638 May 12 15:32:57.352558 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:57.574596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] For port 89f8d6b5-809f-446f-bb95-9e0f45b66f60, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:32:57.597308 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f3525a7-61a7-4f3f-a7f7-7df21cebd927 req-39df9ede-4692-444a-95ef-6ca24b4e8435 service neutron] 10.222.0.84 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8567541 May 12 15:32:57.597308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] For port 89f8d6b5-809f-446f-bb95-9e0f45b66f60, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=89f8d6b5-809f-446f-bb95-9e0f45b66f60,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:32:57.605050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Allocated IP 2001:db8::15d (aecd5d86-5173-456d-9e81-e9cec7c6c409/8e14ccb3-bcde-425d-ac11-c8bd493ae5f1/53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:32:57.620304 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:57.624194 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:57.726277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Network 23f523e9-0880-4d90-990d-969ff64c60e0 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:32:57.767208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:32:57.767208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:32:57.774917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:57.774917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:57.843904 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 964 time: 2.9484730 May 12 15:32:57.857339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53336) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:57.887731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53342) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:57.937174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1265375227', 'description': 'tempest-description--661050329'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:32:57.976353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:58.114038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:58.117732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:58.127649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:58.155082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:58.155082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Pushing event updated for resources: {'Port': ['ID=89f8d6b5-809f-446f-bb95-9e0f45b66f60,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:58.170390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:58.170390 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:58.170390 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-82d74e51-8c7b-43fe-971e-eafc58ade9b5 service neutron] 10.222.0.76 "PUT /v2.0/ports/89f8d6b5-809f-446f-bb95-9e0f45b66f60 HTTP/1.1" status: 200 len: 1092 time: 6.2969296 May 12 15:32:58.207899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '15e319f9-b1d8-4a28-af53-803684c8b243', 'tag': '89f8d6b5-809f-446f-bb95-9e0f45b66f60'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:32:58.315981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Pushing event updated for resources: {'Port': ['ID=6c9f656d-ae17-4501-8d50-2243aa810367,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:58.550273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6940a583-6285-4c1d-a21f-f99a8ba807b3 req-4f2b336d-ffb6-479c-95cc-4e1f016c1682 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:58.621687 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6940a583-6285-4c1d-a21f-f99a8ba807b3 req-4f2b336d-ffb6-479c-95cc-4e1f016c1682 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 944 time: 1.3967021 May 12 15:32:58.785143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:58.785143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:58.785143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:58.785143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:58.785143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:58.785143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:58.785143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:58.785143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:58.789254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:58.789254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:58.789254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:58.789254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba9c567-1170-4b85-979d-37b47d9895f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:32:58.860768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-013206b6-eb78-4442-ae10-9b1926fed508 None None] Network 11ca6d1d-de52-4ba5-a178-0bee9c79e383 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:32:59.048800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6d15237b-4640-455e-aa3a-951755fcf99e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:32:59.058123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90a4344f-3ac9-414c-b6e2-09180111b583 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:59.058123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-90a4344f-3ac9-414c-b6e2-09180111b583 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Synchronizing usage tracker for tenant:8d9d0187e68e4feda08559a57b3c422f on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:32:59.122077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Allocated IP 2001:db8::1 (11ca6d1d-de52-4ba5-a178-0bee9c79e383/72723c37-b245-4008-9464-488728e67f28/72ad51d2-278f-4aea-be4e-3be2ce1c5326) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:32:59.162688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6940a583-6285-4c1d-a21f-f99a8ba807b3 req-44cc6f4b-82dd-4279-9511-1000e559cce0 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5847015 May 12 15:32:59.174673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 6d15237b-4640-455e-aa3a-951755fcf99e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:59.203384 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 6d15237b-4640-455e-aa3a-951755fcf99e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:59.203384 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:59.286194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-90a4344f-3ac9-414c-b6e2-09180111b583 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Unset dirty status for tenant:8d9d0187e68e4feda08559a57b3c422f on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:32:59.287446 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-90a4344f-3ac9-414c-b6e2-09180111b583 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "GET /v2.0/ports/6c9f656d-ae17-4501-8d50-2243aa810367 HTTP/1.1" status: 200 len: 959 time: 1.4220896 May 12 15:32:59.301518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53360) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:32:59.305296 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-326d6435-8ae0-48e8-b421-bc246db8e03f None None] Provisioning for port 6d15237b-4640-455e-aa3a-951755fcf99e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:32:59.331001 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-326d6435-8ae0-48e8-b421-bc246db8e03f None None] Provisioning complete for port 6d15237b-4640-455e-aa3a-951755fcf99e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:32:59.331648 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-326d6435-8ae0-48e8-b421-bc246db8e03f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:59.458464 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:59.473676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-47ce604c-33ec-44e3-b52c-778cb14a5db2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Deleting port 6c9f656d-ae17-4501-8d50-2243aa810367 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:32:59.473676 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-47ce604c-33ec-44e3-b52c-778cb14a5db2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:59.574038 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:59.621129 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:59.643702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Transition to ACTIVE for port object 53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:59.646398 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Transition to ACTIVE for port object 72ad51d2-278f-4aea-be4e-3be2ce1c5326 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:32:59.652523 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:59.666798 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b390bddd-020e-4d58-aed6-2af69180b0ee'] response: {'name': 'network-changed', 'server_uuid': '15e319f9-b1d8-4a28-af53-803684c8b243', 'tag': '89f8d6b5-809f-446f-bb95-9e0f45b66f60', 'status': 'completed', 'code': 200} May 12 15:32:59.670067 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:59.685851 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:59.740365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:32:59.748803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group_rule and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:32:59.748803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:32:59.755523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:32:59.859648 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:59.873111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:59.938786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:32:59.959362 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:32:59.974386 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60b2ceb1-46af-44eb-99da-7cd325b022a0 req-2b65b371-cc0b-413e-ad74-f42886203e66 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:32:59.976399 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60b2ceb1-46af-44eb-99da-7cd325b022a0 req-2b65b371-cc0b-413e-ad74-f42886203e66 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 1094 time: 2.2481515 May 12 15:32:59.991823 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 6d15237b-4640-455e-aa3a-951755fcf99e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6d15237b-4640-455e-aa3a-951755fcf99e,segment=NetworkSegment(aea0890d-1c8c-4cd4-8e5c-45fff3c1075e),segment_id=aea0890d-1c8c-4cd4-8e5c-45fff3c1075e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:00.057160 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:00.208906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-47ce604c-33ec-44e3-b52c-778cb14a5db2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:00.226710 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:00.240391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=72ad51d2-278f-4aea-be4e-3be2ce1c5326,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:00.241364 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-326d6435-8ae0-48e8-b421-bc246db8e03f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:00.356158 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=6d15237b-4640-455e-aa3a-951755fcf99e,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:00.440447 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-326d6435-8ae0-48e8-b421-bc246db8e03f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:33:00.441257 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-326d6435-8ae0-48e8-b421-bc246db8e03f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:33:00.449652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 45ca2419-3316-4890-add7-265905134549 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:33:00.472712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 11ca6d1d-de52-4ba5-a178-0bee9c79e383 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:00.478575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-c9cf5a29-f600-42b9-8715-f645b632d591 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:00.480368 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-c9cf5a29-f600-42b9-8715-f645b632d591 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 1095 time: 2.0550928 May 12 15:33:00.481666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-47ce604c-33ec-44e3-b52c-778cb14a5db2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Calling delete_port for 6c9f656d-ae17-4501-8d50-2243aa810367 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:00.490820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:00.563251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:00.564193 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:00.578808 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:00.580447 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-675c4371-973e-4d96-9483-f792a20e3f68 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1781 time: 2.6780717 May 12 15:33:00.591341 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-c9b44f70-743f-4461-93c0-aef8c95e945b service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=89f8d6b5-809f-446f-bb95-9e0f45b66f60 HTTP/1.1" status: 200 len: 217 time: 0.0954125 May 12 15:33:00.592111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53374) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:00.610644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4d35d096-d7b0-4ee3-8061-2466fd67706a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'security_group_rule': {'security_group_id': 'c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:00.703970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4d35d096-d7b0-4ee3-8061-2466fd67706a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:00.716155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Network aecd5d86-5173-456d-9e81-e9cec7c6c409 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:00.738169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4d35d096-d7b0-4ee3-8061-2466fd67706a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group_rule and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:00.738169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4d35d096-d7b0-4ee3-8061-2466fd67706a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:00.800038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4d35d096-d7b0-4ee3-8061-2466fd67706a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:00.809660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 45ca2419-3316-4890-add7-265905134549, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=45ca2419-3316-4890-add7-265905134549,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:00.831677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:00.862938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '45ca2419-3316-4890-add7-265905134549', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'port_id': '45ca2419-3316-4890-add7-265905134549', 'mac_address': 'fa:16:3e:1b:f9:b4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 581, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:33:00.880104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60b2ceb1-46af-44eb-99da-7cd325b022a0 req-cbbb5e49-2c16-4b6c-9453-2b0082631290 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:00.892292 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60b2ceb1-46af-44eb-99da-7cd325b022a0 req-cbbb5e49-2c16-4b6c-9453-2b0082631290 service neutron] 10.222.0.84 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 0.8563967 May 12 15:33:00.900254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-7a19f235-8e0a-4a46-9ba1-e5b11c926c2e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:00.903688 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-7a19f235-8e0a-4a46-9ba1-e5b11c926c2e service neutron] 10.222.0.76 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.2750094 May 12 15:33:00.911139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:00.916687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:00.917313 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:00.948268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event updated for resources: {'Port': ['ID=53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:01.105350 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60b2ceb1-46af-44eb-99da-7cd325b022a0 req-5a60bc34-24cf-4c38-866e-c08ac4cc2a18 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=45ca2419-3316-4890-add7-265905134549 HTTP/1.1" status: 200 len: 217 time: 0.2001035 May 12 15:33:01.114187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d35d096-d7b0-4ee3-8061-2466fd67706a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:01.119997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Allocated IP 2001:db8::2e (bb9736c7-290f-4580-8c13-53b75603f9df/1fe8a692-ad0f-4592-a201-33f7bc1fdd53/cadbddb9-794f-4060-a651-236927206734) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:33:01.122585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6d15237b-4640-455e-aa3a-951755fcf99e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:33:01.233659 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:01.252741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 45ca2419-3316-4890-add7-265905134549 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:33:01.287456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 45ca2419-3316-4890-add7-265905134549, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=45ca2419-3316-4890-add7-265905134549,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:01.292791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-9e074b9f-bb69-47b1-9d06-f83feaa1b360 req-47f4d44c-07bb-4163-b7bf-7c63f6f77023 service neutron] (88151) timed out ('10.222.0.82', 57954) {{(pid=88151) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 15:33:01.294616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ddd96142-f4f2-4d9b-a54f-484a1170a0eb None None] Provisioning for port 72ad51d2-278f-4aea-be4e-3be2ce1c5326 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:33:01.298864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 6d15237b-4640-455e-aa3a-951755fcf99e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:01.299227 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:01.332401 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:01.334124 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ddd96142-f4f2-4d9b-a54f-484a1170a0eb None None] Provisioning complete for port 72ad51d2-278f-4aea-be4e-3be2ce1c5326 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:01.334484 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ddd96142-f4f2-4d9b-a54f-484a1170a0eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:01.336292 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4f6ecb6b-2e57-484e-9de0-f66fb3c2a1eb tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 6.4712648 May 12 15:33:01.339505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53380) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:01.346711 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-47ce604c-33ec-44e3-b52c-778cb14a5db2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:01.369931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-15f2ba52-8e83-4757-8512-520d4f19a68c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::20b', 'mac_address': 'fa:16:3e:67:6c:cb'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:01.411951 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d35d096-d7b0-4ee3-8061-2466fd67706a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:01.414245 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:01.426277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60b2ceb1-46af-44eb-99da-7cd325b022a0 req-6860d2d9-3afe-4c8a-8f7d-adbc7e5e9a82 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:01.429871 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60b2ceb1-46af-44eb-99da-7cd325b022a0 req-6860d2d9-3afe-4c8a-8f7d-adbc7e5e9a82 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.3008606 May 12 15:33:01.434108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d35d096-d7b0-4ee3-8061-2466fd67706a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:01.503557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ddd96142-f4f2-4d9b-a54f-484a1170a0eb None None] Port 72ad51d2-278f-4aea-be4e-3be2ce1c5326 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:33:01.516580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=45ca2419-3316-4890-add7-265905134549,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:01.555321 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ddd96142-f4f2-4d9b-a54f-484a1170a0eb None None] Provisioning complete for port 6d15237b-4640-455e-aa3a-951755fcf99e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:01.555702 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ddd96142-f4f2-4d9b-a54f-484a1170a0eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:01.563952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d35d096-d7b0-4ee3-8061-2466fd67706a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2f36c3dc-c02a-47b7-9efc-8b4eb4f9ddc5,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:01.611543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-8789ee0e-00f9-4601-b810-756456063f40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:01.613345 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-8789ee0e-00f9-4601-b810-756456063f40 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5642567 May 12 15:33:01.623438 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d35d096-d7b0-4ee3-8061-2466fd67706a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:01.628272 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4d35d096-d7b0-4ee3-8061-2466fd67706a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.0315206 May 12 15:33:01.639518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53386) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:01.719739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53388) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:01.724382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a5ae05a8-44b4-47ac-be3d-994ad5062d77 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'security_group_rule': {'security_group_id': 'c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:01.740652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['45ca2419-3316-4890-add7-265905134549'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:33:01.770831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a5ae05a8-44b4-47ac-be3d-994ad5062d77 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:01.776464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ce604c-33ec-44e3-b52c-778cb14a5db2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Pushing event deleted for resources: {'Port': ['ID=6c9f656d-ae17-4501-8d50-2243aa810367,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:01.840764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a5ae05a8-44b4-47ac-be3d-994ad5062d77 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:security_group_rule and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:01.878404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f00bc08b-e4f1-49a5-a837-acbb448249a0 req-020ab55b-d35d-4c8c-b7e0-dbbd07830139 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:01.879960 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f00bc08b-e4f1-49a5-a837-acbb448249a0 req-020ab55b-d35d-4c8c-b7e0-dbbd07830139 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 944 time: 1.3527682 May 12 15:33:01.883312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a5ae05a8-44b4-47ac-be3d-994ad5062d77 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:01.906438 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-47ce604c-33ec-44e3-b52c-778cb14a5db2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:01.958477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a5ae05a8-44b4-47ac-be3d-994ad5062d77 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:01.974904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ddd96142-f4f2-4d9b-a54f-484a1170a0eb None None] Provisioning for port 53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:33:02.002468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ddd96142-f4f2-4d9b-a54f-484a1170a0eb None None] Provisioning complete for port 53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:02.003252 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ddd96142-f4f2-4d9b-a54f-484a1170a0eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.025864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60b2ceb1-46af-44eb-99da-7cd325b022a0 req-602f89ed-0e0a-4f7e-905c-09e2012bf133 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:02.027340 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60b2ceb1-46af-44eb-99da-7cd325b022a0 req-602f89ed-0e0a-4f7e-905c-09e2012bf133 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5911801 May 12 15:33:02.076584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ddd96142-f4f2-4d9b-a54f-484a1170a0eb None None] Port 53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:33:02.164595 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.197518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-47ce604c-33ec-44e3-b52c-778cb14a5db2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "DELETE /v2.0/ports/6c9f656d-ae17-4501-8d50-2243aa810367 HTTP/1.1" status: 204 len: 168 time: 2.8950481 May 12 15:33:02.260407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53398) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:02.342518 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5ae05a8-44b4-47ac-be3d-994ad5062d77 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.369139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f00bc08b-e4f1-49a5-a837-acbb448249a0 req-4b29ec79-274d-4d68-8c35-7306aeeaf2ea tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4155056 May 12 15:33:02.391079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-0728deae-aac9-4002-b97b-f40459c4b8fd admin admin] Deleting subnet 5191993e-726b-4897-9b02-25fe32b3009b {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:33:02.393474 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-5efd2d0e-09b8-4e51-a3f3-f827b8c6ed01 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] GET failed (client error): The resource could not be found. May 12 15:33:02.394012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5efd2d0e-09b8-4e51-a3f3-f827b8c6ed01 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Synchronizing usage tracker for tenant:8d9d0187e68e4feda08559a57b3c422f on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:02.409129 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0728deae-aac9-4002-b97b-f40459c4b8fd admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.418023 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.502814 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-99dfc9dd-73ad-414f-a04e-fa1ba1a6530d service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8695767 May 12 15:33:02.547502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5efd2d0e-09b8-4e51-a3f3-f827b8c6ed01 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Unset dirty status for tenant:8d9d0187e68e4feda08559a57b3c422f on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:02.548838 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5efd2d0e-09b8-4e51-a3f3-f827b8c6ed01 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "GET /v2.0/ports/6c9f656d-ae17-4501-8d50-2243aa810367 HTTP/1.1" status: 404 len: 333 time: 0.2803483 May 12 15:33:02.556061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53402) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:02.562114 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0728deae-aac9-4002-b97b-f40459c4b8fd admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.615765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Request body: {'port': {'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-2146054752'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:02.620533 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:33:02.649965 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.653093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:02.658937 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.675053 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60b2ceb1-46af-44eb-99da-7cd325b022a0 req-9dd08a52-cf26-4e83-893d-56ae01d750e3 service neutron] 10.222.0.84 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6299741 May 12 15:33:02.679963 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.680714 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.698138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:02.740039 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5ae05a8-44b4-47ac-be3d-994ad5062d77 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.769691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Network bb9736c7-290f-4580-8c13-53b75603f9df is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:02.772227 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5ae05a8-44b4-47ac-be3d-994ad5062d77 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.785993 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15f2ba52-8e83-4757-8512-520d4f19a68c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.795088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:02.818354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:02.883949 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0728deae-aac9-4002-b97b-f40459c4b8fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.911352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event updated for resources: {'Port': ['ID=cadbddb9-794f-4060-a651-236927206734,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:02.939759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Made reservation on behalf of 8d9d0187e68e4feda08559a57b3c422f for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:02.941970 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:02.942094 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5ae05a8-44b4-47ac-be3d-994ad5062d77 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e42a0f1b-0b92-418d-912e-285308c497ca,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:02.989693 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc868d7d-1cfc-4089-8d0a-6ac1efcd3903 req-613170d9-ed70-4dd4-901f-61e833fda7a2 service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4787495 May 12 15:33:03.002365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=72ad51d2-278f-4aea-be4e-3be2ce1c5326,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:03.011559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] device_id is not set on port 199d42ee-4526-4dd1-9b2e-f637da8140de yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:33:03.097059 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a5ae05a8-44b4-47ac-be3d-994ad5062d77 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:03.098069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a5ae05a8-44b4-47ac-be3d-994ad5062d77 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.4176815 May 12 15:33:03.110125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53406) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:03.127748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:03.140864 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:03.155242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Usage tracker for resource:floatingip and tenant:c5f9faeb50de42b1a07298c25a4e4d6b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:03.166689 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:03.185006 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60b2ceb1-46af-44eb-99da-7cd325b022a0 req-055f4eff-825c-433c-ba00-994c8bb2547d service neutron] 10.222.0.84 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4881289 May 12 15:33:03.200424 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:03.203976 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0728deae-aac9-4002-b97b-f40459c4b8fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:03.211410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 11ca6d1d-de52-4ba5-a178-0bee9c79e383 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:03.215425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:03.382320 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0728deae-aac9-4002-b97b-f40459c4b8fd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5191993e-726b-4897-9b02-25fe32b3009b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:03.400245 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0728deae-aac9-4002-b97b-f40459c4b8fd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:03.405704 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:03.506209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7299b98-3371-40de-925f-4f8138388b2f req-31ae18f5-01f1-49f7-8e9d-e6c7c6bfdc1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:03.507712 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7299b98-3371-40de-925f-4f8138388b2f req-31ae18f5-01f1-49f7-8e9d-e6c7c6bfdc1e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 1095 time: 0.4598010 May 12 15:33:03.615899 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-037a7609-f7db-4c74-80e6-bb7c0fbb6fc5 None None] Provisioning complete for port 72ad51d2-278f-4aea-be4e-3be2ce1c5326 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:03.617012 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-037a7609-f7db-4c74-80e6-bb7c0fbb6fc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:03.689409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-037a7609-f7db-4c74-80e6-bb7c0fbb6fc5 None None] Port 72ad51d2-278f-4aea-be4e-3be2ce1c5326 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:33:03.691335 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:03.741708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7299b98-3371-40de-925f-4f8138388b2f req-192c4086-0b29-4eef-9585-f8644b6c5a0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:03.743182 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7299b98-3371-40de-925f-4f8138388b2f req-192c4086-0b29-4eef-9585-f8644b6c5a0c service neutron] 10.222.0.76 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 0.2209918 May 12 15:33:03.786498 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0728deae-aac9-4002-b97b-f40459c4b8fd admin admin] 10.222.0.82 "DELETE /v2.0/subnets/5191993e-726b-4897-9b02-25fe32b3009b HTTP/1.1" status: 204 len: 168 time: 2.0429173 May 12 15:33:03.811681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53422) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:03.837069 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7299b98-3371-40de-925f-4f8138388b2f req-6cedda99-0c15-4fd8-b8a3-3adb991dcbfb service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=89f8d6b5-809f-446f-bb95-9e0f45b66f60 HTTP/1.1" status: 200 len: 217 time: 0.0835414 May 12 15:33:03.876351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 899dcff7-c864-40db-8609-e4f6d07ba323 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:33:04.009419 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:04.180195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7299b98-3371-40de-925f-4f8138388b2f req-66d836e0-ab1e-4378-8def-f3dfd61caca0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:04.181691 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7299b98-3371-40de-925f-4f8138388b2f req-66d836e0-ab1e-4378-8def-f3dfd61caca0 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.3366165 May 12 15:33:04.193984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:04.309311 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cb7aed11-bdc4-447b-83c6-1bc895eeb351 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:04.342553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-15f2ba52-8e83-4757-8512-520d4f19a68c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:33:04.343190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Network 23f523e9-0880-4d90-990d-969ff64c60e0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:04.346913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:04.349367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:33:04.350904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Pushing event updated for resources: {'Port': ['ID=199d42ee-4526-4dd1-9b2e-f637da8140de,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:04.358600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:04.359909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:04.360624 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:04.361213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24bc82df-dbba-43cf-9ee1-c0b94e97e2ad None None] Sync routers for ids ['899dcff7-c864-40db-8609-e4f6d07ba323'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:33:04.372814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24bc82df-dbba-43cf-9ee1-c0b94e97e2ad None None] Routers {'899dcff7-c864-40db-8609-e4f6d07ba323'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:04.375065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-24bc82df-dbba-43cf-9ee1-c0b94e97e2ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['899dcff7-c864-40db-8609-e4f6d07ba323'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:04.384317 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-82f51b41-5706-44d6-a81e-b200a2996cc6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/899dcff7-c864-40db-8609-e4f6d07ba323/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.2840765 May 12 15:33:04.387183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53426) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:04.404034 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15f2ba52-8e83-4757-8512-520d4f19a68c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:04.428775 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7bbda522-4b8d-45dc-9a60-f3f74885b888 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 964 time: 1.8247638 May 12 15:33:04.431309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53430) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:04.451514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Request body: {'port': {'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:04.469879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 45ca2419-3316-4890-add7-265905134549 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:33:04.508413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7299b98-3371-40de-925f-4f8138388b2f req-2ac32bda-0f7d-4b1a-a685-ec301bf2170d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:04.509977 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7299b98-3371-40de-925f-4f8138388b2f req-2ac32bda-0f7d-4b1a-a685-ec301bf2170d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3174634 May 12 15:33:04.556664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-481bfb78-e06b-47d3-a6d6-310190e3d748 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:04.557268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-481bfb78-e06b-47d3-a6d6-310190e3d748 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Synchronizing usage tracker for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:04.604371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-24bc82df-dbba-43cf-9ee1-c0b94e97e2ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:04.627570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960ba010-7e1a-4d41-9e21-9f52660a1e74 req-47434970-7e6e-4561-bdac-624fd07148a8 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:04.635616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 45ca2419-3316-4890-add7-265905134549 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:33:04.636444 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-960ba010-7e1a-4d41-9e21-9f52660a1e74 req-47434970-7e6e-4561-bdac-624fd07148a8 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 944 time: 0.9010749 May 12 15:33:04.639250 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15f2ba52-8e83-4757-8512-520d4f19a68c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:04.648267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24bc82df-dbba-43cf-9ee1-c0b94e97e2ad None None] Routers {'899dcff7-c864-40db-8609-e4f6d07ba323'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:04.649672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-24bc82df-dbba-43cf-9ee1-c0b94e97e2ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['899dcff7-c864-40db-8609-e4f6d07ba323'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:04.696202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-481bfb78-e06b-47d3-a6d6-310190e3d748 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Unset dirty status for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:04.697448 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-481bfb78-e06b-47d3-a6d6-310190e3d748 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports/72ad51d2-278f-4aea-be4e-3be2ce1c5326 HTTP/1.1" status: 200 len: 911 time: 0.3092556 May 12 15:33:04.703848 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53434) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:04.746612 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 45ca2419-3316-4890-add7-265905134549 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:04.747235 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:04.801254 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:04.844679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-24bc82df-dbba-43cf-9ee1-c0b94e97e2ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:04.844679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24bc82df-dbba-43cf-9ee1-c0b94e97e2ad None None] The sync data for ids ['899dcff7-c864-40db-8609-e4f6d07ba323'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:33:04.899160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-15f2ba52-8e83-4757-8512-520d4f19a68c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] In _notify_port_updated(), no bound segment for port 53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78 on network aecd5d86-5173-456d-9e81-e9cec7c6c409 {{(pid=88152) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:33:04.910669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-15f2ba52-8e83-4757-8512-520d4f19a68c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:04.911347 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15f2ba52-8e83-4757-8512-520d4f19a68c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:04.912671 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-15f2ba52-8e83-4757-8512-520d4f19a68c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "PUT /v2.0/ports/53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78 HTTP/1.1" status: 200 len: 1003 time: 3.5708063 May 12 15:33:04.933315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53440) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:04.943865 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:04.996549 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7299b98-3371-40de-925f-4f8138388b2f req-8faf8958-da99-4914-aa0a-b65c10432004 service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4784110 May 12 15:33:04.997784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 45ca2419-3316-4890-add7-265905134549, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=45ca2419-3316-4890-add7-265905134549,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:05.000493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8fb6500d-7db4-46cb-945c-e5ef82421deb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45ca2419-3316-4890-add7-265905134549'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:33:05.019451 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:05.031682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-960ba010-7e1a-4d41-9e21-9f52660a1e74 req-10927cb7-1073-41c8-af0d-2dfa6365ac1b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3942542 May 12 15:33:05.039839 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:05.067146 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cb7aed11-bdc4-447b-83c6-1bc895eeb351 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:05.074696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15f2ba52-8e83-4757-8512-520d4f19a68c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event updated for resources: {'Port': ['ID=53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:05.103220 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e256d229-f790-4f0f-bee7-d1b4929d3c35'] response: {'server_uuid': '8fb6500d-7db4-46cb-945c-e5ef82421deb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45ca2419-3316-4890-add7-265905134549', 'code': 200} May 12 15:33:05.121854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-7e38619f-0571-4567-b8ef-d4c551aa3e2d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Deleting port 53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:05.122203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7e38619f-0571-4567-b8ef-d4c551aa3e2d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:05.169644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=45ca2419-3316-4890-add7-265905134549,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:05.197323 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:05.275911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-cb7aed11-bdc4-447b-83c6-1bc895eeb351 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['19102399-18db-4840-b998-adc5bada1da0']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:05.311968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-cb7aed11-bdc4-447b-83c6-1bc895eeb351 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3307f62e-6977-4a8d-852e-31dcfd97c476') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:05.312814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-cb7aed11-bdc4-447b-83c6-1bc895eeb351 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3307f62e-6977-4a8d-852e-31dcfd97c476') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:05.329501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2035aaf1-755b-4546-9708-3417fd9d868f None None] Provisioning complete for port 53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:05.330033 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2035aaf1-755b-4546-9708-3417fd9d868f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:05.399326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2035aaf1-755b-4546-9708-3417fd9d868f None None] Port 53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:33:05.450105 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cb7aed11-bdc4-447b-83c6-1bc895eeb351 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:05.506967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 89f8d6b5-809f-446f-bb95-9e0f45b66f60 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:33:05.532433 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cb7aed11-bdc4-447b-83c6-1bc895eeb351 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:05.588104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cb7aed11-bdc4-447b-83c6-1bc895eeb351 admin admin] Releasing vlan 589 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:33:05.588510 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cb7aed11-bdc4-447b-83c6-1bc895eeb351 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: timer() May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:33:05.603397 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:33:05.723317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Allocated IP 172.25.8.173 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/d5025d43-7a0f-46ba-97ea-994ee9b2abb5) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:33:05.725072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 89f8d6b5-809f-446f-bb95-9e0f45b66f60, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=89f8d6b5-809f-446f-bb95-9e0f45b66f60,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:05.745271 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cb7aed11-bdc4-447b-83c6-1bc895eeb351 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:05.751644 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cb7aed11-bdc4-447b-83c6-1bc895eeb351 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:05.758786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '89f8d6b5-809f-446f-bb95-9e0f45b66f60', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'port_id': '89f8d6b5-809f-446f-bb95-9e0f45b66f60', 'mac_address': 'fa:16:3e:fa:84:ac', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 581, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:33:05.810142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb7aed11-bdc4-447b-83c6-1bc895eeb351 admin admin] Pushing event deleted for resources: {'Network': ['ID=19102399-18db-4840-b998-adc5bada1da0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:05.827638 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:05.847672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 89f8d6b5-809f-446f-bb95-9e0f45b66f60 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:33:05.870456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 89f8d6b5-809f-446f-bb95-9e0f45b66f60, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=89f8d6b5-809f-446f-bb95-9e0f45b66f60,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:05.878515 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] device_id is not set on port 199d42ee-4526-4dd1-9b2e-f637da8140de yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:33:05.879075 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:05.917117 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:05.974126 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=89f8d6b5-809f-446f-bb95-9e0f45b66f60,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:06.046567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cb7aed11-bdc4-447b-83c6-1bc895eeb351 admin admin] 10.222.0.82 "DELETE /v2.0/networks/19102399-18db-4840-b998-adc5bada1da0 HTTP/1.1" status: 204 len: 168 time: 2.1860991 May 12 15:33:06.047999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Router 9543a60d-487f-4914-9a25-701b1ca89a8f is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:33:06.086616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['89f8d6b5-809f-446f-bb95-9e0f45b66f60'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:33:06.088601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Transition to ACTIVE for port object 199d42ee-4526-4dd1-9b2e-f637da8140de will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:33:06.309882 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:06.381871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53478) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:06.398391 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:06.444951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:33:06.457218 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Sync routers for ids ['9543a60d-487f-4914-9a25-701b1ca89a8f'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:33:06.493156 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:06.493668 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Routers {'9543a60d-487f-4914-9a25-701b1ca89a8f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:06.495179 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9543a60d-487f-4914-9a25-701b1ca89a8f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:06.501338 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0a4dca46-0318-45e9-b89f-d67d936f737a tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 877 time: 12.7003577 May 12 15:33:06.506551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53494) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:06.607110 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7299b98-3371-40de-925f-4f8138388b2f req-115334ec-2b8a-4471-a661-e5882729ff6a service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.5959253 May 12 15:33:06.639960 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:06.668974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Pushing event updated for resources: {'Port': ['ID=199d42ee-4526-4dd1-9b2e-f637da8140de,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:06.679654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cf3695d-c6cd-48a4-a555-43e73c713608 req-41b92a82-c40e-4ba0-8e96-49c4267a63f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:06.681139 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8cf3695d-c6cd-48a4-a555-43e73c713608 req-41b92a82-c40e-4ba0-8e96-49c4267a63f0 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 1096 time: 1.2454741 May 12 15:33:06.687340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a18fd6d1-6de7-44e7-9033-51aa34270b5d req-67091f6a-d218-4e98-812e-4d65871957df tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:06.688968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a18fd6d1-6de7-44e7-9033-51aa34270b5d req-67091f6a-d218-4e98-812e-4d65871957df tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 945 time: 0.3411257 May 12 15:33:06.840378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:06.857521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:06.861009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:06.898878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'Port': ['ID=d5025d43-7a0f-46ba-97ea-994ee9b2abb5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:06.900191 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Set router 9543a60d-487f-4914-9a25-701b1ca89a8f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:33:06.929905 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a18fd6d1-6de7-44e7-9033-51aa34270b5d req-2f15d0b4-ee7d-4dd9-816f-3c4a41241457 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2263362 May 12 15:33:06.935959 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:06.973404 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-90f6c6c1-5be8-4da0-8212-3caf502171df admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e1146a673b454173a1ed844897ff4119&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5047662 May 12 15:33:06.991934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53552) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:06.999850 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8cf3695d-c6cd-48a4-a555-43e73c713608 req-3a7443ae-bb21-4d42-a494-786c247de084 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2296557 May 12 15:33:07.045292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:07.045797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:07.045961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:07.103374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:33:07.103805 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:33:07.107410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7e38619f-0571-4567-b8ef-d4c551aa3e2d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:07.128251 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 2 to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de May 12 15:33:07.141327 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:07.155399 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:07.216626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Deleting port cadbddb9-794f-4060-a651-236927206734 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:07.216965 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:07.331577 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:07.339144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-7e38619f-0571-4567-b8ef-d4c551aa3e2d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Calling delete_port for 53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:07.408239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:07.409187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:07.409714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:07.445223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:33:07.446467 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:33:07.495778 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 3 to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de May 12 15:33:07.516555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 89f8d6b5-809f-446f-bb95-9e0f45b66f60 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:33:07.545271 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9543a60d-487f-4914-9a25-701b1ca89a8f', 'name': '', 'tenant_id': '281d0c58fa114694a3293de8c107204f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bb9736c7-290f-4580-8c13-53b75603f9df', 'external_fixed_ips': [{'subnet_id': '1fe8a692-ad0f-4592-a201-33f7bc1fdd53', 'ip_address': '2001:db8::2e'}], 'enable_snat': True}, 'gw_port_id': 'cadbddb9-794f-4060-a651-236927206734', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:54Z', 'updated_at': '2022-05-12T15:33:03Z', 'revision_number': 3, 'project_id': '281d0c58fa114694a3293de8c107204f', 'gw_port': {'id': 'cadbddb9-794f-4060-a651-236927206734', 'name': '', 'network_id': 'bb9736c7-290f-4580-8c13-53b75603f9df', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:c5:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9543a60d-487f-4914-9a25-701b1ca89a8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2539, 'fixed_ips': [{'subnet_id': '1fe8a692-ad0f-4592-a201-33f7bc1fdd53', 'ip_address': '2001:db8::2e', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:59Z', 'updated_at': '2022-05-12T15:33:01Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1fe8a692-ad0f-4592-a201-33f7bc1fdd53', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:07.551171 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Checking router: 9543a60d-487f-4914-9a25-701b1ca89a8f for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:33:07.551793 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Updating router 9543a60d-487f-4914-9a25-701b1ca89a8f port cadbddb9-794f-4060-a651-236927206734 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:33:07.562020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:07.562622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:07.563441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:07.565939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d4a861c-12f7-4901-97a6-5b747dca5afc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:07.602571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d4a861c-12f7-4901-97a6-5b747dca5afc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:07.644202 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 89f8d6b5-809f-446f-bb95-9e0f45b66f60 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:33:07.656352 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 89f8d6b5-809f-446f-bb95-9e0f45b66f60 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:07.657017 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:07.663276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:33:07.663769 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:33:07.665555 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:07.684826 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 4 to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de May 12 15:33:07.685412 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:07.740187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:07.740500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:07.740838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:07.748254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:33:07.748575 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:33:07.751287 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 5 to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de May 12 15:33:07.778658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:07.778982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:07.780939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:07.788135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d4a861c-12f7-4901-97a6-5b747dca5afc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:07.846415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d4a861c-12f7-4901-97a6-5b747dca5afc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0d800eef-262d-4bd5-ac24-4a3700b73a86,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:07.848232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:33:07.848467 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:33:07.851029 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d60d36d1-68f9-49cf-b6a4-2cdcd9d2c323 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:07.998489 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:08.044051 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 6 to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de May 12 15:33:08.051317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 89f8d6b5-809f-446f-bb95-9e0f45b66f60, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=89f8d6b5-809f-446f-bb95-9e0f45b66f60,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:08.052412 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '15e319f9-b1d8-4a28-af53-803684c8b243', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '89f8d6b5-809f-446f-bb95-9e0f45b66f60'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:33:08.059612 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:08.102406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Calling delete_port for cadbddb9-794f-4060-a651-236927206734 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:08.148245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=89f8d6b5-809f-446f-bb95-9e0f45b66f60,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:08.179308 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bfa8f093-cfde-44fa-a026-b3415415fe98'] response: {'server_uuid': '15e319f9-b1d8-4a28-af53-803684c8b243', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '89f8d6b5-809f-446f-bb95-9e0f45b66f60', 'code': 200} May 12 15:33:08.324753 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:08.594497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4163e4-436c-40aa-bc86-013e8607138c req-061c052e-45ca-4fd0-8b93-497092dcf33b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:08.596643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fe4163e4-436c-40aa-bc86-013e8607138c req-061c052e-45ca-4fd0-8b93-497092dcf33b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 0.2949700 May 12 15:33:08.603653 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:08.623921 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:08.629906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:08.630244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:08.630587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:08.642933 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8d4a861c-12f7-4901-97a6-5b747dca5afc admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:08.643947 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8d4a861c-12f7-4901-97a6-5b747dca5afc admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0d800eef-262d-4bd5-ac24-4a3700b73a86 HTTP/1.1" status: 204 len: 168 time: 1.6425159 May 12 15:33:08.658246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:33:08.658643 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:33:08.662704 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 7 to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de May 12 15:33:08.669091 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Transition to ACTIVE for port object cadbddb9-794f-4060-a651-236927206734 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:33:08.679422 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:08.684801 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7e38619f-0571-4567-b8ef-d4c551aa3e2d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:08.769998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fe4163e4-436c-40aa-bc86-013e8607138c req-f75ebaa7-c369-4808-9f9f-960a51ae5ed4 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1644461 May 12 15:33:08.789678 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:33:08.789968 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:33:08.801748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'Port': ['ID=d5025d43-7a0f-46ba-97ea-994ee9b2abb5,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:08.817052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:08.817709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:08.818127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:08.823984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:08.849419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e38619f-0571-4567-b8ef-d4c551aa3e2d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event deleted for resources: {'Port': ['ID=53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:08.864549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:33:08.864881 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:33:08.884659 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 8 to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de May 12 15:33:08.906730 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:08.908717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-87a36f98-32e2-42e7-9b4e-8fa29542c3a0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 5.7904632 May 12 15:33:08.967613 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Attempting to bind port cadbddb9-794f-4060-a651-236927206734 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:08.968060 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Attempting to bind port cadbddb9-794f-4060-a651-236927206734 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '88bf9e39-7798-4951-9f43-c41ad31d5afe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': 'bb9736c7-290f-4580-8c13-53b75603f9df'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:08.970687 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Attempting to bind port cadbddb9-794f-4060-a651-236927206734 on network bb9736c7-290f-4580-8c13-53b75603f9df {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:08.982058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:08.985727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:08.986126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:08.995113 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 32, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:33:08.995689 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Checking segment: {'id': '88bf9e39-7798-4951-9f43-c41ad31d5afe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': 'bb9736c7-290f-4580-8c13-53b75603f9df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:33:08.996230 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:08.996751 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Bound using segment: {'id': '88bf9e39-7798-4951-9f43-c41ad31d5afe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': 'bb9736c7-290f-4580-8c13-53b75603f9df'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:33:08.997353 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Bound port: cadbddb9-794f-4060-a651-236927206734, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '88bf9e39-7798-4951-9f43-c41ad31d5afe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': 'bb9736c7-290f-4580-8c13-53b75603f9df'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:33:08.997911 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:09.065938 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c515ed3-6ebc-4c26-a569-f7ffd3fcccb9 None None] Pushing event updated for resources: {'Port': ['ID=cadbddb9-794f-4060-a651-236927206734,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:09.100893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:33:09.101517 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:33:09.174532 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 9 to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de May 12 15:33:09.182801 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] For port cadbddb9-794f-4060-a651-236927206734, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:33:09.188883 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] For port cadbddb9-794f-4060-a651-236927206734, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cadbddb9-794f-4060-a651-236927206734,segment=NetworkSegment(88bf9e39-7798-4951-9f43-c41ad31d5afe),segment_id=88bf9e39-7798-4951-9f43-c41ad31d5afe)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:33:09.194137 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:09.248570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2b98906-06aa-4d5c-9000-91b5a90a2072 req-3c5744b8-3d3b-4b43-8b4c-95ee79045366 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:09.250462 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2b98906-06aa-4d5c-9000-91b5a90a2072 req-3c5744b8-3d3b-4b43-8b4c-95ee79045366 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 1097 time: 0.6705291 May 12 15:33:09.290987 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Deleting port cadbddb9-794f-4060-a651-236927206734 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:09.291761 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:09.326530 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7e38619f-0571-4567-b8ef-d4c551aa3e2d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:09.332983 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7e38619f-0571-4567-b8ef-d4c551aa3e2d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "DELETE /v2.0/ports/53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78 HTTP/1.1" status: 204 len: 168 time: 4.3944721 May 12 15:33:09.333167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:09.333908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:09.334657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:09.357430 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Routers {'9543a60d-487f-4914-9a25-701b1ca89a8f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:09.362531 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['9543a60d-487f-4914-9a25-701b1ca89a8f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:09.364996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53830) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:09.372998 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2b98906-06aa-4d5c-9000-91b5a90a2072 req-a3de4800-e489-4a15-acc5-2a8f7103dda0 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0986626 May 12 15:33:09.374456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d60d36d1-68f9-49cf-b6a4-2cdcd9d2c323 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port 72ad51d2-278f-4aea-be4e-3be2ce1c5326 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:09.374848 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d60d36d1-68f9-49cf-b6a4-2cdcd9d2c323 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:09.430465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:33:09.430946 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:33:09.445426 n-d-841483-1 neutron-server[88151]: INFO neutron.plugins.ml2.plugin [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempt 10 to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de May 12 15:33:09.505731 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-2951687d-242a-471e-b1bc-da419297c999 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] GET failed (client error): The resource could not be found. May 12 15:33:09.506437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2951687d-242a-471e-b1bc-da419297c999 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Synchronizing usage tracker for tenant:4daabc80fb744e62aca779fa277e241d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:09.595012 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] Set router 9543a60d-487f-4914-9a25-701b1ca89a8f gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:33:09.627611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:09.628118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:09.628602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempting to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:09.653162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:33:09.653681 n-d-841483-1 neutron-server[88151]: ERROR neutron.plugins.ml2.managers [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Failed to bind port 199d42ee-4526-4dd1-9b2e-f637da8140de on host n-h2-841483-1 for vnic_type normal using segments [{'id': 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '23f523e9-0880-4d90-990d-969ff64c60e0'}] May 12 15:33:09.654482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:09.734023 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9543a60d-487f-4914-9a25-701b1ca89a8f', 'name': '', 'tenant_id': '281d0c58fa114694a3293de8c107204f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:54Z', 'updated_at': '2022-05-12T15:33:07Z', 'revision_number': 4, 'project_id': '281d0c58fa114694a3293de8c107204f', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:09.745732 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6366bb19-4434-41dd-a947-8559a5649fea None None] The sync data for ids ['9543a60d-487f-4914-9a25-701b1ca89a8f'] in n-d-841483-1 is: [{'id': '9543a60d-487f-4914-9a25-701b1ca89a8f', 'name': '', 'tenant_id': '281d0c58fa114694a3293de8c107204f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:54Z', 'updated_at': '2022-05-12T15:33:07Z', 'revision_number': 4, 'project_id': '281d0c58fa114694a3293de8c107204f', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:33:09.756354 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c515ed3-6ebc-4c26-a569-f7ffd3fcccb9 None None] Pushing event updated for resources: {'Port': ['ID=cadbddb9-794f-4060-a651-236927206734,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:09.838905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] For port 199d42ee-4526-4dd1-9b2e-f637da8140de, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:33:09.839284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attempted to set empty binding levels {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:66}} May 12 15:33:09.841198 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d60d36d1-68f9-49cf-b6a4-2cdcd9d2c323 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:09.860774 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:09.925854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] For port cadbddb9-794f-4060-a651-236927206734, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cadbddb9-794f-4060-a651-236927206734,segment=NetworkSegment(88bf9e39-7798-4951-9f43-c41ad31d5afe),segment_id=88bf9e39-7798-4951-9f43-c41ad31d5afe)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:09.926322 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:10.132205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Calling delete_port for cadbddb9-794f-4060-a651-236927206734 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:10.141532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d60d36d1-68f9-49cf-b6a4-2cdcd9d2c323 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for 72ad51d2-278f-4aea-be4e-3be2ce1c5326 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:10.169973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-7a576408-63c7-4fba-be51-8cd2def683cc tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:10.176727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2951687d-242a-471e-b1bc-da419297c999 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Unset dirty status for tenant:4daabc80fb744e62aca779fa277e241d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:10.179808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] In _notify_port_updated(), no bound segment for port 199d42ee-4526-4dd1-9b2e-f637da8140de on network 23f523e9-0880-4d90-990d-969ff64c60e0 {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:33:10.180800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:10.181666 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:10.182683 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "PUT /v2.0/ports/199d42ee-4526-4dd1-9b2e-f637da8140de HTTP/1.1" status: 200 len: 979 time: 5.7504787 May 12 15:33:10.193545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53942) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:10.196718 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2951687d-242a-471e-b1bc-da419297c999 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "GET /v2.0/ports/53ddbb6b-5f91-45ce-83c2-ae3a8b9a6f78 HTTP/1.1" status: 404 len: 333 time: 0.8067069 May 12 15:33:10.199054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53944) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:10.293488 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Request body: {'port': {'network_id': 'aecd5d86-5173-456d-9e81-e9cec7c6c409', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1218056084'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:10.321307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-247a3034-2dd9-4e54-9df8-a1a440597c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Pushing event updated for resources: {'Port': ['ID=199d42ee-4526-4dd1-9b2e-f637da8140de,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:10.351089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-f4601be8-4f56-4c0b-9d1d-95aebd1e40e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Deleting port 199d42ee-4526-4dd1-9b2e-f637da8140de {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:10.351698 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4601be8-4f56-4c0b-9d1d-95aebd1e40e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:10.431261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-7a576408-63c7-4fba-be51-8cd2def683cc tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:10.432491 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-7a576408-63c7-4fba-be51-8cd2def683cc tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1265375227&fields=id&tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b HTTP/1.1" status: 200 len: 267 time: 1.0708930 May 12 15:33:10.693419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc559a97-eea6-4128-9b2a-1483ec875fbd req-310029cc-8f0f-4679-b072-e6b4c29e6ec8 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:10.694947 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc559a97-eea6-4128-9b2a-1483ec875fbd req-310029cc-8f0f-4679-b072-e6b4c29e6ec8 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 0.4967096 May 12 15:33:10.750048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:10.799225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-f4601be8-4f56-4c0b-9d1d-95aebd1e40e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] For port 199d42ee-4526-4dd1-9b2e-f637da8140de, host n-h2-841483-1, got binding levels [] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:10.799926 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4601be8-4f56-4c0b-9d1d-95aebd1e40e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:10.809530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:10.896549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d3e62584-78ee-4036-9e28-0c4b893eb3e7 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:10.898103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d3e62584-78ee-4036-9e28-0c4b893eb3e7 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 815 time: 0.4350708 May 12 15:33:10.911775 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc559a97-eea6-4128-9b2a-1483ec875fbd req-028c63bc-1bfb-487e-97fc-1395361f53ea tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2081902 May 12 15:33:10.920132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Made reservation on behalf of 4daabc80fb744e62aca779fa277e241d for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:10.924612 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:10.966894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] device_id is not set on port c77c4165-7e12-4772-86c8-36a46e073696 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:33:11.005330 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d60d36d1-68f9-49cf-b6a4-2cdcd9d2c323 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:11.016950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-f4601be8-4f56-4c0b-9d1d-95aebd1e40e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Calling delete_port for 199d42ee-4526-4dd1-9b2e-f637da8140de owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:11.157807 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-5e751188-ad32-4de4-b9a8-2bb8fc63c758 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/quotas/c5f9faeb50de42b1a07298c25a4e4d6b HTTP/1.1" status: 200 len: 375 time: 0.2416887 May 12 15:33:11.165769 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:11.272039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event deleted for resources: {'Port': ['ID=cadbddb9-794f-4060-a651-236927206734,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:11.356465 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:11.400062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d60d36d1-68f9-49cf-b6a4-2cdcd9d2c323 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=72ad51d2-278f-4aea-be4e-3be2ce1c5326,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:11.700594 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4601be8-4f56-4c0b-9d1d-95aebd1e40e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:11.779139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4601be8-4f56-4c0b-9d1d-95aebd1e40e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Pushing event deleted for resources: {'Port': ['ID=199d42ee-4526-4dd1-9b2e-f637da8140de,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:11.784386 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d60d36d1-68f9-49cf-b6a4-2cdcd9d2c323 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:11.795675 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4601be8-4f56-4c0b-9d1d-95aebd1e40e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:11.825097 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f4601be8-4f56-4c0b-9d1d-95aebd1e40e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "DELETE /v2.0/ports/199d42ee-4526-4dd1-9b2e-f637da8140de HTTP/1.1" status: 204 len: 168 time: 1.6229374 May 12 15:33:11.826546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53984) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:11.829889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Allocated IP 2001:db8::31c (aecd5d86-5173-456d-9e81-e9cec7c6c409/8e14ccb3-bcde-425d-ac11-c8bd493ae5f1/c77c4165-7e12-4772-86c8-36a46e073696) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:33:11.921923 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:11.932268 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:12.054036 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-a7d7f5ba-c538-43c0-9d40-10f4487c7140 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] GET failed (client error): The resource could not be found. May 12 15:33:12.054719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a7d7f5ba-c538-43c0-9d40-10f4487c7140 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Synchronizing usage tracker for tenant:8d9d0187e68e4feda08559a57b3c422f on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:12.203307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a7d7f5ba-c538-43c0-9d40-10f4487c7140 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] Unset dirty status for tenant:8d9d0187e68e4feda08559a57b3c422f on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:12.203865 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a7d7f5ba-c538-43c0-9d40-10f4487c7140 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782 tempest-PortsAdminExtendedAttrsIpV6TestJSON-46358782-project-admin] 10.222.0.82 "GET /v2.0/ports/199d42ee-4526-4dd1-9b2e-f637da8140de HTTP/1.1" status: 404 len: 333 time: 0.3726850 May 12 15:33:12.211006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53992) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:12.235426 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:12.237663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 9543a60d-487f-4914-9a25-701b1ca89a8f {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:33:12.289280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-7bbcaa7d-57fe-410e-940e-973e8f18ef77 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:12.394802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-7bbcaa7d-57fe-410e-940e-973e8f18ef77 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:12.409474 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-7bbcaa7d-57fe-410e-940e-973e8f18ef77 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&fields=id HTTP/1.1" status: 200 len: 348 time: 1.2361858 May 12 15:33:12.419417 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:12.421246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d245d3c5-2da2-40c9-81f5-660855458871 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "DELETE /v2.0/routers/9543a60d-487f-4914-9a25-701b1ca89a8f HTTP/1.1" status: 204 len: 168 time: 5.9122915 May 12 15:33:12.440869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53998) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:12.444736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d60d36d1-68f9-49cf-b6a4-2cdcd9d2c323 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 899dcff7-c864-40db-8609-e4f6d07ba323 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:33:12.445607 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:12.491119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09262c90-22de-4b62-817c-b3aa4b539e68 req-c78f50d9-429e-436f-a637-25371866f4ec tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:12.492425 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a63ee29-a6ad-45d9-b2eb-d70f6270fad3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:12.502951 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09262c90-22de-4b62-817c-b3aa4b539e68 req-c78f50d9-429e-436f-a637-25371866f4ec tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 0.3958597 May 12 15:33:12.531577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Transition to ACTIVE for port object c77c4165-7e12-4772-86c8-36a46e073696 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:33:12.567585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-6aa1f5af-a872-493c-b116-055dc155f5d6 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Deleting subnet 1fe8a692-ad0f-4592-a201-33f7bc1fdd53 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:33:12.571774 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6aa1f5af-a872-493c-b116-055dc155f5d6 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:12.580280 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09262c90-22de-4b62-817c-b3aa4b539e68 req-c1f8cd08-f090-4c21-b48f-422ad975fe3b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0758557 May 12 15:33:12.615906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:12.739008 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-33654aac-e862-476e-821c-5ab2685eccc4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:12.777776 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6aa1f5af-a872-493c-b116-055dc155f5d6 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:12.812858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Network aecd5d86-5173-456d-9e81-e9cec7c6c409 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:12.823743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:12.830389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:12.835755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:12.836419 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:12.849905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event updated for resources: {'Port': ['ID=c77c4165-7e12-4772-86c8-36a46e073696,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:12.871840 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6aa1f5af-a872-493c-b116-055dc155f5d6 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:12.915529 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1963f5b2-d25d-47bc-af0f-bac0a8413046 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 2.6835589 May 12 15:33:12.932299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54010) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:12.957763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7005ba0c-b436-43fc-ab77-74bef7e3c442 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::/48', 'mac_address': 'fa:16:3e:67:6c:cb'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:13.041668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-cbca3b8d-b6f7-4288-970d-9cf00446f321 service neutron] 10.222.0.82 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6149518 May 12 15:33:13.070366 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:13.096052 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6aa1f5af-a872-493c-b116-055dc155f5d6 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:13.290148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa34bc28-48e6-4783-ad1b-f2094fbcc5a2 None None] Provisioning for port c77c4165-7e12-4772-86c8-36a46e073696 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:33:13.307318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa34bc28-48e6-4783-ad1b-f2094fbcc5a2 None None] Provisioning complete for port c77c4165-7e12-4772-86c8-36a46e073696 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:13.308139 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa34bc28-48e6-4783-ad1b-f2094fbcc5a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:13.347839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d60d36d1-68f9-49cf-b6a4-2cdcd9d2c323 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:33:13.360802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aa1f5af-a872-493c-b116-055dc155f5d6 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=1fe8a692-ad0f-4592-a201-33f7bc1fdd53,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:13.363545 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a63ee29-a6ad-45d9-b2eb-d70f6270fad3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:13.372711 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6aa1f5af-a872-493c-b116-055dc155f5d6 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:13.378323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e75c496f-388c-4355-8d91-19d4bb4f3d22 None None] Sync routers for ids ['899dcff7-c864-40db-8609-e4f6d07ba323'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:33:13.385701 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-b8635ee8-a1be-4e10-97e0-880f53a36f8a service neutron] 10.222.0.82 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3267612 May 12 15:33:13.401536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e75c496f-388c-4355-8d91-19d4bb4f3d22 None None] Routers {'899dcff7-c864-40db-8609-e4f6d07ba323'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:13.402076 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d60d36d1-68f9-49cf-b6a4-2cdcd9d2c323 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/899dcff7-c864-40db-8609-e4f6d07ba323/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.6956930 May 12 15:33:13.402499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e75c496f-388c-4355-8d91-19d4bb4f3d22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['899dcff7-c864-40db-8609-e4f6d07ba323'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:13.405702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54016) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:13.411951 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6aa1f5af-a872-493c-b116-055dc155f5d6 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "DELETE /v2.0/subnets/1fe8a692-ad0f-4592-a201-33f7bc1fdd53 HTTP/1.1" status: 204 len: 168 time: 0.9652648 May 12 15:33:13.413998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54020) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:13.419728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-9a63ee29-a6ad-45d9-b2eb-d70f6270fad3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['23f523e9-0880-4d90-990d-969ff64c60e0']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:13.453216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-9a63ee29-a6ad-45d9-b2eb-d70f6270fad3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:13.453843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-9a63ee29-a6ad-45d9-b2eb-d70f6270fad3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fecf08dc-b12f-4ce2-aeab-61f7864f17ea') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:13.473762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e75c496f-388c-4355-8d91-19d4bb4f3d22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:13.478693 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fa34bc28-48e6-4783-ad1b-f2094fbcc5a2 None None] Port c77c4165-7e12-4772-86c8-36a46e073696 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:33:13.492383 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e75c496f-388c-4355-8d91-19d4bb4f3d22 None None] Routers {'899dcff7-c864-40db-8609-e4f6d07ba323'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:13.493513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e75c496f-388c-4355-8d91-19d4bb4f3d22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:32:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['899dcff7-c864-40db-8609-e4f6d07ba323'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:13.536340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a63ee29-a6ad-45d9-b2eb-d70f6270fad3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:13.577770 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a63ee29-a6ad-45d9-b2eb-d70f6270fad3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:13.582036 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a724ef13-dc9d-4f6a-9c40-8941af63058f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:13.591391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9a63ee29-a6ad-45d9-b2eb-d70f6270fad3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Releasing vlan 597 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:33:13.591801 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a63ee29-a6ad-45d9-b2eb-d70f6270fad3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:13.595463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e75c496f-388c-4355-8d91-19d4bb4f3d22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:13.595866 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e75c496f-388c-4355-8d91-19d4bb4f3d22 None None] The sync data for ids ['899dcff7-c864-40db-8609-e4f6d07ba323'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: timer() May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:33:13.611907 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:33:13.631391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-258bba85-cab8-42b6-acd2-25f516c9d58e req-57e3484f-167d-4197-9754-8dbb77fb0012 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:13.633144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-258bba85-cab8-42b6-acd2-25f516c9d58e req-57e3484f-167d-4197-9754-8dbb77fb0012 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 1097 time: 0.4699392 May 12 15:33:13.719737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-569523b6-4eb7-493b-9dcd-d005db7d96be req-bef1cce8-049e-47ac-91e9-d5f55ac2ead8 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:13.723627 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-569523b6-4eb7-493b-9dcd-d005db7d96be req-bef1cce8-049e-47ac-91e9-d5f55ac2ead8 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 0.4821749 May 12 15:33:13.735849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-42bb13dd-e646-4fbb-9cf4-501987bf1df3 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Synchronizing usage tracker for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:13.839593 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7005ba0c-b436-43fc-ab77-74bef7e3c442 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:13.923333 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7189df4-046d-4653-86d9-77a2391be900 req-21f7b7f2-5f19-40a5-925b-12180414241e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 210 time: 0.2137444 May 12 15:33:13.941311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-42bb13dd-e646-4fbb-9cf4-501987bf1df3 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Unset dirty status for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:13.945258 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-42bb13dd-e646-4fbb-9cf4-501987bf1df3 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports?device_id=899dcff7-c864-40db-8609-e4f6d07ba323 HTTP/1.1" status: 200 len: 205 time: 0.5385664 May 12 15:33:13.955747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54038) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:14.023277 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a63ee29-a6ad-45d9-b2eb-d70f6270fad3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:14.066894 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a63ee29-a6ad-45d9-b2eb-d70f6270fad3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:14.084140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-258bba85-cab8-42b6-acd2-25f516c9d58e req-5de146b3-8fb9-4f75-84d4-fdffd292197b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:14.085634 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-258bba85-cab8-42b6-acd2-25f516c9d58e req-5de146b3-8fb9-4f75-84d4-fdffd292197b service neutron] 10.222.0.76 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 0.3688085 May 12 15:33:14.087596 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a724ef13-dc9d-4f6a-9c40-8941af63058f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:14.096033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a63ee29-a6ad-45d9-b2eb-d70f6270fad3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] Pushing event deleted for resources: {'Network': ['ID=23f523e9-0880-4d90-990d-969ff64c60e0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:14.103581 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9a63ee29-a6ad-45d9-b2eb-d70f6270fad3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772 tempest-PortsAdminExtendedAttrsIpV6TestJSON-932067772-project] 10.222.0.82 "DELETE /v2.0/networks/23f523e9-0880-4d90-990d-969ff64c60e0 HTTP/1.1" status: 204 len: 168 time: 1.8893795 May 12 15:33:14.200067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-569523b6-4eb7-493b-9dcd-d005db7d96be req-e8922ca8-3bc5-46ad-be2a-e21304c26d95 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4221931 May 12 15:33:14.219767 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-258bba85-cab8-42b6-acd2-25f516c9d58e req-1f5280e5-83bb-49dc-a5d9-36dfc8f3d47f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=89f8d6b5-809f-446f-bb95-9e0f45b66f60 HTTP/1.1" status: 200 len: 217 time: 0.1179650 May 12 15:33:14.221347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a724ef13-dc9d-4f6a-9c40-8941af63058f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bb9736c7-290f-4580-8c13-53b75603f9df']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:14.270067 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18111f17-84e8-48ed-8a1d-e072b25dc4ad tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:14.279184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a724ef13-dc9d-4f6a-9c40-8941af63058f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '88bf9e39-7798-4951-9f43-c41ad31d5afe') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:14.279465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a724ef13-dc9d-4f6a-9c40-8941af63058f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '88bf9e39-7798-4951-9f43-c41ad31d5afe') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:14.294960 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a724ef13-dc9d-4f6a-9c40-8941af63058f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:14.312809 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a724ef13-dc9d-4f6a-9c40-8941af63058f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:14.319412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a724ef13-dc9d-4f6a-9c40-8941af63058f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Releasing vlan 596 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:33:14.319817 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a724ef13-dc9d-4f6a-9c40-8941af63058f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: timer() May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:33:14.337787 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:33:14.445413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-258bba85-cab8-42b6-acd2-25f516c9d58e req-bb7ef647-fe07-4ad4-9363-740e662367fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:14.448443 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-258bba85-cab8-42b6-acd2-25f516c9d58e req-bb7ef647-fe07-4ad4-9363-740e662367fb service neutron] 10.222.0.76 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.2195892 May 12 15:33:14.518495 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a724ef13-dc9d-4f6a-9c40-8941af63058f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:14.531932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a724ef13-dc9d-4f6a-9c40-8941af63058f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network bb9736c7-290f-4580-8c13-53b75603f9df {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:124}} May 12 15:33:14.534657 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a724ef13-dc9d-4f6a-9c40-8941af63058f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:14.613327 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a724ef13-dc9d-4f6a-9c40-8941af63058f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "DELETE /v2.0/networks/bb9736c7-290f-4580-8c13-53b75603f9df HTTP/1.1" status: 204 len: 168 time: 1.1963248 May 12 15:33:14.616496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a724ef13-dc9d-4f6a-9c40-8941af63058f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event deleted for resources: {'Network': ['ID=bb9736c7-290f-4580-8c13-53b75603f9df,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:14.747142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-258bba85-cab8-42b6-acd2-25f516c9d58e req-315bfc10-0c21-4be5-8287-5da106a26241 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:14.756031 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-258bba85-cab8-42b6-acd2-25f516c9d58e req-315bfc10-0c21-4be5-8287-5da106a26241 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3005097 May 12 15:33:14.801697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54054) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:15.038130 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-258bba85-cab8-42b6-acd2-25f516c9d58e req-ff0c7aa0-6215-4ff7-8bc1-2a20ccee3f72 service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2812510 May 12 15:33:15.061959 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7005ba0c-b436-43fc-ab77-74bef7e3c442 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:15.095707 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7005ba0c-b436-43fc-ab77-74bef7e3c442 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:15.252810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54072) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:15.259191 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-09d628d0-2b71-4ab3-9372-6d5a6c29219c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:15.272623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7cc840c7-9292-48ac-8eb9-7ea46ba62c07 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Request body: {'router': {'name': 'tempest-router--57801173', 'project_id': 'fca90eaeadb04257a9cadcd033a2bdf3'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:15.294402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7cc840c7-9292-48ac-8eb9-7ea46ba62c07 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:15.305607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7cc840c7-9292-48ac-8eb9-7ea46ba62c07 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Usage tracker for resource:router and tenant:fca90eaeadb04257a9cadcd033a2bdf3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:15.308830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7cc840c7-9292-48ac-8eb9-7ea46ba62c07 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:15.329774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7cc840c7-9292-48ac-8eb9-7ea46ba62c07 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:15.354983 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cc840c7-9292-48ac-8eb9-7ea46ba62c07 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:15.356145 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cc840c7-9292-48ac-8eb9-7ea46ba62c07 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:15.561275 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cc840c7-9292-48ac-8eb9-7ea46ba62c07 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:15.610424 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-258bba85-cab8-42b6-acd2-25f516c9d58e req-b8d61bbc-59c7-4669-a19d-6c3f54261dab service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5595436 May 12 15:33:15.699800 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cc840c7-9292-48ac-8eb9-7ea46ba62c07 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:15.753084 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-97611eb6-3edc-445d-8c03-87ac0c3895ab admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=fd1a08f1a29d4cf3bf91e8d8729484ac&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9363575 May 12 15:33:15.753717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54082) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:15.778672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-8dcb9c03-4e90-4670-91a8-fe278b577629 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:15.780834 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-8dcb9c03-4e90-4670-91a8-fe278b577629 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.84 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 815 time: 0.3806355 May 12 15:33:15.787267 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cc840c7-9292-48ac-8eb9-7ea46ba62c07 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:15.788732 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7cc840c7-9292-48ac-8eb9-7ea46ba62c07 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 721 time: 0.5306420 May 12 15:33:15.791766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54086) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:15.906834 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-7005ba0c-b436-43fc-ab77-74bef7e3c442 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] In _notify_port_updated(), no bound segment for port c77c4165-7e12-4772-86c8-36a46e073696 on network aecd5d86-5173-456d-9e81-e9cec7c6c409 {{(pid=88152) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:33:15.912827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7005ba0c-b436-43fc-ab77-74bef7e3c442 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:15.913561 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7005ba0c-b436-43fc-ab77-74bef7e3c442 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:15.917910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7005ba0c-b436-43fc-ab77-74bef7e3c442 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "PUT /v2.0/ports/c77c4165-7e12-4772-86c8-36a46e073696 HTTP/1.1" status: 200 len: 1003 time: 2.9800797 May 12 15:33:15.931144 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7e140bc-a35f-4e31-850e-3609a4bdd33d req-0368ca73-7822-4a99-969f-84b61f4db41c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 210 time: 0.6753407 May 12 15:33:15.941848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54090) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:15.992729 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18111f17-84e8-48ed-8a1d-e072b25dc4ad tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:16.034050 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18111f17-84e8-48ed-8a1d-e072b25dc4ad tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:16.036070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7005ba0c-b436-43fc-ab77-74bef7e3c442 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event updated for resources: {'Port': ['ID=c77c4165-7e12-4772-86c8-36a46e073696,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:16.069988 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:16.130542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18111f17-84e8-48ed-8a1d-e072b25dc4ad tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:16.131100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-18111f17-84e8-48ed-8a1d-e072b25dc4ad tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Fanout notify agent at l3_agent the message router_deleted on router 899dcff7-c864-40db-8609-e4f6d07ba323 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:33:16.136146 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-98824f0a-efe7-49d5-9815-056f19bb2910 None None] Provisioning complete for port c77c4165-7e12-4772-86c8-36a46e073696 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:16.136593 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-98824f0a-efe7-49d5-9815-056f19bb2910 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:16.137258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5a27c596-b8c1-4ceb-8fc2-34facba937f3 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Deleting port c77c4165-7e12-4772-86c8-36a46e073696 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:16.137772 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a27c596-b8c1-4ceb-8fc2-34facba937f3 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:16.191707 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18111f17-84e8-48ed-8a1d-e072b25dc4ad tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:16.197547 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-18111f17-84e8-48ed-8a1d-e072b25dc4ad tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/routers/899dcff7-c864-40db-8609-e4f6d07ba323 HTTP/1.1" status: 204 len: 168 time: 2.2407076 May 12 15:33:16.207544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54098) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:16.241217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-98824f0a-efe7-49d5-9815-056f19bb2910 None None] Port c77c4165-7e12-4772-86c8-36a46e073696 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:33:16.275777 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:16.317545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7445020a-a6d0-49e5-ae0e-0c86b8c1133a req-69b65fda-f1f2-428a-b49a-5d5c66973e52 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:16.319068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7445020a-a6d0-49e5-ae0e-0c86b8c1133a req-69b65fda-f1f2-428a-b49a-5d5c66973e52 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 0.6226101 May 12 15:33:16.321965 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9aba7d60-65ae-4a39-be71-746cabb7d3ca tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:16.458413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-d6d5bcc4-3daa-4bab-8737-15b5a96df70c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting subnet 72723c37-b245-4008-9464-488728e67f28 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:33:16.492754 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6d5bcc4-3daa-4bab-8737-15b5a96df70c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:16.513521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-ae308e9e-3623-4f82-88be-427da13e394c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:16.646167 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cab30702-e171-4c58-b189-f99b466f9cce admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:16.834498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-ae308e9e-3623-4f82-88be-427da13e394c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:16.835388 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-ae308e9e-3623-4f82-88be-427da13e394c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b HTTP/1.1" status: 200 len: 380 time: 0.9714241 May 12 15:33:16.852620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7445020a-a6d0-49e5-ae0e-0c86b8c1133a req-b933ea71-4be0-4c1b-aac3-886c5437b7bb tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4790933 May 12 15:33:16.859609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'port': {'device_id': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'admin_state_up': True, 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'security_groups': ['c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:16.877058 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9aba7d60-65ae-4a39-be71-746cabb7d3ca tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:16.880181 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cab30702-e171-4c58-b189-f99b466f9cce admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:16.888325 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6d5bcc4-3daa-4bab-8737-15b5a96df70c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:16.892404 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9aba7d60-65ae-4a39-be71-746cabb7d3ca tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:17.041722 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9aba7d60-65ae-4a39-be71-746cabb7d3ca tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:17.042896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9aba7d60-65ae-4a39-be71-746cabb7d3ca tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Fanout notify agent at l3_agent the message router_deleted on router f2e78a25-6707-4864-a0f3-fb0484b4ea74 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:33:17.087323 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9aba7d60-65ae-4a39-be71-746cabb7d3ca tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:17.089300 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a27c596-b8c1-4ceb-8fc2-34facba937f3 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:17.089610 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9aba7d60-65ae-4a39-be71-746cabb7d3ca tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "DELETE /v2.0/routers/f2e78a25-6707-4864-a0f3-fb0484b4ea74 HTTP/1.1" status: 204 len: 168 time: 1.2966614 May 12 15:33:17.140990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:17.146490 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cab30702-e171-4c58-b189-f99b466f9cce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:17.191199 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cab30702-e171-4c58-b189-f99b466f9cce admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:17.195800 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cab30702-e171-4c58-b189-f99b466f9cce admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/84f44d44-ba64-42e5-8f7a-d0981a93ce05 HTTP/1.1" status: 204 len: 168 time: 1.4332659 May 12 15:33:17.206467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:17.221536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cab30702-e171-4c58-b189-f99b466f9cce admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=84f44d44-ba64-42e5-8f7a-d0981a93ce05,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:17.253041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5a27c596-b8c1-4ceb-8fc2-34facba937f3 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Calling delete_port for c77c4165-7e12-4772-86c8-36a46e073696 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:17.259949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Made reservation on behalf of c5f9faeb50de42b1a07298c25a4e4d6b for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:17.283257 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:17.331239 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6d5bcc4-3daa-4bab-8737-15b5a96df70c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:17.441405 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7164302b-73c8-49b4-b935-6e558074886e req-c069e062-bd97-4884-9226-c28d279c8ee3 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 210 time: 0.0534983 May 12 15:33:17.447327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54116) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:17.474443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d000a8ac-ab2a-476e-b0af-5e1d35557bc0 req-2b5f1c7e-7d2c-485d-8d1e-4bd672cf83da service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.4919257 May 12 15:33:17.589854 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6d5bcc4-3daa-4bab-8737-15b5a96df70c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:17.645966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6d5bcc4-3daa-4bab-8737-15b5a96df70c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Subnet': ['ID=72723c37-b245-4008-9464-488728e67f28,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:17.652109 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6d5bcc4-3daa-4bab-8737-15b5a96df70c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:17.662075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d6d5bcc4-3daa-4bab-8737-15b5a96df70c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/72723c37-b245-4008-9464-488728e67f28 HTTP/1.1" status: 204 len: 168 time: 1.4503314 May 12 15:33:17.666195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54128) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:17.713103 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72f37082-60e3-41bc-87de-c4e0cbac79bf None None] Network 11ca6d1d-de52-4ba5-a178-0bee9c79e383 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:33:17.736016 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a27c596-b8c1-4ceb-8fc2-34facba937f3 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:17.812433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Allocated IP 172.20.0.14 (dbecac63-cd00-4ee6-bec1-19abe557d6e1/7cf2ffc4-f41f-40e3-90d1-77e214ee94e3/29d0af7f-6b74-411d-b4cd-b92826b2e4ec) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:33:17.847792 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:17.893586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54134) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:17.942283 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:17.968162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a27c596-b8c1-4ceb-8fc2-34facba937f3 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event deleted for resources: {'Port': ['ID=c77c4165-7e12-4772-86c8-36a46e073696,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:18.013995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-663695774', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}, 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:18.027444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port 6d15237b-4640-455e-aa3a-951755fcf99e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:18.036693 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:18.041891 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a27c596-b8c1-4ceb-8fc2-34facba937f3 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:18.044067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5a27c596-b8c1-4ceb-8fc2-34facba937f3 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "DELETE /v2.0/ports/c77c4165-7e12-4772-86c8-36a46e073696 HTTP/1.1" status: 204 len: 168 time: 2.1012478 May 12 15:33:18.049654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:18.052187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54138) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:18.151267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Usage tracker for resource:router and tenant:b68c8c6134e345c4b780c4a4abc4688f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:18.189355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:18.194613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d000a8ac-ab2a-476e-b0af-5e1d35557bc0 req-56d2f17a-a0db-409f-bbd1-511cf783640a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:18.196096 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d000a8ac-ab2a-476e-b0af-5e1d35557bc0 req-56d2f17a-a0db-409f-bbd1-511cf783640a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 1096 time: 0.5328379 May 12 15:33:18.225893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] DHCP port deletion for 11ca6d1d-de52-4ba5-a178-0bee9c79e383 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:33:18.232423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] Deleting port 6d15237b-4640-455e-aa3a-951755fcf99e {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:18.233656 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:18.263314 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e05ca46e-8e30-4d7b-ad1e-eeb21703962e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8d9d0187e68e4feda08559a57b3c422f&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3605168 May 12 15:33:18.274045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54146) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:18.344292 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-c71f6212-6c21-4ec8-a267-4becec13756f tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] GET failed (client error): The resource could not be found. May 12 15:33:18.344968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c71f6212-6c21-4ec8-a267-4becec13756f tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Synchronizing usage tracker for tenant:4daabc80fb744e62aca779fa277e241d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:18.347878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:18.500216 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:18.501266 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:18.518477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c71f6212-6c21-4ec8-a267-4becec13756f tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Unset dirty status for tenant:4daabc80fb744e62aca779fa277e241d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:18.519907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c71f6212-6c21-4ec8-a267-4becec13756f tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "GET /v2.0/ports/c77c4165-7e12-4772-86c8-36a46e073696 HTTP/1.1" status: 404 len: 333 time: 0.4653282 May 12 15:33:18.527408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54154) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:18.537445 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] For port 6d15237b-4640-455e-aa3a-951755fcf99e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6d15237b-4640-455e-aa3a-951755fcf99e,segment=NetworkSegment(aea0890d-1c8c-4cd4-8e5c-45fff3c1075e),segment_id=aea0890d-1c8c-4cd4-8e5c-45fff3c1075e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:18.539666 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:18.542029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Request body: {'port': {'network_id': 'aecd5d86-5173-456d-9e81-e9cec7c6c409', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-885825330'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:18.677361 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:18.741346 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:18.742946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:18.783019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4cabf45d-7983-40d5-8bbd-4ddbfe378971 req-07bc752f-59ee-416a-8a71-fd4da3f3bcbc tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 210 time: 0.0810721 May 12 15:33:18.789114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] Calling delete_port for 6d15237b-4640-455e-aa3a-951755fcf99e owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:18.792319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:18.810592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Transition to ACTIVE for port object 29d0af7f-6b74-411d-b4cd-b92826b2e4ec will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:33:18.818960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567c4146-80ae-4df4-860f-366e8540f4d0 req-85d13f49-6164-4581-a846-c1f12e91af50 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:18.826263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-567c4146-80ae-4df4-860f-366e8540f4d0 req-85d13f49-6164-4581-a846-c1f12e91af50 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 0.6720116 May 12 15:33:18.859622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Made reservation on behalf of 4daabc80fb744e62aca779fa277e241d for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:18.863192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:18.896600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6d15237b-4640-455e-aa3a-951755fcf99e no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:33:18.909528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:18.911528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81e6715b-d5c7-47d6-87df-f7d61b3ccde4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:18.993440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] device_id is not set on port b7832cd7-275e-4c3f-98f9-0b659195dd39 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:33:19.033529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d000a8ac-ab2a-476e-b0af-5e1d35557bc0 req-5efdee20-554a-4641-805f-eb09196360fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:19.035004 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d000a8ac-ab2a-476e-b0af-5e1d35557bc0 req-5efdee20-554a-4641-805f-eb09196360fe service neutron] 10.222.0.84 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 0.6842060 May 12 15:33:19.066908 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:19.153348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 6d15237b-4640-455e-aa3a-951755fcf99e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6d15237b-4640-455e-aa3a-951755fcf99e,segment=NetworkSegment(aea0890d-1c8c-4cd4-8e5c-45fff3c1075e),segment_id=aea0890d-1c8c-4cd4-8e5c-45fff3c1075e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:19.180963 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:19.273177 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:33:19.273177 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:33:19.361015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=6d15237b-4640-455e-aa3a-951755fcf99e,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:19.386890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] For port 6d15237b-4640-455e-aa3a-951755fcf99e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6d15237b-4640-455e-aa3a-951755fcf99e,segment=NetworkSegment(aea0890d-1c8c-4cd4-8e5c-45fff3c1075e),segment_id=aea0890d-1c8c-4cd4-8e5c-45fff3c1075e)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:19.387325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:19.518517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for 6d15237b-4640-455e-aa3a-951755fcf99e owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:19.630531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Network dbecac63-cd00-4ee6-bec1-19abe557d6e1 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:19.632368 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81e6715b-d5c7-47d6-87df-f7d61b3ccde4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:19.645766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:19.653356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:19.666995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d000a8ac-ab2a-476e-b0af-5e1d35557bc0 req-7424303b-daa2-42b6-9873-021528c141fc service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=45ca2419-3316-4890-add7-265905134549 HTTP/1.1" status: 200 len: 217 time: 0.2394409 May 12 15:33:19.702554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-567c4146-80ae-4df4-860f-366e8540f4d0 req-eb9ee458-a20b-4480-af23-4ac610657d85 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8752251 May 12 15:33:19.746440 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event updated for resources: {'Port': ['ID=29d0af7f-6b74-411d-b4cd-b92826b2e4ec,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:19.774910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] Deleting port 6d15237b-4640-455e-aa3a-951755fcf99e {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:19.775287 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:19.788066 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:33:19.788554 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:33:19.791292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Allocated IP 2001:db8::1f6 (aecd5d86-5173-456d-9e81-e9cec7c6c409/8e14ccb3-bcde-425d-ac11-c8bd493ae5f1/b7832cd7-275e-4c3f-98f9-0b659195dd39) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:33:19.805521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:19.806386 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:19.830730 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81e6715b-d5c7-47d6-87df-f7d61b3ccde4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:19.855933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81e6715b-d5c7-47d6-87df-f7d61b3ccde4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ec6ae84-9edf-4687-a69e-b7226ca32fd4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:19.876839 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-bb3dba70-87f3-402f-8209-0157378779ef tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.0279987 May 12 15:33:19.879613 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81e6715b-d5c7-47d6-87df-f7d61b3ccde4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:19.880839 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-81e6715b-d5c7-47d6-87df-f7d61b3ccde4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5ec6ae84-9edf-4687-a69e-b7226ca32fd4 HTTP/1.1" status: 204 len: 168 time: 1.5962176 May 12 15:33:19.897076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Request body: {'port': {'device_id': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:20.069807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d000a8ac-ab2a-476e-b0af-5e1d35557bc0 req-620c7846-40d3-45de-8a5e-95979137dcd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:20.071572 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d000a8ac-ab2a-476e-b0af-5e1d35557bc0 req-620c7846-40d3-45de-8a5e-95979137dcd3 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.2847834 May 12 15:33:20.132610 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:20.296071 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:20.361653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Transition to ACTIVE for port object b7832cd7-275e-4c3f-98f9-0b659195dd39 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:33:20.366165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] For port 6d15237b-4640-455e-aa3a-951755fcf99e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6d15237b-4640-455e-aa3a-951755fcf99e,segment=NetworkSegment(aea0890d-1c8c-4cd4-8e5c-45fff3c1075e),segment_id=aea0890d-1c8c-4cd4-8e5c-45fff3c1075e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:20.366800 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:20.450773 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:20.573471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] Calling delete_port for 6d15237b-4640-455e-aa3a-951755fcf99e owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:20.648609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port 6d15237b-4640-455e-aa3a-951755fcf99e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:20.648865 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:20.677699 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:20.720079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7ba8bc8c-4a8b-4d26-9578-ab0929ad65fd None None] Provisioning for port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:33:20.757133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7ba8bc8c-4a8b-4d26-9578-ab0929ad65fd None None] Provisioning complete for port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:20.757527 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7ba8bc8c-4a8b-4d26-9578-ab0929ad65fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:20.853217 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ff3f5be-c52c-4236-bbc8-bfe6800df44c req-837068b4-01c8-4e78-be6d-6e72c1d82cc9 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:20.865961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ff3f5be-c52c-4236-bbc8-bfe6800df44c req-837068b4-01c8-4e78-be6d-6e72c1d82cc9 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 932 time: 0.5021198 May 12 15:33:20.895219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-7ba8bc8c-4a8b-4d26-9578-ab0929ad65fd None None] Port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:33:20.897972 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:20.902891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Network aecd5d86-5173-456d-9e81-e9cec7c6c409 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:20.906210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] The port '6d15237b-4640-455e-aa3a-951755fcf99e' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:33:20.948231 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] No DVR routers for this DVR port 6d15237b-4640-455e-aa3a-951755fcf99e on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:33:20.975719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:20.979647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d000a8ac-ab2a-476e-b0af-5e1d35557bc0 req-84c3ac65-fc3a-47f0-8e14-0342767d528a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:20.983572 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d000a8ac-ab2a-476e-b0af-5e1d35557bc0 req-84c3ac65-fc3a-47f0-8e14-0342767d528a service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.6175904 May 12 15:33:21.012697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:21.015680 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:33:21.021783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:21.042183 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:21.050507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df92311a-d7e6-486f-a23a-7c0f12838eea None None] Pushing event deleted for resources: {'Port': ['ID=6d15237b-4640-455e-aa3a-951755fcf99e,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:21.298913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event updated for resources: {'Port': ['ID=b7832cd7-275e-4c3f-98f9-0b659195dd39,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:21.402647 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dde1712a-66dc-4154-b160-7e2f126fe5f9 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 2.8728290 May 12 15:33:21.407572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 29d0af7f-6b74-411d-b4cd-b92826b2e4ec {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:33:21.410595 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ff3f5be-c52c-4236-bbc8-bfe6800df44c req-a2ee631f-c3c3-4083-8371-d57a9c047115 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5436566 May 12 15:33:21.414989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54224) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:21.451312 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:21.454961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Request body: {'port': {'network_id': 'aecd5d86-5173-456d-9e81-e9cec7c6c409', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1673024237'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:21.458121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:21.517111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Transition to ACTIVE for port object 29d0af7f-6b74-411d-b4cd-b92826b2e4ec will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:33:21.521635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['11ca6d1d-de52-4ba5-a178-0bee9c79e383']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:21.544226 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:21.548270 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c33991c8-8fe4-45b1-baf3-4ae499b682f5 None None] Provisioning for port b7832cd7-275e-4c3f-98f9-0b659195dd39 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:33:21.567831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c33991c8-8fe4-45b1-baf3-4ae499b682f5 None None] Provisioning complete for port b7832cd7-275e-4c3f-98f9-0b659195dd39 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:21.568192 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c33991c8-8fe4-45b1-baf3-4ae499b682f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:21.572861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aea0890d-1c8c-4cd4-8e5c-45fff3c1075e') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:21.573311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aea0890d-1c8c-4cd4-8e5c-45fff3c1075e') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:21.591278 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:21.645516 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:21.654538 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d000a8ac-ab2a-476e-b0af-5e1d35557bc0 req-a3ba368d-2028-4849-baef-832e444f09df service neutron] 10.222.0.84 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6063223 May 12 15:33:21.734456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c33991c8-8fe4-45b1-baf3-4ae499b682f5 None None] Port b7832cd7-275e-4c3f-98f9-0b659195dd39 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:33:21.743514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43761610-4175-4c27-b47f-3ea64ed37aaf req-f1b2f6fc-919c-4a26-be0a-dc3ffb6f7ce8 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:21.745019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43761610-4175-4c27-b47f-3ea64ed37aaf req-f1b2f6fc-919c-4a26-be0a-dc3ffb6f7ce8 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 0.8341637 May 12 15:33:21.752110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Releasing vlan 587 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:33:21.752807 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: timer() May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:33:21.791003 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:33:22.038955 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:22.081828 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:22.134166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Pushing event updated for resources: {'Port': ['ID=29d0af7f-6b74-411d-b4cd-b92826b2e4ec,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:22.148628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Network': ['ID=11ca6d1d-de52-4ba5-a178-0bee9c79e383,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:22.188037 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ac8a1770-9cce-402e-b65a-e411b218c996 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/networks/11ca6d1d-de52-4ba5-a178-0bee9c79e383 HTTP/1.1" status: 204 len: 168 time: 4.5206220 May 12 15:33:22.195167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54246) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:22.207456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-423281892', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:22.229949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:22.240317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:router and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:22.247360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:22.264651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:22.278337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:22.301408 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:22.311948 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:22.313003 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:22.339643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Usage tracker for resource:port and tenant:4daabc80fb744e62aca779fa277e241d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:22.359824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:22.368655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43761610-4175-4c27-b47f-3ea64ed37aaf req-7a72a1cf-95a4-4a28-a128-40d445bc4b54 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1850066 May 12 15:33:22.381703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:22.391919 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:22.408704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:22.410247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Attempting to bind port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:22.410610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Attempting to bind port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:22.410938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Attempting to bind port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec on network dbecac63-cd00-4ee6-bec1-19abe557d6e1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:22.423468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec on network dbecac63-cd00-4ee6-bec1-19abe557d6e1 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:33:22.423790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Attempting to bind port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec on network dbecac63-cd00-4ee6-bec1-19abe557d6e1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:22.430740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 33, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:33:22.431075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Checking segment: {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:33:22.431453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Bound using segment: {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:33:22.431926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Bound port: 29d0af7f-6b74-411d-b4cd-b92826b2e4ec, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '37f382a7-d0b1-492c-b3e7-035c86377975', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:33:22.432384 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:22.512580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Made reservation on behalf of 4daabc80fb744e62aca779fa277e241d for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:22.517661 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:22.549031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] device_id is not set on port 293468e1-949b-4ac5-8928-8e45d8c296ed yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:33:22.807978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Allocated IP 2001:db8::50 (aecd5d86-5173-456d-9e81-e9cec7c6c409/8e14ccb3-bcde-425d-ac11-c8bd493ae5f1/293468e1-949b-4ac5-8928-8e45d8c296ed) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:33:23.052590 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:23.056839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] For port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:33:23.066905 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d000a8ac-ab2a-476e-b0af-5e1d35557bc0 req-236dcd36-db36-4ed4-b5dd-cdf3fbd250f7 service neutron] 10.222.0.84 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.3937833 May 12 15:33:23.068198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54274) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:23.073638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] For port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=29d0af7f-6b74-411d-b4cd-b92826b2e4ec,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:33:23.101878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:23.248065 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:23.288541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Transition to ACTIVE for port object 293468e1-949b-4ac5-8928-8e45d8c296ed will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:33:23.290049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Allocated IP 172.25.8.44 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/bfa19bee-9fe9-4697-b65a-545cbb855841) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:33:23.355761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:23.356382 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:23.359430 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] 10.222.0.84 "PUT /v2.0/ports/29d0af7f-6b74-411d-b4cd-b92826b2e4ec HTTP/1.1" status: 200 len: 1092 time: 3.4681301 May 12 15:33:23.362630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'tag': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:33:23.434896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-08070aea-2b99-40cc-9e20-d088d2f5f7d5 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Request body: {'router': {'name': 'tempest-pretest-check-2085114963'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:23.447801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad49e625-066a-4a62-8aa4-6c7327150d3b req-ea1416e4-4299-480b-8dca-fe44db546569 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:23.454917 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad49e625-066a-4a62-8aa4-6c7327150d3b req-ea1416e4-4299-480b-8dca-fe44db546569 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 944 time: 0.4021268 May 12 15:33:23.539007 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:23.605845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-08070aea-2b99-40cc-9e20-d088d2f5f7d5 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:23.633942 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f55274f0-e817-41b0-b701-9d12d64db3a5'] response: {'name': 'network-changed', 'server_uuid': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'tag': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec', 'status': 'completed', 'code': 200} May 12 15:33:23.643916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-08070aea-2b99-40cc-9e20-d088d2f5f7d5 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Usage tracker for resource:router and tenant:ed48147ffb1b4b4494e4049fbfde1bde is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:23.659614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-08070aea-2b99-40cc-9e20-d088d2f5f7d5 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:23.666190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-08070aea-2b99-40cc-9e20-d088d2f5f7d5 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:23.680831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7b39e0d-a881-40af-afb0-ebdd3e8a68f8 service neutron] Pushing event updated for resources: {'Port': ['ID=29d0af7f-6b74-411d-b4cd-b92826b2e4ec,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:23.690614 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08070aea-2b99-40cc-9e20-d088d2f5f7d5 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:23.692165 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08070aea-2b99-40cc-9e20-d088d2f5f7d5 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:23.772634 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08070aea-2b99-40cc-9e20-d088d2f5f7d5 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:23.784386 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad49e625-066a-4a62-8aa4-6c7327150d3b req-21319ed8-09a3-425e-a1bb-a6bc6e123a53 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3281999 May 12 15:33:23.844248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-834a81a1-3950-4209-9b52-6d62730f4662 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:23.846706 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-834a81a1-3950-4209-9b52-6d62730f4662 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 1095 time: 0.3877461 May 12 15:33:23.862646 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:23.983402 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event updated for resources: {'Port': ['ID=293468e1-949b-4ac5-8928-8e45d8c296ed,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:23.995130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Network aecd5d86-5173-456d-9e81-e9cec7c6c409 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:23.996575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:24.006637 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08070aea-2b99-40cc-9e20-d088d2f5f7d5 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:24.048065 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-1361c188-1056-4dec-850d-ba74a156a9c2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=29d0af7f-6b74-411d-b4cd-b92826b2e4ec HTTP/1.1" status: 200 len: 217 time: 0.1581018 May 12 15:33:24.081380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:24.129033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-15a04b78-4576-4545-9b33-614659aa60e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:24.130702 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-15a04b78-4576-4545-9b33-614659aa60e1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 HTTP/1.1" status: 200 len: 854 time: 0.0777984 May 12 15:33:24.139595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:24.146400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:24.147342 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:24.164253 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54300) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:24.200913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:24.211921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:24.229073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:24.302240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Pushing event updated for resources: {'Port': ['ID=bfa19bee-9fe9-4697-b65a-545cbb855841,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:24.356598 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-30ac76e6-f7b2-4858-b279-48c329f43d3c tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 2.9313772 May 12 15:33:24.368157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54306) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:24.379677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-382d60b7-985a-4034-a460-5d23b2c6903d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::20b', 'mac_address': 'fa:16:3e:67:6c:cb'}, {'ip_address': '2001:db8::1f6', 'mac_address': 'fa:16:3e:de:07:a7'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:24.444268 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08070aea-2b99-40cc-9e20-d088d2f5f7d5 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:24.452986 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-08070aea-2b99-40cc-9e20-d088d2f5f7d5 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 729 time: 1.3820746 May 12 15:33:24.457886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54310) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:24.533250 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-66abdcc2-281a-48e8-bc34-57571a55bb98 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:24.584943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-06803295-27aa-4762-9622-5a624639d54e None None] Provisioning for port 293468e1-949b-4ac5-8928-8e45d8c296ed completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:33:24.601598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-06803295-27aa-4762-9622-5a624639d54e None None] Provisioning complete for port 293468e1-949b-4ac5-8928-8e45d8c296ed triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:24.602599 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-06803295-27aa-4762-9622-5a624639d54e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:24.663632 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:24.743351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e97ae20b-87a5-4578-a222-142c34f09f9f tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:24.821599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-06803295-27aa-4762-9622-5a624639d54e None None] Port 293468e1-949b-4ac5-8928-8e45d8c296ed cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:33:24.946736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee095eab-5eb5-4b09-b053-ad7702bbcd14 req-beef0e98-e8d7-4a1c-a4b0-ee574fc731ea tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:24.948532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee095eab-5eb5-4b09-b053-ad7702bbcd14 req-beef0e98-e8d7-4a1c-a4b0-ee574fc731ea tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 1.3071668 May 12 15:33:25.019878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-66abdcc2-281a-48e8-bc34-57571a55bb98 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:25.026868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-66abdcc2-281a-48e8-bc34-57571a55bb98 admin admin] Usage tracker for resource:security_group_rule and tenant:331d635083a64d2fa24b104157be9f3d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:25.095797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-66abdcc2-281a-48e8-bc34-57571a55bb98 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:25.102081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:25.180823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-66abdcc2-281a-48e8-bc34-57571a55bb98 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:25.366360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-963ac76f-a411-4683-b0db-69b62b2786a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:25.368646 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-963ac76f-a411-4683-b0db-69b62b2786a3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbecac63-cd00-4ee6-bec1-19abe557d6e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 1.1497207 May 12 15:33:25.399762 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee095eab-5eb5-4b09-b053-ad7702bbcd14 req-7f8da168-90b6-420f-81fd-9914a2af42d7 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4328797 May 12 15:33:25.425187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e97ae20b-87a5-4578-a222-142c34f09f9f tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:25.435586 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e97ae20b-87a5-4578-a222-142c34f09f9f tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:25.546839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75aa8d9d-1016-49b3-82ce-05f30295d2c8 req-43a7f346-bf12-491e-bfcc-1e2219379ef1 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:25.548388 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75aa8d9d-1016-49b3-82ce-05f30295d2c8 req-43a7f346-bf12-491e-bfcc-1e2219379ef1 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 944 time: 0.6107504 May 12 15:33:25.559493 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:25.595427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Allocated IP 172.25.8.51 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/d5e374ca-631d-45a4-a06f-dcfbc6946c2c) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:33:25.609784 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e97ae20b-87a5-4578-a222-142c34f09f9f tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:25.610275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e97ae20b-87a5-4578-a222-142c34f09f9f tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 3659d8d3-c0b4-4ec1-90af-35214a095dfd {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:33:25.635021 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-382d60b7-985a-4034-a460-5d23b2c6903d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:25.723271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-8beb8e41-df40-48e9-9f6b-a455f7f5d5e1 service neutron] 10.222.0.84 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3408465 May 12 15:33:25.729903 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e97ae20b-87a5-4578-a222-142c34f09f9f tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:25.730897 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e97ae20b-87a5-4578-a222-142c34f09f9f tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] 10.222.0.82 "DELETE /v2.0/routers/3659d8d3-c0b4-4ec1-90af-35214a095dfd HTTP/1.1" status: 204 len: 168 time: 1.2612746 May 12 15:33:25.763566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54334) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:25.776896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5fa5e8b1-c8d7-455b-8d60-7d98f91f0855 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Request body: {'router': {'name': 'tempest-router-263505735', 'distributed': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:25.785530 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-66abdcc2-281a-48e8-bc34-57571a55bb98 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:25.835316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5fa5e8b1-c8d7-455b-8d60-7d98f91f0855 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:25.848323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5fa5e8b1-c8d7-455b-8d60-7d98f91f0855 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Usage tracker for resource:router and tenant:ed48147ffb1b4b4494e4049fbfde1bde is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:25.858682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75aa8d9d-1016-49b3-82ce-05f30295d2c8 req-d02322f0-e0c6-470b-bcea-6d0626d2b79f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3012123 May 12 15:33:25.859492 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-66abdcc2-281a-48e8-bc34-57571a55bb98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:25.863854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5fa5e8b1-c8d7-455b-8d60-7d98f91f0855 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:25.888456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5fa5e8b1-c8d7-455b-8d60-7d98f91f0855 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:25.925725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-66abdcc2-281a-48e8-bc34-57571a55bb98 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=331d635083a64d2fa24b104157be9f3d&name=default HTTP/1.1" status: 200 len: 2983 time: 1.7552168 May 12 15:33:25.934330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54344) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:25.975947 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5fa5e8b1-c8d7-455b-8d60-7d98f91f0855 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:25.977995 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5fa5e8b1-c8d7-455b-8d60-7d98f91f0855 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:26.002594 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:26.009456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66abdcc2-281a-48e8-bc34-57571a55bb98 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=20c65ad9-acc7-4828-8ccd-c7c6129c5352,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:26.016778 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-786d6ce2-371b-4464-b258-2ff93c5951cc req-d684280a-06a5-4018-8704-bf059ee325d5 service neutron] 10.222.0.84 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2766166 May 12 15:33:26.041018 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5fa5e8b1-c8d7-455b-8d60-7d98f91f0855 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:26.069310 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5fa5e8b1-c8d7-455b-8d60-7d98f91f0855 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:26.090023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5fa5e8b1-c8d7-455b-8d60-7d98f91f0855 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:26.091702 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5fa5e8b1-c8d7-455b-8d60-7d98f91f0855 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 721 time: 0.3270011 May 12 15:33:26.094329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:26.100534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54348) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:26.322230 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:26.324326 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab7dadf2-686a-4908-91e4-84ca5c3ebe49 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:26.378170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:26.384507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:26.391968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:26.421308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=d5e374ca-631d-45a4-a06f-dcfbc6946c2c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:26.433855 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0f87d5e-445c-44f6-bbca-3d43687f1fdb tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:26.450802 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab7dadf2-686a-4908-91e4-84ca5c3ebe49 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:26.861043 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-382d60b7-985a-4034-a460-5d23b2c6903d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:26.872863 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab7dadf2-686a-4908-91e4-84ca5c3ebe49 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:26.877158 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-382d60b7-985a-4034-a460-5d23b2c6903d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:26.976719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab7dadf2-686a-4908-91e4-84ca5c3ebe49 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=20c65ad9-acc7-4828-8ccd-c7c6129c5352,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:27.024712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-382d60b7-985a-4034-a460-5d23b2c6903d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] In _notify_port_updated(), no bound segment for port 293468e1-949b-4ac5-8928-8e45d8c296ed on network aecd5d86-5173-456d-9e81-e9cec7c6c409 {{(pid=88152) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:33:27.030895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-382d60b7-985a-4034-a460-5d23b2c6903d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:27.031784 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-382d60b7-985a-4034-a460-5d23b2c6903d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:27.033285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-382d60b7-985a-4034-a460-5d23b2c6903d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "PUT /v2.0/ports/293468e1-949b-4ac5-8928-8e45d8c296ed HTTP/1.1" status: 200 len: 1067 time: 2.6640477 May 12 15:33:27.041868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54370) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:27.053035 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab7dadf2-686a-4908-91e4-84ca5c3ebe49 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:27.054358 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ab7dadf2-686a-4908-91e4-84ca5c3ebe49 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/20c65ad9-acc7-4828-8ccd-c7c6129c5352 HTTP/1.1" status: 204 len: 168 time: 1.1157966 May 12 15:33:27.115991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b907c3d7-6111-4118-957b-1581b6e3eb1f req-e40474d9-c233-442b-8621-45022110e73e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:27.117748 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b907c3d7-6111-4118-957b-1581b6e3eb1f req-e40474d9-c233-442b-8621-45022110e73e service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 1095 time: 0.9121470 May 12 15:33:27.176276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-1faec0b6-07f3-45d5-b5f6-b3f39ea7b411 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Deleting port 293468e1-949b-4ac5-8928-8e45d8c296ed {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:27.176630 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1faec0b6-07f3-45d5-b5f6-b3f39ea7b411 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:27.354642 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0f87d5e-445c-44f6-bbca-3d43687f1fdb tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:27.364077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0f87d5e-445c-44f6-bbca-3d43687f1fdb tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:27.397862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-36ae611d-514d-4e34-87f6-9784e0109d61 None None] Provisioning complete for port 293468e1-949b-4ac5-8928-8e45d8c296ed triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:27.404534 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-36ae611d-514d-4e34-87f6-9784e0109d61 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:27.432923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b907c3d7-6111-4118-957b-1581b6e3eb1f req-9c62c00f-79c5-4643-a9ad-45baa7729890 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:27.439968 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b907c3d7-6111-4118-957b-1581b6e3eb1f req-9c62c00f-79c5-4643-a9ad-45baa7729890 service neutron] 10.222.0.84 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 916 time: 0.2812414 May 12 15:33:27.443523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0f87d5e-445c-44f6-bbca-3d43687f1fdb tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:27.448535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0f87d5e-445c-44f6-bbca-3d43687f1fdb tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 39c756fb-0e21-46a5-a303-0861a40ecc62 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:33:27.449828 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d6a18a5-cab1-410b-bcee-24b15c7cc8de req-12986673-78bd-462d-8fc6-acf19323fce5 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:27.460356 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d6a18a5-cab1-410b-bcee-24b15c7cc8de req-12986673-78bd-462d-8fc6-acf19323fce5 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 0.7858765 May 12 15:33:27.478570 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0f87d5e-445c-44f6-bbca-3d43687f1fdb tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:27.486864 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d0f87d5e-445c-44f6-bbca-3d43687f1fdb tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] 10.222.0.82 "DELETE /v2.0/routers/39c756fb-0e21-46a5-a303-0861a40ecc62 HTTP/1.1" status: 204 len: 168 time: 1.3534348 May 12 15:33:27.496270 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-36ae611d-514d-4e34-87f6-9784e0109d61 None None] Port 293468e1-949b-4ac5-8928-8e45d8c296ed cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:33:27.525237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54380) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:27.525981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-382d60b7-985a-4034-a460-5d23b2c6903d tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event updated for resources: {'Port': ['ID=293468e1-949b-4ac5-8928-8e45d8c296ed,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:27.559169 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-28740d4a-afb3-4518-9e6d-ddbc2c6e1981 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Request body: {'router': {'name': 'tempest-router-1206813858', 'distributed': False, 'admin_state_up': False, 'ha': False, 'project_id': '9c909e5ae3c74b20a7da131020977be7'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:27.586660 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-28740d4a-afb3-4518-9e6d-ddbc2c6e1981 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:27.599766 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b907c3d7-6111-4118-957b-1581b6e3eb1f req-2029ebda-e304-41cb-82c6-1389d91f0904 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=29d0af7f-6b74-411d-b4cd-b92826b2e4ec HTTP/1.1" status: 200 len: 217 time: 0.1361709 May 12 15:33:27.600897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Router 3a3e6f26-972f-411d-89b2-563cc3401c6b is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:33:27.613176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-28740d4a-afb3-4518-9e6d-ddbc2c6e1981 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Usage tracker for resource:router and tenant:9c909e5ae3c74b20a7da131020977be7 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:27.627345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-28740d4a-afb3-4518-9e6d-ddbc2c6e1981 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:27.670330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-28740d4a-afb3-4518-9e6d-ddbc2c6e1981 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:27.812179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d6a18a5-cab1-410b-bcee-24b15c7cc8de req-80088aaa-280a-43ea-9bed-f5d56bee828c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3093154 May 12 15:33:27.822233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b907c3d7-6111-4118-957b-1581b6e3eb1f req-014d6da7-65ac-4784-aef7-4a1dc99b7784 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:27.823668 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b907c3d7-6111-4118-957b-1581b6e3eb1f req-014d6da7-65ac-4784-aef7-4a1dc99b7784 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 HTTP/1.1" status: 200 len: 854 time: 0.1538916 May 12 15:33:27.875415 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28740d4a-afb3-4518-9e6d-ddbc2c6e1981 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:27.876767 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28740d4a-afb3-4518-9e6d-ddbc2c6e1981 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:27.901893 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:27.930172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceadf84c-36f5-42d0-aef5-22dcd8ee3c03 req-1f306c88-56b3-40b5-a42b-4b7a646ff652 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:27.934014 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ceadf84c-36f5-42d0-aef5-22dcd8ee3c03 req-1f306c88-56b3-40b5-a42b-4b7a646ff652 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 944 time: 0.5712900 May 12 15:33:28.001063 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28740d4a-afb3-4518-9e6d-ddbc2c6e1981 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:28.055148 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1faec0b6-07f3-45d5-b5f6-b3f39ea7b411 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:28.100976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b907c3d7-6111-4118-957b-1581b6e3eb1f req-e5432c92-d496-4e10-8143-a353dedd62ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:28.102477 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b907c3d7-6111-4118-957b-1581b6e3eb1f req-e5432c92-d496-4e10-8143-a353dedd62ff service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbecac63-cd00-4ee6-bec1-19abe557d6e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2689605 May 12 15:33:28.217943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-1faec0b6-07f3-45d5-b5f6-b3f39ea7b411 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Calling delete_port for 293468e1-949b-4ac5-8928-8e45d8c296ed owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:28.261778 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ceadf84c-36f5-42d0-aef5-22dcd8ee3c03 req-0618c570-4a27-40ae-8042-6e7312218a1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3195467 May 12 15:33:28.271961 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28740d4a-afb3-4518-9e6d-ddbc2c6e1981 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:28.285727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:33:28.300590 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a570771-454b-42de-bcfe-8c70e484fff8 None None] Sync routers for ids ['3a3e6f26-972f-411d-89b2-563cc3401c6b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:33:28.324104 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a570771-454b-42de-bcfe-8c70e484fff8 None None] Routers {'3a3e6f26-972f-411d-89b2-563cc3401c6b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:28.325136 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3a570771-454b-42de-bcfe-8c70e484fff8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3a3e6f26-972f-411d-89b2-563cc3401c6b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:28.339237 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28740d4a-afb3-4518-9e6d-ddbc2c6e1981 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:28.340406 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-28740d4a-afb3-4518-9e6d-ddbc2c6e1981 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 723 time: 0.8089161 May 12 15:33:28.345140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54398) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:28.351298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1a0a31bc-8cf6-4b97-842c-c235d9c64539 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Request body: {'router': {'distributed': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:28.432620 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:28.433737 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3a570771-454b-42de-bcfe-8c70e484fff8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:28.436324 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-33da9014-1fec-4c62-8b34-046ccc45543a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 10.9787948 May 12 15:33:28.445048 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a570771-454b-42de-bcfe-8c70e484fff8 None None] Routers {'3a3e6f26-972f-411d-89b2-563cc3401c6b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:28.445881 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3a570771-454b-42de-bcfe-8c70e484fff8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3a3e6f26-972f-411d-89b2-563cc3401c6b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:28.463292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54402) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:28.537555 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3a570771-454b-42de-bcfe-8c70e484fff8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:28.538853 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a570771-454b-42de-bcfe-8c70e484fff8 None None] The sync data for ids ['3a3e6f26-972f-411d-89b2-563cc3401c6b'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:33:28.557285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 29d0af7f-6b74-411d-b4cd-b92826b2e4ec details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:33:28.604887 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1faec0b6-07f3-45d5-b5f6-b3f39ea7b411 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:28.795610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=29d0af7f-6b74-411d-b4cd-b92826b2e4ec,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:28.812277 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'port_id': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec', 'mac_address': 'fa:16:3e:d9:02:a0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 598, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:33:28.865518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1faec0b6-07f3-45d5-b5f6-b3f39ea7b411 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event deleted for resources: {'Port': ['ID=293468e1-949b-4ac5-8928-8e45d8c296ed,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:28.873048 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6e7fd237-85d7-4d1b-882f-a510337377ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/routers/3a3e6f26-972f-411d-89b2-563cc3401c6b HTTP/1.1" status: 200 len: 923 time: 0.4002712 May 12 15:33:28.876893 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b907c3d7-6111-4118-957b-1581b6e3eb1f req-3a8de9d2-fbf4-42aa-a95b-404f1ddf1bb9 service neutron] 10.222.0.84 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7664509 May 12 15:33:28.884499 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:28.904055 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 29d0af7f-6b74-411d-b4cd-b92826b2e4ec {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:33:28.926300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=29d0af7f-6b74-411d-b4cd-b92826b2e4ec,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:28.928462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54412) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:28.932217 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:29.037362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=29d0af7f-6b74-411d-b4cd-b92826b2e4ec,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:29.050973 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:29.157193 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ceaba966-1faf-4d25-be28-7a51fcb8e8d8 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "GET /v2.0/ports?device_id=3a3e6f26-972f-411d-89b2-563cc3401c6b HTTP/1.1" status: 200 len: 205 time: 0.2269807 May 12 15:33:29.200082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54422) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:29.214151 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a0a31bc-8cf6-4b97-842c-c235d9c64539 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:29.215049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a0a31bc-8cf6-4b97-842c-c235d9c64539 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:29.246425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['29d0af7f-6b74-411d-b4cd-b92826b2e4ec'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:33:29.506470 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b907c3d7-6111-4118-957b-1581b6e3eb1f req-c6391dfd-2074-4db6-9412-bd0022207582 service neutron] 10.222.0.84 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5725935 May 12 15:33:29.507941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 7adb0a20-4c13-492f-8b5c-b427ee991590 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:33:29.713253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:33:29.723646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9f79c35-f78c-4cd0-b932-c13c6805b61d None None] Sync routers for ids ['7adb0a20-4c13-492f-8b5c-b427ee991590'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:33:29.737575 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:29.741208 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ecf23fbf-4143-492a-8fdb-b31fb30888c9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 882 time: 7.5427890 May 12 15:33:29.741462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54436) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:29.752772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9f79c35-f78c-4cd0-b932-c13c6805b61d None None] Routers {'7adb0a20-4c13-492f-8b5c-b427ee991590'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:29.753828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d9f79c35-f78c-4cd0-b932-c13c6805b61d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7adb0a20-4c13-492f-8b5c-b427ee991590'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:29.763125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-1a0a31bc-8cf6-4b97-842c-c235d9c64539 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Get a provider driver handle based on the ha flag: False and distributed flag: True {{(pid=88152) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:155}} May 12 15:33:29.767545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-1a0a31bc-8cf6-4b97-842c-c235d9c64539 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Router 02814eed-667d-430f-a5b6-5919e3d7f6ae migrating from provider to provider. {{(pid=88152) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:162}} May 12 15:33:29.767545 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a0a31bc-8cf6-4b97-842c-c235d9c64539 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:29.816112 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a0a31bc-8cf6-4b97-842c-c235d9c64539 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:29.862675 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a0a31bc-8cf6-4b97-842c-c235d9c64539 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:29.891213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d9f79c35-f78c-4cd0-b932-c13c6805b61d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:29.900678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9f79c35-f78c-4cd0-b932-c13c6805b61d None None] Routers {'7adb0a20-4c13-492f-8b5c-b427ee991590'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:29.901688 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d9f79c35-f78c-4cd0-b932-c13c6805b61d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7adb0a20-4c13-492f-8b5c-b427ee991590'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:29.962257 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1dcca66d-d5bd-4acb-a986-07523865d268 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/routers/7adb0a20-4c13-492f-8b5c-b427ee991590 HTTP/1.1" status: 200 len: 883 time: 0.2173975 May 12 15:33:29.962445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54440) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:29.981272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d9f79c35-f78c-4cd0-b932-c13c6805b61d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:29.981699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9f79c35-f78c-4cd0-b932-c13c6805b61d None None] The sync data for ids ['7adb0a20-4c13-492f-8b5c-b427ee991590'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:33:30.017467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b4755d-d776-472e-8528-a927141f319e req-ac6adb8b-1104-4de3-aa52-2894389587fa tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:30.018889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59b4755d-d776-472e-8528-a927141f319e req-ac6adb8b-1104-4de3-aa52-2894389587fa tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 0.9642107 May 12 15:33:30.079347 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:30.338463 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1faec0b6-07f3-45d5-b5f6-b3f39ea7b411 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:30.362618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d618c310-28c0-4ac2-959c-d00056c8d67f req-f529c499-1b26-4481-953d-9c8d7b664940 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:30.364085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d618c310-28c0-4ac2-959c-d00056c8d67f req-f529c499-1b26-4481-953d-9c8d7b664940 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 945 time: 0.8153651 May 12 15:33:30.384936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-66c76dff-23dd-4e7d-9d2d-97c8fec059cc tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Synchronizing usage tracker for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:router {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:30.396658 n-d-841483-1 neutron-server[88152]: WARNING neutron.scheduler.l3_agent_scheduler [None req-1a0a31bc-8cf6-4b97-842c-c235d9c64539 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] No L3 agents can host the router 02814eed-667d-430f-a5b6-5919e3d7f6ae May 12 15:33:30.417806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-66c76dff-23dd-4e7d-9d2d-97c8fec059cc tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Unset dirty status for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:router {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:30.419402 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-66c76dff-23dd-4e7d-9d2d-97c8fec059cc tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 886 time: 0.4556539 May 12 15:33:30.422714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54454) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:30.428080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-07505bfe-3dd7-4309-8357-968f8b958932 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'router': {'name': 'updatedtempest-RoutersIpV6Test-router-423281892'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:30.459177 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1faec0b6-07f3-45d5-b5f6-b3f39ea7b411 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "DELETE /v2.0/ports/293468e1-949b-4ac5-8928-8e45d8c296ed HTTP/1.1" status: 204 len: 168 time: 3.4156406 May 12 15:33:30.488803 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54458) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:30.541754 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59b4755d-d776-472e-8528-a927141f319e req-c8fd8c52-2f04-4910-8d62-bf5d0da1d368 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4121530 May 12 15:33:30.565376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 29d0af7f-6b74-411d-b4cd-b92826b2e4ec up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:33:30.632028 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-58aaf803-d985-4812-ac92-8d0e3c1ea781 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] GET failed (client error): The resource could not be found. May 12 15:33:30.632813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-58aaf803-d985-4812-ac92-8d0e3c1ea781 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Synchronizing usage tracker for tenant:4daabc80fb744e62aca779fa277e241d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:30.646428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:33:30.652377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:30.652877 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:30.657502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d618c310-28c0-4ac2-959c-d00056c8d67f req-5ef8d400-4f70-427d-bbd6-dc094953192d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2840316 May 12 15:33:30.769601 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:30.817949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-58aaf803-d985-4812-ac92-8d0e3c1ea781 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Unset dirty status for tenant:4daabc80fb744e62aca779fa277e241d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:30.821997 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-58aaf803-d985-4812-ac92-8d0e3c1ea781 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "GET /v2.0/ports/293468e1-949b-4ac5-8928-8e45d8c296ed HTTP/1.1" status: 404 len: 333 time: 0.3298469 May 12 15:33:30.822605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54466) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:30.828980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Deleting port bfa19bee-9fe9-4697-b65a-545cbb855841 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:30.829316 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:30.830997 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:30.869307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=29d0af7f-6b74-411d-b4cd-b92826b2e4ec,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:30.870540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:33:30.879074 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:30.949196 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1ee91d6c-0335-41c4-bac4-e55e4097707c'] response: {'server_uuid': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec', 'code': 200} May 12 15:33:30.984062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a0a31bc-8cf6-4b97-842c-c235d9c64539 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Hosts for router 02814eed-667d-430f-a5b6-5919e3d7f6ae: [] {{(pid=88152) _get_dvr_hosts_for_router /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:330}} May 12 15:33:31.023305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=29d0af7f-6b74-411d-b4cd-b92826b2e4ec,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:31.132673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a0a31bc-8cf6-4b97-842c-c235d9c64539 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Hosts for other DVR routers connected to router 02814eed-667d-430f-a5b6-5919e3d7f6ae: set() {{(pid=88152) _get_other_dvr_hosts /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:347}} May 12 15:33:31.135368 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a0a31bc-8cf6-4b97-842c-c235d9c64539 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:31.136707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1a0a31bc-8cf6-4b97-842c-c235d9c64539 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] 10.222.0.82 "PUT /v2.0/routers/02814eed-667d-430f-a5b6-5919e3d7f6ae HTTP/1.1" status: 200 len: 717 time: 2.7906051 May 12 15:33:31.137659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07505bfe-3dd7-4309-8357-968f8b958932 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:31.142686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54476) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:31.153961 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07505bfe-3dd7-4309-8357-968f8b958932 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:31.231183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-70931710-2bec-4cd4-b497-678c85bc7f05 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Deleting port b7832cd7-275e-4c3f-98f9-0b659195dd39 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:31.231390 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70931710-2bec-4cd4-b497-678c85bc7f05 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:31.254353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1e0c97e-d975-4844-8306-a3a81d711c59 req-bae2712a-2b88-4c10-9bd5-be86137398fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:31.255847 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f1e0c97e-d975-4844-8306-a3a81d711c59 req-bae2712a-2b88-4c10-9bd5-be86137398fd service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 1097 time: 0.2089183 May 12 15:33:31.390588 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f1e0c97e-d975-4844-8306-a3a81d711c59 req-91028145-b660-41ff-ba30-dfd12e1c890b service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1243577 May 12 15:33:31.416329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07505bfe-3dd7-4309-8357-968f8b958932 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 7adb0a20-4c13-492f-8b5c-b427ee991590 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:33:31.427001 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:31.609979 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Calling delete_port for bfa19bee-9fe9-4697-b65a-545cbb855841 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:31.645549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07505bfe-3dd7-4309-8357-968f8b958932 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:33:31.652448 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-07505bfe-3dd7-4309-8357-968f8b958932 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:31.655787 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf506e30-6929-4321-99ab-3a40b82d23f7 None None] Sync routers for ids ['7adb0a20-4c13-492f-8b5c-b427ee991590'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:33:31.661996 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-07505bfe-3dd7-4309-8357-968f8b958932 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/7adb0a20-4c13-492f-8b5c-b427ee991590 HTTP/1.1" status: 200 len: 890 time: 1.2380118 May 12 15:33:31.665604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54492) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:31.676819 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e0a69098-5d26-456a-8432-fd759b06d870 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] 10.222.0.82 "GET /v2.0/routers/02814eed-667d-430f-a5b6-5919e3d7f6ae HTTP/1.1" status: 200 len: 717 time: 0.5303342 May 12 15:33:31.682048 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf506e30-6929-4321-99ab-3a40b82d23f7 None None] Routers {'7adb0a20-4c13-492f-8b5c-b427ee991590'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:31.684611 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-bf506e30-6929-4321-99ab-3a40b82d23f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7adb0a20-4c13-492f-8b5c-b427ee991590'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:31.697648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54494) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:31.838928 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-bf506e30-6929-4321-99ab-3a40b82d23f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:31.848524 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf506e30-6929-4321-99ab-3a40b82d23f7 None None] Routers {'7adb0a20-4c13-492f-8b5c-b427ee991590'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:31.849418 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-bf506e30-6929-4321-99ab-3a40b82d23f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7adb0a20-4c13-492f-8b5c-b427ee991590'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:31.960758 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-bf506e30-6929-4321-99ab-3a40b82d23f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:31.961235 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf506e30-6929-4321-99ab-3a40b82d23f7 None None] The sync data for ids ['7adb0a20-4c13-492f-8b5c-b427ee991590'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:33:32.151638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac4a4282-e2c9-4b4d-aebf-be6cfdccf80a req-8ece1fc8-33c8-4949-b28f-fd4b002e2d77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:32.153189 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ac4a4282-e2c9-4b4d-aebf-be6cfdccf80a req-8ece1fc8-33c8-4949-b28f-fd4b002e2d77 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 1097 time: 0.4883726 May 12 15:33:32.182252 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4a334186-f08a-4f85-b0b3-74ed576bb418 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/routers/7adb0a20-4c13-492f-8b5c-b427ee991590 HTTP/1.1" status: 200 len: 890 time: 0.4290657 May 12 15:33:32.182434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54508) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:32.237973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9c707b1d-d606-4960-85b8-59959caf6707 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Synchronizing usage tracker for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:32.281690 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ac4a4282-e2c9-4b4d-aebf-be6cfdccf80a req-bd78a900-2914-442e-9d84-d5a2884f8ee1 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1178329 May 12 15:33:32.286610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9c707b1d-d606-4960-85b8-59959caf6707 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Unset dirty status for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:32.288049 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9c707b1d-d606-4960-85b8-59959caf6707 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports?device_id=7adb0a20-4c13-492f-8b5c-b427ee991590 HTTP/1.1" status: 200 len: 205 time: 0.1047840 May 12 15:33:32.293796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54518) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:32.383350 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-208503d8-0cef-46ac-b1d9-836465b979cf tempest-RoutersTestDVR-186727392 tempest-RoutersTestDVR-186727392-project] 10.222.0.82 "GET /v2.0/routers/02814eed-667d-430f-a5b6-5919e3d7f6ae HTTP/1.1" status: 200 len: 683 time: 0.6845582 May 12 15:33:32.390066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54522) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:32.432225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-724e8a0b-083f-47c7-90c8-083c72cabeb7 req-ce33627c-6a3b-4cee-b508-0a33c98037ac tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:32.433908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-724e8a0b-083f-47c7-90c8-083c72cabeb7 req-ce33627c-6a3b-4cee-b508-0a33c98037ac tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 0.7051892 May 12 15:33:32.439756 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:32.477135 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70931710-2bec-4cd4-b497-678c85bc7f05 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:32.702209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-70931710-2bec-4cd4-b497-678c85bc7f05 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Calling delete_port for b7832cd7-275e-4c3f-98f9-0b659195dd39 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:32.750231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28a7b30c-1d67-4230-a546-e19d7a2109ef req-b0c2e647-fbd5-4981-a969-30b3ec27bedc tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:32.751767 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28a7b30c-1d67-4230-a546-e19d7a2109ef req-b0c2e647-fbd5-4981-a969-30b3ec27bedc tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 946 time: 0.8701942 May 12 15:33:32.775611 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-724e8a0b-083f-47c7-90c8-083c72cabeb7 req-8f6210ae-f530-4a61-93f9-0243cf1292ca tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3260887 May 12 15:33:32.807721 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7590352e-276e-47ea-82bf-3ebb9d32259c tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:32.861362 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28a7b30c-1d67-4230-a546-e19d7a2109ef req-76c80641-07f7-4806-8163-9edcaed1c21e tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0980585 May 12 15:33:32.861998 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:32.884058 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:32.939435 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Pushing event deleted for resources: {'Port': ['ID=bfa19bee-9fe9-4697-b65a-545cbb855841,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:33.093773 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70931710-2bec-4cd4-b497-678c85bc7f05 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.161796 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.208559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70931710-2bec-4cd4-b497-678c85bc7f05 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event deleted for resources: {'Port': ['ID=b7832cd7-275e-4c3f-98f9-0b659195dd39,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:33.391391 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.410490 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7590352e-276e-47ea-82bf-3ebb9d32259c tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.413198 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7590352e-276e-47ea-82bf-3ebb9d32259c tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.414862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port d5e374ca-631d-45a4-a06f-dcfbc6946c2c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:33.415161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.443098 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.449021 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.463630 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70931710-2bec-4cd4-b497-678c85bc7f05 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.497275 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.499447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Fanout notify agent at l3_agent the message router_deleted on router 3a3e6f26-972f-411d-89b2-563cc3401c6b {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:33:33.513451 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-70931710-2bec-4cd4-b497-678c85bc7f05 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "DELETE /v2.0/ports/b7832cd7-275e-4c3f-98f9-0b659195dd39 HTTP/1.1" status: 204 len: 168 time: 2.6888070 May 12 15:33:33.519829 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.521243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54544) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:33.528933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2d722d02-500c-402e-8638-aee2b3a6ebfc tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "DELETE /v2.0/routers/3a3e6f26-972f-411d-89b2-563cc3401c6b HTTP/1.1" status: 204 len: 168 time: 4.3179791 May 12 15:33:33.530186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54546) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:33.534815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1883683838', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'enable_snat': False}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:33.540684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:33.553203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Usage tracker for resource:router and tenant:281d0c58fa114694a3293de8c107204f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:33.557586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:33.565278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:33.566942 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7590352e-276e-47ea-82bf-3ebb9d32259c tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.567453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7590352e-276e-47ea-82bf-3ebb9d32259c tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 02814eed-667d-430f-a5b6-5919e3d7f6ae {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:33:33.623103 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.624856 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.647942 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.667112 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-a24dd8fe-5f50-4c88-920d-26d1feda02f4 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] GET failed (client error): The resource could not be found. May 12 15:33:33.667955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a24dd8fe-5f50-4c88-920d-26d1feda02f4 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Synchronizing usage tracker for tenant:4daabc80fb744e62aca779fa277e241d on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:33.674417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7590352e-276e-47ea-82bf-3ebb9d32259c tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.679021 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7590352e-276e-47ea-82bf-3ebb9d32259c tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] 10.222.0.82 "DELETE /v2.0/routers/02814eed-667d-430f-a5b6-5919e3d7f6ae HTTP/1.1" status: 204 len: 168 time: 1.2842166 May 12 15:33:33.679444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54552) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:33.688689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-24a5818d-9233-4141-bcf9-505477902220 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Request body: {'router': {'name': 'tempest-router-1422948609', 'distributed': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:33.703398 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-24a5818d-9233-4141-bcf9-505477902220 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:33.723211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-24a5818d-9233-4141-bcf9-505477902220 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Usage tracker for resource:router and tenant:ed48147ffb1b4b4494e4049fbfde1bde is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:33.727582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a24dd8fe-5f50-4c88-920d-26d1feda02f4 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Unset dirty status for tenant:4daabc80fb744e62aca779fa277e241d on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:33.728768 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a24dd8fe-5f50-4c88-920d-26d1feda02f4 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "GET /v2.0/ports/b7832cd7-275e-4c3f-98f9-0b659195dd39 HTTP/1.1" status: 404 len: 333 time: 0.2012088 May 12 15:33:33.731896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-24a5818d-9233-4141-bcf9-505477902220 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:33.738288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54556) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:33.750022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-24a5818d-9233-4141-bcf9-505477902220 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:33.755781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.825854 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24a5818d-9233-4141-bcf9-505477902220 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.827945 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24a5818d-9233-4141-bcf9-505477902220 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.861804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2ee3c5a8-eaa8-4e36-85f4-ae488c1a5b37 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Deleting port 39b0dcfb-7db6-479a-9d08-7ab584f1636a {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:33.862144 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2ee3c5a8-eaa8-4e36-85f4-ae488c1a5b37 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:33.932329 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:33:34.082884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for d5e374ca-631d-45a4-a06f-dcfbc6946c2c owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:34.142184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24a5818d-9233-4141-bcf9-505477902220 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:34.179777 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24a5818d-9233-4141-bcf9-505477902220 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:34.214397 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24a5818d-9233-4141-bcf9-505477902220 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:34.219802 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-24a5818d-9233-4141-bcf9-505477902220 tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 721 time: 0.5393872 May 12 15:33:34.222055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54572) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:34.335390 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:34.424347 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-52b6b46e-de67-4cec-8fa3-c366db55234f tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:34.635294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb70d355-009c-4b10-a589-99cf070a7eab req-daaf0e8b-b624-4c1d-9be7-b342576fd97f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:34.636719 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb70d355-009c-4b10-a589-99cf070a7eab req-daaf0e8b-b624-4c1d-9be7-b342576fd97f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 946 time: 0.5096178 May 12 15:33:34.647995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-069620ed-3788-4bc2-beca-a3cdc875cc7f req-b495c3c6-00fb-4677-b451-fa200efdfa80 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:34.649467 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-069620ed-3788-4bc2-beca-a3cdc875cc7f req-b495c3c6-00fb-4677-b451-fa200efdfa80 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 0.5161073 May 12 15:33:34.768340 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2ee3c5a8-eaa8-4e36-85f4-ae488c1a5b37 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:34.780094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb70d355-009c-4b10-a589-99cf070a7eab req-0b1205f7-df38-42c2-8ebc-237fdbbb681c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1285865 May 12 15:33:34.782361 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-069620ed-3788-4bc2-beca-a3cdc875cc7f req-b56f9a73-cca4-4f6a-8244-d224fdaf1e09 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1150239 May 12 15:33:34.945146 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-52b6b46e-de67-4cec-8fa3-c366db55234f tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:34.948404 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-52b6b46e-de67-4cec-8fa3-c366db55234f tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:34.950089 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:34.953222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2ee3c5a8-eaa8-4e36-85f4-ae488c1a5b37 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Calling delete_port for 39b0dcfb-7db6-479a-9d08-7ab584f1636a owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:35.010141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=d5e374ca-631d-45a4-a06f-dcfbc6946c2c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:35.108448 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-52b6b46e-de67-4cec-8fa3-c366db55234f tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.109043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-52b6b46e-de67-4cec-8fa3-c366db55234f tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 112b9e1c-d2bc-47ef-a54f-dc8f72e2e07e {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:33:35.135555 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-52b6b46e-de67-4cec-8fa3-c366db55234f tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.147863 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-52b6b46e-de67-4cec-8fa3-c366db55234f tempest-RoutersTestDVR-939831184 tempest-RoutersTestDVR-939831184-project-admin] 10.222.0.82 "DELETE /v2.0/routers/112b9e1c-d2bc-47ef-a54f-dc8f72e2e07e HTTP/1.1" status: 204 len: 168 time: 0.9173956 May 12 15:33:35.150206 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.405562 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.410637 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.418379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36a86256-ad67-497f-9a4a-39caa3a985d0 req-109d3e99-308c-43d1-a1c4-56b7b6cb44ca tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:35.424857 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-36a86256-ad67-497f-9a4a-39caa3a985d0 req-109d3e99-308c-43d1-a1c4-56b7b6cb44ca tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 946 time: 0.4812853 May 12 15:33:35.436074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54598) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:35.442608 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.443138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Fanout notify agent at l3_agent the message router_deleted on router 7adb0a20-4c13-492f-8b5c-b427ee991590 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:33:35.449020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dc9faee-fa98-4c59-a019-8793ca50817f req-b0bc8a21-d179-417d-968a-831581dcad59 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:35.451120 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1dc9faee-fa98-4c59-a019-8793ca50817f req-b0bc8a21-d179-417d-968a-831581dcad59 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.5086715 May 12 15:33:35.490923 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.491714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-78906f8b-6916-4b54-a5c8-ae7552c19a25 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Request body: {'floatingip': {'port_id': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:35.492503 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3fc7095f-51ae-43f1-9323-dbd69a690241 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/routers/7adb0a20-4c13-492f-8b5c-b427ee991590 HTTP/1.1" status: 204 len: 168 time: 3.1976092 May 12 15:33:35.497981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54606) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:35.505801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1305619398'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:35.511918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:35.517340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:network and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:35.521053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:35.537698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:35.554021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:35.558858 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.601467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 589} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:33:35.612891 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.613256 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Added segment 122c8b48-deb8-434d-8a88-45d21d1437de of type vlan for network dc51c982-90df-4f69-aa9e-1a2187873260 May 12 15:33:35.653340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.684886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54612) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:35.701832 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.709712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:35.711056 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.761887 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.2611454 May 12 15:33:35.767046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54620) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:35.772577 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'subnet': {'network_id': 'dc51c982-90df-4f69-aa9e-1a2187873260', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:35.816368 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2ee3c5a8-eaa8-4e36-85f4-ae488c1a5b37 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.818486 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.916777 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78906f8b-6916-4b54-a5c8-ae7552c19a25 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:35.968990 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:36.058332 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4ab0ce8-a138-45f9-9170-97498cd498cf admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:36.104301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81277400-be47-4682-825f-a1beddb06d66 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Network': ['ID=dc51c982-90df-4f69-aa9e-1a2187873260,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:36.118635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network dc51c982-90df-4f69-aa9e-1a2187873260 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:33:36.126227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f4ab0ce8-a138-45f9-9170-97498cd498cf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:36.136175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f4ab0ce8-a138-45f9-9170-97498cd498cf admin admin] Usage tracker for resource:security_group_rule and tenant:9c909e5ae3c74b20a7da131020977be7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:36.140608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f4ab0ce8-a138-45f9-9170-97498cd498cf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:36.172336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f4ab0ce8-a138-45f9-9170-97498cd498cf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:36.175429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:36.183713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:subnet and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:36.200801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:36.209612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:36.229192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ee3c5a8-eaa8-4e36-85f4-ae488c1a5b37 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event deleted for resources: {'Port': ['ID=39b0dcfb-7db6-479a-9d08-7ab584f1636a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:36.234300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:36.243448 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:36.377990 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2ee3c5a8-eaa8-4e36-85f4-ae488c1a5b37 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:36.394307 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1dc9faee-fa98-4c59-a019-8793ca50817f req-0514ea7b-7b40-4b5c-acff-8e44a6267d9a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8452184 May 12 15:33:36.442141 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4ab0ce8-a138-45f9-9170-97498cd498cf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:36.450153 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f4ab0ce8-a138-45f9-9170-97498cd498cf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:36.525948 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2ee3c5a8-eaa8-4e36-85f4-ae488c1a5b37 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "DELETE /v2.0/ports/39b0dcfb-7db6-479a-9d08-7ab584f1636a HTTP/1.1" status: 204 len: 168 time: 2.7865541 May 12 15:33:36.531392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54640) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:36.531392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Allocated IP 172.25.8.20 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/f953d65a-d83b-445c-948c-5ff234efa0f0) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:33:36.571121 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f4ab0ce8-a138-45f9-9170-97498cd498cf admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9c909e5ae3c74b20a7da131020977be7&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8814056 May 12 15:33:36.582367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54644) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:36.620945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-2252df1f-e310-4d92-955b-09ad2ab9d4da tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Deleting subnet 8e14ccb3-bcde-425d-ac11-c8bd493ae5f1 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:33:36.624992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2252df1f-e310-4d92-955b-09ad2ab9d4da tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:36.641928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4ab0ce8-a138-45f9-9170-97498cd498cf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=80dd6b2a-55ca-48fc-89ab-f8d797d41f2d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:36.703212 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:36.758590 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3ecd7ae-9903-46b7-91b0-9b10bf115e7b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:36.798494 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2252df1f-e310-4d92-955b-09ad2ab9d4da tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:36.845544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Subnet': ['ID=9380d3b7-d25f-4284-acd3-794270f1b2b2,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:36.865217 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3ecd7ae-9903-46b7-91b0-9b10bf115e7b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:36.875915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Checking segment: {'id': '122c8b48-deb8-434d-8a88-45d21d1437de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'dc51c982-90df-4f69-aa9e-1a2187873260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:33:36.876286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network hostable DHCP agents. Network: dc51c982-90df-4f69-aa9e-1a2187873260, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:33:36.939252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network dc51c982-90df-4f69-aa9e-1a2187873260 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:33:36.953201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, dc51c982-90df-4f69-aa9e-1a2187873260) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:36.958710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:36.959325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:36.972232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43e3dd87-222d-4c68-8473-3d754114ba9a None None] Network dc51c982-90df-4f69-aa9e-1a2187873260 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:33:36.994394 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3ecd7ae-9903-46b7-91b0-9b10bf115e7b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:36.998641 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3ecd7ae-9903-46b7-91b0-9b10bf115e7b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:37.000131 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c3ecd7ae-9903-46b7-91b0-9b10bf115e7b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/80dd6b2a-55ca-48fc-89ab-f8d797d41f2d HTTP/1.1" status: 204 len: 168 time: 0.4152870 May 12 15:33:37.034604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3ecd7ae-9903-46b7-91b0-9b10bf115e7b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=80dd6b2a-55ca-48fc-89ab-f8d797d41f2d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:37.042449 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0423dd65-2f28-4d6c-8e08-34edf1f9c2b4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2744002 May 12 15:33:37.046997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54656) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:37.062014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-9593a2a8-6fd7-43a2-a1f3-398cfa4add87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1166075406', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:37.088673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9593a2a8-6fd7-43a2-a1f3-398cfa4add87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:37.098843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9593a2a8-6fd7-43a2-a1f3-398cfa4add87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:router and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:37.107232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9593a2a8-6fd7-43a2-a1f3-398cfa4add87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:37.116406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9593a2a8-6fd7-43a2-a1f3-398cfa4add87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:37.138514 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9593a2a8-6fd7-43a2-a1f3-398cfa4add87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:37.139691 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9593a2a8-6fd7-43a2-a1f3-398cfa4add87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:37.175838 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9593a2a8-6fd7-43a2-a1f3-398cfa4add87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:37.201833 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9593a2a8-6fd7-43a2-a1f3-398cfa4add87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:37.264743 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9593a2a8-6fd7-43a2-a1f3-398cfa4add87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:37.265951 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9593a2a8-6fd7-43a2-a1f3-398cfa4add87 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.2157736 May 12 15:33:37.269933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54664) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:37.328766 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2252df1f-e310-4d92-955b-09ad2ab9d4da tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:37.445944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc1d81f5-2d00-4e58-ab2f-8148288077ef req-3fda4bc3-e7ab-4c84-bc31-dae806ea09e8 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:37.447501 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc1d81f5-2d00-4e58-ab2f-8148288077ef req-3fda4bc3-e7ab-4c84-bc31-dae806ea09e8 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.5904458 May 12 15:33:37.451182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-dc51c982-90df-4f69-aa9e-1a2187873260', 'network_id': 'dc51c982-90df-4f69-aa9e-1a2187873260', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'fixed_ips': [{'subnet_id': '9380d3b7-d25f-4284-acd3-794270f1b2b2'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:33:37.452711 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:37.454381 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:37.592259 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc1d81f5-2d00-4e58-ab2f-8148288077ef req-3b6ee4f2-f35a-4432-9f57-321c7650a01f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1308799 May 12 15:33:37.616895 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2252df1f-e310-4d92-955b-09ad2ab9d4da tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:37.788124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2252df1f-e310-4d92-955b-09ad2ab9d4da tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event deleted for resources: {'Subnet': ['ID=8e14ccb3-bcde-425d-ac11-c8bd493ae5f1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:37.790403 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:37.804196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54676) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:37.850740 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2252df1f-e310-4d92-955b-09ad2ab9d4da tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:37.857056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6fd73f47-bacb-4773-9b76-11b9bd25649c None None] Network aecd5d86-5173-456d-9e81-e9cec7c6c409 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:33:37.859544 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2252df1f-e310-4d92-955b-09ad2ab9d4da tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "DELETE /v2.0/subnets/8e14ccb3-bcde-425d-ac11-c8bd493ae5f1 HTTP/1.1" status: 204 len: 168 time: 1.3259027 May 12 15:33:37.875936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Allocated IP 2001:db8::2 (dc51c982-90df-4f69-aa9e-1a2187873260/9380d3b7-d25f-4284-acd3-794270f1b2b2/c2731109-6365-4a9c-a1b8-9234d2443c63) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:33:37.902617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54680) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:38.059355 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-78906f8b-6916-4b54-a5c8-ae7552c19a25 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] It took 0.32 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:33:38.186611 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78906f8b-6916-4b54-a5c8-ae7552c19a25 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:38.195643 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78906f8b-6916-4b54-a5c8-ae7552c19a25 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:38.214863 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:38.270782 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-272801e9-8d79-4978-9077-e2a69e409fb4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:38.313148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:38.327657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:38.334062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:38.386977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:38.401340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-272801e9-8d79-4978-9077-e2a69e409fb4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:38.406439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event updated for resources: {'Port': ['ID=f953d65a-d83b-445c-948c-5ff234efa0f0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:38.434816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-272801e9-8d79-4978-9077-e2a69e409fb4 admin admin] Usage tracker for resource:security_group_rule and tenant:ed48147ffb1b4b4494e4049fbfde1bde is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:38.449888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-272801e9-8d79-4978-9077-e2a69e409fb4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:38.501573 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:38.513275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Transition to ACTIVE for port object c2731109-6365-4a9c-a1b8-9234d2443c63 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:33:38.535854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Transition to ACTIVE for port object c2731109-6365-4a9c-a1b8-9234d2443c63 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:33:38.540396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc4b7438-b5af-4f76-b88c-4043bf6188b0 None None] DHCP port deletion for aecd5d86-5173-456d-9e81-e9cec7c6c409 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:33:38.545012 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:38.593822 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-78906f8b-6916-4b54-a5c8-ae7552c19a25 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Floating IP 5aca4875-736a-41d6-bb44-0bc0ffee31c1 associated. External IP: 172.25.8.173, port: 29d0af7f-6b74-411d-b4cd-b92826b2e4ec. May 12 15:33:38.637942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc4b7438-b5af-4f76-b88c-4043bf6188b0 None None] Deleting port 4a5b78b1-740e-40a9-8401-5d9f47128bdd {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:38.638313 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc4b7438-b5af-4f76-b88c-4043bf6188b0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:38.694368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-272801e9-8d79-4978-9077-e2a69e409fb4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:38.820963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Deleting port 4a5b78b1-740e-40a9-8401-5d9f47128bdd {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:38.821624 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:38.977315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc4b7438-b5af-4f76-b88c-4043bf6188b0 None None] For port 4a5b78b1-740e-40a9-8401-5d9f47128bdd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4a5b78b1-740e-40a9-8401-5d9f47128bdd,segment=NetworkSegment(426b21ab-c085-43bd-9d4e-926b64edbea5),segment_id=426b21ab-c085-43bd-9d4e-926b64edbea5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:38.977953 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc4b7438-b5af-4f76-b88c-4043bf6188b0 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:39.137224 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc4b7438-b5af-4f76-b88c-4043bf6188b0 None None] Calling delete_port for 4a5b78b1-740e-40a9-8401-5d9f47128bdd owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:39.176755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] For port 4a5b78b1-740e-40a9-8401-5d9f47128bdd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4a5b78b1-740e-40a9-8401-5d9f47128bdd,segment=NetworkSegment(426b21ab-c085-43bd-9d4e-926b64edbea5),segment_id=426b21ab-c085-43bd-9d4e-926b64edbea5)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:39.177322 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:39.200727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4a5b78b1-740e-40a9-8401-5d9f47128bdd no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:33:39.282580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Network dc51c982-90df-4f69-aa9e-1a2187873260 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:39.287956 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:39.292319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:39.391465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Calling delete_port for 4a5b78b1-740e-40a9-8401-5d9f47128bdd owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:39.395291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Pushing event updated for resources: {'Port': ['ID=c2731109-6365-4a9c-a1b8-9234d2443c63,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:39.414942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:39.415134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:39.415474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:39.415850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:39.416190 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:39.416619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:39.416971 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:39.417290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:39.417890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:39.418201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:39.418514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:39.418829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:39.476950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Allocated IP 2001:db8::1 (dc51c982-90df-4f69-aa9e-1a2187873260/9380d3b7-d25f-4284-acd3-794270f1b2b2/5be51b6d-ac72-48d0-8831-f926990faa01) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:33:39.515266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Attempting to bind port c2731109-6365-4a9c-a1b8-9234d2443c63 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:39.515872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Attempting to bind port c2731109-6365-4a9c-a1b8-9234d2443c63 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '122c8b48-deb8-434d-8a88-45d21d1437de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'dc51c982-90df-4f69-aa9e-1a2187873260'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:39.516219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Attempting to bind port c2731109-6365-4a9c-a1b8-9234d2443c63 on network dc51c982-90df-4f69-aa9e-1a2187873260 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:39.524410 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:39.535866 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 33, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:33:39.536200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Checking segment: {'id': '122c8b48-deb8-434d-8a88-45d21d1437de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'dc51c982-90df-4f69-aa9e-1a2187873260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:33:39.536584 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:39.537019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Bound using segment: {'id': '122c8b48-deb8-434d-8a88-45d21d1437de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'dc51c982-90df-4f69-aa9e-1a2187873260'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:33:39.537646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Bound port: c2731109-6365-4a9c-a1b8-9234d2443c63, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '122c8b48-deb8-434d-8a88-45d21d1437de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'dc51c982-90df-4f69-aa9e-1a2187873260'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:33:39.538213 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:39.566980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2efc0bf3-92bc-4548-882c-516698f02140 req-31e1ca1f-72d2-4e3b-bde9-566835a825c0 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:39.573949 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2efc0bf3-92bc-4548-882c-516698f02140 req-31e1ca1f-72d2-4e3b-bde9-566835a825c0 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.7301273 May 12 15:33:39.644790 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:39.671539 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-272801e9-8d79-4978-9077-e2a69e409fb4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:39.687283 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2efc0bf3-92bc-4548-882c-516698f02140 req-026bda9d-d367-4906-8b75-f08d47b8c82f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1124907 May 12 15:33:39.692713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] For port c2731109-6365-4a9c-a1b8-9234d2443c63, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:33:39.697074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] For port c2731109-6365-4a9c-a1b8-9234d2443c63, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c2731109-6365-4a9c-a1b8-9234d2443c63,segment=NetworkSegment(122c8b48-deb8-434d-8a88-45d21d1437de),segment_id=122c8b48-deb8-434d-8a88-45d21d1437de)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:33:39.707604 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-bc4b7438-b5af-4f76-b88c-4043bf6188b0 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:33:39.707949 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-bc4b7438-b5af-4f76-b88c-4043bf6188b0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:33:39.709660 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:39.735852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event deleted for resources: {'Port': ['ID=4a5b78b1-740e-40a9-8401-5d9f47128bdd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:39.749447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] No DVR routers for this DVR port 4a5b78b1-740e-40a9-8401-5d9f47128bdd on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:33:39.775627 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-272801e9-8d79-4978-9077-e2a69e409fb4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:39.931146 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbda2ba-607b-49c8-b4f0-1ce5882a3082 None None] Pushing event updated for resources: {'Port': ['ID=c2731109-6365-4a9c-a1b8-9234d2443c63,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:39.962569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:40.041690 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:40.068717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Transition to ACTIVE for port object 5be51b6d-ac72-48d0-8831-f926990faa01 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:33:40.099487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aecd5d86-5173-456d-9e81-e9cec7c6c409']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:40.104433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-272801e9-8d79-4978-9077-e2a69e409fb4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=edd11cb3-d12d-48ab-a7f4-746bfb14036b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:40.114017 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:40.176120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '426b21ab-c085-43bd-9d4e-926b64edbea5') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:40.176469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '426b21ab-c085-43bd-9d4e-926b64edbea5') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:40.199707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-78906f8b-6916-4b54-a5c8-ae7552c19a25 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:33:40.209158 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc4b7438-b5af-4f76-b88c-4043bf6188b0 None None] Deleting port 4a5b78b1-740e-40a9-8401-5d9f47128bdd {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:40.209798 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc4b7438-b5af-4f76-b88c-4043bf6188b0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:40.218250 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:40.225527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-272801e9-8d79-4978-9077-e2a69e409fb4 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ed48147ffb1b4b4494e4049fbfde1bde&name=default HTTP/1.1" status: 200 len: 2983 time: 2.3820410 May 12 15:33:40.226514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54720) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:40.231089 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:40.235625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network dc51c982-90df-4f69-aa9e-1a2187873260 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:40.241416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:40.244469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:40.245121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:40.292309 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:40.295603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=5be51b6d-ac72-48d0-8831-f926990faa01,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:40.340235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Releasing vlan 594 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:33:40.341109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: timer() May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:33:40.365558 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:33:40.496526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc4b7438-b5af-4f76-b88c-4043bf6188b0 None None] The port '4a5b78b1-740e-40a9-8401-5d9f47128bdd' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:33:40.558348 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:40.598723 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:40.624201 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] 10.222.0.82 "DELETE /v2.0/networks/aecd5d86-5173-456d-9e81-e9cec7c6c409 HTTP/1.1" status: 204 len: 168 time: 2.7189472 May 12 15:33:40.635314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-776453d6-e929-40e2-b34d-13ab91a6bbe0 tempest-AllowedAddressPairIpV6TestJSON-43577308 tempest-AllowedAddressPairIpV6TestJSON-43577308-project] Pushing event deleted for resources: {'Network': ['ID=aecd5d86-5173-456d-9e81-e9cec7c6c409,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:40.779347 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:40.922026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c2731109-6365-4a9c-a1b8-9234d2443c63 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:33:40.996349 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0f53974-8dea-4de8-aa22-2ab1270c0e41 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:41.019497 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port c2731109-6365-4a9c-a1b8-9234d2443c63 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:33:41.104365 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0f53974-8dea-4de8-aa22-2ab1270c0e41 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:41.133222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-78906f8b-6916-4b54-a5c8-ae7552c19a25 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:33:41.145907 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7a3c9b1-c281-4b3b-b30c-c2ea11c0d43f None None] Sync routers for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:33:41.163094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7a3c9b1-c281-4b3b-b30c-c2ea11c0d43f None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:41.163875 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a7a3c9b1-c281-4b3b-b30c-c2ea11c0d43f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:41.255790 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54742) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:41.265059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b9a68a1-e8a7-448d-a5ff-da6ffc853ede req-38ad0f61-dc24-423e-860b-7bc03aaa23b6 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:41.267184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b9a68a1-e8a7-448d-a5ff-da6ffc853ede req-38ad0f61-dc24-423e-860b-7bc03aaa23b6 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.6817529 May 12 15:33:41.386275 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78906f8b-6916-4b54-a5c8-ae7552c19a25 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:41.574963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-a7a3c9b1-c281-4b3b-b30c-c2ea11c0d43f None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:33:41.655662 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:41.662234 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b9a68a1-e8a7-448d-a5ff-da6ffc853ede req-4865cd90-a6e8-46f7-b941-a129a520483a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3313594 May 12 15:33:41.713089 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:41.722976 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:41.724765 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:41.758341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc6f3853-bdbe-4f1c-bed2-168d78c1eb2e None None] Network dc51c982-90df-4f69-aa9e-1a2187873260 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:33:41.786316 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-472bb654-18a2-4bd0-bf5c-b1dfe65ca3ed admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4daabc80fb744e62aca779fa277e241d&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5147986 May 12 15:33:41.800700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-78906f8b-6916-4b54-a5c8-ae7552c19a25 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "PUT /v2.0/floatingips/5aca4875-736a-41d6-bb44-0bc0ffee31c1 HTTP/1.1" status: 200 len: 992 time: 6.3629446 May 12 15:33:41.801403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54752) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:41.805169 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'tag': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:33:41.812888 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0f53974-8dea-4de8-aa22-2ab1270c0e41 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:41.841347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=5be51b6d-ac72-48d0-8831-f926990faa01,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:41.958202 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-02345917-c860-4f80-9eba-a6f2758856d6'] response: {'name': 'network-changed', 'server_uuid': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'tag': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec', 'status': 'completed', 'code': 200} May 12 15:33:41.972808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0f53974-8dea-4de8-aa22-2ab1270c0e41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=edd11cb3-d12d-48ab-a7f4-746bfb14036b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:41.976410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-425474e3-d0d9-40f7-9caa-2981358a7b30 None None] Provisioning for port c2731109-6365-4a9c-a1b8-9234d2443c63 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:33:42.012226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-425474e3-d0d9-40f7-9caa-2981358a7b30 None None] Provisioning complete for port c2731109-6365-4a9c-a1b8-9234d2443c63 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:42.012595 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-425474e3-d0d9-40f7-9caa-2981358a7b30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:42.041767 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0f53974-8dea-4de8-aa22-2ab1270c0e41 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:42.058590 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a0f53974-8dea-4de8-aa22-2ab1270c0e41 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/edd11cb3-d12d-48ab-a7f4-746bfb14036b HTTP/1.1" status: 204 len: 168 time: 1.8307669 May 12 15:33:42.092795 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a214094c-8c8f-4559-8ddd-e4f56201d6b7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:42.137538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network dc51c982-90df-4f69-aa9e-1a2187873260 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:42.141548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:42.237951 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a214094c-8c8f-4559-8ddd-e4f56201d6b7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:42.383742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfcd5578-3bc9-446e-8b2f-e066225eb3a7 req-74bb605b-ae58-4857-bcd3-776a394ae209 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:42.392809 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dfcd5578-3bc9-446e-8b2f-e066225eb3a7 req-74bb605b-ae58-4857-bcd3-776a394ae209 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 1097 time: 0.4183373 May 12 15:33:42.427426 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a214094c-8c8f-4559-8ddd-e4f56201d6b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:42.448351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a214094c-8c8f-4559-8ddd-e4f56201d6b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2504f1b8-595e-4bf2-876f-12440f8c96d2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:42.465961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Router 1a964780-957d-47f2-b4b7-5aa21585eb40 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:33:42.469694 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a214094c-8c8f-4559-8ddd-e4f56201d6b7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:42.473046 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a214094c-8c8f-4559-8ddd-e4f56201d6b7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2504f1b8-595e-4bf2-876f-12440f8c96d2 HTTP/1.1" status: 204 len: 168 time: 0.6601160 May 12 15:33:42.509620 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-425474e3-d0d9-40f7-9caa-2981358a7b30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:42.586869 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a7a3c9b1-c281-4b3b-b30c-c2ea11c0d43f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '5aca4875-736a-41d6-bb44-0bc0ffee31c1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.173', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 2546, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:d9:02:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:33:07Z', 'updated_at': '2022-05-12T15:33:37Z', 'revision_number': 1, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:42.594588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-425474e3-d0d9-40f7-9caa-2981358a7b30 None None] For port c2731109-6365-4a9c-a1b8-9234d2443c63, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c2731109-6365-4a9c-a1b8-9234d2443c63,segment=NetworkSegment(122c8b48-deb8-434d-8a88-45d21d1437de),segment_id=122c8b48-deb8-434d-8a88-45d21d1437de)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:42.595876 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7a3c9b1-c281-4b3b-b30c-c2ea11c0d43f None None] Checking router: 616c45f4-38af-4ff7-8fb7-f1c61b204b6a for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:33:42.602004 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-425474e3-d0d9-40f7-9caa-2981358a7b30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:42.647490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7a3c9b1-c281-4b3b-b30c-c2ea11c0d43f None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:42.648122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a7a3c9b1-c281-4b3b-b30c-c2ea11c0d43f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:42.658819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 94c42552-82c0-49c4-9e45-790a32188889 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:33:43.017609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:33:43.029564 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4194baa1-bbca-421b-b9eb-9fd7f16c9e51 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/94c42552-82c0-49c4-9e45-790a32188889/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7567408 May 12 15:33:43.032773 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56ee06b1-ccfd-4a4f-8d5a-35eea206510f None None] Sync routers for ids ['94c42552-82c0-49c4-9e45-790a32188889'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:33:43.041043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54796) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:43.052213 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56ee06b1-ccfd-4a4f-8d5a-35eea206510f None None] Routers {'94c42552-82c0-49c4-9e45-790a32188889'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:43.053055 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-56ee06b1-ccfd-4a4f-8d5a-35eea206510f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['94c42552-82c0-49c4-9e45-790a32188889'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:43.064553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-425474e3-d0d9-40f7-9caa-2981358a7b30 None None] Pushing event updated for resources: {'Port': ['ID=c2731109-6365-4a9c-a1b8-9234d2443c63,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:43.184404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-596d0757-0f97-45a1-925e-95c92728e2d1 None None] Provisioning complete for port c2731109-6365-4a9c-a1b8-9234d2443c63 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:43.184934 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-596d0757-0f97-45a1-925e-95c92728e2d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:43.192788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:33:43.241102 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-56ee06b1-ccfd-4a4f-8d5a-35eea206510f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:43.241904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Sync routers for ids ['1a964780-957d-47f2-b4b7-5aa21585eb40'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:33:43.258770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfcd5578-3bc9-446e-8b2f-e066225eb3a7 req-ad053814-9a71-493b-978a-0efa6de4f638 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:43.264144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dfcd5578-3bc9-446e-8b2f-e066225eb3a7 req-ad053814-9a71-493b-978a-0efa6de4f638 service neutron] 10.222.0.84 "GET /v2.0/networks?id=dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 200 len: 916 time: 0.8463216 May 12 15:33:43.265904 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56ee06b1-ccfd-4a4f-8d5a-35eea206510f None None] Routers {'94c42552-82c0-49c4-9e45-790a32188889'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:43.266534 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-56ee06b1-ccfd-4a4f-8d5a-35eea206510f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['94c42552-82c0-49c4-9e45-790a32188889'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:43.284596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd1872b6-633c-459b-a378-0f1314d247d5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:43.284814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fd1872b6-633c-459b-a378-0f1314d247d5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Synchronizing usage tracker for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:43.294164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0722a195-172e-442b-bf0c-8c69e56fc1d5 req-039a971a-4ae4-429e-aede-ebb5cd1d218c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:43.296521 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0722a195-172e-442b-bf0c-8c69e56fc1d5 req-039a971a-4ae4-429e-aede-ebb5cd1d218c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.3969808 May 12 15:33:43.317098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-a7a3c9b1-c281-4b3b-b30c-c2ea11c0d43f None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:33:43.350801 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:43.354952 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-afb04f90-89dd-4daa-8b2f-9c36cf0950cc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 907 time: 9.8213484 May 12 15:33:43.355724 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54810) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:43.433697 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-41d71757-586d-4145-8222-9bc9768da620 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:43.438854 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-56ee06b1-ccfd-4a4f-8d5a-35eea206510f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:43.439166 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56ee06b1-ccfd-4a4f-8d5a-35eea206510f None None] The sync data for ids ['94c42552-82c0-49c4-9e45-790a32188889'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:33:43.494457 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:43.504853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fd1872b6-633c-459b-a378-0f1314d247d5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Unset dirty status for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:43.509036 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fd1872b6-633c-459b-a378-0f1314d247d5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports/5be51b6d-ac72-48d0-8831-f926990faa01 HTTP/1.1" status: 200 len: 911 time: 0.4586723 May 12 15:33:43.510004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54818) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:43.518252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Routers {'1a964780-957d-47f2-b4b7-5aa21585eb40'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:43.529067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['1a964780-957d-47f2-b4b7-5aa21585eb40'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:43.546116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-576891f2-ec5a-44f6-a54d-c59c868dc920 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '9380d3b7-d25f-4284-acd3-794270f1b2b2'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:44.024637 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dfcd5578-3bc9-446e-8b2f-e066225eb3a7 req-661c0752-d34f-4165-8194-91731d569f13 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=29d0af7f-6b74-411d-b4cd-b92826b2e4ec HTTP/1.1" status: 200 len: 1000 time: 0.7301817 May 12 15:33:44.033672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Set router 1a964780-957d-47f2-b4b7-5aa21585eb40 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:33:44.212022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfcd5578-3bc9-446e-8b2f-e066225eb3a7 req-90340502-7507-40a0-a579-3b3470849644 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:44.213779 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dfcd5578-3bc9-446e-8b2f-e066225eb3a7 req-90340502-7507-40a0-a579-3b3470849644 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 HTTP/1.1" status: 200 len: 854 time: 0.1604562 May 12 15:33:44.291985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0722a195-172e-442b-bf0c-8c69e56fc1d5 req-3a022291-ca0f-4fd2-a4fb-e239359c628a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9897397 May 12 15:33:44.301304 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d414a87e-99ef-4cbc-a623-7c24f8220fa0 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/routers/1a964780-957d-47f2-b4b7-5aa21585eb40 HTTP/1.1" status: 200 len: 908 time: 0.9366798 May 12 15:33:44.302176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54850) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:44.313688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1883683838', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'enable_snat': True}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:44.332350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:44.342998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Usage tracker for resource:router and tenant:281d0c58fa114694a3293de8c107204f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:44.346536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Quota usage for router was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:44.365658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attempting to reserve 1 items for resource router. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:44.398013 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:44.399896 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:44.412654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54856) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:44.444313 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:44.546781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-576891f2-ec5a-44f6-a54d-c59c868dc920 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:44.933350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54870) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:44.941347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c2731109-6365-4a9c-a1b8-9234d2443c63 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:33:45.042004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfcd5578-3bc9-446e-8b2f-e066225eb3a7 req-00c2b4ae-5756-4ea7-b577-bff190db7cd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:45.044270 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dfcd5578-3bc9-446e-8b2f-e066225eb3a7 req-00c2b4ae-5756-4ea7-b577-bff190db7cd8 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=dbecac63-cd00-4ee6-bec1-19abe557d6e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.8203881 May 12 15:33:45.054673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeTest-1412716882', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:45.110756 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-test-network-1585693050'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:45.134185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:45.148349 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.160562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:network and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:45.164235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:45.200528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:45.260945 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dfcd5578-3bc9-446e-8b2f-e066225eb3a7 req-ea1815b3-2c2d-4710-a51a-09882741648f service neutron] 10.222.0.84 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1928303 May 12 15:33:45.262247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:45.271084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Usage tracker for resource:port and tenant:833b98ea5d9145a8b7bf888bab638d27 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:45.303102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:45.304632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:45.306999 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.321242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:45.342537 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.399619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:45.416481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:security_group_rule and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:45.424141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:45.447556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:45.480557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Made reservation on behalf of 833b98ea5d9145a8b7bf888bab638d27 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:45.484568 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.535929 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.551232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-596d0757-0f97-45a1-925e-95c92728e2d1 None None] Provisioning for port 5be51b6d-ac72-48d0-8831-f926990faa01 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:33:45.613364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-596d0757-0f97-45a1-925e-95c92728e2d1 None None] Provisioning complete for port 5be51b6d-ac72-48d0-8831-f926990faa01 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:45.613926 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-596d0757-0f97-45a1-925e-95c92728e2d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.666186 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4b45884b-99e7-418c-b0c0-736ee848fd17 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.667818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c2731109-6365-4a9c-a1b8-9234d2443c63 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:45.668177 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.820265 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.840597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-596d0757-0f97-45a1-925e-95c92728e2d1 None None] Port 5be51b6d-ac72-48d0-8831-f926990faa01 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:33:45.852071 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.858326 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.861148 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.870691 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-576891f2-ec5a-44f6-a54d-c59c868dc920 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.873498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a7a3c9b1-c281-4b3b-b30c-c2ea11c0d43f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '5aca4875-736a-41d6-bb44-0bc0ffee31c1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.173', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 2546, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:d9:02:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:33:07Z', 'updated_at': '2022-05-12T15:33:37Z', 'revision_number': 1, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:45.874357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 576} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:33:45.881932 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dfcd5578-3bc9-446e-8b2f-e066225eb3a7 req-5ecbf246-4975-4195-a874-c4bfa3aa460b service neutron] 10.222.0.84 "GET /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6121981 May 12 15:33:45.884058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7a3c9b1-c281-4b3b-b30c-c2ea11c0d43f None None] The sync data for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 is: [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '5aca4875-736a-41d6-bb44-0bc0ffee31c1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'floating_ip_address': '172.25.8.173', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'port_id': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 2546, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'mac_address': 'fa:16:3e:d9:02:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:33:07Z', 'updated_at': '2022-05-12T15:33:37Z', 'revision_number': 1, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:33:45.884800 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-576891f2-ec5a-44f6-a54d-c59c868dc920 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.885270 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.885909 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Added segment 351c4dc8-5404-4259-bed5-cd4008dea28b of type vlan for network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 May 12 15:33:45.894512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-576891f2-ec5a-44f6-a54d-c59c868dc920 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:45.895231 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-576891f2-ec5a-44f6-a54d-c59c868dc920 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.899753 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-576891f2-ec5a-44f6-a54d-c59c868dc920 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/ports/5be51b6d-ac72-48d0-8831-f926990faa01 HTTP/1.1" status: 200 len: 911 time: 2.3723783 May 12 15:33:45.900722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54892) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:45.901939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:45.949684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:45.977078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Usage tracker for resource:security_group_rule and tenant:833b98ea5d9145a8b7bf888bab638d27 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:45.983484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:45.996385 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a964780-957d-47f2-b4b7-5aa21585eb40', 'name': 'tempest-snat-router-1883683838', 'tenant_id': '281d0c58fa114694a3293de8c107204f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.20'}], 'enable_snat': False}, 'gw_port_id': 'f953d65a-d83b-445c-948c-5ff234efa0f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:33Z', 'updated_at': '2022-05-12T15:33:39Z', 'revision_number': 3, 'project_id': '281d0c58fa114694a3293de8c107204f', 'gw_port': {'id': 'f953d65a-d83b-445c-948c-5ff234efa0f0', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:b7:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a964780-957d-47f2-b4b7-5aa21585eb40', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2568, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:33:36Z', 'updated_at': '2022-05-12T15:33:36Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:45.998532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:46.005486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ab2e4449-ddc4-477e-adae-5bcdb28de463 None None] Provisioning complete for port 5be51b6d-ac72-48d0-8831-f926990faa01 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:46.006451 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ab2e4449-ddc4-477e-adae-5bcdb28de463 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:46.053314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Checking router: 1a964780-957d-47f2-b4b7-5aa21585eb40 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:33:46.065838 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Updating router 1a964780-957d-47f2-b4b7-5aa21585eb40 port f953d65a-d83b-445c-948c-5ff234efa0f0 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:33:46.147973 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:46.162068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:46.162687 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:46.167871 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:46.180119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ab2e4449-ddc4-477e-adae-5bcdb28de463 None None] Port 5be51b6d-ac72-48d0-8831-f926990faa01 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:33:46.181272 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:46.351876 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c376fd6e-c58d-48e0-9d03-5f333c7eb080 None None] New status for floating IP 5aca4875-736a-41d6-bb44-0bc0ffee31c1: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:33:46.378990 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:46.571765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-576891f2-ec5a-44f6-a54d-c59c868dc920 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=5be51b6d-ac72-48d0-8831-f926990faa01,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:46.603634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'SecurityGroup': ['ID=24222ec9-624b-4965-b756-3fef3bd7e96b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:46.606580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Network': ['ID=66bc0e1c-8b39-4a42-b061-fe805d2bcf80,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:46.644760 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Allocated IP 172.25.8.215 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/2a912c75-5578-4ced-b5a5-84c237ad5205) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:33:46.662906 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:33:46.677420 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bec954c0-b3f9-44b4-9634-4bcf4362eb22 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 781 time: 2.2480185 May 12 15:33:46.677420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54908) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:46.690864 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'name': 'tempest-PortsTestJSON-1160493247'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:46.957797 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:47.027412 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:47.050300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] device_id is not set on port ddbf2c01-a0d6-43e7-8ae1-9cce986fd090 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:33:47.056143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:47.063778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:port and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:47.077266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:47.086271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:47.119696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:47.124252 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:47.137736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=524a39ab-4f15-49e3-a243-6afa0708f1fd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:47.145041 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:47.160592 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port d3738296-e321-4a38-bb44-3803dd75076e yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:33:47.346610 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:47.376822 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:47.453324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:47.516344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:47.519645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:47.671344 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:47.727551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Transition to ACTIVE for port object f953d65a-d83b-445c-948c-5ff234efa0f0 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:33:47.747137 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:47.861745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Allocated IP 172.25.8.15 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/ddbf2c01-a0d6-43e7-8ae1-9cce986fd090) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:33:47.941943 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:48.000582 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:48.021981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port 5be51b6d-ac72-48d0-8831-f926990faa01 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:48.023437 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:48.046255 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Attempting to bind port f953d65a-d83b-445c-948c-5ff234efa0f0 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:48.046627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Attempting to bind port f953d65a-d83b-445c-948c-5ff234efa0f0 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:48.046991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Attempting to bind port f953d65a-d83b-445c-948c-5ff234efa0f0 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:48.049215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe0a4171-f853-4062-a75a-a5ae46012a8e None None] Pushing event updated for resources: {'Port': ['ID=f953d65a-d83b-445c-948c-5ff234efa0f0,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:48.055393 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 33, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:33:48.055766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:33:48.056336 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:48.056732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:33:48.057192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Bound port: f953d65a-d83b-445c-948c-5ff234efa0f0, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:33:48.057591 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:48.170083 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] For port f953d65a-d83b-445c-948c-5ff234efa0f0, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:33:48.173769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] For port f953d65a-d83b-445c-948c-5ff234efa0f0, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f953d65a-d83b-445c-948c-5ff234efa0f0,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:33:48.179525 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:48.355615 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe0a4171-f853-4062-a75a-a5ae46012a8e None None] Pushing event updated for resources: {'Port': ['ID=f953d65a-d83b-445c-948c-5ff234efa0f0,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:48.362971 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:48.364244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Routers {'1a964780-957d-47f2-b4b7-5aa21585eb40'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:48.365748 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['1a964780-957d-47f2-b4b7-5aa21585eb40'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:48.450640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event updated for resources: {'Port': ['ID=2a912c75-5578-4ced-b5a5-84c237ad5205,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:48.474160 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:48.505920 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:48.520239 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:48.613201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] Set router 1a964780-957d-47f2-b4b7-5aa21585eb40 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:33:48.679106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=d3738296-e321-4a38-bb44-3803dd75076e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:48.706507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for 5be51b6d-ac72-48d0-8831-f926990faa01 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:48.735440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b245eb-5cad-447a-be16-ce5af6eb902e req-3f3b5775-ebbd-4728-a785-f25b8b9abd5a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:48.742357 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1b245eb-5cad-447a-be16-ce5af6eb902e req-3f3b5775-ebbd-4728-a785-f25b8b9abd5a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.6130769 May 12 15:33:48.771999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Checking segment: {'id': '351c4dc8-5404-4259-bed5-cd4008dea28b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:33:48.772323 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network hostable DHCP agents. Network: 66bc0e1c-8b39-4a42-b061-fe805d2bcf80, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:33:48.886549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68eb1553-c53d-4655-9c18-1a8eefe542f2 req-c8eba52b-3b06-4612-b6d2-66b83b6c5585 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:48.888393 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-68eb1553-c53d-4655-9c18-1a8eefe542f2 req-c8eba52b-3b06-4612-b6d2-66b83b6c5585 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 1096 time: 0.8377337 May 12 15:33:48.922184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1b245eb-5cad-447a-be16-ce5af6eb902e req-ccae8f01-0672-4a2c-81f5-fd69330a0905 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1788299 May 12 15:33:48.950325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:33:48.991332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a964780-957d-47f2-b4b7-5aa21585eb40', 'name': 'tempest-snat-router-1883683838', 'tenant_id': '281d0c58fa114694a3293de8c107204f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.20'}], 'enable_snat': False}, 'gw_port_id': 'f953d65a-d83b-445c-948c-5ff234efa0f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:33Z', 'updated_at': '2022-05-12T15:33:39Z', 'revision_number': 3, 'project_id': '281d0c58fa114694a3293de8c107204f', 'gw_port': {'id': 'f953d65a-d83b-445c-948c-5ff234efa0f0', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:b7:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a964780-957d-47f2-b4b7-5aa21585eb40', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2568, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:33:36Z', 'updated_at': '2022-05-12T15:33:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:48.998241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8a4f0a8-cca1-4d86-a485-95eea502450b None None] The sync data for ids ['1a964780-957d-47f2-b4b7-5aa21585eb40'] in n-d-841483-1 is: [{'id': '1a964780-957d-47f2-b4b7-5aa21585eb40', 'name': 'tempest-snat-router-1883683838', 'tenant_id': '281d0c58fa114694a3293de8c107204f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.20'}], 'enable_snat': False}, 'gw_port_id': 'f953d65a-d83b-445c-948c-5ff234efa0f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:33Z', 'updated_at': '2022-05-12T15:33:39Z', 'revision_number': 3, 'project_id': '281d0c58fa114694a3293de8c107204f', 'gw_port': {'id': 'f953d65a-d83b-445c-948c-5ff234efa0f0', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:b7:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a964780-957d-47f2-b4b7-5aa21585eb40', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2568, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:33:36Z', 'updated_at': '2022-05-12T15:33:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:33:49.195114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 66bc0e1c-8b39-4a42-b061-fe805d2bcf80) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:49.200320 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:49.209895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad0b06cb-59b3-4c7f-ade1-5c6d2bfeb279 None None] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:33:49.210120 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:49.210281 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:49.221814 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:49.280881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=5be51b6d-ac72-48d0-8831-f926990faa01,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:49.288950 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:49.322175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:49.322573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:49.322923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:49.327381 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e22b563c-44f0-4d15-b779-5b73611df17e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 2.6509006 May 12 15:33:49.327880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:49.328018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:49.328384 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:49.328708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:49.329254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:49.329429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:49.329763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:49.330092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:49.330416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:49.338547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54952) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:49.352444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1694994548'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:49.424552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:49.428743 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:49.468815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68eb1553-c53d-4655-9c18-1a8eefe542f2 req-d3049eeb-c180-4946-af88-e5e5d36132f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:49.472763 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-68eb1553-c53d-4655-9c18-1a8eefe542f2 req-d3049eeb-c180-4946-af88-e5e5d36132f4 service neutron] 10.222.0.84 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 0.4058456 May 12 15:33:49.602648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:network and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:49.608303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:49.660527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:49.726278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:49.749621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:49.753075 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:49.823727 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:49.833647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:49.839798 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-68eb1553-c53d-4655-9c18-1a8eefe542f2 req-e465caa8-0423-4f61-96da-b86f3296f8c2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=45ca2419-3316-4890-add7-265905134549 HTTP/1.1" status: 200 len: 217 time: 0.2293506 May 12 15:33:49.868073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 555} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:33:49.888850 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:49.888850 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Added segment eefd0f25-9356-4cc9-a059-6573ac20a798 of type vlan for network 19877065-a43f-437e-803f-da7dbeb64c6c May 12 15:33:49.895209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Router 2fa188d6-3ca1-4639-b0f4-363cad1672ab is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:33:49.901721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:49.938158 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:50.003851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Pushing event updated for resources: {'Port': ['ID=ddbf2c01-a0d6-43e7-8ae1-9cce986fd090,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:50.135873 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:50.142071 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:50.142789 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:50.244397 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.9024012 May 12 15:33:50.254446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54972) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:50.263031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'ports': [{'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80'}, {'network_id': '19877065-a43f-437e-803f-da7dbeb64c6c'}]} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:50.263357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:50.263818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'network_id': '19877065-a43f-437e-803f-da7dbeb64c6c'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:50.304790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:50.305616 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:50.413241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68eb1553-c53d-4655-9c18-1a8eefe542f2 req-7bf60dd8-5b96-4ae8-8d7e-9e7e8184043c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:50.414710 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-68eb1553-c53d-4655-9c18-1a8eefe542f2 req-7bf60dd8-5b96-4ae8-8d7e-9e7e8184043c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.4840200 May 12 15:33:50.473467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 94c42552-82c0-49c4-9e45-790a32188889 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:33:50.475330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:33:50.487060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Sync routers for ids ['2fa188d6-3ca1-4639-b0f4-363cad1672ab'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:33:50.506961 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-663083fa-3194-4de6-a7a6-e9db25c04e3a tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1032 time: 5.5705817 May 12 15:33:50.514065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Routers {'2fa188d6-3ca1-4639-b0f4-363cad1672ab'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:50.515670 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2fa188d6-3ca1-4639-b0f4-363cad1672ab'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:50.523848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8e3bca3-55b4-4b00-ba4f-e15d2a7a3dda tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Network': ['ID=19877065-a43f-437e-803f-da7dbeb64c6c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:50.541826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54980) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:50.583619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 19877065-a43f-437e-803f-da7dbeb64c6c details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:33:50.657635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:33:50.663399 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-471f8f33-2a29-4dc9-a381-fd0edbf43f5e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/94c42552-82c0-49c4-9e45-790a32188889/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.7202666 May 12 15:33:50.670373 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a96b3b84-62c2-467e-896f-fd8397fc1cc9 None None] Sync routers for ids ['94c42552-82c0-49c4-9e45-790a32188889'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:33:50.671881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54984) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:50.685909 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a96b3b84-62c2-467e-896f-fd8397fc1cc9 None None] Routers {'94c42552-82c0-49c4-9e45-790a32188889'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:50.686616 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:50.687390 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a96b3b84-62c2-467e-896f-fd8397fc1cc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['94c42552-82c0-49c4-9e45-790a32188889'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:50.687809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3ce46908-1901-46a5-ae4a-ed371e8fb752 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 907 time: 6.3846903 May 12 15:33:50.703658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.15'}]}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:50.738342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54990) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:50.743855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:50.760844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Set router 2fa188d6-3ca1-4639-b0f4-363cad1672ab gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:33:50.761765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Usage tracker for resource:router and tenant:833b98ea5d9145a8b7bf888bab638d27 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:50.780594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:50.787782 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a96b3b84-62c2-467e-896f-fd8397fc1cc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:50.800472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:50.804353 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a96b3b84-62c2-467e-896f-fd8397fc1cc9 None None] Routers {'94c42552-82c0-49c4-9e45-790a32188889'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:50.806489 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a96b3b84-62c2-467e-896f-fd8397fc1cc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['94c42552-82c0-49c4-9e45-790a32188889'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:50.819526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:50.824419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:port and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:50.829289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:50.835907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 2 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:50.860600 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:50.861883 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:50.902214 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a96b3b84-62c2-467e-896f-fd8397fc1cc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:50.903419 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a96b3b84-62c2-467e-896f-fd8397fc1cc9 None None] The sync data for ids ['94c42552-82c0-49c4-9e45-790a32188889'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:33:50.907038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e235ab89-3bfb-4a8d-905c-6a1e7466257d req-54c122aa-e631-4502-bc31-2ad70ab54f13 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:50.916170 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e235ab89-3bfb-4a8d-905c-6a1e7466257d req-54c122aa-e631-4502-bc31-2ad70ab54f13 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.7896216 May 12 15:33:50.919118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 2} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:50.924854 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:50.967690 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:50.974987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f953d65a-d83b-445c-948c-5ff234efa0f0 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:33:51.010252 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:51.111214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d9c125db-06c8-4dce-8164-eca057a5f187 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Synchronizing usage tracker for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:51.116187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68eb1553-c53d-4655-9c18-1a8eefe542f2 req-151612e9-638f-438e-ba93-8aadfb93261c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:51.117680 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-68eb1553-c53d-4655-9c18-1a8eefe542f2 req-151612e9-638f-438e-ba93-8aadfb93261c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.6944954 May 12 15:33:51.175324 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e235ab89-3bfb-4a8d-905c-6a1e7466257d req-5d7b2ac6-7fc5-41ca-b35c-7baaa1556f71 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2578990 May 12 15:33:51.365191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d9c125db-06c8-4dce-8164-eca057a5f187 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Unset dirty status for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:51.366307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port f292026e-8637-4cce-8dd8-0d910025804e yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:33:51.369447 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d9c125db-06c8-4dce-8164-eca057a5f187 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports?device_id=94c42552-82c0-49c4-9e45-790a32188889 HTTP/1.1" status: 200 len: 205 time: 0.6955340 May 12 15:33:51.369624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55002) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:51.382133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f953d65a-d83b-445c-948c-5ff234efa0f0 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:33:51.426722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f953d65a-d83b-445c-948c-5ff234efa0f0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:51.427148 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:51.459195 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-68eb1553-c53d-4655-9c18-1a8eefe542f2 req-a7a41341-0dfa-4a6b-9606-de73ca1b7cd4 service neutron] 10.222.0.84 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3265493 May 12 15:33:51.461557 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ca03bf8-4f3f-4df8-a10f-3c6bcacdd825 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/routers/2fa188d6-3ca1-4639-b0f4-363cad1672ab HTTP/1.1" status: 200 len: 908 time: 0.7093880 May 12 15:33:51.464504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55006) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:51.605759 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:51.627768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2fa188d6-3ca1-4639-b0f4-363cad1672ab', 'name': 'tempest-snat-router-1883683838', 'tenant_id': '281d0c58fa114694a3293de8c107204f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215'}], 'enable_snat': True}, 'gw_port_id': '2a912c75-5578-4ced-b5a5-84c237ad5205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:44Z', 'updated_at': '2022-05-12T15:33:47Z', 'revision_number': 3, 'project_id': '281d0c58fa114694a3293de8c107204f', 'gw_port': {'id': '2a912c75-5578-4ced-b5a5-84c237ad5205', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f3:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2fa188d6-3ca1-4639-b0f4-363cad1672ab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2595, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:33:46Z', 'updated_at': '2022-05-12T15:33:46Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:51.636032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Checking router: 2fa188d6-3ca1-4639-b0f4-363cad1672ab for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:33:51.636532 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Updating router 2fa188d6-3ca1-4639-b0f4-363cad1672ab port 2a912c75-5578-4ced-b5a5-84c237ad5205 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:33:51.670663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port f953d65a-d83b-445c-948c-5ff234efa0f0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f953d65a-d83b-445c-948c-5ff234efa0f0,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:51.679248 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:51.712305 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-68eb1553-c53d-4655-9c18-1a8eefe542f2 req-13a83bfe-68f7-42dd-a3b0-418b77e97644 service neutron] 10.222.0.84 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1718760 May 12 15:33:51.782701 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:51.868098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=f953d65a-d83b-445c-948c-5ff234efa0f0,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:51.934158 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.011907 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-869e1de1-343c-4fe4-aadd-f1139f6f544c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.186625 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.209686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Deleting port 2a912c75-5578-4ced-b5a5-84c237ad5205 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:52.213422 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.225748 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.239742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Transition to ACTIVE for port object 2a912c75-5578-4ced-b5a5-84c237ad5205 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:33:52.248314 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.417923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Attempting to bind port 2a912c75-5578-4ced-b5a5-84c237ad5205 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:33:52.418299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Attempting to bind port 2a912c75-5578-4ced-b5a5-84c237ad5205 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:33:52.418688 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Attempting to bind port 2a912c75-5578-4ced-b5a5-84c237ad5205 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:33:52.434704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 33, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:33:52.435800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:33:52.436300 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.436787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:33:52.437208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Bound port: 2a912c75-5578-4ced-b5a5-84c237ad5205, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:33:52.437641 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.470979 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.515888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8228066d-c480-45cd-adbb-f369b999df59 None None] Pushing event updated for resources: {'Port': ['ID=2a912c75-5578-4ced-b5a5-84c237ad5205,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:52.527510 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-869e1de1-343c-4fe4-aadd-f1139f6f544c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.530407 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-869e1de1-343c-4fe4-aadd-f1139f6f544c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.536776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] For port 2a912c75-5578-4ced-b5a5-84c237ad5205, host n-d-841483-1, got binding levels [] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:52.537222 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.561255 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] For port 2a912c75-5578-4ced-b5a5-84c237ad5205, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:33:52.570333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] For port 2a912c75-5578-4ced-b5a5-84c237ad5205, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2a912c75-5578-4ced-b5a5-84c237ad5205,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:33:52.579050 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.608831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-869e1de1-343c-4fe4-aadd-f1139f6f544c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.609352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-869e1de1-343c-4fe4-aadd-f1139f6f544c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Fanout notify agent at l3_agent the message router_deleted on router 94c42552-82c0-49c4-9e45-790a32188889 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:33:52.674743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Routers {'2fa188d6-3ca1-4639-b0f4-363cad1672ab'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:33:52.676518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2fa188d6-3ca1-4639-b0f4-363cad1672ab'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:52.694601 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-869e1de1-343c-4fe4-aadd-f1139f6f544c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.694601 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-869e1de1-343c-4fe4-aadd-f1139f6f544c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/routers/94c42552-82c0-49c4-9e45-790a32188889 HTTP/1.1" status: 204 len: 168 time: 1.3161273 May 12 15:33:52.694601 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.711542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55034) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:52.720257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Calling delete_port for 2a912c75-5578-4ced-b5a5-84c237ad5205 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:52.825000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8228066d-c480-45cd-adbb-f369b999df59 None None] Pushing event updated for resources: {'Port': ['ID=2a912c75-5578-4ced-b5a5-84c237ad5205,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:52.829360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-ea1b6009-6bde-4b6f-8b9d-55fbfafbebc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting subnet 9380d3b7-d25f-4284-acd3-794270f1b2b2 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:33:52.834902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea1b6009-6bde-4b6f-8b9d-55fbfafbebc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.845888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d3ac0d-398b-40b6-a4cc-b9903f446fcd req-4b736464-4c7b-4fef-934a-dff1ef515d7f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:52.847400 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13d3ac0d-398b-40b6-a4cc-b9903f446fcd req-4b736464-4c7b-4fef-934a-dff1ef515d7f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.3726552 May 12 15:33:52.919048 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea1b6009-6bde-4b6f-8b9d-55fbfafbebc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:52.930461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port 9c174f4f-6158-4ad0-9176-9680f1b5a6e5 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:33:52.936699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13d3ac0d-398b-40b6-a4cc-b9903f446fcd req-2f654174-ec9b-457c-88e2-c9fae6904065 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0766041 May 12 15:33:52.941061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f953d65a-d83b-445c-948c-5ff234efa0f0 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:33:53.084081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] Set router 2fa188d6-3ca1-4639-b0f4-363cad1672ab gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:33:53.205520 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2fa188d6-3ca1-4639-b0f4-363cad1672ab', 'name': 'tempest-snat-router-1883683838', 'tenant_id': '281d0c58fa114694a3293de8c107204f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:44Z', 'updated_at': '2022-05-12T15:33:52Z', 'revision_number': 4, 'project_id': '281d0c58fa114694a3293de8c107204f', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:53.211510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8cecafc3-ed60-402a-a5f7-68c9d873d111 None None] The sync data for ids ['2fa188d6-3ca1-4639-b0f4-363cad1672ab'] in n-d-841483-1 is: [{'id': '2fa188d6-3ca1-4639-b0f4-363cad1672ab', 'name': 'tempest-snat-router-1883683838', 'tenant_id': '281d0c58fa114694a3293de8c107204f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:44Z', 'updated_at': '2022-05-12T15:33:52Z', 'revision_number': 4, 'project_id': '281d0c58fa114694a3293de8c107204f', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:33:53.222601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f953d65a-d83b-445c-948c-5ff234efa0f0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:33:53.222974 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:53.224998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:33:53.225937 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:33:53.340578 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea1b6009-6bde-4b6f-8b9d-55fbfafbebc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:53.451192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:53.470120 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea1b6009-6bde-4b6f-8b9d-55fbfafbebc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:53.523528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea1b6009-6bde-4b6f-8b9d-55fbfafbebc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Subnet': ['ID=9380d3b7-d25f-4284-acd3-794270f1b2b2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:53.527710 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea1b6009-6bde-4b6f-8b9d-55fbfafbebc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:53.533556 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:53.537954 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ea1b6009-6bde-4b6f-8b9d-55fbfafbebc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/9380d3b7-d25f-4284-acd3-794270f1b2b2 HTTP/1.1" status: 204 len: 168 time: 0.8260086 May 12 15:33:53.540329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55050) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:53.540696 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66349777-e498-4b6f-9f90-c8e744c4775c None None] Network dc51c982-90df-4f69-aa9e-1a2187873260 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:33:53.587627 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:53.636979 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:53.676469 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:53.698889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port c2731109-6365-4a9c-a1b8-9234d2443c63 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:53.699242 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:53.735147 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Deleting port 2a912c75-5578-4ced-b5a5-84c237ad5205 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:53.735496 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:53.755812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:53.761157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:53.769000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:53.769845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:53.785712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=f292026e-8637-4cce-8dd8-0d910025804e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:53.961820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-219cc1f9-449a-4e0e-9a42-e5ed98790659 None None] DHCP port deletion for dc51c982-90df-4f69-aa9e-1a2187873260 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:33:53.969004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-219cc1f9-449a-4e0e-9a42-e5ed98790659 None None] Deleting port c2731109-6365-4a9c-a1b8-9234d2443c63 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:53.970193 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-219cc1f9-449a-4e0e-9a42-e5ed98790659 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:54.035425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=9c174f4f-6158-4ad0-9176-9680f1b5a6e5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:54.061977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Checking segment: {'id': 'eefd0f25-9356-4cc9-a059-6573ac20a798', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 555, 'network_id': '19877065-a43f-437e-803f-da7dbeb64c6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:33:54.062365 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network hostable DHCP agents. Network: 19877065-a43f-437e-803f-da7dbeb64c6c, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:33:54.085877 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:54.148271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] For port 2a912c75-5578-4ced-b5a5-84c237ad5205, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2a912c75-5578-4ced-b5a5-84c237ad5205,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:54.148723 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:54.164019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] For port c2731109-6365-4a9c-a1b8-9234d2443c63, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c2731109-6365-4a9c-a1b8-9234d2443c63,segment=NetworkSegment(122c8b48-deb8-434d-8a88-45d21d1437de),segment_id=122c8b48-deb8-434d-8a88-45d21d1437de)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:54.164470 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:54.317243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 19877065-a43f-437e-803f-da7dbeb64c6c is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:33:54.393652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-219cc1f9-449a-4e0e-9a42-e5ed98790659 None None] For port c2731109-6365-4a9c-a1b8-9234d2443c63, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c2731109-6365-4a9c-a1b8-9234d2443c63,segment=NetworkSegment(122c8b48-deb8-434d-8a88-45d21d1437de),segment_id=122c8b48-deb8-434d-8a88-45d21d1437de)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:54.394042 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-219cc1f9-449a-4e0e-9a42-e5ed98790659 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:54.420650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Calling delete_port for 2a912c75-5578-4ced-b5a5-84c237ad5205 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:54.520678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for c2731109-6365-4a9c-a1b8-9234d2443c63 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:54.569911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 19877065-a43f-437e-803f-da7dbeb64c6c) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:54.576206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:54.584416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:54.589502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:54.590489 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:54.601866 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:54.603614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-219cc1f9-449a-4e0e-9a42-e5ed98790659 None None] Calling delete_port for c2731109-6365-4a9c-a1b8-9234d2443c63 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:54.606525 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:54.641446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-589f15bc-ea4b-4230-b84c-f856809ea191 None None] Network 19877065-a43f-437e-803f-da7dbeb64c6c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:33:54.652176 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f14e95f3-a99f-43f2-a65f-af3a1e600224 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 4.3941925 May 12 15:33:54.655071 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55070) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:54.693338 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:54.693564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 06a65548-179d-4c02-ae2a-b0c8b88f23ea {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:33:54.740710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d6d63be-7486-4890-99b1-fa5c1df4ac7d req-a21147b4-db79-4174-ab65-9f4f620ccb85 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:54.742259 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d6d63be-7486-4890-99b1-fa5c1df4ac7d req-a21147b4-db79-4174-ab65-9f4f620ccb85 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.4260142 May 12 15:33:54.745961 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:54.754523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:54.801377 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] create failed (client error): There was a conflict when trying to complete your request. May 12 15:33:54.803528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a7c26f93-e54c-4bd4-87b4-a4dc66de1994 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 409 len: 371 time: 4.1342554 May 12 15:33:54.811322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55078) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:54.817448 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3747c5a9-e6de-4add-b93a-4e7a52b87c35 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 9c174f4f-6158-4ad0-9176-9680f1b5a6e5 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:54.817794 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3747c5a9-e6de-4add-b93a-4e7a52b87c35 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:54.852133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event deleted for resources: {'Port': ['ID=2a912c75-5578-4ced-b5a5-84c237ad5205,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:54.879137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c2731109-6365-4a9c-a1b8-9234d2443c63 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:33:54.921094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No DVR routers for this DVR port c2731109-6365-4a9c-a1b8-9234d2443c63 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:33:54.933573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=c2731109-6365-4a9c-a1b8-9234d2443c63,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:55.017993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: c2731109-6365-4a9c-a1b8-9234d2443c63 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:33:55.018543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c2731109-6365-4a9c-a1b8-9234d2443c63 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:33:55.063370 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-219cc1f9-449a-4e0e-9a42-e5ed98790659 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:33:55.063705 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-219cc1f9-449a-4e0e-9a42-e5ed98790659 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:33:55.118034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d6d63be-7486-4890-99b1-fa5c1df4ac7d req-f983cb4e-d1a7-434b-aeee-ffe780d5e139 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3590848 May 12 15:33:55.158913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-0c935e24-53a2-4cbb-ba32-533529d45925 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Deleting port ddbf2c01-a0d6-43e7-8ae1-9cce986fd090 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:55.159326 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0c935e24-53a2-4cbb-ba32-533529d45925 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.218027 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.240267 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3747c5a9-e6de-4add-b93a-4e7a52b87c35 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.269753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.425931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dc51c982-90df-4f69-aa9e-1a2187873260']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:55.433932 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.438690 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.443917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '122c8b48-deb8-434d-8a88-45d21d1437de') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:55.444212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '122c8b48-deb8-434d-8a88-45d21d1437de') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:55.467828 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.487455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.492333 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.492812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 2fa188d6-3ca1-4639-b0f4-363cad1672ab {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:33:55.498864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Releasing vlan 589 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:33:55.499265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: timer() May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:33:55.516266 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:33:55.542449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3747c5a9-e6de-4add-b93a-4e7a52b87c35 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for 9c174f4f-6158-4ad0-9176-9680f1b5a6e5 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:55.565100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-219cc1f9-449a-4e0e-9a42-e5ed98790659 None None] Deleting port c2731109-6365-4a9c-a1b8-9234d2443c63 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:55.565517 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-219cc1f9-449a-4e0e-9a42-e5ed98790659 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.613691 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.617759 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-48c22cd0-c927-495f-94d1-1940f68630d9 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "DELETE /v2.0/routers/2fa188d6-3ca1-4639-b0f4-363cad1672ab HTTP/1.1" status: 204 len: 168 time: 4.1520636 May 12 15:33:55.619117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55092) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:55.719269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.755638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-219cc1f9-449a-4e0e-9a42-e5ed98790659 None None] The port 'c2731109-6365-4a9c-a1b8-9234d2443c63' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:33:55.756371 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.777328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Network': ['ID=dc51c982-90df-4f69-aa9e-1a2187873260,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:55.782757 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-63128716-57b7-4949-b1e0-5087849d9046 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/networks/dc51c982-90df-4f69-aa9e-1a2187873260 HTTP/1.1" status: 204 len: 168 time: 2.2412994 May 12 15:33:55.837213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55096) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:55.861553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-13e60934-d5c1-477d-a036-5e37adc999e9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1048475578', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:55.884521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-13e60934-d5c1-477d-a036-5e37adc999e9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:55.893887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-13e60934-d5c1-477d-a036-5e37adc999e9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:router and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:55.900667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-13e60934-d5c1-477d-a036-5e37adc999e9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:55.912343 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.922187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-13e60934-d5c1-477d-a036-5e37adc999e9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:55.928494 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0c935e24-53a2-4cbb-ba32-533529d45925 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:55.938640 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3747c5a9-e6de-4add-b93a-4e7a52b87c35 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.071548 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3747c5a9-e6de-4add-b93a-4e7a52b87c35 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.135462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3747c5a9-e6de-4add-b93a-4e7a52b87c35 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/9c174f4f-6158-4ad0-9176-9680f1b5a6e5 HTTP/1.1" status: 204 len: 168 time: 1.4791367 May 12 15:33:56.146487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-0c935e24-53a2-4cbb-ba32-533529d45925 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Calling delete_port for ddbf2c01-a0d6-43e7-8ae1-9cce986fd090 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:56.174327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3747c5a9-e6de-4add-b93a-4e7a52b87c35 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=9c174f4f-6158-4ad0-9176-9680f1b5a6e5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:56.176314 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-13e60934-d5c1-477d-a036-5e37adc999e9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.177589 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-13e60934-d5c1-477d-a036-5e37adc999e9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.190212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55108) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:56.208507 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.221821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Deleting port f953d65a-d83b-445c-948c-5ff234efa0f0 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:56.222430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.331542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-13e60934-d5c1-477d-a036-5e37adc999e9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.392938 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-13e60934-d5c1-477d-a036-5e37adc999e9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.430584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] For port f953d65a-d83b-445c-948c-5ff234efa0f0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f953d65a-d83b-445c-948c-5ff234efa0f0,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:33:56.431251 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.469332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a783b08-3601-44c7-9811-9cb3983ad3f2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:56.475176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a783b08-3601-44c7-9811-9cb3983ad3f2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:56.475945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4a783b08-3601-44c7-9811-9cb3983ad3f2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:33:56.502209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a562845-74b8-4d7a-90b4-24e7eaa026d5 req-5f2d423b-004d-43ae-b337-89aa2cefa1cf tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:56.505356 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a562845-74b8-4d7a-90b4-24e7eaa026d5 req-5f2d423b-004d-43ae-b337-89aa2cefa1cf tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.2636244 May 12 15:33:56.513795 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-13e60934-d5c1-477d-a036-5e37adc999e9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.518340 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-13e60934-d5c1-477d-a036-5e37adc999e9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.6749504 May 12 15:33:56.532535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55116) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:56.552289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-976663842'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:56.563286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4a783b08-3601-44c7-9811-9cb3983ad3f2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:33:56.564491 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4a783b08-3601-44c7-9811-9cb3983ad3f2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1452 time: 0.3730953 May 12 15:33:56.567313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55124) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:56.575378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:56.580847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Calling delete_port for f953d65a-d83b-445c-948c-5ff234efa0f0 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:56.583623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:network and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:56.588153 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0c935e24-53a2-4cbb-ba32-533529d45925 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.590039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:56.631372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a562845-74b8-4d7a-90b4-24e7eaa026d5 req-c1332eac-3986-4066-b2c1-c341b73d3796 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1192987 May 12 15:33:56.632288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:56.658557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c935e24-53a2-4cbb-ba32-533529d45925 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Pushing event deleted for resources: {'Port': ['ID=ddbf2c01-a0d6-43e7-8ae1-9cce986fd090,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:56.705347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:56.709255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.731367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-5b0d13ff-5976-491d-8344-492c5abfe197 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port f292026e-8637-4cce-8dd8-0d910025804e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:33:56.732217 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b0d13ff-5976-491d-8344-492c5abfe197 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.796457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 582} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:33:56.806582 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0c935e24-53a2-4cbb-ba32-533529d45925 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.814400 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.814744 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Added segment f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d of type vlan for network 8a5a9f45-ac98-4364-8fcd-e150e523be55 May 12 15:33:56.821489 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0c935e24-53a2-4cbb-ba32-533529d45925 tempest-RoutersAdminNegativeTest-555193936 tempest-RoutersAdminNegativeTest-555193936-project-admin] 10.222.0.82 "DELETE /v2.0/ports/ddbf2c01-a0d6-43e7-8ae1-9cce986fd090 HTTP/1.1" status: 204 len: 168 time: 2.0087006 May 12 15:33:56.853931 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.901261 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:56.908822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:56.909875 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:57.026370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.4910302 May 12 15:33:57.029291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55134) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:57.038998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'subnet': {'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:57.058190 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55e2f638-282a-4791-9974-6823d0066846 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Network': ['ID=8a5a9f45-ac98-4364-8fcd-e150e523be55,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:57.071786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 8a5a9f45-ac98-4364-8fcd-e150e523be55 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:33:57.228055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:57.277137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55146) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:57.387374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event deleted for resources: {'Port': ['ID=f953d65a-d83b-445c-948c-5ff234efa0f0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:57.392462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:57.400435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:subnet and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:57.423820 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-16ff1bec-3e0c-4502-b15c-33bb04915b42 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:57.428265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:57.452869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:57.455400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-16ff1bec-3e0c-4502-b15c-33bb04915b42 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:57.459666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-16ff1bec-3e0c-4502-b15c-33bb04915b42 admin admin] Usage tracker for resource:security_group_rule and tenant:2fbf91c5d85348f89af257006358d014 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:57.462657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-16ff1bec-3e0c-4502-b15c-33bb04915b42 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:57.470186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-16ff1bec-3e0c-4502-b15c-33bb04915b42 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:57.487885 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b0d13ff-5976-491d-8344-492c5abfe197 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:57.568365 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-16ff1bec-3e0c-4502-b15c-33bb04915b42 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:57.572633 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-16ff1bec-3e0c-4502-b15c-33bb04915b42 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:57.641308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-5b0d13ff-5976-491d-8344-492c5abfe197 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for f292026e-8637-4cce-8dd8-0d910025804e owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:33:57.646535 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-16ff1bec-3e0c-4502-b15c-33bb04915b42 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2fbf91c5d85348f89af257006358d014&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3679137 May 12 15:33:57.647335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55156) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:57.648014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16ff1bec-3e0c-4502-b15c-33bb04915b42 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6232b96a-ae1e-4792-9be4-315248ac3782,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:57.669583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:57.673058 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:57.725353 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7ef866c6-a4f7-4ff6-ac38-fcee75cee3e7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:57.760954 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7ef866c6-a4f7-4ff6-ac38-fcee75cee3e7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:57.809360 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:57.892573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad105f91-8023-4039-952f-53f1d0d89b60 req-e2000a16-b21e-4d4f-a436-7b08d22ce923 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:57.894310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad105f91-8023-4039-952f-53f1d0d89b60 req-e2000a16-b21e-4d4f-a436-7b08d22ce923 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.1092443 May 12 15:33:57.895808 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7ef866c6-a4f7-4ff6-ac38-fcee75cee3e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:58.033615 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:58.037370 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:58.048953 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b0d13ff-5976-491d-8344-492c5abfe197 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:58.058857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ef866c6-a4f7-4ff6-ac38-fcee75cee3e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6232b96a-ae1e-4792-9be4-315248ac3782,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:58.075350 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7ef866c6-a4f7-4ff6-ac38-fcee75cee3e7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:58.077746 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7ef866c6-a4f7-4ff6-ac38-fcee75cee3e7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6232b96a-ae1e-4792-9be4-315248ac3782 HTTP/1.1" status: 204 len: 168 time: 0.4257343 May 12 15:33:58.091897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad105f91-8023-4039-952f-53f1d0d89b60 req-0325d286-1e63-40aa-9db9-f660db21df82 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1830580 May 12 15:33:58.118282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b0d13ff-5976-491d-8344-492c5abfe197 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=f292026e-8637-4cce-8dd8-0d910025804e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:58.129667 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b0d13ff-5976-491d-8344-492c5abfe197 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:58.172023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:58.172553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 1a964780-957d-47f2-b4b7-5aa21585eb40 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:33:58.269555 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5b0d13ff-5976-491d-8344-492c5abfe197 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/f292026e-8637-4cce-8dd8-0d910025804e HTTP/1.1" status: 204 len: 168 time: 1.7011042 May 12 15:33:58.272059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55176) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:58.274345 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:58.275792 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4f8ae591-cde6-4abc-8436-c392e415e434 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "DELETE /v2.0/routers/1a964780-957d-47f2-b4b7-5aa21585eb40 HTTP/1.1" status: 204 len: 168 time: 2.6557672 May 12 15:33:58.281266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55180) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:58.288128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-923339549', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:58.297467 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:58.306212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:58.409413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Usage tracker for resource:router and tenant:b68c8c6134e345c4b780c4a4abc4688f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:58.428293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:58.449538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a11a75bc-357a-48de-9b0d-2386fb9ee803 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:58.451157 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4030d056-6b12-4596-8bb8-7cbd613fb9c0 req-f76f4b72-cce5-4340-8248-d99922004592 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0905509 May 12 15:33:58.455737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:58.459603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a11a75bc-357a-48de-9b0d-2386fb9ee803 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 0.1862278 May 12 15:33:58.460231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55190) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:58.490181 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Subnet': ['ID=88b72322-9e80-4b80-a94e-362cee47e638,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:58.493294 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:58.495286 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:58.519011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Checking segment: {'id': 'f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 582, 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:33:58.519448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network hostable DHCP agents. Network: 8a5a9f45-ac98-4364-8fcd-e150e523be55, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:33:58.547682 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:58.548975 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-7415fde1-5752-4ae2-9605-1db61f020a8a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] GET failed (client error): The resource could not be found. May 12 15:33:58.551491 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7415fde1-5752-4ae2-9605-1db61f020a8a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/9c174f4f-6158-4ad0-9176-9680f1b5a6e5 HTTP/1.1" status: 404 len: 333 time: 0.0901372 May 12 15:33:58.555589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55196) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:58.607392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55200) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:58.637094 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-23cf2b8d-5263-4fe3-a49e-04fc7c8c9425 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] GET failed (client error): The resource could not be found. May 12 15:33:58.640017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-23cf2b8d-5263-4fe3-a49e-04fc7c8c9425 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/f292026e-8637-4cce-8dd8-0d910025804e HTTP/1.1" status: 404 len: 333 time: 0.0829642 May 12 15:33:58.643751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55204) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:58.730829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 8a5a9f45-ac98-4364-8fcd-e150e523be55 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:33:58.749269 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4030d056-6b12-4596-8bb8-7cbd613fb9c0 req-785fc468-2cad-4cb3-8038-6a042c911b97 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.1880951 May 12 15:33:58.762128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 8a5a9f45-ac98-4364-8fcd-e150e523be55) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:58.772372 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-368ba500-2d52-4c3a-b875-818b1ceb2ae9 None None] Network 8a5a9f45-ac98-4364-8fcd-e150e523be55 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:33:58.837343 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-afa29bae-7586-4de7-a6b6-adc54e8b9f68 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=833b98ea5d9145a8b7bf888bab638d27&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2279341 May 12 15:33:58.843291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55208) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:58.867347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:58.868077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:58.893825 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:58.984270 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4030d056-6b12-4596-8bb8-7cbd613fb9c0 req-b4c084e0-5ada-44a0-a8d7-52df19045a17 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.2035518 May 12 15:33:59.022354 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f953d65a-d83b-445c-948c-5ff234efa0f0 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:33:59.069246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: f953d65a-d83b-445c-948c-5ff234efa0f0 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:33:59.070116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f953d65a-d83b-445c-948c-5ff234efa0f0 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:33:59.113581 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.131242 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d142340-e636-4fbf-b2af-79a47d2ac067 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.144194 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-8a5a9f45-ac98-4364-8fcd-e150e523be55', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:33:59.145132 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.176600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['19877065-a43f-437e-803f-da7dbeb64c6c']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:59.205852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'eefd0f25-9356-4cc9-a059-6573ac20a798') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:59.206232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'eefd0f25-9356-4cc9-a059-6573ac20a798') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:33:59.226307 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d142340-e636-4fbf-b2af-79a47d2ac067 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.245736 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.283539 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4b6d1e8d-9d08-4dbd-bdc3-c1727b86c977 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.2526739 May 12 15:33:59.301290 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.311443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Releasing vlan 555 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:33:59.312722 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.347966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55216) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: timer() May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:33:59.398238 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:33:59.438854 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.442982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4030d056-6b12-4596-8bb8-7cbd613fb9c0 req-70844a79-57b0-4da3-aa74-6362651e19f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:59.444914 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4030d056-6b12-4596-8bb8-7cbd613fb9c0 req-70844a79-57b0-4da3-aa74-6362651e19f8 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4432487 May 12 15:33:59.457965 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Allocated IP 2001:db8::2 (8a5a9f45-ac98-4364-8fcd-e150e523be55/88b72322-9e80-4b80-a94e-362cee47e638/5796cd60-4096-4bd3-8732-71b8f22806a2) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:33:59.528046 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.568139 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.592418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Network': ['ID=19877065-a43f-437e-803f-da7dbeb64c6c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:59.605848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/networks/19877065-a43f-437e-803f-da7dbeb64c6c HTTP/1.1" status: 204 len: 168 time: 0.9606810 May 12 15:33:59.611506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:59.612112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:59.612875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:59.613419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:59.613943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:59.614450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:59.615014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:59.615517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:59.616020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:59.616651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:59.617176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:59.617710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8955221a-6427-4073-bcca-a37cf6cce485 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:33:59.621073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55220) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:33:59.629014 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d142340-e636-4fbf-b2af-79a47d2ac067 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.631835 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d142340-e636-4fbf-b2af-79a47d2ac067 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.633471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2d142340-e636-4fbf-b2af-79a47d2ac067 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/524a39ab-4f15-49e3-a243-6afa0708f1fd HTTP/1.1" status: 204 len: 168 time: 0.7886069 May 12 15:33:59.644301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1309659045'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:33:59.690337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84a1de0f-fb96-447f-a8ff-82019ac6223a req-36035c6f-e42b-4c37-afc3-3a28abcdc57a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:59.691649 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-84a1de0f-fb96-447f-a8ff-82019ac6223a req-36035c6f-e42b-4c37-afc3-3a28abcdc57a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.2854257 May 12 15:33:59.694304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:33:59.697792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d142340-e636-4fbf-b2af-79a47d2ac067 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=524a39ab-4f15-49e3-a243-6afa0708f1fd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:33:59.704991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:network and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:33:59.721691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:33:59.733804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:33:59.761431 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.769765 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-84a1de0f-fb96-447f-a8ff-82019ac6223a req-223f4052-5b88-4780-b825-540cc989b143 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693555 May 12 15:33:59.770905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:33:59.775119 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.796030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Transition to ACTIVE for port object 5796cd60-4096-4bd3-8732-71b8f22806a2 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:33:59.819616 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 571} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:33:59.830976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Transition to ACTIVE for port object 5796cd60-4096-4bd3-8732-71b8f22806a2 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:33:59.836679 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.836930 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Added segment 38ba73a2-67f0-4888-aa72-81b039c09709 of type vlan for network 81285269-acc7-414c-b6ee-d994531d7e18 May 12 15:33:59.841859 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.882722 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.908210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Network 8a5a9f45-ac98-4364-8fcd-e150e523be55 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:33:59.931132 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.941190 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:33:59.942059 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:33:59.968516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:33:59.973717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:33:59.976481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Pushing event updated for resources: {'Port': ['ID=5796cd60-4096-4bd3-8732-71b8f22806a2,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:00.100148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Attempting to bind port 5796cd60-4096-4bd3-8732-71b8f22806a2 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:34:00.100616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Attempting to bind port 5796cd60-4096-4bd3-8732-71b8f22806a2 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 582, 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:34:00.101091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Attempting to bind port 5796cd60-4096-4bd3-8732-71b8f22806a2 on network 8a5a9f45-ac98-4364-8fcd-e150e523be55 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:00.108983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 33, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:34:00.109968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Checking segment: {'id': 'f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 582, 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:00.110506 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:00.111010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Bound using segment: {'id': 'f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 582, 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:34:00.111671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Bound port: 5796cd60-4096-4bd3-8732-71b8f22806a2, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 582, 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:34:00.112274 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:00.144278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Network': ['ID=81285269-acc7-414c-b6ee-d994531d7e18,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:00.173764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 81285269-acc7-414c-b6ee-d994531d7e18 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:34:00.174464 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f115f0ca-b9ae-48f7-a54c-7173e94559a5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.5499940 May 12 15:34:00.175767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55228) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:00.192162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': '81285269-acc7-414c-b6ee-d994531d7e18', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.2', 'end': '172.20.0.14'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:00.295926 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:00.398228 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b9de0192-7be9-431c-b249-72dc370997de None None] For port 5796cd60-4096-4bd3-8732-71b8f22806a2, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:34:00.406679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b9de0192-7be9-431c-b249-72dc370997de None None] For port 5796cd60-4096-4bd3-8732-71b8f22806a2, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5796cd60-4096-4bd3-8732-71b8f22806a2,segment=NetworkSegment(f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d),segment_id=f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:34:00.414666 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:00.423288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:00.428732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:00.431826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:00.440482 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:00.455057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:00.467548 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:00.555732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9de0192-7be9-431c-b249-72dc370997de None None] Pushing event updated for resources: {'Port': ['ID=5796cd60-4096-4bd3-8732-71b8f22806a2,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:00.620499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.ipam_backend_mixin [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Performing IP validity checks on allocation pools {{(pid=88152) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:314}} May 12 15:34:00.621230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.ipam_backend_mixin [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Checking for overlaps among allocation pools and gateway ip {{(pid=88152) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:335}} May 12 15:34:00.838088 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:00.976566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55254) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:00.989431 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:01.028391 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:01.030075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Subnet': ['ID=c516f5d6-eb7f-49bd-b1af-9e2defbd2f64,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:01.040433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Checking segment: {'id': '38ba73a2-67f0-4888-aa72-81b039c09709', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '81285269-acc7-414c-b6ee-d994531d7e18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:01.040796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network hostable DHCP agents. Network: 81285269-acc7-414c-b6ee-d994531d7e18, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:34:01.079878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 81285269-acc7-414c-b6ee-d994531d7e18 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:34:01.094425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 81285269-acc7-414c-b6ee-d994531d7e18) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:01.098927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:01.099512 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:01.107184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-955fb0c5-450a-4c7f-998c-161f533ff156 None None] Network 81285269-acc7-414c-b6ee-d994531d7e18 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:01.120744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd52b951-b6e3-41e5-83d7-e68477ce5931 req-2b0ab046-8224-4741-91da-5a16b21189ba tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:01.122293 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd52b951-b6e3-41e5-83d7-e68477ce5931 req-2b0ab046-8224-4741-91da-5a16b21189ba tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.1730425 May 12 15:34:01.149772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f787d9e7-2704-4027-8dcd-7d9f032f426a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.9699068 May 12 15:34:01.150791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55260) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:01.158991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'network_id': '81285269-acc7-414c-b6ee-d994531d7e18', 'name': 'tempest-PortsTestJSON-1723464980'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:01.207312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'network': {'name': 'tempest-NetworksTestDHCPv6-test-network-966190020'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:01.236025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:01.299824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:network and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:01.320323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:01.342722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:01.416164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-81285269-acc7-414c-b6ee-d994531d7e18', 'network_id': '81285269-acc7-414c-b6ee-d994531d7e18', 'tenant_id': '9bd6beec65cd47b3a0febdc05aaed724', 'fixed_ips': [{'subnet_id': 'c516f5d6-eb7f-49bd-b1af-9e2defbd2f64'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:34:01.417133 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:01.418165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:01.426213 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:01.461637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Allocated IP 2001:db8::1 (8a5a9f45-ac98-4364-8fcd-e150e523be55/88b72322-9e80-4b80-a94e-362cee47e638/772d4b76-1bbf-41b5-a846-f4fb5eaef3c1) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:01.470222 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:01.501604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:01.504089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:01.507632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:port and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:01.511982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:01.516043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:security_group_rule and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:01.519427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:01.541938 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd52b951-b6e3-41e5-83d7-e68477ce5931 req-5e9cdb24-47bf-46c3-b887-8d96d7aae260 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4089925 May 12 15:34:01.542152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:01.554193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:01.563882 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:01.575025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Allocated IP 172.25.8.78 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/77aa9fbb-fb01-443a-afb3-6551d79b9cd2) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:01.578953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:01.620543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Allocated IP 172.20.0.2 (81285269-acc7-414c-b6ee-d994531d7e18/c516f5d6-eb7f-49bd-b1af-9e2defbd2f64/2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:01.620774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port 0d988954-d5bf-4819-bb44-9e670e76d34d yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:34:01.689569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:01.699083 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:01.721877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 553} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:34:01.732204 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:01.732917 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Added segment ce17b845-4503-482c-9dbc-c15a6259653f of type vlan for network 2447b094-d5d6-41ef-a146-2bf56f5399af May 12 15:34:01.856047 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:01.868799 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:01.874250 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Transition to ACTIVE for port object 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:01.906209 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Transition to ACTIVE for port object 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:01.913408 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:01.951468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'SecurityGroup': ['ID=808186e7-539e-4fad-bbd9-000462e21448,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:02.014859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Network 81285269-acc7-414c-b6ee-d994531d7e18 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:02.016071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e69caf49-7367-4e3c-8575-3494e58815b2 None None] Network 8a5a9f45-ac98-4364-8fcd-e150e523be55 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:02.038878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:02.039282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Allocated IP 172.20.0.3 (81285269-acc7-414c-b6ee-d994531d7e18/c516f5d6-eb7f-49bd-b1af-9e2defbd2f64/0d988954-d5bf-4819-bb44-9e670e76d34d) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:02.046366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:02.059618 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:02.065263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:02.065794 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:02.076582 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:02.261167 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:02.296531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Transition to ACTIVE for port object 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:02.300014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Pushing event updated for resources: {'Port': ['ID=2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:02.315078 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:02.316628 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:02.333822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Transition to ACTIVE for port object 0d988954-d5bf-4819-bb44-9e670e76d34d will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:02.362290 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:02.397414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Network': ['ID=2447b094-d5d6-41ef-a146-2bf56f5399af,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:02.432199 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b8f806ec-a840-48c1-a8ec-e0c4b068b337 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 1.4488709 May 12 15:34:02.432199 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:02.433253 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55278) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:02.435388 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:02.438452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:02.442122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:02.468221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:34:02.498922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Pushing event updated for resources: {'Port': ['ID=77aa9fbb-fb01-443a-afb3-6551d79b9cd2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:02.567237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 81285269-acc7-414c-b6ee-d994531d7e18 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:02.582755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:02.601211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:02.611199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fc17f576-f016-4a52-a8fb-da15a987d544 None None] Provisioning for port 5796cd60-4096-4bd3-8732-71b8f22806a2 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:02.611976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:02.618479 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:02.622489 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Attempting to bind port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:34:02.622857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Attempting to bind port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '38ba73a2-67f0-4888-aa72-81b039c09709', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '81285269-acc7-414c-b6ee-d994531d7e18'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:34:02.623371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Attempting to bind port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c on network 81285269-acc7-414c-b6ee-d994531d7e18 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:02.631284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 33, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:34:02.631705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Checking segment: {'id': '38ba73a2-67f0-4888-aa72-81b039c09709', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '81285269-acc7-414c-b6ee-d994531d7e18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:02.632054 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:02.632589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Bound using segment: {'id': '38ba73a2-67f0-4888-aa72-81b039c09709', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '81285269-acc7-414c-b6ee-d994531d7e18'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:34:02.633066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Bound port: 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '38ba73a2-67f0-4888-aa72-81b039c09709', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '81285269-acc7-414c-b6ee-d994531d7e18'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:34:02.633457 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:02.686191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:02.727048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:02.736838 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:02.741085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] For port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:34:02.744638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] For port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c,segment=NetworkSegment(38ba73a2-67f0-4888-aa72-81b039c09709),segment_id=38ba73a2-67f0-4888-aa72-81b039c09709)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:34:02.761584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:02.768893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=0d988954-d5bf-4819-bb44-9e670e76d34d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:02.774063 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:02.856991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:02.857798 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:02.884400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:02.892118 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:02.961055 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05c819f4-0c68-4d07-9ac6-4eaa2d50a156 None None] Pushing event updated for resources: {'Port': ['ID=2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:02.974575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5796cd60-4096-4bd3-8732-71b8f22806a2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:03.032411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f0817b8a-8776-4781-8aff-1d46aff8e9f6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.8804648 May 12 15:34:03.036789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55284) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:03.096493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 5796cd60-4096-4bd3-8732-71b8f22806a2 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:03.106343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 8a5a9f45-ac98-4364-8fcd-e150e523be55 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:03.107742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 5796cd60-4096-4bd3-8732-71b8f22806a2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:03.108144 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:03.120320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:03.155089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:03.155980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:03.188053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1675ef0-15de-4a85-a6da-7b5488fd7f50 req-57020897-b0d1-4964-acc7-38f8d8db3f8d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:03.190975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1675ef0-15de-4a85-a6da-7b5488fd7f50 req-57020897-b0d1-4964-acc7-38f8d8db3f8d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.4261909 May 12 15:34:03.201555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-73afde82-e584-4b36-8020-309b2435e1b3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 0d988954-d5bf-4819-bb44-9e670e76d34d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:03.202167 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73afde82-e584-4b36-8020-309b2435e1b3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:03.211613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=772d4b76-1bbf-41b5-a846-f4fb5eaef3c1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:03.467683 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:03.469538 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:03.476682 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:03.519215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 5796cd60-4096-4bd3-8732-71b8f22806a2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5796cd60-4096-4bd3-8732-71b8f22806a2,segment=NetworkSegment(f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d),segment_id=f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:03.524079 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:03.615191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ec8c59e2-5a9e-4a66-962a-5b0c5ba51892 None None] Provisioning complete for port 5796cd60-4096-4bd3-8732-71b8f22806a2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:03.615559 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ec8c59e2-5a9e-4a66-962a-5b0c5ba51892 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:03.652700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:03.653199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network hostable DHCP agents. Network: 2447b094-d5d6-41ef-a146-2bf56f5399af, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:34:03.677428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=5796cd60-4096-4bd3-8732-71b8f22806a2,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:03.722154 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1675ef0-15de-4a85-a6da-7b5488fd7f50 req-0f9baf84-cded-4bef-a7ec-2d23724bd4f0 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4383786 May 12 15:34:03.745935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=ff052fe9-77d5-4476-baff-4325901e1ad4,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:03.749993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:03.780621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:34:03.806143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 2447b094-d5d6-41ef-a146-2bf56f5399af) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:03.822240 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ec8c59e2-5a9e-4a66-962a-5b0c5ba51892 None None] Provisioning for port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:03.840033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ec8c59e2-5a9e-4a66-962a-5b0c5ba51892 None None] Provisioning complete for port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:03.842505 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ec8c59e2-5a9e-4a66-962a-5b0c5ba51892 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:03.861454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:03.862357 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:03.871243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-856c5c72-df2e-467c-bd64-19cbc94f9ccd None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:03.891442 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-aa95f293-50a7-4c80-8169-1919f7cc7263 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.4508555 May 12 15:34:03.899080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55288) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:03.908100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'name': 'tempest-NetworksTestDHCPv6-1110847279'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:03.995925 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ec8c59e2-5a9e-4a66-962a-5b0c5ba51892 None None] Port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:34:04.059028 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73afde82-e584-4b36-8020-309b2435e1b3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:04.174884 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2a26fdc6-a1ed-4b74-8819-e091af095b9a None None] Provisioning complete for port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:04.175336 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2a26fdc6-a1ed-4b74-8819-e091af095b9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:04.220568 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:04.260557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2a26fdc6-a1ed-4b74-8819-e091af095b9a None None] Port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:34:04.275097 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': 'ff052fe9-77d5-4476-baff-4325901e1ad4'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:34:04.276115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:04.374341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-73afde82-e584-4b36-8020-309b2435e1b3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for 0d988954-d5bf-4819-bb44-9e670e76d34d owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:04.530663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6bd40b70-82d8-4889-8d38-7fdf766c6944 None None] Network 81285269-acc7-414c-b6ee-d994531d7e18 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:04.551422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:04.588110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:port and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:04.597456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:04.612640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:04.632697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:04.640682 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:04.668101 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73afde82-e584-4b36-8020-309b2435e1b3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:04.707484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6d78a6f5-eccb-4d4d-bfa4-b15a345434f1 None None] Provisioning for port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:04.711183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Allocated IP 2001:db8::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/ff052fe9-77d5-4476-baff-4325901e1ad4/209a6200-7cc9-49c6-beec-7d0f27f87493) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:04.714079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 7037386d-9602-4ae9-8dd4-104969601bdc yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:34:04.767554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73afde82-e584-4b36-8020-309b2435e1b3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=0d988954-d5bf-4819-bb44-9e670e76d34d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:04.816549 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:04.824726 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:04.826182 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:04.964637 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73afde82-e584-4b36-8020-309b2435e1b3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:04.985803 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-73afde82-e584-4b36-8020-309b2435e1b3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/0d988954-d5bf-4819-bb44-9e670e76d34d HTTP/1.1" status: 204 len: 168 time: 1.9468384 May 12 15:34:04.986532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55296) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:05.033728 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-1e98b2cb-cfc4-4964-b340-ec467a4a60c6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] DELETE failed (client error): The resource could not be found. May 12 15:34:05.034207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1e98b2cb-cfc4-4964-b340-ec467a4a60c6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:34:05.038916 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1e98b2cb-cfc4-4964-b340-ec467a4a60c6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/0d988954-d5bf-4819-bb44-9e670e76d34d HTTP/1.1" status: 404 len: 333 time: 0.0499942 May 12 15:34:05.039552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55304) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:05.067548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Router ed4d7b30-4f35-4196-8456-3dbb630ecf8a is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:34:05.145113 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-c7407797-9157-439f-8f8f-a9dd70740570 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] GET failed (client error): The resource could not be found. May 12 15:34:05.149118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c7407797-9157-439f-8f8f-a9dd70740570 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:05.218104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c7407797-9157-439f-8f8f-a9dd70740570 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:05.222249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c7407797-9157-439f-8f8f-a9dd70740570 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/0d988954-d5bf-4819-bb44-9e670e76d34d HTTP/1.1" status: 404 len: 333 time: 0.1491861 May 12 15:34:05.222538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55308) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:05.272437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-846c4a73-ef15-450b-b32f-c7846ebfcc37 req-2a8c466a-47b0-406a-ae98-94612d6c1f07 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:05.279133 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:05.291000 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-846c4a73-ef15-450b-b32f-c7846ebfcc37 req-2a8c466a-47b0-406a-ae98-94612d6c1f07 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.3032155 May 12 15:34:05.304733 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Transition to ACTIVE for port object 209a6200-7cc9-49c6-beec-7d0f27f87493 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:05.339527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:05.355161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=772d4b76-1bbf-41b5-a846-f4fb5eaef3c1,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:05.398699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-846c4a73-ef15-450b-b32f-c7846ebfcc37 req-d762663b-3495-4098-bf1a-003542d13a7e tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1065407 May 12 15:34:05.416025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Transition to ACTIVE for port object 209a6200-7cc9-49c6-beec-7d0f27f87493 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:05.429358 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:05.530375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::2d0 (2447b094-d5d6-41ef-a146-2bf56f5399af/ff052fe9-77d5-4476-baff-4325901e1ad4/7037386d-9602-4ae9-8dd4-104969601bdc) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:05.646296 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:05.651323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:05.662822 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:05.675022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 8a5a9f45-ac98-4364-8fcd-e150e523be55 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:05.702970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:05.704981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Pushing event updated for resources: {'Port': ['ID=209a6200-7cc9-49c6-beec-7d0f27f87493,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:05.713053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-dea2ab53-ef95-4c87-8cca-8b888297e1aa tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting subnet c516f5d6-eb7f-49bd-b1af-9e2defbd2f64 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:34:05.751393 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:05.760905 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dea2ab53-ef95-4c87-8cca-8b888297e1aa tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:05.786481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:05.786852 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:05.822457 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:05.844466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object 7037386d-9602-4ae9-8dd4-104969601bdc will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:05.884501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Attempting to bind port 209a6200-7cc9-49c6-beec-7d0f27f87493 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:34:05.888408 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Attempting to bind port 209a6200-7cc9-49c6-beec-7d0f27f87493 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:34:05.888996 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Attempting to bind port 209a6200-7cc9-49c6-beec-7d0f27f87493 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:05.907578 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:05.910076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 33, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:34:05.910670 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:05.912703 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:05.913101 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:34:05.913621 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Bound port: 209a6200-7cc9-49c6-beec-7d0f27f87493, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:34:05.914058 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:05.970475 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dea2ab53-ef95-4c87-8cca-8b888297e1aa tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:06.014109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-48a8b42f-2ce7-4484-874d-b8c9c4416cc9 None None] Could not find standard attr ID for object 0d988954-d5bf-4819-bb44-9e670e76d34d. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:34:06.014425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=7037386d-9602-4ae9-8dd4-104969601bdc,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:06.032553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:06.034523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:06.041439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:06.067198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:06.068870 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:06.101888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8e6f1230-80e8-4988-a44d-66ab684f9d2f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 2.2012324 May 12 15:34:06.110145 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55316) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:06.110603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] For port 209a6200-7cc9-49c6-beec-7d0f27f87493, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:34:06.148638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] For port 209a6200-7cc9-49c6-beec-7d0f27f87493, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=209a6200-7cc9-49c6-beec-7d0f27f87493,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:34:06.163964 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:06.227607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67e4032b-e24c-4eca-b889-c5685705bf1e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:06.234503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67e4032b-e24c-4eca-b889-c5685705bf1e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:06.235231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-67e4032b-e24c-4eca-b889-c5685705bf1e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:06.270206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-67e4032b-e24c-4eca-b889-c5685705bf1e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:06.271966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-67e4032b-e24c-4eca-b889-c5685705bf1e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1669 time: 0.1607797 May 12 15:34:06.273703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-172d2ae6-a02d-417d-b3b8-ac1671674ba4 None None] Pushing event updated for resources: {'Port': ['ID=209a6200-7cc9-49c6-beec-7d0f27f87493,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:06.274606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55320) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:06.277011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:34:06.283467 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:06.301348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68b833c3-f812-4bc6-bacb-72f4ec3cc0f3 None None] Sync routers for ids ['ed4d7b30-4f35-4196-8456-3dbb630ecf8a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:34:06.329987 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:06.334437 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ed2d0620-1c48-4ec2-8e79-6219bc8b8373 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 8.0520256 May 12 15:34:06.337201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55324) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:06.352270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3fc0f3a4-7861-49a5-b974-44a7a5e2871d tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'enable_snat': False}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:06.356200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68b833c3-f812-4bc6-bacb-72f4ec3cc0f3 None None] Routers {'ed4d7b30-4f35-4196-8456-3dbb630ecf8a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:06.357601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-68b833c3-f812-4bc6-bacb-72f4ec3cc0f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ed4d7b30-4f35-4196-8456-3dbb630ecf8a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:06.444192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 397feb9b-2f46-4c79-af57-634897d5df53 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:34:06.478343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-48a7d13b-ad24-43a2-affd-9178d228694f None None] Provisioning complete for port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:06.478454 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48a7d13b-ad24-43a2-affd-9178d228694f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:06.516350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-68b833c3-f812-4bc6-bacb-72f4ec3cc0f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:06.541177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c,segment=NetworkSegment(38ba73a2-67f0-4888-aa72-81b039c09709),segment_id=38ba73a2-67f0-4888-aa72-81b039c09709)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:06.551826 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:06.553195 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5796cd60-4096-4bd3-8732-71b8f22806a2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:06.555420 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dea2ab53-ef95-4c87-8cca-8b888297e1aa tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:06.571737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d6c08c57-e58d-4e69-b84a-dffee4b40174 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port 7037386d-9602-4ae9-8dd4-104969601bdc {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:06.573245 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6c08c57-e58d-4e69-b84a-dffee4b40174 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:06.660450 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68b833c3-f812-4bc6-bacb-72f4ec3cc0f3 None None] Routers {'ed4d7b30-4f35-4196-8456-3dbb630ecf8a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:06.661108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dea2ab53-ef95-4c87-8cca-8b888297e1aa tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:06.661849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-68b833c3-f812-4bc6-bacb-72f4ec3cc0f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ed4d7b30-4f35-4196-8456-3dbb630ecf8a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:06.748121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-48a7d13b-ad24-43a2-affd-9178d228694f None None] Port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:34:06.795601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-68b833c3-f812-4bc6-bacb-72f4ec3cc0f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:06.796008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68b833c3-f812-4bc6-bacb-72f4ec3cc0f3 None None] The sync data for ids ['ed4d7b30-4f35-4196-8456-3dbb630ecf8a'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:34:06.826592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:06.847517 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 5796cd60-4096-4bd3-8732-71b8f22806a2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:06.848127 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:06.919724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb057408-1345-4fd5-b017-91e6dc101d66 None None] Network 81285269-acc7-414c-b6ee-d994531d7e18 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:06.928288 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dea2ab53-ef95-4c87-8cca-8b888297e1aa tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Subnet': ['ID=c516f5d6-eb7f-49bd-b1af-9e2defbd2f64,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:06.930480 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dea2ab53-ef95-4c87-8cca-8b888297e1aa tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:06.974061 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dea2ab53-ef95-4c87-8cca-8b888297e1aa tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/c516f5d6-eb7f-49bd-b1af-9e2defbd2f64 HTTP/1.1" status: 204 len: 168 time: 1.7358081 May 12 15:34:06.992143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55332) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:07.170746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15d3c794-8d3e-4993-a5eb-e71f6c663615 req-4a9bcfcb-56c0-41e9-a1c0-5f90c06d1c2b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:07.178672 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15d3c794-8d3e-4993-a5eb-e71f6c663615 req-4a9bcfcb-56c0-41e9-a1c0-5f90c06d1c2b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.3337560 May 12 15:34:07.251159 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15d3c794-8d3e-4993-a5eb-e71f6c663615 req-5bf8f04d-6928-483b-9c05-738e3f447a15 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0691981 May 12 15:34:07.302728 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6c08c57-e58d-4e69-b84a-dffee4b40174 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:07.402020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:34:07.416834 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Sync routers for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:34:07.430323 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-201c07c9-c7a9-4ed1-b620-c85a321e007f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.0719569 May 12 15:34:07.435383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55336) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:07.437950 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:07.438578 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:07.463034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1147434705'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:07.479405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60b951fb-4e5c-48a1-b77b-d512067494a9 None None] DHCP port deletion for 81285269-acc7-414c-b6ee-d994531d7e18 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:34:07.485947 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-60b951fb-4e5c-48a1-b77b-d512067494a9 None None] Deleting port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:07.486430 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-60b951fb-4e5c-48a1-b77b-d512067494a9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:07.493648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:07.637396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 209a6200-7cc9-49c6-beec-7d0f27f87493 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:07.712184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d6c08c57-e58d-4e69-b84a-dffee4b40174 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for 7037386d-9602-4ae9-8dd4-104969601bdc owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:07.784443 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:34:07.819772 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:07.846546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:network and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:07.864005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:07.871803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:08.047184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:08.052297 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.088316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:08.088877 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.118638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-60b951fb-4e5c-48a1-b77b-d512067494a9 None None] For port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c,segment=NetworkSegment(38ba73a2-67f0-4888-aa72-81b039c09709),segment_id=38ba73a2-67f0-4888-aa72-81b039c09709)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:08.119697 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-60b951fb-4e5c-48a1-b77b-d512067494a9 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.128031 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6c08c57-e58d-4e69-b84a-dffee4b40174 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.130961 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 209a6200-7cc9-49c6-beec-7d0f27f87493 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:08.256163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c08c57-e58d-4e69-b84a-dffee4b40174 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=7037386d-9602-4ae9-8dd4-104969601bdc,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:08.257140 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab5e6c6e-b07c-456f-b5dc-3fcaaf21ed0d None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:08.262961 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6c08c57-e58d-4e69-b84a-dffee4b40174 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.275332 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d6c08c57-e58d-4e69-b84a-dffee4b40174 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/7037386d-9602-4ae9-8dd4-104969601bdc HTTP/1.1" status: 204 len: 168 time: 1.9996448 May 12 15:34:08.277718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55346) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:08.283112 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-60b951fb-4e5c-48a1-b77b-d512067494a9 None None] Calling delete_port for 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:08.285269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fc0f3a4-7861-49a5-b974-44a7a5e2871d tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.329368 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:03Z', 'revision_number': 2, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:04Z', 'revision_number': 2, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:08.333369 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Checking router: 397feb9b-2f46-4c79-af57-634897d5df53 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:34:08.333824 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Updating router 397feb9b-2f46-4c79-af57-634897d5df53 port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:34:08.374244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 579} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:34:08.377292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91f8493d-2986-496d-8abf-e37d375a8b23 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:08.379590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91f8493d-2986-496d-8abf-e37d375a8b23 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:08.380627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-91f8493d-2986-496d-8abf-e37d375a8b23 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:08.395571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.396159 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Added segment 9eb20257-af83-41dc-b1ae-d8bb904b94c9 of type vlan for network 3c31163d-b39c-4c17-b3f6-91c5029a0605 May 12 15:34:08.406134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-91f8493d-2986-496d-8abf-e37d375a8b23 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:08.409315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-91f8493d-2986-496d-8abf-e37d375a8b23 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.1294415 May 12 15:34:08.411669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55350) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:08.416372 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.478678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6bfa361d-8b63-45e6-b823-6510bdab9da2 None None] Provisioning for port 209a6200-7cc9-49c6-beec-7d0f27f87493 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:08.519083 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.556010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-7a845c54-3b29-46e6-bcaa-2bf42b39959f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet ff052fe9-77d5-4476-baff-4325901e1ad4 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:34:08.557121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6bfa361d-8b63-45e6-b823-6510bdab9da2 None None] Provisioning complete for port 209a6200-7cc9-49c6-beec-7d0f27f87493 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:08.557462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6bfa361d-8b63-45e6-b823-6510bdab9da2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.560566 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a845c54-3b29-46e6-bcaa-2bf42b39959f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.634806 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a845c54-3b29-46e6-bcaa-2bf42b39959f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.660609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd45627-fb7e-4c31-8576-0eb1e9aadab8 req-4da91f6f-76e5-47c4-aba7-3b7f7ccc4f0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:08.662605 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3dd45627-fb7e-4c31-8576-0eb1e9aadab8 req-4da91f6f-76e5-47c4-aba7-3b7f7ccc4f0a service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 1096 time: 0.5208411 May 12 15:34:08.693758 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b9cf0ac-b73a-44d7-969d-86ba8225d795 req-35c690aa-8e98-4791-827f-231c11249f3c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:08.696183 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b9cf0ac-b73a-44d7-969d-86ba8225d795 req-35c690aa-8e98-4791-827f-231c11249f3c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.2307427 May 12 15:34:08.723655 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-60b951fb-4e5c-48a1-b77b-d512067494a9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.786317 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b9cf0ac-b73a-44d7-969d-86ba8225d795 req-48511654-1c96-45a5-afda-365831d29d2c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750916 May 12 15:34:08.814004 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a845c54-3b29-46e6-bcaa-2bf42b39959f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.826411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60b951fb-4e5c-48a1-b77b-d512067494a9 None None] Pushing event deleted for resources: {'Port': ['ID=2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:08.833743 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3dd45627-fb7e-4c31-8576-0eb1e9aadab8 req-ca80e9f3-45e5-4603-a409-d0c81d048933 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1610026 May 12 15:34:08.845734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.852768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:08.853090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60b951fb-4e5c-48a1-b77b-d512067494a9 None None] No DVR routers for this DVR port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:34:08.853410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.905020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] For port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c,segment=NetworkSegment(38ba73a2-67f0-4888-aa72-81b039c09709),segment_id=38ba73a2-67f0-4888-aa72-81b039c09709)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:08.907041 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.923959 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a845c54-3b29-46e6-bcaa-2bf42b39959f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.961488 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6bfa361d-8b63-45e6-b823-6510bdab9da2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.968770 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:08.983333 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Transition to ACTIVE for port object 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:08.993278 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:09.011605 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a845c54-3b29-46e6-bcaa-2bf42b39959f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:09.016878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a845c54-3b29-46e6-bcaa-2bf42b39959f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=ff052fe9-77d5-4476-baff-4325901e1ad4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:09.021449 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-6bfa361d-8b63-45e6-b823-6510bdab9da2 None None] For port 209a6200-7cc9-49c6-beec-7d0f27f87493, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=209a6200-7cc9-49c6-beec-7d0f27f87493,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:09.027746 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6bfa361d-8b63-45e6-b823-6510bdab9da2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:09.063013 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7a845c54-3b29-46e6-bcaa-2bf42b39959f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/ff052fe9-77d5-4476-baff-4325901e1ad4 HTTP/1.1" status: 204 len: 168 time: 0.6498973 May 12 15:34:09.064101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55358) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:09.175812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bfa361d-8b63-45e6-b823-6510bdab9da2 None None] Pushing event updated for resources: {'Port': ['ID=209a6200-7cc9-49c6-beec-7d0f27f87493,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:09.212532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c22c160b-5194-4099-a55b-83cc7e15817d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1470304 May 12 15:34:09.224158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55362) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:09.231200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-03e71a8b-f41d-453d-b638-70ca96ca2b5c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:09.360859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:09.400094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86203abd-ce88-444f-9080-b7e750a0f549 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:09.452996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55366) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:09.453605 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 2.0094724 May 12 15:34:09.463048 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c123f39-55c4-4409-b5eb-0cbe8cc7f175 None None] Pushing event updated for resources: {'Port': ['ID=772d4b76-1bbf-41b5-a846-f4fb5eaef3c1,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:09.474269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'subnet': {'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:09.487137 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c123f39-55c4-4409-b5eb-0cbe8cc7f175 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:09.487789 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c123f39-55c4-4409-b5eb-0cbe8cc7f175 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:09.488300 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c123f39-55c4-4409-b5eb-0cbe8cc7f175 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:09.488981 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c123f39-55c4-4409-b5eb-0cbe8cc7f175 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:09.489527 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c123f39-55c4-4409-b5eb-0cbe8cc7f175 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:09.490064 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c123f39-55c4-4409-b5eb-0cbe8cc7f175 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:09.490589 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c123f39-55c4-4409-b5eb-0cbe8cc7f175 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:09.491090 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c123f39-55c4-4409-b5eb-0cbe8cc7f175 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:09.491602 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c123f39-55c4-4409-b5eb-0cbe8cc7f175 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:09.492101 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c123f39-55c4-4409-b5eb-0cbe8cc7f175 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:09.492609 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c123f39-55c4-4409-b5eb-0cbe8cc7f175 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:09.493101 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c123f39-55c4-4409-b5eb-0cbe8cc7f175 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:09.504302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9c54328-924c-4c00-8ca7-441793a968ed tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Network': ['ID=3c31163d-b39c-4c17-b3f6-91c5029a0605,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:09.533961 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Attempting to bind port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:34:09.534860 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Attempting to bind port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 582, 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:34:09.535426 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Attempting to bind port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 on network 8a5a9f45-ac98-4364-8fcd-e150e523be55 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:09.558788 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 33, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:34:09.559112 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Checking segment: {'id': 'f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 582, 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:09.829844 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:09.829844 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Bound using segment: {'id': 'f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 582, 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:34:09.829844 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Bound port: 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 582, 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:34:09.829844 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:09.833568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 209a6200-7cc9-49c6-beec-7d0f27f87493 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:09.833568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 3c31163d-b39c-4c17-b3f6-91c5029a0605 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:34:09.834514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-03e71a8b-f41d-453d-b638-70ca96ca2b5c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:09.834514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-03e71a8b-f41d-453d-b638-70ca96ca2b5c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:09.834514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-03e71a8b-f41d-453d-b638-70ca96ca2b5c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:09.834514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-03e71a8b-f41d-453d-b638-70ca96ca2b5c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:09.834514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:09.834514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:subnet and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:09.834514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:09.856500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:09.860170 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] For port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:34:09.873092 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] For port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=772d4b76-1bbf-41b5-a846-f4fb5eaef3c1,segment=NetworkSegment(f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d),segment_id=f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:34:09.875887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03e71a8b-f41d-453d-b638-70ca96ca2b5c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:09.881053 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:09.889276 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03e71a8b-f41d-453d-b638-70ca96ca2b5c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:10.115863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:10.140816 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:10.144386 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:10.144386 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:10.304386 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1503b3a1-d831-4e2c-a98c-c287a83ca34a None None] Provisioning complete for port 209a6200-7cc9-49c6-beec-7d0f27f87493 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:10.304906 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1503b3a1-d831-4e2c-a98c-c287a83ca34a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:10.498580 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c123f39-55c4-4409-b5eb-0cbe8cc7f175 None None] Pushing event updated for resources: {'Port': ['ID=772d4b76-1bbf-41b5-a846-f4fb5eaef3c1,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:10.510599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 209a6200-7cc9-49c6-beec-7d0f27f87493 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:10.510599 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:10.544301 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:34:10.677745 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:34:10.678730 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:34:10.855688 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:34:10.885041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] Deleting port 209a6200-7cc9-49c6-beec-7d0f27f87493 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:10.885041 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:10.925695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fc0f3a4-7861-49a5-b974-44a7a5e2871d tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:10.925695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fc0f3a4-7861-49a5-b974-44a7a5e2871d tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:10.950332 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:34:11.062076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-187c910d-63be-419f-ae8a-865fe18b7a76 req-f5b165ca-fce9-4952-9429-b236281995cf tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:11.069073 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-187c910d-63be-419f-ae8a-865fe18b7a76 req-f5b165ca-fce9-4952-9429-b236281995cf tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.7342124 May 12 15:34:11.146742 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03e71a8b-f41d-453d-b638-70ca96ca2b5c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:11.183053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:34:11.188569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:11.188569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:11.232415 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:11.246762 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:03Z', 'revision_number': 2, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:09Z', 'revision_number': 4, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:11.246762 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5841c7b7-6ce2-4e53-8b7f-b92fb93e1130 None None] The sync data for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 is: [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:03Z', 'revision_number': 2, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:09Z', 'revision_number': 4, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:34:11.254304 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-187c910d-63be-419f-ae8a-865fe18b7a76 req-d6c30e9f-b36d-49a4-9f75-585e990b1280 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1741824 May 12 15:34:11.282367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03e71a8b-f41d-453d-b638-70ca96ca2b5c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:11.295931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-03e71a8b-f41d-453d-b638-70ca96ca2b5c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:11.295931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03e71a8b-f41d-453d-b638-70ca96ca2b5c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:11.295931 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03e71a8b-f41d-453d-b638-70ca96ca2b5c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:11.334213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:34:11.334213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:34:11.365733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e71a8b-f41d-453d-b638-70ca96ca2b5c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=463e46ac-f43f-4627-ba4c-513e63c0bcd7,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:11.406242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Checking segment: {'id': '9eb20257-af83-41dc-b1ae-d8bb904b94c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:11.406242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network hostable DHCP agents. Network: 3c31163d-b39c-4c17-b3f6-91c5029a0605, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:34:11.447089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] The port '2f4b3d9c-e0e8-42a8-bfb1-cf64ad97070c' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:34:11.478010 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-03e71a8b-f41d-453d-b638-70ca96ca2b5c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 2.2526095 May 12 15:34:11.479608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3fc0f3a4-7861-49a5-b974-44a7a5e2871d tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Router ed4d7b30-4f35-4196-8456-3dbb630ecf8a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:34:11.482591 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55398) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:11.509398 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Subnet': ['ID=806356d2-2805-4b3e-b8c9-31e26512edbe,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:11.517213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 3c31163d-b39c-4c17-b3f6-91c5029a0605 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:34:11.535015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 3c31163d-b39c-4c17-b3f6-91c5029a0605) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:11.550448 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:11.551011 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbc76d03-5103-4ed3-b6bc-b03e0c1073e3 None None] Network 3c31163d-b39c-4c17-b3f6-91c5029a0605 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:11.551121 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:11.574676 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 209a6200-7cc9-49c6-beec-7d0f27f87493 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:34:11.585569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-17a55f2d-d053-49d8-8e41-4f34a6ecc674 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 2.1185865 May 12 15:34:11.590502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'name': 'tempest-NetworksTestDHCPv6-860348086'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:11.599552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55402) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:11.942275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] For port 209a6200-7cc9-49c6-beec-7d0f27f87493, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=209a6200-7cc9-49c6-beec-7d0f27f87493,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:11.943009 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:12.192386 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:12.202671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3fc0f3a4-7861-49a5-b974-44a7a5e2871d tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:34:12.236429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:port and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:12.240698 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fc0f3a4-7861-49a5-b974-44a7a5e2871d tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:12.244511 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3fc0f3a4-7861-49a5-b974-44a7a5e2871d tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "PUT /v2.0/routers/ed4d7b30-4f35-4196-8456-3dbb630ecf8a HTTP/1.1" status: 200 len: 924 time: 5.8994248 May 12 15:34:12.244511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:12.253835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55410) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:12.256409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:12.286942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] Calling delete_port for 209a6200-7cc9-49c6-beec-7d0f27f87493 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:12.321887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28495010-3335-4744-bafa-f7b8a04a5914 None None] Sync routers for ids ['ed4d7b30-4f35-4196-8456-3dbb630ecf8a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:34:12.339779 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-3c31163d-b39c-4c17-b3f6-91c5029a0605', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:34:12.341679 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:12.486543 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:12.600466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28495010-3335-4744-bafa-f7b8a04a5914 None None] Routers {'ed4d7b30-4f35-4196-8456-3dbb630ecf8a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:12.601398 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-28495010-3335-4744-bafa-f7b8a04a5914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ed4d7b30-4f35-4196-8456-3dbb630ecf8a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:12.707453 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9102f6b0-ccd2-4dee-a6c8-37fae14db2aa tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/routers/ed4d7b30-4f35-4196-8456-3dbb630ecf8a HTTP/1.1" status: 200 len: 924 time: 0.4494753 May 12 15:34:12.711659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:12.720633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55424) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:12.724220 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-28495010-3335-4744-bafa-f7b8a04a5914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:12.816003 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 209a6200-7cc9-49c6-beec-7d0f27f87493, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=209a6200-7cc9-49c6-beec-7d0f27f87493,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:12.887263 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:12.987357 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:12.991744 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28495010-3335-4744-bafa-f7b8a04a5914 None None] Routers {'ed4d7b30-4f35-4196-8456-3dbb630ecf8a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:12.991744 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-28495010-3335-4744-bafa-f7b8a04a5914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:33:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ed4d7b30-4f35-4196-8456-3dbb630ecf8a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:12.995097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:12.995097 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:13.040089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 255946e0-f8f8-47c3-9012-917dfa4c0ae0 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:34:13.063150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4d06e1d-18dc-4ef8-bac2-7665df1b23e4 req-b3d0c11b-23cb-488e-92a9-8e33d06312a1 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:13.070250 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4d06e1d-18dc-4ef8-bac2-7665df1b23e4 req-b3d0c11b-23cb-488e-92a9-8e33d06312a1 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.5294795 May 12 15:34:13.124580 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ae917e97-5316-463f-8ce4-7171e22a3329 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:13.124767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['81285269-acc7-414c-b6ee-d994531d7e18']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:13.160682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-28495010-3335-4744-bafa-f7b8a04a5914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:13.161799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28495010-3335-4744-bafa-f7b8a04a5914 None None] The sync data for ids ['ed4d7b30-4f35-4196-8456-3dbb630ecf8a'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:34:13.169372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '38ba73a2-67f0-4888-aa72-81b039c09709') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:13.170718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '38ba73a2-67f0-4888-aa72-81b039c09709') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:13.185661 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:34:13.186099 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:34:13.222902 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:13.231318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=209a6200-7cc9-49c6-beec-7d0f27f87493,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:13.288785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Allocated IP 2001:db8:1::2 (3c31163d-b39c-4c17-b3f6-91c5029a0605/806356d2-2805-4b3e-b8c9-31e26512edbe/a423d38d-f634-4050-a893-fc674418d503) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:13.313133 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:13.473052 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:13.519968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4d06e1d-18dc-4ef8-bac2-7665df1b23e4 req-b94c2829-f27a-4942-add3-33dcfe77a315 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3587568 May 12 15:34:13.610303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:13.648654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Releasing vlan 571 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:34:13.648654 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:13.690851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] Deleting port 209a6200-7cc9-49c6-beec-7d0f27f87493 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:13.690851 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: timer() May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:34:13.717272 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:34:13.767393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6bbe0a9-6a45-42fd-ba69-d4854d91200d tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:13.771701 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e6bbe0a9-6a45-42fd-ba69-d4854d91200d tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/ports?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&device_id=ed4d7b30-4f35-4196-8456-3dbb630ecf8a&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 1.0461714 May 12 15:34:13.820802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55446) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:13.992843 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:13.992843 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:14.026042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Network': ['ID=81285269-acc7-414c-b6ee-d994531d7e18,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:14.050952 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-eac319a5-f03b-40cd-8230-0e1527c9235f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/networks/81285269-acc7-414c-b6ee-d994531d7e18 HTTP/1.1" status: 204 len: 168 time: 7.0474057 May 12 15:34:14.053446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55452) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:14.065245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::330 (2447b094-d5d6-41ef-a146-2bf56f5399af/463e46ac-f43f-4627-ba4c-513e63c0bcd7/255946e0-f8f8-47c3-9012-917dfa4c0ae0) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:14.125111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-617137869'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:14.159888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:14.169364 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:network and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:14.175676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:14.183391 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:14.230781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:14.238613 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:14.430820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] For port 209a6200-7cc9-49c6-beec-7d0f27f87493, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=209a6200-7cc9-49c6-beec-7d0f27f87493,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:14.430820 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:14.562307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acde6d99-2e53-4542-8809-80f07d853b84 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:14.563013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-acde6d99-2e53-4542-8809-80f07d853b84 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Synchronizing usage tracker for tenant:281d0c58fa114694a3293de8c107204f on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:14.708878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72650b09-a129-4da3-b3d5-75bc521dc44b req-32720647-407b-4c51-b1bb-f35ff84d9ad9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:14.711113 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72650b09-a129-4da3-b3d5-75bc521dc44b req-32720647-407b-4c51-b1bb-f35ff84d9ad9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 1096 time: 0.3216631 May 12 15:34:14.750093 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 575} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:34:14.774242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:14.786367 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:14.786367 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Added segment 9866a2d4-463b-445f-9595-b598830e4633 of type vlan for network 8f9639b5-9797-4b91-be4b-01902654c163 May 12 15:34:14.806813 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] Calling delete_port for 209a6200-7cc9-49c6-beec-7d0f27f87493 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:14.842342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-acde6d99-2e53-4542-8809-80f07d853b84 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Unset dirty status for tenant:281d0c58fa114694a3293de8c107204f on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:14.842342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-acde6d99-2e53-4542-8809-80f07d853b84 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 881 time: 1.0137880 May 12 15:34:14.850793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55468) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:14.858699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:14.858699 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:14.976425 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:14.990527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72650b09-a129-4da3-b3d5-75bc521dc44b req-fe995cc2-1c2d-420f-b4b3-39b2311dea9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:14.990527 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72650b09-a129-4da3-b3d5-75bc521dc44b req-fe995cc2-1c2d-420f-b4b3-39b2311dea9e service neutron] 10.222.0.84 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 0.2699766 May 12 15:34:15.111238 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72650b09-a129-4da3-b3d5-75bc521dc44b req-986507ab-7cf4-4db9-b2b8-5bd9f7bf932e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=45ca2419-3316-4890-add7-265905134549 HTTP/1.1" status: 200 len: 217 time: 0.1142771 May 12 15:34:15.125583 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-afbde405-7742-4328-a56a-5f5dbcf758c5 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "GET /v2.0/ports?device_id=ed4d7b30-4f35-4196-8456-3dbb630ecf8a HTTP/1.1" status: 200 len: 205 time: 0.1815228 May 12 15:34:15.126225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55476) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:15.151928 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:15.176207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Transition to ACTIVE for port object a423d38d-f634-4050-a893-fc674418d503 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:15.176207 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:15.193168 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:15.198125 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:15.232289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72650b09-a129-4da3-b3d5-75bc521dc44b req-59c4be3d-64cd-4c91-9085-ee957e53db79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:15.232289 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72650b09-a129-4da3-b3d5-75bc521dc44b req-59c4be3d-64cd-4c91-9085-ee957e53db79 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.1083531 May 12 15:34:15.232289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object 255946e0-f8f8-47c3-9012-917dfa4c0ae0 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:15.275914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] No DVR routers for this DVR port 209a6200-7cc9-49c6-beec-7d0f27f87493 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:34:15.291918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Transition to ACTIVE for port object a423d38d-f634-4050-a893-fc674418d503 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:15.327399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=772d4b76-1bbf-41b5-a846-f4fb5eaef3c1,segment=NetworkSegment(f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d),segment_id=f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:15.327399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6061e5f-b175-4363-9f21-884af4c499be None None] Pushing event deleted for resources: {'Port': ['ID=209a6200-7cc9-49c6-beec-7d0f27f87493,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:15.343870 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:15.343870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bdc693d-4f25-45e3-8c99-ec1f49a865cb None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:15.372104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72650b09-a129-4da3-b3d5-75bc521dc44b req-f65adc25-f8a4-46b5-b37e-8b78f1940ef4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:15.372104 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72650b09-a129-4da3-b3d5-75bc521dc44b req-f65adc25-f8a4-46b5-b37e-8b78f1940ef4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1362197 May 12 15:34:15.372104 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:15.399808 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:15.495521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:15.513323 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1411d22f-ea25-4ae4-bc9d-36af5f9f9e79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:15.550011 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Network 3c31163d-b39c-4c17-b3f6-91c5029a0605 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:15.550011 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:15.567958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:15.602212 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:15.612193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:15.616505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:15.620385 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:15.620385 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:15.626994 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:15.636771 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:15.686110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=772d4b76-1bbf-41b5-a846-f4fb5eaef3c1,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:15.696535 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 4.1984794 May 12 15:34:15.696535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e25363f-b768-45bf-a529-c4ffa83854d5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=255946e0-f8f8-47c3-9012-917dfa4c0ae0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:15.696535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55484) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:15.733080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Allocated IP 2001:db8:1::1 (3c31163d-b39c-4c17-b3f6-91c5029a0605/806356d2-2805-4b3e-b8c9-31e26512edbe/16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:15.787225 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72650b09-a129-4da3-b3d5-75bc521dc44b req-e587c354-d1b7-4216-86df-db24e6df1566 service neutron] 10.222.0.84 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4004388 May 12 15:34:15.841449 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Attempting to bind port a423d38d-f634-4050-a893-fc674418d503 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:34:15.842149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Attempting to bind port a423d38d-f634-4050-a893-fc674418d503 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '9eb20257-af83-41dc-b1ae-d8bb904b94c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:34:15.842740 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Attempting to bind port a423d38d-f634-4050-a893-fc674418d503 on network 3c31163d-b39c-4c17-b3f6-91c5029a0605 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:15.965493 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72650b09-a129-4da3-b3d5-75bc521dc44b req-7ea3e3b9-11f3-4b4e-890c-3fefa597100d service neutron] 10.222.0.84 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1600113 May 12 15:34:16.007792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 33, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:34:16.007792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Checking segment: {'id': '9eb20257-af83-41dc-b1ae-d8bb904b94c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:16.007792 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:16.007792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Bound using segment: {'id': '9eb20257-af83-41dc-b1ae-d8bb904b94c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:34:16.007792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Bound port: a423d38d-f634-4050-a893-fc674418d503, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9eb20257-af83-41dc-b1ae-d8bb904b94c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:34:16.007792 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:16.018086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb938145-99ba-443d-8492-5a60214cc5bf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:16.027218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fb938145-99ba-443d-8492-5a60214cc5bf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:16.058558 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Pushing event updated for resources: {'Port': ['ID=a423d38d-f634-4050-a893-fc674418d503,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:16.067452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fb938145-99ba-443d-8492-5a60214cc5bf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:16.067452 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fb938145-99ba-443d-8492-5a60214cc5bf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 929 time: 0.3669317 May 12 15:34:16.067452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55492) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:16.176723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ec91df34-600b-460e-96ca-e6d92600950d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port 255946e0-f8f8-47c3-9012-917dfa4c0ae0 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:16.177112 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec91df34-600b-460e-96ca-e6d92600950d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:16.220188 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:16.242807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Transition to ACTIVE for port object 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:16.274570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Network': ['ID=8f9639b5-9797-4b91-be4b-01902654c163,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:16.283578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1f782ff5-0050-4eb4-8ef7-5f59305addb6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 2.2295847 May 12 15:34:16.299942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 8f9639b5-9797-4b91-be4b-01902654c163 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:34:16.302695 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:16.320872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55500) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:16.376087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aeb1129-ae5b-4d66-922e-10fb014f073a req-6d5fe09b-8243-4027-b3e3-692b3c40995b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:16.376087 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aeb1129-ae5b-4d66-922e-10fb014f073a req-6d5fe09b-8243-4027-b3e3-692b3c40995b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 1.8015988 May 12 15:34:16.428974 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:16.435709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': '8f9639b5-9797-4b91-be4b-01902654c163', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:16.525228 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:16.556002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '463e46ac-f43f-4627-ba4c-513e63c0bcd7'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:34:16.557261 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:16.584694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 3c31163d-b39c-4c17-b3f6-91c5029a0605 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:16.672566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:16.718785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:16.718785 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:16.726364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] For port a423d38d-f634-4050-a893-fc674418d503, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:34:16.746965 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] For port a423d38d-f634-4050-a893-fc674418d503, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a423d38d-f634-4050-a893-fc674418d503,segment=NetworkSegment(9eb20257-af83-41dc-b1ae-d8bb904b94c9),segment_id=9eb20257-af83-41dc-b1ae-d8bb904b94c9)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:34:16.793427 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:16.825953 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aeb1129-ae5b-4d66-922e-10fb014f073a req-0111ccc3-da40-46ab-b399-6ec47779d80f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4400864 May 12 15:34:16.891821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:16.947187 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:17.052590 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec91df34-600b-460e-96ca-e6d92600950d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:17.173061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:17.219690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:17.226559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:17.230212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff7556d5-e176-4620-a66c-c4b04badcc6b None None] Pushing event updated for resources: {'Port': ['ID=a423d38d-f634-4050-a893-fc674418d503,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:17.238142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:17.260115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Allocated IP 2001:db8::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/463e46ac-f43f-4627-ba4c-513e63c0bcd7/36dc5477-40c3-4ba5-8905-a464b87eb617) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:17.311127 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:17.368342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:17.368342 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:17.416406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ec91df34-600b-460e-96ca-e6d92600950d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for 255946e0-f8f8-47c3-9012-917dfa4c0ae0 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:17.541111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:17.800406 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:17.805948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:17.806696 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:17.963296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec91df34-600b-460e-96ca-e6d92600950d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:17.990251 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:18.170743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec91df34-600b-460e-96ca-e6d92600950d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=255946e0-f8f8-47c3-9012-917dfa4c0ae0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:18.177315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Deleting port 77aa9fbb-fb01-443a-afb3-6551d79b9cd2 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:18.177488 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:18.256901 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:18.271596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Transition to ACTIVE for port object 36dc5477-40c3-4ba5-8905-a464b87eb617 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:18.312542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Transition to ACTIVE for port object 36dc5477-40c3-4ba5-8905-a464b87eb617 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:18.323183 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:18.329845 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec91df34-600b-460e-96ca-e6d92600950d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:18.422130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:18.425092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:18.425092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:18.495493 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ec91df34-600b-460e-96ca-e6d92600950d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/255946e0-f8f8-47c3-9012-917dfa4c0ae0 HTTP/1.1" status: 204 len: 168 time: 2.4270332 May 12 15:34:18.511625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Pushing event updated for resources: {'Port': ['ID=36dc5477-40c3-4ba5-8905-a464b87eb617,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:18.515376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55532) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:18.683742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Attempting to bind port 36dc5477-40c3-4ba5-8905-a464b87eb617 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:34:18.683742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Attempting to bind port 36dc5477-40c3-4ba5-8905-a464b87eb617 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:34:18.683742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Attempting to bind port 36dc5477-40c3-4ba5-8905-a464b87eb617 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:18.695832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 34, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:34:18.695832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:18.695832 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:18.695832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:34:18.695832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Bound port: 36dc5477-40c3-4ba5-8905-a464b87eb617, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:34:18.695832 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:18.739342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16146602-67a8-4ab4-a29f-1c5641ae651e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:18.739342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16146602-67a8-4ab4-a29f-1c5641ae651e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:18.739342 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-16146602-67a8-4ab4-a29f-1c5641ae651e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.2154181 May 12 15:34:18.745191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55538) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:18.887299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-f5bea9d0-9105-49c0-b7ae-7e97b8fab243 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 463e46ac-f43f-4627-ba4c-513e63c0bcd7 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:34:18.891497 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] For port 36dc5477-40c3-4ba5-8905-a464b87eb617, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:34:18.892178 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5bea9d0-9105-49c0-b7ae-7e97b8fab243 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:18.894940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] For port 36dc5477-40c3-4ba5-8905-a464b87eb617, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=36dc5477-40c3-4ba5-8905-a464b87eb617,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:34:18.899875 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:18.967440 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-432a790c-939f-4f94-b6f3-41205ce28c69 req-77540569-7a19-4cd1-ae8b-f994de805b20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:18.998199 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-432a790c-939f-4f94-b6f3-41205ce28c69 req-77540569-7a19-4cd1-ae8b-f994de805b20 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 1096 time: 0.6330605 May 12 15:34:19.116472 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3367912-79e4-439c-bc4c-23389fd962f1 None None] Pushing event updated for resources: {'Port': ['ID=36dc5477-40c3-4ba5-8905-a464b87eb617,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:19.145654 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5bea9d0-9105-49c0-b7ae-7e97b8fab243 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:19.298688 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5bea9d0-9105-49c0-b7ae-7e97b8fab243 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:19.336128 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44d972b4-5ba5-4904-b16a-f81797922948 None None] Network 3c31163d-b39c-4c17-b3f6-91c5029a0605 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:19.413532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5cb693-b062-4997-9e08-d03519e19433 req-a2aecbaf-691a-4a25-b4da-6149516fd4b0 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:19.413532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb5cb693-b062-4997-9e08-d03519e19433 req-a2aecbaf-691a-4a25-b4da-6149516fd4b0 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 1.1659086 May 12 15:34:19.503143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-432a790c-939f-4f94-b6f3-41205ce28c69 req-9fba81bd-4a64-448c-94a8-bd1daf6e0db8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:19.503143 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-432a790c-939f-4f94-b6f3-41205ce28c69 req-9fba81bd-4a64-448c-94a8-bd1daf6e0db8 service neutron] 10.222.0.84 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 0.5067730 May 12 15:34:19.545236 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:34:19.664704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb5cb693-b062-4997-9e08-d03519e19433 req-cb71a61f-35e9-4ea0-ab79-8417e0e4b659 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2555037 May 12 15:34:19.669111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5bea9d0-9105-49c0-b7ae-7e97b8fab243 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:19.696675 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:19.726671 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:19.733450 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5bea9d0-9105-49c0-b7ae-7e97b8fab243 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:19.739857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a423d38d-f634-4050-a893-fc674418d503 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:19.740412 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:19.741408 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-432a790c-939f-4f94-b6f3-41205ce28c69 req-aa0aeb5c-3b48-49a2-82ea-1d1177f6f59c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=45ca2419-3316-4890-add7-265905134549 HTTP/1.1" status: 200 len: 217 time: 0.2331750 May 12 15:34:19.742067 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:19.743534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5bea9d0-9105-49c0-b7ae-7e97b8fab243 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=463e46ac-f43f-4627-ba4c-513e63c0bcd7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:19.801003 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f5bea9d0-9105-49c0-b7ae-7e97b8fab243 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/463e46ac-f43f-4627-ba4c-513e63c0bcd7 HTTP/1.1" status: 204 len: 168 time: 1.0578065 May 12 15:34:19.805061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55554) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:19.922928 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9b0ce99a-f794-49a6-b792-7da382cabd7b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1132898 May 12 15:34:19.943345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55558) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:19.964376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2daa7310-5697-4a70-b3c4-8ac82d7d74d3 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:20.018713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ca8e85ec-9ef3-4688-b5de-d73e43c1d5da None None] Provisioning for port a423d38d-f634-4050-a893-fc674418d503 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:20.073241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port a423d38d-f634-4050-a893-fc674418d503 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:20.098946 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:20.108807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a423d38d-f634-4050-a893-fc674418d503 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:20.109230 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:20.115829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-432a790c-939f-4f94-b6f3-41205ce28c69 req-b98a7d5e-9bd3-4c88-a70f-b65a459156ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:20.117288 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-432a790c-939f-4f94-b6f3-41205ce28c69 req-b98a7d5e-9bd3-4c88-a70f-b65a459156ec service neutron] 10.222.0.84 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.3670254 May 12 15:34:20.231301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Calling delete_port for 77aa9fbb-fb01-443a-afb3-6551d79b9cd2 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:20.351781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:20.729776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network 3c31163d-b39c-4c17-b3f6-91c5029a0605 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:20.775540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2daa7310-5697-4a70-b3c4-8ac82d7d74d3 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:20.780578 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:20.804082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2daa7310-5697-4a70-b3c4-8ac82d7d74d3 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:20.809306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2daa7310-5697-4a70-b3c4-8ac82d7d74d3 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:20.828108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2daa7310-5697-4a70-b3c4-8ac82d7d74d3 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:20.854214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-432a790c-939f-4f94-b6f3-41205ce28c69 req-baed5674-58c5-4835-9ea9-e7693e3edd6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:20.867264 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-432a790c-939f-4f94-b6f3-41205ce28c69 req-baed5674-58c5-4835-9ea9-e7693e3edd6e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.7309704 May 12 15:34:20.878463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port a423d38d-f634-4050-a893-fc674418d503, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a423d38d-f634-4050-a893-fc674418d503,segment=NetworkSegment(9eb20257-af83-41dc-b1ae-d8bb904b94c9),segment_id=9eb20257-af83-41dc-b1ae-d8bb904b94c9)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:20.889125 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:20.932398 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2daa7310-5697-4a70-b3c4-8ac82d7d74d3 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:20.939822 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2daa7310-5697-4a70-b3c4-8ac82d7d74d3 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:21.013489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:21.027120 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:21.172078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=a423d38d-f634-4050-a893-fc674418d503,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:21.293769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5251011a-ced7-42c0-b238-3a0c55f7ec73 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:21.600425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-aee513f5-056a-4e44-ab58-0740a981582b None None] Provisioning for port 36dc5477-40c3-4ba5-8905-a464b87eb617 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:21.796549 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a423d38d-f634-4050-a893-fc674418d503 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:21.984095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 397feb9b-2f46-4c79-af57-634897d5df53 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:34:21.999149 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Pushing event deleted for resources: {'Port': ['ID=77aa9fbb-fb01-443a-afb3-6551d79b9cd2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:22.019428 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2daa7310-5697-4a70-b3c4-8ac82d7d74d3 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:22.035213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Subnet': ['ID=dc158c92-b192-4251-9d8b-e538db2c3e57,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:22.051224 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-432a790c-939f-4f94-b6f3-41205ce28c69 req-e7b62f6f-3717-4d2e-b801-276bd02c0cca service neutron] 10.222.0.84 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.1760306 May 12 15:34:22.065950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-aee513f5-056a-4e44-ab58-0740a981582b None None] Could not find standard attr ID for object 255946e0-f8f8-47c3-9012-917dfa4c0ae0. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:34:22.120037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a423d38d-f634-4050-a893-fc674418d503 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:22.120672 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:22.170216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Checking segment: {'id': '9866a2d4-463b-445f-9595-b598830e4633', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': '8f9639b5-9797-4b91-be4b-01902654c163'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:22.170216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network hostable DHCP agents. Network: 8f9639b5-9797-4b91-be4b-01902654c163, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:34:22.301007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2daa7310-5697-4a70-b3c4-8ac82d7d74d3 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:22.382791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d42d365a-0c92-470a-875e-4709502430a8 None None] Provisioning complete for port a423d38d-f634-4050-a893-fc674418d503 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:22.392714 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d42d365a-0c92-470a-875e-4709502430a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:22.500766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:34:22.537131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 36dc5477-40c3-4ba5-8905-a464b87eb617 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:22.577997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] Deleting port 36dc5477-40c3-4ba5-8905-a464b87eb617 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:22.578394 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:22.617055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 8f9639b5-9797-4b91-be4b-01902654c163 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:34:22.655863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 8f9639b5-9797-4b91-be4b-01902654c163) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:22.673784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:22.673784 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:22.703868 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:22.771492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:34:22.777135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04b1eb93-abd5-4fe8-b620-de8c879b2cb3 None None] Network 8f9639b5-9797-4b91-be4b-01902654c163 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:22.780968 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Sync routers for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:34:22.798025 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e447447f-d710-4274-9666-12af6a05b465 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 6.4000072 May 12 15:34:22.804341 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:22.804341 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:22.814252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-2daa7310-5697-4a70-b3c4-8ac82d7d74d3 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:22.818625 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-030f11c1-0a7a-48fd-84e3-25692d2b59fe tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.2155848 May 12 15:34:22.823332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2daa7310-5697-4a70-b3c4-8ac82d7d74d3 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:22.823332 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2daa7310-5697-4a70-b3c4-8ac82d7d74d3 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:22.828216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55594) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:22.828216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55598) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:22.861229 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-432a790c-939f-4f94-b6f3-41205ce28c69 req-df1a5f04-2773-4f25-80b4-6dd226fda53f service neutron] 10.222.0.84 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7196221 May 12 15:34:22.930757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2daa7310-5697-4a70-b3c4-8ac82d7d74d3 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=aacc81a1-0db0-4f7d-821f-2529e715115b,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:22.969239 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2daa7310-5697-4a70-b3c4-8ac82d7d74d3 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 3.0269146 May 12 15:34:22.972653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55606) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:22.984178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'name': 'tempest-NetworksTestDHCPv6-1436570892'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:23.043840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'network_id': '8f9639b5-9797-4b91-be4b-01902654c163', 'security_groups': [], 'name': 'tempest-PortsTestJSON-164255819'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:23.121191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1929335774'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:23.127110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 36dc5477-40c3-4ba5-8905-a464b87eb617 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:23.131320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 36dc5477-40c3-4ba5-8905-a464b87eb617 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:23.131320 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.244676 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:34:23.290355 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.290355 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.453225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d42d365a-0c92-470a-875e-4709502430a8 None None] Provisioning for port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:23.532577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d42d365a-0c92-470a-875e-4709502430a8 None None] Provisioning complete for port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:23.532577 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d42d365a-0c92-470a-875e-4709502430a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.597759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:23.597759 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.597759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Fanout notify agent at l3_agent the message router_deleted on router ed4d7b30-4f35-4196-8456-3dbb630ecf8a {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:34:23.601023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:23.605013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:23.629826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:port and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:23.633040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:network and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:23.636273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:23.641101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:port and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:23.641101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:23.644586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:23.647838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:23.674067 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.674067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2f74fa26-38d5-4309-bb2a-b39d4cbef9ec tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "DELETE /v2.0/routers/ed4d7b30-4f35-4196-8456-3dbb630ecf8a HTTP/1.1" status: 204 len: 168 time: 8.5056145 May 12 15:34:23.677077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55618) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:23.689576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:23.689576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:23.696978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-0c625919-e373-4924-abf0-03f96b07de35 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1565377336', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:23.712878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55622) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:23.730795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-cdb0b555-cfb2-4728-8442-50d8af47aabc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1144390802', 'description': 'tempest-description--274471777'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:23.744189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:23.756344 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.756532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cdb0b555-cfb2-4728-8442-50d8af47aabc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:23.756532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:23.761984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.768372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0c625919-e373-4924-abf0-03f96b07de35 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:23.779389 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0c625919-e373-4924-abf0-03f96b07de35 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Usage tracker for resource:router and tenant:b68c8c6134e345c4b780c4a4abc4688f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:23.785068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0c625919-e373-4924-abf0-03f96b07de35 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:23.796559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0c625919-e373-4924-abf0-03f96b07de35 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:23.801459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 0c20aca6-65c5-46f4-b1e7-f0ef1d445c18 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:34:23.815332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:23.822886 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.826706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d42d365a-0c92-470a-875e-4709502430a8 None None] Port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:34:23.829100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] For port 36dc5477-40c3-4ba5-8905-a464b87eb617, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=36dc5477-40c3-4ba5-8905-a464b87eb617,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:23.829520 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.845976 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.859236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c625919-e373-4924-abf0-03f96b07de35 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.861042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c625919-e373-4924-abf0-03f96b07de35 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.865026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-8f9639b5-9797-4b91-be4b-01902654c163', 'network_id': '8f9639b5-9797-4b91-be4b-01902654c163', 'tenant_id': '9bd6beec65cd47b3a0febdc05aaed724', 'fixed_ips': [{'subnet_id': 'dc158c92-b192-4251-9d8b-e538db2c3e57'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:34:23.866612 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.914623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cdb0b555-cfb2-4728-8442-50d8af47aabc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:23.926822 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c625919-e373-4924-abf0-03f96b07de35 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:23.928544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port b9d629f9-7151-4eaa-86b8-4c4c7492ff9d yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:34:23.982750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 568} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:34:23.987460 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cdb0b555-cfb2-4728-8442-50d8af47aabc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:24.046134 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:24.046134 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Added segment 5c6c2a14-bc6b-4bdd-922e-64008bac747c of type vlan for network a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67 May 12 15:34:24.092908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cdb0b555-cfb2-4728-8442-50d8af47aabc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:24.097648 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c625919-e373-4924-abf0-03f96b07de35 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:24.109041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cdb0b555-cfb2-4728-8442-50d8af47aabc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Usage tracker for resource:security_group_rule and tenant:ed8d9bf58283443480f0c62e72d53449 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:24.115611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cdb0b555-cfb2-4728-8442-50d8af47aabc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:24.136101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cdb0b555-cfb2-4728-8442-50d8af47aabc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:24.148345 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:24.178019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] Calling delete_port for 36dc5477-40c3-4ba5-8905-a464b87eb617 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:24.178893 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c625919-e373-4924-abf0-03f96b07de35 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:24.180627 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0c625919-e373-4924-abf0-03f96b07de35 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5026715 May 12 15:34:24.182359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::390 (2447b094-d5d6-41ef-a146-2bf56f5399af/aacc81a1-0db0-4f7d-821f-2529e715115b/0c20aca6-65c5-46f4-b1e7-f0ef1d445c18) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:24.184528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55632) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:24.193742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Request body: {'router': {'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:24.209689 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:17Z', 'revision_number': 3, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:18Z', 'revision_number': 2, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:24.214842 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Checking router: 397feb9b-2f46-4c79-af57-634897d5df53 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:34:24.215921 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Updating router 397feb9b-2f46-4c79-af57-634897d5df53 port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:34:24.315405 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Allocated IP 172.20.0.7 (8f9639b5-9797-4b91-be4b-01902654c163/dc158c92-b192-4251-9d8b-e538db2c3e57/b9d629f9-7151-4eaa-86b8-4c4c7492ff9d) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:24.328054 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:24.338193 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:24.345943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:24.345943 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:24.427636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 36dc5477-40c3-4ba5-8905-a464b87eb617, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=36dc5477-40c3-4ba5-8905-a464b87eb617,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:24.438544 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:24.486860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-908de9b8-417d-4da1-b10d-6be34fb1c719 None None] Provisioning complete for port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:24.487331 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-908de9b8-417d-4da1-b10d-6be34fb1c719 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:24.536388 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cdb0b555-cfb2-4728-8442-50d8af47aabc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:24.666531 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cdb0b555-cfb2-4728-8442-50d8af47aabc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:24.695790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=36dc5477-40c3-4ba5-8905-a464b87eb617,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:24.695790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-908de9b8-417d-4da1-b10d-6be34fb1c719 None None] Port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:34:24.713845 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:34:24.713845 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:34:24.713845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 36dc5477-40c3-4ba5-8905-a464b87eb617 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:34:24.885688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb0b555-cfb2-4728-8442-50d8af47aabc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0c27e6cf-6832-4dbf-9eee-0657f0f552fb,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:24.893227 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cdb0b555-cfb2-4728-8442-50d8af47aabc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:24.902696 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cdb0b555-cfb2-4728-8442-50d8af47aabc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1781 time: 1.1936662 May 12 15:34:24.926427 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:24.980035 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 2.1400349 May 12 15:34:24.987852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55642) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:24.987852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55644) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:24.995388 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'subnet': {'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'cidr': '2001:db8:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:2::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:25.012887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-5de3b81e-8e77-4886-a31e-5151fcde6349 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Request body: {'security_group_rule': {'security_group_id': '0c27e6cf-6832-4dbf-9eee-0657f0f552fb', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:25.036396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8da1feea-fd07-42af-b02b-2f23b97b0bd5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Network': ['ID=a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:25.059343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:34:25.063398 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5de3b81e-8e77-4886-a31e-5151fcde6349 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:25.129000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5de3b81e-8e77-4886-a31e-5151fcde6349 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Usage tracker for resource:security_group_rule and tenant:ed8d9bf58283443480f0c62e72d53449 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:25.144277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5de3b81e-8e77-4886-a31e-5151fcde6349 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:25.173688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5de3b81e-8e77-4886-a31e-5151fcde6349 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:25.187499 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:25.201923 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Transition to ACTIVE for port object 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:25.236674 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:25.240260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] Deleting port 36dc5477-40c3-4ba5-8905-a464b87eb617 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:25.240260 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:25.330520 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 36dc5477-40c3-4ba5-8905-a464b87eb617, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=36dc5477-40c3-4ba5-8905-a464b87eb617,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:25.340110 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:25.381404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:25.391776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:subnet and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:25.422322 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5de3b81e-8e77-4886-a31e-5151fcde6349 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:25.468910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:25.490312 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:25.550630 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5de3b81e-8e77-4886-a31e-5151fcde6349 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:25.566886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:25.566886 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5de3b81e-8e77-4886-a31e-5151fcde6349 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:25.625113 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5de3b81e-8e77-4886-a31e-5151fcde6349 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:25.625113 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5de3b81e-8e77-4886-a31e-5151fcde6349 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6355925 May 12 15:34:25.625113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Transition to ACTIVE for port object b9d629f9-7151-4eaa-86b8-4c4c7492ff9d will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:25.643318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55656) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:25.643318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5de3b81e-8e77-4886-a31e-5151fcde6349 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=311c0c4e-bf61-451d-b17d-77608b39eafe,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:25.672486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-95c1cd5f-75e3-4edf-a97c-c912924d2229 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Request body: {'security_group_rule': {'security_group_id': '0c27e6cf-6832-4dbf-9eee-0657f0f552fb', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:25.687882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-95c1cd5f-75e3-4edf-a97c-c912924d2229 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:25.687882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-95c1cd5f-75e3-4edf-a97c-c912924d2229 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Usage tracker for resource:security_group_rule and tenant:ed8d9bf58283443480f0c62e72d53449 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:25.697909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-95c1cd5f-75e3-4edf-a97c-c912924d2229 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:25.714637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-95c1cd5f-75e3-4edf-a97c-c912924d2229 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:25.739913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:25.739913 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:25.753530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] For port 36dc5477-40c3-4ba5-8905-a464b87eb617, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=36dc5477-40c3-4ba5-8905-a464b87eb617,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:25.753530 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:25.796408 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:25.912795 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cc13ceb-c213-4531-b97f-1926a0554b87 None None] Pushing event updated for resources: {'Port': ['ID=16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:25.944876 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Attempting to bind port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:34:25.944876 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Attempting to bind port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '9eb20257-af83-41dc-b1ae-d8bb904b94c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:34:25.944876 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Attempting to bind port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 on network 3c31163d-b39c-4c17-b3f6-91c5029a0605 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:25.964827 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 34, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:34:25.964827 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Checking segment: {'id': '9eb20257-af83-41dc-b1ae-d8bb904b94c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:25.964827 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:25.964827 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Bound using segment: {'id': '9eb20257-af83-41dc-b1ae-d8bb904b94c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:34:25.964827 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Bound port: 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9eb20257-af83-41dc-b1ae-d8bb904b94c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:34:25.964827 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:25.986148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=36dc5477-40c3-4ba5-8905-a464b87eb617,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:26.147400 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-95c1cd5f-75e3-4edf-a97c-c912924d2229 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:26.179377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] Calling delete_port for 36dc5477-40c3-4ba5-8905-a464b87eb617 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:26.181434 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:26.243244 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:26.268308 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] For port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:34:26.281471 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] For port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512,segment=NetworkSegment(9eb20257-af83-41dc-b1ae-d8bb904b94c9),segment_id=9eb20257-af83-41dc-b1ae-d8bb904b94c9)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:34:26.295148 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:26.318850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object 0c20aca6-65c5-46f4-b1e7-f0ef1d445c18 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:26.393669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 8f9639b5-9797-4b91-be4b-01902654c163 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:26.393669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:26.407538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:26.472783 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:26.472783 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:26.486053 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:26.490564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:26.490564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:26.524760 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-95c1cd5f-75e3-4edf-a97c-c912924d2229 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:26.534046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=b9d629f9-7151-4eaa-86b8-4c4c7492ff9d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:26.541567 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-95c1cd5f-75e3-4edf-a97c-c912924d2229 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:26.599983 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95c1cd5f-75e3-4edf-a97c-c912924d2229 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=67091c55-b94b-4962-826c-f460be775ed8,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:26.599983 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-95c1cd5f-75e3-4edf-a97c-c912924d2229 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:26.599983 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-95c1cd5f-75e3-4edf-a97c-c912924d2229 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.9596846 May 12 15:34:26.608192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cc1abe7e-fb03-4bcf-8e0a-85938ca6a50d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 885 time: 3.7728937 May 12 15:34:26.654183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55668) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:26.654183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55670) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:26.703799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] Pushing event deleted for resources: {'Port': ['ID=36dc5477-40c3-4ba5-8905-a464b87eb617,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:26.749574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:26.755443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:26.757175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:26.757920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60fa6d23-5d57-472d-825b-74b17653b167 None None] No DVR routers for this DVR port 36dc5477-40c3-4ba5-8905-a464b87eb617 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:34:26.764795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Usage tracker for resource:floatingip and tenant:ed8d9bf58283443480f0c62e72d53449 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:26.774960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:26.783636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:26.802213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93452209-641d-4fcd-81d1-cd16cdc58657 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:26.814319 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:26.820546 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:34:26.846690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Allocated IP 172.20.0.2 (8f9639b5-9797-4b91-be4b-01902654c163/dc158c92-b192-4251-9d8b-e538db2c3e57/326cdfc8-26ec-41a0-8270-63439363331c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:26.999189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=0c20aca6-65c5-46f4-b1e7-f0ef1d445c18,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:27.019972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:27.019972 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:27.026770 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cc13ceb-c213-4531-b97f-1926a0554b87 None None] Pushing event updated for resources: {'Port': ['ID=16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:27.108055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9d180075-6a71-4b11-b140-1f9ba35cf0a6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port b9d629f9-7151-4eaa-86b8-4c4c7492ff9d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:27.108055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9d180075-6a71-4b11-b140-1f9ba35cf0a6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:27.121214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:27.121214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:27.143654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:27.143654 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:27.165379 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:27.291995 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:27.425508 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:27.445000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Transition to ACTIVE for port object 326cdfc8-26ec-41a0-8270-63439363331c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:27.501849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Transition to ACTIVE for port object 326cdfc8-26ec-41a0-8270-63439363331c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:27.529938 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6760f87c-1de6-4139-b882-e568db7ddcbb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 4.5555468 May 12 15:34:27.533742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55684) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:27.538867 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:27.755681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Network 8f9639b5-9797-4b91-be4b-01902654c163 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:27.769818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:27.796014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:27.819782 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:17Z', 'revision_number': 3, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:26Z', 'revision_number': 4, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:27.826574 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2731943-bd64-4efb-9c5c-cafeaef6f64b None None] The sync data for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 is: [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:17Z', 'revision_number': 3, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:26Z', 'revision_number': 4, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:34:27.949166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Allocated IP 172.25.8.203 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/733c8248-0871-4cd5-9e98-0a3ecc5d508f) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:27.995686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a03d0aab-a5ca-4f52-889c-172c0c3d589e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:27.995686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a03d0aab-a5ca-4f52-889c-172c0c3d589e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:28.017270 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Pushing event updated for resources: {'Port': ['ID=326cdfc8-26ec-41a0-8270-63439363331c,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:28.030426 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9d180075-6a71-4b11-b140-1f9ba35cf0a6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:28.036810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a03d0aab-a5ca-4f52-889c-172c0c3d589e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:28.036810 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a03d0aab-a5ca-4f52-889c-172c0c3d589e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 930 time: 0.4961042 May 12 15:34:28.054538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55690) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:28.159847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Attempting to bind port 326cdfc8-26ec-41a0-8270-63439363331c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:34:28.159847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Attempting to bind port 326cdfc8-26ec-41a0-8270-63439363331c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '9866a2d4-463b-445f-9595-b598830e4633', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': '8f9639b5-9797-4b91-be4b-01902654c163'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:34:28.159847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Attempting to bind port 326cdfc8-26ec-41a0-8270-63439363331c on network 8f9639b5-9797-4b91-be4b-01902654c163 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:28.187879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 34, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:34:28.187879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Checking segment: {'id': '9866a2d4-463b-445f-9595-b598830e4633', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': '8f9639b5-9797-4b91-be4b-01902654c163'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:28.187879 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:28.187879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Bound using segment: {'id': '9866a2d4-463b-445f-9595-b598830e4633', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': '8f9639b5-9797-4b91-be4b-01902654c163'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:34:28.187879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Bound port: 326cdfc8-26ec-41a0-8270-63439363331c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9866a2d4-463b-445f-9595-b598830e4633', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': '8f9639b5-9797-4b91-be4b-01902654c163'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:34:28.187879 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:28.218538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9d180075-6a71-4b11-b140-1f9ba35cf0a6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for b9d629f9-7151-4eaa-86b8-4c4c7492ff9d owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:28.255936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-32bd1241-7afe-4351-9b15-3849ab182d7a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port 0c20aca6-65c5-46f4-b1e7-f0ef1d445c18 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:28.256357 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32bd1241-7afe-4351-9b15-3849ab182d7a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:28.536485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Subnet': ['ID=75c05fee-160a-4d02-9aba-8ce92e1777d1,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:28.547061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9d180075-6a71-4b11-b140-1f9ba35cf0a6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:28.563142 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:28.706587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d180075-6a71-4b11-b140-1f9ba35cf0a6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=b9d629f9-7151-4eaa-86b8-4c4c7492ff9d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:28.726361 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:28.884847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Checking segment: {'id': '5c6c2a14-bc6b-4bdd-922e-64008bac747c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:28.884847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network hostable DHCP agents. Network: a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:34:28.889606 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:28.953274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] For port 326cdfc8-26ec-41a0-8270-63439363331c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:34:28.991056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] For port 326cdfc8-26ec-41a0-8270-63439363331c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=326cdfc8-26ec-41a0-8270-63439363331c,segment=NetworkSegment(9866a2d4-463b-445f-9595-b598830e4633),segment_id=9866a2d4-463b-445f-9595-b598830e4633)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:34:29.003094 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32bd1241-7afe-4351-9b15-3849ab182d7a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:29.024009 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:29.026369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:34:29.030351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Pushing event updated for resources: {'Port': ['ID=733c8248-0871-4cd5-9e98-0a3ecc5d508f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:29.048285 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9d180075-6a71-4b11-b140-1f9ba35cf0a6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:29.072887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:29.078104 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:29.087093 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:29.097349 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:29.131807 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9d180075-6a71-4b11-b140-1f9ba35cf0a6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/b9d629f9-7151-4eaa-86b8-4c4c7492ff9d HTTP/1.1" status: 204 len: 168 time: 2.4867435 May 12 15:34:29.132725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55712) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:29.144715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:29.171930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1e3a753-bbab-4ad8-88f6-d81efd94bfca None None] Network a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:29.180544 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-13358608-53bc-473b-b122-72483ed03965 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 4.1944690 May 12 15:34:29.185621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55716) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:29.379997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-32bd1241-7afe-4351-9b15-3849ab182d7a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for 0c20aca6-65c5-46f4-b1e7-f0ef1d445c18 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:29.476379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': 'aacc81a1-0db0-4f7d-821f-2529e715115b'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:34:29.487728 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:29.603491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:29.802883 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ad29bda-a9d1-4c5e-9859-8fecc4892acd None None] Pushing event updated for resources: {'Port': ['ID=326cdfc8-26ec-41a0-8270-63439363331c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:29.807186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:29.808142 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:30.026012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:30.054014 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32bd1241-7afe-4351-9b15-3849ab182d7a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:30.062153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:30.204502 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-fe35f264-6092-4f5c-a1df-0a77ed3dc98e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] GET failed (client error): The resource could not be found. May 12 15:34:30.205917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fe35f264-6092-4f5c-a1df-0a77ed3dc98e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:30.299512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32bd1241-7afe-4351-9b15-3849ab182d7a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=0c20aca6-65c5-46f4-b1e7-f0ef1d445c18,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:30.388418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Allocated IP 172.25.8.156 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/bbf6f7dd-7d19-45e7-9839-358677ec5c40) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:30.409810 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32bd1241-7afe-4351-9b15-3849ab182d7a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:30.568696 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Allocated IP 2001:db8::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/aacc81a1-0db0-4f7d-821f-2529e715115b/532c185e-12e4-4682-8334-c2f159835951) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:30.574906 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:30.615212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:34:30.616113 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:30.643455 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:30.804970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fe35f264-6092-4f5c-a1df-0a77ed3dc98e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:30.804970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fe35f264-6092-4f5c-a1df-0a77ed3dc98e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/b9d629f9-7151-4eaa-86b8-4c4c7492ff9d HTTP/1.1" status: 404 len: 333 time: 1.6627645 May 12 15:34:30.825649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55740) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:30.849822 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-32bd1241-7afe-4351-9b15-3849ab182d7a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/0c20aca6-65c5-46f4-b1e7-f0ef1d445c18 HTTP/1.1" status: 204 len: 168 time: 2.7958064 May 12 15:34:30.849822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55744) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:30.988426 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-80a716c4-6453-4cc3-8881-6926c5dc84b0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting subnet dc158c92-b192-4251-9d8b-e538db2c3e57 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:34:31.002775 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80a716c4-6453-4cc3-8881-6926c5dc84b0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:31.077238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512,segment=NetworkSegment(9eb20257-af83-41dc-b1ae-d8bb904b94c9),segment_id=9eb20257-af83-41dc-b1ae-d8bb904b94c9)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:31.077238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Allocated IP 2001:db8:2::2 (a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67/75c05fee-160a-4d02-9aba-8ce92e1777d1/f6f14166-3f05-4400-9626-f28a4c3daa37) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:31.108240 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:31.149510 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:31.310897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b80a96c-e336-47bc-a018-dfe23d8ffcbc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:31.313758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b80a96c-e336-47bc-a018-dfe23d8ffcbc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:31.314725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8b80a96c-e336-47bc-a018-dfe23d8ffcbc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:31.372477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 326cdfc8-26ec-41a0-8270-63439363331c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:31.377663 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80a716c4-6453-4cc3-8881-6926c5dc84b0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:31.441577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:31.487243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8b80a96c-e336-47bc-a018-dfe23d8ffcbc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:31.487243 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8b80a96c-e336-47bc-a018-dfe23d8ffcbc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.6319122 May 12 15:34:31.495001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55752) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:31.502198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07569240-45fd-4cf6-adb6-eeafd6611e39 None None] Network 8f9639b5-9797-4b91-be4b-01902654c163 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:31.554478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:31.558167 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:31.591545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Pushing event updated for resources: {'Port': ['ID=bbf6f7dd-7d19-45e7-9839-358677ec5c40,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:31.599687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:31.788374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-17cf2dd1-74ea-44c4-9873-138026f93547 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet aacc81a1-0db0-4f7d-821f-2529e715115b {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:34:32.023629 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.023629 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.029877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d88cc8f3-e11c-448f-94f4-217e94be06a7 None None] Provisioning for port 326cdfc8-26ec-41a0-8270-63439363331c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:32.029877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:32.052636 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.075589 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80a716c4-6453-4cc3-8881-6926c5dc84b0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.093988 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 326cdfc8-26ec-41a0-8270-63439363331c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:32.121007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Transition to ACTIVE for port object 532c185e-12e4-4682-8334-c2f159835951 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:32.134385 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 326cdfc8-26ec-41a0-8270-63439363331c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:32.134748 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.278833 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.283598 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.358268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Transition to ACTIVE for port object 532c185e-12e4-4682-8334-c2f159835951 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:32.378957 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.409027 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17cf2dd1-74ea-44c4-9873-138026f93547 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.471540 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.475354 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17cf2dd1-74ea-44c4-9873-138026f93547 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.568821 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Pushing event updated for resources: {'Port': ['ID=532c185e-12e4-4682-8334-c2f159835951,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:32.580931 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.581752 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17cf2dd1-74ea-44c4-9873-138026f93547 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.652502 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.669413 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:32.680729 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.693143 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:32.707179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:32.744953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Transition to ACTIVE for port object f6f14166-3f05-4400-9626-f28a4c3daa37 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:32.833568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Attempting to bind port 532c185e-12e4-4682-8334-c2f159835951 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:34:32.833568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Attempting to bind port 532c185e-12e4-4682-8334-c2f159835951 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:34:32.833568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Attempting to bind port 532c185e-12e4-4682-8334-c2f159835951 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:32.837796 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17cf2dd1-74ea-44c4-9873-138026f93547 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.848723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 34, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:34:32.848723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:32.848723 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.848723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:34:32.848723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Bound port: 532c185e-12e4-4682-8334-c2f159835951, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:34:32.848723 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.863715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Transition to ACTIVE for port object f6f14166-3f05-4400-9626-f28a4c3daa37 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:32.896022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17cf2dd1-74ea-44c4-9873-138026f93547 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=aacc81a1-0db0-4f7d-821f-2529e715115b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:32.920732 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17cf2dd1-74ea-44c4-9873-138026f93547 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:32.967636 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:33.025175 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-17cf2dd1-74ea-44c4-9873-138026f93547 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/aacc81a1-0db0-4f7d-821f-2529e715115b HTTP/1.1" status: 204 len: 168 time: 1.5321741 May 12 15:34:33.028796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55774) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:33.045449 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] For port 532c185e-12e4-4682-8334-c2f159835951, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:34:33.049104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] For port 532c185e-12e4-4682-8334-c2f159835951, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=532c185e-12e4-4682-8334-c2f159835951,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:34:33.150038 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:33.217122 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Router 92474822-a7c9-4607-9a09-6f5b1f3ef399 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:34:33.285476 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Pushing event updated for resources: {'Port': ['ID=f6f14166-3f05-4400-9626-f28a4c3daa37,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:33.287943 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:33.364325 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:33.392149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Network a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:33.407817 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-651ec7c8-19e9-4aa2-8d24-e868d0b20c9b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.3694830 May 12 15:34:33.417681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55782) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:33.430594 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:33.440790 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80a716c4-6453-4cc3-8881-6926c5dc84b0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:33.444782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:33.549335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80a716c4-6453-4cc3-8881-6926c5dc84b0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Subnet': ['ID=dc158c92-b192-4251-9d8b-e538db2c3e57,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:33.549335 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80a716c4-6453-4cc3-8881-6926c5dc84b0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:33.569965 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-80a716c4-6453-4cc3-8881-6926c5dc84b0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/dc158c92-b192-4251-9d8b-e538db2c3e57 HTTP/1.1" status: 204 len: 168 time: 2.7287700 May 12 15:34:33.573206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55786) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:33.712177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a210f6f6-24e4-4edb-bc0f-12b4eb454abd None None] Network 8f9639b5-9797-4b91-be4b-01902654c163 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:33.739024 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:33.739142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:34:33.756622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:33.760145 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a8e189c5-b793-4cb0-9ad0-85f40d06235c tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "PUT /v2.0/routers/92474822-a7c9-4607-9a09-6f5b1f3ef399 HTTP/1.1" status: 200 len: 884 time: 9.5721428 May 12 15:34:33.765843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28c2ebd3-f032-47a4-9f10-31c02cd73f73 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:33.766544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-28c2ebd3-f032-47a4-9f10-31c02cd73f73 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:33.771177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55794) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:33.806846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Pushing event updated for resources: {'Port': ['ID=bbf6f7dd-7d19-45e7-9839-358677ec5c40,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:33.880487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24a46c0d-6b8b-4f9b-b04a-0d8da9c262d3 None None] Sync routers for ids ['92474822-a7c9-4607-9a09-6f5b1f3ef399'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:34:33.898081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-28c2ebd3-f032-47a4-9f10-31c02cd73f73 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:33.898081 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-28c2ebd3-f032-47a4-9f10-31c02cd73f73 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.4721615 May 12 15:34:33.902520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55798) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:34.022734 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d5abf880-65c2-4052-a4c1-e3962b75f00e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/routers/92474822-a7c9-4607-9a09-6f5b1f3ef399 HTTP/1.1" status: 200 len: 925 time: 0.2414203 May 12 15:34:34.022734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55802) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:34.035448 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:34.035448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-393ff3db-9e6c-45dd-99b6-a40a364c80c2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 7.3892527 May 12 15:34:34.148767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d112755-5260-4e0a-8aa3-542dadaae3b4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:34.149183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9d112755-5260-4e0a-8aa3-542dadaae3b4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:34.151649 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3586b783-fefa-48df-8afd-8bbdf38e54d6 None None] Pushing event updated for resources: {'Port': ['ID=532c185e-12e4-4682-8334-c2f159835951,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:34.155676 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:34:34.156013 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:34:34.183625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65efdeb2-da61-4427-848a-03dbf34a2855 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:34.186155 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-65efdeb2-da61-4427-848a-03dbf34a2855 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/ports?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&device_id=92474822-a7c9-4607-9a09-6f5b1f3ef399&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.1669343 May 12 15:34:34.188743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55812) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:34.191732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9d112755-5260-4e0a-8aa3-542dadaae3b4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:34.195983 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9d112755-5260-4e0a-8aa3-542dadaae3b4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2944858 May 12 15:34:34.201362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55816) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:34.221951 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:34.299364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Attempting to bind port f6f14166-3f05-4400-9626-f28a4c3daa37 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:34:34.299364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Attempting to bind port f6f14166-3f05-4400-9626-f28a4c3daa37 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '5c6c2a14-bc6b-4bdd-922e-64008bac747c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:34:34.299364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Attempting to bind port f6f14166-3f05-4400-9626-f28a4c3daa37 on network a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:34.299364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24a46c0d-6b8b-4f9b-b04a-0d8da9c262d3 None None] Routers {'92474822-a7c9-4607-9a09-6f5b1f3ef399'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:34.299364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-24a46c0d-6b8b-4f9b-b04a-0d8da9c262d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['92474822-a7c9-4607-9a09-6f5b1f3ef399'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:34.398873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8b34f9f-2f76-4d45-8595-772259d2672e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:34.398873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e8b34f9f-2f76-4d45-8595-772259d2672e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Synchronizing usage tracker for tenant:281d0c58fa114694a3293de8c107204f on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:34.431169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e8b34f9f-2f76-4d45-8595-772259d2672e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Unset dirty status for tenant:281d0c58fa114694a3293de8c107204f on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:34.431169 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e8b34f9f-2f76-4d45-8595-772259d2672e tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 881 time: 0.2359705 May 12 15:34:34.431169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55830) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:34.452185 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3f4e7e0f-e15e-4f83-bab4-1b0b7629fabc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.2220905 May 12 15:34:34.452185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55834) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:34.481583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6c285265-8fef-4dfc-87c6-6d158daae2d2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:34.497221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-24a46c0d-6b8b-4f9b-b04a-0d8da9c262d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:34.526432 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dd43a07a-957f-4e72-9176-525ff2dc1b26 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "GET /v2.0/ports?device_id=92474822-a7c9-4607-9a09-6f5b1f3ef399 HTTP/1.1" status: 200 len: 205 time: 0.0952456 May 12 15:34:34.527072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55840) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:34.552229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 326cdfc8-26ec-41a0-8270-63439363331c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:34.552479 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:34.569883 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 34, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:34:34.570361 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Checking segment: {'id': '5c6c2a14-bc6b-4bdd-922e-64008bac747c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:34.570834 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:34.571298 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Bound using segment: {'id': '5c6c2a14-bc6b-4bdd-922e-64008bac747c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:34:34.571890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Bound port: f6f14166-3f05-4400-9626-f28a4c3daa37, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5c6c2a14-bc6b-4bdd-922e-64008bac747c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:34:34.572598 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:34.619864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-52cc08f8-8416-48d8-b89b-8641ef4315e5 None None] Provisioning complete for port 326cdfc8-26ec-41a0-8270-63439363331c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:34.619864 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-52cc08f8-8416-48d8-b89b-8641ef4315e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:34.784074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24a46c0d-6b8b-4f9b-b04a-0d8da9c262d3 None None] Routers {'92474822-a7c9-4607-9a09-6f5b1f3ef399'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:34.784074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-24a46c0d-6b8b-4f9b-b04a-0d8da9c262d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['92474822-a7c9-4607-9a09-6f5b1f3ef399'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:34.812886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c3a54cb-3a77-4f7e-a4dd-9ad974cbbf88 req-ab19f13c-2446-4dce-95b2-a49e22f78fcf tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:34.815032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c3a54cb-3a77-4f7e-a4dd-9ad974cbbf88 req-ab19f13c-2446-4dce-95b2-a49e22f78fcf tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 946 time: 0.8368821 May 12 15:34:34.836054 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:34.878360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-24a46c0d-6b8b-4f9b-b04a-0d8da9c262d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:34.878756 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24a46c0d-6b8b-4f9b-b04a-0d8da9c262d3 None None] The sync data for ids ['92474822-a7c9-4607-9a09-6f5b1f3ef399'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:34:34.914783 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:34.963460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 326cdfc8-26ec-41a0-8270-63439363331c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=326cdfc8-26ec-41a0-8270-63439363331c,segment=NetworkSegment(9866a2d4-463b-445f-9595-b598830e4633),segment_id=9866a2d4-463b-445f-9595-b598830e4633)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:34.991540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-86d758ec-be78-4ef2-9938-e05c0ef26f7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Synchronizing usage tracker for tenant:ed8d9bf58283443480f0c62e72d53449 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:35.002496 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] For port f6f14166-3f05-4400-9626-f28a4c3daa37, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:34:35.009973 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:35.043690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Allocated IP 2001:db8:2::1 (a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67/75c05fee-160a-4d02-9aba-8ce92e1777d1/dadf1f1f-b294-481c-b750-a7e100b498dd) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:35.111775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03c1e402-3f27-4b42-98d7-9b260d76cbbc None None] DHCP port deletion for 8f9639b5-9797-4b91-be4b-01902654c163 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:34:35.139073 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c3a54cb-3a77-4f7e-a4dd-9ad974cbbf88 req-2971c0d9-ea05-4ed9-84f3-52c26292c712 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2912772 May 12 15:34:35.155919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6c285265-8fef-4dfc-87c6-6d158daae2d2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:35.179456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:35.205923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-86d758ec-be78-4ef2-9938-e05c0ef26f7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Unset dirty status for tenant:ed8d9bf58283443480f0c62e72d53449 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:35.207198 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-86d758ec-be78-4ef2-9938-e05c0ef26f7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1144390802&fields=id&tenant_id=ed8d9bf58283443480f0c62e72d53449 HTTP/1.1" status: 200 len: 267 time: 0.7800729 May 12 15:34:35.217723 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:35.228677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Deleting port 733c8248-0871-4cd5-9e98-0a3ecc5d508f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:35.229127 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:35.265581 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] For port f6f14166-3f05-4400-9626-f28a4c3daa37, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f6f14166-3f05-4400-9626-f28a4c3daa37,segment=NetworkSegment(5c6c2a14-bc6b-4bdd-922e-64008bac747c),segment_id=5c6c2a14-bc6b-4bdd-922e-64008bac747c)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:34:35.273515 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-03c1e402-3f27-4b42-98d7-9b260d76cbbc None None] Deleting port 326cdfc8-26ec-41a0-8270-63439363331c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:35.273875 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03c1e402-3f27-4b42-98d7-9b260d76cbbc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:35.395590 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:35.422839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6c285265-8fef-4dfc-87c6-6d158daae2d2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:35.447658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=326cdfc8-26ec-41a0-8270-63439363331c,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:35.650869 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:35.651226 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:35.751495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e61f36e-5727-4d2e-80ce-f7ce0f23d25e None None] Pushing event updated for resources: {'Port': ['ID=f6f14166-3f05-4400-9626-f28a4c3daa37,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:35.757609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] For port 326cdfc8-26ec-41a0-8270-63439363331c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=326cdfc8-26ec-41a0-8270-63439363331c,segment=NetworkSegment(9866a2d4-463b-445f-9595-b598830e4633),segment_id=9866a2d4-463b-445f-9595-b598830e4633)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:35.757609 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:35.783601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c285265-8fef-4dfc-87c6-6d158daae2d2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:35.783601 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6c285265-8fef-4dfc-87c6-6d158daae2d2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:36.003458 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:36.025312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-03c1e402-3f27-4b42-98d7-9b260d76cbbc None None] For port 326cdfc8-26ec-41a0-8270-63439363331c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=326cdfc8-26ec-41a0-8270-63439363331c,segment=NetworkSegment(9866a2d4-463b-445f-9595-b598830e4633),segment_id=9866a2d4-463b-445f-9595-b598830e4633)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:36.025312 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03c1e402-3f27-4b42-98d7-9b260d76cbbc None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:36.153333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Calling delete_port for 733c8248-0871-4cd5-9e98-0a3ecc5d508f owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:36.290868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-03c1e402-3f27-4b42-98d7-9b260d76cbbc None None] Calling delete_port for 326cdfc8-26ec-41a0-8270-63439363331c owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:36.302736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for 326cdfc8-26ec-41a0-8270-63439363331c owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:36.363074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:36.488533 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03c1e402-3f27-4b42-98d7-9b260d76cbbc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:36.493742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Pushing event deleted for resources: {'Port': ['ID=733c8248-0871-4cd5-9e98-0a3ecc5d508f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:36.529170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-5d4e27f5-7b2a-4cba-a1fc-b4ef32c4e880 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:36.538006 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-5d4e27f5-7b2a-4cba-a1fc-b4ef32c4e880 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 818 time: 1.1514032 May 12 15:34:36.564289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03c1e402-3f27-4b42-98d7-9b260d76cbbc None None] No DVR routers for this DVR port 326cdfc8-26ec-41a0-8270-63439363331c on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:34:36.564289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03c1e402-3f27-4b42-98d7-9b260d76cbbc None None] Pushing event deleted for resources: {'Port': ['ID=326cdfc8-26ec-41a0-8270-63439363331c,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:36.629429 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-cb528c98-775d-45cb-9793-5a8810d77f7e tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/quotas/ed8d9bf58283443480f0c62e72d53449 HTTP/1.1" status: 200 len: 375 time: 0.0849566 May 12 15:34:36.632352 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:36.736348 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:36.796028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-a1fa6d94-ca1b-4909-bdc5-988a5712031d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:36.796028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-a1fa6d94-ca1b-4909-bdc5-988a5712031d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Synchronizing usage tracker for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:36.815976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Transition to ACTIVE for port object dadf1f1f-b294-481c-b750-a7e100b498dd will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:36.844733 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:34:36.844733 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:34:36.921903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4fa4033-ef1c-49b6-9f4b-877de200b1cd req-d83108dd-b8f4-40f6-96f6-dfd51dcb6f23 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:36.921903 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d4fa4033-ef1c-49b6-9f4b-877de200b1cd req-d83108dd-b8f4-40f6-96f6-dfd51dcb6f23 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 946 time: 0.5215788 May 12 15:34:37.001846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-a1fa6d94-ca1b-4909-bdc5-988a5712031d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Unset dirty status for tenant:c5f9faeb50de42b1a07298c25a4e4d6b on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:37.003054 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-a1fa6d94-ca1b-4909-bdc5-988a5712031d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.84 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 946 time: 1.3768461 May 12 15:34:37.029093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d4fa4033-ef1c-49b6-9f4b-877de200b1cd req-8079c9c6-0919-45e8-bc08-cfe40f2b2792 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1061466 May 12 15:34:37.033255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.116270 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.116270 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.148642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-38982491-595b-4b17-80de-86910cbac038 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&fields=id HTTP/1.1" status: 200 len: 440 time: 0.5229869 May 12 15:34:37.177080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Deleting port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:37.177080 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.186117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f06782d0-056d-432f-80b4-5ab43c88185f None None] Network a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:37.199088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=dadf1f1f-b294-481c-b750-a7e100b498dd,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:37.224015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:37.235788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:37.235788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:37.235788 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.296625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6f14166-3f05-4400-9626-f28a4c3daa37 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:37.343940 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6c285265-8fef-4dfc-87c6-6d158daae2d2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.352652 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.352652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Fanout notify agent at l3_agent the message router_deleted on router 92474822-a7c9-4607-9a09-6f5b1f3ef399 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:34:37.397333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 326cdfc8-26ec-41a0-8270-63439363331c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:37.397776 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.435880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c285265-8fef-4dfc-87c6-6d158daae2d2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:37.471098 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.472855 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6a4ac263-2392-4afa-9356-6c2ee751eb95 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "DELETE /v2.0/routers/92474822-a7c9-4607-9a09-6f5b1f3ef399 HTTP/1.1" status: 204 len: 168 time: 2.9447744 May 12 15:34:37.476460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55870) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:37.484202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-db43d7a8-91f6-47a3-9839-0f8e7d38d947 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-803945431', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:37.495642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-db43d7a8-91f6-47a3-9839-0f8e7d38d947 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:37.521178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-706e94b2-b093-425b-b234-088e60ce1963 None None] Provisioning for port f6f14166-3f05-4400-9626-f28a4c3daa37 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:37.526296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-db43d7a8-91f6-47a3-9839-0f8e7d38d947 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Usage tracker for resource:router and tenant:b68c8c6134e345c4b780c4a4abc4688f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:37.533824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-db43d7a8-91f6-47a3-9839-0f8e7d38d947 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:37.616007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-db43d7a8-91f6-47a3-9839-0f8e7d38d947 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:37.647132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-6c285265-8fef-4dfc-87c6-6d158daae2d2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:37.647132 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.659481 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db43d7a8-91f6-47a3-9839-0f8e7d38d947 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.662667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c285265-8fef-4dfc-87c6-6d158daae2d2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:37.666154 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db43d7a8-91f6-47a3-9839-0f8e7d38d947 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.670059 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6c285265-8fef-4dfc-87c6-6d158daae2d2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.685976 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db43d7a8-91f6-47a3-9839-0f8e7d38d947 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.751222 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db43d7a8-91f6-47a3-9839-0f8e7d38d947 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.760728 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6c285265-8fef-4dfc-87c6-6d158daae2d2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 3.2925904 May 12 15:34:37.776503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55874) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:37.797284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'fixed_ips': [{'subnet_id': '1ac875b9-81a6-4bbd-9c14-21f72dde4448', 'ip_address': '2001:db8::983:2dc5:563e:3b53'}], 'name': 'tempest-NetworksTestDHCPv6-357721701'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:37.838252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c6f1c98-91cc-4652-88db-50e12944b973 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:37.936346 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db43d7a8-91f6-47a3-9839-0f8e7d38d947 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:37.937809 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-db43d7a8-91f6-47a3-9839-0f8e7d38d947 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 0.4585264 May 12 15:34:37.947091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55880) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:37.952904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'enable_snat': True}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:38.024676 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f6f14166-3f05-4400-9626-f28a4c3daa37 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:38.052002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] For port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=29d0af7f-6b74-411d-b4cd-b92826b2e4ec,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:38.052002 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:38.332698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f6f14166-3f05-4400-9626-f28a4c3daa37 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:38.333367 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:38.383652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] The port '326cdfc8-26ec-41a0-8270-63439363331c' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:34:38.387605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-d9bdc02c-6ada-479a-9f73-a36879021f7f service neutron] 10.222.0.82 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.1811407 May 12 15:34:38.722612 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:38.736308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:38.855839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 29d0af7f-6b74-411d-b4cd-b92826b2e4ec no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:34:38.907873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:38.938651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:39.035745 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port f6f14166-3f05-4400-9626-f28a4c3daa37, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f6f14166-3f05-4400-9626-f28a4c3daa37,segment=NetworkSegment(5c6c2a14-bc6b-4bdd-922e-64008bac747c),segment_id=5c6c2a14-bc6b-4bdd-922e-64008bac747c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:39.087731 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:39.275831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 326cdfc8-26ec-41a0-8270-63439363331c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:34:39.346646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c285265-8fef-4dfc-87c6-6d158daae2d2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=1ac875b9-81a6-4bbd-9c14-21f72dde4448,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:39.381299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 326cdfc8-26ec-41a0-8270-63439363331c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:34:39.382253 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 326cdfc8-26ec-41a0-8270-63439363331c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:34:39.383649 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d3d4a9c4-8af0-4eee-9518-c55c51514105 None None] Provisioning complete for port f6f14166-3f05-4400-9626-f28a4c3daa37 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:39.384013 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d3d4a9c4-8af0-4eee-9518-c55c51514105 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:39.460719 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8eda6c6a-d23a-4698-9546-18e4260d9b2c None None] Update dhcp port {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'fixed_ips': [{'subnet_id': '1ac875b9-81a6-4bbd-9c14-21f72dde4448'}], 'binding:host_id': 'n-d-841483-1'}, 'id': '532c185e-12e4-4682-8334-c2f159835951'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:34:39.515767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=f6f14166-3f05-4400-9626-f28a4c3daa37,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:39.519473 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:39.612252 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:39.661325 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:39.686339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-422f56a9-d2d6-4a3b-a46e-11031812dc89 req-722f7abe-72d8-4219-8f7f-5cd829872852 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:39.686339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-422f56a9-d2d6-4a3b-a46e-11031812dc89 req-722f7abe-72d8-4219-8f7f-5cd829872852 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 946 time: 1.2751768 May 12 15:34:39.693213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=29d0af7f-6b74-411d-b4cd-b92826b2e4ec,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:39.705650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:34:39.715994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:39.715994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:39.715994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:39.715994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:39.715994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:39.716637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:39.717658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:39.717658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:39.717658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:39.719781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:39.719781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:39.719781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:39.740976 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:39.814092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-422f56a9-d2d6-4a3b-a46e-11031812dc89 req-a8b33055-d2c8-48f1-adb1-147faff98b46 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1300523 May 12 15:34:39.818220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8f9639b5-9797-4b91-be4b-01902654c163']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:39.842894 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8eda6c6a-d23a-4698-9546-18e4260d9b2c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:39.847641 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:39.916202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 9c74fa6a-5efc-4eb1-b6c0-520961887d83 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:34:39.952881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-f40a6e2e-cb27-416d-a400-e6e24aec137d service neutron] 10.222.0.82 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.0178850 May 12 15:34:39.970752 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2aa2e149-85a2-4d6b-9f23-713b76b8d238'] response: {'server_uuid': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec', 'code': 200} May 12 15:34:39.983524 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:39.983524 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:39.983524 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Floating IP 5aca4875-736a-41d6-bb44-0bc0ffee31c1 disassociated. External IP: 172.25.8.173, port: 29d0af7f-6b74-411d-b4cd-b92826b2e4ec. May 12 15:34:39.985529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9866a2d4-463b-445f-9595-b598830e4633') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:39.987407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Calling delete_port for 29d0af7f-6b74-411d-b4cd-b92826b2e4ec owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:39.990712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9866a2d4-463b-445f-9595-b598830e4633') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:40.017043 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:40.035889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=29d0af7f-6b74-411d-b4cd-b92826b2e4ec,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:40.062617 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:40.074055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:40.079890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Releasing vlan 575 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:34:40.080688 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: timer() May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:34:40.099203 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:34:40.111226 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:40.112410 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:40.269083 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:34:40.269083 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:34:40.334625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d3d4a9c4-8af0-4eee-9518-c55c51514105 None None] Provisioning for port dadf1f1f-b294-481c-b750-a7e100b498dd completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:40.348805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d3d4a9c4-8af0-4eee-9518-c55c51514105 None None] Provisioning complete for port dadf1f1f-b294-481c-b750-a7e100b498dd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:40.348805 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d3d4a9c4-8af0-4eee-9518-c55c51514105 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:40.487503 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d3d4a9c4-8af0-4eee-9518-c55c51514105 None None] Port dadf1f1f-b294-481c-b750-a7e100b498dd cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:34:40.493061 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a3c8e6c-cc03-4402-a01b-c2897db55adc req-38a61ff7-22f0-4b14-a0ff-e2b50a8cc5e8 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 210 time: 0.1035719 May 12 15:34:40.592235 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:40.592235 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:40.630901 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/networks/8f9639b5-9797-4b91-be4b-01902654c163 HTTP/1.1" status: 204 len: 168 time: 6.8926377 May 12 15:34:40.634562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=dadf1f1f-b294-481c-b750-a7e100b498dd,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:40.646211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01bd5a18-d14a-4116-9d3d-5c8b5d1c6b00 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Network': ['ID=8f9639b5-9797-4b91-be4b-01902654c163,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:40.651684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55916) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:40.663644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-28bec98d-51bc-4acf-99bd-7fe934a6c01a None None] Provisioning complete for port dadf1f1f-b294-481c-b750-a7e100b498dd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:40.663644 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-28bec98d-51bc-4acf-99bd-7fe934a6c01a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:40.674820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'name': 'tempest-PortsTestJSON-414665215'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:40.866910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:40.877793 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Deleting port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:40.878381 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:40.883897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-28bec98d-51bc-4acf-99bd-7fe934a6c01a None None] Port dadf1f1f-b294-481c-b750-a7e100b498dd cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:34:40.927294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:41.010060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::983:2dc5:563e:3b53 (2447b094-d5d6-41ef-a146-2bf56f5399af/1ac875b9-81a6-4bbd-9c14-21f72dde4448/9c74fa6a-5efc-4eb1-b6c0-520961887d83) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:41.027551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:41.027551 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:41.050980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:41.050980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:41.518536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port 894648dd-c814-436f-ba72-5e90c7813cb5 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:34:41.547883 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6f14166-3f05-4400-9626-f28a4c3daa37 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:41.613967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 397feb9b-2f46-4c79-af57-634897d5df53 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:34:41.646245 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:41.688484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ad294dd9-9da9-4e5e-a431-1150e1bf5757 None None] Provisioning complete for port dadf1f1f-b294-481c-b750-a7e100b498dd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:41.688912 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ad294dd9-9da9-4e5e-a431-1150e1bf5757 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:41.768121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ad294dd9-9da9-4e5e-a431-1150e1bf5757 None None] Port dadf1f1f-b294-481c-b750-a7e100b498dd cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:34:41.793828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f6f14166-3f05-4400-9626-f28a4c3daa37 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:41.793828 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:41.848675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-247180f7-b53a-46cc-a266-1b41c45c1bce req-52b4ea6b-7051-42f8-a6a2-9c9530b95880 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 210 time: 0.1840792 May 12 15:34:41.867444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:41.874718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96f9211c-91cb-4d9b-aa21-b1af814e7104 req-04a8bc16-0494-47d1-9d44-efb2248ce2ad tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:41.884383 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96f9211c-91cb-4d9b-aa21-b1af814e7104 req-04a8bc16-0494-47d1-9d44-efb2248ce2ad tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 944 time: 0.8151629 May 12 15:34:41.907152 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:42.037025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object 9c74fa6a-5efc-4eb1-b6c0-520961887d83 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:42.077941 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:42.220727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-8eda6c6a-d23a-4698-9546-18e4260d9b2c None None] Allocated IP 2001:db8::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/1ac875b9-81a6-4bbd-9c14-21f72dde4448/532c185e-12e4-4682-8334-c2f159835951) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:42.348894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:42.476635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:42.486231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:42.489775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:42.489775 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:42.566153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] For port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=29d0af7f-6b74-411d-b4cd-b92826b2e4ec,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:42.566153 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:42.573464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8eda6c6a-d23a-4698-9546-18e4260d9b2c None None] For port 532c185e-12e4-4682-8334-c2f159835951, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=532c185e-12e4-4682-8334-c2f159835951,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:42.599999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-cc990c55-8e7b-431a-9452-baa6424cf20f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:42.603433 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:42.607509 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-cc990c55-8e7b-431a-9452-baa6424cf20f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.76 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 818 time: 0.5054145 May 12 15:34:42.622217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=9c74fa6a-5efc-4eb1-b6c0-520961887d83,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:42.640289 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8eda6c6a-d23a-4698-9546-18e4260d9b2c None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:42.644279 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96f9211c-91cb-4d9b-aa21-b1af814e7104 req-20f74f13-710b-4b30-8066-e464f516b79f tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7602563 May 12 15:34:42.665111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8eda6c6a-d23a-4698-9546-18e4260d9b2c None None] Ignored duplicate provisioning block setup for port 532c185e-12e4-4682-8334-c2f159835951 by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:68}} May 12 15:34:42.673735 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:42.677790 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8eda6c6a-d23a-4698-9546-18e4260d9b2c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:42.734942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:34:42.746316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:42.750261 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Sync routers for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:34:42.756954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:42.764324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:42.769598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:42.770381 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:42.771864 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-71d96784-f48d-4e5c-b5ea-5fd4fcc4de98 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 946 time: 4.9998171 May 12 15:34:42.772293 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:42.773263 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:42.777264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Allocated IP 172.25.8.204 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/08c41689-8b1e-483d-9333-e99567852512) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:42.784733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55940) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:42.832413 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 845 time: 2.1805542 May 12 15:34:42.833356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55946) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:42.970272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eda6c6a-d23a-4698-9546-18e4260d9b2c None None] Pushing event updated for resources: {'Port': ['ID=532c185e-12e4-4682-8334-c2f159835951,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:43.015617 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5cd8201c-a60a-49e4-858d-65b2cb9cd771 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:43.056007 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b53e1e3f-1d96-41aa-9e3f-d7210ff5e1d7 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53/add_router_interface HTTP/1.1" status: 200 len: 503 time: 13.8649323 May 12 15:34:43.072497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-84ea4cad-e09f-4515-b38c-7e68eb86d382 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 894648dd-c814-436f-ba72-5e90c7813cb5 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:43.072497 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84ea4cad-e09f-4515-b38c-7e68eb86d382 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:43.119298 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:43.179384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55952) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:43.186100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-2046672116'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:43.193065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:43.199179 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:network and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:43.207707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for network was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:43.227691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:43.241891 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-a991e397-f0fc-4b46-bb85-e89f4fc33693 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ed8d9bf58283443480f0c62e72d53449 HTTP/1.1" status: 200 len: 380 time: 0.6412978 May 12 15:34:43.247161 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:34:43.251986 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccac12bf-bcc0-4af2-9e06-a1283a52fd06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=894648dd-c814-436f-ba72-5e90c7813cb5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:43.265263 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:43.291593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Request body: {'port': {'device_id': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'admin_state_up': True, 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'security_groups': ['0c27e6cf-6832-4dbf-9eee-0657f0f552fb']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:43.348601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:43.356738 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:43.381589 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ca0dda7f-fa40-4a41-bacb-6c2510c8abcf req-f54d1c0d-61a3-481d-81b0-6ed8196cd55b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 210 time: 0.1098270 May 12 15:34:43.547232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 599} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:34:43.575553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:43.575905 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Added segment f344cec1-3138-44bd-8d64-09a36451564e of type vlan for network ac7191e2-2e1e-4c14-b753-6a321d14e4d8 May 12 15:34:43.643530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 532c185e-12e4-4682-8334-c2f159835951 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:43.812199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 532c185e-12e4-4682-8334-c2f159835951 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:43.940286 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84ea4cad-e09f-4515-b38c-7e68eb86d382 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:44.060659 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:37Z', 'revision_number': 4, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:39Z', 'revision_number': 2, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:44.060659 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Checking router: 397feb9b-2f46-4c79-af57-634897d5df53 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:34:44.060659 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Updating router 397feb9b-2f46-4c79-af57-634897d5df53 port dadf1f1f-b294-481c-b750-a7e100b498dd binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:34:44.069452 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:44.146337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-84ea4cad-e09f-4515-b38c-7e68eb86d382 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for 894648dd-c814-436f-ba72-5e90c7813cb5 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:44.197022 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:44.201241 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:44.295044 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:44.295044 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:44.295044 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Floating IP 5aca4875-736a-41d6-bb44-0bc0ffee31c1 disassociated. External IP: 172.25.8.173, port: 29d0af7f-6b74-411d-b4cd-b92826b2e4ec. May 12 15:34:44.295044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Calling delete_port for 29d0af7f-6b74-411d-b4cd-b92826b2e4ec owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:44.431310 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84ea4cad-e09f-4515-b38c-7e68eb86d382 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:44.450762 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:44.457851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:44.457851 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:44.547990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:44.570852 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84ea4cad-e09f-4515-b38c-7e68eb86d382 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:44.572906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ebaf2b7-6a45-4978-a6b8-41ba5ad818b1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:44.600612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ebaf2b7-6a45-4978-a6b8-41ba5ad818b1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:44.600612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6ebaf2b7-6a45-4978-a6b8-41ba5ad818b1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:44.656160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:44.665045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Usage tracker for resource:port and tenant:ed8d9bf58283443480f0c62e72d53449 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:44.669455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Quota usage for port was recalculated. Used quota:5. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:44.676563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attempting to reserve 1 items for resource port. Total usage: 5; quota limit: 500; headroom:495 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:44.685230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:44.692915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:44.712910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84ea4cad-e09f-4515-b38c-7e68eb86d382 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=894648dd-c814-436f-ba72-5e90c7813cb5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:44.726461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Made reservation on behalf of ed8d9bf58283443480f0c62e72d53449 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:44.735411 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:44.755975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6ebaf2b7-6a45-4978-a6b8-41ba5ad818b1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:44.755975 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6ebaf2b7-6a45-4978-a6b8-41ba5ad818b1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1683 time: 1.9674766 May 12 15:34:44.789717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55972) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:44.801258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event updated for resources: {'Port': ['ID=08c41689-8b1e-483d-9333-e99567852512,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:44.863032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-393f145a-0128-41e7-825b-7185bbe0a73e None None] Provisioning for port 532c185e-12e4-4682-8334-c2f159835951 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:44.885673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-393f145a-0128-41e7-825b-7185bbe0a73e None None] Provisioning complete for port 532c185e-12e4-4682-8334-c2f159835951 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:44.885673 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-393f145a-0128-41e7-825b-7185bbe0a73e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:44.900824 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-84ea4cad-e09f-4515-b38c-7e68eb86d382 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/894648dd-c814-436f-ba72-5e90c7813cb5 HTTP/1.1" status: 204 len: 168 time: 2.0573778 May 12 15:34:44.913115 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55976) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:44.951384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89669d38-d1d2-4543-9d36-e46c22d259ad req-e3c45708-7ce8-4eda-b775-5359afb8e91d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:44.951384 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89669d38-d1d2-4543-9d36-e46c22d259ad req-e3c45708-7ce8-4eda-b775-5359afb8e91d tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 944 time: 1.0775087 May 12 15:34:44.965362 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-497de935-58b0-4505-81d7-c0e1cc1b0888 req-9f74ea2f-89c9-4480-90f6-e0450d64da62 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 210 time: 0.2396033 May 12 15:34:44.965362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'mac_address': 'fa:16:3e:42:5d:b7', 'name': 'tempest-PortsTestJSON-226091487'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:45.033852 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 1.8389826 May 12 15:34:45.033852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55980) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:45.150790 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:45.165202 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Transition to ACTIVE for port object dadf1f1f-b294-481c-b750-a7e100b498dd will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:45.174925 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:45.185617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-021c6ae8-ff6d-44af-820f-fb60978ee292 None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:34:45.369541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-56880bb2-7a4e-4d9d-a81e-9efb177e73db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port 9c74fa6a-5efc-4eb1-b6c0-520961887d83 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:45.369541 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-56880bb2-7a4e-4d9d-a81e-9efb177e73db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:45.422020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:45.422020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:port and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:45.431582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:45.431582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:45.452735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'subnet': {'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8', 'cidr': '2001:db8:3::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:3::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:45.469332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Allocated IP 172.20.0.5 (bca349be-4618-43ae-a547-b8bd2b254da4/aa771580-393c-41f8-ad67-611be21e45d3/d45db345-6e10-417e-8b52-3260151d6ba4) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:45.584507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-021c6ae8-ff6d-44af-820f-fb60978ee292 None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:34:45.596931 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91c00e4-4869-49a4-837b-40bd651c00e4 None None] Pushing event updated for resources: {'Port': ['ID=dadf1f1f-b294-481c-b750-a7e100b498dd,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:45.662929 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-393f145a-0128-41e7-825b-7185bbe0a73e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:45.667010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af728c54-3794-4117-a6f0-dba0a7a52851 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Network': ['ID=ac7191e2-2e1e-4c14-b753-6a321d14e4d8,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:45.692156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:45.694587 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5a0284db-b385-4cb1-a35e-d860c6326b63 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:45.712779 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network ac7191e2-2e1e-4c14-b753-6a321d14e4d8 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:34:45.732261 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Attempting to bind port dadf1f1f-b294-481c-b750-a7e100b498dd on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:34:45.732261 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Attempting to bind port dadf1f1f-b294-481c-b750-a7e100b498dd by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '5c6c2a14-bc6b-4bdd-922e-64008bac747c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:34:45.737040 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:45.741271 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Attempting to bind port dadf1f1f-b294-481c-b750-a7e100b498dd on network a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:45.741271 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 34, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:34:45.741271 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Checking segment: {'id': '5c6c2a14-bc6b-4bdd-922e-64008bac747c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:45.741271 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:45.741271 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Bound using segment: {'id': '5c6c2a14-bc6b-4bdd-922e-64008bac747c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:34:45.741271 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Bound port: dadf1f1f-b294-481c-b750-a7e100b498dd, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5c6c2a14-bc6b-4bdd-922e-64008bac747c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:34:45.741271 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:45.898860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event deleted for resources: {'Port': ['ID=29d0af7f-6b74-411d-b4cd-b92826b2e4ec,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:45.931357 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] For port dadf1f1f-b294-481c-b750-a7e100b498dd, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:34:45.931357 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] For port dadf1f1f-b294-481c-b750-a7e100b498dd, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=dadf1f1f-b294-481c-b750-a7e100b498dd,segment=NetworkSegment(5c6c2a14-bc6b-4bdd-922e-64008bac747c),segment_id=5c6c2a14-bc6b-4bdd-922e-64008bac747c)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:34:45.946315 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:45.970054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-393f145a-0128-41e7-825b-7185bbe0a73e None None] For port 532c185e-12e4-4682-8334-c2f159835951, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=532c185e-12e4-4682-8334-c2f159835951,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:46.102162 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89669d38-d1d2-4543-9d36-e46c22d259ad req-b915f2e1-f9cb-4987-a410-a89ae74099a4 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups?id=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 1.0747411 May 12 15:34:46.176445 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:46.180516 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:46.180516 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:46Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:46.202241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:46.223722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:subnet and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:46.279888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for subnet was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:46.349913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource subnet. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:46.368797 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04f09379-051f-4664-a4aa-3704b969cddc req-b8a1a93e-fc46-45f9-b36e-675ebd770a05 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 210 time: 0.0793054 May 12 15:34:46.368797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port 44c777e1-8b4e-4831-94f3-5c795c9c45a0 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:34:46.432967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Made reservation on behalf of 85d1374188ec4c0ca79f0d59c0d386b5 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:46.432967 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:46.459886 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:46.509200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Transition to ACTIVE for port object d45db345-6e10-417e-8b52-3260151d6ba4 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:46.535168 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:34:46.564785 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:46.640018 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-393f145a-0128-41e7-825b-7185bbe0a73e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:46.646023 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-56880bb2-7a4e-4d9d-a81e-9efb177e73db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:46.723919 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:46.742596 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:46.769622 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:46.797655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-677937e5-10b5-4d4e-8ecb-eb1e8db18c90 None None] Provisioning for port 9c74fa6a-5efc-4eb1-b6c0-520961887d83 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:46.805172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-677937e5-10b5-4d4e-8ecb-eb1e8db18c90 None None] Provisioning complete for port 9c74fa6a-5efc-4eb1-b6c0-520961887d83 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:46.805172 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-677937e5-10b5-4d4e-8ecb-eb1e8db18c90 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:46.832549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Network bca349be-4618-43ae-a547-b8bd2b254da4 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:46.853568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:46.858761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-393f145a-0128-41e7-825b-7185bbe0a73e None None] Pushing event updated for resources: {'Port': ['ID=532c185e-12e4-4682-8334-c2f159835951,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:46.862773 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91c00e4-4869-49a4-837b-40bd651c00e4 None None] Pushing event updated for resources: {'Port': ['ID=dadf1f1f-b294-481c-b750-a7e100b498dd,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:46.873911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:46.916930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-56880bb2-7a4e-4d9d-a81e-9efb177e73db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for 9c74fa6a-5efc-4eb1-b6c0-520961887d83 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:46.982592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-677937e5-10b5-4d4e-8ecb-eb1e8db18c90 None None] Port 9c74fa6a-5efc-4eb1-b6c0-520961887d83 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:34:47.202174 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-56880bb2-7a4e-4d9d-a81e-9efb177e73db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:47.364733 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:37Z', 'revision_number': 4, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:45Z', 'revision_number': 4, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:47.379870 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4fecb2d-c028-49ce-b37e-c27290614cf4 None None] The sync data for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 is: [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:37Z', 'revision_number': 4, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:45Z', 'revision_number': 4, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:34:47.505475 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:47.617623 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-56880bb2-7a4e-4d9d-a81e-9efb177e73db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:47.694757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Pushing event updated for resources: {'Port': ['ID=d45db345-6e10-417e-8b52-3260151d6ba4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:47.740233 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:47.781089 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 532c185e-12e4-4682-8334-c2f159835951 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:47.782257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:47.784319 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:47.858067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56880bb2-7a4e-4d9d-a81e-9efb177e73db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=9c74fa6a-5efc-4eb1-b6c0-520961887d83,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:47.942359 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:34:47.968789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6be9fd21-bb33-48fe-ae67-c31371ee62cd req-290ba2ed-1252-4090-8718-deee062bbf4a tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 210 time: 0.4280894 May 12 15:34:47.978894 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 532c185e-12e4-4682-8334-c2f159835951 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:47.978894 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:47.982918 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-56880bb2-7a4e-4d9d-a81e-9efb177e73db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/9c74fa6a-5efc-4eb1-b6c0-520961887d83 HTTP/1.1" status: 204 len: 168 time: 3.1719532 May 12 15:34:48.038476 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56010) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:48.244587 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:48.253038 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:48.253038 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-fa06fa8c-8f91-4407-992a-d2bcc6223c7c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 5.0033388 May 12 15:34:48.378557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03828aa2-b270-4fd2-ba46-24b4aa13b063 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:48.378557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03828aa2-b270-4fd2-ba46-24b4aa13b063 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:48.378557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-03828aa2-b270-4fd2-ba46-24b4aa13b063 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:48.382294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:34:48.382294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-c1954347-a98e-4b4e-8c75-2a79ea854dd4 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:34:48.385873 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-c1954347-a98e-4b4e-8c75-2a79ea854dd4 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0057983 May 12 15:34:48.424955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Request body: {'port': {'device_id': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:48.467228 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d3cba652-f63d-49d0-b7c5-d70e2b5ef9f1 None None] Provisioning complete for port 532c185e-12e4-4682-8334-c2f159835951 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:48.467228 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d3cba652-f63d-49d0-b7c5-d70e2b5ef9f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:48.514983 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:48.528507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-03828aa2-b270-4fd2-ba46-24b4aa13b063 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:48.529949 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-03828aa2-b270-4fd2-ba46-24b4aa13b063 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.4643133 May 12 15:34:48.539329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56018) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:48.545090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Subnet': ['ID=591a1588-10d4-4137-bac1-05a7d387578c,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:48.550834 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Checking segment: {'id': 'f344cec1-3138-44bd-8d64-09a36451564e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:48.551463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network hostable DHCP agents. Network: ac7191e2-2e1e-4c14-b753-6a321d14e4d8, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:34:48.869725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2123c6d-9e75-40d5-abc9-6625f71a9708 req-22aaa0bf-5e72-44bd-b642-fbc68d8977a6 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:48.882199 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2123c6d-9e75-40d5-abc9-6625f71a9708 req-22aaa0bf-5e72-44bd-b642-fbc68d8977a6 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 931 time: 1.1795058 May 12 15:34:48.904708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d3cba652-f63d-49d0-b7c5-d70e2b5ef9f1 None None] Could not find standard attr ID for object 9c74fa6a-5efc-4eb1-b6c0-520961887d83. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:34:48.974975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-bdbc4b70-4d69-473b-891b-526583d7bbbc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 1ac875b9-81a6-4bbd-9c14-21f72dde4448 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:34:48.978693 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bdbc4b70-4d69-473b-891b-526583d7bbbc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:49.083279 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bdbc4b70-4d69-473b-891b-526583d7bbbc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:49.111344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a918b509-022f-42de-9bf3-3647e1dba46d None None] Provisioning for port d45db345-6e10-417e-8b52-3260151d6ba4 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:49.134521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a918b509-022f-42de-9bf3-3647e1dba46d None None] Provisioning complete for port d45db345-6e10-417e-8b52-3260151d6ba4 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:49.134521 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a918b509-022f-42de-9bf3-3647e1dba46d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:49.179297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network ac7191e2-2e1e-4c14-b753-6a321d14e4d8 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:34:49.216599 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2123c6d-9e75-40d5-abc9-6625f71a9708 req-79a53008-e733-4ea3-93d4-e859ac2240f2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3310494 May 12 15:34:49.223403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, ac7191e2-2e1e-4c14-b753-6a321d14e4d8) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:49.291744 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bdbc4b70-4d69-473b-891b-526583d7bbbc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:49.294753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d7e6d09-7204-4e0a-8582-edf7f14d4b0c None None] Network ac7191e2-2e1e-4c14-b753-6a321d14e4d8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:49.376034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:49.376689 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:49.384397 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bdbc4b70-4d69-473b-891b-526583d7bbbc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:49.523140 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:49.541866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdbc4b70-4d69-473b-891b-526583d7bbbc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=1ac875b9-81a6-4bbd-9c14-21f72dde4448,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:49.541866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0323205-3e70-4216-8b96-e125f25fe1c5 req-d0154455-36ac-4ad3-9b1a-17e20d3918bd tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 210 time: 0.1423550 May 12 15:34:49.555943 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:49.617363 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40b91e96-a60b-432b-b97f-aa1051e2d3b0 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:49.643807 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bdbc4b70-4d69-473b-891b-526583d7bbbc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:49.685252 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0be4632b-a44f-47ed-b357-2102fd71fa0e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 4.3240883 May 12 15:34:49.687321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:34:49.690598 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56032) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:49.696049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dadf1f1f-b294-481c-b750-a7e100b498dd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:49.702247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bdbc4b70-4d69-473b-891b-526583d7bbbc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/1ac875b9-81a6-4bbd-9c14-21f72dde4448 HTTP/1.1" status: 204 len: 168 time: 1.1526656 May 12 15:34:49.703255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56036) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:49.705610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:49.803732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0635e83d-51ce-4b28-970c-41d248415d5f None None] Sync routers for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:34:49.831922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:49.859150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:49.866345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Router a65a1a84-7edf-4d1b-916e-ea737831b2eb is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:34:49.870882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:49.870882 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:49.903188 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a918b509-022f-42de-9bf3-3647e1dba46d None None] Port d45db345-6e10-417e-8b52-3260151d6ba4 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:34:49.907817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=44c777e1-8b4e-4831-94f3-5c795c9c45a0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:49.916247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d6ea6445-e4b6-40ae-b4ed-62444b753004 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.2001235 May 12 15:34:49.923257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4be76a70-b2ea-4987-a349-3a354ca3556d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 845 time: 4.9794202 May 12 15:34:49.923257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56042) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:49.923257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56044) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:49.940956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6ffd979e-cc18-4845-afea-a16d3637713b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:49.953905 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0635e83d-51ce-4b28-970c-41d248415d5f None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:49.953905 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0635e83d-51ce-4b28-970c-41d248415d5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:46Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:50.109897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] No DVR routers for this DVR port 29d0af7f-6b74-411d-b4cd-b92826b2e4ec on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:34:50.145544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dab7c3db-82a5-45a7-a179-9dbec3ee6ac6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:50.145544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-dab7c3db-82a5-45a7-a179-9dbec3ee6ac6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:50.187186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-0635e83d-51ce-4b28-970c-41d248415d5f None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:34:50.196395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6ffd979e-cc18-4845-afea-a16d3637713b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:50.200946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6ffd979e-cc18-4845-afea-a16d3637713b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:50.204134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6ffd979e-cc18-4845-afea-a16d3637713b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:50.210151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6ffd979e-cc18-4845-afea-a16d3637713b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:50.222185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ffd979e-cc18-4845-afea-a16d3637713b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:50.225664 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ffd979e-cc18-4845-afea-a16d3637713b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:50.239918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-dab7c3db-82a5-45a7-a179-9dbec3ee6ac6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:50.243871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dab7c3db-82a5-45a7-a179-9dbec3ee6ac6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/44c777e1-8b4e-4831-94f3-5c795c9c45a0 HTTP/1.1" status: 200 len: 840 time: 0.3145800 May 12 15:34:50.254222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56052) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:50.602498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-b008147e-aa6b-41ba-b124-b53a11b1b66b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 44c777e1-8b4e-4831-94f3-5c795c9c45a0 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:50.602498 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b008147e-aa6b-41ba-b124-b53a11b1b66b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:50.680187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:50.683220 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e85c855e-121d-46aa-b858-2b52263b47c9 req-f0243171-bc46-42fe-af48-9b47587d1b1c tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.84 "DELETE /v2.0/ports/29d0af7f-6b74-411d-b4cd-b92826b2e4ec HTTP/1.1" status: 204 len: 173 time: 13.6730444 May 12 15:34:50.701151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:34:50.714838 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f65087cc-749b-4c96-ab79-5a09dce0864c None None] Sync routers for ids ['a65a1a84-7edf-4d1b-916e-ea737831b2eb'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:34:50.716527 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:50.718958 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-30ccc984-b5e3-433e-9d68-7b62ab97d620 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "PUT /v2.0/routers/a65a1a84-7edf-4d1b-916e-ea737831b2eb HTTP/1.1" status: 200 len: 918 time: 12.7709212 May 12 15:34:50.720018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'name': 'network-vif-deleted', 'tag': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:34:50.727306 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f65087cc-749b-4c96-ab79-5a09dce0864c None None] Routers {'a65a1a84-7edf-4d1b-916e-ea737831b2eb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:50.728777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56060) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:50.730065 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f65087cc-749b-4c96-ab79-5a09dce0864c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:46Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['a65a1a84-7edf-4d1b-916e-ea737831b2eb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:50.785836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port dadf1f1f-b294-481c-b750-a7e100b498dd completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:50.875174 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b008147e-aa6b-41ba-b124-b53a11b1b66b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:50.884467 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f65087cc-749b-4c96-ab79-5a09dce0864c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:50.908814 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f65087cc-749b-4c96-ab79-5a09dce0864c None None] Routers {'a65a1a84-7edf-4d1b-916e-ea737831b2eb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:50.909696 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f65087cc-749b-4c96-ab79-5a09dce0864c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:46Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['a65a1a84-7edf-4d1b-916e-ea737831b2eb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:50.988496 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port dadf1f1f-b294-481c-b750-a7e100b498dd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:50.995260 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:51.010068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-b008147e-aa6b-41ba-b124-b53a11b1b66b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for 44c777e1-8b4e-4831-94f3-5c795c9c45a0 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:51.054339 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f65087cc-749b-4c96-ab79-5a09dce0864c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:51.054726 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f65087cc-749b-4c96-ab79-5a09dce0864c None None] The sync data for ids ['a65a1a84-7edf-4d1b-916e-ea737831b2eb'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:34:51.084747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-845006aa-f919-48a4-993a-2d1c88d2a08b None None] Provisioning complete for port dadf1f1f-b294-481c-b750-a7e100b498dd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:51.085266 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-845006aa-f919-48a4-993a-2d1c88d2a08b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:51.128674 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-054e98fc-1c8e-44fc-9afc-189228298333 req-aa4fec7e-96af-4e86-ac2b-ebe14c09c575 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/ports?device_id=e3c66feb-4fe3-43bf-973e-47d931fd3ede HTTP/1.1" status: 200 len: 210 time: 0.0553329 May 12 15:34:51.312918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-ac7191e2-2e1e-4c14-b753-6a321d14e4d8', 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'fixed_ips': [{'subnet_id': '591a1588-10d4-4137-bac1-05a7d387578c'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:34:51.316299 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:51.344150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0635e83d-51ce-4b28-970c-41d248415d5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:51.358829 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-09c3fb5d-2019-44c4-abea-e4d77c11b5a8'] response: {'server_uuid': 'e3c66feb-4fe3-43bf-973e-47d931fd3ede', 'name': 'network-vif-deleted', 'tag': '29d0af7f-6b74-411d-b4cd-b92826b2e4ec', 'status': 'completed', 'code': 200} May 12 15:34:51.389254 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0635e83d-51ce-4b28-970c-41d248415d5f None None] Checking router: 616c45f4-38af-4ff7-8fb7-f1c61b204b6a for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:34:51.407464 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b008147e-aa6b-41ba-b124-b53a11b1b66b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:51.418608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6cc6b1b-2edb-49f6-bdce-35c7c5a72be8 req-cfccdb07-9c47-44e6-8ed7-8e346aa74d69 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:51.432229 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6cc6b1b-2edb-49f6-bdce-35c7c5a72be8 req-cfccdb07-9c47-44e6-8ed7-8e346aa74d69 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 931 time: 0.9395547 May 12 15:34:51.543380 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-40781086-5ff3-4627-85b4-34c09633a223 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/routers/a65a1a84-7edf-4d1b-916e-ea737831b2eb HTTP/1.1" status: 200 len: 924 time: 0.6831193 May 12 15:34:51.557594 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0635e83d-51ce-4b28-970c-41d248415d5f None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:51.558487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0635e83d-51ce-4b28-970c-41d248415d5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:46Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:51.569308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56068) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:51.599046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b008147e-aa6b-41ba-b124-b53a11b1b66b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=44c777e1-8b4e-4831-94f3-5c795c9c45a0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:51.602730 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ffd979e-cc18-4845-afea-a16d3637713b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:51.707695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ffd979e-cc18-4845-afea-a16d3637713b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=77932d15-465b-422a-86a7-8e543493cdc8,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:51.714061 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6cc6b1b-2edb-49f6-bdce-35c7c5a72be8 req-802fdd1a-d0ca-4677-956f-0ea4463da948 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2808530 May 12 15:34:51.725003 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b008147e-aa6b-41ba-b124-b53a11b1b66b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:51.733448 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ffd979e-cc18-4845-afea-a16d3637713b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:51.738520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-6ffd979e-cc18-4845-afea-a16d3637713b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:51.745633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ffd979e-cc18-4845-afea-a16d3637713b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:51.747055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ffd979e-cc18-4845-afea-a16d3637713b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:51.765302 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-0635e83d-51ce-4b28-970c-41d248415d5f None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:34:51.767197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b008147e-aa6b-41ba-b124-b53a11b1b66b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/44c777e1-8b4e-4831-94f3-5c795c9c45a0 HTTP/1.1" status: 204 len: 168 time: 1.5115647 May 12 15:34:51.770499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56072) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:51.829706 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-cc9ddd73-8be2-4c3e-8c2d-33e64f954eea tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] GET failed (client error): The resource could not be found. May 12 15:34:51.830731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cc9ddd73-8be2-4c3e-8c2d-33e64f954eea tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:51.846026 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6ffd979e-cc18-4845-afea-a16d3637713b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.9183953 May 12 15:34:51.848684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56076) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:51.854677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'fixed_ips': [{'subnet_id': '77932d15-465b-422a-86a7-8e543493cdc8', 'ip_address': '2001:db8::ab41:27bb:ecf8:9109'}], 'name': 'tempest-NetworksTestDHCPv6-1955507279'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:51.861294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a89acd9d-001e-4f44-b0d6-454966823b6d tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:51.862808 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a89acd9d-001e-4f44-b0d6-454966823b6d tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/ports?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&device_id=a65a1a84-7edf-4d1b-916e-ea737831b2eb&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.2920511 May 12 15:34:51.899772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56080) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:51.934243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30c9b168-c516-4c53-8565-8544d5c083f5 None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:34:51.945787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cc9ddd73-8be2-4c3e-8c2d-33e64f954eea tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:34:51.947443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cc9ddd73-8be2-4c3e-8c2d-33e64f954eea tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/44c777e1-8b4e-4831-94f3-5c795c9c45a0 HTTP/1.1" status: 404 len: 333 time: 0.1754367 May 12 15:34:51.954451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56084) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:51.963657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'name': 'tempest-PortsTestJSON-1559521349'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:52.025004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-30c9b168-c516-4c53-8565-8544d5c083f5 None None] Deleting port 532c185e-12e4-4682-8334-c2f159835951 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:52.025288 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30c9b168-c516-4c53-8565-8544d5c083f5 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:52.051384 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-845006aa-f919-48a4-993a-2d1c88d2a08b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:52.070221 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:52.078347 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:52.110455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:52.139238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:52.166770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:52.172176 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:52.203310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:52.208374 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:port and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:52.211810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:52.218845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:52.237678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port b368070a-3a9d-418c-bae3-26f7affe7e75 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:34:52.406333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-845006aa-f919-48a4-993a-2d1c88d2a08b None None] For port dadf1f1f-b294-481c-b750-a7e100b498dd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=dadf1f1f-b294-481c-b750-a7e100b498dd,segment=NetworkSegment(5c6c2a14-bc6b-4bdd-922e-64008bac747c),segment_id=5c6c2a14-bc6b-4bdd-922e-64008bac747c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:52.530110 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-845006aa-f919-48a4-993a-2d1c88d2a08b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:52.554348 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:52.580615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56094) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:52.585337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:34:52.695283 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-356a18dd-4b1d-4b86-b8db-18dfa9582756 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:52.696646 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-356a18dd-4b1d-4b86-b8db-18dfa9582756 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 881 time: 0.7929862 May 12 15:34:52.700274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56098) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:52.713219 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:52.745976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d45db345-6e10-417e-8b52-3260151d6ba4 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:34:52.764967 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:52.769306 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-472decef-33e5-4529-95dc-d0e7e7307d29 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "GET /v2.0/ports?device_id=a65a1a84-7edf-4d1b-916e-ea737831b2eb HTTP/1.1" status: 200 len: 205 time: 0.0675719 May 12 15:34:52.782770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56104) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:52.789993 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:34:52.790582 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:34:52.797597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Transition to ACTIVE for port object d45db345-6e10-417e-8b52-3260151d6ba4 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:52.802252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:52.835679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Allocated IP 2001:db8:3::2 (ac7191e2-2e1e-4c14-b753-6a321d14e4d8/591a1588-10d4-4137-bac1-05a7d387578c/1cca781e-5a14-42d3-a1b8-ad1abcb84f0c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:52.868584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-845006aa-f919-48a4-993a-2d1c88d2a08b None None] Pushing event updated for resources: {'Port': ['ID=dadf1f1f-b294-481c-b750-a7e100b498dd,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:53.042355 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-30c9b168-c516-4c53-8565-8544d5c083f5 None None] For port 532c185e-12e4-4682-8334-c2f159835951, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=532c185e-12e4-4682-8334-c2f159835951,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:53.043636 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30c9b168-c516-4c53-8565-8544d5c083f5 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:53.052082 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:53.076940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Attempting to bind port d45db345-6e10-417e-8b52-3260151d6ba4 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:34:53.077528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Attempting to bind port d45db345-6e10-417e-8b52-3260151d6ba4 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:34:53.077688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Attempting to bind port d45db345-6e10-417e-8b52-3260151d6ba4 on network bca349be-4618-43ae-a547-b8bd2b254da4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:53.085809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Port d45db345-6e10-417e-8b52-3260151d6ba4 on network bca349be-4618-43ae-a547-b8bd2b254da4 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:34:53.086144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Attempting to bind port d45db345-6e10-417e-8b52-3260151d6ba4 on network bca349be-4618-43ae-a547-b8bd2b254da4 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:53.093105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Pushing event updated for resources: {'Port': ['ID=d45db345-6e10-417e-8b52-3260151d6ba4,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:53.106680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 34, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:34:53.107020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Checking segment: {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:53.107391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Bound using segment: {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:34:53.107827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Bound port: d45db345-6e10-417e-8b52-3260151d6ba4, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '60811cb9-2374-4869-8102-d13af82449fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:34:53.108175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:53.118146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:53.118487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:53.118822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:53.119129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:53.119454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:53.119777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:53.120104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:53.120405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:53.121001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:53.121364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:53.121663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:53.121954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:34:53.139807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:53.153590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:53.161314 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:53.224336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] For port d45db345-6e10-417e-8b52-3260151d6ba4, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:34:53.228185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] For port d45db345-6e10-417e-8b52-3260151d6ba4, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d45db345-6e10-417e-8b52-3260151d6ba4,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:34:53.234013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-30c9b168-c516-4c53-8565-8544d5c083f5 None None] Calling delete_port for 532c185e-12e4-4682-8334-c2f159835951 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:53.237361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port e07ac8ab-b2de-4401-ab99-c08c96ce7d1a yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:34:53.245693 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:53.302537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:53.308872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:53.309853 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:53.317217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0635e83d-51ce-4b28-970c-41d248415d5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:53.324658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=b368070a-3a9d-418c-bae3-26f7affe7e75,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:53.359462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30c9b168-c516-4c53-8565-8544d5c083f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:53.380085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:53.380838 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:53.382369 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] 10.222.0.76 "PUT /v2.0/ports/d45db345-6e10-417e-8b52-3260151d6ba4 HTTP/1.1" status: 200 len: 1091 time: 4.9762015 May 12 15:34:53.382915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'tag': 'd45db345-6e10-417e-8b52-3260151d6ba4'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:34:53.462392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91b561e2-7cd1-4fb5-b01c-06f6cedc2ed4 service neutron] Pushing event updated for resources: {'Port': ['ID=d45db345-6e10-417e-8b52-3260151d6ba4,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:53.504539 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1ec049f4-9fe5-4fa9-8568-1a3798062164'] response: {'name': 'network-changed', 'server_uuid': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'tag': 'd45db345-6e10-417e-8b52-3260151d6ba4', 'status': 'completed', 'code': 200} May 12 15:34:53.562997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0635e83d-51ce-4b28-970c-41d248415d5f None None] The sync data for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 is: [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '5ca267b9-8aa5-4388-b459-c37844d97daf', 'name': '', 'network_id': 'dbecac63-cd00-4ee6-bec1-19abe557d6e1', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'mac_address': 'fa:16:3e:70:50:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2005, 'fixed_ips': [{'subnet_id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:45Z', 'updated_at': '2022-05-12T15:27:57Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'subnets': [{'id': '7cf2ffc4-f41f-40e3-90d1-77e214ee94e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:34:53.608256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30c9b168-c516-4c53-8565-8544d5c083f5 None None] No DVR routers for this DVR port 532c185e-12e4-4682-8334-c2f159835951 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:34:53.669339 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:53.690065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Transition to ACTIVE for port object 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:53.705900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30c9b168-c516-4c53-8565-8544d5c083f5 None None] Pushing event deleted for resources: {'Port': ['ID=532c185e-12e4-4682-8334-c2f159835951,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:53.725234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-001f8bad-5a50-4152-8798-d55a39847f75 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:53.736729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-153cb8c1-7a2d-4b44-bfaf-7134cc35d3c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:53.738875 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-153cb8c1-7a2d-4b44-bfaf-7134cc35d3c1 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 1094 time: 0.2953303 May 12 15:34:53.794427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Transition to ACTIVE for port object 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:53.821611 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4bb6bdf0-7b13-4f11-9a65-e74f02865445 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:53.840672 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-3040b79d-0648-4412-b49e-45f15c4096e6 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d45db345-6e10-417e-8b52-3260151d6ba4 HTTP/1.1" status: 200 len: 217 time: 0.0925860 May 12 15:34:53.843654 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d26e9b46-79ad-4386-8297-99be5f086027 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 1.8878808 May 12 15:34:53.857506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56122) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:53.873821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d4943cb6-c4f5-4036-9621-e2f79bdd8494 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:53.924367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-5b30b766-1064-4be0-86aa-090b90227a02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:53.926022 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-5b30b766-1064-4be0-86aa-090b90227a02 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.0798194 May 12 15:34:54.030795 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:54.041758 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4bb6bdf0-7b13-4f11-9a65-e74f02865445 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:54.053825 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:54.079492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Allocated IP 2001:db8:3::1 (ac7191e2-2e1e-4c14-b753-6a321d14e4d8/591a1588-10d4-4137-bac1-05a7d387578c/ab6c816d-4cf1-4fba-a817-8e43af7420e8) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:54.085223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Deleting port 08c41689-8b1e-483d-9333-e99567852512 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:54.085636 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:54.109308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-493df7e0-8a8b-4ef9-b75f-94fc9f53bc63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:54.111063 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-493df7e0-8a8b-4ef9-b75f-94fc9f53bc63 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1786542 May 12 15:34:54.126541 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3191330-bc81-4458-9ab3-f100bc02f9f7 None None] New status for floating IP 5aca4875-736a-41d6-bb44-0bc0ffee31c1: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:34:54.231181 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dadf1f1f-b294-481c-b750-a7e100b498dd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:54.304884 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:54.307348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Network ac7191e2-2e1e-4c14-b753-6a321d14e4d8 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:54.410768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:54.428167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:54.435774 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-8d71c3e8-80d1-458f-bce6-42bb37bceae2 service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3063736 May 12 15:34:54.441117 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:54.469798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72da2443-71f9-4130-8dee-3a37a076b97f req-e4e6b42b-04e0-4e4b-95e0-8b71d8425c65 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:54.471473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72da2443-71f9-4130-8dee-3a37a076b97f req-e4e6b42b-04e0-4e4b-95e0-8b71d8425c65 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 943 time: 1.4733515 May 12 15:34:54.481443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Calling delete_port for 08c41689-8b1e-483d-9333-e99567852512 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:54.489258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Pushing event updated for resources: {'Port': ['ID=1cca781e-5a14-42d3-a1b8-ad1abcb84f0c,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:54.545082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Transition to ACTIVE for port object ab6c816d-4cf1-4fba-a817-8e43af7420e8 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:54.587919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '77932d15-465b-422a-86a7-8e543493cdc8'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:34:54.589672 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:54.602709 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96c32586-6c44-4fb5-9d4b-19d12254ef59 req-1f8c2c53-91a3-4e86-863f-2bb7088f2c43 service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1581130 May 12 15:34:54.619106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::ab41:27bb:ecf8:9109 (2447b094-d5d6-41ef-a146-2bf56f5399af/77932d15-465b-422a-86a7-8e543493cdc8/e07ac8ab-b2de-4401-ab99-c08c96ce7d1a) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:54.623751 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:54.695507 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d4943cb6-c4f5-4036-9621-e2f79bdd8494 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:54.718019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72da2443-71f9-4130-8dee-3a37a076b97f req-71d66320-18a6-4b86-9766-06ec7bea4778 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1962495 May 12 15:34:54.811254 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Attempting to bind port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:34:54.811592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Attempting to bind port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'f344cec1-3138-44bd-8d64-09a36451564e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:34:54.812148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Attempting to bind port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c on network ac7191e2-2e1e-4c14-b753-6a321d14e4d8 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:54.818931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port dadf1f1f-b294-481c-b750-a7e100b498dd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:54.819505 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:54.864743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 34, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:34:54.865454 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Checking segment: {'id': 'f344cec1-3138-44bd-8d64-09a36451564e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:54.866017 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:54.866682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Bound using segment: {'id': 'f344cec1-3138-44bd-8d64-09a36451564e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:34:54.867311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Bound port: 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f344cec1-3138-44bd-8d64-09a36451564e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:34:54.867844 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:54.870289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network ac7191e2-2e1e-4c14-b753-6a321d14e4d8 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:54.906731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=ab6c816d-4cf1-4fba-a817-8e43af7420e8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:54.920421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:54.927740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:54.928540 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:55.049791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] For port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:34:55.064648 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] For port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1cca781e-5a14-42d3-a1b8-ad1abcb84f0c,segment=NetworkSegment(f344cec1-3138-44bd-8d64-09a36451564e),segment_id=f344cec1-3138-44bd-8d64-09a36451564e)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:34:55.072806 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:55.161469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 532c185e-12e4-4682-8334-c2f159835951 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:34:55.210436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 532c185e-12e4-4682-8334-c2f159835951 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:34:55.210819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 532c185e-12e4-4682-8334-c2f159835951 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:34:55.215158 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4bb6bdf0-7b13-4f11-9a65-e74f02865445 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:55.216210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a65aee4-44a9-4b8d-bd30-53f613220d78 None None] Pushing event updated for resources: {'Port': ['ID=1cca781e-5a14-42d3-a1b8-ad1abcb84f0c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:55.305546 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:55.337698 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:55.358170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bb6bdf0-7b13-4f11-9a65-e74f02865445 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:55.381202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object e07ac8ab-b2de-4401-ab99-c08c96ce7d1a will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:55.396319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b1f90c3-3176-4f2e-83b6-ed4adb9b0e35 req-b4553f27-d588-4127-9a92-8f0078b5dd8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:55.398363 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b1f90c3-3176-4f2e-83b6-ed4adb9b0e35 req-b4553f27-d588-4127-9a92-8f0078b5dd8e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 1094 time: 0.7207968 May 12 15:34:55.411162 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d4943cb6-c4f5-4036-9621-e2f79bdd8494 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:55.430301 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4bb6bdf0-7b13-4f11-9a65-e74f02865445 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:55.431474 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4bb6bdf0-7b13-4f11-9a65-e74f02865445 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "DELETE /v2.0/security-groups/c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d HTTP/1.1" status: 204 len: 168 time: 2.8479664 May 12 15:34:55.435428 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d4943cb6-c4f5-4036-9621-e2f79bdd8494 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:55.439112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56128) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:55.563692 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-108411dc-dcf1-43df-b74d-cf7afc9fabe0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] show failed (client error): The resource could not be found. May 12 15:34:55.564375 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-108411dc-dcf1-43df-b74d-cf7afc9fabe0 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "GET /v2.0/security-groups/c7c9141f-6cf0-4d8c-ac79-933fc13a2e0d HTTP/1.1" status: 404 len: 347 time: 0.0893757 May 12 15:34:55.565364 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d4943cb6-c4f5-4036-9621-e2f79bdd8494 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] In _notify_port_updated(), no bound segment for port b368070a-3a9d-418c-bae3-26f7affe7e75 on network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 {{(pid=88152) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:34:55.571010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4943cb6-c4f5-4036-9621-e2f79bdd8494 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:55.572088 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d4943cb6-c4f5-4036-9621-e2f79bdd8494 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:55.577181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d4943cb6-c4f5-4036-9621-e2f79bdd8494 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "PUT /v2.0/ports/b368070a-3a9d-418c-bae3-26f7affe7e75 HTTP/1.1" status: 200 len: 818 time: 1.7152748 May 12 15:34:55.583796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56132) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:55.584124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56134) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:55.751697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b1f90c3-3176-4f2e-83b6-ed4adb9b0e35 req-ccba0f20-8acb-4bd5-8230-3d5094bfde4e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:55.753163 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b1f90c3-3176-4f2e-83b6-ed4adb9b0e35 req-ccba0f20-8acb-4bd5-8230-3d5094bfde4e service neutron] 10.222.0.76 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 0.2903633 May 12 15:34:55.906156 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b1f90c3-3176-4f2e-83b6-ed4adb9b0e35 req-14e54c7a-b93a-4770-b22f-da09f4514974 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d45db345-6e10-417e-8b52-3260151d6ba4 HTTP/1.1" status: 200 len: 217 time: 0.1459241 May 12 15:34:55.956109 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:56.020902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b1f90c3-3176-4f2e-83b6-ed4adb9b0e35 req-4d39ff8e-3487-45cf-b4cf-8647bd9f90f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:56.022435 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b1f90c3-3176-4f2e-83b6-ed4adb9b0e35 req-4d39ff8e-3487-45cf-b4cf-8647bd9f90f1 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.1105287 May 12 15:34:56.050816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4943cb6-c4f5-4036-9621-e2f79bdd8494 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=b368070a-3a9d-418c-bae3-26f7affe7e75,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:56.117825 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:56.127084 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:56.127924 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:56.232312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Allocated IP 2001:db8::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/77932d15-465b-422a-86a7-8e543493cdc8/f8e65e51-48c5-4193-a7f4-f567d228528d) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:34:56.285520 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:34:56.336559 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:56.439038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Pushing event deleted for resources: {'Port': ['ID=08c41689-8b1e-483d-9333-e99567852512,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:56.476953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b1f90c3-3176-4f2e-83b6-ed4adb9b0e35 req-65e3037e-9af5-41aa-bd41-fae9b4fb9ef3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:56.491159 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b1f90c3-3176-4f2e-83b6-ed4adb9b0e35 req-65e3037e-9af5-41aa-bd41-fae9b4fb9ef3 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4621902 May 12 15:34:56.749839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-6e24472a-03a9-4cff-9acb-3a4e42126474 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port b368070a-3a9d-418c-bae3-26f7affe7e75 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:56.752514 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e24472a-03a9-4cff-9acb-3a4e42126474 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:56.792043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:56.808681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Deleting port d5025d43-7a0f-46ba-97ea-994ee9b2abb5 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:34:56.809425 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:56.853069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Network ac7191e2-2e1e-4c14-b753-6a321d14e4d8 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:56.867772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:56.872881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event updated for resources: {'Port': ['ID=ab6c816d-4cf1-4fba-a817-8e43af7420e8,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:56.995480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:57.002938 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=e07ac8ab-b2de-4401-ab99-c08c96ce7d1a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:57.014033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:57.015965 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cebfb700-0257-4491-aab2-7566829fde7c None None] Network ac7191e2-2e1e-4c14-b753-6a321d14e4d8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:34:57.032856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:57.039155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:57.039384 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:57.043963 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:57.085212 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:57.126125 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b1f90c3-3176-4f2e-83b6-ed4adb9b0e35 req-ef933467-57f4-4962-99c7-54aceda82d9d service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4887021 May 12 15:34:57.163823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 397feb9b-2f46-4c79-af57-634897d5df53 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:34:57.166253 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Transition to ACTIVE for port object f8e65e51-48c5-4193-a7f4-f567d228528d will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:57.200070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-eab17f6c-0f10-4532-a829-247f9c1d64df None None] Provisioning for port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:57.228772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Transition to ACTIVE for port object f8e65e51-48c5-4193-a7f4-f567d228528d will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:34:57.236320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-eab17f6c-0f10-4532-a829-247f9c1d64df None None] Provisioning complete for port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:57.236936 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eab17f6c-0f10-4532-a829-247f9c1d64df None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:57.312810 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:57.315259 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:57.432340 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:57.533698 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:57.534223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Fanout notify agent at l3_agent the message router_deleted on router a65a1a84-7edf-4d1b-916e-ea737831b2eb {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:34:57.601474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Pushing event updated for resources: {'Port': ['ID=f8e65e51-48c5-4193-a7f4-f567d228528d,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:57.642132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:34:57.643568 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3961cd3a-5b1f-4937-a97f-ed03a134df9e req-55c7e2dc-0677-400f-b0d8-d2964322a592 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:57.645260 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3961cd3a-5b1f-4937-a97f-ed03a134df9e req-55c7e2dc-0677-400f-b0d8-d2964322a592 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 943 time: 1.6768167 May 12 15:34:57.664927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:34:57.675648 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-065a8238-7879-46bf-bff8-d98fef6ca176 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.9811726 May 12 15:34:57.678987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56262) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:57.690749 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:57.693701 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Sync routers for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:34:57.696499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6bf3f3ff-fead-4f27-a67e-51a6e82f87bd tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'router': {'routes': [{'nexthop': '2001:db8:1::2', 'destination': '2001:db8:1::/64'}, {'nexthop': '2001:db8:2::2', 'destination': '2001:db8:2::/64'}, {'nexthop': '2001:db8:3::2', 'destination': '2001:db8:3::/64'}, {'nexthop': '2001:db8::2', 'destination': '2001:db8::/64'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:57.706863 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e619f566-8bae-414e-b369-0c28a4f4656b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "DELETE /v2.0/routers/a65a1a84-7edf-4d1b-916e-ea737831b2eb HTTP/1.1" status: 204 len: 168 time: 4.9095736 May 12 15:34:57.708112 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:34:57.709850 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:46Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:57.719750 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c532ef64-50a6-4820-90d3-8534e31cafc4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 5.8696141 May 12 15:34:57.736245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56268) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:57.736740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56270) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:34:57.829483 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b1f90c3-3176-4f2e-83b6-ed4adb9b0e35 req-a4a89017-2bfb-4b5e-92e8-9a87e586f620 service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6967511 May 12 15:34:57.838458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:34:57.843312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:34:57.893552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0d595e75-623e-42b7-8852-40ec429735b2 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-505725661', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:34:57.973834 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d45db345-6e10-417e-8b52-3260151d6ba4 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:34:57.974670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0d595e75-623e-42b7-8852-40ec429735b2 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:34:58.012241 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eab17f6c-0f10-4532-a829-247f9c1d64df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:58.060358 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Attempting to bind port f8e65e51-48c5-4193-a7f4-f567d228528d on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:34:58.060358 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Attempting to bind port f8e65e51-48c5-4193-a7f4-f567d228528d by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:34:58.060672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Attempting to bind port f8e65e51-48c5-4193-a7f4-f567d228528d on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:34:58.086209 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-eab17f6c-0f10-4532-a829-247f9c1d64df None None] For port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1cca781e-5a14-42d3-a1b8-ad1abcb84f0c,segment=NetworkSegment(f344cec1-3138-44bd-8d64-09a36451564e),segment_id=f344cec1-3138-44bd-8d64-09a36451564e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:58.091555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 34, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:34:58.092015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:34:58.092580 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:58.093073 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:34:58.094180 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Bound port: f8e65e51-48c5-4193-a7f4-f567d228528d, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:34:58.094634 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:58.114491 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eab17f6c-0f10-4532-a829-247f9c1d64df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:58.117475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0d595e75-623e-42b7-8852-40ec429735b2 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Usage tracker for resource:router and tenant:b68c8c6134e345c4b780c4a4abc4688f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:34:58.157792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0d595e75-623e-42b7-8852-40ec429735b2 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:34:58.174098 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:34:58.178881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0d595e75-623e-42b7-8852-40ec429735b2 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:34:58.192385 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:58.192898 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:58.204451 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3961cd3a-5b1f-4937-a97f-ed03a134df9e req-63de3c4a-ef36-46cc-bfce-5d361433aa37 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4757349 May 12 15:34:58.241600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab17f6c-0f10-4532-a829-247f9c1d64df None None] Pushing event updated for resources: {'Port': ['ID=1cca781e-5a14-42d3-a1b8-ad1abcb84f0c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:58.249492 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] It took 0.19 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:34:58.309152 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e24472a-03a9-4cff-9acb-3a4e42126474 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:58.389084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Calling delete_port for d5025d43-7a0f-46ba-97ea-994ee9b2abb5 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:58.650122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] For port f8e65e51-48c5-4193-a7f4-f567d228528d, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:34:58.658600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] For port f8e65e51-48c5-4193-a7f4-f567d228528d, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f8e65e51-48c5-4193-a7f4-f567d228528d,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:34:58.670407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d45db345-6e10-417e-8b52-3260151d6ba4, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d45db345-6e10-417e-8b52-3260151d6ba4,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:58.686831 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:58.782832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'd45db345-6e10-417e-8b52-3260151d6ba4', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'port_id': 'd45db345-6e10-417e-8b52-3260151d6ba4', 'mac_address': 'fa:16:3e:bc:94:89', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 581, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:34:58.861307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-66544393-115c-4559-a656-c0381b65a40d None None] Provisioning complete for port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:58.861700 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-66544393-115c-4559-a656-c0381b65a40d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:58.953003 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45f8538c-8b50-4bd7-aa22-28f9467e38c0 None None] Pushing event updated for resources: {'Port': ['ID=f8e65e51-48c5-4193-a7f4-f567d228528d,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:58.975812 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:59.002489 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d45db345-6e10-417e-8b52-3260151d6ba4 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:34:59.054334 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d45db345-6e10-417e-8b52-3260151d6ba4, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d45db345-6e10-417e-8b52-3260151d6ba4,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:34:59.061669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.extraroute_db [None req-6bf3f3ff-fead-4f27-a67e-51a6e82f87bd tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Added routes are [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}] {{(pid=88151) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:114}} May 12 15:34:59.084744 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d595e75-623e-42b7-8852-40ec429735b2 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:59.090530 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d595e75-623e-42b7-8852-40ec429735b2 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:59.113123 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:59.128458 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-578e0eeb-d2d0-485c-8b74-441e84821908 req-3484c8d9-12e8-4f39-9213-4c6d51c003dc service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.3513846 May 12 15:34:59.130838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.extraroute_db [None req-6bf3f3ff-fead-4f27-a67e-51a6e82f87bd tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Removed routes are [] {{(pid=88151) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:122}} May 12 15:34:59.131816 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bf3f3ff-fead-4f27-a67e-51a6e82f87bd tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:59.274878 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:55Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ab6c816d-4cf1-4fba-a817-8e43af7420e8', 'name': '', 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:ea:65:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2676, 'fixed_ips': [{'subnet_id': '591a1588-10d4-4137-bac1-05a7d387578c', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:52Z', 'updated_at': '2022-05-12T15:34:55Z', 'revision_number': 2, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '591a1588-10d4-4137-bac1-05a7d387578c', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:52Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:34:59.289575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06b110c7-85a5-4e5a-a123-9fa4e1659eaf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:59.309123 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Checking router: 397feb9b-2f46-4c79-af57-634897d5df53 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:34:59.309549 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Updating router 397feb9b-2f46-4c79-af57-634897d5df53 port ab6c816d-4cf1-4fba-a817-8e43af7420e8 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:34:59.348056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06b110c7-85a5-4e5a-a123-9fa4e1659eaf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:59.351134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-06b110c7-85a5-4e5a-a123-9fa4e1659eaf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:34:59.369819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['d45db345-6e10-417e-8b52-3260151d6ba4'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:34:59.416302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-6e24472a-03a9-4cff-9acb-3a4e42126474 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for b368070a-3a9d-418c-bae3-26f7affe7e75 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:34:59.494947 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:59.497913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d45db345-6e10-417e-8b52-3260151d6ba4,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:34:59.549242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-66544393-115c-4559-a656-c0381b65a40d None None] Provisioning for port ab6c816d-4cf1-4fba-a817-8e43af7420e8 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:34:59.563067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-66544393-115c-4559-a656-c0381b65a40d None None] Provisioning complete for port ab6c816d-4cf1-4fba-a817-8e43af7420e8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:59.563655 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-66544393-115c-4559-a656-c0381b65a40d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:59.624003 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d595e75-623e-42b7-8852-40ec429735b2 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:59.761961 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-66544393-115c-4559-a656-c0381b65a40d None None] Port ab6c816d-4cf1-4fba-a817-8e43af7420e8 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:34:59.896712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0fa805be-78a3-4b89-b09b-244e149fff5d None None] Provisioning complete for port ab6c816d-4cf1-4fba-a817-8e43af7420e8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:34:59.897152 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0fa805be-78a3-4b89-b09b-244e149fff5d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:59.924008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-578e0eeb-d2d0-485c-8b74-441e84821908 req-d151499f-0387-4e09-b362-42a556460615 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:34:59.925559 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-578e0eeb-d2d0-485c-8b74-441e84821908 req-d151499f-0387-4e09-b362-42a556460615 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 1097 time: 0.6262074 May 12 15:34:59.976442 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:34:59.985378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0fa805be-78a3-4b89-b09b-244e149fff5d None None] Port ab6c816d-4cf1-4fba-a817-8e43af7420e8 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:35:00.020774 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bf3f3ff-fead-4f27-a67e-51a6e82f87bd tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:00.026162 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bf3f3ff-fead-4f27-a67e-51a6e82f87bd tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:00.157159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Pushing event deleted for resources: {'Port': ['ID=d5025d43-7a0f-46ba-97ea-994ee9b2abb5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:00.169791 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d595e75-623e-42b7-8852-40ec429735b2 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:00.189197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-06b110c7-85a5-4e5a-a123-9fa4e1659eaf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:00.190878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-06b110c7-85a5-4e5a-a123-9fa4e1659eaf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1685 time: 2.4399872 May 12 15:35:00.277329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:00.277707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:00.278045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:00.278380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:00.278791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:00.280620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:00.280956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:00.281276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:00.289643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:00.301335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:00.302028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:00.302553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:00.311499 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:00.314588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56512) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:00.361923 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Transition to ACTIVE for port object ab6c816d-4cf1-4fba-a817-8e43af7420e8 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:00.371442 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:00.380716 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:00.563204 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:00.563767 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:00.612150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-578e0eeb-d2d0-485c-8b74-441e84821908 req-b9ff1b2e-19e4-4a9c-9b3d-a69873511efc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:00.614483 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-578e0eeb-d2d0-485c-8b74-441e84821908 req-b9ff1b2e-19e4-4a9c-9b3d-a69873511efc service neutron] 10.222.0.76 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 0.6539512 May 12 15:35:00.698361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9f29f7e3-20a2-4a6a-a058-1ae5a547e9d7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port e07ac8ab-b2de-4401-ab99-c08c96ce7d1a {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:00.698711 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f29f7e3-20a2-4a6a-a058-1ae5a547e9d7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:00.740644 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e24472a-03a9-4cff-9acb-3a4e42126474 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:00.824234 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Attempting to bind port ab6c816d-4cf1-4fba-a817-8e43af7420e8 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:35:00.824803 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Attempting to bind port ab6c816d-4cf1-4fba-a817-8e43af7420e8 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'f344cec1-3138-44bd-8d64-09a36451564e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:35:00.825271 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Attempting to bind port ab6c816d-4cf1-4fba-a817-8e43af7420e8 on network ac7191e2-2e1e-4c14-b753-6a321d14e4d8 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:35:00.865168 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 34, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:35:00.865578 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Checking segment: {'id': 'f344cec1-3138-44bd-8d64-09a36451564e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:35:00.865977 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:00.866465 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Bound using segment: {'id': 'f344cec1-3138-44bd-8d64-09a36451564e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:35:00.867035 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Bound port: ab6c816d-4cf1-4fba-a817-8e43af7420e8, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f344cec1-3138-44bd-8d64-09a36451564e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:35:00.867379 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:00.893085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f8e65e51-48c5-4193-a7f4-f567d228528d up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:00.981177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-efa03232-e186-464a-be29-e912c0ced84a None None] Provisioning for port f8e65e51-48c5-4193-a7f4-f567d228528d completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:01.023329 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0d595e75-623e-42b7-8852-40ec429735b2 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:01.025440 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0d595e75-623e-42b7-8852-40ec429735b2 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 3.2854791 May 12 15:35:01.026390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f8e65e51-48c5-4193-a7f4-f567d228528d completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:01.039478 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f8e65e51-48c5-4193-a7f4-f567d228528d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:01.041669 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:01.051771 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:01.052655 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-578e0eeb-d2d0-485c-8b74-441e84821908 req-b9e5272c-8aa6-4e1c-b88e-248da4dbd599 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=89f8d6b5-809f-446f-bb95-9e0f45b66f60 HTTP/1.1" status: 200 len: 217 time: 0.3245642 May 12 15:35:01.055380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56600) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:01.062744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'enable_snat': False}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:01.078794 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:01.084551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-347a18eb-9d25-4f9c-89a2-63b676becb08 tempest-AttachVolumeNegativeTest-306395607 tempest-AttachVolumeNegativeTest-306395607-project] 10.222.0.82 "DELETE /v2.0/floatingips/5aca4875-736a-41d6-bb44-0bc0ffee31c1 HTTP/1.1" status: 204 len: 168 time: 5.4213691 May 12 15:35:01.102381 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] For port ab6c816d-4cf1-4fba-a817-8e43af7420e8, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:35:01.107075 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] For port ab6c816d-4cf1-4fba-a817-8e43af7420e8, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ab6c816d-4cf1-4fba-a817-8e43af7420e8,segment=NetworkSegment(f344cec1-3138-44bd-8d64-09a36451564e),segment_id=f344cec1-3138-44bd-8d64-09a36451564e)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:35:01.109125 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0f3bf31-6ca4-4e00-847d-0902571ecd21 None None] Pushing event updated for resources: {'Port': ['ID=ab6c816d-4cf1-4fba-a817-8e43af7420e8,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:01.119333 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:01.154948 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e24472a-03a9-4cff-9acb-3a4e42126474 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:01.158062 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6e24472a-03a9-4cff-9acb-3a4e42126474 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/b368070a-3a9d-418c-bae3-26f7affe7e75 HTTP/1.1" status: 204 len: 168 time: 5.4864383 May 12 15:35:01.166732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e24472a-03a9-4cff-9acb-3a4e42126474 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=b368070a-3a9d-418c-bae3-26f7affe7e75,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:01.174553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56610) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:01.272984 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:01.273911 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:46Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:01.324681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6bf3f3ff-fead-4f27-a67e-51a6e82f87bd tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 397feb9b-2f46-4c79-af57-634897d5df53 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:35:01.352050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2f19510-24c3-42fc-815f-021b8041f6f8 req-f85f3bf4-32cd-48e1-b1d1-f0d24354ba34 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:01.353681 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2f19510-24c3-42fc-815f-021b8041f6f8 req-f85f3bf4-32cd-48e1-b1d1-f0d24354ba34 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 944 time: 1.7597399 May 12 15:35:01.423007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7275a445-6c3d-4157-bbb4-7c840cce67e3 None None] Provisioning for port e07ac8ab-b2de-4401-ab99-c08c96ce7d1a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:01.451517 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7275a445-6c3d-4157-bbb4-7c840cce67e3 None None] Provisioning complete for port e07ac8ab-b2de-4401-ab99-c08c96ce7d1a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:01.451867 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7275a445-6c3d-4157-bbb4-7c840cce67e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:01.546854 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:01.608019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-7275a445-6c3d-4157-bbb4-7c840cce67e3 None None] Port e07ac8ab-b2de-4401-ab99-c08c96ce7d1a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:35:01.619871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port f8e65e51-48c5-4193-a7f4-f567d228528d, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f8e65e51-48c5-4193-a7f4-f567d228528d,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:01.620495 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0f3bf31-6ca4-4e00-847d-0902571ecd21 None None] Pushing event updated for resources: {'Port': ['ID=ab6c816d-4cf1-4fba-a817-8e43af7420e8,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:01.625826 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:01.627923 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2f19510-24c3-42fc-815f-021b8041f6f8 req-67aca6fb-6574-4167-ad96-bb97ab4b3191 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2070193 May 12 15:35:01.644371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36ff2a13-7fe0-44cc-8ad4-30eabf28731a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:01.645289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-36ff2a13-7fe0-44cc-8ad4-30eabf28731a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:01.659751 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:01.676396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-36ff2a13-7fe0-44cc-8ad4-30eabf28731a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:01.680107 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-36ff2a13-7fe0-44cc-8ad4-30eabf28731a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 0.4876621 May 12 15:35:01.685311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56616) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:01.733783 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=f8e65e51-48c5-4193-a7f4-f567d228528d,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:01.782121 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-3abd7564-c686-44d9-9ddf-fbf9f5e52a80 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] GET failed (client error): The resource could not be found. May 12 15:35:01.783467 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3abd7564-c686-44d9-9ddf-fbf9f5e52a80 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/b368070a-3a9d-418c-bae3-26f7affe7e75 HTTP/1.1" status: 404 len: 333 time: 0.0971501 May 12 15:35:01.794434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56620) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:01.804909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1711862412'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:01.810973 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f29f7e3-20a2-4a6a-a058-1ae5a547e9d7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:01.829570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:01.918361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-578e0eeb-d2d0-485c-8b74-441e84821908 req-4c01b959-1766-4708-9dba-190841719235 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:01.919984 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-578e0eeb-d2d0-485c-8b74-441e84821908 req-4c01b959-1766-4708-9dba-190841719235 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.7017143 May 12 15:35:01.937673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d45db345-6e10-417e-8b52-3260151d6ba4 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:02.102627 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:02.148567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9f29f7e3-20a2-4a6a-a058-1ae5a547e9d7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for e07ac8ab-b2de-4401-ab99-c08c96ce7d1a owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:02.170150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port d45db345-6e10-417e-8b52-3260151d6ba4 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:02.182626 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port d45db345-6e10-417e-8b52-3260151d6ba4 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:02.184568 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:02.228886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f8e65e51-48c5-4193-a7f4-f567d228528d up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:02.232204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:network and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:02.238727 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:59Z', 'revision_number': 6, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ab6c816d-4cf1-4fba-a817-8e43af7420e8', 'name': '', 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:ea:65:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2676, 'fixed_ips': [{'subnet_id': '591a1588-10d4-4137-bac1-05a7d387578c', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:52Z', 'updated_at': '2022-05-12T15:35:01Z', 'revision_number': 4, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '591a1588-10d4-4137-bac1-05a7d387578c', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:52Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:02.242259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:02.249613 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22c5ee70-5b90-4d19-ab4c-54d48bfcdd1a None None] The sync data for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 is: [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:59Z', 'revision_number': 6, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ab6c816d-4cf1-4fba-a817-8e43af7420e8', 'name': '', 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:ea:65:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2676, 'fixed_ips': [{'subnet_id': '591a1588-10d4-4137-bac1-05a7d387578c', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:52Z', 'updated_at': '2022-05-12T15:35:01Z', 'revision_number': 4, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '591a1588-10d4-4137-bac1-05a7d387578c', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:52Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:02.253622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:02.351026 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:02.358596 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:02.400144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6bf3f3ff-fead-4f27-a67e-51a6e82f87bd tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:02.416342 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bf3f3ff-fead-4f27-a67e-51a6e82f87bd tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:02.418862 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6bf3f3ff-fead-4f27-a67e-51a6e82f87bd tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53 HTTP/1.1" status: 200 len: 954 time: 4.7384799 May 12 15:35:02.421611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56630) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:02.498832 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:02.620183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f8e65e51-48c5-4193-a7f4-f567d228528d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:02.620716 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:02.633585 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 588} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:35:02.660970 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:02.661506 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Added segment 2f3a3d21-42be-470d-9a94-9d26ea4f7cb5 of type vlan for network 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 May 12 15:35:02.685913 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f29f7e3-20a2-4a6a-a058-1ae5a547e9d7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:02.877780 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:02.898283 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f29f7e3-20a2-4a6a-a058-1ae5a547e9d7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:02.944934 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd45db345-6e10-417e-8b52-3260151d6ba4'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:35:02.951011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f29f7e3-20a2-4a6a-a058-1ae5a547e9d7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=e07ac8ab-b2de-4401-ab99-c08c96ce7d1a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:02.997951 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-efb7bf69-984a-440d-89e6-8ca4df9fb861 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53 HTTP/1.1" status: 200 len: 954 time: 0.5740807 May 12 15:35:02.999422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56640) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:03.008312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e87d5a0b-e6d2-472d-914c-964d1834a535 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'router': {'routes': None}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:03.042546 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bf6d2a3b-4df7-49ca-b05e-690bbedf7b3e'] response: {'server_uuid': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd45db345-6e10-417e-8b52-3260151d6ba4', 'code': 200} May 12 15:35:03.057262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port d45db345-6e10-417e-8b52-3260151d6ba4, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d45db345-6e10-417e-8b52-3260151d6ba4,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:03.082863 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:03.142192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-578e0eeb-d2d0-485c-8b74-441e84821908 req-eed0fa00-7db7-4489-90d4-cdd3cdf9ac9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:03.143701 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-578e0eeb-d2d0-485c-8b74-441e84821908 req-eed0fa00-7db7-4489-90d4-cdd3cdf9ac9a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 1.0284495 May 12 15:35:03.315562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9f29f7e3-20a2-4a6a-a058-1ae5a547e9d7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/e07ac8ab-b2de-4401-ab99-c08c96ce7d1a HTTP/1.1" status: 204 len: 168 time: 2.9397011 May 12 15:35:03.328775 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:03.338243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56646) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:03.382165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=d45db345-6e10-417e-8b52-3260151d6ba4,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:03.509105 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:03.514358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:03.514951 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:03.547274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef4ac34c-d693-4f07-9c31-079f93741e76 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:03.548859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef4ac34c-d693-4f07-9c31-079f93741e76 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:03.554924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ef4ac34c-d693-4f07-9c31-079f93741e76 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:03.631614 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 1.8354139 May 12 15:35:03.645445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56650) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:03.668435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': '61c670fe-88e6-4119-b6d1-b7a7c081b3a4', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:03.672897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54df894c-7b10-4493-bdc3-6d5b53c017fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Network': ['ID=61c670fe-88e6-4119-b6d1-b7a7c081b3a4,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:03.683066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9310a6bb-413b-4008-b060-af598bce22d0 None None] Sync routers for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:03.691420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ef4ac34c-d693-4f07-9c31-079f93741e76 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:03.694904 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ef4ac34c-d693-4f07-9c31-079f93741e76 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.3507724 May 12 15:35:03.696583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:35:03.703522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9c4eca-d5f1-4769-9c10-c6d562fb2d16 req-b2ef127a-631c-4b06-98e3-d9803fe9586e tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:03.705315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc9c4eca-d5f1-4769-9c10-c6d562fb2d16 req-b2ef127a-631c-4b06-98e3-d9803fe9586e tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.7570283 May 12 15:35:03.705960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56656) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:03.795667 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9310a6bb-413b-4008-b060-af598bce22d0 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:03.796221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9310a6bb-413b-4008-b060-af598bce22d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:46Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:03.880573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-a7aa0a12-392c-4e13-b0f9-124bfc15369a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 77932d15-465b-422a-86a7-8e543493cdc8 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:35:03.886263 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7aa0a12-392c-4e13-b0f9-124bfc15369a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:03.960542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-9310a6bb-413b-4008-b060-af598bce22d0 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:03.973566 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc9c4eca-d5f1-4769-9c10-c6d562fb2d16 req-333fd472-9eed-4b3a-93d5-7734eac50900 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0892341 May 12 15:35:04.019248 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7aa0a12-392c-4e13-b0f9-124bfc15369a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:04.102880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a52c20-5995-4dac-9e1f-2cea8efb38e1 req-84815b2c-41b5-4242-bba8-a5829cc7e827 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:04.105529 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-10a52c20-5995-4dac-9e1f-2cea8efb38e1 req-84815b2c-41b5-4242-bba8-a5829cc7e827 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 1096 time: 0.9593544 May 12 15:35:04.107542 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-578e0eeb-d2d0-485c-8b74-441e84821908 req-d1f6ad1d-80ee-4e51-8a59-82444614aad8 service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9524674 May 12 15:35:04.179054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:04.251605 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7aa0a12-392c-4e13-b0f9-124bfc15369a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:04.304091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:04.308788 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-10a52c20-5995-4dac-9e1f-2cea8efb38e1 req-1f8be680-3da6-42ff-8308-0469db645c27 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1022606 May 12 15:35:04.323487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:04.429480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ab6c816d-4cf1-4fba-a817-8e43af7420e8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:04.476613 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7aa0a12-392c-4e13-b0f9-124bfc15369a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:04.539476 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ab6c816d-4cf1-4fba-a817-8e43af7420e8 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:04.549166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ab6c816d-4cf1-4fba-a817-8e43af7420e8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:04.549698 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:04.555047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7aa0a12-392c-4e13-b0f9-124bfc15369a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=77932d15-465b-422a-86a7-8e543493cdc8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:04.565004 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7aa0a12-392c-4e13-b0f9-124bfc15369a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:04.583439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a7aa0a12-392c-4e13-b0f9-124bfc15369a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/77932d15-465b-422a-86a7-8e543493cdc8 HTTP/1.1" status: 204 len: 168 time: 0.8762434 May 12 15:35:04.584537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56662) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:04.628232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-158529ae-1ed3-4d7f-8da0-10a8e30dcb08 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:04.655163 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:04.680915 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-19901f2f-c597-4990-a515-50f96ea250a7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0926740 May 12 15:35:04.681161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56666) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:04.688477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-335b8486-2378-4d04-bd5b-f49c723bef57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:04.742247 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-578e0eeb-d2d0-485c-8b74-441e84821908 req-313fa506-dfd6-4702-a69a-12abbe9416ca service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5602925 May 12 15:35:04.829898 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9310a6bb-413b-4008-b060-af598bce22d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:59Z', 'revision_number': 6, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ab6c816d-4cf1-4fba-a817-8e43af7420e8', 'name': '', 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:ea:65:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2676, 'fixed_ips': [{'subnet_id': '591a1588-10d4-4137-bac1-05a7d387578c', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:52Z', 'updated_at': '2022-05-12T15:35:01Z', 'revision_number': 4, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '591a1588-10d4-4137-bac1-05a7d387578c', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:52Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:04.897093 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:04.906875 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:04.929742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9310a6bb-413b-4008-b060-af598bce22d0 None None] Checking router: 397feb9b-2f46-4c79-af57-634897d5df53 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:35:04.937567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-335b8486-2378-4d04-bd5b-f49c723bef57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:04.942189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-335b8486-2378-4d04-bd5b-f49c723bef57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:04.945201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-335b8486-2378-4d04-bd5b-f49c723bef57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:04.958141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-335b8486-2378-4d04-bd5b-f49c723bef57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:04.977497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:04.980683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ab6c816d-4cf1-4fba-a817-8e43af7420e8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ab6c816d-4cf1-4fba-a817-8e43af7420e8,segment=NetworkSegment(f344cec1-3138-44bd-8d64-09a36451564e),segment_id=f344cec1-3138-44bd-8d64-09a36451564e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:04.981014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-335b8486-2378-4d04-bd5b-f49c723bef57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:04.983685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9310a6bb-413b-4008-b060-af598bce22d0 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:04.984490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9310a6bb-413b-4008-b060-af598bce22d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:46Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:04.985116 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-335b8486-2378-4d04-bd5b-f49c723bef57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:04.990689 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:05.143202 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:05.220187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-9310a6bb-413b-4008-b060-af598bce22d0 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:05.580590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ab6c816d-4cf1-4fba-a817-8e43af7420e8,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:05.613694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5afb9b39-3564-4415-a275-a6dcc08c3efc None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:35:05.613814 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:05.675563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5afb9b39-3564-4415-a275-a6dcc08c3efc None None] Deleting port f8e65e51-48c5-4193-a7f4-f567d228528d {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:05.676362 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5afb9b39-3564-4415-a275-a6dcc08c3efc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:05.734888 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-335b8486-2378-4d04-bd5b-f49c723bef57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:05.880818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-335b8486-2378-4d04-bd5b-f49c723bef57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=97508220-1a7e-4110-9801-afe6d638e163,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:05.899428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-335b8486-2378-4d04-bd5b-f49c723bef57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:05.910518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-335b8486-2378-4d04-bd5b-f49c723bef57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:05.926348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c6102f9-1d06-49c0-84ef-50e107351271 req-cd06ae03-7a81-4bd1-8842-2d3c28dcaa23 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:05.935596 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c6102f9-1d06-49c0-84ef-50e107351271 req-cd06ae03-7a81-4bd1-8842-2d3c28dcaa23 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.7891169 May 12 15:35:05.961346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-335b8486-2378-4d04-bd5b-f49c723bef57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:05.968200 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-335b8486-2378-4d04-bd5b-f49c723bef57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:06.007462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Allocated IP 172.25.8.132 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/162487c7-5780-4215-8f62-075f491d92bb) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:06.070848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c6102f9-1d06-49c0-84ef-50e107351271 req-10e3b6ad-9291-49c9-aace-82b9a764206f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1342950 May 12 15:35:06.080364 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-335b8486-2378-4d04-bd5b-f49c723bef57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.3979514 May 12 15:35:06.083499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56690) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:06.093157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'fixed_ips': [{'subnet_id': '97508220-1a7e-4110-9801-afe6d638e163', 'ip_address': '2001:db8::4055:ced3:b550:7cf7'}], 'name': 'tempest-NetworksTestDHCPv6-1177211754'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:06.212857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ab6c816d-4cf1-4fba-a817-8e43af7420e8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:06.374938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:06.447930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:06.466051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:port and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:06.474176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:06.489671 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:06.504611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:06.556428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9310a6bb-413b-4008-b060-af598bce22d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:59Z', 'revision_number': 6, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ab6c816d-4cf1-4fba-a817-8e43af7420e8', 'name': '', 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:ea:65:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2676, 'fixed_ips': [{'subnet_id': '591a1588-10d4-4137-bac1-05a7d387578c', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:52Z', 'updated_at': '2022-05-12T15:35:04Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '591a1588-10d4-4137-bac1-05a7d387578c', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:52Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:06.602408 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9310a6bb-413b-4008-b060-af598bce22d0 None None] The sync data for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 is: [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:34:59Z', 'revision_number': 6, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ab6c816d-4cf1-4fba-a817-8e43af7420e8', 'name': '', 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:ea:65:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2676, 'fixed_ips': [{'subnet_id': '591a1588-10d4-4137-bac1-05a7d387578c', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:52Z', 'updated_at': '2022-05-12T15:35:04Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '591a1588-10d4-4137-bac1-05a7d387578c', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:52Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:06.647632 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:06.664923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5afb9b39-3564-4415-a275-a6dcc08c3efc None None] For port f8e65e51-48c5-4193-a7f4-f567d228528d, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f8e65e51-48c5-4193-a7f4-f567d228528d,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:06.665320 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5afb9b39-3564-4415-a275-a6dcc08c3efc None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:06.687709 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ab6c816d-4cf1-4fba-a817-8e43af7420e8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:06.687926 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:06.765738 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:06.817085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port be1798d9-95e0-43e2-bea6-b3a1ace514f5 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:35:06.956013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5afb9b39-3564-4415-a275-a6dcc08c3efc None None] Calling delete_port for f8e65e51-48c5-4193-a7f4-f567d228528d owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:07.103376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:07.146535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:07.148578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Pushing event updated for resources: {'Port': ['ID=162487c7-5780-4215-8f62-075f491d92bb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:07.150582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:07.172205 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5afb9b39-3564-4415-a275-a6dcc08c3efc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:07.310989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5afb9b39-3564-4415-a275-a6dcc08c3efc None None] Pushing event deleted for resources: {'Port': ['ID=f8e65e51-48c5-4193-a7f4-f567d228528d,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:07.318731 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5afb9b39-3564-4415-a275-a6dcc08c3efc None None] No DVR routers for this DVR port f8e65e51-48c5-4193-a7f4-f567d228528d on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:35:07.340017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ebd6a04-8911-475c-9ddf-d6f53ba900e2 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:07.460581 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f8e65e51-48c5-4193-a7f4-f567d228528d no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:07.527818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::4055:ced3:b550:7cf7 (2447b094-d5d6-41ef-a146-2bf56f5399af/97508220-1a7e-4110-9801-afe6d638e163/be1798d9-95e0-43e2-bea6-b3a1ace514f5) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:07.536611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: f8e65e51-48c5-4193-a7f4-f567d228528d {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:07.537097 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f8e65e51-48c5-4193-a7f4-f567d228528d not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:07.597791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a77efbd5-51d1-4e8d-9f6f-acab9a0ab879 req-3a9d2a64-fd50-4f09-a5d4-6142152116a0 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:07.607570 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a77efbd5-51d1-4e8d-9f6f-acab9a0ab879 req-3a9d2a64-fd50-4f09-a5d4-6142152116a0 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.1863842 May 12 15:35:07.675127 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a77efbd5-51d1-4e8d-9f6f-acab9a0ab879 req-b9f6cae3-7f54-460a-9799-93e9d842ab44 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0666873 May 12 15:35:07.750716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.extraroute_db [None req-e87d5a0b-e6d2-472d-914c-964d1834a535 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Added routes are [] {{(pid=88151) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:114}} May 12 15:35:07.755710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.extraroute_db [None req-e87d5a0b-e6d2-472d-914c-964d1834a535 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Removed routes are [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}] {{(pid=88151) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:122}} May 12 15:35:07.802000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '97508220-1a7e-4110-9801-afe6d638e163'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:35:07.802830 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:07.803168 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:07.944917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:07.983591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object be1798d9-95e0-43e2-bea6-b3a1ace514f5 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:08.009920 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Subnet': ['ID=af0eee84-aac4-44e7-8824-006c212bfed1,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:08.068717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fe8f728-c55f-49b2-911d-6a4657592d6d req-8f8c7870-b66c-4450-9d9f-73d642d2266a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:08.074948 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4fe8f728-c55f-49b2-911d-6a4657592d6d req-8f8c7870-b66c-4450-9d9f-73d642d2266a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.1733227 May 12 15:35:08.081667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56704) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:08.093757 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e87d5a0b-e6d2-472d-914c-964d1834a535 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:08.102585 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7995cc0c-f476-4cc6-ab58-5cdcc8431dcd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Request body: {'floatingip': {'port_id': 'd45db345-6e10-417e-8b52-3260151d6ba4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:08.231487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Allocated IP 2001:db8::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/97508220-1a7e-4110-9801-afe6d638e163/dfa75c44-4a7b-4633-a3ed-978c236dc4a2) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:08.238550 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:08.298751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Checking segment: {'id': '2f3a3d21-42be-470d-9a94-9d26ea4f7cb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '61c670fe-88e6-4119-b6d1-b7a7c081b3a4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:35:08.299035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network hostable DHCP agents. Network: 61c670fe-88e6-4119-b6d1-b7a7c081b3a4, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:35:08.341971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:08.363093 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7995cc0c-f476-4cc6-ab58-5cdcc8431dcd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:08.480609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:08.487650 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:08.535426 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:08.542548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:08.544131 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:08.572369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=be1798d9-95e0-43e2-bea6-b3a1ace514f5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:08.651005 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ce0ff01a-64d7-4f8d-98cc-98bd7f333438 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 2.5629292 May 12 15:35:08.655627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56710) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:08.690434 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:08.702821 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Transition to ACTIVE for port object dfa75c44-4a7b-4633-a3ed-978c236dc4a2 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:08.727955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Transition to ACTIVE for port object dfa75c44-4a7b-4633-a3ed-978c236dc4a2 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:08.736166 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:08.835919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:08.842810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:08.860813 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:08.963274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-613a2f61-aa50-47f6-a708-8bf03c220266 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:08.964019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-613a2f61-aa50-47f6-a708-8bf03c220266 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:08.993185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-613a2f61-aa50-47f6-a708-8bf03c220266 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:08.997309 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-613a2f61-aa50-47f6-a708-8bf03c220266 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 946 time: 0.3377733 May 12 15:35:08.998192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56714) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:09.012594 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:09.019995 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:09.040657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Pushing event updated for resources: {'Port': ['ID=dfa75c44-4a7b-4633-a3ed-978c236dc4a2,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:09.071381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Attempting to bind port dfa75c44-4a7b-4633-a3ed-978c236dc4a2 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:35:09.074595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Attempting to bind port dfa75c44-4a7b-4633-a3ed-978c236dc4a2 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:35:09.074994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Attempting to bind port dfa75c44-4a7b-4633-a3ed-978c236dc4a2 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:35:09.092844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 34, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:35:09.093256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:35:09.094855 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:09.095251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:35:09.098026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Bound port: dfa75c44-4a7b-4633-a3ed-978c236dc4a2, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:35:09.098420 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:09.117984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-8b9bed12-5e40-4a2f-8ad6-4a63e0f670da tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port be1798d9-95e0-43e2-bea6-b3a1ace514f5 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:09.118403 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b9bed12-5e40-4a2f-8ad6-4a63e0f670da tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:09.341167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] For port dfa75c44-4a7b-4633-a3ed-978c236dc4a2, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:35:09.343269 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:35:09.346071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] For port dfa75c44-4a7b-4633-a3ed-978c236dc4a2, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=dfa75c44-4a7b-4633-a3ed-978c236dc4a2,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:35:09.351174 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e87d5a0b-e6d2-472d-914c-964d1834a535 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:09.353004 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:09.400765 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e87d5a0b-e6d2-472d-914c-964d1834a535 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:09.409710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 61c670fe-88e6-4119-b6d1-b7a7c081b3a4) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:09.499701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d33003cc-852a-4e5a-aa7c-50a67f55fb4c None None] Pushing event updated for resources: {'Port': ['ID=dfa75c44-4a7b-4633-a3ed-978c236dc4a2,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:09.503136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e878cb46-4148-4f4b-b8cd-95f849938390 None None] Network 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:09.568072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:09.568681 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:10.127540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-61c670fe-88e6-4119-b6d1-b7a7c081b3a4', 'network_id': '61c670fe-88e6-4119-b6d1-b7a7c081b3a4', 'tenant_id': '9bd6beec65cd47b3a0febdc05aaed724', 'fixed_ips': [{'subnet_id': 'af0eee84-aac4-44e7-8824-006c212bfed1'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:35:10.128453 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:10.223929 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-eb623968-a039-4b68-a46f-a8ce2deb9bd5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 6.5698624 May 12 15:35:10.225330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56738) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:10.258268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e87d5a0b-e6d2-472d-914c-964d1834a535 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 397feb9b-2f46-4c79-af57-634897d5df53 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:35:10.272526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e2b5ba11-b48c-4fda-96df-06afe6e2708d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': '61c670fe-88e6-4119-b6d1-b7a7c081b3a4', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:10.280957 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Router b842700e-5e07-47e7-8454-463fccc547ff is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:35:10.316340 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-7995cc0c-f476-4cc6-ab58-5cdcc8431dcd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] It took 0.27 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:35:10.428466 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b9bed12-5e40-4a2f-8ad6-4a63e0f670da tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:10.491454 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Allocated IP 172.20.0.2 (61c670fe-88e6-4119-b6d1-b7a7c081b3a4/af0eee84-aac4-44e7-8824-006c212bfed1/47c27e64-f639-4bf0-abcc-1cee7f24246f) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:10.626845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56744) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:10.771940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e87d5a0b-e6d2-472d-914c-964d1834a535 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:10.783394 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88525aa9-485d-4b34-969c-2c504c71e8f0 None None] Sync routers for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:10.786991 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e87d5a0b-e6d2-472d-914c-964d1834a535 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:10.791443 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e87d5a0b-e6d2-472d-914c-964d1834a535 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53 HTTP/1.1" status: 200 len: 704 time: 7.7890263 May 12 15:35:10.801790 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88525aa9-485d-4b34-969c-2c504c71e8f0 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:10.805110 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-88525aa9-485d-4b34-969c-2c504c71e8f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:46Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:10.808637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56750) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:10.824983 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:10.838572 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Transition to ACTIVE for port object 47c27e64-f639-4bf0-abcc-1cee7f24246f will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:10.853415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e2b5ba11-b48c-4fda-96df-06afe6e2708d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:10.858610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e2b5ba11-b48c-4fda-96df-06afe6e2708d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:10.862127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e2b5ba11-b48c-4fda-96df-06afe6e2708d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:10.873634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e2b5ba11-b48c-4fda-96df-06afe6e2708d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:10.881137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Transition to ACTIVE for port object 47c27e64-f639-4bf0-abcc-1cee7f24246f will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:10.892691 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:10.932696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-8b9bed12-5e40-4a2f-8ad6-4a63e0f670da tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for be1798d9-95e0-43e2-bea6-b3a1ace514f5 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:11.034895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Network 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:11.052514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:11.065573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:11.088648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e2b5ba11-b48c-4fda-96df-06afe6e2708d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:11.092136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Pushing event updated for resources: {'Port': ['ID=47c27e64-f639-4bf0-abcc-1cee7f24246f,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:11.094394 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e2b5ba11-b48c-4fda-96df-06afe6e2708d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:11.177018 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-88525aa9-485d-4b34-969c-2c504c71e8f0 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:11.188464 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7995cc0c-f476-4cc6-ab58-5cdcc8431dcd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:11.246800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Attempting to bind port 47c27e64-f639-4bf0-abcc-1cee7f24246f on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:35:11.247382 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Attempting to bind port 47c27e64-f639-4bf0-abcc-1cee7f24246f by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '2f3a3d21-42be-470d-9a94-9d26ea4f7cb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '61c670fe-88e6-4119-b6d1-b7a7c081b3a4'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:35:11.247382 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Attempting to bind port 47c27e64-f639-4bf0-abcc-1cee7f24246f on network 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:35:11.264596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 34, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:35:11.264973 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Checking segment: {'id': '2f3a3d21-42be-470d-9a94-9d26ea4f7cb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '61c670fe-88e6-4119-b6d1-b7a7c081b3a4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:35:11.265376 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:11.265789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Bound using segment: {'id': '2f3a3d21-42be-470d-9a94-9d26ea4f7cb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '61c670fe-88e6-4119-b6d1-b7a7c081b3a4'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:35:11.266265 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Bound port: 47c27e64-f639-4bf0-abcc-1cee7f24246f, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2f3a3d21-42be-470d-9a94-9d26ea4f7cb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '61c670fe-88e6-4119-b6d1-b7a7c081b3a4'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:35:11.266638 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:11.437474 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7995cc0c-f476-4cc6-ab58-5cdcc8431dcd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:11.494626 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] For port 47c27e64-f639-4bf0-abcc-1cee7f24246f, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:35:11.498854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] For port 47c27e64-f639-4bf0-abcc-1cee7f24246f, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=47c27e64-f639-4bf0-abcc-1cee7f24246f,segment=NetworkSegment(2f3a3d21-42be-470d-9a94-9d26ea4f7cb5),segment_id=2f3a3d21-42be-470d-9a94-9d26ea4f7cb5)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:35:11.504766 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:11.516934 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b9bed12-5e40-4a2f-8ad6-4a63e0f670da tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:11.531171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:11.617755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b9bed12-5e40-4a2f-8ad6-4a63e0f670da tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=be1798d9-95e0-43e2-bea6-b3a1ace514f5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:11.633380 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30129d38-e887-435c-9853-9b159bc0ba85 None None] Sync routers for ids ['b842700e-5e07-47e7-8454-463fccc547ff'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:11.683111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:11.688287 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-791a57e5-d425-4264-9b32-752d211257ab tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "PUT /v2.0/routers/b842700e-5e07-47e7-8454-463fccc547ff HTTP/1.1" status: 200 len: 919 time: 10.6317432 May 12 15:35:11.695549 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c49627b0-559c-4ff8-b135-8ff87abecd43 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53 HTTP/1.1" status: 200 len: 704 time: 0.8806248 May 12 15:35:11.705001 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56756) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:11.705614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56758) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:11.710250 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b9bed12-5e40-4a2f-8ad6-4a63e0f670da tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:11.736365 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30129d38-e887-435c-9853-9b159bc0ba85 None None] Routers {'b842700e-5e07-47e7-8454-463fccc547ff'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:11.737644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-30129d38-e887-435c-9853-9b159bc0ba85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:46Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['b842700e-5e07-47e7-8454-463fccc547ff'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:11.778556 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-98aa491d-4c3e-4ee8-9ba2-82b1525193e3 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c3218244482a42dabbef067e351d4738&name=default HTTP/1.1" status: 200 len: 2983 time: 1.0092406 May 12 15:35:11.785980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56764) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:11.876687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-432aa11f-b9ac-4d81-ad0e-623cbfd35e71 None None] Pushing event updated for resources: {'Port': ['ID=47c27e64-f639-4bf0-abcc-1cee7f24246f,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:11.900847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-30129d38-e887-435c-9853-9b159bc0ba85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:11.915075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ed6700a4-0f4b-4a0e-8091-4977696100ac None None] Provisioning for port dfa75c44-4a7b-4633-a3ed-978c236dc4a2 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:11.921418 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30129d38-e887-435c-9853-9b159bc0ba85 None None] Routers {'b842700e-5e07-47e7-8454-463fccc547ff'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:11.925502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-30129d38-e887-435c-9853-9b159bc0ba85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:46Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['b842700e-5e07-47e7-8454-463fccc547ff'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:11.950545 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-88525aa9-485d-4b34-969c-2c504c71e8f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:07Z', 'revision_number': 7, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ab6c816d-4cf1-4fba-a817-8e43af7420e8', 'name': '', 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:ea:65:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2676, 'fixed_ips': [{'subnet_id': '591a1588-10d4-4137-bac1-05a7d387578c', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:52Z', 'updated_at': '2022-05-12T15:35:04Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '591a1588-10d4-4137-bac1-05a7d387578c', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:52Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:11.967240 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88525aa9-485d-4b34-969c-2c504c71e8f0 None None] Checking router: 397feb9b-2f46-4c79-af57-634897d5df53 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:35:11.976869 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21994a3a-e0ad-46f9-b790-641f6d532c5c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:12.015302 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88525aa9-485d-4b34-969c-2c504c71e8f0 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:12.017071 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-88525aa9-485d-4b34-969c-2c504c71e8f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:46Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:12.020899 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-30129d38-e887-435c-9853-9b159bc0ba85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:12.021538 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30129d38-e887-435c-9853-9b159bc0ba85 None None] The sync data for ids ['b842700e-5e07-47e7-8454-463fccc547ff'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:12.054329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21994a3a-e0ad-46f9-b790-641f6d532c5c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:12.063837 n-d-841483-1 neutron-server[88152]: INFO neutron.db.ipam_backend_mixin [None req-e2b5ba11-b48c-4fda-96df-06afe6e2708d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet af0eee84-aac4-44e7-8824-006c212bfed1 (CIDR: 172.20.0.0/28) May 12 15:35:12.146627 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-7995cc0c-f476-4cc6-ab58-5cdcc8431dcd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Floating IP 97ecb4c0-5dfe-4885-9fdc-e38dfbd87b5a associated. External IP: 172.25.8.156, port: d45db345-6e10-417e-8b52-3260151d6ba4. May 12 15:35:12.148588 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21994a3a-e0ad-46f9-b790-641f6d532c5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:12.161061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4737c0d7-0489-4a23-afa8-a7e5373ae919 None None] Could not find standard attr ID for object be1798d9-95e0-43e2-bea6-b3a1ace514f5. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:35:12.218784 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21994a3a-e0ad-46f9-b790-641f6d532c5c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:12.219934 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-21994a3a-e0ad-46f9-b790-641f6d532c5c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b040f386-5ace-40e3-927f-58e3500d7251 HTTP/1.1" status: 204 len: 168 time: 0.4331231 May 12 15:35:12.224899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21994a3a-e0ad-46f9-b790-641f6d532c5c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b040f386-5ace-40e3-927f-58e3500d7251,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:12.342130 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-88525aa9-485d-4b34-969c-2c504c71e8f0 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:12.346331 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dfa75c44-4a7b-4633-a3ed-978c236dc4a2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:12.489763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port dfa75c44-4a7b-4633-a3ed-978c236dc4a2 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:12.503197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port dfa75c44-4a7b-4633-a3ed-978c236dc4a2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:12.503197 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:12.610800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56774) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:12.611638 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8b9bed12-5e40-4a2f-8ad6-4a63e0f670da tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/be1798d9-95e0-43e2-bea6-b3a1ace514f5 HTTP/1.1" status: 204 len: 168 time: 3.6116853 May 12 15:35:12.634312 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-e2b5ba11-b48c-4fda-96df-06afe6e2708d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:35:12.635057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e2b5ba11-b48c-4fda-96df-06afe6e2708d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:35:12.728925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2a62360-de5c-4177-abdd-00ae347d095e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:12.730984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2a62360-de5c-4177-abdd-00ae347d095e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:12.735062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a2a62360-de5c-4177-abdd-00ae347d095e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:12.771887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a2a62360-de5c-4177-abdd-00ae347d095e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:12.773316 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a2a62360-de5c-4177-abdd-00ae347d095e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1614745 May 12 15:35:12.775932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56778) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:12.819590 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-970fc59b-aacf-4339-b84f-14fa9857fb72 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:12.836253 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e2b5ba11-b48c-4fda-96df-06afe6e2708d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 2.5712333 May 12 15:35:12.856652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56786) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:12.889064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e68da2a5-c8cd-4259-a76b-9c50eeb765a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': '61c670fe-88e6-4119-b6d1-b7a7c081b3a4', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:12.962005 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:13.032975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port dfa75c44-4a7b-4633-a3ed-978c236dc4a2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=dfa75c44-4a7b-4633-a3ed-978c236dc4a2,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:13.045236 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:13.102836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-40a189e9-af32-48b4-a662-b89df6634d1f tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/routers/b842700e-5e07-47e7-8454-463fccc547ff HTTP/1.1" status: 200 len: 925 time: 1.3872035 May 12 15:35:13.143486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56794) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:13.225356 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-88525aa9-485d-4b34-969c-2c504c71e8f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:07Z', 'revision_number': 7, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ab6c816d-4cf1-4fba-a817-8e43af7420e8', 'name': '', 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:ea:65:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2676, 'fixed_ips': [{'subnet_id': '591a1588-10d4-4137-bac1-05a7d387578c', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:52Z', 'updated_at': '2022-05-12T15:35:04Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '591a1588-10d4-4137-bac1-05a7d387578c', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:52Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:13.239504 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88525aa9-485d-4b34-969c-2c504c71e8f0 None None] The sync data for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 is: [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:07Z', 'revision_number': 7, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ab6c816d-4cf1-4fba-a817-8e43af7420e8', 'name': '', 'network_id': 'ac7191e2-2e1e-4c14-b753-6a321d14e4d8', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:ea:65:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2676, 'fixed_ips': [{'subnet_id': '591a1588-10d4-4137-bac1-05a7d387578c', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:52Z', 'updated_at': '2022-05-12T15:35:04Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '591a1588-10d4-4137-bac1-05a7d387578c', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:52Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:13.259735 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:13.309275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=dfa75c44-4a7b-4633-a3ed-978c236dc4a2,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:13.339658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-4d8b22ca-2d19-4873-ab31-cc4f6f220f0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 97508220-1a7e-4110-9801-afe6d638e163 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:35:13.387238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e68da2a5-c8cd-4259-a76b-9c50eeb765a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:13.396436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e68da2a5-c8cd-4259-a76b-9c50eeb765a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:13.406412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e68da2a5-c8cd-4259-a76b-9c50eeb765a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:13.421253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e68da2a5-c8cd-4259-a76b-9c50eeb765a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:13.430505 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d8b22ca-2d19-4873-ab31-cc4f6f220f0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:13.534085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e68da2a5-c8cd-4259-a76b-9c50eeb765a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:13.543537 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e68da2a5-c8cd-4259-a76b-9c50eeb765a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:13.657374 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d8b22ca-2d19-4873-ab31-cc4f6f220f0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:13.667013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-528c7484-afa5-4bba-b75e-17400da41864 None None] Network 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:13.891240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7995cc0c-f476-4cc6-ab58-5cdcc8431dcd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Router 3b0baf01-29b6-49bc-81af-4ed638af06f3 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:35:13.891849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6ac80f5-687c-4476-90f5-276c358528fc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:13.902781 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a6ac80f5-687c-4476-90f5-276c358528fc tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/ports?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&device_id=b842700e-5e07-47e7-8454-463fccc547ff&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.7459970 May 12 15:35:13.906494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56814) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:13.912415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-95d98467-0fd1-4634-9335-d5e97152061b None None] Provisioning for port 47c27e64-f639-4bf0-abcc-1cee7f24246f completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:14.253862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56826) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:14.258721 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d8b22ca-2d19-4873-ab31-cc4f6f220f0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:14.331134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53129c47-11d8-4224-92bd-eab61c21886b tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:14.333574 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-53129c47-11d8-4224-92bd-eab61c21886b tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/networks/5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 881 time: 0.4236960 May 12 15:35:14.392576 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 47c27e64-f639-4bf0-abcc-1cee7f24246f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:14.405316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56832) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:14.411281 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d8b22ca-2d19-4873-ab31-cc4f6f220f0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:14.598090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 47c27e64-f639-4bf0-abcc-1cee7f24246f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:14.626821 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 47c27e64-f639-4bf0-abcc-1cee7f24246f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:14.629698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7995cc0c-f476-4cc6-ab58-5cdcc8431dcd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:14.640506 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-969bf0a9-0d01-47c6-a69b-910676eb56c0 None None] Sync routers for ids ['3b0baf01-29b6-49bc-81af-4ed638af06f3'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:14.649071 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:14.655933 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-969bf0a9-0d01-47c6-a69b-910676eb56c0 None None] Routers {'3b0baf01-29b6-49bc-81af-4ed638af06f3'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:14.657222 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-969bf0a9-0d01-47c6-a69b-910676eb56c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:34:46Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b0baf01-29b6-49bc-81af-4ed638af06f3'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:14.669066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7995cc0c-f476-4cc6-ab58-5cdcc8431dcd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:14.743055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d8b22ca-2d19-4873-ab31-cc4f6f220f0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=97508220-1a7e-4110-9801-afe6d638e163,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:14.754192 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e68da2a5-c8cd-4259-a76b-9c50eeb765a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:14.754419 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-89400ef4-98d8-445f-b76a-63de8136487e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:14.817236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e68da2a5-c8cd-4259-a76b-9c50eeb765a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:14.824406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e68da2a5-c8cd-4259-a76b-9c50eeb765a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:14.834905 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1bd33600-ba18-4b7d-b140-318442591c65 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "GET /v2.0/ports?device_id=b842700e-5e07-47e7-8454-463fccc547ff HTTP/1.1" status: 200 len: 205 time: 0.4255354 May 12 15:35:14.844506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e68da2a5-c8cd-4259-a76b-9c50eeb765a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:14.845649 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e68da2a5-c8cd-4259-a76b-9c50eeb765a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:14.845990 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a79b0f2c-2973-46b6-a3f4-f946455b2549 None None] Network 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:14.850249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56842) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:14.864591 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4d8b22ca-2d19-4873-ab31-cc4f6f220f0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:14.876137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19fd08f0-1347-419d-83a3-c94d712b60f1 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:14.878761 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7995cc0c-f476-4cc6-ab58-5cdcc8431dcd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "PUT /v2.0/floatingips/97ecb4c0-5dfe-4885-9fdc-e38dfbd87b5a HTTP/1.1" status: 200 len: 991 time: 6.7957671 May 12 15:35:14.896441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'tag': 'd45db345-6e10-417e-8b52-3260151d6ba4'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:35:14.999656 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e68da2a5-c8cd-4259-a76b-9c50eeb765a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 2.1296539 May 12 15:35:15.005040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56850) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:15.031204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'network_id': '61c670fe-88e6-4119-b6d1-b7a7c081b3a4', 'fixed_ips': [{'subnet_id': 'af0eee84-aac4-44e7-8824-006c212bfed1'}, {'subnet_id': 'f8eb29b5-ee06-488d-b4b5-2ba586595399'}], 'name': 'tempest-PortsTestJSON-1435614988'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:15.054542 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4d8b22ca-2d19-4873-ab31-cc4f6f220f0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/97508220-1a7e-4110-9801-afe6d638e163 HTTP/1.1" status: 204 len: 168 time: 2.2742531 May 12 15:35:15.117295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56856) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:15.123301 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1879737a-5613-4f0d-a472-135aff557e4a'] response: {'name': 'network-changed', 'server_uuid': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'tag': 'd45db345-6e10-417e-8b52-3260151d6ba4', 'status': 'completed', 'code': 200} May 12 15:35:15.131307 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-969bf0a9-0d01-47c6-a69b-910676eb56c0 None None] Set router 3b0baf01-29b6-49bc-81af-4ed638af06f3 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:15.278937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b798f5a2-a8b6-4a6e-ac47-20de891922ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1500280 May 12 15:35:15.304731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56864) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:15.323187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e68da2a5-c8cd-4259-a76b-9c50eeb765a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Subnet': ['ID=f8eb29b5-ee06-488d-b4b5-2ba586595399,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:15.334483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e7539262-5aa5-4f43-99ed-c397056c1c98 None None] Provisioning complete for port 47c27e64-f639-4bf0-abcc-1cee7f24246f triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:15.335966 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e7539262-5aa5-4f43-99ed-c397056c1c98 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:15.578270 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-16792979-bcf5-43fa-a1a4-bc17a0695a6a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:15.798415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fbb0235b-8283-4ab6-bf25-001366925c3c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:15.799126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fbb0235b-8283-4ab6-bf25-001366925c3c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:15.833124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fbb0235b-8283-4ab6-bf25-001366925c3c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:15.834366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fbb0235b-8283-4ab6-bf25-001366925c3c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.5286977 May 12 15:35:15.839161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56874) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:15.842413 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:15.871732 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-969bf0a9-0d01-47c6-a69b-910676eb56c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:25Z', 'revision_number': 4, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '97ecb4c0-5dfe-4885-9fdc-e38dfbd87b5a', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'floating_ip_address': '172.25.8.156', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'port_id': 'd45db345-6e10-417e-8b52-3260151d6ba4', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 2661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'mac_address': 'fa:16:3e:bc:94:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:34:31Z', 'updated_at': '2022-05-12T15:35:10Z', 'revision_number': 1, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2cefb78b-eff7-47cb-8160-89f1ff42943b', 'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'mac_address': 'fa:16:3e:ee:fd:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 2489, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:20Z', 'updated_at': '2022-05-12T15:32:39Z', 'revision_number': 5, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'subnets': [{'id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:15.881205 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-969bf0a9-0d01-47c6-a69b-910676eb56c0 None None] Checking router: 3b0baf01-29b6-49bc-81af-4ed638af06f3 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:35:15.899292 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-969bf0a9-0d01-47c6-a69b-910676eb56c0 None None] Routers {'3b0baf01-29b6-49bc-81af-4ed638af06f3'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:15.900166 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-969bf0a9-0d01-47c6-a69b-910676eb56c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b0baf01-29b6-49bc-81af-4ed638af06f3'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:15.944558 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:15.960828 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33738636-15cf-403b-be7d-f4dd59f06fc1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:15.961520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-33738636-15cf-403b-be7d-f4dd59f06fc1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:16.001882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-33738636-15cf-403b-be7d-f4dd59f06fc1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:16.003442 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-33738636-15cf-403b-be7d-f4dd59f06fc1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1634517 May 12 15:35:16.007298 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e7539262-5aa5-4f43-99ed-c397056c1c98 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:16.010787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56884) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:16.079567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 47c27e64-f639-4bf0-abcc-1cee7f24246f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=47c27e64-f639-4bf0-abcc-1cee7f24246f,segment=NetworkSegment(2f3a3d21-42be-470d-9a94-9d26ea4f7cb5),segment_id=2f3a3d21-42be-470d-9a94-9d26ea4f7cb5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:16.086636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:16.112656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:port and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:16.115934 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:16.118938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dfa75c44-4a7b-4633-a3ed-978c236dc4a2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:16.124309 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-539e3760-d197-4645-a0c2-644f22b7854b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1114886 May 12 15:35:16.139576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56888) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:16.139823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:16.150548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8698b420-85c9-44d2-a856-545246a1fcf2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:16.156475 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:16.174048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48749d4a-deea-4d4c-a7fb-b993eb89af17 req-f96a15e5-9da9-47bf-b63f-12dea6aa298c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:16.176024 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48749d4a-deea-4d4c-a7fb-b993eb89af17 req-f96a15e5-9da9-47bf-b63f-12dea6aa298c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 1096 time: 0.8491597 May 12 15:35:16.187257 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-969bf0a9-0d01-47c6-a69b-910676eb56c0 None None] Set router 3b0baf01-29b6-49bc-81af-4ed638af06f3 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:16.425004 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:16.425949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56892) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:16.455058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-403b86a2-356e-4628-bf78-4695de33b96d None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:35:16.484527 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:16.508159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-403b86a2-356e-4628-bf78-4695de33b96d None None] Deleting port dfa75c44-4a7b-4633-a3ed-978c236dc4a2 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:16.508822 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-403b86a2-356e-4628-bf78-4695de33b96d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:16.508949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-89400ef4-98d8-445f-b76a-63de8136487e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port ab6c816d-4cf1-4fba-a817-8e43af7420e8 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:16.509418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-89400ef4-98d8-445f-b76a-63de8136487e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:16.539773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Request body: {'network': {'name': 'tempest-network-smoke--335058132', 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'port_security_enabled': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:16.543930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:16.576454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:16.629407 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-969bf0a9-0d01-47c6-a69b-910676eb56c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:25Z', 'revision_number': 4, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '97ecb4c0-5dfe-4885-9fdc-e38dfbd87b5a', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'floating_ip_address': '172.25.8.156', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'port_id': 'd45db345-6e10-417e-8b52-3260151d6ba4', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 2661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'mac_address': 'fa:16:3e:bc:94:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:34:31Z', 'updated_at': '2022-05-12T15:35:10Z', 'revision_number': 1, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2cefb78b-eff7-47cb-8160-89f1ff42943b', 'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'mac_address': 'fa:16:3e:ee:fd:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 2489, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:20Z', 'updated_at': '2022-05-12T15:32:39Z', 'revision_number': 5, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'subnets': [{'id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:16.637547 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-969bf0a9-0d01-47c6-a69b-910676eb56c0 None None] The sync data for ids ['3b0baf01-29b6-49bc-81af-4ed638af06f3'] in n-d-841483-1 is: [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:25Z', 'revision_number': 4, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '97ecb4c0-5dfe-4885-9fdc-e38dfbd87b5a', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'floating_ip_address': '172.25.8.156', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'port_id': 'd45db345-6e10-417e-8b52-3260151d6ba4', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 2661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'mac_address': 'fa:16:3e:bc:94:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:34:31Z', 'updated_at': '2022-05-12T15:35:10Z', 'revision_number': 1, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2cefb78b-eff7-47cb-8160-89f1ff42943b', 'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'mac_address': 'fa:16:3e:ee:fd:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 2489, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:20Z', 'updated_at': '2022-05-12T15:32:39Z', 'revision_number': 5, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'subnets': [{'id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:16.645061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Usage tracker for resource:network and tenant:3dd1fe8ad774471ba7745219a37ead53 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:16.659370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:16.735809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=47c27e64-f639-4bf0-abcc-1cee7f24246f,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:16.753309 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-e7539262-5aa5-4f43-99ed-c397056c1c98 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:35:16.753686 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-e7539262-5aa5-4f43-99ed-c397056c1c98 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:35:16.756207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eee6194c-7e6c-499f-a04c-e39134c249a7 None None] Update dhcp port {'port': {'network_id': '61c670fe-88e6-4119-b6d1-b7a7c081b3a4', 'fixed_ips': [{'subnet_id': 'af0eee84-aac4-44e7-8824-006c212bfed1', 'ip_address': '172.20.0.2'}, {'subnet_id': 'f8eb29b5-ee06-488d-b4b5-2ba586595399'}], 'binding:host_id': 'n-d-841483-1'}, 'id': '47c27e64-f639-4bf0-abcc-1cee7f24246f'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:35:16.773443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:16.779449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8698b420-85c9-44d2-a856-545246a1fcf2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:16.783152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48749d4a-deea-4d4c-a7fb-b993eb89af17 req-b6c895c6-7652-4209-9041-e0bd0d59ff32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:16.785796 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48749d4a-deea-4d4c-a7fb-b993eb89af17 req-b6c895c6-7652-4209-9041-e0bd0d59ff32 service neutron] 10.222.0.76 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 0.4207094 May 12 15:35:16.793677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Made reservation on behalf of 3dd1fe8ad774471ba7745219a37ead53 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:16.798206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-89400ef4-98d8-445f-b76a-63de8136487e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] For port ab6c816d-4cf1-4fba-a817-8e43af7420e8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ab6c816d-4cf1-4fba-a817-8e43af7420e8,segment=NetworkSegment(f344cec1-3138-44bd-8d64-09a36451564e),segment_id=f344cec1-3138-44bd-8d64-09a36451564e)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:16.798571 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-89400ef4-98d8-445f-b76a-63de8136487e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:16.800463 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:16.806508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8698b420-85c9-44d2-a856-545246a1fcf2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:16.887507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port dfa75c44-4a7b-4633-a3ed-978c236dc4a2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:16.887915 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:16.904484 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:16.945362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8698b420-85c9-44d2-a856-545246a1fcf2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:16.946222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:16.951517 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8698b420-85c9-44d2-a856-545246a1fcf2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:16.951745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Usage tracker for resource:security_group_rule and tenant:3dd1fe8ad774471ba7745219a37ead53 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:16.955169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:16.972221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-89400ef4-98d8-445f-b76a-63de8136487e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for ab6c816d-4cf1-4fba-a817-8e43af7420e8 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:17.003074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94919f07-8096-48a0-bc4f-622954e0d05c None None] New status for floating IP 97ecb4c0-5dfe-4885-9fdc-e38dfbd87b5a: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:35:17.054234 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eee6194c-7e6c-499f-a04c-e39134c249a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:17.143138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:17.158085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:17.205757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Deleting port 162487c7-5780-4215-8f62-075f491d92bb {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:17.206170 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:17.251324 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:17.274263 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48749d4a-deea-4d4c-a7fb-b993eb89af17 req-8b05df0e-2891-4f34-9c88-b017dfdcaba7 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d45db345-6e10-417e-8b52-3260151d6ba4 HTTP/1.1" status: 200 len: 999 time: 0.4542906 May 12 15:35:17.346116 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8698b420-85c9-44d2-a856-545246a1fcf2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:17.347540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-403b86a2-356e-4628-bf78-4695de33b96d None None] For port dfa75c44-4a7b-4633-a3ed-978c236dc4a2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=dfa75c44-4a7b-4633-a3ed-978c236dc4a2,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:17.347939 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-403b86a2-356e-4628-bf78-4695de33b96d None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:17.364013 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port a7413f9d-9e4e-4483-888f-bb0f191030be yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:35:17.464655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8698b420-85c9-44d2-a856-545246a1fcf2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:17.470769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8698b420-85c9-44d2-a856-545246a1fcf2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:17.474054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8698b420-85c9-44d2-a856-545246a1fcf2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:17.474780 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8698b420-85c9-44d2-a856-545246a1fcf2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:17.519959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8698b420-85c9-44d2-a856-545246a1fcf2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=d363936d-3681-42b8-9dc3-f8cb84e4773e,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:17.534389 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-89400ef4-98d8-445f-b76a-63de8136487e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:17.561745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48749d4a-deea-4d4c-a7fb-b993eb89af17 req-0412f946-30bc-4aa6-8a8c-50dfbc12508a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:17.563181 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48749d4a-deea-4d4c-a7fb-b993eb89af17 req-0412f946-30bc-4aa6-8a8c-50dfbc12508a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.2756436 May 12 15:35:17.584117 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8698b420-85c9-44d2-a856-545246a1fcf2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.4432390 May 12 15:35:17.590037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56896) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:17.594198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89400ef4-98d8-445f-b76a-63de8136487e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=ab6c816d-4cf1-4fba-a817-8e43af7420e8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:17.597583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-403b86a2-356e-4628-bf78-4695de33b96d None None] Calling delete_port for dfa75c44-4a7b-4633-a3ed-978c236dc4a2 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:17.772687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'fixed_ips': [{'subnet_id': 'd363936d-3681-42b8-9dc3-f8cb84e4773e', 'ip_address': '2001:db8::e56:2408:864c:84d6'}], 'name': 'tempest-NetworksTestDHCPv6-1078949083'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:17.851509 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:17.883279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 47c27e64-f639-4bf0-abcc-1cee7f24246f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:17.915592 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-403b86a2-356e-4628-bf78-4695de33b96d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:17.927011 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-eee6194c-7e6c-499f-a04c-e39134c249a7 None None] Allocated IP 172.20.0.18 (61c670fe-88e6-4119-b6d1-b7a7c081b3a4/f8eb29b5-ee06-488d-b4b5-2ba586595399/47c27e64-f639-4bf0-abcc-1cee7f24246f) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:18.008334 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-403b86a2-356e-4628-bf78-4695de33b96d None None] Pushing event deleted for resources: {'Port': ['ID=dfa75c44-4a7b-4633-a3ed-978c236dc4a2,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:18.023858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-403b86a2-356e-4628-bf78-4695de33b96d None None] No DVR routers for this DVR port dfa75c44-4a7b-4633-a3ed-978c236dc4a2 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:35:18.050998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:18.054824 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-89400ef4-98d8-445f-b76a-63de8136487e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:18.107626 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a0e0c2d-308e-4440-9b86-0562219021cd None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:18.237426 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 47c27e64-f639-4bf0-abcc-1cee7f24246f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:18.237426 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:18.259128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Calling delete_port for 162487c7-5780-4215-8f62-075f491d92bb owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:18.314174 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:18.348887 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb0c6d2e-fdcf-4d92-8bee-4b50f17173d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:18.385179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-eee6194c-7e6c-499f-a04c-e39134c249a7 None None] For port 47c27e64-f639-4bf0-abcc-1cee7f24246f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=47c27e64-f639-4bf0-abcc-1cee7f24246f,segment=NetworkSegment(2f3a3d21-42be-470d-9a94-9d26ea4f7cb5),segment_id=2f3a3d21-42be-470d-9a94-9d26ea4f7cb5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:18.408422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48749d4a-deea-4d4c-a7fb-b993eb89af17 req-10d07bf9-7924-4ba0-888b-1110741ddf9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:18.410127 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48749d4a-deea-4d4c-a7fb-b993eb89af17 req-10d07bf9-7924-4ba0-888b-1110741ddf9e service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.8358617 May 12 15:35:18.410845 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:18.451404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:18.455103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-89400ef4-98d8-445f-b76a-63de8136487e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 397feb9b-2f46-4c79-af57-634897d5df53 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:35:18.482243 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eee6194c-7e6c-499f-a04c-e39134c249a7 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:18.562396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-eee6194c-7e6c-499f-a04c-e39134c249a7 None None] Transition to ACTIVE for port object 47c27e64-f639-4bf0-abcc-1cee7f24246f will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:18.571354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 551} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:35:18.581297 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eee6194c-7e6c-499f-a04c-e39134c249a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:18.590249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:18.627149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'SecurityGroup': ['ID=eed3649d-a197-40c8-bd0b-b90a4fbde54f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:18.642457 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': 'd363936d-3681-42b8-9dc3-f8cb84e4773e'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:35:18.643212 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:18.647456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-89400ef4-98d8-445f-b76a-63de8136487e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:18.656258 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-89400ef4-98d8-445f-b76a-63de8136487e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.9362917 May 12 15:35:18.656258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56900) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:18.665963 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87de230d-f2b5-4a02-a679-dd7a826bbc23 None None] Sync routers for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:18.682542 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87de230d-f2b5-4a02-a679-dd7a826bbc23 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:18.683979 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-87de230d-f2b5-4a02-a679-dd7a826bbc23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:18.740716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-6a1f7b1b-f6ee-4615-8aca-a54d6761815e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting subnet 591a1588-10d4-4137-bac1-05a7d387578c {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:35:18.742148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:18.742605 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Added segment 4dc52732-5577-45b0-b2eb-1c2616cc1c73 of type vlan for network d2e823c6-8acb-45b9-910c-0a4822a68f25 May 12 15:35:18.744425 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a1f7b1b-f6ee-4615-8aca-a54d6761815e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:18.788278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:18.814413 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dfa75c44-4a7b-4633-a3ed-978c236dc4a2 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:18.824662 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a1f7b1b-f6ee-4615-8aca-a54d6761815e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:18.850777 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eee6194c-7e6c-499f-a04c-e39134c249a7 None None] Pushing event updated for resources: {'Port': ['ID=47c27e64-f639-4bf0-abcc-1cee7f24246f,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:18.869892 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: dfa75c44-4a7b-4633-a3ed-978c236dc4a2 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:18.870139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dfa75c44-4a7b-4633-a3ed-978c236dc4a2 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:18.995998 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a1f7b1b-f6ee-4615-8aca-a54d6761815e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:19.004465 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-87de230d-f2b5-4a02-a679-dd7a826bbc23 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:19.037099 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Allocated IP 2001:db8::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/d363936d-3681-42b8-9dc3-f8cb84e4773e/7b0d2e66-4955-4892-9d41-208c99fd0ed1) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:19.128662 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a1f7b1b-f6ee-4615-8aca-a54d6761815e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:19.159782 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:19.248379 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a1f7b1b-f6ee-4615-8aca-a54d6761815e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:19.255119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a1f7b1b-f6ee-4615-8aca-a54d6761815e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Subnet': ['ID=591a1588-10d4-4137-bac1-05a7d387578c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:19.263469 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6a1f7b1b-f6ee-4615-8aca-a54d6761815e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/591a1588-10d4-4137-bac1-05a7d387578c HTTP/1.1" status: 204 len: 168 time: 0.6062298 May 12 15:35:19.269739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56904) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:19.387191 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:19.391555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b60b762d-4310-4072-ab09-6f4612561903 None None] Network ac7191e2-2e1e-4c14-b753-6a321d14e4d8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:19.458564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:19.461613 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48749d4a-deea-4d4c-a7fb-b993eb89af17 req-967ee24a-b246-4f12-9758-1a15ae96e30a service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0253806 May 12 15:35:19.483960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:19.484659 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:19.550892 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-87de230d-f2b5-4a02-a679-dd7a826bbc23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:17Z', 'revision_number': 8, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:52Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:19.555467 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87de230d-f2b5-4a02-a679-dd7a826bbc23 None None] Checking router: 397feb9b-2f46-4c79-af57-634897d5df53 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:35:19.561106 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] It took 0.22 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:35:19.568085 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87de230d-f2b5-4a02-a679-dd7a826bbc23 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:19.568701 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-87de230d-f2b5-4a02-a679-dd7a826bbc23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:19.579023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Transition to ACTIVE for port object 7b0d2e66-4955-4892-9d41-208c99fd0ed1 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:19.652386 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Transition to ACTIVE for port object 7b0d2e66-4955-4892-9d41-208c99fd0ed1 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:19.674645 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:19.786497 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:19.787700 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 47c27e64-f639-4bf0-abcc-1cee7f24246f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:19.832525 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:19.837278 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:19.843858 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:19.863253 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-87de230d-f2b5-4a02-a679-dd7a826bbc23 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:19.877222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Allocated IP 172.20.0.13 (61c670fe-88e6-4119-b6d1-b7a7c081b3a4/af0eee84-aac4-44e7-8824-006c212bfed1/a7413f9d-9e4e-4483-888f-bb0f191030be) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:19.884421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Allocated IP 172.20.0.21 (61c670fe-88e6-4119-b6d1-b7a7c081b3a4/f8eb29b5-ee06-488d-b4b5-2ba586595399/a7413f9d-9e4e-4483-888f-bb0f191030be) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:19.899854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] For port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1cca781e-5a14-42d3-a1b8-ad1abcb84f0c,segment=NetworkSegment(f344cec1-3138-44bd-8d64-09a36451564e),segment_id=f344cec1-3138-44bd-8d64-09a36451564e)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:19.900237 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:19.904606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4399f46-203d-4ffb-a3e9-e0521a5f8bb0 None None] DHCP port deletion for ac7191e2-2e1e-4c14-b753-6a321d14e4d8 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:35:19.917620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a4399f46-203d-4ffb-a3e9-e0521a5f8bb0 None None] Deleting port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:19.918682 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4399f46-203d-4ffb-a3e9-e0521a5f8bb0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.045218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:20.054939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Pushing event updated for resources: {'Port': ['ID=7b0d2e66-4955-4892-9d41-208c99fd0ed1,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:20.066840 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.074512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:20.075375 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.094023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e401ec02-6400-4773-8576-da6b8a7b4796 None None] Provisioning for port 47c27e64-f639-4bf0-abcc-1cee7f24246f completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:20.106052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e401ec02-6400-4773-8576-da6b8a7b4796 None None] Provisioning complete for port 47c27e64-f639-4bf0-abcc-1cee7f24246f triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:20.106592 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e401ec02-6400-4773-8576-da6b8a7b4796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.113328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 28b7f017-c4c6-445b-a340-02a082f7b0a8 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:35:20.157145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Attempting to bind port 7b0d2e66-4955-4892-9d41-208c99fd0ed1 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:35:20.157701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Attempting to bind port 7b0d2e66-4955-4892-9d41-208c99fd0ed1 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:35:20.158170 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Attempting to bind port 7b0d2e66-4955-4892-9d41-208c99fd0ed1 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:35:20.197872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 35, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:35:20.198990 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:35:20.200165 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.200678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:35:20.201282 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Bound port: 7b0d2e66-4955-4892-9d41-208c99fd0ed1, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:35:20.201795 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.204584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.296848 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 3.7857466 May 12 15:35:20.315156 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 47c27e64-f639-4bf0-abcc-1cee7f24246f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:20.315689 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.317643 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-87de230d-f2b5-4a02-a679-dd7a826bbc23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:17Z', 'revision_number': 8, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:52Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:20.322503 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87de230d-f2b5-4a02-a679-dd7a826bbc23 None None] The sync data for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 is: [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:17Z', 'revision_number': 8, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'dadf1f1f-b294-481c-b750-a7e100b498dd', 'name': '', 'network_id': 'a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:3f:54:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2662, 'fixed_ips': [{'subnet_id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:33Z', 'updated_at': '2022-05-12T15:34:52Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '75c05fee-160a-4d02-9aba-8ce92e1777d1', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:20.365598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56908) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:20.372575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Request body: {'router': {'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'admin_state_up': True, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:20.381687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:20.386757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Usage tracker for resource:router and tenant:3dd1fe8ad774471ba7745219a37ead53 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:20.390640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:20.396476 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.400233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:20.426544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Pushing event deleted for resources: {'Port': ['ID=162487c7-5780-4215-8f62-075f491d92bb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:20.453955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=1cca781e-5a14-42d3-a1b8-ad1abcb84f0c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:20.458928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No DVR routers for this DVR port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:35:20.461513 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.462677 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.507602 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a4399f46-203d-4ffb-a3e9-e0521a5f8bb0 None None] For port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1cca781e-5a14-42d3-a1b8-ad1abcb84f0c,segment=NetworkSegment(f344cec1-3138-44bd-8d64-09a36451564e),segment_id=f344cec1-3138-44bd-8d64-09a36451564e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:20.507990 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4399f46-203d-4ffb-a3e9-e0521a5f8bb0 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.589668 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.606542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.630237 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-48749d4a-deea-4d4c-a7fb-b993eb89af17 req-366ce84b-07a3-45df-b057-fb586dbadcc6 service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.1216047 May 12 15:35:20.639100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-125cea2a-a30f-46ba-9773-dc8aa8b75b42 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'Network': ['ID=d2e823c6-8acb-45b9-910c-0a4822a68f25,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:20.639982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ac7191e2-2e1e-4c14-b753-6a321d14e4d8']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:20.699687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a4399f46-203d-4ffb-a3e9-e0521a5f8bb0 None None] Calling delete_port for 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:20.712812 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.716868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f344cec1-3138-44bd-8d64-09a36451564e') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:20.717164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f344cec1-3138-44bd-8d64-09a36451564e') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:20.739072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-cb0c6d2e-fdcf-4d92-8bee-4b50f17173d2 admin admin] Deleting port 5ca267b9-8aa5-4388-b459-c37844d97daf {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:20.739570 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb0c6d2e-fdcf-4d92-8bee-4b50f17173d2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.792537 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-a4399f46-203d-4ffb-a3e9-e0521a5f8bb0 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:35:20.793485 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-a4399f46-203d-4ffb-a3e9-e0521a5f8bb0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:35:20.804143 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.806924 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.853101 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network d2e823c6-8acb-45b9-910c-0a4822a68f25 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:35:20.893855 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.946977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Transition to ACTIVE for port object a7413f9d-9e4e-4483-888f-bb0f191030be will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:20.962767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Releasing vlan 599 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:35:20.963095 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:20.967351 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] For port 7b0d2e66-4955-4892-9d41-208c99fd0ed1, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: timer() May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:35:20.978901 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:35:21.044917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:21.128372 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] For port 7b0d2e66-4955-4892-9d41-208c99fd0ed1, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7b0d2e66-4955-4892-9d41-208c99fd0ed1,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:35:21.143193 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:21.150023 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:21.176009 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:21.200919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Network': ['ID=ac7191e2-2e1e-4c14-b753-6a321d14e4d8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:21.218499 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-70dca322-ed6a-4892-9492-a420dd094b23 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/networks/ac7191e2-2e1e-4c14-b753-6a321d14e4d8 HTTP/1.1" status: 204 len: 168 time: 1.9472094 May 12 15:35:21.219113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56912) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:21.278822 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:21.289852 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:21.296490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a4399f46-203d-4ffb-a3e9-e0521a5f8bb0 None None] Deleting port 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:21.296868 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4399f46-203d-4ffb-a3e9-e0521a5f8bb0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:21.345507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::e56:2408:864c:84d6 (2447b094-d5d6-41ef-a146-2bf56f5399af/d363936d-3681-42b8-9dc3-f8cb84e4773e/28b7f017-c4c6-445b-a340-02a082f7b0a8) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:21.376992 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:21.377547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Fanout notify agent at l3_agent the message router_deleted on router b842700e-5e07-47e7-8454-463fccc547ff {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:35:21.411225 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:21.418460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a4399f46-203d-4ffb-a3e9-e0521a5f8bb0 None None] The port '1cca781e-5a14-42d3-a1b8-ad1abcb84f0c' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:35:21.424925 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-377a17d1-9b68-4ce5-9ca9-1f0a9b313916 None None] Pushing event updated for resources: {'Port': ['ID=7b0d2e66-4955-4892-9d41-208c99fd0ed1,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:21.508764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-cb0c6d2e-fdcf-4d92-8bee-4b50f17173d2 admin admin] For port 5ca267b9-8aa5-4388-b459-c37844d97daf, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5ca267b9-8aa5-4388-b459-c37844d97daf,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:21.509227 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb0c6d2e-fdcf-4d92-8bee-4b50f17173d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:21.703154 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:21.707716 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2f0dbf9c-80c5-4c3c-93b5-014fe079dcc4 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "DELETE /v2.0/routers/b842700e-5e07-47e7-8454-463fccc547ff HTTP/1.1" status: 204 len: 168 time: 6.8452389 May 12 15:35:21.722935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-cb0c6d2e-fdcf-4d92-8bee-4b50f17173d2 admin admin] Calling delete_port for 5ca267b9-8aa5-4388-b459-c37844d97daf owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:21.751205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56916) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:21.774678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:21.816712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:21.823269 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:21.823767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1cca781e-5a14-42d3-a1b8-ad1abcb84f0c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:21.824188 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ab6c816d-4cf1-4fba-a817-8e43af7420e8 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:21.828789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-133188087', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:21.836985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:21.842177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Usage tracker for resource:router and tenant:b68c8c6134e345c4b780c4a4abc4688f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:21.845595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:21.852288 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:21.863042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:21.876786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: ab6c816d-4cf1-4fba-a817-8e43af7420e8 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:21.878427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ab6c816d-4cf1-4fba-a817-8e43af7420e8 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:21.885307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:21.921587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=a7413f9d-9e4e-4483-888f-bb0f191030be,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:21.948773 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:21.949981 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:22.047674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:22.048463 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:22.068826 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:22.072628 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:22.107597 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:22.123521 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:22.153258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object 28b7f017-c4c6-445b-a340-02a082f7b0a8 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:22.161649 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7acc6bfc-f50d-4ccf-b014-e7aa9d33dd67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1005 time: 7.1446433 May 12 15:35:22.164322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56920) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:22.176705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b7ceb9af-2e6f-4194-8f74-90fc4f7e6919 None None] Provisioning for port a7413f9d-9e4e-4483-888f-bb0f191030be completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:22.184132 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b7ceb9af-2e6f-4194-8f74-90fc4f7e6919 None None] Provisioning complete for port a7413f9d-9e4e-4483-888f-bb0f191030be triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:22.184614 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b7ceb9af-2e6f-4194-8f74-90fc4f7e6919 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:22.231320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e2a68be3-17bf-4684-a430-3cd5c36b6ff2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'af0eee84-aac4-44e7-8824-006c212bfed1'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:22.265632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b7ceb9af-2e6f-4194-8f74-90fc4f7e6919 None None] Port a7413f9d-9e4e-4483-888f-bb0f191030be cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:35:22.307052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Allocated IP 172.25.8.115 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/a983e56b-eb5d-4657-9548-7a0bf06a02ad) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:22.529777 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6136976a-c74d-4004-af8e-2241525a9fc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:22.584431 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:22.662543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:22.687196 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:22.695155 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-312f5af6-f122-457b-9574-082cfa91d4b0 None None] Provisioning for port 7b0d2e66-4955-4892-9d41-208c99fd0ed1 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:22.801378 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb0c6d2e-fdcf-4d92-8bee-4b50f17173d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:22.822965 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:22.830900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:22.893554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:22.900310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:22.905357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:22.945331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'Port': ['ID=a983e56b-eb5d-4657-9548-7a0bf06a02ad,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:23.039526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:23.043667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:23.049399 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:23.050148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:23.190905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-6136976a-c74d-4004-af8e-2241525a9fc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port dadf1f1f-b294-481c-b750-a7e100b498dd {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:23.191803 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6136976a-c74d-4004-af8e-2241525a9fc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:23.192876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=28b7f017-c4c6-445b-a340-02a082f7b0a8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:23.282724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb0c6d2e-fdcf-4d92-8bee-4b50f17173d2 admin admin] Pushing event deleted for resources: {'Port': ['ID=5ca267b9-8aa5-4388-b459-c37844d97daf,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:23.284736 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2a68be3-17bf-4684-a430-3cd5c36b6ff2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:23.303777 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d8dc807b-6cfe-4997-8f87-d8e103b4502f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 5.6695688 May 12 15:35:23.323061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56926) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:23.332286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b2db5b80-3d9b-4ad2-91ba-49041461229e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'fixed_ips': [{'subnet_id': 'd363936d-3681-42b8-9dc3-f8cb84e4773e', 'ip_address': '2001:db8::e56:2408:864c:84d6'}], 'name': 'tempest-NetworksTestDHCPv6-633172995'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:23.433735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-04386045-ec3f-45ef-92cd-126f7c46539a None None] Provisioning for port 28b7f017-c4c6-445b-a340-02a082f7b0a8 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:23.439463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-04386045-ec3f-45ef-92cd-126f7c46539a None None] Provisioning complete for port 28b7f017-c4c6-445b-a340-02a082f7b0a8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:23.440593 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-04386045-ec3f-45ef-92cd-126f7c46539a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:23.501761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-04386045-ec3f-45ef-92cd-126f7c46539a None None] Port 28b7f017-c4c6-445b-a340-02a082f7b0a8 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:35:23.795736 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7b0d2e66-4955-4892-9d41-208c99fd0ed1 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:23.835569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb0c6d2e-fdcf-4d92-8bee-4b50f17173d2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:23.850559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-6136976a-c74d-4004-af8e-2241525a9fc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] For port dadf1f1f-b294-481c-b750-a7e100b498dd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=dadf1f1f-b294-481c-b750-a7e100b498dd,segment=NetworkSegment(5c6c2a14-bc6b-4bdd-922e-64008bac747c),segment_id=5c6c2a14-bc6b-4bdd-922e-64008bac747c)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:23.850921 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6136976a-c74d-4004-af8e-2241525a9fc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:23.880266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 7b0d2e66-4955-4892-9d41-208c99fd0ed1 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:23.886360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7b0d2e66-4955-4892-9d41-208c99fd0ed1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:23.887709 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:24.005496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-6136976a-c74d-4004-af8e-2241525a9fc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for dadf1f1f-b294-481c-b750-a7e100b498dd owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:24.022987 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:24.038239 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:24.081995 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 7b0d2e66-4955-4892-9d41-208c99fd0ed1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7b0d2e66-4955-4892-9d41-208c99fd0ed1,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:24.087983 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:24.094407 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:24.133604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b2db5b80-3d9b-4ad2-91ba-49041461229e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:24.143246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b2db5b80-3d9b-4ad2-91ba-49041461229e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:port and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:24.148132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b2db5b80-3d9b-4ad2-91ba-49041461229e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:24.157503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b2db5b80-3d9b-4ad2-91ba-49041461229e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:24.174338 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:24.188487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=7b0d2e66-4955-4892-9d41-208c99fd0ed1,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:24.261490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b2db5b80-3d9b-4ad2-91ba-49041461229e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:24.349379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-e2a68be3-17bf-4684-a430-3cd5c36b6ff2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Delete allocated IP 172.20.0.21 (61c670fe-88e6-4119-b6d1-b7a7c081b3a4/f8eb29b5-ee06-488d-b4b5-2ba586595399) {{(pid=88151) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} May 12 15:35:24.572239 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2db5b80-3d9b-4ad2-91ba-49041461229e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:24.665935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-b2db5b80-3d9b-4ad2-91ba-49041461229e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 1da43fb7-d908-4226-9d58-d2a5e5cc27d9 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:35:24.716731 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:24.866297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Allocated IP 172.25.8.60 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/7273d99a-871e-4625-813f-0696a9a73aa7) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:24.927928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cb0c6d2e-fdcf-4d92-8bee-4b50f17173d2 admin admin] Router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:35:24.934923 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:35:24.947330 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6136976a-c74d-4004-af8e-2241525a9fc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:25.054029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6136976a-c74d-4004-af8e-2241525a9fc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=dadf1f1f-b294-481c-b750-a7e100b498dd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:25.100852 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2a68be3-17bf-4684-a430-3cd5c36b6ff2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:25.159905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-e2a68be3-17bf-4684-a430-3cd5c36b6ff2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Transition to ACTIVE for port object a7413f9d-9e4e-4483-888f-bb0f191030be will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:25.235248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2a68be3-17bf-4684-a430-3cd5c36b6ff2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:25.379434 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:25.407537 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb0c6d2e-fdcf-4d92-8bee-4b50f17173d2 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:25.410682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2a68be3-17bf-4684-a430-3cd5c36b6ff2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=a7413f9d-9e4e-4483-888f-bb0f191030be,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:25.428832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4a44f63-8621-407e-9cfe-f30d7594d6a6 None None] Sync routers for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:25.439912 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6136976a-c74d-4004-af8e-2241525a9fc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:25.449785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4a44f63-8621-407e-9cfe-f30d7594d6a6 None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:25.450361 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-b2db5b80-3d9b-4ad2-91ba-49041461229e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] POST failed (client error): There was a conflict when trying to complete your request. May 12 15:35:25.450814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b2db5b80-3d9b-4ad2-91ba-49041461229e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:35:25.451173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a4a44f63-8621-407e-9cfe-f30d7594d6a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:25.490070 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cb0c6d2e-fdcf-4d92-8bee-4b50f17173d2 admin admin] 10.222.0.82 "PUT /v2.0/routers/616c45f4-38af-4ff7-8fb7-f1c61b204b6a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 11.2296548 May 12 15:35:25.492109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56930) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:25.592183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e2a68be3-17bf-4684-a430-3cd5c36b6ff2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] In _notify_port_updated(), no bound segment for port a7413f9d-9e4e-4483-888f-bb0f191030be on network 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:35:25.597631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2a68be3-17bf-4684-a430-3cd5c36b6ff2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:25.598272 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2a68be3-17bf-4684-a430-3cd5c36b6ff2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:25.599586 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e2a68be3-17bf-4684-a430-3cd5c36b6ff2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "PUT /v2.0/ports/a7413f9d-9e4e-4483-888f-bb0f191030be HTTP/1.1" status: 200 len: 920 time: 3.4330626 May 12 15:35:25.604360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56934) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:25.629131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4dc1a1d5-c1b2-459f-a2f7-062dd9c3f10a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'af0eee84-aac4-44e7-8824-006c212bfed1'}, {'subnet_id': 'f8eb29b5-ee06-488d-b4b5-2ba586595399'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:25.672563 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:25.733231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:35:25.753063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cd7d5ad9-a411-48ec-9e78-cec98cd0fcf3 None None] Provisioning for port a7413f9d-9e4e-4483-888f-bb0f191030be completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:25.759780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b2db5b80-3d9b-4ad2-91ba-49041461229e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 409 len: 388 time: 2.4337077 May 12 15:35:25.770263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cd7d5ad9-a411-48ec-9e78-cec98cd0fcf3 None None] Provisioning complete for port a7413f9d-9e4e-4483-888f-bb0f191030be triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:25.770856 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cd7d5ad9-a411-48ec-9e78-cec98cd0fcf3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:25.793434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56938) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:25.804469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7b0d2e66-4955-4892-9d41-208c99fd0ed1 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:25.907282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:25.934167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-cd7d5ad9-a411-48ec-9e78-cec98cd0fcf3 None None] Port a7413f9d-9e4e-4483-888f-bb0f191030be cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:35:25.937791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-a4a44f63-8621-407e-9cfe-f30d7594d6a6 None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:25.953233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:25.964022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:26.035895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Pushing event updated for resources: {'Port': ['ID=7273d99a-871e-4625-813f-0696a9a73aa7,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:26.046665 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:26.142935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:26.148305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7b0d2e66-4955-4892-9d41-208c99fd0ed1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:26.148716 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:26.149047 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4dc1a1d5-c1b2-459f-a2f7-062dd9c3f10a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:26.159034 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Sync routers for ids ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:26.175841 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Routers {'6c52b572-4880-47dd-bc9e-8f2160f5c2e4'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:26.176819 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:26.185416 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:26.187304 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b185de1e-1bbf-4226-92ae-941e5c306ad3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 894 time: 5.8204944 May 12 15:35:26.201470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6136976a-c74d-4004-af8e-2241525a9fc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 397feb9b-2f46-4c79-af57-634897d5df53 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:35:26.202661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56942) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:26.472082 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Set router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:26.516007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a4a44f63-8621-407e-9cfe-f30d7594d6a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:35:22Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:26.523149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4a44f63-8621-407e-9cfe-f30d7594d6a6 None None] Checking router: 616c45f4-38af-4ff7-8fb7-f1c61b204b6a for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:35:26.544344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4a44f63-8621-407e-9cfe-f30d7594d6a6 None None] Routers {'616c45f4-38af-4ff7-8fb7-f1c61b204b6a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:26.545662 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a4a44f63-8621-407e-9cfe-f30d7594d6a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:26.633749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-534cb6e5-c1b2-447a-8a28-837de4119e29 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:26.639879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-534cb6e5-c1b2-447a-8a28-837de4119e29 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:26.640703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-534cb6e5-c1b2-447a-8a28-837de4119e29 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:26.714670 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-21cf4999-0c41-495c-8ad6-f7749a82b31e tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=3dd1fe8ad774471ba7745219a37ead53&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.5043378 May 12 15:35:26.719619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56950) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:26.771783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-534cb6e5-c1b2-447a-8a28-837de4119e29 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:26.775819 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-534cb6e5-c1b2-447a-8a28-837de4119e29 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1686 time: 0.9658740 May 12 15:35:26.776490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56954) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:26.786241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-a4a44f63-8621-407e-9cfe-f30d7594d6a6 None None] Set router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:26.826558 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:35:23Z', 'revision_number': 3, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:26.831615 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Checking router: 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:35:26.831943 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Updating router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 port a983e56b-eb5d-4657-9548-7a0bf06a02ad binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:35:26.841515 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:26.888777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8806ee0-5b4f-4c08-b653-456d2df4c1ee tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:26.891786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b8806ee0-5b4f-4c08-b653-456d2df4c1ee tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1708567 May 12 15:35:26.897372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56958) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:26.908147 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:26.948223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-79b81264-c878-49ac-847a-75c65f7569af tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0496423 May 12 15:35:26.951400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56962) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:26.957143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1769874406', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:26.982488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] Deleting port af55654c-6da1-4098-b5ee-fd99b8cf7864 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:26.983124 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.093679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6136976a-c74d-4004-af8e-2241525a9fc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:27.106401 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6136976a-c74d-4004-af8e-2241525a9fc8 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.8794072 May 12 15:35:27.108305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:27.110817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56966) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:27.132428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df67d55a-b274-4629-8b8b-20a42e5b7180 None None] Sync routers for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:27.135774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2a30d3bc-1dab-4a96-8aec-b8b3e837ce6b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port 28b7f017-c4c6-445b-a340-02a082f7b0a8 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:27.136616 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a30d3bc-1dab-4a96-8aec-b8b3e837ce6b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.148071 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Usage tracker for resource:subnet and tenant:3dd1fe8ad774471ba7745219a37ead53 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:27.160859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:27.178948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:27.212634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-92422d8c-4178-4b6c-93e4-23d93670919c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting subnet 75c05fee-160a-4d02-9aba-8ce92e1777d1 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:35:27.215330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Made reservation on behalf of 3dd1fe8ad774471ba7745219a37ead53 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:27.219816 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.250085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df67d55a-b274-4629-8b8b-20a42e5b7180 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:27.250744 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-df67d55a-b274-4629-8b8b-20a42e5b7180 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:27.426454 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.446994 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Transition to ACTIVE for port object a983e56b-eb5d-4657-9548-7a0bf06a02ad will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:27.459483 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.461057 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-92422d8c-4178-4b6c-93e4-23d93670919c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.498997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-df67d55a-b274-4629-8b8b-20a42e5b7180 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:27.584593 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-92422d8c-4178-4b6c-93e4-23d93670919c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.602278 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a4a44f63-8621-407e-9cfe-f30d7594d6a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:35:22Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:27.612622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4a44f63-8621-407e-9cfe-f30d7594d6a6 None None] The sync data for ids ['616c45f4-38af-4ff7-8fb7-f1c61b204b6a'] in n-d-841483-1 is: [{'id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'name': 'tempest-AttachVolumeNegativeTest-1745869140-router', 'tenant_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166'}], 'enable_snat': True}, 'gw_port_id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:27:33Z', 'updated_at': '2022-05-12T15:35:22Z', 'revision_number': 5, 'project_id': 'c5f9faeb50de42b1a07298c25a4e4d6b', 'gw_port': {'id': 'af55654c-6da1-4098-b5ee-fd99b8cf7864', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:56:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '616c45f4-38af-4ff7-8fb7-f1c61b204b6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1999, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:27:37Z', 'updated_at': '2022-05-12T15:27:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:27.614025 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Attempting to bind port a983e56b-eb5d-4657-9548-7a0bf06a02ad on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:35:27.614548 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Attempting to bind port a983e56b-eb5d-4657-9548-7a0bf06a02ad by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:35:27.615119 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Attempting to bind port a983e56b-eb5d-4657-9548-7a0bf06a02ad on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:35:27.650837 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 35, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:35:27.651795 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:35:27.653658 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.654084 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:35:27.654586 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Bound port: a983e56b-eb5d-4657-9548-7a0bf06a02ad, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:35:27.655083 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.682907 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.701596 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.814917 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] For port a983e56b-eb5d-4657-9548-7a0bf06a02ad, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:35:27.819838 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] For port a983e56b-eb5d-4657-9548-7a0bf06a02ad, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a983e56b-eb5d-4657-9548-7a0bf06a02ad,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:35:27.820395 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-92422d8c-4178-4b6c-93e4-23d93670919c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.828798 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.850169 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cddc2a0-8ec6-41d2-9e9a-339e2edd1986 None None] Pushing event updated for resources: {'Port': ['ID=a983e56b-eb5d-4657-9548-7a0bf06a02ad,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:27.864895 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cddc2a0-8ec6-41d2-9e9a-339e2edd1986 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:27.866612 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cddc2a0-8ec6-41d2-9e9a-339e2edd1986 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:27.867117 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cddc2a0-8ec6-41d2-9e9a-339e2edd1986 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:27.868021 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cddc2a0-8ec6-41d2-9e9a-339e2edd1986 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:27.868729 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cddc2a0-8ec6-41d2-9e9a-339e2edd1986 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:27.869477 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cddc2a0-8ec6-41d2-9e9a-339e2edd1986 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:27.870303 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cddc2a0-8ec6-41d2-9e9a-339e2edd1986 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:27.871018 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cddc2a0-8ec6-41d2-9e9a-339e2edd1986 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:27.871729 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cddc2a0-8ec6-41d2-9e9a-339e2edd1986 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:27.872440 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cddc2a0-8ec6-41d2-9e9a-339e2edd1986 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:27.873145 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cddc2a0-8ec6-41d2-9e9a-339e2edd1986 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:27.873947 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cddc2a0-8ec6-41d2-9e9a-339e2edd1986 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:27.954163 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-92422d8c-4178-4b6c-93e4-23d93670919c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.976185 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-92422d8c-4178-4b6c-93e4-23d93670919c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:27.991432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] For port af55654c-6da1-4098-b5ee-fd99b8cf7864, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=af55654c-6da1-4098-b5ee-fd99b8cf7864,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:27.992388 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:28.001807 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Routers {'6c52b572-4880-47dd-bc9e-8f2160f5c2e4'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:28.002429 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:28.004335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f36114be-1297-48cb-a998-c1afb7b5f0d2 None None] Network a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:28.033903 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-92422d8c-4178-4b6c-93e4-23d93670919c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/75c05fee-160a-4d02-9aba-8ce92e1777d1 HTTP/1.1" status: 204 len: 168 time: 0.9220452 May 12 15:35:28.036046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'Subnet': ['ID=27cd1f2e-8b9d-4298-a44b-ce82945125a8,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:28.084093 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56970) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:28.100383 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cddc2a0-8ec6-41d2-9e9a-339e2edd1986 None None] Pushing event updated for resources: {'Port': ['ID=a983e56b-eb5d-4657-9548-7a0bf06a02ad,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:28.141111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Checking segment: {'id': '4dc52732-5577-45b0-b2eb-1c2616cc1c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:35:28.141909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Network hostable DHCP agents. Network: d2e823c6-8acb-45b9-910c-0a4822a68f25, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:35:28.147552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92422d8c-4178-4b6c-93e4-23d93670919c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Subnet': ['ID=75c05fee-160a-4d02-9aba-8ce92e1777d1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:28.252018 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] Set router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:28.329377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-df67d55a-b274-4629-8b8b-20a42e5b7180 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:24Z', 'revision_number': 9, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:28.336135 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:28.336577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df67d55a-b274-4629-8b8b-20a42e5b7180 None None] Checking router: 397feb9b-2f46-4c79-af57-634897d5df53 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:35:28.344703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Network d2e823c6-8acb-45b9-910c-0a4822a68f25 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:35:28.353364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df67d55a-b274-4629-8b8b-20a42e5b7180 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:28.353668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-df67d55a-b274-4629-8b8b-20a42e5b7180 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:28.375306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, d2e823c6-8acb-45b9-910c-0a4822a68f25) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:28.382468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port f6f14166-3f05-4400-9626-f28a4c3daa37 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:28.383080 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:28.424158 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a30d3bc-1dab-4a96-8aec-b8b3e837ce6b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:28.439063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:28.439954 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:28.516194 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-14eaf1de-2b8d-4e20-9766-8cba948a3755 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 1.5635133 May 12 15:35:28.528832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56974) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:28.545122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-df67d55a-b274-4629-8b8b-20a42e5b7180 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:28.585226 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2a30d3bc-1dab-4a96-8aec-b8b3e837ce6b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for 28b7f017-c4c6-445b-a340-02a082f7b0a8 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:28.653096 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:35:23Z', 'revision_number': 3, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:28.657670 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1a42c5d-c213-4a20-86f1-79c7703ced7d None None] The sync data for ids ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'] in n-d-841483-1 is: [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:35:23Z', 'revision_number': 3, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:28.701457 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa5c4edc-96c2-45b6-afe0-c25d6694ac2f None None] Network d2e823c6-8acb-45b9-910c-0a4822a68f25 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:28.807176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-4dc1a1d5-c1b2-459f-a2f7-062dd9c3f10a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Allocated IP 172.20.0.19 (61c670fe-88e6-4119-b6d1-b7a7c081b3a4/f8eb29b5-ee06-488d-b4b5-2ba586595399/a7413f9d-9e4e-4483-888f-bb0f191030be) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:28.854099 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4af93027-0078-432d-9f97-37cd4396f109 None None] DHCP port deletion for a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:35:28.877695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4af93027-0078-432d-9f97-37cd4396f109 None None] Deleting port f6f14166-3f05-4400-9626-f28a4c3daa37 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:28.877957 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4af93027-0078-432d-9f97-37cd4396f109 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:28.891807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] Calling delete_port for af55654c-6da1-4098-b5ee-fd99b8cf7864 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:29.188099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] For port f6f14166-3f05-4400-9626-f28a4c3daa37, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f6f14166-3f05-4400-9626-f28a4c3daa37,segment=NetworkSegment(5c6c2a14-bc6b-4bdd-922e-64008bac747c),segment_id=5c6c2a14-bc6b-4bdd-922e-64008bac747c)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:29.188662 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:29.244495 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a30d3bc-1dab-4a96-8aec-b8b3e837ce6b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:29.401895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a30d3bc-1dab-4a96-8aec-b8b3e837ce6b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=28b7f017-c4c6-445b-a340-02a082f7b0a8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:29.415305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for f6f14166-3f05-4400-9626-f28a4c3daa37 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:29.470013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-d2e823c6-8acb-45b9-910c-0a4822a68f25', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'fixed_ips': [{'subnet_id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:35:29.470881 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:29.510666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4af93027-0078-432d-9f97-37cd4396f109 None None] For port f6f14166-3f05-4400-9626-f28a4c3daa37, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f6f14166-3f05-4400-9626-f28a4c3daa37,segment=NetworkSegment(5c6c2a14-bc6b-4bdd-922e-64008bac747c),segment_id=5c6c2a14-bc6b-4bdd-922e-64008bac747c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:29.511452 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4af93027-0078-432d-9f97-37cd4396f109 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:29.607457 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a30d3bc-1dab-4a96-8aec-b8b3e837ce6b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:29.710180 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2a30d3bc-1dab-4a96-8aec-b8b3e837ce6b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/28b7f017-c4c6-445b-a340-02a082f7b0a8 HTTP/1.1" status: 204 len: 168 time: 2.8897903 May 12 15:35:29.723724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56978) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:29.768175 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:29.793836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4af93027-0078-432d-9f97-37cd4396f109 None None] Calling delete_port for f6f14166-3f05-4400-9626-f28a4c3daa37 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:29.810085 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:29.825800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a983e56b-eb5d-4657-9548-7a0bf06a02ad up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:29.848084 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4dc1a1d5-c1b2-459f-a2f7-062dd9c3f10a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:29.858008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=f6f14166-3f05-4400-9626-f28a4c3daa37,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:29.866943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No DVR routers for this DVR port f6f14166-3f05-4400-9626-f28a4c3daa37 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:35:29.969868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-df67d55a-b274-4629-8b8b-20a42e5b7180 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:24Z', 'revision_number': 9, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:30.021691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df67d55a-b274-4629-8b8b-20a42e5b7180 None None] The sync data for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 is: [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:24Z', 'revision_number': 9, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512', 'name': '', 'network_id': '3c31163d-b39c-4c17-b3f6-91c5029a0605', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:da:32:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2639, 'fixed_ips': [{'subnet_id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:13Z', 'updated_at': '2022-05-12T15:34:30Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '806356d2-2805-4b3e-b8c9-31e26512edbe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:30.032286 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-4af93027-0078-432d-9f97-37cd4396f109 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:35:30.032623 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-4af93027-0078-432d-9f97-37cd4396f109 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:35:30.055558 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port a983e56b-eb5d-4657-9548-7a0bf06a02ad completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:30.069992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Allocated IP 172.20.0.2 (d2e823c6-8acb-45b9-910c-0a4822a68f25/27cd1f2e-8b9d-4298-a44b-ce82945125a8/4777b5ea-852f-4989-a7e6-a649768384c2) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:30.080682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a983e56b-eb5d-4657-9548-7a0bf06a02ad triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:30.080880 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.095540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1dc91f6b-5f9a-4516-b25a-c564ddc7f24f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:30.096784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1dc91f6b-5f9a-4516-b25a-c564ddc7f24f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:30.097645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1dc91f6b-5f9a-4516-b25a-c564ddc7f24f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:30.099487 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.116985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-4dc1a1d5-c1b2-459f-a2f7-062dd9c3f10a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Transition to ACTIVE for port object a7413f9d-9e4e-4483-888f-bb0f191030be will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:30.177369 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.178034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:30.203063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5c6c2a14-bc6b-4bdd-922e-64008bac747c') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:30.203780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5c6c2a14-bc6b-4bdd-922e-64008bac747c') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:30.238282 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.248385 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4dc1a1d5-c1b2-459f-a2f7-062dd9c3f10a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.297291 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.313740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Releasing vlan 568 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:35:30.314621 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: timer() May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:35:30.330371 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:35:30.349521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] Pushing event deleted for resources: {'Port': ['ID=af55654c-6da1-4098-b5ee-fd99b8cf7864,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:30.364893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1dc91f6b-5f9a-4516-b25a-c564ddc7f24f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:30.367984 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1dc91f6b-5f9a-4516-b25a-c564ddc7f24f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.6417561 May 12 15:35:30.398994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56982) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:30.446339 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.483329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dc1a1d5-c1b2-459f-a2f7-062dd9c3f10a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=a7413f9d-9e4e-4483-888f-bb0f191030be,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:30.533630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4af93027-0078-432d-9f97-37cd4396f109 None None] Deleting port f6f14166-3f05-4400-9626-f28a4c3daa37 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:30.534000 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4af93027-0078-432d-9f97-37cd4396f109 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.564231 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.583081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port a983e56b-eb5d-4657-9548-7a0bf06a02ad, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a983e56b-eb5d-4657-9548-7a0bf06a02ad,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:30.595115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.596904 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.608453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-ba5ccea9-528f-4d84-a3f6-73d92f89f70c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet d363936d-3681-42b8-9dc3-f8cb84e4773e {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:35:30.621572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Network': ['ID=a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:30.623604 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba5ccea9-528f-4d84-a3f6-73d92f89f70c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.665561 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.672474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4af93027-0078-432d-9f97-37cd4396f109 None None] The port 'f6f14166-3f05-4400-9626-f28a4c3daa37' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:35:30.675784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9dafad6c-0fcc-4295-9135-78d35cf9e0e6 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/networks/a203786c-bfb4-4a67-b6cb-e1d4fcd1aa67 HTTP/1.1" status: 204 len: 168 time: 2.5905194 May 12 15:35:30.683110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56986) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:30.721649 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.738944 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5ca267b9-8aa5-4388-b459-c37844d97daf no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:30.776701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=a983e56b-eb5d-4657-9548-7a0bf06a02ad,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:30.779911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Transition to ACTIVE for port object 4777b5ea-852f-4989-a7e6-a649768384c2 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:30.832587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Transition to ACTIVE for port object 4777b5ea-852f-4989-a7e6-a649768384c2 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:30.836798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 5ca267b9-8aa5-4388-b459-c37844d97daf {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:30.837546 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5ca267b9-8aa5-4388-b459-c37844d97daf not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:30.838474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6f14166-3f05-4400-9626-f28a4c3daa37 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:30.851321 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:30.875852 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.022887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Network d2e823c6-8acb-45b9-910c-0a4822a68f25 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:31.037315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Pushing event updated for resources: {'Port': ['ID=4777b5ea-852f-4989-a7e6-a649768384c2,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:31.055770 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:31.060370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: f6f14166-3f05-4400-9626-f28a4c3daa37 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:31.061254 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6f14166-3f05-4400-9626-f28a4c3daa37 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:31.064589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:31.162646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Router d036de14-6f7b-4786-987e-e736b2bff409 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:35:31.177845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba5ccea9-528f-4d84-a3f6-73d92f89f70c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.180970 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.190908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.197114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6acd4de5-965b-4464-957b-d53fe049348f None None] Provisioning for port a7413f9d-9e4e-4483-888f-bb0f191030be completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:31.208531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6acd4de5-965b-4464-957b-d53fe049348f None None] Provisioning complete for port a7413f9d-9e4e-4483-888f-bb0f191030be triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:31.208897 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6acd4de5-965b-4464-957b-d53fe049348f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.234002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Attempting to bind port 4777b5ea-852f-4989-a7e6-a649768384c2 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:35:31.234335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Attempting to bind port 4777b5ea-852f-4989-a7e6-a649768384c2 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '4dc52732-5577-45b0-b2eb-1c2616cc1c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:35:31.234650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Attempting to bind port 4777b5ea-852f-4989-a7e6-a649768384c2 on network d2e823c6-8acb-45b9-910c-0a4822a68f25 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:35:31.284566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 35, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:35:31.285821 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Checking segment: {'id': '4dc52732-5577-45b0-b2eb-1c2616cc1c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:35:31.286399 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.286956 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Bound using segment: {'id': '4dc52732-5577-45b0-b2eb-1c2616cc1c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:35:31.287590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Bound port: 4777b5ea-852f-4989-a7e6-a649768384c2, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4dc52732-5577-45b0-b2eb-1c2616cc1c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:35:31.288133 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.309745 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba5ccea9-528f-4d84-a3f6-73d92f89f70c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.321356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4dc1a1d5-c1b2-459f-a2f7-062dd9c3f10a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] In _notify_port_updated(), no bound segment for port a7413f9d-9e4e-4483-888f-bb0f191030be on network 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:35:31.332568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4dc1a1d5-c1b2-459f-a2f7-062dd9c3f10a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:31.333619 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4dc1a1d5-c1b2-459f-a2f7-062dd9c3f10a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.338076 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4dc1a1d5-c1b2-459f-a2f7-062dd9c3f10a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "PUT /v2.0/ports/a7413f9d-9e4e-4483-888f-bb0f191030be HTTP/1.1" status: 200 len: 1000 time: 5.7184513 May 12 15:35:31.342272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56990) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:31.387035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6acd4de5-965b-4464-957b-d53fe049348f None None] Port a7413f9d-9e4e-4483-888f-bb0f191030be cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:35:31.393980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.394938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 616c45f4-38af-4ff7-8fb7-f1c61b204b6a {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:35:31.427316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] For port 4777b5ea-852f-4989-a7e6-a649768384c2, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:35:31.431625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] For port 4777b5ea-852f-4989-a7e6-a649768384c2, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4777b5ea-852f-4989-a7e6-a649768384c2,segment=NetworkSegment(4dc52732-5577-45b0-b2eb-1c2616cc1c73),segment_id=4dc52732-5577-45b0-b2eb-1c2616cc1c73)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:35:31.437130 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.517119 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.521257 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1b53aa67-7823-4a83-8be4-1748443ad753 admin admin] 10.222.0.82 "DELETE /v2.0/routers/616c45f4-38af-4ff7-8fb7-f1c61b204b6a HTTP/1.1" status: 204 len: 168 time: 6.0294020 May 12 15:35:31.522227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56994) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:31.595443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1a825340-b3b0-4647-b3b3-208dba3bd6de tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port a7413f9d-9e4e-4483-888f-bb0f191030be {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:31.595785 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a825340-b3b0-4647-b3b3-208dba3bd6de tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.598081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-490065c0-dfba-4e53-9e03-e9f7000dc833 None None] Pushing event updated for resources: {'Port': ['ID=4777b5ea-852f-4989-a7e6-a649768384c2,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:31.672285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:31.685928 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0536d54-4a23-491b-8560-09dcd52ff741 None None] Sync routers for ids ['d036de14-6f7b-4786-987e-e736b2bff409'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:31.702972 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0536d54-4a23-491b-8560-09dcd52ff741 None None] Routers {'d036de14-6f7b-4786-987e-e736b2bff409'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:31.703602 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d0536d54-4a23-491b-8560-09dcd52ff741 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['d036de14-6f7b-4786-987e-e736b2bff409'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:31.739878 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba5ccea9-528f-4d84-a3f6-73d92f89f70c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.757586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-438c4ad0-7696-4c53-b955-5d8607a3081e admin admin] Deleting subnet 7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:35:31.777093 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-438c4ad0-7696-4c53-b955-5d8607a3081e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.784584 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d0536d54-4a23-491b-8560-09dcd52ff741 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:31.795395 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0536d54-4a23-491b-8560-09dcd52ff741 None None] Routers {'d036de14-6f7b-4786-987e-e736b2bff409'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:31.796038 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d0536d54-4a23-491b-8560-09dcd52ff741 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['d036de14-6f7b-4786-987e-e736b2bff409'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:31.812865 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.816983 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-82ebb695-097c-4351-9c94-fbed966e8f42 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 10.0116873 May 12 15:35:31.826081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56998) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:31.841619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:31.865925 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d0536d54-4a23-491b-8560-09dcd52ff741 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:31.866303 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0536d54-4a23-491b-8560-09dcd52ff741 None None] The sync data for ids ['d036de14-6f7b-4786-987e-e736b2bff409'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:31.867614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba5ccea9-528f-4d84-a3f6-73d92f89f70c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=d363936d-3681-42b8-9dc3-f8cb84e4773e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:31.890824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e143913-2d53-4571-a7b6-feed67fc43b8 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:31.901974 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba5ccea9-528f-4d84-a3f6-73d92f89f70c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:31.999964 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ba5ccea9-528f-4d84-a3f6-73d92f89f70c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/d363936d-3681-42b8-9dc3-f8cb84e4773e HTTP/1.1" status: 204 len: 168 time: 1.5999918 May 12 15:35:32.035742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57002) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:32.166454 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-438c4ad0-7696-4c53-b955-5d8607a3081e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:32.183722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bb8a6d82-413f-470b-9b5a-19883a43aa89 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1465063 May 12 15:35:32.188581 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a983e56b-eb5d-4657-9548-7a0bf06a02ad up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:32.192361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57006) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:32.199006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b179f823-6ed1-4920-ad46-6bc057412d0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:32.383917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a983e56b-eb5d-4657-9548-7a0bf06a02ad triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:32.384225 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:32.460360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b179f823-6ed1-4920-ad46-6bc057412d0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:32.464048 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:32.469090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b179f823-6ed1-4920-ad46-6bc057412d0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:32.473494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b179f823-6ed1-4920-ad46-6bc057412d0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:32.479798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0109c61-c9bc-44c8-940c-399d4a5eb9cc None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:35:32.482953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b179f823-6ed1-4920-ad46-6bc057412d0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:32.487802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Allocated IP 172.20.0.1 (d2e823c6-8acb-45b9-910c-0a4822a68f25/27cd1f2e-8b9d-4298-a44b-ce82945125a8/63b42831-39a6-4a50-a6ab-4dce60dc93b6) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:32.489200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f0109c61-c9bc-44c8-940c-399d4a5eb9cc None None] Deleting port 7b0d2e66-4955-4892-9d41-208c99fd0ed1 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:32.490070 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f0109c61-c9bc-44c8-940c-399d4a5eb9cc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:32.514995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b179f823-6ed1-4920-ad46-6bc057412d0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:32.518660 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b179f823-6ed1-4920-ad46-6bc057412d0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:32.528037 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a825340-b3b0-4647-b3b3-208dba3bd6de tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:32.707786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dadf1f1f-b294-481c-b750-a7e100b498dd no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:32.746079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1a825340-b3b0-4647-b3b3-208dba3bd6de tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for a7413f9d-9e4e-4483-888f-bb0f191030be owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:32.818300 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-438c4ad0-7696-4c53-b955-5d8607a3081e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:32.845665 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: dadf1f1f-b294-481c-b750-a7e100b498dd {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:32.846010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device dadf1f1f-b294-481c-b750-a7e100b498dd not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:32.880630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f0109c61-c9bc-44c8-940c-399d4a5eb9cc None None] For port 7b0d2e66-4955-4892-9d41-208c99fd0ed1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7b0d2e66-4955-4892-9d41-208c99fd0ed1,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:32.880630 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f0109c61-c9bc-44c8-940c-399d4a5eb9cc None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:32.913468 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd684432-7488-4b62-b5cc-339e958d5dab tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.014944 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f0109c61-c9bc-44c8-940c-399d4a5eb9cc None None] Calling delete_port for 7b0d2e66-4955-4892-9d41-208c99fd0ed1 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:33.105442 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f0109c61-c9bc-44c8-940c-399d4a5eb9cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.158925 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a113870-e277-4c07-9903-899dce615fa9 None None] Network d2e823c6-8acb-45b9-910c-0a4822a68f25 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:33.172200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0109c61-c9bc-44c8-940c-399d4a5eb9cc None None] No DVR routers for this DVR port 7b0d2e66-4955-4892-9d41-208c99fd0ed1 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:35:33.174197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0109c61-c9bc-44c8-940c-399d4a5eb9cc None None] Pushing event deleted for resources: {'Port': ['ID=7b0d2e66-4955-4892-9d41-208c99fd0ed1,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:33.209015 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-438c4ad0-7696-4c53-b955-5d8607a3081e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.224469 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.334172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-438c4ad0-7696-4c53-b955-5d8607a3081e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7cf2ffc4-f41f-40e3-90d1-77e214ee94e3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:33.341429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2981e0b1-2a6a-44ff-9a88-5492b301f1b6 None None] Provisioning for port 4777b5ea-852f-4989-a7e6-a649768384c2 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:33.344973 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-438c4ad0-7696-4c53-b955-5d8607a3081e admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.345413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Transition to ACTIVE for port object 63b42831-39a6-4a50-a6ab-4dce60dc93b6 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:33.357708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-949b0feb-53a0-4704-9270-9388275a418f None None] Network dbecac63-cd00-4ee6-bec1-19abe557d6e1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:33.379740 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.389789 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-438c4ad0-7696-4c53-b955-5d8607a3081e admin admin] 10.222.0.82 "DELETE /v2.0/subnets/7cf2ffc4-f41f-40e3-90d1-77e214ee94e3 HTTP/1.1" status: 204 len: 168 time: 1.8559504 May 12 15:35:33.389789 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a825340-b3b0-4647-b3b3-208dba3bd6de tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.392936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57010) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:33.498187 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.498890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a825340-b3b0-4647-b3b3-208dba3bd6de tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=a7413f9d-9e4e-4483-888f-bb0f191030be,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:33.507866 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.589224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Deleting port 7273d99a-871e-4625-813f-0696a9a73aa7 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:33.589975 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.652028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Network d2e823c6-8acb-45b9-910c-0a4822a68f25 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:33.698451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:33.753710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:33.782682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f391807-ab39-4d18-bad5-b9953ec49def None None] DHCP port deletion for dbecac63-cd00-4ee6-bec1-19abe557d6e1 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:35:33.788541 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2f391807-ab39-4d18-bad5-b9953ec49def None None] Deleting port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:33.788920 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2f391807-ab39-4d18-bad5-b9953ec49def None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.795247 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.821653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'Port': ['ID=63b42831-39a6-4a50-a6ab-4dce60dc93b6,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:33.836111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a825340-b3b0-4647-b3b3-208dba3bd6de tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.838146 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1a825340-b3b0-4647-b3b3-208dba3bd6de tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/a7413f9d-9e4e-4483-888f-bb0f191030be HTTP/1.1" status: 204 len: 168 time: 2.4946887 May 12 15:35:33.842390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57014) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:33.867956 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b179f823-6ed1-4920-ad46-6bc057412d0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.899388 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4777b5ea-852f-4989-a7e6-a649768384c2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:33.911405 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-d412aaeb-2cf8-4d33-95ec-e3cc18549dca tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] GET failed (client error): The resource could not be found. May 12 15:35:33.911944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d412aaeb-2cf8-4d33-95ec-e3cc18549dca tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:33.920370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Deleting port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:33.920718 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.970362 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.975392 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:33.989112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d412aaeb-2cf8-4d33-95ec-e3cc18549dca tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:33.990721 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d412aaeb-2cf8-4d33-95ec-e3cc18549dca tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/a7413f9d-9e4e-4483-888f-bb0f191030be HTTP/1.1" status: 404 len: 333 time: 0.1472549 May 12 15:35:34.024557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57018) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:34.047832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b179f823-6ed1-4920-ad46-6bc057412d0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:34.104441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-b179f823-6ed1-4920-ad46-6bc057412d0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:34.127091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b179f823-6ed1-4920-ad46-6bc057412d0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:34.127706 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b179f823-6ed1-4920-ad46-6bc057412d0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:34.129218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-febbeee1-1607-4973-a652-395bac05a902 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:34.148359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Calling delete_port for 7273d99a-871e-4625-813f-0696a9a73aa7 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:34.162904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b179f823-6ed1-4920-ad46-6bc057412d0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=7296312a-865f-4b1e-907b-661eff5bf990,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:34.262329 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d5a0b397-5a06-4b6f-bb7d-48a995b51c82 None None] Provisioning for port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:34.289186 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b179f823-6ed1-4920-ad46-6bc057412d0a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 2.0954642 May 12 15:35:34.302574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-b2a08a4a-cc3a-41d7-ad81-16258f03b7fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting subnet f8eb29b5-ee06-488d-b4b5-2ba586595399 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:35:34.329565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57024) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:34.337137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a9baaae8-7eea-4d4a-880a-87bf9a4cb727 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'fixed_ips': [{'subnet_id': '7296312a-865f-4b1e-907b-661eff5bf990', 'ip_address': '2001:db8:0:1::4'}], 'name': 'tempest-NetworksTestDHCPv6-88736489'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:34.356117 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2a08a4a-cc3a-41d7-ad81-16258f03b7fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:34.392111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d5a0b397-5a06-4b6f-bb7d-48a995b51c82 None None] Provisioning complete for port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:34.392391 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d5a0b397-5a06-4b6f-bb7d-48a995b51c82 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:34.461766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 4777b5ea-852f-4989-a7e6-a649768384c2 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:34.483566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4777b5ea-852f-4989-a7e6-a649768384c2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:34.483813 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:34.553423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d5a0b397-5a06-4b6f-bb7d-48a995b51c82 None None] Port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:35:34.555839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2f391807-ab39-4d18-bad5-b9953ec49def None None] For port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f6b0d072-4fb0-490d-a7c2-d6cd2ad99893,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:34.556076 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2f391807-ab39-4d18-bad5-b9953ec49def None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:34.574123 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:34.634457 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2a08a4a-cc3a-41d7-ad81-16258f03b7fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:34.656891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Pushing event deleted for resources: {'Port': ['ID=7273d99a-871e-4625-813f-0696a9a73aa7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:34.691874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] For port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f6b0d072-4fb0-490d-a7c2-d6cd2ad99893,segment=NetworkSegment(37f382a7-d0b1-492c-b3e7-035c86377975),segment_id=37f382a7-d0b1-492c-b3e7-035c86377975)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:34.692237 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:34.711741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-bd684432-7488-4b62-b5cc-339e958d5dab tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:34.712077 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd684432-7488-4b62-b5cc-339e958d5dab tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:34.728287 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:34.752630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2f391807-ab39-4d18-bad5-b9953ec49def None None] Calling delete_port for f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:34.811483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d5a0b397-5a06-4b6f-bb7d-48a995b51c82 None None] Provisioning complete for port 4777b5ea-852f-4989-a7e6-a649768384c2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:34.811930 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d5a0b397-5a06-4b6f-bb7d-48a995b51c82 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:34.994511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '7296312a-865f-4b1e-907b-661eff5bf990'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:35:34.995935 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:35.034264 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2f391807-ab39-4d18-bad5-b9953ec49def None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:35.091153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Calling delete_port for f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:35.101187 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:35.153645 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:35.157249 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:35.181435 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f391807-ab39-4d18-bad5-b9953ec49def None None] Pushing event deleted for resources: {'Port': ['ID=f6b0d072-4fb0-490d-a7c2-d6cd2ad99893,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:35.196251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f391807-ab39-4d18-bad5-b9953ec49def None None] No DVR routers for this DVR port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:35:35.299947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a9baaae8-7eea-4d4a-880a-87bf9a4cb727 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:35.308152 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d5a0b397-5a06-4b6f-bb7d-48a995b51c82 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:35.333988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a9baaae8-7eea-4d4a-880a-87bf9a4cb727 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:port and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:35.337494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Router d036de14-6f7b-4786-987e-e736b2bff409 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:35:35.339431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a9baaae8-7eea-4d4a-880a-87bf9a4cb727 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:35.362643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 4777b5ea-852f-4989-a7e6-a649768384c2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4777b5ea-852f-4989-a7e6-a649768384c2,segment=NetworkSegment(4dc52732-5577-45b0-b2eb-1c2616cc1c73),segment_id=4dc52732-5577-45b0-b2eb-1c2616cc1c73)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:35.370370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a9baaae8-7eea-4d4a-880a-87bf9a4cb727 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:35.375892 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:35.377831 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:35.443680 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2a08a4a-cc3a-41d7-ad81-16258f03b7fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:35.504492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a9baaae8-7eea-4d4a-880a-87bf9a4cb727 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:35.518060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:35.530872 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:35.534469 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3a9fba35-2f69-4b99-8b2a-9ea89173c662 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "PUT /v2.0/routers/d036de14-6f7b-4786-987e-e736b2bff409 HTTP/1.1" status: 200 len: 709 time: 3.7051890 May 12 15:35:35.534631 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Allocated IP 2001:db8::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/7296312a-865f-4b1e-907b-661eff5bf990/39bbd131-095c-40d3-9d8e-8ccf6999513c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:35.534719 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:35:35.534719 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:35:35.534923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57028) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:35.641525 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7b0d2e66-4955-4892-9d41-208c99fd0ed1 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:35.675223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9cbff912-01cf-45fd-abc0-78c50195d373 None None] Sync routers for ids ['d036de14-6f7b-4786-987e-e736b2bff409'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:35.678511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-bd684432-7488-4b62-b5cc-339e958d5dab tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] For port 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512,segment=NetworkSegment(9eb20257-af83-41dc-b1ae-d8bb904b94c9),segment_id=9eb20257-af83-41dc-b1ae-d8bb904b94c9)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:35.679388 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd684432-7488-4b62-b5cc-339e958d5dab tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:35.690284 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-49e88f5c-79db-49eb-88f0-14fdbecdacae tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/routers/d036de14-6f7b-4786-987e-e736b2bff409 HTTP/1.1" status: 200 len: 744 time: 0.1519208 May 12 15:35:35.690848 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57032) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:35.741956 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-da46edd0-0802-4a5a-98b4-ae71649f7e48 tempest-RoutersIpV6AdminTest-1703935241 tempest-RoutersIpV6AdminTest-1703935241-project-admin] 10.222.0.82 "GET /v2.0/ports?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&device_id=d036de14-6f7b-4786-987e-e736b2bff409 HTTP/1.1" status: 200 len: 205 time: 0.0476656 May 12 15:35:35.742381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57036) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:35.800228 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2a132a3d-5f1a-47ed-a09d-f21d8ae17d55 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "GET /v2.0/ports?device_id=d036de14-6f7b-4786-987e-e736b2bff409 HTTP/1.1" status: 200 len: 205 time: 0.0525742 May 12 15:35:35.800497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57040) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:35.802018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 7b0d2e66-4955-4892-9d41-208c99fd0ed1 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:35.802195 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7b0d2e66-4955-4892-9d41-208c99fd0ed1 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:35.802556 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device af55654c-6da1-4098-b5ee-fd99b8cf7864 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:35.869016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: af55654c-6da1-4098-b5ee-fd99b8cf7864 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:35.869350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device af55654c-6da1-4098-b5ee-fd99b8cf7864 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:35.878796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=4777b5ea-852f-4989-a7e6-a649768384c2,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:35.889118 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cbff912-01cf-45fd-abc0-78c50195d373 None None] Routers {'d036de14-6f7b-4786-987e-e736b2bff409'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:35.889791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9cbff912-01cf-45fd-abc0-78c50195d373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['d036de14-6f7b-4786-987e-e736b2bff409'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:35.924827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-bd684432-7488-4b62-b5cc-339e958d5dab tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:35.954882 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-d5a0b397-5a06-4b6f-bb7d-48a995b51c82 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:35:35.955229 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-d5a0b397-5a06-4b6f-bb7d-48a995b51c82 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:35:35.974903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9cbff912-01cf-45fd-abc0-78c50195d373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:36.025006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4777b5ea-852f-4989-a7e6-a649768384c2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:36.037219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Deleting port f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:36.037219 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.067979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cbff912-01cf-45fd-abc0-78c50195d373 None None] Routers {'d036de14-6f7b-4786-987e-e736b2bff409'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:36.068258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9cbff912-01cf-45fd-abc0-78c50195d373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['d036de14-6f7b-4786-987e-e736b2bff409'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:36.088318 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69dcb586-7c8b-4ab1-9281-f78967d085a7 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.101043 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2a08a4a-cc3a-41d7-ad81-16258f03b7fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.156159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9cbff912-01cf-45fd-abc0-78c50195d373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:36.156159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9cbff912-01cf-45fd-abc0-78c50195d373 None None] The sync data for ids ['d036de14-6f7b-4786-987e-e736b2bff409'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:36.178480 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.186049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a9baaae8-7eea-4d4a-880a-87bf9a4cb727 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.202763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Transition to ACTIVE for port object 39bbd131-095c-40d3-9d8e-8ccf6999513c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:36.222129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] The port 'f6b0d072-4fb0-490d-a7c2-d6cd2ad99893' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:35:36.226414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2a08a4a-cc3a-41d7-ad81-16258f03b7fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Subnet': ['ID=f8eb29b5-ee06-488d-b4b5-2ba586595399,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:36.227554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4777b5ea-852f-4989-a7e6-a649768384c2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:36.227929 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.230581 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2a08a4a-cc3a-41d7-ad81-16258f03b7fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.264628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-902a78c8-4cc9-4015-a29c-87d6a209bb77 None None] Network 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:36.319646 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b2a08a4a-cc3a-41d7-ad81-16258f03b7fc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/f8eb29b5-ee06-488d-b4b5-2ba586595399 HTTP/1.1" status: 204 len: 168 time: 2.2919018 May 12 15:35:36.326168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57044) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:36.357337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Transition to ACTIVE for port object 39bbd131-095c-40d3-9d8e-8ccf6999513c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:36.364167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-a9baaae8-7eea-4d4a-880a-87bf9a4cb727 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 4a4cc602-815d-40ea-a951-5cb9cf3e3a4f yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:35:36.381716 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.514032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:36.528546 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69dcb586-7c8b-4ab1-9281-f78967d085a7 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.534451 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69dcb586-7c8b-4ab1-9281-f78967d085a7 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.556737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:36.563762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-1271ab2a-27de-4f8f-95f9-1a3f16c6df58 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting subnet af0eee84-aac4-44e7-8824-006c212bfed1 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:35:36.567643 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1271ab2a-27de-4f8f-95f9-1a3f16c6df58 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.580762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:36.623341 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69dcb586-7c8b-4ab1-9281-f78967d085a7 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.623904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-69dcb586-7c8b-4ab1-9281-f78967d085a7 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Fanout notify agent at l3_agent the message router_deleted on router d036de14-6f7b-4786-987e-e736b2bff409 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:35:36.636811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Pushing event updated for resources: {'Port': ['ID=39bbd131-095c-40d3-9d8e-8ccf6999513c,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:36.641977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69dcb586-7c8b-4ab1-9281-f78967d085a7 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.647002 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-69dcb586-7c8b-4ab1-9281-f78967d085a7 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "DELETE /v2.0/routers/d036de14-6f7b-4786-987e-e736b2bff409 HTTP/1.1" status: 204 len: 168 time: 0.8417633 May 12 15:35:36.647400 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1271ab2a-27de-4f8f-95f9-1a3f16c6df58 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.672099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57048) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:36.740462 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1271ab2a-27de-4f8f-95f9-1a3f16c6df58 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.765072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Attempting to bind port 39bbd131-095c-40d3-9d8e-8ccf6999513c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:35:36.765484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Attempting to bind port 39bbd131-095c-40d3-9d8e-8ccf6999513c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:35:36.765813 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Attempting to bind port 39bbd131-095c-40d3-9d8e-8ccf6999513c on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:35:36.801042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-678ea6f0-479f-42cc-a3c3-4f9ca58d610e tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "GET /v2.0/ports?device_id=d036de14-6f7b-4786-987e-e736b2bff409 HTTP/1.1" status: 200 len: 205 time: 0.1186528 May 12 15:35:36.801643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:36.803150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57052) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:36.809815 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.840491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 35, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:35:36.840777 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:35:36.841180 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.841597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:35:36.842078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Bound port: 39bbd131-095c-40d3-9d8e-8ccf6999513c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:35:36.842513 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.861591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dbecac63-cd00-4ee6-bec1-19abe557d6e1']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:36.865195 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:36.865561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6b0d072-4fb0-490d-a7c2-d6cd2ad99893 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:36.909577 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-a38fb651-afaa-49a7-a04b-126f9c4a74b2 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] delete failed (client error): The resource could not be found. May 12 15:35:36.910960 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a38fb651-afaa-49a7-a04b-126f9c4a74b2 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "DELETE /v2.0/routers/d036de14-6f7b-4786-987e-e736b2bff409 HTTP/1.1" status: 404 len: 336 time: 0.1066768 May 12 15:35:36.917646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57056) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:36.935793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b5ae907e-e55d-44ac-a507-2125bbfa6e8e None None] Provisioning complete for port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:36.936168 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b5ae907e-e55d-44ac-a507-2125bbfa6e8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:36.953018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '37f382a7-d0b1-492c-b3e7-035c86377975') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:36.953315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '37f382a7-d0b1-492c-b3e7-035c86377975') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:36.977110 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e981bf6f-b66c-4a66-ba0d-7c99ed60f14b tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "GET /v2.0/ports?device_id=b842700e-5e07-47e7-8454-463fccc547ff HTTP/1.1" status: 200 len: 205 time: 0.0557303 May 12 15:35:36.978752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57060) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:36.980675 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:37.025689 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] For port 39bbd131-095c-40d3-9d8e-8ccf6999513c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:35:37.030285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] For port 39bbd131-095c-40d3-9d8e-8ccf6999513c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=39bbd131-095c-40d3-9d8e-8ccf6999513c,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:35:37.034285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b5ae907e-e55d-44ac-a507-2125bbfa6e8e None None] Port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:35:37.038932 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:37.066581 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:37.072152 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1271ab2a-27de-4f8f-95f9-1a3f16c6df58 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:37.085282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Releasing vlan 598 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:35:37.085959 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: timer() May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:35:37.107188 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:35:37.111152 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-a9baaae8-7eea-4d4a-880a-87bf9a4cb727 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:35:37.111830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a9baaae8-7eea-4d4a-880a-87bf9a4cb727 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:35:37.118164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1271ab2a-27de-4f8f-95f9-1a3f16c6df58 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Subnet': ['ID=af0eee84-aac4-44e7-8824-006c212bfed1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:37.121665 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-e4f36988-02bb-4e10-af9e-4e7dd9ace659 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] delete failed (client error): The resource could not be found. May 12 15:35:37.122834 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e4f36988-02bb-4e10-af9e-4e7dd9ace659 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "DELETE /v2.0/routers/b842700e-5e07-47e7-8454-463fccc547ff HTTP/1.1" status: 404 len: 336 time: 0.1422577 May 12 15:35:37.126176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57064) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:37.129658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d782123e-c5b5-47b9-8d4d-8622df931018 None None] Pushing event updated for resources: {'Port': ['ID=39bbd131-095c-40d3-9d8e-8ccf6999513c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:37.186165 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7fcbc53e-e5ff-4fd8-8af9-1e6a5f5ecc3a tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "GET /v2.0/ports?device_id=a65a1a84-7edf-4d1b-916e-ea737831b2eb HTTP/1.1" status: 200 len: 205 time: 0.0564780 May 12 15:35:37.187052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57068) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:37.192143 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1271ab2a-27de-4f8f-95f9-1a3f16c6df58 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:37.272560 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a9baaae8-7eea-4d4a-880a-87bf9a4cb727 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 400 len: 350 time: 2.9419465 May 12 15:35:37.276005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57072) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:37.278709 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd684432-7488-4b62-b5cc-339e958d5dab tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:37.287122 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:37.294631 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1271ab2a-27de-4f8f-95f9-1a3f16c6df58 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/af0eee84-aac4-44e7-8824-006c212bfed1 HTTP/1.1" status: 204 len: 168 time: 0.9637399 May 12 15:35:37.296859 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-0d4de32c-1e1e-422b-b001-a334a1428451 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] delete failed (client error): The resource could not be found. May 12 15:35:37.297928 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0d4de32c-1e1e-422b-b001-a334a1428451 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "DELETE /v2.0/routers/a65a1a84-7edf-4d1b-916e-ea737831b2eb HTTP/1.1" status: 404 len: 336 time: 0.1100044 May 12 15:35:37.298449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57076) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:37.300844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57080) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:37.394549 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:37.424676 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:37.492626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd684432-7488-4b62-b5cc-339e958d5dab tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:37.502891 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:37.560929 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a863b12c-f5d5-42f0-bf9d-0a5b073f4177 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "GET /v2.0/ports?device_id=92474822-a7c9-4607-9a09-6f5b1f3ef399 HTTP/1.1" status: 200 len: 205 time: 0.2531061 May 12 15:35:37.561440 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57084) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:37.649793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] Pushing event deleted for resources: {'Network': ['ID=dbecac63-cd00-4ee6-bec1-19abe557d6e1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:37.878653 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:37.888066 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-ee5af354-3f00-4b50-8efa-30454a3c7636 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] delete failed (client error): The resource could not be found. May 12 15:35:37.892358 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ee5af354-3f00-4b50-8efa-30454a3c7636 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "DELETE /v2.0/routers/92474822-a7c9-4607-9a09-6f5b1f3ef399 HTTP/1.1" status: 404 len: 336 time: 0.2751596 May 12 15:35:37.896027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57088) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:37.917518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-68958672-678c-426a-99c2-1b30d6ba41ca admin admin] 10.222.0.82 "DELETE /v2.0/networks/dbecac63-cd00-4ee6-bec1-19abe557d6e1 HTTP/1.1" status: 204 len: 168 time: 4.5205023 May 12 15:35:37.958263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'Port': ['ID=63b42831-39a6-4a50-a6ab-4dce60dc93b6,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:37.962223 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-48072032-2658-434b-b78e-2691a1b4fe8d tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "GET /v2.0/ports?device_id=ed4d7b30-4f35-4196-8456-3dbb630ecf8a HTTP/1.1" status: 200 len: 205 time: 0.0628176 May 12 15:35:37.965858 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:37.973759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57094) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:37.980535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 47c27e64-f639-4bf0-abcc-1cee7f24246f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:37.980876 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:38.081788 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-25e3273c-4d6f-4155-9630-4fc2ef25074f tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] delete failed (client error): The resource could not be found. May 12 15:35:38.085575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-25e3273c-4d6f-4155-9630-4fc2ef25074f tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "DELETE /v2.0/routers/ed4d7b30-4f35-4196-8456-3dbb630ecf8a HTTP/1.1" status: 404 len: 336 time: 0.1096756 May 12 15:35:38.093992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57098) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:38.158666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 39bbd131-095c-40d3-9d8e-8ccf6999513c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:38.300164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f02cc0b0-2446-47fb-8153-977dfd6b6ef7 None None] Network 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:38.327415 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9bb76db5-b62f-4402-a4b8-89d1608ca735 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "GET /v2.0/ports?device_id=3a3e6f26-972f-411d-89b2-563cc3401c6b HTTP/1.1" status: 200 len: 205 time: 0.2325530 May 12 15:35:38.340279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57102) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:38.340674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57104) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:38.403508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ecb89ab4-fc45-47c5-9c4f-b396d8a3a42f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:38.404251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ecb89ab4-fc45-47c5-9c4f-b396d8a3a42f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:38.424436 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd684432-7488-4b62-b5cc-339e958d5dab tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:38.539814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2671caf7-02ec-452f-a60f-9d5d19c67881 None None] Provisioning complete for port 47c27e64-f639-4bf0-abcc-1cee7f24246f triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:38.540540 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2671caf7-02ec-452f-a60f-9d5d19c67881 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:38.544665 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8e79b3c9-4944-4ba5-a551-b77d0d03d1bc admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c5f9faeb50de42b1a07298c25a4e4d6b&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2002151 May 12 15:35:38.544665 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-d40f17df-500a-4443-8757-5aeebcbafb73 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] delete failed (client error): The resource could not be found. May 12 15:35:38.544999 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d40f17df-500a-4443-8757-5aeebcbafb73 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "DELETE /v2.0/routers/3a3e6f26-972f-411d-89b2-563cc3401c6b HTTP/1.1" status: 404 len: 336 time: 0.2015691 May 12 15:35:38.547378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57110) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:38.547378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57112) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:38.616221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 39bbd131-095c-40d3-9d8e-8ccf6999513c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:38.635148 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-aaecfee5-42d3-48db-a75b-08b570eec084 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] DELETE failed (client error): The resource could not be found. May 12 15:35:38.636898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-aaecfee5-42d3-48db-a75b-08b570eec084 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:35:38.638748 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aaecfee5-42d3-48db-a75b-08b570eec084 tempest-RoutersIpV6AdminTest-1578689886 tempest-RoutersIpV6AdminTest-1578689886-project] 10.222.0.82 "DELETE /v2.0/subnets/1fe8a692-ad0f-4592-a201-33f7bc1fdd53 HTTP/1.1" status: 404 len: 337 time: 0.0889843 May 12 15:35:38.640761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] For port 47c27e64-f639-4bf0-abcc-1cee7f24246f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=47c27e64-f639-4bf0-abcc-1cee7f24246f,segment=NetworkSegment(2f3a3d21-42be-470d-9a94-9d26ea4f7cb5),segment_id=2f3a3d21-42be-470d-9a94-9d26ea4f7cb5)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:38.641433 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:38.803900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for 47c27e64-f639-4bf0-abcc-1cee7f24246f owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:38.876805 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbc72e66-023a-4121-8eca-70c376bb3c11 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:38.929658 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbc72e66-023a-4121-8eca-70c376bb3c11 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:38.966837 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.029854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=47c27e64-f639-4bf0-abcc-1cee7f24246f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:39.033959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No DVR routers for this DVR port 47c27e64-f639-4bf0-abcc-1cee7f24246f on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:35:39.036167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ecb89ab4-fc45-47c5-9c4f-b396d8a3a42f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:39.039500 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ecb89ab4-fc45-47c5-9c4f-b396d8a3a42f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 943 time: 1.7564464 May 12 15:35:39.042830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57122) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:39.082256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8cb51d24-c0b2-43ca-8e5b-59bb4354904e None None] DHCP port deletion for 61c670fe-88e6-4119-b6d1-b7a7c081b3a4 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:35:39.109292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Network d2e823c6-8acb-45b9-910c-0a4822a68f25 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:39.117268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:39.117491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4a67517b-2c9b-4378-89c9-dfda6046e4af None None] Provisioning for port 39bbd131-095c-40d3-9d8e-8ccf6999513c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:39.132381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57126) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:39.135110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4a67517b-2c9b-4378-89c9-dfda6046e4af None None] Provisioning complete for port 39bbd131-095c-40d3-9d8e-8ccf6999513c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:39.136264 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4a67517b-2c9b-4378-89c9-dfda6046e4af None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.159834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbc72e66-023a-4121-8eca-70c376bb3c11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.232771 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.240696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbc72e66-023a-4121-8eca-70c376bb3c11 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1c68e3f-f95f-4174-93a8-3b036843193e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:39.250669 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fbc72e66-023a-4121-8eca-70c376bb3c11 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.254226 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fbc72e66-023a-4121-8eca-70c376bb3c11 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b1c68e3f-f95f-4174-93a8-3b036843193e HTTP/1.1" status: 204 len: 168 time: 0.7034869 May 12 15:35:39.270487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['61c670fe-88e6-4119-b6d1-b7a7c081b3a4']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:39.297656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2f3a3d21-42be-470d-9a94-9d26ea4f7cb5') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:39.297959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2f3a3d21-42be-470d-9a94-9d26ea4f7cb5') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:39.319333 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.350214 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4a67517b-2c9b-4378-89c9-dfda6046e4af None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.362358 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.374583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6807c82-6a57-44fe-8446-e771ba64131e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:39.376366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6807c82-6a57-44fe-8446-e771ba64131e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:39.377696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d6807c82-6a57-44fe-8446-e771ba64131e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:39.378113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Releasing vlan 588 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:35:39.378578 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.384376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd684432-7488-4b62-b5cc-339e958d5dab tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 397feb9b-2f46-4c79-af57-634897d5df53 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: timer() May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:35:39.403020 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:35:39.420556 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4a67517b-2c9b-4378-89c9-dfda6046e4af None None] For port 39bbd131-095c-40d3-9d8e-8ccf6999513c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=39bbd131-095c-40d3-9d8e-8ccf6999513c,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:39.425242 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4a67517b-2c9b-4378-89c9-dfda6046e4af None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.516927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a67517b-2c9b-4378-89c9-dfda6046e4af None None] Pushing event updated for resources: {'Port': ['ID=39bbd131-095c-40d3-9d8e-8ccf6999513c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:39.531374 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.554659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c4aee0f1-f770-4485-800f-e52919dfe304 None None] Provisioning complete for port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:39.555196 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4aee0f1-f770-4485-800f-e52919dfe304 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.559935 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.566969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Network': ['ID=61c670fe-88e6-4119-b6d1-b7a7c081b3a4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:39.576547 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-276592f4-906b-442c-baa6-e98c28716c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/networks/61c670fe-88e6-4119-b6d1-b7a7c081b3a4 HTTP/1.1" status: 204 len: 168 time: 2.2769513 May 12 15:35:39.577252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57136) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:39.648745 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e2ea5791-7c01-4689-a950-bf5ec07b8684 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.654206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c4aee0f1-f770-4485-800f-e52919dfe304 None None] Port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:35:39.661500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d6807c82-6a57-44fe-8446-e771ba64131e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:39.665247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d6807c82-6a57-44fe-8446-e771ba64131e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.6162987 May 12 15:35:39.665471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d05e0759-c9f7-4f95-9de1-3e177c018e55 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:39.665931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d05e0759-c9f7-4f95-9de1-3e177c018e55 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:39.668745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57140) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:39.703714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e2ea5791-7c01-4689-a950-bf5ec07b8684 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:39.717099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e2ea5791-7c01-4689-a950-bf5ec07b8684 admin admin] Usage tracker for resource:security_group_rule and tenant:b68c8c6134e345c4b780c4a4abc4688f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:39.723097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e2ea5791-7c01-4689-a950-bf5ec07b8684 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:39.732483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd684432-7488-4b62-b5cc-339e958d5dab tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:39.735439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e2ea5791-7c01-4689-a950-bf5ec07b8684 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:39.743661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d05e0759-c9f7-4f95-9de1-3e177c018e55 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:39.745089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bd684432-7488-4b62-b5cc-339e958d5dab tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 9.0515125 May 12 15:35:39.749936 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62ce2a32-fca0-494c-a878-6b4ff769062c None None] Sync routers for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:39.750696 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d05e0759-c9f7-4f95-9de1-3e177c018e55 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 0.1720781 May 12 15:35:39.751309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57148) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:39.751985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57150) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:39.764588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-cc8bb161-babe-4cf2-a931-5d5e96988bf9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 7296312a-865f-4b1e-907b-661eff5bf990 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:35:39.767905 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62ce2a32-fca0-494c-a878-6b4ff769062c None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:39.768606 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-62ce2a32-fca0-494c-a878-6b4ff769062c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:39.769080 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc8bb161-babe-4cf2-a931-5d5e96988bf9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.797339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:35:39.858212 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc8bb161-babe-4cf2-a931-5d5e96988bf9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:39.969847 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-62ce2a32-fca0-494c-a878-6b4ff769062c None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:40.066730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 39bbd131-095c-40d3-9d8e-8ccf6999513c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:40.162442 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc8bb161-babe-4cf2-a931-5d5e96988bf9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:40.233040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 39bbd131-095c-40d3-9d8e-8ccf6999513c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:40.233650 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:40.267815 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc8bb161-babe-4cf2-a931-5d5e96988bf9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:40.286076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-acd1c1ee-64ee-4aa9-8c2a-adfa552aef71 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting subnet 806356d2-2805-4b3e-b8c9-31e26512edbe {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:35:40.310385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:40.327026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc8bb161-babe-4cf2-a931-5d5e96988bf9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=7296312a-865f-4b1e-907b-661eff5bf990,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:40.328445 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acd1c1ee-64ee-4aa9-8c2a-adfa552aef71 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:40.330309 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Sync routers for ids ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:40.333884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc8bb161-babe-4cf2-a931-5d5e96988bf9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:40.366665 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cc8bb161-babe-4cf2-a931-5d5e96988bf9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/7296312a-865f-4b1e-907b-661eff5bf990 HTTP/1.1" status: 204 len: 168 time: 0.6862125 May 12 15:35:40.368190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57172) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:40.381507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ee0d628-a4ec-4858-b7c3-1c8d24b64e52 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:40.453098 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9904556b-edb3-4b98-a01c-77d19bad7a2c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.6890881 May 12 15:35:40.453098 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-75417ef1-0a18-4b42-a276-9a4c63cbbfe9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "PUT /v2.0/routers/6c52b572-4880-47dd-bc9e-8f2160f5c2e4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.9182742 May 12 15:35:40.455934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57176) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:40.456092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57178) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:40.462482 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acd1c1ee-64ee-4aa9-8c2a-adfa552aef71 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:40.503863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Routers {'6c52b572-4880-47dd-bc9e-8f2160f5c2e4'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:40.503863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:40.504894 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-61d8a9a0-c41a-4658-8944-1b1a66f55b19 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1350994 May 12 15:35:40.506279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57186) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:40.516391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ce23dd4b-0923-4a3f-9fe1-e539e9267aec tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:40.517353 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-62ce2a32-fca0-494c-a878-6b4ff769062c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:36Z', 'revision_number': 10, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:40.521345 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62ce2a32-fca0-494c-a878-6b4ff769062c None None] Checking router: 397feb9b-2f46-4c79-af57-634897d5df53 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:35:40.536224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-332203934'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:40.540441 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62ce2a32-fca0-494c-a878-6b4ff769062c None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:40.541049 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-62ce2a32-fca0-494c-a878-6b4ff769062c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:40.560992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Request body: {'security_group': {'name': 'tempest-secgroup_access--86361257', 'description': 'tempest-secgroup_access--86361257 description', 'project_id': '3dd1fe8ad774471ba7745219a37ead53'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:40.592915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:40.595666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:40.602459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:network and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:40.617984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:40.625415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Usage tracker for resource:security_group and tenant:3dd1fe8ad774471ba7745219a37ead53 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:40.642220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:40.648852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:40.659270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:40.682901 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e2ea5791-7c01-4689-a950-bf5ec07b8684 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:40.698674 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e2ea5791-7c01-4689-a950-bf5ec07b8684 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:40.715614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ce23dd4b-0923-4a3f-9fe1-e539e9267aec tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:40.721329 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:40.722032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ce23dd4b-0923-4a3f-9fe1-e539e9267aec tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:40.725446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ce23dd4b-0923-4a3f-9fe1-e539e9267aec tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:40.730572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:40.733934 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:40.734816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ce23dd4b-0923-4a3f-9fe1-e539e9267aec tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:40.747989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ce23dd4b-0923-4a3f-9fe1-e539e9267aec tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:40.753451 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce23dd4b-0923-4a3f-9fe1-e539e9267aec tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:40.805642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e2ea5791-7c01-4689-a950-bf5ec07b8684 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b68c8c6134e345c4b780c4a4abc4688f&name=default HTTP/1.1" status: 200 len: 2983 time: 1.6700978 May 12 15:35:40.808384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:40.811808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2ea5791-7c01-4689-a950-bf5ec07b8684 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bc295000-146a-4f99-9945-7ad6930782d0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:40.817170 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acd1c1ee-64ee-4aa9-8c2a-adfa552aef71 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:40.825616 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-62ce2a32-fca0-494c-a878-6b4ff769062c None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:40.846355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57194) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:40.864541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 599} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:35:40.868250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Usage tracker for resource:security_group_rule and tenant:3dd1fe8ad774471ba7745219a37ead53 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:40.872032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:40.878621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:41.019251 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.019639 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Added segment 5723a35b-442b-4ca0-9923-4423d1ff636d of type vlan for network b00b93ef-24cf-488b-80ad-16ea8a5cd226 May 12 15:35:41.099779 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acd1c1ee-64ee-4aa9-8c2a-adfa552aef71 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.131072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Set router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:41.223496 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-62ce2a32-fca0-494c-a878-6b4ff769062c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:36Z', 'revision_number': 10, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:41.239667 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62ce2a32-fca0-494c-a878-6b4ff769062c None None] The sync data for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 is: [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:36Z', 'revision_number': 10, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None, '_interfaces': [{'id': '772d4b76-1bbf-41b5-a846-f4fb5eaef3c1', 'name': '', 'network_id': '8a5a9f45-ac98-4364-8fcd-e150e523be55', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'mac_address': 'fa:16:3e:4a:ae:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '397feb9b-2f46-4c79-af57-634897d5df53', 'device_owner': 'network:router_interface', 'standard_attr_id': 2619, 'fixed_ips': [{'subnet_id': '88b72322-9e80-4b80-a94e-362cee47e638', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:34:00Z', 'updated_at': '2022-05-12T15:34:15Z', 'revision_number': 5, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'subnets': [{'id': '88b72322-9e80-4b80-a94e-362cee47e638', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:41.332882 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce23dd4b-0923-4a3f-9fe1-e539e9267aec tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.374381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 47c27e64-f639-4bf0-abcc-1cee7f24246f no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:41.427923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 47c27e64-f639-4bf0-abcc-1cee7f24246f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:41.428893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 47c27e64-f639-4bf0-abcc-1cee7f24246f not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:41.552673 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.559585 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acd1c1ee-64ee-4aa9-8c2a-adfa552aef71 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Subnet': ['ID=806356d2-2805-4b3e-b8c9-31e26512edbe,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:41.567748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce23dd4b-0923-4a3f-9fe1-e539e9267aec tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=88285689-afad-483b-ba60-963106bdc4f2,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:41.600763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce23dd4b-0923-4a3f-9fe1-e539e9267aec tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:41.600946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ce23dd4b-0923-4a3f-9fe1-e539e9267aec tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:41.615257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce23dd4b-0923-4a3f-9fe1-e539e9267aec tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:41.615852 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce23dd4b-0923-4a3f-9fe1-e539e9267aec tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.642991 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acd1c1ee-64ee-4aa9-8c2a-adfa552aef71 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.672412 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1eec007d-2988-4e63-83cc-05b9bcda0b08 None None] Network 3c31163d-b39c-4c17-b3f6-91c5029a0605 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:41.678330 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-60d0b37d-fe6a-4593-9263-acfb0a3e6a0e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.691141 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ce23dd4b-0923-4a3f-9fe1-e539e9267aec tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.1811895 May 12 15:35:41.691562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:35:41.691661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57214) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:41.701320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7bbc98ca-37ce-42a7-9bf1-bd7391144e10 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-235047685', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:41.722502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7bbc98ca-37ce-42a7-9bf1-bd7391144e10 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:41.723861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.732793 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7bbc98ca-37ce-42a7-9bf1-bd7391144e10 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:router and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:41.741638 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.750092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7bbc98ca-37ce-42a7-9bf1-bd7391144e10 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:41.783095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Deleting port 39bbd131-095c-40d3-9d8e-8ccf6999513c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:41.783580 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.789136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7bbc98ca-37ce-42a7-9bf1-bd7391144e10 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:41.790723 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-acd1c1ee-64ee-4aa9-8c2a-adfa552aef71 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/806356d2-2805-4b3e-b8c9-31e26512edbe HTTP/1.1" status: 204 len: 168 time: 2.0354521 May 12 15:35:41.801214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57220) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:41.807708 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7bbc98ca-37ce-42a7-9bf1-bd7391144e10 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.809409 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7bbc98ca-37ce-42a7-9bf1-bd7391144e10 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.844617 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7bbc98ca-37ce-42a7-9bf1-bd7391144e10 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.890790 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7bbc98ca-37ce-42a7-9bf1-bd7391144e10 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.922196 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7bbc98ca-37ce-42a7-9bf1-bd7391144e10 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:41.925421 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7bbc98ca-37ce-42a7-9bf1-bd7391144e10 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.2315493 May 12 15:35:41.935440 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57226) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:42.045440 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 39bbd131-095c-40d3-9d8e-8ccf6999513c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:42.105359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:42.133095 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:42.140460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:42.141522 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:42.150267 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-60d0b37d-fe6a-4593-9263-acfb0a3e6a0e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:42.175218 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:42.179290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57232) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:42.179633 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a551f17b-cfa9-4380-b0ab-37f355eaedd8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 1.7205563 May 12 15:35:42.196631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Request body: {'security_group': {'name': 'tempest-secgroup_general--685168533', 'description': 'tempest-secgroup_general--685168533 description', 'project_id': '3dd1fe8ad774471ba7745219a37ead53'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:42.272480 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:42.300058 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 1.8428359 May 12 15:35:42.313184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57236) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:42.328215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': 'b00b93ef-24cf-488b-80ad-16ea8a5cd226', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:42.382357 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] For port 39bbd131-095c-40d3-9d8e-8ccf6999513c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=39bbd131-095c-40d3-9d8e-8ccf6999513c,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:42.383095 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:42.402631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:42.464002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86c67afc-da1c-43dd-ba2c-a3fd856f29c4 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Network': ['ID=b00b93ef-24cf-488b-80ad-16ea8a5cd226,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:42.480587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:42.482779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port a423d38d-f634-4050-a893-fc674418d503 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:42.483123 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:42.574000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:42.583225 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-60d0b37d-fe6a-4593-9263-acfb0a3e6a0e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:42.587518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:42.605185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Usage tracker for resource:security_group and tenant:3dd1fe8ad774471ba7745219a37ead53 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:42.607853 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60d0b37d-fe6a-4593-9263-acfb0a3e6a0e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc295000-146a-4f99-9945-7ad6930782d0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:42.609324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:42.614353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:42.632188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:42.635717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Calling delete_port for 39bbd131-095c-40d3-9d8e-8ccf6999513c owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:42.688018 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:42.708559 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:42.797943 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:42.801609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network b00b93ef-24cf-488b-80ad-16ea8a5cd226 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:35:42.840994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:42.847404 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:42.878080 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-60d0b37d-fe6a-4593-9263-acfb0a3e6a0e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:42.879556 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-60d0b37d-fe6a-4593-9263-acfb0a3e6a0e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bc295000-146a-4f99-9945-7ad6930782d0 HTTP/1.1" status: 204 len: 168 time: 2.0325632 May 12 15:35:42.887574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:42.933173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Usage tracker for resource:security_group_rule and tenant:3dd1fe8ad774471ba7745219a37ead53 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:42.944328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:43.036071 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] For port a423d38d-f634-4050-a893-fc674418d503, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a423d38d-f634-4050-a893-fc674418d503,segment=NetworkSegment(9eb20257-af83-41dc-b1ae-d8bb904b94c9),segment_id=9eb20257-af83-41dc-b1ae-d8bb904b94c9)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:43.036355 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:43.057904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Pushing event deleted for resources: {'Port': ['ID=39bbd131-095c-40d3-9d8e-8ccf6999513c,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:43.101366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:43.102960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:43.103454 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:43.105053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:43.105583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:43.108008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:43.108507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:43.108984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:43.111253 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:43.111775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:43.112604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:43.113718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:43.149550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No active binding found for port 39bbd131-095c-40d3-9d8e-8ccf6999513c {{(pid=88153) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:224}} May 12 15:35:43.150305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 39bbd131-095c-40d3-9d8e-8ccf6999513c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:43.151860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:43.200895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a555b7c-ad31-42c3-ba3e-ff1d246d5dfc None None] No DVR routers for this DVR port 39bbd131-095c-40d3-9d8e-8ccf6999513c on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:35:43.226284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:43.227580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 16dd7bcd-e052-4ad3-ae9a-4ddfc9b62512 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:43.246659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for a423d38d-f634-4050-a893-fc674418d503 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:43.263735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-893d2704-5ce9-401a-aec8-5f468861a6a9 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:43.271124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:43.350328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:35:34Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '63b42831-39a6-4a50-a6ab-4dce60dc93b6', 'name': '', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'mac_address': 'fa:16:3e:c5:e0:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 2707, 'fixed_ips': [{'subnet_id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:31Z', 'updated_at': '2022-05-12T15:35:36Z', 'revision_number': 2, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'subnets': [{'id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:43.481620 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:43.482848 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c69d5f78-c09a-45c3-9f5e-01a8d2c33277 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:43.488939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Checking router: 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:35:43.489513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Updating router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:35:43.584119 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:43.622390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fd449db-e54a-4d5b-b45a-6cd611cff17d None None] DHCP port deletion for 3c31163d-b39c-4c17-b3f6-91c5029a0605 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:35:43.632278 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:43.678162 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:43.683773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57260) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:43.720497 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:43.783862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=a423d38d-f634-4050-a893-fc674418d503,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:43.800312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No DVR routers for this DVR port a423d38d-f634-4050-a893-fc674418d503 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:35:43.819058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::1 (2447b094-d5d6-41ef-a146-2bf56f5399af/88285689-afad-483b-ba60-963106bdc4f2/cf8dff7a-3dc7-4917-98ee-0a5f1b809e81) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:43.838884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'SecurityGroup': ['ID=62da627b-8675-47b7-a69e-55dbeab2bd90,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:43.855523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:43.860034 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c63588ba-c020-42f7-98c8-14a56a27f382 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1800 time: 1.6787364 May 12 15:35:43.863244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57268) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:43.875270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b4295f8d-a81c-41d5-a555-47a3afbbfc66 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Request body: {'security_group_rule': {'security_group_id': '9358f0f8-f7c3-47a6-a1a3-bfbe9808172b', 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:43.886211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b4295f8d-a81c-41d5-a555-47a3afbbfc66 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:43.891012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b4295f8d-a81c-41d5-a555-47a3afbbfc66 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Usage tracker for resource:security_group_rule and tenant:3dd1fe8ad774471ba7745219a37ead53 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:43.894803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b4295f8d-a81c-41d5-a555-47a3afbbfc66 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:43.916183 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c61517d4-e3ae-4d50-a90f-1ada937ad095 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=281d0c58fa114694a3293de8c107204f&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2303927 May 12 15:35:43.922732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57272) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:43.925584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b4295f8d-a81c-41d5-a555-47a3afbbfc66 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:43.977005 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:43.996925 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '88285689-afad-483b-ba60-963106bdc4f2'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:35:43.997906 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.027586 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a423d38d-f634-4050-a893-fc674418d503 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:44.073866 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: a423d38d-f634-4050-a893-fc674418d503 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:44.074203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a423d38d-f634-4050-a893-fc674418d503 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:44.209828 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.241677 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.284512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object cf8dff7a-3dc7-4917-98ee-0a5f1b809e81 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:44.294231 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58a95bf0-8f5b-40a0-8527-2fab6ed496a0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.301138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3c31163d-b39c-4c17-b3f6-91c5029a0605']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:44.304590 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4295f8d-a81c-41d5-a555-47a3afbbfc66 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.339031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9eb20257-af83-41dc-b1ae-d8bb904b94c9') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:44.339723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9eb20257-af83-41dc-b1ae-d8bb904b94c9') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:44.357167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Checking segment: {'id': '5723a35b-442b-4ca0-9923-4423d1ff636d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'b00b93ef-24cf-488b-80ad-16ea8a5cd226'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:35:44.357889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network hostable DHCP agents. Network: b00b93ef-24cf-488b-80ad-16ea8a5cd226, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:35:44.367792 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.377436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Subnet': ['ID=82849bea-971a-4272-8f77-327862d7f6e7,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:44.403512 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.425329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network b00b93ef-24cf-488b-80ad-16ea8a5cd226 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:35:44.439154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Releasing vlan 579 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:35:44.439895 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: timer() May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:35:44.462286 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:35:44.467746 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4295f8d-a81c-41d5-a555-47a3afbbfc66 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.474027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, b00b93ef-24cf-488b-80ad-16ea8a5cd226) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:44.475673 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4295f8d-a81c-41d5-a555-47a3afbbfc66 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.479814 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58a95bf0-8f5b-40a0-8527-2fab6ed496a0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.495808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:44.498047 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.498221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00a175d2-48f9-4009-859a-a6574860f716 None None] Network b00b93ef-24cf-488b-80ad-16ea8a5cd226 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:44.525369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4295f8d-a81c-41d5-a555-47a3afbbfc66 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9e6acc04-8b37-4f26-84cf-26ab22b31c1f,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:44.536242 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4295f8d-a81c-41d5-a555-47a3afbbfc66 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.546456 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b4295f8d-a81c-41d5-a555-47a3afbbfc66 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6687458 May 12 15:35:44.569733 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.593438 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.693917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:44.697761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:44.703518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:44.704054 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.753743 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e7eba45a-594e-454d-85a8-8f0e65a2e4f5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.4341607 May 12 15:35:44.754997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57280) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:44.781803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Allocated IP 2001:db8::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/88285689-afad-483b-ba60-963106bdc4f2/825a3e42-ece9-486f-8f9e-4ea65b743747) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:44.782032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'network_id': 'b00b93ef-24cf-488b-80ad-16ea8a5cd226', 'name': 'tempest-PortsTestJSON-1773622749'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:44.871885 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.915276 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.946700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Network': ['ID=3c31163d-b39c-4c17-b3f6-91c5029a0605,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:44.983461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=cf8dff7a-3dc7-4917-98ee-0a5f1b809e81,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:44.985848 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58a95bf0-8f5b-40a0-8527-2fab6ed496a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:44.987381 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-44bf0b18-cea2-499f-9f56-053c68a30f38 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/networks/3c31163d-b39c-4c17-b3f6-91c5029a0605 HTTP/1.1" status: 204 len: 168 time: 3.1615567 May 12 15:35:44.988314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57298) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:45.019893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58a95bf0-8f5b-40a0-8527-2fab6ed496a0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=090c2a90-39df-4bad-bc4e-7ad2a286fd62,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:45.039482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58a95bf0-8f5b-40a0-8527-2fab6ed496a0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:45.040848 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-58a95bf0-8f5b-40a0-8527-2fab6ed496a0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/090c2a90-39df-4bad-bc4e-7ad2a286fd62 HTTP/1.1" status: 204 len: 168 time: 1.1171656 May 12 15:35:45.091285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Transition to ACTIVE for port object 63b42831-39a6-4a50-a6ab-4dce60dc93b6 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:45.192982 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:45.210839 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:45.267741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-45bfee5e-4e5f-4baf-8c41-65ed67c97664 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Synchronizing usage tracker for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:45.320309 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:45.370226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:45.377212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-45bfee5e-4e5f-4baf-8c41-65ed67c97664 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Unset dirty status for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:45.378730 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-45bfee5e-4e5f-4baf-8c41-65ed67c97664 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup_access--86361257&fields=id&tenant_id=3dd1fe8ad774471ba7745219a37ead53 HTTP/1.1" status: 200 len: 267 time: 0.4714339 May 12 15:35:45.396273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:45.486361 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Transition to ACTIVE for port object 825a3e42-ece9-486f-8f9e-4ea65b743747 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:45.529859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Transition to ACTIVE for port object 825a3e42-ece9-486f-8f9e-4ea65b743747 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:45.551307 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-916cb8c2-f3cd-4101-9f57-306e3f5c66c2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:45.573862 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:45.590010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-b00b93ef-24cf-488b-80ad-16ea8a5cd226', 'network_id': 'b00b93ef-24cf-488b-80ad-16ea8a5cd226', 'tenant_id': '9bd6beec65cd47b3a0febdc05aaed724', 'fixed_ips': [{'subnet_id': '82849bea-971a-4272-8f77-327862d7f6e7'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:35:45.591368 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:45.679957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed35f052-c151-4262-a499-c12c7d0ce1e6 None None] Pushing event updated for resources: {'Port': ['ID=63b42831-39a6-4a50-a6ab-4dce60dc93b6,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:45.725755 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-bd974ade-d7ba-4af3-823a-d576f70c7cad tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup_general--685168533&fields=id&tenant_id=3dd1fe8ad774471ba7745219a37ead53 HTTP/1.1" status: 200 len: 267 time: 0.3330069 May 12 15:35:45.725870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:45.735664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:45.739116 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:45.814547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:45.830487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:45.969201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port 442670c2-6aa6-45ec-9804-8e1a8d084879 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:35:45.996786 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:46.017738 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:46.019835 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:46.060353 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Attempting to bind port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:35:46.060710 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Attempting to bind port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '4dc52732-5577-45b0-b2eb-1c2616cc1c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:35:46.061128 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Attempting to bind port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 on network d2e823c6-8acb-45b9-910c-0a4822a68f25 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:35:46.082086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Pushing event updated for resources: {'Port': ['ID=825a3e42-ece9-486f-8f9e-4ea65b743747,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:46.106405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 35, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:35:46.107142 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Checking segment: {'id': '4dc52732-5577-45b0-b2eb-1c2616cc1c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:35:46.107142 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:46.107540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Bound using segment: {'id': '4dc52732-5577-45b0-b2eb-1c2616cc1c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:35:46.108029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Bound port: 63b42831-39a6-4a50-a6ab-4dce60dc93b6, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4dc52732-5577-45b0-b2eb-1c2616cc1c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:35:46.108394 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:46.164752 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:46.181063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Attempting to bind port 825a3e42-ece9-486f-8f9e-4ea65b743747 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:35:46.182284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Attempting to bind port 825a3e42-ece9-486f-8f9e-4ea65b743747 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:35:46.183405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Attempting to bind port 825a3e42-ece9-486f-8f9e-4ea65b743747 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:35:46.330341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=cf8dff7a-3dc7-4917-98ee-0a5f1b809e81,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:46.330877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 35, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:35:46.331299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:35:46.331702 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:46.332126 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:35:46.332650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Bound port: 825a3e42-ece9-486f-8f9e-4ea65b743747, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:35:46.333066 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:46.362202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-e6d2309c-fb5f-438d-9e77-e44c15f5c830 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:46.378534 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-e6d2309c-fb5f-438d-9e77-e44c15f5c830 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/networks?id=d2e823c6-8acb-45b9-910c-0a4822a68f25 HTTP/1.1" status: 200 len: 796 time: 0.6540930 May 12 15:35:46.440449 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-7f8e3f98-6fde-4c74-b907-d560ac9dfa91 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/quotas/3dd1fe8ad774471ba7745219a37ead53 HTTP/1.1" status: 200 len: 375 time: 0.0607479 May 12 15:35:46.501683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] For port 825a3e42-ece9-486f-8f9e-4ea65b743747, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:35:46.506453 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] For port 825a3e42-ece9-486f-8f9e-4ea65b743747, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=825a3e42-ece9-486f-8f9e-4ea65b743747,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:35:46.529969 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:46.543937 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:46.614626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5883ae47-37e8-476e-8c3c-2d76155681c0 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Synchronizing usage tracker for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:46.633138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57334) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:46.649909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5883ae47-37e8-476e-8c3c-2d76155681c0 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Unset dirty status for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:46.668942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5883ae47-37e8-476e-8c3c-2d76155681c0 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=3dd1fe8ad774471ba7745219a37ead53&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2275398 May 12 15:35:46.683116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-0ed2961d-6d27-4ec3-99d6-f6d2efe753f4 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:35:46.689618 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-0ed2961d-6d27-4ec3-99d6-f6d2efe753f4 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0141573 May 12 15:35:46.737212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Allocated IP 172.20.0.2 (b00b93ef-24cf-488b-80ad-16ea8a5cd226/82849bea-971a-4272-8f77-327862d7f6e7/89b265da-de0b-4bda-a79e-78aaa9aee5a8) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:46.759823 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] For port 63b42831-39a6-4a50-a6ab-4dce60dc93b6, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:35:46.767633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] For port 63b42831-39a6-4a50-a6ab-4dce60dc93b6, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=63b42831-39a6-4a50-a6ab-4dce60dc93b6,segment=NetworkSegment(4dc52732-5577-45b0-b2eb-1c2616cc1c73),segment_id=4dc52732-5577-45b0-b2eb-1c2616cc1c73)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:35:46.784058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:46.787962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:46.794248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57340) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:46.798495 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:46.806107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2774f600-ce94-4483-beb3-aba1ba36810f None None] Pushing event updated for resources: {'Port': ['ID=825a3e42-ece9-486f-8f9e-4ea65b743747,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:46.907078 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c22a25b-34f5-4654-98ff-f4bae8fe6eee tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:47.148545 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b4b5b89-3315-4fcc-bce3-a4179a06132d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:47.178764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3b4b5b89-3315-4fcc-bce3-a4179a06132d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:47.191669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3b4b5b89-3315-4fcc-bce3-a4179a06132d admin admin] Usage tracker for resource:security_group_rule and tenant:1a391ad5e91744899cc2691882f35232 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:47.197343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3b4b5b89-3315-4fcc-bce3-a4179a06132d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:47.211573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3b4b5b89-3315-4fcc-bce3-a4179a06132d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:47.228899 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed35f052-c151-4262-a499-c12c7d0ce1e6 None None] Pushing event updated for resources: {'Port': ['ID=63b42831-39a6-4a50-a6ab-4dce60dc93b6,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:47.291792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Router 2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:35:47.300868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Routers {'6c52b572-4880-47dd-bc9e-8f2160f5c2e4'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:47.301653 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:47.579662 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] Set router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:47.603233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:47.621750 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Sync routers for ids ['2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:47.639969 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Routers {'2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:47.641873 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:47.649178 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Request body: {'networks': [{'name': 'tempest-network--1227400393'}, {'name': 'tempest-network--526658196'}]} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:47.649700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Request body: {'network': {'name': 'tempest-network--1227400393'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:47.649965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Request body: {'network': {'name': 'tempest-network--526658196'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:47.655633 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-06a80f55-9115-4422-814e-6122b359802f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "PUT /v2.0/routers/2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7186892 May 12 15:35:47.658636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57348) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:47.721379 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b4b5b89-3315-4fcc-bce3-a4179a06132d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:47.723337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:47.742481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Usage tracker for resource:network and tenant:09e0c5fd5fce41bf91599658e3eed992 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:47.754947 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b4b5b89-3315-4fcc-bce3-a4179a06132d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:47.756185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:47.779033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attempting to reserve 2 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:47.794090 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-f68c1bd6-6c92-41e2-bf55-801962fb40f7 service neutron] 10.222.0.82 "GET /v2.0/networks/d2e823c6-8acb-45b9-910c-0a4822a68f25?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0964460 May 12 15:35:47.850419 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3b4b5b89-3315-4fcc-bce3-a4179a06132d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1a391ad5e91744899cc2691882f35232&name=default HTTP/1.1" status: 200 len: 2983 time: 1.0546184 May 12 15:35:47.857492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57352) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:47.867387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a79bcd9d-def1-4185-b5cd-a5ac77b39ccc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:47.867387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a79bcd9d-def1-4185-b5cd-a5ac77b39ccc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:47.876644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b4b5b89-3315-4fcc-bce3-a4179a06132d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e2467e2-4230-45ef-959f-a3ec216fccf6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:47.929590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a79bcd9d-def1-4185-b5cd-a5ac77b39ccc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:47.934618 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a79bcd9d-def1-4185-b5cd-a5ac77b39ccc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports/cf8dff7a-3dc7-4917-98ee-0a5f1b809e81 HTTP/1.1" status: 200 len: 911 time: 0.2712839 May 12 15:35:47.937209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57356) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:47.960846 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Set router 2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:48.100786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 825a3e42-ece9-486f-8f9e-4ea65b743747 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:48.128091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82da2802-1b46-4904-9de3-9902cc6e0865 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:48.138772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82da2802-1b46-4904-9de3-9902cc6e0865 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:48.140840 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-82da2802-1b46-4904-9de3-9902cc6e0865 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1653 time: 0.2019086 May 12 15:35:48.143840 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57360) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:48.146515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Made reservation on behalf of 09e0c5fd5fce41bf91599658e3eed992 for: {'network': 2} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:48.152267 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:48.178516 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:48.193838 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ee0bdc69-2f66-4471-bfcc-3a77be11b257 service neutron] 10.222.0.82 "GET /v2.0/networks/d2e823c6-8acb-45b9-910c-0a4822a68f25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3988545 May 12 15:35:48.211021 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:48.256215 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9c040e8-ebc5-4546-a8a1-75876b08ee97 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:48.258168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:48.275031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Usage tracker for resource:security_group_rule and tenant:09e0c5fd5fce41bf91599658e3eed992 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:48.288034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:48.347370 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:48.371357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3c22a25b-34f5-4654-98ff-f4bae8fe6eee tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:48.371651 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c22a25b-34f5-4654-98ff-f4bae8fe6eee tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:48.374836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Transition to ACTIVE for port object 89b265da-de0b-4bda-a79e-78aaa9aee5a8 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:48.423989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Transition to ACTIVE for port object 89b265da-de0b-4bda-a79e-78aaa9aee5a8 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:48.426241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:48.439488 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:48.477235 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33', 'name': 'tempest-NetworksTestDHCPv6-router-235047685', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:41Z', 'updated_at': '2022-05-12T15:35:45Z', 'revision_number': 2, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'gw_port_host': None, '_interfaces': [{'id': 'cf8dff7a-3dc7-4917-98ee-0a5f1b809e81', 'name': '', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'mac_address': 'fa:16:3e:f1:f8:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33', 'device_owner': 'network:router_interface', 'standard_attr_id': 2724, 'fixed_ips': [{'subnet_id': '88285689-afad-483b-ba60-963106bdc4f2', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:43Z', 'updated_at': '2022-05-12T15:35:45Z', 'revision_number': 2, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'subnets': [{'id': '88285689-afad-483b-ba60-963106bdc4f2', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:48.486557 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Checking router: 2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:35:48.487084 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Updating router 2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33 port cf8dff7a-3dc7-4917-98ee-0a5f1b809e81 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:35:48.605105 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:48.707030 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9c040e8-ebc5-4546-a8a1-75876b08ee97 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:48.729561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Network b00b93ef-24cf-488b-80ad-16ea8a5cd226 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:48.740274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:48.759999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e8a2f7c6-d3da-4350-8f69-44275c3a6ac0 None None] Provisioning for port 825a3e42-ece9-486f-8f9e-4ea65b743747 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:48.788039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:48.806467 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:48.827346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e8a2f7c6-d3da-4350-8f69-44275c3a6ac0 None None] Provisioning complete for port 825a3e42-ece9-486f-8f9e-4ea65b743747 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:48.830820 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e8a2f7c6-d3da-4350-8f69-44275c3a6ac0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:48.884550 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:48.885261 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:48.899196 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9c040e8-ebc5-4546-a8a1-75876b08ee97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:48.909780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Allocated IP 172.20.0.5 (b00b93ef-24cf-488b-80ad-16ea8a5cd226/82849bea-971a-4272-8f77-327862d7f6e7/442670c2-6aa6-45ec-9804-8e1a8d084879) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:48.946576 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2da5349a-daea-4227-86b7-8c775b4455ee req-820ebbed-e35b-4ff9-a65d-e7cb5eeeb774 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 210 time: 0.1384311 May 12 15:35:48.963715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 825a3e42-ece9-486f-8f9e-4ea65b743747 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:48.973108 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Pushing event updated for resources: {'Port': ['ID=89b265da-de0b-4bda-a79e-78aaa9aee5a8,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:49.032258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 557} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:35:49.046317 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.046317 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Added segment ab2369d3-ded3-4f2d-925d-09bea5790ef1 of type vlan for network 93d0e6ea-13be-4ca2-8346-1cab7cd93f00 May 12 15:35:49.047547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 825a3e42-ece9-486f-8f9e-4ea65b743747 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:49.048040 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.080993 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.119443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 592} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:35:49.130557 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.130956 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Added segment 5957ea93-0f6f-43c6-b299-0ea48bc119bb of type vlan for network fee11cfd-7c64-4167-8434-a78d72ae4ebb May 12 15:35:49.161417 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.212644 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fa0d3ff-a1d4-4cdc-8b9f-a22932c60b58 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.222627 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.224135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Attempting to bind port 89b265da-de0b-4bda-a79e-78aaa9aee5a8 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:35:49.224611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Attempting to bind port 89b265da-de0b-4bda-a79e-78aaa9aee5a8 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '5723a35b-442b-4ca0-9923-4423d1ff636d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'b00b93ef-24cf-488b-80ad-16ea8a5cd226'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:35:49.225203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Attempting to bind port 89b265da-de0b-4bda-a79e-78aaa9aee5a8 on network b00b93ef-24cf-488b-80ad-16ea8a5cd226 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:35:49.238869 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Transition to ACTIVE for port object cf8dff7a-3dc7-4917-98ee-0a5f1b809e81 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:49.247618 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.265937 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9c040e8-ebc5-4546-a8a1-75876b08ee97 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.269356 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f9c040e8-ebc5-4546-a8a1-75876b08ee97 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9e2467e2-4230-45ef-959f-a3ec216fccf6 HTTP/1.1" status: 204 len: 168 time: 1.3921731 May 12 15:35:49.269356 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.269356 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.289456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:49.299869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:49.308513 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.310616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 35, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:35:49.311104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Checking segment: {'id': '5723a35b-442b-4ca0-9923-4423d1ff636d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'b00b93ef-24cf-488b-80ad-16ea8a5cd226'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:35:49.311837 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.312545 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Bound using segment: {'id': '5723a35b-442b-4ca0-9923-4423d1ff636d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'b00b93ef-24cf-488b-80ad-16ea8a5cd226'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:35:49.313287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Bound port: 89b265da-de0b-4bda-a79e-78aaa9aee5a8, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5723a35b-442b-4ca0-9923-4423d1ff636d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 599, 'network_id': 'b00b93ef-24cf-488b-80ad-16ea8a5cd226'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:35:49.315659 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.444820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:35:34Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '63b42831-39a6-4a50-a6ab-4dce60dc93b6', 'name': '', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'mac_address': 'fa:16:3e:c5:e0:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 2707, 'fixed_ips': [{'subnet_id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:31Z', 'updated_at': '2022-05-12T15:35:46Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'subnets': [{'id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:49.458828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79e2e839-484c-4268-9561-e2fc49a2f29d None None] The sync data for ids ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'] in n-d-841483-1 is: [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:35:34Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '63b42831-39a6-4a50-a6ab-4dce60dc93b6', 'name': '', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'mac_address': 'fa:16:3e:c5:e0:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 2707, 'fixed_ips': [{'subnet_id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:31Z', 'updated_at': '2022-05-12T15:35:46Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'subnets': [{'id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:49.461001 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e8a2f7c6-d3da-4350-8f69-44275c3a6ac0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.535337 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c98926e-7be3-4bf6-9804-60b327b71a95 None None] Pushing event updated for resources: {'Port': ['ID=cf8dff7a-3dc7-4917-98ee-0a5f1b809e81,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:49.576121 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Attempting to bind port cf8dff7a-3dc7-4917-98ee-0a5f1b809e81 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:35:49.576980 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Attempting to bind port cf8dff7a-3dc7-4917-98ee-0a5f1b809e81 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:35:49.577656 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Attempting to bind port cf8dff7a-3dc7-4917-98ee-0a5f1b809e81 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:35:49.584170 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 35, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:35:49.584793 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:35:49.585374 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.586037 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:35:49.587069 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Bound port: cf8dff7a-3dc7-4917-98ee-0a5f1b809e81, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:35:49.588131 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.661169 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1319 time: 3.0172036 May 12 15:35:49.712877 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.746751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] For port 89b265da-de0b-4bda-a79e-78aaa9aee5a8, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:35:49.753064 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e8a2f7c6-d3da-4350-8f69-44275c3a6ac0 None None] For port 825a3e42-ece9-486f-8f9e-4ea65b743747, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=825a3e42-ece9-486f-8f9e-4ea65b743747,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:49.764195 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] For port cf8dff7a-3dc7-4917-98ee-0a5f1b809e81, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:35:49.782717 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] For port cf8dff7a-3dc7-4917-98ee-0a5f1b809e81, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cf8dff7a-3dc7-4917-98ee-0a5f1b809e81,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:35:49.796585 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e8a2f7c6-d3da-4350-8f69-44275c3a6ac0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.799663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] For port 89b265da-de0b-4bda-a79e-78aaa9aee5a8, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=89b265da-de0b-4bda-a79e-78aaa9aee5a8,segment=NetworkSegment(5723a35b-442b-4ca0-9923-4423d1ff636d),segment_id=5723a35b-442b-4ca0-9923-4423d1ff636d)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:35:49.804118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1c7c5121-c757-49f9-bac3-1a6dd1951e19,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:49.807093 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.864346 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:49.882531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57378) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:50.012684 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Routers {'2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:50.013326 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:50.259411 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:35:50.261272 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:35:50.262422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e6fab930-50ba-48ca-82cd-92f0d060108b None None] Provisioning for port cf8dff7a-3dc7-4917-98ee-0a5f1b809e81 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:50.279242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8a2f7c6-d3da-4350-8f69-44275c3a6ac0 None None] Pushing event updated for resources: {'Port': ['ID=825a3e42-ece9-486f-8f9e-4ea65b743747,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:50.327189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3fa0d3ff-a1d4-4cdc-8b9f-a22932c60b58 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port cf8dff7a-3dc7-4917-98ee-0a5f1b809e81 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:50.327724 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fa0d3ff-a1d4-4cdc-8b9f-a22932c60b58 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:50.505424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-956994a1-4178-4fe1-9edb-b41f6a6c07f9 None None] Pushing event updated for resources: {'Port': ['ID=89b265da-de0b-4bda-a79e-78aaa9aee5a8,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:50.508611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-3c22a25b-34f5-4654-98ff-f4bae8fe6eee tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] For port 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=772d4b76-1bbf-41b5-a846-f4fb5eaef3c1,segment=NetworkSegment(f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d),segment_id=f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:50.509277 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c22a25b-34f5-4654-98ff-f4bae8fe6eee tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:50.581579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3281995f-434f-4e91-a84c-de25e2ae9224 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:50.595591 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] Set router 2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:50.614006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3281995f-434f-4e91-a84c-de25e2ae9224 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:50.632527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3281995f-434f-4e91-a84c-de25e2ae9224 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:50.648392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3281995f-434f-4e91-a84c-de25e2ae9224 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:50.658563 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3281995f-434f-4e91-a84c-de25e2ae9224 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2406 time: 0.6868536 May 12 15:35:50.694891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57400) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:50.757982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9c040e8-ebc5-4546-a8a1-75876b08ee97 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e2467e2-4230-45ef-959f-a3ec216fccf6,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:50.840295 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c98926e-7be3-4bf6-9804-60b327b71a95 None None] Pushing event updated for resources: {'Port': ['ID=cf8dff7a-3dc7-4917-98ee-0a5f1b809e81,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:51.097896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event updated for resources: {'Network': ['ID=93d0e6ea-13be-4ca2-8346-1cab7cd93f00,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:51.138047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 93d0e6ea-13be-4ca2-8346-1cab7cd93f00 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:35:51.140684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3c22a25b-34f5-4654-98ff-f4bae8fe6eee tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:51.418258 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:51.427393 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7451737d-7735-439a-aa35-df4446ac6066 req-c408ce33-49d8-4297-a849-7953170737d2 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 210 time: 1.2855752 May 12 15:35:51.502049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c22a25b-34f5-4654-98ff-f4bae8fe6eee tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:51.504107 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33', 'name': 'tempest-NetworksTestDHCPv6-router-235047685', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:41Z', 'updated_at': '2022-05-12T15:35:45Z', 'revision_number': 2, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'gw_port_host': None, '_interfaces': [{'id': 'cf8dff7a-3dc7-4917-98ee-0a5f1b809e81', 'name': '', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'mac_address': 'fa:16:3e:f1:f8:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33', 'device_owner': 'network:router_interface', 'standard_attr_id': 2724, 'fixed_ips': [{'subnet_id': '88285689-afad-483b-ba60-963106bdc4f2', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:43Z', 'updated_at': '2022-05-12T15:35:49Z', 'revision_number': 4, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'subnets': [{'id': '88285689-afad-483b-ba60-963106bdc4f2', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:51.519100 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4ba4e48-8a9f-4094-96ae-bab2254ee942 None None] The sync data for ids ['2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33'] in n-d-841483-1 is: [{'id': '2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33', 'name': 'tempest-NetworksTestDHCPv6-router-235047685', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:41Z', 'updated_at': '2022-05-12T15:35:45Z', 'revision_number': 2, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'gw_port_host': None, '_interfaces': [{'id': 'cf8dff7a-3dc7-4917-98ee-0a5f1b809e81', 'name': '', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'mac_address': 'fa:16:3e:f1:f8:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33', 'device_owner': 'network:router_interface', 'standard_attr_id': 2724, 'fixed_ips': [{'subnet_id': '88285689-afad-483b-ba60-963106bdc4f2', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:43Z', 'updated_at': '2022-05-12T15:35:49Z', 'revision_number': 4, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'subnets': [{'id': '88285689-afad-483b-ba60-963106bdc4f2', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:51.688333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 63b42831-39a6-4a50-a6ab-4dce60dc93b6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:51.828925 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:51.926334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['93d0e6ea-13be-4ca2-8346-1cab7cd93f00']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:51.951816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-3fa0d3ff-a1d4-4cdc-8b9f-a22932c60b58 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] For port cf8dff7a-3dc7-4917-98ee-0a5f1b809e81, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cf8dff7a-3dc7-4917-98ee-0a5f1b809e81,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:51.955761 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fa0d3ff-a1d4-4cdc-8b9f-a22932c60b58 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:51.962822 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:51.971319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:51.971613 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:52.013324 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ab2369d3-ded3-4f2d-925d-09bea5790ef1') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:52.013598 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ab2369d3-ded3-4f2d-925d-09bea5790ef1') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:52.067925 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-081bba14-7d9f-45d3-a947-24cde0327e78 None None] Network b00b93ef-24cf-488b-80ad-16ea8a5cd226 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:52.321734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3fa0d3ff-a1d4-4cdc-8b9f-a22932c60b58 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for cf8dff7a-3dc7-4917-98ee-0a5f1b809e81 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:52.430165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b1bb20d0-9c36-45cf-b49c-3a58bb299ced None None] Provisioning for port 89b265da-de0b-4bda-a79e-78aaa9aee5a8 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:52.446694 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:52.481590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c22a25b-34f5-4654-98ff-f4bae8fe6eee tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=772d4b76-1bbf-41b5-a846-f4fb5eaef3c1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:52.558469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ada94cb0-f508-43fa-b68f-7f05c5422fe1 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event updated for resources: {'Network': ['ID=fee11cfd-7c64-4167-8434-a78d72ae4ebb,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:52.607638 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:52.631744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Releasing vlan 557 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:35:52.632157 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:52.640913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network fee11cfd-7c64-4167-8434-a78d72ae4ebb details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: timer() May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:35:52.674966 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:35:52.847948 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83351d7c-de2b-438e-8aba-bd4b7e33dcf6 req-fef53959-bbd3-4ff0-a459-4e6693de5c1f tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 210 time: 0.1327019 May 12 15:35:52.850946 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c22a25b-34f5-4654-98ff-f4bae8fe6eee tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:52.907238 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:53.047953 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:53.101495 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:53.110724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 63b42831-39a6-4a50-a6ab-4dce60dc93b6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=63b42831-39a6-4a50-a6ab-4dce60dc93b6,segment=NetworkSegment(4dc52732-5577-45b0-b2eb-1c2616cc1c73),segment_id=4dc52732-5577-45b0-b2eb-1c2616cc1c73)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:53.124792 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:53.125728 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 89b265da-de0b-4bda-a79e-78aaa9aee5a8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:53.167558 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:53.180081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event deleted for resources: {'Network': ['ID=93d0e6ea-13be-4ca2-8346-1cab7cd93f00,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:53.192737 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "DELETE /v2.0/networks/93d0e6ea-13be-4ca2-8346-1cab7cd93f00 HTTP/1.1" status: 204 len: 168 time: 2.4967275 May 12 15:35:53.196554 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:53.198071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:53.198723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:53.199393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:53.199971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:53.200485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:53.201030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:53.201596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:53.202137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:53.202657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:53.203203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:53.203968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf0da6c6-94b1-47ea-a4fe-cd6aad65b814 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:35:53.210265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57452) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:53.252429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Transition to ACTIVE for port object 442670c2-6aa6-45ec-9804-8e1a8d084879 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:53.397796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=63b42831-39a6-4a50-a6ab-4dce60dc93b6,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:53.419071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd37961-c5c9-4c88-be93-dea1283821ae req-22a46fa0-aa54-43b6-a8c0-a0720ce05d11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:53.420428 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efd37961-c5c9-4c88-be93-dea1283821ae req-22a46fa0-aa54-43b6-a8c0-a0720ce05d11 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 1096 time: 0.5648112 May 12 15:35:53.431208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 89b265da-de0b-4bda-a79e-78aaa9aee5a8 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:53.438550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 89b265da-de0b-4bda-a79e-78aaa9aee5a8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:53.439095 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:53.465215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3c22a25b-34f5-4654-98ff-f4bae8fe6eee tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 397feb9b-2f46-4c79-af57-634897d5df53 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:35:53.476624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1f8bf3-6879-43ee-b627-94acdcb4d531 req-f58ed7f3-5359-4014-8128-cef97df6a42d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:53.478360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc1f8bf3-6879-43ee-b627-94acdcb4d531 req-f58ed7f3-5359-4014-8128-cef97df6a42d tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.4945683 May 12 15:35:53.483421 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:53.550726 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fbf4720-70c8-4ed2-9d01-8c536ccb017b tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:53.567988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fa0d3ff-a1d4-4cdc-8b9f-a22932c60b58 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:53.646484 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:53.720763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 89b265da-de0b-4bda-a79e-78aaa9aee5a8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=89b265da-de0b-4bda-a79e-78aaa9aee5a8,segment=NetworkSegment(5723a35b-442b-4ca0-9923-4423d1ff636d),segment_id=5723a35b-442b-4ca0-9923-4423d1ff636d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:53.731055 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:53.731895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 825a3e42-ece9-486f-8f9e-4ea65b743747 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:53.858975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fa0d3ff-a1d4-4cdc-8b9f-a22932c60b58 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=cf8dff7a-3dc7-4917-98ee-0a5f1b809e81,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:53.912698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network b00b93ef-24cf-488b-80ad-16ea8a5cd226 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:53.929416 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5ff28699-433a-4f08-9460-321fa806b77f None None] Provisioning complete for port 89b265da-de0b-4bda-a79e-78aaa9aee5a8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:53.929782 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ff28699-433a-4f08-9460-321fa806b77f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:53.941905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:53.959319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:53.986291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=89b265da-de0b-4bda-a79e-78aaa9aee5a8,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:54.039152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc1f8bf3-6879-43ee-b627-94acdcb4d531 req-0c8d539f-3e6a-4d9e-93a5-3e8d0f2d2244 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4859831 May 12 15:35:54.039850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=442670c2-6aa6-45ec-9804-8e1a8d084879,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:54.063128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3c22a25b-34f5-4654-98ff-f4bae8fe6eee tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:54.085923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 825a3e42-ece9-486f-8f9e-4ea65b743747 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:54.086996 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:54.155439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3c22a25b-34f5-4654-98ff-f4bae8fe6eee tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 9.1417997 May 12 15:35:54.156290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57468) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:54.192005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08c8facf-1412-44ab-a3e5-a1738b835300 None None] Sync routers for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:54.389899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:54.390603 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:54.415664 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a01e283-ad0f-424e-9e1d-57add308e109 req-ec0bc8c1-606b-4e78-927b-20b0062499da tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 210 time: 0.1858702 May 12 15:35:54.439513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08c8facf-1412-44ab-a3e5-a1738b835300 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:54.441171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-08c8facf-1412-44ab-a3e5-a1738b835300 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:54.462561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-744bf546-7ac5-4e95-b7fd-a4c7d5f17328 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 9.6976213 May 12 15:35:54.464656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57472) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:54.471279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-fcbddbef-98c8-44f3-a477-b0cdd00c5188 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting subnet 88b72322-9e80-4b80-a94e-362cee47e638 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:35:54.475107 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fcbddbef-98c8-44f3-a477-b0cdd00c5188 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:54.504979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'network_id': 'b00b93ef-24cf-488b-80ad-16ea8a5cd226', 'name': 'tempest-PortsTestJSON-1111710999'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:54.558011 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fcbddbef-98c8-44f3-a477-b0cdd00c5188 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:54.562025 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fbf4720-70c8-4ed2-9d01-8c536ccb017b tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:54.588854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4fbf4720-70c8-4ed2-9d01-8c536ccb017b tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fee11cfd-7c64-4167-8434-a78d72ae4ebb']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:54.612528 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-08c8facf-1412-44ab-a3e5-a1738b835300 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:54.630462 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57478) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:54.661638 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3fa0d3ff-a1d4-4cdc-8b9f-a22932c60b58 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:54.677444 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fcbddbef-98c8-44f3-a477-b0cdd00c5188 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:54.679996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4fbf4720-70c8-4ed2-9d01-8c536ccb017b tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5957ea93-0f6f-43c6-b299-0ea48bc119bb') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:54.680295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4fbf4720-70c8-4ed2-9d01-8c536ccb017b tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5957ea93-0f6f-43c6-b299-0ea48bc119bb') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:54.707368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd37961-c5c9-4c88-be93-dea1283821ae req-f2802684-404c-440f-944f-bccdb3719603 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:54.708982 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efd37961-c5c9-4c88-be93-dea1283821ae req-f2802684-404c-440f-944f-bccdb3719603 service neutron] 10.222.0.76 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 1.2775035 May 12 15:35:54.723979 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fbf4720-70c8-4ed2-9d01-8c536ccb017b tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:54.773485 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fcbddbef-98c8-44f3-a477-b0cdd00c5188 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:54.783959 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-08c8facf-1412-44ab-a3e5-a1738b835300 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:51Z', 'revision_number': 11, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:54.789342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08c8facf-1412-44ab-a3e5-a1738b835300 None None] Checking router: 397feb9b-2f46-4c79-af57-634897d5df53 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:35:54.798612 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5a157880-2049-43bd-b0cd-0bdf40f78954 None None] Provisioning for port 442670c2-6aa6-45ec-9804-8e1a8d084879 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:54.811253 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08c8facf-1412-44ab-a3e5-a1738b835300 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:54.811884 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-08c8facf-1412-44ab-a3e5-a1738b835300 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:54.887750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5a157880-2049-43bd-b0cd-0bdf40f78954 None None] Provisioning complete for port 442670c2-6aa6-45ec-9804-8e1a8d084879 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:54.888124 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5a157880-2049-43bd-b0cd-0bdf40f78954 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:54.980509 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fbf4720-70c8-4ed2-9d01-8c536ccb017b tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:55.008019 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fcbddbef-98c8-44f3-a477-b0cdd00c5188 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:55.011674 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2ff2243d-8dca-48c3-b352-d22b2797f2dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:55.021342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcbddbef-98c8-44f3-a477-b0cdd00c5188 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Subnet': ['ID=88b72322-9e80-4b80-a94e-362cee47e638,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:55.022148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-048badbf-9250-487f-b3d5-52cd96a40425 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:55.022398 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-048badbf-9250-487f-b3d5-52cd96a40425 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Synchronizing usage tracker for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:55.028851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2931eb79-15b8-49f0-82e8-4ced25a3821c None None] Network 8a5a9f45-ac98-4364-8fcd-e150e523be55 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:55.043582 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fcbddbef-98c8-44f3-a477-b0cdd00c5188 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/88b72322-9e80-4b80-a94e-362cee47e638 HTTP/1.1" status: 204 len: 168 time: 0.8763111 May 12 15:35:55.043582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2ff2243d-8dca-48c3-b352-d22b2797f2dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:55.043582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57484) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:55.046329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4fbf4720-70c8-4ed2-9d01-8c536ccb017b tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Releasing vlan 592 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:35:55.046493 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fbf4720-70c8-4ed2-9d01-8c536ccb017b tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:55.062949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2ff2243d-8dca-48c3-b352-d22b2797f2dd admin admin] Usage tracker for resource:security_group_rule and tenant:02cb5eef93da48f98f0e56feea590616 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: timer() May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:35:55.064800 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:35:55.069214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2ff2243d-8dca-48c3-b352-d22b2797f2dd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:55.105673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-08c8facf-1412-44ab-a3e5-a1738b835300 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:55.146019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2ff2243d-8dca-48c3-b352-d22b2797f2dd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:55.205944 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:55.222253 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Deleting port 5796cd60-4096-4bd3-8732-71b8f22806a2 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:55.223226 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:55.225764 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efd37961-c5c9-4c88-be93-dea1283821ae req-b574cfd8-fb29-4ffc-9c1f-429e398eb013 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d45db345-6e10-417e-8b52-3260151d6ba4 HTTP/1.1" status: 200 len: 1001 time: 0.5067160 May 12 15:35:55.266657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5a157880-2049-43bd-b0cd-0bdf40f78954 None None] Port 442670c2-6aa6-45ec-9804-8e1a8d084879 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:35:55.270697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-08c8facf-1412-44ab-a3e5-a1738b835300 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:51Z', 'revision_number': 11, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:55.295004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08c8facf-1412-44ab-a3e5-a1738b835300 None None] The sync data for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 is: [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:51Z', 'revision_number': 11, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:55.379879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-048badbf-9250-487f-b3d5-52cd96a40425 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Unset dirty status for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:55.381005 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-048badbf-9250-487f-b3d5-52cd96a40425 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.84 "GET /v2.0/networks?id=d2e823c6-8acb-45b9-910c-0a4822a68f25 HTTP/1.1" status: 200 len: 796 time: 1.4397869 May 12 15:35:55.382489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd37961-c5c9-4c88-be93-dea1283821ae req-65e5d635-d7ed-468c-8837-e9053da6c977 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:55.383824 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efd37961-c5c9-4c88-be93-dea1283821ae req-65e5d635-d7ed-468c-8837-e9053da6c977 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.0967929 May 12 15:35:55.441156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:55.469498 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fbf4720-70c8-4ed2-9d01-8c536ccb017b tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:55.471366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6236fd42-14aa-4e99-bee7-67e0bc416dbd req-68a43974-0d56-4291-93c4-f10559157bd2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:55.472836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6236fd42-14aa-4e99-bee7-67e0bc416dbd req-68a43974-0d56-4291-93c4-f10559157bd2 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.2071393 May 12 15:35:55.481819 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fbf4720-70c8-4ed2-9d01-8c536ccb017b tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:55.496943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:port and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:55.653155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6236fd42-14aa-4e99-bee7-67e0bc416dbd req-acf52dd3-806b-4691-8daf-5716dd012cc6 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1537135 May 12 15:35:55.672029 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73ef15fc-e716-47e5-854b-f38ffecb1a6f req-5b94b8aa-bfe4-4266-8a74-e8fc8bd4d342 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 210 time: 0.0925210 May 12 15:35:55.683423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3fa0d3ff-a1d4-4cdc-8b9f-a22932c60b58 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Router 2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:35:55.687386 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:55.696595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-853f6f78-8165-4750-88bf-d3c5902522bb None None] DHCP port deletion for 8a5a9f45-ac98-4364-8fcd-e150e523be55 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:35:55.711933 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-853f6f78-8165-4750-88bf-d3c5902522bb None None] Deleting port 5796cd60-4096-4bd3-8732-71b8f22806a2 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:55.712309 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-853f6f78-8165-4750-88bf-d3c5902522bb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:55.718333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:55.722774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fbf4720-70c8-4ed2-9d01-8c536ccb017b tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event deleted for resources: {'Network': ['ID=fee11cfd-7c64-4167-8434-a78d72ae4ebb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:55.733078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] For port 5796cd60-4096-4bd3-8732-71b8f22806a2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5796cd60-4096-4bd3-8732-71b8f22806a2,segment=NetworkSegment(f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d),segment_id=f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:55.733581 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:55.749744 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4fbf4720-70c8-4ed2-9d01-8c536ccb017b tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "DELETE /v2.0/networks/fee11cfd-7c64-4167-8434-a78d72ae4ebb HTTP/1.1" status: 204 len: 168 time: 2.5239801 May 12 15:35:55.755040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57492) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:55.882813 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 63b42831-39a6-4a50-a6ab-4dce60dc93b6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:55.889318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Calling delete_port for 5796cd60-4096-4bd3-8732-71b8f22806a2 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:55.929070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-24900fe5-418b-4976-9e84-bebcd02d42ee tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Synchronizing usage tracker for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:55.948952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2ff2243d-8dca-48c3-b352-d22b2797f2dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:55.955124 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2ff2243d-8dca-48c3-b352-d22b2797f2dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:55.984941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3fa0d3ff-a1d4-4cdc-8b9f-a22932c60b58 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:55.992974 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3fa0d3ff-a1d4-4cdc-8b9f-a22932c60b58 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "PUT /v2.0/routers/2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.8479140 May 12 15:35:55.993954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57496) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:56.001664 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ed3a017-b581-4207-a5e8-d13332679022 None None] Sync routers for ids ['2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:56.019005 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ed3a017-b581-4207-a5e8-d13332679022 None None] Routers {'2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:56.019611 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1ed3a017-b581-4207-a5e8-d13332679022 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:56.028201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ff2243d-8dca-48c3-b352-d22b2797f2dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=633a36b8-2e07-45fc-8657-69e83210bd3b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:56.037721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2ff2243d-8dca-48c3-b352-d22b2797f2dd admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=02cb5eef93da48f98f0e56feea590616&name=default HTTP/1.1" status: 200 len: 2983 time: 1.4034874 May 12 15:35:56.038343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57500) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:56.068140 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.113359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-853f6f78-8165-4750-88bf-d3c5902522bb None None] For port 5796cd60-4096-4bd3-8732-71b8f22806a2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5796cd60-4096-4bd3-8732-71b8f22806a2,segment=NetworkSegment(f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d),segment_id=f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:56.114494 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-853f6f78-8165-4750-88bf-d3c5902522bb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.128542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Port': ['ID=5796cd60-4096-4bd3-8732-71b8f22806a2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:56.140036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No DVR routers for this DVR port 5796cd60-4096-4bd3-8732-71b8f22806a2 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:35:56.140545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8913ff9-5cca-4ec1-abd8-66f37f096b47 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:56.142410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8913ff9-5cca-4ec1-abd8-66f37f096b47 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:56.143340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c8913ff9-5cca-4ec1-abd8-66f37f096b47 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:56.156494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:56.160171 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.184807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-24900fe5-418b-4976-9e84-bebcd02d42ee tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Unset dirty status for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:56.186035 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-24900fe5-418b-4976-9e84-bebcd02d42ee tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3dd1fe8ad774471ba7745219a37ead53 HTTP/1.1" status: 200 len: 475 time: 0.7424634 May 12 15:35:56.195730 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-1ed3a017-b581-4207-a5e8-d13332679022 None None] Set router 2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:56.198899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port a52e9b0c-62ba-4801-9090-a7ed0fdac00e yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:35:56.246197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Request body: {'port': {'device_id': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'admin_state_up': True, 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'security_groups': ['9358f0f8-f7c3-47a6-a1a3-bfbe9808172b', '62da627b-8675-47b7-a69e-55dbeab2bd90']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:56.278661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd37961-c5c9-4c88-be93-dea1283821ae req-1ca666cf-22c1-4838-8fcb-529c16d00d04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:56.280480 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efd37961-c5c9-4c88-be93-dea1283821ae req-1ca666cf-22c1-4838-8fcb-529c16d00d04 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.8882251 May 12 15:35:56.290344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-853f6f78-8165-4750-88bf-d3c5902522bb None None] Calling delete_port for 5796cd60-4096-4bd3-8732-71b8f22806a2 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:56.299109 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.310744 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc9c3b24-e12c-4ce4-959c-98a6b95dfa42 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.342673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8a5a9f45-ac98-4364-8fcd-e150e523be55']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:56.356356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c8913ff9-5cca-4ec1-abd8-66f37f096b47 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:56.357525 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c8913ff9-5cca-4ec1-abd8-66f37f096b47 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.3316002 May 12 15:35:56.362785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57504) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:56.405798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:56.406449 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.434162 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1ed3a017-b581-4207-a5e8-d13332679022 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33', 'name': 'tempest-NetworksTestDHCPv6-router-235047685', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:41Z', 'updated_at': '2022-05-12T15:35:53Z', 'revision_number': 3, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:56.438421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-96c47fef-66ba-423e-87dc-2a555f0c5f7d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 88285689-afad-483b-ba60-963106bdc4f2 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:35:56.439325 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ed3a017-b581-4207-a5e8-d13332679022 None None] Checking router: 2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:35:56.442702 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc9c3b24-e12c-4ce4-959c-98a6b95dfa42 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.451266 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ed3a017-b581-4207-a5e8-d13332679022 None None] Routers {'2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:56.452012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:56.452361 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1ed3a017-b581-4207-a5e8-d13332679022 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:56.452496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f4a6bfa7-06e9-4ee6-8eb7-2633e105db3d') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:56.459762 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96c47fef-66ba-423e-87dc-2a555f0c5f7d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.503663 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-853f6f78-8165-4750-88bf-d3c5902522bb None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:35:56.503922 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-853f6f78-8165-4750-88bf-d3c5902522bb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:35:56.534219 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.539896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d1a0dc4-67f3-4138-b02a-9e0a8583e3f2 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:56.547802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d1a0dc4-67f3-4138-b02a-9e0a8583e3f2 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:56.548721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4d1a0dc4-67f3-4138-b02a-9e0a8583e3f2 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Synchronizing usage tracker for tenant:09e0c5fd5fce41bf91599658e3eed992 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:56.570698 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96c47fef-66ba-423e-87dc-2a555f0c5f7d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.592518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 89b265da-de0b-4bda-a79e-78aaa9aee5a8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:35:56.605690 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.627056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Releasing vlan 582 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:35:56.627547 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: timer() May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:35:56.648401 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:35:56.674172 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-1ed3a017-b581-4207-a5e8-d13332679022 None None] Set router 2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:56.686058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4d1a0dc4-67f3-4138-b02a-9e0a8583e3f2 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Unset dirty status for tenant:09e0c5fd5fce41bf91599658e3eed992 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:56.688133 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4d1a0dc4-67f3-4138-b02a-9e0a8583e3f2 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.9312010 May 12 15:35:56.709110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57510) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:56.722091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:56.732660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:56.743604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4918b009-fe33-494c-9fd9-188064728f82 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-551524073'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:56.763901 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 89b265da-de0b-4bda-a79e-78aaa9aee5a8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:56.764274 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.783017 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efd37961-c5c9-4c88-be93-dea1283821ae req-cc1b8632-5ff2-465d-a87c-71587b1dd46a service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4817367 May 12 15:35:56.795317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Made reservation on behalf of 3dd1fe8ad774471ba7745219a37ead53 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:56.799125 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.820929 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.824669 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc9c3b24-e12c-4ce4-959c-98a6b95dfa42 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.838731 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:56.876230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc9c3b24-e12c-4ce4-959c-98a6b95dfa42 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=633a36b8-2e07-45fc-8657-69e83210bd3b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:56.886942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Pushing event deleted for resources: {'Network': ['ID=8a5a9f45-ac98-4364-8fcd-e150e523be55,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:56.903064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Allocated IP 172.20.0.10 (b00b93ef-24cf-488b-80ad-16ea8a5cd226/82849bea-971a-4272-8f77-327862d7f6e7/a52e9b0c-62ba-4801-9090-a7ed0fdac00e) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:56.928376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4918b009-fe33-494c-9fd9-188064728f82 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:56.938915 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1ed3a017-b581-4207-a5e8-d13332679022 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33', 'name': 'tempest-NetworksTestDHCPv6-router-235047685', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:41Z', 'updated_at': '2022-05-12T15:35:53Z', 'revision_number': 3, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:56.948337 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ed3a017-b581-4207-a5e8-d13332679022 None None] The sync data for ids ['2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33'] in n-d-841483-1 is: [{'id': '2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33', 'name': 'tempest-NetworksTestDHCPv6-router-235047685', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:41Z', 'updated_at': '2022-05-12T15:35:53Z', 'revision_number': 3, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:57.022440 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-853f6f78-8165-4750-88bf-d3c5902522bb None None] Deleting port 5796cd60-4096-4bd3-8732-71b8f22806a2 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:57.022871 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-853f6f78-8165-4750-88bf-d3c5902522bb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:57.038611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4918b009-fe33-494c-9fd9-188064728f82 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:57.128613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-853f6f78-8165-4750-88bf-d3c5902522bb None None] The port '5796cd60-4096-4bd3-8732-71b8f22806a2' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:35:57.185373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4918b009-fe33-494c-9fd9-188064728f82 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Made reservation on behalf of 09e0c5fd5fce41bf91599658e3eed992 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:57.189145 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4918b009-fe33-494c-9fd9-188064728f82 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:57.205973 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc9c3b24-e12c-4ce4-959c-98a6b95dfa42 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:57.207073 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bc9c3b24-e12c-4ce4-959c-98a6b95dfa42 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/633a36b8-2e07-45fc-8657-69e83210bd3b HTTP/1.1" status: 204 len: 168 time: 1.1666656 May 12 15:35:57.208453 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96c47fef-66ba-423e-87dc-2a555f0c5f7d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:57.247288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-689b2b92-70c7-4bd5-9591-5688a04e3b7a tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/networks/8a5a9f45-ac98-4364-8fcd-e150e523be55 HTTP/1.1" status: 204 len: 168 time: 2.2045333 May 12 15:35:57.254448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b395ec20-90f3-4157-bee1-ba8ac0ba44b4 req-77f9e1a3-a096-4103-83b2-065c505b99c9 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 210 time: 0.1226861 May 12 15:35:57.263637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57518) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:57.272080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-895a9bd4-14e6-4437-a3ad-adfacdb676b0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'router': {'routes': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:57.339150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4918b009-fe33-494c-9fd9-188064728f82 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 587} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:35:57.349808 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4918b009-fe33-494c-9fd9-188064728f82 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:57.350327 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-4918b009-fe33-494c-9fd9-188064728f82 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Added segment f503f7dc-7fed-4789-b468-7e3c9a3bd2b1 of type vlan for network 07aedea1-40b5-4fa3-96b2-b70f45608ea4 May 12 15:35:57.448953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:57.449314 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4918b009-fe33-494c-9fd9-188064728f82 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:57.503687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:57.510081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 772d4b76-1bbf-41b5-a846-f4fb5eaef3c1 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:57.511598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5796cd60-4096-4bd3-8732-71b8f22806a2 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:57.522417 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efd37961-c5c9-4c88-be93-dea1283821ae req-062c6d3d-4c07-4f5b-a8f4-e00caa9eea03 service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7280991 May 12 15:35:57.561576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Allocated IP 172.20.0.6 (d2e823c6-8acb-45b9-910c-0a4822a68f25/27cd1f2e-8b9d-4298-a44b-ce82945125a8/4f36023c-143c-4389-b26c-f62679404834) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:35:57.580021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 5796cd60-4096-4bd3-8732-71b8f22806a2 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:57.581669 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5796cd60-4096-4bd3-8732-71b8f22806a2 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:57.586624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cf8dff7a-3dc7-4917-98ee-0a5f1b809e81 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:57.599559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19259afb-ac4c-44f7-aeca-be083ae22821 req-06f63ff8-153d-4af0-9e80-9737567de5e1 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:57.601223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19259afb-ac4c-44f7-aeca-be083ae22821 req-06f63ff8-153d-4af0-9e80-9737567de5e1 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.7007060 May 12 15:35:57.643269 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: cf8dff7a-3dc7-4917-98ee-0a5f1b809e81 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:57.643912 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cf8dff7a-3dc7-4917-98ee-0a5f1b809e81 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:57.646414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.extraroute_db [None req-895a9bd4-14e6-4437-a3ad-adfacdb676b0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Added routes are [] {{(pid=88152) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:114}} May 12 15:35:57.646558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.extraroute_db [None req-895a9bd4-14e6-4437-a3ad-adfacdb676b0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Removed routes are [] {{(pid=88152) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:122}} May 12 15:35:57.646881 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-895a9bd4-14e6-4437-a3ad-adfacdb676b0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:57.663565 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96c47fef-66ba-423e-87dc-2a555f0c5f7d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:57.694845 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4918b009-fe33-494c-9fd9-188064728f82 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:57.702491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4918b009-fe33-494c-9fd9-188064728f82 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:57.703210 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4918b009-fe33-494c-9fd9-188064728f82 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:57.735255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57528) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:57.792694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96c47fef-66ba-423e-87dc-2a555f0c5f7d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=88285689-afad-483b-ba60-963106bdc4f2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:57.861489 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-96c47fef-66ba-423e-87dc-2a555f0c5f7d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:57.867592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6713ccd6-c2f8-497b-9f01-911c28bbdd57 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:35:57.877880 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ec85c01-dfb3-4b15-b185-7f8069b400d1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:57.879825 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19259afb-ac4c-44f7-aeca-be083ae22821 req-9c64c452-f330-4b13-b091-4ff2a9e25e8b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2423851 May 12 15:35:57.890194 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-96c47fef-66ba-423e-87dc-2a555f0c5f7d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/88285689-afad-483b-ba60-963106bdc4f2 HTTP/1.1" status: 204 len: 168 time: 1.5217962 May 12 15:35:57.909545 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:57.914409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57532) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:58.038130 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-895a9bd4-14e6-4437-a3ad-adfacdb676b0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:58.041844 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-895a9bd4-14e6-4437-a3ad-adfacdb676b0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:58.150023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5950c596-864b-4562-893e-4b4e22d33416 None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:35:58.156181 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5950c596-864b-4562-893e-4b4e22d33416 None None] Deleting port 825a3e42-ece9-486f-8f9e-4ea65b743747 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:35:58.156790 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5950c596-864b-4562-893e-4b4e22d33416 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:58.162880 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4918b009-fe33-494c-9fd9-188064728f82 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 1.4511673 May 12 15:35:58.164317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7ec85c01-dfb3-4b15-b185-7f8069b400d1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:58.165601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57536) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:58.178631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1207740135'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:58.183253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4918b009-fe33-494c-9fd9-188064728f82 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event updated for resources: {'Network': ['ID=07aedea1-40b5-4fa3-96b2-b70f45608ea4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:58.183709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:35:58.188141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Usage tracker for resource:network and tenant:09e0c5fd5fce41bf91599658e3eed992 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:58.191587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:58.201187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:58.202202 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 07aedea1-40b5-4fa3-96b2-b70f45608ea4 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:35:58.228126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-895a9bd4-14e6-4437-a3ad-adfacdb676b0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 397feb9b-2f46-4c79-af57-634897d5df53 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:35:58.234644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Transition to ACTIVE for port object a52e9b0c-62ba-4801-9090-a7ed0fdac00e will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:58.241147 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7ec85c01-dfb3-4b15-b185-7f8069b400d1 admin admin] Usage tracker for resource:security_group_rule and tenant:0a1452fe789d4faab665d6156f60bd07 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:35:58.247921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Made reservation on behalf of 09e0c5fd5fce41bf91599658e3eed992 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:35:58.251492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7ec85c01-dfb3-4b15-b185-7f8069b400d1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:35:58.256018 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:58.275163 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7ec85c01-dfb3-4b15-b185-7f8069b400d1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:35:58.413784 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e76053c2-6259-4ee1-87f9-4a4557ea168c req-871e8256-8cce-4818-ac1f-bbbe1a21d48d service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0814381 May 12 15:35:58.489699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-895a9bd4-14e6-4437-a3ad-adfacdb676b0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:35:58.497737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6ad06326-38b8-41cb-8a61-95b9895431cf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:router {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:58.498441 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-895a9bd4-14e6-4437-a3ad-adfacdb676b0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:58.502263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-895a9bd4-14e6-4437-a3ad-adfacdb676b0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53 HTTP/1.1" status: 200 len: 705 time: 1.2352529 May 12 15:35:58.509418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57542) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:58.512230 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:58.514610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5950c596-864b-4562-893e-4b4e22d33416 None None] For port 825a3e42-ece9-486f-8f9e-4ea65b743747, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=825a3e42-ece9-486f-8f9e-4ea65b743747,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:35:58.515257 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5950c596-864b-4562-893e-4b4e22d33416 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:58.521424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee250df1-4c4f-4f8e-8849-67c0b39a5cdc req-e8f07932-3f1a-4b24-b464-bc5abb9dd1df tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 210 time: 0.0695779 May 12 15:35:58.533601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dee57512-bf96-4fcd-b323-d579edab9b68 None None] Sync routers for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:35:58.537798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 580} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:35:58.549128 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:58.549652 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Added segment 9289b646-008e-43b9-b231-accffffb244a of type vlan for network 0bf56a0b-375f-40f3-a343-779ce0926402 May 12 15:35:58.580314 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:58.660776 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dee57512-bf96-4fcd-b323-d579edab9b68 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:58.661449 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dee57512-bf96-4fcd-b323-d579edab9b68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:58.699081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:58.703156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b386cffe-d845-47fe-a270-95a4f4d6203b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Synchronizing usage tracker for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:35:58.718401 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e76053c2-6259-4ee1-87f9-4a4557ea168c req-89eb15bf-d3c8-419a-a59e-5507c0e02056 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.1054878 May 12 15:35:58.730304 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6ad06326-38b8-41cb-8a61-95b9895431cf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:router {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:58.731246 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6ad06326-38b8-41cb-8a61-95b9895431cf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 709 time: 0.8100281 May 12 15:35:58.740374 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57546) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:58.746054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5950c596-864b-4562-893e-4b4e22d33416 None None] Calling delete_port for 825a3e42-ece9-486f-8f9e-4ea65b743747 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:35:58.752847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network b00b93ef-24cf-488b-80ad-16ea8a5cd226 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:58.793915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:58.798669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Transition to ACTIVE for port object 4f36023c-143c-4389-b26c-f62679404834 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:35:58.804575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=a52e9b0c-62ba-4801-9090-a7ed0fdac00e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:58.810646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:58.854055 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e76053c2-6259-4ee1-87f9-4a4557ea168c req-995dbeee-4d67-4a93-b2ad-8ef95fc72a11 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1049290 May 12 15:35:58.876696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b386cffe-d845-47fe-a270-95a4f4d6203b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Unset dirty status for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:35:58.880308 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b386cffe-d845-47fe-a270-95a4f4d6203b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports?device_id=397feb9b-2f46-4c79-af57-634897d5df53 HTTP/1.1" status: 200 len: 205 time: 0.3621275 May 12 15:35:58.881917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-dee57512-bf96-4fcd-b323-d579edab9b68 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:58.885832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57550) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:58.939986 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ec85c01-dfb3-4b15-b185-7f8069b400d1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:58.999249 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dee57512-bf96-4fcd-b323-d579edab9b68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:51Z', 'revision_number': 11, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:59.004629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dee57512-bf96-4fcd-b323-d579edab9b68 None None] Checking router: 397feb9b-2f46-4c79-af57-634897d5df53 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:35:59.024285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dee57512-bf96-4fcd-b323-d579edab9b68 None None] Routers {'397feb9b-2f46-4c79-af57-634897d5df53'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:35:59.025286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dee57512-bf96-4fcd-b323-d579edab9b68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['397feb9b-2f46-4c79-af57-634897d5df53'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:59.026681 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ec85c01-dfb3-4b15-b185-7f8069b400d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:59.082196 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d055adf2-f577-46ae-883a-3b4aafca8dc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:59.112208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:59.113147 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:59.120817 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7ec85c01-dfb3-4b15-b185-7f8069b400d1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0a1452fe789d4faab665d6156f60bd07&name=default HTTP/1.1" status: 200 len: 2983 time: 1.3690655 May 12 15:35:59.138114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57556) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:59.138263 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c23b7d15-8bb9-445b-8997-8a6ea711d3e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:59.202481 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:59.224728 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:59.232123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:59.232469 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:59.235926 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5950c596-864b-4562-893e-4b4e22d33416 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:59.272216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ec85c01-dfb3-4b15-b185-7f8069b400d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6be4a3fb-48dc-41ae-bd9d-59b40b8c99a2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:59.279879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-dee57512-bf96-4fcd-b323-d579edab9b68 None None] Set router 397feb9b-2f46-4c79-af57-634897d5df53 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:35:59.315747 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2884f635-9882-4d92-a173-18b309fe4925 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 925 time: 4.8330345 May 12 15:35:59.343182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57560) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:59.402685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5950c596-864b-4562-893e-4b4e22d33416 None None] No DVR routers for this DVR port 825a3e42-ece9-486f-8f9e-4ea65b743747 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:35:59.413878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5950c596-864b-4562-893e-4b4e22d33416 None None] Pushing event deleted for resources: {'Port': ['ID=825a3e42-ece9-486f-8f9e-4ea65b743747,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:59.415819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 825a3e42-ece9-486f-8f9e-4ea65b743747 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:35:59.425415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76053c2-6259-4ee1-87f9-4a4557ea168c req-1244a62e-350d-4ed6-99b0-40c0414ae63d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:59.426857 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e76053c2-6259-4ee1-87f9-4a4557ea168c req-1244a62e-350d-4ed6-99b0-40c0414ae63d service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.5512636 May 12 15:35:59.432173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Network d2e823c6-8acb-45b9-910c-0a4822a68f25 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:35:59.451877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:35:59.457769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c917550f-b183-42ea-af34-1b5eef0def09 None None] Provisioning for port a52e9b0c-62ba-4801-9090-a7ed0fdac00e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:59.461098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dee57512-bf96-4fcd-b323-d579edab9b68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:51Z', 'revision_number': 11, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:35:59.466792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 825a3e42-ece9-486f-8f9e-4ea65b743747 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:35:59.467455 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 825a3e42-ece9-486f-8f9e-4ea65b743747 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:35:59.468679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dee57512-bf96-4fcd-b323-d579edab9b68 None None] The sync data for ids ['397feb9b-2f46-4c79-af57-634897d5df53'] in n-d-841483-1 is: [{'id': '397feb9b-2f46-4c79-af57-634897d5df53', 'name': 'tempest-RoutersIpV6Test-router-1048475578', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:33:56Z', 'updated_at': '2022-05-12T15:35:51Z', 'revision_number': 11, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:35:59.472277 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c917550f-b183-42ea-af34-1b5eef0def09 None None] Provisioning complete for port a52e9b0c-62ba-4801-9090-a7ed0fdac00e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:59.472277 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c917550f-b183-42ea-af34-1b5eef0def09 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:59.480265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'Port': ['ID=4f36023c-143c-4389-b26c-f62679404834,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:59.492357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:35:59.558760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c917550f-b183-42ea-af34-1b5eef0def09 None None] Port a52e9b0c-62ba-4801-9090-a7ed0fdac00e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:35:59.604670 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 1.4379716 May 12 15:35:59.611723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57566) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:35:59.634035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aa6e1c04-575a-4b55-acc0-eabd86f3b51d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:59.654140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Request body: {'ports': [{'network_id': '07aedea1-40b5-4fa3-96b2-b70f45608ea4', 'name': 'tempest-port--1942984309', 'admin_state_up': True}, {'network_id': '0bf56a0b-375f-40f3-a343-779ce0926402', 'admin_state_up': False}]} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:59.654711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Request body: {'port': {'network_id': '07aedea1-40b5-4fa3-96b2-b70f45608ea4', 'name': 'tempest-port--1942984309', 'admin_state_up': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:59.655336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Request body: {'port': {'network_id': '0bf56a0b-375f-40f3-a343-779ce0926402', 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:35:59.764261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:35:59.764892 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:59.781078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3ebca7fc-5018-49b8-946c-331591ec0d95 None None] Provisioning for port 4f36023c-143c-4389-b26c-f62679404834 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:35:59.787489 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3ebca7fc-5018-49b8-946c-331591ec0d95 None None] Provisioning complete for port 4f36023c-143c-4389-b26c-f62679404834 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:35:59.788001 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3ebca7fc-5018-49b8-946c-331591ec0d95 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:59.804607 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aa6e1c04-575a-4b55-acc0-eabd86f3b51d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:35:59.836008 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5e2be098-1be5-4ef6-9f64-6bd549313670 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 972 time: 3.6011481 May 12 15:35:59.859376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3ebca7fc-5018-49b8-946c-331591ec0d95 None None] Port 4f36023c-143c-4389-b26c-f62679404834 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:35:59.871323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-0c408ee4-b2d0-499b-a917-2664834fc62d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:35:59.872798 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-0c408ee4-b2d0-499b-a917-2664834fc62d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.84 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0164595 May 12 15:35:59.882281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c15f40b-faaf-42b7-9078-78492b4c4ebe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event updated for resources: {'Network': ['ID=0bf56a0b-375f-40f3-a343-779ce0926402,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:35:59.894315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 0bf56a0b-375f-40f3-a343-779ce0926402 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:36:00.010662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c891607-8c4e-4fd5-87c1-f1b7e4dd0d75 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:00.011677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0c891607-8c4e-4fd5-87c1-f1b7e4dd0d75 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:00.045800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:00.050628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Usage tracker for resource:port and tenant:09e0c5fd5fce41bf91599658e3eed992 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:00.055008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:00.058626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0c891607-8c4e-4fd5-87c1-f1b7e4dd0d75 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:00.063018 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0c891607-8c4e-4fd5-87c1-f1b7e4dd0d75 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports?fixed_ips=ip_address%3D172.20.0.5 HTTP/1.1" status: 200 len: 922 time: 0.7152166 May 12 15:36:00.063871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57572) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:00.099061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attempting to reserve 2 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:00.100998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aa6e1c04-575a-4b55-acc0-eabd86f3b51d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.146363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa6e1c04-575a-4b55-acc0-eabd86f3b51d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6be4a3fb-48dc-41ae-bd9d-59b40b8c99a2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:00.146631 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d055adf2-f577-46ae-883a-3b4aafca8dc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.151267 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d055adf2-f577-46ae-883a-3b4aafca8dc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.157306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Made reservation on behalf of 09e0c5fd5fce41bf91599658e3eed992 for: {'port': 2} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:00.160256 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c23b7d15-8bb9-445b-8997-8a6ea711d3e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.161763 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.168517 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c23b7d15-8bb9-445b-8997-8a6ea711d3e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.175550 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aa6e1c04-575a-4b55-acc0-eabd86f3b51d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.180402 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aa6e1c04-575a-4b55-acc0-eabd86f3b51d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6be4a3fb-48dc-41ae-bd9d-59b40b8c99a2 HTTP/1.1" status: 204 len: 168 time: 1.0372016 May 12 15:36:00.194433 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.241030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73030a95-c56f-45c1-9177-c19d47fcbca3 req-41d931d6-b6a4-44e3-ac10-ef516bcefc1f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:00.248959 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73030a95-c56f-45c1-9177-c19d47fcbca3 req-41d931d6-b6a4-44e3-ac10-ef516bcefc1f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 1.0447059 May 12 15:36:00.271254 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d055adf2-f577-46ae-883a-3b4aafca8dc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.271951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d055adf2-f577-46ae-883a-3b4aafca8dc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Fanout notify agent at l3_agent the message router_deleted on router 397feb9b-2f46-4c79-af57-634897d5df53 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:36:00.286443 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c23b7d15-8bb9-445b-8997-8a6ea711d3e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.287542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c23b7d15-8bb9-445b-8997-8a6ea711d3e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Fanout notify agent at l3_agent the message router_deleted on router 2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:36:00.354955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9c2109e-db02-4336-b46a-69b60a15df25 req-1a404c52-07a4-4d97-a2ca-871a5bb7f892 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:00.363285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9c2109e-db02-4336-b46a-69b60a15df25 req-1a404c52-07a4-4d97-a2ca-871a5bb7f892 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 970 time: 0.5588531 May 12 15:36:00.376648 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d055adf2-f577-46ae-883a-3b4aafca8dc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.378001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d055adf2-f577-46ae-883a-3b4aafca8dc0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53 HTTP/1.1" status: 204 len: 168 time: 1.4886053 May 12 15:36:00.397804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57578) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:00.408478 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73030a95-c56f-45c1-9177-c19d47fcbca3 req-760b17ad-9135-4ba5-9f1f-00fcd4c4d0c9 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1577847 May 12 15:36:00.427904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9eb34183-861a-4a2e-b43b-2495e6555d75 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-412200390', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:00.445478 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c23b7d15-8bb9-445b-8997-8a6ea711d3e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.446771 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c23b7d15-8bb9-445b-8997-8a6ea711d3e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/routers/2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33 HTTP/1.1" status: 204 len: 168 time: 1.7058175 May 12 15:36:00.448777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9eb34183-861a-4a2e-b43b-2495e6555d75 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:00.459918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57582) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:00.470599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9eb34183-861a-4a2e-b43b-2495e6555d75 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Usage tracker for resource:router and tenant:85d1374188ec4c0ca79f0d59c0d386b5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:00.480882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:00.498969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-7081df85-fbe9-4d7f-817c-44307c4474c6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port a52e9b0c-62ba-4801-9090-a7ed0fdac00e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:00.499205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9eb34183-861a-4a2e-b43b-2495e6555d75 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:00.499316 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7081df85-fbe9-4d7f-817c-44307c4474c6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.514277 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9c2109e-db02-4336-b46a-69b60a15df25 req-13516916-7bc4-4f40-86d1-9dec41b17484 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 0.1498399 May 12 15:36:00.515286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9eb34183-861a-4a2e-b43b-2495e6555d75 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:00.540194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Request body: {'port': {'device_id': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:00.591378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9eb34183-861a-4a2e-b43b-2495e6555d75 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.592377 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9eb34183-861a-4a2e-b43b-2495e6555d75 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.624994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:00.630714 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9eb34183-861a-4a2e-b43b-2495e6555d75 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.632433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:00.644775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:00.652900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:00.665575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:00.670092 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.687703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9eb34183-861a-4a2e-b43b-2495e6555d75 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.790339 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9eb34183-861a-4a2e-b43b-2495e6555d75 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.792055 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9eb34183-861a-4a2e-b43b-2495e6555d75 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.3825893 May 12 15:36:00.796944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57596) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:00.804342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0f4e3659-7f5c-432c-b335-e575d946b204 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Request body: {'router': {'admin_state_up': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:00.854733 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:00.946895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] device_id is not set on port 44da3c2a-5e90-45e8-8d9f-55abc3c3f372 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:36:01.267239 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7081df85-fbe9-4d7f-817c-44307c4474c6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:01.288825 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f4e3659-7f5c-432c-b335-e575d946b204 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:01.321360 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f4e3659-7f5c-432c-b335-e575d946b204 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:01.425081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-7081df85-fbe9-4d7f-817c-44307c4474c6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for a52e9b0c-62ba-4801-9090-a7ed0fdac00e owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:01.457223 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:01.566125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:01.572393 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:01.583057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40627331-6add-4d12-81c0-c0cbbd151ec4 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:01.587504 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:01.601491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:01.602455 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:01.676915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=5c305c19-23a9-41fa-8421-7282f02eeb36,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:01.688141 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.2233391 May 12 15:36:01.693822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:01.694272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:01.694728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:01.695668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:01.695668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:01.695906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:01.696831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:01.696831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:01.697037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:01.697520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:01.698105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:01.698496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-792f7a22-899f-4320-8671-d05908e841ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:01.712558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57622) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:01.722909 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:36:01.744863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-eb62c132-4e79-4013-b9f8-1fa487b7bc3e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-163243081', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:01.751981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-eb62c132-4e79-4013-b9f8-1fa487b7bc3e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:01.756282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-eb62c132-4e79-4013-b9f8-1fa487b7bc3e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:router and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:01.767423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-eb62c132-4e79-4013-b9f8-1fa487b7bc3e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:01.833751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-eb62c132-4e79-4013-b9f8-1fa487b7bc3e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:01.845286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] device_id is not set on port 7db3150a-0290-4153-9dc4-b297785438dd yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:36:01.876528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb62c132-4e79-4013-b9f8-1fa487b7bc3e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:01.877553 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb62c132-4e79-4013-b9f8-1fa487b7bc3e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:01.893086 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb62c132-4e79-4013-b9f8-1fa487b7bc3e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:01.904334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4f36023c-143c-4389-b26c-f62679404834 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:36:01.908096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '5c305c19-23a9-41fa-8421-7282f02eeb36'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:36:01.911017 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:01.918286 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:01.920845 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7081df85-fbe9-4d7f-817c-44307c4474c6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:01.936483 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:36:01.992889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7081df85-fbe9-4d7f-817c-44307c4474c6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=a52e9b0c-62ba-4801-9090-a7ed0fdac00e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:01.995919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0f4e3659-7f5c-432c-b335-e575d946b204 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Router 44e73ee8-0550-4d84-9677-7653693e1ded is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:36:01.999243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Transition to ACTIVE for port object 4f36023c-143c-4389-b26c-f62679404834 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:02.038417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:02.155241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Allocated IP 2001:db8::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/5c305c19-23a9-41fa-8421-7282f02eeb36/1880f170-4805-47c3-bcff-e9930dc3a447) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:02.202122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c8b4a2d-2e19-4167-8510-c09bd13de73a req-8100f400-f004-458f-a32b-f2dec0d21016 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:02.209216 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1c8b4a2d-2e19-4167-8510-c09bd13de73a req-8100f400-f004-458f-a32b-f2dec0d21016 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.5799315 May 12 15:36:02.214261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f4e3659-7f5c-432c-b335-e575d946b204 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:36:02.226114 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8684bb59-929d-42fe-996d-834d62cc6daf None None] Sync routers for ids ['44e73ee8-0550-4d84-9677-7653693e1ded'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:36:02.242213 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8684bb59-929d-42fe-996d-834d62cc6daf None None] Routers {'44e73ee8-0550-4d84-9677-7653693e1ded'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:36:02.243097 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8684bb59-929d-42fe-996d-834d62cc6daf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['44e73ee8-0550-4d84-9677-7653693e1ded'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:02.261226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dc41369-fdbb-4802-af67-d4fe4cf50924 req-1c44d65a-868e-4fe8-a05f-203bd583d410 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:02.267085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dc41369-fdbb-4802-af67-d4fe4cf50924 req-1c44d65a-868e-4fe8-a05f-203bd583d410 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 970 time: 0.5912330 May 12 15:36:02.277132 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f4e3659-7f5c-432c-b335-e575d946b204 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:02.289347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0f4e3659-7f5c-432c-b335-e575d946b204 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "PUT /v2.0/routers/44e73ee8-0550-4d84-9677-7653693e1ded HTTP/1.1" status: 200 len: 697 time: 1.4913564 May 12 15:36:02.291542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57640) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:02.444547 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb62c132-4e79-4013-b9f8-1fa487b7bc3e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:02.497087 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:02.513291 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:02.527431 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-8684bb59-929d-42fe-996d-834d62cc6daf None None] Set router 44e73ee8-0550-4d84-9677-7653693e1ded gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:36:02.528497 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:02.529087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Transition to ACTIVE for port object 1880f170-4805-47c3-bcff-e9930dc3a447 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:02.554338 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Transition to ACTIVE for port object 1880f170-4805-47c3-bcff-e9930dc3a447 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:02.562412 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:02.596443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9f1dd8de-3aad-4341-9ab1-25ae0b7bcc09 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/routers/44e73ee8-0550-4d84-9677-7653693e1ded HTTP/1.1" status: 200 len: 703 time: 0.2978637 May 12 15:36:02.623968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1c8b4a2d-2e19-4167-8510-c09bd13de73a req-c2c93450-e911-4cf2-92b1-86cd2c4b47fe tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4114583 May 12 15:36:02.625006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57646) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:02.638499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Pushing event updated for resources: {'Port': ['ID=1880f170-4805-47c3-bcff-e9930dc3a447,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:02.641093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dc41369-fdbb-4802-af67-d4fe4cf50924 req-b1d39cd0-c4f3-4367-8867-175f52ce8e01 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 0.3466175 May 12 15:36:02.650970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:02.652814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:02.655344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:02.699288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-86a42cbe-c40d-4003-843d-be167ce24159 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Synchronizing usage tracker for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:02.716199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-86a42cbe-c40d-4003-843d-be167ce24159 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Unset dirty status for tenant:85d1374188ec4c0ca79f0d59c0d386b5 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:02.717861 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-86a42cbe-c40d-4003-843d-be167ce24159 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports?device_id=44e73ee8-0550-4d84-9677-7653693e1ded HTTP/1.1" status: 200 len: 205 time: 0.0885289 May 12 15:36:02.720297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57654) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:02.736520 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8684bb59-929d-42fe-996d-834d62cc6daf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '44e73ee8-0550-4d84-9677-7653693e1ded', 'name': 'tempest-RoutersIpV6Test-router-412200390', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:00Z', 'updated_at': '2022-05-12T15:36:01Z', 'revision_number': 2, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:02.753804 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8684bb59-929d-42fe-996d-834d62cc6daf None None] Checking router: 44e73ee8-0550-4d84-9677-7653693e1ded for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:36:02.779001 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8684bb59-929d-42fe-996d-834d62cc6daf None None] Routers {'44e73ee8-0550-4d84-9677-7653693e1ded'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:36:02.780233 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8684bb59-929d-42fe-996d-834d62cc6daf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['44e73ee8-0550-4d84-9677-7653693e1ded'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:02.799471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Attempting to bind port 1880f170-4805-47c3-bcff-e9930dc3a447 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:36:02.799872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Attempting to bind port 1880f170-4805-47c3-bcff-e9930dc3a447 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:36:02.800235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Attempting to bind port 1880f170-4805-47c3-bcff-e9930dc3a447 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:36:02.809410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 35, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:36:02.809890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:02.810354 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:02.810835 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:36:02.811365 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Bound port: 1880f170-4805-47c3-bcff-e9930dc3a447, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:36:02.811801 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:02.870537 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:02.883544 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7081df85-fbe9-4d7f-817c-44307c4474c6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:02.892104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Pushing event updated for resources: {'Port': ['ID=4f36023c-143c-4389-b26c-f62679404834,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:02.922065 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f481956-61ad-4dcf-9adb-b10322222ca0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:02.958214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] For port 1880f170-4805-47c3-bcff-e9930dc3a447, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:36:02.978422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] For port 1880f170-4805-47c3-bcff-e9930dc3a447, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1880f170-4805-47c3-bcff-e9930dc3a447,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:36:02.994673 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:03.116794 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event updated for resources: {'Port': ['ID=44da3c2a-5e90-45e8-8d9f-55abc3c3f372,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:03.137352 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-8684bb59-929d-42fe-996d-834d62cc6daf None None] Set router 44e73ee8-0550-4d84-9677-7653693e1ded gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:36:03.156282 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7081df85-fbe9-4d7f-817c-44307c4474c6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/a52e9b0c-62ba-4801-9090-a7ed0fdac00e HTTP/1.1" status: 204 len: 168 time: 3.0876286 May 12 15:36:03.157296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb62c132-4e79-4013-b9f8-1fa487b7bc3e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:03.158964 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-eb62c132-4e79-4013-b9f8-1fa487b7bc3e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 1.4376247 May 12 15:36:03.159237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57664) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:03.169717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57666) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:03.243658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-696b5fa6-0c60-4585-829f-cb6675b18a6c None None] Pushing event updated for resources: {'Port': ['ID=1880f170-4805-47c3-bcff-e9930dc3a447,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:03.320124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Checking segment: {'id': 'f503f7dc-7fed-4789-b468-7e3c9a3bd2b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '07aedea1-40b5-4fa3-96b2-b70f45608ea4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:03.320512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Network hostable DHCP agents. Network: 07aedea1-40b5-4fa3-96b2-b70f45608ea4, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:36:03.364655 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-44a8608c-6a3b-4407-94cd-57f777261bc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] GET failed (client error): The resource could not be found. May 12 15:36:03.365186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-44a8608c-6a3b-4407-94cd-57f777261bc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:03.377301 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f481956-61ad-4dcf-9adb-b10322222ca0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:03.396931 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f481956-61ad-4dcf-9adb-b10322222ca0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:03.422126 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8684bb59-929d-42fe-996d-834d62cc6daf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '44e73ee8-0550-4d84-9677-7653693e1ded', 'name': 'tempest-RoutersIpV6Test-router-412200390', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:00Z', 'updated_at': '2022-05-12T15:36:01Z', 'revision_number': 2, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:03.427174 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8684bb59-929d-42fe-996d-834d62cc6daf None None] The sync data for ids ['44e73ee8-0550-4d84-9677-7653693e1ded'] in n-d-841483-1 is: [{'id': '44e73ee8-0550-4d84-9677-7653693e1ded', 'name': 'tempest-RoutersIpV6Test-router-412200390', 'tenant_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:00Z', 'updated_at': '2022-05-12T15:36:01Z', 'revision_number': 2, 'project_id': '85d1374188ec4c0ca79f0d59c0d386b5', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:36:03.444711 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f481956-61ad-4dcf-9adb-b10322222ca0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:03.445554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f481956-61ad-4dcf-9adb-b10322222ca0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Fanout notify agent at l3_agent the message router_deleted on router 44e73ee8-0550-4d84-9677-7653693e1ded {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:36:03.474433 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2f481956-61ad-4dcf-9adb-b10322222ca0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:03.485899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57676) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:03.487426 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2f481956-61ad-4dcf-9adb-b10322222ca0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/routers/44e73ee8-0550-4d84-9677-7653693e1ded HTTP/1.1" status: 204 len: 168 time: 0.7653003 May 12 15:36:03.492779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-44a8608c-6a3b-4407-94cd-57f777261bc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:03.497076 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-44a8608c-6a3b-4407-94cd-57f777261bc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/a52e9b0c-62ba-4801-9090-a7ed0fdac00e HTTP/1.1" status: 404 len: 333 time: 0.3261721 May 12 15:36:03.497076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Attempting to bind port 4f36023c-143c-4389-b26c-f62679404834 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:36:03.497076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Attempting to bind port 4f36023c-143c-4389-b26c-f62679404834 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '4dc52732-5577-45b0-b2eb-1c2616cc1c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:36:03.497076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Attempting to bind port 4f36023c-143c-4389-b26c-f62679404834 on network d2e823c6-8acb-45b9-910c-0a4822a68f25 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:36:03.497572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57680) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:03.630876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Port 4f36023c-143c-4389-b26c-f62679404834 on network d2e823c6-8acb-45b9-910c-0a4822a68f25 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:36:03.631414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Attempting to bind port 4f36023c-143c-4389-b26c-f62679404834 on network d2e823c6-8acb-45b9-910c-0a4822a68f25 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:36:03.633870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-6f0c1040-99f5-4383-b3af-029ceb375879 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 442670c2-6aa6-45ec-9804-8e1a8d084879 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:03.634153 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f0c1040-99f5-4383-b3af-029ceb375879 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:03.724136 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-abfd0143-aeba-4e25-b61c-749f4f214c44 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports?device_id=44e73ee8-0550-4d84-9677-7653693e1ded HTTP/1.1" status: 200 len: 205 time: 0.2342901 May 12 15:36:03.724136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Network 07aedea1-40b5-4fa3-96b2-b70f45608ea4 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:36:03.730878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57690) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:03.745738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 35, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:36:03.746575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Checking segment: {'id': '4dc52732-5577-45b0-b2eb-1c2616cc1c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:03.746982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Bound using segment: {'id': '4dc52732-5577-45b0-b2eb-1c2616cc1c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:36:03.747495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Bound port: 4f36023c-143c-4389-b26c-f62679404834, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4dc52732-5577-45b0-b2eb-1c2616cc1c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:36:03.747877 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:03.781809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 07aedea1-40b5-4fa3-96b2-b70f45608ea4) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:03.794245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f26b3c0-72e7-462f-81b7-9cc1e99f3314 None None] Network 07aedea1-40b5-4fa3-96b2-b70f45608ea4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:03.897177 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-275794ce-3bc9-4113-b475-d587cd861898 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] delete failed (client error): The resource could not be found. May 12 15:36:03.898231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-275794ce-3bc9-4113-b475-d587cd861898 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/routers/44e73ee8-0550-4d84-9677-7653693e1ded HTTP/1.1" status: 404 len: 336 time: 0.1666324 May 12 15:36:03.903798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57696) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:03.926151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:03.927612 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:04.131169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event updated for resources: {'Port': ['ID=7db3150a-0290-4153-9dc4-b297785438dd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:04.185347 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-581f1ec2-e231-4605-9f5d-1cfa3fe0f295 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] DELETE failed (client error): The resource could not be found. May 12 15:36:04.185887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-581f1ec2-e231-4605-9f5d-1cfa3fe0f295 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:36:04.190119 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-581f1ec2-e231-4605-9f5d-1cfa3fe0f295 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/591a1588-10d4-4137-bac1-05a7d387578c HTTP/1.1" status: 404 len: 337 time: 0.2808270 May 12 15:36:04.198113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57702) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:04.203632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] For port 4f36023c-143c-4389-b26c-f62679404834, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:36:04.262312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] For port 4f36023c-143c-4389-b26c-f62679404834, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4f36023c-143c-4389-b26c-f62679404834,segment=NetworkSegment(4dc52732-5577-45b0-b2eb-1c2616cc1c73),segment_id=4dc52732-5577-45b0-b2eb-1c2616cc1c73)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:36:04.289164 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-28a2051c-22be-4ef4-a814-8626c50e0a8f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] DELETE failed (client error): The resource could not be found. May 12 15:36:04.297605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-28a2051c-22be-4ef4-a814-8626c50e0a8f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:36:04.299472 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-28a2051c-22be-4ef4-a814-8626c50e0a8f tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/75c05fee-160a-4d02-9aba-8ce92e1777d1 HTTP/1.1" status: 404 len: 337 time: 0.0977404 May 12 15:36:04.302094 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57708) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:04.306254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Checking segment: {'id': '9289b646-008e-43b9-b231-accffffb244a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 580, 'network_id': '0bf56a0b-375f-40f3-a343-779ce0926402'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:04.307179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Network hostable DHCP agents. Network: 0bf56a0b-375f-40f3-a343-779ce0926402, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:36:04.312107 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:04.435618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b021efb-8a71-4e3c-8764-a9bdebc79bf2 req-e558e663-df88-4293-aae3-122db3871b24 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:04.437181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b021efb-8a71-4e3c-8764-a9bdebc79bf2 req-e558e663-df88-4293-aae3-122db3871b24 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 982 time: 0.5262694 May 12 15:36:04.449299 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-a54679ad-4035-4099-b11b-8490b47f4559 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] DELETE failed (client error): The resource could not be found. May 12 15:36:04.449799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a54679ad-4035-4099-b11b-8490b47f4559 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:36:04.451593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a54679ad-4035-4099-b11b-8490b47f4559 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/806356d2-2805-4b3e-b8c9-31e26512edbe HTTP/1.1" status: 404 len: 337 time: 0.1484871 May 12 15:36:04.457162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57714) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:04.540272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b73d5b25-6947-4395-8d4c-2582e454b36f req-94821093-7486-48c4-81dd-edc9062a3682 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:04.543483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b73d5b25-6947-4395-8d4c-2582e454b36f req-94821093-7486-48c4-81dd-edc9062a3682 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.6407890 May 12 15:36:04.556211 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-c6e748df-ff23-4b80-8075-7e209b5f72fb tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] DELETE failed (client error): The resource could not be found. May 12 15:36:04.556943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c6e748df-ff23-4b80-8075-7e209b5f72fb tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:36:04.558900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c6e748df-ff23-4b80-8075-7e209b5f72fb tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/88b72322-9e80-4b80-a94e-362cee47e638 HTTP/1.1" status: 404 len: 337 time: 0.0965703 May 12 15:36:04.574759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57718) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:04.694957 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a0920f67-d689-4049-9300-265b058c1da4 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports?device_id=397feb9b-2f46-4c79-af57-634897d5df53 HTTP/1.1" status: 200 len: 205 time: 0.1154623 May 12 15:36:04.696132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:04.696751 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:04.702210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57726) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:04.702504 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] 10.222.0.84 "PUT /v2.0/ports/4f36023c-143c-4389-b26c-f62679404834 HTTP/1.1" status: 200 len: 1130 time: 4.8049431 May 12 15:36:04.710331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b021efb-8a71-4e3c-8764-a9bdebc79bf2 req-d4dd21e4-d06b-4421-af36-7ee8ca67786f tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 0.2628028 May 12 15:36:04.712145 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f0c1040-99f5-4383-b3af-029ceb375879 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:04.720688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'tag': '4f36023c-143c-4389-b26c-f62679404834'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:36:04.740632 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:04.904738 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b73d5b25-6947-4395-8d4c-2582e454b36f req-5d6b4c70-1842-44c9-b181-ede03f3dd514 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3334889 May 12 15:36:04.905841 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-f316f827-8e7c-4ec2-9759-c22d0dd43c6d tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] delete failed (client error): The resource could not be found. May 12 15:36:04.906971 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f316f827-8e7c-4ec2-9759-c22d0dd43c6d tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/routers/397feb9b-2f46-4c79-af57-634897d5df53 HTTP/1.1" status: 404 len: 336 time: 0.2018042 May 12 15:36:04.999581 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57736) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:05.031611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-124ebae6-6e93-43e0-b82f-59f8b85afbb3 None None] Provisioning for port 1880f170-4805-47c3-bcff-e9930dc3a447 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:05.063513 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fe95e1c3-970c-471d-ba39-e36306af5884'] response: {'name': 'network-changed', 'server_uuid': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'tag': '4f36023c-143c-4389-b26c-f62679404834', 'status': 'completed', 'code': 200} May 12 15:36:05.074717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Network 0bf56a0b-375f-40f3-a343-779ce0926402 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:36:05.078794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-6f0c1040-99f5-4383-b3af-029ceb375879 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for 442670c2-6aa6-45ec-9804-8e1a8d084879 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:05.126041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac93f8bc-a6ee-423c-87cd-1a33ce5315cf service neutron] Pushing event updated for resources: {'Port': ['ID=4f36023c-143c-4389-b26c-f62679404834,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:05.130056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 0bf56a0b-375f-40f3-a343-779ce0926402) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:05.137526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9737409f-e46a-45ca-919d-2c9f931adab0 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports?device_id=94c42552-82c0-49c4-9e45-790a32188889 HTTP/1.1" status: 200 len: 205 time: 0.1360490 May 12 15:36:05.140923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57744) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:05.144567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:05.148275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e36f66ea-2dd8-453a-a1bd-a02f0a359089 None None] Network 0bf56a0b-375f-40f3-a343-779ce0926402 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:05.151718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:05.156879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:05.157844 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:05.224303 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d3963aa2-b91e-4979-85b7-443becfa2afe tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1450 time: 5.6051176 May 12 15:36:05.230821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57750) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:05.282455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-1c2bda75-7bd5-4b92-ad58-79c4fffe7217 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:05.283964 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-1c2bda75-7bd5-4b92-ad58-79c4fffe7217 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3dd1fe8ad774471ba7745219a37ead53&device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 1133 time: 0.2776613 May 12 15:36:05.341946 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-33494d36-b59e-4d8f-b084-da850a71b353 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] delete failed (client error): The resource could not be found. May 12 15:36:05.343207 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-33494d36-b59e-4d8f-b084-da850a71b353 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/routers/94c42552-82c0-49c4-9e45-790a32188889 HTTP/1.1" status: 404 len: 336 time: 0.2015498 May 12 15:36:05.454635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57754) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:05.480186 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-76a323f9-7b69-44f4-9d4c-fe6951d9817a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4f36023c-143c-4389-b26c-f62679404834 HTTP/1.1" status: 200 len: 217 time: 0.1481869 May 12 15:36:05.517308 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f0c1040-99f5-4383-b3af-029ceb375879 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:05.525526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1880f170-4805-47c3-bcff-e9930dc3a447 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:05.569574 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-6395f9b8-76b4-4795-bd51-70c3a32e951b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] DELETE failed (client error): The resource could not be found. May 12 15:36:05.570035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6395f9b8-76b4-4795-bd51-70c3a32e951b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:36:05.571709 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6395f9b8-76b4-4795-bd51-70c3a32e951b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/9380d3b7-d25f-4284-acd3-794270f1b2b2 HTTP/1.1" status: 404 len: 337 time: 0.1091411 May 12 15:36:05.579170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57764) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:05.583286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f0c1040-99f5-4383-b3af-029ceb375879 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=442670c2-6aa6-45ec-9804-8e1a8d084879,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:05.617453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::1 (2447b094-d5d6-41ef-a146-2bf56f5399af/5c305c19-23a9-41fa-8421-7282f02eeb36/09d836f9-d0f0-4dab-8f03-5a47988d2299) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:05.640762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-e6a924e1-106a-4979-a925-2710e654e4e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:05.642486 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-e6a924e1-106a-4979-a925-2710e654e4e7 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=27cd1f2e-8b9d-4298-a44b-ce82945125a8 HTTP/1.1" status: 200 len: 835 time: 0.1271057 May 12 15:36:05.649716 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 1880f170-4805-47c3-bcff-e9930dc3a447 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:05.655959 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 1880f170-4805-47c3-bcff-e9930dc3a447 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:05.656247 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:05.682341 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ca78ce4b-51e4-41a7-8ab4-04817c93a25c tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports?device_id=7adb0a20-4c13-492f-8b5c-b427ee991590 HTTP/1.1" status: 200 len: 205 time: 0.0958717 May 12 15:36:05.697311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b0f96c7-2a9c-41d8-86dc-11c8022f519c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:05.704324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b0f96c7-2a9c-41d8-86dc-11c8022f519c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:05.716824 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6b0f96c7-2a9c-41d8-86dc-11c8022f519c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1445 time: 0.4674416 May 12 15:36:05.717650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57768) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:05.748472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57772) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:05.832945 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:05.898080 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f0c1040-99f5-4383-b3af-029ceb375879 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:05.922465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 1880f170-4805-47c3-bcff-e9930dc3a447, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1880f170-4805-47c3-bcff-e9930dc3a447,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:05.927767 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:05.941169 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-74bb3507-9a2f-4a39-bda7-357f535000c5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] delete failed (client error): The resource could not be found. May 12 15:36:05.944590 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-74bb3507-9a2f-4a39-bda7-357f535000c5 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/routers/7adb0a20-4c13-492f-8b5c-b427ee991590 HTTP/1.1" status: 404 len: 336 time: 0.2268403 May 12 15:36:05.950513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57784) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:05.970881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6f0c1040-99f5-4383-b3af-029ceb375879 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/442670c2-6aa6-45ec-9804-8e1a8d084879 HTTP/1.1" status: 204 len: 168 time: 2.4711771 May 12 15:36:06.013542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57790) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:06.024815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-8d4decdc-34be-4924-955a-8f4f613788e8 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Deleting port 44da3c2a-5e90-45e8-8d9f-55abc3c3f372 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:06.025140 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d4decdc-34be-4924-955a-8f4f613788e8 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:06.037157 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0379da2c-488a-4234-95ba-2b7de639a052 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports?device_id=899dcff7-c864-40db-8609-e4f6d07ba323 HTTP/1.1" status: 200 len: 205 time: 0.0847750 May 12 15:36:06.042417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=1880f170-4805-47c3-bcff-e9930dc3a447,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:06.057844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57794) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:06.163091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-e5f48fc7-2ab9-4f0a-a4ba-7d6f5748d377 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:06.164702 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-e5f48fc7-2ab9-4f0a-a4ba-7d6f5748d377 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d2e823c6-8acb-45b9-910c-0a4822a68f25&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5042078 May 12 15:36:06.165919 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-c7d69614-ed9c-4fe0-a197-5f15f768e89b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] delete failed (client error): The resource could not be found. May 12 15:36:06.167483 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c7d69614-ed9c-4fe0-a197-5f15f768e89b tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/routers/899dcff7-c864-40db-8609-e4f6d07ba323 HTTP/1.1" status: 404 len: 336 time: 0.1074774 May 12 15:36:06.171023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57800) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:06.183538 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-3dceca04-f5c6-4937-9930-e0a8b8799972 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] GET failed (client error): The resource could not be found. May 12 15:36:06.184063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3dceca04-f5c6-4937-9930-e0a8b8799972 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:06.248406 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-417e76af-f670-4774-abc5-b8b61ec9e3d9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] DELETE failed (client error): The resource could not be found. May 12 15:36:06.248899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-417e76af-f670-4774-abc5-b8b61ec9e3d9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:36:06.251205 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-417e76af-f670-4774-abc5-b8b61ec9e3d9 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/72723c37-b245-4008-9464-488728e67f28 HTTP/1.1" status: 404 len: 337 time: 0.0789976 May 12 15:36:06.257334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57806) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:06.311189 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:06.379500 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c226d554-1d1c-436d-9aef-630aec23e172 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports?device_id=0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f HTTP/1.1" status: 200 len: 205 time: 0.0718880 May 12 15:36:06.387018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57812) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:06.426077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3dceca04-f5c6-4937-9930-e0a8b8799972 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:06.429878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3dceca04-f5c6-4937-9930-e0a8b8799972 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/442670c2-6aa6-45ec-9804-8e1a8d084879 HTTP/1.1" status: 404 len: 333 time: 0.4127119 May 12 15:36:06.444116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57816) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:06.453164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object 09d836f9-d0f0-4dab-8f03-5a47988d2299 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:06.462435 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fdce377-1568-47ce-a072-117992e108f4 req-3f5ca6c6-36ee-47ff-b6b7-59dc7e1be2b0 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:06.464307 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2fdce377-1568-47ce-a072-117992e108f4 req-3f5ca6c6-36ee-47ff-b6b7-59dc7e1be2b0 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 982 time: 0.5047677 May 12 15:36:06.489279 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-e46e3a87-115d-4460-bb1f-2dd8e3ff0cbc tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] delete failed (client error): The resource could not be found. May 12 15:36:06.492770 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e46e3a87-115d-4460-bb1f-2dd8e3ff0cbc tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/routers/0dba28e0-b2c9-45c5-88c4-f4fa11a4d45f HTTP/1.1" status: 404 len: 336 time: 0.1008415 May 12 15:36:06.494525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57822) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:06.565995 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-5f46c528-3b71-4897-9bf2-1e13d8f554e0 service neutron] 10.222.0.84 "GET /v2.0/networks/d2e823c6-8acb-45b9-910c-0a4822a68f25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3569286 May 12 15:36:06.572066 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-c42cadff-89f3-40ae-83c5-1b075847673d tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] DELETE failed (client error): The resource could not be found. May 12 15:36:06.572066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c42cadff-89f3-40ae-83c5-1b075847673d tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:36:06.576581 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c42cadff-89f3-40ae-83c5-1b075847673d tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/61ef0890-0de1-422e-8893-8072b324254e HTTP/1.1" status: 404 len: 337 time: 0.0666175 May 12 15:36:06.622455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57828) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:06.737352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de5b6c55-bdee-4a55-a025-67d1dd122471 req-5d3321a7-aaab-4b98-918c-bfe8d0d6c46b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:06.739959 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de5b6c55-bdee-4a55-a025-67d1dd122471 req-5d3321a7-aaab-4b98-918c-bfe8d0d6c46b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.6230679 May 12 15:36:06.743383 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-add79ae6-f645-4853-a80c-75a7469ee75e tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "GET /v2.0/ports?device_id=e4bb4ff8-e436-42c7-96f8-56f195f2e452 HTTP/1.1" status: 200 len: 205 time: 0.1119430 May 12 15:36:06.748600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-09f8ebc9-bd0d-469e-b06e-8937dc2980ff tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting subnet 82849bea-971a-4272-8f77-327862d7f6e7 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:36:06.749219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57834) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:06.764949 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09f8ebc9-bd0d-469e-b06e-8937dc2980ff tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:06.845038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2fdce377-1568-47ce-a072-117992e108f4 req-d7612cd1-8db9-47dd-8346-63364f4fd69a tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 0.3424251 May 12 15:36:06.851242 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d4decdc-34be-4924-955a-8f4f613788e8 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:06.887888 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-ca7ec99e-ef17-4545-bfa1-e516b6ccb510 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] delete failed (client error): The resource could not be found. May 12 15:36:06.888999 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ca7ec99e-ef17-4545-bfa1-e516b6ccb510 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/routers/e4bb4ff8-e436-42c7-96f8-56f195f2e452 HTTP/1.1" status: 404 len: 336 time: 0.1373758 May 12 15:36:06.899437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57840) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:06.947810 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:06.999257 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-e162818d-1603-4992-b2c7-375c2ed7ae09 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] DELETE failed (client error): The resource could not be found. May 12 15:36:06.999758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e162818d-1603-4992-b2c7-375c2ed7ae09 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:36:07.001634 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e162818d-1603-4992-b2c7-375c2ed7ae09 tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/b76f650a-c71f-4cfb-8501-a64b78974ec4 HTTP/1.1" status: 404 len: 337 time: 0.1006563 May 12 15:36:07.006595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57846) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:07.051210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-8d4decdc-34be-4924-955a-8f4f613788e8 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Calling delete_port for 44da3c2a-5e90-45e8-8d9f-55abc3c3f372 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:07.052139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:07.057402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:07.070251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:07.070812 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:07.079678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=09d836f9-d0f0-4dab-8f03-5a47988d2299,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:07.098378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09f8ebc9-bd0d-469e-b06e-8937dc2980ff tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:07.098760 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5410a3f0-89eb-4e1c-a682-fbe8a69e1d22 req-aead3513-bd3f-419d-8317-fada2b44c2b9 service neutron] 10.222.0.84 "GET /v2.0/networks/d2e823c6-8acb-45b9-910c-0a4822a68f25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5220270 May 12 15:36:07.160019 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-46eaa0d8-d310-43e9-afa8-1cd7e38c3cdf tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] DELETE failed (client error): The resource could not be found. May 12 15:36:07.160686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-46eaa0d8-d310-43e9-afa8-1cd7e38c3cdf tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:36:07.162600 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-46eaa0d8-d310-43e9-afa8-1cd7e38c3cdf tempest-RoutersIpV6Test-1391345248 tempest-RoutersIpV6Test-1391345248-project] 10.222.0.82 "DELETE /v2.0/subnets/32aa3dbd-054f-4286-81a6-5b1d7f70d6c2 HTTP/1.1" status: 404 len: 337 time: 0.1531246 May 12 15:36:07.175757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de5b6c55-bdee-4a55-a025-67d1dd122471 req-6a2e5da6-5c53-49f4-ba0c-5d265d6d70ea tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4239581 May 12 15:36:07.266428 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d4decdc-34be-4924-955a-8f4f613788e8 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:07.297621 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:07.351000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d4decdc-34be-4924-955a-8f4f613788e8 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event deleted for resources: {'Port': ['ID=44da3c2a-5e90-45e8-8d9f-55abc3c3f372,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:07.355610 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d4decdc-34be-4924-955a-8f4f613788e8 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:07.366569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8d4decdc-34be-4924-955a-8f4f613788e8 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "DELETE /v2.0/ports/44da3c2a-5e90-45e8-8d9f-55abc3c3f372 HTTP/1.1" status: 204 len: 168 time: 1.6138792 May 12 15:36:07.368272 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09f8ebc9-bd0d-469e-b06e-8937dc2980ff tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:07.387948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1880f170-4805-47c3-bcff-e9930dc3a447 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:07.393920 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57860) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:07.535094 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09f8ebc9-bd0d-469e-b06e-8937dc2980ff tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:07.552259 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 1880f170-4805-47c3-bcff-e9930dc3a447 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:07.552663 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:07.596025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09f8ebc9-bd0d-469e-b06e-8937dc2980ff tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Subnet': ['ID=82849bea-971a-4272-8f77-327862d7f6e7,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:07.614308 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09f8ebc9-bd0d-469e-b06e-8937dc2980ff tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:07.622190 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-09f8ebc9-bd0d-469e-b06e-8937dc2980ff tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/82849bea-971a-4272-8f77-327862d7f6e7 HTTP/1.1" status: 204 len: 168 time: 1.1761277 May 12 15:36:07.624876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57870) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:07.647675 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d4629d4-05ea-4f0e-b001-592699dda19c None None] Network b00b93ef-24cf-488b-80ad-16ea8a5cd226 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:07.669671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c531aa92-c1fc-4231-ad8b-b69cb82444be tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Deleting port 7db3150a-0290-4153-9dc4-b297785438dd {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:07.670205 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c531aa92-c1fc-4231-ad8b-b69cb82444be tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:07.697808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-68f39f9f-7b48-4505-a3e7-ede395520e6d None None] Provisioning for port 09d836f9-d0f0-4dab-8f03-5a47988d2299 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:07.769161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57874) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:07.781914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae82d124-abc7-4b06-8329-a0c0c261e08a req-7a737446-e7ad-4b5b-9853-ac04b9a5ab4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:07.783455 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae82d124-abc7-4b06-8329-a0c0c261e08a req-7a737446-e7ad-4b5b-9853-ac04b9a5ab4f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3dd1fe8ad774471ba7745219a37ead53&device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 1133 time: 0.5666554 May 12 15:36:07.787225 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:07.788418 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-68f39f9f-7b48-4505-a3e7-ede395520e6d None None] Provisioning complete for port 09d836f9-d0f0-4dab-8f03-5a47988d2299 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:07.788904 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-68f39f9f-7b48-4505-a3e7-ede395520e6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:07.801583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 89b265da-de0b-4bda-a79e-78aaa9aee5a8 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:07.801583 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:07.963751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-68f39f9f-7b48-4505-a3e7-ede395520e6d None None] Port 09d836f9-d0f0-4dab-8f03-5a47988d2299 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:36:08.210015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e0310de-9755-45ad-8147-e8541b627da7 None None] DHCP port deletion for b00b93ef-24cf-488b-80ad-16ea8a5cd226 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:36:08.211478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae82d124-abc7-4b06-8329-a0c0c261e08a req-38d02517-674b-4087-a6b0-f463a18521f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:08.213220 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae82d124-abc7-4b06-8329-a0c0c261e08a req-38d02517-674b-4087-a6b0-f463a18521f6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=d2e823c6-8acb-45b9-910c-0a4822a68f25 HTTP/1.1" status: 200 len: 897 time: 0.3916037 May 12 15:36:08.215308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e0310de-9755-45ad-8147-e8541b627da7 None None] Deleting port 89b265da-de0b-4bda-a79e-78aaa9aee5a8 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:08.215661 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e0310de-9755-45ad-8147-e8541b627da7 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:08.337415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] For port 89b265da-de0b-4bda-a79e-78aaa9aee5a8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=89b265da-de0b-4bda-a79e-78aaa9aee5a8,segment=NetworkSegment(5723a35b-442b-4ca0-9923-4423d1ff636d),segment_id=5723a35b-442b-4ca0-9923-4423d1ff636d)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:08.348828 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:08.377160 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae82d124-abc7-4b06-8329-a0c0c261e08a req-5ef09835-9496-4ad3-8cfd-58ff85b8668b service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4f36023c-143c-4389-b26c-f62679404834 HTTP/1.1" status: 200 len: 217 time: 0.1062589 May 12 15:36:08.571370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for 89b265da-de0b-4bda-a79e-78aaa9aee5a8 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:08.587755 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e0310de-9755-45ad-8147-e8541b627da7 None None] For port 89b265da-de0b-4bda-a79e-78aaa9aee5a8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=89b265da-de0b-4bda-a79e-78aaa9aee5a8,segment=NetworkSegment(5723a35b-442b-4ca0-9923-4423d1ff636d),segment_id=5723a35b-442b-4ca0-9923-4423d1ff636d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:08.588398 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e0310de-9755-45ad-8147-e8541b627da7 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:08.647205 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c531aa92-c1fc-4231-ad8b-b69cb82444be tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:08.709063 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ca834a95-6b9a-4454-be19-d8a918046353 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=85d1374188ec4c0ca79f0d59c0d386b5&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9301505 May 12 15:36:08.720419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57902) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:08.779144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e0310de-9755-45ad-8147-e8541b627da7 None None] Calling delete_port for 89b265da-de0b-4bda-a79e-78aaa9aee5a8 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:08.797074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e331b400-ea33-419d-adbb-b2a4b964dc68 req-6b2c432c-207f-4bb6-b715-9ab4d00e9652 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:08.803757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e331b400-ea33-419d-adbb-b2a4b964dc68 req-6b2c432c-207f-4bb6-b715-9ab4d00e9652 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 982 time: 0.6538241 May 12 15:36:08.877766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c531aa92-c1fc-4231-ad8b-b69cb82444be tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Calling delete_port for 7db3150a-0290-4153-9dc4-b297785438dd owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:08.892841 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e0310de-9755-45ad-8147-e8541b627da7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:08.902160 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e331b400-ea33-419d-adbb-b2a4b964dc68 req-41b73239-3983-454b-b0b3-9d1d77ff8aea tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 0.0973194 May 12 15:36:08.930031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992e25a2-5d1b-4ada-9db3-dabd582a3b6e req-8e824d03-77c1-42f5-9a26-ab63d6038503 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:08.938175 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-992e25a2-5d1b-4ada-9db3-dabd582a3b6e req-8e824d03-77c1-42f5-9a26-ab63d6038503 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.5758085 May 12 15:36:08.957018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e0310de-9755-45ad-8147-e8541b627da7 None None] Pushing event deleted for resources: {'Port': ['ID=89b265da-de0b-4bda-a79e-78aaa9aee5a8,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:08.959143 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e0310de-9755-45ad-8147-e8541b627da7 None None] No DVR routers for this DVR port 89b265da-de0b-4bda-a79e-78aaa9aee5a8 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:36:08.962732 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:36:08.963280 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:36:08.988934 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-992e25a2-5d1b-4ada-9db3-dabd582a3b6e req-55238ef9-39ce-436f-9013-63fca59e2f58 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495253 May 12 15:36:08.998073 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae82d124-abc7-4b06-8329-a0c0c261e08a req-6f016f21-0176-415b-bf76-2d0001b6df33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:08.999598 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae82d124-abc7-4b06-8329-a0c0c261e08a req-6f016f21-0176-415b-bf76-2d0001b6df33 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=27cd1f2e-8b9d-4298-a44b-ce82945125a8 HTTP/1.1" status: 200 len: 835 time: 0.5960748 May 12 15:36:09.069265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.099621 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.100356 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.198943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4f36023c-143c-4389-b26c-f62679404834 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:36:09.218130 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c531aa92-c1fc-4231-ad8b-b69cb82444be tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.221004 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6ca8cb7-3da5-493c-8a8f-269e00a0ee14 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.298366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0737e4-6444-4afa-b6fc-695126cceecc req-5baa482c-b630-40fd-a520-8599dc3abbca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:09.299756 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ff0737e4-6444-4afa-b6fc-695126cceecc req-5baa482c-b630-40fd-a520-8599dc3abbca service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 1096 time: 0.6385791 May 12 15:36:09.348908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=09d836f9-d0f0-4dab-8f03-5a47988d2299,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:09.361092 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c531aa92-c1fc-4231-ad8b-b69cb82444be tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.363805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 89b265da-de0b-4bda-a79e-78aaa9aee5a8 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:36:09.400860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 89b265da-de0b-4bda-a79e-78aaa9aee5a8 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:36:09.401189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 89b265da-de0b-4bda-a79e-78aaa9aee5a8 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:36:09.416700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6ca8cb7-3da5-493c-8a8f-269e00a0ee14 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.445352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c531aa92-c1fc-4231-ad8b-b69cb82444be tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event deleted for resources: {'Port': ['ID=7db3150a-0290-4153-9dc4-b297785438dd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:09.460923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4f36023c-143c-4389-b26c-f62679404834, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4f36023c-143c-4389-b26c-f62679404834,segment=NetworkSegment(4dc52732-5577-45b0-b2eb-1c2616cc1c73),segment_id=4dc52732-5577-45b0-b2eb-1c2616cc1c73)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:09.464521 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c531aa92-c1fc-4231-ad8b-b69cb82444be tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "DELETE /v2.0/ports/7db3150a-0290-4153-9dc4-b297785438dd HTTP/1.1" status: 204 len: 168 time: 2.0643268 May 12 15:36:09.464655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 89b265da-de0b-4bda-a79e-78aaa9aee5a8 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:09.464798 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.475974 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '4f36023c-143c-4389-b26c-f62679404834', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'port_id': '4f36023c-143c-4389-b26c-f62679404834', 'mac_address': 'fa:16:3e:86:a3:11', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 551, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:36:09.479216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57920) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:09.541902 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ff0737e4-6444-4afa-b6fc-695126cceecc req-24bbb796-31bb-4851-8527-97b70e2f1f9f service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2245328 May 12 15:36:09.546782 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.562735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] The port '89b265da-de0b-4bda-a79e-78aaa9aee5a8' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:36:09.564703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae82d124-abc7-4b06-8329-a0c0c261e08a req-c2eebeff-3d63-49dd-9a13-bf7e73c63618 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:09.566234 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae82d124-abc7-4b06-8329-a0c0c261e08a req-c2eebeff-3d63-49dd-9a13-bf7e73c63618 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d2e823c6-8acb-45b9-910c-0a4822a68f25&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5337415 May 12 15:36:09.569061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4f36023c-143c-4389-b26c-f62679404834 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:36:09.577548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d8c56668-df3e-4d73-b2c1-3f8c2404b09c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Synchronizing usage tracker for tenant:09e0c5fd5fce41bf91599658e3eed992 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:09.588648 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4f36023c-143c-4389-b26c-f62679404834, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4f36023c-143c-4389-b26c-f62679404834,segment=NetworkSegment(4dc52732-5577-45b0-b2eb-1c2616cc1c73),segment_id=4dc52732-5577-45b0-b2eb-1c2616cc1c73)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:09.594867 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.617415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:09.675559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:09.685895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4f36023c-143c-4389-b26c-f62679404834,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:09.745056 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.763701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d8c56668-df3e-4d73-b2c1-3f8c2404b09c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Unset dirty status for tenant:09e0c5fd5fce41bf91599658e3eed992 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:09.768943 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d8c56668-df3e-4d73-b2c1-3f8c2404b09c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.2840447 May 12 15:36:09.769241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57930) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:09.780795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1406137378'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:09.785681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b00b93ef-24cf-488b-80ad-16ea8a5cd226']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:09.797914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:09.803941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5723a35b-442b-4ca0-9923-4423d1ff636d') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:09.804477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5723a35b-442b-4ca0-9923-4423d1ff636d') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:09.812729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Usage tracker for resource:network and tenant:09e0c5fd5fce41bf91599658e3eed992 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:09.819302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:09.828000 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.835251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:09.852041 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.860692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Made reservation on behalf of 09e0c5fd5fce41bf91599658e3eed992 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:09.864668 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.881439 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6ca8cb7-3da5-493c-8a8f-269e00a0ee14 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.882692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Releasing vlan 599 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:36:09.883099 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: timer() May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:36:09.906929 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:36:09.924786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6ca8cb7-3da5-493c-8a8f-269e00a0ee14 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=41c3009a-3470-458d-8287-e9972621d80c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:09.979362 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae82d124-abc7-4b06-8329-a0c0c261e08a req-7d9bb1ab-8d3e-4969-9476-6b5d3509814c service neutron] 10.222.0.84 "GET /v2.0/networks/d2e823c6-8acb-45b9-910c-0a4822a68f25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3945966 May 12 15:36:09.982892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 586} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:36:09.983184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6ca8cb7-3da5-493c-8a8f-269e00a0ee14 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:09.984435 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b6ca8cb7-3da5-493c-8a8f-269e00a0ee14 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/41c3009a-3470-458d-8287-e9972621d80c HTTP/1.1" status: 204 len: 168 time: 1.2520289 May 12 15:36:09.990483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['4f36023c-143c-4389-b26c-f62679404834'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:36:10.027033 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:10.027384 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Added segment 15501122-880e-4aaf-a64f-8d7d43dbbe2f of type vlan for network fd19b8f0-fdcc-4650-99ab-6c20e6c2786f May 12 15:36:10.164383 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:10.179061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:10.219929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ef2741b-fadb-4782-9dcb-84553fb1cbbc None None] Provisioning complete for port 09d836f9-d0f0-4dab-8f03-5a47988d2299 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:10.220544 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ef2741b-fadb-4782-9dcb-84553fb1cbbc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:10.236455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Router 8b8e7749-e111-476a-884f-1e4731548b2a is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:36:10.242572 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae82d124-abc7-4b06-8329-a0c0c261e08a req-9fbd3eba-6310-4134-b085-7ce537eefc76 service neutron] 10.222.0.84 "GET /v2.0/networks/d2e823c6-8acb-45b9-910c-0a4822a68f25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2553213 May 12 15:36:10.316682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Network': ['ID=b00b93ef-24cf-488b-80ad-16ea8a5cd226,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:10.319776 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9ef2741b-fadb-4782-9dcb-84553fb1cbbc None None] Port 09d836f9-d0f0-4dab-8f03-5a47988d2299 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:36:10.323167 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:10.453985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ae72b6b2-07ee-4759-a6a1-760bd5c7543b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/networks/b00b93ef-24cf-488b-80ad-16ea8a5cd226 HTTP/1.1" status: 204 len: 168 time: 2.8274441 May 12 15:36:10.481297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57946) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:10.499686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1713395049'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:10.510659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:10.521965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:network and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:10.527680 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:10.535166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:10.536258 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:10.559346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:10.681846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:36:10.689827 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-490e68f1-31eb-4e9e-a24d-a7efda6269a6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "PUT /v2.0/routers/8b8e7749-e111-476a-884f-1e4731548b2a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.5093205 May 12 15:36:10.693730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Sync routers for ids ['8b8e7749-e111-476a-884f-1e4731548b2a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:36:10.709111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57954) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:10.717664 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Routers {'8b8e7749-e111-476a-884f-1e4731548b2a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:36:10.727861 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8b8e7749-e111-476a-884f-1e4731548b2a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:10.752763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:10.768514 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.9955807 May 12 15:36:10.794087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57962) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:10.815084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-efb5a2df-4d35-4929-805f-52c93374db97 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:10.815693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-efb5a2df-4d35-4929-805f-52c93374db97 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:10.826684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7d930f8-3d3f-4af2-bf8f-327e765a4116 req-9a039f24-436c-457a-b3ee-63dc95ea1571 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:10.835754 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7d930f8-3d3f-4af2-bf8f-327e765a4116 req-9a039f24-436c-457a-b3ee-63dc95ea1571 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.5230737 May 12 15:36:10.841970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-140648168'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:10.861761 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae64923-e700-4766-8a31-befb3523010e req-ae98a3d9-3652-4c60-86a3-73124f4df8d6 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:10.863645 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae64923-e700-4766-8a31-befb3523010e req-ae98a3d9-3652-4c60-86a3-73124f4df8d6 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 983 time: 0.7088885 May 12 15:36:10.864332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ad13821-6875-4c46-be1d-a27d1698bf05 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event updated for resources: {'Network': ['ID=fd19b8f0-fdcc-4650-99ab-6c20e6c2786f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:10.884820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:10.891040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-efb5a2df-4d35-4929-805f-52c93374db97 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:10.892899 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-efb5a2df-4d35-4929-805f-52c93374db97 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports/09d836f9-d0f0-4dab-8f03-5a47988d2299 HTTP/1.1" status: 200 len: 911 time: 0.1819704 May 12 15:36:10.893131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:10.895391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57968) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:10.897009 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:10.916929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network fd19b8f0-fdcc-4650-99ab-6c20e6c2786f details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:36:10.924328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Usage tracker for resource:network and tenant:09e0c5fd5fce41bf91599658e3eed992 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:10.968364 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Quota usage for network was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:11.002390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:11.013779 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fae64923-e700-4766-8a31-befb3523010e req-96f56fb7-1284-4f64-95c1-660af2036883 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 0.1219840 May 12 15:36:11.028539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Set router 8b8e7749-e111-476a-884f-1e4731548b2a gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:36:11.038130 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7d930f8-3d3f-4af2-bf8f-327e765a4116 req-9a607822-c25d-499b-be07-652e8abf2d3f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2013884 May 12 15:36:11.053855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 554} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:36:11.072593 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:11.074193 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Added segment 419e2b09-bea8-4f9b-9cb2-515718c00fbc of type vlan for network 7cd0f48c-257b-44df-aa7b-edaebe2230c8 May 12 15:36:11.098048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Made reservation on behalf of 09e0c5fd5fce41bf91599658e3eed992 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:11.101765 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:11.111418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-051a0027-9ba3-4277-a3bb-d0d2f9c2e4e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:11.117002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-051a0027-9ba3-4277-a3bb-d0d2f9c2e4e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:11.118638 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-051a0027-9ba3-4277-a3bb-d0d2f9c2e4e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1655 time: 0.2219784 May 12 15:36:11.124164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57976) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:11.216792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4f36023c-143c-4389-b26c-f62679404834 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:11.235575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 564} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:36:11.247125 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:11.247698 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Added segment dd5276a6-9f88-4209-b309-364e993c7d16 of type vlan for network dac2e936-f8ee-4a2b-a276-bb54b1891d12 May 12 15:36:11.279141 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:11.388937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 4f36023c-143c-4389-b26c-f62679404834 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:11.395108 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:11.403968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 4f36023c-143c-4389-b26c-f62679404834 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:11.404446 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:11.426162 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:11.432372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:11.433094 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:11.591756 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:11.598215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:11.599036 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:11.616889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.8110645 May 12 15:36:11.697458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70665a39-8b9f-4710-ad1a-ef82e6b670ec tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event updated for resources: {'Network': ['ID=dac2e936-f8ee-4a2b-a276-bb54b1891d12,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:11.715357 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:11.725013 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 1.2350123 May 12 15:36:11.734198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57996) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:11.744137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network dac2e936-f8ee-4a2b-a276-bb54b1891d12 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:36:11.749722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': '7cd0f48c-257b-44df-aa7b-edaebe2230c8', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:11.857192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b8e7749-e111-476a-884f-1e4731548b2a', 'name': 'tempest-NetworksTestDHCPv6-router-163243081', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:01Z', 'updated_at': '2022-05-12T15:36:07Z', 'revision_number': 2, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'gw_port_host': None, '_interfaces': [{'id': '09d836f9-d0f0-4dab-8f03-5a47988d2299', 'name': '', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'mac_address': 'fa:16:3e:11:df:37', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b8e7749-e111-476a-884f-1e4731548b2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2768, 'fixed_ips': [{'subnet_id': '5c305c19-23a9-41fa-8421-7282f02eeb36', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:36:04Z', 'updated_at': '2022-05-12T15:36:07Z', 'revision_number': 2, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'subnets': [{'id': '5c305c19-23a9-41fa-8421-7282f02eeb36', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:11.867470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Checking router: 8b8e7749-e111-476a-884f-1e4731548b2a for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:36:11.867758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Updating router 8b8e7749-e111-476a-884f-1e4731548b2a port 09d836f9-d0f0-4dab-8f03-5a47988d2299 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:36:11.939421 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:11.948513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4f36023c-143c-4389-b26c-f62679404834'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:36:11.971931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 4f36023c-143c-4389-b26c-f62679404834, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4f36023c-143c-4389-b26c-f62679404834,segment=NetworkSegment(4dc52732-5577-45b0-b2eb-1c2616cc1c73),segment_id=4dc52732-5577-45b0-b2eb-1c2616cc1c73)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:12.003849 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:12.091339 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=4f36023c-143c-4389-b26c-f62679404834,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:12.095529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:12.110664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:12.125615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:12.134977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:12.159435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:12.163309 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:12.207321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58014) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:12.562010 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:12.567980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7314e753-731e-4754-8b33-f32844526d39 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Network': ['ID=7cd0f48c-257b-44df-aa7b-edaebe2230c8,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:12.602994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 7cd0f48c-257b-44df-aa7b-edaebe2230c8 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:36:12.669045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1422abb3-1dc6-4d74-8d18-fc4d9eaa5ee5 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group': {'name': 'default'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:12.669045 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-1422abb3-1dc6-4d74-8d18-fc4d9eaa5ee5 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. May 12 15:36:12.669375 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-1422abb3-1dc6-4d74-8d18-fc4d9eaa5ee5 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): There was a conflict when trying to complete your request. May 12 15:36:12.670449 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1422abb3-1dc6-4d74-8d18-fc4d9eaa5ee5 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.4614017 May 12 15:36:12.675281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc6952d9-3257-4c4d-ba4d-6ded313b39f8 req-c16b87a2-17b4-40ff-a5b1-2c15abfa210b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:12.677951 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc6952d9-3257-4c4d-ba4d-6ded313b39f8 req-c16b87a2-17b4-40ff-a5b1-2c15abfa210b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 984 time: 0.1112635 May 12 15:36:12.678712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58024) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:12.710446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group': {'name': 'tempest-secgroup--972006142'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:12.736314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:12.745775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:12.758856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:12.832777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:12.856047 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc6952d9-3257-4c4d-ba4d-6ded313b39f8 req-007b18c5-f54a-4ab1-a1cf-6cf4c5b3c93f tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 0.1698356 May 12 15:36:12.879167 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:12.900717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Subnet': ['ID=25edc5b2-cce0-4f70-ac76-0af56ca5b570,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:12.906588 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:12.912304 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fd217f15-25ce-43a7-ba6c-63777beea9db'] response: {'server_uuid': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4f36023c-143c-4389-b26c-f62679404834', 'code': 200} May 12 15:36:12.944107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Checking segment: {'id': '419e2b09-bea8-4f9b-9cb2-515718c00fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': '7cd0f48c-257b-44df-aa7b-edaebe2230c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:12.946182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network hostable DHCP agents. Network: 7cd0f48c-257b-44df-aa7b-edaebe2230c8, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:36:12.950331 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3d650a4b-2789-402e-af70-ac6415452c16 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:13.031959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 7cd0f48c-257b-44df-aa7b-edaebe2230c8 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:36:13.057474 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:13.059970 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:13.060368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac03a717-bdd9-467b-8c3f-e273a48ce22e req-c28363dc-5db2-4d4a-9d94-be286dd2a308 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:13.062948 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ac03a717-bdd9-467b-8c3f-e273a48ce22e req-c28363dc-5db2-4d4a-9d94-be286dd2a308 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 1135 time: 0.3070111 May 12 15:36:13.064945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 7cd0f48c-257b-44df-aa7b-edaebe2230c8) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:13.085901 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-592c19af-343b-4291-8d8e-9255c8d813b4 None None] Network 7cd0f48c-257b-44df-aa7b-edaebe2230c8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:13.106883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:13.107934 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:13.132223 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ac03a717-bdd9-467b-8c3f-e273a48ce22e req-92b41a3e-af4d-4fc9-b752-79ec15b94db8 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 0.0597434 May 12 15:36:13.145857 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ee8e3d26-fb1c-49c6-8d05-0caf297d255f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.4083195 May 12 15:36:13.147185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58032) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:13.156551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'network_id': '7cd0f48c-257b-44df-aa7b-edaebe2230c8', 'name': 'tempest-PortsTestJSON-1452343127', 'fixed_ips': [{'subnet_id': '25edc5b2-cce0-4f70-ac76-0af56ca5b570', 'ip_address': '172.20.0.10'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:13.163527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:13.167919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:13.171460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:13.177257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:13.222193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Transition to ACTIVE for port object 09d836f9-d0f0-4dab-8f03-5a47988d2299 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:13.338720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:13.343717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:port and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:13.346914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:13.353906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:13.356387 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:13.368473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:13.427917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:13.462620 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:13.561734 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:13.627832 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:13.685427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port 1c1974b7-bdd4-462d-8233-63cbbf69a280 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:36:13.842546 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-7cd0f48c-257b-44df-aa7b-edaebe2230c8', 'network_id': '7cd0f48c-257b-44df-aa7b-edaebe2230c8', 'tenant_id': '9bd6beec65cd47b3a0febdc05aaed724', 'fixed_ips': [{'subnet_id': '25edc5b2-cce0-4f70-ac76-0af56ca5b570'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:36:13.843360 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:13.843951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:13.849020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bf0cfa9b-3d2e-414d-8e3e-972919148152,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:13.869831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c625567b-7afc-47b3-bb92-9268dac6dfac None None] Pushing event updated for resources: {'Port': ['ID=09d836f9-d0f0-4dab-8f03-5a47988d2299,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:13.925759 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Attempting to bind port 09d836f9-d0f0-4dab-8f03-5a47988d2299 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:36:13.926379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Attempting to bind port 09d836f9-d0f0-4dab-8f03-5a47988d2299 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:36:13.926379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Attempting to bind port 09d836f9-d0f0-4dab-8f03-5a47988d2299 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:36:13.939773 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 35, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:36:13.940157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:13.940580 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:13.940958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:36:13.941448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Bound port: 09d836f9-d0f0-4dab-8f03-5a47988d2299, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:36:13.941826 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:13.943650 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:13.950906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:13.958377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:14.058528 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:14.079298 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:14.231939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18c55e85-2c1c-4b08-a408-a4b301a6dd32 req-5c9104c6-d227-4891-9926-ccc8106b13dc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:14.234315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18c55e85-2c1c-4b08-a408-a4b301a6dd32 req-5c9104c6-d227-4891-9926-ccc8106b13dc tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 1.3325951 May 12 15:36:14.292512 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Allocated IP 172.20.0.2 (7cd0f48c-257b-44df-aa7b-edaebe2230c8/25edc5b2-cce0-4f70-ac76-0af56ca5b570/7772c239-cfb8-4bdc-b803-ebc42d2aa9b6) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:14.304862 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:14.307110 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 1.6225693 May 12 15:36:14.308580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a9e0056-7402-4925-b1f3-74d916528aa7 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cab76a4a-ffbc-46ed-9fc1-64ec3cc95967,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:14.310056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58052) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:14.316524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b8ed1dd1-289c-4049-8bfd-1da54e35da05 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': 'cab76a4a-ffbc-46ed-9fc1-64ec3cc95967', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:14.350414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b8ed1dd1-289c-4049-8bfd-1da54e35da05 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:14.359746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b8ed1dd1-289c-4049-8bfd-1da54e35da05 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:14.366518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b8ed1dd1-289c-4049-8bfd-1da54e35da05 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:14.380846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b8ed1dd1-289c-4049-8bfd-1da54e35da05 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:14.415278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18c55e85-2c1c-4b08-a408-a4b301a6dd32 req-7acea7db-6203-46ec-8753-40b985d77d67 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1609404 May 12 15:36:14.417894 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8ed1dd1-289c-4049-8bfd-1da54e35da05 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:14.448617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port 09d836f9-d0f0-4dab-8f03-5a47988d2299 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:14.449029 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:14.601089 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8ed1dd1-289c-4049-8bfd-1da54e35da05 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:14.608100 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8ed1dd1-289c-4049-8bfd-1da54e35da05 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:14.679191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8ed1dd1-289c-4049-8bfd-1da54e35da05 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fdf76c90-4689-4a9e-b657-63c4592589a1,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:14.710934 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] For port 09d836f9-d0f0-4dab-8f03-5a47988d2299, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:36:14.724892 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8ed1dd1-289c-4049-8bfd-1da54e35da05 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:14.726448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] For port 09d836f9-d0f0-4dab-8f03-5a47988d2299, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=09d836f9-d0f0-4dab-8f03-5a47988d2299,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:36:14.727086 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b8ed1dd1-289c-4049-8bfd-1da54e35da05 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4152868 May 12 15:36:14.730030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58066) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:14.736485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-86bc5c2d-2dda-450e-9846-2d395d247372 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': 'cab76a4a-ffbc-46ed-9fc1-64ec3cc95967', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:14.738254 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:14.758753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-86bc5c2d-2dda-450e-9846-2d395d247372 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:14.763484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-86bc5c2d-2dda-450e-9846-2d395d247372 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:14.767160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-86bc5c2d-2dda-450e-9846-2d395d247372 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:14.783765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-86bc5c2d-2dda-450e-9846-2d395d247372 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:14.815092 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-86bc5c2d-2dda-450e-9846-2d395d247372 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:14.850249 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c625567b-7afc-47b3-bb92-9268dac6dfac None None] Pushing event updated for resources: {'Port': ['ID=09d836f9-d0f0-4dab-8f03-5a47988d2299,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:14.888371 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:14.922806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Routers {'8b8e7749-e111-476a-884f-1e4731548b2a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:36:14.923590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:35:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8b8e7749-e111-476a-884f-1e4731548b2a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:14.988100 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-86bc5c2d-2dda-450e-9846-2d395d247372 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): There was a conflict when trying to complete your request. May 12 15:36:14.989197 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-86bc5c2d-2dda-450e-9846-2d395d247372 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.2578874 May 12 15:36:14.990415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] For port 09d836f9-d0f0-4dab-8f03-5a47988d2299, host n-d-841483-1, got binding levels [] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:14.991063 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:14.995421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58076) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:15.115849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Transition to ACTIVE for port object 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:15.139320 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-18baac92-cfc7-45e4-87b0-42705de6453a tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:15.168794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbc911c4-8081-425b-9447-4eac089209f3 req-74dff2a7-b0ce-4bec-beb1-d4f7cbc77dd2 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:15.175306 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dbc911c4-8081-425b-9447-4eac089209f3 req-74dff2a7-b0ce-4bec-beb1-d4f7cbc77dd2 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 984 time: 1.0190964 May 12 15:36:15.249176 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-18baac92-cfc7-45e4-87b0-42705de6453a tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:15.297027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58082) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:15.305808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Request body: {'subnets': [{'network_id': 'fd19b8f0-fdcc-4650-99ab-6c20e6c2786f', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--171033177', 'ip_version': 6}, {'network_id': 'dac2e936-f8ee-4a2b-a276-bb54b1891d12', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}]} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:15.306358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Request body: {'subnet': {'network_id': 'fd19b8f0-fdcc-4650-99ab-6c20e6c2786f', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--171033177', 'ip_version': 6}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:15.307579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Request body: {'subnet': {'network_id': 'dac2e936-f8ee-4a2b-a276-bb54b1891d12', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:15.399640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for 09d836f9-d0f0-4dab-8f03-5a47988d2299 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:15.407632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Transition to ACTIVE for port object 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:15.421540 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-54bafdb7-b85a-401e-a859-999183fe0239 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:15.453005 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:15.506509 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Network 7cd0f48c-257b-44df-aa7b-edaebe2230c8 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:15.516462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dbc911c4-8081-425b-9447-4eac089209f3 req-ad5c2ed3-9e1d-4031-bb9c-c0c5475b74b8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 0.1531003 May 12 15:36:15.516815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:15.522346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] Set router 8b8e7749-e111-476a-884f-1e4731548b2a gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:36:15.569480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:15.710716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-18baac92-cfc7-45e4-87b0-42705de6453a tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:15.815275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18baac92-cfc7-45e4-87b0-42705de6453a tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=cab76a4a-ffbc-46ed-9fc1-64ec3cc95967,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:15.828658 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:36:15.829375 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:36:15.834609 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-18baac92-cfc7-45e4-87b0-42705de6453a tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:15.839055 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-18baac92-cfc7-45e4-87b0-42705de6453a tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "DELETE /v2.0/security-groups/cab76a4a-ffbc-46ed-9fc1-64ec3cc95967 HTTP/1.1" status: 204 len: 168 time: 0.8426490 May 12 15:36:15.842548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58094) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:15.871066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Pushing event updated for resources: {'Port': ['ID=7772c239-cfb8-4bdc-b803-ebc42d2aa9b6,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:15.881278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Allocated IP 172.20.0.10 (7cd0f48c-257b-44df-aa7b-edaebe2230c8/25edc5b2-cce0-4f70-ac76-0af56ca5b570/1c1974b7-bdd4-462d-8233-63cbbf69a280) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:15.909449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:15.919704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Usage tracker for resource:subnet and tenant:09e0c5fd5fce41bf91599658e3eed992 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:15.925306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:15.945123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9075acaf-ed22-400b-8b5b-d4499b318473 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Synchronizing usage tracker for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:15.946423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attempting to reserve 2 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:15.957048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f57fc48-0499-46e3-bd70-53142fec71c3 req-b8cb189e-ffc8-46b1-9b0d-87a32c0e5b81 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:15.958692 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f57fc48-0499-46e3-bd70-53142fec71c3 req-b8cb189e-ffc8-46b1-9b0d-87a32c0e5b81 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 1096 time: 0.3786070 May 12 15:36:15.960113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9946a53c-264a-4140-9726-fc9631670050 req-7231b7b1-3c37-42f5-b001-3463620d3bf8 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:15.961635 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9946a53c-264a-4140-9726-fc9631670050 req-7231b7b1-3c37-42f5-b001-3463620d3bf8 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.3362625 May 12 15:36:16.006903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Made reservation on behalf of 09e0c5fd5fce41bf91599658e3eed992 for: {'subnet': 2} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:16.013052 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:16.015988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:16.028200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9075acaf-ed22-400b-8b5b-d4499b318473 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Unset dirty status for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:16.029558 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9075acaf-ed22-400b-8b5b-d4499b318473 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.1803603 May 12 15:36:16.033812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58104) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:16.042321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1b7a3dfc-3536-4e2c-8872-f80014d79bde tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group': {'name': 'tempest-secgroup--1856095229'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:16.053640 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9946a53c-264a-4140-9726-fc9631670050 req-3589ebb2-8d77-4aab-9c67-3427836a17ea tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0811460 May 12 15:36:16.054664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1b7a3dfc-3536-4e2c-8872-f80014d79bde tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:16.075785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1b7a3dfc-3536-4e2c-8872-f80014d79bde tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:16.088244 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b7a3dfc-3536-4e2c-8872-f80014d79bde tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:16.125603 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1b7a3dfc-3536-4e2c-8872-f80014d79bde tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:16.130207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1b7a3dfc-3536-4e2c-8872-f80014d79bde tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:16.135712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1b7a3dfc-3536-4e2c-8872-f80014d79bde tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:16.139809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Attempting to bind port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:36:16.140357 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Attempting to bind port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '419e2b09-bea8-4f9b-9cb2-515718c00fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': '7cd0f48c-257b-44df-aa7b-edaebe2230c8'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:36:16.140603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Attempting to bind port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 on network 7cd0f48c-257b-44df-aa7b-edaebe2230c8 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:36:16.143238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1b7a3dfc-3536-4e2c-8872-f80014d79bde tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:16.159230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 35, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:36:16.159817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Checking segment: {'id': '419e2b09-bea8-4f9b-9cb2-515718c00fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': '7cd0f48c-257b-44df-aa7b-edaebe2230c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:16.160235 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:16.160651 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Bound using segment: {'id': '419e2b09-bea8-4f9b-9cb2-515718c00fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': '7cd0f48c-257b-44df-aa7b-edaebe2230c8'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:36:16.161159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Bound port: 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '419e2b09-bea8-4f9b-9cb2-515718c00fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 554, 'network_id': '7cd0f48c-257b-44df-aa7b-edaebe2230c8'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:36:16.161567 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:16.193556 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:16.258982 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b7a3dfc-3536-4e2c-8872-f80014d79bde tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:16.265399 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:16.266001 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b7a3dfc-3536-4e2c-8872-f80014d79bde tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:16.314550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b8e7749-e111-476a-884f-1e4731548b2a', 'name': 'tempest-NetworksTestDHCPv6-router-163243081', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:01Z', 'updated_at': '2022-05-12T15:36:07Z', 'revision_number': 2, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'gw_port_host': None, '_interfaces': [{'id': '09d836f9-d0f0-4dab-8f03-5a47988d2299', 'name': '', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'mac_address': 'fa:16:3e:11:df:37', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b8e7749-e111-476a-884f-1e4731548b2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2768, 'fixed_ips': [{'subnet_id': '5c305c19-23a9-41fa-8421-7282f02eeb36', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:36:04Z', 'updated_at': '2022-05-12T15:36:14Z', 'revision_number': 4, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'subnets': [{'id': '5c305c19-23a9-41fa-8421-7282f02eeb36', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:16.317289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] For port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:36:16.322294 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] For port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7772c239-cfb8-4bdc-b803-ebc42d2aa9b6,segment=NetworkSegment(419e2b09-bea8-4f9b-9cb2-515718c00fbc),segment_id=419e2b09-bea8-4f9b-9cb2-515718c00fbc)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:36:16.324957 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b7a3dfc-3536-4e2c-8872-f80014d79bde tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:16.325217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30f97d9a-eddd-456b-b0ea-500de99835cb None None] The sync data for ids ['8b8e7749-e111-476a-884f-1e4731548b2a'] in n-d-841483-1 is: [{'id': '8b8e7749-e111-476a-884f-1e4731548b2a', 'name': 'tempest-NetworksTestDHCPv6-router-163243081', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:01Z', 'updated_at': '2022-05-12T15:36:07Z', 'revision_number': 2, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'gw_port_host': None, '_interfaces': [{'id': '09d836f9-d0f0-4dab-8f03-5a47988d2299', 'name': '', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'mac_address': 'fa:16:3e:11:df:37', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b8e7749-e111-476a-884f-1e4731548b2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 2768, 'fixed_ips': [{'subnet_id': '5c305c19-23a9-41fa-8421-7282f02eeb36', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:36:04Z', 'updated_at': '2022-05-12T15:36:14Z', 'revision_number': 4, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'subnets': [{'id': '5c305c19-23a9-41fa-8421-7282f02eeb36', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:36:16.330461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1b7a3dfc-3536-4e2c-8872-f80014d79bde tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 0.2956929 May 12 15:36:16.331226 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58112) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:16.333594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port 09d836f9-d0f0-4dab-8f03-5a47988d2299 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:16.333935 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:16.337164 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:16.445507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7a3dfc-3536-4e2c-8872-f80014d79bde tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b11b3f44-2f99-4ff0-b8e6-a9af44913e0a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:16.454191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9df6055d-2f3d-4984-9dfb-7c270184f217 None None] Pushing event updated for resources: {'Port': ['ID=7772c239-cfb8-4bdc-b803-ebc42d2aa9b6,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:16.458459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c9a7a47d-3a27-4f9d-aa75-3da1ca8ded97 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': 'b11b3f44-2f99-4ff0-b8e6-a9af44913e0a', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:16.459268 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-c9a7a47d-3a27-4f9d-aa75-3da1ca8ded97 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. May 12 15:36:16.459761 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-c9a7a47d-3a27-4f9d-aa75-3da1ca8ded97 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:16.464500 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c9a7a47d-3a27-4f9d-aa75-3da1ca8ded97 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.1019616 May 12 15:36:16.465035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58116) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:16.548564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f57fc48-0499-46e3-bd70-53142fec71c3 req-709aefa9-c351-44d2-a706-2329a5213f3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:16.550461 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f57fc48-0499-46e3-bd70-53142fec71c3 req-709aefa9-c351-44d2-a706-2329a5213f3f service neutron] 10.222.0.76 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 0.5707812 May 12 15:36:16.820198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] For port 09d836f9-d0f0-4dab-8f03-5a47988d2299, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=09d836f9-d0f0-4dab-8f03-5a47988d2299,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:16.820804 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:16.970822 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5be43ae7-16c3-4527-8cc1-01befbd81326 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:16.980834 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f57fc48-0499-46e3-bd70-53142fec71c3 req-ff5ccc7e-a437-4dc3-a7d1-2c31c1fd220f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d45db345-6e10-417e-8b52-3260151d6ba4 HTTP/1.1" status: 200 len: 1001 time: 0.2804980 May 12 15:36:17.033709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for 09d836f9-d0f0-4dab-8f03-5a47988d2299 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:17.062714 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:17.126794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e37b3e2d-3f7f-4c7b-b54c-c10186ad5998 req-c3bd42b9-ce3e-42e5-90a9-c655f1875093 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:17.128310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e37b3e2d-3f7f-4c7b-b54c-c10186ad5998 req-c3bd42b9-ce3e-42e5-90a9-c655f1875093 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 984 time: 0.4229615 May 12 15:36:17.212974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5be43ae7-16c3-4527-8cc1-01befbd81326 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:17.236130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Transition to ACTIVE for port object 1c1974b7-bdd4-462d-8233-63cbbf69a280 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:17.245351 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e37b3e2d-3f7f-4c7b-b54c-c10186ad5998 req-39116312-dbfc-489b-9409-afce959204e7 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 0.1007898 May 12 15:36:17.425475 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f57fc48-0499-46e3-bd70-53142fec71c3 req-7bb1fdb5-2738-4bb7-9a42-83f7b4936804 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:17.427180 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f57fc48-0499-46e3-bd70-53142fec71c3 req-7bb1fdb5-2738-4bb7-9a42-83f7b4936804 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.3756206 May 12 15:36:17.511884 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:17.703575 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:17.705212 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5be43ae7-16c3-4527-8cc1-01befbd81326 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:17.711186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-741c4107-947b-4bc6-9f9c-7c5829639913 req-04c3952a-f3c8-4e29-b420-75957a4dfc5e tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:17.713380 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-741c4107-947b-4bc6-9f9c-7c5829639913 req-04c3952a-f3c8-4e29-b420-75957a4dfc5e tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.4652479 May 12 15:36:17.721987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:17.722460 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:17.730057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 09d836f9-d0f0-4dab-8f03-5a47988d2299 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:17.793433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5be43ae7-16c3-4527-8cc1-01befbd81326 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b11b3f44-2f99-4ff0-b8e6-a9af44913e0a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:17.798769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 09d836f9-d0f0-4dab-8f03-5a47988d2299 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:36:17.799864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 09d836f9-d0f0-4dab-8f03-5a47988d2299 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:284}} May 12 15:36:17.803676 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:17.863445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=09d836f9-d0f0-4dab-8f03-5a47988d2299,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:17.891275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Port 09d836f9-d0f0-4dab-8f03-5a47988d2299 not found, will not notify nova. {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:294}} May 12 15:36:17.927247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f57fc48-0499-46e3-bd70-53142fec71c3 req-65363548-f306-4393-8c38-4152524bcd0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:17.929067 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f57fc48-0499-46e3-bd70-53142fec71c3 req-65363548-f306-4393-8c38-4152524bcd0f service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4762702 May 12 15:36:17.960678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 7cd0f48c-257b-44df-aa7b-edaebe2230c8 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:17.971443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:18.007093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:18.051485 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6747a9e-76ca-473f-85c7-6be224bb966f None None] Network 7cd0f48c-257b-44df-aa7b-edaebe2230c8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:18.062987 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5be43ae7-16c3-4527-8cc1-01befbd81326 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:18.064786 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5be43ae7-16c3-4527-8cc1-01befbd81326 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "DELETE /v2.0/security-groups/b11b3f44-2f99-4ff0-b8e6-a9af44913e0a HTTP/1.1" status: 204 len: 168 time: 1.5800316 May 12 15:36:18.109423 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58138) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:18.151227 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-741c4107-947b-4bc6-9f9c-7c5829639913 req-ffcc4d51-d94b-4594-bc6e-3ac5f72357e9 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4313054 May 12 15:36:18.156408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=1c1974b7-bdd4-462d-8233-63cbbf69a280,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:18.161319 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:18.183389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-735c7f69-11cd-4885-8aad-5edb2f82e0e0 req-c1984f31-09d7-4a08-85a4-aba8dbc09c24 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:18.191132 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-735c7f69-11cd-4885-8aad-5edb2f82e0e0 req-c1984f31-09d7-4a08-85a4-aba8dbc09c24 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 984 time: 0.6660531 May 12 15:36:18.204610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1b6d2108-0856-4296-8d72-43f8e0f3ad15 None None] Provisioning for port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:18.233529 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1b6d2108-0856-4296-8d72-43f8e0f3ad15 None None] Provisioning complete for port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:18.236103 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1b6d2108-0856-4296-8d72-43f8e0f3ad15 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:18.270849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:18.272177 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:18.398698 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-faeee21f-225b-495c-bf54-f103cd2b5be6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 925 time: 5.2487562 May 12 15:36:18.401791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58144) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:18.419602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-735c7f69-11cd-4885-8aad-5edb2f82e0e0 req-67e5d457-4c7e-4e8e-8e86-1f5f0a48dbf4 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 0.2275219 May 12 15:36:18.433504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'network_id': '7cd0f48c-257b-44df-aa7b-edaebe2230c8', 'name': 'tempest-PortsTestJSON-363173768', 'fixed_ips': [{'subnet_id': '25edc5b2-cce0-4f70-ac76-0af56ca5b570', 'ip_address': '172.20.0.9'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:18.490244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c76a7a4f-f5ed-413e-b95a-1e9616f80735 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Synchronizing usage tracker for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:18.594097 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1b6d2108-0856-4296-8d72-43f8e0f3ad15 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:18.622119 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f57fc48-0499-46e3-bd70-53142fec71c3 req-4642d865-9378-4e0d-9454-9ee7b1e2e150 service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6598177 May 12 15:36:18.664180 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:18.682598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1b6d2108-0856-4296-8d72-43f8e0f3ad15 None None] For port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7772c239-cfb8-4bdc-b803-ebc42d2aa9b6,segment=NetworkSegment(419e2b09-bea8-4f9b-9cb2-515718c00fbc),segment_id=419e2b09-bea8-4f9b-9cb2-515718c00fbc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:18.690187 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1b6d2108-0856-4296-8d72-43f8e0f3ad15 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:18.759555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c76a7a4f-f5ed-413e-b95a-1e9616f80735 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Unset dirty status for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:18.760921 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c76a7a4f-f5ed-413e-b95a-1e9616f80735 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.6472244 May 12 15:36:18.781412 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b6d2108-0856-4296-8d72-43f8e0f3ad15 None None] Pushing event updated for resources: {'Port': ['ID=7772c239-cfb8-4bdc-b803-ebc42d2aa9b6,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:18.828966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58152) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:18.889725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-aaa98d45-75de-4437-825e-53c37f99c23c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group': {'name': 'tempest-secgroup--665867482'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:18.900749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aaa98d45-75de-4437-825e-53c37f99c23c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:18.931867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aaa98d45-75de-4437-825e-53c37f99c23c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:18.935076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Router 8b8e7749-e111-476a-884f-1e4731548b2a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:36:18.990413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event updated for resources: {'Subnet': ['ID=bf5956bc-e9bc-4ebb-836c-5a77cdc52636,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:19.012831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aaa98d45-75de-4437-825e-53c37f99c23c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:19.045124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Checking segment: {'id': '15501122-880e-4aaf-a64f-8d7d43dbbe2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': 'fd19b8f0-fdcc-4650-99ab-6c20e6c2786f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:19.045941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Network hostable DHCP agents. Network: fd19b8f0-fdcc-4650-99ab-6c20e6c2786f, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:36:19.125086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Network fd19b8f0-fdcc-4650-99ab-6c20e6c2786f is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:36:19.131016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aaa98d45-75de-4437-825e-53c37f99c23c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:19.141589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:36:19.144855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-aaa98d45-75de-4437-825e-53c37f99c23c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:19.151140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, fd19b8f0-fdcc-4650-99ab-6c20e6c2786f) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:19.161697 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:19.161871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b074694-72f0-46cb-8562-2c45159748ae req-260c0dd7-e679-4d1b-9934-fa29d403daf8 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:19.163599 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b074694-72f0-46cb-8562-2c45159748ae req-260c0dd7-e679-4d1b-9934-fa29d403daf8 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 1135 time: 0.4052181 May 12 15:36:19.164752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-aaa98d45-75de-4437-825e-53c37f99c23c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:19.167949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:19.173133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dc460023-2f58-4f6c-90e3-5c191208b671 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "PUT /v2.0/routers/8b8e7749-e111-476a-884f-1e4731548b2a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.0479228 May 12 15:36:19.174320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87eaa898-4fec-4211-b322-3e5ddb69dd56 None None] Network fd19b8f0-fdcc-4650-99ab-6c20e6c2786f requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:19.176671 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58162) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:19.180484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aaa98d45-75de-4437-825e-53c37f99c23c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:19.180798 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70da4f29-167f-4ecb-85e0-37c91e72809b None None] Sync routers for ids ['8b8e7749-e111-476a-884f-1e4731548b2a'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:36:19.206319 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70da4f29-167f-4ecb-85e0-37c91e72809b None None] Routers {'8b8e7749-e111-476a-884f-1e4731548b2a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:36:19.206948 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-70da4f29-167f-4ecb-85e0-37c91e72809b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:36:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8b8e7749-e111-476a-884f-1e4731548b2a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:19.281564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0b074694-72f0-46cb-8562-2c45159748ae req-01915c8a-1693-490d-8e8c-90253e3e165d tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:19.318781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event updated for resources: {'Subnet': ['ID=998b7d53-e75c-42d5-8cdf-0c16c4d8f933,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:19.319860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0b074694-72f0-46cb-8562-2c45159748ae req-01915c8a-1693-490d-8e8c-90253e3e165d tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:19.329360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0b074694-72f0-46cb-8562-2c45159748ae req-01915c8a-1693-490d-8e8c-90253e3e165d tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Usage tracker for resource:security_group_rule and tenant:b4a6e1b5de6e4d28a1dd36d7c8899d30 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:19.338324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0b074694-72f0-46cb-8562-2c45159748ae req-01915c8a-1693-490d-8e8c-90253e3e165d tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:19.353908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:port and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:19.354093 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-254f6509-a962-434a-8065-d86eb3b3d530 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:19.354383 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-254f6509-a962-434a-8065-d86eb3b3d530 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:19.355115 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-254f6509-a962-434a-8065-d86eb3b3d530 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:19.358303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-0b074694-72f0-46cb-8562-2c45159748ae req-01915c8a-1693-490d-8e8c-90253e3e165d tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:19.362242 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9f57fc48-0499-46e3-bd70-53142fec71c3 req-ca3f9aa1-c8b4-4c6c-87c2-c51feaa2765e service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7266643 May 12 15:36:19.385550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:19.463985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:19.477040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Checking segment: {'id': 'dd5276a6-9f88-4209-b309-364e993c7d16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'dac2e936-f8ee-4a2b-a276-bb54b1891d12'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:19.477646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Network hostable DHCP agents. Network: dac2e936-f8ee-4a2b-a276-bb54b1891d12, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:36:19.478540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-254f6509-a962-434a-8065-d86eb3b3d530 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:19.482677 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-254f6509-a962-434a-8065-d86eb3b3d530 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.3038640 May 12 15:36:19.486660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58166) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:19.557020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-585bc0a6-dff3-46cf-aa81-a44807bcfafa None None] Provisioning complete for port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:19.557020 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-585bc0a6-dff3-46cf-aa81-a44807bcfafa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:19.635089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-c401f6b0-99a9-46f2-9182-e6d556893e8d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 5c305c19-23a9-41fa-8421-7282f02eeb36 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:36:19.638717 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aaa98d45-75de-4437-825e-53c37f99c23c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:19.644702 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-70da4f29-167f-4ecb-85e0-37c91e72809b None None] Set router 8b8e7749-e111-476a-884f-1e4731548b2a gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:36:19.645846 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c401f6b0-99a9-46f2-9182-e6d556893e8d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:19.667049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:19.679562 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aaa98d45-75de-4437-825e-53c37f99c23c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:19.725698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:19.772108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Network dac2e936-f8ee-4a2b-a276-bb54b1891d12 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:36:19.781518 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aaa98d45-75de-4437-825e-53c37f99c23c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:19.785709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-aaa98d45-75de-4437-825e-53c37f99c23c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 0.9193761 May 12 15:36:19.799851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58174) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:19.813225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ab79c0cb-7324-4f62-a45b-f8565be3419c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': '013c9677-b557-405f-b129-d9b842821bcc', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:19.813893 n-d-841483-1 neutron-server[88152]: WARNING neutron.api.v2.base [None req-ab79c0cb-7324-4f62-a45b-f8565be3419c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. May 12 15:36:19.814812 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-ab79c0cb-7324-4f62-a45b-f8565be3419c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:19.818977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ab79c0cb-7324-4f62-a45b-f8565be3419c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0088596 May 12 15:36:19.842718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58178) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:19.882457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, dac2e936-f8ee-4a2b-a276-bb54b1891d12) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:19.906783 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44664c9d-ecc6-4179-9a2f-f95d4c129663 None None] Network dac2e936-f8ee-4a2b-a276-bb54b1891d12 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:19.908404 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c401f6b0-99a9-46f2-9182-e6d556893e8d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:19.911283 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-70da4f29-167f-4ecb-85e0-37c91e72809b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b8e7749-e111-476a-884f-1e4731548b2a', 'name': 'tempest-NetworksTestDHCPv6-router-163243081', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:01Z', 'updated_at': '2022-05-12T15:36:17Z', 'revision_number': 3, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:19.928658 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70da4f29-167f-4ecb-85e0-37c91e72809b None None] Checking router: 8b8e7749-e111-476a-884f-1e4731548b2a for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:36:19.943094 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70da4f29-167f-4ecb-85e0-37c91e72809b None None] Routers {'8b8e7749-e111-476a-884f-1e4731548b2a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:36:19.944236 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-70da4f29-167f-4ecb-85e0-37c91e72809b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:36:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8b8e7749-e111-476a-884f-1e4731548b2a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:19.956286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaa98d45-75de-4437-825e-53c37f99c23c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event updated for resources: {'SecurityGroup': ['ID=013c9677-b557-405f-b129-d9b842821bcc,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:19.958626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58182) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:19.964917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:19.965812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:19.966883 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:19.987622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55f148cf-2b5c-4013-81a4-21ddfe39452b req-d91c494f-3719-4e93-8639-3f9c078a5de1 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:19.989489 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55f148cf-2b5c-4013-81a4-21ddfe39452b req-d91c494f-3719-4e93-8639-3f9c078a5de1 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.4883769 May 12 15:36:19.996118 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0b074694-72f0-46cb-8562-2c45159748ae req-01915c8a-1693-490d-8e8c-90253e3e165d tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.032225 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-0b074694-72f0-46cb-8562-2c45159748ae req-01915c8a-1693-490d-8e8c-90253e3e165d tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.052928 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-56d17528-e8c7-4f46-8d55-6792b5d0c013 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1475 time: 4.7548013 May 12 15:36:20.060300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58188) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:20.159674 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-70da4f29-167f-4ecb-85e0-37c91e72809b None None] Set router 8b8e7749-e111-476a-884f-1e4731548b2a gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:36:20.179368 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa9d4f95-9631-41f4-a475-a89b982ca199 req-0f7f0a56-3bab-4c44-918c-d1f5db43d2d1 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.1799705 May 12 15:36:20.184758 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.220062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port 8ce13741-e17a-4578-b5d3-3b3a8965545f yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:36:20.237101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77109747-55a2-4ed7-97a9-37c1a15efcff tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:20.238607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77109747-55a2-4ed7-97a9-37c1a15efcff tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:20.240316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77109747-55a2-4ed7-97a9-37c1a15efcff tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:20.241975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-77109747-55a2-4ed7-97a9-37c1a15efcff tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2101 time: 0.1740158 May 12 15:36:20.263899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0b074694-72f0-46cb-8562-2c45159748ae req-01915c8a-1693-490d-8e8c-90253e3e165d tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Synchronizing usage tracker for tenant:b4a6e1b5de6e4d28a1dd36d7c8899d30 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:20.284107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58192) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:20.344053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed95f3be-8134-4ccf-81d0-82996cca1a26 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-fd19b8f0-fdcc-4650-99ab-6c20e6c2786f', 'network_id': 'fd19b8f0-fdcc-4650-99ab-6c20e6c2786f', 'tenant_id': '09e0c5fd5fce41bf91599658e3eed992', 'fixed_ips': [{'subnet_id': 'bf5956bc-e9bc-4ebb-836c-5a77cdc52636'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:36:20.345048 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ed95f3be-8134-4ccf-81d0-82996cca1a26 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.360995 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-70da4f29-167f-4ecb-85e0-37c91e72809b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b8e7749-e111-476a-884f-1e4731548b2a', 'name': 'tempest-NetworksTestDHCPv6-router-163243081', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:01Z', 'updated_at': '2022-05-12T15:36:17Z', 'revision_number': 3, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:20.366806 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70da4f29-167f-4ecb-85e0-37c91e72809b None None] The sync data for ids ['8b8e7749-e111-476a-884f-1e4731548b2a'] in n-d-841483-1 is: [{'id': '8b8e7749-e111-476a-884f-1e4731548b2a', 'name': 'tempest-NetworksTestDHCPv6-router-163243081', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:01Z', 'updated_at': '2022-05-12T15:36:17Z', 'revision_number': 3, 'project_id': 'd0c0be8fb6b844879953049ca91c6fac', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:36:20.387055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01915c8a-1693-490d-8e8c-90253e3e165d tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=361eee1c-8601-4d8b-9f08-46082abef983,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:20.392155 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9aa130c-8df4-4ba5-9a17-cea6ab7f1e07 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.412106 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-55f148cf-2b5c-4013-81a4-21ddfe39452b req-7b7f1d8f-8336-49d3-b296-36ff11fc08f4 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4032874 May 12 15:36:20.422900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:20.423368 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.435387 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0cf9935e-8f55-4cf1-b52f-62bcdde35907 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.438827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d9aa130c-8df4-4ba5-9a17-cea6ab7f1e07 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:20.449218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d9aa130c-8df4-4ba5-9a17-cea6ab7f1e07 admin admin] Usage tracker for resource:security_group_rule and tenant:f6835a6cb1c043e7afad713d68795334 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:20.460999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d9aa130c-8df4-4ba5-9a17-cea6ab7f1e07 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:20.469225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-dac2e936-f8ee-4a2b-a276-bb54b1891d12', 'network_id': 'dac2e936-f8ee-4a2b-a276-bb54b1891d12', 'tenant_id': '09e0c5fd5fce41bf91599658e3eed992', 'fixed_ips': [{'subnet_id': '998b7d53-e75c-42d5-8cdf-0c16c4d8f933'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:36:20.470148 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.483368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-585bc0a6-dff3-46cf-aa81-a44807bcfafa None None] Provisioning for port 1c1974b7-bdd4-462d-8233-63cbbf69a280 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:20.485290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d9aa130c-8df4-4ba5-9a17-cea6ab7f1e07 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:20.486428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Allocated IP 172.20.0.9 (7cd0f48c-257b-44df-aa7b-edaebe2230c8/25edc5b2-cce0-4f70-ac76-0af56ca5b570/8ce13741-e17a-4578-b5d3-3b3a8965545f) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:20.495251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0b074694-72f0-46cb-8562-2c45159748ae req-01915c8a-1693-490d-8e8c-90253e3e165d tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Unset dirty status for tenant:b4a6e1b5de6e4d28a1dd36d7c8899d30 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:20.496515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b074694-72f0-46cb-8562-2c45159748ae req-01915c8a-1693-490d-8e8c-90253e3e165d tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 1.3189635 May 12 15:36:20.501996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-7edb612d-3635-4cd3-847b-6583e999759e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Deleting subnet bf5956bc-e9bc-4ebb-836c-5a77cdc52636 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:36:20.505521 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7edb612d-3635-4cd3-847b-6583e999759e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.530934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58196) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:20.552752 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-585bc0a6-dff3-46cf-aa81-a44807bcfafa None None] Provisioning complete for port 1c1974b7-bdd4-462d-8233-63cbbf69a280 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:20.553345 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-585bc0a6-dff3-46cf-aa81-a44807bcfafa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.591059 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0cf9935e-8f55-4cf1-b52f-62bcdde35907 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.633932 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c401f6b0-99a9-46f2-9182-e6d556893e8d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.645495 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7edb612d-3635-4cd3-847b-6583e999759e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.706669 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-585bc0a6-dff3-46cf-aa81-a44807bcfafa None None] Port 1c1974b7-bdd4-462d-8233-63cbbf69a280 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:36:20.748054 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0cf9935e-8f55-4cf1-b52f-62bcdde35907 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.772955 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7edb612d-3635-4cd3-847b-6583e999759e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.810360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cf9935e-8f55-4cf1-b52f-62bcdde35907 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=013c9677-b557-405f-b129-d9b842821bcc,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:20.897295 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0cf9935e-8f55-4cf1-b52f-62bcdde35907 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.898938 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0cf9935e-8f55-4cf1-b52f-62bcdde35907 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "DELETE /v2.0/security-groups/013c9677-b557-405f-b129-d9b842821bcc HTTP/1.1" status: 204 len: 168 time: 1.0551522 May 12 15:36:20.904762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58200) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:20.927060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Allocated IP 2001:db8:0:1::1 (dac2e936-f8ee-4a2b-a276-bb54b1891d12/998b7d53-e75c-42d5-8cdf-0c16c4d8f933/e55b19d5-201e-48dc-a950-548b39183637) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:20.951444 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-472ddd4f-f1a6-471a-ab1b-95ac1517e3a1 None None] Provisioning complete for port 1c1974b7-bdd4-462d-8233-63cbbf69a280 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:20.952014 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-472ddd4f-f1a6-471a-ab1b-95ac1517e3a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:20.977280 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9aa130c-8df4-4ba5-9a17-cea6ab7f1e07 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.006714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9d4f95-9631-41f4-a475-a89b982ca199 req-deebf10d-9460-4719-b6ae-6459799ffc65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:21.008623 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa9d4f95-9631-41f4-a475-a89b982ca199 req-deebf10d-9460-4719-b6ae-6459799ffc65 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 1096 time: 0.4767849 May 12 15:36:21.015091 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9aa130c-8df4-4ba5-9a17-cea6ab7f1e07 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.025823 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c401f6b0-99a9-46f2-9182-e6d556893e8d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.045807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-472ddd4f-f1a6-471a-ab1b-95ac1517e3a1 None None] Port 1c1974b7-bdd4-462d-8233-63cbbf69a280 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:36:21.092904 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7edb612d-3635-4cd3-847b-6583e999759e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.119007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68072ccd-ddd4-45f6-ac55-b6d4b2c0171b tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:21.121486 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-68072ccd-ddd4-45f6-ac55-b6d4b2c0171b tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 1130 time: 0.5861292 May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server [None req-ed95f3be-8134-4ccf-81d0-82996cca1a26 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet bf5956bc-e9bc-4ebb-836c-5a77cdc52636: This subnet is being modified by another concurrent operation. May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 289, in create_dhcp_port May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 114, in _port_action May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 692, in inner May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kwargs) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 217, in wrapped May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1452, in create_port May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1419, in _create_port_db May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1441, in create_port_db May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 219, in allocate_ips_for_port_and_store May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ips = self.allocate_ips_for_port(context, port_copy) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 217, in wrapped May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1014, in wrapper May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 226, in allocate_ips_for_port May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._allocate_ips_for_port(context, port) May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 258, in _allocate_ips_for_port May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 683, in _ipam_get_subnets May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server subnet.lock_register( May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise exception May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet bf5956bc-e9bc-4ebb-836c-5a77cdc52636: This subnet is being modified by another concurrent operation. May 12 15:36:21.126911 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server May 12 15:36:21.139805 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58204) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:21.153880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d62e3e7e-740f-4767-9423-34567aaae69d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Synchronizing usage tracker for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:21.159463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c401f6b0-99a9-46f2-9182-e6d556893e8d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=5c305c19-23a9-41fa-8421-7282f02eeb36,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:21.160386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '4f36023c-143c-4389-b26c-f62679404834', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'fixed_ip_address': '172.20.0.6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:21.169142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:21.174303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f096a53-e71c-4521-957b-d36a9aba700e None None] Network fd19b8f0-fdcc-4650-99ab-6c20e6c2786f requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:21.179222 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d9aa130c-8df4-4ba5-9a17-cea6ab7f1e07 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f6835a6cb1c043e7afad713d68795334&name=default HTTP/1.1" status: 200 len: 2983 time: 1.2077751 May 12 15:36:21.184028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7edb612d-3635-4cd3-847b-6583e999759e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event deleted for resources: {'Subnet': ['ID=bf5956bc-e9bc-4ebb-836c-5a77cdc52636,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:21.188723 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7edb612d-3635-4cd3-847b-6583e999759e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.194226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Usage tracker for resource:floatingip and tenant:3dd1fe8ad774471ba7745219a37ead53 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:21.200204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58208) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:21.205082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9aa130c-8df4-4ba5-9a17-cea6ab7f1e07 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ced62b06-fa7d-451f-81b4-f6dacddae7df,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:21.212426 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:21.230881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:21.237761 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7edb612d-3635-4cd3-847b-6583e999759e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "DELETE /v2.0/subnets/bf5956bc-e9bc-4ebb-836c-5a77cdc52636 HTTP/1.1" status: 204 len: 168 time: 0.9499609 May 12 15:36:21.238564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15a4ed83-076b-4c0d-8e55-3d9042d4758b None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:21.242021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58212) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:21.251532 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c401f6b0-99a9-46f2-9182-e6d556893e8d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.287777 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.320092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d62e3e7e-740f-4767-9423-34567aaae69d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Unset dirty status for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:21.323818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d62e3e7e-740f-4767-9423-34567aaae69d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.4154313 May 12 15:36:21.323986 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c401f6b0-99a9-46f2-9182-e6d556893e8d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/5c305c19-23a9-41fa-8421-7282f02eeb36 HTTP/1.1" status: 204 len: 168 time: 1.8338339 May 12 15:36:21.324074 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.328476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58216) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:21.328809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58218) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:21.329786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Transition to ACTIVE for port object 8ce13741-e17a-4578-b5d3-3b3a8965545f will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:21.336359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-63372a7c-8451-490a-83f1-64fb46653951 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group': {'name': 'tempest-secgroup--1234307848'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:21.376115 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-ad4e3cc4-4a14-4723-8a6d-2c926d2d2f2e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Deleting subnet 998b7d53-e75c-42d5-8cdf-0c16c4d8f933 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:36:21.389233 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 09d836f9-d0f0-4dab-8f03-5a47988d2299 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:36:21.426406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-63372a7c-8451-490a-83f1-64fb46653951 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:21.465534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-63372a7c-8451-490a-83f1-64fb46653951 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:21.527769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 09d836f9-d0f0-4dab-8f03-5a47988d2299 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:36:21.528143 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 09d836f9-d0f0-4dab-8f03-5a47988d2299 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:36:21.643707 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1db85fb-0c7c-4b79-aa34-b0ce8ea67128 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.683863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9d4f95-9631-41f4-a475-a89b982ca199 req-27139084-b346-440f-99c9-681ab9723a80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:21.685499 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa9d4f95-9631-41f4-a475-a89b982ca199 req-27139084-b346-440f-99c9-681ab9723a80 service neutron] 10.222.0.84 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 0.5993848 May 12 15:36:21.691925 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63372a7c-8451-490a-83f1-64fb46653951 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.698791 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1db85fb-0c7c-4b79-aa34-b0ce8ea67128 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.764951 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.767123 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.782609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Transition to ACTIVE for port object e55b19d5-201e-48dc-a950-548b39183637 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:21.788478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-966927b2-a378-4c62-94f7-4ee0e536f026 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:router {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:21.790219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3825a632-f2b0-4865-9c0a-848a1c34ce37 req-163c6cfb-da39-4035-9abb-561393a18581 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:21.791659 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa9d4f95-9631-41f4-a475-a89b982ca199 req-6a35610b-5d3c-4c95-a505-7c59576c7771 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=45ca2419-3316-4890-add7-265905134549 HTTP/1.1" status: 200 len: 217 time: 0.0902212 May 12 15:36:21.791909 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3825a632-f2b0-4865-9c0a-848a1c34ce37 req-163c6cfb-da39-4035-9abb-561393a18581 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.2136049 May 12 15:36:21.833655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Transition to ACTIVE for port object e55b19d5-201e-48dc-a950-548b39183637 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:21.842694 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.843470 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.845213 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad4e3cc4-4a14-4723-8a6d-2c926d2d2f2e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.876217 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1db85fb-0c7c-4b79-aa34-b0ce8ea67128 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.885502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-63372a7c-8451-490a-83f1-64fb46653951 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:21.910254 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-486d1fdb-8751-4a13-89ce-d4fba4f394b5 None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:36:21.920944 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Network dac2e936-f8ee-4a2b-a276-bb54b1891d12 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:21.921785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-486d1fdb-8751-4a13-89ce-d4fba4f394b5 None None] Deleting port 1880f170-4805-47c3-bcff-e9930dc3a447 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:21.922152 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-486d1fdb-8751-4a13-89ce-d4fba4f394b5 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:21.922742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-63372a7c-8451-490a-83f1-64fb46653951 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:21.933972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-63372a7c-8451-490a-83f1-64fb46653951 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:21.939373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 7cd0f48c-257b-44df-aa7b-edaebe2230c8 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:21.949017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-63372a7c-8451-490a-83f1-64fb46653951 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:21.950730 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3825a632-f2b0-4865-9c0a-848a1c34ce37 req-4ce6c508-0882-4250-ae84-42e47e3aef6a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1528368 May 12 15:36:21.951315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:21.952923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:21.953278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-966927b2-a378-4c62-94f7-4ee0e536f026 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:router {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:21.957074 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-966927b2-a378-4c62-94f7-4ee0e536f026 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 709 time: 0.6258261 May 12 15:36:21.961043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:21.961527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1db85fb-0c7c-4b79-aa34-b0ce8ea67128 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ced62b06-fa7d-451f-81b4-f6dacddae7df,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:21.968088 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:21.987419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58226) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:22.011932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=8ce13741-e17a-4578-b5d3-3b3a8965545f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:22.016700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9d4f95-9631-41f4-a475-a89b982ca199 req-2c2e7706-fd59-4524-a0ff-836abd40b921 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:22.018154 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa9d4f95-9631-41f4-a475-a89b982ca199 req-2c2e7706-fd59-4524-a0ff-836abd40b921 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.1898439 May 12 15:36:22.039767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Pushing event updated for resources: {'Port': ['ID=e55b19d5-201e-48dc-a950-548b39183637,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:22.072476 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1db85fb-0c7c-4b79-aa34-b0ce8ea67128 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.076180 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c1db85fb-0c7c-4b79-aa34-b0ce8ea67128 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ced62b06-fa7d-451f-81b4-f6dacddae7df HTTP/1.1" status: 204 len: 168 time: 0.8701918 May 12 15:36:22.184427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:22.185046 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.219440 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad4e3cc4-4a14-4723-8a6d-2c926d2d2f2e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.342743 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-67d0c718-c33d-451c-9170-1ee88b70c329 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.359697 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63372a7c-8451-490a-83f1-64fb46653951 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.365918 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e4a96c5a-f89e-42b3-8c4f-8d20974254d0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 3.9580407 May 12 15:36:22.366715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58236) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:22.371149 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63372a7c-8451-490a-83f1-64fb46653951 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.426025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9d4f95-9631-41f4-a475-a89b982ca199 req-77c50c98-d0cb-41ce-ab34-5e4f76dbc7ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:22.427673 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa9d4f95-9631-41f4-a475-a89b982ca199 req-77c50c98-d0cb-41ce-ab34-5e4f76dbc7ac service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4009724 May 12 15:36:22.480614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Attempting to bind port e55b19d5-201e-48dc-a950-548b39183637 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:36:22.481174 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Attempting to bind port e55b19d5-201e-48dc-a950-548b39183637 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'dd5276a6-9f88-4209-b309-364e993c7d16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'dac2e936-f8ee-4a2b-a276-bb54b1891d12'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:36:22.481858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Attempting to bind port e55b19d5-201e-48dc-a950-548b39183637 on network dac2e936-f8ee-4a2b-a276-bb54b1891d12 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:36:22.491583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-486b973e-16bf-4110-96b1-b997f7da16f9 None None] Provisioning for port 8ce13741-e17a-4578-b5d3-3b3a8965545f completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:22.497944 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-486d1fdb-8751-4a13-89ce-d4fba4f394b5 None None] For port 1880f170-4805-47c3-bcff-e9930dc3a447, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1880f170-4805-47c3-bcff-e9930dc3a447,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:22.498417 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-486d1fdb-8751-4a13-89ce-d4fba4f394b5 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.507299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 36, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:36:22.507780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Checking segment: {'id': 'dd5276a6-9f88-4209-b309-364e993c7d16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'dac2e936-f8ee-4a2b-a276-bb54b1891d12'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:22.508250 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.508717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Bound using segment: {'id': 'dd5276a6-9f88-4209-b309-364e993c7d16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'dac2e936-f8ee-4a2b-a276-bb54b1891d12'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:36:22.509991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Bound port: e55b19d5-201e-48dc-a950-548b39183637, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dd5276a6-9f88-4209-b309-364e993c7d16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'dac2e936-f8ee-4a2b-a276-bb54b1891d12'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:36:22.510505 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.517856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58240) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:22.532263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-486b973e-16bf-4110-96b1-b997f7da16f9 None None] Provisioning complete for port 8ce13741-e17a-4578-b5d3-3b3a8965545f triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:22.533015 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-486b973e-16bf-4110-96b1-b997f7da16f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.561357 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63372a7c-8451-490a-83f1-64fb46653951 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.565242 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-63372a7c-8451-490a-83f1-64fb46653951 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 1.2299452 May 12 15:36:22.572955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58244) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:22.576259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63372a7c-8451-490a-83f1-64fb46653951 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bc66b612-07ef-483e-abaf-b2be284b3e39,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:22.578932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f6854cf2-a8f0-461a-a97a-968aa556cc56 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': 'bc66b612-07ef-483e-abaf-b2be284b3e39', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:22.580705 n-d-841483-1 neutron-server[88152]: WARNING neutron.api.v2.base [None req-f6854cf2-a8f0-461a-a97a-968aa556cc56 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. May 12 15:36:22.581202 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-f6854cf2-a8f0-461a-a97a-968aa556cc56 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:22.582652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f6854cf2-a8f0-461a-a97a-968aa556cc56 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0073092 May 12 15:36:22.594417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58248) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:22.598930 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ee2cc7cf-ccbf-4f39-af58-2ad85995f523 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.607100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8c775da6-9359-4844-bb80-e8db9e85e7e0 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': 'bc66b612-07ef-483e-abaf-b2be284b3e39', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:22.607781 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-8c775da6-9359-4844-bb80-e8db9e85e7e0 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. May 12 15:36:22.608447 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-8c775da6-9359-4844-bb80-e8db9e85e7e0 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:22.613343 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8c775da6-9359-4844-bb80-e8db9e85e7e0 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0143185 May 12 15:36:22.614483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58252) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:22.627246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b1907991-e6f6-428c-8133-5852901f7b84 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': 'bc66b612-07ef-483e-abaf-b2be284b3e39', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:22.628082 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-b1907991-e6f6-428c-8133-5852901f7b84 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. May 12 15:36:22.628902 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-b1907991-e6f6-428c-8133-5852901f7b84 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:22.632519 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b1907991-e6f6-428c-8133-5852901f7b84 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0153856 May 12 15:36:22.641965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58256) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:22.653182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-199e37c9-c5ba-4088-8380-2d7dadacf6eb tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': 'bc66b612-07ef-483e-abaf-b2be284b3e39', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '256'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:22.654085 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-199e37c9-c5ba-4088-8380-2d7dadacf6eb tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. May 12 15:36:22.654571 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-199e37c9-c5ba-4088-8380-2d7dadacf6eb tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:22.660133 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-199e37c9-c5ba-4088-8380-2d7dadacf6eb tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0122335 May 12 15:36:22.660133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58260) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:22.671544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ee2cc7cf-ccbf-4f39-af58-2ad85995f523 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:22.701321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f1836db-704e-4f17-9e75-d6fda4dc2d06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:22.702056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7f1836db-704e-4f17-9e75-d6fda4dc2d06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:22.716769 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa9d4f95-9631-41f4-a475-a89b982ca199 req-408d19a7-860e-4677-b352-00bf897bbfdb service neutron] 10.222.0.84 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2758412 May 12 15:36:22.724854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-486d1fdb-8751-4a13-89ce-d4fba4f394b5 None None] Calling delete_port for 1880f170-4805-47c3-bcff-e9930dc3a447 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:22.747799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ee2cc7cf-ccbf-4f39-af58-2ad85995f523 admin admin] Usage tracker for resource:security_group_rule and tenant:129b328f09ae44ad8ab931e64b13c4eb is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:22.796854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-486b973e-16bf-4110-96b1-b997f7da16f9 None None] Port 8ce13741-e17a-4578-b5d3-3b3a8965545f cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:36:22.807591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ee2cc7cf-ccbf-4f39-af58-2ad85995f523 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:22.835205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7f1836db-704e-4f17-9e75-d6fda4dc2d06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:22.839062 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7f1836db-704e-4f17-9e75-d6fda4dc2d06 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.1 HTTP/1.1" status: 200 len: 923 time: 0.4685245 May 12 15:36:22.839256 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ee2cc7cf-ccbf-4f39-af58-2ad85995f523 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:22.840297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58264) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:22.841995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Allocated IP 172.25.8.182 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/31e29158-543f-4714-837f-4489590b163b) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:22.851061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] For port e55b19d5-201e-48dc-a950-548b39183637, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:36:22.855671 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-67d0c718-c33d-451c-9170-1ee88b70c329 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.862291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] For port e55b19d5-201e-48dc-a950-548b39183637, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e55b19d5-201e-48dc-a950-548b39183637,segment=NetworkSegment(dd5276a6-9f88-4209-b309-364e993c7d16),segment_id=dd5276a6-9f88-4209-b309-364e993c7d16)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:36:22.862546 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-67d0c718-c33d-451c-9170-1ee88b70c329 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.868144 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.905604 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-486d1fdb-8751-4a13-89ce-d4fba4f394b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.911583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d801f53c-233a-4242-ad47-f92f29b98d94 req-c911a450-db59-48cb-9100-40ac53c55adb tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:22.913153 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91cd968c-4dee-416a-9076-4a52b1ae5b1d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.917102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d801f53c-233a-4242-ad47-f92f29b98d94 req-c911a450-db59-48cb-9100-40ac53c55adb tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.7419870 May 12 15:36:22.918750 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad4e3cc4-4a14-4723-8a6d-2c926d2d2f2e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:22.928504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58268) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:22.962015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-486d1fdb-8751-4a13-89ce-d4fba4f394b5 None None] No DVR routers for this DVR port 1880f170-4805-47c3-bcff-e9930dc3a447 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:36:22.963336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4b5d4e64-13b0-4910-8de7-0a4368d5239b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Request body: {'floatingip': {'port_id': 'd45db345-6e10-417e-8b52-3260151d6ba4'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:22.997969 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d217d70-4389-44f4-931f-efc98fc58218 None None] Pushing event updated for resources: {'Port': ['ID=e55b19d5-201e-48dc-a950-548b39183637,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:23.044177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-486d1fdb-8751-4a13-89ce-d4fba4f394b5 None None] Pushing event deleted for resources: {'Port': ['ID=1880f170-4805-47c3-bcff-e9930dc3a447,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:23.057119 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-67d0c718-c33d-451c-9170-1ee88b70c329 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:23.057852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-67d0c718-c33d-451c-9170-1ee88b70c329 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Fanout notify agent at l3_agent the message router_deleted on router 8b8e7749-e111-476a-884f-1e4731548b2a {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:36:23.140659 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa9d4f95-9631-41f4-a475-a89b982ca199 req-720836bc-5d03-471c-b444-1c3f75d524f9 service neutron] 10.222.0.84 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4166474 May 12 15:36:23.145108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91cd968c-4dee-416a-9076-4a52b1ae5b1d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:23.191781 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad4e3cc4-4a14-4723-8a6d-2c926d2d2f2e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:23.207914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4532748-6b00-4425-bd69-785fd6fc90b0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:23.216946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4532748-6b00-4425-bd69-785fd6fc90b0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:23.220349 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4532748-6b00-4425-bd69-785fd6fc90b0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:23.224794 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e4532748-6b00-4425-bd69-785fd6fc90b0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0. HTTP/1.1" status: 200 len: 2379 time: 0.3787234 May 12 15:36:23.235220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58272) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:23.244933 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b5d4e64-13b0-4910-8de7-0a4368d5239b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for floatingip, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:23.281891 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad4e3cc4-4a14-4723-8a6d-2c926d2d2f2e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:23.295780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad4e3cc4-4a14-4723-8a6d-2c926d2d2f2e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event deleted for resources: {'Subnet': ['ID=998b7d53-e75c-42d5-8cdf-0c16c4d8f933,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:23.300210 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-67d0c718-c33d-451c-9170-1ee88b70c329 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:23.304078 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-67d0c718-c33d-451c-9170-1ee88b70c329 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/routers/8b8e7749-e111-476a-884f-1e4731548b2a HTTP/1.1" status: 204 len: 168 time: 1.3156629 May 12 15:36:23.304759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58276) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:23.317836 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:23.330709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ad4e3cc4-4a14-4723-8a6d-2c926d2d2f2e tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "DELETE /v2.0/subnets/998b7d53-e75c-42d5-8cdf-0c16c4d8f933 HTTP/1.1" status: 204 len: 168 time: 2.0831785 May 12 15:36:23.372714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58280) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:23.447169 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e55b19d5-201e-48dc-a950-548b39183637 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:23.511553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6681c782-863a-4370-86c3-1eda53031668 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 8ce13741-e17a-4578-b5d3-3b3a8965545f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:23.511886 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6681c782-863a-4370-86c3-1eda53031668 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:23.523050 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ee2cc7cf-ccbf-4f39-af58-2ad85995f523 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:23.532733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a295f0e1-17c4-4023-90f8-46959ff1141a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:23.536548 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ee2cc7cf-ccbf-4f39-af58-2ad85995f523 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:23.554085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port e55b19d5-201e-48dc-a950-548b39183637 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:23.601586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee2cc7cf-ccbf-4f39-af58-2ad85995f523 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dfb22e82-4197-4086-8ade-044f6d335d93,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:23.604664 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91cd968c-4dee-416a-9076-4a52b1ae5b1d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:23.609744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ee2cc7cf-ccbf-4f39-af58-2ad85995f523 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=129b328f09ae44ad8ab931e64b13c4eb&name=default HTTP/1.1" status: 200 len: 2983 time: 1.0839550 May 12 15:36:23.612179 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a295f0e1-17c4-4023-90f8-46959ff1141a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:23.615773 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a295f0e1-17c4-4023-90f8-46959ff1141a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.3035071 May 12 15:36:23.617192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58284) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:23.617537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58286) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:23.644950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1880f170-4805-47c3-bcff-e9930dc3a447 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:36:23.664064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31ff9b96-cb20-4629-ba40-770b06902a69 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:23.664847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-31ff9b96-cb20-4629-ba40-770b06902a69 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Synchronizing usage tracker for tenant:09e0c5fd5fce41bf91599658e3eed992 on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:23.673811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91cd968c-4dee-416a-9076-4a52b1ae5b1d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc66b612-07ef-483e-abaf-b2be284b3e39,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:23.724023 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:23.770983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 1880f170-4805-47c3-bcff-e9930dc3a447 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:36:23.771350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1880f170-4805-47c3-bcff-e9930dc3a447 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:36:23.777565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b0f4aa9-97b7-4d96-be89-479218d5bb5e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:23.781757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7b0f4aa9-97b7-4d96-be89-479218d5bb5e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1615822 May 12 15:36:23.785556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58292) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:23.804195 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91cd968c-4dee-416a-9076-4a52b1ae5b1d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:23.808403 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-91cd968c-4dee-416a-9076-4a52b1ae5b1d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "DELETE /v2.0/security-groups/bc66b612-07ef-483e-abaf-b2be284b3e39 HTTP/1.1" status: 204 len: 168 time: 1.1449583 May 12 15:36:23.812083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58296) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:23.815399 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:23.839017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:23.848201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:23.892942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'Port': ['ID=31e29158-543f-4714-837f-4489590b163b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:23.895333 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2240677c-632d-42f5-8135-a3160f71f041 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:24.001966 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2240677c-632d-42f5-8135-a3160f71f041 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:24.012996 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7cbb1da1-6289-4219-ad95-4e37f79ea738 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.1998274 May 12 15:36:24.029747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58300) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:24.044945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group': {'name': 'tempest-secgroup--368558167'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:24.058134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:24.080106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:24.104135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-31ff9b96-cb20-4629-ba40-770b06902a69 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Unset dirty status for tenant:09e0c5fd5fce41bf91599658e3eed992 on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:24.109358 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-31ff9b96-cb20-4629-ba40-770b06902a69 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.6740301 May 12 15:36:24.111896 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f62ee0dc-f75f-487b-97d0-3d8dd4fded11 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.3211136 May 12 15:36:24.112721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58304) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:24.116934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58306) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:24.117718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:24.130697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:24.160419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:24.217918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d79f091-3b8d-495e-a6ac-55c12894736f None None] Network dac2e936-f8ee-4a2b-a276-bb54b1891d12 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:24.250177 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:24.285902 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2240677c-632d-42f5-8135-a3160f71f041 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:24.378265 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2240677c-632d-42f5-8135-a3160f71f041 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dfb22e82-4197-4086-8ade-044f6d335d93,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:24.383143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:24.397795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:24.407612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:24.410089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:24.414363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:24.418780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:24.426443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:24.431100 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2240677c-632d-42f5-8135-a3160f71f041 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:24.434833 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2240677c-632d-42f5-8135-a3160f71f041 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/dfb22e82-4197-4086-8ade-044f6d335d93 HTTP/1.1" status: 204 len: 168 time: 0.8138719 May 12 15:36:24.435011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:24.463101 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:24.478195 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a7eca07e-2b6c-4500-9ef9-18ff3145dafd None None] Provisioning for port e55b19d5-201e-48dc-a950-548b39183637 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:24.486583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a7eca07e-2b6c-4500-9ef9-18ff3145dafd None None] Provisioning complete for port e55b19d5-201e-48dc-a950-548b39183637 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:24.488721 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a7eca07e-2b6c-4500-9ef9-18ff3145dafd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:24.534591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:24.538553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:24.558874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Deleting port e55b19d5-201e-48dc-a950-548b39183637 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:24.559243 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:24.671714 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6681c782-863a-4370-86c3-1eda53031668 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:24.710610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] DHCP port deletion for dac2e936-f8ee-4a2b-a276-bb54b1891d12 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:36:24.720534 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] Deleting port e55b19d5-201e-48dc-a950-548b39183637 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:24.721274 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:24.762876 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a7eca07e-2b6c-4500-9ef9-18ff3145dafd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:24.858323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6681c782-863a-4370-86c3-1eda53031668 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for 8ce13741-e17a-4578-b5d3-3b3a8965545f owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:24.861753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a7eca07e-2b6c-4500-9ef9-18ff3145dafd None None] For port e55b19d5-201e-48dc-a950-548b39183637, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e55b19d5-201e-48dc-a950-548b39183637,segment=NetworkSegment(dd5276a6-9f88-4209-b309-364e993c7d16),segment_id=dd5276a6-9f88-4209-b309-364e993c7d16)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:24.867833 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a7eca07e-2b6c-4500-9ef9-18ff3145dafd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:24.882410 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:24.895487 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.039063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7eca07e-2b6c-4500-9ef9-18ff3145dafd None None] Pushing event updated for resources: {'Port': ['ID=e55b19d5-201e-48dc-a950-548b39183637,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:25.042912 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] For port e55b19d5-201e-48dc-a950-548b39183637, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e55b19d5-201e-48dc-a950-548b39183637,segment=NetworkSegment(dd5276a6-9f88-4209-b309-364e993c7d16),segment_id=dd5276a6-9f88-4209-b309-364e993c7d16)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:25.043550 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.057816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event updated for resources: {'SecurityGroup': ['ID=654e5200-75c3-4b0f-b303-9d7b5558c351,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:25.094215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] For port e55b19d5-201e-48dc-a950-548b39183637, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e55b19d5-201e-48dc-a950-548b39183637,segment=NetworkSegment(dd5276a6-9f88-4209-b309-364e993c7d16),segment_id=dd5276a6-9f88-4209-b309-364e993c7d16)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:25.094898 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.131832 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.133093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-78dd760f-f15a-46af-8573-95cba3b6a830 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 1.1025403 May 12 15:36:25.144630 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58324) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:25.160282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a9fd15ce-c927-4c98-8192-0d0e2f7e729c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': '654e5200-75c3-4b0f-b303-9d7b5558c351', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:25.161872 n-d-841483-1 neutron-server[88152]: WARNING neutron.api.v2.base [None req-a9fd15ce-c927-4c98-8192-0d0e2f7e729c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 May 12 15:36:25.163332 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-a9fd15ce-c927-4c98-8192-0d0e2f7e729c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:25.170576 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a9fd15ce-c927-4c98-8192-0d0e2f7e729c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0247762 May 12 15:36:25.194421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58330) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:25.200544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] Calling delete_port for e55b19d5-201e-48dc-a950-548b39183637 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:25.272906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Calling delete_port for e55b19d5-201e-48dc-a950-548b39183637 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:25.298108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0e4d4700-a43b-4bda-8c94-0a213b157d12 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': '654e5200-75c3-4b0f-b303-9d7b5558c351', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:25.320124 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:36:25.320684 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:36:25.328106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.objects.ports [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88152) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:36:25.336996 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.344973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0e4d4700-a43b-4bda-8c94-0a213b157d12 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:25.382020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e55b19d5-201e-48dc-a950-548b39183637 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:36:25.392920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0e4d4700-a43b-4bda-8c94-0a213b157d12 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:25.410447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0e4d4700-a43b-4bda-8c94-0a213b157d12 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:25.429090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0e4d4700-a43b-4bda-8c94-0a213b157d12 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:25.447354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:25.457712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:25.461206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:25.462892 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.474876 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6ff5b11-6213-437c-98fb-25c91a228d40 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:25.476682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=6683876a-b3b0-4c08-b9c6-49d4d18a7c85,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:25.486715 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.516587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-52a990a8-7ea8-4d37-a216-d3b1f30b1d00 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.3953593 May 12 15:36:25.520730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58340) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:25.534946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8b32d842-fd93-4a84-b2dd-cd2c4f1cbba7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:25.630797 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-0e4d4700-a43b-4bda-8c94-0a213b157d12 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:25.635152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0e4d4700-a43b-4bda-8c94-0a213b157d12 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.3825872 May 12 15:36:25.638557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58346) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:25.645118 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.682678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-43c1dd9f-6019-47c6-8492-7b7ed147b29f tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': '654e5200-75c3-4b0f-b303-9d7b5558c351', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:25.683157 n-d-841483-1 neutron-server[88152]: WARNING neutron.api.v2.base [None req-43c1dd9f-6019-47c6-8492-7b7ed147b29f tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 May 12 15:36:25.683645 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-43c1dd9f-6019-47c6-8492-7b7ed147b29f tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:25.687693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-43c1dd9f-6019-47c6-8492-7b7ed147b29f tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0452788 May 12 15:36:25.691442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58350) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:25.710862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port e55b19d5-201e-48dc-a950-548b39183637, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e55b19d5-201e-48dc-a950-548b39183637,segment=NetworkSegment(dd5276a6-9f88-4209-b309-364e993c7d16),segment_id=dd5276a6-9f88-4209-b309-364e993c7d16)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:25.742355 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.750405 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.774275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-06c6fbfd-3d11-4cfe-9831-f82377ad2f8b tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': '654e5200-75c3-4b0f-b303-9d7b5558c351', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:25.782704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b5d4e64-13b0-4910-8de7-0a4368d5239b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.784571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6681c782-863a-4370-86c3-1eda53031668 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.790417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-06c6fbfd-3d11-4cfe-9831-f82377ad2f8b tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:25.799513 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b5d4e64-13b0-4910-8de7-0a4368d5239b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.830854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] Deleting port e55b19d5-201e-48dc-a950-548b39183637 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:25.831221 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.952641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8b32d842-fd93-4a84-b2dd-cd2c4f1cbba7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:25.965176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8b32d842-fd93-4a84-b2dd-cd2c4f1cbba7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:25.966278 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '6683876a-b3b0-4c08-b9c6-49d4d18a7c85'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:36:25.967091 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:25.968838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8b32d842-fd93-4a84-b2dd-cd2c4f1cbba7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:25.978058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8b32d842-fd93-4a84-b2dd-cd2c4f1cbba7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:26.018469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=e55b19d5-201e-48dc-a950-548b39183637,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:26.068548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-06c6fbfd-3d11-4cfe-9831-f82377ad2f8b tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:26.074051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8b32d842-fd93-4a84-b2dd-cd2c4f1cbba7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:26.077625 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b32d842-fd93-4a84-b2dd-cd2c4f1cbba7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:26.094350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-06c6fbfd-3d11-4cfe-9831-f82377ad2f8b tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:26.174871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6681c782-863a-4370-86c3-1eda53031668 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=8ce13741-e17a-4578-b5d3-3b3a8965545f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:26.193177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-06c6fbfd-3d11-4cfe-9831-f82377ad2f8b tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:26.197543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:36:26.197902 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:36:26.336590 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:26.345993 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:26.495768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] For port e55b19d5-201e-48dc-a950-548b39183637, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e55b19d5-201e-48dc-a950-548b39183637,segment=NetworkSegment(dd5276a6-9f88-4209-b309-364e993c7d16),segment_id=dd5276a6-9f88-4209-b309-364e993c7d16)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:26.496772 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:26.502190 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-06c6fbfd-3d11-4cfe-9831-f82377ad2f8b tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:26.506041 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-06c6fbfd-3d11-4cfe-9831-f82377ad2f8b tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.7809629 May 12 15:36:26.507795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58368) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:26.510652 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6681c782-863a-4370-86c3-1eda53031668 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:26.540367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-53b44445-bf1c-4d88-a741-01b5153ebb31 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': '654e5200-75c3-4b0f-b303-9d7b5558c351', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:26.540367 n-d-841483-1 neutron-server[88152]: WARNING neutron.api.v2.base [None req-53b44445-bf1c-4d88-a741-01b5153ebb31 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 May 12 15:36:26.540367 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-53b44445-bf1c-4d88-a741-01b5153ebb31 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:26.540367 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-53b44445-bf1c-4d88-a741-01b5153ebb31 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0199215 May 12 15:36:26.544475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58372) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:26.561109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-fb6d18e2-e482-4ec8-a817-a4aa3cfbf9ea tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': '654e5200-75c3-4b0f-b303-9d7b5558c351', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:26.575229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'Port': ['ID=31e29158-543f-4714-837f-4489590b163b,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:26.581196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fb6d18e2-e482-4ec8-a817-a4aa3cfbf9ea tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:26.583683 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:26.595615 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6681c782-863a-4370-86c3-1eda53031668 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/8ce13741-e17a-4578-b5d3-3b3a8965545f HTTP/1.1" status: 204 len: 168 time: 3.3593564 May 12 15:36:26.605343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58378) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:26.653004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fb6d18e2-e482-4ec8-a817-a4aa3cfbf9ea tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:26.664061 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-f0a997f0-3ba7-4f31-acf8-623b4cc08830 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] GET failed (client error): The resource could not be found. May 12 15:36:26.665146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f0a997f0-3ba7-4f31-acf8-623b4cc08830 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:26.666148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fb6d18e2-e482-4ec8-a817-a4aa3cfbf9ea tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:26.688791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] Calling delete_port for e55b19d5-201e-48dc-a950-548b39183637 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:26.691758 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fb6d18e2-e482-4ec8-a817-a4aa3cfbf9ea tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:26.698663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Deleting port e55b19d5-201e-48dc-a950-548b39183637 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:26.699224 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:26.725800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Allocated IP 2001:db8::f816:3eff:feb7:15cd (2447b094-d5d6-41ef-a146-2bf56f5399af/6683876a-b3b0-4c08-b9c6-49d4d18a7c85/ed6f345a-7eb3-4e2c-a186-356114e8a7e0) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:26.750711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4b5d4e64-13b0-4910-8de7-0a4368d5239b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Router 3b0baf01-29b6-49bc-81af-4ed638af06f3 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:36:26.771160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f0a997f0-3ba7-4f31-acf8-623b4cc08830 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:26.772667 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f0a997f0-3ba7-4f31-acf8-623b4cc08830 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/8ce13741-e17a-4578-b5d3-3b3a8965545f HTTP/1.1" status: 404 len: 333 time: 0.1664517 May 12 15:36:26.785684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58386) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:26.866941 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-fb6d18e2-e482-4ec8-a817-a4aa3cfbf9ea tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:26.871863 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fb6d18e2-e482-4ec8-a817-a4aa3cfbf9ea tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.3226099 May 12 15:36:26.874496 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b32d842-fd93-4a84-b2dd-cd2c4f1cbba7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:26.879117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58392) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:26.897884 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:26.926693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-97274f06-b2fd-4cad-97dd-1d5010c7be83 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': '654e5200-75c3-4b0f-b303-9d7b5558c351', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:26.927193 n-d-841483-1 neutron-server[88152]: WARNING neutron.api.v2.base [None req-97274f06-b2fd-4cad-97dd-1d5010c7be83 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 May 12 15:36:26.927673 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-97274f06-b2fd-4cad-97dd-1d5010c7be83 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:26.931428 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-97274f06-b2fd-4cad-97dd-1d5010c7be83 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0140662 May 12 15:36:26.936474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58398) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:26.942711 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Floating IP fc5f0f39-1ca9-4a2c-9398-973ed092569a associated. External IP: 172.25.8.182, port: 4f36023c-143c-4389-b26c-f62679404834. May 12 15:36:26.958021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] Pushing event deleted for resources: {'Port': ['ID=e55b19d5-201e-48dc-a950-548b39183637,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:26.966888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01efb413-4be5-42f4-9633-56e074aaea69 None None] No DVR routers for this DVR port e55b19d5-201e-48dc-a950-548b39183637 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:36:26.992334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-47fb5e9f-9fd5-4e28-b28b-01c198aaa842 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 1c1974b7-bdd4-462d-8233-63cbbf69a280 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:26.992691 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-47fb5e9f-9fd5-4e28-b28b-01c198aaa842 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:27.063585 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:27.076376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Transition to ACTIVE for port object ed6f345a-7eb3-4e2c-a186-356114e8a7e0 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:27.090823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b32d842-fd93-4a84-b2dd-cd2c4f1cbba7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=33386b3c-0502-4a8c-8c5c-e38ca9307dd2,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:27.105134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d846fa4c-4772-4bc9-88f7-ed658623d83d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': '654e5200-75c3-4b0f-b303-9d7b5558c351', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:27.110554 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] The port 'e55b19d5-201e-48dc-a950-548b39183637' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:36:27.120131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b32d842-fd93-4a84-b2dd-cd2c4f1cbba7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:27.120840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Transition to ACTIVE for port object ed6f345a-7eb3-4e2c-a186-356114e8a7e0 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:27.121451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d846fa4c-4772-4bc9-88f7-ed658623d83d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:27.126822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8b32d842-fd93-4a84-b2dd-cd2c4f1cbba7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:27.132581 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b32d842-fd93-4a84-b2dd-cd2c4f1cbba7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:27.133158 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b32d842-fd93-4a84-b2dd-cd2c4f1cbba7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:27.134382 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:27.158224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d846fa4c-4772-4bc9-88f7-ed658623d83d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:27.162700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d846fa4c-4772-4bc9-88f7-ed658623d83d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:27.227512 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:27.231219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:27.237979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:27.244384 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Pushing event updated for resources: {'Port': ['ID=ed6f345a-7eb3-4e2c-a186-356114e8a7e0,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:27.256454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d846fa4c-4772-4bc9-88f7-ed658623d83d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:27.264092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8b32d842-fd93-4a84-b2dd-cd2c4f1cbba7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.7419219 May 12 15:36:27.286182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58406) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:27.352639 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'mac_address': 'fa:16:3e:89:68:74', 'name': 'tempest-NetworksTestDHCPv6-1485112906'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:27.382206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Attempting to bind port ed6f345a-7eb3-4e2c-a186-356114e8a7e0 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:36:27.382662 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Attempting to bind port ed6f345a-7eb3-4e2c-a186-356114e8a7e0 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:36:27.383018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Attempting to bind port ed6f345a-7eb3-4e2c-a186-356114e8a7e0 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:36:27.391644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 36, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:36:27.392068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:27.392457 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:27.392844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:36:27.394438 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Bound port: ed6f345a-7eb3-4e2c-a186-356114e8a7e0, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:36:27.394847 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:27.409527 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:27.511257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] For port ed6f345a-7eb3-4e2c-a186-356114e8a7e0, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:36:27.517446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] For port ed6f345a-7eb3-4e2c-a186-356114e8a7e0, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ed6f345a-7eb3-4e2c-a186-356114e8a7e0,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:36:27.523801 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:27.616196 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-d846fa4c-4772-4bc9-88f7-ed658623d83d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:27.617688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d846fa4c-4772-4bc9-88f7-ed658623d83d tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.6768668 May 12 15:36:27.646851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7220effa-0812-4f3b-b6a2-a53f90dfc6f0 None None] Pushing event updated for resources: {'Port': ['ID=ed6f345a-7eb3-4e2c-a186-356114e8a7e0,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:27.650248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58416) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:27.670317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-eaeac1da-c5ce-46f8-87b7-a9395bde48fe tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': '654e5200-75c3-4b0f-b303-9d7b5558c351', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:27.675586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4b5d4e64-13b0-4910-8de7-0a4368d5239b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:36:27.682323 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b5d4e64-13b0-4910-8de7-0a4368d5239b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:27.688831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3803434d-0c4f-4073-a0e0-dc576b1dc662 None None] Sync routers for ids ['3b0baf01-29b6-49bc-81af-4ed638af06f3'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:36:27.707906 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3803434d-0c4f-4073-a0e0-dc576b1dc662 None None] Routers {'3b0baf01-29b6-49bc-81af-4ed638af06f3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:36:27.708894 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3803434d-0c4f-4073-a0e0-dc576b1dc662 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:36:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b0baf01-29b6-49bc-81af-4ed638af06f3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:27.725662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:27.732370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dac2e936-f8ee-4a2b-a276-bb54b1891d12']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:27.742731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-eaeac1da-c5ce-46f8-87b7-a9395bde48fe tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:27.746876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:port and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:27.752999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:27.756040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dd5276a6-9f88-4209-b309-364e993c7d16') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:27.756335 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dd5276a6-9f88-4209-b309-364e993c7d16') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:27.757321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-eaeac1da-c5ce-46f8-87b7-a9395bde48fe tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:27.766084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-eaeac1da-c5ce-46f8-87b7-a9395bde48fe tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:27.771825 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:27.788175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:27.855327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-eaeac1da-c5ce-46f8-87b7-a9395bde48fe tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:27.875005 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:27.879587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'tag': 'd45db345-6e10-417e-8b52-3260151d6ba4'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:36:27.897598 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-47fb5e9f-9fd5-4e28-b28b-01c198aaa842 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:27.918091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Releasing vlan 564 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:36:27.918942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:27.921127 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: timer() May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:36:27.972266 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:36:28.087038 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-3803434d-0c4f-4073-a0e0-dc576b1dc662 None None] Set router 3b0baf01-29b6-49bc-81af-4ed638af06f3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:36:28.111064 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4a69221d-9e2b-4199-b1b6-d711d1960de7'] response: {'name': 'network-changed', 'server_uuid': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'tag': 'd45db345-6e10-417e-8b52-3260151d6ba4', 'status': 'completed', 'code': 200} May 12 15:36:28.257627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-47fb5e9f-9fd5-4e28-b28b-01c198aaa842 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for 1c1974b7-bdd4-462d-8233-63cbbf69a280 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:28.378029 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-eaeac1da-c5ce-46f8-87b7-a9395bde48fe tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:28.379387 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-eaeac1da-c5ce-46f8-87b7-a9395bde48fe tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.7249298 May 12 15:36:28.381634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:36:28.386496 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4b5d4e64-13b0-4910-8de7-0a4368d5239b tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "PUT /v2.0/floatingips/97ecb4c0-5dfe-4885-9fdc-e38dfbd87b5a HTTP/1.1" status: 200 len: 993 time: 5.4454675 May 12 15:36:28.387549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58432) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:28.413346 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:28.444591 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:28.486595 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "DELETE /v2.0/networks/dac2e936-f8ee-4a2b-a276-bb54b1891d12 HTTP/1.1" status: 204 len: 168 time: 4.3614140 May 12 15:36:28.496246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58438) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:28.498826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08f7ff5-6fbb-4415-8b38-b7593839631c tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event deleted for resources: {'Network': ['ID=dac2e936-f8ee-4a2b-a276-bb54b1891d12,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:28.682815 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:28.702950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58c0cb88-7e3f-4bd7-8774-b4e5696a235d req-1496e971-8cc3-41c6-9929-f4d6f716d6b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:28.704691 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58c0cb88-7e3f-4bd7-8774-b4e5696a235d req-1496e971-8cc3-41c6-9929-f4d6f716d6b0 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 1096 time: 0.6447105 May 12 15:36:28.799451 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3803434d-0c4f-4073-a0e0-dc576b1dc662 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:25Z', 'revision_number': 4, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '97ecb4c0-5dfe-4885-9fdc-e38dfbd87b5a', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'floating_ip_address': '172.25.8.156', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'port_id': 'd45db345-6e10-417e-8b52-3260151d6ba4', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 2661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'mac_address': 'fa:16:3e:bc:94:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:34:31Z', 'updated_at': '2022-05-12T15:36:25Z', 'revision_number': 3, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2cefb78b-eff7-47cb-8160-89f1ff42943b', 'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'mac_address': 'fa:16:3e:ee:fd:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 2489, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:20Z', 'updated_at': '2022-05-12T15:32:39Z', 'revision_number': 5, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'subnets': [{'id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:28.807242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3803434d-0c4f-4073-a0e0-dc576b1dc662 None None] Checking router: 3b0baf01-29b6-49bc-81af-4ed638af06f3 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:36:28.816096 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4d398fb-bb19-4b92-b8ba-d0910ad67cd4 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:28.824081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3803434d-0c4f-4073-a0e0-dc576b1dc662 None None] Routers {'3b0baf01-29b6-49bc-81af-4ed638af06f3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:36:28.826640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3803434d-0c4f-4073-a0e0-dc576b1dc662 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:36:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b0baf01-29b6-49bc-81af-4ed638af06f3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:28.850365 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ef64c50-d3ac-4751-989b-dabe3a12e485 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:28.859343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 91b9efd1-d657-4259-a0df-e08a53fa2d4a yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:36:28.880390 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-47fb5e9f-9fd5-4e28-b28b-01c198aaa842 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:28.938487 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4d398fb-bb19-4b92-b8ba-d0910ad67cd4 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:28.983287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:36:28.995701 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b3c8346-6b38-46ba-a22a-3bfa713dbc89 None None] Sync routers for ids ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:36:29.015398 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b3c8346-6b38-46ba-a22a-3bfa713dbc89 None None] Routers {'6c52b572-4880-47dd-bc9e-8f2160f5c2e4'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:36:29.017716 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4b3c8346-6b38-46ba-a22a-3bfa713dbc89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:36:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:29.121630 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:29.178624 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4d398fb-bb19-4b92-b8ba-d0910ad67cd4 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:29.212699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f13bc5f3-95da-4928-88d4-c3e9785366c5 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:29.228201 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4d398fb-bb19-4b92-b8ba-d0910ad67cd4 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:29.229470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e4d398fb-bb19-4b92-b8ba-d0910ad67cd4 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "DELETE /v2.0/security-groups/654e5200-75c3-4b0f-b303-9d7b5558c351 HTTP/1.1" status: 204 len: 168 time: 0.8367884 May 12 15:36:29.234199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4d398fb-bb19-4b92-b8ba-d0910ad67cd4 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=654e5200-75c3-4b0f-b303-9d7b5558c351,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:29.348456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-78254802-3a9a-432c-868d-e91ccfbeb40f None None] Provisioning for port ed6f345a-7eb3-4e2c-a186-356114e8a7e0 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:29.426280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 172.20.0.4 (2447b094-d5d6-41ef-a146-2bf56f5399af/33386b3c-0502-4a8c-8c5c-e38ca9307dd2/91b9efd1-d657-4259-a0df-e08a53fa2d4a) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:29.445882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::f816:3eff:fe89:6874 (2447b094-d5d6-41ef-a146-2bf56f5399af/6683876a-b3b0-4c08-b9c6-49d4d18a7c85/91b9efd1-d657-4259-a0df-e08a53fa2d4a) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:29.462262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58448) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:29.499466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47fb5e9f-9fd5-4e28-b28b-01c198aaa842 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=1c1974b7-bdd4-462d-8233-63cbbf69a280,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:29.533039 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-4b3c8346-6b38-46ba-a22a-3bfa713dbc89 None None] Set router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:36:29.577651 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ef64c50-d3ac-4751-989b-dabe3a12e485 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:29.579249 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ed6f345a-7eb3-4e2c-a186-356114e8a7e0 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:29.623587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-3803434d-0c4f-4073-a0e0-dc576b1dc662 None None] Set router 3b0baf01-29b6-49bc-81af-4ed638af06f3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:36:29.647424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58c0cb88-7e3f-4bd7-8774-b4e5696a235d req-9fb9f3d0-ce8f-4cd4-a77c-6187a4f7022c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:29.648942 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58c0cb88-7e3f-4bd7-8774-b4e5696a235d req-9fb9f3d0-ce8f-4cd4-a77c-6187a4f7022c service neutron] 10.222.0.76 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 0.9352300 May 12 15:36:29.653471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-6ef64c50-d3ac-4751-989b-dabe3a12e485 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fd19b8f0-fdcc-4650-99ab-6c20e6c2786f']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:29.665190 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-47fb5e9f-9fd5-4e28-b28b-01c198aaa842 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:29.761949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-6ef64c50-d3ac-4751-989b-dabe3a12e485 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '15501122-880e-4aaf-a64f-8d7d43dbbe2f') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:29.762249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-6ef64c50-d3ac-4751-989b-dabe3a12e485 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '15501122-880e-4aaf-a64f-8d7d43dbbe2f') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:29.798838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-be42bec4-5267-44c0-86a7-1ba4bcf0d991 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Synchronizing usage tracker for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:29.802866 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ef64c50-d3ac-4751-989b-dabe3a12e485 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:29.818280 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-47fb5e9f-9fd5-4e28-b28b-01c198aaa842 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/1c1974b7-bdd4-462d-8233-63cbbf69a280 HTTP/1.1" status: 204 len: 168 time: 3.0283444 May 12 15:36:29.818951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58460) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:29.854778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ed6f345a-7eb3-4e2c-a186-356114e8a7e0 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:29.862520 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ed6f345a-7eb3-4e2c-a186-356114e8a7e0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:29.862891 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:29.871437 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:29.896967 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58c0cb88-7e3f-4bd7-8774-b4e5696a235d req-6756ba5d-79aa-4824-aeff-2dbb9b25e3e7 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d45db345-6e10-417e-8b52-3260151d6ba4 HTTP/1.1" status: 200 len: 1001 time: 0.2182717 May 12 15:36:29.908329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object 91b9efd1-d657-4259-a0df-e08a53fa2d4a will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:29.910757 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ef64c50-d3ac-4751-989b-dabe3a12e485 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:29.938103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f7554725-4dd4-48fe-9093-ba751c5448d5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 8.7914381 May 12 15:36:29.939452 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58466) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:29.940035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'tag': '4f36023c-143c-4389-b26c-f62679404834'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:36:29.945498 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:29.987332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-be42bec4-5267-44c0-86a7-1ba4bcf0d991 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Unset dirty status for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:29.988545 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-be42bec4-5267-44c0-86a7-1ba4bcf0d991 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.4907591 May 12 15:36:29.997590 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-05acb038-9f7b-41dc-9091-84e9b16206e3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] GET failed (client error): The resource could not be found. May 12 15:36:29.998368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-05acb038-9f7b-41dc-9091-84e9b16206e3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:30.001150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58472) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:30.006917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6ef64c50-d3ac-4751-989b-dabe3a12e485 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Releasing vlan 586 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:36:30.007560 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ef64c50-d3ac-4751-989b-dabe3a12e485 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: timer() May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:36:30.026382 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:36:30.145408 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f7adaa6-679c-4c45-8e4a-d30997b2e3b1 None None] Update dhcp port {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'fixed_ips': [{'subnet_id': '6683876a-b3b0-4c08-b9c6-49d4d18a7c85', 'ip_address': '2001:db8::f816:3eff:feb7:15cd'}, {'subnet_id': '33386b3c-0502-4a8c-8c5c-e38ca9307dd2'}], 'binding:host_id': 'n-d-841483-1'}, 'id': 'ed6f345a-7eb3-4e2c-a186-356114e8a7e0'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:36:30.164965 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4ed2dc75-8590-4858-8d5c-6a41e9d3fe60'] response: {'name': 'network-changed', 'server_uuid': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'tag': '4f36023c-143c-4389-b26c-f62679404834', 'status': 'completed', 'code': 200} May 12 15:36:30.261121 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4f7adaa6-679c-4c45-8e4a-d30997b2e3b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:30.283280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=91b9efd1-d657-4259-a0df-e08a53fa2d4a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:30.304344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99377d04-281f-48f4-8a51-19c1b237793b tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.305482 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99377d04-281f-48f4-8a51-19c1b237793b tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.307236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99377d04-281f-48f4-8a51-19c1b237793b tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.308695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99377d04-281f-48f4-8a51-19c1b237793b tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.309858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99377d04-281f-48f4-8a51-19c1b237793b tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.311936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99377d04-281f-48f4-8a51-19c1b237793b tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.312683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99377d04-281f-48f4-8a51-19c1b237793b tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.314920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99377d04-281f-48f4-8a51-19c1b237793b tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.315530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99377d04-281f-48f4-8a51-19c1b237793b tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.317090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99377d04-281f-48f4-8a51-19c1b237793b tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.317725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99377d04-281f-48f4-8a51-19c1b237793b tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.323758 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-99377d04-281f-48f4-8a51-19c1b237793b tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 7678 time: 0.3754704 May 12 15:36:30.328678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58478) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:30.334499 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4b3c8346-6b38-46ba-a22a-3bfa713dbc89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:35:34Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'fc5f0f39-1ca9-4a2c-9398-973ed092569a', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'floating_ip_address': '172.25.8.182', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'port_id': '4f36023c-143c-4389-b26c-f62679404834', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 2819, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'mac_address': 'fa:16:3e:86:a3:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:36:24Z', 'updated_at': '2022-05-12T15:36:24Z', 'revision_number': 0, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63b42831-39a6-4a50-a6ab-4dce60dc93b6', 'name': '', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'mac_address': 'fa:16:3e:c5:e0:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 2707, 'fixed_ips': [{'subnet_id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:31Z', 'updated_at': '2022-05-12T15:35:53Z', 'revision_number': 5, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'subnets': [{'id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:30.346207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'tag': 'd45db345-6e10-417e-8b52-3260151d6ba4'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:36:30.357631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:30.358594 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b3c8346-6b38-46ba-a22a-3bfa713dbc89 None None] Checking router: 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:36:30.383264 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b3c8346-6b38-46ba-a22a-3bfa713dbc89 None None] Routers {'6c52b572-4880-47dd-bc9e-8f2160f5c2e4'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:36:30.383919 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4b3c8346-6b38-46ba-a22a-3bfa713dbc89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:36:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:30.390137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3637428f-6b90-4e24-afb4-198baa5bdd79 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group': {'name': 'tempest-secgroup--1854341102'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:30.448661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:30.449755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3637428f-6b90-4e24-afb4-198baa5bdd79 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:30.464994 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:30.480378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:30.494801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-05acb038-9f7b-41dc-9091-84e9b16206e3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:30.496157 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-05acb038-9f7b-41dc-9091-84e9b16206e3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/1c1974b7-bdd4-462d-8233-63cbbf69a280 HTTP/1.1" status: 404 len: 333 time: 0.6638007 May 12 15:36:30.498307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58c0cb88-7e3f-4bd7-8774-b4e5696a235d req-2de27884-3ddd-42f2-a9f9-0699d1e6814b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.499808 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58c0cb88-7e3f-4bd7-8774-b4e5696a235d req-2de27884-3ddd-42f2-a9f9-0699d1e6814b service neutron] 10.222.0.76 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.5906420 May 12 15:36:30.501211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58490) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:30.503531 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-23f63742-9015-44f4-9ab8-b06974ec1591'] response: {'name': 'network-changed', 'server_uuid': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'tag': 'd45db345-6e10-417e-8b52-3260151d6ba4', 'status': 'completed', 'code': 200} May 12 15:36:30.504468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3637428f-6b90-4e24-afb4-198baa5bdd79 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:30.587839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ed6f345a-7eb3-4e2c-a186-356114e8a7e0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ed6f345a-7eb3-4e2c-a186-356114e8a7e0,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:30.598432 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:30.620683 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ef64c50-d3ac-4751-989b-dabe3a12e485 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:30.622824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3637428f-6b90-4e24-afb4-198baa5bdd79 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:30.653918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52cb2d3f-926e-4c54-86a0-0a10fb784331 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.654421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52cb2d3f-926e-4c54-86a0-0a10fb784331 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.655092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52cb2d3f-926e-4c54-86a0-0a10fb784331 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.655640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52cb2d3f-926e-4c54-86a0-0a10fb784331 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.656135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52cb2d3f-926e-4c54-86a0-0a10fb784331 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.656748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52cb2d3f-926e-4c54-86a0-0a10fb784331 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.657245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52cb2d3f-926e-4c54-86a0-0a10fb784331 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.658275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52cb2d3f-926e-4c54-86a0-0a10fb784331 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.663258 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-52cb2d3f-926e-4c54-86a0-0a10fb784331 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 5175 time: 0.3187368 May 12 15:36:30.664092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58496) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:30.685176 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ef64c50-d3ac-4751-989b-dabe3a12e485 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:30.697730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.698508 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:30.701512 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6ef64c50-d3ac-4751-989b-dabe3a12e485 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "DELETE /v2.0/networks/fd19b8f0-fdcc-4650-99ab-6c20e6c2786f HTTP/1.1" status: 204 len: 168 time: 2.2005107 May 12 15:36:30.713792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58502) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:30.747180 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-4b3c8346-6b38-46ba-a22a-3bfa713dbc89 None None] Set router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:36:30.771237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-4f7adaa6-679c-4c45-8e4a-d30997b2e3b1 None None] Allocated IP 172.20.0.2 (2447b094-d5d6-41ef-a146-2bf56f5399af/33386b3c-0502-4a8c-8c5c-e38ca9307dd2/ed6f345a-7eb3-4e2c-a186-356114e8a7e0) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:30.783865 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a10fb1d5-c920-457f-a060-f90c710fd79c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 3.4897156 May 12 15:36:30.785156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58506) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:30.908506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ef64c50-d3ac-4751-989b-dabe3a12e485 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event deleted for resources: {'Network': ['ID=fd19b8f0-fdcc-4650-99ab-6c20e6c2786f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:30.910778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86b4c2f1-a823-422d-b966-4b4efe8ceec6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.913716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b282c7c9-cc97-4f35-ae26-2394642cd8d9 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:30.917672 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86b4c2f1-a823-422d-b966-4b4efe8ceec6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.918786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-86b4c2f1-a823-422d-b966-4b4efe8ceec6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:30.942336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3637428f-6b90-4e24-afb4-198baa5bdd79 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:30.947717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78cae8c9-8f1b-4ac1-aacb-25b88233ae2f req-a2442b40-5a8c-4f0d-83bc-6f07cd0ea349 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:30.949733 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78cae8c9-8f1b-4ac1-aacb-25b88233ae2f req-a2442b40-5a8c-4f0d-83bc-6f07cd0ea349 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3dd1fe8ad774471ba7745219a37ead53&device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 1135 time: 0.5822499 May 12 15:36:30.953078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-86b4c2f1-a823-422d-b966-4b4efe8ceec6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:30.958448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-86b4c2f1-a823-422d-b966-4b4efe8ceec6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1784 time: 0.1612513 May 12 15:36:30.959608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58514) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:31.013371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3637428f-6b90-4e24-afb4-198baa5bdd79 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:31.045315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3637428f-6b90-4e24-afb4-198baa5bdd79 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:31.063108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-5dd10b52-0378-4005-897f-61f782ccce38 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting subnet 25edc5b2-cce0-4f70-ac76-0af56ca5b570 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:36:31.068325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5dd10b52-0378-4005-897f-61f782ccce38 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:31.101483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4f7adaa6-679c-4c45-8e4a-d30997b2e3b1 None None] For port ed6f345a-7eb3-4e2c-a186-356114e8a7e0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ed6f345a-7eb3-4e2c-a186-356114e8a7e0,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:31.107661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3803434d-0c4f-4073-a0e0-dc576b1dc662 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:25Z', 'revision_number': 4, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '97ecb4c0-5dfe-4885-9fdc-e38dfbd87b5a', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'floating_ip_address': '172.25.8.156', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'port_id': 'd45db345-6e10-417e-8b52-3260151d6ba4', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 2661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'mac_address': 'fa:16:3e:bc:94:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:34:31Z', 'updated_at': '2022-05-12T15:36:25Z', 'revision_number': 3, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2cefb78b-eff7-47cb-8160-89f1ff42943b', 'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'mac_address': 'fa:16:3e:ee:fd:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 2489, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:20Z', 'updated_at': '2022-05-12T15:32:39Z', 'revision_number': 5, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'subnets': [{'id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:31.115522 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ed6f345a-7eb3-4e2c-a186-356114e8a7e0,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:31.123179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3803434d-0c4f-4073-a0e0-dc576b1dc662 None None] The sync data for ids ['3b0baf01-29b6-49bc-81af-4ed638af06f3'] in n-d-841483-1 is: [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:25Z', 'revision_number': 4, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '97ecb4c0-5dfe-4885-9fdc-e38dfbd87b5a', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'floating_ip_address': '172.25.8.156', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'port_id': 'd45db345-6e10-417e-8b52-3260151d6ba4', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 2661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'mac_address': 'fa:16:3e:bc:94:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:34:31Z', 'updated_at': '2022-05-12T15:36:25Z', 'revision_number': 3, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2cefb78b-eff7-47cb-8160-89f1ff42943b', 'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'mac_address': 'fa:16:3e:ee:fd:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 2489, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:20Z', 'updated_at': '2022-05-12T15:32:39Z', 'revision_number': 5, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'subnets': [{'id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:36:31.156829 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4f7adaa6-679c-4c45-8e4a-d30997b2e3b1 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:31.175719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2d1efb02-b209-4aac-81b2-c4de937a21c4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port 91b9efd1-d657-4259-a0df-e08a53fa2d4a {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:31.176061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d1efb02-b209-4aac-81b2-c4de937a21c4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:31.188317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4f7adaa6-679c-4c45-8e4a-d30997b2e3b1 None None] Transition to ACTIVE for port object ed6f345a-7eb3-4e2c-a186-356114e8a7e0 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:31.196092 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4f7adaa6-679c-4c45-8e4a-d30997b2e3b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:31.241666 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3637428f-6b90-4e24-afb4-198baa5bdd79 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:31.287757 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4b3c8346-6b38-46ba-a22a-3bfa713dbc89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:35:34Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'fc5f0f39-1ca9-4a2c-9398-973ed092569a', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'floating_ip_address': '172.25.8.182', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'port_id': '4f36023c-143c-4389-b26c-f62679404834', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 2819, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'mac_address': 'fa:16:3e:86:a3:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:36:24Z', 'updated_at': '2022-05-12T15:36:24Z', 'revision_number': 0, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63b42831-39a6-4a50-a6ab-4dce60dc93b6', 'name': '', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'mac_address': 'fa:16:3e:c5:e0:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 2707, 'fixed_ips': [{'subnet_id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:31Z', 'updated_at': '2022-05-12T15:35:53Z', 'revision_number': 5, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'subnets': [{'id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:31.288325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5dd10b52-0378-4005-897f-61f782ccce38 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:31.308745 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b3c8346-6b38-46ba-a22a-3bfa713dbc89 None None] The sync data for ids ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'] in n-d-841483-1 is: [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:35:34Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'fc5f0f39-1ca9-4a2c-9398-973ed092569a', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'floating_ip_address': '172.25.8.182', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'port_id': '4f36023c-143c-4389-b26c-f62679404834', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 2819, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'mac_address': 'fa:16:3e:86:a3:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:36:24Z', 'updated_at': '2022-05-12T15:36:24Z', 'revision_number': 0, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63b42831-39a6-4a50-a6ab-4dce60dc93b6', 'name': '', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'mac_address': 'fa:16:3e:c5:e0:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 2707, 'fixed_ips': [{'subnet_id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:31Z', 'updated_at': '2022-05-12T15:35:53Z', 'revision_number': 5, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'subnets': [{'id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:36:31.502374 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ed6f345a-7eb3-4e2c-a186-356114e8a7e0 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:31.552443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58c0cb88-7e3f-4bd7-8774-b4e5696a235d req-cb4f731e-aa0e-4ec2-bd61-7e89bdbdb999 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:31.553951 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58c0cb88-7e3f-4bd7-8774-b4e5696a235d req-cb4f731e-aa0e-4ec2-bd61-7e89bdbdb999 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 1.0455196 May 12 15:36:31.569374 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b282c7c9-cc97-4f35-ae26-2394642cd8d9 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:31.603785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f7adaa6-679c-4c45-8e4a-d30997b2e3b1 None None] Pushing event updated for resources: {'Port': ['ID=ed6f345a-7eb3-4e2c-a186-356114e8a7e0,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:31.737625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bed228ae-e019-41a7-b1fb-030bc828753c None None] New status for floating IP fc5f0f39-1ca9-4a2c-9398-973ed092569a: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:36:31.773192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d1efb02-b209-4aac-81b2-c4de937a21c4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:31.811791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b282c7c9-cc97-4f35-ae26-2394642cd8d9 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0bf56a0b-375f-40f3-a343-779ce0926402']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:31.875041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b282c7c9-cc97-4f35-ae26-2394642cd8d9 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9289b646-008e-43b9-b231-accffffb244a') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:31.875336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b282c7c9-cc97-4f35-ae26-2394642cd8d9 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9289b646-008e-43b9-b231-accffffb244a') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:31.924114 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b282c7c9-cc97-4f35-ae26-2394642cd8d9 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:31.944911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78cae8c9-8f1b-4ac1-aacb-25b88233ae2f req-fbe79d31-2554-4d11-a0c4-21750ac4bd9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:31.946658 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78cae8c9-8f1b-4ac1-aacb-25b88233ae2f req-fbe79d31-2554-4d11-a0c4-21750ac4bd9a service neutron] 10.222.0.84 "GET /v2.0/networks?id=d2e823c6-8acb-45b9-910c-0a4822a68f25 HTTP/1.1" status: 200 len: 897 time: 0.9901481 May 12 15:36:31.957635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2d1efb02-b209-4aac-81b2-c4de937a21c4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for 91b9efd1-d657-4259-a0df-e08a53fa2d4a owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:32.030128 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-76acc2bc-524f-4438-bebd-69c7663a28bb tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 2342 time: 1.3426142 May 12 15:36:32.033415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58524) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:32.083966 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3637428f-6b90-4e24-afb4-198baa5bdd79 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:32.091893 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b282c7c9-cc97-4f35-ae26-2394642cd8d9 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:32.115714 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5dd10b52-0378-4005-897f-61f782ccce38 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:32.167627 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3637428f-6b90-4e24-afb4-198baa5bdd79 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:32.200745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-996960fc-3b9f-4b40-af70-19b03189bdaa tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:32.201221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-996960fc-3b9f-4b40-af70-19b03189bdaa tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:32.203030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-996960fc-3b9f-4b40-af70-19b03189bdaa tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=6c52b572-4880-47dd-bc9e-8f2160f5c2e4 HTTP/1.1" status: 200 len: 1990 time: 0.1688540 May 12 15:36:32.239976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b282c7c9-cc97-4f35-ae26-2394642cd8d9 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Releasing vlan 580 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:36:32.240392 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b282c7c9-cc97-4f35-ae26-2394642cd8d9 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: timer() May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:36:32.276654 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:36:32.293889 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58c0cb88-7e3f-4bd7-8774-b4e5696a235d req-759f675e-2ff1-4e1b-8336-714c6edfe571 service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7070813 May 12 15:36:32.341145 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d1efb02-b209-4aac-81b2-c4de937a21c4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:32.405961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d1efb02-b209-4aac-81b2-c4de937a21c4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=91b9efd1-d657-4259-a0df-e08a53fa2d4a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:32.443356 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:32.613576 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d1efb02-b209-4aac-81b2-c4de937a21c4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:32.626550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-eac61c54-ea02-4969-a9af-b2e27f2309fc None None] Provisioning for port ed6f345a-7eb3-4e2c-a186-356114e8a7e0 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:32.634055 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2d1efb02-b209-4aac-81b2-c4de937a21c4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/91b9efd1-d657-4259-a0df-e08a53fa2d4a HTTP/1.1" status: 204 len: 168 time: 1.6695013 May 12 15:36:32.634342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-eac61c54-ea02-4969-a9af-b2e27f2309fc None None] Provisioning complete for port ed6f345a-7eb3-4e2c-a186-356114e8a7e0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:32.634547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58540) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:32.636921 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eac61c54-ea02-4969-a9af-b2e27f2309fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:32.702846 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78cae8c9-8f1b-4ac1-aacb-25b88233ae2f req-59d45c46-78d9-4646-b18e-290fb949c838 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4f36023c-143c-4389-b26c-f62679404834 HTTP/1.1" status: 200 len: 999 time: 0.7397749 May 12 15:36:32.704850 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58c0cb88-7e3f-4bd7-8774-b4e5696a235d req-25263e6c-5f22-4653-9e29-b61e7384c3b9 service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3363416 May 12 15:36:32.747410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33e7122d-b150-4769-8a1d-15f23c3410c2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:32.748902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33e7122d-b150-4769-8a1d-15f23c3410c2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:32.750716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33e7122d-b150-4769-8a1d-15f23c3410c2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:32.751699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-33e7122d-b150-4769-8a1d-15f23c3410c2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:32.791382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-33e7122d-b150-4769-8a1d-15f23c3410c2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:32.795587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-33e7122d-b150-4769-8a1d-15f23c3410c2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.1566427 May 12 15:36:32.797094 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58546) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:32.799020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3637428f-6b90-4e24-afb4-198baa5bdd79 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c030370e-e188-4021-bbb2-240b53c542a2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:32.803166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78cae8c9-8f1b-4ac1-aacb-25b88233ae2f req-ff86b07e-8eaf-4fe3-b82c-f731d72cc9a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:32.804618 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78cae8c9-8f1b-4ac1-aacb-25b88233ae2f req-ff86b07e-8eaf-4fe3-b82c-f731d72cc9a4 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=27cd1f2e-8b9d-4298-a44b-ce82945125a8 HTTP/1.1" status: 200 len: 835 time: 0.0689692 May 12 15:36:32.889638 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3637428f-6b90-4e24-afb4-198baa5bdd79 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:32.891332 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3637428f-6b90-4e24-afb4-198baa5bdd79 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 2.8668509 May 12 15:36:32.895911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58552) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:32.920314 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b282c7c9-cc97-4f35-ae26-2394642cd8d9 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:32.924496 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b282c7c9-cc97-4f35-ae26-2394642cd8d9 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:32.932284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ec0b25c1-900d-4f41-847e-f765cffd0360 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': 'c030370e-e188-4021-bbb2-240b53c542a2', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': 'bad_group_id'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:32.940272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-175cb95d-efed-4298-aa3a-400f52415ec5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 33386b3c-0502-4a8c-8c5c-e38ca9307dd2 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:36:32.957933 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-175cb95d-efed-4298-aa3a-400f52415ec5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:32.992558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b282c7c9-cc97-4f35-ae26-2394642cd8d9 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event deleted for resources: {'Network': ['ID=0bf56a0b-375f-40f3-a343-779ce0926402,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:32.996400 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5dd10b52-0378-4005-897f-61f782ccce38 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:32.996636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ec0b25c1-900d-4f41-847e-f765cffd0360 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:33.005709 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c4173ec5-7d02-4210-95ea-df45dd412e38 None None] Could not find standard attr ID for object 91b9efd1-d657-4259-a0df-e08a53fa2d4a. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:36:33.021042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ec0b25c1-900d-4f41-847e-f765cffd0360 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:33.026828 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ec0b25c1-900d-4f41-847e-f765cffd0360 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:33.036363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ec0b25c1-900d-4f41-847e-f765cffd0360 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:33.039751 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b282c7c9-cc97-4f35-ae26-2394642cd8d9 tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "DELETE /v2.0/networks/0bf56a0b-375f-40f3-a343-779ce0926402 HTTP/1.1" status: 204 len: 168 time: 2.3167684 May 12 15:36:33.046186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58558) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:33.055197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dd10b52-0378-4005-897f-61f782ccce38 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Subnet': ['ID=25edc5b2-cce0-4f70-ac76-0af56ca5b570,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:33.061177 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5dd10b52-0378-4005-897f-61f782ccce38 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:33.066849 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5dd10b52-0378-4005-897f-61f782ccce38 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/25edc5b2-cce0-4f70-ac76-0af56ca5b570 HTTP/1.1" status: 204 len: 168 time: 2.5595090 May 12 15:36:33.067909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58562) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:33.076640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c35ba109-0151-4bf4-b3d2-3dbc0f7f0b7e None None] Network 7cd0f48c-257b-44df-aa7b-edaebe2230c8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:33.192352 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88050d57-e174-4385-bf5e-0727e1b5c4cb tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:33.199153 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-175cb95d-efed-4298-aa3a-400f52415ec5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:33.205664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4604be3-27ee-4e52-9f0a-763365829883 req-b2e07cd8-3909-4940-ad31-30f31a927067 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:33.208067 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4604be3-27ee-4e52-9f0a-763365829883 req-b2e07cd8-3909-4940-ad31-30f31a927067 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 1096 time: 0.3993442 May 12 15:36:33.249086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78cae8c9-8f1b-4ac1-aacb-25b88233ae2f req-cc5100c0-54e7-4916-a811-e78a3d625691 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:33.251214 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78cae8c9-8f1b-4ac1-aacb-25b88233ae2f req-cc5100c0-54e7-4916-a811-e78a3d625691 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d2e823c6-8acb-45b9-910c-0a4822a68f25&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4076557 May 12 15:36:33.378223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:33.417098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ed6f345a-7eb3-4e2c-a186-356114e8a7e0 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:33.473968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-246b518b-3206-4842-863b-790a6534d8d0 None None] DHCP port deletion for 7cd0f48c-257b-44df-aa7b-edaebe2230c8 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:36:33.489528 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-246b518b-3206-4842-863b-790a6534d8d0 None None] Deleting port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:33.489994 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-246b518b-3206-4842-863b-790a6534d8d0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:33.542003 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-ec0b25c1-900d-4f41-847e-f765cffd0360 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The resource could not be found. May 12 15:36:33.543545 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ec0b25c1-900d-4f41-847e-f765cffd0360 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.6463830 May 12 15:36:33.545500 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88050d57-e174-4385-bf5e-0727e1b5c4cb tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:33.558821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58572) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:33.560155 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78cae8c9-8f1b-4ac1-aacb-25b88233ae2f req-525c4b72-7cef-45d1-8893-2bcb35e44875 service neutron] 10.222.0.84 "GET /v2.0/networks/d2e823c6-8acb-45b9-910c-0a4822a68f25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2951210 May 12 15:36:33.567477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:33.567812 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:33.574965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-79cab430-6cf5-4646-96fa-f481edbdce1f tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': 'c030370e-e188-4021-bbb2-240b53c542a2', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': '372d1729-ba5b-4464-b2a8-16d5f820f49d'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:33.593187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-79cab430-6cf5-4646-96fa-f481edbdce1f tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:33.618770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-88050d57-e174-4385-bf5e-0727e1b5c4cb tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['07aedea1-40b5-4fa3-96b2-b70f45608ea4']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:33.627809 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-79cab430-6cf5-4646-96fa-f481edbdce1f tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:33.627929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ed6f345a-7eb3-4e2c-a186-356114e8a7e0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:33.628333 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:33.634732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-79cab430-6cf5-4646-96fa-f481edbdce1f tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:33.643973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-88050d57-e174-4385-bf5e-0727e1b5c4cb tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f503f7dc-7fed-4789-b468-7e3c9a3bd2b1') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:33.644270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-88050d57-e174-4385-bf5e-0727e1b5c4cb tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f503f7dc-7fed-4789-b468-7e3c9a3bd2b1') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:33.651657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-79cab430-6cf5-4646-96fa-f481edbdce1f tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:33.662262 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88050d57-e174-4385-bf5e-0727e1b5c4cb tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:33.675924 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4604be3-27ee-4e52-9f0a-763365829883 req-990969e6-032b-4c79-a927-2485d76fb23b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:33.677479 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4604be3-27ee-4e52-9f0a-763365829883 req-990969e6-032b-4c79-a927-2485d76fb23b service neutron] 10.222.0.76 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 0.4612169 May 12 15:36:33.688206 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-175cb95d-efed-4298-aa3a-400f52415ec5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:33.717467 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88050d57-e174-4385-bf5e-0727e1b5c4cb tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:33.740561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-88050d57-e174-4385-bf5e-0727e1b5c4cb tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Releasing vlan 587 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:36:33.740974 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88050d57-e174-4385-bf5e-0727e1b5c4cb tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: timer() May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:36:33.758061 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:36:33.797237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-246b518b-3206-4842-863b-790a6534d8d0 None None] For port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7772c239-cfb8-4bdc-b803-ebc42d2aa9b6,segment=NetworkSegment(419e2b09-bea8-4f9b-9cb2-515718c00fbc),segment_id=419e2b09-bea8-4f9b-9cb2-515718c00fbc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:33.797666 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-246b518b-3206-4842-863b-790a6534d8d0 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:33.950159 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4604be3-27ee-4e52-9f0a-763365829883 req-b33fd7e8-7f38-41f0-8d52-2889a7177974 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d45db345-6e10-417e-8b52-3260151d6ba4 HTTP/1.1" status: 200 len: 1001 time: 0.2366931 May 12 15:36:33.978369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-246b518b-3206-4842-863b-790a6534d8d0 None None] Calling delete_port for 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:34.009093 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-79cab430-6cf5-4646-96fa-f481edbdce1f tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The resource could not be found. May 12 15:36:34.010341 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-79cab430-6cf5-4646-96fa-f481edbdce1f tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.4454007 May 12 15:36:34.015970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58592) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:34.020432 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88050d57-e174-4385-bf5e-0727e1b5c4cb tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.060195 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-88050d57-e174-4385-bf5e-0727e1b5c4cb tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.069194 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-175cb95d-efed-4298-aa3a-400f52415ec5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.119979 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88050d57-e174-4385-bf5e-0727e1b5c4cb tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] Pushing event deleted for resources: {'Network': ['ID=07aedea1-40b5-4fa3-96b2-b70f45608ea4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:34.129190 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-246b518b-3206-4842-863b-790a6534d8d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.149075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-175cb95d-efed-4298-aa3a-400f52415ec5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=33386b3c-0502-4a8c-8c5c-e38ca9307dd2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:34.156507 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-88050d57-e174-4385-bf5e-0727e1b5c4cb tempest-BulkNetworkOpsIpV6Test-983480945 tempest-BulkNetworkOpsIpV6Test-983480945-project] 10.222.0.82 "DELETE /v2.0/networks/07aedea1-40b5-4fa3-96b2-b70f45608ea4 HTTP/1.1" status: 204 len: 168 time: 1.1093729 May 12 15:36:34.175695 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-175cb95d-efed-4298-aa3a-400f52415ec5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.177530 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-175cb95d-efed-4298-aa3a-400f52415ec5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/33386b3c-0502-4a8c-8c5c-e38ca9307dd2 HTTP/1.1" status: 204 len: 168 time: 1.3794134 May 12 15:36:34.188610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4604be3-27ee-4e52-9f0a-763365829883 req-e2ee3677-7b25-4b01-ab62-d06303b75ee9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:34.189892 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18e6d5d5-08e0-4471-8133-787f044c34e2 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:34.190346 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4604be3-27ee-4e52-9f0a-763365829883 req-e2ee3677-7b25-4b01-ab62-d06303b75ee9 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.2272074 May 12 15:36:34.190887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58600) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:34.217878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-246b518b-3206-4842-863b-790a6534d8d0 None None] No DVR routers for this DVR port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:36:34.229786 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c90d1355-c368-4b3e-bb5c-fd75a3add0ae tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.236263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-246b518b-3206-4842-863b-790a6534d8d0 None None] Pushing event deleted for resources: {'Port': ['ID=7772c239-cfb8-4bdc-b803-ebc42d2aa9b6,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:34.287196 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c90d1355-c368-4b3e-bb5c-fd75a3add0ae tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.346576 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c90d1355-c368-4b3e-bb5c-fd75a3add0ae tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.382810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c90d1355-c368-4b3e-bb5c-fd75a3add0ae tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c030370e-e188-4021-bbb2-240b53c542a2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:34.389037 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c90d1355-c368-4b3e-bb5c-fd75a3add0ae tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.391885 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c90d1355-c368-4b3e-bb5c-fd75a3add0ae tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "DELETE /v2.0/security-groups/c030370e-e188-4021-bbb2-240b53c542a2 HTTP/1.1" status: 204 len: 168 time: 0.3750172 May 12 15:36:34.394654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58606) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:34.472518 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-78cae8c9-8f1b-4ac1-aacb-25b88233ae2f req-02c2a389-cca4-4bbf-a84c-18f5f5bd3b94 service neutron] 10.222.0.84 "GET /v2.0/networks/d2e823c6-8acb-45b9-910c-0a4822a68f25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8051815 May 12 15:36:34.486260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f165880d-090a-4e94-8eeb-a8527514bf81 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Synchronizing usage tracker for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:34.518132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f165880d-090a-4e94-8eeb-a8527514bf81 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Unset dirty status for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:34.521124 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f165880d-090a-4e94-8eeb-a8527514bf81 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.1249666 May 12 15:36:34.534114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58612) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:34.539182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] For port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7772c239-cfb8-4bdc-b803-ebc42d2aa9b6,segment=NetworkSegment(419e2b09-bea8-4f9b-9cb2-515718c00fbc),segment_id=419e2b09-bea8-4f9b-9cb2-515718c00fbc)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:34.539555 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.543608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7662d0a7-35ae-4ed4-b128-588b2b317403 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': 'f2bbf629-30ce-43a0-841c-460622eea93b', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:34.553953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7662d0a7-35ae-4ed4-b128-588b2b317403 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:34.558555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7662d0a7-35ae-4ed4-b128-588b2b317403 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:34.562057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7662d0a7-35ae-4ed4-b128-588b2b317403 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:34.569273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7662d0a7-35ae-4ed4-b128-588b2b317403 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:34.620807 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-7662d0a7-35ae-4ed4-b128-588b2b317403 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The resource could not be found. May 12 15:36:34.626128 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7662d0a7-35ae-4ed4-b128-588b2b317403 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.0862699 May 12 15:36:34.628251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58616) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:34.635782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-129fdee2-6409-47bc-9e2c-2ddbd831425c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group': {'name': 'tempest-secgroup--454798929'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:34.643698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-129fdee2-6409-47bc-9e2c-2ddbd831425c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:34.656902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-129fdee2-6409-47bc-9e2c-2ddbd831425c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:34.671564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-129fdee2-6409-47bc-9e2c-2ddbd831425c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.689012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58620) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:34.708801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-129fdee2-6409-47bc-9e2c-2ddbd831425c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:34.716678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-129fdee2-6409-47bc-9e2c-2ddbd831425c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:34.719511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:34.724700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-129fdee2-6409-47bc-9e2c-2ddbd831425c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:34.732630 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-129fdee2-6409-47bc-9e2c-2ddbd831425c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:34.881906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-129fdee2-6409-47bc-9e2c-2ddbd831425c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.888462 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-129fdee2-6409-47bc-9e2c-2ddbd831425c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.945302 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-129fdee2-6409-47bc-9e2c-2ddbd831425c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.950972 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-129fdee2-6409-47bc-9e2c-2ddbd831425c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 0.3218241 May 12 15:36:34.954392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58628) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:34.960355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group': {'name': 'tempest-secgroup--1523929482'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:34.982166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:34.982388 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-460098c8-ab95-45c2-beb3-0045d753b1e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 6683876a-b3b0-4c08-b9c6-49d4d18a7c85 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:36:34.985424 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-460098c8-ab95-45c2-beb3-0045d753b1e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:34.989497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:34.994065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-129fdee2-6409-47bc-9e2c-2ddbd831425c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3b45f1e9-ebfe-4592-a405-2782ada5cc0b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:34.996682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:35.005221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:35.022624 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:35.061310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:35.066400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:35.070559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:35.081003 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-460098c8-ab95-45c2-beb3-0045d753b1e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:35.088080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:35.135774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4604be3-27ee-4e52-9f0a-763365829883 req-2c27487e-83ff-449d-a25d-0ced271188e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:35.137666 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4604be3-27ee-4e52-9f0a-763365829883 req-2c27487e-83ff-449d-a25d-0ced271188e0 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.8230450 May 12 15:36:35.146526 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:36:35.146849 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:36:35.183288 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8fb7591e-1116-4e08-9307-5fe6982d8c88 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=09e0c5fd5fce41bf91599658e3eed992&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4878075 May 12 15:36:35.184193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58634) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:35.313658 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:35.325271 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:35.330380 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-460098c8-ab95-45c2-beb3-0045d753b1e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:35.361210 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe84631e-253a-4bf6-9d77-5ecbe547a959 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:35.387703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:36:35.389218 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe84631e-253a-4bf6-9d77-5ecbe547a959 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:35.395629 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4604be3-27ee-4e52-9f0a-763365829883 req-d26a3dbb-dcb8-4b98-a979-e9722a93cf1b service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2502065 May 12 15:36:35.441793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:36:35.442540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:36:35.456707 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe84631e-253a-4bf6-9d77-5ecbe547a959 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:35.489881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c3f72a9c-977a-4dd6-af69-1720a1051efd,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:35.517138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe84631e-253a-4bf6-9d77-5ecbe547a959 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c7c5121-c757-49f9-bac3-1a6dd1951e19,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:35.526323 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:35.527590 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c0af8b78-4fb9-4711-9ca0-6310151e4868 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 0.5720797 May 12 15:36:35.528697 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe84631e-253a-4bf6-9d77-5ecbe547a959 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:35.529717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fe84631e-253a-4bf6-9d77-5ecbe547a959 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1c7c5121-c757-49f9-bac3-1a6dd1951e19 HTTP/1.1" status: 204 len: 168 time: 0.3445525 May 12 15:36:35.532785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58640) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:35.542487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-cabad43e-14bc-43da-ac7c-8c91b54027a5 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group_rule': {'security_group_id': '3b45f1e9-ebfe-4592-a405-2782ada5cc0b', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '172.20.0.0/16', 'remote_group_id': 'c3f72a9c-977a-4dd6-af69-1720a1051efd'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:35.550773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cabad43e-14bc-43da-ac7c-8c91b54027a5 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:35.556930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cabad43e-14bc-43da-ac7c-8c91b54027a5 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:35.561302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cabad43e-14bc-43da-ac7c-8c91b54027a5 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:35.569286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cabad43e-14bc-43da-ac7c-8c91b54027a5 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:35.611549 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-cabad43e-14bc-43da-ac7c-8c91b54027a5 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:36:35.614147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6bc4b665-1ac4-46df-bf00-bcc357f0d462 None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:36:35.617214 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cabad43e-14bc-43da-ac7c-8c91b54027a5 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.0822182 May 12 15:36:35.617503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58650) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:35.658526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 7772c239-cfb8-4bdc-b803-ebc42d2aa9b6 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:35.659121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:35.687127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1fb028fd-cb4f-4a11-aade-ae180a851d44 None None] Provisioning complete for port ed6f345a-7eb3-4e2c-a186-356114e8a7e0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:35.687552 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1fb028fd-cb4f-4a11-aade-ae180a851d44 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:35.765801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] The port '7772c239-cfb8-4bdc-b803-ebc42d2aa9b6' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:36:35.832125 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-460098c8-ab95-45c2-beb3-0045d753b1e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:35.867000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bc4b665-1ac4-46df-bf00-bcc357f0d462 None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:36:35.914523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b392b404-b0fc-494f-8910-73355bcd6fb4 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:35.976399 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-460098c8-ab95-45c2-beb3-0045d753b1e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=6683876a-b3b0-4c08-b9c6-49d4d18a7c85,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:35.980668 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c4604be3-27ee-4e52-9f0a-763365829883 req-e52dac4f-6aed-4d9a-ae28-34b944bc8a7e service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5738578 May 12 15:36:36.008213 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-460098c8-ab95-45c2-beb3-0045d753b1e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.071132 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.082960 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b392b404-b0fc-494f-8910-73355bcd6fb4 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.099096 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-460098c8-ab95-45c2-beb3-0045d753b1e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/6683876a-b3b0-4c08-b9c6-49d4d18a7c85 HTTP/1.1" status: 204 len: 168 time: 1.8951144 May 12 15:36:36.101599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58668) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:36.137792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7cd0f48c-257b-44df-aa7b-edaebe2230c8']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:36.169095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '419e2b09-bea8-4f9b-9cb2-515718c00fbc') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:36.169689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '419e2b09-bea8-4f9b-9cb2-515718c00fbc') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:36.187565 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.207976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-eae96a38-09d1-4667-861a-1a67e5a2c9c9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:router {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:36.228095 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.230610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-eae96a38-09d1-4667-861a-1a67e5a2c9c9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:router {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:36.233148 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-eae96a38-09d1-4667-861a-1a67e5a2c9c9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1305361 May 12 15:36:36.236144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58676) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:36.246032 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b392b404-b0fc-494f-8910-73355bcd6fb4 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.249857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:36.270841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Releasing vlan 554 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:36:36.271195 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.305698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa8c4447-4495-4782-9b6d-fdc57593903a None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:36.393658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:36.406327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:36.416764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:36.434307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:36.447096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: timer() May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:36:36.447238 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:36:36.452508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b392b404-b0fc-494f-8910-73355bcd6fb4 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3f72a9c-977a-4dd6-af69-1720a1051efd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:36.455076 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.467483 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b392b404-b0fc-494f-8910-73355bcd6fb4 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.471491 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b392b404-b0fc-494f-8910-73355bcd6fb4 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "DELETE /v2.0/security-groups/c3f72a9c-977a-4dd6-af69-1720a1051efd HTTP/1.1" status: 204 len: 168 time: 0.8512542 May 12 15:36:36.472094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58684) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:36.475612 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.528645 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.536092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Network': ['ID=7cd0f48c-257b-44df-aa7b-edaebe2230c8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:36.549188 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bd0d001b-3a82-4665-a746-cc62d24cecf6 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/networks/7cd0f48c-257b-44df-aa7b-edaebe2230c8 HTTP/1.1" status: 204 len: 168 time: 3.4761190 May 12 15:36:36.559792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58694) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:36.587874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1483786196'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:36.607105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:36.620703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:network and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:36.626280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:36.643341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:36.662354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-94c06fe9-262b-4c13-8d24-e8baacb8f27e tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Synchronizing usage tracker for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:36.701959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:36.705704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.735892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-94c06fe9-262b-4c13-8d24-e8baacb8f27e tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Unset dirty status for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:36.737977 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-94c06fe9-262b-4c13-8d24-e8baacb8f27e tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4510 time: 0.2644386 May 12 15:36:36.741963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58700) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:36.761458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 568} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:36:36.777066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:36:36.786368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] Deleting port ed6f345a-7eb3-4e2c-a186-356114e8a7e0 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:36.787129 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.794108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.794479 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Added segment 45ced459-a751-4892-a738-c8021427e591 of type vlan for network da12a6be-39f7-4779-8e5b-2245a77983d8 May 12 15:36:36.851514 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.858831 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9b78a8f9-d884-47df-987e-e1d46d6f0ca8 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.905707 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9b78a8f9-d884-47df-987e-e1d46d6f0ca8 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.938857 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:36.944268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:36.945098 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:37.071024 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.5036139 May 12 15:36:37.077440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58710) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:37.081925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4b92d0a-050d-4fc8-836b-6f8bdbec6d7d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Network': ['ID=da12a6be-39f7-4779-8e5b-2245a77983d8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:37.092985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9b78a8f9-d884-47df-987e-e1d46d6f0ca8 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:37.099417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': 'da12a6be-39f7-4779-8e5b-2245a77983d8', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:37.105337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network da12a6be-39f7-4779-8e5b-2245a77983d8 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:36:37.116486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b78a8f9-d884-47df-987e-e1d46d6f0ca8 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b45f1e9-ebfe-4592-a405-2782ada5cc0b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:37.125885 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9b78a8f9-d884-47df-987e-e1d46d6f0ca8 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:37.127193 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9b78a8f9-d884-47df-987e-e1d46d6f0ca8 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "DELETE /v2.0/security-groups/3b45f1e9-ebfe-4592-a405-2782ada5cc0b HTTP/1.1" status: 204 len: 168 time: 0.3843265 May 12 15:36:37.130104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58716) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:37.218026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3ddf679f-e24b-47bf-8989-04789049a45c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Synchronizing usage tracker for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:37.255812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3ddf679f-e24b-47bf-8989-04789049a45c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Unset dirty status for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:37.259231 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3ddf679f-e24b-47bf-8989-04789049a45c tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.1279459 May 12 15:36:37.263493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58720) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:37.267169 n-d-841483-1 neutron-server[88152]: DEBUG neutron.objects.ports [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=88152) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:36:37.275491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ff980cdb-eb7b-4492-8230-bdfa2e68e9e3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group': {'name': 'tempest-secgroup--1400042263'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:37.297790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ff980cdb-eb7b-4492-8230-bdfa2e68e9e3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:37.343895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ff980cdb-eb7b-4492-8230-bdfa2e68e9e3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:37.371527 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff980cdb-eb7b-4492-8230-bdfa2e68e9e3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:37.406576 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ed6f345a-7eb3-4e2c-a186-356114e8a7e0 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:36:37.420667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ff980cdb-eb7b-4492-8230-bdfa2e68e9e3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:37.425961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ff980cdb-eb7b-4492-8230-bdfa2e68e9e3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Usage tracker for resource:security_group_rule and tenant:dc5d7f1532e04adc98d2a337c32e3422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:37.436566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ff980cdb-eb7b-4492-8230-bdfa2e68e9e3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:37.456473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ff980cdb-eb7b-4492-8230-bdfa2e68e9e3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:37.607961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:37.625604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff980cdb-eb7b-4492-8230-bdfa2e68e9e3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:37.626166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] For port ed6f345a-7eb3-4e2c-a186-356114e8a7e0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ed6f345a-7eb3-4e2c-a186-356114e8a7e0,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:37.626826 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:37.629989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:37.636988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff980cdb-eb7b-4492-8230-bdfa2e68e9e3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:37.645673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:37.665896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:37.731522 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff980cdb-eb7b-4492-8230-bdfa2e68e9e3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:37.732754 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ff980cdb-eb7b-4492-8230-bdfa2e68e9e3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 0.4681096 May 12 15:36:37.733559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff980cdb-eb7b-4492-8230-bdfa2e68e9e3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d936a568-5784-4f27-88fa-640ff39ef25c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:37.737829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58732) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:37.744260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-235242d6-f17f-4a0f-836d-b131383183cf tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Request body: {'security_group': {'name': 'default'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:37.744260 n-d-841483-1 neutron-server[88151]: WARNING neutron.api.v2.base [None req-235242d6-f17f-4a0f-836d-b131383183cf tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. May 12 15:36:37.745247 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-235242d6-f17f-4a0f-836d-b131383183cf tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] update failed (client error): There was a conflict when trying to complete your request. May 12 15:36:37.753221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58736) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:37.756795 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-235242d6-f17f-4a0f-836d-b131383183cf tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "PUT /v2.0/security-groups/d936a568-5784-4f27-88fa-640ff39ef25c HTTP/1.1" status: 409 len: 330 time: 0.0066247 May 12 15:36:37.784557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:37.788181 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:37.870933 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] Calling delete_port for ed6f345a-7eb3-4e2c-a186-356114e8a7e0 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:38.032235 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:38.051973 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:36:38.052398 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:36:38.052959 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:38.075278 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ed6f345a-7eb3-4e2c-a186-356114e8a7e0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ed6f345a-7eb3-4e2c-a186-356114e8a7e0,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:38.081337 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:38.180268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ed6f345a-7eb3-4e2c-a186-356114e8a7e0,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:38.296220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] For port ed6f345a-7eb3-4e2c-a186-356114e8a7e0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ed6f345a-7eb3-4e2c-a186-356114e8a7e0,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:38.323569 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:38.340650 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:38.340650 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:38.469578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:38.515670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:38.526710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:38.527292 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:38.542345 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3372fa0d-fe27-45eb-a062-d23729b88612 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:38.553246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] Deleting port ed6f345a-7eb3-4e2c-a186-356114e8a7e0 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:38.553585 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:38.691842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=8c9d568b-abd3-4d96-a557-09afcfabb6f4,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:38.708103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.4705026 May 12 15:36:38.711704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58766) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:38.720259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-390be01b-144d-47e8-adcc-44c903d69ada tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:38.731302 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3372fa0d-fe27-45eb-a062-d23729b88612 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:38.752441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73d7a974-aad0-4976-be5b-8838b94793e4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=ed6f345a-7eb3-4e2c-a186-356114e8a7e0,revision_number=9']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:38.831327 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:38.907505 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3372fa0d-fe27-45eb-a062-d23729b88612 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:38.939593 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:36:38.961467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] For port ed6f345a-7eb3-4e2c-a186-356114e8a7e0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ed6f345a-7eb3-4e2c-a186-356114e8a7e0,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:38.962115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:38.973156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Subnet': ['ID=d8ab4bea-a7c3-41b5-8960-868b53fb898a,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:38.979876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3372fa0d-fe27-45eb-a062-d23729b88612 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d936a568-5784-4f27-88fa-640ff39ef25c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:38.990859 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3372fa0d-fe27-45eb-a062-d23729b88612 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:38.992030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3372fa0d-fe27-45eb-a062-d23729b88612 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "DELETE /v2.0/security-groups/d936a568-5784-4f27-88fa-640ff39ef25c HTTP/1.1" status: 204 len: 168 time: 1.2364683 May 12 15:36:38.997451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58778) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:39.022742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Checking segment: {'id': '45ced459-a751-4892-a738-c8021427e591', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': 'da12a6be-39f7-4779-8e5b-2245a77983d8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:39.023387 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network hostable DHCP agents. Network: da12a6be-39f7-4779-8e5b-2245a77983d8, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:36:39.066560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network da12a6be-39f7-4779-8e5b-2245a77983d8 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:36:39.091582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e58ed3b1-966d-4637-bfb8-030b181a5c76 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Synchronizing usage tracker for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:39.100081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, da12a6be-39f7-4779-8e5b-2245a77983d8) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:39.105987 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:39.106692 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:39.131005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e58ed3b1-966d-4637-bfb8-030b181a5c76 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] Unset dirty status for tenant:dc5d7f1532e04adc98d2a337c32e3422 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:39.132580 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e58ed3b1-966d-4637-bfb8-030b181a5c76 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.1326210 May 12 15:36:39.139914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58784) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:39.158755 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4c5549e4-dee1-4268-84e0-899af5b5e7e7 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0743468 May 12 15:36:39.159585 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58788) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:39.169414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-93d54b1d-e49f-4594-822b-bd8fdfdb6f16 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'router': {'name': 'tempest-PortsTestJSON-router-13950588', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:39.177154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-93d54b1d-e49f-4594-822b-bd8fdfdb6f16 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:39.182827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-93d54b1d-e49f-4594-822b-bd8fdfdb6f16 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:router and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:39.186087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-93d54b1d-e49f-4594-822b-bd8fdfdb6f16 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:39.188844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] Calling delete_port for ed6f345a-7eb3-4e2c-a186-356114e8a7e0 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:39.192737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-93d54b1d-e49f-4594-822b-bd8fdfdb6f16 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:39.201292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-390be01b-144d-47e8-adcc-44c903d69ada tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:39.202779 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-fb50fe0e-8c82-45d3-b009-69d7b7772e05 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] delete failed (client error): The resource could not be found. May 12 15:36:39.203950 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fb50fe0e-8c82-45d3-b009-69d7b7772e05 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "DELETE /v2.0/security-groups/55a24b60-f49a-4265-ad94-e137662a8b2d HTTP/1.1" status: 404 len: 347 time: 0.0627413 May 12 15:36:39.208261 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93d54b1d-e49f-4594-822b-bd8fdfdb6f16 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:39.209806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-390be01b-144d-47e8-adcc-44c903d69ada tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:39.210481 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93d54b1d-e49f-4594-822b-bd8fdfdb6f16 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:39.225918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51087b5e-9ca8-496f-8404-5e1e90e1e2e7 None None] Network da12a6be-39f7-4779-8e5b-2245a77983d8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:39.235072 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93d54b1d-e49f-4594-822b-bd8fdfdb6f16 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:39.237600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-390be01b-144d-47e8-adcc-44c903d69ada tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:39.254918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58792) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:39.260715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-390be01b-144d-47e8-adcc-44c903d69ada tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:39.278198 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93d54b1d-e49f-4594-822b-bd8fdfdb6f16 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:39.282861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-390be01b-144d-47e8-adcc-44c903d69ada tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:39.286932 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-bfa3bc02-8085-4792-aa1d-58f3683931b3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] show failed (client error): The resource could not be found. May 12 15:36:39.290539 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bfa3bc02-8085-4792-aa1d-58f3683931b3 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "GET /v2.0/security-groups/358774e3-8fcc-4555-b34b-9643c9eaf59f HTTP/1.1" status: 404 len: 347 time: 0.0334949 May 12 15:36:39.290672 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-390be01b-144d-47e8-adcc-44c903d69ada tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:39.296298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58796) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:39.323843 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-2d82461e-1d34-449d-9edb-2a33c211c160 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] show failed (client error): The resource could not be found. May 12 15:36:39.332385 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2d82461e-1d34-449d-9edb-2a33c211c160 tempest-NegativeSecGroupTest-1118104928 tempest-NegativeSecGroupTest-1118104928-project] 10.222.0.82 "GET /v2.0/security-group-rules/41471d0c-33e4-42ae-ab13-0aca2c4684aa HTTP/1.1" status: 404 len: 356 time: 0.0332949 May 12 15:36:39.347067 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-93d54b1d-e49f-4594-822b-bd8fdfdb6f16 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:39.351474 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-93d54b1d-e49f-4594-822b-bd8fdfdb6f16 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.1874907 May 12 15:36:39.353320 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58802) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:39.360226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'network_id': 'da12a6be-39f7-4779-8e5b-2245a77983d8', 'name': 'tempest-PortsTestJSON-1650576019'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:39.646807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:39.651880 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:39.658793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:39.678853 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:39.686061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:39.737281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port 353d9b1c-0e9d-4bb1-a24c-ea832e6607e5 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:36:39.823652 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-390be01b-144d-47e8-adcc-44c903d69ada tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:39.860185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-da12a6be-39f7-4779-8e5b-2245a77983d8', 'network_id': 'da12a6be-39f7-4779-8e5b-2245a77983d8', 'tenant_id': '9bd6beec65cd47b3a0febdc05aaed724', 'fixed_ips': [{'subnet_id': 'd8ab4bea-a7c3-41b5-8960-868b53fb898a'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:36:39.860923 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:39.871394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] Pushing event deleted for resources: {'Port': ['ID=ed6f345a-7eb3-4e2c-a186-356114e8a7e0,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:39.903522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-390be01b-144d-47e8-adcc-44c903d69ada tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:39.906626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-390be01b-144d-47e8-adcc-44c903d69ada tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:39.910980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-390be01b-144d-47e8-adcc-44c903d69ada tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:39.911695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-390be01b-144d-47e8-adcc-44c903d69ada tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:39.913850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-244289e3-2f15-40a8-b5a1-592057af288b None None] No DVR routers for this DVR port ed6f345a-7eb3-4e2c-a186-356114e8a7e0 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:36:39.916256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-390be01b-144d-47e8-adcc-44c903d69ada tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=190f4e15-7894-4db0-a1b4-c08889beb74a,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:39.946037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58820) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:39.980037 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-390be01b-144d-47e8-adcc-44c903d69ada tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2624526 May 12 15:36:39.980993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58826) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:39.982291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a69b81fd-6161-44fa-ab68-5ae65697a1a3 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:39.988654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'mac_address': 'fa:16:3e:32:6b:ee', 'name': 'tempest-NetworksTestDHCPv6-566596337'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:40.072186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Allocated IP 172.20.0.5 (da12a6be-39f7-4779-8e5b-2245a77983d8/d8ab4bea-a7c3-41b5-8960-868b53fb898a/353d9b1c-0e9d-4bb1-a24c-ea832e6607e5) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:40.194993 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a7cddd3c-76fd-45a1-b995-2b212ebe0dd2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=dc5d7f1532e04adc98d2a337c32e3422&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2484868 May 12 15:36:40.198683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58838) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:40.300473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:40.322601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:port and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:40.331159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:40.333489 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '190f4e15-7894-4db0-a1b4-c08889beb74a'}, {'subnet_id': '8c9d568b-abd3-4d96-a557-09afcfabb6f4'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:36:40.335012 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:40.349329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:40.386053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:40.478367 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6bdfb91a-f5b6-484b-859b-ec933f5c1844 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:40.553545 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:40.559786 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6bdfb91a-f5b6-484b-859b-ec933f5c1844 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:40.571248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Allocated IP 172.20.0.2 (2447b094-d5d6-41ef-a146-2bf56f5399af/190f4e15-7894-4db0-a1b4-c08889beb74a/4193ed39-865f-4223-bdbd-3ded5d01d5ba) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:40.579769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Allocated IP 2001:db8::f816:3eff:feed:a6e (2447b094-d5d6-41ef-a146-2bf56f5399af/8c9d568b-abd3-4d96-a557-09afcfabb6f4/4193ed39-865f-4223-bdbd-3ded5d01d5ba) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:40.613616 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Transition to ACTIVE for port object 353d9b1c-0e9d-4bb1-a24c-ea832e6607e5 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:40.628446 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:40.670421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 4347987f-850f-439c-820f-f00e6ec375fc yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:36:40.737015 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6bdfb91a-f5b6-484b-859b-ec933f5c1844 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:40.766027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bdfb91a-f5b6-484b-859b-ec933f5c1844 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf0cfa9b-3d2e-414d-8e3e-972919148152,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:40.783626 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:40.927614 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:40.944302 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Allocated IP 172.20.0.2 (da12a6be-39f7-4779-8e5b-2245a77983d8/d8ab4bea-a7c3-41b5-8960-868b53fb898a/7a131efe-2112-4a60-a386-ad81c80c5466) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:40.950420 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Transition to ACTIVE for port object 4193ed39-865f-4223-bdbd-3ded5d01d5ba will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:41.010271 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Transition to ACTIVE for port object 4193ed39-865f-4223-bdbd-3ded5d01d5ba will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:41.012513 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network da12a6be-39f7-4779-8e5b-2245a77983d8 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:41.015597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:41.019956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:41.115662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=353d9b1c-0e9d-4bb1-a24c-ea832e6607e5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:41.123233 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:41.134415 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6bdfb91a-f5b6-484b-859b-ec933f5c1844 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:41.136536 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6bdfb91a-f5b6-484b-859b-ec933f5c1844 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bf0cfa9b-3d2e-414d-8e3e-972919148152 HTTP/1.1" status: 204 len: 168 time: 0.9367926 May 12 15:36:41.162081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:41.162699 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:41.187625 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Retry wrapper got retriable exception: Failed to create a duplicate IpamAllocation: for attribute(s) ['ipamallocations.PRIMARY'] with value(s) 172.20.0.2-67e50e79-ef44-44e9-aff7-9dd0a8a04310 {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:36:41.187945 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:36:41.189839 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1e60f32f-4e6e-4e3a-a0d8-d0b0e62b992c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.8353024 May 12 15:36:41.193026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58858) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:41.336143 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Pushing event updated for resources: {'Port': ['ID=4193ed39-865f-4223-bdbd-3ded5d01d5ba,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:41.368803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:41.371703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:41.386133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:41.618788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Attempting to bind port 4193ed39-865f-4223-bdbd-3ded5d01d5ba on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:36:41.619156 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Attempting to bind port 4193ed39-865f-4223-bdbd-3ded5d01d5ba by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:36:41.619575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Attempting to bind port 4193ed39-865f-4223-bdbd-3ded5d01d5ba on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:36:41.637773 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 36, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:36:41.638086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:41.638484 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:41.638870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:36:41.639339 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Bound port: 4193ed39-865f-4223-bdbd-3ded5d01d5ba, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:36:41.639711 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:41.689107 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:41.741508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] For port 4193ed39-865f-4223-bdbd-3ded5d01d5ba, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:36:41.744622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 20d2555c-e152-4f1a-a5ea-24735aff3042 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:36:41.744964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] For port 4193ed39-865f-4223-bdbd-3ded5d01d5ba, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4193ed39-865f-4223-bdbd-3ded5d01d5ba,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:36:41.755310 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:41.871625 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:41.896848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Transition to ACTIVE for port object 7a131efe-2112-4a60-a386-ad81c80c5466 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:41.938562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9ee740f-9f13-43a3-81af-9cf4736fdad1 None None] Pushing event updated for resources: {'Port': ['ID=4193ed39-865f-4223-bdbd-3ded5d01d5ba,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:41.943424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Transition to ACTIVE for port object 7a131efe-2112-4a60-a386-ad81c80c5466 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:41.950931 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:42.107518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Network da12a6be-39f7-4779-8e5b-2245a77983d8 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:42.127509 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:42.139709 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:42.222697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 172.20.0.12 (2447b094-d5d6-41ef-a146-2bf56f5399af/190f4e15-7894-4db0-a1b4-c08889beb74a/20d2555c-e152-4f1a-a5ea-24735aff3042) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:42.242748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::f816:3eff:fe32:6bee (2447b094-d5d6-41ef-a146-2bf56f5399af/8c9d568b-abd3-4d96-a557-09afcfabb6f4/20d2555c-e152-4f1a-a5ea-24735aff3042) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:42.250112 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Pushing event updated for resources: {'Port': ['ID=7a131efe-2112-4a60-a386-ad81c80c5466,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:42.424488 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Attempting to bind port 7a131efe-2112-4a60-a386-ad81c80c5466 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:36:42.425019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Attempting to bind port 7a131efe-2112-4a60-a386-ad81c80c5466 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '45ced459-a751-4892-a738-c8021427e591', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': 'da12a6be-39f7-4779-8e5b-2245a77983d8'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:36:42.425504 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Attempting to bind port 7a131efe-2112-4a60-a386-ad81c80c5466 on network da12a6be-39f7-4779-8e5b-2245a77983d8 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:36:42.434999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 36, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:36:42.434999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Checking segment: {'id': '45ced459-a751-4892-a738-c8021427e591', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': 'da12a6be-39f7-4779-8e5b-2245a77983d8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:42.438265 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:42.438823 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Bound using segment: {'id': '45ced459-a751-4892-a738-c8021427e591', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': 'da12a6be-39f7-4779-8e5b-2245a77983d8'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:36:42.439417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Bound port: 7a131efe-2112-4a60-a386-ad81c80c5466, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '45ced459-a751-4892-a738-c8021427e591', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': 'da12a6be-39f7-4779-8e5b-2245a77983d8'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:36:42.440021 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:42.526615 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:42.622875 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] For port 7a131efe-2112-4a60-a386-ad81c80c5466, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:36:42.635388 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] For port 7a131efe-2112-4a60-a386-ad81c80c5466, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7a131efe-2112-4a60-a386-ad81c80c5466,segment=NetworkSegment(45ced459-a751-4892-a738-c8021427e591),segment_id=45ced459-a751-4892-a738-c8021427e591)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:36:42.640916 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:42.712952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:42.741503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object 20d2555c-e152-4f1a-a5ea-24735aff3042 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:42.770311 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-835c6ed8-5b8c-4a7e-90ff-fb07300621d3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:42.791895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8596d060-32d7-4601-bd5b-b869d6d41586 None None] Pushing event updated for resources: {'Port': ['ID=7a131efe-2112-4a60-a386-ad81c80c5466,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:42.831094 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:42.941527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:42.945418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:42.948929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:43.007532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=20d2555c-e152-4f1a-a5ea-24735aff3042,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:43.052432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:43.053324 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:43.097546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58912) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:43.098634 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6083efb7-e97c-42f7-8478-4f5f549e0ba9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 3.1165996 May 12 15:36:43.166389 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:43.526970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3a71992-eb26-43e1-a7bc-a07b91f7c58d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:43.537436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7a131efe-2112-4a60-a386-ad81c80c5466 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:43.551727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3a71992-eb26-43e1-a7bc-a07b91f7c58d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:43.551727 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a3a71992-eb26-43e1-a7bc-a07b91f7c58d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1860 time: 0.4503798 May 12 15:36:43.562210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58922) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:43.807466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 7a131efe-2112-4a60-a386-ad81c80c5466 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:43.818307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4193ed39-865f-4223-bdbd-3ded5d01d5ba up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:43.839555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-c22198b2-a7cf-42e4-ac80-72f5d855bd3d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port 20d2555c-e152-4f1a-a5ea-24735aff3042 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:43.840084 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c22198b2-a7cf-42e4-ac80-72f5d855bd3d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:43.888884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:43.901786 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:44.036999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=353d9b1c-0e9d-4bb1-a24c-ea832e6607e5,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:44.121764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7c84993-2d38-47d2-8aba-591dfdea9679 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:44.305167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 4193ed39-865f-4223-bdbd-3ded5d01d5ba completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:44.351151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Provisioning for port 4193ed39-865f-4223-bdbd-3ded5d01d5ba completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:44.370706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Provisioning complete for port 4193ed39-865f-4223-bdbd-3ded5d01d5ba triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:44.371451 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:44.527131 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c22198b2-a7cf-42e4-ac80-72f5d855bd3d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:44.627844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83865e27-3ca5-4cb0-930a-37b8adcf40f7 None None] Network da12a6be-39f7-4779-8e5b-2245a77983d8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:44.698586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-c22198b2-a7cf-42e4-ac80-72f5d855bd3d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for 20d2555c-e152-4f1a-a5ea-24735aff3042 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:44.699003 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:44.860160 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:44.977659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:44.988404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] For port 4193ed39-865f-4223-bdbd-3ded5d01d5ba, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4193ed39-865f-4223-bdbd-3ded5d01d5ba,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:45.007067 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:45.071879 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c22198b2-a7cf-42e4-ac80-72f5d855bd3d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:45.186420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c22198b2-a7cf-42e4-ac80-72f5d855bd3d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=20d2555c-e152-4f1a-a5ea-24735aff3042,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:45.231935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-87f73e6b-887a-4c6b-aca6-2a55af307219 None None] Provisioning for port 7a131efe-2112-4a60-a386-ad81c80c5466 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:45.248815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Pushing event updated for resources: {'Port': ['ID=4193ed39-865f-4223-bdbd-3ded5d01d5ba,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:45.252762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-87f73e6b-887a-4c6b-aca6-2a55af307219 None None] Provisioning complete for port 7a131efe-2112-4a60-a386-ad81c80c5466 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:45.253126 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87f73e6b-887a-4c6b-aca6-2a55af307219 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:45.376807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:45.377487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:45.388362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:45.388763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:45.389088 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:45.389619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:45.390095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:45.390784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:45.391356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:45.391932 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:45.392486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:45.393090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd633ed-2ae4-4b1f-a7af-528e8259d634 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:45.451525 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-82374b72-8514-4a0b-9fa7-39aaa5fa4884 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:45.486381 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c22198b2-a7cf-42e4-ac80-72f5d855bd3d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:45.514693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c22198b2-a7cf-42e4-ac80-72f5d855bd3d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/20d2555c-e152-4f1a-a5ea-24735aff3042 HTTP/1.1" status: 204 len: 168 time: 1.9613378 May 12 15:36:45.515448 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58974) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:45.649602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3076cc04-9839-4fd9-964f-28dc5e9083c4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:45.651589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3076cc04-9839-4fd9-964f-28dc5e9083c4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:45.656364 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87f73e6b-887a-4c6b-aca6-2a55af307219 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:45.656924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3076cc04-9839-4fd9-964f-28dc5e9083c4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:45.658070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3076cc04-9839-4fd9-964f-28dc5e9083c4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:45.684340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3076cc04-9839-4fd9-964f-28dc5e9083c4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:45.689233 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3076cc04-9839-4fd9-964f-28dc5e9083c4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.1727734 May 12 15:36:45.690194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58980) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:45.759382 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-87f73e6b-887a-4c6b-aca6-2a55af307219 None None] For port 7a131efe-2112-4a60-a386-ad81c80c5466, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7a131efe-2112-4a60-a386-ad81c80c5466,segment=NetworkSegment(45ced459-a751-4892-a738-c8021427e591),segment_id=45ced459-a751-4892-a738-c8021427e591)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:45.764662 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87f73e6b-887a-4c6b-aca6-2a55af307219 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:45.921111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87f73e6b-887a-4c6b-aca6-2a55af307219 None None] Pushing event updated for resources: {'Port': ['ID=7a131efe-2112-4a60-a386-ad81c80c5466,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:46.010158 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5eb1fbe9-3b0c-4506-a84c-d955c17bf144 None None] Could not find standard attr ID for object 20d2555c-e152-4f1a-a5ea-24735aff3042. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:36:46.023456 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:46.030316 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:46.066200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5eb1fbe9-3b0c-4506-a84c-d955c17bf144 None None] Provisioning complete for port 7a131efe-2112-4a60-a386-ad81c80c5466 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:46.066560 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5eb1fbe9-3b0c-4506-a84c-d955c17bf144 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:46.227791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-847f1399-1c68-4da3-9f5b-6bd80db364ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 190f4e15-7894-4db0-a1b4-c08889beb74a {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:36:46.231238 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-847f1399-1c68-4da3-9f5b-6bd80db364ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:46.272791 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:46.334887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=353d9b1c-0e9d-4bb1-a24c-ea832e6607e5,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:46.350659 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:46.351408 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:46.394196 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-847f1399-1c68-4da3-9f5b-6bd80db364ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:46.547122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5eb1fbe9-3b0c-4506-a84c-d955c17bf144 None None] Provisioning for port 353d9b1c-0e9d-4bb1-a24c-ea832e6607e5 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:46.559347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5eb1fbe9-3b0c-4506-a84c-d955c17bf144 None None] Provisioning complete for port 353d9b1c-0e9d-4bb1-a24c-ea832e6607e5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:46.559915 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5eb1fbe9-3b0c-4506-a84c-d955c17bf144 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:46.661561 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-847f1399-1c68-4da3-9f5b-6bd80db364ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:46.681044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network da12a6be-39f7-4779-8e5b-2245a77983d8 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:46.684444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:46.760889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5eb1fbe9-3b0c-4506-a84c-d955c17bf144 None None] Port 353d9b1c-0e9d-4bb1-a24c-ea832e6607e5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:36:46.856852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5eb1fbe9-3b0c-4506-a84c-d955c17bf144 None None] Provisioning complete for port 4193ed39-865f-4223-bdbd-3ded5d01d5ba triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:46.883072 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5eb1fbe9-3b0c-4506-a84c-d955c17bf144 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:46.903835 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-847f1399-1c68-4da3-9f5b-6bd80db364ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:47.013658 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-847f1399-1c68-4da3-9f5b-6bd80db364ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:47.065134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-847f1399-1c68-4da3-9f5b-6bd80db364ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=190f4e15-7894-4db0-a1b4-c08889beb74a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:47.072826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58996) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:47.094278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-847f1399-1c68-4da3-9f5b-6bd80db364ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/190f4e15-7894-4db0-a1b4-c08889beb74a HTTP/1.1" status: 204 len: 168 time: 1.4014697 May 12 15:36:47.095586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59004) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:47.183356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5abe130-528a-42a0-9625-97960935b12e None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:47.235503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Router 60580275-20ad-4639-8312-7bcc830b26ff is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:36:47.311452 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-f9a79caf-1757-431d-8044-3663ba06f1b5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 8c9d568b-abd3-4d96-a557-09afcfabb6f4 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:36:47.314926 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9a79caf-1757-431d-8044-3663ba06f1b5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:47.356605 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-07c078e1-4965-41b3-9a23-ef580ac780bc None None] Could not find standard attr ID for object 20d2555c-e152-4f1a-a5ea-24735aff3042. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:36:47.391192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-07c078e1-4965-41b3-9a23-ef580ac780bc None None] Provisioning complete for port 353d9b1c-0e9d-4bb1-a24c-ea832e6607e5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:47.394164 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-07c078e1-4965-41b3-9a23-ef580ac780bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:47.463477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7a131efe-2112-4a60-a386-ad81c80c5466 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:47.464550 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9a79caf-1757-431d-8044-3663ba06f1b5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:47.554999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-07c078e1-4965-41b3-9a23-ef580ac780bc None None] Port 353d9b1c-0e9d-4bb1-a24c-ea832e6607e5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:36:47.561046 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9a79caf-1757-431d-8044-3663ba06f1b5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:47.670758 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9a79caf-1757-431d-8044-3663ba06f1b5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:47.703648 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e16ba701-862c-4dec-98dd-7e8de7e3f97d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:47.727354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9a79caf-1757-431d-8044-3663ba06f1b5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=8c9d568b-abd3-4d96-a557-09afcfabb6f4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:47.730593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e16ba701-862c-4dec-98dd-7e8de7e3f97d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:47.732771 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9a79caf-1757-431d-8044-3663ba06f1b5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:47.737555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7a131efe-2112-4a60-a386-ad81c80c5466 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:47.737928 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:47.740333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e16ba701-862c-4dec-98dd-7e8de7e3f97d admin admin] Usage tracker for resource:security_group_rule and tenant:3b1ff92387804839aab8d3f529e8ceee is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:47.744627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e16ba701-862c-4dec-98dd-7e8de7e3f97d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:47.746460 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f9a79caf-1757-431d-8044-3663ba06f1b5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/8c9d568b-abd3-4d96-a557-09afcfabb6f4 HTTP/1.1" status: 204 len: 168 time: 0.6490734 May 12 15:36:47.749063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59008) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:47.752948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:36:47.754815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e16ba701-862c-4dec-98dd-7e8de7e3f97d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:47.764331 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-82db1916-d500-44be-9b28-fe69ac12f7e9 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "PUT /v2.0/routers/60580275-20ad-4639-8312-7bcc830b26ff/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.5698478 May 12 15:36:47.765157 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59012) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:47.767355 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3be1165c-0ba4-431e-b692-a277288416b7 None None] Sync routers for ids ['60580275-20ad-4639-8312-7bcc830b26ff'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:36:47.784329 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3be1165c-0ba4-431e-b692-a277288416b7 None None] Routers {'60580275-20ad-4639-8312-7bcc830b26ff'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:36:47.785267 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3be1165c-0ba4-431e-b692-a277288416b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:36:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['60580275-20ad-4639-8312-7bcc830b26ff'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:47.809477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4aae0076-92fe-478f-8bdc-2f282cc0a9b2 None None] Provisioning complete for port 353d9b1c-0e9d-4bb1-a24c-ea832e6607e5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:47.809850 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4aae0076-92fe-478f-8bdc-2f282cc0a9b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:47.834981 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:47.873723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4aae0076-92fe-478f-8bdc-2f282cc0a9b2 None None] Port 353d9b1c-0e9d-4bb1-a24c-ea832e6607e5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:36:47.902517 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3be1165c-0ba4-431e-b692-a277288416b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:47.910435 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d136b79b-42d8-4c82-8ac7-b6963b00775e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1598372 May 12 15:36:47.913288 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3be1165c-0ba4-431e-b692-a277288416b7 None None] Routers {'60580275-20ad-4639-8312-7bcc830b26ff'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:36:47.914709 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3be1165c-0ba4-431e-b692-a277288416b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:36:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['60580275-20ad-4639-8312-7bcc830b26ff'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:47.916328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59018) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:47.934457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-27f87065-8e93-4b8d-b1d9-5308abb5f691 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:47.962085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4193ed39-865f-4223-bdbd-3ded5d01d5ba up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:47.968111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-179c6ba5-b83a-4a4c-80e1-ca20b622cd46 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:47.969041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-179c6ba5-b83a-4a4c-80e1-ca20b622cd46 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:48.004913 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3be1165c-0ba4-431e-b692-a277288416b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:48.006070 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3be1165c-0ba4-431e-b692-a277288416b7 None None] The sync data for ids ['60580275-20ad-4639-8312-7bcc830b26ff'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:36:48.025293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-179c6ba5-b83a-4a4c-80e1-ca20b622cd46 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:48.027123 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-179c6ba5-b83a-4a4c-80e1-ca20b622cd46 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports?device_id=60580275-20ad-4639-8312-7bcc830b26ff HTTP/1.1" status: 200 len: 982 time: 0.2589934 May 12 15:36:48.029862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59022) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:48.101256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab3a0bd1-3a3e-44f8-ad33-f0bde6ae8f84 None None] Update dhcp port {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'fixed_ips': [{'subnet_id': '8c9d568b-abd3-4d96-a557-09afcfabb6f4'}], 'binding:host_id': 'n-d-841483-1'}, 'id': '4193ed39-865f-4223-bdbd-3ded5d01d5ba'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:36:48.116141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-27f87065-8e93-4b8d-b1d9-5308abb5f691 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:48.120620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-27f87065-8e93-4b8d-b1d9-5308abb5f691 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:48.124734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-27f87065-8e93-4b8d-b1d9-5308abb5f691 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:48.132755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-27f87065-8e93-4b8d-b1d9-5308abb5f691 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:48.170260 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ab3a0bd1-3a3e-44f8-ad33-f0bde6ae8f84 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:48.172400 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e16ba701-862c-4dec-98dd-7e8de7e3f97d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:48.185292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4193ed39-865f-4223-bdbd-3ded5d01d5ba triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:48.185697 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:48.191729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-27f87065-8e93-4b8d-b1d9-5308abb5f691 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:48.191729 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27f87065-8e93-4b8d-b1d9-5308abb5f691 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:48.192740 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e16ba701-862c-4dec-98dd-7e8de7e3f97d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:48.267280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e16ba701-862c-4dec-98dd-7e8de7e3f97d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=634b0033-1cca-4bda-a5d4-720cbb5b8ec5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:48.276296 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e16ba701-862c-4dec-98dd-7e8de7e3f97d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3b1ff92387804839aab8d3f529e8ceee&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1895130 May 12 15:36:48.334996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59034) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:48.501331 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7610ee5b-5547-4c95-b741-2dfc4a465d30 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:48.555983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2825e97a-fa7e-4ecd-b2c0-1230beac1e84 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:48.605752 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7610ee5b-5547-4c95-b741-2dfc4a465d30 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:48.761195 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27f87065-8e93-4b8d-b1d9-5308abb5f691 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:48.788119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b297ca14-0839-4a41-bb0f-d12e94325d31 None None] Provisioning complete for port 4193ed39-865f-4223-bdbd-3ded5d01d5ba triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:48.788804 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b297ca14-0839-4a41-bb0f-d12e94325d31 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:48.906898 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0fe0bfeb-7ca1-4d73-b082-2180cca198b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:48.909439 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7610ee5b-5547-4c95-b741-2dfc4a465d30 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:48.966288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27f87065-8e93-4b8d-b1d9-5308abb5f691 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:48.975793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-27f87065-8e93-4b8d-b1d9-5308abb5f691 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:48.983042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7610ee5b-5547-4c95-b741-2dfc4a465d30 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=634b0033-1cca-4bda-a5d4-720cbb5b8ec5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:49.004473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27f87065-8e93-4b8d-b1d9-5308abb5f691 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:49.005065 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27f87065-8e93-4b8d-b1d9-5308abb5f691 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:49.064861 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27f87065-8e93-4b8d-b1d9-5308abb5f691 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=9697cb9e-01b5-485c-94a1-4bbe8714db12,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:49.067720 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7610ee5b-5547-4c95-b741-2dfc4a465d30 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:49.068815 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7610ee5b-5547-4c95-b741-2dfc4a465d30 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/634b0033-1cca-4bda-a5d4-720cbb5b8ec5 HTTP/1.1" status: 204 len: 168 time: 0.7327483 May 12 15:36:49.070601 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-27f87065-8e93-4b8d-b1d9-5308abb5f691 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1532388 May 12 15:36:49.074675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59070) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:49.081252 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:49.321830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3cae3fc-6ddd-4189-8565-e8d1fb414a1a None None] Update dhcp port {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'fixed_ips': [{'subnet_id': '9697cb9e-01b5-485c-94a1-4bbe8714db12'}], 'binding:host_id': 'n-d-841483-1'}, 'id': '4193ed39-865f-4223-bdbd-3ded5d01d5ba'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:36:49.357101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:49.364498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:49.372299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:49.389747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:49.407239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:49.408388 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3cae3fc-6ddd-4189-8565-e8d1fb414a1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:49.419161 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:49.440082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-0fe0bfeb-7ca1-4d73-b082-2180cca198b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 353d9b1c-0e9d-4bb1-a24c-ea832e6607e5 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:49.440656 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0fe0bfeb-7ca1-4d73-b082-2180cca198b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:49.479370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4193ed39-865f-4223-bdbd-3ded5d01d5ba no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:36:49.708935 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0fe0bfeb-7ca1-4d73-b082-2180cca198b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:49.764296 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59076) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:49.783799 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3124dd76-efe8-425e-877a-dd294d177923 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:49.806328 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:49.811511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3124dd76-efe8-425e-877a-dd294d177923 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:49.818085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3124dd76-efe8-425e-877a-dd294d177923 admin admin] Usage tracker for resource:security_group_rule and tenant:22da327ec8af4d258595bb6017fb897d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:49.826329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3124dd76-efe8-425e-877a-dd294d177923 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:49.835431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3124dd76-efe8-425e-877a-dd294d177923 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:49.866035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-0fe0bfeb-7ca1-4d73-b082-2180cca198b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for 353d9b1c-0e9d-4bb1-a24c-ea832e6607e5 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:49.968681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 4193ed39-865f-4223-bdbd-3ded5d01d5ba, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4193ed39-865f-4223-bdbd-3ded5d01d5ba,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:49.979839 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:50.068381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-c3cae3fc-6ddd-4189-8565-e8d1fb414a1a None None] Allocated IP 172.20.0.2 (2447b094-d5d6-41ef-a146-2bf56f5399af/9697cb9e-01b5-485c-94a1-4bbe8714db12/4193ed39-865f-4223-bdbd-3ded5d01d5ba) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:50.154023 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3124dd76-efe8-425e-877a-dd294d177923 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:50.159563 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3124dd76-efe8-425e-877a-dd294d177923 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:50.233081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=4193ed39-865f-4223-bdbd-3ded5d01d5ba,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:50.244714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3124dd76-efe8-425e-877a-dd294d177923 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=22da327ec8af4d258595bb6017fb897d&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4787774 May 12 15:36:50.252063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3124dd76-efe8-425e-877a-dd294d177923 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9367f825-96f4-4db3-97fd-07c502b33114,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:50.261802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59084) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:50.346147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.objects.ports [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=88152) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:36:50.387400 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c3cae3fc-6ddd-4189-8565-e8d1fb414a1a None None] For port 4193ed39-865f-4223-bdbd-3ded5d01d5ba, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4193ed39-865f-4223-bdbd-3ded5d01d5ba,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:50.426395 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3cae3fc-6ddd-4189-8565-e8d1fb414a1a None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:50.463295 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8680eb93-263e-49c0-8552-e8ad85be1b88 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:50.478241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c3cae3fc-6ddd-4189-8565-e8d1fb414a1a None None] Transition to ACTIVE for port object 4193ed39-865f-4223-bdbd-3ded5d01d5ba will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:50.480248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0fe0bfeb-7ca1-4d73-b082-2180cca198b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:50.482886 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3cae3fc-6ddd-4189-8565-e8d1fb414a1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:50.512568 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8680eb93-263e-49c0-8552-e8ad85be1b88 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:50.599028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3cae3fc-6ddd-4189-8565-e8d1fb414a1a None None] Pushing event updated for resources: {'Port': ['ID=4193ed39-865f-4223-bdbd-3ded5d01d5ba,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:50.934990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe0bfeb-7ca1-4d73-b082-2180cca198b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=353d9b1c-0e9d-4bb1-a24c-ea832e6607e5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:50.996226 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:51.067952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8680eb93-263e-49c0-8552-e8ad85be1b88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:51.097529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8680eb93-263e-49c0-8552-e8ad85be1b88 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9367f825-96f4-4db3-97fd-07c502b33114,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:51.129685 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8680eb93-263e-49c0-8552-e8ad85be1b88 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:51.129958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8680eb93-263e-49c0-8552-e8ad85be1b88 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9367f825-96f4-4db3-97fd-07c502b33114 HTTP/1.1" status: 204 len: 168 time: 0.8670907 May 12 15:36:51.168833 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0fe0bfeb-7ca1-4d73-b082-2180cca198b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:51.469711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] For port 4193ed39-865f-4223-bdbd-3ded5d01d5ba, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4193ed39-865f-4223-bdbd-3ded5d01d5ba,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:51.495993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4193ed39-865f-4223-bdbd-3ded5d01d5ba up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:51.529357 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:51.537927 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:51.539415 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:51.734185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0fe0bfeb-7ca1-4d73-b082-2180cca198b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Router 60580275-20ad-4639-8312-7bcc830b26ff has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:36:51.752681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:51.759718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:51.786138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:51.791564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:51.884566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=1adea5b5-8e1d-4e35-b187-7fbf8778d11f,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:51.896688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 2.8209610 May 12 15:36:51.903060 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59120) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:51.903889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9aea22ec-e98d-4c7a-845c-878abb6ed2f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=4193ed39-865f-4223-bdbd-3ded5d01d5ba,revision_number=9']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:51.923883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'mac_address': 'fa:16:3e:34:80:cc', 'name': 'tempest-NetworksTestDHCPv6-1920594123'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:51.983061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0fe0bfeb-7ca1-4d73-b082-2180cca198b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:36:51.985699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a74a243-667d-4436-8b4d-acb7294e1a15 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:52.042593 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0fe0bfeb-7ca1-4d73-b082-2180cca198b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "PUT /v2.0/routers/60580275-20ad-4639-8312-7bcc830b26ff/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0117877 May 12 15:36:52.046059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59130) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:52.138622 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-a7f32966-25f7-4957-a78c-57d48888815d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] GET failed (client error): The resource could not be found. May 12 15:36:52.139155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a7f32966-25f7-4957-a78c-57d48888815d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:52.162813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:52.167828 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:port and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:52.172274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:52.179257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a7f32966-25f7-4957-a78c-57d48888815d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:52.180796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:52.181272 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a7f32966-25f7-4957-a78c-57d48888815d tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/353d9b1c-0e9d-4bb1-a24c-ea832e6607e5 HTTP/1.1" status: 404 len: 333 time: 0.1339455 May 12 15:36:52.183962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59136) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:52.195010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:52.265603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d137706-4118-46e4-9223-4840536265c5 None None] Sync routers for ids ['60580275-20ad-4639-8312-7bcc830b26ff'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:36:52.305712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d137706-4118-46e4-9223-4840536265c5 None None] Routers {'60580275-20ad-4639-8312-7bcc830b26ff'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:36:52.306735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0d137706-4118-46e4-9223-4840536265c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:36:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['60580275-20ad-4639-8312-7bcc830b26ff'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:52.385156 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:52.416138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 4f43740b-fdd2-4ca2-a12a-5800e2659845 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:36:52.433197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0d137706-4118-46e4-9223-4840536265c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:52.478350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d137706-4118-46e4-9223-4840536265c5 None None] Routers {'60580275-20ad-4639-8312-7bcc830b26ff'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:36:52.479220 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0d137706-4118-46e4-9223-4840536265c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:36:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['60580275-20ad-4639-8312-7bcc830b26ff'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:52.533814 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7c0b3426-3eeb-4020-ad63-549bc32ae537 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:52.577819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0d137706-4118-46e4-9223-4840536265c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:52.579307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d137706-4118-46e4-9223-4840536265c5 None None] The sync data for ids ['60580275-20ad-4639-8312-7bcc830b26ff'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:36:52.586370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ea569ba4-751c-4d81-be2c-62158b75c26f None None] Provisioning for port 4193ed39-865f-4223-bdbd-3ded5d01d5ba completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:52.604718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ea569ba4-751c-4d81-be2c-62158b75c26f None None] Provisioning complete for port 4193ed39-865f-4223-bdbd-3ded5d01d5ba triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:52.605690 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ea569ba4-751c-4d81-be2c-62158b75c26f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:52.838793 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ea569ba4-751c-4d81-be2c-62158b75c26f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:52.854831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 172.20.0.12 (2447b094-d5d6-41ef-a146-2bf56f5399af/9697cb9e-01b5-485c-94a1-4bbe8714db12/4f43740b-fdd2-4ca2-a12a-5800e2659845) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:52.878750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::f816:3eff:fe34:80cc (2447b094-d5d6-41ef-a146-2bf56f5399af/1adea5b5-8e1d-4e35-b187-7fbf8778d11f/4f43740b-fdd2-4ca2-a12a-5800e2659845) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:52.924387 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ea569ba4-751c-4d81-be2c-62158b75c26f None None] For port 4193ed39-865f-4223-bdbd-3ded5d01d5ba, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4193ed39-865f-4223-bdbd-3ded5d01d5ba,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:52.929138 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ea569ba4-751c-4d81-be2c-62158b75c26f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.093422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea569ba4-751c-4d81-be2c-62158b75c26f None None] Pushing event updated for resources: {'Port': ['ID=4193ed39-865f-4223-bdbd-3ded5d01d5ba,revision_number=10']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:53.290926 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7c0b3426-3eeb-4020-ad63-549bc32ae537 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.296766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7c0b3426-3eeb-4020-ad63-549bc32ae537 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.361606 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7c0b3426-3eeb-4020-ad63-549bc32ae537 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.362138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7c0b3426-3eeb-4020-ad63-549bc32ae537 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Fanout notify agent at l3_agent the message router_deleted on router 60580275-20ad-4639-8312-7bcc830b26ff {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:36:53.377543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7c0b3426-3eeb-4020-ad63-549bc32ae537 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.382484 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7c0b3426-3eeb-4020-ad63-549bc32ae537 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/routers/60580275-20ad-4639-8312-7bcc830b26ff HTTP/1.1" status: 204 len: 168 time: 1.1973290 May 12 15:36:53.383501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59162) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:53.468918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4193ed39-865f-4223-bdbd-3ded5d01d5ba up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:36:53.498823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting subnet d8ab4bea-a7c3-41b5-8960-868b53fb898a {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:36:53.502856 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.526319 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.576427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object 4f43740b-fdd2-4ca2-a12a-5800e2659845 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:53.593279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.607778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4193ed39-865f-4223-bdbd-3ded5d01d5ba triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:53.608399 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.635895 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.721744 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.770967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca7d52e4-8795-4669-8da7-b87f49ccf0e3 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:53.826454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=4f43740b-fdd2-4ca2-a12a-5800e2659845,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:53.835067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:53.836105 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.836664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:53.839302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:53.879917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Subnet': ['ID=d8ab4bea-a7c3-41b5-8960-868b53fb898a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:53.882918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.893877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:53.894217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:53.894693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:53.895032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:53.895363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:53.895694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:53.896017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:53.896337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:53.896660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:53.896980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:53.897296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:53.897636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:36:53.902349 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-58677184-0a2c-41e4-b891-9cb178c476d3 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/d8ab4bea-a7c3-41b5-8960-868b53fb898a HTTP/1.1" status: 204 len: 168 time: 0.5175471 May 12 15:36:53.905093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59174) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:53.912512 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b1bb4a9-86ec-4c0e-9ce3-57cf8ebacf77 None None] Network da12a6be-39f7-4779-8e5b-2245a77983d8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:53.944683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-96d6a6ac-a157-4344-8a0d-d05c3ba68611 None None] Provisioning complete for port 4193ed39-865f-4223-bdbd-3ded5d01d5ba triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:53.949114 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-96d6a6ac-a157-4344-8a0d-d05c3ba68611 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.954779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:53.955433 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:53.996476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8553628c-e44c-4077-a307-102ef55de0f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1028 time: 2.0783048 May 12 15:36:53.999135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59178) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:54.135537 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:54.139943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58ea2d55-87fd-46cc-af39-c41b90a93c99 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:54.148222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58ea2d55-87fd-46cc-af39-c41b90a93c99 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:54.150655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-58ea2d55-87fd-46cc-af39-c41b90a93c99 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:54.173927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-58ea2d55-87fd-46cc-af39-c41b90a93c99 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:54.176173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-58ea2d55-87fd-46cc-af39-c41b90a93c99 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1864 time: 0.1757827 May 12 15:36:54.177143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port 7a131efe-2112-4a60-a386-ad81c80c5466 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:54.177837 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:54.180019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59186) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:54.372807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5cf29d26-83ac-4e5a-8d9f-fc858417f318 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port 4f43740b-fdd2-4ca2-a12a-5800e2659845 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:36:54.386045 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5cf29d26-83ac-4e5a-8d9f-fc858417f318 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:54.610217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] For port 7a131efe-2112-4a60-a386-ad81c80c5466, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7a131efe-2112-4a60-a386-ad81c80c5466,segment=NetworkSegment(45ced459-a751-4892-a738-c8021427e591),segment_id=45ced459-a751-4892-a738-c8021427e591)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:36:54.611223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:54.830980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for 7a131efe-2112-4a60-a386-ad81c80c5466 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:54.982015 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:55.042606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No DVR routers for this DVR port 7a131efe-2112-4a60-a386-ad81c80c5466 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:36:55.044702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=7a131efe-2112-4a60-a386-ad81c80c5466,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:55.078881 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7c9530e-37d3-400b-8cd9-08dd8cb54a15 None None] DHCP port deletion for da12a6be-39f7-4779-8e5b-2245a77983d8 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:36:55.159891 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5cf29d26-83ac-4e5a-8d9f-fc858417f318 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:55.231459 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:55.294477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['da12a6be-39f7-4779-8e5b-2245a77983d8']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:55.311376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '45ced459-a751-4892-a738-c8021427e591') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:55.311899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '45ced459-a751-4892-a738-c8021427e591') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:36:55.330291 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:55.344832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5cf29d26-83ac-4e5a-8d9f-fc858417f318 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for 4f43740b-fdd2-4ca2-a12a-5800e2659845 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:36:55.354504 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:55.377817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Releasing vlan 568 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:36:55.378856 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: timer() May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:36:55.400893 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:36:55.416972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7a131efe-2112-4a60-a386-ad81c80c5466 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:36:55.491029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 7a131efe-2112-4a60-a386-ad81c80c5466 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:36:55.501676 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7a131efe-2112-4a60-a386-ad81c80c5466 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:36:55.553767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59214) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:55.632673 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:36:55.807270 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:36:55.811504 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ea87ef2-1eeb-49af-97ad-b7e6e6ab92f1 None None] Provisioning for port 4f43740b-fdd2-4ca2-a12a-5800e2659845 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:36:55.811880 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5cf29d26-83ac-4e5a-8d9f-fc858417f318 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:55.815673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ea87ef2-1eeb-49af-97ad-b7e6e6ab92f1 None None] Provisioning complete for port 4f43740b-fdd2-4ca2-a12a-5800e2659845 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:55.816131 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ea87ef2-1eeb-49af-97ad-b7e6e6ab92f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:55.911549 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9ea87ef2-1eeb-49af-97ad-b7e6e6ab92f1 None None] Port 4f43740b-fdd2-4ca2-a12a-5800e2659845 was deleted so its status cannot be updated. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:330}} May 12 15:36:55.936923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ea87ef2-1eeb-49af-97ad-b7e6e6ab92f1 None None] Provisioning complete for port 4193ed39-865f-4223-bdbd-3ded5d01d5ba triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:55.937205 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ea87ef2-1eeb-49af-97ad-b7e6e6ab92f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:56.005109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:56.012664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Network': ['ID=da12a6be-39f7-4779-8e5b-2245a77983d8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:56.091871 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5024f2a8-da7c-4d14-833a-8aa39a2aa2a8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/networks/da12a6be-39f7-4779-8e5b-2245a77983d8 HTTP/1.1" status: 204 len: 168 time: 2.1847911 May 12 15:36:56.099067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59238) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:56.131796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cf29d26-83ac-4e5a-8d9f-fc858417f318 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=4f43740b-fdd2-4ca2-a12a-5800e2659845,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:56.289161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59246) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:56.324619 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c9832c32-5cb6-4f9e-891e-72294b45a322 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/ports?fields=fixed_ips&fields=mac_address HTTP/1.1" status: 200 len: 2789 time: 0.7691913 May 12 15:36:56.328526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59252) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:56.343193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-84905dee-27d7-4ef1-ade1-0677fbe3297d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Request body: {'network': {'name': 'tempest-network-smoke--1817143295', 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'port_security_enabled': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:56.355504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7aa8433-e636-4da0-b48f-9d5135b3e983 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:56.359061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d7aa8433-e636-4da0-b48f-9d5135b3e983 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:56.379078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-84905dee-27d7-4ef1-ade1-0677fbe3297d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:56.391112 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5cf29d26-83ac-4e5a-8d9f-fc858417f318 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:56.402589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d7aa8433-e636-4da0-b48f-9d5135b3e983 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:56.407344 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d7aa8433-e636-4da0-b48f-9d5135b3e983 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/d3738296-e321-4a38-bb44-3803dd75076e HTTP/1.1" status: 200 len: 841 time: 0.2921875 May 12 15:36:56.408047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59260) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:56.421216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7d5bc3ce-c4e3-4558-99be-87f3c1a21817 None None] Could not find standard attr ID for object 4f43740b-fdd2-4ca2-a12a-5800e2659845. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:36:56.436613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5cf29d26-83ac-4e5a-8d9f-fc858417f318 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/4f43740b-fdd2-4ca2-a12a-5800e2659845 HTTP/1.1" status: 204 len: 168 time: 2.2541420 May 12 15:36:56.438316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-84905dee-27d7-4ef1-ade1-0677fbe3297d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:56.440121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59264) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:56.528473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59268) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:56.544164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1aa43f63-d0d3-4363-8b05-1012090b053d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:56.546037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1aa43f63-d0d3-4363-8b05-1012090b053d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:56.547709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1aa43f63-d0d3-4363-8b05-1012090b053d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:56.548547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1aa43f63-d0d3-4363-8b05-1012090b053d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:36:56.564518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84905dee-27d7-4ef1-ade1-0677fbe3297d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Made reservation on behalf of 3dd1fe8ad774471ba7745219a37ead53 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:56.569411 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84905dee-27d7-4ef1-ade1-0677fbe3297d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:56.574123 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-af1d28a5-5387-4341-b888-23a60de6b862 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/d3738296-e321-4a38-bb44-3803dd75076e?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.1616266 May 12 15:36:56.582697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59274) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:56.590900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b726a123-cc6d-4dc0-aa23-3ec923318fc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:56.604514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-84905dee-27d7-4ef1-ade1-0677fbe3297d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 571} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:36:56.607617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1aa43f63-d0d3-4363-8b05-1012090b053d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:36:56.609881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1aa43f63-d0d3-4363-8b05-1012090b053d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.1687927 May 12 15:36:56.613588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59278) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:56.670418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84905dee-27d7-4ef1-ade1-0677fbe3297d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:56.670863 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-84905dee-27d7-4ef1-ade1-0677fbe3297d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Added segment 464fcc74-09ac-4457-9f5a-e40ea4ef2c72 of type vlan for network 2edf0bcd-3aed-4d20-90f8-59e368722fde May 12 15:36:56.715927 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7bb99655-224d-49c6-973f-8f5211dce6f5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:56.752765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7bb99655-224d-49c6-973f-8f5211dce6f5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:56.761984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7bb99655-224d-49c6-973f-8f5211dce6f5 admin admin] Usage tracker for resource:security_group_rule and tenant:05e6d048f80a47489176c9c212bb0d60 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:56.766554 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84905dee-27d7-4ef1-ade1-0677fbe3297d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:56.771460 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00de9711-9104-481a-b5de-f6bf6df7299b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:56.775401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-ce2ff986-4480-4235-8e43-e31186bedb5f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 1adea5b5-8e1d-4e35-b187-7fbf8778d11f {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:36:56.778567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7bb99655-224d-49c6-973f-8f5211dce6f5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:56.790573 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce2ff986-4480-4235-8e43-e31186bedb5f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:56.808807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-00de9711-9104-481a-b5de-f6bf6df7299b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:56.817840 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-00de9711-9104-481a-b5de-f6bf6df7299b admin admin] Usage tracker for resource:security_group_rule and tenant:e27e6b8d532d4e128b2bb6a732ae5b8c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:56.821933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7bb99655-224d-49c6-973f-8f5211dce6f5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:56.822999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-00de9711-9104-481a-b5de-f6bf6df7299b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:56.834951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b726a123-cc6d-4dc0-aa23-3ec923318fc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:56.838436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-00de9711-9104-481a-b5de-f6bf6df7299b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:56.843031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b726a123-cc6d-4dc0-aa23-3ec923318fc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:56.848553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b726a123-cc6d-4dc0-aa23-3ec923318fc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:56.860254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b726a123-cc6d-4dc0-aa23-3ec923318fc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:56.890256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b726a123-cc6d-4dc0-aa23-3ec923318fc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:56.894587 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b726a123-cc6d-4dc0-aa23-3ec923318fc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:56.902093 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce2ff986-4480-4235-8e43-e31186bedb5f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:56.934030 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84905dee-27d7-4ef1-ade1-0677fbe3297d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:56.939625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84905dee-27d7-4ef1-ade1-0677fbe3297d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:56.940189 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84905dee-27d7-4ef1-ade1-0677fbe3297d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.071850 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00de9711-9104-481a-b5de-f6bf6df7299b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.077267 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00de9711-9104-481a-b5de-f6bf6df7299b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.114977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84905dee-27d7-4ef1-ade1-0677fbe3297d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'Network': ['ID=2edf0bcd-3aed-4d20-90f8-59e368722fde,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:57.131777 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 2edf0bcd-3aed-4d20-90f8-59e368722fde details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:36:57.140105 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-84905dee-27d7-4ef1-ade1-0677fbe3297d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.8106315 May 12 15:36:57.148337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59282) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:57.172275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Request body: {'router': {'name': 'tempest-TestSecurityGroupsBasicOps-router-1084701644', 'admin_state_up': True, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:57.189807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:57.196887 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7bb99655-224d-49c6-973f-8f5211dce6f5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.197801 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-00de9711-9104-481a-b5de-f6bf6df7299b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e27e6b8d532d4e128b2bb6a732ae5b8c&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9080980 May 12 15:36:57.203718 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce2ff986-4480-4235-8e43-e31186bedb5f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.205258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59286) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:57.210054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Usage tracker for resource:router and tenant:3dd1fe8ad774471ba7745219a37ead53 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:57.282504 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7bb99655-224d-49c6-973f-8f5211dce6f5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.294840 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Quota usage for router was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:57.325936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 1 items for resource router. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:57.330291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00de9711-9104-481a-b5de-f6bf6df7299b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ff3cfce-9e61-4310-906c-5c42cbd9c2c4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:57.354109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b726a123-cc6d-4dc0-aa23-3ec923318fc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.410761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b726a123-cc6d-4dc0-aa23-3ec923318fc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:57.418923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-b726a123-cc6d-4dc0-aa23-3ec923318fc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:57.419959 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7bb99655-224d-49c6-973f-8f5211dce6f5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=05e6d048f80a47489176c9c212bb0d60&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8898299 May 12 15:36:57.421094 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.421598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bb99655-224d-49c6-973f-8f5211dce6f5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=956deb2e-3a31-44fd-bbc4-d622244fd136,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:57.422265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.424689 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59290) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:57.435366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d026a229-b913-4161-bf07-9659223675bb None None] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:57.460958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b726a123-cc6d-4dc0-aa23-3ec923318fc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:57.461623 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b726a123-cc6d-4dc0-aa23-3ec923318fc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.481783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b726a123-cc6d-4dc0-aa23-3ec923318fc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Subnet': ['ID=65927801-6b63-4764-8bc6-a8a23de8dd9d,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:57.503671 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce2ff986-4480-4235-8e43-e31186bedb5f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.557147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce2ff986-4480-4235-8e43-e31186bedb5f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=1adea5b5-8e1d-4e35-b187-7fbf8778d11f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:57.562012 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf37b220-047b-424b-8366-38bd6d6ad2d0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.569266 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce2ff986-4480-4235-8e43-e31186bedb5f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.607666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59296) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:57.609174 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b726a123-cc6d-4dc0-aa23-3ec923318fc1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0253274 May 12 15:36:57.611638 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf37b220-047b-424b-8366-38bd6d6ad2d0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.623914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'security_group': {'name': 'tempest-secgroup-656462178'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:57.626172 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.628736 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-326828cc-5bfc-4598-ab02-c9e0cd203808 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.636612 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ce2ff986-4480-4235-8e43-e31186bedb5f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/1adea5b5-8e1d-4e35-b187-7fbf8778d11f HTTP/1.1" status: 204 len: 168 time: 1.0193987 May 12 15:36:57.636612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:57.639166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59300) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:57.642644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:security_group and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:57.653558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:57.669427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54a36f4c-2a49-40a5-8499-8647eb10659c None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:57.701078 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-326828cc-5bfc-4598-ab02-c9e0cd203808 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.703241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:57.749555 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.794474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-d8d42d12-bd59-4206-b39e-9f070a60ee08 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 9697cb9e-01b5-485c-94a1-4bbe8714db12 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:36:57.802392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:57.806775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:security_group_rule and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:57.809869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:57.816017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:57.827460 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d8d42d12-bd59-4206-b39e-9f070a60ee08 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.963142 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.975281 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf37b220-047b-424b-8366-38bd6d6ad2d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:57.989157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:58.009280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf37b220-047b-424b-8366-38bd6d6ad2d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=956deb2e-3a31-44fd-bbc4-d622244fd136,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:58.048195 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d8d42d12-bd59-4206-b39e-9f070a60ee08 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:58.110642 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf37b220-047b-424b-8366-38bd6d6ad2d0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:58.114551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cf37b220-047b-424b-8366-38bd6d6ad2d0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/956deb2e-3a31-44fd-bbc4-d622244fd136 HTTP/1.1" status: 204 len: 168 time: 0.6851387 May 12 15:36:58.116404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f14b7939-ede5-435b-8c85-938c53d39590,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:58.122806 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:58.126514 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-41d7f191-361b-482e-a8f7-c5591a05a67e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1744 time: 0.5153396 May 12 15:36:58.127778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59306) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:58.134569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'security_group': {'name': 'tempest-secgroup-2103744777'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:58.147709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:58.156051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:security_group and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:58.161375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:58.174167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:58.193739 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:58.208357 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d8d42d12-bd59-4206-b39e-9f070a60ee08 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:58.230089 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:58.262655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-326828cc-5bfc-4598-ab02-c9e0cd203808 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:58.267477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'tenant_id': '9bd6beec65cd47b3a0febdc05aaed724', 'fixed_ips': [{'subnet_id': '65927801-6b63-4764-8bc6-a8a23de8dd9d'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:36:58.268333 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:58.300700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-326828cc-5bfc-4598-ab02-c9e0cd203808 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ff3cfce-9e61-4310-906c-5c42cbd9c2c4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:58.349663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-326828cc-5bfc-4598-ab02-c9e0cd203808 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:58.352304 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-326828cc-5bfc-4598-ab02-c9e0cd203808 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7ff3cfce-9e61-4310-906c-5c42cbd9c2c4 HTTP/1.1" status: 204 len: 168 time: 1.1391420 May 12 15:36:58.519960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:58.528541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:security_group_rule and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:58.536078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:58.548367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:58.590919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Allocated IP 172.20.0.2 (66bc0e1c-8b39-4a42-b061-fe805d2bcf80/65927801-6b63-4764-8bc6-a8a23de8dd9d/ce4fa33a-3f1f-4337-b016-94fd30cba869) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:36:58.640828 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d8d42d12-bd59-4206-b39e-9f070a60ee08 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:58.748818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8d42d12-bd59-4206-b39e-9f070a60ee08 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=9697cb9e-01b5-485c-94a1-4bbe8714db12,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:58.786155 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d8d42d12-bd59-4206-b39e-9f070a60ee08 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:58.822951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59320) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:58.896719 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d8d42d12-bd59-4206-b39e-9f070a60ee08 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/9697cb9e-01b5-485c-94a1-4bbe8714db12 HTTP/1.1" status: 204 len: 168 time: 1.2554915 May 12 15:36:58.908523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59326) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:58.911534 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7a8aa83-2750-4830-96dd-2167eb31a03c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:58.944659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.004862 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fa4e31d1-7302-43d8-9b2c-7715c8d39c75 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0946138 May 12 15:36:59.007878 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.013019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59332) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:59.016501 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.018027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f7a8aa83-2750-4830-96dd-2167eb31a03c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:59.024687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ae541edd-bf7e-4d97-a90b-9ba3518242ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:59.030870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Transition to ACTIVE for port object ce4fa33a-3f1f-4337-b016-94fd30cba869 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:59.053436 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.058935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f7a8aa83-2750-4830-96dd-2167eb31a03c admin admin] Usage tracker for resource:security_group_rule and tenant:3e096ac2f97c476f97c76a6717a04ab9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:59.059724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Transition to ACTIVE for port object ce4fa33a-3f1f-4337-b016-94fd30cba869 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:36:59.076311 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.137248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:59.143729 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:59.146741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:36:59.164353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f7a8aa83-2750-4830-96dd-2167eb31a03c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:59.171011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f7a8aa83-2750-4830-96dd-2167eb31a03c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:59.298687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fd550f81-fc57-4213-bbe2-70426aad92d9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:59.312977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.315355 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.319693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6acc3f2e-fe80-42eb-bfd6-09c1f82e791a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 1.1919823 May 12 15:36:59.320176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59336) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:59.325307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ae541edd-bf7e-4d97-a90b-9ba3518242ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:59.334135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ae541edd-bf7e-4d97-a90b-9ba3518242ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:59.338596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ae541edd-bf7e-4d97-a90b-9ba3518242ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:59.350332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ae541edd-bf7e-4d97-a90b-9ba3518242ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:59.372453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59338) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:59.396922 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-571ceef3-ac53-406d-845b-abb10ceeb5b2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.408939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Pushing event updated for resources: {'Port': ['ID=ce4fa33a-3f1f-4337-b016-94fd30cba869,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:59.412141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae541edd-bf7e-4d97-a90b-9ba3518242ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:59.416408 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae541edd-bf7e-4d97-a90b-9ba3518242ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.422720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdcd6229-ff2d-4f2f-b2f5-721d2be309b6 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:36:59.518608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-571ceef3-ac53-406d-845b-abb10ceeb5b2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:59.524545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-619097474', 'security_groups': ['fd550f81-fc57-4213-bbe2-70426aad92d9'], 'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '65927801-6b63-4764-8bc6-a8a23de8dd9d'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:36:59.535153 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7a8aa83-2750-4830-96dd-2167eb31a03c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.541906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-571ceef3-ac53-406d-845b-abb10ceeb5b2 admin admin] Usage tracker for resource:security_group_rule and tenant:15226d6bfcd141008c6836fc9752e5f7 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:36:59.548171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-571ceef3-ac53-406d-845b-abb10ceeb5b2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:36:59.557558 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7a8aa83-2750-4830-96dd-2167eb31a03c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.567793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-571ceef3-ac53-406d-845b-abb10ceeb5b2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:59.600812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Attempting to bind port ce4fa33a-3f1f-4337-b016-94fd30cba869 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:36:59.601350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Attempting to bind port ce4fa33a-3f1f-4337-b016-94fd30cba869 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '351c4dc8-5404-4259-bed5-cd4008dea28b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:36:59.601487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Attempting to bind port ce4fa33a-3f1f-4337-b016-94fd30cba869 on network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:36:59.627012 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-10134951-ece5-4734-a096-c3beaafa4092 None None] Provisioning complete for port 4193ed39-865f-4223-bdbd-3ded5d01d5ba triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:36:59.627375 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-10134951-ece5-4734-a096-c3beaafa4092 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.644593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f7a8aa83-2750-4830-96dd-2167eb31a03c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3e096ac2f97c476f97c76a6717a04ab9&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8202915 May 12 15:36:59.649713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59346) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:59.663963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7a8aa83-2750-4830-96dd-2167eb31a03c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf7c134e-091f-43d7-9f97-5726f14e2822,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:59.673559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 36, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:36:59.674445 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Checking segment: {'id': '351c4dc8-5404-4259-bed5-cd4008dea28b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:36:59.674962 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.675724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Bound using segment: {'id': '351c4dc8-5404-4259-bed5-cd4008dea28b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:36:59.676266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Bound port: ce4fa33a-3f1f-4337-b016-94fd30cba869, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '351c4dc8-5404-4259-bed5-cd4008dea28b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:36:59.676677 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.775291 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ffd9387-7ae4-4018-a96e-6c283b803187 req-d7d75cd7-3e95-4903-ba73-90ee3a44479d service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.3155394 May 12 15:36:59.807088 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-571ceef3-ac53-406d-845b-abb10ceeb5b2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.819709 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-571ceef3-ac53-406d-845b-abb10ceeb5b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.858559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-571ceef3-ac53-406d-845b-abb10ceeb5b2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=90f44334-7436-4458-9581-b04e6cd3444b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:36:59.902269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-013ed0af-4619-4dc6-8d72-8517fdb5897d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.904620 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae541edd-bf7e-4d97-a90b-9ba3518242ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.914301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:36:59.925779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:36:59.941682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-571ceef3-ac53-406d-845b-abb10ceeb5b2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=15226d6bfcd141008c6836fc9752e5f7&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5681727 May 12 15:36:59.949457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59350) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:36:59.952446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:36:59.973150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae541edd-bf7e-4d97-a90b-9ba3518242ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:36:59.976267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-ae541edd-bf7e-4d97-a90b-9ba3518242ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:36:59.982784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae541edd-bf7e-4d97-a90b-9ba3518242ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:36:59.983376 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae541edd-bf7e-4d97-a90b-9ba3518242ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:36:59.991455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Allocated IP 172.25.8.104 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/fc86a368-e153-4a81-95d3-8aae87de7b1d) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:00.002508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae541edd-bf7e-4d97-a90b-9ba3518242ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=1d0b1eb3-b2bd-477f-9116-21efb3abfe4a,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:00.029926 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ae541edd-bf7e-4d97-a90b-9ba3518242ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0150011 May 12 15:37:00.032787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59354) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:00.038393 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] For port ce4fa33a-3f1f-4337-b016-94fd30cba869, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:37:00.041068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:00.045818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] For port ce4fa33a-3f1f-4337-b016-94fd30cba869, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce4fa33a-3f1f-4337-b016-94fd30cba869,segment=NetworkSegment(351c4dc8-5404-4259-bed5-cd4008dea28b),segment_id=351c4dc8-5404-4259-bed5-cd4008dea28b)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:37:00.055970 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:00.104195 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-013ed0af-4619-4dc6-8d72-8517fdb5897d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:00.162490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0d5f65f-4ebe-445d-ae02-4f46d875d6b8 None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:37:00.172805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a0d5f65f-4ebe-445d-ae02-4f46d875d6b8 None None] Deleting port 4193ed39-865f-4223-bdbd-3ded5d01d5ba {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:00.173309 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a0d5f65f-4ebe-445d-ae02-4f46d875d6b8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:00.227255 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-139050a6-fd45-404f-9d41-01db47a998a2 None None] Pushing event updated for resources: {'Port': ['ID=ce4fa33a-3f1f-4337-b016-94fd30cba869,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:00.234696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ffd9387-7ae4-4018-a96e-6c283b803187 req-01c44c70-f3f0-479a-a514-e37cb337c536 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:00.236206 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ffd9387-7ae4-4018-a96e-6c283b803187 req-01c44c70-f3f0-479a-a514-e37cb337c536 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=ed8d9bf58283443480f0c62e72d53449&device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 1097 time: 0.4315457 May 12 15:37:00.291290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:00.314254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:00.318276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:00.326283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:00.339874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:00.356417 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:00.612714 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8c06f81-56b9-415a-825f-a15fcc49c7bf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:00.617092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a0d5f65f-4ebe-445d-ae02-4f46d875d6b8 None None] For port 4193ed39-865f-4223-bdbd-3ded5d01d5ba, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4193ed39-865f-4223-bdbd-3ded5d01d5ba,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:00.623701 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a0d5f65f-4ebe-445d-ae02-4f46d875d6b8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:00.725187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:00.828367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a0d5f65f-4ebe-445d-ae02-4f46d875d6b8 None None] Calling delete_port for 4193ed39-865f-4223-bdbd-3ded5d01d5ba owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:00.878994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port fdd44655-5be1-488d-9048-7e6ca6c6a61e yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:37:00.956165 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a0d5f65f-4ebe-445d-ae02-4f46d875d6b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:00.997118 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-013ed0af-4619-4dc6-8d72-8517fdb5897d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:01.003691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.objects.ports [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88152) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:37:01.005421 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:01.069010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0d5f65f-4ebe-445d-ae02-4f46d875d6b8 None None] Pushing event deleted for resources: {'Port': ['ID=4193ed39-865f-4223-bdbd-3ded5d01d5ba,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:01.076175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-013ed0af-4619-4dc6-8d72-8517fdb5897d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf7c134e-091f-43d7-9f97-5726f14e2822,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:01.088598 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:01.093999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:01.098613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:01.102509 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:01.103413 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:01.127679 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8c06f81-56b9-415a-825f-a15fcc49c7bf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:01.128099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=e5756c58-c54a-46bc-9199-09e74d94842f,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:01.132125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0d5f65f-4ebe-445d-ae02-4f46d875d6b8 None None] No DVR routers for this DVR port 4193ed39-865f-4223-bdbd-3ded5d01d5ba on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:37:01.168835 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-be6d83a3-d2c7-4ab1-8fba-ce30993ca2ea tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.1340468 May 12 15:37:01.175381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59370) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:01.182724 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'mac_address': 'fa:16:3e:c6:67:be', 'name': 'tempest-NetworksTestDHCPv6-2020305808'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:01.191679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5420906-f844-419a-aa94-409516df7de9 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:01.448420 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-013ed0af-4619-4dc6-8d72-8517fdb5897d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:01.452949 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-013ed0af-4619-4dc6-8d72-8517fdb5897d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cf7c134e-091f-43d7-9f97-5726f14e2822 HTTP/1.1" status: 204 len: 168 time: 1.7959557 May 12 15:37:01.484677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ffd9387-7ae4-4018-a96e-6c283b803187 req-fec451e1-2fde-44d5-9f12-550666ce8c77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:01.486174 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ffd9387-7ae4-4018-a96e-6c283b803187 req-fec451e1-2fde-44d5-9f12-550666ce8c77 service neutron] 10.222.0.76 "GET /v2.0/networks?id=bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 200 len: 919 time: 1.1412470 May 12 15:37:01.531542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:01.536811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:port and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:01.545583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ce4fa33a-3f1f-4337-b016-94fd30cba869 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:01.546310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:01.561237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:01.581921 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8c06f81-56b9-415a-825f-a15fcc49c7bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:01.583963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:01.617179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8c06f81-56b9-415a-825f-a15fcc49c7bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=90f44334-7436-4458-9581-b04e6cd3444b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:01.629846 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ffd9387-7ae4-4018-a96e-6c283b803187 req-9fdbc6d6-ebd1-4371-8d89-53192b0f8601 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=89f8d6b5-809f-446f-bb95-9e0f45b66f60 HTTP/1.1" status: 200 len: 217 time: 0.1278238 May 12 15:37:01.834061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ce4fa33a-3f1f-4337-b016-94fd30cba869 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:01.891841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ffd9387-7ae4-4018-a96e-6c283b803187 req-b16d3bd4-adc8-481e-9673-cb84520877ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:01.893289 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ffd9387-7ae4-4018-a96e-6c283b803187 req-b16d3bd4-adc8-481e-9673-cb84520877ce service neutron] 10.222.0.76 "GET /v2.0/subnets?id=aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 200 len: 857 time: 0.2483346 May 12 15:37:02.026529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:02.026712 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:02.038251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '1d0b1eb3-b2bd-477f-9116-21efb3abfe4a'}, {'subnet_id': 'e5756c58-c54a-46bc-9199-09e74d94842f'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:37:02.039746 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:02.130529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8c06f81-56b9-415a-825f-a15fcc49c7bf admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:02.131888 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a8c06f81-56b9-415a-825f-a15fcc49c7bf admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/90f44334-7436-4458-9581-b04e6cd3444b HTTP/1.1" status: 204 len: 168 time: 2.1611891 May 12 15:37:02.155510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:02.161956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:02.162412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 63ff4f30-8fd7-4cc4-b84b-bf48224ab1b0 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:37:02.171702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:02.200732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4193ed39-865f-4223-bdbd-3ded5d01d5ba no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:37:02.555696 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Allocated IP 172.20.0.2 (2447b094-d5d6-41ef-a146-2bf56f5399af/1d0b1eb3-b2bd-477f-9116-21efb3abfe4a/580ed2cf-72bd-4f56-a8cc-51c6e1cd960e) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:02.562460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Allocated IP 2001:db8::f816:3eff:fed7:29b0 (2447b094-d5d6-41ef-a146-2bf56f5399af/e5756c58-c54a-46bc-9199-09e74d94842f/580ed2cf-72bd-4f56-a8cc-51c6e1cd960e) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:02.564880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'Port': ['ID=fc86a368-e153-4a81-95d3-8aae87de7b1d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:02.574719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Allocated IP 172.20.0.13 (66bc0e1c-8b39-4a42-b061-fe805d2bcf80/65927801-6b63-4764-8bc6-a8a23de8dd9d/fdd44655-5be1-488d-9048-7e6ca6c6a61e) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:02.932605 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 4193ed39-865f-4223-bdbd-3ded5d01d5ba {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:37:02.933103 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4193ed39-865f-4223-bdbd-3ded5d01d5ba not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:37:02.948636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-15097c55-d824-46d8-9aee-b4d122538f15 None None] Provisioning for port ce4fa33a-3f1f-4337-b016-94fd30cba869 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:03.044850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ffd9387-7ae4-4018-a96e-6c283b803187 req-d9a29812-1c12-4c25-9ab1-c6ffd98bc684 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:03.046600 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ffd9387-7ae4-4018-a96e-6c283b803187 req-d9a29812-1c12-4c25-9ab1-c6ffd98bc684 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=bca349be-4618-43ae-a547-b8bd2b254da4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 1.1420398 May 12 15:37:03.060327 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:03.063341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-15097c55-d824-46d8-9aee-b4d122538f15 None None] Provisioning complete for port ce4fa33a-3f1f-4337-b016-94fd30cba869 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:03.063712 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-15097c55-d824-46d8-9aee-b4d122538f15 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:03.168957 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:03.194070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Transition to ACTIVE for port object 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:03.256494 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Transition to ACTIVE for port object 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:03.280191 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:03.453159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Pushing event updated for resources: {'Port': ['ID=580ed2cf-72bd-4f56-a8cc-51c6e1cd960e,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:03.499558 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:03.503425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:03.512085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:03.623467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 172.20.0.3 (2447b094-d5d6-41ef-a146-2bf56f5399af/1d0b1eb3-b2bd-477f-9116-21efb3abfe4a/63ff4f30-8fd7-4cc4-b84b-bf48224ab1b0) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:03.634983 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::f816:3eff:fec6:67be (2447b094-d5d6-41ef-a146-2bf56f5399af/e5756c58-c54a-46bc-9199-09e74d94842f/63ff4f30-8fd7-4cc4-b84b-bf48224ab1b0) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:03.675073 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:03.697991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Transition to ACTIVE for port object fdd44655-5be1-488d-9048-7e6ca6c6a61e will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:03.757905 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:03.902598 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-15097c55-d824-46d8-9aee-b4d122538f15 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:03.919883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:03.955895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59436) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:03.966764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Attempting to bind port 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:37:03.966764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Attempting to bind port 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:37:03.966764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Attempting to bind port 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:37:03.975830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:03.979064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:03.988140 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 36, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:37:03.988599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:37:03.989012 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:03.989416 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:37:03.990002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Bound port: 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:37:03.990380 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:04.035888 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:04.085275 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:04.088147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-15097c55-d824-46d8-9aee-b4d122538f15 None None] For port ce4fa33a-3f1f-4337-b016-94fd30cba869, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce4fa33a-3f1f-4337-b016-94fd30cba869,segment=NetworkSegment(351c4dc8-5404-4259-bed5-cd4008dea28b),segment_id=351c4dc8-5404-4259-bed5-cd4008dea28b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:04.108730 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-15097c55-d824-46d8-9aee-b4d122538f15 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:04.114983 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object 63ff4f30-8fd7-4cc4-b84b-bf48224ab1b0 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:04.148048 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:04.271094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-15097c55-d824-46d8-9aee-b4d122538f15 None None] Provisioning complete for port d3738296-e321-4a38-bb44-3803dd75076e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:04.271585 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-15097c55-d824-46d8-9aee-b4d122538f15 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:04.317930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:04.320567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:04.327406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:04.426656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] For port 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:37:04.486669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=63ff4f30-8fd7-4cc4-b84b-bf48224ab1b0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:04.510982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:04.517806 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:04.518327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] For port 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=580ed2cf-72bd-4f56-a8cc-51c6e1cd960e,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:37:04.523171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:04.525086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-15097c55-d824-46d8-9aee-b4d122538f15 None None] Port d3738296-e321-4a38-bb44-3803dd75076e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:37:04.526246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:04.526712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:04.527158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:04.527621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:04.528049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:04.528819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:04.530162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:04.532333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:04.532783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:04.542292 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:04.550101 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15097c55-d824-46d8-9aee-b4d122538f15 None None] Pushing event updated for resources: {'Port': ['ID=ce4fa33a-3f1f-4337-b016-94fd30cba869,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:04.567220 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ffd9387-7ae4-4018-a96e-6c283b803187 req-88bd5ba6-e97d-4a02-81d6-ba300ced5a4c service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.4584894 May 12 15:37:04.580701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:04.582840 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:04.641425 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-40af6319-ac81-467f-95ba-c64f1591b94a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 3.4660566 May 12 15:37:04.643035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59462) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:04.730971 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-075f68d0-2243-47c0-bcab-3ec226904414 None None] Pushing event updated for resources: {'Port': ['ID=580ed2cf-72bd-4f56-a8cc-51c6e1cd960e,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:04.738933 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e0549ff2-76e9-47af-818a-26f9e6506ea0 None None] Provisioning for port fdd44655-5be1-488d-9048-7e6ca6c6a61e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:04.749613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e0549ff2-76e9-47af-818a-26f9e6506ea0 None None] Provisioning complete for port fdd44655-5be1-488d-9048-7e6ca6c6a61e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:04.749953 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e0549ff2-76e9-47af-818a-26f9e6506ea0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:04.776625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-336a81d1-8fa1-40f0-8a36-d1790c1e7e95 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:04.785185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-336a81d1-8fa1-40f0-8a36-d1790c1e7e95 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:04.787872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-336a81d1-8fa1-40f0-8a36-d1790c1e7e95 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:04.817775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-336a81d1-8fa1-40f0-8a36-d1790c1e7e95 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:04.825034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-336a81d1-8fa1-40f0-8a36-d1790c1e7e95 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1861 time: 0.1804066 May 12 15:37:04.827230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59470) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:04.885017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e0549ff2-76e9-47af-818a-26f9e6506ea0 None None] Port fdd44655-5be1-488d-9048-7e6ca6c6a61e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:37:04.951769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-1a1f67ef-cad4-4757-84d1-9534d376ff88 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port 63ff4f30-8fd7-4cc4-b84b-bf48224ab1b0 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:04.952158 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a1f67ef-cad4-4757-84d1-9534d376ff88 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:05.027177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-test-network-963580409'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:05.033095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:05.037117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:network and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:05.058227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:05.150748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:05.165257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=fdd44655-5be1-488d-9048-7e6ca6c6a61e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:05.199387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:05.199387 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:05.235408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Made reservation on behalf of 9d4bdd73a39f4390bb7d4c6d7a1fc0c4 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:05.238944 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:05.451948 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:05.486442 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:05.532966 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a1f67ef-cad4-4757-84d1-9534d376ff88 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:05.578448 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cfeee04e-a6ad-465f-869e-188dfb455986 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 6.1322527 May 12 15:37:05.589738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:05.608133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59490) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:05.616974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:security_group_rule and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:05.633669 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ce4fa33a-3f1f-4337-b016-94fd30cba869 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:05.712791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-1a1f67ef-cad4-4757-84d1-9534d376ff88 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for 63ff4f30-8fd7-4cc4-b84b-bf48224ab1b0 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:05.777285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-007ba7b5-142b-4258-a9c2-302e6403fade tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:05.799094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ce4fa33a-3f1f-4337-b016-94fd30cba869 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:05.799500 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:05.819331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:05.840514 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7ffd9387-7ae4-4018-a96e-6c283b803187 req-f8e733d3-a14e-4788-a6c5-e2786352c4a5 service neutron] 10.222.0.76 "GET /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.2461946 May 12 15:37:05.845946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:06.035129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fc2cdd-278a-456b-9a0b-97dac00e1ab3 req-73f64f26-3faf-41e4-a2dd-f2459c69e097 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:06.036855 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10fc2cdd-278a-456b-9a0b-97dac00e1ab3 req-73f64f26-3faf-41e4-a2dd-f2459c69e097 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.9775741 May 12 15:37:06.052815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Router 758b50f3-4f3d-446e-b73c-bb447a30f408 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:37:06.064022 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:06.090542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a1f67ef-cad4-4757-84d1-9534d376ff88 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:06.208130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a1f67ef-cad4-4757-84d1-9534d376ff88 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=63ff4f30-8fd7-4cc4-b84b-bf48224ab1b0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:06.228861 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:06.248626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-007ba7b5-142b-4258-a9c2-302e6403fade tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:06.256557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-007ba7b5-142b-4258-a9c2-302e6403fade tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:06.335074 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10fc2cdd-278a-456b-9a0b-97dac00e1ab3 req-f90a4d75-a00e-48ec-ad49-2cafc39c22be tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2852876 May 12 15:37:06.364301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-007ba7b5-142b-4258-a9c2-302e6403fade tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:06.434266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-007ba7b5-142b-4258-a9c2-302e6403fade tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:06.524552 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:06.532713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f70e562a-75a0-483c-b32b-eae9c6404b8e None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:06.536527 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:06.552210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 550} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:37:06.562670 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:06.563058 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Added segment b4cb4823-b26b-42a9-a8a8-2383c10a1371 of type vlan for network 2d338475-91c7-4829-98f2-54874ae73504 May 12 15:37:06.596295 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:06.629173 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a1f67ef-cad4-4757-84d1-9534d376ff88 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:06.644887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1a1f67ef-cad4-4757-84d1-9534d376ff88 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/63ff4f30-8fd7-4cc4-b84b-bf48224ab1b0 HTTP/1.1" status: 204 len: 168 time: 1.8163702 May 12 15:37:06.647378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59510) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:06.658908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-007ba7b5-142b-4258-a9c2-302e6403fade tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:06.664717 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-007ba7b5-142b-4258-a9c2-302e6403fade tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:06.712577 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:06.718214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:06.718981 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:06.767084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9a4903c-02f2-4914-8223-00061e2d6058 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:06.768653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9a4903c-02f2-4914-8223-00061e2d6058 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:06.777669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9a4903c-02f2-4914-8223-00061e2d6058 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:06.780952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e9a4903c-02f2-4914-8223-00061e2d6058 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:06.806507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e9a4903c-02f2-4914-8223-00061e2d6058 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:06.809845 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e9a4903c-02f2-4914-8223-00061e2d6058 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.1614168 May 12 15:37:06.811656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59518) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:06.857784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8411033e-852d-4064-982e-061904b878c8 None None] Provisioning for port 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:06.877272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8411033e-852d-4064-982e-061904b878c8 None None] Provisioning complete for port 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:06.877959 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8411033e-852d-4064-982e-061904b878c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:06.932975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-1ebbd943-aadf-4b1b-bcdd-bf02197d262e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 1d0b1eb3-b2bd-477f-9116-21efb3abfe4a {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:37:06.946842 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1ebbd943-aadf-4b1b-bcdd-bf02197d262e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:07.111249 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1ebbd943-aadf-4b1b-bcdd-bf02197d262e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:07.111765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Network': ['ID=2d338475-91c7-4829-98f2-54874ae73504,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:07.115209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:37:07.130096 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 3.0964036 May 12 15:37:07.140229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59524) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:07.140987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-518c1827-0a5f-4750-854e-ac0b0fdc36a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9711e2e0-d907-4e94-b984-435b9465a2e8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:07.145778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 2d338475-91c7-4829-98f2-54874ae73504 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:37:07.151599 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'subnet': {'network_id': '2d338475-91c7-4829-98f2-54874ae73504', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:07.158969 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Sync routers for ids ['758b50f3-4f3d-446e-b73c-bb447a30f408'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:37:07.206418 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Routers {'758b50f3-4f3d-446e-b73c-bb447a30f408'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:07.210513 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:36:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['758b50f3-4f3d-446e-b73c-bb447a30f408'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:07.275374 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:07.279852 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a592aa6c-f497-425b-8265-fa84189b0228 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 894 time: 10.1206501 May 12 15:37:07.292973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59530) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:07.376613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-afeca664-b701-447d-b6fb-ddf81ded954c tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:07.381956 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-afeca664-b701-447d-b6fb-ddf81ded954c tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=3dd1fe8ad774471ba7745219a37ead53&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 830 time: 0.0851598 May 12 15:37:07.382620 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59536) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:07.424552 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1ebbd943-aadf-4b1b-bcdd-bf02197d262e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:07.517597 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8411033e-852d-4064-982e-061904b878c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:07.529405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59542) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:07.563213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:07.570516 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1ebbd943-aadf-4b1b-bcdd-bf02197d262e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:07.587936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:subnet and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:07.591087 n-d-841483-1 neutron-server[88151]: INFO neutron.db.ipam_backend_mixin [None req-007ba7b5-142b-4258-a9c2-302e6403fade tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 65927801-6b63-4764-8bc6-a8a23de8dd9d (CIDR: 172.20.0.0/28) May 12 15:37:07.593650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:07.600980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db35c401-b775-46c9-a205-dfb52e290a5a tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:07.603387 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-db35c401-b775-46c9-a205-dfb52e290a5a tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2142639 May 12 15:37:07.605172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:07.607101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59550) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:07.608256 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-007ba7b5-142b-4258-a9c2-302e6403fade tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:37:07.608734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-007ba7b5-142b-4258-a9c2-302e6403fade tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:07.706143 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-007ba7b5-142b-4258-a9c2-302e6403fade tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 2.0967920 May 12 15:37:07.717827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ebbd943-aadf-4b1b-bcdd-bf02197d262e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=1d0b1eb3-b2bd-477f-9116-21efb3abfe4a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:07.721964 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bf4063e1-0750-42b0-9b54-aea89d740d6e tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0977690 May 12 15:37:07.724173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59554) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:07.724460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59556) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:07.747745 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1ebbd943-aadf-4b1b-bcdd-bf02197d262e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:07.748446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-29008a17-0edd-47c4-bf22-92eb160722b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:07.809758 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1ebbd943-aadf-4b1b-bcdd-bf02197d262e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/1d0b1eb3-b2bd-477f-9116-21efb3abfe4a HTTP/1.1" status: 204 len: 168 time: 0.9966059 May 12 15:37:07.811133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59564) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:07.853936 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-8411033e-852d-4064-982e-061904b878c8 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:37:07.854279 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-8411033e-852d-4064-982e-061904b878c8 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:37:07.856210 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Set router 758b50f3-4f3d-446e-b73c-bb447a30f408 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:37:07.894350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-4c69fda0-4b4c-4ce9-9706-ac39f192e3b8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet e5756c58-c54a-46bc-9199-09e74d94842f {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:37:07.901616 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c69fda0-4b4c-4ce9-9706-ac39f192e3b8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:07.923544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Made reservation on behalf of 9d4bdd73a39f4390bb7d4c6d7a1fc0c4 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:07.927018 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:07.946846 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-edc97f80-7bd5-4933-af08-30026d9848df tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=3dd1fe8ad774471ba7745219a37ead53&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2134182 May 12 15:37:07.956617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59570) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:07.979139 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-553ad60a-998d-4c8d-a6fc-ee91997ca705 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:08.068007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9546067-2226-42d4-8bcd-94dfbce2d6db None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:08.121599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0224999c-6635-4116-89a1-b5d26eb7a374 req-5f2ac112-4ac1-4c1b-8a4e-6074b7b91523 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:08.128982 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0224999c-6635-4116-89a1-b5d26eb7a374 req-5f2ac112-4ac1-4c1b-8a4e-6074b7b91523 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.4936395 May 12 15:37:08.183118 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c69fda0-4b4c-4ce9-9706-ac39f192e3b8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:08.245592 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1084701644', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104'}], 'enable_snat': True}, 'gw_port_id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:57Z', 'updated_at': '2022-05-12T15:37:03Z', 'revision_number': 3, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:8a:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2887, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:36:59Z', 'updated_at': '2022-05-12T15:37:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:08.250460 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Checking router: 758b50f3-4f3d-446e-b73c-bb447a30f408 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:37:08.251071 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Updating router 758b50f3-4f3d-446e-b73c-bb447a30f408 port fc86a368-e153-4a81-95d3-8aae87de7b1d binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:37:08.326254 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c69fda0-4b4c-4ce9-9706-ac39f192e3b8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:08.375476 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:08.440927 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8411033e-852d-4064-982e-061904b878c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:08.514763 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0224999c-6635-4116-89a1-b5d26eb7a374 req-bdac6d3c-e0aa-495c-b0be-6019d5a93280 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3847711 May 12 15:37:08.532384 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c69fda0-4b4c-4ce9-9706-ac39f192e3b8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:08.542742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-553ad60a-998d-4c8d-a6fc-ee91997ca705 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:08.564179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-553ad60a-998d-4c8d-a6fc-ee91997ca705 admin admin] Usage tracker for resource:security_group_rule and tenant:cbd53e43dad14f8bb1f19f35b013448a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:08.574194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-553ad60a-998d-4c8d-a6fc-ee91997ca705 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:08.606203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-553ad60a-998d-4c8d-a6fc-ee91997ca705 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:08.618586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7aca7f42-2c7a-49b6-bb2c-8e17d083d44e tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:08.623295 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7aca7f42-2c7a-49b6-bb2c-8e17d083d44e tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.6642931 May 12 15:37:08.625627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59576) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:08.628378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c69fda0-4b4c-4ce9-9706-ac39f192e3b8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=e5756c58-c54a-46bc-9199-09e74d94842f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:08.630609 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c69fda0-4b4c-4ce9-9706-ac39f192e3b8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:08.645357 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-8411033e-852d-4064-982e-061904b878c8 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:37:08.646106 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-8411033e-852d-4064-982e-061904b878c8 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:37:08.688641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5430470c-12ca-4ea4-8b23-404687f970e0 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0616229 May 12 15:37:08.689678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59580) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:08.702535 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4c69fda0-4b4c-4ce9-9706-ac39f192e3b8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/e5756c58-c54a-46bc-9199-09e74d94842f HTTP/1.1" status: 204 len: 168 time: 0.8883035 May 12 15:37:08.708338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-2010045841', 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde', 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'ip_version': 4, 'cidr': '172.20.0.16/28'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:08.736348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59584) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:08.794616 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-553ad60a-998d-4c8d-a6fc-ee91997ca705 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:08.842547 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9a98eaf9-e56f-4b7b-9eff-71c8c5eacd46 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1046617 May 12 15:37:08.843278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59588) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:08.892691 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:08.912599 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Transition to ACTIVE for port object fc86a368-e153-4a81-95d3-8aae87de7b1d will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:08.927386 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:08.997864 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-553ad60a-998d-4c8d-a6fc-ee91997ca705 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:09.031088 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:09.037476 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:09.044861 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5456c2d7-b84b-428c-8a5d-bccafec823bf None None] Pushing event updated for resources: {'Port': ['ID=fc86a368-e153-4a81-95d3-8aae87de7b1d,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:09.047236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Usage tracker for resource:subnet and tenant:3dd1fe8ad774471ba7745219a37ead53 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:09.050442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:09.056432 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5456c2d7-b84b-428c-8a5d-bccafec823bf None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:09.056773 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5456c2d7-b84b-428c-8a5d-bccafec823bf None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:09.057112 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5456c2d7-b84b-428c-8a5d-bccafec823bf None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:09.057491 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5456c2d7-b84b-428c-8a5d-bccafec823bf None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:09.057828 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5456c2d7-b84b-428c-8a5d-bccafec823bf None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:09.058151 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5456c2d7-b84b-428c-8a5d-bccafec823bf None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:09.058471 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5456c2d7-b84b-428c-8a5d-bccafec823bf None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:09.058789 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5456c2d7-b84b-428c-8a5d-bccafec823bf None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:09.059107 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5456c2d7-b84b-428c-8a5d-bccafec823bf None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:09.059653 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5456c2d7-b84b-428c-8a5d-bccafec823bf None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:09.059975 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5456c2d7-b84b-428c-8a5d-bccafec823bf None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:09.060290 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5456c2d7-b84b-428c-8a5d-bccafec823bf None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:09.074546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:09.088755 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Attempting to bind port fc86a368-e153-4a81-95d3-8aae87de7b1d on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:37:09.089121 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Attempting to bind port fc86a368-e153-4a81-95d3-8aae87de7b1d by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:37:09.089501 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Attempting to bind port fc86a368-e153-4a81-95d3-8aae87de7b1d on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:37:09.096006 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 36, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:37:09.096378 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:37:09.096822 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:09.097278 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:37:09.099119 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Bound port: fc86a368-e153-4a81-95d3-8aae87de7b1d, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:37:09.099780 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:09.104278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d2a04420-6bb8-40cf-a272-22f45007b0dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:09.105013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d2a04420-6bb8-40cf-a272-22f45007b0dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:09.124440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Made reservation on behalf of 3dd1fe8ad774471ba7745219a37ead53 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:09.127971 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:09.152241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-29008a17-0edd-47c4-bf22-92eb160722b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:09.157527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-29008a17-0edd-47c4-bf22-92eb160722b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:09.162335 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-29008a17-0edd-47c4-bf22-92eb160722b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:09.171186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-29008a17-0edd-47c4-bf22-92eb160722b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:09.212596 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] For port fc86a368-e153-4a81-95d3-8aae87de7b1d, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:37:09.216812 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] For port fc86a368-e153-4a81-95d3-8aae87de7b1d, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fc86a368-e153-4a81-95d3-8aae87de7b1d,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:37:09.225423 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:09.236099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-fab61587-919d-42bc-b8b4-f51a6a9d538f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:09.236861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-fab61587-919d-42bc-b8b4-f51a6a9d538f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Synchronizing usage tracker for tenant:ed8d9bf58283443480f0c62e72d53449 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:09.278503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-29008a17-0edd-47c4-bf22-92eb160722b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:09.288046 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29008a17-0edd-47c4-bf22-92eb160722b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:09.295521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80fb5dff-9b3e-40e5-8735-153376194d75 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:09.347572 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Routers {'758b50f3-4f3d-446e-b73c-bb447a30f408'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:09.347572 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:36:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['758b50f3-4f3d-446e-b73c-bb447a30f408'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:09.349177 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-553ad60a-998d-4c8d-a6fc-ee91997ca705 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=cbd53e43dad14f8bb1f19f35b013448a&name=default HTTP/1.1" status: 200 len: 2983 time: 1.8124225 May 12 15:37:09.378512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d2a04420-6bb8-40cf-a272-22f45007b0dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:09.380067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d2a04420-6bb8-40cf-a272-22f45007b0dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.5321653 May 12 15:37:09.388011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59594) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:09.388654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59596) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:09.424424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-553ad60a-998d-4c8d-a6fc-ee91997ca705 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9116e398-d8dd-45d8-b2c2-4aaf41e7e57f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:09.521802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-fab61587-919d-42bc-b8b4-f51a6a9d538f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Unset dirty status for tenant:ed8d9bf58283443480f0c62e72d53449 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:09.523788 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-fab61587-919d-42bc-b8b4-f51a6a9d538f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.76 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 1.7372725 May 12 15:37:09.545451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a442c6b9-298b-4084-ae7d-25da063b2c15 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:09.546213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a442c6b9-298b-4084-ae7d-25da063b2c15 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:09.551026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Subnet': ['ID=6a6a3afc-f008-4a33-8e40-276ea11e299b,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:09.637680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Checking segment: {'id': 'b4cb4823-b26b-42a9-a8a8-2383c10a1371', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '2d338475-91c7-4829-98f2-54874ae73504'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:37:09.638962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network hostable DHCP agents. Network: 2d338475-91c7-4829-98f2-54874ae73504, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:37:09.649279 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a9bc64e-c16f-46ff-bf90-01353e8dc3d5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:09.651115 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a442c6b9-298b-4084-ae7d-25da063b2c15 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:09.652441 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a442c6b9-298b-4084-ae7d-25da063b2c15 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2600088 May 12 15:37:09.655827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59604) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:09.659781 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8411033e-852d-4064-982e-061904b878c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:09.765231 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8411033e-852d-4064-982e-061904b878c8 None None] For port 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=580ed2cf-72bd-4f56-a8cc-51c6e1cd960e,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:09.777496 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8411033e-852d-4064-982e-061904b878c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:09.796344 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5456c2d7-b84b-428c-8a5d-bccafec823bf None None] Pushing event updated for resources: {'Port': ['ID=fc86a368-e153-4a81-95d3-8aae87de7b1d,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:09.825361 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] Set router 758b50f3-4f3d-446e-b73c-bb447a30f408 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:37:09.860841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Deleting port d45db345-6e10-417e-8b52-3260151d6ba4 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:09.861931 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:09.895533 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8411033e-852d-4064-982e-061904b878c8 None None] Pushing event updated for resources: {'Port': ['ID=580ed2cf-72bd-4f56-a8cc-51c6e1cd960e,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:09.910793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5f4e06e1-53ef-4892-8061-e84db699476b None None] Provisioning complete for port 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:09.911385 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5f4e06e1-53ef-4892-8061-e84db699476b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:09.916171 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a9bc64e-c16f-46ff-bf90-01353e8dc3d5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:09.948709 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-597cc02d-2d4b-4e71-b774-497752f217b1 None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:37:09.974216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-597cc02d-2d4b-4e71-b774-497752f217b1 None None] Deleting port 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:09.974897 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-597cc02d-2d4b-4e71-b774-497752f217b1 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:09.986436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network 2d338475-91c7-4829-98f2-54874ae73504 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:37:09.991429 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a9bc64e-c16f-46ff-bf90-01353e8dc3d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:10.050200 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0b606de0-631d-4d04-99c5-753c6324d6eb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.3864944 May 12 15:37:10.051348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59608) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:10.075214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e9abf6d3-9758-480d-88fa-f08f81bc5d94 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:10.091505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a9bc64e-c16f-46ff-bf90-01353e8dc3d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9116e398-d8dd-45d8-b2c2-4aaf41e7e57f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:10.098071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 2d338475-91c7-4829-98f2-54874ae73504) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:10.127706 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:10.132625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12bf6848-3ad8-4f37-91bd-d57fb5ca2049 None None] Network 2d338475-91c7-4829-98f2-54874ae73504 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:10.295732 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1084701644', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104'}], 'enable_snat': True}, 'gw_port_id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:57Z', 'updated_at': '2022-05-12T15:37:03Z', 'revision_number': 3, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:8a:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2887, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:36:59Z', 'updated_at': '2022-05-12T15:37:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:10.300749 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69a7b850-4f7a-4bbd-8be9-c862864a4697 None None] The sync data for ids ['758b50f3-4f3d-446e-b73c-bb447a30f408'] in n-d-841483-1 is: [{'id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1084701644', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104'}], 'enable_snat': True}, 'gw_port_id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:57Z', 'updated_at': '2022-05-12T15:37:03Z', 'revision_number': 3, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:8a:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2887, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:36:59Z', 'updated_at': '2022-05-12T15:37:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:37:10.363913 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a9bc64e-c16f-46ff-bf90-01353e8dc3d5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:10.364958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6a9bc64e-c16f-46ff-bf90-01353e8dc3d5 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9116e398-d8dd-45d8-b2c2-4aaf41e7e57f HTTP/1.1" status: 204 len: 168 time: 0.9749196 May 12 15:37:10.426238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'Subnet': ['ID=399a8fa1-6ad4-4b22-9cc2-119b29f1931e,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:10.444879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be4f0ca1-3ac3-4b47-a70a-27d94a97793f req-8d666474-4deb-4879-896e-f1f7edef9174 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:10.446706 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be4f0ca1-3ac3-4b47-a70a-27d94a97793f req-8d666474-4deb-4879-896e-f1f7edef9174 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 945 time: 0.4754267 May 12 15:37:10.497928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e9abf6d3-9758-480d-88fa-f08f81bc5d94 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:10.515559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] For port d45db345-6e10-417e-8b52-3260151d6ba4, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=d45db345-6e10-417e-8b52-3260151d6ba4,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:10.515943 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:10.606843 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be4f0ca1-3ac3-4b47-a70a-27d94a97793f req-dd21a921-7022-489b-876f-7b6a2c62f09e tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=0c27e6cf-6832-4dbf-9eee-0657f0f552fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1514335 May 12 15:37:10.635351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e9abf6d3-9758-480d-88fa-f08f81bc5d94 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:10.643461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Checking segment: {'id': '464fcc74-09ac-4457-9f5a-e40ea4ef2c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:37:10.649504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Network hostable DHCP agents. Network: 2edf0bcd-3aed-4d20-90f8-59e368722fde, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:37:10.673485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e9abf6d3-9758-480d-88fa-f08f81bc5d94 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:10.678261 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e9abf6d3-9758-480d-88fa-f08f81bc5d94 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:10.681480 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-e9abf6d3-9758-480d-88fa-f08f81bc5d94 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:37:10.682055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e9abf6d3-9758-480d-88fa-f08f81bc5d94 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:10.698097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Network 2edf0bcd-3aed-4d20-90f8-59e368722fde is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:37:10.709135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 2edf0bcd-3aed-4d20-90f8-59e368722fde) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:10.715166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:10.715956 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:10.724450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e9abf6d3-9758-480d-88fa-f08f81bc5d94 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.6628873 May 12 15:37:10.731367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59624) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:10.737336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9e6e90cd-c104-4c39-9429-3d927c0eee4f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'slaac'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:10.767643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7c702678-96f3-42a4-ab00-853d25873089 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 2.0765839 May 12 15:37:10.781712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59628) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:10.850568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42dfc1b0-fd1e-4e61-8981-8d94a5cf9a6f None None] Network 2edf0bcd-3aed-4d20-90f8-59e368722fde requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:10.936072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:10.936842 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:10.985337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59632) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:11.017000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-597cc02d-2d4b-4e71-b774-497752f217b1 None None] For port 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=580ed2cf-72bd-4f56-a8cc-51c6e1cd960e,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:11.017803 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-597cc02d-2d4b-4e71-b774-497752f217b1 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:11.098080 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63482d4c-e393-47e6-ba68-10fabaef03ed admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:11.154171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-63482d4c-e393-47e6-ba68-10fabaef03ed admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:11.154506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9e6e90cd-c104-4c39-9429-3d927c0eee4f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:11.161094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-63482d4c-e393-47e6-ba68-10fabaef03ed admin admin] Usage tracker for resource:security_group_rule and tenant:411cf90ec33f482bb71ffac8007d87d8 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:11.164643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-63482d4c-e393-47e6-ba68-10fabaef03ed admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:11.171983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-63482d4c-e393-47e6-ba68-10fabaef03ed admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:11.234915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9e6e90cd-c104-4c39-9429-3d927c0eee4f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:11.270094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-597cc02d-2d4b-4e71-b774-497752f217b1 None None] Calling delete_port for 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:11.312766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63482d4c-e393-47e6-ba68-10fabaef03ed admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:11.321486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:11.321486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:11.322134 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Floating IP 97ecb4c0-5dfe-4885-9fdc-e38dfbd87b5a disassociated. External IP: 172.25.8.156, port: d45db345-6e10-417e-8b52-3260151d6ba4. May 12 15:37:11.322633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Calling delete_port for d45db345-6e10-417e-8b52-3260151d6ba4 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:11.362789 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63482d4c-e393-47e6-ba68-10fabaef03ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:11.366126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9e6e90cd-c104-4c39-9429-3d927c0eee4f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:11.375732 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9e6e90cd-c104-4c39-9429-3d927c0eee4f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:11.376706 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-9e6e90cd-c104-4c39-9429-3d927c0eee4f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:37:11.378660 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9e6e90cd-c104-4c39-9429-3d927c0eee4f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:11.403802 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7508155b-e4e2-4625-949c-1f78123d1353 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 4.2566161 May 12 15:37:11.416220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59638) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:11.456851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-1509077264', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:11.502171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:11.515084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63482d4c-e393-47e6-ba68-10fabaef03ed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eafab7ae-a7ed-42b5-a730-fbbf739d5952,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:11.532173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:router and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:11.569268 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-63482d4c-e393-47e6-ba68-10fabaef03ed admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=411cf90ec33f482bb71ffac8007d87d8&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5802312 May 12 15:37:11.569268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:11.580122 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59642) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:11.610257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:11.682566 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:11.683675 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:11.709528 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f719b24d-d9be-430c-9c4a-38250ddaaa00 None None] Network 2d338475-91c7-4829-98f2-54874ae73504 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:11.724491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fc86a368-e153-4a81-95d3-8aae87de7b1d up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:11.831579 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:11.913003 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29008a17-0edd-47c4-bf22-92eb160722b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:12.021991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2edf0bcd-3aed-4d20-90f8-59e368722fde', 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'fixed_ips': [{'subnet_id': '399a8fa1-6ad4-4b22-9cc2-119b29f1931e'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:37:12.026044 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:12.073548 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-597cc02d-2d4b-4e71-b774-497752f217b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:12.152282 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-308453ff-cc08-4ed6-bbe8-867c3563db91 req-28914f26-8b25-4f35-9e31-8138da457a99 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 210 time: 0.1581318 May 12 15:37:12.159094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9e6e90cd-c104-4c39-9429-3d927c0eee4f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 1.4266522 May 12 15:37:12.171620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59654) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:12.193152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-2a0f43f2-3400-44e9-b7ff-0719fddc15e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:12.203197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-597cc02d-2d4b-4e71-b774-497752f217b1 None None] No DVR routers for this DVR port 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:37:12.216771 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-597cc02d-2d4b-4e71-b774-497752f217b1 None None] Pushing event deleted for resources: {'Port': ['ID=580ed2cf-72bd-4f56-a8cc-51c6e1cd960e,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:12.233239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port fc86a368-e153-4a81-95d3-8aae87de7b1d completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:12.262762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port fc86a368-e153-4a81-95d3-8aae87de7b1d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:12.263135 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:12.382346 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:12.536525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29008a17-0edd-47c4-bf22-92eb160722b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:12.580218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d45db345-6e10-417e-8b52-3260151d6ba4 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:37:12.611618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Pushing event deleted for resources: {'Port': ['ID=d45db345-6e10-417e-8b52-3260151d6ba4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:12.614334 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9e2bdbf8-a00b-45ee-b50b-cc3b522372a6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:12.618754 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Allocated IP 172.20.0.18 (2edf0bcd-3aed-4d20-90f8-59e368722fde/399a8fa1-6ad4-4b22-9cc2-119b29f1931e/a658cb29-0413-4ee4-8a11-a438c0d47c79) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:12.639677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-29008a17-0edd-47c4-bf22-92eb160722b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:12.640738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: d45db345-6e10-417e-8b52-3260151d6ba4 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:37:12.641661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device d45db345-6e10-417e-8b52-3260151d6ba4 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:37:12.647040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2a0f43f2-3400-44e9-b7ff-0719fddc15e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:12.658494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29008a17-0edd-47c4-bf22-92eb160722b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:12.659142 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29008a17-0edd-47c4-bf22-92eb160722b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:12.659887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2a0f43f2-3400-44e9-b7ff-0719fddc15e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:12.682662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a0f43f2-3400-44e9-b7ff-0719fddc15e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:12.689402 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2a0f43f2-3400-44e9-b7ff-0719fddc15e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:12.694732 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-2a0f43f2-3400-44e9-b7ff-0719fddc15e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:37:12.698019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2a0f43f2-3400-44e9-b7ff-0719fddc15e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:12.726086 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:12.761126 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-310cffc6-a145-4652-8712-0018adab5bad None None] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:13.009021 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:13.042006 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1d0a8c04-e56b-4271-8a6b-78aa28d1e4a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:13.054119 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:13.080301 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9e2bdbf8-a00b-45ee-b50b-cc3b522372a6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:13.133817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port fc86a368-e153-4a81-95d3-8aae87de7b1d, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fc86a368-e153-4a81-95d3-8aae87de7b1d,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:13.171803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29008a17-0edd-47c4-bf22-92eb160722b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Subnet': ['ID=81532e76-f50d-4005-bf2c-36e07b2cddc7,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:13.173328 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:13.324552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2a0f43f2-3400-44e9-b7ff-0719fddc15e6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 1.1515017 May 12 15:37:13.328557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59662) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:13.329562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:37:13.338367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-3d40fe58-98c7-4867-b1b9-bd51660a09f6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:13.348234 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-29008a17-0edd-47c4-bf22-92eb160722b5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 5.6227431 May 12 15:37:13.349226 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9e2bdbf8-a00b-45ee-b50b-cc3b522372a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:13.359779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59666) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:13.375202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6dcfe32c-e362-4175-9272-825e4ad8c2d8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1993250210', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '81532e76-f50d-4005-bf2c-36e07b2cddc7'}], 'security_groups': ['f14b7939-ede5-435b-8c85-938c53d39590']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:13.385662 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:37:13.386000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 580ed2cf-72bd-4f56-a8cc-51c6e1cd960e not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:37:13.439113 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:13.478805 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-006c13a5-e250-4318-8025-99f80a506cfb req-ed730563-3af2-4e0f-99bc-182964381584 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 210 time: 0.1139877 May 12 15:37:13.482089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e2bdbf8-a00b-45ee-b50b-cc3b522372a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eafab7ae-a7ed-42b5-a730-fbbf739d5952,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:13.511677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3d40fe58-98c7-4867-b1b9-bd51660a09f6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:13.520870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=fc86a368-e153-4a81-95d3-8aae87de7b1d,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:13.521970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3d40fe58-98c7-4867-b1b9-bd51660a09f6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:13.537937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d40fe58-98c7-4867-b1b9-bd51660a09f6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:13.543059 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3d40fe58-98c7-4867-b1b9-bd51660a09f6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:13.544978 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-3d40fe58-98c7-4867-b1b9-bd51660a09f6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:37:13.545547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3d40fe58-98c7-4867-b1b9-bd51660a09f6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:13.567032 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:13.569437 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3d40fe58-98c7-4867-b1b9-bd51660a09f6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.2388477 May 12 15:37:13.570734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59670) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:13.577421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e64f9fb8-1ce4-4dbc-a726-3811caaeeec8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'slaac'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:13.583802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Transition to ACTIVE for port object a658cb29-0413-4ee4-8a11-a438c0d47c79 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:13.613415 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9e2bdbf8-a00b-45ee-b50b-cc3b522372a6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:13.616906 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9e2bdbf8-a00b-45ee-b50b-cc3b522372a6 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/eafab7ae-a7ed-42b5-a730-fbbf739d5952 HTTP/1.1" status: 204 len: 168 time: 2.0212319 May 12 15:37:13.616906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Router 3b0baf01-29b6-49bc-81af-4ed638af06f3 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:37:13.658508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Transition to ACTIVE for port object a658cb29-0413-4ee4-8a11-a438c0d47c79 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:13.673603 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:13.791300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Allocated IP 172.20.0.17 (2edf0bcd-3aed-4d20-90f8-59e368722fde/399a8fa1-6ad4-4b22-9cc2-119b29f1931e/4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:13.816986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Network 2edf0bcd-3aed-4d20-90f8-59e368722fde is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:13.823114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:13.832993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:13.926262 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6dcfe32c-e362-4175-9272-825e4ad8c2d8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:13.957273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Pushing event updated for resources: {'Port': ['ID=a658cb29-0413-4ee4-8a11-a438c0d47c79,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:13.975519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e64f9fb8-1ce4-4dbc-a726-3811caaeeec8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:13.993580 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:13.997007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e64f9fb8-1ce4-4dbc-a726-3811caaeeec8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:14.017159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Transition to ACTIVE for port object 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:14.024804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e64f9fb8-1ce4-4dbc-a726-3811caaeeec8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:14.028888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2e3d559-c463-4a9b-95f3-a70fab521cbe None None] Update dhcp port {'port': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'fixed_ips': [{'subnet_id': '65927801-6b63-4764-8bc6-a8a23de8dd9d', 'ip_address': '172.20.0.2'}, {'subnet_id': '81532e76-f50d-4005-bf2c-36e07b2cddc7'}], 'binding:host_id': 'n-d-841483-1'}, 'id': 'ce4fa33a-3f1f-4337-b016-94fd30cba869'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:37:14.030027 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e64f9fb8-1ce4-4dbc-a726-3811caaeeec8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:14.031439 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-e64f9fb8-1ce4-4dbc-a726-3811caaeeec8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:37:14.031881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e64f9fb8-1ce4-4dbc-a726-3811caaeeec8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:14.068595 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e64f9fb8-1ce4-4dbc-a726-3811caaeeec8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.4960425 May 12 15:37:14.069239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59680) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:14.081948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-5a9ba010-f05a-4bb2-b864-c059ac847363 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:14.090725 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Attempting to bind port a658cb29-0413-4ee4-8a11-a438c0d47c79 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:37:14.091890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Attempting to bind port a658cb29-0413-4ee4-8a11-a438c0d47c79 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '464fcc74-09ac-4457-9f5a-e40ea4ef2c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:37:14.092461 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Attempting to bind port a658cb29-0413-4ee4-8a11-a438c0d47c79 on network 2edf0bcd-3aed-4d20-90f8-59e368722fde {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:37:14.097805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:37:14.101303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 36, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:37:14.101832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Checking segment: {'id': '464fcc74-09ac-4457-9f5a-e40ea4ef2c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:37:14.102522 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:14.102967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Bound using segment: {'id': '464fcc74-09ac-4457-9f5a-e40ea4ef2c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:37:14.103455 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Bound port: a658cb29-0413-4ee4-8a11-a438c0d47c79, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '464fcc74-09ac-4457-9f5a-e40ea4ef2c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:37:14.103876 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:14.119739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6fc83f76-aca4-4f9c-8a74-807ef3adc4dc None None] Sync routers for ids ['3b0baf01-29b6-49bc-81af-4ed638af06f3'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:37:14.208994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5a9ba010-f05a-4bb2-b864-c059ac847363 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:14.217801 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:14.223288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] For port a658cb29-0413-4ee4-8a11-a438c0d47c79, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:37:14.227329 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] For port a658cb29-0413-4ee4-8a11-a438c0d47c79, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a658cb29-0413-4ee4-8a11-a438c0d47c79,segment=NetworkSegment(464fcc74-09ac-4457-9f5a-e40ea4ef2c72),segment_id=464fcc74-09ac-4457-9f5a-e40ea4ef2c72)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:37:14.228766 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a2e3d559-c463-4a9b-95f3-a70fab521cbe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:14.244570 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:14.309707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6fc83f76-aca4-4f9c-8a74-807ef3adc4dc None None] Routers {'3b0baf01-29b6-49bc-81af-4ed638af06f3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:14.310635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6fc83f76-aca4-4f9c-8a74-807ef3adc4dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:36:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b0baf01-29b6-49bc-81af-4ed638af06f3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:14.350396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5a9ba010-f05a-4bb2-b864-c059ac847363 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:14.353433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'Port': ['ID=4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:14.397309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Network 2edf0bcd-3aed-4d20-90f8-59e368722fde is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:14.399385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:14.402482 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:14.460440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a9ba010-f05a-4bb2-b864-c059ac847363 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:14.469081 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a9ba010-f05a-4bb2-b864-c059ac847363 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:14.470694 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-5a9ba010-f05a-4bb2-b864-c059ac847363 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:37:14.471124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5a9ba010-f05a-4bb2-b864-c059ac847363 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:14.531695 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5a9ba010-f05a-4bb2-b864-c059ac847363 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.4584982 May 12 15:37:14.534603 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59700) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:14.616352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7f3ee914-da6c-4c4a-85f8-0c4bfdf41639 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0804739 May 12 15:37:14.617622 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:14.620485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59704) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:14.670856 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-845b18c9-e8a7-4838-95dc-f00005745f7b None None] Pushing event updated for resources: {'Port': ['ID=a658cb29-0413-4ee4-8a11-a438c0d47c79,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:14.842914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cde25875-2cc1-4986-a7c5-afc31dcdcfb8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:14.860518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cde25875-2cc1-4986-a7c5-afc31dcdcfb8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2337327 May 12 15:37:14.869232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59714) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:14.900061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-6fc83f76-aca4-4f9c-8a74-807ef3adc4dc None None] Set router 3b0baf01-29b6-49bc-81af-4ed638af06f3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:37:14.988550 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-17217727-8a56-4d58-b880-32e9e0bcfc85 req-147e687a-6177-4bc5-9f2b-8f42eed5397a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 210 time: 0.1262412 May 12 15:37:15.021656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-72f90659-c7b8-44f0-9d9d-2847efca0a08 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1483037 May 12 15:37:15.025963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59722) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:15.037541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a7520d0b-8ae1-4b34-93f5-449e79dc726d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:15.153125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] No DVR routers for this DVR port d45db345-6e10-417e-8b52-3260151d6ba4 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:37:15.259067 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:15.261020 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-54f03198-76c8-4ffe-875f-cccbea00b803 req-c5b239da-68a5-4471-8945-6b440041e6fd tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.76 "DELETE /v2.0/ports/d45db345-6e10-417e-8b52-3260151d6ba4 HTTP/1.1" status: 204 len: 173 time: 5.6960795 May 12 15:37:15.261596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'name': 'network-vif-deleted', 'tag': 'd45db345-6e10-417e-8b52-3260151d6ba4'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:37:15.377303 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:15.425550 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2b046ffc-e1f8-41f7-9561-0c11926f83b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:15.463545 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-693fe2b4-3fca-437b-ac0b-4f4076d4b41b'] response: {'server_uuid': 'f8b2ee1c-be04-4d70-a03a-454c65466200', 'name': 'network-vif-deleted', 'tag': 'd45db345-6e10-417e-8b52-3260151d6ba4', 'status': 'completed', 'code': 200} May 12 15:37:15.491235 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:15.496527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a7520d0b-8ae1-4b34-93f5-449e79dc726d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:15.509898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-6dcfe32c-e362-4175-9272-825e4ad8c2d8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Delete allocated IP 172.20.0.13 (66bc0e1c-8b39-4a42-b061-fe805d2bcf80/65927801-6b63-4764-8bc6-a8a23de8dd9d) {{(pid=88151) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} May 12 15:37:15.519898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a7520d0b-8ae1-4b34-93f5-449e79dc726d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:15.614717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a7520d0b-8ae1-4b34-93f5-449e79dc726d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:15.619309 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7520d0b-8ae1-4b34-93f5-449e79dc726d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:15.681567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-6dcfe32c-e362-4175-9272-825e4ad8c2d8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Allocated IP 172.20.0.26 (66bc0e1c-8b39-4a42-b061-fe805d2bcf80/81532e76-f50d-4005-bf2c-36e07b2cddc7/fdd44655-5be1-488d-9048-7e6ca6c6a61e) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:15.689650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6fc83f76-aca4-4f9c-8a74-807ef3adc4dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:25Z', 'revision_number': 4, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2cefb78b-eff7-47cb-8160-89f1ff42943b', 'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'mac_address': 'fa:16:3e:ee:fd:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 2489, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:20Z', 'updated_at': '2022-05-12T15:32:39Z', 'revision_number': 5, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'subnets': [{'id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:15.699104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fc86a368-e153-4a81-95d3-8aae87de7b1d up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:15.747476 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6fc83f76-aca4-4f9c-8a74-807ef3adc4dc None None] Checking router: 3b0baf01-29b6-49bc-81af-4ed638af06f3 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:37:15.775232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6fc83f76-aca4-4f9c-8a74-807ef3adc4dc None None] Routers {'3b0baf01-29b6-49bc-81af-4ed638af06f3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:15.776292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6fc83f76-aca4-4f9c-8a74-807ef3adc4dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b0baf01-29b6-49bc-81af-4ed638af06f3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:15.939060 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:37:16.017611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.25.8.37 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/a6dd1cdf-7d31-400b-bb49-edeac0c25572) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:16.152424 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:16.349046 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6dcfe32c-e362-4175-9272-825e4ad8c2d8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:16.363545 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d94924e4-8b50-447e-968b-9b6042c661c9 None None] Network 2edf0bcd-3aed-4d20-90f8-59e368722fde requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:16.384536 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:16.385409 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:16.447017 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:16.450899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-6dcfe32c-e362-4175-9272-825e4ad8c2d8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Transition to ACTIVE for port object fdd44655-5be1-488d-9048-7e6ca6c6a61e will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:16.469802 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6dcfe32c-e362-4175-9272-825e4ad8c2d8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:16.576288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port fc86a368-e153-4a81-95d3-8aae87de7b1d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:16.576840 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:16.585924 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f658fbe-f226-4709-8c19-420035ad407d req-f8ca329a-d2ce-40fd-a8ed-4d8ca93de711 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=f8b2ee1c-be04-4d70-a03a-454c65466200 HTTP/1.1" status: 200 len: 210 time: 0.1492577 May 12 15:37:16.691008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-6fc83f76-aca4-4f9c-8a74-807ef3adc4dc None None] Set router 3b0baf01-29b6-49bc-81af-4ed638af06f3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:37:16.705965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dcfe32c-e362-4175-9272-825e4ad8c2d8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=fdd44655-5be1-488d-9048-7e6ca6c6a61e,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:16.740393 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:16.847280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.objects.ports [None req-a7520d0b-8ae1-4b34-93f5-449e79dc726d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88152) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:37:16.849990 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1eb2b7d1-ced3-4101-a7c1-dfe1efb0761a None None] Provisioning for port a658cb29-0413-4ee4-8a11-a438c0d47c79 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:16.852178 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7520d0b-8ae1-4b34-93f5-449e79dc726d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:16.862042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=a6dd1cdf-7d31-400b-bb49-edeac0c25572,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:16.866238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6dcfe32c-e362-4175-9272-825e4ad8c2d8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] In _notify_port_updated(), no bound segment for port fdd44655-5be1-488d-9048-7e6ca6c6a61e on network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:37:16.873216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6dcfe32c-e362-4175-9272-825e4ad8c2d8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:16.873795 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6dcfe32c-e362-4175-9272-825e4ad8c2d8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:16.875184 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6dcfe32c-e362-4175-9272-825e4ad8c2d8 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "PUT /v2.0/ports/fdd44655-5be1-488d-9048-7e6ca6c6a61e HTTP/1.1" status: 200 len: 921 time: 3.5053725 May 12 15:37:16.885189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:16.886280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59750) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:16.887221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:16.890462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:16.912592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-a2e3d559-c463-4a9b-95f3-a70fab521cbe None None] Allocated IP 172.20.0.18 (66bc0e1c-8b39-4a42-b061-fe805d2bcf80/81532e76-f50d-4005-bf2c-36e07b2cddc7/ce4fa33a-3f1f-4337-b016-94fd30cba869) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:17.023559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7520d0b-8ae1-4b34-93f5-449e79dc726d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:17.029023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-a7520d0b-8ae1-4b34-93f5-449e79dc726d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:17.051456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7520d0b-8ae1-4b34-93f5-449e79dc726d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:17.058564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7520d0b-8ae1-4b34-93f5-449e79dc726d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:17.076771 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a2e3d559-c463-4a9b-95f3-a70fab521cbe None None] For port ce4fa33a-3f1f-4337-b016-94fd30cba869, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce4fa33a-3f1f-4337-b016-94fd30cba869,segment=NetworkSegment(351c4dc8-5404-4259-bed5-cd4008dea28b),segment_id=351c4dc8-5404-4259-bed5-cd4008dea28b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:17.110783 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a2e3d559-c463-4a9b-95f3-a70fab521cbe None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:17.127734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a2e3d559-c463-4a9b-95f3-a70fab521cbe None None] Transition to ACTIVE for port object ce4fa33a-3f1f-4337-b016-94fd30cba869 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:17.137919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0c781ec-1e62-4701-9fa5-ea3eff8fdc54 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:17.213243 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a2e3d559-c463-4a9b-95f3-a70fab521cbe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:17.308979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-805f49e7-48f7-4d64-ba93-6487c3e3190c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port fdd44655-5be1-488d-9048-7e6ca6c6a61e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:17.313042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-805f49e7-48f7-4d64-ba93-6487c3e3190c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:17.321662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7520d0b-8ae1-4b34-93f5-449e79dc726d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=7f084728-75c4-4d4e-86a4-ec984fbee216,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:17.368863 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a7520d0b-8ae1-4b34-93f5-449e79dc726d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 2.3414509 May 12 15:37:17.372528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59756) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:17.386421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'mac_address': 'fa:16:3e:9b:c9:4f', 'name': 'tempest-NetworksTestDHCPv6-901232461'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:17.444016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3d559-c463-4a9b-95f3-a70fab521cbe None None] Pushing event updated for resources: {'Port': ['ID=ce4fa33a-3f1f-4337-b016-94fd30cba869,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:17.567686 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:17.576110 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:17.821525 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:17.850366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59768) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:17.869048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:17.935331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:port and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:17.952778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:17.967429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'Port': ['ID=4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:17.971513 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:17.983012 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:18.004434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:18.067555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a658cb29-0413-4ee4-8a11-a438c0d47c79 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:18.141248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:18.340598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '7f084728-75c4-4d4e-86a4-ec984fbee216'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:37:18.341620 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:18.385250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Network 2edf0bcd-3aed-4d20-90f8-59e368722fde is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:18.391278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:18.418827 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0919c0af-f5af-4f19-b5fc-ec55eb29b270 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:18.457324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6fc83f76-aca4-4f9c-8a74-807ef3adc4dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:25Z', 'revision_number': 4, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2cefb78b-eff7-47cb-8160-89f1ff42943b', 'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'mac_address': 'fa:16:3e:ee:fd:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 2489, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:20Z', 'updated_at': '2022-05-12T15:32:39Z', 'revision_number': 5, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'subnets': [{'id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:18.459568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port a658cb29-0413-4ee4-8a11-a438c0d47c79 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:18.491346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a658cb29-0413-4ee4-8a11-a438c0d47c79 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:18.491716 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:18.521258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6fc83f76-aca4-4f9c-8a74-807ef3adc4dc None None] The sync data for ids ['3b0baf01-29b6-49bc-81af-4ed638af06f3'] in n-d-841483-1 is: [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:32:25Z', 'revision_number': 4, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2cefb78b-eff7-47cb-8160-89f1ff42943b', 'name': '', 'network_id': 'bca349be-4618-43ae-a547-b8bd2b254da4', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'mac_address': 'fa:16:3e:ee:fd:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 2489, 'fixed_ips': [{'subnet_id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:20Z', 'updated_at': '2022-05-12T15:32:39Z', 'revision_number': 5, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'subnets': [{'id': 'aa771580-393c-41f8-ad67-611be21e45d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:37:18.641377 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-805f49e7-48f7-4d64-ba93-6487c3e3190c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:18.651597 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0919c0af-f5af-4f19-b5fc-ec55eb29b270 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:18.818389 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:18.927298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port e2dd3577-6812-47f1-8625-3a1e6d24b433 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:37:19.067421 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:19.110285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-49fbdcbf-22c5-444f-aeaf-25e958640a90 None None] Provisioning complete for port a658cb29-0413-4ee4-8a11-a438c0d47c79 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:19.111104 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-49fbdcbf-22c5-444f-aeaf-25e958640a90 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:19.145969 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d525c313-ba8a-4cdd-b2c4-2da4e7122a90 None None] New status for floating IP 97ecb4c0-5dfe-4885-9fdc-e38dfbd87b5a: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:37:19.174921 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-805f49e7-48f7-4d64-ba93-6487c3e3190c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for fdd44655-5be1-488d-9048-7e6ca6c6a61e owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:19.186457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Router 758b50f3-4f3d-446e-b73c-bb447a30f408 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:37:19.209880 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Allocated IP 2001:db8::f816:3eff:fe54:6262 (2447b094-d5d6-41ef-a146-2bf56f5399af/7f084728-75c4-4d4e-86a4-ec984fbee216/076977ec-e9a1-45f6-8e86-a357bf72af0f) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:19.390824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port a658cb29-0413-4ee4-8a11-a438c0d47c79, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a658cb29-0413-4ee4-8a11-a438c0d47c79,segment=NetworkSegment(464fcc74-09ac-4457-9f5a-e40ea4ef2c72),segment_id=464fcc74-09ac-4457-9f5a-e40ea4ef2c72)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:19.613606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:37:19.631772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-197ec056-c288-4d9a-985f-b3d2e64f7c70 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "PUT /v2.0/routers/758b50f3-4f3d-446e-b73c-bb447a30f408/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.8160591 May 12 15:37:19.636641 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0919c0af-f5af-4f19-b5fc-ec55eb29b270 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:19.655846 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:19.668013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Transition to ACTIVE for port object 076977ec-e9a1-45f6-8e86-a357bf72af0f will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:19.685456 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:19.787264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Sync routers for ids ['758b50f3-4f3d-446e-b73c-bb447a30f408'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:37:19.815998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Transition to ACTIVE for port object 076977ec-e9a1-45f6-8e86-a357bf72af0f will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:19.830260 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:19.838387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0919c0af-f5af-4f19-b5fc-ec55eb29b270 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c27e6cf-6832-4dbf-9eee-0657f0f552fb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:19.839803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ce4fa33a-3f1f-4337-b016-94fd30cba869 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:19.870233 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Routers {'758b50f3-4f3d-446e-b73c-bb447a30f408'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:19.870638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['758b50f3-4f3d-446e-b73c-bb447a30f408'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:19.914459 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0919c0af-f5af-4f19-b5fc-ec55eb29b270 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:19.918828 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0919c0af-f5af-4f19-b5fc-ec55eb29b270 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "DELETE /v2.0/security-groups/0c27e6cf-6832-4dbf-9eee-0657f0f552fb HTTP/1.1" status: 204 len: 168 time: 1.9968145 May 12 15:37:19.920028 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:19.927444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59810) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:20.052073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::f816:3eff:fe9b:c94f (2447b094-d5d6-41ef-a146-2bf56f5399af/7f084728-75c4-4d4e-86a4-ec984fbee216/e2dd3577-6812-47f1-8625-3a1e6d24b433) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:20.101130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=a658cb29-0413-4ee4-8a11-a438c0d47c79,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:20.166357 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:20.180262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:20.243051 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-805f49e7-48f7-4d64-ba93-6487c3e3190c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:20.248638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:20.320195 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-b1687711-ce39-45fc-bac5-c7548a761628 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] show failed (client error): The resource could not be found. May 12 15:37:20.324934 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b1687711-ce39-45fc-bac5-c7548a761628 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups/0c27e6cf-6832-4dbf-9eee-0657f0f552fb HTTP/1.1" status: 404 len: 347 time: 0.2571564 May 12 15:37:20.333762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59826) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:20.343975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Pushing event updated for resources: {'Port': ['ID=076977ec-e9a1-45f6-8e86-a357bf72af0f,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:20.392071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-49fbdcbf-22c5-444f-aeaf-25e958640a90 None None] Provisioning for port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:20.425760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-805f49e7-48f7-4d64-ba93-6487c3e3190c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=fdd44655-5be1-488d-9048-7e6ca6c6a61e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:20.431369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Set router 758b50f3-4f3d-446e-b73c-bb447a30f408 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:37:20.513242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-49fbdcbf-22c5-444f-aeaf-25e958640a90 None None] Provisioning complete for port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:20.513562 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-49fbdcbf-22c5-444f-aeaf-25e958640a90 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:20.590071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Attempting to bind port 076977ec-e9a1-45f6-8e86-a357bf72af0f on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:37:20.590455 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Attempting to bind port 076977ec-e9a1-45f6-8e86-a357bf72af0f by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:37:20.590790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Attempting to bind port 076977ec-e9a1-45f6-8e86-a357bf72af0f on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:37:20.617098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 37, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:37:20.625161 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:37:20.625689 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:20.626097 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:37:20.626604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Bound port: 076977ec-e9a1-45f6-8e86-a357bf72af0f, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:37:20.626982 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:20.760967 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:20.851103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object e2dd3577-6812-47f1-8625-3a1e6d24b433 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:20.909302 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-49fbdcbf-22c5-444f-aeaf-25e958640a90 None None] Port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:37:20.923928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-16dae506-eaa5-4038-937f-cbf15bcab635 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:20.924807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-16dae506-eaa5-4038-937f-cbf15bcab635 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Synchronizing usage tracker for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:20.942159 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:21.022377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-16dae506-eaa5-4038-937f-cbf15bcab635 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Unset dirty status for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:21.030312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-16dae506-eaa5-4038-937f-cbf15bcab635 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/networks?id=2edf0bcd-3aed-4d20-90f8-59e368722fde HTTP/1.1" status: 200 len: 798 time: 0.3466673 May 12 15:37:21.073780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-11098789-5dee-47f7-8845-36a569bcecca tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/quotas/3dd1fe8ad774471ba7745219a37ead53 HTTP/1.1" status: 200 len: 375 time: 0.0418568 May 12 15:37:21.130069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] For port 076977ec-e9a1-45f6-8e86-a357bf72af0f, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:37:21.135166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:21.136081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-805f49e7-48f7-4d64-ba93-6487c3e3190c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:21.141196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:21.152948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:21.158840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:21.161336 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:21.178470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=e2dd3577-6812-47f1-8625-3a1e6d24b433,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:21.187094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ab9f6a1-6c54-4e32-bc5d-3d1c4b73909d None None] Provisioning complete for port d3738296-e321-4a38-bb44-3803dd75076e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:21.187462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ab9f6a1-6c54-4e32-bc5d-3d1c4b73909d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:21.301335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3747a88f-7946-456e-8b64-51643fcdaf49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 3.9276471 May 12 15:37:21.311251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59834) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:21.325197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-23e30301-8d75-4ffb-94f7-f015781a5ee9 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Deleting port bbf6f7dd-7d19-45e7-9839-358677ec5c40 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:21.326232 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23e30301-8d75-4ffb-94f7-f015781a5ee9 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:21.377920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] For port 076977ec-e9a1-45f6-8e86-a357bf72af0f, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=076977ec-e9a1-45f6-8e86-a357bf72af0f,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:37:21.444072 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:21.468666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-d14bb753-82de-495d-8832-a02ad68267dd tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Synchronizing usage tracker for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:21.487794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-d14bb753-82de-495d-8832-a02ad68267dd tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Unset dirty status for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:21.489470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-d14bb753-82de-495d-8832-a02ad68267dd tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=3dd1fe8ad774471ba7745219a37ead53&fields=id HTTP/1.1" status: 200 len: 486 time: 0.4148047 May 12 15:37:21.519405 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-805f49e7-48f7-4d64-ba93-6487c3e3190c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/fdd44655-5be1-488d-9048-7e6ca6c6a61e HTTP/1.1" status: 204 len: 168 time: 4.5862856 May 12 15:37:21.528050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59838) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:21.598929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d766e22-0265-4fdc-80ac-88c27c0aa064 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:21.602575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9ab9f6a1-6c54-4e32-bc5d-3d1c4b73909d None None] Port d3738296-e321-4a38-bb44-3803dd75076e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:37:21.605331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d766e22-0265-4fdc-80ac-88c27c0aa064 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:21.606131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5d766e22-0265-4fdc-80ac-88c27c0aa064 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:21.633866 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-bb115a3a-7574-4fb0-a2b9-644212dfccef tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] GET failed (client error): The resource could not be found. May 12 15:37:21.634916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bb115a3a-7574-4fb0-a2b9-644212dfccef tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:21.642908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5d766e22-0265-4fdc-80ac-88c27c0aa064 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:21.651938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59842) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:21.653455 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5d766e22-0265-4fdc-80ac-88c27c0aa064 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1702 time: 0.3405859 May 12 15:37:21.663471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ab9f6a1-6c54-4e32-bc5d-3d1c4b73909d None None] Could not find standard attr ID for object fdd44655-5be1-488d-9048-7e6ca6c6a61e. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:37:21.732716 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-07d04bfd-8164-4262-9250-67407d2c948e service neutron] 10.222.0.82 "GET /v2.0/networks/2edf0bcd-3aed-4d20-90f8-59e368722fde?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2271798 May 12 15:37:21.801012 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d7a78da-0ad9-4a86-b556-48e3bdfa08a2 None None] Pushing event updated for resources: {'Port': ['ID=076977ec-e9a1-45f6-8e86-a357bf72af0f,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:21.862084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ab9f6a1-6c54-4e32-bc5d-3d1c4b73909d None None] Provisioning for port ce4fa33a-3f1f-4337-b016-94fd30cba869 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:21.873121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23e30301-8d75-4ffb-94f7-f015781a5ee9 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:21.873466 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23e30301-8d75-4ffb-94f7-f015781a5ee9 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:21.884693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bb115a3a-7574-4fb0-a2b9-644212dfccef tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:21.885274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a658cb29-0413-4ee4-8a11-a438c0d47c79 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:21.889010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59850) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:21.889683 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bb115a3a-7574-4fb0-a2b9-644212dfccef tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/fdd44655-5be1-488d-9048-7e6ca6c6a61e HTTP/1.1" status: 404 len: 333 time: 0.3484046 May 12 15:37:21.966543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ab9f6a1-6c54-4e32-bc5d-3d1c4b73909d None None] Provisioning complete for port ce4fa33a-3f1f-4337-b016-94fd30cba869 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:21.966921 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ab9f6a1-6c54-4e32-bc5d-3d1c4b73909d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:22.006169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4ac14473-274b-4b44-9fdd-26f1bdfeee8c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port e2dd3577-6812-47f1-8625-3a1e6d24b433 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:22.013558 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ac14473-274b-4b44-9fdd-26f1bdfeee8c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:22.027755 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1084701644', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104'}], 'enable_snat': True}, 'gw_port_id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:57Z', 'updated_at': '2022-05-12T15:37:15Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:8a:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2887, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:36:59Z', 'updated_at': '2022-05-12T15:37:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97', 'name': '', 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'mac_address': 'fa:16:3e:7c:e9:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'device_owner': 'network:router_interface', 'standard_attr_id': 2920, 'fixed_ips': [{'subnet_id': '399a8fa1-6ad4-4b22-9cc2-119b29f1931e', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:37:13Z', 'updated_at': '2022-05-12T15:37:17Z', 'revision_number': 2, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'subnets': [{'id': '399a8fa1-6ad4-4b22-9cc2-119b29f1931e', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:22.044304 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Checking router: 758b50f3-4f3d-446e-b73c-bb447a30f408 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:37:22.044873 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Updating router 758b50f3-4f3d-446e-b73c-bb447a30f408 port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:37:22.100039 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-752dfdbc-eaf5-4f24-a54f-55780e92776c service neutron] 10.222.0.82 "GET /v2.0/networks/2edf0bcd-3aed-4d20-90f8-59e368722fde?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3662646 May 12 15:37:22.105130 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-83ac1a00-f04f-4ba1-ba7d-2fc606ee1bbe tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:22.140146 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-83ac1a00-f04f-4ba1-ba7d-2fc606ee1bbe tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:22.241351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-83ac1a00-f04f-4ba1-ba7d-2fc606ee1bbe tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:22.252697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a658cb29-0413-4ee4-8a11-a438c0d47c79 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:22.254073 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:22.264920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83ac1a00-f04f-4ba1-ba7d-2fc606ee1bbe tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd550f81-fc57-4213-bbe2-70426aad92d9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:22.285074 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-83ac1a00-f04f-4ba1-ba7d-2fc606ee1bbe tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:22.292255 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-83ac1a00-f04f-4ba1-ba7d-2fc606ee1bbe tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/security-groups/fd550f81-fc57-4213-bbe2-70426aad92d9 HTTP/1.1" status: 204 len: 168 time: 0.4018884 May 12 15:37:22.292889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59858) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:22.312251 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:22.640321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-23e30301-8d75-4ffb-94f7-f015781a5ee9 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Calling delete_port for bbf6f7dd-7d19-45e7-9839-358677ec5c40 owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:22.686314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:37:22.807514 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f00c70fb-023d-4616-9825-60e9d558e8da req-00317da0-062d-4a0b-b173-07a38ba95912 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 210 time: 0.3596125 May 12 15:37:22.815149 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-221fd46b-407b-48a9-82bb-65b1278a5427 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:22.866087 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-221fd46b-407b-48a9-82bb-65b1278a5427 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:22.958981 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-221fd46b-407b-48a9-82bb-65b1278a5427 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:22.988503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-221fd46b-407b-48a9-82bb-65b1278a5427 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f14b7939-ede5-435b-8c85-938c53d39590,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:23.004215 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-221fd46b-407b-48a9-82bb-65b1278a5427 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:23.007686 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-221fd46b-407b-48a9-82bb-65b1278a5427 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/security-groups/f14b7939-ede5-435b-8c85-938c53d39590 HTTP/1.1" status: 204 len: 168 time: 0.7112339 May 12 15:37:23.008243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59874) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:23.139522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-e4e4863b-f412-42f2-b837-3496ff942daf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting subnet 65927801-6b63-4764-8bc6-a8a23de8dd9d {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:37:23.143009 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4e4863b-f412-42f2-b837-3496ff942daf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:23.269259 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4e4863b-f412-42f2-b837-3496ff942daf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:23.452858 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:23.482809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Transition to ACTIVE for port object 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:23.488878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ab9f6a1-6c54-4e32-bc5d-3d1c4b73909d None None] Provisioning complete for port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:23.489593 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ab9f6a1-6c54-4e32-bc5d-3d1c4b73909d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:23.499036 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4e4863b-f412-42f2-b837-3496ff942daf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:23.615868 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ac14473-274b-4b44-9fdd-26f1bdfeee8c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:23.620869 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4e4863b-f412-42f2-b837-3496ff942daf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:23.621808 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:23.713340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e4863b-f412-42f2-b837-3496ff942daf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Subnet': ['ID=65927801-6b63-4764-8bc6-a8a23de8dd9d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:23.715286 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4e4863b-f412-42f2-b837-3496ff942daf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:23.738324 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e4e4863b-f412-42f2-b837-3496ff942daf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/65927801-6b63-4764-8bc6-a8a23de8dd9d HTTP/1.1" status: 204 len: 168 time: 0.7256310 May 12 15:37:23.739148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59880) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:23.745028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f9b47f4c-1086-4c3e-8d11-ab8db68f74cc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:23.796794 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e4685da-eaab-4cfc-9c7c-772b0ec9a03a None None] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:24.113163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f9b47f4c-1086-4c3e-8d11-ab8db68f74cc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:24.120857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f9b47f4c-1086-4c3e-8d11-ab8db68f74cc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:24.142480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f9b47f4c-1086-4c3e-8d11-ab8db68f74cc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:24.147402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4ac14473-274b-4b44-9fdd-26f1bdfeee8c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for e2dd3577-6812-47f1-8625-3a1e6d24b433 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:24.161648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f9b47f4c-1086-4c3e-8d11-ab8db68f74cc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:24.195496 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 076977ec-e9a1-45f6-8e86-a357bf72af0f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:24.267552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9ab9f6a1-6c54-4e32-bc5d-3d1c4b73909d None None] Port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:37:24.302044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd2674b5-07ac-40d7-af8f-1a7b549e5ce2 req-e76ea9d9-f1f1-4e95-9a43-5236fc2307d3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 210 time: 0.1449311 May 12 15:37:24.310993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f9b47f4c-1086-4c3e-8d11-ab8db68f74cc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:24.367361 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9b47f4c-1086-4c3e-8d11-ab8db68f74cc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:24.391778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d187c1ee-e348-4c23-8809-2f9bd41197be None None] Pushing event updated for resources: {'Port': ['ID=4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:24.555702 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Attempting to bind port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:37:24.556400 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Attempting to bind port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '464fcc74-09ac-4457-9f5a-e40ea4ef2c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:37:24.556400 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Attempting to bind port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 on network 2edf0bcd-3aed-4d20-90f8-59e368722fde {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:37:24.561371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-db09cd95-7f9e-4ed7-8948-631aa7307746 None None] Provisioning for port 076977ec-e9a1-45f6-8e86-a357bf72af0f completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:24.653997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 37, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:37:24.654333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Checking segment: {'id': '464fcc74-09ac-4457-9f5a-e40ea4ef2c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:37:24.654733 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:24.655267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Bound using segment: {'id': '464fcc74-09ac-4457-9f5a-e40ea4ef2c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:37:24.655766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Bound port: 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '464fcc74-09ac-4457-9f5a-e40ea4ef2c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:37:24.656141 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:24.712115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 076977ec-e9a1-45f6-8e86-a357bf72af0f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:24.834623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 076977ec-e9a1-45f6-8e86-a357bf72af0f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:24.835537 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:24.836814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-8103b867-6a47-4ce1-b4ef-24b2a1b1f518 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:24.838480 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-8103b867-6a47-4ce1-b4ef-24b2a1b1f518 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.76 "GET /v2.0/networks?id=2edf0bcd-3aed-4d20-90f8-59e368722fde HTTP/1.1" status: 200 len: 798 time: 0.2177315 May 12 15:37:24.854397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Request body: {'port': {'device_id': 'db0e9b9b-6db8-4cb6-9388-31519382fa96', 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde', 'admin_state_up': True, 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:24.953517 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-db09cd95-7f9e-4ed7-8948-631aa7307746 None None] Provisioning for port e2dd3577-6812-47f1-8625-3a1e6d24b433 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:25.002263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-db09cd95-7f9e-4ed7-8948-631aa7307746 None None] Provisioning complete for port e2dd3577-6812-47f1-8625-3a1e6d24b433 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:25.002651 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-db09cd95-7f9e-4ed7-8948-631aa7307746 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.012218 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5d870ac9-0526-42d8-9e21-ea23cd45e4ca req-1c5db4c3-0aab-443b-8f8f-8526a0f0b940 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 2.5377626 May 12 15:37:25.012821 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ac14473-274b-4b44-9fdd-26f1bdfeee8c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.052552 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9b47f4c-1086-4c3e-8d11-ab8db68f74cc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.060470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-db09cd95-7f9e-4ed7-8948-631aa7307746 None None] Port e2dd3577-6812-47f1-8625-3a1e6d24b433 was deleted so its status cannot be updated. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:330}} May 12 15:37:25.073638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:37:25.086326 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55f61b18-bdcc-42cb-a9b6-7939035896a9 None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:37:25.099132 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55f61b18-bdcc-42cb-a9b6-7939035896a9 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:25.108088 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-55f61b18-bdcc-42cb-a9b6-7939035896a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:25.159406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9b47f4c-1086-4c3e-8d11-ab8db68f74cc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:25.163347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-f9b47f4c-1086-4c3e-8d11-ab8db68f74cc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:25.169355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9b47f4c-1086-4c3e-8d11-ab8db68f74cc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:25.170191 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9b47f4c-1086-4c3e-8d11-ab8db68f74cc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.198685 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f9b47f4c-1086-4c3e-8d11-ab8db68f74cc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.4555678 May 12 15:37:25.198685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9b47f4c-1086-4c3e-8d11-ab8db68f74cc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Subnet': ['ID=8fd9aa3d-9718-4c57-adf4-e4121068264b,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:25.199040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59894) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:25.201854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] For port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:37:25.204386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'security_group': {'name': 'tempest-secgroup-1809571593'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:25.212359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:25.214861 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-55f61b18-bdcc-42cb-a9b6-7939035896a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:25.216697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:security_group and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:25.221093 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:25.227531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] For port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97,segment=NetworkSegment(464fcc74-09ac-4457-9f5a-e40ea4ef2c72),segment_id=464fcc74-09ac-4457-9f5a-e40ea4ef2c72)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:37:25.228152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:25.237278 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55f61b18-bdcc-42cb-a9b6-7939035896a9 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:25.237994 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-55f61b18-bdcc-42cb-a9b6-7939035896a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:25.239088 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.244622 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.252963 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.269749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:25.275366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:security_group_rule and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:25.279944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:25.289621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:25.296600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ac14473-274b-4b44-9fdd-26f1bdfeee8c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=e2dd3577-6812-47f1-8625-3a1e6d24b433,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:25.356643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:25.364539 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-55f61b18-bdcc-42cb-a9b6-7939035896a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:25.364929 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55f61b18-bdcc-42cb-a9b6-7939035896a9 None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:37:25.396376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attempting to reserve 1 items for resource port. Total usage: 6; quota limit: 500; headroom:494 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:25.470424 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.477460 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.494829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 076977ec-e9a1-45f6-8e86-a357bf72af0f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=076977ec-e9a1-45f6-8e86-a357bf72af0f,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:25.531814 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.550692 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Routers {'758b50f3-4f3d-446e-b73c-bb447a30f408'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:25.555649 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['758b50f3-4f3d-446e-b73c-bb447a30f408'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:25.558439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Made reservation on behalf of 3dd1fe8ad774471ba7745219a37ead53 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:25.562592 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.624380 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ac14473-274b-4b44-9fdd-26f1bdfeee8c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.629804 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ac14473-274b-4b44-9fdd-26f1bdfeee8c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/e2dd3577-6812-47f1-8625-3a1e6d24b433 HTTP/1.1" status: 204 len: 168 time: 3.9669466 May 12 15:37:25.695354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59900) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:25.735126 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23e30301-8d75-4ffb-94f7-f015781a5ee9 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.739125 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.740368 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-39bb2808-a329-40d8-94cf-712c063a64cb tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 14.3079305 May 12 15:37:25.753586 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8067448c-583c-4b43-bb9c-87238267862f req-bd631919-96a0-41aa-8ef7-32d290ff8ba7 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 210 time: 0.1716545 May 12 15:37:25.754175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 59904) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:25.767244 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:25.772641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 0.5729222 May 12 15:37:25.841380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59910) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:26.014216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'security_group': {'name': 'tempest-secgroup-2067167564'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:26.067950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] Set router 758b50f3-4f3d-446e-b73c-bb447a30f408 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:37:26.119364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23e30301-8d75-4ffb-94f7-f015781a5ee9 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Pushing event deleted for resources: {'Port': ['ID=bbf6f7dd-7d19-45e7-9839-358677ec5c40,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:26.131250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:26.179767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:security_group and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:26.206273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:26.251521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d187c1ee-e348-4c23-8809-2f9bd41197be None None] Pushing event updated for resources: {'Port': ['ID=4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:26.324419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:26.330252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e553a65f-70b8-42d5-b20f-5a63b6e647a8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:26.339474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e553a65f-70b8-42d5-b20f-5a63b6e647a8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:26.340555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e553a65f-70b8-42d5-b20f-5a63b6e647a8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:26.353126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9d13650-25e0-4463-93c4-71e305f60642 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6c5c9417-99ec-4bbb-bd2f-65d68f7be2f9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:26.386462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d870ac9-0526-42d8-9e21-ea23cd45e4ca req-7535210e-1322-4034-9cf7-e30c9516f8ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:26.388108 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5d870ac9-0526-42d8-9e21-ea23cd45e4ca req-7535210e-1322-4034-9cf7-e30c9516f8ab service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3dd1fe8ad774471ba7745219a37ead53&device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 1135 time: 1.2593288 May 12 15:37:26.444430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=076977ec-e9a1-45f6-8e86-a357bf72af0f,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:26.514145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-993efabc-fd04-49dd-8ac3-097a61cdfcc2 None None] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:26.548501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59930) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:26.562849 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23e30301-8d75-4ffb-94f7-f015781a5ee9 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:26.637410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:26.658602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e553a65f-70b8-42d5-b20f-5a63b6e647a8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:26.662653 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e553a65f-70b8-42d5-b20f-5a63b6e647a8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1457 time: 0.9636180 May 12 15:37:26.677793 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59936) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:26.721518 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23e30301-8d75-4ffb-94f7-f015781a5ee9 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:26.722795 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-23e30301-8d75-4ffb-94f7-f015781a5ee9 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "DELETE /v2.0/floatingips/97ecb4c0-5dfe-4885-9fdc-e38dfbd87b5a HTTP/1.1" status: 204 len: 168 time: 6.3855205 May 12 15:37:26.860402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d870ac9-0526-42d8-9e21-ea23cd45e4ca req-98dd8447-76dd-4416-beba-100148523b7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:26.864097 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5d870ac9-0526-42d8-9e21-ea23cd45e4ca req-98dd8447-76dd-4416-beba-100148523b7c service neutron] 10.222.0.84 "GET /v2.0/networks?id=d2e823c6-8acb-45b9-910c-0a4822a68f25 HTTP/1.1" status: 200 len: 897 time: 0.3409033 May 12 15:37:27.061224 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5d870ac9-0526-42d8-9e21-ea23cd45e4ca req-9c261ca1-f847-41a9-8826-57966de4fb16 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4f36023c-143c-4389-b26c-f62679404834 HTTP/1.1" status: 200 len: 1001 time: 0.1812491 May 12 15:37:27.064982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:27.078527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Allocated IP 172.20.0.21 (2edf0bcd-3aed-4d20-90f8-59e368722fde/399a8fa1-6ad4-4b22-9cc2-119b29f1931e/e8a30607-8978-4b85-b35b-a3fe9bdb626c) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:27.082419 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2a94b3-1797-45bf-b8e4-7d87f8bf49e6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:27.324736 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-167e6056-5d06-420e-b796-f9efad72c20c req-ab7cb602-e9f0-435b-97eb-14f9776becdf tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 210 time: 0.1020532 May 12 15:37:27.347365 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6b2c8f55-a3c0-4762-85e5-e7f0cafc39e3 None None] Provisioning complete for port ce4fa33a-3f1f-4337-b016-94fd30cba869 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:27.350295 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6b2c8f55-a3c0-4762-85e5-e7f0cafc39e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:27.507538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:security_group_rule and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:27.650943 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:27.742886 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:27.750974 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1084701644', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104'}], 'enable_snat': True}, 'gw_port_id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:57Z', 'updated_at': '2022-05-12T15:37:15Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:8a:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2887, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:36:59Z', 'updated_at': '2022-05-12T15:37:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97', 'name': '', 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'mac_address': 'fa:16:3e:7c:e9:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'device_owner': 'network:router_interface', 'standard_attr_id': 2920, 'fixed_ips': [{'subnet_id': '399a8fa1-6ad4-4b22-9cc2-119b29f1931e', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:37:13Z', 'updated_at': '2022-05-12T15:37:25Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'subnets': [{'id': '399a8fa1-6ad4-4b22-9cc2-119b29f1931e', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:27.761682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Transition to ACTIVE for port object e8a30607-8978-4b85-b35b-a3fe9bdb626c will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:27.766456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddbcff81-62d2-4f2a-a298-1b4bb451773d None None] The sync data for ids ['758b50f3-4f3d-446e-b73c-bb447a30f408'] in n-d-841483-1 is: [{'id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1084701644', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104'}], 'enable_snat': True}, 'gw_port_id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:57Z', 'updated_at': '2022-05-12T15:37:15Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:8a:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2887, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:36:59Z', 'updated_at': '2022-05-12T15:37:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97', 'name': '', 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'mac_address': 'fa:16:3e:7c:e9:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'device_owner': 'network:router_interface', 'standard_attr_id': 2920, 'fixed_ips': [{'subnet_id': '399a8fa1-6ad4-4b22-9cc2-119b29f1931e', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:37:13Z', 'updated_at': '2022-05-12T15:37:25Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'subnets': [{'id': '399a8fa1-6ad4-4b22-9cc2-119b29f1931e', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:37:27.774329 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6b2c8f55-a3c0-4762-85e5-e7f0cafc39e3 None None] Provisioning complete for port d3738296-e321-4a38-bb44-3803dd75076e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:27.774706 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6b2c8f55-a3c0-4762-85e5-e7f0cafc39e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:27.795746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:27.814942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cc2a94b3-1797-45bf-b8e4-7d87f8bf49e6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:27.836026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cc2a94b3-1797-45bf-b8e4-7d87f8bf49e6 admin admin] Usage tracker for resource:security_group_rule and tenant:1b9f9849b1cb4dff86fc138aacbaf4c6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:27.840102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cc2a94b3-1797-45bf-b8e4-7d87f8bf49e6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:27.846474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cc2a94b3-1797-45bf-b8e4-7d87f8bf49e6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:27.931131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6b2c8f55-a3c0-4762-85e5-e7f0cafc39e3 None None] Port d3738296-e321-4a38-bb44-3803dd75076e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:37:27.943431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:27.948068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 076977ec-e9a1-45f6-8e86-a357bf72af0f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:27.966170 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:28.044322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-77c214ec-e925-4a89-82d8-7dd9c6c3fb22 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 7f084728-75c4-4d4e-86a4-ec984fbee216 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:37:28.159326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event updated for resources: {'Port': ['ID=e8a30607-8978-4b85-b35b-a3fe9bdb626c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:28.169371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d870ac9-0526-42d8-9e21-ea23cd45e4ca req-3c2fd287-1f89-4eab-87c9-8cea63bffa17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:28.170886 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5d870ac9-0526-42d8-9e21-ea23cd45e4ca req-3c2fd287-1f89-4eab-87c9-8cea63bffa17 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=27cd1f2e-8b9d-4298-a44b-ce82945125a8 HTTP/1.1" status: 200 len: 835 time: 1.0946324 May 12 15:37:28.192876 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-77c214ec-e925-4a89-82d8-7dd9c6c3fb22 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:28.366007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42944baa-dda4-4090-a156-4bff1132567e None None] Update dhcp port {'port': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'fixed_ips': [{'subnet_id': '81532e76-f50d-4005-bf2c-36e07b2cddc7', 'ip_address': '172.20.0.18'}, {'subnet_id': '8fd9aa3d-9718-4c57-adf4-e4121068264b'}], 'binding:host_id': 'n-d-841483-1'}, 'id': 'ce4fa33a-3f1f-4337-b016-94fd30cba869'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:37:28.377910 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Network 2edf0bcd-3aed-4d20-90f8-59e368722fde is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:28.396530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:28.431386 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2a94b3-1797-45bf-b8e4-7d87f8bf49e6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:28.432421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:28.544209 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2a94b3-1797-45bf-b8e4-7d87f8bf49e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:28.591115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-42944baa-dda4-4090-a156-4bff1132567e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:28.623196 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-77c214ec-e925-4a89-82d8-7dd9c6c3fb22 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:28.705263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 076977ec-e9a1-45f6-8e86-a357bf72af0f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:28.705263 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:28.730315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.20.0.1 (2d338475-91c7-4829-98f2-54874ae73504/6a6a3afc-f008-4a33-8e40-276ea11e299b/7cc33eb2-e3e7-459a-b512-3bca1b17f226) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:28.758569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88b888f8-2f48-4598-866a-77d7e8675e77 req-dcf4d573-5bde-45b3-9e8b-865afebad731 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:28.760169 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88b888f8-2f48-4598-866a-77d7e8675e77 req-dcf4d573-5bde-45b3-9e8b-865afebad731 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 895 time: 0.2211094 May 12 15:37:28.955473 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cc2a94b3-1797-45bf-b8e4-7d87f8bf49e6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1b9f9849b1cb4dff86fc138aacbaf4c6&name=default HTTP/1.1" status: 200 len: 2983 time: 2.3960409 May 12 15:37:28.963077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc2a94b3-1797-45bf-b8e4-7d87f8bf49e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3974da64-cf6d-4490-8fe4-e879c24cbec7,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:28.967963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59976) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:29.001729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:29.002287 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:29.019663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-32bca974-21dc-451f-97b4-d3f3bfd77ae7 None None] Provisioning for port e8a30607-8978-4b85-b35b-a3fe9bdb626c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:29.059161 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-c3da13af-538b-439e-8954-14b3eba47e7b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 897 time: 4.2091436 May 12 15:37:29.063538 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:29.093668 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:29.100524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Request body: {'port': {'device_id': 'db0e9b9b-6db8-4cb6-9388-31519382fa96', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:29.128124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d870ac9-0526-42d8-9e21-ea23cd45e4ca req-ea41b5ca-3191-4276-8f47-756ad1850ea3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:29.129659 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5d870ac9-0526-42d8-9e21-ea23cd45e4ca req-ea41b5ca-3191-4276-8f47-756ad1850ea3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d2e823c6-8acb-45b9-910c-0a4822a68f25&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.8706820 May 12 15:37:29.138018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-32bca974-21dc-451f-97b4-d3f3bfd77ae7 None None] Provisioning complete for port e8a30607-8978-4b85-b35b-a3fe9bdb626c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:29.138531 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-32bca974-21dc-451f-97b4-d3f3bfd77ae7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:29.151053 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:29.205537 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:29.276916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=7cc33eb2-e3e7-459a-b512-3bca1b17f226,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:29.295603 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network 2d338475-91c7-4829-98f2-54874ae73504 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:29.297486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:29.300234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:29.402853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-32bca974-21dc-451f-97b4-d3f3bfd77ae7 None None] Port e8a30607-8978-4b85-b35b-a3fe9bdb626c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:37:29.407832 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:29.469033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-42944baa-dda4-4090-a156-4bff1132567e None None] Allocated IP 172.20.0.2 (66bc0e1c-8b39-4a42-b061-fe805d2bcf80/8fd9aa3d-9718-4c57-adf4-e4121068264b/ce4fa33a-3f1f-4337-b016-94fd30cba869) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:29.604175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-77c214ec-e925-4a89-82d8-7dd9c6c3fb22 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:29.682097 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:29.777726 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:29.781289 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 3.9142516 May 12 15:37:29.802215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 59994) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:29.817966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'security_group': {'name': 'tempest-secgroup-309336816'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:29.831435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4076a285-9f0f-4611-a6cc-06c213df8d6c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6ffd1e2e-498c-4f2a-be64-e45143cb9c93,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:29.849966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:29.871890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:security_group and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:29.874407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-42944baa-dda4-4090-a156-4bff1132567e None None] For port ce4fa33a-3f1f-4337-b016-94fd30cba869, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce4fa33a-3f1f-4337-b016-94fd30cba869,segment=NetworkSegment(351c4dc8-5404-4259-bed5-cd4008dea28b),segment_id=351c4dc8-5404-4259-bed5-cd4008dea28b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:29.886805 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:29.903827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:29.904872 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for security_group was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:29.916359 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f72c273f-3385-4b3d-8ebf-5af1833e8e4b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:29.971345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource security_group. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:30.005140 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-42944baa-dda4-4090-a156-4bff1132567e None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:30.047002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-42944baa-dda4-4090-a156-4bff1132567e None None] Transition to ACTIVE for port object ce4fa33a-3f1f-4337-b016-94fd30cba869 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:30.059623 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-42944baa-dda4-4090-a156-4bff1132567e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:30.090809 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5d870ac9-0526-42d8-9e21-ea23cd45e4ca req-9a4dd368-331c-4ce1-85b8-c45b549ccd62 service neutron] 10.222.0.84 "GET /v2.0/networks/d2e823c6-8acb-45b9-910c-0a4822a68f25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9302249 May 12 15:37:30.092291 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-77c214ec-e925-4a89-82d8-7dd9c6c3fb22 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:30.105573 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f72c273f-3385-4b3d-8ebf-5af1833e8e4b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:30.248852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42944baa-dda4-4090-a156-4bff1132567e None None] Pushing event updated for resources: {'Port': ['ID=ce4fa33a-3f1f-4337-b016-94fd30cba869,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:30.362553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:30.370068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:30.370431 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:30.420410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77c214ec-e925-4a89-82d8-7dd9c6c3fb22 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=7f084728-75c4-4d4e-86a4-ec984fbee216,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:30.422423 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:30.505198 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-77c214ec-e925-4a89-82d8-7dd9c6c3fb22 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:30.549359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e22c9d89-94c1-4407-91c8-996274f2ec17 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:31.055686 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:31.119960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97,segment=NetworkSegment(464fcc74-09ac-4457-9f5a-e40ea4ef2c72),segment_id=464fcc74-09ac-4457-9f5a-e40ea4ef2c72)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:31.130216 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:31.207703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e8a30607-8978-4b85-b35b-a3fe9bdb626c {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:37:31.220185 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:31.237495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Transition to ACTIVE for port object e8a30607-8978-4b85-b35b-a3fe9bdb626c will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:31.254603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08fce03b-fc4f-472b-a199-b3516e0a7071 None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:37:31.296684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-08fce03b-fc4f-472b-a199-b3516e0a7071 None None] Deleting port 076977ec-e9a1-45f6-8e86-a357bf72af0f {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:31.297151 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-08fce03b-fc4f-472b-a199-b3516e0a7071 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:31.308819 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:31.329575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:31.498274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:31.582567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d25aab4-9239-4e5b-9971-ef56f062aadc req-c5545ad1-c37d-449f-8fd5-e12ea7bc4ec3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:31.595947 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d25aab4-9239-4e5b-9971-ef56f062aadc req-c5545ad1-c37d-449f-8fd5-e12ea7bc4ec3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 895 time: 0.7383788 May 12 15:37:31.632358 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1668946e-15b4-46bb-aa84-95003d4a89bd None None] Provisioning for port ce4fa33a-3f1f-4337-b016-94fd30cba869 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:31.643003 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:31.649211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=7cc33eb2-e3e7-459a-b512-3bca1b17f226,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:31.654358 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:31.665971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f72c273f-3385-4b3d-8ebf-5af1833e8e4b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:31.675621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:31.836811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1668946e-15b4-46bb-aa84-95003d4a89bd None None] Provisioning complete for port ce4fa33a-3f1f-4337-b016-94fd30cba869 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:31.843572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:security_group_rule and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:31.848754 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1668946e-15b4-46bb-aa84-95003d4a89bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:31.902056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:31.905206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f72c273f-3385-4b3d-8ebf-5af1833e8e4b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3974da64-cf6d-4490-8fe4-e879c24cbec7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:31.923529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f72c273f-3385-4b3d-8ebf-5af1833e8e4b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:31.924807 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f72c273f-3385-4b3d-8ebf-5af1833e8e4b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3974da64-cf6d-4490-8fe4-e879c24cbec7 HTTP/1.1" status: 204 len: 168 time: 2.9332767 May 12 15:37:31.926576 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-77c214ec-e925-4a89-82d8-7dd9c6c3fb22 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/7f084728-75c4-4d4e-86a4-ec984fbee216 HTTP/1.1" status: 204 len: 168 time: 5.2476265 May 12 15:37:31.928340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:31.935595 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5d870ac9-0526-42d8-9e21-ea23cd45e4ca req-eb29a654-d9fd-4d02-af24-616c41f9fa79 service neutron] 10.222.0.84 "GET /v2.0/networks/d2e823c6-8acb-45b9-910c-0a4822a68f25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.7286816 May 12 15:37:31.937895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60034) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:31.994554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:32.065996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network 2d338475-91c7-4829-98f2-54874ae73504 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:32.068809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Pushing event updated for resources: {'Port': ['ID=e8a30607-8978-4b85-b35b-a3fe9bdb626c,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:32.077536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:32.102390 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-000d4c5d-a25a-4d2b-9e00-a105bbb1ff9c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1530826 May 12 15:37:32.108110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60038) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:32.218982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-08fce03b-fc4f-472b-a199-b3516e0a7071 None None] For port 076977ec-e9a1-45f6-8e86-a357bf72af0f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=076977ec-e9a1-45f6-8e86-a357bf72af0f,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:32.219387 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-08fce03b-fc4f-472b-a199-b3516e0a7071 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:32.236043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:32.378822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:37:32.651982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60054) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:32.678415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Attempting to bind port e8a30607-8978-4b85-b35b-a3fe9bdb626c on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:37:32.679007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Attempting to bind port e8a30607-8978-4b85-b35b-a3fe9bdb626c by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '464fcc74-09ac-4457-9f5a-e40ea4ef2c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:37:32.681158 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Attempting to bind port e8a30607-8978-4b85-b35b-a3fe9bdb626c on network 2edf0bcd-3aed-4d20-90f8-59e368722fde {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:37:32.685904 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:32.690262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:32.697319 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:32.745035 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-151ae081-2213-4deb-bcf3-0486b8dfbe3a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:32.753600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Port e8a30607-8978-4b85-b35b-a3fe9bdb626c on network 2edf0bcd-3aed-4d20-90f8-59e368722fde not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:37:32.755242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Attempting to bind port e8a30607-8978-4b85-b35b-a3fe9bdb626c on network 2edf0bcd-3aed-4d20-90f8-59e368722fde {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:37:32.790478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:32.792414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-151ae081-2213-4deb-bcf3-0486b8dfbe3a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:32.795634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d35fce6d-2b23-4e78-bcbb-f24fdf02c89b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:32.807109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-08fce03b-fc4f-472b-a199-b3516e0a7071 None None] Calling delete_port for 076977ec-e9a1-45f6-8e86-a357bf72af0f owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:32.810527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 37, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:37:32.811038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Checking segment: {'id': '464fcc74-09ac-4457-9f5a-e40ea4ef2c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:37:32.811577 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Bound using segment: {'id': '464fcc74-09ac-4457-9f5a-e40ea4ef2c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:37:32.812176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Bound port: e8a30607-8978-4b85-b35b-a3fe9bdb626c, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '464fcc74-09ac-4457-9f5a-e40ea4ef2c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 571, 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:37:32.813036 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:32.841039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:32.905145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:32.943169 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:32.948762 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-33bc6723-ad84-4255-b4ad-c155dc4fa58b tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1744 time: 3.1417854 May 12 15:37:32.950272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-151ae081-2213-4deb-bcf3-0486b8dfbe3a admin admin] Usage tracker for resource:security_group_rule and tenant:c992697e9c3c494a90df54fbd87495fe is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:32.952178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60062) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:32.957549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-151ae081-2213-4deb-bcf3-0486b8dfbe3a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:32.963575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1348654603', 'security_groups': ['d35fce6d-2b23-4e78-bcbb-f24fdf02c89b'], 'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '8fd9aa3d-9718-4c57-adf4-e4121068264b'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:32.966551 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:32.995997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-151ae081-2213-4deb-bcf3-0486b8dfbe3a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:33.073410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:37:33.119252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a505e60-663c-4330-a5fd-5756dc403bd8 None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:37:33.131271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d84cabf1-81af-4280-b11a-be61ff9e3bb5 req-b973befb-7f47-465e-88d4-3badf0589b33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:33.132833 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d84cabf1-81af-4280-b11a-be61ff9e3bb5 req-b973befb-7f47-465e-88d4-3badf0589b33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 907 time: 0.2277546 May 12 15:37:33.134015 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-08fce03b-fc4f-472b-a199-b3516e0a7071 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:33.154717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] For port e8a30607-8978-4b85-b35b-a3fe9bdb626c, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:37:33.159260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] For port e8a30607-8978-4b85-b35b-a3fe9bdb626c, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8a30607-8978-4b85-b35b-a3fe9bdb626c,segment=NetworkSegment(464fcc74-09ac-4457-9f5a-e40ea4ef2c72),segment_id=464fcc74-09ac-4457-9f5a-e40ea4ef2c72)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:37:33.161104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:33.167019 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:33.191695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:33.193159 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:33.194273 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-954a53f9-6327-4a7d-930e-cfe0247e3fc1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "PUT /v2.0/routers/c622fac9-6201-493c-99ca-1de3b27ccf7c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.4326477 May 12 15:37:33.196313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60066) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:33.197214 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:33.206649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'port': {'network_id': '2d338475-91c7-4829-98f2-54874ae73504', 'name': 'tempest-FloatingIPTestJSON-1881189529'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:33.312812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08fce03b-fc4f-472b-a199-b3516e0a7071 None None] Pushing event deleted for resources: {'Port': ['ID=076977ec-e9a1-45f6-8e86-a357bf72af0f,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:33.316252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a505e60-663c-4330-a5fd-5756dc403bd8 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:33.316977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3a505e60-663c-4330-a5fd-5756dc403bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:33.377320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Pushing event updated for resources: {'Port': ['ID=e8a30607-8978-4b85-b35b-a3fe9bdb626c,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:33.384190 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-151ae081-2213-4deb-bcf3-0486b8dfbe3a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:33.394370 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-151ae081-2213-4deb-bcf3-0486b8dfbe3a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:33.422116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08fce03b-fc4f-472b-a199-b3516e0a7071 None None] No DVR routers for this DVR port 076977ec-e9a1-45f6-8e86-a357bf72af0f on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:37:33.446638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:33.447319 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:33.448956 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-f34cbaba-2d1e-4345-96b3-75eb6d7bbb9f service neutron] 10.222.0.76 "PUT /v2.0/ports/e8a30607-8978-4b85-b35b-a3fe9bdb626c HTTP/1.1" status: 200 len: 1055 time: 4.3612847 May 12 15:37:33.452858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'db0e9b9b-6db8-4cb6-9388-31519382fa96', 'tag': 'e8a30607-8978-4b85-b35b-a3fe9bdb626c'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:37:33.453046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3a505e60-663c-4330-a5fd-5756dc403bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:33.509183 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-151ae081-2213-4deb-bcf3-0486b8dfbe3a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c992697e9c3c494a90df54fbd87495fe&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8543127 May 12 15:37:33.514083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60076) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:33.526045 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a505e60-663c-4330-a5fd-5756dc403bd8 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:33.526709 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3a505e60-663c-4330-a5fd-5756dc403bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:33.580094 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1eea7bc7-91ea-47d4-83c0-02d4e23c95f7'] response: {'name': 'network-changed', 'server_uuid': 'db0e9b9b-6db8-4cb6-9388-31519382fa96', 'tag': 'e8a30607-8978-4b85-b35b-a3fe9bdb626c', 'status': 'completed', 'code': 200} May 12 15:37:33.618596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:33.641004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-3a505e60-663c-4330-a5fd-5756dc403bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:33.641606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a505e60-663c-4330-a5fd-5756dc403bd8 None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:37:33.656670 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1668946e-15b4-46bb-aa84-95003d4a89bd None None] Provisioning complete for port d3738296-e321-4a38-bb44-3803dd75076e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:33.657264 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1668946e-15b4-46bb-aa84-95003d4a89bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:33.670586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:33.725748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:33.738500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-151ae081-2213-4deb-bcf3-0486b8dfbe3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a1c24587-2068-4f5a-abce-2f35cfc27fab,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:33.758803 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:33.810670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:port and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:33.816239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:33.830760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1668946e-15b4-46bb-aa84-95003d4a89bd None None] Port d3738296-e321-4a38-bb44-3803dd75076e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:37:33.844088 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ce4fa33a-3f1f-4337-b016-94fd30cba869 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:33.858135 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7373bd54-1456-4fe4-aad7-0029817e0998 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:33.861347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:33.950439 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ce4fa33a-3f1f-4337-b016-94fd30cba869 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:33.950809 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:33.966996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Made reservation on behalf of 9d4bdd73a39f4390bb7d4c6d7a1fc0c4 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:33.970741 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:33.983804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-2ac97a25-3383-4ea2-a913-f52bcec3cd58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:33.985633 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-2ac97a25-3383-4ea2-a913-f52bcec3cd58 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=3dd1fe8ad774471ba7745219a37ead53&device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 1058 time: 0.4871104 May 12 15:37:33.999529 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7373bd54-1456-4fe4-aad7-0029817e0998 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:34.094416 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-60f53438-2613-44b8-acfa-ac24e37d4332 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.21&port_id=e8a30607-8978-4b85-b35b-a3fe9bdb626c HTTP/1.1" status: 200 len: 217 time: 0.0968418 May 12 15:37:34.129297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] device_id is not set on port 3fcda3cf-cc90-44c3-8595-0c2d95cbda90 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:37:34.202490 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7373bd54-1456-4fe4-aad7-0029817e0998 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:34.203238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 076977ec-e9a1-45f6-8e86-a357bf72af0f no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:37:34.249311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-9c3f31c9-6884-43af-8a04-a9d42a91d9f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:34.250903 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-9c3f31c9-6884-43af-8a04-a9d42a91d9f8 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=399a8fa1-6ad4-4b22-9cc2-119b29f1931e HTTP/1.1" status: 200 len: 838 time: 0.1510637 May 12 15:37:34.284685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7373bd54-1456-4fe4-aad7-0029817e0998 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1c24587-2068-4f5a-abce-2f35cfc27fab,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:34.305026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 076977ec-e9a1-45f6-8e86-a357bf72af0f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:37:34.305700 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 076977ec-e9a1-45f6-8e86-a357bf72af0f not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:37:34.419097 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:34.437480 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7373bd54-1456-4fe4-aad7-0029817e0998 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:34.443429 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7373bd54-1456-4fe4-aad7-0029817e0998 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a1c24587-2068-4f5a-abce-2f35cfc27fab HTTP/1.1" status: 204 len: 168 time: 0.9264252 May 12 15:37:34.513710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] device_id is not set on port a07a267d-3854-4d6e-9148-b6d338fb19ea yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:37:34.802785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.20.0.14 (2d338475-91c7-4829-98f2-54874ae73504/6a6a3afc-f008-4a33-8e40-276ea11e299b/3fcda3cf-cc90-44c3-8595-0c2d95cbda90) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:34.827840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9332bd11-3c71-4580-8727-4a0cfa79403c req-6b06bf3c-b932-477a-b82c-3ba96897a614 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:34.829371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9332bd11-3c71-4580-8727-4a0cfa79403c req-6b06bf3c-b932-477a-b82c-3ba96897a614 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 907 time: 0.4488933 May 12 15:37:35.066341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.objects.ports [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88151) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:37:35.072350 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:35.167049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-80930f54-fc8d-41e9-8e73-a09fa3eaab65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:35.169528 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-80930f54-fc8d-41e9-8e73-a09fa3eaab65 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=2edf0bcd-3aed-4d20-90f8-59e368722fde&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.9084101 May 12 15:37:35.204508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:35.228873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:35.235752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Allocated IP 172.20.0.3 (66bc0e1c-8b39-4a42-b061-fe805d2bcf80/8fd9aa3d-9718-4c57-adf4-e4121068264b/a07a267d-3854-4d6e-9148-b6d338fb19ea) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:35.239798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-195d8445-d355-4f5c-8504-a8dca5d8402e None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:35.243565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:35.244300 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:35.401750 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:35.434160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=f38e3e28-a08b-457d-95c4-1898903f5bd0,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:35.494678 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:35.576582 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5568b6fd-42f9-4eae-b4b6-e9505d1b0512 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 3.3751018 May 12 15:37:35.580229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60128) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:35.612895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=3fcda3cf-cc90-44c3-8595-0c2d95cbda90,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:35.631692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network 2d338475-91c7-4829-98f2-54874ae73504 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:35.633591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:35.635941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:35.644656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'mac_address': 'fa:16:3e:e1:a4:f8', 'name': 'tempest-NetworksTestDHCPv6-1176526739'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:35.653006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': 'f38e3e28-a08b-457d-95c4-1898903f5bd0'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:37:35.654428 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:35.794928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:35.804314 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:35.876752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b3605a37-e076-4789-ae99-0a194778540b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 2.6791642 May 12 15:37:35.879251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60144) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:35.895730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'port': {'network_id': '2d338475-91c7-4829-98f2-54874ae73504', 'name': 'tempest-FloatingIPTestJSON-195378006'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:35.930656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Allocated IP 2001:db8::f816:3eff:fe28:93da (2447b094-d5d6-41ef-a146-2bf56f5399af/f38e3e28-a08b-457d-95c4-1898903f5bd0/74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:36.082527 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-0fb55718-76a6-4cda-8cad-633c972d086b service neutron] 10.222.0.76 "GET /v2.0/networks/2edf0bcd-3aed-4d20-90f8-59e368722fde?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8806820 May 12 15:37:36.184478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:36.188850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:port and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:36.192171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:36.238856 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:36.250596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Transition to ACTIVE for port object 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:36.294107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Transition to ACTIVE for port object 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:36.305471 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:36.326505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:36.387948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:36.403444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Made reservation on behalf of 9d4bdd73a39f4390bb7d4c6d7a1fc0c4 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:36.411284 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:36.428084 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:36.455756 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:36.461102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Pushing event updated for resources: {'Port': ['ID=74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:36.471554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:36.472962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:36.475613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:36.486887 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0a5c2da5-1503-4916-9d3c-3a6aca65b6a1 req-07ecb61e-9929-4885-945e-37a77f000812 service neutron] 10.222.0.76 "GET /v2.0/networks/2edf0bcd-3aed-4d20-90f8-59e368722fde?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3969560 May 12 15:37:36.489241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Transition to ACTIVE for port object a07a267d-3854-4d6e-9148-b6d338fb19ea will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:36.512415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:36.540350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] device_id is not set on port 8ac3db5f-3324-4a02-a6e5-504a9ea69fc2 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:37:36.613776 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Attempting to bind port 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:37:36.614135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Attempting to bind port 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:37:36.614560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Attempting to bind port 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:37:36.621052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 37, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:37:36.621569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:37:36.621903 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:36.622261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:37:36.622720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Bound port: 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:37:36.623082 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:36.774265 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] For port 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:37:36.779589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] For port 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:37:36.780380 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:36.783573 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:36.794971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:36.849368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d981b6f3-d8ed-4d4c-bfd4-821812fea0d5 req-4c34239d-64a0-492a-981d-58bc40e6a555 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:36.863622 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d981b6f3-d8ed-4d4c-bfd4-821812fea0d5 req-4c34239d-64a0-492a-981d-58bc40e6a555 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 907 time: 0.6064687 May 12 15:37:36.880736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12a8d3a8-7bac-4b4a-80c0-49614e409593 req-afcc102f-100f-4213-b3fc-80963e207d5c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:36.887569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:36.889058 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12a8d3a8-7bac-4b4a-80c0-49614e409593 req-afcc102f-100f-4213-b3fc-80963e207d5c tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 0.6932080 May 12 15:37:36.905919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port f8b0c968-d5d0-413d-9ade-028ef202d570 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:37:36.933478 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad693b6-4da5-49c8-95bc-f75298290258 None None] Pushing event updated for resources: {'Port': ['ID=74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:36.973436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.20.0.6 (2d338475-91c7-4829-98f2-54874ae73504/6a6a3afc-f008-4a33-8e40-276ea11e299b/8ac3db5f-3324-4a02-a6e5-504a9ea69fc2) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:37.034786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12a8d3a8-7bac-4b4a-80c0-49614e409593 req-8158eb41-f536-4522-a28f-d326f9a446aa tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1399267 May 12 15:37:37.099293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:37.116052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:37.248863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:37.262089 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:37.351086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c110226-652d-4210-8559-db6496cca200 req-bdd225e3-5e53-4f3b-a9bc-11644f1afa32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:37.352620 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c110226-652d-4210-8559-db6496cca200 req-bdd225e3-5e53-4f3b-a9bc-11644f1afa32 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=3dd1fe8ad774471ba7745219a37ead53&device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 1058 time: 0.7565234 May 12 15:37:37.404207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::f816:3eff:fee1:a4f8 (2447b094-d5d6-41ef-a146-2bf56f5399af/f38e3e28-a08b-457d-95c4-1898903f5bd0/f8b0c968-d5d0-413d-9ade-028ef202d570) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:37.519768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=a07a267d-3854-4d6e-9148-b6d338fb19ea,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:37.538875 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:37.542323 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b478a3fc-2ee3-499b-84fe-beaf0789c5af tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 4.5863800 May 12 15:37:37.552075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60186) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:37.578397 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-914e773d-8bb4-4361-833e-dc0c6a1fe4bf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:37.625554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-08aff24f-d0bc-4ca9-8ac7-e1aa35378fec None None] Provisioning for port a07a267d-3854-4d6e-9148-b6d338fb19ea completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:37.645711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-08aff24f-d0bc-4ca9-8ac7-e1aa35378fec None None] Provisioning complete for port a07a267d-3854-4d6e-9148-b6d338fb19ea triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:37.649422 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-08aff24f-d0bc-4ca9-8ac7-e1aa35378fec None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:37.779613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-08aff24f-d0bc-4ca9-8ac7-e1aa35378fec None None] Port a07a267d-3854-4d6e-9148-b6d338fb19ea cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:37:37.873452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c110226-652d-4210-8559-db6496cca200 req-3fea7cf7-2d32-4c2e-9dc2-35522d2e72dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:37.875705 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c110226-652d-4210-8559-db6496cca200 req-3fea7cf7-2d32-4c2e-9dc2-35522d2e72dc service neutron] 10.222.0.76 "GET /v2.0/networks?id=2edf0bcd-3aed-4d20-90f8-59e368722fde HTTP/1.1" status: 200 len: 899 time: 0.4984848 May 12 15:37:37.914366 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:37.922702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-914e773d-8bb4-4361-833e-dc0c6a1fe4bf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:37.938602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-914e773d-8bb4-4361-833e-dc0c6a1fe4bf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:37.942385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-914e773d-8bb4-4361-833e-dc0c6a1fe4bf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:37.949922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-914e773d-8bb4-4361-833e-dc0c6a1fe4bf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:38.027843 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-914e773d-8bb4-4361-833e-dc0c6a1fe4bf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:38.031355 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-914e773d-8bb4-4361-833e-dc0c6a1fe4bf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:38.315150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network 2d338475-91c7-4829-98f2-54874ae73504 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:38.323743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:38.328803 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:38.434245 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c110226-652d-4210-8559-db6496cca200 req-8ea9cc57-1575-4571-a4b9-7e7f7b5eab3d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.21&port_id=e8a30607-8978-4b85-b35b-a3fe9bdb626c HTTP/1.1" status: 200 len: 217 time: 0.5510597 May 12 15:37:38.510590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:38.577772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c110226-652d-4210-8559-db6496cca200 req-5645d308-12ac-4d9d-87cd-006394166b14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:38.581106 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c110226-652d-4210-8559-db6496cca200 req-5645d308-12ac-4d9d-87cd-006394166b14 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=399a8fa1-6ad4-4b22-9cc2-119b29f1931e HTTP/1.1" status: 200 len: 838 time: 0.1295722 May 12 15:37:38.713019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e8a30607-8978-4b85-b35b-a3fe9bdb626c details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:37:38.738763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:38.856466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=8ac3db5f-3324-4a02-a6e5-504a9ea69fc2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:38.878444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:38.888097 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:38.906154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f0608b6-8cbb-407d-9650-5d5ed8935fc8 req-4671637d-d8f2-4021-9eac-c15d0133edf4 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:38.906938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-1f0608b6-8cbb-407d-9650-5d5ed8935fc8 req-4671637d-d8f2-4021-9eac-c15d0133edf4 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Synchronizing usage tracker for tenant:ed8d9bf58283443480f0c62e72d53449 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:38.912273 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:38.940550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c110226-652d-4210-8559-db6496cca200 req-84476186-4c23-462c-974f-0ef6f8abc729 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:38.941933 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c110226-652d-4210-8559-db6496cca200 req-84476186-4c23-462c-974f-0ef6f8abc729 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=2edf0bcd-3aed-4d20-90f8-59e368722fde&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.3431125 May 12 15:37:38.952090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e8a30607-8978-4b85-b35b-a3fe9bdb626c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8a30607-8978-4b85-b35b-a3fe9bdb626c,segment=NetworkSegment(464fcc74-09ac-4457-9f5a-e40ea4ef2c72),segment_id=464fcc74-09ac-4457-9f5a-e40ea4ef2c72)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:38.972457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object f8b0c968-d5d0-413d-9ade-028ef202d570 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:38.976381 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e8e2c46c-b638-4b6b-8f8d-18a79b39dc56 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 3.0959902 May 12 15:37:38.982234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60210) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:38.982784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-1f0608b6-8cbb-407d-9650-5d5ed8935fc8 req-4671637d-d8f2-4021-9eac-c15d0133edf4 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Unset dirty status for tenant:ed8d9bf58283443480f0c62e72d53449 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:38.983909 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1f0608b6-8cbb-407d-9650-5d5ed8935fc8 req-4671637d-d8f2-4021-9eac-c15d0133edf4 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.76 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 1.1073101 May 12 15:37:38.996139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'e8a30607-8978-4b85-b35b-a3fe9bdb626c', 'network_id': '2edf0bcd-3aed-4d20-90f8-59e368722fde', 'port_id': 'e8a30607-8978-4b85-b35b-a3fe9bdb626c', 'mac_address': 'fa:16:3e:05:1d:b3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 571, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '399a8fa1-6ad4-4b22-9cc2-119b29f1931e', 'ip_address': '172.20.0.21'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:37:39.011911 n-d-841483-1 neutron-server[88152]: INFO neutron.db.ipam_backend_mixin [None req-914e773d-8bb4-4361-833e-dc0c6a1fe4bf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 8fd9aa3d-9718-4c57-adf4-e4121068264b (CIDR: 172.20.0.0/28) May 12 15:37:39.027610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85bbc45d-f8f3-407c-947b-3e2ac0c10419 req-bbb83354-ede5-4257-b00c-5fe43f27cbe0 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:39.030150 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85bbc45d-f8f3-407c-947b-3e2ac0c10419 req-bbb83354-ede5-4257-b00c-5fe43f27cbe0 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 907 time: 0.8252106 May 12 15:37:39.034924 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-914e773d-8bb4-4361-833e-dc0c6a1fe4bf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:37:39.035417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-914e773d-8bb4-4361-833e-dc0c6a1fe4bf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:39.042803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '8ac3db5f-3324-4a02-a6e5-504a9ea69fc2', 'fixed_ip_address': '172.20.0.6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:39.061027 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:39.062144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fef9608-146a-4be9-ab34-27b39dd82c38 req-3f9febe4-1975-43da-9b38-36bfe2d37d01 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:39.070819 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8fef9608-146a-4be9-ab34-27b39dd82c38 req-3f9febe4-1975-43da-9b38-36bfe2d37d01 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 946 time: 0.5905528 May 12 15:37:39.073619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a759ba07-f65b-4552-86e9-00469264009e None None] Provisioning for port 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:39.081369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a759ba07-f65b-4552-86e9-00469264009e None None] Provisioning complete for port 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:39.081799 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a759ba07-f65b-4552-86e9-00469264009e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:39.105066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:39.125876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-914e773d-8bb4-4361-833e-dc0c6a1fe4bf tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.5651114 May 12 15:37:39.126754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60220) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:39.134845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:floatingip and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:39.137516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:39.140675 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e8a30607-8978-4b85-b35b-a3fe9bdb626c {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:37:39.146189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-89684eaf-b1b0-4805-9124-4b3eb7a58b31 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:39.157672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:39.187375 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e8a30607-8978-4b85-b35b-a3fe9bdb626c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8a30607-8978-4b85-b35b-a3fe9bdb626c,segment=NetworkSegment(464fcc74-09ac-4457-9f5a-e40ea4ef2c72),segment_id=464fcc74-09ac-4457-9f5a-e40ea4ef2c72)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:39.200697 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:39.208026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-1f0608b6-8cbb-407d-9650-5d5ed8935fc8 req-53225e5c-d020-46ed-acd5-03ee634fa7c5 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Deleting port 89f8d6b5-809f-446f-bb95-9e0f45b66f60 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:39.208411 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1f0608b6-8cbb-407d-9650-5d5ed8935fc8 req-53225e5c-d020-46ed-acd5-03ee634fa7c5 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:39.306957 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8fef9608-146a-4be9-ab34-27b39dd82c38 req-96492b04-06d3-434b-955f-8e698e3dde3a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2318091 May 12 15:37:39.325300 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:39.374046 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c110226-652d-4210-8559-db6496cca200 req-cf54a839-7979-49a0-8162-35c935b8e235 service neutron] 10.222.0.76 "GET /v2.0/networks/2edf0bcd-3aed-4d20-90f8-59e368722fde?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4252737 May 12 15:37:39.375040 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a759ba07-f65b-4552-86e9-00469264009e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:39.416429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-89684eaf-b1b0-4805-9124-4b3eb7a58b31 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:39.416601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a759ba07-f65b-4552-86e9-00469264009e None None] For port 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:39.418817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=e8a30607-8978-4b85-b35b-a3fe9bdb626c,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:39.424237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['e8a30607-8978-4b85-b35b-a3fe9bdb626c'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:37:39.433014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-89684eaf-b1b0-4805-9124-4b3eb7a58b31 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:39.436860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-89684eaf-b1b0-4805-9124-4b3eb7a58b31 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:39.444099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-89684eaf-b1b0-4805-9124-4b3eb7a58b31 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:39.451711 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a759ba07-f65b-4552-86e9-00469264009e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:39.453204 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:39.464271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89684eaf-b1b0-4805-9124-4b3eb7a58b31 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:39.468805 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-89684eaf-b1b0-4805-9124-4b3eb7a58b31 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:39.583933 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a759ba07-f65b-4552-86e9-00469264009e None None] Pushing event updated for resources: {'Port': ['ID=74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:39.633577 n-d-841483-1 neutron-server[88152]: INFO neutron.db.ipam_backend_mixin [None req-89684eaf-b1b0-4805-9124-4b3eb7a58b31 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Validation for CIDR: 172.20.0.16/28 failed - overlaps with subnet 81532e76-f50d-4005-bf2c-36e07b2cddc7 (CIDR: 172.20.0.16/28) May 12 15:37:39.637866 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-89684eaf-b1b0-4805-9124-4b3eb7a58b31 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:37:39.638350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-89684eaf-b1b0-4805-9124-4b3eb7a58b31 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:39.658443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-89684eaf-b1b0-4805-9124-4b3eb7a58b31 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 425 time: 0.5306222 May 12 15:37:39.661328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60228) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:39.668270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-66b1e406-928e-4773-a8fa-642f1fe46cad tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'subnet': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'cidr': '172.20.0.32/28', 'ip_version': 4, 'gateway_ip': '172.20.0.33'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:39.770295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:39.781318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:39.799391 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c110226-652d-4210-8559-db6496cca200 req-02645ad4-9e96-455e-ae96-994def339278 service neutron] 10.222.0.76 "GET /v2.0/networks/2edf0bcd-3aed-4d20-90f8-59e368722fde?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3398700 May 12 15:37:39.817780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:39.825590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:39.826184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:39.831510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=f8b0c968-d5d0-413d-9ade-028ef202d570,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:39.870498 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5c446992-dbab-4044-9a77-294df2b279cc tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 4.2464437 May 12 15:37:39.870633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60242) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:39.927968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-1f0608b6-8cbb-407d-9650-5d5ed8935fc8 req-53225e5c-d020-46ed-acd5-03ee634fa7c5 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] For port 89f8d6b5-809f-446f-bb95-9e0f45b66f60, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=89f8d6b5-809f-446f-bb95-9e0f45b66f60,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:39.928241 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1f0608b6-8cbb-407d-9650-5d5ed8935fc8 req-53225e5c-d020-46ed-acd5-03ee634fa7c5 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:39.941278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-66b1e406-928e-4773-a8fa-642f1fe46cad tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:39.950400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-66b1e406-928e-4773-a8fa-642f1fe46cad tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Usage tracker for resource:subnet and tenant:9bd6beec65cd47b3a0febdc05aaed724 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:39.954694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-66b1e406-928e-4773-a8fa-642f1fe46cad tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:39.977007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-66b1e406-928e-4773-a8fa-642f1fe46cad tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:40.039703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd515d7c-b0e8-4ced-ad5e-f9d4166d3783 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:40.047314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd515d7c-b0e8-4ced-ad5e-f9d4166d3783 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:40.052256 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fd515d7c-b0e8-4ced-ad5e-f9d4166d3783 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1705 time: 0.1853299 May 12 15:37:40.052849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60252) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:40.078175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66b1e406-928e-4773-a8fa-642f1fe46cad tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Made reservation on behalf of 9bd6beec65cd47b3a0febdc05aaed724 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:40.083792 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-66b1e406-928e-4773-a8fa-642f1fe46cad tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:40.132388 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-1f0608b6-8cbb-407d-9650-5d5ed8935fc8 req-53225e5c-d020-46ed-acd5-03ee634fa7c5 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Calling delete_port for 89f8d6b5-809f-446f-bb95-9e0f45b66f60 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:40.203417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6ea3abf0-dd65-4c93-85a9-73fa66951bfe None None] Provisioning for port f8b0c968-d5d0-413d-9ade-028ef202d570 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:40.222528 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6ea3abf0-dd65-4c93-85a9-73fa66951bfe None None] Provisioning complete for port f8b0c968-d5d0-413d-9ade-028ef202d570 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:40.222528 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6ea3abf0-dd65-4c93-85a9-73fa66951bfe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:40.287326 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:40.342388 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6ea3abf0-dd65-4c93-85a9-73fa66951bfe None None] Port f8b0c968-d5d0-413d-9ade-028ef202d570 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:37:40.440131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:40.557614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:40.559270 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:40.655110 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1f0608b6-8cbb-407d-9650-5d5ed8935fc8 req-53225e5c-d020-46ed-acd5-03ee634fa7c5 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:40.672887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['89f8d6b5-809f-446f-bb95-9e0f45b66f60'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:37:40.698286 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-66b1e406-928e-4773-a8fa-642f1fe46cad tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:40.740554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['45ca2419-3316-4890-add7-265905134549'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:37:40.789622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e8a30607-8978-4b85-b35b-a3fe9bdb626c up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:40.868584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d3b91aa-2590-4365-9842-ef8b5516081b req-a786b148-9290-4874-9991-98ce612283d6 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=15e319f9-b1d8-4a28-af53-803684c8b243 HTTP/1.1" status: 200 len: 210 time: 0.1831000 May 12 15:37:40.880423 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66b1e406-928e-4773-a8fa-642f1fe46cad tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:40.901668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-66b1e406-928e-4773-a8fa-642f1fe46cad tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:40.915549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66b1e406-928e-4773-a8fa-642f1fe46cad tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:40.916140 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-66b1e406-928e-4773-a8fa-642f1fe46cad tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:40.918223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ea79698-97bd-4350-943a-a8f3565989bf None None] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:40.943537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-cb2d13bc-5b02-4315-9bf5-e9621664a935 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port f8b0c968-d5d0-413d-9ade-028ef202d570 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:40.943861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cb2d13bc-5b02-4315-9bf5-e9621664a935 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:40.948830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53225e5c-d020-46ed-acd5-03ee634fa7c5 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Pushing event deleted for resources: {'Port': ['ID=89f8d6b5-809f-446f-bb95-9e0f45b66f60,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:40.986268 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-66b1e406-928e-4773-a8fa-642f1fe46cad tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 1.3238568 May 12 15:37:40.989660 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60278) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:41.017196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a74b16bc-471f-449f-a893-f91869dd638e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-48368022', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'd86e1191-b64b-44e0-b299-70d2fa06d715'}], 'security_groups': ['6c5c9417-99ec-4bbb-bd2f-65d68f7be2f9', '6ffd1e2e-498c-4f2a-be64-e45143cb9c93']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:41.053257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66b1e406-928e-4773-a8fa-642f1fe46cad tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Subnet': ['ID=d86e1191-b64b-44e0-b299-70d2fa06d715,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:41.061972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-1f0608b6-8cbb-407d-9650-5d5ed8935fc8 req-53225e5c-d020-46ed-acd5-03ee634fa7c5 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] No DVR routers for this DVR port 89f8d6b5-809f-446f-bb95-9e0f45b66f60 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:37:41.073148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1f0608b6-8cbb-407d-9650-5d5ed8935fc8 req-53225e5c-d020-46ed-acd5-03ee634fa7c5 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:41.076264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '15e319f9-b1d8-4a28-af53-803684c8b243', 'name': 'network-vif-deleted', 'tag': '89f8d6b5-809f-446f-bb95-9e0f45b66f60'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:37:41.107026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.25.8.118 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/29a92c97-d0fc-4fc5-8598-7350964e408a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:41.112222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf51c78a-2cef-4c46-b6a4-2d2e567dcc9c req-8000ef9a-42a4-45a8-aa0e-6299b450e7e4 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:41.114093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf51c78a-2cef-4c46-b6a4-2d2e567dcc9c req-8000ef9a-42a4-45a8-aa0e-6299b450e7e4 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 908 time: 0.4273357 May 12 15:37:41.127925 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1f0608b6-8cbb-407d-9650-5d5ed8935fc8 req-53225e5c-d020-46ed-acd5-03ee634fa7c5 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.76 "DELETE /v2.0/ports/89f8d6b5-809f-446f-bb95-9e0f45b66f60 HTTP/1.1" status: 204 len: 173 time: 2.0941584 May 12 15:37:41.234760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port e8a30607-8978-4b85-b35b-a3fe9bdb626c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:41.402029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port e8a30607-8978-4b85-b35b-a3fe9bdb626c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:41.402764 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:41.433711 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:41.480338 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-85b83c3e-7f39-4c39-ab52-3765b954a099'] response: {'server_uuid': '15e319f9-b1d8-4a28-af53-803684c8b243', 'name': 'network-vif-deleted', 'tag': '89f8d6b5-809f-446f-bb95-9e0f45b66f60', 'status': 'completed', 'code': 200} May 12 15:37:41.482417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:41.606291 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a74b16bc-471f-449f-a893-f91869dd638e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:41.615321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=29a92c97-d0fc-4fc5-8598-7350964e408a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:41.658678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:41.662403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:41.670930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:41.736181 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cb2d13bc-5b02-4315-9bf5-e9621664a935 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:41.873274 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:41.923820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'db0e9b9b-6db8-4cb6-9388-31519382fa96', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8a30607-8978-4b85-b35b-a3fe9bdb626c'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:37:41.959883 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e8a30607-8978-4b85-b35b-a3fe9bdb626c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8a30607-8978-4b85-b35b-a3fe9bdb626c,segment=NetworkSegment(464fcc74-09ac-4457-9f5a-e40ea4ef2c72),segment_id=464fcc74-09ac-4457-9f5a-e40ea4ef2c72)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:42.036592 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:42.036592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 89f8d6b5-809f-446f-bb95-9e0f45b66f60 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:37:42.125567 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9b750bc7-6a6f-490e-aaab-f3b5ad28ff74'] response: {'server_uuid': 'db0e9b9b-6db8-4cb6-9388-31519382fa96', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8a30607-8978-4b85-b35b-a3fe9bdb626c', 'code': 200} May 12 15:37:42.180401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-cb2d13bc-5b02-4315-9bf5-e9621664a935 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for f8b0c968-d5d0-413d-9ade-028ef202d570 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:42.199219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 89f8d6b5-809f-446f-bb95-9e0f45b66f60 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:37:42.200817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 89f8d6b5-809f-446f-bb95-9e0f45b66f60 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:37:42.352344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b3f813f-1688-44b5-857e-617e1a70b62d None None] Update dhcp port {'port': {'network_id': '66bc0e1c-8b39-4a42-b061-fe805d2bcf80', 'fixed_ips': [{'subnet_id': '81532e76-f50d-4005-bf2c-36e07b2cddc7', 'ip_address': '172.20.0.18'}, {'subnet_id': '8fd9aa3d-9718-4c57-adf4-e4121068264b', 'ip_address': '172.20.0.2'}, {'subnet_id': 'd86e1191-b64b-44e0-b299-70d2fa06d715'}], 'binding:host_id': 'n-d-841483-1'}, 'id': 'ce4fa33a-3f1f-4337-b016-94fd30cba869'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:37:42.478454 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=e8a30607-8978-4b85-b35b-a3fe9bdb626c,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:42.500089 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b3f813f-1688-44b5-857e-617e1a70b62d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:42.657839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9897eeea-8296-4432-b1e0-a65300a95458 req-e4da5725-ab7f-4bf4-be6e-fdb39d747d75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:42.659958 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9897eeea-8296-4432-b1e0-a65300a95458 req-e4da5725-ab7f-4bf4-be6e-fdb39d747d75 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 1060 time: 0.4635441 May 12 15:37:42.761253 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:42.823581 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cfb7e080-6be6-476f-a15d-e59651adbfbf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:42.866252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:42.999684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cb2d13bc-5b02-4315-9bf5-e9621664a935 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:43.105064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb2d13bc-5b02-4315-9bf5-e9621664a935 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=f8b0c968-d5d0-413d-9ade-028ef202d570,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:43.178012 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cb2d13bc-5b02-4315-9bf5-e9621664a935 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:43.193233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-a74b16bc-471f-449f-a893-f91869dd638e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Delete allocated IP 172.20.0.3 (66bc0e1c-8b39-4a42-b061-fe805d2bcf80/8fd9aa3d-9718-4c57-adf4-e4121068264b) {{(pid=88152) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} May 12 15:37:43.207522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13c2a137-b776-4b00-a7e5-511dd658c795 req-0fdaf3d4-c957-4b37-940d-5f4493250b67 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:43.207748 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:43.209075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13c2a137-b776-4b00-a7e5-511dd658c795 req-0fdaf3d4-c957-4b37-940d-5f4493250b67 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.4726653 May 12 15:37:43.228392 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:43.229198 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cb2d13bc-5b02-4315-9bf5-e9621664a935 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/f8b0c968-d5d0-413d-9ade-028ef202d570 HTTP/1.1" status: 204 len: 168 time: 3.1683831 May 12 15:37:43.233555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60346) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:43.244648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57016350-7c50-4fe7-acb5-f62d06a5f9d7 req-5ec51332-d9a6-4a9c-a294-f81e87ddb15f tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:43.246621 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57016350-7c50-4fe7-acb5-f62d06a5f9d7 req-5ec51332-d9a6-4a9c-a294-f81e87ddb15f tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 909 time: 0.6423140 May 12 15:37:43.248041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-a74b16bc-471f-449f-a893-f91869dd638e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Allocated IP 172.20.0.46 (66bc0e1c-8b39-4a42-b061-fe805d2bcf80/d86e1191-b64b-44e0-b299-70d2fa06d715/a07a267d-3854-4d6e-9148-b6d338fb19ea) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:43.291921 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:43.404936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13c2a137-b776-4b00-a7e5-511dd658c795 req-da2fce2a-ed0b-47a8-a07f-2f86ab287148 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1886091 May 12 15:37:43.415091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-c2682e90-24bc-4b82-9b1f-0c64c913b2db req-5381d606-b5a7-4733-8466-2fa52fc242ad service neutron] (88151) timed out ('10.222.0.82', 46344) {{(pid=88151) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 15:37:43.497689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=29a92c97-d0fc-4fc5-8598-7350964e408a,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:43.521003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d21fa353-3f6b-49f5-9448-294874cd1f94 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:43.527537 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d21fa353-3f6b-49f5-9448-294874cd1f94 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:43.529186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d21fa353-3f6b-49f5-9448-294874cd1f94 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:43.554585 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:43.658318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d21fa353-3f6b-49f5-9448-294874cd1f94 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:43.660393 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d21fa353-3f6b-49f5-9448-294874cd1f94 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.4255610 May 12 15:37:43.663692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60358) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:43.672218 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a74b16bc-471f-449f-a893-f91869dd638e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:43.690716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-a74b16bc-471f-449f-a893-f91869dd638e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Transition to ACTIVE for port object a07a267d-3854-4d6e-9148-b6d338fb19ea will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:43.707564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a74b16bc-471f-449f-a893-f91869dd638e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:43.795084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60362) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:43.869223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-0b3f813f-1688-44b5-857e-617e1a70b62d None None] Allocated IP 172.20.0.34 (66bc0e1c-8b39-4a42-b061-fe805d2bcf80/d86e1191-b64b-44e0-b299-70d2fa06d715/ce4fa33a-3f1f-4337-b016-94fd30cba869) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:44.004435 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a74b16bc-471f-449f-a893-f91869dd638e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] In _notify_port_updated(), no bound segment for port a07a267d-3854-4d6e-9148-b6d338fb19ea on network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 {{(pid=88152) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:37:44.010309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a74b16bc-471f-449f-a893-f91869dd638e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:44.010971 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a74b16bc-471f-449f-a893-f91869dd638e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:44.012261 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a74b16bc-471f-449f-a893-f91869dd638e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "PUT /v2.0/ports/a07a267d-3854-4d6e-9148-b6d338fb19ea HTTP/1.1" status: 200 len: 958 time: 3.0139015 May 12 15:37:44.013335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a74b16bc-471f-449f-a893-f91869dd638e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event updated for resources: {'Port': ['ID=a07a267d-3854-4d6e-9148-b6d338fb19ea,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:44.015501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60372) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:44.021002 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Floating IP 20770190-a935-44e3-8b22-f2f7a5b501ea associated. External IP: 172.25.8.118, port: 8ac3db5f-3324-4a02-a6e5-504a9ea69fc2. May 12 15:37:44.088284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0b3f813f-1688-44b5-857e-617e1a70b62d None None] For port ce4fa33a-3f1f-4337-b016-94fd30cba869, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce4fa33a-3f1f-4337-b016-94fd30cba869,segment=NetworkSegment(351c4dc8-5404-4259-bed5-cd4008dea28b),segment_id=351c4dc8-5404-4259-bed5-cd4008dea28b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:44.112074 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-250c7dd2-36b8-4968-a6ad-fca9c53f2bd3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:44.133678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-af97fb7c-a60f-4893-8009-01e7a1981c80 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port a07a267d-3854-4d6e-9148-b6d338fb19ea {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:44.134019 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af97fb7c-a60f-4893-8009-01e7a1981c80 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:44.143723 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b3f813f-1688-44b5-857e-617e1a70b62d None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:44.154904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-e8d673c4-c629-4baf-9d0f-5bc782be1c52 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet f38e3e28-a08b-457d-95c4-1898903f5bd0 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:37:44.162707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0b3f813f-1688-44b5-857e-617e1a70b62d None None] Transition to ACTIVE for port object ce4fa33a-3f1f-4337-b016-94fd30cba869 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:44.166501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-250c7dd2-36b8-4968-a6ad-fca9c53f2bd3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:44.167347 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d673c4-c629-4baf-9d0f-5bc782be1c52 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:44.167609 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b3f813f-1688-44b5-857e-617e1a70b62d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:44.183146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-250c7dd2-36b8-4968-a6ad-fca9c53f2bd3 admin admin] Usage tracker for resource:security_group_rule and tenant:bebcf6b787a74dfa9db11ca5d7eeb5da is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:44.188110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-250c7dd2-36b8-4968-a6ad-fca9c53f2bd3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:44.197010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-250c7dd2-36b8-4968-a6ad-fca9c53f2bd3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:44.372013 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d673c4-c629-4baf-9d0f-5bc782be1c52 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:44.423705 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af97fb7c-a60f-4893-8009-01e7a1981c80 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:44.549542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b3f813f-1688-44b5-857e-617e1a70b62d None None] Pushing event updated for resources: {'Port': ['ID=ce4fa33a-3f1f-4337-b016-94fd30cba869,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:44.718773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-af97fb7c-a60f-4893-8009-01e7a1981c80 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for a07a267d-3854-4d6e-9148-b6d338fb19ea owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:44.751231 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d673c4-c629-4baf-9d0f-5bc782be1c52 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:44.863071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:37:44.895312 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af97fb7c-a60f-4893-8009-01e7a1981c80 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:44.937972 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d673c4-c629-4baf-9d0f-5bc782be1c52 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:45.010663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8d673c4-c629-4baf-9d0f-5bc782be1c52 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=f38e3e28-a08b-457d-95c4-1898903f5bd0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:45.015012 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8d673c4-c629-4baf-9d0f-5bc782be1c52 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:45.026329 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49592b26-21ca-4722-a286-228a2ede6a69 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:45.061268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af97fb7c-a60f-4893-8009-01e7a1981c80 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=a07a267d-3854-4d6e-9148-b6d338fb19ea,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:45.134434 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e8d673c4-c629-4baf-9d0f-5bc782be1c52 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/f38e3e28-a08b-457d-95c4-1898903f5bd0 HTTP/1.1" status: 204 len: 168 time: 1.4694085 May 12 15:37:45.143166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60394) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:45.229421 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d3a1a9f4-5559-48a8-b25b-ef977b318d5b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0847454 May 12 15:37:45.233049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60398) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:45.325553 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-517fd32b-e523-42cc-9902-3a337164e6ba None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:45.333097 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-250c7dd2-36b8-4968-a6ad-fca9c53f2bd3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:45.344731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:37:45.345470 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-250c7dd2-36b8-4968-a6ad-fca9c53f2bd3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:45.354754 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b0f6851-49ec-420e-93b7-e18e4434fb91 None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:37:45.368013 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b0f6851-49ec-420e-93b7-e18e4434fb91 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:45.370222 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9b0f6851-49ec-420e-93b7-e18e4434fb91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:45.394191 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:45.446472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc7aca3-aede-415b-954c-abdd6ca5ba6b req-89ce4d5c-2f6f-4712-a304-8525ad5cba67 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:45.448220 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dcc7aca3-aede-415b-954c-abdd6ca5ba6b req-89ce4d5c-2f6f-4712-a304-8525ad5cba67 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 909 time: 0.5625298 May 12 15:37:45.456388 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af97fb7c-a60f-4893-8009-01e7a1981c80 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:45.461341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b77a280-cca5-498d-b0a9-b7583e158557 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:45.464328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6b77a280-cca5-498d-b0a9-b7583e158557 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:45.473078 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9b0f6851-49ec-420e-93b7-e18e4434fb91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:45.475105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:37:45.481338 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Deleting port 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:45.481739 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:45.484650 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b0f6851-49ec-420e-93b7-e18e4434fb91 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:45.485545 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9b0f6851-49ec-420e-93b7-e18e4434fb91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:45.566223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-041dd70a-7ba1-4fb9-91ba-1f3b4959a235 req-18dc2630-83b3-497d-892d-919fc410a87a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:45.569363 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-041dd70a-7ba1-4fb9-91ba-1f3b4959a235 req-18dc2630-83b3-497d-892d-919fc410a87a tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.6857605 May 12 15:37:45.571442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-250c7dd2-36b8-4968-a6ad-fca9c53f2bd3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0121a7eb-3c03-4439-badd-f1d5ae7c5e33,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:45.587917 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9b0f6851-49ec-420e-93b7-e18e4434fb91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:45.588888 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b0f6851-49ec-420e-93b7-e18e4434fb91 None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:37:45.604429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3e6a7d38-c5fb-4d7a-a44d-0a65e5cb9259 None None] Provisioning for port ce4fa33a-3f1f-4337-b016-94fd30cba869 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:45.610292 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-250c7dd2-36b8-4968-a6ad-fca9c53f2bd3 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bebcf6b787a74dfa9db11ca5d7eeb5da&name=default HTTP/1.1" status: 200 len: 2983 time: 1.8016522 May 12 15:37:45.616859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60410) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:45.631719 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-af97fb7c-a60f-4893-8009-01e7a1981c80 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/a07a267d-3854-4d6e-9148-b6d338fb19ea HTTP/1.1" status: 204 len: 168 time: 1.6149178 May 12 15:37:45.635640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60414) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:45.641226 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-be800a92-5f01-41d6-98e8-37f19695c0fa tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 982 time: 6.6560555 May 12 15:37:45.642782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6b77a280-cca5-498d-b0a9-b7583e158557 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:45.642948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3e6a7d38-c5fb-4d7a-a44d-0a65e5cb9259 None None] Provisioning complete for port ce4fa33a-3f1f-4337-b016-94fd30cba869 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:45.644081 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6b77a280-cca5-498d-b0a9-b7583e158557 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.4095232 May 12 15:37:45.645962 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3e6a7d38-c5fb-4d7a-a44d-0a65e5cb9259 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:45.650645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60418) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:45.651345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60420) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:45.658679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-eaf6135d-74b3-4c83-8294-981825bca4b8 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'floatingip': {'port_id': None}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:45.709951 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-a701d0e4-76af-4c1b-be19-7ec8331b1fd1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] GET failed (client error): The resource could not be found. May 12 15:37:45.710981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a701d0e4-76af-4c1b-be19-7ec8331b1fd1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Synchronizing usage tracker for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:45.826325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-041dd70a-7ba1-4fb9-91ba-1f3b4959a235 req-88e3eb19-5f46-4ba8-9475-25cc4756c420 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2119534 May 12 15:37:45.835614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a701d0e4-76af-4c1b-be19-7ec8331b1fd1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Unset dirty status for tenant:9bd6beec65cd47b3a0febdc05aaed724 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:45.841679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a701d0e4-76af-4c1b-be19-7ec8331b1fd1 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports/a07a267d-3854-4d6e-9148-b6d338fb19ea HTTP/1.1" status: 404 len: 333 time: 0.2043304 May 12 15:37:45.842872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60426) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:45.890911 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eaf6135d-74b3-4c83-8294-981825bca4b8 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:45.990583 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c866f5a-792d-4870-847f-00796010fa5a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.021235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] For port 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:46.021639 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.062576 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c866f5a-792d-4870-847f-00796010fa5a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.125413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1cf8ac7-4ce4-4eb1-9d1c-daf675729bc3 req-7daba3ba-6e95-43a6-aaf4-4104a704bad8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:46.127290 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1cf8ac7-4ce4-4eb1-9d1c-daf675729bc3 req-7daba3ba-6e95-43a6-aaf4-4104a704bad8 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 909 time: 0.4081128 May 12 15:37:46.128526 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c866f5a-792d-4870-847f-00796010fa5a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.161202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c866f5a-792d-4870-847f-00796010fa5a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d35fce6d-2b23-4e78-bcbb-f24fdf02c89b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:46.167683 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c866f5a-792d-4870-847f-00796010fa5a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.169098 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5c866f5a-792d-4870-847f-00796010fa5a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/security-groups/d35fce6d-2b23-4e78-bcbb-f24fdf02c89b HTTP/1.1" status: 204 len: 168 time: 0.3208363 May 12 15:37:46.175630 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60436) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:46.286692 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Calling delete_port for 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:46.307116 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b709145b-dbf4-48d0-a5d8-6328d694f518 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.350367 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.358972 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b709145b-dbf4-48d0-a5d8-6328d694f518 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.468128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0d4eb88-e7c3-4f2c-a104-2470be6c8945 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:46.469560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c0d4eb88-e7c3-4f2c-a104-2470be6c8945 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:46.508578 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b709145b-dbf4-48d0-a5d8-6328d694f518 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.537029 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b709145b-dbf4-48d0-a5d8-6328d694f518 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.538933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b709145b-dbf4-48d0-a5d8-6328d694f518 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/security-groups/6ffd1e2e-498c-4f2a-be64-e45143cb9c93 HTTP/1.1" status: 204 len: 168 time: 0.3617845 May 12 15:37:46.540036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b709145b-dbf4-48d0-a5d8-6328d694f518 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ffd1e2e-498c-4f2a-be64-e45143cb9c93,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:46.540152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ce4fa33a-3f1f-4337-b016-94fd30cba869 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:46.544751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60444) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:46.594433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6b1a0b-a126-4b4c-908d-ab0e33570495 req-a9bff5f4-a984-40ae-9a0a-9bd6228e46be tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:46.594433 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da6b1a0b-a126-4b4c-908d-ab0e33570495 req-a9bff5f4-a984-40ae-9a0a-9bd6228e46be tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 1060 time: 0.1682196 May 12 15:37:46.596267 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.608856 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3e6a7d38-c5fb-4d7a-a44d-0a65e5cb9259 None None] Provisioning complete for port d3738296-e321-4a38-bb44-3803dd75076e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:46.609228 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3e6a7d38-c5fb-4d7a-a44d-0a65e5cb9259 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.660379 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eaf6135d-74b3-4c83-8294-981825bca4b8 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.695639 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f1fdd4e1-1d50-43da-b8ba-048393f99a91 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.736189 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e59fbd50-5afe-4c5d-ade1-fbc7c9932ffa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.738018 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eaf6135d-74b3-4c83-8294-981825bca4b8 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.738332 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-eaf6135d-74b3-4c83-8294-981825bca4b8 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Floating IP 20770190-a935-44e3-8b22-f2f7a5b501ea disassociated. External IP: 172.25.8.118, port: 8ac3db5f-3324-4a02-a6e5-504a9ea69fc2. May 12 15:37:46.763998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Pushing event deleted for resources: {'Port': ['ID=74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:46.771454 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.778639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:46.778972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:46.779307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:46.779637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:46.779962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:46.780284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:46.780602 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:46.780919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:46.781239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:46.781577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:46.781892 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:46.782205 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:46.794837 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f1fdd4e1-1d50-43da-b8ba-048393f99a91 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.795034 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-372bf074-b13d-44fa-ad81-019ad538fb40 None None] No DVR routers for this DVR port 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:37:46.823078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3e6a7d38-c5fb-4d7a-a44d-0a65e5cb9259 None None] Port d3738296-e321-4a38-bb44-3803dd75076e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:37:46.830864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3e6a7d38-c5fb-4d7a-a44d-0a65e5cb9259 None None] Could not find standard attr ID for object a07a267d-3854-4d6e-9148-b6d338fb19ea. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:37:46.846554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ce4fa33a-3f1f-4337-b016-94fd30cba869 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:46.847183 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.882051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbeca63d-2a32-4f21-8a4c-6872a4b016e3 req-0a3cc612-5f4e-4666-8e5f-a1341233a781 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:46.883364 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fbeca63d-2a32-4f21-8a4c-6872a4b016e3 req-0a3cc612-5f4e-4666-8e5f-a1341233a781 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 1135 time: 0.1453760 May 12 15:37:46.889176 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e59fbd50-5afe-4c5d-ade1-fbc7c9932ffa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.901001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c0d4eb88-e7c3-4f2c-a104-2470be6c8945 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:46.912583 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c0d4eb88-e7c3-4f2c-a104-2470be6c8945 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 1.2479029 May 12 15:37:46.912687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60458) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:46.917014 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f1fdd4e1-1d50-43da-b8ba-048393f99a91 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:46.959482 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d12cf80d-27d5-4126-9776-69d9ff9475c8 None None] Could not find standard attr ID for object a07a267d-3854-4d6e-9148-b6d338fb19ea. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:37:47.043278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1fdd4e1-1d50-43da-b8ba-048393f99a91 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6c5c9417-99ec-4bbb-bd2f-65d68f7be2f9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:47.072402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc7bcfbb-43eb-4c1c-a726-ea21be2adcce req-84f98099-ca56-4fc0-8011-e7673ea90001 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:47.072809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-dc7bcfbb-43eb-4c1c-a726-ea21be2adcce req-84f98099-ca56-4fc0-8011-e7673ea90001 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Synchronizing usage tracker for tenant:ed8d9bf58283443480f0c62e72d53449 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:47.105288 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e59fbd50-5afe-4c5d-ade1-fbc7c9932ffa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:47.119709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-dc7bcfbb-43eb-4c1c-a726-ea21be2adcce req-84f98099-ca56-4fc0-8011-e7673ea90001 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Unset dirty status for tenant:ed8d9bf58283443480f0c62e72d53449 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:47.120856 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc7bcfbb-43eb-4c1c-a726-ea21be2adcce req-84f98099-ca56-4fc0-8011-e7673ea90001 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.84 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.4486661 May 12 15:37:47.135634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:37:47.177042 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:37:47.177709 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 74ab2f91-a97e-4d2d-8a23-7aaf241ed3c6 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:37:47.186657 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fbeca63d-2a32-4f21-8a4c-6872a4b016e3 req-db35c92a-2737-411c-bc1d-8c23394eda07 tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 0.2907825 May 12 15:37:47.199246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a9e92c38-c3de-4d69-b5d3-646c134f9151 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.2833152 May 12 15:37:47.201086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60462) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:47.201486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60464) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:47.226630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e59fbd50-5afe-4c5d-ade1-fbc7c9932ffa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0121a7eb-3c03-4439-badd-f1d5ae7c5e33,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:47.267900 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e59fbd50-5afe-4c5d-ade1-fbc7c9932ffa admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:47.269257 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e59fbd50-5afe-4c5d-ade1-fbc7c9932ffa admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0121a7eb-3c03-4439-badd-f1d5ae7c5e33 HTTP/1.1" status: 204 len: 168 time: 1.6511848 May 12 15:37:47.282792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4e3bb606-2479-4a07-b547-7255604f722f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'slaac'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:47.308239 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f1fdd4e1-1d50-43da-b8ba-048393f99a91 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:47.319992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f1fdd4e1-1d50-43da-b8ba-048393f99a91 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/security-groups/6c5c9417-99ec-4bbb-bd2f-65d68f7be2f9 HTTP/1.1" status: 204 len: 168 time: 0.7659700 May 12 15:37:47.319992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60476) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:47.389974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-dc7bcfbb-43eb-4c1c-a726-ea21be2adcce req-5e4c9c9f-23e6-44a1-a8d5-adfd5d3cc44f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Deleting port 45ca2419-3316-4890-add7-265905134549 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:47.390462 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-dc7bcfbb-43eb-4c1c-a726-ea21be2adcce req-5e4c9c9f-23e6-44a1-a8d5-adfd5d3cc44f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:47.564242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eaf6135d-74b3-4c83-8294-981825bca4b8 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:37:47.705875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04225990-0cad-466c-9f4e-c6176b0ccc93 req-fb367563-128a-4314-83c5-96b11dbda020 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:47.707397 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04225990-0cad-466c-9f4e-c6176b0ccc93 req-fb367563-128a-4314-83c5-96b11dbda020 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 945 time: 0.6447151 May 12 15:37:47.716435 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-e5897377-2e5d-487b-9991-1180f65a3c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting subnet 8fd9aa3d-9718-4c57-adf4-e4121068264b {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:37:47.720589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4e3bb606-2479-4a07-b547-7255604f722f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:47.727503 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:47.728062 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e5897377-2e5d-487b-9991-1180f65a3c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:47.764809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60488) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:47.800876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4e3bb606-2479-4a07-b547-7255604f722f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:47.806461 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5ad1f8ed-0869-4494-8150-353ed103b47d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:47.817729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c644e5d1-af07-4d4d-b493-7fe0124d005e tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:47.823663 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c644e5d1-af07-4d4d-b493-7fe0124d005e tempest-TestSecurityGroupsBasicOps-1549139348 tempest-TestSecurityGroupsBasicOps-1549139348-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 1055 time: 0.6190219 May 12 15:37:47.830780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5ad1f8ed-0869-4494-8150-353ed103b47d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:47.834948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5ad1f8ed-0869-4494-8150-353ed103b47d admin admin] Usage tracker for resource:security_group_rule and tenant:14f4d8641e564e739aa0c6089d35de46 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:47.838479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5ad1f8ed-0869-4494-8150-353ed103b47d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:47.844341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5ad1f8ed-0869-4494-8150-353ed103b47d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:47.855554 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e5897377-2e5d-487b-9991-1180f65a3c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:47.887583 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04225990-0cad-466c-9f4e-c6176b0ccc93 req-b605bd1a-3afc-4974-869f-d9a8f8ca86d5 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/security-groups?id=17ef7040-f66b-422a-a8da-be4216f1f8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1688142 May 12 15:37:47.896435 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4e3bb606-2479-4a07-b547-7255604f722f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:47.901654 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4e3bb606-2479-4a07-b547-7255604f722f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:48.065884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5ad1f8ed-0869-4494-8150-353ed103b47d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:48.079676 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5ad1f8ed-0869-4494-8150-353ed103b47d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:48.108298 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e5897377-2e5d-487b-9991-1180f65a3c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:48.123643 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5ad1f8ed-0869-4494-8150-353ed103b47d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=14f4d8641e564e739aa0c6089d35de46&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3497336 May 12 15:37:48.136504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60498) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:48.174113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-dc7bcfbb-43eb-4c1c-a726-ea21be2adcce req-5e4c9c9f-23e6-44a1-a8d5-adfd5d3cc44f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] For port 45ca2419-3316-4890-add7-265905134549, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=45ca2419-3316-4890-add7-265905134549,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:48.174786 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-dc7bcfbb-43eb-4c1c-a726-ea21be2adcce req-5e4c9c9f-23e6-44a1-a8d5-adfd5d3cc44f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:48.220643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eaf6135d-74b3-4c83-8294-981825bca4b8 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:37:48.249901 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-665c5ffe-afd0-46d1-8e6e-377a576d6096 None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:37:48.274437 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-665c5ffe-afd0-46d1-8e6e-377a576d6096 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:48.278612 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-665c5ffe-afd0-46d1-8e6e-377a576d6096 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:48.300849 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e5897377-2e5d-487b-9991-1180f65a3c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:48.388241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5897377-2e5d-487b-9991-1180f65a3c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Subnet': ['ID=8fd9aa3d-9718-4c57-adf4-e4121068264b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:48.399165 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e5897377-2e5d-487b-9991-1180f65a3c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:48.417605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e5897377-2e5d-487b-9991-1180f65a3c67 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/8fd9aa3d-9718-4c57-adf4-e4121068264b HTTP/1.1" status: 204 len: 168 time: 1.0869808 May 12 15:37:48.419638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60508) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:48.425864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-665c5ffe-afd0-46d1-8e6e-377a576d6096 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:48.429815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f35e5dbe-410d-4448-8151-a20970069aca None None] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:48.522523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-665c5ffe-afd0-46d1-8e6e-377a576d6096 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:48.523859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-665c5ffe-afd0-46d1-8e6e-377a576d6096 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:48.581040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ad1f8ed-0869-4494-8150-353ed103b47d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=376e3e10-5641-49d6-965a-e883dee7c2d2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:48.597130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-665c5ffe-afd0-46d1-8e6e-377a576d6096 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:48.598207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-665c5ffe-afd0-46d1-8e6e-377a576d6096 None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:37:48.599014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-dc7bcfbb-43eb-4c1c-a726-ea21be2adcce req-5e4c9c9f-23e6-44a1-a8d5-adfd5d3cc44f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Calling delete_port for 45ca2419-3316-4890-add7-265905134549 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:48.661956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.objects.ports [None req-4e3bb606-2479-4a07-b547-7255604f722f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88152) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:37:48.668224 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a4779fd-9d3b-4d76-9f46-1cf71aadbffd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:48.669853 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4e3bb606-2479-4a07-b547-7255604f722f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:48.698753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a4779fd-9d3b-4d76-9f46-1cf71aadbffd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:48.744999 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eaf6135d-74b3-4c83-8294-981825bca4b8 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:48.792254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-ed9a6898-e707-471f-9fea-2e706bd6d744 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting subnet d86e1191-b64b-44e0-b299-70d2fa06d715 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:37:48.812006 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ed9a6898-e707-471f-9fea-2e706bd6d744 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:48.846661 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-eaf6135d-74b3-4c83-8294-981825bca4b8 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "PUT /v2.0/floatingips/20770190-a935-44e3-8b22-f2f7a5b501ea HTTP/1.1" status: 200 len: 688 time: 3.1928957 May 12 15:37:48.848570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60518) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:48.860325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e3bb606-2479-4a07-b547-7255604f722f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:48.862596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e3bb606-2479-4a07-b547-7255604f722f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=2d18170c-957c-43d3-a4dc-97efb6ef7afe,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:48.871534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-4e3bb606-2479-4a07-b547-7255604f722f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:48.887233 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a47587d8-f6e6-4d8d-bbbf-980329248d30 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:48.888536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e3bb606-2479-4a07-b547-7255604f722f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:48.889140 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4e3bb606-2479-4a07-b547-7255604f722f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:48.941459 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ed9a6898-e707-471f-9fea-2e706bd6d744 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:48.980443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4e3bb606-2479-4a07-b547-7255604f722f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 824 time: 1.7772474 May 12 15:37:48.995617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60524) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:49.021713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4dd086d-a526-4569-8a03-f4cf7eb242b1 req-34fddd3f-9a52-4132-b609-50bd3552fe1c tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:49.032223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4dd086d-a526-4569-8a03-f4cf7eb242b1 req-34fddd3f-9a52-4132-b609-50bd3552fe1c tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 909 time: 0.6113920 May 12 15:37:49.048421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'mac_address': 'fa:16:3e:a7:38:4f', 'name': 'tempest-NetworksTestDHCPv6-560555237'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:49.101534 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a4779fd-9d3b-4d76-9f46-1cf71aadbffd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:49.190528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a4779fd-9d3b-4d76-9f46-1cf71aadbffd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=376e3e10-5641-49d6-965a-e883dee7c2d2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:49.200516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4ceb01ae-9f30-4b56-8958-23292147a5b1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port 29a92c97-d0fc-4fc5-8598-7350964e408a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:49.202066 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ceb01ae-9f30-4b56-8958-23292147a5b1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:49.262569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '2d18170c-957c-43d3-a4dc-97efb6ef7afe'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:37:49.263285 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:49.296453 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a4779fd-9d3b-4d76-9f46-1cf71aadbffd admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:49.297584 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3a4779fd-9d3b-4d76-9f46-1cf71aadbffd admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/376e3e10-5641-49d6-965a-e883dee7c2d2 HTTP/1.1" status: 204 len: 168 time: 1.1548305 May 12 15:37:49.373781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-dc7bcfbb-43eb-4c1c-a726-ea21be2adcce req-5e4c9c9f-23e6-44a1-a8d5-adfd5d3cc44f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:49.442649 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-489b2be1-9748-4793-b5bb-33e8ae75a1f6 req-e50f04a4-572f-46d0-bafe-02766920b117 tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 210 time: 0.2613044 May 12 15:37:49.469372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:49.484129 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ed9a6898-e707-471f-9fea-2e706bd6d744 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:49.619327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Allocated IP 2001:db8::f816:3eff:fe8e:6ac3 (2447b094-d5d6-41ef-a146-2bf56f5399af/2d18170c-957c-43d3-a4dc-97efb6ef7afe/4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:49.650634 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ed9a6898-e707-471f-9fea-2e706bd6d744 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:49.695647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e4c9c9f-23e6-44a1-a8d5-adfd5d3cc44f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Pushing event deleted for resources: {'Port': ['ID=45ca2419-3316-4890-add7-265905134549,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:49.752571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:49.752571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed9a6898-e707-471f-9fea-2e706bd6d744 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Subnet': ['ID=d86e1191-b64b-44e0-b299-70d2fa06d715,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:49.752571 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ed9a6898-e707-471f-9fea-2e706bd6d744 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:49.757148 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ed9a6898-e707-471f-9fea-2e706bd6d744 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/d86e1191-b64b-44e0-b299-70d2fa06d715 HTTP/1.1" status: 204 len: 168 time: 1.3329015 May 12 15:37:49.761211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60540) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:49.815516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:49.847456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 45ca2419-3316-4890-add7-265905134549 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:37:49.868887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-dc7bcfbb-43eb-4c1c-a726-ea21be2adcce req-5e4c9c9f-23e6-44a1-a8d5-adfd5d3cc44f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] No DVR routers for this DVR port 45ca2419-3316-4890-add7-265905134549 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:37:49.871142 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-dc7bcfbb-43eb-4c1c-a726-ea21be2adcce req-5e4c9c9f-23e6-44a1-a8d5-adfd5d3cc44f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:49.873126 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc7bcfbb-43eb-4c1c-a726-ea21be2adcce req-5e4c9c9f-23e6-44a1-a8d5-adfd5d3cc44f tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.84 "DELETE /v2.0/ports/45ca2419-3316-4890-add7-265905134549 HTTP/1.1" status: 204 len: 173 time: 2.6987081 May 12 15:37:49.876656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e28c68b-82b6-449a-9c40-1c588e625b8f None None] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:49.883228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8fb6500d-7db4-46cb-945c-e5ef82421deb', 'name': 'network-vif-deleted', 'tag': '45ca2419-3316-4890-add7-265905134549'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:37:49.910614 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ceb01ae-9f30-4b56-8958-23292147a5b1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:49.910945 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ceb01ae-9f30-4b56-8958-23292147a5b1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:50.017913 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:50.050924 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-cbf09fcb-4d6b-43e2-b93b-143c0578ba77'] response: {'server_uuid': '8fb6500d-7db4-46cb-945c-e5ef82421deb', 'name': 'network-vif-deleted', 'tag': '45ca2419-3316-4890-add7-265905134549', 'status': 'completed', 'code': 200} May 12 15:37:50.060488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4ceb01ae-9f30-4b56-8958-23292147a5b1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for 29a92c97-d0fc-4fc5-8598-7350964e408a owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:50.072123 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-99ed1750-f156-452c-a4c1-70fa3ba6f3bb tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] DELETE failed (client error): The resource could not be found. May 12 15:37:50.072572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-99ed1750-f156-452c-a4c1-70fa3ba6f3bb tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:50.074296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-99ed1750-f156-452c-a4c1-70fa3ba6f3bb tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/8fd9aa3d-9718-4c57-adf4-e4121068264b HTTP/1.1" status: 404 len: 337 time: 0.3116484 May 12 15:37:50.076942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60554) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:50.113991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 45ca2419-3316-4890-add7-265905134549 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:37:50.117132 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 45ca2419-3316-4890-add7-265905134549 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:37:50.119491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21f96cf9-38a1-42c2-b107-c747b24ec082 req-2fee0a2d-2f4a-4c3b-85f1-9198087a4a0a tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:50.120214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-21f96cf9-38a1-42c2-b107-c747b24ec082 req-2fee0a2d-2f4a-4c3b-85f1-9198087a4a0a tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Synchronizing usage tracker for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:50.127054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port d6050a60-ec12-410a-9b8f-d376863839fd yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:37:50.165474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-21f96cf9-38a1-42c2-b107-c747b24ec082 req-2fee0a2d-2f4a-4c3b-85f1-9198087a4a0a tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Unset dirty status for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:50.166695 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-21f96cf9-38a1-42c2-b107-c747b24ec082 req-2fee0a2d-2f4a-4c3b-85f1-9198087a4a0a tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.76 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 909 time: 0.5890799 May 12 15:37:50.291492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-bc6fce7e-b116-4c01-8721-b9a8196e497e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting subnet 81532e76-f50d-4005-bf2c-36e07b2cddc7 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:37:50.295122 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc6fce7e-b116-4c01-8721-b9a8196e497e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:50.345672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-97d954d2-b1c1-42f5-be62-2c7c186d81ea None None] Provisioning complete for port ce4fa33a-3f1f-4337-b016-94fd30cba869 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:50.346190 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-97d954d2-b1c1-42f5-be62-2c7c186d81ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:50.461944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-21f96cf9-38a1-42c2-b107-c747b24ec082 req-7d737307-bfe1-4800-a282-43fa401481ba tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Deleting port e8a30607-8978-4b85-b35b-a3fe9bdb626c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:50.464357 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-21f96cf9-38a1-42c2-b107-c747b24ec082 req-7d737307-bfe1-4800-a282-43fa401481ba tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:50.656517 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ceb01ae-9f30-4b56-8958-23292147a5b1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:50.665979 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc6fce7e-b116-4c01-8721-b9a8196e497e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:50.761187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ceb01ae-9f30-4b56-8958-23292147a5b1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Port': ['ID=29a92c97-d0fc-4fc5-8598-7350964e408a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:50.849370 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:50.867991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25064c37-36ca-4615-afb4-337ac1700c2f req-bb62d350-46e8-4d75-8408-034934846b1e tempest-ServerRescueNegativeTestJSON-153110547 tempest-ServerRescueNegativeTestJSON-153110547-project] 10.222.0.82 "GET /v2.0/ports?device_id=8fb6500d-7db4-46cb-945c-e5ef82421deb HTTP/1.1" status: 200 len: 210 time: 0.1239915 May 12 15:37:50.949458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a693ee9-2d1f-4d0d-8e9a-477ae9eaf926 req-ed3aff39-4245-4864-8577-0f038075817e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:50.958607 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a693ee9-2d1f-4d0d-8e9a-477ae9eaf926 req-ed3aff39-4245-4864-8577-0f038075817e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 909 time: 0.3920243 May 12 15:37:51.002632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Transition to ACTIVE for port object 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:51.021640 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc6fce7e-b116-4c01-8721-b9a8196e497e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:51.111264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Transition to ACTIVE for port object 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:51.124053 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:51.190831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-97d954d2-b1c1-42f5-be62-2c7c186d81ea None None] Provisioning complete for port d3738296-e321-4a38-bb44-3803dd75076e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:51.191200 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-97d954d2-b1c1-42f5-be62-2c7c186d81ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:51.258724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:51.266898 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:51.271617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Pushing event updated for resources: {'Port': ['ID=4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:51.276524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:51.282020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-97d954d2-b1c1-42f5-be62-2c7c186d81ea None None] Port d3738296-e321-4a38-bb44-3803dd75076e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:37:51.294976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::f816:3eff:fea7:384f (2447b094-d5d6-41ef-a146-2bf56f5399af/2d18170c-957c-43d3-a4dc-97efb6ef7afe/d6050a60-ec12-410a-9b8f-d376863839fd) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:51.461876 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Attempting to bind port 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:37:51.462148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Attempting to bind port 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:37:51.464767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Attempting to bind port 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:37:51.476205 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 37, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:37:51.478779 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:37:51.479203 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:51.480815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:37:51.480815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Bound port: 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:37:51.481085 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:51.497281 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc6fce7e-b116-4c01-8721-b9a8196e497e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:51.509873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-21f96cf9-38a1-42c2-b107-c747b24ec082 req-7d737307-bfe1-4800-a282-43fa401481ba tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] For port e8a30607-8978-4b85-b35b-a3fe9bdb626c, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e8a30607-8978-4b85-b35b-a3fe9bdb626c,segment=NetworkSegment(464fcc74-09ac-4457-9f5a-e40ea4ef2c72),segment_id=464fcc74-09ac-4457-9f5a-e40ea4ef2c72)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:51.510841 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-21f96cf9-38a1-42c2-b107-c747b24ec082 req-7d737307-bfe1-4800-a282-43fa401481ba tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:51.581194 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc6fce7e-b116-4c01-8721-b9a8196e497e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:51.603547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc6fce7e-b116-4c01-8721-b9a8196e497e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Subnet': ['ID=81532e76-f50d-4005-bf2c-36e07b2cddc7,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:51.610383 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bc6fce7e-b116-4c01-8721-b9a8196e497e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/81532e76-f50d-4005-bf2c-36e07b2cddc7 HTTP/1.1" status: 204 len: 168 time: 1.5322604 May 12 15:37:51.614203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60596) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:51.681912 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] For port 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:37:51.688696 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] For port 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:37:51.696248 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:51.698203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-21f96cf9-38a1-42c2-b107-c747b24ec082 req-7d737307-bfe1-4800-a282-43fa401481ba tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Calling delete_port for e8a30607-8978-4b85-b35b-a3fe9bdb626c owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:51.721721 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-18284428-bfc9-47f5-85c1-39a83854f472 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] DELETE failed (client error): The resource could not be found. May 12 15:37:51.722177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-18284428-bfc9-47f5-85c1-39a83854f472 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:51.723886 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-18284428-bfc9-47f5-85c1-39a83854f472 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/65927801-6b63-4764-8bc6-a8a23de8dd9d HTTP/1.1" status: 404 len: 337 time: 0.1080337 May 12 15:37:51.732643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60602) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:51.844370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d18179e1-d1d3-4448-8ad6-5ba694f0f150 None None] Pushing event updated for resources: {'Port': ['ID=4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:51.873495 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2457e15e-83be-4bc7-9adf-fa9963ef87bb tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "GET /v2.0/ports?device_id=60580275-20ad-4639-8312-7bcc830b26ff HTTP/1.1" status: 200 len: 205 time: 0.1397836 May 12 15:37:51.882817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60608) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:51.958564 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-21f96cf9-38a1-42c2-b107-c747b24ec082 req-7d737307-bfe1-4800-a282-43fa401481ba tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:52.076937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d737307-bfe1-4800-a282-43fa401481ba tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event deleted for resources: {'Port': ['ID=e8a30607-8978-4b85-b35b-a3fe9bdb626c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:52.096331 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-d45a3c19-b8cb-4bbc-81d9-aecfee221439 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] delete failed (client error): The resource could not be found. May 12 15:37:52.097833 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d45a3c19-b8cb-4bbc-81d9-aecfee221439 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/routers/60580275-20ad-4639-8312-7bcc830b26ff HTTP/1.1" status: 404 len: 336 time: 0.2125273 May 12 15:37:52.121614 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:52.135706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60624) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:52.140946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-21f96cf9-38a1-42c2-b107-c747b24ec082 req-7d737307-bfe1-4800-a282-43fa401481ba tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] No DVR routers for this DVR port e8a30607-8978-4b85-b35b-a3fe9bdb626c on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:37:52.197673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object d6050a60-ec12-410a-9b8f-d376863839fd will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:37:52.213219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60630) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:52.258084 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-21f96cf9-38a1-42c2-b107-c747b24ec082 req-7d737307-bfe1-4800-a282-43fa401481ba tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:52.292958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'db0e9b9b-6db8-4cb6-9388-31519382fa96', 'name': 'network-vif-deleted', 'tag': 'e8a30607-8978-4b85-b35b-a3fe9bdb626c'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:37:52.322314 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-21f96cf9-38a1-42c2-b107-c747b24ec082 req-7d737307-bfe1-4800-a282-43fa401481ba tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.76 "DELETE /v2.0/ports/e8a30607-8978-4b85-b35b-a3fe9bdb626c HTTP/1.1" status: 204 len: 173 time: 2.1482561 May 12 15:37:52.332412 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-c7ee508e-8b47-43b5-a2cf-3b5f5892735a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] DELETE failed (client error): The resource could not be found. May 12 15:37:52.333072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c7ee508e-8b47-43b5-a2cf-3b5f5892735a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:52.339467 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c7ee508e-8b47-43b5-a2cf-3b5f5892735a tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/d8ab4bea-a7c3-41b5-8960-868b53fb898a HTTP/1.1" status: 404 len: 337 time: 0.1990535 May 12 15:37:52.340401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60638) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:52.384691 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25d6a9db-ee10-4979-aaee-8bf98fde978c req-d62f5993-631b-4f4c-90a1-5a5d54e06d41 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=db0e9b9b-6db8-4cb6-9388-31519382fa96 HTTP/1.1" status: 200 len: 210 time: 0.1385155 May 12 15:37:52.397602 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-54cf7127-efb1-4c9a-94b6-aee03d0787a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] DELETE failed (client error): The resource could not be found. May 12 15:37:52.398814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-54cf7127-efb1-4c9a-94b6-aee03d0787a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:52.403617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60642) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:52.404042 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-54cf7127-efb1-4c9a-94b6-aee03d0787a2 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/25edc5b2-cce0-4f70-ac76-0af56ca5b570 HTTP/1.1" status: 404 len: 337 time: 0.0599067 May 12 15:37:52.409091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ceb01ae-9f30-4b56-8958-23292147a5b1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:52.412553 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ceb01ae-9f30-4b56-8958-23292147a5b1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:52.419366 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ceb01ae-9f30-4b56-8958-23292147a5b1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/floatingips/20770190-a935-44e3-8b22-f2f7a5b501ea HTTP/1.1" status: 204 len: 168 time: 3.5682969 May 12 15:37:52.420281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60646) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:52.426689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '3fcda3cf-cc90-44c3-8595-0c2d95cbda90'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:52.437663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:52.462015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:floatingip and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:52.479612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:52.496708 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:52.499121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:52.556889 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4b8e8929-f382-4f33-82b1-cd8fa96dba60'] response: {'server_uuid': 'db0e9b9b-6db8-4cb6-9388-31519382fa96', 'name': 'network-vif-deleted', 'tag': 'e8a30607-8978-4b85-b35b-a3fe9bdb626c', 'status': 'completed', 'code': 200} May 12 15:37:52.572367 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:52.666144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3446792-1a8a-402d-b49f-8ea7e8878d63 None None] Network 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:52.698538 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-df833a2c-9f34-4c69-a4c0-e3fc37ffd3bc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] DELETE failed (client error): The resource could not be found. May 12 15:37:52.700042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-df833a2c-9f34-4c69-a4c0-e3fc37ffd3bc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:52.705604 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-df833a2c-9f34-4c69-a4c0-e3fc37ffd3bc tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/82849bea-971a-4272-8f77-327862d7f6e7 HTTP/1.1" status: 404 len: 337 time: 0.2980649 May 12 15:37:52.716291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60658) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:52.769606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e8a30607-8978-4b85-b35b-a3fe9bdb626c no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:37:52.905222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: e8a30607-8978-4b85-b35b-a3fe9bdb626c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:37:52.905586 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e8a30607-8978-4b85-b35b-a3fe9bdb626c not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:37:52.917369 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:52.941819 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:37:52.958717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:52.959773 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-34e63a74-03ab-434f-864c-af0a7d1b009e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] DELETE failed (client error): The resource could not be found. May 12 15:37:52.960231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-34e63a74-03ab-434f-864c-af0a7d1b009e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:52.961926 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-34e63a74-03ab-434f-864c-af0a7d1b009e tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/a7413f9d-9e4e-4483-888f-bb0f191030be HTTP/1.1" status: 404 len: 333 time: 0.2340310 May 12 15:37:52.964946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=d6050a60-ec12-410a-9b8f-d376863839fd,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:52.967929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:52.971500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60666) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:52.990076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:52.997529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:53.010230 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:53.017161 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-58327504-4063-4fb8-9cf1-0f66436680d2 None None] Provisioning complete for port ce4fa33a-3f1f-4337-b016-94fd30cba869 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:53.017554 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-58327504-4063-4fb8-9cf1-0f66436680d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:53.204035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-58327504-4063-4fb8-9cf1-0f66436680d2 None None] Provisioning complete for port d3738296-e321-4a38-bb44-3803dd75076e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:53.204408 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-58327504-4063-4fb8-9cf1-0f66436680d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:53.227165 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-62377022-b8ff-4c77-9cb1-999390dd143c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] DELETE failed (client error): The resource could not be found. May 12 15:37:53.227876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-62377022-b8ff-4c77-9cb1-999390dd143c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:53.233729 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-62377022-b8ff-4c77-9cb1-999390dd143c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/f8eb29b5-ee06-488d-b4b5-2ba586595399 HTTP/1.1" status: 404 len: 337 time: 0.2609634 May 12 15:37:53.247056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60678) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:53.278809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-108487b1-b09c-4c5b-a8bd-256bee625e3f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 4.2776954 May 12 15:37:53.281991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60682) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:53.390699 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.25.8.74 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/e82b27bb-6b3a-49fa-965f-eb51f26a0d2c) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:37:53.390891 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-58327504-4063-4fb8-9cf1-0f66436680d2 None None] Port d3738296-e321-4a38-bb44-3803dd75076e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:37:53.393784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f03f9e17-12f9-47fd-80cc-1d756844e15f None None] DHCP port deletion for 66bc0e1c-8b39-4a42-b061-fe805d2bcf80 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:37:53.408692 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-3eeedddf-fc3f-4a0a-9de4-4977bf6d0bb0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] DELETE failed (client error): The resource could not be found. May 12 15:37:53.408900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f03f9e17-12f9-47fd-80cc-1d756844e15f None None] Deleting port ce4fa33a-3f1f-4337-b016-94fd30cba869 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:53.409141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3eeedddf-fc3f-4a0a-9de4-4977bf6d0bb0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:53.409258 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f03f9e17-12f9-47fd-80cc-1d756844e15f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:53.484000 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3eeedddf-fc3f-4a0a-9de4-4977bf6d0bb0 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/af0eee84-aac4-44e7-8824-006c212bfed1 HTTP/1.1" status: 404 len: 337 time: 0.2358701 May 12 15:37:53.489022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60688) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:53.565697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60692) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:53.606259 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-8fac5d9b-512d-40a2-86fd-a608c1f79678 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] DELETE failed (client error): The resource could not be found. May 12 15:37:53.609994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8fac5d9b-512d-40a2-86fd-a608c1f79678 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:53.611735 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8fac5d9b-512d-40a2-86fd-a608c1f79678 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/b9d629f9-7151-4eaa-86b8-4c4c7492ff9d HTTP/1.1" status: 404 len: 333 time: 0.1217697 May 12 15:37:53.616639 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60698) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:53.621569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60700) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:53.736179 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-b40b4f49-008a-4c9e-80da-045a8bc8c13f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] DELETE failed (client error): The resource could not be found. May 12 15:37:53.736798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b40b4f49-008a-4c9e-80da-045a8bc8c13f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:53.738628 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b40b4f49-008a-4c9e-80da-045a8bc8c13f tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/dc158c92-b192-4251-9d8b-e538db2c3e57 HTTP/1.1" status: 404 len: 337 time: 0.1161454 May 12 15:37:53.743177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60710) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:53.837235 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-f8fe4a5f-6b8b-4092-b5fb-61975eda8932 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] DELETE failed (client error): The resource could not be found. May 12 15:37:53.844281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f8fe4a5f-6b8b-4092-b5fb-61975eda8932 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:37:53.848278 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f8fe4a5f-6b8b-4092-b5fb-61975eda8932 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/subnets/c516f5d6-eb7f-49bd-b1af-9e2defbd2f64 HTTP/1.1" status: 404 len: 337 time: 0.1016262 May 12 15:37:53.850629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60714) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:53.867612 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f03f9e17-12f9-47fd-80cc-1d756844e15f None None] For port ce4fa33a-3f1f-4337-b016-94fd30cba869, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce4fa33a-3f1f-4337-b016-94fd30cba869,segment=NetworkSegment(351c4dc8-5404-4259-bed5-cd4008dea28b),segment_id=351c4dc8-5404-4259-bed5-cd4008dea28b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:53.868287 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f03f9e17-12f9-47fd-80cc-1d756844e15f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:53.925863 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-810983ec-a4ee-41d7-97d4-912f3edbf58a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:53.969357 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:53.979610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-810983ec-a4ee-41d7-97d4-912f3edbf58a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:53.995739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-810983ec-a4ee-41d7-97d4-912f3edbf58a admin admin] Usage tracker for resource:security_group_rule and tenant:d96a8c81ae574acd9b36124d89d879dd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:54.000897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-810983ec-a4ee-41d7-97d4-912f3edbf58a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:54.011290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f03f9e17-12f9-47fd-80cc-1d756844e15f None None] Calling delete_port for ce4fa33a-3f1f-4337-b016-94fd30cba869 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:54.015890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-24654bec-73cb-4ac3-828d-3c6043674fb5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Deleting port d3738296-e321-4a38-bb44-3803dd75076e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:54.016227 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24654bec-73cb-4ac3-828d-3c6043674fb5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:54.068670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-810983ec-a4ee-41d7-97d4-912f3edbf58a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:54.101959 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f03f9e17-12f9-47fd-80cc-1d756844e15f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:54.190587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f03f9e17-12f9-47fd-80cc-1d756844e15f None None] Pushing event deleted for resources: {'Port': ['ID=ce4fa33a-3f1f-4337-b016-94fd30cba869,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:54.193539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7ca18b01-88f0-4f65-900c-cd6de76b43ff None None] Provisioning for port 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:54.204006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f03f9e17-12f9-47fd-80cc-1d756844e15f None None] No DVR routers for this DVR port ce4fa33a-3f1f-4337-b016-94fd30cba869 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:37:54.417360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b6070e8-e224-4db8-9572-0764294479bb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:54.424546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b6070e8-e224-4db8-9572-0764294479bb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:54.425736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9b6070e8-e224-4db8-9572-0764294479bb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:37:54.447196 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:54.490932 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:54.555775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-47852d64-540d-405f-b85d-c9cff984c863 None None] Provisioning for port d6050a60-ec12-410a-9b8f-d376863839fd completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:54.556459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9b6070e8-e224-4db8-9572-0764294479bb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:37:54.564757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9b6070e8-e224-4db8-9572-0764294479bb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1702 time: 1.2758274 May 12 15:37:54.571107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-47852d64-540d-405f-b85d-c9cff984c863 None None] Provisioning complete for port d6050a60-ec12-410a-9b8f-d376863839fd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:54.571107 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-47852d64-540d-405f-b85d-c9cff984c863 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:54.588219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60728) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:54.621736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:54.631433 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-47852d64-540d-405f-b85d-c9cff984c863 None None] Port d6050a60-ec12-410a-9b8f-d376863839fd cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:37:54.637370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:54.651809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:37:54.661983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:37:54.669178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:54.669908 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:54.709423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=e82b27bb-6b3a-49fa-965f-eb51f26a0d2c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:54.727284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-44bf758a-3208-42b1-b579-4aa9644bc0e8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port d6050a60-ec12-410a-9b8f-d376863839fd {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:54.727808 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-44bf758a-3208-42b1-b579-4aa9644bc0e8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:54.740352 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24654bec-73cb-4ac3-828d-3c6043674fb5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:54.748704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:54.749040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:54.749367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:54.749712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:54.750039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:54.750338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:54.750679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:54.750960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:54.751269 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:54.751586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:54.751980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:54.752330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:37:54.800660 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:54.870459 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:54.882476 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:54.921925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-24654bec-73cb-4ac3-828d-3c6043674fb5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Calling delete_port for d3738296-e321-4a38-bb44-3803dd75076e owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:54.965705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:54.971018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ce4fa33a-3f1f-4337-b016-94fd30cba869 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:37:54.982943 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-810983ec-a4ee-41d7-97d4-912f3edbf58a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.014297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: ce4fa33a-3f1f-4337-b016-94fd30cba869 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:37:55.014636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ce4fa33a-3f1f-4337-b016-94fd30cba869 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:37:55.023758 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-810983ec-a4ee-41d7-97d4-912f3edbf58a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.161639 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-810983ec-a4ee-41d7-97d4-912f3edbf58a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d96a8c81ae574acd9b36124d89d879dd&name=default HTTP/1.1" status: 200 len: 2983 time: 1.5930731 May 12 15:37:55.168210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-810983ec-a4ee-41d7-97d4-912f3edbf58a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d6ef3d6c-5257-429d-a3cf-497056d7fbf3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:55.183111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60740) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:55.205980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24654bec-73cb-4ac3-828d-3c6043674fb5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.282416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24654bec-73cb-4ac3-828d-3c6043674fb5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Port': ['ID=d3738296-e321-4a38-bb44-3803dd75076e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:55.288405 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-24654bec-73cb-4ac3-828d-3c6043674fb5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.382814 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-44bf758a-3208-42b1-b579-4aa9644bc0e8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.403190 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-24654bec-73cb-4ac3-828d-3c6043674fb5 tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/ports/d3738296-e321-4a38-bb44-3803dd75076e HTTP/1.1" status: 204 len: 168 time: 1.5406716 May 12 15:37:55.404464 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dcf06b5-10b5-484b-aa85-c0cadd7d7210 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.462702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60746) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:55.510382 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-013c8e2d-ac2f-4be0-9033-bfd9f2430930 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.581062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-44bf758a-3208-42b1-b579-4aa9644bc0e8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for d6050a60-ec12-410a-9b8f-d376863839fd owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:55.643512 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-013c8e2d-ac2f-4be0-9033-bfd9f2430930 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.670230 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bef5163f-c8c3-4813-9473-17488ab32b7c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.867806 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-013c8e2d-ac2f-4be0-9033-bfd9f2430930 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.873710 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bef5163f-c8c3-4813-9473-17488ab32b7c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.914236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-013c8e2d-ac2f-4be0-9033-bfd9f2430930 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d6ef3d6c-5257-429d-a3cf-497056d7fbf3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:55.927646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-bef5163f-c8c3-4813-9473-17488ab32b7c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['66bc0e1c-8b39-4a42-b061-fe805d2bcf80']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:55.944683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-bef5163f-c8c3-4813-9473-17488ab32b7c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '351c4dc8-5404-4259-bed5-cd4008dea28b') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:55.945056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-bef5163f-c8c3-4813-9473-17488ab32b7c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '351c4dc8-5404-4259-bed5-cd4008dea28b') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:55.960559 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-013c8e2d-ac2f-4be0-9033-bfd9f2430930 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.964282 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-013c8e2d-ac2f-4be0-9033-bfd9f2430930 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d6ef3d6c-5257-429d-a3cf-497056d7fbf3 HTTP/1.1" status: 204 len: 168 time: 0.7793732 May 12 15:37:55.965161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bef5163f-c8c3-4813-9473-17488ab32b7c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.972315 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.991391 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bef5163f-c8c3-4813-9473-17488ab32b7c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:55.999847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bef5163f-c8c3-4813-9473-17488ab32b7c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Releasing vlan 576 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:37:56.000331 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bef5163f-c8c3-4813-9473-17488ab32b7c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: timer() May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:37:56.018548 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:37:56.243090 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff7ab677-7324-40fc-a556-35df1ee01450 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:56.303179 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bef5163f-c8c3-4813-9473-17488ab32b7c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:56.308046 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bef5163f-c8c3-4813-9473-17488ab32b7c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:56.350116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef5163f-c8c3-4813-9473-17488ab32b7c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] Pushing event deleted for resources: {'Network': ['ID=66bc0e1c-8b39-4a42-b061-fe805d2bcf80,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:56.356869 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-44bf758a-3208-42b1-b579-4aa9644bc0e8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:56.357595 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bef5163f-c8c3-4813-9473-17488ab32b7c tempest-PortsTestJSON-1271087672 tempest-PortsTestJSON-1271087672-project] 10.222.0.82 "DELETE /v2.0/networks/66bc0e1c-8b39-4a42-b061-fe805d2bcf80 HTTP/1.1" status: 204 len: 168 time: 0.8916907 May 12 15:37:56.363144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:56.439405 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44bf758a-3208-42b1-b579-4aa9644bc0e8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=d6050a60-ec12-410a-9b8f-d376863839fd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:56.512211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:37:56.547317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60774) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:56.636709 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-44bf758a-3208-42b1-b579-4aa9644bc0e8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:56.653410 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e43c4dc-0f30-4011-94b1-2f1e05517d57 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:56.676128 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:37:56.676661 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:56.791893 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:56.804229 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:56.860217 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5e43c4dc-0f30-4011-94b1-2f1e05517d57 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:56.862742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60780) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:56.864346 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-44bf758a-3208-42b1-b579-4aa9644bc0e8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/d6050a60-ec12-410a-9b8f-d376863839fd HTTP/1.1" status: 204 len: 168 time: 2.2709785 May 12 15:37:56.868274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60786) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:56.881807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5e43c4dc-0f30-4011-94b1-2f1e05517d57 admin admin] Usage tracker for resource:security_group_rule and tenant:c17fd6e8a9b449f1acd605f1baf7a50b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:56.892786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5e43c4dc-0f30-4011-94b1-2f1e05517d57 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:56.932253 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5e43c4dc-0f30-4011-94b1-2f1e05517d57 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:56.953838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-8dcf06b5-10b5-484b-aa85-c0cadd7d7210 admin admin] Deleting port 2cefb78b-eff7-47cb-8160-89f1ff42943b {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:56.957996 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dcf06b5-10b5-484b-aa85-c0cadd7d7210 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:57.051626 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:57.125904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=e82b27bb-6b3a-49fa-965f-eb51f26a0d2c,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:57.173408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e99409f2-ec96-428a-ac7a-cf515beffe24 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:57.175255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e99409f2-ec96-428a-ac7a-cf515beffe24 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:57.176751 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e99409f2-ec96-428a-ac7a-cf515beffe24 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1454 time: 0.2659848 May 12 15:37:57.181059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60798) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:57.217347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e7644e63-d10c-4e16-a51b-9bfccc3c044e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9bd6beec65cd47b3a0febdc05aaed724&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3513067 May 12 15:37:57.224600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60802) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:57.342744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-c8df07e1-ccff-4a06-95ef-3f89e1d8ed51 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 2d18170c-957c-43d3-a4dc-97efb6ef7afe {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:37:57.348734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c8df07e1-ccff-4a06-95ef-3f89e1d8ed51 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:57.364486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-8dcf06b5-10b5-484b-aa85-c0cadd7d7210 admin admin] For port 2cefb78b-eff7-47cb-8160-89f1ff42943b, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2cefb78b-eff7-47cb-8160-89f1ff42943b,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:57.364925 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dcf06b5-10b5-484b-aa85-c0cadd7d7210 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:57.379571 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Floating IP 869c4082-2869-4ecc-8258-04ded7ac1b72 associated. External IP: 172.25.8.74, port: 3fcda3cf-cc90-44c3-8595-0c2d95cbda90. May 12 15:37:57.489701 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c8df07e1-ccff-4a06-95ef-3f89e1d8ed51 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:57.550334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-8dcf06b5-10b5-484b-aa85-c0cadd7d7210 admin admin] Calling delete_port for 2cefb78b-eff7-47cb-8160-89f1ff42943b owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:57.597184 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e43c4dc-0f30-4011-94b1-2f1e05517d57 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:57.612029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ff7ab677-7324-40fc-a556-35df1ee01450 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Deleting port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:57.612368 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff7ab677-7324-40fc-a556-35df1ee01450 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:57.637813 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e43c4dc-0f30-4011-94b1-2f1e05517d57 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:57.727085 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f2451efe-ae8a-4d04-81c2-47efe0da6701 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:57.735954 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c8df07e1-ccff-4a06-95ef-3f89e1d8ed51 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:57.801366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e43c4dc-0f30-4011-94b1-2f1e05517d57 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f8013b3-f36d-415f-995e-5c157ed9b6db,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:57.809835 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5e43c4dc-0f30-4011-94b1-2f1e05517d57 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c17fd6e8a9b449f1acd605f1baf7a50b&name=default HTTP/1.1" status: 200 len: 2983 time: 1.2325230 May 12 15:37:57.816681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60814) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:57.957845 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c8df07e1-ccff-4a06-95ef-3f89e1d8ed51 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:57.963529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:37:58.008928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8df07e1-ccff-4a06-95ef-3f89e1d8ed51 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=2d18170c-957c-43d3-a4dc-97efb6ef7afe,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:58.016239 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c8df07e1-ccff-4a06-95ef-3f89e1d8ed51 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:58.027626 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55963fe2-e94f-40ee-9904-dd89accb387d None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:58.112854 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f2451efe-ae8a-4d04-81c2-47efe0da6701 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:58.402962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb167bd7-0989-45f9-a68b-b9ef54e22984 None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:37:58.410486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fb167bd7-0989-45f9-a68b-b9ef54e22984 None None] Deleting port 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:37:58.410891 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fb167bd7-0989-45f9-a68b-b9ef54e22984 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:58.425105 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57ca5efa-a555-4998-841f-491a3b91b2a2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:58.431590 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f2451efe-ae8a-4d04-81c2-47efe0da6701 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:58.448054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-ff7ab677-7324-40fc-a556-35df1ee01450 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] For port 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97,segment=NetworkSegment(464fcc74-09ac-4457-9f5a-e40ea4ef2c72),segment_id=464fcc74-09ac-4457-9f5a-e40ea4ef2c72)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:58.448438 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff7ab677-7324-40fc-a556-35df1ee01450 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:58.483644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2451efe-ae8a-4d04-81c2-47efe0da6701 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=24222ec9-624b-4965-b756-3fef3bd7e96b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:58.555554 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c8df07e1-ccff-4a06-95ef-3f89e1d8ed51 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/2d18170c-957c-43d3-a4dc-97efb6ef7afe HTTP/1.1" status: 204 len: 168 time: 1.3710544 May 12 15:37:58.560415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60830) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:58.630316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ff7ab677-7324-40fc-a556-35df1ee01450 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Calling delete_port for 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:58.634152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:37:58.651885 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-68df41f2-889c-4c92-9a86-ca0f0e6ef86b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0876846 May 12 15:37:58.652258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60834) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:58.652639 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4f2871a-9c2f-40e7-b982-e714aa42e21e None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:37:58.663502 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4f2871a-9c2f-40e7-b982-e714aa42e21e None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:58.664496 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f4f2871a-9c2f-40e7-b982-e714aa42e21e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:58.664646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:58.704461 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-fb167bd7-0989-45f9-a68b-b9ef54e22984 None None] For port 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:37:58.705035 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fb167bd7-0989-45f9-a68b-b9ef54e22984 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:58.733738 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f4f2871a-9c2f-40e7-b982-e714aa42e21e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:58.744689 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4f2871a-9c2f-40e7-b982-e714aa42e21e None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:37:58.745884 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f4f2871a-9c2f-40e7-b982-e714aa42e21e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:58.760548 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:58.823927 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f4f2871a-9c2f-40e7-b982-e714aa42e21e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:37:58.824791 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4f2871a-9c2f-40e7-b982-e714aa42e21e None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:37:58.830105 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57ca5efa-a555-4998-841f-491a3b91b2a2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:58.848925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:58.854639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:58.858367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:58.865015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:58.875616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fb167bd7-0989-45f9-a68b-b9ef54e22984 None None] Calling delete_port for 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:37:58.885897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f2451efe-ae8a-4d04-81c2-47efe0da6701 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:58.892160 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d600f507-8a85-4e01-b331-7d33c32e804d tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 983 time: 6.4651561 May 12 15:37:58.892313 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f2451efe-ae8a-4d04-81c2-47efe0da6701 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/24222ec9-624b-4965-b756-3fef3bd7e96b HTTP/1.1" status: 204 len: 168 time: 1.6613717 May 12 15:37:58.892398 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:58.892398 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:58.902508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60838) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:59.015449 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fb167bd7-0989-45f9-a68b-b9ef54e22984 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:59.055555 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dcf06b5-10b5-484b-aa85-c0cadd7d7210 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:59.094834 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb167bd7-0989-45f9-a68b-b9ef54e22984 None None] Pushing event deleted for resources: {'Port': ['ID=4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:59.111704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb167bd7-0989-45f9-a68b-b9ef54e22984 None None] No DVR routers for this DVR port 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:37:59.137475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dcf06b5-10b5-484b-aa85-c0cadd7d7210 admin admin] Pushing event deleted for resources: {'Port': ['ID=2cefb78b-eff7-47cb-8160-89f1ff42943b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:59.279330 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8b59f968-243e-4fb0-93dc-db3ec1931c67 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "GET /v2.0/floatingips/869c4082-2869-4ecc-8258-04ded7ac1b72 HTTP/1.1" status: 200 len: 978 time: 0.3732402 May 12 15:37:59.280507 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57ca5efa-a555-4998-841f-491a3b91b2a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:59.286554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60850) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:59.374662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.objects.ports [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88151) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:37:59.376571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:59.474731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57ca5efa-a555-4998-841f-491a3b91b2a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f8013b3-f36d-415f-995e-5c157ed9b6db,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:59.496045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=6019c6f6-1dfd-4bef-805a-b36f2fe9672a,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:37:59.514058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:37:59.515436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:37:59.518571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:37:59.519152 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:59.536324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c29749f-8d30-4eb2-9fa5-416d041a8d13 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:37:59.569713 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f5afca36-ad32-4763-b6cd-440072975fa5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 0.9158044 May 12 15:37:59.572365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60864) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:59.579123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'mac_address': 'fa:16:3e:4d:65:36', 'name': 'tempest-NetworksTestDHCPv6-299895077'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:59.726906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dcf06b5-10b5-484b-aa85-c0cadd7d7210 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:59.741664 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57ca5efa-a555-4998-841f-491a3b91b2a2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:37:59.746018 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-57ca5efa-a555-4998-841f-491a3b91b2a2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1f8013b3-f36d-415f-995e-5c157ed9b6db HTTP/1.1" status: 204 len: 168 time: 1.9143384 May 12 15:37:59.775963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:37:59.788191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:port and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:37:59.796855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:37:59.813060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:37:59.839845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:37:59.849436 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fcbf6e42-3819-4cde-89c8-3f01fed757db tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 981 time: 0.4735403 May 12 15:37:59.867455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60878) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:37:59.890961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-345d600e-e744-44e2-869f-d7abf3eff900 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'floatingip': {'port_id': '8ac3db5f-3324-4a02-a6e5-504a9ea69fc2'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:37:59.967639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '6019c6f6-1dfd-4bef-805a-b36f2fe9672a'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:37:59.968536 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:00.094489 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-345d600e-e744-44e2-869f-d7abf3eff900 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:00.196090 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff7ab677-7324-40fc-a556-35df1ee01450 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:00.219197 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:00.322107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port df9a414a-4889-4953-b467-9aa00a9ae792 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:38:00.322219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Allocated IP 2001:db8::f816:3eff:fee0:5e30 (2447b094-d5d6-41ef-a146-2bf56f5399af/6019c6f6-1dfd-4bef-805a-b36f2fe9672a/6473c239-4312-4ac0-8a4d-75ae094ab4bc) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:00.565067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:38:00.621636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60904) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:00.672067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff7ab677-7324-40fc-a556-35df1ee01450 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event deleted for resources: {'Port': ['ID=4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:00.895903 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:00.926346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Transition to ACTIVE for port object 6473c239-4312-4ac0-8a4d-75ae094ab4bc will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:00.977698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Transition to ACTIVE for port object 6473c239-4312-4ac0-8a4d-75ae094ab4bc will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:01.021910 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:01.054178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:38:01.055069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4f5d6a7b-43b0-4192-9ac5-c5faf6a8d214 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:38:01.110996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::f816:3eff:fe4d:6536 (2447b094-d5d6-41ef-a146-2bf56f5399af/6019c6f6-1dfd-4bef-805a-b36f2fe9672a/df9a414a-4889-4953-b467-9aa00a9ae792) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:01.146311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d2a1e8df-bf6d-4e65-bf28-0478f7a9cab2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Request body: {'router': {'name': 'tempest-RoutersNegativeIpV6Test-router-667494349', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:01.194332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Pushing event updated for resources: {'Port': ['ID=6473c239-4312-4ac0-8a4d-75ae094ab4bc,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:01.202482 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:01.203666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:01.207013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:01.269744 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff7ab677-7324-40fc-a556-35df1ee01450 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:01.280994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d2a1e8df-bf6d-4e65-bf28-0478f7a9cab2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:01.284938 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d2a1e8df-bf6d-4e65-bf28-0478f7a9cab2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Usage tracker for resource:router and tenant:7fab164333c84a019a5a0e9436b3a8df is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:01.288315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d2a1e8df-bf6d-4e65-bf28-0478f7a9cab2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:01.296130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d2a1e8df-bf6d-4e65-bf28-0478f7a9cab2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:01.338772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Attempting to bind port 6473c239-4312-4ac0-8a4d-75ae094ab4bc on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:38:01.338772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Attempting to bind port 6473c239-4312-4ac0-8a4d-75ae094ab4bc by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:38:01.338772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Attempting to bind port 6473c239-4312-4ac0-8a4d-75ae094ab4bc on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:38:01.338772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 37, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:38:01.338772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:38:01.338772 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:01.338772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:38:01.339738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Bound port: 6473c239-4312-4ac0-8a4d-75ae094ab4bc, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:38:01.339836 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:01.454965 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d2a1e8df-bf6d-4e65-bf28-0478f7a9cab2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:01.456385 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d2a1e8df-bf6d-4e65-bf28-0478f7a9cab2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:01.532757 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:01.549100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] For port 6473c239-4312-4ac0-8a4d-75ae094ab4bc, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:38:01.557660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] For port 6473c239-4312-4ac0-8a4d-75ae094ab4bc, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6473c239-4312-4ac0-8a4d-75ae094ab4bc,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:38:01.569786 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:01.607323 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8dcf06b5-10b5-484b-aa85-c0cadd7d7210 admin admin] Router 3b0baf01-29b6-49bc-81af-4ed638af06f3 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:38:01.620857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object df9a414a-4889-4953-b467-9aa00a9ae792 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:01.657203 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d2a1e8df-bf6d-4e65-bf28-0478f7a9cab2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:01.692488 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:01.738962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5a5ea9b-0efa-40ae-a20d-21e2b77d598b None None] Pushing event updated for resources: {'Port': ['ID=6473c239-4312-4ac0-8a4d-75ae094ab4bc,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:01.811643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=df9a414a-4889-4953-b467-9aa00a9ae792,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:01.835116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:01.844509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:01.848235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:01.859016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:01.861351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:01.972627 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d2a1e8df-bf6d-4e65-bf28-0478f7a9cab2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:02.051128 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-54912849-5fad-4c5c-990b-ab639414fc40 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 2.4773643 May 12 15:38:02.055538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60938) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:02.155304 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-345d600e-e744-44e2-869f-d7abf3eff900 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:02.163346 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d2a1e8df-bf6d-4e65-bf28-0478f7a9cab2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:02.167404 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d2a1e8df-bf6d-4e65-bf28-0478f7a9cab2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 711 time: 1.5412736 May 12 15:38:02.170384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60944) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:02.189475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ff7ab677-7324-40fc-a556-35df1ee01450 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Router 758b50f3-4f3d-446e-b73c-bb447a30f408 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:38:02.193564 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-345d600e-e744-44e2-869f-d7abf3eff900 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:02.193781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-1119195513'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:02.199259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8dcf06b5-10b5-484b-aa85-c0cadd7d7210 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:38:02.211142 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51859e92-6cef-4ff0-ba37-2b1594ad3737 None None] Sync routers for ids ['3b0baf01-29b6-49bc-81af-4ed638af06f3'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:38:02.230931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:02.231769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51859e92-6cef-4ff0-ba37-2b1594ad3737 None None] Routers {'3b0baf01-29b6-49bc-81af-4ed638af06f3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:02.232401 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-51859e92-6cef-4ff0-ba37-2b1594ad3737 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b0baf01-29b6-49bc-81af-4ed638af06f3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:02.244065 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8dcf06b5-10b5-484b-aa85-c0cadd7d7210 admin admin] 10.222.0.82 "PUT /v2.0/routers/3b0baf01-29b6-49bc-81af-4ed638af06f3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 10.0274625 May 12 15:38:02.245679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60954) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:02.247266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Usage tracker for resource:network and tenant:7fab164333c84a019a5a0e9436b3a8df is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:02.253458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:02.405143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:02.534804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f4dadb3-483d-4367-bf8c-13c6e7e63910 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:02.548250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f4dadb3-483d-4367-bf8c-13c6e7e63910 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:02.550020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4f4dadb3-483d-4367-bf8c-13c6e7e63910 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:02.630679 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:02.631202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4f4dadb3-483d-4367-bf8c-13c6e7e63910 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:02.631202 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4f4dadb3-483d-4367-bf8c-13c6e7e63910 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1702 time: 0.5728669 May 12 15:38:02.639195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 60964) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:02.657929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6473c239-4312-4ac0-8a4d-75ae094ab4bc up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:02.729238 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-345d600e-e744-44e2-869f-d7abf3eff900 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Floating IP 869c4082-2869-4ecc-8258-04ded7ac1b72 associated. External IP: 172.25.8.74, port: 3fcda3cf-cc90-44c3-8595-0c2d95cbda90. May 12 15:38:02.856337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Made reservation on behalf of 7fab164333c84a019a5a0e9436b3a8df for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:02.860829 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:02.892223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-51859e92-6cef-4ff0-ba37-2b1594ad3737 None None] Set router 3b0baf01-29b6-49bc-81af-4ed638af06f3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:38:02.904289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-78b14180-94ec-4f1c-992b-36a69290b622 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port df9a414a-4889-4953-b467-9aa00a9ae792 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:02.904920 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-78b14180-94ec-4f1c-992b-36a69290b622 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:03.022476 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:03.033221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff7ab677-7324-40fc-a556-35df1ee01450 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:38:03.044543 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ee42280-eac3-4def-84bc-fe32e6422e6a None None] Sync routers for ids ['758b50f3-4f3d-446e-b73c-bb447a30f408'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:38:03.060993 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ff7ab677-7324-40fc-a556-35df1ee01450 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "PUT /v2.0/routers/758b50f3-4f3d-446e-b73c-bb447a30f408/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 9.4410777 May 12 15:38:03.063515 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ee42280-eac3-4def-84bc-fe32e6422e6a None None] Routers {'758b50f3-4f3d-446e-b73c-bb447a30f408'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:03.065422 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6ee42280-eac3-4def-84bc-fe32e6422e6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['758b50f3-4f3d-446e-b73c-bb447a30f408'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:03.066731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 60978) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:03.113097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:03.142856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Usage tracker for resource:security_group_rule and tenant:7fab164333c84a019a5a0e9436b3a8df is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:03.170985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:03.218272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:03.246066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:03.497820 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6ee42280-eac3-4def-84bc-fe32e6422e6a None None] Set router 758b50f3-4f3d-446e-b73c-bb447a30f408 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:38:03.781565 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-78b14180-94ec-4f1c-992b-36a69290b622 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:03.800789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-80e062c6-7917-44f9-9b4f-86a24ce2305e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Deleting subnet 399a8fa1-6ad4-4b22-9cc2-119b29f1931e {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:38:03.804630 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80e062c6-7917-44f9-9b4f-86a24ce2305e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:03.841217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 6473c239-4312-4ac0-8a4d-75ae094ab4bc completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:03.845822 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a2711880-eaa7-4b69-906c-30968e3f5cff None None] Provisioning for port 6473c239-4312-4ac0-8a4d-75ae094ab4bc completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:03.855059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 6473c239-4312-4ac0-8a4d-75ae094ab4bc triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:03.855685 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:03.868174 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80e062c6-7917-44f9-9b4f-86a24ce2305e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:03.922359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a2711880-eaa7-4b69-906c-30968e3f5cff None None] Provisioning complete for port 6473c239-4312-4ac0-8a4d-75ae094ab4bc triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:03.922722 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a2711880-eaa7-4b69-906c-30968e3f5cff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:03.932445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-78b14180-94ec-4f1c-992b-36a69290b622 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for df9a414a-4889-4953-b467-9aa00a9ae792 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:04.010510 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80e062c6-7917-44f9-9b4f-86a24ce2305e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:04.124843 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6ee42280-eac3-4def-84bc-fe32e6422e6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1084701644', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104'}], 'enable_snat': True}, 'gw_port_id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:57Z', 'updated_at': '2022-05-12T15:37:59Z', 'revision_number': 5, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:8a:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2887, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:36:59Z', 'updated_at': '2022-05-12T15:37:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:04.135168 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ee42280-eac3-4def-84bc-fe32e6422e6a None None] Checking router: 758b50f3-4f3d-446e-b73c-bb447a30f408 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:38:04.156019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-51859e92-6cef-4ff0-ba37-2b1594ad3737 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148'}], 'enable_snat': True}, 'gw_port_id': '96d50894-0a98-4aff-9097-44452345b862', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:37:58Z', 'revision_number': 5, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port': {'id': '96d50894-0a98-4aff-9097-44452345b862', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2471, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:32:05Z', 'updated_at': '2022-05-12T15:32:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:04.159365 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ee42280-eac3-4def-84bc-fe32e6422e6a None None] Routers {'758b50f3-4f3d-446e-b73c-bb447a30f408'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:04.160709 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6ee42280-eac3-4def-84bc-fe32e6422e6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['758b50f3-4f3d-446e-b73c-bb447a30f408'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:04.165540 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-78b14180-94ec-4f1c-992b-36a69290b622 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:04.169075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51859e92-6cef-4ff0-ba37-2b1594ad3737 None None] Checking router: 3b0baf01-29b6-49bc-81af-4ed638af06f3 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:38:04.200643 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:04.205503 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80e062c6-7917-44f9-9b4f-86a24ce2305e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:04.294286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80e062c6-7917-44f9-9b4f-86a24ce2305e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event deleted for resources: {'Subnet': ['ID=399a8fa1-6ad4-4b22-9cc2-119b29f1931e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:04.305576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78b14180-94ec-4f1c-992b-36a69290b622 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=df9a414a-4889-4953-b467-9aa00a9ae792,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:04.312345 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80e062c6-7917-44f9-9b4f-86a24ce2305e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:04.338279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Deleting port 96d50894-0a98-4aff-9097-44452345b862 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:04.340297 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:04.349009 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a2711880-eaa7-4b69-906c-30968e3f5cff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:04.412417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-80e062c6-7917-44f9-9b4f-86a24ce2305e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "DELETE /v2.0/subnets/399a8fa1-6ad4-4b22-9cc2-119b29f1931e HTTP/1.1" status: 204 len: 168 time: 1.3446355 May 12 15:38:04.424244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bfbdbe76-c87d-423a-ba3a-0a4142c607dd None None] Network 2edf0bcd-3aed-4d20-90f8-59e368722fde requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:04.432102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32770) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:04.461951 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-78b14180-94ec-4f1c-992b-36a69290b622 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:04.559548 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-78b14180-94ec-4f1c-992b-36a69290b622 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/df9a414a-4889-4953-b467-9aa00a9ae792 HTTP/1.1" status: 204 len: 168 time: 1.9192712 May 12 15:38:04.563974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32776) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:04.643850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-345d600e-e744-44e2-869f-d7abf3eff900 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:38:04.648392 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51859e92-6cef-4ff0-ba37-2b1594ad3737 None None] Routers {'3b0baf01-29b6-49bc-81af-4ed638af06f3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:04.649115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-51859e92-6cef-4ff0-ba37-2b1594ad3737 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b0baf01-29b6-49bc-81af-4ed638af06f3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:04.676170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea49181a-1366-4384-a097-3198dc564411 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:04.678182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea49181a-1366-4384-a097-3198dc564411 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:04.679098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ea49181a-1366-4384-a097-3198dc564411 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:04.748278 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:04.821135 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6ee42280-eac3-4def-84bc-fe32e6422e6a None None] Set router 758b50f3-4f3d-446e-b73c-bb447a30f408 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:38:04.985942 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:05.000504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ea49181a-1366-4384-a097-3198dc564411 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:05.002129 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ea49181a-1366-4384-a097-3198dc564411 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1465 time: 0.4365351 May 12 15:38:05.008970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-51859e92-6cef-4ff0-ba37-2b1594ad3737 None None] Set router 3b0baf01-29b6-49bc-81af-4ed638af06f3 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:38:05.020265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32788) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:05.068711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] For port 96d50894-0a98-4aff-9097-44452345b862, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=96d50894-0a98-4aff-9097-44452345b862,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:05.069605 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:05.181113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-51859e92-6cef-4ff0-ba37-2b1594ad3737 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:38:04Z', 'revision_number': 6, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:05.215479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-345d600e-e744-44e2-869f-d7abf3eff900 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:38:05.230576 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a2711880-eaa7-4b69-906c-30968e3f5cff None None] For port 6473c239-4312-4ac0-8a4d-75ae094ab4bc, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6473c239-4312-4ac0-8a4d-75ae094ab4bc,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:05.251216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e61acd18-ed71-425b-92d9-c70cfc746595 None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:38:05.251414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Calling delete_port for 96d50894-0a98-4aff-9097-44452345b862 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:05.255421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-fd22bf83-5a91-4c7a-a812-dcb324d6a817 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 6019c6f6-1dfd-4bef-805a-b36f2fe9672a {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:38:05.389985 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a2711880-eaa7-4b69-906c-30968e3f5cff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:05.391908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51859e92-6cef-4ff0-ba37-2b1594ad3737 None None] The sync data for ids ['3b0baf01-29b6-49bc-81af-4ed638af06f3'] in n-d-841483-1 is: [{'id': '3b0baf01-29b6-49bc-81af-4ed638af06f3', 'name': 'tempest-ServerRescueNegativeTestJSON-437125850-router', 'tenant_id': 'ed8d9bf58283443480f0c62e72d53449', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:32:03Z', 'updated_at': '2022-05-12T15:38:04Z', 'revision_number': 6, 'project_id': 'ed8d9bf58283443480f0c62e72d53449', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:38:05.404587 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd22bf83-5a91-4c7a-a812-dcb324d6a817 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:05.409700 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6ee42280-eac3-4def-84bc-fe32e6422e6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1084701644', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104'}], 'enable_snat': True}, 'gw_port_id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:57Z', 'updated_at': '2022-05-12T15:37:59Z', 'revision_number': 5, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:8a:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2887, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:36:59Z', 'updated_at': '2022-05-12T15:37:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:05.427257 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ee42280-eac3-4def-84bc-fe32e6422e6a None None] The sync data for ids ['758b50f3-4f3d-446e-b73c-bb447a30f408'] in n-d-841483-1 is: [{'id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1084701644', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104'}], 'enable_snat': True}, 'gw_port_id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:36:57Z', 'updated_at': '2022-05-12T15:37:59Z', 'revision_number': 5, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'fc86a368-e153-4a81-95d3-8aae87de7b1d', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:8a:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '758b50f3-4f3d-446e-b73c-bb447a30f408', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2887, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:36:59Z', 'updated_at': '2022-05-12T15:37:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:38:05.533508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2711880-eaa7-4b69-906c-30968e3f5cff None None] Pushing event updated for resources: {'Port': ['ID=6473c239-4312-4ac0-8a4d-75ae094ab4bc,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:05.555780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e61acd18-ed71-425b-92d9-c70cfc746595 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:05.556573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e61acd18-ed71-425b-92d9-c70cfc746595 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:05.628745 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd22bf83-5a91-4c7a-a812-dcb324d6a817 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:05.629798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8036f9c5-bc67-4932-a4b2-609921993821 None None] Could not find standard attr ID for object df9a414a-4889-4953-b467-9aa00a9ae792. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:38:05.648867 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e61acd18-ed71-425b-92d9-c70cfc746595 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:05.653289 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:38:05.653659 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:38:05.661627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e61acd18-ed71-425b-92d9-c70cfc746595 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:05.662231 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e61acd18-ed71-425b-92d9-c70cfc746595 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:05.701855 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:05.737147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e61acd18-ed71-425b-92d9-c70cfc746595 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:05.737570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e61acd18-ed71-425b-92d9-c70cfc746595 None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:38:05.822267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Pushing event deleted for resources: {'Port': ['ID=96d50894-0a98-4aff-9097-44452345b862,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:06.014372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:06.014713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:06.015041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:06.015370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:06.015694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:06.016043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:06.016515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:06.016839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:06.017162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:06.017496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:06.017812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:06.018125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:06.055526 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd22bf83-5a91-4c7a-a812-dcb324d6a817 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.118403 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eae2939c-7696-446d-b2e6-0834732b98f4 None None] DHCP port deletion for 2edf0bcd-3aed-4d20-90f8-59e368722fde request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:38:06.129450 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-eae2939c-7696-446d-b2e6-0834732b98f4 None None] Deleting port a658cb29-0413-4ee4-8a11-a438c0d47c79 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:06.129883 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eae2939c-7696-446d-b2e6-0834732b98f4 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.146086 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.170754 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.209885 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.238262 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.318518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 578} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:38:06.485242 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.485850 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Added segment 24ecba11-7e7a-4432-b001-7bb43e248572 of type vlan for network 9b7334d3-09cb-43ee-879c-8af2e3abb59f May 12 15:38:06.518564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.558185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Deleting port fc86a368-e153-4a81-95d3-8aae87de7b1d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:06.558533 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.608703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-eae2939c-7696-446d-b2e6-0834732b98f4 None None] For port a658cb29-0413-4ee4-8a11-a438c0d47c79, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a658cb29-0413-4ee4-8a11-a438c0d47c79,segment=NetworkSegment(464fcc74-09ac-4457-9f5a-e40ea4ef2c72),segment_id=464fcc74-09ac-4457-9f5a-e40ea4ef2c72)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:06.609132 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eae2939c-7696-446d-b2e6-0834732b98f4 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.625081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd22bf83-5a91-4c7a-a812-dcb324d6a817 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.696479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd22bf83-5a91-4c7a-a812-dcb324d6a817 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=6019c6f6-1dfd-4bef-805a-b36f2fe9672a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:06.698970 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd22bf83-5a91-4c7a-a812-dcb324d6a817 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.700635 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.712096 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.720906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event updated for resources: {'SecurityGroup': ['ID=206464a4-1b26-4ea4-aba6-7377d45edefb,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:06.722326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-345d600e-e744-44e2-869f-d7abf3eff900 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:38:06.765087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6473c239-4312-4ac0-8a4d-75ae094ab4bc up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:06.778492 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.784649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:06.785697 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.797235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19a0da9f-e0e3-4361-aff2-409d836f232e None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:06.835224 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:06.836010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3b0baf01-29b6-49bc-81af-4ed638af06f3 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:38:06.846079 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fd22bf83-5a91-4c7a-a812-dcb324d6a817 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/6019c6f6-1dfd-4bef-805a-b36f2fe9672a HTTP/1.1" status: 204 len: 168 time: 1.8247495 May 12 15:38:06.852514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32814) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:06.970753 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-26247faa-5ff0-4c71-bcd2-895ab5a26cf8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1170218 May 12 15:38:06.973235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32824) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:07.031076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-eae2939c-7696-446d-b2e6-0834732b98f4 None None] Calling delete_port for a658cb29-0413-4ee4-8a11-a438c0d47c79 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:07.090557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 4.9076512 May 12 15:38:07.098703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32830) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:07.209114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] For port fc86a368-e153-4a81-95d3-8aae87de7b1d, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fc86a368-e153-4a81-95d3-8aae87de7b1d,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:07.209912 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:07.245030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 6473c239-4312-4ac0-8a4d-75ae094ab4bc triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:07.245965 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:07.301659 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eae2939c-7696-446d-b2e6-0834732b98f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:07.309260 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:07.313069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f7ff8bcd-a688-4b8e-b9c9-5be45e60a098 admin admin] 10.222.0.82 "DELETE /v2.0/routers/3b0baf01-29b6-49bc-81af-4ed638af06f3 HTTP/1.1" status: 204 len: 168 time: 5.0624619 May 12 15:38:07.328941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-345d600e-e744-44e2-869f-d7abf3eff900 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:38:07.335200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32838) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:07.344005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Request body: {'subnet': {'network_id': '9b7334d3-09cb-43ee-879c-8af2e3abb59f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:07.345949 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee556816-a15a-4c25-977d-847f475bcdd5 None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:38:07.362346 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee556816-a15a-4c25-977d-847f475bcdd5 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:07.363819 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ee556816-a15a-4c25-977d-847f475bcdd5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:07.406129 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-345d600e-e744-44e2-869f-d7abf3eff900 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:07.413418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eeafe06-7f5a-4940-b1e9-fd0ab8f655a5 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event updated for resources: {'Network': ['ID=9b7334d3-09cb-43ee-879c-8af2e3abb59f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:07.415732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eae2939c-7696-446d-b2e6-0834732b98f4 None None] Pushing event deleted for resources: {'Port': ['ID=a658cb29-0413-4ee4-8a11-a438c0d47c79,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:07.427772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Calling delete_port for fc86a368-e153-4a81-95d3-8aae87de7b1d owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:07.467882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eae2939c-7696-446d-b2e6-0834732b98f4 None None] No DVR routers for this DVR port a658cb29-0413-4ee4-8a11-a438c0d47c79 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:38:07.543891 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ee556816-a15a-4c25-977d-847f475bcdd5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:07.553033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 9b7334d3-09cb-43ee-879c-8af2e3abb59f details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:38:07.558159 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee556816-a15a-4c25-977d-847f475bcdd5 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:07.558894 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ee556816-a15a-4c25-977d-847f475bcdd5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:07.674088 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d471fa4e-f3d7-4c6e-971a-0f7fb73370f4 None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:38:07.689488 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ee556816-a15a-4c25-977d-847f475bcdd5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:07.689488 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee556816-a15a-4c25-977d-847f475bcdd5 None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:38:07.755498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d471fa4e-f3d7-4c6e-971a-0f7fb73370f4 None None] Deleting port 6473c239-4312-4ac0-8a4d-75ae094ab4bc {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:07.756771 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d471fa4e-f3d7-4c6e-971a-0f7fb73370f4 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:07.777511 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:07.844205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-0525dad1-a8e7-43fe-8652-57efb20d914b admin admin] Deleting subnet aa771580-393c-41f8-ad67-611be21e45d3 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:38:07.850974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0525dad1-a8e7-43fe-8652-57efb20d914b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:07.872245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 96d50894-0a98-4aff-9097-44452345b862 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:38:07.879171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event deleted for resources: {'Port': ['ID=fc86a368-e153-4a81-95d3-8aae87de7b1d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:07.991698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 96d50894-0a98-4aff-9097-44452345b862 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:38:07.992059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 96d50894-0a98-4aff-9097-44452345b862 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:38:07.992411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:38:07.998896 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0525dad1-a8e7-43fe-8652-57efb20d914b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:08.016051 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:08.046087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:08.051987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:38:08.052286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4b875e15-3cd6-4f3e-bfb2-a9c8c37daf97 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:38:08.052888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a658cb29-0413-4ee4-8a11-a438c0d47c79 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:38:08.057503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Usage tracker for resource:subnet and tenant:7fab164333c84a019a5a0e9436b3a8df is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:08.095295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: a658cb29-0413-4ee4-8a11-a438c0d47c79 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:38:08.095641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a658cb29-0413-4ee4-8a11-a438c0d47c79 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:38:08.096048 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2cefb78b-eff7-47cb-8160-89f1ff42943b no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:38:08.097973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:08.112655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:08.167099 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 2cefb78b-eff7-47cb-8160-89f1ff42943b {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:38:08.167500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2cefb78b-eff7-47cb-8160-89f1ff42943b not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:38:08.172897 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-345d600e-e744-44e2-869f-d7abf3eff900 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "PUT /v2.0/floatingips/869c4082-2869-4ecc-8258-04ded7ac1b72 HTTP/1.1" status: 200 len: 976 time: 8.2933989 May 12 15:38:08.176156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Made reservation on behalf of 7fab164333c84a019a5a0e9436b3a8df for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:08.182369 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:08.206423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39d4706b-4b43-4fa3-939c-c57dc021a240 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:08.207161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-39d4706b-4b43-4fa3-939c-c57dc021a240 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:08.214459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32852) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:08.226214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e8fabebf-cbf1-4031-afb5-696dfe60bb87 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'floatingip': {'port_id': None}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:08.317314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d471fa4e-f3d7-4c6e-971a-0f7fb73370f4 None None] For port 6473c239-4312-4ac0-8a4d-75ae094ab4bc, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6473c239-4312-4ac0-8a4d-75ae094ab4bc,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:08.317871 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d471fa4e-f3d7-4c6e-971a-0f7fb73370f4 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:08.462942 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:08.465187 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:08.500505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-39d4706b-4b43-4fa3-939c-c57dc021a240 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:08.501983 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-39d4706b-4b43-4fa3-939c-c57dc021a240 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 1.5275471 May 12 15:38:08.504775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32860) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:08.540948 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8fabebf-cbf1-4031-afb5-696dfe60bb87 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:08.548850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d471fa4e-f3d7-4c6e-971a-0f7fb73370f4 None None] Calling delete_port for 6473c239-4312-4ac0-8a4d-75ae094ab4bc owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:08.563943 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:08.564370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Fanout notify agent at l3_agent the message router_deleted on router 758b50f3-4f3d-446e-b73c-bb447a30f408 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:38:08.612145 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0525dad1-a8e7-43fe-8652-57efb20d914b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:08.635928 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:08.649677 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a64179a8-533c-4030-b5fb-37ee01ccb943 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "DELETE /v2.0/routers/758b50f3-4f3d-446e-b73c-bb447a30f408 HTTP/1.1" status: 204 len: 168 time: 4.2009871 May 12 15:38:08.666538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32864) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:08.723789 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d471fa4e-f3d7-4c6e-971a-0f7fb73370f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:08.846405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d471fa4e-f3d7-4c6e-971a-0f7fb73370f4 None None] Pushing event deleted for resources: {'Port': ['ID=6473c239-4312-4ac0-8a4d-75ae094ab4bc,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:08.849071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6473c239-4312-4ac0-8a4d-75ae094ab4bc no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:38:08.863043 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c7e3b0d-4756-4060-a898-4a8f01a474e3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:08.904327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec76e1be-241c-43e5-b988-5252aac1d838 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:08.905261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ec76e1be-241c-43e5-b988-5252aac1d838 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:08.930774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 6473c239-4312-4ac0-8a4d-75ae094ab4bc {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:38:08.931475 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6473c239-4312-4ac0-8a4d-75ae094ab4bc not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:38:08.943164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d471fa4e-f3d7-4c6e-971a-0f7fb73370f4 None None] No DVR routers for this DVR port 6473c239-4312-4ac0-8a4d-75ae094ab4bc on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:38:08.987240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ec76e1be-241c-43e5-b988-5252aac1d838 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:08.987240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ec76e1be-241c-43e5-b988-5252aac1d838 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.4788222 May 12 15:38:08.995362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32874) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:09.071209 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c7e3b0d-4756-4060-a898-4a8f01a474e3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:09.102894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-5c7e3b0d-4756-4060-a898-4a8f01a474e3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2edf0bcd-3aed-4d20-90f8-59e368722fde']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:09.117187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-5c7e3b0d-4756-4060-a898-4a8f01a474e3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '464fcc74-09ac-4457-9f5a-e40ea4ef2c72') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:09.117515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-5c7e3b0d-4756-4060-a898-4a8f01a474e3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '464fcc74-09ac-4457-9f5a-e40ea4ef2c72') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:09.132356 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c7e3b0d-4756-4060-a898-4a8f01a474e3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:09.153689 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c7e3b0d-4756-4060-a898-4a8f01a474e3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:09.163579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5c7e3b0d-4756-4060-a898-4a8f01a474e3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Releasing vlan 571 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:38:09.164010 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c7e3b0d-4756-4060-a898-4a8f01a474e3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: timer() May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:38:09.210435 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:38:09.480036 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c7e3b0d-4756-4060-a898-4a8f01a474e3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:09.520258 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c7e3b0d-4756-4060-a898-4a8f01a474e3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:09.533956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c7e3b0d-4756-4060-a898-4a8f01a474e3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event deleted for resources: {'Network': ['ID=2edf0bcd-3aed-4d20-90f8-59e368722fde,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:09.535946 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0525dad1-a8e7-43fe-8652-57efb20d914b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:09.548788 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5c7e3b0d-4756-4060-a898-4a8f01a474e3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "DELETE /v2.0/networks/2edf0bcd-3aed-4d20-90f8-59e368722fde HTTP/1.1" status: 204 len: 168 time: 0.8806767 May 12 15:38:09.552338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32884) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:09.596919 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9086aa14-ab9d-461e-b00b-e20d70976669 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.5896652 May 12 15:38:09.620376 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0525dad1-a8e7-43fe-8652-57efb20d914b admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:09.620592 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32888) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:09.629128 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1b40f76-3ed4-43b5-9cb2-b41dd1f46399 None None] Network bca349be-4618-43ae-a547-b8bd2b254da4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:09.637107 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8fabebf-cbf1-4031-afb5-696dfe60bb87 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:09.648511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9da6275c-0e91-49f7-b312-15fba71127f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:09.649019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0525dad1-a8e7-43fe-8652-57efb20d914b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=aa771580-393c-41f8-ad67-611be21e45d3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:09.670705 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:09.676362 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0525dad1-a8e7-43fe-8652-57efb20d914b admin admin] 10.222.0.82 "DELETE /v2.0/subnets/aa771580-393c-41f8-ad67-611be21e45d3 HTTP/1.1" status: 204 len: 168 time: 2.2744730 May 12 15:38:09.712732 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8fabebf-cbf1-4031-afb5-696dfe60bb87 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:09.713053 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-e8fabebf-cbf1-4031-afb5-696dfe60bb87 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Floating IP 869c4082-2869-4ecc-8258-04ded7ac1b72 disassociated. External IP: 172.25.8.74, port: 8ac3db5f-3324-4a02-a6e5-504a9ea69fc2. May 12 15:38:09.728730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32892) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:09.982508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d137ff16-5cc8-4e52-9cf0-df4ad99caa04 None None] DHCP port deletion for bca349be-4618-43ae-a547-b8bd2b254da4 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:38:09.986861 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d137ff16-5cc8-4e52-9cf0-df4ad99caa04 None None] Deleting port c779e8fa-022b-430d-9eb2-833a2d42e6de {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:09.987436 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d137ff16-5cc8-4e52-9cf0-df4ad99caa04 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:10.010108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9da6275c-0e91-49f7-b312-15fba71127f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:10.089546 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:10.091627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9da6275c-0e91-49f7-b312-15fba71127f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:10.101588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event updated for resources: {'Subnet': ['ID=73529121-9bf5-45f1-bfed-1522a4a53d69,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:10.118933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Deleting port c779e8fa-022b-430d-9eb2-833a2d42e6de {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:10.120089 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:10.187128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9da6275c-0e91-49f7-b312-15fba71127f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:10.190634 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9da6275c-0e91-49f7-b312-15fba71127f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:10.210446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Checking segment: {'id': '24ecba11-7e7a-4432-b001-7bb43e248572', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '9b7334d3-09cb-43ee-879c-8af2e3abb59f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:38:10.210762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-83191dd2-3433-4ce4-852e-c55fc7cc1d34 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Deleting port 31e29158-543f-4714-837f-4489590b163b {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:10.210965 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-83191dd2-3433-4ce4-852e-c55fc7cc1d34 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:10.211617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Network hostable DHCP agents. Network: 9b7334d3-09cb-43ee-879c-8af2e3abb59f, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:38:10.334106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Network 9b7334d3-09cb-43ee-879c-8af2e3abb59f is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:38:10.369369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 9b7334d3-09cb-43ee-879c-8af2e3abb59f) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:10.382276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:10.383115 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:10.384222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2069f09-402b-418e-87e4-4a296ea1cd95 None None] Network 9b7334d3-09cb-43ee-879c-8af2e3abb59f requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:10.415048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e8fabebf-cbf1-4031-afb5-696dfe60bb87 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:38:10.423885 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f44f3022-d986-4353-b2a8-40c54cd4eada tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 3.0967124 May 12 15:38:10.425595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32914) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:10.433853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Request body: {'network': {'name': 'tempest-router-network01--934756538'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:10.440268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:10.445588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Usage tracker for resource:network and tenant:7fab164333c84a019a5a0e9436b3a8df is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:10.450204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:10.460373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:10.481914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Made reservation on behalf of 7fab164333c84a019a5a0e9436b3a8df for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:10.486405 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:10.529668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d137ff16-5cc8-4e52-9cf0-df4ad99caa04 None None] For port c779e8fa-022b-430d-9eb2-833a2d42e6de, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c779e8fa-022b-430d-9eb2-833a2d42e6de,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:10.530170 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d137ff16-5cc8-4e52-9cf0-df4ad99caa04 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:10.665048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 576} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:38:10.733059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fc86a368-e153-4a81-95d3-8aae87de7b1d no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:38:10.750630 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:10.751357 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Added segment 20bf5b3e-bbbd-4e60-b09a-451438ef59de of type vlan for network ff1e2484-ac35-4e14-aa85-193f3c121e48 May 12 15:38:10.824752 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:10.836894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e8fabebf-cbf1-4031-afb5-696dfe60bb87 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:38:10.864653 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8fabebf-cbf1-4031-afb5-696dfe60bb87 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:10.888479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] For port c779e8fa-022b-430d-9eb2-833a2d42e6de, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c779e8fa-022b-430d-9eb2-833a2d42e6de,segment=NetworkSegment(60811cb9-2374-4869-8102-d13af82449fc),segment_id=60811cb9-2374-4869-8102-d13af82449fc)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:10.889100 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:10.951163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:10.956564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:10.957325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:10.992829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d137ff16-5cc8-4e52-9cf0-df4ad99caa04 None None] Calling delete_port for c779e8fa-022b-430d-9eb2-833a2d42e6de owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:11.021434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a937dadf-e9e5-452c-adde-9cfbf2916034 None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:38:11.044501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: fc86a368-e153-4a81-95d3-8aae87de7b1d {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:38:11.044501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fc86a368-e153-4a81-95d3-8aae87de7b1d not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:38:11.044501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c779e8fa-022b-430d-9eb2-833a2d42e6de no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:38:11.090687 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-83191dd2-3433-4ce4-852e-c55fc7cc1d34 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:11.091014 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-83191dd2-3433-4ce4-852e-c55fc7cc1d34 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:11.146362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a937dadf-e9e5-452c-adde-9cfbf2916034 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:11.147140 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a937dadf-e9e5-452c-adde-9cfbf2916034 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:11.166874 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e8fabebf-cbf1-4031-afb5-696dfe60bb87 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "PUT /v2.0/floatingips/869c4082-2869-4ecc-8258-04ded7ac1b72 HTTP/1.1" status: 200 len: 687 time: 2.9468503 May 12 15:38:11.170514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32932) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:11.238285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event updated for resources: {'Network': ['ID=ff1e2484-ac35-4e14-aa85-193f3c121e48,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:11.258345 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cb926799-23aa-43cb-ae08-79f1bc49d916 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.8285325 May 12 15:38:11.259387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32936) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:11.264569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Request body: {'network': {'name': 'tempest-router-network02--282410695'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:11.320690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Calling delete_port for c779e8fa-022b-430d-9eb2-833a2d42e6de owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:11.327750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network ff1e2484-ac35-4e14-aa85-193f3c121e48 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:38:11.359078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:11.364515 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Usage tracker for resource:network and tenant:7fab164333c84a019a5a0e9436b3a8df is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:11.370106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:11.375487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-83191dd2-3433-4ce4-852e-c55fc7cc1d34 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Calling delete_port for 31e29158-543f-4714-837f-4489590b163b owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:11.377862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:11.403932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Made reservation on behalf of 7fab164333c84a019a5a0e9436b3a8df for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:11.408760 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:11.415997 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d137ff16-5cc8-4e52-9cf0-df4ad99caa04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:11.470498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c51b8737-6ead-405e-8a22-b9a8ec5e482f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port e82b27bb-6b3a-49fa-965f-eb51f26a0d2c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:11.471499 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c51b8737-6ead-405e-8a22-b9a8ec5e482f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:11.542519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 572} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:38:11.561834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:11.562755 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Added segment 73d0e46e-b7ec-4dc8-be38-786a1545a838 of type vlan for network 8ce74361-036e-4b19-b9d1-2b75a2ae9571 May 12 15:38:11.569506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a937dadf-e9e5-452c-adde-9cfbf2916034 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:11.666681 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:38:11.667003 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:38:11.747210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d137ff16-5cc8-4e52-9cf0-df4ad99caa04 None None] Pushing event deleted for resources: {'Port': ['ID=c779e8fa-022b-430d-9eb2-833a2d42e6de,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:11.764119 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9da6275c-0e91-49f7-b312-15fba71127f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:11.800728 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d137ff16-5cc8-4e52-9cf0-df4ad99caa04 None None] No DVR routers for this DVR port c779e8fa-022b-430d-9eb2-833a2d42e6de on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:38:11.835526 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:11.848994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a937dadf-e9e5-452c-adde-9cfbf2916034 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:11.850629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a937dadf-e9e5-452c-adde-9cfbf2916034 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:11.863383 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9da6275c-0e91-49f7-b312-15fba71127f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=80485e3f-9911-46cd-88e9-ff7d2634ee2b,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:11.879410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9da6275c-0e91-49f7-b312-15fba71127f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:11.883367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-9da6275c-0e91-49f7-b312-15fba71127f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:11.887888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9da6275c-0e91-49f7-b312-15fba71127f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:11.888858 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9da6275c-0e91-49f7-b312-15fba71127f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:11.903958 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c51b8737-6ead-405e-8a22-b9a8ec5e482f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:11.904292 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c51b8737-6ead-405e-8a22-b9a8ec5e482f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:11.931075 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-83191dd2-3433-4ce4-852e-c55fc7cc1d34 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:11.968759 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No active binding found for port c779e8fa-022b-430d-9eb2-833a2d42e6de {{(pid=88153) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:224}} May 12 15:38:11.969253 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c779e8fa-022b-430d-9eb2-833a2d42e6de not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:38:11.998655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee319569-e203-4590-afe3-087691cecf26 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:12.041190 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83191dd2-3433-4ce4-852e-c55fc7cc1d34 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event deleted for resources: {'Port': ['ID=31e29158-543f-4714-837f-4489590b163b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:12.048846 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9da6275c-0e91-49f7-b312-15fba71127f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.4201679 May 12 15:38:12.054402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32952) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:12.087978 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-9b7334d3-09cb-43ee-879c-8af2e3abb59f', 'network_id': '9b7334d3-09cb-43ee-879c-8af2e3abb59f', 'tenant_id': '7fab164333c84a019a5a0e9436b3a8df', 'fixed_ips': [{'subnet_id': '73529121-9bf5-45f1-bfed-1522a4a53d69'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:38:12.088988 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:12.111852 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-83191dd2-3433-4ce4-852e-c55fc7cc1d34 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:12.112311 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-83191dd2-3433-4ce4-852e-c55fc7cc1d34 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Floating IP fc5f0f39-1ca9-4a2c-9398-973ed092569a disassociated (deleted). External IP: 172.25.8.182, port: 4f36023c-143c-4389-b26c-f62679404834. May 12 15:38:12.192612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Deleting port c779e8fa-022b-430d-9eb2-833a2d42e6de {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:12.193374 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:12.206877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c51b8737-6ead-405e-8a22-b9a8ec5e482f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for e82b27bb-6b3a-49fa-965f-eb51f26a0d2c owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:12.241505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'mac_address': 'fa:16:3e:0c:a9:d6', 'name': 'tempest-NetworksTestDHCPv6-1620454672'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:12.321097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] The port 'c779e8fa-022b-430d-9eb2-833a2d42e6de' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:38:12.428503 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] It took 0.58 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:38:12.574169 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Allocated IP 2001:db8::2 (9b7334d3-09cb-43ee-879c-8af2e3abb59f/73529121-9bf5-45f1-bfed-1522a4a53d69/cdf9fedf-365d-4e32-a48f-b738e2bd9239) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:12.576441 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a937dadf-e9e5-452c-adde-9cfbf2916034 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:12.576836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a937dadf-e9e5-452c-adde-9cfbf2916034 None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:38:12.662180 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:12.671662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:12.673024 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:12.710608 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c51b8737-6ead-405e-8a22-b9a8ec5e482f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:12.777932 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:12.907479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bca349be-4618-43ae-a547-b8bd2b254da4']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:12.914322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c51b8737-6ead-405e-8a22-b9a8ec5e482f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Port': ['ID=e82b27bb-6b3a-49fa-965f-eb51f26a0d2c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:12.968267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '60811cb9-2374-4869-8102-d13af82449fc') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:12.968888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '60811cb9-2374-4869-8102-d13af82449fc') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:12.981286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '80485e3f-9911-46cd-88e9-ff7d2634ee2b'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:38:12.982517 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:12.988117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:12.993602 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:13.030418 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 1.7669315 May 12 15:38:13.035351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64c5f4bb-d5c3-441d-9fe4-3e0a93b200aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event updated for resources: {'Network': ['ID=8ce74361-036e-4b19-b9d1-2b75a2ae9571,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:13.035680 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-66f92b15-be98-45ad-a985-cd34cff54b5f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:13.047224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32974) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:13.052350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:13.057427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Request body: {'subnet': {'network_id': 'ff1e2484-ac35-4e14-aa85-193f3c121e48', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:13.067099 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 8ce74361-036e-4b19-b9d1-2b75a2ae9571 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:38:13.097791 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:13.116077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Releasing vlan 581 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:38:13.116606 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: timer() May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:38:13.131877 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:38:13.273437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-83191dd2-3433-4ce4-852e-c55fc7cc1d34 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:38:13.341872 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:13.346444 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:13.351652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Usage tracker for resource:subnet and tenant:7fab164333c84a019a5a0e9436b3a8df is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:13.369829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:13.381466 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:13.387585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Transition to ACTIVE for port object cdf9fedf-365d-4e32-a48f-b738e2bd9239 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:13.392613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:13.392771 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:13.399642 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:13.421278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:13.425629 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c51b8737-6ead-405e-8a22-b9a8ec5e482f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:13.428684 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c51b8737-6ead-405e-8a22-b9a8ec5e482f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:13.432546 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c51b8737-6ead-405e-8a22-b9a8ec5e482f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/floatingips/869c4082-2869-4ecc-8258-04ded7ac1b72 HTTP/1.1" status: 204 len: 168 time: 2.2591357 May 12 15:38:13.435941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 32984) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:13.457665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] Pushing event deleted for resources: {'Network': ['ID=bca349be-4618-43ae-a547-b8bd2b254da4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:13.486468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Transition to ACTIVE for port object cdf9fedf-365d-4e32-a48f-b738e2bd9239 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:13.489157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-00969861-f484-4dfb-9dad-75b178c90fae admin admin] 10.222.0.82 "DELETE /v2.0/networks/bca349be-4618-43ae-a547-b8bd2b254da4 HTTP/1.1" status: 204 len: 168 time: 3.7494802 May 12 15:38:13.503382 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:13.514571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Allocated IP 2001:db8::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/80485e3f-9911-46cd-88e9-ff7d2634ee2b/87f4626e-eca9-462e-9ed2-e612952688b1) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:13.647273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Network 9b7334d3-09cb-43ee-879c-8af2e3abb59f is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:13.651807 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-ae979f1f-9334-4273-98ce-c9c7990bfa53 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] delete failed (client error): The resource could not be found. May 12 15:38:13.652376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Pushing event updated for resources: {'Port': ['ID=cdf9fedf-365d-4e32-a48f-b738e2bd9239,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:13.653368 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ae979f1f-9334-4273-98ce-c9c7990bfa53 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/floatingips/869c4082-2869-4ecc-8258-04ded7ac1b72 HTTP/1.1" status: 404 len: 345 time: 0.1526742 May 12 15:38:13.657492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Made reservation on behalf of 7fab164333c84a019a5a0e9436b3a8df for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:13.664363 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:13.665539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:13.668893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:13.681929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32992) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:13.745622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 32996) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:13.816336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-83191dd2-3433-4ce4-852e-c55fc7cc1d34 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:38:13.827555 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c4522aa-cf74-4e47-9c58-4ed096144367 None None] Sync routers for ids ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:38:13.840218 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c4522aa-cf74-4e47-9c58-4ed096144367 None None] Routers {'6c52b572-4880-47dd-bc9e-8f2160f5c2e4'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:13.842534 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8c4522aa-cf74-4e47-9c58-4ed096144367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:13.895646 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-83191dd2-3433-4ce4-852e-c55fc7cc1d34 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:13.965035 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-98990414-095e-4fb4-9aaa-2bf6ab79f545 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ed8d9bf58283443480f0c62e72d53449&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2141187 May 12 15:38:13.968738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33000) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:13.988584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:14.049091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-83191dd2-3433-4ce4-852e-c55fc7cc1d34 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "DELETE /v2.0/floatingips/fc5f0f39-1ca9-4a2c-9398-973ed092569a HTTP/1.1" status: 204 len: 168 time: 4.4929986 May 12 15:38:14.049091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'tag': '4f36023c-143c-4389-b26c-f62679404834'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:38:14.070818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cbed974a-37b3-4dc0-8540-4c76981954d4 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:14.083924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cbed974a-37b3-4dc0-8540-4c76981954d4 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:14.090694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cbed974a-37b3-4dc0-8540-4c76981954d4 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:14.094130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cbed974a-37b3-4dc0-8540-4c76981954d4 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Synchronizing usage tracker for tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:14.115232 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:14.128054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Transition to ACTIVE for port object 87f4626e-eca9-462e-9ed2-e612952688b1 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:14.133625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cbed974a-37b3-4dc0-8540-4c76981954d4 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Unset dirty status for tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:14.135043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cbed974a-37b3-4dc0-8540-4c76981954d4 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "GET /v2.0/ports?network_id=2d338475-91c7-4829-98f2-54874ae73504 HTTP/1.1" status: 200 len: 2358 time: 0.4517295 May 12 15:38:14.137835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33010) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:14.164139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Transition to ACTIVE for port object 87f4626e-eca9-462e-9ed2-e612952688b1 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:14.213323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event updated for resources: {'Subnet': ['ID=400f4760-7cc3-4cf7-afb0-8bf1209cbe83,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:14.252759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5213c16-ab45-42ea-9e9c-ea605f465750 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:14.259142 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e5213c16-ab45-42ea-9e9c-ea605f465750 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "GET /v2.0/subnets/6a6a3afc-f008-4a33-8e40-276ea11e299b HTTP/1.1" status: 200 len: 797 time: 0.1201415 May 12 15:38:14.263949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33014) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:14.266475 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:14.270036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'port': {'network_id': '2d338475-91c7-4829-98f2-54874ae73504', 'name': 'tempest-FloatingIPTestJSON-1284653383', 'fixed_ips': [{'ip_address': '172.20.0.13'}, {'ip_address': '172.20.0.12'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:14.282672 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:14.328911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 5eebea01-7d6e-4574-8a3a-f06afeaef1cf yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:38:14.348113 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-8c4522aa-cf74-4e47-9c58-4ed096144367 None None] Set router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:38:14.552508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Attempting to bind port cdf9fedf-365d-4e32-a48f-b738e2bd9239 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:38:14.553788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Attempting to bind port cdf9fedf-365d-4e32-a48f-b738e2bd9239 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '24ecba11-7e7a-4432-b001-7bb43e248572', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '9b7334d3-09cb-43ee-879c-8af2e3abb59f'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:38:14.566560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Attempting to bind port cdf9fedf-365d-4e32-a48f-b738e2bd9239 on network 9b7334d3-09cb-43ee-879c-8af2e3abb59f {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:38:14.570370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Pushing event updated for resources: {'Port': ['ID=87f4626e-eca9-462e-9ed2-e612952688b1,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:14.597308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 37, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:38:14.601186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Checking segment: {'id': '24ecba11-7e7a-4432-b001-7bb43e248572', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '9b7334d3-09cb-43ee-879c-8af2e3abb59f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:38:14.605053 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:14.605567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Bound using segment: {'id': '24ecba11-7e7a-4432-b001-7bb43e248572', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '9b7334d3-09cb-43ee-879c-8af2e3abb59f'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:38:14.606194 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Bound port: cdf9fedf-365d-4e32-a48f-b738e2bd9239, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '24ecba11-7e7a-4432-b001-7bb43e248572', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '9b7334d3-09cb-43ee-879c-8af2e3abb59f'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:38:14.606680 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:14.680830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:14.688489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Checking segment: {'id': '20bf5b3e-bbbd-4e60-b09a-451438ef59de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'ff1e2484-ac35-4e14-aa85-193f3c121e48'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:38:14.691571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Network hostable DHCP agents. Network: ff1e2484-ac35-4e14-aa85-193f3c121e48, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:38:14.701751 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b778d0b-6d93-4498-bbf0-2b3753425d1c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:14.766594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:14.775322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:14.781900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:14.800704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:14.809472 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b4fe53cb-a712-45a8-80b7-a1b4a22a87bf'] response: {'name': 'network-changed', 'server_uuid': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'tag': '4f36023c-143c-4389-b26c-f62679404834', 'status': 'completed', 'code': 200} May 12 15:38:14.828302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Made reservation on behalf of 9d4bdd73a39f4390bb7d4c6d7a1fc0c4 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:14.858686 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b778d0b-6d93-4498-bbf0-2b3753425d1c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:14.910824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] For port cdf9fedf-365d-4e32-a48f-b738e2bd9239, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:38:14.916044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] For port cdf9fedf-365d-4e32-a48f-b738e2bd9239, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cdf9fedf-365d-4e32-a48f-b738e2bd9239,segment=NetworkSegment(24ecba11-7e7a-4432-b001-7bb43e248572),segment_id=24ecba11-7e7a-4432-b001-7bb43e248572)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:38:14.927849 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:15.062870 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b778d0b-6d93-4498-bbf0-2b3753425d1c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:15.127174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b778d0b-6d93-4498-bbf0-2b3753425d1c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17ef7040-f66b-422a-a8da-be4216f1f8bd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:15.150461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Network ff1e2484-ac35-4e14-aa85-193f3c121e48 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:38:15.157074 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:15.178027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d633b243-b7d3-4ba3-bbd1-1ef7d76b4d79 req-d03c1405-a1c9-4d93-9314-ab6e68ef65e5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:15.179061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d633b243-b7d3-4ba3-bbd1-1ef7d76b4d79 req-d03c1405-a1c9-4d93-9314-ab6e68ef65e5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Synchronizing usage tracker for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:15.195688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, ff1e2484-ac35-4e14-aa85-193f3c121e48) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:15.206143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] device_id is not set on port fe574d75-b8e5-4d9b-9027-58c6118d9cd8 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:38:15.206425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:15.207138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:15.250155 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-405362a7-f373-443b-90ad-afbe5b4b85ff None None] Network ff1e2484-ac35-4e14-aa85-193f3c121e48 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:15.276379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::22e (2447b094-d5d6-41ef-a146-2bf56f5399af/80485e3f-9911-46cd-88e9-ff7d2634ee2b/5eebea01-7d6e-4574-8a3a-f06afeaef1cf) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:15.311254 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b778d0b-6d93-4498-bbf0-2b3753425d1c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:15.315459 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5b778d0b-6d93-4498-bbf0-2b3753425d1c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/17ef7040-f66b-422a-a8da-be4216f1f8bd HTTP/1.1" status: 204 len: 168 time: 1.3450580 May 12 15:38:15.332354 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c2be4dbd-c70c-4aca-8ca9-ad39e4d97428 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.2809713 May 12 15:38:15.340593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33028) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:15.358025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Request body: {'subnet': {'network_id': '8ce74361-036e-4b19-b9d1-2b75a2ae9571', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:15.478550 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8c4522aa-cf74-4e47-9c58-4ed096144367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:35:34Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '63b42831-39a6-4a50-a6ab-4dce60dc93b6', 'name': '', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'mac_address': 'fa:16:3e:c5:e0:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 2707, 'fixed_ips': [{'subnet_id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:31Z', 'updated_at': '2022-05-12T15:35:53Z', 'revision_number': 5, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'subnets': [{'id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:15.491992 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c4522aa-cf74-4e47-9c58-4ed096144367 None None] Checking router: 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:38:15.523073 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c4522aa-cf74-4e47-9c58-4ed096144367 None None] Routers {'6c52b572-4880-47dd-bc9e-8f2160f5c2e4'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:15.524386 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8c4522aa-cf74-4e47-9c58-4ed096144367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:37:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:15.644839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Attempting to bind port 87f4626e-eca9-462e-9ed2-e612952688b1 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:38:15.649927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Attempting to bind port 87f4626e-eca9-462e-9ed2-e612952688b1 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:38:15.651470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Attempting to bind port 87f4626e-eca9-462e-9ed2-e612952688b1 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:38:15.694537 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 37, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:38:15.696010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:38:15.696500 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:15.696903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:38:15.697420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-968c7765-1060-4e55-8dcd-3089f01be502 req-4795f2de-e4bd-4854-8c79-4cd2300ed5bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:15.697529 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Bound port: 87f4626e-eca9-462e-9ed2-e612952688b1, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:38:15.697788 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:15.699379 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-968c7765-1060-4e55-8dcd-3089f01be502 req-4795f2de-e4bd-4854-8c79-4cd2300ed5bb service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3dd1fe8ad774471ba7745219a37ead53&device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 1135 time: 0.7314510 May 12 15:38:15.802522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:15.907069 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87c891d7-f00a-4210-ab9f-d44276c74b7b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:15.907360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Usage tracker for resource:subnet and tenant:7fab164333c84a019a5a0e9436b3a8df is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:15.910660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:15.912829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d633b243-b7d3-4ba3-bbd1-1ef7d76b4d79 req-d03c1405-a1c9-4d93-9314-ab6e68ef65e5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Unset dirty status for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:15.917833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:15.919507 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d633b243-b7d3-4ba3-bbd1-1ef7d76b4d79 req-d03c1405-a1c9-4d93-9314-ab6e68ef65e5 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 984 time: 1.0455155 May 12 15:38:15.948316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Made reservation on behalf of 7fab164333c84a019a5a0e9436b3a8df for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:15.952054 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:15.980466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d49437cc-db84-4f64-b455-c74c4ddd1ad9 None None] Pushing event updated for resources: {'Port': ['ID=cdf9fedf-365d-4e32-a48f-b738e2bd9239,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:16.053994 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-8c4522aa-cf74-4e47-9c58-4ed096144367 None None] Set router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:38:16.105746 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d633b243-b7d3-4ba3-bbd1-1ef7d76b4d79 req-6a02e7c7-8c83-4f96-b170-f250596868ab tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 0.1851954 May 12 15:38:16.136826 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:16.298918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.20.0.13 (2d338475-91c7-4829-98f2-54874ae73504/6a6a3afc-f008-4a33-8e40-276ea11e299b/fe574d75-b8e5-4d9b-9027-58c6118d9cd8) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:16.315224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.20.0.12 (2d338475-91c7-4829-98f2-54874ae73504/6a6a3afc-f008-4a33-8e40-276ea11e299b/fe574d75-b8e5-4d9b-9027-58c6118d9cd8) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:16.382565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-968c7765-1060-4e55-8dcd-3089f01be502 req-606673a3-e9b0-4e61-be87-8891c9ac9ccb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:16.385129 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-968c7765-1060-4e55-8dcd-3089f01be502 req-606673a3-e9b0-4e61-be87-8891c9ac9ccb service neutron] 10.222.0.84 "GET /v2.0/networks?id=d2e823c6-8acb-45b9-910c-0a4822a68f25 HTTP/1.1" status: 200 len: 897 time: 0.6776233 May 12 15:38:16.488445 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] For port 87f4626e-eca9-462e-9ed2-e612952688b1, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:38:16.528194 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-ff1e2484-ac35-4e14-aa85-193f3c121e48', 'network_id': 'ff1e2484-ac35-4e14-aa85-193f3c121e48', 'tenant_id': '7fab164333c84a019a5a0e9436b3a8df', 'fixed_ips': [{'subnet_id': '400f4760-7cc3-4cf7-afb0-8bf1209cbe83'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:38:16.529032 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:16.629283 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] For port 87f4626e-eca9-462e-9ed2-e612952688b1, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=87f4626e-eca9-462e-9ed2-e612952688b1,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:38:16.939545 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:16.980436 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8c4522aa-cf74-4e47-9c58-4ed096144367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:35:34Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '63b42831-39a6-4a50-a6ab-4dce60dc93b6', 'name': '', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'mac_address': 'fa:16:3e:c5:e0:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 2707, 'fixed_ips': [{'subnet_id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:31Z', 'updated_at': '2022-05-12T15:35:53Z', 'revision_number': 5, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'subnets': [{'id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:16.990404 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c4522aa-cf74-4e47-9c58-4ed096144367 None None] The sync data for ids ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'] in n-d-841483-1 is: [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:35:34Z', 'revision_number': 4, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '63b42831-39a6-4a50-a6ab-4dce60dc93b6', 'name': '', 'network_id': 'd2e823c6-8acb-45b9-910c-0a4822a68f25', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'mac_address': 'fa:16:3e:c5:e0:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 2707, 'fixed_ips': [{'subnet_id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:31Z', 'updated_at': '2022-05-12T15:35:53Z', 'revision_number': 5, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'subnets': [{'id': '27cd1f2e-8b9d-4298-a44b-ce82945125a8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:38:17.004286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object 5eebea01-7d6e-4574-8a3a-f06afeaef1cf will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:17.070823 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:17.089412 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:17.108610 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-968c7765-1060-4e55-8dcd-3089f01be502 req-11aa778d-5dc0-4e13-b677-7808a511cf73 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4f36023c-143c-4389-b26c-f62679404834 HTTP/1.1" status: 200 len: 217 time: 0.7138910 May 12 15:38:17.188765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Allocated IP 2001:db8::2 (ff1e2484-ac35-4e14-aa85-193f3c121e48/400f4760-7cc3-4cf7-afb0-8bf1209cbe83/980e521e-27f1-4eeb-a586-9243c69f7517) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:17.329670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39879ed-6f8f-4541-956f-7a34a963f7f8 req-2d0b6411-9ba7-4c59-80ca-7dac49cf7ab3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:17.333700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e39879ed-6f8f-4541-956f-7a34a963f7f8 req-2d0b6411-9ba7-4c59-80ca-7dac49cf7ab3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.84 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 984 time: 0.9761589 May 12 15:38:17.465200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-968c7765-1060-4e55-8dcd-3089f01be502 req-48a820e8-9cf9-4496-8bc1-ec19671628d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:17.470840 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-968c7765-1060-4e55-8dcd-3089f01be502 req-48a820e8-9cf9-4496-8bc1-ec19671628d0 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=27cd1f2e-8b9d-4298-a44b-ce82945125a8 HTTP/1.1" status: 200 len: 835 time: 0.2397611 May 12 15:38:17.531739 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:17.541324 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:17.596512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:17.601104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:17.603819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:17.610798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:17.611719 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:17.662299 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 5.4673648 May 12 15:38:17.687812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33078) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:17.708688 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cdf9fedf-365d-4e32-a48f-b738e2bd9239 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:17.736272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdc4075e-557b-4d90-8ccb-434032993d63 None None] Network 9b7334d3-09cb-43ee-879c-8af2e3abb59f requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:17.774231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event updated for resources: {'Subnet': ['ID=1b4efce0-efde-4551-8b49-a4b113962251,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:17.776072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e61c59ac-3d41-441a-981c-1bb2127559b2 None None] Pushing event updated for resources: {'Port': ['ID=87f4626e-eca9-462e-9ed2-e612952688b1,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:17.783751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5589b6d6-35ad-4377-8447-405dc7c816af tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=5eebea01-7d6e-4574-8a3a-f06afeaef1cf,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:17.785848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72bdffde-dad6-4784-9ea9-9cdd0f021db9 None None] New status for floating IP fc5f0f39-1ca9-4a2c-9398-973ed092569a: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:38:17.855776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-e39879ed-6f8f-4541-956f-7a34a963f7f8 req-fe62596b-b101-403c-9fac-b051e5f72cae tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Deleting port 4f36023c-143c-4389-b26c-f62679404834 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:17.856200 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e39879ed-6f8f-4541-956f-7a34a963f7f8 req-fe62596b-b101-403c-9fac-b051e5f72cae tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:17.860239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Checking segment: {'id': '73d0e46e-b7ec-4dc8-be38-786a1545a838', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '8ce74361-036e-4b19-b9d1-2b75a2ae9571'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:38:17.861239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Network hostable DHCP agents. Network: 8ce74361-036e-4b19-b9d1-2b75a2ae9571, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:38:17.921092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-968c7765-1060-4e55-8dcd-3089f01be502 req-287e2945-4ba9-4e4c-ae6e-bf55d89800be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:17.922756 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-968c7765-1060-4e55-8dcd-3089f01be502 req-287e2945-4ba9-4e4c-ae6e-bf55d89800be service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d2e823c6-8acb-45b9-910c-0a4822a68f25&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3981478 May 12 15:38:17.930332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Network 8ce74361-036e-4b19-b9d1-2b75a2ae9571 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:38:17.971324 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:17.984835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9684e8b9-11d4-4d32-a809-6a05499554a9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:17.996371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9684e8b9-11d4-4d32-a809-6a05499554a9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:17.997318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9684e8b9-11d4-4d32-a809-6a05499554a9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:18.058059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33088) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:18.060164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 8ce74361-036e-4b19-b9d1-2b75a2ae9571) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:18.065896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:18.066618 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:18.097080 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-27eef246-d118-4e06-aefb-bf597c1a3382 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.7499979 May 12 15:38:18.107988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33092) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:18.159797 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:18.160911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ec4166d-5960-44c2-b6b5-187fec797a15 None None] Network 8ce74361-036e-4b19-b9d1-2b75a2ae9571 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:18.213203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33098) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:18.313613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-620e5d14-1af1-4f18-aca1-8e8936d5ef9e req-375094b7-2bcb-4277-80cb-1e3281f0d0ce tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:18.322189 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-620e5d14-1af1-4f18-aca1-8e8936d5ef9e req-375094b7-2bcb-4277-80cb-1e3281f0d0ce tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 984 time: 0.7526455 May 12 15:38:18.393798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9684e8b9-11d4-4d32-a809-6a05499554a9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:18.395114 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9684e8b9-11d4-4d32-a809-6a05499554a9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1669 time: 0.7059944 May 12 15:38:18.461180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33108) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:18.527432 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-622c1b9b-e882-4ef1-829a-0ecc276322b5 None None] Provisioning for port cdf9fedf-365d-4e32-a48f-b738e2bd9239 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:18.539312 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:18.735091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-620e5d14-1af1-4f18-aca1-8e8936d5ef9e req-458f3339-f048-4007-8f3d-5606f646904e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/security-groups?id=62da627b-8675-47b7-a69e-55dbeab2bd90&id=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b&fields=id&fields=name HTTP/1.1" status: 200 len: 408 time: 0.4120080 May 12 15:38:18.761269 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port cdf9fedf-365d-4e32-a48f-b738e2bd9239 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:18.770830 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-71d9caed-7601-4d57-80ee-380b2eebdb12 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:18.810397 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b92c585c-3be9-42f1-8cec-cee3d389af87 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:18.882318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=fe574d75-b8e5-4d9b-9027-58c6118d9cd8,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:18.896045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network 2d338475-91c7-4829-98f2-54874ae73504 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:18.901502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:18.915990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:18.941745 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-8ce74361-036e-4b19-b9d1-2b75a2ae9571', 'network_id': '8ce74361-036e-4b19-b9d1-2b75a2ae9571', 'tenant_id': '7fab164333c84a019a5a0e9436b3a8df', 'fixed_ips': [{'subnet_id': '1b4efce0-efde-4551-8b49-a4b113962251'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:38:18.943063 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:18.956461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b92c585c-3be9-42f1-8cec-cee3d389af87 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:18.959736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-71d9caed-7601-4d57-80ee-380b2eebdb12 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:18.979614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port cdf9fedf-365d-4e32-a48f-b738e2bd9239 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:18.980157 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:18.992048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b0696c49-219c-40f8-acea-a927ab42a217 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port 5eebea01-7d6e-4574-8a3a-f06afeaef1cf {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:18.992663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b0696c49-219c-40f8-acea-a927ab42a217 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:18.997679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b92c585c-3be9-42f1-8cec-cee3d389af87 admin admin] Usage tracker for resource:security_group_rule and tenant:3793df6311764341a3f54447e16ae944 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:19.002727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-71d9caed-7601-4d57-80ee-380b2eebdb12 admin admin] Usage tracker for resource:security_group_rule and tenant:f12eeb54da0c41bf859cfb70b24ee721 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:19.016918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-71d9caed-7601-4d57-80ee-380b2eebdb12 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:19.033293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b92c585c-3be9-42f1-8cec-cee3d389af87 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:19.041202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-e39879ed-6f8f-4541-956f-7a34a963f7f8 req-fe62596b-b101-403c-9fac-b051e5f72cae tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] For port 4f36023c-143c-4389-b26c-f62679404834, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=4f36023c-143c-4389-b26c-f62679404834,segment=NetworkSegment(4dc52732-5577-45b0-b2eb-1c2616cc1c73),segment_id=4dc52732-5577-45b0-b2eb-1c2616cc1c73)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:19.041592 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e39879ed-6f8f-4541-956f-7a34a963f7f8 req-fe62596b-b101-403c-9fac-b051e5f72cae tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:19.061704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-71d9caed-7601-4d57-80ee-380b2eebdb12 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:19.070847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b92c585c-3be9-42f1-8cec-cee3d389af87 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:19.076536 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-968c7765-1060-4e55-8dcd-3089f01be502 req-c29a0d7e-1409-4b43-87c0-bb99377255ea service neutron] 10.222.0.84 "GET /v2.0/networks/d2e823c6-8acb-45b9-910c-0a4822a68f25?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.1400189 May 12 15:38:19.087271 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:19.175659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Transition to ACTIVE for port object 980e521e-27f1-4eeb-a586-9243c69f7517 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:19.197702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-e39879ed-6f8f-4541-956f-7a34a963f7f8 req-fe62596b-b101-403c-9fac-b051e5f72cae tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Calling delete_port for 4f36023c-143c-4389-b26c-f62679404834 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:19.260264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Transition to ACTIVE for port object 980e521e-27f1-4eeb-a586-9243c69f7517 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:19.276634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:19.277217 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:19.375737 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:19.468787 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b92c585c-3be9-42f1-8cec-cee3d389af87 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:19.479172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Network ff1e2484-ac35-4e14-aa85-193f3c121e48 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:19.479963 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b92c585c-3be9-42f1-8cec-cee3d389af87 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:19.494364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:19.498234 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:19.500962 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:19.513225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:19.523347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b92c585c-3be9-42f1-8cec-cee3d389af87 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3793df6311764341a3f54447e16ae944&name=default HTTP/1.1" status: 200 len: 2983 time: 1.4584310 May 12 15:38:19.525200 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-224204b6-2e41-4199-917c-cd7bca157804 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1010 time: 5.2601540 May 12 15:38:19.534135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33118) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:19.534669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33120) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:19.603806 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': 'fe574d75-b8e5-4d9b-9027-58c6118d9cd8', 'fixed_ip_address': '172.20.0.13'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:19.614880 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Pushing event updated for resources: {'Port': ['ID=980e521e-27f1-4eeb-a586-9243c69f7517,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:19.619979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Allocated IP 2001:db8::2 (8ce74361-036e-4b19-b9d1-2b75a2ae9571/1b4efce0-efde-4551-8b49-a4b113962251/8b4e70fe-09b8-4d59-aa6c-7b85953bcef8) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:19.623362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:19.655075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:floatingip and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:19.677196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:19.712738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:19.720845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port cdf9fedf-365d-4e32-a48f-b738e2bd9239, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cdf9fedf-365d-4e32-a48f-b738e2bd9239,segment=NetworkSegment(24ecba11-7e7a-4432-b001-7bb43e248572),segment_id=24ecba11-7e7a-4432-b001-7bb43e248572)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:19.732880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b92c585c-3be9-42f1-8cec-cee3d389af87 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11eac58d-0131-4817-972a-ccfae07a73ea,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:19.743042 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-968c7765-1060-4e55-8dcd-3089f01be502 req-056b2422-d7ee-4ba2-a442-59e41a356844 service neutron] 10.222.0.84 "GET /v2.0/networks/d2e823c6-8acb-45b9-910c-0a4822a68f25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6539495 May 12 15:38:19.808408 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:19.839117 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4136d17d-12dd-4322-9cdc-ded859a74f71 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:19.909987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4136d17d-12dd-4322-9cdc-ded859a74f71 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:20.029105 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:20.043936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Attempting to bind port 980e521e-27f1-4eeb-a586-9243c69f7517 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:38:20.043936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Attempting to bind port 980e521e-27f1-4eeb-a586-9243c69f7517 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '20bf5b3e-bbbd-4e60-b09a-451438ef59de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'ff1e2484-ac35-4e14-aa85-193f3c121e48'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:38:20.044273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Attempting to bind port 980e521e-27f1-4eeb-a586-9243c69f7517 on network ff1e2484-ac35-4e14-aa85-193f3c121e48 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:38:20.064663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4f36023c-143c-4389-b26c-f62679404834 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:38:20.065336 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-71d9caed-7601-4d57-80ee-380b2eebdb12 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:20.095715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 87f4626e-eca9-462e-9ed2-e612952688b1 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:20.109143 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4136d17d-12dd-4322-9cdc-ded859a74f71 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:20.112899 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e39879ed-6f8f-4541-956f-7a34a963f7f8 req-fe62596b-b101-403c-9fac-b051e5f72cae tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:20.154121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4136d17d-12dd-4322-9cdc-ded859a74f71 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11eac58d-0131-4817-972a-ccfae07a73ea,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:20.157347 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-71d9caed-7601-4d57-80ee-380b2eebdb12 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:20.188708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 38, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:38:20.189080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Checking segment: {'id': '20bf5b3e-bbbd-4e60-b09a-451438ef59de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'ff1e2484-ac35-4e14-aa85-193f3c121e48'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:38:20.189498 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:20.189886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Bound using segment: {'id': '20bf5b3e-bbbd-4e60-b09a-451438ef59de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'ff1e2484-ac35-4e14-aa85-193f3c121e48'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:38:20.190362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Bound port: 980e521e-27f1-4eeb-a586-9243c69f7517, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '20bf5b3e-bbbd-4e60-b09a-451438ef59de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'ff1e2484-ac35-4e14-aa85-193f3c121e48'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:38:20.190730 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:20.201697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 4f36023c-143c-4389-b26c-f62679404834 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:38:20.202157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 4f36023c-143c-4389-b26c-f62679404834 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:38:20.262866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-71d9caed-7601-4d57-80ee-380b2eebdb12 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f12eeb54da0c41bf859cfb70b24ee721&name=default HTTP/1.1" status: 200 len: 2983 time: 2.0486507 May 12 15:38:20.264295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe62596b-b101-403c-9fac-b051e5f72cae tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event deleted for resources: {'Port': ['ID=4f36023c-143c-4389-b26c-f62679404834,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:20.268052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33130) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:20.268545 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-313014c5-4b9e-4430-9a5b-704dc5aeef79 req-c93acd82-eaad-4528-b1f2-a850fdb78d1b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 210 time: 0.2454107 May 12 15:38:20.274287 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b0696c49-219c-40f8-acea-a927ab42a217 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:20.349145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4fd3798d-1e4e-45da-a431-786fa5ec0316 None None] Provisioning complete for port cdf9fedf-365d-4e32-a48f-b738e2bd9239 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:20.349587 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4fd3798d-1e4e-45da-a431-786fa5ec0316 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:20.426762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=cdf9fedf-365d-4e32-a48f-b738e2bd9239,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:20.482273 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4136d17d-12dd-4322-9cdc-ded859a74f71 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:20.485996 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4136d17d-12dd-4322-9cdc-ded859a74f71 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/11eac58d-0131-4817-972a-ccfae07a73ea HTTP/1.1" status: 204 len: 168 time: 0.9477038 May 12 15:38:20.656136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 87f4626e-eca9-462e-9ed2-e612952688b1 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:20.676175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] For port 980e521e-27f1-4eeb-a586-9243c69f7517, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:38:20.708263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] For port 980e521e-27f1-4eeb-a586-9243c69f7517, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=980e521e-27f1-4eeb-a586-9243c69f7517,segment=NetworkSegment(20bf5b3e-bbbd-4e60-b09a-451438ef59de),segment_id=20bf5b3e-bbbd-4e60-b09a-451438ef59de)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:38:20.753719 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:20.757315 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:20.794157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71d9caed-7601-4d57-80ee-380b2eebdb12 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a2a521ba-58f0-4348-9fcc-dc74cedcbb4f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:20.806279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-e39879ed-6f8f-4541-956f-7a34a963f7f8 req-fe62596b-b101-403c-9fac-b051e5f72cae tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] No DVR routers for this DVR port 4f36023c-143c-4389-b26c-f62679404834 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:38:20.809427 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-e39879ed-6f8f-4541-956f-7a34a963f7f8 req-fe62596b-b101-403c-9fac-b051e5f72cae tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:20.811432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e39879ed-6f8f-4541-956f-7a34a963f7f8 req-fe62596b-b101-403c-9fac-b051e5f72cae tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.84 "DELETE /v2.0/ports/4f36023c-143c-4389-b26c-f62679404834 HTTP/1.1" status: 204 len: 173 time: 3.4477549 May 12 15:38:20.812048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'name': 'network-vif-deleted', 'tag': '4f36023c-143c-4389-b26c-f62679404834'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:38:20.849233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b0696c49-219c-40f8-acea-a927ab42a217 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for 5eebea01-7d6e-4574-8a3a-f06afeaef1cf owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:20.913970 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ef7fc6e5-baae-403a-b56b-90d079e36de3'] response: {'server_uuid': 'c8050ea5-bcaa-41bb-8286-f72cbe274af3', 'name': 'network-vif-deleted', 'tag': '4f36023c-143c-4389-b26c-f62679404834', 'status': 'completed', 'code': 200} May 12 15:38:20.947052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cd8442e-537c-4c82-a57e-d3597e837dca None None] Pushing event updated for resources: {'Port': ['ID=980e521e-27f1-4eeb-a586-9243c69f7517,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:20.970691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Transition to ACTIVE for port object 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:21.018059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Transition to ACTIVE for port object 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:21.028793 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:21.069110 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:21.204978 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Network 8ce74361-036e-4b19-b9d1-2b75a2ae9571 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:21.228492 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:21.232369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:21.244111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Pushing event updated for resources: {'Port': ['ID=8b4e70fe-09b8-4d59-aa6c-7b85953bcef8,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:21.274791 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7b9fe0f-4fb1-4384-bcf6-0f927f3cd59d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:21.313479 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0fb50a9d-f144-42fe-ac1d-77608561fb6a None None] Provisioning for port 5eebea01-7d6e-4574-8a3a-f06afeaef1cf completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:21.360869 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7b9fe0f-4fb1-4384-bcf6-0f927f3cd59d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:21.477655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7b9fe0f-4fb1-4384-bcf6-0f927f3cd59d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:21.550573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0fb50a9d-f144-42fe-ac1d-77608561fb6a None None] Provisioning complete for port 5eebea01-7d6e-4574-8a3a-f06afeaef1cf triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:21.551113 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0fb50a9d-f144-42fe-ac1d-77608561fb6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:21.609219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Allocated IP 2001:db8::1 (ff1e2484-ac35-4e14-aa85-193f3c121e48/400f4760-7cc3-4cf7-afb0-8bf1209cbe83/4367b7d5-68be-424d-a755-8196507a5486) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:21.630452 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.25.8.78 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/ecbe0d96-f591-4304-b41d-e71c4442cc0b) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:21.635714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7b9fe0f-4fb1-4384-bcf6-0f927f3cd59d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2a521ba-58f0-4348-9fcc-dc74cedcbb4f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:21.674959 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7b9fe0f-4fb1-4384-bcf6-0f927f3cd59d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:21.681657 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c7b9fe0f-4fb1-4384-bcf6-0f927f3cd59d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a2a521ba-58f0-4348-9fcc-dc74cedcbb4f HTTP/1.1" status: 204 len: 168 time: 1.3988078 May 12 15:38:21.727775 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b0696c49-219c-40f8-acea-a927ab42a217 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:21.763031 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Attempting to bind port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:38:21.763413 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Attempting to bind port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '73d0e46e-b7ec-4dc8-be38-786a1545a838', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '8ce74361-036e-4b19-b9d1-2b75a2ae9571'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:38:21.763734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Attempting to bind port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 on network 8ce74361-036e-4b19-b9d1-2b75a2ae9571 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:38:21.786198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 38, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:38:21.786583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Checking segment: {'id': '73d0e46e-b7ec-4dc8-be38-786a1545a838', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '8ce74361-036e-4b19-b9d1-2b75a2ae9571'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:38:21.787049 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:21.787623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Bound using segment: {'id': '73d0e46e-b7ec-4dc8-be38-786a1545a838', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '8ce74361-036e-4b19-b9d1-2b75a2ae9571'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:38:21.788262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Bound port: 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '73d0e46e-b7ec-4dc8-be38-786a1545a838', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': '8ce74361-036e-4b19-b9d1-2b75a2ae9571'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:38:21.788657 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:21.822306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0fb50a9d-f144-42fe-ac1d-77608561fb6a None None] Port 5eebea01-7d6e-4574-8a3a-f06afeaef1cf cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:38:21.875149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0696c49-219c-40f8-acea-a927ab42a217 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=5eebea01-7d6e-4574-8a3a-f06afeaef1cf,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:21.913119 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:21.970838 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0fb50a9d-f144-42fe-ac1d-77608561fb6a None None] Provisioning for port 87f4626e-eca9-462e-9ed2-e612952688b1 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:21.986715 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b0696c49-219c-40f8-acea-a927ab42a217 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:21.996851 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b0696c49-219c-40f8-acea-a927ab42a217 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/5eebea01-7d6e-4574-8a3a-f06afeaef1cf HTTP/1.1" status: 204 len: 168 time: 3.5346062 May 12 15:38:22.004641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33162) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:22.015265 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0fb50a9d-f144-42fe-ac1d-77608561fb6a None None] Provisioning complete for port 87f4626e-eca9-462e-9ed2-e612952688b1 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:22.016031 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0fb50a9d-f144-42fe-ac1d-77608561fb6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:22.110232 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:22.190576 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:22.254770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d63ec0c1-64d6-4998-994e-f9e3afd2a061 req-4914e104-16e0-4db4-998a-888d2d632d8d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Synchronizing usage tracker for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:22.256054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Transition to ACTIVE for port object 4367b7d5-68be-424d-a755-8196507a5486 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:22.262798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cdf9fedf-365d-4e32-a48f-b738e2bd9239 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:22.287900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25e710a3-016c-4651-8aff-6e520ed34c5d req-81557515-63dc-4a7e-a2e2-a61171895337 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.2809362 May 12 15:38:22.309996 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:22.321622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:22.334659 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:22.351687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:22.424654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d63ec0c1-64d6-4998-994e-f9e3afd2a061 req-4914e104-16e0-4db4-998a-888d2d632d8d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Unset dirty status for tenant:3dd1fe8ad774471ba7745219a37ead53 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:22.426121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d63ec0c1-64d6-4998-994e-f9e3afd2a061 req-4914e104-16e0-4db4-998a-888d2d632d8d tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "GET /v2.0/ports?device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 210 time: 0.9108028 May 12 15:38:22.439440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=ecbe0d96-f591-4304-b41d-e71c4442cc0b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:22.441334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Network ff1e2484-ac35-4e14-aa85-193f3c121e48 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:22.462587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:22.467894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4779d5c-9977-485f-b028-8a2b0f7d05b6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:22.470270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4779d5c-9977-485f-b028-8a2b0f7d05b6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:22.470394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:22.471508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c4779d5c-9977-485f-b028-8a2b0f7d05b6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:22.471796 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:22.524498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] For port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:38:22.557876 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] For port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=8b4e70fe-09b8-4d59-aa6c-7b85953bcef8,segment=NetworkSegment(73d0e46e-b7ec-4dc8-be38-786a1545a838),segment_id=73d0e46e-b7ec-4dc8-be38-786a1545a838)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:38:22.572972 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:22.608064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33172) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:22.660505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c67270f-e0dc-491b-a459-138f5b9b0f2a None None] Pushing event updated for resources: {'Port': ['ID=8b4e70fe-09b8-4d59-aa6c-7b85953bcef8,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:22.694731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event updated for resources: {'Port': ['ID=4367b7d5-68be-424d-a755-8196507a5486,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:22.711822 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-804140c6-8e52-4043-82f0-b713f9c55c4b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:22.749541 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0fb50a9d-f144-42fe-ac1d-77608561fb6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:22.768027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-804140c6-8e52-4043-82f0-b713f9c55c4b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:22.777490 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:22.783487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port cdf9fedf-365d-4e32-a48f-b738e2bd9239 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:22.783863 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:22.789921 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-804140c6-8e52-4043-82f0-b713f9c55c4b admin admin] Usage tracker for resource:security_group_rule and tenant:bf55e54e5cb349e69feab5a6865309fc is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:22.801796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-804140c6-8e52-4043-82f0-b713f9c55c4b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:22.816100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-804140c6-8e52-4043-82f0-b713f9c55c4b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:22.828283 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25e710a3-016c-4651-8aff-6e520ed34c5d req-d040202a-ca04-4131-9ed0-39848f851393 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3dd1fe8ad774471ba7745219a37ead53&device_id=c8050ea5-bcaa-41bb-8286-f72cbe274af3 HTTP/1.1" status: 200 len: 210 time: 0.3236296 May 12 15:38:22.831714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c4779d5c-9977-485f-b028-8a2b0f7d05b6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:22.832744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c4779d5c-9977-485f-b028-8a2b0f7d05b6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1451 time: 0.7463548 May 12 15:38:22.863955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33178) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:22.882870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0fb50a9d-f144-42fe-ac1d-77608561fb6a None None] For port 87f4626e-eca9-462e-9ed2-e612952688b1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=87f4626e-eca9-462e-9ed2-e612952688b1,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:22.903122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a505ba77-835a-42ad-8f13-321dbafbcab2 None None] Network ff1e2484-ac35-4e14-aa85-193f3c121e48 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:23.039922 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0fb50a9d-f144-42fe-ac1d-77608561fb6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:23.245957 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e710a3-016c-4651-8aff-6e520ed34c5d req-30eefe57-2245-4592-bc51-ad7636c84683 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:23.251400 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25e710a3-016c-4651-8aff-6e520ed34c5d req-30eefe57-2245-4592-bc51-ad7636c84683 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=3dd1fe8ad774471ba7745219a37ead53&shared=False HTTP/1.1" status: 200 len: 897 time: 0.3396852 May 12 15:38:23.257312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-a6c6b4f2-0765-4da7-9d70-86fd604e4835 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 80485e3f-9911-46cd-88e9-ff7d2634ee2b {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:38:23.278011 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-455aab5e-7642-4004-943c-b23a08623727 None None] Provisioning for port 980e521e-27f1-4eeb-a586-9243c69f7517 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:23.282661 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a6c6b4f2-0765-4da7-9d70-86fd604e4835 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:23.392065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fb50a9d-f144-42fe-ac1d-77608561fb6a None None] Pushing event updated for resources: {'Port': ['ID=87f4626e-eca9-462e-9ed2-e612952688b1,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:23.422618 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 980e521e-27f1-4eeb-a586-9243c69f7517 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:23.585982 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a6c6b4f2-0765-4da7-9d70-86fd604e4835 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:23.660983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33208) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:23.683830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 980e521e-27f1-4eeb-a586-9243c69f7517 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:23.702129 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 980e521e-27f1-4eeb-a586-9243c69f7517 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:23.702498 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:23.835851 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a6c6b4f2-0765-4da7-9d70-86fd604e4835 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:23.911045 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:23.926910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e710a3-016c-4651-8aff-6e520ed34c5d req-8385863c-252b-42bd-81ea-cff2f86ae514 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:23.929922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25e710a3-016c-4651-8aff-6e520ed34c5d req-8385863c-252b-42bd-81ea-cff2f86ae514 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.6387572 May 12 15:38:23.985781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 980e521e-27f1-4eeb-a586-9243c69f7517, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=980e521e-27f1-4eeb-a586-9243c69f7517,segment=NetworkSegment(20bf5b3e-bbbd-4e60-b09a-451438ef59de),segment_id=20bf5b3e-bbbd-4e60-b09a-451438ef59de)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:23.995762 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:24.026661 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:24.045266 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a6c6b4f2-0765-4da7-9d70-86fd604e4835 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:24.179337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=980e521e-27f1-4eeb-a586-9243c69f7517,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:24.183441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6c6b4f2-0765-4da7-9d70-86fd604e4835 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=80485e3f-9911-46cd-88e9-ff7d2634ee2b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:24.184217 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:24.411787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:24.437874 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-804140c6-8e52-4043-82f0-b713f9c55c4b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:24.447077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a6c6b4f2-0765-4da7-9d70-86fd604e4835 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:24.480036 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-804140c6-8e52-4043-82f0-b713f9c55c4b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:24.504499 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a6c6b4f2-0765-4da7-9d70-86fd604e4835 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/80485e3f-9911-46cd-88e9-ff7d2634ee2b HTTP/1.1" status: 204 len: 168 time: 1.6394429 May 12 15:38:24.516717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33222) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:24.519227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b82f0f1-492c-448d-bc9d-a6de1ebe9170 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:24.655215 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e296625e-8fc1-4af1-9968-13421920c6c1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1354434 May 12 15:38:24.656081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39913a02-89a4-43ba-84da-263815133578 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:24.670988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33226) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:24.671370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33228) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:24.730779 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] It took 0.21 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:38:24.774559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-804140c6-8e52-4043-82f0-b713f9c55c4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fdd3386b-aac1-4c54-bf7e-9b800db7dcd9,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:24.792967 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:24.797022 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-804140c6-8e52-4043-82f0-b713f9c55c4b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bf55e54e5cb349e69feab5a6865309fc&name=default HTTP/1.1" status: 200 len: 2983 time: 2.1774395 May 12 15:38:24.800293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33236) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:24.807895 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:24.814683 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:24.818338 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39913a02-89a4-43ba-84da-263815133578 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:24.820800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-296dbd53-bac3-4384-879b-8d2baa536cc0 None None] Network 8ce74361-036e-4b19-b9d1-2b75a2ae9571 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:24.845202 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:24.846005 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:24.902780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=ecbe0d96-f591-4304-b41d-e71c4442cc0b,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:25.031002 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc0fb22f-0c04-4791-b886-dbdfb0ac2847 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:25.059240 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc0fb22f-0c04-4791-b886-dbdfb0ac2847 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:25.114614 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:25.119700 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9bb2cf4b-a65a-486d-aedf-7e6dd08f0dba None None] Provisioning for port 4367b7d5-68be-424d-a755-8196507a5486 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:25.131841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9bb2cf4b-a65a-486d-aedf-7e6dd08f0dba None None] Provisioning complete for port 4367b7d5-68be-424d-a755-8196507a5486 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:25.132458 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9bb2cf4b-a65a-486d-aedf-7e6dd08f0dba None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:25.135026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Network ff1e2484-ac35-4e14-aa85-193f3c121e48 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:25.147068 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f34734d3-59cd-4599-9bf9-1506f8f74487 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:25.156577 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:25.161294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event updated for resources: {'Port': ['ID=4367b7d5-68be-424d-a755-8196507a5486,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:25.268591 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d28f957f-b30e-434f-b770-1e049db89107 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:25.269430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d28f957f-b30e-434f-b770-1e049db89107 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:25.290195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f34734d3-59cd-4599-9bf9-1506f8f74487 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:25.322963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:25.328599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9bb2cf4b-a65a-486d-aedf-7e6dd08f0dba None None] Port 4367b7d5-68be-424d-a755-8196507a5486 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:38:25.332238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 87f4626e-eca9-462e-9ed2-e612952688b1 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:25.381627 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39913a02-89a4-43ba-84da-263815133578 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:25.392987 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Floating IP 76bc9621-5546-42f8-8990-221fb5c6e31e associated. External IP: 172.25.8.78, port: fe574d75-b8e5-4d9b-9027-58c6118d9cd8. May 12 15:38:25.446237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f34734d3-59cd-4599-9bf9-1506f8f74487 admin admin] Usage tracker for resource:security_group_rule and tenant:812509c4be29447da1af0851438d5f3e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:25.457648 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc0fb22f-0c04-4791-b886-dbdfb0ac2847 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:25.477437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f34734d3-59cd-4599-9bf9-1506f8f74487 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:25.489956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39913a02-89a4-43ba-84da-263815133578 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=62da627b-8675-47b7-a69e-55dbeab2bd90,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:25.495513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f34734d3-59cd-4599-9bf9-1506f8f74487 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:25.507413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc0fb22f-0c04-4791-b886-dbdfb0ac2847 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fdd3386b-aac1-4c54-bf7e-9b800db7dcd9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:25.521409 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-39913a02-89a4-43ba-84da-263815133578 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:25.523754 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-39913a02-89a4-43ba-84da-263815133578 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "DELETE /v2.0/security-groups/62da627b-8675-47b7-a69e-55dbeab2bd90 HTTP/1.1" status: 204 len: 168 time: 1.8608594 May 12 15:38:25.524454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d28f957f-b30e-434f-b770-1e049db89107 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:25.528746 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d28f957f-b30e-434f-b770-1e049db89107 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.8520591 May 12 15:38:25.529433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33244) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:25.529688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33242) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:25.551404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1dd7a461-dcbe-448b-ac99-af1c8b29998b None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:38:25.580184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1dd7a461-dcbe-448b-ac99-af1c8b29998b None None] Deleting port 87f4626e-eca9-462e-9ed2-e612952688b1 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:25.580578 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1dd7a461-dcbe-448b-ac99-af1c8b29998b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:25.588110 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc0fb22f-0c04-4791-b886-dbdfb0ac2847 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:25.591467 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dc0fb22f-0c04-4791-b886-dbdfb0ac2847 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fdd3386b-aac1-4c54-bf7e-9b800db7dcd9 HTTP/1.1" status: 204 len: 168 time: 0.7878447 May 12 15:38:25.680050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b840d0bf-27ff-42cc-a075-f3d8f4ab98b9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:25.680705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b840d0bf-27ff-42cc-a075-f3d8f4ab98b9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:25.747159 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b840d0bf-27ff-42cc-a075-f3d8f4ab98b9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:25.750017 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b840d0bf-27ff-42cc-a075-f3d8f4ab98b9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2113481 May 12 15:38:25.753172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33254) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:25.782098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 87f4626e-eca9-462e-9ed2-e612952688b1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:25.782568 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:25.822526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9bb2cf4b-a65a-486d-aedf-7e6dd08f0dba None None] Provisioning complete for port 980e521e-27f1-4eeb-a586-9243c69f7517 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:25.822899 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9bb2cf4b-a65a-486d-aedf-7e6dd08f0dba None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:25.879039 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f55176d-f930-4968-abd4-ff9dd5309f6e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:25.880330 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e5e1338a-e501-466f-b9a8-24d1cc4400f2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1257544 May 12 15:38:25.883441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Router 0b891f9b-4350-4592-bcd3-b3900181c94c is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:38:25.885483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33260) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:25.964828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-99b351b3-b6be-4ec3-b764-848204878188 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:26.056566 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f55176d-f930-4968-abd4-ff9dd5309f6e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:26.141156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:38:26.165214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1dd7a461-dcbe-448b-ac99-af1c8b29998b None None] For port 87f4626e-eca9-462e-9ed2-e612952688b1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=87f4626e-eca9-462e-9ed2-e612952688b1,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:26.165672 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1dd7a461-dcbe-448b-ac99-af1c8b29998b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:26.347564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1dd7a461-dcbe-448b-ac99-af1c8b29998b None None] Calling delete_port for 87f4626e-eca9-462e-9ed2-e612952688b1 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:26.354422 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f34734d3-59cd-4599-9bf9-1506f8f74487 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:26.377782 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f34734d3-59cd-4599-9bf9-1506f8f74487 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:26.437086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:38:26.446595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-99b351b3-b6be-4ec3-b764-848204878188 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:26.449935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:38:26.452490 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ce0ac90-8998-4127-9494-d78478ca44a2 None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:38:26.464960 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f55176d-f930-4968-abd4-ff9dd5309f6e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:26.467537 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ce0ac90-8998-4127-9494-d78478ca44a2 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:26.467866 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f55176d-f930-4968-abd4-ff9dd5309f6e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:26.468358 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2ce0ac90-8998-4127-9494-d78478ca44a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:26.469873 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8f55176d-f930-4968-abd4-ff9dd5309f6e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "DELETE /v2.0/security-groups/9358f0f8-f7c3-47a6-a1a3-bfbe9808172b HTTP/1.1" status: 204 len: 168 time: 0.9357193 May 12 15:38:26.485228 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33274) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:26.486041 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:26.516188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f34734d3-59cd-4599-9bf9-1506f8f74487 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48add0c4-ee9b-4c39-9d39-ff8532d2c5ee,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:26.523785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05b7cc59-5d8c-409b-bc95-b479cde00a18 None None] Sync routers for ids ['0b891f9b-4350-4592-bcd3-b3900181c94c'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:38:26.554500 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f34734d3-59cd-4599-9bf9-1506f8f74487 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=812509c4be29447da1af0851438d5f3e&name=default HTTP/1.1" status: 200 len: 2983 time: 1.8820560 May 12 15:38:26.567604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-99b351b3-b6be-4ec3-b764-848204878188 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:26.572199 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33280) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:26.577131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05b7cc59-5d8c-409b-bc95-b479cde00a18 None None] Routers {'0b891f9b-4350-4592-bcd3-b3900181c94c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:26.578134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-05b7cc59-5d8c-409b-bc95-b479cde00a18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0b891f9b-4350-4592-bcd3-b3900181c94c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:26.598608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f55176d-f930-4968-abd4-ff9dd5309f6e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9358f0f8-f7c3-47a6-a1a3-bfbe9808172b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:26.598809 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2ce0ac90-8998-4127-9494-d78478ca44a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:26.619707 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0e81f5f7-e983-4131-bdb8-6105660e5ba2 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "PUT /v2.0/routers/0b891f9b-4350-4592-bcd3-b3900181c94c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.5104210 May 12 15:38:26.624610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33286) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:26.637122 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ce0ac90-8998-4127-9494-d78478ca44a2 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:26.637857 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2ce0ac90-8998-4127-9494-d78478ca44a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:26.659942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99b351b3-b6be-4ec3-b764-848204878188 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:26.664501 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-99b351b3-b6be-4ec3-b764-848204878188 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:26.692963 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1dd7a461-dcbe-448b-ac99-af1c8b29998b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:26.745657 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2ce0ac90-8998-4127-9494-d78478ca44a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:26.746100 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ce0ac90-8998-4127-9494-d78478ca44a2 None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:38:26.748096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd7a461-dcbe-448b-ac99-af1c8b29998b None None] Pushing event deleted for resources: {'Port': ['ID=87f4626e-eca9-462e-9ed2-e612952688b1,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:26.751373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-05b7cc59-5d8c-409b-bc95-b479cde00a18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:26.768834 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dd7a461-dcbe-448b-ac99-af1c8b29998b None None] No DVR routers for this DVR port 87f4626e-eca9-462e-9ed2-e612952688b1 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:38:26.782646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-12b34b18-14af-47af-a2dd-d676d28aea96 None None] Provisioning for port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:26.798617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-12b34b18-14af-47af-a2dd-d676d28aea96 None None] Provisioning complete for port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:26.798991 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-12b34b18-14af-47af-a2dd-d676d28aea96 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:26.888327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05b7cc59-5d8c-409b-bc95-b479cde00a18 None None] Routers {'0b891f9b-4350-4592-bcd3-b3900181c94c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:26.889101 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-05b7cc59-5d8c-409b-bc95-b479cde00a18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0b891f9b-4350-4592-bcd3-b3900181c94c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:27.016241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 980e521e-27f1-4eeb-a586-9243c69f7517 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:27.019730 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-eb267b87-c9bb-4b6a-b033-ed726708548b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 983 time: 7.4814475 May 12 15:38:27.038893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33296) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:27.096705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-05b7cc59-5d8c-409b-bc95-b479cde00a18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:27.097341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05b7cc59-5d8c-409b-bc95-b479cde00a18 None None] The sync data for ids ['0b891f9b-4350-4592-bcd3-b3900181c94c'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:38:27.110560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-916d2717-f6f9-4474-894e-98c2e2fdd49f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'floatingip': {'port_id': 'fe574d75-b8e5-4d9b-9027-58c6118d9cd8', 'fixed_ip_address': '172.20.0.12'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:27.191735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 980e521e-27f1-4eeb-a586-9243c69f7517 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:27.192223 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:27.337447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.objects.ports [None req-99b351b3-b6be-4ec3-b764-848204878188 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88151) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:38:27.338284 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2b03ab4-aeb0-41af-83d9-6573dbeb0614 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:27.341190 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-99b351b3-b6be-4ec3-b764-848204878188 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:27.346986 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-12b34b18-14af-47af-a2dd-d676d28aea96 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:27.439000 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2b03ab4-aeb0-41af-83d9-6573dbeb0614 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:27.508933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99b351b3-b6be-4ec3-b764-848204878188 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:27.513438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-99b351b3-b6be-4ec3-b764-848204878188 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:27.519459 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2b03ab4-aeb0-41af-83d9-6573dbeb0614 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:27.523755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99b351b3-b6be-4ec3-b764-848204878188 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:27.524273 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-99b351b3-b6be-4ec3-b764-848204878188 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:27.533537 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-916d2717-f6f9-4474-894e-98c2e2fdd49f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:27.560959 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6575c35-448b-43fe-8838-7b55eabf1939 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:27.567689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99b351b3-b6be-4ec3-b764-848204878188 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=38d0fc3b-0844-43a2-bda7-1c040e0ced61,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:27.571214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2b03ab4-aeb0-41af-83d9-6573dbeb0614 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48add0c4-ee9b-4c39-9d39-ff8532d2c5ee,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:27.597545 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2b03ab4-aeb0-41af-83d9-6573dbeb0614 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:27.599563 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e2b03ab4-aeb0-41af-83d9-6573dbeb0614 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/48add0c4-ee9b-4c39-9d39-ff8532d2c5ee HTTP/1.1" status: 204 len: 168 time: 1.0247550 May 12 15:38:27.617646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-12b34b18-14af-47af-a2dd-d676d28aea96 None None] For port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=8b4e70fe-09b8-4d59-aa6c-7b85953bcef8,segment=NetworkSegment(73d0e46e-b7ec-4dc8-be38-786a1545a838),segment_id=73d0e46e-b7ec-4dc8-be38-786a1545a838)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:27.619409 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-99b351b3-b6be-4ec3-b764-848204878188 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.6802504 May 12 15:38:27.622900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33314) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:27.642864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-08c8042e-4885-4dcc-b69e-b33823209281 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:27.826703 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-12b34b18-14af-47af-a2dd-d676d28aea96 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:27.951064 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-12b34b18-14af-47af-a2dd-d676d28aea96 None None] Provisioning complete for port 4367b7d5-68be-424d-a755-8196507a5486 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:27.951064 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-12b34b18-14af-47af-a2dd-d676d28aea96 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:27.953512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-08c8042e-4885-4dcc-b69e-b33823209281 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:27.953512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-08c8042e-4885-4dcc-b69e-b33823209281 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:27.953512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-08c8042e-4885-4dcc-b69e-b33823209281 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:27.953512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-08c8042e-4885-4dcc-b69e-b33823209281 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:27.961368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-08c8042e-4885-4dcc-b69e-b33823209281 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:27.964952 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08c8042e-4885-4dcc-b69e-b33823209281 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:28.012383 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 87f4626e-eca9-462e-9ed2-e612952688b1 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:38:28.130184 n-d-841483-1 neutron-server[88151]: INFO neutron.db.ipam_backend_mixin [None req-08c8042e-4885-4dcc-b69e-b33823209281 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 38d0fc3b-0844-43a2-bda7-1c040e0ced61 (CIDR: 2001:db8::/64) May 12 15:38:28.135604 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-08c8042e-4885-4dcc-b69e-b33823209281 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:38:28.136723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-08c8042e-4885-4dcc-b69e-b33823209281 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:38:28.139681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12b34b18-14af-47af-a2dd-d676d28aea96 None None] Pushing event updated for resources: {'Port': ['ID=8b4e70fe-09b8-4d59-aa6c-7b85953bcef8,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:28.166247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 87f4626e-eca9-462e-9ed2-e612952688b1 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:38:28.166782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 87f4626e-eca9-462e-9ed2-e612952688b1 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:38:28.190067 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-08c8042e-4885-4dcc-b69e-b33823209281 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.5492420 May 12 15:38:28.190854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33344) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:28.221512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a3dfb052-2363-4bef-b83a-8b4359f5135d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:28.280493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-12b34b18-14af-47af-a2dd-d676d28aea96 None None] Port 4367b7d5-68be-424d-a755-8196507a5486 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:38:28.336791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '38d0fc3b-0844-43a2-bda7-1c040e0ced61'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:38:28.336791 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:28.619198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Allocated IP 2001:db8::f816:3eff:fe5b:f711 (2447b094-d5d6-41ef-a146-2bf56f5399af/38d0fc3b-0844-43a2-bda7-1c040e0ced61/21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:28.623664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a3dfb052-2363-4bef-b83a-8b4359f5135d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:28.644145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a3dfb052-2363-4bef-b83a-8b4359f5135d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:28.652063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a3dfb052-2363-4bef-b83a-8b4359f5135d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:28.678482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a3dfb052-2363-4bef-b83a-8b4359f5135d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:28.704075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a3dfb052-2363-4bef-b83a-8b4359f5135d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:28.704075 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3dfb052-2363-4bef-b83a-8b4359f5135d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:29.072727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:29.306210 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-3e04a6ba-a9bf-4f9b-bfa8-7c01cee5e011 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:38:29.306210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3e04a6ba-a9bf-4f9b-bfa8-7c01cee5e011 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "PUT /v2.0/routers/0b891f9b-4350-4592-bcd3-b3900181c94c/add_router_interface HTTP/1.1" status: 400 len: 438 time: 2.6614938 May 12 15:38:29.306210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33374) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:29.553337 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3dfb052-2363-4bef-b83a-8b4359f5135d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:29.622591 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3dfb052-2363-4bef-b83a-8b4359f5135d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:29.626932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-a3dfb052-2363-4bef-b83a-8b4359f5135d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:29.655094 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:29.693738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Transition to ACTIVE for port object 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:29.696587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3dfb052-2363-4bef-b83a-8b4359f5135d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:29.711106 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3dfb052-2363-4bef-b83a-8b4359f5135d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:29.740790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Transition to ACTIVE for port object 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:29.740790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:29.740790 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:29.761010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3dfb052-2363-4bef-b83a-8b4359f5135d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=b30923ad-3873-49bf-a7f7-cb546155d9b7,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:29.795743 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a3dfb052-2363-4bef-b83a-8b4359f5135d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.5903840 May 12 15:38:29.795743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33388) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:29.795743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'mac_address': 'fa:16:3e:52:80:18', 'name': 'tempest-NetworksTestDHCPv6-1513924264'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:29.902941 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:29.942427 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:38:30.024824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:30.032792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:30.039431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:30.202452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:30.229448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:30.242111 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-916d2717-f6f9-4474-894e-98c2e2fdd49f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:38:30.262008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:30.299710 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Pushing event updated for resources: {'Port': ['ID=21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:30.322299 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc385c57-8dc0-4c29-a433-e0d541b28f2b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:30.357669 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Attempting to bind port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:38:30.358188 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Attempting to bind port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:38:30.358553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Attempting to bind port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:38:30.378173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 38, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:38:30.381973 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:38:30.382383 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:30.382778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:38:30.383266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Bound port: 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:38:30.383634 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:30.540112 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] For port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:38:30.544994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] For port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:38:30.548413 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:30.558020 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:30.663311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 5550f0a3-1374-45e0-88ee-6adf162bb656 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:38:30.749378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3da8bcd-ad26-475b-a071-b5b038c94472 None None] Pushing event updated for resources: {'Port': ['ID=21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:30.855179 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-916d2717-f6f9-4474-894e-98c2e2fdd49f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:30.866765 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-916d2717-f6f9-4474-894e-98c2e2fdd49f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:31.211486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8:0:1::21f (2447b094-d5d6-41ef-a146-2bf56f5399af/b30923ad-3873-49bf-a7f7-cb546155d9b7/5550f0a3-1374-45e0-88ee-6adf162bb656) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:31.220010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::f816:3eff:fe52:8018 (2447b094-d5d6-41ef-a146-2bf56f5399af/38d0fc3b-0844-43a2-bda7-1c040e0ced61/5550f0a3-1374-45e0-88ee-6adf162bb656) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:31.697879 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:31.732142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object 5550f0a3-1374-45e0-88ee-6adf162bb656 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:31.832942 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d670654-5678-4fba-9f57-9a65ba4a082e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:31.838545 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:31.991784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:31.996181 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:32.001883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:32.007625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:32.008588 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:32.034239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=5550f0a3-1374-45e0-88ee-6adf162bb656,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:32.042573 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6ae235bd-38a4-4efb-93c1-1243ac372cac tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1034 time: 2.2554405 May 12 15:38:32.044155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33436) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:32.206577 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8b4a99c8-0f83-47fa-8658-22b64f15790c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port 5550f0a3-1374-45e0-88ee-6adf162bb656 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:32.206577 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b4a99c8-0f83-47fa-8658-22b64f15790c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:32.406631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-bc385c57-8dc0-4c29-a433-e0d541b28f2b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Deleting port 63b42831-39a6-4a50-a6ab-4dce60dc93b6 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:32.406972 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc385c57-8dc0-4c29-a433-e0d541b28f2b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:32.451412 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:32.671152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b952b99-c56e-42aa-9d4e-f5bdaaf4635a None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:32.907800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-916d2717-f6f9-4474-894e-98c2e2fdd49f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:38:32.958388 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b4a99c8-0f83-47fa-8658-22b64f15790c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:33.070756 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:33.214796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-537b700a-1431-481d-915b-ae1697e163cb None None] Provisioning for port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:33.218762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-bc385c57-8dc0-4c29-a433-e0d541b28f2b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] For port 63b42831-39a6-4a50-a6ab-4dce60dc93b6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=63b42831-39a6-4a50-a6ab-4dce60dc93b6,segment=NetworkSegment(4dc52732-5577-45b0-b2eb-1c2616cc1c73),segment_id=4dc52732-5577-45b0-b2eb-1c2616cc1c73)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:33.218762 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc385c57-8dc0-4c29-a433-e0d541b28f2b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:33.222464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8b4a99c8-0f83-47fa-8658-22b64f15790c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for 5550f0a3-1374-45e0-88ee-6adf162bb656 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:33.276916 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:33.289094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:33.289500 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:33.516157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-bc385c57-8dc0-4c29-a433-e0d541b28f2b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Calling delete_port for 63b42831-39a6-4a50-a6ab-4dce60dc93b6 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:33.597498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c20e1c9-38e0-4164-a497-d977ab41b399 None None] Update dhcp port {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'fixed_ips': [{'subnet_id': '38d0fc3b-0844-43a2-bda7-1c040e0ced61', 'ip_address': '2001:db8::f816:3eff:fe5b:f711'}, {'subnet_id': 'b30923ad-3873-49bf-a7f7-cb546155d9b7'}], 'binding:host_id': 'n-d-841483-1'}, 'id': '21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:38:33.659089 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:33.769971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b4a99c8-0f83-47fa-8658-22b64f15790c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:34.023580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:34.023580 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6c20e1c9-38e0-4164-a497-d977ab41b399 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:34.112640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b4a99c8-0f83-47fa-8658-22b64f15790c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=5550f0a3-1374-45e0-88ee-6adf162bb656,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:34.195327 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:34.207402 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b4a99c8-0f83-47fa-8658-22b64f15790c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:34.218645 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8b4a99c8-0f83-47fa-8658-22b64f15790c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/5550f0a3-1374-45e0-88ee-6adf162bb656 HTTP/1.1" status: 204 len: 168 time: 2.1736002 May 12 15:38:34.220898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33476) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:34.230056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2d670654-5678-4fba-9f57-9a65ba4a082e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Deleting port 4367b7d5-68be-424d-a755-8196507a5486 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:34.230609 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d670654-5678-4fba-9f57-9a65ba4a082e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:34.382695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01d9fe1d-b923-4659-be95-2e5e5cb5bd59 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:34.382695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-01d9fe1d-b923-4659-be95-2e5e5cb5bd59 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:34.433502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-01d9fe1d-b923-4659-be95-2e5e5cb5bd59 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:34.433502 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-01d9fe1d-b923-4659-be95-2e5e5cb5bd59 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 963 time: 0.2112925 May 12 15:38:34.439935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33482) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:34.469144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:34.540950 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc385c57-8dc0-4c29-a433-e0d541b28f2b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:34.610311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-6c20e1c9-38e0-4164-a497-d977ab41b399 None None] Allocated IP 2001:db8:0:1::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/b30923ad-3873-49bf-a7f7-cb546155d9b7/21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:34.612797 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d670654-5678-4fba-9f57-9a65ba4a082e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:34.632927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84f1df35-4f24-44ed-b72d-5162c1b2845f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:34.641377 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-84f1df35-4f24-44ed-b72d-5162c1b2845f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 963 time: 0.2065151 May 12 15:38:34.642077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33490) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:34.797853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-6c20e1c9-38e0-4164-a497-d977ab41b399 None None] For port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:34.856802 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6c20e1c9-38e0-4164-a497-d977ab41b399 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:34.868865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd42fcee-2df7-4a90-9087-c0e385d529c0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:34.868865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd42fcee-2df7-4a90-9087-c0e385d529c0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:34.872541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2d670654-5678-4fba-9f57-9a65ba4a082e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Calling delete_port for 4367b7d5-68be-424d-a755-8196507a5486 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:34.894381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6c20e1c9-38e0-4164-a497-d977ab41b399 None None] Transition to ACTIVE for port object 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:34.897548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd42fcee-2df7-4a90-9087-c0e385d529c0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:34.897548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bd42fcee-2df7-4a90-9087-c0e385d529c0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:34.900724 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6c20e1c9-38e0-4164-a497-d977ab41b399 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:34.954981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bd42fcee-2df7-4a90-9087-c0e385d529c0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:34.961752 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bd42fcee-2df7-4a90-9087-c0e385d529c0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.3183610 May 12 15:38:34.962383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33498) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:35.022153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:35.060323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-1ca7f8b4-d94f-4c8e-bac9-aa1925f774db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 38d0fc3b-0844-43a2-bda7-1c040e0ced61 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:38:35.064096 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1ca7f8b4-d94f-4c8e-bac9-aa1925f774db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:35.177139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c20e1c9-38e0-4164-a497-d977ab41b399 None None] Pushing event updated for resources: {'Port': ['ID=21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:35.255123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-916d2717-f6f9-4474-894e-98c2e2fdd49f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:38:35.282666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc385c57-8dc0-4c29-a433-e0d541b28f2b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event deleted for resources: {'Port': ['ID=63b42831-39a6-4a50-a6ab-4dce60dc93b6,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:35.285677 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f5658c0-963f-4605-a530-868ad288b150 None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:38:35.313879 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f5658c0-963f-4605-a530-868ad288b150 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:35.313879 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7f5658c0-963f-4605-a530-868ad288b150 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:35.380118 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1ca7f8b4-d94f-4c8e-bac9-aa1925f774db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:35.430296 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7f5658c0-963f-4605-a530-868ad288b150 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:35.463507 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f5658c0-963f-4605-a530-868ad288b150 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:35.464130 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7f5658c0-963f-4605-a530-868ad288b150 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:35.568709 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-916d2717-f6f9-4474-894e-98c2e2fdd49f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:35.720677 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1ca7f8b4-d94f-4c8e-bac9-aa1925f774db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:35.812897 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7f5658c0-963f-4605-a530-868ad288b150 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:35.813319 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f5658c0-963f-4605-a530-868ad288b150 None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:38:35.945248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1ca7f8b4-d94f-4c8e-bac9-aa1925f774db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:36.011114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ca7f8b4-d94f-4c8e-bac9-aa1925f774db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=38d0fc3b-0844-43a2-bda7-1c040e0ced61,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:36.019847 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1ca7f8b4-d94f-4c8e-bac9-aa1925f774db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:36.027067 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d670654-5678-4fba-9f57-9a65ba4a082e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:36.046545 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1ca7f8b4-d94f-4c8e-bac9-aa1925f774db tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/38d0fc3b-0844-43a2-bda7-1c040e0ced61 HTTP/1.1" status: 204 len: 168 time: 1.0804555 May 12 15:38:36.046545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33512) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:36.253845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-a0a84d91-5286-4d1e-980c-7097b519467a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet b30923ad-3873-49bf-a7f7-cb546155d9b7 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:38:36.253845 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a0a84d91-5286-4d1e-980c-7097b519467a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:36.345021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33522) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:36.394860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d670654-5678-4fba-9f57-9a65ba4a082e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event deleted for resources: {'Port': ['ID=4367b7d5-68be-424d-a755-8196507a5486,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:36.453498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ce11e7a-a3f9-4fbf-ac56-ca4136ce36fb None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:36.466810 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a0a84d91-5286-4d1e-980c-7097b519467a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:36.669754 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6c88169-27ef-4ae1-8d92-7be83e92d925 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:36.687758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-981578a8-5b14-4854-ba5e-4fbd17d020ba None None] Provisioning for port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:36.700432 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-981578a8-5b14-4854-ba5e-4fbd17d020ba None None] Provisioning complete for port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:36.700432 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-981578a8-5b14-4854-ba5e-4fbd17d020ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:36.724182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c6c88169-27ef-4ae1-8d92-7be83e92d925 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:36.735311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c6c88169-27ef-4ae1-8d92-7be83e92d925 admin admin] Usage tracker for resource:security_group_rule and tenant:9e5237e8df374a099b289d294c117542 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:36.735311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c6c88169-27ef-4ae1-8d92-7be83e92d925 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:36.758282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c6c88169-27ef-4ae1-8d92-7be83e92d925 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:36.785333 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-916d2717-f6f9-4474-894e-98c2e2fdd49f tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "PUT /v2.0/floatingips/76bc9621-5546-42f8-8990-221fb5c6e31e HTTP/1.1" status: 200 len: 978 time: 9.7335036 May 12 15:38:36.803280 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc385c57-8dc0-4c29-a433-e0d541b28f2b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:36.811754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33534) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:37.028070 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6c88169-27ef-4ae1-8d92-7be83e92d925 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:37.054360 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6c88169-27ef-4ae1-8d92-7be83e92d925 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:37.069968 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a0a84d91-5286-4d1e-980c-7097b519467a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:37.081937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:37.142075 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d670654-5678-4fba-9f57-9a65ba4a082e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:37.150449 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-981578a8-5b14-4854-ba5e-4fbd17d020ba None None] Could not find standard attr ID for object 5550f0a3-1374-45e0-88ee-6adf162bb656. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:38:37.221981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:37.221981 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:37.287541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6c88169-27ef-4ae1-8d92-7be83e92d925 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fabaaf1e-9ac5-4b68-8d40-b6d951111fd5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:37.462573 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c6c88169-27ef-4ae1-8d92-7be83e92d925 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9e5237e8df374a099b289d294c117542&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1150687 May 12 15:38:37.470303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33548) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:37.678515 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79b864bc-27eb-4a0b-a293-464f826118b7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:37.704159 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a0a84d91-5286-4d1e-980c-7097b519467a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:37.780042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79b864bc-27eb-4a0b-a293-464f826118b7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:37.793980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0a84d91-5286-4d1e-980c-7097b519467a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=b30923ad-3873-49bf-a7f7-cb546155d9b7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:37.803225 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a0a84d91-5286-4d1e-980c-7097b519467a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:37.927121 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a0a84d91-5286-4d1e-980c-7097b519467a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/b30923ad-3873-49bf-a7f7-cb546155d9b7 HTTP/1.1" status: 204 len: 168 time: 1.8755841 May 12 15:38:37.927121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33556) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:38.062112 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-50d8ff4f-55b8-4bf9-921b-2e5dd74a3d1c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1346939 May 12 15:38:38.063726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33564) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:38.085338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:38.280675 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79b864bc-27eb-4a0b-a293-464f826118b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:38.310353 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44debf8b-9afc-42f8-a2a1-68b59fa38d8b None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:38.360818 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79b864bc-27eb-4a0b-a293-464f826118b7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:38.360818 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-79b864bc-27eb-4a0b-a293-464f826118b7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fabaaf1e-9ac5-4b68-8d40-b6d951111fd5 HTTP/1.1" status: 204 len: 168 time: 0.8827052 May 12 15:38:38.363926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79b864bc-27eb-4a0b-a293-464f826118b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fabaaf1e-9ac5-4b68-8d40-b6d951111fd5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:38.430280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:38.443305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:38.449819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:38.460105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:38.487908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:38.492059 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:38.594666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2d670654-5678-4fba-9f57-9a65ba4a082e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Router 0b891f9b-4350-4592-bcd3-b3900181c94c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:38:38.711422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a49209c3-fcda-49f5-82ed-db6b540bf6eb None None] Provisioning complete for port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:38.711422 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a49209c3-fcda-49f5-82ed-db6b540bf6eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:39.127544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33580) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:39.169134 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d7b078e2-5b70-49e7-8c02-82571bd5f77b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:39.209814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2e1d1401-d3ad-4d45-9cf4-b8781757a1cc tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port ecbe0d96-f591-4304-b41d-e71c4442cc0b {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:39.210251 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e1d1401-d3ad-4d45-9cf4-b8781757a1cc tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:39.233494 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-823379f8-bcef-4fce-a7a9-870b46573e23 None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:38:39.240902 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-823379f8-bcef-4fce-a7a9-870b46573e23 None None] Deleting port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:39.244011 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-823379f8-bcef-4fce-a7a9-870b46573e23 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:39.261648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d7b078e2-5b70-49e7-8c02-82571bd5f77b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:39.283989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d7b078e2-5b70-49e7-8c02-82571bd5f77b admin admin] Usage tracker for resource:security_group_rule and tenant:34cc59eece314ff3bfff9d3ec39d7b81 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:39.305761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d7b078e2-5b70-49e7-8c02-82571bd5f77b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:39.316524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d7b078e2-5b70-49e7-8c02-82571bd5f77b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:39.507802 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e1d1401-d3ad-4d45-9cf4-b8781757a1cc tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:39.507802 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e1d1401-d3ad-4d45-9cf4-b8781757a1cc tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:39.518689 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2d670654-5678-4fba-9f57-9a65ba4a082e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:38:39.535805 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2d670654-5678-4fba-9f57-9a65ba4a082e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "PUT /v2.0/routers/0b891f9b-4350-4592-bcd3-b3900181c94c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 10.2386241 May 12 15:38:39.565062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33588) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:39.626345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e0a3d72-9979-4458-a167-7294400a9604 None None] Sync routers for ids ['0b891f9b-4350-4592-bcd3-b3900181c94c'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:38:39.642803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e0a3d72-9979-4458-a167-7294400a9604 None None] Routers {'0b891f9b-4350-4592-bcd3-b3900181c94c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:39.642803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9e0a3d72-9979-4458-a167-7294400a9604 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0b891f9b-4350-4592-bcd3-b3900181c94c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:39.700943 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-edd713ff-9da0-41c0-b8ed-444fc6778cab tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] delete failed (client error): The resource could not be found. May 12 15:38:39.707752 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-edd713ff-9da0-41c0-b8ed-444fc6778cab tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "DELETE /v2.0/routers/tempest-non_exist_router-1580371997 HTTP/1.1" status: 404 len: 335 time: 0.1304617 May 12 15:38:39.707752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33592) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:39.725107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-acae9ac9-0517-4369-b944-d832fe9c539f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Request body: {'router': {'external_gateway_info': {'network_id': '0b891f9b-4350-4592-bcd3-b3900181c94c'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:39.729812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9e0a3d72-9979-4458-a167-7294400a9604 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:39.735380 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-823379f8-bcef-4fce-a7a9-870b46573e23 None None] For port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:39.735380 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-823379f8-bcef-4fce-a7a9-870b46573e23 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:39.756394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e0a3d72-9979-4458-a167-7294400a9604 None None] Routers {'0b891f9b-4350-4592-bcd3-b3900181c94c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:39.756394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9e0a3d72-9979-4458-a167-7294400a9604 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0b891f9b-4350-4592-bcd3-b3900181c94c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:39.871050 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-9e0a3d72-9979-4458-a167-7294400a9604 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:39.871511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e0a3d72-9979-4458-a167-7294400a9604 None None] The sync data for ids ['0b891f9b-4350-4592-bcd3-b3900181c94c'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:38:39.924253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.objects.ports [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=88151) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:38:39.951409 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bc385c57-8dc0-4c29-a433-e0d541b28f2b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:38:39.959065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2e1d1401-d3ad-4d45-9cf4-b8781757a1cc tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for ecbe0d96-f591-4304-b41d-e71c4442cc0b owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:39.990913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-823379f8-bcef-4fce-a7a9-870b46573e23 None None] Calling delete_port for 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:40.187844 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-823379f8-bcef-4fce-a7a9-870b46573e23 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:40.263672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-823379f8-bcef-4fce-a7a9-870b46573e23 None None] Pushing event deleted for resources: {'Port': ['ID=21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:40.294053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-823379f8-bcef-4fce-a7a9-870b46573e23 None None] No DVR routers for this DVR port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:38:40.457886 n-d-841483-1 neutron-server[88151]: WARNING neutron.services.revisions.revision_plugin [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Could not find related port for resource to bump revision. May 12 15:38:40.598394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.ipam_pluggable_backend [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Port 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 was deleted while updating it with an IPv6 auto-address. Ignoring. {{(pid=88151) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:597}} May 12 15:38:40.599665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.ipam_pluggable_backend [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Reverting IP allocation for 2001:db8::f816:3eff:fe5b:f711 {{(pid=88151) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:599}} May 12 15:38:40.625771 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:40.625771 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d7b078e2-5b70-49e7-8c02-82571bd5f77b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:40.690389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc385c57-8dc0-4c29-a433-e0d541b28f2b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:38:40.695155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=38cb4b0d-6258-4c5b-904b-a12c4bc812d7,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:40.695155 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-acae9ac9-0517-4369-b944-d832fe9c539f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:40.702106 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bc385c57-8dc0-4c29-a433-e0d541b28f2b tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "PUT /v2.0/routers/6c52b572-4880-47dd-bc9e-8f2160f5c2e4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 14.1843414 May 12 15:38:40.702106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33612) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:40.705179 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d7b078e2-5b70-49e7-8c02-82571bd5f77b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:40.709794 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d223c1fe-5f4c-418a-8388-a4b6893ce7cf None None] Sync routers for ids ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:38:40.736358 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d223c1fe-5f4c-418a-8388-a4b6893ce7cf None None] Routers {'6c52b572-4880-47dd-bc9e-8f2160f5c2e4'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:40.736358 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d223c1fe-5f4c-418a-8388-a4b6893ce7cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:40.752209 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d7b078e2-5b70-49e7-8c02-82571bd5f77b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=34cc59eece314ff3bfff9d3ec39d7b81&name=default HTTP/1.1" status: 200 len: 2983 time: 1.6196108 May 12 15:38:40.762863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33616) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:40.766680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:40.766680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:40.766680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:40.766680 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:40.775469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ed98767-fc1a-4ac3-8989-2019ced017a4 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:40.882774 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-acae9ac9-0517-4369-b944-d832fe9c539f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] update failed (client error): The resource could not be found. May 12 15:38:40.883802 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-acae9ac9-0517-4369-b944-d832fe9c539f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "PUT /v2.0/routers/0b891f9b-4350-4592-bcd3-b3900181c94c HTTP/1.1" status: 404 len: 339 time: 1.1745625 May 12 15:38:40.884492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7b078e2-5b70-49e7-8c02-82571bd5f77b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ad4dd0d-63b0-4e29-ad75-bff14fe22108,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:40.892751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33620) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:40.907402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-1505283204'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:40.921738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:40.932526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Usage tracker for resource:network and tenant:7fab164333c84a019a5a0e9436b3a8df is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:40.935479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Quota usage for network was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:40.966168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:41.000859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Made reservation on behalf of 7fab164333c84a019a5a0e9436b3a8df for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:41.005342 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:41.022430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:38:41.042778 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e0b6283b-29d5-488e-85e6-06432ad4f0be tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.9764829 May 12 15:38:41.045772 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e1d1401-d3ad-4d45-9cf4-b8781757a1cc tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:41.047884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33626) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:41.051221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 566} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:38:41.105200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-38029990-69a7-4b74-9fab-0481770d57ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:41.123026 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d223c1fe-5f4c-418a-8388-a4b6893ce7cf None None] Set router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:38:41.126434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:38:41.126434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 21bb4e83-57d5-41ce-a3d1-03ddc9b1cd93 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:38:41.194338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-c3b6cda5-8a19-4cb2-aa36-3f3e44d42d4e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Deleting subnet 27cd1f2e-8b9d-4298-a44b-ce82945125a8 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:38:41.202722 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:41.205613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e1d1401-d3ad-4d45-9cf4-b8781757a1cc tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Port': ['ID=ecbe0d96-f591-4304-b41d-e71c4442cc0b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:41.212072 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Added segment 19660022-17a8-473d-9896-f59cce2ae64e of type vlan for network c9a6bb00-bbac-4814-bdfd-4659f4eb623c May 12 15:38:41.215094 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3b6cda5-8a19-4cb2-aa36-3f3e44d42d4e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:41.338383 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:41.357312 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3a5b68b2-39cb-4208-a4d2-2141cde1398d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:41.410583 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3a5b68b2-39cb-4208-a4d2-2141cde1398d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:41.411360 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:41.419491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': '38cb4b0d-6258-4c5b-904b-a12c4bc812d7'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:38:41.419658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:41.420180 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:41.420312 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:41.503848 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3a5b68b2-39cb-4208-a4d2-2141cde1398d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:41.527248 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3b6cda5-8a19-4cb2-aa36-3f3e44d42d4e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:41.736796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Allocated IP 2001:db8::f816:3eff:fe71:148c (2447b094-d5d6-41ef-a146-2bf56f5399af/38cb4b0d-6258-4c5b-904b-a12c4bc812d7/aec884a7-8012-4fb8-9e21-066760a3e1d2) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:41.743041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a5b68b2-39cb-4208-a4d2-2141cde1398d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ad4dd0d-63b0-4e29-ad75-bff14fe22108,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:41.774107 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e1d1401-d3ad-4d45-9cf4-b8781757a1cc tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:41.774447 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-2e1d1401-d3ad-4d45-9cf4-b8781757a1cc tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Floating IP 76bc9621-5546-42f8-8990-221fb5c6e31e disassociated (deleted). External IP: 172.25.8.78, port: fe574d75-b8e5-4d9b-9027-58c6118d9cd8. May 12 15:38:41.865511 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 0.9683621 May 12 15:38:41.879593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33640) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:41.903072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Request body: {'subnet': {'network_id': 'c9a6bb00-bbac-4814-bdfd-4659f4eb623c', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:42.000758 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d223c1fe-5f4c-418a-8388-a4b6893ce7cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:38:33Z', 'revision_number': 5, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:42.013606 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d223c1fe-5f4c-418a-8388-a4b6893ce7cf None None] Checking router: 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:38:42.038157 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d223c1fe-5f4c-418a-8388-a4b6893ce7cf None None] Routers {'6c52b572-4880-47dd-bc9e-8f2160f5c2e4'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:42.038157 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d223c1fe-5f4c-418a-8388-a4b6893ce7cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:42.199963 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:42.211731 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Transition to ACTIVE for port object aec884a7-8012-4fb8-9e21-066760a3e1d2 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:42.233936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Transition to ACTIVE for port object aec884a7-8012-4fb8-9e21-066760a3e1d2 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:42.242843 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:42.261703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f28a8ae-7f99-4d7b-aad5-11bf2242797f tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event updated for resources: {'Network': ['ID=c9a6bb00-bbac-4814-bdfd-4659f4eb623c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:42.329116 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3a5b68b2-39cb-4208-a4d2-2141cde1398d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:42.331212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network c9a6bb00-bbac-4814-bdfd-4659f4eb623c details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:38:42.360393 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3a5b68b2-39cb-4208-a4d2-2141cde1398d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1ad4dd0d-63b0-4e29-ad75-bff14fe22108 HTTP/1.1" status: 204 len: 168 time: 1.6032712 May 12 15:38:42.375933 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d223c1fe-5f4c-418a-8388-a4b6893ce7cf None None] Set router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:38:42.525095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-38029990-69a7-4b74-9fab-0481770d57ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:42.548757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-38029990-69a7-4b74-9fab-0481770d57ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:42.562346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-38029990-69a7-4b74-9fab-0481770d57ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:42.582781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:42.593582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-38029990-69a7-4b74-9fab-0481770d57ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:42.597461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Usage tracker for resource:subnet and tenant:7fab164333c84a019a5a0e9436b3a8df is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:42.606850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Quota usage for subnet was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:42.630566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attempting to reserve 1 items for resource subnet. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:42.646102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38029990-69a7-4b74-9fab-0481770d57ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:42.653438 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-38029990-69a7-4b74-9fab-0481770d57ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:42.825216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Pushing event updated for resources: {'Port': ['ID=aec884a7-8012-4fb8-9e21-066760a3e1d2,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:42.847587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Made reservation on behalf of 7fab164333c84a019a5a0e9436b3a8df for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:42.860835 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:42.867260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:42.867260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:42.867260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:42.921348 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3b6cda5-8a19-4cb2-aa36-3f3e44d42d4e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:43.030958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2e1d1401-d3ad-4d45-9cf4-b8781757a1cc tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:38:43.113543 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-91fcce91-5436-491a-8aaf-0b63ccaedcca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:43.210067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Attempting to bind port aec884a7-8012-4fb8-9e21-066760a3e1d2 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:38:43.210067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Attempting to bind port aec884a7-8012-4fb8-9e21-066760a3e1d2 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:38:43.210067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Attempting to bind port aec884a7-8012-4fb8-9e21-066760a3e1d2 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:38:43.214691 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d223c1fe-5f4c-418a-8388-a4b6893ce7cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:38:33Z', 'revision_number': 5, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:43.216839 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:43.220865 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 38, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:38:43.220865 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:38:43.220865 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:43.223482 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d223c1fe-5f4c-418a-8388-a4b6893ce7cf None None] The sync data for ids ['6c52b572-4880-47dd-bc9e-8f2160f5c2e4'] in n-d-841483-1 is: [{'id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1433085786', 'tenant_id': '3dd1fe8ad774471ba7745219a37ead53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115'}], 'enable_snat': True}, 'gw_port_id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:35:20Z', 'updated_at': '2022-05-12T15:38:33Z', 'revision_number': 5, 'project_id': '3dd1fe8ad774471ba7745219a37ead53', 'gw_port': {'id': 'a983e56b-eb5d-4657-9548-7a0bf06a02ad', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:c5:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c52b572-4880-47dd-bc9e-8f2160f5c2e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2702, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:35:22Z', 'updated_at': '2022-05-12T15:35:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:38:43.225050 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:38:43.225050 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Bound port: aec884a7-8012-4fb8-9e21-066760a3e1d2, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:38:43.225050 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:43.364415 n-d-841483-1 neutron-server[88151]: INFO neutron.db.ipam_backend_mixin [None req-38029990-69a7-4b74-9fab-0481770d57ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 38cb4b0d-6258-4c5b-904b-a12c4bc812d7 (CIDR: 2001:db8::/64) May 12 15:38:43.391219 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-38029990-69a7-4b74-9fab-0481770d57ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:38:43.391877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-38029990-69a7-4b74-9fab-0481770d57ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:38:43.449279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] For port aec884a7-8012-4fb8-9e21-066760a3e1d2, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:38:43.454741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] For port aec884a7-8012-4fb8-9e21-066760a3e1d2, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=aec884a7-8012-4fb8-9e21-066760a3e1d2,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:38:43.470272 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:43.504669 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-38029990-69a7-4b74-9fab-0481770d57ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 2.4553714 May 12 15:38:43.508502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33672) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:43.539953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-abcce6a4-415e-4197-8186-847b3e82a192 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:43.629785 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3b6cda5-8a19-4cb2-aa36-3f3e44d42d4e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:43.685909 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87e0f863-0fb0-42d8-9393-08e9276dbebb None None] Pushing event updated for resources: {'Port': ['ID=aec884a7-8012-4fb8-9e21-066760a3e1d2,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:43.989153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-abcce6a4-415e-4197-8186-847b3e82a192 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:43.993962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-abcce6a4-415e-4197-8186-847b3e82a192 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:43.993962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-abcce6a4-415e-4197-8186-847b3e82a192 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:44.013235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-abcce6a4-415e-4197-8186-847b3e82a192 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:44.026616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-abcce6a4-415e-4197-8186-847b3e82a192 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:44.040729 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abcce6a4-415e-4197-8186-847b3e82a192 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:44.062384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3b6cda5-8a19-4cb2-aa36-3f3e44d42d4e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event deleted for resources: {'Subnet': ['ID=27cd1f2e-8b9d-4298-a44b-ce82945125a8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:44.071320 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3b6cda5-8a19-4cb2-aa36-3f3e44d42d4e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:44.075726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d2318fc-0f32-47b3-9084-fb2284e71e70 None None] Network d2e823c6-8acb-45b9-910c-0a4822a68f25 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:44.092280 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c3b6cda5-8a19-4cb2-aa36-3f3e44d42d4e tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "DELETE /v2.0/subnets/27cd1f2e-8b9d-4298-a44b-ce82945125a8 HTTP/1.1" status: 204 len: 168 time: 3.3886690 May 12 15:38:44.092280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33686) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:44.104137 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:44.250007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2e1d1401-d3ad-4d45-9cf4-b8781757a1cc tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:38:44.260202 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e1d1401-d3ad-4d45-9cf4-b8781757a1cc tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:44.357329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33696) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:44.361605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2e1d1401-d3ad-4d45-9cf4-b8781757a1cc tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/floatingips/76bc9621-5546-42f8-8990-221fb5c6e31e HTTP/1.1" status: 204 len: 168 time: 7.5542386 May 12 15:38:44.503824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5cd5b47-0f74-40e1-903c-aa253f0a32a9 None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:38:44.578531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event updated for resources: {'Subnet': ['ID=8c735b68-13dc-4d08-a1f8-f08b9ae4ff6b,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:44.622633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5cd5b47-0f74-40e1-903c-aa253f0a32a9 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:44.622633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f5cd5b47-0f74-40e1-903c-aa253f0a32a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:44.701413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-87d7a316-6502-499b-8650-d30b8f47abe1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port fe574d75-b8e5-4d9b-9027-58c6118d9cd8 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:44.703051 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87d7a316-6502-499b-8650-d30b8f47abe1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:44.710342 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:44.743183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Checking segment: {'id': '19660022-17a8-473d-9896-f59cce2ae64e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'c9a6bb00-bbac-4814-bdfd-4659f4eb623c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:38:44.745271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Network hostable DHCP agents. Network: c9a6bb00-bbac-4814-bdfd-4659f4eb623c, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:38:44.798761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f5cd5b47-0f74-40e1-903c-aa253f0a32a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:44.871211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5cd5b47-0f74-40e1-903c-aa253f0a32a9 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:38:44.874690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Network c9a6bb00-bbac-4814-bdfd-4659f4eb623c is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:38:44.882336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f5cd5b47-0f74-40e1-903c-aa253f0a32a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:45.155565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, c9a6bb00-bbac-4814-bdfd-4659f4eb623c) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:45.194039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:45.195011 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:45.210923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd79578c-0dfc-4f6b-82ee-fb9b4f90d49b None None] Network c9a6bb00-bbac-4814-bdfd-4659f4eb623c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:45.259568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device aec884a7-8012-4fb8-9e21-066760a3e1d2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:45.284266 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:45.340416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Deleting port a983e56b-eb5d-4657-9548-7a0bf06a02ad {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:45.340416 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:45.442471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f5cd5b47-0f74-40e1-903c-aa253f0a32a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:45.442471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5cd5b47-0f74-40e1-903c-aa253f0a32a9 None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:38:45.625697 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f862b772-ef2e-4e0e-a58d-cca7a2a4de06 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 3.7180595 May 12 15:38:45.628730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33734) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:45.712624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-9e9be584-0043-4d4b-b604-c5353ba55fc8 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Request body: {'router': {'external_gateway_info': {'network_id': 'c9a6bb00-bbac-4814-bdfd-4659f4eb623c'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:45.856834 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6bd3175a-a226-427b-9bac-74e620ef44fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:45.941411 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87d7a316-6502-499b-8650-d30b8f47abe1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:45.963705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab931a68-77d3-46a6-a884-cb8f017ae1f9 None None] DHCP port deletion for d2e823c6-8acb-45b9-910c-0a4822a68f25 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:38:46.041625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] For port a983e56b-eb5d-4657-9548-7a0bf06a02ad, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a983e56b-eb5d-4657-9548-7a0bf06a02ad,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:46.041625 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:46.055121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ab931a68-77d3-46a6-a884-cb8f017ae1f9 None None] Deleting port 4777b5ea-852f-4989-a7e6-a649768384c2 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:46.055121 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ab931a68-77d3-46a6-a884-cb8f017ae1f9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:46.172841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port aec884a7-8012-4fb8-9e21-066760a3e1d2 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:46.448443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 63b42831-39a6-4a50-a6ab-4dce60dc93b6 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:38:46.506197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Calling delete_port for a983e56b-eb5d-4657-9548-7a0bf06a02ad owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:46.573058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 63b42831-39a6-4a50-a6ab-4dce60dc93b6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:38:46.573058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 63b42831-39a6-4a50-a6ab-4dce60dc93b6 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:38:46.598312 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:46.609711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-87d7a316-6502-499b-8650-d30b8f47abe1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for fe574d75-b8e5-4d9b-9027-58c6118d9cd8 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:46.650218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-764636cc-da00-4650-a52b-35ab1b3021b0 None None] Provisioning for port aec884a7-8012-4fb8-9e21-066760a3e1d2 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:46.721876 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:46.730344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-764636cc-da00-4650-a52b-35ab1b3021b0 None None] Provisioning complete for port aec884a7-8012-4fb8-9e21-066760a3e1d2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:46.730716 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-764636cc-da00-4650-a52b-35ab1b3021b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:46.899241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33754) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:46.926483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-c9a6bb00-bbac-4814-bdfd-4659f4eb623c', 'network_id': 'c9a6bb00-bbac-4814-bdfd-4659f4eb623c', 'tenant_id': '7fab164333c84a019a5a0e9436b3a8df', 'fixed_ips': [{'subnet_id': '8c735b68-13dc-4d08-a1f8-f08b9ae4ff6b'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:38:46.926483 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:46.930535 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:47.112162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event deleted for resources: {'Port': ['ID=a983e56b-eb5d-4657-9548-7a0bf06a02ad,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:47.196796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ab931a68-77d3-46a6-a884-cb8f017ae1f9 None None] For port 4777b5ea-852f-4989-a7e6-a649768384c2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4777b5ea-852f-4989-a7e6-a649768384c2,segment=NetworkSegment(4dc52732-5577-45b0-b2eb-1c2616cc1c73),segment_id=4dc52732-5577-45b0-b2eb-1c2616cc1c73)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:47.196796 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ab931a68-77d3-46a6-a884-cb8f017ae1f9 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:47.318980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4777b5ea-852f-4989-a7e6-a649768384c2 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:38:47.352818 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-da0bb1c7-b826-4266-b175-acbe457d1b64 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:47.382557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-da0bb1c7-b826-4266-b175-acbe457d1b64 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:47.388566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-da0bb1c7-b826-4266-b175-acbe457d1b64 admin admin] Usage tracker for resource:security_group_rule and tenant:320b998e0d8d4b8d97dde446833c7aa3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:47.443529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-da0bb1c7-b826-4266-b175-acbe457d1b64 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:47.483128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-da0bb1c7-b826-4266-b175-acbe457d1b64 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:47.552710 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9e9be584-0043-4d4b-b604-c5353ba55fc8 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:47.628853 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abcce6a4-415e-4197-8186-847b3e82a192 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:47.665065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Allocated IP 2001:db8:1::2 (c9a6bb00-bbac-4814-bdfd-4659f4eb623c/8c735b68-13dc-4d08-a1f8-f08b9ae4ff6b/de80ba7e-13c7-46eb-b13c-cd31ade2e2af) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:47.760130 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:47.877561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-abcce6a4-415e-4197-8186-847b3e82a192 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:47.898236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-abcce6a4-415e-4197-8186-847b3e82a192 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:47.898236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abcce6a4-415e-4197-8186-847b3e82a192 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:47.898236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abcce6a4-415e-4197-8186-847b3e82a192 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:47.950519 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-da0bb1c7-b826-4266-b175-acbe457d1b64 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:48.093935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abcce6a4-415e-4197-8186-847b3e82a192 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=87a57b78-71e7-407e-908a-83dd27ff897f,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:48.154989 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-da0bb1c7-b826-4266-b175-acbe457d1b64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:48.159527 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-abcce6a4-415e-4197-8186-847b3e82a192 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 4.6423161 May 12 15:38:48.178448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33772) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:48.188411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'mac_address': 'fa:16:3e:7e:df:ad', 'name': 'tempest-NetworksTestDHCPv6-201744855'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:48.226015 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-da0bb1c7-b826-4266-b175-acbe457d1b64 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=320b998e0d8d4b8d97dde446833c7aa3&name=default HTTP/1.1" status: 200 len: 2983 time: 1.3284588 May 12 15:38:48.226680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33776) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:48.294568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ab931a68-77d3-46a6-a884-cb8f017ae1f9 None None] Calling delete_port for 4777b5ea-852f-4989-a7e6-a649768384c2 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:48.502153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb58e4dc-e6e0-458a-83f0-4497e295ee5a None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:48.511826 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-9e9be584-0043-4d4b-b604-c5353ba55fc8 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:38:48.511826 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9e9be584-0043-4d4b-b604-c5353ba55fc8 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "PUT /v2.0/routers/0b891f9b-4350-4592-bcd3-b3900181c94c HTTP/1.1" status: 400 len: 364 time: 2.8589666 May 12 15:38:48.518827 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:48.518827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33780) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:48.568472 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87d7a316-6502-499b-8650-d30b8f47abe1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:48.572526 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:48.572526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da0bb1c7-b826-4266-b175-acbe457d1b64 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62937e7f-679c-4794-bd76-ffd95eaa2666,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:48.714981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87d7a316-6502-499b-8650-d30b8f47abe1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Port': ['ID=fe574d75-b8e5-4d9b-9027-58c6118d9cd8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:48.997998 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-326468ac-127f-451f-82bd-08f2de6b507e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:49.078629 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:49.079416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Fanout notify agent at l3_agent the message router_deleted on router 6c52b572-4880-47dd-bc9e-8f2160f5c2e4 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:38:49.097487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:49.135696 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:49.205514 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-326468ac-127f-451f-82bd-08f2de6b507e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:49.209909 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:49.240705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Transition to ACTIVE for port object de80ba7e-13c7-46eb-b13c-cd31ade2e2af will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:49.275524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Transition to ACTIVE for port object de80ba7e-13c7-46eb-b13c-cd31ade2e2af will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:49.296250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:port and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:49.310409 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:49.320301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:49.353693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:49.408173 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87d7a316-6502-499b-8650-d30b8f47abe1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:49.410209 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-87d7a316-6502-499b-8650-d30b8f47abe1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/ports/fe574d75-b8e5-4d9b-9027-58c6118d9cd8 HTTP/1.1" status: 204 len: 168 time: 5.0488498 May 12 15:38:49.411209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:49.423808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33796) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:49.452739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:49.483126 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:49.664805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Network c9a6bb00-bbac-4814-bdfd-4659f4eb623c is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:49.669643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:49.705644 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ab931a68-77d3-46a6-a884-cb8f017ae1f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:49.705644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:49.705644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Pushing event updated for resources: {'Port': ['ID=de80ba7e-13c7-46eb-b13c-cd31ade2e2af,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:49.717564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:49.751742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:49.751742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:49.751742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:49.751742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:49.751742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:49.751742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:49.751742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:49.751742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:49.751742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:49.751742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:49.751742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:49.751742 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:49.761156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:floatingip and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:49.777432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:49.797578 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:49.822492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:49.866312 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:49.871477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port d32d24d1-93b9-4c91-95fb-e8987be16d8b yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:38:49.876606 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f68e40e7-6333-416a-a811-e65958d81d33 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "DELETE /v2.0/routers/6c52b572-4880-47dd-bc9e-8f2160f5c2e4 HTTP/1.1" status: 204 len: 168 time: 5.7833319 May 12 15:38:49.880104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33806) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:49.891111 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:50.108706 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-764636cc-da00-4650-a52b-35ab1b3021b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:50.164456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab931a68-77d3-46a6-a884-cb8f017ae1f9 None None] Pushing event deleted for resources: {'Port': ['ID=4777b5ea-852f-4989-a7e6-a649768384c2,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:50.189659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab931a68-77d3-46a6-a884-cb8f017ae1f9 None None] No DVR routers for this DVR port 4777b5ea-852f-4989-a7e6-a649768384c2 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:38:50.244949 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Attempting to bind port de80ba7e-13c7-46eb-b13c-cd31ade2e2af on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:38:50.245597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Attempting to bind port de80ba7e-13c7-46eb-b13c-cd31ade2e2af by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '19660022-17a8-473d-9896-f59cce2ae64e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'c9a6bb00-bbac-4814-bdfd-4659f4eb623c'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:38:50.246186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Attempting to bind port de80ba7e-13c7-46eb-b13c-cd31ade2e2af on network c9a6bb00-bbac-4814-bdfd-4659f4eb623c {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:38:50.263928 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 38, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:38:50.264421 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Checking segment: {'id': '19660022-17a8-473d-9896-f59cce2ae64e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'c9a6bb00-bbac-4814-bdfd-4659f4eb623c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:38:50.264845 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:50.265349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Bound using segment: {'id': '19660022-17a8-473d-9896-f59cce2ae64e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'c9a6bb00-bbac-4814-bdfd-4659f4eb623c'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:38:50.265955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Bound port: de80ba7e-13c7-46eb-b13c-cd31ade2e2af, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '19660022-17a8-473d-9896-f59cce2ae64e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'c9a6bb00-bbac-4814-bdfd-4659f4eb623c'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:38:50.266436 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:50.386474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-764636cc-da00-4650-a52b-35ab1b3021b0 None None] For port aec884a7-8012-4fb8-9e21-066760a3e1d2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=aec884a7-8012-4fb8-9e21-066760a3e1d2,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:50.556370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a983e56b-eb5d-4657-9548-7a0bf06a02ad no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:38:50.557071 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:50.676065 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-764636cc-da00-4650-a52b-35ab1b3021b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:50.726422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: a983e56b-eb5d-4657-9548-7a0bf06a02ad {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:38:50.726422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a983e56b-eb5d-4657-9548-7a0bf06a02ad not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:38:50.831430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] For port de80ba7e-13c7-46eb-b13c-cd31ade2e2af, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:38:50.831430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-764636cc-da00-4650-a52b-35ab1b3021b0 None None] Pushing event updated for resources: {'Port': ['ID=aec884a7-8012-4fb8-9e21-066760a3e1d2,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:50.842600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] For port de80ba7e-13c7-46eb-b13c-cd31ade2e2af, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=de80ba7e-13c7-46eb-b13c-cd31ade2e2af,segment=NetworkSegment(19660022-17a8-473d-9896-f59cce2ae64e),segment_id=19660022-17a8-473d-9896-f59cce2ae64e)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:38:50.842600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b12e3fc2-a313-4211-a57f-a75fbbd581af None None] Update dhcp port {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'fixed_ips': [{'subnet_id': '38cb4b0d-6258-4c5b-904b-a12c4bc812d7', 'ip_address': '2001:db8::f816:3eff:fe71:148c'}, {'subnet_id': '87a57b78-71e7-407e-908a-83dd27ff897f'}], 'binding:host_id': 'n-d-841483-1'}, 'id': 'aec884a7-8012-4fb8-9e21-066760a3e1d2'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:38:50.879208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8:0:1::118 (2447b094-d5d6-41ef-a146-2bf56f5399af/87a57b78-71e7-407e-908a-83dd27ff897f/d32d24d1-93b9-4c91-95fb-e8987be16d8b) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:50.909446 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-326468ac-127f-451f-82bd-08f2de6b507e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:50.910777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::f816:3eff:fe7e:dfad (2447b094-d5d6-41ef-a146-2bf56f5399af/38cb4b0d-6258-4c5b-904b-a12c4bc812d7/d32d24d1-93b9-4c91-95fb-e8987be16d8b) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:50.921944 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:51.108924 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19c8118b-139b-4d53-a59c-b1b905eb996c None None] Pushing event updated for resources: {'Port': ['ID=de80ba7e-13c7-46eb-b13c-cd31ade2e2af,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:51.141739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-326468ac-127f-451f-82bd-08f2de6b507e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62937e7f-679c-4794-bd76-ffd95eaa2666,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:51.171086 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b12e3fc2-a313-4211-a57f-a75fbbd581af None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:51.213713 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-326468ac-127f-451f-82bd-08f2de6b507e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:51.213713 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-326468ac-127f-451f-82bd-08f2de6b507e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/62937e7f-679c-4794-bd76-ffd95eaa2666 HTTP/1.1" status: 204 len: 168 time: 2.8741639 May 12 15:38:51.238734 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-16f63b12-c07d-441a-b448-98eff626e2f3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:51.932766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:51.991201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object d32d24d1-93b9-4c91-95fb-e8987be16d8b will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:52.033825 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-16f63b12-c07d-441a-b448-98eff626e2f3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:52.040953 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:52.153480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:52.160201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:52.160201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:52.169154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:52.169154 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:52.200263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=d32d24d1-93b9-4c91-95fb-e8987be16d8b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:52.255843 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-54ab3adc-4593-46bb-8978-2a126dd15af0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 4.0734732 May 12 15:38:52.261609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33842) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:52.400653 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-b12e3fc2-a313-4211-a57f-a75fbbd581af None None] Allocated IP 2001:db8:0:1::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/87a57b78-71e7-407e-908a-83dd27ff897f/aec884a7-8012-4fb8-9e21-066760a3e1d2) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:52.451564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-dad74585-0f7f-47d4-8671-94afff8d00a1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port d32d24d1-93b9-4c91-95fb-e8987be16d8b {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:38:52.479463 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dad74585-0f7f-47d4-8671-94afff8d00a1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:52.580204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-16f63b12-c07d-441a-b448-98eff626e2f3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d2e823c6-8acb-45b9-910c-0a4822a68f25']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:52.654953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Allocated IP 2001:db8::1 (9b7334d3-09cb-43ee-879c-8af2e3abb59f/73529121-9bf5-45f1-bfed-1522a4a53d69/e4eb5ae6-0fea-4ec5-961a-d1f08903a639) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:52.682701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-16f63b12-c07d-441a-b448-98eff626e2f3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4dc52732-5577-45b0-b2eb-1c2616cc1c73') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:52.682997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-16f63b12-c07d-441a-b448-98eff626e2f3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4dc52732-5577-45b0-b2eb-1c2616cc1c73') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:38:52.735463 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-16f63b12-c07d-441a-b448-98eff626e2f3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:52.820974 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:52.901562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device de80ba7e-13c7-46eb-b13c-cd31ade2e2af up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:53.014682 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-16f63b12-c07d-441a-b448-98eff626e2f3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:53.020289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b12e3fc2-a313-4211-a57f-a75fbbd581af None None] For port aec884a7-8012-4fb8-9e21-066760a3e1d2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=aec884a7-8012-4fb8-9e21-066760a3e1d2,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:53.053685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port de80ba7e-13c7-46eb-b13c-cd31ade2e2af completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:53.065423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device aec884a7-8012-4fb8-9e21-066760a3e1d2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:53.161242 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b12e3fc2-a313-4211-a57f-a75fbbd581af None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:53.193183 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dad74585-0f7f-47d4-8671-94afff8d00a1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:53.202524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-16f63b12-c07d-441a-b448-98eff626e2f3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Releasing vlan 551 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:38:53.202524 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-16f63b12-c07d-441a-b448-98eff626e2f3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: timer() May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:38:53.273820 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:38:53.288591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port aec884a7-8012-4fb8-9e21-066760a3e1d2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:53.288591 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:53.404391 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3cc21835-b31e-4c28-b144-98d30b3bd952 None None] Network c9a6bb00-bbac-4814-bdfd-4659f4eb623c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:53.496179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-dad74585-0f7f-47d4-8671-94afff8d00a1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for d32d24d1-93b9-4c91-95fb-e8987be16d8b owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:38:53.587186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-87534e56-b4be-4c86-924c-2e15d81a33e0 None None] Provisioning for port de80ba7e-13c7-46eb-b13c-cd31ade2e2af completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:53.643976 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-16f63b12-c07d-441a-b448-98eff626e2f3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:53.691172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b12e3fc2-a313-4211-a57f-a75fbbd581af None None] Transition to ACTIVE for port object aec884a7-8012-4fb8-9e21-066760a3e1d2 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:53.691172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-87534e56-b4be-4c86-924c-2e15d81a33e0 None None] Provisioning complete for port de80ba7e-13c7-46eb-b13c-cd31ade2e2af triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:53.691172 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87534e56-b4be-4c86-924c-2e15d81a33e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:53.719317 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-16f63b12-c07d-441a-b448-98eff626e2f3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:53.780283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16f63b12-c07d-441a-b448-98eff626e2f3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] Pushing event deleted for resources: {'Network': ['ID=d2e823c6-8acb-45b9-910c-0a4822a68f25,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:53.780283 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:53.798673 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-16f63b12-c07d-441a-b448-98eff626e2f3 tempest-TestSecurityGroupsBasicOps-1953446295 tempest-TestSecurityGroupsBasicOps-1953446295-project] 10.222.0.82 "DELETE /v2.0/networks/d2e823c6-8acb-45b9-910c-0a4822a68f25 HTTP/1.1" status: 204 len: 168 time: 3.9024353 May 12 15:38:53.806496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.25.8.88 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/47d480e1-1d95-4883-ac67-643473d0a791) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:38:53.900264 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b12e3fc2-a313-4211-a57f-a75fbbd581af None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:54.006263 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dad74585-0f7f-47d4-8671-94afff8d00a1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:54.033501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Transition to ACTIVE for port object e4eb5ae6-0fea-4ec5-961a-d1f08903a639 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:38:54.155175 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:54.200485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dad74585-0f7f-47d4-8671-94afff8d00a1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=d32d24d1-93b9-4c91-95fb-e8987be16d8b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:54.295050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33884) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:54.321020 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dad74585-0f7f-47d4-8671-94afff8d00a1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:54.376296 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dad74585-0f7f-47d4-8671-94afff8d00a1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/d32d24d1-93b9-4c91-95fb-e8987be16d8b HTTP/1.1" status: 204 len: 168 time: 2.1134565 May 12 15:38:54.377479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33892) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:54.434469 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:54.467493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33896) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:54.487753 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:54.610852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:54.610852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:54.636314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:54.653171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e7582fc-bd21-4ab5-83a2-9d4b619cd3ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:54.653171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0e7582fc-bd21-4ab5-83a2-9d4b619cd3ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:54.688818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0e7582fc-bd21-4ab5-83a2-9d4b619cd3ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:54.695189 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0e7582fc-bd21-4ab5-83a2-9d4b619cd3ef tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.3150816 May 12 15:38:54.696087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33904) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:54.744411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b12e3fc2-a313-4211-a57f-a75fbbd581af None None] Pushing event updated for resources: {'Port': ['ID=aec884a7-8012-4fb8-9e21-066760a3e1d2,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:54.759542 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87534e56-b4be-4c86-924c-2e15d81a33e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:54.788305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Network 9b7334d3-09cb-43ee-879c-8af2e3abb59f is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:54.830389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:54.832285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-87534e56-b4be-4c86-924c-2e15d81a33e0 None None] For port de80ba7e-13c7-46eb-b13c-cd31ade2e2af, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=de80ba7e-13c7-46eb-b13c-cd31ade2e2af,segment=NetworkSegment(19660022-17a8-473d-9896-f59cce2ae64e),segment_id=19660022-17a8-473d-9896-f59cce2ae64e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:38:54.838719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:38:54.839981 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87534e56-b4be-4c86-924c-2e15d81a33e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:54.841432 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:54.890337 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:54.956210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:55.011085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87534e56-b4be-4c86-924c-2e15d81a33e0 None None] Pushing event updated for resources: {'Port': ['ID=de80ba7e-13c7-46eb-b13c-cd31ade2e2af,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:55.016167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Usage tracker for resource:security_group_rule and tenant:11e57cc11787498b94b3c27ef0ffe6d5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:55.016167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:55.053213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:55.216852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event updated for resources: {'Port': ['ID=e4eb5ae6-0fea-4ec5-961a-d1f08903a639,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:55.273282 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b1631215-b128-4f53-aa8a-83ee124fd3d7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3dd1fe8ad774471ba7745219a37ead53&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7874901 May 12 15:38:55.331725 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:55.336508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33914) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:55.349197 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:55.357703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=47d480e1-1d95-4883-ac67-643473d0a791,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:55.530205 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:55.594484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f0f4f39c-6611-4328-8dfb-2c41054b311c None None] Provisioning complete for port de80ba7e-13c7-46eb-b13c-cd31ade2e2af triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:55.594484 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f0f4f39c-6611-4328-8dfb-2c41054b311c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:55.762730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-caac15ed-6646-479e-aeae-41702dbace28 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:55.762730 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-caac15ed-6646-479e-aeae-41702dbace28 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 1.0536628 May 12 15:38:55.782236 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=11e57cc11787498b94b3c27ef0ffe6d5&name=default HTTP/1.1" status: 200 len: 2983 time: 1.4516089 May 12 15:38:55.792810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33926) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:55.792810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33928) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:55.884223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=28201744-224a-41ca-a4f3-767b06bc4d38,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:55.949852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f0f4f39c-6611-4328-8dfb-2c41054b311c None None] Provisioning for port e4eb5ae6-0fea-4ec5-961a-d1f08903a639 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:55.959102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f0f4f39c-6611-4328-8dfb-2c41054b311c None None] Provisioning complete for port e4eb5ae6-0fea-4ec5-961a-d1f08903a639 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:55.959102 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f0f4f39c-6611-4328-8dfb-2c41054b311c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:55.963406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:55.963830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:55.964229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:55.964621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:55.965030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:55.965466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:55.967117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:55.967514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:55.967904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:55.970452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:55.970956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:55.971274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b6dc3df-0b55-40d4-b963-a61c48aa99a2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:38:56.030272 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-73a92b70-37d3-4487-84c7-c66ce44c48d1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:56.069219 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-73a92b70-37d3-4487-84c7-c66ce44c48d1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:56.110260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f0f4f39c-6611-4328-8dfb-2c41054b311c None None] Port e4eb5ae6-0fea-4ec5-961a-d1f08903a639 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:38:56.192382 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:56.199275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acb52c78-6db3-4531-a678-6f277aa3f42c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:56.199275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acb52c78-6db3-4531-a678-6f277aa3f42c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:56.199275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acb52c78-6db3-4531-a678-6f277aa3f42c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:38:56.199275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-acb52c78-6db3-4531-a678-6f277aa3f42c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:38:56.229253 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-73a92b70-37d3-4487-84c7-c66ce44c48d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:56.269408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a92b70-37d3-4487-84c7-c66ce44c48d1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eed3649d-a197-40c8-bd0b-b90a4fbde54f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:56.273334 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9a26b05e-5a5f-49d2-b6ee-401e6f40ff70 None None] Provisioning for port aec884a7-8012-4fb8-9e21-066760a3e1d2 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:38:56.281693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-acb52c78-6db3-4531-a678-6f277aa3f42c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:38:56.281693 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-acb52c78-6db3-4531-a678-6f277aa3f42c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.4817069 May 12 15:38:56.281693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33936) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:56.339635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9a26b05e-5a5f-49d2-b6ee-401e6f40ff70 None None] Provisioning complete for port aec884a7-8012-4fb8-9e21-066760a3e1d2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:56.340007 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9a26b05e-5a5f-49d2-b6ee-401e6f40ff70 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:56.385184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-73a92b70-37d3-4487-84c7-c66ce44c48d1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:56.386330 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-73a92b70-37d3-4487-84c7-c66ce44c48d1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/eed3649d-a197-40c8-bd0b-b90a4fbde54f HTTP/1.1" status: 204 len: 168 time: 1.0480604 May 12 15:38:56.429337 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f754f791-1563-48d9-8dc2-d99a0dbdd884 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:56.658062 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:56.782063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device de80ba7e-13c7-46eb-b13c-cd31ade2e2af up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:56.898644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-96c5c236-f5bc-43a2-91de-aaa97f8ea67a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 38cb4b0d-6258-4c5b-904b-a12c4bc812d7 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:38:56.909208 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f754f791-1563-48d9-8dc2-d99a0dbdd884 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.038444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96c5c236-f5bc-43a2-91de-aaa97f8ea67a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.071360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1ec91db1-0c13-4bfd-9338-af4db5c2de56 None None] Could not find standard attr ID for object d32d24d1-93b9-4c91-95fb-e8987be16d8b. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:38:57.115838 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port de80ba7e-13c7-46eb-b13c-cd31ade2e2af triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:57.115838 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.226190 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96c5c236-f5bc-43a2-91de-aaa97f8ea67a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.343080 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.394442 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.394442 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.394442 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.477237 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.511094 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33954) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:57.531489 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96c5c236-f5bc-43a2-91de-aaa97f8ea67a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.601791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device aec884a7-8012-4fb8-9e21-066760a3e1d2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:38:57.642756 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6b4f01fe-81bb-4228-869b-c900d3a60f24 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.651458 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f754f791-1563-48d9-8dc2-d99a0dbdd884 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.691405 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f754f791-1563-48d9-8dc2-d99a0dbdd884 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.692033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6b4f01fe-81bb-4228-869b-c900d3a60f24 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:57.694204 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f754f791-1563-48d9-8dc2-d99a0dbdd884 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/28201744-224a-41ca-a4f3-767b06bc4d38 HTTP/1.1" status: 204 len: 168 time: 1.9028666 May 12 15:38:57.695510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f754f791-1563-48d9-8dc2-d99a0dbdd884 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=28201744-224a-41ca-a4f3-767b06bc4d38,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:57.699529 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port aec884a7-8012-4fb8-9e21-066760a3e1d2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:57.700078 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.717783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6b4f01fe-81bb-4228-869b-c900d3a60f24 admin admin] Usage tracker for resource:security_group_rule and tenant:3c2f593315834dcbb29001cd51821937 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:57.720884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96c5c236-f5bc-43a2-91de-aaa97f8ea67a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.734810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6b4f01fe-81bb-4228-869b-c900d3a60f24 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:57.765598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event updated for resources: {'Port': ['ID=e4eb5ae6-0fea-4ec5-961a-d1f08903a639,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:57.795658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6b4f01fe-81bb-4228-869b-c900d3a60f24 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:57.848412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96c5c236-f5bc-43a2-91de-aaa97f8ea67a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=38cb4b0d-6258-4c5b-904b-a12c4bc812d7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:57.883558 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96c5c236-f5bc-43a2-91de-aaa97f8ea67a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.883558 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-96c5c236-f5bc-43a2-91de-aaa97f8ea67a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/38cb4b0d-6258-4c5b-904b-a12c4bc812d7 HTTP/1.1" status: 204 len: 168 time: 1.5964839 May 12 15:38:57.897078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33964) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:57.902011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=47d480e1-1d95-4883-ac67-643473d0a791,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:57.916761 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:57.945617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7dd25d08-e63a-4aec-870a-675b9fa94182 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:38:58.085115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-d2a8a95f-0397-43b6-8be0-e604e8d24858 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 87a57b78-71e7-407e-908a-83dd27ff897f {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:38:58.091707 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d2a8a95f-0397-43b6-8be0-e604e8d24858 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:58.108185 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:58.110821 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3c49695a-0328-42cf-a646-6e8736626b70 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 8.6860073 May 12 15:38:58.123745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 33972) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:58.138942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'port': {'network_id': '2d338475-91c7-4829-98f2-54874ae73504', 'name': 'tempest-FloatingIPTestJSON-1048822350'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:58.176813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Network 9b7334d3-09cb-43ee-879c-8af2e3abb59f is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:38:58.219760 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d2a8a95f-0397-43b6-8be0-e604e8d24858 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:58.500941 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6b4f01fe-81bb-4228-869b-c900d3a60f24 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:58.512369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:38:58.528144 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6b4f01fe-81bb-4228-869b-c900d3a60f24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:58.536171 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d2a8a95f-0397-43b6-8be0-e604e8d24858 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:58.624261 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6b4f01fe-81bb-4228-869b-c900d3a60f24 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3c2f593315834dcbb29001cd51821937&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1187699 May 12 15:38:58.641094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33984) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:58.846743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:58.890576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:port and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:58.914083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for port was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:58.964879 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e7d099f-3b59-4c7e-bb3d-7bc6d8bf54f9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:59.002229 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e7d099f-3b59-4c7e-bb3d-7bc6d8bf54f9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:59.010024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:59.101187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d2a8a95f-0397-43b6-8be0-e604e8d24858 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:59.146197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bfd17373-4137-48f9-80b1-21a3ac9fc085 None None] Provisioning complete for port e4eb5ae6-0fea-4ec5-961a-d1f08903a639 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:38:59.146197 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bfd17373-4137-48f9-80b1-21a3ac9fc085 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:59.156413 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e7d099f-3b59-4c7e-bb3d-7bc6d8bf54f9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:59.179647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2a8a95f-0397-43b6-8be0-e604e8d24858 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=87a57b78-71e7-407e-908a-83dd27ff897f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:59.197058 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d2a8a95f-0397-43b6-8be0-e604e8d24858 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:59.206781 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d2a8a95f-0397-43b6-8be0-e604e8d24858 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/87a57b78-71e7-407e-908a-83dd27ff897f HTTP/1.1" status: 204 len: 168 time: 1.3100872 May 12 15:38:59.206781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e7d099f-3b59-4c7e-bb3d-7bc6d8bf54f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=befe1b56-611f-4da6-915d-1aef373699b0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:59.214030 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e7d099f-3b59-4c7e-bb3d-7bc6d8bf54f9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:59.214030 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6e7d099f-3b59-4c7e-bb3d-7bc6d8bf54f9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/befe1b56-611f-4da6-915d-1aef373699b0 HTTP/1.1" status: 204 len: 168 time: 0.5699596 May 12 15:38:59.214030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 33996) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:59.350726 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-22460e2f-27be-40df-ace8-afc5ee5b3e25 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1355388 May 12 15:38:59.353340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34006) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:38:59.358974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a2badbf4-3429-446b-b9ae-9e7c82463261 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:38:59.382903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bfd17373-4137-48f9-80b1-21a3ac9fc085 None None] Port e4eb5ae6-0fea-4ec5-961a-d1f08903a639 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:38:59.414255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b4f01fe-81bb-4228-869b-c900d3a60f24 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=befe1b56-611f-4da6-915d-1aef373699b0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:38:59.429707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Made reservation on behalf of 9d4bdd73a39f4390bb7d4c6d7a1fc0c4 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:59.447036 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:59.519527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Router 0b891f9b-4350-4592-bcd3-b3900181c94c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:38:59.666603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a2badbf4-3429-446b-b9ae-9e7c82463261 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:38:59.678202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a2badbf4-3429-446b-b9ae-9e7c82463261 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:38:59.693830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a2badbf4-3429-446b-b9ae-9e7c82463261 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:38:59.710645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a2badbf4-3429-446b-b9ae-9e7c82463261 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:38:59.756859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a2badbf4-3429-446b-b9ae-9e7c82463261 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:38:59.760752 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2badbf4-3429-446b-b9ae-9e7c82463261 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:38:59.838024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] device_id is not set on port fe8d161a-a3d6-45cb-851e-2e6868d836d9 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:38:59.899317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cd7ea34-6f00-475c-8986-c249c6ee9d37 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:00.014939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:39:00.027080 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7467d141-02df-4103-8d40-cd76610651a6 None None] Sync routers for ids ['0b891f9b-4350-4592-bcd3-b3900181c94c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:39:00.040080 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7467d141-02df-4103-8d40-cd76610651a6 None None] Routers {'0b891f9b-4350-4592-bcd3-b3900181c94c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:00.040080 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7467d141-02df-4103-8d40-cd76610651a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0b891f9b-4350-4592-bcd3-b3900181c94c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:00.211879 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-578de77f-13b5-4058-afe5-339009040a1a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "PUT /v2.0/routers/0b891f9b-4350-4592-bcd3-b3900181c94c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.6740406 May 12 15:39:00.222167 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7467d141-02df-4103-8d40-cd76610651a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:00.230938 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34024) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:00.255261 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7467d141-02df-4103-8d40-cd76610651a6 None None] Routers {'0b891f9b-4350-4592-bcd3-b3900181c94c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:00.256624 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7467d141-02df-4103-8d40-cd76610651a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0b891f9b-4350-4592-bcd3-b3900181c94c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:00.330037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34032) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:00.429178 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7467d141-02df-4103-8d40-cd76610651a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:00.429178 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7467d141-02df-4103-8d40-cd76610651a6 None None] The sync data for ids ['0b891f9b-4350-4592-bcd3-b3900181c94c'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:39:00.444461 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2badbf4-3429-446b-b9ae-9e7c82463261 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:00.472753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ceaa46d4-5386-4efb-af29-729517f65076 None None] Provisioning complete for port aec884a7-8012-4fb8-9e21-066760a3e1d2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:00.472753 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ceaa46d4-5386-4efb-af29-729517f65076 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:00.585192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2badbf4-3429-446b-b9ae-9e7c82463261 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=9c050e5e-c14a-45d2-9f3a-26a91f8ad488,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:00.633619 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6a459414-9b7c-4a46-9e1a-1da9810a0de6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b4a6e1b5de6e4d28a1dd36d7c8899d30&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2946608 May 12 15:39:00.633619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34040) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:00.656688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2badbf4-3429-446b-b9ae-9e7c82463261 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:00.682475 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-a2badbf4-3429-446b-b9ae-9e7c82463261 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:00.692892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2badbf4-3429-446b-b9ae-9e7c82463261 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:00.692892 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2badbf4-3429-446b-b9ae-9e7c82463261 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:00.760727 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a2badbf4-3429-446b-b9ae-9e7c82463261 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.3976617 May 12 15:39:00.760891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34046) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:00.787099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a6bacf14-944b-4bb6-a7d5-3a180deb24c1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:00.987994 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0da9042c-b72a-4e5a-9b56-b61d4921b1aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:01.200408 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b9fdd8f0-802f-4da1-b1dd-97e296747747 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:01.204768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d46c8df7-82d3-4efe-bc1b-f1b3661dfdf8 None None] Update dhcp port {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'fixed_ips': [{'subnet_id': '9c050e5e-c14a-45d2-9f3a-26a91f8ad488'}], 'binding:host_id': 'n-d-841483-1'}, 'id': 'aec884a7-8012-4fb8-9e21-066760a3e1d2'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:39:01.271835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a6bacf14-944b-4bb6-a7d5-3a180deb24c1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:01.276033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a6bacf14-944b-4bb6-a7d5-3a180deb24c1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:01.279184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a6bacf14-944b-4bb6-a7d5-3a180deb24c1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:01.285177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a6bacf14-944b-4bb6-a7d5-3a180deb24c1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:01.297455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b9fdd8f0-802f-4da1-b1dd-97e296747747 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:01.306002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a6bacf14-944b-4bb6-a7d5-3a180deb24c1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:01.312846 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a6bacf14-944b-4bb6-a7d5-3a180deb24c1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:01.397434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.20.0.7 (2d338475-91c7-4829-98f2-54874ae73504/6a6a3afc-f008-4a33-8e40-276ea11e299b/fe8d161a-a3d6-45cb-851e-2e6868d836d9) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:01.448144 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d46c8df7-82d3-4efe-bc1b-f1b3661dfdf8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:01.579184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b9fdd8f0-802f-4da1-b1dd-97e296747747 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:01.597614 n-d-841483-1 neutron-server[88151]: INFO neutron.db.ipam_backend_mixin [None req-a6bacf14-944b-4bb6-a7d5-3a180deb24c1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 9c050e5e-c14a-45d2-9f3a-26a91f8ad488 (CIDR: 2001:db8::/64) May 12 15:39:01.607319 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-a6bacf14-944b-4bb6-a7d5-3a180deb24c1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:39:01.607319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a6bacf14-944b-4bb6-a7d5-3a180deb24c1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:01.638323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9fdd8f0-802f-4da1-b1dd-97e296747747 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=361eee1c-8601-4d8b-9f08-46082abef983,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:01.638323 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a6bacf14-944b-4bb6-a7d5-3a180deb24c1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.8629916 May 12 15:39:01.638323 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b9fdd8f0-802f-4da1-b1dd-97e296747747 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:01.638323 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b9fdd8f0-802f-4da1-b1dd-97e296747747 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/361eee1c-8601-4d8b-9f08-46082abef983 HTTP/1.1" status: 204 len: 168 time: 1.0045118 May 12 15:39:01.638323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34066) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:01.659786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34072) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:01.828059 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-0da9042c-b72a-4e5a-9b56-b61d4921b1aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] delete failed (client error): There was a conflict when trying to complete your request. May 12 15:39:01.830222 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0da9042c-b72a-4e5a-9b56-b61d4921b1aa tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "DELETE /v2.0/routers/0b891f9b-4350-4592-bcd3-b3900181c94c HTTP/1.1" status: 409 len: 329 time: 1.5988829 May 12 15:39:01.834039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34084) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:01.919239 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:01.939741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-d46c8df7-82d3-4efe-bc1b-f1b3661dfdf8 None None] Allocated IP 2001:db8::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/9c050e5e-c14a-45d2-9f3a-26a91f8ad488/aec884a7-8012-4fb8-9e21-066760a3e1d2) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:01.984235 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:02.167016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=fe8d161a-a3d6-45cb-851e-2e6868d836d9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:02.184356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network 2d338475-91c7-4829-98f2-54874ae73504 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:02.185588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:02.202615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:02.307736 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d46c8df7-82d3-4efe-bc1b-f1b3661dfdf8 None None] For port aec884a7-8012-4fb8-9e21-066760a3e1d2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=aec884a7-8012-4fb8-9e21-066760a3e1d2,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:02.356211 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d46c8df7-82d3-4efe-bc1b-f1b3661dfdf8 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:02.377981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:02.377981 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:02.400255 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d46c8df7-82d3-4efe-bc1b-f1b3661dfdf8 None None] Transition to ACTIVE for port object aec884a7-8012-4fb8-9e21-066760a3e1d2 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:02.407427 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d46c8df7-82d3-4efe-bc1b-f1b3661dfdf8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:02.464573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-664dccdd-d434-4777-b05c-c3180cca210a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 4.3259313 May 12 15:39:02.464573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34100) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:02.490997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-dc59c2b2-f331-4a77-a434-b806c65843bd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'floatingip': {'port_id': 'fe8d161a-a3d6-45cb-851e-2e6868d836d9'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:02.526732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:02.677689 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d46c8df7-82d3-4efe-bc1b-f1b3661dfdf8 None None] Pushing event updated for resources: {'Port': ['ID=aec884a7-8012-4fb8-9e21-066760a3e1d2,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:02.710013 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:02.713630 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc59c2b2-f331-4a77-a434-b806c65843bd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:02.737218 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd112e70-2fab-4787-87c6-3e11529fc447 req-e2dd1f3b-b284-4f70-ab6a-e29da86e4cfa service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.2433138 May 12 15:39:02.867616 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a55f70f-2902-4cad-b3ed-65b7d843d4d1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:03.093700 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd112e70-2fab-4787-87c6-3e11529fc447 req-dcc3d7db-3c82-44e4-99da-a270ed8fceb5 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.1632230 May 12 15:39:03.093700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6a55f70f-2902-4cad-b3ed-65b7d843d4d1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:03.158973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6a55f70f-2902-4cad-b3ed-65b7d843d4d1 admin admin] Usage tracker for resource:security_group_rule and tenant:46aea2c3a8824d07b35bdd844bf528cf is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:03.179055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6a55f70f-2902-4cad-b3ed-65b7d843d4d1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:03.226585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6a55f70f-2902-4cad-b3ed-65b7d843d4d1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:03.451375 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd112e70-2fab-4787-87c6-3e11529fc447 req-5d028ae5-5389-441b-a066-6d2f1aa80798 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.2766311 May 12 15:39:03.652260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34140) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:03.906003 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc59c2b2-f331-4a77-a434-b806c65843bd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:03.914095 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc59c2b2-f331-4a77-a434-b806c65843bd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:03.940450 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eda1df88-b1f5-40f6-9593-ee4c3c55d869 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:03.957343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd112e70-2fab-4787-87c6-3e11529fc447 req-b3b1a3f7-4a94-4b91-85eb-3fd9f42b3a32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:03.957343 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bd112e70-2fab-4787-87c6-3e11529fc447 req-b3b1a3f7-4a94-4b91-85eb-3fd9f42b3a32 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4828146 May 12 15:39:03.968798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:04.000129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:04.000129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:04.015403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:04.015403 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a55f70f-2902-4cad-b3ed-65b7d843d4d1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:04.031021 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a55f70f-2902-4cad-b3ed-65b7d843d4d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:04.083372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a55f70f-2902-4cad-b3ed-65b7d843d4d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=329df290-4c80-471f-87db-e03a356ebc54,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:04.083372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:04.083372 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:04.123885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Request body: {'network': {'name': 'tempest-ImageQuotaTest-411269687-network', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:04.138090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:04.154390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Usage tracker for resource:network and tenant:2e0dfdb783c948f8aad42ecd29e9390e is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:04.159454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:04.169297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:04.347575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a6bb66dd-ec89-4ec1-8f8e-d3d2f837a1bc None None] Provisioning for port aec884a7-8012-4fb8-9e21-066760a3e1d2 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:39:04.391300 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6a55f70f-2902-4cad-b3ed-65b7d843d4d1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=46aea2c3a8824d07b35bdd844bf528cf&name=default HTTP/1.1" status: 200 len: 2983 time: 2.7113862 May 12 15:39:04.396724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a6bb66dd-ec89-4ec1-8f8e-d3d2f837a1bc None None] Provisioning complete for port aec884a7-8012-4fb8-9e21-066760a3e1d2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:04.396724 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a6bb66dd-ec89-4ec1-8f8e-d3d2f837a1bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:04.400656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34178) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:04.528530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Made reservation on behalf of 2e0dfdb783c948f8aad42ecd29e9390e for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:04.528530 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:04.554324 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:04.596425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:04.612650 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e42c482-8c75-4f82-9ba0-e34aea525903 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:04.617519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Usage tracker for resource:security_group_rule and tenant:2e0dfdb783c948f8aad42ecd29e9390e is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:04.626276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:04.639715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:04.779691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34186) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:04.784495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device aec884a7-8012-4fb8-9e21-066760a3e1d2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:39:04.789124 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e42c482-8c75-4f82-9ba0-e34aea525903 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:04.830719 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:04.841962 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-dc59c2b2-f331-4a77-a434-b806c65843bd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Floating IP 2dff7047-682c-4570-a2ce-25dcde8b0b6b associated. External IP: 172.25.8.88, port: fe8d161a-a3d6-45cb-851e-2e6868d836d9. May 12 15:39:04.885134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port aec884a7-8012-4fb8-9e21-066760a3e1d2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:04.885134 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:04.916199 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:04.945240 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e42c482-8c75-4f82-9ba0-e34aea525903 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:04.995558 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-43ef05f1-0212-4aed-a8a3-c5ba8c800e8c None None] Provisioning complete for port aec884a7-8012-4fb8-9e21-066760a3e1d2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:04.995558 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-43ef05f1-0212-4aed-a8a3-c5ba8c800e8c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:05.000075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e42c482-8c75-4f82-9ba0-e34aea525903 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=329df290-4c80-471f-87db-e03a356ebc54,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:05.006675 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-645c97b2-316e-4621-abe9-0b0f7199310a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:05.008180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 594} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:39:05.037808 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:05.038409 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Added segment c345e75f-d395-4dba-a724-35c44275a64f of type vlan for network 293104b9-2a34-465b-ba14-8789ca8ec013 May 12 15:39:05.099094 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:05.110323 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fa720b4a-9dbc-44f9-bc43-8f906edc817d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:05.161692 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-59be52d9-4488-43ce-88bb-5fefd0bba3a0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:05.288222 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:05.288222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:05.288222 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:05.414300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] Pushing event updated for resources: {'Network': ['ID=293104b9-2a34-465b-ba14-8789ca8ec013,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:05.431765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 293104b9-2a34-465b-ba14-8789ca8ec013 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:39:05.478659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-59be52d9-4488-43ce-88bb-5fefd0bba3a0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:05.518935 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e42c482-8c75-4f82-9ba0-e34aea525903 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:05.518935 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6e42c482-8c75-4f82-9ba0-e34aea525903 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/329df290-4c80-471f-87db-e03a356ebc54 HTTP/1.1" status: 204 len: 168 time: 1.1122758 May 12 15:39:05.518935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-59be52d9-4488-43ce-88bb-5fefd0bba3a0 admin admin] Usage tracker for resource:security_group_rule and tenant:5a16a34ea7604855b47c7bf93fb93573 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:05.546713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-59be52d9-4488-43ce-88bb-5fefd0bba3a0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:05.570953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-59be52d9-4488-43ce-88bb-5fefd0bba3a0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:05.695520 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-aca9ac5e-c83f-4f2a-9623-7c96fff2345c admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 877 time: 2.0415516 May 12 15:39:05.699170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34202) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:05.702990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc59c2b2-f331-4a77-a434-b806c65843bd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:39:05.706780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Request body: {'subnet': {'network_id': '293104b9-2a34-465b-ba14-8789ca8ec013', 'cidr': '172.20.0.0/28', 'name': 'tempest-ImageQuotaTest-411269687-subnet', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:05.714380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:05.727983 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Usage tracker for resource:subnet and tenant:2e0dfdb783c948f8aad42ecd29e9390e is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:05.813801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:05.829278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:05.878791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Made reservation on behalf of 2e0dfdb783c948f8aad42ecd29e9390e for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:05.878791 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:06.006835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34208) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:06.019689 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-59be52d9-4488-43ce-88bb-5fefd0bba3a0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:06.043345 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-59be52d9-4488-43ce-88bb-5fefd0bba3a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:06.074553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc59c2b2-f331-4a77-a434-b806c65843bd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:39:06.104812 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc59c2b2-f331-4a77-a434-b806c65843bd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:06.115945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d556da8c-98ef-4bc9-b3f5-bbbf7ab423f7 None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:39:06.131505 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51a6b29e-cca7-4ea0-bbec-785badd71677 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:06.134994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d556da8c-98ef-4bc9-b3f5-bbbf7ab423f7 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:06.134994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d556da8c-98ef-4bc9-b3f5-bbbf7ab423f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:06.173955 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dc59c2b2-f331-4a77-a434-b806c65843bd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "PUT /v2.0/floatingips/2dff7047-682c-4570-a2ce-25dcde8b0b6b HTTP/1.1" status: 200 len: 977 time: 3.7136719 May 12 15:39:06.173955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34214) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:06.188602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59be52d9-4488-43ce-88bb-5fefd0bba3a0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b21b9864-bde1-4185-a23a-87d122845afe,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:06.194821 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-59be52d9-4488-43ce-88bb-5fefd0bba3a0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5a16a34ea7604855b47c7bf93fb93573&name=default HTTP/1.1" status: 200 len: 2983 time: 1.3251839 May 12 15:39:06.194821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-51a6b29e-cca7-4ea0-bbec-785badd71677 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:06.199378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34218) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:06.210374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-51a6b29e-cca7-4ea0-bbec-785badd71677 admin admin] Usage tracker for resource:security_group_rule and tenant:5bfe82ee66bf4edaac5d37a547e72e1a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:06.232464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d556da8c-98ef-4bc9-b3f5-bbbf7ab423f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:06.256844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d556da8c-98ef-4bc9-b3f5-bbbf7ab423f7 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:06.256844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d556da8c-98ef-4bc9-b3f5-bbbf7ab423f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:06.276850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.objects.ports [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=88151) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:39:06.276850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-51a6b29e-cca7-4ea0-bbec-785badd71677 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:06.316789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5a26542c-dc5b-4962-b55d-2140f51b20fd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port fe8d161a-a3d6-45cb-851e-2e6868d836d9 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:06.316789 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a26542c-dc5b-4962-b55d-2140f51b20fd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:06.345516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d556da8c-98ef-4bc9-b3f5-bbbf7ab423f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:06.345516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d556da8c-98ef-4bc9-b3f5-bbbf7ab423f7 None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:39:06.406732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-51a6b29e-cca7-4ea0-bbec-785badd71677 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:06.552976 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:06.581315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-645c97b2-316e-4621-abe9-0b0f7199310a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Deleting port e4eb5ae6-0fea-4ec5-961a-d1f08903a639 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:06.581315 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-645c97b2-316e-4621-abe9-0b0f7199310a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:06.719391 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ac59832-ceff-4323-8bfb-23e3b756fce8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:06.858806 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Pushing event updated for resources: {'Subnet': ['ID=917eef28-a2e7-40e6-afd8-bba440bc427a,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:06.885893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:06.885893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:06.885893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:06.885893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:06.885893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:06.889704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ac59832-ceff-4323-8bfb-23e3b756fce8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:06.892291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:06.892291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:06.892291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:06.892291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:06.892291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:06.892291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:06.892291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:06.896137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Checking segment: {'id': 'c345e75f-d395-4dba-a724-35c44275a64f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': '293104b9-2a34-465b-ba14-8789ca8ec013'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:39:06.896137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Network hostable DHCP agents. Network: 293104b9-2a34-465b-ba14-8789ca8ec013, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:39:06.918578 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a26542c-dc5b-4962-b55d-2140f51b20fd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:06.950687 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:39:07.041878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Network 293104b9-2a34-465b-ba14-8789ca8ec013 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:39:07.065536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 293104b9-2a34-465b-ba14-8789ca8ec013) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:07.075840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:07.075840 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.083578 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51a6b29e-cca7-4ea0-bbec-785badd71677 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.086470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4224a6f0-3098-48f2-946e-6c544f73d20a None None] Network 293104b9-2a34-465b-ba14-8789ca8ec013 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:07.105670 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.116647 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51a6b29e-cca7-4ea0-bbec-785badd71677 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.173573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4c763f51-264e-47bd-8834-b9cacd7ed9da admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 1.4604962 May 12 15:39:07.177814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34230) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:07.206789 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-645c97b2-316e-4621-abe9-0b0f7199310a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.222942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Request body: {'router': {'name': 'tempest-ImageQuotaTest-411269687-router', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:07.261707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:07.335389 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-51a6b29e-cca7-4ea0-bbec-785badd71677 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5bfe82ee66bf4edaac5d37a547e72e1a&name=default HTTP/1.1" status: 200 len: 2983 time: 1.3263297 May 12 15:39:07.336635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51a6b29e-cca7-4ea0-bbec-785badd71677 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b6d72b3f-4853-49fd-8cad-8ceb673876ec,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:07.341542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34236) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:07.431049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a26542c-dc5b-4962-b55d-2140f51b20fd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.431049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a26542c-dc5b-4962-b55d-2140f51b20fd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.431049 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-5a26542c-dc5b-4962-b55d-2140f51b20fd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Floating IP 2dff7047-682c-4570-a2ce-25dcde8b0b6b disassociated. External IP: 172.25.8.88, port: fe8d161a-a3d6-45cb-851e-2e6868d836d9. May 12 15:39:07.431049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5a26542c-dc5b-4962-b55d-2140f51b20fd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for fe8d161a-a3d6-45cb-851e-2e6868d836d9 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:07.445767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-645c97b2-316e-4621-abe9-0b0f7199310a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Calling delete_port for e4eb5ae6-0fea-4ec5-961a-d1f08903a639 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:07.523695 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5bc81275-2c4b-402e-869d-772e80f6fdeb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.565539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-293104b9-2a34-465b-ba14-8789ca8ec013', 'network_id': '293104b9-2a34-465b-ba14-8789ca8ec013', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'fixed_ips': [{'subnet_id': '917eef28-a2e7-40e6-afd8-bba440bc427a'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:39:07.572200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Usage tracker for resource:router and tenant:2e0dfdb783c948f8aad42ecd29e9390e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:07.574720 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.586876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:07.594056 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ac59832-ceff-4323-8bfb-23e3b756fce8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.608509 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5bc81275-2c4b-402e-869d-772e80f6fdeb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.610341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:07.670406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ac59832-ceff-4323-8bfb-23e3b756fce8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b21b9864-bde1-4185-a23a-87d122845afe,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:07.693878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ac59832-ceff-4323-8bfb-23e3b756fce8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.703919 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0ac59832-ceff-4323-8bfb-23e3b756fce8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b21b9864-bde1-4185-a23a-87d122845afe HTTP/1.1" status: 204 len: 168 time: 1.4982007 May 12 15:39:07.721801 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a26542c-dc5b-4962-b55d-2140f51b20fd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.779314 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.784734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.795083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a26542c-dc5b-4962-b55d-2140f51b20fd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Port': ['ID=fe8d161a-a3d6-45cb-851e-2e6868d836d9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:07.993631 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-645c97b2-316e-4621-abe9-0b0f7199310a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:07.994207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Allocated IP 172.20.0.2 (293104b9-2a34-465b-ba14-8789ca8ec013/917eef28-a2e7-40e6-afd8-bba440bc427a/e60e88df-e3f5-43ee-9957-d0e2ad1bd28c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:08.005436 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5bc81275-2c4b-402e-869d-772e80f6fdeb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:08.022809 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:08.032244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bc81275-2c4b-402e-869d-772e80f6fdeb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6d72b3f-4853-49fd-8cad-8ceb673876ec,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:08.104656 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5bc81275-2c4b-402e-869d-772e80f6fdeb admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:08.104656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5bc81275-2c4b-402e-869d-772e80f6fdeb admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b6d72b3f-4853-49fd-8cad-8ceb673876ec HTTP/1.1" status: 204 len: 168 time: 0.7567358 May 12 15:39:08.104656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a26542c-dc5b-4962-b55d-2140f51b20fd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:39:08.115928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-645c97b2-316e-4621-abe9-0b0f7199310a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event deleted for resources: {'Port': ['ID=e4eb5ae6-0fea-4ec5-961a-d1f08903a639,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:08.637697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34258) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:08.681427 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:08.697887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Transition to ACTIVE for port object e60e88df-e3f5-43ee-9957-d0e2ad1bd28c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:08.712478 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-40925c0c-982b-45eb-ae30-3053fed6f426 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:08.720977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Transition to ACTIVE for port object e60e88df-e3f5-43ee-9957-d0e2ad1bd28c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:08.730898 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:08.769436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-40925c0c-982b-45eb-ae30-3053fed6f426 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:08.782022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-40925c0c-982b-45eb-ae30-3053fed6f426 admin admin] Usage tracker for resource:security_group_rule and tenant:b4c9a1f0847f427c86542e3fba21cebc is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:08.785461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a26542c-dc5b-4962-b55d-2140f51b20fd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:39:08.796890 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ff3f758-32c0-4aa2-8786-22d785a1f6a3 None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:39:08.815028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Pushing event updated for resources: {'Port': ['ID=e60e88df-e3f5-43ee-9957-d0e2ad1bd28c,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:08.820330 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ff3f758-32c0-4aa2-8786-22d785a1f6a3 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:08.820330 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4ff3f758-32c0-4aa2-8786-22d785a1f6a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:08.830346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-40925c0c-982b-45eb-ae30-3053fed6f426 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:08.851167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-40925c0c-982b-45eb-ae30-3053fed6f426 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:08.910305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Network 293104b9-2a34-465b-ba14-8789ca8ec013 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:08.912893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:08.916796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:08.951378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a26542c-dc5b-4962-b55d-2140f51b20fd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:08.974394 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5a26542c-dc5b-4962-b55d-2140f51b20fd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/ports/fe8d161a-a3d6-45cb-851e-2e6868d836d9 HTTP/1.1" status: 204 len: 168 time: 2.8032398 May 12 15:39:08.977634 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4ff3f758-32c0-4aa2-8786-22d785a1f6a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:08.985755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34266) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:09.023578 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ff3f758-32c0-4aa2-8786-22d785a1f6a3 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:09.024554 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4ff3f758-32c0-4aa2-8786-22d785a1f6a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:09.093848 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-645c97b2-316e-4621-abe9-0b0f7199310a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:09.115746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] For port aec884a7-8012-4fb8-9e21-066760a3e1d2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=aec884a7-8012-4fb8-9e21-066760a3e1d2,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:09.124519 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-33d71bf7-ad10-410c-9796-c5f493966993 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "GET /v2.0/floatingips/2dff7047-682c-4570-a2ce-25dcde8b0b6b HTTP/1.1" status: 200 len: 687 time: 0.1375585 May 12 15:39:09.127200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34274) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:09.308472 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4ff3f758-32c0-4aa2-8786-22d785a1f6a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:09.308472 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ff3f758-32c0-4aa2-8786-22d785a1f6a3 None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:39:09.349073 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Attempting to bind port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:39:09.349772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Attempting to bind port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'c345e75f-d395-4dba-a724-35c44275a64f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': '293104b9-2a34-465b-ba14-8789ca8ec013'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:39:09.350347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Attempting to bind port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c on network 293104b9-2a34-465b-ba14-8789ca8ec013 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:39:09.358587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 38, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:39:09.359320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Checking segment: {'id': 'c345e75f-d395-4dba-a724-35c44275a64f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': '293104b9-2a34-465b-ba14-8789ca8ec013'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:39:09.359938 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:09.360516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Bound using segment: {'id': 'c345e75f-d395-4dba-a724-35c44275a64f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': '293104b9-2a34-465b-ba14-8789ca8ec013'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:39:09.361187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Bound port: e60e88df-e3f5-43ee-9957-d0e2ad1bd28c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c345e75f-d395-4dba-a724-35c44275a64f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 594, 'network_id': '293104b9-2a34-465b-ba14-8789ca8ec013'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:39:09.361795 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:09.468454 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] For port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:39:09.472480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] For port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e60e88df-e3f5-43ee-9957-d0e2ad1bd28c,segment=NetworkSegment(c345e75f-d395-4dba-a724-35c44275a64f),segment_id=c345e75f-d395-4dba-a724-35c44275a64f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:39:09.491387 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:09.575227 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-40925c0c-982b-45eb-ae30-3053fed6f426 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:09.591642 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-40925c0c-982b-45eb-ae30-3053fed6f426 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:09.618012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-c4816835-c975-4f7e-aea7-b4b434e59660 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port 47d480e1-1d95-4883-ac67-643473d0a791 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:09.619378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c4816835-c975-4f7e-aea7-b4b434e59660 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:09.664100 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:09.694951 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c78a75c-1e94-4cbf-ba0a-f05ba5438e20 None None] Pushing event updated for resources: {'Port': ['ID=e60e88df-e3f5-43ee-9957-d0e2ad1bd28c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:09.732757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40925c0c-982b-45eb-ae30-3053fed6f426 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2f624fe-3254-45e1-a943-2258cf1a8472,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:09.744639 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-40925c0c-982b-45eb-ae30-3053fed6f426 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b4c9a1f0847f427c86542e3fba21cebc&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1071308 May 12 15:39:09.762316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34290) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:09.824210 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:09.835348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34294) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:09.921131 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0c1df62-a805-4b96-a44e-a4efee2bbc3d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:09.929426 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:09.930351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:09.949987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0c1df62-a805-4b96-a44e-a4efee2bbc3d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:09.999886 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c4816835-c975-4f7e-aea7-b4b434e59660 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:10.000659 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c4816835-c975-4f7e-aea7-b4b434e59660 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:10.159185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-652185199-network', 'tenant_id': 'f798fdc3e9c54b38b7dbb0478a1d31d6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:10.177839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-645c97b2-316e-4621-abe9-0b0f7199310a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Router 0b891f9b-4350-4592-bcd3-b3900181c94c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:39:10.178176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-c4816835-c975-4f7e-aea7-b4b434e59660 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for 47d480e1-1d95-4883-ac67-643473d0a791 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:10.179902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:10.198620 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:10.201947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:10.202530 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:10.214366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-088cd2af-857b-455b-8303-d57ed412c863 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:10.216263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:10.230473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Usage tracker for resource:network and tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:10.233121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=b78785e4-055a-4a30-9a26-24fb6d6c4882,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:10.241846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=aec884a7-8012-4fb8-9e21-066760a3e1d2,revision_number=9']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:10.252412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:10.266113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:10.271234 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0c1df62-a805-4b96-a44e-a4efee2bbc3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:10.306608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0c1df62-a805-4b96-a44e-a4efee2bbc3d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2f624fe-3254-45e1-a943-2258cf1a8472,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:10.328212 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-09c74c40-f393-4fc5-a68b-08312e8b9f0c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 8.6895154 May 12 15:39:10.331994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34300) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:10.337550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Made reservation on behalf of f798fdc3e9c54b38b7dbb0478a1d31d6 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:10.340919 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:10.357055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:10.371493 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0c1df62-a805-4b96-a44e-a4efee2bbc3d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:10.373125 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a0c1df62-a805-4b96-a44e-a4efee2bbc3d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b2f624fe-3254-45e1-a943-2258cf1a8472 HTTP/1.1" status: 204 len: 168 time: 0.6095343 May 12 15:39:10.381525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:10.430896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Usage tracker for resource:security_group_rule and tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:10.438362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:10.450473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'mac_address': 'fa:16:3e:04:41:1e', 'name': 'tempest-NetworksTestDHCPv6-220820158'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:10.452779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:10.511036 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c4816835-c975-4f7e-aea7-b4b434e59660 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:10.626109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4816835-c975-4f7e-aea7-b4b434e59660 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Port': ['ID=47d480e1-1d95-4883-ac67-643473d0a791,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:10.708255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c4816835-c975-4f7e-aea7-b4b434e59660 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:10.776280 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c4816835-c975-4f7e-aea7-b4b434e59660 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:10.782196 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c4816835-c975-4f7e-aea7-b4b434e59660 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/floatingips/2dff7047-682c-4570-a2ce-25dcde8b0b6b HTTP/1.1" status: 204 len: 168 time: 1.6534052 May 12 15:39:10.793236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34310) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:10.803814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '8ac3db5f-3324-4a02-a6e5-504a9ea69fc2'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:10.813655 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:10.816282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:10.821665 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:10.825656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:floatingip and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:10.836248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:10.846875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:10.869334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 597} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:39:10.886312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5eb3848b-51ff-479d-bc4a-37b90b9c5382,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:10.903317 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:10.924553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:10.925511 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Added segment 09c83b83-4d53-47f0-b181-c0fb6ed7f95d of type vlan for network 85cd1d66-57c4-4d94-b782-1d4cae810f95 May 12 15:39:10.964150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device aec884a7-8012-4fb8-9e21-066760a3e1d2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:39:11.063313 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:11.065377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-645c97b2-316e-4621-abe9-0b0f7199310a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:39:11.079613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5dda56e-572d-4e65-9787-ae0bbdf9e39e None None] Sync routers for ids ['0b891f9b-4350-4592-bcd3-b3900181c94c'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:39:11.120431 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-645c97b2-316e-4621-abe9-0b0f7199310a tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "PUT /v2.0/routers/0b891f9b-4350-4592-bcd3-b3900181c94c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 9.2846460 May 12 15:39:11.125617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:11.130774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34320) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:11.144632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5dda56e-572d-4e65-9787-ae0bbdf9e39e None None] Routers {'0b891f9b-4350-4592-bcd3-b3900181c94c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:11.146215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a5dda56e-572d-4e65-9787-ae0bbdf9e39e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0b891f9b-4350-4592-bcd3-b3900181c94c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:11.177903 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:11.180688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:11.181605 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:11.261412 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a5dda56e-572d-4e65-9787-ae0bbdf9e39e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:11.278538 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port aec884a7-8012-4fb8-9e21-066760a3e1d2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:11.279252 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:11.333982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5dda56e-572d-4e65-9787-ae0bbdf9e39e None None] Routers {'0b891f9b-4350-4592-bcd3-b3900181c94c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:11.338696 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a5dda56e-572d-4e65-9787-ae0bbdf9e39e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:38:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0b891f9b-4350-4592-bcd3-b3900181c94c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:11.430218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:11.474322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a5dda56e-572d-4e65-9787-ae0bbdf9e39e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:11.474844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5dda56e-572d-4e65-9787-ae0bbdf9e39e None None] The sync data for ids ['0b891f9b-4350-4592-bcd3-b3900181c94c'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:39:11.480089 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:11.484522 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.6482217 May 12 15:39:11.532506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34328) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:11.538257 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-6aef94cf-4fbf-47bb-ad88-c52ed3382368 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] show failed (client error): The resource could not be found. May 12 15:39:11.544607 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6aef94cf-4fbf-47bb-ad88-c52ed3382368 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "GET /v2.0/routers/tempest-non_exist_router-204963476 HTTP/1.1" status: 404 len: 334 time: 0.3942707 May 12 15:39:11.546201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34334) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:11.550996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-294ed462-8b84-4be5-93a0-05ccef5230e4 admin admin] Pushing event updated for resources: {'Network': ['ID=85cd1d66-57c4-4d94-b782-1d4cae810f95,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:11.553085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-574bf821-9cbc-44d6-ac6f-8de7ff87bc05 None None] Network 293104b9-2a34-465b-ba14-8789ca8ec013 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:11.554656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Request body: {'subnet': {'network_id': '85cd1d66-57c4-4d94-b782-1d4cae810f95', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-652185199-subnet', 'tenant_id': 'f798fdc3e9c54b38b7dbb0478a1d31d6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:11.577027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-cf9054c6-a6a9-4a6b-b2a2-04aa3398fadc tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Request body: {'router': {'name': 'new_name'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:11.600034 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 85cd1d66-57c4-4d94-b782-1d4cae810f95 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:39:11.674199 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:11.724952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:11.731045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.25.8.233 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/b3f0dc69-a505-4a60-ad9b-a912e5401a58) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:11.742453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Usage tracker for resource:subnet and tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:11.748005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:11.759732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:11.786746 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-cf9054c6-a6a9-4a6b-b2a2-04aa3398fadc tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] update failed (client error): The resource could not be found. May 12 15:39:11.795195 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cf9054c6-a6a9-4a6b-b2a2-04aa3398fadc tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "PUT /v2.0/routers/tempest-non_exist_router-1432376334 HTTP/1.1" status: 404 len: 335 time: 0.2222319 May 12 15:39:11.798448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34344) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:11.867262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Made reservation on behalf of f798fdc3e9c54b38b7dbb0478a1d31d6 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:11.871210 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:11.901736 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-858a75e9-f324-4f23-9a0d-3b5ed6610c5e None None] Provisioning for port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:39:11.971812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e60e88df-e3f5-43ee-9957-d0e2ad1bd28c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:39:12.012912 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:12.083197 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:12.186687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-48db705f-85ae-4555-a8a2-a68c3214dc11 None None] Provisioning complete for port aec884a7-8012-4fb8-9e21-066760a3e1d2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:12.187052 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48db705f-85ae-4555-a8a2-a68c3214dc11 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:12.212849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:12.246885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:12.249218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=b3f0dc69-a505-4a60-ad9b-a912e5401a58,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:12.252887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:12.350660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:39:12.441651 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:12.442550 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:12.469629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-845cb593-e0f2-4e91-82c9-9d103ca086f8 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Deleting subnet 8c735b68-13dc-4d08-a1f8-f08b9ae4ff6b {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:39:12.487956 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-845cb593-e0f2-4e91-82c9-9d103ca086f8 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:12.585216 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-845cb593-e0f2-4e91-82c9-9d103ca086f8 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:12.667443 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:12.691478 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-845cb593-e0f2-4e91-82c9-9d103ca086f8 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:12.704301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e60e88df-e3f5-43ee-9957-d0e2ad1bd28c,segment=NetworkSegment(c345e75f-d395-4dba-a724-35c44275a64f),segment_id=c345e75f-d395-4dba-a724-35c44275a64f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:12.710270 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:12.827313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=e60e88df-e3f5-43ee-9957-d0e2ad1bd28c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:12.857083 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-02a4ae97-9ca5-4f8c-b547-46cf092e8045 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:12.966260 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-845cb593-e0f2-4e91-82c9-9d103ca086f8 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:12.974104 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:13.016415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-43ebc7cb-32ee-447a-9c00-15090f92c37d None None] Provisioning complete for port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:13.016961 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-43ebc7cb-32ee-447a-9c00-15090f92c37d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:13.158471 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-845cb593-e0f2-4e91-82c9-9d103ca086f8 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:13.162326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-845cb593-e0f2-4e91-82c9-9d103ca086f8 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event deleted for resources: {'Subnet': ['ID=8c735b68-13dc-4d08-a1f8-f08b9ae4ff6b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:13.213745 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95abf400-9983-4368-8660-37d5b5845206 None None] Network c9a6bb00-bbac-4814-bdfd-4659f4eb623c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:13.215562 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:13.218327 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:13.266136 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-845cb593-e0f2-4e91-82c9-9d103ca086f8 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "DELETE /v2.0/subnets/8c735b68-13dc-4d08-a1f8-f08b9ae4ff6b HTTP/1.1" status: 204 len: 168 time: 1.4092076 May 12 15:39:13.267483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port f936f886-df20-4e53-bbc8-3233883932ef yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:39:13.304583 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:13.306447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34388) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:13.325326 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:13.440897 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:13.637317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e271f5a-c812-45bf-9fe3-255c2d4e0c6f None None] DHCP port deletion for c9a6bb00-bbac-4814-bdfd-4659f4eb623c request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:39:13.642610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9e271f5a-c812-45bf-9fe3-255c2d4e0c6f None None] Deleting port de80ba7e-13c7-46eb-b13c-cd31ade2e2af {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:13.642953 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9e271f5a-c812-45bf-9fe3-255c2d4e0c6f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:13.649093 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:13.725898 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:13.741912 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:13.909894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=b3f0dc69-a505-4a60-ad9b-a912e5401a58,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:13.921256 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:13.983159 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Deleting port de80ba7e-13c7-46eb-b13c-cd31ade2e2af {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:13.983604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:14.034223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:14.127284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9e271f5a-c812-45bf-9fe3-255c2d4e0c6f None None] For port de80ba7e-13c7-46eb-b13c-cd31ade2e2af, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=de80ba7e-13c7-46eb-b13c-cd31ade2e2af,segment=NetworkSegment(19660022-17a8-473d-9896-f59cce2ae64e),segment_id=19660022-17a8-473d-9896-f59cce2ae64e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:14.127866 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9e271f5a-c812-45bf-9fe3-255c2d4e0c6f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:14.254504 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Floating IP c24d2acf-3216-485d-abda-c05c5a66e7eb associated. External IP: 172.25.8.233, port: 8ac3db5f-3324-4a02-a6e5-504a9ea69fc2. May 12 15:39:14.337730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9e271f5a-c812-45bf-9fe3-255c2d4e0c6f None None] Calling delete_port for de80ba7e-13c7-46eb-b13c-cd31ade2e2af owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:14.445515 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9e271f5a-c812-45bf-9fe3-255c2d4e0c6f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:14.512054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Allocated IP 172.25.8.231 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/f97fc964-9829-4202-b95a-8c9798200bd8) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:14.568384 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e271f5a-c812-45bf-9fe3-255c2d4e0c6f None None] No DVR routers for this DVR port de80ba7e-13c7-46eb-b13c-cd31ade2e2af on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:39:14.580743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e271f5a-c812-45bf-9fe3-255c2d4e0c6f None None] Pushing event deleted for resources: {'Port': ['ID=de80ba7e-13c7-46eb-b13c-cd31ade2e2af,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:14.748255 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:14.860624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e60e88df-e3f5-43ee-9957-d0e2ad1bd28c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:39:14.872051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3c282c52-5b3b-474f-b33b-26979e8a2384,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:14.914092 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:14.960053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:14.960704 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:15.112084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Checking segment: {'id': '09c83b83-4d53-47f0-b181-c0fb6ed7f95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '85cd1d66-57c4-4d94-b782-1d4cae810f95'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:39:15.119102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Network hostable DHCP agents. Network: 85cd1d66-57c4-4d94-b782-1d4cae810f95, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:39:15.144473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:39:15.260524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] For port de80ba7e-13c7-46eb-b13c-cd31ade2e2af, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=de80ba7e-13c7-46eb-b13c-cd31ade2e2af,segment=NetworkSegment(19660022-17a8-473d-9896-f59cce2ae64e),segment_id=19660022-17a8-473d-9896-f59cce2ae64e)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:15.260981 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:15.299210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device de80ba7e-13c7-46eb-b13c-cd31ade2e2af no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:39:15.299691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:15.316698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:15.334845 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-31c0f987-31d2-4530-ae75-bbcd197861f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:15.335831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:15.360999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: de80ba7e-13c7-46eb-b13c-cd31ade2e2af {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:39:15.361686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device de80ba7e-13c7-46eb-b13c-cd31ade2e2af not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:39:15.511297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Pushing event updated for resources: {'Port': ['ID=f97fc964-9829-4202-b95a-8c9798200bd8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:15.629457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Calling delete_port for de80ba7e-13c7-46eb-b13c-cd31ade2e2af owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:15.729365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Network 85cd1d66-57c4-4d94-b782-1d4cae810f95 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:39:15.731901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::41 (2447b094-d5d6-41ef-a146-2bf56f5399af/9c050e5e-c14a-45d2-9f3a-26a91f8ad488/f936f886-df20-4e53-bbc8-3233883932ef) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:15.807863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:39:15.822365 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48c4a85-a9f7-44a1-838c-0f5fc3397da1 None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:39:15.822824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8:0:1:f816:3eff:fe04:411e (2447b094-d5d6-41ef-a146-2bf56f5399af/b78785e4-055a-4a30-9a26-24fb6d6c4882/f936f886-df20-4e53-bbc8-3233883932ef) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:15.845550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 85cd1d66-57c4-4d94-b782-1d4cae810f95) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:15.848962 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48c4a85-a9f7-44a1-838c-0f5fc3397da1 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:15.849685 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a48c4a85-a9f7-44a1-838c-0f5fc3397da1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:15.859751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03e50951-f9f4-4a8b-89a8-acd14cbf3b2a None None] Network 85cd1d66-57c4-4d94-b782-1d4cae810f95 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:15.886035 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:15.941671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:15.942476 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:16.009612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34682) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:16.023701 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a48c4a85-a9f7-44a1-838c-0f5fc3397da1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:16.037671 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b3460c3f-cdb2-43a8-951f-07fe0a865178 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 4.4965074 May 12 15:39:16.043599 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48c4a85-a9f7-44a1-838c-0f5fc3397da1 None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:16.044628 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a48c4a85-a9f7-44a1-838c-0f5fc3397da1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:16.057735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6ffc72fa-b482-4109-a0dd-c20b4c27bf6b tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 982 time: 5.2627945 May 12 15:39:16.060667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34698) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:16.076144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:39:16.076493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-1998987371'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:16.077019 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:39:16.091781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:16.109003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:network and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:16.122324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:16.151482 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:16.186920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Made reservation on behalf of 9d4bdd73a39f4390bb7d4c6d7a1fc0c4 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:16.191210 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:16.236929 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a48c4a85-a9f7-44a1-838c-0f5fc3397da1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:16.237321 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48c4a85-a9f7-44a1-838c-0f5fc3397da1 None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:39:16.283944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 561} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:39:16.335325 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:16.342220 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:16.367898 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:16.368240 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Added segment 18bd4448-0f94-4680-9be4-a1ef24f52439 of type vlan for network b0419c0f-ed69-45c1-aa89-5514f9462b46 May 12 15:39:16.375314 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7859125e-5c9e-448b-989c-ab8b8828dfc1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:16.427193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7859125e-5c9e-448b-989c-ab8b8828dfc1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:16.436767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7859125e-5c9e-448b-989c-ab8b8828dfc1 admin admin] Usage tracker for resource:security_group_rule and tenant:f94686aceca749c0852ada0bf1959276 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:16.446766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7859125e-5c9e-448b-989c-ab8b8828dfc1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:16.454271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7859125e-5c9e-448b-989c-ab8b8828dfc1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:16.578526 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7859125e-5c9e-448b-989c-ab8b8828dfc1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:16.589724 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7859125e-5c9e-448b-989c-ab8b8828dfc1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:16.616566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Deleting port de80ba7e-13c7-46eb-b13c-cd31ade2e2af {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:16.616913 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:16.622600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08717fa3-afe9-4c29-a959-a6b3de154430 None None] Network 85cd1d66-57c4-4d94-b782-1d4cae810f95 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:16.667993 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:16.685943 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7859125e-5c9e-448b-989c-ab8b8828dfc1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f94686aceca749c0852ada0bf1959276&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6748185 May 12 15:39:16.686645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7859125e-5c9e-448b-989c-ab8b8828dfc1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a203eef3-f047-4f39-abac-8ab73fccaed5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:16.690594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34766) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:16.775891 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:16.792148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:16.809192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:16.814956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] The port 'de80ba7e-13c7-46eb-b13c-cd31ade2e2af' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:39:16.877161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:16.924334 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75b28ec6-fd6d-435c-8838-eac5ad06e9e8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:17.002113 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75b28ec6-fd6d-435c-8838-eac5ad06e9e8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:17.112351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:17.222233 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:17.274812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object f936f886-df20-4e53-bbc8-3233883932ef will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:17.278588 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75b28ec6-fd6d-435c-8838-eac5ad06e9e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:17.282067 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-75b28ec6-fd6d-435c-8838-eac5ad06e9e8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:17.284020 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-75b28ec6-fd6d-435c-8838-eac5ad06e9e8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a203eef3-f047-4f39-abac-8ab73fccaed5 HTTP/1.1" status: 204 len: 168 time: 0.5923493 May 12 15:39:17.287459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c9a6bb00-bbac-4814-bdfd-4659f4eb623c']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:17.321749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Network': ['ID=b0419c0f-ed69-45c1-aa89-5514f9462b46,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:17.328049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75b28ec6-fd6d-435c-8838-eac5ad06e9e8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a203eef3-f047-4f39-abac-8ab73fccaed5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:17.334392 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-73153e76-d3f7-43a3-ac66-a8901468d234 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 1.2725277 May 12 15:39:17.337045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34842) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:17.343558 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network b0419c0f-ed69-45c1-aa89-5514f9462b46 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:39:17.360898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'subnet': {'network_id': 'b0419c0f-ed69-45c1-aa89-5514f9462b46', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:17.394516 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:17.405720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '19660022-17a8-473d-9896-f59cce2ae64e') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:17.407125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '19660022-17a8-473d-9896-f59cce2ae64e') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:17.628748 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:17.716376 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:17.720248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:17.730821 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:17.731016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:17.747541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:17.753264 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:subnet and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:17.754753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:17.760107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:17.765336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:17.766142 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:17.777798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:17.797417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Releasing vlan 566 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:39:17.799124 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:17.807387 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Made reservation on behalf of 9d4bdd73a39f4390bb7d4c6d7a1fc0c4 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:17.811236 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: timer() May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:39:17.874691 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:39:18.027019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34926) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:18.054977 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-659aeb71-2b02-44d8-936c-bef3ca377ace admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:18.079166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-659aeb71-2b02-44d8-936c-bef3ca377ace admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:18.084096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-659aeb71-2b02-44d8-936c-bef3ca377ace admin admin] Usage tracker for resource:security_group_rule and tenant:b3667c4d169144eb8f3939e0407c70fc is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:18.087147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-659aeb71-2b02-44d8-936c-bef3ca377ace admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:18.106512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-659aeb71-2b02-44d8-936c-bef3ca377ace admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:18.148934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=f936f886-df20-4e53-bbc8-3233883932ef,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:18.154879 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7e87a07a-57a0-485a-a6f6-64b221cc75dd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1031 time: 7.8110731 May 12 15:39:18.174534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34932) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:18.232104 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:18.292695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d00b8f4c-fb03-41a9-a857-c5f96fb2a9c4 None None] Provisioning for port f936f886-df20-4e53-bbc8-3233883932ef completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:39:18.297971 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d00b8f4c-fb03-41a9-a857-c5f96fb2a9c4 None None] Provisioning complete for port f936f886-df20-4e53-bbc8-3233883932ef triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:18.298333 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d00b8f4c-fb03-41a9-a857-c5f96fb2a9c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:18.335102 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:18.349472 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:18.383818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-f113dea6-76e8-4a63-8482-0438484951d8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port f936f886-df20-4e53-bbc8-3233883932ef {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:18.390506 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f113dea6-76e8-4a63-8482-0438484951d8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:18.410091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d00b8f4c-fb03-41a9-a857-c5f96fb2a9c4 None None] Port f936f886-df20-4e53-bbc8-3233883932ef cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:39:18.525831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event deleted for resources: {'Network': ['ID=c9a6bb00-bbac-4814-bdfd-4659f4eb623c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:18.533717 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c299f56d-de8d-4b14-ac7b-ec32aec002a1 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "DELETE /v2.0/networks/c9a6bb00-bbac-4814-bdfd-4659f4eb623c HTTP/1.1" status: 204 len: 168 time: 5.2216322 May 12 15:39:18.538634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34936) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:18.553653 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:18.652703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-0cdcf32b-85cb-4f7a-a951-ce32b667e443 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Deleting subnet 1b4efce0-efde-4551-8b49-a4b113962251 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:39:18.657638 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0cdcf32b-85cb-4f7a-a951-ce32b667e443 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:18.720391 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0cdcf32b-85cb-4f7a-a951-ce32b667e443 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:18.772578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Router 7c141417-daaf-4ea8-bcfa-5b34e251efc1 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:39:18.789587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Subnet': ['ID=93f4665b-d6a8-4147-b1d7-7358a9b0558e,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:18.810940 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Checking segment: {'id': '18bd4448-0f94-4680-9be4-a1ef24f52439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'b0419c0f-ed69-45c1-aa89-5514f9462b46'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:39:18.811305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network hostable DHCP agents. Network: b0419c0f-ed69-45c1-aa89-5514f9462b46, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:39:18.818904 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-659aeb71-2b02-44d8-936c-bef3ca377ace admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:18.840354 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-659aeb71-2b02-44d8-936c-bef3ca377ace admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:18.862369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network b0419c0f-ed69-45c1-aa89-5514f9462b46 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:39:18.940355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, b0419c0f-ed69-45c1-aa89-5514f9462b46) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:18.952734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-710d51ea-2388-418b-b006-7269d80b5e2d None None] Network b0419c0f-ed69-45c1-aa89-5514f9462b46 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:18.953542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f113dea6-76e8-4a63-8482-0438484951d8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:18.962923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:18.963519 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:18.971991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-659aeb71-2b02-44d8-936c-bef3ca377ace admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b3667c4d169144eb8f3939e0407c70fc&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9410846 May 12 15:39:18.971991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-659aeb71-2b02-44d8-936c-bef3ca377ace admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8730834b-56a2-4199-9a59-1f88c1cda240,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:18.976129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34952) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:19.232889 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0cdcf32b-85cb-4f7a-a951-ce32b667e443 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:19.278683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:39:19.318622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:19.320451 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b171574a-039c-46af-b624-81bf52316d95 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 916 time: 12.1207454 May 12 15:39:19.326570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34964) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:19.340825 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Sync routers for ids ['7c141417-daaf-4ea8-bcfa-5b34e251efc1'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:39:19.372514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-b0419c0f-ed69-45c1-aa89-5514f9462b46', 'network_id': 'b0419c0f-ed69-45c1-aa89-5514f9462b46', 'tenant_id': '9d4bdd73a39f4390bb7d4c6d7a1fc0c4', 'fixed_ips': [{'subnet_id': '93f4665b-d6a8-4147-b1d7-7358a9b0558e'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:39:19.373826 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:19.395261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Routers {'7c141417-daaf-4ea8-bcfa-5b34e251efc1'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:19.397753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7c141417-daaf-4ea8-bcfa-5b34e251efc1'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:19.434609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-f113dea6-76e8-4a63-8482-0438484951d8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for f936f886-df20-4e53-bbc8-3233883932ef owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:19.467128 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0cdcf32b-85cb-4f7a-a951-ce32b667e443 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:19.512510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cdcf32b-85cb-4f7a-a951-ce32b667e443 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event deleted for resources: {'Subnet': ['ID=1b4efce0-efde-4551-8b49-a4b113962251,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:19.525455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0cdcf32b-85cb-4f7a-a951-ce32b667e443 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:19.598608 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0cdcf32b-85cb-4f7a-a951-ce32b667e443 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "DELETE /v2.0/subnets/1b4efce0-efde-4551-8b49-a4b113962251 HTTP/1.1" status: 204 len: 168 time: 1.0577714 May 12 15:39:19.608989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34972) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:19.678764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 34976) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:19.679658 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f494defa-1cda-4681-8b8d-a1e621388b0c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.3396392 May 12 15:39:19.689080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-1711442359', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:19.701702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:19.711773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:router and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:19.730345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4feb856-15fa-4110-9406-9a8d40276c6c None None] Network 8ce74361-036e-4b19-b9d1-2b75a2ae9571 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:19.769447 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-939f629b-4ceb-4ca0-8173-ae4470516031 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:19.799317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for router was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:19.807252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource router. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:19.835833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-3b86a6f4-40a3-4ecf-b641-825d06c0c84c tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Deleting subnet 400f4760-7cc3-4cf7-afb0-8bf1209cbe83 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:39:19.854553 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:19.856093 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:19.875873 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-939f629b-4ceb-4ca0-8173-ae4470516031 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:19.877790 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b86a6f4-40a3-4ecf-b641-825d06c0c84c tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:19.935564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-d821de9a-a2a8-4fa6-9335-c3b7a9ba1d62 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:19.936682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-d821de9a-a2a8-4fa6-9335-c3b7a9ba1d62 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Synchronizing usage tracker for tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:39:19.945241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Allocated IP 172.20.0.2 (b0419c0f-ed69-45c1-aa89-5514f9462b46/93f4665b-d6a8-4147-b1d7-7358a9b0558e/c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:20.020154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-d821de9a-a2a8-4fa6-9335-c3b7a9ba1d62 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Unset dirty status for tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:39:20.021336 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-d821de9a-a2a8-4fa6-9335-c3b7a9ba1d62 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/networks?id=85cd1d66-57c4-4d94-b782-1d4cae810f95 HTTP/1.1" status: 200 len: 808 time: 0.5078740 May 12 15:39:20.047898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-6dc613f0-49c6-4d3a-98fb-d3bb30662fa7 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/quotas/f798fdc3e9c54b38b7dbb0478a1d31d6 HTTP/1.1" status: 200 len: 375 time: 0.0160003 May 12 15:39:20.057897 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b86a6f4-40a3-4ecf-b641-825d06c0c84c tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:20.102992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-939f629b-4ceb-4ca0-8173-ae4470516031 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:20.126174 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-26fffb5f-7834-4b60-b465-59f31947eda9 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=f798fdc3e9c54b38b7dbb0478a1d31d6&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0684247 May 12 15:39:20.129056 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f113dea6-76e8-4a63-8482-0438484951d8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:20.132187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-939f629b-4ceb-4ca0-8173-ae4470516031 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8730834b-56a2-4199-9a59-1f88c1cda240,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:20.139181 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:20.144484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Set router 7c141417-daaf-4ea8-bcfa-5b34e251efc1 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:39:20.182145 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-d30c1274-f8b7-4fa6-863a-71823427e113 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:39:20.183089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-d30c1274-f8b7-4fa6-863a-71823427e113 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0132737 May 12 15:39:20.195816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f113dea6-76e8-4a63-8482-0438484951d8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=f936f886-df20-4e53-bbc8-3233883932ef,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:20.274746 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b86a6f4-40a3-4ecf-b641-825d06c0c84c tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:20.373613 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-939f629b-4ceb-4ca0-8173-ae4470516031 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:20.377584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-939f629b-4ceb-4ca0-8173-ae4470516031 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8730834b-56a2-4199-9a59-1f88c1cda240 HTTP/1.1" status: 204 len: 168 time: 1.3989043 May 12 15:39:20.391012 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f113dea6-76e8-4a63-8482-0438484951d8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:20.392902 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f113dea6-76e8-4a63-8482-0438484951d8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/f936f886-df20-4e53-bbc8-3233883932ef HTTP/1.1" status: 204 len: 168 time: 2.2174289 May 12 15:39:20.396577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34988) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:20.520475 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-2b93871f-a83f-4619-902a-d87f44a02342 service neutron] 10.222.0.82 "GET /v2.0/networks/85cd1d66-57c4-4d94-b782-1d4cae810f95?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3252354 May 12 15:39:20.547628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-347bd734-5826-496f-a64c-f8c97fcad75c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:20.548498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-347bd734-5826-496f-a64c-f8c97fcad75c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:39:20.606118 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-498ae063-bb2e-41b9-8173-14ab923a68d8 None None] DHCP port deletion for 8ce74361-036e-4b19-b9d1-2b75a2ae9571 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:39:20.610322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-347bd734-5826-496f-a64c-f8c97fcad75c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:39:20.614148 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-347bd734-5826-496f-a64c-f8c97fcad75c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.2166166 May 12 15:39:20.614949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 34994) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:20.651949 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-498ae063-bb2e-41b9-8173-14ab923a68d8 None None] Deleting port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:20.652292 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-498ae063-bb2e-41b9-8173-14ab923a68d8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:20.735839 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b86a6f4-40a3-4ecf-b641-825d06c0c84c tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:20.787402 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:20.798898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1e0eb504-a8b6-4957-863f-ad06405db859 service neutron] 10.222.0.82 "GET /v2.0/networks/85cd1d66-57c4-4d94-b782-1d4cae810f95?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2475016 May 12 15:39:20.799798 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:20.815343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Transition to ACTIVE for port object c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:20.840899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0459879-62da-4afc-9e2d-f3a2afdb96e7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:20.849602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f0459879-62da-4afc-9e2d-f3a2afdb96e7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.1894336 May 12 15:39:20.850203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Transition to ACTIVE for port object c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:20.850318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35000) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:20.990257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83dcfc5d-f249-4cb2-8744-1423d2e4c021 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:20.991737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83dcfc5d-f249-4cb2-8744-1423d2e4c021 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:20.993311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83dcfc5d-f249-4cb2-8744-1423d2e4c021 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:21.010082 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-83dcfc5d-f249-4cb2-8744-1423d2e4c021 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.1587029 May 12 15:39:21.010722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35012) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:21.128959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b86a6f4-40a3-4ecf-b641-825d06c0c84c tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event deleted for resources: {'Subnet': ['ID=400f4760-7cc3-4cf7-afb0-8bf1209cbe83,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:21.134823 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b86a6f4-40a3-4ecf-b641-825d06c0c84c tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:21.145524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-d3ac3449-1302-4c9d-96b8-1a7aeef020a4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 9c050e5e-c14a-45d2-9f3a-26a91f8ad488 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:39:21.149014 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3ac3449-1302-4c9d-96b8-1a7aeef020a4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:21.242789 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3ac3449-1302-4c9d-96b8-1a7aeef020a4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:21.344191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:39:21.348564 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3b86a6f4-40a3-4ecf-b641-825d06c0c84c tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "DELETE /v2.0/subnets/400f4760-7cc3-4cf7-afb0-8bf1209cbe83 HTTP/1.1" status: 204 len: 168 time: 1.7370260 May 12 15:39:21.363675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35030) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:21.434630 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3ac3449-1302-4c9d-96b8-1a7aeef020a4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:21.452125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f1e06a3-b5ed-4c8b-b956-a5b3046d561b None None] Network ff1e2484-ac35-4e14-aa85-193f3c121e48 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:21.487183 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:21.581764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Network b0419c0f-ed69-45c1-aa89-5514f9462b46 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:21.604453 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:21.657459 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4ad5e780-79c4-41b9-8d84-3d426adc22b2 req-e643f688-596b-4027-b9b3-2c8b1c2e3679 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 210 time: 0.5656197 May 12 15:39:21.666583 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3ac3449-1302-4c9d-96b8-1a7aeef020a4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:21.678933 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:21.716842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-498ae063-bb2e-41b9-8173-14ab923a68d8 None None] For port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=8b4e70fe-09b8-4d59-aa6c-7b85953bcef8,segment=NetworkSegment(73d0e46e-b7ec-4dc8-be38-786a1545a838),segment_id=73d0e46e-b7ec-4dc8-be38-786a1545a838)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:21.717200 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-498ae063-bb2e-41b9-8173-14ab923a68d8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:21.775654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3ac3449-1302-4c9d-96b8-1a7aeef020a4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=9c050e5e-c14a-45d2-9f3a-26a91f8ad488,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:21.784512 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3ac3449-1302-4c9d-96b8-1a7aeef020a4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:21.805360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d3ac3449-1302-4c9d-96b8-1a7aeef020a4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/9c050e5e-c14a-45d2-9f3a-26a91f8ad488 HTTP/1.1" status: 204 len: 168 time: 0.7927654 May 12 15:39:21.808356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35046) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:21.900693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-7a87283b-9095-42c7-bb59-401e70805ecd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet b78785e4-055a-4a30-9a26-24fb6d6c4882 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:39:21.905250 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a87283b-9095-42c7-bb59-401e70805ecd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:21.932173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef399090-c2e0-41bf-aea8-f325e891e7fe None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:21.935312 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:22.002390 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a87283b-9095-42c7-bb59-401e70805ecd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:22.017771 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Deleting port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:22.027873 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:22.325846 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:22.356585 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a87283b-9095-42c7-bb59-401e70805ecd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:22.362531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-498ae063-bb2e-41b9-8173-14ab923a68d8 None None] Calling delete_port for 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:22.477739 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a87283b-9095-42c7-bb59-401e70805ecd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:22.528841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Attempting to bind port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:39:22.529339 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Attempting to bind port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '18bd4448-0f94-4680-9be4-a1ef24f52439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'b0419c0f-ed69-45c1-aa89-5514f9462b46'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:39:22.530590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Attempting to bind port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 on network b0419c0f-ed69-45c1-aa89-5514f9462b46 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:39:22.587693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a87283b-9095-42c7-bb59-401e70805ecd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=b78785e4-055a-4a30-9a26-24fb6d6c4882,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:22.611908 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a87283b-9095-42c7-bb59-401e70805ecd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:22.627851 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7a87283b-9095-42c7-bb59-401e70805ecd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/b78785e4-055a-4a30-9a26-24fb6d6c4882 HTTP/1.1" status: 204 len: 168 time: 0.8161762 May 12 15:39:22.631927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35064) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:22.640701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] For port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=8b4e70fe-09b8-4d59-aa6c-7b85953bcef8,segment=NetworkSegment(73d0e46e-b7ec-4dc8-be38-786a1545a838),segment_id=73d0e46e-b7ec-4dc8-be38-786a1545a838)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:22.641261 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:22.708795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Pushing event updated for resources: {'Port': ['ID=c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:22.733879 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4404cf0e-fe1f-4490-a5c9-37f927217c6c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0947144 May 12 15:39:22.734546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35074) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:22.747803 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-17814a86-3cb3-4268-abd9-c17a3e70143f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:22.816708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Calling delete_port for 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:22.891108 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 39, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:39:22.891488 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Checking segment: {'id': '18bd4448-0f94-4680-9be4-a1ef24f52439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'b0419c0f-ed69-45c1-aa89-5514f9462b46'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:39:22.891897 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:22.892285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Bound using segment: {'id': '18bd4448-0f94-4680-9be4-a1ef24f52439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'b0419c0f-ed69-45c1-aa89-5514f9462b46'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:39:22.892772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Bound port: c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '18bd4448-0f94-4680-9be4-a1ef24f52439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'b0419c0f-ed69-45c1-aa89-5514f9462b46'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:39:22.893254 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:22.903736 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-498ae063-bb2e-41b9-8173-14ab923a68d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:22.913211 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:39:22.913831 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:39:23.028640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 update to DOWN by agent not found {{(pid=88153) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2140}} May 12 15:39:23.099377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-17814a86-3cb3-4268-abd9-c17a3e70143f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:23.103263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'name': 'tempest-ImageQuotaTest-411269687-router', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.231'}], 'enable_snat': True}, 'gw_port_id': 'f97fc964-9829-4202-b95a-8c9798200bd8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:07Z', 'updated_at': '2022-05-12T15:39:16Z', 'revision_number': 3, 'project_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'gw_port': {'id': 'f97fc964-9829-4202-b95a-8c9798200bd8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:89:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3113, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:13Z', 'updated_at': '2022-05-12T15:39:14Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:23.106816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-17814a86-3cb3-4268-abd9-c17a3e70143f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:23.114566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-17814a86-3cb3-4268-abd9-c17a3e70143f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:23.118913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Checking router: 7c141417-daaf-4ea8-bcfa-5b34e251efc1 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:39:23.119268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Updating router 7c141417-daaf-4ea8-bcfa-5b34e251efc1 port f97fc964-9829-4202-b95a-8c9798200bd8 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:39:23.133243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-17814a86-3cb3-4268-abd9-c17a3e70143f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:23.153201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-498ae063-bb2e-41b9-8173-14ab923a68d8 None None] Pushing event deleted for resources: {'Port': ['ID=8b4e70fe-09b8-4d59-aa6c-7b85953bcef8,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:23.157666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-498ae063-bb2e-41b9-8173-14ab923a68d8 None None] No DVR routers for this DVR port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:39:23.310359 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:23.364911 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:23.412368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] For port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:39:23.413680 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:23.423050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Deleting port 8b4e70fe-09b8-4d59-aa6c-7b85953bcef8 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:23.423622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:23.450270 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] For port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5,segment=NetworkSegment(18bd4448-0f94-4680-9be4-a1ef24f52439),segment_id=18bd4448-0f94-4680-9be4-a1ef24f52439)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:39:23.498497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17814a86-3cb3-4268-abd9-c17a3e70143f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:23.502175 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17814a86-3cb3-4268-abd9-c17a3e70143f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:23.509362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3cd1cf1-a634-477b-ad49-ab91bbf1079f None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:39:23.512158 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:23.625211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-666f1786-3048-426b-b9d7-e885b9dcf751 None None] Pushing event updated for resources: {'Port': ['ID=c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:23.657756 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f3cd1cf1-a634-477b-ad49-ab91bbf1079f None None] Deleting port aec884a7-8012-4fb8-9e21-066760a3e1d2 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:23.658581 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f3cd1cf1-a634-477b-ad49-ab91bbf1079f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:23.736746 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97548f55-199d-4ba7-bd4a-ef6e99532bb6 None None] DHCP port deletion for ff1e2484-ac35-4e14-aa85-193f3c121e48 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:39:23.750166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-97548f55-199d-4ba7-bd4a-ef6e99532bb6 None None] Deleting port 980e521e-27f1-4eeb-a586-9243c69f7517 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:23.750745 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-97548f55-199d-4ba7-bd4a-ef6e99532bb6 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:23.817850 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8404d281-e13a-445a-a6a5-de95f023ca31 req-aafb827b-2d03-4358-aa50-9fcd9ab43695 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 210 time: 0.6727903 May 12 15:39:23.865752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] The port '8b4e70fe-09b8-4d59-aa6c-7b85953bcef8' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:39:23.899361 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17814a86-3cb3-4268-abd9-c17a3e70143f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:24.041017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-e9c7f8d5-2406-4d54-b7a0-f6d868193df4 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:24.042611 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-e9c7f8d5-2406-4d54-b7a0-f6d868193df4 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.84 "GET /v2.0/networks?id=85cd1d66-57c4-4d94-b782-1d4cae810f95 HTTP/1.1" status: 200 len: 808 time: 0.9011195 May 12 15:39:24.063328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17814a86-3cb3-4268-abd9-c17a3e70143f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:24.067522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-17814a86-3cb3-4268-abd9-c17a3e70143f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:24.071337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17814a86-3cb3-4268-abd9-c17a3e70143f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:24.072034 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17814a86-3cb3-4268-abd9-c17a3e70143f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:24.089352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Request body: {'port': {'device_id': '1703133c-bec8-4a64-87dd-56b43532f2ab', 'network_id': '85cd1d66-57c4-4d94-b782-1d4cae810f95', 'admin_state_up': True, 'tenant_id': 'f798fdc3e9c54b38b7dbb0478a1d31d6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:24.163063 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:24.176155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Allocated IP 172.20.0.1 (293104b9-2a34-465b-ba14-8789ca8ec013/917eef28-a2e7-40e6-afd8-bba440bc427a/65e83242-c0d2-43cd-93cd-05fc538f6b3a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:24.198354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17814a86-3cb3-4268-abd9-c17a3e70143f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=ffb8a9ec-0442-4075-ab64-20864846e225,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:24.225406 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-17814a86-3cb3-4268-abd9-c17a3e70143f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.4897418 May 12 15:39:24.229050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35136) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:24.241272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8ce74361-036e-4b19-b9d1-2b75a2ae9571']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:24.244246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a7908e3f-cc28-4603-9506-898f206ffb0e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:24.304385 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-97548f55-199d-4ba7-bd4a-ef6e99532bb6 None None] For port 980e521e-27f1-4eeb-a586-9243c69f7517, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=980e521e-27f1-4eeb-a586-9243c69f7517,segment=NetworkSegment(20bf5b3e-bbbd-4e60-b09a-451438ef59de),segment_id=20bf5b3e-bbbd-4e60-b09a-451438ef59de)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:24.305468 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-97548f55-199d-4ba7-bd4a-ef6e99532bb6 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:24.358207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '73d0e46e-b7ec-4dc8-be38-786a1545a838') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:24.358521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '73d0e46e-b7ec-4dc8-be38-786a1545a838') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:24.386173 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:24.437011 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:24.462788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Releasing vlan 572 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:39:24.463203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: timer() May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:39:24.495825 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:39:24.509987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-97548f55-199d-4ba7-bd4a-ef6e99532bb6 None None] Calling delete_port for 980e521e-27f1-4eeb-a586-9243c69f7517 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:24.620592 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:24.620829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:24.630789 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:24.670831 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:24.674464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event deleted for resources: {'Network': ['ID=8ce74361-036e-4b19-b9d1-2b75a2ae9571,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:24.684843 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Usage tracker for resource:port and tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:24.704369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Transition to ACTIVE for port object 65e83242-c0d2-43cd-93cd-05fc538f6b3a will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:24.707955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a7908e3f-cc28-4603-9506-898f206ffb0e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:24.720764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a7908e3f-cc28-4603-9506-898f206ffb0e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:24.721431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a7908e3f-cc28-4603-9506-898f206ffb0e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:24.729082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a7908e3f-cc28-4603-9506-898f206ffb0e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:24.734263 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9f73658d-8b45-4a29-9363-4e873aa6a45e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "DELETE /v2.0/networks/8ce74361-036e-4b19-b9d1-2b75a2ae9571 HTTP/1.1" status: 204 len: 168 time: 3.3661315 May 12 15:39:24.737948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35162) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:24.739000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:24.784361 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:24.859100 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-97548f55-199d-4ba7-bd4a-ef6e99532bb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:24.912413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a7908e3f-cc28-4603-9506-898f206ffb0e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:24.915668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Network 293104b9-2a34-465b-ba14-8789ca8ec013 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:24.916143 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7908e3f-cc28-4603-9506-898f206ffb0e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:24.931429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:24.932881 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe51ae05-4974-409e-8b74-9bc49bc23657 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:24.936228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:24.941278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:25.011757 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:39:25.085745 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:25.086519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97548f55-199d-4ba7-bd4a-ef6e99532bb6 None None] Pushing event deleted for resources: {'Port': ['ID=980e521e-27f1-4eeb-a586-9243c69f7517,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:25.096934 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f3cd1cf1-a634-477b-ad49-ab91bbf1079f None None] For port aec884a7-8012-4fb8-9e21-066760a3e1d2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=aec884a7-8012-4fb8-9e21-066760a3e1d2,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:25.097762 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f3cd1cf1-a634-477b-ad49-ab91bbf1079f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:25.159098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97548f55-199d-4ba7-bd4a-ef6e99532bb6 None None] No DVR routers for this DVR port 980e521e-27f1-4eeb-a586-9243c69f7517 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:39:25.160433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Pushing event updated for resources: {'Port': ['ID=65e83242-c0d2-43cd-93cd-05fc538f6b3a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:25.454303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:39:25.525017 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:25.536773 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31217a42-46ff-4abd-bee3-9f703e6839a0 req-b4d62fd5-2498-4817-8489-be6c7af97757 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 210 time: 0.3387945 May 12 15:39:25.539590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Made reservation on behalf of f798fdc3e9c54b38b7dbb0478a1d31d6 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:25.555753 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:25.716445 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f3cd1cf1-a634-477b-ad49-ab91bbf1079f None None] Calling delete_port for aec884a7-8012-4fb8-9e21-066760a3e1d2 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:25.872025 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:25.872247 n-d-841483-1 neutron-server[88152]: INFO neutron.db.ipam_backend_mixin [None req-a7908e3f-cc28-4603-9506-898f206ffb0e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet ffb8a9ec-0442-4075-ab64-20864846e225 (CIDR: 2001:db8::/64) May 12 15:39:25.877955 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:25.907594 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:25.916770 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65943e3c-c9e8-472f-80b9-20297ebf7d90 None None] Network b0419c0f-ed69-45c1-aa89-5514f9462b46 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:25.939863 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-a7908e3f-cc28-4603-9506-898f206ffb0e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:39:25.940271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a7908e3f-cc28-4603-9506-898f206ffb0e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:25.949298 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe51ae05-4974-409e-8b74-9bc49bc23657 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:25.957025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c12f83db-80b2-4ed7-b48c-d0df5e44e412 None None] Provisioning for port 65e83242-c0d2-43cd-93cd-05fc538f6b3a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:39:26.012147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fe51ae05-4974-409e-8b74-9bc49bc23657 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ff1e2484-ac35-4e14-aa85-193f3c121e48']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:26.036562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a7908e3f-cc28-4603-9506-898f206ffb0e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.8065257 May 12 15:39:26.040944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fe51ae05-4974-409e-8b74-9bc49bc23657 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '20bf5b3e-bbbd-4e60-b09a-451438ef59de') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:26.041732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-fe51ae05-4974-409e-8b74-9bc49bc23657 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '20bf5b3e-bbbd-4e60-b09a-451438ef59de') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:26.044695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35222) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:26.047658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Transition to ACTIVE for port object f97fc964-9829-4202-b95a-8c9798200bd8 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:26.053432 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f3cd1cf1-a634-477b-ad49-ab91bbf1079f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:26.056883 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c12f83db-80b2-4ed7-b48c-d0df5e44e412 None None] Provisioning complete for port 65e83242-c0d2-43cd-93cd-05fc538f6b3a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:26.057247 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c12f83db-80b2-4ed7-b48c-d0df5e44e412 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:26.061963 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe51ae05-4974-409e-8b74-9bc49bc23657 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:26.062141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'subnet': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:26.086474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Pushing event updated for resources: {'Port': ['ID=65e83242-c0d2-43cd-93cd-05fc538f6b3a,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:26.101452 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:26.124847 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe51ae05-4974-409e-8b74-9bc49bc23657 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:26.138217 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fe51ae05-4974-409e-8b74-9bc49bc23657 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Releasing vlan 576 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:39:26.138663 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe51ae05-4974-409e-8b74-9bc49bc23657 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: timer() May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:39:26.167779 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:39:26.179633 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:26.189288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3cd1cf1-a634-477b-ad49-ab91bbf1079f None None] Pushing event deleted for resources: {'Port': ['ID=aec884a7-8012-4fb8-9e21-066760a3e1d2,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:26.226961 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3cd1cf1-a634-477b-ad49-ab91bbf1079f None None] No DVR routers for this DVR port aec884a7-8012-4fb8-9e21-066760a3e1d2 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:39:26.262827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b9a5f11-88ea-45b9-bba3-62ff76e4d253 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:26.298033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Allocated IP 172.20.0.4 (85cd1d66-57c4-4d94-b782-1d4cae810f95/3c282c52-5b3b-474f-b33b-26979e8a2384/c04b659b-b7f0-4250-9162-64d4b30f41b3) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:26.319406 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe51ae05-4974-409e-8b74-9bc49bc23657 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:26.355418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fe51ae05-4974-409e-8b74-9bc49bc23657 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:26.366343 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fe51ae05-4974-409e-8b74-9bc49bc23657 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "DELETE /v2.0/networks/ff1e2484-ac35-4e14-aa85-193f3c121e48 HTTP/1.1" status: 204 len: 168 time: 1.6193790 May 12 15:39:26.372745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35228) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:26.390925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe51ae05-4974-409e-8b74-9bc49bc23657 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event deleted for resources: {'Network': ['ID=ff1e2484-ac35-4e14-aa85-193f3c121e48,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:26.399041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:39:26.402470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c12f83db-80b2-4ed7-b48c-d0df5e44e412 None None] Port 65e83242-c0d2-43cd-93cd-05fc538f6b3a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:39:26.450586 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Attempting to bind port f97fc964-9829-4202-b95a-8c9798200bd8 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:39:26.451162 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Attempting to bind port f97fc964-9829-4202-b95a-8c9798200bd8 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:39:26.452049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Attempting to bind port f97fc964-9829-4202-b95a-8c9798200bd8 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:39:26.510847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-223aca41-52cc-4d23-afce-763d4f820b3e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Deleting subnet 73529121-9bf5-45f1-bfed-1522a4a53d69 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:39:26.515696 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fd92a2a-f8bb-40bf-9500-77036240e459 None None] Pushing event updated for resources: {'Port': ['ID=f97fc964-9829-4202-b95a-8c9798200bd8,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:26.517930 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-223aca41-52cc-4d23-afce-763d4f820b3e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:26.519897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 39, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:39:26.520646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:39:26.521308 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:26.521889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:39:26.522541 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Bound port: f97fc964-9829-4202-b95a-8c9798200bd8, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:39:26.523097 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:26.575787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device aec884a7-8012-4fb8-9e21-066760a3e1d2 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:39:26.588043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:26.606931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Usage tracker for resource:subnet and tenant:d0c0be8fb6b844879953049ca91c6fac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:26.614843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:26.634089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:26.655305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.25.8.58 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/e475ae99-4cf4-40c9-bf47-bbb94f3c8f3a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:26.668562 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-223aca41-52cc-4d23-afce-763d4f820b3e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:26.688856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:26.697523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:26.705985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: aec884a7-8012-4fb8-9e21-066760a3e1d2 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:39:26.706319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device aec884a7-8012-4fb8-9e21-066760a3e1d2 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:39:26.706722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 980e521e-27f1-4eeb-a586-9243c69f7517 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:39:26.825819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 980e521e-27f1-4eeb-a586-9243c69f7517 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:39:26.827364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 980e521e-27f1-4eeb-a586-9243c69f7517 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:39:26.867593 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35236) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:26.869378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-89172870-8071-4de4-b056-85a02fdc0cd8 req-f4caba17-6834-4c74-9945-5a60ca08b6f4 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Synchronizing usage tracker for tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:39:26.946941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-89172870-8071-4de4-b056-85a02fdc0cd8 req-f4caba17-6834-4c74-9945-5a60ca08b6f4 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Unset dirty status for tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:39:26.948501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fddccfea-7468-442f-bc8a-600babd3936f None None] Provisioning for port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:39:26.949404 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89172870-8071-4de4-b056-85a02fdc0cd8 req-f4caba17-6834-4c74-9945-5a60ca08b6f4 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 210 time: 0.1627407 May 12 15:39:27.088496 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] For port f97fc964-9829-4202-b95a-8c9798200bd8, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:39:27.090531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] For port f97fc964-9829-4202-b95a-8c9798200bd8, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f97fc964-9829-4202-b95a-8c9798200bd8,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:39:27.091788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fddccfea-7468-442f-bc8a-600babd3936f None None] Provisioning complete for port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:27.092252 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fddccfea-7468-442f-bc8a-600babd3936f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:27.109008 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:27.112544 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-223aca41-52cc-4d23-afce-763d4f820b3e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:27.138484 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:27.206776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Network 293104b9-2a34-465b-ba14-8789ca8ec013 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:27.216113 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-16a44e3f-6863-49ba-af6d-9a8ea763561b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:27.220124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:27.231520 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:27.242852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-16a44e3f-6863-49ba-af6d-9a8ea763561b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:27.255727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2447b094-d5d6-41ef-a146-2bf56f5399af', 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'tenant_id': 'd0c0be8fb6b844879953049ca91c6fac', 'fixed_ips': [{'subnet_id': 'ffb8a9ec-0442-4075-ab64-20864846e225'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:39:27.256567 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:27.259695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-16a44e3f-6863-49ba-af6d-9a8ea763561b admin admin] Usage tracker for resource:security_group_rule and tenant:e46b1cf69885412282cd26ccd087ef54 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:27.271104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-16a44e3f-6863-49ba-af6d-9a8ea763561b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:27.283484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fd92a2a-f8bb-40bf-9500-77036240e459 None None] Pushing event updated for resources: {'Port': ['ID=f97fc964-9829-4202-b95a-8c9798200bd8,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:27.284860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-16a44e3f-6863-49ba-af6d-9a8ea763561b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:27.328406 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-223aca41-52cc-4d23-afce-763d4f820b3e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:27.337043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Routers {'7c141417-daaf-4ea8-bcfa-5b34e251efc1'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:27.338276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7c141417-daaf-4ea8-bcfa-5b34e251efc1'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:27.418039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-223aca41-52cc-4d23-afce-763d4f820b3e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event deleted for resources: {'Subnet': ['ID=73529121-9bf5-45f1-bfed-1522a4a53d69,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:27.449243 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-223aca41-52cc-4d23-afce-763d4f820b3e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:27.453861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:27.523296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:27.541603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6552ceb3-2ec7-4c28-ab54-d776c5e44444 None None] Network 9b7334d3-09cb-43ee-879c-8af2e3abb59f requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:27.634674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=e475ae99-4cf4-40c9-bf47-bbb94f3c8f3a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:27.644015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Network 85cd1d66-57c4-4d94-b782-1d4cae810f95 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:27.647101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:27.651649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:27.655847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-223aca41-52cc-4d23-afce-763d4f820b3e tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "DELETE /v2.0/subnets/73529121-9bf5-45f1-bfed-1522a4a53d69 HTTP/1.1" status: 204 len: 168 time: 1.2663534 May 12 15:39:27.658512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:27.662362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35262) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:27.683817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:27.716397 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Pushing event updated for resources: {'Port': ['ID=c04b659b-b7f0-4250-9162-64d4b30f41b3,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:27.725703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:27.795985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:27.797125 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:27.831117 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-8a977eb2-1f1c-4bc4-9046-7bd7523d5faf tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.7534781 May 12 15:39:27.856765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Request body: {'port': {'device_id': '1703133c-bec8-4a64-87dd-56b43532f2ab', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:27.978881 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-16a44e3f-6863-49ba-af6d-9a8ea763561b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:28.074500 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:28.104750 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-16a44e3f-6863-49ba-af6d-9a8ea763561b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:28.116050 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] Set router 7c141417-daaf-4ea8-bcfa-5b34e251efc1 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:39:28.166904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16a44e3f-6863-49ba-af6d-9a8ea763561b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c9a7b39-52f6-4b7e-8172-5b5e83c3d5c9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:28.242724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Router 7c141417-daaf-4ea8-bcfa-5b34e251efc1 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:39:28.253078 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:28.278379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Allocated IP 2001:db8::2 (2447b094-d5d6-41ef-a146-2bf56f5399af/ffb8a9ec-0442-4075-ab64-20864846e225/502308a6-1076-44de-9233-ae79e304dfc8) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:28.380369 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fddccfea-7468-442f-bc8a-600babd3936f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:28.463172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Deleting port cdf9fedf-365d-4e32-a48f-b738e2bd9239 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:28.463519 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:28.583994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-16a44e3f-6863-49ba-af6d-9a8ea763561b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e46b1cf69885412282cd26ccd087ef54&name=default HTTP/1.1" status: 200 len: 2983 time: 1.7098446 May 12 15:39:28.596805 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35280) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:28.602954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-fddccfea-7468-442f-bc8a-600babd3936f None None] For port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5,segment=NetworkSegment(18bd4448-0f94-4680-9be4-a1ef24f52439),segment_id=18bd4448-0f94-4680-9be4-a1ef24f52439)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:28.804849 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fddccfea-7468-442f-bc8a-600babd3936f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:28.901721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.objects.ports [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=88151) get_objects /opt/stack/neutron/neutron/objects/ports.py:461}} May 12 15:39:28.907024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc0457ac-2c58-474e-8f3b-89a76d5d782c req-beafa026-947b-487f-8c09-848cd88ce8a9 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:28.908673 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc0457ac-2c58-474e-8f3b-89a76d5d782c req-beafa026-947b-487f-8c09-848cd88ce8a9 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 931 time: 0.4560559 May 12 15:39:28.987606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-dc0457ac-2c58-474e-8f3b-89a76d5d782c req-a42835ff-cec2-43ec-948d-a847f8c93a7c tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Synchronizing usage tracker for tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:39:28.998856 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d0ef976-1e76-4aee-bd1f-f4efdff1508b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.000866 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fddccfea-7468-442f-bc8a-600babd3936f None None] Pushing event updated for resources: {'Port': ['ID=c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:29.057068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a805e63c-0a94-4528-a47e-dee4478f1e23 None None] Provisioning complete for port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:29.058552 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a805e63c-0a94-4528-a47e-dee4478f1e23 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.105819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-dc0457ac-2c58-474e-8f3b-89a76d5d782c req-a42835ff-cec2-43ec-948d-a847f8c93a7c tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Unset dirty status for tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:39:29.107304 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc0457ac-2c58-474e-8f3b-89a76d5d782c req-a42835ff-cec2-43ec-948d-a847f8c93a7c tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1767399 May 12 15:39:29.185799 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d0ef976-1e76-4aee-bd1f-f4efdff1508b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.220584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.242452 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c04b659b-b7f0-4250-9162-64d4b30f41b3 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:39:29.255761 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.256074 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.271130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Transition to ACTIVE for port object 502308a6-1076-44de-9233-ae79e304dfc8 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:29.274881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Transition to ACTIVE for port object c04b659b-b7f0-4250-9162-64d4b30f41b3 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:29.278971 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.319051 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b26c5603-831d-455a-9091-d59e2dfab341 None None] DHCP port deletion for 9b7334d3-09cb-43ee-879c-8af2e3abb59f request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:39:29.324906 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:39:29.376352 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Transition to ACTIVE for port object 502308a6-1076-44de-9233-ae79e304dfc8 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:29.393014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b26c5603-831d-455a-9091-d59e2dfab341 None None] Deleting port cdf9fedf-365d-4e32-a48f-b738e2bd9239 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:29.393556 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b26c5603-831d-455a-9091-d59e2dfab341 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.430483 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.436245 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d0ef976-1e76-4aee-bd1f-f4efdff1508b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.483525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Pushing event updated for resources: {'Port': ['ID=c04b659b-b7f0-4250-9162-64d4b30f41b3,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:29.491942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d0ef976-1e76-4aee-bd1f-f4efdff1508b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c9a7b39-52f6-4b7e-8172-5b5e83c3d5c9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:29.553129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] For port cdf9fedf-365d-4e32-a48f-b738e2bd9239, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cdf9fedf-365d-4e32-a48f-b738e2bd9239,segment=NetworkSegment(24ecba11-7e7a-4432-b001-7bb43e248572),segment_id=24ecba11-7e7a-4432-b001-7bb43e248572)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:29.553783 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.574404 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2d0ef976-1e76-4aee-bd1f-f4efdff1508b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.575717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2d0ef976-1e76-4aee-bd1f-f4efdff1508b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1c9a7b39-52f6-4b7e-8172-5b5e83c3d5c9 HTTP/1.1" status: 204 len: 168 time: 0.9778016 May 12 15:39:29.631431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Attempting to bind port c04b659b-b7f0-4250-9162-64d4b30f41b3 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:39:29.631431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Attempting to bind port c04b659b-b7f0-4250-9162-64d4b30f41b3 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '09c83b83-4d53-47f0-b181-c0fb6ed7f95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '85cd1d66-57c4-4d94-b782-1d4cae810f95'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:39:29.631889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Attempting to bind port c04b659b-b7f0-4250-9162-64d4b30f41b3 on network 85cd1d66-57c4-4d94-b782-1d4cae810f95 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:39:29.639377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'name': 'tempest-ImageQuotaTest-411269687-router', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.231'}], 'enable_snat': True}, 'gw_port_id': 'f97fc964-9829-4202-b95a-8c9798200bd8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:07Z', 'updated_at': '2022-05-12T15:39:25Z', 'revision_number': 4, 'project_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'gw_port': {'id': 'f97fc964-9829-4202-b95a-8c9798200bd8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:89:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3113, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:13Z', 'updated_at': '2022-05-12T15:39:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '65e83242-c0d2-43cd-93cd-05fc538f6b3a', 'name': '', 'network_id': '293104b9-2a34-465b-ba14-8789ca8ec013', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'mac_address': 'fa:16:3e:61:4a:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3129, 'fixed_ips': [{'subnet_id': '917eef28-a2e7-40e6-afd8-bba440bc427a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:22Z', 'updated_at': '2022-05-12T15:39:25Z', 'revision_number': 2, 'project_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'subnets': [{'id': '917eef28-a2e7-40e6-afd8-bba440bc427a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:29.649216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Port c04b659b-b7f0-4250-9162-64d4b30f41b3 on network 85cd1d66-57c4-4d94-b782-1d4cae810f95 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:39:29.649561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Attempting to bind port c04b659b-b7f0-4250-9162-64d4b30f41b3 on network 85cd1d66-57c4-4d94-b782-1d4cae810f95 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:39:29.658855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 39, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:39:29.659185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Checking segment: {'id': '09c83b83-4d53-47f0-b181-c0fb6ed7f95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '85cd1d66-57c4-4d94-b782-1d4cae810f95'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:39:29.659562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Bound using segment: {'id': '09c83b83-4d53-47f0-b181-c0fb6ed7f95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '85cd1d66-57c4-4d94-b782-1d4cae810f95'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:39:29.659981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Bound port: c04b659b-b7f0-4250-9162-64d4b30f41b3, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '09c83b83-4d53-47f0-b181-c0fb6ed7f95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '85cd1d66-57c4-4d94-b782-1d4cae810f95'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:39:29.660859 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.665608 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:29.720761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Calling delete_port for cdf9fedf-365d-4e32-a48f-b738e2bd9239 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:29.763895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:29.767059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:29.822085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] For port c04b659b-b7f0-4250-9162-64d4b30f41b3, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:39:29.826599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] For port c04b659b-b7f0-4250-9162-64d4b30f41b3, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c04b659b-b7f0-4250-9162-64d4b30f41b3,segment=NetworkSegment(09c83b83-4d53-47f0-b181-c0fb6ed7f95d),segment_id=09c83b83-4d53-47f0-b181-c0fb6ed7f95d)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:39:29.835136 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.835891 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.838711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b03c5a08-6e8a-4beb-bf50-0ace6859bb14 None None] The sync data for ids ['7c141417-daaf-4ea8-bcfa-5b34e251efc1'] in n-d-841483-1 is: [{'id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'name': 'tempest-ImageQuotaTest-411269687-router', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.231'}], 'enable_snat': True}, 'gw_port_id': 'f97fc964-9829-4202-b95a-8c9798200bd8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:07Z', 'updated_at': '2022-05-12T15:39:25Z', 'revision_number': 4, 'project_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'gw_port': {'id': 'f97fc964-9829-4202-b95a-8c9798200bd8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:89:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3113, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:13Z', 'updated_at': '2022-05-12T15:39:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '65e83242-c0d2-43cd-93cd-05fc538f6b3a', 'name': '', 'network_id': '293104b9-2a34-465b-ba14-8789ca8ec013', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'mac_address': 'fa:16:3e:61:4a:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3129, 'fixed_ips': [{'subnet_id': '917eef28-a2e7-40e6-afd8-bba440bc427a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:22Z', 'updated_at': '2022-05-12T15:39:25Z', 'revision_number': 2, 'project_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'subnets': [{'id': '917eef28-a2e7-40e6-afd8-bba440bc427a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:39:29.909806 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:29.912452 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:29.913911 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] 10.222.0.84 "PUT /v2.0/ports/c04b659b-b7f0-4250-9162-64d4b30f41b3 HTTP/1.1" status: 200 len: 1091 time: 2.0616789 May 12 15:39:29.923050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1703133c-bec8-4a64-87dd-56b43532f2ab', 'tag': 'c04b659b-b7f0-4250-9162-64d4b30f41b3'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:39:29.925027 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Pushing event updated for resources: {'Port': ['ID=502308a6-1076-44de-9233-ae79e304dfc8,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:29.980817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:30.004515 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:30.029888 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:30.033902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:30.039764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:39:30.076147 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9579d333-09cc-453a-a4e7-341e1cdc6704'] response: {'name': 'network-changed', 'server_uuid': '1703133c-bec8-4a64-87dd-56b43532f2ab', 'tag': 'c04b659b-b7f0-4250-9162-64d4b30f41b3', 'status': 'completed', 'code': 200} May 12 15:39:30.091366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b2c5a34-c655-4cc5-90c4-3f2a5d9b47b2 service neutron] Pushing event updated for resources: {'Port': ['ID=c04b659b-b7f0-4250-9162-64d4b30f41b3,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:30.145180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-e11998fe-3cf3-453f-940f-a316a1c779f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:30.148385 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-e11998fe-3cf3-453f-940f-a316a1c779f0 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f798fdc3e9c54b38b7dbb0478a1d31d6&device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 1094 time: 0.1520927 May 12 15:39:30.176795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:30.177200 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:30.205901 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-15b43b67-7c8a-4720-ac23-19adcca2eb81 admin admin] 10.222.0.82 "PUT /v2.0/routers/7c141417-daaf-4ea8-bcfa-5b34e251efc1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.8757517 May 12 15:39:30.207765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Subnet': ['ID=7239331a-43e0-42d0-8e36-1b1576a54ca7,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:30.251804 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e041592c-b3ff-4659-ad05-fad08a2d9ea8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 864 time: 4.2052634 May 12 15:39:30.256862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35316) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:30.265022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Request body: {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'mac_address': 'fa:16:3e:51:77:74', 'name': 'tempest-NetworksTestDHCPv6-1290258795'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:30.320006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35320) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:30.326961 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:30.436474 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-33aad2af-ef80-4048-bdae-575fd8d8839d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c04b659b-b7f0-4250-9162-64d4b30f41b3 HTTP/1.1" status: 200 len: 217 time: 0.2673597 May 12 15:39:30.464044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Attempting to bind port 502308a6-1076-44de-9233-ae79e304dfc8 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:39:30.464323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Attempting to bind port 502308a6-1076-44de-9233-ae79e304dfc8 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:39:30.464688 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Attempting to bind port 502308a6-1076-44de-9233-ae79e304dfc8 on network 2447b094-d5d6-41ef-a146-2bf56f5399af {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:39:30.509855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-0b26b996-cd55-4001-8720-c7a551b6efdb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:30.511499 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-0b26b996-cd55-4001-8720-c7a551b6efdb service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3c282c52-5b3b-474f-b33b-26979e8a2384 HTTP/1.1" status: 200 len: 848 time: 0.0625160 May 12 15:39:30.554461 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 39, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:39:30.555571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Checking segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:39:30.556358 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:30.556984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Bound using segment: {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:39:30.557894 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Bound port: 502308a6-1076-44de-9233-ae79e304dfc8, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce17b845-4503-482c-9dbc-c15a6259653f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:39:30.558885 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:30.576781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a805e63c-0a94-4528-a47e-dee4478f1e23 None None] Provisioning complete for port 65e83242-c0d2-43cd-93cd-05fc538f6b3a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:30.577555 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a805e63c-0a94-4528-a47e-dee4478f1e23 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:30.624608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:30.628672 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-b3a94388-7820-405b-8cbc-66236d8c02f0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=85cd1d66-57c4-4d94-b782-1d4cae810f95&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1064994 May 12 15:39:30.637342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:30.647836 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:30.755553 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53966273-bf81-48f5-8c9e-e096d57e0276 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:30.764755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Made reservation on behalf of d0c0be8fb6b844879953049ca91c6fac for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:30.831729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event deleted for resources: {'Port': ['ID=cdf9fedf-365d-4e32-a48f-b738e2bd9239,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:30.917562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-53966273-bf81-48f5-8c9e-e096d57e0276 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:30.922254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-53966273-bf81-48f5-8c9e-e096d57e0276 admin admin] Usage tracker for resource:security_group_rule and tenant:12863065d22b46ebbb483b11a9a83dde is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:30.925113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-53966273-bf81-48f5-8c9e-e096d57e0276 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:30.934210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-53966273-bf81-48f5-8c9e-e096d57e0276 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:30.945592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] No DVR routers for this DVR port cdf9fedf-365d-4e32-a48f-b738e2bd9239 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:39:30.991211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b26c5603-831d-455a-9091-d59e2dfab341 None None] For port cdf9fedf-365d-4e32-a48f-b738e2bd9239, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cdf9fedf-365d-4e32-a48f-b738e2bd9239,segment=NetworkSegment(24ecba11-7e7a-4432-b001-7bb43e248572),segment_id=24ecba11-7e7a-4432-b001-7bb43e248572)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:30.991740 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b26c5603-831d-455a-9091-d59e2dfab341 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:31.007731 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-88e0e052-d57e-4bb3-a5e5-effdd0438f40 service neutron] 10.222.0.84 "GET /v2.0/networks/85cd1d66-57c4-4d94-b782-1d4cae810f95?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3691418 May 12 15:39:31.177206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a805e63c-0a94-4528-a47e-dee4478f1e23 None None] Port 65e83242-c0d2-43cd-93cd-05fc538f6b3a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:39:31.341090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b26c5603-831d-455a-9091-d59e2dfab341 None None] Calling delete_port for cdf9fedf-365d-4e32-a48f-b738e2bd9239 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:31.360266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3bca716-c9c8-4780-9fdd-f63f09ceed0c req-76da4f51-091d-4dba-9992-9f7c46c7e70a tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:31.362151 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3bca716-c9c8-4780-9fdd-f63f09ceed0c req-76da4f51-091d-4dba-9992-9f7c46c7e70a tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 943 time: 0.5260394 May 12 15:39:31.414196 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41604fb4-e457-4c39-8ce1-346f3cba8d30 req-59f6cee0-133f-4d47-8c0e-f63e0dee78da service neutron] 10.222.0.84 "GET /v2.0/networks/85cd1d66-57c4-4d94-b782-1d4cae810f95?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3965890 May 12 15:39:31.499436 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3bca716-c9c8-4780-9fdd-f63f09ceed0c req-a8e9783f-f1b8-4448-9f0f-e69e031727db tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1291273 May 12 15:39:31.645079 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:31.677706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] For port 502308a6-1076-44de-9233-ae79e304dfc8, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:39:31.707416 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] For port 502308a6-1076-44de-9233-ae79e304dfc8, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=502308a6-1076-44de-9233-ae79e304dfc8,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:39:31.712482 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aaaba3b-8709-458c-8f78-ee455c823be3 req-2a311457-7fa5-48a8-9fd0-d0fb04ad6885 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:31.715879 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-b26c5603-831d-455a-9091-d59e2dfab341 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:39:31.716478 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-b26c5603-831d-455a-9091-d59e2dfab341 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:39:31.716588 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1aaaba3b-8709-458c-8f78-ee455c823be3 req-2a311457-7fa5-48a8-9fd0-d0fb04ad6885 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f798fdc3e9c54b38b7dbb0478a1d31d6&device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 1094 time: 0.1637077 May 12 15:39:31.722140 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:31.773251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9b7334d3-09cb-43ee-879c-8af2e3abb59f']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:31.822643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cdf9fedf-365d-4e32-a48f-b738e2bd9239 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:39:31.844528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '24ecba11-7e7a-4432-b001-7bb43e248572') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:31.844528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '24ecba11-7e7a-4432-b001-7bb43e248572') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:31.879758 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:31.906729 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: cdf9fedf-365d-4e32-a48f-b738e2bd9239 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:39:31.906969 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cdf9fedf-365d-4e32-a48f-b738e2bd9239 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:39:31.923128 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:31.955347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aaaba3b-8709-458c-8f78-ee455c823be3 req-d6c8295d-45fc-40bd-a4e2-60995649ddab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:31.960691 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1aaaba3b-8709-458c-8f78-ee455c823be3 req-d6c8295d-45fc-40bd-a4e2-60995649ddab service neutron] 10.222.0.84 "GET /v2.0/networks?id=85cd1d66-57c4-4d94-b782-1d4cae810f95 HTTP/1.1" status: 200 len: 909 time: 0.2313631 May 12 15:39:31.991019 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:31.991149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10133440-820b-4a51-ae89-8b47f6e869e5 None None] Pushing event updated for resources: {'Port': ['ID=502308a6-1076-44de-9233-ae79e304dfc8,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:32.059786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1aaaba3b-8709-458c-8f78-ee455c823be3 req-8a8c2b4c-8565-4b6f-a867-29ad2856dddb service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c04b659b-b7f0-4250-9162-64d4b30f41b3 HTTP/1.1" status: 200 len: 217 time: 0.0937729 May 12 15:39:32.071220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] device_id is not set on port 4c19b8a2-29af-4cfd-a6ac-16f9fc14ca0a yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:39:32.162090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f97fc964-9829-4202-b95a-8c9798200bd8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:39:32.188610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Releasing vlan 578 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:39:32.199511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:32.254671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b26c5603-831d-455a-9091-d59e2dfab341 None None] Deleting port cdf9fedf-365d-4e32-a48f-b738e2bd9239 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:32.255440 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b26c5603-831d-455a-9091-d59e2dfab341 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: timer() May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:39:32.292076 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:39:32.385571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aaaba3b-8709-458c-8f78-ee455c823be3 req-d2d9e1cc-9084-4ad3-bca3-1c53fd88732e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:32.387906 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1aaaba3b-8709-458c-8f78-ee455c823be3 req-d2d9e1cc-9084-4ad3-bca3-1c53fd88732e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3c282c52-5b3b-474f-b33b-26979e8a2384 HTTP/1.1" status: 200 len: 848 time: 0.3207967 May 12 15:39:32.464277 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b26c5603-831d-455a-9091-d59e2dfab341 None None] The port 'cdf9fedf-365d-4e32-a48f-b738e2bd9239' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:39:32.569807 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:32.577194 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53966273-bf81-48f5-8c9e-e096d57e0276 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:32.588950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f97fc964-9829-4202-b95a-8c9798200bd8 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:39:32.604948 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1aaaba3b-8709-458c-8f78-ee455c823be3 req-e56343f6-426d-4546-9b9b-8542d8037f49 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=85cd1d66-57c4-4d94-b782-1d4cae810f95&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2085419 May 12 15:39:32.608713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f97fc964-9829-4202-b95a-8c9798200bd8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:32.609086 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:32.719282 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53966273-bf81-48f5-8c9e-e096d57e0276 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:32.790811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53966273-bf81-48f5-8c9e-e096d57e0276 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=79a14a57-83f3-47a1-b382-87d63af0b8dc,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:32.884971 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:32.886655 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-53966273-bf81-48f5-8c9e-e096d57e0276 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=12863065d22b46ebbb483b11a9a83dde&name=default HTTP/1.1" status: 200 len: 2983 time: 2.5571675 May 12 15:39:32.909774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port f97fc964-9829-4202-b95a-8c9798200bd8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f97fc964-9829-4202-b95a-8c9798200bd8,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:32.914513 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35364) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:32.915387 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:32.954163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:33.019141 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:33.022499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Pushing event deleted for resources: {'Network': ['ID=9b7334d3-09cb-43ee-879c-8af2e3abb59f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:33.024722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router 697c0f4d-8153-41d1-a4dd-f0d86c14fd95 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:39:33.048343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=f97fc964-9829-4202-b95a-8c9798200bd8,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:33.072522 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1aaaba3b-8709-458c-8f78-ee455c823be3 req-fc6749e5-7e5c-41ff-9afa-8f3a422cd13f service neutron] 10.222.0.84 "GET /v2.0/networks/85cd1d66-57c4-4d94-b782-1d4cae810f95?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4550579 May 12 15:39:33.144990 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-56226ec0-1cdb-4865-9393-577611027a4d tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "DELETE /v2.0/networks/9b7334d3-09cb-43ee-879c-8af2e3abb59f HTTP/1.1" status: 204 len: 168 time: 5.4791546 May 12 15:39:33.227723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35370) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:33.228050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35378) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:33.380929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8::115 (2447b094-d5d6-41ef-a146-2bf56f5399af/ffb8a9ec-0442-4075-ab64-20864846e225/4c19b8a2-29af-4cfd-a6ac-16f9fc14ca0a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:33.392558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Allocated IP 2001:db8:0:1:f816:3eff:fe51:7774 (2447b094-d5d6-41ef-a146-2bf56f5399af/7239331a-43e0-42d0-8e36-1b1576a54ca7/4c19b8a2-29af-4cfd-a6ac-16f9fc14ca0a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:33.400807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd99f36-0ec8-4deb-95c6-d29c10252092 req-8e1ad7d9-d167-4a3a-b1ce-d7720dfc5e6e tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:33.408429 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-efd99f36-0ec8-4deb-95c6-d29c10252092 req-8e1ad7d9-d167-4a3a-b1ce-d7720dfc5e6e tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 943 time: 0.7251701 May 12 15:39:33.432659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:39:33.445553 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3e4163e-59af-4c89-ba24-1828e6efcff2 None None] Sync routers for ids ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:39:33.446063 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-501ecd8e-b85e-4b60-9534-bc65a6bc5f35 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:33.461346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-727fa684-74a4-42f8-8711-65f4e966b956 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Synchronizing usage tracker for tenant:7fab164333c84a019a5a0e9436b3a8df on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:39:33.465880 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3e4163e-59af-4c89-ba24-1828e6efcff2 None None] Routers {'697c0f4d-8153-41d1-a4dd-f0d86c14fd95'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:33.466519 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e3e4163e-59af-4c89-ba24-1828e6efcff2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:33.484944 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:33.489850 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b38bad5d-3157-47fa-b7d2-6539b05d580a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 13.8095574 May 12 15:39:33.490777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35384) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:33.558651 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e3e4163e-59af-4c89-ba24-1828e6efcff2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:33.565080 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-501ecd8e-b85e-4b60-9534-bc65a6bc5f35 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:33.569842 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3e4163e-59af-4c89-ba24-1828e6efcff2 None None] Routers {'697c0f4d-8153-41d1-a4dd-f0d86c14fd95'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:33.570442 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e3e4163e-59af-4c89-ba24-1828e6efcff2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:33.571964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-727fa684-74a4-42f8-8711-65f4e966b956 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Unset dirty status for tenant:7fab164333c84a019a5a0e9436b3a8df on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:39:33.573151 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-727fa684-74a4-42f8-8711-65f4e966b956 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "GET /v2.0/ports?device_id=0b891f9b-4350-4592-bcd3-b3900181c94c HTTP/1.1" status: 200 len: 205 time: 0.3395143 May 12 15:39:33.594414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35392) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:33.695245 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e3e4163e-59af-4c89-ba24-1828e6efcff2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:33.697954 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3e4163e-59af-4c89-ba24-1828e6efcff2 None None] The sync data for ids ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:39:33.715799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-efd99f36-0ec8-4deb-95c6-d29c10252092 req-f1d97293-d6f1-43e0-887b-5f3723564cde tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3065202 May 12 15:39:33.875191 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-501ecd8e-b85e-4b60-9534-bc65a6bc5f35 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:33.889948 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1aaaba3b-8709-458c-8f78-ee455c823be3 req-b8298a20-f15e-4554-b77e-f39b4db3f3c4 service neutron] 10.222.0.84 "GET /v2.0/networks/85cd1d66-57c4-4d94-b782-1d4cae810f95?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7946243 May 12 15:39:33.902849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-501ecd8e-b85e-4b60-9534-bc65a6bc5f35 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=79a14a57-83f3-47a1-b382-87d63af0b8dc,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:34.013585 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-501ecd8e-b85e-4b60-9534-bc65a6bc5f35 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:34.019184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-501ecd8e-b85e-4b60-9534-bc65a6bc5f35 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/79a14a57-83f3-47a1-b382-87d63af0b8dc HTTP/1.1" status: 204 len: 168 time: 1.0935905 May 12 15:39:34.125234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5de0ea5e-126b-4592-ad65-8cf8ca301616 None None] Sync routers for ids ['7c141417-daaf-4ea8-bcfa-5b34e251efc1'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:39:34.142915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5de0ea5e-126b-4592-ad65-8cf8ca301616 None None] Routers {'7c141417-daaf-4ea8-bcfa-5b34e251efc1'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:34.143657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5de0ea5e-126b-4592-ad65-8cf8ca301616 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7c141417-daaf-4ea8-bcfa-5b34e251efc1'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:34.212437 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d897de4e-6125-4ce0-8306-e7e1486cd470 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:34.246248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 502308a6-1076-44de-9233-ae79e304dfc8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:39:34.310566 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:34.543472 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-02fc5921-c3d5-4716-84b6-df1eaf5d2117 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:34.548720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-644428c0-d375-4c0c-b8a0-2f7f4b32d810 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:34.575063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-5de0ea5e-126b-4592-ad65-8cf8ca301616 None None] Set router 7c141417-daaf-4ea8-bcfa-5b34e251efc1 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:39:34.674646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Transition to ACTIVE for port object 4c19b8a2-29af-4cfd-a6ac-16f9fc14ca0a will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:34.781126 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 502308a6-1076-44de-9233-ae79e304dfc8 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:39:34.860355 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-95392f8d-067f-442d-92f2-330ba763bc6e None None] Provisioning for port 502308a6-1076-44de-9233-ae79e304dfc8 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:39:34.987715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 502308a6-1076-44de-9233-ae79e304dfc8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:34.989180 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:35.011405 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d897de4e-6125-4ce0-8306-e7e1486cd470 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:35.013757 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d897de4e-6125-4ce0-8306-e7e1486cd470 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:35.045364 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d897de4e-6125-4ce0-8306-e7e1486cd470 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:35.045655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d897de4e-6125-4ce0-8306-e7e1486cd470 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Fanout notify agent at l3_agent the message router_deleted on router 0b891f9b-4350-4592-bcd3-b3900181c94c {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:39:35.148517 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d897de4e-6125-4ce0-8306-e7e1486cd470 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:35.149942 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d897de4e-6125-4ce0-8306-e7e1486cd470 tempest-RoutersNegativeIpV6Test-316149401 tempest-RoutersNegativeIpV6Test-316149401-project] 10.222.0.82 "DELETE /v2.0/routers/0b891f9b-4350-4592-bcd3-b3900181c94c HTTP/1.1" status: 204 len: 168 time: 1.5540729 May 12 15:39:35.163027 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-95392f8d-067f-442d-92f2-330ba763bc6e None None] Provisioning complete for port 502308a6-1076-44de-9233-ae79e304dfc8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:35.163585 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-95392f8d-067f-442d-92f2-330ba763bc6e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:35.255701 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:35.295837 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-02fc5921-c3d5-4716-84b6-df1eaf5d2117 admin admin] Deleting port 65e83242-c0d2-43cd-93cd-05fc538f6b3a {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:35.296539 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-02fc5921-c3d5-4716-84b6-df1eaf5d2117 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:35.428801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Network 2447b094-d5d6-41ef-a146-2bf56f5399af is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:35.435095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:35.444161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:35.450264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:35.450885 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:35.503103 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-02fc5921-c3d5-4716-84b6-df1eaf5d2117 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:35.580882 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:35.645803 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-02fc5921-c3d5-4716-84b6-df1eaf5d2117 admin admin] Calling delete_port for 65e83242-c0d2-43cd-93cd-05fc538f6b3a owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:35.697680 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-95392f8d-067f-442d-92f2-330ba763bc6e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:35.745336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 502308a6-1076-44de-9233-ae79e304dfc8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=502308a6-1076-44de-9233-ae79e304dfc8,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:35.791407 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:35.792232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f97fc964-9829-4202-b95a-8c9798200bd8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:39:35.808136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event updated for resources: {'Port': ['ID=4c19b8a2-29af-4cfd-a6ac-16f9fc14ca0a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:35.896030 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-47bb7d35-7be1-490f-bd1a-0c80f5bec73a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 5.6365590 May 12 15:39:35.903160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35448) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:35.937271 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-02fc5921-c3d5-4716-84b6-df1eaf5d2117 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:36.059407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02fc5921-c3d5-4716-84b6-df1eaf5d2117 admin admin] Pushing event deleted for resources: {'Port': ['ID=65e83242-c0d2-43cd-93cd-05fc538f6b3a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:36.088091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4fc5d59b-acd3-4326-936d-3e1663739fd4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting port 4c19b8a2-29af-4cfd-a6ac-16f9fc14ca0a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:36.088438 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fc5d59b-acd3-4326-936d-3e1663739fd4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:36.141789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35456) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:36.159950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c04b659b-b7f0-4250-9162-64d4b30f41b3 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:39:36.167974 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-95392f8d-067f-442d-92f2-330ba763bc6e None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:39:36.168621 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-95392f8d-067f-442d-92f2-330ba763bc6e None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:39:36.186098 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:36.237820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=502308a6-1076-44de-9233-ae79e304dfc8,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:36.254593 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87f6439b-7fd4-4d5c-8b5a-a0aa82d01fc5 None None] Update dhcp port {'port': {'network_id': '2447b094-d5d6-41ef-a146-2bf56f5399af', 'fixed_ips': [{'subnet_id': 'ffb8a9ec-0442-4075-ab64-20864846e225', 'ip_address': '2001:db8::2'}, {'subnet_id': '7239331a-43e0-42d0-8e36-1b1576a54ca7'}], 'binding:host_id': 'n-d-841483-1'}, 'id': '502308a6-1076-44de-9233-ae79e304dfc8'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:39:36.263840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d1098e3-b9ca-4cbb-b604-1744bed4c238 req-1fd8b653-1f5b-4021-ad9b-7cbd44471a7e tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:36.272380 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d1098e3-b9ca-4cbb-b604-1744bed4c238 req-1fd8b653-1f5b-4021-ad9b-7cbd44471a7e tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 943 time: 1.2621448 May 12 15:39:36.374463 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87f6439b-7fd4-4d5c-8b5a-a0aa82d01fc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:36.467447 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] It took 0.22 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:39:36.523986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5de0ea5e-126b-4592-ad65-8cf8ca301616 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'name': 'tempest-ImageQuotaTest-411269687-router', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.231'}], 'enable_snat': True}, 'gw_port_id': 'f97fc964-9829-4202-b95a-8c9798200bd8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:07Z', 'updated_at': '2022-05-12T15:39:25Z', 'revision_number': 4, 'project_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'gw_port': {'id': 'f97fc964-9829-4202-b95a-8c9798200bd8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:89:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3113, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:13Z', 'updated_at': '2022-05-12T15:39:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '65e83242-c0d2-43cd-93cd-05fc538f6b3a', 'name': '', 'network_id': '293104b9-2a34-465b-ba14-8789ca8ec013', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'mac_address': 'fa:16:3e:61:4a:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3129, 'fixed_ips': [{'subnet_id': '917eef28-a2e7-40e6-afd8-bba440bc427a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:22Z', 'updated_at': '2022-05-12T15:39:25Z', 'revision_number': 2, 'project_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'subnets': [{'id': '917eef28-a2e7-40e6-afd8-bba440bc427a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:36.596214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f97fc964-9829-4202-b95a-8c9798200bd8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:36.596487 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:36.600724 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-02fc5921-c3d5-4716-84b6-df1eaf5d2117 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:36.638314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5de0ea5e-126b-4592-ad65-8cf8ca301616 None None] Checking router: 7c141417-daaf-4ea8-bcfa-5b34e251efc1 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:39:36.638610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5de0ea5e-126b-4592-ad65-8cf8ca301616 None None] Updating router 7c141417-daaf-4ea8-bcfa-5b34e251efc1 port 65e83242-c0d2-43cd-93cd-05fc538f6b3a binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:39:36.731656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d1098e3-b9ca-4cbb-b604-1744bed4c238 req-57dea217-4258-4b1c-b4a1-b0b86e107f59 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4580703 May 12 15:39:36.877537 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c04b659b-b7f0-4250-9162-64d4b30f41b3, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c04b659b-b7f0-4250-9162-64d4b30f41b3,segment=NetworkSegment(09c83b83-4d53-47f0-b181-c0fb6ed7f95d),segment_id=09c83b83-4d53-47f0-b181-c0fb6ed7f95d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:36.897356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'c04b659b-b7f0-4250-9162-64d4b30f41b3', 'network_id': '85cd1d66-57c4-4d94-b782-1d4cae810f95', 'port_id': 'c04b659b-b7f0-4250-9162-64d4b30f41b3', 'mac_address': 'fa:16:3e:6a:12:bb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 597, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3c282c52-5b3b-474f-b33b-26979e8a2384', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:39:36.917209 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5de0ea5e-126b-4592-ad65-8cf8ca301616 None None] Port 65e83242-c0d2-43cd-93cd-05fc538f6b3a not found while updating agent binding for router 7c141417-daaf-4ea8-bcfa-5b34e251efc1. {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:216}} May 12 15:39:36.942527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1133fa0e-0a3c-4f19-981a-19eba06c931c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7fab164333c84a019a5a0e9436b3a8df&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7981617 May 12 15:39:36.942735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35482) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:37.026022 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5de0ea5e-126b-4592-ad65-8cf8ca301616 None None] Routers {'7c141417-daaf-4ea8-bcfa-5b34e251efc1'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:37.026674 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5de0ea5e-126b-4592-ad65-8cf8ca301616 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7c141417-daaf-4ea8-bcfa-5b34e251efc1'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:37.199088 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:37.324477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c04b659b-b7f0-4250-9162-64d4b30f41b3 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:39:37.337192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35494) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:37.371123 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fc5d59b-acd3-4326-936d-3e1663739fd4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:37.472341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-02fc5921-c3d5-4716-84b6-df1eaf5d2117 admin admin] Router 7c141417-daaf-4ea8-bcfa-5b34e251efc1 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:39:37.552169 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e50acd8c-bfe8-4d02-93ed-9d378c32f758 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:37.564328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4fc5d59b-acd3-4326-936d-3e1663739fd4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Calling delete_port for 4c19b8a2-29af-4cfd-a6ac-16f9fc14ca0a owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:37.578832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c04b659b-b7f0-4250-9162-64d4b30f41b3, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c04b659b-b7f0-4250-9162-64d4b30f41b3,segment=NetworkSegment(09c83b83-4d53-47f0-b181-c0fb6ed7f95d),segment_id=09c83b83-4d53-47f0-b181-c0fb6ed7f95d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:37.604285 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:37.609097 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-87f6439b-7fd4-4d5c-8b5a-a0aa82d01fc5 None None] Allocated IP 2001:db8:0:1:f816:3eff:feb3:dad3 (2447b094-d5d6-41ef-a146-2bf56f5399af/7239331a-43e0-42d0-8e36-1b1576a54ca7/502308a6-1076-44de-9233-ae79e304dfc8) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:37.646145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-39bc8b5b-3ffb-4037-ba1e-7c31651e8aa3 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Request body: {'quota': {'network': 2}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:37.754498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-5de0ea5e-126b-4592-ad65-8cf8ca301616 None None] Set router 7c141417-daaf-4ea8-bcfa-5b34e251efc1 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:39:37.782780 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-39bc8b5b-3ffb-4037-ba1e-7c31651e8aa3 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] 10.222.0.82 "PUT /v2.0/quotas/b2a8790824e2417db0b99e7f14eaf62c HTTP/1.1" status: 200 len: 368 time: 0.4436729 May 12 15:39:37.811028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35508) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:37.812587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-02fc5921-c3d5-4716-84b6-df1eaf5d2117 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:39:37.823974 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Request body: {'network': {'project_id': 'b2a8790824e2417db0b99e7f14eaf62c'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:37.831375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:37.837695 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-02fc5921-c3d5-4716-84b6-df1eaf5d2117 admin admin] 10.222.0.82 "PUT /v2.0/routers/7c141417-daaf-4ea8-bcfa-5b34e251efc1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6017289 May 12 15:39:37.846708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Usage tracker for resource:network and tenant:b2a8790824e2417db0b99e7f14eaf62c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:37.851053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35512) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:37.865277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:37.879161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e50acd8c-bfe8-4d02-93ed-9d378c32f758 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:37.966892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.20.0.1 (b0419c0f-ed69-45c1-aa89-5514f9462b46/93f4665b-d6a8-4147-b1d7-7358a9b0558e/36f8743f-6e41-4575-8e01-dc13b003bf99) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:38.016486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 502308a6-1076-44de-9233-ae79e304dfc8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:39:38.041219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=c04b659b-b7f0-4250-9162-64d4b30f41b3,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:38.118372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 2; headroom:2 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:38.171858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['c04b659b-b7f0-4250-9162-64d4b30f41b3'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:39:38.231004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Made reservation on behalf of b2a8790824e2417db0b99e7f14eaf62c for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:38.233286 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:38.255257 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:38.274446 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:38.310093 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:38.330981 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e50acd8c-bfe8-4d02-93ed-9d378c32f758 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:38.348118 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 502308a6-1076-44de-9233-ae79e304dfc8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:38.348680 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:38.406441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e50acd8c-bfe8-4d02-93ed-9d378c32f758 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=206464a4-1b26-4ea4-aba6-7377d45edefb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:38.412427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:38.431750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Usage tracker for resource:security_group_rule and tenant:b2a8790824e2417db0b99e7f14eaf62c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:38.445936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:38.459032 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e50acd8c-bfe8-4d02-93ed-9d378c32f758 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:38.461781 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e50acd8c-bfe8-4d02-93ed-9d378c32f758 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/206464a4-1b26-4ea4-aba6-7377d45edefb HTTP/1.1" status: 204 len: 168 time: 1.5134854 May 12 15:39:38.465500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Transition to ACTIVE for port object 36f8743f-6e41-4575-8e01-dc13b003bf99 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:38.467418 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fc5d59b-acd3-4326-936d-3e1663739fd4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:38.469187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-87f6439b-7fd4-4d5c-8b5a-a0aa82d01fc5 None None] For port 502308a6-1076-44de-9233-ae79e304dfc8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=502308a6-1076-44de-9233-ae79e304dfc8,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:38.477600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:38.626477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fc5d59b-acd3-4326-936d-3e1663739fd4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Port': ['ID=4c19b8a2-29af-4cfd-a6ac-16f9fc14ca0a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:38.693889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c104126c-7c9e-4715-96f0-721d9c86eb53 req-5159b4c2-ba01-4e67-bf0d-fb3efac18ce0 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:38.701111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c104126c-7c9e-4715-96f0-721d9c86eb53 req-5159b4c2-ba01-4e67-bf0d-fb3efac18ce0 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 944 time: 0.5965333 May 12 15:39:38.742616 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87f6439b-7fd4-4d5c-8b5a-a0aa82d01fc5 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:38.810866 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fc5d59b-acd3-4326-936d-3e1663739fd4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:38.816170 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4fc5d59b-acd3-4326-936d-3e1663739fd4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/4c19b8a2-29af-4cfd-a6ac-16f9fc14ca0a HTTP/1.1" status: 204 len: 168 time: 2.9120684 May 12 15:39:38.820902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35528) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:38.858967 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:38.873639 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c104126c-7c9e-4715-96f0-721d9c86eb53 req-f50f9fb2-afca-48c2-97e0-f6ee98c2de87 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1564119 May 12 15:39:38.958250 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:38.958521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-87f6439b-7fd4-4d5c-8b5a-a0aa82d01fc5 None None] Transition to ACTIVE for port object 502308a6-1076-44de-9233-ae79e304dfc8 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:38.971831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:38.974145 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87f6439b-7fd4-4d5c-8b5a-a0aa82d01fc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:38.975207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] Deleting port f97fc964-9829-4202-b95a-8c9798200bd8 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:38.976048 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:39.056998 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:39.072647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 551} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:39:39.087484 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:39.087998 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Added segment 042ed597-9ff5-4cc6-8a55-41b0de947838 of type vlan for network f925c046-4b6d-4b1c-8af2-3c456a663f65 May 12 15:39:39.108599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5de0ea5e-126b-4592-ad65-8cf8ca301616 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'name': 'tempest-ImageQuotaTest-411269687-router', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.231'}], 'enable_snat': True}, 'gw_port_id': 'f97fc964-9829-4202-b95a-8c9798200bd8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:07Z', 'updated_at': '2022-05-12T15:39:35Z', 'revision_number': 5, 'project_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'gw_port': {'id': 'f97fc964-9829-4202-b95a-8c9798200bd8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:89:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3113, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:13Z', 'updated_at': '2022-05-12T15:39:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:39.154098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5de0ea5e-126b-4592-ad65-8cf8ca301616 None None] The sync data for ids ['7c141417-daaf-4ea8-bcfa-5b34e251efc1'] in n-d-841483-1 is: [{'id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'name': 'tempest-ImageQuotaTest-411269687-router', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.231'}], 'enable_snat': True}, 'gw_port_id': 'f97fc964-9829-4202-b95a-8c9798200bd8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:07Z', 'updated_at': '2022-05-12T15:39:35Z', 'revision_number': 5, 'project_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'gw_port': {'id': 'f97fc964-9829-4202-b95a-8c9798200bd8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:89:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3113, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:13Z', 'updated_at': '2022-05-12T15:39:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:39:39.154955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=36f8743f-6e41-4575-8e01-dc13b003bf99,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:39.174839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network b0419c0f-ed69-45c1-aa89-5514f9462b46 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:39.178902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:39.184691 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:39.186376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87f6439b-7fd4-4d5c-8b5a-a0aa82d01fc5 None None] Pushing event updated for resources: {'Port': ['ID=502308a6-1076-44de-9233-ae79e304dfc8,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:39.189871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:39.308135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9bfffc4c-f3f3-4f00-a0c2-4b5a74b044c4,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:39.328701 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:39.329682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:39.330248 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:39.365343 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:39.397269 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e56f278-e75b-4d4a-8138-25db428242b7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:39.398125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4e56f278-e75b-4d4a-8138-25db428242b7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:39:39.404889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 1.5899813 May 12 15:39:39.413638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35546) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:39.431905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Request body: {'network': {'project_id': 'b2a8790824e2417db0b99e7f14eaf62c'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:39.444748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:39.450815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Usage tracker for resource:network and tenant:b2a8790824e2417db0b99e7f14eaf62c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:39.468435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:39.471255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4e56f278-e75b-4d4a-8138-25db428242b7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:39:39.473461 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4e56f278-e75b-4d4a-8138-25db428242b7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.6499915 May 12 15:39:39.495052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 2; headroom:1 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:39.497059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35550) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:39.659102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Made reservation on behalf of b2a8790824e2417db0b99e7f14eaf62c for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:39.662184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:39.685502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0089758-21c4-4248-9fee-31ec9a3648d2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Pushing event updated for resources: {'Network': ['ID=f925c046-4b6d-4b1c-8af2-3c456a663f65,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:39.686631 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-10d9801c-c0a3-47a2-95db-90e3b252b693 None None] Provisioning for port 36f8743f-6e41-4575-8e01-dc13b003bf99 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:39:39.704180 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-10d9801c-c0a3-47a2-95db-90e3b252b693 None None] Provisioning complete for port 36f8743f-6e41-4575-8e01-dc13b003bf99 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:39.707419 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-10d9801c-c0a3-47a2-95db-90e3b252b693 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:39.719055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 563} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:39:39.743405 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:39.744202 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Added segment d90936b6-7ff1-4dab-925b-e6c86b70ebb4 of type vlan for network ed67e694-eaac-495d-bf0e-15c61d8132eb May 12 15:39:39.818715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] For port f97fc964-9829-4202-b95a-8c9798200bd8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f97fc964-9829-4202-b95a-8c9798200bd8,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:39.818715 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:39.835858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network f925c046-4b6d-4b1c-8af2-3c456a663f65 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:39:39.839429 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:39.867123 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 502308a6-1076-44de-9233-ae79e304dfc8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:39:40.008387 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:40.009623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:40.010278 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:40.066879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] Calling delete_port for f97fc964-9829-4202-b95a-8c9798200bd8 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:40.192392 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c04b659b-b7f0-4250-9162-64d4b30f41b3 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:39:40.308766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-10d9801c-c0a3-47a2-95db-90e3b252b693 None None] Port 36f8743f-6e41-4575-8e01-dc13b003bf99 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:39:40.340322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5aa7efc-e72c-4f3b-8a51-504acacd9f49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:40.356199 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c5aa7efc-e72c-4f3b-8a51-504acacd9f49 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.8579667 May 12 15:39:40.357648 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 0.9429951 May 12 15:39:40.359504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35576) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:40.362519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35578) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:40.375832 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:40.414759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b3fe8fc-9cd3-48ed-a8a7-2a8662b1b4f2 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Pushing event updated for resources: {'Network': ['ID=ed67e694-eaac-495d-bf0e-15c61d8132eb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:40.424052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-5e0751f8-d3c7-4f6e-b37e-f892ce924867 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Request body: {'network': {'project_id': 'b2a8790824e2417db0b99e7f14eaf62c'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:40.461715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network ed67e694-eaac-495d-bf0e-15c61d8132eb details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:39:40.539476 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 65e83242-c0d2-43cd-93cd-05fc538f6b3a no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:39:40.681590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5e0751f8-d3c7-4f6e-b37e-f892ce924867 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:40.697889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11a33654-18f1-4b3a-b01e-7e9385aa0327 req-63c0e62c-877f-4c97-b372-86a7c4b1135f tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:40.700835 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11a33654-18f1-4b3a-b01e-7e9385aa0327 req-63c0e62c-877f-4c97-b372-86a7c4b1135f tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 944 time: 0.5492525 May 12 15:39:40.716077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5e0751f8-d3c7-4f6e-b37e-f892ce924867 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Usage tracker for resource:network and tenant:b2a8790824e2417db0b99e7f14eaf62c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:40.730340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5e0751f8-d3c7-4f6e-b37e-f892ce924867 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Quota usage for network was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:40.836520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5e0751f8-d3c7-4f6e-b37e-f892ce924867 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 2; headroom:0 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:40.873805 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-5e0751f8-d3c7-4f6e-b37e-f892ce924867 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] POST failed (client error): There was a conflict when trying to complete your request. May 12 15:39:40.874276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5e0751f8-d3c7-4f6e-b37e-f892ce924867 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:40.875675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5e0751f8-d3c7-4f6e-b37e-f892ce924867 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 409 len: 310 time: 0.4988775 May 12 15:39:40.879723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 65e83242-c0d2-43cd-93cd-05fc538f6b3a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:39:40.880552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 65e83242-c0d2-43cd-93cd-05fc538f6b3a not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:39:40.886330 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11a33654-18f1-4b3a-b01e-7e9385aa0327 req-b4d3ae97-7e55-404c-acc6-705883684c23 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1718302 May 12 15:39:40.887632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35596) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:40.901281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91f8c447-3a49-4071-b815-5bd5dec03243 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:40.909523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91f8c447-3a49-4071-b815-5bd5dec03243 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:40.914212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91f8c447-3a49-4071-b815-5bd5dec03243 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:40.915074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-91f8c447-3a49-4071-b815-5bd5dec03243 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:39:41.039253 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfb264a9-81d6-40fb-947c-cca5fecb0593 None None] Sync routers for ids ['7c141417-daaf-4ea8-bcfa-5b34e251efc1'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:39:41.061474 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfb264a9-81d6-40fb-947c-cca5fecb0593 None None] Routers {'7c141417-daaf-4ea8-bcfa-5b34e251efc1'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:41.067110 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-dfb264a9-81d6-40fb-947c-cca5fecb0593 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7c141417-daaf-4ea8-bcfa-5b34e251efc1'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:41.079925 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c94aa0e0-e895-4489-812c-0d05de5cd2e4 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b2a8790824e2417db0b99e7f14eaf62c&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1855896 May 12 15:39:41.086809 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35602) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:41.087685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-91f8c447-3a49-4071-b815-5bd5dec03243 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:39:41.089093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-91f8c447-3a49-4071-b815-5bd5dec03243 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.7210021 May 12 15:39:41.122528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35604) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:41.139603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b5970d89-8cb6-4e44-9c91-3b7e73996617 None None] Could not find standard attr ID for object 4c19b8a2-29af-4cfd-a6ac-16f9fc14ca0a. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:39:41.195193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port c04b659b-b7f0-4250-9162-64d4b30f41b3 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:39:41.235045 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-12eeecae-19fe-4af1-9b08-3af6632718c4 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:41.261524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port c04b659b-b7f0-4250-9162-64d4b30f41b3 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:41.261782 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:41.316354 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:41.360471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b5970d89-8cb6-4e44-9c91-3b7e73996617 None None] Provisioning for port 502308a6-1076-44de-9233-ae79e304dfc8 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:39:41.389691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b5970d89-8cb6-4e44-9c91-3b7e73996617 None None] Provisioning complete for port 502308a6-1076-44de-9233-ae79e304dfc8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:41.390109 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b5970d89-8cb6-4e44-9c91-3b7e73996617 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:41.401042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-28158181-581a-4701-bee4-da745b8ac9f5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet 7239331a-43e0-42d0-8e36-1b1576a54ca7 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:39:41.410532 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28158181-581a-4701-bee4-da745b8ac9f5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:41.451181 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-dfb264a9-81d6-40fb-947c-cca5fecb0593 None None] Set router 7c141417-daaf-4ea8-bcfa-5b34e251efc1 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:39:41.543270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] Pushing event deleted for resources: {'Port': ['ID=f97fc964-9829-4202-b95a-8c9798200bd8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:41.552820 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-12eeecae-19fe-4af1-9b08-3af6632718c4 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:41.627102 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28158181-581a-4701-bee4-da745b8ac9f5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:41.663256 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-dfb264a9-81d6-40fb-947c-cca5fecb0593 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'name': 'tempest-ImageQuotaTest-411269687-router', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:07Z', 'updated_at': '2022-05-12T15:39:38Z', 'revision_number': 6, 'project_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:41.668221 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfb264a9-81d6-40fb-947c-cca5fecb0593 None None] Checking router: 7c141417-daaf-4ea8-bcfa-5b34e251efc1 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:39:41.669751 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:41.687613 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfb264a9-81d6-40fb-947c-cca5fecb0593 None None] Routers {'7c141417-daaf-4ea8-bcfa-5b34e251efc1'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:41.688148 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-dfb264a9-81d6-40fb-947c-cca5fecb0593 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7c141417-daaf-4ea8-bcfa-5b34e251efc1'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:41.748964 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:41.780070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1703133c-bec8-4a64-87dd-56b43532f2ab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c04b659b-b7f0-4250-9162-64d4b30f41b3'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:39:41.794353 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c04b659b-b7f0-4250-9162-64d4b30f41b3, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c04b659b-b7f0-4250-9162-64d4b30f41b3,segment=NetworkSegment(09c83b83-4d53-47f0-b181-c0fb6ed7f95d),segment_id=09c83b83-4d53-47f0-b181-c0fb6ed7f95d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:41.799190 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:41.891335 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c44ccd75-a367-4a40-af4a-299f438c928d'] response: {'server_uuid': '1703133c-bec8-4a64-87dd-56b43532f2ab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c04b659b-b7f0-4250-9162-64d4b30f41b3', 'code': 200} May 12 15:39:41.955922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-93d6bca5-0523-45fe-8608-f44067f9a421 None None] Could not find standard attr ID for object 4c19b8a2-29af-4cfd-a6ac-16f9fc14ca0a. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:39:41.991770 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-dfb264a9-81d6-40fb-947c-cca5fecb0593 None None] Set router 7c141417-daaf-4ea8-bcfa-5b34e251efc1 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:39:42.014476 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=c04b659b-b7f0-4250-9162-64d4b30f41b3,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:42.079495 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:42.090570 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:42.150310 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-dfb264a9-81d6-40fb-947c-cca5fecb0593 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'name': 'tempest-ImageQuotaTest-411269687-router', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:07Z', 'updated_at': '2022-05-12T15:39:40Z', 'revision_number': 7, 'project_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:42.156346 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfb264a9-81d6-40fb-947c-cca5fecb0593 None None] The sync data for ids ['7c141417-daaf-4ea8-bcfa-5b34e251efc1'] in n-d-841483-1 is: [{'id': '7c141417-daaf-4ea8-bcfa-5b34e251efc1', 'name': 'tempest-ImageQuotaTest-411269687-router', 'tenant_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:07Z', 'updated_at': '2022-05-12T15:39:40Z', 'revision_number': 7, 'project_id': '2e0dfdb783c948f8aad42ecd29e9390e', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:39:42.190861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-12eeecae-19fe-4af1-9b08-3af6632718c4 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:42.239971 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:42.244308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12eeecae-19fe-4af1-9b08-3af6632718c4 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9bfffc4c-f3f3-4f00-a0c2-4b5a74b044c4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:42.264064 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:42.331482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28158181-581a-4701-bee4-da745b8ac9f5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:42.346513 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-12eeecae-19fe-4af1-9b08-3af6632718c4 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:42.348347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-12eeecae-19fe-4af1-9b08-3af6632718c4 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] 10.222.0.82 "DELETE /v2.0/security-groups/9bfffc4c-f3f3-4f00-a0c2-4b5a74b044c4 HTTP/1.1" status: 204 len: 168 time: 1.2577376 May 12 15:39:42.351925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35636) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:42.374595 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:42.410708 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:42.411260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7c141417-daaf-4ea8-bcfa-5b34e251efc1 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:39:42.416132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=36f8743f-6e41-4575-8e01-dc13b003bf99,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:42.505129 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:42.506432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e3121567-ac4e-4e0f-85b1-4d5dc2e89432 admin admin] 10.222.0.82 "DELETE /v2.0/routers/7c141417-daaf-4ea8-bcfa-5b34e251efc1 HTTP/1.1" status: 204 len: 168 time: 4.6538999 May 12 15:39:42.513819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35640) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:42.516044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82542df0-1d48-4fa7-99f7-efea05be853f req-524a7660-4894-4141-a040-029977555cf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:42.517646 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-82542df0-1d48-4fa7-99f7-efea05be853f req-524a7660-4894-4141-a040-029977555cf0 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 1096 time: 0.5364842 May 12 15:39:42.536168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a8d24d0-caf5-408f-bf07-a4964b0148f0 req-91fe9e92-d1cf-4155-aa35-f932633e05d3 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:42.537818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a8d24d0-caf5-408f-bf07-a4964b0148f0 req-91fe9e92-d1cf-4155-aa35-f932633e05d3 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 945 time: 0.3980629 May 12 15:39:42.639111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network b0419c0f-ed69-45c1-aa89-5514f9462b46 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:42.640360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:42.642671 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28158181-581a-4701-bee4-da745b8ac9f5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:42.724065 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5049cc2b-de82-4b38-9a3a-2db18018cec0 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:42.756327 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a9453375-7f50-4403-a5eb-b6eec4a3896c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:42.844717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28158181-581a-4701-bee4-da745b8ac9f5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=7239331a-43e0-42d0-8e36-1b1576a54ca7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:42.852283 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-82542df0-1d48-4fa7-99f7-efea05be853f req-798f0797-c038-4de5-a567-8e2756e2a4f3 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3133342 May 12 15:39:42.852824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28158181-581a-4701-bee4-da745b8ac9f5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:42.856370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45da1a88-8afb-4852-b8fb-4a139e28fd5b None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:42.875206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a8d24d0-caf5-408f-bf07-a4964b0148f0 req-7fe8fe0e-f2aa-4981-91d3-8d0f94894702 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2325876 May 12 15:39:42.933034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-62adbf59-d255-40d6-b718-693cbdbf879c admin admin] Deleting subnet 917eef28-a2e7-40e6-afd8-bba440bc427a {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:39:42.939530 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-62adbf59-d255-40d6-b718-693cbdbf879c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:43.048263 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-28158181-581a-4701-bee4-da745b8ac9f5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/7239331a-43e0-42d0-8e36-1b1576a54ca7 HTTP/1.1" status: 204 len: 168 time: 1.9244232 May 12 15:39:43.062819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35656) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:43.182495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-59019037-b0bf-4392-b704-02c8409dbe39 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Deleting subnet ffb8a9ec-0442-4075-ab64-20864846e225 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:39:43.186223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-59019037-b0bf-4392-b704-02c8409dbe39 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:43.190553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5049cc2b-de82-4b38-9a3a-2db18018cec0 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:43.279428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-5049cc2b-de82-4b38-9a3a-2db18018cec0 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ed67e694-eaac-495d-bf0e-15c61d8132eb']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:43.286036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router 697c0f4d-8153-41d1-a4dd-f0d86c14fd95 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:39:43.288836 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-59019037-b0bf-4392-b704-02c8409dbe39 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:43.302880 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-62adbf59-d255-40d6-b718-693cbdbf879c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:43.324886 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:43.374859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-945b1b53-adf6-4248-97fe-e4dd55ebd580 None None] Provisioning complete for port 36f8743f-6e41-4575-8e01-dc13b003bf99 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:43.375230 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-945b1b53-adf6-4248-97fe-e4dd55ebd580 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:43.415919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-5049cc2b-de82-4b38-9a3a-2db18018cec0 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd90936b6-7ff1-4dab-925b-e6c86b70ebb4') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:43.416107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-5049cc2b-de82-4b38-9a3a-2db18018cec0 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd90936b6-7ff1-4dab-925b-e6c86b70ebb4') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:43.454396 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5049cc2b-de82-4b38-9a3a-2db18018cec0 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:43.488812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-945b1b53-adf6-4248-97fe-e4dd55ebd580 None None] Port 36f8743f-6e41-4575-8e01-dc13b003bf99 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:39:43.511632 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5049cc2b-de82-4b38-9a3a-2db18018cec0 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:43.523481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5049cc2b-de82-4b38-9a3a-2db18018cec0 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Releasing vlan 563 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:39:43.523866 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5049cc2b-de82-4b38-9a3a-2db18018cec0 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: timer() May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:39:43.611992 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:39:43.648001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:39:43.657724 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-28707dfe-5469-4651-9bb9-c000fa4835e7 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "PUT /v2.0/routers/697c0f4d-8153-41d1-a4dd-f0d86c14fd95/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.1631997 May 12 15:39:43.660488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35666) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:43.662398 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2c695aa-d526-498d-8b0b-4e3f0fe18aba None None] Sync routers for ids ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:39:43.665449 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-59019037-b0bf-4392-b704-02c8409dbe39 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:43.669541 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-62adbf59-d255-40d6-b718-693cbdbf879c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:43.701606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2c695aa-d526-498d-8b0b-4e3f0fe18aba None None] Routers {'697c0f4d-8153-41d1-a4dd-f0d86c14fd95'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:43.702584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b2c695aa-d526-498d-8b0b-4e3f0fe18aba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:43.715151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'port': {'network_id': 'b0419c0f-ed69-45c1-aa89-5514f9462b46', 'name': 'tempest-FloatingIPTestJSON-275341705'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:43.818681 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5049cc2b-de82-4b38-9a3a-2db18018cec0 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:43.889688 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f97fc964-9829-4202-b95a-8c9798200bd8 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:39:43.940874 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:39:44.048343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: f97fc964-9829-4202-b95a-8c9798200bd8 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:39:44.049667 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f97fc964-9829-4202-b95a-8c9798200bd8 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:39:44.063065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b2c695aa-d526-498d-8b0b-4e3f0fe18aba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:44.104908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2c695aa-d526-498d-8b0b-4e3f0fe18aba None None] Routers {'697c0f4d-8153-41d1-a4dd-f0d86c14fd95'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:44.105893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b2c695aa-d526-498d-8b0b-4e3f0fe18aba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:44.216121 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5049cc2b-de82-4b38-9a3a-2db18018cec0 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:44.228687 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-59019037-b0bf-4392-b704-02c8409dbe39 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:44.281502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59019037-b0bf-4392-b704-02c8409dbe39 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Subnet': ['ID=ffb8a9ec-0442-4075-ab64-20864846e225,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:44.291599 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-59019037-b0bf-4392-b704-02c8409dbe39 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:44.294127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b2c695aa-d526-498d-8b0b-4e3f0fe18aba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:44.294855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2c695aa-d526-498d-8b0b-4e3f0fe18aba None None] The sync data for ids ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:39:44.309040 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-59019037-b0bf-4392-b704-02c8409dbe39 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/ffb8a9ec-0442-4075-ab64-20864846e225 HTTP/1.1" status: 204 len: 168 time: 1.2449129 May 12 15:39:44.315174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35682) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:44.318543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:44.329860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5049cc2b-de82-4b38-9a3a-2db18018cec0 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Pushing event deleted for resources: {'Network': ['ID=ed67e694-eaac-495d-bf0e-15c61d8132eb,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:44.361729 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5049cc2b-de82-4b38-9a3a-2db18018cec0 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] 10.222.0.82 "DELETE /v2.0/networks/ed67e694-eaac-495d-bf0e-15c61d8132eb HTTP/1.1" status: 204 len: 168 time: 2.0070431 May 12 15:39:44.365241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35686) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:44.398305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Usage tracker for resource:port and tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:44.405119 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3e2ad838-5ae5-4032-9db8-4cb4affacc84 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0883918 May 12 15:39:44.406963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Quota usage for port was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:44.409879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35690) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:44.416317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attempting to reserve 1 items for resource port. Total usage: 6; quota limit: 500; headroom:494 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:44.430527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Made reservation on behalf of 9d4bdd73a39f4390bb7d4c6d7a1fc0c4 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:44.435864 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:44.463385 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] device_id is not set on port f081673d-e456-4c37-905f-a5fce92a8340 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:39:44.577137 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-62adbf59-d255-40d6-b718-693cbdbf879c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:44.617691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-932b5a0e-bfd0-4a66-9bf6-40ce14649111 None None] Network 2447b094-d5d6-41ef-a146-2bf56f5399af requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:44.626890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Allocated IP 172.20.0.7 (b0419c0f-ed69-45c1-aa89-5514f9462b46/93f4665b-d6a8-4147-b1d7-7358a9b0558e/f081673d-e456-4c37-905f-a5fce92a8340) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:44.637748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62adbf59-d255-40d6-b718-693cbdbf879c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=917eef28-a2e7-40e6-afd8-bba440bc427a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:44.665065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91f039fa-a68c-4fb4-ad3a-80ac4de1299f req-2486cfdc-aa81-4659-b063-52b1de585ad7 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:44.666643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-91f039fa-a68c-4fb4-ad3a-80ac4de1299f req-2486cfdc-aa81-4659-b063-52b1de585ad7 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 945 time: 0.4340794 May 12 15:39:44.669942 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04c15b97-9672-41c9-bc1c-cf2df501cb44 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:44.672861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-62adbf59-d255-40d6-b718-693cbdbf879c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:44.723442 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-62adbf59-d255-40d6-b718-693cbdbf879c admin admin] 10.222.0.82 "DELETE /v2.0/subnets/917eef28-a2e7-40e6-afd8-bba440bc427a HTTP/1.1" status: 204 len: 168 time: 2.2044766 May 12 15:39:44.730017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36226c2c-16de-40e7-95c2-d451af953dda None None] Network 293104b9-2a34-465b-ba14-8789ca8ec013 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:44.736551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65697d4d-db1e-49d0-9b6f-557cdb40c7c0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:44.738691 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-65697d4d-db1e-49d0-9b6f-557cdb40c7c0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.3266201 May 12 15:39:44.739727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35698) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:44.741678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35700) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:44.843302 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-91f039fa-a68c-4fb4-ad3a-80ac4de1299f req-d769cf27-058e-4b53-8342-a4cccb5f1df2 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1587617 May 12 15:39:44.847064 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2cf139b1-7808-4c29-84fc-b8f70e4c38c5 None None] Provisioning complete for port 502308a6-1076-44de-9233-ae79e304dfc8 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:44.848494 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2cf139b1-7808-4c29-84fc-b8f70e4c38c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:44.953607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba60b1b4-1e7d-4ca8-b592-53d103c1cd89 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:44.957443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ba60b1b4-1e7d-4ca8-b592-53d103c1cd89 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Synchronizing usage tracker for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:39:45.002006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ba60b1b4-1e7d-4ca8-b592-53d103c1cd89 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Unset dirty status for tenant:d0c0be8fb6b844879953049ca91c6fac on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:39:45.005853 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ba60b1b4-1e7d-4ca8-b592-53d103c1cd89 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2606540 May 12 15:39:45.007838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35712) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:45.011696 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04c15b97-9672-41c9-bc1c-cf2df501cb44 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:45.031873 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:45.079435 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-04c15b97-9672-41c9-bc1c-cf2df501cb44 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f925c046-4b6d-4b1c-8af2-3c456a663f65']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:45.092162 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:45.096120 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-04c15b97-9672-41c9-bc1c-cf2df501cb44 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '042ed597-9ff5-4cc6-8a55-41b0de947838') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:45.096421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-04c15b97-9672-41c9-bc1c-cf2df501cb44 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '042ed597-9ff5-4cc6-8a55-41b0de947838') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:45.110192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04c15b97-9672-41c9-bc1c-cf2df501cb44 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:45.112987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fbab8695-629d-42fc-91ff-dbd504622cc8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1036601 May 12 15:39:45.121088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35720) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:45.136720 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04c15b97-9672-41c9-bc1c-cf2df501cb44 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:45.143772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-04c15b97-9672-41c9-bc1c-cf2df501cb44 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Releasing vlan 551 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:39:45.144711 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04c15b97-9672-41c9-bc1c-cf2df501cb44 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:45.228538 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-84464f91-e7f3-49d6-91a8-ca4e5caa1096 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:45.236121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-84464f91-e7f3-49d6-91a8-ca4e5caa1096 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:45.245371 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-84464f91-e7f3-49d6-91a8-ca4e5caa1096 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/4c19b8a2-29af-4cfd-a6ac-16f9fc14ca0a HTTP/1.1" status: 404 len: 333 time: 0.1225295 May 12 15:39:45.254703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35724) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: timer() May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:39:45.258515 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:39:45.267409 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04c15b97-9672-41c9-bc1c-cf2df501cb44 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:45.271776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Transition to ACTIVE for port object f081673d-e456-4c37-905f-a5fce92a8340 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:45.278435 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04c15b97-9672-41c9-bc1c-cf2df501cb44 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:45.305949 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-04c15b97-9672-41c9-bc1c-cf2df501cb44 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] 10.222.0.82 "DELETE /v2.0/networks/f925c046-4b6d-4b1c-8af2-3c456a663f65 HTTP/1.1" status: 204 len: 168 time: 0.9384365 May 12 15:39:45.307442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04c15b97-9672-41c9-bc1c-cf2df501cb44 tempest-QuotasNegativeTest-113670418 tempest-QuotasNegativeTest-113670418-project-admin] Pushing event deleted for resources: {'Network': ['ID=f925c046-4b6d-4b1c-8af2-3c456a663f65,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:45.343985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Deleting port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:45.345700 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:45.370667 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d0d79828-df77-4ca5-8cdc-b37afd829c54 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:45.448424 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:45.498095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f25dc7c-b309-4dbe-ab83-05fd6e668653 None None] DHCP port deletion for 293104b9-2a34-465b-ba14-8789ca8ec013 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:39:45.506279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9f25dc7c-b309-4dbe-ab83-05fd6e668653 None None] Deleting port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:45.506861 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9f25dc7c-b309-4dbe-ab83-05fd6e668653 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:45.654424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event updated for resources: {'Port': ['ID=f081673d-e456-4c37-905f-a5fce92a8340,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:45.657489 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-6433df53-ff74-47a9-8d3a-7ceb5489f9a8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:45.658197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6433df53-ff74-47a9-8d3a-7ceb5489f9a8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:45.660796 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6433df53-ff74-47a9-8d3a-7ceb5489f9a8 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/7239331a-43e0-42d0-8e36-1b1576a54ca7 HTTP/1.1" status: 404 len: 337 time: 0.3985090 May 12 15:39:45.666424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35736) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:45.716255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Network b0419c0f-ed69-45c1-aa89-5514f9462b46 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:45.733000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:45.746265 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-304ed1cb-d0d0-4b04-bcf4-9418fa68b18a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:45.746875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-304ed1cb-d0d0-4b04-bcf4-9418fa68b18a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:45.755329 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-304ed1cb-d0d0-4b04-bcf4-9418fa68b18a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/ffb8a9ec-0442-4075-ab64-20864846e225 HTTP/1.1" status: 404 len: 337 time: 0.0844233 May 12 15:39:45.755329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:45.762895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35740) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:45.790884 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] DHCP port deletion for 2447b094-d5d6-41ef-a146-2bf56f5399af request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:39:45.801104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 502308a6-1076-44de-9233-ae79e304dfc8 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:39:45.854270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:45.855016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:45.885475 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a55c397b-7d48-4797-96bc-0d066869a2cd tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 2.2236345 May 12 15:39:45.888244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35748) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:45.897180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ff5657af-138a-47a8-b012-b633467f01a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Request body: {'floatingip': {'port_id': 'f081673d-e456-4c37-905f-a5fce92a8340'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:45.923877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] Deleting port 502308a6-1076-44de-9233-ae79e304dfc8 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:45.924245 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:45.933138 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-317f217b-76b2-4b6e-a887-68736791177e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:45.934846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-317f217b-76b2-4b6e-a887-68736791177e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:45.943108 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-317f217b-76b2-4b6e-a887-68736791177e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/f936f886-df20-4e53-bbc8-3233883932ef HTTP/1.1" status: 404 len: 333 time: 0.1787844 May 12 15:39:45.951274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35756) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:46.168043 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff5657af-138a-47a8-b012-b633467f01a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:46.196410 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-9372b4c7-c289-41b7-a58a-941e6642bb64 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:46.198900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9372b4c7-c289-41b7-a58a-941e6642bb64 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:46.204316 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9372b4c7-c289-41b7-a58a-941e6642bb64 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/b78785e4-055a-4a30-9a26-24fb6d6c4882 HTTP/1.1" status: 404 len: 337 time: 0.2498927 May 12 15:39:46.206559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35762) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:46.238465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] For port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e60e88df-e3f5-43ee-9957-d0e2ad1bd28c,segment=NetworkSegment(c345e75f-d395-4dba-a724-35c44275a64f),segment_id=c345e75f-d395-4dba-a724-35c44275a64f)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:46.238856 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:46.435577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Calling delete_port for e60e88df-e3f5-43ee-9957-d0e2ad1bd28c owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:46.495648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35770) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:46.533636 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:46.533823 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:46.549687 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:46.570005 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:46.593918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-188b1e47-d3aa-476d-bc2b-451bf2c095e8 None None] Provisioning for port f081673d-e456-4c37-905f-a5fce92a8340 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:39:46.609661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-188b1e47-d3aa-476d-bc2b-451bf2c095e8 None None] Provisioning complete for port f081673d-e456-4c37-905f-a5fce92a8340 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:39:46.610029 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-188b1e47-d3aa-476d-bc2b-451bf2c095e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:46.755649 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-efb7007e-048c-4fdd-b922-3302c15cdd07 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:46.756373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-efb7007e-048c-4fdd-b922-3302c15cdd07 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:46.759694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] No DVR routers for this DVR port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:39:46.762851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Pushing event deleted for resources: {'Port': ['ID=e60e88df-e3f5-43ee-9957-d0e2ad1bd28c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:46.789363 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-553aebb2-3fe0-4692-8c80-6ae3d486c0ad admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:46.812916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-553aebb2-3fe0-4692-8c80-6ae3d486c0ad admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:46.825260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9f25dc7c-b309-4dbe-ab83-05fd6e668653 None None] For port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e60e88df-e3f5-43ee-9957-d0e2ad1bd28c,segment=NetworkSegment(c345e75f-d395-4dba-a724-35c44275a64f),segment_id=c345e75f-d395-4dba-a724-35c44275a64f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:46.825864 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9f25dc7c-b309-4dbe-ab83-05fd6e668653 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:46.895240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-553aebb2-3fe0-4692-8c80-6ae3d486c0ad admin admin] Usage tracker for resource:security_group_rule and tenant:60a9bace888f4d1ea136bd7397a29b37 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:46.966103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-efb7007e-048c-4fdd-b922-3302c15cdd07 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/9c050e5e-c14a-45d2-9f3a-26a91f8ad488 HTTP/1.1" status: 404 len: 337 time: 0.4361517 May 12 15:39:46.997415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35784) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:47.038890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 502308a6-1076-44de-9233-ae79e304dfc8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=502308a6-1076-44de-9233-ae79e304dfc8,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:47.050225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9f25dc7c-b309-4dbe-ab83-05fd6e668653 None None] Calling delete_port for e60e88df-e3f5-43ee-9957-d0e2ad1bd28c owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:47.096750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-188b1e47-d3aa-476d-bc2b-451bf2c095e8 None None] Port f081673d-e456-4c37-905f-a5fce92a8340 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:39:47.104656 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:47.105356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e60e88df-e3f5-43ee-9957-d0e2ad1bd28c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:39:47.118919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-553aebb2-3fe0-4692-8c80-6ae3d486c0ad admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:47.126987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-553aebb2-3fe0-4692-8c80-6ae3d486c0ad admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:47.149029 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-9983c28d-c55c-49a4-aa55-57295e42447f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:47.152715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9983c28d-c55c-49a4-aa55-57295e42447f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:47.158422 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9983c28d-c55c-49a4-aa55-57295e42447f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/d32d24d1-93b9-4c91-95fb-e8987be16d8b HTTP/1.1" status: 404 len: 333 time: 0.1605802 May 12 15:39:47.164194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35788) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:47.177419 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:47.180855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: e60e88df-e3f5-43ee-9957-d0e2ad1bd28c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:39:47.181511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e60e88df-e3f5-43ee-9957-d0e2ad1bd28c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:39:47.235937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] For port 502308a6-1076-44de-9233-ae79e304dfc8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=502308a6-1076-44de-9233-ae79e304dfc8,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:47.236759 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:47.330236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b42a07a-6e44-4fab-a81e-c674f9bec02d req-d95b2c5d-27ca-4c1a-bec7-6ecce9e34f9f tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:47.341105 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8b42a07a-6e44-4fab-a81e-c674f9bec02d req-d95b2c5d-27ca-4c1a-bec7-6ecce9e34f9f tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 945 time: 1.2556655 May 12 15:39:47.403178 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-c81aff5c-e238-4a48-a2a9-4f101210ae01 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:47.403604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c81aff5c-e238-4a48-a2a9-4f101210ae01 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:47.406523 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c81aff5c-e238-4a48-a2a9-4f101210ae01 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/87a57b78-71e7-407e-908a-83dd27ff897f HTTP/1.1" status: 404 len: 337 time: 0.2402921 May 12 15:39:47.437121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35798) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:47.479756 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['293104b9-2a34-465b-ba14-8789ca8ec013']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:47.571810 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-553aebb2-3fe0-4692-8c80-6ae3d486c0ad admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:47.573486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c345e75f-d395-4dba-a724-35c44275a64f') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:47.574019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c345e75f-d395-4dba-a724-35c44275a64f') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:47.582287 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-553aebb2-3fe0-4692-8c80-6ae3d486c0ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:47.595881 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-67b9b998-c72f-4546-9a1b-010b1662d0ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:47.596332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-67b9b998-c72f-4546-9a1b-010b1662d0ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:47.598768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-67b9b998-c72f-4546-9a1b-010b1662d0ee tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/38cb4b0d-6258-4c5b-904b-a12c4bc812d7 HTTP/1.1" status: 404 len: 337 time: 0.1605549 May 12 15:39:47.604291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35802) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:47.614715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] Calling delete_port for 502308a6-1076-44de-9233-ae79e304dfc8 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:47.619353 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8b42a07a-6e44-4fab-a81e-c674f9bec02d req-dd0f5724-4669-4a96-948d-2e6dcb21bfa0 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2771218 May 12 15:39:47.630808 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-553aebb2-3fe0-4692-8c80-6ae3d486c0ad admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=60a9bace888f4d1ea136bd7397a29b37&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1338451 May 12 15:39:47.633006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35806) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:47.668107 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:47.687678 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:47.694369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Releasing vlan 594 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:39:47.694922 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:47.740784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-553aebb2-3fe0-4692-8c80-6ae3d486c0ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b711db2-bf1b-43db-a945-4a5780f04588,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:47.785780 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2174ca-d455-4bea-b5d2-03e6c8aa8f0d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:47.826074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2174ca-d455-4bea-b5d2-03e6c8aa8f0d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: timer() May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:39:47.827921 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:39:47.835887 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:47.840256 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-9f25dc7c-b309-4dbe-ab83-05fd6e668653 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:39:47.840844 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-9f25dc7c-b309-4dbe-ab83-05fd6e668653 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:39:47.841742 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:39:47.842190 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:39:47.857291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=502308a6-1076-44de-9233-ae79e304dfc8,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:47.860968 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:47.868065 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:47.870741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] Pushing event deleted for resources: {'Network': ['ID=293104b9-2a34-465b-ba14-8789ca8ec013,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:47.872972 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-5e842fae-1807-465d-8f8c-d2c4d126b970 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:47.873670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5e842fae-1807-465d-8f8c-d2c4d126b970 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:47.882289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3843fcd0-9f0b-4eb8-918b-0d4eed4ce840 admin admin] 10.222.0.82 "DELETE /v2.0/networks/293104b9-2a34-465b-ba14-8789ca8ec013 HTTP/1.1" status: 204 len: 168 time: 3.1374502 May 12 15:39:47.884473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5e842fae-1807-465d-8f8c-d2c4d126b970 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/5550f0a3-1374-45e0-88ee-6adf162bb656 HTTP/1.1" status: 404 len: 333 time: 0.2788241 May 12 15:39:47.888255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35818) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:47.946992 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-4714684a-6cb3-459b-afa6-f55f0bbf3b57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:47.947717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4714684a-6cb3-459b-afa6-f55f0bbf3b57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:47.949603 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4714684a-6cb3-459b-afa6-f55f0bbf3b57 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/b30923ad-3873-49bf-a7f7-cb546155d9b7 HTTP/1.1" status: 404 len: 337 time: 0.0603781 May 12 15:39:47.952111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35824) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:48.011003 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff5657af-138a-47a8-b012-b633467f01a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:48.021026 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff5657af-138a-47a8-b012-b633467f01a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:48.032896 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-0b6ddc63-4c9c-4ba7-8805-5b99f0bfe54c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:48.034896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0b6ddc63-4c9c-4ba7-8805-5b99f0bfe54c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:48.037432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0b6ddc63-4c9c-4ba7-8805-5b99f0bfe54c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/38d0fc3b-0844-43a2-bda7-1c040e0ced61 HTTP/1.1" status: 404 len: 337 time: 0.0838199 May 12 15:39:48.041882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35828) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:48.093017 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-aa090fe7-908f-4ad0-94eb-5f861d8fbe3d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:48.093656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-aa090fe7-908f-4ad0-94eb-5f861d8fbe3d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:48.098636 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-aa090fe7-908f-4ad0-94eb-5f861d8fbe3d tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/5eebea01-7d6e-4574-8a3a-f06afeaef1cf HTTP/1.1" status: 404 len: 333 time: 0.0556855 May 12 15:39:48.099288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35832) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:48.143055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35836) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:48.166350 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-3eb1fe83-1bf8-49a4-9785-7145ff268e52 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:48.166871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3eb1fe83-1bf8-49a4-9785-7145ff268e52 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:48.171178 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3eb1fe83-1bf8-49a4-9785-7145ff268e52 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/80485e3f-9911-46cd-88e9-ff7d2634ee2b HTTP/1.1" status: 404 len: 337 time: 0.0683501 May 12 15:39:48.172000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35842) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:48.223786 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-16ff5d93-0a4d-4cec-b64b-76efbd4ced11 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:48.224248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-16ff5d93-0a4d-4cec-b64b-76efbd4ced11 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:48.226044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-16ff5d93-0a4d-4cec-b64b-76efbd4ced11 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/df9a414a-4889-4953-b467-9aa00a9ae792 HTTP/1.1" status: 404 len: 333 time: 0.0530198 May 12 15:39:48.228320 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-ff5657af-138a-47a8-b012-b633467f01a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Floating IP c24d2acf-3216-485d-abda-c05c5a66e7eb associated. External IP: 172.25.8.233, port: 8ac3db5f-3324-4a02-a6e5-504a9ea69fc2. May 12 15:39:48.231574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35848) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:48.287501 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-c5d0d84c-5110-4a2c-a737-e1c6bf8dc1f7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:48.287947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c5d0d84c-5110-4a2c-a737-e1c6bf8dc1f7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:48.289652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c5d0d84c-5110-4a2c-a737-e1c6bf8dc1f7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/6019c6f6-1dfd-4bef-805a-b36f2fe9672a HTTP/1.1" status: 404 len: 337 time: 0.0565984 May 12 15:39:48.297467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35856) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:48.342842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9f25dc7c-b309-4dbe-ab83-05fd6e668653 None None] Deleting port e60e88df-e3f5-43ee-9957-d0e2ad1bd28c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:48.343372 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9f25dc7c-b309-4dbe-ab83-05fd6e668653 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:48.407040 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-520c0296-a043-4330-b177-111a092577fd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:48.407473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-520c0296-a043-4330-b177-111a092577fd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:48.409538 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-520c0296-a043-4330-b177-111a092577fd tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/d6050a60-ec12-410a-9b8f-d376863839fd HTTP/1.1" status: 404 len: 333 time: 0.1109297 May 12 15:39:48.413078 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d8883a4e-499a-4c29-a753-43df8f91a889 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2e0dfdb783c948f8aad42ecd29e9390e&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2688260 May 12 15:39:48.414112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35862) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:48.416160 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] Deleting port 502308a6-1076-44de-9233-ae79e304dfc8 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:48.416402 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35864) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:48.417565 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:48.459348 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2174ca-d455-4bea-b5d2-03e6c8aa8f0d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:48.500688 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-93723ca6-0b01-4053-9828-05caa50b7926 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:48.501309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-93723ca6-0b01-4053-9828-05caa50b7926 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:48.502857 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-93723ca6-0b01-4053-9828-05caa50b7926 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/2d18170c-957c-43d3-a4dc-97efb6ef7afe HTTP/1.1" status: 404 len: 337 time: 0.0877118 May 12 15:39:48.503282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc2174ca-d455-4bea-b5d2-03e6c8aa8f0d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b711db2-bf1b-43db-a945-4a5780f04588,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:48.505857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35870) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:48.525175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2174ca-d455-4bea-b5d2-03e6c8aa8f0d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:48.539416 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cc2174ca-d455-4bea-b5d2-03e6c8aa8f0d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7b711db2-bf1b-43db-a945-4a5780f04588 HTTP/1.1" status: 204 len: 168 time: 0.9034958 May 12 15:39:48.571206 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-31b01705-a450-4fef-8cf9-30b2156cc95a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:48.571918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-31b01705-a450-4fef-8cf9-30b2156cc95a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:48.574374 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-31b01705-a450-4fef-8cf9-30b2156cc95a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/f8b0c968-d5d0-413d-9ade-028ef202d570 HTTP/1.1" status: 404 len: 333 time: 0.0674245 May 12 15:39:48.577639 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35878) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:48.617220 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65e3278d-280e-4c45-bc90-18ff961582b5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:48.623433 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-3f667b8b-4aa0-40eb-b591-32d411a597b9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:48.624135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3f667b8b-4aa0-40eb-b591-32d411a597b9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:48.626012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3f667b8b-4aa0-40eb-b591-32d411a597b9 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/f38e3e28-a08b-457d-95c4-1898903f5bd0 HTTP/1.1" status: 404 len: 337 time: 0.0471611 May 12 15:39:48.633958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35882) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:48.710968 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-dc7333f0-ef15-4703-9ccd-f3068e293547 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:48.712080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dc7333f0-ef15-4703-9ccd-f3068e293547 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:48.713847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dc7333f0-ef15-4703-9ccd-f3068e293547 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/e2dd3577-6812-47f1-8625-3a1e6d24b433 HTTP/1.1" status: 404 len: 333 time: 0.0786455 May 12 15:39:48.716396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35890) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:48.723169 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65e3278d-280e-4c45-bc90-18ff961582b5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:48.864804 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-b2cc6d5d-4228-49e3-b6c6-4cbd33f8a648 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:48.872435 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b2cc6d5d-4228-49e3-b6c6-4cbd33f8a648 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:48.879037 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b2cc6d5d-4228-49e3-b6c6-4cbd33f8a648 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/7f084728-75c4-4d4e-86a4-ec984fbee216 HTTP/1.1" status: 404 len: 337 time: 0.1354382 May 12 15:39:48.888774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35904) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:48.911830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] For port 502308a6-1076-44de-9233-ae79e304dfc8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=502308a6-1076-44de-9233-ae79e304dfc8,segment=NetworkSegment(ce17b845-4503-482c-9dbc-c15a6259653f),segment_id=ce17b845-4503-482c-9dbc-c15a6259653f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:48.926696 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:48.952894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ff5657af-138a-47a8-b012-b633467f01a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:39:49.047640 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-76d55a2d-aa49-42ad-92ff-f261e390858a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:49.048151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-76d55a2d-aa49-42ad-92ff-f261e390858a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:49.056379 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-76d55a2d-aa49-42ad-92ff-f261e390858a tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/63ff4f30-8fd7-4cc4-b84b-bf48224ab1b0 HTTP/1.1" status: 404 len: 333 time: 0.1643357 May 12 15:39:49.068811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] Calling delete_port for 502308a6-1076-44de-9233-ae79e304dfc8 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:49.073245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35908) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:49.125706 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35912) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:49.151761 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-a9cfc62f-27a7-4698-9a0e-8bead7744287 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:49.152248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a9cfc62f-27a7-4698-9a0e-8bead7744287 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:49.154141 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a9cfc62f-27a7-4698-9a0e-8bead7744287 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/e5756c58-c54a-46bc-9199-09e74d94842f HTTP/1.1" status: 404 len: 337 time: 0.0798302 May 12 15:39:49.156912 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35916) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:49.161522 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb689646-604f-445e-8ded-2f05ed82149a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:49.184343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fb689646-604f-445e-8ded-2f05ed82149a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:49.188579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fb689646-604f-445e-8ded-2f05ed82149a admin admin] Usage tracker for resource:security_group_rule and tenant:ad0f7934d23d4ea1b887e19ed69d8a96 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:49.191968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fb689646-604f-445e-8ded-2f05ed82149a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:49.192693 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9f25dc7c-b309-4dbe-ab83-05fd6e668653 None None] The port 'e60e88df-e3f5-43ee-9957-d0e2ad1bd28c' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:39:49.197314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fb689646-604f-445e-8ded-2f05ed82149a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:49.212049 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:49.307027 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] No DVR routers for this DVR port 502308a6-1076-44de-9233-ae79e304dfc8 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:39:49.321669 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb689646-604f-445e-8ded-2f05ed82149a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:49.327915 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb689646-604f-445e-8ded-2f05ed82149a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:49.345359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-783004b4-d4f6-4fea-9555-a1db3475fbab None None] Pushing event deleted for resources: {'Port': ['ID=502308a6-1076-44de-9233-ae79e304dfc8,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:49.361813 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-9f4a2cb9-36cb-493f-ae59-9528835b3573 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:49.362272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9f4a2cb9-36cb-493f-ae59-9528835b3573 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:49.367483 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9f4a2cb9-36cb-493f-ae59-9528835b3573 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/1d0b1eb3-b2bd-477f-9116-21efb3abfe4a HTTP/1.1" status: 404 len: 337 time: 0.2062383 May 12 15:39:49.367804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35926) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:49.477371 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65e3278d-280e-4c45-bc90-18ff961582b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:49.499994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fb689646-604f-445e-8ded-2f05ed82149a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ad0f7934d23d4ea1b887e19ed69d8a96&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3677876 May 12 15:39:49.500833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35934) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:49.506752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb689646-604f-445e-8ded-2f05ed82149a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17fdaaef-f4f4-4795-a696-7fd7b6218168,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:49.542025 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65e3278d-280e-4c45-bc90-18ff961582b5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:49.545935 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-65e3278d-280e-4c45-bc90-18ff961582b5 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fa720b4a-9dbc-44f9-bc43-8f906edc817d HTTP/1.1" status: 204 len: 168 time: 1.1256275 May 12 15:39:49.561295 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-9a74a102-f9c6-4b10-8a4c-24e55d01a4cb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:49.561861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9a74a102-f9c6-4b10-8a4c-24e55d01a4cb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:49.567388 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9a74a102-f9c6-4b10-8a4c-24e55d01a4cb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/4f43740b-fdd2-4ca2-a12a-5800e2659845 HTTP/1.1" status: 404 len: 333 time: 0.1955817 May 12 15:39:49.567855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65e3278d-280e-4c45-bc90-18ff961582b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa720b4a-9dbc-44f9-bc43-8f906edc817d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:49.574745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35940) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:49.608289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff5657af-138a-47a8-b012-b633467f01a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:39:49.621166 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac37856b-6465-4d21-8771-01e2a76512ea None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:39:49.639704 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac37856b-6465-4d21-8771-01e2a76512ea None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:49.640236 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ac37856b-6465-4d21-8771-01e2a76512ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:49.661324 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-c0e36ea8-1817-4e28-85cd-d3f71fe26623 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:49.685958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c0e36ea8-1817-4e28-85cd-d3f71fe26623 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:49.687838 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c0e36ea8-1817-4e28-85cd-d3f71fe26623 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/1adea5b5-8e1d-4e35-b187-7fbf8778d11f HTTP/1.1" status: 404 len: 337 time: 0.1115341 May 12 15:39:49.693142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35944) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:49.712575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be87f0ee-e88f-4719-91c4-63338743ea65 req-8283ab36-1947-4844-8b19-3880c5ce5363 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:49.714142 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be87f0ee-e88f-4719-91c4-63338743ea65 req-8283ab36-1947-4844-8b19-3880c5ce5363 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 945 time: 0.3585057 May 12 15:39:49.766012 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ac37856b-6465-4d21-8771-01e2a76512ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:49.778962 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac37856b-6465-4d21-8771-01e2a76512ea None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:49.779633 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ac37856b-6465-4d21-8771-01e2a76512ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:49.836946 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-2d63b4c0-29d2-40a2-a56c-0fba7ad14264 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:49.836946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2d63b4c0-29d2-40a2-a56c-0fba7ad14264 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:49.846279 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2d63b4c0-29d2-40a2-a56c-0fba7ad14264 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/9697cb9e-01b5-485c-94a1-4bbe8714db12 HTTP/1.1" status: 404 len: 337 time: 0.1196263 May 12 15:39:49.859426 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ac37856b-6465-4d21-8771-01e2a76512ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:49.859426 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac37856b-6465-4d21-8771-01e2a76512ea None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:39:49.869555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35952) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:50.061614 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f78566a8-28d9-419a-8721-e99764b8a2cd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:50.065562 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-ac4f4a47-5dce-402c-bbd8-6e2539de8a44 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:50.066061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ac4f4a47-5dce-402c-bbd8-6e2539de8a44 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:50.068401 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ac4f4a47-5dce-402c-bbd8-6e2539de8a44 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/20d2555c-e152-4f1a-a5ea-24735aff3042 HTTP/1.1" status: 404 len: 333 time: 0.1969481 May 12 15:39:50.074601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35962) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:50.081611 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be87f0ee-e88f-4719-91c4-63338743ea65 req-42f3fd80-7282-4f87-bc0f-5a670e672856 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3532913 May 12 15:39:50.100746 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f78566a8-28d9-419a-8721-e99764b8a2cd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:50.179142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35966) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:50.202019 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77be4782-a701-4500-9d8c-8b075d933a0e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:50.211340 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-c7bd2c2a-e508-499f-a2f6-522e36056d54 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:50.212181 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c7bd2c2a-e508-499f-a2f6-522e36056d54 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:50.214215 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f78566a8-28d9-419a-8721-e99764b8a2cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:50.217564 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c7bd2c2a-e508-499f-a2f6-522e36056d54 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/190f4e15-7894-4db0-a1b4-c08889beb74a HTTP/1.1" status: 404 len: 337 time: 0.1417170 May 12 15:39:50.218933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35970) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:50.271997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f78566a8-28d9-419a-8721-e99764b8a2cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17fdaaef-f4f4-4795-a696-7fd7b6218168,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:50.277950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-77be4782-a701-4500-9d8c-8b075d933a0e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:50.287388 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f78566a8-28d9-419a-8721-e99764b8a2cd admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:50.288721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f78566a8-28d9-419a-8721-e99764b8a2cd admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/17fdaaef-f4f4-4795-a696-7fd7b6218168 HTTP/1.1" status: 204 len: 168 time: 0.7856085 May 12 15:39:50.290855 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-4007ce5e-9092-4c96-9720-e1d953690dd1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:50.291544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4007ce5e-9092-4c96-9720-e1d953690dd1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:50.293264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4007ce5e-9092-4c96-9720-e1d953690dd1 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/8c9d568b-abd3-4d96-a557-09afcfabb6f4 HTTP/1.1" status: 404 len: 337 time: 0.0654335 May 12 15:39:50.295212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-77be4782-a701-4500-9d8c-8b075d933a0e admin admin] Usage tracker for resource:security_group_rule and tenant:None is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:50.298690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 35976) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:50.303064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-77be4782-a701-4500-9d8c-8b075d933a0e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:50.344958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-77be4782-a701-4500-9d8c-8b075d933a0e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:50.368607 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-57437104-0adc-48f5-bae1-db810ee7c8f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:50.370330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-57437104-0adc-48f5-bae1-db810ee7c8f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:50.372910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-57437104-0adc-48f5-bae1-db810ee7c8f4 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/91b9efd1-d657-4259-a0df-e08a53fa2d4a HTTP/1.1" status: 404 len: 333 time: 0.0715957 May 12 15:39:50.377146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35984) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:50.423262 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-884295e0-1e4c-4cab-8a12-2ba80fc8d1da tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:50.423995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-884295e0-1e4c-4cab-8a12-2ba80fc8d1da tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:50.426095 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-884295e0-1e4c-4cab-8a12-2ba80fc8d1da tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/33386b3c-0502-4a8c-8c5c-e38ca9307dd2 HTTP/1.1" status: 404 len: 337 time: 0.0480018 May 12 15:39:50.429170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35988) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:50.509173 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77be4782-a701-4500-9d8c-8b075d933a0e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:50.513860 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-88229e51-3031-4f90-9bfd-d9a73f871f0b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:50.514320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-88229e51-3031-4f90-9bfd-d9a73f871f0b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:50.516047 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-88229e51-3031-4f90-9bfd-d9a73f871f0b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/6683876a-b3b0-4c08-b9c6-49d4d18a7c85 HTTP/1.1" status: 404 len: 337 time: 0.0856941 May 12 15:39:50.518844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 35994) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:50.524719 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77be4782-a701-4500-9d8c-8b075d933a0e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:50.559845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ff5657af-138a-47a8-b012-b633467f01a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router 697c0f4d-8153-41d1-a4dd-f0d86c14fd95 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:39:50.582678 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-31d977b7-69fc-42ba-bee7-a4f1b3c8fa94 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports?device_id=8b8e7749-e111-476a-884f-1e4731548b2a HTTP/1.1" status: 200 len: 205 time: 0.0603995 May 12 15:39:50.585355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36000) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:50.629235 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-77be4782-a701-4500-9d8c-8b075d933a0e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=None&name=default HTTP/1.1" status: 200 len: 2703 time: 0.4490280 May 12 15:39:50.630288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36008) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:50.744231 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-112b0203-bc3b-4824-9a3e-646244ae39b7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] delete failed (client error): The resource could not be found. May 12 15:39:50.745277 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-112b0203-bc3b-4824-9a3e-646244ae39b7 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/routers/8b8e7749-e111-476a-884f-1e4731548b2a HTTP/1.1" status: 404 len: 336 time: 0.1587021 May 12 15:39:50.755682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36018) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:50.789701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77be4782-a701-4500-9d8c-8b075d933a0e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7a55a1a-68be-45b2-8e09-d63faac44f10,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:50.810012 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-5e5c6156-7a6d-434c-9199-c92f3b6b171e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:50.810938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5e5c6156-7a6d-434c-9199-c92f3b6b171e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:50.813489 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5e5c6156-7a6d-434c-9199-c92f3b6b171e tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/5c305c19-23a9-41fa-8421-7282f02eeb36 HTTP/1.1" status: 404 len: 337 time: 0.0563679 May 12 15:39:50.817710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36024) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:50.854954 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f26bc7f5-367d-4a44-93fd-80a96124d369 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:50.907584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1f4add4d-4be1-4735-8ad7-06ad64f47940 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "GET /v2.0/ports?device_id=2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33 HTTP/1.1" status: 200 len: 205 time: 0.0849867 May 12 15:39:50.914423 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36030) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:50.960451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff5657af-138a-47a8-b012-b633467f01a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:39:50.966371 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ff5657af-138a-47a8-b012-b633467f01a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:50.971692 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1588d087-e402-4a5a-bb0a-0cbcc7f6c404 None None] Sync routers for ids ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:39:50.988361 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1588d087-e402-4a5a-bb0a-0cbcc7f6c404 None None] Routers {'697c0f4d-8153-41d1-a4dd-f0d86c14fd95'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:50.989122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1588d087-e402-4a5a-bb0a-0cbcc7f6c404 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:51.096021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1588d087-e402-4a5a-bb0a-0cbcc7f6c404 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:51.133628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1588d087-e402-4a5a-bb0a-0cbcc7f6c404 None None] Routers {'697c0f4d-8153-41d1-a4dd-f0d86c14fd95'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:51.134532 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1588d087-e402-4a5a-bb0a-0cbcc7f6c404 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:51.141088 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f26bc7f5-367d-4a44-93fd-80a96124d369 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:51.165243 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-11a4178e-8c14-4da7-bddb-9fc060281a32 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] delete failed (client error): The resource could not be found. May 12 15:39:51.169263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-11a4178e-8c14-4da7-bddb-9fc060281a32 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/routers/2165dd9a-7145-4fb7-8eb1-d0e3dbd9ca33 HTTP/1.1" status: 404 len: 336 time: 0.2432835 May 12 15:39:51.178901 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36046) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:51.187475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f98e2d18-1a5f-450c-8d5a-4392384dd80a req-1529e824-6378-4138-b697-a7f81f1f1cc6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:51.189038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f98e2d18-1a5f-450c-8d5a-4392384dd80a req-1529e824-6378-4138-b697-a7f81f1f1cc6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.84 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 945 time: 0.4917040 May 12 15:39:51.205325 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ff5657af-138a-47a8-b012-b633467f01a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "PUT /v2.0/floatingips/c24d2acf-3216-485d-abda-c05c5a66e7eb HTTP/1.1" status: 200 len: 977 time: 5.3160121 May 12 15:39:51.216652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36050) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:51.247089 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1588d087-e402-4a5a-bb0a-0cbcc7f6c404 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:51.247786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1588d087-e402-4a5a-bb0a-0cbcc7f6c404 None None] The sync data for ids ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:39:51.356352 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-4b73151e-9eea-4920-b14c-b5fa14fb52e2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:51.356477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4b73151e-9eea-4920-b14c-b5fa14fb52e2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:51.381811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-55615ae8-9af6-4fc3-a88b-22d7127a41c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port f081673d-e456-4c37-905f-a5fce92a8340 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:51.382199 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55615ae8-9af6-4fc3-a88b-22d7127a41c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:51.407997 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4b73151e-9eea-4920-b14c-b5fa14fb52e2 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/88285689-afad-483b-ba60-963106bdc4f2 HTTP/1.1" status: 404 len: 337 time: 0.2179341 May 12 15:39:51.418335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36060) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:51.488722 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-a084b719-b0e9-4dc8-a15b-e2e2ba9f6dd5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:51.489333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a084b719-b0e9-4dc8-a15b-e2e2ba9f6dd5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:51.509146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-f98e2d18-1a5f-450c-8d5a-4392384dd80a req-4170e6ee-7481-4560-a339-0f6791feff49 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Deleting port c04b659b-b7f0-4250-9162-64d4b30f41b3 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:51.509875 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f98e2d18-1a5f-450c-8d5a-4392384dd80a req-4170e6ee-7481-4560-a339-0f6791feff49 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:51.562429 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a084b719-b0e9-4dc8-a15b-e2e2ba9f6dd5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/7296312a-865f-4b1e-907b-661eff5bf990 HTTP/1.1" status: 404 len: 337 time: 0.1401551 May 12 15:39:51.574824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36068) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:51.626138 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f26bc7f5-367d-4a44-93fd-80a96124d369 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:51.630287 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f26bc7f5-367d-4a44-93fd-80a96124d369 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:51.634232 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f26bc7f5-367d-4a44-93fd-80a96124d369 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f7a55a1a-68be-45b2-8e09-d63faac44f10 HTTP/1.1" status: 204 len: 168 time: 0.9924071 May 12 15:39:51.661123 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-efb984c2-168b-42ac-8572-17504e04a99f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:51.662052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-efb984c2-168b-42ac-8572-17504e04a99f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:51.663990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-efb984c2-168b-42ac-8572-17504e04a99f tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/28b7f017-c4c6-445b-a340-02a082f7b0a8 HTTP/1.1" status: 404 len: 333 time: 0.0841994 May 12 15:39:51.696705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f26bc7f5-367d-4a44-93fd-80a96124d369 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7a55a1a-68be-45b2-8e09-d63faac44f10,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:51.706099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36078) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:51.773233 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55615ae8-9af6-4fc3-a88b-22d7127a41c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:51.784063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36082) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:51.790611 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [-] 10.222.0.82 "GET / HTTP/1.1" status: 200 len: 248 time: 0.0028727 May 12 15:39:51.794454 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-906ce4f8-610c-49b1-a9b0-9029891a747b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:51.794454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-906ce4f8-610c-49b1-a9b0-9029891a747b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:51.796126 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-906ce4f8-610c-49b1-a9b0-9029891a747b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/d363936d-3681-42b8-9dc3-f8cb84e4773e HTTP/1.1" status: 404 len: 337 time: 0.0872324 May 12 15:39:51.802931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36084) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:51.802931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36086) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:51.817636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56892c2c-fe47-4cf7-b54f-0aff49fef877 req-54286fc6-2b8d-4624-b316-a6294cffff0a tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:51.824489 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56892c2c-fe47-4cf7-b54f-0aff49fef877 req-54286fc6-2b8d-4624-b316-a6294cffff0a tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 945 time: 0.4859850 May 12 15:39:51.968502 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-4659ce2c-e366-477a-9128-d3da70d50767 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:51.968974 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4659ce2c-e366-477a-9128-d3da70d50767 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:51.970689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4659ce2c-e366-477a-9128-d3da70d50767 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/be1798d9-95e0-43e2-bea6-b3a1ace514f5 HTTP/1.1" status: 404 len: 333 time: 0.1655011 May 12 15:39:52.077582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36098) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:52.083976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56892c2c-fe47-4cf7-b54f-0aff49fef877 req-a27a1e11-5a3d-4397-acfd-d83ff4e80265 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2583902 May 12 15:39:52.193213 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-82467e0e-493b-432d-be5c-bbb5a1f5c815 tempest-NetworksApiDiscovery-1259686024 tempest-NetworksApiDiscovery-1259686024-project] 10.222.0.82 "GET /v2.0/ HTTP/1.1" status: 200 len: 702 time: 0.3894560 May 12 15:39:52.199719 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-b405afc7-ea21-414b-8a9b-ffc8568f3feb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:52.200168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b405afc7-ea21-414b-8a9b-ffc8568f3feb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:52.204102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b405afc7-ea21-414b-8a9b-ffc8568f3feb tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/97508220-1a7e-4110-9801-afe6d638e163 HTTP/1.1" status: 404 len: 337 time: 0.1188350 May 12 15:39:52.207702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36116) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:52.289450 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-f67fb46d-523a-4f1e-97fb-368aac2135bf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:52.289859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f67fb46d-523a-4f1e-97fb-368aac2135bf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:52.298718 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f67fb46d-523a-4f1e-97fb-368aac2135bf tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/e07ac8ab-b2de-4401-ab99-c08c96ce7d1a HTTP/1.1" status: 404 len: 333 time: 0.0643415 May 12 15:39:52.299568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36122) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:52.370328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f98e2d18-1a5f-450c-8d5a-4392384dd80a req-4170e6ee-7481-4560-a339-0f6791feff49 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] For port c04b659b-b7f0-4250-9162-64d4b30f41b3, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c04b659b-b7f0-4250-9162-64d4b30f41b3,segment=NetworkSegment(09c83b83-4d53-47f0-b181-c0fb6ed7f95d),segment_id=09c83b83-4d53-47f0-b181-c0fb6ed7f95d)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:39:52.370463 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f98e2d18-1a5f-450c-8d5a-4392384dd80a req-4170e6ee-7481-4560-a339-0f6791feff49 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:52.388244 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-a1c15b13-9969-452d-a3b3-f2e565c28a66 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:52.388762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a1c15b13-9969-452d-a3b3-f2e565c28a66 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:52.393366 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a1c15b13-9969-452d-a3b3-f2e565c28a66 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/77932d15-465b-422a-86a7-8e543493cdc8 HTTP/1.1" status: 404 len: 337 time: 0.0869370 May 12 15:39:52.397218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36128) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:52.529143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36132) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:52.560021 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-9ebe3e21-12fc-4ff3-aee8-9c2d30e05c2c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:52.560657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9ebe3e21-12fc-4ff3-aee8-9c2d30e05c2c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:52.562914 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9ebe3e21-12fc-4ff3-aee8-9c2d30e05c2c tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/9c74fa6a-5efc-4eb1-b6c0-520961887d83 HTTP/1.1" status: 404 len: 333 time: 0.1640897 May 12 15:39:52.570644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-f98e2d18-1a5f-450c-8d5a-4392384dd80a req-4170e6ee-7481-4560-a339-0f6791feff49 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Calling delete_port for c04b659b-b7f0-4250-9162-64d4b30f41b3 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:52.575105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36142) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:52.662413 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55615ae8-9af6-4fc3-a88b-22d7127a41c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:52.665849 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55615ae8-9af6-4fc3-a88b-22d7127a41c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:52.666335 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-55615ae8-9af6-4fc3-a88b-22d7127a41c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Floating IP c24d2acf-3216-485d-abda-c05c5a66e7eb disassociated. External IP: 172.25.8.233, port: f081673d-e456-4c37-905f-a5fce92a8340. May 12 15:39:52.666852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-55615ae8-9af6-4fc3-a88b-22d7127a41c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for f081673d-e456-4c37-905f-a5fce92a8340 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:52.767649 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-f2a5879a-b744-45c5-abad-fdd0e009767b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:52.768717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f2a5879a-b744-45c5-abad-fdd0e009767b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:52.771362 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f2a5879a-b744-45c5-abad-fdd0e009767b tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/1ac875b9-81a6-4bbd-9c14-21f72dde4448 HTTP/1.1" status: 404 len: 337 time: 0.1953127 May 12 15:39:52.775221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36152) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:52.851356 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a02ce5a-703d-42a5-8a92-13463747fd3e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:52.864968 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-f1f3c656-7f77-40e4-b777-2faecbdea536 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:52.865466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f1f3c656-7f77-40e4-b777-2faecbdea536 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:52.869361 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f1f3c656-7f77-40e4-b777-2faecbdea536 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/0c20aca6-65c5-46f4-b1e7-f0ef1d445c18 HTTP/1.1" status: 404 len: 333 time: 0.0907342 May 12 15:39:52.872423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36160) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:52.929294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1a02ce5a-703d-42a5-8a92-13463747fd3e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:52.931813 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-63a01fde-ba81-4895-bf6d-5142db010e66 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:52.932639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-63a01fde-ba81-4895-bf6d-5142db010e66 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:52.936952 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-63a01fde-ba81-4895-bf6d-5142db010e66 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/aacc81a1-0db0-4f7d-821f-2529e715115b HTTP/1.1" status: 404 len: 337 time: 0.0606251 May 12 15:39:52.936952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36164) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:52.939837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1a02ce5a-703d-42a5-8a92-13463747fd3e admin admin] Usage tracker for resource:security_group_rule and tenant:d2f9734fe4e243b5a2945914a4a9718f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:52.943371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1a02ce5a-703d-42a5-8a92-13463747fd3e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:52.985653 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f98e2d18-1a5f-450c-8d5a-4392384dd80a req-4170e6ee-7481-4560-a339-0f6791feff49 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:52.988244 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-f2ca6883-d702-400f-a6c2-6ff6a135ece5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:52.988244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f2ca6883-d702-400f-a6c2-6ff6a135ece5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:53.031550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36170) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:53.037820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['c04b659b-b7f0-4250-9162-64d4b30f41b3'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:39:53.046641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1a02ce5a-703d-42a5-8a92-13463747fd3e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:53.058117 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f2ca6883-d702-400f-a6c2-6ff6a135ece5 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/255946e0-f8f8-47c3-9012-917dfa4c0ae0 HTTP/1.1" status: 404 len: 333 time: 0.1180322 May 12 15:39:53.064985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36176) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:53.094638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4170e6ee-7481-4560-a339-0f6791feff49 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Pushing event deleted for resources: {'Port': ['ID=c04b659b-b7f0-4250-9162-64d4b30f41b3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:53.125983 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-651b506d-0d6f-43e4-9c72-f983c98437a0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:53.126513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-651b506d-0d6f-43e4-9c72-f983c98437a0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:53.173801 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-651b506d-0d6f-43e4-9c72-f983c98437a0 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/463e46ac-f43f-4627-ba4c-513e63c0bcd7 HTTP/1.1" status: 404 len: 337 time: 0.0964491 May 12 15:39:53.175659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36184) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:53.225124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-f98e2d18-1a5f-450c-8d5a-4392384dd80a req-4170e6ee-7481-4560-a339-0f6791feff49 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] No DVR routers for this DVR port c04b659b-b7f0-4250-9162-64d4b30f41b3 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:39:53.229072 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f98e2d18-1a5f-450c-8d5a-4392384dd80a req-4170e6ee-7481-4560-a339-0f6791feff49 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:53.233272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1703133c-bec8-4a64-87dd-56b43532f2ab', 'name': 'network-vif-deleted', 'tag': 'c04b659b-b7f0-4250-9162-64d4b30f41b3'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:39:53.263944 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f98e2d18-1a5f-450c-8d5a-4392384dd80a req-4170e6ee-7481-4560-a339-0f6791feff49 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.84 "DELETE /v2.0/ports/c04b659b-b7f0-4250-9162-64d4b30f41b3 HTTP/1.1" status: 204 len: 173 time: 2.0134337 May 12 15:39:53.275841 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55615ae8-9af6-4fc3-a88b-22d7127a41c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:53.300397 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBackupRestore-424444605-network', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:53.312848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:53.325094 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Usage tracker for resource:network and tenant:0528307b42774c45be9eba4ffc91c8dd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:53.330735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:53.338577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:53.361757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Made reservation on behalf of 0528307b42774c45be9eba4ffc91c8dd for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:53.365073 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:53.395109 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7dc4925f-9663-4666-8ff8-0a17747c2e4c'] response: {'server_uuid': '1703133c-bec8-4a64-87dd-56b43532f2ab', 'name': 'network-vif-deleted', 'tag': 'c04b659b-b7f0-4250-9162-64d4b30f41b3', 'status': 'completed', 'code': 200} May 12 15:39:53.396786 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:53.428271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:53.434486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Usage tracker for resource:security_group_rule and tenant:0528307b42774c45be9eba4ffc91c8dd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:53.438408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:53.446368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:53.559668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a472c0db-4381-40e6-9f85-8f5689cf7437 req-16fe46ce-fedf-4415-8782-345f45eb2798 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Synchronizing usage tracker for tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:39:53.601184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a472c0db-4381-40e6-9f85-8f5689cf7437 req-16fe46ce-fedf-4415-8782-345f45eb2798 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Unset dirty status for tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:39:53.604659 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a472c0db-4381-40e6-9f85-8f5689cf7437 req-16fe46ce-fedf-4415-8782-345f45eb2798 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=1703133c-bec8-4a64-87dd-56b43532f2ab HTTP/1.1" status: 200 len: 210 time: 0.1234577 May 12 15:39:53.630002 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-5ce312b7-be77-439b-98ff-8ccc0af9d167 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:53.630491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5ce312b7-be77-439b-98ff-8ccc0af9d167 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:53.734249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55615ae8-9af6-4fc3-a88b-22d7127a41c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Port': ['ID=f081673d-e456-4c37-905f-a5fce92a8340,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:53.750267 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a02ce5a-703d-42a5-8a92-13463747fd3e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:53.752610 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5ce312b7-be77-439b-98ff-8ccc0af9d167 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/ports/7037386d-9602-4ae9-8dd4-104969601bdc HTTP/1.1" status: 404 len: 333 time: 0.5750329 May 12 15:39:53.787727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36198) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:53.857780 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:53.860092 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-21a82d6a-b5b7-4114-9a7c-51f55c817eb6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] DELETE failed (client error): The resource could not be found. May 12 15:39:53.860837 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-21a82d6a-b5b7-4114-9a7c-51f55c817eb6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:39:53.882875 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-21a82d6a-b5b7-4114-9a7c-51f55c817eb6 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/subnets/ff052fe9-77d5-4476-baff-4325901e1ad4 HTTP/1.1" status: 404 len: 337 time: 0.0926168 May 12 15:39:53.883884 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:53.888308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36202) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:53.922617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0d10c60f-7be4-4e31-b4dd-6ecb90920a8e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:54.051356 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a02ce5a-703d-42a5-8a92-13463747fd3e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.055980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 589} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:39:54.069337 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a18ba89-586f-4675-abb5-c45e1fa3d663 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.083509 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.084680 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Added segment 384c5e83-6775-4f29-a4c7-08c3d60e1de8 of type vlan for network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade May 12 15:39:54.148051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a02ce5a-703d-42a5-8a92-13463747fd3e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4bdb6bd7-e220-4754-88f5-ed5ab5837244,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:54.150813 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1a02ce5a-703d-42a5-8a92-13463747fd3e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d2f9734fe4e243b5a2945914a4a9718f&name=default HTTP/1.1" status: 200 len: 2983 time: 1.6206560 May 12 15:39:54.154609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36210) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:54.158764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-55615ae8-9af6-4fc3-a88b-22d7127a41c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router 697c0f4d-8153-41d1-a4dd-f0d86c14fd95 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:39:54.184057 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.333055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a18ba89-586f-4675-abb5-c45e1fa3d663 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.370054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-0a18ba89-586f-4675-abb5-c45e1fa3d663 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2447b094-d5d6-41ef-a146-2bf56f5399af']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:54.384494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-0a18ba89-586f-4675-abb5-c45e1fa3d663 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ce17b845-4503-482c-9dbc-c15a6259653f') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:54.384991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-0a18ba89-586f-4675-abb5-c45e1fa3d663 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ce17b845-4503-482c-9dbc-c15a6259653f') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:54.401780 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f30f5f4-7738-44c7-8e99-b700dc81bead admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.402795 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a18ba89-586f-4675-abb5-c45e1fa3d663 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.418750 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.420406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:54.421822 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.490338 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f30f5f4-7738-44c7-8e99-b700dc81bead admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.517985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55615ae8-9af6-4fc3-a88b-22d7127a41c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:39:54.535936 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f85c6e2-0a39-4731-8305-60bd05c21464 None None] Sync routers for ids ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:39:54.536470 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a18ba89-586f-4675-abb5-c45e1fa3d663 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.551795 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f85c6e2-0a39-4731-8305-60bd05c21464 None None] Routers {'697c0f4d-8153-41d1-a4dd-f0d86c14fd95'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:54.552444 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2f85c6e2-0a39-4731-8305-60bd05c21464 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:54.560173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0a18ba89-586f-4675-abb5-c45e1fa3d663 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Releasing vlan 553 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:39:54.560575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a18ba89-586f-4675-abb5-c45e1fa3d663 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: timer() May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:39:54.577337 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:39:54.592300 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 1.5596993 May 12 15:39:54.592979 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36224) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:54.673185 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55615ae8-9af6-4fc3-a88b-22d7127a41c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.685972 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-55615ae8-9af6-4fc3-a88b-22d7127a41c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/ports/f081673d-e456-4c37-905f-a5fce92a8340 HTTP/1.1" status: 204 len: 168 time: 3.4682062 May 12 15:39:54.688780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36230) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:54.735712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Request body: {'subnet': {'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBackupRestore-424444605-subnet', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:54.772432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:54.782859 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2f85c6e2-0a39-4731-8305-60bd05c21464 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:54.783041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1747b5b1-df49-4c87-9723-8a110716110d admin admin] Pushing event updated for resources: {'Network': ['ID=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:54.796551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:39:54.818264 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f85c6e2-0a39-4731-8305-60bd05c21464 None None] Routers {'697c0f4d-8153-41d1-a4dd-f0d86c14fd95'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:39:54.818264 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2f85c6e2-0a39-4731-8305-60bd05c21464 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:54.834161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Usage tracker for resource:subnet and tenant:0528307b42774c45be9eba4ffc91c8dd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:54.849510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:54.871266 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a18ba89-586f-4675-abb5-c45e1fa3d663 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.883652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:54.896910 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a18ba89-586f-4675-abb5-c45e1fa3d663 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:54.952862 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2f85c6e2-0a39-4731-8305-60bd05c21464 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:39:54.953546 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f85c6e2-0a39-4731-8305-60bd05c21464 None None] The sync data for ids ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:39:54.963795 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0a18ba89-586f-4675-abb5-c45e1fa3d663 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] 10.222.0.82 "DELETE /v2.0/networks/2447b094-d5d6-41ef-a146-2bf56f5399af HTTP/1.1" status: 204 len: 168 time: 1.0447769 May 12 15:39:54.971949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a18ba89-586f-4675-abb5-c45e1fa3d663 tempest-NetworksTestDHCPv6-918737091 tempest-NetworksTestDHCPv6-918737091-project] Pushing event deleted for resources: {'Network': ['ID=2447b094-d5d6-41ef-a146-2bf56f5399af,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:54.988607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Made reservation on behalf of 0528307b42774c45be9eba4ffc91c8dd for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:39:54.991376 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:55.239835 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f30f5f4-7738-44c7-8e99-b700dc81bead admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:55.247932 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f30f5f4-7738-44c7-8e99-b700dc81bead admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:55.261438 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0f30f5f4-7738-44c7-8e99-b700dc81bead admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4bdb6bd7-e220-4754-88f5-ed5ab5837244 HTTP/1.1" status: 204 len: 168 time: 1.1057224 May 12 15:39:55.296673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f30f5f4-7738-44c7-8e99-b700dc81bead admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bdb6bd7-e220-4754-88f5-ed5ab5837244,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:55.439861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:55.510607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36264) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:55.585850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-d3b53107-6497-423f-aa17-10871df680f4 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:55.587283 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-d3b53107-6497-423f-aa17-10871df680f4 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/networks?id=85cd1d66-57c4-4d94-b782-1d4cae810f95 HTTP/1.1" status: 200 len: 808 time: 0.3956087 May 12 15:39:55.632063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Checking segment: {'id': '384c5e83-6775-4f29-a4c7-08c3d60e1de8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:39:55.632511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Network hostable DHCP agents. Network: 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:39:55.652197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-9b71dca5-84d7-4372-9b7a-319e87adee67 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/quotas/f798fdc3e9c54b38b7dbb0478a1d31d6 HTTP/1.1" status: 200 len: 375 time: 0.0308511 May 12 15:39:55.656402 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Pushing event updated for resources: {'Subnet': ['ID=5b4ef35a-b116-4246-86c9-ff3a7aad3410,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:55.748621 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-90a071b1-fb0b-4061-bde2-d19eb602603e tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=f798fdc3e9c54b38b7dbb0478a1d31d6&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0836251 May 12 15:39:55.774841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:39:55.789653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:55.798807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-790d317f-8a5d-4b5f-8154-4300e3ad7c67 None None] Network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:39:55.811626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:39:55.812384 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:55.913198 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-46f54d7f-d0c6-48c7-9d00-d3a0e2a4fa7b admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.2089357 May 12 15:39:55.915874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36288) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:55.922141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:39:55.932062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:39:55.944579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Usage tracker for resource:router and tenant:0528307b42774c45be9eba4ffc91c8dd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:39:55.954627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:39:55.985171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:39:56.094288 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a9ee1ca7-47e8-4359-a38a-d197d4e02661 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d0c0be8fb6b844879953049ca91c6fac&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5797989 May 12 15:39:56.096530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36294) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:56.221764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'fixed_ips': [{'subnet_id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:39:56.222949 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:56.304059 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:56.339197 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:56.374825 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb2b54d0-285e-42cb-a49f-85d99b3994a6 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:56.412725 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c04b659b-b7f0-4250-9162-64d4b30f41b3 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:39:56.454531 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:56.455590 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:56.507032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: c04b659b-b7f0-4250-9162-64d4b30f41b3 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:39:56.507261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c04b659b-b7f0-4250-9162-64d4b30f41b3 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:39:56.535145 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:56.607091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-7a15e69d-b5e5-49e5-9401-bbec78b185c8 service neutron] 10.222.0.82 "GET /v2.0/networks/85cd1d66-57c4-4d94-b782-1d4cae810f95?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8437896 May 12 15:39:56.726595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Allocated IP 172.20.0.2 (8fe69ccc-2df6-4e6d-ad35-1b9439b8eade/5b4ef35a-b116-4246-86c9-ff3a7aad3410/cbf462b6-153c-4279-b379-047c97c981f7) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:56.807240 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:56.846785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=808186e7-539e-4fad-bbd9-000462e21448,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:56.864315 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:56.865761 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/808186e7-539e-4fad-bbd9-000462e21448 HTTP/1.1" status: 204 len: 168 time: 0.7682800 May 12 15:39:56.886472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:56.887095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:56.887633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:56.888176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:56.888703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:56.889475 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:56.890001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:56.890638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:56.891258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:56.891783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:56.892304 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:56.892950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c80e7bf-d4f6-485e-a6ff-3782e01cb160 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:57.013034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-eb2b54d0-285e-42cb-a49f-85d99b3994a6 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port 36f8743f-6e41-4575-8e01-dc13b003bf99 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:39:57.014664 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb2b54d0-285e-42cb-a49f-85d99b3994a6 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:57.235925 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:57.258401 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Transition to ACTIVE for port object cbf462b6-153c-4279-b379-047c97c981f7 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:57.293272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Transition to ACTIVE for port object cbf462b6-153c-4279-b379-047c97c981f7 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:39:57.307748 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:57.481549 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:57.499255 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:57.515343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:57.520752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-0ed6d704-74b1-4006-b397-c4b4936078a2 service neutron] 10.222.0.82 "GET /v2.0/networks/85cd1d66-57c4-4d94-b782-1d4cae810f95?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8861947 May 12 15:39:57.531483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:57.608175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb2b54d0-285e-42cb-a49f-85d99b3994a6 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:57.714708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Pushing event updated for resources: {'Port': ['ID=cbf462b6-153c-4279-b379-047c97c981f7,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:57.729190 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:57.729870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:57.730373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:57.730952 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:57.731420 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:57.731884 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:57.732476 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:57.733105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:57.733588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:57.734062 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:57.734611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:57.735218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:39:57.761676 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Attempting to bind port cbf462b6-153c-4279-b379-047c97c981f7 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:39:57.762261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Attempting to bind port cbf462b6-153c-4279-b379-047c97c981f7 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '384c5e83-6775-4f29-a4c7-08c3d60e1de8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:39:57.762847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Attempting to bind port cbf462b6-153c-4279-b379-047c97c981f7 on network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:39:57.772560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 39, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:39:57.773348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Checking segment: {'id': '384c5e83-6775-4f29-a4c7-08c3d60e1de8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:39:57.774012 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:57.774597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Bound using segment: {'id': '384c5e83-6775-4f29-a4c7-08c3d60e1de8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:39:57.775267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Bound port: cbf462b6-153c-4279-b379-047c97c981f7, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '384c5e83-6775-4f29-a4c7-08c3d60e1de8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:39:57.775971 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:57.815094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-eb2b54d0-285e-42cb-a49f-85d99b3994a6 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for 36f8743f-6e41-4575-8e01-dc13b003bf99 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:39:57.951283 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09cd37a4-313c-4cc8-860f-130463f42fee req-c77b58e2-41a6-4f27-b90c-1d1a75b3d48e tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 210 time: 0.1120822 May 12 15:39:58.071818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] For port cbf462b6-153c-4279-b379-047c97c981f7, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:39:58.075913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] For port cbf462b6-153c-4279-b379-047c97c981f7, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cbf462b6-153c-4279-b379-047c97c981f7,segment=NetworkSegment(384c5e83-6775-4f29-a4c7-08c3d60e1de8),segment_id=384c5e83-6775-4f29-a4c7-08c3d60e1de8)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:39:58.089531 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:58.203327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03edf1c2-38c5-4301-af99-92822d49c255 None None] Pushing event updated for resources: {'Port': ['ID=cbf462b6-153c-4279-b379-047c97c981f7,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:58.751740 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:58.829507 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:59.098559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36408) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:59.148283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Allocated IP 172.25.8.241 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:39:59.205316 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb2b54d0-285e-42cb-a49f-85d99b3994a6 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:59.335450 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:59.366689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb2b54d0-285e-42cb-a49f-85d99b3994a6 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Port': ['ID=36f8743f-6e41-4575-8e01-dc13b003bf99,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:59.512497 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:39:59.590873 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef204f29-c418-4875-bd19-95e6d157575f req-8025ff52-b070-411d-a922-5766e84dadf6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 210 time: 0.1623964 May 12 15:39:59.670377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:39:59.676335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:39:59.696300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:39:59.767041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-b74e4012-e630-4cc6-b9a2-ee19b9814434 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:39:59.767041 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b74e4012-e630-4cc6-b9a2-ee19b9814434 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13635 time: 0.6601639 May 12 15:39:59.782938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36436) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:59.806677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-c70fe262-1305-4b15-bb54-a98b09b01ba7 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/address-group returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:39:59.811969 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c70fe262-1305-4b15-bb54-a98b09b01ba7 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/address-group HTTP/1.1" status: 200 len: 353 time: 0.0305212 May 12 15:39:59.843160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36442) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:59.860940 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Pushing event updated for resources: {'Port': ['ID=ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:39:59.868498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-2162be0d-58e0-4188-86f1-f9f7833846e2 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/address-scope returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:39:59.873729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36446) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:59.874278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2162be0d-58e0-4188-86f1-f9f7833846e2 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/address-scope HTTP/1.1" status: 200 len: 357 time: 0.0280676 May 12 15:39:59.905564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cbf462b6-153c-4279-b379-047c97c981f7 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:39:59.929685 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-3d6fae55-10f6-484b-9f7f-5be33e7c924e tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/router-admin-state-down-before-update returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:39:59.933550 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3d6fae55-10f6-484b-9f7f-5be33e7c924e tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/router-admin-state-down-before-update HTTP/1.1" status: 200 len: 506 time: 0.0587618 May 12 15:39:59.947694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36452) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:59.968314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-17cb659c-ef20-4485-b49e-cc046278315a tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/agent returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:39:59.970031 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-17cb659c-ef20-4485-b49e-cc046278315a tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/agent HTTP/1.1" status: 200 len: 347 time: 0.0165052 May 12 15:39:59.977670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36456) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:39:59.994373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-6c4cb907-8431-40b6-abc3-6e1973fe9aaa tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/agent-resources-synced returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:39:59.995653 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6c4cb907-8431-40b6-abc3-6e1973fe9aaa tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/agent-resources-synced HTTP/1.1" status: 200 len: 417 time: 0.0168021 May 12 15:40:00.114309 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port cbf462b6-153c-4279-b379-047c97c981f7 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:00.196742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36460) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:00.206559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-bca2c9bb-9820-4972-be3a-095a327d2a79 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/allowed-address-pairs returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:00.207903 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bca2c9bb-9820-4972-be3a-095a327d2a79 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/allowed-address-pairs HTTP/1.1" status: 200 len: 378 time: 0.0097194 May 12 15:40:00.211023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36468) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:00.220039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-793648bb-0d09-46c1-ab10-cba29006c8c7 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/auto-allocated-topology returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:00.221224 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-793648bb-0d09-46c1-ab10-cba29006c8c7 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/auto-allocated-topology HTTP/1.1" status: 200 len: 394 time: 0.0090809 May 12 15:40:00.225784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36472) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:00.233751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-9a612da9-fd86-4608-af0d-1f5a2e6edff0 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/availability_zone returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:00.235249 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9a612da9-fd86-4608-af0d-1f5a2e6edff0 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/availability_zone HTTP/1.1" status: 200 len: 372 time: 0.0083621 May 12 15:40:00.238374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36478) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:00.241187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb2b54d0-285e-42cb-a49f-85d99b3994a6 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:00.254341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-0220efdb-133b-4c7e-9bcb-dcf520a9e8f3 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/availability_zone_filter returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:00.255893 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0220efdb-133b-4c7e-9bcb-dcf520a9e8f3 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/availability_zone_filter HTTP/1.1" status: 200 len: 414 time: 0.0164733 May 12 15:40:00.324891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36482) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:00.365649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-f80277e5-c15c-4275-af33-5cedde31fadb tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/default-subnetpools returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:00.365649 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f80277e5-c15c-4275-af33-5cedde31fadb tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/default-subnetpools HTTP/1.1" status: 200 len: 405 time: 0.0314000 May 12 15:40:00.376669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36486) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:00.423309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-96aad47a-6993-4725-b318-ee300a8a338f tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/dhcp_agent_scheduler returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:00.424275 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-96aad47a-6993-4725-b318-ee300a8a338f tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/dhcp_agent_scheduler HTTP/1.1" status: 200 len: 381 time: 0.0466933 May 12 15:40:00.447165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36492) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:00.467879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-54ff00aa-f60d-4009-af83-586feb1ca8af tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/dvr returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:00.473689 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-54ff00aa-f60d-4009-af83-586feb1ca8af tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/dvr HTTP/1.1" status: 200 len: 387 time: 0.0277040 May 12 15:40:00.489996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36496) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:00.490243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36498) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:00.500654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65caf6d9-f9da-4017-839e-5d2692eaa156 None None] Network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:00.514805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-ea63b236-0653-421a-bcaf-a07333e08dc7 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/empty-string-filtering returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:00.518231 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ea63b236-0653-421a-bcaf-a07333e08dc7 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/empty-string-filtering HTTP/1.1" status: 200 len: 413 time: 0.0223744 May 12 15:40:00.523695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36504) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:00.694822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-bea9c040-1c56-4894-b0fb-f94c53a29e1d tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:00.696453 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-bea9c040-1c56-4894-b0fb-f94c53a29e1d tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.84 "GET /v2.0/networks?id=85cd1d66-57c4-4d94-b782-1d4cae810f95 HTTP/1.1" status: 200 len: 808 time: 0.1736844 May 12 15:40:00.701981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-c079fc2c-49c0-47c5-8644-22edd1b27f5f tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/external-net returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:00.702929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c079fc2c-49c0-47c5-8644-22edd1b27f5f tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/external-net HTTP/1.1" status: 200 len: 394 time: 0.1780744 May 12 15:40:00.705505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36516) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:00.751332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Request body: {'port': {'device_id': '3e24e01e-91e6-4ab8-aca2-78714b1cccb2', 'network_id': '85cd1d66-57c4-4d94-b782-1d4cae810f95', 'admin_state_up': True, 'tenant_id': 'f798fdc3e9c54b38b7dbb0478a1d31d6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:00.754939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fe9fc80e-f629-4e46-9f92-f10c0d58468e None None] Provisioning for port cbf462b6-153c-4279-b379-047c97c981f7 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:00.786345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-56d6da65-81aa-4550-b6ce-c564325ff605 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/extra_dhcp_opt returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:00.787579 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-56d6da65-81aa-4550-b6ce-c564325ff605 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/extra_dhcp_opt HTTP/1.1" status: 200 len: 498 time: 0.0812099 May 12 15:40:00.794391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36520) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:00.811545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-ae0e0573-611b-41b9-afb8-73566e942cbd tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/extraroute returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:00.837029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ae0e0573-611b-41b9-afb8-73566e942cbd tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/extraroute HTTP/1.1" status: 200 len: 375 time: 0.0383749 May 12 15:40:00.837029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36526) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:00.868950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-d22b5a4f-43af-476b-b9ac-142d12647117 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/extraroute-atomic returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:00.874413 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d22b5a4f-43af-476b-b9ac-142d12647117 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/extraroute-atomic HTTP/1.1" status: 200 len: 444 time: 0.0289416 May 12 15:40:00.875149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36530) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:00.940815 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aeed324e-f220-42a3-aac4-bf7330cd22f2 req-1e60a21a-6c57-4a2f-842b-bf182ef9c25b tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 210 time: 0.1942906 May 12 15:40:00.963606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fe9fc80e-f629-4e46-9f92-f10c0d58468e None None] Provisioning complete for port cbf462b6-153c-4279-b379-047c97c981f7 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:00.964125 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fe9fc80e-f629-4e46-9f92-f10c0d58468e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:01.014541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-49724137-e615-442f-83e2-836b79411850 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/filter-validation returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.017805 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-49724137-e615-442f-83e2-836b79411850 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/filter-validation HTTP/1.1" status: 200 len: 392 time: 0.0321929 May 12 15:40:01.022356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36536) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.033344 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bc4125d4-fbc6-4fd1-90d5-1b29faffbcdd admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:01.048965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-1ee5eef5-4ff7-407b-ad0f-72e0a5d261ff tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/fip-port-details returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.052292 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1ee5eef5-4ff7-407b-ad0f-72e0a5d261ff tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/fip-port-details HTTP/1.1" status: 200 len: 406 time: 0.0267150 May 12 15:40:01.054913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36540) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.064191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-f04df55d-183a-4521-8842-d77024518dea tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/flavors returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.068126 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f04df55d-183a-4521-8842-d77024518dea tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/flavors HTTP/1.1" status: 200 len: 387 time: 0.0075378 May 12 15:40:01.068919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bc4125d4-fbc6-4fd1-90d5-1b29faffbcdd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:01.070781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36544) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.131751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-75582b73-aac3-403d-96bb-f2bbfcbb5aae tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/floatingip-pools returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.133725 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-75582b73-aac3-403d-96bb-f2bbfcbb5aae tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/floatingip-pools HTTP/1.1" status: 200 len: 382 time: 0.0593412 May 12 15:40:01.134035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bc4125d4-fbc6-4fd1-90d5-1b29faffbcdd admin admin] Usage tracker for resource:security_group_rule and tenant:5ab4aa397c734421bfe12d8a7dd4457c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:01.144143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36550) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.147352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bc4125d4-fbc6-4fd1-90d5-1b29faffbcdd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:01.187740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-7f4a17fb-5afc-4fbf-bd72-db0ed4f21929 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/ip-substring-filtering returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.191772 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7f4a17fb-5afc-4fbf-bd72-db0ed4f21929 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/ip-substring-filtering HTTP/1.1" status: 200 len: 416 time: 0.0433352 May 12 15:40:01.199159 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36556) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.203561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bc4125d4-fbc6-4fd1-90d5-1b29faffbcdd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:01.230697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-5e21e4af-6b8e-4d66-a0dc-0a64e04e5bee tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/router returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.231209 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fe9fc80e-f629-4e46-9f92-f10c0d58468e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:01.234804 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5e21e4af-6b8e-4d66-a0dc-0a64e04e5bee tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/router HTTP/1.1" status: 200 len: 450 time: 0.0318918 May 12 15:40:01.240728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36560) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.287615 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-fe9fc80e-f629-4e46-9f92-f10c0d58468e None None] For port cbf462b6-153c-4279-b379-047c97c981f7, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cbf462b6-153c-4279-b379-047c97c981f7,segment=NetworkSegment(384c5e83-6775-4f29-a4c7-08c3d60e1de8),segment_id=384c5e83-6775-4f29-a4c7-08c3d60e1de8)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:01.293598 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fe9fc80e-f629-4e46-9f92-f10c0d58468e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:01.296450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-f2d91b91-8eb6-42d1-a84e-498dbf875ab4 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/ext-gw-mode returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.297672 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f2d91b91-8eb6-42d1-a84e-498dbf875ab4 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/ext-gw-mode HTTP/1.1" status: 200 len: 462 time: 0.0557275 May 12 15:40:01.305832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36564) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.316675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-3797f7cb-e337-4719-87e7-5584e8631ff5 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/l3-ha returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.317664 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3797f7cb-e337-4719-87e7-5584e8631ff5 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/l3-ha HTTP/1.1" status: 200 len: 360 time: 0.0108879 May 12 15:40:01.335930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36568) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.349755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-2a6cbecd-0439-417a-b280-5ff745e65284 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/l3-flavors returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.354941 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2a6cbecd-0439-417a-b280-5ff745e65284 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/l3-flavors HTTP/1.1" status: 200 len: 366 time: 0.0173762 May 12 15:40:01.359550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36572) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.363683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eb2b54d0-285e-42cb-a49f-85d99b3994a6 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router 697c0f4d-8153-41d1-a4dd-f0d86c14fd95 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:40:01.373098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-8f96f3b8-eeba-40f2-9b75-f4e2564ec910 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/l3-port-ip-change-not-allowed returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.378914 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8f96f3b8-eeba-40f2-9b75-f4e2564ec910 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/l3-port-ip-change-not-allowed HTTP/1.1" status: 200 len: 439 time: 0.0175643 May 12 15:40:01.382450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:01.384059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36576) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.394702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-42a7f98c-ccfa-413b-ac7f-3f6ae77d87f5 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/l3_agent_scheduler returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.397901 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:01.399186 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-42a7f98c-ccfa-413b-ac7f-3f6ae77d87f5 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/l3_agent_scheduler HTTP/1.1" status: 200 len: 374 time: 0.0139432 May 12 15:40:01.401299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36580) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.412493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Made reservation on behalf of f798fdc3e9c54b38b7dbb0478a1d31d6 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:01.414539 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-a69e7963-bc31-4dfb-aa78-06d79e4b4273 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/metering returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.418157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:01.419431 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a69e7963-bc31-4dfb-aa78-06d79e4b4273 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/metering HTTP/1.1" status: 200 len: 357 time: 0.0163097 May 12 15:40:01.447324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36584) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.463765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-585181de-1a7e-4add-8edc-3673f1bdf354 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/metering_source_and_destination_fields returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.464925 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-585181de-1a7e-4add-8edc-3673f1bdf354 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/metering_source_and_destination_fields HTTP/1.1" status: 200 len: 515 time: 0.0117919 May 12 15:40:01.497851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe9fc80e-f629-4e46-9f92-f10c0d58468e None None] Pushing event updated for resources: {'Port': ['ID=cbf462b6-153c-4279-b379-047c97c981f7,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:01.505342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36590) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.631267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-b9a5693a-6d22-43e1-be67-df832eb1fdf0 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/multi-provider returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.632278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b9a5693a-6d22-43e1-be67-df832eb1fdf0 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/multi-provider HTTP/1.1" status: 200 len: 406 time: 0.1209447 May 12 15:40:01.640378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:01.647363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36596) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.674391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-2c3f7644-1d29-4e5b-ad9a-420f160fb950 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/net-mtu returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.677932 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2c3f7644-1d29-4e5b-ad9a-420f160fb950 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/net-mtu HTTP/1.1" status: 200 len: 370 time: 0.0270550 May 12 15:40:01.683925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36602) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.692484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-d3bd755a-93f9-4e6b-8b33-22a33906ffaa tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/net-mtu-writable returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.695970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d3bd755a-93f9-4e6b-8b33-22a33906ffaa tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/net-mtu-writable HTTP/1.1" status: 200 len: 401 time: 0.0087616 May 12 15:40:01.699716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36606) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.713256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-d28eb1d9-8298-4e61-9d6f-a4bbe5d82dff tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/network_availability_zone returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.717824 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d28eb1d9-8298-4e61-9d6f-a4bbe5d82dff tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/network_availability_zone HTTP/1.1" status: 200 len: 394 time: 0.0115795 May 12 15:40:01.721199 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36610) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.732183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb2b54d0-285e-42cb-a49f-85d99b3994a6 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:40:01.744116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d79a96d7-6920-47a2-bc19-de7ecdb30cce None None] Provisioning complete for port cbf462b6-153c-4279-b379-047c97c981f7 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:01.744526 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d79a96d7-6920-47a2-bc19-de7ecdb30cce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:01.751209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-0d3a3067-a70e-4e65-a304-366b959bbb12 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/network-ip-availability returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.756277 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0d3a3067-a70e-4e65-a304-366b959bbb12 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/network-ip-availability HTTP/1.1" status: 200 len: 410 time: 0.0292318 May 12 15:40:01.761130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36614) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.785057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-03887931-9995-4cfa-a669-460e3942e75c tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/pagination returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.786156 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-03887931-9995-4cfa-a669-460e3942e75c tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/pagination HTTP/1.1" status: 200 len: 386 time: 0.0198863 May 12 15:40:01.796663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36618) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.833476 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bc4125d4-fbc6-4fd1-90d5-1b29faffbcdd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:01.840394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-8a8b588b-0bea-4184-b09e-5d461108acfd tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/port-device-profile returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.841275 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8a8b588b-0bea-4184-b09e-5d461108acfd tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/port-device-profile HTTP/1.1" status: 200 len: 383 time: 0.0353920 May 12 15:40:01.841868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36622) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.849594 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b82afe7b-d19d-4a3b-9e33-208659438c96 None None] Sync routers for ids ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:40:01.850013 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-eb2b54d0-285e-42cb-a49f-85d99b3994a6 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "PUT /v2.0/routers/697c0f4d-8153-41d1-a4dd-f0d86c14fd95/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.1599159 May 12 15:40:01.850648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36624) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.856144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bc4125d4-fbc6-4fd1-90d5-1b29faffbcdd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:01.857311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cbf462b6-153c-4279-b379-047c97c981f7 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:01.874716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-63c6a7ad-09e8-4747-bc9d-5656834175dc tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/port-mac-address-regenerate returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:01.875666 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-63c6a7ad-09e8-4747-bc9d-5656834175dc tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/port-mac-address-regenerate HTTP/1.1" status: 200 len: 403 time: 0.0234702 May 12 15:40:01.880750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36630) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:01.912637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b82afe7b-d19d-4a3b-9e33-208659438c96 None None] Routers {'697c0f4d-8153-41d1-a4dd-f0d86c14fd95'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:40:01.913561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b82afe7b-d19d-4a3b-9e33-208659438c96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:01.943165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc4125d4-fbc6-4fd1-90d5-1b29faffbcdd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a96a552c-5901-4214-b2b8-40dc88938580,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:01.971043 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bc4125d4-fbc6-4fd1-90d5-1b29faffbcdd admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5ab4aa397c734421bfe12d8a7dd4457c&name=default HTTP/1.1" status: 200 len: 2983 time: 1.4759526 May 12 15:40:01.971838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36638) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.023458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b82afe7b-d19d-4a3b-9e33-208659438c96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:02.046362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-4d43ef47-be9a-4de4-aac3-51fab7d1a98f tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/port-numa-affinity-policy returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.048489 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4d43ef47-be9a-4de4-aac3-51fab7d1a98f tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/port-numa-affinity-policy HTTP/1.1" status: 200 len: 392 time: 0.0509677 May 12 15:40:02.062654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b82afe7b-d19d-4a3b-9e33-208659438c96 None None] Routers {'697c0f4d-8153-41d1-a4dd-f0d86c14fd95'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:40:02.063478 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b82afe7b-d19d-4a3b-9e33-208659438c96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:02.078370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36646) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.079353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c1c201ed-c515-48da-91a4-da8529cff77d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:02.087999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Allocated IP 172.20.0.12 (85cd1d66-57c4-4d94-b782-1d4cae810f95/3c282c52-5b3b-474f-b33b-26979e8a2384/87fec19b-446c-4edb-905b-6c36fbfa250f) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:40:02.129309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-21d1c87a-8707-4ea9-8ca1-ac89b065aab9 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/binding returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.131322 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-21d1c87a-8707-4ea9-8ca1-ac89b065aab9 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/binding HTTP/1.1" status: 200 len: 387 time: 0.0457289 May 12 15:40:02.134723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36650) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.168600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b82afe7b-d19d-4a3b-9e33-208659438c96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:02.171206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b82afe7b-d19d-4a3b-9e33-208659438c96 None None] The sync data for ids ['697c0f4d-8153-41d1-a4dd-f0d86c14fd95'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:40:02.181358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-487cf0ea-d0db-40b2-b8b6-765c70b9a3cf tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/binding-extended returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.182774 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-487cf0ea-d0db-40b2-b8b6-765c70b9a3cf tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/binding-extended HTTP/1.1" status: 200 len: 406 time: 0.0399897 May 12 15:40:02.186670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36656) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.195509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-c7bad4a3-9000-4fc5-bef2-c3ee4d86c607 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/port-security returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.196825 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port cbf462b6-153c-4279-b379-047c97c981f7 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:02.197134 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c7bad4a3-9000-4fc5-bef2-c3ee4d86c607 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/port-security HTTP/1.1" status: 200 len: 354 time: 0.0089843 May 12 15:40:02.197242 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:02.199583 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c1c201ed-c515-48da-91a4-da8529cff77d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:02.207769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36660) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.215265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-93d22f8b-db7c-4a5a-a85c-29ea9ebc2de4 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/project-id returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.216688 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-93d22f8b-db7c-4a5a-a85c-29ea9ebc2de4 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/project-id HTTP/1.1" status: 200 len: 398 time: 0.0075204 May 12 15:40:02.219232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36664) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.231029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-9bcd7f74-b314-4701-b66f-2bfcbc22b46a tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/provider returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.232334 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9bcd7f74-b314-4701-b66f-2bfcbc22b46a tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/provider HTTP/1.1" status: 200 len: 385 time: 0.0120366 May 12 15:40:02.236536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36668) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.286271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-a655095c-3769-4a2b-9905-7f4a8c98858a tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/quotas returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.288308 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a655095c-3769-4a2b-9905-7f4a8c98858a tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/quotas HTTP/1.1" status: 200 len: 385 time: 0.0489483 May 12 15:40:02.302160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36672) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.314896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-0ebb6378-f178-4890-a228-5d989e07abe5 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/quota_details returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.317900 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0ebb6378-f178-4890-a228-5d989e07abe5 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/quota_details HTTP/1.1" status: 200 len: 407 time: 0.0134006 May 12 15:40:02.321835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36678) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.336181 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-8512d5c6-44a3-46c2-8829-68f8a51347a0 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/rbac-policies returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.338993 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8512d5c6-44a3-46c2-8829-68f8a51347a0 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/rbac-policies HTTP/1.1" status: 200 len: 417 time: 0.0148430 May 12 15:40:02.342577 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36682) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.353274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-5bf90780-30b6-4a91-9426-bacc1bfa77c2 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/rbac-address-group returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.358881 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5bf90780-30b6-4a91-9426-bacc1bfa77c2 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/rbac-address-group HTTP/1.1" status: 200 len: 392 time: 0.0107481 May 12 15:40:02.361033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36686) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.377892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-1750184c-d711-4b01-ba52-5aa1ab49da1c tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/rbac-address-scope returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.382125 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1750184c-d711-4b01-ba52-5aa1ab49da1c tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/rbac-address-scope HTTP/1.1" status: 200 len: 384 time: 0.0173316 May 12 15:40:02.382955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36692) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.392303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-eba72a7b-4702-49f6-af2c-654a612a95be tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/rbac-security-groups returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.397818 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-eba72a7b-4702-49f6-af2c-654a612a95be tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/rbac-security-groups HTTP/1.1" status: 200 len: 404 time: 0.0136423 May 12 15:40:02.398715 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c1c201ed-c515-48da-91a4-da8529cff77d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:02.407811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36696) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.462336 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:02.509352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-2664d0ac-40cb-4e06-b3db-1c4f392c97c8 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/rbac-subnetpool returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.513130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36704) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.513286 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2664d0ac-40cb-4e06-b3db-1c4f392c97c8 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/rbac-subnetpool HTTP/1.1" status: 200 len: 375 time: 0.0736811 May 12 15:40:02.519085 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c1e4af40-be30-460a-a3d7-fc462613e1db req-70aeb68f-8412-42a3-9255-1c3364ec155b service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.2285860 May 12 15:40:02.526911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c201ed-c515-48da-91a4-da8529cff77d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a96a552c-5901-4214-b2b8-40dc88938580,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:02.532872 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c1c201ed-c515-48da-91a4-da8529cff77d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:02.533991 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c1c201ed-c515-48da-91a4-da8529cff77d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a96a552c-5901-4214-b2b8-40dc88938580 HTTP/1.1" status: 204 len: 168 time: 0.5609891 May 12 15:40:02.561256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36712) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.561980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-4cd83fb8-7a1f-4d16-b9d1-9ae57eece722 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/revision-if-match returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.566693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4cd83fb8-7a1f-4d16-b9d1-9ae57eece722 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/revision-if-match HTTP/1.1" status: 200 len: 441 time: 0.0334134 May 12 15:40:02.575784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36714) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.598558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-d974055b-f78b-42b4-9f3b-e99d0e26d739 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/standard-attr-revisions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.603986 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d974055b-f78b-42b4-9f3b-e99d0e26d739 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/standard-attr-revisions HTTP/1.1" status: 200 len: 423 time: 0.0135674 May 12 15:40:02.608088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36722) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.734234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-f014d270-ddc8-4d9c-a2bd-7b76cbfb7ba1 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/router_availability_zone returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.740304 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f014d270-ddc8-4d9c-a2bd-7b76cbfb7ba1 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/router_availability_zone HTTP/1.1" status: 200 len: 391 time: 0.1301823 May 12 15:40:02.761425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36726) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.802939 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c1e4af40-be30-460a-a3d7-fc462613e1db req-60356de7-1014-4580-a448-50bcb349ba91 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.1962488 May 12 15:40:02.811198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-d774d445-30f7-4529-9062-71b3baea36f6 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/security-groups-normalized-cidr returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.815063 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d774d445-30f7-4529-9062-71b3baea36f6 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/security-groups-normalized-cidr HTTP/1.1" status: 200 len: 445 time: 0.0525260 May 12 15:40:02.816788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36732) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.823829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-0162fed1-b724-4c09-90d1-95a0a1539c57 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/port-security-groups-filtering returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:02.827687 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0162fed1-b724-4c09-90d1-95a0a1539c57 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/port-security-groups-filtering HTTP/1.1" status: 200 len: 422 time: 0.0080416 May 12 15:40:02.829048 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-37877946-9e27-41cb-8303-55e7da7a689b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:02.843846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36736) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:02.899814 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e262e320-00cf-46ed-929d-80507737f3df req-c40e6d37-cbc8-40a7-b9a1-40d833427ce6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 210 time: 0.5612218 May 12 15:40:03.015389 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-b203bb94-c27d-4066-a425-ed0643fa5dad tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/security-groups-remote-address-group returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:03.020136 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b203bb94-c27d-4066-a425-ed0643fa5dad tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/security-groups-remote-address-group HTTP/1.1" status: 200 len: 448 time: 0.1734018 May 12 15:40:03.051174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36744) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:03.056094 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c1e4af40-be30-460a-a3d7-fc462613e1db req-d98eb820-79e4-4fba-81cd-9131acc941dd service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.2132349 May 12 15:40:03.057225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-37877946-9e27-41cb-8303-55e7da7a689b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:03.063501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-ffc08077-0b58-470e-905e-ee4ca8542777 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/security-group returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:03.067029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ffc08077-0b58-470e-905e-ee4ca8542777 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/security-group HTTP/1.1" status: 200 len: 364 time: 0.0123444 May 12 15:40:03.071454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36748) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:03.109696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-82edb168-c8d4-4815-b264-89b546178d7a tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/service-type returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:03.113875 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-82edb168-c8d4-4815-b264-89b546178d7a tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/service-type HTTP/1.1" status: 200 len: 415 time: 0.0360181 May 12 15:40:03.121632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36752) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:03.133600 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:03.188275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36754) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:03.191370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-498376d0-074e-4e77-bfeb-e42f46cd4180 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/sorting returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:03.192621 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-498376d0-074e-4e77-bfeb-e42f46cd4180 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/sorting HTTP/1.1" status: 200 len: 377 time: 0.0655956 May 12 15:40:03.200479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36760) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:03.201694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-37877946-9e27-41cb-8303-55e7da7a689b admin admin] Usage tracker for resource:security_group_rule and tenant:ade859a9aa7447bb958d2c11e10e490e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:03.235995 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-776f7d91-3df1-45b8-b8a0-dc2f14c84c3c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:03.246022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-37877946-9e27-41cb-8303-55e7da7a689b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:03.255849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-37877946-9e27-41cb-8303-55e7da7a689b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:03.287353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1e4af40-be30-460a-a3d7-fc462613e1db req-e5c786f5-ec5c-4f63-8ace-32f484abef69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:03.290108 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c1e4af40-be30-460a-a3d7-fc462613e1db req-e5c786f5-ec5c-4f63-8ace-32f484abef69 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2245634 May 12 15:40:03.317055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-776f7d91-3df1-45b8-b8a0-dc2f14c84c3c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:03.326200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-776f7d91-3df1-45b8-b8a0-dc2f14c84c3c admin admin] Usage tracker for resource:security_group_rule and tenant:7808fd525c924a7eaa446bda4d68db9f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:03.329731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-776f7d91-3df1-45b8-b8a0-dc2f14c84c3c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:03.335573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-cbe82e43-31b3-442e-885b-8600bdcd861f tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/standard-attr-description returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:03.336643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cbe82e43-31b3-442e-885b-8600bdcd861f tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/standard-attr-description HTTP/1.1" status: 200 len: 408 time: 0.0850356 May 12 15:40:03.337658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-776f7d91-3df1-45b8-b8a0-dc2f14c84c3c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:03.372090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36768) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:03.397078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-8bf8b19f-1d83-41a4-80a4-50088ddac5e2 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/stateful-security-group returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:03.397078 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8bf8b19f-1d83-41a4-80a4-50088ddac5e2 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/stateful-security-group HTTP/1.1" status: 200 len: 402 time: 0.0225928 May 12 15:40:03.400275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36772) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:03.423291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-1f261d49-23b9-4c16-97cc-f4d15e3825a4 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/subnet_onboard returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:03.424568 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1f261d49-23b9-4c16-97cc-f4d15e3825a4 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/subnet_onboard HTTP/1.1" status: 200 len: 391 time: 0.0204852 May 12 15:40:03.427872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36776) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:03.499615 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-776f7d91-3df1-45b8-b8a0-dc2f14c84c3c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:03.502501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-561e7110-3fbd-4313-a5f6-9f0335254744 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/subnet-service-types returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:03.503535 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-561e7110-3fbd-4313-a5f6-9f0335254744 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/subnet-service-types HTTP/1.1" status: 200 len: 400 time: 0.0638504 May 12 15:40:03.509881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36780) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:03.517664 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-776f7d91-3df1-45b8-b8a0-dc2f14c84c3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:03.528641 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:03.542817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-4dd2ee95-11d9-4941-9bb7-467e17c6a98b tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/subnet_allocation returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:03.546443 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4dd2ee95-11d9-4941-9bb7-467e17c6a98b tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/subnet_allocation HTTP/1.1" status: 200 len: 388 time: 0.0297797 May 12 15:40:03.547759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36784) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:03.610000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-776f7d91-3df1-45b8-b8a0-dc2f14c84c3c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=849b92ac-9e6e-4d57-90ab-f4f33c47c09d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:03.618251 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-776f7d91-3df1-45b8-b8a0-dc2f14c84c3c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7808fd525c924a7eaa446bda4d68db9f&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4289105 May 12 15:40:03.620938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-37877946-9e27-41cb-8303-55e7da7a689b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:03.621777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36792) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:03.635598 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-37877946-9e27-41cb-8303-55e7da7a689b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:03.665070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-33b3f4b7-c80e-4bc9-9a21-e31f82d1cfdd tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/subnetpool-prefix-ops returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:03.666485 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-33b3f4b7-c80e-4bc9-9a21-e31f82d1cfdd tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/subnetpool-prefix-ops HTTP/1.1" status: 200 len: 418 time: 0.1142681 May 12 15:40:03.669685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36798) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:03.683968 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:03.693280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [None req-97ceaa0d-194a-4753-9d2b-8c16a46b9157 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/standard-attr-tag returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:03.694302 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-97ceaa0d-194a-4753-9d2b-8c16a46b9157 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/standard-attr-tag HTTP/1.1" status: 200 len: 537 time: 0.0196476 May 12 15:40:03.700274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36802) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:03.724530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [None req-0400e85e-b986-40fe-9566-d2e1406988b6 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] http://10.222.0.82:9696/v2.0/extensions/standard-attr-timestamp returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:40:03.729192 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0400e85e-b986-40fe-9566-d2e1406988b6 tempest-ExtensionsTestJSON-1691242490 tempest-ExtensionsTestJSON-1691242490-project] 10.222.0.82 "GET /v2.0/extensions/standard-attr-timestamp HTTP/1.1" status: 200 len: 449 time: 0.0196626 May 12 15:40:03.733630 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-37877946-9e27-41cb-8303-55e7da7a689b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ade859a9aa7447bb958d2c11e10e490e&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1690018 May 12 15:40:03.735071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37877946-9e27-41cb-8303-55e7da7a689b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f1e6e38-d63e-4dec-8251-960e43c7f1cc,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:03.739062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36806) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:03.772269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c166762-1c47-4c8f-9dfc-5b71067d8055 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:03.803412 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:03.825279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c166762-1c47-4c8f-9dfc-5b71067d8055 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:03.829868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port e475ae99-4cf4-40c9-bf47-bbb94f3c8f3a {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:03.830205 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:03.883553 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b9f77cb8-9d5c-43ba-84b8-8a85ef83dd54 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:03.945767 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:03.948516 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b9f77cb8-9d5c-43ba-84b8-8a85ef83dd54 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:04.035976 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c166762-1c47-4c8f-9dfc-5b71067d8055 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:04.084783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Router 90b1ce02-50a9-42ff-913c-e1db00f64560 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:40:04.088029 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b9f77cb8-9d5c-43ba-84b8-8a85ef83dd54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:04.098619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c166762-1c47-4c8f-9dfc-5b71067d8055 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=849b92ac-9e6e-4d57-90ab-f4f33c47c09d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:04.132613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9f77cb8-9d5c-43ba-84b8-8a85ef83dd54 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f1e6e38-d63e-4dec-8251-960e43c7f1cc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:04.170185 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b9f77cb8-9d5c-43ba-84b8-8a85ef83dd54 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:04.172130 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b9f77cb8-9d5c-43ba-84b8-8a85ef83dd54 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3f1e6e38-d63e-4dec-8251-960e43c7f1cc HTTP/1.1" status: 204 len: 168 time: 0.4301353 May 12 15:40:04.184832 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c166762-1c47-4c8f-9dfc-5b71067d8055 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:04.191329 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8c166762-1c47-4c8f-9dfc-5b71067d8055 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/849b92ac-9e6e-4d57-90ab-f4f33c47c09d HTTP/1.1" status: 204 len: 168 time: 0.5677617 May 12 15:40:04.200162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Network 85cd1d66-57c4-4d94-b782-1d4cae810f95 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:04.220777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36824) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:04.233324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:04.244370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:40:04.327239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Pushing event updated for resources: {'Port': ['ID=87fec19b-446c-4edb-905b-6c36fbfa250f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:04.417808 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:04.498493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:04.499311 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:04.644405 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46bfc8c9-8ff2-4518-b1bb-d71489bbeb5a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:04.664173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-46bfc8c9-8ff2-4518-b1bb-d71489bbeb5a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:04.671654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-46bfc8c9-8ff2-4518-b1bb-d71489bbeb5a admin admin] Usage tracker for resource:security_group_rule and tenant:b106eda80e3a40d5ba236f86f0c25fb2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:04.680899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-46bfc8c9-8ff2-4518-b1bb-d71489bbeb5a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:04.693500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-46bfc8c9-8ff2-4518-b1bb-d71489bbeb5a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:04.828867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36852) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:04.868086 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69f96870-950a-450c-b446-87ec61abb1a6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:04.882185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for e475ae99-4cf4-40c9-bf47-bbb94f3c8f3a owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:04.897917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-69f96870-950a-450c-b446-87ec61abb1a6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:04.902997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-69f96870-950a-450c-b446-87ec61abb1a6 admin admin] Usage tracker for resource:security_group_rule and tenant:f74f99fd241d4dd28e77c8cbfc71042c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:04.907631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-69f96870-950a-450c-b446-87ec61abb1a6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:04.918283 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-69f96870-950a-450c-b446-87ec61abb1a6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:04.929722 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46bfc8c9-8ff2-4518-b1bb-d71489bbeb5a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:04.935547 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46bfc8c9-8ff2-4518-b1bb-d71489bbeb5a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:04.959690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:40:04.969466 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Sync routers for ids ['90b1ce02-50a9-42ff-913c-e1db00f64560'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:40:04.985151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05c1ae8-f062-454e-baee-cb27038ef9d2 req-45d60b2f-9f10-4509-82c4-ac91f2508cee tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:04.986530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b05c1ae8-f062-454e-baee-cb27038ef9d2 req-45d60b2f-9f10-4509-82c4-ac91f2508cee tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Synchronizing usage tracker for tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:40:04.986852 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Routers {'90b1ce02-50a9-42ff-913c-e1db00f64560'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:40:04.991639 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-22461785-c55e-4dbd-a93d-400190601379 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['90b1ce02-50a9-42ff-913c-e1db00f64560'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:04.991847 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-46bfc8c9-8ff2-4518-b1bb-d71489bbeb5a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b106eda80e3a40d5ba236f86f0c25fb2&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7677364 May 12 15:40:04.995735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36858) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:05.029378 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-520c60a0-1d2e-4f5a-9304-059e64a4f934 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 4.2845581 May 12 15:40:05.070423 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Request body: {'port': {'device_id': '3e24e01e-91e6-4ab8-aca2-78714b1cccb2', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:05.115732 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69f96870-950a-450c-b446-87ec61abb1a6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:05.127675 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69f96870-950a-450c-b446-87ec61abb1a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:05.131748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b05c1ae8-f062-454e-baee-cb27038ef9d2 req-45d60b2f-9f10-4509-82c4-ac91f2508cee tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Unset dirty status for tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:40:05.133436 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b05c1ae8-f062-454e-baee-cb27038ef9d2 req-45d60b2f-9f10-4509-82c4-ac91f2508cee tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 932 time: 0.9669302 May 12 15:40:05.165759 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:05.167063 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7e7f1471-cb75-4eca-9b15-9f11fd1c0cba admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 9.2502091 May 12 15:40:05.186800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 36868) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:05.270827 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-69f96870-950a-450c-b446-87ec61abb1a6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f74f99fd241d4dd28e77c8cbfc71042c&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4404891 May 12 15:40:05.278475 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46bfc8c9-8ff2-4518-b1bb-d71489bbeb5a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c89571b1-6662-43f3-bc6e-59880f9c9b67,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:05.284007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36874) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:05.339806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b05c1ae8-f062-454e-baee-cb27038ef9d2 req-60784e94-a729-452a-83d5-6505a295dda8 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1752408 May 12 15:40:05.348914 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Set router 90b1ce02-50a9-42ff-913c-e1db00f64560 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:40:05.374830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69f96870-950a-450c-b446-87ec61abb1a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d0d6fc9-db4d-46b7-adc1-893d5c6973f6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:05.618613 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:05.715219 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-22461785-c55e-4dbd-a93d-400190601379 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:00Z', 'revision_number': 3, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:39:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:05.719103 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Checking router: 90b1ce02-50a9-42ff-913c-e1db00f64560 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:40:05.719434 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Updating router 90b1ce02-50a9-42ff-913c-e1db00f64560 port ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:40:05.787678 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:05.818818 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f94ea055-d5fe-40bc-b161-46bcbc356dfa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:05.889070 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f94ea055-d5fe-40bc-b161-46bcbc356dfa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:05.898812 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:05.915963 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:06.020178 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:06.108648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Port': ['ID=e475ae99-4cf4-40c9-bf47-bbb94f3c8f3a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:06.154913 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:06.244352 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:06.450565 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:06.569366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Allocated IP 172.20.0.1 (8fe69ccc-2df6-4e6d-ad35-1b9439b8eade/5b4ef35a-b116-4246-86c9-ff3a7aad3410/0330d6b4-dcca-428b-884e-6ad77426f8da) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:40:06.742444 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:06.748611 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:06.761631 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f94ea055-d5fe-40bc-b161-46bcbc356dfa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:06.777649 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:06.790025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f94ea055-d5fe-40bc-b161-46bcbc356dfa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d0d6fc9-db4d-46b7-adc1-893d5c6973f6,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:06.799053 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Transition to ACTIVE for port object ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:06.815901 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:06.818565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Transition to ACTIVE for port object 0330d6b4-dcca-428b-884e-6ad77426f8da will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:06.834083 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:06.860386 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:06.895222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c89571b1-6662-43f3-bc6e-59880f9c9b67,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:06.947926 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:06.948418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Fanout notify agent at l3_agent the message router_deleted on router 697c0f4d-8153-41d1-a4dd-f0d86c14fd95 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:40:06.983836 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:06.988685 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-631f6379-5d7d-45e0-a2f0-e1b35c68a7f2 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/routers/697c0f4d-8153-41d1-a4dd-f0d86c14fd95 HTTP/1.1" status: 204 len: 168 time: 5.1298943 May 12 15:40:06.990775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:06.991258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:06.991733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:06.992204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:06.992697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:06.992953 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Attempting to bind port ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:40:06.993321 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Attempting to bind port ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:40:06.993580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:06.993743 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Attempting to bind port ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:40:06.994193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:06.994810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:06.995271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:06.996038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:06.996590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:06.997124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:06.999661 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd92b480-0ea5-4613-ad51-da64a9b5af97 None None] Pushing event updated for resources: {'Port': ['ID=ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:07.001243 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f94ea055-d5fe-40bc-b161-46bcbc356dfa admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:07.002651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f94ea055-d5fe-40bc-b161-46bcbc356dfa admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7d0d6fc9-db4d-46b7-adc1-893d5c6973f6 HTTP/1.1" status: 204 len: 168 time: 1.7171779 May 12 15:40:07.004211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 36926) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:07.005411 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 39, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:40:07.005979 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:07.022280 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:07.022910 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:40:07.023676 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Bound port: ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:40:07.024405 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:07.055980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:07.068163 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:07.079430 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:07.083911 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a7de17a4-5fb2-4418-ac3f-dfccbf74c28f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c89571b1-6662-43f3-bc6e-59880f9c9b67 HTTP/1.1" status: 204 len: 168 time: 2.0839829 May 12 15:40:07.088213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:40:07.113935 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd92b480-0ea5-4613-ad51-da64a9b5af97 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:07.114375 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd92b480-0ea5-4613-ad51-da64a9b5af97 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:07.114713 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd92b480-0ea5-4613-ad51-da64a9b5af97 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:07.115046 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd92b480-0ea5-4613-ad51-da64a9b5af97 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:07.115375 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd92b480-0ea5-4613-ad51-da64a9b5af97 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:07.115699 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd92b480-0ea5-4613-ad51-da64a9b5af97 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:07.116020 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd92b480-0ea5-4613-ad51-da64a9b5af97 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:07.116338 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd92b480-0ea5-4613-ad51-da64a9b5af97 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:07.116655 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd92b480-0ea5-4613-ad51-da64a9b5af97 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:07.125409 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd92b480-0ea5-4613-ad51-da64a9b5af97 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:07.126329 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd92b480-0ea5-4613-ad51-da64a9b5af97 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:07.126329 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd92b480-0ea5-4613-ad51-da64a9b5af97 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:07.139467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-470ff581-2218-436c-bd48-fe3e6eae6d5f req-986457fd-0316-4590-b46d-f9a345935f6e tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:07.148332 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-470ff581-2218-436c-bd48-fe3e6eae6d5f req-986457fd-0316-4590-b46d-f9a345935f6e tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 932 time: 0.5463045 May 12 15:40:07.192506 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:07.224505 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-22461785-c55e-4dbd-a93d-400190601379 None None] For port ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:40:07.228695 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-22461785-c55e-4dbd-a93d-400190601379 None None] For port ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:40:07.235980 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:07.252641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-9c64548a-3a1d-4702-bf4c-295a82fa995a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting subnet 93f4665b-d6a8-4147-b1d7-7358a9b0558e {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:40:07.293440 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c64548a-3a1d-4702-bf4c-295a82fa995a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:07.336096 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Routers {'90b1ce02-50a9-42ff-913c-e1db00f64560'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:40:07.337016 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-22461785-c55e-4dbd-a93d-400190601379 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['90b1ce02-50a9-42ff-913c-e1db00f64560'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:07.451751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Pushing event updated for resources: {'Port': ['ID=0330d6b4-dcca-428b-884e-6ad77426f8da,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:07.546555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0c6b562c-88b2-4db3-8854-8029a3f704b1 None None] Provisioning for port 0330d6b4-dcca-428b-884e-6ad77426f8da completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:07.553046 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-470ff581-2218-436c-bd48-fe3e6eae6d5f req-e1685029-90b3-4955-92ce-491334afe4f6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4014866 May 12 15:40:07.558921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0c6b562c-88b2-4db3-8854-8029a3f704b1 None None] Provisioning complete for port 0330d6b4-dcca-428b-884e-6ad77426f8da triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:07.560784 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0c6b562c-88b2-4db3-8854-8029a3f704b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:07.588369 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:40:07.611666 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c64548a-3a1d-4702-bf4c-295a82fa995a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:07.771438 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0c6b562c-88b2-4db3-8854-8029a3f704b1 None None] Port 0330d6b4-dcca-428b-884e-6ad77426f8da cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:40:07.787945 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:07.900512 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd92b480-0ea5-4613-ad51-da64a9b5af97 None None] Pushing event updated for resources: {'Port': ['ID=ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:07.991894 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-22461785-c55e-4dbd-a93d-400190601379 None None] Set router 90b1ce02-50a9-42ff-913c-e1db00f64560 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:40:08.250968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 87fec19b-446c-4edb-905b-6c36fbfa250f {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:40:08.284357 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:08.352465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Transition to ACTIVE for port object 87fec19b-446c-4edb-905b-6c36fbfa250f will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:08.360859 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:08.476252 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c64548a-3a1d-4702-bf4c-295a82fa995a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:08.477311 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:08.487233 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:08.592431 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-22461785-c55e-4dbd-a93d-400190601379 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:00Z', 'revision_number': 3, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:08.601437 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22461785-c55e-4dbd-a93d-400190601379 None None] The sync data for ids ['90b1ce02-50a9-42ff-913c-e1db00f64560'] in n-d-841483-1 is: [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:00Z', 'revision_number': 3, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:40:08.753990 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:08.906318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Pushing event updated for resources: {'Port': ['ID=0330d6b4-dcca-428b-884e-6ad77426f8da,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:08.927478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Pushing event updated for resources: {'Port': ['ID=87fec19b-446c-4edb-905b-6c36fbfa250f,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:09.111684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c64548a-3a1d-4702-bf4c-295a82fa995a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:09.217225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:09.223806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:09.263573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c64548a-3a1d-4702-bf4c-295a82fa995a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Subnet': ['ID=93f4665b-d6a8-4147-b1d7-7358a9b0558e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:09.297330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37024) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:09.308069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c73e4c2-0d98-4371-8221-8f1aca17bac1 None None] Network b0419c0f-ed69-45c1-aa89-5514f9462b46 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:09.341927 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9c64548a-3a1d-4702-bf4c-295a82fa995a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:09.396524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18065757-5427-4ab0-9f2a-66b784dbe851 req-dee6ef2e-5216-4e82-ab5f-5bbac55f1246 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:09.417184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18065757-5427-4ab0-9f2a-66b784dbe851 req-dee6ef2e-5216-4e82-ab5f-5bbac55f1246 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 944 time: 0.5793855 May 12 15:40:09.426552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Attempting to bind port 87fec19b-446c-4edb-905b-6c36fbfa250f on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:40:09.432873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Attempting to bind port 87fec19b-446c-4edb-905b-6c36fbfa250f by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '09c83b83-4d53-47f0-b181-c0fb6ed7f95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '85cd1d66-57c4-4d94-b782-1d4cae810f95'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:40:09.433945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Attempting to bind port 87fec19b-446c-4edb-905b-6c36fbfa250f on network 85cd1d66-57c4-4d94-b782-1d4cae810f95 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:40:09.476830 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9c64548a-3a1d-4702-bf4c-295a82fa995a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/subnets/93f4665b-d6a8-4147-b1d7-7358a9b0558e HTTP/1.1" status: 204 len: 168 time: 2.4670019 May 12 15:40:09.478054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37030) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:09.497759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Port 87fec19b-446c-4edb-905b-6c36fbfa250f on network 85cd1d66-57c4-4d94-b782-1d4cae810f95 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:40:09.499766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Attempting to bind port 87fec19b-446c-4edb-905b-6c36fbfa250f on network 85cd1d66-57c4-4d94-b782-1d4cae810f95 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:40:09.544487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 39, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:40:09.548626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Checking segment: {'id': '09c83b83-4d53-47f0-b181-c0fb6ed7f95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '85cd1d66-57c4-4d94-b782-1d4cae810f95'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:09.551247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Bound using segment: {'id': '09c83b83-4d53-47f0-b181-c0fb6ed7f95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '85cd1d66-57c4-4d94-b782-1d4cae810f95'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:40:09.552720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Bound port: 87fec19b-446c-4edb-905b-6c36fbfa250f, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '09c83b83-4d53-47f0-b181-c0fb6ed7f95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 597, 'network_id': '85cd1d66-57c4-4d94-b782-1d4cae810f95'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:40:09.553271 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:09.720757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-40c09dd1-0e96-4c3d-85ed-5e7e2895496a None None] Provisioning complete for port 0330d6b4-dcca-428b-884e-6ad77426f8da triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:09.721136 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-40c09dd1-0e96-4c3d-85ed-5e7e2895496a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:09.768122 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18065757-5427-4ab0-9f2a-66b784dbe851 req-7e09c1a2-fd0c-4e18-bd4a-6d5cf3e22a38 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3485556 May 12 15:40:09.833887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-40c09dd1-0e96-4c3d-85ed-5e7e2895496a None None] Port 0330d6b4-dcca-428b-884e-6ad77426f8da cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:40:09.882454 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:09.905208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91948d87-e728-43ed-86b5-56a3f88bfc90 None None] DHCP port deletion for b0419c0f-ed69-45c1-aa89-5514f9462b46 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:40:09.911993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-91948d87-e728-43ed-86b5-56a3f88bfc90 None None] Deleting port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:09.912590 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-91948d87-e728-43ed-86b5-56a3f88bfc90 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:09.960818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] For port 87fec19b-446c-4edb-905b-6c36fbfa250f, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:40:09.981665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] For port 87fec19b-446c-4edb-905b-6c36fbfa250f, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=87fec19b-446c-4edb-905b-6c36fbfa250f,segment=NetworkSegment(09c83b83-4d53-47f0-b181-c0fb6ed7f95d),segment_id=09c83b83-4d53-47f0-b181-c0fb6ed7f95d)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:40:09.994043 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:10.035756 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:10.215006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:10.215798 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:10.237296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] 10.222.0.84 "PUT /v2.0/ports/87fec19b-446c-4edb-905b-6c36fbfa250f HTTP/1.1" status: 200 len: 1092 time: 5.1638570 May 12 15:40:10.345612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3e24e01e-91e6-4ab8-aca2-78714b1cccb2', 'tag': '87fec19b-446c-4edb-905b-6c36fbfa250f'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:40:10.355311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a44f05f-1b6f-4610-bfd5-b0df6935a6f4 service neutron] Pushing event updated for resources: {'Port': ['ID=87fec19b-446c-4edb-905b-6c36fbfa250f,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:10.385723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-test-network-371785169'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:10.490065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:10.490065 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:10.537036 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:10.550999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:10.551638 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:10.576670 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d6f912ed-f00b-46b2-a3a8-a1683f47467a'] response: {'name': 'network-changed', 'server_uuid': '3e24e01e-91e6-4ab8-aca2-78714b1cccb2', 'tag': '87fec19b-446c-4edb-905b-6c36fbfa250f', 'status': 'completed', 'code': 200} May 12 15:40:10.577961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:10.584606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Usage tracker for resource:network and tenant:b5b6bed7c5384a038d2067fd4f6b3819 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:10.604207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:10.615305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:10.639165 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Made reservation on behalf of b5b6bed7c5384a038d2067fd4f6b3819 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:10.650135 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:10.687612 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:10.710228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Router 90b1ce02-50a9-42ff-913c-e1db00f64560 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:40:10.734175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:10.739892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Usage tracker for resource:security_group_rule and tenant:b5b6bed7c5384a038d2067fd4f6b3819 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:10.745607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:10.752156 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-91948d87-e728-43ed-86b5-56a3f88bfc90 None None] For port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5,segment=NetworkSegment(18bd4448-0f94-4680-9be4-a1ef24f52439),segment_id=18bd4448-0f94-4680-9be4-a1ef24f52439)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:10.752567 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-91948d87-e728-43ed-86b5-56a3f88bfc90 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:10.762290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:11.017999 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:11.029750 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:11.033614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-91948d87-e728-43ed-86b5-56a3f88bfc90 None None] Calling delete_port for c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:11.090062 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:11.128592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:11.134716 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:11.239153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-df57bc7e-6907-43e8-b57e-3293d7da1c95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:11.242182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-df57bc7e-6907-43e8-b57e-3293d7da1c95 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f798fdc3e9c54b38b7dbb0478a1d31d6&device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 1095 time: 0.8517337 May 12 15:40:11.243360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3c3bc024-a7f9-4b14-ad71-6651f0779cf5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:11.273970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 551} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:40:11.294691 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:11.295383 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Added segment 4bfc1ff9-edb6-41cb-83a5-1aa76100e959 of type vlan for network a2a13f76-4a7a-4a28-a20f-e993b7379fe7 May 12 15:40:11.305266 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-91948d87-e728-43ed-86b5-56a3f88bfc90 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:11.330273 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:11.371997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91948d87-e728-43ed-86b5-56a3f88bfc90 None None] No DVR routers for this DVR port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:40:11.393070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:11.411581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:40:11.424281 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:11.431038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:11.431979 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:11.495972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91948d87-e728-43ed-86b5-56a3f88bfc90 None None] Pushing event deleted for resources: {'Port': ['ID=c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:11.497407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] For port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5,segment=NetworkSegment(18bd4448-0f94-4680-9be4-a1ef24f52439),segment_id=18bd4448-0f94-4680-9be4-a1ef24f52439)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:11.497922 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:11.518039 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3e261c22-d809-450a-9cac-bcf574e39f64 admin admin] 10.222.0.82 "PUT /v2.0/routers/90b1ce02-50a9-42ff-913c-e1db00f64560/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.3272502 May 12 15:40:11.738209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-d3b69119-335d-4ead-a615-5466b7a10b36 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=87fec19b-446c-4edb-905b-6c36fbfa250f HTTP/1.1" status: 200 len: 217 time: 0.3147807 May 12 15:40:11.761815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Sync routers for ids ['90b1ce02-50a9-42ff-913c-e1db00f64560'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:40:11.777563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Routers {'90b1ce02-50a9-42ff-913c-e1db00f64560'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:40:11.778185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:39:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['90b1ce02-50a9-42ff-913c-e1db00f64560'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:11.866734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:12.022423 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:40:12.022811 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:40:12.045949 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:12.120153 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 795 time: 2.8190320 May 12 15:40:12.123135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37096) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:12.138777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-731ca359-c933-4f7d-83a3-e7bd380c5585 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Pushing event updated for resources: {'Network': ['ID=a2a13f76-4a7a-4a28-a20f-e993b7379fe7,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:12.140346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Request body: {'subnet': {'network_id': 'a2a13f76-4a7a-4a28-a20f-e993b7379fe7', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:12.171559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90558e44-ae3f-471b-8f52-9cf189cb99c6 req-2015e20d-c4bb-4bf1-b565-537f5655d02e tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:12.173055 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-90558e44-ae3f-471b-8f52-9cf189cb99c6 req-2015e20d-c4bb-4bf1-b565-537f5655d02e tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 944 time: 1.1444478 May 12 15:40:12.174724 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-86079c72-4bd7-48f2-ac77-fed648cf1e22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:12.176051 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-86079c72-4bd7-48f2-ac77-fed648cf1e22 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3c282c52-5b3b-474f-b33b-26979e8a2384 HTTP/1.1" status: 200 len: 848 time: 0.2008252 May 12 15:40:12.359025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:12.367201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Usage tracker for resource:subnet and tenant:b5b6bed7c5384a038d2067fd4f6b3819 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:12.369356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network a2a13f76-4a7a-4a28-a20f-e993b7379fe7 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:40:12.371945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:12.379823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:12.400537 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Made reservation on behalf of b5b6bed7c5384a038d2067fd4f6b3819 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:12.407012 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:12.437443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-fe3a051b-19c3-4463-9e62-4da5938e2879 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=85cd1d66-57c4-4d94-b782-1d4cae810f95&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1954079 May 12 15:40:12.507317 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-90558e44-ae3f-471b-8f52-9cf189cb99c6 req-b280f080-7f61-479e-849a-54589ac9a34f tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3261802 May 12 15:40:12.549578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:12.550794 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:12.716851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] The port 'c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:40:12.739319 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-22d85e7d-4fdb-4532-8605-aa80ee70d0f4 service neutron] 10.222.0.84 "GET /v2.0/networks/85cd1d66-57c4-4d94-b782-1d4cae810f95?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2904212 May 12 15:40:12.756759 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Set router 90b1ce02-50a9-42ff-913c-e1db00f64560 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:40:12.838897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37118) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:12.856274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBackupRestore-1378188961-network', 'tenant_id': 'd5937b60103242ddb97055720836a8ff'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:12.866554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:12.871257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:12.871797 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:12.874585 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Usage tracker for resource:network and tenant:d5937b60103242ddb97055720836a8ff is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:12.879850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:12.890596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:12.922248 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9d571ae2-bad2-4ce4-aeaf-1723943ce876 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:12.932439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Made reservation on behalf of d5937b60103242ddb97055720836a8ff for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:13.056257 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:13.099743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b0419c0f-ed69-45c1-aa89-5514f9462b46']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:13.146416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '18bd4448-0f94-4680-9be4-a1ef24f52439') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:13.148845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '18bd4448-0f94-4680-9be4-a1ef24f52439') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:13.197885 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:13.262556 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:13.278672 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:13.290622 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f442656d-9a65-46ce-b6fe-13054f225d69 req-1c5524b0-38e5-49e4-9b88-dd91c27a0dd1 service neutron] 10.222.0.84 "GET /v2.0/networks/85cd1d66-57c4-4d94-b782-1d4cae810f95?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5414765 May 12 15:40:13.311476 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:13.321686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Usage tracker for resource:security_group_rule and tenant:d5937b60103242ddb97055720836a8ff is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:13.332030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:13.349882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:13.405103 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:13.422588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Releasing vlan 561 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:40:13.423002 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: timer() May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:40:13.441431 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:40:13.481989 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:13.660453 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 4, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0330d6b4-dcca-428b-884e-6ad77426f8da', 'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'mac_address': 'fa:16:3e:cb:a3:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_interface', 'standard_attr_id': 3214, 'fixed_ips': [{'subnet_id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:06Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 2, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'subnets': [{'id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:13.669462 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Checking router: 90b1ce02-50a9-42ff-913c-e1db00f64560 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:40:13.670762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Updating router 90b1ce02-50a9-42ff-913c-e1db00f64560 port 0330d6b4-dcca-428b-884e-6ad77426f8da binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:40:13.702026 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:13.750957 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:13.759592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:40:13.769120 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:13.770672 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:13.782326 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:13.805897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4637d26-7910-47c2-bb11-c83f5434778d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:13.806969 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:40:13.807468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c22839d2-9a5b-4250-9f7e-65fb0c0cdbc5 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:40:13.809423 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:13.829061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 558} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:40:13.844245 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/networks/b0419c0f-ed69-45c1-aa89-5514f9462b46 HTTP/1.1" status: 204 len: 168 time: 4.3640301 May 12 15:40:13.844734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37144) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:13.848095 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:13.848593 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Added segment cd102ff7-1d00-44b5-ae17-4227b811564b of type vlan for network 144e0d0a-a7de-4e63-8a93-dfaca53a8328 May 12 15:40:13.874770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-121f4209-2492-4206-98da-5bf58efab776 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Network': ['ID=b0419c0f-ed69-45c1-aa89-5514f9462b46,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:13.955013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d114686a-6970-4d81-b5ee-24620fa42f47 req-d2703c35-3825-4329-9d70-f59ecb9c1b96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:13.956955 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d114686a-6970-4d81-b5ee-24620fa42f47 req-d2703c35-3825-4329-9d70-f59ecb9c1b96 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f798fdc3e9c54b38b7dbb0478a1d31d6&device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 1095 time: 0.5496306 May 12 15:40:13.970177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Checking segment: {'id': '4bfc1ff9-edb6-41cb-83a5-1aa76100e959', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'a2a13f76-4a7a-4a28-a20f-e993b7379fe7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:13.970578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Network hostable DHCP agents. Network: a2a13f76-4a7a-4a28-a20f-e993b7379fe7, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:40:14.003870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Pushing event updated for resources: {'Subnet': ['ID=baa1741c-396f-4bda-a3ff-5f8c45c7cf03,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:14.038238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Network a2a13f76-4a7a-4a28-a20f-e993b7379fe7 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:40:14.064459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, a2a13f76-4a7a-4a28-a20f-e993b7379fe7) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:14.073568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1daea52-f0e7-46ef-8f08-0f3cfbf0bc60 None None] Network a2a13f76-4a7a-4a28-a20f-e993b7379fe7 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:14.079220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:14.079804 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:14.119611 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c21f43af-bb87-43cc-934e-5705266bd33b tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.9951799 May 12 15:40:14.122180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37152) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:14.129269 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Request body: {'port': {'network_id': 'a2a13f76-4a7a-4a28-a20f-e993b7379fe7', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-100670317'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:14.186340 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:14.241631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-cdc7d808-5d00-41d2-9d6f-6ddd61503a4a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port b3f0dc69-a505-4a60-ad9b-a912e5401a58 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:14.242166 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cdc7d808-5d00-41d2-9d6f-6ddd61503a4a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:14.556570 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cdc7d808-5d00-41d2-9d6f-6ddd61503a4a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:14.557153 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cdc7d808-5d00-41d2-9d6f-6ddd61503a4a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:14.722577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-cdc7d808-5d00-41d2-9d6f-6ddd61503a4a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for b3f0dc69-a505-4a60-ad9b-a912e5401a58 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:14.740990 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-a2a13f76-4a7a-4a28-a20f-e993b7379fe7', 'network_id': 'a2a13f76-4a7a-4a28-a20f-e993b7379fe7', 'tenant_id': 'b5b6bed7c5384a038d2067fd4f6b3819', 'fixed_ips': [{'subnet_id': 'baa1741c-396f-4bda-a3ff-5f8c45c7cf03'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:40:14.748399 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:14.813615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:14.820272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Usage tracker for resource:port and tenant:b5b6bed7c5384a038d2067fd4f6b3819 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:14.830091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:14.844967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:14.853578 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:14.854881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:14.855803 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:14.876062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Made reservation on behalf of b5b6bed7c5384a038d2067fd4f6b3819 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:14.879988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:14.929023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] device_id is not set on port b26ffd28-9422-4f59-bd00-52dd1fff13ab yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:40:15.067076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1654976-4928-4791-85f6-a4b88853cbf8 req-c2593a9c-7595-4387-bd49-1eee788cbf57 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:15.068536 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1654976-4928-4791-85f6-a4b88853cbf8 req-c2593a9c-7595-4387-bd49-1eee788cbf57 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 944 time: 1.3701701 May 12 15:40:15.219615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37186) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:15.220304 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 2.3800564 May 12 15:40:15.231008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Request body: {'subnet': {'network_id': '144e0d0a-a7de-4e63-8a93-dfaca53a8328', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBackupRestore-1378188961-subnet', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:15.255233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:15.264106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Usage tracker for resource:subnet and tenant:d5937b60103242ddb97055720836a8ff is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:15.275261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:15.288967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:15.295562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1654976-4928-4791-85f6-a4b88853cbf8 req-07a0c808-2c5e-42a8-ab33-06463c05027a tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1869869 May 12 15:40:15.296306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05751385-3d3a-43eb-b94f-83a2ef138ad3 admin admin] Pushing event updated for resources: {'Network': ['ID=144e0d0a-a7de-4e63-8a93-dfaca53a8328,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:15.304360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Made reservation on behalf of d5937b60103242ddb97055720836a8ff for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:15.312055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:15.322836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 144e0d0a-a7de-4e63-8a93-dfaca53a8328 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:40:15.376186 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cdc7d808-5d00-41d2-9d6f-6ddd61503a4a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:15.518463 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] It took 0.25 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:40:15.620996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d114686a-6970-4d81-b5ee-24620fa42f47 req-d496815b-6367-40ca-9b88-eccc50f07b9c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:15.622544 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d114686a-6970-4d81-b5ee-24620fa42f47 req-d496815b-6367-40ca-9b88-eccc50f07b9c service neutron] 10.222.0.84 "GET /v2.0/networks?id=85cd1d66-57c4-4d94-b782-1d4cae810f95 HTTP/1.1" status: 200 len: 909 time: 1.5415595 May 12 15:40:15.626395 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6ab68db1-974a-4362-ac7f-134b3026f011 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:15.666572 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Allocated IP 2001:db8::2 (a2a13f76-4a7a-4a28-a20f-e993b7379fe7/baa1741c-396f-4bda-a3ff-5f8c45c7cf03/90de2846-968a-47a7-a7ec-3f5bcb9db1d1) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:40:15.676182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdc7d808-5d00-41d2-9d6f-6ddd61503a4a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Port': ['ID=b3f0dc69-a505-4a60-ad9b-a912e5401a58,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:15.767427 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:15.829994 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:15.978800 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d114686a-6970-4d81-b5ee-24620fa42f47 req-76c2b732-47d0-4f3b-ad2e-4095a80e60d6 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=87fec19b-446c-4edb-905b-6c36fbfa250f HTTP/1.1" status: 200 len: 217 time: 0.3042996 May 12 15:40:15.986008 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cdc7d808-5d00-41d2-9d6f-6ddd61503a4a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:15.988603 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cdc7d808-5d00-41d2-9d6f-6ddd61503a4a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:15.993648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37202) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:15.998819 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cdc7d808-5d00-41d2-9d6f-6ddd61503a4a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/floatingips/c24d2acf-3216-485d-abda-c05c5a66e7eb HTTP/1.1" status: 204 len: 168 time: 2.1523066 May 12 15:40:16.067336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Transition to ACTIVE for port object 0330d6b4-dcca-428b-884e-6ad77426f8da will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:16.086760 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:16.099587 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:16.272889 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-3cba42d5-eb4e-4bba-823e-9dd959e22485 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] DELETE failed (client error): The resource could not be found. May 12 15:40:16.274085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3cba42d5-eb4e-4bba-823e-9dd959e22485 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:40:16.290981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Pushing event updated for resources: {'Subnet': ['ID=8199d329-88ea-42b4-8648-caba92394460,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:16.347329 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3cba42d5-eb4e-4bba-823e-9dd959e22485 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/ports/f081673d-e456-4c37-905f-a5fce92a8340 HTTP/1.1" status: 404 len: 333 time: 0.3378627 May 12 15:40:16.356303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37214) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:16.391630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Checking segment: {'id': 'cd102ff7-1d00-44b5-ae17-4227b811564b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '144e0d0a-a7de-4e63-8a93-dfaca53a8328'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:16.391991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Network hostable DHCP agents. Network: 144e0d0a-a7de-4e63-8a93-dfaca53a8328, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:40:16.502315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 87fec19b-446c-4edb-905b-6c36fbfa250f details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:40:16.504238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d114686a-6970-4d81-b5ee-24620fa42f47 req-33ab2509-b997-4df3-a931-73e9a60f9e93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:16.505865 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d114686a-6970-4d81-b5ee-24620fa42f47 req-33ab2509-b997-4df3-a931-73e9a60f9e93 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3c282c52-5b3b-474f-b33b-26979e8a2384 HTTP/1.1" status: 200 len: 848 time: 0.5043857 May 12 15:40:16.560746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-69de9ff0-ddf0-4306-a1e5-fb3d3244b8c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Synchronizing usage tracker for tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:40:16.601048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Network 144e0d0a-a7de-4e63-8a93-dfaca53a8328 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:40:16.654677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-69de9ff0-ddf0-4306-a1e5-fb3d3244b8c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Unset dirty status for tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:40:16.661552 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-69de9ff0-ddf0-4306-a1e5-fb3d3244b8c9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "GET /v2.0/ports?device_id=697c0f4d-8153-41d1-a4dd-f0d86c14fd95 HTTP/1.1" status: 200 len: 205 time: 0.2969348 May 12 15:40:16.664318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37220) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:16.669974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 144e0d0a-a7de-4e63-8a93-dfaca53a8328) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:16.698438 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:16.715882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ea89fce-6c24-4c08-9b8d-8059d2439412 None None] Network 144e0d0a-a7de-4e63-8a93-dfaca53a8328 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:16.742046 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d114686a-6970-4d81-b5ee-24620fa42f47 req-df9b4cd8-fa27-43c3-a054-2311553ee3a8 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=85cd1d66-57c4-4d94-b782-1d4cae810f95&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2258382 May 12 15:40:16.840843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:16.841377 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:16.852987 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-e5a16741-499b-4c2f-a57b-b8027c14e1a1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] delete failed (client error): The resource could not be found. May 12 15:40:16.854024 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e5a16741-499b-4c2f-a57b-b8027c14e1a1 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/routers/697c0f4d-8153-41d1-a4dd-f0d86c14fd95 HTTP/1.1" status: 404 len: 336 time: 0.1821277 May 12 15:40:16.856636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37224) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:16.859954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb74c479-f1ca-4e2f-b9d9-09ddb0e15159 None None] Pushing event updated for resources: {'Port': ['ID=0330d6b4-dcca-428b-884e-6ad77426f8da,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:16.893002 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] It took 0.33 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:40:16.921769 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-853d7a2a-683a-428d-a8d6-78d61bd217a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] DELETE failed (client error): The resource could not be found. May 12 15:40:16.922488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-853d7a2a-683a-428d-a8d6-78d61bd217a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:40:16.924318 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-853d7a2a-683a-428d-a8d6-78d61bd217a9 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/subnets/93f4665b-d6a8-4147-b1d7-7358a9b0558e HTTP/1.1" status: 404 len: 337 time: 0.0652688 May 12 15:40:16.927673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37228) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:16.968346 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0218c467-2487-45f8-b817-24f5521a0e3a admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 1.7474730 May 12 15:40:16.974131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37232) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:17.025261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4a8eef74-4afb-47e1-a4d8-c7336b4b8da5 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port 8ac3db5f-3324-4a02-a6e5-504a9ea69fc2 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:17.026231 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a8eef74-4afb-47e1-a4d8-c7336b4b8da5 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:17.036177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBackupRestore-1378188961-router', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:17.057103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:17.087782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Usage tracker for resource:router and tenant:d5937b60103242ddb97055720836a8ff is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:17.109615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:17.153799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:17.186928 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:17.188259 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:17.208185 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:17.403588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f09d7c4c-0fbb-4b46-b1d0-8c3c7ada6874 req-f6d13e4f-69e0-4d76-a9f8-38fba3f193b8 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:17.405493 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f09d7c4c-0fbb-4b46-b1d0-8c3c7ada6874 req-f6d13e4f-69e0-4d76-a9f8-38fba3f193b8 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 944 time: 0.7652941 May 12 15:40:17.433063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Attempting to bind port 0330d6b4-dcca-428b-884e-6ad77426f8da on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:40:17.436568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Attempting to bind port 0330d6b4-dcca-428b-884e-6ad77426f8da by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '384c5e83-6775-4f29-a4c7-08c3d60e1de8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:40:17.437016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Attempting to bind port 0330d6b4-dcca-428b-884e-6ad77426f8da on network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:40:17.559871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 40, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:40:17.560598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Checking segment: {'id': '384c5e83-6775-4f29-a4c7-08c3d60e1de8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:17.561918 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:17.562392 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Bound using segment: {'id': '384c5e83-6775-4f29-a4c7-08c3d60e1de8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:40:17.562956 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Bound port: 0330d6b4-dcca-428b-884e-6ad77426f8da, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '384c5e83-6775-4f29-a4c7-08c3d60e1de8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:40:17.563443 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:17.600979 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a8eef74-4afb-47e1-a4d8-c7336b4b8da5 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:17.628522 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d114686a-6970-4d81-b5ee-24620fa42f47 req-01217b10-6335-42cb-993f-92b751dd9fe3 service neutron] 10.222.0.84 "GET /v2.0/networks/85cd1d66-57c4-4d94-b782-1d4cae810f95?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8743584 May 12 15:40:17.733238 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:17.749226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Transition to ACTIVE for port object 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:17.774535 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Transition to ACTIVE for port object 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:17.852194 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:17.941740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4a8eef74-4afb-47e1-a4d8-c7336b4b8da5 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for 8ac3db5f-3324-4a02-a6e5-504a9ea69fc2 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:18.060636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Network a2a13f76-4a7a-4a28-a20f-e993b7379fe7 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:18.103634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Pushing event updated for resources: {'Port': ['ID=90de2846-968a-47a7-a7ec-3f5bcb9db1d1,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:18.106735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:18.116733 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:40:18.178492 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a8eef74-4afb-47e1-a4d8-c7336b4b8da5 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:18.188289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 87fec19b-446c-4edb-905b-6c36fbfa250f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=87fec19b-446c-4edb-905b-6c36fbfa250f,segment=NetworkSegment(09c83b83-4d53-47f0-b181-c0fb6ed7f95d),segment_id=09c83b83-4d53-47f0-b181-c0fb6ed7f95d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:18.224736 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:18.293252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] For port 0330d6b4-dcca-428b-884e-6ad77426f8da, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:40:18.368195 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f09d7c4c-0fbb-4b46-b1d0-8c3c7ada6874 req-7e9750c9-2ebb-4b8b-b9ce-e09499de7a5d tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7421112 May 12 15:40:18.372208 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:18.469304 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '87fec19b-446c-4edb-905b-6c36fbfa250f', 'network_id': '85cd1d66-57c4-4d94-b782-1d4cae810f95', 'port_id': '87fec19b-446c-4edb-905b-6c36fbfa250f', 'mac_address': 'fa:16:3e:50:ac:b8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 597, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3c282c52-5b3b-474f-b33b-26979e8a2384', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:40:18.485674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a8eef74-4afb-47e1-a4d8-c7336b4b8da5 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Port': ['ID=8ac3db5f-3324-4a02-a6e5-504a9ea69fc2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:18.507424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] For port 0330d6b4-dcca-428b-884e-6ad77426f8da, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0330d6b4-dcca-428b-884e-6ad77426f8da,segment=NetworkSegment(384c5e83-6775-4f29-a4c7-08c3d60e1de8),segment_id=384c5e83-6775-4f29-a4c7-08c3d60e1de8)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:40:18.507838 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a8eef74-4afb-47e1-a4d8-c7336b4b8da5 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:18.538127 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4a8eef74-4afb-47e1-a4d8-c7336b4b8da5 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/ports/8ac3db5f-3324-4a02-a6e5-504a9ea69fc2 HTTP/1.1" status: 204 len: 168 time: 1.6092346 May 12 15:40:18.552512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37250) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:18.552915 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:18.573630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d114686a-6970-4d81-b5ee-24620fa42f47 req-2afbdc77-78ec-48a2-94fe-b6668b36298a service neutron] 10.222.0.84 "GET /v2.0/networks/85cd1d66-57c4-4d94-b782-1d4cae810f95?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9307187 May 12 15:40:18.625533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Allocated IP 2001:db8::28e (a2a13f76-4a7a-4a28-a20f-e993b7379fe7/baa1741c-396f-4bda-a3ff-5f8c45c7cf03/b26ffd28-9422-4f59-bd00-52dd1fff13ab) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:40:18.669112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-cd9fafd3-5963-46aa-ba0a-ca0f12300a23 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port 3fcda3cf-cc90-44c3-8595-0c2d95cbda90 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:18.669502 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cd9fafd3-5963-46aa-ba0a-ca0f12300a23 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:18.721170 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-144e0d0a-a7de-4e63-8a93-dfaca53a8328', 'network_id': '144e0d0a-a7de-4e63-8a93-dfaca53a8328', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'fixed_ips': [{'subnet_id': '8199d329-88ea-42b4-8648-caba92394460'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:40:18.724181 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:18.771729 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb74c479-f1ca-4e2f-b9d9-09ddb0e15159 None None] Pushing event updated for resources: {'Port': ['ID=0330d6b4-dcca-428b-884e-6ad77426f8da,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:18.867299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Attempting to bind port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:40:18.867667 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Attempting to bind port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '4bfc1ff9-edb6-41cb-83a5-1aa76100e959', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'a2a13f76-4a7a-4a28-a20f-e993b7379fe7'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:40:18.868024 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Attempting to bind port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 on network a2a13f76-4a7a-4a28-a20f-e993b7379fe7 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:40:19.006781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Routers {'90b1ce02-50a9-42ff-913c-e1db00f64560'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:40:19.011409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:40:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['90b1ce02-50a9-42ff-913c-e1db00f64560'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:19.012605 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:19.102343 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:19.118794 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:19.146129 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 87fec19b-446c-4edb-905b-6c36fbfa250f {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:40:19.150318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 40, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:40:19.150684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Checking segment: {'id': '4bfc1ff9-edb6-41cb-83a5-1aa76100e959', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'a2a13f76-4a7a-4a28-a20f-e993b7379fe7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:19.151079 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:19.151461 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Bound using segment: {'id': '4bfc1ff9-edb6-41cb-83a5-1aa76100e959', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'a2a13f76-4a7a-4a28-a20f-e993b7379fe7'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:40:19.152148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Bound port: 90de2846-968a-47a7-a7ec-3f5bcb9db1d1, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4bfc1ff9-edb6-41cb-83a5-1aa76100e959', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 551, 'network_id': 'a2a13f76-4a7a-4a28-a20f-e993b7379fe7'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:40:19.152586 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:19.351332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Allocated IP 172.25.8.127 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/80a299dc-ac88-40fc-9d83-8707660023fd) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:40:19.399182 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:19.507240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Transition to ACTIVE for port object b26ffd28-9422-4f59-bd00-52dd1fff13ab will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:19.512830 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cd9fafd3-5963-46aa-ba0a-ca0f12300a23 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:19.586459 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] Set router 90b1ce02-50a9-42ff-913c-e1db00f64560 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:40:19.722092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 87fec19b-446c-4edb-905b-6c36fbfa250f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=87fec19b-446c-4edb-905b-6c36fbfa250f,segment=NetworkSegment(09c83b83-4d53-47f0-b181-c0fb6ed7f95d),segment_id=09c83b83-4d53-47f0-b181-c0fb6ed7f95d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:19.738092 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:19.753618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-cd9fafd3-5963-46aa-ba0a-ca0f12300a23 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for 3fcda3cf-cc90-44c3-8595-0c2d95cbda90 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:19.831437 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:19.921629 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:19.960989 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:20.034723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Pushing event updated for resources: {'Port': ['ID=80a299dc-ac88-40fc-9d83-8707660023fd,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:20.051542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:20.053698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:20.061643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:40:20.304006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c83896d-2ab2-4995-83b7-0af7388ff5ad req-b6fb3f0c-81e9-472e-b721-82745d7fb03f tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:20.306034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c83896d-2ab2-4995-83b7-0af7388ff5ad req-b6fb3f0c-81e9-472e-b721-82745d7fb03f tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 945 time: 0.5689769 May 12 15:40:20.323837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Pushing event updated for resources: {'Port': ['ID=b26ffd28-9422-4f59-bd00-52dd1fff13ab,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:20.388299 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c83896d-2ab2-4995-83b7-0af7388ff5ad req-ff629d5a-5811-4433-b99a-588eacb8ebe0 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658197 May 12 15:40:20.427771 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cd9fafd3-5963-46aa-ba0a-ca0f12300a23 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:20.431938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Network a2a13f76-4a7a-4a28-a20f-e993b7379fe7 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:20.495690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:20.506713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['87fec19b-446c-4edb-905b-6c36fbfa250f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:40:20.552088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:40:20.559863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:20.560569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:20.592756 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd9fafd3-5963-46aa-ba0a-ca0f12300a23 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Port': ['ID=3fcda3cf-cc90-44c3-8595-0c2d95cbda90,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:20.681722 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cd9fafd3-5963-46aa-ba0a-ca0f12300a23 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:20.697460 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a9a0c35f-3d0c-4194-a114-7f46b51d9ae7 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 941 time: 6.5741465 May 12 15:40:20.699628 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cd9fafd3-5963-46aa-ba0a-ca0f12300a23 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/ports/3fcda3cf-cc90-44c3-8595-0c2d95cbda90 HTTP/1.1" status: 204 len: 168 time: 2.1461565 May 12 15:40:20.700597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37408) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:20.703875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37410) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:20.708651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Request body: {'port': {'network_id': 'a2a13f76-4a7a-4a28-a20f-e993b7379fe7', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-1191485581', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:20.709553 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.api.validators [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] bootfile-name is not in valid_values {{(pid=88151) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} May 12 15:40:20.710114 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.api.validators [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] tftp-server is not in valid_values {{(pid=88151) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} May 12 15:40:20.710660 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.api.validators [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] server-ip-address is not in valid_values {{(pid=88151) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} May 12 15:40:20.808873 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] For port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:40:20.870992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:20.886508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] For port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=90de2846-968a-47a7-a7ec-3f5bcb9db1d1,segment=NetworkSegment(4bfc1ff9-edb6-41cb-83a5-1aa76100e959),segment_id=4bfc1ff9-edb6-41cb-83a5-1aa76100e959)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:40:20.915850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=87fec19b-446c-4edb-905b-6c36fbfa250f,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:20.929682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Allocated IP 172.20.0.2 (144e0d0a-a7de-4e63-8a93-dfaca53a8328/8199d329-88ea-42b4-8648-caba92394460/a3ca589c-46a4-47c6-a8a8-4cbc670fb19c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:40:20.941462 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:40:20.949028 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:21.037795 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:21.050364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Usage tracker for resource:port and tenant:b5b6bed7c5384a038d2067fd4f6b3819 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:21.073196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e1b2ad7-db56-4566-9bcc-592186ac4936 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:21.073975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8e1b2ad7-db56-4566-9bcc-592186ac4936 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Synchronizing usage tracker for tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:40:21.086013 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:21.101642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:21.138248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8e1b2ad7-db56-4566-9bcc-592186ac4936 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Unset dirty status for tenant:9d4bdd73a39f4390bb7d4c6d7a1fc0c4 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:40:21.140063 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8e1b2ad7-db56-4566-9bcc-592186ac4936 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "GET /v2.0/ports?device_id=c622fac9-6201-493c-99ca-1de3b27ccf7c HTTP/1.1" status: 200 len: 913 time: 0.4103191 May 12 15:40:21.141331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Made reservation on behalf of b5b6bed7c5384a038d2067fd4f6b3819 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:21.145663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:21.166599 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37460) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:21.278055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] device_id is not set on port 56e45132-2c14-43bf-bb0d-bad238f0775e yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:40:21.410235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-600855b1-291c-4cf5-88d3-c11377dc8534 None None] Pushing event updated for resources: {'Port': ['ID=90de2846-968a-47a7-a7ec-3f5bcb9db1d1,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:21.527876 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:22.081238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 4, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0330d6b4-dcca-428b-884e-6ad77426f8da', 'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'mac_address': 'fa:16:3e:cb:a3:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_interface', 'standard_attr_id': 3214, 'fixed_ips': [{'subnet_id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:06Z', 'updated_at': '2022-05-12T15:40:18Z', 'revision_number': 4, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'subnets': [{'id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:22.121666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:22.196762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37cc5883-58c4-4d2b-b8cc-091dfb7facce None None] The sync data for ids ['90b1ce02-50a9-42ff-913c-e1db00f64560'] in n-d-841483-1 is: [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 4, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0330d6b4-dcca-428b-884e-6ad77426f8da', 'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'mac_address': 'fa:16:3e:cb:a3:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_interface', 'standard_attr_id': 3214, 'fixed_ips': [{'subnet_id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:06Z', 'updated_at': '2022-05-12T15:40:18Z', 'revision_number': 4, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'subnets': [{'id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:40:22.280781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b20ee76-bc2e-467e-ad25-2d2d06f3954d req-488033ff-74eb-4150-b2e1-7b4e929de9ac tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:22.282340 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b20ee76-bc2e-467e-ad25-2d2d06f3954d req-488033ff-74eb-4150-b2e1-7b4e929de9ac tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 945 time: 0.5926380 May 12 15:40:22.311408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Allocated IP 2001:db8::237 (a2a13f76-4a7a-4a28-a20f-e993b7379fe7/baa1741c-396f-4bda-a3ff-5f8c45c7cf03/56e45132-2c14-43bf-bb0d-bad238f0775e) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:40:22.316054 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:22.397565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Transition to ACTIVE for port object a3ca589c-46a4-47c6-a8a8-4cbc670fb19c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:22.474104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Transition to ACTIVE for port object a3ca589c-46a4-47c6-a8a8-4cbc670fb19c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:22.478453 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b20ee76-bc2e-467e-ad25-2d2d06f3954d req-9edaa89f-0cdc-4f4a-995a-619d2de7595c tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1836045 May 12 15:40:22.492816 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:22.497898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Router 7b4592bb-783c-491e-8854-09b8b7ceb354 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:40:22.504158 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:22.679634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Network 144e0d0a-a7de-4e63-8a93-dfaca53a8328 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:22.687165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:22.695174 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:40:22.827888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Pushing event updated for resources: {'Port': ['ID=a3ca589c-46a4-47c6-a8a8-4cbc670fb19c,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:22.997878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Attempting to bind port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:40:23.000248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Attempting to bind port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'cd102ff7-1d00-44b5-ae17-4227b811564b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '144e0d0a-a7de-4e63-8a93-dfaca53a8328'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:40:23.000725 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Attempting to bind port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c on network 144e0d0a-a7de-4e63-8a93-dfaca53a8328 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:40:23.011142 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 40, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:40:23.012023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Checking segment: {'id': 'cd102ff7-1d00-44b5-ae17-4227b811564b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '144e0d0a-a7de-4e63-8a93-dfaca53a8328'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:23.012888 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:23.013578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Bound using segment: {'id': 'cd102ff7-1d00-44b5-ae17-4227b811564b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '144e0d0a-a7de-4e63-8a93-dfaca53a8328'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:40:23.014295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Bound port: a3ca589c-46a4-47c6-a8a8-4cbc670fb19c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cd102ff7-1d00-44b5-ae17-4227b811564b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '144e0d0a-a7de-4e63-8a93-dfaca53a8328'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:40:23.014915 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:23.178666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] For port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:40:23.182839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] For port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a3ca589c-46a4-47c6-a8a8-4cbc670fb19c,segment=NetworkSegment(cd102ff7-1d00-44b5-ae17-4227b811564b),segment_id=cd102ff7-1d00-44b5-ae17-4227b811564b)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:40:23.189450 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:23.333470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-396ebad7-674e-4b94-b08d-d9ee38ec3007 None None] Pushing event updated for resources: {'Port': ['ID=a3ca589c-46a4-47c6-a8a8-4cbc670fb19c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:23.536608 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b7cccbf-7c30-4dfc-8410-f3aad4374e44 None None] Network a2a13f76-4a7a-4a28-a20f-e993b7379fe7 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:23.632159 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:23.668545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:40:23.702654 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Sync routers for ids ['7b4592bb-783c-491e-8854-09b8b7ceb354'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:40:23.738649 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Routers {'7b4592bb-783c-491e-8854-09b8b7ceb354'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:40:23.739292 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:40:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7b4592bb-783c-491e-8854-09b8b7ceb354'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:23.770877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Transition to ACTIVE for port object 56e45132-2c14-43bf-bb0d-bad238f0775e will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:23.788952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:23.794701 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ddeedcd9-58ce-44ae-b3a5-41fa74396148 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 6.8138301 May 12 15:40:23.799385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37728) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:23.835843 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:23.926294 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 87fec19b-446c-4edb-905b-6c36fbfa250f up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:24.175391 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc78a6e5-f89c-4733-8dcd-5c61f9f619f0 None None] Provisioning for port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:24.238025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc78a6e5-f89c-4733-8dcd-5c61f9f619f0 None None] Provisioning complete for port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:24.240166 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc78a6e5-f89c-4733-8dcd-5c61f9f619f0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:24.337950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Network a2a13f76-4a7a-4a28-a20f-e993b7379fe7 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:24.353519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:24.373907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:40:24.382069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:24.383004 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:24.394481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0330d6b4-dcca-428b-884e-6ad77426f8da up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:24.492136 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1150 time: 3.7895994 May 12 15:40:24.500836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37770) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:24.531986 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Set router 7b4592bb-783c-491e-8854-09b8b7ceb354 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:40:24.612357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1bada5a-7292-4249-88f0-606599d62d99 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Pushing event updated for resources: {'Port': ['ID=56e45132-2c14-43bf-bb0d-bad238f0775e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:24.766929 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f758b6a-ac2e-408c-b5d5-19a6ff58d55a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:24.941263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c77a9dbb-2e5c-403e-859f-7e069760afec req-a41dbe2e-9f15-4f17-8f6a-21d5dd1ccbdb tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:24.946574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c77a9dbb-2e5c-403e-859f-7e069760afec req-a41dbe2e-9f15-4f17-8f6a-21d5dd1ccbdb tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 945 time: 0.8343158 May 12 15:40:24.952016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 87fec19b-446c-4edb-905b-6c36fbfa250f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:25.005965 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 0330d6b4-dcca-428b-884e-6ad77426f8da completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:25.042559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0330d6b4-dcca-428b-884e-6ad77426f8da triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:25.042803 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:25.067228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf1956b6-04f6-4362-9286-8eeb167ac3f5 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:25.079927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf1956b6-04f6-4362-9286-8eeb167ac3f5 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:25.091558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf1956b6-04f6-4362-9286-8eeb167ac3f5 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:25.092457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cf1956b6-04f6-4362-9286-8eeb167ac3f5 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Synchronizing usage tracker for tenant:b5b6bed7c5384a038d2067fd4f6b3819 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:40:25.136094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 87fec19b-446c-4edb-905b-6c36fbfa250f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:25.136685 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:25.148624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37776) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:25.182240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c77a9dbb-2e5c-403e-859f-7e069760afec req-dee56dcf-a461-4f0b-b7d1-88cc394640bd tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1647990 May 12 15:40:25.336166 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'name': 'tempest-TestVolumeBackupRestore-1378188961-router', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.127'}], 'enable_snat': True}, 'gw_port_id': '80a299dc-ac88-40fc-9d83-8707660023fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:40:17Z', 'updated_at': '2022-05-12T15:40:20Z', 'revision_number': 3, 'project_id': 'd5937b60103242ddb97055720836a8ff', 'gw_port': {'id': '80a299dc-ac88-40fc-9d83-8707660023fd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:c3:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3235, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:19Z', 'updated_at': '2022-05-12T15:40:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:25.340157 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc78a6e5-f89c-4733-8dcd-5c61f9f619f0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:25.349643 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Checking router: 7b4592bb-783c-491e-8854-09b8b7ceb354 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:40:25.350002 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Updating router 7b4592bb-783c-491e-8854-09b8b7ceb354 port 80a299dc-ac88-40fc-9d83-8707660023fd binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:40:25.403893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cf1956b6-04f6-4362-9286-8eeb167ac3f5 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Unset dirty status for tenant:b5b6bed7c5384a038d2067fd4f6b3819 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:40:25.411705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37788) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:25.422248 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cf1956b6-04f6-4362-9286-8eeb167ac3f5 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2621 time: 0.9138193 May 12 15:40:25.482078 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:25.635019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-87d735d7-d1d8-4614-9395-40619868a6a1 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Deleting port 56e45132-2c14-43bf-bb0d-bad238f0775e {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:25.635441 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87d735d7-d1d8-4614-9395-40619868a6a1 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:25.743579 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fcea90f5-c1b6-4aa4-bf97-6cff0538a1b0 None None] Network 144e0d0a-a7de-4e63-8a93-dfaca53a8328 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:25.931080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9f758b6a-ac2e-408c-b5d5-19a6ff58d55a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port 7cc33eb2-e3e7-459a-b512-3bca1b17f226 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:25.931603 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f758b6a-ac2e-408c-b5d5-19a6ff58d55a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:25.947368 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:25.961214 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Transition to ACTIVE for port object 80a299dc-ac88-40fc-9d83-8707660023fd will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:25.975759 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:26.062090 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b23ef671-d16d-4d67-96b3-59dfad426de9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:26.067248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc78a6e5-f89c-4733-8dcd-5c61f9f619f0 None None] For port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=90de2846-968a-47a7-a7ec-3f5bcb9db1d1,segment=NetworkSegment(4bfc1ff9-edb6-41cb-83a5-1aa76100e959),segment_id=4bfc1ff9-edb6-41cb-83a5-1aa76100e959)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:26.102832 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc78a6e5-f89c-4733-8dcd-5c61f9f619f0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:26.122545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b23ef671-d16d-4d67-96b3-59dfad426de9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:26.139775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b23ef671-d16d-4d67-96b3-59dfad426de9 admin admin] Usage tracker for resource:security_group_rule and tenant:7c39d19c62444185a85ce6fa5d0be506 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:26.147915 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:26.167549 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:26.175299 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d89fb6b-7cc5-4b4e-84e5-87b8f4d231dd None None] Pushing event updated for resources: {'Port': ['ID=80a299dc-ac88-40fc-9d83-8707660023fd,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:26.180932 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Attempting to bind port 80a299dc-ac88-40fc-9d83-8707660023fd on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:40:26.184929 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Attempting to bind port 80a299dc-ac88-40fc-9d83-8707660023fd by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:40:26.185610 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Attempting to bind port 80a299dc-ac88-40fc-9d83-8707660023fd on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:40:26.195936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b23ef671-d16d-4d67-96b3-59dfad426de9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:26.199375 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 40, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:40:26.200383 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:26.200966 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:26.204241 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:40:26.204887 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Bound port: 80a299dc-ac88-40fc-9d83-8707660023fd, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:40:26.210076 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:26.262908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 87fec19b-446c-4edb-905b-6c36fbfa250f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=87fec19b-446c-4edb-905b-6c36fbfa250f,segment=NetworkSegment(09c83b83-4d53-47f0-b181-c0fb6ed7f95d),segment_id=09c83b83-4d53-47f0-b181-c0fb6ed7f95d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:26.298805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3e24e01e-91e6-4ab8-aca2-78714b1cccb2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '87fec19b-446c-4edb-905b-6c36fbfa250f'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:40:26.327064 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:26.350761 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b23ef671-d16d-4d67-96b3-59dfad426de9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:26.405903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa6dab64-cd01-4c82-b83e-aa68c07612aa None None] Provisioning for port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:26.416725 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 0330d6b4-dcca-428b-884e-6ad77426f8da, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0330d6b4-dcca-428b-884e-6ad77426f8da,segment=NetworkSegment(384c5e83-6775-4f29-a4c7-08c3d60e1de8),segment_id=384c5e83-6775-4f29-a4c7-08c3d60e1de8)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:26.469829 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] For port 80a299dc-ac88-40fc-9d83-8707660023fd, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:40:26.483059 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] For port 80a299dc-ac88-40fc-9d83-8707660023fd, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=80a299dc-ac88-40fc-9d83-8707660023fd,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:40:26.488351 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:26.500426 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f758b6a-ac2e-408c-b5d5-19a6ff58d55a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:26.504227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc78a6e5-f89c-4733-8dcd-5c61f9f619f0 None None] Pushing event updated for resources: {'Port': ['ID=90de2846-968a-47a7-a7ec-3f5bcb9db1d1,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:26.507083 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-49e4f36d-d249-41b9-b6a1-76f043c24b84'] response: {'server_uuid': '3e24e01e-91e6-4ab8-aca2-78714b1cccb2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '87fec19b-446c-4edb-905b-6c36fbfa250f', 'code': 200} May 12 15:40:26.597458 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:26.598279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a3ca589c-46a4-47c6-a8a8-4cbc670fb19c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:26.701759 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d89fb6b-7cc5-4b4e-84e5-87b8f4d231dd None None] Pushing event updated for resources: {'Port': ['ID=80a299dc-ac88-40fc-9d83-8707660023fd,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:26.746162 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Routers {'7b4592bb-783c-491e-8854-09b8b7ceb354'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:40:26.746795 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:40:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7b4592bb-783c-491e-8854-09b8b7ceb354'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:26.938926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9f758b6a-ac2e-408c-b5d5-19a6ff58d55a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for 7cc33eb2-e3e7-459a-b512-3bca1b17f226 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:27.007295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=87fec19b-446c-4edb-905b-6c36fbfa250f,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:27.170390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d5326f06-e504-4e9f-a65b-c4cef4fe1973 None None] Provisioning for port b26ffd28-9422-4f59-bd00-52dd1fff13ab completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:27.181960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:27.195523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d5326f06-e504-4e9f-a65b-c4cef4fe1973 None None] Provisioning complete for port b26ffd28-9422-4f59-bd00-52dd1fff13ab triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:27.195944 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d5326f06-e504-4e9f-a65b-c4cef4fe1973 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:27.202974 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] Set router 7b4592bb-783c-491e-8854-09b8b7ceb354 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:40:27.277265 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d5326f06-e504-4e9f-a65b-c4cef4fe1973 None None] Port b26ffd28-9422-4f59-bd00-52dd1fff13ab cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:40:27.280691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:27.281056 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:27.398588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=0330d6b4-dcca-428b-884e-6ad77426f8da,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:27.437968 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:27.544914 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87d735d7-d1d8-4614-9395-40619868a6a1 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:27.585087 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:27.606615 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d5326f06-e504-4e9f-a65b-c4cef4fe1973 None None] Provisioning complete for port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:27.609824 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d5326f06-e504-4e9f-a65b-c4cef4fe1973 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:27.744946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a3ca589c-46a4-47c6-a8a8-4cbc670fb19c,segment=NetworkSegment(cd102ff7-1d00-44b5-ae17-4227b811564b),segment_id=cd102ff7-1d00-44b5-ae17-4227b811564b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:27.779380 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:27.923438 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'name': 'tempest-TestVolumeBackupRestore-1378188961-router', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.127'}], 'enable_snat': True}, 'gw_port_id': '80a299dc-ac88-40fc-9d83-8707660023fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:40:17Z', 'updated_at': '2022-05-12T15:40:20Z', 'revision_number': 3, 'project_id': 'd5937b60103242ddb97055720836a8ff', 'gw_port': {'id': '80a299dc-ac88-40fc-9d83-8707660023fd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:c3:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3235, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:19Z', 'updated_at': '2022-05-12T15:40:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:27.931895 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-867057c0-c1db-4b8c-935a-99b041716982 None None] The sync data for ids ['7b4592bb-783c-491e-8854-09b8b7ceb354'] in n-d-841483-1 is: [{'id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'name': 'tempest-TestVolumeBackupRestore-1378188961-router', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.127'}], 'enable_snat': True}, 'gw_port_id': '80a299dc-ac88-40fc-9d83-8707660023fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:40:17Z', 'updated_at': '2022-05-12T15:40:20Z', 'revision_number': 3, 'project_id': 'd5937b60103242ddb97055720836a8ff', 'gw_port': {'id': '80a299dc-ac88-40fc-9d83-8707660023fd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:c3:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3235, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:19Z', 'updated_at': '2022-05-12T15:40:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:40:27.961534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-87d735d7-d1d8-4614-9395-40619868a6a1 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Calling delete_port for 56e45132-2c14-43bf-bb0d-bad238f0775e owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:27.986311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:28.131633 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f758b6a-ac2e-408c-b5d5-19a6ff58d55a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:28.145882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:28.146486 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:28.266838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e2fb1c-93e7-45c3-a03a-18b59d9a062c req-d59e6b0e-8c0b-4044-a785-5f133614dc45 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:28.268350 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66e2fb1c-93e7-45c3-a03a-18b59d9a062c req-d59e6b0e-8c0b-4044-a785-5f133614dc45 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 946 time: 1.7351294 May 12 15:40:28.350308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=a3ca589c-46a4-47c6-a8a8-4cbc670fb19c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:28.381371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f758b6a-ac2e-408c-b5d5-19a6ff58d55a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Port': ['ID=7cc33eb2-e3e7-459a-b512-3bca1b17f226,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:28.458261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d5326f06-e504-4e9f-a65b-c4cef4fe1973 None None] Provisioning for port 56e45132-2c14-43bf-bb0d-bad238f0775e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:28.470066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d5326f06-e504-4e9f-a65b-c4cef4fe1973 None None] Provisioning complete for port 56e45132-2c14-43bf-bb0d-bad238f0775e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:28.470780 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d5326f06-e504-4e9f-a65b-c4cef4fe1973 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:28.693537 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d5326f06-e504-4e9f-a65b-c4cef4fe1973 None None] Port 56e45132-2c14-43bf-bb0d-bad238f0775e cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:40:28.713152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-366f971b-d211-4c37-b7de-84bbf02794e0 req-b8d19b92-00c3-44ef-8fec-528cadaf4267 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:28.714679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-366f971b-d211-4c37-b7de-84bbf02794e0 req-b8d19b92-00c3-44ef-8fec-528cadaf4267 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 1097 time: 2.0567956 May 12 15:40:28.719276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0330d6b4-dcca-428b-884e-6ad77426f8da up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:28.754001 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b23ef671-d16d-4d67-96b3-59dfad426de9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:28.838257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-52ffad28-7349-495f-aef9-64b04833f379 None None] Provisioning complete for port b26ffd28-9422-4f59-bd00-52dd1fff13ab triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:28.838638 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-52ffad28-7349-495f-aef9-64b04833f379 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:28.861575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87d735d7-d1d8-4614-9395-40619868a6a1 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:28.933890 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66e2fb1c-93e7-45c3-a03a-18b59d9a062c req-4c17bc4c-cd07-4596-b4b2-9e683438a910 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5479422 May 12 15:40:28.946953 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f758b6a-ac2e-408c-b5d5-19a6ff58d55a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:28.968757 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b23ef671-d16d-4d67-96b3-59dfad426de9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:29.008573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0330d6b4-dcca-428b-884e-6ad77426f8da triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:29.009290 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:29.128094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b23ef671-d16d-4d67-96b3-59dfad426de9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7c39d19c62444185a85ce6fa5d0be506&name=default HTTP/1.1" status: 200 len: 2983 time: 3.9636402 May 12 15:40:29.138103 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-52ffad28-7349-495f-aef9-64b04833f379 None None] Port b26ffd28-9422-4f59-bd00-52dd1fff13ab cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:40:29.159749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37820) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:29.208532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87d735d7-d1d8-4614-9395-40619868a6a1 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Pushing event deleted for resources: {'Port': ['ID=56e45132-2c14-43bf-bb0d-bad238f0775e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:29.215107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-52ffad28-7349-495f-aef9-64b04833f379 None None] Provisioning complete for port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:29.215553 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-52ffad28-7349-495f-aef9-64b04833f379 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:29.230674 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-366f971b-d211-4c37-b7de-84bbf02794e0 req-cb9847b2-ada7-4726-86c5-1738de6841d1 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4850535 May 12 15:40:29.404176 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87d735d7-d1d8-4614-9395-40619868a6a1 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:29.473095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b23ef671-d16d-4d67-96b3-59dfad426de9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f413785c-ccec-450e-836a-7a92f3af1096,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:29.510311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Allocated IP 172.20.0.1 (144e0d0a-a7de-4e63-8a93-dfaca53a8328/8199d329-88ea-42b4-8648-caba92394460/d3290597-fba6-41cb-a98f-3d1e1e3d542f) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:40:29.554835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37830) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:29.673984 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-87d735d7-d1d8-4614-9395-40619868a6a1 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] 10.222.0.82 "DELETE /v2.0/ports/56e45132-2c14-43bf-bb0d-bad238f0775e HTTP/1.1" status: 204 len: 168 time: 4.2567794 May 12 15:40:29.675429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37838) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:29.689356 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b432dbea-3b69-49f8-95d6-c8e03f8c2593 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:29.732947 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-52ffad28-7349-495f-aef9-64b04833f379 None None] Could not find standard attr ID for object 56e45132-2c14-43bf-bb0d-bad238f0775e. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:40:29.737727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9f758b6a-ac2e-408c-b5d5-19a6ff58d55a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Router c622fac9-6201-493c-99ca-1de3b27ccf7c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:40:29.747798 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b432dbea-3b69-49f8-95d6-c8e03f8c2593 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:29.808750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1293517a-3879-47f5-929b-96797b08c509 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Request body: {'port': {'name': 'tempest-new-port-name-1974404004', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:29.809146 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.api.validators [None req-1293517a-3879-47f5-929b-96797b08c509 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] bootfile-name is not in valid_values {{(pid=88152) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} May 12 15:40:29.809498 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.api.validators [None req-1293517a-3879-47f5-929b-96797b08c509 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] tftp-server is not in valid_values {{(pid=88152) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} May 12 15:40:29.809821 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.api.validators [None req-1293517a-3879-47f5-929b-96797b08c509 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] server-ip-address is not in valid_values {{(pid=88152) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} May 12 15:40:30.029233 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 80a299dc-ac88-40fc-9d83-8707660023fd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:30.052358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9f758b6a-ac2e-408c-b5d5-19a6ff58d55a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:40:30.085188 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1293517a-3879-47f5-929b-96797b08c509 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:30.092922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28f7431a-69b8-4576-9e9b-b8cb51bc22ba None None] Sync routers for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:40:30.101258 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c402bb5a-442f-4b75-ba0c-cfd4bd5ba01e admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:30.117625 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b432dbea-3b69-49f8-95d6-c8e03f8c2593 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:30.117829 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9f758b6a-ac2e-408c-b5d5-19a6ff58d55a tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "PUT /v2.0/routers/c622fac9-6201-493c-99ca-1de3b27ccf7c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.9380410 May 12 15:40:30.124863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37844) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:30.142618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c402bb5a-442f-4b75-ba0c-cfd4bd5ba01e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:30.169881 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28f7431a-69b8-4576-9e9b-b8cb51bc22ba None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:40:30.170510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-28f7431a-69b8-4576-9e9b-b8cb51bc22ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:40:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:30.213430 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b432dbea-3b69-49f8-95d6-c8e03f8c2593 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:30.214861 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b432dbea-3b69-49f8-95d6-c8e03f8c2593 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f413785c-ccec-450e-836a-7a92f3af1096 HTTP/1.1" status: 204 len: 168 time: 1.0541053 May 12 15:40:30.257193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-28f7431a-69b8-4576-9e9b-b8cb51bc22ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:30.292491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c402bb5a-442f-4b75-ba0c-cfd4bd5ba01e admin admin] Usage tracker for resource:security_group_rule and tenant:f2682ce89b774d1d993b6d5ab262d97b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:30.304940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28f7431a-69b8-4576-9e9b-b8cb51bc22ba None None] Routers {'c622fac9-6201-493c-99ca-1de3b27ccf7c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:40:30.305606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-28f7431a-69b8-4576-9e9b-b8cb51bc22ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:40:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c622fac9-6201-493c-99ca-1de3b27ccf7c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:30.467269 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-28f7431a-69b8-4576-9e9b-b8cb51bc22ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:30.471571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28f7431a-69b8-4576-9e9b-b8cb51bc22ba None None] The sync data for ids ['c622fac9-6201-493c-99ca-1de3b27ccf7c'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:40:30.473499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 80a299dc-ac88-40fc-9d83-8707660023fd completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:30.492220 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 80a299dc-ac88-40fc-9d83-8707660023fd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:30.492723 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:30.536677 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:30.698080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b432dbea-3b69-49f8-95d6-c8e03f8c2593 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f413785c-ccec-450e-836a-7a92f3af1096,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:30.704886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c402bb5a-442f-4b75-ba0c-cfd4bd5ba01e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:30.733421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c402bb5a-442f-4b75-ba0c-cfd4bd5ba01e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:30.822996 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:30.831585 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:30.899096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 80a299dc-ac88-40fc-9d83-8707660023fd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=80a299dc-ac88-40fc-9d83-8707660023fd,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:30.900776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afc47bb1-8f39-4af8-938b-2d8d8c249837 req-75646d6b-be02-4ed4-ae2f-4e9827e840af tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:30.903452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-afc47bb1-8f39-4af8-938b-2d8d8c249837 req-75646d6b-be02-4ed4-ae2f-4e9827e840af tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 946 time: 0.7546468 May 12 15:40:30.905699 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:30.906797 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a3ca589c-46a4-47c6-a8a8-4cbc670fb19c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:30.943631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Transition to ACTIVE for port object d3290597-fba6-41cb-a98f-3d1e1e3d542f will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:30.951984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37854) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:30.977005 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f93cfa0-954f-43fc-bb15-c45e7552cdb9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.015745 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.016966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9f93cfa0-954f-43fc-bb15-c45e7552cdb9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:31.022790 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9f93cfa0-954f-43fc-bb15-c45e7552cdb9 admin admin] Usage tracker for resource:security_group_rule and tenant:4f8f6cc3de214d3b80b50c834f9e56bd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:31.026512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9f93cfa0-954f-43fc-bb15-c45e7552cdb9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:31.031145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting port a6dd1cdf-7d31-400b-bb49-edeac0c25572 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:31.031879 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.033707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9f93cfa0-954f-43fc-bb15-c45e7552cdb9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:31.100900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=80a299dc-ac88-40fc-9d83-8707660023fd,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:31.126280 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:31.126705 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.131014 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f93cfa0-954f-43fc-bb15-c45e7552cdb9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.147260 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f93cfa0-954f-43fc-bb15-c45e7552cdb9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.343682 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-1293517a-3879-47f5-929b-96797b08c509 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] It took 0.34 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:40:31.357639 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-afc47bb1-8f39-4af8-938b-2d8d8c249837 req-f6048451-d24a-4661-9db6-4e240762b64d tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4374008 May 12 15:40:31.362940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.387591 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1293517a-3879-47f5-929b-96797b08c509 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.409565 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1293517a-3879-47f5-929b-96797b08c509 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.455004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f93cfa0-954f-43fc-bb15-c45e7552cdb9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=972ada90-cea9-4f1d-ba22-5b1fbd7bf71c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:31.461254 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9f93cfa0-954f-43fc-bb15-c45e7552cdb9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4f8f6cc3de214d3b80b50c834f9e56bd&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5082719 May 12 15:40:31.477047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37860) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:31.480505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-1293517a-3879-47f5-929b-96797b08c509 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] In _notify_port_updated(), no bound segment for port b26ffd28-9422-4f59-bd00-52dd1fff13ab on network a2a13f76-4a7a-4a28-a20f-e993b7379fe7 {{(pid=88152) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:40:31.487876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1293517a-3879-47f5-929b-96797b08c509 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:31.488075 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1293517a-3879-47f5-929b-96797b08c509 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.489347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1293517a-3879-47f5-929b-96797b08c509 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] 10.222.0.82 "PUT /v2.0/ports/b26ffd28-9422-4f59-bd00-52dd1fff13ab HTTP/1.1" status: 200 len: 1130 time: 1.8017504 May 12 15:40:31.496553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Calling delete_port for a6dd1cdf-7d31-400b-bb49-edeac0c25572 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:31.518293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37864) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:31.593227 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.652248 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c402bb5a-442f-4b75-ba0c-cfd4bd5ba01e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.666214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1293517a-3879-47f5-929b-96797b08c509 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Pushing event updated for resources: {'Port': ['ID=b26ffd28-9422-4f59-bd00-52dd1fff13ab,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:31.709997 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.733257 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c402bb5a-442f-4b75-ba0c-cfd4bd5ba01e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.743444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Network 144e0d0a-a7de-4e63-8a93-dfaca53a8328 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:31.769507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Port': ['ID=a6dd1cdf-7d31-400b-bb49-edeac0c25572,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:31.777427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:31.779637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:40:31.830032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67777f03-7ebe-4d71-bfd7-db3140dacfa1 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:31.830702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-67777f03-7ebe-4d71-bfd7-db3140dacfa1 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Synchronizing usage tracker for tenant:b5b6bed7c5384a038d2067fd4f6b3819 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:40:31.890831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d476af7-1771-433d-8335-5d1be9c86180 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.895985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:31.909892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c402bb5a-442f-4b75-ba0c-cfd4bd5ba01e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=03187a09-3e61-4d4f-88c2-5052bec571d3,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:31.915526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c402bb5a-442f-4b75-ba0c-cfd4bd5ba01e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f2682ce89b774d1d993b6d5ab262d97b&name=default HTTP/1.1" status: 200 len: 2983 time: 2.3585694 May 12 15:40:31.930885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Pushing event updated for resources: {'Port': ['ID=d3290597-fba6-41cb-a98f-3d1e1e3d542f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:31.949778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 80a299dc-ac88-40fc-9d83-8707660023fd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:31.968429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37868) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:32.006124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-67777f03-7ebe-4d71-bfd7-db3140dacfa1 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Unset dirty status for tenant:b5b6bed7c5384a038d2067fd4f6b3819 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:40:32.007292 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-67777f03-7ebe-4d71-bfd7-db3140dacfa1 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] 10.222.0.82 "GET /v2.0/ports/b26ffd28-9422-4f59-bd00-52dd1fff13ab HTTP/1.1" status: 200 len: 1130 time: 0.4870470 May 12 15:40:32.024720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37874) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:32.032309 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.036931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-09ea1e17-e730-4bea-a8db-e7406f60ead8 None None] Provisioning complete for port b26ffd28-9422-4f59-bd00-52dd1fff13ab triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:32.044887 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-09ea1e17-e730-4bea-a8db-e7406f60ead8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.085292 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d476af7-1771-433d-8335-5d1be9c86180 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.156791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-09ea1e17-e730-4bea-a8db-e7406f60ead8 None None] Port b26ffd28-9422-4f59-bd00-52dd1fff13ab cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:40:32.166490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 80a299dc-ac88-40fc-9d83-8707660023fd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:32.166936 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.176460 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.179876 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.219640 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.221694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Fanout notify agent at l3_agent the message router_deleted on router c622fac9-6201-493c-99ca-1de3b27ccf7c {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:40:32.246306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.250342 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1598e615-7367-45c4-b077-d0029b30c964 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/routers/c622fac9-6201-493c-99ca-1de3b27ccf7c HTTP/1.1" status: 204 len: 168 time: 2.1244030 May 12 15:40:32.251053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37878) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:32.265366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-c972fa16-a4a1-479b-8c7b-2ae8a80d69e3 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Deleting port b26ffd28-9422-4f59-bd00-52dd1fff13ab {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:32.265984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c972fa16-a4a1-479b-8c7b-2ae8a80d69e3 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.314247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-84e335b3-e350-44b1-8034-aa708b2d0904 None None] Provisioning for port d3290597-fba6-41cb-a98f-3d1e1e3d542f completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:32.325096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-84e335b3-e350-44b1-8034-aa708b2d0904 None None] Provisioning complete for port d3290597-fba6-41cb-a98f-3d1e1e3d542f triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:32.327698 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-84e335b3-e350-44b1-8034-aa708b2d0904 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.348054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-04942cd3-d3cb-4453-815a-1ee610e71e27 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Deleting subnet 6a6a3afc-f008-4a33-8e40-276ea11e299b {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:40:32.353476 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-04942cd3-d3cb-4453-815a-1ee610e71e27 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.455959 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-04942cd3-d3cb-4453-815a-1ee610e71e27 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.477378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-84e335b3-e350-44b1-8034-aa708b2d0904 None None] Port d3290597-fba6-41cb-a98f-3d1e1e3d542f cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:40:32.486561 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d198d487-4205-4470-be0b-ad3b11c8747c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.487617 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.536649 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d476af7-1771-433d-8335-5d1be9c86180 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.541769 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-04942cd3-d3cb-4453-815a-1ee610e71e27 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.605691 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d198d487-4205-4470-be0b-ad3b11c8747c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.624307 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-04942cd3-d3cb-4453-815a-1ee610e71e27 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.627921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d476af7-1771-433d-8335-5d1be9c86180 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=972ada90-cea9-4f1d-ba22-5b1fbd7bf71c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:32.670739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04942cd3-d3cb-4453-815a-1ee610e71e27 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Subnet': ['ID=6a6a3afc-f008-4a33-8e40-276ea11e299b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:32.684879 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-04942cd3-d3cb-4453-815a-1ee610e71e27 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.696613 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-04942cd3-d3cb-4453-815a-1ee610e71e27 tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/subnets/6a6a3afc-f008-4a33-8e40-276ea11e299b HTTP/1.1" status: 204 len: 168 time: 0.4443121 May 12 15:40:32.699020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37884) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:32.747103 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d476af7-1771-433d-8335-5d1be9c86180 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.748343 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8d476af7-1771-433d-8335-5d1be9c86180 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/972ada90-cea9-4f1d-ba22-5b1fbd7bf71c HTTP/1.1" status: 204 len: 168 time: 1.2578299 May 12 15:40:32.854245 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69f536ef-9091-4d03-a85e-adb86fdc6c4c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.882860 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.920479 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c972fa16-a4a1-479b-8c7b-2ae8a80d69e3 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:32.956088 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d198d487-4205-4470-be0b-ad3b11c8747c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:33.026276 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69f536ef-9091-4d03-a85e-adb86fdc6c4c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:33.067131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3c1d39f-d3c1-43c6-9b20-23b4fb9d7cf2 req-069cd107-95e9-4bb6-8c72-1ded40760fc6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:33.079133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3c1d39f-d3c1-43c6-9b20-23b4fb9d7cf2 req-069cd107-95e9-4bb6-8c72-1ded40760fc6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 946 time: 0.5434082 May 12 15:40:33.156827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d198d487-4205-4470-be0b-ad3b11c8747c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=03187a09-3e61-4d4f-88c2-5052bec571d3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:33.166959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-c972fa16-a4a1-479b-8c7b-2ae8a80d69e3 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Calling delete_port for b26ffd28-9422-4f59-bd00-52dd1fff13ab owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:33.192772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-69f536ef-9091-4d03-a85e-adb86fdc6c4c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2d338475-91c7-4829-98f2-54874ae73504']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:33.208971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-69f536ef-9091-4d03-a85e-adb86fdc6c4c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b4cb4823-b26b-42a9-a8a8-2383c10a1371') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:33.209601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-69f536ef-9091-4d03-a85e-adb86fdc6c4c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b4cb4823-b26b-42a9-a8a8-2383c10a1371') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:33.224609 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69f536ef-9091-4d03-a85e-adb86fdc6c4c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:33.258040 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69f536ef-9091-4d03-a85e-adb86fdc6c4c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:33.265706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-69f536ef-9091-4d03-a85e-adb86fdc6c4c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Releasing vlan 550 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:40:33.267384 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69f536ef-9091-4d03-a85e-adb86fdc6c4c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: timer() May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:40:33.287554 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:40:33.309642 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d198d487-4205-4470-be0b-ad3b11c8747c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:33.313956 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d198d487-4205-4470-be0b-ad3b11c8747c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/03187a09-3e61-4d4f-88c2-5052bec571d3 HTTP/1.1" status: 204 len: 168 time: 1.3411760 May 12 15:40:33.376833 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3c1d39f-d3c1-43c6-9b20-23b4fb9d7cf2 req-48a42560-844d-4641-9a4a-76b6c6eb673e tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2967870 May 12 15:40:33.495096 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69f536ef-9091-4d03-a85e-adb86fdc6c4c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:33.512616 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-69f536ef-9091-4d03-a85e-adb86fdc6c4c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:33.594203 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-69f536ef-9091-4d03-a85e-adb86fdc6c4c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] 10.222.0.82 "DELETE /v2.0/networks/2d338475-91c7-4829-98f2-54874ae73504 HTTP/1.1" status: 204 len: 168 time: 0.8916204 May 12 15:40:33.594203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69f536ef-9091-4d03-a85e-adb86fdc6c4c tempest-FloatingIPTestJSON-12701767 tempest-FloatingIPTestJSON-12701767-project] Pushing event deleted for resources: {'Network': ['ID=2d338475-91c7-4829-98f2-54874ae73504,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:33.712298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37912) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:33.760936 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c972fa16-a4a1-479b-8c7b-2ae8a80d69e3 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:33.902065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c972fa16-a4a1-479b-8c7b-2ae8a80d69e3 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Pushing event deleted for resources: {'Port': ['ID=b26ffd28-9422-4f59-bd00-52dd1fff13ab,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:33.915105 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c972fa16-a4a1-479b-8c7b-2ae8a80d69e3 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:33.919619 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:40:33.935446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37924) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:33.943467 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:33.955178 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:33.966385 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82be98fd-f280-47c0-8667-8effae6ee5cc admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:33.997265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-82be98fd-f280-47c0-8667-8effae6ee5cc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:34.008576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-82be98fd-f280-47c0-8667-8effae6ee5cc admin admin] Usage tracker for resource:security_group_rule and tenant:bcfa0af3faec4a9797d24e1f7b3d0609 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:34.011869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-82be98fd-f280-47c0-8667-8effae6ee5cc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:34.027153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-82be98fd-f280-47c0-8667-8effae6ee5cc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:34.061528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c972fa16-a4a1-479b-8c7b-2ae8a80d69e3 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] 10.222.0.82 "DELETE /v2.0/ports/b26ffd28-9422-4f59-bd00-52dd1fff13ab HTTP/1.1" status: 204 len: 168 time: 2.0252995 May 12 15:40:34.070594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37930) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:34.191907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Pushing event updated for resources: {'Port': ['ID=d3290597-fba6-41cb-a98f-3d1e1e3d542f,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:34.202347 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.230746 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82be98fd-f280-47c0-8667-8effae6ee5cc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.239072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-1cba1371-9864-442d-98c8-e671bf7e225d tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Deleting subnet baa1741c-396f-4bda-a3ff-5f8c45c7cf03 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:40:34.241019 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-82be98fd-f280-47c0-8667-8effae6ee5cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.294941 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1cba1371-9864-442d-98c8-e671bf7e225d tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.328081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82be98fd-f280-47c0-8667-8effae6ee5cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c33f42bc-a38e-40d6-b390-87882f954ab5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:34.371194 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-82be98fd-f280-47c0-8667-8effae6ee5cc admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bcfa0af3faec4a9797d24e1f7b3d0609&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4320498 May 12 15:40:34.371452 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37938) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:34.394414 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3f45b5a-0bb0-424c-aa24-59a19ae94bb7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.411525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37944) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:34.412559 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1cba1371-9864-442d-98c8-e671bf7e225d tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.415286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d3f45b5a-0bb0-424c-aa24-59a19ae94bb7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:34.423247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d3f45b5a-0bb0-424c-aa24-59a19ae94bb7 admin admin] Usage tracker for resource:security_group_rule and tenant:1fc8c6b309cf44e0a46df03c25e99fd0 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:34.427108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d3f45b5a-0bb0-424c-aa24-59a19ae94bb7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:34.434994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d3f45b5a-0bb0-424c-aa24-59a19ae94bb7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:34.522262 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1cba1371-9864-442d-98c8-e671bf7e225d tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.605844 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3f45b5a-0bb0-424c-aa24-59a19ae94bb7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.623340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3f45b5a-0bb0-424c-aa24-59a19ae94bb7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.682676 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8007481d-4794-4c06-8ad9-ef90be498066 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.694247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Network 144e0d0a-a7de-4e63-8a93-dfaca53a8328 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:34.699967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:34.744175 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d3f45b5a-0bb0-424c-aa24-59a19ae94bb7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1fc8c6b309cf44e0a46df03c25e99fd0&name=default HTTP/1.1" status: 200 len: 2983 time: 1.0315392 May 12 15:40:34.748206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37960) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:34.750723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f45b5a-0bb0-424c-aa24-59a19ae94bb7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c204ad88-bfb0-4d7b-948e-0145495ce077,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:34.770613 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b7ed7921-f732-4b94-bf85-048035b71844 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9d4bdd73a39f4390bb7d4c6d7a1fc0c4&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3581228 May 12 15:40:34.775014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37964) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:34.890075 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8007481d-4794-4c06-8ad9-ef90be498066 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.895668 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca02ff1d-61bc-448d-9417-01db33adc2f2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.928068 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca02ff1d-61bc-448d-9417-01db33adc2f2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.938459 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1cba1371-9864-442d-98c8-e671bf7e225d tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.951849 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-535b69d3-7589-4f89-ad81-c913ab59845f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:34.994894 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-535b69d3-7589-4f89-ad81-c913ab59845f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:35.037011 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-553f7405-198e-434f-bb35-2d4e46731042 None None] Provisioning complete for port d3290597-fba6-41cb-a98f-3d1e1e3d542f triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:35.038067 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-553f7405-198e-434f-bb35-2d4e46731042 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:35.055560 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca02ff1d-61bc-448d-9417-01db33adc2f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:35.076925 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1cba1371-9864-442d-98c8-e671bf7e225d tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:35.083191 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-535b69d3-7589-4f89-ad81-c913ab59845f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:35.100109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cba1371-9864-442d-98c8-e671bf7e225d tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Pushing event deleted for resources: {'Subnet': ['ID=baa1741c-396f-4bda-a3ff-5f8c45c7cf03,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:35.114293 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1cba1371-9864-442d-98c8-e671bf7e225d tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] 10.222.0.82 "DELETE /v2.0/subnets/baa1741c-396f-4bda-a3ff-5f8c45c7cf03 HTTP/1.1" status: 204 len: 168 time: 1.0271270 May 12 15:40:35.116861 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-553f7405-198e-434f-bb35-2d4e46731042 None None] Port d3290597-fba6-41cb-a98f-3d1e1e3d542f cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:40:35.117611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 37974) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:35.121135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-535b69d3-7589-4f89-ad81-c913ab59845f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:35.124575 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-535b69d3-7589-4f89-ad81-c913ab59845f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9711e2e0-d907-4e94-b984-435b9465a2e8 HTTP/1.1" status: 204 len: 168 time: 0.3464093 May 12 15:40:35.124575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca02ff1d-61bc-448d-9417-01db33adc2f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c204ad88-bfb0-4d7b-948e-0145495ce077,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:35.125588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b696ab1-b7d7-40f8-be71-040f2ac2d8a3 None None] Network a2a13f76-4a7a-4a28-a20f-e993b7379fe7 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:35.145951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535b69d3-7589-4f89-ad81-c913ab59845f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9711e2e0-d907-4e94-b984-435b9465a2e8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:35.152116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ea4906-4a01-416d-8099-bcd3d0c8ceb6 req-f3fab8dd-1c77-4c70-b891-158ddcfaedcd tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:35.153679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85ea4906-4a01-416d-8099-bcd3d0c8ceb6 req-f3fab8dd-1c77-4c70-b891-158ddcfaedcd tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 946 time: 0.3510549 May 12 15:40:35.155627 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca02ff1d-61bc-448d-9417-01db33adc2f2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:35.159690 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ca02ff1d-61bc-448d-9417-01db33adc2f2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c204ad88-bfb0-4d7b-948e-0145495ce077 HTTP/1.1" status: 204 len: 168 time: 0.4101174 May 12 15:40:35.322342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Router 7b4592bb-783c-491e-8854-09b8b7ceb354 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:40:35.386048 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8007481d-4794-4c06-8ad9-ef90be498066 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:35.483888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] DHCP port deletion for a2a13f76-4a7a-4a28-a20f-e993b7379fe7 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:40:35.490725 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] Deleting port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:35.491408 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:35.575314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37988) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:35.589901 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-85ea4906-4a01-416d-8099-bcd3d0c8ceb6 req-5cc3865c-6c99-4668-a3e1-3f478225efc6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3295243 May 12 15:40:35.615954 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:35.615954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8007481d-4794-4c06-8ad9-ef90be498066 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c33f42bc-a38e-40d6-b390-87882f954ab5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:35.632480 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8007481d-4794-4c06-8ad9-ef90be498066 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:35.635879 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8007481d-4794-4c06-8ad9-ef90be498066 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c33f42bc-a38e-40d6-b390-87882f954ab5 HTTP/1.1" status: 204 len: 168 time: 1.2617164 May 12 15:40:35.657681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Deleting port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:35.658099 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:35.824894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:40:35.837776 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d3adc2c0-16d3-421f-bd87-625138ae2e29 admin admin] 10.222.0.82 "PUT /v2.0/routers/7b4592bb-783c-491e-8854-09b8b7ceb354/add_router_interface HTTP/1.1" status: 200 len: 503 time: 12.0323465 May 12 15:40:35.837985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 37998) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:35.856783 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Sync routers for ids ['7b4592bb-783c-491e-8854-09b8b7ceb354'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:40:35.872826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] For port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=90de2846-968a-47a7-a7ec-3f5bcb9db1d1,segment=NetworkSegment(4bfc1ff9-edb6-41cb-83a5-1aa76100e959),segment_id=4bfc1ff9-edb6-41cb-83a5-1aa76100e959)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:35.873551 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:35.879173 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Routers {'7b4592bb-783c-491e-8854-09b8b7ceb354'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:40:35.887180 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:40:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7b4592bb-783c-491e-8854-09b8b7ceb354'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:35.925327 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-447f28ac-6c13-4e12-b43d-e5cad6df8f58 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:35.969919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:40:36.003812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-447f28ac-6c13-4e12-b43d-e5cad6df8f58 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:36.012371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-447f28ac-6c13-4e12-b43d-e5cad6df8f58 admin admin] Usage tracker for resource:security_group_rule and tenant:37054946eab24034a4067f3fc18f0b5b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:36.024076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-447f28ac-6c13-4e12-b43d-e5cad6df8f58 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:36.050827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-447f28ac-6c13-4e12-b43d-e5cad6df8f58 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:36.109280 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] Calling delete_port for 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:36.179710 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-447f28ac-6c13-4e12-b43d-e5cad6df8f58 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.185076 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-447f28ac-6c13-4e12-b43d-e5cad6df8f58 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.191308 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Set router 7b4592bb-783c-491e-8854-09b8b7ceb354 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:40:36.265029 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b08ea53-8eac-443d-a12c-a9697f87c9a9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.287699 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-447f28ac-6c13-4e12-b43d-e5cad6df8f58 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=37054946eab24034a4067f3fc18f0b5b&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4462492 May 12 15:40:36.288319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-447f28ac-6c13-4e12-b43d-e5cad6df8f58 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6053a48d-49ec-41bf-8a05-6cc360bc8241,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:36.304725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38006) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:36.337805 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.339132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5b08ea53-8eac-443d-a12c-a9697f87c9a9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:36.388838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] For port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=90de2846-968a-47a7-a7ec-3f5bcb9db1d1,segment=NetworkSegment(4bfc1ff9-edb6-41cb-83a5-1aa76100e959),segment_id=4bfc1ff9-edb6-41cb-83a5-1aa76100e959)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:36.391141 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.397041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=90de2846-968a-47a7-a7ec-3f5bcb9db1d1,segment=NetworkSegment(4bfc1ff9-edb6-41cb-83a5-1aa76100e959),segment_id=4bfc1ff9-edb6-41cb-83a5-1aa76100e959)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:36.404638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5b08ea53-8eac-443d-a12c-a9697f87c9a9 admin admin] Usage tracker for resource:security_group_rule and tenant:db94cac870874056bdcedc07f20e42c1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:36.410531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5b08ea53-8eac-443d-a12c-a9697f87c9a9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:36.426087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5b08ea53-8eac-443d-a12c-a9697f87c9a9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:36.436200 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.452039 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9ffa55c6-8bd9-4228-8969-10b85bb1cbaf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.484366 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9ffa55c6-8bd9-4228-8969-10b85bb1cbaf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.563971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9ffa55c6-8bd9-4228-8969-10b85bb1cbaf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.588321 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:40:36.588836 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:40:36.613853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=90de2846-968a-47a7-a7ec-3f5bcb9db1d1,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:36.623582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ffa55c6-8bd9-4228-8969-10b85bb1cbaf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6053a48d-49ec-41bf-8a05-6cc360bc8241,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:36.630763 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9ffa55c6-8bd9-4228-8969-10b85bb1cbaf admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.631909 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9ffa55c6-8bd9-4228-8969-10b85bb1cbaf admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6053a48d-49ec-41bf-8a05-6cc360bc8241 HTTP/1.1" status: 204 len: 168 time: 0.3229942 May 12 15:40:36.722942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Calling delete_port for 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:36.739915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b08ea53-8eac-443d-a12c-a9697f87c9a9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.744778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38024) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:36.756520 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'name': 'tempest-TestVolumeBackupRestore-1378188961-router', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.127'}], 'enable_snat': True}, 'gw_port_id': '80a299dc-ac88-40fc-9d83-8707660023fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:40:17Z', 'updated_at': '2022-05-12T15:40:32Z', 'revision_number': 4, 'project_id': 'd5937b60103242ddb97055720836a8ff', 'gw_port': {'id': '80a299dc-ac88-40fc-9d83-8707660023fd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:c3:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3235, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:19Z', 'updated_at': '2022-05-12T15:40:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'd3290597-fba6-41cb-a98f-3d1e1e3d542f', 'name': '', 'network_id': '144e0d0a-a7de-4e63-8a93-dfaca53a8328', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'mac_address': 'fa:16:3e:2e:e2:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'device_owner': 'network:router_interface', 'standard_attr_id': 3239, 'fixed_ips': [{'subnet_id': '8199d329-88ea-42b4-8648-caba92394460', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:27Z', 'updated_at': '2022-05-12T15:40:33Z', 'revision_number': 2, 'project_id': 'd5937b60103242ddb97055720836a8ff', 'subnets': [{'id': '8199d329-88ea-42b4-8648-caba92394460', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:36.763052 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Checking router: 7b4592bb-783c-491e-8854-09b8b7ceb354 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:40:36.764422 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Updating router 7b4592bb-783c-491e-8854-09b8b7ceb354 port d3290597-fba6-41cb-a98f-3d1e1e3d542f binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:40:36.786543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b08ea53-8eac-443d-a12c-a9697f87c9a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.793415 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-62f856a9-3fd8-42ce-b412-0eeba882f085 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.837325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b08ea53-8eac-443d-a12c-a9697f87c9a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6533d4ab-7ba1-45e6-bc6a-3bc5c4fecc93,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:36.855307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-62f856a9-3fd8-42ce-b412-0eeba882f085 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:36.863307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-62f856a9-3fd8-42ce-b412-0eeba882f085 admin admin] Usage tracker for resource:security_group_rule and tenant:f401f2bb5c17449abbbf7a291d4a08ac is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:36.868413 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5b08ea53-8eac-443d-a12c-a9697f87c9a9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=db94cac870874056bdcedc07f20e42c1&name=default HTTP/1.1" status: 200 len: 2983 time: 1.2907877 May 12 15:40:36.869467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-62f856a9-3fd8-42ce-b412-0eeba882f085 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:36.872702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38028) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:36.880219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1a1800-9c74-4313-8128-3a5687476372 req-57f152ec-dee7-430c-a189-ae9517016785 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:36.881805 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd1a1800-9c74-4313-8128-3a5687476372 req-57f152ec-dee7-430c-a189-ae9517016785 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.84 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 946 time: 0.6810012 May 12 15:40:36.887922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-62f856a9-3fd8-42ce-b412-0eeba882f085 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:36.890904 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.985335 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e1a7466c-096e-4f64-9c8d-cb18c4a2c998 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:36.986127 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:40:36.986404 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:40:36.993265 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-dd1a1800-9c74-4313-8128-3a5687476372 req-128ccd01-cd24-4405-bca1-5736cd2209b6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Deleting port 87fec19b-446c-4edb-905b-6c36fbfa250f {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:36.993710 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd1a1800-9c74-4313-8128-3a5687476372 req-128ccd01-cd24-4405-bca1-5736cd2209b6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:37.032096 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e1a7466c-096e-4f64-9c8d-cb18c4a2c998 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:37.090455 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] Deleting port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:37.091384 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:37.103981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b892693e-403f-4b07-ac69-254169df8bc2 req-9f5eb0a8-dff6-42ea-a7e5-676cd5f5a871 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:37.105585 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b892693e-403f-4b07-ac69-254169df8bc2 req-9f5eb0a8-dff6-42ea-a7e5-676cd5f5a871 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 946 time: 0.3255074 May 12 15:40:37.114575 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-62f856a9-3fd8-42ce-b412-0eeba882f085 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:37.128958 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-62f856a9-3fd8-42ce-b412-0eeba882f085 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:37.233036 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e1a7466c-096e-4f64-9c8d-cb18c4a2c998 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:37.275294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62f856a9-3fd8-42ce-b412-0eeba882f085 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3eabefbf-5186-4575-bca4-bc8ada938454,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:37.312358 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-62f856a9-3fd8-42ce-b412-0eeba882f085 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f401f2bb5c17449abbbf7a291d4a08ac&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5622935 May 12 15:40:37.313045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38060) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:37.349937 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e1a7466c-096e-4f64-9c8d-cb18c4a2c998 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:37.353456 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e1a7466c-096e-4f64-9c8d-cb18c4a2c998 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6533d4ab-7ba1-45e6-bc6a-3bc5c4fecc93 HTTP/1.1" status: 204 len: 168 time: 0.4782834 May 12 15:40:37.354660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1a7466c-096e-4f64-9c8d-cb18c4a2c998 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6533d4ab-7ba1-45e6-bc6a-3bc5c4fecc93,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:37.391612 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b892693e-403f-4b07-ac69-254169df8bc2 req-6dd4cec7-0ee6-4681-a4aa-538856cea5e5 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2425041 May 12 15:40:37.485429 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bd222312-96da-413b-88fd-0ffd661b5197 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:37.544566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Deleting port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:37.548790 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:37.558767 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bd222312-96da-413b-88fd-0ffd661b5197 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:37.710788 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bd222312-96da-413b-88fd-0ffd661b5197 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:37.756006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd222312-96da-413b-88fd-0ffd661b5197 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3eabefbf-5186-4575-bca4-bc8ada938454,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:37.766299 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:37.790014 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bd222312-96da-413b-88fd-0ffd661b5197 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:37.794909 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Transition to ACTIVE for port object d3290597-fba6-41cb-a98f-3d1e1e3d542f will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:37.796524 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bd222312-96da-413b-88fd-0ffd661b5197 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3eabefbf-5186-4575-bca4-bc8ada938454 HTTP/1.1" status: 204 len: 168 time: 0.4766564 May 12 15:40:37.802142 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] For port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=90de2846-968a-47a7-a7ec-3f5bcb9db1d1,segment=NetworkSegment(4bfc1ff9-edb6-41cb-83a5-1aa76100e959),segment_id=4bfc1ff9-edb6-41cb-83a5-1aa76100e959)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:37.802929 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:37.813042 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:38.140319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] Calling delete_port for 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:38.282450 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5f8c76c-e784-49fc-be8f-9926c306f28e None None] Pushing event updated for resources: {'Port': ['ID=d3290597-fba6-41cb-a98f-3d1e1e3d542f,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:38.334502 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Attempting to bind port d3290597-fba6-41cb-a98f-3d1e1e3d542f on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:40:38.338255 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Attempting to bind port d3290597-fba6-41cb-a98f-3d1e1e3d542f by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'cd102ff7-1d00-44b5-ae17-4227b811564b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '144e0d0a-a7de-4e63-8a93-dfaca53a8328'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:40:38.340076 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Attempting to bind port d3290597-fba6-41cb-a98f-3d1e1e3d542f on network 144e0d0a-a7de-4e63-8a93-dfaca53a8328 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:40:38.364019 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 40, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:40:38.364401 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Checking segment: {'id': 'cd102ff7-1d00-44b5-ae17-4227b811564b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '144e0d0a-a7de-4e63-8a93-dfaca53a8328'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:38.365125 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:38.366473 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Bound using segment: {'id': 'cd102ff7-1d00-44b5-ae17-4227b811564b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '144e0d0a-a7de-4e63-8a93-dfaca53a8328'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:40:38.368272 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Bound port: d3290597-fba6-41cb-a98f-3d1e1e3d542f, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cd102ff7-1d00-44b5-ae17-4227b811564b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '144e0d0a-a7de-4e63-8a93-dfaca53a8328'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:40:38.371980 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:38.381686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] For port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=90de2846-968a-47a7-a7ec-3f5bcb9db1d1,segment=NetworkSegment(4bfc1ff9-edb6-41cb-83a5-1aa76100e959),segment_id=4bfc1ff9-edb6-41cb-83a5-1aa76100e959)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:38.382281 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:38.429099 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:38.561106 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] No DVR routers for this DVR port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:40:38.567609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa07bdfa-0660-400e-b67c-e4573d1c985a None None] Pushing event deleted for resources: {'Port': ['ID=90de2846-968a-47a7-a7ec-3f5bcb9db1d1,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:38.599082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Calling delete_port for 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:38.701762 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:40:38.702278 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:40:38.702738 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] For port d3290597-fba6-41cb-a98f-3d1e1e3d542f, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:40:38.707340 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] For port d3290597-fba6-41cb-a98f-3d1e1e3d542f, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d3290597-fba6-41cb-a98f-3d1e1e3d542f,segment=NetworkSegment(cd102ff7-1d00-44b5-ae17-4227b811564b),segment_id=cd102ff7-1d00-44b5-ae17-4227b811564b)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:40:38.707656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-dd1a1800-9c74-4313-8128-3a5687476372 req-128ccd01-cd24-4405-bca1-5736cd2209b6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] For port 87fec19b-446c-4edb-905b-6c36fbfa250f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=87fec19b-446c-4edb-905b-6c36fbfa250f,segment=NetworkSegment(09c83b83-4d53-47f0-b181-c0fb6ed7f95d),segment_id=09c83b83-4d53-47f0-b181-c0fb6ed7f95d)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:38.708184 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd1a1800-9c74-4313-8128-3a5687476372 req-128ccd01-cd24-4405-bca1-5736cd2209b6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:38.720286 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:38.903140 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Routers {'7b4592bb-783c-491e-8854-09b8b7ceb354'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:40:38.904268 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:40:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7b4592bb-783c-491e-8854-09b8b7ceb354'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:39.041766 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5f8c76c-e784-49fc-be8f-9926c306f28e None None] Pushing event updated for resources: {'Port': ['ID=d3290597-fba6-41cb-a98f-3d1e1e3d542f,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:39.217007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38146) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:39.274207 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] Set router 7b4592bb-783c-491e-8854-09b8b7ceb354 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:40:39.278937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Deleting port 90de2846-968a-47a7-a7ec-3f5bcb9db1d1 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:39.279287 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:39.327243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-dd1a1800-9c74-4313-8128-3a5687476372 req-128ccd01-cd24-4405-bca1-5736cd2209b6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Calling delete_port for 87fec19b-446c-4edb-905b-6c36fbfa250f owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:39.474103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] The port '90de2846-968a-47a7-a7ec-3f5bcb9db1d1' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:40:39.658770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66867417-2ef4-431d-a013-894b57657037 req-37a84cab-7b7d-4778-ba98-4c4bf340af3d tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:39.666841 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66867417-2ef4-431d-a013-894b57657037 req-37a84cab-7b7d-4778-ba98-4c4bf340af3d tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 946 time: 0.9620609 May 12 15:40:39.739272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-758784651'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:39.747941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:39.765811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:network and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:39.770077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:39.793454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:39.811891 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:39.820527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:39.824740 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:39.832702 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 87fec19b-446c-4edb-905b-6c36fbfa250f no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:40:39.861656 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:39.881454 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'name': 'tempest-TestVolumeBackupRestore-1378188961-router', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.127'}], 'enable_snat': True}, 'gw_port_id': '80a299dc-ac88-40fc-9d83-8707660023fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:40:17Z', 'updated_at': '2022-05-12T15:40:32Z', 'revision_number': 4, 'project_id': 'd5937b60103242ddb97055720836a8ff', 'gw_port': {'id': '80a299dc-ac88-40fc-9d83-8707660023fd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:c3:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3235, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:19Z', 'updated_at': '2022-05-12T15:40:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'd3290597-fba6-41cb-a98f-3d1e1e3d542f', 'name': '', 'network_id': '144e0d0a-a7de-4e63-8a93-dfaca53a8328', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'mac_address': 'fa:16:3e:2e:e2:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'device_owner': 'network:router_interface', 'standard_attr_id': 3239, 'fixed_ips': [{'subnet_id': '8199d329-88ea-42b4-8648-caba92394460', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:27Z', 'updated_at': '2022-05-12T15:40:38Z', 'revision_number': 4, 'project_id': 'd5937b60103242ddb97055720836a8ff', 'subnets': [{'id': '8199d329-88ea-42b4-8648-caba92394460', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:39.887411 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7147f49-d97f-444e-a0e6-1b207cce0832 None None] The sync data for ids ['7b4592bb-783c-491e-8854-09b8b7ceb354'] in n-d-841483-1 is: [{'id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'name': 'tempest-TestVolumeBackupRestore-1378188961-router', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.127'}], 'enable_snat': True}, 'gw_port_id': '80a299dc-ac88-40fc-9d83-8707660023fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:40:17Z', 'updated_at': '2022-05-12T15:40:32Z', 'revision_number': 4, 'project_id': 'd5937b60103242ddb97055720836a8ff', 'gw_port': {'id': '80a299dc-ac88-40fc-9d83-8707660023fd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:c3:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3235, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:19Z', 'updated_at': '2022-05-12T15:40:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'd3290597-fba6-41cb-a98f-3d1e1e3d542f', 'name': '', 'network_id': '144e0d0a-a7de-4e63-8a93-dfaca53a8328', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'mac_address': 'fa:16:3e:2e:e2:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'device_owner': 'network:router_interface', 'standard_attr_id': 3239, 'fixed_ips': [{'subnet_id': '8199d329-88ea-42b4-8648-caba92394460', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:27Z', 'updated_at': '2022-05-12T15:40:38Z', 'revision_number': 4, 'project_id': 'd5937b60103242ddb97055720836a8ff', 'subnets': [{'id': '8199d329-88ea-42b4-8648-caba92394460', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:40:39.918520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:39.929656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:security_group_rule and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:39.938148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:39.954268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:40.004583 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66867417-2ef4-431d-a013-894b57657037 req-506fd3c4-fe95-49a1-ac85-8ab7026eb7af tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/security-groups?id=5eb3848b-51ff-479d-bc4a-37b90b9c5382&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3365524 May 12 15:40:40.053141 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd1a1800-9c74-4313-8128-3a5687476372 req-128ccd01-cd24-4405-bca1-5736cd2209b6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:40.057240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a2a13f76-4a7a-4a28-a20f-e993b7379fe7']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:40.149349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Port 87fec19b-446c-4edb-905b-6c36fbfa250f update to DOWN by agent not found {{(pid=88153) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2140}} May 12 15:40:40.159739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-128ccd01-cd24-4405-bca1-5736cd2209b6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Pushing event deleted for resources: {'Port': ['ID=87fec19b-446c-4edb-905b-6c36fbfa250f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:40.173192 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:40.177902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4bfc1ff9-edb6-41cb-83a5-1aa76100e959') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:40.178093 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:40.178389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4bfc1ff9-edb6-41cb-83a5-1aa76100e959') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:40.234342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 579} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:40:40.250063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a788ddaa-e1a6-465e-8111-f2cd19549898,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:40.260187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:40.260790 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Added segment c974e42a-0498-41b2-bf96-f8948fad5d0b of type vlan for network 4e892bc1-e9cd-4ae0-afba-9426073de30e May 12 15:40:40.294894 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:40.365485 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:40.378662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:40.379509 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:40.385519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-dd1a1800-9c74-4313-8128-3a5687476372 req-128ccd01-cd24-4405-bca1-5736cd2209b6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] No DVR routers for this DVR port 87fec19b-446c-4edb-905b-6c36fbfa250f on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:40:40.390744 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:40.412692 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-dd1a1800-9c74-4313-8128-3a5687476372 req-128ccd01-cd24-4405-bca1-5736cd2209b6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:40.415322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3e24e01e-91e6-4ab8-aca2-78714b1cccb2', 'name': 'network-vif-deleted', 'tag': '87fec19b-446c-4edb-905b-6c36fbfa250f'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:40:40.492500 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:40.509658 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd1a1800-9c74-4313-8128-3a5687476372 req-128ccd01-cd24-4405-bca1-5736cd2209b6 tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.84 "DELETE /v2.0/ports/87fec19b-446c-4edb-905b-6c36fbfa250f HTTP/1.1" status: 204 len: 173 time: 3.6135950 May 12 15:40:40.513811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Releasing vlan 551 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:40:40.515097 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: timer() May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:40:40.553950 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:40:40.566795 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2542a8eb-f208-42c2-8b08-8d0162e86470'] response: {'server_uuid': '3e24e01e-91e6-4ab8-aca2-78714b1cccb2', 'name': 'network-vif-deleted', 'tag': '87fec19b-446c-4edb-905b-6c36fbfa250f', 'status': 'completed', 'code': 200} May 12 15:40:40.687054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Network': ['ID=4e892bc1-e9cd-4ae0-afba-9426073de30e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:40.702324 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6e921af6-dc6c-493e-be85-8700a10bb391 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 1.4841838 May 12 15:40:40.731707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 4e892bc1-e9cd-4ae0-afba-9426073de30e details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:40:40.875109 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:40.938359 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:40.952448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] 10.222.0.82 "DELETE /v2.0/networks/a2a13f76-4a7a-4a28-a20f-e993b7379fe7 HTTP/1.1" status: 204 len: 168 time: 5.8292260 May 12 15:40:40.959457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27901950-0c95-4499-9819-18de03454a29 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724 tempest-ExtraDHCPOptionsIpV6TestJSON-1904083724-project] Pushing event deleted for resources: {'Network': ['ID=a2a13f76-4a7a-4a28-a20f-e993b7379fe7,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:40.976431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-051b14de-bfbb-40a3-8e8c-d51292186f6a req-889de288-ff5a-4fed-8570-31cd667152a1 tempest-DeleteServersTestJSON-341381432 tempest-DeleteServersTestJSON-341381432-project] (88151) timed out ('10.222.0.84', 55229) {{(pid=88151) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 15:40:41.122133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-f2681775-34fd-46d3-adcf-ca2a83e0ae70 req-d314876a-eb71-47a2-928d-0ec496880719 service neutron] (88151) timed out ('10.222.0.84', 55124) {{(pid=88151) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 15:40:41.541726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-695cb5ef-b4c5-4a87-be46-57509911adfc req-21f04c78-0e59-4ef1-a242-a187bd82162b tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Synchronizing usage tracker for tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:40:41.579935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-695cb5ef-b4c5-4a87-be46-57509911adfc req-21f04c78-0e59-4ef1-a242-a187bd82162b tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] Unset dirty status for tenant:f798fdc3e9c54b38b7dbb0478a1d31d6 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:40:41.582488 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-695cb5ef-b4c5-4a87-be46-57509911adfc req-21f04c78-0e59-4ef1-a242-a187bd82162b tempest-VolumesActionsTest-73796904 tempest-VolumesActionsTest-73796904-project] 10.222.0.82 "GET /v2.0/ports?device_id=3e24e01e-91e6-4ab8-aca2-78714b1cccb2 HTTP/1.1" status: 200 len: 210 time: 0.2560060 May 12 15:40:42.013831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d3290597-fba6-41cb-a98f-3d1e1e3d542f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:42.094706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38212) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:42.121200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38218) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:42.175717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port d3290597-fba6-41cb-a98f-3d1e1e3d542f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:42.182440 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port d3290597-fba6-41cb-a98f-3d1e1e3d542f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:42.182720 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:42.344422 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ab682aa-cc3e-4dd1-928c-378ac920ef6f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:42.382504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8ab682aa-cc3e-4dd1-928c-378ac920ef6f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:42.394837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8ab682aa-cc3e-4dd1-928c-378ac920ef6f admin admin] Usage tracker for resource:security_group_rule and tenant:d24efe72ed8741a1a057d573112e626e is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:42.400664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8ab682aa-cc3e-4dd1-928c-378ac920ef6f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:42.421779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8ab682aa-cc3e-4dd1-928c-378ac920ef6f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:42.429338 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:42.482619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port d3290597-fba6-41cb-a98f-3d1e1e3d542f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d3290597-fba6-41cb-a98f-3d1e1e3d542f,segment=NetworkSegment(cd102ff7-1d00-44b5-ae17-4227b811564b),segment_id=cd102ff7-1d00-44b5-ae17-4227b811564b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:42.492234 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:42.615474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=d3290597-fba6-41cb-a98f-3d1e1e3d542f,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:42.651852 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ab682aa-cc3e-4dd1-928c-378ac920ef6f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:42.660332 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ab682aa-cc3e-4dd1-928c-378ac920ef6f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:42.666693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-79ea9d55-fb5f-430d-985e-3e4593fbcad0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b5b6bed7c5384a038d2067fd4f6b3819&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5411761 May 12 15:40:42.668700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38236) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:42.751675 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-892cdefa-7031-4d04-abbe-6eaabff3fc76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:42.826972 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-189c23cc-de02-4fed-a405-863d485b6a97 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:42.870233 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-189c23cc-de02-4fed-a405-863d485b6a97 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:42.914361 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8ab682aa-cc3e-4dd1-928c-378ac920ef6f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d24efe72ed8741a1a057d573112e626e&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8185024 May 12 15:40:42.915621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ab682aa-cc3e-4dd1-928c-378ac920ef6f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=06fc2fc9-04b4-4e85-aeea-95128fd0d053,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:42.928628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38246) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:42.942086 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-189c23cc-de02-4fed-a405-863d485b6a97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:42.977334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-189c23cc-de02-4fed-a405-863d485b6a97 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c3bc024-a7f9-4b14-ad71-6651f0779cf5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:42.998546 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-189c23cc-de02-4fed-a405-863d485b6a97 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:43.002579 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-189c23cc-de02-4fed-a405-863d485b6a97 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3c3bc024-a7f9-4b14-ad71-6651f0779cf5 HTTP/1.1" status: 204 len: 168 time: 0.3305662 May 12 15:40:43.167973 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32f08daa-a63f-4406-af19-a6cf9fd548bb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:43.270865 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:43.292533 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32f08daa-a63f-4406-af19-a6cf9fd548bb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:43.357626 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32f08daa-a63f-4406-af19-a6cf9fd548bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:43.382012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f08daa-a63f-4406-af19-a6cf9fd548bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=06fc2fc9-04b4-4e85-aeea-95128fd0d053,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:43.426058 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32f08daa-a63f-4406-af19-a6cf9fd548bb admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:43.429380 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-32f08daa-a63f-4406-af19-a6cf9fd548bb admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/06fc2fc9-04b4-4e85-aeea-95128fd0d053 HTTP/1.1" status: 204 len: 168 time: 0.5003254 May 12 15:40:43.952084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d3290597-fba6-41cb-a98f-3d1e1e3d542f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:44.039877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38286) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:44.045764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'subnet': {'network_id': '4e892bc1-e9cd-4ae0-afba-9426073de30e', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:44.069283 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port d3290597-fba6-41cb-a98f-3d1e1e3d542f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:44.070429 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:44.258029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:44.272485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:subnet and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:44.276252 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:44.289492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:44.311141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:44.318584 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:44.628535 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:44.755988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Subnet': ['ID=cf8ef23d-e876-4621-90c8-4b95c688ce9f,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:44.764813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Checking segment: {'id': 'c974e42a-0498-41b2-bf96-f8948fad5d0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '4e892bc1-e9cd-4ae0-afba-9426073de30e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:44.765177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network hostable DHCP agents. Network: 4e892bc1-e9cd-4ae0-afba-9426073de30e, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:40:44.812063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network 4e892bc1-e9cd-4ae0-afba-9426073de30e is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:40:44.831388 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 4e892bc1-e9cd-4ae0-afba-9426073de30e) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:44.841830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:44.842486 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:44.847957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3c07118-d553-406d-826d-fa58ae20fc93 None None] Network 4e892bc1-e9cd-4ae0-afba-9426073de30e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:44.905755 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7c6c9042-c5f7-44a6-80ac-a0e5aac22962 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.8645589 May 12 15:40:44.910305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38346) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:44.916492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1456966923'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:44.926444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:44.935382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:network and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:44.947597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:44.964532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:44.990233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:44.999078 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:45.077743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 577} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:40:45.102443 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:45.105237 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Added segment c435dad9-b274-4f82-a12a-2dfe69387edb of type vlan for network 06aa2989-c2c8-4639-bfdc-8d59cf9cc800 May 12 15:40:45.187812 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:45.284701 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:45.295318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:45.299592 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:45.401104 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1a4256a0-21ea-4c33-ac70-71409098b288 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:45.486789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-4e892bc1-e9cd-4ae0-afba-9426073de30e', 'network_id': '4e892bc1-e9cd-4ae0-afba-9426073de30e', 'tenant_id': '23ebb72014f64d3f921a26784efda987', 'fixed_ips': [{'subnet_id': 'cf8ef23d-e876-4621-90c8-4b95c688ce9f'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:40:45.487649 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:45.537965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Network': ['ID=06aa2989-c2c8-4639-bfdc-8d59cf9cc800,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:45.564028 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9afd04a1-a9c0-4591-bfc6-9bd17cefca74 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.6502478 May 12 15:40:45.565671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38394) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:45.571754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'subnet': {'network_id': '06aa2989-c2c8-4639-bfdc-8d59cf9cc800', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:45.606818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 06aa2989-c2c8-4639-bfdc-8d59cf9cc800 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:40:45.932888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Allocated IP 2001:db8:0:ffff::2 (4e892bc1-e9cd-4ae0-afba-9426073de30e/cf8ef23d-e876-4621-90c8-4b95c688ce9f/52f0b5ba-7622-4d89-8257-54808d0ad352) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:40:46.033579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38402) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:46.094098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:46.101166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:subnet and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:46.107062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:46.117290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:46.148084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:46.151951 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:46.415629 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:46.494895 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:46.705799 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:46.756100 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:46.784221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Transition to ACTIVE for port object 52f0b5ba-7622-4d89-8257-54808d0ad352 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:46.837953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Transition to ACTIVE for port object 52f0b5ba-7622-4d89-8257-54808d0ad352 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:46.858332 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:46.864897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Subnet': ['ID=1a13f5c7-0e4c-4191-a308-c3798453b7bd,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:46.881964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Checking segment: {'id': 'c435dad9-b274-4f82-a12a-2dfe69387edb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '06aa2989-c2c8-4639-bfdc-8d59cf9cc800'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:46.882866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network hostable DHCP agents. Network: 06aa2989-c2c8-4639-bfdc-8d59cf9cc800, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:40:46.947805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network 06aa2989-c2c8-4639-bfdc-8d59cf9cc800 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:40:46.972339 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 06aa2989-c2c8-4639-bfdc-8d59cf9cc800) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:46.979065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:46.979539 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:47.006421 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-55ace8bb-6b23-4b11-bded-097ff407e806 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 1.4395609 May 12 15:40:47.009147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38430) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:47.063931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Pushing event updated for resources: {'Port': ['ID=52f0b5ba-7622-4d89-8257-54808d0ad352,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:47.075698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3ee16fa-de37-4941-a344-adf7ed7bff41 None None] Network 06aa2989-c2c8-4639-bfdc-8d59cf9cc800 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:47.100711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Network 4e892bc1-e9cd-4ae0-afba-9426073de30e is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:47.150581 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:47.158792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:40:47.206745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38442) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:47.323249 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'network': {'name': 'tempest-RoutersTest-1736884365'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:47.337693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:47.340332 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ed8602a-2c83-4dba-9900-e0027449bbe7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:47.349801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:network and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:47.355695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:47.370832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:47.395168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4ed8602a-2c83-4dba-9900-e0027449bbe7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:47.403979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4ed8602a-2c83-4dba-9900-e0027449bbe7 admin admin] Usage tracker for resource:security_group_rule and tenant:10ee7d38f39e465fa740dc5e388c11d9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:47.414094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4ed8602a-2c83-4dba-9900-e0027449bbe7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:47.423796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4ed8602a-2c83-4dba-9900-e0027449bbe7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:47.537830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:47.545784 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:47.588955 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:47.606547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Attempting to bind port 52f0b5ba-7622-4d89-8257-54808d0ad352 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:40:47.607028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Attempting to bind port 52f0b5ba-7622-4d89-8257-54808d0ad352 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'c974e42a-0498-41b2-bf96-f8948fad5d0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '4e892bc1-e9cd-4ae0-afba-9426073de30e'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:40:47.607389 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Attempting to bind port 52f0b5ba-7622-4d89-8257-54808d0ad352 on network 4e892bc1-e9cd-4ae0-afba-9426073de30e {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:40:47.624935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:47.640964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 40, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:40:47.641489 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Checking segment: {'id': 'c974e42a-0498-41b2-bf96-f8948fad5d0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '4e892bc1-e9cd-4ae0-afba-9426073de30e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:47.641910 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:47.643105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Bound using segment: {'id': 'c974e42a-0498-41b2-bf96-f8948fad5d0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '4e892bc1-e9cd-4ae0-afba-9426073de30e'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:40:47.650789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:security_group_rule and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:47.653862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Bound port: 52f0b5ba-7622-4d89-8257-54808d0ad352, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c974e42a-0498-41b2-bf96-f8948fad5d0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '4e892bc1-e9cd-4ae0-afba-9426073de30e'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:40:47.654343 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:47.673599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:47.696793 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ed8602a-2c83-4dba-9900-e0027449bbe7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:47.704529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ed8602a-2c83-4dba-9900-e0027449bbe7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:47.731122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:47.822605 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-06aa2989-c2c8-4639-bfdc-8d59cf9cc800', 'network_id': '06aa2989-c2c8-4639-bfdc-8d59cf9cc800', 'tenant_id': '23ebb72014f64d3f921a26784efda987', 'fixed_ips': [{'subnet_id': '1a13f5c7-0e4c-4191-a308-c3798453b7bd'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:40:47.828944 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:47.870954 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ed8602a-2c83-4dba-9900-e0027449bbe7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=10ee7d38f39e465fa740dc5e388c11d9&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6614451 May 12 15:40:47.874786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38460) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:47.881341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed8602a-2c83-4dba-9900-e0027449bbe7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1258dab8-3850-4623-99a1-643adcb2f7fa,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:47.907835 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:47.991940 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:48.105512 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:48.123254 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:48.180165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] For port 52f0b5ba-7622-4d89-8257-54808d0ad352, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:40:48.187602 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] For port 52f0b5ba-7622-4d89-8257-54808d0ad352, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=52f0b5ba-7622-4d89-8257-54808d0ad352,segment=NetworkSegment(c974e42a-0498-41b2-bf96-f8948fad5d0b),segment_id=c974e42a-0498-41b2-bf96-f8948fad5d0b)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:40:48.192836 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:48.247490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 572} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:40:48.306075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0352a96f-d8bd-4afd-811a-c520afb15d9d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:48.347640 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-74b45665-d728-4ea7-b7aa-f96362043bf8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:48.406391 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-74b45665-d728-4ea7-b7aa-f96362043bf8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:48.445473 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4498c681-0909-4ea3-a822-222498bcc719 None None] Pushing event updated for resources: {'Port': ['ID=52f0b5ba-7622-4d89-8257-54808d0ad352,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:48.457706 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:48.459031 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Added segment 4c246df8-bf89-4902-969e-467cddaf4df0 of type vlan for network f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a May 12 15:40:48.460335 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:48.462312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Allocated IP 2001:db8::1 (06aa2989-c2c8-4639-bfdc-8d59cf9cc800/1a13f5c7-0e4c-4191-a308-c3798453b7bd/b9e91974-0e43-4cd4-8d97-698c9b5d3bec) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:40:48.563600 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:48.646903 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-74b45665-d728-4ea7-b7aa-f96362043bf8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:48.678750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b45665-d728-4ea7-b7aa-f96362043bf8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1258dab8-3850-4623-99a1-643adcb2f7fa,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:48.693613 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:48.700039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:48.700626 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:48.945619 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:48.948462 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-74b45665-d728-4ea7-b7aa-f96362043bf8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:48.957573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-74b45665-d728-4ea7-b7aa-f96362043bf8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1258dab8-3850-4623-99a1-643adcb2f7fa HTTP/1.1" status: 204 len: 168 time: 1.0441329 May 12 15:40:48.962790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Transition to ACTIVE for port object b9e91974-0e43-4cd4-8d97-698c9b5d3bec will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:48.977439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38472) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:48.985137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'network': {'name': 'tempest-RoutersTest-1492574872'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:48.989885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Transition to ACTIVE for port object b9e91974-0e43-4cd4-8d97-698c9b5d3bec will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:48.992423 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 2.9558563 May 12 15:40:48.997543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:49.000279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c02ada-44d1-48e6-b84c-db2572657fc8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Network': ['ID=f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:49.004356 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:49.006266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:network and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:49.023360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:49.040611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:49.055039 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:49.112744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:49.122028 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:49.184066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:40:49.224632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 559} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:40:49.233293 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Pushing event updated for resources: {'Port': ['ID=b9e91974-0e43-4cd4-8d97-698c9b5d3bec,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:49.263345 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:49.265420 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Added segment f272e3d1-06c6-44c7-8da9-ff40b8565939 of type vlan for network 23779a52-80bc-4d2e-8340-541517284dda May 12 15:40:49.286351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Subnet': ['ID=1a13f5c7-0e4c-4191-a308-c3798453b7bd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:49.364625 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:49.539447 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:49.556989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:49.559091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:49.644395 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:49.676237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Network 06aa2989-c2c8-4639-bfdc-8d59cf9cc800 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:49.678252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:49.684362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:40:49.717264 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['06aa2989-c2c8-4639-bfdc-8d59cf9cc800']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:49.782921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c435dad9-b274-4f82-a12a-2dfe69387edb') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:49.783502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c435dad9-b274-4f82-a12a-2dfe69387edb') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:49.792441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Network': ['ID=23779a52-80bc-4d2e-8340-541517284dda,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:49.825854 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:49.865332 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dae062f3-7cf0-40ff-8a50-05f720cd671d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.8866816 May 12 15:40:49.868281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38486) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:49.888008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 23779a52-80bc-4d2e-8340-541517284dda details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:40:49.890274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'subnet': {'network_id': 'f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:49.896358 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:49.926411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Releasing vlan 577 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:40:49.928984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:49.979681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38490) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:50.004471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Attempting to bind port b9e91974-0e43-4cd4-8d97-698c9b5d3bec on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:40:50.004829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Attempting to bind port b9e91974-0e43-4cd4-8d97-698c9b5d3bec by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'c435dad9-b274-4f82-a12a-2dfe69387edb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '06aa2989-c2c8-4639-bfdc-8d59cf9cc800'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:40:50.005185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Attempting to bind port b9e91974-0e43-4cd4-8d97-698c9b5d3bec on network 06aa2989-c2c8-4639-bfdc-8d59cf9cc800 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:40:50.055085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 40, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:40:50.055452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Checking segment: {'id': 'c435dad9-b274-4f82-a12a-2dfe69387edb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '06aa2989-c2c8-4639-bfdc-8d59cf9cc800'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:50.055853 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:50.056237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Bound using segment: {'id': 'c435dad9-b274-4f82-a12a-2dfe69387edb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '06aa2989-c2c8-4639-bfdc-8d59cf9cc800'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:40:50.056712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Bound port: b9e91974-0e43-4cd4-8d97-698c9b5d3bec, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c435dad9-b274-4f82-a12a-2dfe69387edb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 577, 'network_id': '06aa2989-c2c8-4639-bfdc-8d59cf9cc800'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:40:50.057096 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:50.151520 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 52f0b5ba-7622-4d89-8257-54808d0ad352 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: timer() May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:40:50.188638 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:40:50.205895 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') May 12 15:40:50.205895 n-d-841483-1 neutron-server[88152]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] May 12 15:40:50.205895 n-d-841483-1 neutron-server[88152]: [parameters: {'id': '06aa2989-c2c8-4639-bfdc-8d59cf9cc800'}] May 12 15:40:50.205895 n-d-841483-1 neutron-server[88152]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:40:50.207182 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:40:50.375691 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8dfe1d5-488f-4816-9fe7-37681048e4cb admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:50.423649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d8dfe1d5-488f-4816-9fe7-37681048e4cb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:50.434621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:50.439337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:subnet and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:50.443633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:50.450560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:50.459803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d8dfe1d5-488f-4816-9fe7-37681048e4cb admin admin] Usage tracker for resource:security_group_rule and tenant:255df233a0aa42f58ca98a437fb79751 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:50.463991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d8dfe1d5-488f-4816-9fe7-37681048e4cb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:50.473413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:50.478020 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:50.487208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 52f0b5ba-7622-4d89-8257-54808d0ad352 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:50.532582 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] For port b9e91974-0e43-4cd4-8d97-698c9b5d3bec, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:40:50.538079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] For port b9e91974-0e43-4cd4-8d97-698c9b5d3bec, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b9e91974-0e43-4cd4-8d97-698c9b5d3bec,segment=NetworkSegment(c435dad9-b274-4f82-a12a-2dfe69387edb),segment_id=c435dad9-b274-4f82-a12a-2dfe69387edb)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:40:50.550381 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:50.674437 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-448843ca-23d2-4d88-95dc-567188369c49 None None] Network 4e892bc1-e9cd-4ae0-afba-9426073de30e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:50.698204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d8dfe1d5-488f-4816-9fe7-37681048e4cb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:50.709046 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:50.734610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Deleting port b9e91974-0e43-4cd4-8d97-698c9b5d3bec {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:40:50.751458 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:51.041703 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8dfe1d5-488f-4816-9fe7-37681048e4cb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:51.051801 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8dfe1d5-488f-4816-9fe7-37681048e4cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:51.104052 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:51.194893 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d8dfe1d5-488f-4816-9fe7-37681048e4cb admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=255df233a0aa42f58ca98a437fb79751&name=default HTTP/1.1" status: 200 len: 2983 time: 1.2058418 May 12 15:40:51.235610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38510) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:51.267954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8dfe1d5-488f-4816-9fe7-37681048e4cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c4e4c542-1738-4cf1-946b-d13659f2ada0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:51.291203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] For port b9e91974-0e43-4cd4-8d97-698c9b5d3bec, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b9e91974-0e43-4cd4-8d97-698c9b5d3bec,segment=NetworkSegment(c435dad9-b274-4f82-a12a-2dfe69387edb),segment_id=c435dad9-b274-4f82-a12a-2dfe69387edb)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:51.291453 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:51.328531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acda7d0d-24c1-4d25-a32d-5e641a4c42c3 None None] Pushing event updated for resources: {'Port': ['ID=b9e91974-0e43-4cd4-8d97-698c9b5d3bec,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:51.498872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ce9e0b93-6d79-42db-9f97-8b96f96b8f6a None None] Provisioning for port 52f0b5ba-7622-4d89-8257-54808d0ad352 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:40:51.553725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Calling delete_port for b9e91974-0e43-4cd4-8d97-698c9b5d3bec owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:40:51.554997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ce9e0b93-6d79-42db-9f97-8b96f96b8f6a None None] Provisioning complete for port 52f0b5ba-7622-4d89-8257-54808d0ad352 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:51.555378 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ce9e0b93-6d79-42db-9f97-8b96f96b8f6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:51.559666 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Checking segment: {'id': '4c246df8-bf89-4902-969e-467cddaf4df0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': 'f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:51.560080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network hostable DHCP agents. Network: f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:40:51.587954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Subnet': ['ID=065f3de9-82f8-45c4-adf9-8dd4045e095b,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:51.614547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6ecbf91-ee41-49b9-b4a3-a16d7dc661e2 None None] Network 06aa2989-c2c8-4639-bfdc-8d59cf9cc800 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:51.676592 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:51.739639 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6acf383f-c4f5-4809-8df3-6a512e79d496 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:51.751312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:40:51.781020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No DVR routers for this DVR port b9e91974-0e43-4cd4-8d97-698c9b5d3bec on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:40:51.801794 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:51.825067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:51.825707 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:51.913455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Port': ['ID=b9e91974-0e43-4cd4-8d97-698c9b5d3bec,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:51.927190 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6acf383f-c4f5-4809-8df3-6a512e79d496 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:52.022795 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-45bf7939-c689-4bce-be31-bb64e95ec711 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.1531332 May 12 15:40:52.026482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38520) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:52.043156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'subnet': {'network_id': '23779a52-80bc-4d2e-8340-541517284dda', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:52.105037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa05e51b-99d0-4f19-b7f2-ffe8731a1c4b None None] Network f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:52.235916 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:52.316016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:52.320401 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6acf383f-c4f5-4809-8df3-6a512e79d496 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:52.339260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:subnet and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:52.342682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6acf383f-c4f5-4809-8df3-6a512e79d496 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c4e4c542-1738-4cf1-946b-d13659f2ada0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:52.352714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:52.360801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:52.375609 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6acf383f-c4f5-4809-8df3-6a512e79d496 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:52.377787 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6acf383f-c4f5-4809-8df3-6a512e79d496 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c4e4c542-1738-4cf1-946b-d13659f2ada0 HTTP/1.1" status: 204 len: 168 time: 1.1170545 May 12 15:40:52.384818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:52.390408 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:52.792993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['06aa2989-c2c8-4639-bfdc-8d59cf9cc800']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:52.816758 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c435dad9-b274-4f82-a12a-2dfe69387edb') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:52.817033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c435dad9-b274-4f82-a12a-2dfe69387edb') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:52.837841 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:52.873540 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:52.896195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Releasing vlan 577 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:40:52.899729 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: timer() May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:40:52.952055 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:40:53.093803 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ce9e0b93-6d79-42db-9f97-8b96f96b8f6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:53.149236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:53.159877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ce9e0b93-6d79-42db-9f97-8b96f96b8f6a None None] For port 52f0b5ba-7622-4d89-8257-54808d0ad352, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=52f0b5ba-7622-4d89-8257-54808d0ad352,segment=NetworkSegment(c974e42a-0498-41b2-bf96-f8948fad5d0b),segment_id=c974e42a-0498-41b2-bf96-f8948fad5d0b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:40:53.176325 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ce9e0b93-6d79-42db-9f97-8b96f96b8f6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:53.277907 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce9e0b93-6d79-42db-9f97-8b96f96b8f6a None None] Pushing event updated for resources: {'Port': ['ID=52f0b5ba-7622-4d89-8257-54808d0ad352,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:53.429826 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:53.451353 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:53.482422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Subnet': ['ID=b43d14af-848e-4434-a4f7-1e43a0ba4a65,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:53.511170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Checking segment: {'id': 'f272e3d1-06c6-44c7-8da9-ff40b8565939', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '23779a52-80bc-4d2e-8340-541517284dda'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:53.511546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network hostable DHCP agents. Network: 23779a52-80bc-4d2e-8340-541517284dda, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:40:53.547329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 23779a52-80bc-4d2e-8340-541517284dda is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:40:53.586423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 23779a52-80bc-4d2e-8340-541517284dda) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:53.594638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a', 'network_id': 'f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'fixed_ips': [{'subnet_id': '065f3de9-82f8-45c4-adf9-8dd4045e095b'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:40:53.597922 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:53.625880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:53.628369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa9ccad4-1895-44b0-9ce5-7e454451070c None None] Network 23779a52-80bc-4d2e-8340-541517284dda requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:53.632873 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:53.639997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Network': ['ID=06aa2989-c2c8-4639-bfdc-8d59cf9cc800,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:53.708520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38548) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:53.711809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e895cf06-2b6c-44c7-96f4-2a9b70a9cae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/06aa2989-c2c8-4639-bfdc-8d59cf9cc800 HTTP/1.1" status: 204 len: 168 time: 6.6992784 May 12 15:40:53.756361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-873989807'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:53.773028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:53.784424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:network and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:53.791947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:53.801192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:53.828231 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bfd0f594-b277-4304-862e-89ee5953bc76 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.8006701 May 12 15:40:53.831694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38554) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:53.842852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-02f84fc2-2019-4ff0-a342-34d890574160 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-2050719806', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:53.859674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:53.873338 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:53.890118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-02f84fc2-2019-4ff0-a342-34d890574160 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:53.909646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-02f84fc2-2019-4ff0-a342-34d890574160 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:router and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:53.940822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-02f84fc2-2019-4ff0-a342-34d890574160 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:53.996716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 565} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:40:54.006659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:54.009791 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Added segment f5342ae6-4001-47eb-9fea-e1cf097ef88f of type vlan for network f7241002-80e0-4c7e-9b30-f926ce673510 May 12 15:40:54.067129 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:54.135157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 52f0b5ba-7622-4d89-8257-54808d0ad352 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:40:54.137704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-02f84fc2-2019-4ff0-a342-34d890574160 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:54.145596 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:54.153479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:54.154811 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:54.307950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-23779a52-80bc-4d2e-8340-541517284dda', 'network_id': '23779a52-80bc-4d2e-8340-541517284dda', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'fixed_ips': [{'subnet_id': 'b43d14af-848e-4434-a4f7-1e43a0ba4a65'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:40:54.309257 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:54.472802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-366e8054-bb1b-4aea-a492-5d8e2f37ed93 None None] Provisioning complete for port 52f0b5ba-7622-4d89-8257-54808d0ad352 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:54.473283 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-366e8054-bb1b-4aea-a492-5d8e2f37ed93 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:54.518532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Network': ['ID=f7241002-80e0-4c7e-9b30-f926ce673510,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:54.564606 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02f84fc2-2019-4ff0-a342-34d890574160 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:54.565951 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02f84fc2-2019-4ff0-a342-34d890574160 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:54.602107 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ec880cc9-8e5f-4cae-8238-0553ec5970a3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.8808453 May 12 15:40:54.603688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38574) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:54.614478 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02f84fc2-2019-4ff0-a342-34d890574160 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:54.623931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'subnet': {'network_id': 'f7241002-80e0-4c7e-9b30-f926ce673510', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::2'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:54.668149 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02f84fc2-2019-4ff0-a342-34d890574160 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:54.681412 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network f7241002-80e0-4c7e-9b30-f926ce673510 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:40:54.716306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02f84fc2-2019-4ff0-a342-34d890574160 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:54.718112 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-02f84fc2-2019-4ff0-a342-34d890574160 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.8853769 May 12 15:40:54.721965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38578) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:54.983656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:54.996609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:subnet and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:55.000191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:55.014237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:55.040167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:55.044021 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:55.354848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Allocated IP 172.20.0.2 (f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a/065f3de9-82f8-45c4-adf9-8dd4045e095b/a66b25bd-c80b-4976-906b-401945204a28) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:40:55.645558 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:55.704458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 52f0b5ba-7622-4d89-8257-54808d0ad352 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:40:55.705469 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:55.765379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Subnet': ['ID=cf376045-9ed7-4044-88dc-2db044dc3e30,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:55.827475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Checking segment: {'id': 'f5342ae6-4001-47eb-9fea-e1cf097ef88f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': 'f7241002-80e0-4c7e-9b30-f926ce673510'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:55.828085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network hostable DHCP agents. Network: f7241002-80e0-4c7e-9b30-f926ce673510, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:40:55.859315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network f7241002-80e0-4c7e-9b30-f926ce673510 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:40:55.883842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, f7241002-80e0-4c7e-9b30-f926ce673510) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:55.894407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:55.895734 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:55.918273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3603a82-7fee-4c95-a8be-44372fb6a6d6 None None] Network f7241002-80e0-4c7e-9b30-f926ce673510 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:55.929210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2274d423-fc21-47da-ac22-3b47fc5bf366 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 1.3168118 May 12 15:40:55.929577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38596) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:55.936876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1391670972'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:55.939361 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Allocated IP 172.21.0.2 (23779a52-80bc-4d2e-8340-541517284dda/b43d14af-848e-4434-a4f7-1e43a0ba4a65/7f495018-4d8b-4e6b-ac40-4f017027d43c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:40:55.944560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:55.950965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:network and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:55.954438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:55.961609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:55.979643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:55.993050 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:56.005035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:56.058290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 562} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:40:56.094379 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:56.094887 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Added segment 85b00db7-74a0-44d6-a037-d112ffc7c946 of type vlan for network 5142c69d-3967-46ff-a0b9-a97c22f09d4a May 12 15:40:56.185163 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:56.286184 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:56.292245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:56.292841 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:56.700811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Network': ['ID=5142c69d-3967-46ff-a0b9-a97c22f09d4a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:56.764336 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-28d77e43-d0ea-46f7-8035-c8078ceccc2f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.8331997 May 12 15:40:56.766593 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38606) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:56.777088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'subnet': {'network_id': '5142c69d-3967-46ff-a0b9-a97c22f09d4a', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:40:56.934245 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:56.949124 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Transition to ACTIVE for port object 7f495018-4d8b-4e6b-ac40-4f017027d43c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:56.977200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Transition to ACTIVE for port object 7f495018-4d8b-4e6b-ac40-4f017027d43c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:56.995396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:40:56.997645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 5142c69d-3967-46ff-a0b9-a97c22f09d4a details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:40:56.999612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:subnet and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:40:57.003228 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:40:57.010710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:40:57.098338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:40:57.103629 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:57.200707 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:57.391720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Pushing event updated for resources: {'Port': ['ID=7f495018-4d8b-4e6b-ac40-4f017027d43c,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:57.399007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.ipam_backend_mixin [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Performing IP validity checks on allocation pools {{(pid=88152) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:314}} May 12 15:40:57.406891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.ipam_backend_mixin [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Checking for overlaps among allocation pools and gateway ip {{(pid=88152) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:335}} May 12 15:40:57.469046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Network 23779a52-80bc-4d2e-8340-541517284dda is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:57.513433 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:57.539341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:40:57.561020 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:57.621261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Transition to ACTIVE for port object a66b25bd-c80b-4976-906b-401945204a28 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:57.653067 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:57.759976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Attempting to bind port 7f495018-4d8b-4e6b-ac40-4f017027d43c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:40:57.760485 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Attempting to bind port 7f495018-4d8b-4e6b-ac40-4f017027d43c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'f272e3d1-06c6-44c7-8da9-ff40b8565939', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '23779a52-80bc-4d2e-8340-541517284dda'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:40:57.760972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Attempting to bind port 7f495018-4d8b-4e6b-ac40-4f017027d43c on network 23779a52-80bc-4d2e-8340-541517284dda {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:40:57.765168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Transition to ACTIVE for port object a66b25bd-c80b-4976-906b-401945204a28 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:57.773468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 40, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:40:57.780466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Checking segment: {'id': 'f272e3d1-06c6-44c7-8da9-ff40b8565939', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '23779a52-80bc-4d2e-8340-541517284dda'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:57.781084 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:57.781612 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Bound using segment: {'id': 'f272e3d1-06c6-44c7-8da9-ff40b8565939', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '23779a52-80bc-4d2e-8340-541517284dda'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:40:57.782248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Bound port: 7f495018-4d8b-4e6b-ac40-4f017027d43c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f272e3d1-06c6-44c7-8da9-ff40b8565939', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '23779a52-80bc-4d2e-8340-541517284dda'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:40:57.782722 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:57.808825 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-f7241002-80e0-4c7e-9b30-f926ce673510', 'network_id': 'f7241002-80e0-4c7e-9b30-f926ce673510', 'tenant_id': '23ebb72014f64d3f921a26784efda987', 'fixed_ips': [{'subnet_id': 'cf376045-9ed7-4044-88dc-2db044dc3e30'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:40:57.820939 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:57.850509 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Subnet': ['ID=9bb8022d-f538-45c6-a70c-7bff680728ee,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:57.856153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Checking segment: {'id': '85b00db7-74a0-44d6-a037-d112ffc7c946', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '5142c69d-3967-46ff-a0b9-a97c22f09d4a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:40:57.856496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network hostable DHCP agents. Network: 5142c69d-3967-46ff-a0b9-a97c22f09d4a, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:40:57.860447 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:57.884773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network 5142c69d-3967-46ff-a0b9-a97c22f09d4a is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:40:57.930838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 5142c69d-3967-46ff-a0b9-a97c22f09d4a) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:57.936288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:40:57.939327 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:57.948490 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:40:58.003201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7ff227e-82e8-4293-9cf1-4914ddacf933 None None] Network 5142c69d-3967-46ff-a0b9-a97c22f09d4a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:40:58.025204 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6e959738-8ee4-4b18-8fba-7b131adbe774 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 803 time: 1.2568285 May 12 15:40:58.032088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38620) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:40:58.065906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Allocated IP 172.20.0.1 (f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a/065f3de9-82f8-45c4-adf9-8dd4045e095b/d53491d6-908b-4986-b717-5e606c288bcf) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:40:58.230137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Network f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:58.394795 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:58.576144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:58.584310 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:40:58.616493 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:58.726323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Pushing event updated for resources: {'Port': ['ID=a66b25bd-c80b-4976-906b-401945204a28,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:58.739320 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:58.747575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:58.795629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Transition to ACTIVE for port object d53491d6-908b-4986-b717-5e606c288bcf will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:58.835718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:58.836060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:58.836413 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:58.836747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:58.837109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:58.837482 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:58.837823 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:58.838152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:58.838477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:58.838817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:58.839144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:58.839487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:58.848855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] For port 7f495018-4d8b-4e6b-ac40-4f017027d43c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:40:58.869364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] For port 7f495018-4d8b-4e6b-ac40-4f017027d43c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7f495018-4d8b-4e6b-ac40-4f017027d43c,segment=NetworkSegment(f272e3d1-06c6-44c7-8da9-ff40b8565939),segment_id=f272e3d1-06c6-44c7-8da9-ff40b8565939)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:40:58.887935 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:58.902343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Subnet': ['ID=9bb8022d-f538-45c6-a70c-7bff680728ee,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:58.915382 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:59.092564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:40:59.107485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:40:59.116390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:40:59.249136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=d53491d6-908b-4986-b717-5e606c288bcf,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:59.274637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:59.274951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:59.277270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:59.277634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:59.277967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:59.278292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:59.278611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:59.278931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:59.280449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:59.280770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:59.283869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:59.284227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:40:59.294501 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:59.310212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Allocated IP 2001:db8::1 (f7241002-80e0-4c7e-9b30-f926ce673510/cf376045-9ed7-4044-88dc-2db044dc3e30/410b8af2-4759-4b80-9cd2-a9190df6023f) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:40:59.358226 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:59.423263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5142c69d-3967-46ff-a0b9-a97c22f09d4a']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:59.477231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '85b00db7-74a0-44d6-a037-d112ffc7c946') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:59.477559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '85b00db7-74a0-44d6-a037-d112ffc7c946') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:40:59.532063 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:59.568573 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:59.588095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Releasing vlan 562 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:40:59.588605 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: timer() May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:40:59.624775 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:40:59.724226 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:59.738263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Transition to ACTIVE for port object 410b8af2-4759-4b80-9cd2-a9190df6023f will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:59.762519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Transition to ACTIVE for port object 410b8af2-4759-4b80-9cd2-a9190df6023f will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:40:59.775299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f20ea0-61d5-477a-a3dc-4505722a8ab9 None None] Pushing event updated for resources: {'Port': ['ID=7f495018-4d8b-4e6b-ac40-4f017027d43c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:40:59.819686 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:40:59.958474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Attempting to bind port a66b25bd-c80b-4976-906b-401945204a28 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:40:59.958833 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Attempting to bind port a66b25bd-c80b-4976-906b-401945204a28 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '4c246df8-bf89-4902-969e-467cddaf4df0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': 'f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:40:59.959435 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Attempting to bind port a66b25bd-c80b-4976-906b-401945204a28 on network f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:41:00.038698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Network f7241002-80e0-4c7e-9b30-f926ce673510 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:41:00.055325 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:00.066987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:00.101776 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Network': ['ID=5142c69d-3967-46ff-a0b9-a97c22f09d4a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:00.118168 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-198c394b-2c1d-4e05-9df9-1e08808dae88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/5142c69d-3967-46ff-a0b9-a97c22f09d4a HTTP/1.1" status: 204 len: 168 time: 2.0836096 May 12 15:41:00.122850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38644) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:00.130842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-850498447'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:00.140324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:00.150408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:network and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:00.156988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:00.158779 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Pushing event updated for resources: {'Port': ['ID=410b8af2-4759-4b80-9cd2-a9190df6023f,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:00.172364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:00.177441 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 40, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:41:00.178371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Checking segment: {'id': '4c246df8-bf89-4902-969e-467cddaf4df0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': 'f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:41:00.179171 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:00.180017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Bound using segment: {'id': '4c246df8-bf89-4902-969e-467cddaf4df0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': 'f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:41:00.181100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Bound port: a66b25bd-c80b-4976-906b-401945204a28, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4c246df8-bf89-4902-969e-467cddaf4df0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 572, 'network_id': 'f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:41:00.181857 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:00.199711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:41:00.202038 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f08a0631-fa0a-4f83-8524-22c2f705afb9 None None] Network 5142c69d-3967-46ff-a0b9-a97c22f09d4a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:00.207216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:00.247859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:00.275429 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:00.382503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 563} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:41:00.424645 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:00.425445 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Added segment 31b81588-dde8-495f-8965-c5cf854fe383 of type vlan for network e9a53a94-df56-42c6-8e3a-13a20c8b87cd May 12 15:41:00.438262 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:00.514885 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:00.574264 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:00.580470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:00.580470 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:00.601220 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f08a0631-fa0a-4f83-8524-22c2f705afb9 None None] Network 5142c69d-3967-46ff-a0b9-a97c22f09d4a could not be found, it might have been deleted concurrently. {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:220}} May 12 15:41:00.773203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Attempting to bind port 410b8af2-4759-4b80-9cd2-a9190df6023f on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:41:00.773746 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Attempting to bind port 410b8af2-4759-4b80-9cd2-a9190df6023f by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'f5342ae6-4001-47eb-9fea-e1cf097ef88f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': 'f7241002-80e0-4c7e-9b30-f926ce673510'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:41:00.774115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Attempting to bind port 410b8af2-4759-4b80-9cd2-a9190df6023f on network f7241002-80e0-4c7e-9b30-f926ce673510 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:41:00.795607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 40, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:41:00.795980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Checking segment: {'id': 'f5342ae6-4001-47eb-9fea-e1cf097ef88f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': 'f7241002-80e0-4c7e-9b30-f926ce673510'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:41:00.796383 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:00.796770 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Bound using segment: {'id': 'f5342ae6-4001-47eb-9fea-e1cf097ef88f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': 'f7241002-80e0-4c7e-9b30-f926ce673510'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:41:00.797244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Bound port: 410b8af2-4759-4b80-9cd2-a9190df6023f, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f5342ae6-4001-47eb-9fea-e1cf097ef88f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': 'f7241002-80e0-4c7e-9b30-f926ce673510'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:41:00.797655 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:00.820936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.6969624 May 12 15:41:00.831037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38652) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:00.851926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9adb8ade-c53c-4683-8d6a-c25da149f731 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Network': ['ID=e9a53a94-df56-42c6-8e3a-13a20c8b87cd,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:00.855070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] For port a66b25bd-c80b-4976-906b-401945204a28, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:41:00.867491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'subnet': {'network_id': 'e9a53a94-df56-42c6-8e3a-13a20c8b87cd', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:00.877526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network e9a53a94-df56-42c6-8e3a-13a20c8b87cd details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:41:00.912444 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] For port a66b25bd-c80b-4976-906b-401945204a28, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a66b25bd-c80b-4976-906b-401945204a28,segment=NetworkSegment(4c246df8-bf89-4902-969e-467cddaf4df0),segment_id=4c246df8-bf89-4902-969e-467cddaf4df0)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:41:00.945124 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:01.069558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:01.074284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:subnet and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:01.078474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:01.088433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:01.105029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:01.110763 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:01.269152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] For port 410b8af2-4759-4b80-9cd2-a9190df6023f, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:41:01.272780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] For port 410b8af2-4759-4b80-9cd2-a9190df6023f, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=410b8af2-4759-4b80-9cd2-a9190df6023f,segment=NetworkSegment(f5342ae6-4001-47eb-9fea-e1cf097ef88f),segment_id=f5342ae6-4001-47eb-9fea-e1cf097ef88f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:41:01.387697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71705aa7-c791-4aa1-9185-d41ee2c95bac None None] Pushing event updated for resources: {'Port': ['ID=a66b25bd-c80b-4976-906b-401945204a28,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:01.405203 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:01.416258 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:01.435500 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:01.780437 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b03313d-6e4c-42f8-9463-27e6944bc95d None None] Pushing event updated for resources: {'Port': ['ID=410b8af2-4759-4b80-9cd2-a9190df6023f,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:01.826244 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:01.896911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=d53491d6-908b-4986-b717-5e606c288bcf,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:02.083953 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:02.363737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Subnet': ['ID=7bb6e92d-2537-4b34-8ab5-9b1cc7ebde2b,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:02.369259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Checking segment: {'id': '31b81588-dde8-495f-8965-c5cf854fe383', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': 'e9a53a94-df56-42c6-8e3a-13a20c8b87cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:41:02.369804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network hostable DHCP agents. Network: e9a53a94-df56-42c6-8e3a-13a20c8b87cd, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:41:02.427939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network e9a53a94-df56-42c6-8e3a-13a20c8b87cd is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:41:02.476871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, e9a53a94-df56-42c6-8e3a-13a20c8b87cd) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:02.484944 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:02.500914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d85aafc0-e891-4595-8198-cea40c3a61ba None None] Network e9a53a94-df56-42c6-8e3a-13a20c8b87cd requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:02.512889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:02.513465 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:02.522164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:41:02.526453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:02.585647 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8202bf67-f582-4d92-ac63-7b6913bb4586 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 904 time: 1.7495978 May 12 15:41:02.587733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38672) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:02.731169 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a66b25bd-c80b-4976-906b-401945204a28 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:41:02.756774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c38df83-7910-4918-9127-1c79d9e822b5 None None] Network 23779a52-80bc-4d2e-8340-541517284dda requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:02.879264 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:02.990604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 5db27d2e-25e4-4bc0-be01-3f16d1aa415a is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:41:03.073887 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:03.080788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5442aa4b-9eae-4bc5-9391-fe961cef209b None None] Provisioning for port 7f495018-4d8b-4e6b-ac40-4f017027d43c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:41:03.247571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:41:03.267093 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38688) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:03.268912 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-914d89ac-b0b2-45c2-a520-75541cb157c2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/5db27d2e-25e4-4bc0-be01-3f16d1aa415a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.5439370 May 12 15:41:03.285809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ccf18e5-c140-443f-9bcf-5b10d04f549c None None] Sync routers for ids ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:41:03.352490 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:03.562789 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-61485633-7f4b-4921-90fb-954473fc15c4 req-3fb6b109-6d75-4012-b6b3-784cdfe254e6 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.2616277 May 12 15:41:03.574329 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port a66b25bd-c80b-4976-906b-401945204a28 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:41:03.602303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ccf18e5-c140-443f-9bcf-5b10d04f549c None None] Routers {'5db27d2e-25e4-4bc0-be01-3f16d1aa415a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:41:03.602969 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6ccf18e5-c140-443f-9bcf-5b10d04f549c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:40:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:03.635655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Subnet': ['ID=7bb6e92d-2537-4b34-8ab5-9b1cc7ebde2b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:03.779096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7f495018-4d8b-4e6b-ac40-4f017027d43c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:41:03.912047 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-61485633-7f4b-4921-90fb-954473fc15c4 req-55a5a66b-4f39-456f-826b-a4dc4e89a332 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.1475818 May 12 15:41:03.960179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42d8c392-b997-4cf0-b76d-f70ab5cd4fd5 None None] Network e9a53a94-df56-42c6-8e3a-13a20c8b87cd requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:03.963611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a9f2f33-e1cb-464f-85e8-b66833e6700d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:03.973030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7a9f2f33-e1cb-464f-85e8-b66833e6700d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports/d53491d6-908b-4986-b717-5e606c288bcf HTTP/1.1" status: 200 len: 910 time: 0.7041509 May 12 15:41:03.994709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38694) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:04.043150 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:04.143922 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-61485633-7f4b-4921-90fb-954473fc15c4 req-e19b43c9-2505-420f-ba06-3ef960d4d23f service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.2116356 May 12 15:41:04.186719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e9a53a94-df56-42c6-8e3a-13a20c8b87cd']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:04.219766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '31b81588-dde8-495f-8965-c5cf854fe383') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:04.220076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '31b81588-dde8-495f-8965-c5cf854fe383') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:04.249983 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:04.306168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6ccf18e5-c140-443f-9bcf-5b10d04f549c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:04.310079 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:04.327165 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Releasing vlan 563 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:41:04.328575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: timer() May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:41:04.390481 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:41:04.422613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e591bde-0568-4628-a720-2b60782b9fa5 None None] Network f7241002-80e0-4c7e-9b30-f926ce673510 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:04.566264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-053d7a11-5866-4bfb-a0ed-59aa99c29633 None None] Network f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:04.606375 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:04.637792 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:04.671326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Network': ['ID=e9a53a94-df56-42c6-8e3a-13a20c8b87cd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:04.682888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-61a2a3d6-292f-43fa-8aad-5b91b92f823c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/e9a53a94-df56-42c6-8e3a-13a20c8b87cd HTTP/1.1" status: 204 len: 168 time: 2.0940750 May 12 15:41:04.686662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38702) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:04.698212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-490465927'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:04.746251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:04.759969 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:network and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:04.778181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:04.797999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:04.827299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:04.830870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ccf18e5-c140-443f-9bcf-5b10d04f549c None None] Routers {'5db27d2e-25e4-4bc0-be01-3f16d1aa415a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:41:04.831598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6ccf18e5-c140-443f-9bcf-5b10d04f549c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:40:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:04.836796 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:04.953105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 553} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:41:04.985068 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:04.985836 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Added segment 6c08bd47-412c-4e93-b54e-fb597fefa441 of type vlan for network 1c43e957-4f8d-46bf-a6ca-88abc67b22c2 May 12 15:41:05.037057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6ccf18e5-c140-443f-9bcf-5b10d04f549c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:05.037840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ccf18e5-c140-443f-9bcf-5b10d04f549c None None] The sync data for ids ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:41:05.073032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-08c10f50-3a35-4d4c-b972-e8cc8dc3fa41 None None] Provisioning for port 410b8af2-4759-4b80-9cd2-a9190df6023f completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:41:05.094178 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:05.235252 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:05.253495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:05.254211 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:05.342058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 7f495018-4d8b-4e6b-ac40-4f017027d43c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:41:05.379561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cd57c138-8880-4e68-a824-378c8f08a8a7 None None] Provisioning for port a66b25bd-c80b-4976-906b-401945204a28 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:41:05.411352 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cd57c138-8880-4e68-a824-378c8f08a8a7 None None] Provisioning complete for port a66b25bd-c80b-4976-906b-401945204a28 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:05.411942 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cd57c138-8880-4e68-a824-378c8f08a8a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:05.540226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7f495018-4d8b-4e6b-ac40-4f017027d43c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:05.544711 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:05.790571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 1.1026475 May 12 15:41:05.796573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38712) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:05.845767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61485633-7f4b-4921-90fb-954473fc15c4 req-072b988b-ff43-4d90-bd3c-4959e8e14a1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:05.848599 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-61485633-7f4b-4921-90fb-954473fc15c4 req-072b988b-ff43-4d90-bd3c-4959e8e14a1c service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 1.2219918 May 12 15:41:05.949336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ddeec39-f22e-44ff-afeb-0c15d6218d88 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Network': ['ID=1c43e957-4f8d-46bf-a6ca-88abc67b22c2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:05.955861 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'subnet': {'network_id': '1c43e957-4f8d-46bf-a6ca-88abc67b22c2', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:06.036689 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 1c43e957-4f8d-46bf-a6ca-88abc67b22c2 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:41:06.195919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:06.206407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:06.217904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:subnet and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:06.225627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:06.237545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:06.265039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:06.269944 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:06.501218 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cd57c138-8880-4e68-a824-378c8f08a8a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:06.522999 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:06.608617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-cd57c138-8880-4e68-a824-378c8f08a8a7 None None] For port a66b25bd-c80b-4976-906b-401945204a28, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a66b25bd-c80b-4976-906b-401945204a28,segment=NetworkSegment(4c246df8-bf89-4902-969e-467cddaf4df0),segment_id=4c246df8-bf89-4902-969e-467cddaf4df0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:06.628239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 7f495018-4d8b-4e6b-ac40-4f017027d43c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7f495018-4d8b-4e6b-ac40-4f017027d43c,segment=NetworkSegment(f272e3d1-06c6-44c7-8da9-ff40b8565939),segment_id=f272e3d1-06c6-44c7-8da9-ff40b8565939)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:06.630079 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cd57c138-8880-4e68-a824-378c8f08a8a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:06.703775 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:06.833090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c2f3e16b-2c3d-40ee-bbf9-39a7209417ea None None] Provisioning complete for port 7f495018-4d8b-4e6b-ac40-4f017027d43c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:06.833477 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c2f3e16b-2c3d-40ee-bbf9-39a7209417ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:06.976497 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:07.007769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 410b8af2-4759-4b80-9cd2-a9190df6023f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:41:07.085984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd57c138-8880-4e68-a824-378c8f08a8a7 None None] Pushing event updated for resources: {'Port': ['ID=a66b25bd-c80b-4976-906b-401945204a28,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:07.190670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Subnet': ['ID=c88d1898-258b-47b6-8d57-bf153388c359,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:07.232089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:41:07.232543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:41:07.232968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:41:07.233422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:41:07.233852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:41:07.234266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:41:07.234680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:41:07.235371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:41:07.235765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:41:07.236211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:41:07.236618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:41:07.237037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:41:07.281347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Checking segment: {'id': '6c08bd47-412c-4e93-b54e-fb597fefa441', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '1c43e957-4f8d-46bf-a6ca-88abc67b22c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:41:07.282175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network hostable DHCP agents. Network: 1c43e957-4f8d-46bf-a6ca-88abc67b22c2, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:41:07.315925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network 1c43e957-4f8d-46bf-a6ca-88abc67b22c2 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:41:07.348661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 1c43e957-4f8d-46bf-a6ca-88abc67b22c2) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:07.366339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:07.367869 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:07.400457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Allocated IP 172.21.0.1 (23779a52-80bc-4d2e-8340-541517284dda/b43d14af-848e-4434-a4f7-1e43a0ba4a65/9563a4f4-4c03-4699-ad66-e05aed3547e7) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:41:07.408704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-557fbecc-3208-458b-b72c-a4b3e6422b70 None None] Network 1c43e957-4f8d-46bf-a6ca-88abc67b22c2 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:07.477093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f081b6b9-88fe-43b3-950d-519a1ed70b29 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 1.6762950 May 12 15:41:07.480547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38728) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:07.914097 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=7f495018-4d8b-4e6b-ac40-4f017027d43c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:07.978681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 410b8af2-4759-4b80-9cd2-a9190df6023f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:41:07.984192 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:07.993583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 410b8af2-4759-4b80-9cd2-a9190df6023f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:07.994275 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:08.049101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Transition to ACTIVE for port object 9563a4f4-4c03-4699-ad66-e05aed3547e7 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:41:08.088687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38738) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:08.143778 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:08.206382 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:08.232763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d5a5d28-2107-4b14-a975-e58d0938fe69 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-1c43e957-4f8d-46bf-a6ca-88abc67b22c2', 'network_id': '1c43e957-4f8d-46bf-a6ca-88abc67b22c2', 'tenant_id': '23ebb72014f64d3f921a26784efda987', 'fixed_ips': [{'subnet_id': 'c88d1898-258b-47b6-8d57-bf153388c359'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:41:08.238012 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7d5a5d28-2107-4b14-a975-e58d0938fe69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:08.259154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 23779a52-80bc-4d2e-8340-541517284dda is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:41:08.263255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:08.268757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:41:08.393496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=9563a4f4-4c03-4699-ad66-e05aed3547e7,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:08.425154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-56452a8a-1901-4f38-aec6-5a72a387b48a None None] Provisioning complete for port 410b8af2-4759-4b80-9cd2-a9190df6023f triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:08.426756 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-56452a8a-1901-4f38-aec6-5a72a387b48a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:08.480371 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:08.481501 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:08.649779 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1925e67b-8c35-4278-a4a2-0e723c884b52 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:08.701034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1925e67b-8c35-4278-a4a2-0e723c884b52 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:08.719694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1925e67b-8c35-4278-a4a2-0e723c884b52 admin admin] Usage tracker for resource:security_group_rule and tenant:611c309a46564e47a61cf38f7ac2133c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:08.725173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1925e67b-8c35-4278-a4a2-0e723c884b52 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:08.744125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1925e67b-8c35-4278-a4a2-0e723c884b52 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:08.801786 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:08.878143 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:08.921647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Subnet': ['ID=c88d1898-258b-47b6-8d57-bf153388c359,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server [None req-7d5a5d28-2107-4b14-a975-e58d0938fe69 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet c88d1898-258b-47b6-8d57-bf153388c359: This subnet is being modified by another concurrent operation. May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 289, in create_dhcp_port May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 114, in _port_action May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 692, in inner May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kwargs) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 217, in wrapped May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1452, in create_port May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1419, in _create_port_db May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1441, in create_port_db May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 219, in allocate_ips_for_port_and_store May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ips = self.allocate_ips_for_port(context, port_copy) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 217, in wrapped May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1014, in wrapper May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 226, in allocate_ips_for_port May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._allocate_ips_for_port(context, port) May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 258, in _allocate_ips_for_port May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 683, in _ipam_get_subnets May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server subnet.lock_register( May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise exception May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet c88d1898-258b-47b6-8d57-bf153388c359: This subnet is being modified by another concurrent operation. May 12 15:41:09.006770 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server May 12 15:41:09.093110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b32f6ef3-4183-4608-a520-be82f480a530 None None] Network 1c43e957-4f8d-46bf-a6ca-88abc67b22c2 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:09.200817 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:09.269317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1c43e957-4f8d-46bf-a6ca-88abc67b22c2']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:09.291865 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6c08bd47-412c-4e93-b54e-fb597fefa441') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:09.292266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6c08bd47-412c-4e93-b54e-fb597fefa441') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:09.305498 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:09.319050 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:09.323583 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:09.331148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Releasing vlan 553 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:41:09.331537 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: timer() May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:41:09.520373 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:41:09.539696 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:09.550547 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:09.589937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/1c43e957-4f8d-46bf-a6ca-88abc67b22c2 HTTP/1.1" status: 204 len: 168 time: 2.1059132 May 12 15:41:09.598485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38748) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:09.608369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1787645865'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:09.613804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bb34b79-8161-4742-a304-66123932a868 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Network': ['ID=1c43e957-4f8d-46bf-a6ca-88abc67b22c2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:09.622958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:09.636026 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:network and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:09.640727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:09.656130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:09.690606 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1925e67b-8c35-4278-a4a2-0e723c884b52 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:09.706403 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1925e67b-8c35-4278-a4a2-0e723c884b52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:09.744389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:09.748823 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:09.795019 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-56452a8a-1901-4f38-aec6-5a72a387b48a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:09.818394 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:09.870203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1925e67b-8c35-4278-a4a2-0e723c884b52 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bfc57e30-60c2-47c6-b7fb-4f4b0bcabee2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:09.875915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:09.888122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-56452a8a-1901-4f38-aec6-5a72a387b48a None None] For port 410b8af2-4759-4b80-9cd2-a9190df6023f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=410b8af2-4759-4b80-9cd2-a9190df6023f,segment=NetworkSegment(f5342ae6-4001-47eb-9fea-e1cf097ef88f),segment_id=f5342ae6-4001-47eb-9fea-e1cf097ef88f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:09.949743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 595} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:41:09.956243 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-56452a8a-1901-4f38-aec6-5a72a387b48a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:09.989147 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1925e67b-8c35-4278-a4a2-0e723c884b52 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=611c309a46564e47a61cf38f7ac2133c&name=default HTTP/1.1" status: 200 len: 2983 time: 1.8965950 May 12 15:41:09.990734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38752) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:10.024807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8441ff1-6da1-496e-af50-09350a907ee9 None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:41:10.034521 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:10.034868 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Added segment 9db4b0ac-d244-479d-89f2-4b43416d076e of type vlan for network d1b03368-2a7f-424e-8a55-929dc38a4616 May 12 15:41:10.167567 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:10.180522 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:10.197399 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:41:10.198032 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:41:10.244320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-56452a8a-1901-4f38-aec6-5a72a387b48a None None] Provisioning for port d53491d6-908b-4986-b717-5e606c288bcf completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:41:10.248325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=9563a4f4-4c03-4699-ad66-e05aed3547e7,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:10.270610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-56452a8a-1901-4f38-aec6-5a72a387b48a None None] Provisioning complete for port d53491d6-908b-4986-b717-5e606c288bcf triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:10.275462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-56452a8a-1901-4f38-aec6-5a72a387b48a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:10.293615 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17250b79-81d1-407b-94c8-ea88fb273c6c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:10.385880 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:10.391360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:10.391973 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:10.450928 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17250b79-81d1-407b-94c8-ea88fb273c6c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:10.461559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56452a8a-1901-4f38-aec6-5a72a387b48a None None] Pushing event updated for resources: {'Port': ['ID=410b8af2-4759-4b80-9cd2-a9190df6023f,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:10.498570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-56452a8a-1901-4f38-aec6-5a72a387b48a None None] Port d53491d6-908b-4986-b717-5e606c288bcf cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:41:10.546471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 23779a52-80bc-4d2e-8340-541517284dda is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:41:10.554626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:10.573110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-56452a8a-1901-4f38-aec6-5a72a387b48a None None] Provisioning complete for port a66b25bd-c80b-4976-906b-401945204a28 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:10.573110 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-56452a8a-1901-4f38-aec6-5a72a387b48a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:10.593139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.9934490 May 12 15:41:10.599051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38760) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:10.605766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'subnet': {'network_id': 'd1b03368-2a7f-424e-8a55-929dc38a4616', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:10.620022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50b36a1f-d76d-482b-ba52-f2e54189007d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Network': ['ID=d1b03368-2a7f-424e-8a55-929dc38a4616,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:10.795295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network d1b03368-2a7f-424e-8a55-929dc38a4616 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:41:10.980894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 5db27d2e-25e4-4bc0-be01-3f16d1aa415a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:41:11.134213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8441ff1-6da1-496e-af50-09350a907ee9 None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:41:11.311308 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17250b79-81d1-407b-94c8-ea88fb273c6c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:11.315753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:11.356315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:subnet and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:11.362393 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17250b79-81d1-407b-94c8-ea88fb273c6c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bfc57e30-60c2-47c6-b7fb-4f4b0bcabee2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:11.370993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:11.378640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:11.396474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 410b8af2-4759-4b80-9cd2-a9190df6023f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:41:11.401571 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17250b79-81d1-407b-94c8-ea88fb273c6c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:11.406413 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-17250b79-81d1-407b-94c8-ea88fb273c6c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bfc57e30-60c2-47c6-b7fb-4f4b0bcabee2 HTTP/1.1" status: 204 len: 168 time: 1.4076469 May 12 15:41:11.410525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:11.416124 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:11.468623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:41:11.484435 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e71b996-28c9-4bea-923a-1016c962a120 None None] Sync routers for ids ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:41:11.487553 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-35522faf-7178-47da-8a27-476c20790d1a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/5db27d2e-25e4-4bc0-be01-3f16d1aa415a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.4878316 May 12 15:41:11.496476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38774) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:11.503686 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e71b996-28c9-4bea-923a-1016c962a120 None None] Routers {'5db27d2e-25e4-4bc0-be01-3f16d1aa415a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:41:11.504798 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9e71b996-28c9-4bea-923a-1016c962a120 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:40:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:11.750179 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9e71b996-28c9-4bea-923a-1016c962a120 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:11.779896 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e71b996-28c9-4bea-923a-1016c962a120 None None] Routers {'5db27d2e-25e4-4bc0-be01-3f16d1aa415a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:41:11.781527 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9e71b996-28c9-4bea-923a-1016c962a120 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:40:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:11.829562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93743993-fdc8-456e-9acb-c9c474f0005b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:11.830350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-93743993-fdc8-456e-9acb-c9c474f0005b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Synchronizing usage tracker for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:41:11.896552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-93743993-fdc8-456e-9acb-c9c474f0005b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Unset dirty status for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:41:11.904364 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-93743993-fdc8-456e-9acb-c9c474f0005b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports/9563a4f4-4c03-4699-ad66-e05aed3547e7 HTTP/1.1" status: 200 len: 910 time: 0.4031792 May 12 15:41:11.907207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38782) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:12.069769 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9e71b996-28c9-4bea-923a-1016c962a120 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:12.070156 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e71b996-28c9-4bea-923a-1016c962a120 None None] The sync data for ids ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:41:12.262753 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:12.433377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38828) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:12.508285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Checking segment: {'id': '9db4b0ac-d244-479d-89f2-4b43416d076e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': 'd1b03368-2a7f-424e-8a55-929dc38a4616'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:41:12.508869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network hostable DHCP agents. Network: d1b03368-2a7f-424e-8a55-929dc38a4616, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:41:12.518993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-40528dab-071a-4149-9c25-6e0d78b0ec90 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:12.521990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Subnet': ['ID=7bf69d7d-027d-47fa-b93e-2ec7f6bc90e4,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:12.554407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-40528dab-071a-4149-9c25-6e0d78b0ec90 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:12.562076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-40528dab-071a-4149-9c25-6e0d78b0ec90 admin admin] Usage tracker for resource:security_group_rule and tenant:c5ead87c36f84519bd6bfb95c5c673ad is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:12.565573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-40528dab-071a-4149-9c25-6e0d78b0ec90 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:12.571634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-40528dab-071a-4149-9c25-6e0d78b0ec90 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:12.574906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network d1b03368-2a7f-424e-8a55-929dc38a4616 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:41:12.613886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, d1b03368-2a7f-424e-8a55-929dc38a4616) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:12.618797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:12.619529 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:12.657098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 410b8af2-4759-4b80-9cd2-a9190df6023f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:12.657732 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:12.671854 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7bb7cfbc-3921-4c86-8a3c-397007e48d01 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.0713530 May 12 15:41:12.672385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38846) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:12.686622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-3ad006d5-5c13-4851-a60b-7d0a9e6fcdf5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'subnet': {'network_id': 'd1b03368-2a7f-424e-8a55-929dc38a4616', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:12.739347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e5bc282c-9e2c-4468-80b2-0f4b73d67b7d None None] Provisioning for port 9563a4f4-4c03-4699-ad66-e05aed3547e7 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:41:12.754768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e5bc282c-9e2c-4468-80b2-0f4b73d67b7d None None] Provisioning complete for port 9563a4f4-4c03-4699-ad66-e05aed3547e7 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:12.755219 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e5bc282c-9e2c-4468-80b2-0f4b73d67b7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:12.789019 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-40528dab-071a-4149-9c25-6e0d78b0ec90 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:12.812424 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-40528dab-071a-4149-9c25-6e0d78b0ec90 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:12.826227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e5bc282c-9e2c-4468-80b2-0f4b73d67b7d None None] Port 9563a4f4-4c03-4699-ad66-e05aed3547e7 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:41:12.840343 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ea7bde10-a30f-44b9-a4de-b0cd02f80065 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:12.961751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7f495018-4d8b-4e6b-ac40-4f017027d43c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:41:13.398238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3ad006d5-5c13-4851-a60b-7d0a9e6fcdf5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:13.416270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3ad006d5-5c13-4851-a60b-7d0a9e6fcdf5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:subnet and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:13.425891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3ad006d5-5c13-4851-a60b-7d0a9e6fcdf5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for subnet was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:13.455373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3ad006d5-5c13-4851-a60b-7d0a9e6fcdf5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource subnet. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:13.489051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ad006d5-5c13-4851-a60b-7d0a9e6fcdf5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:13.494341 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3ad006d5-5c13-4851-a60b-7d0a9e6fcdf5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:13.544904 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:13.554079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7f495018-4d8b-4e6b-ac40-4f017027d43c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:13.556284 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:13.741109 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-40528dab-071a-4149-9c25-6e0d78b0ec90 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c5ead87c36f84519bd6bfb95c5c673ad&name=default HTTP/1.1" status: 200 len: 2983 time: 1.3066335 May 12 15:41:13.744951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38860) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:13.752947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40528dab-071a-4149-9c25-6e0d78b0ec90 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86a41da6-dcd6-4309-bff8-a59cf66f8441,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:13.961794 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a66b25bd-c80b-4976-906b-401945204a28 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:41:13.980150 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fc093cb-6d83-40bb-b4c1-7afde0c12819 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:13.989768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c528dd9-03f3-4a03-9000-9a5a28cbf123 None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:41:14.117290 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fc093cb-6d83-40bb-b4c1-7afde0c12819 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:14.224761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c528dd9-03f3-4a03-9000-9a5a28cbf123 None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:41:14.504234 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fc093cb-6d83-40bb-b4c1-7afde0c12819 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:14.535929 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3ad006d5-5c13-4851-a60b-7d0a9e6fcdf5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:14.595217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fc093cb-6d83-40bb-b4c1-7afde0c12819 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86a41da6-dcd6-4309-bff8-a59cf66f8441,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:14.604097 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fc093cb-6d83-40bb-b4c1-7afde0c12819 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:14.607095 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7fc093cb-6d83-40bb-b4c1-7afde0c12819 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/86a41da6-dcd6-4309-bff8-a59cf66f8441 HTTP/1.1" status: 204 len: 168 time: 0.8574648 May 12 15:41:14.638244 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5877141-e001-446f-84e9-0427379b8fd8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:14.679932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ad006d5-5c13-4851-a60b-7d0a9e6fcdf5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Subnet': ['ID=6f95b469-7d12-4e89-acd9-d88eb3ca38c2,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:14.735624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ad006d5-5c13-4851-a60b-7d0a9e6fcdf5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network d1b03368-2a7f-424e-8a55-929dc38a4616 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:41:14.739734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-3ad006d5-5c13-4851-a60b-7d0a9e6fcdf5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:14.750615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ad006d5-5c13-4851-a60b-7d0a9e6fcdf5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:14.754296 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3ad006d5-5c13-4851-a60b-7d0a9e6fcdf5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3874133'] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:14.842783 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3ad006d5-5c13-4851-a60b-7d0a9e6fcdf5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 2.1664183 May 12 15:41:14.846526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38916) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:14.988991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a66b25bd-c80b-4976-906b-401945204a28 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:14.989480 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:14.991126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-055aac34-984c-425d-921c-6e81c34a082e tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:14.993586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-055aac34-984c-425d-921c-6e81c34a082e tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:14.995511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-055aac34-984c-425d-921c-6e81c34a082e tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:14.997538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-055aac34-984c-425d-921c-6e81c34a082e tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:15.000074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-055aac34-984c-425d-921c-6e81c34a082e tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:15.001269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-055aac34-984c-425d-921c-6e81c34a082e tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Synchronizing usage tracker for tenant:23ebb72014f64d3f921a26784efda987 on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:41:15.051995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-055aac34-984c-425d-921c-6e81c34a082e tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Unset dirty status for tenant:23ebb72014f64d3f921a26784efda987 on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:41:15.053282 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-055aac34-984c-425d-921c-6e81c34a082e tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.2056782 May 12 15:41:15.058858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38924) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:15.079076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1870847676'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:15.100380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:15.107618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:network and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:15.113576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for network was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:15.127730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:15.142024 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-d1b03368-2a7f-424e-8a55-929dc38a4616', 'network_id': 'd1b03368-2a7f-424e-8a55-929dc38a4616', 'tenant_id': '23ebb72014f64d3f921a26784efda987', 'fixed_ips': [{'subnet_id': '6f95b469-7d12-4e89-acd9-d88eb3ca38c2'}, {'subnet_id': '7bf69d7d-027d-47fa-b93e-2ec7f6bc90e4'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:41:15.144283 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:15.151331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:15.155726 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:15.246813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 560} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:41:15.284956 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:15.285900 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Added segment bbfa6ed0-a81b-4cb1-900c-14688862d7da of type vlan for network edbc81f2-2828-4a87-bc93-4b30d4f0ab7b May 12 15:41:15.383961 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:15.490542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:15.516017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:15.518521 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:15.648000 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.5854566 May 12 15:41:15.690132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38936) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:15.690617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38942) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:15.785594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e8214dec-0da4-45df-83aa-658b9a42272d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'network': {'name': 'New_network'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:15.881259 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7a911cc1-00c5-4da6-8b88-4a12f6fd01e1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:15.882332 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-05950aee-2081-4a58-98bc-fcd4de3d80fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:15.904302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a272fc6-d294-4f14-bdbb-fa4370648aae tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Network': ['ID=edbc81f2-2828-4a87-bc93-4b30d4f0ab7b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:15.923480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7a911cc1-00c5-4da6-8b88-4a12f6fd01e1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:15.929493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7a911cc1-00c5-4da6-8b88-4a12f6fd01e1 admin admin] Usage tracker for resource:security_group_rule and tenant:7763441e27cb485eabea2f3b3ea7ec68 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:15.929659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network edbc81f2-2828-4a87-bc93-4b30d4f0ab7b details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:41:15.934132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7a911cc1-00c5-4da6-8b88-4a12f6fd01e1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:15.942203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7a911cc1-00c5-4da6-8b88-4a12f6fd01e1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:16.184191 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:16.303204 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:16.350223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Allocated IP 172.20.0.1 (d1b03368-2a7f-424e-8a55-929dc38a4616/6f95b469-7d12-4e89-acd9-d88eb3ca38c2/a00b9646-c3ec-4c10-9470-6be1cbdc072a) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:41:16.373942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Allocated IP 2001:db8::2 (d1b03368-2a7f-424e-8a55-929dc38a4616/7bf69d7d-027d-47fa-b93e-2ec7f6bc90e4/a00b9646-c3ec-4c10-9470-6be1cbdc072a) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:41:16.507411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d5877141-e001-446f-84e9-0427379b8fd8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port 9563a4f4-4c03-4699-ad66-e05aed3547e7 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:16.507752 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5877141-e001-446f-84e9-0427379b8fd8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:16.749802 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5877141-e001-446f-84e9-0427379b8fd8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:16.926065 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:16.947076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Transition to ACTIVE for port object a00b9646-c3ec-4c10-9470-6be1cbdc072a will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:41:16.979449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d5877141-e001-446f-84e9-0427379b8fd8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for 9563a4f4-4c03-4699-ad66-e05aed3547e7 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:41:17.029491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Transition to ACTIVE for port object a00b9646-c3ec-4c10-9470-6be1cbdc072a will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:41:17.044222 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:17.174388 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Pushing event updated for resources: {'Port': ['ID=a00b9646-c3ec-4c10-9470-6be1cbdc072a,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:17.186655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Network d1b03368-2a7f-424e-8a55-929dc38a4616 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:41:17.188413 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:17.191401 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:41:17.279828 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7a911cc1-00c5-4da6-8b88-4a12f6fd01e1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:17.338568 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8214dec-0da4-45df-83aa-658b9a42272d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:17.355548 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Attempting to bind port a00b9646-c3ec-4c10-9470-6be1cbdc072a on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:41:17.355954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Attempting to bind port a00b9646-c3ec-4c10-9470-6be1cbdc072a by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '9db4b0ac-d244-479d-89f2-4b43416d076e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': 'd1b03368-2a7f-424e-8a55-929dc38a4616'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:41:17.356378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Attempting to bind port a00b9646-c3ec-4c10-9470-6be1cbdc072a on network d1b03368-2a7f-424e-8a55-929dc38a4616 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:41:17.360808 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7a911cc1-00c5-4da6-8b88-4a12f6fd01e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:17.375107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 41, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:41:17.377514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Checking segment: {'id': '9db4b0ac-d244-479d-89f2-4b43416d076e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': 'd1b03368-2a7f-424e-8a55-929dc38a4616'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:41:17.378190 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:17.379958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Bound using segment: {'id': '9db4b0ac-d244-479d-89f2-4b43416d076e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': 'd1b03368-2a7f-424e-8a55-929dc38a4616'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:41:17.380522 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Bound port: a00b9646-c3ec-4c10-9470-6be1cbdc072a, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9db4b0ac-d244-479d-89f2-4b43416d076e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': 'd1b03368-2a7f-424e-8a55-929dc38a4616'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:41:17.382749 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:17.411506 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7a911cc1-00c5-4da6-8b88-4a12f6fd01e1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7763441e27cb485eabea2f3b3ea7ec68&name=default HTTP/1.1" status: 200 len: 2983 time: 1.7064455 May 12 15:41:17.412520 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8214dec-0da4-45df-83aa-658b9a42272d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:17.414135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 38958) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:17.460722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-e8214dec-0da4-45df-83aa-658b9a42272d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network edbc81f2-2828-4a87-bc93-4b30d4f0ab7b is not hosted by any dhcp agent {{(pid=88151) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:228}} May 12 15:41:17.467731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8214dec-0da4-45df-83aa-658b9a42272d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:17.468663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e8214dec-0da4-45df-83aa-658b9a42272d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:17.471031 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e8214dec-0da4-45df-83aa-658b9a42272d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "PUT /v2.0/networks/edbc81f2-2828-4a87-bc93-4b30d4f0ab7b HTTP/1.1" status: 200 len: 723 time: 1.7723322 May 12 15:41:17.504190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 38962) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:17.528611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] For port a00b9646-c3ec-4c10-9470-6be1cbdc072a, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:41:17.533330 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] For port a00b9646-c3ec-4c10-9470-6be1cbdc072a, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a00b9646-c3ec-4c10-9470-6be1cbdc072a,segment=NetworkSegment(9db4b0ac-d244-479d-89f2-4b43416d076e),segment_id=9db4b0ac-d244-479d-89f2-4b43416d076e)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:41:17.545832 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:17.663353 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf13b771-80ed-45be-9d66-f003fb0f146a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:17.713335 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf13b771-80ed-45be-9d66-f003fb0f146a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:17.779347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04c72de2-7945-4663-b22b-abd39be67624 None None] Pushing event updated for resources: {'Port': ['ID=a00b9646-c3ec-4c10-9470-6be1cbdc072a,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:17.785757 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf13b771-80ed-45be-9d66-f003fb0f146a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:17.819650 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf13b771-80ed-45be-9d66-f003fb0f146a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=526cd580-a140-498c-ae67-ae71af5784e8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:17.830119 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf13b771-80ed-45be-9d66-f003fb0f146a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:17.832736 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bf13b771-80ed-45be-9d66-f003fb0f146a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/526cd580-a140-498c-ae67-ae71af5784e8 HTTP/1.1" status: 204 len: 168 time: 0.4167895 May 12 15:41:17.901815 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:17.928944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-81ab3735-023f-4486-a926-a0b795913058 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'subnet': {'network_id': 'edbc81f2-2828-4a87-bc93-4b30d4f0ab7b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:18.036517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a911cc1-00c5-4da6-8b88-4a12f6fd01e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=526cd580-a140-498c-ae67-ae71af5784e8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:18.103714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8214dec-0da4-45df-83aa-658b9a42272d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Network': ['ID=edbc81f2-2828-4a87-bc93-4b30d4f0ab7b,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:18.118799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network edbc81f2-2828-4a87-bc93-4b30d4f0ab7b details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:41:18.710355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-81ab3735-023f-4486-a926-a0b795913058 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:18.727786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-81ab3735-023f-4486-a926-a0b795913058 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource subnet. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:18.759960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-81ab3735-023f-4486-a926-a0b795913058 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:18.766816 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81ab3735-023f-4486-a926-a0b795913058 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:19.050786 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5877141-e001-446f-84e9-0427379b8fd8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:19.186658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5877141-e001-446f-84e9-0427379b8fd8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=9563a4f4-4c03-4699-ad66-e05aed3547e7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:19.715166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a00b9646-c3ec-4c10-9470-6be1cbdc072a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:41:19.892050 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port a00b9646-c3ec-4c10-9470-6be1cbdc072a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:41:19.996657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60c21285-e73e-45b1-952f-30142b6bebe7 None None] Network d1b03368-2a7f-424e-8a55-929dc38a4616 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:20.013799 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5877141-e001-446f-84e9-0427379b8fd8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:20.019297 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81ab3735-023f-4486-a926-a0b795913058 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:20.204249 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8687e6e9-b259-4b3c-b967-4c5e65302b4d None None] Provisioning for port a00b9646-c3ec-4c10-9470-6be1cbdc072a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:41:20.241000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8687e6e9-b259-4b3c-b967-4c5e65302b4d None None] Provisioning complete for port a00b9646-c3ec-4c10-9470-6be1cbdc072a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:20.243550 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8687e6e9-b259-4b3c-b967-4c5e65302b4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:20.701286 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8687e6e9-b259-4b3c-b967-4c5e65302b4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:20.815897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8687e6e9-b259-4b3c-b967-4c5e65302b4d None None] For port a00b9646-c3ec-4c10-9470-6be1cbdc072a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a00b9646-c3ec-4c10-9470-6be1cbdc072a,segment=NetworkSegment(9db4b0ac-d244-479d-89f2-4b43416d076e),segment_id=9db4b0ac-d244-479d-89f2-4b43416d076e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:20.884668 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8687e6e9-b259-4b3c-b967-4c5e65302b4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:20.967815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81ab3735-023f-4486-a926-a0b795913058 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Checking segment: {'id': 'bbfa6ed0-a81b-4cb1-900c-14688862d7da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 560, 'network_id': 'edbc81f2-2828-4a87-bc93-4b30d4f0ab7b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:41:20.968446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81ab3735-023f-4486-a926-a0b795913058 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network hostable DHCP agents. Network: edbc81f2-2828-4a87-bc93-4b30d4f0ab7b, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:41:21.031891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81ab3735-023f-4486-a926-a0b795913058 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Subnet': ['ID=d6ca1c3b-7fd6-4f8d-a60e-74a1e6b90443,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:21.066005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a3289a12-f231-4e67-ae49-a72867f4d3ea None None] Could not find standard attr ID for object 9563a4f4-4c03-4699-ad66-e05aed3547e7. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:41:21.073620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8687e6e9-b259-4b3c-b967-4c5e65302b4d None None] Pushing event updated for resources: {'Port': ['ID=a00b9646-c3ec-4c10-9470-6be1cbdc072a,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:21.103978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81ab3735-023f-4486-a926-a0b795913058 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network edbc81f2-2828-4a87-bc93-4b30d4f0ab7b is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:41:21.126234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d5877141-e001-446f-84e9-0427379b8fd8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 5db27d2e-25e4-4bc0-be01-3f16d1aa415a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:41:21.128204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-81ab3735-023f-4486-a926-a0b795913058 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, edbc81f2-2828-4a87-bc93-4b30d4f0ab7b) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:21.138510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f374caeb-da70-4435-a44c-5ae334105f80 None None] Network edbc81f2-2828-4a87-bc93-4b30d4f0ab7b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:21.143678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81ab3735-023f-4486-a926-a0b795913058 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:21.144469 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-81ab3735-023f-4486-a926-a0b795913058 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:21.295568 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-81ab3735-023f-4486-a926-a0b795913058 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 3.7844160 May 12 15:41:21.299422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39016) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:21.308457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d09a7531-3e7f-42c3-8281-aab09ced8b5f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:21.598831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d5877141-e001-446f-84e9-0427379b8fd8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:41:21.624014 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d5877141-e001-446f-84e9-0427379b8fd8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/5db27d2e-25e4-4bc0-be01-3f16d1aa415a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 9.7156973 May 12 15:41:21.630500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39022) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:21.787211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d18aa543-67fa-4ca0-86bd-df4859228c85 None None] Sync routers for ids ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:41:21.797075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a00b9646-c3ec-4c10-9470-6be1cbdc072a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:41:21.879576 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-edbc81f2-2828-4a87-bc93-4b30d4f0ab7b', 'network_id': 'edbc81f2-2828-4a87-bc93-4b30d4f0ab7b', 'tenant_id': '23ebb72014f64d3f921a26784efda987', 'fixed_ips': [{'subnet_id': 'd6ca1c3b-7fd6-4f8d-a60e-74a1e6b90443'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:41:21.880410 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:21.896146 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d18aa543-67fa-4ca0-86bd-df4859228c85 None None] Routers {'5db27d2e-25e4-4bc0-be01-3f16d1aa415a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:41:21.896775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d18aa543-67fa-4ca0-86bd-df4859228c85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:41:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:21.957834 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d09a7531-3e7f-42c3-8281-aab09ced8b5f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-1637698'] for subnet, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:21.999977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d18aa543-67fa-4ca0-86bd-df4859228c85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:22.018927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d18aa543-67fa-4ca0-86bd-df4859228c85 None None] Routers {'5db27d2e-25e4-4bc0-be01-3f16d1aa415a'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:41:22.019788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d18aa543-67fa-4ca0-86bd-df4859228c85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:41:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:22.168774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d18aa543-67fa-4ca0-86bd-df4859228c85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:22.169221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d18aa543-67fa-4ca0-86bd-df4859228c85 None None] The sync data for ids ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:41:22.319639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a00b9646-c3ec-4c10-9470-6be1cbdc072a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:22.320157 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:22.348242 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d09a7531-3e7f-42c3-8281-aab09ced8b5f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8768026839929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-28130211'] for subnet, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:22.435059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69981ccb-871f-40c4-a3dc-b005f995fe1c None None] Network d1b03368-2a7f-424e-8a55-929dc38a4616 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:22.553786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d09a7531-3e7f-42c3-8281-aab09ced8b5f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:22.554885 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d09a7531-3e7f-42c3-8281-aab09ced8b5f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:22.564307 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d09a7531-3e7f-42c3-8281-aab09ced8b5f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "PUT /v2.0/subnets/d6ca1c3b-7fd6-4f8d-a60e-74a1e6b90443 HTTP/1.1" status: 200 len: 826 time: 1.2619762 May 12 15:41:22.568797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39034) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:22.599985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d09a7531-3e7f-42c3-8281-aab09ced8b5f tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Subnet': ['ID=d6ca1c3b-7fd6-4f8d-a60e-74a1e6b90443,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:22.858084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-194bf39e-5233-4b01-8aa0-29a3ef161223 None None] Provisioning complete for port a00b9646-c3ec-4c10-9470-6be1cbdc072a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:22.859369 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-194bf39e-5233-4b01-8aa0-29a3ef161223 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:22.936620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Allocated IP 2001:db8::2 (edbc81f2-2828-4a87-bc93-4b30d4f0ab7b/d6ca1c3b-7fd6-4f8d-a60e-74a1e6b90443/c3ec7d97-8d4b-4d54-93ce-e48d687fc60d) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:41:23.024855 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:23.200453 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:23.295427 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-681a6e7d-dff0-4695-bc9e-6e796f543669 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:23.459542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-664fd3ca-0bae-4d32-84f8-8dc5e859211c req-989f8de2-8f26-4a45-8acd-1f7f853eb69b service neutron] (88151) timed out ('10.222.0.82', 42812) {{(pid=88151) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 15:41:23.781830 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:23.813744 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Transition to ACTIVE for port object c3ec7d97-8d4b-4d54-93ce-e48d687fc60d will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:41:23.861910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Transition to ACTIVE for port object c3ec7d97-8d4b-4d54-93ce-e48d687fc60d will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:41:23.873040 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:24.036094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Network edbc81f2-2828-4a87-bc93-4b30d4f0ab7b is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:41:24.046285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:24.054377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:41:24.077405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Pushing event updated for resources: {'Port': ['ID=c3ec7d97-8d4b-4d54-93ce-e48d687fc60d,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:24.291679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-681a6e7d-dff0-4695-bc9e-6e796f543669 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port d53491d6-908b-4986-b717-5e606c288bcf {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:24.292211 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-681a6e7d-dff0-4695-bc9e-6e796f543669 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:24.317832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46aea8eb-2e35-4dd2-aa19-4bdc4b6a42fc None None] Network d1b03368-2a7f-424e-8a55-929dc38a4616 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:24.376503 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:24.543102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Attempting to bind port c3ec7d97-8d4b-4d54-93ce-e48d687fc60d on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:41:24.545511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Attempting to bind port c3ec7d97-8d4b-4d54-93ce-e48d687fc60d by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'bbfa6ed0-a81b-4cb1-900c-14688862d7da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 560, 'network_id': 'edbc81f2-2828-4a87-bc93-4b30d4f0ab7b'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:41:24.552866 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Attempting to bind port c3ec7d97-8d4b-4d54-93ce-e48d687fc60d on network edbc81f2-2828-4a87-bc93-4b30d4f0ab7b {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:41:24.565839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Subnet': ['ID=d6ca1c3b-7fd6-4f8d-a60e-74a1e6b90443,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:24.592513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 41, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:41:24.593252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Checking segment: {'id': 'bbfa6ed0-a81b-4cb1-900c-14688862d7da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 560, 'network_id': 'edbc81f2-2828-4a87-bc93-4b30d4f0ab7b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:41:24.593842 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:24.594394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Bound using segment: {'id': 'bbfa6ed0-a81b-4cb1-900c-14688862d7da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 560, 'network_id': 'edbc81f2-2828-4a87-bc93-4b30d4f0ab7b'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:41:24.595038 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Bound port: c3ec7d97-8d4b-4d54-93ce-e48d687fc60d, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bbfa6ed0-a81b-4cb1-900c-14688862d7da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 560, 'network_id': 'edbc81f2-2828-4a87-bc93-4b30d4f0ab7b'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:41:24.595610 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:24.738002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ec23cdf7-f476-4889-997f-378a4b02cf3d None None] Provisioning complete for port a00b9646-c3ec-4c10-9470-6be1cbdc072a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:24.749992 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ec23cdf7-f476-4889-997f-378a4b02cf3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:24.760460 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:24.779856 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-681a6e7d-dff0-4695-bc9e-6e796f543669 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:25.080206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-681a6e7d-dff0-4695-bc9e-6e796f543669 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for d53491d6-908b-4986-b717-5e606c288bcf owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:41:25.116765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] For port c3ec7d97-8d4b-4d54-93ce-e48d687fc60d, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:41:25.160316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['edbc81f2-2828-4a87-bc93-4b30d4f0ab7b']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:25.161432 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] For port c3ec7d97-8d4b-4d54-93ce-e48d687fc60d, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c3ec7d97-8d4b-4d54-93ce-e48d687fc60d,segment=NetworkSegment(bbfa6ed0-a81b-4cb1-900c-14688862d7da),segment_id=bbfa6ed0-a81b-4cb1-900c-14688862d7da)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:41:25.180932 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:25.182636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bbfa6ed0-a81b-4cb1-900c-14688862d7da') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:25.183247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bbfa6ed0-a81b-4cb1-900c-14688862d7da') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:25.202915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:25.349811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5fda871-54fc-433b-b014-6c70aed4f077 None None] Pushing event updated for resources: {'Port': ['ID=c3ec7d97-8d4b-4d54-93ce-e48d687fc60d,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:25.350428 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:25.374608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Releasing vlan 560 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:41:25.383999 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: timer() May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:41:25.451311 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:41:25.572732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b127876-4d08-44c0-9596-73abdf297dab None None] Network edbc81f2-2828-4a87-bc93-4b30d4f0ab7b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:25.706390 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') May 12 15:41:25.706390 n-d-841483-1 neutron-server[88151]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] May 12 15:41:25.706390 n-d-841483-1 neutron-server[88151]: [parameters: {'id': 'edbc81f2-2828-4a87-bc93-4b30d4f0ab7b'}] May 12 15:41:25.706390 n-d-841483-1 neutron-server[88151]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:41:25.707443 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:41:25.756592 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-681a6e7d-dff0-4695-bc9e-6e796f543669 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:25.822182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-681a6e7d-dff0-4695-bc9e-6e796f543669 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=d53491d6-908b-4986-b717-5e606c288bcf,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:25.852834 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0342e93c-7774-4458-9882-65c9f937e393 None None] Provisioning complete for port a00b9646-c3ec-4c10-9470-6be1cbdc072a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:25.853703 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0342e93c-7774-4458-9882-65c9f937e393 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:26.303216 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:26.391837 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23e3d400-9dcd-4ac1-b595-a621ca9fc086 None None] Network edbc81f2-2828-4a87-bc93-4b30d4f0ab7b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:26.507799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Deleting port c3ec7d97-8d4b-4d54-93ce-e48d687fc60d {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:26.508430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:26.696141 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-681a6e7d-dff0-4695-bc9e-6e796f543669 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:26.896652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2474b8ec-e800-43c3-ba9c-363ab41b9a69 None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:41:27.077339 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2474b8ec-e800-43c3-ba9c-363ab41b9a69 None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:41:27.544604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-681a6e7d-dff0-4695-bc9e-6e796f543669 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 5db27d2e-25e4-4bc0-be01-3f16d1aa415a has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:41:27.956283 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] For port c3ec7d97-8d4b-4d54-93ce-e48d687fc60d, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c3ec7d97-8d4b-4d54-93ce-e48d687fc60d,segment=NetworkSegment(bbfa6ed0-a81b-4cb1-900c-14688862d7da),segment_id=bbfa6ed0-a81b-4cb1-900c-14688862d7da)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:27.957086 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:27.965191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-681a6e7d-dff0-4695-bc9e-6e796f543669 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:41:27.982840 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a123dd2-c9ec-47e4-924e-fdb7a6202e85 None None] Sync routers for ids ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:41:28.014165 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39066) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:28.015694 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-681a6e7d-dff0-4695-bc9e-6e796f543669 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/5db27d2e-25e4-4bc0-be01-3f16d1aa415a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.3834834 May 12 15:41:28.019318 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a123dd2-c9ec-47e4-924e-fdb7a6202e85 None None] Routers {'5db27d2e-25e4-4bc0-be01-3f16d1aa415a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:41:28.020223 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6a123dd2-c9ec-47e4-924e-fdb7a6202e85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:41:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:28.093078 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6a123dd2-c9ec-47e4-924e-fdb7a6202e85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:28.104332 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a123dd2-c9ec-47e4-924e-fdb7a6202e85 None None] Routers {'5db27d2e-25e4-4bc0-be01-3f16d1aa415a'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:41:28.105519 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6a123dd2-c9ec-47e4-924e-fdb7a6202e85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:41:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:28.201900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-634072e7-915c-4807-a149-1abc6e7d533c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports?device_id=5db27d2e-25e4-4bc0-be01-3f16d1aa415a HTTP/1.1" status: 200 len: 205 time: 0.1674705 May 12 15:41:28.202642 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39070) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:28.239962 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6a123dd2-c9ec-47e4-924e-fdb7a6202e85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:28.246706 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a123dd2-c9ec-47e4-924e-fdb7a6202e85 None None] The sync data for ids ['5db27d2e-25e4-4bc0-be01-3f16d1aa415a'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:41:28.464801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Calling delete_port for c3ec7d97-8d4b-4d54-93ce-e48d687fc60d owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:41:28.641441 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:28.713621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Port': ['ID=c3ec7d97-8d4b-4d54-93ce-e48d687fc60d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:28.726664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No DVR routers for this DVR port c3ec7d97-8d4b-4d54-93ce-e48d687fc60d on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:41:28.810235 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0644826c-5eb6-4d76-8348-1e93e95d54c0 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.000200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.069711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['edbc81f2-2828-4a87-bc93-4b30d4f0ab7b']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:29.131434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bbfa6ed0-a81b-4cb1-900c-14688862d7da') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:29.133759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bbfa6ed0-a81b-4cb1-900c-14688862d7da') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:29.178165 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.227549 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.247842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Releasing vlan 560 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:41:29.248269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: timer() May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:41:29.270375 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:41:29.367823 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.393745 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0644826c-5eb6-4d76-8348-1e93e95d54c0 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.396138 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0644826c-5eb6-4d76-8348-1e93e95d54c0 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.432249 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.442722 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0644826c-5eb6-4d76-8348-1e93e95d54c0 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.443558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0644826c-5eb6-4d76-8348-1e93e95d54c0 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Fanout notify agent at l3_agent the message router_deleted on router 5db27d2e-25e4-4bc0-be01-3f16d1aa415a {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:41:29.465218 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0644826c-5eb6-4d76-8348-1e93e95d54c0 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.465569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Network': ['ID=edbc81f2-2828-4a87-bc93-4b30d4f0ab7b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:29.474229 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0644826c-5eb6-4d76-8348-1e93e95d54c0 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/routers/5db27d2e-25e4-4bc0-be01-3f16d1aa415a HTTP/1.1" status: 204 len: 168 time: 1.2642937 May 12 15:41:29.475628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39082) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:29.486666 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8a14fcee-82dd-456a-825c-c346c37e3fe9 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/edbc81f2-2828-4a87-bc93-4b30d4f0ab7b HTTP/1.1" status: 204 len: 168 time: 6.9167562 May 12 15:41:29.489934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39086) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:29.612166 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-4dcc70f6-9ad5-4c59-a9bb-75d9f5065980 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] DELETE failed (client error): The resource could not be found. May 12 15:41:29.613004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4dcc70f6-9ad5-4c59-a9bb-75d9f5065980 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:41:29.615818 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4dcc70f6-9ad5-4c59-a9bb-75d9f5065980 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/edbc81f2-2828-4a87-bc93-4b30d4f0ab7b HTTP/1.1" status: 404 len: 339 time: 0.1243985 May 12 15:41:29.619574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-ac1c24b6-1cd7-45d9-a98e-855ecba74ba4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting subnet b43d14af-848e-4434-a4f7-1e43a0ba4a65 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:41:29.623439 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ac1c24b6-1cd7-45d9-a98e-855ecba74ba4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.625495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39090) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:29.665621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1541774317', 'description': 'd1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:29.674421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:29.680090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Usage tracker for resource:network and tenant:23ebb72014f64d3f921a26784efda987 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:29.685308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Quota usage for network was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:29.690163 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ac1c24b6-1cd7-45d9-a98e-855ecba74ba4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.697430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:29.718253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:29.728379 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.762570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 569} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:41:29.775007 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.775571 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Added segment 925a58c6-3c6f-4f99-8d78-f89a89ac6468 of type vlan for network b53bb899-a655-4d6f-8985-b37f4d489014 May 12 15:41:29.815560 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.854958 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.862007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:29.862669 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:29.883766 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ac1c24b6-1cd7-45d9-a98e-855ecba74ba4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:30.020032 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.3930480 May 12 15:41:30.023295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39094) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:30.143312 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ac1c24b6-1cd7-45d9-a98e-855ecba74ba4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:30.188336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4342538c-289e-4efb-a7f2-525746621ba4 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:30.189137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4342538c-289e-4efb-a7f2-525746621ba4 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Synchronizing usage tracker for tenant:23ebb72014f64d3f921a26784efda987 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:41:30.192367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6351eda7-a658-4043-b5da-6d617df0b8fd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Network': ['ID=b53bb899-a655-4d6f-8985-b37f4d489014,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:30.204156 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network b53bb899-a655-4d6f-8985-b37f4d489014 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:41:30.226053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac1c24b6-1cd7-45d9-a98e-855ecba74ba4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Subnet': ['ID=b43d14af-848e-4434-a4f7-1e43a0ba4a65,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:30.227418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4342538c-289e-4efb-a7f2-525746621ba4 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Unset dirty status for tenant:23ebb72014f64d3f921a26784efda987 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:41:30.232228 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ac1c24b6-1cd7-45d9-a98e-855ecba74ba4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:30.240308 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ac1c24b6-1cd7-45d9-a98e-855ecba74ba4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/b43d14af-848e-4434-a4f7-1e43a0ba4a65 HTTP/1.1" status: 204 len: 168 time: 0.7637703 May 12 15:41:30.242862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39106) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:30.248228 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4342538c-289e-4efb-a7f2-525746621ba4 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "GET /v2.0/networks?id=b53bb899-a655-4d6f-8985-b37f4d489014 HTTP/1.1" status: 200 len: 765 time: 0.2239392 May 12 15:41:30.255487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39110) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:30.285621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e09eda5c-a353-4f0d-bc92-01d00d718fe1 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'network': {'description': 'd2'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:30.373962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-4cb8cb90-5cde-4b35-97c3-ef1aa3c427a4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting subnet 065f3de9-82f8-45c4-adf9-8dd4045e095b {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:41:30.378034 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4cb8cb90-5cde-4b35-97c3-ef1aa3c427a4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:30.462033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2276abc2-c534-4e23-b8ac-b62edbdf15cb None None] Network 23779a52-80bc-4d2e-8340-541517284dda requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:30.514858 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4cb8cb90-5cde-4b35-97c3-ef1aa3c427a4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:30.727402 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4cb8cb90-5cde-4b35-97c3-ef1aa3c427a4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:30.865425 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4cb8cb90-5cde-4b35-97c3-ef1aa3c427a4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:30.869029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af73d26e-b3e6-4265-922f-fa207c598d39 None None] DHCP port deletion for 23779a52-80bc-4d2e-8340-541517284dda request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:41:30.873926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-af73d26e-b3e6-4265-922f-fa207c598d39 None None] Deleting port 7f495018-4d8b-4e6b-ac40-4f017027d43c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:30.874367 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-af73d26e-b3e6-4265-922f-fa207c598d39 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:30.912093 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4cb8cb90-5cde-4b35-97c3-ef1aa3c427a4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:30.915127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cb8cb90-5cde-4b35-97c3-ef1aa3c427a4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Subnet': ['ID=065f3de9-82f8-45c4-adf9-8dd4045e095b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:30.921190 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4cb8cb90-5cde-4b35-97c3-ef1aa3c427a4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/065f3de9-82f8-45c4-adf9-8dd4045e095b HTTP/1.1" status: 204 len: 168 time: 0.6771379 May 12 15:41:30.924982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39116) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:30.934551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27f4780f-1ff6-48e1-af3d-a08961a51a36 None None] Network f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:31.085009 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:31.102900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port 7f495018-4d8b-4e6b-ac40-4f017027d43c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:31.103493 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:31.205671 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e09eda5c-a353-4f0d-bc92-01d00d718fe1 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:31.326878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e09eda5c-a353-4f0d-bc92-01d00d718fe1 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:31.620336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7f495018-4d8b-4e6b-ac40-4f017027d43c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:41:31.674859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-e09eda5c-a353-4f0d-bc92-01d00d718fe1 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network b53bb899-a655-4d6f-8985-b37f4d489014 is not hosted by any dhcp agent {{(pid=88151) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:228}} May 12 15:41:31.686612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e09eda5c-a353-4f0d-bc92-01d00d718fe1 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:31.687916 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e09eda5c-a353-4f0d-bc92-01d00d718fe1 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:31.698115 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e09eda5c-a353-4f0d-bc92-01d00d718fe1 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "PUT /v2.0/networks/b53bb899-a655-4d6f-8985-b37f4d489014 HTTP/1.1" status: 200 len: 762 time: 1.4413755 May 12 15:41:31.699932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39124) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:31.818076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e09eda5c-a353-4f0d-bc92-01d00d718fe1 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Network': ['ID=b53bb899-a655-4d6f-8985-b37f4d489014,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:31.863168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] For port 7f495018-4d8b-4e6b-ac40-4f017027d43c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7f495018-4d8b-4e6b-ac40-4f017027d43c,segment=NetworkSegment(f272e3d1-06c6-44c7-8da9-ff40b8565939),segment_id=f272e3d1-06c6-44c7-8da9-ff40b8565939)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:31.863763 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:31.913548 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network b53bb899-a655-4d6f-8985-b37f4d489014 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:41:31.961848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-af73d26e-b3e6-4265-922f-fa207c598d39 None None] For port 7f495018-4d8b-4e6b-ac40-4f017027d43c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7f495018-4d8b-4e6b-ac40-4f017027d43c,segment=NetworkSegment(f272e3d1-06c6-44c7-8da9-ff40b8565939),segment_id=f272e3d1-06c6-44c7-8da9-ff40b8565939)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:31.962228 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-af73d26e-b3e6-4265-922f-fa207c598d39 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:32.120262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0a09a6d-6bee-404b-87cc-285e64c0055d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:32.122425 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b0a09a6d-6bee-404b-87cc-285e64c0055d tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "GET /v2.0/networks?id=b53bb899-a655-4d6f-8985-b37f4d489014 HTTP/1.1" status: 200 len: 765 time: 0.4179504 May 12 15:41:32.126416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39130) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:32.222815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ddf2b55-1a5f-4788-b766-917427beceff None None] DHCP port deletion for f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:41:32.317432 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:32.415820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for 7f495018-4d8b-4e6b-ac40-4f017027d43c owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:41:32.567527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3ddf2b55-1a5f-4788-b766-917427beceff None None] Deleting port a66b25bd-c80b-4976-906b-401945204a28 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:32.578628 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3ddf2b55-1a5f-4788-b766-917427beceff None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:32.617551 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:32.634330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ab629c1-41c8-49c1-8a0f-13a9e27bc85b tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:32.636000 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0ab629c1-41c8-49c1-8a0f-13a9e27bc85b tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.5083144 May 12 15:41:32.639895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39134) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:32.738884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-732c2a32-e596-4cb2-ae55-6d126a93f7af tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Synchronizing usage tracker for tenant:23ebb72014f64d3f921a26784efda987 on resource:subnet {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:41:32.774498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-732c2a32-e596-4cb2-ae55-6d126a93f7af tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Unset dirty status for tenant:23ebb72014f64d3f921a26784efda987 on resource:subnet {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:41:32.775707 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-732c2a32-e596-4cb2-ae55-6d126a93f7af tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 207 time: 0.1349111 May 12 15:41:32.780107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39142) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:32.782012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=7f495018-4d8b-4e6b-ac40-4f017027d43c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:32.796962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No DVR routers for this DVR port 7f495018-4d8b-4e6b-ac40-4f017027d43c on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:41:32.967091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-af73d26e-b3e6-4265-922f-fa207c598d39 None None] Calling delete_port for 7f495018-4d8b-4e6b-ac40-4f017027d43c owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:41:33.152988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad6c5da4-00fd-4f92-a711-bb67840b689c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:33.162402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad6c5da4-00fd-4f92-a711-bb67840b689c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:33.172845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad6c5da4-00fd-4f92-a711-bb67840b689c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:33.181264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad6c5da4-00fd-4f92-a711-bb67840b689c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:33.187749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad6c5da4-00fd-4f92-a711-bb67840b689c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:33.198108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad6c5da4-00fd-4f92-a711-bb67840b689c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:33.204040 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ad6c5da4-00fd-4f92-a711-bb67840b689c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 3730 time: 0.4195251 May 12 15:41:33.206472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39148) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:33.331668 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:33.458592 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['23779a52-80bc-4d2e-8340-541517284dda']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:33.515015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f272e3d1-06c6-44c7-8da9-ff40b8565939') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:33.516671 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f272e3d1-06c6-44c7-8da9-ff40b8565939') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:33.537018 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:33.562819 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:33.575491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Releasing vlan 559 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:41:33.576169 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:33.603874 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-3ddf2b55-1a5f-4788-b766-917427beceff None None] For port a66b25bd-c80b-4976-906b-401945204a28, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a66b25bd-c80b-4976-906b-401945204a28,segment=NetworkSegment(4c246df8-bf89-4902-969e-467cddaf4df0),segment_id=4c246df8-bf89-4902-969e-467cddaf4df0)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: timer() May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:41:33.605073 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:41:33.607402 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3ddf2b55-1a5f-4788-b766-917427beceff None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:33.754791 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ba6b03ff-30e6-4fe0-abb9-0a10de66a957 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 812 time: 0.5469735 May 12 15:41:33.759830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39152) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:33.800146 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:33.831941 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3ddf2b55-1a5f-4788-b766-917427beceff None None] Calling delete_port for a66b25bd-c80b-4976-906b-401945204a28 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:41:33.863692 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:33.868900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Network': ['ID=23779a52-80bc-4d2e-8340-541517284dda,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:33.921605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39158) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:33.924876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a225616a-dde8-4a6a-b351-c9746823a7e3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/networks/23779a52-80bc-4d2e-8340-541517284dda HTTP/1.1" status: 204 len: 168 time: 2.9978893 May 12 15:41:33.929627 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:33.931091 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-af73d26e-b3e6-4265-922f-fa207c598d39 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:41:33.933958 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-af73d26e-b3e6-4265-922f-fa207c598d39 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:41:33.937470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4435c2f2-a115-4933-819a-1e5b59d9c484 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:33.941473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4435c2f2-a115-4933-819a-1e5b59d9c484 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:33.943533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4435c2f2-a115-4933-819a-1e5b59d9c484 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:33.947002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4435c2f2-a115-4933-819a-1e5b59d9c484 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:33.949146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4435c2f2-a115-4933-819a-1e5b59d9c484 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:33.951555 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4435c2f2-a115-4933-819a-1e5b59d9c484 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.1897445 May 12 15:41:33.954810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39164) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:34.022629 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3ddf2b55-1a5f-4788-b766-917427beceff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:34.090359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ddf2b55-1a5f-4788-b766-917427beceff None None] No DVR routers for this DVR port a66b25bd-c80b-4976-906b-401945204a28 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:41:34.136361 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ddf2b55-1a5f-4788-b766-917427beceff None None] Pushing event deleted for resources: {'Port': ['ID=a66b25bd-c80b-4976-906b-401945204a28,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:34.181148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a66b25bd-c80b-4976-906b-401945204a28 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:41:34.217183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c28197a-e8b7-4194-b00a-e44f731c584e tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:34.219489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c28197a-e8b7-4194-b00a-e44f731c584e tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:34.222625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c28197a-e8b7-4194-b00a-e44f731c584e tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:34.224599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c28197a-e8b7-4194-b00a-e44f731c584e tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:34.226388 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c28197a-e8b7-4194-b00a-e44f731c584e tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:34.228189 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0c28197a-e8b7-4194-b00a-e44f731c584e tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 697 time: 0.2724621 May 12 15:41:34.233825 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39172) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:34.276255 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: a66b25bd-c80b-4976-906b-401945204a28 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:41:34.276871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a66b25bd-c80b-4976-906b-401945204a28 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:41:34.355998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51728de3-3a58-4287-8ba7-8d6e82085db5 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:34.434942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-af73d26e-b3e6-4265-922f-fa207c598d39 None None] Deleting port 7f495018-4d8b-4e6b-ac40-4f017027d43c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:34.435323 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-af73d26e-b3e6-4265-922f-fa207c598d39 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:34.539512 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51728de3-3a58-4287-8ba7-8d6e82085db5 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:34.546001 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8a1a0a5-0ec0-45a4-ae07-4086b49e4c64 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:34.546996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8a1a0a5-0ec0-45a4-ae07-4086b49e4c64 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Synchronizing usage tracker for tenant:23ebb72014f64d3f921a26784efda987 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:41:34.560111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a8a1a0a5-0ec0-45a4-ae07-4086b49e4c64 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Unset dirty status for tenant:23ebb72014f64d3f921a26784efda987 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:41:34.561250 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a8a1a0a5-0ec0-45a4-ae07-4086b49e4c64 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "GET /v2.0/networks/4e892bc1-e9cd-4ae0-afba-9426073de30e HTTP/1.1" status: 200 len: 803 time: 0.3262262 May 12 15:41:34.566438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39180) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:34.571378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-51728de3-3a58-4287-8ba7-8d6e82085db5 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:34.588083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-51728de3-3a58-4287-8ba7-8d6e82085db5 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4c246df8-bf89-4902-969e-467cddaf4df0') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:34.588442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-51728de3-3a58-4287-8ba7-8d6e82085db5 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4c246df8-bf89-4902-969e-467cddaf4df0') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:34.601260 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51728de3-3a58-4287-8ba7-8d6e82085db5 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:34.620252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51728de3-3a58-4287-8ba7-8d6e82085db5 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:34.628799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-51728de3-3a58-4287-8ba7-8d6e82085db5 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Releasing vlan 572 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:41:34.629313 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51728de3-3a58-4287-8ba7-8d6e82085db5 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: timer() May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:41:34.709814 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:41:34.769273 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51728de3-3a58-4287-8ba7-8d6e82085db5 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:34.780895 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51728de3-3a58-4287-8ba7-8d6e82085db5 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:34.793440 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-af73d26e-b3e6-4265-922f-fa207c598d39 None None] The port '7f495018-4d8b-4e6b-ac40-4f017027d43c' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:41:34.810673 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-51728de3-3a58-4287-8ba7-8d6e82085db5 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/networks/f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a HTTP/1.1" status: 204 len: 168 time: 0.8547773 May 12 15:41:34.810673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39184) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:34.817468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'network': {'name': 'tempest-RoutersTest-524022240'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:34.829262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51728de3-3a58-4287-8ba7-8d6e82085db5 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Network': ['ID=f9eb8f53-050f-43a5-9eb1-b7a4f4d46f4a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:34.831902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:34.837511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:network and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:34.841228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:34.850558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:34.868028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:34.875622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:34.932458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 564} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:41:34.940367 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:41:34.945297 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:34.946005 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Added segment 24ca703d-74e4-411d-a39c-586b7ab9d075 of type vlan for network 4ddb05cb-5b62-4e39-b733-c36a8e7deb35 May 12 15:41:34.981328 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9c18776c-88b7-48eb-8558-30fc743c1b9b tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "GET /v2.0/networks/4e892bc1-e9cd-4ae0-afba-9426073de30e?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 319 time: 0.4137602 May 12 15:41:34.985091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39188) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:35.013232 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:35.077834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:35.088377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:35.089539 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:35.103569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff532a79-c73d-48dc-8ca0-78094074eb27 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:35.104965 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ff532a79-c73d-48dc-8ca0-78094074eb27 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "GET /v2.0/subnets/cf8ef23d-e876-4621-90c8-4b95c688ce9f HTTP/1.1" status: 200 len: 843 time: 0.1187572 May 12 15:41:35.108948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39194) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:35.250049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3587feb-a3f4-437c-b801-6a16de70f902 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:35.251611 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b3587feb-a3f4-437c-b801-6a16de70f902 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "GET /v2.0/subnets/cf8ef23d-e876-4621-90c8-4b95c688ce9f?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.1386855 May 12 15:41:35.256287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39198) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:35.262587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-61d3fcc2-7cc2-470b-98a9-b40d9c573cdf tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1370450441'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:35.270331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-61d3fcc2-7cc2-470b-98a9-b40d9c573cdf tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:35.289341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-61d3fcc2-7cc2-470b-98a9-b40d9c573cdf tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource network. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:35.313363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-61d3fcc2-7cc2-470b-98a9-b40d9c573cdf tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:35.322370 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61d3fcc2-7cc2-470b-98a9-b40d9c573cdf tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:35.378887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-61d3fcc2-7cc2-470b-98a9-b40d9c573cdf tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 555} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:41:35.402629 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61d3fcc2-7cc2-470b-98a9-b40d9c573cdf tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:35.402977 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-61d3fcc2-7cc2-470b-98a9-b40d9c573cdf tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Added segment cbe0603b-e02c-4086-877a-a1db725b091d of type vlan for network bf51ba5f-2fc8-45e9-8aa4-b5482757683e May 12 15:41:35.487382 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61d3fcc2-7cc2-470b-98a9-b40d9c573cdf tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:35.559662 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61d3fcc2-7cc2-470b-98a9-b40d9c573cdf tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:35.566254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61d3fcc2-7cc2-470b-98a9-b40d9c573cdf tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:35.566851 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61d3fcc2-7cc2-470b-98a9-b40d9c573cdf tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:35.568279 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.7568035 May 12 15:41:35.570726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39204) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:35.606244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26d3440f-0cc6-4911-a19c-1587ab777c5a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Network': ['ID=4ddb05cb-5b62-4e39-b733-c36a8e7deb35,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:35.607550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'subnet': {'network_id': '4ddb05cb-5b62-4e39-b733-c36a8e7deb35', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:35.618445 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 4ddb05cb-5b62-4e39-b733-c36a8e7deb35 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:41:35.994123 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-61d3fcc2-7cc2-470b-98a9-b40d9c573cdf tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.7326255 May 12 15:41:35.994123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d3fcc2-7cc2-470b-98a9-b40d9c573cdf tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Network': ['ID=bf51ba5f-2fc8-45e9-8aa4-b5482757683e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:35.999975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39210) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:36.005731 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network bf51ba5f-2fc8-45e9-8aa4-b5482757683e details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:41:36.013084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'subnet': {'network_id': 'bf51ba5f-2fc8-45e9-8aa4-b5482757683e', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888'], 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:36.170967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:36.187850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attempting to reserve 1 items for resource subnet. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:36.203317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:36.209318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Made reservation on behalf of 23ebb72014f64d3f921a26784efda987 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:36.240681 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:36.277206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:subnet and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:36.288218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:36.491428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:36.523793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:36.527219 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:36.541667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.ipam_backend_mixin [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Performing IP validity checks on allocation pools {{(pid=88152) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:314}} May 12 15:41:36.542184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.ipam_backend_mixin [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Checking for overlaps among allocation pools and gateway ip {{(pid=88152) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:335}} May 12 15:41:36.937550 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:37.013258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Subnet': ['ID=738c462a-65bc-4929-afef-e9bdcd044211,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:37.029928 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:37.125098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Checking segment: {'id': '24ca703d-74e4-411d-a39c-586b7ab9d075', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '4ddb05cb-5b62-4e39-b733-c36a8e7deb35'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:41:37.125507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network hostable DHCP agents. Network: 4ddb05cb-5b62-4e39-b733-c36a8e7deb35, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:41:37.154808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Subnet': ['ID=2729fb1e-41c6-44ff-8c22-39a0d3ddeb33,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:37.182366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Checking segment: {'id': 'cbe0603b-e02c-4086-877a-a1db725b091d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 555, 'network_id': 'bf51ba5f-2fc8-45e9-8aa4-b5482757683e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:41:37.183029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network hostable DHCP agents. Network: bf51ba5f-2fc8-45e9-8aa4-b5482757683e, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:41:37.191628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 4ddb05cb-5b62-4e39-b733-c36a8e7deb35 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:41:37.210909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 4ddb05cb-5b62-4e39-b733-c36a8e7deb35) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:37.216237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:37.216811 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:37.222890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d3cdcaa-4305-4526-b5be-26173963ab3f None None] Network 4ddb05cb-5b62-4e39-b733-c36a8e7deb35 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:37.224311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Network bf51ba5f-2fc8-45e9-8aa4-b5482757683e is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:41:37.247845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, bf51ba5f-2fc8-45e9-8aa4-b5482757683e) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:37.255814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:37.256257 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:37.276349 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c95f441d-682b-45e6-97dc-b6f2cad19d82 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.6817360 May 12 15:41:37.279171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39220) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:37.287680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f6a4c46e-d312-47ca-a874-08e1d2c437ae tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1444612038', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:37.296259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f6a4c46e-d312-47ca-a874-08e1d2c437ae tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:37.301243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f6a4c46e-d312-47ca-a874-08e1d2c437ae tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:router and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:37.304782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f6a4c46e-d312-47ca-a874-08e1d2c437ae tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:37.312595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f6a4c46e-d312-47ca-a874-08e1d2c437ae tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:37.325422 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b91275be-1fea-4cc6-a1f1-b7231a607a6c tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 895 time: 1.3258419 May 12 15:41:37.325747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39226) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:37.335266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e4ae2575-f87b-4094-8b19-54b93ba81c72 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2005::1'}], 'dns_nameservers': ['2001:4860:4860::7744', '2001:4860:4860::7888'], 'gateway_ip': '2001:db8::2', 'enable_dhcp': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:37.386006 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f6a4c46e-d312-47ca-a874-08e1d2c437ae tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:37.387287 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f6a4c46e-d312-47ca-a874-08e1d2c437ae tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:37.435653 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f6a4c46e-d312-47ca-a874-08e1d2c437ae tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:37.566744 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f6a4c46e-d312-47ca-a874-08e1d2c437ae tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:37.597922 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4ae2575-f87b-4094-8b19-54b93ba81c72 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-1637698'] for subnet, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:37.655859 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f6a4c46e-d312-47ca-a874-08e1d2c437ae tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:37.660707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f6a4c46e-d312-47ca-a874-08e1d2c437ae tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.3805180 May 12 15:41:37.663669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39232) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:37.670135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'port': {'network_id': '4ddb05cb-5b62-4e39-b733-c36a8e7deb35', 'name': 'tempest-RoutersTest-260698671'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:37.761902 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70024587-7a4b-48e4-ae72-b9a52087c151 None None] Network bf51ba5f-2fc8-45e9-8aa4-b5482757683e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:38.109162 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4ae2575-f87b-4094-8b19-54b93ba81c72 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8768026839929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-28130211'] for subnet, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:38.151229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-4ddb05cb-5b62-4e39-b733-c36a8e7deb35', 'network_id': '4ddb05cb-5b62-4e39-b733-c36a8e7deb35', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'fixed_ips': [{'subnet_id': '738c462a-65bc-4929-afef-e9bdcd044211'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:41:38.152058 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:38.307616 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4ae2575-f87b-4094-8b19-54b93ba81c72 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event updated for resources: {'Subnet': ['ID=2729fb1e-41c6-44ff-8c22-39a0d3ddeb33,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:38.342069 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4ae2575-f87b-4094-8b19-54b93ba81c72 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:38.342069 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e4ae2575-f87b-4094-8b19-54b93ba81c72 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:38.342069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e4ae2575-f87b-4094-8b19-54b93ba81c72 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "PUT /v2.0/subnets/2729fb1e-41c6-44ff-8c22-39a0d3ddeb33 HTTP/1.1" status: 200 len: 900 time: 1.0120170 May 12 15:41:38.342069 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39238) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:38.364861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:38.374265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:port and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:38.382117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:38.393280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:38.412064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:38.419279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:38.472766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] device_id is not set on port 9d9e82e0-7f4d-434b-9a03-c7abc4f561da yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:41:38.546366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-bf51ba5f-2fc8-45e9-8aa4-b5482757683e', 'network_id': 'bf51ba5f-2fc8-45e9-8aa4-b5482757683e', 'tenant_id': '23ebb72014f64d3f921a26784efda987', 'fixed_ips': [{'subnet_id': '2729fb1e-41c6-44ff-8c22-39a0d3ddeb33'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:41:38.547121 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:38.645592 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:38.782294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Allocated IP 172.20.0.2 (4ddb05cb-5b62-4e39-b733-c36a8e7deb35/738c462a-65bc-4929-afef-e9bdcd044211/9d9e82e0-7f4d-434b-9a03-c7abc4f561da) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:41:38.911742 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:39.258285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Allocated IP 2001:db8::3 (bf51ba5f-2fc8-45e9-8aa4-b5482757683e/2729fb1e-41c6-44ff-8c22-39a0d3ddeb33/631fa684-458a-4b3c-a470-67e573d4327e) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:41:39.318682 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:39.367041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Transition to ACTIVE for port object 9d9e82e0-7f4d-434b-9a03-c7abc4f561da will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:41:39.422590 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:39.520981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 4ddb05cb-5b62-4e39-b733-c36a8e7deb35 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:41:39.524300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:39.529475 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:41:39.562537 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=9d9e82e0-7f4d-434b-9a03-c7abc4f561da,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:39.591203 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Retry wrapper got retriable exception: Failed to create a duplicate IpamAllocation: for attribute(s) ['ipamallocations.PRIMARY'] with value(s) 172.20.0.2-0b6ec3ba-4e0a-4afa-8f4e-9bc6bf94207c {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:41:39.591721 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:41:39.604599 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:39.605280 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:39.650935 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-03f43594-c8d7-400f-b038-d7a652915ad1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 921 time: 1.9860535 May 12 15:41:39.653757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39248) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:39.777988 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:39.793931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Transition to ACTIVE for port object 631fa684-458a-4b3c-a470-67e573d4327e will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:41:39.835661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Transition to ACTIVE for port object 631fa684-458a-4b3c-a470-67e573d4327e will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:41:39.865566 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:40.040511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Pushing event updated for resources: {'Port': ['ID=631fa684-458a-4b3c-a470-67e573d4327e,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:40.060507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Network bf51ba5f-2fc8-45e9-8aa4-b5482757683e is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:41:40.061921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:40.065468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:41:40.112009 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:40.132691 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:40.375374 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Attempting to bind port 631fa684-458a-4b3c-a470-67e573d4327e on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:41:40.375735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Attempting to bind port 631fa684-458a-4b3c-a470-67e573d4327e by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'cbe0603b-e02c-4086-877a-a1db725b091d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 555, 'network_id': 'bf51ba5f-2fc8-45e9-8aa4-b5482757683e'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:41:40.376093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Attempting to bind port 631fa684-458a-4b3c-a470-67e573d4327e on network bf51ba5f-2fc8-45e9-8aa4-b5482757683e {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:41:40.413585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 41, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:41:40.413953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Checking segment: {'id': 'cbe0603b-e02c-4086-877a-a1db725b091d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 555, 'network_id': 'bf51ba5f-2fc8-45e9-8aa4-b5482757683e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:41:40.419812 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:40.420225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Bound using segment: {'id': 'cbe0603b-e02c-4086-877a-a1db725b091d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 555, 'network_id': 'bf51ba5f-2fc8-45e9-8aa4-b5482757683e'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:41:40.420984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Bound port: 631fa684-458a-4b3c-a470-67e573d4327e, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cbe0603b-e02c-4086-877a-a1db725b091d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 555, 'network_id': 'bf51ba5f-2fc8-45e9-8aa4-b5482757683e'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:41:40.421364 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:40.502826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Subnet': ['ID=2729fb1e-41c6-44ff-8c22-39a0d3ddeb33,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:40.572642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] For port 631fa684-458a-4b3c-a470-67e573d4327e, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:41:40.576851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] For port 631fa684-458a-4b3c-a470-67e573d4327e, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=631fa684-458a-4b3c-a470-67e573d4327e,segment=NetworkSegment(cbe0603b-e02c-4086-877a-a1db725b091d),segment_id=cbe0603b-e02c-4086-877a-a1db725b091d)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:41:40.584458 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:40.877656 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:40.920083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bf51ba5f-2fc8-45e9-8aa4-b5482757683e']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:40.940076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16e5b470-4596-4ec5-b654-d87da02a94e7 None None] Pushing event updated for resources: {'Port': ['ID=631fa684-458a-4b3c-a470-67e573d4327e,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:40.955625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Allocated IP 172.20.0.3 (4ddb05cb-5b62-4e39-b733-c36a8e7deb35/738c462a-65bc-4929-afef-e9bdcd044211/1d0f2d14-ffc3-4f50-ab52-39105cd87761) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:41:41.066266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e1ba306-f728-46c1-afa4-a5ffad5b85a0 None None] Network bf51ba5f-2fc8-45e9-8aa4-b5482757683e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:41.074640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cbe0603b-e02c-4086-877a-a1db725b091d') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:41.074938 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cbe0603b-e02c-4086-877a-a1db725b091d') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:41.107966 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:41.191221 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:41.205373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Releasing vlan 555 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:41:41.205800 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: timer() May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:41:41.222806 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:41:41.283850 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:41.406097 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') May 12 15:41:41.406097 n-d-841483-1 neutron-server[88152]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] May 12 15:41:41.406097 n-d-841483-1 neutron-server[88152]: [parameters: {'id': 'bf51ba5f-2fc8-45e9-8aa4-b5482757683e'}] May 12 15:41:41.406097 n-d-841483-1 neutron-server[88152]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:41:41.407346 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:41:41.722422 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:41.743165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Transition to ACTIVE for port object 1d0f2d14-ffc3-4f50-ab52-39105cd87761 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:41:41.810034 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Transition to ACTIVE for port object 1d0f2d14-ffc3-4f50-ab52-39105cd87761 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:41:41.829115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:41.915077 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06b7f46c-3ebd-45e8-8d93-9e07252216b4 None None] Network bf51ba5f-2fc8-45e9-8aa4-b5482757683e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:41.965676 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Network 4ddb05cb-5b62-4e39-b733-c36a8e7deb35 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:41:41.977308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:42.024378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:41:42.040254 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:42.127860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Deleting port 631fa684-458a-4b3c-a470-67e573d4327e {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:42.129971 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:42.173979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Pushing event updated for resources: {'Port': ['ID=1d0f2d14-ffc3-4f50-ab52-39105cd87761,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:42.243096 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:42.271256 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:42.448747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Attempting to bind port 1d0f2d14-ffc3-4f50-ab52-39105cd87761 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:41:42.449299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Attempting to bind port 1d0f2d14-ffc3-4f50-ab52-39105cd87761 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '24ca703d-74e4-411d-a39c-586b7ab9d075', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '4ddb05cb-5b62-4e39-b733-c36a8e7deb35'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:41:42.449747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Attempting to bind port 1d0f2d14-ffc3-4f50-ab52-39105cd87761 on network 4ddb05cb-5b62-4e39-b733-c36a8e7deb35 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:41:42.469426 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 41, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:41:42.470080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Checking segment: {'id': '24ca703d-74e4-411d-a39c-586b7ab9d075', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '4ddb05cb-5b62-4e39-b733-c36a8e7deb35'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:41:42.470809 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:42.471362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Bound using segment: {'id': '24ca703d-74e4-411d-a39c-586b7ab9d075', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '4ddb05cb-5b62-4e39-b733-c36a8e7deb35'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:41:42.473083 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Bound port: 1d0f2d14-ffc3-4f50-ab52-39105cd87761, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '24ca703d-74e4-411d-a39c-586b7ab9d075', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '4ddb05cb-5b62-4e39-b733-c36a8e7deb35'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:41:42.473776 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:42.669237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] For port 1d0f2d14-ffc3-4f50-ab52-39105cd87761, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:41:42.672921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] For port 1d0f2d14-ffc3-4f50-ab52-39105cd87761, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1d0f2d14-ffc3-4f50-ab52-39105cd87761,segment=NetworkSegment(24ca703d-74e4-411d-a39c-586b7ab9d075),segment_id=24ca703d-74e4-411d-a39c-586b7ab9d075)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:41:42.679431 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:42.905582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] For port 631fa684-458a-4b3c-a470-67e573d4327e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=631fa684-458a-4b3c-a470-67e573d4327e,segment=NetworkSegment(cbe0603b-e02c-4086-877a-a1db725b091d),segment_id=cbe0603b-e02c-4086-877a-a1db725b091d)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:42.907714 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:42.993376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-140a132d-7d24-4439-8b1a-8ac741a3f3e6 None None] Pushing event updated for resources: {'Port': ['ID=1d0f2d14-ffc3-4f50-ab52-39105cd87761,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:43.001109 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f50b8969-f5d8-4224-96c1-6f7cae45f154 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:43.271636 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:43.554838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Calling delete_port for 631fa684-458a-4b3c-a470-67e573d4327e owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:41:43.649311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=9d9e82e0-7f4d-434b-9a03-c7abc4f561da,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:43.747387 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:43.899804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Port': ['ID=631fa684-458a-4b3c-a470-67e573d4327e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:43.967989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No DVR routers for this DVR port 631fa684-458a-4b3c-a470-67e573d4327e on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:41:44.232933 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1d0f2d14-ffc3-4f50-ab52-39105cd87761 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:41:44.408201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 1d0f2d14-ffc3-4f50-ab52-39105cd87761 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:41:44.451409 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:44.468192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:44.513885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bf51ba5f-2fc8-45e9-8aa4-b5482757683e']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:44.532224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cbe0603b-e02c-4086-877a-a1db725b091d') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:44.533342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cbe0603b-e02c-4086-877a-a1db725b091d') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:44.557810 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:44.600450 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:44.617883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Releasing vlan 555 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:41:44.618198 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:44.633551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a2d0500-6d80-4057-b03a-a1cee02bc8d3 None None] Network 4ddb05cb-5b62-4e39-b733-c36a8e7deb35 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: timer() May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:41:44.637083 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:41:44.781427 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:44.794989 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:44.804961 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:44.830393 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9f4927bf-94d4-43ce-a48b-8b8486426c9c None None] Provisioning for port 1d0f2d14-ffc3-4f50-ab52-39105cd87761 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:41:44.851707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Network': ['ID=bf51ba5f-2fc8-45e9-8aa4-b5482757683e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:44.866124 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9f4927bf-94d4-43ce-a48b-8b8486426c9c None None] Provisioning complete for port 1d0f2d14-ffc3-4f50-ab52-39105cd87761 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:44.876229 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9f4927bf-94d4-43ce-a48b-8b8486426c9c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:45.451514 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9f4927bf-94d4-43ce-a48b-8b8486426c9c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:45.523792 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a656b10b-7cbc-4588-8914-618759590b7a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:45.569097 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-209ce22a-cf75-4b6e-869b-bca75f3c7a57 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/bf51ba5f-2fc8-45e9-8aa4-b5482757683e HTTP/1.1" status: 204 len: 168 time: 7.2261734 May 12 15:41:45.570387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39476) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:45.706425 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:45.717641 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:45.731763 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-d82cdfe6-a352-43b5-a1fa-4a2b9424a997 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] DELETE failed (client error): The resource could not be found. May 12 15:41:45.732266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d82cdfe6-a352-43b5-a1fa-4a2b9424a997 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:41:45.734351 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d82cdfe6-a352-43b5-a1fa-4a2b9424a997 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/subnets/2729fb1e-41c6-44ff-8c22-39a0d3ddeb33 HTTP/1.1" status: 404 len: 337 time: 0.1629570 May 12 15:41:45.752965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39484) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:45.766219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9f4927bf-94d4-43ce-a48b-8b8486426c9c None None] For port 1d0f2d14-ffc3-4f50-ab52-39105cd87761, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1d0f2d14-ffc3-4f50-ab52-39105cd87761,segment=NetworkSegment(24ca703d-74e4-411d-a39c-586b7ab9d075),segment_id=24ca703d-74e4-411d-a39c-586b7ab9d075)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:45.784591 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9f4927bf-94d4-43ce-a48b-8b8486426c9c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:45.840785 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-58a1305a-ce80-4d98-ba7e-e47a48c09f64 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] DELETE failed (client error): The resource could not be found. May 12 15:41:45.841712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-58a1305a-ce80-4d98-ba7e-e47a48c09f64 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:41:45.847170 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-58a1305a-ce80-4d98-ba7e-e47a48c09f64 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/bf51ba5f-2fc8-45e9-8aa4-b5482757683e HTTP/1.1" status: 404 len: 339 time: 0.0931351 May 12 15:41:45.849869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39488) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:45.949403 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:45.952889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=9d9e82e0-7f4d-434b-9a03-c7abc4f561da,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:46.099223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f4927bf-94d4-43ce-a48b-8b8486426c9c None None] Pushing event updated for resources: {'Port': ['ID=1d0f2d14-ffc3-4f50-ab52-39105cd87761,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:46.177704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-049966ca-5dae-44e5-adfa-3ec1eae3e244 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:46.184940 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:46.191675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 4ddb05cb-5b62-4e39-b733-c36a8e7deb35 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:41:46.196894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:41:46.287451 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:46.457687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39496) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:46.532024 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-049966ca-5dae-44e5-adfa-3ec1eae3e244 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:46.600805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-049966ca-5dae-44e5-adfa-3ec1eae3e244 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b53bb899-a655-4d6f-8985-b37f4d489014']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:46.655648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-049966ca-5dae-44e5-adfa-3ec1eae3e244 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '925a58c6-3c6f-4f99-8d78-f89a89ac6468') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:46.659140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-049966ca-5dae-44e5-adfa-3ec1eae3e244 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '925a58c6-3c6f-4f99-8d78-f89a89ac6468') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:46.737865 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-049966ca-5dae-44e5-adfa-3ec1eae3e244 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:46.817355 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-049966ca-5dae-44e5-adfa-3ec1eae3e244 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:46.887425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-68d73f3e-79c5-4b27-8824-e607d62531e5 None None] Provisioning complete for port 1d0f2d14-ffc3-4f50-ab52-39105cd87761 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:46.888275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-049966ca-5dae-44e5-adfa-3ec1eae3e244 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Releasing vlan 569 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:41:46.889483 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-049966ca-5dae-44e5-adfa-3ec1eae3e244 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:46.890088 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-68d73f3e-79c5-4b27-8824-e607d62531e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: timer() May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:41:46.935567 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:41:46.950052 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8cde5894-ac1b-47b2-bced-e9cbd9f306fb admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:47.076981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8cde5894-ac1b-47b2-bced-e9cbd9f306fb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:47.094917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8cde5894-ac1b-47b2-bced-e9cbd9f306fb admin admin] Usage tracker for resource:security_group_rule and tenant:0143d6ff5e6c414cba50162b0b0e14f3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:47.113509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8cde5894-ac1b-47b2-bced-e9cbd9f306fb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:47.136732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8cde5894-ac1b-47b2-bced-e9cbd9f306fb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:47.337202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 171fbbe8-103b-4069-8efc-f9a483f821d6 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:41:47.436754 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-049966ca-5dae-44e5-adfa-3ec1eae3e244 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:47.454894 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-049966ca-5dae-44e5-adfa-3ec1eae3e244 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:47.665806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-68d73f3e-79c5-4b27-8824-e607d62531e5 None None] Provisioning for port 9d9e82e0-7f4d-434b-9a03-c7abc4f561da completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:41:47.707159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-68d73f3e-79c5-4b27-8824-e607d62531e5 None None] Provisioning complete for port 9d9e82e0-7f4d-434b-9a03-c7abc4f561da triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:47.707529 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-68d73f3e-79c5-4b27-8824-e607d62531e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:47.779801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:41:47.792225 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ed7d70bb-614a-4b92-a069-27eeec55d11a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/171fbbe8-103b-4069-8efc-f9a483f821d6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.1370873 May 12 15:41:47.793683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-68d73f3e-79c5-4b27-8824-e607d62531e5 None None] Port 9d9e82e0-7f4d-434b-9a03-c7abc4f561da cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:41:47.794994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39518) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:47.808245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6553c4b8-6d73-4d8f-8c96-8684866926e7 None None] Sync routers for ids ['171fbbe8-103b-4069-8efc-f9a483f821d6'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:41:47.821715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6553c4b8-6d73-4d8f-8c96-8684866926e7 None None] Routers {'171fbbe8-103b-4069-8efc-f9a483f821d6'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:41:47.822346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6553c4b8-6d73-4d8f-8c96-8684866926e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:41:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['171fbbe8-103b-4069-8efc-f9a483f821d6'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:47.871183 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8cde5894-ac1b-47b2-bced-e9cbd9f306fb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:47.876780 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:47.878033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-049966ca-5dae-44e5-adfa-3ec1eae3e244 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Network': ['ID=b53bb899-a655-4d6f-8985-b37f4d489014,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:47.886187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8cde5894-ac1b-47b2-bced-e9cbd9f306fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:47.897735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6553c4b8-6d73-4d8f-8c96-8684866926e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:47.953897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6553c4b8-6d73-4d8f-8c96-8684866926e7 None None] Routers {'171fbbe8-103b-4069-8efc-f9a483f821d6'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:41:47.956680 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6553c4b8-6d73-4d8f-8c96-8684866926e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:41:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['171fbbe8-103b-4069-8efc-f9a483f821d6'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:47.962599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0bef7c22-6059-4837-9228-93a203904fe2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:47.968684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0bef7c22-6059-4837-9228-93a203904fe2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Synchronizing usage tracker for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:41:47.969741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cde5894-ac1b-47b2-bced-e9cbd9f306fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=536a8151-2a47-4fce-9836-6fabcb1610fa,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:47.976596 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-049966ca-5dae-44e5-adfa-3ec1eae3e244 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/b53bb899-a655-4d6f-8985-b37f4d489014 HTTP/1.1" status: 204 len: 168 time: 2.1211653 May 12 15:41:47.981054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39522) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:48.017280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0bef7c22-6059-4837-9228-93a203904fe2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Unset dirty status for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:41:48.018868 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0bef7c22-6059-4837-9228-93a203904fe2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports/9d9e82e0-7f4d-434b-9a03-c7abc4f561da HTTP/1.1" status: 200 len: 976 time: 0.2224665 May 12 15:41:48.022570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39528) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:48.188308 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-d6458175-a932-4efe-874b-aae7b86d56b5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] DELETE failed (client error): The resource could not be found. May 12 15:41:48.192242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d6458175-a932-4efe-874b-aae7b86d56b5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:41:48.200718 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d6458175-a932-4efe-874b-aae7b86d56b5 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/subnets/d6ca1c3b-7fd6-4f8d-a60e-74a1e6b90443 HTTP/1.1" status: 404 len: 337 time: 0.2083356 May 12 15:41:48.200718 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8cde5894-ac1b-47b2-bced-e9cbd9f306fb admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0143d6ff5e6c414cba50162b0b0e14f3&name=default HTTP/1.1" status: 200 len: 2983 time: 1.7398310 May 12 15:41:48.231092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39534) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:48.231730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39536) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:48.387362 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-cfcf1541-6b92-47f5-bb30-fa2f98c6a3cd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] DELETE failed (client error): The resource could not be found. May 12 15:41:48.389157 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cfcf1541-6b92-47f5-bb30-fa2f98c6a3cd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:41:48.394834 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cfcf1541-6b92-47f5-bb30-fa2f98c6a3cd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/edbc81f2-2828-4a87-bc93-4b30d4f0ab7b HTTP/1.1" status: 404 len: 339 time: 0.1604316 May 12 15:41:48.398634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39544) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:48.416784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-6553c4b8-6d73-4d8f-8c96-8684866926e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:48.417179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6553c4b8-6d73-4d8f-8c96-8684866926e7 None None] The sync data for ids ['171fbbe8-103b-4069-8efc-f9a483f821d6'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:41:48.420267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1d0f2d14-ffc3-4f50-ab52-39105cd87761 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:41:48.511424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69b86ed3-9ce5-4617-8ef7-4c28afc79565 None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:41:48.556284 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e1b823bc-9d03-4232-b356-c0c92fbfe86b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:48.610755 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e1b823bc-9d03-4232-b356-c0c92fbfe86b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:48.647042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-e0a67ede-c5bc-488c-b471-fc9016807875 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Deleting subnet 6f95b469-7d12-4e89-acd9-d88eb3ca38c2 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:41:48.669961 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0a67ede-c5bc-488c-b471-fc9016807875 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:48.679285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69b86ed3-9ce5-4617-8ef7-4c28afc79565 None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:41:48.753795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ce34f1c4-53b2-4ed9-b698-6b7fe5207caf None None] Provisioning complete for port 9d9e82e0-7f4d-434b-9a03-c7abc4f561da triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:48.754171 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ce34f1c4-53b2-4ed9-b698-6b7fe5207caf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:48.787701 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0a67ede-c5bc-488c-b471-fc9016807875 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:48.885195 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e1b823bc-9d03-4232-b356-c0c92fbfe86b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:48.910451 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ce34f1c4-53b2-4ed9-b698-6b7fe5207caf None None] Port 9d9e82e0-7f4d-434b-9a03-c7abc4f561da cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:41:48.936603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1b823bc-9d03-4232-b356-c0c92fbfe86b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=536a8151-2a47-4fce-9836-6fabcb1610fa,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:48.957908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e1b823bc-9d03-4232-b356-c0c92fbfe86b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:48.961249 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e1b823bc-9d03-4232-b356-c0c92fbfe86b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/536a8151-2a47-4fce-9836-6fabcb1610fa HTTP/1.1" status: 204 len: 168 time: 0.7220864 May 12 15:41:48.997505 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0a67ede-c5bc-488c-b471-fc9016807875 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:48.999472 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 1d0f2d14-ffc3-4f50-ab52-39105cd87761 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:49.000029 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:49.202227 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0a67ede-c5bc-488c-b471-fc9016807875 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:49.311316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0a67ede-c5bc-488c-b471-fc9016807875 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Subnet': ['ID=6f95b469-7d12-4e89-acd9-d88eb3ca38c2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:49.317044 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e0a67ede-c5bc-488c-b471-fc9016807875 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:49.341155 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e0a67ede-c5bc-488c-b471-fc9016807875 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/subnets/6f95b469-7d12-4e89-acd9-d88eb3ca38c2 HTTP/1.1" status: 204 len: 168 time: 0.9312088 May 12 15:41:49.347043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39556) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:49.396716 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f2d24f1d-cef4-45f0-a126-b0ea7cb43dd9 None None] Provisioning complete for port 9d9e82e0-7f4d-434b-9a03-c7abc4f561da triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:41:49.409350 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f2d24f1d-cef4-45f0-a126-b0ea7cb43dd9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:49.426920 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17f091bf-b278-4c61-a5fe-d83cdb1ebe00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:49.479532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-f2a81f3f-b297-4859-b227-c4a4817c3d69 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Deleting subnet 7bf69d7d-027d-47fa-b93e-2ec7f6bc90e4 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:41:49.483266 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2a81f3f-b297-4859-b227-c4a4817c3d69 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:49.622686 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2a81f3f-b297-4859-b227-c4a4817c3d69 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:49.676311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f2d24f1d-cef4-45f0-a126-b0ea7cb43dd9 None None] Port 9d9e82e0-7f4d-434b-9a03-c7abc4f561da cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:41:49.935315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9600920-7ffb-481a-9ed6-6b9dde327dc2 None None] Network d1b03368-2a7f-424e-8a55-929dc38a4616 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:50.002067 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2a81f3f-b297-4859-b227-c4a4817c3d69 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:50.241876 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2a81f3f-b297-4859-b227-c4a4817c3d69 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:50.260273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-17f091bf-b278-4c61-a5fe-d83cdb1ebe00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port 9d9e82e0-7f4d-434b-9a03-c7abc4f561da {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:50.260741 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17f091bf-b278-4c61-a5fe-d83cdb1ebe00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:50.717297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4aeb221-404c-4188-a660-c6e0804df865 None None] DHCP port deletion for d1b03368-2a7f-424e-8a55-929dc38a4616 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:41:50.723203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e4aeb221-404c-4188-a660-c6e0804df865 None None] Deleting port a00b9646-c3ec-4c10-9470-6be1cbdc072a {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:50.723573 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e4aeb221-404c-4188-a660-c6e0804df865 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:50.744188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2a81f3f-b297-4859-b227-c4a4817c3d69 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Subnet': ['ID=7bf69d7d-027d-47fa-b93e-2ec7f6bc90e4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:50.758344 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2a81f3f-b297-4859-b227-c4a4817c3d69 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:50.760336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39594) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:50.884185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-a2672def-ad57-49ff-b98c-49d627a3b68b admin admin] Deleting subnet 3c282c52-5b3b-474f-b33b-26979e8a2384 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:41:50.887581 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2672def-ad57-49ff-b98c-49d627a3b68b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:50.950378 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2672def-ad57-49ff-b98c-49d627a3b68b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:50.959709 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17f091bf-b278-4c61-a5fe-d83cdb1ebe00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:51.026853 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2672def-ad57-49ff-b98c-49d627a3b68b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:51.235459 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f2a81f3f-b297-4859-b227-c4a4817c3d69 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/subnets/7bf69d7d-027d-47fa-b93e-2ec7f6bc90e4 HTTP/1.1" status: 204 len: 168 time: 1.8864334 May 12 15:41:51.240457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39604) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:51.241482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2672def-ad57-49ff-b98c-49d627a3b68b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:51.342802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-17f091bf-b278-4c61-a5fe-d83cdb1ebe00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for 9d9e82e0-7f4d-434b-9a03-c7abc4f561da owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:41:51.464281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2672def-ad57-49ff-b98c-49d627a3b68b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3c282c52-5b3b-474f-b33b-26979e8a2384,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:51.552292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e4aeb221-404c-4188-a660-c6e0804df865 None None] For port a00b9646-c3ec-4c10-9470-6be1cbdc072a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a00b9646-c3ec-4c10-9470-6be1cbdc072a,segment=NetworkSegment(9db4b0ac-d244-479d-89f2-4b43416d076e),segment_id=9db4b0ac-d244-479d-89f2-4b43416d076e)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:51.552930 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e4aeb221-404c-4188-a660-c6e0804df865 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:51.616669 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2672def-ad57-49ff-b98c-49d627a3b68b admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:51.651086 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a2672def-ad57-49ff-b98c-49d627a3b68b admin admin] 10.222.0.82 "DELETE /v2.0/subnets/3c282c52-5b3b-474f-b33b-26979e8a2384 HTTP/1.1" status: 204 len: 168 time: 0.8751602 May 12 15:41:51.693245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39608) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:51.889725 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e4aeb221-404c-4188-a660-c6e0804df865 None None] Calling delete_port for a00b9646-c3ec-4c10-9470-6be1cbdc072a owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:41:52.133228 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e4aeb221-404c-4188-a660-c6e0804df865 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:52.156826 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8725311-0220-4482-bee1-d0a9ed254236 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:52.200407 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17f091bf-b278-4c61-a5fe-d83cdb1ebe00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:52.269010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4aeb221-404c-4188-a660-c6e0804df865 None None] No DVR routers for this DVR port a00b9646-c3ec-4c10-9470-6be1cbdc072a on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:41:52.304696 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a00b9646-c3ec-4c10-9470-6be1cbdc072a no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:41:52.310225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17f091bf-b278-4c61-a5fe-d83cdb1ebe00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=9d9e82e0-7f4d-434b-9a03-c7abc4f561da,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:52.397573 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc1d02f0-f9b9-44c0-ac99-327eecf855c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:52.441609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: a00b9646-c3ec-4c10-9470-6be1cbdc072a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:41:52.441973 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a00b9646-c3ec-4c10-9470-6be1cbdc072a not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:41:52.445244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4aeb221-404c-4188-a660-c6e0804df865 None None] Pushing event deleted for resources: {'Port': ['ID=a00b9646-c3ec-4c10-9470-6be1cbdc072a,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:52.570442 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8725311-0220-4482-bee1-d0a9ed254236 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:52.615273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a8725311-0220-4482-bee1-d0a9ed254236 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d1b03368-2a7f-424e-8a55-929dc38a4616']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:52.630909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a8725311-0220-4482-bee1-d0a9ed254236 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9db4b0ac-d244-479d-89f2-4b43416d076e') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:52.631227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a8725311-0220-4482-bee1-d0a9ed254236 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9db4b0ac-d244-479d-89f2-4b43416d076e') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:52.646766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8725311-0220-4482-bee1-d0a9ed254236 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:52.707917 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8725311-0220-4482-bee1-d0a9ed254236 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:52.795158 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17f091bf-b278-4c61-a5fe-d83cdb1ebe00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:52.836779 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc1d02f0-f9b9-44c0-ac99-327eecf855c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:52.879662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-dc1d02f0-f9b9-44c0-ac99-327eecf855c1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['85cd1d66-57c4-4d94-b782-1d4cae810f95']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:52.908307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-dc1d02f0-f9b9-44c0-ac99-327eecf855c1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '09c83b83-4d53-47f0-b181-c0fb6ed7f95d') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:52.908675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-dc1d02f0-f9b9-44c0-ac99-327eecf855c1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '09c83b83-4d53-47f0-b181-c0fb6ed7f95d') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:52.925713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc1d02f0-f9b9-44c0-ac99-327eecf855c1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:52.942957 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a8725311-0220-4482-bee1-d0a9ed254236 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Releasing vlan 595 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:41:52.943368 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8725311-0220-4482-bee1-d0a9ed254236 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: timer() May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:41:52.979081 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:41:53.001334 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc1d02f0-f9b9-44c0-ac99-327eecf855c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:53.017353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dc1d02f0-f9b9-44c0-ac99-327eecf855c1 admin admin] Releasing vlan 597 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:41:53.018334 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc1d02f0-f9b9-44c0-ac99-327eecf855c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: timer() May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:41:53.099795 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:41:53.223021 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8725311-0220-4482-bee1-d0a9ed254236 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:53.236755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-17f091bf-b278-4c61-a5fe-d83cdb1ebe00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 171fbbe8-103b-4069-8efc-f9a483f821d6 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:41:53.270561 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc1d02f0-f9b9-44c0-ac99-327eecf855c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:53.272539 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8725311-0220-4482-bee1-d0a9ed254236 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:53.284759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8725311-0220-4482-bee1-d0a9ed254236 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Network': ['ID=d1b03368-2a7f-424e-8a55-929dc38a4616,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:53.289669 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a8725311-0220-4482-bee1-d0a9ed254236 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/d1b03368-2a7f-424e-8a55-929dc38a4616 HTTP/1.1" status: 204 len: 168 time: 2.0362351 May 12 15:41:53.309101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39630) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:53.309935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc1d02f0-f9b9-44c0-ac99-327eecf855c1 admin admin] Pushing event deleted for resources: {'Network': ['ID=85cd1d66-57c4-4d94-b782-1d4cae810f95,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:53.313737 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc1d02f0-f9b9-44c0-ac99-327eecf855c1 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:53.315604 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dc1d02f0-f9b9-44c0-ac99-327eecf855c1 admin admin] 10.222.0.82 "DELETE /v2.0/networks/85cd1d66-57c4-4d94-b782-1d4cae810f95 HTTP/1.1" status: 204 len: 168 time: 1.6205251 May 12 15:41:53.390921 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-ecbdf832-c7b4-412e-866b-9062c10d70bc tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] DELETE failed (client error): The resource could not be found. May 12 15:41:53.391752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ecbdf832-c7b4-412e-866b-9062c10d70bc tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:41:53.396407 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ecbdf832-c7b4-412e-866b-9062c10d70bc tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/subnets/c88d1898-258b-47b6-8d57-bf153388c359 HTTP/1.1" status: 404 len: 337 time: 0.0832143 May 12 15:41:53.397800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39636) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:53.447932 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-bd60fa28-129d-4818-b331-8324355c2383 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] DELETE failed (client error): The resource could not be found. May 12 15:41:53.448405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bd60fa28-129d-4818-b331-8324355c2383 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:41:53.453322 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bd60fa28-129d-4818-b331-8324355c2383 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/1c43e957-4f8d-46bf-a6ca-88abc67b22c2 HTTP/1.1" status: 404 len: 339 time: 0.0478415 May 12 15:41:53.453643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39640) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:53.557772 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-110c0fdc-9e00-467c-8701-57b0ca580590 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] DELETE failed (client error): The resource could not be found. May 12 15:41:53.559821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-110c0fdc-9e00-467c-8701-57b0ca580590 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:41:53.564002 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-110c0fdc-9e00-467c-8701-57b0ca580590 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/subnets/7bb6e92d-2537-4b34-8ab5-9b1cc7ebde2b HTTP/1.1" status: 404 len: 337 time: 0.1078675 May 12 15:41:53.565817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39646) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:53.638630 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-0c0a7b41-30b0-44e2-b14e-5127f49f4482 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] DELETE failed (client error): The resource could not be found. May 12 15:41:53.642820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0c0a7b41-30b0-44e2-b14e-5127f49f4482 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:41:53.648083 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0c0a7b41-30b0-44e2-b14e-5127f49f4482 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/e9a53a94-df56-42c6-8e3a-13a20c8b87cd HTTP/1.1" status: 404 len: 339 time: 0.0757222 May 12 15:41:53.654928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39650) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:53.728518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-17f091bf-b278-4c61-a5fe-d83cdb1ebe00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:41:53.743707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39656) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:53.748204 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb79cda1-dde7-4dd9-9bf9-4694b321bf15 None None] Sync routers for ids ['171fbbe8-103b-4069-8efc-f9a483f821d6'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:41:53.756508 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-c378964e-f483-4f91-82fd-ef254e2accfd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] DELETE failed (client error): The resource could not be found. May 12 15:41:53.757222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c378964e-f483-4f91-82fd-ef254e2accfd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:41:53.759531 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c378964e-f483-4f91-82fd-ef254e2accfd tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/subnets/9bb8022d-f538-45c6-a70c-7bff680728ee HTTP/1.1" status: 404 len: 337 time: 0.1035159 May 12 15:41:53.762549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39660) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:53.764020 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb79cda1-dde7-4dd9-9bf9-4694b321bf15 None None] Routers {'171fbbe8-103b-4069-8efc-f9a483f821d6'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:41:53.766419 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-cb79cda1-dde7-4dd9-9bf9-4694b321bf15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:41:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['171fbbe8-103b-4069-8efc-f9a483f821d6'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:53.793821 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-17f091bf-b278-4c61-a5fe-d83cdb1ebe00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/171fbbe8-103b-4069-8efc-f9a483f821d6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7698674 May 12 15:41:53.795120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39664) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:53.873805 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0468cc91-8b0a-4312-86dd-be4a9390f498 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f798fdc3e9c54b38b7dbb0478a1d31d6&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1085448 May 12 15:41:53.874386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39670) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:53.881969 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-cb79cda1-dde7-4dd9-9bf9-4694b321bf15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:53.891782 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb79cda1-dde7-4dd9-9bf9-4694b321bf15 None None] Routers {'171fbbe8-103b-4069-8efc-f9a483f821d6'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:41:53.893727 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-cb79cda1-dde7-4dd9-9bf9-4694b321bf15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:41:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['171fbbe8-103b-4069-8efc-f9a483f821d6'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:53.969448 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-cb79cda1-dde7-4dd9-9bf9-4694b321bf15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:53.970025 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb79cda1-dde7-4dd9-9bf9-4694b321bf15 None None] The sync data for ids ['171fbbe8-103b-4069-8efc-f9a483f821d6'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:41:53.994516 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f850ec1-3994-422d-bae1-9b0c29de4ab5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:54.041556 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f850ec1-3994-422d-bae1-9b0c29de4ab5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:54.130809 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f850ec1-3994-422d-bae1-9b0c29de4ab5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:54.165225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f850ec1-3994-422d-bae1-9b0c29de4ab5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5eb3848b-51ff-479d-bc4a-37b90b9c5382,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:54.193166 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9f850ec1-3994-422d-bae1-9b0c29de4ab5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:54.196008 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-4bad791b-10b6-4458-8008-a0b8110636ac tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] DELETE failed (client error): The resource could not be found. May 12 15:41:54.196681 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9f850ec1-3994-422d-bae1-9b0c29de4ab5 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5eb3848b-51ff-479d-bc4a-37b90b9c5382 HTTP/1.1" status: 204 len: 168 time: 0.3213642 May 12 15:41:54.199788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4bad791b-10b6-4458-8008-a0b8110636ac tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:41:54.204454 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4bad791b-10b6-4458-8008-a0b8110636ac tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/5142c69d-3967-46ff-a0b9-a97c22f09d4a HTTP/1.1" status: 404 len: 339 time: 0.4381349 May 12 15:41:54.215093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39680) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:54.836297 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-ce9375e5-5714-4161-8518-1aef8294f1b9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] remove_router_interface failed (client error): The resource could not be found. May 12 15:41:54.838732 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ce9375e5-5714-4161-8518-1aef8294f1b9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/171fbbe8-103b-4069-8efc-f9a483f821d6/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 1.0400369 May 12 15:41:54.840053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39696) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:54.896187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9bd66f02-15ba-4b69-907e-e6c1f84363ff tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Synchronizing usage tracker for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:41:54.903819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-55b99e6f-e1c8-42ef-a60d-319d12ec5740 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Deleting subnet cf376045-9ed7-4044-88dc-2db044dc3e30 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:41:54.907881 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55b99e6f-e1c8-42ef-a60d-319d12ec5740 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:54.968337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9bd66f02-15ba-4b69-907e-e6c1f84363ff tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Unset dirty status for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:41:54.969583 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9bd66f02-15ba-4b69-907e-e6c1f84363ff tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports?device_id=171fbbe8-103b-4069-8efc-f9a483f821d6 HTTP/1.1" status: 200 len: 205 time: 0.1284022 May 12 15:41:54.973614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39704) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:55.140108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55b99e6f-e1c8-42ef-a60d-319d12ec5740 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:55.185216 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a644f86-4d0f-46b5-ab98-06953c68743b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:55.641261 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a644f86-4d0f-46b5-ab98-06953c68743b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:55.649082 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a644f86-4d0f-46b5-ab98-06953c68743b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:55.740836 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a644f86-4d0f-46b5-ab98-06953c68743b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:55.741730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a644f86-4d0f-46b5-ab98-06953c68743b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Fanout notify agent at l3_agent the message router_deleted on router 171fbbe8-103b-4069-8efc-f9a483f821d6 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:41:55.766939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9a644f86-4d0f-46b5-ab98-06953c68743b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:55.768677 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9a644f86-4d0f-46b5-ab98-06953c68743b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/routers/171fbbe8-103b-4069-8efc-f9a483f821d6 HTTP/1.1" status: 204 len: 168 time: 0.7939527 May 12 15:41:55.771458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39740) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:55.772184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55b99e6f-e1c8-42ef-a60d-319d12ec5740 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:55.884558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-f0dc8785-e3df-40e5-ae12-a8623f474e00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting subnet 738c462a-65bc-4929-afef-e9bdcd044211 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:41:55.893845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f0dc8785-e3df-40e5-ae12-a8623f474e00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:55.926044 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55b99e6f-e1c8-42ef-a60d-319d12ec5740 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:55.971638 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f0dc8785-e3df-40e5-ae12-a8623f474e00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:56.061572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55b99e6f-e1c8-42ef-a60d-319d12ec5740 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Subnet': ['ID=cf376045-9ed7-4044-88dc-2db044dc3e30,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:56.094597 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55b99e6f-e1c8-42ef-a60d-319d12ec5740 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:56.097863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c4ff0cd-9f9f-4bed-9803-622c91edc1fc None None] Network f7241002-80e0-4c7e-9b30-f926ce673510 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:56.130286 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-55b99e6f-e1c8-42ef-a60d-319d12ec5740 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/subnets/cf376045-9ed7-4044-88dc-2db044dc3e30 HTTP/1.1" status: 204 len: 168 time: 1.9139833 May 12 15:41:56.132744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39750) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:56.193453 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f0dc8785-e3df-40e5-ae12-a8623f474e00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:56.336122 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f0dc8785-e3df-40e5-ae12-a8623f474e00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:56.487268 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f0dc8785-e3df-40e5-ae12-a8623f474e00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:56.502703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0dc8785-e3df-40e5-ae12-a8623f474e00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Subnet': ['ID=738c462a-65bc-4929-afef-e9bdcd044211,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:56.503487 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:56.506262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bef2e185-7df4-44ba-be36-9b19fcc41dbb None None] Network 4ddb05cb-5b62-4e39-b733-c36a8e7deb35 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:41:56.510735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f0dc8785-e3df-40e5-ae12-a8623f474e00 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/738c462a-65bc-4929-afef-e9bdcd044211 HTTP/1.1" status: 204 len: 168 time: 0.7360160 May 12 15:41:56.511963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39770) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:56.532281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Deleting port 410b8af2-4759-4b80-9cd2-a9190df6023f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:56.532572 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:56.948906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:56.979842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port 1d0f2d14-ffc3-4f50-ab52-39105cd87761 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:56.981295 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:57.345230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01b7e211-8c66-4b05-9e37-511c5e2f0866 None None] DHCP port deletion for f7241002-80e0-4c7e-9b30-f926ce673510 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:41:57.353001 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-01b7e211-8c66-4b05-9e37-511c5e2f0866 None None] Deleting port 410b8af2-4759-4b80-9cd2-a9190df6023f {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:57.353351 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-01b7e211-8c66-4b05-9e37-511c5e2f0866 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:57.464978 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3152ddbc-ba74-45ea-a493-77d0f55bf119 None None] DHCP port deletion for 4ddb05cb-5b62-4e39-b733-c36a8e7deb35 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:41:57.500749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] For port 410b8af2-4759-4b80-9cd2-a9190df6023f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=410b8af2-4759-4b80-9cd2-a9190df6023f,segment=NetworkSegment(f5342ae6-4001-47eb-9fea-e1cf097ef88f),segment_id=f5342ae6-4001-47eb-9fea-e1cf097ef88f)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:57.501344 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:57.522569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3152ddbc-ba74-45ea-a493-77d0f55bf119 None None] Deleting port 1d0f2d14-ffc3-4f50-ab52-39105cd87761 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:57.534623 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3152ddbc-ba74-45ea-a493-77d0f55bf119 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:57.732324 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Calling delete_port for 410b8af2-4759-4b80-9cd2-a9190df6023f owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:41:57.751105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] For port 1d0f2d14-ffc3-4f50-ab52-39105cd87761, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1d0f2d14-ffc3-4f50-ab52-39105cd87761,segment=NetworkSegment(24ca703d-74e4-411d-a39c-586b7ab9d075),segment_id=24ca703d-74e4-411d-a39c-586b7ab9d075)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:57.751497 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:57.974148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:58.168387 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for 1d0f2d14-ffc3-4f50-ab52-39105cd87761 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:41:58.183666 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Port': ['ID=410b8af2-4759-4b80-9cd2-a9190df6023f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:58.201056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No DVR routers for this DVR port 410b8af2-4759-4b80-9cd2-a9190df6023f on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:41:58.216088 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-01b7e211-8c66-4b05-9e37-511c5e2f0866 None None] For port 410b8af2-4759-4b80-9cd2-a9190df6023f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=410b8af2-4759-4b80-9cd2-a9190df6023f,segment=NetworkSegment(f5342ae6-4001-47eb-9fea-e1cf097ef88f),segment_id=f5342ae6-4001-47eb-9fea-e1cf097ef88f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:58.216753 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-01b7e211-8c66-4b05-9e37-511c5e2f0866 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:58.406460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-01b7e211-8c66-4b05-9e37-511c5e2f0866 None None] Calling delete_port for 410b8af2-4759-4b80-9cd2-a9190df6023f owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:41:58.446136 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:58.538957 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:58.603366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=1d0f2d14-ffc3-4f50-ab52-39105cd87761,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:58.619420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No DVR routers for this DVR port 1d0f2d14-ffc3-4f50-ab52-39105cd87761 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:41:58.626929 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-01b7e211-8c66-4b05-9e37-511c5e2f0866 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:41:58.627280 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-01b7e211-8c66-4b05-9e37-511c5e2f0866 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:41:58.630572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f7241002-80e0-4c7e-9b30-f926ce673510']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:58.640671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-3152ddbc-ba74-45ea-a493-77d0f55bf119 None None] For port 1d0f2d14-ffc3-4f50-ab52-39105cd87761, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1d0f2d14-ffc3-4f50-ab52-39105cd87761,segment=NetworkSegment(24ca703d-74e4-411d-a39c-586b7ab9d075),segment_id=24ca703d-74e4-411d-a39c-586b7ab9d075)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:41:58.641062 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3152ddbc-ba74-45ea-a493-77d0f55bf119 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:58.677848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1d0f2d14-ffc3-4f50-ab52-39105cd87761 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:41:58.681347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f5342ae6-4001-47eb-9fea-e1cf097ef88f') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:58.681673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f5342ae6-4001-47eb-9fea-e1cf097ef88f') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:58.709257 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:58.746077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:58.782085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Releasing vlan 565 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:41:58.782506 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:58.834784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 1d0f2d14-ffc3-4f50-ab52-39105cd87761 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: timer() May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:41:58.835055 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:41:58.838609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1d0f2d14-ffc3-4f50-ab52-39105cd87761 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:41:58.839983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 410b8af2-4759-4b80-9cd2-a9190df6023f no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:41:58.870443 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:58.958025 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:58.980422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 410b8af2-4759-4b80-9cd2-a9190df6023f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:41:58.980760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 410b8af2-4759-4b80-9cd2-a9190df6023f not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:41:58.990195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4ddb05cb-5b62-4e39-b733-c36a8e7deb35']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:59.019569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.026699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '24ca703d-74e4-411d-a39c-586b7ab9d075') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:59.027101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '24ca703d-74e4-411d-a39c-586b7ab9d075') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:41:59.044743 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.061323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Network': ['ID=f7241002-80e0-4c7e-9b30-f926ce673510,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:59.065545 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.073356 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-91305d17-6944-4d7f-9abf-d8e51b7d69da tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/f7241002-80e0-4c7e-9b30-f926ce673510 HTTP/1.1" status: 204 len: 168 time: 2.9394743 May 12 15:41:59.075519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Releasing vlan 564 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:41:59.076672 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.077154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39822) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: timer() May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:41:59.094589 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:41:59.133030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-01b7e211-8c66-4b05-9e37-511c5e2f0866 None None] Deleting port 410b8af2-4759-4b80-9cd2-a9190df6023f {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:41:59.134695 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-01b7e211-8c66-4b05-9e37-511c5e2f0866 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.135865 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-2faf99c4-a63e-4992-bcf4-b229ad72fe5b tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] DELETE failed (client error): The resource could not be found. May 12 15:41:59.137089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2faf99c4-a63e-4992-bcf4-b229ad72fe5b tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:41:59.142406 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2faf99c4-a63e-4992-bcf4-b229ad72fe5b tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/subnets/1a13f5c7-0e4c-4191-a308-c3798453b7bd HTTP/1.1" status: 404 len: 337 time: 0.0641282 May 12 15:41:59.143383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39828) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:59.179835 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-d7a07db9-c6e5-4a7c-b436-ed4f88f6efec tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] DELETE failed (client error): The resource could not be found. May 12 15:41:59.183560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d7a07db9-c6e5-4a7c-b436-ed4f88f6efec tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:41:59.191254 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d7a07db9-c6e5-4a7c-b436-ed4f88f6efec tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/06aa2989-c2c8-4639-bfdc-8d59cf9cc800 HTTP/1.1" status: 404 len: 339 time: 0.0439713 May 12 15:41:59.192090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39832) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:59.343500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Deleting subnet cf8ef23d-e876-4621-90c8-4b95c688ce9f {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:41:59.353483 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.365815 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.397782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3152ddbc-ba74-45ea-a493-77d0f55bf119 None None] Calling delete_port for 1d0f2d14-ffc3-4f50-ab52-39105cd87761 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:41:59.454420 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.477268 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.492716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Network': ['ID=4ddb05cb-5b62-4e39-b733-c36a8e7deb35,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:41:59.529259 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b053014f-5eba-4715-aa60-6c98acd2acc3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/networks/4ddb05cb-5b62-4e39-b733-c36a8e7deb35 HTTP/1.1" status: 204 len: 168 time: 3.0145206 May 12 15:41:59.534272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39840) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:41:59.551919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'network': {'name': 'tempest-RoutersTest-1431084069'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:41:59.579569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:41:59.597612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:network and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:41:59.607173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:41:59.636046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:41:59.665946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:41:59.679318 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.719354 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.755560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-01b7e211-8c66-4b05-9e37-511c5e2f0866 None None] The port '410b8af2-4759-4b80-9cd2-a9190df6023f' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:41:59.760907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 552} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:41:59.776047 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-3152ddbc-ba74-45ea-a493-77d0f55bf119 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:41:59.776421 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-3152ddbc-ba74-45ea-a493-77d0f55bf119 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:41:59.780369 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.784350 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Added segment d9cb36e2-9448-4d84-b227-96e347beb405 of type vlan for network 8daa4949-5de0-4e72-9b29-bbf2cad2b887 May 12 15:41:59.851324 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.886142 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.901514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:41:59.904140 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:41:59.918602 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:00.007532 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:00.018011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Subnet': ['ID=cf8ef23d-e876-4621-90c8-4b95c688ce9f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:00.018726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d791ba6c-f871-49f8-8a45-800d0d8df3dd None None] Network 4e892bc1-e9cd-4ae0-afba-9426073de30e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:00.028662 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.4930010 May 12 15:42:00.029269 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:00.029645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:00.029988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:00.030317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:00.030640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:00.030962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:00.031282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:00.031601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:00.031917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:00.032230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:00.032548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:00.033494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:00.037885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39852) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:00.043712 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ffeadae2-3ee2-4232-9fbc-f6dcacc11ae0 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/subnets/cf8ef23d-e876-4621-90c8-4b95c688ce9f HTTP/1.1" status: 204 len: 168 time: 0.8501806 May 12 15:42:00.044977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39858) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:00.130267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'subnet': {'network_id': '8daa4949-5de0-4e72-9b29-bbf2cad2b887', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:00.287582 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3152ddbc-ba74-45ea-a493-77d0f55bf119 None None] Deleting port 1d0f2d14-ffc3-4f50-ab52-39105cd87761 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:42:00.293936 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3152ddbc-ba74-45ea-a493-77d0f55bf119 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:00.521055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:00.553417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Deleting port 52f0b5ba-7622-4d89-8257-54808d0ad352 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:42:00.553965 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:00.572968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3152ddbc-ba74-45ea-a493-77d0f55bf119 None None] The port '1d0f2d14-ffc3-4f50-ab52-39105cd87761' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:42:00.587868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eaf0de7-5356-419e-acdb-cd4c3af3081b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Network': ['ID=8daa4949-5de0-4e72-9b29-bbf2cad2b887,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:00.605868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 8daa4949-5de0-4e72-9b29-bbf2cad2b887 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:42:00.609065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:00.623543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:subnet and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:00.633300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:00.649783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:00.675348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:00.679032 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:01.070045 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:01.181774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] For port 52f0b5ba-7622-4d89-8257-54808d0ad352, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=52f0b5ba-7622-4d89-8257-54808d0ad352,segment=NetworkSegment(c974e42a-0498-41b2-bf96-f8948fad5d0b),segment_id=c974e42a-0498-41b2-bf96-f8948fad5d0b)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:42:01.182998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:01.205344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72a3ae87-4ee8-4641-b6f3-d022239c9ab0 None None] DHCP port deletion for 4e892bc1-e9cd-4ae0-afba-9426073de30e request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:42:01.211257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-72a3ae87-4ee8-4641-b6f3-d022239c9ab0 None None] Deleting port 52f0b5ba-7622-4d89-8257-54808d0ad352 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:42:01.212911 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-72a3ae87-4ee8-4641-b6f3-d022239c9ab0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:01.353160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Subnet': ['ID=7aac4d61-6a9e-4de4-8a07-0377e3406e4f,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:01.386274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Checking segment: {'id': 'd9cb36e2-9448-4d84-b227-96e347beb405', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '8daa4949-5de0-4e72-9b29-bbf2cad2b887'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:01.386915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network hostable DHCP agents. Network: 8daa4949-5de0-4e72-9b29-bbf2cad2b887, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:42:01.430820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 8daa4949-5de0-4e72-9b29-bbf2cad2b887 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:42:01.442738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 8daa4949-5de0-4e72-9b29-bbf2cad2b887) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:01.452604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:01.453180 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:01.501569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-930abc6f-0b0e-4eea-8f00-3d01f4651ba8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.4601369 May 12 15:42:01.501813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39876) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:01.507056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-85f01edb-5d3c-48e4-b312-13b0c3bf9fc9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-477113101', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:01.530890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-85f01edb-5d3c-48e4-b312-13b0c3bf9fc9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:01.535917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-85f01edb-5d3c-48e4-b312-13b0c3bf9fc9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:router and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:01.541196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-85f01edb-5d3c-48e4-b312-13b0c3bf9fc9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:01.561870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-85f01edb-5d3c-48e4-b312-13b0c3bf9fc9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:01.578034 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85f01edb-5d3c-48e4-b312-13b0c3bf9fc9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:01.579111 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85f01edb-5d3c-48e4-b312-13b0c3bf9fc9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:01.608704 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85f01edb-5d3c-48e4-b312-13b0c3bf9fc9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:01.652376 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85f01edb-5d3c-48e4-b312-13b0c3bf9fc9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:01.708998 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85f01edb-5d3c-48e4-b312-13b0c3bf9fc9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:01.710695 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-85f01edb-5d3c-48e4-b312-13b0c3bf9fc9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.2077353 May 12 15:42:01.713011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39882) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:01.815262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-72a3ae87-4ee8-4641-b6f3-d022239c9ab0 None None] For port 52f0b5ba-7622-4d89-8257-54808d0ad352, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=52f0b5ba-7622-4d89-8257-54808d0ad352,segment=NetworkSegment(c974e42a-0498-41b2-bf96-f8948fad5d0b),segment_id=c974e42a-0498-41b2-bf96-f8948fad5d0b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:42:01.822688 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-72a3ae87-4ee8-4641-b6f3-d022239c9ab0 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:01.907369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Calling delete_port for 52f0b5ba-7622-4d89-8257-54808d0ad352 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:42:02.083862 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:02.170580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-72a3ae87-4ee8-4641-b6f3-d022239c9ab0 None None] Calling delete_port for 52f0b5ba-7622-4d89-8257-54808d0ad352 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:42:02.236773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] No DVR routers for this DVR port 52f0b5ba-7622-4d89-8257-54808d0ad352 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:42:02.238764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Port': ['ID=52f0b5ba-7622-4d89-8257-54808d0ad352,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:02.420085 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-72a3ae87-4ee8-4641-b6f3-d022239c9ab0 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:42:02.422355 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-72a3ae87-4ee8-4641-b6f3-d022239c9ab0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:42:02.423523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2bb5d3f-edd8-4612-9bed-7b1b274a146f None None] Network 8daa4949-5de0-4e72-9b29-bbf2cad2b887 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:02.620817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 52f0b5ba-7622-4d89-8257-54808d0ad352 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:42:02.684760 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:02.736864 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:02.764040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4e892bc1-e9cd-4ae0-afba-9426073de30e']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:02.804077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c974e42a-0498-41b2-bf96-f8948fad5d0b') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:02.804378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c974e42a-0498-41b2-bf96-f8948fad5d0b') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:02.835318 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:02.850574 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 52f0b5ba-7622-4d89-8257-54808d0ad352 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:42:02.855800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 52f0b5ba-7622-4d89-8257-54808d0ad352 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:42:02.897853 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:02.911089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Releasing vlan 579 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:42:02.911489 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: timer() May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:42:02.948791 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:42:02.961885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-72a3ae87-4ee8-4641-b6f3-d022239c9ab0 None None] Deleting port 52f0b5ba-7622-4d89-8257-54808d0ad352 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:42:02.963157 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-72a3ae87-4ee8-4641-b6f3-d022239c9ab0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:03.195415 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:03.207810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-72a3ae87-4ee8-4641-b6f3-d022239c9ab0 None None] The port '52f0b5ba-7622-4d89-8257-54808d0ad352' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:42:03.210321 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:03.258120 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:03.331876 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] 10.222.0.82 "DELETE /v2.0/networks/4e892bc1-e9cd-4ae0-afba-9426073de30e HTTP/1.1" status: 204 len: 168 time: 3.2848301 May 12 15:42:03.332945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fc54aae-3a5e-4968-a4aa-6a24f7067da3 tempest-NetworksIpV6Test-893898488 tempest-NetworksIpV6Test-893898488-project] Pushing event deleted for resources: {'Network': ['ID=4e892bc1-e9cd-4ae0-afba-9426073de30e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:03.375111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-8daa4949-5de0-4e72-9b29-bbf2cad2b887', 'network_id': '8daa4949-5de0-4e72-9b29-bbf2cad2b887', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'fixed_ips': [{'subnet_id': '7aac4d61-6a9e-4de4-8a07-0377e3406e4f'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:42:03.376289 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:03.420465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39914) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:03.697807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Allocated IP 172.20.0.1 (8daa4949-5de0-4e72-9b29-bbf2cad2b887/7aac4d61-6a9e-4de4-8a07-0377e3406e4f/7fd7d3b5-72ed-485b-a4fa-1086327fa75c) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:42:03.804576 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c9d7729-93f7-4032-ba95-742be0363b46 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:03.915400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8c9d7729-93f7-4032-ba95-742be0363b46 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:03.956399 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8c9d7729-93f7-4032-ba95-742be0363b46 admin admin] Usage tracker for resource:security_group_rule and tenant:6afe64442bb94eaabfdf1ccc2d6d43e4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:03.975488 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:03.983380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8c9d7729-93f7-4032-ba95-742be0363b46 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:03.990623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8c9d7729-93f7-4032-ba95-742be0363b46 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:04.001090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Transition to ACTIVE for port object 7fd7d3b5-72ed-485b-a4fa-1086327fa75c will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:42:04.056529 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:04.165601 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c9d7729-93f7-4032-ba95-742be0363b46 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:04.177976 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c9d7729-93f7-4032-ba95-742be0363b46 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:04.286146 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Allocated IP 172.20.0.2 (8daa4949-5de0-4e72-9b29-bbf2cad2b887/7aac4d61-6a9e-4de4-8a07-0377e3406e4f/4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:42:04.305586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39924) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:04.307611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 8daa4949-5de0-4e72-9b29-bbf2cad2b887 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:42:04.352108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c9d7729-93f7-4032-ba95-742be0363b46 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ec3e3a14-07b0-49eb-ad85-f8a1406c89d8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:04.395661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:04.427141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:42:04.599173 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-456952a4-c699-4bd1-9d03-432d1ad741a0 req-ac79015c-a5be-428a-92c0-e942021d2830 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.2181110 May 12 15:42:04.607388 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8c9d7729-93f7-4032-ba95-742be0363b46 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6afe64442bb94eaabfdf1ccc2d6d43e4&name=default HTTP/1.1" status: 200 len: 2983 time: 1.1855447 May 12 15:42:04.614602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 39936) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:04.717228 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=7fd7d3b5-72ed-485b-a4fa-1086327fa75c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:04.843995 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b1397b73-7f85-4d30-86c8-3744ce0211d8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:04.874307 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-456952a4-c699-4bd1-9d03-432d1ad741a0 req-fb4cef83-f8dd-4f93-b28e-0bd43eb34248 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0650101 May 12 15:42:04.907398 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-69d6fbe9-36c7-4a8b-beb1-3edb18d9bd1b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=23ebb72014f64d3f921a26784efda987&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5951087 May 12 15:42:04.908540 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:04.909788 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b1397b73-7f85-4d30-86c8-3744ce0211d8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:04.911847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 39942) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:05.003630 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-456952a4-c699-4bd1-9d03-432d1ad741a0 req-bc0c6e41-90f3-46bd-9a23-c7dfc9ff2fa8 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0521057 May 12 15:42:05.092568 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8647c73b-1454-4508-bd6c-f83e26d8de88 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:05.117714 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:05.179388 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8647c73b-1454-4508-bd6c-f83e26d8de88 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:05.186188 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Transition to ACTIVE for port object 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:42:05.309939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b1397b73-7f85-4d30-86c8-3744ce0211d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:05.333722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Transition to ACTIVE for port object 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:42:05.340833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456952a4-c699-4bd1-9d03-432d1ad741a0 req-98f996f1-1fbd-40a4-a8b9-ede97e7c3eaf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:05.340833 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-456952a4-c699-4bd1-9d03-432d1ad741a0 req-98f996f1-1fbd-40a4-a8b9-ede97e7c3eaf service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3044853 May 12 15:42:05.347858 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:05.479938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1397b73-7f85-4d30-86c8-3744ce0211d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec3e3a14-07b0-49eb-ad85-f8a1406c89d8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:05.492430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b1397b73-7f85-4d30-86c8-3744ce0211d8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:05.493640 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b1397b73-7f85-4d30-86c8-3744ce0211d8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ec3e3a14-07b0-49eb-ad85-f8a1406c89d8 HTTP/1.1" status: 204 len: 168 time: 0.8773992 May 12 15:42:05.546731 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8647c73b-1454-4508-bd6c-f83e26d8de88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:05.716313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Network 8daa4949-5de0-4e72-9b29-bbf2cad2b887 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:42:05.719616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:05.727809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:42:05.742571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Pushing event updated for resources: {'Port': ['ID=4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:05.822322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:05.822837 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:05.823394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:05.823902 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:05.824408 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:05.824921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:05.825446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:05.825931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:05.826476 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:05.827015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:05.827475 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:05.827818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:05.974764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8647c73b-1454-4508-bd6c-f83e26d8de88 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a788ddaa-e1a6-465e-8111-f2cd19549898,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:06.025235 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8647c73b-1454-4508-bd6c-f83e26d8de88 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:06.026896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8647c73b-1454-4508-bd6c-f83e26d8de88 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a788ddaa-e1a6-465e-8111-f2cd19549898 HTTP/1.1" status: 204 len: 168 time: 1.1137660 May 12 15:42:06.060748 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:06.060915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Attempting to bind port 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:42:06.061826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Attempting to bind port 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'd9cb36e2-9448-4d84-b227-96e347beb405', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '8daa4949-5de0-4e72-9b29-bbf2cad2b887'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:42:06.062185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Attempting to bind port 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf on network 8daa4949-5de0-4e72-9b29-bbf2cad2b887 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:42:06.089287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 41, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:42:06.092232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Checking segment: {'id': 'd9cb36e2-9448-4d84-b227-96e347beb405', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '8daa4949-5de0-4e72-9b29-bbf2cad2b887'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:06.095072 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:06.098830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Bound using segment: {'id': 'd9cb36e2-9448-4d84-b227-96e347beb405', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '8daa4949-5de0-4e72-9b29-bbf2cad2b887'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:42:06.099364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Bound port: 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd9cb36e2-9448-4d84-b227-96e347beb405', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '8daa4949-5de0-4e72-9b29-bbf2cad2b887'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:42:06.101838 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:06.418297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] For port 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:42:06.429697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] For port 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf,segment=NetworkSegment(d9cb36e2-9448-4d84-b227-96e347beb405),segment_id=d9cb36e2-9448-4d84-b227-96e347beb405)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:42:06.439239 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:06.882058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d47d654-88f5-49ae-9b8f-22dac00d116f None None] Pushing event updated for resources: {'Port': ['ID=4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:07.212219 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:07.227784 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:07.602018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=7fd7d3b5-72ed-485b-a4fa-1086327fa75c,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:07.608379 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:07.646438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:07.647381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:07.650032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:07.650624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:07.653240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:07.654294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:07.656505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:07.658957 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:07.659935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:07.663805 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:07.667493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:07.669510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:42:08.063031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 8daa4949-5de0-4e72-9b29-bbf2cad2b887 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:42:08.064553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:08.374065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:42:08.655440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 4a181b0a-648d-40c1-b3ca-d6a8995fa6eb is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:42:08.763839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:42:09.143645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc14f187-f418-4ff6-9bb5-2f521ec5db49 None None] Network 8daa4949-5de0-4e72-9b29-bbf2cad2b887 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:09.205950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:42:09.211374 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-57459ff6-3e74-4953-b917-00c814cf66a7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/4a181b0a-648d-40c1-b3ca-d6a8995fa6eb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.4973612 May 12 15:42:09.214186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40052) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:09.440762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40062) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:09.450321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-714cf936-7df0-48aa-ab74-4a111761f9e6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:09.457471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-714cf936-7df0-48aa-ab74-4a111761f9e6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Synchronizing usage tracker for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:42:09.521962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-714cf936-7df0-48aa-ab74-4a111761f9e6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Unset dirty status for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:42:09.523261 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-714cf936-7df0-48aa-ab74-4a111761f9e6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports/7fd7d3b5-72ed-485b-a4fa-1086327fa75c HTTP/1.1" status: 200 len: 910 time: 0.3073285 May 12 15:42:09.526811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40070) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:09.666785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-586f3486-74df-4827-8eac-a696e4a18d01 None None] Sync routers for ids ['4a181b0a-648d-40c1-b3ca-d6a8995fa6eb'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:42:09.803841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-586f3486-74df-4827-8eac-a696e4a18d01 None None] Routers {'4a181b0a-648d-40c1-b3ca-d6a8995fa6eb'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:42:09.805819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-586f3486-74df-4827-8eac-a696e4a18d01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:41:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['4a181b0a-648d-40c1-b3ca-d6a8995fa6eb'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:09.870232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1998259868'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:09.894868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:09.912130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:network and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:09.922043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:09.968737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:10.034950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:10.051174 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:10.078782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-586f3486-74df-4827-8eac-a696e4a18d01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:10.128667 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:10.137801 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e2553ff3-c3b7-4bb1-8dda-de8acaa42483 None None] Provisioning for port 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:42:10.187509 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e2553ff3-c3b7-4bb1-8dda-de8acaa42483 None None] Provisioning complete for port 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:10.187919 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e2553ff3-c3b7-4bb1-8dda-de8acaa42483 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:10.201638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:10.215480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:security_group_rule and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:10.218997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:10.227625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:10.420684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-586f3486-74df-4827-8eac-a696e4a18d01 None None] Routers {'4a181b0a-648d-40c1-b3ca-d6a8995fa6eb'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:42:10.424729 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-586f3486-74df-4827-8eac-a696e4a18d01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:41:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['4a181b0a-648d-40c1-b3ca-d6a8995fa6eb'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:10.582380 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:10.602927 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:10.655621 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-586f3486-74df-4827-8eac-a696e4a18d01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:10.656109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-586f3486-74df-4827-8eac-a696e4a18d01 None None] The sync data for ids ['4a181b0a-648d-40c1-b3ca-d6a8995fa6eb'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:42:10.722534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 553} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:42:10.759035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:10.769346 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Added segment a41b8a4b-e33b-44a9-be4e-365dd4b0e017 of type vlan for network 06314778-8dc3-40db-a6f5-f8126f80fd1e May 12 15:42:10.819028 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e2553ff3-c3b7-4bb1-8dda-de8acaa42483 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:10.891261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e2553ff3-c3b7-4bb1-8dda-de8acaa42483 None None] For port 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf,segment=NetworkSegment(d9cb36e2-9448-4d84-b227-96e347beb405),segment_id=d9cb36e2-9448-4d84-b227-96e347beb405)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:42:10.898397 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e2553ff3-c3b7-4bb1-8dda-de8acaa42483 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:10.942115 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:11.055846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2553ff3-c3b7-4bb1-8dda-de8acaa42483 None None] Pushing event updated for resources: {'Port': ['ID=4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:11.201471 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:11.232776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:11.236547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4fd08fca-7874-4455-9704-775aa2169e8e None None] Provisioning complete for port 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:11.237666 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4fd08fca-7874-4455-9704-775aa2169e8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:11.243509 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:11.780739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Network': ['ID=06314778-8dc3-40db-a6f5-f8126f80fd1e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:11.826384 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 06314778-8dc3-40db-a6f5-f8126f80fd1e details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:42:11.844705 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e96fb394-2019-4139-9e6e-6af5d019b73e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:11.870016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2af76b94-c52f-4a5e-98f1-be7cd55092f6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:11.918375 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2359cd0b-da80-4dc2-a570-2d072943e513 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 2.4764111 May 12 15:42:11.948769 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:42:11.974774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4fd08fca-7874-4455-9704-775aa2169e8e None None] Provisioning for port 7fd7d3b5-72ed-485b-a4fa-1086327fa75c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:42:12.058750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40126) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:12.066942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'subnet': {'network_id': '06314778-8dc3-40db-a6f5-f8126f80fd1e', 'cidr': '172.20.255.240/28', 'ip_version': 4, 'gateway_ip': '172.20.255.241'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:12.104358 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4fd08fca-7874-4455-9704-775aa2169e8e None None] Provisioning complete for port 7fd7d3b5-72ed-485b-a4fa-1086327fa75c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:12.104626 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4fd08fca-7874-4455-9704-775aa2169e8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:12.277134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:12.296927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:subnet and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:12.308805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:12.337507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:12.377656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4fd08fca-7874-4455-9704-775aa2169e8e None None] Port 7fd7d3b5-72ed-485b-a4fa-1086327fa75c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:42:12.396901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:12.406986 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:12.475978 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:42:12.770114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-02977883-86eb-4353-9cc3-3f6b7a327681 None None] Provisioning complete for port 7fd7d3b5-72ed-485b-a4fa-1086327fa75c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:12.770583 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-02977883-86eb-4353-9cc3-3f6b7a327681 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:12.849091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-02977883-86eb-4353-9cc3-3f6b7a327681 None None] Port 7fd7d3b5-72ed-485b-a4fa-1086327fa75c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:42:12.853325 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-14c64fcf-1bfb-40a4-9a71-094120edb1a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:12.881540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:12.882675 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:12.965589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:13.138395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e96fb394-2019-4139-9e6e-6af5d019b73e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port 7fd7d3b5-72ed-485b-a4fa-1086327fa75c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:42:13.138924 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e96fb394-2019-4139-9e6e-6af5d019b73e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:13.159493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Subnet': ['ID=1c5479d5-6152-4084-8920-dc74c2e667c5,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:13.256933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Checking segment: {'id': 'a41b8a4b-e33b-44a9-be4e-365dd4b0e017', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '06314778-8dc3-40db-a6f5-f8126f80fd1e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:13.285847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network hostable DHCP agents. Network: 06314778-8dc3-40db-a6f5-f8126f80fd1e, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:42:13.360911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network 06314778-8dc3-40db-a6f5-f8126f80fd1e is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:42:13.398331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 06314778-8dc3-40db-a6f5-f8126f80fd1e) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:13.406495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:13.407360 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:13.412255 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:13.442170 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-780e9c2e-c19c-46f5-8839-d0b0f5ae3604 None None] Network 06314778-8dc3-40db-a6f5-f8126f80fd1e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:13.472878 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-16498e2f-f5b8-4650-85a8-5c849fd9efa2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 816 time: 1.4115517 May 12 15:42:13.473901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40160) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:13.480086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1786582024'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:13.495963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:13.502901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:network and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:13.508161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:13.520942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:13.590481 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:13.590481 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:13.652596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 578} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:42:13.678522 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:13.679043 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Added segment 37dda084-8260-41eb-ab6c-886671abc40d of type vlan for network d4051fa3-866b-4e92-9d53-e0a2eeb36b88 May 12 15:42:13.780490 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e96fb394-2019-4139-9e6e-6af5d019b73e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:13.797546 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:13.898228 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:13.906059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:13.906584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:14.073891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e96fb394-2019-4139-9e6e-6af5d019b73e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for 7fd7d3b5-72ed-485b-a4fa-1086327fa75c owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:42:14.190999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-06314778-8dc3-40db-a6f5-f8126f80fd1e', 'network_id': '06314778-8dc3-40db-a6f5-f8126f80fd1e', 'tenant_id': '3fcb9ca7c3d44a988e6caa81ca64980c', 'fixed_ips': [{'subnet_id': '1c5479d5-6152-4084-8920-dc74c2e667c5'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:42:14.191406 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:14.199852 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.7242804 May 12 15:42:14.233881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40190) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:14.244418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'subnet': {'network_id': 'd4051fa3-866b-4e92-9d53-e0a2eeb36b88', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': True, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:14.292145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-a23e9c70-b3ca-4c23-8ce4-70db4d4e236c tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=f5159f7227ee44cd86967cf5c8d430ab&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1338906 May 12 15:42:14.557910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-138b1e6d-d4f0-4327-8270-f7c31c0215e5 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:14.559784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-138b1e6d-d4f0-4327-8270-f7c31c0215e5 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2612195 May 12 15:42:14.562490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Allocated IP 172.20.255.242 (06314778-8dc3-40db-a6f5-f8126f80fd1e/1c5479d5-6152-4084-8920-dc74c2e667c5/58977900-9ffe-410f-9737-9a0b0966441c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:42:14.635827 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-8eb2c5e7-d1da-4eef-b64e-0c97c09acec2 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/quotas/f5159f7227ee44cd86967cf5c8d430ab HTTP/1.1" status: 200 len: 375 time: 0.0668325 May 12 15:42:14.769625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa055c99-d2c4-483f-ab99-d4f1447c39c6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Network': ['ID=d4051fa3-866b-4e92-9d53-e0a2eeb36b88,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:14.807220 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-2616f762-562a-4568-8203-0f557fdfda4f tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=f5159f7227ee44cd86967cf5c8d430ab&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1462691 May 12 15:42:14.836913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network d4051fa3-866b-4e92-9d53-e0a2eeb36b88 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:42:14.850290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:14.856348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:subnet and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:14.861120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:14.867348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:14.881990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:14.893110 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:15.016049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e96fb394-2019-4139-9e6e-6af5d019b73e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:15.136835 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:15.150076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Transition to ACTIVE for port object 58977900-9ffe-410f-9737-9a0b0966441c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:42:15.228638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Transition to ACTIVE for port object 58977900-9ffe-410f-9737-9a0b0966441c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:42:15.238842 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:15.347256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Network 06314778-8dc3-40db-a6f5-f8126f80fd1e is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:42:15.360177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:15.372050 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:42:15.494733 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Pushing event updated for resources: {'Port': ['ID=58977900-9ffe-410f-9737-9a0b0966441c,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:15.572593 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Attempting to bind port 58977900-9ffe-410f-9737-9a0b0966441c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:42:15.572852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Attempting to bind port 58977900-9ffe-410f-9737-9a0b0966441c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'a41b8a4b-e33b-44a9-be4e-365dd4b0e017', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '06314778-8dc3-40db-a6f5-f8126f80fd1e'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:42:15.573209 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Attempting to bind port 58977900-9ffe-410f-9737-9a0b0966441c on network 06314778-8dc3-40db-a6f5-f8126f80fd1e {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:42:15.587940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 41, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:42:15.588317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Checking segment: {'id': 'a41b8a4b-e33b-44a9-be4e-365dd4b0e017', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '06314778-8dc3-40db-a6f5-f8126f80fd1e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:15.588710 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:15.589272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Bound using segment: {'id': 'a41b8a4b-e33b-44a9-be4e-365dd4b0e017', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '06314778-8dc3-40db-a6f5-f8126f80fd1e'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:42:15.589916 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Bound port: 58977900-9ffe-410f-9737-9a0b0966441c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a41b8a4b-e33b-44a9-be4e-365dd4b0e017', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '06314778-8dc3-40db-a6f5-f8126f80fd1e'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:42:15.590448 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:15.612993 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa94833b-5692-430a-8f3b-58c79feefe04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:15.680689 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:15.764577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-84927edd-398f-429a-be08-bc7443a61251 None None] For port 58977900-9ffe-410f-9737-9a0b0966441c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:42:15.769077 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-84927edd-398f-429a-be08-bc7443a61251 None None] For port 58977900-9ffe-410f-9737-9a0b0966441c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=58977900-9ffe-410f-9737-9a0b0966441c,segment=NetworkSegment(a41b8a4b-e33b-44a9-be4e-365dd4b0e017),segment_id=a41b8a4b-e33b-44a9-be4e-365dd4b0e017)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:42:15.778938 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:15.797225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e96fb394-2019-4139-9e6e-6af5d019b73e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=7fd7d3b5-72ed-485b-a4fa-1086327fa75c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:15.946395 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84927edd-398f-429a-be08-bc7443a61251 None None] Pushing event updated for resources: {'Port': ['ID=58977900-9ffe-410f-9737-9a0b0966441c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:15.975661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Subnet': ['ID=d28f3368-b00e-4b54-a04f-30435b09f7f4,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:16.013804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Checking segment: {'id': '37dda084-8260-41eb-ab6c-886671abc40d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': 'd4051fa3-866b-4e92-9d53-e0a2eeb36b88'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:16.014936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network hostable DHCP agents. Network: d4051fa3-866b-4e92-9d53-e0a2eeb36b88, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:42:16.073982 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:16.084367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network d4051fa3-866b-4e92-9d53-e0a2eeb36b88 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:42:16.130774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, d4051fa3-866b-4e92-9d53-e0a2eeb36b88) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:16.143486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04821961-f1ea-42d6-ac66-d3282e280777 None None] Network d4051fa3-866b-4e92-9d53-e0a2eeb36b88 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:16.155436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:16.159654 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:16.249061 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-71e70b78-fac9-4fee-87d1-1953bef060e0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 873 time: 1.9993193 May 12 15:42:16.250103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40246) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:16.378290 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:16.601838 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:16.752776 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:16.759973 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13790c77-e616-4a7a-936a-40a998a787fc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-d4051fa3-866b-4e92-9d53-e0a2eeb36b88', 'network_id': 'd4051fa3-866b-4e92-9d53-e0a2eeb36b88', 'tenant_id': '3fcb9ca7c3d44a988e6caa81ca64980c', 'fixed_ips': [{'subnet_id': 'd28f3368-b00e-4b54-a04f-30435b09f7f4'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:42:16.761012 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-13790c77-e616-4a7a-936a-40a998a787fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:16.813628 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3028c22-1a35-4ae7-8728-9a4848cc7797 req-fce6d02d-b7ec-4967-8c49-03412a3f51f7 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.4137988 May 12 15:42:16.824688 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e96fb394-2019-4139-9e6e-6af5d019b73e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:16.935038 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:17.003037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Subnet': ['ID=d28f3368-b00e-4b54-a04f-30435b09f7f4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server [None req-13790c77-e616-4a7a-936a-40a998a787fc None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet d28f3368-b00e-4b54-a04f-30435b09f7f4: This subnet is being modified by another concurrent operation. May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 289, in create_dhcp_port May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 114, in _port_action May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 692, in inner May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kwargs) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 217, in wrapped May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1452, in create_port May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1419, in _create_port_db May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1441, in create_port_db May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 219, in allocate_ips_for_port_and_store May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ips = self.allocate_ips_for_port(context, port_copy) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 217, in wrapped May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1014, in wrapper May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 226, in allocate_ips_for_port May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._allocate_ips_for_port(context, port) May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 258, in _allocate_ips_for_port May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 683, in _ipam_get_subnets May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server subnet.lock_register( May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise exception May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet d28f3368-b00e-4b54-a04f-30435b09f7f4: This subnet is being modified by another concurrent operation. May 12 15:42:17.004934 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server May 12 15:42:17.035505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e323093-7f55-4d67-89e1-77883c93143b None None] Network d4051fa3-866b-4e92-9d53-e0a2eeb36b88 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:17.219500 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:17.319342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d4051fa3-866b-4e92-9d53-e0a2eeb36b88']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:17.347182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '37dda084-8260-41eb-ab6c-886671abc40d') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:17.352691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '37dda084-8260-41eb-ab6c-886671abc40d') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:17.376782 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:17.407381 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:17.420630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 578 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:42:17.421289 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: timer() May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:42:17.445685 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:42:17.573701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e96fb394-2019-4139-9e6e-6af5d019b73e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 4a181b0a-648d-40c1-b3ca-d6a8995fa6eb has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:42:17.601715 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:17.655966 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:17.672475 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/d4051fa3-866b-4e92-9d53-e0a2eeb36b88 HTTP/1.1" status: 204 len: 168 time: 1.4209921 May 12 15:42:17.678096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40278) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:17.679662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f823e03-aafc-45dc-8403-041b3c6fe245 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Network': ['ID=d4051fa3-866b-4e92-9d53-e0a2eeb36b88,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:17.687797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-821644617'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:17.696554 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:17.708566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:network and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:17.715625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:17.727503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:17.738589 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:17.777045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:17.780493 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:17.851534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 555} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:42:17.871109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:17.871463 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Added segment b0701a78-ad36-4a97-b077-86a625304ce5 of type vlan for network 566e59cb-660c-471c-af55-3740a3424b0e May 12 15:42:17.944298 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a7d4928-3e56-4ed5-855a-48a426b2b0bc None None] Network 06314778-8dc3-40db-a6f5-f8126f80fd1e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:17.944599 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:18.002496 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c251434e-506e-4fea-9940-650397236000 req-ababf623-c1a2-4fc1-a388-167d225d8dca tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.0641060 May 12 15:42:18.019078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e96fb394-2019-4139-9e6e-6af5d019b73e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:42:18.035058 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c66c69c-8036-4b70-979e-ee88a4f45da4 None None] Sync routers for ids ['4a181b0a-648d-40c1-b3ca-d6a8995fa6eb'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:42:18.044735 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c66c69c-8036-4b70-979e-ee88a4f45da4 None None] Routers {'4a181b0a-648d-40c1-b3ca-d6a8995fa6eb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:42:18.045351 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9c66c69c-8036-4b70-979e-ee88a4f45da4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:42:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['4a181b0a-648d-40c1-b3ca-d6a8995fa6eb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:18.059427 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:18.081998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e96fb394-2019-4139-9e6e-6af5d019b73e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/4a181b0a-648d-40c1-b3ca-d6a8995fa6eb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.5514903 May 12 15:42:18.084169 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40290) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:18.090652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:18.091858 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:18.201111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-62acf243-8769-4610-b04c-196593eba396 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Synchronizing usage tracker for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:42:18.255369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-62acf243-8769-4610-b04c-196593eba396 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Unset dirty status for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:42:18.257551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-62acf243-8769-4610-b04c-196593eba396 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a181b0a-648d-40c1-b3ca-d6a8995fa6eb HTTP/1.1" status: 200 len: 205 time: 0.1706474 May 12 15:42:18.259852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40300) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:18.328685 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9c66c69c-8036-4b70-979e-ee88a4f45da4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:18.379520 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c66c69c-8036-4b70-979e-ee88a4f45da4 None None] Routers {'4a181b0a-648d-40c1-b3ca-d6a8995fa6eb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:42:18.385225 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9c66c69c-8036-4b70-979e-ee88a4f45da4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:42:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['4a181b0a-648d-40c1-b3ca-d6a8995fa6eb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:18.385552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 58977900-9ffe-410f-9737-9a0b0966441c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:42:18.503786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-636474b1-7b2b-4a93-adc8-112e6ce473a6 None None] Provisioning for port 58977900-9ffe-410f-9737-9a0b0966441c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:42:18.524252 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.8421950 May 12 15:42:18.524854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40308) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:18.553518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'subnet': {'network_id': '566e59cb-660c-471c-af55-3740a3424b0e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:18.569758 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9c66c69c-8036-4b70-979e-ee88a4f45da4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:18.572193 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c66c69c-8036-4b70-979e-ee88a4f45da4 None None] The sync data for ids ['4a181b0a-648d-40c1-b3ca-d6a8995fa6eb'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:42:18.575595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75f50215-f88c-4c98-b937-22ace15f8198 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Network': ['ID=566e59cb-660c-471c-af55-3740a3424b0e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:18.620193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 566e59cb-660c-471c-af55-3740a3424b0e details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:42:18.750386 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ccbf679-cf89-46b0-b71d-4ba0cddc9862 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:18.812751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:18.824780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:subnet and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:18.828039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:18.842508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:18.854364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 58977900-9ffe-410f-9737-9a0b0966441c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:42:18.865704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:18.869210 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:18.887751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 58977900-9ffe-410f-9737-9a0b0966441c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:18.888126 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:19.145812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.ipam_backend_mixin [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Performing IP validity checks on allocation pools {{(pid=88151) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:314}} May 12 15:42:19.146597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.ipam_backend_mixin [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Checking for overlaps among allocation pools and gateway ip {{(pid=88151) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:335}} May 12 15:42:19.166154 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:19.265378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 58977900-9ffe-410f-9737-9a0b0966441c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=58977900-9ffe-410f-9737-9a0b0966441c,segment=NetworkSegment(a41b8a4b-e33b-44a9-be4e-365dd4b0e017),segment_id=a41b8a4b-e33b-44a9-be4e-365dd4b0e017)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:42:19.270026 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:19.441993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:19.502681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=58977900-9ffe-410f-9737-9a0b0966441c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:19.527950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9119618c-dd2f-4efd-914a-fe7b719c211a None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:42:19.602562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Subnet': ['ID=4534fd1b-da0a-478b-a9c7-1e8ce0928260,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:19.685878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b25ec08f-9d50-4cd2-ab5d-1925029aa925 None None] Provisioning complete for port 58977900-9ffe-410f-9737-9a0b0966441c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:19.686243 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b25ec08f-9d50-4cd2-ab5d-1925029aa925 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:19.695116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Checking segment: {'id': 'b0701a78-ad36-4a97-b077-86a625304ce5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 555, 'network_id': '566e59cb-660c-471c-af55-3740a3424b0e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:19.695469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network hostable DHCP agents. Network: 566e59cb-660c-471c-af55-3740a3424b0e, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:42:19.734530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network 566e59cb-660c-471c-af55-3740a3424b0e is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:42:19.749039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 566e59cb-660c-471c-af55-3740a3424b0e) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:19.762595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:19.763174 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:19.813217 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-37297bc7-c6e4-4ed7-bdb5-e346a21f9205 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 792 time: 1.2801573 May 12 15:42:19.815065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40346) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:19.859751 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1fa26ae0-ca10-4bd1-9099-6a81c5c699d6 req-5d6fb275-40ad-4e55-b163-9afaddf570ae tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.7452629 May 12 15:42:20.003424 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ccbf679-cf89-46b0-b71d-4ba0cddc9862 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:20.006435 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ccbf679-cf89-46b0-b71d-4ba0cddc9862 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:20.062932 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ccbf679-cf89-46b0-b71d-4ba0cddc9862 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:20.062932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4ccbf679-cf89-46b0-b71d-4ba0cddc9862 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Fanout notify agent at l3_agent the message router_deleted on router 4a181b0a-648d-40c1-b3ca-d6a8995fa6eb {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:42:20.085476 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ccbf679-cf89-46b0-b71d-4ba0cddc9862 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:20.089073 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4ccbf679-cf89-46b0-b71d-4ba0cddc9862 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/routers/4a181b0a-648d-40c1-b3ca-d6a8995fa6eb HTTP/1.1" status: 204 len: 168 time: 1.8256621 May 12 15:42:20.089709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40354) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:20.207208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 58977900-9ffe-410f-9737-9a0b0966441c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:42:20.279993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:20.319472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-f657c81c-b989-4b0c-b117-deedcf519bad tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting subnet 7aac4d61-6a9e-4de4-8a07-0377e3406e4f {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:42:20.325257 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f657c81c-b989-4b0c-b117-deedcf519bad tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:20.401995 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f657c81c-b989-4b0c-b117-deedcf519bad tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:20.467542 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:20.488892 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f657c81c-b989-4b0c-b117-deedcf519bad tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:20.614791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9119618c-dd2f-4efd-914a-fe7b719c211a None None] Unable to find a vacant binding_index for network 566e59cb-660c-471c-af55-3740a3424b0e and agent 62f64aba-1951-452f-9938-cd517262c713 {{(pid=88153) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} May 12 15:42:20.619841 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f657c81c-b989-4b0c-b117-deedcf519bad tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:20.651486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9119618c-dd2f-4efd-914a-fe7b719c211a None None] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 566e59cb-660c-471c-af55-3740a3424b0e) {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:42:20.680095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f657c81c-b989-4b0c-b117-deedcf519bad tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Subnet': ['ID=7aac4d61-6a9e-4de4-8a07-0377e3406e4f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:20.712662 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f657c81c-b989-4b0c-b117-deedcf519bad tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:20.731872 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f657c81c-b989-4b0c-b117-deedcf519bad tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/7aac4d61-6a9e-4de4-8a07-0377e3406e4f HTTP/1.1" status: 204 len: 168 time: 0.6410296 May 12 15:42:20.733610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40370) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:20.764368 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:20.886707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 58977900-9ffe-410f-9737-9a0b0966441c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:20.886885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Subnet': ['ID=4534fd1b-da0a-478b-a9c7-1e8ce0928260,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:20.887736 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:21.007486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:21.052234 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:21.076020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['566e59cb-660c-471c-af55-3740a3424b0e']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:21.089112 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8fbd2e3-d8d3-4d75-afea-2ba55d93f370 req-1320f899-1ebd-4151-8592-3d9fdc053445 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1357479 May 12 15:42:21.091927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b0701a78-ad36-4a97-b077-86a625304ce5') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:21.092608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b0701a78-ad36-4a97-b077-86a625304ce5') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:21.107823 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:21.110845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:42:21.111410 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:21.148834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:21.165407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 555 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:42:21.165914 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: timer() May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:42:21.350634 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:42:21.353401 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:21.396758 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:21.413971 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/566e59cb-660c-471c-af55-3740a3424b0e HTTP/1.1" status: 204 len: 168 time: 1.5975091 May 12 15:42:21.427668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40386) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:21.428460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-644af0ed-a688-4c96-acb2-c2c2245d4a1d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Network': ['ID=566e59cb-660c-471c-af55-3740a3424b0e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:21.435533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-338530122'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:21.454453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:21.472001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:network and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:21.475108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:21.481292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:21.481544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09242717-1000-4cad-b175-66f2185d90c8 None None] Network 566e59cb-660c-471c-af55-3740a3424b0e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:21.498743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85642ff9-b0d4-4ae7-847c-75defbddd02f None None] Network 8daa4949-5de0-4e72-9b29-bbf2cad2b887 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:21.519134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09242717-1000-4cad-b175-66f2185d90c8 None None] Network 566e59cb-660c-471c-af55-3740a3424b0e could not be found, it might have been deleted concurrently. {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:220}} May 12 15:42:21.568660 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] For port 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf,segment=NetworkSegment(d9cb36e2-9448-4d84-b227-96e347beb405),segment_id=d9cb36e2-9448-4d84-b227-96e347beb405)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:42:21.569033 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:21.683139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ee0105f-67ae-4818-a2b2-b5f90d6075e1 None None] Network 566e59cb-660c-471c-af55-3740a3424b0e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:21.791235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ee0105f-67ae-4818-a2b2-b5f90d6075e1 None None] Network 566e59cb-660c-471c-af55-3740a3424b0e could not be found, it might have been deleted concurrently. {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:220}} May 12 15:42:21.809413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:21.812812 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:21.879059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 587} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:42:21.893266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:42:21.896091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:21.896628 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Added segment 94a9b054-0be8-4651-9a2b-fca9f9333477 of type vlan for network 0a1cb1b8-fedd-44cd-8861-68218cde1108 May 12 15:42:21.955659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:22.011954 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:22.032173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:22.033974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:22.053429 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:22.167253 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No DVR routers for this DVR port 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:42:22.186264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40219f1c-bb75-42be-9811-73d70dd3f8e0 None None] DHCP port deletion for 8daa4949-5de0-4e72-9b29-bbf2cad2b887 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:42:22.268706 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:22.394126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Network': ['ID=0a1cb1b8-fedd-44cd-8861-68218cde1108,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:22.409361 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 0a1cb1b8-fedd-44cd-8861-68218cde1108 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:42:22.430786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8416df2c-2e0f-4240-be56-0b0ce25868c2 req-ecd067b2-aa59-46a3-bba5-9b56c4f37222 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1425331 May 12 15:42:22.451485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40410) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:22.458576 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-487119d4-d9ad-4e9d-b3aa-5d1dc94e2edd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.0278249 May 12 15:42:22.601267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'subnet': {'network_id': '0a1cb1b8-fedd-44cd-8861-68218cde1108', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:22.906667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:22.913258 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:22.934225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:subnet and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:22.942908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:22.974539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:22.981334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8daa4949-5de0-4e72-9b29-bbf2cad2b887']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:23.025206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd9cb36e2-9448-4d84-b227-96e347beb405') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:23.025844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd9cb36e2-9448-4d84-b227-96e347beb405') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:23.040104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:23.044399 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:23.066903 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:23.353984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:23.365246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Releasing vlan 552 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:42:23.365674 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: timer() May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:42:23.394882 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:42:23.721783 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:23.794420 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e711a9d-931b-4279-8090-c1d0e32b7d52 req-7d521f84-a315-40ed-bd1c-8d43f8d0e13f tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1627152 May 12 15:42:23.909458 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:23.943534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Checking segment: {'id': '94a9b054-0be8-4651-9a2b-fca9f9333477', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '0a1cb1b8-fedd-44cd-8861-68218cde1108'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:23.944050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network hostable DHCP agents. Network: 0a1cb1b8-fedd-44cd-8861-68218cde1108, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:42:23.949431 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:23.959533 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Network': ['ID=8daa4949-5de0-4e72-9b29-bbf2cad2b887,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:23.961951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Subnet': ['ID=03ced78f-fc15-4f1c-b3b2-cf343514d16d,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:23.995062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network 0a1cb1b8-fedd-44cd-8861-68218cde1108 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:42:24.000845 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2e899401-9694-41ca-9a1d-0936031cce2a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/networks/8daa4949-5de0-4e72-9b29-bbf2cad2b887 HTTP/1.1" status: 204 len: 168 time: 3.2661307 May 12 15:42:24.004442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40460) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:24.010211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1638747065', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:24.022089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 0a1cb1b8-fedd-44cd-8861-68218cde1108) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:24.030722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3f415e6-1285-4ede-b263-502d8f2e48bb None None] Network 0a1cb1b8-fedd-44cd-8861-68218cde1108 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:24.038862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:24.039088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:24.039488 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:24.061098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:router and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:24.075072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:24.080457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-446eb54c-7e2e-49b9-b21a-5bef3864fa12 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 1.6268771 May 12 15:42:24.082994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40464) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:24.112714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:24.188731 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:24.194627 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:24.221950 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:24.324175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:42:24.435739 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:24.474950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:42:24.475290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4bd24d7d-bc8d-4ce3-8e94-f6bd0a4097bf not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:42:24.531919 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:24.620888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89a5134c-1c68-4617-8120-7ec9bea39064 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-0a1cb1b8-fedd-44cd-8861-68218cde1108', 'network_id': '0a1cb1b8-fedd-44cd-8861-68218cde1108', 'tenant_id': '3fcb9ca7c3d44a988e6caa81ca64980c', 'fixed_ips': [{'subnet_id': '03ced78f-fc15-4f1c-b3b2-cf343514d16d'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:42:24.621784 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-89a5134c-1c68-4617-8120-7ec9bea39064 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:24.675768 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server [None req-89a5134c-1c68-4617-8120-7ec9bea39064 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 03ced78f-fc15-4f1c-b3b2-cf343514d16d: This subnet is being modified by another concurrent operation. May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 289, in create_dhcp_port May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 114, in _port_action May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 692, in inner May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kwargs) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 217, in wrapped May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1452, in create_port May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1419, in _create_port_db May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1441, in create_port_db May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 219, in allocate_ips_for_port_and_store May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ips = self.allocate_ips_for_port(context, port_copy) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 217, in wrapped May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1014, in wrapper May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 226, in allocate_ips_for_port May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._allocate_ips_for_port(context, port) May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 258, in _allocate_ips_for_port May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 683, in _ipam_get_subnets May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server subnet.lock_register( May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise exception May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 03ced78f-fc15-4f1c-b3b2-cf343514d16d: This subnet is being modified by another concurrent operation. May 12 15:42:24.734570 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server May 12 15:42:24.742055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:24.754697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e872e74c-7a38-498f-9be7-413ce8b7f483 None None] Network 0a1cb1b8-fedd-44cd-8861-68218cde1108 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:24.844616 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Subnet': ['ID=03ced78f-fc15-4f1c-b3b2-cf343514d16d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:25.044007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-902067db-c125-412d-b0aa-fbb055639f20 None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:42:25.086814 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3d7b036-05c4-4ef5-bd25-c9d1c14cee87 req-2e8de70b-58cf-42bd-ba73-4b707f47f3b0 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.0660577 May 12 15:42:25.117706 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:25.163998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-902067db-c125-412d-b0aa-fbb055639f20 None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:42:25.172348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0a1cb1b8-fedd-44cd-8861-68218cde1108']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:25.201678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '94a9b054-0be8-4651-9a2b-fca9f9333477') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:25.202008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '94a9b054-0be8-4651-9a2b-fca9f9333477') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:25.228517 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:25.253964 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:25.265560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 587 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:42:25.265972 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: timer() May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:42:25.297562 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:42:25.377263 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:25.418029 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:25.542612 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:25.565426 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:25.674932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/0a1cb1b8-fedd-44cd-8861-68218cde1108 HTTP/1.1" status: 204 len: 168 time: 1.5908747 May 12 15:42:25.690931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40496) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:25.698726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e659cc3-ebcd-4877-bdc7-945ad5ff412c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Network': ['ID=0a1cb1b8-fedd-44cd-8861-68218cde1108,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:25.712724 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1564225037'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:25.732822 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:25.740224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:network and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:25.744793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:25.756769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:25.789548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:25.802737 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:25.875556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 555} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:42:25.883681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Allocated IP 172.25.8.59 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/d373c988-02c3-4360-9ec9-9440cab8b5c4) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:42:25.884788 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:25.885130 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Added segment 292823a4-442c-4b71-97be-95625bb54d9d of type vlan for network e597fb0b-9e76-4c25-9036-4b7d38fe0fac May 12 15:42:25.915986 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:26.006671 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:26.023070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:26.023690 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:26.292540 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.6006391 May 12 15:42:26.307545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40514) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:26.325175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'subnet': {'network_id': 'e597fb0b-9e76-4c25-9036-4b7d38fe0fac', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:26.398366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc2de1bd-31b0-4d3a-b9ae-7cae0503b537 req-d1bb8645-1c04-43ca-bfc7-be98c0b3b8ad tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.0859673 May 12 15:42:26.415418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-546fabfe-65aa-4626-81a8-715019057ddd tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Network': ['ID=e597fb0b-9e76-4c25-9036-4b7d38fe0fac,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:26.432544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network e597fb0b-9e76-4c25-9036-4b7d38fe0fac details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:42:26.528007 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:26.648146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:26.675947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:subnet and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:26.685773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:26.698368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:26.719271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:26.726166 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:26.883806 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:27.389967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=d373c988-02c3-4360-9ec9-9440cab8b5c4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:27.423987 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:27.440335 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:42:27.483189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:27.497371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:42:27.544386 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e960016-c57f-490d-878f-903c74d7918d req-ab91bfda-077b-4691-93bf-21263cf9f28b tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.0658927 May 12 15:42:27.784787 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Subnet': ['ID=ea012f0f-a39c-4c23-b465-d2bbe7722d79,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:27.812142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Checking segment: {'id': '292823a4-442c-4b71-97be-95625bb54d9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 555, 'network_id': 'e597fb0b-9e76-4c25-9036-4b7d38fe0fac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:27.813105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network hostable DHCP agents. Network: e597fb0b-9e76-4c25-9036-4b7d38fe0fac, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:42:27.887047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network e597fb0b-9e76-4c25-9036-4b7d38fe0fac is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:42:27.903905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, e597fb0b-9e76-4c25-9036-4b7d38fe0fac) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:27.914054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39551569-83ab-417f-b7b6-17f475a68383 None None] Network e597fb0b-9e76-4c25-9036-4b7d38fe0fac requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:27.985577 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:27.987236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:28.182481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40558) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:28.182855 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e2cc0684-19fb-4563-8a55-7d321500e5af tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.8739195 May 12 15:42:28.222616 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:28.540127 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:28.558660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-e597fb0b-9e76-4c25-9036-4b7d38fe0fac', 'network_id': 'e597fb0b-9e76-4c25-9036-4b7d38fe0fac', 'tenant_id': '3fcb9ca7c3d44a988e6caa81ca64980c', 'fixed_ips': [{'subnet_id': 'ea012f0f-a39c-4c23-b465-d2bbe7722d79'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:42:28.559830 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:28.909638 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:28.938597 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-592accc8-932f-4598-a471-5f9f7dd6c43a req-33a96f41-f718-40af-8292-6ea6bec03439 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.2200236 May 12 15:42:28.979845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:29.028893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Allocated IP 172.20.0.2 (e597fb0b-9e76-4c25-9036-4b7d38fe0fac/ea012f0f-a39c-4c23-b465-d2bbe7722d79/7d01d582-b8da-4c15-82a2-380b110b742e) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:42:29.403008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 2f916fd8-d0d3-4984-897b-0a39e34543f4 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:42:29.603517 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:29.628214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Transition to ACTIVE for port object 7d01d582-b8da-4c15-82a2-380b110b742e will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:42:29.698340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Transition to ACTIVE for port object 7d01d582-b8da-4c15-82a2-380b110b742e will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:42:29.722389 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:29.758564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:30.065985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Pushing event updated for resources: {'Port': ['ID=7d01d582-b8da-4c15-82a2-380b110b742e,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:30.077535 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Network e597fb0b-9e76-4c25-9036-4b7d38fe0fac is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:42:30.079032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:30.085368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:42:30.133037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Subnet': ['ID=ea012f0f-a39c-4c23-b465-d2bbe7722d79,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:30.164273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:42:30.263422 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:30.272136 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ab62c55b-e073-479d-97af-05512f0df0c6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 879 time: 6.2659743 May 12 15:42:30.275161 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-390c4a76-06f7-4ab4-81ca-7729ccd4d617 None None] Sync routers for ids ['2f916fd8-d0d3-4984-897b-0a39e34543f4'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:42:30.276188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40620) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:30.309601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-390c4a76-06f7-4ab4-81ca-7729ccd4d617 None None] Routers {'2f916fd8-d0d3-4984-897b-0a39e34543f4'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:42:30.310539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-390c4a76-06f7-4ab4-81ca-7729ccd4d617 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:42:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2f916fd8-d0d3-4984-897b-0a39e34543f4'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:30.323728 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3de7fd47-0964-4e29-ad6e-fef39cc1f8a1 req-a6693295-7b69-4c03-b0a5-b88187af7d0b tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1724727 May 12 15:42:30.471002 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:30.473798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-390c4a76-06f7-4ab4-81ca-7729ccd4d617 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:30.479827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Attempting to bind port 7d01d582-b8da-4c15-82a2-380b110b742e on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:42:30.480479 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Attempting to bind port 7d01d582-b8da-4c15-82a2-380b110b742e by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '292823a4-442c-4b71-97be-95625bb54d9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 555, 'network_id': 'e597fb0b-9e76-4c25-9036-4b7d38fe0fac'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:42:30.481073 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Attempting to bind port 7d01d582-b8da-4c15-82a2-380b110b742e on network e597fb0b-9e76-4c25-9036-4b7d38fe0fac {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:42:30.491859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 42, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:42:30.494418 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Checking segment: {'id': '292823a4-442c-4b71-97be-95625bb54d9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 555, 'network_id': 'e597fb0b-9e76-4c25-9036-4b7d38fe0fac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:30.495086 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:30.495709 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Bound using segment: {'id': '292823a4-442c-4b71-97be-95625bb54d9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 555, 'network_id': 'e597fb0b-9e76-4c25-9036-4b7d38fe0fac'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:42:30.496388 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Bound port: 7d01d582-b8da-4c15-82a2-380b110b742e, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292823a4-442c-4b71-97be-95625bb54d9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 555, 'network_id': 'e597fb0b-9e76-4c25-9036-4b7d38fe0fac'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:42:30.497356 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:30.570365 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-390c4a76-06f7-4ab4-81ca-7729ccd4d617 None None] Routers {'2f916fd8-d0d3-4984-897b-0a39e34543f4'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:42:30.578814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-390c4a76-06f7-4ab4-81ca-7729ccd4d617 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:42:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2f916fd8-d0d3-4984-897b-0a39e34543f4'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:30.584403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e597fb0b-9e76-4c25-9036-4b7d38fe0fac']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:30.627549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '292823a4-442c-4b71-97be-95625bb54d9d') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:30.630607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '292823a4-442c-4b71-97be-95625bb54d9d') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:30.671401 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:30.716741 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:30.737301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 555 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:42:30.739970 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:30.858825 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ab8fadf4-21fa-454c-b588-6101e5663ce9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/routers/2f916fd8-d0d3-4984-897b-0a39e34543f4 HTTP/1.1" status: 200 len: 880 time: 0.5739989 May 12 15:42:30.858825 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40632) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: timer() May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:42:30.892213 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:42:30.961097 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') May 12 15:42:30.961097 n-d-841483-1 neutron-server[88152]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] May 12 15:42:30.961097 n-d-841483-1 neutron-server[88152]: [parameters: {'id': 'e597fb0b-9e76-4c25-9036-4b7d38fe0fac'}] May 12 15:42:30.961097 n-d-841483-1 neutron-server[88152]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:42:30.961449 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:42:30.973043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-390c4a76-06f7-4ab4-81ca-7729ccd4d617 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:30.973460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-390c4a76-06f7-4ab4-81ca-7729ccd4d617 None None] The sync data for ids ['2f916fd8-d0d3-4984-897b-0a39e34543f4'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:42:30.976460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] For port 7d01d582-b8da-4c15-82a2-380b110b742e, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:42:31.010399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] For port 7d01d582-b8da-4c15-82a2-380b110b742e, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7d01d582-b8da-4c15-82a2-380b110b742e,segment=NetworkSegment(292823a4-442c-4b71-97be-95625bb54d9d),segment_id=292823a4-442c-4b71-97be-95625bb54d9d)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:42:31.029820 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:31.495767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4a7ad54-de7d-4041-92d0-5969c3897ca9 None None] Pushing event updated for resources: {'Port': ['ID=7d01d582-b8da-4c15-82a2-380b110b742e,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:31.549823 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:31.559031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-522ecb5b-b617-4f6b-ba3b-7cb15d25891a req-78eed97b-c9fe-4d40-a715-5f526b101c88 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1041150 May 12 15:42:31.565150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72005f0d-a0f2-427a-9bc4-8a9505940a31 None None] Network e597fb0b-9e76-4c25-9036-4b7d38fe0fac requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:31.576461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef400fc9-2d3a-4a30-a4a5-472da3eb0aec tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Synchronizing usage tracker for tenant:755d04c3babe4d56b0092365d0203422 on resource:router {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:42:31.583494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Deleting port 7d01d582-b8da-4c15-82a2-380b110b742e {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:42:31.585818 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:31.627647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef400fc9-2d3a-4a30-a4a5-472da3eb0aec tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Unset dirty status for tenant:755d04c3babe4d56b0092365d0203422 on resource:router {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:42:31.632775 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ef400fc9-2d3a-4a30-a4a5-472da3eb0aec tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 883 time: 0.7738202 May 12 15:42:31.636957 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40652) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:31.655702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-42976b45-e78f-43c2-9844-749af7053e43 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'router': {'name': 'updatedtempest-RoutersTest-router-1638747065'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:31.958028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d882a209-c2fc-4d72-9ba9-51172748b5a3 None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:42:32.092150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d882a209-c2fc-4d72-9ba9-51172748b5a3 None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:42:32.192664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] For port 7d01d582-b8da-4c15-82a2-380b110b742e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7d01d582-b8da-4c15-82a2-380b110b742e,segment=NetworkSegment(292823a4-442c-4b71-97be-95625bb54d9d),segment_id=292823a4-442c-4b71-97be-95625bb54d9d)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:42:32.193031 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:32.566920 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:32.899576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Calling delete_port for 7d01d582-b8da-4c15-82a2-380b110b742e owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:42:33.096793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-767590a1-6850-49f7-8f0d-8c4bdd25e88f req-9b210b18-b176-4a83-a51e-b1018b9b6c7f tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.3393674 May 12 15:42:33.129080 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42976b45-e78f-43c2-9844-749af7053e43 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:33.163226 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42976b45-e78f-43c2-9844-749af7053e43 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:33.226419 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:33.413360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No DVR routers for this DVR port 7d01d582-b8da-4c15-82a2-380b110b742e on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:42:33.537644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Port': ['ID=7d01d582-b8da-4c15-82a2-380b110b742e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:33.926350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-42976b45-e78f-43c2-9844-749af7053e43 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 2f916fd8-d0d3-4984-897b-0a39e34543f4 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:42:33.941105 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:34.008988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e597fb0b-9e76-4c25-9036-4b7d38fe0fac']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:34.053440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '292823a4-442c-4b71-97be-95625bb54d9d') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:34.054117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '292823a4-442c-4b71-97be-95625bb54d9d') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:34.086937 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:34.126906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:34.141489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 555 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:42:34.143825 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: timer() May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:42:34.163506 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:42:34.436355 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f589db7c-4f78-47f8-ad41-2259b4fa899b req-de8a8c40-5797-479f-81c3-4a5334891c74 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1415422 May 12 15:42:34.476474 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:34.488686 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:34.535056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Network': ['ID=e597fb0b-9e76-4c25-9036-4b7d38fe0fac,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:34.538187 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b3f20342-8afb-485c-bc4f-5b3eaa98a8c7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/e597fb0b-9e76-4c25-9036-4b7d38fe0fac HTTP/1.1" status: 204 len: 168 time: 6.3544345 May 12 15:42:34.543230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40708) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:34.550375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-951867919'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:34.556876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:34.567232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:network and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:34.599614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:34.610020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:34.670390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:34.685543 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:34.828646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42976b45-e78f-43c2-9844-749af7053e43 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:42:34.843163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42976b45-e78f-43c2-9844-749af7053e43 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:34.844331 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-42976b45-e78f-43c2-9844-749af7053e43 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/2f916fd8-d0d3-4984-897b-0a39e34543f4 HTTP/1.1" status: 200 len: 887 time: 3.2040968 May 12 15:42:34.848354 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8283b97-0931-451f-aff1-ef0cb613b65a None None] Sync routers for ids ['2f916fd8-d0d3-4984-897b-0a39e34543f4'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:42:34.851228 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 595} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:42:34.869812 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8283b97-0931-451f-aff1-ef0cb613b65a None None] Routers {'2f916fd8-d0d3-4984-897b-0a39e34543f4'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:42:34.871423 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f8283b97-0931-451f-aff1-ef0cb613b65a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:42:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2f916fd8-d0d3-4984-897b-0a39e34543f4'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:34.877423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40720) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:34.880919 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:34.881857 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Added segment ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f of type vlan for network 9a79ad24-946b-41a1-bdbe-c20077c0d5d4 May 12 15:42:34.951307 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:35.007610 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f8283b97-0931-451f-aff1-ef0cb613b65a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:35.033237 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8283b97-0931-451f-aff1-ef0cb613b65a None None] Routers {'2f916fd8-d0d3-4984-897b-0a39e34543f4'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:42:35.035450 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f8283b97-0931-451f-aff1-ef0cb613b65a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:42:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2f916fd8-d0d3-4984-897b-0a39e34543f4'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:35.039399 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:35.082682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:35.083329 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:35.205870 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f8283b97-0931-451f-aff1-ef0cb613b65a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:35.207084 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8283b97-0931-451f-aff1-ef0cb613b65a None None] The sync data for ids ['2f916fd8-d0d3-4984-897b-0a39e34543f4'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:42:35.367321 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.8226805 May 12 15:42:35.369960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40734) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:35.382797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f770b8da-7795-4f23-bb3f-8e1bccbf8686 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Network': ['ID=9a79ad24-946b-41a1-bdbe-c20077c0d5d4,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:35.392833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'subnet': {'network_id': '9a79ad24-946b-41a1-bdbe-c20077c0d5d4', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:35.393340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 9a79ad24-946b-41a1-bdbe-c20077c0d5d4 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:42:35.525777 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5f192882-2d36-4fcd-b186-39713c04d1f5 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/routers/2f916fd8-d0d3-4984-897b-0a39e34543f4 HTTP/1.1" status: 200 len: 887 time: 0.6469173 May 12 15:42:35.528224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40740) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:35.695842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-38a86a8d-e610-441e-877f-aceedbae4e29 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Synchronizing usage tracker for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:42:35.710000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:35.731143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:subnet and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:35.747508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:35.786616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:35.838179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:35.852847 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:36.011265 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81363e44-de2f-463f-9e71-6afe9ad0a66b req-a6a25341-d46b-4f19-b14d-c9567bc6a525 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.3403447 May 12 15:42:36.042241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-38a86a8d-e610-441e-877f-aceedbae4e29 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Unset dirty status for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:42:36.044055 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-38a86a8d-e610-441e-877f-aceedbae4e29 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports?device_id=2f916fd8-d0d3-4984-897b-0a39e34543f4 HTTP/1.1" status: 200 len: 205 time: 0.5144856 May 12 15:42:36.046667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40754) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:36.100569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.ipam_backend_mixin [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Performing IP validity checks on allocation pools {{(pid=88151) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:314}} May 12 15:42:36.101259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.ipam_backend_mixin [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Checking for overlaps among allocation pools and gateway ip {{(pid=88151) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:335}} May 12 15:42:36.299123 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:36.436158 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Checking segment: {'id': 'ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9a79ad24-946b-41a1-bdbe-c20077c0d5d4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:36.436803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network hostable DHCP agents. Network: 9a79ad24-946b-41a1-bdbe-c20077c0d5d4, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:42:36.446852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Subnet': ['ID=57c9e184-0c3a-401a-a796-a55ba127c886,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:36.469131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network 9a79ad24-946b-41a1-bdbe-c20077c0d5d4 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:42:36.481128 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:36.486459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 9a79ad24-946b-41a1-bdbe-c20077c0d5d4) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:36.498227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:36.498752 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:36.509899 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63a2f9a8-0171-4181-8730-e0aa7c5f9b08 None None] Network 9a79ad24-946b-41a1-bdbe-c20077c0d5d4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:36.542593 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8b96d4b1-e848-481e-9c16-80cd3c2f2055 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 800 time: 1.1706033 May 12 15:42:36.546767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40764) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:36.902378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:36.908872 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:36.912508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-9a79ad24-946b-41a1-bdbe-c20077c0d5d4', 'network_id': '9a79ad24-946b-41a1-bdbe-c20077c0d5d4', 'tenant_id': '3fcb9ca7c3d44a988e6caa81ca64980c', 'fixed_ips': [{'subnet_id': '57c9e184-0c3a-401a-a796-a55ba127c886'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:42:36.913556 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:36.921538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port d373c988-02c3-4360-9ec9-9440cab8b5c4 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:42:36.921872 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:37.177136 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:37.245287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Allocated IP 172.20.0.3 (9a79ad24-946b-41a1-bdbe-c20077c0d5d4/57c9e184-0c3a-401a-a796-a55ba127c886/3fe5d551-853b-4d63-87a4-be5482e2f755) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:42:37.397311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0f8f7fd-7131-4b11-880d-88430b3ea201 req-b30cac26-d42c-41a3-aa4a-0c5f09fd15ee tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.2809865 May 12 15:42:37.519005 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:37.687196 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:37.710408 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Transition to ACTIVE for port object 3fe5d551-853b-4d63-87a4-be5482e2f755 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:42:37.776481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Transition to ACTIVE for port object 3fe5d551-853b-4d63-87a4-be5482e2f755 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:42:37.783489 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:37.800209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for d373c988-02c3-4360-9ec9-9440cab8b5c4 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:42:37.866562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Network 9a79ad24-946b-41a1-bdbe-c20077c0d5d4 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:42:37.870064 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:37.880342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Pushing event updated for resources: {'Port': ['ID=3fe5d551-853b-4d63-87a4-be5482e2f755,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:37.883254 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:42:38.013597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Attempting to bind port 3fe5d551-853b-4d63-87a4-be5482e2f755 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:42:38.014136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Attempting to bind port 3fe5d551-853b-4d63-87a4-be5482e2f755 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9a79ad24-946b-41a1-bdbe-c20077c0d5d4'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:42:38.014606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Attempting to bind port 3fe5d551-853b-4d63-87a4-be5482e2f755 on network 9a79ad24-946b-41a1-bdbe-c20077c0d5d4 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:42:38.021689 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 42, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:42:38.022481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Checking segment: {'id': 'ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9a79ad24-946b-41a1-bdbe-c20077c0d5d4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:38.022993 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:38.023502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Bound using segment: {'id': 'ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9a79ad24-946b-41a1-bdbe-c20077c0d5d4'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:42:38.024073 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Bound port: 3fe5d551-853b-4d63-87a4-be5482e2f755, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9a79ad24-946b-41a1-bdbe-c20077c0d5d4'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:42:38.024563 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:38.297824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] For port 3fe5d551-853b-4d63-87a4-be5482e2f755, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:42:38.308760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] For port 3fe5d551-853b-4d63-87a4-be5482e2f755, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3fe5d551-853b-4d63-87a4-be5482e2f755,segment=NetworkSegment(ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f),segment_id=ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:42:38.314767 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:38.344564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:38.561561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d78502-18ef-4f67-a25e-17dd6fe4989d None None] Pushing event updated for resources: {'Port': ['ID=3fe5d551-853b-4d63-87a4-be5482e2f755,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:38.679978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Subnet': ['ID=57c9e184-0c3a-401a-a796-a55ba127c886,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:38.867412 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62db5194-17a1-4ac3-a41b-5e9277231df6 req-807fbffc-956b-4c6d-80f0-843fe979618b tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1775427 May 12 15:42:38.917438 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:39.003894 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:39.231618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=d373c988-02c3-4360-9ec9-9440cab8b5c4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:39.358373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9a79ad24-946b-41a1-bdbe-c20077c0d5d4']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:39.473719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:39.474017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:39.491723 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:39.503983 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:39.738636 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:39.741289 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:39.766143 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:39.767678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Fanout notify agent at l3_agent the message router_deleted on router 2f916fd8-d0d3-4984-897b-0a39e34543f4 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:42:39.773309 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:39.800080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 595 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:42:39.800489 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: timer() May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:42:39.831834 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:42:40.051701 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-afd72c7b-b8f4-44d8-b0e3-acd7dde0e21c req-7766a10d-9139-4422-8105-bdf6379972d6 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1106925 May 12 15:42:40.106287 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:40.123684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-78c2a4b9-0814-4fce-b665-59ab3a30e347 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/routers/2f916fd8-d0d3-4984-897b-0a39e34543f4 HTTP/1.1" status: 204 len: 168 time: 4.0699174 May 12 15:42:40.125633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40844) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:40.155118 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') May 12 15:42:40.155118 n-d-841483-1 neutron-server[88152]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] May 12 15:42:40.155118 n-d-841483-1 neutron-server[88152]: [parameters: {'id': '9a79ad24-946b-41a1-bdbe-c20077c0d5d4'}] May 12 15:42:40.155118 n-d-841483-1 neutron-server[88152]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:42:40.156047 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:42:40.165875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'network': {'name': 'tempest-RoutersTest-1261281345'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:40.180095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:40.200630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:network and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:40.224901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:40.253858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:40.256572 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3fe5d551-853b-4d63-87a4-be5482e2f755 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:42:40.302195 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:40.306673 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:40.404323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 560} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:42:40.420571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:40.420918 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Added segment 96164c11-eecf-40eb-b526-5d2b95be5432 of type vlan for network 67c2ca46-29c7-46f4-b686-178b21f9ed78 May 12 15:42:40.468916 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:40.484693 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5f5f026-1fed-4512-9d85-472d28c1532e None None] Network 9a79ad24-946b-41a1-bdbe-c20077c0d5d4 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:40.514748 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:40.520188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:40.520771 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:40.657232 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:40.678720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Deleting port 3fe5d551-853b-4d63-87a4-be5482e2f755 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:42:40.679368 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:40.680535 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5ed6dc9d-be0a-4ddc-8e59-e92c814c6d8b None None] Provisioning for port 3fe5d551-853b-4d63-87a4-be5482e2f755 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:42:40.721987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 3fe5d551-853b-4d63-87a4-be5482e2f755 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:42:40.732910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 3fe5d551-853b-4d63-87a4-be5482e2f755 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:40.733457 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:40.740273 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.6099579 May 12 15:42:40.740867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40862) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:40.749379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'subnet': {'network_id': '67c2ca46-29c7-46f4-b686-178b21f9ed78', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:40.874733 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:40.937245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 3fe5d551-853b-4d63-87a4-be5482e2f755, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3fe5d551-853b-4d63-87a4-be5482e2f755,segment=NetworkSegment(ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f),segment_id=ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:42:40.943055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:40.944741 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:40.948103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:subnet and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:40.951934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:40.960381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:40.971951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af5798e7-c3be-44b9-b3c7-fbf71c3f2521 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Network': ['ID=67c2ca46-29c7-46f4-b686-178b21f9ed78,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:40.977995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:40.987854 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:41.032918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 67c2ca46-29c7-46f4-b686-178b21f9ed78 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:42:41.066200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-083f3022-aa23-474b-b973-4422f2c3be14 None None] DHCP port deletion for 9a79ad24-946b-41a1-bdbe-c20077c0d5d4 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:42:41.395847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=3fe5d551-853b-4d63-87a4-be5482e2f755,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:41.509333 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4da5a519-fa80-4cba-a970-63bea9caa37f req-7d956b29-f6d8-4114-b0ee-67b9aab4fdf8 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1703675 May 12 15:42:41.531971 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-083f3022-aa23-474b-b973-4422f2c3be14 None None] Deleting port 3fe5d551-853b-4d63-87a4-be5482e2f755 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:42:41.533519 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-083f3022-aa23-474b-b973-4422f2c3be14 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:41.538270 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:41.559378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] For port 3fe5d551-853b-4d63-87a4-be5482e2f755, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3fe5d551-853b-4d63-87a4-be5482e2f755,segment=NetworkSegment(ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f),segment_id=ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:42:41.560367 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:41.763381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Calling delete_port for 3fe5d551-853b-4d63-87a4-be5482e2f755 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:42:41.779832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Checking segment: {'id': '96164c11-eecf-40eb-b526-5d2b95be5432', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 560, 'network_id': '67c2ca46-29c7-46f4-b686-178b21f9ed78'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:41.780192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network hostable DHCP agents. Network: 67c2ca46-29c7-46f4-b686-178b21f9ed78, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:42:41.794774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Subnet': ['ID=7d525743-a247-4185-8c70-60b889a9e809,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:41.825277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 67c2ca46-29c7-46f4-b686-178b21f9ed78 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:42:41.841101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 67c2ca46-29c7-46f4-b686-178b21f9ed78) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:41.847843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:41.848547 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:41.872600 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:41.896994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45bfef2a-f77c-4803-a664-4e22642e006a None None] Network 67c2ca46-29c7-46f4-b686-178b21f9ed78 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:41.908041 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6bf67fb4-9ff2-4771-8b43-18d3baa025f6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1627469 May 12 15:42:41.909100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40884) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:41.956447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-368becfb-ba65-480a-805a-97954deb8b86 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-505206567', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:41.969133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-368becfb-ba65-480a-805a-97954deb8b86 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:41.976180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-368becfb-ba65-480a-805a-97954deb8b86 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:router and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:41.983339 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-368becfb-ba65-480a-805a-97954deb8b86 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:42.004298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-368becfb-ba65-480a-805a-97954deb8b86 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:42.023411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Port': ['ID=3fe5d551-853b-4d63-87a4-be5482e2f755,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:42.030702 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-368becfb-ba65-480a-805a-97954deb8b86 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:42.031891 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-368becfb-ba65-480a-805a-97954deb8b86 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:42.033585 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No DVR routers for this DVR port 3fe5d551-853b-4d63-87a4-be5482e2f755 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:42:42.127658 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-368becfb-ba65-480a-805a-97954deb8b86 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:42.199761 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-368becfb-ba65-480a-805a-97954deb8b86 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:42.220002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-083f3022-aa23-474b-b973-4422f2c3be14 None None] For port 3fe5d551-853b-4d63-87a4-be5482e2f755, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3fe5d551-853b-4d63-87a4-be5482e2f755,segment=NetworkSegment(ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f),segment_id=ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:42:42.227046 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-083f3022-aa23-474b-b973-4422f2c3be14 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:42.263556 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3fe5d551-853b-4d63-87a4-be5482e2f755 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:42:42.269541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-368becfb-ba65-480a-805a-97954deb8b86 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:42.274418 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-368becfb-ba65-480a-805a-97954deb8b86 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.3577261 May 12 15:42:42.275466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40894) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:42.397338 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 3fe5d551-853b-4d63-87a4-be5482e2f755 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:42:42.400186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3fe5d551-853b-4d63-87a4-be5482e2f755 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:42:42.567300 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:42.652983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-083f3022-aa23-474b-b973-4422f2c3be14 None None] Calling delete_port for 3fe5d551-853b-4d63-87a4-be5482e2f755 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:42:42.701991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb635c54-ab2b-48f3-94e5-4555242bb318 req-d02241e6-13c9-4fa6-a63c-e2307f3e1554 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1203611 May 12 15:42:42.731797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9a79ad24-946b-41a1-bdbe-c20077c0d5d4']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:42.780251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:42.787526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ce04e2fc-4e83-4c6a-bfdf-ed661bc6094f') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:42.827479 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:42.887382 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:42.900866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 595 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:42:42.901684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: timer() May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:42:42.947606 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:42:43.075597 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0dea9400-b213-4d44-9c3a-4390627f34b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:43.103211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-67c2ca46-29c7-46f4-b686-178b21f9ed78', 'network_id': '67c2ca46-29c7-46f4-b686-178b21f9ed78', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'fixed_ips': [{'subnet_id': '7d525743-a247-4185-8c70-60b889a9e809'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:42:43.104279 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:43.204542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:43.234061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:43.249053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Network': ['ID=9a79ad24-946b-41a1-bdbe-c20077c0d5d4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:43.262034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4096bfd7-2d45-478b-ac86-2347d9126fbc tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/9a79ad24-946b-41a1-bdbe-c20077c0d5d4 HTTP/1.1" status: 204 len: 168 time: 6.7139351 May 12 15:42:43.262696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40912) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:43.270368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-970835434'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:43.295124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:43.301526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:network and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:43.310225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:43.338644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:43.361722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:43.365704 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:43.381145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Allocated IP 172.20.0.2 (67c2ca46-29c7-46f4-b686-178b21f9ed78/7d525743-a247-4185-8c70-60b889a9e809/3c858432-b9c3-467a-84a2-d1806a119636) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:42:43.435637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 596} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:42:43.468437 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:43.468862 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Added segment 73612ee4-b828-4b68-bb5e-74feb00226ac of type vlan for network 41b81980-9704-4848-95a5-e3989ab3e0e1 May 12 15:42:43.550599 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:43.635434 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:43.644574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:43.647451 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:43.716629 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.4503567 May 12 15:42:43.719001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 40928) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:43.734255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'subnet': {'network_id': '41b81980-9704-4848-95a5-e3989ab3e0e1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:43.786889 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:43.828279 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-083f3022-aa23-474b-b973-4422f2c3be14 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:42:43.828651 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-083f3022-aa23-474b-b973-4422f2c3be14 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:42:43.872543 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:43.882337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b1f9c15-e218-4861-b004-19c2531dc591 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Network': ['ID=41b81980-9704-4848-95a5-e3989ab3e0e1,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:43.904921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Transition to ACTIVE for port object 3c858432-b9c3-467a-84a2-d1806a119636 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:42:43.927609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 41b81980-9704-4848-95a5-e3989ab3e0e1 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:42:43.929248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:43.978761 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:subnet and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:43.985585 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2afb99c6-2fed-4a08-927b-be043f3eeb4f req-6ce5e12a-a88f-41c4-b054-1f7186e6e0d7 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.0993013 May 12 15:42:43.998346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:44.007553 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:44.041104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:44.266214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Transition to ACTIVE for port object 3c858432-b9c3-467a-84a2-d1806a119636 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:42:44.311074 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:44.364043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:44.371338 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:44.465947 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-083f3022-aa23-474b-b973-4422f2c3be14 None None] Deleting port 3fe5d551-853b-4d63-87a4-be5482e2f755 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:42:44.466577 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-083f3022-aa23-474b-b973-4422f2c3be14 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:44.610423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Pushing event updated for resources: {'Port': ['ID=3c858432-b9c3-467a-84a2-d1806a119636,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:44.633179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-083f3022-aa23-474b-b973-4422f2c3be14 None None] The port '3fe5d551-853b-4d63-87a4-be5482e2f755' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:42:44.638954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Network 67c2ca46-29c7-46f4-b686-178b21f9ed78 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:42:44.640543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:44.644400 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:42:44.773783 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Attempting to bind port 3c858432-b9c3-467a-84a2-d1806a119636 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:42:44.774366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Attempting to bind port 3c858432-b9c3-467a-84a2-d1806a119636 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '96164c11-eecf-40eb-b526-5d2b95be5432', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 560, 'network_id': '67c2ca46-29c7-46f4-b686-178b21f9ed78'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:42:44.774911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Attempting to bind port 3c858432-b9c3-467a-84a2-d1806a119636 on network 67c2ca46-29c7-46f4-b686-178b21f9ed78 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:42:44.781155 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 42, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:42:44.781808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Checking segment: {'id': '96164c11-eecf-40eb-b526-5d2b95be5432', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 560, 'network_id': '67c2ca46-29c7-46f4-b686-178b21f9ed78'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:44.782373 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:44.783014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Bound using segment: {'id': '96164c11-eecf-40eb-b526-5d2b95be5432', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 560, 'network_id': '67c2ca46-29c7-46f4-b686-178b21f9ed78'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:42:44.783642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Bound port: 3c858432-b9c3-467a-84a2-d1806a119636, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '96164c11-eecf-40eb-b526-5d2b95be5432', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 560, 'network_id': '67c2ca46-29c7-46f4-b686-178b21f9ed78'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:42:44.784181 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:44.799909 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:44.971534 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] For port 3c858432-b9c3-467a-84a2-d1806a119636, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:42:44.976526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] For port 3c858432-b9c3-467a-84a2-d1806a119636, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3c858432-b9c3-467a-84a2-d1806a119636,segment=NetworkSegment(96164c11-eecf-40eb-b526-5d2b95be5432),segment_id=96164c11-eecf-40eb-b526-5d2b95be5432)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:42:44.985201 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:45.018527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Subnet': ['ID=91efeefd-e105-428d-b421-3bbf7081108f,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:45.174810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Checking segment: {'id': '73612ee4-b828-4b68-bb5e-74feb00226ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '41b81980-9704-4848-95a5-e3989ab3e0e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:45.175116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network hostable DHCP agents. Network: 41b81980-9704-4848-95a5-e3989ab3e0e1, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:42:45.205481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62a49b68-9bb6-4069-92a0-838b3cbe2101 req-d4c8b084-27c9-452f-aa96-82972e8aace9 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1186471 May 12 15:42:45.265651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network 41b81980-9704-4848-95a5-e3989ab3e0e1 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:42:45.283487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Allocated IP 172.20.0.1 (67c2ca46-29c7-46f4-b686-178b21f9ed78/7d525743-a247-4185-8c70-60b889a9e809/5dfd3281-56b5-478e-b6f9-78fa828871c2) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:42:45.289626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 41b81980-9704-4848-95a5-e3989ab3e0e1) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:45.306459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:45.307050 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:45.325724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de3ac8f0-8c3b-4ede-babc-f81b5a950a89 None None] Pushing event updated for resources: {'Port': ['ID=3c858432-b9c3-467a-84a2-d1806a119636,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:45.341615 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-483638c3-89f3-44bb-a2d9-861698289bab None None] Network 41b81980-9704-4848-95a5-e3989ab3e0e1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:45.565663 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5c8c9aa1-fb8d-40eb-9588-f338e34de717 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 1.8430574 May 12 15:42:45.565866 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b11d8cfd-ab19-47cb-b305-10278a4ea98e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:45.567102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 40970) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:45.808931 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:45.903214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Transition to ACTIVE for port object 5dfd3281-56b5-478e-b6f9-78fa828871c2 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:42:45.982876 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:46.102241 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:46.311781 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:46.354099 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-296df54d-54f3-428c-9847-909c06f13f6e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-41b81980-9704-4848-95a5-e3989ab3e0e1', 'network_id': '41b81980-9704-4848-95a5-e3989ab3e0e1', 'tenant_id': '3fcb9ca7c3d44a988e6caa81ca64980c', 'fixed_ips': [{'subnet_id': '91efeefd-e105-428d-b421-3bbf7081108f'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:42:46.354892 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-296df54d-54f3-428c-9847-909c06f13f6e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:46.396272 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:46.397282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 67c2ca46-29c7-46f4-b686-178b21f9ed78 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:42:46.407969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:46.417917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3c858432-b9c3-467a-84a2-d1806a119636 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:42:46.422688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:42:46.541536 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:46.570084 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:46.702663 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b94d6b5-8685-4ae3-9d08-ae0612d2e742 req-620daf93-bc21-4aec-b24c-8b6775c50fd6 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1692436 May 12 15:42:46.728168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Subnet': ['ID=91efeefd-e105-428d-b421-3bbf7081108f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:46.824307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1bf670c6-56f6-4df1-a503-5d36a7e014f2 None None] Network 41b81980-9704-4848-95a5-e3989ab3e0e1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:46.876209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=5dfd3281-56b5-478e-b6f9-78fa828871c2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:46.948858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 3c858432-b9c3-467a-84a2-d1806a119636 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:42:46.963731 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:46.971190 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:47.031568 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['41b81980-9704-4848-95a5-e3989ab3e0e1']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:47.073732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '73612ee4-b828-4b68-bb5e-74feb00226ac') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:47.074022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '73612ee4-b828-4b68-bb5e-74feb00226ac') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:47.087212 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:47.113243 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:47.130643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 596 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:42:47.130973 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: timer() May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:42:47.162416 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:42:47.328324 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:47.377070 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:47.380256 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Network': ['ID=41b81980-9704-4848-95a5-e3989ab3e0e1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:47.411751 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b95d0c91-1651-4ad3-b4c4-9c60214b940e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/41b81980-9704-4848-95a5-e3989ab3e0e1 HTTP/1.1" status: 204 len: 168 time: 1.8426416 May 12 15:42:47.415237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41024) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:47.420604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-369524277'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:47.427215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:47.431445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:network and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:47.443005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:47.456451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:47.484270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:47.490449 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:47.528167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 578} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:42:47.529236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eca81b08-ae58-48d8-959f-dcf3ee4d4c29 None None] Network 67c2ca46-29c7-46f4-b686-178b21f9ed78 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:47.541081 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:47.541598 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Added segment 4442abd5-bab6-49f7-95f6-f7bbc34557a9 of type vlan for network 2f2e6006-9725-4937-a104-551037cea5df May 12 15:42:47.598672 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:47.665943 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:47.680225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:47.682208 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:47.690962 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:47.962379 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:47.963038 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2b26df1c-ee40-43cd-bfa9-3858acf16650 None None] Provisioning for port 3c858432-b9c3-467a-84a2-d1806a119636 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:42:47.982315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2b26df1c-ee40-43cd-bfa9-3858acf16650 None None] Provisioning complete for port 3c858432-b9c3-467a-84a2-d1806a119636 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:47.982677 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2b26df1c-ee40-43cd-bfa9-3858acf16650 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:47.987074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Network': ['ID=2f2e6006-9725-4937-a104-551037cea5df,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:48.009968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f72ad4f3-a9e2-491c-bf1a-eba8b62133c7 req-1f15ebf2-20b6-4f61-8b77-33698de0c720 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.0987020 May 12 15:42:48.015401 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-36b121af-3ee9-4155-9e65-075442d488b6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.5952861 May 12 15:42:48.016447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41038) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:48.030179 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'subnet': {'network_id': '2f2e6006-9725-4937-a104-551037cea5df', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:48.309714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 2f2e6006-9725-4937-a104-551037cea5df details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:42:48.352809 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:48.359994 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:48.636177 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:48.668589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:48.678063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:subnet and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:48.711449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=5dfd3281-56b5-478e-b6f9-78fa828871c2,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:48.713057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:48.728578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:48.753893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:48.757415 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:48.807398 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2b26df1c-ee40-43cd-bfa9-3858acf16650 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:48.883618 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2b26df1c-ee40-43cd-bfa9-3858acf16650 None None] For port 3c858432-b9c3-467a-84a2-d1806a119636, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3c858432-b9c3-467a-84a2-d1806a119636,segment=NetworkSegment(96164c11-eecf-40eb-b526-5d2b95be5432),segment_id=96164c11-eecf-40eb-b526-5d2b95be5432)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:42:48.889730 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2b26df1c-ee40-43cd-bfa9-3858acf16650 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:48.893930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 67c2ca46-29c7-46f4-b686-178b21f9ed78 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:42:48.895343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:48.944941 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:42:49.085058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b26df1c-ee40-43cd-bfa9-3858acf16650 None None] Pushing event updated for resources: {'Port': ['ID=3c858432-b9c3-467a-84a2-d1806a119636,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:49.247686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5384b590-8437-4ab8-a302-92b53a3c074b None None] Provisioning complete for port 3c858432-b9c3-467a-84a2-d1806a119636 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:49.250198 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5384b590-8437-4ab8-a302-92b53a3c074b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:49.327559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 3b08703e-e807-4695-a44e-e43e5d97d1c7 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:42:49.562464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5384b590-8437-4ab8-a302-92b53a3c074b None None] Provisioning for port 5dfd3281-56b5-478e-b6f9-78fa828871c2 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:42:49.580086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5384b590-8437-4ab8-a302-92b53a3c074b None None] Provisioning complete for port 5dfd3281-56b5-478e-b6f9-78fa828871c2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:49.591012 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5384b590-8437-4ab8-a302-92b53a3c074b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:49.742460 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:49.765573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5384b590-8437-4ab8-a302-92b53a3c074b None None] Port 5dfd3281-56b5-478e-b6f9-78fa828871c2 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:42:49.828701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:42:49.839778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c18664f9-de8a-427d-9d4d-7296f8ff6338 None None] Sync routers for ids ['3b08703e-e807-4695-a44e-e43e5d97d1c7'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:42:49.855465 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d19b6ac3-d7e0-42d2-b2d5-1ba7f3254995 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/3b08703e-e807-4695-a44e-e43e5d97d1c7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.5777638 May 12 15:42:49.856186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41076) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:49.889051 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c18664f9-de8a-427d-9d4d-7296f8ff6338 None None] Routers {'3b08703e-e807-4695-a44e-e43e5d97d1c7'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:42:49.894482 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c18664f9-de8a-427d-9d4d-7296f8ff6338 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:42:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b08703e-e807-4695-a44e-e43e5d97d1c7'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:50.010732 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74712dba-dfd9-4789-bd9a-78e44ec9b7df req-0ad6ebda-0c00-4b3f-94c2-0db83f572fa4 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.4737446 May 12 15:42:50.100106 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c18664f9-de8a-427d-9d4d-7296f8ff6338 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:50.119211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c18664f9-de8a-427d-9d4d-7296f8ff6338 None None] Routers {'3b08703e-e807-4695-a44e-e43e5d97d1c7'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:42:50.119958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c18664f9-de8a-427d-9d4d-7296f8ff6338 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:42:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b08703e-e807-4695-a44e-e43e5d97d1c7'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:50.130691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d49632df-e0de-49f9-a322-8fb7b3b844a2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:50.134672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d49632df-e0de-49f9-a322-8fb7b3b844a2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Synchronizing usage tracker for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:42:50.179181 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2736b093-4cf6-429c-9c49-727c76673034 None None] Provisioning complete for port 5dfd3281-56b5-478e-b6f9-78fa828871c2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:50.179642 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2736b093-4cf6-429c-9c49-727c76673034 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:50.206194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d49632df-e0de-49f9-a322-8fb7b3b844a2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Unset dirty status for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:42:50.211524 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d49632df-e0de-49f9-a322-8fb7b3b844a2 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports/5dfd3281-56b5-478e-b6f9-78fa828871c2 HTTP/1.1" status: 200 len: 910 time: 0.3515346 May 12 15:42:50.214144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41086) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:50.243788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a239e847-ce1a-43ff-ac94-9f8853bb4262 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '7d525743-a247-4185-8c70-60b889a9e809'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:50.333247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Checking segment: {'id': '4442abd5-bab6-49f7-95f6-f7bbc34557a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '2f2e6006-9725-4937-a104-551037cea5df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:50.333851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network hostable DHCP agents. Network: 2f2e6006-9725-4937-a104-551037cea5df, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:42:50.334870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2736b093-4cf6-429c-9c49-727c76673034 None None] Port 5dfd3281-56b5-478e-b6f9-78fa828871c2 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:42:50.339559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3c858432-b9c3-467a-84a2-d1806a119636 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:42:50.342316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Subnet': ['ID=756437ea-72fb-4c6c-87d1-493b79c95b65,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:50.444782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c18664f9-de8a-427d-9d4d-7296f8ff6338 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:50.445166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c18664f9-de8a-427d-9d4d-7296f8ff6338 None None] The sync data for ids ['3b08703e-e807-4695-a44e-e43e5d97d1c7'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:42:50.482322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2320e130-c6e5-4c27-9717-098a3436dfab None None] Provisioning complete for port 5dfd3281-56b5-478e-b6f9-78fa828871c2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:50.488400 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2320e130-c6e5-4c27-9717-098a3436dfab None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:50.575743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 3c858432-b9c3-467a-84a2-d1806a119636 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:42:50.576343 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:50.640870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2320e130-c6e5-4c27-9717-098a3436dfab None None] Port 5dfd3281-56b5-478e-b6f9-78fa828871c2 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:42:50.688152 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a239e847-ce1a-43ff-ac94-9f8853bb4262 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:50.727872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network 2f2e6006-9725-4937-a104-551037cea5df is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:42:50.929237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 2f2e6006-9725-4937-a104-551037cea5df) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:50.934377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:50.935155 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:50.944622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1823977-74eb-40af-9f3c-c5f76c657ca7 None None] Network 2f2e6006-9725-4937-a104-551037cea5df requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:51.042075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dc99ebca-8a9d-4cb7-ad1f-82b88617bbab tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 3.0233355 May 12 15:42:51.044771 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41108) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:51.578621 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2f2e6006-9725-4937-a104-551037cea5df', 'network_id': '2f2e6006-9725-4937-a104-551037cea5df', 'tenant_id': '3fcb9ca7c3d44a988e6caa81ca64980c', 'fixed_ips': [{'subnet_id': '756437ea-72fb-4c6c-87d1-493b79c95b65'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:42:51.582080 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:51.748450 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-256dcc39-3a75-4d0d-b068-01fe1c770550 req-df76e736-e885-43af-8029-ae67bba101b0 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.5825968 May 12 15:42:51.828282 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:51.992362 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:52.008254 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a239e847-ce1a-43ff-ac94-9f8853bb4262 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:52.037257 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a239e847-ce1a-43ff-ac94-9f8853bb4262 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:52.066042 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Allocated IP 172.20.0.1 (2f2e6006-9725-4937-a104-551037cea5df/756437ea-72fb-4c6c-87d1-493b79c95b65/93d9750e-bd7e-40e4-9352-defefd23f39a) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:42:52.177063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a239e847-ce1a-43ff-ac94-9f8853bb4262 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:52.178332 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a239e847-ce1a-43ff-ac94-9f8853bb4262 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:52.182918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41132) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:52.183428 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a239e847-ce1a-43ff-ac94-9f8853bb4262 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/ports/5dfd3281-56b5-478e-b6f9-78fa828871c2 HTTP/1.1" status: 200 len: 910 time: 1.9579310 May 12 15:42:52.266362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a239e847-ce1a-43ff-ac94-9f8853bb4262 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=5dfd3281-56b5-478e-b6f9-78fa828871c2,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:52.496085 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:52.511968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Transition to ACTIVE for port object 93d9750e-bd7e-40e4-9352-defefd23f39a will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:42:52.541632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Transition to ACTIVE for port object 93d9750e-bd7e-40e4-9352-defefd23f39a will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:42:52.563062 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:52.743169 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Network 2f2e6006-9725-4937-a104-551037cea5df is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:42:52.744498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:52.752726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:42:52.909569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Pushing event updated for resources: {'Port': ['ID=93d9750e-bd7e-40e4-9352-defefd23f39a,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:52.943803 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:52.995334 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74d8a083-c0f0-4674-856a-b3ccab09c318 req-4b218281-f511-472e-86f7-08f544099e0b tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1323853 May 12 15:42:53.008451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Subnet': ['ID=756437ea-72fb-4c6c-87d1-493b79c95b65,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:53.066804 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Attempting to bind port 93d9750e-bd7e-40e4-9352-defefd23f39a on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:42:53.069947 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Attempting to bind port 93d9750e-bd7e-40e4-9352-defefd23f39a by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '4442abd5-bab6-49f7-95f6-f7bbc34557a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '2f2e6006-9725-4937-a104-551037cea5df'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:42:53.070561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Attempting to bind port 93d9750e-bd7e-40e4-9352-defefd23f39a on network 2f2e6006-9725-4937-a104-551037cea5df {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:42:53.083184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 42, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:42:53.084199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Checking segment: {'id': '4442abd5-bab6-49f7-95f6-f7bbc34557a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '2f2e6006-9725-4937-a104-551037cea5df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:53.085899 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:53.086633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Bound using segment: {'id': '4442abd5-bab6-49f7-95f6-f7bbc34557a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '2f2e6006-9725-4937-a104-551037cea5df'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:42:53.087324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Bound port: 93d9750e-bd7e-40e4-9352-defefd23f39a, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4442abd5-bab6-49f7-95f6-f7bbc34557a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '2f2e6006-9725-4937-a104-551037cea5df'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:42:53.089650 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:53.228660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] For port 93d9750e-bd7e-40e4-9352-defefd23f39a, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:42:53.233123 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] For port 93d9750e-bd7e-40e4-9352-defefd23f39a, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=93d9750e-bd7e-40e4-9352-defefd23f39a,segment=NetworkSegment(4442abd5-bab6-49f7-95f6-f7bbc34557a9),segment_id=4442abd5-bab6-49f7-95f6-f7bbc34557a9)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:42:53.235212 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:53.261284 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:53.351812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2f2e6006-9725-4937-a104-551037cea5df']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:53.380622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4442abd5-bab6-49f7-95f6-f7bbc34557a9') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:53.380918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4442abd5-bab6-49f7-95f6-f7bbc34557a9') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:53.411256 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:53.451405 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:53.459895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb31c9d3-13b4-4007-960d-384d29e5f0b6 None None] Pushing event updated for resources: {'Port': ['ID=93d9750e-bd7e-40e4-9352-defefd23f39a,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:53.465758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 578 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:42:53.466159 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:53.556818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-195a028c-2171-4815-9299-fa721a9d1061 None None] Network 2f2e6006-9725-4937-a104-551037cea5df requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: timer() May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:42:53.565227 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:42:53.615212 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') May 12 15:42:53.615212 n-d-841483-1 neutron-server[88151]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] May 12 15:42:53.615212 n-d-841483-1 neutron-server[88151]: [parameters: {'id': '2f2e6006-9725-4937-a104-551037cea5df'}] May 12 15:42:53.615212 n-d-841483-1 neutron-server[88151]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:42:53.615803 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:42:53.774271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a01d328-c7d7-4cea-9280-cb511b73625d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:53.859958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcbacbd2-a989-45e7-9166-aaa3a41b37b9 None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:42:54.171659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:54.187044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-422b737e-0ee5-400e-8d3a-353169f77c57 req-138d5fe0-bbc8-4c34-a656-49934a8fd08a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.0906832 May 12 15:42:54.211836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcbacbd2-a989-45e7-9166-aaa3a41b37b9 None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:42:54.237968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Deleting port 93d9750e-bd7e-40e4-9352-defefd23f39a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:42:54.238525 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:54.627091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6a01d328-c7d7-4cea-9280-cb511b73625d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port 5dfd3281-56b5-478e-b6f9-78fa828871c2 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:42:54.627091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a01d328-c7d7-4cea-9280-cb511b73625d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:55.011095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] For port 93d9750e-bd7e-40e4-9352-defefd23f39a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=93d9750e-bd7e-40e4-9352-defefd23f39a,segment=NetworkSegment(4442abd5-bab6-49f7-95f6-f7bbc34557a9),segment_id=4442abd5-bab6-49f7-95f6-f7bbc34557a9)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:42:55.011862 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:55.248945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Calling delete_port for 93d9750e-bd7e-40e4-9352-defefd23f39a owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:42:55.410763 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0da90206-2440-4952-bd0e-7b5336c0cb0d req-e9eb7cff-b308-4634-988b-dc97425956c6 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1052942 May 12 15:42:55.450408 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a01d328-c7d7-4cea-9280-cb511b73625d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:55.696654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6a01d328-c7d7-4cea-9280-cb511b73625d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for 5dfd3281-56b5-478e-b6f9-78fa828871c2 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:42:55.765439 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:55.766244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41204) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:55.860068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Port': ['ID=93d9750e-bd7e-40e4-9352-defefd23f39a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:55.864612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No DVR routers for this DVR port 93d9750e-bd7e-40e4-9352-defefd23f39a on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:42:56.052466 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:56.095928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2f2e6006-9725-4937-a104-551037cea5df']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:56.115811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4442abd5-bab6-49f7-95f6-f7bbc34557a9') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:56.116034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4442abd5-bab6-49f7-95f6-f7bbc34557a9') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:56.156092 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:56.315175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:56.327284 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bfd5c0f0-6acb-4f0e-a617-209c0804f946 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:56.341420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 578 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:42:56.341866 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:56.344625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bfd5c0f0-6acb-4f0e-a617-209c0804f946 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:56.349531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bfd5c0f0-6acb-4f0e-a617-209c0804f946 admin admin] Usage tracker for resource:security_group_rule and tenant:3c047c70fc184e6e882983010222a2e0 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:56.352573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bfd5c0f0-6acb-4f0e-a617-209c0804f946 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:56.358449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bfd5c0f0-6acb-4f0e-a617-209c0804f946 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: timer() May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:42:56.360544 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:42:56.472065 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a01d328-c7d7-4cea-9280-cb511b73625d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:56.521149 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:56.548926 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f410bc5a-6b1e-4e93-a699-b38e237cecc0 req-7122117b-cd4e-473a-a071-ef5833ee676e tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.0538435 May 12 15:42:56.553371 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:56.556409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Network': ['ID=2f2e6006-9725-4937-a104-551037cea5df,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:56.558142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a01d328-c7d7-4cea-9280-cb511b73625d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=5dfd3281-56b5-478e-b6f9-78fa828871c2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:56.704756 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bfd5c0f0-6acb-4f0e-a617-209c0804f946 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:56.719434 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bfd5c0f0-6acb-4f0e-a617-209c0804f946 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:56.768296 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-829a58ab-ce81-434c-aa2b-21ce87a5e63e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/2f2e6006-9725-4937-a104-551037cea5df HTTP/1.1" status: 204 len: 168 time: 5.7223132 May 12 15:42:56.773902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41228) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:56.794708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41230) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:56.795267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bfd5c0f0-6acb-4f0e-a617-209c0804f946 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3c047c70fc184e6e882983010222a2e0&name=default HTTP/1.1" status: 200 len: 2983 time: 1.0266097 May 12 15:42:56.803547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-287208670'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:56.813700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:56.840547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:network and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:56.849466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfd5c0f0-6acb-4f0e-a617-209c0804f946 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f4b4a158-c4ca-49c2-8d0e-94db0c0495a1,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:56.852686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:56.867314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:56.882478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:56.886689 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:56.951630 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 590} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:42:56.962374 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:56.963131 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Added segment 63f864e8-d994-4f46-81f2-853a40457153 of type vlan for network 24409778-26af-450e-bd36-8aed94ba9962 May 12 15:42:57.007845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:57.042072 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:57.050330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:57.051324 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:57.151675 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6a01d328-c7d7-4cea-9280-cb511b73625d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:57.224739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Network': ['ID=24409778-26af-450e-bd36-8aed94ba9962,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:57.235276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 24409778-26af-450e-bd36-8aed94ba9962 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:42:57.269841 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4da7b230-a1e4-4a1e-9742-de835e75f5f8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.4731636 May 12 15:42:57.272478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41242) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:57.280422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b426e1e0-fd0d-47be-bea0-1535d20fb3e6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'network': {'name': 'New_network'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:57.583152 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d362a0a-2c21-4497-b563-db95532a7c78 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:57.613470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6a01d328-c7d7-4cea-9280-cb511b73625d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 3b08703e-e807-4695-a44e-e43e5d97d1c7 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:42:57.629708 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d362a0a-2c21-4497-b563-db95532a7c78 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:57.751351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b426e1e0-fd0d-47be-bea0-1535d20fb3e6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:57.808907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-528aa32b-7edf-48fb-a66b-9464e3f81183 req-10be6f5e-c04b-4ccf-a588-d84bd63ef3a5 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1546342 May 12 15:42:57.824274 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b426e1e0-fd0d-47be-bea0-1535d20fb3e6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:57.867485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6a01d328-c7d7-4cea-9280-cb511b73625d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:42:57.875307 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6a01d328-c7d7-4cea-9280-cb511b73625d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/3b08703e-e807-4695-a44e-e43e5d97d1c7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.6887801 May 12 15:42:57.880547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41266) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:57.885627 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58f2f92d-3850-48cb-889f-5ab2460515a0 None None] Sync routers for ids ['3b08703e-e807-4695-a44e-e43e5d97d1c7'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:42:57.923990 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58f2f92d-3850-48cb-889f-5ab2460515a0 None None] Routers {'3b08703e-e807-4695-a44e-e43e5d97d1c7'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:42:57.925971 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-58f2f92d-3850-48cb-889f-5ab2460515a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:42:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b08703e-e807-4695-a44e-e43e5d97d1c7'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:57.944585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9c024f51-8702-4ac7-bd9b-9c438a63657f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Synchronizing usage tracker for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:42:57.978304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b426e1e0-fd0d-47be-bea0-1535d20fb3e6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Network': ['ID=24409778-26af-450e-bd36-8aed94ba9962,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:57.980392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-b426e1e0-fd0d-47be-bea0-1535d20fb3e6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network 24409778-26af-450e-bd36-8aed94ba9962 is not hosted by any dhcp agent {{(pid=88152) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:228}} May 12 15:42:57.985954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b426e1e0-fd0d-47be-bea0-1535d20fb3e6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:57.986621 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b426e1e0-fd0d-47be-bea0-1535d20fb3e6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:57.990627 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b426e1e0-fd0d-47be-bea0-1535d20fb3e6 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "PUT /v2.0/networks/24409778-26af-450e-bd36-8aed94ba9962 HTTP/1.1" status: 200 len: 723 time: 0.7142558 May 12 15:42:57.997466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 24409778-26af-450e-bd36-8aed94ba9962 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:42:57.997799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41276) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:58.008980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'subnet': {'network_id': '24409778-26af-450e-bd36-8aed94ba9962', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:58.027780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9c024f51-8702-4ac7-bd9b-9c438a63657f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Unset dirty status for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:42:58.029572 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9c024f51-8702-4ac7-bd9b-9c438a63657f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports?device_id=3b08703e-e807-4695-a44e-e43e5d97d1c7 HTTP/1.1" status: 200 len: 205 time: 0.1478181 May 12 15:42:58.032178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41280) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:58.112129 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-58f2f92d-3850-48cb-889f-5ab2460515a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:58.134976 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58f2f92d-3850-48cb-889f-5ab2460515a0 None None] Routers {'3b08703e-e807-4695-a44e-e43e5d97d1c7'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:42:58.134976 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-58f2f92d-3850-48cb-889f-5ab2460515a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:42:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['3b08703e-e807-4695-a44e-e43e5d97d1c7'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:58.223471 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-58f2f92d-3850-48cb-889f-5ab2460515a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:42:58.224434 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58f2f92d-3850-48cb-889f-5ab2460515a0 None None] The sync data for ids ['3b08703e-e807-4695-a44e-e43e5d97d1c7'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:42:58.248757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:42:58.253587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:subnet and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:42:58.256460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:42:58.267707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:42:58.278516 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d362a0a-2c21-4497-b563-db95532a7c78 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:58.297791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:42:58.302202 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:58.357675 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d362a0a-2c21-4497-b563-db95532a7c78 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:58.365897 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0d362a0a-2c21-4497-b563-db95532a7c78 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f4b4a158-c4ca-49c2-8d0e-94db0c0495a1 HTTP/1.1" status: 204 len: 168 time: 1.5699048 May 12 15:42:58.367356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d362a0a-2c21-4497-b563-db95532a7c78 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4b4a158-c4ca-49c2-8d0e-94db0c0495a1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:58.372288 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb43d6aa-ad98-4da0-b305-48a48c199b9d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:58.661668 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:58.776307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Subnet': ['ID=91af63f0-a0de-4689-8eeb-43465326e6bc,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:42:58.833520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Checking segment: {'id': '63f864e8-d994-4f46-81f2-853a40457153', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': '24409778-26af-450e-bd36-8aed94ba9962'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:42:58.833858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network hostable DHCP agents. Network: 24409778-26af-450e-bd36-8aed94ba9962, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:42:58.894095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network 24409778-26af-450e-bd36-8aed94ba9962 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:42:59.114699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93100a04-c9f3-4647-b1e8-b15981f287cb req-1ad29b09-990a-4ebf-b73e-d3ab7bdde1c7 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.2071068 May 12 15:42:59.115052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 24409778-26af-450e-bd36-8aed94ba9962) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:42:59.135466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:42:59.141402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d23e8986-9723-44ea-b87a-1139cf5c56db None None] Network 24409778-26af-450e-bd36-8aed94ba9962 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:42:59.143229 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:59.240162 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5ca14a73-4fce-4066-bf7e-c829c1ae0de2 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2412055 May 12 15:42:59.240765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41318) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:59.254475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-87716221-281b-4653-b6a7-127e6354bb98 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:42:59.283710 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb43d6aa-ad98-4da0-b305-48a48c199b9d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:59.286333 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb43d6aa-ad98-4da0-b305-48a48c199b9d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:59.332077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb43d6aa-ad98-4da0-b305-48a48c199b9d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:59.333087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb43d6aa-ad98-4da0-b305-48a48c199b9d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Fanout notify agent at l3_agent the message router_deleted on router 3b08703e-e807-4695-a44e-e43e5d97d1c7 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:42:59.414343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41324) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:59.419365 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bb43d6aa-ad98-4da0-b305-48a48c199b9d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:59.420471 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bb43d6aa-ad98-4da0-b305-48a48c199b9d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/routers/3b08703e-e807-4695-a44e-e43e5d97d1c7 HTTP/1.1" status: 204 len: 168 time: 1.3869274 May 12 15:42:59.423685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41328) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:59.733968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-24409778-26af-450e-bd36-8aed94ba9962', 'network_id': '24409778-26af-450e-bd36-8aed94ba9962', 'tenant_id': '3fcb9ca7c3d44a988e6caa81ca64980c', 'fixed_ips': [{'subnet_id': '91af63f0-a0de-4689-8eeb-43465326e6bc'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:42:59.739247 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:59.812418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87716221-281b-4653-b6a7-127e6354bb98 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-1637698'] for subnet, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:59.900559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41348) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:42:59.908177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-32692a4b-7bc9-4025-ad49-b894d247c5ec tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting subnet 7d525743-a247-4185-8c70-60b889a9e809 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:42:59.950409 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-32692a4b-7bc9-4025-ad49-b894d247c5ec tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:42:59.994596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Allocated IP 172.20.0.2 (24409778-26af-450e-bd36-8aed94ba9962/91af63f0-a0de-4689-8eeb-43465326e6bc/a825c2f4-a225-43f0-9e8b-878041327fda) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:00.036962 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0527a6cf-5d0b-480e-99cf-35bb6a66831c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.091177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Request body: {'network': {'name': 'tempest-TestAggregatesBasicOps-1565348474-network', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:00.098816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:00.103837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Usage tracker for resource:network and tenant:7b6758bd71d1400f8b6b1d4858918128 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:00.107552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:00.126098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:00.164330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Made reservation on behalf of 7b6758bd71d1400f8b6b1d4858918128 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:00.178702 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.228053 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.254612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:00.258506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Usage tracker for resource:security_group_rule and tenant:7b6758bd71d1400f8b6b1d4858918128 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:00.267274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:00.286281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:00.346867 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.364343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Transition to ACTIVE for port object a825c2f4-a225-43f0-9e8b-878041327fda will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:00.388932 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Transition to ACTIVE for port object a825c2f4-a225-43f0-9e8b-878041327fda will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:00.404580 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.434289 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.434525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0527a6cf-5d0b-480e-99cf-35bb6a66831c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:00.438256 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e82cf2d4-4a84-4822-a023-961757cf288b req-e1567f20-c05d-434f-b1a0-14d452179d80 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.0772698 May 12 15:43:00.453334 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-32692a4b-7bc9-4025-ad49-b894d247c5ec tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.453637 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.490636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 586} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:43:00.495603 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0527a6cf-5d0b-480e-99cf-35bb6a66831c admin admin] Usage tracker for resource:security_group_rule and tenant:28a931c75a9141caa06cd1ff0f796b37 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:00.506707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0527a6cf-5d0b-480e-99cf-35bb6a66831c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:00.507504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a58efc01-61b7-4d4d-a153-d3125124b4dc,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:00.519157 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.519498 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Added segment 00733d62-a32c-495d-9cf8-f6c6e58930c1 of type vlan for network dc4d0778-8db2-40e0-aa19-9acf571959fb May 12 15:43:00.521677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:00.522022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:00.522408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:00.522749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:00.523081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:00.523409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:00.523736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:00.524058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:00.524476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:00.524804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:00.525125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:00.525468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:00.526786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0527a6cf-5d0b-480e-99cf-35bb6a66831c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:00.545850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Network 24409778-26af-450e-bd36-8aed94ba9962 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:00.556508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:00.570267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:00.584366 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.657364 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.658556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:00.659341 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.700425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Pushing event updated for resources: {'Port': ['ID=a825c2f4-a225-43f0-9e8b-878041327fda,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:00.734748 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87716221-281b-4653-b6a7-127e6354bb98 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8768026839929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-28130211'] for subnet, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.741665 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Attempting to bind port a825c2f4-a225-43f0-9e8b-878041327fda on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:00.744297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Attempting to bind port a825c2f4-a225-43f0-9e8b-878041327fda by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '63f864e8-d994-4f46-81f2-853a40457153', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': '24409778-26af-450e-bd36-8aed94ba9962'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:00.745267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Attempting to bind port a825c2f4-a225-43f0-9e8b-878041327fda on network 24409778-26af-450e-bd36-8aed94ba9962 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:00.760105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 42, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:00.764307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Checking segment: {'id': '63f864e8-d994-4f46-81f2-853a40457153', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': '24409778-26af-450e-bd36-8aed94ba9962'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:00.765510 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.766130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Bound using segment: {'id': '63f864e8-d994-4f46-81f2-853a40457153', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': '24409778-26af-450e-bd36-8aed94ba9962'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:00.767569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Bound port: a825c2f4-a225-43f0-9e8b-878041327fda, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '63f864e8-d994-4f46-81f2-853a40457153', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': '24409778-26af-450e-bd36-8aed94ba9962'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:00.768401 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.818227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87716221-281b-4653-b6a7-127e6354bb98 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:00.819506 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-87716221-281b-4653-b6a7-127e6354bb98 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.821017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-87716221-281b-4653-b6a7-127e6354bb98 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "PUT /v2.0/subnets/91af63f0-a0de-4689-8eeb-43465326e6bc HTTP/1.1" status: 200 len: 806 time: 1.5793440 May 12 15:43:00.836178 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41368) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:00.871474 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-32692a4b-7bc9-4025-ad49-b894d247c5ec tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:00.912616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] For port a825c2f4-a225-43f0-9e8b-878041327fda, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:00.916839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] For port a825c2f4-a225-43f0-9e8b-878041327fda, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a825c2f4-a225-43f0-9e8b-878041327fda,segment=NetworkSegment(63f864e8-d994-4f46-81f2-853a40457153),segment_id=63f864e8-d994-4f46-81f2-853a40457153)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:00.925010 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:01.003902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87716221-281b-4653-b6a7-127e6354bb98 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Subnet': ['ID=91af63f0-a0de-4689-8eeb-43465326e6bc,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:01.044233 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 1.1422076 May 12 15:43:01.047819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41376) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:01.056094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0364734-31a7-445f-8d61-b1d65d5ff7b9 admin admin] Pushing event updated for resources: {'Network': ['ID=dc4d0778-8db2-40e0-aa19-9acf571959fb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:01.082332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Request body: {'subnet': {'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestAggregatesBasicOps-1565348474-subnet', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:01.100263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network dc4d0778-8db2-40e0-aa19-9acf571959fb details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:43:01.107305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:01.152431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6e551e4-72cc-4e7c-b7cc-6ab781ff8b8d None None] Pushing event updated for resources: {'Port': ['ID=a825c2f4-a225-43f0-9e8b-878041327fda,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:01.175396 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0527a6cf-5d0b-480e-99cf-35bb6a66831c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:01.206230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Usage tracker for resource:subnet and tenant:7b6758bd71d1400f8b6b1d4858918128 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:01.218779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:01.224241 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0527a6cf-5d0b-480e-99cf-35bb6a66831c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:01.234625 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-32692a4b-7bc9-4025-ad49-b894d247c5ec tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:01.243187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:01.391921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Made reservation on behalf of 7b6758bd71d1400f8b6b1d4858918128 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:01.394832 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:01.597223 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:01.645262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32692a4b-7bc9-4025-ad49-b894d247c5ec tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Subnet': ['ID=7d525743-a247-4185-8c70-60b889a9e809,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:01.670093 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-32692a4b-7bc9-4025-ad49-b894d247c5ec tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:01.685159 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0527a6cf-5d0b-480e-99cf-35bb6a66831c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=28a931c75a9141caa06cd1ff0f796b37&name=default HTTP/1.1" status: 200 len: 2983 time: 2.2698016 May 12 15:43:01.687795 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41392) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:01.691182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0527a6cf-5d0b-480e-99cf-35bb6a66831c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e02dada5-b72f-4910-a20c-834b45ee4bdf,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:01.691587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e1b05ed-a94d-4ac4-a495-b357ac574ffb None None] Network 67c2ca46-29c7-46f4-b686-178b21f9ed78 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:01.702990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58e2d8b0-39cc-403d-909b-a45c6b234cbc req-03a41211-95ee-4833-963a-26fb3a5cefeb tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1356087 May 12 15:43:01.741516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Deleting port a825c2f4-a225-43f0-9e8b-878041327fda {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:43:01.741868 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:01.774693 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d06f569c-26ea-4bc4-a5f7-0796d6b9614b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:01.790810 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-32692a4b-7bc9-4025-ad49-b894d247c5ec tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/7d525743-a247-4185-8c70-60b889a9e809 HTTP/1.1" status: 204 len: 168 time: 2.3486540 May 12 15:43:01.794027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41396) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:01.916831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:01.950025 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d06f569c-26ea-4bc4-a5f7-0796d6b9614b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:02.021690 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:02.080364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port 3c858432-b9c3-467a-84a2-d1806a119636 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:43:02.080904 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:02.110653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8048f0a2-0244-4df1-a0f2-76aae45f6709,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:02.204630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02d5c202-dd59-4a61-bd90-e45bae6e3a66 None None] DHCP port deletion for 67c2ca46-29c7-46f4-b686-178b21f9ed78 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:43:02.213317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-02d5c202-dd59-4a61-bd90-e45bae6e3a66 None None] Deleting port 3c858432-b9c3-467a-84a2-d1806a119636 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:43:02.214497 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-02d5c202-dd59-4a61-bd90-e45bae6e3a66 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:02.321161 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a825c2f4-a225-43f0-9e8b-878041327fda up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:02.331444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Checking segment: {'id': '00733d62-a32c-495d-9cf8-f6c6e58930c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:02.331796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Network hostable DHCP agents. Network: dc4d0778-8db2-40e0-aa19-9acf571959fb, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:43:02.421509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] For port 3c858432-b9c3-467a-84a2-d1806a119636, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3c858432-b9c3-467a-84a2-d1806a119636,segment=NetworkSegment(96164c11-eecf-40eb-b526-5d2b95be5432),segment_id=96164c11-eecf-40eb-b526-5d2b95be5432)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:02.421895 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:02.439021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Network dc4d0778-8db2-40e0-aa19-9acf571959fb is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:43:02.456635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] For port a825c2f4-a225-43f0-9e8b-878041327fda, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a825c2f4-a225-43f0-9e8b-878041327fda,segment=NetworkSegment(63f864e8-d994-4f46-81f2-853a40457153),segment_id=63f864e8-d994-4f46-81f2-853a40457153)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:02.457189 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:02.466627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, dc4d0778-8db2-40e0-aa19-9acf571959fb) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:02.475108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:02.476036 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:02.506457 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb016961-5beb-41b3-a7eb-db337332ab49 None None] Network dc4d0778-8db2-40e0-aa19-9acf571959fb requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:02.634212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port a825c2f4-a225-43f0-9e8b-878041327fda completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:02.636389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Calling delete_port for a825c2f4-a225-43f0-9e8b-878041327fda owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:43:02.644397 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:02.715814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for 3c858432-b9c3-467a-84a2-d1806a119636 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:43:02.779476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-09a35668-f367-4e5e-ad97-a6b0cf3e5fa6 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.7299039 May 12 15:43:02.780460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41418) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:02.797432 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14dabd18-8f2c-48d9-8c71-1334579d69ac None None] Network 24409778-26af-450e-bd36-8aed94ba9962 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:02.836150 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:02.908695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d06f569c-26ea-4bc4-a5f7-0796d6b9614b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:02.908695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No DVR routers for this DVR port 3c858432-b9c3-467a-84a2-d1806a119636 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:43:02.911061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=3c858432-b9c3-467a-84a2-d1806a119636,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:02.927965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Request body: {'router': {'name': 'tempest-TestAggregatesBasicOps-1565348474-router', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:02.974718 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:02.981093 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:02.982756 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-02d5c202-dd59-4a61-bd90-e45bae6e3a66 None None] For port 3c858432-b9c3-467a-84a2-d1806a119636, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3c858432-b9c3-467a-84a2-d1806a119636,segment=NetworkSegment(96164c11-eecf-40eb-b526-5d2b95be5432),segment_id=96164c11-eecf-40eb-b526-5d2b95be5432)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:02.983147 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-02d5c202-dd59-4a61-bd90-e45bae6e3a66 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.007115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d06f569c-26ea-4bc4-a5f7-0796d6b9614b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e02dada5-b72f-4910-a20c-834b45ee4bdf,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:03.087834 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Port': ['ID=a825c2f4-a225-43f0-9e8b-878041327fda,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:03.091551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Usage tracker for resource:router and tenant:7b6758bd71d1400f8b6b1d4858918128 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:03.109173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3bb4fc25-5ed5-427f-b75a-4d9d4c43b736 req-0c469597-a19d-4713-b6f3-59e5b25f322c tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.3279476 May 12 15:43:03.111531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7e1f8f0f-31a9-41a0-b981-77eccc44711e None None] Provisioning complete for port a825c2f4-a225-43f0-9e8b-878041327fda triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:03.111796 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7e1f8f0f-31a9-41a0-b981-77eccc44711e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.116632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:03.152926 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.163994 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d06f569c-26ea-4bc4-a5f7-0796d6b9614b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.167523 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d06f569c-26ea-4bc4-a5f7-0796d6b9614b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e02dada5-b72f-4910-a20c-834b45ee4bdf HTTP/1.1" status: 204 len: 168 time: 1.4737973 May 12 15:43:03.201231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['67c2ca46-29c7-46f4-b686-178b21f9ed78']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:03.249615 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-02d5c202-dd59-4a61-bd90-e45bae6e3a66 None None] Calling delete_port for 3c858432-b9c3-467a-84a2-d1806a119636 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:43:03.259792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '96164c11-eecf-40eb-b526-5d2b95be5432') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:03.259792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '96164c11-eecf-40eb-b526-5d2b95be5432') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:03.285538 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.338622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.354923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Releasing vlan 560 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:43:03.357947 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.380891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: timer() May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:43:03.389195 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:43:03.402131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-7e1f8f0f-31a9-41a0-b981-77eccc44711e None None] Port a825c2f4-a225-43f0-9e8b-878041327fda was deleted so its status cannot be updated. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:330}} May 12 15:43:03.467456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No DVR routers for this DVR port a825c2f4-a225-43f0-9e8b-878041327fda on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:43:03.510730 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.512377 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.553351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.576778 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.581299 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-02d5c202-dd59-4a61-bd90-e45bae6e3a66 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:43:03.586584 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-02d5c202-dd59-4a61-bd90-e45bae6e3a66 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:43:03.601292 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.649379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-dc4d0778-8db2-40e0-aa19-9acf571959fb', 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'fixed_ips': [{'subnet_id': '8048f0a2-0244-4df1-a0f2-76aae45f6709'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:43:03.650221 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.659027 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.662428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Network': ['ID=67c2ca46-29c7-46f4-b686-178b21f9ed78,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:03.668734 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-87dbfb8d-7015-4fb0-9be4-469b9a2a5d3d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/networks/67c2ca46-29c7-46f4-b686-178b21f9ed78 HTTP/1.1" status: 204 len: 168 time: 1.8700600 May 12 15:43:03.669805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41440) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:03.675320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3c602a0b-43d9-4352-aa43-1bbc6070832a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-2126470660', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:03.684449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3c602a0b-43d9-4352-aa43-1bbc6070832a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:03.700336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3c602a0b-43d9-4352-aa43-1bbc6070832a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:router and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:03.703528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3c602a0b-43d9-4352-aa43-1bbc6070832a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:03.741825 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3c602a0b-43d9-4352-aa43-1bbc6070832a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:03.788755 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c602a0b-43d9-4352-aa43-1bbc6070832a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.788755 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c602a0b-43d9-4352-aa43-1bbc6070832a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.814394 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c602a0b-43d9-4352-aa43-1bbc6070832a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.844854 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c602a0b-43d9-4352-aa43-1bbc6070832a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.849121 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.892714 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3c602a0b-43d9-4352-aa43-1bbc6070832a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:03.897257 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3c602a0b-43d9-4352-aa43-1bbc6070832a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.2269120 May 12 15:43:03.897944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41446) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:03.908011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'network': {'name': 'tempest-RoutersTest-1203678318'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:03.916099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:03.925619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:network and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:03.929426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:03.937507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:03.956963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:03.964016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:04.025167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 584} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:43:04.040183 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:04.040945 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Added segment 92cc27a5-54f6-4acf-aea2-6f8363283685 of type vlan for network 68b58bc0-e327-4b58-a823-23ad945651fe May 12 15:43:04.074221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Allocated IP 172.20.0.2 (dc4d0778-8db2-40e0-aa19-9acf571959fb/8048f0a2-0244-4df1-a0f2-76aae45f6709/b3a5c96c-3661-496b-b5d1-e53a15ef1740) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:04.089543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-02d5c202-dd59-4a61-bd90-e45bae6e3a66 None None] Deleting port 3c858432-b9c3-467a-84a2-d1806a119636 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:43:04.089543 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-02d5c202-dd59-4a61-bd90-e45bae6e3a66 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:04.112748 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:04.118952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Subnet': ['ID=91af63f0-a0de-4689-8eeb-43465326e6bc,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:04.223545 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:04.231422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:04.232022 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:04.344254 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.4357109 May 12 15:43:04.397561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41462) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:04.476916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'subnet': {'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:04.510112 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f497a05f-27d8-41e1-af40-504ce2b9b73e req-6903579b-0314-466d-95cf-f9274cd76fd8 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.1874061 May 12 15:43:04.566072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b01afb0-59b9-49ab-928a-66c2ac567873 req-1e6df894-6a16-4ade-8aef-f25f8325da0d tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.3570666 May 12 15:43:04.711535 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:04.725052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Transition to ACTIVE for port object b3a5c96c-3661-496b-b5d1-e53a15ef1740 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:04.747639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Transition to ACTIVE for port object b3a5c96c-3661-496b-b5d1-e53a15ef1740 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:04.752205 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7dd620d0-0d50-4b6a-947d-8f8dd2ff8f17 None None] Network 24409778-26af-450e-bd36-8aed94ba9962 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:04.894041 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:04.919394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-02d5c202-dd59-4a61-bd90-e45bae6e3a66 None None] The port '3c858432-b9c3-467a-84a2-d1806a119636' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:43:04.950903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3c858432-b9c3-467a-84a2-d1806a119636 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:43:04.955686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-542e3ae9-10d5-4391-88d9-8cf0b1f29b60 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Network': ['ID=68b58bc0-e327-4b58-a823-23ad945651fe,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:04.959554 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f497a05f-27d8-41e1-af40-504ce2b9b73e req-3198a88f-9e1d-40fe-970d-699b38fae0f0 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.2691996 May 12 15:43:04.995919 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:05.005271 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 3c858432-b9c3-467a-84a2-d1806a119636 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:43:05.006627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3c858432-b9c3-467a-84a2-d1806a119636 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:43:05.010127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 68b58bc0-e327-4b58-a823-23ad945651fe details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:43:05.028615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:05.035565 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f497a05f-27d8-41e1-af40-504ce2b9b73e req-184644be-6c54-4aba-8300-0141f5e888b1 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0450077 May 12 15:43:05.036472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:subnet and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:05.040340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:05.064763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:05.122170 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:05.148674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:05.152617 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:05.203816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['24409778-26af-450e-bd36-8aed94ba9962']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:05.226630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Pushing event updated for resources: {'Port': ['ID=b3a5c96c-3661-496b-b5d1-e53a15ef1740,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:05.260613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '63f864e8-d994-4f46-81f2-853a40457153') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:05.260931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '63f864e8-d994-4f46-81f2-853a40457153') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:05.319017 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:05.356258 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:05.364645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 590 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:43:05.365729 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: timer() May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:43:05.383894 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:43:05.475819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f497a05f-27d8-41e1-af40-504ce2b9b73e req-5f2fa6bc-fcd5-4c97-ae13-63f13ed680fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:05.480973 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f497a05f-27d8-41e1-af40-504ce2b9b73e req-5f2fa6bc-fcd5-4c97-ae13-63f13ed680fe service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4357266 May 12 15:43:05.528716 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Network dc4d0778-8db2-40e0-aa19-9acf571959fb is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:05.532049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:05.535973 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:05.558566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-138eda5a-b13e-4bf8-8a23-ee392fd48c9e None None] DHCP port deletion for 24409778-26af-450e-bd36-8aed94ba9962 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:43:05.776314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Attempting to bind port b3a5c96c-3661-496b-b5d1-e53a15ef1740 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:05.776858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Attempting to bind port b3a5c96c-3661-496b-b5d1-e53a15ef1740 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '00733d62-a32c-495d-9cf8-f6c6e58930c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:05.776989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41506) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:05.777504 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Attempting to bind port b3a5c96c-3661-496b-b5d1-e53a15ef1740 on network dc4d0778-8db2-40e0-aa19-9acf571959fb {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:05.788603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 42, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:05.789294 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Checking segment: {'id': '00733d62-a32c-495d-9cf8-f6c6e58930c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:05.789887 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:05.790425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Bound using segment: {'id': '00733d62-a32c-495d-9cf8-f6c6e58930c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:05.791041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Bound port: b3a5c96c-3661-496b-b5d1-e53a15ef1740, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '00733d62-a32c-495d-9cf8-f6c6e58930c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:05.791570 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:05.822936 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:05.866906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:05.925760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Subnet': ['ID=f7006e60-2559-4109-b7ec-b5e7c210cde8,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:05.938910 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:05.950330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Checking segment: {'id': '92cc27a5-54f6-4acf-aea2-6f8363283685', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:05.952250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network hostable DHCP agents. Network: 68b58bc0-e327-4b58-a823-23ad945651fe, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:43:05.958847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/24409778-26af-450e-bd36-8aed94ba9962 HTTP/1.1" status: 204 len: 168 time: 5.1114454 May 12 15:43:05.961764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41514) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:05.967385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-619e49c2-16d7-479e-8aea-6874f88da952 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Network': ['ID=24409778-26af-450e-bd36-8aed94ba9962,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:05.971026 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ac7819c-e603-4b2c-8ad8-9754c0015624 req-f1bd0a48-d929-476f-800b-23ae1955c145 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1051502 May 12 15:43:06.015307 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-8e437136-20ef-409c-8ea7-789ca586a9d0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:06.015768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8e437136-20ef-409c-8ea7-789ca586a9d0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:06.035101 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] For port b3a5c96c-3661-496b-b5d1-e53a15ef1740, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:06.040453 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8e437136-20ef-409c-8ea7-789ca586a9d0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/24409778-26af-450e-bd36-8aed94ba9962 HTTP/1.1" status: 404 len: 339 time: 0.0715075 May 12 15:43:06.040632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] For port b3a5c96c-3661-496b-b5d1-e53a15ef1740, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b3a5c96c-3661-496b-b5d1-e53a15ef1740,segment=NetworkSegment(00733d62-a32c-495d-9cf8-f6c6e58930c1),segment_id=00733d62-a32c-495d-9cf8-f6c6e58930c1)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:06.041943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41520) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:06.046084 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab1c46c9-6e48-4db4-a4d7-1f120e6a4abf admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:06.048713 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:06.053489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1585802017', 'description': 'd1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:06.062286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:06.069230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:network and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:06.072479 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:06.073411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 68b58bc0-e327-4b58-a823-23ad945651fe is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:43:06.091563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ab1c46c9-6e48-4db4-a4d7-1f120e6a4abf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:06.095573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ab1c46c9-6e48-4db4-a4d7-1f120e6a4abf admin admin] Usage tracker for resource:security_group_rule and tenant:6325ef5d4ede4ae095f641bd25126131 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:06.098710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ab1c46c9-6e48-4db4-a4d7-1f120e6a4abf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:06.102118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:06.106235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ab1c46c9-6e48-4db4-a4d7-1f120e6a4abf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:06.113596 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:06.116845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:06.168986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a825c2f4-a225-43f0-9e8b-878041327fda no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:43:06.227203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab1c46c9-6e48-4db4-a4d7-1f120e6a4abf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:06.233300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: a825c2f4-a225-43f0-9e8b-878041327fda {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:43:06.233867 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a825c2f4-a225-43f0-9e8b-878041327fda not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:43:06.243057 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab1c46c9-6e48-4db4-a4d7-1f120e6a4abf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:06.263833 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Pushing event updated for resources: {'Port': ['ID=b3a5c96c-3661-496b-b5d1-e53a15ef1740,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:06.275369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:06.276060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:06.276400 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:06.277043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:06.277376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:06.277778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:06.278149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:06.278665 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:06.278989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:06.279537 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:06.279906 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:06.280294 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1306cbaa-c370-450d-8cf5-3aff9a4adbd1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:06.319130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 68b58bc0-e327-4b58-a823-23ad945651fe) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:06.327128 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dff03de1-f66e-4eff-a8a3-2a84bafaa32b None None] Network 68b58bc0-e327-4b58-a823-23ad945651fe requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:06.336033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:06.336727 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:06.418963 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ab1c46c9-6e48-4db4-a4d7-1f120e6a4abf admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6325ef5d4ede4ae095f641bd25126131&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6385760 May 12 15:43:06.421961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41538) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:06.433068 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-33a2622c-b834-4510-a9f7-7480f21c73de tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0268719 May 12 15:43:06.440792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab1c46c9-6e48-4db4-a4d7-1f120e6a4abf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7670eece-f9b5-46a0-ad10-4ac29a85fff6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:06.445699 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41542) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:06.544043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Allocated IP 172.25.8.246 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/b412f7d6-f82f-41a4-a588-b9f97c5b45ab) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:06.757830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-68b58bc0-e327-4b58-a823-23ad945651fe', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:43:06.757830 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:06.809652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:06.818162 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:06.910542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 583} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:43:06.931566 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:06.931915 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Added segment 31803763-e200-4b74-931a-4ecc18c92862 of type vlan for network 25cda344-9ad0-4bd1-9239-c9412279c118 May 12 15:43:06.976771 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:07.018515 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Allocated IP 172.20.0.2 (68b58bc0-e327-4b58-a823-23ad945651fe/f7006e60-2559-4109-b7ec-b5e7c210cde8/ba84bb8c-76ac-4c5d-9296-856e9d039f94) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:07.033643 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2810e1c3-60b9-4071-a670-180c9a5401a2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:07.080141 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:07.081022 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:07.092497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:07.092860 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:07.111950 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2810e1c3-60b9-4071-a670-180c9a5401a2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:07.320533 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2dca6761-10db-48b6-8ae2-22bcfa7d4fb7 req-9761fb8d-35ed-4d1b-b33a-48a3acdb0198 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.2476642 May 12 15:43:07.372485 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:07.409503 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 782 time: 1.3661597 May 12 15:43:07.412605 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:07.417243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41552) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:07.421843 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Transition to ACTIVE for port object ba84bb8c-76ac-4c5d-9296-856e9d039f94 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:07.426610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e4bf9dc-8cee-46f9-a847-285ae53c22d8 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Network': ['ID=25cda344-9ad0-4bd1-9239-c9412279c118,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:07.490449 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:07.506848 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Transition to ACTIVE for port object ba84bb8c-76ac-4c5d-9296-856e9d039f94 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:07.515010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 25cda344-9ad0-4bd1-9239-c9412279c118 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:43:07.578018 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:07.643393 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:07.646467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:07.651450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:07.693224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Pushing event updated for resources: {'Port': ['ID=b412f7d6-f82f-41a4-a588-b9f97c5b45ab,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:07.734016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:07.734709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:07.735292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:07.735902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:07.736463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:07.737014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:07.737587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:07.738136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:07.745065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:07.745923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:07.746280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:07.746614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:07.921249 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce7d64ec-4c01-4b45-a15e-12e0fdd99141 None None] Network dc4d0778-8db2-40e0-aa19-9acf571959fb requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:07.998693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6487e945-69c5-4110-97f6-39ca0356897e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:07.999619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6487e945-69c5-4110-97f6-39ca0356897e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Synchronizing usage tracker for tenant:3fcb9ca7c3d44a988e6caa81ca64980c on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:43:08.008995 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Network 68b58bc0-e327-4b58-a823-23ad945651fe is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:08.029371 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2810e1c3-60b9-4071-a670-180c9a5401a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:08.059289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6487e945-69c5-4110-97f6-39ca0356897e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Unset dirty status for tenant:3fcb9ca7c3d44a988e6caa81ca64980c on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:43:08.060624 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6487e945-69c5-4110-97f6-39ca0356897e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "GET /v2.0/networks?id=25cda344-9ad0-4bd1-9239-c9412279c118 HTTP/1.1" status: 200 len: 761 time: 0.6425862 May 12 15:43:08.067398 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41562) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:08.088927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2810e1c3-60b9-4071-a670-180c9a5401a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7670eece-f9b5-46a0-ad10-4ac29a85fff6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:08.109327 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-9406cb74-d33c-4b14-aed6-14472e5bd801 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'network': {'description': 'd2'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:08.266307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:08.320523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:08.325408 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b3a5c96c-3661-496b-b5d1-e53a15ef1740 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:08.346866 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:08.483998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2810e1c3-60b9-4071-a670-180c9a5401a2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:08.485296 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2810e1c3-60b9-4071-a670-180c9a5401a2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7670eece-f9b5-46a0-ad10-4ac29a85fff6 HTTP/1.1" status: 204 len: 168 time: 2.0588479 May 12 15:43:08.527574 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Pushing event updated for resources: {'Port': ['ID=ba84bb8c-76ac-4c5d-9296-856e9d039f94,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:08.550784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c6b1e51c-a76c-463d-bf30-9a5cb76e20f4 None None] Provisioning for port b3a5c96c-3661-496b-b5d1-e53a15ef1740 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:08.586186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Attempting to bind port ba84bb8c-76ac-4c5d-9296-856e9d039f94 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:08.586608 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Attempting to bind port ba84bb8c-76ac-4c5d-9296-856e9d039f94 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '92cc27a5-54f6-4acf-aea2-6f8363283685', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:08.586981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Attempting to bind port ba84bb8c-76ac-4c5d-9296-856e9d039f94 on network 68b58bc0-e327-4b58-a823-23ad945651fe {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:08.594238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Allocated IP 172.20.0.1 (68b58bc0-e327-4b58-a823-23ad945651fe/f7006e60-2559-4109-b7ec-b5e7c210cde8/ed656bd7-ed7b-4ddb-89f6-ce37354b5f13) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:08.598679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 42, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:08.599095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Checking segment: {'id': '92cc27a5-54f6-4acf-aea2-6f8363283685', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:08.599581 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:08.600044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Bound using segment: {'id': '92cc27a5-54f6-4acf-aea2-6f8363283685', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:08.600740 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Bound port: ba84bb8c-76ac-4c5d-9296-856e9d039f94, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '92cc27a5-54f6-4acf-aea2-6f8363283685', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:08.601123 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:08.663147 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9406cb74-d33c-4b14-aed6-14472e5bd801 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:08.773093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] For port ba84bb8c-76ac-4c5d-9296-856e9d039f94, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:08.794426 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] For port ba84bb8c-76ac-4c5d-9296-856e9d039f94, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ba84bb8c-76ac-4c5d-9296-856e9d039f94,segment=NetworkSegment(92cc27a5-54f6-4acf-aea2-6f8363283685),segment_id=92cc27a5-54f6-4acf-aea2-6f8363283685)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:08.795036 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9406cb74-d33c-4b14-aed6-14472e5bd801 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:08.828491 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:08.919653 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port b3a5c96c-3661-496b-b5d1-e53a15ef1740 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:08.946267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b3a5c96c-3661-496b-b5d1-e53a15ef1740 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:08.946647 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:08.977521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-9406cb74-d33c-4b14-aed6-14472e5bd801 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network 25cda344-9ad0-4bd1-9239-c9412279c118 is not hosted by any dhcp agent {{(pid=88151) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:228}} May 12 15:43:08.983121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9406cb74-d33c-4b14-aed6-14472e5bd801 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:08.983713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9406cb74-d33c-4b14-aed6-14472e5bd801 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:08.986489 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9406cb74-d33c-4b14-aed6-14472e5bd801 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "PUT /v2.0/networks/25cda344-9ad0-4bd1-9239-c9412279c118 HTTP/1.1" status: 200 len: 758 time: 0.8976779 May 12 15:43:08.993130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41580) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:09.003222 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35a09c32-fa3d-4468-b1c8-e5cc6d23e7f7 req-f21e46f6-6168-4f12-ae7c-1abf1c7ce4bd tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.3809648 May 12 15:43:09.238544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e5ccbb-e8ff-4438-aaff-e6c3412b1371 None None] Pushing event updated for resources: {'Port': ['ID=ba84bb8c-76ac-4c5d-9296-856e9d039f94,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:09.274756 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:09.278213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65d7f0d4-7b9a-4938-9ac4-1992e0a03794 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:09.280448 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-65d7f0d4-7b9a-4938-9ac4-1992e0a03794 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "GET /v2.0/networks?id=25cda344-9ad0-4bd1-9239-c9412279c118 HTTP/1.1" status: 200 len: 761 time: 0.2812898 May 12 15:43:09.284878 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9406cb74-d33c-4b14-aed6-14472e5bd801 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Network': ['ID=25cda344-9ad0-4bd1-9239-c9412279c118,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:09.300197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 25cda344-9ad0-4bd1-9239-c9412279c118 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:43:09.301346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41592) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:09.321918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b84d2d0c-c084-4214-abbd-7333ea923872 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1257786250'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:09.352601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b84d2d0c-c084-4214-abbd-7333ea923872 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:09.379362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b84d2d0c-c084-4214-abbd-7333ea923872 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:09.394628 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:09.399656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b84d2d0c-c084-4214-abbd-7333ea923872 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:09.403452 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b84d2d0c-c084-4214-abbd-7333ea923872 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:09.463567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Transition to ACTIVE for port object ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:09.492089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b84d2d0c-c084-4214-abbd-7333ea923872 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 559} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:43:09.522963 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b84d2d0c-c084-4214-abbd-7333ea923872 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:09.523493 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-b84d2d0c-c084-4214-abbd-7333ea923872 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Added segment 16c71dd4-cad8-41ba-8f07-edf39ea6c0b6 of type vlan for network ffb6d613-173f-4cc2-8063-033ddddc447e May 12 15:43:09.560871 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:09.580533 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port b3a5c96c-3661-496b-b5d1-e53a15ef1740, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b3a5c96c-3661-496b-b5d1-e53a15ef1740,segment=NetworkSegment(00733d62-a32c-495d-9cf8-f6c6e58930c1),segment_id=00733d62-a32c-495d-9cf8-f6c6e58930c1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:09.588072 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:09.615412 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b84d2d0c-c084-4214-abbd-7333ea923872 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:09.631962 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:09.706816 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=b3a5c96c-3661-496b-b5d1-e53a15ef1740,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:09.718693 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-644c0e4b-c723-4e03-bd43-698149f9f65c None None] Provisioning complete for port b3a5c96c-3661-496b-b5d1-e53a15ef1740 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:09.719126 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-644c0e4b-c723-4e03-bd43-698149f9f65c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:09.742046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 68b58bc0-e327-4b58-a823-23ad945651fe is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:09.746566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:09.753788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:09.796917 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b84d2d0c-c084-4214-abbd-7333ea923872 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:09.806071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b84d2d0c-c084-4214-abbd-7333ea923872 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:09.807220 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b84d2d0c-c084-4214-abbd-7333ea923872 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:09.854852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=ed656bd7-ed7b-4ddb-89f6-ce37354b5f13,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:09.971313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b84d2d0c-c084-4214-abbd-7333ea923872 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Network': ['ID=ffb6d613-173f-4cc2-8063-033ddddc447e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:09.994396 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:10.004299 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b84d2d0c-c084-4214-abbd-7333ea923872 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.7018654 May 12 15:43:10.013814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41614) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:10.014898 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network ffb6d613-173f-4cc2-8063-033ddddc447e details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:43:10.027114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'subnet': {'network_id': 'ffb6d613-173f-4cc2-8063-033ddddc447e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:10.074801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Router 457f98a8-5d75-4172-bace-cad1c36d6cff is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:43:10.231810 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:10.327444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:10.334873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Usage tracker for resource:subnet and tenant:3fcb9ca7c3d44a988e6caa81ca64980c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:10.340408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:10.354706 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:10.484137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ba84bb8c-76ac-4c5d-9296-856e9d039f94 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:10.595407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ba84bb8c-76ac-4c5d-9296-856e9d039f94 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:10.606096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:10.609877 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:10.613016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b3a5c96c-3661-496b-b5d1-e53a15ef1740 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:10.660613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a07ff26b-9ac6-410c-93bb-a6b4ed42623f req-a532f2ed-fa3e-4bed-9e6f-b889a8d3abe5 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.2888374 May 12 15:43:10.840575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b3a5c96c-3661-496b-b5d1-e53a15ef1740 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:10.841167 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:10.968303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e420f8b-eae7-4953-ab98-c0311dec7aad None None] Network 68b58bc0-e327-4b58-a823-23ad945651fe requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:10.976238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:43:11.136579 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:11.141635 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a1df9ba9-adc9-4611-bf0a-f62337fff017 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 8.2166560 May 12 15:43:11.150097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41714) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:11.154187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Sync routers for ids ['457f98a8-5d75-4172-bace-cad1c36d6cff'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:43:11.413081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:11.419589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:11.494663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-08287218-ca72-4763-bfb9-63eea6b467ca None None] Provisioning for port ba84bb8c-76ac-4c5d-9296-856e9d039f94 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:11.515478 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-08287218-ca72-4763-bfb9-63eea6b467ca None None] Provisioning complete for port ba84bb8c-76ac-4c5d-9296-856e9d039f94 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:11.515848 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-08287218-ca72-4763-bfb9-63eea6b467ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:11.586733 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Routers {'457f98a8-5d75-4172-bace-cad1c36d6cff'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:11.588168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:42:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['457f98a8-5d75-4172-bace-cad1c36d6cff'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:11.593034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=ed656bd7-ed7b-4ddb-89f6-ce37354b5f13,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:11.600162 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:11.614858 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:11.734389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41778) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:11.913625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Subnet': ['ID=b962a435-3d4a-4dc3-80fb-28d1abce7090,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:11.919888 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 68b58bc0-e327-4b58-a823-23ad945651fe is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:11.921524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:11.932711 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0945780e-9cac-4e5c-aad2-d8f68e3de84e req-5fb9e024-da7e-4863-ac1f-f3b544dab811 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1144328 May 12 15:43:11.940660 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Checking segment: {'id': '16c71dd4-cad8-41ba-8f07-edf39ea6c0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'ffb6d613-173f-4cc2-8063-033ddddc447e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:11.941014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network hostable DHCP agents. Network: ffb6d613-173f-4cc2-8063-033ddddc447e, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:43:12.204527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 766c87d1-88c8-4b7e-ba13-f65737b66f8b is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:43:12.432544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Set router 457f98a8-5d75-4172-bace-cad1c36d6cff gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:12.450788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'network': {'name': 'tempest-network-smoke--266244476', 'project_id': 'b641518781114418963451fc3ff58f4d', 'port_security_enabled': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:12.463018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network ffb6d613-173f-4cc2-8063-033ddddc447e is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:43:12.466568 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:12.481648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:43:12.488110 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-41b4d37e-f104-43e1-91ef-ac8725d84519 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.0412321 May 12 15:43:12.495632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41864) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:12.497077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:network and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:12.498651 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Sync routers for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:43:12.505770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:12.515627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, ffb6d613-173f-4cc2-8063-033ddddc447e) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:12.519211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:12.526355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'network': {'name': 'tempest-RoutersTest-780443603'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:12.530761 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:12.533353 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:42:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:12.537667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:12.549973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:network and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:12.553209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:12.556712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-668e58ad-525f-4ee7-a482-c693649ba6bf None None] Network ffb6d613-173f-4cc2-8063-033ddddc447e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:12.567130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:12.575547 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-08287218-ca72-4763-bfb9-63eea6b467ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:12.590678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:12.591603 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:12.613822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:12.617222 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:12.690151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Made reservation on behalf of b641518781114418963451fc3ff58f4d for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:12.696728 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:12.706864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 590} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:43:12.718321 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:12.734765 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:12.746218 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Added segment 7a44f3c7-0903-4bb2-a8d6-58ca1555771d of type vlan for network d213e082-cba2-4b2e-9e03-a43f1c32c29c May 12 15:43:12.757077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3e7c0275-1000-42cd-aa3b-9a2717c1b26c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.7403183 May 12 15:43:12.762562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 41892) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:12.769656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:12.819437 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:12.881119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:12.886468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:12.901050 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:12.910166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:12.910968 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:12.945337 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:12.973646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:12.991498 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.4931662 May 12 15:43:12.995934 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9ed98a88-0e2d-4234-9ecb-8c9ea605dfcc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:12.996482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 41914) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:13.113225 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-08287218-ca72-4763-bfb9-63eea6b467ca None None] For port ba84bb8c-76ac-4c5d-9296-856e9d039f94, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ba84bb8c-76ac-4c5d-9296-856e9d039f94,segment=NetworkSegment(92cc27a5-54f6-4acf-aea2-6f8363283685),segment_id=92cc27a5-54f6-4acf-aea2-6f8363283685)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:13.133463 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-08287218-ca72-4763-bfb9-63eea6b467ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:13.169896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'subnet': {'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:13.331917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75d57239-1324-41e8-bcff-e8d101b13a34 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Network': ['ID=d213e082-cba2-4b2e-9e03-a43f1c32c29c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:13.436231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a01b1bc3-57ba-420a-936b-e0acba8eada8 req-3793fdc1-4f67-4e51-a2e1-a5964f6cac41 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.2742970 May 12 15:43:13.465244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network d213e082-cba2-4b2e-9e03-a43f1c32c29c details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:43:13.508411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08287218-ca72-4763-bfb9-63eea6b467ca None None] Pushing event updated for resources: {'Port': ['ID=ba84bb8c-76ac-4c5d-9296-856e9d039f94,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:13.530570 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:13.681436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:13.694568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:subnet and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:13.697785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:13.703830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:13.715267 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:13.734292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:13.738835 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:13.748771 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7ba86c3c-391f-4083-88d0-cef6ba6fb59e None None] Provisioning complete for port ba84bb8c-76ac-4c5d-9296-856e9d039f94 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:13.749140 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7ba86c3c-391f-4083-88d0-cef6ba6fb59e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:13.810217 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:10Z', 'revision_number': 2, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:11Z', 'revision_number': 2, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:13.814579 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Checking router: 766c87d1-88c8-4b7e-ba13-f65737b66f8b for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:43:13.814965 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Updating router 766c87d1-88c8-4b7e-ba13-f65737b66f8b port ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:43:13.831167 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:13.881318 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:13.994400 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-ffb6d613-173f-4cc2-8063-033ddddc447e', 'network_id': 'ffb6d613-173f-4cc2-8063-033ddddc447e', 'tenant_id': '3fcb9ca7c3d44a988e6caa81ca64980c', 'fixed_ips': [{'subnet_id': 'b962a435-3d4a-4dc3-80fb-28d1abce7090'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:43:13.995335 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:14.158671 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:14.198343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'name': 'tempest-TestAggregatesBasicOps-1565348474-router', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:08Z', 'revision_number': 3, 'project_id': '7b6758bd71d1400f8b6b1d4858918128', 'gw_port': {'id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:e4:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3466, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:06Z', 'updated_at': '2022-05-12T15:43:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:14.210010 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:14.235953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 585} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:43:14.344512 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:14.344852 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Added segment 0e218190-12cd-4c5d-a26e-6453816fe1e4 of type vlan for network 03979098-a904-494a-a852-b458bf7ca658 May 12 15:43:14.369691 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:14.380031 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:14.478801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Subnet': ['ID=e60573af-7581-47c1-bde6-897b9df5c310,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:14.478994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroup': ['ID=df3f3999-6f3d-41d6-a6a3-19c75ef5fb6b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:14.494526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Allocated IP 172.20.0.2 (ffb6d613-173f-4cc2-8063-033ddddc447e/b962a435-3d4a-4dc3-80fb-28d1abce7090/2fc491a4-a66f-41b3-b80a-1d7ff9696c52) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:14.553349 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:14.582477 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:14.614206 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Transition to ACTIVE for port object ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:14.626931 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:14.696955 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7507421d-a637-435c-a25b-6dbc1811b309 req-9e57b7d6-b098-4077-b62c-73ae9e9e935a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.0862021 May 12 15:43:14.799874 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:14.823371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:14.826101 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:14.854319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Checking segment: {'id': '7a44f3c7-0903-4bb2-a8d6-58ca1555771d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:14.854845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network hostable DHCP agents. Network: d213e082-cba2-4b2e-9e03-a43f1c32c29c, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:43:14.857214 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:14.869685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Transition to ACTIVE for port object 2fc491a4-a66f-41b3-b80a-1d7ff9696c52 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:14.880047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network d213e082-cba2-4b2e-9e03-a43f1c32c29c is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:43:14.896662 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Transition to ACTIVE for port object 2fc491a4-a66f-41b3-b80a-1d7ff9696c52 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:14.899884 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be637d1d-fc26-4c53-9fd2-d7695e9b591f None None] Pushing event updated for resources: {'Port': ['ID=ed656bd7-ed7b-4ddb-89f6-ce37354b5f13,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:14.902852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, d213e082-cba2-4b2e-9e03-a43f1c32c29c) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:14.908877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:14.909823 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:14.943967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ba84bb8c-76ac-4c5d-9296-856e9d039f94 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:14.964606 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-30a655f2-6157-4b48-9805-16c3708dc67e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.9647734 May 12 15:43:14.965371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42096) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:15.003844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c010edf-97ce-4b74-8315-2dc987ab66c8 None None] Network d213e082-cba2-4b2e-9e03-a43f1c32c29c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:15.018466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Allocated IP 172.20.0.1 (dc4d0778-8db2-40e0-aa19-9acf571959fb/8048f0a2-0244-4df1-a0f2-76aae45f6709/c7aceb9b-7f66-45af-a7ff-b801f5bcec19) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:15.021368 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 3.2857413 May 12 15:43:15.034895 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:15.043144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Checking router: 457f98a8-5d75-4172-bace-cad1c36d6cff for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:43:15.043708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Updating router 457f98a8-5d75-4172-bace-cad1c36d6cff port b412f7d6-f82f-41a4-a588-b9f97c5b45ab binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:43:15.064622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42106) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:15.132589 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be637d1d-fc26-4c53-9fd2-d7695e9b591f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:15.133486 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be637d1d-fc26-4c53-9fd2-d7695e9b591f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:15.134961 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be637d1d-fc26-4c53-9fd2-d7695e9b591f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:15.135484 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be637d1d-fc26-4c53-9fd2-d7695e9b591f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:15.136321 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be637d1d-fc26-4c53-9fd2-d7695e9b591f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:15.137044 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be637d1d-fc26-4c53-9fd2-d7695e9b591f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:15.137917 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be637d1d-fc26-4c53-9fd2-d7695e9b591f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:15.139553 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be637d1d-fc26-4c53-9fd2-d7695e9b591f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:15.142329 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be637d1d-fc26-4c53-9fd2-d7695e9b591f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:15.142798 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be637d1d-fc26-4c53-9fd2-d7695e9b591f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:15.143253 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be637d1d-fc26-4c53-9fd2-d7695e9b591f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:15.144031 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be637d1d-fc26-4c53-9fd2-d7695e9b591f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:43:15.157525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'admin_state_up': True, 'project_id': 'b641518781114418963451fc3ff58f4d', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:15.202786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-217187da-bfab-4a02-9d8c-c6dbd1c8cf8a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Network': ['ID=03979098-a904-494a-a852-b458bf7ca658,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:15.211229 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Attempting to bind port ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:15.211381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:15.211636 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Attempting to bind port ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '92cc27a5-54f6-4acf-aea2-6f8363283685', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:15.212165 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Attempting to bind port ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 on network 68b58bc0-e327-4b58-a823-23ad945651fe {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:15.224636 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 42, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:15.225190 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Checking segment: {'id': '92cc27a5-54f6-4acf-aea2-6f8363283685', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:15.226012 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:15.227172 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Bound using segment: {'id': '92cc27a5-54f6-4acf-aea2-6f8363283685', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:15.228518 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Bound port: ed656bd7-ed7b-4ddb-89f6-ce37354b5f13, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '92cc27a5-54f6-4acf-aea2-6f8363283685', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 584, 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:15.230629 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:15.269095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:router and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:15.272735 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:15.284324 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:15.287931 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:15.426079 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] For port ed656bd7-ed7b-4ddb-89f6-ce37354b5f13, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:15.429841 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] For port ed656bd7-ed7b-4ddb-89f6-ce37354b5f13, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ed656bd7-ed7b-4ddb-89f6-ce37354b5f13,segment=NetworkSegment(92cc27a5-54f6-4acf-aea2-6f8363283685),segment_id=92cc27a5-54f6-4acf-aea2-6f8363283685)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:15.442343 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:15.459326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:15.544284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Subnet': ['ID=b962a435-3d4a-4dc3-80fb-28d1abce7090,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:15.587337 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:15.611853 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:15.612735 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:42:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:15.621767 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:15.622947 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:15.698778 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be637d1d-fc26-4c53-9fd2-d7695e9b591f None None] Pushing event updated for resources: {'Port': ['ID=ed656bd7-ed7b-4ddb-89f6-ce37354b5f13,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:15.717446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 03979098-a904-494a-a852-b458bf7ca658 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:43:15.729483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ffb6d613-173f-4cc2-8063-033ddddc447e']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:15.837175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7ba86c3c-391f-4083-88d0-cef6ba6fb59e None None] Provisioning for port ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:15.922116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18b620c6-7e64-47ae-b526-c9c263785422 req-c65e7b8e-c4c1-421d-9015-220dbc3fa95a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1345408 May 12 15:43:15.939500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '16c71dd4-cad8-41ba-8f07-edf39ea6c0b6') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:15.948709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '16c71dd4-cad8-41ba-8f07-edf39ea6c0b6') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:15.986179 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:15.987759 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:16.023206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Network ffb6d613-173f-4cc2-8063-033ddddc447e is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:16.073969 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:16.115467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:16.128499 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:16.265953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:16.279029 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:16.285620 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:16.286913 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6b4778bc-27de-476a-a712-8dd838e36969 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:16.316424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Pushing event updated for resources: {'Port': ['ID=2fc491a4-a66f-41b3-b80a-1d7ff9696c52,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:16.318995 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:16.563134 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:10Z', 'revision_number': 2, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:15Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:16.570356 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-baece535-279b-46f8-8bbd-a40b3ad011f8 None None] The sync data for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 is: [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:10Z', 'revision_number': 2, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:15Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:43:16.614808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-d213e082-cba2-4b2e-9e03-a43f1c32c29c', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:43:16.615774 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:16.638715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 559 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:43:16.641167 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: timer() May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:43:16.694914 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:43:16.700862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Attempting to bind port 2fc491a4-a66f-41b3-b80a-1d7ff9696c52 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:16.701353 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Attempting to bind port 2fc491a4-a66f-41b3-b80a-1d7ff9696c52 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '16c71dd4-cad8-41ba-8f07-edf39ea6c0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'ffb6d613-173f-4cc2-8063-033ddddc447e'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:16.701842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Attempting to bind port 2fc491a4-a66f-41b3-b80a-1d7ff9696c52 on network ffb6d613-173f-4cc2-8063-033ddddc447e {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:16.728572 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:16.744414 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ba84bb8c-76ac-4c5d-9296-856e9d039f94 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:16.744929 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:16.772908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:16.773750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Checking segment: {'id': '16c71dd4-cad8-41ba-8f07-edf39ea6c0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'ffb6d613-173f-4cc2-8063-033ddddc447e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:16.774373 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:16.774975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Bound using segment: {'id': '16c71dd4-cad8-41ba-8f07-edf39ea6c0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'ffb6d613-173f-4cc2-8063-033ddddc447e'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:16.775672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Bound port: 2fc491a4-a66f-41b3-b80a-1d7ff9696c52, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '16c71dd4-cad8-41ba-8f07-edf39ea6c0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': 'ffb6d613-173f-4cc2-8063-033ddddc447e'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:16.776288 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:16.869219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Allocated IP 172.21.0.1 (d213e082-cba2-4b2e-9e03-a43f1c32c29c/e60573af-7581-47c1-bde6-897b9df5c310/71e8fce5-504b-42e3-96ac-f1d3aa801337) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:17.171119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Transition to ACTIVE for port object c7aceb9b-7f66-45af-a7ff-b801f5bcec19 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:17.248560 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:17.296997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Transition to ACTIVE for port object 71e8fce5-504b-42e3-96ac-f1d3aa801337 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:17.349431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1cadbf2b-b754-4c70-bf15-34cb1e594c81 req-34f0e202-ad7b-45ba-8cfc-33342a01d8a4 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.2873213 May 12 15:43:17.370306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:17.371736 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:17.373748 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:17.391621 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Transition to ACTIVE for port object b412f7d6-f82f-41a4-a588-b9f97c5b45ab will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:17.403531 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') May 12 15:43:17.403531 n-d-841483-1 neutron-server[88152]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] May 12 15:43:17.403531 n-d-841483-1 neutron-server[88152]: [parameters: {'id': 'ffb6d613-173f-4cc2-8063-033ddddc447e'}] May 12 15:43:17.403531 n-d-841483-1 neutron-server[88152]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:43:17.405557 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:43:17.461088 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:17.497600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network d213e082-cba2-4b2e-9e03-a43f1c32c29c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:17.511864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:17.523077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:17.603479 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:17.649773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=71e8fce5-504b-42e3-96ac-f1d3aa801337,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:17.655806 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:17.721938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Attempting to bind port b412f7d6-f82f-41a4-a588-b9f97c5b45ab on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:17.722547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Attempting to bind port b412f7d6-f82f-41a4-a588-b9f97c5b45ab by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:17.723130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Attempting to bind port b412f7d6-f82f-41a4-a588-b9f97c5b45ab on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:17.779822 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a390fc3-2407-46ce-991f-12705216f344 None None] Pushing event updated for resources: {'Port': ['ID=b412f7d6-f82f-41a4-a588-b9f97c5b45ab,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:17.784560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:17.785282 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:17.785953 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:17.786626 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:17.787320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Bound port: b412f7d6-f82f-41a4-a588-b9f97c5b45ab, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:17.787901 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:17.840503 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] For port 2fc491a4-a66f-41b3-b80a-1d7ff9696c52, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:17.852591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] For port 2fc491a4-a66f-41b3-b80a-1d7ff9696c52, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2fc491a4-a66f-41b3-b80a-1d7ff9696c52,segment=NetworkSegment(16c71dd4-cad8-41ba-8f07-edf39ea6c0b6),segment_id=16c71dd4-cad8-41ba-8f07-edf39ea6c0b6)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:17.856712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Network dc4d0778-8db2-40e0-aa19-9acf571959fb is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:17.856903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Allocated IP 172.21.0.2 (d213e082-cba2-4b2e-9e03-a43f1c32c29c/e60573af-7581-47c1-bde6-897b9df5c310/2d578718-1ffe-4a5e-a184-b9aac0d60c36) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:17.869996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:17.874469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:17.910242 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:17.916740 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:17.995122 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:18.002120 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:18.037120 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Pushing event updated for resources: {'Port': ['ID=c7aceb9b-7f66-45af-a7ff-b801f5bcec19,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:18.116942 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:18.146394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Deleting port 2fc491a4-a66f-41b3-b80a-1d7ff9696c52 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:43:18.146789 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:18.233941 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] For port b412f7d6-f82f-41a4-a588-b9f97c5b45ab, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:18.245277 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] For port b412f7d6-f82f-41a4-a588-b9f97c5b45ab, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b412f7d6-f82f-41a4-a588-b9f97c5b45ab,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:18.249953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:18.364518 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:18.519159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17b1b799-5a2c-407b-8cb2-cdfbc6382109 None None] Pushing event updated for resources: {'Port': ['ID=2fc491a4-a66f-41b3-b80a-1d7ff9696c52,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:18.535136 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6cedb637-fa37-4211-9e9d-b94f4b188474 req-fd166de7-ad2f-4b70-988d-c3b9c680844e tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.0996835 May 12 15:43:18.792465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a390fc3-2407-46ce-991f-12705216f344 None None] Pushing event updated for resources: {'Port': ['ID=b412f7d6-f82f-41a4-a588-b9f97c5b45ab,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:18.807645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-508c7ae9-7ac1-4cd3-948f-f924cdd5d074 None None] Provisioning for port c7aceb9b-7f66-45af-a7ff-b801f5bcec19 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:18.819359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c3af4f1-deb4-4131-adfc-e14916a74a97 None None] Network ffb6d613-173f-4cc2-8063-033ddddc447e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:19.026339 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-508c7ae9-7ac1-4cd3-948f-f924cdd5d074 None None] Provisioning complete for port c7aceb9b-7f66-45af-a7ff-b801f5bcec19 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:19.026746 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-508c7ae9-7ac1-4cd3-948f-f924cdd5d074 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:19.096198 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:19.111697 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:19.137852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] For port 2fc491a4-a66f-41b3-b80a-1d7ff9696c52, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2fc491a4-a66f-41b3-b80a-1d7ff9696c52,segment=NetworkSegment(16c71dd4-cad8-41ba-8f07-edf39ea6c0b6),segment_id=16c71dd4-cad8-41ba-8f07-edf39ea6c0b6)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:19.141499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:19.148714 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:19.161033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:19.161418 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:19.169489 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:19.278867 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Routers {'457f98a8-5d75-4172-bace-cad1c36d6cff'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:19.280057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:16Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['457f98a8-5d75-4172-bace-cad1c36d6cff'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:19.287939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:19.375157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:19.444377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-508c7ae9-7ac1-4cd3-948f-f924cdd5d074 None None] Port c7aceb9b-7f66-45af-a7ff-b801f5bcec19 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:43:19.455578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=71e8fce5-504b-42e3-96ac-f1d3aa801337,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:19.520692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network d213e082-cba2-4b2e-9e03-a43f1c32c29c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:19.522046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:19.539848 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:19.603011 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Transition to ACTIVE for port object 2d578718-1ffe-4a5e-a184-b9aac0d60c36 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:19.757642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 766c87d1-88c8-4b7e-ba13-f65737b66f8b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:43:19.764614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Transition to ACTIVE for port object 2d578718-1ffe-4a5e-a184-b9aac0d60c36 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:19.792322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] Set router 457f98a8-5d75-4172-bace-cad1c36d6cff gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:19.839318 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:19.843167 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:20.021239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Network d213e082-cba2-4b2e-9e03-a43f1c32c29c is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:20.025303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:43:20.064864 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-63fa2c82-a4df-4905-a533-63bf04198b74 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.0949218 May 12 15:43:20.065235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42188) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:20.082757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'network': {'name': 'tempest-RoutersTest-326070895'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:20.088249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:20.098312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Sync routers for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:43:20.099485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:network and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:20.104606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:20.108622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Calling delete_port for 2fc491a4-a66f-41b3-b80a-1d7ff9696c52 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:43:20.110029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:20.118013 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:20.126112 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:20.143601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:20.154733 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:20.155086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Pushing event updated for resources: {'Port': ['ID=2d578718-1ffe-4a5e-a184-b9aac0d60c36,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:20.162200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ed656bd7-ed7b-4ddb-89f6-ce37354b5f13, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ed656bd7-ed7b-4ddb-89f6-ce37354b5f13,segment=NetworkSegment(92cc27a5-54f6-4acf-aea2-6f8363283685),segment_id=92cc27a5-54f6-4acf-aea2-6f8363283685)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:20.166627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42194) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:20.252090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:20.252867 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:16Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:20.263579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 565} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:43:20.284867 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:20.285358 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Added segment 170e329c-dde1-448c-88ad-452fb2700328 of type vlan for network 3f83009e-15c3-4297-93d4-b28b3de6e6a0 May 12 15:43:20.299325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf658ebe-47b3-4fc0-88c3-763211179278 req-9960be43-65ad-4fca-a5b5-957196fce87d tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.0733740 May 12 15:43:20.301888 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:20.305229 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:20.341776 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:20.409622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:20.415214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:20.421709 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:20.434822 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:20.442319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Port': ['ID=2fc491a4-a66f-41b3-b80a-1d7ff9696c52,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:20.537242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No DVR routers for this DVR port 2fc491a4-a66f-41b3-b80a-1d7ff9696c52 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:43:20.554322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Attempting to bind port 2d578718-1ffe-4a5e-a184-b9aac0d60c36 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:20.554693 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Attempting to bind port 2d578718-1ffe-4a5e-a184-b9aac0d60c36 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '7a44f3c7-0903-4bb2-a8d6-58ca1555771d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:20.555053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Attempting to bind port 2d578718-1ffe-4a5e-a184-b9aac0d60c36 on network d213e082-cba2-4b2e-9e03-a43f1c32c29c {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:20.575464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:20.666932 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b78bea1-1c4e-453d-94f5-f9aed572b5c5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:20.686926 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.6181931 May 12 15:43:20.689710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5b78bea1-1c4e-453d-94f5-f9aed572b5c5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:20.693842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5b78bea1-1c4e-453d-94f5-f9aed572b5c5 admin admin] Usage tracker for resource:security_group_rule and tenant:ce28f794d9bb4e27b21085698ebd5148 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:20.696816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5b78bea1-1c4e-453d-94f5-f9aed572b5c5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:20.702643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5b78bea1-1c4e-453d-94f5-f9aed572b5c5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:20.791702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Allocated IP 172.25.8.197 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/539a80f2-ef5d-4365-8999-6a2e51b5afc6) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:20.794482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b78bea1-1c4e-453d-94f5-f9aed572b5c5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:20.795755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca92d877-bac6-471a-a1ed-f29d719dff23 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Network': ['ID=3f83009e-15c3-4297-93d4-b28b3de6e6a0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:20.798652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42200) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:20.805364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'subnet': {'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'cidr': '172.22.0.0/28', 'ip_version': 4, 'gateway_ip': '172.22.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:20.820438 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b78bea1-1c4e-453d-94f5-f9aed572b5c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:20.898031 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:20.898597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Checking segment: {'id': '7a44f3c7-0903-4bb2-a8d6-58ca1555771d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:20.899022 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:20.899510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Bound using segment: {'id': '7a44f3c7-0903-4bb2-a8d6-58ca1555771d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:20.900104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Bound port: 2d578718-1ffe-4a5e-a184-b9aac0d60c36, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7a44f3c7-0903-4bb2-a8d6-58ca1555771d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:20.900579 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:20.920080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 3f83009e-15c3-4297-93d4-b28b3de6e6a0 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:43:20.955057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ed656bd7-ed7b-4ddb-89f6-ce37354b5f13,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:20.993256 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:21.070194 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:21.099418 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5b78bea1-1c4e-453d-94f5-f9aed572b5c5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ce28f794d9bb4e27b21085698ebd5148&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9296739 May 12 15:43:21.102894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42206) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:21.106876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b78bea1-1c4e-453d-94f5-f9aed572b5c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=65c699c4-2a3d-4f06-b370-98723fcab4c4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:21.130719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:21.143344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:subnet and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:21.146700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:21.157830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:21.193992 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:21.197551 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:21.438409 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd07dbf3-fafb-43c4-b50c-2fcbfbd2b729 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:21.449369 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:21.492438 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:21.494335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] For port 2d578718-1ffe-4a5e-a184-b9aac0d60c36, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:21.521278 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:21.522370 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd07dbf3-fafb-43c4-b50c-2fcbfbd2b729 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:21.559167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] For port 2d578718-1ffe-4a5e-a184-b9aac0d60c36, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2d578718-1ffe-4a5e-a184-b9aac0d60c36,segment=NetworkSegment(7a44f3c7-0903-4bb2-a8d6-58ca1555771d),segment_id=7a44f3c7-0903-4bb2-a8d6-58ca1555771d)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:21.571778 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:21.584191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Subnet': ['ID=b434ad3a-39aa-4d78-9730-83acdb7ad343,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:21.591286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Checking segment: {'id': '170e329c-dde1-448c-88ad-452fb2700328', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:21.591580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network hostable DHCP agents. Network: 3f83009e-15c3-4297-93d4-b28b3de6e6a0, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:43:21.616482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 3f83009e-15c3-4297-93d4-b28b3de6e6a0 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:43:21.631378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 3f83009e-15c3-4297-93d4-b28b3de6e6a0) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:21.637777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:21.648728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:21.649317 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:21.654117 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd07dbf3-fafb-43c4-b50c-2fcbfbd2b729 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:21.655206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-900191d3-ba52-49a8-a505-89d1d5309f13 None None] Network 3f83009e-15c3-4297-93d4-b28b3de6e6a0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:21.659310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:21.668224 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:21.691351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd07dbf3-fafb-43c4-b50c-2fcbfbd2b729 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=65c699c4-2a3d-4f06-b370-98723fcab4c4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:21.697002 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a894f503-07e5-454e-9e26-e04fd0129a99 req-507ddc9f-2b07-4ca1-9ffb-413fe9fd395a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1836245 May 12 15:43:21.705948 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd07dbf3-fafb-43c4-b50c-2fcbfbd2b729 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:21.709643 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dd07dbf3-fafb-43c4-b50c-2fcbfbd2b729 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/65c699c4-2a3d-4f06-b370-98723fcab4c4 HTTP/1.1" status: 204 len: 168 time: 0.6033719 May 12 15:43:21.713722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:21.722449 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5f30229e-e7b5-47f7-97b3-df7e10dbc079 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.9189520 May 12 15:43:21.722783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42220) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:21.746856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=539a80f2-ef5d-4365-8999-6a2e51b5afc6,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:21.927104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ffb6d613-173f-4cc2-8063-033ddddc447e']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:21.951172 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:21.969029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'name': 'tempest-TestAggregatesBasicOps-1565348474-router', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:19Z', 'revision_number': 4, 'project_id': '7b6758bd71d1400f8b6b1d4858918128', 'gw_port': {'id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:e4:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3466, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:06Z', 'updated_at': '2022-05-12T15:43:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c7aceb9b-7f66-45af-a7ff-b801f5bcec19', 'name': '', 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'mac_address': 'fa:16:3e:25:d2:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'device_owner': 'network:router_interface', 'standard_attr_id': 3483, 'fixed_ips': [{'subnet_id': '8048f0a2-0244-4df1-a0f2-76aae45f6709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:14Z', 'updated_at': '2022-05-12T15:43:15Z', 'revision_number': 1, 'project_id': '7b6758bd71d1400f8b6b1d4858918128', 'subnets': [{'id': '8048f0a2-0244-4df1-a0f2-76aae45f6709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:21.990137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '16c71dd4-cad8-41ba-8f07-edf39ea6c0b6') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:21.990768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '16c71dd4-cad8-41ba-8f07-edf39ea6c0b6') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:22.085228 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:22.092655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Pushing event updated for resources: {'Port': ['ID=c7aceb9b-7f66-45af-a7ff-b801f5bcec19,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:22.109078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f59b7792-7067-4129-b33b-9299d90f43ee None None] The sync data for ids ['457f98a8-5d75-4172-bace-cad1c36d6cff'] in n-d-841483-1 is: [{'id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'name': 'tempest-TestAggregatesBasicOps-1565348474-router', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:19Z', 'revision_number': 4, 'project_id': '7b6758bd71d1400f8b6b1d4858918128', 'gw_port': {'id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:e4:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3466, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:06Z', 'updated_at': '2022-05-12T15:43:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c7aceb9b-7f66-45af-a7ff-b801f5bcec19', 'name': '', 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'mac_address': 'fa:16:3e:25:d2:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'device_owner': 'network:router_interface', 'standard_attr_id': 3483, 'fixed_ips': [{'subnet_id': '8048f0a2-0244-4df1-a0f2-76aae45f6709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:14Z', 'updated_at': '2022-05-12T15:43:15Z', 'revision_number': 1, 'project_id': '7b6758bd71d1400f8b6b1d4858918128', 'subnets': [{'id': '8048f0a2-0244-4df1-a0f2-76aae45f6709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:43:22.225956 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b9e8208-9487-46df-9b24-deefc493a029 None None] Pushing event updated for resources: {'Port': ['ID=2d578718-1ffe-4a5e-a184-b9aac0d60c36,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:22.273887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:17Z', 'revision_number': 3, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:18Z', 'revision_number': 2, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:22.301283 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Checking router: 766c87d1-88c8-4b7e-ba13-f65737b66f8b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:43:22.301673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Updating router 766c87d1-88c8-4b7e-ba13-f65737b66f8b port 71e8fce5-504b-42e3-96ac-f1d3aa801337 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:43:22.419157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:22.466445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 559 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:43:22.466752 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: timer() May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:43:22.514138 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:43:22.671558 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:22.716685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:23.097473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Network dc4d0778-8db2-40e0-aa19-9acf571959fb is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:23.109207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:23.127582 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d43284e-1254-4e4e-94eb-157021085431 req-729c1797-9c54-477f-ab02-da5c8a602db3 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.2775218 May 12 15:43:23.161754 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:23.166668 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:23.224341 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:23.480118 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:43:23.480884 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:23.741555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/ffb6d613-173f-4cc2-8063-033ddddc447e HTTP/1.1" status: 204 len: 168 time: 10.9773653 May 12 15:43:23.745870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42266) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:23.781423 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03f2ed12-2e01-4c09-855c-dbbb864521c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Network': ['ID=ffb6d613-173f-4cc2-8063-033ddddc447e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:23.893897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e8117ebb-179f-45fc-8a27-d15710a18896 None None] Provisioning complete for port c7aceb9b-7f66-45af-a7ff-b801f5bcec19 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:23.898126 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e8117ebb-179f-45fc-8a27-d15710a18896 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:23.956338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Allocated IP 172.22.0.1 (3f83009e-15c3-4297-93d4-b28b3de6e6a0/b434ad3a-39aa-4d78-9730-83acdb7ad343/144476e8-3d2f-40e1-8e1d-88435e1c3389) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:24.031301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e8117ebb-179f-45fc-8a27-d15710a18896 None None] Port c7aceb9b-7f66-45af-a7ff-b801f5bcec19 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:43:24.033216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9680a64-fece-4ac5-a4c7-e8daa2050ec2 None None] Network d213e082-cba2-4b2e-9e03-a43f1c32c29c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:24.163457 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-1425334e-738c-4401-8407-457c8d0b15d7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] GET failed (client error): The resource could not be found. May 12 15:43:24.166364 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1425334e-738c-4401-8407-457c8d0b15d7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Synchronizing usage tracker for tenant:3fcb9ca7c3d44a988e6caa81ca64980c on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:43:24.312640 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:24.354934 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Transition to ACTIVE for port object 71e8fce5-504b-42e3-96ac-f1d3aa801337 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:24.396896 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:24.412522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1425334e-738c-4401-8407-457c8d0b15d7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Unset dirty status for tenant:3fcb9ca7c3d44a988e6caa81ca64980c on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:43:24.416654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42278) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:24.430192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1425334e-738c-4401-8407-457c8d0b15d7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "GET /v2.0/subnets/b962a435-3d4a-4dc3-80fb-28d1abce7090 HTTP/1.1" status: 404 len: 337 time: 0.5026767 May 12 15:43:24.481604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:24.500143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Transition to ACTIVE for port object 144476e8-3d2f-40e1-8e1d-88435e1c3389 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:24.543573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Router 457f98a8-5d75-4172-bace-cad1c36d6cff has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:43:24.546502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff77194d-fa89-4771-8af1-f2b21e212e41 req-76214d61-bbf3-455c-9875-223f0b7e4f2a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.2808807 May 12 15:43:24.551859 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-98c470a0-6f7d-4db5-9729-f161421c205e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:24.553273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-98c470a0-6f7d-4db5-9729-f161421c205e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:24.553936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f26dcbb3-f528-49f8-aa90-4b49d385038c None None] Provisioning for port 2d578718-1ffe-4a5e-a184-b9aac0d60c36 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:24.571794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42282) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:24.580502 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-98c470a0-6f7d-4db5-9729-f161421c205e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/ffb6d613-173f-4cc2-8063-033ddddc447e HTTP/1.1" status: 404 len: 339 time: 0.1625636 May 12 15:43:24.582049 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:24.679287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Allocated IP 172.22.0.2 (3f83009e-15c3-4297-93d4-b28b3de6e6a0/b434ad3a-39aa-4d78-9730-83acdb7ad343/409a78e5-4573-4d33-b4da-83dcea90e530) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:24.699756 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:24.700123 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:24.755948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 3f83009e-15c3-4297-93d4-b28b3de6e6a0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:24.757281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=144476e8-3d2f-40e1-8e1d-88435e1c3389,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:24.760538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:24.763217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:24.846200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:24.917197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f853b0c7-f602-4d06-b62f-fc5bf5ebc4d0 None None] Pushing event updated for resources: {'Port': ['ID=71e8fce5-504b-42e3-96ac-f1d3aa801337,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:25.016572 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:25.169781 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:25.321322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:43:25.348632 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2cbe3520-7c8c-46f5-bc23-7272e2e80ca1 admin admin] 10.222.0.82 "PUT /v2.0/routers/457f98a8-5d75-4172-bace-cad1c36d6cff/add_router_interface HTTP/1.1" status: 200 len: 503 time: 14.1764362 May 12 15:43:25.419476 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7852e78c-7895-474f-8a93-d2ee5e14cd04 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:25.420169 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7852e78c-7895-474f-8a93-d2ee5e14cd04 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Synchronizing usage tracker for tenant:3fcb9ca7c3d44a988e6caa81ca64980c on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:43:25.484579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7852e78c-7895-474f-8a93-d2ee5e14cd04 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Unset dirty status for tenant:3fcb9ca7c3d44a988e6caa81ca64980c on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:43:25.486836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7852e78c-7895-474f-8a93-d2ee5e14cd04 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.9006722 May 12 15:43:25.489321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42300) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:25.654009 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:25.667272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Transition to ACTIVE for port object 409a78e5-4573-4d33-b4da-83dcea90e530 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:25.705430 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f4eb5125-8e6e-42b3-bee9-79b598cb489d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 207 time: 0.2141099 May 12 15:43:25.711377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Transition to ACTIVE for port object 409a78e5-4573-4d33-b4da-83dcea90e530 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:25.727912 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42308) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:25.732927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Attempting to bind port 71e8fce5-504b-42e3-96ac-f1d3aa801337 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:25.733576 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Attempting to bind port 71e8fce5-504b-42e3-96ac-f1d3aa801337 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '7a44f3c7-0903-4bb2-a8d6-58ca1555771d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:25.736734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Attempting to bind port 71e8fce5-504b-42e3-96ac-f1d3aa801337 on network d213e082-cba2-4b2e-9e03-a43f1c32c29c {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:25.837604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:25.838209 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Checking segment: {'id': '7a44f3c7-0903-4bb2-a8d6-58ca1555771d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:25.838720 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:25.839530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Bound using segment: {'id': '7a44f3c7-0903-4bb2-a8d6-58ca1555771d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:25.841060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Bound port: 71e8fce5-504b-42e3-96ac-f1d3aa801337, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7a44f3c7-0903-4bb2-a8d6-58ca1555771d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 590, 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:25.843881 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:25.912422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2d578718-1ffe-4a5e-a184-b9aac0d60c36 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:25.945430 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:43:25.981294 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:26.054863 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Sync routers for ids ['457f98a8-5d75-4172-bace-cad1c36d6cff'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:43:26.092077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:26.103613 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Routers {'457f98a8-5d75-4172-bace-cad1c36d6cff'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:26.104377 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:16Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['457f98a8-5d75-4172-bace-cad1c36d6cff'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:26.110278 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:26.305343 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-082688d8-b741-4cf4-843b-26e109bb326c req-1d774427-9ca2-4934-9a3d-7cf7d83ad80d tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1820750 May 12 15:43:26.361409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] For port 71e8fce5-504b-42e3-96ac-f1d3aa801337, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:26.365989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] For port 71e8fce5-504b-42e3-96ac-f1d3aa801337, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=71e8fce5-504b-42e3-96ac-f1d3aa801337,segment=NetworkSegment(7a44f3c7-0903-4bb2-a8d6-58ca1555771d),segment_id=7a44f3c7-0903-4bb2-a8d6-58ca1555771d)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:26.388859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Network 3f83009e-15c3-4297-93d4-b28b3de6e6a0 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:26.409785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:26.422508 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:26.431704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:26.464577 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5908955-7c51-4fba-8a19-b277e59b62e3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:26.472517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5908955-7c51-4fba-8a19-b277e59b62e3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:26.475606 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Set router 457f98a8-5d75-4172-bace-cad1c36d6cff gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:26.479860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5908955-7c51-4fba-8a19-b277e59b62e3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:26.488758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5908955-7c51-4fba-8a19-b277e59b62e3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:26.489704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f5908955-7c51-4fba-8a19-b277e59b62e3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Synchronizing usage tracker for tenant:3fcb9ca7c3d44a988e6caa81ca64980c on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:43:26.521188 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:26.521874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f5908955-7c51-4fba-8a19-b277e59b62e3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Unset dirty status for tenant:3fcb9ca7c3d44a988e6caa81ca64980c on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:43:26.523078 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f5908955-7c51-4fba-8a19-b277e59b62e3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2487 time: 0.7906494 May 12 15:43:26.526536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=144476e8-3d2f-40e1-8e1d-88435e1c3389,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:26.531386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42328) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:26.535807 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:26.609941 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Pushing event updated for resources: {'Port': ['ID=409a78e5-4573-4d33-b4da-83dcea90e530,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:26.705333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42334) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:26.712656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Request body: {'network': {'name': 'tempest-TestAggregatesBasicOps-454973996-network', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:26.722316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network 3f83009e-15c3-4297-93d4-b28b3de6e6a0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:26.723679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:26.726300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:26.736567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Usage tracker for resource:network and tenant:b5b03ecc6a264c70aba77f212d9d4757 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:26.740427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:26.804570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:26.848173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Attempting to bind port 409a78e5-4573-4d33-b4da-83dcea90e530 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:26.848648 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Attempting to bind port 409a78e5-4573-4d33-b4da-83dcea90e530 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '170e329c-dde1-448c-88ad-452fb2700328', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:26.848886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Attempting to bind port 409a78e5-4573-4d33-b4da-83dcea90e530 on network 3f83009e-15c3-4297-93d4-b28b3de6e6a0 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:26.856513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 2d578718-1ffe-4a5e-a184-b9aac0d60c36 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:26.864529 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:26.865161 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:16Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:26.868096 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f39f3987-43b3-485d-a5b6-e8d496a5bbb1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 576 time: 0.2657816 May 12 15:43:26.878345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42340) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:26.934868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:26.935262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Checking segment: {'id': '170e329c-dde1-448c-88ad-452fb2700328', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:26.935673 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:26.936063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Bound using segment: {'id': '170e329c-dde1-448c-88ad-452fb2700328', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:26.936552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Bound port: 409a78e5-4573-4d33-b4da-83dcea90e530, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '170e329c-dde1-448c-88ad-452fb2700328', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:26.936927 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:26.975807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Made reservation on behalf of b5b03ecc6a264c70aba77f212d9d4757 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:26.979584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:26.997792 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:27.045904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:27.049047 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'name': 'tempest-TestAggregatesBasicOps-1565348474-router', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:19Z', 'revision_number': 4, 'project_id': '7b6758bd71d1400f8b6b1d4858918128', 'gw_port': {'id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:e4:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3466, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:06Z', 'updated_at': '2022-05-12T15:43:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c7aceb9b-7f66-45af-a7ff-b801f5bcec19', 'name': '', 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'mac_address': 'fa:16:3e:25:d2:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'device_owner': 'network:router_interface', 'standard_attr_id': 3483, 'fixed_ips': [{'subnet_id': '8048f0a2-0244-4df1-a0f2-76aae45f6709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:14Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 2, 'project_id': '7b6758bd71d1400f8b6b1d4858918128', 'subnets': [{'id': '8048f0a2-0244-4df1-a0f2-76aae45f6709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:27.054495 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Checking router: 457f98a8-5d75-4172-bace-cad1c36d6cff for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:43:27.054838 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Updating router 457f98a8-5d75-4172-bace-cad1c36d6cff port c7aceb9b-7f66-45af-a7ff-b801f5bcec19 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:43:27.062212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Usage tracker for resource:security_group_rule and tenant:b5b03ecc6a264c70aba77f212d9d4757 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:27.073331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:27.094208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:27.106090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 766c87d1-88c8-4b7e-ba13-f65737b66f8b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:43:27.155707 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:27.179877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2d578718-1ffe-4a5e-a184-b9aac0d60c36 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:27.180248 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:27.235926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88482012-802f-497a-b18a-4eb566486c5d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:27.237646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88482012-802f-497a-b18a-4eb566486c5d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:27.239155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-88482012-802f-497a-b18a-4eb566486c5d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1446 time: 0.3595972 May 12 15:43:27.262450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42350) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:27.286448 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:27.395589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:27.420569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98d44947-a54c-44b3-836a-a282ba12f240 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:27.439930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98d44947-a54c-44b3-836a-a282ba12f240 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:27.441650 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-98d44947-a54c-44b3-836a-a282ba12f240 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 403 time: 0.1779392 May 12 15:43:27.504177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42360) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:27.528096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Router 943c296a-7f18-4231-8088-35f5348abd2b is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:43:27.645585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f853b0c7-f602-4d06-b62f-fc5bf5ebc4d0 None None] Pushing event updated for resources: {'Port': ['ID=71e8fce5-504b-42e3-96ac-f1d3aa801337,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:27.746699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7b185b2-f9e9-41a0-8350-9cfeed4c8ea7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:27.748391 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b7b185b2-f9e9-41a0-8350-9cfeed4c8ea7 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "GET /v2.0/networks/06314778-8dc3-40db-a6f5-f8126f80fd1e HTTP/1.1" status: 200 len: 800 time: 0.2423022 May 12 15:43:27.753132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42366) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:27.843837 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] For port 409a78e5-4573-4d33-b4da-83dcea90e530, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:27.849449 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] For port 409a78e5-4573-4d33-b4da-83dcea90e530, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=409a78e5-4573-4d33-b4da-83dcea90e530,segment=NetworkSegment(170e329c-dde1-448c-88ad-452fb2700328),segment_id=170e329c-dde1-448c-88ad-452fb2700328)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:27.861089 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:27.932766 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40b14be9-1d9d-4c6f-b85b-4889cb039ad6 req-b4d718ea-e001-4d10-a2a6-486d35624dba tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.4890065 May 12 15:43:27.946896 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b05cab38-a643-4f8c-b7e4-0c5f6dd68972 None None] Provisioning for port 71e8fce5-504b-42e3-96ac-f1d3aa801337 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:27.987190 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:28.154953 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:28.180138 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1197763f-de69-4857-addd-f0a4ccf978e2 None None] Pushing event updated for resources: {'Port': ['ID=409a78e5-4573-4d33-b4da-83dcea90e530,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:28.187351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:43:28.187534 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Transition to ACTIVE for port object c7aceb9b-7f66-45af-a7ff-b801f5bcec19 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:28.216226 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:28.242701 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:28.247460 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b4679174-88df-4106-9ae0-d48464861de9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 13.1626968 May 12 15:43:28.248941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42378) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:28.256080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Sync routers for ids ['943c296a-7f18-4231-8088-35f5348abd2b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:43:28.463296 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42386) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:28.464301 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3119cef5-cb38-4c98-9c18-01a1a9e9ef46 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "GET /v2.0/networks/06314778-8dc3-40db-a6f5-f8126f80fd1e?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 316 time: 0.7098615 May 12 15:43:28.465442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:43:28.477154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 579} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:43:28.482112 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91155ae-cc4e-4635-829a-bdcda650f939 None None] Pushing event updated for resources: {'Port': ['ID=c7aceb9b-7f66-45af-a7ff-b801f5bcec19,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:28.511448 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:28.513165 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Added segment 1bca247c-f07d-45c8-9a50-17cd07b7f0b5 of type vlan for network 4365c129-804f-4de1-8f2b-afafcddb88c8 May 12 15:43:28.572289 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:28.659797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb92ccbc-1092-42ce-af6a-4deb9db22e73,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:28.674842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b05cab38-a643-4f8c-b7e4-0c5f6dd68972 None None] Provisioning complete for port 2d578718-1ffe-4a5e-a184-b9aac0d60c36 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:28.675258 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b05cab38-a643-4f8c-b7e4-0c5f6dd68972 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:28.688192 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:28.692105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-042f85e5-eb5a-47e2-ab6f-04012dd8414c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:28.697116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-042f85e5-eb5a-47e2-ab6f-04012dd8414c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "GET /v2.0/subnets/1c5479d5-6152-4084-8920-dc74c2e667c5 HTTP/1.1" status: 200 len: 811 time: 0.2279921 May 12 15:43:28.698233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42390) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:28.701472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:28.703916 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:28.775171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Routers {'943c296a-7f18-4231-8088-35f5348abd2b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:28.785844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:16Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['943c296a-7f18-4231-8088-35f5348abd2b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:28.855429 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2f34d3e8-5187-42ae-b5b0-87b350f2fb95 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.1314623 May 12 15:43:28.897570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42398) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:28.930450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'network': {'name': 'tempest-RoutersTest-1319432142'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:29.049974 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Attempting to bind port c7aceb9b-7f66-45af-a7ff-b801f5bcec19 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:29.062292 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Attempting to bind port c7aceb9b-7f66-45af-a7ff-b801f5bcec19 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '00733d62-a32c-495d-9cf8-f6c6e58930c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:29.062997 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Attempting to bind port c7aceb9b-7f66-45af-a7ff-b801f5bcec19 on network dc4d0778-8db2-40e0-aa19-9acf571959fb {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:29.088871 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:29.097266 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Checking segment: {'id': '00733d62-a32c-495d-9cf8-f6c6e58930c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:29.098278 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:29.098931 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Bound using segment: {'id': '00733d62-a32c-495d-9cf8-f6c6e58930c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:29.100370 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Bound port: c7aceb9b-7f66-45af-a7ff-b801f5bcec19, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '00733d62-a32c-495d-9cf8-f6c6e58930c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:29.101141 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:29.113043 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 2.3675416 May 12 15:43:29.134223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:29.141308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42410) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:29.155892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:network and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:29.162305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Request body: {'subnet': {'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestAggregatesBasicOps-454973996-subnet', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:29.189667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:29.195666 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef37b836-d8e2-4cfc-b750-764a42bf9dac admin admin] Pushing event updated for resources: {'Network': ['ID=4365c129-804f-4de1-8f2b-afafcddb88c8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:29.198422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Usage tracker for resource:subnet and tenant:b5b03ecc6a264c70aba77f212d9d4757 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:29.202123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:29.209015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:29.223688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Made reservation on behalf of b5b03ecc6a264c70aba77f212d9d4757 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:29.234060 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:29.300751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for network was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:29.335335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d5f5eda9-726d-4b25-afcd-c963d9a1df92 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=b641518781114418963451fc3ff58f4d&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 1.0758462 May 12 15:43:29.336498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42416) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:29.337493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:29.363951 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] For port c7aceb9b-7f66-45af-a7ff-b801f5bcec19, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:29.373888 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] For port c7aceb9b-7f66-45af-a7ff-b801f5bcec19, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c7aceb9b-7f66-45af-a7ff-b801f5bcec19,segment=NetworkSegment(00733d62-a32c-495d-9cf8-f6c6e58930c1),segment_id=00733d62-a32c-495d-9cf8-f6c6e58930c1)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:29.374010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 4365c129-804f-4de1-8f2b-afafcddb88c8 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:43:29.380755 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:29.391574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23fb0336-a1f5-4d04-b036-c707f5e25ff1 req-8fbfeeb3-1c75-4764-a142-2a6d5bb5379e tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.2205479 May 12 15:43:29.417679 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:29.590036 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Routers {'457f98a8-5d75-4172-bace-cad1c36d6cff'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:29.590654 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:16Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['457f98a8-5d75-4172-bace-cad1c36d6cff'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:29.598494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e11841b-84ee-4198-9f7d-316e37088e77 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['shared'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:29.610799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9e11841b-84ee-4198-9f7d-316e37088e77 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "GET /v2.0/subnets/1c5479d5-6152-4084-8920-dc74c2e667c5?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.9104824 May 12 15:43:29.632706 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42422) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:29.643194 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 2d578718-1ffe-4a5e-a184-b9aac0d60c36, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2d578718-1ffe-4a5e-a184-b9aac0d60c36,segment=NetworkSegment(7a44f3c7-0903-4bb2-a8d6-58ca1555771d),segment_id=7a44f3c7-0903-4bb2-a8d6-58ca1555771d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:29.655390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9ae7cbc9-c412-40a9-841b-7b04d34171fb tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1750360436'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:29.663657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9ae7cbc9-c412-40a9-841b-7b04d34171fb tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:29.748612 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91155ae-cc4e-4635-829a-bdcda650f939 None None] Pushing event updated for resources: {'Port': ['ID=c7aceb9b-7f66-45af-a7ff-b801f5bcec19,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:29.794058 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:29.797274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66d877ba-1b8c-45af-b3a3-c77a4b9acb13 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:29.802657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42426) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:29.803022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-66d877ba-1b8c-45af-b3a3-c77a4b9acb13 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.4352324 May 12 15:43:29.805336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9ae7cbc9-c412-40a9-841b-7b04d34171fb tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:29.814254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:29.817712 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:29.875450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ae7cbc9-c412-40a9-841b-7b04d34171fb tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:29.880364 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9ae7cbc9-c412-40a9-841b-7b04d34171fb tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:29.928547 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:29.973074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 581} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:43:30.004278 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:30.004622 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Added segment 78dc89b5-762c-4e20-928f-48bda4132660 of type vlan for network ca8599bc-9771-409d-b719-ef5aae5d8e20 May 12 15:43:30.053621 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a06183bf-2a2e-4360-a75a-2a9262f719c6 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2418056 May 12 15:43:30.054425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42432) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:30.092876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-2106181312', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'project_id': 'b641518781114418963451fc3ff58f4d', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:30.328050 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] Set router 457f98a8-5d75-4172-bace-cad1c36d6cff gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:30.391163 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c7aceb9b-7f66-45af-a7ff-b801f5bcec19 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:30.401914 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:30.413038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Pushing event updated for resources: {'Subnet': ['ID=341bc8b1-1137-42ab-8609-e6e2102116ba,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:30.503702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Checking segment: {'id': '1bca247c-f07d-45c8-9a50-17cd07b7f0b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:30.503702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Network hostable DHCP agents. Network: 4365c129-804f-4de1-8f2b-afafcddb88c8, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:43:30.518553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9ae7cbc9-c412-40a9-841b-7b04d34171fb tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 550} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:43:30.518553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:30.518872 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:30.523117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:30.523752 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:30.536001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:subnet and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:30.539845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:30.581603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:30.589725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Network 4365c129-804f-4de1-8f2b-afafcddb88c8 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:43:30.628658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 4365c129-804f-4de1-8f2b-afafcddb88c8) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:30.634127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:30.634767 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:30.639308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Made reservation on behalf of b641518781114418963451fc3ff58f4d for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:30.644532 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:30.653004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57bd7b20-d4b9-4231-8856-fb0e16fe6521 None None] Network 4365c129-804f-4de1-8f2b-afafcddb88c8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:30.730721 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9ae7cbc9-c412-40a9-841b-7b04d34171fb tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:30.731673 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-9ae7cbc9-c412-40a9-841b-7b04d34171fb tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Added segment 8307a2da-c391-4638-b543-8b010694b263 of type vlan for network b9deb4cb-9fa0-49a9-be85-9674dd8270ae May 12 15:43:30.748315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 1.8446395 May 12 15:43:30.751087 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e43541a8-92de-433e-8f59-f77669602a17 req-67938076-ab6f-4d66-a4de-5291e2ceb54d tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1529458 May 12 15:43:30.754881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42444) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:30.771386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'subnet': {'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20', 'cidr': '172.23.0.0/28', 'ip_version': 4, 'gateway_ip': '172.23.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:30.806645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e63c7ee-6ef8-4177-9554-cc256ee1119f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Network': ['ID=ca8599bc-9771-409d-b719-ef5aae5d8e20,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:30.868376 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9ae7cbc9-c412-40a9-841b-7b04d34171fb tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:30.880684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-631f328d-6deb-4807-be6b-f9ac3712b2e2 None None] Network 3f83009e-15c3-4297-93d4-b28b3de6e6a0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:30.928895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:30.948572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:subnet and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:30.963652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for subnet was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:30.966685 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9ae7cbc9-c412-40a9-841b-7b04d34171fb tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:30.982712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ae7cbc9-c412-40a9-841b-7b04d34171fb tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:30.983340 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9ae7cbc9-c412-40a9-841b-7b04d34171fb tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:30.998389 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:31.026994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource subnet. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:31.045042 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network ca8599bc-9771-409d-b719-ef5aae5d8e20 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:43:31.060921 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'name': 'tempest-TestAggregatesBasicOps-1565348474-router', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:19Z', 'revision_number': 4, 'project_id': '7b6758bd71d1400f8b6b1d4858918128', 'gw_port': {'id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:e4:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3466, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:06Z', 'updated_at': '2022-05-12T15:43:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c7aceb9b-7f66-45af-a7ff-b801f5bcec19', 'name': '', 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'mac_address': 'fa:16:3e:25:d2:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'device_owner': 'network:router_interface', 'standard_attr_id': 3483, 'fixed_ips': [{'subnet_id': '8048f0a2-0244-4df1-a0f2-76aae45f6709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:14Z', 'updated_at': '2022-05-12T15:43:29Z', 'revision_number': 4, 'project_id': '7b6758bd71d1400f8b6b1d4858918128', 'subnets': [{'id': '8048f0a2-0244-4df1-a0f2-76aae45f6709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:31.067773 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f65727bd-1173-4146-a795-031c2b7281ad None None] The sync data for ids ['457f98a8-5d75-4172-bace-cad1c36d6cff'] in n-d-841483-1 is: [{'id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'name': 'tempest-TestAggregatesBasicOps-1565348474-router', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:19Z', 'revision_number': 4, 'project_id': '7b6758bd71d1400f8b6b1d4858918128', 'gw_port': {'id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:e4:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3466, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:06Z', 'updated_at': '2022-05-12T15:43:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c7aceb9b-7f66-45af-a7ff-b801f5bcec19', 'name': '', 'network_id': 'dc4d0778-8db2-40e0-aa19-9acf571959fb', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'mac_address': 'fa:16:3e:25:d2:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'device_owner': 'network:router_interface', 'standard_attr_id': 3483, 'fixed_ips': [{'subnet_id': '8048f0a2-0244-4df1-a0f2-76aae45f6709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:14Z', 'updated_at': '2022-05-12T15:43:29Z', 'revision_number': 4, 'project_id': '7b6758bd71d1400f8b6b1d4858918128', 'subnets': [{'id': '8048f0a2-0244-4df1-a0f2-76aae45f6709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:43:31.135047 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5f877b90-2227-402a-83b2-7922d8aade4d admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.9921465 May 12 15:43:31.141752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42452) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:31.145481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9ae7cbc9-c412-40a9-841b-7b04d34171fb tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.4993129 May 12 15:43:31.149047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42456) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:31.152374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Request body: {'router': {'name': 'tempest-TestAggregatesBasicOps-454973996-router', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:31.159280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Made reservation on behalf of 755d04c3babe4d56b0092365d0203422 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:31.163166 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:31.166097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Subnet': ['ID=501ff294-e32c-494b-9718-ec96b39fa231,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:31.171387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'subnet': {'network_id': 'b9deb4cb-9fa0-49a9-be85-9674dd8270ae', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8'], 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:31.186747 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:31.189514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Checking segment: {'id': '0e218190-12cd-4c5d-a26e-6453816fe1e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 585, 'network_id': '03979098-a904-494a-a852-b458bf7ca658'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:31.189879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network hostable DHCP agents. Network: 03979098-a904-494a-a852-b458bf7ca658, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:43:31.203981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Set router 943c296a-7f18-4231-8088-35f5348abd2b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:31.204179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Usage tracker for resource:router and tenant:b5b03ecc6a264c70aba77f212d9d4757 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:31.207258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:31.220286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:31.382544 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:31.384769 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:31.411060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 03979098-a904-494a-a852-b458bf7ca658 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:43:31.413545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:31.424076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ae7cbc9-c412-40a9-841b-7b04d34171fb tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Network': ['ID=b9deb4cb-9fa0-49a9-be85-9674dd8270ae,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:31.448452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:31.452449 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:31.463737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:24Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:43:25Z', 'revision_number': 2, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:26Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:31.475730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 03979098-a904-494a-a852-b458bf7ca658) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:31.496390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41967e3f-9a6c-4e5b-bd1f-d8d5545ad3f1 None None] The sync data for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 is: [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:24Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:43:25Z', 'revision_number': 2, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:26Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:43:31.497999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=2d578718-1ffe-4a5e-a184-b9aac0d60c36,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:31.500627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network b9deb4cb-9fa0-49a9-be85-9674dd8270ae details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:43:31.520043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58057929-7798-4d4d-a84e-e3f1413f9c12 None None] Network 03979098-a904-494a-a852-b458bf7ca658 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:31.695005 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:31.877121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:31.878148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:31.914711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Made reservation on behalf of 3fcb9ca7c3d44a988e6caa81ca64980c for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:31.918491 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:32.008180 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-4365c129-804f-4de1-8f2b-afafcddb88c8', 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'fixed_ips': [{'subnet_id': '341bc8b1-1137-42ab-8609-e6e2102116ba'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:43:32.009184 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:32.034023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e083377-2e00-4f85-b483-ab14c534efff req-ad265d8c-1c1d-487f-8a5e-e75aa4885a2a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1574626 May 12 15:43:32.051943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.ipam_backend_mixin [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Performing IP validity checks on allocation pools {{(pid=88151) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:314}} May 12 15:43:32.052471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.ipam_backend_mixin [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Checking for overlaps among allocation pools and gateway ip {{(pid=88151) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:335}} May 12 15:43:32.059889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Subnet': ['ID=b5dbeca3-f681-42eb-8d6c-1e8120c9627a,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:32.084754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Checking segment: {'id': '78dc89b5-762c-4e20-928f-48bda4132660', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:32.085515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network hostable DHCP agents. Network: ca8599bc-9771-409d-b719-ef5aae5d8e20, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:43:32.108757 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a19e6774-ed83-42ec-9b99-cf10dc9bf279 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 2.0495574 May 12 15:43:32.114110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42472) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:32.245962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network ca8599bc-9771-409d-b719-ef5aae5d8e20 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:43:32.323206 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:32.421346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, ca8599bc-9771-409d-b719-ef5aae5d8e20) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:32.443895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:32.444487 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:32.513938 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-744acb85-b438-4d25-9d5f-05be5895945b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.7569258 May 12 15:43:32.517847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42480) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:32.605836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Allocated IP 172.20.0.2 (4365c129-804f-4de1-8f2b-afafcddb88c8/341bc8b1-1137-42ab-8609-e6e2102116ba/f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:32.660632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7deb6a5c-1d9a-4633-b213-b6bcb1e36445 None None] Network ca8599bc-9771-409d-b719-ef5aae5d8e20 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:32.903205 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port c7aceb9b-7f66-45af-a7ff-b801f5bcec19 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:32.963025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c7aceb9b-7f66-45af-a7ff-b801f5bcec19 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:32.963727 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:32.992928 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-10196c82-7706-4f68-a57f-7a73f86f12b8 None None] Provisioning complete for port c7aceb9b-7f66-45af-a7ff-b801f5bcec19 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:32.997978 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-10196c82-7706-4f68-a57f-7a73f86f12b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:33.043426 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:33.071595 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:33.216615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Subnet': ['ID=bda53641-de7e-4811-aa4e-6fb0c73cc567,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:33.295205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Checking segment: {'id': '8307a2da-c391-4638-b543-8b010694b263', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': 'b9deb4cb-9fa0-49a9-be85-9674dd8270ae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:33.296230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network hostable DHCP agents. Network: b9deb4cb-9fa0-49a9-be85-9674dd8270ae, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:43:33.333140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Network b9deb4cb-9fa0-49a9-be85-9674dd8270ae is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:43:33.585569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, b9deb4cb-9fa0-49a9-be85-9674dd8270ae) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:33.590604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:33.591236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:33.637638 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-32d54bbd-b723-4212-b037-2da8d34a387f tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 872 time: 2.4751754 May 12 15:43:33.642744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42498) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:33.651302 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-68f0aad9-a7b3-4a0d-8ae1-2b101f3e413b req-d1f4b97f-9082-4846-aed5-f67e023c27f5 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.4718621 May 12 15:43:33.676716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e17e76dc-31df-445b-9c6d-28d5435b4d62 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.2'}], 'dns_nameservers': ['7.8.8.8', '7.8.4.4'], 'gateway_ip': '172.20.0.2', 'enable_dhcp': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:33.705504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-5f14c3c8-9944-4322-86e9-f9fbdb721a73 req-884d437c-557d-4950-932f-de02f05b7b16 service neutron] (88152) timed out ('10.222.0.76', 61676) {{(pid=88152) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 15:43:33.754000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12b1b656-e912-486f-877f-b02fea7f0f09 None None] Network b9deb4cb-9fa0-49a9-be85-9674dd8270ae requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:33.947225 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:34.029370 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Sync routers for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:43:34.051880 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:34.052420 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:16Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:34.349857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-03979098-a904-494a-a852-b458bf7ca658', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:43:34.355096 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:34.548715 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:34.688185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Allocated IP 172.20.0.1 (03979098-a904-494a-a852-b458bf7ca658/501ff294-e32c-494b-9718-ec96b39fa231/4c9c52d9-7be2-45c7-82f5-d4e254eec55f) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:34.783744 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:43:23Z', 'revision_number': 3, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:34.824527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-b9deb4cb-9fa0-49a9-be85-9674dd8270ae', 'network_id': 'b9deb4cb-9fa0-49a9-be85-9674dd8270ae', 'tenant_id': '3fcb9ca7c3d44a988e6caa81ca64980c', 'fixed_ips': [{'subnet_id': 'bda53641-de7e-4811-aa4e-6fb0c73cc567'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:43:34.825360 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:34.841232 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:34.929047 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:34.966709 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-10196c82-7706-4f68-a57f-7a73f86f12b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:35.005242 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:35.023546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Transition to ACTIVE for port object 4c9c52d9-7be2-45c7-82f5-d4e254eec55f will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:35.057066 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e17e76dc-31df-445b-9c6d-28d5435b4d62 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-1887871'] for subnet, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:35.104784 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:35.119437 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:35.208256 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=4c9c52d9-7be2-45c7-82f5-d4e254eec55f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:35.248422 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-368b9b1b-87d2-4c9d-a3fb-bb9c524315f0 req-45368c8f-1790-4bf8-b0eb-0088b68a7ae5 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1968334 May 12 15:43:35.278714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 03979098-a904-494a-a852-b458bf7ca658 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:35.280858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:35.287763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:35.291472 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:24Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:43:25Z', 'revision_number': 2, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:26Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:35.301229 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Checking router: 766c87d1-88c8-4b7e-ba13-f65737b66f8b for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:43:35.304904 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Updating router 766c87d1-88c8-4b7e-ba13-f65737b66f8b port 144476e8-3d2f-40e1-8e1d-88435e1c3389 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:43:35.386890 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:35.400027 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:35.503750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Allocated IP 172.20.0.2 (03979098-a904-494a-a852-b458bf7ca658/501ff294-e32c-494b-9718-ec96b39fa231/f1e033f3-b048-470b-ac02-cd534e3f1483) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:35.562653 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-10196c82-7706-4f68-a57f-7a73f86f12b8 None None] For port c7aceb9b-7f66-45af-a7ff-b801f5bcec19, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c7aceb9b-7f66-45af-a7ff-b801f5bcec19,segment=NetworkSegment(00733d62-a32c-495d-9cf8-f6c6e58930c1),segment_id=00733d62-a32c-495d-9cf8-f6c6e58930c1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:35.564029 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:35.586860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Checking router: 943c296a-7f18-4231-8088-35f5348abd2b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:43:35.587379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Updating router 943c296a-7f18-4231-8088-35f5348abd2b port 539a80f2-ef5d-4365-8999-6a2e51b5afc6 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:43:35.674496 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:35.753063 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e17e76dc-31df-445b-9c6d-28d5435b4d62 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8768026839929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-28283924'] for subnet, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:35.779056 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:35.805518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Transition to ACTIVE for port object f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:35.866449 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Transition to ACTIVE for port object f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:35.886107 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-10196c82-7706-4f68-a57f-7a73f86f12b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:36.081827 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:36.091937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e17e76dc-31df-445b-9c6d-28d5435b4d62 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event updated for resources: {'Subnet': ['ID=bda53641-de7e-4811-aa4e-6fb0c73cc567,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:36.116431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-ca8599bc-9771-409d-b719-ef5aae5d8e20', 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'fixed_ips': [{'subnet_id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:43:36.117256 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:36.130357 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Transition to ACTIVE for port object 144476e8-3d2f-40e1-8e1d-88435e1c3389 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:36.144581 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:36.158607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e17e76dc-31df-445b-9c6d-28d5435b4d62 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:36.159840 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e17e76dc-31df-445b-9c6d-28d5435b4d62 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:36.161476 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e17e76dc-31df-445b-9c6d-28d5435b4d62 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "PUT /v2.0/subnets/bda53641-de7e-4811-aa4e-6fb0c73cc567 HTTP/1.1" status: 200 len: 877 time: 2.5046961 May 12 15:43:36.172182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42530) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:36.213317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Allocated IP 172.25.8.57 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:36.237733 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:36.593251 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4593f014-538f-4ee5-97a6-0f9f4476e453 None None] Pushing event updated for resources: {'Port': ['ID=144476e8-3d2f-40e1-8e1d-88435e1c3389,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:36.597089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d4e7137a-eccb-47a4-82d7-0e9fa2b8db15 req-89ac1d78-73fd-4411-a288-961aab47c747 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1858196 May 12 15:43:36.717576 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:36.763670 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:36.778001 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:36.912125 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Attempting to bind port 144476e8-3d2f-40e1-8e1d-88435e1c3389 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:36.912395 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Attempting to bind port 144476e8-3d2f-40e1-8e1d-88435e1c3389 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '170e329c-dde1-448c-88ad-452fb2700328', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:36.912751 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Attempting to bind port 144476e8-3d2f-40e1-8e1d-88435e1c3389 on network 3f83009e-15c3-4297-93d4-b28b3de6e6a0 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:36.926683 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:36.927049 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Checking segment: {'id': '170e329c-dde1-448c-88ad-452fb2700328', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:36.927451 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:36.927835 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Bound using segment: {'id': '170e329c-dde1-448c-88ad-452fb2700328', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:36.928294 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Bound port: 144476e8-3d2f-40e1-8e1d-88435e1c3389, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '170e329c-dde1-448c-88ad-452fb2700328', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 565, 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:36.928668 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:36.938301 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:37.065201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Network 4365c129-804f-4de1-8f2b-afafcddb88c8 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:37.107165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10196c82-7706-4f68-a57f-7a73f86f12b8 None None] Pushing event updated for resources: {'Port': ['ID=c7aceb9b-7f66-45af-a7ff-b801f5bcec19,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:37.130696 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] For port 144476e8-3d2f-40e1-8e1d-88435e1c3389, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:37.134317 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] For port 144476e8-3d2f-40e1-8e1d-88435e1c3389, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=144476e8-3d2f-40e1-8e1d-88435e1c3389,segment=NetworkSegment(170e329c-dde1-448c-88ad-452fb2700328),segment_id=170e329c-dde1-448c-88ad-452fb2700328)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:37.142326 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:37.232919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:37.297450 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4593f014-538f-4ee5-97a6-0f9f4476e453 None None] Pushing event updated for resources: {'Port': ['ID=144476e8-3d2f-40e1-8e1d-88435e1c3389,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:37.299100 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:37.305711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=4c9c52d9-7be2-45c7-82f5-d4e254eec55f,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:37.387775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:37.390106 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:37.390919 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:16Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:37.504625 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:37.551311 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:37.624164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Allocated IP 172.23.0.1 (ca8599bc-9771-409d-b719-ef5aae5d8e20/b5dbeca3-f681-42eb-8d6c-1e8120c9627a/ad231b54-6bf2-4f37-9752-72197ecdb6b2) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:37.683396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 03979098-a904-494a-a852-b458bf7ca658 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:37.784695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:37.811536 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ef50aa5-24af-46ba-a004-add53b289d60 req-5de3f113-729e-4776-be5d-b00348e404a2 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1209230 May 12 15:43:37.846622 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:37.911734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Pushing event updated for resources: {'Port': ['ID=f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:37.945228 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:37.999022 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:43:37.999534 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:43:38.052191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-10196c82-7706-4f68-a57f-7a73f86f12b8 None None] Provisioning for port 409a78e5-4573-4d33-b4da-83dcea90e530 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:38.089110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Attempting to bind port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:38.096703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Attempting to bind port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '1bca247c-f07d-45c8-9a50-17cd07b7f0b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:38.097298 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Attempting to bind port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 on network 4365c129-804f-4de1-8f2b-afafcddb88c8 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:38.148053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Router 943c296a-7f18-4231-8088-35f5348abd2b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:43:38.154052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Allocated IP 172.20.0.3 (b9deb4cb-9fa0-49a9-be85-9674dd8270ae/bda53641-de7e-4811-aa4e-6fb0c73cc567/f7a42af6-1991-4cf5-abdc-110a84081a30) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:38.169157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:38.169540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Checking segment: {'id': '1bca247c-f07d-45c8-9a50-17cd07b7f0b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:38.170027 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:38.170535 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Bound using segment: {'id': '1bca247c-f07d-45c8-9a50-17cd07b7f0b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:38.171041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Bound port: f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1bca247c-f07d-45c8-9a50-17cd07b7f0b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:38.171444 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:38.487723 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:24Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:43:37Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:26Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:38.514424 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d872f6b-4019-4cff-8d0a-c770f6a1f1ba None None] The sync data for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 is: [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:24Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:43:37Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:26Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:43:38.526072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:38.536976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:38.541683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:43:38.555512 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c97134e9-137f-483e-9a95-0c2352852015 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "PUT /v2.0/routers/943c296a-7f18-4231-8088-35f5348abd2b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.4291973 May 12 15:43:38.559940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:38.563167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42546) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:38.737492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Pushing event updated for resources: {'Port': ['ID=4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:38.752499 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:38.774845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-524e66f3-f434-4bdf-8660-36fcc57a56c4 None None] Provisioning for port 144476e8-3d2f-40e1-8e1d-88435e1c3389 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:38.846729 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:38.849977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b412f7d6-f82f-41a4-a588-b9f97c5b45ab up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:38.952630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Transition to ACTIVE for port object ad231b54-6bf2-4f37-9752-72197ecdb6b2 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:39.029610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Transition to ACTIVE for port object f1e033f3-b048-470b-ac02-cd534e3f1483 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:39.033809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7701a3b1-224c-45dd-b304-871951c3cacf req-71e8c917-e628-4744-b759-1ac63f2334fa tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1168773 May 12 15:43:39.093432 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] For port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:39.121049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Transition to ACTIVE for port object f1e033f3-b048-470b-ac02-cd534e3f1483 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:39.121905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.122255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.122716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.123168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.123612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.124085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.128528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.128912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.129360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.132571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] For port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087,segment=NetworkSegment(1bca247c-f07d-45c8-9a50-17cd07b7f0b5),segment_id=1bca247c-f07d-45c8-9a50-17cd07b7f0b5)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:39.133647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.134112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.136764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.137372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.138110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.138457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.146053 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b39acf84-e07b-44a7-888a-c16deca426a0 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 10462 time: 0.5785954 May 12 15:43:39.146935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42556) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:39.231890 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:39.238819 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:39.291946 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:39.359473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.362945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.363426 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.365089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.365577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.367246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.367712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.368210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.368660 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.371270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.371908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.372367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.372816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.376865 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:39.385715 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c5ee6b26-18cf-4e95-9778-95444d12c2c7 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 8936 time: 0.2339985 May 12 15:43:39.385715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42562) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:39.436110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port b412f7d6-f82f-41a4-a588-b9f97c5b45ab completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:39.440726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Network 03979098-a904-494a-a852-b458bf7ca658 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:39.460373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:39.470869 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:39.475173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b412f7d6-f82f-41a4-a588-b9f97c5b45ab triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:39.475637 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:39.475896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network ca8599bc-9771-409d-b719-ef5aae5d8e20 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:39.478880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=ad231b54-6bf2-4f37-9752-72197ecdb6b2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:39.483465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:39.487475 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:39.510500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:39.517164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Pushing event updated for resources: {'Port': ['ID=f1e033f3-b048-470b-ac02-cd534e3f1483,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:39.586307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Transition to ACTIVE for port object f7a42af6-1991-4cf5-abdc-110a84081a30 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:39.600504 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:39.723349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Allocated IP 172.23.0.2 (ca8599bc-9771-409d-b719-ef5aae5d8e20/b5dbeca3-f681-42eb-8d6c-1e8120c9627a/db282676-b200-482c-b8ba-dc814d43f534) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:39.817937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3688b73f-f8f1-4a19-80dc-3e3c80870bf4 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 4841 time: 0.4255991 May 12 15:43:39.818153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Transition to ACTIVE for port object 539a80f2-ef5d-4365-8999-6a2e51b5afc6 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:39.834917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Transition to ACTIVE for port object f7a42af6-1991-4cf5-abdc-110a84081a30 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:39.880950 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:39.906071 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:39.911462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:40.041967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa18ce90-f940-4d87-843c-eaf829dccf9d None None] Pushing event updated for resources: {'Port': ['ID=f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:40.042497 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:40.069997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Attempting to bind port f1e033f3-b048-470b-ac02-cd534e3f1483 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:40.070595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Attempting to bind port f1e033f3-b048-470b-ac02-cd534e3f1483 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '0e218190-12cd-4c5d-a26e-6453816fe1e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 585, 'network_id': '03979098-a904-494a-a852-b458bf7ca658'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:40.071138 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Attempting to bind port f1e033f3-b048-470b-ac02-cd534e3f1483 on network 03979098-a904-494a-a852-b458bf7ca658 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:40.255360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb9fc162-55c1-46ef-b044-e186d3881a39 req-6783a5bb-3779-49c6-8e38-b8ee9d4b948a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1299968 May 12 15:43:40.324757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:40.325735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Checking segment: {'id': '0e218190-12cd-4c5d-a26e-6453816fe1e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 585, 'network_id': '03979098-a904-494a-a852-b458bf7ca658'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:40.328305 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:40.328856 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Bound using segment: {'id': '0e218190-12cd-4c5d-a26e-6453816fe1e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 585, 'network_id': '03979098-a904-494a-a852-b458bf7ca658'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:40.330220 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Bound port: f1e033f3-b048-470b-ac02-cd534e3f1483, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0e218190-12cd-4c5d-a26e-6453816fe1e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 585, 'network_id': '03979098-a904-494a-a852-b458bf7ca658'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:40.332168 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:40.350199 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:40.352333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Network b9deb4cb-9fa0-49a9-be85-9674dd8270ae is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:40.418879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:40.441378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:40.462713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Subnet': ['ID=bda53641-de7e-4811-aa4e-6fb0c73cc567,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:40.464159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Attempting to bind port 539a80f2-ef5d-4365-8999-6a2e51b5afc6 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:40.464527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Attempting to bind port 539a80f2-ef5d-4365-8999-6a2e51b5afc6 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:40.464888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Attempting to bind port 539a80f2-ef5d-4365-8999-6a2e51b5afc6 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:40.524565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db67dc89-8e3d-4687-a14f-fe37fb4d65ad None None] Pushing event updated for resources: {'Port': ['ID=539a80f2-ef5d-4365-8999-6a2e51b5afc6,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:40.527713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:40.528998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:40.530147 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:40.530719 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:40.534323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Bound port: 539a80f2-ef5d-4365-8999-6a2e51b5afc6, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:40.535597 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:40.683711 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:40.755296 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:40.841284 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:40.846796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b9deb4cb-9fa0-49a9-be85-9674dd8270ae']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:41.013543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42596) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:41.018904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-143866584', 'description': 'tempest-secgroup-smoke-143866584 description', 'project_id': 'b641518781114418963451fc3ff58f4d'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:41.028547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] For port f1e033f3-b048-470b-ac02-cd534e3f1483, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:41.028937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:41.049233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:41.060356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:41.070382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:41.103490 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.139966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:41.147795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:41.168738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:41.181070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port b412f7d6-f82f-41a4-a588-b9f97c5b45ab, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b412f7d6-f82f-41a4-a588-b9f97c5b45ab,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:41.194418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:41.201438 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.209308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Attempting to bind port f7a42af6-1991-4cf5-abdc-110a84081a30 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:41.217922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Attempting to bind port f7a42af6-1991-4cf5-abdc-110a84081a30 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '8307a2da-c391-4638-b543-8b010694b263', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': 'b9deb4cb-9fa0-49a9-be85-9674dd8270ae'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:41.218551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Attempting to bind port f7a42af6-1991-4cf5-abdc-110a84081a30 on network b9deb4cb-9fa0-49a9-be85-9674dd8270ae {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:41.229112 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.246446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 409a78e5-4573-4d33-b4da-83dcea90e530 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:41.268703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8307a2da-c391-4638-b543-8b010694b263') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:41.269006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8307a2da-c391-4638-b543-8b010694b263') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:41.283008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Pushing event updated for resources: {'Port': ['ID=f7a42af6-1991-4cf5-abdc-110a84081a30,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:41.305079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] For port f1e033f3-b048-470b-ac02-cd534e3f1483, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f1e033f3-b048-470b-ac02-cd534e3f1483,segment=NetworkSegment(0e218190-12cd-4c5d-a26e-6453816fe1e4),segment_id=0e218190-12cd-4c5d-a26e-6453816fe1e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:41.344543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.403927 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.440855 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.445937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:41.449845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Checking segment: {'id': '8307a2da-c391-4638-b543-8b010694b263', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': 'b9deb4cb-9fa0-49a9-be85-9674dd8270ae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:41.451506 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.451900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Bound using segment: {'id': '8307a2da-c391-4638-b543-8b010694b263', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': 'b9deb4cb-9fa0-49a9-be85-9674dd8270ae'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:41.455358 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Bound port: f7a42af6-1991-4cf5-abdc-110a84081a30, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8307a2da-c391-4638-b543-8b010694b263', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': 'b9deb4cb-9fa0-49a9-be85-9674dd8270ae'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:41.455715 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.499744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fafe7e52-c7a9-4843-ba3d-c7c5ad96a907 req-74042c8f-eed1-47e9-a07c-0838fe5026f3 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.0931842 May 12 15:43:41.527760 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.534972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7ef93a22-5ccd-49ce-bc3f-8fb5236953da,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:41.547658 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.550403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d524d582-8402-4272-b623-e1afcd8553f0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.5357842 May 12 15:43:41.553186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42608) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:41.558061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9886b128-6030-4c91-98cc-b85f874d7450 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': '7ef93a22-5ccd-49ce-bc3f-8fb5236953da', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:41.568198 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.574908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9886b128-6030-4c91-98cc-b85f874d7450 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:41.596240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9886b128-6030-4c91-98cc-b85f874d7450 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:41.604170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9886b128-6030-4c91-98cc-b85f874d7450 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:41.612493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9886b128-6030-4c91-98cc-b85f874d7450 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:41.614865 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6134eca3-c4c5-4383-8166-fe720722d15c None None] Network 4365c129-804f-4de1-8f2b-afafcddb88c8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:41.640777 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9886b128-6030-4c91-98cc-b85f874d7450 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.761092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] For port 539a80f2-ef5d-4365-8999-6a2e51b5afc6, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:41.776957 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9886b128-6030-4c91-98cc-b85f874d7450 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.789297 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9886b128-6030-4c91-98cc-b85f874d7450 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.849583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9886b128-6030-4c91-98cc-b85f874d7450 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3d7002aa-8f98-47c7-8a3c-0c08b79bfc0b,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:41.865484 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9886b128-6030-4c91-98cc-b85f874d7450 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:41.867088 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9886b128-6030-4c91-98cc-b85f874d7450 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3125880 May 12 15:43:41.870399 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42618) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:41.879403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8e9c203b-906d-44d9-90ab-4e97c5b28b83 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': '7ef93a22-5ccd-49ce-bc3f-8fb5236953da', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:41.885858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8e9c203b-906d-44d9-90ab-4e97c5b28b83 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:41.891076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8e9c203b-906d-44d9-90ab-4e97c5b28b83 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:41.895310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8e9c203b-906d-44d9-90ab-4e97c5b28b83 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:41.902777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8e9c203b-906d-44d9-90ab-4e97c5b28b83 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:41.947001 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e9c203b-906d-44d9-90ab-4e97c5b28b83 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.004074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 550 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:43:42.004629 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.026961 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.030895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] For port 539a80f2-ef5d-4365-8999-6a2e51b5afc6, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=539a80f2-ef5d-4365-8999-6a2e51b5afc6,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: timer() May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:43:42.035320 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:43:42.071804 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.090417 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e9c203b-906d-44d9-90ab-4e97c5b28b83 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.096632 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e9c203b-906d-44d9-90ab-4e97c5b28b83 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.111399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Transition to ACTIVE for port object db282676-b200-482c-b8ba-dc814d43f534 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:42.138150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e9c203b-906d-44d9-90ab-4e97c5b28b83 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0b0ca309-46c1-4d6e-a386-494badce7e29,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:42.158703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e9c203b-906d-44d9-90ab-4e97c5b28b83 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.160635 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8e9c203b-906d-44d9-90ab-4e97c5b28b83 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2890482 May 12 15:43:42.163322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42622) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:42.171501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-be426959-32d7-412a-8c9f-26b018fa5646 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': '7ef93a22-5ccd-49ce-bc3f-8fb5236953da', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:42.181185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-be426959-32d7-412a-8c9f-26b018fa5646 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:42.187288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-be426959-32d7-412a-8c9f-26b018fa5646 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:42.187448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-25af5504-dde4-4ab5-9057-7bb929c4e35d None None] Provisioning for port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:42.202478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-be426959-32d7-412a-8c9f-26b018fa5646 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:42.204342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=b412f7d6-f82f-41a4-a588-b9f97c5b45ab,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:42.214949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-be426959-32d7-412a-8c9f-26b018fa5646 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:42.287121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] For port f7a42af6-1991-4cf5-abdc-110a84081a30, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:42.301818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Transition to ACTIVE for port object db282676-b200-482c-b8ba-dc814d43f534 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:42.317425 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') May 12 15:43:42.317425 n-d-841483-1 neutron-server[88151]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] May 12 15:43:42.317425 n-d-841483-1 neutron-server[88151]: [parameters: {'id': 'b9deb4cb-9fa0-49a9-be85-9674dd8270ae'}] May 12 15:43:42.317425 n-d-841483-1 neutron-server[88151]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:43:42.318321 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:43:42.356787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] For port f7a42af6-1991-4cf5-abdc-110a84081a30, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f7a42af6-1991-4cf5-abdc-110a84081a30,segment=NetworkSegment(8307a2da-c391-4638-b543-8b010694b263),segment_id=8307a2da-c391-4638-b543-8b010694b263)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:42.366995 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 409a78e5-4573-4d33-b4da-83dcea90e530 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:42.379642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Router 420111e5-3d19-4801-ac99-692a805ed38d is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:43:42.396917 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.403908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.439787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Routers {'943c296a-7f18-4231-8088-35f5348abd2b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:42.440960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:16Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['943c296a-7f18-4231-8088-35f5348abd2b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:42.476849 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.514981 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.526559 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be426959-32d7-412a-8c9f-26b018fa5646 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.535263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 409a78e5-4573-4d33-b4da-83dcea90e530 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:42.535630 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.632995 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.676048 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57e2ceae-26dd-4065-8f3a-3c43f4250d3a req-380d1814-5d81-4872-a423-cfd5f77a0d7b tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.0632627 May 12 15:43:42.711700 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-846bc8dd-36f8-4b09-9958-9a033e5fff22 None None] Pushing event updated for resources: {'Port': ['ID=f1e033f3-b048-470b-ac02-cd534e3f1483,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:42.741706 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be426959-32d7-412a-8c9f-26b018fa5646 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.747009 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be426959-32d7-412a-8c9f-26b018fa5646 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.773965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be426959-32d7-412a-8c9f-26b018fa5646 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d5779a75-59e7-403e-b8f1-f7cbb9c8317e,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:42.792320 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be426959-32d7-412a-8c9f-26b018fa5646 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.793631 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-be426959-32d7-412a-8c9f-26b018fa5646 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.6288035 May 12 15:43:42.796526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42638) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:42.802762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d5b4153b-fab3-49d1-b65d-318a81a9c4b7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': '7ef93a22-5ccd-49ce-bc3f-8fb5236953da', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:42.810698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d5b4153b-fab3-49d1-b65d-318a81a9c4b7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:42.823543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Network ca8599bc-9771-409d-b719-ef5aae5d8e20 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:42.830457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d5b4153b-fab3-49d1-b65d-318a81a9c4b7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:42.833753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d5b4153b-fab3-49d1-b65d-318a81a9c4b7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:42.836036 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db67dc89-8e3d-4687-a14f-fe37fb4d65ad None None] Pushing event updated for resources: {'Port': ['ID=539a80f2-ef5d-4365-8999-6a2e51b5afc6,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:42.869291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d5b4153b-fab3-49d1-b65d-318a81a9c4b7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:42.892726 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.898539 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5b4153b-fab3-49d1-b65d-318a81a9c4b7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:42.903091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event updated for resources: {'Port': ['ID=ad231b54-6bf2-4f37-9752-72197ecdb6b2,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:42.940573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:42.950160 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:42.963323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Pushing event updated for resources: {'Port': ['ID=db282676-b200-482c-b8ba-dc814d43f534,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:43.009944 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5b4153b-fab3-49d1-b65d-318a81a9c4b7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.014538 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5b4153b-fab3-49d1-b65d-318a81a9c4b7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.049170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Network ca8599bc-9771-409d-b719-ef5aae5d8e20 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:43.052792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5b4153b-fab3-49d1-b65d-318a81a9c4b7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=793bf659-0eeb-458e-aa48-6d0bb1ff1c16,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:43.066453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Deleting port f7a42af6-1991-4cf5-abdc-110a84081a30 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:43:43.066791 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.069222 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5b4153b-fab3-49d1-b65d-318a81a9c4b7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.071208 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d5b4153b-fab3-49d1-b65d-318a81a9c4b7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2736721 May 12 15:43:43.074031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42646) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:43.081090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7dede66c-914a-49d4-99fc-0af46c25b0ce tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': '7ef93a22-5ccd-49ce-bc3f-8fb5236953da', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:43.090475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7dede66c-914a-49d4-99fc-0af46c25b0ce tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:43.096709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7dede66c-914a-49d4-99fc-0af46c25b0ce tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:43.100301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7dede66c-914a-49d4-99fc-0af46c25b0ce tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:43.108089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7dede66c-914a-49d4-99fc-0af46c25b0ce tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:43.132778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:43.145416 n-d-841483-1 neutron-server[88152]: INFO neutron.db.securitygroups_db [None req-7dede66c-914a-49d4-99fc-0af46c25b0ce tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Project b641518781114418963451fc3ff58f4d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:43:43.154624 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7dede66c-914a-49d4-99fc-0af46c25b0ce tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.294235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb86506-a7e5-4bb1-9c7a-db3e447dfd06 None None] Pushing event updated for resources: {'Port': ['ID=f7a42af6-1991-4cf5-abdc-110a84081a30,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:43.323539 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:43:43.331784 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7dede66c-914a-49d4-99fc-0af46c25b0ce tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.336464 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2d57bbf4-07e2-4f9c-9f2b-60add20fd2ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.345613 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7dede66c-914a-49d4-99fc-0af46c25b0ce tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.371242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b863858f-91b8-4642-8c62-c4785e24b383 None None] Network b9deb4cb-9fa0-49a9-be85-9674dd8270ae requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:43.388393 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Sync routers for ids ['420111e5-3d19-4801-ac99-692a805ed38d'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:43:43.391219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Attempting to bind port db282676-b200-482c-b8ba-dc814d43f534 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:43.392206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Attempting to bind port db282676-b200-482c-b8ba-dc814d43f534 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '78dc89b5-762c-4e20-928f-48bda4132660', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:43.392948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Attempting to bind port db282676-b200-482c-b8ba-dc814d43f534 on network ca8599bc-9771-409d-b719-ef5aae5d8e20 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:43.397675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dede66c-914a-49d4-99fc-0af46c25b0ce tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e3823793-46b6-461b-808c-6fba880ccab7,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:43.445862 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7dede66c-914a-49d4-99fc-0af46c25b0ce tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.450244 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7dede66c-914a-49d4-99fc-0af46c25b0ce tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3749065 May 12 15:43:43.450855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42654) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:43.456290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f1560fc9-f10e-49d5-a1ec-ba5eb6164aa4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': '7ef93a22-5ccd-49ce-bc3f-8fb5236953da', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:43.470512 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:43.471222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Checking segment: {'id': '78dc89b5-762c-4e20-928f-48bda4132660', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:43.471861 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.472467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Bound using segment: {'id': '78dc89b5-762c-4e20-928f-48bda4132660', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:43.473172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Bound port: db282676-b200-482c-b8ba-dc814d43f534, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78dc89b5-762c-4e20-928f-48bda4132660', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:43.473826 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.482147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f1560fc9-f10e-49d5-a1ec-ba5eb6164aa4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:43.488215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f1560fc9-f10e-49d5-a1ec-ba5eb6164aa4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:43.491662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f1560fc9-f10e-49d5-a1ec-ba5eb6164aa4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:43.498466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f1560fc9-f10e-49d5-a1ec-ba5eb6164aa4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:43.513301 n-d-841483-1 neutron-server[88152]: INFO neutron.db.securitygroups_db [None req-f1560fc9-f10e-49d5-a1ec-ba5eb6164aa4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Project b641518781114418963451fc3ff58f4d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:43:43.523997 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f1560fc9-f10e-49d5-a1ec-ba5eb6164aa4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.642076 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f1560fc9-f10e-49d5-a1ec-ba5eb6164aa4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.656553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f1560fc9-f10e-49d5-a1ec-ba5eb6164aa4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.687648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1560fc9-f10e-49d5-a1ec-ba5eb6164aa4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=16153278-1bbc-42e1-a026-263d0db0c8ad,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:43.693032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Routers {'420111e5-3d19-4801-ac99-692a805ed38d'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:43.693733 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:16Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['420111e5-3d19-4801-ac99-692a805ed38d'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:43.734849 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f1560fc9-f10e-49d5-a1ec-ba5eb6164aa4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.744743 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f1560fc9-f10e-49d5-a1ec-ba5eb6164aa4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2843204 May 12 15:43:43.907008 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:43.917706 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cfb0f4d8-6293-4aa5-84ce-1b7fb87f0dfd req-5d381f58-1e54-44c5-a406-da6ffd3bc885 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1233139 May 12 15:43:43.990055 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41d194f2-000d-4413-a03b-1dfd051164e1 None None] Network 03979098-a904-494a-a852-b458bf7ca658 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:44.086781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 766c87d1-88c8-4b7e-ba13-f65737b66f8b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:43:44.093835 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:44.098764 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-abb54645-a1f0-4eca-9c34-11a75fb81912 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 12.9558408 May 12 15:43:44.101701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42676) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:44.315030 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:44.352941 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] Set router 943c296a-7f18-4231-8088-35f5348abd2b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:44.422714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] For port f7a42af6-1991-4cf5-abdc-110a84081a30, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f7a42af6-1991-4cf5-abdc-110a84081a30,segment=NetworkSegment(8307a2da-c391-4638-b543-8b010694b263),segment_id=8307a2da-c391-4638-b543-8b010694b263)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:44.424410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:44.588741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Calling delete_port for f7a42af6-1991-4cf5-abdc-110a84081a30 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:43:44.635529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-54cc8509-058d-4816-b928-c9ce29e397dc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:43:44.649276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:43:44.654969 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 409a78e5-4573-4d33-b4da-83dcea90e530, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=409a78e5-4573-4d33-b4da-83dcea90e530,segment=NetworkSegment(170e329c-dde1-448c-88ad-452fb2700328),segment_id=170e329c-dde1-448c-88ad-452fb2700328)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:44.658683 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-12675ef0-3801-4650-89d9-051497a1a50c tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 12.1382968 May 12 15:43:44.698202 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Sync routers for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:43:44.705244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42700) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:44.711841 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:44.712748 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:16Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:44.732626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f89ffb92-1bce-4ff1-8de5-128bb3979854 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'router': {'routes': [{'nexthop': '172.20.0.2', 'destination': '172.20.0.0/28'}, {'nexthop': '172.21.0.2', 'destination': '172.21.0.0/28'}, {'nexthop': '172.22.0.2', 'destination': '172.22.0.0/28'}, {'nexthop': '172.23.0.2', 'destination': '172.23.0.0/28'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:44.772056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-54cc8509-058d-4816-b928-c9ce29e397dc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:43:44.773126 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-54cc8509-058d-4816-b928-c9ce29e397dc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-143866584&fields=id&tenant_id=b641518781114418963451fc3ff58f4d HTTP/1.1" status: 200 len: 267 time: 0.4088767 May 12 15:43:44.952134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5a8146ec-e94c-401a-9f33-39e99d5b1868 None None] Provisioning for port f1e033f3-b048-470b-ac02-cd534e3f1483 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:44.952581 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:44.955725 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:45.169558 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] For port db282676-b200-482c-b8ba-dc814d43f534, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:45.325435 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] For port db282676-b200-482c-b8ba-dc814d43f534, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=db282676-b200-482c-b8ba-dc814d43f534,segment=NetworkSegment(78dc89b5-762c-4e20-928f-48bda4132660),segment_id=78dc89b5-762c-4e20-928f-48bda4132660)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:45.347965 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Set router 420111e5-3d19-4801-ac99-692a805ed38d gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:45.554537 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:45.582252 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:45.586464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c7aceb9b-7f66-45af-a7ff-b801f5bcec19 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:45.602458 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b68353ae-6296-48a9-afb6-4ac4388981b2 req-283ee21d-e707-4685-a8be-df881217e9eb tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.3994863 May 12 15:43:45.623155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No DVR routers for this DVR port f7a42af6-1991-4cf5-abdc-110a84081a30 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:43:45.677614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Port': ['ID=f7a42af6-1991-4cf5-abdc-110a84081a30,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:45.726583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=409a78e5-4573-4d33-b4da-83dcea90e530,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:45.838443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-914c363f-d9a2-494f-8888-249975d7fd8c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:45.838443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-914c363f-d9a2-494f-8888-249975d7fd8c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:43:45.875845 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4bb34a8-92c6-4186-927c-1518c13786d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:45.898815 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:40Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:43:37Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:26Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ad231b54-6bf2-4f37-9752-72197ecdb6b2', 'name': '', 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:e1:83:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3521, 'fixed_ips': [{'subnet_id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:36Z', 'updated_at': '2022-05-12T15:43:41Z', 'revision_number': 2, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:45.904102 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Checking router: 766c87d1-88c8-4b7e-ba13-f65737b66f8b for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:43:45.904650 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Updating router 766c87d1-88c8-4b7e-ba13-f65737b66f8b port ad231b54-6bf2-4f37-9752-72197ecdb6b2 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:43:45.977915 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:46.076400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-914c363f-d9a2-494f-8888-249975d7fd8c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:43:46.084382 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-914c363f-d9a2-494f-8888-249975d7fd8c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/networks?id=03979098-a904-494a-a852-b458bf7ca658 HTTP/1.1" status: 200 len: 796 time: 1.3019443 May 12 15:43:46.120103 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:46.159983 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-a433d0ec-fb4c-43a4-af4e-cf77d39af9ee tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/quotas/b641518781114418963451fc3ff58f4d HTTP/1.1" status: 200 len: 375 time: 0.0746412 May 12 15:43:46.248049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d2a8dec-bd3c-4351-94c0-f65789a30f5c None None] Network b9deb4cb-9fa0-49a9-be85-9674dd8270ae requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:46.255500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.extraroute_db [None req-f89ffb92-1bce-4ff1-8de5-128bb3979854 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Added routes are [{'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}] {{(pid=88151) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:114}} May 12 15:43:46.272214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.extraroute_db [None req-f89ffb92-1bce-4ff1-8de5-128bb3979854 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Removed routes are [] {{(pid=88151) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:122}} May 12 15:43:46.272850 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f89ffb92-1bce-4ff1-8de5-128bb3979854 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:46.305901 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:46.314524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dea80ca-7720-4ab6-b2c7-696ba029e600 None None] Pushing event updated for resources: {'Port': ['ID=db282676-b200-482c-b8ba-dc814d43f534,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:46.734158 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:46.775007 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:46.816808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b9deb4cb-9fa0-49a9-be85-9674dd8270ae']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:46.844466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c7aceb9b-7f66-45af-a7ff-b801f5bcec19 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:46.845464 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:46.995165 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:47.043077 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Transition to ACTIVE for port object ad231b54-6bf2-4f37-9752-72197ecdb6b2 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:47.053153 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:47.075929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10998245-ab05-48de-b9e0-85ce27a2bc9f req-4102b7c7-11e0-4285-8f1d-7386f805d04f tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1194286 May 12 15:43:47.132020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-83c7d4be-9573-4cd6-b3d8-cee62d805abb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:43:47.174316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:43:35Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:43:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:43:36Z', 'revision_number': 2, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:47.221046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1ce9305-fd0f-4382-99ff-27a3df3674e5 None None] The sync data for ids ['943c296a-7f18-4231-8088-35f5348abd2b'] in n-d-841483-1 is: [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:43:35Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:43:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:43:36Z', 'revision_number': 2, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:43:47.331032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-83c7d4be-9573-4cd6-b3d8-cee62d805abb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:43:47.342271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-83c7d4be-9573-4cd6-b3d8-cee62d805abb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&fields=id HTTP/1.1" status: 200 len: 302 time: 1.1799941 May 12 15:43:47.517341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b412f7d6-f82f-41a4-a588-b9f97c5b45ab up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:47.564024 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8546616d-ed47-4bb5-a2d8-476a05faf47d None None] Pushing event updated for resources: {'Port': ['ID=ad231b54-6bf2-4f37-9752-72197ecdb6b2,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:47.656795 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8307a2da-c391-4638-b543-8b010694b263') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:47.658685 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8307a2da-c391-4638-b543-8b010694b263') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:47.683436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '420111e5-3d19-4801-ac99-692a805ed38d', 'name': 'tempest-TestAggregatesBasicOps-454973996-router', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57'}], 'enable_snat': True}, 'gw_port_id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:31Z', 'updated_at': '2022-05-12T15:43:39Z', 'revision_number': 3, 'project_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'gw_port': {'id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:ac:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '420111e5-3d19-4801-ac99-692a805ed38d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3518, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:43:36Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:47.712695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c864a22f-5146-485d-8e3d-dd5a1e2ed857 None None] Provisioning for port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:47.772961 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Attempting to bind port ad231b54-6bf2-4f37-9752-72197ecdb6b2 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:47.773626 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Attempting to bind port ad231b54-6bf2-4f37-9752-72197ecdb6b2 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '78dc89b5-762c-4e20-928f-48bda4132660', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:47.774464 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Attempting to bind port ad231b54-6bf2-4f37-9752-72197ecdb6b2 on network ca8599bc-9771-409d-b719-ef5aae5d8e20 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:47.793630 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:47.797263 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Checking segment: {'id': '78dc89b5-762c-4e20-928f-48bda4132660', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:47.797715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Checking router: 420111e5-3d19-4801-ac99-692a805ed38d for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:43:47.798107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Updating router 420111e5-3d19-4801-ac99-692a805ed38d port 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:43:47.799051 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:47.799778 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Bound using segment: {'id': '78dc89b5-762c-4e20-928f-48bda4132660', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:47.800625 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Bound port: ad231b54-6bf2-4f37-9752-72197ecdb6b2, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78dc89b5-762c-4e20-928f-48bda4132660', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:47.805288 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:47.922137 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:47.971221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-d096860d-ff96-4bd7-be73-07defa1eceec service neutron] 10.222.0.82 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4295073 May 12 15:43:47.975444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:47.995723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 550 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:43:48.007478 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:48.118761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c864a22f-5146-485d-8e3d-dd5a1e2ed857 None None] Provisioning complete for port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:48.119216 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c864a22f-5146-485d-8e3d-dd5a1e2ed857 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:48.149189 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] For port ad231b54-6bf2-4f37-9752-72197ecdb6b2, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:48.189630 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] For port ad231b54-6bf2-4f37-9752-72197ecdb6b2, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ad231b54-6bf2-4f37-9752-72197ecdb6b2,segment=NetworkSegment(78dc89b5-762c-4e20-928f-48bda4132660),segment_id=78dc89b5-762c-4e20-928f-48bda4132660)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:48.199869 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: timer() May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:43:48.261725 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:43:48.348632 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:48.378227 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-ced6eec2-fc5c-4f3a-bcac-08f19cc2246e service neutron] 10.222.0.82 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3848131 May 12 15:43:48.435874 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:48.459946 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:48.504170 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f89ffb92-1bce-4ff1-8de5-128bb3979854 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:48.507622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68307782-f3ea-4c57-b3b8-1a4b21c3c540 None None] Network ca8599bc-9771-409d-b719-ef5aae5d8e20 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:43:48.516095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Network': ['ID=b9deb4cb-9fa0-49a9-be85-9674dd8270ae,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:48.519769 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4a9f628e-5f8d-4ff8-8f4b-596e68a321a1 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/b9deb4cb-9fa0-49a9-be85-9674dd8270ae HTTP/1.1" status: 204 len: 168 time: 12.3462462 May 12 15:43:48.525726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42746) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:48.527563 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f89ffb92-1bce-4ff1-8de5-128bb3979854 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:48.539838 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:48.573335 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:48.574372 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:48.582774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c864a22f-5146-485d-8e3d-dd5a1e2ed857 None None] Port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:43:48.681823 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b306d6b-5efe-4f26-ac0e-a1937776add8 req-d1bbad79-fb4e-48f8-854c-62e48a017176 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.3005309 May 12 15:43:48.717141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Allocated IP 172.20.0.1 (4365c129-804f-4de1-8f2b-afafcddb88c8/341bc8b1-1137-42ab-8609-e6e2102116ba/b9c2d2b5-8819-4be1-a8e6-613616dac8fe) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:48.733848 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-5c31ab01-6900-41f4-98de-2faba6f6d34b tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:48.734653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5c31ab01-6900-41f4-98de-2faba6f6d34b tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:48.749454 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5c31ab01-6900-41f4-98de-2faba6f6d34b tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/subnets/bda53641-de7e-4811-aa4e-6fb0c73cc567 HTTP/1.1" status: 404 len: 337 time: 0.1970673 May 12 15:43:48.762241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 42754) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:48.838119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b412f7d6-f82f-41a4-a588-b9f97c5b45ab triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:48.838312 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:49.008592 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-0894d2e3-d557-4d4c-bc29-5c5fdee9d220 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:49.009066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0894d2e3-d557-4d4c-bc29-5c5fdee9d220 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:49.010860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0894d2e3-d557-4d4c-bc29-5c5fdee9d220 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/b9deb4cb-9fa0-49a9-be85-9674dd8270ae HTTP/1.1" status: 404 len: 339 time: 0.2473950 May 12 15:43:49.025803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f89ffb92-1bce-4ff1-8de5-128bb3979854 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 766c87d1-88c8-4b7e-ba13-f65737b66f8b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:43:49.036539 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42774) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:49.082057 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8546616d-ed47-4bb5-a2d8-476a05faf47d None None] Pushing event updated for resources: {'Port': ['ID=ad231b54-6bf2-4f37-9752-72197ecdb6b2,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:49.193380 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-2764f29e-74ce-43d2-861f-12c0d7345684 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:49.240635 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:49.241376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2764f29e-74ce-43d2-861f-12c0d7345684 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:49.246072 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2764f29e-74ce-43d2-861f-12c0d7345684 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/subnets/b962a435-3d4a-4dc3-80fb-28d1abce7090 HTTP/1.1" status: 404 len: 337 time: 0.2079437 May 12 15:43:49.286777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42780) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:49.391375 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-90315b8a-5560-4d70-8de3-461111237b27 req-cd930ad2-5cc6-44bb-9a9d-4eef181d6123 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 210 time: 0.5326946 May 12 15:43:49.499807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0412151f-aef4-4b22-a9ab-0bc0d2b68b17 None None] Provisioning for port db282676-b200-482c-b8ba-dc814d43f534 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:49.618474 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:49.679275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Transition to ACTIVE for port object b9c2d2b5-8819-4be1-a8e6-613616dac8fe will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:49.739239 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:49.873061 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-5f739e92-7b8c-41dc-901a-446261cfb97d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:49.873976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5f739e92-7b8c-41dc-901a-446261cfb97d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:49.877578 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5f739e92-7b8c-41dc-901a-446261cfb97d tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/ffb6d613-173f-4cc2-8063-033ddddc447e HTTP/1.1" status: 404 len: 339 time: 0.2793741 May 12 15:43:49.900861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42798) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:49.903117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0412151f-aef4-4b22-a9ab-0bc0d2b68b17 None None] Provisioning complete for port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:49.904206 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0412151f-aef4-4b22-a9ab-0bc0d2b68b17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:49.912294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Network 4365c129-804f-4de1-8f2b-afafcddb88c8 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:49.917396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Pushing event updated for resources: {'Port': ['ID=b9c2d2b5-8819-4be1-a8e6-613616dac8fe,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:49.924716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:49.941895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:50.281820 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e39130dd-83e4-4cbf-acef-e022aceb4f98 req-b454c3d4-ae4c-45ee-914e-75b87c194326 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.3651562 May 12 15:43:50.301219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:50.301880 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ba99086-ea93-4868-b0cb-e0e73138c598 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:50.312364 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:50.319332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f89ffb92-1bce-4ff1-8de5-128bb3979854 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:43:50.334391 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f89ffb92-1bce-4ff1-8de5-128bb3979854 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:50.338402 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f89ffb92-1bce-4ff1-8de5-128bb3979854 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b HTTP/1.1" status: 200 len: 934 time: 5.6263797 May 12 15:43:50.343101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42814) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:50.539148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0412151f-aef4-4b22-a9ab-0bc0d2b68b17 None None] Port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:43:50.587644 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] It took 0.19 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:43:50.598274 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:46Z', 'revision_number': 6, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:43:37Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:26Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ad231b54-6bf2-4f37-9752-72197ecdb6b2', 'name': '', 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:e1:83:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3521, 'fixed_ips': [{'subnet_id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:36Z', 'updated_at': '2022-05-12T15:43:48Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:50.612137 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e41a510-968c-4d65-a53c-b5e102c8c705 None None] The sync data for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 is: [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:46Z', 'revision_number': 6, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:43:37Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:26Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ad231b54-6bf2-4f37-9752-72197ecdb6b2', 'name': '', 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:e1:83:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3521, 'fixed_ips': [{'subnet_id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:36Z', 'updated_at': '2022-05-12T15:43:48Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:43:50.809116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a78dbd1c-09fd-47f0-b421-df33ce9dc0aa req-a2b4dee0-4356-476b-943f-830b3b1bea4e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 210 time: 0.2828302 May 12 15:43:50.899192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a4a95f9e-e163-43d7-b6fb-10061be5c8de None None] Provisioning for port b9c2d2b5-8819-4be1-a8e6-613616dac8fe completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:50.900857 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:50.974992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a4a95f9e-e163-43d7-b6fb-10061be5c8de None None] Provisioning complete for port b9c2d2b5-8819-4be1-a8e6-613616dac8fe triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:50.975647 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4a95f9e-e163-43d7-b6fb-10061be5c8de None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:51.039261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:51.063131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:51.063131 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:51.089368 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ba99086-ea93-4868-b0cb-e0e73138c598 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:51.171133 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-06828b16-9c71-416c-9a56-a84ceae2af7d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b HTTP/1.1" status: 200 len: 934 time: 0.7948000 May 12 15:43:51.175192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42830) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:51.182820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-df8e240b-5d6d-4d8b-b24c-a72fe0bca748 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'router': {'routes': None}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:51.189502 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:51.424004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Transition to ACTIVE for port object 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:51.431479 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a4a95f9e-e163-43d7-b6fb-10061be5c8de None None] Port b9c2d2b5-8819-4be1-a8e6-613616dac8fe cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:43:51.470616 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:51.523170 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:51.802133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-842e1103-ed94-42e2-adb4-e0cf15ff58bf req-9266ea28-ccf5-4ecf-9df3-de15b789b74b tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.2026649 May 12 15:43:51.831391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8ba99086-ea93-4868-b0cb-e0e73138c598 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['25cda344-9ad0-4bd1-9239-c9412279c118']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:51.853340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087,segment=NetworkSegment(1bca247c-f07d-45c8-9a50-17cd07b7f0b5),segment_id=1bca247c-f07d-45c8-9a50-17cd07b7f0b5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:51.856604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8ba99086-ea93-4868-b0cb-e0e73138c598 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '31803763-e200-4b74-931a-4ecc18c92862') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:51.857168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8ba99086-ea93-4868-b0cb-e0e73138c598 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '31803763-e200-4b74-931a-4ecc18c92862') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:51.875954 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ba99086-ea93-4868-b0cb-e0e73138c598 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:51.904263 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:51.912324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 71e8fce5-504b-42e3-96ac-f1d3aa801337 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:51.913729 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ba99086-ea93-4868-b0cb-e0e73138c598 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:51.925624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8ba99086-ea93-4868-b0cb-e0e73138c598 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 583 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:43:51.926378 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ba99086-ea93-4868-b0cb-e0e73138c598 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:52.015698 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:52.023906 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ee4078c-1049-48c0-b1a1-83c8d7c71625 None None] Pushing event updated for resources: {'Port': ['ID=4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:52.030087 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:52.033234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-16a361e6-7723-47ab-b333-b9cfcf2228d8 None None] Provisioning for port ad231b54-6bf2-4f37-9752-72197ecdb6b2 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:52.050359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Attempting to bind port 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:43:52.051146 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Attempting to bind port 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:43:52.051580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Attempting to bind port 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: timer() May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:43:52.133592 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:43:52.183476 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ba99086-ea93-4868-b0cb-e0e73138c598 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:52.190313 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ba99086-ea93-4868-b0cb-e0e73138c598 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:52.211223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:43:52.211596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:43:52.211992 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:52.212431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:43:52.212906 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Bound port: 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:43:52.213270 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:52.435326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Sync routers for ids ['943c296a-7f18-4231-8088-35f5348abd2b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:43:52.472568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 71e8fce5-504b-42e3-96ac-f1d3aa801337 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:52.507007 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8ba99086-ea93-4868-b0cb-e0e73138c598 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/25cda344-9ad0-4bd1-9239-c9412279c118 HTTP/1.1" status: 204 len: 168 time: 2.6048658 May 12 15:43:52.511284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42852) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:52.512027 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eec8707-d23e-4ef6-9b0d-0978a3c34407 None None] Sync routers for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:43:52.518168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 71e8fce5-504b-42e3-96ac-f1d3aa801337 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:52.527070 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:52.529977 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2eec8707-d23e-4ef6-9b0d-0978a3c34407 None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:52.530771 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2eec8707-d23e-4ef6-9b0d-0978a3c34407 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:52.539356 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:52.541820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ba99086-ea93-4868-b0cb-e0e73138c598 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Network': ['ID=25cda344-9ad0-4bd1-9239-c9412279c118,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:52.665069 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-7c3b9ec0-6a98-4a3f-9671-e5e391612dbe tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:52.672313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7c3b9ec0-6a98-4a3f-9671-e5e391612dbe tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:52.677361 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7c3b9ec0-6a98-4a3f-9671-e5e391612dbe tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/subnets/91af63f0-a0de-4689-8eeb-43465326e6bc HTTP/1.1" status: 404 len: 337 time: 0.1294026 May 12 15:43:52.681196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42856) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:52.710403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0470e84-aabc-4afb-ba38-67f7083ad933 req-9aa5418d-9397-4653-9789-d0eb1d142de3 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 210 time: 0.4868383 May 12 15:43:52.812628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:52.821868 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-d34e62b0-6c1b-49fe-ad45-7cad3a440c08 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:52.827331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d34e62b0-6c1b-49fe-ad45-7cad3a440c08 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:52.839808 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d34e62b0-6c1b-49fe-ad45-7cad3a440c08 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/24409778-26af-450e-bd36-8aed94ba9962 HTTP/1.1" status: 404 len: 339 time: 0.1501942 May 12 15:43:52.854316 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-2eec8707-d23e-4ef6-9b0d-0978a3c34407 None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:52.866096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Routers {'943c296a-7f18-4231-8088-35f5348abd2b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:52.869258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['943c296a-7f18-4231-8088-35f5348abd2b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:53.194224 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] For port 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:43:53.201926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83e996f2-8668-4766-a92c-64450f1132e8 None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:43:53.243063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42866) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:53.406071 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-fe4e5778-a9f2-479a-9c7e-292276d15080 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:53.406755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fe4e5778-a9f2-479a-9c7e-292276d15080 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:53.408673 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fe4e5778-a9f2-479a-9c7e-292276d15080 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/subnets/756437ea-72fb-4c6c-87d1-493b79c95b65 HTTP/1.1" status: 404 len: 337 time: 0.1644483 May 12 15:43:53.458430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42876) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:53.513699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-360c98b8-62c6-4290-bf10-922d62321320 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=f5159f7227ee44cd86967cf5c8d430ab&shared=False HTTP/1.1" status: 200 len: 213 time: 0.7961161 May 12 15:43:53.524792 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-290d1414-72c9-4b5c-b9c3-43717306d73b tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:53.525564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-290d1414-72c9-4b5c-b9c3-43717306d73b tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:53.527397 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-290d1414-72c9-4b5c-b9c3-43717306d73b tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/2f2e6006-9725-4937-a104-551037cea5df HTTP/1.1" status: 404 len: 339 time: 0.0644937 May 12 15:43:53.541508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42882) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:53.633522 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-efe0b84c-d728-45c0-8ffd-548de83f1033 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:53.634336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-efe0b84c-d728-45c0-8ffd-548de83f1033 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:53.636245 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-efe0b84c-d728-45c0-8ffd-548de83f1033 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/subnets/91efeefd-e105-428d-b421-3bbf7081108f HTTP/1.1" status: 404 len: 337 time: 0.0935254 May 12 15:43:53.642725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42886) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:53.680506 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-0e979277-4691-4eda-83b6-1c49af660dc0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:53.681151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0e979277-4691-4eda-83b6-1c49af660dc0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:53.683171 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0e979277-4691-4eda-83b6-1c49af660dc0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/41b81980-9704-4848-95a5-e3989ab3e0e1 HTTP/1.1" status: 404 len: 339 time: 0.0365713 May 12 15:43:53.700674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42890) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:53.765713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-06af1a5d-31f1-41d6-9c57-89a1e19a2483 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:53.767657 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-eaa7d3ac-3d2e-4ae6-a2df-da67f735dffe tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:53.768275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-eaa7d3ac-3d2e-4ae6-a2df-da67f735dffe tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:53.770169 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-eaa7d3ac-3d2e-4ae6-a2df-da67f735dffe tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/subnets/57c9e184-0c3a-401a-a796-a55ba127c886 HTTP/1.1" status: 404 len: 337 time: 0.0683272 May 12 15:43:53.773320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-06af1a5d-31f1-41d6-9c57-89a1e19a2483 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2018404 May 12 15:43:53.775434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42896) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:53.836238 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83b47b9e-c27d-428d-aada-a67793a3bfe9 req-88e275ef-0d24-42bc-abaa-6c0a14ba33cb tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.3182263 May 12 15:43:53.836923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Pushing event updated for resources: {'Port': ['ID=b9c2d2b5-8819-4be1-a8e6-613616dac8fe,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:53.859853 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Request body: {'port': {'device_id': '68685fe3-34ed-4c8e-94b3-acfbd69762b2', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': 'f5159f7227ee44cd86967cf5c8d430ab'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:53.899541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Network 4365c129-804f-4de1-8f2b-afafcddb88c8 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:53.911458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-dd8a99eb-8695-49e9-923b-f8f56aae3fe2 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:53.912902 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-dd8a99eb-8695-49e9-923b-f8f56aae3fe2 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "GET /v2.0/networks?id=03979098-a904-494a-a852-b458bf7ca658 HTTP/1.1" status: 200 len: 796 time: 0.5741694 May 12 15:43:53.915147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:53.916848 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-19307fc0-a46b-4efe-b568-a98518edfa80 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:53.917743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-19307fc0-a46b-4efe-b568-a98518edfa80 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:53.925111 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-19307fc0-a46b-4efe-b568-a98518edfa80 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/9a79ad24-946b-41a1-bdbe-c20077c0d5d4 HTTP/1.1" status: 404 len: 339 time: 0.1187544 May 12 15:43:53.932364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42900) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:54.046248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83e996f2-8668-4766-a92c-64450f1132e8 None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:43:54.067656 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-d1a320e5-8fd8-4098-8a70-84a45a33d42c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:54.068340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d1a320e5-8fd8-4098-8a70-84a45a33d42c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:54.070234 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d1a320e5-8fd8-4098-8a70-84a45a33d42c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/subnets/ea012f0f-a39c-4c23-b465-d2bbe7722d79 HTTP/1.1" status: 404 len: 337 time: 0.1344423 May 12 15:43:54.084203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42908) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:54.205266 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-c0fb0e5f-8e04-4ecd-a9da-bdadff406c0f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b641518781114418963451fc3ff58f4d HTTP/1.1" status: 200 len: 379 time: 0.1626186 May 12 15:43:54.206564 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-cf32b3b1-a7bc-4a3f-963f-af84a17788ca tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:54.207155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cf32b3b1-a7bc-4a3f-963f-af84a17788ca tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:54.209866 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cf32b3b1-a7bc-4a3f-963f-af84a17788ca tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/e597fb0b-9e76-4c25-9036-4b7d38fe0fac HTTP/1.1" status: 404 len: 339 time: 0.1245208 May 12 15:43:54.212727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42914) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:54.215577 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2eec8707-d23e-4ef6-9b0d-0978a3c34407 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:46Z', 'revision_number': 6, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:43:37Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:26Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ad231b54-6bf2-4f37-9752-72197ecdb6b2', 'name': '', 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:e1:83:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3521, 'fixed_ips': [{'subnet_id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:36Z', 'updated_at': '2022-05-12T15:43:48Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:54.221317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'port': {'device_id': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'admin_state_up': True, 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'security_groups': ['7ef93a22-5ccd-49ce-bc3f-8fb5236953da']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:54.224579 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eec8707-d23e-4ef6-9b0d-0978a3c34407 None None] Checking router: 766c87d1-88c8-4b7e-ba13-f65737b66f8b for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:43:54.243845 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2eec8707-d23e-4ef6-9b0d-0978a3c34407 None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:54.244636 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2eec8707-d23e-4ef6-9b0d-0978a3c34407 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:54.370578 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-fcde8981-973e-43f6-86be-397cc476d191 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:54.371265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fcde8981-973e-43f6-86be-397cc476d191 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:54.373155 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fcde8981-973e-43f6-86be-397cc476d191 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/subnets/03ced78f-fc15-4f1c-b3b2-cf343514d16d HTTP/1.1" status: 404 len: 337 time: 0.1593099 May 12 15:43:54.388149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42918) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:54.444507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Set router 943c296a-7f18-4231-8088-35f5348abd2b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:54.463137 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-cd15c3b2-09cc-47ab-b8de-0d542c1315ca tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:54.463829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cd15c3b2-09cc-47ab-b8de-0d542c1315ca tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:54.465730 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cd15c3b2-09cc-47ab-b8de-0d542c1315ca tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/0a1cb1b8-fedd-44cd-8861-68218cde1108 HTTP/1.1" status: 404 len: 339 time: 0.0739441 May 12 15:43:54.481446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42922) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:54.535237 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-2eec8707-d23e-4ef6-9b0d-0978a3c34407 None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:54.570300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] For port 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:43:54.620220 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21b56270-98e3-43f4-8db3-f7dc752f5743 req-a22c618f-5c84-4c82-81a9-30a7f503ab2c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 210 time: 0.5069580 May 12 15:43:54.662313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:54.670580 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:54.800312 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-24b657cf-f0e4-49dc-a15a-750faabbe876 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:54.800695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-24b657cf-f0e4-49dc-a15a-750faabbe876 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:54.802539 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-24b657cf-f0e4-49dc-a15a-750faabbe876 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/subnets/4534fd1b-da0a-478b-a9c7-1e8ce0928260 HTTP/1.1" status: 404 len: 337 time: 0.3197818 May 12 15:43:54.811275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42932) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:54.862002 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-6bd06e69-5103-41f2-a7bc-5189f33087ff tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:54.862507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6bd06e69-5103-41f2-a7bc-5189f33087ff tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:54.864300 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6bd06e69-5103-41f2-a7bc-5189f33087ff tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/566e59cb-660c-471c-af55-3740a3424b0e HTTP/1.1" status: 404 len: 339 time: 0.0521357 May 12 15:43:54.873381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42936) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:54.879746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Usage tracker for resource:port and tenant:f5159f7227ee44cd86967cf5c8d430ab is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:54.887573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ee4078c-1049-48c0-b1a1-83c8d7c71625 None None] Pushing event updated for resources: {'Port': ['ID=4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:54.889812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:54.904820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:54.938947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Made reservation on behalf of f5159f7227ee44cd86967cf5c8d430ab for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:54.942422 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:54.986561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.extraroute_db [None req-df8e240b-5d6d-4d8b-b24c-a72fe0bca748 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Added routes are [] {{(pid=88151) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:114}} May 12 15:43:54.987138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.extraroute_db [None req-df8e240b-5d6d-4d8b-b24c-a72fe0bca748 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Removed routes are [{'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}] {{(pid=88151) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:122}} May 12 15:43:54.993800 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-b0094ea0-c87d-4b22-be5b-a47ce22179b0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:54.994253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b0094ea0-c87d-4b22-be5b-a47ce22179b0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:54.996091 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b0094ea0-c87d-4b22-be5b-a47ce22179b0 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/subnets/d28f3368-b00e-4b54-a04f-30435b09f7f4 HTTP/1.1" status: 404 len: 337 time: 0.1193261 May 12 15:43:55.004370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42942) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:55.011901 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:55.029861 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Router 420111e5-3d19-4801-ac99-692a805ed38d has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:43:55.038381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:55.044790 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Usage tracker for resource:security_group_rule and tenant:f5159f7227ee44cd86967cf5c8d430ab is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:43:55.049820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:43:55.078253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:43:55.106533 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-b785c523-3a39-4755-a30c-c3fb20bb80c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] DELETE failed (client error): The resource could not be found. May 12 15:43:55.106998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b785c523-3a39-4755-a30c-c3fb20bb80c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:43:55.111137 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b785c523-3a39-4755-a30c-c3fb20bb80c3 tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/d4051fa3-866b-4e92-9d53-e0a2eeb36b88 HTTP/1.1" status: 404 len: 339 time: 0.0925286 May 12 15:43:55.125646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 42946) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:55.201870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:55.214044 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-df8e240b-5d6d-4d8b-b24c-a72fe0bca748 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:55.288132 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2eec8707-d23e-4ef6-9b0d-0978a3c34407 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:46Z', 'revision_number': 6, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:43:37Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:26Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ad231b54-6bf2-4f37-9752-72197ecdb6b2', 'name': '', 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:e1:83:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3521, 'fixed_ips': [{'subnet_id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:36Z', 'updated_at': '2022-05-12T15:43:48Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:55.304566 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eec8707-d23e-4ef6-9b0d-0978a3c34407 None None] The sync data for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 is: [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:46Z', 'revision_number': 6, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:43:37Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:26Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ad231b54-6bf2-4f37-9752-72197ecdb6b2', 'name': '', 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:e1:83:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3521, 'fixed_ips': [{'subnet_id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:36Z', 'updated_at': '2022-05-12T15:43:48Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:43:55.393219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:43:55.424607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:43:55.496019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-38660154-aa48-4416-a374-423ee3a70ee4 admin admin] 10.222.0.82 "PUT /v2.0/routers/420111e5-3d19-4801-ac99-692a805ed38d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.3931804 May 12 15:43:55.515211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Routers {'420111e5-3d19-4801-ac99-692a805ed38d'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:55.515927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['420111e5-3d19-4801-ac99-692a805ed38d'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:55.529943 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41551486-cd73-4c4c-8ac8-b87c33e493ed req-9bcab336-25fb-4baf-9bad-1659e59ede92 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.2237771 May 12 15:43:55.594309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Made reservation on behalf of b641518781114418963451fc3ff58f4d for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:43:55.598795 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:55.668077 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:55.781724 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:55.789820 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:55.962646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Allocated IP 192.168.233.119 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:56.036396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1515931f-5ca8-49a5-a679-083278fc54dd,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:56.083571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-df8e240b-5d6d-4d8b-b24c-a72fe0bca748 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:56.087387 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-df8e240b-5d6d-4d8b-b24c-a72fe0bca748 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:56.098622 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c470f5e5-e008-4b21-938d-be75e8fbe638 req-1bf35a4e-4fc4-419a-ae0d-345275c69165 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 210 time: 0.0651274 May 12 15:43:56.109012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-9b10d215-bc85-4069-b018-6bc4de64b95e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Deleting subnet 1c5479d5-6152-4084-8920-dc74c2e667c5 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:43:56.118909 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9b10d215-bc85-4069-b018-6bc4de64b95e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:56.357486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9b10d215-bc85-4069-b018-6bc4de64b95e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:56.447059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] Set router 420111e5-3d19-4801-ac99-692a805ed38d gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:56.507899 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 71e8fce5-504b-42e3-96ac-f1d3aa801337, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=71e8fce5-504b-42e3-96ac-f1d3aa801337,segment=NetworkSegment(7a44f3c7-0903-4bb2-a8d6-58ca1555771d),segment_id=7a44f3c7-0903-4bb2-a8d6-58ca1555771d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:56.516418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:56.538200 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:56.539783 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f1e033f3-b048-470b-ac02-cd534e3f1483 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:56.553278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Transition to ACTIVE for port object c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:56.615869 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:56.820576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:43:56.823568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=71e8fce5-504b-42e3-96ac-f1d3aa801337,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:56.834824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-df8e240b-5d6d-4d8b-b24c-a72fe0bca748 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 766c87d1-88c8-4b7e-ba13-f65737b66f8b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:43:57.249074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:43:57.258301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:43:57.414891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-df8e240b-5d6d-4d8b-b24c-a72fe0bca748 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:43:57.448941 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-df8e240b-5d6d-4d8b-b24c-a72fe0bca748 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:57.455547 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-df8e240b-5d6d-4d8b-b24c-a72fe0bca748 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b HTTP/1.1" status: 200 len: 700 time: 6.2793508 May 12 15:43:57.456519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43006) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:57.577545 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69e147ec-d7c7-4e53-beba-741d75119e4d None None] Sync routers for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:43:57.583863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:57.584627 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:57.599083 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f1e033f3-b048-470b-ac02-cd534e3f1483 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:43:57.630478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Pushing event updated for resources: {'Port': ['ID=c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:57.650407 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a89f850-8a7a-4fb5-bb21-f8824d045565 req-e302fe6a-4209-4c9d-a4c8-270effc17eea tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 210 time: 0.1398404 May 12 15:43:57.703130 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ec3c5b67-ada2-456c-881a-8957de49fd67 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 3.8982885 May 12 15:43:57.705010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f1e033f3-b048-470b-ac02-cd534e3f1483 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:43:57.705956 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:57.758298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3678378-ca16-4fef-9601-9a9979fb973f req-b4122ade-afac-4936-af7a-b95679f3f1bf tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:43:57.760056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d3678378-ca16-4fef-9601-9a9979fb973f req-b4122ade-afac-4936-af7a-b95679f3f1bf tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Synchronizing usage tracker for tenant:f5159f7227ee44cd86967cf5c8d430ab on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:43:57.815752 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69e147ec-d7c7-4e53-beba-741d75119e4d None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:43:57.816796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-69e147ec-d7c7-4e53-beba-741d75119e4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:57.824846 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9b10d215-bc85-4069-b018-6bc4de64b95e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:57.827535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d3678378-ca16-4fef-9601-9a9979fb973f req-b4122ade-afac-4936-af7a-b95679f3f1bf tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Unset dirty status for tenant:f5159f7227ee44cd86967cf5c8d430ab on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:43:57.836065 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3678378-ca16-4fef-9601-9a9979fb973f req-b4122ade-afac-4936-af7a-b95679f3f1bf tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 936 time: 1.0311344 May 12 15:43:57.920922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d3678378-ca16-4fef-9601-9a9979fb973f req-1d26a14a-b1c9-440a-a379-538e21afc141 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Synchronizing usage tracker for tenant:f5159f7227ee44cd86967cf5c8d430ab on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:43:57.978374 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d3678378-ca16-4fef-9601-9a9979fb973f req-1d26a14a-b1c9-440a-a379-538e21afc141 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Unset dirty status for tenant:f5159f7227ee44cd86967cf5c8d430ab on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:43:57.998051 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3678378-ca16-4fef-9601-9a9979fb973f req-1d26a14a-b1c9-440a-a379-538e21afc141 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/security-groups?id=1515931f-5ca8-49a5-a679-083278fc54dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1589839 May 12 15:43:58.015186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Request body: {'port': {'device_id': '68685fe3-34ed-4c8e-94b3-acfbd69762b2', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:43:58.052186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Allocated IP 172.20.0.8 (03979098-a904-494a-a852-b458bf7ca658/501ff294-e32c-494b-9718-ec96b39fa231/42a296ea-fb47-4109-8501-772157438fa6) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:43:58.140564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43034) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:58.144566 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c0eaa1a9-87b8-49f0-a874-d7f7061e1b0e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b HTTP/1.1" status: 200 len: 700 time: 0.6821599 May 12 15:43:58.223806 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9b10d215-bc85-4069-b018-6bc4de64b95e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:58.357953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:43:35Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:43:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:43:36Z', 'revision_number': 2, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:58.364949 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9b10d215-bc85-4069-b018-6bc4de64b95e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:58.386370 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:58.473106 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba030034-3bfc-4e03-8b58-b0ee2113cca5 None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:43:58.480576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b10d215-bc85-4069-b018-6bc4de64b95e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Subnet': ['ID=1c5479d5-6152-4084-8920-dc74c2e667c5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:43:58.531013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-69e147ec-d7c7-4e53-beba-741d75119e4d None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:43:58.568812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43052) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:58.595747 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9b10d215-bc85-4069-b018-6bc4de64b95e tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/subnets/1c5479d5-6152-4084-8920-dc74c2e667c5 HTTP/1.1" status: 204 len: 168 time: 3.4596581 May 12 15:43:58.602832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43054) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:43:58.754420 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '420111e5-3d19-4801-ac99-692a805ed38d', 'name': 'tempest-TestAggregatesBasicOps-454973996-router', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57'}], 'enable_snat': True}, 'gw_port_id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:31Z', 'updated_at': '2022-05-12T15:43:50Z', 'revision_number': 4, 'project_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'gw_port': {'id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:ac:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '420111e5-3d19-4801-ac99-692a805ed38d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3518, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:43:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'b9c2d2b5-8819-4be1-a8e6-613616dac8fe', 'name': '', 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'mac_address': 'fa:16:3e:e5:67:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '420111e5-3d19-4801-ac99-692a805ed38d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3532, 'fixed_ips': [{'subnet_id': '341bc8b1-1137-42ab-8609-e6e2102116ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:46Z', 'updated_at': '2022-05-12T15:43:51Z', 'revision_number': 2, 'project_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'subnets': [{'id': '341bc8b1-1137-42ab-8609-e6e2102116ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:43:58.771251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Checking router: 943c296a-7f18-4231-8088-35f5348abd2b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:43:58.771598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Updating router 943c296a-7f18-4231-8088-35f5348abd2b port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:43:58.787216 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:58.818768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Deleting port 58977900-9ffe-410f-9737-9a0b0966441c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:43:58.819570 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:58.863717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-990ba421-0e0d-4600-850b-56c6ba9f3b0a None None] The sync data for ids ['420111e5-3d19-4801-ac99-692a805ed38d'] in n-d-841483-1 is: [{'id': '420111e5-3d19-4801-ac99-692a805ed38d', 'name': 'tempest-TestAggregatesBasicOps-454973996-router', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57'}], 'enable_snat': True}, 'gw_port_id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:31Z', 'updated_at': '2022-05-12T15:43:50Z', 'revision_number': 4, 'project_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'gw_port': {'id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:ac:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '420111e5-3d19-4801-ac99-692a805ed38d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3518, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:43:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'b9c2d2b5-8819-4be1-a8e6-613616dac8fe', 'name': '', 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'mac_address': 'fa:16:3e:e5:67:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '420111e5-3d19-4801-ac99-692a805ed38d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3532, 'fixed_ips': [{'subnet_id': '341bc8b1-1137-42ab-8609-e6e2102116ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:46Z', 'updated_at': '2022-05-12T15:43:51Z', 'revision_number': 2, 'project_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'subnets': [{'id': '341bc8b1-1137-42ab-8609-e6e2102116ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:43:58.933149 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:58.985908 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:59.116956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Transition to ACTIVE for port object 42a296ea-fb47-4109-8501-772157438fa6 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:43:59.230834 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:59.364776 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de59b390-7302-4460-a184-afbe49953540 req-dc0c05b3-7f29-4a4b-9902-b3715963f030 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 210 time: 0.2767634 May 12 15:43:59.464296 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port f1e033f3-b048-470b-ac02-cd534e3f1483, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f1e033f3-b048-470b-ac02-cd534e3f1483,segment=NetworkSegment(0e218190-12cd-4c5d-a26e-6453816fe1e4),segment_id=0e218190-12cd-4c5d-a26e-6453816fe1e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:59.557153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] For port 58977900-9ffe-410f-9737-9a0b0966441c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=58977900-9ffe-410f-9737-9a0b0966441c,segment=NetworkSegment(a41b8a4b-e33b-44a9-be4e-365dd4b0e017),segment_id=a41b8a4b-e33b-44a9-be4e-365dd4b0e017)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:43:59.558645 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:59.558767 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:43:59.559755 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2d578718-1ffe-4a5e-a184-b9aac0d60c36 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:43:59.778875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Calling delete_port for 58977900-9ffe-410f-9737-9a0b0966441c owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:43:59.846435 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:00.057144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 03979098-a904-494a-a852-b458bf7ca658 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:44:00.075686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:00.088821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:44:00.146287 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=42a296ea-fb47-4109-8501-772157438fa6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:00.226859 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:00.384236 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:00.633867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Port': ['ID=58977900-9ffe-410f-9737-9a0b0966441c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:00.661254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:00.661992 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:00.668776 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba030034-3bfc-4e03-8b58-b0ee2113cca5 None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:44:00.685176 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Transition to ACTIVE for port object 4c9c52d9-7be2-45c7-82f5-d4e254eec55f will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:44:00.715030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] No DVR routers for this DVR port 58977900-9ffe-410f-9737-9a0b0966441c on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:44:00.754595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad29b5c-7b49-4a32-a09a-b34ef2e85b31 req-a6366321-a76f-4ed7-9005-de73b75fc68f tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:00.762397 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ad29b5c-7b49-4a32-a09a-b34ef2e85b31 req-a6366321-a76f-4ed7-9005-de73b75fc68f tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 936 time: 1.3654315 May 12 15:44:00.781790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:00.782152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:00.782504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:00.782830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:00.783151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:00.783472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:00.783768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:00.784093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:00.784392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:00.784704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:00.785010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:00.785331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:00.793154 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:00.838981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:44:00.902104 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:00.976392 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:01.010304 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-bdb957be-4cb7-4aab-a3e5-f7857183a276 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 6.7935739 May 12 15:44:01.047633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Request body: {'port': {'device_id': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:01.067210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=f1e033f3-b048-470b-ac02-cd534e3f1483,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:01.123642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ad29b5c-7b49-4a32-a09a-b34ef2e85b31 req-6c117630-93c5-4459-9756-f81953da5aa5 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/security-groups?id=1515931f-5ca8-49a5-a679-083278fc54dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3587193 May 12 15:44:01.174829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Transition to ACTIVE for port object c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:44:01.201216 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:01.298899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['06314778-8dc3-40db-a6f5-f8126f80fd1e']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:01.368841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a41b8a4b-e33b-44a9-be4e-365dd4b0e017') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:01.369119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a41b8a4b-e33b-44a9-be4e-365dd4b0e017') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:01.398097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Pushing event updated for resources: {'Port': ['ID=c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:01.436769 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:01.465286 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:01.475379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Releasing vlan 553 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:44:01.476075 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:01.566430 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26de1030-7488-4383-a97c-d8305c3cf975 req-b7cc6fa7-8cfe-41d5-910a-d4cb8a30a904 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:01.568289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-26de1030-7488-4383-a97c-d8305c3cf975 req-b7cc6fa7-8cfe-41d5-910a-d4cb8a30a904 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 931 time: 0.9183452 May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: timer() May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:44:01.635952 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:44:01.681977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:01.706881 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-69e147ec-d7c7-4e53-beba-741d75119e4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:55Z', 'revision_number': 7, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:43:37Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:56Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ad231b54-6bf2-4f37-9752-72197ecdb6b2', 'name': '', 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:e1:83:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3521, 'fixed_ips': [{'subnet_id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:36Z', 'updated_at': '2022-05-12T15:43:48Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:01.829502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Attempting to bind port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:44:01.829865 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Attempting to bind port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '0e218190-12cd-4c5d-a26e-6453816fe1e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 585, 'network_id': '03979098-a904-494a-a852-b458bf7ca658'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:44:01.830222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Attempting to bind port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f on network 03979098-a904-494a-a852-b458bf7ca658 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:44:01.838868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2d578718-1ffe-4a5e-a184-b9aac0d60c36 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:01.839094 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:01.910700 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-450a72e1-653a-4df6-aaa1-4bd96cf19c5c None None] Pushing event updated for resources: {'Port': ['ID=4c9c52d9-7be2-45c7-82f5-d4e254eec55f,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:01.917202 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69e147ec-d7c7-4e53-beba-741d75119e4d None None] Checking router: 766c87d1-88c8-4b7e-ba13-f65737b66f8b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:44:01.941056 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-26de1030-7488-4383-a97c-d8305c3cf975 req-d83bfb91-9947-4b9d-81aa-dd14b39b2d91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=7ef93a22-5ccd-49ce-bc3f-8fb5236953da&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3313823 May 12 15:44:01.943707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Attempting to bind port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:44:01.943707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Attempting to bind port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:44:01.943707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Attempting to bind port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:44:01.952455 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:44:01.952825 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Checking segment: {'id': '0e218190-12cd-4c5d-a26e-6453816fe1e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 585, 'network_id': '03979098-a904-494a-a852-b458bf7ca658'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:44:01.953223 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:01.953689 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Bound using segment: {'id': '0e218190-12cd-4c5d-a26e-6453816fe1e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 585, 'network_id': '03979098-a904-494a-a852-b458bf7ca658'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:44:01.954229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Bound port: 4c9c52d9-7be2-45c7-82f5-d4e254eec55f, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0e218190-12cd-4c5d-a26e-6453816fe1e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 585, 'network_id': '03979098-a904-494a-a852-b458bf7ca658'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:44:01.954598 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:01.996619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:44:01.996934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Attempting to bind port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:44:02.017076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:44:02.017501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:44:02.021997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:44:02.022464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Bound port: c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:44:02.027456 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:02.105369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] For port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:44:02.109286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] For port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4c9c52d9-7be2-45c7-82f5-d4e254eec55f,segment=NetworkSegment(0e218190-12cd-4c5d-a26e-6453816fe1e4),segment_id=0e218190-12cd-4c5d-a26e-6453816fe1e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:44:02.114328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69e147ec-d7c7-4e53-beba-741d75119e4d None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:02.115172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-69e147ec-d7c7-4e53-beba-741d75119e4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:02.259896 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:02.340464 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-323691d4-331d-4ea1-a50a-cafd76e3f367 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:02.370042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:02.373731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 42a296ea-fb47-4109-8501-772157438fa6 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:44:02.409546 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:02.416705 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:02.420874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] Pushing event deleted for resources: {'Network': ['ID=06314778-8dc3-40db-a6f5-f8126f80fd1e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:02.451699 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2166c9f1-34ac-4e40-9b56-9bec95469b4c tempest-NetworksTest-1375103197 tempest-NetworksTest-1375103197-project] 10.222.0.82 "DELETE /v2.0/networks/06314778-8dc3-40db-a6f5-f8126f80fd1e HTTP/1.1" status: 204 len: 168 time: 3.8476024 May 12 15:44:02.453137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Transition to ACTIVE for port object 42a296ea-fb47-4109-8501-772157438fa6 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:44:02.467271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:02.529126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] For port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:44:02.536526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] For port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:44:02.613722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Routers {'943c296a-7f18-4231-8088-35f5348abd2b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:02.614356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['943c296a-7f18-4231-8088-35f5348abd2b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:02.675125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 144476e8-3d2f-40e1-8e1d-88435e1c3389 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:02.703984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:02.724179 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Sync routers for ids ['420111e5-3d19-4801-ac99-692a805ed38d'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:44:02.734403 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Routers {'420111e5-3d19-4801-ac99-692a805ed38d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:02.735914 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5035e339-5523-486b-957e-d64a30a83810 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['420111e5-3d19-4801-ac99-692a805ed38d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:02.742284 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:02.760080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-69e147ec-d7c7-4e53-beba-741d75119e4d None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:02.848046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-450a72e1-653a-4df6-aaa1-4bd96cf19c5c None None] Pushing event updated for resources: {'Port': ['ID=4c9c52d9-7be2-45c7-82f5-d4e254eec55f,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:02.886004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Pushing event updated for resources: {'Port': ['ID=42a296ea-fb47-4109-8501-772157438fa6,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:02.992356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:02.993266 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:02.995093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] 10.222.0.84 "PUT /v2.0/ports/c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 HTTP/1.1" status: 200 len: 1096 time: 5.2176182 May 12 15:44:02.999941 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:03.008672 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:44:03.131354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '68685fe3-34ed-4c8e-94b3-acfbd69762b2', 'tag': 'c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:44:03.167781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Attempting to bind port 42a296ea-fb47-4109-8501-772157438fa6 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:44:03.168261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Attempting to bind port 42a296ea-fb47-4109-8501-772157438fa6 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '0e218190-12cd-4c5d-a26e-6453816fe1e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 585, 'network_id': '03979098-a904-494a-a852-b458bf7ca658'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:44:03.168838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Attempting to bind port 42a296ea-fb47-4109-8501-772157438fa6 on network 03979098-a904-494a-a852-b458bf7ca658 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:44:03.178988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Port 42a296ea-fb47-4109-8501-772157438fa6 on network 03979098-a904-494a-a852-b458bf7ca658 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:44:03.179320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Attempting to bind port 42a296ea-fb47-4109-8501-772157438fa6 on network 03979098-a904-494a-a852-b458bf7ca658 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:44:03.202153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:44:03.202352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Checking segment: {'id': '0e218190-12cd-4c5d-a26e-6453816fe1e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 585, 'network_id': '03979098-a904-494a-a852-b458bf7ca658'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:44:03.202637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Bound using segment: {'id': '0e218190-12cd-4c5d-a26e-6453816fe1e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 585, 'network_id': '03979098-a904-494a-a852-b458bf7ca658'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:44:03.203056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Bound port: 42a296ea-fb47-4109-8501-772157438fa6, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0e218190-12cd-4c5d-a26e-6453816fe1e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 585, 'network_id': '03979098-a904-494a-a852-b458bf7ca658'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:44:03.203402 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:03.389797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43116) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:03.390533 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Set router 420111e5-3d19-4801-ac99-692a805ed38d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:03.570519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] For port 42a296ea-fb47-4109-8501-772157438fa6, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:44:03.575162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] For port 42a296ea-fb47-4109-8501-772157438fa6, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=42a296ea-fb47-4109-8501-772157438fa6,segment=NetworkSegment(0e218190-12cd-4c5d-a26e-6453816fe1e4),segment_id=0e218190-12cd-4c5d-a26e-6453816fe1e4)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:44:03.585437 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3e3943f-3ecf-4bf3-9ee1-728321914974 None None] Network 06314778-8dc3-40db-a6f5-f8126f80fd1e requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:44:03.585654 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:03.613172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 144476e8-3d2f-40e1-8e1d-88435e1c3389 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:44:03.713003 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 144476e8-3d2f-40e1-8e1d-88435e1c3389 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:03.713710 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:03.779696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:03.780306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:03.784738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3e3943f-3ecf-4bf3-9ee1-728321914974 None None] Network 06314778-8dc3-40db-a6f5-f8126f80fd1e could not be found, it might have been deleted concurrently. {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:220}} May 12 15:44:03.787360 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] 10.222.0.84 "PUT /v2.0/ports/42a296ea-fb47-4109-8501-772157438fa6 HTTP/1.1" status: 200 len: 1091 time: 2.7393322 May 12 15:44:03.791212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'tag': '42a296ea-fb47-4109-8501-772157438fa6'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:44:03.831691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] Set router 943c296a-7f18-4231-8088-35f5348abd2b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:03.946634 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7569481d-074f-4922-bb19-204998717731 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3fcb9ca7c3d44a988e6caa81ca64980c&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5318506 May 12 15:44:03.960162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43126) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:03.965165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8db21cca-45b6-47fb-bba9-fdf295fddc53 None None] DHCP port deletion for 06314778-8dc3-40db-a6f5-f8126f80fd1e request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:44:03.982872 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e74483b-1718-4b14-947c-ef248cc536fc service neutron] Pushing event updated for resources: {'Port': ['ID=42a296ea-fb47-4109-8501-772157438fa6,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:04.076999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-c6ab58fb-a771-4e7f-ae6b-aa149c30b52c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:04.083490 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-c6ab58fb-a771-4e7f-ae6b-aa149c30b52c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 1094 time: 0.2054477 May 12 15:44:04.089480 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f20e05b-d551-4bb4-87fa-46783746d1cf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:04.161899 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5035e339-5523-486b-957e-d64a30a83810 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '420111e5-3d19-4801-ac99-692a805ed38d', 'name': 'tempest-TestAggregatesBasicOps-454973996-router', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57'}], 'enable_snat': True}, 'gw_port_id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:31Z', 'updated_at': '2022-05-12T15:43:50Z', 'revision_number': 4, 'project_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'gw_port': {'id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:ac:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '420111e5-3d19-4801-ac99-692a805ed38d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3518, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:43:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'b9c2d2b5-8819-4be1-a8e6-613616dac8fe', 'name': '', 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'mac_address': 'fa:16:3e:e5:67:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '420111e5-3d19-4801-ac99-692a805ed38d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3532, 'fixed_ips': [{'subnet_id': '341bc8b1-1137-42ab-8609-e6e2102116ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:46Z', 'updated_at': '2022-05-12T15:43:51Z', 'revision_number': 2, 'project_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'subnets': [{'id': '341bc8b1-1137-42ab-8609-e6e2102116ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:04.170368 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Checking router: 420111e5-3d19-4801-ac99-692a805ed38d for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:44:04.170978 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Updating router 420111e5-3d19-4801-ac99-692a805ed38d port b9c2d2b5-8819-4be1-a8e6-613616dac8fe binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:44:04.242296 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-63cd72d9-e14e-4364-b703-71b2e2d80b1b None None] Provisioning complete for port b9c2d2b5-8819-4be1-a8e6-613616dac8fe triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:04.242664 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-63cd72d9-e14e-4364-b703-71b2e2d80b1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:04.253676 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:04.311875 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-106b00ae-e982-4548-991a-bd86ae1afa24 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=42a296ea-fb47-4109-8501-772157438fa6 HTTP/1.1" status: 200 len: 217 time: 0.1987171 May 12 15:44:04.458702 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f20e05b-d551-4bb4-87fa-46783746d1cf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:04.501920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-63cd72d9-e14e-4364-b703-71b2e2d80b1b None None] Port b9c2d2b5-8819-4be1-a8e6-613616dac8fe cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:44:04.505592 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:04.518843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-e3b57856-ddab-4614-8cff-5aca6b85f588 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:04.530986 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-e3b57856-ddab-4614-8cff-5aca6b85f588 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=501ff294-e32c-494b-9718-ec96b39fa231 HTTP/1.1" status: 200 len: 835 time: 0.2071199 May 12 15:44:04.570160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abbf61ae-1aac-45d2-a6f3-35908fa9c97d service neutron] Pushing event updated for resources: {'Port': ['ID=c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:04.646015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5a409cb-9b3d-47ad-b348-b375c3c52fe7 req-241f1ebf-974a-45ad-9698-97183f6ea5ef tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:04.647668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a5a409cb-9b3d-47ad-b348-b375c3c52fe7 req-241f1ebf-974a-45ad-9698-97183f6ea5ef tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 948 time: 2.3192635 May 12 15:44:04.697488 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 144476e8-3d2f-40e1-8e1d-88435e1c3389, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=144476e8-3d2f-40e1-8e1d-88435e1c3389,segment=NetworkSegment(170e329c-dde1-448c-88ad-452fb2700328),segment_id=170e329c-dde1-448c-88ad-452fb2700328)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:04.717937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-6321bc0a-8274-4c66-8b60-5be0fcd6f63c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:04.719421 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-6321bc0a-8274-4c66-8b60-5be0fcd6f63c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=03979098-a904-494a-a852-b458bf7ca658&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1778414 May 12 15:44:04.720604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f20e05b-d551-4bb4-87fa-46783746d1cf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:04.726065 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:04.863351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f20e05b-d551-4bb4-87fa-46783746d1cf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2af76b94-c52f-4a5e-98f1-be7cd55092f6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:04.874458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ff6d16cf-77e6-4739-8ff8-9c714f08bb2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:04.881505 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-ff6d16cf-77e6-4739-8ff8-9c714f08bb2a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f5159f7227ee44cd86967cf5c8d430ab&device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 1099 time: 1.7256520 May 12 15:44:05.009221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=144476e8-3d2f-40e1-8e1d-88435e1c3389,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:05.019951 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f20e05b-d551-4bb4-87fa-46783746d1cf admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:05.023827 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7f20e05b-d551-4bb4-87fa-46783746d1cf admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2af76b94-c52f-4a5e-98f1-be7cd55092f6 HTTP/1.1" status: 204 len: 168 time: 1.0595036 May 12 15:44:05.077439 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:05.102962 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Transition to ACTIVE for port object b9c2d2b5-8819-4be1-a8e6-613616dac8fe will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:44:05.119190 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:05.240428 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-cdc7bede-1fb2-4725-b2e8-b0c128776e6b service neutron] 10.222.0.84 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4917493 May 12 15:44:05.301288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27491fc6-64c6-458d-9e07-340282eab4a6 req-22894d89-2df4-4cfb-8058-9617a34f47b7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:05.318832 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27491fc6-64c6-458d-9e07-340282eab4a6 req-22894d89-2df4-4cfb-8058-9617a34f47b7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 943 time: 1.7729266 May 12 15:44:05.442657 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a5a409cb-9b3d-47ad-b348-b375c3c52fe7 req-33f7d9b2-5d9d-4065-b055-aa5bd9ea98af tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/security-groups?id=1515931f-5ca8-49a5-a679-083278fc54dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7764921 May 12 15:44:05.507965 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-f5c74b32-677a-40b7-be5b-8f7b0a714af4 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.119&port_id=c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 HTTP/1.1" status: 200 len: 217 time: 0.5448802 May 12 15:44:05.656158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-a0040269-923e-4462-8cd3-23cff15cedf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:05.661969 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-a0040269-923e-4462-8cd3-23cff15cedf8 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1207159 May 12 15:44:05.673839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ad231b54-6bf2-4f37-9752-72197ecdb6b2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:05.700876 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b4c65ca-02e9-4f32-851d-9cd28fd2cd2a None None] Pushing event updated for resources: {'Port': ['ID=b9c2d2b5-8819-4be1-a8e6-613616dac8fe,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:05.786819 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3d77e068-2c67-4c3f-b26a-a6c43628d7b6 req-ec7e50bc-c9f4-46de-8749-5cb45877cf6e service neutron] 10.222.0.84 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5400300 May 12 15:44:05.834310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-27491fc6-64c6-458d-9e07-340282eab4a6 req-46fa1e77-b90e-4708-b3db-745a8e66e1f7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=7ef93a22-5ccd-49ce-bc3f-8fb5236953da&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5146105 May 12 15:44:05.838582 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-63cd72d9-e14e-4364-b703-71b2e2d80b1b None None] Provisioning for port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:44:05.957807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ad231b54-6bf2-4f37-9752-72197ecdb6b2 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:44:05.967239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ad231b54-6bf2-4f37-9752-72197ecdb6b2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:05.967792 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:05.971129 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Attempting to bind port b9c2d2b5-8819-4be1-a8e6-613616dac8fe on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:44:05.971492 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Attempting to bind port b9c2d2b5-8819-4be1-a8e6-613616dac8fe by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '1bca247c-f07d-45c8-9a50-17cd07b7f0b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:44:05.971847 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Attempting to bind port b9c2d2b5-8819-4be1-a8e6-613616dac8fe on network 4365c129-804f-4de1-8f2b-afafcddb88c8 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:44:05.983405 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-323691d4-331d-4ea1-a50a-cafd76e3f367 admin admin] Deleting port c7aceb9b-7f66-45af-a7ff-b801f5bcec19 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:05.983660 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-323691d4-331d-4ea1-a50a-cafd76e3f367 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:06.008289 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 43, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:44:06.009791 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Checking segment: {'id': '1bca247c-f07d-45c8-9a50-17cd07b7f0b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:44:06.010512 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:06.011227 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Bound using segment: {'id': '1bca247c-f07d-45c8-9a50-17cd07b7f0b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:44:06.012472 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Bound port: b9c2d2b5-8819-4be1-a8e6-613616dac8fe, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1bca247c-f07d-45c8-9a50-17cd07b7f0b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:44:06.012945 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:06.072792 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8b135b31-15e5-45db-a233-43a515c79af6'] response: {'name': 'network-changed', 'server_uuid': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'tag': '42a296ea-fb47-4109-8501-772157438fa6', 'status': 'completed', 'code': 200} May 12 15:44:06.097302 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5aacfe11-74d6-457c-8af2-f296ab08d8e4'] response: {'name': 'network-changed', 'server_uuid': '68685fe3-34ed-4c8e-94b3-acfbd69762b2', 'tag': 'c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7', 'status': 'completed', 'code': 200} May 12 15:44:06.149991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:43:35Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:43:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:02Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:06.183565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67675c02-927c-47fa-8aab-b30e390e3800 None None] The sync data for ids ['943c296a-7f18-4231-8088-35f5348abd2b'] in n-d-841483-1 is: [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:43:35Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:43:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:02Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:44:06.187186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-89bc9feb-d495-4db0-9726-2f174d04790c None None] Provisioning for port 42a296ea-fb47-4109-8501-772157438fa6 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:44:06.287276 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-5035e339-5523-486b-957e-d64a30a83810 None None] For port b9c2d2b5-8819-4be1-a8e6-613616dac8fe, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:44:06.293001 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-5035e339-5523-486b-957e-d64a30a83810 None None] For port b9c2d2b5-8819-4be1-a8e6-613616dac8fe, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b9c2d2b5-8819-4be1-a8e6-613616dac8fe,segment=NetworkSegment(1bca247c-f07d-45c8-9a50-17cd07b7f0b5),segment_id=1bca247c-f07d-45c8-9a50-17cd07b7f0b5)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:44:06.313376 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:06.325011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-770902ad-fadd-4a74-9ba3-1475d792a8ea req-69c324b8-d7bb-4106-8940-475b124b70b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:06.331766 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-770902ad-fadd-4a74-9ba3-1475d792a8ea req-69c324b8-d7bb-4106-8940-475b124b70b4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 1094 time: 0.2147346 May 12 15:44:06.406815 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:06.499954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ad231b54-6bf2-4f37-9752-72197ecdb6b2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ad231b54-6bf2-4f37-9752-72197ecdb6b2,segment=NetworkSegment(78dc89b5-762c-4e20-928f-48bda4132660),segment_id=78dc89b5-762c-4e20-928f-48bda4132660)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:06.516633 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Routers {'420111e5-3d19-4801-ac99-692a805ed38d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:06.517269 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5035e339-5523-486b-957e-d64a30a83810 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['420111e5-3d19-4801-ac99-692a805ed38d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:06.520700 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:06.521506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device db282676-b200-482c-b8ba-dc814d43f534 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:06.602678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port ad231b54-6bf2-4f37-9752-72197ecdb6b2 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:06.603178 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:06.718119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-69e147ec-d7c7-4e53-beba-741d75119e4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:55Z', 'revision_number': 7, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:43:37Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:56Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ad231b54-6bf2-4f37-9752-72197ecdb6b2', 'name': '', 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:e1:83:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3521, 'fixed_ips': [{'subnet_id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:36Z', 'updated_at': '2022-05-12T15:43:48Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:06.814321 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69e147ec-d7c7-4e53-beba-741d75119e4d None None] The sync data for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 is: [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:43:55Z', 'revision_number': 7, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:43:37Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:56Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ad231b54-6bf2-4f37-9752-72197ecdb6b2', 'name': '', 'network_id': 'ca8599bc-9771-409d-b719-ef5aae5d8e20', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:e1:83:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3521, 'fixed_ips': [{'subnet_id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:36Z', 'updated_at': '2022-05-12T15:43:48Z', 'revision_number': 4, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b5dbeca3-f681-42eb-8d6c-1e8120c9627a', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:44:06.839241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-55dccc27-25f2-4696-b586-9817a391c89a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:06.840752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-55dccc27-25f2-4696-b586-9817a391c89a service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 1.1116664 May 12 15:44:06.938246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ad231b54-6bf2-4f37-9752-72197ecdb6b2,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:07.019713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:07.027739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:07.028402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:07.029104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:07.029682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:07.030254 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:07.030809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:07.031711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:07.032862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:07.033436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:07.033985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:07.034768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:07.042367 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-69a244ed-cd7f-4bba-8f68-c06440c205e4 req-1daa829a-775a-43ab-8d46-b83bdc453583 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.6534536 May 12 15:44:07.087805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port db282676-b200-482c-b8ba-dc814d43f534 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:44:07.095715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port db282676-b200-482c-b8ba-dc814d43f534 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:07.096195 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:07.153058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43188) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:07.158402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-770902ad-fadd-4a74-9ba3-1475d792a8ea req-b407029c-4720-494f-aa4f-c6c8f5911875 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:07.162022 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-770902ad-fadd-4a74-9ba3-1475d792a8ea req-b407029c-4720-494f-aa4f-c6c8f5911875 service neutron] 10.222.0.84 "GET /v2.0/networks?id=03979098-a904-494a-a852-b458bf7ca658 HTTP/1.1" status: 200 len: 897 time: 0.8200035 May 12 15:44:07.231340 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-5035e339-5523-486b-957e-d64a30a83810 None None] Set router 420111e5-3d19-4801-ac99-692a805ed38d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:07.437928 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-770902ad-fadd-4a74-9ba3-1475d792a8ea req-109b87b8-c65e-40e0-8adb-2dfad95ca756 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=42a296ea-fb47-4109-8501-772157438fa6 HTTP/1.1" status: 200 len: 217 time: 0.2601380 May 12 15:44:07.454550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-323691d4-331d-4ea1-a50a-cafd76e3f367 admin admin] For port c7aceb9b-7f66-45af-a7ff-b801f5bcec19, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c7aceb9b-7f66-45af-a7ff-b801f5bcec19,segment=NetworkSegment(00733d62-a32c-495d-9cf8-f6c6e58930c1),segment_id=00733d62-a32c-495d-9cf8-f6c6e58930c1)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:07.459346 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-323691d4-331d-4ea1-a50a-cafd76e3f367 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:07.479520 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b4c65ca-02e9-4f32-851d-9cd28fd2cd2a None None] Pushing event updated for resources: {'Port': ['ID=b9c2d2b5-8819-4be1-a8e6-613616dac8fe,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:07.584321 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:07.588066 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-69a244ed-cd7f-4bba-8f68-c06440c205e4 req-9c29fb7b-a1ed-4e65-97ba-1373050d66e0 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.1459205 May 12 15:44:07.594343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-test-network-1739825744'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:07.601120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:07.615360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:network and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:07.622118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:07.623846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port db282676-b200-482c-b8ba-dc814d43f534, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=db282676-b200-482c-b8ba-dc814d43f534,segment=NetworkSegment(78dc89b5-762c-4e20-928f-48bda4132660),segment_id=78dc89b5-762c-4e20-928f-48bda4132660)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:07.635535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:07.640142 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:07.642753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 539a80f2-ef5d-4365-8999-6a2e51b5afc6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:07.705705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-770902ad-fadd-4a74-9ba3-1475d792a8ea req-7df0c8ea-9aa4-4397-a3b4-52ef3ec1007c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:07.707242 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-770902ad-fadd-4a74-9ba3-1475d792a8ea req-7df0c8ea-9aa4-4397-a3b4-52ef3ec1007c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=501ff294-e32c-494b-9718-ec96b39fa231 HTTP/1.1" status: 200 len: 835 time: 0.0692637 May 12 15:44:07.809975 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5035e339-5523-486b-957e-d64a30a83810 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '420111e5-3d19-4801-ac99-692a805ed38d', 'name': 'tempest-TestAggregatesBasicOps-454973996-router', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57'}], 'enable_snat': True}, 'gw_port_id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:31Z', 'updated_at': '2022-05-12T15:43:50Z', 'revision_number': 4, 'project_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'gw_port': {'id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:ac:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '420111e5-3d19-4801-ac99-692a805ed38d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3518, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:43:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'b9c2d2b5-8819-4be1-a8e6-613616dac8fe', 'name': '', 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'mac_address': 'fa:16:3e:e5:67:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '420111e5-3d19-4801-ac99-692a805ed38d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3532, 'fixed_ips': [{'subnet_id': '341bc8b1-1137-42ab-8609-e6e2102116ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:46Z', 'updated_at': '2022-05-12T15:44:06Z', 'revision_number': 4, 'project_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'subnets': [{'id': '341bc8b1-1137-42ab-8609-e6e2102116ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:07.824030 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5035e339-5523-486b-957e-d64a30a83810 None None] The sync data for ids ['420111e5-3d19-4801-ac99-692a805ed38d'] in n-d-841483-1 is: [{'id': '420111e5-3d19-4801-ac99-692a805ed38d', 'name': 'tempest-TestAggregatesBasicOps-454973996-router', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57'}], 'enable_snat': True}, 'gw_port_id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:31Z', 'updated_at': '2022-05-12T15:43:50Z', 'revision_number': 4, 'project_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'gw_port': {'id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:ac:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '420111e5-3d19-4801-ac99-692a805ed38d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3518, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:43:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'b9c2d2b5-8819-4be1-a8e6-613616dac8fe', 'name': '', 'network_id': '4365c129-804f-4de1-8f2b-afafcddb88c8', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'mac_address': 'fa:16:3e:e5:67:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '420111e5-3d19-4801-ac99-692a805ed38d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3532, 'fixed_ips': [{'subnet_id': '341bc8b1-1137-42ab-8609-e6e2102116ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:46Z', 'updated_at': '2022-05-12T15:44:06Z', 'revision_number': 4, 'project_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'subnets': [{'id': '341bc8b1-1137-42ab-8609-e6e2102116ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:44:07.866524 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-69a244ed-cd7f-4bba-8f68-c06440c205e4 req-13a9366f-1b50-4ba9-acda-468e35474dcb service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1582754 May 12 15:44:07.867385 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:07.871109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:07.888634 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:07.958991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:07.998491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=db282676-b200-482c-b8ba-dc814d43f534,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:08.013946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 539a80f2-ef5d-4365-8999-6a2e51b5afc6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:44:08.028446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 539a80f2-ef5d-4365-8999-6a2e51b5afc6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:08.029429 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:08.096094 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-323691d4-331d-4ea1-a50a-cafd76e3f367 admin admin] Calling delete_port for c7aceb9b-7f66-45af-a7ff-b801f5bcec19 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:08.096720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:security_group_rule and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:08.101045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:08.112188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:08.155653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a244ed-cd7f-4bba-8f68-c06440c205e4 req-9ffdb66a-134d-47fa-aa52-bb065e93d0c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:08.157725 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-69a244ed-cd7f-4bba-8f68-c06440c205e4 req-9ffdb66a-134d-47fa-aa52-bb065e93d0c2 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2697248 May 12 15:44:08.195714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-770902ad-fadd-4a74-9ba3-1475d792a8ea req-d1f0046c-5b8c-4a2c-b994-d47361f598e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:08.197550 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-770902ad-fadd-4a74-9ba3-1475d792a8ea req-d1f0046c-5b8c-4a2c-b994-d47361f598e9 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=03979098-a904-494a-a852-b458bf7ca658&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4232152 May 12 15:44:08.215312 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:08.235308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 539a80f2-ef5d-4365-8999-6a2e51b5afc6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=539a80f2-ef5d-4365-8999-6a2e51b5afc6,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:08.239699 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:08.242257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:08.330185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] For port ad231b54-6bf2-4f37-9752-72197ecdb6b2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ad231b54-6bf2-4f37-9752-72197ecdb6b2,segment=NetworkSegment(78dc89b5-762c-4e20-928f-48bda4132660),segment_id=78dc89b5-762c-4e20-928f-48bda4132660)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:08.330539 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:08.385412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe930e0-e22f-4956-a1bf-4c12e9714efb req-b29ab2fa-2149-42f7-b7ce-b95ea670e3d5 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:08.392827 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dbe930e0-e22f-4956-a1bf-4c12e9714efb req-b29ab2fa-2149-42f7-b7ce-b95ea670e3d5 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 948 time: 1.7208102 May 12 15:44:08.394301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=539a80f2-ef5d-4365-8999-6a2e51b5afc6,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:08.420583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:44:08.428350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:08.429057 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:08.478638 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:08.488555 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-770902ad-fadd-4a74-9ba3-1475d792a8ea req-3ecafbc5-1944-4d62-8918-983ac3f4a2bf service neutron] 10.222.0.84 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2773674 May 12 15:44:08.489858 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:08.583913 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:08.605467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:08.612967 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:08.614271 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:08.631667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for ad231b54-6bf2-4f37-9752-72197ecdb6b2 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:08.645941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 559} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:44:08.660132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fc21d87b-ac9d-47ee-bbfb-d1834c1cc3d1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:08.679448 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:08.679743 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Added segment 88392f67-14f6-47b9-a689-18992378d1e1 of type vlan for network 61b1250e-09c9-4206-8592-62cee35b5757 May 12 15:44:08.716853 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-770902ad-fadd-4a74-9ba3-1475d792a8ea req-cd7c7f97-aaf5-49b9-beca-47c0b82277a1 service neutron] 10.222.0.84 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2063770 May 12 15:44:08.724146 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:08.764461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-a68c82a7-a7b6-492d-ad75-3d1dc70766d4 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.8362236 May 12 15:44:08.805443 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:08.806735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:08.815260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:08.818182 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:08.827920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:08.828401 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:09.034308 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b95c961-db5d-40ba-b9d1-1e3e683f3608 req-9afec421-9226-489a-8072-0e1a4844d2e3 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1930938 May 12 15:44:09.038837 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 42a296ea-fb47-4109-8501-772157438fa6 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:44:09.057592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4c9c52d9-7be2-45c7-82f5-d4e254eec55f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:09.082741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33af9764-3680-4950-ae09-d57375b7b62d req-e8dc5486-9900-4293-a570-46a6128772fd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:09.084467 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33af9764-3680-4950-ae09-d57375b7b62d req-e8dc5486-9900-4293-a570-46a6128772fd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 943 time: 1.8619764 May 12 15:44:09.085720 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 1.9314902 May 12 15:44:09.086694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f09a1f-9b44-4b27-bc53-e31543cf8a51 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Network': ['ID=61b1250e-09c9-4206-8592-62cee35b5757,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:09.088853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43206) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:09.098554 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'name': 'tempest-PortsIpV6TestJSON-2051465187'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:09.122337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 61b1250e-09c9-4206-8592-62cee35b5757 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:44:09.140558 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dbe930e0-e22f-4956-a1bf-4c12e9714efb req-90668352-5362-427c-8459-2ed0c9dd1356 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/security-groups?id=1515931f-5ca8-49a5-a679-083278fc54dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7468870 May 12 15:44:09.277776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:09.285359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:port and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:09.291063 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-33af9764-3680-4950-ae09-d57375b7b62d req-3a4d63e6-3e82-4777-a456-ba361a05490a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=7ef93a22-5ccd-49ce-bc3f-8fb5236953da&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1865911 May 12 15:44:09.294205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:09.311330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:09.335954 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] It took 0.24 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:44:09.344711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:09.348495 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:09.388964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port 2828a441-fc11-488a-bc82-1cc8de827bc0 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:44:09.561065 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:09.568197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:44:09.579655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 42a296ea-fb47-4109-8501-772157438fa6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=42a296ea-fb47-4109-8501-772157438fa6,segment=NetworkSegment(0e218190-12cd-4c5d-a26e-6453816fe1e4),segment_id=0e218190-12cd-4c5d-a26e-6453816fe1e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:09.586682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:09.587053 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:09.650745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=ad231b54-6bf2-4f37-9752-72197ecdb6b2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:09.668855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '42a296ea-fb47-4109-8501-772157438fa6', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'port_id': '42a296ea-fb47-4109-8501-772157438fa6', 'mac_address': 'fa:16:3e:2d:a9:4b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 585, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:44:09.672364 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:09.707425 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:09.734181 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-323691d4-331d-4ea1-a50a-cafd76e3f367 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:09.787600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553791e6-0a47-425a-9f0c-2adb1aae2798 req-f376d6c0-b039-42dc-b15d-39b4cd2d3efe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:09.789377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-553791e6-0a47-425a-9f0c-2adb1aae2798 req-f376d6c0-b039-42dc-b15d-39b4cd2d3efe service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f5159f7227ee44cd86967cf5c8d430ab&device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 1099 time: 0.6470027 May 12 15:44:09.795045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:09.795958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:09.796416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:09.796850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:09.800524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:09.809784 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:09.813594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:09.814073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:09.816022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:09.816519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:09.817238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:09.817849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:09.818361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:44:09.835040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=2828a441-fc11-488a-bc82-1cc8de827bc0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:09.852249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Checking segment: {'id': '88392f67-14f6-47b9-a689-18992378d1e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '61b1250e-09c9-4206-8592-62cee35b5757'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:44:09.852829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network hostable DHCP agents. Network: 61b1250e-09c9-4206-8592-62cee35b5757, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:44:09.894543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 61b1250e-09c9-4206-8592-62cee35b5757 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:44:09.911288 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 61b1250e-09c9-4206-8592-62cee35b5757) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:09.915920 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:44:09.927491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:09.930385 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:09.939491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 42a296ea-fb47-4109-8501-772157438fa6 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:44:09.967057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15cb688d-5ef2-4a50-aa49-1cfa683dc786 None None] Network 61b1250e-09c9-4206-8592-62cee35b5757 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:44:09.991338 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-913042dc-ca85-459a-acdc-3cd4ab2ee94e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 0.8976703 May 12 15:44:09.995611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43212) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:10.011034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1135381873'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:10.036741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:10.046785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:network and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:10.053246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:10.068578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:10.101678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-323691d4-331d-4ea1-a50a-cafd76e3f367 admin admin] Pushing event deleted for resources: {'Port': ['ID=c7aceb9b-7f66-45af-a7ff-b801f5bcec19,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:10.103345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:10.115653 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:10.201715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 564} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:44:10.226507 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:10.226861 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Added segment 807f3dd3-5196-4f46-b15f-349803359149 of type vlan for network 426d864b-9d83-4778-998c-95f8582da4b8 May 12 15:44:10.236538 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 42a296ea-fb47-4109-8501-772157438fa6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=42a296ea-fb47-4109-8501-772157438fa6,segment=NetworkSegment(0e218190-12cd-4c5d-a26e-6453816fe1e4),segment_id=0e218190-12cd-4c5d-a26e-6453816fe1e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:10.240335 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:10.310312 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:10.542516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4c9c52d9-7be2-45c7-82f5-d4e254eec55f,segment=NetworkSegment(0e218190-12cd-4c5d-a26e-6453816fe1e4),segment_id=0e218190-12cd-4c5d-a26e-6453816fe1e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:10.583467 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:10.586777 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:10.588461 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 409a78e5-4573-4d33-b4da-83dcea90e530 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:10.676040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=42a296ea-fb47-4109-8501-772157438fa6,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:10.692699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['42a296ea-fb47-4109-8501-772157438fa6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:44:10.695180 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:10.700715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:10.701343 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:10.878003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Network': ['ID=426d864b-9d83-4778-998c-95f8582da4b8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:10.883428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553791e6-0a47-425a-9f0c-2adb1aae2798 req-447e38a7-9ac3-4e00-b993-5f5a6841286f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:10.886394 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-553791e6-0a47-425a-9f0c-2adb1aae2798 req-447e38a7-9ac3-4e00-b993-5f5a6841286f service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 1.0561316 May 12 15:44:10.898172 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-46b54503-ade6-47e2-81c2-8af11f313b89 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.9015460 May 12 15:44:10.898779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43226) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:10.904222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'ports': [{'network_id': '61b1250e-09c9-4206-8592-62cee35b5757'}, {'network_id': '426d864b-9d83-4778-998c-95f8582da4b8'}]} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:10.904536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:10.905016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'network_id': '426d864b-9d83-4778-998c-95f8582da4b8'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:10.923943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 426d864b-9d83-4778-998c-95f8582da4b8 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:44:11.018477 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-553791e6-0a47-425a-9f0c-2adb1aae2798 req-a2222b0e-f294-4b7e-8519-3b67be8b5d73 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.119&port_id=c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 HTTP/1.1" status: 200 len: 217 time: 0.1070433 May 12 15:44:11.034944 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:11.054552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:44:11.123394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=4c9c52d9-7be2-45c7-82f5-d4e254eec55f,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:11.127619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553791e6-0a47-425a-9f0c-2adb1aae2798 req-42d461ae-6d5b-443f-b85f-20ce8cfc2e5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:11.129177 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-553791e6-0a47-425a-9f0c-2adb1aae2798 req-42d461ae-6d5b-443f-b85f-20ce8cfc2e5b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0814147 May 12 15:44:11.190336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:11.195051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:port and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:11.198055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:11.206474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 2 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:11.239536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 409a78e5-4573-4d33-b4da-83dcea90e530 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:11.239910 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:11.243511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 2} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:11.249590 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:11.279986 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:11.428715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:11.464390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': 'c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7', 'mac_address': 'fa:16:3e:00:6a:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.119'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:44:11.506097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34ecbf08-8ad3-4661-b1cd-8fa85440aa37 req-45ec0ed1-1b13-431b-b551-bb84f4dcadbf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:11.514651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34ecbf08-8ad3-4661-b1cd-8fa85440aa37 req-45ec0ed1-1b13-431b-b551-bb84f4dcadbf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 944 time: 0.8933816 May 12 15:44:11.545776 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-323691d4-331d-4ea1-a50a-cafd76e3f367 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:11.597952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port 77b4ffd2-cf16-47d8-9655-18ac12a5e747 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:44:11.598673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 71e8fce5-504b-42e3-96ac-f1d3aa801337 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:11.692668 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:11.713343 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:11.723359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34ecbf08-8ad3-4661-b1cd-8fa85440aa37 req-fb96c783-a38c-43c0-9887-c7ee3df57b34 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=7ef93a22-5ccd-49ce-bc3f-8fb5236953da&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2074487 May 12 15:44:11.749057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18f13053-9939-4961-b0d4-aa487d7c2b07 req-708c0d6e-d794-4cd3-a460-9710e43c39f6 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:11.750541 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18f13053-9939-4961-b0d4-aa487d7c2b07 req-708c0d6e-d794-4cd3-a460-9710e43c39f6 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 948 time: 1.1893189 May 12 15:44:11.787197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:44:11.806694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:11.844391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port 7abb81e2-8729-41a6-bc28-f816ff6ca6fe yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:44:11.881999 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:11.935441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553791e6-0a47-425a-9f0c-2adb1aae2798 req-fe11933c-92fd-475e-9bad-4cb695a5f3a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:11.936975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-553791e6-0a47-425a-9f0c-2adb1aae2798 req-fe11933c-92fd-475e-9bad-4cb695a5f3a2 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.6309731 May 12 15:44:11.942477 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:11.979938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:11.989443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 71e8fce5-504b-42e3-96ac-f1d3aa801337 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:11.989813 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:12.073594 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:12.148740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=77b4ffd2-cf16-47d8-9655-18ac12a5e747,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:12.163414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 61b1250e-09c9-4206-8592-62cee35b5757 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:44:12.165130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:12.168712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:44:12.169984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:12.189200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f1e033f3-b048-470b-ac02-cd534e3f1483 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:12.324741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Checking segment: {'id': '807f3dd3-5196-4f46-b15f-349803359149', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '426d864b-9d83-4778-998c-95f8582da4b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:44:12.324741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network hostable DHCP agents. Network: 426d864b-9d83-4778-998c-95f8582da4b8, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:44:12.324741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=7abb81e2-8729-41a6-bc28-f816ff6ca6fe,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:12.432903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 426d864b-9d83-4778-998c-95f8582da4b8 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:44:12.434720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f1e033f3-b048-470b-ac02-cd534e3f1483 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:12.434720 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:12.435511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 426d864b-9d83-4778-998c-95f8582da4b8) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:12.435511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:44:12.435511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:12.435511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:12.435511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:12.435511 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c623f7be-0cb6-42ab-97e5-fdb23673252c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 1.5205812 May 12 15:44:12.435511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43246) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:12.465975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:44:12.470109 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18f13053-9939-4961-b0d4-aa487d7c2b07 req-08acf6f8-2498-4d83-a869-5c3d541f23bb tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/security-groups?id=1515931f-5ca8-49a5-a679-083278fc54dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6458101 May 12 15:44:12.510412 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-021848fb-91e0-408f-a06d-cb61710a8d20 None None] Network 426d864b-9d83-4778-998c-95f8582da4b8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:44:12.644941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8ac08c44-8ed5-4e4a-b0e9-fa0ff90ecf1b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 7abb81e2-8729-41a6-bc28-f816ff6ca6fe {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:12.645529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ac08c44-8ed5-4e4a-b0e9-fa0ff90ecf1b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:12.847250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 766c87d1-88c8-4b7e-ba13-f65737b66f8b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:44:13.082790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 42a296ea-fb47-4109-8501-772157438fa6 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:13.093018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-323691d4-331d-4ea1-a50a-cafd76e3f367 admin admin] Router 457f98a8-5d75-4172-bace-cad1c36d6cff has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:44:13.101181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-553791e6-0a47-425a-9f0c-2adb1aae2798 req-e0383a27-ec68-44d4-a380-1bc898476d7b service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0901339 May 12 15:44:13.151959 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ae0dfb92-445b-4ebc-a5a8-6218e9ca1e82 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:13.325443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:44:13.348109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6432f31-4d11-4162-931c-9da182e7630e req-7ae36505-bb91-4abd-8931-b8d09fc8eb11 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:13.355034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e6432f31-4d11-4162-931c-9da182e7630e req-7ae36505-bb91-4abd-8931-b8d09fc8eb11 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 944 time: 0.3283067 May 12 15:44:13.406366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ccb18831-68fb-4c05-bfea-c937346dbb5e None None] Sync routers for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:44:13.436309 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ac08c44-8ed5-4e4a-b0e9-fa0ff90ecf1b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:13.539985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-21e6fa43-60e7-47ff-aab8-28d676957423 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 15.3924155 May 12 15:44:13.550992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43268) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:13.629726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-e987381f-720b-46fb-a814-93d7c32c19a6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting subnet b5dbeca3-f681-42eb-8d6c-1e8120c9627a {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:44:13.649034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e6432f31-4d11-4162-931c-9da182e7630e req-87c72e6b-3357-4627-b9d6-b80a4aad433f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=7ef93a22-5ccd-49ce-bc3f-8fb5236953da&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2802465 May 12 15:44:13.665900 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e987381f-720b-46fb-a814-93d7c32c19a6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:13.735602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-553791e6-0a47-425a-9f0c-2adb1aae2798 req-e94692df-6313-4c06-9775-1bbfd416669e service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6166267 May 12 15:44:13.754637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-323691d4-331d-4ea1-a50a-cafd76e3f367 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:44:13.754808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 58977900-9ffe-410f-9737-9a0b0966441c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:13.772590 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fa21e52-09da-42ca-869b-3c40c6ebec16 None None] Sync routers for ids ['457f98a8-5d75-4172-bace-cad1c36d6cff'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:44:13.773157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e987381f-720b-46fb-a814-93d7c32c19a6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:13.788933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8ac08c44-8ed5-4e4a-b0e9-fa0ff90ecf1b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 7abb81e2-8729-41a6-bc28-f816ff6ca6fe owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:13.791898 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fa21e52-09da-42ca-869b-3c40c6ebec16 None None] Routers {'457f98a8-5d75-4172-bace-cad1c36d6cff'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:13.792535 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4fa21e52-09da-42ca-869b-3c40c6ebec16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['457f98a8-5d75-4172-bace-cad1c36d6cff'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:13.798954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ccb18831-68fb-4c05-bfea-c937346dbb5e None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:13.799989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ccb18831-68fb-4c05-bfea-c937346dbb5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:13.870922 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e987381f-720b-46fb-a814-93d7c32c19a6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:13.954408 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ac08c44-8ed5-4e4a-b0e9-fa0ff90ecf1b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:14.073639 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e987381f-720b-46fb-a814-93d7c32c19a6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:14.124463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e987381f-720b-46fb-a814-93d7c32c19a6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Subnet': ['ID=b5dbeca3-f681-42eb-8d6c-1e8120c9627a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:14.137628 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-323691d4-331d-4ea1-a50a-cafd76e3f367 admin admin] 10.222.0.82 "PUT /v2.0/routers/457f98a8-5d75-4172-bace-cad1c36d6cff/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 15.5031774 May 12 15:44:14.137628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43276) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:14.227989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ac08c44-8ed5-4e4a-b0e9-fa0ff90ecf1b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=7abb81e2-8729-41a6-bc28-f816ff6ca6fe,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:14.251510 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ac08c44-8ed5-4e4a-b0e9-fa0ff90ecf1b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:14.265248 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-4fa21e52-09da-42ca-869b-3c40c6ebec16 None None] Set router 457f98a8-5d75-4172-bace-cad1c36d6cff gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:14.268135 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8ac08c44-8ed5-4e4a-b0e9-fa0ff90ecf1b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/7abb81e2-8729-41a6-bc28-f816ff6ca6fe HTTP/1.1" status: 204 len: 168 time: 1.8413279 May 12 15:44:14.269020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43282) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:14.288620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ccb18831-68fb-4c05-bfea-c937346dbb5e None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:14.292963 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e987381f-720b-46fb-a814-93d7c32c19a6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:14.300829 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e987381f-720b-46fb-a814-93d7c32c19a6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/b5dbeca3-f681-42eb-8d6c-1e8120c9627a HTTP/1.1" status: 204 len: 168 time: 0.7533123 May 12 15:44:14.347769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43286) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:14.514757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f743b66e-fa09-412c-9534-bfa175cbb53b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:14.533376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f743b66e-fa09-412c-9534-bfa175cbb53b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:14.546300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f743b66e-fa09-412c-9534-bfa175cbb53b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:44:14.587439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f743b66e-fa09-412c-9534-bfa175cbb53b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:44:14.596605 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f743b66e-fa09-412c-9534-bfa175cbb53b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1456 time: 0.3207641 May 12 15:44:14.596605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43292) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:14.714981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2a4bab3-d88c-4fe8-8c37-1bb475d6f9a1 None None] Network ca8599bc-9771-409d-b719-ef5aae5d8e20 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:44:14.763974 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:14.801930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 58977900-9ffe-410f-9737-9a0b0966441c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:44:14.802272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 58977900-9ffe-410f-9737-9a0b0966441c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:44:14.835069 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4fa21e52-09da-42ca-869b-3c40c6ebec16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'name': 'tempest-TestAggregatesBasicOps-1565348474-router', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:09Z', 'revision_number': 5, 'project_id': '7b6758bd71d1400f8b6b1d4858918128', 'gw_port': {'id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:e4:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3466, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:06Z', 'updated_at': '2022-05-12T15:43:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:14.853762 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fa21e52-09da-42ca-869b-3c40c6ebec16 None None] Checking router: 457f98a8-5d75-4172-bace-cad1c36d6cff for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:44:14.874413 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fa21e52-09da-42ca-869b-3c40c6ebec16 None None] Routers {'457f98a8-5d75-4172-bace-cad1c36d6cff'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:14.875353 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4fa21e52-09da-42ca-869b-3c40c6ebec16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:43:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['457f98a8-5d75-4172-bace-cad1c36d6cff'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:15.046927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-71bf5a09-1698-4077-b8c7-1e9e26a20f25 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 77b4ffd2-cf16-47d8-9655-18ac12a5e747 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:15.046927 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71bf5a09-1698-4077-b8c7-1e9e26a20f25 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:15.165010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 42a296ea-fb47-4109-8501-772157438fa6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:44:15.173310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5e0313-057b-41e6-9b4f-835faa6c04bc req-ab642289-7010-446e-b56b-f821dcd2e751 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:15.194772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f5e0313-057b-41e6-9b4f-835faa6c04bc req-ab642289-7010-446e-b56b-f821dcd2e751 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 949 time: 1.1962254 May 12 15:44:15.220538 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 42a296ea-fb47-4109-8501-772157438fa6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:15.220907 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:15.228684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:15.290184 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-4fa21e52-09da-42ca-869b-3c40c6ebec16 None None] Set router 457f98a8-5d75-4172-bace-cad1c36d6cff gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:15.338361 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b9c2d2b5-8819-4be1-a8e6-613616dac8fe up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:15.374771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb2aae53-31fe-4f92-8270-263a55917f35 req-ee86afcd-31b7-4ae0-8638-8473ba7debe8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:15.388931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eb2aae53-31fe-4f92-8270-263a55917f35 req-ee86afcd-31b7-4ae0-8638-8473ba7debe8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 944 time: 0.5321975 May 12 15:44:15.450827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port db282676-b200-482c-b8ba-dc814d43f534 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:15.450827 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:15.583983 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:15.649496 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71bf5a09-1698-4077-b8c7-1e9e26a20f25 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:15.707568 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7dd79191-6e82-436d-8f70-b751775fb9e2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:15.830909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-71bf5a09-1698-4077-b8c7-1e9e26a20f25 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 77b4ffd2-cf16-47d8-9655-18ac12a5e747 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:15.920409 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71bf5a09-1698-4077-b8c7-1e9e26a20f25 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:15.963308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port b9c2d2b5-8819-4be1-a8e6-613616dac8fe completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:44:15.988105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ccb18831-68fb-4c05-bfea-c937346dbb5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:09Z', 'revision_number': 8, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:44:04Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:56Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:15.990241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b9c2d2b5-8819-4be1-a8e6-613616dac8fe triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:15.990609 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:15.995175 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eb2aae53-31fe-4f92-8270-263a55917f35 req-41e4cdea-dbf9-41e8-abfa-bc29fe81de3e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=7ef93a22-5ccd-49ce-bc3f-8fb5236953da&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.6081736 May 12 15:44:16.052864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71bf5a09-1698-4077-b8c7-1e9e26a20f25 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=77b4ffd2-cf16-47d8-9655-18ac12a5e747,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:16.067983 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-71bf5a09-1698-4077-b8c7-1e9e26a20f25 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:16.086148 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4fa21e52-09da-42ca-869b-3c40c6ebec16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'name': 'tempest-TestAggregatesBasicOps-1565348474-router', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:09Z', 'revision_number': 5, 'project_id': '7b6758bd71d1400f8b6b1d4858918128', 'gw_port': {'id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:e4:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3466, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:06Z', 'updated_at': '2022-05-12T15:43:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:16.087118 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:16.087986 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-71bf5a09-1698-4077-b8c7-1e9e26a20f25 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/77b4ffd2-cf16-47d8-9655-18ac12a5e747 HTTP/1.1" status: 204 len: 168 time: 1.4914613 May 12 15:44:16.090098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43310) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:16.093993 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f5e0313-057b-41e6-9b4f-835faa6c04bc req-1b4a4165-6555-40a3-8593-20b6a9170bac tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/security-groups?id=1515931f-5ca8-49a5-a679-083278fc54dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8536434 May 12 15:44:16.104426 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fa21e52-09da-42ca-869b-3c40c6ebec16 None None] The sync data for ids ['457f98a8-5d75-4172-bace-cad1c36d6cff'] in n-d-841483-1 is: [{'id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'name': 'tempest-TestAggregatesBasicOps-1565348474-router', 'tenant_id': '7b6758bd71d1400f8b6b1d4858918128', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:09Z', 'revision_number': 5, 'project_id': '7b6758bd71d1400f8b6b1d4858918128', 'gw_port': {'id': 'b412f7d6-f82f-41a4-a588-b9f97c5b45ab', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:e4:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '457f98a8-5d75-4172-bace-cad1c36d6cff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3466, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:06Z', 'updated_at': '2022-05-12T15:43:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:44:16.150605 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ccb18831-68fb-4c05-bfea-c937346dbb5e None None] Checking router: 766c87d1-88c8-4b7e-ba13-f65737b66f8b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:44:16.153503 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-277042eb-4974-4bab-9d5d-622d2e9aeb4d None None] DHCP port deletion for ca8599bc-9771-409d-b719-ef5aae5d8e20 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:44:16.199198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ccb18831-68fb-4c05-bfea-c937346dbb5e None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:16.199198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ccb18831-68fb-4c05-bfea-c937346dbb5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:16.281982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbe8c008-36c8-4b3e-95e5-12a8b3818c21 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:16.281982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bbe8c008-36c8-4b3e-95e5-12a8b3818c21 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:44:16.322955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bbe8c008-36c8-4b3e-95e5-12a8b3818c21 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:44:16.322955 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bbe8c008-36c8-4b3e-95e5-12a8b3818c21 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.2285273 May 12 15:44:16.329606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43316) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:16.402086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 42a296ea-fb47-4109-8501-772157438fa6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=42a296ea-fb47-4109-8501-772157438fa6,segment=NetworkSegment(0e218190-12cd-4c5d-a26e-6453816fe1e4),segment_id=0e218190-12cd-4c5d-a26e-6453816fe1e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:16.406002 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-c0b222ab-0efb-4a26-8927-05e55ec529ba tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] GET failed (client error): The resource could not be found. May 12 15:44:16.407855 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c0b222ab-0efb-4a26-8927-05e55ec529ba tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/7abb81e2-8729-41a6-bc28-f816ff6ca6fe HTTP/1.1" status: 404 len: 333 time: 0.0810833 May 12 15:44:16.411065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43320) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:16.414831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '42a296ea-fb47-4109-8501-772157438fa6'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:44:16.419994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-277042eb-4974-4bab-9d5d-622d2e9aeb4d None None] Deleting port db282676-b200-482c-b8ba-dc814d43f534 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:16.420473 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-277042eb-4974-4bab-9d5d-622d2e9aeb4d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:16.486522 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-44c64673-4bda-47dc-a7f2-c9d3aaa502ed tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] GET failed (client error): The resource could not be found. May 12 15:44:16.489863 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-44c64673-4bda-47dc-a7f2-c9d3aaa502ed tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/77b4ffd2-cf16-47d8-9655-18ac12a5e747 HTTP/1.1" status: 404 len: 333 time: 0.0773683 May 12 15:44:16.494706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43330) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:16.560551 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:16.570378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] For port db282676-b200-482c-b8ba-dc814d43f534, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=db282676-b200-482c-b8ba-dc814d43f534,segment=NetworkSegment(78dc89b5-762c-4e20-928f-48bda4132660),segment_id=78dc89b5-762c-4e20-928f-48bda4132660)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:16.571164 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:16.671981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] Deleting port b412f7d6-f82f-41a4-a588-b9f97c5b45ab {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:16.671981 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:16.840654 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d433a91-2b89-4e5f-8c42-2794b8d4a103 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:16.889008 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:16.891469 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:17.100497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] For port b412f7d6-f82f-41a4-a588-b9f97c5b45ab, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b412f7d6-f82f-41a4-a588-b9f97c5b45ab,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:17.100497 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:17.178733 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=42a296ea-fb47-4109-8501-772157438fa6,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:17.190147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:17.317025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] Calling delete_port for b412f7d6-f82f-41a4-a588-b9f97c5b45ab owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:17.431153 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d433a91-2b89-4e5f-8c42-2794b8d4a103 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:17.552756 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-0d433a91-2b89-4e5f-8c42-2794b8d4a103 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['426d864b-9d83-4778-998c-95f8582da4b8']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:17.596506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-0d433a91-2b89-4e5f-8c42-2794b8d4a103 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '807f3dd3-5196-4f46-b15f-349803359149') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:17.607695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-0d433a91-2b89-4e5f-8c42-2794b8d4a103 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '807f3dd3-5196-4f46-b15f-349803359149') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:17.636179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-277042eb-4974-4bab-9d5d-622d2e9aeb4d None None] For port db282676-b200-482c-b8ba-dc814d43f534, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=db282676-b200-482c-b8ba-dc814d43f534,segment=NetworkSegment(78dc89b5-762c-4e20-928f-48bda4132660),segment_id=78dc89b5-762c-4e20-928f-48bda4132660)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:17.636179 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-277042eb-4974-4bab-9d5d-622d2e9aeb4d None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:17.665121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d433a91-2b89-4e5f-8c42-2794b8d4a103 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:17.727559 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d433a91-2b89-4e5f-8c42-2794b8d4a103 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:17.746835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0d433a91-2b89-4e5f-8c42-2794b8d4a103 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Releasing vlan 564 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:44:17.746835 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d433a91-2b89-4e5f-8c42-2794b8d4a103 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:17.880401 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-277042eb-4974-4bab-9d5d-622d2e9aeb4d None None] Calling delete_port for db282676-b200-482c-b8ba-dc814d43f534 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:18.017621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for db282676-b200-482c-b8ba-dc814d43f534 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:18.035352 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-53e7ea58-02d7-469d-9d36-d4d085791a53'] response: {'server_uuid': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '42a296ea-fb47-4109-8501-772157438fa6', 'code': 200} May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: timer() May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:44:18.046407 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:44:18.065955 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d433a91-2b89-4e5f-8c42-2794b8d4a103 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:18.065955 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0d433a91-2b89-4e5f-8c42-2794b8d4a103 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:18.118104 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0d433a91-2b89-4e5f-8c42-2794b8d4a103 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/networks/426d864b-9d83-4778-998c-95f8582da4b8 HTTP/1.1" status: 204 len: 168 time: 1.6159317 May 12 15:44:18.118104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43394) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:18.138541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1014404407'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:18.166753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:18.187782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:network and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:18.200139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d433a91-2b89-4e5f-8c42-2794b8d4a103 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Network': ['ID=426d864b-9d83-4778-998c-95f8582da4b8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:18.208693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:18.211575 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-277042eb-4974-4bab-9d5d-622d2e9aeb4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:18.223113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:18.251420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:18.257356 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:18.330778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-277042eb-4974-4bab-9d5d-622d2e9aeb4d None None] No DVR routers for this DVR port db282676-b200-482c-b8ba-dc814d43f534 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:44:18.331147 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 569} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:44:18.334794 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:18.354715 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:18.355051 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Added segment 8da6216b-9d7b-4b1a-91c1-0261e1475eff of type vlan for network 6c5694de-e3e1-4193-b854-106bd923eb51 May 12 15:44:18.425027 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-277042eb-4974-4bab-9d5d-622d2e9aeb4d None None] Pushing event deleted for resources: {'Port': ['ID=db282676-b200-482c-b8ba-dc814d43f534,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:18.434775 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:18.535082 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:18.547769 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:18.554507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:18.555135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:18.568970 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:18.573051 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ccb18831-68fb-4c05-bfea-c937346dbb5e None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:18.582065 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:44:18.582378 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:44:18.727138 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:18.745497 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:44:18.805649 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:18.805649 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:18.853003 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.7310257 May 12 15:44:18.853003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43432) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:18.914685 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': '6c5694de-e3e1-4193-b854-106bd923eb51', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::2', 'end': '2001:db8::ffff:ffff:ffff:fffe'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:18.995867 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port b9c2d2b5-8819-4be1-a8e6-613616dac8fe, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b9c2d2b5-8819-4be1-a8e6-613616dac8fe,segment=NetworkSegment(1bca247c-f07d-45c8-9a50-17cd07b7f0b5),segment_id=1bca247c-f07d-45c8-9a50-17cd07b7f0b5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:18.996952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c75a6087-8659-43cc-b6a3-b667eae7fc7d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Network': ['ID=6c5694de-e3e1-4193-b854-106bd923eb51,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:19.005488 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] Pushing event deleted for resources: {'Port': ['ID=b412f7d6-f82f-41a4-a588-b9f97c5b45ab,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:19.022707 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:19.024163 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:19.084478 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 6c5694de-e3e1-4193-b854-106bd923eb51 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:44:19.128121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port db282676-b200-482c-b8ba-dc814d43f534 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:19.128121 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:19.197148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:19.202308 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:19.216565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:19.225205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:19.244445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:19.300067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:19.304034 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:19.582453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] The port 'db282676-b200-482c-b8ba-dc814d43f534' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:44:19.610560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.ipam_backend_mixin [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Performing IP validity checks on allocation pools {{(pid=88151) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:314}} May 12 15:44:19.611918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.ipam_backend_mixin [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Checking for overlaps among allocation pools and gateway ip {{(pid=88151) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:335}} May 12 15:44:19.628812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:19.628812 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:19.796141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bf669cc-3b2f-4c2e-b2f5-0c1d35a55876 req-54000922-d1e0-47e5-a61a-7aeb934a20c3 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:19.796141 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5bf669cc-3b2f-4c2e-b2f5-0c1d35a55876 req-54000922-d1e0-47e5-a61a-7aeb934a20c3 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 945 time: 1.6006875 May 12 15:44:19.820865 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:19.846733 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:19.904604 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:19.912202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5bf669cc-3b2f-4c2e-b2f5-0c1d35a55876 req-79f03dd8-0717-42ba-a2e4-36279e4e10e5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=7ef93a22-5ccd-49ce-bc3f-8fb5236953da&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1151745 May 12 15:44:19.919598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45b16d82-ffb7-4209-890d-b1f8fc3726b1 req-89d2f769-8d98-418c-97dd-9cb305e7b23e tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:19.935552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45b16d82-ffb7-4209-890d-b1f8fc3726b1 req-89d2f769-8d98-418c-97dd-9cb305e7b23e tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 949 time: 2.2367353 May 12 15:44:19.941828 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:19.973479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Subnet': ['ID=d09de61a-563a-43ec-8c32-4e0716191c6e,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:20.000124 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=b9c2d2b5-8819-4be1-a8e6-613616dac8fe,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:20.043730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '68685fe3-34ed-4c8e-94b3-acfbd69762b2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:44:20.052522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Checking segment: {'id': '8da6216b-9d7b-4b1a-91c1-0261e1475eff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 569, 'network_id': '6c5694de-e3e1-4193-b854-106bd923eb51'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:44:20.053265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network hostable DHCP agents. Network: 6c5694de-e3e1-4193-b854-106bd923eb51, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:44:20.139905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 6c5694de-e3e1-4193-b854-106bd923eb51 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:44:20.167772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 6c5694de-e3e1-4193-b854-106bd923eb51) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:20.175540 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45b16d82-ffb7-4209-890d-b1f8fc3726b1 req-a96604e8-1cba-4d34-8162-82aa27ffd976 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/security-groups?id=1515931f-5ca8-49a5-a679-083278fc54dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2356422 May 12 15:44:20.187635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device db282676-b200-482c-b8ba-dc814d43f534 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:20.197333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:20.197333 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:20.219848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cedb0e5e-d107-44bd-92c9-387562613f15 req-8d74dc0f-d1cd-4b2b-93bf-0d0d3b0215e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:20.219848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cedb0e5e-d107-44bd-92c9-387562613f15 req-8d74dc0f-d1cd-4b2b-93bf-0d0d3b0215e2 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 1096 time: 2.4451036 May 12 15:44:20.226093 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:20.258120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ac7a69f-d535-4738-ab2b-f2741aedc35a None None] Network 6c5694de-e3e1-4193-b854-106bd923eb51 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:44:20.266985 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:20.267515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 457f98a8-5d75-4172-bace-cad1c36d6cff {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:44:20.277153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: db282676-b200-482c-b8ba-dc814d43f534 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:44:20.277753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device db282676-b200-482c-b8ba-dc814d43f534 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:284}} May 12 15:44:20.313349 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5ff2a792-ee83-477f-86c3-0ff913277964 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.4491203 May 12 15:44:20.316322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43452) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:20.332272 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:20.335953 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ae1aaf2d-d164-446f-9552-d277ecd2a26f admin admin] 10.222.0.82 "DELETE /v2.0/routers/457f98a8-5d75-4172-bace-cad1c36d6cff HTTP/1.1" status: 204 len: 168 time: 6.1978462 May 12 15:44:20.338321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43456) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:20.340028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ca8599bc-9771-409d-b719-ef5aae5d8e20']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:20.344293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'network_id': '6c5694de-e3e1-4193-b854-106bd923eb51', 'name': 'tempest-PortsIpV6TestJSON-1076155351'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:20.398134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:20.400077 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3c174791-f511-41bf-9f75-f31113860701'] response: {'server_uuid': '68685fe3-34ed-4c8e-94b3-acfbd69762b2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7', 'code': 200} May 12 15:44:20.411964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Port db282676-b200-482c-b8ba-dc814d43f534 not found, will not notify nova. {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:294}} May 12 15:44:20.412452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 539a80f2-ef5d-4365-8999-6a2e51b5afc6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:20.475345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '78dc89b5-762c-4e20-928f-48bda4132660') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:20.475640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '78dc89b5-762c-4e20-928f-48bda4132660') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:20.476459 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:20.493146 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cedb0e5e-d107-44bd-92c9-387562613f15 req-5260c053-4657-488a-977c-7ab4fbee0f3f service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=7ef93a22-5ccd-49ce-bc3f-8fb5236953da&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2564127 May 12 15:44:20.499653 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:20.522057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-86cd38d2-5bd7-4b8f-8b83-2c1914219fe7 admin admin] Deleting subnet 8048f0a2-0244-4df1-a0f2-76aae45f6709 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:44:20.526677 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86cd38d2-5bd7-4b8f-8b83-2c1914219fe7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:20.580516 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:20.612172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Releasing vlan 581 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:44:20.613441 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: timer() May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:44:20.656875 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:44:20.775835 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86cd38d2-5bd7-4b8f-8b83-2c1914219fe7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:20.820223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:20.820223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d320ee9-ef48-431f-906f-fbbfb03b6cee req-fd18d03e-37a7-403c-a332-66c6a70c9a1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:20.820223 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9d320ee9-ef48-431f-906f-fbbfb03b6cee req-fd18d03e-37a7-403c-a332-66c6a70c9a1a service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 1101 time: 0.2315423 May 12 15:44:20.831975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:20.896172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:20.901530 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:20.919341 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9d320ee9-ef48-431f-906f-fbbfb03b6cee req-e3b0450e-11ac-4e21-841f-5407e7c849bf service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=1515931f-5ca8-49a5-a679-083278fc54dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0900552 May 12 15:44:20.945025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port b2fae83c-64e9-4a7c-810d-40a3c8729e73 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:44:20.959745 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:21.018196 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:21.046441 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:21.061098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Network': ['ID=ca8599bc-9771-409d-b719-ef5aae5d8e20,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:21.078565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ccb18831-68fb-4c05-bfea-c937346dbb5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:09Z', 'revision_number': 8, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:44:04Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:56Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:21.090667 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e646874b-fd86-400c-a784-35f1fe07b8bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/networks/ca8599bc-9771-409d-b719-ef5aae5d8e20 HTTP/1.1" status: 204 len: 168 time: 6.7333980 May 12 15:44:21.093044 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ccb18831-68fb-4c05-bfea-c937346dbb5e None None] The sync data for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 is: [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:09Z', 'revision_number': 8, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '144476e8-3d2f-40e1-8e1d-88435e1c3389', 'name': '', 'network_id': '3f83009e-15c3-4297-93d4-b28b3de6e6a0', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:f3:39:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3498, 'fixed_ips': [{'subnet_id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:23Z', 'updated_at': '2022-05-12T15:44:04Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'b434ad3a-39aa-4d78-9730-83acdb7ad343', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:56Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:44:21.100118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43470) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:21.149232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 539a80f2-ef5d-4365-8999-6a2e51b5afc6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:21.152276 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:21.245223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-6c5694de-e3e1-4193-b854-106bd923eb51', 'network_id': '6c5694de-e3e1-4193-b854-106bd923eb51', 'tenant_id': '1da2b935bcd34292b3e8ce00cc114001', 'fixed_ips': [{'subnet_id': 'd09de61a-563a-43ec-8c32-4e0716191c6e'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:44:21.245223 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:21.476272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 144476e8-3d2f-40e1-8e1d-88435e1c3389 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:21.531190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Allocated IP 2001:db8::2ee (6c5694de-e3e1-4193-b854-106bd923eb51/d09de61a-563a-43ec-8c32-4e0716191c6e/b2fae83c-64e9-4a7c-810d-40a3c8729e73) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:44:21.669995 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 144476e8-3d2f-40e1-8e1d-88435e1c3389 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:21.670498 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:22.075256 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86cd38d2-5bd7-4b8f-8b83-2c1914219fe7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:22.328121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:22.353438 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4c9c52d9-7be2-45c7-82f5-d4e254eec55f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:22.412581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Transition to ACTIVE for port object b2fae83c-64e9-4a7c-810d-40a3c8729e73 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:44:22.486227 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:22.640501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Allocated IP 2001:db8::2 (6c5694de-e3e1-4193-b854-106bd923eb51/d09de61a-563a-43ec-8c32-4e0716191c6e/09e0576e-50b1-49e2-8a88-75bbe7f857dc) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:44:22.651679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:22.652304 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:22.668765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c9005b-e60d-436b-b7df-4a702b4954cb req-67c45a60-23e1-4d7b-8464-1a3c58a8f222 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:22.670245 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31c9005b-e60d-436b-b7df-4a702b4954cb req-67c45a60-23e1-4d7b-8464-1a3c58a8f222 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 945 time: 1.5758669 May 12 15:44:22.732858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 6c5694de-e3e1-4193-b854-106bd923eb51 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:44:22.737143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:22.745960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=b2fae83c-64e9-4a7c-810d-40a3c8729e73,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:22.755531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:44:22.761523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:22.763025 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:22.779563 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86cd38d2-5bd7-4b8f-8b83-2c1914219fe7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:22.838056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86cd38d2-5bd7-4b8f-8b83-2c1914219fe7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8048f0a2-0244-4df1-a0f2-76aae45f6709,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:22.855034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31c9005b-e60d-436b-b7df-4a702b4954cb req-7434efad-935e-4a23-9f3c-0d8d4e47a215 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=7ef93a22-5ccd-49ce-bc3f-8fb5236953da&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1628096 May 12 15:44:22.855034 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-86cd38d2-5bd7-4b8f-8b83-2c1914219fe7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:22.875575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a99ed519-42ac-49ae-b592-43089398a553 req-5e11b913-5212-457b-941c-05c91e87f196 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:22.875575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a99ed519-42ac-49ae-b592-43089398a553 req-5e11b913-5212-457b-941c-05c91e87f196 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 950 time: 1.0803735 May 12 15:44:22.878314 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-36287d95-3721-4ed2-ab4c-a869678e061b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.5426588 May 12 15:44:22.878314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43488) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:22.880170 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-86cd38d2-5bd7-4b8f-8b83-2c1914219fe7 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/8048f0a2-0244-4df1-a0f2-76aae45f6709 HTTP/1.1" status: 204 len: 168 time: 2.5191941 May 12 15:44:22.889004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43492) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:23.024982 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a99ed519-42ac-49ae-b592-43089398a553 req-b158e4bb-edad-4978-af89-7c2f1d87b746 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/security-groups?id=1515931f-5ca8-49a5-a679-083278fc54dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1535697 May 12 15:44:23.054243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7986610-57be-40e1-9644-2f96044182fd None None] Network dc4d0778-8db2-40e0-aa19-9acf571959fb requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:44:23.060564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-5cc389f1-758b-412b-8786-14d808123f97 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port b2fae83c-64e9-4a7c-810d-40a3c8729e73 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:23.061034 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5cc389f1-758b-412b-8786-14d808123f97 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:23.072672 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:23.125700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Deleting port b3a5c96c-3661-496b-b5d1-e53a15ef1740 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:23.126389 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:23.408685 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e0f09ec3-2cdf-4fbf-9a23-b5315e0da5cf tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:23.559496 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5cc389f1-758b-412b-8786-14d808123f97 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:23.670825 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b9c2d2b5-8819-4be1-a8e6-613616dac8fe up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:23.795966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32620fb1-7007-4611-b64f-81e4a3afd6a1 None None] DHCP port deletion for dc4d0778-8db2-40e0-aa19-9acf571959fb request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:44:23.826251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-32620fb1-7007-4611-b64f-81e4a3afd6a1 None None] Deleting port b3a5c96c-3661-496b-b5d1-e53a15ef1740 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:23.826251 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-32620fb1-7007-4611-b64f-81e4a3afd6a1 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:23.872354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-5cc389f1-758b-412b-8786-14d808123f97 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for b2fae83c-64e9-4a7c-810d-40a3c8729e73 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:23.926278 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:23.955920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b9c2d2b5-8819-4be1-a8e6-613616dac8fe triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:23.956383 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:24.053361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] For port b3a5c96c-3661-496b-b5d1-e53a15ef1740, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b3a5c96c-3661-496b-b5d1-e53a15ef1740,segment=NetworkSegment(00733d62-a32c-495d-9cf8-f6c6e58930c1),segment_id=00733d62-a32c-495d-9cf8-f6c6e58930c1)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:24.058287 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:24.109184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5cc389f1-758b-412b-8786-14d808123f97 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:24.331768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-32620fb1-7007-4611-b64f-81e4a3afd6a1 None None] For port b3a5c96c-3661-496b-b5d1-e53a15ef1740, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b3a5c96c-3661-496b-b5d1-e53a15ef1740,segment=NetworkSegment(00733d62-a32c-495d-9cf8-f6c6e58930c1),segment_id=00733d62-a32c-495d-9cf8-f6c6e58930c1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:24.332162 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-32620fb1-7007-4611-b64f-81e4a3afd6a1 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:24.554087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Transition to ACTIVE for port object 09e0576e-50b1-49e2-8a88-75bbe7f857dc will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:44:24.682927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Calling delete_port for b3a5c96c-3661-496b-b5d1-e53a15ef1740 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:24.691622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-32620fb1-7007-4611-b64f-81e4a3afd6a1 None None] Calling delete_port for b3a5c96c-3661-496b-b5d1-e53a15ef1740 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:24.704896 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5cc389f1-758b-412b-8786-14d808123f97 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:24.727736 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5cc389f1-758b-412b-8786-14d808123f97 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/b2fae83c-64e9-4a7c-810d-40a3c8729e73 HTTP/1.1" status: 204 len: 168 time: 1.8602355 May 12 15:44:24.728564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cc389f1-758b-412b-8786-14d808123f97 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=b2fae83c-64e9-4a7c-810d-40a3c8729e73,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:24.733308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43516) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:24.787382 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Transition to ACTIVE for port object 09e0576e-50b1-49e2-8a88-75bbe7f857dc will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:44:24.831243 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:24.881120 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:24.888788 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-1a70c077-38d2-4b41-a1af-fdf4bc2fc5d5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] DELETE failed (client error): The resource could not be found. May 12 15:44:24.888788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1a70c077-38d2-4b41-a1af-fdf4bc2fc5d5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:44:24.966372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1a70c077-38d2-4b41-a1af-fdf4bc2fc5d5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/b2fae83c-64e9-4a7c-810d-40a3c8729e73 HTTP/1.1" status: 404 len: 333 time: 0.2085402 May 12 15:44:24.969697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43522) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:24.978152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Pushing event deleted for resources: {'Port': ['ID=b3a5c96c-3661-496b-b5d1-e53a15ef1740,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:24.978152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] No DVR routers for this DVR port b3a5c96c-3661-496b-b5d1-e53a15ef1740 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:44:24.993524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Pushing event updated for resources: {'Port': ['ID=09e0576e-50b1-49e2-8a88-75bbe7f857dc,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:25.016122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Network 6c5694de-e3e1-4193-b854-106bd923eb51 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:44:25.016122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:25.016122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:44:25.021136 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-32620fb1-7007-4611-b64f-81e4a3afd6a1 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:44:25.021136 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-32620fb1-7007-4611-b64f-81e4a3afd6a1 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:44:25.057132 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-7977e69e-41f2-42c3-a351-0697005b8abb tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] GET failed (client error): The resource could not be found. May 12 15:44:25.057132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7977e69e-41f2-42c3-a351-0697005b8abb tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:44:25.117861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7977e69e-41f2-42c3-a351-0697005b8abb tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:44:25.117861 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7977e69e-41f2-42c3-a351-0697005b8abb tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/b2fae83c-64e9-4a7c-810d-40a3c8729e73 HTTP/1.1" status: 404 len: 333 time: 0.1557250 May 12 15:44:25.117861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43526) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:25.167186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e0f09ec3-2cdf-4fbf-9a23-b5315e0da5cf tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port 144476e8-3d2f-40e1-8e1d-88435e1c3389 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:25.167331 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e0f09ec3-2cdf-4fbf-9a23-b5315e0da5cf tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:25.208440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a405300c-ff32-4432-8668-fd61619c1111 req-c244eb65-21d7-4a23-9380-bd76fb7992c0 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:25.213848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a405300c-ff32-4432-8668-fd61619c1111 req-c244eb65-21d7-4a23-9380-bd76fb7992c0 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 950 time: 0.5742753 May 12 15:44:25.220224 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:25.230560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ad231b54-6bf2-4f37-9752-72197ecdb6b2 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:25.243848 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-601ec615-09d7-48b6-8457-4532a28a6bf8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting subnet d09de61a-563a-43ec-8c32-4e0716191c6e {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:44:25.247424 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-601ec615-09d7-48b6-8457-4532a28a6bf8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:25.253730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6bac22-c36a-4683-8103-bb2d4281c277 req-b3534840-2b59-458d-bd71-10c2b3f02090 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:25.255704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc6bac22-c36a-4683-8103-bb2d4281c277 req-b3534840-2b59-458d-bd71-10c2b3f02090 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 945 time: 0.6481798 May 12 15:44:25.325807 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a405300c-ff32-4432-8668-fd61619c1111 req-aeaddc2c-c868-4a73-9e43-014930b69b83 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/security-groups?id=1515931f-5ca8-49a5-a679-083278fc54dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659175 May 12 15:44:25.343735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: ad231b54-6bf2-4f37-9752-72197ecdb6b2 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:44:25.354873 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ad231b54-6bf2-4f37-9752-72197ecdb6b2 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:44:25.357494 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device db282676-b200-482c-b8ba-dc814d43f534 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:25.379949 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-601ec615-09d7-48b6-8457-4532a28a6bf8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:25.383321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dc4d0778-8db2-40e0-aa19-9acf571959fb']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:25.422395 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: db282676-b200-482c-b8ba-dc814d43f534 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:44:25.423539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device db282676-b200-482c-b8ba-dc814d43f534 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:44:25.424114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c7aceb9b-7f66-45af-a7ff-b801f5bcec19 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:25.479336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Attempting to bind port 09e0576e-50b1-49e2-8a88-75bbe7f857dc on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:44:25.479336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Attempting to bind port 09e0576e-50b1-49e2-8a88-75bbe7f857dc by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '8da6216b-9d7b-4b1a-91c1-0261e1475eff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 569, 'network_id': '6c5694de-e3e1-4193-b854-106bd923eb51'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:44:25.479336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Attempting to bind port 09e0576e-50b1-49e2-8a88-75bbe7f857dc on network 6c5694de-e3e1-4193-b854-106bd923eb51 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:44:25.492429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: c7aceb9b-7f66-45af-a7ff-b801f5bcec19 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:44:25.492429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c7aceb9b-7f66-45af-a7ff-b801f5bcec19 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:44:25.492429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b412f7d6-f82f-41a4-a588-b9f97c5b45ab no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:25.524877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '00733d62-a32c-495d-9cf8-f6c6e58930c1') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:25.524877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '00733d62-a32c-495d-9cf8-f6c6e58930c1') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:25.539350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-32620fb1-7007-4611-b64f-81e4a3afd6a1 None None] Deleting port b3a5c96c-3661-496b-b5d1-e53a15ef1740 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:25.539350 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-32620fb1-7007-4611-b64f-81e4a3afd6a1 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:25.562768 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:25.575744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bc6bac22-c36a-4683-8103-bb2d4281c277 req-3abdc5e1-6578-40d0-a7d6-8b91ff2082cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=7ef93a22-5ccd-49ce-bc3f-8fb5236953da&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2483494 May 12 15:44:25.588518 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:25.651491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Releasing vlan 586 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:44:25.651491 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: timer() May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:44:25.656698 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:44:25.668307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 44, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:44:25.669172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Checking segment: {'id': '8da6216b-9d7b-4b1a-91c1-0261e1475eff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 569, 'network_id': '6c5694de-e3e1-4193-b854-106bd923eb51'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:44:25.673712 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:25.677157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Bound using segment: {'id': '8da6216b-9d7b-4b1a-91c1-0261e1475eff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 569, 'network_id': '6c5694de-e3e1-4193-b854-106bd923eb51'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:44:25.677880 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Bound port: 09e0576e-50b1-49e2-8a88-75bbe7f857dc, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8da6216b-9d7b-4b1a-91c1-0261e1475eff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 569, 'network_id': '6c5694de-e3e1-4193-b854-106bd923eb51'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:44:25.679945 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:25.731620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: b412f7d6-f82f-41a4-a588-b9f97c5b45ab {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:44:25.738885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b412f7d6-f82f-41a4-a588-b9f97c5b45ab not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:44:25.759468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-e0f09ec3-2cdf-4fbf-9a23-b5315e0da5cf tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] For port 144476e8-3d2f-40e1-8e1d-88435e1c3389, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=144476e8-3d2f-40e1-8e1d-88435e1c3389,segment=NetworkSegment(170e329c-dde1-448c-88ad-452fb2700328),segment_id=170e329c-dde1-448c-88ad-452fb2700328)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:25.760111 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e0f09ec3-2cdf-4fbf-9a23-b5315e0da5cf tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:25.792271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-601ec615-09d7-48b6-8457-4532a28a6bf8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:25.863885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-32620fb1-7007-4611-b64f-81e4a3afd6a1 None None] The port 'b3a5c96c-3661-496b-b5d1-e53a15ef1740' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:44:25.953346 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-601ec615-09d7-48b6-8457-4532a28a6bf8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:25.971482 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b3a5c96c-3661-496b-b5d1-e53a15ef1740 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:26.014325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e0f09ec3-2cdf-4fbf-9a23-b5315e0da5cf tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for 144476e8-3d2f-40e1-8e1d-88435e1c3389 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:26.029701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-601ec615-09d7-48b6-8457-4532a28a6bf8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Subnet': ['ID=d09de61a-563a-43ec-8c32-4e0716191c6e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:26.040333 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-601ec615-09d7-48b6-8457-4532a28a6bf8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:26.052822 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-601ec615-09d7-48b6-8457-4532a28a6bf8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/d09de61a-563a-43ec-8c32-4e0716191c6e HTTP/1.1" status: 204 len: 168 time: 0.9298453 May 12 15:44:26.052822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43544) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:26.133735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: b3a5c96c-3661-496b-b5d1-e53a15ef1740 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:44:26.133735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b3a5c96c-3661-496b-b5d1-e53a15ef1740 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:44:26.237325 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] For port 09e0576e-50b1-49e2-8a88-75bbe7f857dc, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:44:26.244685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] For port 09e0576e-50b1-49e2-8a88-75bbe7f857dc, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=09e0576e-50b1-49e2-8a88-75bbe7f857dc,segment=NetworkSegment(8da6216b-9d7b-4b1a-91c1-0261e1475eff),segment_id=8da6216b-9d7b-4b1a-91c1-0261e1475eff)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:44:26.276666 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:26.321429 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:26.350466 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:26.402437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 09e0576e-50b1-49e2-8a88-75bbe7f857dc {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:26.402700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:26.414549 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-219432ab-2a90-40b4-96a7-be58aaedd3b0 None None] Pushing event updated for resources: {'Port': ['ID=09e0576e-50b1-49e2-8a88-75bbe7f857dc,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:26.509311 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:26.535413 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e0f09ec3-2cdf-4fbf-9a23-b5315e0da5cf tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:26.614964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5784c8f0-f675-4ee6-8f47-d4e746e85d09 None None] Network 6c5694de-e3e1-4193-b854-106bd923eb51 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:44:26.658962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] Pushing event deleted for resources: {'Network': ['ID=dc4d0778-8db2-40e0-aa19-9acf571959fb,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:26.714238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0f09ec3-2cdf-4fbf-9a23-b5315e0da5cf tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=144476e8-3d2f-40e1-8e1d-88435e1c3389,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:26.725961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f68374f3-7cfd-40c2-820f-648e8eb0dd65 admin admin] 10.222.0.82 "DELETE /v2.0/networks/dc4d0778-8db2-40e0-aa19-9acf571959fb HTTP/1.1" status: 204 len: 168 time: 3.8322794 May 12 15:44:26.747085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] For port 09e0576e-50b1-49e2-8a88-75bbe7f857dc, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=09e0576e-50b1-49e2-8a88-75bbe7f857dc,segment=NetworkSegment(8da6216b-9d7b-4b1a-91c1-0261e1475eff),segment_id=8da6216b-9d7b-4b1a-91c1-0261e1475eff)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:26.747449 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:26.768751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43554) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:27.080452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6c9cbbb-70eb-4b7d-aeb8-88ed06b8791a None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 15:44:27.101028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 09e0576e-50b1-49e2-8a88-75bbe7f857dc owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:27.185957 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:27.307714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=09e0576e-50b1-49e2-8a88-75bbe7f857dc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:27.311518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No DVR routers for this DVR port 09e0576e-50b1-49e2-8a88-75bbe7f857dc on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:44:27.435217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6c9cbbb-70eb-4b7d-aeb8-88ed06b8791a None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 15:44:27.563667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0545915c-1d5a-4ad9-a936-6da07f1f9db0 req-f9f9ea58-97c3-4b80-9350-224d95e36abc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:27.572169 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0545915c-1d5a-4ad9-a936-6da07f1f9db0 req-f9f9ea58-97c3-4b80-9350-224d95e36abc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 945 time: 1.2417850 May 12 15:44:27.616056 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:27.656726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6c5694de-e3e1-4193-b854-106bd923eb51']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:27.682656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8da6216b-9d7b-4b1a-91c1-0261e1475eff') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:27.682656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8da6216b-9d7b-4b1a-91c1-0261e1475eff') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:27.708781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:27.824011 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:27.852656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7029664-0161-48dc-9fd7-68e425eb74b8 req-ca96d42c-e7ff-47f2-ad65-b1cfedb29b13 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:27.854784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7029664-0161-48dc-9fd7-68e425eb74b8 req-ca96d42c-e7ff-47f2-ad65-b1cfedb29b13 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 950 time: 1.3902905 May 12 15:44:27.857291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Releasing vlan 569 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:44:27.857970 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: timer() May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:44:27.971916 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:44:27.977309 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:27.982467 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:28.032427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5325d60-c4ff-4cc5-a52e-79869cc9d881 req-d50b3521-1e1a-42b3-9cc3-bfbaea6405a3 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:28.034725 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e5325d60-c4ff-4cc5-a52e-79869cc9d881 req-d50b3521-1e1a-42b3-9cc3-bfbaea6405a3 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.84 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 950 time: 0.3205466 May 12 15:44:28.037581 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/networks/6c5694de-e3e1-4193-b854-106bd923eb51 HTTP/1.1" status: 204 len: 168 time: 1.9852123 May 12 15:44:28.041251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29b2e9b9-b3af-497a-9076-93869a67a947 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Network': ['ID=6c5694de-e3e1-4193-b854-106bd923eb51,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:28.067530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43568) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:28.123181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0545915c-1d5a-4ad9-a936-6da07f1f9db0 req-1777c5b1-70b5-4eaf-ba38-f809f97098b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=7ef93a22-5ccd-49ce-bc3f-8fb5236953da&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5179935 May 12 15:44:28.183413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43574) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:28.194108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1241880757'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:28.222727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:28.227380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:network and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:28.234005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:28.248916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:28.256568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-e5325d60-c4ff-4cc5-a52e-79869cc9d881 req-07ee9486-dbe8-4364-a7e4-9007c652e86a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Deleting port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:28.256916 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e5325d60-c4ff-4cc5-a52e-79869cc9d881 req-07ee9486-dbe8-4364-a7e4-9007c652e86a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:28.323583 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e0f09ec3-2cdf-4fbf-9a23-b5315e0da5cf tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:28.347526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7029664-0161-48dc-9fd7-68e425eb74b8 req-1acee533-f65a-42ff-9962-630a30a60bc0 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/security-groups?id=1515931f-5ca8-49a5-a679-083278fc54dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3377337 May 12 15:44:28.519101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:28.521989 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:28.650742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d578e711-d062-4580-972c-b6d48dfa190d tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:28.652748 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d578e711-d062-4580-972c-b6d48dfa190d tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 1091 time: 0.4541073 May 12 15:44:28.694444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43582) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:28.701852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '42a296ea-fb47-4109-8501-772157438fa6', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ip_address': '172.20.0.8'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:28.713996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 581} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:44:28.716224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:28.730616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:floatingip and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:28.736972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:28.747385 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:28.747726 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Added segment a2c58d39-26db-41f5-9e66-49e23abff784 of type vlan for network 6edd3480-2f2e-4bbd-b716-be7a819dc082 May 12 15:44:28.755806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:28.835366 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:28.859010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e0f09ec3-2cdf-4fbf-9a23-b5315e0da5cf tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 766c87d1-88c8-4b7e-ba13-f65737b66f8b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:44:28.864171 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:29.014799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-e5325d60-c4ff-4cc5-a52e-79869cc9d881 req-07ee9486-dbe8-4364-a7e4-9007c652e86a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] For port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:29.015190 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e5325d60-c4ff-4cc5-a52e-79869cc9d881 req-07ee9486-dbe8-4364-a7e4-9007c652e86a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:29.158841 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:29.158841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:29.158841 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:29.265124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-e5325d60-c4ff-4cc5-a52e-79869cc9d881 req-07ee9486-dbe8-4364-a7e4-9007c652e86a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Calling delete_port for c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:29.315385 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 1.2523203 May 12 15:44:29.325514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43592) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:29.404728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': '6edd3480-2f2e-4bbd-b716-be7a819dc082', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:29.537042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44f131e1-3aa3-4579-b87f-12474c5a1158 req-b38b01e0-010a-4604-ad70-4fcb5894b016 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.4016531 May 12 15:44:29.546627 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65a1a248-3f85-44cf-a0b8-c84027468a23 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:29.691731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2af9f63c-4acb-4f03-9296-3721e3504736 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Network': ['ID=6edd3480-2f2e-4bbd-b716-be7a819dc082,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:29.708270 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 6edd3480-2f2e-4bbd-b716-be7a819dc082 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:44:29.719123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e0f09ec3-2cdf-4fbf-9a23-b5315e0da5cf tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:44:29.733464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-657f3fcc-8fd8-4c99-9f98-9800dfcbffdd None None] Sync routers for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:44:29.736068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e0f09ec3-2cdf-4fbf-9a23-b5315e0da5cf tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.6346030 May 12 15:44:29.749395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43602) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:29.750391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:29.844121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:29.872597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-657f3fcc-8fd8-4c99-9f98-9800dfcbffdd None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:29.872597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-657f3fcc-8fd8-4c99-9f98-9800dfcbffdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:29.875812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:29.898642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:30.000528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:30.049616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-657f3fcc-8fd8-4c99-9f98-9800dfcbffdd None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:30.133004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-223bebb2-4899-48dc-9398-e92df0408cff tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting subnet b434ad3a-39aa-4d78-9730-83acdb7ad343 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:44:30.148449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:30.152998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:30.172325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-223bebb2-4899-48dc-9398-e92df0408cff tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:30.320162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d769c060-dc3c-4f99-8177-f4fa817d8857 req-58c3a084-5d82-4e10-b2ec-eca8f2307cef tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:30.329888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d769c060-dc3c-4f99-8177-f4fa817d8857 req-58c3a084-5d82-4e10-b2ec-eca8f2307cef tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 950 time: 0.4726841 May 12 15:44:30.402132 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e5325d60-c4ff-4cc5-a52e-79869cc9d881 req-07ee9486-dbe8-4364-a7e4-9007c652e86a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:30.523990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f131e1-3aa3-4579-b87f-12474c5a1158 req-d50f0b15-011f-4fc4-8097-d8b769de0b5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:30.525834 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44f131e1-3aa3-4579-b87f-12474c5a1158 req-d50f0b15-011f-4fc4-8097-d8b769de0b5d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 1096 time: 0.8088350 May 12 15:44:30.539922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d769c060-dc3c-4f99-8177-f4fa817d8857 req-7c4956a2-a449-4d85-a0c6-4e156e0a7825 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/security-groups?id=1515931f-5ca8-49a5-a679-083278fc54dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1000104 May 12 15:44:30.559011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ee9486-dbe8-4364-a7e4-9007c652e86a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Pushing event deleted for resources: {'Port': ['ID=c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:30.655729 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-657f3fcc-8fd8-4c99-9f98-9800dfcbffdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:26Z', 'revision_number': 9, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:56Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:30.668030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-657f3fcc-8fd8-4c99-9f98-9800dfcbffdd None None] Checking router: 766c87d1-88c8-4b7e-ba13-f65737b66f8b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:44:30.677452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-657f3fcc-8fd8-4c99-9f98-9800dfcbffdd None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:30.678315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-657f3fcc-8fd8-4c99-9f98-9800dfcbffdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:30.775629 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-223bebb2-4899-48dc-9398-e92df0408cff tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:30.870600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5325d60-c4ff-4cc5-a52e-79869cc9d881 req-07ee9486-dbe8-4364-a7e4-9007c652e86a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] No DVR routers for this DVR port c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:44:30.874046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-65a1a248-3f85-44cf-a0b8-c84027468a23 admin admin] Deleting port b9c2d2b5-8819-4be1-a8e6-613616dac8fe {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:30.874046 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65a1a248-3f85-44cf-a0b8-c84027468a23 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:30.877901 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e5325d60-c4ff-4cc5-a52e-79869cc9d881 req-07ee9486-dbe8-4364-a7e4-9007c652e86a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:30.884457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '68685fe3-34ed-4c8e-94b3-acfbd69762b2', 'name': 'network-vif-deleted', 'tag': 'c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:44:30.984120 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f131e1-3aa3-4579-b87f-12474c5a1158 req-0e97d030-c863-4244-b453-e3a7876d0859 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:30.984120 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44f131e1-3aa3-4579-b87f-12474c5a1158 req-0e97d030-c863-4244-b453-e3a7876d0859 service neutron] 10.222.0.84 "GET /v2.0/networks?id=03979098-a904-494a-a852-b458bf7ca658 HTTP/1.1" status: 200 len: 897 time: 0.4241805 May 12 15:44:30.994347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:30.999096 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4c20c3c9-62e8-4fb4-baef-9aa4b0f3b952'] response: {'server_uuid': '68685fe3-34ed-4c8e-94b3-acfbd69762b2', 'name': 'network-vif-deleted', 'tag': 'c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7', 'status': 'completed', 'code': 200} May 12 15:44:31.039564 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e5325d60-c4ff-4cc5-a52e-79869cc9d881 req-07ee9486-dbe8-4364-a7e4-9007c652e86a tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.84 "DELETE /v2.0/ports/c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 HTTP/1.1" status: 204 len: 173 time: 2.9842734 May 12 15:44:31.076682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:44:31.076983 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device c2be4a4d-fdea-4eb7-855e-2154fe8ca1f7 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:44:31.088211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Allocated IP 172.25.8.55 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/b1f3dfd8-5191-40b3-9f9a-49e68fd758e1) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:44:31.130982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-657f3fcc-8fd8-4c99-9f98-9800dfcbffdd None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:31.457826 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44f131e1-3aa3-4579-b87f-12474c5a1158 req-e8f87fb2-8875-47ed-b3e9-61435de760af service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=42a296ea-fb47-4109-8501-772157438fa6 HTTP/1.1" status: 200 len: 217 time: 0.4128382 May 12 15:44:31.481169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-36cbc935-8a64-4eb0-b8b9-9a51b9ac6065 req-660be0dd-f1c6-4297-9677-1b243baa46f2 tempest-VolumesBackupsTest-1093811749 tempest-VolumesBackupsTest-1093811749-project] (88151) timed out ('10.222.0.84', 55543) {{(pid=88151) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 15:44:31.546245 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-223bebb2-4899-48dc-9398-e92df0408cff tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:31.590893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f131e1-3aa3-4579-b87f-12474c5a1158 req-51d6612b-5c26-4794-92b8-1630b0e21a68 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:31.592610 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44f131e1-3aa3-4579-b87f-12474c5a1158 req-51d6612b-5c26-4794-92b8-1630b0e21a68 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=501ff294-e32c-494b-9718-ec96b39fa231 HTTP/1.1" status: 200 len: 835 time: 0.1147099 May 12 15:44:31.853457 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:31.869895 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:31.897555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-657f3fcc-8fd8-4c99-9f98-9800dfcbffdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:26Z', 'revision_number': 9, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:56Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:31.902467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-657f3fcc-8fd8-4c99-9f98-9800dfcbffdd None None] The sync data for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 is: [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:26Z', 'revision_number': 9, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': '71e8fce5-504b-42e3-96ac-f1d3aa801337', 'name': '', 'network_id': 'd213e082-cba2-4b2e-9e03-a43f1c32c29c', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:53:66:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3487, 'fixed_ips': [{'subnet_id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:16Z', 'updated_at': '2022-05-12T15:43:56Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'e60573af-7581-47c1-bde6-897b9df5c310', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:44:32.003881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2233df7b-f985-40f6-a75d-86b482919e27 req-d1ab8a5e-4102-4f9e-9812-ab620ed61231 tempest-VolumesNegativeTest-1377708144 tempest-VolumesNegativeTest-1377708144-project] 10.222.0.82 "GET /v2.0/ports?device_id=68685fe3-34ed-4c8e-94b3-acfbd69762b2 HTTP/1.1" status: 200 len: 210 time: 0.1774323 May 12 15:44:32.012803 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-65a1a248-3f85-44cf-a0b8-c84027468a23 admin admin] For port b9c2d2b5-8819-4be1-a8e6-613616dac8fe, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b9c2d2b5-8819-4be1-a8e6-613616dac8fe,segment=NetworkSegment(1bca247c-f07d-45c8-9a50-17cd07b7f0b5),segment_id=1bca247c-f07d-45c8-9a50-17cd07b7f0b5)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:32.013614 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65a1a248-3f85-44cf-a0b8-c84027468a23 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:32.031268 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-223bebb2-4899-48dc-9398-e92df0408cff tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:32.075774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Checking segment: {'id': 'a2c58d39-26db-41f5-9e66-49e23abff784', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '6edd3480-2f2e-4bbd-b716-be7a819dc082'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:44:32.075774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network hostable DHCP agents. Network: 6edd3480-2f2e-4bbd-b716-be7a819dc082, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:44:32.086626 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d20cf17-d7e1-423e-b21d-52471ea72c40 None None] Network 3f83009e-15c3-4297-93d4-b28b3de6e6a0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:44:32.101236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-223bebb2-4899-48dc-9398-e92df0408cff tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:32.161118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Subnet': ['ID=93116bc3-a2a4-4941-9811-c16809fcaf18,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:32.233435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 6edd3480-2f2e-4bbd-b716-be7a819dc082 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:44:32.281700 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-223bebb2-4899-48dc-9398-e92df0408cff tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/b434ad3a-39aa-4d78-9730-83acdb7ad343 HTTP/1.1" status: 204 len: 168 time: 2.5122800 May 12 15:44:32.281700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43628) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:32.281700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 6edd3480-2f2e-4bbd-b716-be7a819dc082) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:32.336392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-223bebb2-4899-48dc-9398-e92df0408cff tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Subnet': ['ID=b434ad3a-39aa-4d78-9730-83acdb7ad343,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:32.439858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b71afbe0-a891-431f-a520-c0b5f5befa99 None None] Network 6edd3480-2f2e-4bbd-b716-be7a819dc082 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:44:32.468135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:32.468967 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:32.638444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:32.674598 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:32.678745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f131e1-3aa3-4579-b87f-12474c5a1158 req-c4d7ec8c-5409-45f4-bd93-10b4438c6222 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:32.678745 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44f131e1-3aa3-4579-b87f-12474c5a1158 req-c4d7ec8c-5409-45f4-bd93-10b4438c6222 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=03979098-a904-494a-a852-b458bf7ca658&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 1.0730443 May 12 15:44:32.685867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-65a1a248-3f85-44cf-a0b8-c84027468a23 admin admin] Calling delete_port for b9c2d2b5-8819-4be1-a8e6-613616dac8fe owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:32.770818 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fd910629-2bd8-4b9e-a382-11eaab5ce2da tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 3.3824663 May 12 15:44:32.780376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43634) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:32.796392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:44:32.809482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'network_id': '6edd3480-2f2e-4bbd-b716-be7a819dc082', 'security_groups': [], 'name': 'tempest-PortsIpV6TestJSON-783341046'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:32.923813 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44f131e1-3aa3-4579-b87f-12474c5a1158 req-af0b6060-e00e-4994-8b63-1d4a0277df60 service neutron] 10.222.0.84 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1833813 May 12 15:44:32.943821 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-6edd3480-2f2e-4bbd-b716-be7a819dc082', 'network_id': '6edd3480-2f2e-4bbd-b716-be7a819dc082', 'tenant_id': '1da2b935bcd34292b3e8ce00cc114001', 'fixed_ips': [{'subnet_id': '93116bc3-a2a4-4941-9811-c16809fcaf18'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:44:32.945034 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:32.967935 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:32.975479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:32.980513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:port and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:32.983830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:32.990947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:33.005221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:33.008870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:44:33.130496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port 409a78e5-4573-4d33-b4da-83dcea90e530 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:33.130496 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:33.206905 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44f131e1-3aa3-4579-b87f-12474c5a1158 req-f39a06ab-ad87-4831-a406-594977126790 service neutron] 10.222.0.84 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2580280 May 12 15:44:33.209960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:33.209960 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:33.410746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port 20562783-dfb0-46eb-b519-bb7799f0ca61 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:44:33.470358 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Allocated IP 2001:db8::2 (6edd3480-2f2e-4bbd-b716-be7a819dc082/93116bc3-a2a4-4941-9811-c16809fcaf18/73a24a1d-4691-4785-a8a4-b9c2b662fc16) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:44:33.483136 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65a1a248-3f85-44cf-a0b8-c84027468a23 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:33.501297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=b1f3dfd8-5191-40b3-9f9a-49e68fd758e1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:33.572357 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af8d2f43-f17d-4b78-b2b7-60bcadd37c5d None None] DHCP port deletion for 3f83009e-15c3-4297-93d4-b28b3de6e6a0 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:44:33.589561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65a1a248-3f85-44cf-a0b8-c84027468a23 admin admin] Pushing event deleted for resources: {'Port': ['ID=b9c2d2b5-8819-4be1-a8e6-613616dac8fe,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:33.914767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-af8d2f43-f17d-4b78-b2b7-60bcadd37c5d None None] Deleting port 409a78e5-4573-4d33-b4da-83dcea90e530 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:33.921317 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-af8d2f43-f17d-4b78-b2b7-60bcadd37c5d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:34.244615 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 144476e8-3d2f-40e1-8e1d-88435e1c3389 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:34.423916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] For port 409a78e5-4573-4d33-b4da-83dcea90e530, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=409a78e5-4573-4d33-b4da-83dcea90e530,segment=NetworkSegment(170e329c-dde1-448c-88ad-452fb2700328),segment_id=170e329c-dde1-448c-88ad-452fb2700328)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:34.424517 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:34.441591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 144476e8-3d2f-40e1-8e1d-88435e1c3389 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:44:34.441860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 144476e8-3d2f-40e1-8e1d-88435e1c3389 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:44:34.442281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 409a78e5-4573-4d33-b4da-83dcea90e530 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:34.452734 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-65a1a248-3f85-44cf-a0b8-c84027468a23 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:34.840846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for 409a78e5-4573-4d33-b4da-83dcea90e530 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:34.958109 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:34.972128 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Transition to ACTIVE for port object 73a24a1d-4691-4785-a8a4-b9c2b662fc16 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:44:35.024069 n-d-841483-1 neutron-server[88153]: INFO neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No ports have port_id starting with 409a78e5-4573-4d33-b4da-83dcea90e530 May 12 15:44:35.038225 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:35.061842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Transition to ACTIVE for port object 73a24a1d-4691-4785-a8a4-b9c2b662fc16 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:44:35.082969 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:35.178585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Network 6edd3480-2f2e-4bbd-b716-be7a819dc082 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:44:35.178585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Pushing event updated for resources: {'Port': ['ID=73a24a1d-4691-4785-a8a4-b9c2b662fc16,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:35.190964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:35.190964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:44:35.207000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-af8d2f43-f17d-4b78-b2b7-60bcadd37c5d None None] For port 409a78e5-4573-4d33-b4da-83dcea90e530, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=409a78e5-4573-4d33-b4da-83dcea90e530,segment=NetworkSegment(170e329c-dde1-448c-88ad-452fb2700328),segment_id=170e329c-dde1-448c-88ad-452fb2700328)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:35.207000 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-af8d2f43-f17d-4b78-b2b7-60bcadd37c5d None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:35.348935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=409a78e5-4573-4d33-b4da-83dcea90e530,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:35.370275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-65a1a248-3f85-44cf-a0b8-c84027468a23 admin admin] Router 420111e5-3d19-4801-ac99-692a805ed38d has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:44:35.378772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No DVR routers for this DVR port 409a78e5-4573-4d33-b4da-83dcea90e530 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:44:35.522074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-af8d2f43-f17d-4b78-b2b7-60bcadd37c5d None None] Calling delete_port for 409a78e5-4573-4d33-b4da-83dcea90e530 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:35.552318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Attempting to bind port 73a24a1d-4691-4785-a8a4-b9c2b662fc16 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:44:35.552318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Attempting to bind port 73a24a1d-4691-4785-a8a4-b9c2b662fc16 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'a2c58d39-26db-41f5-9e66-49e23abff784', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '6edd3480-2f2e-4bbd-b716-be7a819dc082'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:44:35.552318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Attempting to bind port 73a24a1d-4691-4785-a8a4-b9c2b662fc16 on network 6edd3480-2f2e-4bbd-b716-be7a819dc082 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:44:35.562661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 44, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:44:35.562661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Checking segment: {'id': 'a2c58d39-26db-41f5-9e66-49e23abff784', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '6edd3480-2f2e-4bbd-b716-be7a819dc082'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:44:35.562661 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:35.562661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Bound using segment: {'id': 'a2c58d39-26db-41f5-9e66-49e23abff784', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '6edd3480-2f2e-4bbd-b716-be7a819dc082'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:44:35.562661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Bound port: 73a24a1d-4691-4785-a8a4-b9c2b662fc16, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a2c58d39-26db-41f5-9e66-49e23abff784', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': '6edd3480-2f2e-4bbd-b716-be7a819dc082'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:44:35.562661 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:35.639834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:35.692393 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:35.720852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] For port 73a24a1d-4691-4785-a8a4-b9c2b662fc16, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:44:35.736265 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] For port 73a24a1d-4691-4785-a8a4-b9c2b662fc16, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=73a24a1d-4691-4785-a8a4-b9c2b662fc16,segment=NetworkSegment(a2c58d39-26db-41f5-9e66-49e23abff784),segment_id=a2c58d39-26db-41f5-9e66-49e23abff784)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:44:35.753536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Allocated IP 2001:db8::85 (6edd3480-2f2e-4bbd-b716-be7a819dc082/93116bc3-a2a4-4941-9811-c16809fcaf18/20562783-dfb0-46eb-b519-bb7799f0ca61) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:44:35.765123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3f83009e-15c3-4297-93d4-b28b3de6e6a0']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:35.770266 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:35.791279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '170e329c-dde1-448c-88ad-452fb2700328') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:35.791704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '170e329c-dde1-448c-88ad-452fb2700328') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:35.870972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-65a1a248-3f85-44cf-a0b8-c84027468a23 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:44:35.889753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-65a1a248-3f85-44cf-a0b8-c84027468a23 admin admin] 10.222.0.82 "PUT /v2.0/routers/420111e5-3d19-4801-ac99-692a805ed38d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.8466418 May 12 15:44:35.892540 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:35.896477 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0112bed9-4976-43a1-8279-b09940aa52e0 None None] Sync routers for ids ['420111e5-3d19-4801-ac99-692a805ed38d'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:44:35.900840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43746) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:35.967029 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0112bed9-4976-43a1-8279-b09940aa52e0 None None] Routers {'420111e5-3d19-4801-ac99-692a805ed38d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:35.967029 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0112bed9-4976-43a1-8279-b09940aa52e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['420111e5-3d19-4801-ac99-692a805ed38d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:36.176219 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-af8d2f43-f17d-4b78-b2b7-60bcadd37c5d None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:44:36.177252 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-af8d2f43-f17d-4b78-b2b7-60bcadd37c5d None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:44:36.181420 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:36.243048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Releasing vlan 565 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:44:36.243048 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: timer() May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:44:36.306607 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:36.332812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baa3f980-e133-496f-88ae-69ae0dfdb0b9 None None] Pushing event updated for resources: {'Port': ['ID=73a24a1d-4691-4785-a8a4-b9c2b662fc16,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:36.461843 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-0112bed9-4976-43a1-8279-b09940aa52e0 None None] Set router 420111e5-3d19-4801-ac99-692a805ed38d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:36.572054 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:36.679312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-af8d2f43-f17d-4b78-b2b7-60bcadd37c5d None None] Deleting port 409a78e5-4573-4d33-b4da-83dcea90e530 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:36.679803 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-af8d2f43-f17d-4b78-b2b7-60bcadd37c5d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:36.773236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:36.861843 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:36.917089 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-af8d2f43-f17d-4b78-b2b7-60bcadd37c5d None None] The port '409a78e5-4573-4d33-b4da-83dcea90e530' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:44:37.082455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Network': ['ID=3f83009e-15c3-4297-93d4-b28b3de6e6a0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:37.087453 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4381661a-f8e9-4efe-a822-43a7428ee20e tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/networks/3f83009e-15c3-4297-93d4-b28b3de6e6a0 HTTP/1.1" status: 204 len: 168 time: 4.8077867 May 12 15:44:37.092253 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43784) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:37.168963 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:37.271671 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0112bed9-4976-43a1-8279-b09940aa52e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '420111e5-3d19-4801-ac99-692a805ed38d', 'name': 'tempest-TestAggregatesBasicOps-454973996-router', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57'}], 'enable_snat': True}, 'gw_port_id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:31Z', 'updated_at': '2022-05-12T15:44:33Z', 'revision_number': 5, 'project_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'gw_port': {'id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:ac:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '420111e5-3d19-4801-ac99-692a805ed38d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3518, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:37.274464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Transition to ACTIVE for port object 20562783-dfb0-46eb-b519-bb7799f0ca61 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:44:37.286065 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0112bed9-4976-43a1-8279-b09940aa52e0 None None] Checking router: 420111e5-3d19-4801-ac99-692a805ed38d for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:44:37.308248 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0112bed9-4976-43a1-8279-b09940aa52e0 None None] Routers {'420111e5-3d19-4801-ac99-692a805ed38d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:37.308248 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0112bed9-4976-43a1-8279-b09940aa52e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['420111e5-3d19-4801-ac99-692a805ed38d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:37.506727 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:37.509378 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:37.522691 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:37.528161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] Deleting port 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:37.529005 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:37.652806 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-0112bed9-4976-43a1-8279-b09940aa52e0 None None] Set router 420111e5-3d19-4801-ac99-692a805ed38d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:37.666592 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:37.795251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 6edd3480-2f2e-4bbd-b716-be7a819dc082 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:44:37.802783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:37.813520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:44:37.833915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:37.836698 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:37.951706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=b1f3dfd8-5191-40b3-9f9a-49e68fd758e1,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:38.137142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] For port 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:38.137142 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:38.157946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 73a24a1d-4691-4785-a8a4-b9c2b662fc16 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:38.272448 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:38.395715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-954d9f24-0d2e-434a-8f6a-5bef50087de3 None None] Network 6edd3480-2f2e-4bbd-b716-be7a819dc082 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:44:38.441968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] Calling delete_port for 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:38.542088 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 891 time: 5.7434413 May 12 15:44:38.542088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43852) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:38.747185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aafb950-453c-4993-b79f-da3c2ac193a8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=20562783-dfb0-46eb-b519-bb7799f0ca61,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:38.854060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 73a24a1d-4691-4785-a8a4-b9c2b662fc16 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:44:38.872346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ecca05bb-8b55-4842-b9e0-59bb0941d3b9 None None] Provisioning for port 73a24a1d-4691-4785-a8a4-b9c2b662fc16 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:44:38.886976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ecca05bb-8b55-4842-b9e0-59bb0941d3b9 None None] Provisioning complete for port 73a24a1d-4691-4785-a8a4-b9c2b662fc16 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:38.891731 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ecca05bb-8b55-4842-b9e0-59bb0941d3b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:38.931231 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0112bed9-4976-43a1-8279-b09940aa52e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '420111e5-3d19-4801-ac99-692a805ed38d', 'name': 'tempest-TestAggregatesBasicOps-454973996-router', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57'}], 'enable_snat': True}, 'gw_port_id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:31Z', 'updated_at': '2022-05-12T15:44:33Z', 'revision_number': 5, 'project_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'gw_port': {'id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:ac:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '420111e5-3d19-4801-ac99-692a805ed38d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3518, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:38.946177 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0112bed9-4976-43a1-8279-b09940aa52e0 None None] The sync data for ids ['420111e5-3d19-4801-ac99-692a805ed38d'] in n-d-841483-1 is: [{'id': '420111e5-3d19-4801-ac99-692a805ed38d', 'name': 'tempest-TestAggregatesBasicOps-454973996-router', 'tenant_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57'}], 'enable_snat': True}, 'gw_port_id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:31Z', 'updated_at': '2022-05-12T15:44:33Z', 'revision_number': 5, 'project_id': 'b5b03ecc6a264c70aba77f212d9d4757', 'gw_port': {'id': '4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:ac:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '420111e5-3d19-4801-ac99-692a805ed38d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3518, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:44:38.985296 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 73a24a1d-4691-4785-a8a4-b9c2b662fc16 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:38.986473 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:39.067726 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Floating IP d2ed2139-605d-4648-ada6-83bbdb6ff583 associated. External IP: 172.25.8.55, port: 42a296ea-fb47-4109-8501-772157438fa6. May 12 15:44:39.187286 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:39.422474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] Pushing event deleted for resources: {'Port': ['ID=4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:39.568371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3b524701-5559-4193-ac42-7fa2c3847cb3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 20562783-dfb0-46eb-b519-bb7799f0ca61 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:39.568371 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b524701-5559-4193-ac42-7fa2c3847cb3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:39.736640 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ecca05bb-8b55-4842-b9e0-59bb0941d3b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:39.942329 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:44:39.999057 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:40.041718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ecca05bb-8b55-4842-b9e0-59bb0941d3b9 None None] For port 73a24a1d-4691-4785-a8a4-b9c2b662fc16, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=73a24a1d-4691-4785-a8a4-b9c2b662fc16,segment=NetworkSegment(a2c58d39-26db-41f5-9e66-49e23abff784),segment_id=a2c58d39-26db-41f5-9e66-49e23abff784)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:40.327152 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ecca05bb-8b55-4842-b9e0-59bb0941d3b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:40.560668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecca05bb-8b55-4842-b9e0-59bb0941d3b9 None None] Pushing event updated for resources: {'Port': ['ID=73a24a1d-4691-4785-a8a4-b9c2b662fc16,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:40.577624 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:40.577624 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:40.629092 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:40.629092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 420111e5-3d19-4801-ac99-692a805ed38d {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:44:40.668501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b9c2d2b5-8819-4be1-a8e6-613616dac8fe no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:40.685806 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:40.696025 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d5b5168a-1b29-4721-bf18-82c3067c3514 admin admin] 10.222.0.82 "DELETE /v2.0/routers/420111e5-3d19-4801-ac99-692a805ed38d HTTP/1.1" status: 204 len: 168 time: 4.8058693 May 12 15:44:40.702415 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b524701-5559-4193-ac42-7fa2c3847cb3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:40.717844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43902) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:40.789736 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: b9c2d2b5-8819-4be1-a8e6-613616dac8fe {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:44:40.789736 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b9c2d2b5-8819-4be1-a8e6-613616dac8fe not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:44:40.975776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-3b524701-5559-4193-ac42-7fa2c3847cb3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 20562783-dfb0-46eb-b519-bb7799f0ca61 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:41.029284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-4fcae45b-b785-48d0-b16b-0225fd03753f admin admin] Deleting subnet 341bc8b1-1137-42ab-8609-e6e2102116ba {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:44:41.065187 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4fcae45b-b785-48d0-b16b-0225fd03753f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:41.195491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Router 943c296a-7f18-4231-8088-35f5348abd2b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:44:41.306836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-23336dfa-c041-4dae-ada2-a7821d37ea33 None None] Provisioning complete for port 73a24a1d-4691-4785-a8a4-b9c2b662fc16 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:41.307113 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-23336dfa-c041-4dae-ada2-a7821d37ea33 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:41.371950 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4fcae45b-b785-48d0-b16b-0225fd03753f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:41.553444 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d2939645-0dc7-4797-ac28-1a54935ab1b9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:41.828530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-23336dfa-c041-4dae-ada2-a7821d37ea33 None None] Provisioning for port 20562783-dfb0-46eb-b519-bb7799f0ca61 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:44:41.834795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-23336dfa-c041-4dae-ada2-a7821d37ea33 None None] Provisioning complete for port 20562783-dfb0-46eb-b519-bb7799f0ca61 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:41.835415 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-23336dfa-c041-4dae-ada2-a7821d37ea33 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:41.904718 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4fcae45b-b785-48d0-b16b-0225fd03753f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:41.954664 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-23336dfa-c041-4dae-ada2-a7821d37ea33 None None] Port 20562783-dfb0-46eb-b519-bb7799f0ca61 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:44:42.033765 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4fcae45b-b785-48d0-b16b-0225fd03753f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:42.101794 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a56b22e8-07a4-41f8-8260-c77be21d07c5 None None] Provisioning complete for port 20562783-dfb0-46eb-b519-bb7799f0ca61 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:42.101794 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a56b22e8-07a4-41f8-8260-c77be21d07c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:42.104874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:44:42.203397 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fcae45b-b785-48d0-b16b-0225fd03753f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=341bc8b1-1137-42ab-8609-e6e2102116ba,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:42.208828 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4fcae45b-b785-48d0-b16b-0225fd03753f admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:42.211949 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2291825-daac-46c9-9019-d6ddd858c23b None None] Sync routers for ids ['943c296a-7f18-4231-8088-35f5348abd2b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:44:42.214529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b524701-5559-4193-ac42-7fa2c3847cb3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:42.223432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4fcae45b-b785-48d0-b16b-0225fd03753f admin admin] 10.222.0.82 "DELETE /v2.0/subnets/341bc8b1-1137-42ab-8609-e6e2102116ba HTTP/1.1" status: 204 len: 168 time: 1.5178764 May 12 15:44:42.227040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43954) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:42.244318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-711d9561-06e1-4abc-8cc4-355136e1e5e5 None None] Network 4365c129-804f-4de1-8f2b-afafcddb88c8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:44:42.313971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:42.639959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b524701-5559-4193-ac42-7fa2c3847cb3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=20562783-dfb0-46eb-b519-bb7799f0ca61,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:42.718991 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:42.742449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Deleting port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:42.742775 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:42.760708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 73a24a1d-4691-4785-a8a4-b9c2b662fc16 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:44:42.763753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3b524701-5559-4193-ac42-7fa2c3847cb3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:42.777768 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3b524701-5559-4193-ac42-7fa2c3847cb3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/20562783-dfb0-46eb-b519-bb7799f0ca61 HTTP/1.1" status: 204 len: 168 time: 4.1930320 May 12 15:44:42.780492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43978) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:42.927094 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-79e0a1b3-d853-466e-9037-5b2a82407fb9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] GET failed (client error): The resource could not be found. May 12 15:44:42.927094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-79e0a1b3-d853-466e-9037-5b2a82407fb9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:44:42.965266 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cc2450f2-759b-4503-b299-0df48959c840 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 14.2649336 May 12 15:44:42.972510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 43988) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:42.976040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'tag': '42a296ea-fb47-4109-8501-772157438fa6'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:44:43.010333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-79e0a1b3-d853-466e-9037-5b2a82407fb9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:44:43.010333 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-79e0a1b3-d853-466e-9037-5b2a82407fb9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/20562783-dfb0-46eb-b519-bb7799f0ca61 HTTP/1.1" status: 404 len: 333 time: 0.2240434 May 12 15:44:43.010333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 43994) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:43.056192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2291825-daac-46c9-9019-d6ddd858c23b None None] Routers {'943c296a-7f18-4231-8088-35f5348abd2b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:43.056872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c2291825-daac-46c9-9019-d6ddd858c23b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['943c296a-7f18-4231-8088-35f5348abd2b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:43.139529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-067a2e56-3356-48e6-8b3e-b430f3117aab tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting subnet 93116bc3-a2a4-4941-9811-c16809fcaf18 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:44:43.143180 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c4ad1a73-1838-4759-83fd-76197cda0d1c'] response: {'name': 'network-changed', 'server_uuid': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'tag': '42a296ea-fb47-4109-8501-772157438fa6', 'status': 'completed', 'code': 200} May 12 15:44:43.145076 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-067a2e56-3356-48e6-8b3e-b430f3117aab tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:43.174237 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e8ea032d-1372-450d-bfec-2d2cba129219 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/floatingips/d2ed2139-605d-4648-ada6-83bbdb6ff583 HTTP/1.1" status: 200 len: 990 time: 0.1995935 May 12 15:44:43.337564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a56b22e8-07a4-41f8-8260-c77be21d07c5 None None] Port 20562783-dfb0-46eb-b519-bb7799f0ca61 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:44:43.471904 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e9d244be-15de-4463-92a5-20df3e6e19ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:43.523736 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:43.598441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d2939645-0dc7-4797-ac28-1a54935ab1b9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port 71e8fce5-504b-42e3-96ac-f1d3aa801337 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:43.600491 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d2939645-0dc7-4797-ac28-1a54935ab1b9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:43.650045 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-067a2e56-3356-48e6-8b3e-b430f3117aab tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:43.736580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 73a24a1d-4691-4785-a8a4-b9c2b662fc16 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:44:43.736580 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:43.821849 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-067a2e56-3356-48e6-8b3e-b430f3117aab tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:43.862309 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c2291825-daac-46c9-9019-d6ddd858c23b None None] Set router 943c296a-7f18-4231-8088-35f5348abd2b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:43.988320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20669593-c5fc-4600-a21d-f233c18d8882 None None] DHCP port deletion for 4365c129-804f-4de1-8f2b-afafcddb88c8 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:44:44.013344 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-067a2e56-3356-48e6-8b3e-b430f3117aab tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:44.013942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-20669593-c5fc-4600-a21d-f233c18d8882 None None] Deleting port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:44.014344 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-20669593-c5fc-4600-a21d-f233c18d8882 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:44.106061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-067a2e56-3356-48e6-8b3e-b430f3117aab tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Subnet': ['ID=93116bc3-a2a4-4941-9811-c16809fcaf18,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:44.116662 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-067a2e56-3356-48e6-8b3e-b430f3117aab tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:44.123995 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-067a2e56-3356-48e6-8b3e-b430f3117aab tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/93116bc3-a2a4-4941-9811-c16809fcaf18 HTTP/1.1" status: 204 len: 168 time: 1.1142313 May 12 15:44:44.126933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44012) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:44.163809 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] For port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087,segment=NetworkSegment(1bca247c-f07d-45c8-9a50-17cd07b7f0b5),segment_id=1bca247c-f07d-45c8-9a50-17cd07b7f0b5)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:44.164431 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:44.189949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44016) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:44.248453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83512c99-cd8d-4063-b37b-2867e1d6c8f1 req-dcd71e5e-803d-4099-94ec-9ab3c043dfae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:44.248453 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83512c99-cd8d-4063-b37b-2867e1d6c8f1 req-dcd71e5e-803d-4099-94ec-9ab3c043dfae service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 1096 time: 1.0645118 May 12 15:44:44.433877 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:44.464598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4ffd148-074e-4ef3-b5cc-6fc046fe8e6b None None] Network 6edd3480-2f2e-4bbd-b716-be7a819dc082 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:44:44.465609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 73a24a1d-4691-4785-a8a4-b9c2b662fc16 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:44.465958 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:44.508400 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6d2db394-1fe2-467b-a81b-e01edfad0433 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/floatingips/d2ed2139-605d-4648-ada6-83bbdb6ff583 HTTP/1.1" status: 200 len: 990 time: 0.3029892 May 12 15:44:44.886116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Calling delete_port for f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:44.935232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] For port 73a24a1d-4691-4785-a8a4-b9c2b662fc16, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=73a24a1d-4691-4785-a8a4-b9c2b662fc16,segment=NetworkSegment(a2c58d39-26db-41f5-9e66-49e23abff784),segment_id=a2c58d39-26db-41f5-9e66-49e23abff784)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:44.936940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:45.130410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 73a24a1d-4691-4785-a8a4-b9c2b662fc16 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:45.150920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83512c99-cd8d-4063-b37b-2867e1d6c8f1 req-5cbfb273-69b1-4dd4-9ec0-0b110ed507a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:45.150920 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83512c99-cd8d-4063-b37b-2867e1d6c8f1 req-5cbfb273-69b1-4dd4-9ec0-0b110ed507a3 service neutron] 10.222.0.84 "GET /v2.0/networks?id=03979098-a904-494a-a852-b458bf7ca658 HTTP/1.1" status: 200 len: 897 time: 0.7307098 May 12 15:44:45.173551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:45.302338 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:45.330333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:44:45.330333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4b44e3db-a4f1-4dd7-b25d-ae7bd31c9732 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:44:45.423471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No DVR routers for this DVR port 73a24a1d-4691-4785-a8a4-b9c2b662fc16 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:44:45.470178 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-319d0777-2d2f-45ee-b0db-225a7f153405 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:45.480727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-d2939645-0dc7-4797-ac28-1a54935ab1b9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] For port 71e8fce5-504b-42e3-96ac-f1d3aa801337, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=71e8fce5-504b-42e3-96ac-f1d3aa801337,segment=NetworkSegment(7a44f3c7-0903-4bb2-a8d6-58ca1555771d),segment_id=7a44f3c7-0903-4bb2-a8d6-58ca1555771d)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:45.480727 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d2939645-0dc7-4797-ac28-1a54935ab1b9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:45.557159 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44042) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:45.563176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=73a24a1d-4691-4785-a8a4-b9c2b662fc16,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:45.604267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:45.782649 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-20669593-c5fc-4600-a21d-f233c18d8882 None None] For port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087,segment=NetworkSegment(1bca247c-f07d-45c8-9a50-17cd07b7f0b5),segment_id=1bca247c-f07d-45c8-9a50-17cd07b7f0b5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:45.782649 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-20669593-c5fc-4600-a21d-f233c18d8882 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:45.835692 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:45.948835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d2939645-0dc7-4797-ac28-1a54935ab1b9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for 71e8fce5-504b-42e3-96ac-f1d3aa801337 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:45.975354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6edd3480-2f2e-4bbd-b716-be7a819dc082']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:45.995295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a2c58d39-26db-41f5-9e66-49e23abff784') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:45.995979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a2c58d39-26db-41f5-9e66-49e23abff784') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:46.016391 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:46.027885 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-da95cfc6-765a-40a4-8240-fd0f4ba4cd02 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/floatingips/d2ed2139-605d-4648-ada6-83bbdb6ff583 HTTP/1.1" status: 200 len: 990 time: 0.4606988 May 12 15:44:46.037091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83512c99-cd8d-4063-b37b-2867e1d6c8f1 req-9f623f6e-b81b-4bcb-a52b-c0ac7e91d3d3 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=42a296ea-fb47-4109-8501-772157438fa6 HTTP/1.1" status: 200 len: 998 time: 0.8600607 May 12 15:44:46.053756 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:46.077559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-20669593-c5fc-4600-a21d-f233c18d8882 None None] Calling delete_port for f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:46.095051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Releasing vlan 581 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:44:46.095051 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:46.274077 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c2291825-daac-46c9-9019-d6ddd858c23b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:43:35Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd2ed2139-605d-4648-ada6-83bbdb6ff583', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'port_id': '42a296ea-fb47-4109-8501-772157438fa6', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 3563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'mac_address': 'fa:16:3e:2d:a9:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:44:34Z', 'updated_at': '2022-05-12T15:44:34Z', 'revision_number': 0, 'project_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:10Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:46.299861 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:46.312006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2291825-daac-46c9-9019-d6ddd858c23b None None] Checking router: 943c296a-7f18-4231-8088-35f5348abd2b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:44:46.324524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83512c99-cd8d-4063-b37b-2867e1d6c8f1 req-afb6c840-5689-4d27-9e77-4931e0505b99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:46.335835 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:46.336503 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83512c99-cd8d-4063-b37b-2867e1d6c8f1 req-afb6c840-5689-4d27-9e77-4931e0505b99 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=501ff294-e32c-494b-9718-ec96b39fa231 HTTP/1.1" status: 200 len: 835 time: 0.2795579 May 12 15:44:46.356096 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: timer() May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:44:46.402836 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:44:46.406778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0be52459-abf6-4c3a-96e6-11b8ca750e7d None None] DHCP port deletion for 6edd3480-2f2e-4bbd-b716-be7a819dc082 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:44:46.409567 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:46.447692 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:46.465334 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-20669593-c5fc-4600-a21d-f233c18d8882 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:44:46.465801 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-20669593-c5fc-4600-a21d-f233c18d8882 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:44:46.466578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2291825-daac-46c9-9019-d6ddd858c23b None None] Routers {'943c296a-7f18-4231-8088-35f5348abd2b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:46.467554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c2291825-daac-46c9-9019-d6ddd858c23b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['943c296a-7f18-4231-8088-35f5348abd2b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:46.490629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Network': ['ID=6edd3480-2f2e-4bbd-b716-be7a819dc082,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:46.518245 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-15dc045b-552b-43ea-a545-a06a2e24e86c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/networks/6edd3480-2f2e-4bbd-b716-be7a819dc082 HTTP/1.1" status: 204 len: 168 time: 2.3846047 May 12 15:44:46.518245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44056) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:46.534234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'name': 'tempest-PortsIpV6TestJSON-763871224'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:46.619727 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:46.777227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:46.782664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:port and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:46.786017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:46.792733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:46.814068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:46.818250 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:46.874169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port 5891d3af-717d-4511-bdc5-9bc3c162c231 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:44:46.907257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] No DVR routers for this DVR port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:44:46.952819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c2291825-daac-46c9-9019-d6ddd858c23b None None] Set router 943c296a-7f18-4231-8088-35f5348abd2b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:46.995829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Pushing event deleted for resources: {'Port': ['ID=f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:47.037966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44066) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:47.376447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-20669593-c5fc-4600-a21d-f233c18d8882 None None] Deleting port f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:47.376447 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-20669593-c5fc-4600-a21d-f233c18d8882 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:47.800795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-20669593-c5fc-4600-a21d-f233c18d8882 None None] The port 'f9037b1f-b93f-44dc-a9ca-1f8d3d3ec087' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:44:47.814308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 73a24a1d-4691-4785-a8a4-b9c2b662fc16 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:47.867364 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d2939645-0dc7-4797-ac28-1a54935ab1b9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:47.904262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44082) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:47.990037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 73a24a1d-4691-4785-a8a4-b9c2b662fc16 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:44:47.990569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 73a24a1d-4691-4785-a8a4-b9c2b662fc16 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:44:48.054282 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:48.118369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2939645-0dc7-4797-ac28-1a54935ab1b9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=71e8fce5-504b-42e3-96ac-f1d3aa801337,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:48.140618 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:48.232881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4365c129-804f-4de1-8f2b-afafcddb88c8']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:48.240142 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:48.287046 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:48.291074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83512c99-cd8d-4063-b37b-2867e1d6c8f1 req-bc5be7e8-3458-49e2-877d-cb12d0e843ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:48.291074 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83512c99-cd8d-4063-b37b-2867e1d6c8f1 req-bc5be7e8-3458-49e2-877d-cb12d0e843ac service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=03979098-a904-494a-a852-b458bf7ca658&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 1.9446316 May 12 15:44:48.374646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1bca247c-f07d-45c8-9a50-17cd07b7f0b5') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:48.374646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1bca247c-f07d-45c8-9a50-17cd07b7f0b5') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:48.418082 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c2291825-daac-46c9-9019-d6ddd858c23b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:43:35Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd2ed2139-605d-4648-ada6-83bbdb6ff583', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'port_id': '42a296ea-fb47-4109-8501-772157438fa6', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 3563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'mac_address': 'fa:16:3e:2d:a9:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:44:34Z', 'updated_at': '2022-05-12T15:44:34Z', 'revision_number': 0, 'project_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:10Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:48.429923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2291825-daac-46c9-9019-d6ddd858c23b None None] The sync data for ids ['943c296a-7f18-4231-8088-35f5348abd2b'] in n-d-841483-1 is: [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:43:35Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd2ed2139-605d-4648-ada6-83bbdb6ff583', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'port_id': '42a296ea-fb47-4109-8501-772157438fa6', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 3563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'mac_address': 'fa:16:3e:2d:a9:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:44:34Z', 'updated_at': '2022-05-12T15:44:34Z', 'revision_number': 0, 'project_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:10Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:44:48.447286 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2b2df3de-2030-4c1c-ae6b-0d13a38796e8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/floatingips/d2ed2139-605d-4648-ada6-83bbdb6ff583 HTTP/1.1" status: 200 len: 990 time: 1.4080725 May 12 15:44:48.495676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 61b1250e-09c9-4206-8592-62cee35b5757 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:44:48.507245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:48.518626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:44:48.530443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:48.536659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:48.559345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=5891d3af-717d-4511-bdc5-9bc3c162c231,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:48.602435 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-519cf364-99e5-4479-8f62-9781f961cb09 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 849 time: 2.0853028 May 12 15:44:48.604877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44094) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:48.862859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2005a12b-5e5a-49bd-a827-43464f40b424 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 5891d3af-717d-4511-bdc5-9bc3c162c231 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:48.863464 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2005a12b-5e5a-49bd-a827-43464f40b424 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:48.999201 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:49.088539 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d2939645-0dc7-4797-ac28-1a54935ab1b9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:49.218533 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2005a12b-5e5a-49bd-a827-43464f40b424 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:49.276563 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:49.288582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Releasing vlan 579 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:44:49.289317 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:49.504901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44104) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: timer() May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:44:49.508063 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:44:49.672462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dfc486ba-e675-4208-8584-e5a857fa5c24 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f5159f7227ee44cd86967cf5c8d430ab&name=default HTTP/1.1" status: 200 len: 2983 time: 1.7394047 May 12 15:44:49.677133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44112) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:49.680309 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:49.698722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2005a12b-5e5a-49bd-a827-43464f40b424 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 5891d3af-717d-4511-bdc5-9bc3c162c231 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:49.741182 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:49.768341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] Pushing event deleted for resources: {'Network': ['ID=4365c129-804f-4de1-8f2b-afafcddb88c8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:49.873089 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2664eac3-199e-47a2-90d6-9103733f81f2 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/floatingips/d2ed2139-605d-4648-ada6-83bbdb6ff583 HTTP/1.1" status: 200 len: 990 time: 0.3691061 May 12 15:44:49.905444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2005a12b-5e5a-49bd-a827-43464f40b424 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:49.980180 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9758608e-ce17-4ce9-ba27-7d62de1eebe9 None None] New status for floating IP d2ed2139-605d-4648-ada6-83bbdb6ff583: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:44:49.994676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2005a12b-5e5a-49bd-a827-43464f40b424 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=5891d3af-717d-4511-bdc5-9bc3c162c231,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:50.015348 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2005a12b-5e5a-49bd-a827-43464f40b424 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:50.052936 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2005a12b-5e5a-49bd-a827-43464f40b424 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/5891d3af-717d-4511-bdc5-9bc3c162c231 HTTP/1.1" status: 204 len: 168 time: 1.4466381 May 12 15:44:50.053772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44120) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:50.064758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'mac_address': 'fa:16:3e:17:06:3e', 'name': 'tempest-PortsIpV6TestJSON-2086946228'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:50.204150 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83512c99-cd8d-4063-b37b-2867e1d6c8f1 req-2b846c70-e4f9-40a0-bf21-106145e0fd40 service neutron] 10.222.0.84 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.8729551 May 12 15:44:50.212101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:50.228292 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d6b82251-45fe-4d03-b695-8529cfa907f3 admin admin] 10.222.0.82 "DELETE /v2.0/networks/4365c129-804f-4de1-8f2b-afafcddb88c8 HTTP/1.1" status: 204 len: 168 time: 7.9952700 May 12 15:44:50.239479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:port and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:50.239479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:50.239479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:50.273525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:50.500102 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6caf441-4c92-48a5-baef-2ac190c95231 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:50.537006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d2939645-0dc7-4797-ac28-1a54935ab1b9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 766c87d1-88c8-4b7e-ba13-f65737b66f8b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:44:50.551631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44128) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:50.606144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:50.610812 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6caf441-4c92-48a5-baef-2ac190c95231 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:50.647718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port 0da64f1a-ae78-49d9-a308-8fbd6b5c7502 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:44:50.729439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83512c99-cd8d-4063-b37b-2867e1d6c8f1 req-5a094178-60f8-4e3c-b4e8-fe70703f0d3b service neutron] 10.222.0.84 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4718285 May 12 15:44:50.731900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c7608070-92df-4fc3-a85f-8cbab425a7bc admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7b6758bd71d1400f8b6b1d4858918128&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1784768 May 12 15:44:50.761990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44132) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:50.898581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44140) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:51.087348 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6caf441-4c92-48a5-baef-2ac190c95231 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:51.120730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6caf441-4c92-48a5-baef-2ac190c95231 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1515931f-5ca8-49a5-a679-083278fc54dd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:51.154587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2939645-0dc7-4797-ac28-1a54935ab1b9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:44:51.155999 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbbe8d92-fa60-4748-a01a-96570a4199d4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:51.163307 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d2939645-0dc7-4797-ac28-1a54935ab1b9 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 14.0644805 May 12 15:44:51.169335 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6caf441-4c92-48a5-baef-2ac190c95231 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:51.170503 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c6caf441-4c92-48a5-baef-2ac190c95231 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1515931f-5ca8-49a5-a679-083278fc54dd HTTP/1.1" status: 204 len: 168 time: 1.4877274 May 12 15:44:51.171262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44148) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:51.204284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aba9a287-8942-45b6-94e5-0e89212ceebe None None] Sync routers for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:44:51.235855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aba9a287-8942-45b6-94e5-0e89212ceebe None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:51.237263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-aba9a287-8942-45b6-94e5-0e89212ceebe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:51.249020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-082ce07d-58df-45c9-b5de-112f9f251ec7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting subnet e60573af-7581-47c1-bde6-897b9df5c310 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:44:51.264932 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-082ce07d-58df-45c9-b5de-112f9f251ec7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:51.295830 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbbe8d92-fa60-4748-a01a-96570a4199d4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:51.484250 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dad95b02-ddd5-4bb4-9c4b-12aaafb87c33 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/floatingips/d2ed2139-605d-4648-ada6-83bbdb6ff583 HTTP/1.1" status: 200 len: 992 time: 0.5789649 May 12 15:44:51.513412 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:51.538325 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-082ce07d-58df-45c9-b5de-112f9f251ec7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:51.627216 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:51.674064 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-aba9a287-8942-45b6-94e5-0e89212ceebe None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:51.778580 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-082ce07d-58df-45c9-b5de-112f9f251ec7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:51.829345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 61b1250e-09c9-4206-8592-62cee35b5757 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:44:51.880215 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-082ce07d-58df-45c9-b5de-112f9f251ec7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:51.925460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:51.929882 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbbe8d92-fa60-4748-a01a-96570a4199d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:51.941459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:44:51.968933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-082ce07d-58df-45c9-b5de-112f9f251ec7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Subnet': ['ID=e60573af-7581-47c1-bde6-897b9df5c310,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:51.968933 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-082ce07d-58df-45c9-b5de-112f9f251ec7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:51.979068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbbe8d92-fa60-4748-a01a-96570a4199d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a58efc01-61b7-4d4d-a153-d3125124b4dc,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:51.990092 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbbe8d92-fa60-4748-a01a-96570a4199d4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:51.991679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bbbe8d92-fa60-4748-a01a-96570a4199d4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a58efc01-61b7-4d4d-a153-d3125124b4dc HTTP/1.1" status: 204 len: 168 time: 1.2282577 May 12 15:44:52.009793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-082ce07d-58df-45c9-b5de-112f9f251ec7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/e60573af-7581-47c1-bde6-897b9df5c310 HTTP/1.1" status: 204 len: 168 time: 0.8341336 May 12 15:44:52.010488 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44164) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:52.013101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:52.013812 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:52.023094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5c8496e-c798-4d4c-8445-31fdd6128505 None None] Network d213e082-cba2-4b2e-9e03-a43f1c32c29c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:44:52.164629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=0da64f1a-ae78-49d9-a308-8fbd6b5c7502,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:52.230569 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6b199e86-3288-4f2a-b419-2fa8b8004c2f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 2.1757090 May 12 15:44:52.233064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44172) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:52.259894 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:52.280680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port 2d578718-1ffe-4a5e-a184-b9aac0d60c36 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:52.280680 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:52.410517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca5f9585-5ad5-49d3-885e-9d173b4abd9d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:52.417139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ca5f9585-5ad5-49d3-885e-9d173b4abd9d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:44:52.462723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ca5f9585-5ad5-49d3-885e-9d173b4abd9d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:44:52.462723 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ca5f9585-5ad5-49d3-885e-9d173b4abd9d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/0da64f1a-ae78-49d9-a308-8fbd6b5c7502 HTTP/1.1" status: 200 len: 845 time: 0.2214777 May 12 15:44:52.462723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44178) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:52.562279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2f6ee3dd-b2de-4aee-88e6-129e57bc8d64 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 0da64f1a-ae78-49d9-a308-8fbd6b5c7502 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:52.562575 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f6ee3dd-b2de-4aee-88e6-129e57bc8d64 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:52.688098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44184) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:52.745839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] For port 2d578718-1ffe-4a5e-a184-b9aac0d60c36, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2d578718-1ffe-4a5e-a184-b9aac0d60c36,segment=NetworkSegment(7a44f3c7-0903-4bb2-a8d6-58ca1555771d),segment_id=7a44f3c7-0903-4bb2-a8d6-58ca1555771d)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:52.745839 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:52.896827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a232ba0-8b52-4222-88dd-304eb898f6bd None None] DHCP port deletion for d213e082-cba2-4b2e-9e03-a43f1c32c29c request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:44:52.908252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2a232ba0-8b52-4222-88dd-304eb898f6bd None None] Deleting port 2d578718-1ffe-4a5e-a184-b9aac0d60c36 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:52.908613 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2a232ba0-8b52-4222-88dd-304eb898f6bd None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:52.913977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f6ee3dd-b2de-4aee-88e6-129e57bc8d64 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:52.932160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for 2d578718-1ffe-4a5e-a184-b9aac0d60c36 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:53.033020 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-21b229c0-23b7-4d2b-b02b-bb94f2bf9829 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b5b03ecc6a264c70aba77f212d9d4757&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3448362 May 12 15:44:53.043277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44190) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:53.050550 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:53.075235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2a232ba0-8b52-4222-88dd-304eb898f6bd None None] The port '2d578718-1ffe-4a5e-a184-b9aac0d60c36' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:44:53.113005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-aba9a287-8942-45b6-94e5-0e89212ceebe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:46Z', 'revision_number': 10, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:53.128622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aba9a287-8942-45b6-94e5-0e89212ceebe None None] Checking router: 766c87d1-88c8-4b7e-ba13-f65737b66f8b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:44:53.133337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2f6ee3dd-b2de-4aee-88e6-129e57bc8d64 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 0da64f1a-ae78-49d9-a308-8fbd6b5c7502 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:53.137421 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aba9a287-8942-45b6-94e5-0e89212ceebe None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:53.137421 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-aba9a287-8942-45b6-94e5-0e89212ceebe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:53.238417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f6ee3dd-b2de-4aee-88e6-129e57bc8d64 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:53.265492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No DVR routers for this DVR port 2d578718-1ffe-4a5e-a184-b9aac0d60c36 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:44:53.275186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=2d578718-1ffe-4a5e-a184-b9aac0d60c36,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:53.287400 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2f6ee3dd-b2de-4aee-88e6-129e57bc8d64 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:53.321867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f6ee3dd-b2de-4aee-88e6-129e57bc8d64 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=0da64f1a-ae78-49d9-a308-8fbd6b5c7502,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:53.379917 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2f6ee3dd-b2de-4aee-88e6-129e57bc8d64 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/0da64f1a-ae78-49d9-a308-8fbd6b5c7502 HTTP/1.1" status: 204 len: 168 time: 0.9172075 May 12 15:44:53.379917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44202) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:53.409975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-aba9a287-8942-45b6-94e5-0e89212ceebe None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:53.474966 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-0eee6887-112f-42a6-88d2-0264cf5f6cd5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] GET failed (client error): The resource could not be found. May 12 15:44:53.474966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0eee6887-112f-42a6-88d2-0264cf5f6cd5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:44:53.501299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0eee6887-112f-42a6-88d2-0264cf5f6cd5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:44:53.501299 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0eee6887-112f-42a6-88d2-0264cf5f6cd5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/0da64f1a-ae78-49d9-a308-8fbd6b5c7502 HTTP/1.1" status: 404 len: 333 time: 0.1184452 May 12 15:44:53.528799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44208) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:53.537412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'name': 'tempest-PortsIpV6TestJSON-1389520445'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:53.589276 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:53.597462 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61cae0b6-a393-4e16-bfbc-5d0e1cdc4761 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:53.647764 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61cae0b6-a393-4e16-bfbc-5d0e1cdc4761 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:53.678446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d213e082-cba2-4b2e-9e03-a43f1c32c29c']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:53.688851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:53.697634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7a44f3c7-0903-4bb2-a8d6-58ca1555771d') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:53.697933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7a44f3c7-0903-4bb2-a8d6-58ca1555771d') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:53.703512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:53.716421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:53.720557 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:53.723566 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:53.767828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2d578718-1ffe-4a5e-a184-b9aac0d60c36 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:53.774876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port d62a83aa-5f22-4d67-8bc9-a71a36455fcb yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:44:53.778610 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:53.804585 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Releasing vlan 590 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:44:53.804585 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: timer() May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:44:53.841589 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:44:53.847627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 2d578718-1ffe-4a5e-a184-b9aac0d60c36 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:44:53.847627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2d578718-1ffe-4a5e-a184-b9aac0d60c36 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:44:53.851098 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61cae0b6-a393-4e16-bfbc-5d0e1cdc4761 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:53.992434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61cae0b6-a393-4e16-bfbc-5d0e1cdc4761 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb92ccbc-1092-42ce-af6a-4deb9db22e73,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:54.024793 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-61cae0b6-a393-4e16-bfbc-5d0e1cdc4761 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:54.029069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-61cae0b6-a393-4e16-bfbc-5d0e1cdc4761 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fb92ccbc-1092-42ce-af6a-4deb9db22e73 HTTP/1.1" status: 204 len: 168 time: 0.9873929 May 12 15:44:54.043489 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:54.055213 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:54.084289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/networks/d213e082-cba2-4b2e-9e03-a43f1c32c29c HTTP/1.1" status: 204 len: 168 time: 2.0705626 May 12 15:44:54.087974 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44224) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:54.091181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-718f325a-55d0-42e5-833c-84c459c07fe8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Network': ['ID=d213e082-cba2-4b2e-9e03-a43f1c32c29c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:54.105448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-aba9a287-8942-45b6-94e5-0e89212ceebe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:46Z', 'revision_number': 10, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:54.114939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aba9a287-8942-45b6-94e5-0e89212ceebe None None] The sync data for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 is: [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:46Z', 'revision_number': 10, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None, '_interfaces': [{'id': 'ed656bd7-ed7b-4ddb-89f6-ce37354b5f13', 'name': '', 'network_id': '68b58bc0-e327-4b58-a823-23ad945651fe', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'mac_address': 'fa:16:3e:55:ff:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3470, 'fixed_ips': [{'subnet_id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:07Z', 'updated_at': '2022-05-12T15:43:20Z', 'revision_number': 5, 'project_id': '755d04c3babe4d56b0092365d0203422', 'subnets': [{'id': 'f7006e60-2559-4109-b7ec-b5e7c210cde8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:44:54.182568 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:54.256061 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:54.410709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=d62a83aa-5f22-4d67-8bc9-a71a36455fcb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:54.425674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 61b1250e-09c9-4206-8592-62cee35b5757 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:44:54.426843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:54.429979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:44:54.435801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:54.436425 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:54.466738 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cc2beedd-840a-4acd-b9bc-00ff6c806967 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 0.9408922 May 12 15:44:54.469610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44236) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:54.477562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-fa87a2a1-c76e-4012-8070-f443119e137e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:54.779713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fa87a2a1-c76e-4012-8070-f443119e137e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:55.132106 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fa87a2a1-c76e-4012-8070-f443119e137e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:55.139182 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fa87a2a1-c76e-4012-8070-f443119e137e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:55.227926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-fa87a2a1-c76e-4012-8070-f443119e137e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] In _notify_port_updated(), no bound segment for port d62a83aa-5f22-4d67-8bc9-a71a36455fcb on network 61b1250e-09c9-4206-8592-62cee35b5757 {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:44:55.227926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa87a2a1-c76e-4012-8070-f443119e137e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:55.227926 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fa87a2a1-c76e-4012-8070-f443119e137e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:55.236335 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fa87a2a1-c76e-4012-8070-f443119e137e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "PUT /v2.0/ports/d62a83aa-5f22-4d67-8bc9-a71a36455fcb HTTP/1.1" status: 200 len: 818 time: 0.7577355 May 12 15:44:55.240224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44262) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:55.243563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa87a2a1-c76e-4012-8070-f443119e137e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=d62a83aa-5f22-4d67-8bc9-a71a36455fcb,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:55.418368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-f69fef4a-aa06-44a5-a9df-ceb0502db9c7 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port d62a83aa-5f22-4d67-8bc9-a71a36455fcb {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:55.418368 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f69fef4a-aa06-44a5-a9df-ceb0502db9c7 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:55.503892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44272) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:55.587849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 71e8fce5-504b-42e3-96ac-f1d3aa801337 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:44:55.624390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 71e8fce5-504b-42e3-96ac-f1d3aa801337 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:44:55.624835 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 71e8fce5-504b-42e3-96ac-f1d3aa801337 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:44:55.759850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Request body: {'network': {'name': 'tempest-TestServerMultinode-726377410-network', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:55.768352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:55.774665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Usage tracker for resource:network and tenant:d3a18d1ea5f34946aa8296445e7e6f81 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:55.781256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:55.799950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:55.815387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Made reservation on behalf of d3a18d1ea5f34946aa8296445e7e6f81 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:55.815387 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:55.829376 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1750c0bd-0b03-49a6-b1a4-e6c625da435d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:55.836370 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:55.862291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:55.866655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Usage tracker for resource:security_group_rule and tenant:d3a18d1ea5f34946aa8296445e7e6f81 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:55.866655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:55.878901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:55.990997 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:55.990997 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:56.006926 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f69fef4a-aa06-44a5-a9df-ceb0502db9c7 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:56.039486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88235146-11b3-4640-a2c9-91c14108cb34,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:56.045533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 586} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:44:56.062054 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:56.062054 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Added segment 61a4fe29-5447-4206-9944-48020c142c8a of type vlan for network 0de89d0f-e308-41b4-8980-4fb156f3c79b May 12 15:44:56.109433 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:56.157782 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:56.157782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:56.157782 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:56.174719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-f69fef4a-aa06-44a5-a9df-ceb0502db9c7 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for d62a83aa-5f22-4d67-8bc9-a71a36455fcb owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:56.541153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] Pushing event updated for resources: {'Network': ['ID=0de89d0f-e308-41b4-8980-4fb156f3c79b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:56.551111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 0de89d0f-e308-41b4-8980-4fb156f3c79b details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:44:56.607457 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7f5ad20e-8c57-465a-b8e0-e9a7d005a91d admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.1007333 May 12 15:44:56.608219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44294) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:56.617642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Request body: {'subnet': {'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerMultinode-726377410-subnet', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:56.644642 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f69fef4a-aa06-44a5-a9df-ceb0502db9c7 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:56.648149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:56.653572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Usage tracker for resource:subnet and tenant:d3a18d1ea5f34946aa8296445e7e6f81 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:56.657899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:56.664374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:56.684766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Made reservation on behalf of d3a18d1ea5f34946aa8296445e7e6f81 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:56.687512 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:56.707468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f69fef4a-aa06-44a5-a9df-ceb0502db9c7 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=d62a83aa-5f22-4d67-8bc9-a71a36455fcb,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:56.713822 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f69fef4a-aa06-44a5-a9df-ceb0502db9c7 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:56.789792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-1750c0bd-0b03-49a6-b1a4-e6c625da435d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:44:56.789792 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1750c0bd-0b03-49a6-b1a4-e6c625da435d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:56.980981 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f69fef4a-aa06-44a5-a9df-ceb0502db9c7 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/d62a83aa-5f22-4d67-8bc9-a71a36455fcb HTTP/1.1" status: 204 len: 168 time: 1.7474291 May 12 15:44:56.981603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44300) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:56.989414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-1750c0bd-0b03-49a6-b1a4-e6c625da435d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] For port ed656bd7-ed7b-4ddb-89f6-ce37354b5f13, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ed656bd7-ed7b-4ddb-89f6-ce37354b5f13,segment=NetworkSegment(92cc27a5-54f6-4acf-aea2-6f8363283685),segment_id=92cc27a5-54f6-4acf-aea2-6f8363283685)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:44:56.990112 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1750c0bd-0b03-49a6-b1a4-e6c625da435d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:57.021946 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:57.139818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-1750c0bd-0b03-49a6-b1a4-e6c625da435d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:44:57.173650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Checking segment: {'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:44:57.173650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Network hostable DHCP agents. Network: 0de89d0f-e308-41b4-8980-4fb156f3c79b, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:44:57.180425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Pushing event updated for resources: {'Subnet': ['ID=25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:57.200401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a93f0a8b-b7c9-4a60-9b04-d00368e9acb2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:57.200401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a93f0a8b-b7c9-4a60-9b04-d00368e9acb2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:44:57.236595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Network 0de89d0f-e308-41b4-8980-4fb156f3c79b is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:44:57.248359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a93f0a8b-b7c9-4a60-9b04-d00368e9acb2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:44:57.248359 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a93f0a8b-b7c9-4a60-9b04-d00368e9acb2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.2635458 May 12 15:44:57.255697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44306) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:57.255697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 0de89d0f-e308-41b4-8980-4fb156f3c79b) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:57.262180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:57.262180 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:57.280096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b878913b-2657-42cc-9bab-e7e4d46d5c78 None None] Network 0de89d0f-e308-41b4-8980-4fb156f3c79b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:44:57.336022 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-218522aa-c5c2-476e-a4b3-76450b66036b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] GET failed (client error): The resource could not be found. May 12 15:44:57.338721 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-218522aa-c5c2-476e-a4b3-76450b66036b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/d62a83aa-5f22-4d67-8bc9-a71a36455fcb HTTP/1.1" status: 404 len: 333 time: 0.0723348 May 12 15:44:57.345277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44310) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:57.354824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1128445619'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:57.361932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:57.365985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:network and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:57.368918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:57.373770 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aba97118-253a-4b57-873a-cc1a129b5efc admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.7620332 May 12 15:44:57.374328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44316) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:57.375226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:57.381770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Request body: {'router': {'name': 'tempest-TestServerMultinode-726377410-router', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:57.400485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:57.411915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Usage tracker for resource:router and tenant:d3a18d1ea5f34946aa8296445e7e6f81 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:57.415854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:57.423571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:57.426361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:57.427324 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:57.455619 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:57.457032 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:57.477569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:57.487087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 587} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:44:57.499446 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:57.499956 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Added segment c8e3bb58-c87d-48f2-bd31-1c6f6f6becec of type vlan for network 298268da-bc9b-41cf-8e8d-f9d26aa737fe May 12 15:44:57.536518 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1750c0bd-0b03-49a6-b1a4-e6c625da435d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:57.665614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1750c0bd-0b03-49a6-b1a4-e6c625da435d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=ed656bd7-ed7b-4ddb-89f6-ce37354b5f13,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:57.754081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-0de89d0f-e308-41b4-8980-4fb156f3c79b', 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'fixed_ips': [{'subnet_id': '25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:44:57.754081 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:57.781615 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:57.962187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:58.060286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Allocated IP 172.20.0.2 (0de89d0f-e308-41b4-8980-4fb156f3c79b/25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e/7c400b8e-f20d-492c-8fbd-a62e4dda2608) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:44:58.236159 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] It took 0.20 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:44:58.256709 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1750c0bd-0b03-49a6-b1a4-e6c625da435d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:58.286152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44332) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:58.470675 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:58.488168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Transition to ACTIVE for port object 7c400b8e-f20d-492c-8fbd-a62e4dda2608 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:44:58.504062 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:58.509628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:58.510220 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:58.526634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Transition to ACTIVE for port object 7c400b8e-f20d-492c-8fbd-a62e4dda2608 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:44:58.538542 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:58.560842 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:58.602758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Network 0de89d0f-e308-41b4-8980-4fb156f3c79b is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:44:58.612571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:58.614245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:58.638193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:44:58.785964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-995c4129-e106-4024-b52c-ecd5f3f964ad tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:58.786500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-995c4129-e106-4024-b52c-ecd5f3f964ad tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:58.786874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-995c4129-e106-4024-b52c-ecd5f3f964ad tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:44:58.788518 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-995c4129-e106-4024-b52c-ecd5f3f964ad tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/ports?project_id=b641518781114418963451fc3ff58f4d&network_id=03979098-a904-494a-a852-b458bf7ca658 HTTP/1.1" status: 200 len: 2969 time: 0.5068622 May 12 15:44:58.821030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Pushing event updated for resources: {'Port': ['ID=7c400b8e-f20d-492c-8fbd-a62e4dda2608,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:58.889045 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Attempting to bind port 7c400b8e-f20d-492c-8fbd-a62e4dda2608 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:44:58.889782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Attempting to bind port 7c400b8e-f20d-492c-8fbd-a62e4dda2608 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:44:58.890354 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Attempting to bind port 7c400b8e-f20d-492c-8fbd-a62e4dda2608 on network 0de89d0f-e308-41b4-8980-4fb156f3c79b {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:44:58.897699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 44, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:44:58.898400 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Checking segment: {'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:44:58.899016 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:58.899624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Bound using segment: {'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:44:58.900284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Bound port: 7c400b8e-f20d-492c-8fbd-a62e4dda2608, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:44:58.900861 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:58.975769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Network': ['ID=298268da-bc9b-41cf-8e8d-f9d26aa737fe,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:58.982114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Allocated IP 172.25.8.246 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/ca01fcce-f259-4769-9012-23d4f8b5e9ef) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:44:58.993765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 298268da-bc9b-41cf-8e8d-f9d26aa737fe details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:44:58.997309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1750c0bd-0b03-49a6-b1a4-e6c625da435d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 766c87d1-88c8-4b7e-ba13-f65737b66f8b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:44:59.220777 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] For port 7c400b8e-f20d-492c-8fbd-a62e4dda2608, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:44:59.220777 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] For port 7c400b8e-f20d-492c-8fbd-a62e4dda2608, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7c400b8e-f20d-492c-8fbd-a62e4dda2608,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:44:59.240609 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:59.275070 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7c417bbd-3d81-4a0d-9da1-4eb077ecf497 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 1.9284432 May 12 15:44:59.303309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44344) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:59.312481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': '298268da-bc9b-41cf-8e8d-f9d26aa737fe', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:44:59.338992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1750c0bd-0b03-49a6-b1a4-e6c625da435d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:44:59.349527 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b143ba01-c6c1-4e44-8044-bde83b9c301e None None] Sync routers for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:44:59.362287 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b143ba01-c6c1-4e44-8044-bde83b9c301e None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:59.362902 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b143ba01-c6c1-4e44-8044-bde83b9c301e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:59.440302 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1750c0bd-0b03-49a6-b1a4-e6c625da435d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.3509471 May 12 15:44:59.454176 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30afcb7d-0a24-4bc9-b371-10ca60cad41b None None] Pushing event updated for resources: {'Port': ['ID=7c400b8e-f20d-492c-8fbd-a62e4dda2608,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:59.466568 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44348) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:44:59.514644 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:59.583651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:44:59.592803 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-f0d4f425-8a39-41ea-be67-c35aa311ac40 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting subnet f7006e60-2559-4109-b7ec-b5e7c210cde8 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:44:59.595582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:44:59.599110 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:59.599334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:44:59.602409 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f0d4f425-8a39-41ea-be67-c35aa311ac40 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:59.668227 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-b143ba01-c6c1-4e44-8044-bde83b9c301e None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:44:59.682726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:44:59.738267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:44:59.746185 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:59.761586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:44:59.765196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:44:59.770858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:44:59.848474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Pushing event updated for resources: {'Port': ['ID=ca01fcce-f259-4769-9012-23d4f8b5e9ef,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:44:59.907449 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f0d4f425-8a39-41ea-be67-c35aa311ac40 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:44:59.960675 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b143ba01-c6c1-4e44-8044-bde83b9c301e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:57Z', 'revision_number': 11, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:44:59.966849 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b143ba01-c6c1-4e44-8044-bde83b9c301e None None] Checking router: 766c87d1-88c8-4b7e-ba13-f65737b66f8b for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:44:59.988305 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b143ba01-c6c1-4e44-8044-bde83b9c301e None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:44:59.989242 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b143ba01-c6c1-4e44-8044-bde83b9c301e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:00.245010 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-b143ba01-c6c1-4e44-8044-bde83b9c301e None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:00.276879 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f0d4f425-8a39-41ea-be67-c35aa311ac40 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:00.312980 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:00.462396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Checking segment: {'id': 'c8e3bb58-c87d-48f2-bd31-1c6f6f6becec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '298268da-bc9b-41cf-8e8d-f9d26aa737fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:00.463144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network hostable DHCP agents. Network: 298268da-bc9b-41cf-8e8d-f9d26aa737fe, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:45:00.467604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Subnet': ['ID=1ddc6003-e8a6-490b-b1fa-cc3e1d8653aa,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:00.490487 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f0d4f425-8a39-41ea-be67-c35aa311ac40 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:00.509605 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b143ba01-c6c1-4e44-8044-bde83b9c301e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:57Z', 'revision_number': 11, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:00.517419 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b143ba01-c6c1-4e44-8044-bde83b9c301e None None] The sync data for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 is: [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:57Z', 'revision_number': 11, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:45:00.540575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f0d4f425-8a39-41ea-be67-c35aa311ac40 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:00.546008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35564bed-ff8f-4a9d-afff-f89591b8ac3c None None] Network 68b58bc0-e327-4b58-a823-23ad945651fe requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:00.567317 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f0d4f425-8a39-41ea-be67-c35aa311ac40 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/f7006e60-2559-4109-b7ec-b5e7c210cde8 HTTP/1.1" status: 204 len: 168 time: 1.0996485 May 12 15:45:00.574863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44364) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:00.575752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0d4f425-8a39-41ea-be67-c35aa311ac40 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Subnet': ['ID=f7006e60-2559-4109-b7ec-b5e7c210cde8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:00.720722 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:00.723111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 298268da-bc9b-41cf-8e8d-f9d26aa737fe is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:45:00.752507 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:00.753893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 298268da-bc9b-41cf-8e8d-f9d26aa737fe) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:00.758781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:00.759537 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:00.779636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Deleting port ba84bb8c-76ac-4c5d-9296-856e9d039f94 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:45:00.780268 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:00.784571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a464f1b-b48d-473c-82fd-e88c3ce990b0 None None] Network 298268da-bc9b-41cf-8e8d-f9d26aa737fe requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:00.899937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-43d85fe3-da62-42d5-87d8-d3e29c62295e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.5955434 May 12 15:45:00.905655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44372) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:00.927878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d3d3ee02-ddd7-42d6-b1d5-ccd501f9c881 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': '298268da-bc9b-41cf-8e8d-f9d26aa737fe', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:01.119438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d3d3ee02-ddd7-42d6-b1d5-ccd501f9c881 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:01.127168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d3d3ee02-ddd7-42d6-b1d5-ccd501f9c881 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:01.132167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d3d3ee02-ddd7-42d6-b1d5-ccd501f9c881 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:01.161059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d3d3ee02-ddd7-42d6-b1d5-ccd501f9c881 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:01.217091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de5ae009-ba91-4d40-89ac-8dce2e3272cc None None] Network 0de89d0f-e308-41b4-8980-4fb156f3c79b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:01.319789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3d3ee02-ddd7-42d6-b1d5-ccd501f9c881 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:01.324209 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3d3ee02-ddd7-42d6-b1d5-ccd501f9c881 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:01.449359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] For port ba84bb8c-76ac-4c5d-9296-856e9d039f94, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ba84bb8c-76ac-4c5d-9296-856e9d039f94,segment=NetworkSegment(92cc27a5-54f6-4acf-aea2-6f8363283685),segment_id=92cc27a5-54f6-4acf-aea2-6f8363283685)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:01.449761 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:01.592749 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:01.650265 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-797225b8-8225-45a8-90b0-9635c4002a92 None None] Provisioning for port 7c400b8e-f20d-492c-8fbd-a62e4dda2608 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:01.661021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-298268da-bc9b-41cf-8e8d-f9d26aa737fe', 'network_id': '298268da-bc9b-41cf-8e8d-f9d26aa737fe', 'tenant_id': '1da2b935bcd34292b3e8ce00cc114001', 'fixed_ips': [{'subnet_id': '1ddc6003-e8a6-490b-b1fa-cc3e1d8653aa'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:45:01.661926 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:01.711435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44378) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:01.748967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7c400b8e-f20d-492c-8fbd-a62e4dda2608 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:01.781356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06e51a5c-718a-421c-9c17-aceea7e6e6f2 None None] DHCP port deletion for 68b58bc0-e327-4b58-a823-23ad945651fe request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:45:01.796064 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-06e51a5c-718a-421c-9c17-aceea7e6e6f2 None None] Deleting port ba84bb8c-76ac-4c5d-9296-856e9d039f94 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:45:01.796725 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-06e51a5c-718a-421c-9c17-aceea7e6e6f2 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:01.931279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ebdf0d86-30aa-4e33-9482-79ef7d2f9400 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:01.933545 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ebdf0d86-30aa-4e33-9482-79ef7d2f9400 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143 HTTP/1.1" status: 200 len: 814 time: 0.2148194 May 12 15:45:01.964766 n-d-841483-1 neutron-server[88152]: INFO neutron.db.ipam_backend_mixin [None req-d3d3ee02-ddd7-42d6-b1d5-ccd501f9c881 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 1ddc6003-e8a6-490b-b1fa-cc3e1d8653aa (CIDR: 2001:db8::/64) May 12 15:45:01.990512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Calling delete_port for ba84bb8c-76ac-4c5d-9296-856e9d039f94 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:45:02.027915 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-d3d3ee02-ddd7-42d6-b1d5-ccd501f9c881 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:45:02.028690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d3d3ee02-ddd7-42d6-b1d5-ccd501f9c881 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:45:02.034096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Router 759cf87a-38b1-4e42-8dc9-a38af59b3a2f is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:45:02.108895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d3d3ee02-ddd7-42d6-b1d5-ccd501f9c881 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.2011521 May 12 15:45:02.116204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44390) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:02.133299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8587afab-132e-487f-917c-3e2687e7e5f3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': '298268da-bc9b-41cf-8e8d-f9d26aa737fe', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:02.177760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 7c400b8e-f20d-492c-8fbd-a62e4dda2608 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:02.347243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7c400b8e-f20d-492c-8fbd-a62e4dda2608 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:02.347612 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:02.385040 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:02.464007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44398) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:02.464762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Port': ['ID=ba84bb8c-76ac-4c5d-9296-856e9d039f94,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:02.485852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1284402186', 'description': 'tempest-secgroup-smoke-1284402186 description', 'project_id': '0528307b42774c45be9eba4ffc91c8dd'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:02.493138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:02.497022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Usage tracker for resource:security_group and tenant:0528307b42774c45be9eba4ffc91c8dd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:02.501120 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:02.507147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:02.526166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No DVR routers for this DVR port ba84bb8c-76ac-4c5d-9296-856e9d039f94 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:45:02.584738 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:02.607401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:45:02.625116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Allocated IP 2001:db8::2 (298268da-bc9b-41cf-8e8d-f9d26aa737fe/1ddc6003-e8a6-490b-b1fa-cc3e1d8653aa/91429dee-a49d-4027-9b60-0403c1a100ce) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:02.631434 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:02.632492 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Sync routers for ids ['759cf87a-38b1-4e42-8dc9-a38af59b3a2f'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:45:02.644389 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-24bfec3b-6ec0-49d6-91ce-aec104458e09 None None] Provisioning complete for port 7c400b8e-f20d-492c-8fbd-a62e4dda2608 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:02.645410 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-24bfec3b-6ec0-49d6-91ce-aec104458e09 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:02.649466 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:02.655070 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-538db9e6-5fcb-47d4-9e3a-b42b8d0e820c admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 5.2755346 May 12 15:45:02.655284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44404) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:02.710904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Routers {'759cf87a-38b1-4e42-8dc9-a38af59b3a2f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:02.710904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b217c42c-5779-467f-81c1-908d48550372 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['759cf87a-38b1-4e42-8dc9-a38af59b3a2f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:02.738413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:02.746983 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Usage tracker for resource:security_group_rule and tenant:0528307b42774c45be9eba4ffc91c8dd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:02.749674 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:02.755525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:02.799982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-06e51a5c-718a-421c-9c17-aceea7e6e6f2 None None] For port ba84bb8c-76ac-4c5d-9296-856e9d039f94, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ba84bb8c-76ac-4c5d-9296-856e9d039f94,segment=NetworkSegment(92cc27a5-54f6-4acf-aea2-6f8363283685),segment_id=92cc27a5-54f6-4acf-aea2-6f8363283685)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:02.800679 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-06e51a5c-718a-421c-9c17-aceea7e6e6f2 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:02.829786 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:02.845010 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:02.862432 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:02.877924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44408) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:02.917807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-54138ff2-16aa-4aa4-bdb6-f190d069a5b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'network': {'name': 'tempest-network-smoke--701030497', 'project_id': 'b641518781114418963451fc3ff58f4d', 'port_security_enabled': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:02.934506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8587afab-132e-487f-917c-3e2687e7e5f3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:02.957616 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-54138ff2-16aa-4aa4-bdb6-f190d069a5b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:02.964649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8587afab-132e-487f-917c-3e2687e7e5f3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:02.975449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8587afab-132e-487f-917c-3e2687e7e5f3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:02.977907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Pushing event updated for resources: {'SecurityGroup': ['ID=be4caf5e-1821-4c5c-b429-5f1324c7c7b2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:02.988920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['68b58bc0-e327-4b58-a823-23ad945651fe']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:02.997691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-54138ff2-16aa-4aa4-bdb6-f190d069a5b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:02.999715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8587afab-132e-487f-917c-3e2687e7e5f3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:03.001904 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.006684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44412) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:03.007271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-067bf563-fbc4-4b79-93ce-9326361e422a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.5349452 May 12 15:45:03.019783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Request body: {'security_group_rule': {'security_group_id': 'be4caf5e-1821-4c5c-b429-5f1324c7c7b2', 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:03.020854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '92cc27a5-54f6-4acf-aea2-6f8363283685') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:03.021316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '92cc27a5-54f6-4acf-aea2-6f8363283685') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:03.027431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-06e51a5c-718a-421c-9c17-aceea7e6e6f2 None None] Calling delete_port for ba84bb8c-76ac-4c5d-9296-856e9d039f94 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:45:03.036063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:03.036297 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.043313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54138ff2-16aa-4aa4-bdb6-f190d069a5b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Made reservation on behalf of b641518781114418963451fc3ff58f4d for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:03.045074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Usage tracker for resource:security_group_rule and tenant:0528307b42774c45be9eba4ffc91c8dd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:03.052788 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54138ff2-16aa-4aa4-bdb6-f190d069a5b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.064092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8587afab-132e-487f-917c-3e2687e7e5f3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:03.067617 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8587afab-132e-487f-917c-3e2687e7e5f3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.112073 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:03.135074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:03.154589 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.174131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-54138ff2-16aa-4aa4-bdb6-f190d069a5b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 552} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:45:03.183572 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54138ff2-16aa-4aa4-bdb6-f190d069a5b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.183926 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-54138ff2-16aa-4aa4-bdb6-f190d069a5b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Added segment 41769506-c6e2-4d6c-a537-2d71e8a5e3f7 of type vlan for network 81ad07c9-5912-449b-bb49-14d754ee47c0 May 12 15:45:03.201958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Set router 759cf87a-38b1-4e42-8dc9-a38af59b3a2f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:03.210992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54138ff2-16aa-4aa4-bdb6-f190d069a5b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.248304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Releasing vlan 584 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:45:03.248625 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: timer() May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:45:03.264371 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:45:03.268042 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54138ff2-16aa-4aa4-bdb6-f190d069a5b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.273357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54138ff2-16aa-4aa4-bdb6-f190d069a5b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:03.273973 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-54138ff2-16aa-4aa4-bdb6-f190d069a5b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.377875 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.491680 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.496898 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.523352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54138ff2-16aa-4aa4-bdb6-f190d069a5b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Network': ['ID=81ad07c9-5912-449b-bb49-14d754ee47c0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:03.536549 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.547457 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.548827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 81ad07c9-5912-449b-bb49-14d754ee47c0 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:45:03.553420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Pushing event deleted for resources: {'Network': ['ID=68b58bc0-e327-4b58-a823-23ad945651fe,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:03.568273 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5b00c2f1-8d66-4319-9615-2050033c26f4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/networks/68b58bc0-e327-4b58-a823-23ad945651fe HTTP/1.1" status: 204 len: 168 time: 2.9885700 May 12 15:45:03.574978 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-54138ff2-16aa-4aa4-bdb6-f190d069a5b5 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.6729245 May 12 15:45:03.578314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44416) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:03.579480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44418) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:03.586849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-854f0b12-5854-4205-b3a4-fc5989ab38a8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'router': {'routes': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:03.622799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e7f8605f-cfad-46f6-9f2e-449ecc782bd9,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:03.643061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:03.653722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:03.654693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:03.655288 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:03.656046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:03.656867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:03.657779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:03.658619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:03.659175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:03.659694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:03.660199 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:03.660718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:03.674276 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.675979 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2879429b-2c0a-4de8-86a0-8e93a0c98e9c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6683133 May 12 15:45:03.679987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44426) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:03.688884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-54876876-e5d9-41e9-bb39-30a3dba99c67 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Request body: {'security_group_rule': {'security_group_id': 'be4caf5e-1821-4c5c-b429-5f1324c7c7b2', 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:03.699760 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:03.723907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-54876876-e5d9-41e9-bb39-30a3dba99c67 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:03.727729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c931029-dbb0-45b1-a582-12d02a211c37 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:03.727983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-54876876-e5d9-41e9-bb39-30a3dba99c67 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Usage tracker for resource:security_group_rule and tenant:0528307b42774c45be9eba4ffc91c8dd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:03.730936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-54876876-e5d9-41e9-bb39-30a3dba99c67 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:03.732125 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5c931029-dbb0-45b1-a582-12d02a211c37 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=b641518781114418963451fc3ff58f4d&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 830 time: 0.1497540 May 12 15:45:03.737419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-54876876-e5d9-41e9-bb39-30a3dba99c67 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:03.746114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44432) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:03.795458 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54876876-e5d9-41e9-bb39-30a3dba99c67 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.013422 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.028404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Transition to ACTIVE for port object 91429dee-a49d-4027-9b60-0403c1a100ce will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:04.039044 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54876876-e5d9-41e9-bb39-30a3dba99c67 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.074067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Transition to ACTIVE for port object 91429dee-a49d-4027-9b60-0403c1a100ce will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:04.097194 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54876876-e5d9-41e9-bb39-30a3dba99c67 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.108552 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-06e51a5c-718a-421c-9c17-aceea7e6e6f2 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:45:04.108902 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-06e51a5c-718a-421c-9c17-aceea7e6e6f2 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:45:04.109499 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.139728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54876876-e5d9-41e9-bb39-30a3dba99c67 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=29ed8161-5f2d-419d-aa45-8efdd48255b1,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:04.161942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Allocated IP 172.20.0.1 (0de89d0f-e308-41b4-8980-4fb156f3c79b/25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e/07a79124-ebb1-420c-a284-314332baa4cd) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:04.171705 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.177913 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54876876-e5d9-41e9-bb39-30a3dba99c67 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.184925 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-54876876-e5d9-41e9-bb39-30a3dba99c67 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5030894 May 12 15:45:04.186753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44438) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:04.207317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-03504186-0df0-49cb-8026-d34f81e4c754 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Request body: {'security_group_rule': {'security_group_id': 'be4caf5e-1821-4c5c-b429-5f1324c7c7b2', 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:04.260666 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-03504186-0df0-49cb-8026-d34f81e4c754 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:04.282320 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.extraroute_db [None req-854f0b12-5854-4205-b3a4-fc5989ab38a8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Added routes are [] {{(pid=88152) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:114}} May 12 15:45:04.282726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.extraroute_db [None req-854f0b12-5854-4205-b3a4-fc5989ab38a8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Removed routes are [] {{(pid=88152) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:122}} May 12 15:45:04.283093 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-854f0b12-5854-4205-b3a4-fc5989ab38a8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.286245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Network 298268da-bc9b-41cf-8e8d-f9d26aa737fe is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:04.301562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:04.318214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:04.460499 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.479508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Transition to ACTIVE for port object 07a79124-ebb1-420c-a284-314332baa4cd will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:04.509934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-03504186-0df0-49cb-8026-d34f81e4c754 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Usage tracker for resource:security_group_rule and tenant:0528307b42774c45be9eba4ffc91c8dd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:04.517374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-03504186-0df0-49cb-8026-d34f81e4c754 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:04.524893 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.545120 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-24bfec3b-6ec0-49d6-91ce-aec104458e09 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.598931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-03504186-0df0-49cb-8026-d34f81e4c754 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:04.612348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 7c400b8e-f20d-492c-8fbd-a62e4dda2608, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7c400b8e-f20d-492c-8fbd-a62e4dda2608,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:04.620870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-06e51a5c-718a-421c-9c17-aceea7e6e6f2 None None] Deleting port ba84bb8c-76ac-4c5d-9296-856e9d039f94 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:45:04.620870 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-06e51a5c-718a-421c-9c17-aceea7e6e6f2 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.626511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Network 0de89d0f-e308-41b4-8980-4fb156f3c79b is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:04.630418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:04.632900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Pushing event updated for resources: {'Port': ['ID=07a79124-ebb1-420c-a284-314332baa4cd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:04.642122 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:04.658098 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-854f0b12-5854-4205-b3a4-fc5989ab38a8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.671559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07965561-1920-458c-a5c2-212b30a75040 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:04.676335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-07965561-1920-458c-a5c2-212b30a75040 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.9291692 May 12 15:45:04.679723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44442) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:04.682237 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-854f0b12-5854-4205-b3a4-fc5989ab38a8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.731081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Pushing event updated for resources: {'Port': ['ID=91429dee-a49d-4027-9b60-0403c1a100ce,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:04.733515 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.735200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03504186-0df0-49cb-8026-d34f81e4c754 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.750142 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-06e51a5c-718a-421c-9c17-aceea7e6e6f2 None None] The port 'ba84bb8c-76ac-4c5d-9296-856e9d039f94' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:45:04.781286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Attempting to bind port 91429dee-a49d-4027-9b60-0403c1a100ce on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:04.782619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Attempting to bind port 91429dee-a49d-4027-9b60-0403c1a100ce by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'c8e3bb58-c87d-48f2-bd31-1c6f6f6becec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '298268da-bc9b-41cf-8e8d-f9d26aa737fe'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:04.783176 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Attempting to bind port 91429dee-a49d-4027-9b60-0403c1a100ce on network 298268da-bc9b-41cf-8e8d-f9d26aa737fe {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:04.872147 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-24bfec3b-6ec0-49d6-91ce-aec104458e09 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:45:04.872679 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-24bfec3b-6ec0-49d6-91ce-aec104458e09 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:45:04.873605 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:45:04.884511 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8ecf36ce-a0a1-4d96-800e-52d35137d83f tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2037213 May 12 15:45:04.905197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44446) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:04.925757 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.927185 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8587afab-132e-487f-917c-3e2687e7e5f3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.932712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 44, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:04.933091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Checking segment: {'id': 'c8e3bb58-c87d-48f2-bd31-1c6f6f6becec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '298268da-bc9b-41cf-8e8d-f9d26aa737fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:04.942895 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.943400 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Bound using segment: {'id': 'c8e3bb58-c87d-48f2-bd31-1c6f6f6becec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '298268da-bc9b-41cf-8e8d-f9d26aa737fe'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:04.943903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Bound port: 91429dee-a49d-4027-9b60-0403c1a100ce, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c8e3bb58-c87d-48f2-bd31-1c6f6f6becec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '298268da-bc9b-41cf-8e8d-f9d26aa737fe'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:04.944291 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:04.963750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:45:04.964117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ed656bd7-ed7b-4ddb-89f6-ce37354b5f13 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:45:04.984070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b217c42c-5779-467f-81c1-908d48550372 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'name': 'tempest-TestServerMultinode-726377410-router', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:44:57Z', 'updated_at': '2022-05-12T15:45:00Z', 'revision_number': 3, 'project_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'gw_port': {'id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:d5:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3579, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:44:58Z', 'updated_at': '2022-05-12T15:44:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:05.060924 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Checking router: 759cf87a-38b1-4e42-8dc9-a38af59b3a2f for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:45:05.061607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Updating router 759cf87a-38b1-4e42-8dc9-a38af59b3a2f port ca01fcce-f259-4769-9012-23d4f8b5e9ef binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:45:05.062274 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03504186-0df0-49cb-8026-d34f81e4c754 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:05.071657 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03504186-0df0-49cb-8026-d34f81e4c754 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:05.111062 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=7c400b8e-f20d-492c-8fbd-a62e4dda2608,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:05.150068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ba84bb8c-76ac-4c5d-9296-856e9d039f94 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:45:05.153050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-854f0b12-5854-4205-b3a4-fc5989ab38a8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 766c87d1-88c8-4b7e-ba13-f65737b66f8b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:45:05.157989 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c247257e-1085-49c3-96b3-c6488ff34821 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=b641518781114418963451fc3ff58f4d&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2418542 May 12 15:45:05.163072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44452) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:05.168135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8587afab-132e-487f-917c-3e2687e7e5f3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 298268da-bc9b-41cf-8e8d-f9d26aa737fe is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:05.173777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03504186-0df0-49cb-8026-d34f81e4c754 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9cbcdcb4-b051-4ff5-a5f0-51dc570ff215,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:05.197655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8587afab-132e-487f-917c-3e2687e7e5f3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:05.200470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8587afab-132e-487f-917c-3e2687e7e5f3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:05.201047 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8587afab-132e-487f-917c-3e2687e7e5f3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:05.233053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: ba84bb8c-76ac-4c5d-9296-856e9d039f94 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:45:05.233698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ba84bb8c-76ac-4c5d-9296-856e9d039f94 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:45:05.253576 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03504186-0df0-49cb-8026-d34f81e4c754 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:05.257599 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-03504186-0df0-49cb-8026-d34f81e4c754 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.0698864 May 12 15:45:05.258187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44456) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:05.268926 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:05.279399 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-fdabeece-751c-44b0-813c-4961c88bab9e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Request body: {'security_group_rule': {'security_group_id': 'be4caf5e-1821-4c5c-b429-5f1324c7c7b2', 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:05.289744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fdabeece-751c-44b0-813c-4961c88bab9e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:05.296619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fdabeece-751c-44b0-813c-4961c88bab9e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Usage tracker for resource:security_group_rule and tenant:0528307b42774c45be9eba4ffc91c8dd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:05.301857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fdabeece-751c-44b0-813c-4961c88bab9e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:05.308599 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:05.310414 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] For port 91429dee-a49d-4027-9b60-0403c1a100ce, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:05.330518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] For port 91429dee-a49d-4027-9b60-0403c1a100ce, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=91429dee-a49d-4027-9b60-0403c1a100ce,segment=NetworkSegment(c8e3bb58-c87d-48f2-bd31-1c6f6f6becec),segment_id=c8e3bb58-c87d-48f2-bd31-1c6f6f6becec)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:05.331718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fdabeece-751c-44b0-813c-4961c88bab9e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:05.352306 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8587afab-132e-487f-917c-3e2687e7e5f3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 3.2349215 May 12 15:45:05.361571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44460) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:05.427775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8587afab-132e-487f-917c-3e2687e7e5f3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Subnet': ['ID=11a47c48-9002-4cc8-aa83-79d9ef8e1be3,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:05.445590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'network_id': '298268da-bc9b-41cf-8e8d-f9d26aa737fe', 'fixed_ips': [{'subnet_id': '1ddc6003-e8a6-490b-b1fa-cc3e1d8653aa'}, {'subnet_id': '11a47c48-9002-4cc8-aa83-79d9ef8e1be3'}], 'name': 'tempest-PortsIpV6TestJSON-140742125'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:05.453899 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:05.522510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-854f0b12-5854-4205-b3a4-fc5989ab38a8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:45:05.530030 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-854f0b12-5854-4205-b3a4-fc5989ab38a8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:05.531167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-854f0b12-5854-4205-b3a4-fc5989ab38a8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b HTTP/1.1" status: 200 len: 701 time: 1.9505713 May 12 15:45:05.534264 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e51c8011-82fa-4d44-a102-22d2bd73d02f None None] Sync routers for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:45:05.540072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44464) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:05.546436 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e51c8011-82fa-4d44-a102-22d2bd73d02f None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:05.547085 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e51c8011-82fa-4d44-a102-22d2bd73d02f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:05.616296 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e63d5804-299c-4581-ab6d-8041bf8514a8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Synchronizing usage tracker for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:05.675668 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:05.696239 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:05.784790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-547bf9c5-ed03-49a6-acd1-e86fc42d2742 None None] Provisioning for port 07a79124-ebb1-420c-a284-314332baa4cd completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:05.798340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58f03131-e489-43a2-aaab-b77aa92d2e28 None None] Pushing event updated for resources: {'Port': ['ID=91429dee-a49d-4027-9b60-0403c1a100ce,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:05.814262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-547bf9c5-ed03-49a6-acd1-e86fc42d2742 None None] Provisioning complete for port 07a79124-ebb1-420c-a284-314332baa4cd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:05.814639 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-547bf9c5-ed03-49a6-acd1-e86fc42d2742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:05.821483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a8feaa5-f545-491e-b3ea-4801ab13f85a tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:05.825667 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2a8feaa5-f545-491e-b3ea-4801ab13f85a tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.6601737 May 12 15:45:05.826493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e63d5804-299c-4581-ab6d-8041bf8514a8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Unset dirty status for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:05.830139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e63d5804-299c-4581-ab6d-8041bf8514a8 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports?device_id=766c87d1-88c8-4b7e-ba13-f65737b66f8b HTTP/1.1" status: 200 len: 205 time: 0.2865722 May 12 15:45:05.831240 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fdabeece-751c-44b0-813c-4961c88bab9e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:05.834828 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44468) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:05.834828 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44470) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:05.851403 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-e51c8011-82fa-4d44-a102-22d2bd73d02f None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:05.907204 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:05.911146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Pushing event updated for resources: {'Port': ['ID=07a79124-ebb1-420c-a284-314332baa4cd,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:06.008884 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-547bf9c5-ed03-49a6-acd1-e86fc42d2742 None None] Port 07a79124-ebb1-420c-a284-314332baa4cd cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:06.046168 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e51c8011-82fa-4d44-a102-22d2bd73d02f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:57Z', 'revision_number': 11, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:06.052073 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e51c8011-82fa-4d44-a102-22d2bd73d02f None None] Checking router: 766c87d1-88c8-4b7e-ba13-f65737b66f8b for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:45:06.070595 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2889ddc7-62c7-43c2-be81-5e7f781b4188 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2332134 May 12 15:45:06.072044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44476) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:06.077615 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e51c8011-82fa-4d44-a102-22d2bd73d02f None None] Routers {'766c87d1-88c8-4b7e-ba13-f65737b66f8b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:06.079884 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e51c8011-82fa-4d44-a102-22d2bd73d02f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:06.094610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1739911231', 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0', 'project_id': 'b641518781114418963451fc3ff58f4d', 'ip_version': 4, 'cidr': '172.20.0.16/28'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:06.155248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:06.164631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:port and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:06.168162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:06.177046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:06.191971 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23d1212f-18d9-41b3-83d0-dd60099485a3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:06.214035 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:06.246984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Transition to ACTIVE for port object ca01fcce-f259-4769-9012-23d4f8b5e9ef will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:06.267574 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:06.288042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fdabeece-751c-44b0-813c-4961c88bab9e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:06.322110 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fdabeece-751c-44b0-813c-4961c88bab9e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:06.424279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdabeece-751c-44b0-813c-4961c88bab9e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b46e5997-eabd-443e-98b5-01fe629c8b03,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:06.427430 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-e51c8011-82fa-4d44-a102-22d2bd73d02f None None] Set router 766c87d1-88c8-4b7e-ba13-f65737b66f8b gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:06.505814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Attempting to bind port ca01fcce-f259-4769-9012-23d4f8b5e9ef on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:06.506141 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Attempting to bind port ca01fcce-f259-4769-9012-23d4f8b5e9ef by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:06.506442 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Attempting to bind port ca01fcce-f259-4769-9012-23d4f8b5e9ef on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:06.508733 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0680421b-a61f-46b3-8c31-58bcb93d07c0 None None] Pushing event updated for resources: {'Port': ['ID=ca01fcce-f259-4769-9012-23d4f8b5e9ef,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:06.515734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 44, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:06.516456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:06.516806 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:06.517162 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:06.517650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Bound port: ca01fcce-f259-4769-9012-23d4f8b5e9ef, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:06.518022 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:06.602638 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e51c8011-82fa-4d44-a102-22d2bd73d02f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:57Z', 'revision_number': 11, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:06.607869 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e51c8011-82fa-4d44-a102-22d2bd73d02f None None] The sync data for ids ['766c87d1-88c8-4b7e-ba13-f65737b66f8b'] in n-d-841483-1 is: [{'id': '766c87d1-88c8-4b7e-ba13-f65737b66f8b', 'name': 'tempest-RoutersTest-router-2126470660', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:03Z', 'updated_at': '2022-05-12T15:44:57Z', 'revision_number': 11, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:45:06.612279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fdabeece-751c-44b0-813c-4961c88bab9e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:06.616019 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fdabeece-751c-44b0-813c-4961c88bab9e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 1.3447142 May 12 15:45:06.616886 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f54d959-9dae-48b0-a87d-9a50371853b8 req-f5be5e20-8af5-4963-9d90-a12bf9175eac service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.3018270 May 12 15:45:06.616886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44488) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:06.623414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:06.628789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:subnet and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:06.636524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:06.652656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:06.666557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b217c42c-5779-467f-81c1-908d48550372 None None] For port ca01fcce-f259-4769-9012-23d4f8b5e9ef, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:06.676465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b217c42c-5779-467f-81c1-908d48550372 None None] For port ca01fcce-f259-4769-9012-23d4f8b5e9ef, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ca01fcce-f259-4769-9012-23d4f8b5e9ef,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:06.691883 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:06.707992 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7679eb38-5e92-47d6-b9b0-55e2c3d01c43 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Request body: {'security_group_rule': {'security_group_id': 'be4caf5e-1821-4c5c-b429-5f1324c7c7b2', 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:06.731236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Made reservation on behalf of b641518781114418963451fc3ff58f4d for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:06.737242 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:06.765569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Network 0de89d0f-e308-41b4-8980-4fb156f3c79b is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:06.767772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7679eb38-5e92-47d6-b9b0-55e2c3d01c43 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:06.801015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44492) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:06.801615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:06.805904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:06.824048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7679eb38-5e92-47d6-b9b0-55e2c3d01c43 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Usage tracker for resource:security_group_rule and tenant:0528307b42774c45be9eba4ffc91c8dd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:06.840325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7679eb38-5e92-47d6-b9b0-55e2c3d01c43 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:06.852589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Routers {'759cf87a-38b1-4e42-8dc9-a38af59b3a2f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:06.854531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b217c42c-5779-467f-81c1-908d48550372 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['759cf87a-38b1-4e42-8dc9-a38af59b3a2f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:06.919745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7679eb38-5e92-47d6-b9b0-55e2c3d01c43 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:06.923703 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f54d959-9dae-48b0-a87d-9a50371853b8 req-374bda52-af9e-4e2b-a3da-50a888ab772b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.1607168 May 12 15:45:07.033274 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23d1212f-18d9-41b3-83d0-dd60099485a3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:07.044342 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23d1212f-18d9-41b3-83d0-dd60099485a3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:07.068986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0680421b-a61f-46b3-8c31-58bcb93d07c0 None None] Pushing event updated for resources: {'Port': ['ID=ca01fcce-f259-4769-9012-23d4f8b5e9ef,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:07.091665 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0680421b-a61f-46b3-8c31-58bcb93d07c0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:07.092006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0680421b-a61f-46b3-8c31-58bcb93d07c0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:07.092515 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0680421b-a61f-46b3-8c31-58bcb93d07c0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:07.092661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0680421b-a61f-46b3-8c31-58bcb93d07c0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:07.092982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0680421b-a61f-46b3-8c31-58bcb93d07c0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:07.095788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0680421b-a61f-46b3-8c31-58bcb93d07c0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:07.096211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0680421b-a61f-46b3-8c31-58bcb93d07c0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:07.096543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0680421b-a61f-46b3-8c31-58bcb93d07c0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:07.096865 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0680421b-a61f-46b3-8c31-58bcb93d07c0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:07.097187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0680421b-a61f-46b3-8c31-58bcb93d07c0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:07.097535 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0680421b-a61f-46b3-8c31-58bcb93d07c0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:07.097857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0680421b-a61f-46b3-8c31-58bcb93d07c0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:07.204962 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23d1212f-18d9-41b3-83d0-dd60099485a3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:07.205873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-23d1212f-18d9-41b3-83d0-dd60099485a3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Fanout notify agent at l3_agent the message router_deleted on router 766c87d1-88c8-4b7e-ba13-f65737b66f8b {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:45:07.231432 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:07.262264 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23d1212f-18d9-41b3-83d0-dd60099485a3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:07.263834 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-23d1212f-18d9-41b3-83d0-dd60099485a3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b HTTP/1.1" status: 204 len: 168 time: 1.4266579 May 12 15:45:07.268364 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44498) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:07.274567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-aaff0ebb-f432-4e67-a4f1-9d25c7d3f65a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-712202871', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:07.283974 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aaff0ebb-f432-4e67-a4f1-9d25c7d3f65a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:07.289270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-aaff0ebb-f432-4e67-a4f1-9d25c7d3f65a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Usage tracker for resource:router and tenant:755d04c3babe4d56b0092365d0203422 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:07.292814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-aaff0ebb-f432-4e67-a4f1-9d25c7d3f65a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:07.299679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aaff0ebb-f432-4e67-a4f1-9d25c7d3f65a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:07.345505 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aaff0ebb-f432-4e67-a4f1-9d25c7d3f65a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:07.346681 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aaff0ebb-f432-4e67-a4f1-9d25c7d3f65a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:07.358891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port 4fc09877-1358-4598-afb6-583f6f6355c0 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:45:07.363244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Router 759cf87a-38b1-4e42-8dc9-a38af59b3a2f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:45:07.376637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7c400b8e-f20d-492c-8fbd-a62e4dda2608 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:07.404719 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15c1c8b5-1993-4494-85ba-43c54e3845da admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:07.409642 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-7679eb38-5e92-47d6-b9b0-55e2c3d01c43 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Project 0528307b42774c45be9eba4ffc91c8dd added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:45:07.416659 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f54d959-9dae-48b0-a87d-9a50371853b8 req-13ef032e-a356-4d49-a575-3e4dfaa5d442 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0645916 May 12 15:45:07.452061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-15c1c8b5-1993-4494-85ba-43c54e3845da admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:07.473643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-15c1c8b5-1993-4494-85ba-43c54e3845da admin admin] Usage tracker for resource:security_group_rule and tenant:d4db48b28686450ab63063679d4982c5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:07.482351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-15c1c8b5-1993-4494-85ba-43c54e3845da admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:07.489814 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aaff0ebb-f432-4e67-a4f1-9d25c7d3f65a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:07.510123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-15c1c8b5-1993-4494-85ba-43c54e3845da admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:07.511556 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7679eb38-5e92-47d6-b9b0-55e2c3d01c43 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:07.526114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3ed8a487-d23f-475b-8af2-d5302a25edc3 None None] Provisioning complete for port 07a79124-ebb1-420c-a284-314332baa4cd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:07.526567 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3ed8a487-d23f-475b-8af2-d5302a25edc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:07.678066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aaff0ebb-f432-4e67-a4f1-9d25c7d3f65a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:07.678257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a457e02-bc0a-4a2e-8723-de06dd46880f None None] Network 298268da-bc9b-41cf-8e8d-f9d26aa737fe requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:07.707392 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b217c42c-5779-467f-81c1-908d48550372 None None] Set router 759cf87a-38b1-4e42-8dc9-a38af59b3a2f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:07.764588 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:07.819520 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aaff0ebb-f432-4e67-a4f1-9d25c7d3f65a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:07.820807 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-aaff0ebb-f432-4e67-a4f1-9d25c7d3f65a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.5512578 May 12 15:45:07.827520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44502) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:07.836370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-09a5856d-f5ee-4ab9-a28d-c6452733be43 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Request body: {'router': {'admin_state_up': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:07.862642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3ed8a487-d23f-475b-8af2-d5302a25edc3 None None] Port 07a79124-ebb1-420c-a284-314332baa4cd cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:07.946863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7c400b8e-f20d-492c-8fbd-a62e4dda2608 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:07.947231 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.148124 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ad66b895-e754-4981-9b27-e6426e45c2bc None None] Provisioning for port 91429dee-a49d-4027-9b60-0403c1a100ce completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:08.205173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Subnet': ['ID=854614c5-2c9e-43c0-8389-330eb4e14250,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:08.262974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7679eb38-5e92-47d6-b9b0-55e2c3d01c43 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.265499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f54d959-9dae-48b0-a87d-9a50371853b8 req-cbe6b4d2-ef79-4f06-bae5-92d9375bc355 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:08.269611 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f54d959-9dae-48b0-a87d-9a50371853b8 req-cbe6b4d2-ef79-4f06-bae5-92d9375bc355 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.8444831 May 12 15:45:08.299743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Checking segment: {'id': '41769506-c6e2-4d6c-a537-2d71e8a5e3f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:08.301070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network hostable DHCP agents. Network: 81ad07c9-5912-449b-bb49-14d754ee47c0, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:45:08.306850 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7679eb38-5e92-47d6-b9b0-55e2c3d01c43 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.309614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:45:08.341255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15c1c8b5-1993-4494-85ba-43c54e3845da admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.349009 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7679eb38-5e92-47d6-b9b0-55e2c3d01c43 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d5d30760-d1f5-4642-b500-6b7d02d119a7,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:08.351386 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 91429dee-a49d-4027-9b60-0403c1a100ce up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:08.364048 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15c1c8b5-1993-4494-85ba-43c54e3845da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.368565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 81ad07c9-5912-449b-bb49-14d754ee47c0 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:45:08.382710 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3d639657-6455-4a6d-ba45-8b538d31a1d0 admin admin] 10.222.0.82 "PUT /v2.0/routers/759cf87a-38b1-4e42-8dc9-a38af59b3a2f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7168856 May 12 15:45:08.382710 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7679eb38-5e92-47d6-b9b0-55e2c3d01c43 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.382710 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7679eb38-5e92-47d6-b9b0-55e2c3d01c43 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 1.7083902 May 12 15:45:08.382710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44506) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:08.386643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e88b2b28-6cf4-44bc-9f6b-53eb8c8f2167 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Request body: {'security_group_rule': {'security_group_id': 'be4caf5e-1821-4c5c-b429-5f1324c7c7b2', 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:08.396375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e88b2b28-6cf4-44bc-9f6b-53eb8c8f2167 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:08.400704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e88b2b28-6cf4-44bc-9f6b-53eb8c8f2167 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Usage tracker for resource:security_group_rule and tenant:0528307b42774c45be9eba4ffc91c8dd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:08.404204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e88b2b28-6cf4-44bc-9f6b-53eb8c8f2167 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:08.411206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e88b2b28-6cf4-44bc-9f6b-53eb8c8f2167 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:08.425843 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-e88b2b28-6cf4-44bc-9f6b-53eb8c8f2167 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Project 0528307b42774c45be9eba4ffc91c8dd added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:45:08.434194 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e88b2b28-6cf4-44bc-9f6b-53eb8c8f2167 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.444598 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 81ad07c9-5912-449b-bb49-14d754ee47c0) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:08.452934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:08.454438 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.461729 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08adc8f4-119b-4bc0-9dd8-f23f2509cb8c None None] Network 81ad07c9-5912-449b-bb49-14d754ee47c0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:08.480167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b217c42c-5779-467f-81c1-908d48550372 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'name': 'tempest-TestServerMultinode-726377410-router', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:44:57Z', 'updated_at': '2022-05-12T15:45:05Z', 'revision_number': 4, 'project_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'gw_port': {'id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:d5:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3579, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:44:58Z', 'updated_at': '2022-05-12T15:45:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '07a79124-ebb1-420c-a284-314332baa4cd', 'name': '', 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'mac_address': 'fa:16:3e:05:1b:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 3588, 'fixed_ips': [{'subnet_id': '25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:03Z', 'updated_at': '2022-05-12T15:45:05Z', 'revision_number': 2, 'project_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'subnets': [{'id': '25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:08.486500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 91429dee-a49d-4027-9b60-0403c1a100ce completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:08.511225 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-da78c21c-4f96-48b5-9566-e4a3f74731e1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 2.4340315 May 12 15:45:08.536938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e88b2b28-6cf4-44bc-9f6b-53eb8c8f2167 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.542084 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e88b2b28-6cf4-44bc-9f6b-53eb8c8f2167 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.573523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e88b2b28-6cf4-44bc-9f6b-53eb8c8f2167 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=496b838c-d79d-4ffd-a014-72101c21d265,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:08.586129 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e88b2b28-6cf4-44bc-9f6b-53eb8c8f2167 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.587765 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e88b2b28-6cf4-44bc-9f6b-53eb8c8f2167 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2061472 May 12 15:45:08.593752 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b217c42c-5779-467f-81c1-908d48550372 None None] The sync data for ids ['759cf87a-38b1-4e42-8dc9-a38af59b3a2f'] in n-d-841483-1 is: [{'id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'name': 'tempest-TestServerMultinode-726377410-router', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:44:57Z', 'updated_at': '2022-05-12T15:45:05Z', 'revision_number': 4, 'project_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'gw_port': {'id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:d5:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3579, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:44:58Z', 'updated_at': '2022-05-12T15:45:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '07a79124-ebb1-420c-a284-314332baa4cd', 'name': '', 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'mac_address': 'fa:16:3e:05:1b:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 3588, 'fixed_ips': [{'subnet_id': '25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:03Z', 'updated_at': '2022-05-12T15:45:05Z', 'revision_number': 2, 'project_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'subnets': [{'id': '25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:45:08.608717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 91429dee-a49d-4027-9b60-0403c1a100ce triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:08.609154 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.648858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44516) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:08.657950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-971d9da2-b25f-453b-91d6-2c29584c95c4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1249125445', 'description': 'tempest-secgroup-smoke-1249125445 description', 'project_id': 'b641518781114418963451fc3ff58f4d'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:08.663462 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09a5856d-f5ee-4ab9-a28d-c6452733be43 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.669535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-971d9da2-b25f-453b-91d6-2c29584c95c4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:08.684654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-971d9da2-b25f-453b-91d6-2c29584c95c4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:08.701230 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-971d9da2-b25f-453b-91d6-2c29584c95c4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.733302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Allocated IP 2001:db8::364 (298268da-bc9b-41cf-8e8d-f9d26aa737fe/1ddc6003-e8a6-490b-b1fa-cc3e1d8653aa/4fc09877-1358-4598-afb6-583f6f6355c0) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:08.744349 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15c1c8b5-1993-4494-85ba-43c54e3845da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e017f503-1bc4-4efb-8974-9d541b6a79d4,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:08.753639 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09a5856d-f5ee-4ab9-a28d-c6452733be43 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3769140', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3769103', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3784374'] for router, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:08.767005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-971d9da2-b25f-453b-91d6-2c29584c95c4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:08.771570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62b2dd00-2e29-477e-acce-31acbc3666e3 None None] Update dhcp port {'port': {'network_id': '298268da-bc9b-41cf-8e8d-f9d26aa737fe', 'fixed_ips': [{'subnet_id': '1ddc6003-e8a6-490b-b1fa-cc3e1d8653aa', 'ip_address': '2001:db8::2'}, {'subnet_id': '11a47c48-9002-4cc8-aa83-79d9ef8e1be3'}], 'binding:host_id': 'n-d-841483-1'}, 'id': '91429dee-a49d-4027-9b60-0403c1a100ce'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:45:08.778466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-971d9da2-b25f-453b-91d6-2c29584c95c4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:08.783767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-971d9da2-b25f-453b-91d6-2c29584c95c4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:12. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:08.796851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-971d9da2-b25f-453b-91d6-2c29584c95c4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 12; quota limit: 100; headroom:88 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:08.850832 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-15c1c8b5-1993-4494-85ba-43c54e3845da admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d4db48b28686450ab63063679d4982c5&name=default HTTP/1.1" status: 200 len: 2983 time: 2.0139849 May 12 15:45:08.852828 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Allocated IP 2001:db8:0:1::1da (298268da-bc9b-41cf-8e8d-f9d26aa737fe/11a47c48-9002-4cc8-aa83-79d9ef8e1be3/4fc09877-1358-4598-afb6-583f6f6355c0) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:08.856263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44526) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:09.002695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-971d9da2-b25f-453b-91d6-2c29584c95c4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.020173 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-971d9da2-b25f-453b-91d6-2c29584c95c4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.053730 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.080969 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d36b67fc-7600-4ce1-9dda-ae019083bc05 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.144915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d36b67fc-7600-4ce1-9dda-ae019083bc05 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.159023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-971d9da2-b25f-453b-91d6-2c29584c95c4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e4f60c54-e7d8-4d35-b4f9-38e9a427040b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:09.169171 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-971d9da2-b25f-453b-91d6-2c29584c95c4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.170595 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-971d9da2-b25f-453b-91d6-2c29584c95c4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.5205083 May 12 15:45:09.180006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44536) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:09.183784 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-62b2dd00-2e29-477e-acce-31acbc3666e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.191036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2c8fe08c-36c3-4029-bd93-466b4c980c0b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': 'e4f60c54-e7d8-4d35-b4f9-38e9a427040b', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:09.211024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2c8fe08c-36c3-4029-bd93-466b4c980c0b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:09.217568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2c8fe08c-36c3-4029-bd93-466b4c980c0b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:09.222209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2c8fe08c-36c3-4029-bd93-466b4c980c0b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:14. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:09.228601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2c8fe08c-36c3-4029-bd93-466b4c980c0b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 14; quota limit: 100; headroom:86 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:09.267576 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c8fe08c-36c3-4029-bd93-466b4c980c0b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.301137 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d36b67fc-7600-4ce1-9dda-ae019083bc05 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.307888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-81ad07c9-5912-449b-bb49-14d754ee47c0', 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ips': [{'subnet_id': '854614c5-2c9e-43c0-8389-330eb4e14250'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:45:09.309055 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.328054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 91429dee-a49d-4027-9b60-0403c1a100ce, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=91429dee-a49d-4027-9b60-0403c1a100ce,segment=NetworkSegment(c8e3bb58-c87d-48f2-bd31-1c6f6f6becec),segment_id=c8e3bb58-c87d-48f2-bd31-1c6f6f6becec)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:09.348307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-1998be42-9b25-47b9-b6dd-ffede832434b tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Synchronizing usage tracker for tenant:0528307b42774c45be9eba4ffc91c8dd on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:09.360587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d36b67fc-7600-4ce1-9dda-ae019083bc05 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e017f503-1bc4-4efb-8974-9d541b6a79d4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:09.360868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-09a5856d-f5ee-4ab9-a28d-c6452733be43 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Router 724ffccb-439d-4dcf-8067-dd93db2f1f73 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:45:09.444290 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c8fe08c-36c3-4029-bd93-466b4c980c0b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.446126 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d36b67fc-7600-4ce1-9dda-ae019083bc05 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.447416 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d36b67fc-7600-4ce1-9dda-ae019083bc05 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e017f503-1bc4-4efb-8974-9d541b6a79d4 HTTP/1.1" status: 204 len: 168 time: 0.5901377 May 12 15:45:09.452980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c8fe08c-36c3-4029-bd93-466b4c980c0b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.492305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c8fe08c-36c3-4029-bd93-466b4c980c0b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ae68a443-8ad4-4db9-80ac-191548306290,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:09.502958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44546) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:09.509903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Request body: {'network': {'name': 'tempest-TestServerMultinode-1726459329-network', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:09.518054 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c8fe08c-36c3-4029-bd93-466b4c980c0b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.523408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-1998be42-9b25-47b9-b6dd-ffede832434b tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Unset dirty status for tenant:0528307b42774c45be9eba4ffc91c8dd on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:09.524687 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-1998be42-9b25-47b9-b6dd-ffede832434b tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1284402186&fields=id&tenant_id=0528307b42774c45be9eba4ffc91c8dd HTTP/1.1" status: 200 len: 267 time: 0.4830844 May 12 15:45:09.524971 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2c8fe08c-36c3-4029-bd93-466b4c980c0b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3438940 May 12 15:45:09.525821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44550) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:09.527053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:09.534066 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.543118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-dce2ea85-f0a3-47fa-997d-0af210a95b41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': 'e4f60c54-e7d8-4d35-b4f9-38e9a427040b', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:09.555519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dce2ea85-f0a3-47fa-997d-0af210a95b41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:09.560418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dce2ea85-f0a3-47fa-997d-0af210a95b41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:09.569515 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dce2ea85-f0a3-47fa-997d-0af210a95b41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:15. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:09.577416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dce2ea85-f0a3-47fa-997d-0af210a95b41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 15; quota limit: 100; headroom:85 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:09.599024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Usage tracker for resource:network and tenant:5b43e848e2af491a8dc509c668c33e91 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:09.604662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:09.627658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:09.638673 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dce2ea85-f0a3-47fa-997d-0af210a95b41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.710808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Made reservation on behalf of 5b43e848e2af491a8dc509c668c33e91 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:09.713638 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.739592 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.776335 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dce2ea85-f0a3-47fa-997d-0af210a95b41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.782888 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:09.787389 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Usage tracker for resource:security_group_rule and tenant:5b43e848e2af491a8dc509c668c33e91 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:09.790580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:09.793307 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dce2ea85-f0a3-47fa-997d-0af210a95b41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.847132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-09a5856d-f5ee-4ab9-a28d-c6452733be43 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:45:09.848400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:09.851652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dce2ea85-f0a3-47fa-997d-0af210a95b41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=729b2b90-df13-4417-ad00-268ded97372e,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:09.861493 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dce2ea85-f0a3-47fa-997d-0af210a95b41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.865798 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dce2ea85-f0a3-47fa-997d-0af210a95b41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3303602 May 12 15:45:09.867412 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.869352 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83987ca3-ff39-4674-b0bf-35b19e89ff3f None None] Sync routers for ids ['724ffccb-439d-4dcf-8067-dd93db2f1f73'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:45:09.871993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44556) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:09.879275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4fb694cd-474d-4864-81f5-5e0baad0019e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': 'e4f60c54-e7d8-4d35-b4f9-38e9a427040b', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:09.884501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=91429dee-a49d-4027-9b60-0403c1a100ce,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:09.888087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4fb694cd-474d-4864-81f5-5e0baad0019e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:09.892920 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4fb694cd-474d-4864-81f5-5e0baad0019e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:09.897551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4fb694cd-474d-4864-81f5-5e0baad0019e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:16. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:09.897780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83987ca3-ff39-4674-b0bf-35b19e89ff3f None None] Routers {'724ffccb-439d-4dcf-8067-dd93db2f1f73'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:09.898668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-83987ca3-ff39-4674-b0bf-35b19e89ff3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['724ffccb-439d-4dcf-8067-dd93db2f1f73'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:09.900217 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09a5856d-f5ee-4ab9-a28d-c6452733be43 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:09.902916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4fb694cd-474d-4864-81f5-5e0baad0019e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 16; quota limit: 100; headroom:84 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:09.912258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44560) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:09.913932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-09a5856d-f5ee-4ab9-a28d-c6452733be43 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "PUT /v2.0/routers/724ffccb-439d-4dcf-8067-dd93db2f1f73 HTTP/1.1" status: 200 len: 693 time: 2.0853002 May 12 15:45:09.946407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Transition to ACTIVE for port object 4fc09877-1358-4598-afb6-583f6f6355c0 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:09.982572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-d1d20db9-f4f6-407d-9aa6-f91bbeddc29e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:09.983309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-d1d20db9-f4f6-407d-9aa6-f91bbeddc29e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Synchronizing usage tracker for tenant:0528307b42774c45be9eba4ffc91c8dd on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:10.010580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-d1d20db9-f4f6-407d-9aa6-f91bbeddc29e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Unset dirty status for tenant:0528307b42774c45be9eba4ffc91c8dd on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:10.017482 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-d1d20db9-f4f6-407d-9aa6-f91bbeddc29e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/networks?id=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade HTTP/1.1" status: 200 len: 813 time: 0.4757061 May 12 15:45:10.026218 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:10.031278 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fb694cd-474d-4864-81f5-5e0baad0019e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:10.051478 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Allocated IP 172.20.0.18 (81ad07c9-5912-449b-bb49-14d754ee47c0/854614c5-2c9e-43c0-8389-330eb4e14250/9ebb09dd-551b-4b3d-b1f6-5bdd77960bed) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:10.085293 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-62b1cd28-7421-4720-9417-1174c29e513e tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/quotas/0528307b42774c45be9eba4ffc91c8dd HTTP/1.1" status: 200 len: 375 time: 0.0668693 May 12 15:45:10.158304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 298268da-bc9b-41cf-8e8d-f9d26aa737fe is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:10.167554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:10.181837 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ee27abf8-cbf9-4ec2-99a6-97f5c8654878 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/routers/724ffccb-439d-4dcf-8067-dd93db2f1f73 HTTP/1.1" status: 200 len: 699 time: 0.2661574 May 12 15:45:10.196844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:10.203729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:10.205344 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:10.205655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44572) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:10.233103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=4fc09877-1358-4598-afb6-583f6f6355c0,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:10.246240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:10.246602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:10.247025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:10.247365 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:10.247701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:10.248123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:10.250655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fb694cd-474d-4864-81f5-5e0baad0019e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:10.251889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:10.252233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:10.255170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:10.255527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:10.256300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:10.256641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:10.270773 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-83987ca3-ff39-4674-b0bf-35b19e89ff3f None None] Set router 724ffccb-439d-4dcf-8067-dd93db2f1f73 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:10.284962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-27cd9c82-a83a-42a7-b1f7-385f42a1dffd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1016 time: 4.9087768 May 12 15:45:10.285863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44576) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:10.298711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d6e93d26-97d1-4d88-a7a0-efa5928739c9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '1ddc6003-e8a6-490b-b1fa-cc3e1d8653aa'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:10.298939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fb694cd-474d-4864-81f5-5e0baad0019e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:10.359469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ea08111d-2afd-4021-ab26-71a857fcf7f7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Synchronizing usage tracker for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:10.427149 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-52befbfc-1f12-4223-a54d-e807119a993d tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=0528307b42774c45be9eba4ffc91c8dd&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3236351 May 12 15:45:10.444745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fb694cd-474d-4864-81f5-5e0baad0019e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=caa58b35-7f48-488e-8953-721e386133fe,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:10.451837 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fb694cd-474d-4864-81f5-5e0baad0019e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:10.455487 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4fb694cd-474d-4864-81f5-5e0baad0019e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5789473 May 12 15:45:10.459984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44582) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:10.469339 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ea08111d-2afd-4021-ab26-71a857fcf7f7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Unset dirty status for tenant:755d04c3babe4d56b0092365d0203422 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:10.473876 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ea08111d-2afd-4021-ab26-71a857fcf7f7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports?device_id=724ffccb-439d-4dcf-8067-dd93db2f1f73 HTTP/1.1" status: 200 len: 205 time: 0.2649412 May 12 15:45:10.480252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-17eb016e-91cc-427f-ad0a-4aaa1d560edc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': 'e4f60c54-e7d8-4d35-b4f9-38e9a427040b', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:10.485415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-83987ca3-ff39-4674-b0bf-35b19e89ff3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '724ffccb-439d-4dcf-8067-dd93db2f1f73', 'name': 'tempest-RoutersTest-router-712202871', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:07Z', 'updated_at': '2022-05-12T15:45:08Z', 'revision_number': 2, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:10.491803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44586) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:10.498940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:10.502823 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83987ca3-ff39-4674-b0bf-35b19e89ff3f None None] Checking router: 724ffccb-439d-4dcf-8067-dd93db2f1f73 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:45:10.603049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6e93d26-97d1-4d88-a7a0-efa5928739c9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:10.608522 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83987ca3-ff39-4674-b0bf-35b19e89ff3f None None] Routers {'724ffccb-439d-4dcf-8067-dd93db2f1f73'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:10.609789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-83987ca3-ff39-4674-b0bf-35b19e89ff3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['724ffccb-439d-4dcf-8067-dd93db2f1f73'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:10.683298 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d29f8b52-da28-42b0-8bcc-ec7f3e471615 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:10.770746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-17eb016e-91cc-427f-ad0a-4aaa1d560edc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:10.780425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-83987ca3-ff39-4674-b0bf-35b19e89ff3f None None] Set router 724ffccb-439d-4dcf-8067-dd93db2f1f73 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:10.802659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:10.905900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-17eb016e-91cc-427f-ad0a-4aaa1d560edc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:10.937857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-17eb016e-91cc-427f-ad0a-4aaa1d560edc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:17. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:10.948462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-17eb016e-91cc-427f-ad0a-4aaa1d560edc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 17; quota limit: 100; headroom:83 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:10.992369 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17eb016e-91cc-427f-ad0a-4aaa1d560edc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:11.066808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-62b2dd00-2e29-477e-acce-31acbc3666e3 None None] Allocated IP 2001:db8:0:1::2 (298268da-bc9b-41cf-8e8d-f9d26aa737fe/11a47c48-9002-4cc8-aa83-79d9ef8e1be3/91429dee-a49d-4027-9b60-0403c1a100ce) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:11.073549 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-83987ca3-ff39-4674-b0bf-35b19e89ff3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '724ffccb-439d-4dcf-8067-dd93db2f1f73', 'name': 'tempest-RoutersTest-router-712202871', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:07Z', 'updated_at': '2022-05-12T15:45:08Z', 'revision_number': 2, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:11.108862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83987ca3-ff39-4674-b0bf-35b19e89ff3f None None] The sync data for ids ['724ffccb-439d-4dcf-8067-dd93db2f1f73'] in n-d-841483-1 is: [{'id': '724ffccb-439d-4dcf-8067-dd93db2f1f73', 'name': 'tempest-RoutersTest-router-712202871', 'tenant_id': '755d04c3babe4d56b0092365d0203422', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:07Z', 'updated_at': '2022-05-12T15:45:08Z', 'revision_number': 2, 'project_id': '755d04c3babe4d56b0092365d0203422', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:45:11.147957 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:11.314795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Transition to ACTIVE for port object 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:11.367050 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-3ae2385c-9830-4f76-9ee0-9b42bfdaba03 service neutron] 10.222.0.82 "GET /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8729768 May 12 15:45:11.384649 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Transition to ACTIVE for port object 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:11.391790 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d29f8b52-da28-42b0-8bcc-ec7f3e471615 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:11.394102 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d29f8b52-da28-42b0-8bcc-ec7f3e471615 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:11.416472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 579} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:45:11.456666 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d29f8b52-da28-42b0-8bcc-ec7f3e471615 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:11.457230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d29f8b52-da28-42b0-8bcc-ec7f3e471615 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Fanout notify agent at l3_agent the message router_deleted on router 724ffccb-439d-4dcf-8067-dd93db2f1f73 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:45:11.488804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e4bbe98-a709-4ded-b538-2767cd2be6f4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:11.507451 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:11.507808 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Added segment 40a24c29-7ea4-4fc4-b95a-63eec4b86204 of type vlan for network efb0a87e-f691-44d4-91fd-6973427a3bed May 12 15:45:11.539834 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-62b2dd00-2e29-477e-acce-31acbc3666e3 None None] For port 91429dee-a49d-4027-9b60-0403c1a100ce, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=91429dee-a49d-4027-9b60-0403c1a100ce,segment=NetworkSegment(c8e3bb58-c87d-48f2-bd31-1c6f6f6becec),segment_id=c8e3bb58-c87d-48f2-bd31-1c6f6f6becec)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:11.577053 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17eb016e-91cc-427f-ad0a-4aaa1d560edc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:11.581937 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d29f8b52-da28-42b0-8bcc-ec7f3e471615 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:11.583021 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d29f8b52-da28-42b0-8bcc-ec7f3e471615 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/routers/724ffccb-439d-4dcf-8067-dd93db2f1f73 HTTP/1.1" status: 204 len: 168 time: 1.0908215 May 12 15:45:11.587011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44606) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:11.596814 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-62b2dd00-2e29-477e-acce-31acbc3666e3 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:11.602827 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17eb016e-91cc-427f-ad0a-4aaa1d560edc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:11.646439 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:11.662634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17eb016e-91cc-427f-ad0a-4aaa1d560edc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=58811a47-6883-420b-a7a3-dc5e6542a401,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:11.675445 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-62b2dd00-2e29-477e-acce-31acbc3666e3 None None] Transition to ACTIVE for port object 91429dee-a49d-4027-9b60-0403c1a100ce will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:11.685416 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:11.692007 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-d95fb1f9-5f8d-44d6-a772-240dced93f07 service neutron] 10.222.0.82 "GET /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3189192 May 12 15:45:11.702563 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-602104d9-2152-4379-9816-e3901374f9e1 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports?device_id=724ffccb-439d-4dcf-8067-dd93db2f1f73 HTTP/1.1" status: 200 len: 205 time: 0.1115370 May 12 15:45:11.702747 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44612) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:11.793323 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-62b2dd00-2e29-477e-acce-31acbc3666e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:11.813057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Network 81ad07c9-5912-449b-bb49-14d754ee47c0 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:11.814196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-d6e93d26-97d1-4d88-a7a0-efa5928739c9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Delete allocated IP 2001:db8:0:1::1da (298268da-bc9b-41cf-8e8d-f9d26aa737fe/11a47c48-9002-4cc8-aa83-79d9ef8e1be3) {{(pid=88152) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} May 12 15:45:11.825721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:11.864624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:11.866940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ca01fcce-f259-4769-9012-23d4f8b5e9ef up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:11.913218 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-1b89ee33-480d-4da5-8af5-45faaa41a041 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] delete failed (client error): The resource could not be found. May 12 15:45:11.914723 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1b89ee33-480d-4da5-8af5-45faaa41a041 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/routers/724ffccb-439d-4dcf-8067-dd93db2f1f73 HTTP/1.1" status: 404 len: 336 time: 0.2099092 May 12 15:45:11.918025 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17eb016e-91cc-427f-ad0a-4aaa1d560edc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:11.923831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44620) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:11.924663 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-17eb016e-91cc-427f-ad0a-4aaa1d560edc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 1.4636893 May 12 15:45:11.926637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44622) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:11.947243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-44235866-1185-43e1-bf7e-e8fe62abfde8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': 'e4f60c54-e7d8-4d35-b4f9-38e9a427040b', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:11.995459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-44235866-1185-43e1-bf7e-e8fe62abfde8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:12.017170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-44235866-1185-43e1-bf7e-e8fe62abfde8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:12.025414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-44235866-1185-43e1-bf7e-e8fe62abfde8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:18. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:12.046766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-44235866-1185-43e1-bf7e-e8fe62abfde8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 18; quota limit: 100; headroom:82 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:12.056829 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:12.057927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:12.058541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:12.093055 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-2af556f0-1f2b-4b52-b54b-d1d6c456379f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] DELETE failed (client error): The resource could not be found. May 12 15:45:12.093540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2af556f0-1f2b-4b52-b54b-d1d6c456379f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:45:12.098785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2af556f0-1f2b-4b52-b54b-d1d6c456379f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/b5dbeca3-f681-42eb-8d6c-1e8120c9627a HTTP/1.1" status: 404 len: 337 time: 0.1739175 May 12 15:45:12.101322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44634) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:12.120939 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Sync routers for ids ['759cf87a-38b1-4e42-8dc9-a38af59b3a2f'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:45:12.135128 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Routers {'759cf87a-38b1-4e42-8dc9-a38af59b3a2f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:12.135749 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['759cf87a-38b1-4e42-8dc9-a38af59b3a2f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:12.156721 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-44235866-1185-43e1-bf7e-e8fe62abfde8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Project b641518781114418963451fc3ff58f4d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:45:12.166596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Pushing event updated for resources: {'Port': ['ID=9ebb09dd-551b-4b3d-b1f6-5bdd77960bed,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:12.194206 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-85ee9f49-77a5-451f-897a-a9ba680ef331 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] DELETE failed (client error): The resource could not be found. May 12 15:45:12.194648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-85ee9f49-77a5-451f-897a-a9ba680ef331 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:45:12.201911 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-85ee9f49-77a5-451f-897a-a9ba680ef331 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/b434ad3a-39aa-4d78-9730-83acdb7ad343 HTTP/1.1" status: 404 len: 337 time: 0.0996797 May 12 15:45:12.202531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44638) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:12.298936 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 2.7933574 May 12 15:45:12.305657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44642) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:12.311803 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-0147387f-945d-47a5-b122-62c12d447f1f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] DELETE failed (client error): The resource could not be found. May 12 15:45:12.312244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0147387f-945d-47a5-b122-62c12d447f1f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:45:12.319569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0147387f-945d-47a5-b122-62c12d447f1f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/e60573af-7581-47c1-bde6-897b9df5c310 HTTP/1.1" status: 404 len: 337 time: 0.1142356 May 12 15:45:12.334819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44646) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:12.339908 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.resource_extend [None req-d6e93d26-97d1-4d88-a7a0-efa5928739c9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:45:12.340362 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-44235866-1185-43e1-bf7e-e8fe62abfde8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:12.380943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Request body: {'subnet': {'network_id': 'efb0a87e-f691-44d4-91fd-6973427a3bed', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerMultinode-1726459329-subnet', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:12.389066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:12.400959 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6e93d26-97d1-4d88-a7a0-efa5928739c9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:12.411965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Usage tracker for resource:subnet and tenant:5b43e848e2af491a8dc509c668c33e91 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:12.418750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:12.431675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:12.450035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-d6e93d26-97d1-4d88-a7a0-efa5928739c9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Ignored duplicate provisioning block setup for port 4fc09877-1358-4598-afb6-583f6f6355c0 by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:68}} May 12 15:45:12.480129 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Attempting to bind port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:12.480499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Attempting to bind port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '41769506-c6e2-4d6c-a537-2d71e8a5e3f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:12.480854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Attempting to bind port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed on network 81ad07c9-5912-449b-bb49-14d754ee47c0 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:12.497788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 44, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:12.498144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Checking segment: {'id': '41769506-c6e2-4d6c-a537-2d71e8a5e3f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:12.498544 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:12.499107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Bound using segment: {'id': '41769506-c6e2-4d6c-a537-2d71e8a5e3f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:12.499761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Bound port: 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '41769506-c6e2-4d6c-a537-2d71e8a5e3f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:12.500840 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:12.522261 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-268408e2-a20c-4f08-ab1e-c164f341a343 req-fc316aef-3dde-458a-a37f-710638c88d49 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 210 time: 0.0704031 May 12 15:45:12.524459 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6e93d26-97d1-4d88-a7a0-efa5928739c9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:12.558758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ca01fcce-f259-4769-9012-23d4f8b5e9ef completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:12.592382 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-b8060b4c-e2c7-4af3-a2f3-5d3dfc7c3acb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] DELETE failed (client error): The resource could not be found. May 12 15:45:12.593221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b8060b4c-e2c7-4af3-a2f3-5d3dfc7c3acb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:45:12.597971 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b8060b4c-e2c7-4af3-a2f3-5d3dfc7c3acb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/f7006e60-2559-4109-b7ec-b5e7c210cde8 HTTP/1.1" status: 404 len: 337 time: 0.2203195 May 12 15:45:12.612201 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Set router 759cf87a-38b1-4e42-8dc9-a38af59b3a2f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:12.619502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5a8582b-0e80-4c39-814c-9f844cb930fe admin admin] Pushing event updated for resources: {'Network': ['ID=efb0a87e-f691-44d4-91fd-6973427a3bed,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:12.636952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44658) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:12.649273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Made reservation on behalf of 5b43e848e2af491a8dc509c668c33e91 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:12.669921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62b2dd00-2e29-477e-acce-31acbc3666e3 None None] Pushing event updated for resources: {'Port': ['ID=91429dee-a49d-4027-9b60-0403c1a100ce,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:12.673818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network efb0a87e-f691-44d4-91fd-6973427a3bed details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:45:12.682317 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:12.700741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ca01fcce-f259-4769-9012-23d4f8b5e9ef triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:12.701111 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:12.767295 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-44235866-1185-43e1-bf7e-e8fe62abfde8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:12.777240 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-44235866-1185-43e1-bf7e-e8fe62abfde8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:12.860824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44235866-1185-43e1-bf7e-e8fe62abfde8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a9296845-947a-43a7-951a-5d2e75b320b6,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:12.896124 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-44235866-1185-43e1-bf7e-e8fe62abfde8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:12.899836 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-44235866-1185-43e1-bf7e-e8fe62abfde8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.9649241 May 12 15:45:12.900442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44666) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:12.912172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4680985d-c3b4-4139-8621-660cd0cd44f6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': 'e4f60c54-e7d8-4d35-b4f9-38e9a427040b', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:12.924967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d6e93d26-97d1-4d88-a7a0-efa5928739c9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] In _notify_port_updated(), no bound segment for port 4fc09877-1358-4598-afb6-583f6f6355c0 on network 298268da-bc9b-41cf-8e8d-f9d26aa737fe {{(pid=88152) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:45:12.930636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4680985d-c3b4-4139-8621-660cd0cd44f6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:12.936088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4680985d-c3b4-4139-8621-660cd0cd44f6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:12.938469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6e93d26-97d1-4d88-a7a0-efa5928739c9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:12.939271 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6e93d26-97d1-4d88-a7a0-efa5928739c9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:12.940911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4680985d-c3b4-4139-8621-660cd0cd44f6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:19. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:12.945265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44670) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:12.946880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d6e93d26-97d1-4d88-a7a0-efa5928739c9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "PUT /v2.0/ports/4fc09877-1358-4598-afb6-583f6f6355c0 HTTP/1.1" status: 200 len: 925 time: 2.6561201 May 12 15:45:12.961440 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-789c72ab-a621-4058-8cb7-97ffd3bf2427 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '1ddc6003-e8a6-490b-b1fa-cc3e1d8653aa'}, {'subnet_id': '11a47c48-9002-4cc8-aa83-79d9ef8e1be3'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:13.047136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4680985d-c3b4-4139-8621-660cd0cd44f6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 19; quota limit: 100; headroom:81 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:13.081040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44676) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:13.082569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c17d01e1-e610-4c43-81ce-31f7300514fd tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports?device_id=766c87d1-88c8-4b7e-ba13-f65737b66f8b HTTP/1.1" status: 200 len: 205 time: 0.4403803 May 12 15:45:13.097657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44678) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:13.120426 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2d228395-9b9d-43c5-9f15-4090c016ceaf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:13.133476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1285160968', 'description': 'tempest-secgroup-smoke-1285160968 description', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:13.149889 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-4680985d-c3b4-4139-8621-660cd0cd44f6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Project b641518781114418963451fc3ff58f4d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:45:13.169172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:13.213539 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:13.231984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e93d26-97d1-4d88-a7a0-efa5928739c9 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=4fc09877-1358-4598-afb6-583f6f6355c0,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:13.233448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:13.237184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4680985d-c3b4-4139-8621-660cd0cd44f6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:13.270958 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-34e95ad3-0dc5-4413-90ef-18a714a785ca tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] delete failed (client error): The resource could not be found. May 12 15:45:13.272235 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-34e95ad3-0dc5-4413-90ef-18a714a785ca tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/routers/766c87d1-88c8-4b7e-ba13-f65737b66f8b HTTP/1.1" status: 404 len: 336 time: 0.1389229 May 12 15:45:13.275182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44686) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:13.302612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:13.324388 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] For port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:13.384286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] For port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9ebb09dd-551b-4b3d-b1f6-5bdd77960bed,segment=NetworkSegment(41769506-c6e2-4d6c-a537-2d71e8a5e3f7),segment_id=41769506-c6e2-4d6c-a537-2d71e8a5e3f7)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:13.404495 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:13.498858 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:13.501374 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9dd1aebf-fb46-44db-b9ab-3fa83eaec9f6 None None] Network 298268da-bc9b-41cf-8e8d-f9d26aa737fe requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:13.511273 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:13.535306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:13.539295 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'name': 'tempest-TestServerMultinode-726377410-router', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:44:57Z', 'updated_at': '2022-05-12T15:45:05Z', 'revision_number': 4, 'project_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'gw_port': {'id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:d5:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3579, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:44:58Z', 'updated_at': '2022-05-12T15:45:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '07a79124-ebb1-420c-a284-314332baa4cd', 'name': '', 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'mac_address': 'fa:16:3e:05:1b:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 3588, 'fixed_ips': [{'subnet_id': '25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:03Z', 'updated_at': '2022-05-12T15:45:05Z', 'revision_number': 2, 'project_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'subnets': [{'id': '25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:13.543264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e35a1819-4487-4241-9d9e-61634f56a549 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports?device_id=3b08703e-e807-4695-a44e-e43e5d97d1c7 HTTP/1.1" status: 200 len: 205 time: 0.2628868 May 12 15:45:13.548869 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Checking router: 759cf87a-38b1-4e42-8dc9-a38af59b3a2f for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:45:13.549570 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Updating router 759cf87a-38b1-4e42-8dc9-a38af59b3a2f port 07a79124-ebb1-420c-a284-314332baa4cd binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:45:13.562127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44690) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:13.562611 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:13.632298 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:13.639303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:13.659522 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4680985d-c3b4-4139-8621-660cd0cd44f6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:13.667855 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-322b69d5-71fd-40c2-8a80-be2f216988ab tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] delete failed (client error): The resource could not be found. May 12 15:45:13.668881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-322b69d5-71fd-40c2-8a80-be2f216988ab tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/routers/3b08703e-e807-4695-a44e-e43e5d97d1c7 HTTP/1.1" status: 404 len: 336 time: 0.1059351 May 12 15:45:13.672111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:13.675312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44696) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:13.690725 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:13.694994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:13.761479 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ca01fcce-f259-4769-9012-23d4f8b5e9ef, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ca01fcce-f259-4769-9012-23d4f8b5e9ef,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:13.768114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b54d0dae-0437-4dbc-bffc-603e71f77655 None None] Provisioning for port 91429dee-a49d-4027-9b60-0403c1a100ce completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:13.781197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fdf826e-ad9a-4ff5-aef3-e7d4604fbad5 None None] Pushing event updated for resources: {'Port': ['ID=9ebb09dd-551b-4b3d-b1f6-5bdd77960bed,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:13.786196 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:13.791536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 91429dee-a49d-4027-9b60-0403c1a100ce up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:13.850048 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-789c72ab-a621-4058-8cb7-97ffd3bf2427 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:13.854478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a02117db-ebdf-49e4-8844-4ca414de801d,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:13.883216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b54d0dae-0437-4dbc-bffc-603e71f77655 None None] Provisioning complete for port 91429dee-a49d-4027-9b60-0403c1a100ce triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:13.883491 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b54d0dae-0437-4dbc-bffc-603e71f77655 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:13.898528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4680985d-c3b4-4139-8621-660cd0cd44f6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:13.903337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:13.914988 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-a8dd294e-5151-4cc1-b713-f5e964d299c7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] DELETE failed (client error): The resource could not be found. May 12 15:45:13.915525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a8dd294e-5151-4cc1-b713-f5e964d299c7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:45:13.926522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Checking segment: {'id': '40a24c29-7ea4-4fc4-b95a-63eec4b86204', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'efb0a87e-f691-44d4-91fd-6973427a3bed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:13.928105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Network hostable DHCP agents. Network: efb0a87e-f691-44d4-91fd-6973427a3bed, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:45:13.952338 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39a72436-77ce-40cf-8018-4a99a46bda80 req-391b1923-4ae7-4918-a1a6-dce1cd7e50e9 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 210 time: 0.1001499 May 12 15:45:13.958720 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a8dd294e-5151-4cc1-b713-f5e964d299c7 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/7d525743-a247-4185-8c70-60b889a9e809 HTTP/1.1" status: 404 len: 337 time: 0.2805123 May 12 15:45:13.974587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4680985d-c3b4-4139-8621-660cd0cd44f6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5cec6beb-821f-4c29-8b52-df4816c62a9f,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:13.979171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44700) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:14.094920 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-283d6b58-d4b4-4236-a550-e25ed3866bf3 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports?device_id=2f916fd8-d0d3-4984-897b-0a39e34543f4 HTTP/1.1" status: 200 len: 205 time: 0.1070344 May 12 15:45:14.095556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44704) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:14.113587 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4680985d-c3b4-4139-8621-660cd0cd44f6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:14.125313 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4680985d-c3b4-4139-8621-660cd0cd44f6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 1.2137043 May 12 15:45:14.258091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Network efb0a87e-f691-44d4-91fd-6973427a3bed is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:45:14.271834 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ca01fcce-f259-4769-9012-23d4f8b5e9ef,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:14.275974 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-2d7ba6f1-f960-4225-9e30-7b49307e537a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] delete failed (client error): The resource could not be found. May 12 15:45:14.280520 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2d7ba6f1-f960-4225-9e30-7b49307e537a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/routers/2f916fd8-d0d3-4984-897b-0a39e34543f4 HTTP/1.1" status: 404 len: 336 time: 0.1827316 May 12 15:45:14.281126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44710) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:14.284049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, efb0a87e-f691-44d4-91fd-6973427a3bed) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:14.307165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc662a44-e8df-4a67-8dce-1afd26fa922f None None] Network efb0a87e-f691-44d4-91fd-6973427a3bed requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:14.345704 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:14.364502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-788c29de-3764-4ef6-b383-02bb5dbeb94a tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports?device_id=4a181b0a-648d-40c1-b3ca-d6a8995fa6eb HTTP/1.1" status: 200 len: 205 time: 0.0814340 May 12 15:45:14.366913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44714) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:14.370272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:14.370866 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:14.372607 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Transition to ACTIVE for port object 07a79124-ebb1-420c-a284-314332baa4cd will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:14.393715 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:14.481130 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-82ec97e3-d3f5-449e-8440-b527dc674f3b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] delete failed (client error): The resource could not be found. May 12 15:45:14.485883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-82ec97e3-d3f5-449e-8440-b527dc674f3b tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/routers/4a181b0a-648d-40c1-b3ca-d6a8995fa6eb HTTP/1.1" status: 404 len: 336 time: 0.1179943 May 12 15:45:14.487794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44720) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:14.528407 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cf3120ed-414a-4c31-ae9a-8e0fb40867f8 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 2.2216690 May 12 15:45:14.532819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44724) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:14.536056 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-d7bd15db-e37d-4647-8944-9c790cf53e8f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] DELETE failed (client error): The resource could not be found. May 12 15:45:14.536511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d7bd15db-e37d-4647-8944-9c790cf53e8f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:45:14.541754 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d7bd15db-e37d-4647-8944-9c790cf53e8f tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/7aac4d61-6a9e-4de4-8a07-0377e3406e4f HTTP/1.1" status: 404 len: 337 time: 0.0521607 May 12 15:45:14.541754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44728) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:14.544639 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Request body: {'router': {'name': 'tempest-TestServerMultinode-1726459329-router', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:14.550376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:14.555105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Usage tracker for resource:router and tenant:5b43e848e2af491a8dc509c668c33e91 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:14.558013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:14.565905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:14.702549 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:14.705032 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:14.724264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-62e56b41-99d5-4d4d-921b-6578811b6fd6 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports?device_id=171fbbe8-103b-4069-8efc-f9a483f821d6 HTTP/1.1" status: 200 len: 205 time: 0.1507409 May 12 15:45:14.732619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44740) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:14.741941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-444a65aa-2e54-4331-aa4b-e6a209236a28 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1249125445&fields=id&tenant_id=b641518781114418963451fc3ff58f4d HTTP/1.1" status: 200 len: 267 time: 0.1032078 May 12 15:45:14.766764 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15843da3-4eb9-4b16-aea9-a61af56a631f None None] Pushing event updated for resources: {'Port': ['ID=07a79124-ebb1-420c-a284-314332baa4cd,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:14.842157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 91429dee-a49d-4027-9b60-0403c1a100ce triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:14.842652 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:14.879641 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15843da3-4eb9-4b16-aea9-a61af56a631f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:14.880041 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15843da3-4eb9-4b16-aea9-a61af56a631f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:14.880374 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15843da3-4eb9-4b16-aea9-a61af56a631f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:14.880695 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15843da3-4eb9-4b16-aea9-a61af56a631f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:14.881012 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15843da3-4eb9-4b16-aea9-a61af56a631f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:14.881322 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15843da3-4eb9-4b16-aea9-a61af56a631f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:14.881667 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15843da3-4eb9-4b16-aea9-a61af56a631f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:14.881977 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15843da3-4eb9-4b16-aea9-a61af56a631f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:14.882351 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15843da3-4eb9-4b16-aea9-a61af56a631f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:14.882572 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15843da3-4eb9-4b16-aea9-a61af56a631f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:14.882878 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15843da3-4eb9-4b16-aea9-a61af56a631f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:14.883179 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15843da3-4eb9-4b16-aea9-a61af56a631f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:45:14.936328 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Attempting to bind port 07a79124-ebb1-420c-a284-314332baa4cd on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:14.936650 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Attempting to bind port 07a79124-ebb1-420c-a284-314332baa4cd by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:14.936996 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Attempting to bind port 07a79124-ebb1-420c-a284-314332baa4cd on network 0de89d0f-e308-41b4-8980-4fb156f3c79b {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:14.951310 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 44, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:14.951665 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Checking segment: {'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:14.952053 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:14.952427 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Bound using segment: {'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:14.952877 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Bound port: 07a79124-ebb1-420c-a284-314332baa4cd, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:14.953229 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:14.985660 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:14.992641 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:15.024418 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-e2569c50-b70f-4c26-9d77-c714d8766f15 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] delete failed (client error): The resource could not be found. May 12 15:45:15.028327 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e2569c50-b70f-4c26-9d77-c714d8766f15 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/routers/171fbbe8-103b-4069-8efc-f9a483f821d6 HTTP/1.1" status: 404 len: 336 time: 0.2943611 May 12 15:45:15.028929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44746) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:15.030578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-5ee6d05e-abc5-4b24-acff-7d01fba60800 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:15.032082 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-5ee6d05e-abc5-4b24-acff-7d01fba60800 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.76 "GET /v2.0/networks?id=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade HTTP/1.1" status: 200 len: 813 time: 0.7267385 May 12 15:45:15.035594 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:15.044178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:15.061699 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:15.065000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:15.066995 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-efb0a87e-f691-44d4-91fd-6973427a3bed', 'network_id': 'efb0a87e-f691-44d4-91fd-6973427a3bed', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'fixed_ips': [{'subnet_id': 'a02117db-ebdf-49e4-8844-4ca414de801d'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:45:15.067807 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:15.089662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:15.162458 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] For port 07a79124-ebb1-420c-a284-314332baa4cd, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:15.167047 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] For port 07a79124-ebb1-420c-a284-314332baa4cd, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=07a79124-ebb1-420c-a284-314332baa4cd,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:15.176018 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:15.243412 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:15.397381 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Routers {'759cf87a-38b1-4e42-8dc9-a38af59b3a2f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:15.398009 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:44:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['759cf87a-38b1-4e42-8dc9-a38af59b3a2f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:15.420043 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-a42ea929-8688-4df9-b2e4-78b524624852 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0528307b42774c45be9eba4ffc91c8dd HTTP/1.1" status: 200 len: 380 time: 0.1729455 May 12 15:45:15.423076 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bd7bfcda-37e2-4318-b4b2-df32f1e6c790 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:15.461130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Request body: {'port': {'device_id': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'admin_state_up': True, 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'security_groups': ['be4caf5e-1821-4c5c-b429-5f1324c7c7b2']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:15.488673 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:15.569338 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-497b328c-0a17-4ae5-bcb9-4cc9aac2b4c4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] DELETE failed (client error): The resource could not be found. May 12 15:45:15.569847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-497b328c-0a17-4ae5-bcb9-4cc9aac2b4c4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:45:15.595697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-497b328c-0a17-4ae5-bcb9-4cc9aac2b4c4 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/738c462a-65bc-4929-afef-e9bdcd044211 HTTP/1.1" status: 404 len: 337 time: 0.5595117 May 12 15:45:15.600717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44750) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:15.614079 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c8fe875-4e27-474e-bf35-72a6c0cc4da0 req-eb7ce034-c1a6-4b0c-a155-203fa4b1851d tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 210 time: 0.3285391 May 12 15:45:15.639968 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15843da3-4eb9-4b16-aea9-a61af56a631f None None] Pushing event updated for resources: {'Port': ['ID=07a79124-ebb1-420c-a284-314332baa4cd,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:15.660751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Allocated IP 172.20.0.2 (efb0a87e-f691-44d4-91fd-6973427a3bed/a02117db-ebdf-49e4-8844-4ca414de801d/674557b5-63cc-40e5-bc60-af4e475b92d6) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:15.688356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 91429dee-a49d-4027-9b60-0403c1a100ce up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:15.801141 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4bd32035-802b-4188-b325-f84eafbea8fd None None] Network 81ad07c9-5912-449b-bb49-14d754ee47c0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:15.897940 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:15.952418 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] Set router 759cf87a-38b1-4e42-8dc9-a38af59b3a2f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:15.955979 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dc7847c6-8d25-4beb-a2bb-28561d51a6fa tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "GET /v2.0/ports?device_id=5db27d2e-25e4-4bc0-be01-3f16d1aa415a HTTP/1.1" status: 200 len: 205 time: 0.3503470 May 12 15:45:15.963082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44754) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:16.068403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroup': ['ID=08663c65-52e4-493a-a1c9-3be0a47695bd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:16.110325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:16.112128 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 3.0207951 May 12 15:45:16.133592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44758) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:16.136727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-789c72ab-a621-4058-8cb7-97ffd3bf2427 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Allocated IP 2001:db8:0:1::bf (298268da-bc9b-41cf-8e8d-f9d26aa737fe/11a47c48-9002-4cc8-aa83-79d9ef8e1be3/4fc09877-1358-4598-afb6-583f6f6355c0) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:16.167865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f31568b5-5981-4355-bb9c-b4accf9abcd8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '93d6a643-d4d6-485b-81ac-56893147cebc', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:16.199466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f31568b5-5981-4355-bb9c-b4accf9abcd8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:16.210541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f31568b5-5981-4355-bb9c-b4accf9abcd8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:16.225078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1dfb4c18-b924-42f8-9398-47897c4adea2 None None] Provisioning for port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:16.230450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-8799701e-07dd-4417-b8c9-36f326c58ac9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:16.231450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-8799701e-07dd-4417-b8c9-36f326c58ac9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:16.240384 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-b84f6ab6-45c1-4e6e-a8f1-1a3e46b8c9bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] delete failed (client error): The resource could not be found. May 12 15:45:16.244566 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b84f6ab6-45c1-4e6e-a8f1-1a3e46b8c9bb tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/routers/5db27d2e-25e4-4bc0-be01-3f16d1aa415a HTTP/1.1" status: 404 len: 336 time: 0.2803469 May 12 15:45:16.246998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44762) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:16.295257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f31568b5-5981-4355-bb9c-b4accf9abcd8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:16.310623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a579e1e8-f579-43af-94e5-3d48336ea5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroup': ['ID=93d6a643-d4d6-485b-81ac-56893147cebc,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:16.311833 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:16.398803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 91429dee-a49d-4027-9b60-0403c1a100ce triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:16.404510 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:16.439565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f31568b5-5981-4355-bb9c-b4accf9abcd8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:16.481521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:16.496214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Usage tracker for resource:port and tenant:0528307b42774c45be9eba4ffc91c8dd is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:16.503729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:16.533288 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:16.542934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:16.552712 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f31568b5-5981-4355-bb9c-b4accf9abcd8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:16.608231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Made reservation on behalf of 0528307b42774c45be9eba4ffc91c8dd for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:16.619291 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:16.636832 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'name': 'tempest-TestServerMultinode-726377410-router', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:44:57Z', 'updated_at': '2022-05-12T15:45:05Z', 'revision_number': 4, 'project_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'gw_port': {'id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:d5:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3579, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:44:58Z', 'updated_at': '2022-05-12T15:45:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '07a79124-ebb1-420c-a284-314332baa4cd', 'name': '', 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'mac_address': 'fa:16:3e:05:1b:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 3588, 'fixed_ips': [{'subnet_id': '25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:03Z', 'updated_at': '2022-05-12T15:45:15Z', 'revision_number': 4, 'project_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'subnets': [{'id': '25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:16.642613 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7670d57d-f4c3-4abd-b4c3-bb7f2a90d515 None None] The sync data for ids ['759cf87a-38b1-4e42-8dc9-a38af59b3a2f'] in n-d-841483-1 is: [{'id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'name': 'tempest-TestServerMultinode-726377410-router', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:44:57Z', 'updated_at': '2022-05-12T15:45:05Z', 'revision_number': 4, 'project_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'gw_port': {'id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:d5:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3579, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:44:58Z', 'updated_at': '2022-05-12T15:45:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '07a79124-ebb1-420c-a284-314332baa4cd', 'name': '', 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'mac_address': 'fa:16:3e:05:1b:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 3588, 'fixed_ips': [{'subnet_id': '25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:03Z', 'updated_at': '2022-05-12T15:45:15Z', 'revision_number': 4, 'project_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'subnets': [{'id': '25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:45:16.678906 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4cff1059-abed-41a8-ab64-ceb180a9fb64 None None] Provisioning complete for port 91429dee-a49d-4027-9b60-0403c1a100ce triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:16.686047 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cff1059-abed-41a8-ab64-ceb180a9fb64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:16.695835 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-1e258b40-82cb-467f-9303-4cf1ffb0a304 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] DELETE failed (client error): The resource could not be found. May 12 15:45:16.696554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1e258b40-82cb-467f-9303-4cf1ffb0a304 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:45:16.706706 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1e258b40-82cb-467f-9303-4cf1ffb0a304 tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/b43d14af-848e-4434-a4f7-1e43a0ba4a65 HTTP/1.1" status: 404 len: 337 time: 0.4527786 May 12 15:45:16.708946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44768) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:16.768360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-8799701e-07dd-4417-b8c9-36f326c58ac9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:16.769534 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-8799701e-07dd-4417-b8c9-36f326c58ac9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/networks?id=81ad07c9-5912-449b-bb49-14d754ee47c0 HTTP/1.1" status: 200 len: 796 time: 1.8406110 May 12 15:45:16.803164 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-21bf02e1-36d9-4087-8eaf-746fdcad774d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/quotas/b641518781114418963451fc3ff58f4d HTTP/1.1" status: 200 len: 375 time: 0.0222127 May 12 15:45:16.846732 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-789c72ab-a621-4058-8cb7-97ffd3bf2427 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:16.885724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:16.887385 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-da3f71b4-7950-42b3-a4fe-7f6626d8de2d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] DELETE failed (client error): The resource could not be found. May 12 15:45:16.888194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-da3f71b4-7950-42b3-a4fe-7f6626d8de2d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:45:16.890154 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-da3f71b4-7950-42b3-a4fe-7f6626d8de2d tempest-RoutersTest-1619665070 tempest-RoutersTest-1619665070-project] 10.222.0.82 "DELETE /v2.0/subnets/065f3de9-82f8-45c4-adf9-8dd4045e095b HTTP/1.1" status: 404 len: 337 time: 0.1791220 May 12 15:45:16.933043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-789c72ab-a621-4058-8cb7-97ffd3bf2427 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Ignored duplicate provisioning block setup for port 4fc09877-1358-4598-afb6-583f6f6355c0 by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:68}} May 12 15:45:16.942804 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f31568b5-5981-4355-bb9c-b4accf9abcd8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:16.946182 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:45:16.958570 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-789c72ab-a621-4058-8cb7-97ffd3bf2427 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:16.989821 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31d7f6ef-2c19-480e-aa68-7f9e427ae334 req-7d9cd996-6ce6-4d68-98dc-d40ffabd68c7 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 210 time: 0.0960124 May 12 15:45:17.053218 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f31568b5-5981-4355-bb9c-b4accf9abcd8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:17.237179 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:17.287796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Transition to ACTIVE for port object 674557b5-63cc-40e5-bc60-af4e475b92d6 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:17.308723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f31568b5-5981-4355-bb9c-b4accf9abcd8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=57e2240f-ed91-4417-9780-d25ed1066ff8,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:17.316182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4cff1059-abed-41a8-ab64-ceb180a9fb64 None None] Provisioning for port 4fc09877-1358-4598-afb6-583f6f6355c0 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:17.341113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:17.380545 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4cff1059-abed-41a8-ab64-ceb180a9fb64 None None] Provisioning complete for port 4fc09877-1358-4598-afb6-583f6f6355c0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:17.380910 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4cff1059-abed-41a8-ab64-ceb180a9fb64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:17.399667 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-d7837d6b-344c-4307-af65-8e544514fd4a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&fields=id HTTP/1.1" status: 200 len: 440 time: 0.5884576 May 12 15:45:17.440584 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:17.499510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Transition to ACTIVE for port object 674557b5-63cc-40e5-bc60-af4e475b92d6 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:17.499971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f31568b5-5981-4355-bb9c-b4accf9abcd8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:17.505854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:17.506286 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f31568b5-5981-4355-bb9c-b4accf9abcd8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.3713629 May 12 15:45:17.506957 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:17.510260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44776) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:17.534906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:17.565914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Allocated IP 172.20.0.14 (8fe69ccc-2df6-4e6d-ad35-1b9439b8eade/5b4ef35a-b116-4246-86c9-ff3a7aad3410/e4de15ca-6d9a-47d1-8535-a72265f9c929) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:17.604709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-789c72ab-a621-4058-8cb7-97ffd3bf2427 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=4fc09877-1358-4598-afb6-583f6f6355c0,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:17.614989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-789c72ab-a621-4058-8cb7-97ffd3bf2427 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] In _notify_port_updated(), no bound segment for port 4fc09877-1358-4598-afb6-583f6f6355c0 on network 298268da-bc9b-41cf-8e8d-f9d26aa737fe {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:45:17.628052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-789c72ab-a621-4058-8cb7-97ffd3bf2427 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:17.628889 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-789c72ab-a621-4058-8cb7-97ffd3bf2427 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:17.633733 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:17.635375 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-789c72ab-a621-4058-8cb7-97ffd3bf2427 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "PUT /v2.0/ports/4fc09877-1358-4598-afb6-583f6f6355c0 HTTP/1.1" status: 200 len: 1010 time: 4.6885579 May 12 15:45:17.636324 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44780) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:17.636819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44782) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:17.641261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-10df06b8-2716-4a2e-b59b-4f738495d892 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '93d6a643-d4d6-485b-81ac-56893147cebc', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:17.691918 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-d2e07591-b95b-4d1d-a235-2b3212794908 service neutron] 10.222.0.82 "GET /v2.0/networks/81ad07c9-5912-449b-bb49-14d754ee47c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2855811 May 12 15:45:17.812169 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Pushing event updated for resources: {'Port': ['ID=674557b5-63cc-40e5-bc60-af4e475b92d6,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:17.821489 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4cff1059-abed-41a8-ab64-ceb180a9fb64 None None] Port 4fc09877-1358-4598-afb6-583f6f6355c0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:17.849450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-10df06b8-2716-4a2e-b59b-4f738495d892 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:17.865324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Network efb0a87e-f691-44d4-91fd-6973427a3bed is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:17.872754 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:17.873738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-125343d3-0cba-4c92-81a2-00a2bfe1aa67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 4fc09877-1358-4598-afb6-583f6f6355c0 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:45:17.874940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125343d3-0cba-4c92-81a2-00a2bfe1aa67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:17.876987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:17.900332 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:17.905056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-10df06b8-2716-4a2e-b59b-4f738495d892 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:17.960088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-10df06b8-2716-4a2e-b59b-4f738495d892 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:17.983390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-10df06b8-2716-4a2e-b59b-4f738495d892 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:18.019572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Allocated IP 172.25.8.215 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/e66a483c-259d-4247-bb93-8082176ad6ed) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:18.043822 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-f64ef760-7689-4c3f-873b-70510fe63918 service neutron] 10.222.0.82 "GET /v2.0/networks/81ad07c9-5912-449b-bb49-14d754ee47c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3445184 May 12 15:45:18.127708 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:18.229932 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-86b4dab1-7827-4c03-afd2-4b7926bf5fba None None] Provisioning complete for port 4fc09877-1358-4598-afb6-583f6f6355c0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:18.230307 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-86b4dab1-7827-4c03-afd2-4b7926bf5fba None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:18.286072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Attempting to bind port 674557b5-63cc-40e5-bc60-af4e475b92d6 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:18.286726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Attempting to bind port 674557b5-63cc-40e5-bc60-af4e475b92d6 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '40a24c29-7ea4-4fc4-b95a-63eec4b86204', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'efb0a87e-f691-44d4-91fd-6973427a3bed'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:18.286826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Attempting to bind port 674557b5-63cc-40e5-bc60-af4e475b92d6 on network efb0a87e-f691-44d4-91fd-6973427a3bed {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:18.296291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:18.296659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Checking segment: {'id': '40a24c29-7ea4-4fc4-b95a-63eec4b86204', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'efb0a87e-f691-44d4-91fd-6973427a3bed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:18.297149 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:18.297750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Bound using segment: {'id': '40a24c29-7ea4-4fc4-b95a-63eec4b86204', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'efb0a87e-f691-44d4-91fd-6973427a3bed'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:18.298229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Bound port: 674557b5-63cc-40e5-bc60-af4e475b92d6, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '40a24c29-7ea4-4fc4-b95a-63eec4b86204', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'efb0a87e-f691-44d4-91fd-6973427a3bed'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:18.298601 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:18.316674 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9ebb09dd-551b-4b3d-b1f6-5bdd77960bed,segment=NetworkSegment(41769506-c6e2-4d6c-a537-2d71e8a5e3f7),segment_id=41769506-c6e2-4d6c-a537-2d71e8a5e3f7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:18.316909 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:18.333629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Transition to ACTIVE for port object e4de15ca-6d9a-47d1-8535-a72265f9c929 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:18.367780 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:18.371324 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:18.372304 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ca01fcce-f259-4769-9012-23d4f8b5e9ef up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:18.379836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8b98f4df-ca13-4fc3-b09b-5ce542e3948c req-99271319-d92c-4e7d-8a5c-56a80bce5014 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 210 time: 0.1430988 May 12 15:45:18.398248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-86b4dab1-7827-4c03-afd2-4b7926bf5fba None None] Port 4fc09877-1358-4598-afb6-583f6f6355c0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:18.438707 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:18.450194 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e6057167-83d6-461f-864a-8510a7abc147 req-28d8ebad-845c-4d09-b650-95819d71a90f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 210 time: 0.0859370 May 12 15:45:18.484172 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:18.557940 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] For port 674557b5-63cc-40e5-bc60-af4e475b92d6, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:18.558233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:18.562289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f2004ee0-8ef8-4ca4-bd85-955ef7cc7d3c None None] Provisioning complete for port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:18.563210 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f2004ee0-8ef8-4ca4-bd85-955ef7cc7d3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:18.571914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:18.574577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:18.596891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:18.607106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:18.620061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] For port 674557b5-63cc-40e5-bc60-af4e475b92d6, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=674557b5-63cc-40e5-bc60-af4e475b92d6,segment=NetworkSegment(40a24c29-7ea4-4fc4-b95a-63eec4b86204),segment_id=40a24c29-7ea4-4fc4-b95a-63eec4b86204)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:18.624029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=9ebb09dd-551b-4b3d-b1f6-5bdd77960bed,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:18.635435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:18.637374 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:18.709203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-10df06b8-2716-4a2e-b59b-4f738495d892 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:18.730523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ca01fcce-f259-4769-9012-23d4f8b5e9ef triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:18.730914 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:18.800391 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Pushing event updated for resources: {'Port': ['ID=e66a483c-259d-4247-bb93-8082176ad6ed,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:18.854820 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cf56fa9e-634d-4056-adcf-28bf60a178d4 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=755d04c3babe4d56b0092365d0203422&name=default HTTP/1.1" status: 200 len: 2983 time: 1.2038829 May 12 15:45:18.858866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44804) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:18.979300 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-10df06b8-2716-4a2e-b59b-4f738495d892 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:18.983538 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1e53baa-eb49-4110-978e-e956c4b4d156 None None] Pushing event updated for resources: {'Port': ['ID=674557b5-63cc-40e5-bc60-af4e475b92d6,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:18.991383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Pushing event updated for resources: {'Port': ['ID=e4de15ca-6d9a-47d1-8535-a72265f9c929,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:19.002770 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125343d3-0cba-4c92-81a2-00a2bfe1aa67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:19.035286 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-10df06b8-2716-4a2e-b59b-4f738495d892 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:19.056273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:19.057667 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:19.116158 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-014fd0a3-752e-420b-873d-89b6858c75be tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.6704071 May 12 15:45:19.206494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10df06b8-2716-4a2e-b59b-4f738495d892 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=375f7959-8e67-4636-a65f-de9ef265183c,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:19.214015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-341da3b8-94b8-4b04-b43a-3a11186687b7 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:45:19.215042 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-341da3b8-94b8-4b04-b43a-3a11186687b7 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0098066 May 12 15:45:19.235829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-15de5adb-2445-41a6-b227-307e5aed16eb None None] Provisioning for port e4de15ca-6d9a-47d1-8535-a72265f9c929 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:19.241687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-15de5adb-2445-41a6-b227-307e5aed16eb None None] Provisioning complete for port e4de15ca-6d9a-47d1-8535-a72265f9c929 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:19.242316 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-15de5adb-2445-41a6-b227-307e5aed16eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:19.387874 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-15de5adb-2445-41a6-b227-307e5aed16eb None None] Port e4de15ca-6d9a-47d1-8535-a72265f9c929 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:19.464921 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-015af967-fab9-43ba-929e-0c739eebe1b2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:19.470577 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Request body: {'port': {'device_id': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:19.504546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-125343d3-0cba-4c92-81a2-00a2bfe1aa67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 4fc09877-1358-4598-afb6-583f6f6355c0 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:45:19.512740 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 674557b5-63cc-40e5-bc60-af4e475b92d6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:19.608733 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:19.661839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 674557b5-63cc-40e5-bc60-af4e475b92d6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:19.668327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:19.694251 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-10df06b8-2716-4a2e-b59b-4f738495d892 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:19.695515 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-10df06b8-2716-4a2e-b59b-4f738495d892 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 2.1110952 May 12 15:45:19.705001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44812) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:19.737699 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f2d11a3f-c659-4157-8f6c-37ae9fec4e5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '93d6a643-d4d6-485b-81ac-56893147cebc', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:19.742660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:19.743026 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:19.753161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-015af967-fab9-43ba-929e-0c739eebe1b2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:19.761898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f2d11a3f-c659-4157-8f6c-37ae9fec4e5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:19.779622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f2d11a3f-c659-4157-8f6c-37ae9fec4e5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:19.787339 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f2d11a3f-c659-4157-8f6c-37ae9fec4e5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:19.788322 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8140f68f-5890-408a-b17a-f70e5e219c60 req-0ccdfe52-c07b-4844-8a5b-c115514bcf85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 210 time: 0.1106055 May 12 15:45:19.791511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:19.848084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f2d11a3f-c659-4157-8f6c-37ae9fec4e5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:19.908003 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 07a79124-ebb1-420c-a284-314332baa4cd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:19.945487 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2d11a3f-c659-4157-8f6c-37ae9fec4e5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:20.005013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e24cf06a-1d80-42c8-8805-223190a0d9bc req-eb0b29a1-7e99-4c00-a485-b7f0668e370a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:20.017470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 07a79124-ebb1-420c-a284-314332baa4cd completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:20.019861 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e24cf06a-1d80-42c8-8805-223190a0d9bc req-eb0b29a1-7e99-4c00-a485-b7f0668e370a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 932 time: 0.3409140 May 12 15:45:20.023239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 07a79124-ebb1-420c-a284-314332baa4cd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:20.023677 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:20.133059 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-015af967-fab9-43ba-929e-0c739eebe1b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:20.193144 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:20.229774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-015af967-fab9-43ba-929e-0c739eebe1b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0352a96f-d8bd-4afd-811a-c520afb15d9d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:20.274244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 07a79124-ebb1-420c-a284-314332baa4cd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=07a79124-ebb1-420c-a284-314332baa4cd,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:20.284280 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:20.332982 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e24cf06a-1d80-42c8-8805-223190a0d9bc req-692b0d06-9e3b-48a5-9109-af751ab935e3 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3115306 May 12 15:45:20.347424 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:20.362733 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125343d3-0cba-4c92-81a2-00a2bfe1aa67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:20.406607 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-015af967-fab9-43ba-929e-0c739eebe1b2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:20.411055 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-015af967-fab9-43ba-929e-0c739eebe1b2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0352a96f-d8bd-4afd-811a-c520afb15d9d HTTP/1.1" status: 204 len: 168 time: 1.5408564 May 12 15:45:20.417993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8e6f5dd-9f62-4a92-b87e-5e66284b5960 None None] Network efb0a87e-f691-44d4-91fd-6973427a3bed requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:20.432630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-125343d3-0cba-4c92-81a2-00a2bfe1aa67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=4fc09877-1358-4598-afb6-583f6f6355c0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:20.482590 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2d11a3f-c659-4157-8f6c-37ae9fec4e5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:20.587208 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-125343d3-0cba-4c92-81a2-00a2bfe1aa67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:20.590078 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2d11a3f-c659-4157-8f6c-37ae9fec4e5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:20.655675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Router bc5f0aa5-db22-4d81-afb5-d90c21590056 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:45:20.659130 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-125343d3-0cba-4c92-81a2-00a2bfe1aa67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/4fc09877-1358-4598-afb6-583f6f6355c0 HTTP/1.1" status: 204 len: 168 time: 3.0041037 May 12 15:45:20.659130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d11a3f-c659-4157-8f6c-37ae9fec4e5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=28990cd0-134c-486d-8736-c80ddd792ef2,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:20.659934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44820) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:20.727720 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f2d11a3f-c659-4157-8f6c-37ae9fec4e5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:20.728893 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f2d11a3f-c659-4157-8f6c-37ae9fec4e5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.0050232 May 12 15:45:20.737983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44824) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:20.743430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-bf9ef878-5bd5-4ae5-bbf1-0c8230a65c8e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '93d6a643-d4d6-485b-81ac-56893147cebc', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:20.750896 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-02beb9d0-c760-49a1-8c6c-372d38786f5e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] GET failed (client error): The resource could not be found. May 12 15:45:20.751768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-02beb9d0-c760-49a1-8c6c-372d38786f5e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:20.759842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bf9ef878-5bd5-4ae5-bbf1-0c8230a65c8e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:20.769376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bf9ef878-5bd5-4ae5-bbf1-0c8230a65c8e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:20.775330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bf9ef878-5bd5-4ae5-bbf1-0c8230a65c8e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:20.809361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bf9ef878-5bd5-4ae5-bbf1-0c8230a65c8e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:20.841221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=07a79124-ebb1-420c-a284-314332baa4cd,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:20.880124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-02beb9d0-c760-49a1-8c6c-372d38786f5e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:20.884520 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-02beb9d0-c760-49a1-8c6c-372d38786f5e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/4fc09877-1358-4598-afb6-583f6f6355c0 HTTP/1.1" status: 404 len: 333 time: 0.2049005 May 12 15:45:20.887494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44830) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:20.950504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e4de15ca-6d9a-47d1-8535-a72265f9c929 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:45:20.957980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf9ef878-5bd5-4ae5-bbf1-0c8230a65c8e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:20.971292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f36a6b65-5606-43a3-b488-ebc9c039aaa6 None None] Provisioning for port 674557b5-63cc-40e5-bc60-af4e475b92d6 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:20.973136 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.003193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f36a6b65-5606-43a3-b488-ebc9c039aaa6 None None] Provisioning complete for port 674557b5-63cc-40e5-bc60-af4e475b92d6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:21.003441 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f36a6b65-5606-43a3-b488-ebc9c039aaa6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.036095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-5e7f52da-6e7a-47af-8b9f-151326e41078 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting subnet 11a47c48-9002-4cc8-aa83-79d9ef8e1be3 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:45:21.041052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Transition to ACTIVE for port object e4de15ca-6d9a-47d1-8535-a72265f9c929 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:21.051581 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7f52da-6e7a-47af-8b9f-151326e41078 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.084834 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-c143976f-062c-44da-86b1-3edab8dfb42f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:21.088644 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-c143976f-062c-44da-86b1-3edab8dfb42f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "GET /v2.0/networks?id=81ad07c9-5912-449b-bb49-14d754ee47c0 HTTP/1.1" status: 200 len: 796 time: 0.3308263 May 12 15:45:21.088776 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.166992 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f36a6b65-5606-43a3-b488-ebc9c039aaa6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.253657 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a640bbd7-505b-48b1-b63e-fff871f1bfb7 req-0704670d-27a0-4727-94c4-d4fd5407a2ac tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 210 time: 0.1503723 May 12 15:45:21.335032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 07a79124-ebb1-420c-a284-314332baa4cd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:21.408342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Pushing event updated for resources: {'Port': ['ID=e4de15ca-6d9a-47d1-8535-a72265f9c929,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:21.473689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-4f0b161f-e477-4211-b0cc-0e8674813b7a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b641518781114418963451fc3ff58f4d HTTP/1.1" status: 200 len: 472 time: 0.2965398 May 12 15:45:21.483618 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7f52da-6e7a-47af-8b9f-151326e41078 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.488706 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'port': {'device_id': '66325ace-1cb7-4f16-9e03-a30ac6c4fc01', 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0', 'admin_state_up': True, 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'security_groups': ['e4f60c54-e7d8-4d35-b4f9-38e9a427040b']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:21.493182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f36a6b65-5606-43a3-b488-ebc9c039aaa6 None None] For port 674557b5-63cc-40e5-bc60-af4e475b92d6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=674557b5-63cc-40e5-bc60-af4e475b92d6,segment=NetworkSegment(40a24c29-7ea4-4fc4-b95a-63eec4b86204),segment_id=40a24c29-7ea4-4fc4-b95a-63eec4b86204)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:21.510565 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f36a6b65-5606-43a3-b488-ebc9c039aaa6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.635089 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 07a79124-ebb1-420c-a284-314332baa4cd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:21.635462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.687215 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf9ef878-5bd5-4ae5-bbf1-0c8230a65c8e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.706339 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf9ef878-5bd5-4ae5-bbf1-0c8230a65c8e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.747748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf9ef878-5bd5-4ae5-bbf1-0c8230a65c8e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=257f4aa9-8364-4d44-a978-c57c86c6afc2,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:21.788412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Attempting to bind port e4de15ca-6d9a-47d1-8535-a72265f9c929 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:21.788732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Attempting to bind port e4de15ca-6d9a-47d1-8535-a72265f9c929 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '384c5e83-6775-4f29-a4c7-08c3d60e1de8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:21.789125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Attempting to bind port e4de15ca-6d9a-47d1-8535-a72265f9c929 on network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:21.796388 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Port e4de15ca-6d9a-47d1-8535-a72265f9c929 on network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:45:21.796708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Attempting to bind port e4de15ca-6d9a-47d1-8535-a72265f9c929 on network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:21.801649 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf9ef878-5bd5-4ae5-bbf1-0c8230a65c8e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.802829 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bf9ef878-5bd5-4ae5-bbf1-0c8230a65c8e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 1.0635450 May 12 15:45:21.808262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44852) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:21.815693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:45:21.816528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-3dfcfd9f-a1d9-4060-b817-b382d096029a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '93d6a643-d4d6-485b-81ac-56893147cebc', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:21.831695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:21.832025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Checking segment: {'id': '384c5e83-6775-4f29-a4c7-08c3d60e1de8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:21.832414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Bound using segment: {'id': '384c5e83-6775-4f29-a4c7-08c3d60e1de8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:21.832866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Bound port: e4de15ca-6d9a-47d1-8535-a72265f9c929, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '384c5e83-6775-4f29-a4c7-08c3d60e1de8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:21.833343 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.837118 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b124d98f-fbed-49cf-a06b-f06e8d612b09 None None] Provisioning complete for port 674557b5-63cc-40e5-bc60-af4e475b92d6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:21.837540 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b124d98f-fbed-49cf-a06b-f06e8d612b09 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.851480 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7f52da-6e7a-47af-8b9f-151326e41078 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.873771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:21.884361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3dfcfd9f-a1d9-4060-b817-b382d096029a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:21.885880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:port and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:21.899208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for port was recalculated. Used quota:5. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:21.904396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Sync routers for ids ['bc5f0aa5-db22-4d81-afb5-d90c21590056'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:45:21.908850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44856) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:21.918274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f36a6b65-5606-43a3-b488-ebc9c039aaa6 None None] Pushing event updated for resources: {'Port': ['ID=674557b5-63cc-40e5-bc60-af4e475b92d6,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:21.923076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource port. Total usage: 5; quota limit: 500; headroom:495 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:21.956004 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:21.960164 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8f0de6e4-7098-472f-b967-2e3fa3c1b4e0 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 7.4238088 May 12 15:45:21.966877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89a78345-e39f-46c7-bbf4-41bfcd1400fd req-93f66a64-470b-42b0-b2bc-40ebc80cb496 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:21.975053 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89a78345-e39f-46c7-bbf4-41bfcd1400fd req-93f66a64-470b-42b0-b2bc-40ebc80cb496 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 944 time: 0.1614013 May 12 15:45:21.977492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44862) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:21.980047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Made reservation on behalf of b641518781114418963451fc3ff58f4d for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:21.983907 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:22.016926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Routers {'bc5f0aa5-db22-4d81-afb5-d90c21590056'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:22.017378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bc5f0aa5-db22-4d81-afb5-d90c21590056'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:22.066989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3dfcfd9f-a1d9-4060-b817-b382d096029a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:22.081571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3dfcfd9f-a1d9-4060-b817-b382d096029a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:22.103394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3dfcfd9f-a1d9-4060-b817-b382d096029a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:22.116692 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group': {'name': 'tempest-secgroup--1231851933'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:22.138447 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-3dfcfd9f-a1d9-4060-b817-b382d096029a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Project b88b5989d4c548dba6124f2e4690e5c3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:45:22.159456 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3dfcfd9f-a1d9-4060-b817-b382d096029a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:22.168446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] For port e4de15ca-6d9a-47d1-8535-a72265f9c929, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:22.184294 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7f52da-6e7a-47af-8b9f-151326e41078 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:22.196654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] For port e4de15ca-6d9a-47d1-8535-a72265f9c929, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e4de15ca-6d9a-47d1-8535-a72265f9c929,segment=NetworkSegment(384c5e83-6775-4f29-a4c7-08c3d60e1de8),segment_id=384c5e83-6775-4f29-a4c7-08c3d60e1de8)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:22.209992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:22.231916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:22.241342 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:22.249022 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Set router bc5f0aa5-db22-4d81-afb5-d90c21590056 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:22.276573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:22.282471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e7f52da-6e7a-47af-8b9f-151326e41078 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Subnet': ['ID=11a47c48-9002-4cc8-aa83-79d9ef8e1be3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:22.296411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:22.302866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89a78345-e39f-46c7-bbf4-41bfcd1400fd req-ee603e61-2632-482a-8a38-86a6ee5a7bac tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3268251 May 12 15:45:22.308093 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e7f52da-6e7a-47af-8b9f-151326e41078 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:22.333410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:22.334079 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:22.335458 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] 10.222.0.76 "PUT /v2.0/ports/e4de15ca-6d9a-47d1-8535-a72265f9c929 HTTP/1.1" status: 200 len: 1092 time: 2.8728161 May 12 15:45:22.339214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'tag': 'e4de15ca-6d9a-47d1-8535-a72265f9c929'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:45:22.351616 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5e7f52da-6e7a-47af-8b9f-151326e41078 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/11a47c48-9002-4cc8-aa83-79d9ef8e1be3 HTTP/1.1" status: 204 len: 168 time: 1.4624116 May 12 15:45:22.352424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44870) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:22.392247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb13967a-b8a4-42e5-a163-2c898ccf35ba None None] Network 298268da-bc9b-41cf-8e8d-f9d26aa737fe requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:22.432888 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:22.475571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3dfcfd9f-a1d9-4060-b817-b382d096029a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:22.476255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:22.520119 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d4c9baeb-ae29-4fd4-a507-6749814dbe0e'] response: {'name': 'network-changed', 'server_uuid': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'tag': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'status': 'completed', 'code': 200} May 12 15:45:22.525079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-53f2d26a-fb75-4bf9-95f4-a6efef6dc763 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting subnet 1ddc6003-e8a6-490b-b1fa-cc3e1d8653aa {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:45:22.528980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53f2d26a-fb75-4bf9-95f4-a6efef6dc763 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:22.570822 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d12ec00f-0bb5-49f4-9abf-6d4195af8822 req-165b212b-e116-4602-ac41-7db0da993145 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 210 time: 0.0799253 May 12 15:45:22.621361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1d381bc-c32b-492f-8551-b99d5de20a3e service neutron] Pushing event updated for resources: {'Port': ['ID=e4de15ca-6d9a-47d1-8535-a72265f9c929,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:22.624153 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3dfcfd9f-a1d9-4060-b817-b382d096029a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:22.633324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:22.645149 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53f2d26a-fb75-4bf9-95f4-a6efef6dc763 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:22.695154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:22.707711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:22.716601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dfcfd9f-a1d9-4060-b817-b382d096029a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4bc25037-7d9d-4e93-a7c5-149c3ebaf051,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:22.727003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:22.743540 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3dfcfd9f-a1d9-4060-b817-b382d096029a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:22.745901 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3dfcfd9f-a1d9-4060-b817-b382d096029a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.9364743 May 12 15:45:22.750903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Allocated IP 172.20.0.22 (81ad07c9-5912-449b-bb49-14d754ee47c0/854614c5-2c9e-43c0-8389-330eb4e14250/8160be06-21c8-4d3e-a7d7-af54735fddd1) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:22.753589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44876) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:22.772784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d39a965d-090d-4a22-bdc5-ffcc89351205 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '93d6a643-d4d6-485b-81ac-56893147cebc', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:22.790214 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53f2d26a-fb75-4bf9-95f4-a6efef6dc763 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:22.796285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d39a965d-090d-4a22-bdc5-ffcc89351205 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:22.829940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-ff40ae10-2c3c-4010-bee7-a7b7ca0660b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:22.831448 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-ff40ae10-2c3c-4010-bee7-a7b7ca0660b8 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0528307b42774c45be9eba4ffc91c8dd&device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 1095 time: 0.4040976 May 12 15:45:22.868760 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d39a965d-090d-4a22-bdc5-ffcc89351205 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:22.882447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d39a965d-090d-4a22-bdc5-ffcc89351205 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:22.917503 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-dc76e693-ccb2-464a-b2d5-d2b17e206c04 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e4de15ca-6d9a-47d1-8535-a72265f9c929 HTTP/1.1" status: 200 len: 217 time: 0.0765221 May 12 15:45:22.919523 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d39a965d-090d-4a22-bdc5-ffcc89351205 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:22.965424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'name': 'tempest-TestServerMultinode-1726459329-router', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215'}], 'enable_snat': True}, 'gw_port_id': 'e66a483c-259d-4247-bb93-8082176ad6ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:14Z', 'updated_at': '2022-05-12T15:45:18Z', 'revision_number': 3, 'project_id': '5b43e848e2af491a8dc509c668c33e91', 'gw_port': {'id': 'e66a483c-259d-4247-bb93-8082176ad6ed', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:f0:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3633, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:17Z', 'updated_at': '2022-05-12T15:45:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:22.971312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Checking router: bc5f0aa5-db22-4d81-afb5-d90c21590056 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:45:22.971312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Updating router bc5f0aa5-db22-4d81-afb5-d90c21590056 port e66a483c-259d-4247-bb93-8082176ad6ed binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:45:22.999989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-896b0c11-d701-4315-a54c-7d2fc0f87b3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:23.001869 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-896b0c11-d701-4315-a54c-7d2fc0f87b3c service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5b4ef35a-b116-4246-86c9-ff3a7aad3410 HTTP/1.1" status: 200 len: 852 time: 0.0764050 May 12 15:45:23.006132 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53f2d26a-fb75-4bf9-95f4-a6efef6dc763 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.027026 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.065219 n-d-841483-1 neutron-server[88152]: INFO neutron.db.securitygroups_db [None req-d39a965d-090d-4a22-bdc5-ffcc89351205 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Project b88b5989d4c548dba6124f2e4690e5c3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:45:23.087554 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53f2d26a-fb75-4bf9-95f4-a6efef6dc763 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Subnet': ['ID=1ddc6003-e8a6-490b-b1fa-cc3e1d8653aa,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:23.098495 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-53f2d26a-fb75-4bf9-95f4-a6efef6dc763 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.118917 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-53f2d26a-fb75-4bf9-95f4-a6efef6dc763 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/1ddc6003-e8a6-490b-b1fa-cc3e1d8653aa HTTP/1.1" status: 204 len: 168 time: 0.7607918 May 12 15:45:23.119714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44880) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:23.145547 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d39a965d-090d-4a22-bdc5-ffcc89351205 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.242719 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 674557b5-63cc-40e5-bc60-af4e475b92d6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:23.296171 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.321735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 91429dee-a49d-4027-9b60-0403c1a100ce {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:45:23.322237 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.337530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 674557b5-63cc-40e5-bc60-af4e475b92d6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:23.337901 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.367483 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d39a965d-090d-4a22-bdc5-ffcc89351205 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.388877 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d39a965d-090d-4a22-bdc5-ffcc89351205 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.390382 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-bfecddaa-b0e4-4d41-9eb6-f4bb30c7a2c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:23.394013 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-bfecddaa-b0e4-4d41-9eb6-f4bb30c7a2c0 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3824072 May 12 15:45:23.406212 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.444569 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.471170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:23.520206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d39a965d-090d-4a22-bdc5-ffcc89351205 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=342de2c4-5130-4dce-a54d-194975beb097,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:23.523871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:23.577771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:23.584469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:23.681695 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-41189e6c-a041-4ea0-a4ff-368ee4463c11 service neutron] 10.222.0.76 "GET /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2820690 May 12 15:45:23.741878 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.755852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Transition to ACTIVE for port object e66a483c-259d-4247-bb93-8082176ad6ed will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:23.765110 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.837854 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.892920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9cf79623-aab0-463e-8cbc-ace80a7beaa0 None None] Network 298268da-bc9b-41cf-8e8d-f9d26aa737fe requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:23.898838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b23bb660-53e3-4c89-9447-bb3475e7fd7e req-64c4737c-d730-4abd-88b9-b6fa9971876a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:23.906156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] For port 91429dee-a49d-4027-9b60-0403c1a100ce, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=91429dee-a49d-4027-9b60-0403c1a100ce,segment=NetworkSegment(c8e3bb58-c87d-48f2-bd31-1c6f6f6becec),segment_id=c8e3bb58-c87d-48f2-bd31-1c6f6f6becec)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:23.906698 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.913658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b0726698-413e-4250-afae-ccaa4317da40,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:23.916454 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d39a965d-090d-4a22-bdc5-ffcc89351205 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:23.917675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d39a965d-090d-4a22-bdc5-ffcc89351205 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 1.1630597 May 12 15:45:23.927976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44888) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:23.939706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'network': {'name': 'tempest-network-smoke--943747126', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'port_security_enabled': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:23.946421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:23.952486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:network and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:23.967184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Transition to ACTIVE for port object 8160be06-21c8-4d3e-a7d7-af54735fddd1 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:23.970529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-b23bb660-53e3-4c89-9447-bb3475e7fd7e req-64c4737c-d730-4abd-88b9-b6fa9971876a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:23.971677 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b23bb660-53e3-4c89-9447-bb3475e7fd7e req-64c4737c-d730-4abd-88b9-b6fa9971876a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 210 time: 0.1538022 May 12 15:45:23.977485 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.006855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Attempting to bind port e66a483c-259d-4247-bb93-8082176ad6ed on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:24.007484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Attempting to bind port e66a483c-259d-4247-bb93-8082176ad6ed by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:24.007614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Attempting to bind port e66a483c-259d-4247-bb93-8082176ad6ed on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:24.016492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:24.017171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:24.017574 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:24.017973 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.018370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:24.018831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Bound port: e66a483c-259d-4247-bb93-8082176ad6ed, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:24.019196 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.071526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3efedb68-148d-42e3-8846-27d9eac370c3 None None] Pushing event updated for resources: {'Port': ['ID=e66a483c-259d-4247-bb93-8082176ad6ed,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:24.125955 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.140221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a2ed7742-85d9-4352-935b-8ccde4da3913 None None] Provisioning complete for port 91429dee-a49d-4027-9b60-0403c1a100ce triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:24.140221 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a2ed7742-85d9-4352-935b-8ccde4da3913 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.140547 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.165643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d64794b-8ce8-47ce-b6eb-21d7157288fe req-d5d907f8-8ba0-4171-85c8-da51488a63fc tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:24.173157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d64794b-8ce8-47ce-b6eb-21d7157288fe req-d5d907f8-8ba0-4171-85c8-da51488a63fc tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 944 time: 0.6417186 May 12 15:45:24.222687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 91429dee-a49d-4027-9b60-0403c1a100ce owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:45:24.249603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:24.264274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] For port e66a483c-259d-4247-bb93-8082176ad6ed, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:24.276739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] For port e66a483c-259d-4247-bb93-8082176ad6ed, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e66a483c-259d-4247-bb93-8082176ad6ed,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:24.307956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Made reservation on behalf of b88b5989d4c548dba6124f2e4690e5c3 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:24.311480 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.329928 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.365029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1ae268af-0e4b-4c15-b8df-d4430fbd084e req-6f8bc7d0-5bab-4382-b6c7-a3ea2a7c9ebd service neutron] 10.222.0.76 "GET /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6431057 May 12 15:45:24.365296 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.380919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 562} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:45:24.384294 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.438442 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Routers {'bc5f0aa5-db22-4d81-afb5-d90c21590056'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:24.439063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bc5f0aa5-db22-4d81-afb5-d90c21590056'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:24.443150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Allocated IP 172.20.0.1 (efb0a87e-f691-44d4-91fd-6973427a3bed/a02117db-ebdf-49e4-8844-4ca414de801d/edccd307-5544-482d-92bc-4a31eeb6ca92) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:24.466723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=91429dee-a49d-4027-9b60-0403c1a100ce,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:24.468750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No DVR routers for this DVR port 91429dee-a49d-4027-9b60-0403c1a100ce on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:45:24.501833 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0633b2bb-e426-413b-87c6-fa493c821ae3 None None] DHCP port deletion for 298268da-bc9b-41cf-8e8d-f9d26aa737fe request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:45:24.503553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3efedb68-148d-42e3-8846-27d9eac370c3 None None] Pushing event updated for resources: {'Port': ['ID=e66a483c-259d-4247-bb93-8082176ad6ed,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:24.548879 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.549349 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Added segment cf19c71b-ab00-459e-982f-b233b38347af of type vlan for network 96b03b8b-8b48-4742-a456-9d456e030e73 May 12 15:45:24.636924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9a9ed075-ff76-4434-bb52-143550997b5f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:24.652997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] Set router bc5f0aa5-db22-4d81-afb5-d90c21590056 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:24.660484 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.663655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bd9f8ebf-90f2-4f7f-a25f-5a5751aa16ff tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 2.7449851 May 12 15:45:24.670937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44892) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:24.678310 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.682777 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.705605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d64794b-8ce8-47ce-b6eb-21d7157288fe req-fd44e461-5487-4c6b-81ae-3e269ea9225b tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5314038 May 12 15:45:24.712431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 81ad07c9-5912-449b-bb49-14d754ee47c0 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:24.728340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:24.736087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:24.751995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['298268da-bc9b-41cf-8e8d-f9d26aa737fe']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:24.773535 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.786559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=8160be06-21c8-4d3e-a7d7-af54735fddd1,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:24.794367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c8e3bb58-c87d-48f2-bd31-1c6f6f6becec') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:24.794367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c8e3bb58-c87d-48f2-bd31-1c6f6f6becec') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:24.815108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.819171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Transition to ACTIVE for port object edccd307-5544-482d-92bc-4a31eeb6ca92 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:24.838185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:24.838817 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.850071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c1ce883-b2fe-4882-bd2f-f0c2b7561939 req-ae8ee77d-2bb7-4c8d-b706-d7fe40b61d5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:24.851633 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c1ce883-b2fe-4882-bd2f-f0c2b7561939 req-ae8ee77d-2bb7-4c8d-b706-d7fe40b61d5d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0528307b42774c45be9eba4ffc91c8dd&device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 1095 time: 0.3871300 May 12 15:45:24.864828 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-a6472b5f-dbd3-4ccf-9c8f-2fb57e308338 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.3811688 May 12 15:45:24.882929 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.885122 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.888660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:24.889556 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.895206 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:24.941937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Request body: {'port': {'device_id': '66325ace-1cb7-4f16-9e03-a30ac6c4fc01', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:25.002502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'name': 'tempest-TestServerMultinode-1726459329-router', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215'}], 'enable_snat': True}, 'gw_port_id': 'e66a483c-259d-4247-bb93-8082176ad6ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:14Z', 'updated_at': '2022-05-12T15:45:18Z', 'revision_number': 3, 'project_id': '5b43e848e2af491a8dc509c668c33e91', 'gw_port': {'id': 'e66a483c-259d-4247-bb93-8082176ad6ed', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:f0:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3633, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:17Z', 'updated_at': '2022-05-12T15:45:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:25.008674 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd06b592-f0c2-4538-b8d2-41eaed409b58 None None] The sync data for ids ['bc5f0aa5-db22-4d81-afb5-d90c21590056'] in n-d-841483-1 is: [{'id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'name': 'tempest-TestServerMultinode-1726459329-router', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215'}], 'enable_snat': True}, 'gw_port_id': 'e66a483c-259d-4247-bb93-8082176ad6ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:14Z', 'updated_at': '2022-05-12T15:45:18Z', 'revision_number': 3, 'project_id': '5b43e848e2af491a8dc509c668c33e91', 'gw_port': {'id': 'e66a483c-259d-4247-bb93-8082176ad6ed', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:f0:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3633, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:17Z', 'updated_at': '2022-05-12T15:45:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:45:25.038125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Network efb0a87e-f691-44d4-91fd-6973427a3bed is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:25.043058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:25.055416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:25.090554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Pushing event updated for resources: {'Port': ['ID=edccd307-5544-482d-92bc-4a31eeb6ca92,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:25.104908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Releasing vlan 587 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:45:25.105452 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: timer() May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:45:25.158028 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:45:25.167162 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ee4c140c-3e8c-4439-81f2-bd408fccebab tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4511 time: 0.4923584 May 12 15:45:25.186570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d6bd6fca-3419-439e-bfae-ced70d9535bf None None] Provisioning for port 8160be06-21c8-4d3e-a7d7-af54735fddd1 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:25.193651 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d6bd6fca-3419-439e-bfae-ced70d9535bf None None] Provisioning complete for port 8160be06-21c8-4d3e-a7d7-af54735fddd1 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:25.194166 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d6bd6fca-3419-439e-bfae-ced70d9535bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:25.214576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44902) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:25.292805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 91429dee-a49d-4027-9b60-0403c1a100ce no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:45:25.303102 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 1.3718565 May 12 15:45:25.310238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-468b38f2-fac5-4d45-a3e7-95e60f60a47c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group': {'name': 'tempest-security--403690205', 'description': 'tempest-security-description-1310364407'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:25.318906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44906) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:25.351746 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:25.356040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 91429dee-a49d-4027-9b60-0403c1a100ce {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:45:25.356437 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 91429dee-a49d-4027-9b60-0403c1a100ce not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:45:25.356644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'admin_state_up': True, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:25.364639 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:25.373865 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d6bd6fca-3419-439e-bfae-ced70d9535bf None None] Port 8160be06-21c8-4d3e-a7d7-af54735fddd1 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:25.376518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd582e88-1751-4c13-afe4-f02026ad8144 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Network': ['ID=96b03b8b-8b48-4742-a456-9d456e030e73,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:25.382608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:25.390653 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 96b03b8b-8b48-4742-a456-9d456e030e73 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:45:25.399037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:router and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:25.418069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:25.435566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:25.437701 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:25.453946 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-468b38f2-fac5-4d45-a3e7-95e60f60a47c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:25.486552 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:25.513563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c1ce883-b2fe-4882-bd2f-f0c2b7561939 req-e09893f0-8c12-4b98-971c-93d608ab2496 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:25.515036 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c1ce883-b2fe-4882-bd2f-f0c2b7561939 req-e09893f0-8c12-4b98-971c-93d608ab2496 service neutron] 10.222.0.76 "GET /v2.0/networks?id=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade HTTP/1.1" status: 200 len: 914 time: 0.6563921 May 12 15:45:25.534605 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/networks/298268da-bc9b-41cf-8e8d-f9d26aa737fe HTTP/1.1" status: 204 len: 168 time: 2.4136977 May 12 15:45:25.535698 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:25.536750 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:25.554396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44910) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:25.575938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cb12dea0-d46d-4708-a4ab-f5e8645abec4 None None] Provisioning for port edccd307-5544-482d-92bc-4a31eeb6ca92 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:25.584001 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cb12dea0-d46d-4708-a4ab-f5e8645abec4 None None] Provisioning complete for port edccd307-5544-482d-92bc-4a31eeb6ca92 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:25.584903 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cb12dea0-d46d-4708-a4ab-f5e8645abec4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:25.597351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6d37a15-5f3b-4b58-8d45-59e5c10bbcc3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Network': ['ID=298268da-bc9b-41cf-8e8d-f9d26aa737fe,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:25.627819 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c1ce883-b2fe-4882-bd2f-f0c2b7561939 req-05fe433d-f3f2-48d3-bf38-d95b4a4c83c4 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e4de15ca-6d9a-47d1-8535-a72265f9c929 HTTP/1.1" status: 200 len: 217 time: 0.0996490 May 12 15:45:25.661179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-cb12dea0-d46d-4708-a4ab-f5e8645abec4 None None] Port edccd307-5544-482d-92bc-4a31eeb6ca92 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:25.689779 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-468b38f2-fac5-4d45-a3e7-95e60f60a47c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:25.702341 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-468b38f2-fac5-4d45-a3e7-95e60f60a47c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:25.721318 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:25.738922 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-468b38f2-fac5-4d45-a3e7-95e60f60a47c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:25.740343 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-468b38f2-fac5-4d45-a3e7-95e60f60a47c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "PUT /v2.0/security-groups/9a9ed075-ff76-4434-bb52-143550997b5f HTTP/1.1" status: 200 len: 1779 time: 0.5245798 May 12 15:45:25.747536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44916) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:25.791292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c1ce883-b2fe-4882-bd2f-f0c2b7561939 req-0f2b033f-93fe-463c-ab7b-7da215a6e590 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:25.792747 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c1ce883-b2fe-4882-bd2f-f0c2b7561939 req-0f2b033f-93fe-463c-ab7b-7da215a6e590 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5b4ef35a-b116-4246-86c9-ff3a7aad3410 HTTP/1.1" status: 200 len: 852 time: 0.1582434 May 12 15:45:25.794607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9cfd4f8-e38f-49c8-b268-9ff68259b56d req-e3bc118f-cfd8-4768-90d9-f9d44314a053 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:25.796671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-468b38f2-fac5-4d45-a3e7-95e60f60a47c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9a9ed075-ff76-4434-bb52-143550997b5f,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:25.803886 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9cfd4f8-e38f-49c8-b268-9ff68259b56d req-e3bc118f-cfd8-4768-90d9-f9d44314a053 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 932 time: 0.6580737 May 12 15:45:25.998918 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1823e5d8-45cb-4052-934e-f023bf7984c9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-groups/9a9ed075-ff76-4434-bb52-143550997b5f HTTP/1.1" status: 200 len: 1779 time: 0.2415369 May 12 15:45:26.008508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44920) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:26.111187 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9cfd4f8-e38f-49c8-b268-9ff68259b56d req-fbac3019-297f-4686-9df4-a50892f7559f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3063812 May 12 15:45:26.207673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2bcf17ce-0ef9-45a5-9529-ebd8a4d531a2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:26.208392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2bcf17ce-0ef9-45a5-9529-ebd8a4d531a2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:26.324043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2bcf17ce-0ef9-45a5-9529-ebd8a4d531a2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:26.329749 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2bcf17ce-0ef9-45a5-9529-ebd8a4d531a2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.7405424 May 12 15:45:26.329749 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:26.334463 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:26.337998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44924) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:26.386147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37296e24-8ade-408a-a591-cc7b3c340eeb req-2174cecb-7a81-4626-8174-d9592bf63320 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:26.387673 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37296e24-8ade-408a-a591-cc7b3c340eeb req-2174cecb-7a81-4626-8174-d9592bf63320 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 944 time: 0.3700764 May 12 15:45:26.447753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1e8df839-8714-43cc-b49d-e18b07fb6be6 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:26.450853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c1ce883-b2fe-4882-bd2f-f0c2b7561939 req-a5c745e6-295a-4de5-8a20-d18e9863a4a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:26.452261 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c1ce883-b2fe-4882-bd2f-f0c2b7561939 req-a5c745e6-295a-4de5-8a20-d18e9863a4a8 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.6451068 May 12 15:45:26.586814 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37296e24-8ade-408a-a591-cc7b3c340eeb req-f31e1434-15c8-43b1-b9dd-00e010429b25 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1926911 May 12 15:45:26.597312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8160be06-21c8-4d3e-a7d7-af54735fddd1 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:45:26.607907 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:26.630103 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1e8df839-8714-43cc-b49d-e18b07fb6be6 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:26.640216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Transition to ACTIVE for port object 8160be06-21c8-4d3e-a7d7-af54735fddd1 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:26.648041 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:26.712256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2d50184e-272b-4f5d-98ff-ee51c5ce2ce4 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:26.753104 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c1ce883-b2fe-4882-bd2f-f0c2b7561939 req-55ae9961-256a-4ebe-911f-23feeb2b21c1 service neutron] 10.222.0.76 "GET /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2487283 May 12 15:45:26.767493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2d50184e-272b-4f5d-98ff-ee51c5ce2ce4 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:26.772207 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2d50184e-272b-4f5d-98ff-ee51c5ce2ce4 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.4275718 May 12 15:45:26.781607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44928) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:26.803351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1e8df839-8714-43cc-b49d-e18b07fb6be6 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:26.803553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-436754281'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:26.816022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:26.818214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Pushing event updated for resources: {'Port': ['ID=8160be06-21c8-4d3e-a7d7-af54735fddd1,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:26.825282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:network and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:26.829201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:26.861520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:26.904606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e8df839-8714-43cc-b49d-e18b07fb6be6 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a9ed075-ff76-4434-bb52-143550997b5f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:26.925601 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:26.932871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:26.936419 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:26.948332 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:26.951643 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1e8df839-8714-43cc-b49d-e18b07fb6be6 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:26.955312 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1e8df839-8714-43cc-b49d-e18b07fb6be6 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-groups/9a9ed075-ff76-4434-bb52-143550997b5f HTTP/1.1" status: 204 len: 168 time: 0.9435444 May 12 15:45:26.957581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44932) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:27.067401 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c1ce883-b2fe-4882-bd2f-f0c2b7561939 req-53b1b8cc-8939-4500-8e7a-ca99a8e93538 service neutron] 10.222.0.76 "GET /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3039923 May 12 15:45:27.088902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 561} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:45:27.102721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Attempting to bind port 8160be06-21c8-4d3e-a7d7-af54735fddd1 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:27.103045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Attempting to bind port 8160be06-21c8-4d3e-a7d7-af54735fddd1 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '41769506-c6e2-4d6c-a537-2d71e8a5e3f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:27.103362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Attempting to bind port 8160be06-21c8-4d3e-a7d7-af54735fddd1 on network 81ad07c9-5912-449b-bb49-14d754ee47c0 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:27.108133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Pushing event updated for resources: {'Port': ['ID=edccd307-5544-482d-92bc-4a31eeb6ca92,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:27.116586 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.117241 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Added segment 8703f0d6-3caf-42ba-b224-cb230a4dfa42 of type vlan for network c7f68380-c906-474f-8407-2e4714dc6877 May 12 15:45:27.118135 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.128799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Port 8160be06-21c8-4d3e-a7d7-af54735fddd1 on network 81ad07c9-5912-449b-bb49-14d754ee47c0 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:45:27.129044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Attempting to bind port 8160be06-21c8-4d3e-a7d7-af54735fddd1 on network 81ad07c9-5912-449b-bb49-14d754ee47c0 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:27.157168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:27.157516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Checking segment: {'id': '41769506-c6e2-4d6c-a537-2d71e8a5e3f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:27.157948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Bound using segment: {'id': '41769506-c6e2-4d6c-a537-2d71e8a5e3f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:27.158384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Bound port: 8160be06-21c8-4d3e-a7d7-af54735fddd1, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '41769506-c6e2-4d6c-a537-2d71e8a5e3f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:27.158720 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.242585 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.248280 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e66a483c-259d-4247-bb93-8082176ad6ed up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:27.261268 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.316477 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.352578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port e66a483c-259d-4247-bb93-8082176ad6ed completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:27.357724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port e66a483c-259d-4247-bb93-8082176ad6ed triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:27.358087 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.364858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-13c7daed-ecbd-492d-af55-808bb86b98a5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:27.414780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-13c7daed-ecbd-492d-af55-808bb86b98a5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:27.416449 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-13c7daed-ecbd-492d-af55-808bb86b98a5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.4571154 May 12 15:45:27.419900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44938) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:27.442962 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.448234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:27.448811 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.479325 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-8384f467-fd3e-43e9-bf42-e43d3270dcb7 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] delete failed (client error): The resource could not be found. May 12 15:45:27.484738 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8384f467-fd3e-43e9-bf42-e43d3270dcb7 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-groups/9a9ed075-ff76-4434-bb52-143550997b5f HTTP/1.1" status: 404 len: 347 time: 0.0593166 May 12 15:45:27.484738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44942) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:27.491829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4065a616-5a43-4038-9652-1dde8bb57c20 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group': {'name': 'tempest-secgroup--633700495'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:27.508433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4065a616-5a43-4038-9652-1dde8bb57c20 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:27.522280 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.529107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4065a616-5a43-4038-9652-1dde8bb57c20 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:27.539517 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port e66a483c-259d-4247-bb93-8082176ad6ed, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e66a483c-259d-4247-bb93-8082176ad6ed,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:27.540287 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.25.8.143 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/5e065dc4-c922-4e2a-8f89-cf23d6684d63) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:27.544385 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.584017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] For port 8160be06-21c8-4d3e-a7d7-af54735fddd1, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:27.605911 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.8215170 May 12 15:45:27.606709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44946) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:27.628945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Network efb0a87e-f691-44d4-91fd-6973427a3bed is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:27.631430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=e66a483c-259d-4247-bb93-8082176ad6ed,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:27.643094 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4065a616-5a43-4038-9652-1dde8bb57c20 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.646621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': 'c7f68380-c906-474f-8407-2e4714dc6877', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:27.665581 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:27.675157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] For port 8160be06-21c8-4d3e-a7d7-af54735fddd1, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8160be06-21c8-4d3e-a7d7-af54735fddd1,segment=NetworkSegment(41769506-c6e2-4d6c-a537-2d71e8a5e3f7),segment_id=41769506-c6e2-4d6c-a537-2d71e8a5e3f7)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:27.685061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4c2b9d8-16b5-432b-b3b4-25c26f276116 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Network': ['ID=c7f68380-c906-474f-8407-2e4714dc6877,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:27.691118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4065a616-5a43-4038-9652-1dde8bb57c20 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:27.695418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99e1d06a-63f0-4356-b511-40c91abc0d0f req-b3a408e9-a0f0-4759-9211-d25b538d7d24 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:27.697220 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99e1d06a-63f0-4356-b511-40c91abc0d0f req-b3a408e9-a0f0-4759-9211-d25b538d7d24 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 944 time: 0.4073811 May 12 15:45:27.698930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4065a616-5a43-4038-9652-1dde8bb57c20 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:27.701506 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network c7f68380-c906-474f-8407-2e4714dc6877 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:45:27.704704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4065a616-5a43-4038-9652-1dde8bb57c20 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:27.722993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4065a616-5a43-4038-9652-1dde8bb57c20 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:27.753622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.841941 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4065a616-5a43-4038-9652-1dde8bb57c20 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.848701 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4065a616-5a43-4038-9652-1dde8bb57c20 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.871443 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:27.956333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4065a616-5a43-4038-9652-1dde8bb57c20 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b1c61b78-18cc-453a-b8aa-53af3f9c6216,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:27.981205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:27.987098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:27.994923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:28.034827 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:28.046305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-969df73d-af2c-409c-872e-9e40742c9947 None None] Provisioning complete for port edccd307-5544-482d-92bc-4a31eeb6ca92 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:28.047015 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-969df73d-af2c-409c-872e-9e40742c9947 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:28.049080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=5e065dc4-c922-4e2a-8f89-cf23d6684d63,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:28.051922 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4065a616-5a43-4038-9652-1dde8bb57c20 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:28.053102 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4065a616-5a43-4038-9652-1dde8bb57c20 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 0.5669842 May 12 15:45:28.056036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44952) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:28.063291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-344ac58c-0355-4e07-b764-97cc4d17ae73 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group_rule': {'security_group_id': 'b1c61b78-18cc-453a-b8aa-53af3f9c6216', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:28.073338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-344ac58c-0355-4e07-b764-97cc4d17ae73 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:28.080736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-344ac58c-0355-4e07-b764-97cc4d17ae73 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:28.085583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-344ac58c-0355-4e07-b764-97cc4d17ae73 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:28.114189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-969df73d-af2c-409c-872e-9e40742c9947 None None] Port edccd307-5544-482d-92bc-4a31eeb6ca92 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:28.183895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:28.184845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:28.187373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] 10.222.0.84 "PUT /v2.0/ports/8160be06-21c8-4d3e-a7d7-af54735fddd1 HTTP/1.1" status: 200 len: 1092 time: 3.2961864 May 12 15:45:28.196319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '66325ace-1cb7-4f16-9e03-a30ac6c4fc01', 'tag': '8160be06-21c8-4d3e-a7d7-af54735fddd1'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:45:28.220038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99e1d06a-63f0-4356-b511-40c91abc0d0f req-afe0133d-be5e-4eac-a9a3-1babb3e42412 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4482298 May 12 15:45:28.333057 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-219f1dab-f44f-4f46-af5d-e0b0c0798269'] response: {'name': 'network-changed', 'server_uuid': '66325ace-1cb7-4f16-9e03-a30ac6c4fc01', 'tag': '8160be06-21c8-4d3e-a7d7-af54735fddd1', 'status': 'completed', 'code': 200} May 12 15:45:28.355668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-344ac58c-0355-4e07-b764-97cc4d17ae73 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:28.370379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:28.373696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ae68821-a83d-4d08-ba56-a58f5ddec75e service neutron] Pushing event updated for resources: {'Port': ['ID=8160be06-21c8-4d3e-a7d7-af54735fddd1,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:28.384282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:28.391386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:28.404794 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:28.447497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c277c87c-7e94-4acc-8848-29d64b1c309b req-e81506a5-6d4b-4b4a-b2e7-84b295716dc4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:28.448974 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c277c87c-7e94-4acc-8848-29d64b1c309b req-e81506a5-6d4b-4b4a-b2e7-84b295716dc4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 944 time: 0.6603732 May 12 15:45:28.453206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:28.456919 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:28.476769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Router bc5f0aa5-db22-4d81-afb5-d90c21590056 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:45:28.479266 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-344ac58c-0355-4e07-b764-97cc4d17ae73 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:28.624786 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-344ac58c-0355-4e07-b764-97cc4d17ae73 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:28.638337 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-344ac58c-0355-4e07-b764-97cc4d17ae73 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:28.684772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-9007cb41-4692-4e78-98df-837baeca1197 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:28.686272 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-9007cb41-4692-4e78-98df-837baeca1197 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 1095 time: 0.3908303 May 12 15:45:28.689728 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c277c87c-7e94-4acc-8848-29d64b1c309b req-00e12beb-796b-406c-8fdd-ea76c039b148 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2186701 May 12 15:45:28.738715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-344ac58c-0355-4e07-b764-97cc4d17ae73 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fd4e6419-fd1c-4cd6-9145-0a320d50632e,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:28.749520 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-344ac58c-0355-4e07-b764-97cc4d17ae73 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:28.751470 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-344ac58c-0355-4e07-b764-97cc4d17ae73 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6945262 May 12 15:45:28.755192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44960) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:28.776120 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:28.788246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-e48d92f6-9052-45c4-997d-adc168e1dd67 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.22&port_id=8160be06-21c8-4d3e-a7d7-af54735fddd1 HTTP/1.1" status: 200 len: 217 time: 0.0830166 May 12 15:45:28.866496 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d04e1f6f-d748-4ddc-8a84-6a22a8c237c8 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:28.880365 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d04e1f6f-d748-4ddc-8a84-6a22a8c237c8 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:28.992129 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d04e1f6f-d748-4ddc-8a84-6a22a8c237c8 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:28.999308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:45:29.002386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-d7dd093a-9845-46f0-ae9a-92a329a38784 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:29.003976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-d7dd093a-9845-46f0-ae9a-92a329a38784 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=854614c5-2c9e-43c0-8389-330eb4e14250 HTTP/1.1" status: 200 len: 838 time: 0.1567748 May 12 15:45:29.008651 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Sync routers for ids ['bc5f0aa5-db22-4d81-afb5-d90c21590056'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:45:29.018801 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Routers {'bc5f0aa5-db22-4d81-afb5-d90c21590056'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:29.019717 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bc5f0aa5-db22-4d81-afb5-d90c21590056'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:29.022072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bafcb5c9-062a-40f3-bea7-9f5f9f382ae7 admin admin] 10.222.0.82 "PUT /v2.0/routers/bc5f0aa5-db22-4d81-afb5-d90c21590056/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.0432491 May 12 15:45:29.074848 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d04e1f6f-d748-4ddc-8a84-6a22a8c237c8 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=fd4e6419-fd1c-4cd6-9145-0a320d50632e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:29.126387 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:29.147482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d04e1f6f-d748-4ddc-8a84-6a22a8c237c8 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:29.151034 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d04e1f6f-d748-4ddc-8a84-6a22a8c237c8 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/fd4e6419-fd1c-4cd6-9145-0a320d50632e HTTP/1.1" status: 204 len: 168 time: 0.3926136 May 12 15:45:29.165533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 44966) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:29.248748 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e66a483c-259d-4247-bb93-8082176ad6ed up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:29.254294 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Set router bc5f0aa5-db22-4d81-afb5-d90c21590056 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:29.263084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Subnet': ['ID=33e1eac5-5903-4f22-b0b5-1f09b44ea529,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:29.272468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Checking segment: {'id': '8703f0d6-3caf-42ba-b224-cb230a4dfa42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'c7f68380-c906-474f-8407-2e4714dc6877'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:29.272899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network hostable DHCP agents. Network: c7f68380-c906-474f-8407-2e4714dc6877, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:45:29.291592 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-28e38095-11e5-4e21-acb5-dd2accc4f05b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:29.293225 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-28e38095-11e5-4e21-acb5-dd2accc4f05b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=81ad07c9-5912-449b-bb49-14d754ee47c0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2248712 May 12 15:45:29.364091 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network c7f68380-c906-474f-8407-2e4714dc6877 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:45:29.367909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1edf2651-1426-4691-ba34-2fca19aa03d4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:29.402373 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:29.430955 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c144f08-6cc2-453e-bac5-c0c19bc7ede9 req-d53daee6-cc7a-4603-a62a-e89e38bd13a6 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.3573139 May 12 15:45:29.443935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port e66a483c-259d-4247-bb93-8082176ad6ed triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:29.444307 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:29.545999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1edf2651-1426-4691-ba34-2fca19aa03d4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:29.551188 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1edf2651-1426-4691-ba34-2fca19aa03d4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.3819149 May 12 15:45:29.603990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44980) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:29.642410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, c7f68380-c906-474f-8407-2e4714dc6877) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:29.647117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:29.647690 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:29.658487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b6c08af-68a7-462b-86de-19afad2fc84c None None] Network c7f68380-c906-474f-8407-2e4714dc6877 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:29.760785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1127d95d-208f-403a-b652-f469319d5b62 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.1284835 May 12 15:45:29.768572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 44986) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:29.782983 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-00c7c251-7be4-41c6-bc18-411b78021188 service neutron] 10.222.0.84 "GET /v2.0/networks/81ad07c9-5912-449b-bb49-14d754ee47c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4780462 May 12 15:45:29.794178 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'network_id': 'c7f68380-c906-474f-8407-2e4714dc6877', 'name': 'tempest-PortsIpV6TestJSON-1507266235'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:29.816640 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'name': 'tempest-TestServerMultinode-1726459329-router', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215'}], 'enable_snat': True}, 'gw_port_id': 'e66a483c-259d-4247-bb93-8082176ad6ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:14Z', 'updated_at': '2022-05-12T15:45:26Z', 'revision_number': 4, 'project_id': '5b43e848e2af491a8dc509c668c33e91', 'gw_port': {'id': 'e66a483c-259d-4247-bb93-8082176ad6ed', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:f0:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3633, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:17Z', 'updated_at': '2022-05-12T15:45:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'edccd307-5544-482d-92bc-4a31eeb6ca92', 'name': '', 'network_id': 'efb0a87e-f691-44d4-91fd-6973427a3bed', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'mac_address': 'fa:16:3e:ad:78:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'device_owner': 'network:router_interface', 'standard_attr_id': 3648, 'fixed_ips': [{'subnet_id': 'a02117db-ebdf-49e4-8844-4ca414de801d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:24Z', 'updated_at': '2022-05-12T15:45:26Z', 'revision_number': 2, 'project_id': '5b43e848e2af491a8dc509c668c33e91', 'subnets': [{'id': 'a02117db-ebdf-49e4-8844-4ca414de801d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:29.825835 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Checking router: bc5f0aa5-db22-4d81-afb5-d90c21590056 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:45:29.827099 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Updating router bc5f0aa5-db22-4d81-afb5-d90c21590056 port edccd307-5544-482d-92bc-4a31eeb6ca92 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:45:29.851434 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d0997c8-d3a9-4520-94c8-6d8289771441 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:29.920072 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:29.924245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c144f08-6cc2-453e-bac5-c0c19bc7ede9 req-6095d647-c1d8-4e4a-b8b5-62dbe492dc5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:29.925863 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c144f08-6cc2-453e-bac5-c0c19bc7ede9 req-6095d647-c1d8-4e4a-b8b5-62dbe492dc5f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 1096 time: 0.1769972 May 12 15:45:29.960962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-c7f68380-c906-474f-8407-2e4714dc6877', 'network_id': 'c7f68380-c906-474f-8407-2e4714dc6877', 'tenant_id': '1da2b935bcd34292b3e8ce00cc114001', 'fixed_ips': [{'subnet_id': '33e1eac5-5903-4f22-b0b5-1f09b44ea529'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:45:29.962809 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:30.089600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:45:30.174240 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Allocated IP 2001:db8::2 (c7f68380-c906-474f-8407-2e4714dc6877/33e1eac5-5903-4f22-b0b5-1f09b44ea529/0c976339-72c0-495d-b226-0555efa998ac) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:30.176808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c3c4db-c674-4b50-8775-7be62b36cfa5 req-eea1e898-3444-439c-b589-814ba9999472 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:30.178411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83c3c4db-c674-4b50-8775-7be62b36cfa5 req-eea1e898-3444-439c-b589-814ba9999472 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 944 time: 0.6792302 May 12 15:45:30.209752 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d0997c8-d3a9-4520-94c8-6d8289771441 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:30.369493 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:30.382643 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Transition to ACTIVE for port object edccd307-5544-482d-92bc-4a31eeb6ca92 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:30.391345 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:30.454992 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:30.472165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cba2ecde-2ffc-4e11-bebb-11a38b79050c req-437adc97-c5a0-4da3-881f-e62385b9be6f service neutron] 10.222.0.84 "GET /v2.0/networks/81ad07c9-5912-449b-bb49-14d754ee47c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6627505 May 12 15:45:30.475102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-83c3c4db-c674-4b50-8775-7be62b36cfa5 req-493b2d94-9bd0-4af0-b007-1419d6deb4c7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2801898 May 12 15:45:30.488261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:30.493197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c144f08-6cc2-453e-bac5-c0c19bc7ede9 req-8394a128-2764-408e-b9fe-91839abcf3f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:30.494682 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c144f08-6cc2-453e-bac5-c0c19bc7ede9 req-8394a128-2764-408e-b9fe-91839abcf3f2 service neutron] 10.222.0.84 "GET /v2.0/networks?id=03979098-a904-494a-a852-b458bf7ca658 HTTP/1.1" status: 200 len: 897 time: 0.5357525 May 12 15:45:30.510201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:30.535645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aca8862-eb77-4e89-8e23-a737df173269 req-6c331a9e-7051-4fbb-88af-456eb009cf2d tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:30.554562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0aca8862-eb77-4e89-8e23-a737df173269 req-6c331a9e-7051-4fbb-88af-456eb009cf2d tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 944 time: 0.4487727 May 12 15:45:30.572790 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:30.577195 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:30.580714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Transition to ACTIVE for port object 0c976339-72c0-495d-b226-0555efa998ac will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:30.602013 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d0997c8-d3a9-4520-94c8-6d8289771441 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:30.622844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Transition to ACTIVE for port object 0c976339-72c0-495d-b226-0555efa998ac will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:30.631055 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:30.674441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:45:30.705680 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c144f08-6cc2-453e-bac5-c0c19bc7ede9 req-1a01a28c-d147-42b4-96cb-7f435072e427 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=42a296ea-fb47-4109-8501-772157438fa6 HTTP/1.1" status: 200 len: 1000 time: 0.1910319 May 12 15:45:30.707618 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:30.709215 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e10680b5-8521-474a-9c4a-9b6263649d2b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 5.3793576 May 12 15:45:30.715078 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6a07cdf-32c6-412e-aed1-bb9cca65041f None None] Pushing event updated for resources: {'Port': ['ID=edccd307-5544-482d-92bc-4a31eeb6ca92,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:30.726275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Sync routers for ids ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:45:30.739549 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Attempting to bind port edccd307-5544-482d-92bc-4a31eeb6ca92 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:30.739904 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Attempting to bind port edccd307-5544-482d-92bc-4a31eeb6ca92 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '40a24c29-7ea4-4fc4-b95a-63eec4b86204', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'efb0a87e-f691-44d4-91fd-6973427a3bed'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:30.740256 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Attempting to bind port edccd307-5544-482d-92bc-4a31eeb6ca92 on network efb0a87e-f691-44d4-91fd-6973427a3bed {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:30.745839 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:30.746153 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Checking segment: {'id': '40a24c29-7ea4-4fc4-b95a-63eec4b86204', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'efb0a87e-f691-44d4-91fd-6973427a3bed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:30.746509 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:30.746888 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Bound using segment: {'id': '40a24c29-7ea4-4fc4-b95a-63eec4b86204', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'efb0a87e-f691-44d4-91fd-6973427a3bed'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:30.747692 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Bound port: edccd307-5544-482d-92bc-4a31eeb6ca92, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '40a24c29-7ea4-4fc4-b95a-63eec4b86204', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': 'efb0a87e-f691-44d4-91fd-6973427a3bed'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:30.747692 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:30.759208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Network c7f68380-c906-474f-8407-2e4714dc6877 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:30.764516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:30.768209 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:30.771966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port f5fee0fe-13ff-4937-9198-0081d4033540 yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:45:30.782124 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Routers {'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:30.782756 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:30.800773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45000) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:30.838763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c144f08-6cc2-453e-bac5-c0c19bc7ede9 req-df7ccc21-cccc-48d5-81e9-9e5d3f40d312 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:30.846114 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c144f08-6cc2-453e-bac5-c0c19bc7ede9 req-df7ccc21-cccc-48d5-81e9-9e5d3f40d312 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=501ff294-e32c-494b-9718-ec96b39fa231 HTTP/1.1" status: 200 len: 835 time: 0.1332181 May 12 15:45:30.859304 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] For port edccd307-5544-482d-92bc-4a31eeb6ca92, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:30.868016 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] For port edccd307-5544-482d-92bc-4a31eeb6ca92, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=edccd307-5544-482d-92bc-4a31eeb6ca92,segment=NetworkSegment(40a24c29-7ea4-4fc4-b95a-63eec4b86204),segment_id=40a24c29-7ea4-4fc4-b95a-63eec4b86204)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:30.870316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d0997c8-d3a9-4520-94c8-6d8289771441 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1c61b78-18cc-453a-b8aa-53af3f9c6216,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:30.880196 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:30.987299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Pushing event updated for resources: {'Port': ['ID=0c976339-72c0-495d-b226-0555efa998ac,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:31.002153 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0c6d5ba0-611b-44a2-b369-4ef66e8ddfb6 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=b88b5989d4c548dba6124f2e4690e5c3&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1998174 May 12 15:45:31.006119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45006) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:31.006275 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Routers {'bc5f0aa5-db22-4d81-afb5-d90c21590056'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:31.006275 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bc5f0aa5-db22-4d81-afb5-d90c21590056'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:31.029452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0aca8862-eb77-4e89-8e23-a737df173269 req-3434d5c2-698a-4b4e-bedd-598266fb108a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4739914 May 12 15:45:31.051955 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d0997c8-d3a9-4520-94c8-6d8289771441 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:31.053114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6d0997c8-d3a9-4520-94c8-6d8289771441 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-groups/b1c61b78-18cc-453a-b8aa-53af3f9c6216 HTTP/1.1" status: 204 len: 168 time: 1.4481778 May 12 15:45:31.064997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45010) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:31.102514 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6a07cdf-32c6-412e-aed1-bb9cca65041f None None] Pushing event updated for resources: {'Port': ['ID=edccd307-5544-482d-92bc-4a31eeb6ca92,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:31.137732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Attempting to bind port 0c976339-72c0-495d-b226-0555efa998ac on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:31.138046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Attempting to bind port 0c976339-72c0-495d-b226-0555efa998ac by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '8703f0d6-3caf-42ba-b224-cb230a4dfa42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'c7f68380-c906-474f-8407-2e4714dc6877'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:31.138402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Attempting to bind port 0c976339-72c0-495d-b226-0555efa998ac on network c7f68380-c906-474f-8407-2e4714dc6877 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:31.149711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d93376b-a5c5-40f3-b5b6-3f4b5d6ab763 req-55607c55-a4cc-4874-ad81-89e8801cea71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:31.151202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d93376b-a5c5-40f3-b5b6-3f4b5d6ab763 req-55607c55-a4cc-4874-ad81-89e8801cea71 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 1095 time: 0.5569334 May 12 15:45:31.168762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:31.169135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Checking segment: {'id': '8703f0d6-3caf-42ba-b224-cb230a4dfa42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'c7f68380-c906-474f-8407-2e4714dc6877'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:31.169560 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:31.169948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Bound using segment: {'id': '8703f0d6-3caf-42ba-b224-cb230a4dfa42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'c7f68380-c906-474f-8407-2e4714dc6877'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:31.170418 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Bound port: 0c976339-72c0-495d-b226-0555efa998ac, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8703f0d6-3caf-42ba-b224-cb230a4dfa42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 561, 'network_id': 'c7f68380-c906-474f-8407-2e4714dc6877'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:31.170786 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:31.189495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c144f08-6cc2-453e-bac5-c0c19bc7ede9 req-46eb41df-a16d-4cba-8edc-71d10b917cff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:31.191020 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c144f08-6cc2-453e-bac5-c0c19bc7ede9 req-46eb41df-a16d-4cba-8edc-71d10b917cff service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=03979098-a904-494a-a852-b458bf7ca658&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3385305 May 12 15:45:31.296165 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b5282d04-13c2-4975-853e-51da6b5877f4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:31.328305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Set router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:31.339723 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] Set router bc5f0aa5-db22-4d81-afb5-d90c21590056 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:31.399501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee85b81a-67d3-4658-a44a-713260cda33b tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:31.403752 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ee85b81a-67d3-4658-a44a-713260cda33b tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.3948302 May 12 15:45:31.403752 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c144f08-6cc2-453e-bac5-c0c19bc7ede9 req-21d2ccf2-5598-459d-b298-f2cb6cea65c6 service neutron] 10.222.0.84 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2026238 May 12 15:45:31.404385 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45014) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:31.484868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3123f9fb-3f63-4850-95d5-f0450949257c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:31.486607 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3123f9fb-3f63-4850-95d5-f0450949257c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/networks?id=0de89d0f-e308-41b4-8980-4fb156f3c79b HTTP/1.1" status: 200 len: 910 time: 0.7500222 May 12 15:45:31.521703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b5282d04-13c2-4975-853e-51da6b5877f4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:31.535984 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b5282d04-13c2-4975-853e-51da6b5877f4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.4603205 May 12 15:45:31.551746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45020) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:31.571160 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-e9e23a5c-ade4-47b6-a728-9f0cee8ef5da tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/quotas/5b43e848e2af491a8dc509c668c33e91 HTTP/1.1" status: 200 len: 375 time: 0.0748255 May 12 15:45:31.597922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] For port 0c976339-72c0-495d-b226-0555efa998ac, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:31.618302 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] For port 0c976339-72c0-495d-b226-0555efa998ac, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0c976339-72c0-495d-b226-0555efa998ac,segment=NetworkSegment(8703f0d6-3caf-42ba-b224-cb230a4dfa42),segment_id=8703f0d6-3caf-42ba-b224-cb230a4dfa42)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:31.625980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d8a6c22f-5c2e-45c7-a0ec-5e641dc36576 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group': {'name': 'tempest-secgroup--1587971238'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:31.628526 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:31.633044 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4cc3624a-d5fc-45e5-884c-568aa992079a tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2247062 May 12 15:45:31.634208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45024) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:31.636296 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c144f08-6cc2-453e-bac5-c0c19bc7ede9 req-e3a98674-1908-4580-9505-4be789ddcc15 service neutron] 10.222.0.84 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1874979 May 12 15:45:31.643024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-670723062', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:31.672274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Allocated IP 2001:db8::31b (c7f68380-c906-474f-8407-2e4714dc6877/33e1eac5-5903-4f22-b0b5-1f09b44ea529/f5fee0fe-13ff-4937-9198-0081d4033540) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:31.710589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d8a6c22f-5c2e-45c7-a0ec-5e641dc36576 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:31.764792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:31.765268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34a170a3-4724-4f94-b01a-3ba74f54b175 None None] Pushing event updated for resources: {'Port': ['ID=0c976339-72c0-495d-b226-0555efa998ac,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:31.771197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:subnet and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:31.774600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:31.785061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:31.801489 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'name': 'tempest-TestServerMultinode-1726459329-router', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215'}], 'enable_snat': True}, 'gw_port_id': 'e66a483c-259d-4247-bb93-8082176ad6ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:14Z', 'updated_at': '2022-05-12T15:45:26Z', 'revision_number': 4, 'project_id': '5b43e848e2af491a8dc509c668c33e91', 'gw_port': {'id': 'e66a483c-259d-4247-bb93-8082176ad6ed', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:f0:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3633, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:17Z', 'updated_at': '2022-05-12T15:45:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'edccd307-5544-482d-92bc-4a31eeb6ca92', 'name': '', 'network_id': 'efb0a87e-f691-44d4-91fd-6973427a3bed', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'mac_address': 'fa:16:3e:ad:78:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'device_owner': 'network:router_interface', 'standard_attr_id': 3648, 'fixed_ips': [{'subnet_id': 'a02117db-ebdf-49e4-8844-4ca414de801d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:24Z', 'updated_at': '2022-05-12T15:45:30Z', 'revision_number': 4, 'project_id': '5b43e848e2af491a8dc509c668c33e91', 'subnets': [{'id': 'a02117db-ebdf-49e4-8844-4ca414de801d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:31.803454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Made reservation on behalf of b88b5989d4c548dba6124f2e4690e5c3 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:31.807647 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:31.807967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d8a6c22f-5c2e-45c7-a0ec-5e641dc36576 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:31.809743 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6835446d-c62f-4f53-8a11-68623848b50a None None] The sync data for ids ['bc5f0aa5-db22-4d81-afb5-d90c21590056'] in n-d-841483-1 is: [{'id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'name': 'tempest-TestServerMultinode-1726459329-router', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215'}], 'enable_snat': True}, 'gw_port_id': 'e66a483c-259d-4247-bb93-8082176ad6ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:14Z', 'updated_at': '2022-05-12T15:45:26Z', 'revision_number': 4, 'project_id': '5b43e848e2af491a8dc509c668c33e91', 'gw_port': {'id': 'e66a483c-259d-4247-bb93-8082176ad6ed', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:f0:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3633, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:17Z', 'updated_at': '2022-05-12T15:45:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'edccd307-5544-482d-92bc-4a31eeb6ca92', 'name': '', 'network_id': 'efb0a87e-f691-44d4-91fd-6973427a3bed', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'mac_address': 'fa:16:3e:ad:78:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'device_owner': 'network:router_interface', 'standard_attr_id': 3648, 'fixed_ips': [{'subnet_id': 'a02117db-ebdf-49e4-8844-4ca414de801d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:24Z', 'updated_at': '2022-05-12T15:45:30Z', 'revision_number': 4, 'project_id': '5b43e848e2af491a8dc509c668c33e91', 'subnets': [{'id': 'a02117db-ebdf-49e4-8844-4ca414de801d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:45:31.823957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143'}], 'enable_snat': True}, 'gw_port_id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:45:28Z', 'revision_number': 3, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:65:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3654, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:27Z', 'updated_at': '2022-05-12T15:45:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:31.830532 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Checking router: f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:45:31.830872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Updating router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 port 5e065dc4-c922-4e2a-8f89-cf23d6684d63 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:45:31.845127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d93376b-a5c5-40f3-b5b6-3f4b5d6ab763 req-f30d503f-77b7-42b0-a14d-f86f4ffbeb41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:31.846824 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d93376b-a5c5-40f3-b5b6-3f4b5d6ab763 req-f30d503f-77b7-42b0-a14d-f86f4ffbeb41 service neutron] 10.222.0.84 "GET /v2.0/networks?id=81ad07c9-5912-449b-bb49-14d754ee47c0 HTTP/1.1" status: 200 len: 897 time: 0.6735601 May 12 15:45:31.968482 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d8a6c22f-5c2e-45c7-a0ec-5e641dc36576 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:31.992680 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:32.114780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d93376b-a5c5-40f3-b5b6-3f4b5d6ab763 req-a571fd3e-1a42-4327-96a9-cf5901567419 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.22&port_id=8160be06-21c8-4d3e-a7d7-af54735fddd1 HTTP/1.1" status: 200 len: 217 time: 0.2548506 May 12 15:45:32.216221 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:32.274337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d8a6c22f-5c2e-45c7-a0ec-5e641dc36576 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:32.326351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d8a6c22f-5c2e-45c7-a0ec-5e641dc36576 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:32.347353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d8a6c22f-5c2e-45c7-a0ec-5e641dc36576 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:32.352866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Subnet': ['ID=7ee4997d-d763-4a38-bf54-c1153ac3e51c,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:32.381118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Checking segment: {'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:32.381552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network hostable DHCP agents. Network: 96b03b8b-8b48-4742-a456-9d456e030e73, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:45:32.397051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d8a6c22f-5c2e-45c7-a0ec-5e641dc36576 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:32.402004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-cda0dcc2-6672-402c-8032-58347d478809 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Synchronizing usage tracker for tenant:5b43e848e2af491a8dc509c668c33e91 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:32.408234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 96b03b8b-8b48-4742-a456-9d456e030e73 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:45:32.421240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 96b03b8b-8b48-4742-a456-9d456e030e73) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:32.427690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:32.427841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58b2403d-e257-4577-b13e-08990c1e7e05 req-e4b00a8d-9892-4502-9b6d-8d2ef0401c09 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:32.428672 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:32.429402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58b2403d-e257-4577-b13e-08990c1e7e05 req-e4b00a8d-9892-4502-9b6d-8d2ef0401c09 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 944 time: 0.6944861 May 12 15:45:32.432627 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:32.441199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc0fea81-d260-4fa7-9331-a1cb6626da53 None None] Network 96b03b8b-8b48-4742-a456-9d456e030e73 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:32.452584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d93376b-a5c5-40f3-b5b6-3f4b5d6ab763 req-387d2e4f-70d8-4301-b6cf-74ebac0300e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:32.457697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d93376b-a5c5-40f3-b5b6-3f4b5d6ab763 req-387d2e4f-70d8-4301-b6cf-74ebac0300e1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=854614c5-2c9e-43c0-8389-330eb4e14250 HTTP/1.1" status: 200 len: 838 time: 0.2900841 May 12 15:45:32.470809 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ab9931c5-0127-4926-aaae-288c6530bd9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.8333855 May 12 15:45:32.473742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45030) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:32.550517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Transition to ACTIVE for port object f5fee0fe-13ff-4937-9198-0081d4033540 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:32.593898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-cda0dcc2-6672-402c-8032-58347d478809 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Unset dirty status for tenant:5b43e848e2af491a8dc509c668c33e91 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:32.595481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-cda0dcc2-6672-402c-8032-58347d478809 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?tenant_id=5b43e848e2af491a8dc509c668c33e91&fields=id HTTP/1.1" status: 200 len: 302 time: 0.9814966 May 12 15:45:32.626274 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58b2403d-e257-4577-b13e-08990c1e7e05 req-8cc85b90-e021-4036-8054-43ef16fe631e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1792278 May 12 15:45:32.701718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d93376b-a5c5-40f3-b5b6-3f4b5d6ab763 req-41628d0b-ffc5-471f-a3e1-c930bf2845fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:32.703784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d93376b-a5c5-40f3-b5b6-3f4b5d6ab763 req-41628d0b-ffc5-471f-a3e1-c930bf2845fd service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=81ad07c9-5912-449b-bb49-14d754ee47c0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2217326 May 12 15:45:32.709671 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d8a6c22f-5c2e-45c7-a0ec-5e641dc36576 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:32.779373 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:32.807719 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-96b03b8b-8b48-4742-a456-9d456e030e73', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ips': [{'subnet_id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:45:32.819006 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:32.903970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e4de15ca-6d9a-47d1-8535-a72265f9c929 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:45:32.958171 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:32.972208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Transition to ACTIVE for port object 5e065dc4-c922-4e2a-8f89-cf23d6684d63 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:33.048483 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:33.145612 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d8a6c22f-5c2e-45c7-a0ec-5e641dc36576 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:33.149494 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:33.355625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Attempting to bind port 5e065dc4-c922-4e2a-8f89-cf23d6684d63 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:33.357689 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Attempting to bind port 5e065dc4-c922-4e2a-8f89-cf23d6684d63 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:33.358167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Attempting to bind port 5e065dc4-c922-4e2a-8f89-cf23d6684d63 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:33.376248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2eb72c5-569a-45fb-bd26-b32c1283788e None None] Network c7f68380-c906-474f-8407-2e4714dc6877 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:33.396216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8a6c22f-5c2e-45c7-a0ec-5e641dc36576 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e13b5784-5bb8-4033-9e90-4e52744259a1,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:33.396537 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0c976339-72c0-495d-b226-0555efa998ac up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:33.439477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network c7f68380-c906-474f-8407-2e4714dc6877 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:33.450382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:33.452781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:33.458303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:33.459138 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:33.459892 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:33.460271 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:33.460668 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:33.461058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:33.461588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Bound port: 5e065dc4-c922-4e2a-8f89-cf23d6684d63, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:33.461930 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:33.521468 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 3.7505364 May 12 15:45:33.534321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45036) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:33.542903 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d8a6c22f-5c2e-45c7-a0ec-5e641dc36576 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:33.546644 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d8a6c22f-5c2e-45c7-a0ec-5e641dc36576 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 1.9767771 May 12 15:45:33.548686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'network_id': 'c7f68380-c906-474f-8407-2e4714dc6877', 'name': 'tempest-PortsIpV6TestJSON-1428173805'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:33.553871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45040) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:33.564233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3698eb94-1161-4356-a15e-6b3441ada004 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=f5fee0fe-13ff-4937-9198-0081d4033540,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:33.575897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-2596d974-1deb-42a3-85dd-1d0eaf36f501 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group_rule': {'security_group_id': 'e13b5784-5bb8-4033-9e90-4e52744259a1', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:33.604735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2596d974-1deb-42a3-85dd-1d0eaf36f501 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:33.616606 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-46daf607-8503-4f64-a2f2-d2f9bcc18e7b service neutron] 10.222.0.82 "GET /v2.0/networks/0de89d0f-e308-41b4-8980-4fb156f3c79b?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0034969 May 12 15:45:33.618203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2596d974-1deb-42a3-85dd-1d0eaf36f501 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:33.626100 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d93376b-a5c5-40f3-b5b6-3f4b5d6ab763 req-7736bfa9-319d-41de-aa5b-fe4ee4b1688d service neutron] 10.222.0.84 "GET /v2.0/networks/81ad07c9-5912-449b-bb49-14d754ee47c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9120429 May 12 15:45:33.627432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2596d974-1deb-42a3-85dd-1d0eaf36f501 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:33.656854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2596d974-1deb-42a3-85dd-1d0eaf36f501 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:33.708011 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67913f8e-476c-4012-86f6-ad387ce4f729 None None] Pushing event updated for resources: {'Port': ['ID=5e065dc4-c922-4e2a-8f89-cf23d6684d63,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:33.768619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e282289e-e7c9-43a1-ad53-571549994d3a None None] Provisioning for port 0c976339-72c0-495d-b226-0555efa998ac completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:33.836891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-747cdc53-3377-4ae1-bc76-373e30052229 req-cd720d02-8015-4413-b9db-ab4dec5e2d5b tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:33.838377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-747cdc53-3377-4ae1-bc76-373e30052229 req-cd720d02-8015-4413-b9db-ab4dec5e2d5b tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 944 time: 0.7630396 May 12 15:45:33.840812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:33.843107 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2596d974-1deb-42a3-85dd-1d0eaf36f501 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:33.847862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:port and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:33.852328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:33.861680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:33.890553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 0c976339-72c0-495d-b226-0555efa998ac completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:33.916966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:33.919215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] For port 5e065dc4-c922-4e2a-8f89-cf23d6684d63, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:33.920572 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:33.923341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0c976339-72c0-495d-b226-0555efa998ac triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:33.923718 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:33.948923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port 02c4c8ea-38e2-4466-a5f2-bda778dc4ba5 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:45:33.956146 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Allocated IP 172.20.0.2 (96b03b8b-8b48-4742-a456-9d456e030e73/7ee4997d-d763-4a38-bf54-c1153ac3e51c/c0d3d1a7-c497-40d6-93d7-f0a6747b1c15) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:33.991224 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] For port 5e065dc4-c922-4e2a-8f89-cf23d6684d63, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5e065dc4-c922-4e2a-8f89-cf23d6684d63,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:34.003614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e4de15ca-6d9a-47d1-8535-a72265f9c929, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e4de15ca-6d9a-47d1-8535-a72265f9c929,segment=NetworkSegment(384c5e83-6775-4f29-a4c7-08c3d60e1de8),segment_id=384c5e83-6775-4f29-a4c7-08c3d60e1de8)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:34.004819 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-747cdc53-3377-4ae1-bc76-373e30052229 req-fc9e44d2-dc1b-4fc7-bee8-2b0ee8406d14 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1502755 May 12 15:45:34.009304 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d93376b-a5c5-40f3-b5b6-3f4b5d6ab763 req-4fe1bb4a-0a3f-469c-848e-d9015d7d98da service neutron] 10.222.0.84 "GET /v2.0/networks/81ad07c9-5912-449b-bb49-14d754ee47c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3494952 May 12 15:45:34.014543 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-2668d9cf-aefe-42c0-8a29-d2558f0b7cfe service neutron] 10.222.0.82 "GET /v2.0/networks/0de89d0f-e308-41b4-8980-4fb156f3c79b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3823972 May 12 15:45:34.031259 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.055960 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.058109 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2596d974-1deb-42a3-85dd-1d0eaf36f501 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.070320 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2596d974-1deb-42a3-85dd-1d0eaf36f501 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.111322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2596d974-1deb-42a3-85dd-1d0eaf36f501 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a150956a-c4a8-436d-aab9-cd6a6a953a95,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:34.159956 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2596d974-1deb-42a3-85dd-1d0eaf36f501 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.161180 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2596d974-1deb-42a3-85dd-1d0eaf36f501 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5935919 May 12 15:45:34.164111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45046) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:34.170024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-dd69c34e-7866-48c9-8ef2-47f4a12d2630 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group_rule': {'security_group_id': 'e13b5784-5bb8-4033-9e90-4e52744259a1', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:34.178293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-dd69c34e-7866-48c9-8ef2-47f4a12d2630 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:34.190946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-dd69c34e-7866-48c9-8ef2-47f4a12d2630 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:34.199648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-dd69c34e-7866-48c9-8ef2-47f4a12d2630 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:34.208816 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'port_id': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'mac_address': 'fa:16:3e:d1:51:ea', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 589, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:45:34.215376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-dd69c34e-7866-48c9-8ef2-47f4a12d2630 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:34.322836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-791f8472-c47a-493d-b8cb-dff0c053b1a0 req-edde9897-2159-47d2-932c-a069ef7cca27 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 210 time: 0.0494921 May 12 15:45:34.340198 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dd69c34e-7866-48c9-8ef2-47f4a12d2630 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.350555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Allocated IP 2001:db8::22c (c7f68380-c906-474f-8407-2e4714dc6877/33e1eac5-5903-4f22-b0b5-1f09b44ea529/02c4c8ea-38e2-4466-a5f2-bda778dc4ba5) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:34.413876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da404f6e-27c6-433e-9c3d-97ade2241abe req-d9124fd0-3711-4ba6-905b-c77f29bfc971 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:34.422509 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da404f6e-27c6-433e-9c3d-97ade2241abe req-d9124fd0-3711-4ba6-905b-c77f29bfc971 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 944 time: 0.2086844 May 12 15:45:34.480919 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dd69c34e-7866-48c9-8ef2-47f4a12d2630 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.499072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da404f6e-27c6-433e-9c3d-97ade2241abe req-6c9749bc-d32c-4c64-88c5-baead6aa0ef4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0728364 May 12 15:45:34.502635 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dd69c34e-7866-48c9-8ef2-47f4a12d2630 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.539477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd69c34e-7866-48c9-8ef2-47f4a12d2630 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e05fd526-8121-452b-8b6e-b8653a84882c,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:34.556000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Routers {'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:34.556767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:34.560727 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dd69c34e-7866-48c9-8ef2-47f4a12d2630 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.565680 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dd69c34e-7866-48c9-8ef2-47f4a12d2630 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3988698 May 12 15:45:34.567440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45058) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:34.582335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f70e1003-65be-43fd-b9df-ab269c48210c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group_rule': {'security_group_id': 'e13b5784-5bb8-4033-9e90-4e52744259a1', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:34.595875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f70e1003-65be-43fd-b9df-ab269c48210c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:34.602445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f70e1003-65be-43fd-b9df-ab269c48210c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:34.605827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f70e1003-65be-43fd-b9df-ab269c48210c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:34.615953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f70e1003-65be-43fd-b9df-ab269c48210c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:34.642802 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f70e1003-65be-43fd-b9df-ab269c48210c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.656054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67913f8e-476c-4012-86f6-ad387ce4f729 None None] Pushing event updated for resources: {'Port': ['ID=5e065dc4-c922-4e2a-8f89-cf23d6684d63,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:34.706849 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.732845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f70e1003-65be-43fd-b9df-ab269c48210c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.739037 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f70e1003-65be-43fd-b9df-ab269c48210c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.787456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f70e1003-65be-43fd-b9df-ab269c48210c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=df679169-7fc9-4ba6-a38f-c5355b1b0180,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:34.806388 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f70e1003-65be-43fd-b9df-ab269c48210c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.812222 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f70e1003-65be-43fd-b9df-ab269c48210c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2419982 May 12 15:45:34.813588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45064) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:34.819847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-26800847-547d-4fd6-a902-526c593254f4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group_rule': {'security_group_id': 'e13b5784-5bb8-4033-9e90-4e52744259a1', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:34.827785 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.832164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-26800847-547d-4fd6-a902-526c593254f4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:34.833088 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.844084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-26800847-547d-4fd6-a902-526c593254f4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:34.844324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e4de15ca-6d9a-47d1-8535-a72265f9c929 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:45:34.848773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-26800847-547d-4fd6-a902-526c593254f4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:34.855826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-26800847-547d-4fd6-a902-526c593254f4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:34.874409 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.877917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-26800847-547d-4fd6-a902-526c593254f4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.904398 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Transition to ACTIVE for port object 02c4c8ea-38e2-4466-a5f2-bda778dc4ba5 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:34.909259 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Transition to ACTIVE for port object c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:34.940167 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:34.940434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e4de15ca-6d9a-47d1-8535-a72265f9c929, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e4de15ca-6d9a-47d1-8535-a72265f9c929,segment=NetworkSegment(384c5e83-6775-4f29-a4c7-08c3d60e1de8),segment_id=384c5e83-6775-4f29-a4c7-08c3d60e1de8)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:34.963744 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Transition to ACTIVE for port object c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:34.968258 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.017111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] Set router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:35.026601 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-26800847-547d-4fd6-a902-526c593254f4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.034394 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-26800847-547d-4fd6-a902-526c593254f4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.090570 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.095542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 0c976339-72c0-495d-b226-0555efa998ac, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0c976339-72c0-495d-b226-0555efa998ac,segment=NetworkSegment(8703f0d6-3caf-42ba-b224-cb230a4dfa42),segment_id=8703f0d6-3caf-42ba-b224-cb230a4dfa42)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:35.116526 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-26800847-547d-4fd6-a902-526c593254f4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.120965 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-26800847-547d-4fd6-a902-526c593254f4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3062642 May 12 15:45:35.121669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45070) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:35.128885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26800847-547d-4fd6-a902-526c593254f4 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d1613c99-2e27-46c7-b0e5-c2a30a22fd46,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:35.137989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a71e5aa7-c565-42c6-8b7b-20c359629f00 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group_rule': {'security_group_id': 'e13b5784-5bb8-4033-9e90-4e52744259a1', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:35.162644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a71e5aa7-c565-42c6-8b7b-20c359629f00 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:35.167604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a71e5aa7-c565-42c6-8b7b-20c359629f00 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:35.178418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a71e5aa7-c565-42c6-8b7b-20c359629f00 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:35.186505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a71e5aa7-c565-42c6-8b7b-20c359629f00 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:35.208724 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.209954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device edccd307-5544-482d-92bc-4a31eeb6ca92 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:35.223712 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a71e5aa7-c565-42c6-8b7b-20c359629f00 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.275617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network c7f68380-c906-474f-8407-2e4714dc6877 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:35.286665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:35.291332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=02c4c8ea-38e2-4466-a5f2-bda778dc4ba5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:35.299502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:35.305332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:35.305962 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.324970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['e4de15ca-6d9a-47d1-8535-a72265f9c929'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:45:35.345871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.20.0.1 (96b03b8b-8b48-4742-a456-9d456e030e73/7ee4997d-d763-4a38-bf54-c1153ac3e51c/0f3cbe16-d9fe-46b2-b341-ab176c57b531) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:35.393360 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-729d1dd7-5d3c-4dee-a75b-25a83031fccf tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.8547022 May 12 15:45:35.394665 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a71e5aa7-c565-42c6-8b7b-20c359629f00 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.395574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45076) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:35.408304 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8160be06-21c8-4d3e-a7d7-af54735fddd1 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:45:35.418991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bca1f6e-b0f8-4725-abc5-7862cc526807 req-39edc586-f72d-4c29-8aa1-5eb5fa40e78f tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:35.428390 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5bca1f6e-b0f8-4725-abc5-7862cc526807 req-39edc586-f72d-4c29-8aa1-5eb5fa40e78f tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 945 time: 0.1837368 May 12 15:45:35.446179 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a71e5aa7-c565-42c6-8b7b-20c359629f00 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.523389 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5bca1f6e-b0f8-4725-abc5-7862cc526807 req-fe2c4cea-692c-40ce-b3d2-32081b03c44a tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0917430 May 12 15:45:35.529621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a71e5aa7-c565-42c6-8b7b-20c359629f00 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fe6e11b3-5023-4551-9665-7a5e1e40c430,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:35.529912 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Network 96b03b8b-8b48-4742-a456-9d456e030e73 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:35.567669 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a71e5aa7-c565-42c6-8b7b-20c359629f00 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.572560 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a71e5aa7-c565-42c6-8b7b-20c359629f00 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.4483881 May 12 15:45:35.574957 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45082) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:35.577037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:35.602141 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:35.633190 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=e4de15ca-6d9a-47d1-8535-a72265f9c929,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:35.636095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2a56cd02-f80a-4ac7-8103-07a3695e7cff None None] Provisioning for port f5fee0fe-13ff-4937-9198-0081d4033540 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:35.678478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fb28084-8161-4268-a1c7-22d8603e8263 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:35.679202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5fb28084-8161-4268-a1c7-22d8603e8263 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:35.709992 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.713724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5fb28084-8161-4268-a1c7-22d8603e8263 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:35.715043 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5fb28084-8161-4268-a1c7-22d8603e8263 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports?fixed_ips=ip_address%3D2001%3Adb8%3A%3A31b HTTP/1.1" status: 200 len: 929 time: 0.3184462 May 12 15:45:35.719767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45086) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:35.803252 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c3eb1c3-3478-418e-b517-4cd19b69c605 req-a4a8665b-5ae9-436b-a119-b49e40d0c4f1 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 210 time: 0.1672332 May 12 15:45:35.806279 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f07e8807-3016-4f98-92ba-bfd805be1a70 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.825158 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.resource_extend [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] It took 0.22 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:45:35.826214 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f07e8807-3016-4f98-92ba-bfd805be1a70 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.854456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Transition to ACTIVE for port object 0f3cbe16-d9fe-46b2-b341-ab176c57b531 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:35.892271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e022b23c-21d0-44d8-8973-57e55d342c8f req-1741972e-a97e-4fcb-8c9d-5e2e9216cdd8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:35.893985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2a56cd02-f80a-4ac7-8103-07a3695e7cff None None] Provisioning complete for port f5fee0fe-13ff-4937-9198-0081d4033540 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:35.894456 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2a56cd02-f80a-4ac7-8103-07a3695e7cff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.899985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e022b23c-21d0-44d8-8973-57e55d342c8f req-1741972e-a97e-4fcb-8c9d-5e2e9216cdd8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 944 time: 0.1499448 May 12 15:45:35.936963 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f07e8807-3016-4f98-92ba-bfd805be1a70 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.943079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-bad2a6e5-50ee-4d01-8330-a19f6605ca10 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 02c4c8ea-38e2-4466-a5f2-bda778dc4ba5 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:45:35.943657 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bad2a6e5-50ee-4d01-8330-a19f6605ca10 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.973616 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f07e8807-3016-4f98-92ba-bfd805be1a70 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:35.974969 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f07e8807-3016-4f98-92ba-bfd805be1a70 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/fe6e11b3-5023-4551-9665-7a5e1e40c430 HTTP/1.1" status: 204 len: 168 time: 0.3988464 May 12 15:45:35.983002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45090) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:35.993310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f07e8807-3016-4f98-92ba-bfd805be1a70 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=fe6e11b3-5023-4551-9665-7a5e1e40c430,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:36.078623 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.082977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e022b23c-21d0-44d8-8973-57e55d342c8f req-ccf60924-2918-4c5e-bcab-6db6217d25a7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1820221 May 12 15:45:36.144966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-80b83a30-889c-428f-bbb0-07ce522154db tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:36.168148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-80b83a30-889c-428f-bbb0-07ce522154db tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:36.173472 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-80b83a30-889c-428f-bbb0-07ce522154db tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5731 time: 0.1890991 May 12 15:45:36.174319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45094) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:36.178133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Pushing event updated for resources: {'Port': ['ID=c0d3d1a7-c497-40d6-93d7-f0a6747b1c15,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:36.180499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Attempting to bind port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:36.180926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Attempting to bind port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:36.181360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Attempting to bind port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 on network 96b03b8b-8b48-4742-a456-9d456e030e73 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:36.221101 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c0cbb01-48e2-41e7-8829-07ead297fc5b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.235522 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c0cbb01-48e2-41e7-8829-07ead297fc5b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.235818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2a56cd02-f80a-4ac7-8103-07a3695e7cff None None] Port f5fee0fe-13ff-4937-9198-0081d4033540 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:36.238083 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port edccd307-5544-482d-92bc-4a31eeb6ca92 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:36.247331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 96b03b8b-8b48-4742-a456-9d456e030e73 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:36.255170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:36.264453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:36.275920 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c0cbb01-48e2-41e7-8829-07ead297fc5b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.277443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:36.277954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Checking segment: {'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:36.278868 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.278868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Bound using segment: {'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:36.279366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Bound port: c0d3d1a7-c497-40d6-93d7-f0a6747b1c15, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:36.279779 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.299911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port edccd307-5544-482d-92bc-4a31eeb6ca92 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:36.300366 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.308031 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c0cbb01-48e2-41e7-8829-07ead297fc5b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.309744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4c0cbb01-48e2-41e7-8829-07ead297fc5b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/d1613c99-2e27-46c7-b0e5-c2a30a22fd46 HTTP/1.1" status: 204 len: 168 time: 0.1344216 May 12 15:45:36.313175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45098) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:36.341999 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c0cbb01-48e2-41e7-8829-07ead297fc5b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=d1613c99-2e27-46c7-b0e5-c2a30a22fd46,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:36.383056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5e172dfb-297d-446b-a2a4-4fb7f16469e9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:36.399948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5e172dfb-297d-446b-a2a4-4fb7f16469e9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:36.404438 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5e172dfb-297d-446b-a2a4-4fb7f16469e9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5190 time: 0.0861528 May 12 15:45:36.404812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45102) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:36.417308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=0f3cbe16-d9fe-46b2-b341-ab176c57b531,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:36.435700 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9c62b6b-fedd-4171-875f-d58ffc028219 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.449821 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9c62b6b-fedd-4171-875f-d58ffc028219 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.456604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-225b5ad0-551a-42f5-b71e-f42d1f090886 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:36.457285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-225b5ad0-551a-42f5-b71e-f42d1f090886 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Synchronizing usage tracker for tenant:5b43e848e2af491a8dc509c668c33e91 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:36.463134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8160be06-21c8-4d3e-a7d7-af54735fddd1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8160be06-21c8-4d3e-a7d7-af54735fddd1,segment=NetworkSegment(41769506-c6e2-4d6c-a537-2d71e8a5e3f7),segment_id=41769506-c6e2-4d6c-a537-2d71e8a5e3f7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:36.476582 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9c62b6b-fedd-4171-875f-d58ffc028219 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.487347 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.501269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9c62b6b-fedd-4171-875f-d58ffc028219 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=df679169-7fc9-4ba6-a38f-c5355b1b0180,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:36.503092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2a56cd02-f80a-4ac7-8103-07a3695e7cff None None] Provisioning complete for port 0c976339-72c0-495d-b226-0555efa998ac triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:36.503092 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2a56cd02-f80a-4ac7-8103-07a3695e7cff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.511797 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9c62b6b-fedd-4171-875f-d58ffc028219 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.513135 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d9c62b6b-fedd-4171-875f-d58ffc028219 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/df679169-7fc9-4ba6-a38f-c5355b1b0180 HTTP/1.1" status: 204 len: 168 time: 0.1069717 May 12 15:45:36.515814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45106) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:36.525234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-225b5ad0-551a-42f5-b71e-f42d1f090886 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Unset dirty status for tenant:5b43e848e2af491a8dc509c668c33e91 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:36.526393 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-225b5ad0-551a-42f5-b71e-f42d1f090886 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.76 "GET /v2.0/networks?id=0de89d0f-e308-41b4-8980-4fb156f3c79b HTTP/1.1" status: 200 len: 910 time: 0.6386478 May 12 15:45:36.527842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=0c976339-72c0-495d-b226-0555efa998ac,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:36.527990 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bad2a6e5-50ee-4d01-8330-a19f6605ca10 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.544541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Request body: {'port': {'device_id': '2b1086dd-d596-4bdf-ade3-83e3daa10bac', 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b', 'admin_state_up': True, 'tenant_id': '5b43e848e2af491a8dc509c668c33e91'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:36.551483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:36.561510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:36.608547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '8160be06-21c8-4d3e-a7d7-af54735fddd1', 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0', 'port_id': '8160be06-21c8-4d3e-a7d7-af54735fddd1', 'mac_address': 'fa:16:3e:54:41:2d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 552, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '854614c5-2c9e-43c0-8389-330eb4e14250', 'ip_address': '172.20.0.22'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:45:36.698661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4f4343c2-5ff0-4eb3-b8d7-d184aeb097d3 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:36.717762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4f4343c2-5ff0-4eb3-b8d7-d184aeb097d3 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:36.725226 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4f4343c2-5ff0-4eb3-b8d7-d184aeb097d3 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4649 time: 0.2077968 May 12 15:45:36.726205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45114) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:36.744444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Made reservation on behalf of 5b43e848e2af491a8dc509c668c33e91 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:36.746869 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.763524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-bad2a6e5-50ee-4d01-8330-a19f6605ca10 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 02c4c8ea-38e2-4466-a5f2-bda778dc4ba5 owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:45:36.767558 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ebccaccd-2709-4ab1-afeb-79fd1ca2828e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.777803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] For port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:36.786846 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ebccaccd-2709-4ab1-afeb-79fd1ca2828e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.830407 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.851811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] For port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c0d3d1a7-c497-40d6-93d7-f0a6747b1c15,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:36.857203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143'}], 'enable_snat': True}, 'gw_port_id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:45:28Z', 'revision_number': 3, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:65:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3654, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:27Z', 'updated_at': '2022-05-12T15:45:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:36.902730 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ebccaccd-2709-4ab1-afeb-79fd1ca2828e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.912361 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:36.957840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec5caae5-af1a-4157-92f8-385302b3e4f4 None None] The sync data for ids ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'] in n-d-841483-1 is: [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143'}], 'enable_snat': True}, 'gw_port_id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:45:28Z', 'revision_number': 3, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:65:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3654, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:27Z', 'updated_at': '2022-05-12T15:45:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:45:36.960725 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8160be06-21c8-4d3e-a7d7-af54735fddd1 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:45:37.014467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81554a5c-e52e-4789-a905-723c25ba9b5a req-5f26ff06-45a4-4eb9-a24d-c315aea755ef tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:37.019876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81554a5c-e52e-4789-a905-723c25ba9b5a req-5f26ff06-45a4-4eb9-a24d-c315aea755ef tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 945 time: 0.3691692 May 12 15:45:37.020644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebccaccd-2709-4ab1-afeb-79fd1ca2828e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=e05fd526-8121-452b-8b6e-b8653a84882c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:37.045706 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ebccaccd-2709-4ab1-afeb-79fd1ca2828e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:37.049157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ebccaccd-2709-4ab1-afeb-79fd1ca2828e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/e05fd526-8121-452b-8b6e-b8653a84882c HTTP/1.1" status: 204 len: 168 time: 0.3184786 May 12 15:45:37.056938 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45120) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:37.061017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69f21329-5a97-439f-9c65-9e83b28ad527 req-c871e321-4360-424d-8317-1b9563118f52 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 210 time: 0.0960546 May 12 15:45:37.088703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b743607-31ce-4901-9af0-a3080b797137 None None] Pushing event updated for resources: {'Port': ['ID=c0d3d1a7-c497-40d6-93d7-f0a6747b1c15,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:37.091632 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:37.111931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81554a5c-e52e-4789-a905-723c25ba9b5a req-cebda163-1889-4c93-b50e-1b746238f441 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0814641 May 12 15:45:37.151190 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ed2bd5fc-70db-4918-95a8-87286ba7a107 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:37.151739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Allocated IP 172.20.0.10 (0de89d0f-e308-41b4-8980-4fb156f3c79b/25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e/a9e5c289-e1e2-4485-824e-3e18f4ba6f96) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:37.161144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bad2a6e5-50ee-4d01-8330-a19f6605ca10 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:37.176995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ed2bd5fc-70db-4918-95a8-87286ba7a107 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:37.176995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ed2bd5fc-70db-4918-95a8-87286ba7a107 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4108 time: 0.1170571 May 12 15:45:37.178338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45126) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:37.201651 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:37.213445 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8160be06-21c8-4d3e-a7d7-af54735fddd1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8160be06-21c8-4d3e-a7d7-af54735fddd1,segment=NetworkSegment(41769506-c6e2-4d6c-a537-2d71e8a5e3f7),segment_id=41769506-c6e2-4d6c-a537-2d71e8a5e3f7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:37.232630 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:37.251732 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-637b3ea0-9d22-46b5-b047-f1e6d84180ad tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:37.268690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bad2a6e5-50ee-4d01-8330-a19f6605ca10 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=02c4c8ea-38e2-4466-a5f2-bda778dc4ba5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:37.284867 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-637b3ea0-9d22-46b5-b047-f1e6d84180ad tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:37.370441 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port edccd307-5544-482d-92bc-4a31eeb6ca92, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=edccd307-5544-482d-92bc-4a31eeb6ca92,segment=NetworkSegment(40a24c29-7ea4-4fc4-b95a-63eec4b86204),segment_id=40a24c29-7ea4-4fc4-b95a-63eec4b86204)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:37.448106 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:37.503493 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-637b3ea0-9d22-46b5-b047-f1e6d84180ad tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:37.556981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-637b3ea0-9d22-46b5-b047-f1e6d84180ad tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=a150956a-c4a8-436d-aab9-cd6a6a953a95,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:37.564128 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-30cbaf33-fcc4-45e9-a2af-bcac47db8a8e None None] Provisioning complete for port f5fee0fe-13ff-4937-9198-0081d4033540 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:37.564525 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30cbaf33-fcc4-45e9-a2af-bcac47db8a8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:37.589591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8b85a3c-8a26-499d-8c1f-805cc8c67c4f req-a5872726-3fbe-4679-ba3c-b9851d4e7e2c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:37.596390 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8b85a3c-8a26-499d-8c1f-805cc8c67c4f req-a5872726-3fbe-4679-ba3c-b9851d4e7e2c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 945 time: 0.2944126 May 12 15:45:37.599791 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-637b3ea0-9d22-46b5-b047-f1e6d84180ad tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:37.601126 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-637b3ea0-9d22-46b5-b047-f1e6d84180ad tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/a150956a-c4a8-436d-aab9-cd6a6a953a95 HTTP/1.1" status: 204 len: 168 time: 0.4215205 May 12 15:45:37.603564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45130) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:37.664015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['8160be06-21c8-4d3e-a7d7-af54735fddd1'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:45:37.762125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0c976339-72c0-495d-b226-0555efa998ac up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:37.762695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bad2a6e5-50ee-4d01-8330-a19f6605ca10 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:37.801931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8b85a3c-8a26-499d-8c1f-805cc8c67c4f req-9a0450d5-f506-4bc3-9935-d55a03d8455d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1641014 May 12 15:45:37.832938 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5e5773d6-e7b4-4544-b15b-3c2cfd6a06aa tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:37.874499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5e5773d6-e7b4-4544-b15b-3c2cfd6a06aa tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:37.878412 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bad2a6e5-50ee-4d01-8330-a19f6605ca10 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/02c4c8ea-38e2-4466-a5f2-bda778dc4ba5 HTTP/1.1" status: 204 len: 168 time: 2.1573415 May 12 15:45:37.878626 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5e5773d6-e7b4-4544-b15b-3c2cfd6a06aa tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.2623396 May 12 15:45:37.878783 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=8160be06-21c8-4d3e-a7d7-af54735fddd1,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:37.880943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45134) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:37.979629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45136) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:38.005682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-30cbaf33-fcc4-45e9-a2af-bcac47db8a8e None None] Port f5fee0fe-13ff-4937-9198-0081d4033540 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:38.051494 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-30cbaf33-fcc4-45e9-a2af-bcac47db8a8e None None] Could not find standard attr ID for object 02c4c8ea-38e2-4466-a5f2-bda778dc4ba5. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:45:38.061185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=edccd307-5544-482d-92bc-4a31eeb6ca92,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:38.064229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0c976339-72c0-495d-b226-0555efa998ac triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:38.064584 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:38.076076 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-dbf50a3e-54d6-4a66-8363-5f70b0d9cfd1 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] GET failed (client error): The resource could not be found. May 12 15:45:38.076610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-dbf50a3e-54d6-4a66-8363-5f70b0d9cfd1 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:38.114142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-dbf50a3e-54d6-4a66-8363-5f70b0d9cfd1 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:38.115374 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dbf50a3e-54d6-4a66-8363-5f70b0d9cfd1 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/02c4c8ea-38e2-4466-a5f2-bda778dc4ba5 HTTP/1.1" status: 404 len: 333 time: 0.2312050 May 12 15:45:38.118772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45144) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:38.155500 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cd4c30fd-f2c5-4aab-8534-889677e86e23 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:38.231726 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cd4c30fd-f2c5-4aab-8534-889677e86e23 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:38.268439 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:38.270154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-12b0b184-66e7-4454-8dfa-517e59f191b5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port f5fee0fe-13ff-4937-9198-0081d4033540 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:45:38.270507 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-12b0b184-66e7-4454-8dfa-517e59f191b5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:38.287334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Transition to ACTIVE for port object a9e5c289-e1e2-4485-824e-3e18f4ba6f96 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:38.320344 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:38.564913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Network 0de89d0f-e308-41b4-8980-4fb156f3c79b is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:38.586242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:38.611025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:38.626502 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cd4c30fd-f2c5-4aab-8534-889677e86e23 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:38.759634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd4c30fd-f2c5-4aab-8534-889677e86e23 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e13b5784-5bb8-4033-9e90-4e52744259a1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:38.805052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Pushing event updated for resources: {'Port': ['ID=a9e5c289-e1e2-4485-824e-3e18f4ba6f96,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:38.870289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:38.872415 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:38.983528 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e4de15ca-6d9a-47d1-8535-a72265f9c929 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:38.987392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-754873b4-b6fa-4abc-b2e8-c5dcc36414e8 req-b30c4776-b03a-4052-b0e2-ebe2fae421ca tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:38.997295 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-754873b4-b6fa-4abc-b2e8-c5dcc36414e8 req-b30c4776-b03a-4052-b0e2-ebe2fae421ca tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1028 time: 0.6232488 May 12 15:45:38.999538 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cd4c30fd-f2c5-4aab-8534-889677e86e23 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:39.003153 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cd4c30fd-f2c5-4aab-8534-889677e86e23 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-groups/e13b5784-5bb8-4033-9e90-4e52744259a1 HTTP/1.1" status: 204 len: 168 time: 1.0198565 May 12 15:45:39.011011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45152) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:39.068575 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-13b12b83-24d7-422d-8f13-26ebee81b890 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1030 time: 2.5273755 May 12 15:45:39.094759 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-52bad2ca-69b9-40fe-a963-3c09dbfe21af None None] Provisioning for port a9e5c289-e1e2-4485-824e-3e18f4ba6f96 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:39.100546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Request body: {'port': {'device_id': '2b1086dd-d596-4bdf-ade3-83e3daa10bac', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:39.102154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-52bad2ca-69b9-40fe-a963-3c09dbfe21af None None] Provisioning complete for port a9e5c289-e1e2-4485-824e-3e18f4ba6f96 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:39.102635 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-52bad2ca-69b9-40fe-a963-3c09dbfe21af None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:39.142544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port e4de15ca-6d9a-47d1-8535-a72265f9c929 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:39.152735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36214ab2-4ec3-4b44-944b-0910c5932b8e None None] Network 96b03b8b-8b48-4742-a456-9d456e030e73 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:39.162085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-754873b4-b6fa-4abc-b2e8-c5dcc36414e8 req-dd483eb0-8fa5-4b64-a1f3-c3e1d6c6d96f tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1636896 May 12 15:45:39.178633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4bdf87f-76ca-4905-b8da-e5d9005186aa req-27810900-4468-49d9-b83f-9946aa8cb85c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:39.187160 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4bdf87f-76ca-4905-b8da-e5d9005186aa req-27810900-4468-49d9-b83f-9946aa8cb85c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 945 time: 0.7049997 May 12 15:45:39.188963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port e4de15ca-6d9a-47d1-8535-a72265f9c929 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:39.189331 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:39.224311 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-12b0b184-66e7-4454-8dfa-517e59f191b5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:39.284161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d198b17c-5db7-4490-a6e8-8f4eac073bfe tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:39.351332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-52bad2ca-69b9-40fe-a963-3c09dbfe21af None None] Port a9e5c289-e1e2-4485-824e-3e18f4ba6f96 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:39.401937 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:39.419166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d198b17c-5db7-4490-a6e8-8f4eac073bfe tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:39.425401 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d198b17c-5db7-4490-a6e8-8f4eac073bfe tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.4129956 May 12 15:45:39.429436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-12b0b184-66e7-4454-8dfa-517e59f191b5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for f5fee0fe-13ff-4937-9198-0081d4033540 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:45:39.441282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45156) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:39.449860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-87e8631b-2943-4172-98e8-5ac509b0f3b5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group': {'name': 'tempest-secgroup--983894119'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:39.497908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4bdf87f-76ca-4905-b8da-e5d9005186aa req-8c3ce8df-e2c0-4e4a-a707-0e6c408f292c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3085818 May 12 15:45:39.524035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:39.540912 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-87e8631b-2943-4172-98e8-5ac509b0f3b5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:39.554391 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:39.578868 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe7d989-34cd-4bd5-9239-7f2659303d69 req-54e0099e-cabc-49a8-88c2-1dc8eeeddc12 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:39.588025 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ebe7d989-34cd-4bd5-9239-7f2659303d69 req-54e0099e-cabc-49a8-88c2-1dc8eeeddc12 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 945 time: 0.2083197 May 12 15:45:39.617891 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0f91878e-4e4d-492b-a198-8784907a15c5 None None] Provisioning for port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:39.628360 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:39.704655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ebe7d989-34cd-4bd5-9239-7f2659303d69 req-b098fb8f-de0a-48fe-b446-6576d3b6cc23 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1157687 May 12 15:45:39.744569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e4de15ca-6d9a-47d1-8535-a72265f9c929'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:45:39.744932 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-12b0b184-66e7-4454-8dfa-517e59f191b5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:39.772283 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e4de15ca-6d9a-47d1-8535-a72265f9c929, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e4de15ca-6d9a-47d1-8535-a72265f9c929,segment=NetworkSegment(384c5e83-6775-4f29-a4c7-08c3d60e1de8),segment_id=384c5e83-6775-4f29-a4c7-08c3d60e1de8)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:39.791298 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:39.813102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-87e8631b-2943-4172-98e8-5ac509b0f3b5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:39.880441 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-deb1b760-0ec0-4e32-a446-eac4eefd52c7'] response: {'server_uuid': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'code': 200} May 12 15:45:39.884222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=0f3cbe16-d9fe-46b2-b341-ab176c57b531,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:39.884516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5e065dc4-c922-4e2a-8f89-cf23d6684d63 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:39.998050 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.000563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=e4de15ca-6d9a-47d1-8535-a72265f9c929,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:40.041651 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 5e065dc4-c922-4e2a-8f89-cf23d6684d63 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:40.047837 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12b0b184-66e7-4454-8dfa-517e59f191b5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=f5fee0fe-13ff-4937-9198-0081d4033540,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:40.054468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 5e065dc4-c922-4e2a-8f89-cf23d6684d63 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:40.054857 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.070719 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-12b0b184-66e7-4454-8dfa-517e59f191b5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.092560 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87e8631b-2943-4172-98e8-5ac509b0f3b5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.093148 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-12b0b184-66e7-4454-8dfa-517e59f191b5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/f5fee0fe-13ff-4937-9198-0081d4033540 HTTP/1.1" status: 204 len: 168 time: 1.9730337 May 12 15:45:40.096665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45162) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:40.146376 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-69bf613c-4a83-46cd-846c-e49919bf6dbd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] GET failed (client error): The resource could not be found. May 12 15:45:40.147377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-69bf613c-4a83-46cd-846c-e49919bf6dbd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:40.173318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-69bf613c-4a83-46cd-846c-e49919bf6dbd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:40.175222 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-69bf613c-4a83-46cd-846c-e49919bf6dbd tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/f5fee0fe-13ff-4937-9198-0081d4033540 HTTP/1.1" status: 404 len: 333 time: 0.0770252 May 12 15:45:40.179184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45166) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:40.199049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-87e8631b-2943-4172-98e8-5ac509b0f3b5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:40.230253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-87e8631b-2943-4172-98e8-5ac509b0f3b5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:40.241223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-87e8631b-2943-4172-98e8-5ac509b0f3b5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:40.264363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-87e8631b-2943-4172-98e8-5ac509b0f3b5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:40.270943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0d57fe-d41c-4d0a-b12b-bb73dedf5c9f req-deb8f0e0-3f68-4ad6-a144-4cf7268ffb95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:40.271264 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-851a9934-0e97-470d-ad32-9387a5478c9f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting subnet 33e1eac5-5903-4f22-b0b5-1f09b44ea529 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:45:40.272682 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e0d57fe-d41c-4d0a-b12b-bb73dedf5c9f req-deb8f0e0-3f68-4ad6-a144-4cf7268ffb95 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 1097 time: 0.3785961 May 12 15:45:40.277311 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-851a9934-0e97-470d-ad32-9387a5478c9f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.300205 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.339523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 5e065dc4-c922-4e2a-8f89-cf23d6684d63, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5e065dc4-c922-4e2a-8f89-cf23d6684d63,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:40.352069 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.353100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:40.424288 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-851a9934-0e97-470d-ad32-9387a5478c9f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.475031 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a29b114e-5f7d-4296-a318-2f71a72625e7 None None] Provisioning for port 0f3cbe16-d9fe-46b2-b341-ab176c57b531 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:40.492159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a29b114e-5f7d-4296-a318-2f71a72625e7 None None] Provisioning complete for port 0f3cbe16-d9fe-46b2-b341-ab176c57b531 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:40.492530 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a29b114e-5f7d-4296-a318-2f71a72625e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.524115 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-851a9934-0e97-470d-ad32-9387a5478c9f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.537584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=5e065dc4-c922-4e2a-8f89-cf23d6684d63,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:40.575112 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:40.588814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a29b114e-5f7d-4296-a318-2f71a72625e7 None None] Port 0f3cbe16-d9fe-46b2-b341-ab176c57b531 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:40.598686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:40.599068 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.627449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ea7dace-42c6-404a-a519-150c96a8ce3e req-8360ce04-6be6-41f2-a5ae-65a265fc4692 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:40.629458 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ea7dace-42c6-404a-a519-150c96a8ce3e req-8360ce04-6be6-41f2-a5ae-65a265fc4692 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1028 time: 0.2905211 May 12 15:45:40.633209 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-851a9934-0e97-470d-ad32-9387a5478c9f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.651516 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e0d57fe-d41c-4d0a-b12b-bb73dedf5c9f req-f99ef996-de22-4b0f-ae3f-4397d3f1e519 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3538618 May 12 15:45:40.681874 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a29b114e-5f7d-4296-a318-2f71a72625e7 None None] Provisioning complete for port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:40.682244 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a29b114e-5f7d-4296-a318-2f71a72625e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.702517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-851a9934-0e97-470d-ad32-9387a5478c9f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Subnet': ['ID=33e1eac5-5903-4f22-b0b5-1f09b44ea529,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:40.720332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 96b03b8b-8b48-4742-a456-9d456e030e73 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:40.724519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:40.764836 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-851a9934-0e97-470d-ad32-9387a5478c9f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.784897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-851a9934-0e97-470d-ad32-9387a5478c9f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/33e1eac5-5903-4f22-b0b5-1f09b44ea529 HTTP/1.1" status: 204 len: 168 time: 0.6041744 May 12 15:45:40.785514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6e013fa-33a1-4887-81c5-5b26fc6c368c None None] Network c7f68380-c906-474f-8407-2e4714dc6877 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:40.788011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45176) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:40.798402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5ea7dace-42c6-404a-a519-150c96a8ce3e req-e14c12ff-fb13-414f-89de-89ade4c1f5c4 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1589797 May 12 15:45:40.919215 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87e8631b-2943-4172-98e8-5ac509b0f3b5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:40.987435 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87e8631b-2943-4172-98e8-5ac509b0f3b5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.011550 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.015081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.resource_extend [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 12 15:45:41.034808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fff986fd-464b-41c5-a2cb-f4d5651f33a3 req-af59c273-a0a9-4133-aa25-599f889657f3 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:41.036178 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fff986fd-464b-41c5-a2cb-f4d5651f33a3 req-af59c273-a0a9-4133-aa25-599f889657f3 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 946 time: 0.3364305 May 12 15:45:41.042099 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.100032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 0c976339-72c0-495d-b226-0555efa998ac {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:45:41.100032 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.138616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87e8631b-2943-4172-98e8-5ac509b0f3b5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6d8bcc91-5941-427b-a811-5fce79ef1244,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:41.144602 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-87e8631b-2943-4172-98e8-5ac509b0f3b5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.145805 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-87e8631b-2943-4172-98e8-5ac509b0f3b5 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 1.7044761 May 12 15:45:41.150342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45180) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:41.158392 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fff986fd-464b-41c5-a2cb-f4d5651f33a3 req-bd18b64b-8f32-4d5a-b85d-eb9b073c0694 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1092722 May 12 15:45:41.159090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c47f82a2-9752-49d6-b62a-79bb806f8d1e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group_rule': {'security_group_id': '6d8bcc91-5941-427b-a811-5fce79ef1244', 'direction': 'ingress', 'protocol': 17}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:41.166675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a9e5c289-e1e2-4485-824e-3e18f4ba6f96 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:45:41.168409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c0d3d1a7-c497-40d6-93d7-f0a6747b1c15,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:41.175508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c47f82a2-9752-49d6-b62a-79bb806f8d1e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:41.176585 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc11a242-8ac1-497a-9642-729192b54ba5 req-686bc41f-b2f6-4cbc-91dc-e2f2407781dc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:41.179258 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.180080 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a29b114e-5f7d-4296-a318-2f71a72625e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.187019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc11a242-8ac1-497a-9642-729192b54ba5 req-686bc41f-b2f6-4cbc-91dc-e2f2407781dc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 945 time: 0.2320099 May 12 15:45:41.190961 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.191621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:45:41.191874 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device edccd307-5544-482d-92bc-4a31eeb6ca92 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:41.192892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c47f82a2-9752-49d6-b62a-79bb806f8d1e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:41.199647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c47f82a2-9752-49d6-b62a-79bb806f8d1e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:41.209829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c47f82a2-9752-49d6-b62a-79bb806f8d1e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:41.215987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Transition to ACTIVE for port object a9e5c289-e1e2-4485-824e-3e18f4ba6f96 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:41.279257 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.304128 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc11a242-8ac1-497a-9642-729192b54ba5 req-c7a3469f-2d5d-4fb5-82a9-552dacfa545a tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1160893 May 12 15:45:41.350890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8160be06-21c8-4d3e-a7d7-af54735fddd1 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:41.438433 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c47f82a2-9752-49d6-b62a-79bb806f8d1e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.439787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] For port 0c976339-72c0-495d-b226-0555efa998ac, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0c976339-72c0-495d-b226-0555efa998ac,segment=NetworkSegment(8703f0d6-3caf-42ba-b224-cb230a4dfa42),segment_id=8703f0d6-3caf-42ba-b224-cb230a4dfa42)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:41.440264 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.511107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=c0d3d1a7-c497-40d6-93d7-f0a6747b1c15,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:41.549907 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-a29b114e-5f7d-4296-a318-2f71a72625e7 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:45:41.550260 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-a29b114e-5f7d-4296-a318-2f71a72625e7 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:45:41.559619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port edccd307-5544-482d-92bc-4a31eeb6ca92 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:41.559988 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.604030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 8160be06-21c8-4d3e-a7d7-af54735fddd1 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:41.622455 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 8160be06-21c8-4d3e-a7d7-af54735fddd1 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:41.623228 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.627754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Pushing event updated for resources: {'Port': ['ID=a9e5c289-e1e2-4485-824e-3e18f4ba6f96,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:41.652735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 0c976339-72c0-495d-b226-0555efa998ac owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:45:41.660593 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4bf57e58-da9d-487e-8b0c-44b0ae5bf91c None None] DHCP port deletion for c7f68380-c906-474f-8407-2e4714dc6877 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:45:41.690813 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4bf57e58-da9d-487e-8b0c-44b0ae5bf91c None None] Deleting port 0c976339-72c0-495d-b226-0555efa998ac {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:45:41.691175 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4bf57e58-da9d-487e-8b0c-44b0ae5bf91c None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.751558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:45:41.756303 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.764918 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Sync routers for ids ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:45:41.780872 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Routers {'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:41.781581 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:41.788288 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c47f82a2-9752-49d6-b62a-79bb806f8d1e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.804186 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-70aa39a3-e316-4c69-8ee2-6933bb148d57 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "PUT /v2.0/routers/f1e265b8-30b0-454f-b7a1-8e4b4bd686b0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 9.3290863 May 12 15:45:41.807200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c47f82a2-9752-49d6-b62a-79bb806f8d1e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.836211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=0c976339-72c0-495d-b226-0555efa998ac,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:41.848565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No DVR routers for this DVR port 0c976339-72c0-495d-b226-0555efa998ac on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:45:41.919829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Attempting to bind port a9e5c289-e1e2-4485-824e-3e18f4ba6f96 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:41.920218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Attempting to bind port a9e5c289-e1e2-4485-824e-3e18f4ba6f96 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:41.926897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Attempting to bind port a9e5c289-e1e2-4485-824e-3e18f4ba6f96 on network 0de89d0f-e308-41b4-8980-4fb156f3c79b {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:41.947092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Port a9e5c289-e1e2-4485-824e-3e18f4ba6f96 on network 0de89d0f-e308-41b4-8980-4fb156f3c79b not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:45:41.949662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Attempting to bind port a9e5c289-e1e2-4485-824e-3e18f4ba6f96 on network 0de89d0f-e308-41b4-8980-4fb156f3c79b {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:41.952358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c47f82a2-9752-49d6-b62a-79bb806f8d1e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e7baea31-2b4d-4448-b8bc-59613aed31bd,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:41.975239 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c47f82a2-9752-49d6-b62a-79bb806f8d1e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:41.981794 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c47f82a2-9752-49d6-b62a-79bb806f8d1e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.8303432 May 12 15:45:41.981998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4bf57e58-da9d-487e-8b0c-44b0ae5bf91c None None] The port '0c976339-72c0-495d-b226-0555efa998ac' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:45:41.985271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45190) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:41.987925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:41.988260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Checking segment: {'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:41.991817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Bound using segment: {'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:41.992271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Bound port: a9e5c289-e1e2-4485-824e-3e18f4ba6f96, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:41.992619 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.041861 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Set router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:42.134686 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.186596 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1d9e219-b178-4940-a763-14a2a78a6382 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.200138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c7f68380-c906-474f-8407-2e4714dc6877']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:42.223427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-9ce4f2da-05e9-4e69-992f-c7500839d387 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1285160968&fields=id&tenant_id=b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 267 time: 0.1186752 May 12 15:45:42.245249 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.247304 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1d9e219-b178-4940-a763-14a2a78a6382 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.311291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] For port a9e5c289-e1e2-4485-824e-3e18f4ba6f96, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:42.318542 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1d9e219-b178-4940-a763-14a2a78a6382 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.320963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '66325ace-1cb7-4f16-9e03-a30ac6c4fc01', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8160be06-21c8-4d3e-a7d7-af54735fddd1'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:45:42.339068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] For port a9e5c289-e1e2-4485-824e-3e18f4ba6f96, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a9e5c289-e1e2-4485-824e-3e18f4ba6f96,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:42.339291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5e065dc4-c922-4e2a-8f89-cf23d6684d63 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:42.346704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1d9e219-b178-4940-a763-14a2a78a6382 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d8bcc91-5941-427b-a811-5fce79ef1244,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:42.360113 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1d9e219-b178-4940-a763-14a2a78a6382 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.361761 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f1d9e219-b178-4940-a763-14a2a78a6382 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-groups/6d8bcc91-5941-427b-a811-5fce79ef1244 HTTP/1.1" status: 204 len: 168 time: 0.3752306 May 12 15:45:42.363451 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.367686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45208) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:42.417454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8703f0d6-3caf-42ba-b224-cb230a4dfa42') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:42.417748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8703f0d6-3caf-42ba-b224-cb230a4dfa42') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:42.468769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:42.469617 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.471310 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] 10.222.0.76 "PUT /v2.0/ports/a9e5c289-e1e2-4485-824e-3e18f4ba6f96 HTTP/1.1" status: 200 len: 1092 time: 3.3761950 May 12 15:45:42.479567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8160be06-21c8-4d3e-a7d7-af54735fddd1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8160be06-21c8-4d3e-a7d7-af54735fddd1,segment=NetworkSegment(41769506-c6e2-4d6c-a537-2d71e8a5e3f7),segment_id=41769506-c6e2-4d6c-a537-2d71e8a5e3f7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:42.485364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2b1086dd-d596-4bdf-ade3-83e3daa10bac', 'tag': 'a9e5c289-e1e2-4485-824e-3e18f4ba6f96'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:45:42.489349 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b5eb5fd5-1213-41cf-8ae1-60da018f9861 None None] Provisioning complete for port 0f3cbe16-d9fe-46b2-b341-ab176c57b531 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:42.489771 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b5eb5fd5-1213-41cf-8ae1-60da018f9861 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.497756 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.508021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d5c0ec0-1ef1-45b9-ab70-413c5badcae8 service neutron] Pushing event updated for resources: {'Port': ['ID=a9e5c289-e1e2-4485-824e-3e18f4ba6f96,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:42.547021 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.567968 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143'}], 'enable_snat': True}, 'gw_port_id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:45:36Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:65:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3654, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:27Z', 'updated_at': '2022-05-12T15:45:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0f3cbe16-d9fe-46b2-b341-ab176c57b531', 'name': '', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:d8:fe:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_interface', 'standard_attr_id': 3670, 'fixed_ips': [{'subnet_id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:34Z', 'updated_at': '2022-05-12T15:45:38Z', 'revision_number': 2, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:42.572907 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Checking router: f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:45:42.573255 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Updating router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 port 0f3cbe16-d9fe-46b2-b341-ab176c57b531 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:45:42.583421 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.594512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-eb1bbf36-83f4-4248-a7b2-70f3960fc8c0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:42.610762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be717dc-7a2c-47df-864b-5bfb771c05d3 req-79437243-1420-417e-9e9c-440f906d755e tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:42.613937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4be717dc-7a2c-47df-864b-5bfb771c05d3 req-79437243-1420-417e-9e9c-440f906d755e tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1053 time: 0.5553300 May 12 15:45:42.621875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Releasing vlan 561 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:45:42.622351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.647268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-eb1bbf36-83f4-4248-a7b2-70f3960fc8c0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:42.648622 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-eb1bbf36-83f4-4248-a7b2-70f3960fc8c0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.2157531 May 12 15:45:42.648982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 5e065dc4-c922-4e2a-8f89-cf23d6684d63 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:42.649900 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.652828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45214) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:42.659687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-451e84e2-eaef-45f4-aabb-ca89621cb0ac tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group': {'name': 'tempest-secgroup--1279387665'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:42.669680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-451e84e2-eaef-45f4-aabb-ca89621cb0ac tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:42.674719 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.696237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-451e84e2-eaef-45f4-aabb-ca89621cb0ac tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:42.700193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-8128bc3d-d14e-42b3-b981-4eb3ed4b7bdb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:42.701994 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-8128bc3d-d14e-42b3-b981-4eb3ed4b7bdb service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=5b43e848e2af491a8dc509c668c33e91&device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1095 time: 0.1699774 May 12 15:45:42.729452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b5eb5fd5-1213-41cf-8ae1-60da018f9861 None None] Port 0f3cbe16-d9fe-46b2-b341-ab176c57b531 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: timer() May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:45:42.771847 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:45:42.779975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81a83c1-1df1-4737-8569-c66358b1009a req-55b2704f-f6fe-4d33-8649-4f9b47eb60c3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:42.785478 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-55b2704f-f6fe-4d33-8649-4f9b47eb60c3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/networks?id=96b03b8b-8b48-4742-a456-9d456e030e73 HTTP/1.1" status: 200 len: 796 time: 0.5609159 May 12 15:45:42.795446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=8160be06-21c8-4d3e-a7d7-af54735fddd1,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:42.813266 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.827220 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3cfd4feb-1aff-4d67-b3da-0350f5206425 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.848259 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.851435 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-451e84e2-eaef-45f4-aabb-ca89621cb0ac tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:42.854413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Network': ['ID=c7f68380-c906-474f-8407-2e4714dc6877,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:42.862324 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-78482fc6-845f-4de9-964e-c99a5fec45fc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/quotas/b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 375 time: 0.0597079 May 12 15:45:42.876178 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-36976c81-1e72-4547-869d-7bcf2a1ea0a3 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a9e5c289-e1e2-4485-824e-3e18f4ba6f96 HTTP/1.1" status: 200 len: 217 time: 0.1653364 May 12 15:45:42.908821 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:42.933465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-451e84e2-eaef-45f4-aabb-ca89621cb0ac tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:42.941269 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-451e84e2-eaef-45f4-aabb-ca89621cb0ac tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:42.945483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-451e84e2-eaef-45f4-aabb-ca89621cb0ac tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:42.954592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-451e84e2-eaef-45f4-aabb-ca89621cb0ac tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:42.963193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4be717dc-7a2c-47df-864b-5bfb771c05d3 req-7237eaa7-55be-4fb5-a1d1-2fdd2966f8b1 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1759934 May 12 15:45:42.963437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-d90922c6-b8fd-477c-afe2-517bb1702d5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:42.964834 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-d90922c6-b8fd-477c-afe2-517bb1702d5e service neutron] 10.222.0.76 "GET /v2.0/subnets?id=25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e HTTP/1.1" status: 200 len: 848 time: 0.0821881 May 12 15:45:43.005267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d6e3cdc6-cf80-47f6-b0db-1fcdd3e7189c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/networks/c7f68380-c906-474f-8407-2e4714dc6877 HTTP/1.1" status: 204 len: 168 time: 2.2102211 May 12 15:45:43.014463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45218) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:43.041883 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:43.042348 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.081304 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-c7fee7ac-35ee-47ec-8afe-4ca6dffbc1f3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2006314 May 12 15:45:43.150420 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.172638 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Transition to ACTIVE for port object 0f3cbe16-d9fe-46b2-b341-ab176c57b531 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:43.181105 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.204523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-699414629'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:43.225863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:43.252699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0c976339-72c0-495d-b226-0555efa998ac no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:45:43.253201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:network and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:43.267197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:43.275749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:43.324960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:43.333593 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 0c976339-72c0-495d-b226-0555efa998ac {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:45:43.333941 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0c976339-72c0-495d-b226-0555efa998ac not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:45:43.344153 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.349914 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.378542 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-52742ea4-3422-42f7-9b30-dd98a1fbeb9b service neutron] 10.222.0.82 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2821116 May 12 15:45:43.404623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-0d530595-39e0-4fd5-9f7d-e0854800c05e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:43.406170 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-0d530595-39e0-4fd5-9f7d-e0854800c05e service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=0de89d0f-e308-41b4-8980-4fb156f3c79b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.4347055 May 12 15:45:43.409919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-451e84e2-eaef-45f4-aabb-ca89621cb0ac tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.436067 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-451e84e2-eaef-45f4-aabb-ca89621cb0ac tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.490741 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-495a81c9-4ffa-4177-849e-ef96b5b3cdbb None None] Pushing event updated for resources: {'Port': ['ID=0f3cbe16-d9fe-46b2-b341-ab176c57b531,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:43.493048 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Attempting to bind port 0f3cbe16-d9fe-46b2-b341-ab176c57b531 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:43.493469 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Attempting to bind port 0f3cbe16-d9fe-46b2-b341-ab176c57b531 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:43.493766 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Attempting to bind port 0f3cbe16-d9fe-46b2-b341-ab176c57b531 on network 96b03b8b-8b48-4742-a456-9d456e030e73 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:43.500149 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:43.500681 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Checking segment: {'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:43.502137 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.502521 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Bound using segment: {'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:43.503120 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Bound port: 0f3cbe16-d9fe-46b2-b341-ab176c57b531, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:43.503488 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.541892 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-451e84e2-eaef-45f4-aabb-ca89621cb0ac tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.545767 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-451e84e2-eaef-45f4-aabb-ca89621cb0ac tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 0.8898153 May 12 15:45:43.554638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 564} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:45:43.555166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45222) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:43.568245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f035a018-7288-4f96-877c-32b88d9b2beb req-74cf01cd-0db6-4710-9989-a31e1e3c1698 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:43.569738 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f035a018-7288-4f96-877c-32b88d9b2beb req-74cf01cd-0db6-4710-9989-a31e1e3c1698 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 946 time: 0.3880320 May 12 15:45:43.575528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group': {'name': 'tempest-secgroup--490154095'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:43.583859 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.584210 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Added segment fc0d3222-c778-4297-9e20-0c4f07609416 of type vlan for network d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8 May 12 15:45:43.594963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-451e84e2-eaef-45f4-aabb-ca89621cb0ac tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroup': ['ID=89b1648c-8146-445d-b052-61db6056211a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:43.599890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:43.610078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:43.611700 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] For port 0f3cbe16-d9fe-46b2-b341-ab176c57b531, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:43.615289 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] For port 0f3cbe16-d9fe-46b2-b341-ab176c57b531, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0f3cbe16-d9fe-46b2-b341-ab176c57b531,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:43.617421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:43.619926 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.642455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.650046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:43.665576 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-87af6121-081e-4c38-9d8f-322a7012d376 service neutron] 10.222.0.76 "GET /v2.0/networks/0de89d0f-e308-41b4-8980-4fb156f3c79b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2529874 May 12 15:45:43.668471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f035a018-7288-4f96-877c-32b88d9b2beb req-c58be93a-f4d5-419b-bcf2-f3ba79d6f529 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0848145 May 12 15:45:43.690703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.702832 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-5b48ec51-c07f-442e-89e0-5478fd6bc4c0 service neutron] 10.222.0.82 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3060508 May 12 15:45:43.717331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:43.723427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:43.726550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:43.733013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:43.746705 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-495a81c9-4ffa-4177-849e-ef96b5b3cdbb None None] Pushing event updated for resources: {'Port': ['ID=0f3cbe16-d9fe-46b2-b341-ab176c57b531,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:43.756369 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Routers {'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:43.757368 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:43.832553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.837505 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.895924 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.916883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:43.918291 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.926922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5a2c83fc-89d8-4f45-8ae6-d66cb17ae961,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:43.985036 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:43.986721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a3d545ba-670c-47ba-8109-4a73c1e92aed tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 0.4282227 May 12 15:45:43.989553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45234) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:43.995959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-49bd300d-d647-40e7-9b46-05d58ab8e2e9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group_rule': {'security_group_id': '89b1648c-8146-445d-b052-61db6056211a', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': '5a2c83fc-89d8-4f45-8ae6-d66cb17ae961', 'remote_ip_prefix': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:44.005781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-49bd300d-d647-40e7-9b46-05d58ab8e2e9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:44.014612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-49bd300d-d647-40e7-9b46-05d58ab8e2e9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:44.018327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-49bd300d-d647-40e7-9b46-05d58ab8e2e9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:44.030878 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-60c04caa-891b-4686-a529-4bdf132e3f71'] response: {'server_uuid': '66325ace-1cb7-4f16-9e03-a30ac6c4fc01', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8160be06-21c8-4d3e-a7d7-af54735fddd1', 'code': 200} May 12 15:45:44.055129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-49bd300d-d647-40e7-9b46-05d58ab8e2e9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:44.074633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52092f9f-0d91-47d5-87ed-eb24f96e6a35 req-3fbfaa03-8b61-4901-ae7d-fa2dba85758f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:44.076197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52092f9f-0d91-47d5-87ed-eb24f96e6a35 req-3fbfaa03-8b61-4901-ae7d-fa2dba85758f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 946 time: 0.2251406 May 12 15:45:44.077666 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] Set router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:44.168027 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-55d73c2d-b202-4d4f-87bb-1b9fa95e2b9d'] response: {'name': 'network-changed', 'server_uuid': '2b1086dd-d596-4bdf-ade3-83e3daa10bac', 'tag': 'a9e5c289-e1e2-4485-824e-3e18f4ba6f96', 'status': 'completed', 'code': 200} May 12 15:45:44.199591 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-49bd300d-d647-40e7-9b46-05d58ab8e2e9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:44.236725 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 1.2126019 May 12 15:45:44.243662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45240) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:44.257733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52092f9f-0d91-47d5-87ed-eb24f96e6a35 req-217b268f-777c-41ca-ba28-4dd9652a7618 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1666746 May 12 15:45:44.285143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': 'd4f0eb48-f987-4fb2-b69d-f3358a3b0ae8', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:44.424132 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0ebcad08-d42c-4d3f-998e-ec36fd612f3b req-ad3a0b9f-e4cb-4ded-a483-48491188648d service neutron] 10.222.0.76 "GET /v2.0/networks/0de89d0f-e308-41b4-8980-4fb156f3c79b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7462149 May 12 15:45:44.432820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:44.436267 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:44.439893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:44.446973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:44.458969 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2202cc17-0650-4555-a666-530359cf67aa req-39419832-dc12-4b68-b3fb-8ffa9d6704d2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 210 time: 0.0793538 May 12 15:45:44.460796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf71c815-7e22-4026-a4be-e3f1533a4d5f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Network': ['ID=d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:44.465101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:44.471038 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:44.476622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:45:44.502292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63f7d738-e96d-41b2-8e19-60c6071b9f4e req-6fd6df51-910f-476a-bcb7-6bc0fce5935b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:44.511938 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63f7d738-e96d-41b2-8e19-60c6071b9f4e req-6fd6df51-910f-476a-bcb7-6bc0fce5935b service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 1097 time: 0.3637145 May 12 15:45:44.544729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f1d9889-8f84-46a1-9e91-4bd62dc84afd req-c2f0b5d4-5a90-4002-8e61-d2b8564950a3 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:44.552173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f1d9889-8f84-46a1-9e91-4bd62dc84afd req-c2f0b5d4-5a90-4002-8e61-d2b8564950a3 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 946 time: 0.2580311 May 12 15:45:44.600383 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-49bd300d-d647-40e7-9b46-05d58ab8e2e9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:44.639932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f1d9889-8f84-46a1-9e91-4bd62dc84afd req-631dce07-4415-4646-9211-89826f2478a3 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0867851 May 12 15:45:44.657979 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-49bd300d-d647-40e7-9b46-05d58ab8e2e9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:44.659666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45248) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:44.667584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63f7d738-e96d-41b2-8e19-60c6071b9f4e req-2960893c-0ce4-4a82-86d5-fa9a7fc0bb23 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1524637 May 12 15:45:44.690633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49bd300d-d647-40e7-9b46-05d58ab8e2e9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5b2f8fc0-dbdd-4622-836c-82ef21c17e34,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:44.711570 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-49bd300d-d647-40e7-9b46-05d58ab8e2e9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:44.713632 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-49bd300d-d647-40e7-9b46-05d58ab8e2e9 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.7228508 May 12 15:45:44.715526 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143'}], 'enable_snat': True}, 'gw_port_id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:45:36Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:65:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3654, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:27Z', 'updated_at': '2022-05-12T15:45:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0f3cbe16-d9fe-46b2-b341-ab176c57b531', 'name': '', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:d8:fe:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_interface', 'standard_attr_id': 3670, 'fixed_ips': [{'subnet_id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:34Z', 'updated_at': '2022-05-12T15:45:43Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:44.716624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45254) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:44.727155 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d522ca81-449e-488a-88f5-5f60dcd8c26e None None] The sync data for ids ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'] in n-d-841483-1 is: [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143'}], 'enable_snat': True}, 'gw_port_id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:45:36Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:65:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3654, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:27Z', 'updated_at': '2022-05-12T15:45:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0f3cbe16-d9fe-46b2-b341-ab176c57b531', 'name': '', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:d8:fe:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_interface', 'standard_attr_id': 3670, 'fixed_ips': [{'subnet_id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:34Z', 'updated_at': '2022-05-12T15:45:43Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:45:44.796641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-049152d5-2484-4622-a0e3-ef2b4e767dc4 req-0c8e8189-8697-4166-977a-a2cd1037e3a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:44.797516 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-049152d5-2484-4622-a0e3-ef2b4e767dc4 req-0c8e8189-8697-4166-977a-a2cd1037e3a1 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=5b43e848e2af491a8dc509c668c33e91&device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1095 time: 0.3059678 May 12 15:45:44.910966 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-719bbf2a-1270-412c-ac60-6399bb5d259e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:44.928240 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-719bbf2a-1270-412c-ac60-6399bb5d259e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:44.973565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29f55529-d20b-41dc-9d1a-92097c407e08 req-a25b8d72-5775-45f0-bb66-5c2216e56e98 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:44.975274 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29f55529-d20b-41dc-9d1a-92097c407e08 req-a25b8d72-5775-45f0-bb66-5c2216e56e98 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1095 time: 0.2392526 May 12 15:45:45.013879 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-719bbf2a-1270-412c-ac60-6399bb5d259e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:45.053269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38dd43a8-85e2-4c0f-8f1d-79c1b6a5dab1 tempest-TestVolumeBackupRestore-1119599373 tempest-TestVolumeBackupRestore-1119599373-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:45.054115 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-38dd43a8-85e2-4c0f-8f1d-79c1b6a5dab1 tempest-TestVolumeBackupRestore-1119599373 tempest-TestVolumeBackupRestore-1119599373-project-admin] Synchronizing usage tracker for tenant:d5937b60103242ddb97055720836a8ff on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:45.056811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-719bbf2a-1270-412c-ac60-6399bb5d259e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=5b2f8fc0-dbdd-4622-836c-82ef21c17e34,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:45.065061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-719bbf2a-1270-412c-ac60-6399bb5d259e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:45.066505 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-719bbf2a-1270-412c-ac60-6399bb5d259e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/5b2f8fc0-dbdd-4622-836c-82ef21c17e34 HTTP/1.1" status: 204 len: 168 time: 0.3486025 May 12 15:45:45.069945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45258) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:45.070077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:45.086555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29f55529-d20b-41dc-9d1a-92097c407e08 req-2abee905-238a-4510-b54c-b21ec506c7e5 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1018009 May 12 15:45:45.103332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-38dd43a8-85e2-4c0f-8f1d-79c1b6a5dab1 tempest-TestVolumeBackupRestore-1119599373 tempest-TestVolumeBackupRestore-1119599373-project-admin] Unset dirty status for tenant:d5937b60103242ddb97055720836a8ff on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:45.106089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-38dd43a8-85e2-4c0f-8f1d-79c1b6a5dab1 tempest-TestVolumeBackupRestore-1119599373 tempest-TestVolumeBackupRestore-1119599373-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 1092 time: 0.4375985 May 12 15:45:45.110254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45262) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:45.116234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-049152d5-2484-4622-a0e3-ef2b4e767dc4 req-3bd941ef-e894-47d6-ad40-4a1c538a9b73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:45.117713 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-049152d5-2484-4622-a0e3-ef2b4e767dc4 req-3bd941ef-e894-47d6-ad40-4a1c538a9b73 service neutron] 10.222.0.76 "GET /v2.0/networks?id=0de89d0f-e308-41b4-8980-4fb156f3c79b HTTP/1.1" status: 200 len: 910 time: 0.3138301 May 12 15:45:45.118134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'fixed_ip_address': '172.20.0.14'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:45.133712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:45.143236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Usage tracker for resource:floatingip and tenant:0528307b42774c45be9eba4ffc91c8dd is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:45.146242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:45.159442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:45.182133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bd5767ee-c629-4c5b-b34d-beac6a84b446 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:45.193377 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:45.222818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Subnet': ['ID=4fa38328-6c61-4ac7-b76e-d91d29d426a8,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:45.241831 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-049152d5-2484-4622-a0e3-ef2b4e767dc4 req-ff8387a7-f584-4b49-88aa-8828246dc5f2 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a9e5c289-e1e2-4485-824e-3e18f4ba6f96 HTTP/1.1" status: 200 len: 217 time: 0.1130250 May 12 15:45:45.313538 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-99f76396-4e8e-45da-98ee-68398eca12e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:45.335197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Checking segment: {'id': 'fc0d3222-c778-4297-9e20-0c4f07609416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'd4f0eb48-f987-4fb2-b69d-f3358a3b0ae8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:45.336142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network hostable DHCP agents. Network: d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:45:45.369789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-049152d5-2484-4622-a0e3-ef2b4e767dc4 req-21ad9650-ea7a-4785-b247-f925e99837dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:45.371271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-049152d5-2484-4622-a0e3-ef2b4e767dc4 req-21ad9650-ea7a-4785-b247-f925e99837dc service neutron] 10.222.0.76 "GET /v2.0/subnets?id=25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e HTTP/1.1" status: 200 len: 848 time: 0.1171474 May 12 15:45:45.420978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:45:45.457613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:45.464814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:45.465415 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:45.465655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e64ebc94-0c9a-4ce0-84e4-9653350070aa None None] Network d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:45.490789 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aa311b98-13c6-45b8-b6ab-4d56f8897b60 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2416894 May 12 15:45:45.494231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45268) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:45.500705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bd5767ee-c629-4c5b-b34d-beac6a84b446 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:45.502644 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bd5767ee-c629-4c5b-b34d-beac6a84b446 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.4199784 May 12 15:45:45.507186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-049152d5-2484-4622-a0e3-ef2b4e767dc4 req-37923459-bd56-46c4-8e94-2bb91fe88fdf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:45.508866 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-049152d5-2484-4622-a0e3-ef2b4e767dc4 req-37923459-bd56-46c4-8e94-2bb91fe88fdf service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=0de89d0f-e308-41b4-8980-4fb156f3c79b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1298854 May 12 15:45:45.509398 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45272) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:45.557427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'network_id': 'd4f0eb48-f987-4fb2-b69d-f3358a3b0ae8', 'name': 'tempest-PortsIpV6TestJSON-30348620', 'fixed_ips': [{'subnet_id': '4fa38328-6c61-4ac7-b76e-d91d29d426a8', 'ip_address': '2001:db8::10'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:45.717041 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-22f57f35-c28d-4c94-8e9b-7e8919d8f98f tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:45.773638 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-049152d5-2484-4622-a0e3-ef2b4e767dc4 req-d6ec74d7-b593-4456-b5b1-abc53ca76925 service neutron] 10.222.0.76 "GET /v2.0/networks/0de89d0f-e308-41b4-8980-4fb156f3c79b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2469709 May 12 15:45:45.800244 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1475e2c-67d3-4509-a22e-95ebccdbbcec req-e5f8bc87-c4ac-4ad0-b143-542614e01214 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 210 time: 0.1183734 May 12 15:45:45.802937 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-22f57f35-c28d-4c94-8e9b-7e8919d8f98f tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:45.804996 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8', 'network_id': 'd4f0eb48-f987-4fb2-b69d-f3358a3b0ae8', 'tenant_id': '1da2b935bcd34292b3e8ce00cc114001', 'fixed_ips': [{'subnet_id': '4fa38328-6c61-4ac7-b76e-d91d29d426a8'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:45:45.805907 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:45.875965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d147815a-a262-4d62-b2a1-56d5101e62ee req-f06a0a30-0ca2-4309-ae2b-ab659432f366 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:45.883767 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d147815a-a262-4d62-b2a1-56d5101e62ee req-f06a0a30-0ca2-4309-ae2b-ab659432f366 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 946 time: 0.3915644 May 12 15:45:45.916072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:45.938079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:port and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:45.945142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:45.988935 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d147815a-a262-4d62-b2a1-56d5101e62ee req-43de97fe-c6ad-468e-8a14-8cd214962ddb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1040928 May 12 15:45:45.990634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:46.004550 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.092958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:46.138453 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.240930 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-049152d5-2484-4622-a0e3-ef2b4e767dc4 req-cc19b129-c7b0-47c4-a0e0-97ce896bfac1 service neutron] 10.222.0.76 "GET /v2.0/networks/0de89d0f-e308-41b4-8980-4fb156f3c79b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4612603 May 12 15:45:46.244341 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-22f57f35-c28d-4c94-8e9b-7e8919d8f98f tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.318984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22f57f35-c28d-4c94-8e9b-7e8919d8f98f tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a2c83fc-89d8-4f45-8ae6-d66cb17ae961,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:46.348583 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-22f57f35-c28d-4c94-8e9b-7e8919d8f98f tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.352075 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-22f57f35-c28d-4c94-8e9b-7e8919d8f98f tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-groups/5a2c83fc-89d8-4f45-8ae6-d66cb17ae961 HTTP/1.1" status: 204 len: 168 time: 0.8407004 May 12 15:45:46.353572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45280) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:46.374188 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.400635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Allocated IP 2001:db8::2 (d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8/4fa38328-6c61-4ac7-b76e-d91d29d426a8/744f8a21-d50c-4467-bda4-c12ea144be03) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:46.405802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0f3cbe16-d9fe-46b2-b341-ab176c57b531 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:46.462488 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.485899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c06b29f9-57ea-4fe2-8f5e-def73123a5ba tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:46.502765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c06b29f9-57ea-4fe2-8f5e-def73123a5ba tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:46.507299 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c06b29f9-57ea-4fe2-8f5e-def73123a5ba tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4511 time: 0.1525640 May 12 15:45:46.507990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45284) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:46.565652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 0f3cbe16-d9fe-46b2-b341-ab176c57b531 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:46.582734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0f3cbe16-d9fe-46b2-b341-ab176c57b531 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:46.583096 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.587475 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123cd551-7cec-4a11-9f81-a9ce29bf0b4e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.618023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123cd551-7cec-4a11-9f81-a9ce29bf0b4e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.621405 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port ec817eb9-960b-41e8-aa65-0c6b88cd81da yet. {{(pid=88152) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:45:46.674912 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123cd551-7cec-4a11-9f81-a9ce29bf0b4e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.696579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-123cd551-7cec-4a11-9f81-a9ce29bf0b4e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=89b1648c-8146-445d-b052-61db6056211a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:46.715766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-123cd551-7cec-4a11-9f81-a9ce29bf0b4e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.719898 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-123cd551-7cec-4a11-9f81-a9ce29bf0b4e tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-groups/89b1648c-8146-445d-b052-61db6056211a HTTP/1.1" status: 204 len: 168 time: 0.2078879 May 12 15:45:46.720137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45288) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:46.775715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c99a0f38-7e9a-4c33-bc3c-5b2a556fd731 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:46.793921 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c99a0f38-7e9a-4c33-bc3c-5b2a556fd731 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:46.798664 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c99a0f38-7e9a-4c33-bc3c-5b2a556fd731 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.0737782 May 12 15:45:46.800881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45292) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:46.807469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ee47f2e7-434f-4cd9-9156-9dd93f5ff7e0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group': {'name': 'tempest-secgroup--611473557'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:46.813970 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.815738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ee47f2e7-434f-4cd9-9156-9dd93f5ff7e0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:46.825681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ee47f2e7-434f-4cd9-9156-9dd93f5ff7e0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:46.836248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee47f2e7-434f-4cd9-9156-9dd93f5ff7e0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.847710 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.861267 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ee47f2e7-434f-4cd9-9156-9dd93f5ff7e0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:46.865931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ee47f2e7-434f-4cd9-9156-9dd93f5ff7e0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:46.870009 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ee47f2e7-434f-4cd9-9156-9dd93f5ff7e0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:46.872098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Allocated IP 172.25.8.189 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/d36b134c-f863-4d2d-9c1a-8e2d37464082) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:46.877828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ee47f2e7-434f-4cd9-9156-9dd93f5ff7e0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:46.878561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Transition to ACTIVE for port object 744f8a21-d50c-4467-bda4-c12ea144be03 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:46.904313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 0f3cbe16-d9fe-46b2-b341-ab176c57b531, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0f3cbe16-d9fe-46b2-b341-ab176c57b531,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:46.907199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Transition to ACTIVE for port object 744f8a21-d50c-4467-bda4-c12ea144be03 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:46.910147 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.944334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84a0ba75-ee3d-4dd7-ad03-7d3c124bbf27 req-05489632-0523-48cf-88da-bd1821ea0ad4 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:46.949968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-84a0ba75-ee3d-4dd7-ad03-7d3c124bbf27 req-05489632-0523-48cf-88da-bd1821ea0ad4 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1095 time: 0.4471304 May 12 15:45:46.956667 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.967023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81a83c1-1df1-4737-8569-c66358b1009a req-29d30099-9399-443d-89e4-fbd82d7dda6b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:46.968396 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-29d30099-9399-443d-89e4-fbd82d7dda6b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.84 "GET /v2.0/networks?id=96b03b8b-8b48-4742-a456-9d456e030e73 HTTP/1.1" status: 200 len: 796 time: 0.8559239 May 12 15:45:46.979279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee47f2e7-434f-4cd9-9156-9dd93f5ff7e0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.984535 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee47f2e7-434f-4cd9-9156-9dd93f5ff7e0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:46.988626 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Network d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:46.991533 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:46.993781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:46.998782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=0f3cbe16-d9fe-46b2-b341-ab176c57b531,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:47.037098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee47f2e7-434f-4cd9-9156-9dd93f5ff7e0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c61342b1-17a8-4b08-be92-f73d9321a2bc,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:47.061757 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ee47f2e7-434f-4cd9-9156-9dd93f5ff7e0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.067544 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ee47f2e7-434f-4cd9-9156-9dd93f5ff7e0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 0.2614548 May 12 15:45:47.067544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45300) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:47.071810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f8465830-1c03-49ce-b4e4-912c5a09dfda tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group_rule': {'security_group_id': 'c61342b1-17a8-4b08-be92-f73d9321a2bc', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:47.078440 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f8465830-1c03-49ce-b4e4-912c5a09dfda tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:47.082871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f8465830-1c03-49ce-b4e4-912c5a09dfda tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:47.085811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f8465830-1c03-49ce-b4e4-912c5a09dfda tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:47.091448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f8465830-1c03-49ce-b4e4-912c5a09dfda tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:47.111772 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8465830-1c03-49ce-b4e4-912c5a09dfda tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.121295 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f590a66-a706-49be-b6ea-2ab9cc9af1b1 req-ce32d761-c919-4513-90fb-4b3b5672912a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 210 time: 0.1610894 May 12 15:45:47.154429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Attempting to bind port 744f8a21-d50c-4467-bda4-c12ea144be03 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:47.154791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Attempting to bind port 744f8a21-d50c-4467-bda4-c12ea144be03 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'fc0d3222-c778-4297-9e20-0c4f07609416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'd4f0eb48-f987-4fb2-b69d-f3358a3b0ae8'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:47.155145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Attempting to bind port 744f8a21-d50c-4467-bda4-c12ea144be03 on network d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:47.158521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Pushing event updated for resources: {'Port': ['ID=744f8a21-d50c-4467-bda4-c12ea144be03,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:47.172733 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:47.173103 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Checking segment: {'id': 'fc0d3222-c778-4297-9e20-0c4f07609416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'd4f0eb48-f987-4fb2-b69d-f3358a3b0ae8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:47.173534 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.173923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Bound using segment: {'id': 'fc0d3222-c778-4297-9e20-0c4f07609416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'd4f0eb48-f987-4fb2-b69d-f3358a3b0ae8'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:47.174390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Bound port: 744f8a21-d50c-4467-bda4-c12ea144be03, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fc0d3222-c778-4297-9e20-0c4f07609416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': 'd4f0eb48-f987-4fb2-b69d-f3358a3b0ae8'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:47.174750 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.226069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-84a0ba75-ee3d-4dd7-ad03-7d3c124bbf27 req-aee9047a-c6d2-45fd-9e4a-739895a1c99b tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2528729 May 12 15:45:47.239258 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8465830-1c03-49ce-b4e4-912c5a09dfda tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.244057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Allocated IP 2001:db8::10 (d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8/4fa38328-6c61-4ac7-b76e-d91d29d426a8/ec817eb9-960b-41e8-aa65-0c6b88cd81da) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:47.249724 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-09670380-0a56-4e1d-a64e-f16a39734d0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 380 time: 0.2138903 May 12 15:45:47.254203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8465830-1c03-49ce-b4e4-912c5a09dfda tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.262770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'port': {'device_id': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'admin_state_up': True, 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'security_groups': ['93d6a643-d4d6-485b-81ac-56893147cebc']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:47.290616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] For port 744f8a21-d50c-4467-bda4-c12ea144be03, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:47.294473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8465830-1c03-49ce-b4e4-912c5a09dfda tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0b94d404-c2a0-49cd-a97e-85f75bd4f53d,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:47.295080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] For port 744f8a21-d50c-4467-bda4-c12ea144be03, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=744f8a21-d50c-4467-bda4-c12ea144be03,segment=NetworkSegment(fc0d3222-c778-4297-9e20-0c4f07609416),segment_id=fc0d3222-c778-4297-9e20-0c4f07609416)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:47.302614 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.305202 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8465830-1c03-49ce-b4e4-912c5a09dfda tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.309649 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f8465830-1c03-49ce-b4e4-912c5a09dfda tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.2423859 May 12 15:45:47.310381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45304) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:47.353008 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a66c8aad-29f8-4523-9f8f-6ab4fca15489 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.364912 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a66c8aad-29f8-4523-9f8f-6ab4fca15489 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.392639 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a66c8aad-29f8-4523-9f8f-6ab4fca15489 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.398419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-101f60a0-3442-4e30-9f0c-ef720b5a3288 None None] Pushing event updated for resources: {'Port': ['ID=744f8a21-d50c-4467-bda4-c12ea144be03,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:47.418781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a66c8aad-29f8-4523-9f8f-6ab4fca15489 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=0b94d404-c2a0-49cd-a97e-85f75bd4f53d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:47.423705 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a66c8aad-29f8-4523-9f8f-6ab4fca15489 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.424960 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a66c8aad-29f8-4523-9f8f-6ab4fca15489 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/0b94d404-c2a0-49cd-a97e-85f75bd4f53d HTTP/1.1" status: 204 len: 168 time: 0.1130912 May 12 15:45:47.427608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45308) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:47.477002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d2f67257-e67a-421c-b805-815a49fdb136 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:47.495271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d2f67257-e67a-421c-b805-815a49fdb136 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:47.496848 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d2f67257-e67a-421c-b805-815a49fdb136 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0681181 May 12 15:45:47.498167 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.499796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45312) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:47.573552 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03003399-fc75-4689-83fd-d210b9cfad9a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.609187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03003399-fc75-4689-83fd-d210b9cfad9a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.678978 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03003399-fc75-4689-83fd-d210b9cfad9a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.707636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03003399-fc75-4689-83fd-d210b9cfad9a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c61342b1-17a8-4b08-be92-f73d9321a2bc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:47.720038 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03003399-fc75-4689-83fd-d210b9cfad9a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.722009 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-03003399-fc75-4689-83fd-d210b9cfad9a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-groups/c61342b1-17a8-4b08-be92-f73d9321a2bc HTTP/1.1" status: 204 len: 168 time: 0.2206025 May 12 15:45:47.725131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45316) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:47.756836 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.786350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-587adc58-a2d3-4085-a17b-4dfbee932b17 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:47.799515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50eb1b8b-d785-4d71-8fa6-a354273acc4d req-d4d4e216-80ce-41a4-ab4c-da73f4437edf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:47.800980 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50eb1b8b-d785-4d71-8fa6-a354273acc4d req-d4d4e216-80ce-41a4-ab4c-da73f4437edf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 946 time: 0.5484481 May 12 15:45:47.803373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:47.810974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-587adc58-a2d3-4085-a17b-4dfbee932b17 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:47.818177 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-587adc58-a2d3-4085-a17b-4dfbee932b17 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.0923634 May 12 15:45:47.819360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45320) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:47.824580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ba977339-b668-4a1f-89f5-0ab69834393a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group': {'name': 'tempest-secgroup--1593140417'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:47.826559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:port and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:47.832525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ba977339-b668-4a1f-89f5-0ab69834393a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:47.841729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:47.842218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ba977339-b668-4a1f-89f5-0ab69834393a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:47.853227 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba977339-b668-4a1f-89f5-0ab69834393a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.854322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:47.875253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ba977339-b668-4a1f-89f5-0ab69834393a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:47.879298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ba977339-b668-4a1f-89f5-0ab69834393a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:47.882808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ba977339-b668-4a1f-89f5-0ab69834393a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:47.888953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ba977339-b668-4a1f-89f5-0ab69834393a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:47.907222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Made reservation on behalf of b88b5989d4c548dba6124f2e4690e5c3 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:47.910676 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.952035 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50eb1b8b-d785-4d71-8fa6-a354273acc4d req-9b45a82d-f115-462d-a14f-14cf7da8d74b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1403728 May 12 15:45:47.956646 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.974780 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba977339-b668-4a1f-89f5-0ab69834393a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:47.979068 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba977339-b668-4a1f-89f5-0ab69834393a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.032488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba977339-b668-4a1f-89f5-0ab69834393a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroup': ['ID=276c9eed-c2b8-4e4a-9624-24271cc931e1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:48.044167 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba977339-b668-4a1f-89f5-0ab69834393a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.047296 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ba977339-b668-4a1f-89f5-0ab69834393a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 0.2257874 May 12 15:45:48.049779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45326) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:48.055922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-300f8a7b-a43a-43ac-8fdf-278de8592116 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group_rule': {'security_group_id': '276c9eed-c2b8-4e4a-9624-24271cc931e1', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:48.063499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-300f8a7b-a43a-43ac-8fdf-278de8592116 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:48.067880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-300f8a7b-a43a-43ac-8fdf-278de8592116 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:48.070966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-300f8a7b-a43a-43ac-8fdf-278de8592116 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:48.073953 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.078813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-300f8a7b-a43a-43ac-8fdf-278de8592116 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:48.097510 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-300f8a7b-a43a-43ac-8fdf-278de8592116 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.154117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:48.172690 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-300f8a7b-a43a-43ac-8fdf-278de8592116 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.180311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:48.184390 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-300f8a7b-a43a-43ac-8fdf-278de8592116 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.189977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:48.223313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-300f8a7b-a43a-43ac-8fdf-278de8592116 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dc35c68b-d980-4d46-9d0d-259845a14e97,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:48.242985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-300f8a7b-a43a-43ac-8fdf-278de8592116 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.244866 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-300f8a7b-a43a-43ac-8fdf-278de8592116 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1940460 May 12 15:45:48.247474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45332) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:48.255447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Transition to ACTIVE for port object ec817eb9-960b-41e8-aa65-0c6b88cd81da will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:48.275253 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-78c7812a-5782-4d72-af7e-e79b68ef05a2 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules/dc35c68b-d980-4d46-9d0d-259845a14e97 HTTP/1.1" status: 200 len: 763 time: 0.0261550 May 12 15:45:48.277744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45338) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:48.285489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Pushing event updated for resources: {'Port': ['ID=d36b134c-f863-4d2d-9c1a-8e2d37464082,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:48.337206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-aa488b19-499e-43b9-83dc-a059a753458c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:48.363594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-aa488b19-499e-43b9-83dc-a059a753458c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:48.365265 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aa488b19-499e-43b9-83dc-a059a753458c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0864596 May 12 15:45:48.369292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45342) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:48.400880 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b6ba354-c197-44c2-bbdd-3259f3a0334d tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.413642 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b6ba354-c197-44c2-bbdd-3259f3a0334d tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.445101 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.458946 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b6ba354-c197-44c2-bbdd-3259f3a0334d tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.479497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b6ba354-c197-44c2-bbdd-3259f3a0334d tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=dc35c68b-d980-4d46-9d0d-259845a14e97,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:48.484651 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 744f8a21-d50c-4467-bda4-c12ea144be03 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:48.491410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b6ba354-c197-44c2-bbdd-3259f3a0334d tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.493138 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1b6ba354-c197-44c2-bbdd-3259f3a0334d tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/dc35c68b-d980-4d46-9d0d-259845a14e97 HTTP/1.1" status: 204 len: 168 time: 0.1227539 May 12 15:45:48.495696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45346) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:48.553870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-be90edce-1160-48b1-b9a0-43c2f1727779 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:48.571914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 744f8a21-d50c-4467-bda4-c12ea144be03 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:48.576926 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5808380-bbb0-48de-9c51-57bab650db22 req-c2fe320d-3d11-4bb4-8e62-83e9c1a9e806 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 210 time: 0.2248697 May 12 15:45:48.579579 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0f3cbe16-d9fe-46b2-b341-ab176c57b531 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:48.584637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-be90edce-1160-48b1-b9a0-43c2f1727779 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:48.586090 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-be90edce-1160-48b1-b9a0-43c2f1727779 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0893965 May 12 15:45:48.588674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45350) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:48.594075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a56ec689-e840-42d3-afc6-39a374a49ace tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group_rule': {'security_group_id': '276c9eed-c2b8-4e4a-9624-24271cc931e1', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:48.598843 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:48.614939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a56ec689-e840-42d3-afc6-39a374a49ace tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:48.630551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a56ec689-e840-42d3-afc6-39a374a49ace tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:48.647542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:48.649903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:48.656233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:48.657272 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.664560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f89af274-58a0-46b8-bf96-8d128d79f697 None None] Network d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:48.666450 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a56ec689-e840-42d3-afc6-39a374a49ace tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.705904 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 3.2074552 May 12 15:45:48.710557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45354) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:48.720480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'network_id': 'd4f0eb48-f987-4fb2-b69d-f3358a3b0ae8', 'name': 'tempest-PortsIpV6TestJSON-83602263', 'fixed_ips': [{'subnet_id': '4fa38328-6c61-4ac7-b76e-d91d29d426a8', 'ip_address': '2001:db8::f'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:48.725006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.20.0.5 (96b03b8b-8b48-4742-a456-9d456e030e73/7ee4997d-d763-4a38-bf54-c1153ac3e51c/2a5ee9ef-0363-4a82-b382-c38a8d19f1c6) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:48.773802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0f3cbe16-d9fe-46b2-b341-ab176c57b531 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:48.774630 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.777062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d0595b7-f169-430c-984f-fd228cb53d06 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=ec817eb9-960b-41e8-aa65-0c6b88cd81da,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:48.797770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2d37439-a91f-45af-986a-5ac63310d37b req-5a24d5d9-c87b-4361-92fc-976d302f6c43 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:48.799593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2d37439-a91f-45af-986a-5ac63310d37b req-5a24d5d9-c87b-4361-92fc-976d302f6c43 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 946 time: 0.6974986 May 12 15:45:48.845548 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a56ec689-e840-42d3-afc6-39a374a49ace tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.850834 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9c574b2e-e3c6-46c9-b5ee-46682510071f None None] Provisioning for port 744f8a21-d50c-4467-bda4-c12ea144be03 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:48.857264 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a56ec689-e840-42d3-afc6-39a374a49ace tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.902592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a56ec689-e840-42d3-afc6-39a374a49ace tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b62319a2-6ea5-4ae0-83d3-3f045b600dd3,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:48.906975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9c574b2e-e3c6-46c9-b5ee-46682510071f None None] Provisioning complete for port 744f8a21-d50c-4467-bda4-c12ea144be03 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:48.907448 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9c574b2e-e3c6-46c9-b5ee-46682510071f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.923730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:48.929726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:port and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:48.933485 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a56ec689-e840-42d3-afc6-39a374a49ace tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:48.937275 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a56ec689-e840-42d3-afc6-39a374a49ace tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3450060 May 12 15:45:48.937275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:48.940369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45358) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:48.952891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:48.969609 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8f6320d2-22b1-43c9-b9a9-5e927b4a5c3f tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules/b62319a2-6ea5-4ae0-83d3-3f045b600dd3 HTTP/1.1" status: 200 len: 763 time: 0.0264523 May 12 15:45:48.969884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45362) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:48.988131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:48.993260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a9e5c289-e1e2-4485-824e-3e18f4ba6f96 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:45:48.997588 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2d37439-a91f-45af-986a-5ac63310d37b req-8721c523-977c-4bcc-8198-3528faed1cb6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1779904 May 12 15:45:49.110815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-172f6ab2-4528-459b-8c8f-5ef005618198 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:49.157429 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.168186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-172f6ab2-4528-459b-8c8f-5ef005618198 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:49.172115 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-172f6ab2-4528-459b-8c8f-5ef005618198 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.1987429 May 12 15:45:49.174424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45370) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:49.177213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab42f98d-c0a6-4838-9456-be4f13e8d917 req-80d8e682-4668-4c02-b8c1-9dc95f7dbd1a tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:49.178794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab42f98d-c0a6-4838-9456-be4f13e8d917 req-80d8e682-4668-4c02-b8c1-9dc95f7dbd1a tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1095 time: 0.4381435 May 12 15:45:49.197813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port c2face68-819e-48bb-aaab-5d33bb59f0eb yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:45:49.261915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e43acfe-6130-4ea8-bdb2-aee50882c001 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.287752 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e43acfe-6130-4ea8-bdb2-aee50882c001 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.295859 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab42f98d-c0a6-4838-9456-be4f13e8d917 req-d05427a0-7985-4cde-8ccb-da2c32ae9cde tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1014645 May 12 15:45:49.331672 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.375146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Transition to ACTIVE for port object 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:49.375761 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e43acfe-6130-4ea8-bdb2-aee50882c001 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.378868 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9c574b2e-e3c6-46c9-b5ee-46682510071f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.402084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e43acfe-6130-4ea8-bdb2-aee50882c001 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=b62319a2-6ea5-4ae0-83d3-3f045b600dd3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:49.415169 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.439924 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.457340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a9e5c289-e1e2-4485-824e-3e18f4ba6f96, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a9e5c289-e1e2-4485-824e-3e18f4ba6f96,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:49.467032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9c574b2e-e3c6-46c9-b5ee-46682510071f None None] For port 744f8a21-d50c-4467-bda4-c12ea144be03, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=744f8a21-d50c-4467-bda4-c12ea144be03,segment=NetworkSegment(fc0d3222-c778-4297-9e20-0c4f07609416),segment_id=fc0d3222-c778-4297-9e20-0c4f07609416)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:49.472381 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e43acfe-6130-4ea8-bdb2-aee50882c001 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.472904 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9c574b2e-e3c6-46c9-b5ee-46682510071f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.473778 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6e43acfe-6130-4ea8-bdb2-aee50882c001 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/b62319a2-6ea5-4ae0-83d3-3f045b600dd3 HTTP/1.1" status: 204 len: 168 time: 0.3004036 May 12 15:45:49.476570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45374) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:49.510467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'a9e5c289-e1e2-4485-824e-3e18f4ba6f96', 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b', 'port_id': 'a9e5c289-e1e2-4485-824e-3e18f4ba6f96', 'mac_address': 'fa:16:3e:bd:2a:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 586, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:45:49.512839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Allocated IP 2001:db8::f (d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8/4fa38328-6c61-4ac7-b76e-d91d29d426a8/c2face68-819e-48bb-aaab-5d33bb59f0eb) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:49.559183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-efc8268f-f300-4145-ad51-5dc7392ebf14 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:49.613146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 96b03b8b-8b48-4742-a456-9d456e030e73 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:49.620055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:49.620288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c574b2e-e3c6-46c9-b5ee-46682510071f None None] Pushing event updated for resources: {'Port': ['ID=744f8a21-d50c-4467-bda4-c12ea144be03,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:49.625345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:49.625540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-efc8268f-f300-4145-ad51-5dc7392ebf14 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:49.625638 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.631102 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-efc8268f-f300-4145-ad51-5dc7392ebf14 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1534503 May 12 15:45:49.632179 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:49.635314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45380) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:49.646015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ae9a8e8b-aaf9-4719-ac95-aba73a032f61 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group_rule': {'security_group_id': '276c9eed-c2b8-4e4a-9624-24271cc931e1', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:49.655828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ae9a8e8b-aaf9-4719-ac95-aba73a032f61 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:49.670526 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a9e5c289-e1e2-4485-824e-3e18f4ba6f96 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:45:49.686687 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.716850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a9e5c289-e1e2-4485-824e-3e18f4ba6f96, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a9e5c289-e1e2-4485-824e-3e18f4ba6f96,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:49.741496 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.757236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ae9a8e8b-aaf9-4719-ac95-aba73a032f61 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:49.826000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a9e5c289-e1e2-4485-824e-3e18f4ba6f96,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:49.832194 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ae9a8e8b-aaf9-4719-ac95-aba73a032f61 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.916828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a4725303-ec65-4190-a6a0-38536504cbce None None] Provisioning for port ec817eb9-960b-41e8-aa65-0c6b88cd81da completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:49.924768 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.927376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a4725303-ec65-4190-a6a0-38536504cbce None None] Provisioning complete for port ec817eb9-960b-41e8-aa65-0c6b88cd81da triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:49.928097 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4725303-ec65-4190-a6a0-38536504cbce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.956851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Transition to ACTIVE for port object c2face68-819e-48bb-aaab-5d33bb59f0eb will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:49.959305 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ae9a8e8b-aaf9-4719-ac95-aba73a032f61 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.967640 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ae9a8e8b-aaf9-4719-ac95-aba73a032f61 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.975858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a9e5c289-e1e2-4485-824e-3e18f4ba6f96'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:45:49.992105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:49.992898 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:49.993210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae9a8e8b-aaf9-4719-ac95-aba73a032f61 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9e882403-1918-42fd-b161-4ba6eb2fc365,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:50.045194 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:50.083215 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-bafb8492-624a-40eb-9c6e-5c1803793c02 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.8239071 May 12 15:45:50.099195 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a4725303-ec65-4190-a6a0-38536504cbce None None] Port ec817eb9-960b-41e8-aa65-0c6b88cd81da cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:50.114219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Request body: {'port': {'device_id': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:50.147499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a4725303-ec65-4190-a6a0-38536504cbce None None] Provisioning complete for port 744f8a21-d50c-4467-bda4-c12ea144be03 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:50.147897 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4725303-ec65-4190-a6a0-38536504cbce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:50.273097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f409170b-c6c8-42a2-8fb7-f08083294561 req-824afdfd-88b3-4af8-a5cc-0b7ec68fb4ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:50.273933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f409170b-c6c8-42a2-8fb7-f08083294561 req-824afdfd-88b3-4af8-a5cc-0b7ec68fb4ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:50.280121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=c2face68-819e-48bb-aaab-5d33bb59f0eb,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:50.288593 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ae9a8e8b-aaf9-4719-ac95-aba73a032f61 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:50.289768 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ae9a8e8b-aaf9-4719-ac95-aba73a032f61 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.6533499 May 12 15:45:50.292933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45384) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:50.296432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:50.311548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:50.331953 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-57ca9d3a-c126-44e9-b189-3d2d837d877f tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules/9e882403-1918-42fd-b161-4ba6eb2fc365 HTTP/1.1" status: 200 len: 764 time: 0.0379217 May 12 15:45:50.332869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:50.343349 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45388) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:50.344483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:50.349080 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:50.378567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 744f8a21-d50c-4467-bda4-c12ea144be03 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:50.384231 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c7d9f529-d042-4129-8455-7111197b4cd0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 927 time: 1.6696985 May 12 15:45:50.386891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45394) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:50.479760 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f409170b-c6c8-42a2-8fb7-f08083294561 req-824afdfd-88b3-4af8-a5cc-0b7ec68fb4ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:50.485910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f409170b-c6c8-42a2-8fb7-f08083294561 req-824afdfd-88b3-4af8-a5cc-0b7ec68fb4ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 931 time: 0.5856566 May 12 15:45:50.513861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99429d87-1ef6-41e6-9af9-ec0a4c943250 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:50.514422 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-99429d87-1ef6-41e6-9af9-ec0a4c943250 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:50.526132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45398) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:50.540522 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 744f8a21-d50c-4467-bda4-c12ea144be03 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:50.542922 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:50.543519 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:50.557502 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:50.576446 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:50.641889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-99429d87-1ef6-41e6-9af9-ec0a4c943250 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:50.643180 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-99429d87-1ef6-41e6-9af9-ec0a4c943250 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A1 HTTP/1.1" status: 200 len: 926 time: 0.2553263 May 12 15:45:50.647550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45402) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:50.695418 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa7d80fa-5e86-4719-ab89-02e0279d59fe None None] Provisioning complete for port ec817eb9-960b-41e8-aa65-0c6b88cd81da triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:50.695780 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa7d80fa-5e86-4719-ab89-02e0279d59fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:50.713702 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f044626b-f642-43c0-9d13-7f99c59c667b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4114 time: 0.3665116 May 12 15:45:50.743411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45406) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:50.772504 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fa7d80fa-5e86-4719-ab89-02e0279d59fe None None] Port ec817eb9-960b-41e8-aa65-0c6b88cd81da cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:50.785717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa7d80fa-5e86-4719-ab89-02e0279d59fe None None] Provisioning for port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:50.790567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa7d80fa-5e86-4719-ab89-02e0279d59fe None None] Provisioning complete for port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:50.790932 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa7d80fa-5e86-4719-ab89-02e0279d59fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:50.849651 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fa7d80fa-5e86-4719-ab89-02e0279d59fe None None] Port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:50.872576 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f409170b-c6c8-42a2-8fb7-f08083294561 req-f4a0150d-07b6-4fe4-bbd9-b08fda3a2942 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3835351 May 12 15:45:50.893722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Pushing event updated for resources: {'Port': ['ID=d36b134c-f863-4d2d-9c1a-8e2d37464082,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:50.895191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf352d15-4b7e-4c3e-8ad2-00effff76190 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:50.901041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf352d15-4b7e-4c3e-8ad2-00effff76190 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:50.907196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf352d15-4b7e-4c3e-8ad2-00effff76190 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:50.909864 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bf352d15-4b7e-4c3e-8ad2-00effff76190 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A HTTP/1.1" status: 200 len: 2387 time: 0.2604136 May 12 15:45:50.916536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45410) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:50.921349 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2b051e0a-dd34-49d4-978d-90979f9c0598 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:50.970188 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-afc7335a-fb93-4f57-80d5-4ceadc0ac7c0 None None] Provisioning for port c2face68-819e-48bb-aaab-5d33bb59f0eb completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:50.975739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-afc7335a-fb93-4f57-80d5-4ceadc0ac7c0 None None] Provisioning complete for port c2face68-819e-48bb-aaab-5d33bb59f0eb triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:50.976423 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-afc7335a-fb93-4f57-80d5-4ceadc0ac7c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:51.016406 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a9e5c289-e1e2-4485-824e-3e18f4ba6f96 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:45:51.019651 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2b051e0a-dd34-49d4-978d-90979f9c0598 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:51.038984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:51.083823 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-afc7335a-fb93-4f57-80d5-4ceadc0ac7c0 None None] Port c2face68-819e-48bb-aaab-5d33bb59f0eb cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:51.102583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port a9e5c289-e1e2-4485-824e-3e18f4ba6f96 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:51.108564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port a9e5c289-e1e2-4485-824e-3e18f4ba6f96 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:51.108564 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:51.181617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e821df2e-d7d2-474f-a4c5-587dfb80e1ce req-afd6b5cd-92ec-4649-911b-2a99b49e727a tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:51.183132 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e821df2e-d7d2-474f-a4c5-587dfb80e1ce req-afd6b5cd-92ec-4649-911b-2a99b49e727a tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1096 time: 0.6094379 May 12 15:45:51.186853 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-acbe2f8b-15f5-4ac6-b71b-b857dce3a012 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port c2face68-819e-48bb-aaab-5d33bb59f0eb {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:45:51.187184 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acbe2f8b-15f5-4ac6-b71b-b857dce3a012 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:51.242668 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:51.277406 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2b1086dd-d596-4bdf-ade3-83e3daa10bac', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a9e5c289-e1e2-4485-824e-3e18f4ba6f96'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:45:51.290518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a9e5c289-e1e2-4485-824e-3e18f4ba6f96, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a9e5c289-e1e2-4485-824e-3e18f4ba6f96,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:51.297977 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:51.319987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2b051e0a-dd34-49d4-978d-90979f9c0598 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:51.367530 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-07918b4f-836c-4523-97b3-e38ab1c4ca3a'] response: {'server_uuid': '2b1086dd-d596-4bdf-ade3-83e3daa10bac', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a9e5c289-e1e2-4485-824e-3e18f4ba6f96', 'code': 200} May 12 15:45:51.391726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a9e5c289-e1e2-4485-824e-3e18f4ba6f96,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:51.444882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b051e0a-dd34-49d4-978d-90979f9c0598 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=9e882403-1918-42fd-b161-4ba6eb2fc365,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:51.452840 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2b051e0a-dd34-49d4-978d-90979f9c0598 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:51.456207 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2b051e0a-dd34-49d4-978d-90979f9c0598 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/9e882403-1918-42fd-b161-4ba6eb2fc365 HTTP/1.1" status: 204 len: 168 time: 0.6554699 May 12 15:45:51.459354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45416) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:51.497939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:51.547457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e821df2e-d7d2-474f-a4c5-587dfb80e1ce req-e184814f-80f5-41ba-926a-65f67e46342b tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3287182 May 12 15:45:51.548749 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Floating IP 0b95da37-fabd-4a50-a9d3-d41f466d89c2 associated. External IP: 172.25.8.189, port: e4de15ca-6d9a-47d1-8535-a72265f9c929. May 12 15:45:51.611107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61d03a01-c8f2-469c-8010-4e6dffe9a2f6 req-52a83295-e5ed-4ad2-a0a5-477d1534c6f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:51.612556 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-61d03a01-c8f2-469c-8010-4e6dffe9a2f6 req-52a83295-e5ed-4ad2-a0a5-477d1534c6f6 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1097 time: 0.1853402 May 12 15:45:51.735920 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-61d03a01-c8f2-469c-8010-4e6dffe9a2f6 req-023bf9d9-4e26-4038-a298-08087eea63f6 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698054 May 12 15:45:51.898518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-08be8425-4728-4a71-93a6-c2c92a56d23c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:52.075279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-08be8425-4728-4a71-93a6-c2c92a56d23c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:52.076512 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-08be8425-4728-4a71-93a6-c2c92a56d23c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.6107450 May 12 15:45:52.080222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45422) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:52.084952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Allocated IP 172.20.0.17 (81ad07c9-5912-449b-bb49-14d754ee47c0/854614c5-2c9e-43c0-8389-330eb4e14250/32cbe545-2b22-4977-b1e1-25ec74a331a2) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:45:52.244762 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b66dad4-cab3-4fc0-8350-a4a3e7e5ac6c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:52.284162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:45:52.292248 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acbe2f8b-15f5-4ac6-b71b-b857dce3a012 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:52.315229 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b66dad4-cab3-4fc0-8350-a4a3e7e5ac6c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:52.322114 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:52.348937 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:52.378239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Transition to ACTIVE for port object 32cbe545-2b22-4977-b1e1-25ec74a331a2 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:52.397337 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b66dad4-cab3-4fc0-8350-a4a3e7e5ac6c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:52.416896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b66dad4-cab3-4fc0-8350-a4a3e7e5ac6c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=276c9eed-c2b8-4e4a-9624-24271cc931e1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:52.434901 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:52.519370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-acbe2f8b-15f5-4ac6-b71b-b857dce3a012 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for c2face68-819e-48bb-aaab-5d33bb59f0eb owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:45:52.527404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 81ad07c9-5912-449b-bb49-14d754ee47c0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:52.531762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:52.536413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:45:52.565732 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5b66dad4-cab3-4fc0-8350-a4a3e7e5ac6c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:52.571967 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5b66dad4-cab3-4fc0-8350-a4a3e7e5ac6c tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-groups/276c9eed-c2b8-4e4a-9624-24271cc931e1 HTTP/1.1" status: 204 len: 168 time: 0.4855595 May 12 15:45:52.573792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45426) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:52.590558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=32cbe545-2b22-4977-b1e1-25ec74a331a2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:52.606397 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Transition to ACTIVE for port object 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:52.637759 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:52.662558 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:52.694808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-beed821e-536a-43fa-a540-58ac61a0408a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:52.783312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-beed821e-536a-43fa-a540-58ac61a0408a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:52.793015 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-beed821e-536a-43fa-a540-58ac61a0408a tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.2160158 May 12 15:45:52.797843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45432) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:52.820042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d4c3d0ad-043e-46c0-a564-353d28be848b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group': {'name': 'tempest-secgroup--139870235'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:52.840361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d4c3d0ad-043e-46c0-a564-353d28be848b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:52.870404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ca5f492-d7e6-462f-9b27-409f8f2c0b68 req-af5ed6a0-1aad-4906-9409-f6c1000c3e1a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:52.872031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ca5f492-d7e6-462f-9b27-409f8f2c0b68 req-af5ed6a0-1aad-4906-9409-f6c1000c3e1a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 931 time: 0.8499372 May 12 15:45:53.006052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d4c3d0ad-043e-46c0-a564-353d28be848b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:53.013181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Router 90b1ce02-50a9-42ff-913c-e1db00f64560 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:45:53.037668 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4c3d0ad-043e-46c0-a564-353d28be848b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.049129 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b08ca1ae-be83-472c-a898-d97992197d06 None None] Provisioning for port 32cbe545-2b22-4977-b1e1-25ec74a331a2 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:45:53.049699 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.060448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b08ca1ae-be83-472c-a898-d97992197d06 None None] Provisioning complete for port 32cbe545-2b22-4977-b1e1-25ec74a331a2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:53.061229 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b08ca1ae-be83-472c-a898-d97992197d06 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.078595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d4c3d0ad-043e-46c0-a564-353d28be848b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:53.114259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Pushing event updated for resources: {'Port': ['ID=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:53.146278 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b08ca1ae-be83-472c-a898-d97992197d06 None None] Port 32cbe545-2b22-4977-b1e1-25ec74a331a2 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:53.150328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d4c3d0ad-043e-46c0-a564-353d28be848b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:53.160728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d4c3d0ad-043e-46c0-a564-353d28be848b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:53.175530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d4c3d0ad-043e-46c0-a564-353d28be848b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:53.365590 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acbe2f8b-15f5-4ac6-b71b-b857dce3a012 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.374188 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ca5f492-d7e6-462f-9b27-409f8f2c0b68 req-f43fe22d-892d-44db-827a-ff795c9a5bfd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3881898 May 12 15:45:53.442588 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4c3d0ad-043e-46c0-a564-353d28be848b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.443106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbe2f8b-15f5-4ac6-b71b-b857dce3a012 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=c2face68-819e-48bb-aaab-5d33bb59f0eb,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:53.465717 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4c3d0ad-043e-46c0-a564-353d28be848b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.511266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Attempting to bind port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:53.511266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Attempting to bind port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:53.511607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Attempting to bind port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 on network 96b03b8b-8b48-4742-a456-9d456e030e73 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:53.600901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4c3d0ad-043e-46c0-a564-353d28be848b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b3e46ee4-aa3e-4461-a9ec-ce50b8fc1945,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:53.641843 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d4c3d0ad-043e-46c0-a564-353d28be848b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.641843 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d4c3d0ad-043e-46c0-a564-353d28be848b tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 0.8258994 May 12 15:45:53.641843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45436) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:53.655610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-fd9b4bc7-82cf-4a02-b26f-e341d63f33c0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Request body: {'security_group_rule': {'security_group_id': 'b3e46ee4-aa3e-4461-a9ec-ce50b8fc1945', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:53.655610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fd9b4bc7-82cf-4a02-b26f-e341d63f33c0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:53.669229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fd9b4bc7-82cf-4a02-b26f-e341d63f33c0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Usage tracker for resource:security_group_rule and tenant:3bd4f2a40bfe42069afd2d8d4a04f01a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:53.669229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fd9b4bc7-82cf-4a02-b26f-e341d63f33c0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:53.685309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fd9b4bc7-82cf-4a02-b26f-e341d63f33c0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:53.712540 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd9b4bc7-82cf-4a02-b26f-e341d63f33c0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.732800 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.745985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.760261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 on network 96b03b8b-8b48-4742-a456-9d456e030e73 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:45:53.760431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Attempting to bind port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 on network 96b03b8b-8b48-4742-a456-9d456e030e73 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:53.772478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbb540a4-d696-476c-a3ac-41929734e693 req-0beefce5-2b5e-4144-942a-d790fbff1243 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:53.774477 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fbb540a4-d696-476c-a3ac-41929734e693 req-0beefce5-2b5e-4144-942a-d790fbff1243 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1097 time: 0.8030863 May 12 15:45:53.780057 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acbe2f8b-15f5-4ac6-b71b-b857dce3a012 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.785129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:53.785297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Checking segment: {'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:53.785697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Bound using segment: {'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:53.786164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Bound port: 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:53.786504 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.872790 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:45:53.880807 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-acbe2f8b-15f5-4ac6-b71b-b857dce3a012 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/c2face68-819e-48bb-aaab-5d33bb59f0eb HTTP/1.1" status: 204 len: 168 time: 2.9532230 May 12 15:45:53.889337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45440) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:53.897609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae6b522a-70d2-41e3-939c-508691f34bb3 None None] Sync routers for ids ['90b1ce02-50a9-42ff-913c-e1db00f64560'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:45:53.910284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae6b522a-70d2-41e3-939c-508691f34bb3 None None] Routers {'90b1ce02-50a9-42ff-913c-e1db00f64560'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:53.910284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ae6b522a-70d2-41e3-939c-508691f34bb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['90b1ce02-50a9-42ff-913c-e1db00f64560'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:53.927701 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fbb540a4-d696-476c-a3ac-41929734e693 req-2b0cf8ce-40b4-4b3b-920a-214f623be67f tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1250954 May 12 15:45:53.938784 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.949710 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=32cbe545-2b22-4977-b1e1-25ec74a331a2,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:53.957060 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:45:53.960946 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-f5a9e639-639c-4837-811a-deccf108e7c7 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] GET failed (client error): The resource could not be found. May 12 15:45:53.964764 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f5a9e639-639c-4837-811a-deccf108e7c7 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/c2face68-819e-48bb-aaab-5d33bb59f0eb HTTP/1.1" status: 404 len: 333 time: 0.0811155 May 12 15:45:53.964764 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd9b4bc7-82cf-4a02-b26f-e341d63f33c0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.964994 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:53.969272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45444) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:53.999016 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] For port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:54.004096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] For port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:54.008102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6d16ecf5-0a59-432f-b97b-918d73233da4 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 8.8968153 May 12 15:45:54.009544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'tag': 'e4de15ca-6d9a-47d1-8535-a72265f9c929'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:45:54.012620 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd9b4bc7-82cf-4a02-b26f-e341d63f33c0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:54.014767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45448) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:54.019315 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:54.094423 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-80183f4a-a8be-4a04-b19d-6a81315ee6e7'] response: {'name': 'network-changed', 'server_uuid': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'tag': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'status': 'completed', 'code': 200} May 12 15:45:54.133862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:54.135149 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:54.136821 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] 10.222.0.84 "PUT /v2.0/ports/2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 HTTP/1.1" status: 200 len: 1091 time: 4.0281801 May 12 15:45:54.158519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e9ceec6-64ff-4944-a0a5-684ad709879c service neutron] Pushing event updated for resources: {'Port': ['ID=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:54.161516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9b4bc7-82cf-4a02-b26f-e341d63f33c0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0e00005d-8cbd-4365-ba78-b92426f66d39,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:54.175848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e20e00d-0800-4db5-bd79-94cdbce1b73b tempest-TestVolumeBackupRestore-1119599373 tempest-TestVolumeBackupRestore-1119599373-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:54.179001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8e20e00d-0800-4db5-bd79-94cdbce1b73b tempest-TestVolumeBackupRestore-1119599373 tempest-TestVolumeBackupRestore-1119599373-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 1092 time: 0.1606252 May 12 15:45:54.180564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45454) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:54.185988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-bc2d656d-f59b-40da-b6dc-3f16d8871062 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Request body: {'floatingip': {'port_id': 'e4de15ca-6d9a-47d1-8535-a72265f9c929'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:54.324404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ae6b522a-70d2-41e3-939c-508691f34bb3 None None] Set router 90b1ce02-50a9-42ff-913c-e1db00f64560 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:54.407033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-973272d0-dd29-41eb-a89c-767614e0c772 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port ec817eb9-960b-41e8-aa65-0c6b88cd81da {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:45:54.407296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-973272d0-dd29-41eb-a89c-767614e0c772 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:54.451504 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd9b4bc7-82cf-4a02-b26f-e341d63f33c0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:54.455566 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fd9b4bc7-82cf-4a02-b26f-e341d63f33c0 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.8218300 May 12 15:45:54.464141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45460) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:54.480911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 81ad07c9-5912-449b-bb49-14d754ee47c0 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:45:54.486961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:54.542125 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc2d656d-f59b-40da-b6dc-3f16d8871062 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:54.676279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30d3c22-233b-4f3b-9578-fc104b0e667d req-11a7ec65-f840-4c66-b861-2d3730ac3850 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:54.679487 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a30d3c22-233b-4f3b-9578-fc104b0e667d req-11a7ec65-f840-4c66-b861-2d3730ac3850 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0528307b42774c45be9eba4ffc91c8dd&device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 1097 time: 0.5297666 May 12 15:45:54.730416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81a83c1-1df1-4737-8569-c66358b1009a req-9597ae4e-b7c1-4cb9-9110-2372df981992 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:54.732803 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-9597ae4e-b7c1-4cb9-9110-2372df981992 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 1094 time: 0.4489744 May 12 15:45:54.789734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ae6b522a-70d2-41e3-939c-508691f34bb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 4, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '0b95da37-fabd-4a50-a9d3-d41f466d89c2', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'floating_ip_address': '172.25.8.189', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'port_id': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 3702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'mac_address': 'fa:16:3e:d1:51:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:45:49Z', 'updated_at': '2022-05-12T15:45:49Z', 'revision_number': 0, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0330d6b4-dcca-428b-884e-6ad77426f8da', 'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'mac_address': 'fa:16:3e:cb:a3:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_interface', 'standard_attr_id': 3214, 'fixed_ips': [{'subnet_id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:06Z', 'updated_at': '2022-05-12T15:40:26Z', 'revision_number': 5, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'subnets': [{'id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:54.794769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae6b522a-70d2-41e3-939c-508691f34bb3 None None] Checking router: 90b1ce02-50a9-42ff-913c-e1db00f64560 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:45:54.804928 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae6b522a-70d2-41e3-939c-508691f34bb3 None None] Routers {'90b1ce02-50a9-42ff-913c-e1db00f64560'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:54.805908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ae6b522a-70d2-41e3-939c-508691f34bb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['90b1ce02-50a9-42ff-913c-e1db00f64560'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:54.850253 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-973272d0-dd29-41eb-a89c-767614e0c772 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:54.895443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-a58da8cf-81c0-41bb-b32b-5c7b509e5542 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 HTTP/1.1" status: 200 len: 217 time: 0.0945289 May 12 15:45:54.904991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-42903024-4957-4f0a-ac3f-51835a7ad898 None None] Provisioning complete for port 32cbe545-2b22-4977-b1e1-25ec74a331a2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:45:54.905452 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-42903024-4957-4f0a-ac3f-51835a7ad898 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:55.037998 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30a0c281-6453-4c36-9b57-60c9f378f848 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:55.040153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-42903024-4957-4f0a-ac3f-51835a7ad898 None None] Port 32cbe545-2b22-4977-b1e1-25ec74a331a2 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:45:55.052314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ae6b522a-70d2-41e3-939c-508691f34bb3 None None] Set router 90b1ce02-50a9-42ff-913c-e1db00f64560 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:55.111667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-973272d0-dd29-41eb-a89c-767614e0c772 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for ec817eb9-960b-41e8-aa65-0c6b88cd81da owned by {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:45:55.119775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81a83c1-1df1-4737-8569-c66358b1009a req-ac0603f2-0b97-4395-8228-8c4831e96f5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:55.121181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-ac0603f2-0b97-4395-8228-8c4831e96f5f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7ee4997d-d763-4a38-bf54-c1153ac3e51c HTTP/1.1" status: 200 len: 834 time: 0.2153456 May 12 15:45:55.206254 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30a0c281-6453-4c36-9b57-60c9f378f848 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:55.255632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Router 943c296a-7f18-4231-8088-35f5348abd2b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:45:55.261550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ea615b-f539-4fe7-888c-92043baffc83 req-95e0cc1a-b63f-4a3a-a28c-3748cf0c1483 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:55.269521 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47ea615b-f539-4fe7-888c-92043baffc83 req-95e0cc1a-b63f-4a3a-a28c-3748cf0c1483 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 943 time: 0.5355606 May 12 15:45:55.350923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30d3c22-233b-4f3b-9578-fc104b0e667d req-1d5f99e3-3ddf-44ca-bf20-f789dfc689ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:55.352357 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a30d3c22-233b-4f3b-9578-fc104b0e667d req-1d5f99e3-3ddf-44ca-bf20-f789dfc689ed service neutron] 10.222.0.76 "GET /v2.0/networks?id=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade HTTP/1.1" status: 200 len: 914 time: 0.6562693 May 12 15:45:55.420266 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-47ea615b-f539-4fe7-888c-92043baffc83 req-ea9d4a1b-90de-4c7a-b2d3-8217b78598fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1498864 May 12 15:45:55.432401 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ae6b522a-70d2-41e3-939c-508691f34bb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 4, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '0b95da37-fabd-4a50-a9d3-d41f466d89c2', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'floating_ip_address': '172.25.8.189', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'port_id': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 3702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'mac_address': 'fa:16:3e:d1:51:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:45:49Z', 'updated_at': '2022-05-12T15:45:49Z', 'revision_number': 0, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0330d6b4-dcca-428b-884e-6ad77426f8da', 'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'mac_address': 'fa:16:3e:cb:a3:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_interface', 'standard_attr_id': 3214, 'fixed_ips': [{'subnet_id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:06Z', 'updated_at': '2022-05-12T15:40:26Z', 'revision_number': 5, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'subnets': [{'id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:55.437343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae6b522a-70d2-41e3-939c-508691f34bb3 None None] The sync data for ids ['90b1ce02-50a9-42ff-913c-e1db00f64560'] in n-d-841483-1 is: [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 4, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '0b95da37-fabd-4a50-a9d3-d41f466d89c2', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'floating_ip_address': '172.25.8.189', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'port_id': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 3702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'mac_address': 'fa:16:3e:d1:51:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:45:49Z', 'updated_at': '2022-05-12T15:45:49Z', 'revision_number': 0, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0330d6b4-dcca-428b-884e-6ad77426f8da', 'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'mac_address': 'fa:16:3e:cb:a3:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_interface', 'standard_attr_id': 3214, 'fixed_ips': [{'subnet_id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:06Z', 'updated_at': '2022-05-12T15:40:26Z', 'revision_number': 5, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'subnets': [{'id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:45:55.550883 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30a0c281-6453-4c36-9b57-60c9f378f848 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:55.581769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1931d0dd-ff18-460e-85a8-ac497f0f56c8 req-fa5522ba-9e01-494e-8a76-9d7d6d6f1cfd tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:55.583256 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1931d0dd-ff18-460e-85a8-ac497f0f56c8 req-fa5522ba-9e01-494e-8a76-9d7d6d6f1cfd tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1097 time: 0.4694133 May 12 15:45:55.587963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a0c281-6453-4c36-9b57-60c9f378f848 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3e46ee4-aa3e-4461-a9ec-ce50b8fc1945,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:55.614479 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a30d3c22-233b-4f3b-9578-fc104b0e667d req-5816a58d-1de4-4ded-b141-1c66b4f8eb6a service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e4de15ca-6d9a-47d1-8535-a72265f9c929 HTTP/1.1" status: 200 len: 1000 time: 0.2317266 May 12 15:45:55.618042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-973272d0-dd29-41eb-a89c-767614e0c772 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:55.699248 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-747810b0-f306-45e7-9509-6402964ba90f None None] New status for floating IP 0b95da37-fabd-4a50-a9d3-d41f466d89c2: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:45:55.760404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-973272d0-dd29-41eb-a89c-767614e0c772 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=ec817eb9-960b-41e8-aa65-0c6b88cd81da,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:55.770714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:45:55.782714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Sync routers for ids ['943c296a-7f18-4231-8088-35f5348abd2b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:45:55.800596 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7ff57da3-7b9d-4c34-9415-179aa2a0c0fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "PUT /v2.0/routers/943c296a-7f18-4231-8088-35f5348abd2b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2735300 May 12 15:45:55.802192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Routers {'943c296a-7f18-4231-8088-35f5348abd2b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:55.802819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['943c296a-7f18-4231-8088-35f5348abd2b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:55.811885 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-973272d0-dd29-41eb-a89c-767614e0c772 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:55.817992 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-973272d0-dd29-41eb-a89c-767614e0c772 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/ec817eb9-960b-41e8-aa65-0c6b88cd81da HTTP/1.1" status: 204 len: 168 time: 1.8467932 May 12 15:45:55.821268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45468) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:55.869633 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-3f74a51d-7488-46a3-99c0-8dd05a7d3095 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] GET failed (client error): The resource could not be found. May 12 15:45:55.870172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3f74a51d-7488-46a3-99c0-8dd05a7d3095 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:55.880992 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30d3c22-233b-4f3b-9578-fc104b0e667d req-aa6006a3-7fd7-4255-8e6a-453074a3296c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:55.882731 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a30d3c22-233b-4f3b-9578-fc104b0e667d req-aa6006a3-7fd7-4255-8e6a-453074a3296c service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5b4ef35a-b116-4246-86c9-ff3a7aad3410 HTTP/1.1" status: 200 len: 852 time: 0.2557023 May 12 15:45:55.910760 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81a83c1-1df1-4737-8569-c66358b1009a req-edd253c1-916d-40d6-9c55-ac703b8c75b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:55.912159 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-edd253c1-916d-40d6-9c55-ac703b8c75b5 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=96b03b8b-8b48-4742-a456-9d456e030e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.7794256 May 12 15:45:55.961358 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-30a0c281-6453-4c36-9b57-60c9f378f848 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:55.962498 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-30a0c281-6453-4c36-9b57-60c9f378f848 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-groups/b3e46ee4-aa3e-4461-a9ec-ce50b8fc1945 HTTP/1.1" status: 204 len: 168 time: 1.4957483 May 12 15:45:56.032751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45474) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:56.046863 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1931d0dd-ff18-460e-85a8-ac497f0f56c8 req-b26cf9af-b74c-4b2b-8f6d-26f51d763b2b tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4551461 May 12 15:45:56.094682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Set router 943c296a-7f18-4231-8088-35f5348abd2b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:56.119267 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3f74a51d-7488-46a3-99c0-8dd05a7d3095 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:56.120552 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3f74a51d-7488-46a3-99c0-8dd05a7d3095 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/ec817eb9-960b-41e8-aa65-0c6b88cd81da HTTP/1.1" status: 404 len: 333 time: 0.2982464 May 12 15:45:56.123319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45480) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:56.192967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:45:56.198241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30d3c22-233b-4f3b-9578-fc104b0e667d req-6f91b508-745d-4bff-8558-bdf7c268de8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:56.200127 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a30d3c22-233b-4f3b-9578-fc104b0e667d req-6f91b508-745d-4bff-8558-bdf7c268de8d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3073344 May 12 15:45:56.200693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-2e6ea8e7-3b2a-4455-8cac-413d5ab5d359 service neutron] 10.222.0.84 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2106123 May 12 15:45:56.210874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-f14799e2-a8ea-4cf2-9174-fbf51830242d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting subnet 4fa38328-6c61-4ac7-b76e-d91d29d426a8 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:45:56.239068 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f14799e2-a8ea-4cf2-9174-fbf51830242d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:56.345070 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-33cc656f-e72d-4ad8-a9d1-b398e74a0011'] response: {'name': 'network-changed', 'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'status': 'completed', 'code': 200} May 12 15:45:56.374467 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f14799e2-a8ea-4cf2-9174-fbf51830242d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:56.432214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-efe1990e-d00c-4336-9916-d3bf7af30e55 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:56.462606 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a30d3c22-233b-4f3b-9578-fc104b0e667d req-d189c77e-8c57-4750-a009-85cfafaad8b2 service neutron] 10.222.0.76 "GET /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2494395 May 12 15:45:56.496747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-efe1990e-d00c-4336-9916-d3bf7af30e55 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:56.498032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-efe1990e-d00c-4336-9916-d3bf7af30e55 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.4500232 May 12 15:45:56.502805 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f14799e2-a8ea-4cf2-9174-fbf51830242d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:56.505705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45488) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:56.545797 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c81a83c1-1df1-4737-8569-c66358b1009a req-c45b43bf-7567-4e7c-ba45-3f6fe86b3714 service neutron] 10.222.0.84 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3350220 May 12 15:45:56.557631 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-bc2d656d-f59b-40da-b6dc-3f16d8871062 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:45:56.557954 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-bc2d656d-f59b-40da-b6dc-3f16d8871062 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Performing DB retry for function neutron.db.l3_dvr_db.L3_NAT_with_dvr_db_mixin.update_floatingip {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:45:56.571580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ce964b-d549-4bae-921c-0dc2f5445aec req-1b5a081b-f3f6-47bb-a8ef-faba1abd52e1 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:56.573975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6ce964b-d549-4bae-921c-0dc2f5445aec req-1b5a081b-f3f6-47bb-a8ef-faba1abd52e1 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1097 time: 0.3403912 May 12 15:45:56.628460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bd0da565-2b97-4352-99dd-23e40b7240e6 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:56.629363 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:45:52Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd2ed2139-605d-4648-ada6-83bbdb6ff583', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'port_id': '42a296ea-fb47-4109-8501-772157438fa6', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 3563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'mac_address': 'fa:16:3e:2d:a9:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:44:34Z', 'updated_at': '2022-05-12T15:44:50Z', 'revision_number': 1, 'project_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '32cbe545-2b22-4977-b1e1-25ec74a331a2', 'name': '', 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:fe:bf:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3705, 'fixed_ips': [{'subnet_id': '854614c5-2c9e-43c0-8389-330eb4e14250', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:51Z', 'updated_at': '2022-05-12T15:45:53Z', 'revision_number': 2, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '854614c5-2c9e-43c0-8389-330eb4e14250', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:10Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:56.636045 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Checking router: 943c296a-7f18-4231-8088-35f5348abd2b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:45:56.637177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Updating router 943c296a-7f18-4231-8088-35f5348abd2b port 32cbe545-2b22-4977-b1e1-25ec74a331a2 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:45:56.682613 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f14799e2-a8ea-4cf2-9174-fbf51830242d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:56.702285 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:56.733371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f14799e2-a8ea-4cf2-9174-fbf51830242d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Subnet': ['ID=4fa38328-6c61-4ac7-b76e-d91d29d426a8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:56.741772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bd0da565-2b97-4352-99dd-23e40b7240e6 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:56.746557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bd0da565-2b97-4352-99dd-23e40b7240e6 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 2475 time: 0.2387564 May 12 15:45:56.749060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6ce964b-d549-4bae-921c-0dc2f5445aec req-60842763-ea8a-47aa-b63a-0bf9a9abff45 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1641519 May 12 15:45:56.750881 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f14799e2-a8ea-4cf2-9174-fbf51830242d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:56.753215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45492) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:56.787902 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f14799e2-a8ea-4cf2-9174-fbf51830242d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/4fa38328-6c61-4ac7-b76e-d91d29d426a8 HTTP/1.1" status: 204 len: 168 time: 0.6635611 May 12 15:45:56.790518 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-ed6aa3f3-5601-46dc-a69f-dc80814e00b2 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] delete failed (client error): The resource could not be found. May 12 15:45:56.791467 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ed6aa3f3-5601-46dc-a69f-dc80814e00b2 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "DELETE /v2.0/security-groups/b3e46ee4-aa3e-4461-a9ec-ce50b8fc1945 HTTP/1.1" status: 404 len: 347 time: 0.0371318 May 12 15:45:56.792078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45498) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:56.793994 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a30d3c22-233b-4f3b-9578-fc104b0e667d req-60b16f6c-245e-4350-88e4-76f66292e693 service neutron] 10.222.0.76 "GET /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2226720 May 12 15:45:56.795829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45500) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:56.798802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dca9a78c-72cd-48e9-834c-578361e12a2c req-5db6ee19-88cb-4644-b62d-bdf22f0ace63 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:56.815192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dca9a78c-72cd-48e9-834c-578361e12a2c req-5db6ee19-88cb-4644-b62d-bdf22f0ace63 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 943 time: 0.2369947 May 12 15:45:56.847267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f045ce39-42f7-4911-ab2f-d9a87b4ceaeb req-3a2f067a-6765-4514-a431-f8573fc550d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:56.849232 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f045ce39-42f7-4911-ab2f-d9a87b4ceaeb req-3a2f067a-6765-4514-a431-f8573fc550d5 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 1094 time: 0.1865792 May 12 15:45:56.889959 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c6d9825-dc35-408b-8e44-b25fd0e81b68 None None] Network d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:56.952677 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:56.957470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7de8ec44-1835-48a1-a942-0372dbc92e05 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Synchronizing usage tracker for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:45:56.975628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7de8ec44-1835-48a1-a942-0372dbc92e05 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] Unset dirty status for tenant:3bd4f2a40bfe42069afd2d8d4a04f01a on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:45:56.977109 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7de8ec44-1835-48a1-a942-0372dbc92e05 tempest-SecGroupTest-250188505 tempest-SecGroupTest-250188505-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.1802173 May 12 15:45:56.978174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 744f8a21-d50c-4467-bda4-c12ea144be03 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:45:56.978820 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:56.989990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dca9a78c-72cd-48e9-834c-578361e12a2c req-26e7666d-5499-429a-be60-0bffe177963d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1715164 May 12 15:45:57.077341 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc2d656d-f59b-40da-b6dc-3f16d8871062 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:57.211365 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f045ce39-42f7-4911-ab2f-d9a87b4ceaeb req-b2cee31e-91ef-4316-a289-ec1a7ab5eba6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:57.212996 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f045ce39-42f7-4911-ab2f-d9a87b4ceaeb req-b2cee31e-91ef-4316-a289-ec1a7ab5eba6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=96b03b8b-8b48-4742-a456-9d456e030e73 HTTP/1.1" status: 200 len: 897 time: 0.3550932 May 12 15:45:57.289146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] For port 744f8a21-d50c-4467-bda4-c12ea144be03, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=744f8a21-d50c-4467-bda4-c12ea144be03,segment=NetworkSegment(fc0d3222-c778-4297-9e20-0c4f07609416),segment_id=fc0d3222-c778-4297-9e20-0c4f07609416)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:45:57.289556 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:57.321942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f045ce39-42f7-4911-ab2f-d9a87b4ceaeb req-cad7ada0-49a8-4b1b-b382-cd47f0f18b28 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 HTTP/1.1" status: 200 len: 217 time: 0.0706563 May 12 15:45:57.346316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb48182d-950f-4849-b33b-aebbe6bcc279 None None] DHCP port deletion for d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:45:57.352624 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:57.366597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Transition to ACTIVE for port object 32cbe545-2b22-4977-b1e1-25ec74a331a2 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:45:57.373055 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-eb48182d-950f-4849-b33b-aebbe6bcc279 None None] Deleting port 744f8a21-d50c-4467-bda4-c12ea144be03 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:45:57.373503 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eb48182d-950f-4849-b33b-aebbe6bcc279 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:57.403461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45510) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:57.407043 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:57.471650 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f045ce39-42f7-4911-ab2f-d9a87b4ceaeb req-55956cc3-b415-486b-afe6-f16e805f8dfc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:57.473079 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f045ce39-42f7-4911-ab2f-d9a87b4ceaeb req-55956cc3-b415-486b-afe6-f16e805f8dfc service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7ee4997d-d763-4a38-bf54-c1153ac3e51c HTTP/1.1" status: 200 len: 834 time: 0.1248221 May 12 15:45:57.491729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 744f8a21-d50c-4467-bda4-c12ea144be03 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:45:57.532041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-812afcfb-9a25-44fe-9f42-edd1c8d5800e req-716c258f-31a5-40b8-97dc-190afc46addf tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:57.539024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-812afcfb-9a25-44fe-9f42-edd1c8d5800e req-716c258f-31a5-40b8-97dc-190afc46addf tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1097 time: 0.5949781 May 12 15:45:57.595806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-812afcfb-9a25-44fe-9f42-edd1c8d5800e req-575d5b7f-14e5-44a7-9f3b-d2f2e29261c9 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0558450 May 12 15:45:57.624042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:57.672585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-eb48182d-950f-4849-b33b-aebbe6bcc279 None None] The port '744f8a21-d50c-4467-bda4-c12ea144be03' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:45:57.697167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=744f8a21-d50c-4467-bda4-c12ea144be03,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:57.703609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a119d1b0-068b-466c-b19c-e0f9feb06766 None None] Pushing event updated for resources: {'Port': ['ID=32cbe545-2b22-4977-b1e1-25ec74a331a2,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:57.730719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No DVR routers for this DVR port 744f8a21-d50c-4467-bda4-c12ea144be03 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:45:57.740452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Attempting to bind port 32cbe545-2b22-4977-b1e1-25ec74a331a2 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:45:57.740808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Attempting to bind port 32cbe545-2b22-4977-b1e1-25ec74a331a2 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '41769506-c6e2-4d6c-a537-2d71e8a5e3f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:45:57.741162 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Attempting to bind port 32cbe545-2b22-4977-b1e1-25ec74a331a2 on network 81ad07c9-5912-449b-bb49-14d754ee47c0 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:45:57.758062 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:45:57.758424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Checking segment: {'id': '41769506-c6e2-4d6c-a537-2d71e8a5e3f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:57.758827 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:57.759206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Bound using segment: {'id': '41769506-c6e2-4d6c-a537-2d71e8a5e3f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:45:57.759723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Bound port: 32cbe545-2b22-4977-b1e1-25ec74a331a2, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '41769506-c6e2-4d6c-a537-2d71e8a5e3f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:45:57.760107 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:57.889373 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:57.919602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:57.923809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] For port 32cbe545-2b22-4977-b1e1-25ec74a331a2, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:45:57.929547 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1d0957df-e32a-42a6-a8a5-8ce2db411315 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3bd4f2a40bfe42069afd2d8d4a04f01a&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5190542 May 12 15:45:57.931512 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] For port 32cbe545-2b22-4977-b1e1-25ec74a331a2, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=32cbe545-2b22-4977-b1e1-25ec74a331a2,segment=NetworkSegment(41769506-c6e2-4d6c-a537-2d71e8a5e3f7),segment_id=41769506-c6e2-4d6c-a537-2d71e8a5e3f7)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:45:57.938160 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:57.946287 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45528) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:57.960752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fc0d3222-c778-4297-9e20-0c4f07609416') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:57.961113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fc0d3222-c778-4297-9e20-0c4f07609416') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:57.977742 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:58.015584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:58.017606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Routers {'943c296a-7f18-4231-8088-35f5348abd2b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:45:58.018079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['943c296a-7f18-4231-8088-35f5348abd2b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:58.092198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a119d1b0-068b-466c-b19c-e0f9feb06766 None None] Pushing event updated for resources: {'Port': ['ID=32cbe545-2b22-4977-b1e1-25ec74a331a2,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:58.152553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f045ce39-42f7-4911-ab2f-d9a87b4ceaeb req-eb5599ee-da63-49db-8ae9-f81098eed0f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:58.154108 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f045ce39-42f7-4911-ab2f-d9a87b4ceaeb req-eb5599ee-da63-49db-8ae9-f81098eed0f0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=96b03b8b-8b48-4742-a456-9d456e030e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.6712005 May 12 15:45:58.178130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Releasing vlan 564 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:45:58.178542 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: timer() May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:45:58.195887 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:45:58.280803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] Set router 943c296a-7f18-4231-8088-35f5348abd2b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:45:58.319093 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-26417710-f724-4a6d-a934-1ae6358c687d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:58.356949 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-26417710-f724-4a6d-a934-1ae6358c687d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:58.380964 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:58.386326 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:58.430431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Network': ['ID=d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:58.441420 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-94b1f615-0cf9-40d4-9113-5d5b095e9435 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/networks/d4f0eb48-f987-4fb2-b69d-f3358a3b0ae8 HTTP/1.1" status: 204 len: 168 time: 1.6462448 May 12 15:45:58.441854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45536) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:58.452058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 744f8a21-d50c-4467-bda4-c12ea144be03 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:45:58.465125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1334286181'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:58.465125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:58.470930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:network and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:58.470930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:58.477993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:58.491153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:58.506755 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:58.507447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 744f8a21-d50c-4467-bda4-c12ea144be03 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:45:58.507447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 744f8a21-d50c-4467-bda4-c12ea144be03 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:45:58.536725 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-26417710-f724-4a6d-a934-1ae6358c687d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:58.555125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26417710-f724-4a6d-a934-1ae6358c687d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b0726698-413e-4250-afae-ccaa4317da40,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:58.576829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 588} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:45:58.581985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-9b3744bf-78d8-46ef-9ef1-351c83b56eec tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:58.583614 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-9b3744bf-78d8-46ef-9ef1-351c83b56eec tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/networks?id=0de89d0f-e308-41b4-8980-4fb156f3c79b HTTP/1.1" status: 200 len: 910 time: 0.6550388 May 12 15:45:58.597607 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-26417710-f724-4a6d-a934-1ae6358c687d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:58.598811 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-26417710-f724-4a6d-a934-1ae6358c687d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b0726698-413e-4250-afae-ccaa4317da40 HTTP/1.1" status: 204 len: 168 time: 0.6516056 May 12 15:45:58.605483 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:58.605902 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Added segment 12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc of type vlan for network 5ea51e53-9a27-4f14-94e0-7720b5aadfe6 May 12 15:45:58.632726 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-9a8b3480-c33b-40b2-b79c-f5ec39fef42a tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/quotas/5b43e848e2af491a8dc509c668c33e91 HTTP/1.1" status: 200 len: 375 time: 0.0268798 May 12 15:45:58.659486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:58.686177 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f045ce39-42f7-4911-ab2f-d9a87b4ceaeb req-4abc313a-6851-4d77-b145-e5384326dcd8 service neutron] 10.222.0.84 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4808588 May 12 15:45:58.702031 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:58.712441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:58.713182 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:58.727126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bde8787-62d7-4f44-a9b7-ef2fef8b5398 req-bf8861b7-61de-4f42-8e1b-085584069624 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:58.733940 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8bde8787-62d7-4f44-a9b7-ef2fef8b5398 req-bf8861b7-61de-4f42-8e1b-085584069624 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 943 time: 0.5664973 May 12 15:45:58.836032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Network': ['ID=5ea51e53-9a27-4f14-94e0-7720b5aadfe6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:58.844512 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4a571f9b-bc09-4fd2-a2cc-02e3f99c2f01 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.4007061 May 12 15:45:58.847618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45544) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:58.852500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 5ea51e53-9a27-4f14-94e0-7720b5aadfe6 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:45:58.856235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': '5ea51e53-9a27-4f14-94e0-7720b5aadfe6', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:58.903936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8bde8787-62d7-4f44-a9b7-ef2fef8b5398 req-69f48ab1-194c-408b-b228-31cdcbfc7618 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1689537 May 12 15:45:58.985458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:45:52Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd2ed2139-605d-4648-ada6-83bbdb6ff583', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'port_id': '42a296ea-fb47-4109-8501-772157438fa6', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 3563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'mac_address': 'fa:16:3e:2d:a9:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:44:34Z', 'updated_at': '2022-05-12T15:44:50Z', 'revision_number': 1, 'project_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '32cbe545-2b22-4977-b1e1-25ec74a331a2', 'name': '', 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:fe:bf:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3705, 'fixed_ips': [{'subnet_id': '854614c5-2c9e-43c0-8389-330eb4e14250', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:51Z', 'updated_at': '2022-05-12T15:45:57Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '854614c5-2c9e-43c0-8389-330eb4e14250', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:10Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:45:58.990342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09e5d8a2-f131-4615-a86f-39976e47878e None None] The sync data for ids ['943c296a-7f18-4231-8088-35f5348abd2b'] in n-d-841483-1 is: [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:45:52Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd2ed2139-605d-4648-ada6-83bbdb6ff583', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'port_id': '42a296ea-fb47-4109-8501-772157438fa6', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 3563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'mac_address': 'fa:16:3e:2d:a9:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:44:34Z', 'updated_at': '2022-05-12T15:44:50Z', 'revision_number': 1, 'project_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '32cbe545-2b22-4977-b1e1-25ec74a331a2', 'name': '', 'network_id': '81ad07c9-5912-449b-bb49-14d754ee47c0', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:fe:bf:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3705, 'fixed_ips': [{'subnet_id': '854614c5-2c9e-43c0-8389-330eb4e14250', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:51Z', 'updated_at': '2022-05-12T15:45:57Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '854614c5-2c9e-43c0-8389-330eb4e14250', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:10Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:45:59.014429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:59.019166 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:59.023104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:59.031313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:59.082165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:45:59.086445 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:59.098592 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc2d656d-f59b-40da-b6dc-3f16d8871062 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:59.111907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-3035fbd2-b0e0-41bf-9933-43c8476de60d tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?tenant_id=5b43e848e2af491a8dc509c668c33e91&fields=id HTTP/1.1" status: 200 len: 348 time: 0.4782438 May 12 15:45:59.119485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-939dc759-a542-49e5-98e1-99c603851f2f service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:45:59.120717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-939dc759-a542-49e5-98e1-99c603851f2f service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0078714 May 12 15:45:59.123525 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc2d656d-f59b-40da-b6dc-3f16d8871062 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:59.176267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f045ce39-42f7-4911-ab2f-d9a87b4ceaeb req-f2da9da8-3260-4c06-b6ae-ad71e7572784 service neutron] 10.222.0.84 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4766376 May 12 15:45:59.407563 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:59.447630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:45:59.464535 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-4e7b19bd-8b8c-4a4a-b526-9ce9379cb37a service neutron] 10.222.0.82 "GET /v2.0/networks/0de89d0f-e308-41b4-8980-4fb156f3c79b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2850916 May 12 15:45:59.507401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Checking segment: {'id': '12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '5ea51e53-9a27-4f14-94e0-7720b5aadfe6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:45:59.507767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network hostable DHCP agents. Network: 5ea51e53-9a27-4f14-94e0-7720b5aadfe6, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:45:59.522898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Subnet': ['ID=341373d7-a414-4e68-bbb2-befc9aa72839,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:45:59.559271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 5ea51e53-9a27-4f14-94e0-7720b5aadfe6 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:45:59.576009 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 5ea51e53-9a27-4f14-94e0-7720b5aadfe6) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:45:59.593308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:45:59.593308 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:59.626756 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d6d9b28-1a7d-4869-9946-94dd66c0a317 None None] Network 5ea51e53-9a27-4f14-94e0-7720b5aadfe6 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:45:59.682767 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7198b736-1093-4445-8cae-cd3412179c5b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8241131 May 12 15:45:59.682767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45564) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:59.682767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7a1b4411-cf98-40a9-b53c-cda979f55057 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'router': {'name': 'tempest-PortsIpV6TestJSON-router-597582642', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:59.705521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7a1b4411-cf98-40a9-b53c-cda979f55057 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:45:59.707045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7a1b4411-cf98-40a9-b53c-cda979f55057 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:router and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:45:59.710427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7a1b4411-cf98-40a9-b53c-cda979f55057 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:45:59.722898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7a1b4411-cf98-40a9-b53c-cda979f55057 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:45:59.754152 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7a1b4411-cf98-40a9-b53c-cda979f55057 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:59.754152 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7a1b4411-cf98-40a9-b53c-cda979f55057 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:59.787025 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7a1b4411-cf98-40a9-b53c-cda979f55057 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:59.815641 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7a1b4411-cf98-40a9-b53c-cda979f55057 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:59.862196 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7a1b4411-cf98-40a9-b53c-cda979f55057 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:45:59.863513 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7a1b4411-cf98-40a9-b53c-cda979f55057 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.1870949 May 12 15:45:59.866160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45568) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:45:59.872221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'network_id': '5ea51e53-9a27-4f14-94e0-7720b5aadfe6', 'name': 'tempest-PortsIpV6TestJSON-1374644167'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:45:59.908056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45572) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:00.125119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:00.166238 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b9194bbe-4a26-417d-bec7-ec430abe5656 tempest-ServiceProvidersTest-1135725376 tempest-ServiceProvidersTest-1135725376-project] 10.222.0.82 "GET /v2.0/service-providers HTTP/1.1" status: 200 len: 498 time: 0.2444940 May 12 15:46:00.170801 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-603ad029-6415-458a-addb-58c1cc3bddf2 service neutron] 10.222.0.82 "GET /v2.0/networks/0de89d0f-e308-41b4-8980-4fb156f3c79b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7002304 May 12 15:46:00.191623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bc2d656d-f59b-40da-b6dc-3f16d8871062 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Router 90b1ce02-50a9-42ff-913c-e1db00f64560 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:46:00.264876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:00.291793 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:port and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:00.301950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:00.332866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:00.352406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:46:00.357427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'port_id': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'mac_address': 'fa:16:3e:b3:7c:cb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 562, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:46:00.366129 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:00.414277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port faefdfb1-a331-4e04-9193-13aa3135c521 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:46:00.462127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 32cbe545-2b22-4977-b1e1-25ec74a331a2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:46:00.694791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Allocated IP 2001:db8::15e (5ea51e53-9a27-4f14-94e0-7720b5aadfe6/341373d7-a414-4e68-bbb2-befc9aa72839/faefdfb1-a331-4e04-9193-13aa3135c521) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:46:00.748531 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:00.792532 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:46:00.829035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-5ea51e53-9a27-4f14-94e0-7720b5aadfe6', 'network_id': '5ea51e53-9a27-4f14-94e0-7720b5aadfe6', 'tenant_id': '1da2b935bcd34292b3e8ce00cc114001', 'fixed_ips': [{'subnet_id': '341373d7-a414-4e68-bbb2-befc9aa72839'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:46:00.829035 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:00.837292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc2d656d-f59b-40da-b6dc-3f16d8871062 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:46:00.851381 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7eaaf37f-3cf8-478d-8a49-33ef9f6337f4 None None] Sync routers for ids ['90b1ce02-50a9-42ff-913c-e1db00f64560'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:46:00.872672 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7eaaf37f-3cf8-478d-8a49-33ef9f6337f4 None None] Routers {'90b1ce02-50a9-42ff-913c-e1db00f64560'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:00.872672 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7eaaf37f-3cf8-478d-8a49-33ef9f6337f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['90b1ce02-50a9-42ff-913c-e1db00f64560'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:00.896661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:00.918094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45590) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:00.946272 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:00.979808 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc2d656d-f59b-40da-b6dc-3f16d8871062 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:01.002261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 32cbe545-2b22-4977-b1e1-25ec74a331a2 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:46:01.043363 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 32cbe545-2b22-4977-b1e1-25ec74a331a2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:01.043811 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:01.081674 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd274927-dd33-4e6f-a65e-6eb240d84ac0 req-7ed5ff14-1050-465b-b5ed-80d32e46b84b tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 210 time: 0.2533314 May 12 15:46:01.192977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:01.204837 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:01.215558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'tag': 'e4de15ca-6d9a-47d1-8535-a72265f9c929'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:46:01.226274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Transition to ACTIVE for port object faefdfb1-a331-4e04-9193-13aa3135c521 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:46:01.249304 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:01.378796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['2a5ee9ef-0363-4a82-b382-c38a8d19f1c6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:46:01.385994 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-7eaaf37f-3cf8-478d-8a49-33ef9f6337f4 None None] Set router 90b1ce02-50a9-42ff-913c-e1db00f64560 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:01.394037 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60c31582-bc5c-42a1-97c1-f2efafeeb0cd admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:01.411222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 5ea51e53-9a27-4f14-94e0-7720b5aadfe6 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:46:01.411222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:46:01.425553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-60c31582-bc5c-42a1-97c1-f2efafeeb0cd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:01.425553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:46:01.439489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:01.439489 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:01.439489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-60c31582-bc5c-42a1-97c1-f2efafeeb0cd admin admin] Usage tracker for resource:security_group_rule and tenant:736334f832d840f4b17175fd055a02f3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:01.453984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9851d637-dde9-4758-9328-b8d9ef539035 req-cfa2a741-da28-48d4-9bbe-2c163526c4fc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:01.460263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=faefdfb1-a331-4e04-9193-13aa3135c521,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:01.462628 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9851d637-dde9-4758-9328-b8d9ef539035 req-cfa2a741-da28-48d4-9bbe-2c163526c4fc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 943 time: 0.6651964 May 12 15:46:01.462796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-60c31582-bc5c-42a1-97c1-f2efafeeb0cd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:01.470765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-60c31582-bc5c-42a1-97c1-f2efafeeb0cd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:01.487699 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b649caaf-400e-4814-9fb7-94d89727cb55 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.6204467 May 12 15:46:01.492330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45604) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:01.499289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bc2d656d-f59b-40da-b6dc-3f16d8871062 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "PUT /v2.0/floatingips/0b95da37-fabd-4a50-a9d3-d41f466d89c2 HTTP/1.1" status: 200 len: 994 time: 7.3175416 May 12 15:46:01.502582 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a86b0d89-aeef-4c46-b8a8-b23878a8da88'] response: {'name': 'network-changed', 'server_uuid': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'tag': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'status': 'completed', 'code': 200} May 12 15:46:01.563334 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9851d637-dde9-4758-9328-b8d9ef539035 req-74b1c55b-fc5b-4690-a0b8-efa8e27c1330 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1059840 May 12 15:46:01.596753 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:01.632935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Allocated IP 2001:db8::2 (5ea51e53-9a27-4f14-94e0-7720b5aadfe6/341373d7-a414-4e68-bbb2-befc9aa72839/be385b2e-0f28-428e-b5b8-de42c3885a30) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:46:01.815047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 32cbe545-2b22-4977-b1e1-25ec74a331a2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=32cbe545-2b22-4977-b1e1-25ec74a331a2,segment=NetworkSegment(41769506-c6e2-4d6c-a537-2d71e8a5e3f7),segment_id=41769506-c6e2-4d6c-a537-2d71e8a5e3f7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:01.849687 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:01.916212 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7eaaf37f-3cf8-478d-8a49-33ef9f6337f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 4, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '0b95da37-fabd-4a50-a9d3-d41f466d89c2', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'floating_ip_address': '172.25.8.189', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'port_id': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 3702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'mac_address': 'fa:16:3e:d1:51:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:45:49Z', 'updated_at': '2022-05-12T15:45:58Z', 'revision_number': 2, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0330d6b4-dcca-428b-884e-6ad77426f8da', 'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'mac_address': 'fa:16:3e:cb:a3:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_interface', 'standard_attr_id': 3214, 'fixed_ips': [{'subnet_id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:06Z', 'updated_at': '2022-05-12T15:40:26Z', 'revision_number': 5, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'subnets': [{'id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:01.922906 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7eaaf37f-3cf8-478d-8a49-33ef9f6337f4 None None] Checking router: 90b1ce02-50a9-42ff-913c-e1db00f64560 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:46:01.933234 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7eaaf37f-3cf8-478d-8a49-33ef9f6337f4 None None] Routers {'90b1ce02-50a9-42ff-913c-e1db00f64560'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:01.934258 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7eaaf37f-3cf8-478d-8a49-33ef9f6337f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['90b1ce02-50a9-42ff-913c-e1db00f64560'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:02.013877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=32cbe545-2b22-4977-b1e1-25ec74a331a2,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:02.162855 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-7eaaf37f-3cf8-478d-8a49-33ef9f6337f4 None None] Set router 90b1ce02-50a9-42ff-913c-e1db00f64560 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:02.197142 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:02.233939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Transition to ACTIVE for port object be385b2e-0f28-428e-b5b8-de42c3885a30 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:46:02.282015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Transition to ACTIVE for port object be385b2e-0f28-428e-b5b8-de42c3885a30 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:46:02.292004 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:02.323037 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0a0b36f-1548-47ae-997c-de7f04171d7d req-b346ed1f-30f5-48e9-83fb-e00969ae0626 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 210 time: 0.1144037 May 12 15:46:02.378150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Network 5ea51e53-9a27-4f14-94e0-7720b5aadfe6 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:46:02.379248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 32cbe545-2b22-4977-b1e1-25ec74a331a2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:46:02.413665 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:46:02.461669 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:46:02.558653 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Pushing event updated for resources: {'Port': ['ID=be385b2e-0f28-428e-b5b8-de42c3885a30,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:02.626726 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60c31582-bc5c-42a1-97c1-f2efafeeb0cd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:02.639783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-408b6dd6-089e-4814-aec5-b999d438aeb0 req-ea4759f7-c62b-425c-9dcc-1ad45f0f5c40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:02.643189 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-408b6dd6-089e-4814-aec5-b999d438aeb0 req-ea4759f7-c62b-425c-9dcc-1ad45f0f5c40 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0528307b42774c45be9eba4ffc91c8dd&device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 1097 time: 1.1278994 May 12 15:46:02.648556 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60c31582-bc5c-42a1-97c1-f2efafeeb0cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:02.807292 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7eaaf37f-3cf8-478d-8a49-33ef9f6337f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 4, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '0b95da37-fabd-4a50-a9d3-d41f466d89c2', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'floating_ip_address': '172.25.8.189', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'port_id': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 3702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'mac_address': 'fa:16:3e:d1:51:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:45:49Z', 'updated_at': '2022-05-12T15:45:58Z', 'revision_number': 2, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0330d6b4-dcca-428b-884e-6ad77426f8da', 'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'mac_address': 'fa:16:3e:cb:a3:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_interface', 'standard_attr_id': 3214, 'fixed_ips': [{'subnet_id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:06Z', 'updated_at': '2022-05-12T15:40:26Z', 'revision_number': 5, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'subnets': [{'id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:02.817932 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7eaaf37f-3cf8-478d-8a49-33ef9f6337f4 None None] The sync data for ids ['90b1ce02-50a9-42ff-913c-e1db00f64560'] in n-d-841483-1 is: [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 4, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '0b95da37-fabd-4a50-a9d3-d41f466d89c2', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'floating_ip_address': '172.25.8.189', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'port_id': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 3702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'mac_address': 'fa:16:3e:d1:51:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:45:49Z', 'updated_at': '2022-05-12T15:45:58Z', 'revision_number': 2, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0330d6b4-dcca-428b-884e-6ad77426f8da', 'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'mac_address': 'fa:16:3e:cb:a3:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_interface', 'standard_attr_id': 3214, 'fixed_ips': [{'subnet_id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:06Z', 'updated_at': '2022-05-12T15:40:26Z', 'revision_number': 5, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'subnets': [{'id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:46:02.818403 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Attempting to bind port be385b2e-0f28-428e-b5b8-de42c3885a30 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:46:02.818766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Attempting to bind port be385b2e-0f28-428e-b5b8-de42c3885a30 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '5ea51e53-9a27-4f14-94e0-7720b5aadfe6'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:46:02.819119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Attempting to bind port be385b2e-0f28-428e-b5b8-de42c3885a30 on network 5ea51e53-9a27-4f14-94e0-7720b5aadfe6 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:46:02.828351 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:02.847662 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:46:02.848570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Checking segment: {'id': '12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '5ea51e53-9a27-4f14-94e0-7720b5aadfe6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:46:02.849908 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:02.850948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Bound using segment: {'id': '12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '5ea51e53-9a27-4f14-94e0-7720b5aadfe6'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:46:02.852074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Bound port: be385b2e-0f28-428e-b5b8-de42c3885a30, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': '5ea51e53-9a27-4f14-94e0-7720b5aadfe6'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:46:02.852860 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:02.956249 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-858c6e88-7d70-4792-8a8b-00a680216b07 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:02.958084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-858c6e88-7d70-4792-8a8b-00a680216b07 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.84 "GET /v2.0/networks?id=0de89d0f-e308-41b4-8980-4fb156f3c79b HTTP/1.1" status: 200 len: 910 time: 0.4114478 May 12 15:46:02.977111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Request body: {'port': {'device_id': '99528244-c271-4a64-8ff9-023e3eaee03c', 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b', 'admin_state_up': True, 'tenant_id': '5b43e848e2af491a8dc509c668c33e91'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:02.985992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:02.987012 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-60c31582-bc5c-42a1-97c1-f2efafeeb0cd admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=736334f832d840f4b17175fd055a02f3&name=default HTTP/1.1" status: 200 len: 2983 time: 2.0771940 May 12 15:46:02.994932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45612) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:03.008730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] For port be385b2e-0f28-428e-b5b8-de42c3885a30, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:46:03.014290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60c31582-bc5c-42a1-97c1-f2efafeeb0cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3869fb81-c825-45ad-bb38-e1e79ea7a050,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:03.016945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] For port be385b2e-0f28-428e-b5b8-de42c3885a30, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=be385b2e-0f28-428e-b5b8-de42c3885a30,segment=NetworkSegment(12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc),segment_id=12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:46:03.030703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:03.034647 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:03.034873 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 32cbe545-2b22-4977-b1e1-25ec74a331a2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:03.035707 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:03.081558 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:03.096552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Made reservation on behalf of 5b43e848e2af491a8dc509c668c33e91 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:46:03.098931 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:03.125859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-408b6dd6-089e-4814-aec5-b999d438aeb0 req-d6652951-ab1f-4c2f-a4fb-78a8769c1fc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:03.127281 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-408b6dd6-089e-4814-aec5-b999d438aeb0 req-d6652951-ab1f-4c2f-a4fb-78a8769c1fc1 service neutron] 10.222.0.76 "GET /v2.0/networks?id=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade HTTP/1.1" status: 200 len: 914 time: 0.4641831 May 12 15:46:03.132796 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-134460be-2854-4d95-aa3e-d0a18b1b2e7a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:03.143378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c17b9ea1-feab-4cbf-84ff-c6691bb6bf89 req-052141d5-c6b0-457b-ac91-26697d361944 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:03.144876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c17b9ea1-feab-4cbf-84ff-c6691bb6bf89 req-052141d5-c6b0-457b-ac91-26697d361944 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 944 time: 0.3672972 May 12 15:46:03.220132 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11600d8f-c367-44e5-9157-200a14c307b1 None None] Pushing event updated for resources: {'Port': ['ID=be385b2e-0f28-428e-b5b8-de42c3885a30,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:03.262924 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-134460be-2854-4d95-aa3e-d0a18b1b2e7a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:03.368327 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c17b9ea1-feab-4cbf-84ff-c6691bb6bf89 req-aee911cf-3511-43d9-b7be-ec352b7bdbfc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1743131 May 12 15:46:03.467168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:46:03.503611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'tag': 'e4de15ca-6d9a-47d1-8535-a72265f9c929'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:46:03.575291 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-408b6dd6-089e-4814-aec5-b999d438aeb0 req-00ce6c90-8384-4fdf-8be0-7fc018f59e91 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e4de15ca-6d9a-47d1-8535-a72265f9c929 HTTP/1.1" status: 200 len: 1002 time: 0.4394939 May 12 15:46:03.610927 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4aec110d-e3d3-4356-8936-96d0d0494449'] response: {'name': 'network-changed', 'server_uuid': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'tag': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'status': 'completed', 'code': 200} May 12 15:46:03.613766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Allocated IP 172.20.0.3 (0de89d0f-e308-41b4-8980-4fb156f3c79b/25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e/0e74445e-ee56-4901-85b9-cba1966e3daa) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:46:03.658309 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:46:03.663924 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:03.664357 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:03.682077 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-134460be-2854-4d95-aa3e-d0a18b1b2e7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:03.729617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-408b6dd6-089e-4814-aec5-b999d438aeb0 req-455d2ceb-c035-43d6-b106-6673cf3fd371 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:03.729617 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-408b6dd6-089e-4814-aec5-b999d438aeb0 req-455d2ceb-c035-43d6-b106-6673cf3fd371 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5b4ef35a-b116-4246-86c9-ff3a7aad3410 HTTP/1.1" status: 200 len: 852 time: 0.0752163 May 12 15:46:03.736268 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f44987f3-abc8-406f-a910-5d3647571862 req-58c4b588-2065-4447-9d5c-74ec8bd4fdd0 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 210 time: 0.1456358 May 12 15:46:03.775431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-134460be-2854-4d95-aa3e-d0a18b1b2e7a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3869fb81-c825-45ad-bb38-e1e79ea7a050,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:03.839876 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-134460be-2854-4d95-aa3e-d0a18b1b2e7a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:03.845494 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-134460be-2854-4d95-aa3e-d0a18b1b2e7a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3869fb81-c825-45ad-bb38-e1e79ea7a050 HTTP/1.1" status: 204 len: 168 time: 0.8417907 May 12 15:46:03.959230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-408b6dd6-089e-4814-aec5-b999d438aeb0 req-16311749-b95d-4fb2-963d-ad79e1ba2083 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:03.960739 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-408b6dd6-089e-4814-aec5-b999d438aeb0 req-16311749-b95d-4fb2-963d-ad79e1ba2083 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2302754 May 12 15:46:03.965491 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:04.017487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:46:04.045439 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:04.056073 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:04.087092 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:04.091345 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:04.118928 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:04.120911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Transition to ACTIVE for port object 0e74445e-ee56-4901-85b9-cba1966e3daa will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:46:04.123811 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-64f035eb-b3a3-4c18-862c-dae8bf565a70'] response: {'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'code': 200} May 12 15:46:04.154356 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:04.167980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a9e5c289-e1e2-4485-824e-3e18f4ba6f96'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:46:04.260723 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Network 0de89d0f-e308-41b4-8980-4fb156f3c79b is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:46:04.264356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:46:04.267764 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:46:04.345969 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Pushing event updated for resources: {'Port': ['ID=0e74445e-ee56-4901-85b9-cba1966e3daa,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:04.389325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:04.402360 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:04.404271 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:04.469165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-20afabca-199e-41a2-bed4-8428bed9e434 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1029 time: 1.4975040 May 12 15:46:04.488930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-9106453d-f6e8-4359-a622-772953449649 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:46:04.489595 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-9106453d-f6e8-4359-a622-772953449649 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.84 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0065920 May 12 15:46:04.500418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Request body: {'port': {'device_id': '99528244-c271-4a64-8ff9-023e3eaee03c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:04.581181 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=faefdfb1-a331-4e04-9193-13aa3135c521,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:04.612186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:04.612786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:04.618566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:04.619010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:04.619356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:04.619805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:04.620168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:04.620467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device be385b2e-0f28-428e-b5b8-de42c3885a30 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:46:04.620565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:04.620820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:04.621299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:04.621713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:04.622041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:04.748014 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-408b6dd6-089e-4814-aec5-b999d438aeb0 req-a59231a6-7d0a-4a64-bf25-d57bd9715bc8 service neutron] 10.222.0.76 "GET /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7573338 May 12 15:46:04.814223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port be385b2e-0f28-428e-b5b8-de42c3885a30 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:46:04.890778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e8d9d453-18b0-46a3-b9f8-de1e4a9782e1 None None] Provisioning for port 0e74445e-ee56-4901-85b9-cba1966e3daa completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:46:04.898717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e8d9d453-18b0-46a3-b9f8-de1e4a9782e1 None None] Provisioning complete for port 0e74445e-ee56-4901-85b9-cba1966e3daa triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:04.898717 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e8d9d453-18b0-46a3-b9f8-de1e4a9782e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:05.036606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e8d9d453-18b0-46a3-b9f8-de1e4a9782e1 None None] Port 0e74445e-ee56-4901-85b9-cba1966e3daa cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:46:05.152685 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-408b6dd6-089e-4814-aec5-b999d438aeb0 req-da2a4c25-4b4f-470f-a441-9d6497625cb0 service neutron] 10.222.0.76 "GET /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3664103 May 12 15:46:05.224348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c000dca-31ec-4523-83ea-29c36ddc8327 None None] Network 5ea51e53-9a27-4f14-94e0-7720b5aadfe6 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:05.267380 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d09782d-af4d-441c-8ff5-99f5562d1d5b req-25a55475-4c29-45d1-88f6-52de4d6f2d2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:05.272688 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9d09782d-af4d-441c-8ff5-99f5562d1d5b req-25a55475-4c29-45d1-88f6-52de4d6f2d2e service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 1096 time: 0.8986452 May 12 15:46:05.315955 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:05.329098 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:05.383512 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9d09782d-af4d-441c-8ff5-99f5562d1d5b req-f3bc3701-87d4-41b0-b920-df10557a5dde service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0602386 May 12 15:46:05.421455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd5b8825-c98e-4151-910b-1b90fd30fea0 req-db78d0d1-46b0-4d8f-ba23-7b88b5a6eeb9 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:05.422167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-dd5b8825-c98e-4151-910b-1b90fd30fea0 req-db78d0d1-46b0-4d8f-ba23-7b88b5a6eeb9 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Synchronizing usage tracker for tenant:5b43e848e2af491a8dc509c668c33e91 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:05.455472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-153f2f51-f11f-448f-9d59-def6664eb7b1 req-876f8c25-a67f-4120-9892-010ef1cea67b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:05.457446 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-153f2f51-f11f-448f-9d59-def6664eb7b1 req-876f8c25-a67f-4120-9892-010ef1cea67b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0528307b42774c45be9eba4ffc91c8dd&device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 1097 time: 0.1857209 May 12 15:46:05.464220 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-76d71448-94ec-4f04-9853-5eac100fe456 None None] Provisioning for port be385b2e-0f28-428e-b5b8-de42c3885a30 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:46:05.475289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-76d71448-94ec-4f04-9853-5eac100fe456 None None] Provisioning complete for port be385b2e-0f28-428e-b5b8-de42c3885a30 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:05.475699 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-76d71448-94ec-4f04-9853-5eac100fe456 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:05.514572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9b5ccca-6003-4d66-87ba-02c9f4507eb5 req-e7570cf0-1569-42c0-b3ad-a622c80c8c8f tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:05.516795 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9b5ccca-6003-4d66-87ba-02c9f4507eb5 req-e7570cf0-1569-42c0-b3ad-a622c80c8c8f tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.5027926 May 12 15:46:05.572416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-dd5b8825-c98e-4151-910b-1b90fd30fea0 req-db78d0d1-46b0-4d8f-ba23-7b88b5a6eeb9 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Unset dirty status for tenant:5b43e848e2af491a8dc509c668c33e91 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:05.572416 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd5b8825-c98e-4151-910b-1b90fd30fea0 req-db78d0d1-46b0-4d8f-ba23-7b88b5a6eeb9 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1027 time: 0.5506091 May 12 15:46:05.602866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9b5ccca-6003-4d66-87ba-02c9f4507eb5 req-bdf0bf49-a0ba-47ac-a8dc-b2b1164e4563 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0708895 May 12 15:46:05.691760 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:05.723666 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd5b8825-c98e-4151-910b-1b90fd30fea0 req-bac8c943-e0aa-424a-aabd-d30aca31239c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1491287 May 12 15:46:05.754068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-153f2f51-f11f-448f-9d59-def6664eb7b1 req-12c08c40-887e-43d6-ac4e-ca02f8c28ab3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:05.754068 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-153f2f51-f11f-448f-9d59-def6664eb7b1 req-12c08c40-887e-43d6-ac4e-ca02f8c28ab3 service neutron] 10.222.0.76 "GET /v2.0/networks?id=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade HTTP/1.1" status: 200 len: 914 time: 0.2868409 May 12 15:46:05.851307 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-76d71448-94ec-4f04-9853-5eac100fe456 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:05.895212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0e74445e-ee56-4901-85b9-cba1966e3daa {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:46:05.905852 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:05.927147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-76d71448-94ec-4f04-9853-5eac100fe456 None None] For port be385b2e-0f28-428e-b5b8-de42c3885a30, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=be385b2e-0f28-428e-b5b8-de42c3885a30,segment=NetworkSegment(12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc),segment_id=12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:05.927642 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Transition to ACTIVE for port object 0e74445e-ee56-4901-85b9-cba1966e3daa will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:46:05.933070 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:05.942325 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-76d71448-94ec-4f04-9853-5eac100fe456 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:06.034204 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76d71448-94ec-4f04-9853-5eac100fe456 None None] Pushing event updated for resources: {'Port': ['ID=be385b2e-0f28-428e-b5b8-de42c3885a30,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:06.120849 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-153f2f51-f11f-448f-9d59-def6664eb7b1 req-ec0077dd-2dba-4c2b-9b3f-4d0c12dbc597 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e4de15ca-6d9a-47d1-8535-a72265f9c929 HTTP/1.1" status: 200 len: 1002 time: 0.3247790 May 12 15:46:06.348454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-153f2f51-f11f-448f-9d59-def6664eb7b1 req-5f1699bb-6269-4db9-85ae-4796672a090e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:06.352098 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-153f2f51-f11f-448f-9d59-def6664eb7b1 req-5f1699bb-6269-4db9-85ae-4796672a090e service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5b4ef35a-b116-4246-86c9-ff3a7aad3410 HTTP/1.1" status: 200 len: 852 time: 0.2205863 May 12 15:46:06.361259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Pushing event updated for resources: {'Port': ['ID=0e74445e-ee56-4901-85b9-cba1966e3daa,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:06.407350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device be385b2e-0f28-428e-b5b8-de42c3885a30 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:46:06.454227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Attempting to bind port 0e74445e-ee56-4901-85b9-cba1966e3daa on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:46:06.454732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Attempting to bind port 0e74445e-ee56-4901-85b9-cba1966e3daa by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:46:06.455809 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Attempting to bind port 0e74445e-ee56-4901-85b9-cba1966e3daa on network 0de89d0f-e308-41b4-8980-4fb156f3c79b {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:46:06.489509 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Port 0e74445e-ee56-4901-85b9-cba1966e3daa on network 0de89d0f-e308-41b4-8980-4fb156f3c79b not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:46:06.489835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Attempting to bind port 0e74445e-ee56-4901-85b9-cba1966e3daa on network 0de89d0f-e308-41b4-8980-4fb156f3c79b {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:46:06.524347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 45, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:46:06.524464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Checking segment: {'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:46:06.524804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Bound using segment: {'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:46:06.525247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Bound port: 0e74445e-ee56-4901-85b9-cba1966e3daa, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '61a4fe29-5447-4206-9944-48020c142c8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 586, 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:46:06.526454 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:06.583150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port be385b2e-0f28-428e-b5b8-de42c3885a30 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:06.586198 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:06.798400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] For port 0e74445e-ee56-4901-85b9-cba1966e3daa, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:46:06.804196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] For port 0e74445e-ee56-4901-85b9-cba1966e3daa, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0e74445e-ee56-4901-85b9-cba1966e3daa,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:46:06.817293 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:06.868187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-153f2f51-f11f-448f-9d59-def6664eb7b1 req-d6316f89-f588-4c1d-908d-9444205b3f25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:06.871457 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-153f2f51-f11f-448f-9d59-def6664eb7b1 req-d6316f89-f588-4c1d-908d-9444205b3f25 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3677406 May 12 15:46:06.873969 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-23c407d6-888e-4212-8ba5-c2f8eb41806d None None] Provisioning for port faefdfb1-a331-4e04-9193-13aa3135c521 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:46:06.911326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-23c407d6-888e-4212-8ba5-c2f8eb41806d None None] Provisioning complete for port faefdfb1-a331-4e04-9193-13aa3135c521 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:06.912471 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-23c407d6-888e-4212-8ba5-c2f8eb41806d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:06.945663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:07.051405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-23c407d6-888e-4212-8ba5-c2f8eb41806d None None] Port faefdfb1-a331-4e04-9193-13aa3135c521 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:46:07.065218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-23c407d6-888e-4212-8ba5-c2f8eb41806d None None] Provisioning complete for port be385b2e-0f28-428e-b5b8-de42c3885a30 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:07.065656 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-23c407d6-888e-4212-8ba5-c2f8eb41806d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:07.129006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:07.132448 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:07.134940 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] 10.222.0.84 "PUT /v2.0/ports/0e74445e-ee56-4901-85b9-cba1966e3daa HTTP/1.1" status: 200 len: 1091 time: 2.6395030 May 12 15:46:07.182571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '99528244-c271-4a64-8ff9-023e3eaee03c', 'tag': '0e74445e-ee56-4901-85b9-cba1966e3daa'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:46:07.365070 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:07.365070 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:07.388230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2af9a808-50ae-49eb-9150-195a2af6f33d service neutron] Pushing event updated for resources: {'Port': ['ID=0e74445e-ee56-4901-85b9-cba1966e3daa,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:07.431650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5f003ebd-4485-455a-9610-fb3b786aed4f None None] Provisioning complete for port faefdfb1-a331-4e04-9193-13aa3135c521 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:07.432187 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5f003ebd-4485-455a-9610-fb3b786aed4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:07.470528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377b6909-8d75-4174-911c-903dfb2abf04 req-eb68425e-ddbe-45ba-869f-7b3098ce962e tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:07.479769 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-377b6909-8d75-4174-911c-903dfb2abf04 req-eb68425e-ddbe-45ba-869f-7b3098ce962e tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1094 time: 0.4772170 May 12 15:46:07.509845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5f003ebd-4485-455a-9610-fb3b786aed4f None None] Port faefdfb1-a331-4e04-9193-13aa3135c521 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:46:07.541280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=faefdfb1-a331-4e04-9193-13aa3135c521,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:07.560714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-fe83e21a-32e0-402d-b6a1-926a6d4bd9c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:07.564075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-fe83e21a-32e0-402d-b6a1-926a6d4bd9c1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=5b43e848e2af491a8dc509c668c33e91&device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1094 time: 0.3434482 May 12 15:46:07.601674 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-377b6909-8d75-4174-911c-903dfb2abf04 req-fe02b78f-94b5-471a-b87f-199aacc8111c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1131723 May 12 15:46:07.690429 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f9da69b2-e945-4253-9e71-bea751816af1'] response: {'name': 'network-changed', 'server_uuid': '99528244-c271-4a64-8ff9-023e3eaee03c', 'tag': '0e74445e-ee56-4901-85b9-cba1966e3daa', 'status': 'completed', 'code': 200} May 12 15:46:07.700368 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-b98692be-65f9-415c-84cb-2f322d89d1f3 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=0e74445e-ee56-4901-85b9-cba1966e3daa HTTP/1.1" status: 200 len: 217 time: 0.0997577 May 12 15:46:07.711932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea3fb2e8-8574-4a07-a02b-9d532c54a51b req-4987632c-e88c-4e7b-ad09-7a990989b543 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:07.713423 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea3fb2e8-8574-4a07-a02b-9d532c54a51b req-4987632c-e88c-4e7b-ad09-7a990989b543 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.8038723 May 12 15:46:07.752516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9198b7da-5d01-4ff4-b289-54bc44cfc720 None None] Provisioning complete for port faefdfb1-a331-4e04-9193-13aa3135c521 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:07.753181 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9198b7da-5d01-4ff4-b289-54bc44cfc720 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:07.796188 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-153f2f51-f11f-448f-9d59-def6664eb7b1 req-da5fcb59-ccd2-4722-ab91-92cb02014080 service neutron] 10.222.0.76 "GET /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9034741 May 12 15:46:07.817607 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea3fb2e8-8574-4a07-a02b-9d532c54a51b req-2574d652-9d03-4e95-b2bc-81927ba08c4c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0616589 May 12 15:46:07.823797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-bceda973-0d5c-44ff-865e-ae8af0312d12 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:07.825350 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-bceda973-0d5c-44ff-865e-ae8af0312d12 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e HTTP/1.1" status: 200 len: 848 time: 0.1110392 May 12 15:46:07.835757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9198b7da-5d01-4ff4-b289-54bc44cfc720 None None] Port faefdfb1-a331-4e04-9193-13aa3135c521 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:46:07.960981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-bc5a3077-56da-468a-b0d6-005cdc0c53cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:07.964208 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-bc5a3077-56da-468a-b0d6-005cdc0c53cf service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=0de89d0f-e308-41b4-8980-4fb156f3c79b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1318963 May 12 15:46:07.993934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 5ea51e53-9a27-4f14-94e0-7720b5aadfe6 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:46:08.006088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:46:08.164234 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-153f2f51-f11f-448f-9d59-def6664eb7b1 req-12087ab1-105e-4900-8fc7-879f4e0b21e7 service neutron] 10.222.0.76 "GET /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3616664 May 12 15:46:08.269047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Router 52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:46:08.324478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45708) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:08.426630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-3121bfe2-4bf1-44f8-b0e6-6c6012889012 service neutron] 10.222.0.84 "GET /v2.0/networks/0de89d0f-e308-41b4-8980-4fb156f3c79b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4505792 May 12 15:46:08.427581 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-411a5a4b-59da-49c3-9853-6affed830b11 req-c09cb7fb-c469-4284-995b-21356913d12b service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0581369 May 12 15:46:08.435343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0e4fa0a-d58e-4e4c-bf3b-8cb6a8edeff2 req-22166a6f-e056-4180-8910-7118285d64b3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:08.436771 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0e4fa0a-d58e-4e4c-bf3b-8cb6a8edeff2 req-22166a6f-e056-4180-8910-7118285d64b3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.2900836 May 12 15:46:08.476573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5a56610a-030e-4f69-befd-a85049d3db1a None None] Provisioning complete for port faefdfb1-a331-4e04-9193-13aa3135c521 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:08.477192 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5a56610a-030e-4f69-befd-a85049d3db1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:08.533695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:46:08.546446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aeb70f9-c0aa-4d21-a9ce-b2548fead764 None None] Sync routers for ids ['52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:46:08.566012 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5a56610a-030e-4f69-befd-a85049d3db1a None None] Port faefdfb1-a331-4e04-9193-13aa3135c521 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:46:08.567915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aeb70f9-c0aa-4d21-a9ce-b2548fead764 None None] Routers {'52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:08.568740 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8aeb70f9-c0aa-4d21-a9ce-b2548fead764 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:08.584597 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-411a5a4b-59da-49c3-9853-6affed830b11 req-f72f36d3-5e7f-4f6d-bfec-a7e8cf236d61 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0489151 May 12 15:46:08.596749 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f8149e67-3d82-4236-a64d-31ef77e592e0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:08.602176 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ca62cedb-f66c-4236-a84c-ce75e79da01b tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "PUT /v2.0/routers/52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.1088347 May 12 15:46:08.604695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45714) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:08.627505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f8149e67-3d82-4236-a64d-31ef77e592e0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:08.631429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f8149e67-3d82-4236-a64d-31ef77e592e0 admin admin] Usage tracker for resource:security_group_rule and tenant:7deb9be88c6f477a8d042ea9b129f5c0 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:08.634324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f8149e67-3d82-4236-a64d-31ef77e592e0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:08.640274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f8149e67-3d82-4236-a64d-31ef77e592e0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:08.643567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8aeb70f9-c0aa-4d21-a9ce-b2548fead764 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:08.653010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aeb70f9-c0aa-4d21-a9ce-b2548fead764 None None] Routers {'52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:08.654075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8aeb70f9-c0aa-4d21-a9ce-b2548fead764 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:08.705594 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-411a5a4b-59da-49c3-9853-6affed830b11 req-80f0c521-a8a2-4630-a8a8-804147674a4c service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0950947 May 12 15:46:08.705725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0e4fa0a-d58e-4e4c-bf3b-8cb6a8edeff2 req-423d0170-5c22-4dac-9822-860e40022946 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2438114 May 12 15:46:08.740606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45720) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:08.741858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8aeb70f9-c0aa-4d21-a9ce-b2548fead764 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:08.742286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aeb70f9-c0aa-4d21-a9ce-b2548fead764 None None] The sync data for ids ['52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41'] in n-d-841483-1 is: [] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:46:08.850048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2cc9ab9-1018-412e-8f9c-bed99ee3c60d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:08.850622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b2cc9ab9-1018-412e-8f9c-bed99ee3c60d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:08.869994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-986c7a54-4eed-42b6-8b05-28985ba3d505 req-d89ec4a1-1fce-4769-a491-cfa80a3250ee service neutron] 10.222.0.84 "GET /v2.0/networks/0de89d0f-e308-41b4-8980-4fb156f3c79b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4322345 May 12 15:46:08.900196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411a5a4b-59da-49c3-9853-6affed830b11 req-4b6015cc-68c5-4374-abff-fa3bd1f08985 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:08.900196 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-411a5a4b-59da-49c3-9853-6affed830b11 req-4b6015cc-68c5-4374-abff-fa3bd1f08985 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1785440 May 12 15:46:08.900861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b2cc9ab9-1018-412e-8f9c-bed99ee3c60d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:08.906105 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b2cc9ab9-1018-412e-8f9c-bed99ee3c60d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports?device_id=52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41 HTTP/1.1" status: 200 len: 989 time: 0.2960892 May 12 15:46:08.906230 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f8149e67-3d82-4236-a64d-31ef77e592e0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:08.906305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45724) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:08.913148 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f8149e67-3d82-4236-a64d-31ef77e592e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:08.990935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8149e67-3d82-4236-a64d-31ef77e592e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=03e6aff0-2baf-43ca-bc7f-bc4e903489bb,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:09.034057 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f8149e67-3d82-4236-a64d-31ef77e592e0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7deb9be88c6f477a8d042ea9b129f5c0&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7005088 May 12 15:46:09.047489 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45728) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:09.056738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eca5acb-806f-41d0-a1ef-6d4809b6e8e3 req-66f7116d-a6be-4fcf-aa9a-48aec674709d tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:09.061038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2eca5acb-806f-41d0-a1ef-6d4809b6e8e3 req-66f7116d-a6be-4fcf-aa9a-48aec674709d tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1094 time: 0.3098078 May 12 15:46:09.073206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a133421f-7bbb-4b6d-8958-596eabd83510 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:09.079561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a133421f-7bbb-4b6d-8958-596eabd83510 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 1091 time: 0.3286538 May 12 15:46:09.080230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45732) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:09.097838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address': '172.20.0.5'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:09.122816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:09.124801 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2eca5acb-806f-41d0-a1ef-6d4809b6e8e3 req-9c4b406e-b168-4ce2-8c52-fdbb7d3fb6c0 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482650 May 12 15:46:09.133107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:floatingip and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:09.135246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-745c356d-f50a-4adc-b652-436e0e6e9131 req-f2fa730a-d7e9-4511-a7ca-3d3776da4f1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:09.136643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-745c356d-f50a-4adc-b652-436e0e6e9131 req-f2fa730a-d7e9-4511-a7ca-3d3776da4f1f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=5b43e848e2af491a8dc509c668c33e91&device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1094 time: 0.1487489 May 12 15:46:09.138988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:09.291998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-745c356d-f50a-4adc-b652-436e0e6e9131 req-68852e8f-3b4d-43d3-b846-0b5909697970 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:09.293480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-745c356d-f50a-4adc-b652-436e0e6e9131 req-68852e8f-3b4d-43d3-b846-0b5909697970 service neutron] 10.222.0.84 "GET /v2.0/networks?id=0de89d0f-e308-41b4-8980-4fb156f3c79b HTTP/1.1" status: 200 len: 910 time: 0.1502335 May 12 15:46:09.349294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:09.372078 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-745c356d-f50a-4adc-b652-436e0e6e9131 req-17ed82df-8eb3-410f-81ec-bfcd441c8caa service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=0e74445e-ee56-4901-85b9-cba1966e3daa HTTP/1.1" status: 200 len: 217 time: 0.0714955 May 12 15:46:09.443470 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-745c356d-f50a-4adc-b652-436e0e6e9131 req-4b8e4e1b-432d-494f-acc4-ed71392679cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:09.445045 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-745c356d-f50a-4adc-b652-436e0e6e9131 req-4b8e4e1b-432d-494f-acc4-ed71392679cc service neutron] 10.222.0.84 "GET /v2.0/subnets?id=25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e HTTP/1.1" status: 200 len: 848 time: 0.0666237 May 12 15:46:09.455129 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-31b9f3c0-13ca-4368-82e7-0cd06cede6dd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:09.458959 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:09.532415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-745c356d-f50a-4adc-b652-436e0e6e9131 req-54f23794-dfd5-49d4-9987-a4818943fdc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:09.533915 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-745c356d-f50a-4adc-b652-436e0e6e9131 req-54f23794-dfd5-49d4-9987-a4818943fdc1 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=0de89d0f-e308-41b4-8980-4fb156f3c79b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0822551 May 12 15:46:09.606971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-31b9f3c0-13ca-4368-82e7-0cd06cede6dd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:09.696565 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-745c356d-f50a-4adc-b652-436e0e6e9131 req-e2ffe3c0-4970-4b1d-bc7a-20193649306e service neutron] 10.222.0.84 "GET /v2.0/networks/0de89d0f-e308-41b4-8980-4fb156f3c79b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1549692 May 12 15:46:09.755662 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-31b9f3c0-13ca-4368-82e7-0cd06cede6dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:09.794249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31b9f3c0-13ca-4368-82e7-0cd06cede6dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=03e6aff0-2baf-43ca-bc7f-bc4e903489bb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:09.818544 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-31b9f3c0-13ca-4368-82e7-0cd06cede6dd admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:09.821429 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-31b9f3c0-13ca-4368-82e7-0cd06cede6dd admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/03e6aff0-2baf-43ca-bc7f-bc4e903489bb HTTP/1.1" status: 204 len: 168 time: 0.7713544 May 12 15:46:09.835398 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:09.863699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-745c356d-f50a-4adc-b652-436e0e6e9131 req-b6cbcf71-92eb-4005-8757-e843a02cd691 service neutron] 10.222.0.84 "GET /v2.0/networks/0de89d0f-e308-41b4-8980-4fb156f3c79b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1600456 May 12 15:46:10.026608 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b48aed9-1c58-4c65-9fa6-4799a215ad77 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:10.151898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45744) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:10.170205 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:10.190398 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:10.194291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Usage tracker for resource:security_group_rule and tenant:86b6f8ed4a7340b59ec9ac0d43748200 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:10.197169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.25.8.70 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/d18150c1-fdbe-4e3a-b613-0345e2532d7c) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:46:10.197706 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:10.204140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:10.370063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db3f5a2b-3a8d-4668-8cc0-144ebc05f7df req-df44877b-6c33-4d6f-9761-1403c8332629 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:10.371561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db3f5a2b-3a8d-4668-8cc0-144ebc05f7df req-df44877b-6c33-4d6f-9761-1403c8332629 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1094 time: 0.1251905 May 12 15:46:10.373186 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:10.379042 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:10.469492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4b48aed9-1c58-4c65-9fa6-4799a215ad77 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port faefdfb1-a331-4e04-9193-13aa3135c521 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:10.469844 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b48aed9-1c58-4c65-9fa6-4799a215ad77 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:10.503001 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:10.574092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=86b6f8ed4a7340b59ec9ac0d43748200&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4208364 May 12 15:46:10.577034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=05236c93-6e2f-49c5-8dd2-d81ca0b1157a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:10.587522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45748) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:10.588564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:10.588924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:10.589317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:10.589555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:10.591508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:10.591508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:10.591508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:10.591508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:10.591508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:10.592933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:10.592933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:10.592933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-959ef268-5416-4c16-805c-02ef9ee26a7a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:10.612489 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db3f5a2b-3a8d-4668-8cc0-144ebc05f7df req-b2c1dacd-7336-45eb-99f4-058903457fc0 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2263012 May 12 15:46:10.672547 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff5b2829-c7da-4b36-bbc9-42eaf673d185 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:10.674965 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:10.698218 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff5b2829-c7da-4b36-bbc9-42eaf673d185 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:10.751561 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff5b2829-c7da-4b36-bbc9-42eaf673d185 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:10.754203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b48aed9-1c58-4c65-9fa6-4799a215ad77 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:10.769353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff5b2829-c7da-4b36-bbc9-42eaf673d185 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05236c93-6e2f-49c5-8dd2-d81ca0b1157a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:10.771221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:46:10.775787 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:46:10.778407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:46:10.778750 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ff5b2829-c7da-4b36-bbc9-42eaf673d185 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:10.780234 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ff5b2829-c7da-4b36-bbc9-42eaf673d185 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/05236c93-6e2f-49c5-8dd2-d81ca0b1157a HTTP/1.1" status: 204 len: 168 time: 0.1837294 May 12 15:46:10.865139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=d18150c1-fdbe-4e3a-b613-0345e2532d7c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:11.065118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4b48aed9-1c58-4c65-9fa6-4799a215ad77 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for faefdfb1-a331-4e04-9193-13aa3135c521 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:11.520168 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b48aed9-1c58-4c65-9fa6-4799a215ad77 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:11.581452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b48aed9-1c58-4c65-9fa6-4799a215ad77 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=faefdfb1-a331-4e04-9193-13aa3135c521,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:11.771622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4b48aed9-1c58-4c65-9fa6-4799a215ad77 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:11.830491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d857046-0422-4751-a836-39953db328f8 req-31a3f9a7-e125-4e6d-b51f-f2a024696653 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:11.831992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d857046-0422-4751-a836-39953db328f8 req-31a3f9a7-e125-4e6d-b51f-f2a024696653 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1094 time: 0.0941768 May 12 15:46:11.879098 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d857046-0422-4751-a836-39953db328f8 req-162c4a41-6acb-4601-b6c9-a97a296a79f8 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409167 May 12 15:46:12.082915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:12.092136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4b48aed9-1c58-4c65-9fa6-4799a215ad77 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Router 52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:46:12.291313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4b48aed9-1c58-4c65-9fa6-4799a215ad77 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:46:12.308655 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d763129d-2ff9-4c79-8102-8a385a211b91 None None] Sync routers for ids ['52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:46:12.316358 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:12.329910 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d763129d-2ff9-4c79-8102-8a385a211b91 None None] Routers {'52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:12.331113 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d763129d-2ff9-4c79-8102-8a385a211b91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:12.408215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45798) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:12.409571 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d763129d-2ff9-4c79-8102-8a385a211b91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:12.423900 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d763129d-2ff9-4c79-8102-8a385a211b91 None None] Routers {'52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:12.424700 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d763129d-2ff9-4c79-8102-8a385a211b91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:12.520015 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d763129d-2ff9-4c79-8102-8a385a211b91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:12.520408 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d763129d-2ff9-4c79-8102-8a385a211b91 None None] The sync data for ids ['52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41'] in n-d-841483-1 is: [] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:46:12.548517 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4b48aed9-1c58-4c65-9fa6-4799a215ad77 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "PUT /v2.0/routers/52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6416402 May 12 15:46:12.551334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45806) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:12.607628 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-c90162c5-ed17-4a78-a508-770b4e10e87d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] GET failed (client error): The resource could not be found. May 12 15:46:12.607628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c90162c5-ed17-4a78-a508-770b4e10e87d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:12.704784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c90162c5-ed17-4a78-a508-770b4e10e87d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:12.706079 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c90162c5-ed17-4a78-a508-770b4e10e87d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/faefdfb1-a331-4e04-9193-13aa3135c521 HTTP/1.1" status: 404 len: 333 time: 0.1534617 May 12 15:46:12.708927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45810) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:12.754806 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9a12e20e-abfc-4a28-92e6-e5b655f32b3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:12.864377 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f0d42bf-ffa1-4148-a482-9f315b8b9477 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.155292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab246da5-9162-4de2-a599-5d1927fd7b7b req-978a6b89-340a-49fd-bcc6-70704e5a7b5b tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:13.155292 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab246da5-9162-4de2-a599-5d1927fd7b7b req-978a6b89-340a-49fd-bcc6-70704e5a7b5b tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1094 time: 0.1164234 May 12 15:46:13.193712 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f0d42bf-ffa1-4148-a482-9f315b8b9477 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.205511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f0d42bf-ffa1-4148-a482-9f315b8b9477 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.256403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab246da5-9162-4de2-a599-5d1927fd7b7b req-5679a225-7677-4fda-8f6e-ec5d75f0d381 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632393 May 12 15:46:13.307554 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.311661 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b26f2acf-aee0-41b8-9861-dc3154d67bbd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.311838 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f0d42bf-ffa1-4148-a482-9f315b8b9477 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.312937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9f0d42bf-ffa1-4148-a482-9f315b8b9477 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Fanout notify agent at l3_agent the message router_deleted on router 52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:46:13.325416 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.326335 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.384580 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f0d42bf-ffa1-4148-a482-9f315b8b9477 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.388301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45828) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:13.388573 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9f0d42bf-ffa1-4148-a482-9f315b8b9477 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/routers/52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41 HTTP/1.1" status: 204 len: 168 time: 0.6787229 May 12 15:46:13.478510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=d18150c1-fdbe-4e3a-b613-0345e2532d7c,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:13.491957 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.514168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0e74445e-ee56-4901-85b9-cba1966e3daa details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:46:13.549781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-f789b96c-1b9a-417b-a953-b05461f5699e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting subnet 341373d7-a414-4e68-bbb2-befc9aa72839 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:46:13.557692 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f789b96c-1b9a-417b-a953-b05461f5699e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.693286 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f789b96c-1b9a-417b-a953-b05461f5699e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.713801 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0e74445e-ee56-4901-85b9-cba1966e3daa, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0e74445e-ee56-4901-85b9-cba1966e3daa,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:13.733757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '0e74445e-ee56-4901-85b9-cba1966e3daa', 'network_id': '0de89d0f-e308-41b4-8980-4fb156f3c79b', 'port_id': '0e74445e-ee56-4901-85b9-cba1966e3daa', 'mac_address': 'fa:16:3e:07:02:27', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 586, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:46:13.757204 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Floating IP 81d2aa67-f73f-4acb-8c6b-3410a5437f49 associated. External IP: 172.25.8.70, port: 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6. May 12 15:46:13.809987 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.834405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0e74445e-ee56-4901-85b9-cba1966e3daa {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:46:13.845636 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f789b96c-1b9a-417b-a953-b05461f5699e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.863810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0e74445e-ee56-4901-85b9-cba1966e3daa, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0e74445e-ee56-4901-85b9-cba1966e3daa,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:13.871272 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:13.981583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=0e74445e-ee56-4901-85b9-cba1966e3daa,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:13.995147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:13.995577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:13.996347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:13.996743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:13.997169 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:13.997838 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:13.998150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:13.998774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:13.998841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:13.999235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:14.000138 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:14.000603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:46:14.113925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-b26f2acf-aee0-41b8-9861-dc3154d67bbd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting port 32cbe545-2b22-4977-b1e1-25ec74a331a2 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:14.114252 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b26f2acf-aee0-41b8-9861-dc3154d67bbd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:14.153809 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f789b96c-1b9a-417b-a953-b05461f5699e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:14.212847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f789b96c-1b9a-417b-a953-b05461f5699e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Subnet': ['ID=341373d7-a414-4e68-bbb2-befc9aa72839,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:14.220755 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f789b96c-1b9a-417b-a953-b05461f5699e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:14.232426 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ee28fd5-01fb-4d86-b525-2baf73b3e697 None None] Network 5ea51e53-9a27-4f14-94e0-7720b5aadfe6 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:14.247301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f789b96c-1b9a-417b-a953-b05461f5699e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/341373d7-a414-4e68-bbb2-befc9aa72839 HTTP/1.1" status: 204 len: 168 time: 0.8578110 May 12 15:46:14.261189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45842) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:14.287637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['0e74445e-ee56-4901-85b9-cba1966e3daa'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:46:14.444590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45850) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:14.448140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-b26f2acf-aee0-41b8-9861-dc3154d67bbd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] For port 32cbe545-2b22-4977-b1e1-25ec74a331a2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=32cbe545-2b22-4977-b1e1-25ec74a331a2,segment=NetworkSegment(41769506-c6e2-4d6c-a537-2d71e8a5e3f7),segment_id=41769506-c6e2-4d6c-a537-2d71e8a5e3f7)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:14.448507 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b26f2acf-aee0-41b8-9861-dc3154d67bbd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:14.553793 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:14.584266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port be385b2e-0f28-428e-b5b8-de42c3885a30 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:14.584609 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:14.633097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:46:14.635415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-b26f2acf-aee0-41b8-9861-dc3154d67bbd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Calling delete_port for 32cbe545-2b22-4977-b1e1-25ec74a331a2 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:14.711299 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-051ed157-f984-4f82-a6d7-7e0d07c9e642 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:14.740910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-051ed157-f984-4f82-a6d7-7e0d07c9e642 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:14.746789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-051ed157-f984-4f82-a6d7-7e0d07c9e642 admin admin] Usage tracker for resource:security_group_rule and tenant:7f0dd71721e54741a0be24f36ab79717 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:14.872047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00e19562-f244-461e-b3ff-fb2726efd078 None None] DHCP port deletion for 5ea51e53-9a27-4f14-94e0-7720b5aadfe6 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:46:14.879611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-00e19562-f244-461e-b3ff-fb2726efd078 None None] Deleting port be385b2e-0f28-428e-b5b8-de42c3885a30 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:14.879920 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-00e19562-f244-461e-b3ff-fb2726efd078 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:14.880844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-051ed157-f984-4f82-a6d7-7e0d07c9e642 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:14.903087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-051ed157-f984-4f82-a6d7-7e0d07c9e642 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:14.919062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-007245cd-6aaa-4cd2-a4ab-ed6f65620a1a req-98af2081-4727-455e-a99e-e1de6ab35eb1 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:14.920480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-007245cd-6aaa-4cd2-a4ab-ed6f65620a1a req-98af2081-4727-455e-a99e-e1de6ab35eb1 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1095 time: 0.4514785 May 12 15:46:14.981144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] For port be385b2e-0f28-428e-b5b8-de42c3885a30, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=be385b2e-0f28-428e-b5b8-de42c3885a30,segment=NetworkSegment(12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc),segment_id=12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:14.982292 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:14.995068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:46:15.026514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b44e5d49-3ae6-496a-95d8-829b000ffc71 None None] Sync routers for ids ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:46:15.043447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b44e5d49-3ae6-496a-95d8-829b000ffc71 None None] Routers {'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:15.044290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b44e5d49-3ae6-496a-95d8-829b000ffc71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:45:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:15.049960 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-007245cd-6aaa-4cd2-a4ab-ed6f65620a1a req-1a02a1d5-4ced-4039-8e4d-d188a9a89c54 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1083305 May 12 15:46:15.145034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for be385b2e-0f28-428e-b5b8-de42c3885a30 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:15.195332 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.225535 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-051ed157-f984-4f82-a6d7-7e0d07c9e642 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.236324 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-051ed157-f984-4f82-a6d7-7e0d07c9e642 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.286432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-051ed157-f984-4f82-a6d7-7e0d07c9e642 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c36130cf-1603-481a-8ac0-d26bca7546dc,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:15.299234 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f9ee9568-8a83-4bc6-a2d7-1762b401e0f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 6.2126510 May 12 15:46:15.300865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:46:15.319206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-051ed157-f984-4f82-a6d7-7e0d07c9e642 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7f0dd71721e54741a0be24f36ab79717&name=default HTTP/1.1" status: 200 len: 2983 time: 0.8716555 May 12 15:46:15.319533 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b26f2acf-aee0-41b8-9861-dc3154d67bbd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.324140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45860) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:15.326671 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.395215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-00e19562-f244-461e-b3ff-fb2726efd078 None None] For port be385b2e-0f28-428e-b5b8-de42c3885a30, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=be385b2e-0f28-428e-b5b8-de42c3885a30,segment=NetworkSegment(12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc),segment_id=12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:15.395956 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-00e19562-f244-461e-b3ff-fb2726efd078 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.409532 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6bac79de-fd0b-4d86-950b-a8c51d1cddf6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.423271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b26f2acf-aee0-41b8-9861-dc3154d67bbd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Port': ['ID=32cbe545-2b22-4977-b1e1-25ec74a331a2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:15.436748 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-872fecfd-0dc0-4183-b67e-e600e8b5e999'] response: {'name': 'network-changed', 'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'status': 'completed', 'code': 200} May 12 15:46:15.450788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=be385b2e-0f28-428e-b5b8-de42c3885a30,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:15.454615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No DVR routers for this DVR port be385b2e-0f28-428e-b5b8-de42c3885a30 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:46:15.562062 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0e74445e-ee56-4901-85b9-cba1966e3daa up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:46:15.601510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-00e19562-f244-461e-b3ff-fb2726efd078 None None] Calling delete_port for be385b2e-0f28-428e-b5b8-de42c3885a30 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:15.608713 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.642312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5ea51e53-9a27-4f14-94e0-7720b5aadfe6']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:15.659614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:15.659833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '12846fc0-2c0f-46bd-8ee2-a40f5a9d01dc') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:15.680969 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.699938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b44e5d49-3ae6-496a-95d8-829b000ffc71 None None] Set router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:15.714228 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.727456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Releasing vlan 588 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:46:15.728091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.778992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84c90630-7d84-4e7d-b041-a855851ed538 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: timer() May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:46:15.843097 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:46:15.883884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.884713 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84c90630-7d84-4e7d-b041-a855851ed538 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.904861 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.936654 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-00e19562-f244-461e-b3ff-fb2726efd078 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:46:15.937401 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-00e19562-f244-461e-b3ff-fb2726efd078 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:46:15.940099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Network': ['ID=5ea51e53-9a27-4f14-94e0-7720b5aadfe6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:15.940931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 0e74445e-ee56-4901-85b9-cba1966e3daa completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:46:15.943133 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d5cd1397-22b1-44e6-820c-6cb30aca5c3c tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/networks/5ea51e53-9a27-4f14-94e0-7720b5aadfe6 HTTP/1.1" status: 204 len: 168 time: 1.6807950 May 12 15:46:15.948203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45864) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:15.954583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 0e74445e-ee56-4901-85b9-cba1966e3daa triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:15.954970 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:15.986487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a1318d0-1a90-4a7d-a48b-f940402b0d5c req-7a16e4f1-3874-4179-9452-f45adc1e0780 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:15.988598 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a1318d0-1a90-4a7d-a48b-f940402b0d5c req-7a16e4f1-3874-4179-9452-f45adc1e0780 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.5006747 May 12 15:46:15.993090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d78d0ad-a75d-42ae-bafc-92e4fc955029 req-75b7c450-f7fa-4562-9b5a-9c1917d278a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:15.996390 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d78d0ad-a75d-42ae-bafc-92e4fc955029 req-75b7c450-f7fa-4562-9b5a-9c1917d278a9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 1096 time: 0.5033431 May 12 15:46:16.143300 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:16.159148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7641670-96d8-4de4-be99-e36a18a2fab5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:16.159696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c7641670-96d8-4de4-be99-e36a18a2fab5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:16.177118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c7641670-96d8-4de4-be99-e36a18a2fab5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:16.178612 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c7641670-96d8-4de4-be99-e36a18a2fab5 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/2828a441-fc11-488a-bc82-1cc8de827bc0 HTTP/1.1" status: 200 len: 845 time: 0.2296336 May 12 15:46:16.183219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45870) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:16.324662 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-88910393-f77c-402a-addb-ce7a18fed629 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/2828a441-fc11-488a-bc82-1cc8de827bc0?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.1375096 May 12 15:46:16.326118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45874) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:16.336249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-0a71eb2e-1116-463b-b005-577ea16a5800 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:16.396362 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:16.428476 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:16.447453 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-00e19562-f244-461e-b3ff-fb2726efd078 None None] Deleting port be385b2e-0f28-428e-b5b8-de42c3885a30 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:16.447453 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-00e19562-f244-461e-b3ff-fb2726efd078 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:16.499049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '99528244-c271-4a64-8ff9-023e3eaee03c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e74445e-ee56-4901-85b9-cba1966e3daa'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:46:16.515914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device be385b2e-0f28-428e-b5b8-de42c3885a30 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:16.532867 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a1318d0-1a90-4a7d-a48b-f940402b0d5c req-8645885c-22c4-4aae-a6c8-634baffcdff3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5325129 May 12 15:46:16.545301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45880) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:16.596947 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84c90630-7d84-4e7d-b041-a855851ed538 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:16.599840 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b26f2acf-aee0-41b8-9861-dc3154d67bbd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:16.618091 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5c009278-697b-4cdf-9d16-9279fd3ce35c'] response: {'server_uuid': '99528244-c271-4a64-8ff9-023e3eaee03c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e74445e-ee56-4901-85b9-cba1966e3daa', 'code': 200} May 12 15:46:16.626950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 0e74445e-ee56-4901-85b9-cba1966e3daa, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0e74445e-ee56-4901-85b9-cba1966e3daa,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:16.630319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: be385b2e-0f28-428e-b5b8-de42c3885a30 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:16.633710 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device be385b2e-0f28-428e-b5b8-de42c3885a30 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:16.639825 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84c90630-7d84-4e7d-b041-a855851ed538 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c36130cf-1603-481a-8ac0-d26bca7546dc,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:16.642620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d78d0ad-a75d-42ae-bafc-92e4fc955029 req-30f99c96-78b2-48bc-b565-3e7ead127f0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:16.644004 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d78d0ad-a75d-42ae-bafc-92e4fc955029 req-30f99c96-78b2-48bc-b565-3e7ead127f0b service neutron] 10.222.0.84 "GET /v2.0/networks?id=96b03b8b-8b48-4742-a456-9d456e030e73 HTTP/1.1" status: 200 len: 897 time: 0.4761949 May 12 15:46:16.685031 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:16.692650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-00e19562-f244-461e-b3ff-fb2726efd078 None None] The port 'be385b2e-0f28-428e-b5b8-de42c3885a30' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:46:16.774980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0a71eb2e-1116-463b-b005-577ea16a5800 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:16.777325 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b44e5d49-3ae6-496a-95d8-829b000ffc71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143'}], 'enable_snat': True}, 'gw_port_id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:45:36Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:65:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3654, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:27Z', 'updated_at': '2022-05-12T15:45:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '81d2aa67-f73f-4acb-8c6b-3410a5437f49', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'floating_ip_address': '172.25.8.70', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'port_id': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 3733, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'mac_address': 'fa:16:3e:b3:7c:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:46:11Z', 'updated_at': '2022-05-12T15:46:11Z', 'revision_number': 0, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0f3cbe16-d9fe-46b2-b341-ab176c57b531', 'name': '', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:d8:fe:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_interface', 'standard_attr_id': 3670, 'fixed_ips': [{'subnet_id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:34Z', 'updated_at': '2022-05-12T15:45:46Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:16.783722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=0e74445e-ee56-4901-85b9-cba1966e3daa,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:16.784703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0a71eb2e-1116-463b-b005-577ea16a5800 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:16.786416 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b44e5d49-3ae6-496a-95d8-829b000ffc71 None None] Checking router: f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:46:16.798991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0a71eb2e-1116-463b-b005-577ea16a5800 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:16.800040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b44e5d49-3ae6-496a-95d8-829b000ffc71 None None] Routers {'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:16.800712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b44e5d49-3ae6-496a-95d8-829b000ffc71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:16.817236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0a71eb2e-1116-463b-b005-577ea16a5800 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:16.829445 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aaa19f9a-6b8f-4cca-a09e-87e09e472315 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/81d2aa67-f73f-4acb-8c6b-3410a5437f49 HTTP/1.1" status: 200 len: 990 time: 0.2836301 May 12 15:46:16.849922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a71eb2e-1116-463b-b005-577ea16a5800 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:46:16.855359 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0a71eb2e-1116-463b-b005-577ea16a5800 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:16.925927 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84c90630-7d84-4e7d-b041-a855851ed538 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:16.933944 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-84c90630-7d84-4e7d-b041-a855851ed538 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c36130cf-1603-481a-8ac0-d26bca7546dc HTTP/1.1" status: 204 len: 168 time: 1.5697916 May 12 15:46:16.937895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21eaf083-d123-440d-a544-7ea58050aa6c req-fd0df25d-b1ae-4a4f-8bdc-28fe1709c84a tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:16.940181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21eaf083-d123-440d-a544-7ea58050aa6c req-fd0df25d-b1ae-4a4f-8bdc-28fe1709c84a tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1095 time: 0.6411500 May 12 15:46:17.012275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c6ccb9-82ab-4776-81a6-5da6ec6b4991 req-7e9e06a4-1b6b-4162-81fb-da084a669960 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:17.013962 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-37c6ccb9-82ab-4776-81a6-5da6ec6b4991 req-7e9e06a4-1b6b-4162-81fb-da084a669960 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1096 time: 0.3040209 May 12 15:46:17.037852 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d78d0ad-a75d-42ae-bafc-92e4fc955029 req-adda99e8-3d57-4ae4-b682-fbb897b31646 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 HTTP/1.1" status: 200 len: 998 time: 0.3706396 May 12 15:46:17.090043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b44e5d49-3ae6-496a-95d8-829b000ffc71 None None] Set router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:17.154654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d78d0ad-a75d-42ae-bafc-92e4fc955029 req-7febf117-b17f-47f4-b75f-dd106e2fae40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:17.157274 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d78d0ad-a75d-42ae-bafc-92e4fc955029 req-7febf117-b17f-47f4-b75f-dd106e2fae40 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7ee4997d-d763-4a38-bf54-c1153ac3e51c HTTP/1.1" status: 200 len: 834 time: 0.0980244 May 12 15:46:17.180043 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0a71eb2e-1116-463b-b005-577ea16a5800 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:17.337927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a71eb2e-1116-463b-b005-577ea16a5800 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 61b1250e-09c9-4206-8592-62cee35b5757 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:46:17.344106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-0a71eb2e-1116-463b-b005-577ea16a5800 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:46:17.347925 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21eaf083-d123-440d-a544-7ea58050aa6c req-3ef942c4-13b9-47d3-bac6-4877094b7d84 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2905481 May 12 15:46:17.362977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59996479-4560-4eaf-8dd6-e6f46bba9361 None None] Network 61b1250e-09c9-4206-8592-62cee35b5757 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:17.366912 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-37c6ccb9-82ab-4776-81a6-5da6ec6b4991 req-7a139c6c-38c3-4fbb-90a1-3c4f7701c0f7 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3054676 May 12 15:46:17.371186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a71eb2e-1116-463b-b005-577ea16a5800 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:17.372532 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0a71eb2e-1116-463b-b005-577ea16a5800 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:17.376318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45888) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:17.395962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a71eb2e-1116-463b-b005-577ea16a5800 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Subnet': ['ID=54d8ebb9-ee37-4f15-acb9-b5f8c941aa35,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:17.408606 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0a71eb2e-1116-463b-b005-577ea16a5800 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.0799365 May 12 15:46:17.412841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45890) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:17.429791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'security_group': {'name': 'tempest-secgroup-750390795'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:17.429791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:17.443574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:security_group and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:17.443574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:17.452856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:17.474885 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:17.496378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:17.503288 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:security_group_rule and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:17.504845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:17.511018 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-89e6e969-6482-4944-a453-60fe484d6f7b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:17.512347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:17.538773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-89e6e969-6482-4944-a453-60fe484d6f7b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:17.605999 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:17.607097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-89e6e969-6482-4944-a453-60fe484d6f7b admin admin] Usage tracker for resource:security_group_rule and tenant:dab05f81193a4662be92bbd18e6e70ed is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:17.613272 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:17.636092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-89e6e969-6482-4944-a453-60fe484d6f7b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:17.650773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-89e6e969-6482-4944-a453-60fe484d6f7b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:17.670109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d78d0ad-a75d-42ae-bafc-92e4fc955029 req-afb2586b-0df6-42ca-82cd-120e2a146c0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:17.670847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d78d0ad-a75d-42ae-bafc-92e4fc955029 req-afb2586b-0df6-42ca-82cd-120e2a146c0f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=96b03b8b-8b48-4742-a456-9d456e030e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.5021799 May 12 15:46:17.683861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b02baab1-e1d1-427f-8c70-43ff829a724f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:17.698445 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:17.698445 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4fd3afec-2290-416a-bb17-83aaa61912df tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1744 time: 0.2804627 May 12 15:46:17.705377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45898) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:17.714240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'security_group': {'name': 'tempest-secgroup-1897666146'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:17.722522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:17.727610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:security_group and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:17.730585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:17.737960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:17.750115 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:17.775583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:17.781014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:security_group_rule and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:17.785169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:17.785262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b26f2acf-aee0-41b8-9861-dc3154d67bbd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Router 943c296a-7f18-4231-8088-35f5348abd2b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:46:17.792137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:17.815051 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:17.835697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45902) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:17.857093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b44e5d49-3ae6-496a-95d8-829b000ffc71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143'}], 'enable_snat': True}, 'gw_port_id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:45:36Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:65:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3654, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:27Z', 'updated_at': '2022-05-12T15:45:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '81d2aa67-f73f-4acb-8c6b-3410a5437f49', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'floating_ip_address': '172.25.8.70', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'port_id': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 3733, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'mac_address': 'fa:16:3e:b3:7c:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:46:11Z', 'updated_at': '2022-05-12T15:46:11Z', 'revision_number': 0, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0f3cbe16-d9fe-46b2-b341-ab176c57b531', 'name': '', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:d8:fe:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_interface', 'standard_attr_id': 3670, 'fixed_ips': [{'subnet_id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:34Z', 'updated_at': '2022-05-12T15:45:46Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:17.867181 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b44e5d49-3ae6-496a-95d8-829b000ffc71 None None] The sync data for ids ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'] in n-d-841483-1 is: [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143'}], 'enable_snat': True}, 'gw_port_id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:45:36Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:65:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3654, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:27Z', 'updated_at': '2022-05-12T15:45:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '81d2aa67-f73f-4acb-8c6b-3410a5437f49', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'floating_ip_address': '172.25.8.70', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'port_id': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 3733, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'mac_address': 'fa:16:3e:b3:7c:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:46:11Z', 'updated_at': '2022-05-12T15:46:11Z', 'revision_number': 0, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0f3cbe16-d9fe-46b2-b341-ab176c57b531', 'name': '', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:d8:fe:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_interface', 'standard_attr_id': 3670, 'fixed_ips': [{'subnet_id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:34Z', 'updated_at': '2022-05-12T15:45:46Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:46:17.888712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-61b1250e-09c9-4206-8592-62cee35b5757', 'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'tenant_id': '1da2b935bcd34292b3e8ce00cc114001', 'fixed_ips': [{'subnet_id': '54d8ebb9-ee37-4f15-acb9-b5f8c941aa35'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:46:17.889552 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:17.965438 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e7b510c2-2242-4373-9476-6aab54c702d6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/81d2aa67-f73f-4acb-8c6b-3410a5437f49 HTTP/1.1" status: 200 len: 990 time: 0.1286182 May 12 15:46:17.995876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d78d0ad-a75d-42ae-bafc-92e4fc955029 req-be443fc3-00f7-494a-8fae-b4002f6e64e5 service neutron] 10.222.0.84 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3160577 May 12 15:46:18.033939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:18.047515 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:18.111062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'SecurityGroup': ['ID=970e5d22-57c2-4fa4-90c9-43761db59ee7,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:18.118814 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:18.129257 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dcbfa547-809c-4d65-b38d-2abc2513dd67 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 0.4182689 May 12 15:46:18.130278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45906) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:18.137231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1753956345', 'security_groups': ['970e5d22-57c2-4fa4-90c9-43761db59ee7'], 'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '54d8ebb9-ee37-4f15-acb9-b5f8c941aa35'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:18.198213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Allocated IP 2001:db8::2 (61b1250e-09c9-4206-8592-62cee35b5757/54d8ebb9-ee37-4f15-acb9-b5f8c941aa35/a8ca4652-4c09-412b-9f0f-016c3017550c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:46:18.327150 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2c25bf3-a017-4616-93c6-b14fe2dd202c None None] New status for floating IP 81d2aa67-f73f-4acb-8c6b-3410a5437f49: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:46:18.355695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:18.373838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:18.400716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:46:18.588344 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:18.598187 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-89e6e969-6482-4944-a453-60fe484d6f7b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:18.608261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Transition to ACTIVE for port object a8ca4652-4c09-412b-9f0f-016c3017550c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:46:18.624164 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-89e6e969-6482-4944-a453-60fe484d6f7b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:18.654052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b26f2acf-aee0-41b8-9861-dc3154d67bbd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:46:18.685961 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d52eab8a-97b8-48f6-9690-681565c2a6c2 None None] Sync routers for ids ['943c296a-7f18-4231-8088-35f5348abd2b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:46:18.708061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Transition to ACTIVE for port object a8ca4652-4c09-412b-9f0f-016c3017550c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:46:18.718879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d52eab8a-97b8-48f6-9690-681565c2a6c2 None None] Routers {'943c296a-7f18-4231-8088-35f5348abd2b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:18.719561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d52eab8a-97b8-48f6-9690-681565c2a6c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['943c296a-7f18-4231-8088-35f5348abd2b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:18.755684 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:18.786024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port 4a76d0ac-c154-4755-80bc-31d885b4f632 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:46:18.790097 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d78d0ad-a75d-42ae-bafc-92e4fc955029 req-c9d32887-f7c1-4077-ac6c-66cd30ff02d5 service neutron] 10.222.0.84 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7166548 May 12 15:46:18.832153 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:18.836133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-89e6e969-6482-4944-a453-60fe484d6f7b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=dab05f81193a4662be92bbd18e6e70ed&name=default HTTP/1.1" status: 200 len: 2983 time: 1.3866405 May 12 15:46:18.836133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b26f2acf-aee0-41b8-9861-dc3154d67bbd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "PUT /v2.0/routers/943c296a-7f18-4231-8088-35f5348abd2b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.4248545 May 12 15:46:18.836133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45912) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:18.841743 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89e6e969-6482-4944-a453-60fe484d6f7b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25b24861-a0bb-4b29-9152-1a19c9d4f7d8,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:18.956692 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba5db97e-ca51-4a3c-bed7-0a3e7f070e4c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:18.971267 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45918) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:18.993671 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba5db97e-ca51-4a3c-bed7-0a3e7f070e4c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:19.039713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d1d3909-4a1d-4531-b89a-4e642fa9a50e req-47462a44-7de3-4999-947e-3988b4a4519c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:19.042222 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d1d3909-4a1d-4531-b89a-4e642fa9a50e req-47462a44-7de3-4999-947e-3988b4a4519c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1096 time: 0.3994069 May 12 15:46:19.085984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba5db97e-ca51-4a3c-bed7-0a3e7f070e4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:19.105047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-d52eab8a-97b8-48f6-9690-681565c2a6c2 None None] Set router 943c296a-7f18-4231-8088-35f5348abd2b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:19.116125 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-93da46ca-920f-4a82-ae11-00d08d4a9eb1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/81d2aa67-f73f-4acb-8c6b-3410a5437f49 HTTP/1.1" status: 200 len: 992 time: 0.1432154 May 12 15:46:19.128381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba5db97e-ca51-4a3c-bed7-0a3e7f070e4c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25b24861-a0bb-4b29-9152-1a19c9d4f7d8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:19.131019 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba5db97e-ca51-4a3c-bed7-0a3e7f070e4c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:19.151391 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ba5db97e-ca51-4a3c-bed7-0a3e7f070e4c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/25b24861-a0bb-4b29-9152-1a19c9d4f7d8 HTTP/1.1" status: 204 len: 168 time: 0.3122811 May 12 15:46:19.206941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d1d3909-4a1d-4531-b89a-4e642fa9a50e req-67cd8608-175d-4c37-a4fb-5554172d037e tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1452444 May 12 15:46:19.364804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Allocated IP 2001:db8::33 (61b1250e-09c9-4206-8592-62cee35b5757/54d8ebb9-ee37-4f15-acb9-b5f8c941aa35/4a76d0ac-c154-4755-80bc-31d885b4f632) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:46:19.466159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Network 61b1250e-09c9-4206-8592-62cee35b5757 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:46:19.537747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:46:19.612771 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Pushing event updated for resources: {'Port': ['ID=a8ca4652-4c09-412b-9f0f-016c3017550c,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:19.626644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:46:19.646319 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:19.649525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c5e16f2-d98f-48f8-bf0c-1e561b48d2e0 req-4ec1d156-faec-49d3-b57b-eaa9db83d4ca tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:19.650515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3c5e16f2-d98f-48f8-bf0c-1e561b48d2e0 req-4ec1d156-faec-49d3-b57b-eaa9db83d4ca tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:19.673446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3c5e16f2-d98f-48f8-bf0c-1e561b48d2e0 req-4ec1d156-faec-49d3-b57b-eaa9db83d4ca tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:19.675875 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c5e16f2-d98f-48f8-bf0c-1e561b48d2e0 req-4ec1d156-faec-49d3-b57b-eaa9db83d4ca tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 946 time: 0.1641500 May 12 15:46:19.682287 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Transition to ACTIVE for port object 4a76d0ac-c154-4755-80bc-31d885b4f632 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:46:19.725757 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:19.778450 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Attempting to bind port a8ca4652-4c09-412b-9f0f-016c3017550c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:46:19.779748 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Attempting to bind port a8ca4652-4c09-412b-9f0f-016c3017550c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '88392f67-14f6-47b9-a689-18992378d1e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '61b1250e-09c9-4206-8592-62cee35b5757'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:46:19.780322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Attempting to bind port a8ca4652-4c09-412b-9f0f-016c3017550c on network 61b1250e-09c9-4206-8592-62cee35b5757 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:46:19.786413 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c5e16f2-d98f-48f8-bf0c-1e561b48d2e0 req-7b04c219-f478-4702-97c6-acf72a2cc13e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1028810 May 12 15:46:19.831691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 61b1250e-09c9-4206-8592-62cee35b5757 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:46:19.835119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:46:19.840828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:46:19.847033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:19.847552 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:19.852985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=4a76d0ac-c154-4755-80bc-31d885b4f632,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:19.888487 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-43505fc7-5b23-4f06-9e15-5369a70547b8 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 1.7569172 May 12 15:46:19.889550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 46, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:46:19.889921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Checking segment: {'id': '88392f67-14f6-47b9-a689-18992378d1e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '61b1250e-09c9-4206-8592-62cee35b5757'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:46:19.890912 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:19.891290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Bound using segment: {'id': '88392f67-14f6-47b9-a689-18992378d1e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '61b1250e-09c9-4206-8592-62cee35b5757'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:46:19.891741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Bound port: a8ca4652-4c09-412b-9f0f-016c3017550c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '88392f67-14f6-47b9-a689-18992378d1e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '61b1250e-09c9-4206-8592-62cee35b5757'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:46:19.892079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45934) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:19.892198 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:19.898833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7cdd81f6-aeb4-4067-813f-9ea1f4cf4abe tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:20.004785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d52eab8a-97b8-48f6-9690-681565c2a6c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:46:15Z', 'revision_number': 6, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd2ed2139-605d-4648-ada6-83bbdb6ff583', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'port_id': '42a296ea-fb47-4109-8501-772157438fa6', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 3563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'mac_address': 'fa:16:3e:2d:a9:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:44:34Z', 'updated_at': '2022-05-12T15:44:50Z', 'revision_number': 1, 'project_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:10Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:20.009794 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] For port a8ca4652-4c09-412b-9f0f-016c3017550c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:46:20.013747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] For port a8ca4652-4c09-412b-9f0f-016c3017550c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a8ca4652-4c09-412b-9f0f-016c3017550c,segment=NetworkSegment(88392f67-14f6-47b9-a689-18992378d1e1),segment_id=88392f67-14f6-47b9-a689-18992378d1e1)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:46:20.014793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d52eab8a-97b8-48f6-9690-681565c2a6c2 None None] Checking router: 943c296a-7f18-4231-8088-35f5348abd2b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:46:20.019535 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:20.056057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7cdd81f6-aeb4-4067-813f-9ea1f4cf4abe tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:20.060509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7cdd81f6-aeb4-4067-813f-9ea1f4cf4abe tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:20.065553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7cdd81f6-aeb4-4067-813f-9ea1f4cf4abe tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:20.071341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7cdd81f6-aeb4-4067-813f-9ea1f4cf4abe tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:20.082929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7cdd81f6-aeb4-4067-813f-9ea1f4cf4abe tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:46:20.085157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d52eab8a-97b8-48f6-9690-681565c2a6c2 None None] Routers {'943c296a-7f18-4231-8088-35f5348abd2b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:20.086067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d52eab8a-97b8-48f6-9690-681565c2a6c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['943c296a-7f18-4231-8088-35f5348abd2b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:20.086526 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7cdd81f6-aeb4-4067-813f-9ea1f4cf4abe tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:20.260558 n-d-841483-1 neutron-server[88151]: INFO neutron.db.ipam_backend_mixin [None req-7cdd81f6-aeb4-4067-813f-9ea1f4cf4abe tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 54d8ebb9-ee37-4f15-acb9-b5f8c941aa35 (CIDR: 2001:db8::/64) May 12 15:46:20.266478 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-7cdd81f6-aeb4-4067-813f-9ea1f4cf4abe tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:46:20.266926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7cdd81f6-aeb4-4067-813f-9ea1f4cf4abe tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:46:20.293020 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7cdd81f6-aeb4-4067-813f-9ea1f4cf4abe tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3998668 May 12 15:46:20.295772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 45950) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:20.303596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-5b07e163-fe9d-46b3-b314-f4f950e70dff tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:20.310487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf6fd042-d2d5-42e2-b193-49c1589192e8 None None] Pushing event updated for resources: {'Port': ['ID=a8ca4652-4c09-412b-9f0f-016c3017550c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:20.400860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-d52eab8a-97b8-48f6-9690-681565c2a6c2 None None] Set router 943c296a-7f18-4231-8088-35f5348abd2b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:20.580043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5b07e163-fe9d-46b3-b314-f4f950e70dff tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:20.585555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5b07e163-fe9d-46b3-b314-f4f950e70dff tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:20.590801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5b07e163-fe9d-46b3-b314-f4f950e70dff tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:20.597901 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5b07e163-fe9d-46b3-b314-f4f950e70dff tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:20.601236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22640aed-20b3-4339-a9d6-167df941050a req-a30ad191-2103-4d24-b9e4-0661c7b9d1cc tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:20.602811 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22640aed-20b3-4339-a9d6-167df941050a req-a30ad191-2103-4d24-b9e4-0661c7b9d1cc tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1096 time: 0.1575570 May 12 15:46:20.627615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5b07e163-fe9d-46b3-b314-f4f950e70dff tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:46:20.632652 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5b07e163-fe9d-46b3-b314-f4f950e70dff tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:20.749322 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22640aed-20b3-4339-a9d6-167df941050a req-fb4cb6b7-1e51-449e-ab82-07a193cbda5b tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1401091 May 12 15:46:20.845370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d52eab8a-97b8-48f6-9690-681565c2a6c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:46:15Z', 'revision_number': 6, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd2ed2139-605d-4648-ada6-83bbdb6ff583', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'port_id': '42a296ea-fb47-4109-8501-772157438fa6', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 3563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'mac_address': 'fa:16:3e:2d:a9:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:44:34Z', 'updated_at': '2022-05-12T15:44:50Z', 'revision_number': 1, 'project_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:10Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:20.850739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d52eab8a-97b8-48f6-9690-681565c2a6c2 None None] The sync data for ids ['943c296a-7f18-4231-8088-35f5348abd2b'] in n-d-841483-1 is: [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:46:15Z', 'revision_number': 6, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'd2ed2139-605d-4648-ada6-83bbdb6ff583', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'floating_ip_address': '172.25.8.55', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'port_id': '42a296ea-fb47-4109-8501-772157438fa6', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 3563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'mac_address': 'fa:16:3e:2d:a9:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:44:34Z', 'updated_at': '2022-05-12T15:44:50Z', 'revision_number': 1, 'project_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:10Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:46:21.115095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1713476d-4a47-446e-84b3-66bf6efc585e req-f4cb874d-ecd1-4db4-9c63-aaf2828aafbd tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:21.116595 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1713476d-4a47-446e-84b3-66bf6efc585e req-f4cb874d-ecd1-4db4-9c63-aaf2828aafbd tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1096 time: 0.1830571 May 12 15:46:21.223136 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5b07e163-fe9d-46b3-b314-f4f950e70dff tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:21.282658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dff8d1b-b430-4ad3-9d12-603e49b5f729 req-cc21fb59-8776-49dd-bec9-0ef6043cb5ae tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:21.283583 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5dff8d1b-b430-4ad3-9d12-603e49b5f729 req-cc21fb59-8776-49dd-bec9-0ef6043cb5ae tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 946 time: 0.3135915 May 12 15:46:21.387340 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1713476d-4a47-446e-84b3-66bf6efc585e req-2936c1ba-a0f7-489b-93c3-d9116cc7d3b8 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2631123 May 12 15:46:21.389669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b07e163-fe9d-46b3-b314-f4f950e70dff tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 61b1250e-09c9-4206-8592-62cee35b5757 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:46:21.420768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-5b07e163-fe9d-46b3-b314-f4f950e70dff tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:46:21.435235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b07e163-fe9d-46b3-b314-f4f950e70dff tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:21.435235 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5b07e163-fe9d-46b3-b314-f4f950e70dff tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:21.458602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b07e163-fe9d-46b3-b314-f4f950e70dff tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Subnet': ['ID=95b1e088-a677-4f6e-9cf8-8bb51f36684d,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:21.490279 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5dff8d1b-b430-4ad3-9d12-603e49b5f729 req-7ca6b34e-ad9d-467a-9703-cb0dd8e5b1ba tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=e4f60c54-e7d8-4d35-b4f9-38e9a427040b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1868820 May 12 15:46:21.496020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 45980) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:21.496448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5b07e163-fe9d-46b3-b314-f4f950e70dff tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.1979954 May 12 15:46:21.502383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-858437e3-1d8c-4cf3-b053-1d9a89ce3599 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1116415894', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '95b1e088-a677-4f6e-9cf8-8bb51f36684d'}], 'security_groups': ['b02baab1-e1d1-427f-8c70-43ff829a724f']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:21.509832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d087e954-1597-4204-95dc-72512db382e1 req-a9a3c6fb-ab8d-49b7-a477-0ca9694ae79f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:21.511371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d087e954-1597-4204-95dc-72512db382e1 req-a9a3c6fb-ab8d-49b7-a477-0ca9694ae79f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 946 time: 0.3636405 May 12 15:46:21.540491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42686db5-eafb-4fc4-9f14-ba6dd85473de None None] Network 61b1250e-09c9-4206-8592-62cee35b5757 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:21.663055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-d087e954-1597-4204-95dc-72512db382e1 req-68a21682-9f25-4331-b31a-9440ccd784d6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting port 8160be06-21c8-4d3e-a7d7-af54735fddd1 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:21.663055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d087e954-1597-4204-95dc-72512db382e1 req-68a21682-9f25-4331-b31a-9440ccd784d6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:21.695767 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3fab9fb2-a689-4066-ba2c-e8d33b53d045 None None] Provisioning complete for port 2828a441-fc11-488a-bc82-1cc8de827bc0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:21.695968 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3fab9fb2-a689-4066-ba2c-e8d33b53d045 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:21.742341 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-858437e3-1d8c-4cf3-b053-1d9a89ce3599 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:21.821667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8e1e125-70b5-4a7d-9520-fd8ac69c0f84 req-267c9b14-cd37-4ee7-b8b5-12373c9ea74b tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:21.823087 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8e1e125-70b5-4a7d-9520-fd8ac69c0f84 req-267c9b14-cd37-4ee7-b8b5-12373c9ea74b tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1096 time: 0.2253036 May 12 15:46:21.880722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3fab9fb2-a689-4066-ba2c-e8d33b53d045 None None] Port 2828a441-fc11-488a-bc82-1cc8de827bc0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:46:21.956641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8e1e125-70b5-4a7d-9520-fd8ac69c0f84 req-70e652a4-8c92-4c27-b9c7-4d9df320327b tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0779436 May 12 15:46:21.966202 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3fab9fb2-a689-4066-ba2c-e8d33b53d045 None None] Provisioning for port a8ca4652-4c09-412b-9f0f-016c3017550c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:46:22.019858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-d087e954-1597-4204-95dc-72512db382e1 req-68a21682-9f25-4331-b31a-9440ccd784d6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] For port 8160be06-21c8-4d3e-a7d7-af54735fddd1, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8160be06-21c8-4d3e-a7d7-af54735fddd1,segment=NetworkSegment(41769506-c6e2-4d6c-a537-2d71e8a5e3f7),segment_id=41769506-c6e2-4d6c-a537-2d71e8a5e3f7)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:22.019858 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d087e954-1597-4204-95dc-72512db382e1 req-68a21682-9f25-4331-b31a-9440ccd784d6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:22.187786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ebea2a7-9cd8-4701-bd0c-a87a39cad6b4 None None] Update dhcp port {'port': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'fixed_ips': [{'subnet_id': '54d8ebb9-ee37-4f15-acb9-b5f8c941aa35', 'ip_address': '2001:db8::2'}, {'subnet_id': '95b1e088-a677-4f6e-9cf8-8bb51f36684d'}], 'binding:host_id': 'n-d-841483-1'}, 'id': 'a8ca4652-4c09-412b-9f0f-016c3017550c'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:46:22.300794 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1ebea2a7-9cd8-4701-bd0c-a87a39cad6b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:22.344031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-d087e954-1597-4204-95dc-72512db382e1 req-68a21682-9f25-4331-b31a-9440ccd784d6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Calling delete_port for 8160be06-21c8-4d3e-a7d7-af54735fddd1 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:22.376758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-858437e3-1d8c-4cf3-b053-1d9a89ce3599 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Delete allocated IP 2001:db8::33 (61b1250e-09c9-4206-8592-62cee35b5757/54d8ebb9-ee37-4f15-acb9-b5f8c941aa35) {{(pid=88151) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} May 12 15:46:22.397071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-858437e3-1d8c-4cf3-b053-1d9a89ce3599 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Allocated IP 2001:db8:0:1::36 (61b1250e-09c9-4206-8592-62cee35b5757/95b1e088-a677-4f6e-9cf8-8bb51f36684d/4a76d0ac-c154-4755-80bc-31d885b4f632) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:46:22.491049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a8ca4652-4c09-412b-9f0f-016c3017550c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:46:22.596498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port a8ca4652-4c09-412b-9f0f-016c3017550c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:46:22.615463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a8ca4652-4c09-412b-9f0f-016c3017550c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:22.616109 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:22.654073 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d087e954-1597-4204-95dc-72512db382e1 req-68a21682-9f25-4331-b31a-9440ccd784d6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:22.755753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68a21682-9f25-4331-b31a-9440ccd784d6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Port': ['ID=8160be06-21c8-4d3e-a7d7-af54735fddd1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:22.762955 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f44c9355-a51e-443b-8deb-0a3ff1d5ff65 req-4ddeb157-0cdf-4080-b187-9e0ca895bbc7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=66325ace-1cb7-4f16-9e03-a30ac6c4fc01 HTTP/1.1" status: 200 len: 210 time: 0.1069765 May 12 15:46:22.826837 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1fd611e-1be3-48f0-9945-c0b6b29a6d8c req-fd64d5af-babb-468d-baf4-8ea3270ff606 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:22.828574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a1fd611e-1be3-48f0-9945-c0b6b29a6d8c req-fd64d5af-babb-468d-baf4-8ea3270ff606 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1096 time: 0.2615392 May 12 15:46:22.835159 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:22.858313 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-858437e3-1d8c-4cf3-b053-1d9a89ce3599 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:22.880868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port a8ca4652-4c09-412b-9f0f-016c3017550c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a8ca4652-4c09-412b-9f0f-016c3017550c,segment=NetworkSegment(88392f67-14f6-47b9-a689-18992378d1e1),segment_id=88392f67-14f6-47b9-a689-18992378d1e1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:22.882489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-d087e954-1597-4204-95dc-72512db382e1 req-68a21682-9f25-4331-b31a-9440ccd784d6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] No DVR routers for this DVR port 8160be06-21c8-4d3e-a7d7-af54735fddd1 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:46:22.887104 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d087e954-1597-4204-95dc-72512db382e1 req-68a21682-9f25-4331-b31a-9440ccd784d6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:22.888094 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:22.894259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '66325ace-1cb7-4f16-9e03-a30ac6c4fc01', 'name': 'network-vif-deleted', 'tag': '8160be06-21c8-4d3e-a7d7-af54735fddd1'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:46:22.896891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-858437e3-1d8c-4cf3-b053-1d9a89ce3599 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Ignored duplicate provisioning block setup for port 4a76d0ac-c154-4755-80bc-31d885b4f632 by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:68}} May 12 15:46:22.904337 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-858437e3-1d8c-4cf3-b053-1d9a89ce3599 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:22.930007 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d087e954-1597-4204-95dc-72512db382e1 req-68a21682-9f25-4331-b31a-9440ccd784d6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "DELETE /v2.0/ports/8160be06-21c8-4d3e-a7d7-af54735fddd1 HTTP/1.1" status: 204 len: 173 time: 1.4074900 May 12 15:46:22.941906 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a1fd611e-1be3-48f0-9945-c0b6b29a6d8c req-846b2886-6412-4ee9-9ec7-daf1fc882a57 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797091 May 12 15:46:22.981783 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 32cbe545-2b22-4977-b1e1-25ec74a331a2 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:22.996232 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2e914adf-96e1-4c8d-a5c3-e5953b73df7b'] response: {'server_uuid': '66325ace-1cb7-4f16-9e03-a30ac6c4fc01', 'name': 'network-vif-deleted', 'tag': '8160be06-21c8-4d3e-a7d7-af54735fddd1', 'status': 'completed', 'code': 200} May 12 15:46:23.059729 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 32cbe545-2b22-4977-b1e1-25ec74a331a2 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:23.060221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 32cbe545-2b22-4977-b1e1-25ec74a331a2 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:23.085325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-858437e3-1d8c-4cf3-b053-1d9a89ce3599 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] In _notify_port_updated(), no bound segment for port 4a76d0ac-c154-4755-80bc-31d885b4f632 on network 61b1250e-09c9-4206-8592-62cee35b5757 {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:46:23.090996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-858437e3-1d8c-4cf3-b053-1d9a89ce3599 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:23.091605 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-858437e3-1d8c-4cf3-b053-1d9a89ce3599 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:23.092891 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-858437e3-1d8c-4cf3-b053-1d9a89ce3599 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "PUT /v2.0/ports/4a76d0ac-c154-4755-80bc-31d885b4f632 HTTP/1.1" status: 200 len: 930 time: 1.5957346 May 12 15:46:23.096500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46014) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:23.107438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-858437e3-1d8c-4cf3-b053-1d9a89ce3599 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=4a76d0ac-c154-4755-80bc-31d885b4f632,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:23.178478 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=a8ca4652-4c09-412b-9f0f-016c3017550c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:23.190926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-1ebea2a7-9cd8-4701-bd0c-a87a39cad6b4 None None] Allocated IP 2001:db8:0:1::2 (61b1250e-09c9-4206-8592-62cee35b5757/95b1e088-a677-4f6e-9cf8-8bb51f36684d/a8ca4652-4c09-412b-9f0f-016c3017550c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:46:23.225551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-596a44ec-30d5-47e3-8738-c575c8b85be6 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 4a76d0ac-c154-4755-80bc-31d885b4f632 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:23.225551 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-596a44ec-30d5-47e3-8738-c575c8b85be6 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:23.414743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1ebea2a7-9cd8-4701-bd0c-a87a39cad6b4 None None] For port a8ca4652-4c09-412b-9f0f-016c3017550c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a8ca4652-4c09-412b-9f0f-016c3017550c,segment=NetworkSegment(88392f67-14f6-47b9-a689-18992378d1e1),segment_id=88392f67-14f6-47b9-a689-18992378d1e1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:23.441324 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1ebea2a7-9cd8-4701-bd0c-a87a39cad6b4 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:23.460746 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1ebea2a7-9cd8-4701-bd0c-a87a39cad6b4 None None] Transition to ACTIVE for port object a8ca4652-4c09-412b-9f0f-016c3017550c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:46:23.466046 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1ebea2a7-9cd8-4701-bd0c-a87a39cad6b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:23.576013 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-596a44ec-30d5-47e3-8738-c575c8b85be6 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:23.650020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ebea2a7-9cd8-4701-bd0c-a87a39cad6b4 None None] Pushing event updated for resources: {'Port': ['ID=a8ca4652-4c09-412b-9f0f-016c3017550c,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:23.732720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-596a44ec-30d5-47e3-8738-c575c8b85be6 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 4a76d0ac-c154-4755-80bc-31d885b4f632 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:23.901684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46024) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:23.921341 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-596a44ec-30d5-47e3-8738-c575c8b85be6 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:23.990835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-596a44ec-30d5-47e3-8738-c575c8b85be6 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=4a76d0ac-c154-4755-80bc-31d885b4f632,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:24.033027 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-88107e58-b34b-4667-9946-263ff9c4fcab tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.042510 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-596a44ec-30d5-47e3-8738-c575c8b85be6 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.058777 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-596a44ec-30d5-47e3-8738-c575c8b85be6 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/4a76d0ac-c154-4755-80bc-31d885b4f632 HTTP/1.1" status: 204 len: 168 time: 0.9610100 May 12 15:46:24.061153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46030) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:24.105420 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-88107e58-b34b-4667-9946-263ff9c4fcab tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.185810 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-88107e58-b34b-4667-9946-263ff9c4fcab tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.207221 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88107e58-b34b-4667-9946-263ff9c4fcab tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4f60c54-e7d8-4d35-b4f9-38e9a427040b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:24.219724 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-0c004cf3-a253-4683-a49c-b2b52602f143 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] GET failed (client error): The resource could not be found. May 12 15:46:24.220246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0c004cf3-a253-4683-a49c-b2b52602f143 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:24.227670 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-88107e58-b34b-4667-9946-263ff9c4fcab tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.228811 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-88107e58-b34b-4667-9946-263ff9c4fcab tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "DELETE /v2.0/security-groups/e4f60c54-e7d8-4d35-b4f9-38e9a427040b HTTP/1.1" status: 204 len: 168 time: 0.3260236 May 12 15:46:24.271033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0c004cf3-a253-4683-a49c-b2b52602f143 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:24.272331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0c004cf3-a253-4683-a49c-b2b52602f143 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/4a76d0ac-c154-4755-80bc-31d885b4f632 HTTP/1.1" status: 404 len: 333 time: 0.2102506 May 12 15:46:24.275415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46038) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:24.292479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46042) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:24.399463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a8ca4652-4c09-412b-9f0f-016c3017550c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:46:24.439781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9930fd53-e244-4f1f-81d5-d8b687f286f4 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.473633 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9930fd53-e244-4f1f-81d5-d8b687f286f4 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.528389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-305ae9ee-2aeb-43c3-ac27-2462b2fbbe51 req-b9fb64ff-ae5d-473c-a974-c069a42ec330 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:24.529900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-305ae9ee-2aeb-43c3-ac27-2462b2fbbe51 req-b9fb64ff-ae5d-473c-a974-c069a42ec330 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1096 time: 0.4132497 May 12 15:46:24.541053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9947545c-2af3-4a7d-9e0c-24e933bcbc22 req-b819e7cf-37da-4b85-88c5-e234be6cb656 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:24.542016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9930fd53-e244-4f1f-81d5-d8b687f286f4 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.542502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9947545c-2af3-4a7d-9e0c-24e933bcbc22 req-b819e7cf-37da-4b85-88c5-e234be6cb656 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.84 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 1096 time: 0.4323313 May 12 15:46:24.548928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-d61d269e-06e1-479c-822f-d347228ef26f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting subnet 854614c5-2c9e-43c0-8389-330eb4e14250 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:46:24.567966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9930fd53-e244-4f1f-81d5-d8b687f286f4 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=970e5d22-57c2-4fa4-90c9-43761db59ee7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:24.574638 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9930fd53-e244-4f1f-81d5-d8b687f286f4 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.580953 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9930fd53-e244-4f1f-81d5-d8b687f286f4 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/security-groups/970e5d22-57c2-4fa4-90c9-43761db59ee7 HTTP/1.1" status: 204 len: 168 time: 0.3041356 May 12 15:46:24.582343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46054) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:24.616471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1ee904ce-a52b-4988-8d45-608937561fce None None] Could not find standard attr ID for object 4a76d0ac-c154-4755-80bc-31d885b4f632. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:46:24.633823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-9947545c-2af3-4a7d-9e0c-24e933bcbc22 req-4c4f567d-80cc-4e9a-aa7e-4696c7b1347c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Deleting port 0e74445e-ee56-4901-85b9-cba1966e3daa {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:24.633823 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9947545c-2af3-4a7d-9e0c-24e933bcbc22 req-4c4f567d-80cc-4e9a-aa7e-4696c7b1347c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.660216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1ee904ce-a52b-4988-8d45-608937561fce None None] Provisioning complete for port 2828a441-fc11-488a-bc82-1cc8de827bc0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:24.660650 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1ee904ce-a52b-4988-8d45-608937561fce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.674362 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d61d269e-06e1-479c-822f-d347228ef26f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.708877 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ec63920-31c1-4955-9b33-b21fbed2ee0f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.778745 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1ee904ce-a52b-4988-8d45-608937561fce None None] Port 2828a441-fc11-488a-bc82-1cc8de827bc0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:46:24.781492 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-305ae9ee-2aeb-43c3-ac27-2462b2fbbe51 req-2db859f8-8e9e-4fbb-b4d7-0f96fbbfc212 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2376423 May 12 15:46:24.800144 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d61d269e-06e1-479c-822f-d347228ef26f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.803244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1ee904ce-a52b-4988-8d45-608937561fce None None] Provisioning for port a8ca4652-4c09-412b-9f0f-016c3017550c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:46:24.809240 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1ee904ce-a52b-4988-8d45-608937561fce None None] Provisioning complete for port a8ca4652-4c09-412b-9f0f-016c3017550c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:24.809698 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1ee904ce-a52b-4988-8d45-608937561fce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.814120 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ec63920-31c1-4955-9b33-b21fbed2ee0f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.876338 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ec63920-31c1-4955-9b33-b21fbed2ee0f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.910240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ec63920-31c1-4955-9b33-b21fbed2ee0f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b02baab1-e1d1-427f-8c70-43ff829a724f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:24.919320 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0ec63920-31c1-4955-9b33-b21fbed2ee0f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:24.926954 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0ec63920-31c1-4955-9b33-b21fbed2ee0f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/security-groups/b02baab1-e1d1-427f-8c70-43ff829a724f HTTP/1.1" status: 204 len: 168 time: 0.3405912 May 12 15:46:24.926954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46068) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:25.006084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-ddc3afc7-3645-4a3b-b13c-a4b72d860b00 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting subnet 54d8ebb9-ee37-4f15-acb9-b5f8c941aa35 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:46:25.008887 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ddc3afc7-3645-4a3b-b13c-a4b72d860b00 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:25.079105 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ddc3afc7-3645-4a3b-b13c-a4b72d860b00 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:25.109984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fe58e683-85fa-4d06-82fc-8e9c0ea61c6a None None] Could not find standard attr ID for object 4a76d0ac-c154-4755-80bc-31d885b4f632. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:46:25.120555 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d61d269e-06e1-479c-822f-d347228ef26f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:25.217767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-9947545c-2af3-4a7d-9e0c-24e933bcbc22 req-4c4f567d-80cc-4e9a-aa7e-4696c7b1347c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] For port 0e74445e-ee56-4901-85b9-cba1966e3daa, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=0e74445e-ee56-4901-85b9-cba1966e3daa,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:25.218712 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9947545c-2af3-4a7d-9e0c-24e933bcbc22 req-4c4f567d-80cc-4e9a-aa7e-4696c7b1347c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:25.228357 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b215a0ff-c469-40a4-bda7-d4fc05e99ab5 None None] Could not find standard attr ID for object 4a76d0ac-c154-4755-80bc-31d885b4f632. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:46:25.254700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ddc3afc7-3645-4a3b-b13c-a4b72d860b00 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:25.358731 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ddc3afc7-3645-4a3b-b13c-a4b72d860b00 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:25.397042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-9947545c-2af3-4a7d-9e0c-24e933bcbc22 req-4c4f567d-80cc-4e9a-aa7e-4696c7b1347c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Calling delete_port for 0e74445e-ee56-4901-85b9-cba1966e3daa owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:25.401740 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ddc3afc7-3645-4a3b-b13c-a4b72d860b00 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:25.414811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddc3afc7-3645-4a3b-b13c-a4b72d860b00 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Subnet': ['ID=54d8ebb9-ee37-4f15-acb9-b5f8c941aa35,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:25.418540 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ddc3afc7-3645-4a3b-b13c-a4b72d860b00 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/54d8ebb9-ee37-4f15-acb9-b5f8c941aa35 HTTP/1.1" status: 204 len: 168 time: 0.4922080 May 12 15:46:25.423363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46076) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:25.429613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c858be02-1670-4b6f-8184-52beb20247e0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:25.461191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d92d07d9-4af8-4462-94aa-b9982f1f9617 None None] Network 61b1250e-09c9-4206-8592-62cee35b5757 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:25.489350 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d61d269e-06e1-479c-822f-d347228ef26f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:25.558626 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d61d269e-06e1-479c-822f-d347228ef26f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:25.563891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d61d269e-06e1-479c-822f-d347228ef26f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Subnet': ['ID=854614c5-2c9e-43c0-8389-330eb4e14250,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:25.572684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d61d269e-06e1-479c-822f-d347228ef26f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "DELETE /v2.0/subnets/854614c5-2c9e-43c0-8389-330eb4e14250 HTTP/1.1" status: 204 len: 168 time: 1.2770700 May 12 15:46:25.574757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8160be06-21c8-4d3e-a7d7-af54735fddd1 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:25.575329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46080) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:25.621126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c858be02-1670-4b6f-8184-52beb20247e0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:25.622520 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b4bdedc-cdb6-4a72-b02d-a0e7d6f8ba06 None None] Network 81ad07c9-5912-449b-bb49-14d754ee47c0 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:25.626921 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c858be02-1670-4b6f-8184-52beb20247e0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:25.630739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c858be02-1670-4b6f-8184-52beb20247e0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:25.642908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c858be02-1670-4b6f-8184-52beb20247e0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:25.657027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c858be02-1670-4b6f-8184-52beb20247e0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:46:25.659023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 8160be06-21c8-4d3e-a7d7-af54735fddd1 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:25.659500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8160be06-21c8-4d3e-a7d7-af54735fddd1 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:25.663993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c858be02-1670-4b6f-8184-52beb20247e0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:25.772367 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:25.786114 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9947545c-2af3-4a7d-9e0c-24e933bcbc22 req-4c4f567d-80cc-4e9a-aa7e-4696c7b1347c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:25.794346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:25.794688 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:25.819284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a9e5c289-e1e2-4485-824e-3e18f4ba6f96'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:46:25.876782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['0e74445e-ee56-4901-85b9-cba1966e3daa'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:46:25.984081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c4f567d-80cc-4e9a-aa7e-4696c7b1347c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Pushing event deleted for resources: {'Port': ['ID=0e74445e-ee56-4901-85b9-cba1966e3daa,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:26.108532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d442c308-dfa8-410f-bae9-9076eeec07d8 req-b19134b6-20ce-4eaf-8d8e-562b3740bd16 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 210 time: 0.1202581 May 12 15:46:26.187768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-9947545c-2af3-4a7d-9e0c-24e933bcbc22 req-4c4f567d-80cc-4e9a-aa7e-4696c7b1347c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] No DVR routers for this DVR port 0e74445e-ee56-4901-85b9-cba1966e3daa on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:46:26.192771 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-9947545c-2af3-4a7d-9e0c-24e933bcbc22 req-4c4f567d-80cc-4e9a-aa7e-4696c7b1347c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:26.204839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '99528244-c271-4a64-8ff9-023e3eaee03c', 'name': 'network-vif-deleted', 'tag': '0e74445e-ee56-4901-85b9-cba1966e3daa'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:46:26.284177 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c858be02-1670-4b6f-8184-52beb20247e0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:26.418496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c858be02-1670-4b6f-8184-52beb20247e0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 61b1250e-09c9-4206-8592-62cee35b5757 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:46:26.428832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-c858be02-1670-4b6f-8184-52beb20247e0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:46:26.433789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c858be02-1670-4b6f-8184-52beb20247e0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:26.434377 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c858be02-1670-4b6f-8184-52beb20247e0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:26.453634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83df1618-2dce-41e0-bb03-68d5e457ab8e None None] DHCP port deletion for 81ad07c9-5912-449b-bb49-14d754ee47c0 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:46:26.456955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] For port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9ebb09dd-551b-4b3d-b1f6-5bdd77960bed,segment=NetworkSegment(41769506-c6e2-4d6c-a537-2d71e8a5e3f7),segment_id=41769506-c6e2-4d6c-a537-2d71e8a5e3f7)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:26.457271 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:26.465348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c858be02-1670-4b6f-8184-52beb20247e0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Subnet': ['ID=b363b536-bfd3-4cbb-af39-a9fd057371f4,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:26.467281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-83df1618-2dce-41e0-bb03-68d5e457ab8e None None] Deleting port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:26.467769 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-83df1618-2dce-41e0-bb03-68d5e457ab8e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:26.473071 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9947545c-2af3-4a7d-9e0c-24e933bcbc22 req-4c4f567d-80cc-4e9a-aa7e-4696c7b1347c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.84 "DELETE /v2.0/ports/0e74445e-ee56-4901-85b9-cba1966e3daa HTTP/1.1" status: 204 len: 173 time: 1.9199464 May 12 15:46:26.475673 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c858be02-1670-4b6f-8184-52beb20247e0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.0511010 May 12 15:46:26.484692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46090) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:26.489693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'security_group': {'name': 'tempest-secgroup-757579807'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:26.498614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:26.516321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:security_group and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:26.519552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:26.530374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:26.550398 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:26.568319 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-77a79ee7-5c2a-4d25-a566-333577bdb0cc'] response: {'server_uuid': '99528244-c271-4a64-8ff9-023e3eaee03c', 'name': 'network-vif-deleted', 'tag': '0e74445e-ee56-4901-85b9-cba1966e3daa', 'status': 'completed', 'code': 200} May 12 15:46:26.595871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:26.600633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:security_group_rule and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:26.603718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:26.611147 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:26.719602 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:26.730942 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:26.800553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-83df1618-2dce-41e0-bb03-68d5e457ab8e None None] For port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9ebb09dd-551b-4b3d-b1f6-5bdd77960bed,segment=NetworkSegment(41769506-c6e2-4d6c-a537-2d71e8a5e3f7),segment_id=41769506-c6e2-4d6c-a537-2d71e8a5e3f7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:26.801202 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-83df1618-2dce-41e0-bb03-68d5e457ab8e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:26.830324 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'SecurityGroup': ['ID=be71d5d6-d086-41fa-be89-766fd5750ede,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:26.837085 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:26.841369 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dcac8cab-5c9e-4490-a82f-33c0b6f6ab94 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1744 time: 0.3532045 May 12 15:46:26.841966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46094) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:26.848879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'security_group': {'name': 'tempest-secgroup-976877347'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:26.857493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:26.862358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Calling delete_port for 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:26.862664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:security_group and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:26.865938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:26.873454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:26.887718 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:26.914749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:26.919638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:security_group_rule and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:26.923476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:26.932403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:27.056134 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.063571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.070092 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.087945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-83df1618-2dce-41e0-bb03-68d5e457ab8e None None] Calling delete_port for 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:27.164612 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] No DVR routers for this DVR port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:46:27.168083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Port': ['ID=9ebb09dd-551b-4b3d-b1f6-5bdd77960bed,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:27.180299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aa2f91ad-2b66-423f-a5f4-00bff4ff098c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:27.207947 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.211007 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1a047bde-30ab-4484-beb0-db03d0d42b53 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1744 time: 0.3682013 May 12 15:46:27.217057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46100) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:27.231457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'security_group': {'name': 'tempest-secgroup-1130803720'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:27.240889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:27.268485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:security_group and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:27.280393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for security_group was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:27.295745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource security_group. Total usage: 3; quota limit: 100; headroom:97 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:27.351110 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-83df1618-2dce-41e0-bb03-68d5e457ab8e None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:46:27.351110 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-83df1618-2dce-41e0-bb03-68d5e457ab8e None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:46:27.398589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.496483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:27.508029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:security_group_rule and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:27.511266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1c017e4a-b31d-4851-993b-79f52ad9724c req-3995660d-05fa-41b2-bc9b-5ef8a2b634f1 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Synchronizing usage tracker for tenant:5b43e848e2af491a8dc509c668c33e91 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:27.513532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:27.525942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:27.558192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.588652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1c017e4a-b31d-4851-993b-79f52ad9724c req-3995660d-05fa-41b2-bc9b-5ef8a2b634f1 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Unset dirty status for tenant:5b43e848e2af491a8dc509c668c33e91 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:27.600963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1c017e4a-b31d-4851-993b-79f52ad9724c req-3995660d-05fa-41b2-bc9b-5ef8a2b634f1 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=99528244-c271-4a64-8ff9-023e3eaee03c HTTP/1.1" status: 200 len: 210 time: 0.1515520 May 12 15:46:27.616524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bae2b98f-4237-4ded-92aa-929c37e38b9b None None] Network 61b1250e-09c9-4206-8592-62cee35b5757 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:27.662289 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.669595 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.679348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['81ad07c9-5912-449b-bb49-14d754ee47c0']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:27.700714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '41769506-c6e2-4d6c-a537-2d71e8a5e3f7') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:27.701001 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '41769506-c6e2-4d6c-a537-2d71e8a5e3f7') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:27.735150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a6dc593f-310a-48e1-92fd-6df81855f0c0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:27.738006 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.738529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.740259 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0e4082c6-988a-4a39-8412-656babf6cfda tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 0.5211263 May 12 15:46:27.745316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46108) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:27.764741 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.776833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Releasing vlan 552 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:46:27.776833 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.787762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1549945126', 'security_groups': ['a6dc593f-310a-48e1-92fd-6df81855f0c0'], 'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': 'b363b536-bfd3-4cbb-af39-a9fd057371f4'}]}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:27.797261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-56c88c61-c0db-421e-89ec-a1b4e2a45ff3 None None] Provisioning complete for port 2828a441-fc11-488a-bc82-1cc8de827bc0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:27.797261 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-56c88c61-c0db-421e-89ec-a1b4e2a45ff3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.851484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-83df1618-2dce-41e0-bb03-68d5e457ab8e None None] Deleting port 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:27.851847 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-83df1618-2dce-41e0-bb03-68d5e457ab8e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: timer() May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:46:27.886083 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:46:27.888112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46112) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:27.960473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:27.970220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:27.973140 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:27.983216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:46:27.993010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-83df1618-2dce-41e0-bb03-68d5e457ab8e None None] The port '9ebb09dd-551b-4b3d-b1f6-5bdd77960bed' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:46:28.004991 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:28.034122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Network': ['ID=81ad07c9-5912-449b-bb49-14d754ee47c0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:28.063518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-56c88c61-c0db-421e-89ec-a1b4e2a45ff3 None None] Port 2828a441-fc11-488a-bc82-1cc8de827bc0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:46:28.071561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-11eed378-9a4f-4522-b071-bbc448d0ec64 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "DELETE /v2.0/networks/81ad07c9-5912-449b-bb49-14d754ee47c0 HTTP/1.1" status: 204 len: 168 time: 2.4944465 May 12 15:46:28.076808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46116) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:28.107796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-56c88c61-c0db-421e-89ec-a1b4e2a45ff3 None None] Provisioning complete for port a8ca4652-4c09-412b-9f0f-016c3017550c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:28.108165 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-56c88c61-c0db-421e-89ec-a1b4e2a45ff3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:28.195315 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:28.250260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] device_id is not set on port 5785b3d6-e6e5-401f-a25f-ae978cfe4d21 yet. {{(pid=88151) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} May 12 15:46:28.318728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-af855678-6ae0-4ca3-82de-22a06396793c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Deleting port d36b134c-f863-4d2d-9c1a-8e2d37464082 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:28.319277 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af855678-6ae0-4ca3-82de-22a06396793c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:28.466422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:28.509493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22caf7b0-4f11-4670-b457-178fdfd085c9 None None] Update dhcp port {'port': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'fixed_ips': [{'subnet_id': '95b1e088-a677-4f6e-9cf8-8bb51f36684d', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': 'b363b536-bfd3-4cbb-af39-a9fd057371f4'}], 'binding:host_id': 'n-d-841483-1'}, 'id': 'a8ca4652-4c09-412b-9f0f-016c3017550c'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:46:28.538355 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:28.538453 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9ebb09dd-551b-4b3d-b1f6-5bdd77960bed not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:28.604379 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-22caf7b0-4f11-4670-b457-178fdfd085c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:28.609859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Allocated IP 2001:db8::325 (61b1250e-09c9-4206-8592-62cee35b5757/b363b536-bfd3-4cbb-af39-a9fd057371f4/5785b3d6-e6e5-401f-a25f-ae978cfe4d21) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:46:28.853677 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af855678-6ae0-4ca3-82de-22a06396793c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:28.854165 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af855678-6ae0-4ca3-82de-22a06396793c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:29.048422 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:29.094302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Transition to ACTIVE for port object 5785b3d6-e6e5-401f-a25f-ae978cfe4d21 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:46:29.111826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-af855678-6ae0-4ca3-82de-22a06396793c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Calling delete_port for d36b134c-f863-4d2d-9c1a-8e2d37464082 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:29.158175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:29.211574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ab5038cd-c43d-4a42-922b-7850754d0c6d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting port b1f3dfd8-5191-40b3-9f9a-49e68fd758e1 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:29.212659 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab5038cd-c43d-4a42-922b-7850754d0c6d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:29.307718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-22caf7b0-4f11-4670-b457-178fdfd085c9 None None] Allocated IP 2001:db8::2 (61b1250e-09c9-4206-8592-62cee35b5757/b363b536-bfd3-4cbb-af39-a9fd057371f4/a8ca4652-4c09-412b-9f0f-016c3017550c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:46:29.356431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=5785b3d6-e6e5-401f-a25f-ae978cfe4d21,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:29.388724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 61b1250e-09c9-4206-8592-62cee35b5757 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:46:29.393450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:46:29.399101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:46:29.418549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:29.419372 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:29.484476 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-446a5c67-dc1b-4064-834f-3e1322a7cb0a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.7375450 May 12 15:46:29.489511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46136) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:29.497754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ba7657e0-0fc6-4621-b160-8cbedb19dcf0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:29.556271 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-22caf7b0-4f11-4670-b457-178fdfd085c9 None None] For port a8ca4652-4c09-412b-9f0f-016c3017550c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a8ca4652-4c09-412b-9f0f-016c3017550c,segment=NetworkSegment(88392f67-14f6-47b9-a689-18992378d1e1),segment_id=88392f67-14f6-47b9-a689-18992378d1e1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:29.597640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0e74445e-ee56-4901-85b9-cba1966e3daa no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:29.619893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46140) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:29.666149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 0e74445e-ee56-4901-85b9-cba1966e3daa {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:29.666609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 0e74445e-ee56-4901-85b9-cba1966e3daa not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:29.672246 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-22caf7b0-4f11-4670-b457-178fdfd085c9 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:29.679524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ba7657e0-0fc6-4621-b160-8cbedb19dcf0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:29.679654 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab5038cd-c43d-4a42-922b-7850754d0c6d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:29.679870 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab5038cd-c43d-4a42-922b-7850754d0c6d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:29.684266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ba7657e0-0fc6-4621-b160-8cbedb19dcf0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:29.690275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ba7657e0-0fc6-4621-b160-8cbedb19dcf0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:29.698478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ba7657e0-0fc6-4621-b160-8cbedb19dcf0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:29.709020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba7657e0-0fc6-4621-b160-8cbedb19dcf0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:46:29.712287 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba7657e0-0fc6-4621-b160-8cbedb19dcf0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:29.830338 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6c01598-5953-4129-acde-e49919f13929 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:29.861991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ab5038cd-c43d-4a42-922b-7850754d0c6d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Calling delete_port for b1f3dfd8-5191-40b3-9f9a-49e68fd758e1 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:29.870874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b6c01598-5953-4129-acde-e49919f13929 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:29.878542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b6c01598-5953-4129-acde-e49919f13929 admin admin] Usage tracker for resource:security_group_rule and tenant:d74e9955413a478cbd44038b30521da4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:29.886517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b6c01598-5953-4129-acde-e49919f13929 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:29.889585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b6c01598-5953-4129-acde-e49919f13929 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:29.898767 n-d-841483-1 neutron-server[88151]: INFO neutron.db.ipam_backend_mixin [None req-ba7657e0-0fc6-4621-b160-8cbedb19dcf0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet b363b536-bfd3-4cbb-af39-a9fd057371f4 (CIDR: 2001:db8::/64) May 12 15:46:29.906198 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-ba7657e0-0fc6-4621-b160-8cbedb19dcf0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:46:29.906859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ba7657e0-0fc6-4621-b160-8cbedb19dcf0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:46:29.910845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0c2fe36-f817-432c-ae51-7b03d918580c req-1a0846b8-e563-4502-aeb2-55560ea34d03 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:29.913220 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0c2fe36-f817-432c-ae51-7b03d918580c req-1a0846b8-e563-4502-aeb2-55560ea34d03 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1097 time: 0.4337678 May 12 15:46:29.937784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-22caf7b0-4f11-4670-b457-178fdfd085c9 None None] Transition to ACTIVE for port object a8ca4652-4c09-412b-9f0f-016c3017550c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:46:29.945735 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-22caf7b0-4f11-4670-b457-178fdfd085c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:29.953748 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af855678-6ae0-4ca3-82de-22a06396793c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:29.970794 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ba7657e0-0fc6-4621-b160-8cbedb19dcf0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.4774747 May 12 15:46:29.976001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46146) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:29.986273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a3df8c72-8084-4a00-b263-252952273104 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:30.031970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af855678-6ae0-4ca3-82de-22a06396793c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Pushing event deleted for resources: {'Port': ['ID=d36b134c-f863-4d2d-9c1a-8e2d37464082,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:30.146343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22caf7b0-4f11-4670-b457-178fdfd085c9 None None] Pushing event updated for resources: {'Port': ['ID=a8ca4652-4c09-412b-9f0f-016c3017550c,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:30.206088 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0c2fe36-f817-432c-ae51-7b03d918580c req-ee0db213-f308-4dd6-b5f1-68040f1f7a74 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2782810 May 12 15:46:30.221985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6c01598-5953-4129-acde-e49919f13929 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:30.238857 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6c01598-5953-4129-acde-e49919f13929 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:30.260115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a3df8c72-8084-4a00-b263-252952273104 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:30.284854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a3df8c72-8084-4a00-b263-252952273104 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:30.290990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a3df8c72-8084-4a00-b263-252952273104 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:30.325586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a3df8c72-8084-4a00-b263-252952273104 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:30.338567 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b6c01598-5953-4129-acde-e49919f13929 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d74e9955413a478cbd44038b30521da4&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7175300 May 12 15:46:30.341280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6c01598-5953-4129-acde-e49919f13929 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5764c37c-e7d2-4354-a0f5-5c34fff01997,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:30.346455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46150) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:30.356807 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af855678-6ae0-4ca3-82de-22a06396793c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:30.357715 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-af855678-6ae0-4ca3-82de-22a06396793c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Floating IP 0b95da37-fabd-4a50-a9d3-d41f466d89c2 disassociated (deleted). External IP: 172.25.8.189, port: e4de15ca-6d9a-47d1-8535-a72265f9c929. May 12 15:46:30.403296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a3df8c72-8084-4a00-b263-252952273104 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:46:30.408115 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3df8c72-8084-4a00-b263-252952273104 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:30.474962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a8ca4652-4c09-412b-9f0f-016c3017550c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:46:30.487361 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-daecc2d0-b9b2-4c78-885f-4cc273882008 req-327143cc-982a-48dd-8e31-d46aefc2d3b8 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.4569712 May 12 15:46:30.584044 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab5038cd-c43d-4a42-922b-7850754d0c6d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:30.720733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab5038cd-c43d-4a42-922b-7850754d0c6d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Port': ['ID=b1f3dfd8-5191-40b3-9f9a-49e68fd758e1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:30.764716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-864ab077-4e76-496f-919c-a49521a861cf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:30.798583 n-d-841483-1 neutron-server[88151]: INFO neutron.db.ipam_backend_mixin [None req-a3df8c72-8084-4a00-b263-252952273104 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Validation for CIDR: 2001:db8:0:1::/64 failed - overlaps with subnet 95b1e088-a677-4f6e-9cf8-8bb51f36684d (CIDR: 2001:db8:0:1::/64) May 12 15:46:30.821447 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-a3df8c72-8084-4a00-b263-252952273104 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 15:46:30.822292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a3df8c72-8084-4a00-b263-252952273104 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:46:30.835302 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-864ab077-4e76-496f-919c-a49521a861cf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:30.895014 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a3df8c72-8084-4a00-b263-252952273104 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 428 time: 0.9132993 May 12 15:46:30.895014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46154) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:30.902925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-443ee3bf-6a78-4b7c-b3b4-ddca78c3b8d2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'subnet': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'cidr': '2001:db8:0:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:2::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:30.925724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7778841-b0e8-41a6-9793-28461fce31eb req-058bea84-966a-4259-95e9-cfb30d179d91 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:30.926434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-f7778841-b0e8-41a6-9793-28461fce31eb req-058bea84-966a-4259-95e9-cfb30d179d91 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Synchronizing usage tracker for tenant:5b43e848e2af491a8dc509c668c33e91 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:30.949412 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:46:30.952288 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab5038cd-c43d-4a42-922b-7850754d0c6d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:30.952731 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-ab5038cd-c43d-4a42-922b-7850754d0c6d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Floating IP d2ed2139-605d-4648-ada6-83bbdb6ff583 disassociated (deleted). External IP: 172.25.8.55, port: 42a296ea-fb47-4109-8501-772157438fa6. May 12 15:46:31.021017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-f7778841-b0e8-41a6-9793-28461fce31eb req-058bea84-966a-4259-95e9-cfb30d179d91 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Unset dirty status for tenant:5b43e848e2af491a8dc509c668c33e91 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:31.022814 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f7778841-b0e8-41a6-9793-28461fce31eb req-058bea84-966a-4259-95e9-cfb30d179d91 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1097 time: 0.3351617 May 12 15:46:31.090041 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-864ab077-4e76-496f-919c-a49521a861cf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:31.140289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-864ab077-4e76-496f-919c-a49521a861cf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5764c37c-e7d2-4354-a0f5-5c34fff01997,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:31.157024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-f7778841-b0e8-41a6-9793-28461fce31eb req-252bb247-bdc0-4b7d-bac3-a4cfcfde7ce0 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Deleting port a9e5c289-e1e2-4485-824e-3e18f4ba6f96 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:31.157366 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f7778841-b0e8-41a6-9793-28461fce31eb req-252bb247-bdc0-4b7d-bac3-a4cfcfde7ce0 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:31.191205 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-864ab077-4e76-496f-919c-a49521a861cf admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:31.192822 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-864ab077-4e76-496f-919c-a49521a861cf admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5764c37c-e7d2-4354-a0f5-5c34fff01997 HTTP/1.1" status: 204 len: 168 time: 0.8470490 May 12 15:46:31.200035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-443ee3bf-6a78-4b7c-b3b4-ddca78c3b8d2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:31.206829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1d9237b6-4ea0-4955-9b58-c547eccb7e6e None None] Provisioning complete for port 2828a441-fc11-488a-bc82-1cc8de827bc0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:31.209296 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1d9237b6-4ea0-4955-9b58-c547eccb7e6e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:31.235610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-443ee3bf-6a78-4b7c-b3b4-ddca78c3b8d2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Usage tracker for resource:subnet and tenant:1da2b935bcd34292b3e8ce00cc114001 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:31.260632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-443ee3bf-6a78-4b7c-b3b4-ddca78c3b8d2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:31.286829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-443ee3bf-6a78-4b7c-b3b4-ddca78c3b8d2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:31.287345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1d9237b6-4ea0-4955-9b58-c547eccb7e6e None None] Port 2828a441-fc11-488a-bc82-1cc8de827bc0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:46:31.314164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1d9237b6-4ea0-4955-9b58-c547eccb7e6e None None] Provisioning for port a8ca4652-4c09-412b-9f0f-016c3017550c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:46:31.322981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1d9237b6-4ea0-4955-9b58-c547eccb7e6e None None] Provisioning complete for port a8ca4652-4c09-412b-9f0f-016c3017550c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:31.323601 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1d9237b6-4ea0-4955-9b58-c547eccb7e6e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:31.340223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af855678-6ae0-4ca3-82de-22a06396793c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Router 90b1ce02-50a9-42ff-913c-e1db00f64560 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:46:31.411034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-443ee3bf-6a78-4b7c-b3b4-ddca78c3b8d2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Made reservation on behalf of 1da2b935bcd34292b3e8ce00cc114001 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:46:31.417858 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-443ee3bf-6a78-4b7c-b3b4-ddca78c3b8d2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:31.425596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daecc2d0-b9b2-4c78-885f-4cc273882008 req-3a53b387-b2b6-447e-8cb7-ba57ba085233 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:31.427644 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-daecc2d0-b9b2-4c78-885f-4cc273882008 req-3a53b387-b2b6-447e-8cb7-ba57ba085233 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 1096 time: 0.7519660 May 12 15:46:31.724690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f7778841-b0e8-41a6-9793-28461fce31eb req-252bb247-bdc0-4b7d-bac3-a4cfcfde7ce0 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] For port a9e5c289-e1e2-4485-824e-3e18f4ba6f96, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a9e5c289-e1e2-4485-824e-3e18f4ba6f96,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:31.724984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f7778841-b0e8-41a6-9793-28461fce31eb req-252bb247-bdc0-4b7d-bac3-a4cfcfde7ce0 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:31.742738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc56f411-8930-4579-a471-f66fd870136f None None] Provisioning for port 5785b3d6-e6e5-401f-a25f-ae978cfe4d21 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:46:31.752027 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc56f411-8930-4579-a471-f66fd870136f None None] Provisioning complete for port 5785b3d6-e6e5-401f-a25f-ae978cfe4d21 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:31.752530 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc56f411-8930-4579-a471-f66fd870136f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:31.792908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46164) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:31.811820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc56f411-8930-4579-a471-f66fd870136f None None] Port 5785b3d6-e6e5-401f-a25f-ae978cfe4d21 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:46:31.857449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-f7778841-b0e8-41a6-9793-28461fce31eb req-252bb247-bdc0-4b7d-bac3-a4cfcfde7ce0 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Calling delete_port for a9e5c289-e1e2-4485-824e-3e18f4ba6f96 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:31.916143 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2ed8b1ec-32b5-40f9-9df8-76eb8cb6a579 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:31.942458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daecc2d0-b9b2-4c78-885f-4cc273882008 req-132c424f-74ed-4ecf-9ffc-736df26b8e84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:31.943885 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-daecc2d0-b9b2-4c78-885f-4cc273882008 req-132c424f-74ed-4ecf-9ffc-736df26b8e84 service neutron] 10.222.0.84 "GET /v2.0/networks?id=03979098-a904-494a-a852-b458bf7ca658 HTTP/1.1" status: 200 len: 897 time: 0.4474690 May 12 15:46:31.951363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94b32ad4-0559-4c11-9c2d-a75c39f11232 req-eb1850f5-5d54-4ba6-bb07-65139635b534 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:31.953494 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-94b32ad4-0559-4c11-9c2d-a75c39f11232 req-eb1850f5-5d54-4ba6-bb07-65139635b534 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 1097 time: 0.4898794 May 12 15:46:31.957664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af855678-6ae0-4ca3-82de-22a06396793c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:46:31.967615 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48b91da-7aaf-418d-a334-acd531266fad None None] Sync routers for ids ['90b1ce02-50a9-42ff-913c-e1db00f64560'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:46:31.971198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2ed8b1ec-32b5-40f9-9df8-76eb8cb6a579 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:31.981723 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48b91da-7aaf-418d-a334-acd531266fad None None] Routers {'90b1ce02-50a9-42ff-913c-e1db00f64560'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:31.982545 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a48b91da-7aaf-418d-a334-acd531266fad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['90b1ce02-50a9-42ff-913c-e1db00f64560'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:31.986451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2ed8b1ec-32b5-40f9-9df8-76eb8cb6a579 admin admin] Usage tracker for resource:security_group_rule and tenant:7c726c796ffb49a2931b68436e3c18f2 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:31.991120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2ed8b1ec-32b5-40f9-9df8-76eb8cb6a579 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:32.003060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2ed8b1ec-32b5-40f9-9df8-76eb8cb6a579 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:32.106845 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-daecc2d0-b9b2-4c78-885f-4cc273882008 req-8e1724e2-33c1-477a-9782-6622163d133d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=42a296ea-fb47-4109-8501-772157438fa6 HTTP/1.1" status: 200 len: 217 time: 0.1505585 May 12 15:46:32.162518 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f7778841-b0e8-41a6-9793-28461fce31eb req-252bb247-bdc0-4b7d-bac3-a4cfcfde7ce0 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:32.199884 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-94b32ad4-0559-4c11-9c2d-a75c39f11232 req-32bd441e-ec3f-438e-ab4b-599de1712637 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=9e4bbe98-a709-4ded-b538-2767cd2be6f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1423094 May 12 15:46:32.209621 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af855678-6ae0-4ca3-82de-22a06396793c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:32.245166 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-a48b91da-7aaf-418d-a334-acd531266fad None None] Set router 90b1ce02-50a9-42ff-913c-e1db00f64560 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:32.267119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ab5038cd-c43d-4a42-922b-7850754d0c6d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Router 943c296a-7f18-4231-8088-35f5348abd2b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:46:32.273770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daecc2d0-b9b2-4c78-885f-4cc273882008 req-a1775072-18f3-4b0c-ae30-b9b478c70b64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:32.275430 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-daecc2d0-b9b2-4c78-885f-4cc273882008 req-a1775072-18f3-4b0c-ae30-b9b478c70b64 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=501ff294-e32c-494b-9718-ec96b39fa231 HTTP/1.1" status: 200 len: 835 time: 0.1608367 May 12 15:46:32.297085 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-443ee3bf-6a78-4b7c-b3b4-ddca78c3b8d2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:32.349233 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2ed8b1ec-32b5-40f9-9df8-76eb8cb6a579 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:32.353851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-252bb247-bdc0-4b7d-bac3-a4cfcfde7ce0 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Pushing event deleted for resources: {'Port': ['ID=a9e5c289-e1e2-4485-824e-3e18f4ba6f96,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:32.384104 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-af855678-6ae0-4ca3-82de-22a06396793c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "DELETE /v2.0/floatingips/0b95da37-fabd-4a50-a9d3-d41f466d89c2 HTTP/1.1" status: 204 len: 168 time: 4.4963646 May 12 15:46:32.402455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'tag': 'e4de15ca-6d9a-47d1-8535-a72265f9c929'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:46:32.407022 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2ed8b1ec-32b5-40f9-9df8-76eb8cb6a579 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:32.485115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ed8b1ec-32b5-40f9-9df8-76eb8cb6a579 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ff208b62-913c-4dda-8f5c-0b9821a7bed6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:32.543775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-443ee3bf-6a78-4b7c-b3b4-ddca78c3b8d2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Network 61b1250e-09c9-4206-8592-62cee35b5757 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:46:32.546469 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7015d598-f30d-4ba4-959c-3d0b5fad87b1'] response: {'name': 'network-changed', 'server_uuid': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'tag': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'status': 'completed', 'code': 200} May 12 15:46:32.550128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-f7778841-b0e8-41a6-9793-28461fce31eb req-252bb247-bdc0-4b7d-bac3-a4cfcfde7ce0 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] No DVR routers for this DVR port a9e5c289-e1e2-4485-824e-3e18f4ba6f96 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:46:32.553157 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f7778841-b0e8-41a6-9793-28461fce31eb req-252bb247-bdc0-4b7d-bac3-a4cfcfde7ce0 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:32.586086 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:32.601945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daecc2d0-b9b2-4c78-885f-4cc273882008 req-20f6275e-69cf-44fa-98b7-ba9dda70a19b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:32.603470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-daecc2d0-b9b2-4c78-885f-4cc273882008 req-20f6275e-69cf-44fa-98b7-ba9dda70a19b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=03979098-a904-494a-a852-b458bf7ca658&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3188763 May 12 15:46:32.607238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ab5038cd-c43d-4a42-922b-7850754d0c6d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:46:32.614400 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab5038cd-c43d-4a42-922b-7850754d0c6d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:32.619178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74ab443c-6f2e-494b-acda-2afd99af21a5 None None] Sync routers for ids ['943c296a-7f18-4231-8088-35f5348abd2b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:46:32.632548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2b1086dd-d596-4bdf-ade3-83e3daa10bac', 'name': 'network-vif-deleted', 'tag': 'a9e5c289-e1e2-4485-824e-3e18f4ba6f96'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:46:32.634379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74ab443c-6f2e-494b-acda-2afd99af21a5 None None] Routers {'943c296a-7f18-4231-8088-35f5348abd2b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:32.635096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-74ab443c-6f2e-494b-acda-2afd99af21a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['943c296a-7f18-4231-8088-35f5348abd2b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:32.646201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-443ee3bf-6a78-4b7c-b3b4-ddca78c3b8d2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:46:32.650223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-443ee3bf-6a78-4b7c-b3b4-ddca78c3b8d2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:32.650992 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-443ee3bf-6a78-4b7c-b3b4-ddca78c3b8d2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:32.663991 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a48b91da-7aaf-418d-a334-acd531266fad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 4, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0330d6b4-dcca-428b-884e-6ad77426f8da', 'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'mac_address': 'fa:16:3e:cb:a3:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_interface', 'standard_attr_id': 3214, 'fixed_ips': [{'subnet_id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:06Z', 'updated_at': '2022-05-12T15:40:26Z', 'revision_number': 5, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'subnets': [{'id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:32.669213 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48b91da-7aaf-418d-a334-acd531266fad None None] Checking router: 90b1ce02-50a9-42ff-913c-e1db00f64560 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:46:32.680234 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48b91da-7aaf-418d-a334-acd531266fad None None] Routers {'90b1ce02-50a9-42ff-913c-e1db00f64560'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:32.681459 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a48b91da-7aaf-418d-a334-acd531266fad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['90b1ce02-50a9-42ff-913c-e1db00f64560'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:32.705284 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2ed8b1ec-32b5-40f9-9df8-76eb8cb6a579 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7c726c796ffb49a2931b68436e3c18f2&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9097536 May 12 15:46:32.706109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-443ee3bf-6a78-4b7c-b3b4-ddca78c3b8d2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Subnet': ['ID=257991e8-a60e-46fa-93c2-b0d377c1520a,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:32.711904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46176) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:32.793777 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a61445ea-58a8-4c8e-8045-49398aed526b None None] Network 61b1250e-09c9-4206-8592-62cee35b5757 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:32.820215 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-daecc2d0-b9b2-4c78-885f-4cc273882008 req-d70e1601-7b0b-46d8-8f9e-7444a4232018 service neutron] 10.222.0.84 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2093308 May 12 15:46:32.832370 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1d9ac5c7-30bc-42ef-abdd-a9fe81fc1ee7'] response: {'server_uuid': '2b1086dd-d596-4bdf-ade3-83e3daa10bac', 'name': 'network-vif-deleted', 'tag': 'a9e5c289-e1e2-4485-824e-3e18f4ba6f96', 'status': 'completed', 'code': 200} May 12 15:46:32.851026 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-443ee3bf-6a78-4b7c-b3b4-ddca78c3b8d2 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.9516058 May 12 15:46:32.851026 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f7778841-b0e8-41a6-9793-28461fce31eb req-252bb247-bdc0-4b7d-bac3-a4cfcfde7ce0 tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.76 "DELETE /v2.0/ports/a9e5c289-e1e2-4485-824e-3e18f4ba6f96 HTTP/1.1" status: 204 len: 173 time: 1.8206439 May 12 15:46:32.875383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46180) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:32.917883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ecfaea07-0938-4294-99fb-965b5d8f9259 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1920243859', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '257991e8-a60e-46fa-93c2-b0d377c1520a'}], 'security_groups': ['be71d5d6-d086-41fa-be89-766fd5750ede', 'aa2f91ad-2b66-423f-a5f4-00bff4ff098c']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:33.106700 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-a48b91da-7aaf-418d-a334-acd531266fad None None] Set router 90b1ce02-50a9-42ff-913c-e1db00f64560 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:33.150274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-74ab443c-6f2e-494b-acda-2afd99af21a5 None None] Set router 943c296a-7f18-4231-8088-35f5348abd2b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:33.237925 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-748b2b8e-3886-4bba-a3bd-463d31199fc2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:33.242644 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ab5038cd-c43d-4a42-922b-7850754d0c6d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "DELETE /v2.0/floatingips/d2ed2139-605d-4648-ada6-83bbdb6ff583 HTTP/1.1" status: 204 len: 168 time: 5.1622298 May 12 15:46:33.257203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24d28ad7-1cba-45be-adbe-a5b4e4e935da req-f40be242-de11-4e45-ad61-9ec3ae95f894 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:33.259245 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24d28ad7-1cba-45be-adbe-a5b4e4e935da req-f40be242-de11-4e45-ad61-9ec3ae95f894 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=0528307b42774c45be9eba4ffc91c8dd&device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 1097 time: 0.7175694 May 12 15:46:33.371719 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a9e5c289-e1e2-4485-824e-3e18f4ba6f96 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:33.396973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cddf62ff-df24-4224-b01b-af7715dfe791 req-a0019306-d563-4da4-8c75-aac013531506 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:33.398102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cddf62ff-df24-4224-b01b-af7715dfe791 req-a0019306-d563-4da4-8c75-aac013531506 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Synchronizing usage tracker for tenant:0528307b42774c45be9eba4ffc91c8dd on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:33.407725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-daecc2d0-b9b2-4c78-885f-4cc273882008 req-bf4ca222-3352-49de-a83c-88c9bb6e7549 service neutron] 10.222.0.84 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5809233 May 12 15:46:33.435124 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-748b2b8e-3886-4bba-a3bd-463d31199fc2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:33.465525 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: a9e5c289-e1e2-4485-824e-3e18f4ba6f96 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:33.466014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a9e5c289-e1e2-4485-824e-3e18f4ba6f96 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:33.493416 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-156f6ed4-7012-4b70-8666-0831709428e6 req-ed8c8e46-3d1e-4407-a507-4dc01969bf7c tempest-TestServerMultinode-593376728 tempest-TestServerMultinode-593376728-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2b1086dd-d596-4bdf-ade3-83e3daa10bac HTTP/1.1" status: 200 len: 210 time: 0.0563462 May 12 15:46:33.494753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cddf62ff-df24-4224-b01b-af7715dfe791 req-a0019306-d563-4da4-8c75-aac013531506 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Unset dirty status for tenant:0528307b42774c45be9eba4ffc91c8dd on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:33.502287 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cddf62ff-df24-4224-b01b-af7715dfe791 req-a0019306-d563-4da4-8c75-aac013531506 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 946 time: 0.4206100 May 12 15:46:33.588647 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cddf62ff-df24-4224-b01b-af7715dfe791 req-b889154a-ee39-4fb3-b93c-db289d1e66ed tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0845971 May 12 15:46:33.665106 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a48b91da-7aaf-418d-a334-acd531266fad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 4, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0330d6b4-dcca-428b-884e-6ad77426f8da', 'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'mac_address': 'fa:16:3e:cb:a3:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_interface', 'standard_attr_id': 3214, 'fixed_ips': [{'subnet_id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:06Z', 'updated_at': '2022-05-12T15:40:26Z', 'revision_number': 5, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'subnets': [{'id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:33.672245 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48b91da-7aaf-418d-a334-acd531266fad None None] The sync data for ids ['90b1ce02-50a9-42ff-913c-e1db00f64560'] in n-d-841483-1 is: [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:40:07Z', 'revision_number': 4, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0330d6b4-dcca-428b-884e-6ad77426f8da', 'name': '', 'network_id': '8fe69ccc-2df6-4e6d-ad35-1b9439b8eade', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'mac_address': 'fa:16:3e:cb:a3:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_interface', 'standard_attr_id': 3214, 'fixed_ips': [{'subnet_id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:06Z', 'updated_at': '2022-05-12T15:40:26Z', 'revision_number': 5, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'subnets': [{'id': '5b4ef35a-b116-4246-86c9-ff3a7aad3410', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:46:33.690325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24d28ad7-1cba-45be-adbe-a5b4e4e935da req-167e5567-7a3c-4c97-a717-b613595b5f58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:33.692159 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24d28ad7-1cba-45be-adbe-a5b4e4e935da req-167e5567-7a3c-4c97-a717-b613595b5f58 service neutron] 10.222.0.76 "GET /v2.0/networks?id=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade HTTP/1.1" status: 200 len: 914 time: 0.4222436 May 12 15:46:33.795598 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24d28ad7-1cba-45be-adbe-a5b4e4e935da req-76264c56-b0cf-44db-a66f-85ccf0aa24ce service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e4de15ca-6d9a-47d1-8535-a72265f9c929 HTTP/1.1" status: 200 len: 217 time: 0.0916748 May 12 15:46:33.804062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-748b2b8e-3886-4bba-a3bd-463d31199fc2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:33.911252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-748b2b8e-3886-4bba-a3bd-463d31199fc2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff208b62-913c-4dda-8f5c-0b9821a7bed6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:33.919168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ea711ba-204e-4ed3-a681-e140347e024a None None] Update dhcp port {'port': {'network_id': '61b1250e-09c9-4206-8592-62cee35b5757', 'fixed_ips': [{'subnet_id': '95b1e088-a677-4f6e-9cf8-8bb51f36684d', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': 'b363b536-bfd3-4cbb-af39-a9fd057371f4', 'ip_address': '2001:db8::2'}, {'subnet_id': '257991e8-a60e-46fa-93c2-b0d377c1520a'}], 'binding:host_id': 'n-d-841483-1'}, 'id': 'a8ca4652-4c09-412b-9f0f-016c3017550c'} from n-d-841483-1. {{(pid=88153) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:322}} May 12 15:46:33.951704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-748b2b8e-3886-4bba-a3bd-463d31199fc2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:33.952888 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-748b2b8e-3886-4bba-a3bd-463d31199fc2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ff208b62-913c-4dda-8f5c-0b9821a7bed6 HTTP/1.1" status: 204 len: 168 time: 1.2358797 May 12 15:46:33.964131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24d28ad7-1cba-45be-adbe-a5b4e4e935da req-042d9345-3ca0-499a-80d1-e8091961ae35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:33.965612 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24d28ad7-1cba-45be-adbe-a5b4e4e935da req-042d9345-3ca0-499a-80d1-e8091961ae35 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5b4ef35a-b116-4246-86c9-ff3a7aad3410 HTTP/1.1" status: 200 len: 852 time: 0.1536431 May 12 15:46:33.966179 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecfaea07-0938-4294-99fb-965b5d8f9259 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:33.982694 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4ea711ba-204e-4ed3-a681-e140347e024a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:34.053285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-989acdc6-adfc-4e73-b9b9-33db2ebe06c7 req-70fd1d7f-07e9-40b1-b1dd-9d170c157ee0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:34.064498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-989acdc6-adfc-4e73-b9b9-33db2ebe06c7 req-70fd1d7f-07e9-40b1-b1dd-9d170c157ee0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:34.069777 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-74ab443c-6f2e-494b-acda-2afd99af21a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:46:15Z', 'revision_number': 6, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:10Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:34.085115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74ab443c-6f2e-494b-acda-2afd99af21a5 None None] Checking router: 943c296a-7f18-4231-8088-35f5348abd2b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:46:34.108730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-989acdc6-adfc-4e73-b9b9-33db2ebe06c7 req-70fd1d7f-07e9-40b1-b1dd-9d170c157ee0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:34.110301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-989acdc6-adfc-4e73-b9b9-33db2ebe06c7 req-70fd1d7f-07e9-40b1-b1dd-9d170c157ee0 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 945 time: 0.1995742 May 12 15:46:34.144222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74ab443c-6f2e-494b-acda-2afd99af21a5 None None] Routers {'943c296a-7f18-4231-8088-35f5348abd2b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:34.145147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-74ab443c-6f2e-494b-acda-2afd99af21a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['943c296a-7f18-4231-8088-35f5348abd2b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:34.170278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24d28ad7-1cba-45be-adbe-a5b4e4e935da req-8f781bb1-893a-4293-8722-ce2d42402f5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:34.172491 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24d28ad7-1cba-45be-adbe-a5b4e4e935da req-8f781bb1-893a-4293-8722-ce2d42402f5d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1959338 May 12 15:46:34.198693 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9bb273d-5254-4987-a22d-ac97dcd3d4a3 None None] New status for floating IP 0b95da37-fabd-4a50-a9d3-d41f466d89c2: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:46:34.206802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-989acdc6-adfc-4e73-b9b9-33db2ebe06c7 req-39f9eeaf-d367-4a35-ac2e-a6afab82a0ec tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=7ef93a22-5ccd-49ce-bc3f-8fb5236953da&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0889964 May 12 15:46:34.353809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-74ab443c-6f2e-494b-acda-2afd99af21a5 None None] Set router 943c296a-7f18-4231-8088-35f5348abd2b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:34.535684 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24d28ad7-1cba-45be-adbe-a5b4e4e935da req-7ef7c46c-6b23-41d7-8e2c-2360a6592f65 service neutron] 10.222.0.76 "GET /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3554306 May 12 15:46:34.547411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'tag': '42a296ea-fb47-4109-8501-772157438fa6'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:46:34.548850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0d96b9f-401b-4a26-966d-dbcd9bedc204 req-827d3187-61bc-4e44-95b5-c50202246bb8 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:34.549597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b0d96b9f-401b-4a26-966d-dbcd9bedc204 req-827d3187-61bc-4e44-95b5-c50202246bb8 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Synchronizing usage tracker for tenant:0528307b42774c45be9eba4ffc91c8dd on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:34.587532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46198) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:34.616998 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b4ee7c9-8d7e-4522-b8bc-8d476b08b1b2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:34.638869 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4cadf309-18d5-47ce-a62c-e56dbbc0fdd3'] response: {'name': 'network-changed', 'server_uuid': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'tag': '42a296ea-fb47-4109-8501-772157438fa6', 'status': 'completed', 'code': 200} May 12 15:46:34.643544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9b4ee7c9-8d7e-4522-b8bc-8d476b08b1b2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:34.648369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9b4ee7c9-8d7e-4522-b8bc-8d476b08b1b2 admin admin] Usage tracker for resource:security_group_rule and tenant:0d4af299e8df4225a0f6ea2620a78121 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:34.653353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9b4ee7c9-8d7e-4522-b8bc-8d476b08b1b2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:34.660143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9b4ee7c9-8d7e-4522-b8bc-8d476b08b1b2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:34.699517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b0d96b9f-401b-4a26-966d-dbcd9bedc204 req-827d3187-61bc-4e44-95b5-c50202246bb8 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Unset dirty status for tenant:0528307b42774c45be9eba4ffc91c8dd on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:34.700724 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0d96b9f-401b-4a26-966d-dbcd9bedc204 req-827d3187-61bc-4e44-95b5-c50202246bb8 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.76 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 946 time: 0.4438443 May 12 15:46:34.712698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46204) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:34.734803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-74ab443c-6f2e-494b-acda-2afd99af21a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:46:15Z', 'revision_number': 6, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:10Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:34.738963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74ab443c-6f2e-494b-acda-2afd99af21a5 None None] The sync data for ids ['943c296a-7f18-4231-8088-35f5348abd2b'] in n-d-841483-1 is: [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:46:15Z', 'revision_number': 6, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4c9c52d9-7be2-45c7-82f5-d4e254eec55f', 'name': '', 'network_id': '03979098-a904-494a-a852-b458bf7ca658', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:25:ba:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3517, 'fixed_ips': [{'subnet_id': '501ff294-e32c-494b-9718-ec96b39fa231', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:34Z', 'updated_at': '2022-05-12T15:44:10Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '501ff294-e32c-494b-9718-ec96b39fa231', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:46:34.884276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef1e955e-730c-4c08-a4d0-94ec4cfd0d40 req-0227fa33-cd98-4458-a101-a2975bc3a96d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:34.885953 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef1e955e-730c-4c08-a4d0-94ec4cfd0d40 req-0227fa33-cd98-4458-a101-a2975bc3a96d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 1096 time: 0.1920700 May 12 15:46:35.010571 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b4ee7c9-8d7e-4522-b8bc-8d476b08b1b2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:35.017565 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b4ee7c9-8d7e-4522-b8bc-8d476b08b1b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:35.034556 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1773c426-09a7-4a0c-9288-878c848c1706 None None] New status for floating IP d2ed2139-605d-4648-ada6-83bbdb6ff583: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:46:35.051189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f8e5f17-be35-43f2-b98b-40da4f264d86 req-a9e38677-c9b2-4ae2-89f7-649e3dc3ef85 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:35.052913 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f8e5f17-be35-43f2-b98b-40da4f264d86 req-a9e38677-c9b2-4ae2-89f7-649e3dc3ef85 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 946 time: 0.2656696 May 12 15:46:35.106841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-b0d96b9f-401b-4a26-966d-dbcd9bedc204 req-34c114b7-b309-489f-9229-9286041164a7 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Deleting port e4de15ca-6d9a-47d1-8535-a72265f9c929 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:35.107390 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b0d96b9f-401b-4a26-966d-dbcd9bedc204 req-34c114b7-b309-489f-9229-9286041164a7 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:35.116535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b4ee7c9-8d7e-4522-b8bc-8d476b08b1b2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b03e0085-8f58-49dc-a42b-aeb68f9154fe,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:35.121138 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9b4ee7c9-8d7e-4522-b8bc-8d476b08b1b2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0d4af299e8df4225a0f6ea2620a78121&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5310032 May 12 15:46:35.127333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46208) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:35.172912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef1e955e-730c-4c08-a4d0-94ec4cfd0d40 req-4182410d-430e-4645-9b5c-36ad660cdafc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:35.174299 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef1e955e-730c-4c08-a4d0-94ec4cfd0d40 req-4182410d-430e-4645-9b5c-36ad660cdafc service neutron] 10.222.0.84 "GET /v2.0/networks?id=03979098-a904-494a-a852-b458bf7ca658 HTTP/1.1" status: 200 len: 897 time: 0.2777879 May 12 15:46:35.198823 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f8e5f17-be35-43f2-b98b-40da4f264d86 req-0a8db47e-c7eb-40d3-af0a-9a7cde5a39ca tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1302297 May 12 15:46:35.268144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-24d28ad7-1cba-45be-adbe-a5b4e4e935da req-d8bb316b-a115-4891-9ba4-cf5a62f280d9 service neutron] 10.222.0.76 "GET /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7130108 May 12 15:46:35.285823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-ecfaea07-0938-4294-99fb-965b5d8f9259 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Delete allocated IP 2001:db8::325 (61b1250e-09c9-4206-8592-62cee35b5757/b363b536-bfd3-4cbb-af39-a9fd057371f4) {{(pid=88151) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} May 12 15:46:35.314466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-ecfaea07-0938-4294-99fb-965b5d8f9259 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Allocated IP 2001:db8:0:2::ef (61b1250e-09c9-4206-8592-62cee35b5757/257991e8-a60e-46fa-93c2-b0d377c1520a/5785b3d6-e6e5-401f-a25f-ae978cfe4d21) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:46:35.331734 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c088820-23eb-436b-96aa-ac988fbaec3c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:35.364431 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c088820-23eb-436b-96aa-ac988fbaec3c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:35.392477 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef1e955e-730c-4c08-a4d0-94ec4cfd0d40 req-8896db0b-c11f-47c8-bb0d-e0adfda2ece6 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=42a296ea-fb47-4109-8501-772157438fa6 HTTP/1.1" status: 200 len: 217 time: 0.1781056 May 12 15:46:35.524006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef1e955e-730c-4c08-a4d0-94ec4cfd0d40 req-5f54416c-b56f-4f55-96c3-401d8b194b89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:35.525507 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef1e955e-730c-4c08-a4d0-94ec4cfd0d40 req-5f54416c-b56f-4f55-96c3-401d8b194b89 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=501ff294-e32c-494b-9718-ec96b39fa231 HTTP/1.1" status: 200 len: 835 time: 0.0777578 May 12 15:46:35.534061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c088820-23eb-436b-96aa-ac988fbaec3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:35.595385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c088820-23eb-436b-96aa-ac988fbaec3c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b03e0085-8f58-49dc-a42b-aeb68f9154fe,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:35.605957 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c088820-23eb-436b-96aa-ac988fbaec3c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:35.609810 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4c088820-23eb-436b-96aa-ac988fbaec3c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b03e0085-8f58-49dc-a42b-aeb68f9154fe HTTP/1.1" status: 204 len: 168 time: 0.4788375 May 12 15:46:35.623748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f5f1614-e11b-4b64-8f7f-800b10fcabf7 req-a98a013f-d2f6-4528-b271-83076f94cd5c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:35.631114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8f5f1614-e11b-4b64-8f7f-800b10fcabf7 req-a98a013f-d2f6-4528-b271-83076f94cd5c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 945 time: 0.2296178 May 12 15:46:35.680986 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8f5f1614-e11b-4b64-8f7f-800b10fcabf7 req-326643e3-a0e0-46e3-af2e-d4135c16b952 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=7ef93a22-5ccd-49ce-bc3f-8fb5236953da&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490229 May 12 15:46:35.689763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef1e955e-730c-4c08-a4d0-94ec4cfd0d40 req-5d894737-05ad-4741-b140-dbbd19ac302d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:35.691223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef1e955e-730c-4c08-a4d0-94ec4cfd0d40 req-5d894737-05ad-4741-b140-dbbd19ac302d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=03979098-a904-494a-a852-b458bf7ca658&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1583068 May 12 15:46:35.853374 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef1e955e-730c-4c08-a4d0-94ec4cfd0d40 req-e24513d7-6740-4617-836f-4f5a263d4d9f service neutron] 10.222.0.84 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1554697 May 12 15:46:35.943394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b0d96b9f-401b-4a26-966d-dbcd9bedc204 req-34c114b7-b309-489f-9229-9286041164a7 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] For port e4de15ca-6d9a-47d1-8535-a72265f9c929, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e4de15ca-6d9a-47d1-8535-a72265f9c929,segment=NetworkSegment(384c5e83-6775-4f29-a4c7-08c3d60e1de8),segment_id=384c5e83-6775-4f29-a4c7-08c3d60e1de8)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:35.943828 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b0d96b9f-401b-4a26-966d-dbcd9bedc204 req-34c114b7-b309-489f-9229-9286041164a7 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:35.980054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc29b1f-fadb-4fc5-951d-928024bd96cf req-491eda12-da01-45a3-beea-d80689389d9d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:35.981183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-3fc29b1f-fadb-4fc5-951d-928024bd96cf req-491eda12-da01-45a3-beea-d80689389d9d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:35.994760 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef1e955e-730c-4c08-a4d0-94ec4cfd0d40 req-9b03e369-fc43-443e-8ab9-de19271cc197 service neutron] 10.222.0.84 "GET /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1349728 May 12 15:46:36.114088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-b0d96b9f-401b-4a26-966d-dbcd9bedc204 req-34c114b7-b309-489f-9229-9286041164a7 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Calling delete_port for e4de15ca-6d9a-47d1-8535-a72265f9c929 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:36.210045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-3fc29b1f-fadb-4fc5-951d-928024bd96cf req-491eda12-da01-45a3-beea-d80689389d9d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:36.211230 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3fc29b1f-fadb-4fc5-951d-928024bd96cf req-491eda12-da01-45a3-beea-d80689389d9d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 945 time: 0.7364156 May 12 15:46:36.298131 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecfaea07-0938-4294-99fb-965b5d8f9259 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:36.368365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-ecfaea07-0938-4294-99fb-965b5d8f9259 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Transition to ACTIVE for port object 5785b3d6-e6e5-401f-a25f-ae978cfe4d21 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:46:36.412165 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecfaea07-0938-4294-99fb-965b5d8f9259 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:36.423675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-3fc29b1f-fadb-4fc5-951d-928024bd96cf req-e74f0fc0-50ff-48fc-a32a-409847b5bd18 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting port 42a296ea-fb47-4109-8501-772157438fa6 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:36.424283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3fc29b1f-fadb-4fc5-951d-928024bd96cf req-e74f0fc0-50ff-48fc-a32a-409847b5bd18 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:36.431542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13cf32f4-79d4-4665-bac0-a4ff903b3844 req-a0bb48d3-5d71-417d-b900-1dc10996c458 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:36.433197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13cf32f4-79d4-4665-bac0-a4ff903b3844 req-a0bb48d3-5d71-417d-b900-1dc10996c458 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 946 time: 0.1063361 May 12 15:46:36.450090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-4ea711ba-204e-4ed3-a681-e140347e024a None None] Allocated IP 2001:db8:0:2::2 (61b1250e-09c9-4206-8592-62cee35b5757/257991e8-a60e-46fa-93c2-b0d377c1520a/a8ca4652-4c09-412b-9f0f-016c3017550c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:46:36.501804 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13cf32f4-79d4-4665-bac0-a4ff903b3844 req-3440405a-6f27-4dd1-887b-608f68ae5857 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/security-groups?id=be4caf5e-1821-4c5c-b429-5f1324c7c7b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0623662 May 12 15:46:36.608025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ecfaea07-0938-4294-99fb-965b5d8f9259 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] In _notify_port_updated(), no bound segment for port 5785b3d6-e6e5-401f-a25f-ae978cfe4d21 on network 61b1250e-09c9-4206-8592-62cee35b5757 {{(pid=88151) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:870}} May 12 15:46:36.614421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ecfaea07-0938-4294-99fb-965b5d8f9259 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:36.615035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecfaea07-0938-4294-99fb-965b5d8f9259 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:36.618939 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ecfaea07-0938-4294-99fb-965b5d8f9259 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "PUT /v2.0/ports/5785b3d6-e6e5-401f-a25f-ae978cfe4d21 HTTP/1.1" status: 200 len: 969 time: 3.7288501 May 12 15:46:36.620183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46244) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:36.643219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecfaea07-0938-4294-99fb-965b5d8f9259 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event updated for resources: {'Port': ['ID=5785b3d6-e6e5-401f-a25f-ae978cfe4d21,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:36.667766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4ea711ba-204e-4ed3-a681-e140347e024a None None] For port a8ca4652-4c09-412b-9f0f-016c3017550c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a8ca4652-4c09-412b-9f0f-016c3017550c,segment=NetworkSegment(88392f67-14f6-47b9-a689-18992378d1e1),segment_id=88392f67-14f6-47b9-a689-18992378d1e1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:36.700621 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4ea711ba-204e-4ed3-a681-e140347e024a None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:36.729656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4ea711ba-204e-4ed3-a681-e140347e024a None None] Transition to ACTIVE for port object a8ca4652-4c09-412b-9f0f-016c3017550c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:46:36.737852 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4ea711ba-204e-4ed3-a681-e140347e024a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:36.856572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ca60385f-6ce2-4753-89c5-067001bfa6ad tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 5785b3d6-e6e5-401f-a25f-ae978cfe4d21 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:36.856903 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca60385f-6ce2-4753-89c5-067001bfa6ad tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:36.883059 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b0d96b9f-401b-4a26-966d-dbcd9bedc204 req-34c114b7-b309-489f-9229-9286041164a7 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:36.912697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ea711ba-204e-4ed3-a681-e140347e024a None None] Pushing event updated for resources: {'Port': ['ID=a8ca4652-4c09-412b-9f0f-016c3017550c,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:37.029810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34c114b7-b309-489f-9229-9286041164a7 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Pushing event deleted for resources: {'Port': ['ID=e4de15ca-6d9a-47d1-8535-a72265f9c929,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:37.094293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0d96b9f-401b-4a26-966d-dbcd9bedc204 req-34c114b7-b309-489f-9229-9286041164a7 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] No DVR routers for this DVR port e4de15ca-6d9a-47d1-8535-a72265f9c929 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:46:37.097433 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b0d96b9f-401b-4a26-966d-dbcd9bedc204 req-34c114b7-b309-489f-9229-9286041164a7 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:37.128859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'name': 'network-vif-deleted', 'tag': 'e4de15ca-6d9a-47d1-8535-a72265f9c929'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:46:37.224263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e4de15ca-6d9a-47d1-8535-a72265f9c929 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:37.258254 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-aca4f9b5-2606-4381-8bc7-3bd233d60237'] response: {'server_uuid': '6cbc8243-c388-4047-ab2f-0fd130140f79', 'name': 'network-vif-deleted', 'tag': 'e4de15ca-6d9a-47d1-8535-a72265f9c929', 'status': 'completed', 'code': 200} May 12 15:46:37.267854 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0d96b9f-401b-4a26-966d-dbcd9bedc204 req-34c114b7-b309-489f-9229-9286041164a7 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.76 "DELETE /v2.0/ports/e4de15ca-6d9a-47d1-8535-a72265f9c929 HTTP/1.1" status: 204 len: 173 time: 2.5562825 May 12 15:46:37.362288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40114973-7257-4405-b9b4-dace577de634 req-4ab044f6-401d-4ef4-9e07-0bb5f717062c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:37.364374 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: e4de15ca-6d9a-47d1-8535-a72265f9c929 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:37.365423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e4de15ca-6d9a-47d1-8535-a72265f9c929 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:37.380214 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40114973-7257-4405-b9b4-dace577de634 req-4ab044f6-401d-4ef4-9e07-0bb5f717062c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 945 time: 0.4490089 May 12 15:46:37.421090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-3fc29b1f-fadb-4fc5-951d-928024bd96cf req-e74f0fc0-50ff-48fc-a32a-409847b5bd18 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] For port 42a296ea-fb47-4109-8501-772157438fa6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=42a296ea-fb47-4109-8501-772157438fa6,segment=NetworkSegment(0e218190-12cd-4c5d-a26e-6453816fe1e4),segment_id=0e218190-12cd-4c5d-a26e-6453816fe1e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:37.424420 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3fc29b1f-fadb-4fc5-951d-928024bd96cf req-e74f0fc0-50ff-48fc-a32a-409847b5bd18 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:37.549815 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca60385f-6ce2-4753-89c5-067001bfa6ad tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:37.599663 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40114973-7257-4405-b9b4-dace577de634 req-6adb3f7c-e751-4f97-a2e8-10c1b8274428 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=7ef93a22-5ccd-49ce-bc3f-8fb5236953da&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2184896 May 12 15:46:37.635510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-3fc29b1f-fadb-4fc5-951d-928024bd96cf req-e74f0fc0-50ff-48fc-a32a-409847b5bd18 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Calling delete_port for 42a296ea-fb47-4109-8501-772157438fa6 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:37.746345 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84311b31-5f38-42bd-84a4-c075a800d301 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:37.833097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ca60385f-6ce2-4753-89c5-067001bfa6ad tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 5785b3d6-e6e5-401f-a25f-ae978cfe4d21 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:37.994825 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8593ff78-7d22-4dc4-b02c-577809f2a9d8 req-f27886ce-61b9-4031-a875-9c8b9a5535ff tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 210 time: 0.1827173 May 12 15:46:38.222493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0dff6026-736e-430d-9ee5-286dc406e7bb None None] Provisioning complete for port 2828a441-fc11-488a-bc82-1cc8de827bc0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:38.223023 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0dff6026-736e-430d-9ee5-286dc406e7bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:38.282921 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca60385f-6ce2-4753-89c5-067001bfa6ad tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:38.285821 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3fc29b1f-fadb-4fc5-951d-928024bd96cf req-e74f0fc0-50ff-48fc-a32a-409847b5bd18 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:38.330376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0dff6026-736e-430d-9ee5-286dc406e7bb None None] Port 2828a441-fc11-488a-bc82-1cc8de827bc0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:46:38.351452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0dff6026-736e-430d-9ee5-286dc406e7bb None None] Provisioning for port a8ca4652-4c09-412b-9f0f-016c3017550c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:46:38.357467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0dff6026-736e-430d-9ee5-286dc406e7bb None None] Provisioning complete for port a8ca4652-4c09-412b-9f0f-016c3017550c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:38.358042 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0dff6026-736e-430d-9ee5-286dc406e7bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:38.433517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e74f0fc0-50ff-48fc-a32a-409847b5bd18 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Port': ['ID=42a296ea-fb47-4109-8501-772157438fa6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:38.539064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca60385f-6ce2-4753-89c5-067001bfa6ad tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=5785b3d6-e6e5-401f-a25f-ae978cfe4d21,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:38.547542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a8ca4652-4c09-412b-9f0f-016c3017550c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:46:38.580762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-3fc29b1f-fadb-4fc5-951d-928024bd96cf req-e74f0fc0-50ff-48fc-a32a-409847b5bd18 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] No DVR routers for this DVR port 42a296ea-fb47-4109-8501-772157438fa6 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:46:38.608106 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3fc29b1f-fadb-4fc5-951d-928024bd96cf req-e74f0fc0-50ff-48fc-a32a-409847b5bd18 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:38.645821 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3fc29b1f-fadb-4fc5-951d-928024bd96cf req-e74f0fc0-50ff-48fc-a32a-409847b5bd18 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "DELETE /v2.0/ports/42a296ea-fb47-4109-8501-772157438fa6 HTTP/1.1" status: 204 len: 173 time: 2.4133635 May 12 15:46:38.695851 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca60385f-6ce2-4753-89c5-067001bfa6ad tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:38.716476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ca60385f-6ce2-4753-89c5-067001bfa6ad tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/5785b3d6-e6e5-401f-a25f-ae978cfe4d21 HTTP/1.1" status: 204 len: 168 time: 2.0937531 May 12 15:46:38.717772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46274) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:38.760254 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0dff6026-736e-430d-9ee5-286dc406e7bb None None] Could not find standard attr ID for object 5785b3d6-e6e5-401f-a25f-ae978cfe4d21. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:46:38.771596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a8ca4652-4c09-412b-9f0f-016c3017550c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:38.772520 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:38.817225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-84311b31-5f38-42bd-84a4-c075a800d301 admin admin] Deleting port 07a79124-ebb1-420c-a284-314332baa4cd {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:38.820246 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84311b31-5f38-42bd-84a4-c075a800d301 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:38.872299 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-da53a4f9-ce29-4f47-ad9e-995811130950 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] GET failed (client error): The resource could not be found. May 12 15:46:38.872857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-da53a4f9-ce29-4f47-ad9e-995811130950 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:38.915296 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7d88b6d7-c4f4-421d-9593-69ada7ab166b None None] Could not find standard attr ID for object 5785b3d6-e6e5-401f-a25f-ae978cfe4d21. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 15:46:38.976411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10911bda-d0c2-405a-b9ab-1fdbf41bc306 req-c8311fbe-1c1b-40ee-95b6-cb150bdb584c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=dfdb80a3-1ea5-441e-b752-00ccdeec75ae HTTP/1.1" status: 200 len: 210 time: 0.0928078 May 12 15:46:39.007569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-da53a4f9-ce29-4f47-ad9e-995811130950 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:39.007569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-da53a4f9-ce29-4f47-ad9e-995811130950 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports/5785b3d6-e6e5-401f-a25f-ae978cfe4d21 HTTP/1.1" status: 404 len: 333 time: 0.2878463 May 12 15:46:39.010048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46278) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:39.158678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-84311b31-5f38-42bd-84a4-c075a800d301 admin admin] For port 07a79124-ebb1-420c-a284-314332baa4cd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=07a79124-ebb1-420c-a284-314332baa4cd,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:39.158678 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84311b31-5f38-42bd-84a4-c075a800d301 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:39.163724 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c19b91fb-4c50-4d5d-a2af-b51b26092f91 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:39.205686 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c19b91fb-4c50-4d5d-a2af-b51b26092f91 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:39.277873 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3035eab-b721-42a1-9be7-3893facbb248 req-e3ac6db5-84f8-4259-8369-c9a1528e99f1 tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "GET /v2.0/ports?device_id=6cbc8243-c388-4047-ab2f-0fd130140f79 HTTP/1.1" status: 200 len: 210 time: 0.0637267 May 12 15:46:39.312037 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c19b91fb-4c50-4d5d-a2af-b51b26092f91 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:39.332721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c19b91fb-4c50-4d5d-a2af-b51b26092f91 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6dc593f-310a-48e1-92fd-6df81855f0c0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:39.349358 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c19b91fb-4c50-4d5d-a2af-b51b26092f91 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:39.350656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c19b91fb-4c50-4d5d-a2af-b51b26092f91 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/security-groups/a6dc593f-310a-48e1-92fd-6df81855f0c0 HTTP/1.1" status: 204 len: 168 time: 0.3396020 May 12 15:46:39.353242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46284) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:39.477026 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5aa9d282-bbfe-45b7-9f66-2d83b4dd2b4e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:39.497378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'name': 'network-vif-deleted', 'tag': '42a296ea-fb47-4109-8501-772157438fa6'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:46:39.506952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5aa9d282-bbfe-45b7-9f66-2d83b4dd2b4e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:39.520894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-84311b31-5f38-42bd-84a4-c075a800d301 admin admin] Calling delete_port for 07a79124-ebb1-420c-a284-314332baa4cd owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:39.566227 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5aa9d282-bbfe-45b7-9f66-2d83b4dd2b4e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:39.586205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aa9d282-bbfe-45b7-9f66-2d83b4dd2b4e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa2f91ad-2b66-423f-a5f4-00bff4ff098c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:39.601238 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5aa9d282-bbfe-45b7-9f66-2d83b4dd2b4e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:39.605734 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5aa9d282-bbfe-45b7-9f66-2d83b4dd2b4e tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/security-groups/aa2f91ad-2b66-423f-a5f4-00bff4ff098c HTTP/1.1" status: 204 len: 168 time: 0.2513995 May 12 15:46:39.606392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46292) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:39.639004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 42a296ea-fb47-4109-8501-772157438fa6 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:39.657004 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-dbd4e750-2b8c-4b33-8eff-cf4d2d2c9b39'] response: {'server_uuid': 'dfdb80a3-1ea5-441e-b752-00ccdeec75ae', 'name': 'network-vif-deleted', 'tag': '42a296ea-fb47-4109-8501-772157438fa6', 'status': 'completed', 'code': 200} May 12 15:46:39.697524 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3bdc96ed-715b-4c53-adb0-1d6e73822242 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:39.729843 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 42a296ea-fb47-4109-8501-772157438fa6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:39.732003 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 42a296ea-fb47-4109-8501-772157438fa6 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:39.755752 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3bdc96ed-715b-4c53-adb0-1d6e73822242 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:39.806167 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3bdc96ed-715b-4c53-adb0-1d6e73822242 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:39.823923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bdc96ed-715b-4c53-adb0-1d6e73822242 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=be71d5d6-d086-41fa-be89-766fd5750ede,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:39.831304 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3bdc96ed-715b-4c53-adb0-1d6e73822242 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:39.836156 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3bdc96ed-715b-4c53-adb0-1d6e73822242 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/security-groups/be71d5d6-d086-41fa-be89-766fd5750ede HTTP/1.1" status: 204 len: 168 time: 0.2264214 May 12 15:46:39.836679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46298) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:39.883957 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84311b31-5f38-42bd-84a4-c075a800d301 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:39.932765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-5ff3f729-9b9b-40ac-9433-5b7ade9a11ca tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting subnet b363b536-bfd3-4cbb-af39-a9fd057371f4 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:46:39.933273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84311b31-5f38-42bd-84a4-c075a800d301 admin admin] Pushing event deleted for resources: {'Port': ['ID=07a79124-ebb1-420c-a284-314332baa4cd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:39.939253 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff3f729-9b9b-40ac-9433-5b7ade9a11ca tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:40.008535 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff3f729-9b9b-40ac-9433-5b7ade9a11ca tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:40.132951 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff3f729-9b9b-40ac-9433-5b7ade9a11ca tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:40.165547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46306) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:40.303924 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-449a437e-285e-49a0-9065-9654bb59c39e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:40.341927 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-84311b31-5f38-42bd-84a4-c075a800d301 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:40.350366 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-449a437e-285e-49a0-9065-9654bb59c39e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:40.381754 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff3f729-9b9b-40ac-9433-5b7ade9a11ca tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:40.461464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a449f060-cde8-42ce-89bf-456a25eb8357 None None] Network 61b1250e-09c9-4206-8592-62cee35b5757 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:40.463461 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff3f729-9b9b-40ac-9433-5b7ade9a11ca tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:40.473073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ff3f729-9b9b-40ac-9433-5b7ade9a11ca tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Subnet': ['ID=b363b536-bfd3-4cbb-af39-a9fd057371f4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:40.487287 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5ff3f729-9b9b-40ac-9433-5b7ade9a11ca tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/b363b536-bfd3-4cbb-af39-a9fd057371f4 HTTP/1.1" status: 204 len: 168 time: 0.6491742 May 12 15:46:40.492203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46316) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:40.534476 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46320) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:40.747352 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e16ca58-3950-4728-a769-4d756582916c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:40.769072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-ab245b37-edb9-408e-88e3-ae36d024aac3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting subnet 257991e8-a60e-46fa-93c2-b0d377c1520a {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:46:40.776121 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-449a437e-285e-49a0-9065-9654bb59c39e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:40.780447 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab245b37-edb9-408e-88e3-ae36d024aac3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:40.864238 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e16ca58-3950-4728-a769-4d756582916c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:40.909553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-449a437e-285e-49a0-9065-9654bb59c39e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ef93a22-5ccd-49ce-bc3f-8fb5236953da,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:40.916363 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-449a437e-285e-49a0-9065-9654bb59c39e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:40.918120 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-449a437e-285e-49a0-9065-9654bb59c39e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "DELETE /v2.0/security-groups/7ef93a22-5ccd-49ce-bc3f-8fb5236953da HTTP/1.1" status: 204 len: 168 time: 0.7513885 May 12 15:46:40.964002 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab245b37-edb9-408e-88e3-ae36d024aac3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:40.990335 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-84311b31-5f38-42bd-84a4-c075a800d301 admin admin] Router 759cf87a-38b1-4e42-8dc9-a38af59b3a2f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:46:40.991870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46328) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:41.118235 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e16ca58-3950-4728-a769-4d756582916c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:41.148226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e16ca58-3950-4728-a769-4d756582916c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=be4caf5e-1821-4c5c-b429-5f1324c7c7b2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:41.151818 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab245b37-edb9-408e-88e3-ae36d024aac3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:41.220144 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e16ca58-3950-4728-a769-4d756582916c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:41.224547 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1e16ca58-3950-4728-a769-4d756582916c tempest-TestVolumeBackupRestore-1887795370 tempest-TestVolumeBackupRestore-1887795370-project] 10.222.0.82 "DELETE /v2.0/security-groups/be4caf5e-1821-4c5c-b429-5f1324c7c7b2 HTTP/1.1" status: 204 len: 168 time: 0.6873775 May 12 15:46:41.255574 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab245b37-edb9-408e-88e3-ae36d024aac3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:41.337910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab245b37-edb9-408e-88e3-ae36d024aac3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Subnet': ['ID=257991e8-a60e-46fa-93c2-b0d377c1520a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:41.343591 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ab245b37-edb9-408e-88e3-ae36d024aac3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:41.350686 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ab245b37-edb9-408e-88e3-ae36d024aac3 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/257991e8-a60e-46fa-93c2-b0d377c1520a HTTP/1.1" status: 204 len: 168 time: 0.8573194 May 12 15:46:41.352910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46336) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:41.431782 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-3aab5b08-e6a7-4416-adf6-0abb99aac575 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] DELETE failed (client error): The resource could not be found. May 12 15:46:41.432561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3aab5b08-e6a7-4416-adf6-0abb99aac575 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:46:41.434950 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3aab5b08-e6a7-4416-adf6-0abb99aac575 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/b363b536-bfd3-4cbb-af39-a9fd057371f4 HTTP/1.1" status: 404 len: 337 time: 0.0808411 May 12 15:46:41.438780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46342) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:41.455343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-84311b31-5f38-42bd-84a4-c075a800d301 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:46:41.468588 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6f3de39-c42c-458c-95fc-b06b462f04e5 None None] Sync routers for ids ['759cf87a-38b1-4e42-8dc9-a38af59b3a2f'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:46:41.489182 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6f3de39-c42c-458c-95fc-b06b462f04e5 None None] Routers {'759cf87a-38b1-4e42-8dc9-a38af59b3a2f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:41.489852 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d6f3de39-c42c-458c-95fc-b06b462f04e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['759cf87a-38b1-4e42-8dc9-a38af59b3a2f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:41.649043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-a114ffc8-05e6-40c2-b42e-8220dd4aa1c1 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting subnet 95b1e088-a677-4f6e-9cf8-8bb51f36684d {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:46:41.661986 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a114ffc8-05e6-40c2-b42e-8220dd4aa1c1 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:41.845611 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a114ffc8-05e6-40c2-b42e-8220dd4aa1c1 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:41.958583 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-84311b31-5f38-42bd-84a4-c075a800d301 admin admin] 10.222.0.82 "PUT /v2.0/routers/759cf87a-38b1-4e42-8dc9-a38af59b3a2f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.2417107 May 12 15:46:41.960871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46388) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:41.971674 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5709cc99-8132-458c-976b-48363bd72ded None None] Network 61b1250e-09c9-4206-8592-62cee35b5757 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:42.043968 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d6f3de39-c42c-458c-95fc-b06b462f04e5 None None] Set router 759cf87a-38b1-4e42-8dc9-a38af59b3a2f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:42.267195 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a114ffc8-05e6-40c2-b42e-8220dd4aa1c1 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:42.324894 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e160c4c4-79e7-47bc-be14-6c55b6f2a1a1 None None] Provisioning complete for port 2828a441-fc11-488a-bc82-1cc8de827bc0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:42.325108 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e160c4c4-79e7-47bc-be14-6c55b6f2a1a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:42.429633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e160c4c4-79e7-47bc-be14-6c55b6f2a1a1 None None] Port 2828a441-fc11-488a-bc82-1cc8de827bc0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:46:42.453407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e160c4c4-79e7-47bc-be14-6c55b6f2a1a1 None None] Provisioning complete for port a8ca4652-4c09-412b-9f0f-016c3017550c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:42.454583 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e160c4c4-79e7-47bc-be14-6c55b6f2a1a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:42.550465 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a114ffc8-05e6-40c2-b42e-8220dd4aa1c1 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:42.672145 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d6f3de39-c42c-458c-95fc-b06b462f04e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'name': 'tempest-TestServerMultinode-726377410-router', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:44:57Z', 'updated_at': '2022-05-12T15:46:39Z', 'revision_number': 5, 'project_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'gw_port': {'id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:d5:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3579, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:44:58Z', 'updated_at': '2022-05-12T15:45:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:42.680968 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6f3de39-c42c-458c-95fc-b06b462f04e5 None None] Checking router: 759cf87a-38b1-4e42-8dc9-a38af59b3a2f for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:46:42.699684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a114ffc8-05e6-40c2-b42e-8220dd4aa1c1 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Subnet': ['ID=95b1e088-a677-4f6e-9cf8-8bb51f36684d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:42.710582 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a114ffc8-05e6-40c2-b42e-8220dd4aa1c1 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:42.726593 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6f3de39-c42c-458c-95fc-b06b462f04e5 None None] Routers {'759cf87a-38b1-4e42-8dc9-a38af59b3a2f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:42.727229 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d6f3de39-c42c-458c-95fc-b06b462f04e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['759cf87a-38b1-4e42-8dc9-a38af59b3a2f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:42.767176 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3a8cc04-1d97-4c80-a82b-aee27387a18d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:43.006865 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:43.110582 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-517dfc18-f369-4c3b-84d1-41dacdf85d29 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:43.186067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a114ffc8-05e6-40c2-b42e-8220dd4aa1c1 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/95b1e088-a677-4f6e-9cf8-8bb51f36684d HTTP/1.1" status: 204 len: 168 time: 1.7460849 May 12 15:46:43.198962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46502) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:43.218044 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d6f3de39-c42c-458c-95fc-b06b462f04e5 None None] Set router 759cf87a-38b1-4e42-8dc9-a38af59b3a2f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:43.335261 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:43.379375 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-dd9ac472-ae8b-41e0-9cd3-53ce5ac3d406 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] DELETE failed (client error): The resource could not be found. May 12 15:46:43.379756 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dd9ac472-ae8b-41e0-9cd3-53ce5ac3d406 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:46:43.382149 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dd9ac472-ae8b-41e0-9cd3-53ce5ac3d406 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/54d8ebb9-ee37-4f15-acb9-b5f8c941aa35 HTTP/1.1" status: 404 len: 337 time: 0.1818125 May 12 15:46:43.385597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46522) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:43.500584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b8308185-1ad8-4ab8-94d8-979d474f8b50 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Synchronizing usage tracker for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:43.539375 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:43.561975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] Deleting port ca01fcce-f259-4769-9012-23d4f8b5e9ef {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:43.562542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:43.814151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b8308185-1ad8-4ab8-94d8-979d474f8b50 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Unset dirty status for tenant:1da2b935bcd34292b3e8ce00cc114001 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:43.818487 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b8308185-1ad8-4ab8-94d8-979d474f8b50 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "GET /v2.0/ports?device_id=52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41 HTTP/1.1" status: 200 len: 205 time: 0.4316094 May 12 15:46:43.836580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-788a1559-4576-4150-89a7-b2d7cf561b8a None None] Network 61b1250e-09c9-4206-8592-62cee35b5757 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:43.847767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46566) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:44.020816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] For port ca01fcce-f259-4769-9012-23d4f8b5e9ef, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ca01fcce-f259-4769-9012-23d4f8b5e9ef,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:44.021155 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:44.035117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-10d42419-5f23-4b51-ad77-4a25bb1457aa None None] Provisioning complete for port 2828a441-fc11-488a-bc82-1cc8de827bc0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:44.035482 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-10d42419-5f23-4b51-ad77-4a25bb1457aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:44.082242 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-028e8be5-5d96-4dd5-a472-e8bed01426c0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] delete failed (client error): The resource could not be found. May 12 15:46:44.085502 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-028e8be5-5d96-4dd5-a472-e8bed01426c0 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/routers/52feaaa9-a114-4f2c-82ee-f6cf5a0f2d41 HTTP/1.1" status: 404 len: 336 time: 0.2345529 May 12 15:46:44.086488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46596) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:44.206546 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d6f3de39-c42c-458c-95fc-b06b462f04e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'name': 'tempest-TestServerMultinode-726377410-router', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:44:57Z', 'updated_at': '2022-05-12T15:46:39Z', 'revision_number': 5, 'project_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'gw_port': {'id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:d5:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3579, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:44:58Z', 'updated_at': '2022-05-12T15:45:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:44.210993 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6f3de39-c42c-458c-95fc-b06b462f04e5 None None] The sync data for ids ['759cf87a-38b1-4e42-8dc9-a38af59b3a2f'] in n-d-841483-1 is: [{'id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'name': 'tempest-TestServerMultinode-726377410-router', 'tenant_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246'}], 'enable_snat': True}, 'gw_port_id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:44:57Z', 'updated_at': '2022-05-12T15:46:39Z', 'revision_number': 5, 'project_id': 'd3a18d1ea5f34946aa8296445e7e6f81', 'gw_port': {'id': 'ca01fcce-f259-4769-9012-23d4f8b5e9ef', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:d5:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '759cf87a-38b1-4e42-8dc9-a38af59b3a2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3579, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:44:58Z', 'updated_at': '2022-05-12T15:45:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:46:44.225865 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-70fd55e6-4dc5-4aa6-90e8-3bcba7a1ac9a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] DELETE failed (client error): The resource could not be found. May 12 15:46:44.226856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-70fd55e6-4dc5-4aa6-90e8-3bcba7a1ac9a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:46:44.228784 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-70fd55e6-4dc5-4aa6-90e8-3bcba7a1ac9a tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/341373d7-a414-4e68-bbb2-befc9aa72839 HTTP/1.1" status: 404 len: 337 time: 0.1414068 May 12 15:46:44.351950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46614) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:44.377054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] Calling delete_port for ca01fcce-f259-4769-9012-23d4f8b5e9ef owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:44.599393 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-10d42419-5f23-4b51-ad77-4a25bb1457aa None None] Port 2828a441-fc11-488a-bc82-1cc8de827bc0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:46:44.667864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-517dfc18-f369-4c3b-84d1-41dacdf85d29 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:44.668399 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-517dfc18-f369-4c3b-84d1-41dacdf85d29 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:44.676371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-10d42419-5f23-4b51-ad77-4a25bb1457aa None None] Provisioning complete for port a8ca4652-4c09-412b-9f0f-016c3017550c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:46:44.677060 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-10d42419-5f23-4b51-ad77-4a25bb1457aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:45.006471 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-581fb2d8-fecc-4dbb-b5e7-ac6d97a444fe tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] DELETE failed (client error): The resource could not be found. May 12 15:46:45.006945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-581fb2d8-fecc-4dbb-b5e7-ac6d97a444fe tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:46:45.008688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-581fb2d8-fecc-4dbb-b5e7-ac6d97a444fe tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/4fa38328-6c61-4ac7-b76e-d91d29d426a8 HTTP/1.1" status: 404 len: 337 time: 0.6557779 May 12 15:46:45.027295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46688) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:45.054360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75a4e237-37af-4b68-9bf5-eea3b2c1fd02 None None] DHCP port deletion for 61b1250e-09c9-4206-8592-62cee35b5757 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:46:45.060143 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-75a4e237-37af-4b68-9bf5-eea3b2c1fd02 None None] Deleting port a8ca4652-4c09-412b-9f0f-016c3017550c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:45.060719 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-75a4e237-37af-4b68-9bf5-eea3b2c1fd02 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:45.105309 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-8f580e55-2f14-4475-9689-dc8682cb6ebb tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] DELETE failed (client error): The resource could not be found. May 12 15:46:45.105936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8f580e55-2f14-4475-9689-dc8682cb6ebb tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:46:45.107909 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8f580e55-2f14-4475-9689-dc8682cb6ebb tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/33e1eac5-5903-4f22-b0b5-1f09b44ea529 HTTP/1.1" status: 404 len: 337 time: 0.0790668 May 12 15:46:45.112542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46700) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:45.186985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-517dfc18-f369-4c3b-84d1-41dacdf85d29 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] For port 4c9c52d9-7be2-45c7-82f5-d4e254eec55f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4c9c52d9-7be2-45c7-82f5-d4e254eec55f,segment=NetworkSegment(0e218190-12cd-4c5d-a26e-6453816fe1e4),segment_id=0e218190-12cd-4c5d-a26e-6453816fe1e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:45.187694 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-517dfc18-f369-4c3b-84d1-41dacdf85d29 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:45.203706 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-84ac7adb-4c48-4a6d-8b65-3ce1413f568f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] DELETE failed (client error): The resource could not be found. May 12 15:46:45.204239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-84ac7adb-4c48-4a6d-8b65-3ce1413f568f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:46:45.208161 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-84ac7adb-4c48-4a6d-8b65-3ce1413f568f tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/4fc09877-1358-4598-afb6-583f6f6355c0 HTTP/1.1" status: 404 len: 333 time: 0.0921261 May 12 15:46:45.219618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46712) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:45.349300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-517dfc18-f369-4c3b-84d1-41dacdf85d29 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Calling delete_port for 4c9c52d9-7be2-45c7-82f5-d4e254eec55f owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:45.354884 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-0a655b6d-54e2-4a99-84ff-5242cd9f5923 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] DELETE failed (client error): The resource could not be found. May 12 15:46:45.355329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0a655b6d-54e2-4a99-84ff-5242cd9f5923 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:46:45.357105 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0a655b6d-54e2-4a99-84ff-5242cd9f5923 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/11a47c48-9002-4cc8-aa83-79d9ef8e1be3 HTTP/1.1" status: 404 len: 337 time: 0.1325283 May 12 15:46:45.361730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46728) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:45.421198 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-09912296-9879-4ba2-b6fe-1640d8066f2d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] DELETE failed (client error): The resource could not be found. May 12 15:46:45.422012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-09912296-9879-4ba2-b6fe-1640d8066f2d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:46:45.426240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-09912296-9879-4ba2-b6fe-1640d8066f2d tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/1ddc6003-e8a6-490b-b1fa-cc3e1d8653aa HTTP/1.1" status: 404 len: 337 time: 0.0490344 May 12 15:46:45.428996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46738) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:45.479577 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-b1ed3223-b807-452f-8c90-b8c37328db87 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] DELETE failed (client error): The resource could not be found. May 12 15:46:45.480307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b1ed3223-b807-452f-8c90-b8c37328db87 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:46:45.482302 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b1ed3223-b807-452f-8c90-b8c37328db87 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/20562783-dfb0-46eb-b519-bb7799f0ca61 HTTP/1.1" status: 404 len: 333 time: 0.0522230 May 12 15:46:45.500125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46750) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:45.610562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-75a4e237-37af-4b68-9bf5-eea3b2c1fd02 None None] For port a8ca4652-4c09-412b-9f0f-016c3017550c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a8ca4652-4c09-412b-9f0f-016c3017550c,segment=NetworkSegment(88392f67-14f6-47b9-a689-18992378d1e1),segment_id=88392f67-14f6-47b9-a689-18992378d1e1)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:45.613775 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-75a4e237-37af-4b68-9bf5-eea3b2c1fd02 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:45.628798 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-f19b0992-ea46-4423-ab65-7ac9a4cff817 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] DELETE failed (client error): The resource could not be found. May 12 15:46:45.629327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f19b0992-ea46-4423-ab65-7ac9a4cff817 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:46:45.631233 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f19b0992-ea46-4423-ab65-7ac9a4cff817 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/93116bc3-a2a4-4941-9811-c16809fcaf18 HTTP/1.1" status: 404 len: 337 time: 0.1298926 May 12 15:46:45.635274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46768) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:45.666232 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64855fb3-557c-477a-b200-a13fe18fd812 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:45.736975 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-52195e4a-1bf4-424b-820c-bf1b54fe1308 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] DELETE failed (client error): The resource could not be found. May 12 15:46:45.737338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-52195e4a-1bf4-424b-820c-bf1b54fe1308 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 15:46:45.739005 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-52195e4a-1bf4-424b-820c-bf1b54fe1308 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/subnets/d09de61a-563a-43ec-8c32-4e0716191c6e HTTP/1.1" status: 404 len: 337 time: 0.1028259 May 12 15:46:45.742382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46782) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:45.946454 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-75a4e237-37af-4b68-9bf5-eea3b2c1fd02 None None] Calling delete_port for a8ca4652-4c09-412b-9f0f-016c3017550c owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:46.013615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a04abe4d-e51f-44ca-be20-7f0d58902720 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Deleting port 2828a441-fc11-488a-bc82-1cc8de827bc0 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:46.022322 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a04abe4d-e51f-44ca-be20-7f0d58902720 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:46.048720 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-517dfc18-f369-4c3b-84d1-41dacdf85d29 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:46.116662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-517dfc18-f369-4c3b-84d1-41dacdf85d29 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Port': ['ID=4c9c52d9-7be2-45c7-82f5-d4e254eec55f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:46.150785 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:46.302145 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-75a4e237-37af-4b68-9bf5-eea3b2c1fd02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:46.358132 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:46.539534 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75a4e237-37af-4b68-9bf5-eea3b2c1fd02 None None] No DVR routers for this DVR port a8ca4652-4c09-412b-9f0f-016c3017550c on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:46:46.543595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a4e237-37af-4b68-9bf5-eea3b2c1fd02 None None] Pushing event deleted for resources: {'Port': ['ID=a8ca4652-4c09-412b-9f0f-016c3017550c,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:46.555768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] Pushing event deleted for resources: {'Port': ['ID=ca01fcce-f259-4769-9012-23d4f8b5e9ef,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:46.570567 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:46.630916 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a8ca4652-4c09-412b-9f0f-016c3017550c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:46.746072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: a8ca4652-4c09-412b-9f0f-016c3017550c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:46.746409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a8ca4652-4c09-412b-9f0f-016c3017550c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:46.746813 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 07a79124-ebb1-420c-a284-314332baa4cd no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:46.792985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 07a79124-ebb1-420c-a284-314332baa4cd {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:46.800864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 07a79124-ebb1-420c-a284-314332baa4cd not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:46.875518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46884) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:46.907391 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-517dfc18-f369-4c3b-84d1-41dacdf85d29 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:47.044295 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a04abe4d-e51f-44ca-be20-7f0d58902720 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:47.239520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a04abe4d-e51f-44ca-be20-7f0d58902720 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Calling delete_port for 2828a441-fc11-488a-bc82-1cc8de827bc0 owned by {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:47.300748 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:47.392401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e73a097-910e-46d5-85d9-176b98c43433 req-eea83c19-a762-4dcc-aeda-e1a5ce37cad1 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:47.394026 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e73a097-910e-46d5-85d9-176b98c43433 req-eea83c19-a762-4dcc-aeda-e1a5ce37cad1 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 1096 time: 0.8796799 May 12 15:46:47.714572 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a04abe4d-e51f-44ca-be20-7f0d58902720 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:47.716413 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4e73a097-910e-46d5-85d9-176b98c43433 req-530a103f-9477-42ae-a2ff-c9f0d505f768 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:47.716778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-517dfc18-f369-4c3b-84d1-41dacdf85d29 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Router 943c296a-7f18-4231-8088-35f5348abd2b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:46:47.737197 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:47.775446 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:47.788114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4e73a097-910e-46d5-85d9-176b98c43433 req-530a103f-9477-42ae-a2ff-c9f0d505f768 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:47.790746 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:47.792816 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a04abe4d-e51f-44ca-be20-7f0d58902720 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:47.795311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a04abe4d-e51f-44ca-be20-7f0d58902720 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Port': ['ID=2828a441-fc11-488a-bc82-1cc8de827bc0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:47.800958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4e73a097-910e-46d5-85d9-176b98c43433 req-530a103f-9477-42ae-a2ff-c9f0d505f768 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Usage tracker for resource:security_group_rule and tenant:c4f01cc8269a4c928114504c61053540 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:47.808200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4e73a097-910e-46d5-85d9-176b98c43433 req-530a103f-9477-42ae-a2ff-c9f0d505f768 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:47.825453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-4e73a097-910e-46d5-85d9-176b98c43433 req-530a103f-9477-42ae-a2ff-c9f0d505f768 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:47.842384 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a04abe4d-e51f-44ca-be20-7f0d58902720 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/ports/2828a441-fc11-488a-bc82-1cc8de827bc0 HTTP/1.1" status: 204 len: 168 time: 2.0951054 May 12 15:46:47.842600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46904) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:47.868229 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:47.868751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 759cf87a-38b1-4e42-8dc9-a38af59b3a2f {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:46:48.014422 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.016289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-be626655-3c9b-4a9e-a541-a7ff583f4249 admin admin] 10.222.0.82 "DELETE /v2.0/routers/759cf87a-38b1-4e42-8dc9-a38af59b3a2f HTTP/1.1" status: 204 len: 168 time: 6.0451403 May 12 15:46:48.033139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46910) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:48.057323 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e02e338d-278b-4017-bbd6-0f62215fe113 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.226190 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4e73a097-910e-46d5-85d9-176b98c43433 req-530a103f-9477-42ae-a2ff-c9f0d505f768 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.239066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-4e73a097-910e-46d5-85d9-176b98c43433 req-530a103f-9477-42ae-a2ff-c9f0d505f768 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.249752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-0dc48cdf-68c4-4fac-a428-58829f714c88 admin admin] Deleting subnet 25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:46:48.261873 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0dc48cdf-68c4-4fac-a428-58829f714c88 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.273640 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e02e338d-278b-4017-bbd6-0f62215fe113 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.286683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4e73a097-910e-46d5-85d9-176b98c43433 req-530a103f-9477-42ae-a2ff-c9f0d505f768 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Synchronizing usage tracker for tenant:c4f01cc8269a4c928114504c61053540 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:48.321915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e02e338d-278b-4017-bbd6-0f62215fe113 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['61b1250e-09c9-4206-8592-62cee35b5757']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:48.334173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-530a103f-9477-42ae-a2ff-c9f0d505f768 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dbf45695-ee3f-4b73-8ad9-5c06dc2b7bbf,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:48.342339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e02e338d-278b-4017-bbd6-0f62215fe113 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '88392f67-14f6-47b9-a689-18992378d1e1') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:48.342635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e02e338d-278b-4017-bbd6-0f62215fe113 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '88392f67-14f6-47b9-a689-18992378d1e1') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:48.359725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4e73a097-910e-46d5-85d9-176b98c43433 req-530a103f-9477-42ae-a2ff-c9f0d505f768 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Unset dirty status for tenant:c4f01cc8269a4c928114504c61053540 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:48.359725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4e73a097-910e-46d5-85d9-176b98c43433 req-530a103f-9477-42ae-a2ff-c9f0d505f768 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.8656092 May 12 15:46:48.359725 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e02e338d-278b-4017-bbd6-0f62215fe113 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.374678 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e02e338d-278b-4017-bbd6-0f62215fe113 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.381026 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e02e338d-278b-4017-bbd6-0f62215fe113 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Releasing vlan 559 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:46:48.381552 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e02e338d-278b-4017-bbd6-0f62215fe113 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: timer() May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:46:48.398876 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:46:48.424915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0dc48cdf-68c4-4fac-a428-58829f714c88 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.495540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ca01fcce-f259-4769-9012-23d4f8b5e9ef no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:48.514711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-517dfc18-f369-4c3b-84d1-41dacdf85d29 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:46:48.542114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63b6ceb2-b780-4822-83c1-4127ab9faf4c None None] Sync routers for ids ['943c296a-7f18-4231-8088-35f5348abd2b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:46:48.561287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: ca01fcce-f259-4769-9012-23d4f8b5e9ef {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:48.562033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ca01fcce-f259-4769-9012-23d4f8b5e9ef not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:48.562841 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-517dfc18-f369-4c3b-84d1-41dacdf85d29 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "PUT /v2.0/routers/943c296a-7f18-4231-8088-35f5348abd2b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.5681531 May 12 15:46:48.566816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46926) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:48.576647 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63b6ceb2-b780-4822-83c1-4127ab9faf4c None None] Routers {'943c296a-7f18-4231-8088-35f5348abd2b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:48.577557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-63b6ceb2-b780-4822-83c1-4127ab9faf4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['943c296a-7f18-4231-8088-35f5348abd2b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:48.630889 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e02e338d-278b-4017-bbd6-0f62215fe113 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.653247 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0dc48cdf-68c4-4fac-a428-58829f714c88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.654378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e02e338d-278b-4017-bbd6-0f62215fe113 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.669766 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e02e338d-278b-4017-bbd6-0f62215fe113 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] 10.222.0.82 "DELETE /v2.0/networks/61b1250e-09c9-4206-8592-62cee35b5757 HTTP/1.1" status: 204 len: 168 time: 0.8237140 May 12 15:46:48.683861 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d31c9785-8ccf-435f-9c4f-1dd58bd1d77e req-64314caa-d862-47a8-8a1b-0aa4512eb8e4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:48.685944 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d31c9785-8ccf-435f-9c4f-1dd58bd1d77e req-64314caa-d862-47a8-8a1b-0aa4512eb8e4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.1321800 May 12 15:46:48.686925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e02e338d-278b-4017-bbd6-0f62215fe113 tempest-PortsIpV6TestJSON-32756646 tempest-PortsIpV6TestJSON-32756646-project] Pushing event deleted for resources: {'Network': ['ID=61b1250e-09c9-4206-8592-62cee35b5757,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:48.752411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-64fe6358-9a4b-4490-990d-232a19051c68 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting subnet 501ff294-e32c-494b-9718-ec96b39fa231 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:46:48.760768 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64fe6358-9a4b-4490-990d-232a19051c68 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.771359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d31c9785-8ccf-435f-9c4f-1dd58bd1d77e req-47ea41f0-e029-4a76-9a28-51769ade2661 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0703428 May 12 15:46:48.801314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46936) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:48.822828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-63b6ceb2-b780-4822-83c1-4127ab9faf4c None None] Set router 943c296a-7f18-4231-8088-35f5348abd2b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:48.857154 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64fe6358-9a4b-4490-990d-232a19051c68 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:48.954930 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-594b0a33-5e78-4aed-9c7d-3d02dc0c7f1c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/81d2aa67-f73f-4acb-8c6b-3410a5437f49 HTTP/1.1" status: 200 len: 992 time: 0.1522589 May 12 15:46:49.018742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46948) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:49.051714 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0dc48cdf-68c4-4fac-a428-58829f714c88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:49.122265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0dc48cdf-68c4-4fac-a428-58829f714c88 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:49.128330 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7363aa1a-8757-469d-86e6-b9b35d4f057b None None] Network 0de89d0f-e308-41b4-8980-4fb156f3c79b requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:49.130260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dc48cdf-68c4-4fac-a428-58829f714c88 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:49.145417 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0dc48cdf-68c4-4fac-a428-58829f714c88 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/25d1f3ad-956b-4aaf-82b2-0a8fd04a2a0e HTTP/1.1" status: 204 len: 168 time: 1.1094282 May 12 15:46:49.147945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46960) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:49.190237 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c1b8b45-6771-4a75-9b0a-7e599b2cab0a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:49.344533 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64fe6358-9a4b-4490-990d-232a19051c68 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:49.349862 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:49.376641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Deleting port 7c400b8e-f20d-492c-8fbd-a62e4dda2608 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:49.377493 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:49.430046 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f2d81162-3a9d-4cce-8a7e-e91fc44294f1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1da2b935bcd34292b3e8ce00cc114001&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4098678 May 12 15:46:49.436244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46972) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:49.532847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-63b6ceb2-b780-4822-83c1-4127ab9faf4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:46:45Z', 'revision_number': 7, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:49.532847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63b6ceb2-b780-4822-83c1-4127ab9faf4c None None] Checking router: 943c296a-7f18-4231-8088-35f5348abd2b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:46:49.544077 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63b6ceb2-b780-4822-83c1-4127ab9faf4c None None] Routers {'943c296a-7f18-4231-8088-35f5348abd2b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:49.544682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-63b6ceb2-b780-4822-83c1-4127ab9faf4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['943c296a-7f18-4231-8088-35f5348abd2b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:49.650672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f3b03ac-c5f9-478e-b929-a76c2224f49a None None] DHCP port deletion for 0de89d0f-e308-41b4-8980-4fb156f3c79b request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:46:49.666847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0f3b03ac-c5f9-478e-b929-a76c2224f49a None None] Deleting port 7c400b8e-f20d-492c-8fbd-a62e4dda2608 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:49.678294 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0f3b03ac-c5f9-478e-b929-a76c2224f49a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:49.694824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b69a15a-1497-43e9-a964-60052a80044b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:49.698459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] For port 7c400b8e-f20d-492c-8fbd-a62e4dda2608, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7c400b8e-f20d-492c-8fbd-a62e4dda2608,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:49.699690 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:49.826142 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64fe6358-9a4b-4490-990d-232a19051c68 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:49.843745 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b69a15a-1497-43e9-a964-60052a80044b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:49.907164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Calling delete_port for 7c400b8e-f20d-492c-8fbd-a62e4dda2608 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:49.938515 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64fe6358-9a4b-4490-990d-232a19051c68 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:49.942825 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-63b6ceb2-b780-4822-83c1-4127ab9faf4c None None] Set router 943c296a-7f18-4231-8088-35f5348abd2b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:49.973708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64fe6358-9a4b-4490-990d-232a19051c68 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Subnet': ['ID=501ff294-e32c-494b-9718-ec96b39fa231,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:49.983263 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-64fe6358-9a4b-4490-990d-232a19051c68 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "DELETE /v2.0/subnets/501ff294-e32c-494b-9718-ec96b39fa231 HTTP/1.1" status: 204 len: 168 time: 1.4150615 May 12 15:46:49.985185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 46986) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:50.019735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70174453-20bb-4967-bbe6-ac5fee182bbc None None] Network 03979098-a904-494a-a852-b458bf7ca658 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:50.064037 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:50.168368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Pushing event deleted for resources: {'Port': ['ID=7c400b8e-f20d-492c-8fbd-a62e4dda2608,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:50.179824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 46992) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:50.210219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] No DVR routers for this DVR port 7c400b8e-f20d-492c-8fbd-a62e4dda2608 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:46:50.224210 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b69a15a-1497-43e9-a964-60052a80044b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:50.296607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b69a15a-1497-43e9-a964-60052a80044b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc21d87b-ac9d-47ee-bbfb-d1834c1cc3d1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:50.430608 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7c400b8e-f20d-492c-8fbd-a62e4dda2608 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:50.490065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 7c400b8e-f20d-492c-8fbd-a62e4dda2608 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:50.490643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7c400b8e-f20d-492c-8fbd-a62e4dda2608 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:50.532790 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b69a15a-1497-43e9-a964-60052a80044b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:50.533032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0f3b03ac-c5f9-478e-b929-a76c2224f49a None None] For port 7c400b8e-f20d-492c-8fbd-a62e4dda2608, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7c400b8e-f20d-492c-8fbd-a62e4dda2608,segment=NetworkSegment(61a4fe29-5447-4206-9944-48020c142c8a),segment_id=61a4fe29-5447-4206-9944-48020c142c8a)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:50.533594 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0f3b03ac-c5f9-478e-b929-a76c2224f49a None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:50.533929 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1b69a15a-1497-43e9-a964-60052a80044b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fc21d87b-ac9d-47ee-bbfb-d1834c1cc3d1 HTTP/1.1" status: 204 len: 168 time: 1.0942664 May 12 15:46:50.550772 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:50.616481 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2c1b8b45-6771-4a75-9b0a-7e599b2cab0a admin admin] Deleting port 0330d6b4-dcca-428b-884e-6ad77426f8da {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:50.616822 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c1b8b45-6771-4a75-9b0a-7e599b2cab0a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:50.732735 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:50.789524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0f3b03ac-c5f9-478e-b929-a76c2224f49a None None] Calling delete_port for 7c400b8e-f20d-492c-8fbd-a62e4dda2608 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:50.797908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0de89d0f-e308-41b4-8980-4fb156f3c79b']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:50.824541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '61a4fe29-5447-4206-9944-48020c142c8a') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:50.824892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '61a4fe29-5447-4206-9944-48020c142c8a') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:50.847974 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-21e41b7e-a639-4828-abfa-010be30a1239 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.6640153 May 12 15:46:50.858522 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:50.882374 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-942ff1aa-07ee-4179-9d13-39542b0d1044 req-33025210-4526-4122-aec2-f027e8003959 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:50.892299 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-942ff1aa-07ee-4179-9d13-39542b0d1044 req-33025210-4526-4122-aec2-f027e8003959 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.5678086 May 12 15:46:50.896951 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:50.924307 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:50.929672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-2c1b8b45-6771-4a75-9b0a-7e599b2cab0a admin admin] For port 0330d6b4-dcca-428b-884e-6ad77426f8da, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0330d6b4-dcca-428b-884e-6ad77426f8da,segment=NetworkSegment(384c5e83-6775-4f29-a4c7-08c3d60e1de8),segment_id=384c5e83-6775-4f29-a4c7-08c3d60e1de8)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:50.930501 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c1b8b45-6771-4a75-9b0a-7e599b2cab0a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:50.938279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting port 539a80f2-ef5d-4365-8999-6a2e51b5afc6 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:50.938676 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:50.965591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Releasing vlan 586 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:46:50.966000 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:51.017816 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-942ff1aa-07ee-4179-9d13-39542b0d1044 req-27a7c06b-1c80-4360-8c1b-da83c34dc49c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1239250 May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: timer() May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:46:51.018835 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:46:51.029849 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-0f3b03ac-c5f9-478e-b929-a76c2224f49a None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:46:51.030529 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-0f3b03ac-c5f9-478e-b929-a76c2224f49a None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:46:51.052255 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-63b6ceb2-b780-4822-83c1-4127ab9faf4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:46:45Z', 'revision_number': 7, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:51.057056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63b6ceb2-b780-4822-83c1-4127ab9faf4c None None] The sync data for ids ['943c296a-7f18-4231-8088-35f5348abd2b'] in n-d-841483-1 is: [{'id': '943c296a-7f18-4231-8088-35f5348abd2b', 'name': 'tempest-TestNetworkBasicOps-router-2055943104', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197'}], 'enable_snat': True}, 'gw_port_id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:43:15Z', 'updated_at': '2022-05-12T15:46:45Z', 'revision_number': 7, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '539a80f2-ef5d-4365-8999-6a2e51b5afc6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:2c:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '943c296a-7f18-4231-8088-35f5348abd2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3491, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:43:20Z', 'updated_at': '2022-05-12T15:44:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:46:51.141121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa018730-ef0e-4b75-86c7-cca90d1ab30f None None] DHCP port deletion for 03979098-a904-494a-a852-b458bf7ca658 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:46:51.145723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fa018730-ef0e-4b75-86c7-cca90d1ab30f None None] Deleting port f1e033f3-b048-470b-ac02-cd534e3f1483 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:51.146108 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa018730-ef0e-4b75-86c7-cca90d1ab30f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:51.211026 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2c1b8b45-6771-4a75-9b0a-7e599b2cab0a admin admin] Calling delete_port for 0330d6b4-dcca-428b-884e-6ad77426f8da owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:51.212905 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:51.259141 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:51.274837 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] Pushing event deleted for resources: {'Network': ['ID=0de89d0f-e308-41b4-8980-4fb156f3c79b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:51.288663 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a3564109-450c-4dea-a347-b9f3dee9fd0b admin admin] 10.222.0.82 "DELETE /v2.0/networks/0de89d0f-e308-41b4-8980-4fb156f3c79b HTTP/1.1" status: 204 len: 168 time: 2.1391416 May 12 15:46:51.289410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47022) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:51.549519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0f3b03ac-c5f9-478e-b929-a76c2224f49a None None] Deleting port 7c400b8e-f20d-492c-8fbd-a62e4dda2608 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:51.550035 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0f3b03ac-c5f9-478e-b929-a76c2224f49a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:51.748474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0f3b03ac-c5f9-478e-b929-a76c2224f49a None None] The port '7c400b8e-f20d-492c-8fbd-a62e4dda2608' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:46:51.751182 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c1b8b45-6771-4a75-9b0a-7e599b2cab0a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:51.804991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-fa018730-ef0e-4b75-86c7-cca90d1ab30f None None] For port f1e033f3-b048-470b-ac02-cd534e3f1483, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f1e033f3-b048-470b-ac02-cd534e3f1483,segment=NetworkSegment(0e218190-12cd-4c5d-a26e-6453816fe1e4),segment_id=0e218190-12cd-4c5d-a26e-6453816fe1e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:51.805778 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa018730-ef0e-4b75-86c7-cca90d1ab30f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:51.821774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] For port 539a80f2-ef5d-4365-8999-6a2e51b5afc6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=539a80f2-ef5d-4365-8999-6a2e51b5afc6,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:51.822194 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:51.979823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47042) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:52.083264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Calling delete_port for 539a80f2-ef5d-4365-8999-6a2e51b5afc6 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:52.098099 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fa018730-ef0e-4b75-86c7-cca90d1ab30f None None] Calling delete_port for f1e033f3-b048-470b-ac02-cd534e3f1483 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:52.166285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c1b8b45-6771-4a75-9b0a-7e599b2cab0a admin admin] Pushing event deleted for resources: {'Port': ['ID=0330d6b4-dcca-428b-884e-6ad77426f8da,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:52.304958 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fa018730-ef0e-4b75-86c7-cca90d1ab30f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:52.408048 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa018730-ef0e-4b75-86c7-cca90d1ab30f None None] Pushing event deleted for resources: {'Port': ['ID=f1e033f3-b048-470b-ac02-cd534e3f1483,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:52.411332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa018730-ef0e-4b75-86c7-cca90d1ab30f None None] No DVR routers for this DVR port f1e033f3-b048-470b-ac02-cd534e3f1483 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:46:52.432051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b17aae03-7398-47e4-a74b-02c858cbfbcf tempest-DvrRoutersNegativeTest-2141495121 tempest-DvrRoutersNegativeTest-2141495121-project] Request body: {'router': {'name': 'tempest-DvrRoutersNegativeTest-router-359471042', 'external_gateway_info': {}, 'admin_state_up': False, 'distributed': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:52.457412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.policy [None req-b17aae03-7398-47e4-a74b-02c858cbfbcf tempest-DvrRoutersNegativeTest-2141495121 tempest-DvrRoutersNegativeTest-2141495121-project] Enforcing rules: ['create_router', 'create_router:external_gateway_info', 'create_router:distributed'] {{(pid=88152) log_rule_list /opt/stack/neutron/neutron/policy.py:446}} May 12 15:46:52.457412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.policy [None req-b17aae03-7398-47e4-a74b-02c858cbfbcf tempest-DvrRoutersNegativeTest-2141495121 tempest-DvrRoutersNegativeTest-2141495121-project] Failed policy check for 'create_router' {{(pid=88152) enforce /opt/stack/neutron/neutron/policy.py:520}} May 12 15:46:52.457412 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-b17aae03-7398-47e4-a74b-02c858cbfbcf tempest-DvrRoutersNegativeTest-2141495121 tempest-DvrRoutersNegativeTest-2141495121-project] create failed (client error): Access was denied to this resource. May 12 15:46:52.458296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b17aae03-7398-47e4-a74b-02c858cbfbcf tempest-DvrRoutersNegativeTest-2141495121 tempest-DvrRoutersNegativeTest-2141495121-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 403 len: 414 time: 0.4775476 May 12 15:46:52.522898 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f1e033f3-b048-470b-ac02-cd534e3f1483 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:52.601322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: f1e033f3-b048-470b-ac02-cd534e3f1483 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:52.601688 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f1e033f3-b048-470b-ac02-cd534e3f1483 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:52.602965 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4c9c52d9-7be2-45c7-82f5-d4e254eec55f no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:52.660851 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80399c14-6543-4037-be91-5a7d5fe08c71 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:52.688209 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 4c9c52d9-7be2-45c7-82f5-d4e254eec55f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:52.688785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4c9c52d9-7be2-45c7-82f5-d4e254eec55f not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:52.743248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b155338-7a54-4aeb-8b6a-63b8c75fa62b req-30adb091-049d-4ebc-bbba-f775755c54b8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:52.751346 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b155338-7a54-4aeb-8b6a-63b8c75fa62b req-30adb091-049d-4ebc-bbba-f775755c54b8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.3746932 May 12 15:46:52.896477 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b155338-7a54-4aeb-8b6a-63b8c75fa62b req-f5038912-3615-4854-8250-b6d098059516 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1441677 May 12 15:46:53.033468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47062) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:53.183230 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2c1b8b45-6771-4a75-9b0a-7e599b2cab0a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:53.224245 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4f4ffaba-ccb8-4077-8884-b65429d2a3f2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:53.250052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4f4ffaba-ccb8-4077-8884-b65429d2a3f2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:53.257712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4f4ffaba-ccb8-4077-8884-b65429d2a3f2 admin admin] Usage tracker for resource:security_group_rule and tenant:09cf9231d3fd4e9494b1621f55b7fb69 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:53.260805 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-80399c14-6543-4037-be91-5a7d5fe08c71 admin admin] Deleting port edccd307-5544-482d-92bc-4a31eeb6ca92 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:53.261345 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80399c14-6543-4037-be91-5a7d5fe08c71 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:53.305004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4f4ffaba-ccb8-4077-8884-b65429d2a3f2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:53.311008 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:53.319079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4f4ffaba-ccb8-4077-8884-b65429d2a3f2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:53.449092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-85ab04d7-9d9f-46f3-8892-cf4fabe62898 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:53.451189 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-85ab04d7-9d9f-46f3-8892-cf4fabe62898 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 1096 time: 0.3462665 May 12 15:46:53.452982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Port': ['ID=539a80f2-ef5d-4365-8999-6a2e51b5afc6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:53.500900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-80399c14-6543-4037-be91-5a7d5fe08c71 admin admin] For port edccd307-5544-482d-92bc-4a31eeb6ca92, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=edccd307-5544-482d-92bc-4a31eeb6ca92,segment=NetworkSegment(40a24c29-7ea4-4fc4-b95a-63eec4b86204),segment_id=40a24c29-7ea4-4fc4-b95a-63eec4b86204)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:53.501521 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80399c14-6543-4037-be91-5a7d5fe08c71 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:53.731040 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:53.784741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-80399c14-6543-4037-be91-5a7d5fe08c71 admin admin] Calling delete_port for edccd307-5544-482d-92bc-4a31eeb6ca92 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:53.850516 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4f4ffaba-ccb8-4077-8884-b65429d2a3f2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:53.861836 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4f4ffaba-ccb8-4077-8884-b65429d2a3f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:53.929753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f4ffaba-ccb8-4077-8884-b65429d2a3f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48566f7b-7eb1-4914-bc06-229c31c01df2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:53.939546 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4f4ffaba-ccb8-4077-8884-b65429d2a3f2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=09cf9231d3fd4e9494b1621f55b7fb69&name=default HTTP/1.1" status: 200 len: 2983 time: 0.9008906 May 12 15:46:53.939546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47078) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:54.022599 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04e843e2-42e3-4364-9131-c23fd1c610c0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:54.049916 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04e843e2-42e3-4364-9131-c23fd1c610c0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:54.163722 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:54.167444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:54.180284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-e9d365b2-1d35-4631-8ecf-f7c4e17a1285 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:54.181749 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-e9d365b2-1d35-4631-8ecf-f7c4e17a1285 service neutron] 10.222.0.84 "GET /v2.0/networks?id=96b03b8b-8b48-4742-a456-9d456e030e73 HTTP/1.1" status: 200 len: 897 time: 0.7184467 May 12 15:46:54.228335 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80399c14-6543-4037-be91-5a7d5fe08c71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:54.283148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c1b8b45-6771-4a75-9b0a-7e599b2cab0a admin admin] Router 90b1ce02-50a9-42ff-913c-e1db00f64560 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:46:54.301863 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04e843e2-42e3-4364-9131-c23fd1c610c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:54.304395 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:54.304855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Fanout notify agent at l3_agent the message router_deleted on router 943c296a-7f18-4231-8088-35f5348abd2b {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:46:54.336450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80399c14-6543-4037-be91-5a7d5fe08c71 admin admin] Pushing event deleted for resources: {'Port': ['ID=edccd307-5544-482d-92bc-4a31eeb6ca92,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:54.373578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04e843e2-42e3-4364-9131-c23fd1c610c0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48566f7b-7eb1-4914-bc06-229c31c01df2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:54.395348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eea7ad6-8361-4605-8a5a-cf2cc555ee93 req-e7148a56-4a4d-4d2c-bd39-661bb6632a8a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:54.397575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6eea7ad6-8361-4605-8a5a-cf2cc555ee93 req-e7148a56-4a4d-4d2c-bd39-661bb6632a8a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.3098562 May 12 15:46:54.524951 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-04e843e2-42e3-4364-9131-c23fd1c610c0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:54.528962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-04e843e2-42e3-4364-9131-c23fd1c610c0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/48566f7b-7eb1-4914-bc06-229c31c01df2 HTTP/1.1" status: 204 len: 168 time: 0.5858233 May 12 15:46:54.571067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6eea7ad6-8361-4605-8a5a-cf2cc555ee93 req-f41ab342-9995-45a6-8b57-29270cbb079f tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1438253 May 12 15:46:54.590947 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:54.594017 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-295fba1f-7138-4d33-b636-2449844a87cc tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "DELETE /v2.0/routers/943c296a-7f18-4231-8088-35f5348abd2b HTTP/1.1" status: 204 len: 168 time: 4.6053829 May 12 15:46:54.595222 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47084) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:54.604454 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-6a01e137-c08b-43e3-b7c7-01c2f206992c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 HTTP/1.1" status: 200 len: 1000 time: 0.4145460 May 12 15:46:54.783452 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-80399c14-6543-4037-be91-5a7d5fe08c71 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:54.938225 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5937c1d-a85d-4b45-826e-66fafd1dfbac tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:55.005438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c1b8b45-6771-4a75-9b0a-7e599b2cab0a admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:46:55.013982 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2c1b8b45-6771-4a75-9b0a-7e599b2cab0a admin admin] 10.222.0.82 "PUT /v2.0/routers/90b1ce02-50a9-42ff-913c-e1db00f64560/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.1329834 May 12 15:46:55.017427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47096) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:55.023690 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83c1a007-2dd8-4ce4-9aae-8c7ea315bc86 None None] Sync routers for ids ['90b1ce02-50a9-42ff-913c-e1db00f64560'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:46:55.039667 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83c1a007-2dd8-4ce4-9aae-8c7ea315bc86 None None] Routers {'90b1ce02-50a9-42ff-913c-e1db00f64560'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:55.041004 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-83c1a007-2dd8-4ce4-9aae-8c7ea315bc86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['90b1ce02-50a9-42ff-913c-e1db00f64560'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:55.221687 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:55.316072 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-83c1a007-2dd8-4ce4-9aae-8c7ea315bc86 None None] Set router 90b1ce02-50a9-42ff-913c-e1db00f64560 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:55.448635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-80399c14-6543-4037-be91-5a7d5fe08c71 admin admin] Router bc5f0aa5-db22-4d81-afb5-d90c21590056 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:46:55.507980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-beff79ec-d48b-4ef7-89c7-e4a68c357cae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:55.509435 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-beff79ec-d48b-4ef7-89c7-e4a68c357cae service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7ee4997d-d763-4a38-bf54-c1153ac3e51c HTTP/1.1" status: 200 len: 834 time: 0.5959260 May 12 15:46:55.673792 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5937c1d-a85d-4b45-826e-66fafd1dfbac tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:55.720458 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:55.727692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f5937c1d-a85d-4b45-826e-66fafd1dfbac tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['03979098-a904-494a-a852-b458bf7ca658']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:55.746621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f5937c1d-a85d-4b45-826e-66fafd1dfbac tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0e218190-12cd-4c5d-a26e-6453816fe1e4') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:55.746997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-f5937c1d-a85d-4b45-826e-66fafd1dfbac tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0e218190-12cd-4c5d-a26e-6453816fe1e4') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:55.760592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] Deleting port ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:55.761036 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:55.795610 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5937c1d-a85d-4b45-826e-66fafd1dfbac tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:55.824164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47114) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:55.852768 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5937c1d-a85d-4b45-826e-66fafd1dfbac tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:55.874650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f5937c1d-a85d-4b45-826e-66fafd1dfbac tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Releasing vlan 585 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:46:55.876004 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5937c1d-a85d-4b45-826e-66fafd1dfbac tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:55.881815 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-83c1a007-2dd8-4ce4-9aae-8c7ea315bc86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241'}], 'enable_snat': True}, 'gw_port_id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:46:51Z', 'revision_number': 5, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port': {'id': 'ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:29:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3187, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:39:58Z', 'updated_at': '2022-05-12T15:40:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:55.886199 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83c1a007-2dd8-4ce4-9aae-8c7ea315bc86 None None] Checking router: 90b1ce02-50a9-42ff-913c-e1db00f64560 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:46:55.897337 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83c1a007-2dd8-4ce4-9aae-8c7ea315bc86 None None] Routers {'90b1ce02-50a9-42ff-913c-e1db00f64560'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:55.898083 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-83c1a007-2dd8-4ce4-9aae-8c7ea315bc86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['90b1ce02-50a9-42ff-913c-e1db00f64560'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: timer() May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:46:55.907928 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:46:56.043391 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-80399c14-6543-4037-be91-5a7d5fe08c71 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:46:56.049516 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-80399c14-6543-4037-be91-5a7d5fe08c71 admin admin] 10.222.0.82 "PUT /v2.0/routers/bc5f0aa5-db22-4d81-afb5-d90c21590056/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.7571387 May 12 15:46:56.059944 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d6cf954-b935-4168-8433-ca12315cf616 None None] Sync routers for ids ['bc5f0aa5-db22-4d81-afb5-d90c21590056'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:46:56.068704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47124) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:56.079964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d6cf954-b935-4168-8433-ca12315cf616 None None] Routers {'bc5f0aa5-db22-4d81-afb5-d90c21590056'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:56.080586 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-2d6cf954-b935-4168-8433-ca12315cf616 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bc5f0aa5-db22-4d81-afb5-d90c21590056'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:56.085182 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-83c1a007-2dd8-4ce4-9aae-8c7ea315bc86 None None] Set router 90b1ce02-50a9-42ff-913c-e1db00f64560 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:56.206620 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-83c1a007-2dd8-4ce4-9aae-8c7ea315bc86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:46:55Z', 'revision_number': 6, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:56.211075 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83c1a007-2dd8-4ce4-9aae-8c7ea315bc86 None None] The sync data for ids ['90b1ce02-50a9-42ff-913c-e1db00f64560'] in n-d-841483-1 is: [{'id': '90b1ce02-50a9-42ff-913c-e1db00f64560', 'name': 'tempest-TestVolumeBackupRestore-424444605-router', 'tenant_id': '0528307b42774c45be9eba4ffc91c8dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:39:56Z', 'updated_at': '2022-05-12T15:46:55Z', 'revision_number': 6, 'project_id': '0528307b42774c45be9eba4ffc91c8dd', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:46:56.243530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-004bc3ca-5b0c-4ff8-94b6-c91f7c0724bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:56.248079 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-004bc3ca-5b0c-4ff8-94b6-c91f7c0724bb service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=96b03b8b-8b48-4742-a456-9d456e030e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.7132335 May 12 15:46:56.260485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group': {'name': 'tempest-secgroup--973195478'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:56.265790 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c4a2030-fa30-4028-9d4e-f6c7f0c9f09c req-070941cd-f125-4e0f-9433-38ddcd6a0912 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:56.273323 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c4a2030-fa30-4028-9d4e-f6c7f0c9f09c req-070941cd-f125-4e0f-9433-38ddcd6a0912 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.3843534 May 12 15:46:56.401003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:56.411736 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c4a2030-fa30-4028-9d4e-f6c7f0c9f09c req-15365452-3d94-4640-91d8-5b8766b5ebbb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1372533 May 12 15:46:56.439578 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:56.464847 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5937c1d-a85d-4b45-826e-66fafd1dfbac tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:56.471833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] For port ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:56.472251 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:56.480903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:56.486120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-2d6cf954-b935-4168-8433-ca12315cf616 None None] Set router bc5f0aa5-db22-4d81-afb5-d90c21590056 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:56.560276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:56.564092 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5937c1d-a85d-4b45-826e-66fafd1dfbac tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:56.660149 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:56.692097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] Deleting port e66a483c-259d-4247-bb93-8082176ad6ed {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:56.692452 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:56.698985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0330d6b4-dcca-428b-884e-6ad77426f8da no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:56.747121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 0330d6b4-dcca-428b-884e-6ad77426f8da {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:56.747712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0330d6b4-dcca-428b-884e-6ad77426f8da not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:56.748268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 539a80f2-ef5d-4365-8999-6a2e51b5afc6 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:56.781323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:56.809454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] Calling delete_port for ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:56.881039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 539a80f2-ef5d-4365-8999-6a2e51b5afc6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:56.881298 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 539a80f2-ef5d-4365-8999-6a2e51b5afc6 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:56.935232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] For port e66a483c-259d-4247-bb93-8082176ad6ed, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e66a483c-259d-4247-bb93-8082176ad6ed,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:56.935845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:57.018476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5937c1d-a85d-4b45-826e-66fafd1dfbac tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Network': ['ID=03979098-a904-494a-a852-b458bf7ca658,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:57.036168 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f5937c1d-a85d-4b45-826e-66fafd1dfbac tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "DELETE /v2.0/networks/03979098-a904-494a-a852-b458bf7ca658 HTTP/1.1" status: 204 len: 168 time: 2.4366989 May 12 15:46:57.086686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47130) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:57.095636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-2d6cf954-b935-4168-8433-ca12315cf616 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'name': 'tempest-TestServerMultinode-1726459329-router', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215'}], 'enable_snat': True}, 'gw_port_id': 'e66a483c-259d-4247-bb93-8082176ad6ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:14Z', 'updated_at': '2022-05-12T15:46:54Z', 'revision_number': 5, 'project_id': '5b43e848e2af491a8dc509c668c33e91', 'gw_port': {'id': 'e66a483c-259d-4247-bb93-8082176ad6ed', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:f0:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3633, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:17Z', 'updated_at': '2022-05-12T15:45:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:57.102331 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d6cf954-b935-4168-8433-ca12315cf616 None None] Checking router: bc5f0aa5-db22-4d81-afb5-d90c21590056 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:46:57.104514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'network': {'name': 'tempest-network-smoke--844948942', 'project_id': 'b641518781114418963451fc3ff58f4d', 'port_security_enabled': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:57.113168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] Calling delete_port for e66a483c-259d-4247-bb93-8082176ad6ed owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:46:57.114787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d6cf954-b935-4168-8433-ca12315cf616 None None] Routers {'bc5f0aa5-db22-4d81-afb5-d90c21590056'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:46:57.115667 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-2d6cf954-b935-4168-8433-ca12315cf616 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['bc5f0aa5-db22-4d81-afb5-d90c21590056'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:57.122091 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:57.170605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:57.313426 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:57.324770 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:57.328685 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:network and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:57.335374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:57.365758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:57.376437 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-82867c53-b9aa-4090-a4a3-9c37420fcbf6 service neutron] 10.222.0.84 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0281706 May 12 15:46:57.377495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:57.385849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:57.405003 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-2d6cf954-b935-4168-8433-ca12315cf616 None None] Set router bc5f0aa5-db22-4d81-afb5-d90c21590056 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:46:57.417836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:57.423658 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:57.468934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Made reservation on behalf of b641518781114418963451fc3ff58f4d for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:46:57.472406 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:57.552558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:57.553989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] Pushing event deleted for resources: {'Port': ['ID=e66a483c-259d-4247-bb93-8082176ad6ed,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:57.571750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-2d6cf954-b935-4168-8433-ca12315cf616 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'name': 'tempest-TestServerMultinode-1726459329-router', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:14Z', 'updated_at': '2022-05-12T15:46:56Z', 'revision_number': 6, 'project_id': '5b43e848e2af491a8dc509c668c33e91', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:46:57.584268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d6cf954-b935-4168-8433-ca12315cf616 None None] The sync data for ids ['bc5f0aa5-db22-4d81-afb5-d90c21590056'] in n-d-841483-1 is: [{'id': 'bc5f0aa5-db22-4d81-afb5-d90c21590056', 'name': 'tempest-TestServerMultinode-1726459329-router', 'tenant_id': '5b43e848e2af491a8dc509c668c33e91', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:14Z', 'updated_at': '2022-05-12T15:46:56Z', 'revision_number': 6, 'project_id': '5b43e848e2af491a8dc509c668c33e91', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:46:57.624086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] Pushing event deleted for resources: {'Port': ['ID=ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:57.704750 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:57.717279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 559} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:46:57.761728 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:57.762070 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Added segment 384ff5b9-795f-4199-b25d-4d1f08782bc8 of type vlan for network 27a3a31e-244b-4431-86b4-73b53f4f0c89 May 12 15:46:57.772475 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-bcb94a7a-6b8a-4962-a5ea-7b11eee81cd5 service neutron] 10.222.0.84 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3834717 May 12 15:46:57.775993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.006452 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.015915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.020787 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.070377 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.073051 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.083490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b9d437-c5d7-43c5-9981-13be7410dc0e req-fc2aa4ff-c7ab-4b35-93a1-ee40768df791 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:58.090429 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02b9d437-c5d7-43c5-9981-13be7410dc0e req-fc2aa4ff-c7ab-4b35-93a1-ee40768df791 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.4805188 May 12 15:46:58.115541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.135603 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.136149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] Fanout notify agent at l3_agent the message router_deleted on router 90b1ce02-50a9-42ff-913c-e1db00f64560 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:46:58.137831 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.155788 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02b9d437-c5d7-43c5-9981-13be7410dc0e req-4c95241c-c184-4d32-a9a5-5eb7cfd74b13 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0637801 May 12 15:46:58.158451 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.158595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:58.159034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] Fanout notify agent at l3_agent the message router_deleted on router bc5f0aa5-db22-4d81-afb5-d90c21590056 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:46:58.163635 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.173220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:58.173967 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.179396 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.183137 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-759a11ca-4b9f-4822-9038-81cf582c905d admin admin] 10.222.0.82 "DELETE /v2.0/routers/bc5f0aa5-db22-4d81-afb5-d90c21590056 HTTP/1.1" status: 204 len: 168 time: 2.1133223 May 12 15:46:58.183792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47138) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:58.202338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:58.211415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:58.229249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:58.261459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-1f3d27db-888b-4abc-ad0b-72cff1930093 admin admin] Deleting subnet a02117db-ebdf-49e4-8844-4ca414de801d {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:46:58.264834 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1f3d27db-888b-4abc-ad0b-72cff1930093 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.330642 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1f3d27db-888b-4abc-ad0b-72cff1930093 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.332966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroup': ['ID=92efa66b-463e-4234-86d5-3667cce0702c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:58.344611 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.345335 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-eaadb5fb-4ff6-4f43-8c00-6adde9d576dc admin admin] 10.222.0.82 "DELETE /v2.0/routers/90b1ce02-50a9-42ff-913c-e1db00f64560 HTTP/1.1" status: 204 len: 168 time: 3.3272426 May 12 15:46:58.350396 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47142) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:58.365750 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 1.2755842 May 12 15:46:58.373930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47146) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:58.383541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'admin_state_up': True, 'project_id': 'b641518781114418963451fc3ff58f4d', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:58.398759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:46:58.403152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f0031b6-1904-40b2-bfb5-f8c7d1711985 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Network': ['ID=27a3a31e-244b-4431-86b4-73b53f4f0c89,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:58.405991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:router and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:46:58.410447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:46:58.420044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:46:58.420486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 27a3a31e-244b-4431-86b4-73b53f4f0c89 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:46:58.440703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.443044 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.467736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-08a2391f-75de-43a2-964f-19098439ee3c admin admin] Deleting subnet 5b4ef35a-b116-4246-86c9-ff3a7aad3410 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:46:58.473021 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08a2391f-75de-43a2-964f-19098439ee3c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.485980 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.513510 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1f3d27db-888b-4abc-ad0b-72cff1930093 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.571756 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.584980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08a2391f-75de-43a2-964f-19098439ee3c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.627350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:58.672344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:58.672735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ec0fc28c-0f0f-4f2d-bd00-72efe1e4215c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:58.673157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e66a483c-259d-4247-bb93-8082176ad6ed no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:58.698499 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.708645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: e66a483c-259d-4247-bb93-8082176ad6ed {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:58.709220 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e66a483c-259d-4247-bb93-8082176ad6ed not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:58.709798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device edccd307-5544-482d-92bc-4a31eeb6ca92 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:46:58.754782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: edccd307-5544-482d-92bc-4a31eeb6ca92 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:46:58.755380 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device edccd307-5544-482d-92bc-4a31eeb6ca92 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:46:58.766489 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08a2391f-75de-43a2-964f-19098439ee3c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.811051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroup': ['ID=be9ab150-c556-44a7-a16f-07782984c7bf,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:58.816921 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.818372 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e5faac8e-2849-4f16-92c7-0813a47a0068 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 2.9906561 May 12 15:46:58.822810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47152) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:58.908563 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08a2391f-75de-43a2-964f-19098439ee3c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.950285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cfa82e4b-c661-4d94-ab5b-c4d1e23f2ae1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:46:58.954426 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ba9e346-dfc7-4bef-bf80-731f30480c7a None None] Network 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:58.958415 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08a2391f-75de-43a2-964f-19098439ee3c admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:58.965823 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-08a2391f-75de-43a2-964f-19098439ee3c admin admin] 10.222.0.82 "DELETE /v2.0/subnets/5b4ef35a-b116-4246-86c9-ff3a7aad3410 HTTP/1.1" status: 204 len: 168 time: 0.6074264 May 12 15:46:58.971999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47156) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:58.978912 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08a2391f-75de-43a2-964f-19098439ee3c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5b4ef35a-b116-4246-86c9-ff3a7aad3410,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:59.002939 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.034591 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1f3d27db-888b-4abc-ad0b-72cff1930093 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.078251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cfa82e4b-c661-4d94-ab5b-c4d1e23f2ae1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:46:59.079591 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cfa82e4b-c661-4d94-ab5b-c4d1e23f2ae1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4510 time: 0.2554142 May 12 15:46:59.085130 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1f3d27db-888b-4abc-ad0b-72cff1930093 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.091008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47160) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:59.091378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f3d27db-888b-4abc-ad0b-72cff1930093 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a02117db-ebdf-49e4-8844-4ca414de801d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:59.095361 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5addcd8-95e9-4cef-855b-5653180e6fae None None] Network efb0a87e-f691-44d4-91fd-6973427a3bed requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:46:59.099476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-19631465-9433-4282-8b21-7ef5d74aa364 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group': {'name': 'tempest-security--954305293', 'description': 'tempest-security-description-1006420559'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:46:59.105704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1f3d27db-888b-4abc-ad0b-72cff1930093 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/a02117db-ebdf-49e4-8844-4ca414de801d HTTP/1.1" status: 204 len: 168 time: 0.9187791 May 12 15:46:59.112539 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47164) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:59.476039 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.496652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4a3acea-ca60-493b-a7b8-e20642c20bc3 None None] DHCP port deletion for 8fe69ccc-2df6-4e6d-ad35-1b9439b8eade request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:46:59.502904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b4a3acea-ca60-493b-a7b8-e20642c20bc3 None None] Deleting port cbf462b6-153c-4279-b379-047c97c981f7 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:59.503280 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b4a3acea-ca60-493b-a7b8-e20642c20bc3 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.515592 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.517318 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19631465-9433-4282-8b21-7ef5d74aa364 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.591411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-876a6d72-d64a-47f1-b6e7-ebb091a0b824 None None] DHCP port deletion for efb0a87e-f691-44d4-91fd-6973427a3bed request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:46:59.610475 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19631465-9433-4282-8b21-7ef5d74aa364 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.612140 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-876a6d72-d64a-47f1-b6e7-ebb091a0b824 None None] Deleting port 674557b5-63cc-40e5-bc60-af4e475b92d6 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:59.612640 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-876a6d72-d64a-47f1-b6e7-ebb091a0b824 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.623498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-707e1beb-f92c-4845-a673-6611de809aea req-46c1d591-a0a1-4a2c-ba47-99ac81c15ac2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:46:59.626110 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-707e1beb-f92c-4845-a673-6611de809aea req-46c1d591-a0a1-4a2c-ba47-99ac81c15ac2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.2020068 May 12 15:46:59.685058 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.707479 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19631465-9433-4282-8b21-7ef5d74aa364 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.710221 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19631465-9433-4282-8b21-7ef5d74aa364 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.711145 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-19631465-9433-4282-8b21-7ef5d74aa364 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "PUT /v2.0/security-groups/be9ab150-c556-44a7-a16f-07782984c7bf HTTP/1.1" status: 200 len: 1779 time: 0.6190758 May 12 15:46:59.723419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47172) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:46:59.732051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Deleting port cbf462b6-153c-4279-b379-047c97c981f7 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:59.732396 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.746586 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-707e1beb-f92c-4845-a673-6611de809aea req-2e62bd39-207a-4b1d-b47b-2af5ee0da5df tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1112289 May 12 15:46:59.776641 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.789849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Allocated IP 172.25.8.87 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/0b130198-953d-4f1e-95d3-4d8791331284) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:46:59.844231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Deleting port 674557b5-63cc-40e5-bc60-af4e475b92d6 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:46:59.844572 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:46:59.948401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19631465-9433-4282-8b21-7ef5d74aa364 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroup': ['ID=be9ab150-c556-44a7-a16f-07782984c7bf,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:46:59.961066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-876a6d72-d64a-47f1-b6e7-ebb091a0b824 None None] For port 674557b5-63cc-40e5-bc60-af4e475b92d6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=674557b5-63cc-40e5-bc60-af4e475b92d6,segment=NetworkSegment(40a24c29-7ea4-4fc4-b95a-63eec4b86204),segment_id=40a24c29-7ea4-4fc4-b95a-63eec4b86204)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:46:59.963263 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-876a6d72-d64a-47f1-b6e7-ebb091a0b824 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.070766 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-173b5ee5-8bc5-4d20-9f26-57fbcbcff76d tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-groups/be9ab150-c556-44a7-a16f-07782984c7bf HTTP/1.1" status: 200 len: 1779 time: 0.3409221 May 12 15:47:00.073695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47180) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:00.137307 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.150592 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47184) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:00.162104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-876a6d72-d64a-47f1-b6e7-ebb091a0b824 None None] Calling delete_port for 674557b5-63cc-40e5-bc60-af4e475b92d6 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:47:00.182611 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.227896 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b4a3acea-ca60-493b-a7b8-e20642c20bc3 None None] For port cbf462b6-153c-4279-b379-047c97c981f7, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cbf462b6-153c-4279-b379-047c97c981f7,segment=NetworkSegment(384c5e83-6775-4f29-a4c7-08c3d60e1de8),segment_id=384c5e83-6775-4f29-a4c7-08c3d60e1de8)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:00.228603 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b4a3acea-ca60-493b-a7b8-e20642c20bc3 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.316622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:47:00.324525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:47:00.332622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:47:00.349562 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79780437-2855-48db-89e6-e2c0df1551c3 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.352931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] For port 674557b5-63cc-40e5-bc60-af4e475b92d6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=674557b5-63cc-40e5-bc60-af4e475b92d6,segment=NetworkSegment(40a24c29-7ea4-4fc4-b95a-63eec4b86204),segment_id=40a24c29-7ea4-4fc4-b95a-63eec4b86204)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:00.353278 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.373026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b4a3acea-ca60-493b-a7b8-e20642c20bc3 None None] Calling delete_port for cbf462b6-153c-4279-b379-047c97c981f7 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:47:00.389839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] For port cbf462b6-153c-4279-b379-047c97c981f7, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cbf462b6-153c-4279-b379-047c97c981f7,segment=NetworkSegment(384c5e83-6775-4f29-a4c7-08c3d60e1de8),segment_id=384c5e83-6775-4f29-a4c7-08c3d60e1de8)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:00.390203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.399441 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-64e6a19d-4f19-49f2-93a2-69502971ece2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.431469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=0b130198-953d-4f1e-95d3-4d8791331284,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:00.435724 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-64e6a19d-4f19-49f2-93a2-69502971ece2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:00.442768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-64e6a19d-4f19-49f2-93a2-69502971ece2 admin admin] Usage tracker for resource:security_group_rule and tenant:fbeb5943497849ccb5c12379dcc3f4d2 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:00.445283 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cbf462b6-153c-4279-b379-047c97c981f7 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:47:00.447095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-64e6a19d-4f19-49f2-93a2-69502971ece2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:00.455995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-64e6a19d-4f19-49f2-93a2-69502971ece2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:00.488928 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-876a6d72-d64a-47f1-b6e7-ebb091a0b824 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.518191 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79780437-2855-48db-89e6-e2c0df1551c3 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.532403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Calling delete_port for 674557b5-63cc-40e5-bc60-af4e475b92d6 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:47:00.552075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-876a6d72-d64a-47f1-b6e7-ebb091a0b824 None None] Pushing event deleted for resources: {'Port': ['ID=674557b5-63cc-40e5-bc60-af4e475b92d6,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:00.578756 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-876a6d72-d64a-47f1-b6e7-ebb091a0b824 None None] No DVR routers for this DVR port 674557b5-63cc-40e5-bc60-af4e475b92d6 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:47:00.652249 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b4a3acea-ca60-493b-a7b8-e20642c20bc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.687672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Calling delete_port for cbf462b6-153c-4279-b379-047c97c981f7 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:47:00.708617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4a3acea-ca60-493b-a7b8-e20642c20bc3 None None] Pushing event deleted for resources: {'Port': ['ID=cbf462b6-153c-4279-b379-047c97c981f7,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:00.714313 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.725152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4a3acea-ca60-493b-a7b8-e20642c20bc3 None None] No DVR routers for this DVR port cbf462b6-153c-4279-b379-047c97c981f7 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:47:00.793158 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 674557b5-63cc-40e5-bc60-af4e475b92d6 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:47:00.809700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79780437-2855-48db-89e6-e2c0df1551c3 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.835389 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 674557b5-63cc-40e5-bc60-af4e475b92d6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:47:00.835721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 674557b5-63cc-40e5-bc60-af4e475b92d6 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:47:00.838673 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:47:00.839079 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:47:00.839717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79780437-2855-48db-89e6-e2c0df1551c3 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=be9ab150-c556-44a7-a16f-07782984c7bf,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:00.843974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.db.api [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88151) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:47:00.844278 n-d-841483-1 neutron-server[88151]: DEBUG oslo_db.api [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:47:00.844982 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79780437-2855-48db-89e6-e2c0df1551c3 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.848268 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-79780437-2855-48db-89e6-e2c0df1551c3 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-groups/be9ab150-c556-44a7-a16f-07782984c7bf HTTP/1.1" status: 204 len: 168 time: 0.7694459 May 12 15:47:00.848493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47192) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:00.854064 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-64e6a19d-4f19-49f2-93a2-69502971ece2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.868751 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-64e6a19d-4f19-49f2-93a2-69502971ece2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.912952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0ade4b15-5a43-4105-af05-de01616a7fc4 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:00.928849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0ade4b15-5a43-4105-af05-de01616a7fc4 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:00.930194 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0ade4b15-5a43-4105-af05-de01616a7fc4 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.0808213 May 12 15:47:00.933422 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-64e6a19d-4f19-49f2-93a2-69502971ece2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=fbeb5943497849ccb5c12379dcc3f4d2&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7791100 May 12 15:47:00.933552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47196) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:00.933552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47198) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:00.962503 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [None req-b55e2e4c-f89e-4feb-b278-610fc1c9374e tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] delete failed (client error): The resource could not be found. May 12 15:47:00.963467 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b55e2e4c-f89e-4feb-b278-610fc1c9374e tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-groups/be9ab150-c556-44a7-a16f-07782984c7bf HTTP/1.1" status: 404 len: 347 time: 0.0290754 May 12 15:47:00.968768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47204) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:00.986289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64e6a19d-4f19-49f2-93a2-69502971ece2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=508b17f0-8166-4869-8019-6d5df90df0a9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:00.986756 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ab7efae9-79c4-4a65-9aee-2b2365ff5d75 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group': {'name': 'tempest-secgroup--571213536'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:00.993220 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:00.996035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ab7efae9-79c4-4a65-9aee-2b2365ff5d75 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:01.017044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ab7efae9-79c4-4a65-9aee-2b2365ff5d75 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:01.040284 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab7efae9-79c4-4a65-9aee-2b2365ff5d75 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.050973 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e9a941f0-3161-4175-9491-f1bdcebd989e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.078463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ab7efae9-79c4-4a65-9aee-2b2365ff5d75 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:01.086425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ab7efae9-79c4-4a65-9aee-2b2365ff5d75 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:01.089879 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e9a941f0-3161-4175-9491-f1bdcebd989e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.096697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ab7efae9-79c4-4a65-9aee-2b2365ff5d75 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:01.105063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ab7efae9-79c4-4a65-9aee-2b2365ff5d75 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:01.184082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ed115f0-4157-4626-90ba-6820e84e1cd5 req-ef31fd12-df0d-4b9b-aa00-b78a91ba4f80 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:01.185561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ed115f0-4157-4626-90ba-6820e84e1cd5 req-ef31fd12-df0d-4b9b-aa00-b78a91ba4f80 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.2519653 May 12 15:47:01.187659 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e9a941f0-3161-4175-9491-f1bdcebd989e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.212670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9a941f0-3161-4175-9491-f1bdcebd989e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=508b17f0-8166-4869-8019-6d5df90df0a9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:01.224922 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab7efae9-79c4-4a65-9aee-2b2365ff5d75 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.236663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab7efae9-79c4-4a65-9aee-2b2365ff5d75 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.290146 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab7efae9-79c4-4a65-9aee-2b2365ff5d75 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.294400 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ab7efae9-79c4-4a65-9aee-2b2365ff5d75 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 0.3157864 May 12 15:47:01.294400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47208) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:01.297244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab7efae9-79c4-4a65-9aee-2b2365ff5d75 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroup': ['ID=28c875b6-a402-4d9f-9a5d-a33113824975,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:01.299920 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e9a941f0-3161-4175-9491-f1bdcebd989e admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.303808 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e9a941f0-3161-4175-9491-f1bdcebd989e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/508b17f0-8166-4869-8019-6d5df90df0a9 HTTP/1.1" status: 204 len: 168 time: 0.3650866 May 12 15:47:01.314592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c3c90608-56b8-47b1-8f44-1fa1019a3c3b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group_rule': {'security_group_id': '28c875b6-a402-4d9f-9a5d-a33113824975', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:01.321289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c3c90608-56b8-47b1-8f44-1fa1019a3c3b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:01.325205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c3c90608-56b8-47b1-8f44-1fa1019a3c3b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:01.328300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c3c90608-56b8-47b1-8f44-1fa1019a3c3b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:01.334061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c3c90608-56b8-47b1-8f44-1fa1019a3c3b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:01.340799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Deleting port 674557b5-63cc-40e5-bc60-af4e475b92d6 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:47:01.341132 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.373935 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Deleting port cbf462b6-153c-4279-b379-047c97c981f7 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:47:01.374502 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.375619 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7ed115f0-4157-4626-90ba-6820e84e1cd5 req-e05d714b-d342-4716-80fe-f22c9a197149 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1822927 May 12 15:47:01.409686 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.602681 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3c90608-56b8-47b1-8f44-1fa1019a3c3b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.616355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] The port '674557b5-63cc-40e5-bc60-af4e475b92d6' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:47:01.621191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] The port 'cbf462b6-153c-4279-b379-047c97c981f7' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:47:01.632206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Router c5f7aaa9-0739-4d05-b072-f7db2111e5ba is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:47:01.880081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.907930 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.924930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8fe69ccc-2df6-4e6d-ad35-1b9439b8eade']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:01.953074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:47:01.956278 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3c90608-56b8-47b1-8f44-1fa1019a3c3b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.959700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '384c5e83-6775-4f29-a4c7-08c3d60e1de8') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:01.959997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '384c5e83-6775-4f29-a4c7-08c3d60e1de8') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:01.967367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['efb0a87e-f691-44d4-91fd-6973427a3bed']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:01.972508 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Sync routers for ids ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:47:01.985836 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3c90608-56b8-47b1-8f44-1fa1019a3c3b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.988601 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Routers {'c5f7aaa9-0739-4d05-b072-f7db2111e5ba'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:47:01.989656 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:01.990448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '40a24c29-7ea4-4fc4-b95a-63eec4b86204') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:01.990742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '40a24c29-7ea4-4fc4-b95a-63eec4b86204') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:01.992753 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:01.998562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ad044d6b-2487-4203-84a4-7a05afe36a41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 3.6233921 May 12 15:47:02.000598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47232) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:02.008411 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.027325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.043787 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3c90608-56b8-47b1-8f44-1fa1019a3c3b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3a667e6d-120c-4d74-a7c2-48472fa2aa04,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:02.060380 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.063978 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.069987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4a0bd26f-c2b0-44df-b15d-f4ac754ce66b tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=b641518781114418963451fc3ff58f4d&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0647075 May 12 15:47:02.070286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47236) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:02.075191 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3c90608-56b8-47b1-8f44-1fa1019a3c3b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.076332 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c3c90608-56b8-47b1-8f44-1fa1019a3c3b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7810936 May 12 15:47:02.077562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Releasing vlan 579 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:47:02.077949 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.080486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47240) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:02.092322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Releasing vlan 589 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:47:02.092694 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.120643 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d0f266f4-e52c-4f34-8655-cc587c66febc tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: util.warn( May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: timer() May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:47:02.123815 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:47:02.135726 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d0f266f4-e52c-4f34-8655-cc587c66febc tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.168086 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d0f266f4-e52c-4f34-8655-cc587c66febc tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.184939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0f266f4-e52c-4f34-8655-cc587c66febc tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=3a667e6d-120c-4d74-a7c2-48472fa2aa04,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:02.187785 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d0f266f4-e52c-4f34-8655-cc587c66febc tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.188861 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d0f266f4-e52c-4f34-8655-cc587c66febc tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/3a667e6d-120c-4d74-a7c2-48472fa2aa04 HTTP/1.1" status: 204 len: 168 time: 0.1073647 May 12 15:47:02.191685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47248) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:02.212175 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Set router c5f7aaa9-0739-4d05-b072-f7db2111e5ba gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:47:02.253194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c15aa2bb-57dc-41df-8bda-d79f320b9b14 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:02.313950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c15aa2bb-57dc-41df-8bda-d79f320b9b14 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:02.315574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c15aa2bb-57dc-41df-8bda-d79f320b9b14 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1228900 May 12 15:47:02.319333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47252) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:02.385553 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.391801 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.400687 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1f033da-63c1-474b-ba5c-598f0294ae7a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.435982 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1f033da-63c1-474b-ba5c-598f0294ae7a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.445223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.450773 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.466733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] Pushing event deleted for resources: {'Network': ['ID=8fe69ccc-2df6-4e6d-ad35-1b9439b8eade,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:02.511251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] Pushing event deleted for resources: {'Network': ['ID=efb0a87e-f691-44d4-91fd-6973427a3bed,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:02.512632 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1f033da-63c1-474b-ba5c-598f0294ae7a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.554074 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-678f3876-5e4d-421d-8d99-02ff2d729d60 admin admin] 10.222.0.82 "DELETE /v2.0/networks/8fe69ccc-2df6-4e6d-ad35-1b9439b8eade HTTP/1.1" status: 204 len: 168 time: 3.5793395 May 12 15:47:02.558611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47258) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:02.586407 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.587025 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87'}], 'enable_snat': True}, 'gw_port_id': '0b130198-953d-4f1e-95d3-4d8791331284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:47:00Z', 'revision_number': 3, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '0b130198-953d-4f1e-95d3-4d8791331284', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:e5:70', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3802, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:46:59Z', 'updated_at': '2022-05-12T15:46:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:02.593869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1f033da-63c1-474b-ba5c-598f0294ae7a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=28c875b6-a402-4d9f-9a5d-a33113824975,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:02.595585 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Checking router: c5f7aaa9-0739-4d05-b072-f7db2111e5ba for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:47:02.596129 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Updating router c5f7aaa9-0739-4d05-b072-f7db2111e5ba port 0b130198-953d-4f1e-95d3-4d8791331284 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:47:02.621121 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1f033da-63c1-474b-ba5c-598f0294ae7a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.625974 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c1f033da-63c1-474b-ba5c-598f0294ae7a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-groups/28c875b6-a402-4d9f-9a5d-a33113824975 HTTP/1.1" status: 204 len: 168 time: 0.3052149 May 12 15:47:02.626697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47262) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:02.657412 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1aafcdb5-7707-4479-be86-0ffa2cd9a85d admin admin] 10.222.0.82 "DELETE /v2.0/networks/efb0a87e-f691-44d4-91fd-6973427a3bed HTTP/1.1" status: 204 len: 168 time: 3.5388615 May 12 15:47:02.661696 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:02.698137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b40d6fcc-0508-4ac7-ac5e-8efd4c321d35 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:02.714314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-571422ee-6934-4518-b0da-69c14bfdd80e tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:02.715820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-280a060e-5c05-4898-a864-7ab448afa7c2 req-bd994a05-e34e-47ea-b0c3-6f6ba3c6975e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:02.718956 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-280a060e-5c05-4898-a864-7ab448afa7c2 req-bd994a05-e34e-47ea-b0c3-6f6ba3c6975e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.1891069 May 12 15:47:02.724975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47268) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:02.725139 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-571422ee-6934-4518-b0da-69c14bfdd80e tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.6538155 May 12 15:47:02.794257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-28d3a3ff-1f6c-49c0-887e-16d83eb43c17 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0655932 May 12 15:47:02.797737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b40d6fcc-0508-4ac7-ac5e-8efd4c321d35 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:02.803491 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b40d6fcc-0508-4ac7-ac5e-8efd4c321d35 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.1730227 May 12 15:47:02.804429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47272) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:02.804567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47274) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:02.815542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-3700c85f-0574-459d-a8ec-21fcea670c50 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group': {'name': 'tempest-secgroup--1772344372'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:02.822123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3700c85f-0574-459d-a8ec-21fcea670c50 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:02.834854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1643565435', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'project_id': 'b641518781114418963451fc3ff58f4d', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:02.896869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3700c85f-0574-459d-a8ec-21fcea670c50 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:03.011095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47284) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:03.061205 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-280a060e-5c05-4898-a864-7ab448afa7c2 req-cf99df36-7bbd-49cb-978b-14fc8dbbdb11 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3355196 May 12 15:47:03.121615 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-01fd2ec1-5993-40e5-b15a-98aef5813095 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d3a18d1ea5f34946aa8296445e7e6f81&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1085203 May 12 15:47:03.137601 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3700c85f-0574-459d-a8ec-21fcea670c50 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.146924 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.148039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47288) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:03.164138 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Transition to ACTIVE for port object 0b130198-953d-4f1e-95d3-4d8791331284 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:47:03.179137 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.221781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:03.228051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3700c85f-0574-459d-a8ec-21fcea670c50 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:03.230543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:subnet and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:03.234878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:03.269643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3700c85f-0574-459d-a8ec-21fcea670c50 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:03.274871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:03.279088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-3700c85f-0574-459d-a8ec-21fcea670c50 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:03.284367 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9508664d-3174-492c-9498-385c0d361197 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.297203 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efc7f740-572f-45fc-b2fb-5dbdf54c3293 None None] Pushing event updated for resources: {'Port': ['ID=0b130198-953d-4f1e-95d3-4d8791331284,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:03.302570 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Attempting to bind port 0b130198-953d-4f1e-95d3-4d8791331284 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:47:03.303311 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Attempting to bind port 0b130198-953d-4f1e-95d3-4d8791331284 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:47:03.303755 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Attempting to bind port 0b130198-953d-4f1e-95d3-4d8791331284 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:47:03.313961 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efc7f740-572f-45fc-b2fb-5dbdf54c3293 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:03.314449 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efc7f740-572f-45fc-b2fb-5dbdf54c3293 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:03.315038 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efc7f740-572f-45fc-b2fb-5dbdf54c3293 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:03.315575 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efc7f740-572f-45fc-b2fb-5dbdf54c3293 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:03.316085 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efc7f740-572f-45fc-b2fb-5dbdf54c3293 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:03.316507 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efc7f740-572f-45fc-b2fb-5dbdf54c3293 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:03.316926 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efc7f740-572f-45fc-b2fb-5dbdf54c3293 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:03.317333 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efc7f740-572f-45fc-b2fb-5dbdf54c3293 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:03.317776 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efc7f740-572f-45fc-b2fb-5dbdf54c3293 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:03.318227 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efc7f740-572f-45fc-b2fb-5dbdf54c3293 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:03.318635 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efc7f740-572f-45fc-b2fb-5dbdf54c3293 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:03.319040 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efc7f740-572f-45fc-b2fb-5dbdf54c3293 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:03.324774 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 46, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:47:03.325621 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:47:03.326110 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.326579 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:47:03.327170 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Bound port: 0b130198-953d-4f1e-95d3-4d8791331284, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:47:03.327692 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.344664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-3700c85f-0574-459d-a8ec-21fcea670c50 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:03.368857 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9508664d-3174-492c-9498-385c0d361197 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.388877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Made reservation on behalf of b641518781114418963451fc3ff58f4d for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:47:03.400595 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.419723 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] For port 0b130198-953d-4f1e-95d3-4d8791331284, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:47:03.425020 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] For port 0b130198-953d-4f1e-95d3-4d8791331284, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0b130198-953d-4f1e-95d3-4d8791331284,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:47:03.430812 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.576588 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Routers {'c5f7aaa9-0739-4d05-b072-f7db2111e5ba'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:47:03.579121 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:03.592205 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.629376 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9508664d-3174-492c-9498-385c0d361197 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.657224 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3700c85f-0574-459d-a8ec-21fcea670c50 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.661250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9508664d-3174-492c-9498-385c0d361197 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88235146-11b3-4640-a2c9-91c14108cb34,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:03.682549 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efc7f740-572f-45fc-b2fb-5dbdf54c3293 None None] Pushing event updated for resources: {'Port': ['ID=0b130198-953d-4f1e-95d3-4d8791331284,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:03.705356 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3700c85f-0574-459d-a8ec-21fcea670c50 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.784184 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3700c85f-0574-459d-a8ec-21fcea670c50 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.785418 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3700c85f-0574-459d-a8ec-21fcea670c50 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 0.9762936 May 12 15:47:03.791717 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9508664d-3174-492c-9498-385c0d361197 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.795064 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9508664d-3174-492c-9498-385c0d361197 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/88235146-11b3-4640-a2c9-91c14108cb34 HTTP/1.1" status: 204 len: 168 time: 0.6388547 May 12 15:47:03.802625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47294) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:03.806867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3700c85f-0574-459d-a8ec-21fcea670c50 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroup': ['ID=353af953-875b-4d0c-927c-473372f5c525,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:03.816759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-64b22044-9f94-49e5-9c79-99d899b5e40c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group_rule': {'security_group_id': '353af953-875b-4d0c-927c-473372f5c525', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:03.836655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-64b22044-9f94-49e5-9c79-99d899b5e40c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:03.851956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-64b22044-9f94-49e5-9c79-99d899b5e40c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:03.857632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-64b22044-9f94-49e5-9c79-99d899b5e40c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:03.867596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-64b22044-9f94-49e5-9c79-99d899b5e40c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:03.875972 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] Set router c5f7aaa9-0739-4d05-b072-f7db2111e5ba gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:47:03.877723 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:03.945793 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-64b22044-9f94-49e5-9c79-99d899b5e40c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:04.091938 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-64b22044-9f94-49e5-9c79-99d899b5e40c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:04.113737 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-64b22044-9f94-49e5-9c79-99d899b5e40c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:04.121718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Subnet': ['ID=4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:04.158115 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64b22044-9f94-49e5-9c79-99d899b5e40c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=de7061d6-c8b5-41a4-868c-23c3f2a584d7,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:04.171834 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Checking segment: {'id': '384ff5b9-795f-4199-b25d-4d1f08782bc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:47:04.172245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network hostable DHCP agents. Network: 27a3a31e-244b-4431-86b4-73b53f4f0c89, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:47:04.194552 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-64b22044-9f94-49e5-9c79-99d899b5e40c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:04.197516 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-64b22044-9f94-49e5-9c79-99d899b5e40c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3922708 May 12 15:47:04.198442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47306) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:04.208875 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d1685020-f45d-4a1f-babf-88ad463770d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group_rule': {'security_group_id': '353af953-875b-4d0c-927c-473372f5c525', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:04.216341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 27a3a31e-244b-4431-86b4-73b53f4f0c89 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:47:04.221892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d1685020-f45d-4a1f-babf-88ad463770d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:04.231220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d1685020-f45d-4a1f-babf-88ad463770d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:04.235722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d1685020-f45d-4a1f-babf-88ad463770d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:04.238803 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 27a3a31e-244b-4431-86b4-73b53f4f0c89) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:47:04.245020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:04.245785 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:04.249815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e88206f-15d8-48ad-8c1e-f2f87ec1deab None None] Network 27a3a31e-244b-4431-86b4-73b53f4f0c89 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:47:04.256369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d1685020-f45d-4a1f-babf-88ad463770d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:04.281492 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7f7ca1c8-0494-44e3-bd41-951dead19494 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 1.4727972 May 12 15:47:04.282392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47310) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:04.373502 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87'}], 'enable_snat': True}, 'gw_port_id': '0b130198-953d-4f1e-95d3-4d8791331284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:47:00Z', 'revision_number': 3, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '0b130198-953d-4f1e-95d3-4d8791331284', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:e5:70', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3802, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:46:59Z', 'updated_at': '2022-05-12T15:47:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:04.382084 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d1685020-f45d-4a1f-babf-88ad463770d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:04.384207 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bfcc969-a073-4b37-a710-d2ae456a3725 None None] The sync data for ids ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'] in n-d-841483-1 is: [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87'}], 'enable_snat': True}, 'gw_port_id': '0b130198-953d-4f1e-95d3-4d8791331284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:47:00Z', 'revision_number': 3, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '0b130198-953d-4f1e-95d3-4d8791331284', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:e5:70', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3802, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:46:59Z', 'updated_at': '2022-05-12T15:47:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:47:04.496746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47314) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:04.497442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Deleting port d3290597-fba6-41cb-a98f-3d1e1e3d542f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:47:04.497787 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:04.638789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-27a3a31e-244b-4431-86b4-73b53f4f0c89', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ips': [{'subnet_id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:47:04.640337 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:04.694080 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-26ccdbbe-08ba-420f-b5b6-0e61a365f422 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5b43e848e2af491a8dc509c668c33e91&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1651947 May 12 15:47:04.698365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47318) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:04.798581 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2fcd0d19-8668-46e9-a91d-2391c61a99f2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:04.842285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] For port d3290597-fba6-41cb-a98f-3d1e1e3d542f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d3290597-fba6-41cb-a98f-3d1e1e3d542f,segment=NetworkSegment(cd102ff7-1d00-44b5-ae17-4227b811564b),segment_id=cd102ff7-1d00-44b5-ae17-4227b811564b)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:04.843229 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:04.859574 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2fcd0d19-8668-46e9-a91d-2391c61a99f2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:04.870951 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d1685020-f45d-4a1f-babf-88ad463770d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:04.894404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba74f874-16a4-4992-a778-ebfb3a9aee13 req-ee3ca859-309d-4ddd-8045-28303bb0e462 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:04.895931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba74f874-16a4-4992-a778-ebfb3a9aee13 req-ee3ca859-309d-4ddd-8045-28303bb0e462 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.5276864 May 12 15:47:04.899525 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d1685020-f45d-4a1f-babf-88ad463770d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:04.932228 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Allocated IP 172.20.0.2 (27a3a31e-244b-4431-86b4-73b53f4f0c89/4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610/03b70439-0ed8-4406-888a-b6afb6de6fc6) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:47:05.007592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Calling delete_port for d3290597-fba6-41cb-a98f-3d1e1e3d542f owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:47:05.022288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1685020-f45d-4a1f-babf-88ad463770d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cdac64c3-90e3-4150-aeca-e6e601ae6f38,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:05.044441 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d1685020-f45d-4a1f-babf-88ad463770d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:05.045672 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d1685020-f45d-4a1f-babf-88ad463770d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.8461549 May 12 15:47:05.055584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47322) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:05.061298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group_rule': {'security_group_id': '353af953-875b-4d0c-927c-473372f5c525', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:05.068588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:05.074009 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:05.077551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:05.084042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:05.088525 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba74f874-16a4-4992-a778-ebfb3a9aee13 req-22b64dd3-4bf5-4a35-96f6-d9a2d05e0d54 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1701357 May 12 15:47:05.217239 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:05.230619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Transition to ACTIVE for port object 03b70439-0ed8-4406-888a-b6afb6de6fc6 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:47:05.254053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Transition to ACTIVE for port object 03b70439-0ed8-4406-888a-b6afb6de6fc6 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:47:05.264544 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:05.310016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:05.352102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Pushing event updated for resources: {'Port': ['ID=03b70439-0ed8-4406-888a-b6afb6de6fc6,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:05.361590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Network 27a3a31e-244b-4431-86b4-73b53f4f0c89 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:47:05.363075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:47:05.368105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:47:05.376824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:05.469513 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:05.491340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:05.493270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Pushing event deleted for resources: {'Port': ['ID=d3290597-fba6-41cb-a98f-3d1e1e3d542f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:05.532277 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Attempting to bind port 03b70439-0ed8-4406-888a-b6afb6de6fc6 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:47:05.532639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Attempting to bind port 03b70439-0ed8-4406-888a-b6afb6de6fc6 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '384ff5b9-795f-4199-b25d-4d1f08782bc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:47:05.533037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Attempting to bind port 03b70439-0ed8-4406-888a-b6afb6de6fc6 on network 27a3a31e-244b-4431-86b4-73b53f4f0c89 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:47:05.550508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 46, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:47:05.550876 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Checking segment: {'id': '384ff5b9-795f-4199-b25d-4d1f08782bc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:47:05.551403 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:05.553118 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Bound using segment: {'id': '384ff5b9-795f-4199-b25d-4d1f08782bc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:47:05.553718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Bound port: 03b70439-0ed8-4406-888a-b6afb6de6fc6, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '384ff5b9-795f-4199-b25d-4d1f08782bc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:47:05.554095 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:05.694596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] For port 03b70439-0ed8-4406-888a-b6afb6de6fc6, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:47:05.705549 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:05.706910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] For port 03b70439-0ed8-4406-888a-b6afb6de6fc6, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=03b70439-0ed8-4406-888a-b6afb6de6fc6,segment=NetworkSegment(384ff5b9-795f-4199-b25d-4d1f08782bc8),segment_id=384ff5b9-795f-4199-b25d-4d1f08782bc8)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:47:05.715827 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:05.743357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f11aed0e-7cfc-456d-82d7-e1ded95a5186,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:05.745888 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:05.750318 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.6906788 May 12 15:47:05.752974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.753469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.754348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.754551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.755110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.755517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.756021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.756490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.756899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.758153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.758855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.759356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.762202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47332) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:05.772883 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2fcd0d19-8668-46e9-a91d-2391c61a99f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:05.775465 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2fcd0d19-8668-46e9-a91d-2391c61a99f2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:05.776758 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2fcd0d19-8668-46e9-a91d-2391c61a99f2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9e4bbe98-a709-4ded-b538-2767cd2be6f4 HTTP/1.1" status: 204 len: 168 time: 1.0791636 May 12 15:47:05.796520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.797976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.798615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.799137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.800605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.800965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.801418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.801801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.802133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.802735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.803317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.803742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d61b7-f81a-4400-b91c-ad418b95d724 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:05.890112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a3f63973-efa4-4dcc-817a-b0da2570581a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group_rule': {'security_group_id': '353af953-875b-4d0c-927c-473372f5c525', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:05.912348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fcd0d19-8668-46e9-a91d-2391c61a99f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e4bbe98-a709-4ded-b538-2767cd2be6f4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:05.931505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a3f63973-efa4-4dcc-817a-b0da2570581a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:05.944963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a3f63973-efa4-4dcc-817a-b0da2570581a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:05.949319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a3f63973-efa4-4dcc-817a-b0da2570581a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:05.984635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a3f63973-efa4-4dcc-817a-b0da2570581a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:06.042065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c03bd5e1-dc6b-4042-9f14-3f364c169be4 None None] Pushing event updated for resources: {'Port': ['ID=03b70439-0ed8-4406-888a-b6afb6de6fc6,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:06.159122 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:06.511936 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3f63973-efa4-4dcc-817a-b0da2570581a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:06.620037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0b130198-953d-4f1e-95d3-4d8791331284 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:47:06.678366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Allocated IP 172.20.0.1 (27a3a31e-244b-4431-86b4-73b53f4f0c89/4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610/c6584f69-ed28-4741-b68f-c92c73eccc19) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:47:06.693085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de41ad56-3ce4-4eff-93c3-60e1547066fd req-3c1f5072-cf60-4a28-93af-7a432d59502c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:06.695016 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de41ad56-3ce4-4eff-93c3-60e1547066fd req-3c1f5072-cf60-4a28-93af-7a432d59502c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.3017139 May 12 15:47:06.752028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 0b130198-953d-4f1e-95d3-4d8791331284 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:47:06.758951 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0b130198-953d-4f1e-95d3-4d8791331284 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:47:06.759458 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:06.863711 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de41ad56-3ce4-4eff-93c3-60e1547066fd req-ee04f429-6434-4e25-8562-d8b54e70cc78 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1512189 May 12 15:47:06.927414 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:06.953660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 0b130198-953d-4f1e-95d3-4d8791331284, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0b130198-953d-4f1e-95d3-4d8791331284,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:06.965719 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:06.966185 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:06.986925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Transition to ACTIVE for port object c6584f69-ed28-4741-b68f-c92c73eccc19 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:47:07.017738 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:07.018123 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3f63973-efa4-4dcc-817a-b0da2570581a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:07.066518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=0b130198-953d-4f1e-95d3-4d8791331284,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:07.076940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3f63973-efa4-4dcc-817a-b0da2570581a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:07.109631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 27a3a31e-244b-4431-86b4-73b53f4f0c89 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:47:07.113325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:47:07.119912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:47:07.129009 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3f63973-efa4-4dcc-817a-b0da2570581a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=348207ab-c587-41a5-92b4-48a13028d62b,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:07.164323 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a3f63973-efa4-4dcc-817a-b0da2570581a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:07.166072 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a3f63973-efa4-4dcc-817a-b0da2570581a tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 1.3950613 May 12 15:47:07.169510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=c6584f69-ed28-4741-b68f-c92c73eccc19,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:07.171760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47344) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:07.181372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c60a7bfb-1215-4621-8797-4f6b11734c00 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group_rule': {'security_group_id': '353af953-875b-4d0c-927c-473372f5c525', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:07.190492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c60a7bfb-1215-4621-8797-4f6b11734c00 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:07.197463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c60a7bfb-1215-4621-8797-4f6b11734c00 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:07.198530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c60a7bfb-1215-4621-8797-4f6b11734c00 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:07.208733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c60a7bfb-1215-4621-8797-4f6b11734c00 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:07.215524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Router 7b4592bb-783c-491e-8854-09b8b7ceb354 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:47:07.223503 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:07.403606 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c60a7bfb-1215-4621-8797-4f6b11734c00 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:07.611404 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c60a7bfb-1215-4621-8797-4f6b11734c00 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:07.618249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:47:07.620562 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c60a7bfb-1215-4621-8797-4f6b11734c00 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:07.631593 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-328ec8b2-5031-4367-a7cc-ea855beae606 None None] Sync routers for ids ['7b4592bb-783c-491e-8854-09b8b7ceb354'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:47:07.651441 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-642c4919-10ea-451d-8a86-61a711f31fe1 None None] Network 27a3a31e-244b-4431-86b4-73b53f4f0c89 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:47:07.658707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c60a7bfb-1215-4621-8797-4f6b11734c00 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=abc544b9-1d4e-4d82-8e86-b0d2548e59c8,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:07.660950 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-56e873aa-f38d-4285-9b26-7ca6709434c3 admin admin] 10.222.0.82 "PUT /v2.0/routers/7b4592bb-783c-491e-8854-09b8b7ceb354/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1000631 May 12 15:47:07.663519 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c60a7bfb-1215-4621-8797-4f6b11734c00 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:07.664557 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c60a7bfb-1215-4621-8797-4f6b11734c00 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 772 time: 0.4913146 May 12 15:47:07.665080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47348) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:07.669354 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47350) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:07.716901 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7fb5d107-f36d-4fda-bfc2-d8d24c6279e7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:07.730110 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7fb5d107-f36d-4fda-bfc2-d8d24c6279e7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:07.735195 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-328ec8b2-5031-4367-a7cc-ea855beae606 None None] Routers {'7b4592bb-783c-491e-8854-09b8b7ceb354'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:47:07.735815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-328ec8b2-5031-4367-a7cc-ea855beae606 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7b4592bb-783c-491e-8854-09b8b7ceb354'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:07.808136 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7fb5d107-f36d-4fda-bfc2-d8d24c6279e7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:07.828950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb5d107-f36d-4fda-bfc2-d8d24c6279e7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=abc544b9-1d4e-4d82-8e86-b0d2548e59c8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:07.831436 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:07.861333 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:07.917992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-24a3b40f-3e21-4fd1-981f-dda96ae3d556 None None] Provisioning for port 03b70439-0ed8-4406-888a-b6afb6de6fc6 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:47:07.954862 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:47:08.013798 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-328ec8b2-5031-4367-a7cc-ea855beae606 None None] Set router 7b4592bb-783c-491e-8854-09b8b7ceb354 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:47:08.086149 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:08.098428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] Deleting port 80a299dc-ac88-40fc-9d83-8707660023fd {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:47:08.098776 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:08.166189 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7fb5d107-f36d-4fda-bfc2-d8d24c6279e7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:08.167348 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7fb5d107-f36d-4fda-bfc2-d8d24c6279e7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/abc544b9-1d4e-4d82-8e86-b0d2548e59c8 HTTP/1.1" status: 204 len: 168 time: 0.4970627 May 12 15:47:08.172555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47362) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:08.276436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-486052d7-61a9-457a-b682-771d4c229dac req-a909aa49-d5ca-499f-a39a-4372715aff2e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:08.278104 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-486052d7-61a9-457a-b682-771d4c229dac req-a909aa49-d5ca-499f-a39a-4372715aff2e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.1134255 May 12 15:47:08.460291 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-486052d7-61a9-457a-b682-771d4c229dac req-0f155c05-ca0d-42b2-a090-0c7f9a9ab3ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1587822 May 12 15:47:08.537746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] For port 80a299dc-ac88-40fc-9d83-8707660023fd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=80a299dc-ac88-40fc-9d83-8707660023fd,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:08.538109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:08.554754 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-328ec8b2-5031-4367-a7cc-ea855beae606 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'name': 'tempest-TestVolumeBackupRestore-1378188961-router', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.127'}], 'enable_snat': True}, 'gw_port_id': '80a299dc-ac88-40fc-9d83-8707660023fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:40:17Z', 'updated_at': '2022-05-12T15:47:05Z', 'revision_number': 5, 'project_id': 'd5937b60103242ddb97055720836a8ff', 'gw_port': {'id': '80a299dc-ac88-40fc-9d83-8707660023fd', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:c3:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3235, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:40:19Z', 'updated_at': '2022-05-12T15:40:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:08.564444 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-328ec8b2-5031-4367-a7cc-ea855beae606 None None] Checking router: 7b4592bb-783c-491e-8854-09b8b7ceb354 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:47:08.586240 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-328ec8b2-5031-4367-a7cc-ea855beae606 None None] Routers {'7b4592bb-783c-491e-8854-09b8b7ceb354'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:47:08.586875 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-328ec8b2-5031-4367-a7cc-ea855beae606 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['7b4592bb-783c-491e-8854-09b8b7ceb354'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:08.603022 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:08.609096 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:08.705073 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 03b70439-0ed8-4406-888a-b6afb6de6fc6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:47:08.729364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] Calling delete_port for 80a299dc-ac88-40fc-9d83-8707660023fd owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:47:08.743904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=c6584f69-ed28-4741-b68f-c92c73eccc19,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:08.786565 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:08.835396 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6353fc66-50e0-4d60-86bb-f97241d5bc9f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:08.877403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6353fc66-50e0-4d60-86bb-f97241d5bc9f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:08.882043 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6353fc66-50e0-4d60-86bb-f97241d5bc9f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5751 time: 0.7082486 May 12 15:47:08.890805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-328ec8b2-5031-4367-a7cc-ea855beae606 None None] Set router 7b4592bb-783c-491e-8854-09b8b7ceb354 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:47:08.891695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47368) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:09.005746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 27a3a31e-244b-4431-86b4-73b53f4f0c89 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:47:09.007010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:47:09.091286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-328ec8b2-5031-4367-a7cc-ea855beae606 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'name': 'tempest-TestVolumeBackupRestore-1378188961-router', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:40:17Z', 'updated_at': '2022-05-12T15:47:08Z', 'revision_number': 6, 'project_id': 'd5937b60103242ddb97055720836a8ff', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:09.098830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-328ec8b2-5031-4367-a7cc-ea855beae606 None None] The sync data for ids ['7b4592bb-783c-491e-8854-09b8b7ceb354'] in n-d-841483-1 is: [{'id': '7b4592bb-783c-491e-8854-09b8b7ceb354', 'name': 'tempest-TestVolumeBackupRestore-1378188961-router', 'tenant_id': 'd5937b60103242ddb97055720836a8ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:40:17Z', 'updated_at': '2022-05-12T15:47:08Z', 'revision_number': 6, 'project_id': 'd5937b60103242ddb97055720836a8ff', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:47:09.120516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8c4c6999-c08b-4723-899f-cc5ede71b178 None None] Provisioning for port c6584f69-ed28-4741-b68f-c92c73eccc19 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:47:09.126948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8c4c6999-c08b-4723-899f-cc5ede71b178 None None] Provisioning complete for port c6584f69-ed28-4741-b68f-c92c73eccc19 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:47:09.127321 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8c4c6999-c08b-4723-899f-cc5ede71b178 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:09.155949 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 03b70439-0ed8-4406-888a-b6afb6de6fc6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:47:09.160690 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55bff267-9a24-4b22-8ad6-9656dd544585 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:09.180702 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55bff267-9a24-4b22-8ad6-9656dd544585 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:09.191902 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 03b70439-0ed8-4406-888a-b6afb6de6fc6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:47:09.192670 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:09.285884 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8c4c6999-c08b-4723-899f-cc5ede71b178 None None] Port c6584f69-ed28-4741-b68f-c92c73eccc19 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:47:09.309758 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:09.317276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8c4c6999-c08b-4723-899f-cc5ede71b178 None None] Provisioning complete for port 03b70439-0ed8-4406-888a-b6afb6de6fc6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:47:09.317813 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8c4c6999-c08b-4723-899f-cc5ede71b178 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:09.345422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Router c5f7aaa9-0739-4d05-b072-f7db2111e5ba has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:47:09.376585 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55bff267-9a24-4b22-8ad6-9656dd544585 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:09.382029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] Pushing event deleted for resources: {'Port': ['ID=80a299dc-ac88-40fc-9d83-8707660023fd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:09.432329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55bff267-9a24-4b22-8ad6-9656dd544585 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=348207ab-c587-41a5-92b4-48a13028d62b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:09.465617 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:09.502929 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55bff267-9a24-4b22-8ad6-9656dd544585 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:09.504296 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-55bff267-9a24-4b22-8ad6-9656dd544585 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/348207ab-c587-41a5-92b4-48a13028d62b HTTP/1.1" status: 204 len: 168 time: 0.6116679 May 12 15:47:09.510332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47376) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:09.634407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 03b70439-0ed8-4406-888a-b6afb6de6fc6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=03b70439-0ed8-4406-888a-b6afb6de6fc6,segment=NetworkSegment(384ff5b9-795f-4199-b25d-4d1f08782bc8),segment_id=384ff5b9-795f-4199-b25d-4d1f08782bc8)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:09.652581 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:09.656155 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0b130198-953d-4f1e-95d3-4d8791331284 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:47:09.658102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:47:09.664523 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7b9ede46-bd9a-4b58-9908-754ddce2971c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "PUT /v2.0/routers/c5f7aaa9-0739-4d05-b072-f7db2111e5ba/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.3803649 May 12 15:47:09.664904 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:09.676098 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Sync routers for ids ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:47:09.697968 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Routers {'c5f7aaa9-0739-4d05-b072-f7db2111e5ba'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:47:09.699478 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:09.700007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47380) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:09.795954 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8c4c6999-c08b-4723-899f-cc5ede71b178 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:09.978629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=03b70439-0ed8-4406-888a-b6afb6de6fc6,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:10.080673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0b130198-953d-4f1e-95d3-4d8791331284 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:47:10.081042 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.111633 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.124584 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-8c4c6999-c08b-4723-899f-cc5ede71b178 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:47:10.124584 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-8c4c6999-c08b-4723-899f-cc5ede71b178 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:47:10.136757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1542a6a8-802b-46ab-ba3e-37156b937c6c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:10.142354 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.168826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1542a6a8-802b-46ab-ba3e-37156b937c6c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:10.170168 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1542a6a8-802b-46ab-ba3e-37156b937c6c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5205 time: 0.5796447 May 12 15:47:10.175290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47384) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:10.176032 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Set router c5f7aaa9-0739-4d05-b072-f7db2111e5ba gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:47:10.192797 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.193452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7b4592bb-783c-491e-8854-09b8b7ceb354 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:47:10.221282 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e030e86-3315-4d61-9bb6-b1e82df7306e tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.246361 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e030e86-3315-4d61-9bb6-b1e82df7306e tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.258073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aed3201-ba7a-4a78-b56b-5672ab061a27 req-ca73b071-649e-4727-aa2b-21797601ddcd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:10.258578 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.262105 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6aed3201-ba7a-4a78-b56b-5672ab061a27 req-ca73b071-649e-4727-aa2b-21797601ddcd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.5940688 May 12 15:47:10.262904 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47388) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:10.270306 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e3ea7232-4f37-479f-9e5b-1b4948437b09 admin admin] 10.222.0.82 "DELETE /v2.0/routers/7b4592bb-783c-491e-8854-09b8b7ceb354 HTTP/1.1" status: 204 len: 168 time: 2.6041563 May 12 15:47:10.313543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e030e86-3315-4d61-9bb6-b1e82df7306e tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.328806 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b38b0d69-1876-419b-8b8a-c3caa2323182 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:10.329473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b38b0d69-1876-419b-8b8a-c3caa2323182 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:10.330117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b38b0d69-1876-419b-8b8a-c3caa2323182 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:10.330702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b38b0d69-1876-419b-8b8a-c3caa2323182 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:10.331271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b38b0d69-1876-419b-8b8a-c3caa2323182 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:10.331847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b38b0d69-1876-419b-8b8a-c3caa2323182 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:10.337132 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b38b0d69-1876-419b-8b8a-c3caa2323182 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4271 time: 0.6360722 May 12 15:47:10.337251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47392) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:10.338109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e030e86-3315-4d61-9bb6-b1e82df7306e tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=f11aed0e-7cfc-456d-82d7-e1ded95a5186,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:10.410036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Deleting subnet 8199d329-88ea-42b4-8648-caba92394460 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:47:10.416236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0e030e86-3315-4d61-9bb6-b1e82df7306e tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.420564 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6aed3201-ba7a-4a78-b56b-5672ab061a27 req-4172cdb4-fe43-4e51-8784-0e48e68e559c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0794976 May 12 15:47:10.420564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.429219 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0e030e86-3315-4d61-9bb6-b1e82df7306e tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/f11aed0e-7cfc-456d-82d7-e1ded95a5186 HTTP/1.1" status: 204 len: 168 time: 0.2378080 May 12 15:47:10.431186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47396) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:10.457473 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 03b70439-0ed8-4406-888a-b6afb6de6fc6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:47:10.489342 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.507821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff90b4e5-49a7-448a-8633-5d9f46d41542 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:10.508284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff90b4e5-49a7-448a-8633-5d9f46d41542 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:10.508731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff90b4e5-49a7-448a-8633-5d9f46d41542 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:10.509174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff90b4e5-49a7-448a-8633-5d9f46d41542 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:10.509641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff90b4e5-49a7-448a-8633-5d9f46d41542 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:10.510081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff90b4e5-49a7-448a-8633-5d9f46d41542 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:10.514758 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ff90b4e5-49a7-448a-8633-5d9f46d41542 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3991 time: 0.1737118 May 12 15:47:10.515501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47400) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:10.591522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9139f32f-eaab-410c-8e49-334afdd6692f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:10.609374 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.619131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 03b70439-0ed8-4406-888a-b6afb6de6fc6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:47:10.619500 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.658349 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9139f32f-eaab-410c-8e49-334afdd6692f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:10.662165 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9139f32f-eaab-410c-8e49-334afdd6692f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.2211103 May 12 15:47:10.667627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47408) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:10.697481 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87'}], 'enable_snat': True}, 'gw_port_id': '0b130198-953d-4f1e-95d3-4d8791331284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:47:07Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '0b130198-953d-4f1e-95d3-4d8791331284', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:e5:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3802, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:46:59Z', 'updated_at': '2022-05-12T15:47:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c6584f69-ed28-4741-b68f-c92c73eccc19', 'name': '', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:e8:e9:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 3820, 'fixed_ips': [{'subnet_id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:47:06Z', 'updated_at': '2022-05-12T15:47:08Z', 'revision_number': 2, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:10.703775 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Checking router: c5f7aaa9-0739-4d05-b072-f7db2111e5ba for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:47:10.704403 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Updating router c5f7aaa9-0739-4d05-b072-f7db2111e5ba port c6584f69-ed28-4741-b68f-c92c73eccc19 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:47:10.721236 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.774928 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e484889-6971-4687-8509-39630454f250 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.775619 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.794422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8199d329-88ea-42b4-8648-caba92394460,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:10.794736 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e484889-6971-4687-8509-39630454f250 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.806001 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.810240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:10.810579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:10.810911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:10.811236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:10.811596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:10.812047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:10.812373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:10.812689 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:10.813006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:10.813317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:10.813691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:10.813981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:10.821725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2625f694-d6e4-467a-99d3-901cc2189530 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/8199d329-88ea-42b4-8648-caba92394460 HTTP/1.1" status: 204 len: 168 time: 0.5575426 May 12 15:47:10.823851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47412) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:10.855166 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e484889-6971-4687-8509-39630454f250 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.860508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72f4ba08-021a-46bf-b58d-b848af30aaf2 None None] Network 144e0d0a-a7de-4e63-8a93-dfaca53a8328 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:47:10.887135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e484889-6971-4687-8509-39630454f250 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.888233 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6e484889-6971-4687-8509-39630454f250 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/cdac64c3-90e3-4150-aeca-e6e601ae6f38 HTTP/1.1" status: 204 len: 168 time: 0.2196934 May 12 15:47:10.891459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47416) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:10.893936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e484889-6971-4687-8509-39630454f250 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=cdac64c3-90e3-4150-aeca-e6e601ae6f38,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:10.947394 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bc6fe661-12aa-4061-bb06-5db9103d8684 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/routers HTTP/1.1" status: 200 len: 2335 time: 0.4219911 May 12 15:47:10.964021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b62310d1-758b-4fee-95a8-413324532953 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:10.994032 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:10.994286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b62310d1-758b-4fee-95a8-413324532953 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:10.996940 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b62310d1-758b-4fee-95a8-413324532953 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.1043465 May 12 15:47:11.000963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47422) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:11.036770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Deleting port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:47:11.040852 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.085791 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-444ddaa2-8e04-409a-acc4-83eb08cc7199 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.114274 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-444ddaa2-8e04-409a-acc4-83eb08cc7199 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.122751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47428) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:11.134898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-852714710', 'description': 'tempest-secgroup-smoke-852714710 description', 'project_id': 'b641518781114418963451fc3ff58f4d'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:11.151137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:11.159703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:11.165039 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:11.175025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:11.178935 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-444ddaa2-8e04-409a-acc4-83eb08cc7199 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.200473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-444ddaa2-8e04-409a-acc4-83eb08cc7199 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=de7061d6-c8b5-41a4-868c-23c3f2a584d7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:11.221113 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-444ddaa2-8e04-409a-acc4-83eb08cc7199 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.225629 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-444ddaa2-8e04-409a-acc4-83eb08cc7199 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/de7061d6-c8b5-41a4-868c-23c3f2a584d7 HTTP/1.1" status: 204 len: 168 time: 0.2211072 May 12 15:47:11.226951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47432) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:11.254114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 80a299dc-ac88-40fc-9d83-8707660023fd no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:47:11.302404 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.328766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f2fa81ae-fd4e-4c00-96f8-77ca4b614c66 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:11.335408 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a2ce9fd9-8349-4c19-8485-e9d1b48d5323 None None] Provisioning complete for port c6584f69-ed28-4741-b68f-c92c73eccc19 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:47:11.335839 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a2ce9fd9-8349-4c19-8485-e9d1b48d5323 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.349144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f2fa81ae-fd4e-4c00-96f8-77ca4b614c66 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:11.353845 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f2fa81ae-fd4e-4c00-96f8-77ca4b614c66 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1254246 May 12 15:47:11.356551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47436) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:11.386641 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.396168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a2ce9fd9-8349-4c19-8485-e9d1b48d5323 None None] Port c6584f69-ed28-4741-b68f-c92c73eccc19 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:47:11.397575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 80a299dc-ac88-40fc-9d83-8707660023fd {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:47:11.397909 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 80a299dc-ac88-40fc-9d83-8707660023fd not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:47:11.398370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d3290597-fba6-41cb-a98f-3d1e1e3d542f no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:47:11.403685 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Transition to ACTIVE for port object c6584f69-ed28-4741-b68f-c92c73eccc19 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:47:11.418478 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.427299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:11.435804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:11.441492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:11.450220 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: d3290597-fba6-41cb-a98f-3d1e1e3d542f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:47:11.450620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d3290597-fba6-41cb-a98f-3d1e1e3d542f not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:47:11.460279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:11.482378 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] For port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a3ca589c-46a4-47c6-a8a8-4cbc670fb19c,segment=NetworkSegment(cd102ff7-1d00-44b5-ae17-4227b811564b),segment_id=cd102ff7-1d00-44b5-ae17-4227b811564b)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:11.483500 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.518476 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16fb975e-5301-414f-a9ec-107026e6b6d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.546786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04ac02a7-8822-42a2-b863-ad8b26631ab9 None None] DHCP port deletion for 144e0d0a-a7de-4e63-8a93-dfaca53a8328 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:47:11.552317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-04ac02a7-8822-42a2-b863-ad8b26631ab9 None None] Deleting port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:47:11.552866 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-04ac02a7-8822-42a2-b863-ad8b26631ab9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.565484 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16fb975e-5301-414f-a9ec-107026e6b6d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.673165 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16fb975e-5301-414f-a9ec-107026e6b6d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.687382 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b5f4e7e-9424-4651-ae3c-fb5e1cae8c12 None None] Pushing event updated for resources: {'Port': ['ID=c6584f69-ed28-4741-b68f-c92c73eccc19,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:11.720461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16fb975e-5301-414f-a9ec-107026e6b6d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=353af953-875b-4d0c-927c-473372f5c525,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:11.742847 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.746346 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16fb975e-5301-414f-a9ec-107026e6b6d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.748410 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-16fb975e-5301-414f-a9ec-107026e6b6d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-groups/353af953-875b-4d0c-927c-473372f5c525 HTTP/1.1" status: 204 len: 168 time: 0.3907881 May 12 15:47:11.756155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47442) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:11.807738 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Attempting to bind port c6584f69-ed28-4741-b68f-c92c73eccc19 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:47:11.808349 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Attempting to bind port c6584f69-ed28-4741-b68f-c92c73eccc19 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '384ff5b9-795f-4199-b25d-4d1f08782bc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:47:11.808472 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Attempting to bind port c6584f69-ed28-4741-b68f-c92c73eccc19 on network 27a3a31e-244b-4431-86b4-73b53f4f0c89 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:47:11.817436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Calling delete_port for a3ca589c-46a4-47c6-a8a8-4cbc670fb19c owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:47:11.826717 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 46, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:47:11.827701 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Checking segment: {'id': '384ff5b9-795f-4199-b25d-4d1f08782bc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:47:11.828121 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.828749 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Bound using segment: {'id': '384ff5b9-795f-4199-b25d-4d1f08782bc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:47:11.829263 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Bound port: c6584f69-ed28-4741-b68f-c92c73eccc19, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '384ff5b9-795f-4199-b25d-4d1f08782bc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:47:11.829670 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.869116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1bf1f1f2-2867-429e-b349-b3ba6e1060e2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:11.877896 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.892395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1bf1f1f2-2867-429e-b349-b3ba6e1060e2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:11.895045 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1bf1f1f2-2867-429e-b349-b3ba6e1060e2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.1373112 May 12 15:47:11.899587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47446) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:11.910064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7ac34d14-25ec-46e7-9719-fb9788217d8f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group': {'name': 'tempest-secgroup--1119020712'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:11.919623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7ac34d14-25ec-46e7-9719-fb9788217d8f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:11.934006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7ac34d14-25ec-46e7-9719-fb9788217d8f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:11.967129 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] For port c6584f69-ed28-4741-b68f-c92c73eccc19, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:47:11.972841 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] For port c6584f69-ed28-4741-b68f-c92c73eccc19, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c6584f69-ed28-4741-b68f-c92c73eccc19,segment=NetworkSegment(384ff5b9-795f-4199-b25d-4d1f08782bc8),segment_id=384ff5b9-795f-4199-b25d-4d1f08782bc8)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:47:11.979606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroup': ['ID=52328bfc-80e0-4587-961a-a4facf47e8a6,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:11.980257 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.994256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-04ac02a7-8822-42a2-b863-ad8b26631ab9 None None] For port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a3ca589c-46a4-47c6-a8a8-4cbc670fb19c,segment=NetworkSegment(cd102ff7-1d00-44b5-ae17-4227b811564b),segment_id=cd102ff7-1d00-44b5-ae17-4227b811564b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:11.996411 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-04ac02a7-8822-42a2-b863-ad8b26631ab9 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:11.996686 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.000840 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ac34d14-25ec-46e7-9719-fb9788217d8f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.001445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-62100484-6039-43e0-abe9-d727477e5e1e tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.8783147 May 12 15:47:12.012988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47450) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:12.021702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0b87e752-2a31-4302-909f-a02328dff56d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': '52328bfc-80e0-4587-961a-a4facf47e8a6', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:12.030441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0b87e752-2a31-4302-909f-a02328dff56d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:12.042566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0b87e752-2a31-4302-909f-a02328dff56d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:12.044111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7ac34d14-25ec-46e7-9719-fb9788217d8f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:12.047570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0b87e752-2a31-4302-909f-a02328dff56d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:12.051298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7ac34d14-25ec-46e7-9719-fb9788217d8f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:12.055640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7ac34d14-25ec-46e7-9719-fb9788217d8f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:12.061918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7ac34d14-25ec-46e7-9719-fb9788217d8f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:12.062978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c78910ce-abc3-454d-a9fd-1cd155967111 req-c03050d8-0768-4550-85f0-ffb21df4c730 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:12.081230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c78910ce-abc3-454d-a9fd-1cd155967111 req-c03050d8-0768-4550-85f0-ffb21df4c730 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.3368180 May 12 15:47:12.083075 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.087292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0b87e752-2a31-4302-909f-a02328dff56d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:12.107342 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Routers {'c5f7aaa9-0739-4d05-b072-f7db2111e5ba'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:47:12.108326 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:46:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:12.180160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Pushing event deleted for resources: {'Port': ['ID=a3ca589c-46a4-47c6-a8a8-4cbc670fb19c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:12.184183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] No DVR routers for this DVR port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:47:12.222396 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ac34d14-25ec-46e7-9719-fb9788217d8f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.235320 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ac34d14-25ec-46e7-9719-fb9788217d8f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.289674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ac34d14-25ec-46e7-9719-fb9788217d8f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7c3b6023-4a76-4d9b-a195-e2adfce060c4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:12.335287 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ac34d14-25ec-46e7-9719-fb9788217d8f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.336885 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7ac34d14-25ec-46e7-9719-fb9788217d8f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 0.4357834 May 12 15:47:12.339492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47456) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:12.345284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-42cc2700-4d1a-4374-8969-f9e6ade363a4 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group_rule': {'security_group_id': '7c3b6023-4a76-4d9b-a195-e2adfce060c4', 'direction': 'ingress', 'protocol': 17}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:12.352909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-42cc2700-4d1a-4374-8969-f9e6ade363a4 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:12.357875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-42cc2700-4d1a-4374-8969-f9e6ade363a4 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:12.361234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-42cc2700-4d1a-4374-8969-f9e6ade363a4 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:12.375660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-42cc2700-4d1a-4374-8969-f9e6ade363a4 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:12.408871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c78910ce-abc3-454d-a9fd-1cd155967111 req-3b235feb-dac7-4081-9b9c-bde5fed18c54 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3266716 May 12 15:47:12.422859 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42cc2700-4d1a-4374-8969-f9e6ade363a4 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.430595 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] Set router c5f7aaa9-0739-4d05-b072-f7db2111e5ba gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:47:12.461024 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0b87e752-2a31-4302-909f-a02328dff56d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.492291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a3ca589c-46a4-47c6-a8a8-4cbc670fb19c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:47:12.509177 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42cc2700-4d1a-4374-8969-f9e6ade363a4 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.511030 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b5f4e7e-9424-4651-ae3c-fb5e1cae8c12 None None] Pushing event updated for resources: {'Port': ['ID=c6584f69-ed28-4741-b68f-c92c73eccc19,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:12.517586 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42cc2700-4d1a-4374-8969-f9e6ade363a4 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.546075 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0b87e752-2a31-4302-909f-a02328dff56d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.553946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42cc2700-4d1a-4374-8969-f9e6ade363a4 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e860f1a6-73c8-4746-8d23-a278b2f9e034,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:12.559948 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.569949 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42cc2700-4d1a-4374-8969-f9e6ade363a4 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.571902 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-42cc2700-4d1a-4374-8969-f9e6ade363a4 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.2305958 May 12 15:47:12.574274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47460) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:12.578545 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0b87e752-2a31-4302-909f-a02328dff56d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.592149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-04ac02a7-8822-42a2-b863-ad8b26631ab9 None None] Calling delete_port for a3ca589c-46a4-47c6-a8a8-4cbc670fb19c owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:47:12.609646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['144e0d0a-a7de-4e63-8a93-dfaca53a8328']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:12.633859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b87e752-2a31-4302-909f-a02328dff56d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c12e03f8-9285-44ce-a204-334fcb43aa79,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:12.638867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cd102ff7-1d00-44b5-ae17-4227b811564b') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:12.639179 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cd102ff7-1d00-44b5-ae17-4227b811564b') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:12.657859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: a3ca589c-46a4-47c6-a8a8-4cbc670fb19c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:47:12.658424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a3ca589c-46a4-47c6-a8a8-4cbc670fb19c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:47:12.660838 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.675145 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0b87e752-2a31-4302-909f-a02328dff56d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.676508 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0b87e752-2a31-4302-909f-a02328dff56d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6608775 May 12 15:47:12.682227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47464) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:12.691131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-45d6148a-270b-4e0d-a3b4-3c3ad478c469 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': '52328bfc-80e0-4587-961a-a4facf47e8a6', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:12.698902 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.702540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-45d6148a-270b-4e0d-a3b4-3c3ad478c469 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:12.712837 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-45d6148a-270b-4e0d-a3b4-3c3ad478c469 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:12.716780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Releasing vlan 558 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:47:12.717184 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.723707 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3f936f0f-99fa-42ff-b6f5-d857dc8313c7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: timer() May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:47:12.734360 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:47:12.736535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-45d6148a-270b-4e0d-a3b4-3c3ad478c469 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:12.759790 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3f936f0f-99fa-42ff-b6f5-d857dc8313c7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.759969 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-04ac02a7-8822-42a2-b863-ad8b26631ab9 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:47:12.760211 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-04ac02a7-8822-42a2-b863-ad8b26631ab9 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:47:12.763195 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-55548a11-d1cc-4085-9e3f-2ca457955b33 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.831522 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3f936f0f-99fa-42ff-b6f5-d857dc8313c7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.860657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f936f0f-99fa-42ff-b6f5-d857dc8313c7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7c3b6023-4a76-4d9b-a195-e2adfce060c4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:12.874526 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3f936f0f-99fa-42ff-b6f5-d857dc8313c7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:12.876169 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3f936f0f-99fa-42ff-b6f5-d857dc8313c7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-groups/7c3b6023-4a76-4d9b-a195-e2adfce060c4 HTTP/1.1" status: 204 len: 168 time: 0.2993000 May 12 15:47:12.888614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47468) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:12.976319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-45d6148a-270b-4e0d-a3b4-3c3ad478c469 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:13.036955 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87'}], 'enable_snat': True}, 'gw_port_id': '0b130198-953d-4f1e-95d3-4d8791331284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:47:07Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '0b130198-953d-4f1e-95d3-4d8791331284', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:e5:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3802, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:46:59Z', 'updated_at': '2022-05-12T15:47:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c6584f69-ed28-4741-b68f-c92c73eccc19', 'name': '', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:e8:e9:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 3820, 'fixed_ips': [{'subnet_id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:47:06Z', 'updated_at': '2022-05-12T15:47:11Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:13.051264 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-45d6148a-270b-4e0d-a3b4-3c3ad478c469 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.054666 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab6c8e6c-abc6-4788-bca2-b6a0c55fb275 None None] The sync data for ids ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'] in n-d-841483-1 is: [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87'}], 'enable_snat': True}, 'gw_port_id': '0b130198-953d-4f1e-95d3-4d8791331284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:47:07Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '0b130198-953d-4f1e-95d3-4d8791331284', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:e5:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3802, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:46:59Z', 'updated_at': '2022-05-12T15:47:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c6584f69-ed28-4741-b68f-c92c73eccc19', 'name': '', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:e8:e9:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 3820, 'fixed_ips': [{'subnet_id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:47:06Z', 'updated_at': '2022-05-12T15:47:11Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:47:13.078125 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.118830 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.122235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] Pushing event deleted for resources: {'Network': ['ID=144e0d0a-a7de-4e63-8a93-dfaca53a8328,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:13.144115 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e45a2148-d248-4ff8-9182-d637b8f996f1 admin admin] 10.222.0.82 "DELETE /v2.0/networks/144e0d0a-a7de-4e63-8a93-dfaca53a8328 HTTP/1.1" status: 204 len: 168 time: 2.3191338 May 12 15:47:13.156686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-58051b45-29c6-44f1-821b-faa121639376 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:13.185949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-58051b45-29c6-44f1-821b-faa121639376 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:13.193237 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-58051b45-29c6-44f1-821b-faa121639376 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.3032854 May 12 15:47:13.194038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47474) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:13.195230 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-45d6148a-270b-4e0d-a3b4-3c3ad478c469 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.201234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-78ba6b4e-41b3-4106-88fd-8e5d7c43293b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group': {'name': 'tempest-secgroup--899846145'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:13.202807 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-45d6148a-270b-4e0d-a3b4-3c3ad478c469 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.212780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-78ba6b4e-41b3-4106-88fd-8e5d7c43293b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:13.224069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-78ba6b4e-41b3-4106-88fd-8e5d7c43293b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:13.246939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-78ba6b4e-41b3-4106-88fd-8e5d7c43293b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.261442 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-04ac02a7-8822-42a2-b863-ad8b26631ab9 None None] Deleting port a3ca589c-46a4-47c6-a8a8-4cbc670fb19c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:47:13.261944 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-04ac02a7-8822-42a2-b863-ad8b26631ab9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.293623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45d6148a-270b-4e0d-a3b4-3c3ad478c469 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2f046f90-1df7-4927-9ed0-99c312c4bebf,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:13.321291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-78ba6b4e-41b3-4106-88fd-8e5d7c43293b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:13.322986 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-45d6148a-270b-4e0d-a3b4-3c3ad478c469 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.323302 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-45d6148a-270b-4e0d-a3b4-3c3ad478c469 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.6403208 May 12 15:47:13.325964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47480) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:13.326433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-78ba6b4e-41b3-4106-88fd-8e5d7c43293b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:13.332006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e216e257-3532-4af1-9515-031309d2a03d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': '52328bfc-80e0-4587-961a-a4facf47e8a6', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:13.335774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-78ba6b4e-41b3-4106-88fd-8e5d7c43293b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:13.345724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-78ba6b4e-41b3-4106-88fd-8e5d7c43293b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:13.348539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e216e257-3532-4af1-9515-031309d2a03d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:13.359229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e216e257-3532-4af1-9515-031309d2a03d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:13.367420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e216e257-3532-4af1-9515-031309d2a03d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:13.374109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e216e257-3532-4af1-9515-031309d2a03d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:13.402842 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e216e257-3532-4af1-9515-031309d2a03d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.405347 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.415946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-04ac02a7-8822-42a2-b863-ad8b26631ab9 None None] The port 'a3ca589c-46a4-47c6-a8a8-4cbc670fb19c' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:47:13.478227 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e216e257-3532-4af1-9515-031309d2a03d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.480916 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-78ba6b4e-41b3-4106-88fd-8e5d7c43293b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.484565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47486) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:13.488941 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-78ba6b4e-41b3-4106-88fd-8e5d7c43293b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.493607 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e216e257-3532-4af1-9515-031309d2a03d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.540358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e216e257-3532-4af1-9515-031309d2a03d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9ae75ae3-a201-4ed0-b84d-51cf598a20fb,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:13.545294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78ba6b4e-41b3-4106-88fd-8e5d7c43293b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8fe4f93f-d125-4136-a195-8414b5b69388,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:13.555339 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-78ba6b4e-41b3-4106-88fd-8e5d7c43293b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.556542 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-78ba6b4e-41b3-4106-88fd-8e5d7c43293b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 0.3611844 May 12 15:47:13.559263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47490) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:13.568627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group': {'name': 'tempest-secgroup--2134606991'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:13.576363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:13.581371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:13.584296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:13.593887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:13.605304 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.615773 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e216e257-3532-4af1-9515-031309d2a03d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.619722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e216e257-3532-4af1-9515-031309d2a03d tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2928154 May 12 15:47:13.621938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47494) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:13.630202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bcc36342-b50c-4874-b17e-4ff07d5d125f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0528307b42774c45be9eba4ffc91c8dd&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1424651 May 12 15:47:13.630415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f61d49c4-b739-45fb-866e-aac599a4b9d9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': '52328bfc-80e0-4587-961a-a4facf47e8a6', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:13.632763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47498) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:13.638090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:13.641305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f61d49c4-b739-45fb-866e-aac599a4b9d9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:13.647014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:13.649989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f61d49c4-b739-45fb-866e-aac599a4b9d9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:13.652451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:13.655172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f61d49c4-b739-45fb-866e-aac599a4b9d9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:13.663485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:13.665564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f61d49c4-b739-45fb-866e-aac599a4b9d9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:13.699561 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f61d49c4-b739-45fb-866e-aac599a4b9d9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.725769 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0811500-494e-499e-b636-4bb125c3875d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.736757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5f78b50-19e7-4b84-a439-7824f88b4051 req-f93506d6-b422-4d4f-ae0d-7f8c2d480e38 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:13.738528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5f78b50-19e7-4b84-a439-7824f88b4051 req-f93506d6-b422-4d4f-ae0d-7f8c2d480e38 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.1716573 May 12 15:47:13.787130 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0811500-494e-499e-b636-4bb125c3875d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.829371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5f78b50-19e7-4b84-a439-7824f88b4051 req-d1a643ca-8f9d-40f4-8f71-2ed90500e3da tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0834348 May 12 15:47:13.868396 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0811500-494e-499e-b636-4bb125c3875d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.889589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0811500-494e-499e-b636-4bb125c3875d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0d10c60f-7be4-4e31-b4dd-6ecb90920a8e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:13.902617 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a0811500-494e-499e-b636-4bb125c3875d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.910998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a0811500-494e-499e-b636-4bb125c3875d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0d10c60f-7be4-4e31-b4dd-6ecb90920a8e HTTP/1.1" status: 204 len: 168 time: 0.2764461 May 12 15:47:13.918303 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.936843 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f61d49c4-b739-45fb-866e-aac599a4b9d9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.938581 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:13.958068 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f61d49c4-b739-45fb-866e-aac599a4b9d9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.011150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f61d49c4-b739-45fb-866e-aac599a4b9d9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c9532989-de4c-46fa-b823-67edb8ee3e39,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:14.022667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroup': ['ID=49d2a206-142b-4acb-88c1-9de4620cb40d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:14.027583 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.029043 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-70f9c239-8a8a-4824-ba6d-feab04162355 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1746 time: 0.4687202 May 12 15:47:14.032920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47504) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:14.034982 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f61d49c4-b739-45fb-866e-aac599a4b9d9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.038970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f61d49c4-b739-45fb-866e-aac599a4b9d9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4136474 May 12 15:47:14.039105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4b177a9d-e2ec-4128-b3e0-0948cb99520c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group_rule': {'security_group_id': '8fe4f93f-d125-4136-a195-8414b5b69388', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': '49d2a206-142b-4acb-88c1-9de4620cb40d', 'remote_ip_prefix': None}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:14.039461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47508) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:14.044910 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-fae315dc-7435-449c-8c6c-e145e230a2fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': '52328bfc-80e0-4587-961a-a4facf47e8a6', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:14.047077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4b177a9d-e2ec-4128-b3e0-0948cb99520c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:14.051912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4b177a9d-e2ec-4128-b3e0-0948cb99520c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:14.053623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fae315dc-7435-449c-8c6c-e145e230a2fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:14.056423 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4b177a9d-e2ec-4128-b3e0-0948cb99520c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:14.063359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4b177a9d-e2ec-4128-b3e0-0948cb99520c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:14.066590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fae315dc-7435-449c-8c6c-e145e230a2fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:14.072415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fae315dc-7435-449c-8c6c-e145e230a2fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:14.079798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fae315dc-7435-449c-8c6c-e145e230a2fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:14.091885 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-fae315dc-7435-449c-8c6c-e145e230a2fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Project b641518781114418963451fc3ff58f4d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:47:14.103226 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fae315dc-7435-449c-8c6c-e145e230a2fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.104628 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4b177a9d-e2ec-4128-b3e0-0948cb99520c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.196029 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fae315dc-7435-449c-8c6c-e145e230a2fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.198045 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4b177a9d-e2ec-4128-b3e0-0948cb99520c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.201441 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fae315dc-7435-449c-8c6c-e145e230a2fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.204479 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4b177a9d-e2ec-4128-b3e0-0948cb99520c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.241699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b177a9d-e2ec-4128-b3e0-0948cb99520c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bb67dc4f-bb22-401b-a82b-fc5b05edf61c,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:14.253848 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4b177a9d-e2ec-4128-b3e0-0948cb99520c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.253848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4b177a9d-e2ec-4128-b3e0-0948cb99520c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.2197733 May 12 15:47:14.256563 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47514) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:14.260293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fae315dc-7435-449c-8c6c-e145e230a2fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5e09a67c-c3b3-42c6-beaa-ecbb26625df2,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:14.289210 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a8ed499-68b7-4d2f-966c-8a25d7f180e6 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.295204 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fae315dc-7435-449c-8c6c-e145e230a2fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.299011 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fae315dc-7435-449c-8c6c-e145e230a2fb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2584584 May 12 15:47:14.301639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47518) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:14.302413 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a8ed499-68b7-4d2f-966c-8a25d7f180e6 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.309278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-02e9e461-080d-4563-9fe5-5833d3f65acf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'security_group_rule': {'security_group_id': '52328bfc-80e0-4587-961a-a4facf47e8a6', 'project_id': 'b641518781114418963451fc3ff58f4d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:14.324182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-02e9e461-080d-4563-9fe5-5833d3f65acf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:14.334744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-02e9e461-080d-4563-9fe5-5833d3f65acf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:security_group_rule and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:14.338567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-02e9e461-080d-4563-9fe5-5833d3f65acf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:14.350989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-02e9e461-080d-4563-9fe5-5833d3f65acf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:14.365947 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a8ed499-68b7-4d2f-966c-8a25d7f180e6 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.383205 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-02e9e461-080d-4563-9fe5-5833d3f65acf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Project b641518781114418963451fc3ff58f4d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:47:14.394783 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02e9e461-080d-4563-9fe5-5833d3f65acf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.400791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a8ed499-68b7-4d2f-966c-8a25d7f180e6 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=bb67dc4f-bb22-401b-a82b-fc5b05edf61c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:14.415072 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a8ed499-68b7-4d2f-966c-8a25d7f180e6 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.416192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6a8ed499-68b7-4d2f-966c-8a25d7f180e6 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/bb67dc4f-bb22-401b-a82b-fc5b05edf61c HTTP/1.1" status: 204 len: 168 time: 0.1586587 May 12 15:47:14.418894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47526) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:14.457855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c6584f69-ed28-4741-b68f-c92c73eccc19 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:47:14.488048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47532) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:14.492949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5c8a7ce8-d603-49e2-99b3-696f95205036 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:14.517793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5c8a7ce8-d603-49e2-99b3-696f95205036 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:14.519726 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5c8a7ce8-d603-49e2-99b3-696f95205036 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.0998685 May 12 15:47:14.522812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47538) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:14.553331 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ed287fac-6a3e-488a-852f-06dee15e3252 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d5937b60103242ddb97055720836a8ff&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0637000 May 12 15:47:14.553948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47542) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:14.577800 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02e9e461-080d-4563-9fe5-5833d3f65acf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.597736 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02e9e461-080d-4563-9fe5-5833d3f65acf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.619188 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-609eab4c-d106-4fe2-8725-1669693b1dc8 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.628381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port c6584f69-ed28-4741-b68f-c92c73eccc19 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:47:14.642942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c6584f69-ed28-4741-b68f-c92c73eccc19 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:47:14.643665 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.667581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02e9e461-080d-4563-9fe5-5833d3f65acf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5bb3bce3-6fe1-44ba-b80f-e3fabd714c1d,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:14.691805 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-02e9e461-080d-4563-9fe5-5833d3f65acf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.692977 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-02e9e461-080d-4563-9fe5-5833d3f65acf tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3888435 May 12 15:47:14.693110 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-609eab4c-d106-4fe2-8725-1669693b1dc8 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.732983 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ae41167-d0d0-4358-a07b-a19a984b4e88 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.778486 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-609eab4c-d106-4fe2-8725-1669693b1dc8 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.799445 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ae41167-d0d0-4358-a07b-a19a984b4e88 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.822535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-609eab4c-d106-4fe2-8725-1669693b1dc8 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=49d2a206-142b-4acb-88c1-9de4620cb40d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:14.838844 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-609eab4c-d106-4fe2-8725-1669693b1dc8 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.839960 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-609eab4c-d106-4fe2-8725-1669693b1dc8 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-groups/49d2a206-142b-4acb-88c1-9de4620cb40d HTTP/1.1" status: 204 len: 168 time: 0.3156669 May 12 15:47:14.842954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47560) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:14.864202 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.902932 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port c6584f69-ed28-4741-b68f-c92c73eccc19, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c6584f69-ed28-4741-b68f-c92c73eccc19,segment=NetworkSegment(384ff5b9-795f-4199-b25d-4d1f08782bc8),segment_id=384ff5b9-795f-4199-b25d-4d1f08782bc8)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:14.908240 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.923860 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ae41167-d0d0-4358-a07b-a19a984b4e88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.953331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ae41167-d0d0-4358-a07b-a19a984b4e88 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4637d26-7910-47c2-bb11-c83f5434778d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:14.970564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1fdb4926-86cb-4d9e-b0d9-1829151016d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:14.972229 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7ae41167-d0d0-4358-a07b-a19a984b4e88 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:14.975748 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7ae41167-d0d0-4358-a07b-a19a984b4e88 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d4637d26-7910-47c2-bb11-c83f5434778d HTTP/1.1" status: 204 len: 168 time: 0.4121978 May 12 15:47:14.995979 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1fdb4926-86cb-4d9e-b0d9-1829151016d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:14.997663 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1fdb4926-86cb-4d9e-b0d9-1829151016d2 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4510 time: 0.1537013 May 12 15:47:15.001059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47572) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:15.055151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=c6584f69-ed28-4741-b68f-c92c73eccc19,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:15.084004 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:15.084360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:15.084656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:15.084979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:15.085296 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:15.085645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:15.085957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:15.086267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:15.086578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:15.086887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:15.087195 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:15.087712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:47:15.121125 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2626969-e282-4072-9b67-062f496af3c1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:15.174506 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2626969-e282-4072-9b67-062f496af3c1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:15.198244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-597c1db9-0b61-4cf2-b6b7-244b6d9ed73c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:15.221100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144be5ab-73f2-4698-b8da-1a2a12b76b9d req-f140b89c-dc32-439b-b521-7c5ade97b0b3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:15.222624 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-144be5ab-73f2-4698-b8da-1a2a12b76b9d req-f140b89c-dc32-439b-b521-7c5ade97b0b3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.1549752 May 12 15:47:15.230132 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2626969-e282-4072-9b67-062f496af3c1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:15.253044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2626969-e282-4072-9b67-062f496af3c1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8fe4f93f-d125-4136-a195-8414b5b69388,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:15.255032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-597c1db9-0b61-4cf2-b6b7-244b6d9ed73c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:15.256376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-597c1db9-0b61-4cf2-b6b7-244b6d9ed73c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-852714710&fields=id&tenant_id=b641518781114418963451fc3ff58f4d HTTP/1.1" status: 200 len: 267 time: 0.1231353 May 12 15:47:15.275058 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a2626969-e282-4072-9b67-062f496af3c1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:15.276222 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a2626969-e282-4072-9b67-062f496af3c1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-groups/8fe4f93f-d125-4136-a195-8414b5b69388 HTTP/1.1" status: 204 len: 168 time: 0.2740195 May 12 15:47:15.278608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47596) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:15.314958 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0c1bb0fb-102c-4d90-894b-07f21e262e6e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:15.350091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c77d5633-1a56-4f88-9c82-6fb6e271abef tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:15.352622 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-144be5ab-73f2-4698-b8da-1a2a12b76b9d req-bfba622d-0d90-4bcc-8842-85080b3e33bb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1179538 May 12 15:47:15.420313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c77d5633-1a56-4f88-9c82-6fb6e271abef tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:15.427073 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c77d5633-1a56-4f88-9c82-6fb6e271abef tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.1434746 May 12 15:47:15.427495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47604) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:15.433000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-dd742a8e-0061-4351-9926-424c64cd4444 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group': {'name': 'tempest-secgroup--326533806'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:15.441894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dd742a8e-0061-4351-9926-424c64cd4444 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:15.452095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dd742a8e-0061-4351-9926-424c64cd4444 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:15.464977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd742a8e-0061-4351-9926-424c64cd4444 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:15.503693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dd742a8e-0061-4351-9926-424c64cd4444 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:15.508457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dd742a8e-0061-4351-9926-424c64cd4444 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:15.511755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dd742a8e-0061-4351-9926-424c64cd4444 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:15.519224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dd742a8e-0061-4351-9926-424c64cd4444 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:15.520753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-f71e7544-362a-4191-9929-fe236018be03 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:15.522285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-f71e7544-362a-4191-9929-fe236018be03 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:15.554654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-f71e7544-362a-4191-9929-fe236018be03 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:15.556488 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-f71e7544-362a-4191-9929-fe236018be03 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/networks?id=27a3a31e-244b-4431-86b4-73b53f4f0c89 HTTP/1.1" status: 200 len: 796 time: 0.2720666 May 12 15:47:15.582039 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-c2f6b61a-ec68-4449-9a03-8b1792c412d4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/quotas/b641518781114418963451fc3ff58f4d HTTP/1.1" status: 200 len: 375 time: 0.0181870 May 12 15:47:15.662560 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd742a8e-0061-4351-9926-424c64cd4444 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:15.668186 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd742a8e-0061-4351-9926-424c64cd4444 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:15.725650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd742a8e-0061-4351-9926-424c64cd4444 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f7ab33ec-7168-4c24-b17a-533290b8f4ee,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:15.735762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-6ed9f3f0-0ec5-4682-9b6b-47679106e9a9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:15.739178 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dd742a8e-0061-4351-9926-424c64cd4444 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:15.741334 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dd742a8e-0061-4351-9926-424c64cd4444 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 0.3126984 May 12 15:47:15.744178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47614) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:15.751567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-190f2dc5-8e26-4768-9915-0793024b8737 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group_rule': {'security_group_id': 'f7ab33ec-7168-4c24-b17a-533290b8f4ee', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:15.759467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-190f2dc5-8e26-4768-9915-0793024b8737 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:15.765439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-6ed9f3f0-0ec5-4682-9b6b-47679106e9a9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:15.766384 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-190f2dc5-8e26-4768-9915-0793024b8737 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:15.767561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-6ed9f3f0-0ec5-4682-9b6b-47679106e9a9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1797364 May 12 15:47:15.783880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-190f2dc5-8e26-4768-9915-0793024b8737 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:15.793657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-190f2dc5-8e26-4768-9915-0793024b8737 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:15.818826 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-190f2dc5-8e26-4768-9915-0793024b8737 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:15.907688 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-190f2dc5-8e26-4768-9915-0793024b8737 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:15.912135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-190f2dc5-8e26-4768-9915-0793024b8737 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:15.938218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-190f2dc5-8e26-4768-9915-0793024b8737 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=641cf52d-3a45-4979-8674-8ac496dbfe72,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:15.959279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-190f2dc5-8e26-4768-9915-0793024b8737 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:15.960458 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-190f2dc5-8e26-4768-9915-0793024b8737 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.2151399 May 12 15:47:15.963432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47618) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:15.970681 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-a15a33af-1062-40ed-8ad5-d90e03ecaac9 service neutron] 10.222.0.82 "GET /v2.0/networks/27a3a31e-244b-4431-86b4-73b53f4f0c89?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1848822 May 12 15:47:15.998671 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c77e3709-f10f-4b55-9710-c6400c9d4f2b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:16.012712 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c77e3709-f10f-4b55-9710-c6400c9d4f2b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:16.039373 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c77e3709-f10f-4b55-9710-c6400c9d4f2b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:16.044233 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:16.062022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c77e3709-f10f-4b55-9710-c6400c9d4f2b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=641cf52d-3a45-4979-8674-8ac496dbfe72,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:16.064589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c77e3709-f10f-4b55-9710-c6400c9d4f2b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:16.068022 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c77e3709-f10f-4b55-9710-c6400c9d4f2b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/641cf52d-3a45-4979-8674-8ac496dbfe72 HTTP/1.1" status: 204 len: 168 time: 0.1010005 May 12 15:47:16.068589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47622) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:16.162485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4f18e23d-0592-4cac-b1e9-8fd490fd11d7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:16.180744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-a05a615d-d526-4be8-a0e5-b691ce9c0d67 service neutron] 10.222.0.82 "GET /v2.0/networks/27a3a31e-244b-4431-86b4-73b53f4f0c89?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2030344 May 12 15:47:16.191603 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4f18e23d-0592-4cac-b1e9-8fd490fd11d7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:16.193414 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4f18e23d-0592-4cac-b1e9-8fd490fd11d7 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1239436 May 12 15:47:16.195994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47626) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:16.275142 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:16.307631 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53b474a0-bee5-4a61-ac8b-cbe607c87459 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:16.343858 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53b474a0-bee5-4a61-ac8b-cbe607c87459 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:16.388930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c6584f69-ed28-4741-b68f-c92c73eccc19 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:47:16.491329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-42aa0d2b-1535-4a1e-bafc-1308811e4499 req-f1da3c5c-6da7-45e2-9c7c-65d0310eb004 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 210 time: 0.0575597 May 12 15:47:16.492081 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53b474a0-bee5-4a61-ac8b-cbe607c87459 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:16.547155 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c6584f69-ed28-4741-b68f-c92c73eccc19 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:47:16.547155 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:16.572085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53b474a0-bee5-4a61-ac8b-cbe607c87459 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7ab33ec-7168-4c24-b17a-533290b8f4ee,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:16.615575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53b474a0-bee5-4a61-ac8b-cbe607c87459 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:16.619765 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-53b474a0-bee5-4a61-ac8b-cbe607c87459 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-groups/f7ab33ec-7168-4c24-b17a-533290b8f4ee HTTP/1.1" status: 204 len: 168 time: 0.4228244 May 12 15:47:16.622488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47638) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:16.716454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a2523c7-9d7b-48f9-b149-1c99cd3266ad req-6e91cce5-51bf-46d8-9d2b-18720f8ae5bc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:16.720745 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a2523c7-9d7b-48f9-b149-1c99cd3266ad req-6e91cce5-51bf-46d8-9d2b-18720f8ae5bc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.2124574 May 12 15:47:16.746728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-01345f84-33b0-4af3-8c74-63b3cf3e8b0f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:16.771182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-01345f84-33b0-4af3-8c74-63b3cf3e8b0f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:16.772398 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-01345f84-33b0-4af3-8c74-63b3cf3e8b0f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.1483636 May 12 15:47:16.776534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47646) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:16.783507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4e05fe3a-813f-4555-a38d-f2557eb1465b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group': {'name': 'tempest-secgroup--355860105'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:16.794373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4e05fe3a-813f-4555-a38d-f2557eb1465b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:16.802924 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a2523c7-9d7b-48f9-b149-1c99cd3266ad req-d3c4e310-8aae-4ca2-a0b8-0fa2aba4f2a4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0753396 May 12 15:47:16.817692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4e05fe3a-813f-4555-a38d-f2557eb1465b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:16.831279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e05fe3a-813f-4555-a38d-f2557eb1465b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:16.852032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4e05fe3a-813f-4555-a38d-f2557eb1465b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:16.856261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4e05fe3a-813f-4555-a38d-f2557eb1465b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:16.859135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4e05fe3a-813f-4555-a38d-f2557eb1465b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:16.864906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4e05fe3a-813f-4555-a38d-f2557eb1465b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:16.947399 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e05fe3a-813f-4555-a38d-f2557eb1465b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:16.952156 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e05fe3a-813f-4555-a38d-f2557eb1465b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.005040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e05fe3a-813f-4555-a38d-f2557eb1465b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c3489fca-3f7d-4379-b446-70663cd54600,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:17.026906 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e05fe3a-813f-4555-a38d-f2557eb1465b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.031056 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4e05fe3a-813f-4555-a38d-f2557eb1465b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 0.2514493 May 12 15:47:17.031363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47652) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:17.036644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4daebc03-fb5f-4564-8154-bb178af2b4ff tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group_rule': {'security_group_id': 'c3489fca-3f7d-4379-b446-70663cd54600', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:17.043891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4daebc03-fb5f-4564-8154-bb178af2b4ff tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:17.048295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4daebc03-fb5f-4564-8154-bb178af2b4ff tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:17.051436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4daebc03-fb5f-4564-8154-bb178af2b4ff tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:17.057639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4daebc03-fb5f-4564-8154-bb178af2b4ff tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:17.076108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4daebc03-fb5f-4564-8154-bb178af2b4ff tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.145308 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4daebc03-fb5f-4564-8154-bb178af2b4ff tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.149083 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4daebc03-fb5f-4564-8154-bb178af2b4ff tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.171881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4daebc03-fb5f-4564-8154-bb178af2b4ff tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7cf36c3e-55dc-43f6-a635-a26654398729,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:17.191176 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4daebc03-fb5f-4564-8154-bb178af2b4ff tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.192363 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4daebc03-fb5f-4564-8154-bb178af2b4ff tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1600640 May 12 15:47:17.195220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47656) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:17.214018 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7b5a862a-e5dc-4e28-a822-539ee8283ce0 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules/7cf36c3e-55dc-43f6-a635-a26654398729 HTTP/1.1" status: 200 len: 763 time: 0.0178876 May 12 15:47:17.216374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47660) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:17.272310 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-63a9f49d-4495-4b34-aa0b-e2e84a670528 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:17.290028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-63a9f49d-4495-4b34-aa0b-e2e84a670528 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:17.294221 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-63a9f49d-4495-4b34-aa0b-e2e84a670528 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0743787 May 12 15:47:17.294914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47664) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:17.328746 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2146bc17-f168-4b68-95c8-197424b21812 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.338881 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2146bc17-f168-4b68-95c8-197424b21812 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.362775 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2146bc17-f168-4b68-95c8-197424b21812 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.380847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2146bc17-f168-4b68-95c8-197424b21812 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=7cf36c3e-55dc-43f6-a635-a26654398729,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:17.387898 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2146bc17-f168-4b68-95c8-197424b21812 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.389027 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2146bc17-f168-4b68-95c8-197424b21812 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/7cf36c3e-55dc-43f6-a635-a26654398729 HTTP/1.1" status: 204 len: 168 time: 0.0913403 May 12 15:47:17.391639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47668) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:17.437410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3bc747ca-6036-4f2a-ae05-e188508b2b1f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:17.451774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3bc747ca-6036-4f2a-ae05-e188508b2b1f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:17.453026 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3bc747ca-6036-4f2a-ae05-e188508b2b1f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0605018 May 12 15:47:17.455740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47672) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:17.460491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-af578765-ab89-4d96-96d2-7a982487bcfa tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group_rule': {'security_group_id': 'c3489fca-3f7d-4379-b446-70663cd54600', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:17.466817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-af578765-ab89-4d96-96d2-7a982487bcfa tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:17.476596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-af578765-ab89-4d96-96d2-7a982487bcfa tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:17.492169 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af578765-ab89-4d96-96d2-7a982487bcfa tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.555469 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af578765-ab89-4d96-96d2-7a982487bcfa tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.559291 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af578765-ab89-4d96-96d2-7a982487bcfa tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.582536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af578765-ab89-4d96-96d2-7a982487bcfa tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=872a34d9-6cb6-49f6-a94c-398c5f20af57,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:17.598717 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af578765-ab89-4d96-96d2-7a982487bcfa tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.600123 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-af578765-ab89-4d96-96d2-7a982487bcfa tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1434057 May 12 15:47:17.602769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47678) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:17.623507 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-158418d5-86cc-4eac-b231-4ef365562173 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules/872a34d9-6cb6-49f6-a94c-398c5f20af57 HTTP/1.1" status: 200 len: 763 time: 0.0196078 May 12 15:47:17.626802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47682) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:17.666065 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-97abcb4f-0f23-420e-9697-a5a28ed9ea7a req-e42d715e-51e1-4a31-926c-e0f294ea6598 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 210 time: 0.0560393 May 12 15:47:17.679175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-be5f8cb6-2761-491a-b7b0-dfecd30593dd tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:17.697675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-be5f8cb6-2761-491a-b7b0-dfecd30593dd tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:17.701466 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-be5f8cb6-2761-491a-b7b0-dfecd30593dd tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0712802 May 12 15:47:17.701729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47686) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:17.731860 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11931c88-ba95-490a-a510-6384b07f964e tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.739862 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.743887 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11931c88-ba95-490a-a510-6384b07f964e tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.849422 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11931c88-ba95-490a-a510-6384b07f964e tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.884160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11931c88-ba95-490a-a510-6384b07f964e tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=872a34d9-6cb6-49f6-a94c-398c5f20af57,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:17.898822 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-11931c88-ba95-490a-a510-6384b07f964e tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:17.903132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47696) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:17.904105 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-11931c88-ba95-490a-a510-6384b07f964e tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/872a34d9-6cb6-49f6-a94c-398c5f20af57 HTTP/1.1" status: 204 len: 168 time: 0.1995280 May 12 15:47:17.991434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-e6ea8885-683e-4a02-96b2-4d99c7442a3f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:17.992778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-e6ea8885-683e-4a02-96b2-4d99c7442a3f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:18.008180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-e6ea8885-683e-4a02-96b2-4d99c7442a3f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:18.009431 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-e6ea8885-683e-4a02-96b2-4d99c7442a3f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "GET /v2.0/networks?id=27a3a31e-244b-4431-86b4-73b53f4f0c89 HTTP/1.1" status: 200 len: 796 time: 0.2393258 May 12 15:47:18.087720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-092b995c-805a-4b67-b55a-b2108d2ce589 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:18.102693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-092b995c-805a-4b67-b55a-b2108d2ce589 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:18.103921 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-092b995c-805a-4b67-b55a-b2108d2ce589 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b641518781114418963451fc3ff58f4d HTTP/1.1" status: 200 len: 379 time: 0.0679784 May 12 15:47:18.134237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'port': {'device_id': '876c4deb-264b-4d18-a670-939dd27bf316', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'admin_state_up': True, 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'security_groups': ['52328bfc-80e0-4587-961a-a4facf47e8a6']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:18.160260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-233748d4-ca48-4822-8e8f-9903f97af79c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:18.188520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-233748d4-ca48-4822-8e8f-9903f97af79c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:18.189700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-233748d4-ca48-4822-8e8f-9903f97af79c tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.2858036 May 12 15:47:18.193963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47702) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:18.198403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-01b4e7fd-9aaf-4b0e-a6f9-8f8c71c03018 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group_rule': {'security_group_id': 'c3489fca-3f7d-4379-b446-70663cd54600', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:18.206243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-01b4e7fd-9aaf-4b0e-a6f9-8f8c71c03018 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:18.220270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-01b4e7fd-9aaf-4b0e-a6f9-8f8c71c03018 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:18.230939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4636f3b7-5335-4590-a44f-d12aacb60a75 req-0bf84b7f-c79c-40fe-b5dc-1f5895d6ab08 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:18.232405 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4636f3b7-5335-4590-a44f-d12aacb60a75 req-0bf84b7f-c79c-40fe-b5dc-1f5895d6ab08 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.2526202 May 12 15:47:18.256564 n-d-841483-1 neutron-server[88152]: INFO neutron.db.securitygroups_db [None req-01b4e7fd-9aaf-4b0e-a6f9-8f8c71c03018 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Project d8a7abf57655417b870028442e5a6a34 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:47:18.267481 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01b4e7fd-9aaf-4b0e-a6f9-8f8c71c03018 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:18.306648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:18.320839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:18.323027 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4636f3b7-5335-4590-a44f-d12aacb60a75 req-c65fff8c-0e21-4173-9d34-2f7921baf563 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0834768 May 12 15:47:18.338451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Made reservation on behalf of b641518781114418963451fc3ff58f4d for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:47:18.342204 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:18.364106 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01b4e7fd-9aaf-4b0e-a6f9-8f8c71c03018 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:18.369350 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01b4e7fd-9aaf-4b0e-a6f9-8f8c71c03018 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:18.392196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01b4e7fd-9aaf-4b0e-a6f9-8f8c71c03018 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a67b64b9-dc98-4551-938a-5e0d3aa9ffa0,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:18.407927 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-01b4e7fd-9aaf-4b0e-a6f9-8f8c71c03018 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:18.412289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-01b4e7fd-9aaf-4b0e-a6f9-8f8c71c03018 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2150226 May 12 15:47:18.412638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47706) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:18.451441 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1fa5f018-83fb-41f2-812f-2330f02684cb tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules/a67b64b9-dc98-4551-938a-5e0d3aa9ffa0 HTTP/1.1" status: 200 len: 769 time: 0.0376859 May 12 15:47:18.456960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47710) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:18.510784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7ff970f1-8b84-4eee-aabd-8842c6ccc0c8 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:18.527012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7ff970f1-8b84-4eee-aabd-8842c6ccc0c8 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:18.528788 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7ff970f1-8b84-4eee-aabd-8842c6ccc0c8 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4119 time: 0.0704989 May 12 15:47:18.531798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47714) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:18.542465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Allocated IP 172.20.0.11 (27a3a31e-244b-4431-86b4-73b53f4f0c89/4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610/95ac94e2-2622-4853-b774-aa79cb57ca97) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:47:18.563555 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e0e9abc-4b60-4870-a862-0274f858d582 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:18.574509 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e0e9abc-4b60-4870-a862-0274f858d582 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:18.602412 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e0e9abc-4b60-4870-a862-0274f858d582 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:18.621348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e0e9abc-4b60-4870-a862-0274f858d582 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=a67b64b9-dc98-4551-938a-5e0d3aa9ffa0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:18.631662 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3e0e9abc-4b60-4870-a862-0274f858d582 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:18.633915 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3e0e9abc-4b60-4870-a862-0274f858d582 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-group-rules/a67b64b9-dc98-4551-938a-5e0d3aa9ffa0 HTTP/1.1" status: 204 len: 168 time: 0.1010044 May 12 15:47:18.635910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47718) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:18.689710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a1e9ecb4-7881-4f1e-9b55-177324bfb9af tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:18.708509 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a1e9ecb4-7881-4f1e-9b55-177324bfb9af tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:18.712720 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a1e9ecb4-7881-4f1e-9b55-177324bfb9af tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0723941 May 12 15:47:18.713076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47724) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:18.827468 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:18.834370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd3ca5c6-3822-4258-a1a2-0826f4053195 req-5ebc377c-d0ab-4abb-a34b-0ffa7f5627f9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 210 time: 0.0500751 May 12 15:47:18.836923 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3ba19f79-e60f-426d-a604-6bbe6596af4f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:18.862956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Transition to ACTIVE for port object 95ac94e2-2622-4853-b774-aa79cb57ca97 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:47:18.877351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3ba19f79-e60f-426d-a604-6bbe6596af4f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:18.947391 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:18.995305 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3ba19f79-e60f-426d-a604-6bbe6596af4f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:19.044481 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ba19f79-e60f-426d-a604-6bbe6596af4f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3489fca-3f7d-4379-b446-70663cd54600,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:19.051342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 27a3a31e-244b-4431-86b4-73b53f4f0c89 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:47:19.058555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:47:19.061967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:47:19.116131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=95ac94e2-2622-4853-b774-aa79cb57ca97,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:19.139465 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3ba19f79-e60f-426d-a604-6bbe6596af4f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:19.143371 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3ba19f79-e60f-426d-a604-6bbe6596af4f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-groups/c3489fca-3f7d-4379-b446-70663cd54600 HTTP/1.1" status: 204 len: 168 time: 0.4268570 May 12 15:47:19.144363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47730) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:19.174578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:19.175220 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:19.214599 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-aa0f52c8-d977-474c-9cfc-725fd8c3ae85 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0845275 May 12 15:47:19.226004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-61d61276-4ec1-4042-8a5b-41ddf7b5bf56 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:19.236202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Request body: {'port': {'device_id': '876c4deb-264b-4d18-a670-939dd27bf316', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:19.337274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-61d61276-4ec1-4042-8a5b-41ddf7b5bf56 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:19.339704 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-61d61276-4ec1-4042-8a5b-41ddf7b5bf56 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.1946638 May 12 15:47:19.344746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47736) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:19.350104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-bf9485a7-2b93-4728-bea5-0b0e2bcb1e8b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group': {'name': 'tempest-secgroup--139460691'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:19.357086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bf9485a7-2b93-4728-bea5-0b0e2bcb1e8b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:19.361380 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:19.368005 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bf9485a7-2b93-4728-bea5-0b0e2bcb1e8b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:19.380898 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf9485a7-2b93-4728-bea5-0b0e2bcb1e8b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:19.388148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cb26e81a-69da-4d51-b335-0d43363ce709 None None] Provisioning for port 95ac94e2-2622-4853-b774-aa79cb57ca97 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:47:19.394749 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cb26e81a-69da-4d51-b335-0d43363ce709 None None] Provisioning complete for port 95ac94e2-2622-4853-b774-aa79cb57ca97 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:47:19.406061 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cb26e81a-69da-4d51-b335-0d43363ce709 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:19.408009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bf9485a7-2b93-4728-bea5-0b0e2bcb1e8b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:19.414113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bf9485a7-2b93-4728-bea5-0b0e2bcb1e8b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:19.418654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bf9485a7-2b93-4728-bea5-0b0e2bcb1e8b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:19.427578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bf9485a7-2b93-4728-bea5-0b0e2bcb1e8b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:19.477804 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-cb26e81a-69da-4d51-b335-0d43363ce709 None None] Port 95ac94e2-2622-4853-b774-aa79cb57ca97 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:47:19.582290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec21c9c5-ee18-4266-b303-84133723a215 req-6cf691e6-7a96-4d04-95ef-9c388bf4a0ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:19.584181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec21c9c5-ee18-4266-b303-84133723a215 req-6cf691e6-7a96-4d04-95ef-9c388bf4a0ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.1501524 May 12 15:47:19.598008 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf9485a7-2b93-4728-bea5-0b0e2bcb1e8b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:19.612438 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf9485a7-2b93-4728-bea5-0b0e2bcb1e8b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:19.679608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf9485a7-2b93-4728-bea5-0b0e2bcb1e8b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6108f9b4-d828-4911-a3a5-cbc413053d2b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:19.703434 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec21c9c5-ee18-4266-b303-84133723a215 req-475e93a0-8da7-42ff-83b0-21d5a2b681d6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1083975 May 12 15:47:19.712651 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bf9485a7-2b93-4728-bea5-0b0e2bcb1e8b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:19.714087 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bf9485a7-2b93-4728-bea5-0b0e2bcb1e8b tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1745 time: 0.3682477 May 12 15:47:19.717489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47742) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:19.723303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4f2beb33-c7c4-4954-bd79-a738b3402b05 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Request body: {'security_group_rule': {'security_group_id': '6108f9b4-d828-4911-a3a5-cbc413053d2b', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:19.729722 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4f2beb33-c7c4-4954-bd79-a738b3402b05 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:19.733942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4f2beb33-c7c4-4954-bd79-a738b3402b05 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Usage tracker for resource:security_group_rule and tenant:d8a7abf57655417b870028442e5a6a34 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:19.737054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4f2beb33-c7c4-4954-bd79-a738b3402b05 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:19.742978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4f2beb33-c7c4-4954-bd79-a738b3402b05 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:19.762919 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4f2beb33-c7c4-4954-bd79-a738b3402b05 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:19.830349 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4f2beb33-c7c4-4954-bd79-a738b3402b05 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:19.834456 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4f2beb33-c7c4-4954-bd79-a738b3402b05 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:19.869908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f2beb33-c7c4-4954-bd79-a738b3402b05 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0996bc51-40d6-4c98-a9a5-1c45d76d4e6a,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:19.883136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 95ac94e2-2622-4853-b774-aa79cb57ca97 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:47:19.883653 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4f2beb33-c7c4-4954-bd79-a738b3402b05 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:19.884985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4f2beb33-c7c4-4954-bd79-a738b3402b05 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1657779 May 12 15:47:19.888271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47748) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:19.894894 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:19.914693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Transition to ACTIVE for port object 95ac94e2-2622-4853-b774-aa79cb57ca97 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:47:19.930688 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:20.042689 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce394a6d-f134-4916-bcb5-001f63b8cdc1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:20.084464 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce394a6d-f134-4916-bcb5-001f63b8cdc1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:20.109048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Pushing event updated for resources: {'Port': ['ID=95ac94e2-2622-4853-b774-aa79cb57ca97,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:20.144814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aae6515-a193-4165-82ae-da92340c68a3 req-b6ac40f2-3d1d-474a-9b27-6da33773da7b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:20.146859 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2aae6515-a193-4165-82ae-da92340c68a3 req-b6ac40f2-3d1d-474a-9b27-6da33773da7b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 944 time: 0.1749656 May 12 15:47:20.195642 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce394a6d-f134-4916-bcb5-001f63b8cdc1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:20.241136 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2aae6515-a193-4165-82ae-da92340c68a3 req-3b823cd3-3eb3-4645-8819-fe7ede76c059 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=52328bfc-80e0-4587-961a-a4facf47e8a6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0874000 May 12 15:47:20.241891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce394a6d-f134-4916-bcb5-001f63b8cdc1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6108f9b4-d828-4911-a3a5-cbc413053d2b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:20.282578 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce394a6d-f134-4916-bcb5-001f63b8cdc1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:20.287645 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ce394a6d-f134-4916-bcb5-001f63b8cdc1 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-groups/6108f9b4-d828-4911-a3a5-cbc413053d2b HTTP/1.1" status: 204 len: 168 time: 0.3963075 May 12 15:47:20.288756 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47758) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:20.342669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Attempting to bind port 95ac94e2-2622-4853-b774-aa79cb57ca97 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:47:20.343105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Attempting to bind port 95ac94e2-2622-4853-b774-aa79cb57ca97 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '384ff5b9-795f-4199-b25d-4d1f08782bc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:47:20.343528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Attempting to bind port 95ac94e2-2622-4853-b774-aa79cb57ca97 on network 27a3a31e-244b-4431-86b4-73b53f4f0c89 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:47:20.348868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Port 95ac94e2-2622-4853-b774-aa79cb57ca97 on network 27a3a31e-244b-4431-86b4-73b53f4f0c89 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:47:20.349315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Attempting to bind port 95ac94e2-2622-4853-b774-aa79cb57ca97 on network 27a3a31e-244b-4431-86b4-73b53f4f0c89 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:47:20.354801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 47, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:47:20.355259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Checking segment: {'id': '384ff5b9-795f-4199-b25d-4d1f08782bc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:47:20.355882 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Bound using segment: {'id': '384ff5b9-795f-4199-b25d-4d1f08782bc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:47:20.356404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Bound port: 95ac94e2-2622-4853-b774-aa79cb57ca97, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '384ff5b9-795f-4199-b25d-4d1f08782bc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 559, 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:47:20.356841 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:20.432341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8318413e-c617-40c2-863d-442dc11d3375 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:20.442685 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-940c6005-095f-450a-bc09-a09454f362e0 service neutron] show failed (client error): The resource could not be found. May 12 15:47:20.443593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-940c6005-095f-450a-bc09-a09454f362e0 service neutron] 10.222.0.84 "GET /v2.0/ports/2a5ee9ef-0363-4a82-b382-c38a8d19f1c6/bindings/n-h2-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.1190829 May 12 15:47:20.454887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] For port 95ac94e2-2622-4853-b774-aa79cb57ca97, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:47:20.458738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] For port 95ac94e2-2622-4853-b774-aa79cb57ca97, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=95ac94e2-2622-4853-b774-aa79cb57ca97,segment=NetworkSegment(384ff5b9-795f-4199-b25d-4d1f08782bc8),segment_id=384ff5b9-795f-4199-b25d-4d1f08782bc8)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:47:20.465089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8318413e-c617-40c2-863d-442dc11d3375 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:20.466897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8318413e-c617-40c2-863d-442dc11d3375 tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.1772182 May 12 15:47:20.469763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47762) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:20.470291 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:20.522958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-029f4ce8-958c-4fd7-bbd2-5ead5f13850f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Synchronizing usage tracker for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:20.544474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-029f4ce8-958c-4fd7-bbd2-5ead5f13850f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] Unset dirty status for tenant:d8a7abf57655417b870028442e5a6a34 on resource:security_group_rule {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:20.546820 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-029f4ce8-958c-4fd7-bbd2-5ead5f13850f tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 2475 time: 0.0757797 May 12 15:47:20.549641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47766) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:20.549792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:20.550615 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:20.552082 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] 10.222.0.84 "PUT /v2.0/ports/95ac94e2-2622-4853-b774-aa79cb57ca97 HTTP/1.1" status: 200 len: 1092 time: 1.3216257 May 12 15:47:20.552608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '876c4deb-264b-4d18-a670-939dd27bf316', 'tag': '95ac94e2-2622-4853-b774-aa79cb57ca97'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:47:20.571736 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-fc455ab0-995d-441f-9154-6dfef68898eb tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] delete failed (client error): The resource could not be found. May 12 15:47:20.572780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fc455ab0-995d-441f-9154-6dfef68898eb tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "DELETE /v2.0/security-groups/6108f9b4-d828-4911-a3a5-cbc413053d2b HTTP/1.1" status: 404 len: 347 time: 0.0216892 May 12 15:47:20.576341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7366da5e-e9a6-41ac-b263-141a05d71490 service neutron] Pushing event updated for resources: {'Port': ['ID=95ac94e2-2622-4853-b774-aa79cb57ca97,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:20.579060 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47772) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:20.640305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-43f91dbe-9d40-4787-84f5-d5cd11fbb7ca tempest-SecGroupIPv6Test-823985515 tempest-SecGroupIPv6Test-823985515-project] 10.222.0.82 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2983 time: 0.0587475 May 12 15:47:20.647481 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-df841181-6882-4c23-a23e-7b9a5a88553a'] response: {'name': 'network-changed', 'server_uuid': '876c4deb-264b-4d18-a670-939dd27bf316', 'tag': '95ac94e2-2622-4853-b774-aa79cb57ca97', 'status': 'completed', 'code': 200} May 12 15:47:20.886044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-90a742f6-11b9-49f4-a8db-23a94fb14548 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:20.886864 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-90a742f6-11b9-49f4-a8db-23a94fb14548 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 1095 time: 0.1893711 May 12 15:47:20.893902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-65ffae5c-485c-4151-bb29-d5853bede157 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:20.895486 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-65ffae5c-485c-4151-bb29-d5853bede157 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544&tenant_id=b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 1096 time: 0.1368177 May 12 15:47:20.908033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:20.941456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0db5d782-eb99-42dc-ae2c-ba257116c1f9 req-0d046086-9e84-49f1-9dfc-7462814ca033 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:20.941456 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0db5d782-eb99-42dc-ae2c-ba257116c1f9 req-0d046086-9e84-49f1-9dfc-7462814ca033 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.1246161 May 12 15:47:21.031340 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0db5d782-eb99-42dc-ae2c-ba257116c1f9 req-b50314b3-0ef6-49c9-9eec-80955b665a3c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0843146 May 12 15:47:21.068745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47782) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:21.115416 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-02088af6-6f4c-4f07-a167-c71e203bf99e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=95ac94e2-2622-4853-b774-aa79cb57ca97 HTTP/1.1" status: 200 len: 217 time: 0.1025624 May 12 15:47:21.172628 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:21.272943 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c26ab6f8-3fe4-41ab-93e7-a6d852b62380 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d8a7abf57655417b870028442e5a6a34&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1996739 May 12 15:47:21.273929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47790) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:21.288786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-41a9ae69-5013-4309-9c8b-b897b48254e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:21.290734 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-41a9ae69-5013-4309-9c8b-b897b48254e2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610 HTTP/1.1" status: 200 len: 835 time: 0.1627970 May 12 15:47:21.386600 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1c6f5bbc-1af7-4c1c-b972-2b3d793b5062 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:21.463473 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1c6f5bbc-1af7-4c1c-b972-2b3d793b5062 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:21.535607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-139d87e4-fd84-4e8f-8db8-37180afe02e9 req-d2bc8635-e904-4c35-9d55-fef4abf5846c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:21.537404 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-139d87e4-fd84-4e8f-8db8-37180afe02e9 req-d2bc8635-e904-4c35-9d55-fef4abf5846c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 944 time: 0.1342354 May 12 15:47:21.560057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-36fbe753-f794-453f-9a9e-2c3820690dd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:21.562595 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-36fbe753-f794-453f-9a9e-2c3820690dd4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=27a3a31e-244b-4431-86b4-73b53f4f0c89&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2609401 May 12 15:47:21.567663 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1c6f5bbc-1af7-4c1c-b972-2b3d793b5062 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:21.600517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c6f5bbc-1af7-4c1c-b972-2b3d793b5062 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92efa66b-463e-4234-86d5-3667cce0702c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:21.612071 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-139d87e4-fd84-4e8f-8db8-37180afe02e9 req-3148d884-2494-4628-81ae-aeffbf29a182 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=52328bfc-80e0-4587-961a-a4facf47e8a6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0669277 May 12 15:47:21.625673 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1c6f5bbc-1af7-4c1c-b972-2b3d793b5062 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:21.627214 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1c6f5bbc-1af7-4c1c-b972-2b3d793b5062 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/92efa66b-463e-4234-86d5-3667cce0702c HTTP/1.1" status: 204 len: 168 time: 0.3499849 May 12 15:47:21.830305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] For port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:21.884518 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-dd61a61b-f847-40ee-8613-41ef7f6a12f7 service neutron] 10.222.0.84 "GET /v2.0/networks/27a3a31e-244b-4431-86b4-73b53f4f0c89?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3150139 May 12 15:47:21.892108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] For port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:47:22.041264 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:22.074804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Transition to ACTIVE for port object 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:47:22.084818 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:22.143625 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-964f4aa5-1ce3-46d9-b6a2-a56695f7abc5 req-ad796be9-3655-4b0e-b176-c2ed291aefd4 service neutron] 10.222.0.84 "GET /v2.0/networks/27a3a31e-244b-4431-86b4-73b53f4f0c89?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2245986 May 12 15:47:22.275864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Pushing event updated for resources: {'Port': ['ID=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,revision_number=6']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:22.440886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] No DVR routers for this DVR port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:47:22.500613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 47822) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:22.515709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20631060-8e9c-482d-abcb-70ac229635a4 req-e74e1e42-3f29-4053-abac-9c656ddb350b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:22.517569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20631060-8e9c-482d-abcb-70ac229635a4 req-e74e1e42-3f29-4053-abac-9c656ddb350b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 943 time: 0.1456299 May 12 15:47:22.586827 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20631060-8e9c-482d-abcb-70ac229635a4 req-e12a55a3-0dbc-400d-9dfc-81eb1c232406 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0582380 May 12 15:47:22.659007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c0c7645-9e8f-43e6-9b63-af9954b5ea13 req-44c27c88-7b8e-40d2-8ec7-3129ae44ebbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:22.661845 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6c0c7645-9e8f-43e6-9b63-af9954b5ea13 req-44c27c88-7b8e-40d2-8ec7-3129ae44ebbd service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 1095 time: 0.3862433 May 12 15:47:22.661845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:47:22.726169 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-57360727-fbce-42b7-aaeb-e3c67797498e'] response: {'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'code': 200} May 12 15:47:22.752400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-932a1ce7-1138-4ca8-8890-b2d85bf355e0 tempest-SubnetPoolsTestJSON-675222614 tempest-SubnetPoolsTestJSON-675222614-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools-213347875', 'prefixes': ['172.20.0.0/16']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:22.759899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-932a1ce7-1138-4ca8-8890-b2d85bf355e0 tempest-SubnetPoolsTestJSON-675222614 tempest-SubnetPoolsTestJSON-675222614-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:22.840036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72e17653-c059-401b-8641-c8b942f3bdba req-a41cf1c9-4836-4971-aecc-2c1b2437f02b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:22.847464 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72e17653-c059-401b-8641-c8b942f3bdba req-a41cf1c9-4836-4971-aecc-2c1b2437f02b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 944 time: 0.0921109 May 12 15:47:22.896775 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72e17653-c059-401b-8641-c8b942f3bdba req-df3d4c59-dabc-4b93-b87e-6a976099b489 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=52328bfc-80e0-4587-961a-a4facf47e8a6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483992 May 12 15:47:22.914638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Attempting to bind port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:47:22.915186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Attempting to bind port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:47:22.915313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Attempting to bind port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 on network 96b03b8b-8b48-4742-a456-9d456e030e73 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:47:22.946486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 on network 96b03b8b-8b48-4742-a456-9d456e030e73 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:47:22.946807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Attempting to bind port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 on network 96b03b8b-8b48-4742-a456-9d456e030e73 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:47:22.968765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 47, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:47:22.969100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Checking segment: {'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:47:22.969523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Bound using segment: {'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:47:22.969955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Bound port: 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cf19c71b-ab00-459e-982f-b233b38347af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:47:22.970296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:22.990730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c0c7645-9e8f-43e6-9b63-af9954b5ea13 req-ebc2eedd-5c53-4e9e-bb1e-6d2e34f1f08d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:22.992169 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6c0c7645-9e8f-43e6-9b63-af9954b5ea13 req-ebc2eedd-5c53-4e9e-bb1e-6d2e34f1f08d service neutron] 10.222.0.84 "GET /v2.0/networks?id=27a3a31e-244b-4431-86b4-73b53f4f0c89 HTTP/1.1" status: 200 len: 897 time: 0.2696941 May 12 15:47:22.994774 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-932a1ce7-1138-4ca8-8890-b2d85bf355e0 tempest-SubnetPoolsTestJSON-675222614 tempest-SubnetPoolsTestJSON-675222614-project] Notify callbacks [] for subnetpool, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:22.998492 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-932a1ce7-1138-4ca8-8890-b2d85bf355e0 tempest-SubnetPoolsTestJSON-675222614 tempest-SubnetPoolsTestJSON-675222614-project] 10.222.0.82 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 736 time: 0.4958720 May 12 15:47:22.998651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47836) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:23.029959 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-22b7dd56-79d5-4b88-a4bc-6e0eb328d714 tempest-SubnetPoolsTestJSON-675222614 tempest-SubnetPoolsTestJSON-675222614-project] 10.222.0.82 "GET /v2.0/subnetpools/7b6b57cc-6be8-4510-bec4-bc82c03f6899 HTTP/1.1" status: 200 len: 731 time: 0.0295737 May 12 15:47:23.033029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47840) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:23.038492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c1c2c570-6760-4bfb-ac8c-f1a8137aa442 tempest-SubnetPoolsTestJSON-675222614 tempest-SubnetPoolsTestJSON-675222614-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools_update-1477422434'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:23.107455 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6c0c7645-9e8f-43e6-9b63-af9954b5ea13 req-927c941f-1daa-4e54-983e-d07d418fcf4d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=95ac94e2-2622-4853-b774-aa79cb57ca97 HTTP/1.1" status: 200 len: 217 time: 0.1061361 May 12 15:47:23.131106 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1c2c570-6760-4bfb-ac8c-f1a8137aa442 tempest-SubnetPoolsTestJSON-675222614 tempest-SubnetPoolsTestJSON-675222614-project] Notify callbacks [] for subnetpool, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:23.133432 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c1c2c570-6760-4bfb-ac8c-f1a8137aa442 tempest-SubnetPoolsTestJSON-675222614 tempest-SubnetPoolsTestJSON-675222614-project] 10.222.0.82 "PUT /v2.0/subnetpools/7b6b57cc-6be8-4510-bec4-bc82c03f6899 HTTP/1.1" status: 200 len: 684 time: 0.0982149 May 12 15:47:23.135219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47844) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:23.191265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] For port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:47:23.196087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] For port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:47:23.203767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c0c7645-9e8f-43e6-9b63-af9954b5ea13 req-b92e68fd-0e42-46c6-ae78-371fdfdb717d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:23.205680 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6c0c7645-9e8f-43e6-9b63-af9954b5ea13 req-b92e68fd-0e42-46c6-ae78-371fdfdb717d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610 HTTP/1.1" status: 200 len: 835 time: 0.0877378 May 12 15:47:23.206943 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:23.238444 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-31a9a709-375b-43d2-bc1f-46b7b5d4ef3a tempest-SubnetPoolsTestJSON-675222614 tempest-SubnetPoolsTestJSON-675222614-project] Notify callbacks [] for subnetpool, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:23.238444 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-31a9a709-375b-43d2-bc1f-46b7b5d4ef3a tempest-SubnetPoolsTestJSON-675222614 tempest-SubnetPoolsTestJSON-675222614-project] 10.222.0.82 "DELETE /v2.0/subnetpools/7b6b57cc-6be8-4510-bec4-bc82c03f6899 HTTP/1.1" status: 204 len: 168 time: 0.0990462 May 12 15:47:23.238729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47848) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:23.258858 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-22b32605-1321-483b-a3ea-0b923b192392 tempest-SubnetPoolsTestJSON-675222614 tempest-SubnetPoolsTestJSON-675222614-project] show failed (client error): The resource could not be found. May 12 15:47:23.262399 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-22b32605-1321-483b-a3ea-0b923b192392 tempest-SubnetPoolsTestJSON-675222614 tempest-SubnetPoolsTestJSON-675222614-project] 10.222.0.82 "GET /v2.0/subnetpools/7b6b57cc-6be8-4510-bec4-bc82c03f6899 HTTP/1.1" status: 404 len: 346 time: 0.0203180 May 12 15:47:23.262629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47852) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:23.285464 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-450feb16-b355-4721-bde0-316b3b435a2b tempest-SubnetPoolsTestJSON-675222614 tempest-SubnetPoolsTestJSON-675222614-project] delete failed (client error): The resource could not be found. May 12 15:47:23.291271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-450feb16-b355-4721-bde0-316b3b435a2b tempest-SubnetPoolsTestJSON-675222614 tempest-SubnetPoolsTestJSON-675222614-project] 10.222.0.82 "DELETE /v2.0/subnetpools/7b6b57cc-6be8-4510-bec4-bc82c03f6899 HTTP/1.1" status: 404 len: 346 time: 0.0238111 May 12 15:47:23.326106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:23.327718 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:23.329533 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] 10.222.0.76 "PUT /v2.0/ports/2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 HTTP/1.1" status: 200 len: 1091 time: 2.4268591 May 12 15:47:23.437821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1e3de1a-15a8-43b7-b4f9-a41456b006b1 service neutron] Pushing event updated for resources: {'Port': ['ID=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,revision_number=7']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:23.459739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c0c7645-9e8f-43e6-9b63-af9954b5ea13 req-c4a941f3-9a54-4b3e-8287-d78b8a483583 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:23.461219 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6c0c7645-9e8f-43e6-9b63-af9954b5ea13 req-c4a941f3-9a54-4b3e-8287-d78b8a483583 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=27a3a31e-244b-4431-86b4-73b53f4f0c89&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2173569 May 12 15:47:23.491958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-d709c2ff-78f6-4a37-b843-c0ec5f5b2dc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:23.493480 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-d709c2ff-78f6-4a37-b843-c0ec5f5b2dc9 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 1094 time: 0.1346920 May 12 15:47:23.666194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47864) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:23.841713 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f37a61f-37f2-42c4-b8d9-0533968c8bed admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:23.866105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6f37a61f-37f2-42c4-b8d9-0533968c8bed admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:23.871905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6f37a61f-37f2-42c4-b8d9-0533968c8bed admin admin] Usage tracker for resource:security_group_rule and tenant:581bbdb7338b46018fe78c3ea2a30c61 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:23.878120 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6f37a61f-37f2-42c4-b8d9-0533968c8bed admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:23.879135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:47:23.885092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6f37a61f-37f2-42c4-b8d9-0533968c8bed admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:23.892959 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6c0c7645-9e8f-43e6-9b63-af9954b5ea13 req-7b563918-35dd-4434-8da7-79e77f27a9e4 service neutron] 10.222.0.84 "GET /v2.0/networks/27a3a31e-244b-4431-86b4-73b53f4f0c89?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4211185 May 12 15:47:23.899065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-f5e59f14-1e66-4dee-b212-d63d2545fae4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:23.901150 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-f5e59f14-1e66-4dee-b212-d63d2545fae4 service neutron] 10.222.0.76 "GET /v2.0/networks?id=96b03b8b-8b48-4742-a456-9d456e030e73 HTTP/1.1" status: 200 len: 897 time: 0.3999889 May 12 15:47:23.932644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c991dc0d-2069-4ba5-a24a-bc8abbf7d20d req-3a25b40d-9139-4457-9dda-1ef19da1f9b3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:23.940178 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c991dc0d-2069-4ba5-a24a-bc8abbf7d20d req-3a25b40d-9139-4457-9dda-1ef19da1f9b3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 943 time: 0.1672359 May 12 15:47:23.981371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:47:24.001036 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c991dc0d-2069-4ba5-a24a-bc8abbf7d20d req-cb0bca1f-980d-4d16-842e-4f4719dee7d1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0599070 May 12 15:47:24.118141 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f37a61f-37f2-42c4-b8d9-0533968c8bed admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:24.123603 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f37a61f-37f2-42c4-b8d9-0533968c8bed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:24.168411 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-beb10158-af5a-4175-b48d-4c302fde5165 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 HTTP/1.1" status: 200 len: 998 time: 0.2234635 May 12 15:47:24.247687 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6c0c7645-9e8f-43e6-9b63-af9954b5ea13 req-a9855227-0f75-4540-a922-8721938d8777 service neutron] 10.222.0.84 "GET /v2.0/networks/27a3a31e-244b-4431-86b4-73b53f4f0c89?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3446774 May 12 15:47:24.263682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-9bc69bc6-b76a-4e13-a8c7-631849a0f851 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:24.266139 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-9bc69bc6-b76a-4e13-a8c7-631849a0f851 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=7ee4997d-d763-4a38-bf54-c1153ac3e51c HTTP/1.1" status: 200 len: 834 time: 0.0917234 May 12 15:47:24.303448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6f37a61f-37f2-42c4-b8d9-0533968c8bed admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=581bbdb7338b46018fe78c3ea2a30c61&name=default HTTP/1.1" status: 200 len: 2983 time: 0.6364119 May 12 15:47:24.306839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47872) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:24.318487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f37a61f-37f2-42c4-b8d9-0533968c8bed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=41495f13-536d-4019-b16e-dafbe7a4bdae,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:24.331804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35e6112f-b2a8-4890-acf5-55f9fdd7db7c req-6a2550bd-c139-4781-ba5c-1f8f30df488b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:24.333246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35e6112f-b2a8-4890-acf5-55f9fdd7db7c req-6a2550bd-c139-4781-ba5c-1f8f30df488b tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 944 time: 0.3160830 May 12 15:47:24.362377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-f4817b15-cfb1-477e-bae2-2bd2142bd5e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:24.364279 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-f4817b15-cfb1-477e-bae2-2bd2142bd5e1 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=96b03b8b-8b48-4742-a456-9d456e030e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0922813 May 12 15:47:24.413454 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35e6112f-b2a8-4890-acf5-55f9fdd7db7c req-f538f781-bcdb-4b9f-b163-e95941f5f06f tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=52328bfc-80e0-4587-961a-a4facf47e8a6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0734169 May 12 15:47:24.421716 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a0acddd-5b25-41a3-9719-90fbfd30bf69 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:24.455707 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a0acddd-5b25-41a3-9719-90fbfd30bf69 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:24.505757 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-1d5a02dd-8c4f-497e-9165-736895f819fe service neutron] 10.222.0.76 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1346605 May 12 15:47:24.508443 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a0acddd-5b25-41a3-9719-90fbfd30bf69 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:24.523578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a0acddd-5b25-41a3-9719-90fbfd30bf69 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=41495f13-536d-4019-b16e-dafbe7a4bdae,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:24.530071 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a0acddd-5b25-41a3-9719-90fbfd30bf69 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:24.531241 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9a0acddd-5b25-41a3-9719-90fbfd30bf69 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/41495f13-536d-4019-b16e-dafbe7a4bdae HTTP/1.1" status: 204 len: 168 time: 0.2234898 May 12 15:47:24.653248 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-97117ceb-0bf6-46a3-9806-7a1a5d9c762f req-c316bfc4-cb04-4ed9-83d9-f4fedd023608 service neutron] 10.222.0.76 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1421609 May 12 15:47:24.728024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:47:24.818737 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-00f30582-1188-4318-9c88-ca9f3b7eec25'] response: {'name': 'network-changed', 'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'status': 'completed', 'code': 200} May 12 15:47:24.988402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-d75a6541-6634-45f3-8742-abcf76176bb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:24.989963 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-d75a6541-6634-45f3-8742-abcf76176bb1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 1094 time: 0.1071587 May 12 15:47:24.992616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-74c4feac-b759-4fc7-bac9-461ae29a3830 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:24.994023 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-74c4feac-b759-4fc7-bac9-461ae29a3830 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 1094 time: 0.1552019 May 12 15:47:25.150688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47898) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:25.272335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-652586f4-d118-461a-87fd-b99f11e9069c req-2a20750f-cf20-4a9e-ab93-1f3ea6f3737d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:25.274577 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-652586f4-d118-461a-87fd-b99f11e9069c req-2a20750f-cf20-4a9e-ab93-1f3ea6f3737d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 943 time: 0.1128659 May 12 15:47:25.343070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-f136e31a-cc22-4f1b-b15f-e1cb5cb7e186 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:25.344516 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-f136e31a-cc22-4f1b-b15f-e1cb5cb7e186 service neutron] 10.222.0.84 "GET /v2.0/networks?id=96b03b8b-8b48-4742-a456-9d456e030e73 HTTP/1.1" status: 200 len: 897 time: 0.3456178 May 12 15:47:25.355210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-3e53e110-3865-445b-82d8-cacb5ab3762d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:25.356673 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-3e53e110-3865-445b-82d8-cacb5ab3762d service neutron] 10.222.0.76 "GET /v2.0/networks?id=96b03b8b-8b48-4742-a456-9d456e030e73 HTTP/1.1" status: 200 len: 897 time: 0.3556938 May 12 15:47:25.373424 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbd7ba8e-c537-49b1-95e5-b18f628ec4d5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:25.406076 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-652586f4-d118-461a-87fd-b99f11e9069c req-705a62b1-c5e1-4696-bebd-c884e9b3c774 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1244757 May 12 15:47:25.414454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bbd7ba8e-c537-49b1-95e5-b18f628ec4d5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:25.430285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bbd7ba8e-c537-49b1-95e5-b18f628ec4d5 admin admin] Usage tracker for resource:security_group_rule and tenant:d3f6ec195de84244a5453d3d5b837adc is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:25.433162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bbd7ba8e-c537-49b1-95e5-b18f628ec4d5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:25.439796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bbd7ba8e-c537-49b1-95e5-b18f628ec4d5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:25.584086 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbd7ba8e-c537-49b1-95e5-b18f628ec4d5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:25.584310 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-ceeecb25-033b-43dc-9d8e-2385ad837e88 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 HTTP/1.1" status: 200 len: 998 time: 0.2265737 May 12 15:47:25.588508 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-26d43352-b96f-45bf-9894-dcaf0f5e4ec3 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 HTTP/1.1" status: 200 len: 998 time: 0.1607242 May 12 15:47:25.597555 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bbd7ba8e-c537-49b1-95e5-b18f628ec4d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:25.656152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbd7ba8e-c537-49b1-95e5-b18f628ec4d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=31cd30d3-bf60-4e2d-83bf-971f06be8f42,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:25.666016 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bbd7ba8e-c537-49b1-95e5-b18f628ec4d5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d3f6ec195de84244a5453d3d5b837adc&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5130169 May 12 15:47:25.667156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 47916) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:25.731131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52cba01e-6f0e-45c0-a1d8-280848f3c5bc req-b3c2fb08-c9a5-4927-a415-97efa7b351db tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:25.732643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52cba01e-6f0e-45c0-a1d8-280848f3c5bc req-b3c2fb08-c9a5-4927-a415-97efa7b351db tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 944 time: 0.1989839 May 12 15:47:25.765106 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05cedffb-bdcd-4173-a766-834210345f77 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:25.817193 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05cedffb-bdcd-4173-a766-834210345f77 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:25.829740 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52cba01e-6f0e-45c0-a1d8-280848f3c5bc req-1175f582-3d66-4994-a1b3-f0b0481e6d19 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=52328bfc-80e0-4587-961a-a4facf47e8a6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0804443 May 12 15:47:25.841564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-52e6abef-88d5-4166-9138-411786bf141a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:25.843695 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-52e6abef-88d5-4166-9138-411786bf141a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7ee4997d-d763-4a38-bf54-c1153ac3e51c HTTP/1.1" status: 200 len: 834 time: 0.2502995 May 12 15:47:25.845205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-6d65dedf-2a1d-4500-a21d-58f35c63083a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:25.846904 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-6d65dedf-2a1d-4500-a21d-58f35c63083a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=7ee4997d-d763-4a38-bf54-c1153ac3e51c HTTP/1.1" status: 200 len: 834 time: 0.2231374 May 12 15:47:25.884732 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05cedffb-bdcd-4173-a766-834210345f77 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:25.892845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 95ac94e2-2622-4853-b774-aa79cb57ca97 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:47:25.917545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05cedffb-bdcd-4173-a766-834210345f77 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=31cd30d3-bf60-4e2d-83bf-971f06be8f42,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:25.926949 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-05cedffb-bdcd-4173-a766-834210345f77 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:25.931883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-05cedffb-bdcd-4173-a766-834210345f77 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/31cd30d3-bf60-4e2d-83bf-971f06be8f42 HTTP/1.1" status: 204 len: 168 time: 0.2621610 May 12 15:47:26.005028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-9f94f3ca-49b6-4e80-8d33-23028435b214 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:26.006714 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-9f94f3ca-49b6-4e80-8d33-23028435b214 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=96b03b8b-8b48-4742-a456-9d456e030e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1530745 May 12 15:47:26.009307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-06acd306-e84a-4a26-93a8-1302e38a89ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:26.010656 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-06acd306-e84a-4a26-93a8-1302e38a89ae service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=96b03b8b-8b48-4742-a456-9d456e030e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1558800 May 12 15:47:26.107088 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 95ac94e2-2622-4853-b774-aa79cb57ca97, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=95ac94e2-2622-4853-b774-aa79cb57ca97,segment=NetworkSegment(384ff5b9-795f-4199-b25d-4d1f08782bc8),segment_id=384ff5b9-795f-4199-b25d-4d1f08782bc8)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:26.130154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '95ac94e2-2622-4853-b774-aa79cb57ca97', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'port_id': '95ac94e2-2622-4853-b774-aa79cb57ca97', 'mac_address': 'fa:16:3e:2f:5b:3b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 559, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:47:26.201151 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:26.239910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 95ac94e2-2622-4853-b774-aa79cb57ca97 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:47:26.282077 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 95ac94e2-2622-4853-b774-aa79cb57ca97, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=95ac94e2-2622-4853-b774-aa79cb57ca97,segment=NetworkSegment(384ff5b9-795f-4199-b25d-4d1f08782bc8),segment_id=384ff5b9-795f-4199-b25d-4d1f08782bc8)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:26.296582 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:26.304487 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-ec82ad3b-09ef-4445-a423-29dc9234476a service neutron] 10.222.0.76 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2870331 May 12 15:47:26.308849 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-5e3f693e-60b6-4801-a51a-e6c190f20f64 service neutron] 10.222.0.84 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2662129 May 12 15:47:26.500927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=95ac94e2-2622-4853-b774-aa79cb57ca97,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:26.605716 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-a44471ad-bd79-4224-a258-4e8d1a0c3bbe service neutron] 10.222.0.76 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2915058 May 12 15:47:26.610059 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8acfc75-a4c9-4ac1-8aa6-c32527141e91 req-026de5dc-5eaf-47d0-8b70-06c3f7d54faf service neutron] 10.222.0.84 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2524037 May 12 15:47:26.648718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['95ac94e2-2622-4853-b774-aa79cb57ca97'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:47:26.690205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e80d483-07d7-4efc-adb6-24ebd0bc4bbd req-7390c75f-757a-4996-9c60-e3e80f7343c3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:26.695783 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e80d483-07d7-4efc-adb6-24ebd0bc4bbd req-7390c75f-757a-4996-9c60-e3e80f7343c3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 943 time: 0.1300879 May 12 15:47:26.750811 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e80d483-07d7-4efc-adb6-24ebd0bc4bbd req-f8fbc8d6-cf06-4e38-a7ab-a16bc7aa08d6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0514741 May 12 15:47:27.157887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bca0307c-7531-48cd-9329-f9490723e54f req-e0cc06c6-48b7-4c26-b5d1-0baf02a6d025 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:27.159372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bca0307c-7531-48cd-9329-f9490723e54f req-e0cc06c6-48b7-4c26-b5d1-0baf02a6d025 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 945 time: 0.1932290 May 12 15:47:27.172487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13efb813-d5e0-498a-baa4-ec50f1b526f5 req-abb82ca4-b13d-44c5-b036-d072de833281 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:27.174408 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13efb813-d5e0-498a-baa4-ec50f1b526f5 req-abb82ca4-b13d-44c5-b036-d072de833281 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 943 time: 0.1089427 May 12 15:47:27.240683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-00315d4a-7639-4206-b021-8946f47b5ceb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:27.241669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-00315d4a-7639-4206-b021-8946f47b5ceb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:27.263672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-00315d4a-7639-4206-b021-8946f47b5ceb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:27.267610 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-00315d4a-7639-4206-b021-8946f47b5ceb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.84 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544&tenant_id=b88b5989d4c548dba6124f2e4690e5c3&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 943 time: 0.1474662 May 12 15:47:27.296474 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bca0307c-7531-48cd-9329-f9490723e54f req-98ab80ae-1d29-4dd9-9e62-c69a3488b019 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=52328bfc-80e0-4587-961a-a4facf47e8a6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1207998 May 12 15:47:27.321859 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13efb813-d5e0-498a-baa4-ec50f1b526f5 req-cea4df54-5061-40c4-a0e3-993feda53437 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1319683 May 12 15:47:27.384890 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-18f6054d-4784-43f1-9f52-3fb83eff70b8 service neutron] delete failed (client error): The resource could not be found. May 12 15:47:27.386112 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-18f6054d-4784-43f1-9f52-3fb83eff70b8 service neutron] 10.222.0.84 "DELETE /v2.0/ports/2a5ee9ef-0363-4a82-b382-c38a8d19f1c6/bindings/n-h1-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.1108592 May 12 15:47:27.432491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:47:27.561132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-3c6da357-7d32-482e-8382-aaaef94a0442 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:27.562795 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-3c6da357-7d32-482e-8382-aaaef94a0442 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 1094 time: 0.0750480 May 12 15:47:27.577436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:27.590803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'port_id': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'mac_address': 'fa:16:3e:b3:7c:cb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 562, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:47:27.656172 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:27.673422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:47:27.689990 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:27.695777 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:27.713244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-097bd5af-f1cf-45a6-add8-cc8ad9319e45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:27.714770 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-097bd5af-f1cf-45a6-add8-cc8ad9319e45 service neutron] 10.222.0.84 "GET /v2.0/networks?id=96b03b8b-8b48-4742-a456-9d456e030e73 HTTP/1.1" status: 200 len: 897 time: 0.1399660 May 12 15:47:27.767452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:27.827918 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-a52dfe51-eab6-4d35-90f6-1814846cdda0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 HTTP/1.1" status: 200 len: 999 time: 0.1038733 May 12 15:47:27.896099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-ee0fa6fa-8941-465a-9c18-673c68de5d2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:27.897644 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-ee0fa6fa-8941-465a-9c18-673c68de5d2b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=7ee4997d-d763-4a38-bf54-c1153ac3e51c HTTP/1.1" status: 200 len: 834 time: 0.0604999 May 12 15:47:27.909338 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['2a5ee9ef-0363-4a82-b382-c38a8d19f1c6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:47:27.935241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 95ac94e2-2622-4853-b774-aa79cb57ca97 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:47:27.982606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-6882eed1-19ad-4fb4-a5fd-34a87af6d71c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:27.984401 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-6882eed1-19ad-4fb4-a5fd-34a87af6d71c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=96b03b8b-8b48-4742-a456-9d456e030e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0778673 May 12 15:47:28.068041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 95ac94e2-2622-4853-b774-aa79cb57ca97 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:47:28.081856 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 95ac94e2-2622-4853-b774-aa79cb57ca97 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:47:28.082173 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:28.150431 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-efa16148-80ae-4afa-8ceb-845decc11908 service neutron] 10.222.0.84 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1555984 May 12 15:47:28.281951 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:28.346806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '876c4deb-264b-4d18-a670-939dd27bf316', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '95ac94e2-2622-4853-b774-aa79cb57ca97'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:47:28.367933 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 95ac94e2-2622-4853-b774-aa79cb57ca97, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=95ac94e2-2622-4853-b774-aa79cb57ca97,segment=NetworkSegment(384ff5b9-795f-4199-b25d-4d1f08782bc8),segment_id=384ff5b9-795f-4199-b25d-4d1f08782bc8)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:28.395605 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:28.530683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=95ac94e2-2622-4853-b774-aa79cb57ca97,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:28.589432 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fd367273-dbc9-42bd-8811-5c2325504ea1 req-46891ecf-e7e4-4fed-b709-e571a9898c8c service neutron] 10.222.0.84 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4298222 May 12 15:47:28.647466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c66dc126-6124-410b-8e2a-f31a039553b0 req-ce494e12-ff67-4fbc-8413-85ce24dd8d75 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:28.649776 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c66dc126-6124-410b-8e2a-f31a039553b0 req-ce494e12-ff67-4fbc-8413-85ce24dd8d75 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 944 time: 0.1282876 May 12 15:47:28.659387 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faf1211f-710b-4a24-8b39-26997e35c9a5 req-bdcae28a-160b-4065-b3fc-20bd52e1e506 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:28.666104 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-faf1211f-710b-4a24-8b39-26997e35c9a5 req-bdcae28a-160b-4065-b3fc-20bd52e1e506 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 946 time: 0.1893196 May 12 15:47:28.739917 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c66dc126-6124-410b-8e2a-f31a039553b0 req-3f342337-30fc-4db2-9e33-cb63353015c0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0715368 May 12 15:47:28.750192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-faf1211f-710b-4a24-8b39-26997e35c9a5 req-d47c0810-8aa9-4ff3-87a4-e0fedab4b8b2 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=52328bfc-80e0-4587-961a-a4facf47e8a6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0830925 May 12 15:47:28.799901 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1d9a2930-b576-4064-94ad-d4536d5d5760'] response: {'server_uuid': '876c4deb-264b-4d18-a670-939dd27bf316', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '95ac94e2-2622-4853-b774-aa79cb57ca97', 'code': 200} May 12 15:47:28.920034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48116) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:28.957595 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2d721a7-a90e-4bca-b432-43683157d311 req-ef0634ac-07f0-49d4-9b2a-de9f7ae9783b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:28.959059 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b2d721a7-a90e-4bca-b432-43683157d311 req-ef0634ac-07f0-49d4-9b2a-de9f7ae9783b service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 1097 time: 0.0707312 May 12 15:47:28.999907 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b2d721a7-a90e-4bca-b432-43683157d311 req-411ebbac-2d88-4790-9d0d-b886ea5d6ab3 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=52328bfc-80e0-4587-961a-a4facf47e8a6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0345535 May 12 15:47:29.041100 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7dddd5fa-c545-42ee-aecd-cc3a03b1f574 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:29.055739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7dddd5fa-c545-42ee-aecd-cc3a03b1f574 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:29.059526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7dddd5fa-c545-42ee-aecd-cc3a03b1f574 admin admin] Usage tracker for resource:security_group_rule and tenant:e796e701c71d43ccb4bf5d0860c92216 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:29.062359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7dddd5fa-c545-42ee-aecd-cc3a03b1f574 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:29.067882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7dddd5fa-c545-42ee-aecd-cc3a03b1f574 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:29.146965 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7dddd5fa-c545-42ee-aecd-cc3a03b1f574 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:29.150646 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7dddd5fa-c545-42ee-aecd-cc3a03b1f574 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:29.201293 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7dddd5fa-c545-42ee-aecd-cc3a03b1f574 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e796e701c71d43ccb4bf5d0860c92216&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2794533 May 12 15:47:29.203615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dddd5fa-c545-42ee-aecd-cc3a03b1f574 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dc867e06-cbbe-492f-81ca-510d17e77f2b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:29.204590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48122) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:29.272630 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ec4056e-bd13-48e7-ac1d-efbd59db3ebb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:29.298504 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ec4056e-bd13-48e7-ac1d-efbd59db3ebb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:29.354088 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ec4056e-bd13-48e7-ac1d-efbd59db3ebb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:29.369746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ec4056e-bd13-48e7-ac1d-efbd59db3ebb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dc867e06-cbbe-492f-81ca-510d17e77f2b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:29.374204 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8ec4056e-bd13-48e7-ac1d-efbd59db3ebb admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:29.375193 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8ec4056e-bd13-48e7-ac1d-efbd59db3ebb admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/dc867e06-cbbe-492f-81ca-510d17e77f2b HTTP/1.1" status: 204 len: 168 time: 0.1695590 May 12 15:47:29.469515 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:47:29.545336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:47:29.551524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:47:29.551950 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:29.678856 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:29.686838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48130) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:29.705942 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23d57966-4b51-42cd-a7dc-583f0d817036 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:29.715458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:29.720509 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:29.723271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-23d57966-4b51-42cd-a7dc-583f0d817036 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:29.727430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-23d57966-4b51-42cd-a7dc-583f0d817036 admin admin] Usage tracker for resource:security_group_rule and tenant:1d12fbc62c934c2984e4ad4afb5478f7 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:29.730394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-23d57966-4b51-42cd-a7dc-583f0d817036 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:29.737591 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-23d57966-4b51-42cd-a7dc-583f0d817036 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:29.832235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:29.867801 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23d57966-4b51-42cd-a7dc-583f0d817036 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:29.875526 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-23d57966-4b51-42cd-a7dc-583f0d817036 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:29.917280 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-23d57966-4b51-42cd-a7dc-583f0d817036 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1d12fbc62c934c2984e4ad4afb5478f7&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2291553 May 12 15:47:29.920085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48142) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:29.971440 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23d57966-4b51-42cd-a7dc-583f0d817036 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a0b39db8-2b58-4d9c-a4df-34e6d806a266,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:30.009156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-351c92bc-0371-485d-bdc3-3c7e8c55f995 req-27e3712f-c343-4df4-b1fd-f841d1625c73 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:30.010300 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-342553b3-dc88-4ad1-906e-95521eb3eb06 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:30.010701 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-351c92bc-0371-485d-bdc3-3c7e8c55f995 req-27e3712f-c343-4df4-b1fd-f841d1625c73 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 946 time: 0.1491315 May 12 15:47:30.040462 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-342553b3-dc88-4ad1-906e-95521eb3eb06 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:30.066935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d7f18da-a7cb-438a-953a-2bba94bd67f3 req-9c519c9f-938d-41de-8b3d-8cc8531ad11b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:30.068675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d7f18da-a7cb-438a-953a-2bba94bd67f3 req-9c519c9f-938d-41de-8b3d-8cc8531ad11b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.1610742 May 12 15:47:30.100891 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-342553b3-dc88-4ad1-906e-95521eb3eb06 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:30.110959 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-351c92bc-0371-485d-bdc3-3c7e8c55f995 req-953bbc9d-e28e-4c2b-bf7b-3b36f30c82d3 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=52328bfc-80e0-4587-961a-a4facf47e8a6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0839145 May 12 15:47:30.118307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-342553b3-dc88-4ad1-906e-95521eb3eb06 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a0b39db8-2b58-4d9c-a4df-34e6d806a266,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:30.123202 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-342553b3-dc88-4ad1-906e-95521eb3eb06 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:30.124492 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-342553b3-dc88-4ad1-906e-95521eb3eb06 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a0b39db8-2b58-4d9c-a4df-34e6d806a266 HTTP/1.1" status: 204 len: 168 time: 0.2038617 May 12 15:47:30.144023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d7f18da-a7cb-438a-953a-2bba94bd67f3 req-1c7686a8-516e-4d70-8a3b-2dcdf8d58e77 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0611582 May 12 15:47:30.178472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48148) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:30.424271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dd2b0b54-ff14-49fd-947c-ee7b7bbc94bf tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/81d2aa67-f73f-4acb-8c6b-3410a5437f49 HTTP/1.1" status: 200 len: 992 time: 0.2445114 May 12 15:47:30.801570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:47:30.849822 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f813e088-6796-43b3-8881-528a4a971076'] response: {'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'code': 200} May 12 15:47:31.101876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48182) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:31.209504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-1891118410-network', 'tenant_id': '5ccba38e88b349ef81bcfe0977c73e5c'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:31.214655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:31.218592 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Usage tracker for resource:network and tenant:5ccba38e88b349ef81bcfe0977c73e5c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:31.221411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:31.227709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:31.239267 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Made reservation on behalf of 5ccba38e88b349ef81bcfe0977c73e5c for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:47:31.241873 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:31.288504 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:31.315911 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:31.325324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Usage tracker for resource:security_group_rule and tenant:5ccba38e88b349ef81bcfe0977c73e5c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:31.331032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:31.338085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:31.380953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb5b12a6-6600-44c4-858c-01443f76bf81 req-765ee30b-c9f6-4a29-a3a9-8406071dbd41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:31.382417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eb5b12a6-6600-44c4-858c-01443f76bf81 req-765ee30b-c9f6-4a29-a3a9-8406071dbd41 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 946 time: 0.1309116 May 12 15:47:31.443641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eb5b12a6-6600-44c4-858c-01443f76bf81 req-3a0147ca-84e2-4b54-9faf-89c4dad2b1d4 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=52328bfc-80e0-4587-961a-a4facf47e8a6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0555785 May 12 15:47:31.489112 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:31.493018 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:31.512960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 593} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:47:31.537428 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:31.537630 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Added segment c87f52f2-42ce-4a68-bc00-5896134aa512 of type vlan for network 03746746-e8ad-4600-8329-b8f3bb1a1390 May 12 15:47:31.542782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c009f517-23b3-4783-800b-7324ac122c09,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:31.620599 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:31.772857 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:31.773836 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:31.774402 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:31.812162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e1897f4-ed07-49c2-b318-80c5ddf2b613 req-eb50e6fd-7a4d-4d4d-be72-355cc7b84223 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:31.813762 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e1897f4-ed07-49c2-b318-80c5ddf2b613 req-eb50e6fd-7a4d-4d4d-be72-355cc7b84223 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 946 time: 0.2577343 May 12 15:47:31.924169 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] Pushing event updated for resources: {'Network': ['ID=03746746-e8ad-4600-8329-b8f3bb1a1390,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:31.927002 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5e48fe27-ce84-455d-b40b-8700060f6c49 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.8238976 May 12 15:47:31.930289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48212) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:31.937901 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Request body: {'subnet': {'network_id': '03746746-e8ad-4600-8329-b8f3bb1a1390', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-1891118410-subnet', 'tenant_id': '5ccba38e88b349ef81bcfe0977c73e5c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:31.939162 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 03746746-e8ad-4600-8329-b8f3bb1a1390 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:47:31.943854 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e1897f4-ed07-49c2-b318-80c5ddf2b613 req-561034ce-8a53-4ae0-a0ae-a8ce7d4218c8 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=52328bfc-80e0-4587-961a-a4facf47e8a6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0866022 May 12 15:47:31.946109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:31.950030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Usage tracker for resource:subnet and tenant:5ccba38e88b349ef81bcfe0977c73e5c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:31.953564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:31.959716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:31.973896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Made reservation on behalf of 5ccba38e88b349ef81bcfe0977c73e5c for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:47:31.976207 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:31.977910 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48216) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:32.064366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8abab6e6-177a-44a6-82be-23dad5af78c4 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:32.066272 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8abab6e6-177a-44a6-82be-23dad5af78c4 tempest-TestNetworkBasicOps-1839237972 tempest-TestNetworkBasicOps-1839237972-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 1092 time: 0.0873027 May 12 15:47:32.069353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48220) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:32.074736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '95ac94e2-2622-4853-b774-aa79cb57ca97', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ip_address': '172.20.0.11'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:32.087059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:32.095303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Usage tracker for resource:floatingip and tenant:b641518781114418963451fc3ff58f4d is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:32.100774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:32.106933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:32.124722 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:32.224080 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:32.276974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:32.290244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=340415ec-29a4-4671-9281-869c2b5d0a7b,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:32.335174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Checking segment: {'id': 'c87f52f2-42ce-4a68-bc00-5896134aa512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 593, 'network_id': '03746746-e8ad-4600-8329-b8f3bb1a1390'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:47:32.335651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Network hostable DHCP agents. Network: 03746746-e8ad-4600-8329-b8f3bb1a1390, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:47:32.356450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Network 03746746-e8ad-4600-8329-b8f3bb1a1390 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:47:32.367100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 03746746-e8ad-4600-8329-b8f3bb1a1390) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:47:32.372560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:32.373147 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:32.377591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcef24cd-6694-46cc-990c-3a4884854f11 None None] Network 03746746-e8ad-4600-8329-b8f3bb1a1390 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:47:32.405259 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-17397133-9336-4912-a992-0e9aace01cf4 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.4661317 May 12 15:47:32.430635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Allocated IP 172.25.8.156 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/5c448329-295f-445b-83d2-a39ef5023849) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:47:32.617966 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:32.669801 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:32.681336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2dd5f79-3568-43a6-9733-3d4a1b69cb4a None None] Network 03746746-e8ad-4600-8329-b8f3bb1a1390 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:47:32.753937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:47:32.756409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:47:32.760889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:47:32.802350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=5c448329-295f-445b-83d2-a39ef5023849,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:32.892587 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.044547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48242) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:33.051599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-1693191058-network', 'tenant_id': 'f43ddb876670423e9d38166f14801c44'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:33.057274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:33.062129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Usage tracker for resource:network and tenant:f43ddb876670423e9d38166f14801c44 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:33.065481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:33.071745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:33.084163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Made reservation on behalf of f43ddb876670423e9d38166f14801c44 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:47:33.087011 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.099835 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.115355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:33.120489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Usage tracker for resource:security_group_rule and tenant:f43ddb876670423e9d38166f14801c44 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:33.123435 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:33.130275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:33.227038 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.239348 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.281875 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.328187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 563} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:47:33.371224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=710d3341-0fb5-407b-afb1-cc7d1b1cff49,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:33.383074 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.383586 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Added segment 5c60837f-b366-4170-9914-669f22cbb5ec of type vlan for network 8672e219-2158-4b33-b479-5903c0d763f2 May 12 15:47:33.412263 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.435160 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.466007 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.466933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:33.468245 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.583669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.5366297 May 12 15:47:33.584412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48250) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:33.585083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25f0bf47-3349-437d-a926-2ef603dadb52 admin admin] Pushing event updated for resources: {'Network': ['ID=8672e219-2158-4b33-b479-5903c0d763f2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:33.594605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Request body: {'subnet': {'network_id': '8672e219-2158-4b33-b479-5903c0d763f2', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-1693191058-subnet', 'tenant_id': 'f43ddb876670423e9d38166f14801c44', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:33.599815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 8672e219-2158-4b33-b479-5903c0d763f2 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:47:33.600472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:33.604753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Usage tracker for resource:subnet and tenant:f43ddb876670423e9d38166f14801c44 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:33.608849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:33.615789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:33.629315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Made reservation on behalf of f43ddb876670423e9d38166f14801c44 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:47:33.632176 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.801775 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.806899 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.868340 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.944460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event updated for resources: {'Port': ['ID=5c448329-295f-445b-83d2-a39ef5023849,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:33.950582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Pushing event updated for resources: {'Subnet': ['ID=aa50c3a9-e308-4c26-8193-46a19e34fab1,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:33.956733 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:33.959724 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Checking segment: {'id': '5c60837f-b366-4170-9914-669f22cbb5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '8672e219-2158-4b33-b479-5903c0d763f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:47:33.960165 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Network hostable DHCP agents. Network: 8672e219-2158-4b33-b479-5903c0d763f2, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:47:33.981244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Network 8672e219-2158-4b33-b479-5903c0d763f2 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:47:33.992140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 8672e219-2158-4b33-b479-5903c0d763f2) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:47:33.996295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:33.996973 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:34.003453 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb83ea54-d32f-4598-8d38-b3a2d17c15ea None None] Network 8672e219-2158-4b33-b479-5903c0d763f2 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:47:34.024797 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0f01945e-2000-4748-9089-e43d7b3a5b21 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.4369450 May 12 15:47:34.190265 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Floating IP b681fcdb-b426-40f9-958a-a7594097770b associated. External IP: 172.25.8.156, port: 95ac94e2-2622-4853-b774-aa79cb57ca97. May 12 15:47:34.273073 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8da3ab98-d3f2-41cb-9e39-5cb2d03f3ee0 None None] Network 8672e219-2158-4b33-b479-5903c0d763f2 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:47:34.635780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Router c5f7aaa9-0739-4d05-b072-f7db2111e5ba has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:47:34.849129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-e658f451-b77e-4f09-88db-06c77672aa51 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:34.850066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-e658f451-b77e-4f09-88db-06c77672aa51 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Synchronizing usage tracker for tenant:5ccba38e88b349ef81bcfe0977c73e5c on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:34.854558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:47:34.867726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa19f575-a191-48f6-bbdb-f5efdc017b77 None None] Sync routers for ids ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:47:34.879500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa19f575-a191-48f6-bbdb-f5efdc017b77 None None] Routers {'c5f7aaa9-0739-4d05-b072-f7db2111e5ba'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:47:34.881049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-aa19f575-a191-48f6-bbdb-f5efdc017b77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:47:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:34.888200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-e658f451-b77e-4f09-88db-06c77672aa51 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Unset dirty status for tenant:5ccba38e88b349ef81bcfe0977c73e5c on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:34.889974 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-e658f451-b77e-4f09-88db-06c77672aa51 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/networks?id=03746746-e8ad-4600-8329-b8f3bb1a1390 HTTP/1.1" status: 200 len: 812 time: 0.2173092 May 12 15:47:34.897019 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:34.913679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-08aa3286-b12d-49c4-bf2b-5527643e3dd1 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/quotas/5ccba38e88b349ef81bcfe0977c73e5c HTTP/1.1" status: 200 len: 375 time: 0.0171828 May 12 15:47:34.975653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-f5521aaf-208e-41ed-bc30-96fc7ddb04c1 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=5ccba38e88b349ef81bcfe0977c73e5c&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0554428 May 12 15:47:34.988760 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6f51b096-ce0c-44a8-8fd4-fecbaea8c1bb tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.9183445 May 12 15:47:34.989946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '876c4deb-264b-4d18-a670-939dd27bf316', 'tag': '95ac94e2-2622-4853-b774-aa79cb57ca97'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:47:34.995307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48278) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:35.118496 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-aa19f575-a191-48f6-bbdb-f5efdc017b77 None None] Set router c5f7aaa9-0739-4d05-b072-f7db2111e5ba gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:47:35.151839 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-039eb200-7d71-47b3-898e-99454d8e16d6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/floatingips/b681fcdb-b426-40f9-958a-a7594097770b HTTP/1.1" status: 200 len: 992 time: 0.1550577 May 12 15:47:35.189245 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-8bc881af-b5b4-405e-927a-5855cb6583e9 service neutron] 10.222.0.82 "GET /v2.0/networks/03746746-e8ad-4600-8329-b8f3bb1a1390?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2056985 May 12 15:47:35.217071 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-34538718-0b14-4585-928a-80af89f6970e'] response: {'name': 'network-changed', 'server_uuid': '876c4deb-264b-4d18-a670-939dd27bf316', 'tag': '95ac94e2-2622-4853-b774-aa79cb57ca97', 'status': 'completed', 'code': 200} May 12 15:47:35.260606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0829cc6-8ced-4791-9736-5c33b82f153c req-fedca94e-b533-49b8-84d4-f8b3436ce6c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:35.262174 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e0829cc6-8ced-4791-9736-5c33b82f153c req-fedca94e-b533-49b8-84d4-f8b3436ce6c5 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 1097 time: 0.1092029 May 12 15:47:35.367041 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-a62846bf-e093-42a0-86dd-12b447a0227b service neutron] 10.222.0.82 "GET /v2.0/networks/03746746-e8ad-4600-8329-b8f3bb1a1390?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1717448 May 12 15:47:35.417429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0829cc6-8ced-4791-9736-5c33b82f153c req-b1a43784-ad0d-420d-af32-58f37ecb518c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:35.418810 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e0829cc6-8ced-4791-9736-5c33b82f153c req-b1a43784-ad0d-420d-af32-58f37ecb518c service neutron] 10.222.0.84 "GET /v2.0/networks?id=27a3a31e-244b-4431-86b4-73b53f4f0c89 HTTP/1.1" status: 200 len: 897 time: 0.1507158 May 12 15:47:35.558661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-aa19f575-a191-48f6-bbdb-f5efdc017b77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87'}], 'enable_snat': True}, 'gw_port_id': '0b130198-953d-4f1e-95d3-4d8791331284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:47:07Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '0b130198-953d-4f1e-95d3-4d8791331284', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:e5:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3802, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:46:59Z', 'updated_at': '2022-05-12T15:47:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'b681fcdb-b426-40f9-958a-a7594097770b', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'floating_ip_address': '172.25.8.156', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'port_id': '95ac94e2-2622-4853-b774-aa79cb57ca97', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 3891, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'mac_address': 'fa:16:3e:2f:5b:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '876c4deb-264b-4d18-a670-939dd27bf316', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:47:33Z', 'updated_at': '2022-05-12T15:47:33Z', 'revision_number': 0, 'project_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c6584f69-ed28-4741-b68f-c92c73eccc19', 'name': '', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:e8:e9:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 3820, 'fixed_ips': [{'subnet_id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:47:06Z', 'updated_at': '2022-05-12T15:47:14Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:35.566362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa19f575-a191-48f6-bbdb-f5efdc017b77 None None] Checking router: c5f7aaa9-0739-4d05-b072-f7db2111e5ba for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:47:35.577830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa19f575-a191-48f6-bbdb-f5efdc017b77 None None] Routers {'c5f7aaa9-0739-4d05-b072-f7db2111e5ba'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:47:35.578452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-aa19f575-a191-48f6-bbdb-f5efdc017b77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:47:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:35.661585 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bbc4b225-315c-43c5-91c0-4cd3f2d49e9d req-4cb26510-b8a4-438c-a4d9-7ad9315e881b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 210 time: 0.0926027 May 12 15:47:35.692474 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e0829cc6-8ced-4791-9736-5c33b82f153c req-98ffb45d-3d44-48cf-8f1b-478d6cc051b8 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=95ac94e2-2622-4853-b774-aa79cb57ca97 HTTP/1.1" status: 200 len: 1000 time: 0.2676160 May 12 15:47:35.785460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0829cc6-8ced-4791-9736-5c33b82f153c req-114bfe2f-336b-4f57-96ba-776fbf5f4737 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:35.786914 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e0829cc6-8ced-4791-9736-5c33b82f153c req-114bfe2f-336b-4f57-96ba-776fbf5f4737 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610 HTTP/1.1" status: 200 len: 835 time: 0.0885038 May 12 15:47:35.883068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-aa19f575-a191-48f6-bbdb-f5efdc017b77 None None] Set router c5f7aaa9-0739-4d05-b072-f7db2111e5ba gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:47:35.898569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0829cc6-8ced-4791-9736-5c33b82f153c req-f8cf14e2-c00b-4ce0-8771-c502d181c546 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:35.900100 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e0829cc6-8ced-4791-9736-5c33b82f153c req-f8cf14e2-c00b-4ce0-8771-c502d181c546 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=27a3a31e-244b-4431-86b4-73b53f4f0c89&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1076164 May 12 15:47:36.080457 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e0829cc6-8ced-4791-9736-5c33b82f153c req-c79d9623-43c2-48d5-b0d1-4b4e9b891905 service neutron] 10.222.0.84 "GET /v2.0/networks/27a3a31e-244b-4431-86b4-73b53f4f0c89?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1738081 May 12 15:47:36.155951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48314) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:36.348892 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e0829cc6-8ced-4791-9736-5c33b82f153c req-26b899e7-a0d4-4d57-a195-f58371b73e1f service neutron] 10.222.0.84 "GET /v2.0/networks/27a3a31e-244b-4431-86b4-73b53f4f0c89?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2596691 May 12 15:47:36.353690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-aa19f575-a191-48f6-bbdb-f5efdc017b77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87'}], 'enable_snat': True}, 'gw_port_id': '0b130198-953d-4f1e-95d3-4d8791331284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:47:07Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '0b130198-953d-4f1e-95d3-4d8791331284', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:e5:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3802, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:46:59Z', 'updated_at': '2022-05-12T15:47:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'b681fcdb-b426-40f9-958a-a7594097770b', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'floating_ip_address': '172.25.8.156', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'port_id': '95ac94e2-2622-4853-b774-aa79cb57ca97', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 3891, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'mac_address': 'fa:16:3e:2f:5b:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '876c4deb-264b-4d18-a670-939dd27bf316', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:47:33Z', 'updated_at': '2022-05-12T15:47:33Z', 'revision_number': 0, 'project_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c6584f69-ed28-4741-b68f-c92c73eccc19', 'name': '', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:e8:e9:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 3820, 'fixed_ips': [{'subnet_id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:47:06Z', 'updated_at': '2022-05-12T15:47:14Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:47:36.359686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa19f575-a191-48f6-bbdb-f5efdc017b77 None None] The sync data for ids ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'] in n-d-841483-1 is: [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87'}], 'enable_snat': True}, 'gw_port_id': '0b130198-953d-4f1e-95d3-4d8791331284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:47:07Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '0b130198-953d-4f1e-95d3-4d8791331284', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:e5:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3802, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:46:59Z', 'updated_at': '2022-05-12T15:47:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'b681fcdb-b426-40f9-958a-a7594097770b', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'floating_ip_address': '172.25.8.156', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'port_id': '95ac94e2-2622-4853-b774-aa79cb57ca97', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 3891, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'mac_address': 'fa:16:3e:2f:5b:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '876c4deb-264b-4d18-a670-939dd27bf316', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:47:33Z', 'updated_at': '2022-05-12T15:47:33Z', 'revision_number': 0, 'project_id': 'b641518781114418963451fc3ff58f4d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c6584f69-ed28-4741-b68f-c92c73eccc19', 'name': '', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:e8:e9:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 3820, 'fixed_ips': [{'subnet_id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:47:06Z', 'updated_at': '2022-05-12T15:47:14Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:47:36.487790 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-24b4b3ce-7483-4963-8715-fa870fe3293c tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/floatingips/b681fcdb-b426-40f9-958a-a7594097770b HTTP/1.1" status: 200 len: 992 time: 0.3306673 May 12 15:47:36.604731 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e446d0b-78a9-4315-b23b-58447358a892 None None] New status for floating IP b681fcdb-b426-40f9-958a-a7594097770b: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:47:36.812060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4f4ddb-80e8-49f1-9d07-c40c01d87e56 req-7a12db3f-b29e-4444-bf63-a542068e0d7f tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 210 time: 0.0468853 May 12 15:47:37.017820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-fee5ef20-4d07-4954-96ca-9a7f818020b5 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:37.019259 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-fee5ef20-4d07-4954-96ca-9a7f818020b5 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.76 "GET /v2.0/networks?id=03746746-e8ad-4600-8329-b8f3bb1a1390 HTTP/1.1" status: 200 len: 812 time: 0.1598201 May 12 15:47:37.032135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Request body: {'port': {'device_id': '8ad1c8c3-7846-4b3d-b038-db5225dff8ba', 'network_id': '03746746-e8ad-4600-8329-b8f3bb1a1390', 'admin_state_up': True, 'tenant_id': '5ccba38e88b349ef81bcfe0977c73e5c'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:37.168884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:37.172775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Usage tracker for resource:port and tenant:5ccba38e88b349ef81bcfe0977c73e5c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:37.175585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:37.181416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:37.190730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Made reservation on behalf of 5ccba38e88b349ef81bcfe0977c73e5c for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:47:37.194181 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:37.358756 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Allocated IP 172.20.0.2 (03746746-e8ad-4600-8329-b8f3bb1a1390/340415ec-29a4-4671-9281-869c2b5d0a7b/4671f45e-1ba1-471c-a9cf-71a8b93df5ea) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:47:37.491171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48324) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:37.568562 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:37.600544 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:37.607152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6b0c8f7d-6358-4c94-afa5-d6beff928682 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/floatingips/b681fcdb-b426-40f9-958a-a7594097770b HTTP/1.1" status: 200 len: 994 time: 0.1146467 May 12 15:47:37.693050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Pushing event updated for resources: {'Port': ['ID=4671f45e-1ba1-471c-a9cf-71a8b93df5ea,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:37.696524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Network 03746746-e8ad-4600-8329-b8f3bb1a1390 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:47:37.698029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:47:37.704773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:47:37.771652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:37.772293 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:37.792695 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-1eb3f53f-6b99-4567-8f58-60e740d344fa tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7646494 May 12 15:47:37.804973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Request body: {'port': {'device_id': '8ad1c8c3-7846-4b3d-b038-db5225dff8ba', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:47:37.970449 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:38.148905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16482599-b597-4056-9ef9-7a7dd1ec5ba4 req-5352e558-d5ec-43c4-a5bc-c54a1f3f04fe tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:38.150978 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16482599-b597-4056-9ef9-7a7dd1ec5ba4 req-5352e558-d5ec-43c4-a5bc-c54a1f3f04fe tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 931 time: 0.1691768 May 12 15:47:38.213059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-16482599-b597-4056-9ef9-7a7dd1ec5ba4 req-008a51aa-6682-41b5-a99e-5d6a087c8b3b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Synchronizing usage tracker for tenant:5ccba38e88b349ef81bcfe0977c73e5c on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:47:38.243545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-16482599-b597-4056-9ef9-7a7dd1ec5ba4 req-008a51aa-6682-41b5-a99e-5d6a087c8b3b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Unset dirty status for tenant:5ccba38e88b349ef81bcfe0977c73e5c on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:47:38.244818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16482599-b597-4056-9ef9-7a7dd1ec5ba4 req-008a51aa-6682-41b5-a99e-5d6a087c8b3b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0859056 May 12 15:47:38.539892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4671f45e-1ba1-471c-a9cf-71a8b93df5ea {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:47:38.547434 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:38.563282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Transition to ACTIVE for port object 4671f45e-1ba1-471c-a9cf-71a8b93df5ea will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:47:38.566720 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:38.720311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Pushing event updated for resources: {'Port': ['ID=4671f45e-1ba1-471c-a9cf-71a8b93df5ea,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:38.803814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Attempting to bind port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:47:38.804179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Attempting to bind port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'c87f52f2-42ce-4a68-bc00-5896134aa512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 593, 'network_id': '03746746-e8ad-4600-8329-b8f3bb1a1390'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:47:38.804499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Attempting to bind port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea on network 03746746-e8ad-4600-8329-b8f3bb1a1390 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:47:38.809011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea on network 03746746-e8ad-4600-8329-b8f3bb1a1390 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:47:38.809323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Attempting to bind port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea on network 03746746-e8ad-4600-8329-b8f3bb1a1390 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:47:38.815268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 47, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:47:38.815543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Checking segment: {'id': 'c87f52f2-42ce-4a68-bc00-5896134aa512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 593, 'network_id': '03746746-e8ad-4600-8329-b8f3bb1a1390'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:47:38.815914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Bound using segment: {'id': 'c87f52f2-42ce-4a68-bc00-5896134aa512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 593, 'network_id': '03746746-e8ad-4600-8329-b8f3bb1a1390'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:47:38.816346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Bound port: 4671f45e-1ba1-471c-a9cf-71a8b93df5ea, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c87f52f2-42ce-4a68-bc00-5896134aa512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 593, 'network_id': '03746746-e8ad-4600-8329-b8f3bb1a1390'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:47:38.816755 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:38.911272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] For port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:47:38.914201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] For port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4671f45e-1ba1-471c-a9cf-71a8b93df5ea,segment=NetworkSegment(c87f52f2-42ce-4a68-bc00-5896134aa512),segment_id=c87f52f2-42ce-4a68-bc00-5896134aa512)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:47:38.918221 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:38.982238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:38.982830 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:38.985010 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] 10.222.0.76 "PUT /v2.0/ports/4671f45e-1ba1-471c-a9cf-71a8b93df5ea HTTP/1.1" status: 200 len: 1091 time: 1.1840880 May 12 15:47:38.985609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8ad1c8c3-7846-4b3d-b038-db5225dff8ba', 'tag': '4671f45e-1ba1-471c-a9cf-71a8b93df5ea'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:47:39.009528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13816cdc-fd0f-4eee-bf46-0bee26f3dfe1 service neutron] Pushing event updated for resources: {'Port': ['ID=4671f45e-1ba1-471c-a9cf-71a8b93df5ea,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:39.065973 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7c4f0775-01bc-4f8e-91fe-56d3ac61d476'] response: {'name': 'network-changed', 'server_uuid': '8ad1c8c3-7846-4b3d-b038-db5225dff8ba', 'tag': '4671f45e-1ba1-471c-a9cf-71a8b93df5ea', 'status': 'completed', 'code': 200} May 12 15:47:39.110383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-f8881732-9958-4939-b255-9f476704a4db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:39.112102 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-f8881732-9958-4939-b255-9f476704a4db service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=5ccba38e88b349ef81bcfe0977c73e5c&device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 1094 time: 0.0827520 May 12 15:47:39.192045 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-ed180c0b-c427-4bb7-96bb-acc45100e5c7 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=4671f45e-1ba1-471c-a9cf-71a8b93df5ea HTTP/1.1" status: 200 len: 217 time: 0.0718071 May 12 15:47:39.263934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-6da729a5-910c-4b65-9cd0-467f4701584a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:39.265867 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-6da729a5-910c-4b65-9cd0-467f4701584a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=340415ec-29a4-4671-9281-869c2b5d0a7b HTTP/1.1" status: 200 len: 852 time: 0.0673432 May 12 15:47:39.348175 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-b957e6b5-6466-46cd-bfe7-610d1e3d9106 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=03746746-e8ad-4600-8329-b8f3bb1a1390&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0655437 May 12 15:47:39.458467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac975bb-92d2-492d-8af3-56db5f318c88 req-a585a872-14c3-4d79-8b63-2a759e48bc22 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:39.471237 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ac975bb-92d2-492d-8af3-56db5f318c88 req-a585a872-14c3-4d79-8b63-2a759e48bc22 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 943 time: 0.1127596 May 12 15:47:39.508778 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-8cbda2d8-edb8-400c-b4c8-1940ab774699 service neutron] 10.222.0.76 "GET /v2.0/networks/03746746-e8ad-4600-8329-b8f3bb1a1390?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1525087 May 12 15:47:39.537346 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ac975bb-92d2-492d-8af3-56db5f318c88 req-e00de23d-87e8-4cf8-b1b6-e746ea78e42f tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583968 May 12 15:47:39.669635 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58076ea1-bff5-4c3c-96f4-f8cb22b25e7f req-fbfc31a7-718f-4fcf-8072-dee272965bb6 service neutron] 10.222.0.76 "GET /v2.0/networks/03746746-e8ad-4600-8329-b8f3bb1a1390?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1534312 May 12 15:47:39.799493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ecc0c9-f5ba-4fc9-95d7-ee8c317c17b6 req-4e815bcd-f378-40cb-8015-891e954d132d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:39.804991 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2ecc0c9-f5ba-4fc9-95d7-ee8c317c17b6 req-4e815bcd-f378-40cb-8015-891e954d132d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=5ccba38e88b349ef81bcfe0977c73e5c&device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 1094 time: 0.0807371 May 12 15:47:39.939377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ecc0c9-f5ba-4fc9-95d7-ee8c317c17b6 req-f7a9179b-c5a7-47a2-afce-8bc2f0837c7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:39.940806 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2ecc0c9-f5ba-4fc9-95d7-ee8c317c17b6 req-f7a9179b-c5a7-47a2-afce-8bc2f0837c7c service neutron] 10.222.0.76 "GET /v2.0/networks?id=03746746-e8ad-4600-8329-b8f3bb1a1390 HTTP/1.1" status: 200 len: 913 time: 0.1306734 May 12 15:47:40.014895 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2ecc0c9-f5ba-4fc9-95d7-ee8c317c17b6 req-36e24597-ed0f-45fd-9082-cbc113c47a41 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=4671f45e-1ba1-471c-a9cf-71a8b93df5ea HTTP/1.1" status: 200 len: 217 time: 0.0653946 May 12 15:47:40.077849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ecc0c9-f5ba-4fc9-95d7-ee8c317c17b6 req-a09f5e1e-c517-4ca0-9a33-6d92971b0a68 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:40.079261 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2ecc0c9-f5ba-4fc9-95d7-ee8c317c17b6 req-a09f5e1e-c517-4ca0-9a33-6d92971b0a68 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=340415ec-29a4-4671-9281-869c2b5d0a7b HTTP/1.1" status: 200 len: 852 time: 0.0584264 May 12 15:47:40.126930 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2ecc0c9-f5ba-4fc9-95d7-ee8c317c17b6 req-74e2ae00-871a-4e8f-9d33-98b19aa3135f service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=03746746-e8ad-4600-8329-b8f3bb1a1390&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0411623 May 12 15:47:40.264985 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2ecc0c9-f5ba-4fc9-95d7-ee8c317c17b6 req-25ef9f40-bced-4050-a114-1e51c7450fe3 service neutron] 10.222.0.76 "GET /v2.0/networks/03746746-e8ad-4600-8329-b8f3bb1a1390?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1310391 May 12 15:47:40.403826 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2ecc0c9-f5ba-4fc9-95d7-ee8c317c17b6 req-cce7bebb-1c2c-47ac-99bf-e0aebe2082b5 service neutron] 10.222.0.76 "GET /v2.0/networks/03746746-e8ad-4600-8329-b8f3bb1a1390?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1327765 May 12 15:47:40.736652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6082cd39-73a9-4c79-82be-cb4b07470742 req-1aba96e0-8a19-468c-b62c-40765343b797 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:40.738121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6082cd39-73a9-4c79-82be-cb4b07470742 req-1aba96e0-8a19-468c-b62c-40765343b797 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 943 time: 0.0834155 May 12 15:47:40.781033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6082cd39-73a9-4c79-82be-cb4b07470742 req-9cc5adf4-42a2-4733-8f9e-be884cf8f172 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0370741 May 12 15:47:41.962574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4fb3d8-e62e-4b2b-bade-4bf2b702119b req-868724e0-b770-4fa4-bdd8-79120af32d5b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:41.963985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e4fb3d8-e62e-4b2b-bade-4bf2b702119b req-868724e0-b770-4fa4-bdd8-79120af32d5b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 943 time: 0.0780866 May 12 15:47:42.007600 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e4fb3d8-e62e-4b2b-bade-4bf2b702119b req-b8eddf07-070d-48ff-b544-759b743d13c1 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377769 May 12 15:47:42.746798 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-667395cb-1484-43d4-8987-3d22282f0ef5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:43.198018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94e35a9f-8ac0-409b-b12c-17bec0637120 req-39414ed0-5744-4786-b0b8-13a93f925269 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:43.199468 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-94e35a9f-8ac0-409b-b12c-17bec0637120 req-39414ed0-5744-4786-b0b8-13a93f925269 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 943 time: 0.0870109 May 12 15:47:43.245370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-94e35a9f-8ac0-409b-b12c-17bec0637120 req-af3d2ff1-24c4-4fe1-8d26-386694afdd79 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402780 May 12 15:47:43.333420 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:43.513376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4671f45e-1ba1-471c-a9cf-71a8b93df5ea details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:47:43.651556 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4671f45e-1ba1-471c-a9cf-71a8b93df5ea,segment=NetworkSegment(c87f52f2-42ce-4a68-bc00-5896134aa512),segment_id=c87f52f2-42ce-4a68-bc00-5896134aa512)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:43.666193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '4671f45e-1ba1-471c-a9cf-71a8b93df5ea', 'network_id': '03746746-e8ad-4600-8329-b8f3bb1a1390', 'port_id': '4671f45e-1ba1-471c-a9cf-71a8b93df5ea', 'mac_address': 'fa:16:3e:3e:66:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 593, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '340415ec-29a4-4671-9281-869c2b5d0a7b', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:47:43.725115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:43.742427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4671f45e-1ba1-471c-a9cf-71a8b93df5ea {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:47:43.759333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4671f45e-1ba1-471c-a9cf-71a8b93df5ea,segment=NetworkSegment(c87f52f2-42ce-4a68-bc00-5896134aa512),segment_id=c87f52f2-42ce-4a68-bc00-5896134aa512)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:43.763168 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:43.832166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=4671f45e-1ba1-471c-a9cf-71a8b93df5ea,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:43.980366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['4671f45e-1ba1-471c-a9cf-71a8b93df5ea'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:47:44.438379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbad2c07-92f1-46b6-9bdd-e725298201e3 req-f9724f89-deb4-488e-9602-ecdba809d319 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:44.439836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dbad2c07-92f1-46b6-9bdd-e725298201e3 req-f9724f89-deb4-488e-9602-ecdba809d319 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 944 time: 0.0804815 May 12 15:47:44.487970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dbad2c07-92f1-46b6-9bdd-e725298201e3 req-cc47d898-49a9-4587-b21b-60f4ad23a87d tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425193 May 12 15:47:44.954282 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:47:45.297562 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-552e5af0-994d-42cd-b21f-080911ca0ea7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:45.526694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4671f45e-1ba1-471c-a9cf-71a8b93df5ea up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:47:45.594504 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:47:45.599420 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:47:45.599785 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:45.681147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c027da-f515-4a7b-83fb-41b0f01d0c70 req-96a4cc9c-4ee9-4971-9b67-b1d9a646d2a8 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:45.682697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8c027da-f515-4a7b-83fb-41b0f01d0c70 req-96a4cc9c-4ee9-4971-9b67-b1d9a646d2a8 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 944 time: 0.0856209 May 12 15:47:45.728552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8c027da-f515-4a7b-83fb-41b0f01d0c70 req-91532254-e2e8-4d9f-a403-eb929dd3a2dc tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386920 May 12 15:47:45.730312 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:45.759533 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ad1c8c3-7846-4b3d-b038-db5225dff8ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4671f45e-1ba1-471c-a9cf-71a8b93df5ea'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:47:45.770259 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4671f45e-1ba1-471c-a9cf-71a8b93df5ea,segment=NetworkSegment(c87f52f2-42ce-4a68-bc00-5896134aa512),segment_id=c87f52f2-42ce-4a68-bc00-5896134aa512)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:47:45.776062 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:45.821199 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8e70166e-2c92-4ffb-a4a7-bd60bf39a1a6'] response: {'server_uuid': '8ad1c8c3-7846-4b3d-b038-db5225dff8ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4671f45e-1ba1-471c-a9cf-71a8b93df5ea', 'code': 200} May 12 15:47:45.856243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=4671f45e-1ba1-471c-a9cf-71a8b93df5ea,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:45.955428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08ae43de-91e5-4216-a34d-6af4a34bbbf2 req-a46951d8-9df2-4a4c-a12f-5192dc4da47d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:45.956817 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08ae43de-91e5-4216-a34d-6af4a34bbbf2 req-a46951d8-9df2-4a4c-a12f-5192dc4da47d service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 1096 time: 0.0800400 May 12 15:47:45.997844 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08ae43de-91e5-4216-a34d-6af4a34bbbf2 req-f3004886-2134-4e7d-93d3-ec61507f69cd service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0345619 May 12 15:47:46.038570 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:46.266365 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:46.921130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cb602fd-8b06-4529-a0a4-f566262f29ec req-0f3cb0a1-67b2-40af-a021-0d820749c233 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:46.922715 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cb602fd-8b06-4529-a0a4-f566262f29ec req-0f3cb0a1-67b2-40af-a021-0d820749c233 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.0872555 May 12 15:47:46.970484 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cb602fd-8b06-4529-a0a4-f566262f29ec req-5cf70a38-e649-4122-b1c8-08e20feeb4ad tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419886 May 12 15:47:47.740707 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:48.093606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48452) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:48.157621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42c754d4-e82f-4cb1-ac1c-fd3de5973b4f req-cee2b18a-510f-488d-9847-f3faa973be87 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:48.159318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-42c754d4-e82f-4cb1-ac1c-fd3de5973b4f req-cee2b18a-510f-488d-9847-f3faa973be87 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.0796592 May 12 15:47:48.205120 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-42c754d4-e82f-4cb1-ac1c-fd3de5973b4f req-98861d84-ab71-4a5a-a18a-b7960539f255 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401146 May 12 15:47:48.215905 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c17c65a6-06fe-45cd-8c31-7ec0d71a6ac6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:48.231404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c17c65a6-06fe-45cd-8c31-7ec0d71a6ac6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:48.235987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c17c65a6-06fe-45cd-8c31-7ec0d71a6ac6 admin admin] Usage tracker for resource:security_group_rule and tenant:80c5ce1dad5e41d9b17e265206f34f1a is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:48.238817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c17c65a6-06fe-45cd-8c31-7ec0d71a6ac6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:48.244564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c17c65a6-06fe-45cd-8c31-7ec0d71a6ac6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:48.332018 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c17c65a6-06fe-45cd-8c31-7ec0d71a6ac6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:48.335921 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c17c65a6-06fe-45cd-8c31-7ec0d71a6ac6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:48.399283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4407b231-d9d3-4af3-b458-06a21a82a994 req-5e752f1f-30a9-4ff2-8761-9f4a3c376f4f tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:48.400837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4407b231-d9d3-4af3-b458-06a21a82a994 req-5e752f1f-30a9-4ff2-8761-9f4a3c376f4f tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.0835431 May 12 15:47:48.448897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4407b231-d9d3-4af3-b458-06a21a82a994 req-07cbc922-bbb1-483e-b866-1e30410c4e5c tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409839 May 12 15:47:48.499765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c17c65a6-06fe-45cd-8c31-7ec0d71a6ac6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3a678046-f625-40fb-961a-53559c2dc434,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:48.506804 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c17c65a6-06fe-45cd-8c31-7ec0d71a6ac6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=80c5ce1dad5e41d9b17e265206f34f1a&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4120274 May 12 15:47:48.507401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48462) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:48.566611 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aaf8e6be-6e28-49b0-b9d4-adddf2b3e63a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:48.594063 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aaf8e6be-6e28-49b0-b9d4-adddf2b3e63a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:48.647779 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aaf8e6be-6e28-49b0-b9d4-adddf2b3e63a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:48.664292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaf8e6be-6e28-49b0-b9d4-adddf2b3e63a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a678046-f625-40fb-961a-53559c2dc434,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:48.668542 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-aaf8e6be-6e28-49b0-b9d4-adddf2b3e63a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:48.669686 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aaf8e6be-6e28-49b0-b9d4-adddf2b3e63a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3a678046-f625-40fb-961a-53559c2dc434 HTTP/1.1" status: 204 len: 168 time: 0.1610305 May 12 15:47:48.864921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673210f8-689b-4df2-b566-2bc740263c2c req-2f43227b-ebc2-4a71-a93f-ff855ccf7e4d tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:48.866416 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-673210f8-689b-4df2-b566-2bc740263c2c req-2f43227b-ebc2-4a71-a93f-ff855ccf7e4d tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.0804369 May 12 15:47:48.915637 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-673210f8-689b-4df2-b566-2bc740263c2c req-1f0cce1f-2d29-4141-a222-f5197dc52895 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429075 May 12 15:47:48.965421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48472) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:48.984414 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a5bd86a-7620-41e6-a189-0daf45dbf814 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:48.998330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3a5bd86a-7620-41e6-a189-0daf45dbf814 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:49.002304 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3a5bd86a-7620-41e6-a189-0daf45dbf814 admin admin] Usage tracker for resource:security_group_rule and tenant:261b46419ad846e88d77cad0c7eb0034 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:49.005056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-3a5bd86a-7620-41e6-a189-0daf45dbf814 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:49.010651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-3a5bd86a-7620-41e6-a189-0daf45dbf814 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:49.098199 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a5bd86a-7620-41e6-a189-0daf45dbf814 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:49.101959 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a5bd86a-7620-41e6-a189-0daf45dbf814 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:49.147324 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3a5bd86a-7620-41e6-a189-0daf45dbf814 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=261b46419ad846e88d77cad0c7eb0034&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1808250 May 12 15:47:49.148265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a5bd86a-7620-41e6-a189-0daf45dbf814 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6c12a13-56f1-4a11-8bda-d70a1bad4158,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:49.150010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48476) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:49.211277 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a25a093-1583-409b-8a32-818bdacd3a5f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:49.238763 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a25a093-1583-409b-8a32-818bdacd3a5f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:49.293187 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a25a093-1583-409b-8a32-818bdacd3a5f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:49.309638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a25a093-1583-409b-8a32-818bdacd3a5f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6c12a13-56f1-4a11-8bda-d70a1bad4158,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:49.315897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1a25a093-1583-409b-8a32-818bdacd3a5f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:49.316990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1a25a093-1583-409b-8a32-818bdacd3a5f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e6c12a13-56f1-4a11-8bda-d70a1bad4158 HTTP/1.1" status: 204 len: 168 time: 0.1656892 May 12 15:47:50.111542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ad3ce6-8ae6-400e-b9a5-bd478a4c4be9 req-38482ce5-7a66-4916-a368-22ad37e669eb tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:50.112992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11ad3ce6-8ae6-400e-b9a5-bd478a4c4be9 req-38482ce5-7a66-4916-a368-22ad37e669eb tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.0864367 May 12 15:47:50.159271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11ad3ce6-8ae6-400e-b9a5-bd478a4c4be9 req-3d01f7d1-61f4-427f-a336-75e42bfcf69e tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404408 May 12 15:47:50.527026 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2b3edc-5874-4b05-9e30-266d927a4e54 req-007bfa09-eb44-450f-b103-25079dd813c2 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:50.528327 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a2b3edc-5874-4b05-9e30-266d927a4e54 req-007bfa09-eb44-450f-b103-25079dd813c2 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.0857599 May 12 15:47:50.543338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc3677cf-f51c-4919-97dc-bfa87733d8d7 req-67320a35-1c25-47e8-b09f-c374f277f0c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:50.544929 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cc3677cf-f51c-4919-97dc-bfa87733d8d7 req-67320a35-1c25-47e8-b09f-c374f277f0c4 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=5ccba38e88b349ef81bcfe0977c73e5c&device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 1096 time: 0.0788343 May 12 15:47:50.575708 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a2b3edc-5874-4b05-9e30-266d927a4e54 req-7d4b6e0e-dbbe-4ebd-bd59-afea0667e889 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404742 May 12 15:47:50.689587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc3677cf-f51c-4919-97dc-bfa87733d8d7 req-d6a4c58c-c271-42c7-9112-06e4668913f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:50.691053 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cc3677cf-f51c-4919-97dc-bfa87733d8d7 req-d6a4c58c-c271-42c7-9112-06e4668913f9 service neutron] 10.222.0.76 "GET /v2.0/networks?id=03746746-e8ad-4600-8329-b8f3bb1a1390 HTTP/1.1" status: 200 len: 913 time: 0.1390524 May 12 15:47:50.763572 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cc3677cf-f51c-4919-97dc-bfa87733d8d7 req-40301607-e292-49d1-92e1-41e6660df926 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=4671f45e-1ba1-471c-a9cf-71a8b93df5ea HTTP/1.1" status: 200 len: 217 time: 0.0659184 May 12 15:47:50.827163 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc3677cf-f51c-4919-97dc-bfa87733d8d7 req-f62adedb-dc14-46c3-94ba-eb4136e0bb96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:50.828590 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cc3677cf-f51c-4919-97dc-bfa87733d8d7 req-f62adedb-dc14-46c3-94ba-eb4136e0bb96 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=340415ec-29a4-4671-9281-869c2b5d0a7b HTTP/1.1" status: 200 len: 852 time: 0.0597229 May 12 15:47:50.879147 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cc3677cf-f51c-4919-97dc-bfa87733d8d7 req-25343f57-51c4-45c4-92e2-f2d04d7a8a9d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=03746746-e8ad-4600-8329-b8f3bb1a1390&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0447028 May 12 15:47:51.011297 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cc3677cf-f51c-4919-97dc-bfa87733d8d7 req-845829c4-f7a0-446e-a61e-bdb7d9ff9107 service neutron] 10.222.0.76 "GET /v2.0/networks/03746746-e8ad-4600-8329-b8f3bb1a1390?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1256258 May 12 15:47:51.150082 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cc3677cf-f51c-4919-97dc-bfa87733d8d7 req-cf670fb1-0806-4f0f-bfb0-bd8f4b4630a6 service neutron] 10.222.0.76 "GET /v2.0/networks/03746746-e8ad-4600-8329-b8f3bb1a1390?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1326988 May 12 15:47:51.777314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6049588-38cb-4a0b-aef6-4e4bb8312176 req-90e2fd5d-f923-4af5-801a-ed4a5246301f tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:51.779157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6049588-38cb-4a0b-aef6-4e4bb8312176 req-90e2fd5d-f923-4af5-801a-ed4a5246301f tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.0886831 May 12 15:47:51.830169 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6049588-38cb-4a0b-aef6-4e4bb8312176 req-6d413357-624d-4ec9-b3ff-87d80a811c42 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441658 May 12 15:47:53.018222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1381312-4809-4b74-8b66-4491371c09d2 req-31cdc15c-b227-4700-b481-e248d5988437 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:53.019668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1381312-4809-4b74-8b66-4491371c09d2 req-31cdc15c-b227-4700-b481-e248d5988437 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.0803885 May 12 15:47:53.066424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1381312-4809-4b74-8b66-4491371c09d2 req-e7d14159-ce24-4cd3-a646-84ad91253110 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404799 May 12 15:47:53.481259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e6fc498-ad0c-453a-b09f-56ad4931a404 req-fbb9cf86-003b-4c1d-bef6-44d87f24f73f tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:53.482723 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e6fc498-ad0c-453a-b09f-56ad4931a404 req-fbb9cf86-003b-4c1d-bef6-44d87f24f73f tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.0829713 May 12 15:47:53.526405 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e6fc498-ad0c-453a-b09f-56ad4931a404 req-f5b9173b-c0fd-4304-9b75-7cffcbd83e17 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372264 May 12 15:47:54.720991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d6082d-9583-4206-9708-4669763b5db8 req-0f5ba2f7-06e3-4b93-acf1-d83e7a790fdf tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:54.723929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-98d6082d-9583-4206-9708-4669763b5db8 req-0f5ba2f7-06e3-4b93-acf1-d83e7a790fdf tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.0798533 May 12 15:47:54.773457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-98d6082d-9583-4206-9708-4669763b5db8 req-7d70674e-9579-45f4-9abd-eaa8df165d87 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441461 May 12 15:47:55.123024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a2973f-5c86-4af7-b591-d6b0c38dac3e req-a0f44926-f589-44d3-9e91-608673a22207 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:55.124551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71a2973f-5c86-4af7-b591-d6b0c38dac3e req-a0f44926-f589-44d3-9e91-608673a22207 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.0811820 May 12 15:47:55.128704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67e8559a-9775-40fc-90f1-892f24b1de16 req-3daf508b-69d1-4a2c-a3d6-ed6f55bb6e73 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:55.130313 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67e8559a-9775-40fc-90f1-892f24b1de16 req-3daf508b-69d1-4a2c-a3d6-ed6f55bb6e73 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=5ccba38e88b349ef81bcfe0977c73e5c&device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 1096 time: 0.0721350 May 12 15:47:55.171655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71a2973f-5c86-4af7-b591-d6b0c38dac3e req-f2acd354-e3b1-47e9-a49e-fccd5561314a tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397546 May 12 15:47:55.263500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67e8559a-9775-40fc-90f1-892f24b1de16 req-541013ef-1109-4208-992b-16a6c987ecbd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:55.265352 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67e8559a-9775-40fc-90f1-892f24b1de16 req-541013ef-1109-4208-992b-16a6c987ecbd service neutron] 10.222.0.76 "GET /v2.0/networks?id=03746746-e8ad-4600-8329-b8f3bb1a1390 HTTP/1.1" status: 200 len: 913 time: 0.1291962 May 12 15:47:55.339246 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67e8559a-9775-40fc-90f1-892f24b1de16 req-313afae9-95b5-4317-a058-6f464725933f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=4671f45e-1ba1-471c-a9cf-71a8b93df5ea HTTP/1.1" status: 200 len: 217 time: 0.0671000 May 12 15:47:55.401789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67e8559a-9775-40fc-90f1-892f24b1de16 req-d859c1c8-6883-4ff1-b3bf-83a9065e6c42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:55.403173 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67e8559a-9775-40fc-90f1-892f24b1de16 req-d859c1c8-6883-4ff1-b3bf-83a9065e6c42 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=340415ec-29a4-4671-9281-869c2b5d0a7b HTTP/1.1" status: 200 len: 852 time: 0.0572696 May 12 15:47:55.453251 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67e8559a-9775-40fc-90f1-892f24b1de16 req-2beca2b3-847f-4645-a6d5-d5272bb0aafc service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=03746746-e8ad-4600-8329-b8f3bb1a1390&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0439110 May 12 15:47:55.589045 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67e8559a-9775-40fc-90f1-892f24b1de16 req-9fc41798-fcaa-48d8-aa92-04e6aad4f1ec service neutron] 10.222.0.76 "GET /v2.0/networks/03746746-e8ad-4600-8329-b8f3bb1a1390?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1302941 May 12 15:47:55.740790 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67e8559a-9775-40fc-90f1-892f24b1de16 req-aa68d8cc-4b92-4196-8530-4e9273b48aa0 service neutron] 10.222.0.76 "GET /v2.0/networks/03746746-e8ad-4600-8329-b8f3bb1a1390?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1448226 May 12 15:47:55.971999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48582) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:56.205606 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60c2d0aa-7c9a-4bd5-abbd-5a3accf274c2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:56.221002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-60c2d0aa-7c9a-4bd5-abbd-5a3accf274c2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:56.224866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-60c2d0aa-7c9a-4bd5-abbd-5a3accf274c2 admin admin] Usage tracker for resource:security_group_rule and tenant:38a99b471d2948c4a745c2d1b6c644a1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:56.227736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-60c2d0aa-7c9a-4bd5-abbd-5a3accf274c2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:56.234413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-60c2d0aa-7c9a-4bd5-abbd-5a3accf274c2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:56.339412 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60c2d0aa-7c9a-4bd5-abbd-5a3accf274c2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:56.345218 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60c2d0aa-7c9a-4bd5-abbd-5a3accf274c2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:56.397165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60c2d0aa-7c9a-4bd5-abbd-5a3accf274c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5be672d5-6556-4672-9630-e33905ce57a6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:56.404061 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-60c2d0aa-7c9a-4bd5-abbd-5a3accf274c2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=38a99b471d2948c4a745c2d1b6c644a1&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4286187 May 12 15:47:56.404259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48590) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:56.425058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e323759-1baa-40d1-9197-c4c7c2e5d1a5 req-9e3ef9e9-afc6-47fd-a021-be2cae917cd6 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:56.437956 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e323759-1baa-40d1-9197-c4c7c2e5d1a5 req-9e3ef9e9-afc6-47fd-a021-be2cae917cd6 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.1477001 May 12 15:47:56.470024 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9266574-bfa6-46e6-b0df-48ccc293d84c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:56.486347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e323759-1baa-40d1-9197-c4c7c2e5d1a5 req-86e174f2-a27d-481e-855c-4ca872c88a65 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474858 May 12 15:47:56.496029 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9266574-bfa6-46e6-b0df-48ccc293d84c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:56.551469 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9266574-bfa6-46e6-b0df-48ccc293d84c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:56.568588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9266574-bfa6-46e6-b0df-48ccc293d84c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5be672d5-6556-4672-9630-e33905ce57a6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:56.576829 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9266574-bfa6-46e6-b0df-48ccc293d84c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:56.578642 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c9266574-bfa6-46e6-b0df-48ccc293d84c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5be672d5-6556-4672-9630-e33905ce57a6 HTTP/1.1" status: 204 len: 168 time: 0.1734824 May 12 15:47:56.857519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48598) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:56.875533 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54ecaabe-a58b-4ccf-8ff7-083f39eb3af7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:56.889951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-54ecaabe-a58b-4ccf-8ff7-083f39eb3af7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:47:56.893815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-54ecaabe-a58b-4ccf-8ff7-083f39eb3af7 admin admin] Usage tracker for resource:security_group_rule and tenant:baef1bef44ab449e81000026f44309c5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:47:56.896553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-54ecaabe-a58b-4ccf-8ff7-083f39eb3af7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:47:56.902128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-54ecaabe-a58b-4ccf-8ff7-083f39eb3af7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:47:56.985865 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54ecaabe-a58b-4ccf-8ff7-083f39eb3af7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:56.989548 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-54ecaabe-a58b-4ccf-8ff7-083f39eb3af7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:57.036824 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-54ecaabe-a58b-4ccf-8ff7-083f39eb3af7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=baef1bef44ab449e81000026f44309c5&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1775007 May 12 15:47:57.038309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54ecaabe-a58b-4ccf-8ff7-083f39eb3af7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f09c0308-401f-43fb-b494-a7f02f731a95,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:57.039518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48602) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:57.098062 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70a4aeea-3ffa-4884-8455-f6f2079f4ffb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:57.123463 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70a4aeea-3ffa-4884-8455-f6f2079f4ffb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:57.174831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70a4aeea-3ffa-4884-8455-f6f2079f4ffb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:57.189674 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70a4aeea-3ffa-4884-8455-f6f2079f4ffb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f09c0308-401f-43fb-b494-a7f02f731a95,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:47:57.196055 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-70a4aeea-3ffa-4884-8455-f6f2079f4ffb admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:57.197154 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-70a4aeea-3ffa-4884-8455-f6f2079f4ffb admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f09c0308-401f-43fb-b494-a7f02f731a95 HTTP/1.1" status: 204 len: 168 time: 0.1566606 May 12 15:47:57.808930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f96913-1dc3-4aad-96a5-4ebc206eaa5f req-2d4c177b-6c1d-4553-8f49-826cd5a63c10 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:57.810388 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39f96913-1dc3-4aad-96a5-4ebc206eaa5f req-2d4c177b-6c1d-4553-8f49-826cd5a63c10 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.2188442 May 12 15:47:57.855631 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39f96913-1dc3-4aad-96a5-4ebc206eaa5f req-8af27c89-8390-4684-8b3e-d6a5f8e13f81 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393739 May 12 15:47:58.263034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf4ba28b-b224-41c2-86db-5ad338c39638 req-41a875dc-649c-406e-a946-0af7a00d1221 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:58.265189 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cf4ba28b-b224-41c2-86db-5ad338c39638 req-41a875dc-649c-406e-a946-0af7a00d1221 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.0797479 May 12 15:47:58.316692 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cf4ba28b-b224-41c2-86db-5ad338c39638 req-d6122b43-4160-416f-860b-c0ac689cefbe tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445843 May 12 15:47:58.982273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ea47553-0986-4fc2-a212-6f488f5aa463 req-43d64e1c-70a4-46e5-a1f4-2903771bace6 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:58.984989 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ea47553-0986-4fc2-a212-6f488f5aa463 req-43d64e1c-70a4-46e5-a1f4-2903771bace6 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 1096 time: 0.0729203 May 12 15:47:59.025733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ea47553-0986-4fc2-a212-6f488f5aa463 req-d6d4a483-3292-4a85-9457-1a069d271e9f tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0350780 May 12 15:47:59.052824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48664) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:47:59.281307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-91e6c180-7073-4283-a58a-606456c9124e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port d18150c1-fdbe-4e3a-b613-0345e2532d7c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:47:59.281823 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91e6c180-7073-4283-a58a-606456c9124e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:59.525661 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91e6c180-7073-4283-a58a-606456c9124e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:59.525990 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91e6c180-7073-4283-a58a-606456c9124e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:59.654095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-91e6c180-7073-4283-a58a-606456c9124e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for d18150c1-fdbe-4e3a-b613-0345e2532d7c owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:47:59.718002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2644307c-f6d7-4c46-a80b-b97c0173823b req-7fdc34ea-60ad-463c-a358-b6c347b0c2a1 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:47:59.719333 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2644307c-f6d7-4c46-a80b-b97c0173823b req-7fdc34ea-60ad-463c-a358-b6c347b0c2a1 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.2905910 May 12 15:47:59.777664 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2644307c-f6d7-4c46-a80b-b97c0173823b req-db1e4e6f-e043-4511-b3b4-8b876fa5eb1c tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/security-groups?id=c009f517-23b3-4783-800b-7324ac122c09&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0526607 May 12 15:47:59.873165 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91e6c180-7073-4283-a58a-606456c9124e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:47:59.928350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91e6c180-7073-4283-a58a-606456c9124e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=d18150c1-fdbe-4e3a-b613-0345e2532d7c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:00.025192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91e6c180-7073-4283-a58a-606456c9124e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:00.025889 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-91e6c180-7073-4283-a58a-606456c9124e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Floating IP 81d2aa67-f73f-4acb-8c6b-3410a5437f49 disassociated (deleted). External IP: 172.25.8.70, port: 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6. May 12 15:48:00.080161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e129d5-fdd6-4a4a-b6e5-4f20df5b29a1 req-b1218f8c-fdf3-42dc-a172-3917b44534a5 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:00.080782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-56e129d5-fdd6-4a4a-b6e5-4f20df5b29a1 req-b1218f8c-fdf3-42dc-a172-3917b44534a5 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Synchronizing usage tracker for tenant:5ccba38e88b349ef81bcfe0977c73e5c on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:48:00.098345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-56e129d5-fdd6-4a4a-b6e5-4f20df5b29a1 req-b1218f8c-fdf3-42dc-a172-3917b44534a5 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Unset dirty status for tenant:5ccba38e88b349ef81bcfe0977c73e5c on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:48:00.099482 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-56e129d5-fdd6-4a4a-b6e5-4f20df5b29a1 req-b1218f8c-fdf3-42dc-a172-3917b44534a5 tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.76 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 945 time: 0.1094255 May 12 15:48:00.173895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-56e129d5-fdd6-4a4a-b6e5-4f20df5b29a1 req-5237df81-2a36-4ae7-82be-03b0df647e4b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Deleting port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:48:00.174220 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-56e129d5-fdd6-4a4a-b6e5-4f20df5b29a1 req-5237df81-2a36-4ae7-82be-03b0df647e4b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:00.450333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-56e129d5-fdd6-4a4a-b6e5-4f20df5b29a1 req-5237df81-2a36-4ae7-82be-03b0df647e4b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] For port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=4671f45e-1ba1-471c-a9cf-71a8b93df5ea,segment=NetworkSegment(c87f52f2-42ce-4a68-bc00-5896134aa512),segment_id=c87f52f2-42ce-4a68-bc00-5896134aa512)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:00.450933 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-56e129d5-fdd6-4a4a-b6e5-4f20df5b29a1 req-5237df81-2a36-4ae7-82be-03b0df647e4b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:00.519573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-91e6c180-7073-4283-a58a-606456c9124e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:48:00.577593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-56e129d5-fdd6-4a4a-b6e5-4f20df5b29a1 req-5237df81-2a36-4ae7-82be-03b0df647e4b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Calling delete_port for 4671f45e-1ba1-471c-a9cf-71a8b93df5ea owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:48:00.718859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-91e6c180-7073-4283-a58a-606456c9124e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:00.736453 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd72a5c9-9b01-4e25-a20a-d288786ddb79 None None] Sync routers for ids ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:48:00.744902 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91e6c180-7073-4283-a58a-606456c9124e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:00.746024 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-56e129d5-fdd6-4a4a-b6e5-4f20df5b29a1 req-5237df81-2a36-4ae7-82be-03b0df647e4b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:00.748986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd72a5c9-9b01-4e25-a20a-d288786ddb79 None None] Routers {'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:00.750374 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-bd72a5c9-9b01-4e25-a20a-d288786ddb79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:47:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:00.813841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5237df81-2a36-4ae7-82be-03b0df647e4b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Pushing event deleted for resources: {'Port': ['ID=4671f45e-1ba1-471c-a9cf-71a8b93df5ea,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:00.817789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['4671f45e-1ba1-471c-a9cf-71a8b93df5ea'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:48:00.827172 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-91e6c180-7073-4283-a58a-606456c9124e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/floatingips/81d2aa67-f73f-4acb-8c6b-3410a5437f49 HTTP/1.1" status: 204 len: 168 time: 1.7722008 May 12 15:48:00.828404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:48:00.946271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-56e129d5-fdd6-4a4a-b6e5-4f20df5b29a1 req-5237df81-2a36-4ae7-82be-03b0df647e4b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] No DVR routers for this DVR port 4671f45e-1ba1-471c-a9cf-71a8b93df5ea on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:48:00.949195 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-56e129d5-fdd6-4a4a-b6e5-4f20df5b29a1 req-5237df81-2a36-4ae7-82be-03b0df647e4b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:00.962860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ad1c8c3-7846-4b3d-b038-db5225dff8ba', 'name': 'network-vif-deleted', 'tag': '4671f45e-1ba1-471c-a9cf-71a8b93df5ea'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:48:00.977185 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-56e129d5-fdd6-4a4a-b6e5-4f20df5b29a1 req-5237df81-2a36-4ae7-82be-03b0df647e4b tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.76 "DELETE /v2.0/ports/4671f45e-1ba1-471c-a9cf-71a8b93df5ea HTTP/1.1" status: 204 len: 173 time: 0.8710341 May 12 15:48:01.035006 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63874e38-90c9-4135-b772-5c9031eb602d req-ef3b5da2-cdf4-4c7d-a201-d667ceb85ccd tempest-TestServerAdvancedOps-1312852266 tempest-TestServerAdvancedOps-1312852266-project] 10.222.0.82 "GET /v2.0/ports?device_id=8ad1c8c3-7846-4b3d-b038-db5225dff8ba HTTP/1.1" status: 200 len: 210 time: 0.0758820 May 12 15:48:01.053093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-bd72a5c9-9b01-4e25-a20a-d288786ddb79 None None] Set router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:01.111291 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-66084491-080a-4cdb-a2f2-ce693cd52779'] response: {'name': 'network-changed', 'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'status': 'completed', 'code': 200} May 12 15:48:01.204843 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-43b22818-2d67-4e27-8ce6-682f54f869d6'] response: {'server_uuid': '8ad1c8c3-7846-4b3d-b038-db5225dff8ba', 'name': 'network-vif-deleted', 'tag': '4671f45e-1ba1-471c-a9cf-71a8b93df5ea', 'status': 'completed', 'code': 200} May 12 15:48:01.268126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0bc497f-debe-4376-9dfd-11a7ad5cdaae req-367a4a3b-75f8-481c-9c84-24d577ff4ac1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:01.270557 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0bc497f-debe-4376-9dfd-11a7ad5cdaae req-367a4a3b-75f8-481c-9c84-24d577ff4ac1 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 1096 time: 0.1341436 May 12 15:48:01.411638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8933ddb6-2f1a-4161-8bfe-1f0810659c3e req-90d6461c-8ab2-467b-a500-cba7075d4d5d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:01.412595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8933ddb6-2f1a-4161-8bfe-1f0810659c3e req-90d6461c-8ab2-467b-a500-cba7075d4d5d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:48:01.439791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-8933ddb6-2f1a-4161-8bfe-1f0810659c3e req-90d6461c-8ab2-467b-a500-cba7075d4d5d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:48:01.442523 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8933ddb6-2f1a-4161-8bfe-1f0810659c3e req-90d6461c-8ab2-467b-a500-cba7075d4d5d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.1482434 May 12 15:48:01.444510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0bc497f-debe-4376-9dfd-11a7ad5cdaae req-6fe1f7fb-347f-491e-aa30-ecdfbba71b3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:01.446162 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0bc497f-debe-4376-9dfd-11a7ad5cdaae req-6fe1f7fb-347f-491e-aa30-ecdfbba71b3c service neutron] 10.222.0.76 "GET /v2.0/networks?id=96b03b8b-8b48-4742-a456-9d456e030e73 HTTP/1.1" status: 200 len: 897 time: 0.1676338 May 12 15:48:01.517962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8933ddb6-2f1a-4161-8bfe-1f0810659c3e req-f3c263b4-8779-4be6-b121-a9ca9f4fe39c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0692604 May 12 15:48:01.547460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-bd72a5c9-9b01-4e25-a20a-d288786ddb79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143'}], 'enable_snat': True}, 'gw_port_id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:45:36Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:65:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3654, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:27Z', 'updated_at': '2022-05-12T15:45:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0f3cbe16-d9fe-46b2-b341-ab176c57b531', 'name': '', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:d8:fe:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_interface', 'standard_attr_id': 3670, 'fixed_ips': [{'subnet_id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:34Z', 'updated_at': '2022-05-12T15:45:46Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:01.547644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd72a5c9-9b01-4e25-a20a-d288786ddb79 None None] Checking router: f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:48:01.563447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd72a5c9-9b01-4e25-a20a-d288786ddb79 None None] Routers {'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:01.564096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-bd72a5c9-9b01-4e25-a20a-d288786ddb79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:47:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:01.573367 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0bc497f-debe-4376-9dfd-11a7ad5cdaae req-338e6bbf-90b7-4ef0-94b3-c8d474ae2a4b service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 HTTP/1.1" status: 200 len: 217 time: 0.1190016 May 12 15:48:01.660424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0bc497f-debe-4376-9dfd-11a7ad5cdaae req-211e2a78-a213-4f7a-bf11-e8cfefb0e02f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:01.663157 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0bc497f-debe-4376-9dfd-11a7ad5cdaae req-211e2a78-a213-4f7a-bf11-e8cfefb0e02f service neutron] 10.222.0.76 "GET /v2.0/subnets?id=7ee4997d-d763-4a38-bf54-c1153ac3e51c HTTP/1.1" status: 200 len: 834 time: 0.0799830 May 12 15:48:01.755498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0bc497f-debe-4376-9dfd-11a7ad5cdaae req-e8429788-f229-4599-aac1-b38269b8955a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:01.757620 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0bc497f-debe-4376-9dfd-11a7ad5cdaae req-e8429788-f229-4599-aac1-b38269b8955a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=96b03b8b-8b48-4742-a456-9d456e030e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0879405 May 12 15:48:01.784487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-bd72a5c9-9b01-4e25-a20a-d288786ddb79 None None] Set router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:02.031816 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0bc497f-debe-4376-9dfd-11a7ad5cdaae req-02986723-bb92-48a2-a4d9-ab330d1db1bb service neutron] 10.222.0.76 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2669199 May 12 15:48:02.142012 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-bd72a5c9-9b01-4e25-a20a-d288786ddb79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143'}], 'enable_snat': True}, 'gw_port_id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:45:36Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:65:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3654, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:27Z', 'updated_at': '2022-05-12T15:45:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0f3cbe16-d9fe-46b2-b341-ab176c57b531', 'name': '', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:d8:fe:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_interface', 'standard_attr_id': 3670, 'fixed_ips': [{'subnet_id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:34Z', 'updated_at': '2022-05-12T15:45:46Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:02.147074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd72a5c9-9b01-4e25-a20a-d288786ddb79 None None] The sync data for ids ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'] in n-d-841483-1 is: [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143'}], 'enable_snat': True}, 'gw_port_id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:45:36Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:65:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3654, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:27Z', 'updated_at': '2022-05-12T15:45:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0f3cbe16-d9fe-46b2-b341-ab176c57b531', 'name': '', 'network_id': '96b03b8b-8b48-4742-a456-9d456e030e73', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:d8:fe:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_interface', 'standard_attr_id': 3670, 'fixed_ips': [{'subnet_id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:34Z', 'updated_at': '2022-05-12T15:45:46Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '7ee4997d-d763-4a38-bf54-c1153ac3e51c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:48:02.156450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48706) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:02.260173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-245d610f-f15d-4c7a-b204-7edbdf9fb308 admin admin] Deleting subnet 340415ec-29a4-4671-9281-869c2b5d0a7b {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:48:02.267481 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-245d610f-f15d-4c7a-b204-7edbdf9fb308 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:02.306365 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b0bc497f-debe-4376-9dfd-11a7ad5cdaae req-220745fc-ec2b-48c7-8d01-ad4a4a3a193e service neutron] 10.222.0.76 "GET /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2674270 May 12 15:48:02.335768 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-245d610f-f15d-4c7a-b204-7edbdf9fb308 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:02.399862 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-245d610f-f15d-4c7a-b204-7edbdf9fb308 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:02.481962 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22af1efb-fa78-4745-a26f-b5671e3fcb42 None None] New status for floating IP 81d2aa67-f73f-4acb-8c6b-3410a5437f49: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:48:02.524928 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-245d610f-f15d-4c7a-b204-7edbdf9fb308 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:02.579528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-245d610f-f15d-4c7a-b204-7edbdf9fb308 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=340415ec-29a4-4671-9281-869c2b5d0a7b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:02.583486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-245d610f-f15d-4c7a-b204-7edbdf9fb308 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:02.605200 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-245d610f-f15d-4c7a-b204-7edbdf9fb308 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/340415ec-29a4-4671-9281-869c2b5d0a7b HTTP/1.1" status: 204 len: 168 time: 0.4476845 May 12 15:48:02.607926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48714) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:02.614135 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:02.637845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c41224-dfd2-43c9-8444-df9708876fd9 req-95716a2d-ae99-423c-b0b8-0110b7fe5e09 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:02.640045 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49c41224-dfd2-43c9-8444-df9708876fd9 req-95716a2d-ae99-423c-b0b8-0110b7fe5e09 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.76 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.1671486 May 12 15:48:02.729266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-49c41224-dfd2-43c9-8444-df9708876fd9 req-a52c0908-f01d-4f8e-a966-99685cf519c9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:48:02.729637 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-49c41224-dfd2-43c9-8444-df9708876fd9 req-a52c0908-f01d-4f8e-a966-99685cf519c9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:02.792363 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09a74656-87a2-4dd1-ae48-bee20d806686 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:02.869855 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e399ffa5-fb08-442e-829c-28a46768187d req-4b6a2541-c539-4d57-ac71-3aaa58419202 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:02.871347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e399ffa5-fb08-442e-829c-28a46768187d req-4b6a2541-c539-4d57-ac71-3aaa58419202 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=d6c041e0-a7cd-440b-9826-e379ed847544 HTTP/1.1" status: 200 len: 945 time: 0.2249951 May 12 15:48:02.974327 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09a74656-87a2-4dd1-ae48-bee20d806686 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:02.995605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-49c41224-dfd2-43c9-8444-df9708876fd9 req-a52c0908-f01d-4f8e-a966-99685cf519c9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] For port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:02.995984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-49c41224-dfd2-43c9-8444-df9708876fd9 req-a52c0908-f01d-4f8e-a966-99685cf519c9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:03.002819 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e399ffa5-fb08-442e-829c-28a46768187d req-1db1b4de-2c79-4100-86cd-45d9dedadc53 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=93d6a643-d4d6-485b-81ac-56893147cebc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1243086 May 12 15:48:03.008941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-09a74656-87a2-4dd1-ae48-bee20d806686 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['03746746-e8ad-4600-8329-b8f3bb1a1390']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:03.040135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-09a74656-87a2-4dd1-ae48-bee20d806686 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c87f52f2-42ce-4a68-bc00-5896134aa512') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:03.040541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-09a74656-87a2-4dd1-ae48-bee20d806686 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c87f52f2-42ce-4a68-bc00-5896134aa512') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:03.053753 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09a74656-87a2-4dd1-ae48-bee20d806686 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:03.072598 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09a74656-87a2-4dd1-ae48-bee20d806686 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:03.080369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-09a74656-87a2-4dd1-ae48-bee20d806686 admin admin] Releasing vlan 593 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:48:03.081193 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09a74656-87a2-4dd1-ae48-bee20d806686 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: timer() May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:48:03.096418 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:48:03.131055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-49c41224-dfd2-43c9-8444-df9708876fd9 req-a52c0908-f01d-4f8e-a966-99685cf519c9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:48:03.180598 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09a74656-87a2-4dd1-ae48-bee20d806686 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:03.203788 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-09a74656-87a2-4dd1-ae48-bee20d806686 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:03.206526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09a74656-87a2-4dd1-ae48-bee20d806686 admin admin] Pushing event deleted for resources: {'Network': ['ID=03746746-e8ad-4600-8329-b8f3bb1a1390,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:03.220296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-09a74656-87a2-4dd1-ae48-bee20d806686 admin admin] 10.222.0.82 "DELETE /v2.0/networks/03746746-e8ad-4600-8329-b8f3bb1a1390 HTTP/1.1" status: 204 len: 168 time: 0.6103535 May 12 15:48:03.223193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48718) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:03.297358 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-49c41224-dfd2-43c9-8444-df9708876fd9 req-a52c0908-f01d-4f8e-a966-99685cf519c9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:03.300970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-d3f2c648-de24-4326-8eed-4292c5c7a797 admin admin] Deleting subnet aa50c3a9-e308-4c26-8193-46a19e34fab1 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:48:03.305615 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3f2c648-de24-4326-8eed-4292c5c7a797 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:03.349196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a52c0908-f01d-4f8e-a966-99685cf519c9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=2a5ee9ef-0363-4a82-b382-c38a8d19f1c6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:03.362993 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3f2c648-de24-4326-8eed-4292c5c7a797 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:03.424442 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3f2c648-de24-4326-8eed-4292c5c7a797 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:03.442947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-49c41224-dfd2-43c9-8444-df9708876fd9 req-a52c0908-f01d-4f8e-a966-99685cf519c9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] No DVR routers for this DVR port 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:48:03.446595 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-49c41224-dfd2-43c9-8444-df9708876fd9 req-a52c0908-f01d-4f8e-a966-99685cf519c9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:03.451714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'name': 'network-vif-deleted', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:48:03.484054 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-49c41224-dfd2-43c9-8444-df9708876fd9 req-a52c0908-f01d-4f8e-a966-99685cf519c9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.76 "DELETE /v2.0/ports/2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 HTTP/1.1" status: 204 len: 173 time: 0.8380861 May 12 15:48:03.527659 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2d96f42f-e0c0-4058-a299-75737e6eba82'] response: {'server_uuid': 'd6c041e0-a7cd-440b-9826-e379ed847544', 'name': 'network-vif-deleted', 'tag': '2a5ee9ef-0363-4a82-b382-c38a8d19f1c6', 'status': 'completed', 'code': 200} May 12 15:48:03.557675 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3f2c648-de24-4326-8eed-4292c5c7a797 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:03.599169 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f2c648-de24-4326-8eed-4292c5c7a797 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=aa50c3a9-e308-4c26-8193-46a19e34fab1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:03.602988 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d3f2c648-de24-4326-8eed-4292c5c7a797 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:03.610074 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d3f2c648-de24-4326-8eed-4292c5c7a797 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/aa50c3a9-e308-4c26-8193-46a19e34fab1 HTTP/1.1" status: 204 len: 168 time: 0.3854764 May 12 15:48:03.612379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48726) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:03.661791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4671f45e-1ba1-471c-a9cf-71a8b93df5ea no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:48:03.722428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 4671f45e-1ba1-471c-a9cf-71a8b93df5ea {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:48:03.722793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 4671f45e-1ba1-471c-a9cf-71a8b93df5ea not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:48:03.755543 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0dd2c7c-8062-4a01-b5ab-7b9205abda9d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:04.053021 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0dd2c7c-8062-4a01-b5ab-7b9205abda9d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:04.080262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-c0dd2c7c-8062-4a01-b5ab-7b9205abda9d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8672e219-2158-4b33-b479-5903c0d763f2']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:04.095342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-c0dd2c7c-8062-4a01-b5ab-7b9205abda9d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5c60837f-b366-4170-9914-669f22cbb5ec') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:04.095635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-c0dd2c7c-8062-4a01-b5ab-7b9205abda9d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5c60837f-b366-4170-9914-669f22cbb5ec') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:04.107147 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0dd2c7c-8062-4a01-b5ab-7b9205abda9d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:04.111335 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48734) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:04.125251 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0dd2c7c-8062-4a01-b5ab-7b9205abda9d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:04.131662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c0dd2c7c-8062-4a01-b5ab-7b9205abda9d admin admin] Releasing vlan 563 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:48:04.132049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0dd2c7c-8062-4a01-b5ab-7b9205abda9d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: timer() May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:48:04.148905 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:48:04.230831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0dd2c7c-8062-4a01-b5ab-7b9205abda9d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:04.256013 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0dd2c7c-8062-4a01-b5ab-7b9205abda9d admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:04.268318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c0dd2c7c-8062-4a01-b5ab-7b9205abda9d admin admin] 10.222.0.82 "DELETE /v2.0/networks/8672e219-2158-4b33-b479-5903c0d763f2 HTTP/1.1" status: 204 len: 168 time: 0.6549025 May 12 15:48:04.269158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0dd2c7c-8062-4a01-b5ab-7b9205abda9d admin admin] Pushing event deleted for resources: {'Network': ['ID=8672e219-2158-4b33-b479-5903c0d763f2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:04.470329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48740) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:04.527301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-54683201-0244-4a0e-8409-8f902162672d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5ccba38e88b349ef81bcfe0977c73e5c&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0557761 May 12 15:48:04.530289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48746) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:04.728354 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1756851e-8105-42ae-9a74-d66e88b8952c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:04.776503 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1756851e-8105-42ae-9a74-d66e88b8952c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:04.894337 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1756851e-8105-42ae-9a74-d66e88b8952c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:04.915402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1756851e-8105-42ae-9a74-d66e88b8952c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c009f517-23b3-4783-800b-7324ac122c09,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:04.955931 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1756851e-8105-42ae-9a74-d66e88b8952c admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:04.957059 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1756851e-8105-42ae-9a74-d66e88b8952c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c009f517-23b3-4783-800b-7324ac122c09 HTTP/1.1" status: 204 len: 168 time: 0.4170470 May 12 15:48:05.002108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:05.063017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48764) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:05.274647 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b03619d-0bff-4925-898e-d9d9bba6161c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:05.292930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1b03619d-0bff-4925-898e-d9d9bba6161c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:05.299638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1b03619d-0bff-4925-898e-d9d9bba6161c admin admin] Usage tracker for resource:security_group_rule and tenant:be780d2eb6d748aeb1fc5e5051bb69c7 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:05.303361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1b03619d-0bff-4925-898e-d9d9bba6161c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:05.309879 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1b03619d-0bff-4925-898e-d9d9bba6161c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:05.341251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48772) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:05.422074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port 0f3cbe16-d9fe-46b2-b341-ab176c57b531 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:48:05.422563 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:05.424724 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1079024f-d17c-4953-a86d-279eed30c1af admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f43ddb876670423e9d38166f14801c44&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0822988 May 12 15:48:05.427490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48776) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:05.464190 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b03619d-0bff-4925-898e-d9d9bba6161c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:05.471649 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1b03619d-0bff-4925-898e-d9d9bba6161c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:05.539740 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1b03619d-0bff-4925-898e-d9d9bba6161c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=be780d2eb6d748aeb1fc5e5051bb69c7&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4752822 May 12 15:48:05.541555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b03619d-0bff-4925-898e-d9d9bba6161c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e44b595-6962-46a3-a123-af27b3e4e19b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:05.543831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48780) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:05.574728 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f15804f4-89c5-46f6-82d0-2996f9f7bbe6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:05.620081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] For port 0f3cbe16-d9fe-46b2-b341-ab176c57b531, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0f3cbe16-d9fe-46b2-b341-ab176c57b531,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:05.620684 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:05.625808 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f15804f4-89c5-46f6-82d0-2996f9f7bbe6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:05.668572 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc921b76-3233-4dd7-9e41-19adba9ffdb0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:05.683166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:48:05.702393 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc921b76-3233-4dd7-9e41-19adba9ffdb0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:05.734048 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:48:05.734436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 2a5ee9ef-0363-4a82-b382-c38a8d19f1c6 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:48:05.750263 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f15804f4-89c5-46f6-82d0-2996f9f7bbe6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:05.766241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for 0f3cbe16-d9fe-46b2-b341-ab176c57b531 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:48:05.777188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f15804f4-89c5-46f6-82d0-2996f9f7bbe6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=710d3341-0fb5-407b-afb1-cc7d1b1cff49,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:05.788908 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f15804f4-89c5-46f6-82d0-2996f9f7bbe6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:05.790203 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f15804f4-89c5-46f6-82d0-2996f9f7bbe6 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/710d3341-0fb5-407b-afb1-cc7d1b1cff49 HTTP/1.1" status: 204 len: 168 time: 0.3618062 May 12 15:48:05.804732 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc921b76-3233-4dd7-9e41-19adba9ffdb0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:05.829705 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc921b76-3233-4dd7-9e41-19adba9ffdb0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:05.830831 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dc921b76-3233-4dd7-9e41-19adba9ffdb0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0e44b595-6962-46a3-a123-af27b3e4e19b HTTP/1.1" status: 204 len: 168 time: 0.2783976 May 12 15:48:05.831677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc921b76-3233-4dd7-9e41-19adba9ffdb0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e44b595-6962-46a3-a123-af27b3e4e19b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:05.982743 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:06.048283 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=0f3cbe16-d9fe-46b2-b341-ab176c57b531,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:06.274882 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:06.275297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:06.275539 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:06.275868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:06.276189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:06.287444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:06.287956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:06.288294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:06.288632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:06.288966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:06.289285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:06.289634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:06.301949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48800) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:06.322237 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7f55777e-8cb6-46eb-8270-b7638edc59a3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:06.358597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7f55777e-8cb6-46eb-8270-b7638edc59a3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:06.363760 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7f55777e-8cb6-46eb-8270-b7638edc59a3 admin admin] Usage tracker for resource:security_group_rule and tenant:ddc674193c474e888699167f0b986418 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:06.375087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7f55777e-8cb6-46eb-8270-b7638edc59a3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:06.383762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7f55777e-8cb6-46eb-8270-b7638edc59a3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:06.479489 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7f55777e-8cb6-46eb-8270-b7638edc59a3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:06.484838 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7f55777e-8cb6-46eb-8270-b7638edc59a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:06.537314 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:06.545019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7f55777e-8cb6-46eb-8270-b7638edc59a3 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ddc674193c474e888699167f0b986418&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2414753 May 12 15:48:06.545825 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48806) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:06.549709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f55777e-8cb6-46eb-8270-b7638edc59a3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a15d52cd-b033-418a-beae-ffb67911fb1f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:06.617188 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24b41d62-d2a1-44d2-afc0-328a75628b0a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:06.645208 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24b41d62-d2a1-44d2-afc0-328a75628b0a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:06.704377 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24b41d62-d2a1-44d2-afc0-328a75628b0a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:06.720332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24b41d62-d2a1-44d2-afc0-328a75628b0a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a15d52cd-b033-418a-beae-ffb67911fb1f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:06.726987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24b41d62-d2a1-44d2-afc0-328a75628b0a admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:06.728189 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-24b41d62-d2a1-44d2-afc0-328a75628b0a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a15d52cd-b033-418a-beae-ffb67911fb1f HTTP/1.1" status: 204 len: 168 time: 0.1813190 May 12 15:48:06.774015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48818) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:06.895704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1403548621-network', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:06.901832 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:06.907705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Usage tracker for resource:network and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:06.911908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:06.918061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:06.933196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Made reservation on behalf of 939000b7f70c4c85a39e52ee93a06ed5 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:48:06.935555 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:06.938846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:48:06.948593 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:06.966076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:06.971113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Usage tracker for resource:security_group_rule and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:06.974058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:06.979817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:07.071178 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.075745 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.112246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 566} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:48:07.117137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=222fbe49-cc04-4730-9bd7-c945c6e93703,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:07.124636 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.124991 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Added segment df75c3d3-8e48-420e-8a5f-7e8bc6400515 of type vlan for network d13f4c27-5358-4d60-abb1-0c94e69df718 May 12 15:48:07.139791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:07.153821 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.153992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44836cae-afea-443d-bafe-658e3e77e50c None None] Sync routers for ids ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:48:07.156363 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9030cb25-237b-4c38-bf85-5c2ba98a6930 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "PUT /v2.0/routers/f1e265b8-30b0-454f-b7a1-8e4b4bd686b0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0439429 May 12 15:48:07.158990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48832) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:07.167166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44836cae-afea-443d-bafe-658e3e77e50c None None] Routers {'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:07.168268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-44836cae-afea-443d-bafe-658e3e77e50c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:47:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:07.188795 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.190191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:07.190770 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.263048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-1061b05d-ba17-46c8-8d1d-788e5098ed20 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting subnet 7ee4997d-d763-4a38-bf54-c1153ac3e51c {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:48:07.278012 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1061b05d-ba17-46c8-8d1d-788e5098ed20 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.299271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.5240662 May 12 15:48:07.302435 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48838) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:07.311632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Request body: {'subnet': {'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1403548621-subnet', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:07.316243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0491891c-5801-4b5d-9606-88a31f91385d admin admin] Pushing event updated for resources: {'Network': ['ID=d13f4c27-5358-4d60-abb1-0c94e69df718,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:07.320229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:07.325307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Usage tracker for resource:subnet and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:07.329288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:07.335556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:07.349042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Made reservation on behalf of 939000b7f70c4c85a39e52ee93a06ed5 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:48:07.352744 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.375430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1061b05d-ba17-46c8-8d1d-788e5098ed20 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.395879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network d13f4c27-5358-4d60-abb1-0c94e69df718 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:48:07.485613 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1061b05d-ba17-46c8-8d1d-788e5098ed20 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.512391 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-44836cae-afea-443d-bafe-658e3e77e50c None None] Set router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:07.569953 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1061b05d-ba17-46c8-8d1d-788e5098ed20 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.608649 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.609704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1061b05d-ba17-46c8-8d1d-788e5098ed20 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Subnet': ['ID=7ee4997d-d763-4a38-bf54-c1153ac3e51c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:07.613411 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1061b05d-ba17-46c8-8d1d-788e5098ed20 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.619596 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1061b05d-ba17-46c8-8d1d-788e5098ed20 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/subnets/7ee4997d-d763-4a38-bf54-c1153ac3e51c HTTP/1.1" status: 204 len: 168 time: 0.4595654 May 12 15:48:07.626163 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48850) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:07.700529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Pushing event updated for resources: {'Subnet': ['ID=020f79af-22ce-41ca-91a6-931258be2176,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:07.710719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Checking segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:07.711140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Network hostable DHCP agents. Network: d13f4c27-5358-4d60-abb1-0c94e69df718, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:48:07.730157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcb3d1f2-3bb3-4b4e-993c-3905ac475424 None None] Network 96b03b8b-8b48-4742-a456-9d456e030e73 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:48:07.735217 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Network d13f4c27-5358-4d60-abb1-0c94e69df718 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:48:07.748082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, d13f4c27-5358-4d60-abb1-0c94e69df718) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:07.753502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:07.754282 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.765841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d73b44c-10dc-488e-b5bb-c0463f3e2316 None None] Network d13f4c27-5358-4d60-abb1-0c94e69df718 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:48:07.787640 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e85757df-1975-48f4-a75a-1c752449006a admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.4834535 May 12 15:48:07.789292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48856) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:07.797124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:07.802978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:07.807608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Usage tracker for resource:router and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:07.811682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:07.819422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:07.836185 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.837845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.862779 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:07.874332 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:08.241321 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:08.255821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port 5e065dc4-c922-4e2a-8f89-cf23d6684d63 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:48:08.256639 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:08.404618 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-44836cae-afea-443d-bafe-658e3e77e50c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143'}], 'enable_snat': True}, 'gw_port_id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:48:05Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '5e065dc4-c922-4e2a-8f89-cf23d6684d63', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:65:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3654, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:45:27Z', 'updated_at': '2022-05-12T15:45:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:08.410306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-d13f4c27-5358-4d60-abb1-0c94e69df718', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:48:08.411138 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:08.418523 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:08.428082 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44836cae-afea-443d-bafe-658e3e77e50c None None] Checking router: f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:48:08.493402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44836cae-afea-443d-bafe-658e3e77e50c None None] Routers {'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:08.494344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-44836cae-afea-443d-bafe-658e3e77e50c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:47:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:08.539128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] For port 5e065dc4-c922-4e2a-8f89-cf23d6684d63, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=5e065dc4-c922-4e2a-8f89-cf23d6684d63,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:08.539487 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:08.668232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-44836cae-afea-443d-bafe-658e3e77e50c None None] Set router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:08.711451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for 5e065dc4-c922-4e2a-8f89-cf23d6684d63 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:48:08.804150 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:08.814229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-44836cae-afea-443d-bafe-658e3e77e50c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:48:08Z', 'revision_number': 6, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:08.830789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44836cae-afea-443d-bafe-658e3e77e50c None None] The sync data for ids ['f1e265b8-30b0-454f-b7a1-8e4b4bd686b0'] in n-d-841483-1 is: [{'id': 'f1e265b8-30b0-454f-b7a1-8e4b4bd686b0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1371143099', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:45:25Z', 'updated_at': '2022-05-12T15:48:08Z', 'revision_number': 6, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:48:08.863086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48890) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:08.864145 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:08.924683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Allocated IP 172.20.0.2 (d13f4c27-5358-4d60-abb1-0c94e69df718/020f79af-22ce-41ca-91a6-931258be2176/49246c67-1781-44e0-b588-1ca9a8bb37de) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:08.978499 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.056821 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-507d6c70-22c6-427b-b5d6-1fc23c178347 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/floatingips/b681fcdb-b426-40f9-958a-a7594097770b HTTP/1.1" status: 200 len: 994 time: 0.1901264 May 12 15:48:09.067817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=5e065dc4-c922-4e2a-8f89-cf23d6684d63,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:09.141357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Allocated IP 172.25.8.209 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/27013f92-3ec2-4c63-a09f-c5fb5ef8f397) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:09.234416 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.256998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Transition to ACTIVE for port object 49246c67-1781-44e0-b588-1ca9a8bb37de will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:09.258567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48900) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:09.292496 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.296099 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Transition to ACTIVE for port object 49246c67-1781-44e0-b588-1ca9a8bb37de will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:09.304701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b637b204-0c0f-40ad-9313-1ffc15240696 None None] DHCP port deletion for 96b03b8b-8b48-4742-a456-9d456e030e73 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:48:09.328759 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b637b204-0c0f-40ad-9313-1ffc15240696 None None] Deleting port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:48:09.331330 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b637b204-0c0f-40ad-9313-1ffc15240696 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.358175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48906) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:09.379794 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.466380 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Network d13f4c27-5358-4d60-abb1-0c94e69df718 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:09.471794 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:09.479025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:09.479672 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.487512 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Pushing event updated for resources: {'Port': ['ID=49246c67-1781-44e0-b588-1ca9a8bb37de,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:09.506772 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f6604b2-42dd-4d8e-afd5-5adbec5a0311 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.587250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6f6604b2-42dd-4d8e-afd5-5adbec5a0311 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:09.617537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6f6604b2-42dd-4d8e-afd5-5adbec5a0311 admin admin] Usage tracker for resource:security_group_rule and tenant:af519608ad0b4a1b80facf3e58c468f9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:09.621678 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc2d46cb-3396-43bd-9eb9-7826c6e0ec7b req-c70ef861-1fc0-49be-b70a-f8f86430a7a1 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.1038761 May 12 15:48:09.624238 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.624643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6f6604b2-42dd-4d8e-afd5-5adbec5a0311 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:09.627709 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.641775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6f6604b2-42dd-4d8e-afd5-5adbec5a0311 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:09.681436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting port 5c448329-295f-445b-83d2-a39ef5023849 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:48:09.681852 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.682668 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.683736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Fanout notify agent at l3_agent the message router_deleted on router f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:48:09.714993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.716053 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.716659 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-909ad907-09e8-466a-9416-66575922a99a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/routers/f1e265b8-30b0-454f-b7a1-8e4b4bd686b0 HTTP/1.1" status: 204 len: 168 time: 2.0893137 May 12 15:48:09.719426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48910) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:09.734653 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Attempting to bind port 49246c67-1781-44e0-b588-1ca9a8bb37de on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:09.735014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Attempting to bind port 49246c67-1781-44e0-b588-1ca9a8bb37de by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:09.735387 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Attempting to bind port 49246c67-1781-44e0-b588-1ca9a8bb37de on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:09.754311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 47, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:09.754615 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Checking segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:09.755001 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.755376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Bound using segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:09.755829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Bound port: 49246c67-1781-44e0-b588-1ca9a8bb37de, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:09.756194 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.788331 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc2d46cb-3396-43bd-9eb9-7826c6e0ec7b req-a11869b5-f879-44c0-9584-a8f65599089d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0651987 May 12 15:48:09.842707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Pushing event updated for resources: {'Port': ['ID=27013f92-3ec2-4c63-a09f-c5fb5ef8f397,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:09.854040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:09.870704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b637b204-0c0f-40ad-9313-1ffc15240696 None None] For port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c0d3d1a7-c497-40d6-93d7-f0a6747b1c15,segment=NetworkSegment(cf19c71b-ab00-459e-982f-b233b38347af),segment_id=cf19c71b-ab00-459e-982f-b233b38347af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:09.871159 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b637b204-0c0f-40ad-9313-1ffc15240696 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:09.876143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:09.882959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:09.885235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-83640106-4d79-42d1-b504-1633bd86568d None None] For port 49246c67-1781-44e0-b588-1ca9a8bb37de, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:09.921490 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc2d46cb-3396-43bd-9eb9-7826c6e0ec7b req-1bf0454f-7454-4ff9-bc0f-bf1aad07e94c service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0656245 May 12 15:48:09.961894 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.000464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b637b204-0c0f-40ad-9313-1ffc15240696 None None] Calling delete_port for c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:48:10.039412 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-83640106-4d79-42d1-b504-1633bd86568d None None] For port 49246c67-1781-44e0-b588-1ca9a8bb37de, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=49246c67-1781-44e0-b588-1ca9a8bb37de,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:10.042137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:48:10.042847 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.051799 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.164234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83640106-4d79-42d1-b504-1633bd86568d None None] Pushing event updated for resources: {'Port': ['ID=49246c67-1781-44e0-b588-1ca9a8bb37de,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:10.172581 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b637b204-0c0f-40ad-9313-1ffc15240696 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.241809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b637b204-0c0f-40ad-9313-1ffc15240696 None None] Pushing event deleted for resources: {'Port': ['ID=c0d3d1a7-c497-40d6-93d7-f0a6747b1c15,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:10.250696 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b637b204-0c0f-40ad-9313-1ffc15240696 None None] No DVR routers for this DVR port c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:48:10.387038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] The port 'c0d3d1a7-c497-40d6-93d7-f0a6747b1c15' was deleted {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:48:10.397372 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f6604b2-42dd-4d8e-afd5-5adbec5a0311 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.428001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc2d46cb-3396-43bd-9eb9-7826c6e0ec7b req-6cd93133-ca71-4e17-970a-97944b3db8a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:10.429974 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc2d46cb-3396-43bd-9eb9-7826c6e0ec7b req-6cd93133-ca71-4e17-970a-97944b3db8a0 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.5022144 May 12 15:48:10.435456 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.435767 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.438997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5e065dc4-c922-4e2a-8f89-cf23d6684d63 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:48:10.530763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 5e065dc4-c922-4e2a-8f89-cf23d6684d63 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:48:10.531432 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 5e065dc4-c922-4e2a-8f89-cf23d6684d63 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:48:10.531637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:48:10.567179 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.580242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:48:10.580242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c0d3d1a7-c497-40d6-93d7-f0a6747b1c15 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:48:10.580242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0f3cbe16-d9fe-46b2-b341-ab176c57b531 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:48:10.581988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Calling delete_port for 5c448329-295f-445b-83d2-a39ef5023849 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:48:10.602217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['96b03b8b-8b48-4742-a456-9d456e030e73']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:10.620271 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6f6604b2-42dd-4d8e-afd5-5adbec5a0311 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.625232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cf19c71b-ab00-459e-982f-b233b38347af') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:10.625813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cf19c71b-ab00-459e-982f-b233b38347af') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:10.626623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 0f3cbe16-d9fe-46b2-b341-ab176c57b531 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:48:10.627065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0f3cbe16-d9fe-46b2-b341-ab176c57b531 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:48:10.642805 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.662573 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.670094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Releasing vlan 562 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:48:10.671108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: timer() May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:48:10.686653 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:48:10.729134 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6f6604b2-42dd-4d8e-afd5-5adbec5a0311 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=af519608ad0b4a1b80facf3e58c468f9&name=default HTTP/1.1" status: 200 len: 2983 time: 1.4694660 May 12 15:48:10.733507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f6604b2-42dd-4d8e-afd5-5adbec5a0311 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ebb316e0-a4ba-456a-887e-e383d70854bd,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:10.738985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48914) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:10.773050 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.791408 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.805674 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/networks/96b03b8b-8b48-4742-a456-9d456e030e73 HTTP/1.1" status: 204 len: 168 time: 1.0818918 May 12 15:48:10.805674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16277e8e-5425-4d40-a141-801543f6f490 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Network': ['ID=96b03b8b-8b48-4742-a456-9d456e030e73,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:10.806711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48918) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:10.879601 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1516daad-717a-4086-a6dd-d2ec4d93abb9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:10.913888 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1516daad-717a-4086-a6dd-d2ec4d93abb9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.001074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1516daad-717a-4086-a6dd-d2ec4d93abb9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.017723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1516daad-717a-4086-a6dd-d2ec4d93abb9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=93d6a643-d4d6-485b-81ac-56893147cebc,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:11.024629 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1516daad-717a-4086-a6dd-d2ec4d93abb9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.028333 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1516daad-717a-4086-a6dd-d2ec4d93abb9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/security-groups/93d6a643-d4d6-485b-81ac-56893147cebc HTTP/1.1" status: 204 len: 168 time: 0.2189031 May 12 15:48:11.049596 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ea8bf42-1089-469a-9637-2a02f23f2013 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.053624 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.172951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48926) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:11.178915 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ea8bf42-1089-469a-9637-2a02f23f2013 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.184381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1248896788', 'description': 'tempest-secgroup-smoke-1248896788 description', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:11.193344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:11.203338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:11.206812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:11.213751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:11.230307 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.252544 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.261476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:11.265592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:11.268986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:11.275115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:11.329811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Port': ['ID=5c448329-295f-445b-83d2-a39ef5023849,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:11.362676 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.367220 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.394389 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f82680d6-b542-4f43-bb2f-d39c73d61f21 None None] Network d13f4c27-5358-4d60-abb1-0c94e69df718 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:48:11.397873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:11.398233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:11.398555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:11.398887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:11.399216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:11.399541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:11.399862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:11.400184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:11.400497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:11.401002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:11.401321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:11.401677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:11.411568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7161f302-3fa1-419c-846a-d65b5f05897a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:11.415185 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.416359 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-85f9f1a4-4d74-44b0-b8ba-8ad1e6a4b0cb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.2382152 May 12 15:48:11.419133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48930) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:11.425601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-16a5a264-e0c3-4697-b998-955e895d2d8c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '7161f302-3fa1-419c-846a-d65b5f05897a', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:11.432660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-16a5a264-e0c3-4697-b998-955e895d2d8c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:11.437232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-16a5a264-e0c3-4697-b998-955e895d2d8c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:11.440627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-16a5a264-e0c3-4697-b998-955e895d2d8c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:11.447037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-16a5a264-e0c3-4697-b998-955e895d2d8c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:11.464206 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16a5a264-e0c3-4697-b998-955e895d2d8c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.500566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-353fb300-26bd-4ca9-85bf-b5ea3335f274 None None] Provisioning for port 49246c67-1781-44e0-b588-1ca9a8bb37de completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:11.536570 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16a5a264-e0c3-4697-b998-955e895d2d8c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.542161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16a5a264-e0c3-4697-b998-955e895d2d8c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.559831 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.560091 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Floating IP b681fcdb-b426-40f9-958a-a7594097770b disassociated (deleted). External IP: 172.25.8.156, port: 95ac94e2-2622-4853-b774-aa79cb57ca97. May 12 15:48:11.570265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16a5a264-e0c3-4697-b998-955e895d2d8c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=54ec18d1-dd2f-4f53-8b01-8d660cf0a41f,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:11.580826 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16a5a264-e0c3-4697-b998-955e895d2d8c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.585571 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-16a5a264-e0c3-4697-b998-955e895d2d8c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1653893 May 12 15:48:11.586435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48934) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:11.593790 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d8485394-eb80-48d2-924e-bb8ffd5fb159 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '7161f302-3fa1-419c-846a-d65b5f05897a', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:11.600420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d8485394-eb80-48d2-924e-bb8ffd5fb159 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:11.604348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d8485394-eb80-48d2-924e-bb8ffd5fb159 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:11.607620 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d8485394-eb80-48d2-924e-bb8ffd5fb159 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:11.613548 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ea8bf42-1089-469a-9637-2a02f23f2013 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.614892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d8485394-eb80-48d2-924e-bb8ffd5fb159 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:11.633831 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8485394-eb80-48d2-924e-bb8ffd5fb159 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.709543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8485394-eb80-48d2-924e-bb8ffd5fb159 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.714324 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8485394-eb80-48d2-924e-bb8ffd5fb159 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.739701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8485394-eb80-48d2-924e-bb8ffd5fb159 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a943ef7a-8050-452c-b30c-3f2781316380,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:11.752883 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d8485394-eb80-48d2-924e-bb8ffd5fb159 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.756807 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d8485394-eb80-48d2-924e-bb8ffd5fb159 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1660330 May 12 15:48:11.757217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48938) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:11.763050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8bc9cc46-2d18-4aa4-a245-8066099cd716 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '7161f302-3fa1-419c-846a-d65b5f05897a', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:11.770865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8bc9cc46-2d18-4aa4-a245-8066099cd716 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:11.775001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8bc9cc46-2d18-4aa4-a245-8066099cd716 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:11.778160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8bc9cc46-2d18-4aa4-a245-8066099cd716 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:11.784393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8bc9cc46-2d18-4aa4-a245-8066099cd716 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:11.802323 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8bc9cc46-2d18-4aa4-a245-8066099cd716 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.870778 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8bc9cc46-2d18-4aa4-a245-8066099cd716 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.872372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ea8bf42-1089-469a-9637-2a02f23f2013 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ebb316e0-a4ba-456a-887e-e383d70854bd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:11.877346 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8bc9cc46-2d18-4aa4-a245-8066099cd716 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.903901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bc9cc46-2d18-4aa4-a245-8066099cd716 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=451cd95a-da14-46de-81c4-6383605f0d44,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:11.918079 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8bc9cc46-2d18-4aa4-a245-8066099cd716 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.919520 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8bc9cc46-2d18-4aa4-a245-8066099cd716 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1612995 May 12 15:48:11.923561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48942) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:11.928395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-50a4a75b-d4f2-4eb1-8b87-1d36d7729bcc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '7161f302-3fa1-419c-846a-d65b5f05897a', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:11.935448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-50a4a75b-d4f2-4eb1-8b87-1d36d7729bcc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:11.939803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-50a4a75b-d4f2-4eb1-8b87-1d36d7729bcc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:11.942826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-50a4a75b-d4f2-4eb1-8b87-1d36d7729bcc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:11.948939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-50a4a75b-d4f2-4eb1-8b87-1d36d7729bcc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:11.970167 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-50a4a75b-d4f2-4eb1-8b87-1d36d7729bcc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:11.990226 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.035234 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-50a4a75b-d4f2-4eb1-8b87-1d36d7729bcc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.038919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-50a4a75b-d4f2-4eb1-8b87-1d36d7729bcc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.066226 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50a4a75b-d4f2-4eb1-8b87-1d36d7729bcc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d6d1d908-160e-4138-a352-3ffece54016c,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:12.076781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-50a4a75b-d4f2-4eb1-8b87-1d36d7729bcc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.078342 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-50a4a75b-d4f2-4eb1-8b87-1d36d7729bcc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1541815 May 12 15:48:12.080881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48946) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:12.086266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1eef86b6-2cdf-4542-a821-8b9343daeee2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '7161f302-3fa1-419c-846a-d65b5f05897a', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:12.093258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1eef86b6-2cdf-4542-a821-8b9343daeee2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:12.096999 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ea8bf42-1089-469a-9637-2a02f23f2013 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.097148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1eef86b6-2cdf-4542-a821-8b9343daeee2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:12.098142 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4ea8bf42-1089-469a-9637-2a02f23f2013 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ebb316e0-a4ba-456a-887e-e383d70854bd HTTP/1.1" status: 204 len: 168 time: 1.3591337 May 12 15:48:12.100024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1eef86b6-2cdf-4542-a821-8b9343daeee2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:12.105796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1eef86b6-2cdf-4542-a821-8b9343daeee2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:12.118583 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-1eef86b6-2cdf-4542-a821-8b9343daeee2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Project b88b5989d4c548dba6124f2e4690e5c3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:48:12.125950 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1eef86b6-2cdf-4542-a821-8b9343daeee2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.195976 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1eef86b6-2cdf-4542-a821-8b9343daeee2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.200369 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1eef86b6-2cdf-4542-a821-8b9343daeee2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.224796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eef86b6-2cdf-4542-a821-8b9343daeee2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d3d21c3f-f349-4f67-a21c-8699c9696cae,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:12.237572 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1eef86b6-2cdf-4542-a821-8b9343daeee2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.242398 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1eef86b6-2cdf-4542-a821-8b9343daeee2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1600385 May 12 15:48:12.243080 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48952) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:12.248519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-29fd42ea-3607-41b2-abb5-4e13b9a40018 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '7161f302-3fa1-419c-846a-d65b5f05897a', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:12.255544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-29fd42ea-3607-41b2-abb5-4e13b9a40018 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:12.259838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-29fd42ea-3607-41b2-abb5-4e13b9a40018 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:12.263888 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-29fd42ea-3607-41b2-abb5-4e13b9a40018 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:12.272768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-29fd42ea-3607-41b2-abb5-4e13b9a40018 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:12.289655 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-29fd42ea-3607-41b2-abb5-4e13b9a40018 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Project b88b5989d4c548dba6124f2e4690e5c3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:48:12.299557 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29fd42ea-3607-41b2-abb5-4e13b9a40018 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.381655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29fd42ea-3607-41b2-abb5-4e13b9a40018 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.387791 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29fd42ea-3607-41b2-abb5-4e13b9a40018 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.418052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29fd42ea-3607-41b2-abb5-4e13b9a40018 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c3f28a17-5c84-4802-b0bf-1e4f8413f810,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:12.435200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-29fd42ea-3607-41b2-abb5-4e13b9a40018 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.437906 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-29fd42ea-3607-41b2-abb5-4e13b9a40018 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1937003 May 12 15:48:12.439690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48958) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:12.451078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Router c5f7aaa9-0739-4d05-b072-f7db2111e5ba has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:48:12.453719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Router c4a7b7e0-fe66-4b58-a3e2-7e635585791d is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:48:12.457063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'network': {'name': 'tempest-network-smoke--1841658049', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'port_security_enabled': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:12.462840 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:12.466884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:network and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:12.470753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:12.477241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:12.491006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48962) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:12.491948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 49246c67-1781-44e0-b588-1ca9a8bb37de up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:12.505179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Made reservation on behalf of b88b5989d4c548dba6124f2e4690e5c3 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:48:12.508652 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.524452 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf56d2b2-0764-4b2a-a415-41ce1ae9e0dc admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.549857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cf56d2b2-0764-4b2a-a415-41ce1ae9e0dc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:12.557243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cf56d2b2-0764-4b2a-a415-41ce1ae9e0dc admin admin] Usage tracker for resource:security_group_rule and tenant:d94ded36f9694571ae61288be1af0533 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:12.563233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cf56d2b2-0764-4b2a-a415-41ce1ae9e0dc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:12.565926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 564} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:48:12.567740 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 49246c67-1781-44e0-b588-1ca9a8bb37de completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:12.572851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 49246c67-1781-44e0-b588-1ca9a8bb37de triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:12.573214 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.573839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cf56d2b2-0764-4b2a-a415-41ce1ae9e0dc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:12.584998 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.585303 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Added segment 8324a333-973a-4a60-b286-77665151f901 of type vlan for network 2c49c390-e121-4f31-92ba-528e8cdf62dd May 12 15:48:12.632431 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.702527 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.706822 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.707866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:12.708439 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.748241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 49246c67-1781-44e0-b588-1ca9a8bb37de, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=49246c67-1781-44e0-b588-1ca9a8bb37de,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:12.753453 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.753765 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf56d2b2-0764-4b2a-a415-41ce1ae9e0dc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.791283 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4b3801cc-a79c-47c0-a6bc-1fd8271a3337 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.807587 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf56d2b2-0764-4b2a-a415-41ce1ae9e0dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.826065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=49246c67-1781-44e0-b588-1ca9a8bb37de,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:12.832335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:12.834365 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:12.837904 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.847647 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8eb3f88-4c2e-40cc-8d7d-c081f8424e0d None None] Sync routers for ids ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:48:12.853513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Sync routers for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:48:12.860389 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8eb3f88-4c2e-40cc-8d7d-c081f8424e0d None None] Routers {'c5f7aaa9-0739-4d05-b072-f7db2111e5ba'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:12.861291 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c8eb3f88-4c2e-40cc-8d7d-c081f8424e0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:47:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:12.872261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf56d2b2-0764-4b2a-a415-41ce1ae9e0dc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=735c16e5-533b-4245-a3a9-d53ed58c7039,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:12.875718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:12.876368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d70878e0-0467-4279-b014-67a421a97431 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:47:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:12.890349 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Network': ['ID=2c49c390-e121-4f31-92ba-528e8cdf62dd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:12.896264 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ba93c732-959a-45f4-9000-16055d67f87e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.4553380 May 12 15:48:12.897297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 48966) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:12.906868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'admin_state_up': True, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:12.914632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:12.918865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:router and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:12.921984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:12.928770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:12.931137 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-52c74733-db3c-4b92-9dff-d9efc6e884f1 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "DELETE /v2.0/floatingips/b681fcdb-b426-40f9-958a-a7594097770b HTTP/1.1" status: 204 len: 168 time: 3.5719159 May 12 15:48:12.932468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '876c4deb-264b-4d18-a670-939dd27bf316', 'tag': '95ac94e2-2622-4853-b774-aa79cb57ca97'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:48:12.938374 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cf56d2b2-0764-4b2a-a415-41ce1ae9e0dc admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d94ded36f9694571ae61288be1af0533&name=default HTTP/1.1" status: 200 len: 2983 time: 0.4462938 May 12 15:48:12.941876 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.942903 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.952315 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.959116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c1016b37-ab91-453e-97d2-20126fcbc730 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 5.1679423 May 12 15:48:12.960363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48972) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:12.961049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 48978) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:12.963571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:12.986817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 2c49c390-e121-4f31-92ba-528e8cdf62dd details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:48:13.144174 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-c8eb3f88-4c2e-40cc-8d7d-c081f8424e0d None None] Set router c5f7aaa9-0739-4d05-b072-f7db2111e5ba gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:13.172441 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e0361fff-2993-44b0-b310-a0b877f8db78'] response: {'name': 'network-changed', 'server_uuid': '876c4deb-264b-4d18-a670-939dd27bf316', 'tag': '95ac94e2-2622-4853-b774-aa79cb57ca97', 'status': 'completed', 'code': 200} May 12 15:48:13.272657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:13.429893 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77eb5042-96ac-4330-8147-a23ece23bc5d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:13.464342 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77eb5042-96ac-4330-8147-a23ece23bc5d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:13.582506 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:13.636321 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c8eb3f88-4c2e-40cc-8d7d-c081f8424e0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87'}], 'enable_snat': True}, 'gw_port_id': '0b130198-953d-4f1e-95d3-4d8791331284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:47:07Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '0b130198-953d-4f1e-95d3-4d8791331284', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:e5:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3802, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:46:59Z', 'updated_at': '2022-05-12T15:47:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c6584f69-ed28-4741-b68f-c92c73eccc19', 'name': '', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:e8:e9:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 3820, 'fixed_ips': [{'subnet_id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:47:06Z', 'updated_at': '2022-05-12T15:47:14Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:13.646165 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8eb3f88-4c2e-40cc-8d7d-c081f8424e0d None None] Checking router: c5f7aaa9-0739-4d05-b072-f7db2111e5ba for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:48:13.656850 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:13.672357 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8eb3f88-4c2e-40cc-8d7d-c081f8424e0d None None] Routers {'c5f7aaa9-0739-4d05-b072-f7db2111e5ba'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:13.676648 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c8eb3f88-4c2e-40cc-8d7d-c081f8424e0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:47:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:13.712614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b304b59-c7b6-4519-9a75-2639f17d8310 req-ddcb82e4-3089-457a-8146-0b272e28102d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:13.714144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9b304b59-c7b6-4519-9a75-2639f17d8310 req-ddcb82e4-3089-457a-8146-0b272e28102d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b641518781114418963451fc3ff58f4d&device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 1097 time: 0.6112819 May 12 15:48:13.780021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d70878e0-0467-4279-b014-67a421a97431 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:10Z', 'revision_number': 3, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:13.785563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Checking router: c4a7b7e0-fe66-4b58-a3e2-7e635585791d for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:48:13.785909 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Updating router c4a7b7e0-fe66-4b58-a3e2-7e635585791d port 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:48:13.851444 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:13.953439 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-c8eb3f88-4c2e-40cc-8d7d-c081f8424e0d None None] Set router c5f7aaa9-0739-4d05-b072-f7db2111e5ba gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:13.962847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b304b59-c7b6-4519-9a75-2639f17d8310 req-a32e33f3-6e54-4bb3-9dfe-17561638e762 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:13.964325 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9b304b59-c7b6-4519-9a75-2639f17d8310 req-a32e33f3-6e54-4bb3-9dfe-17561638e762 service neutron] 10.222.0.84 "GET /v2.0/networks?id=27a3a31e-244b-4431-86b4-73b53f4f0c89 HTTP/1.1" status: 200 len: 897 time: 0.1941528 May 12 15:48:14.031013 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77eb5042-96ac-4330-8147-a23ece23bc5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:14.064119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77eb5042-96ac-4330-8147-a23ece23bc5d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=735c16e5-533b-4245-a3a9-d53ed58c7039,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:14.095402 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-77eb5042-96ac-4330-8147-a23ece23bc5d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:14.098593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-77eb5042-96ac-4330-8147-a23ece23bc5d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/735c16e5-533b-4245-a3a9-d53ed58c7039 HTTP/1.1" status: 204 len: 168 time: 1.1286390 May 12 15:48:14.120821 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9b304b59-c7b6-4519-9a75-2639f17d8310 req-3c172b0b-fe6b-4bfc-819a-847a99bf409c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=95ac94e2-2622-4853-b774-aa79cb57ca97 HTTP/1.1" status: 200 len: 217 time: 0.1445026 May 12 15:48:14.296638 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:14.309052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e281dc-1b3d-4214-9876-19f7f73d9b57 req-ffee79e6-92c3-4e06-a12e-6d579aa252b6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:14.309825 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-19e281dc-1b3d-4214-9876-19f7f73d9b57 req-ffee79e6-92c3-4e06-a12e-6d579aa252b6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:48:14.311841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Transition to ACTIVE for port object 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:14.334698 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:14.366725 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:14.414470 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:14.423540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Attempting to bind port 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:14.428579 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Attempting to bind port 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:14.433228 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-19e281dc-1b3d-4214-9876-19f7f73d9b57 req-ffee79e6-92c3-4e06-a12e-6d579aa252b6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:48:14.433470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Attempting to bind port 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:14.441876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19e281dc-1b3d-4214-9876-19f7f73d9b57 req-ffee79e6-92c3-4e06-a12e-6d579aa252b6 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 946 time: 0.5387645 May 12 15:48:14.460205 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 47, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:14.460606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:14.460976 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:14.461365 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:14.461885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Bound port: 27013f92-3ec2-4c63-a09f-c5fb5ef8f397, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:14.462215 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:14.470230 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c8eb3f88-4c2e-40cc-8d7d-c081f8424e0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87'}], 'enable_snat': True}, 'gw_port_id': '0b130198-953d-4f1e-95d3-4d8791331284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:47:07Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '0b130198-953d-4f1e-95d3-4d8791331284', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:e5:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3802, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:46:59Z', 'updated_at': '2022-05-12T15:47:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c6584f69-ed28-4741-b68f-c92c73eccc19', 'name': '', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:e8:e9:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 3820, 'fixed_ips': [{'subnet_id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:47:06Z', 'updated_at': '2022-05-12T15:47:14Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:14.480778 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8eb3f88-4c2e-40cc-8d7d-c081f8424e0d None None] The sync data for ids ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'] in n-d-841483-1 is: [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87'}], 'enable_snat': True}, 'gw_port_id': '0b130198-953d-4f1e-95d3-4d8791331284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:47:07Z', 'revision_number': 4, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '0b130198-953d-4f1e-95d3-4d8791331284', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:e5:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3802, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:46:59Z', 'updated_at': '2022-05-12T15:47:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'c6584f69-ed28-4741-b68f-c92c73eccc19', 'name': '', 'network_id': '27a3a31e-244b-4431-86b4-73b53f4f0c89', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'mac_address': 'fa:16:3e:e8:e9:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 3820, 'fixed_ips': [{'subnet_id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:47:06Z', 'updated_at': '2022-05-12T15:47:14Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'subnets': [{'id': '4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:48:14.508659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f3aef60-772e-475a-875b-9e1bb3914dd7 None None] Pushing event updated for resources: {'Port': ['ID=27013f92-3ec2-4c63-a09f-c5fb5ef8f397,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:14.519120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 49246c67-1781-44e0-b588-1ca9a8bb37de up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:14.621835 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19e281dc-1b3d-4214-9876-19f7f73d9b57 req-642f7f01-fa39-4acd-964d-51f00af0b1cd tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=52328bfc-80e0-4587-961a-a4facf47e8a6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1750112 May 12 15:48:14.624219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b304b59-c7b6-4519-9a75-2639f17d8310 req-263ef189-0fec-4742-97bf-8291d8e45a10 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:14.626450 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9b304b59-c7b6-4519-9a75-2639f17d8310 req-263ef189-0fec-4742-97bf-8291d8e45a10 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610 HTTP/1.1" status: 200 len: 835 time: 0.4968953 May 12 15:48:14.668721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d70878e0-0467-4279-b014-67a421a97431 None None] For port 27013f92-3ec2-4c63-a09f-c5fb5ef8f397, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:14.676976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d70878e0-0467-4279-b014-67a421a97431 None None] For port 27013f92-3ec2-4c63-a09f-c5fb5ef8f397, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=27013f92-3ec2-4c63-a09f-c5fb5ef8f397,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:14.690992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 49246c67-1781-44e0-b588-1ca9a8bb37de triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:14.691610 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:14.693844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.25.8.37 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/6456e927-9c55-44a1-867f-9d614d3489f4) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:14.724965 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:14.737886 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:14.841974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b304b59-c7b6-4519-9a75-2639f17d8310 req-072d4875-913c-489b-90aa-a49c70eae731 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:14.844950 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9b304b59-c7b6-4519-9a75-2639f17d8310 req-072d4875-913c-489b-90aa-a49c70eae731 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=27a3a31e-244b-4431-86b4-73b53f4f0c89&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2116961 May 12 15:48:14.888893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:14.890587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d70878e0-0467-4279-b014-67a421a97431 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:47:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:14.941401 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3dd657b-f65d-4d8e-a4ac-2d733a17a845 None None] New status for floating IP b681fcdb-b426-40f9-958a-a7594097770b: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:48:15.024818 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:15.058445 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9b304b59-c7b6-4519-9a75-2639f17d8310 req-d2fc180f-8a9e-4a30-b83b-d7cd2673c8c1 service neutron] 10.222.0.84 "GET /v2.0/networks/27a3a31e-244b-4431-86b4-73b53f4f0c89?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1949322 May 12 15:48:15.071289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Allocated IP 172.20.0.1 (d13f4c27-5358-4d60-abb1-0c94e69df718/020f79af-22ce-41ca-91a6-931258be2176/20864bd6-8986-4ba2-bb53-6f32c19879a5) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:15.142161 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f3aef60-772e-475a-875b-9e1bb3914dd7 None None] Pushing event updated for resources: {'Port': ['ID=27013f92-3ec2-4c63-a09f-c5fb5ef8f397,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:15.169016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3aef60-772e-475a-875b-9e1bb3914dd7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:15.169566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3aef60-772e-475a-875b-9e1bb3914dd7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:15.171490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3aef60-772e-475a-875b-9e1bb3914dd7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:15.171924 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3aef60-772e-475a-875b-9e1bb3914dd7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:15.172355 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3aef60-772e-475a-875b-9e1bb3914dd7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:15.172817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3aef60-772e-475a-875b-9e1bb3914dd7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:15.173281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3aef60-772e-475a-875b-9e1bb3914dd7 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:15.173755 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3aef60-772e-475a-875b-9e1bb3914dd7 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:15.174179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3aef60-772e-475a-875b-9e1bb3914dd7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:15.174599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3aef60-772e-475a-875b-9e1bb3914dd7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:15.175020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3aef60-772e-475a-875b-9e1bb3914dd7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:15.175715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f3aef60-772e-475a-875b-9e1bb3914dd7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:15.204410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:15.330248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-d70878e0-0467-4279-b014-67a421a97431 None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:15.331921 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:15.355440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Transition to ACTIVE for port object 20864bd6-8986-4ba2-bb53-6f32c19879a5 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:15.410378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:15.414908 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9b304b59-c7b6-4519-9a75-2639f17d8310 req-88868f06-0e53-45ec-b051-1621b8ec49d1 service neutron] 10.222.0.84 "GET /v2.0/networks/27a3a31e-244b-4431-86b4-73b53f4f0c89?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3487613 May 12 15:48:15.415953 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:15.421050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:15.434345 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:15.439978 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-697eef1f-a56b-4cfb-b38d-53ff17bab4ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:15.488012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=6456e927-9c55-44a1-867f-9d614d3489f4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:15.525332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Network d13f4c27-5358-4d60-abb1-0c94e69df718 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:15.528765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:15.549956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:15.621734 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:15.636522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Pushing event updated for resources: {'Port': ['ID=20864bd6-8986-4ba2-bb53-6f32c19879a5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:15.720779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfed4e99-8b2e-4d83-a80a-2b9dd84a2fba req-bec371c8-ef3a-4b88-995b-be08514b0ab7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:15.726197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cfed4e99-8b2e-4d83-a80a-2b9dd84a2fba req-bec371c8-ef3a-4b88-995b-be08514b0ab7 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 946 time: 0.3380158 May 12 15:48:15.799966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d70878e0-0467-4279-b014-67a421a97431 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:10Z', 'revision_number': 3, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:15.814395 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d70878e0-0467-4279-b014-67a421a97431 None None] The sync data for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 is: [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:10Z', 'revision_number': 3, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:48:15.904542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0212e5f6-ae9b-4133-b669-446e314b3bdf None None] Provisioning for port 20864bd6-8986-4ba2-bb53-6f32c19879a5 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:15.913279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0212e5f6-ae9b-4133-b669-446e314b3bdf None None] Provisioning complete for port 20864bd6-8986-4ba2-bb53-6f32c19879a5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:15.913718 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0212e5f6-ae9b-4133-b669-446e314b3bdf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:15.986531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-cfed4e99-8b2e-4d83-a80a-2b9dd84a2fba req-98ff671c-72ba-4d72-9c52-5b5e2bde3e26 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting port 95ac94e2-2622-4853-b774-aa79cb57ca97 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:48:15.986848 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cfed4e99-8b2e-4d83-a80a-2b9dd84a2fba req-98ff671c-72ba-4d72-9c52-5b5e2bde3e26 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:15.989232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0212e5f6-ae9b-4133-b669-446e314b3bdf None None] Port 20864bd6-8986-4ba2-bb53-6f32c19879a5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:48:16.047287 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:16.192177 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:16.282238 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:16.337736 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:16.465795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:16.599143 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:16.605304 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:16.605994 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:16.606514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd1dce2f-dc00-4634-8d3b-952b5b4b7011 req-d73443f1-4a76-450f-9b94-36ea26df4bb9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:16.613984 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd1dce2f-dc00-4634-8d3b-952b5b4b7011 req-d73443f1-4a76-450f-9b94-36ea26df4bb9 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 946 time: 0.7456400 May 12 15:48:16.689806 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:16.797261 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:16.833144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-cfed4e99-8b2e-4d83-a80a-2b9dd84a2fba req-98ff671c-72ba-4d72-9c52-5b5e2bde3e26 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] For port 95ac94e2-2622-4853-b774-aa79cb57ca97, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=95ac94e2-2622-4853-b774-aa79cb57ca97,segment=NetworkSegment(384ff5b9-795f-4199-b25d-4d1f08782bc8),segment_id=384ff5b9-795f-4199-b25d-4d1f08782bc8)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:16.833956 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cfed4e99-8b2e-4d83-a80a-2b9dd84a2fba req-98ff671c-72ba-4d72-9c52-5b5e2bde3e26 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:16.834786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 27013f92-3ec2-4c63-a09f-c5fb5ef8f397, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=27013f92-3ec2-4c63-a09f-c5fb5ef8f397,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:16.843459 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:16.849078 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd1dce2f-dc00-4634-8d3b-952b5b4b7011 req-91156296-a7b4-44eb-aaec-d4383628e690 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/security-groups?id=52328bfc-80e0-4587-961a-a4facf47e8a6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2340326 May 12 15:48:16.946763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=27013f92-3ec2-4c63-a09f-c5fb5ef8f397,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:17.019311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-cfed4e99-8b2e-4d83-a80a-2b9dd84a2fba req-98ff671c-72ba-4d72-9c52-5b5e2bde3e26 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Calling delete_port for 95ac94e2-2622-4853-b774-aa79cb57ca97 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:48:17.029352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router 8730f760-162a-4cbe-920e-62ab9491281b is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:48:17.153305 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:17.160760 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:17.235546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:17.247145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Sync routers for ids ['8730f760-162a-4cbe-920e-62ab9491281b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:48:17.259946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Routers {'8730f760-162a-4cbe-920e-62ab9491281b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:17.261093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8730f760-162a-4cbe-920e-62ab9491281b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:17.277353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:17.283051 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8c3dd181-5a5f-4cac-92d3-8cc00e08a260 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 4.3821113 May 12 15:48:17.284172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49044) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:17.347812 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5b3acb82-df6e-4a6a-893b-43c6d546255a tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=b88b5989d4c548dba6124f2e4690e5c3&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0617681 May 12 15:48:17.349122 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49050) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:17.365948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Pushing event updated for resources: {'Port': ['ID=20864bd6-8986-4ba2-bb53-6f32c19879a5,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:17.376934 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:17.460897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cfed4e99-8b2e-4d83-a80a-2b9dd84a2fba req-98ff671c-72ba-4d72-9c52-5b5e2bde3e26 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:17.534090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98ff671c-72ba-4d72-9c52-5b5e2bde3e26 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Port': ['ID=95ac94e2-2622-4853-b774-aa79cb57ca97,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:17.536137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Set router 8730f760-162a-4cbe-920e-62ab9491281b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:17.658100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-cfed4e99-8b2e-4d83-a80a-2b9dd84a2fba req-98ff671c-72ba-4d72-9c52-5b5e2bde3e26 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] No DVR routers for this DVR port 95ac94e2-2622-4853-b774-aa79cb57ca97 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:48:17.661167 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-cfed4e99-8b2e-4d83-a80a-2b9dd84a2fba req-98ff671c-72ba-4d72-9c52-5b5e2bde3e26 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:17.672227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '876c4deb-264b-4d18-a670-939dd27bf316', 'name': 'network-vif-deleted', 'tag': '95ac94e2-2622-4853-b774-aa79cb57ca97'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:48:17.721351 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cfed4e99-8b2e-4d83-a80a-2b9dd84a2fba req-98ff671c-72ba-4d72-9c52-5b5e2bde3e26 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.84 "DELETE /v2.0/ports/95ac94e2-2622-4853-b774-aa79cb57ca97 HTTP/1.1" status: 204 len: 173 time: 1.9781628 May 12 15:48:17.722743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91f935ff-991f-4dec-a492-f5d662b9d059 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:17.737019 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-91f935ff-991f-4dec-a492-f5d662b9d059 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.3858697 May 12 15:48:17.737019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49064) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:17.749227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Network d13f4c27-5358-4d60-abb1-0c94e69df718 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:17.751711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:17.778073 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b2986b8b-43c1-4c11-b7a0-6bb2ecede7cf'] response: {'server_uuid': '876c4deb-264b-4d18-a670-939dd27bf316', 'name': 'network-vif-deleted', 'tag': '95ac94e2-2622-4853-b774-aa79cb57ca97', 'status': 'completed', 'code': 200} May 12 15:48:17.815287 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ad0e269d-d3fe-4e27-90cd-23a063ee6dc9 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0770721 May 12 15:48:17.815738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49068) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:17.822073 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1416285199', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:17.871793 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:18.150985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:18.159510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Router c4a7b7e0-fe66-4b58-a3e2-7e635585791d has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:48:18.160408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:subnet and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:18.171502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:18.180952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:18.183152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49076) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:18.207305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Made reservation on behalf of b88b5989d4c548dba6124f2e4690e5c3 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:48:18.210095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 3, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:14Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:18.212503 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:18.222265 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Checking router: 8730f760-162a-4cbe-920e-62ab9491281b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:48:18.227168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Updating router 8730f760-162a-4cbe-920e-62ab9491281b port 6456e927-9c55-44a1-867f-9d614d3489f4 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:48:18.298816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-781308d6-b04d-49f5-9152-f31c93b11e29 req-bba38a0e-479d-406f-bd5c-1f4d0081f6aa tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Synchronizing usage tracker for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:48:18.419077 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:18.476895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8589d465-5898-4983-9c15-5894453aadd6 None None] Provisioning complete for port 20864bd6-8986-4ba2-bb53-6f32c19879a5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:18.478510 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8589d465-5898-4983-9c15-5894453aadd6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:18.478628 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f226c634-8380-480f-88ae-7b2c377b5f2d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:18.508567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f226c634-8380-480f-88ae-7b2c377b5f2d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:18.515352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f226c634-8380-480f-88ae-7b2c377b5f2d admin admin] Usage tracker for resource:security_group_rule and tenant:1f717b5f81904b14be2f7f405b02ff55 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:18.519285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f226c634-8380-480f-88ae-7b2c377b5f2d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:18.522342 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:18.538060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:18.563684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f226c634-8380-480f-88ae-7b2c377b5f2d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:18.615915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:18.618828 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-781308d6-b04d-49f5-9152-f31c93b11e29 req-bba38a0e-479d-406f-bd5c-1f4d0081f6aa tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Unset dirty status for tenant:b641518781114418963451fc3ff58f4d on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:48:18.620114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-781308d6-b04d-49f5-9152-f31c93b11e29 req-bba38a0e-479d-406f-bd5c-1f4d0081f6aa tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "GET /v2.0/ports?device_id=876c4deb-264b-4d18-a670-939dd27bf316 HTTP/1.1" status: 200 len: 210 time: 0.4457257 May 12 15:48:18.630341 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-edcd17fa-9555-45f5-924e-54c80d9621f5 admin admin] 10.222.0.82 "PUT /v2.0/routers/c4a7b7e0-fe66-4b58-a3e2-7e635585791d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.6576374 May 12 15:48:18.649689 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Sync routers for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:48:18.654868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Subnet': ['ID=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:18.662126 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:18.662842 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:18.690639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Checking segment: {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:18.692448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network hostable DHCP agents. Network: 2c49c390-e121-4f31-92ba-528e8cdf62dd, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:48:18.753083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 2c49c390-e121-4f31-92ba-528e8cdf62dd is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:48:18.777271 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f226c634-8380-480f-88ae-7b2c377b5f2d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:18.782823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 2c49c390-e121-4f31-92ba-528e8cdf62dd) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:18.789218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:18.790097 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:18.806480 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f226c634-8380-480f-88ae-7b2c377b5f2d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:18.879570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49088) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:18.891056 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f226c634-8380-480f-88ae-7b2c377b5f2d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1f717b5f81904b14be2f7f405b02ff55&name=default HTTP/1.1" status: 200 len: 2983 time: 0.7068245 May 12 15:48:18.895416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f226c634-8380-480f-88ae-7b2c377b5f2d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=127615ff-818c-40ac-bd91-294ca9bcc1a4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:18.951133 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9fa210c8-b50a-4ab7-ad22-dae22403f713 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 1.1333439 May 12 15:48:18.953418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49094) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:18.983584 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:18.997173 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2d4747-70ab-47e2-832d-245acdb617bf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.026776 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2d4747-70ab-47e2-832d-245acdb617bf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.104638 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2d4747-70ab-47e2-832d-245acdb617bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.125619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8a0e1b9-05fc-4210-8871-0465062a7669 None None] Network 2c49c390-e121-4f31-92ba-528e8cdf62dd requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:48:19.126185 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b2d4747-70ab-47e2-832d-245acdb617bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=127615ff-818c-40ac-bd91-294ca9bcc1a4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:19.128787 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2d4747-70ab-47e2-832d-245acdb617bf admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.133042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8b2d4747-70ab-47e2-832d-245acdb617bf admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/127615ff-818c-40ac-bd91-294ca9bcc1a4 HTTP/1.1" status: 204 len: 168 time: 0.2525685 May 12 15:48:19.176681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8589d465-5898-4983-9c15-5894453aadd6 None None] Port 20864bd6-8986-4ba2-bb53-6f32c19879a5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:48:19.296384 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.322178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:19.322430 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.392695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Transition to ACTIVE for port object 6456e927-9c55-44a1-867f-9d614d3489f4 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:19.434637 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.567567 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 2, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:19.573309 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Checking router: c4a7b7e0-fe66-4b58-a3e2-7e635585791d for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:48:19.574282 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Updating router c4a7b7e0-fe66-4b58-a3e2-7e635585791d port 20864bd6-8986-4ba2-bb53-6f32c19879a5 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:48:19.614942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49110) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:19.620325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1714193566-network', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:19.630355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:19.638570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Usage tracker for resource:network and tenant:b9e092935fcb4a6aa088e881bf1641c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:19.638776 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f7a792e-d6b9-4abb-88da-9929b44ad7c5 None None] Pushing event updated for resources: {'Port': ['ID=6456e927-9c55-44a1-867f-9d614d3489f4,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:19.644339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:19.646605 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Attempting to bind port 6456e927-9c55-44a1-867f-9d614d3489f4 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:19.647099 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Attempting to bind port 6456e927-9c55-44a1-867f-9d614d3489f4 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:19.647431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Attempting to bind port 6456e927-9c55-44a1-867f-9d614d3489f4 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:19.655735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:19.657503 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.660578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:19.661176 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:19.661745 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.662273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:19.663105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Bound port: 6456e927-9c55-44a1-867f-9d614d3489f4, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:19.663644 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.690355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49116) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:19.693042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Made reservation on behalf of b9e092935fcb4a6aa088e881bf1641c3 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:48:19.695336 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.762312 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.774636 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c8000aa9-34f1-4062-a276-692ae595e630 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.815319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:19.822122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c8000aa9-34f1-4062-a276-692ae595e630 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:19.825480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49120) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:19.829189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Usage tracker for resource:security_group_rule and tenant:b9e092935fcb4a6aa088e881bf1641c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:19.861306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2c49c390-e121-4f31-92ba-528e8cdf62dd', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ips': [{'subnet_id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:48:19.862394 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.874380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:19.878899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c8000aa9-34f1-4062-a276-692ae595e630 admin admin] Usage tracker for resource:security_group_rule and tenant:718af8e5d19e49df83cc2d59c31bfc35 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:19.887098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c8000aa9-34f1-4062-a276-692ae595e630 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:19.896548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:19.898184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] For port 6456e927-9c55-44a1-867f-9d614d3489f4, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:19.900973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c8000aa9-34f1-4062-a276-692ae595e630 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:19.953727 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edb5711a-abf7-4728-943a-a53728262b62 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:19.957045 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] For port 6456e927-9c55-44a1-867f-9d614d3489f4, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6456e927-9c55-44a1-867f-9d614d3489f4,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:19.980032 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.014624 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.022511 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edb5711a-abf7-4728-943a-a53728262b62 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.092642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f7a792e-d6b9-4abb-88da-9929b44ad7c5 None None] Pushing event updated for resources: {'Port': ['ID=6456e927-9c55-44a1-867f-9d614d3489f4,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:20.117918 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.147365 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Transition to ACTIVE for port object 20864bd6-8986-4ba2-bb53-6f32c19879a5 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:20.152870 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.156907 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 95ac94e2-2622-4853-b774-aa79cb57ca97 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:48:20.160049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c8000aa9-34f1-4062-a276-692ae595e630 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.162393 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.168862 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.178780 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c8000aa9-34f1-4062-a276-692ae595e630 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.204306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 95ac94e2-2622-4853-b774-aa79cb57ca97 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:48:20.204633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 95ac94e2-2622-4853-b774-aa79cb57ca97 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:48:20.212353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 557} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:48:20.218847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Routers {'8730f760-162a-4cbe-920e-62ab9491281b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:20.219485 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8730f760-162a-4cbe-920e-62ab9491281b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:20.234951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0598dde3-111e-4ff0-b9f3-52316b280f00,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:20.250641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c8000aa9-34f1-4062-a276-692ae595e630 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=718af8e5d19e49df83cc2d59c31bfc35&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5590825 May 12 15:48:20.251977 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.252460 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Added segment b08993ad-0765-41fc-9d7e-0a9c098fbc64 of type vlan for network 0eeaef15-2568-445a-9d02-7051964139fe May 12 15:48:20.259784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49124) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:20.264587 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edb5711a-abf7-4728-943a-a53728262b62 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.387952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8000aa9-34f1-4062-a276-692ae595e630 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e8097ab-04c6-4129-8fb4-6b8ac3509860,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:20.415306 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.449319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Allocated IP 172.20.0.2 (2c49c390-e121-4f31-92ba-528e8cdf62dd/3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae/72b90871-bbf5-4362-b6cc-49c16f451e78) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:20.454642 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edb5711a-abf7-4728-943a-a53728262b62 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=52328bfc-80e0-4587-961a-a4facf47e8a6,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:20.489339 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edb5711a-abf7-4728-943a-a53728262b62 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.499593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-edb5711a-abf7-4728-943a-a53728262b62 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "DELETE /v2.0/security-groups/52328bfc-80e0-4587-961a-a4facf47e8a6 HTTP/1.1" status: 204 len: 168 time: 0.6717703 May 12 15:48:20.512675 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edaaee98-9ab3-4b83-89d2-536661e294a6 None None] Pushing event updated for resources: {'Port': ['ID=20864bd6-8986-4ba2-bb53-6f32c19879a5,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:20.537939 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaaee98-9ab3-4b83-89d2-536661e294a6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:20.538427 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaaee98-9ab3-4b83-89d2-536661e294a6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:20.538880 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaaee98-9ab3-4b83-89d2-536661e294a6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:20.539318 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaaee98-9ab3-4b83-89d2-536661e294a6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:20.539652 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaaee98-9ab3-4b83-89d2-536661e294a6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:20.539977 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaaee98-9ab3-4b83-89d2-536661e294a6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:20.540333 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaaee98-9ab3-4b83-89d2-536661e294a6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:20.540788 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaaee98-9ab3-4b83-89d2-536661e294a6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:20.541175 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaaee98-9ab3-4b83-89d2-536661e294a6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:20.541596 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaaee98-9ab3-4b83-89d2-536661e294a6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:20.541917 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaaee98-9ab3-4b83-89d2-536661e294a6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:20.542280 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaaee98-9ab3-4b83-89d2-536661e294a6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:48:20.559570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49130) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:20.562664 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-229045f5-f530-47bc-9da4-646f4b20dc07 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.580186 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Attempting to bind port 20864bd6-8986-4ba2-bb53-6f32c19879a5 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:20.580545 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Attempting to bind port 20864bd6-8986-4ba2-bb53-6f32c19879a5 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:20.580897 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Attempting to bind port 20864bd6-8986-4ba2-bb53-6f32c19879a5 on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:20.589840 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:20.590252 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Checking segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:20.590653 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.591066 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Bound using segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:20.591480 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Bound port: 20864bd6-8986-4ba2-bb53-6f32c19879a5, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:20.591894 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.646499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] Set router 8730f760-162a-4cbe-920e-62ab9491281b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:20.685643 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.688447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:20.689696 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.693369 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] For port 20864bd6-8986-4ba2-bb53-6f32c19879a5, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:20.696963 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] For port 20864bd6-8986-4ba2-bb53-6f32c19879a5, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=20864bd6-8986-4ba2-bb53-6f32c19879a5,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:20.703468 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.769686 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.1535730 May 12 15:48:20.770459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49134) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:20.793322 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:20.794066 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:20.854534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Request body: {'subnet': {'network_id': '0eeaef15-2568-445a-9d02-7051964139fe', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1714193566-subnet', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:20.860642 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-229045f5-f530-47bc-9da4-646f4b20dc07 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:20.894483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:20.983255 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edaaee98-9ab3-4b83-89d2-536661e294a6 None None] Pushing event updated for resources: {'Port': ['ID=20864bd6-8986-4ba2-bb53-6f32c19879a5,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:20.992604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Usage tracker for resource:subnet and tenant:b9e092935fcb4a6aa088e881bf1641c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:20.995438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aed03a20-9a1b-4c51-adc9-cb55a1bb93e8 admin admin] Pushing event updated for resources: {'Network': ['ID=0eeaef15-2568-445a-9d02-7051964139fe,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:21.002576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:21.006858 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:21.049133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 0eeaef15-2568-445a-9d02-7051964139fe details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:48:21.058041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:21.066267 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-229045f5-f530-47bc-9da4-646f4b20dc07 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:21.097985 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-229045f5-f530-47bc-9da4-646f4b20dc07 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e8097ab-04c6-4129-8fb4-6b8ac3509860,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:21.173620 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-229045f5-f530-47bc-9da4-646f4b20dc07 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:21.177335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-229045f5-f530-47bc-9da4-646f4b20dc07 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7e8097ab-04c6-4129-8fb4-6b8ac3509860 HTTP/1.1" status: 204 len: 168 time: 0.9072118 May 12 15:48:21.178287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Made reservation on behalf of b9e092935fcb4a6aa088e881bf1641c3 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:48:21.181120 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:21.259124 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:21.309294 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Transition to ACTIVE for port object 72b90871-bbf5-4362-b6cc-49c16f451e78 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:21.348660 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Transition to ACTIVE for port object 72b90871-bbf5-4362-b6cc-49c16f451e78 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:21.367597 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:21.475393 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:20Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:21.480523 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88ff82c5-da34-4b18-bf58-c42a10f6a64d None None] The sync data for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 is: [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:20Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:48:21.496553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Pushing event updated for resources: {'Port': ['ID=72b90871-bbf5-4362-b6cc-49c16f451e78,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:21.500118 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 3, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:21.508970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.20.0.1 (2c49c390-e121-4f31-92ba-528e8cdf62dd/3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae/ba356da3-692c-41a7-9dae-e94814fdc047) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:21.520850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dbe0404-bcc5-4f7a-8735-aa21b0b66494 None None] The sync data for ids ['8730f760-162a-4cbe-920e-62ab9491281b'] in n-d-841483-1 is: [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 3, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:48:21.530723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Network 2c49c390-e121-4f31-92ba-528e8cdf62dd is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:21.534214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:21.542512 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:21.709773 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Attempting to bind port 72b90871-bbf5-4362-b6cc-49c16f451e78 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:21.713366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Attempting to bind port 72b90871-bbf5-4362-b6cc-49c16f451e78 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:21.714256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Attempting to bind port 72b90871-bbf5-4362-b6cc-49c16f451e78 on network 2c49c390-e121-4f31-92ba-528e8cdf62dd {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:21.729467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:21.729843 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Checking segment: {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:21.730400 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:21.738262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Bound using segment: {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:21.739873 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Bound port: 72b90871-bbf5-4362-b6cc-49c16f451e78, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:21.740281 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:21.862156 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:21.880301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Transition to ACTIVE for port object ba356da3-692c-41a7-9dae-e94814fdc047 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:21.908853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] For port 72b90871-bbf5-4362-b6cc-49c16f451e78, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:21.915450 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] For port 72b90871-bbf5-4362-b6cc-49c16f451e78, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=72b90871-bbf5-4362-b6cc-49c16f451e78,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:21.921468 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:21.927580 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:21.958528 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:48:22.013548 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:22.023383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 2c49c390-e121-4f31-92ba-528e8cdf62dd is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:22.036922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:22.046399 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:22.146014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b370d0-acf5-4827-8e34-4edd673bb8e0 None None] Pushing event updated for resources: {'Port': ['ID=72b90871-bbf5-4362-b6cc-49c16f451e78,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:22.192987 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:22.195973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=ba356da3-692c-41a7-9dae-e94814fdc047,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:22.231154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Pushing event updated for resources: {'Subnet': ['ID=f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:22.249994 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Checking segment: {'id': 'b08993ad-0765-41fc-9d7e-0a9c098fbc64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:22.250222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Network hostable DHCP agents. Network: 0eeaef15-2568-445a-9d02-7051964139fe, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:48:22.400725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Network 0eeaef15-2568-445a-9d02-7051964139fe is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:48:22.440476 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 0eeaef15-2568-445a-9d02-7051964139fe) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:22.449323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e127fb67-e947-4d11-a56f-30d0b4a6d4a5 None None] Network 0eeaef15-2568-445a-9d02-7051964139fe requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:48:22.461275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:22.461976 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:22.582331 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e6743db-6cec-4bbf-beca-8c1a05388305 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:22.646382 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 20864bd6-8986-4ba2-bb53-6f32c19879a5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:22.717740 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e2d23ff4-4431-4997-983b-be51ab190b9d admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.9247942 May 12 15:48:22.721369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49158) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:22.739781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:22.802871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1714193566-router', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:22.810646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:22.828682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Usage tracker for resource:router and tenant:b9e092935fcb4a6aa088e881bf1641c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:22.847996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:22.862940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:22.941208 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:22.942269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:22.982701 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:23.099230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-0eeaef15-2568-445a-9d02-7051964139fe', 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'fixed_ips': [{'subnet_id': 'f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:48:23.100201 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:23.364864 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-6e6743db-6cec-4bbf-beca-8c1a05388305 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting port c6584f69-ed28-4741-b68f-c92c73eccc19 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:48:23.365815 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e6743db-6cec-4bbf-beca-8c1a05388305 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:23.524245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Allocated IP 172.20.0.2 (0eeaef15-2568-445a-9d02-7051964139fe/f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e/3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:23.617623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 20864bd6-8986-4ba2-bb53-6f32c19879a5 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:23.773366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-6e6743db-6cec-4bbf-beca-8c1a05388305 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] For port c6584f69-ed28-4741-b68f-c92c73eccc19, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c6584f69-ed28-4741-b68f-c92c73eccc19,segment=NetworkSegment(384ff5b9-795f-4199-b25d-4d1f08782bc8),segment_id=384ff5b9-795f-4199-b25d-4d1f08782bc8)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:23.774117 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e6743db-6cec-4bbf-beca-8c1a05388305 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:23.837734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:23.942738 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:23.955302 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Transition to ACTIVE for port object 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:23.979497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-6e6743db-6cec-4bbf-beca-8c1a05388305 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Calling delete_port for c6584f69-ed28-4741-b68f-c92c73eccc19 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:48:23.986559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Transition to ACTIVE for port object 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:23.996184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 20864bd6-8986-4ba2-bb53-6f32c19879a5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:24.010807 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:24.099077 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30f3fa8d-7b36-439d-8388-e20c5a293e33 None None] Network 2c49c390-e121-4f31-92ba-528e8cdf62dd requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:48:24.127825 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:24.356033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Network 0eeaef15-2568-445a-9d02-7051964139fe is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:24.379649 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:24.408454 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:24.416831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-74736c84-e4a6-472f-9d75-75dfb09cdc96 None None] Provisioning for port 72b90871-bbf5-4362-b6cc-49c16f451e78 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:24.435797 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:24.438699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:24.449325 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e6743db-6cec-4bbf-beca-8c1a05388305 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:24.457090 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:24.548712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e6743db-6cec-4bbf-beca-8c1a05388305 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Port': ['ID=c6584f69-ed28-4741-b68f-c92c73eccc19,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:24.736195 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:24.741467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=ba356da3-692c-41a7-9dae-e94814fdc047,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:24.770959 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Pushing event updated for resources: {'Port': ['ID=3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:24.823292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 20864bd6-8986-4ba2-bb53-6f32c19879a5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=20864bd6-8986-4ba2-bb53-6f32c19879a5,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:24.825624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Attempting to bind port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:24.826021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Attempting to bind port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'b08993ad-0765-41fc-9d7e-0a9c098fbc64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:24.828499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Attempting to bind port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 on network 0eeaef15-2568-445a-9d02-7051964139fe {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:24.838775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:24.839154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Checking segment: {'id': 'b08993ad-0765-41fc-9d7e-0a9c098fbc64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:24.839558 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:24.839954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Bound using segment: {'id': 'b08993ad-0765-41fc-9d7e-0a9c098fbc64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:24.840425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Bound port: 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b08993ad-0765-41fc-9d7e-0a9c098fbc64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:24.840802 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:24.965265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 2c49c390-e121-4f31-92ba-528e8cdf62dd is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:24.966680 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e6743db-6cec-4bbf-beca-8c1a05388305 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:24.986192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] For port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:24.986585 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] For port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02,segment=NetworkSegment(b08993ad-0765-41fc-9d7e-0a9c098fbc64),segment_id=b08993ad-0765-41fc-9d7e-0a9c098fbc64)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:24.988159 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:24.988969 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6456e927-9c55-44a1-867f-9d614d3489f4 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:25.092686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:25.102164 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:25.227103 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 6456e927-9c55-44a1-867f-9d614d3489f4 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:25.240671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 6456e927-9c55-44a1-867f-9d614d3489f4 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:25.240962 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:25.335842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=20864bd6-8986-4ba2-bb53-6f32c19879a5,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:25.479347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48130aec-df21-420d-8739-505d9d5d6160 None None] Pushing event updated for resources: {'Port': ['ID=3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:25.479820 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:25.556939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:25.578336 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:25.611394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 6456e927-9c55-44a1-867f-9d614d3489f4, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6456e927-9c55-44a1-867f-9d614d3489f4,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:25.617886 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:25.681762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6e6743db-6cec-4bbf-beca-8c1a05388305 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Router c5f7aaa9-0739-4d05-b072-f7db2111e5ba has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:48:25.745324 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router 8730f760-162a-4cbe-920e-62ab9491281b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:48:25.785991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=6456e927-9c55-44a1-867f-9d614d3489f4,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:25.882453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Allocated IP 172.25.8.211 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/fb368f25-f1fa-4eb7-8109-23e3550d259f) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:25.966133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e6743db-6cec-4bbf-beca-8c1a05388305 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:25.981658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41561737-f427-4201-9b85-df1891027831 None None] Sync routers for ids ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:48:26.005950 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6e6743db-6cec-4bbf-beca-8c1a05388305 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "PUT /v2.0/routers/c5f7aaa9-0739-4d05-b072-f7db2111e5ba/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.4388380 May 12 15:48:26.006158 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41561737-f427-4201-9b85-df1891027831 None None] Routers {'c5f7aaa9-0739-4d05-b072-f7db2111e5ba'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:26.006678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-41561737-f427-4201-9b85-df1891027831 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:26.007303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49180) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:26.124139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 20864bd6-8986-4ba2-bb53-6f32c19879a5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:26.167967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-bcb69915-1218-4f31-8f22-584331f52a74 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting subnet 4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:48:26.173243 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bcb69915-1218-4f31-8f22-584331f52a74 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:26.266225 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bcb69915-1218-4f31-8f22-584331f52a74 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:26.360172 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:26.383232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:26.395397 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Sync routers for ids ['8730f760-162a-4cbe-920e-62ab9491281b'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:48:26.403996 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bcb69915-1218-4f31-8f22-584331f52a74 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:26.421718 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Routers {'8730f760-162a-4cbe-920e-62ab9491281b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:26.422592 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8730f760-162a-4cbe-920e-62ab9491281b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:26.442163 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-693dea38-37af-482d-9466-06567aa63f5a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "PUT /v2.0/routers/8730f760-162a-4cbe-920e-62ab9491281b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.4758859 May 12 15:48:26.516442 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:26.524965 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 20864bd6-8986-4ba2-bb53-6f32c19879a5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:26.525339 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:26.553659 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bcb69915-1218-4f31-8f22-584331f52a74 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:26.628981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f3f1d15c-0a90-42d4-9d05-8e056347866a None None] Provisioning for port ba356da3-692c-41a7-9dae-e94814fdc047 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:26.648244 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bcb69915-1218-4f31-8f22-584331f52a74 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:26.662802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcb69915-1218-4f31-8f22-584331f52a74 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Subnet': ['ID=4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:26.664886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-41561737-f427-4201-9b85-df1891027831 None None] Set router c5f7aaa9-0739-4d05-b072-f7db2111e5ba gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:26.678048 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bcb69915-1218-4f31-8f22-584331f52a74 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "DELETE /v2.0/subnets/4e82f9dd-39bb-4ef3-8b6a-2e34b7f52610 HTTP/1.1" status: 204 len: 168 time: 0.6683693 May 12 15:48:26.679996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49188) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:26.687940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:26.689267 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:26.695430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:26.868490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-477e0baf-2e27-4d8b-95d1-0988774e6ef6 None None] Network 27a3a31e-244b-4431-86b4-73b53f4f0c89 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:48:26.945848 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Set router 8730f760-162a-4cbe-920e-62ab9491281b gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:27.038091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-a82d83c3-e872-4495-9759-439f9fba9aed tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1248896788&fields=id&tenant_id=b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 267 time: 0.1385486 May 12 15:48:27.072408 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:27.078060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f3f1d15c-0a90-42d4-9d05-8e056347866a None None] Provisioning complete for port ba356da3-692c-41a7-9dae-e94814fdc047 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:27.078060 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f3f1d15c-0a90-42d4-9d05-8e056347866a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:27.243039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a92fa6a-8328-4b5b-bb76-d9c15c5bc3b8 None None] Network 0eeaef15-2568-445a-9d02-7051964139fe requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:48:27.438064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Pushing event updated for resources: {'Port': ['ID=fb368f25-f1fa-4eb7-8109-23e3550d259f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:27.466482 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:48:22Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'ba356da3-692c-41a7-9dae-e94814fdc047', 'name': '', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:88:8c:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3982, 'fixed_ips': [{'subnet_id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:20Z', 'updated_at': '2022-05-12T15:48:23Z', 'revision_number': 2, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:27.473884 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Checking router: 8730f760-162a-4cbe-920e-62ab9491281b for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:48:27.474508 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Updating router 8730f760-162a-4cbe-920e-62ab9491281b port ba356da3-692c-41a7-9dae-e94814fdc047 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:48:27.556449 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:27.586112 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:27.586721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88d2499-bd67-4c8f-8082-3970829db68d req-a1377a95-caa3-4a5a-94be-d478464a4f6e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:27.588400 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-a1377a95-caa3-4a5a-94be-d478464a4f6e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/networks?id=2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 200 len: 797 time: 0.5396786 May 12 15:48:27.598726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting port 0b130198-953d-4f1e-95d3-4d8791331284 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:48:27.599069 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:27.643073 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-3678d2f5-a2a9-46b4-b300-1582e0540163 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/quotas/b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 375 time: 0.0455453 May 12 15:48:27.727982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f3f1d15c-0a90-42d4-9d05-8e056347866a None None] Port ba356da3-692c-41a7-9dae-e94814fdc047 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:48:27.777146 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:27.886216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:27.928635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ca769bd8-9adb-4457-b340-7669edd235f6 None None] Provisioning for port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:28.140607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ca769bd8-9adb-4457-b340-7669edd235f6 None None] Provisioning complete for port ba356da3-692c-41a7-9dae-e94814fdc047 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:28.141245 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ca769bd8-9adb-4457-b340-7669edd235f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:28.174008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6578cccb-40fd-45a1-9687-b66b10aa2bdc None None] DHCP port deletion for 27a3a31e-244b-4431-86b4-73b53f4f0c89 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:48:28.179031 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:28.187370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-29b74eeb-d553-4cef-8bb0-108b3f832312 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.5370140 May 12 15:48:28.197204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] For port 0b130198-953d-4f1e-95d3-4d8791331284, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0b130198-953d-4f1e-95d3-4d8791331284,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:28.198115 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:28.203878 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Transition to ACTIVE for port object ba356da3-692c-41a7-9dae-e94814fdc047 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:28.212050 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6578cccb-40fd-45a1-9687-b66b10aa2bdc None None] Deleting port 03b70439-0ed8-4406-888a-b6afb6de6fc6 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:48:28.212291 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6578cccb-40fd-45a1-9687-b66b10aa2bdc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:28.224413 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:28.225786 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:28.278302 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:28.300732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:28.301101 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:28.340792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ca769bd8-9adb-4457-b340-7669edd235f6 None None] Port ba356da3-692c-41a7-9dae-e94814fdc047 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:48:28.355144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-41561737-f427-4201-9b85-df1891027831 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87'}], 'enable_snat': True}, 'gw_port_id': '0b130198-953d-4f1e-95d3-4d8791331284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port': {'id': '0b130198-953d-4f1e-95d3-4d8791331284', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:e5:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3802, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:46:59Z', 'updated_at': '2022-05-12T15:47:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:28.370599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41561737-f427-4201-9b85-df1891027831 None None] Checking router: c5f7aaa9-0739-4d05-b072-f7db2111e5ba for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:48:28.435348 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6172c06-11ac-479c-9537-7a5fe7a0c5e1 None None] Pushing event updated for resources: {'Port': ['ID=ba356da3-692c-41a7-9dae-e94814fdc047,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:28.478943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41561737-f427-4201-9b85-df1891027831 None None] Routers {'c5f7aaa9-0739-4d05-b072-f7db2111e5ba'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:28.479606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-41561737-f427-4201-9b85-df1891027831 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:28.553410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Router 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:48:28.583719 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Attempting to bind port ba356da3-692c-41a7-9dae-e94814fdc047 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:28.584667 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Attempting to bind port ba356da3-692c-41a7-9dae-e94814fdc047 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:28.585224 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Attempting to bind port ba356da3-692c-41a7-9dae-e94814fdc047 on network 2c49c390-e121-4f31-92ba-528e8cdf62dd {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:28.591064 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:28.591711 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Checking segment: {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:28.592875 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:28.593484 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Bound using segment: {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:28.594119 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Bound port: ba356da3-692c-41a7-9dae-e94814fdc047, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:28.594663 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:28.598114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Calling delete_port for 0b130198-953d-4f1e-95d3-4d8791331284 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:48:28.733928 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-3c835629-7656-40aa-b078-0f14943e0dfb service neutron] 10.222.0.82 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5263121 May 12 15:48:28.823789 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] For port ba356da3-692c-41a7-9dae-e94814fdc047, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:28.832200 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] For port ba356da3-692c-41a7-9dae-e94814fdc047, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ba356da3-692c-41a7-9dae-e94814fdc047,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:28.849290 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:28.884452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:28.917298 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:28.923718 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2d627966-9c6e-4909-a01c-f7463f6fd7e9 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 6.1882453 May 12 15:48:28.924513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49214) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:28.962632 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Routers {'8730f760-162a-4cbe-920e-62ab9491281b'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:28.963215 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8730f760-162a-4cbe-920e-62ab9491281b'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:29.010159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-6578cccb-40fd-45a1-9687-b66b10aa2bdc None None] For port 03b70439-0ed8-4406-888a-b6afb6de6fc6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=03b70439-0ed8-4406-888a-b6afb6de6fc6,segment=NetworkSegment(384ff5b9-795f-4199-b25d-4d1f08782bc8),segment_id=384ff5b9-795f-4199-b25d-4d1f08782bc8)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:29.026564 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6578cccb-40fd-45a1-9687-b66b10aa2bdc None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:29.062447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Sync routers for ids ['4b0ad84c-7e1e-4b79-881d-e1a2d280d891'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:48:29.094707 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:29.124242 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:29.151093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Routers {'4b0ad84c-7e1e-4b79-881d-e1a2d280d891'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:29.152113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['4b0ad84c-7e1e-4b79-881d-e1a2d280d891'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:29.195613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-2e258c59-fd84-43ea-a9a2-e9f2641d2e95 service neutron] 10.222.0.82 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4557297 May 12 15:48:29.227942 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Port': ['ID=0b130198-953d-4f1e-95d3-4d8791331284,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:29.364697 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:29.374280 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] Set router 8730f760-162a-4cbe-920e-62ab9491281b gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:29.473786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02,segment=NetworkSegment(b08993ad-0765-41fc-9d7e-0a9c098fbc64),segment_id=b08993ad-0765-41fc-9d7e-0a9c098fbc64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:29.486170 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6172c06-11ac-479c-9537-7a5fe7a0c5e1 None None] Pushing event updated for resources: {'Port': ['ID=ba356da3-692c-41a7-9dae-e94814fdc047,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:29.542396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6578cccb-40fd-45a1-9687-b66b10aa2bdc None None] Calling delete_port for 03b70439-0ed8-4406-888a-b6afb6de6fc6 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:48:29.652236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-41561737-f427-4201-9b85-df1891027831 None None] Set router c5f7aaa9-0739-4d05-b072-f7db2111e5ba gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:29.734472 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:29.735499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 72b90871-bbf5-4362-b6cc-49c16f451e78 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:29.767312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d23aeb1-c41e-4d5d-8d5b-fdcf9ac63a89 req-a8a9bc85-b3d8-4b89-8f6e-ca16dbd26bd4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 210 time: 0.1296203 May 12 15:48:29.775997 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:29.783001 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:29.846437 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:29.848448 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Fanout notify agent at l3_agent the message router_deleted on router c5f7aaa9-0739-4d05-b072-f7db2111e5ba {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:48:29.883938 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:29.887993 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3947a300-372e-49ca-9f87-ffdd3f436b08 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "DELETE /v2.0/routers/c5f7aaa9-0739-4d05-b072-f7db2111e5ba HTTP/1.1" status: 204 len: 168 time: 3.2068934 May 12 15:48:29.889402 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49240) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:30.018617 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:48:22Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'ba356da3-692c-41a7-9dae-e94814fdc047', 'name': '', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:88:8c:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3982, 'fixed_ips': [{'subnet_id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:20Z', 'updated_at': '2022-05-12T15:48:28Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:30.023586 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cefc9bbf-4db3-4a2e-89dc-f9f04e91e127 None None] The sync data for ids ['8730f760-162a-4cbe-920e-62ab9491281b'] in n-d-841483-1 is: [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:48:22Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'ba356da3-692c-41a7-9dae-e94814fdc047', 'name': '', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:88:8c:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3982, 'fixed_ips': [{'subnet_id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:20Z', 'updated_at': '2022-05-12T15:48:28Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:48:30.069477 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:30.132370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting port 03b70439-0ed8-4406-888a-b6afb6de6fc6 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:48:30.133101 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:30.269927 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:30.410409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-41561737-f427-4201-9b85-df1891027831 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:48:27Z', 'revision_number': 6, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:30.461738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41561737-f427-4201-9b85-df1891027831 None None] The sync data for ids ['c5f7aaa9-0739-4d05-b072-f7db2111e5ba'] in n-d-841483-1 is: [{'id': 'c5f7aaa9-0739-4d05-b072-f7db2111e5ba', 'name': 'tempest-TestNetworkBasicOps-router-1184073561', 'tenant_id': 'b641518781114418963451fc3ff58f4d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:46:58Z', 'updated_at': '2022-05-12T15:48:27Z', 'revision_number': 6, 'project_id': 'b641518781114418963451fc3ff58f4d', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:48:30.501655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6c44c911-473a-4761-a981-5fd85ce31367 None None] Provisioning complete for port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:30.502164 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6c44c911-473a-4761-a981-5fd85ce31367 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:30.672785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:30.689038 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Set router 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:30.703084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Allocated IP 172.20.0.1 (0eeaef15-2568-445a-9d02-7051964139fe/f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e/197f9cef-8851-4e66-915d-5daabb37cd45) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:30.745040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] For port 03b70439-0ed8-4406-888a-b6afb6de6fc6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=03b70439-0ed8-4406-888a-b6afb6de6fc6,segment=NetworkSegment(384ff5b9-795f-4199-b25d-4d1f08782bc8),segment_id=384ff5b9-795f-4199-b25d-4d1f08782bc8)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:30.745636 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:30.961231 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:30.981759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Transition to ACTIVE for port object 197f9cef-8851-4e66-915d-5daabb37cd45 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:31.016337 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6578cccb-40fd-45a1-9687-b66b10aa2bdc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:31.019355 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:31.024936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 72b90871-bbf5-4362-b6cc-49c16f451e78 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:31.075014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Network 0eeaef15-2568-445a-9d02-7051964139fe is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:31.083060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:31.093831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:31.131700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Calling delete_port for 03b70439-0ed8-4406-888a-b6afb6de6fc6 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:48:31.199272 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:31.225609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 72b90871-bbf5-4362-b6cc-49c16f451e78 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:31.226437 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:31.236818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d19bb8b-9f32-437f-bc33-025de6d0a562 req-eac3197e-6023-4418-b632-ac6547a00645 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 210 time: 0.1239247 May 12 15:48:31.260979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Pushing event updated for resources: {'Port': ['ID=197f9cef-8851-4e66-915d-5daabb37cd45,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:31.321069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6578cccb-40fd-45a1-9687-b66b10aa2bdc None None] Pushing event deleted for resources: {'Port': ['ID=03b70439-0ed8-4406-888a-b6afb6de6fc6,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:31.360377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6578cccb-40fd-45a1-9687-b66b10aa2bdc None None] No DVR routers for this DVR port 03b70439-0ed8-4406-888a-b6afb6de6fc6 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:48:31.410146 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.db.api [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88152) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:48:31.410385 n-d-841483-1 neutron-server[88152]: DEBUG oslo_db.api [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:48:31.541365 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:31.715726 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:31.837482 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88d2499-bd67-4c8f-8082-3970829db68d req-aa29684b-c959-4dfa-b03b-afbf9c2bf846 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:31.843991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-aa29684b-c959-4dfa-b03b-afbf9c2bf846 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.84 "GET /v2.0/networks?id=2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 200 len: 797 time: 0.3229163 May 12 15:48:31.913975 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:31.928276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Deleting port 03b70439-0ed8-4406-888a-b6afb6de6fc6 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:48:31.928596 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:31.930453 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:31.946737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 72b90871-bbf5-4362-b6cc-49c16f451e78, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=72b90871-bbf5-4362-b6cc-49c16f451e78,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:31.957862 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:32.028246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] The port '03b70439-0ed8-4406-888a-b6afb6de6fc6' was deleted {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:48:32.079215 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-81c96fb2-cc8c-4eed-942b-a5fa6c1de64c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 380 time: 0.2112498 May 12 15:48:32.108540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'port': {'device_id': '14a655a9-bdaa-4d2e-8238-f05604300363', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'admin_state_up': True, 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'security_groups': ['7161f302-3fa1-419c-846a-d65b5f05897a']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:32.129342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-745b45a8-4ad3-407d-a655-f1fab842a155 None None] Provisioning for port 197f9cef-8851-4e66-915d-5daabb37cd45 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:32.143448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-745b45a8-4ad3-407d-a655-f1fab842a155 None None] Provisioning complete for port 197f9cef-8851-4e66-915d-5daabb37cd45 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:32.143802 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-745b45a8-4ad3-407d-a655-f1fab842a155 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:32.175014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=72b90871-bbf5-4362-b6cc-49c16f451e78,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:32.178972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'name': 'tempest-TestVolumeBootPattern-1714193566-router', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': 'fb368f25-f1fa-4eb7-8109-23e3550d259f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:22Z', 'updated_at': '2022-05-12T15:48:27Z', 'revision_number': 3, 'project_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'gw_port': {'id': 'fb368f25-f1fa-4eb7-8109-23e3550d259f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:9e:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3986, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:25Z', 'updated_at': '2022-05-12T15:48:25Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:32.201789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Checking router: 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:48:32.202056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Updating router 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 port fb368f25-f1fa-4eb7-8109-23e3550d259f binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:48:32.293836 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:32.303420 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-745b45a8-4ad3-407d-a655-f1fab842a155 None None] Port 197f9cef-8851-4e66-915d-5daabb37cd45 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:48:32.320908 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:32.357264 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['27a3a31e-244b-4431-86b4-73b53f4f0c89']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:32.371426 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6456e927-9c55-44a1-867f-9d614d3489f4 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:32.380779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '384ff5b9-795f-4199-b25d-4d1f08782bc8') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:32.381438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '384ff5b9-795f-4199-b25d-4d1f08782bc8') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:32.398343 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:32.420923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:32.463849 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-141fed79-78de-44e4-b996-94dfed51a38c req-84196f86-945b-427d-8080-f772a1762543 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 210 time: 0.0478792 May 12 15:48:32.470205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:port and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:32.473697 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:32.475475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:32.485040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:32.487207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Releasing vlan 559 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:48:32.487611 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: util.warn( May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: timer() May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:48:32.503215 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:48:32.519515 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Pushing event updated for resources: {'Port': ['ID=197f9cef-8851-4e66-915d-5daabb37cd45,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:32.541666 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:32.590353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Made reservation on behalf of b88b5989d4c548dba6124f2e4690e5c3 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:48:32.594205 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:32.615676 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:32.632726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 6456e927-9c55-44a1-867f-9d614d3489f4 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:32.633100 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:32.658825 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:32.680054 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:32.703965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] Pushing event deleted for resources: {'Network': ['ID=27a3a31e-244b-4431-86b4-73b53f4f0c89,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:32.717366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ba68254e-c80c-4ba6-a7aa-fd70094e3a91 tempest-TestNetworkBasicOps-55225755 tempest-TestNetworkBasicOps-55225755-project] 10.222.0.82 "DELETE /v2.0/networks/27a3a31e-244b-4431-86b4-73b53f4f0c89 HTTP/1.1" status: 204 len: 168 time: 2.8224323 May 12 15:48:32.800779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Network 0eeaef15-2568-445a-9d02-7051964139fe is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:32.802731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:32.955566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.20.0.6 (2c49c390-e121-4f31-92ba-528e8cdf62dd/3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae/fcfbcee7-a160-4968-9ce4-95d57bd748bc) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:33.052160 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:33.217858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Router 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:48:33.346786 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:33.360673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e725bb53-46c9-425f-9066-1229223d8937 None None] Provisioning complete for port 197f9cef-8851-4e66-915d-5daabb37cd45 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:33.361644 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e725bb53-46c9-425f-9066-1229223d8937 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:33.367075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Transition to ACTIVE for port object fcfbcee7-a160-4968-9ce4-95d57bd748bc will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:33.379758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49274) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:33.399330 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:33.453085 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:33.478717 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e725bb53-46c9-425f-9066-1229223d8937 None None] Port 197f9cef-8851-4e66-915d-5daabb37cd45 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:48:33.485641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Transition to ACTIVE for port object fb368f25-f1fa-4eb7-8109-23e3550d259f will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:33.503491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:33.503872 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:33.562518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:33.582860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=fcfbcee7-a160-4968-9ce4-95d57bd748bc,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:33.597784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 2c49c390-e121-4f31-92ba-528e8cdf62dd is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:33.599989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:33.604360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:33.624073 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e1d6badf-48e1-4312-81e7-1828d916d4de admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b641518781114418963451fc3ff58f4d&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2375364 May 12 15:48:33.624664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49282) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:33.645038 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:33.671835 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-152b0848-365c-4b16-a501-3e785ece905f admin admin] 10.222.0.82 "PUT /v2.0/routers/4b0ad84c-7e1e-4b79-881d-e1a2d280d891/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.7458856 May 12 15:48:33.765562 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1f543fcc-4e5a-4088-bcd5-4c6fa005cf4d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:33.820959 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1f543fcc-4e5a-4088-bcd5-4c6fa005cf4d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:33.854116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Attempting to bind port fb368f25-f1fa-4eb7-8109-23e3550d259f on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:33.854483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Attempting to bind port fb368f25-f1fa-4eb7-8109-23e3550d259f by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:33.854851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Attempting to bind port fb368f25-f1fa-4eb7-8109-23e3550d259f on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:33.875851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f701390b-bf6c-4437-a977-c70d054a5fdb None None] Pushing event updated for resources: {'Port': ['ID=fb368f25-f1fa-4eb7-8109-23e3550d259f,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:33.892020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:33.892548 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:33.893905 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:33.894873 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:33.895790 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Bound port: fb368f25-f1fa-4eb7-8109-23e3550d259f, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:33.896322 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:33.911096 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1f543fcc-4e5a-4088-bcd5-4c6fa005cf4d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:33.938840 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f543fcc-4e5a-4088-bcd5-4c6fa005cf4d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df3f3999-6f3d-41d6-a6a3-19c75ef5fb6b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:33.939834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1f543fcc-4e5a-4088-bcd5-4c6fa005cf4d admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:33.943610 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1f543fcc-4e5a-4088-bcd5-4c6fa005cf4d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/df3f3999-6f3d-41d6-a6a3-19c75ef5fb6b HTTP/1.1" status: 204 len: 168 time: 0.3143506 May 12 15:48:33.979439 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ba356da3-692c-41a7-9dae-e94814fdc047 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:34.007028 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:34.007567 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:34.059405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fd2b2c9f-9b1d-4396-aaf5-3b31775aaece None None] Provisioning for port fcfbcee7-a160-4968-9ce4-95d57bd748bc completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:34.065237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e4c544-eca3-4655-a89d-ca985825a541 req-ad70f060-7efc-4129-84e9-ce5e06f3be16 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:34.066165 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c4e4c544-eca3-4655-a89d-ca985825a541 req-ad70f060-7efc-4129-84e9-ce5e06f3be16 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:48:34.081424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-375dbce4-1a7c-4468-9bd5-67431441ee4d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.9778740 May 12 15:48:34.093520 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fd2b2c9f-9b1d-4396-aaf5-3b31775aaece None None] Provisioning complete for port fcfbcee7-a160-4968-9ce4-95d57bd748bc triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:34.094061 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fd2b2c9f-9b1d-4396-aaf5-3b31775aaece None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:34.094909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c4e4c544-eca3-4655-a89d-ca985825a541 req-ad70f060-7efc-4129-84e9-ce5e06f3be16 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:48:34.096193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4e4c544-eca3-4655-a89d-ca985825a541 req-ad70f060-7efc-4129-84e9-ce5e06f3be16 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 931 time: 0.2179992 May 12 15:48:34.107409 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Request body: {'port': {'device_id': '14a655a9-bdaa-4d2e-8238-f05604300363', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:34.154721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] For port fb368f25-f1fa-4eb7-8109-23e3550d259f, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:34.168979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] For port fb368f25-f1fa-4eb7-8109-23e3550d259f, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fb368f25-f1fa-4eb7-8109-23e3550d259f,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:34.176652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fd2b2c9f-9b1d-4396-aaf5-3b31775aaece None None] Port fcfbcee7-a160-4968-9ce4-95d57bd748bc cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:48:34.182061 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:34.306131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4e4c544-eca3-4655-a89d-ca985825a541 req-ea8351a0-8351-4435-9f3a-b483bab453eb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1189201 May 12 15:48:34.323774 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:34.325709 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f701390b-bf6c-4437-a977-c70d054a5fdb None None] Pushing event updated for resources: {'Port': ['ID=fb368f25-f1fa-4eb7-8109-23e3550d259f,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:34.329687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ba356da3-692c-41a7-9dae-e94814fdc047 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:34.337289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ba356da3-692c-41a7-9dae-e94814fdc047 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:34.337614 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:34.423760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Routers {'4b0ad84c-7e1e-4b79-881d-e1a2d280d891'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:34.424402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['4b0ad84c-7e1e-4b79-881d-e1a2d280d891'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:34.455203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49298) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:34.472954 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-afe134d0-e425-4151-a504-5eefb8669a71 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:34.490224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-afe134d0-e425-4151-a504-5eefb8669a71 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:34.495337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-afe134d0-e425-4151-a504-5eefb8669a71 admin admin] Usage tracker for resource:security_group_rule and tenant:24b824d19621434dba1f74814718ecf0 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:34.499835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-afe134d0-e425-4151-a504-5eefb8669a71 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:34.522311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-afe134d0-e425-4151-a504-5eefb8669a71 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:34.642947 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-afe134d0-e425-4151-a504-5eefb8669a71 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:34.650310 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-afe134d0-e425-4151-a504-5eefb8669a71 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:34.694316 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:34.698357 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-afe134d0-e425-4151-a504-5eefb8669a71 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=24b824d19621434dba1f74814718ecf0&name=default HTTP/1.1" status: 200 len: 2983 time: 0.2419522 May 12 15:48:34.700992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49308) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:34.727322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afe134d0-e425-4151-a504-5eefb8669a71 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f99df896-65b1-4389-869f-24a56e7178ed,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:34.759785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ba356da3-692c-41a7-9dae-e94814fdc047, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ba356da3-692c-41a7-9dae-e94814fdc047,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:34.770328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] Set router 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:34.812258 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a997213c-b2d3-4b02-b3ba-b9702c75db7f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:34.816553 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:34.911665 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a997213c-b2d3-4b02-b3ba-b9702c75db7f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:34.973901 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c6584f69-ed28-4741-b68f-c92c73eccc19 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:48:35.016120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: c6584f69-ed28-4741-b68f-c92c73eccc19 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:48:35.016451 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c6584f69-ed28-4741-b68f-c92c73eccc19 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:48:35.016874 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 03b70439-0ed8-4406-888a-b6afb6de6fc6 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:48:35.056347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fcfbcee7-a160-4968-9ce4-95d57bd748bc {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:48:35.064576 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:35.071989 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a997213c-b2d3-4b02-b3ba-b9702c75db7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:35.094618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a997213c-b2d3-4b02-b3ba-b9702c75db7f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f99df896-65b1-4389-869f-24a56e7178ed,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:35.096810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Transition to ACTIVE for port object fcfbcee7-a160-4968-9ce4-95d57bd748bc will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:35.103018 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a997213c-b2d3-4b02-b3ba-b9702c75db7f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:35.103845 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a997213c-b2d3-4b02-b3ba-b9702c75db7f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f99df896-65b1-4389-869f-24a56e7178ed HTTP/1.1" status: 204 len: 168 time: 0.4005904 May 12 15:48:35.106298 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:35.267789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Pushing event updated for resources: {'Port': ['ID=fcfbcee7-a160-4968-9ce4-95d57bd748bc,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:35.541322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 03b70439-0ed8-4406-888a-b6afb6de6fc6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:48:35.548457 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 03b70439-0ed8-4406-888a-b6afb6de6fc6 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:48:35.549282 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0b130198-953d-4f1e-95d3-4d8791331284 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:48:35.627474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ba356da3-692c-41a7-9dae-e94814fdc047,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:35.637957 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Attempting to bind port fcfbcee7-a160-4968-9ce4-95d57bd748bc on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:35.638460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Attempting to bind port fcfbcee7-a160-4968-9ce4-95d57bd748bc by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:35.639304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Attempting to bind port fcfbcee7-a160-4968-9ce4-95d57bd748bc on network 2c49c390-e121-4f31-92ba-528e8cdf62dd {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:35.678028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 0b130198-953d-4f1e-95d3-4d8791331284 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:48:35.678521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0b130198-953d-4f1e-95d3-4d8791331284 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:48:35.687058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Port fcfbcee7-a160-4968-9ce4-95d57bd748bc on network 2c49c390-e121-4f31-92ba-528e8cdf62dd not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:48:35.687745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Attempting to bind port fcfbcee7-a160-4968-9ce4-95d57bd748bc on network 2c49c390-e121-4f31-92ba-528e8cdf62dd {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:35.702321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:35.702957 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Checking segment: {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:35.703502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Bound using segment: {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:35.704088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Bound port: fcfbcee7-a160-4968-9ce4-95d57bd748bc, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:35.704608 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:35.758751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'name': 'tempest-TestVolumeBootPattern-1714193566-router', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': 'fb368f25-f1fa-4eb7-8109-23e3550d259f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:22Z', 'updated_at': '2022-05-12T15:48:31Z', 'revision_number': 4, 'project_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'gw_port': {'id': 'fb368f25-f1fa-4eb7-8109-23e3550d259f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:9e:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3986, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:25Z', 'updated_at': '2022-05-12T15:48:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '197f9cef-8851-4e66-915d-5daabb37cd45', 'name': '', 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'mac_address': 'fa:16:3e:60:da:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'device_owner': 'network:router_interface', 'standard_attr_id': 3987, 'fixed_ips': [{'subnet_id': 'f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:30Z', 'updated_at': '2022-05-12T15:48:31Z', 'revision_number': 2, 'project_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'subnets': [{'id': 'f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:35.790855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e19b43f1-16d9-4337-a3ae-f892141f3981 None None] The sync data for ids ['4b0ad84c-7e1e-4b79-881d-e1a2d280d891'] in n-d-841483-1 is: [{'id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'name': 'tempest-TestVolumeBootPattern-1714193566-router', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': 'fb368f25-f1fa-4eb7-8109-23e3550d259f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:22Z', 'updated_at': '2022-05-12T15:48:31Z', 'revision_number': 4, 'project_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'gw_port': {'id': 'fb368f25-f1fa-4eb7-8109-23e3550d259f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:9e:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3986, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:25Z', 'updated_at': '2022-05-12T15:48:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '197f9cef-8851-4e66-915d-5daabb37cd45', 'name': '', 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'mac_address': 'fa:16:3e:60:da:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'device_owner': 'network:router_interface', 'standard_attr_id': 3987, 'fixed_ips': [{'subnet_id': 'f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:30Z', 'updated_at': '2022-05-12T15:48:31Z', 'revision_number': 2, 'project_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'subnets': [{'id': 'f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:48:35.855194 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 72b90871-bbf5-4362-b6cc-49c16f451e78 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:35.871887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:35.877222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:35.887542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:35.973568 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:35.974533 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:35.977293 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] 10.222.0.84 "PUT /v2.0/ports/fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 1091 time: 1.8743963 May 12 15:48:35.977949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:48:36.065056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 72b90871-bbf5-4362-b6cc-49c16f451e78 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:36.065492 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:36.082086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ee827c3-9ec4-45f1-a2a0-8c4fca3f92e5 service neutron] Pushing event updated for resources: {'Port': ['ID=fcfbcee7-a160-4968-9ce4-95d57bd748bc,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:36.161821 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-80f6bf57-9f01-478f-9147-752d38e8eb66'] response: {'name': 'network-changed', 'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'status': 'completed', 'code': 200} May 12 15:48:36.230418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-297716b3-cf21-4975-ba17-59b366bd9b5d req-bff4a62b-6dca-4368-920f-284987e60e9e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:36.252594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-297716b3-cf21-4975-ba17-59b366bd9b5d req-bff4a62b-6dca-4368-920f-284987e60e9e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 943 time: 0.6842721 May 12 15:48:36.272549 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ba356da3-692c-41a7-9dae-e94814fdc047 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:36.383460 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-297716b3-cf21-4975-ba17-59b366bd9b5d req-156898de-0835-489c-9eb9-cd521738e7d1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1297817 May 12 15:48:36.409038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88d2499-bd67-4c8f-8082-3970829db68d req-eafd6fbf-278c-4a4a-9d05-9824580ca50e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:36.413436 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-eafd6fbf-278c-4a4a-9d05-9824580ca50e service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1094 time: 0.3254025 May 12 15:48:36.448245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ba356da3-692c-41a7-9dae-e94814fdc047 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:36.448684 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:36.529121 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-ae0eda28-de1f-49cb-ad20-d04f16cdd60a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 217 time: 0.0899510 May 12 15:48:36.611579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88d2499-bd67-4c8f-8082-3970829db68d req-df3eaa4b-eb9c-427c-8772-54c37ff076b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:36.613022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-df3eaa4b-eb9c-427c-8772-54c37ff076b2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae HTTP/1.1" status: 200 len: 835 time: 0.0736277 May 12 15:48:36.769002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88d2499-bd67-4c8f-8082-3970829db68d req-08c8e8f4-fff6-46fe-b1c6-c8288680e0c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:36.774373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-08c8e8f4-fff6-46fe-b1c6-c8288680e0c0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2c49c390-e121-4f31-92ba-528e8cdf62dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1517520 May 12 15:48:37.124552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-0510e074-769d-463f-82ab-d2faca33a9a7 service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3429081 May 12 15:48:37.154891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49336) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:37.314516 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f88d2499-bd67-4c8f-8082-3970829db68d req-b35a95c8-fe32-4464-a38b-078dd41a3b34 service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1802158 May 12 15:48:37.470218 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a0dd58ea-e906-44ff-8be0-78d5dce098a2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:37.503991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a0dd58ea-e906-44ff-8be0-78d5dce098a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:37.518923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a0dd58ea-e906-44ff-8be0-78d5dce098a2 admin admin] Usage tracker for resource:security_group_rule and tenant:b9cb039388df44bc84533d47e8328553 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:37.521487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a0dd58ea-e906-44ff-8be0-78d5dce098a2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:37.528317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a0dd58ea-e906-44ff-8be0-78d5dce098a2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:37.547222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6612c37-f507-4ba9-a1f6-eb53391dea09 req-05611dca-28a9-403c-9bbc-bcd6f9841606 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:37.548693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6612c37-f507-4ba9-a1f6-eb53391dea09 req-05611dca-28a9-403c-9bbc-bcd6f9841606 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1094 time: 0.1231904 May 12 15:48:37.652595 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a0dd58ea-e906-44ff-8be0-78d5dce098a2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:37.657719 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a0dd58ea-e906-44ff-8be0-78d5dce098a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:37.720763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49344) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:37.721484 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a0dd58ea-e906-44ff-8be0-78d5dce098a2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b9cb039388df44bc84533d47e8328553&name=default HTTP/1.1" status: 200 len: 2983 time: 0.5648353 May 12 15:48:37.730175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0dd58ea-e906-44ff-8be0-78d5dce098a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f021bd05-fd2d-435e-9bee-4c22f80f95e1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:37.790824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6612c37-f507-4ba9-a1f6-eb53391dea09 req-0225d736-5f24-445c-a3ad-f6e86f95d26d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:37.792184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6612c37-f507-4ba9-a1f6-eb53391dea09 req-0225d736-5f24-445c-a3ad-f6e86f95d26d service neutron] 10.222.0.84 "GET /v2.0/networks?id=2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 200 len: 898 time: 0.2342062 May 12 15:48:37.820968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fb368f25-f1fa-4eb7-8109-23e3550d259f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:37.882223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6612c37-f507-4ba9-a1f6-eb53391dea09 req-192f327e-9ed0-488d-adca-c66a239740f7 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 217 time: 0.0817568 May 12 15:48:37.891819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-528ef678-a05b-4493-b4a0-55a719548177 req-3491c1ff-56e1-4f6b-9eb2-52cf3e912119 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:37.893330 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-528ef678-a05b-4493-b4a0-55a719548177 req-3491c1ff-56e1-4f6b-9eb2-52cf3e912119 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 943 time: 0.3162525 May 12 15:48:37.960452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port fb368f25-f1fa-4eb7-8109-23e3550d259f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:37.966991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port fb368f25-f1fa-4eb7-8109-23e3550d259f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:37.968517 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:37.978807 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e9b64fd-fffb-4290-9435-1a8c7f3f2043 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:38.024183 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-528ef678-a05b-4493-b4a0-55a719548177 req-7b74ed15-1866-4d5d-9ce9-c6251a949e01 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0818748 May 12 15:48:38.030356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6612c37-f507-4ba9-a1f6-eb53391dea09 req-ef001266-cb0e-459e-8156-884f56b1112b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:38.032578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6612c37-f507-4ba9-a1f6-eb53391dea09 req-ef001266-cb0e-459e-8156-884f56b1112b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae HTTP/1.1" status: 200 len: 835 time: 0.1382992 May 12 15:48:38.124853 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e9b64fd-fffb-4290-9435-1a8c7f3f2043 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:38.139962 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:38.168492 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port fb368f25-f1fa-4eb7-8109-23e3550d259f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fb368f25-f1fa-4eb7-8109-23e3550d259f,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:38.204668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6612c37-f507-4ba9-a1f6-eb53391dea09 req-7c5d5228-11b6-49c9-bd84-eaf6edce6606 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:38.205314 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:38.206185 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6612c37-f507-4ba9-a1f6-eb53391dea09 req-7c5d5228-11b6-49c9-bd84-eaf6edce6606 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2c49c390-e121-4f31-92ba-528e8cdf62dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1622896 May 12 15:48:38.262664 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e9b64fd-fffb-4290-9435-1a8c7f3f2043 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:38.335038 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=fb368f25-f1fa-4eb7-8109-23e3550d259f,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:38.336584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e9b64fd-fffb-4290-9435-1a8c7f3f2043 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f021bd05-fd2d-435e-9bee-4c22f80f95e1,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:38.355908 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8e9b64fd-fffb-4290-9435-1a8c7f3f2043 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:38.359949 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8e9b64fd-fffb-4290-9435-1a8c7f3f2043 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f021bd05-fd2d-435e-9bee-4c22f80f95e1 HTTP/1.1" status: 204 len: 168 time: 0.6348321 May 12 15:48:38.409206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6612c37-f507-4ba9-a1f6-eb53391dea09 req-ccbb2e90-fd76-4c68-9a1c-8f868e504669 service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1816890 May 12 15:48:38.676037 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6612c37-f507-4ba9-a1f6-eb53391dea09 req-ec0a73b3-3599-4fee-8d32-0134d3746d03 service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2596049 May 12 15:48:38.689153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5791b72a-f094-4796-9400-72d1cb41672f req-b69b3efd-edc2-4fc7-ac3b-6e297578a94b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:38.689934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5791b72a-f094-4796-9400-72d1cb41672f req-b69b3efd-edc2-4fc7-ac3b-6e297578a94b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Synchronizing usage tracker for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:48:38.708754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5791b72a-f094-4796-9400-72d1cb41672f req-b69b3efd-edc2-4fc7-ac3b-6e297578a94b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Unset dirty status for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:48:38.709975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5791b72a-f094-4796-9400-72d1cb41672f req-b69b3efd-edc2-4fc7-ac3b-6e297578a94b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 812 time: 0.2141044 May 12 15:48:38.738060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5791b72a-f094-4796-9400-72d1cb41672f req-6a4923ce-d564-47a5-bae4-eeea1a54c353 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/quotas/939000b7f70c4c85a39e52ee93a06ed5 HTTP/1.1" status: 200 len: 375 time: 0.0158865 May 12 15:48:38.740188 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Sync routers for ids ['4b0ad84c-7e1e-4b79-881d-e1a2d280d891'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:48:38.751522 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Routers {'4b0ad84c-7e1e-4b79-881d-e1a2d280d891'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:38.752201 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['4b0ad84c-7e1e-4b79-881d-e1a2d280d891'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:38.832287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5791b72a-f094-4796-9400-72d1cb41672f req-958f10f4-c04a-4139-b664-bbda7590778c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Synchronizing usage tracker for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:48:38.851852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-5791b72a-f094-4796-9400-72d1cb41672f req-958f10f4-c04a-4139-b664-bbda7590778c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Unset dirty status for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:48:38.860654 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5791b72a-f094-4796-9400-72d1cb41672f req-958f10f4-c04a-4139-b664-bbda7590778c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1192713 May 12 15:48:38.944083 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Set router 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:38.998914 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5791b72a-f094-4796-9400-72d1cb41672f req-4e3a4fa3-7639-40a4-8346-ff55baec116b service neutron] 10.222.0.82 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1368198 May 12 15:48:39.308177 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'name': 'tempest-TestVolumeBootPattern-1714193566-router', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': 'fb368f25-f1fa-4eb7-8109-23e3550d259f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:22Z', 'updated_at': '2022-05-12T15:48:31Z', 'revision_number': 4, 'project_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'gw_port': {'id': 'fb368f25-f1fa-4eb7-8109-23e3550d259f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:9e:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3986, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:25Z', 'updated_at': '2022-05-12T15:48:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '197f9cef-8851-4e66-915d-5daabb37cd45', 'name': '', 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'mac_address': 'fa:16:3e:60:da:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'device_owner': 'network:router_interface', 'standard_attr_id': 3987, 'fixed_ips': [{'subnet_id': 'f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:30Z', 'updated_at': '2022-05-12T15:48:31Z', 'revision_number': 2, 'project_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'subnets': [{'id': 'f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:39.315745 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Checking router: 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:48:39.317299 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Updating router 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 port 197f9cef-8851-4e66-915d-5daabb37cd45 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:48:39.328847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5791b72a-f094-4796-9400-72d1cb41672f req-0f6db09d-2a9a-41f0-8a04-dce107ffe1d0 service neutron] 10.222.0.82 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3237350 May 12 15:48:39.354049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9edd08bc-9d23-4c2c-99c6-c3b57eac076d req-40b32f37-7ea4-4006-9d63-52066c4fb556 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:39.355685 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9edd08bc-9d23-4c2c-99c6-c3b57eac076d req-40b32f37-7ea4-4006-9d63-52066c4fb556 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 943 time: 0.1029773 May 12 15:48:39.387100 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:39.405316 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9edd08bc-9d23-4c2c-99c6-c3b57eac076d req-915f5f8f-f19d-42d1-bf53-e61c60fe90f6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419171 May 12 15:48:39.772419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fb368f25-f1fa-4eb7-8109-23e3550d259f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:39.792626 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b15776e4-8851-4c88-b41c-627125d92d90 req-913aedde-150a-4d06-ae19-9377a3f36f64 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 210 time: 0.0685682 May 12 15:48:39.878462 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:39.896696 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port fb368f25-f1fa-4eb7-8109-23e3550d259f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:39.896696 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:39.897160 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Transition to ACTIVE for port object 197f9cef-8851-4e66-915d-5daabb37cd45 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:39.915350 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:40.167692 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Attempting to bind port 197f9cef-8851-4e66-915d-5daabb37cd45 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:40.168051 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Attempting to bind port 197f9cef-8851-4e66-915d-5daabb37cd45 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'b08993ad-0765-41fc-9d7e-0a9c098fbc64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:40.168441 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Attempting to bind port 197f9cef-8851-4e66-915d-5daabb37cd45 on network 0eeaef15-2568-445a-9d02-7051964139fe {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:40.170663 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-370d44a0-3179-4f72-8e23-1ad23bb58ed1 None None] Pushing event updated for resources: {'Port': ['ID=197f9cef-8851-4e66-915d-5daabb37cd45,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:40.176381 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:40.176743 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Checking segment: {'id': 'b08993ad-0765-41fc-9d7e-0a9c098fbc64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:40.177128 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:40.177529 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Bound using segment: {'id': 'b08993ad-0765-41fc-9d7e-0a9c098fbc64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:40.177981 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Bound port: 197f9cef-8851-4e66-915d-5daabb37cd45, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b08993ad-0765-41fc-9d7e-0a9c098fbc64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:40.178341 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:40.240167 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fcfbcee7-a160-4968-9ce4-95d57bd748bc details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:48:40.301264 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] For port 197f9cef-8851-4e66-915d-5daabb37cd45, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:40.308513 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] For port 197f9cef-8851-4e66-915d-5daabb37cd45, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=197f9cef-8851-4e66-915d-5daabb37cd45,segment=NetworkSegment(b08993ad-0765-41fc-9d7e-0a9c098fbc64),segment_id=b08993ad-0765-41fc-9d7e-0a9c098fbc64)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:40.325691 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:40.404142 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-370d44a0-3179-4f72-8e23-1ad23bb58ed1 None None] Pushing event updated for resources: {'Port': ['ID=197f9cef-8851-4e66-915d-5daabb37cd45,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:40.423385 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Routers {'4b0ad84c-7e1e-4b79-881d-e1a2d280d891'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:40.424449 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['4b0ad84c-7e1e-4b79-881d-e1a2d280d891'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:40.452287 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:40.469142 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'port_id': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'mac_address': 'fa:16:3e:fe:e9:0f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 564, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:48:40.634292 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:40.671789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fcfbcee7-a160-4968-9ce4-95d57bd748bc {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:48:40.700869 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] Set router 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:40.717979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:40.727775 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:40.753473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc55b50d-1b92-444f-b946-76709b5ec145 req-9dee8da5-972c-4d9c-95a9-7d59cce5f3b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:40.760035 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc55b50d-1b92-444f-b946-76709b5ec145 req-9dee8da5-972c-4d9c-95a9-7d59cce5f3b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 943 time: 0.2140427 May 12 15:48:40.830388 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dc55b50d-1b92-444f-b946-76709b5ec145 req-bc41a046-7655-48da-8dc9-3834341c81b4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0602014 May 12 15:48:40.887040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=fcfbcee7-a160-4968-9ce4-95d57bd748bc,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:41.018026 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-428f4491-6ff7-48cf-9c48-47945f0d4a29 req-accfd2cb-8485-4c73-93c2-b2a6d6f0750d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 210 time: 0.0700216 May 12 15:48:41.057049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['fcfbcee7-a160-4968-9ce4-95d57bd748bc'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:48:41.292792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5791b72a-f094-4796-9400-72d1cb41672f req-47c83350-cb65-43b5-9ec3-83395c60ed96 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:41.298585 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5791b72a-f094-4796-9400-72d1cb41672f req-47c83350-cb65-43b5-9ec3-83395c60ed96 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 812 time: 0.2773738 May 12 15:48:41.311694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'port': {'device_id': 'b5508855-5e88-4ff1-8ed9-b3df18a0ae70', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'admin_state_up': True, 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:41.469672 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'name': 'tempest-TestVolumeBootPattern-1714193566-router', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': 'fb368f25-f1fa-4eb7-8109-23e3550d259f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:22Z', 'updated_at': '2022-05-12T15:48:31Z', 'revision_number': 4, 'project_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'gw_port': {'id': 'fb368f25-f1fa-4eb7-8109-23e3550d259f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:9e:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3986, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:25Z', 'updated_at': '2022-05-12T15:48:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '197f9cef-8851-4e66-915d-5daabb37cd45', 'name': '', 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'mac_address': 'fa:16:3e:60:da:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'device_owner': 'network:router_interface', 'standard_attr_id': 3987, 'fixed_ips': [{'subnet_id': 'f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:30Z', 'updated_at': '2022-05-12T15:48:40Z', 'revision_number': 4, 'project_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'subnets': [{'id': 'f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:41.476894 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35d247b0-3944-40a4-8ae4-eebafa6fe3f9 None None] The sync data for ids ['4b0ad84c-7e1e-4b79-881d-e1a2d280d891'] in n-d-841483-1 is: [{'id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'name': 'tempest-TestVolumeBootPattern-1714193566-router', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': 'fb368f25-f1fa-4eb7-8109-23e3550d259f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:22Z', 'updated_at': '2022-05-12T15:48:31Z', 'revision_number': 4, 'project_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'gw_port': {'id': 'fb368f25-f1fa-4eb7-8109-23e3550d259f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:9e:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3986, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:25Z', 'updated_at': '2022-05-12T15:48:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '197f9cef-8851-4e66-915d-5daabb37cd45', 'name': '', 'network_id': '0eeaef15-2568-445a-9d02-7051964139fe', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'mac_address': 'fa:16:3e:60:da:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'device_owner': 'network:router_interface', 'standard_attr_id': 3987, 'fixed_ips': [{'subnet_id': 'f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:30Z', 'updated_at': '2022-05-12T15:48:40Z', 'revision_number': 4, 'project_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'subnets': [{'id': 'f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:48:41.584600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:41.596352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:41.609598 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Made reservation on behalf of 939000b7f70c4c85a39e52ee93a06ed5 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:48:41.614225 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:41.849809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 197f9cef-8851-4e66-915d-5daabb37cd45 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:41.855257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Allocated IP 172.20.0.8 (d13f4c27-5358-4d60-abb1-0c94e69df718/020f79af-22ce-41ca-91a6-931258be2176/e2437d02-b992-47e4-8d72-0a2dde082069) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:41.999008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 197f9cef-8851-4e66-915d-5daabb37cd45 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:42.004973 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 197f9cef-8851-4e66-915d-5daabb37cd45 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:42.005401 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:42.135204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37cd06be-ae79-44df-8288-aa1d8d4040e1 req-39c80938-4bda-4ad9-abf3-cd98c2c10c21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:42.144511 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37cd06be-ae79-44df-8288-aa1d8d4040e1 req-39c80938-4bda-4ad9-abf3-cd98c2c10c21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 944 time: 0.1491492 May 12 15:48:42.243713 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:42.334279 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37cd06be-ae79-44df-8288-aa1d8d4040e1 req-b672185c-3c20-4c2d-9cda-cf28a2e74f0e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1798966 May 12 15:48:42.337072 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:42.340691 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-089ee23c-fde8-4fab-a39b-db09b22b976d req-0d59af94-19ce-4bce-8631-dc1bf3a41b8f tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 210 time: 0.1411633 May 12 15:48:42.368370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Transition to ACTIVE for port object e2437d02-b992-47e4-8d72-0a2dde082069 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:42.389735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fcfbcee7-a160-4968-9ce4-95d57bd748bc up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:42.410018 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:42.470666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 197f9cef-8851-4e66-915d-5daabb37cd45, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=197f9cef-8851-4e66-915d-5daabb37cd45,segment=NetworkSegment(b08993ad-0765-41fc-9d7e-0a9c098fbc64),segment_id=b08993ad-0765-41fc-9d7e-0a9c098fbc64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:42.483423 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:42.528034 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port fcfbcee7-a160-4968-9ce4-95d57bd748bc completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:42.541730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port fcfbcee7-a160-4968-9ce4-95d57bd748bc triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:42.542356 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:42.633634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=197f9cef-8851-4e66-915d-5daabb37cd45,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:42.727740 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:42.727967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Network d13f4c27-5358-4d60-abb1-0c94e69df718 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:42.731302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:42.737153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:42.782758 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a51aa7d3-0277-4294-bc00-9ac513b2f462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:42.791775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:48:42.804060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:42.810175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:42.811538 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:42.813103 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:42.853808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'Port': ['ID=e2437d02-b992-47e4-8d72-0a2dde082069,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:42.860585 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5791b72a-f094-4796-9400-72d1cb41672f req-aaf1ebec-25fd-40e8-bddf-69ecee557638 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5558367 May 12 15:48:42.872373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Request body: {'port': {'device_id': 'b5508855-5e88-4ff1-8ed9-b3df18a0ae70', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:42.885528 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5dd727e6-8d55-4c3f-b5ac-0d11c041c231'] response: {'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'code': 200} May 12 15:48:42.937476 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=fcfbcee7-a160-4968-9ce4-95d57bd748bc,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:43.033766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:43.117330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d368783-b567-44f5-a60a-5aea1452f38f req-ea4a8648-6834-45bc-98d8-7b3c4978f523 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:43.119329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d368783-b567-44f5-a60a-5aea1452f38f req-ea4a8648-6834-45bc-98d8-7b3c4978f523 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1096 time: 0.1622815 May 12 15:48:43.183373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3e4714ce-31ad-410b-9609-151d2d922ddd None None] Provisioning for port e2437d02-b992-47e4-8d72-0a2dde082069 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:43.184011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4d368783-b567-44f5-a60a-5aea1452f38f req-12b2dd80-cb61-47cf-85a8-8ca82492eeb1 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0538821 May 12 15:48:43.189379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3e4714ce-31ad-410b-9609-151d2d922ddd None None] Provisioning complete for port e2437d02-b992-47e4-8d72-0a2dde082069 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:43.189803 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3e4714ce-31ad-410b-9609-151d2d922ddd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:43.307683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3e4714ce-31ad-410b-9609-151d2d922ddd None None] Port e2437d02-b992-47e4-8d72-0a2dde082069 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:48:43.340665 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:43.499225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e2437d02-b992-47e4-8d72-0a2dde082069 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:48:43.508023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:43.533006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Transition to ACTIVE for port object e2437d02-b992-47e4-8d72-0a2dde082069 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:43.538858 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:43.622149 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e24cdbf6-f6f7-4e45-bb2b-e929b86bf0de req-51eaee98-1456-4a57-a8d7-ab0cff522a9d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:43.629933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e24cdbf6-f6f7-4e45-bb2b-e929b86bf0de req-51eaee98-1456-4a57-a8d7-ab0cff522a9d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 943 time: 0.1306643 May 12 15:48:43.680220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b6c377f-c295-46ea-814c-9fd11301084a req-355b2a2d-5496-4eec-85b2-08541d9cdb69 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:43.681768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b6c377f-c295-46ea-814c-9fd11301084a req-355b2a2d-5496-4eec-85b2-08541d9cdb69 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.2229514 May 12 15:48:43.742603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Pushing event updated for resources: {'Port': ['ID=e2437d02-b992-47e4-8d72-0a2dde082069,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:43.784291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-e24cdbf6-f6f7-4e45-bb2b-e929b86bf0de req-3a6af2ed-d098-4804-b5d7-dd9e48d9ee3a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Synchronizing usage tracker for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:48:43.817306 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b6c377f-c295-46ea-814c-9fd11301084a req-e2e4f9ed-6daa-44fe-b877-88906dc6b1b9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1263497 May 12 15:48:43.824311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 197f9cef-8851-4e66-915d-5daabb37cd45 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:43.849909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-e24cdbf6-f6f7-4e45-bb2b-e929b86bf0de req-3a6af2ed-d098-4804-b5d7-dd9e48d9ee3a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Unset dirty status for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:48:43.857489 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e24cdbf6-f6f7-4e45-bb2b-e929b86bf0de req-3a6af2ed-d098-4804-b5d7-dd9e48d9ee3a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2262657 May 12 15:48:43.887212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Attempting to bind port e2437d02-b992-47e4-8d72-0a2dde082069 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:43.887607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Attempting to bind port e2437d02-b992-47e4-8d72-0a2dde082069 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:43.887977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Attempting to bind port e2437d02-b992-47e4-8d72-0a2dde082069 on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:43.894571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Port e2437d02-b992-47e4-8d72-0a2dde082069 on network d13f4c27-5358-4d60-abb1-0c94e69df718 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:48:43.894897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Attempting to bind port e2437d02-b992-47e4-8d72-0a2dde082069 on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:43.900549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:43.900891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Checking segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:43.901600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Bound using segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:43.902032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Bound port: e2437d02-b992-47e4-8d72-0a2dde082069, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:43.902376 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:43.949082 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 197f9cef-8851-4e66-915d-5daabb37cd45 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:43.949765 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:44.063337 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] For port e2437d02-b992-47e4-8d72-0a2dde082069, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:44.073281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] For port e2437d02-b992-47e4-8d72-0a2dde082069, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e2437d02-b992-47e4-8d72-0a2dde082069,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:44.080353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:44.142184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:44.143145 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:44.144965 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5791b72a-f094-4796-9400-72d1cb41672f req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] 10.222.0.76 "PUT /v2.0/ports/e2437d02-b992-47e4-8d72-0a2dde082069 HTTP/1.1" status: 200 len: 1091 time: 1.2776606 May 12 15:48:44.153893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b5508855-5e88-4ff1-8ed9-b3df18a0ae70', 'tag': 'e2437d02-b992-47e4-8d72-0a2dde082069'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:48:44.278089 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5f8ea36f-73aa-4f2f-acce-95294a2d7d38'] response: {'name': 'network-changed', 'server_uuid': 'b5508855-5e88-4ff1-8ed9-b3df18a0ae70', 'tag': 'e2437d02-b992-47e4-8d72-0a2dde082069', 'status': 'completed', 'code': 200} May 12 15:48:44.282947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e318bcfc-1bde-4b73-8c41-3f0e1a2efc49 service neutron] Pushing event updated for resources: {'Port': ['ID=e2437d02-b992-47e4-8d72-0a2dde082069,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:44.283343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49442) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:44.323940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5791b72a-f094-4796-9400-72d1cb41672f req-f1e0d571-3a34-4dc4-9f53-7b972f4220fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:44.325467 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5791b72a-f094-4796-9400-72d1cb41672f req-f1e0d571-3a34-4dc4-9f53-7b972f4220fd service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 1094 time: 0.1394224 May 12 15:48:44.410929 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5791b72a-f094-4796-9400-72d1cb41672f req-5c2bd49d-c62d-41bd-a068-ad57fef086fe service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e2437d02-b992-47e4-8d72-0a2dde082069 HTTP/1.1" status: 200 len: 217 time: 0.0776939 May 12 15:48:44.469359 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b179cfb3-0fe1-41ed-8aeb-ea83b1039a49 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:44.500728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b179cfb3-0fe1-41ed-8aeb-ea83b1039a49 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:44.503544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5791b72a-f094-4796-9400-72d1cb41672f req-2b5d7326-2ea8-455a-ab53-33720a2247f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:44.505212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b179cfb3-0fe1-41ed-8aeb-ea83b1039a49 admin admin] Usage tracker for resource:security_group_rule and tenant:b0a78e4bd8e04b82bec5b5854eb93039 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:44.506387 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5791b72a-f094-4796-9400-72d1cb41672f req-2b5d7326-2ea8-455a-ab53-33720a2247f3 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0882041 May 12 15:48:44.508316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b179cfb3-0fe1-41ed-8aeb-ea83b1039a49 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:44.518065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b179cfb3-0fe1-41ed-8aeb-ea83b1039a49 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:44.595172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5791b72a-f094-4796-9400-72d1cb41672f req-e394fa36-b752-4910-96f5-249bb7795df5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:44.596659 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5791b72a-f094-4796-9400-72d1cb41672f req-e394fa36-b752-4910-96f5-249bb7795df5 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0845101 May 12 15:48:44.622569 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b179cfb3-0fe1-41ed-8aeb-ea83b1039a49 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:44.627554 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b179cfb3-0fe1-41ed-8aeb-ea83b1039a49 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:44.684687 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b179cfb3-0fe1-41ed-8aeb-ea83b1039a49 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b0a78e4bd8e04b82bec5b5854eb93039&name=default HTTP/1.1" status: 200 len: 2983 time: 0.3996456 May 12 15:48:44.687308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b179cfb3-0fe1-41ed-8aeb-ea83b1039a49 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8dfb567d-dc97-41b2-a7cb-076c5178a246,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:44.687992 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49448) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:44.779865 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5791b72a-f094-4796-9400-72d1cb41672f req-3657ccd8-0259-4409-bccb-bf021ebdca02 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1769807 May 12 15:48:44.810968 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8e7b082-49a1-44c6-bc39-78ca284f8910 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:44.948619 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8e7b082-49a1-44c6-bc39-78ca284f8910 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:44.961597 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5791b72a-f094-4796-9400-72d1cb41672f req-afc84159-c56e-4599-bd01-661e0fa28c38 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1767943 May 12 15:48:45.117489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab26d26b-6cdb-46df-878d-6b4ba095658e req-939f80c7-dfce-4f9c-b410-5f7d9ac374e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:45.118838 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab26d26b-6cdb-46df-878d-6b4ba095658e req-939f80c7-dfce-4f9c-b410-5f7d9ac374e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 943 time: 0.1253564 May 12 15:48:45.127881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d084e823-174e-4d69-99f1-6d79511a4aa3 req-8bd83131-9ec6-4e64-b0ce-6be9627ccbe8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:45.129252 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d084e823-174e-4d69-99f1-6d79511a4aa3 req-8bd83131-9ec6-4e64-b0ce-6be9627ccbe8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.1991117 May 12 15:48:45.168205 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8e7b082-49a1-44c6-bc39-78ca284f8910 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:45.191500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8e7b082-49a1-44c6-bc39-78ca284f8910 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8dfb567d-dc97-41b2-a7cb-076c5178a246,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:45.196207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0189b479-d32b-4f9b-8317-95d448a1cb31 req-73c89497-0370-4489-9dfa-55ee3dad5c3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:45.197630 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0189b479-d32b-4f9b-8317-95d448a1cb31 req-73c89497-0370-4489-9dfa-55ee3dad5c3b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 1094 time: 0.0995791 May 12 15:48:45.199207 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f8e7b082-49a1-44c6-bc39-78ca284f8910 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:45.201817 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab26d26b-6cdb-46df-878d-6b4ba095658e req-a1358bb4-cbad-4880-9985-785c6ad0482d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715744 May 12 15:48:45.205126 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f8e7b082-49a1-44c6-bc39-78ca284f8910 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8dfb567d-dc97-41b2-a7cb-076c5178a246 HTTP/1.1" status: 204 len: 168 time: 0.5137012 May 12 15:48:45.217726 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d084e823-174e-4d69-99f1-6d79511a4aa3 req-ed2c757f-068e-468e-8b2c-d63619257ba3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0724070 May 12 15:48:45.315563 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d4d920cc-8027-4da1-b05a-29da0be2284a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:45.396655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0189b479-d32b-4f9b-8317-95d448a1cb31 req-a553ec42-f9a9-415e-bbe0-421b9d2f5c53 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:45.396655 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0189b479-d32b-4f9b-8317-95d448a1cb31 req-a553ec42-f9a9-415e-bbe0-421b9d2f5c53 service neutron] 10.222.0.76 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1831565 May 12 15:48:45.433247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93868fea-47ee-468a-9954-bf3b761e8a40 req-0f0f45cb-a996-40d5-887d-2a3b05e60413 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:45.433247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93868fea-47ee-468a-9954-bf3b761e8a40 req-0f0f45cb-a996-40d5-887d-2a3b05e60413 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.0971017 May 12 15:48:45.468304 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0189b479-d32b-4f9b-8317-95d448a1cb31 req-9bb7657b-fb8f-43f3-bf9b-251870db67db service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e2437d02-b992-47e4-8d72-0a2dde082069 HTTP/1.1" status: 200 len: 217 time: 0.0694695 May 12 15:48:45.478189 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93868fea-47ee-468a-9954-bf3b761e8a40 req-2fbe70fc-5282-4038-a30b-a11306031dbf tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398362 May 12 15:48:45.502799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49464) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:45.538121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0189b479-d32b-4f9b-8317-95d448a1cb31 req-32709371-870f-49e3-950e-6d94dd899d11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:45.539584 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0189b479-d32b-4f9b-8317-95d448a1cb31 req-32709371-870f-49e3-950e-6d94dd899d11 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0660505 May 12 15:48:45.574095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06bf1018-71b0-4b2b-957a-e4a85463bed8 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:45.575575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-06bf1018-71b0-4b2b-957a-e4a85463bed8 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1091 time: 0.0717971 May 12 15:48:45.578603 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49472) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:45.583589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address': '172.20.0.6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:45.590411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:45.596148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:floatingip and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:45.599452 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:45.606965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:45.619111 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:45.629669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0189b479-d32b-4f9b-8317-95d448a1cb31 req-7657c8c9-b88e-4d9d-b3cd-e5ca1521a993 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:45.631147 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0189b479-d32b-4f9b-8317-95d448a1cb31 req-7657c8c9-b88e-4d9d-b3cd-e5ca1521a993 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0858641 May 12 15:48:45.770897 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:45.791036 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0189b479-d32b-4f9b-8317-95d448a1cb31 req-b04af3ca-5b3d-408c-a034-910083140bf2 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1537089 May 12 15:48:45.920332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.25.8.172 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/72328225-023d-4371-9794-c0b90b5becf4) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:45.926735 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0189b479-d32b-4f9b-8317-95d448a1cb31 req-5263679a-6f02-45a5-adb3-50578fd3a206 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1301522 May 12 15:48:45.974990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49486) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:46.041783 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.077779 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.090614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Request body: {'network': {'name': 'tempest-TestServerBasicOps-7749450-network', 'tenant_id': '1151aa532835463f914c578c906281f8'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:46.096242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:46.100174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Usage tracker for resource:network and tenant:1151aa532835463f914c578c906281f8 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:46.103067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:46.108051 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.109568 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:46.118696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Made reservation on behalf of 1151aa532835463f914c578c906281f8 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:48:46.121224 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.134684 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.150735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:46.154873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Usage tracker for resource:security_group_rule and tenant:1151aa532835463f914c578c906281f8 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:46.157818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:46.163399 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:46.175858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:46.178601 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:46.182790 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:46.218386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=72328225-023d-4371-9794-c0b90b5becf4,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:46.275075 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.282096 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.285163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.320293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 562} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:48:46.333855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a63d8a4-d8af-4d35-8e6b-53491117dcd0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:46.338442 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.338850 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Added segment fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76 of type vlan for network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 May 12 15:48:46.366183 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.402384 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.403462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:46.404038 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.510839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] Pushing event updated for resources: {'Network': ['ID=b6bf3355-4481-47dd-96cc-1e4a6e5445a3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:46.517033 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8df7f052-5abd-48c5-9bbd-19425f6b26c4 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 879 time: 0.5376434 May 12 15:48:46.517816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49494) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:46.523515 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:48:46.524027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Request body: {'subnet': {'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerBasicOps-7749450-subnet', 'tenant_id': '1151aa532835463f914c578c906281f8', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:46.530457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:46.534759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Usage tracker for resource:subnet and tenant:1151aa532835463f914c578c906281f8 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:46.537670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:46.543741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:46.554515 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Made reservation on behalf of 1151aa532835463f914c578c906281f8 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:48:46.557020 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.632439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc8f252d-7935-4e30-8a9a-da57fb2ffd14 req-c3994220-3016-4788-abc3-4d376e6ee7a1 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:46.637862 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc8f252d-7935-4e30-8a9a-da57fb2ffd14 req-c3994220-3016-4788-abc3-4d376e6ee7a1 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 943 time: 0.3136680 May 12 15:48:46.773572 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc8f252d-7935-4e30-8a9a-da57fb2ffd14 req-e1d7d569-4727-442c-b216-6da856b02fd5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1302080 May 12 15:48:46.782424 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.860132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a6a2c883-c889-4a5d-b880-b94c7f7dbeff,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:46.863516 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.869081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Checking segment: {'id': 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:46.869473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Network hostable DHCP agents. Network: b6bf3355-4481-47dd-96cc-1e4a6e5445a3, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:48:46.890307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:48:46.899368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, b6bf3355-4481-47dd-96cc-1e4a6e5445a3) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:46.903594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:46.904219 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.910612 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b075a031-4162-4bcf-9693-f24172ec1f3f None None] Network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:48:46.926851 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-55756481-5f02-4738-9306-198d0b8ebaa9 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 0.4079280 May 12 15:48:46.929871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49498) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:46.934928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Request body: {'router': {'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:46.941085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:46.945739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Usage tracker for resource:router and tenant:1151aa532835463f914c578c906281f8 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:46.946056 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.949175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:46.956127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:46.967328 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.968609 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:46.985424 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:47.135418 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'tenant_id': '1151aa532835463f914c578c906281f8', 'fixed_ips': [{'subnet_id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:48:47.136254 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:47.166393 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:47.172664 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:47.309707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=72328225-023d-4371-9794-c0b90b5becf4,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:47.322976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Allocated IP 172.20.0.2 (b6bf3355-4481-47dd-96cc-1e4a6e5445a3/a6a2c883-c889-4a5d-b880-b94c7f7dbeff/3bba5053-89ea-41a3-a948-079db908d144) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:47.327437 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:47.383637 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:47.510523 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Floating IP 553c2d8d-aaa2-4f71-b736-7b6255f73611 associated. External IP: 172.25.8.172, port: fcfbcee7-a160-4968-9ce4-95d57bd748bc. May 12 15:48:47.543187 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:47.556518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Transition to ACTIVE for port object 3bba5053-89ea-41a3-a948-079db908d144 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:47.576703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Transition to ACTIVE for port object 3bba5053-89ea-41a3-a948-079db908d144 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:47.583800 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:47.652447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:47.655880 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:47.659812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:47.669039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Pushing event updated for resources: {'Port': ['ID=3bba5053-89ea-41a3-a948-079db908d144,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:47.718884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:47.756056 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:47.779706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Attempting to bind port 3bba5053-89ea-41a3-a948-079db908d144 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:47.780081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Attempting to bind port 3bba5053-89ea-41a3-a948-079db908d144 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:47.780436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Attempting to bind port 3bba5053-89ea-41a3-a948-079db908d144 on network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:47.782457 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:47.786505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:47.786871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Checking segment: {'id': 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:47.787259 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:47.787641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Bound using segment: {'id': 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:47.788106 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Bound port: 3bba5053-89ea-41a3-a948-079db908d144, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:47.788470 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:47.884747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router 8730f760-162a-4cbe-920e-62ab9491281b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:48:47.885914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] For port 3bba5053-89ea-41a3-a948-079db908d144, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:47.891959 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] For port 3bba5053-89ea-41a3-a948-079db908d144, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3bba5053-89ea-41a3-a948-079db908d144,segment=NetworkSegment(fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76),segment_id=fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:47.897902 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:47.917925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Allocated IP 172.25.8.120 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/53058f3d-d8fa-4817-a143-1964a7baa056) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:48.026146 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-901f0f92-dce8-4955-aadf-f5892c788864 None None] Pushing event updated for resources: {'Port': ['ID=3bba5053-89ea-41a3-a948-079db908d144,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:48.096451 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:48.128537 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:48.201941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:48.204885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:48.210831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:48.275411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Pushing event updated for resources: {'Port': ['ID=53058f3d-d8fa-4817-a143-1964a7baa056,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:48.294313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:48.311548 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1ad6359-f2e5-45c3-a607-d1cbe20ec05f None None] Sync routers for ids ['8730f760-162a-4cbe-920e-62ab9491281b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:48:48.336172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1ad6359-f2e5-45c3-a607-d1cbe20ec05f None None] Routers {'8730f760-162a-4cbe-920e-62ab9491281b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:48.337174 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d1ad6359-f2e5-45c3-a607-d1cbe20ec05f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8730f760-162a-4cbe-920e-62ab9491281b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:48.356113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0acb7227-8043-4b7b-bbba-dedf91c209a6 req-6880927f-d7d8-4c52-93ff-3c69dad3bc52 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:48.357829 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0acb7227-8043-4b7b-bbba-dedf91c209a6 req-6880927f-d7d8-4c52-93ff-3c69dad3bc52 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 943 time: 0.4096603 May 12 15:48:48.359325 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:48.454898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0acb7227-8043-4b7b-bbba-dedf91c209a6 req-bec2ebe3-dec9-4323-a7ab-caa2f2b2b68c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700214 May 12 15:48:48.459144 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e441aaf4-00ef-4fc3-9606-133345f807a0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.8794682 May 12 15:48:48.459922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:48:48.520473 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4108cc84-de74-40d0-ba9d-54733a9a63b8'] response: {'name': 'network-changed', 'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'status': 'completed', 'code': 200} May 12 15:48:48.581589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-d1ad6359-f2e5-45c3-a607-d1cbe20ec05f None None] Set router 8730f760-162a-4cbe-920e-62ab9491281b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:48.718503 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:48.728396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da439b70-4991-4d5e-8c43-2458390259e1 req-33e7d395-d1a3-4bc3-a9ab-e956f47d75ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:48.730045 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da439b70-4991-4d5e-8c43-2458390259e1 req-33e7d395-d1a3-4bc3-a9ab-e956f47d75ef service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1096 time: 0.1614978 May 12 15:48:48.742791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedac1bc-90a0-4383-9d2f-a62e23225c32 req-1d9ab30a-cb75-4d38-9a1b-e60ce1aadea6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:48.744475 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fedac1bc-90a0-4383-9d2f-a62e23225c32 req-1d9ab30a-cb75-4d38-9a1b-e60ce1aadea6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.1387362 May 12 15:48:48.881742 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fedac1bc-90a0-4383-9d2f-a62e23225c32 req-871958a9-1546-4f00-847d-68ffdc03e778 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1180701 May 12 15:48:48.911417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49508) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:49.004597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d1ad6359-f2e5-45c3-a607-d1cbe20ec05f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:48:22Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '553c2d8d-aaa2-4f71-b736-7b6255f73611', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'floating_ip_address': '172.25.8.172', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'port_id': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4014, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'mac_address': 'fa:16:3e:fe:e9:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14a655a9-bdaa-4d2e-8238-f05604300363', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:46Z', 'revision_number': 0, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ba356da3-692c-41a7-9dae-e94814fdc047', 'name': '', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:88:8c:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3982, 'fixed_ips': [{'subnet_id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:20Z', 'updated_at': '2022-05-12T15:48:34Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:49.006308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da439b70-4991-4d5e-8c43-2458390259e1 req-99187379-87ab-40ba-9738-8d2d1c2a4d85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:49.007979 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da439b70-4991-4d5e-8c43-2458390259e1 req-99187379-87ab-40ba-9738-8d2d1c2a4d85 service neutron] 10.222.0.84 "GET /v2.0/networks?id=2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 200 len: 898 time: 0.2624657 May 12 15:48:49.009465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1ad6359-f2e5-45c3-a607-d1cbe20ec05f None None] Checking router: 8730f760-162a-4cbe-920e-62ab9491281b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:48:49.022165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1ad6359-f2e5-45c3-a607-d1cbe20ec05f None None] Routers {'8730f760-162a-4cbe-920e-62ab9491281b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:49.023017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d1ad6359-f2e5-45c3-a607-d1cbe20ec05f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8730f760-162a-4cbe-920e-62ab9491281b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:49.128692 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0a8ee831-8882-46d2-85ac-c65985a55ed0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/553c2d8d-aaa2-4f71-b736-7b6255f73611 HTTP/1.1" status: 200 len: 991 time: 0.2160220 May 12 15:48:49.144225 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da439b70-4991-4d5e-8c43-2458390259e1 req-395c3f29-4227-48d1-8b54-40e91c295bbb service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 999 time: 0.1245623 May 12 15:48:49.210370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da439b70-4991-4d5e-8c43-2458390259e1 req-6e61296f-5964-4a03-862d-6571f8c2be45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:49.222897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da439b70-4991-4d5e-8c43-2458390259e1 req-6e61296f-5964-4a03-862d-6571f8c2be45 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae HTTP/1.1" status: 200 len: 835 time: 0.0714457 May 12 15:48:49.247134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-d1ad6359-f2e5-45c3-a607-d1cbe20ec05f None None] Set router 8730f760-162a-4cbe-920e-62ab9491281b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:49.258688 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:49.308727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da439b70-4991-4d5e-8c43-2458390259e1 req-97c1cdd3-0afb-45dd-9439-18275798c89f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:49.310444 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da439b70-4991-4d5e-8c43-2458390259e1 req-97c1cdd3-0afb-45dd-9439-18275798c89f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2c49c390-e121-4f31-92ba-528e8cdf62dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0806921 May 12 15:48:49.318839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39de17e8-08a3-4c9b-9ca5-0a7f346f1d56 None None] Network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:48:49.449349 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da439b70-4991-4d5e-8c43-2458390259e1 req-a08df9c9-93fb-432d-8f0c-ad56eb09db43 service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1299865 May 12 15:48:49.506428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fa58d2f1-3e1b-4bc9-80ec-01af9bf6e6a6 None None] Provisioning for port 3bba5053-89ea-41a3-a948-079db908d144 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:49.537055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:48:49.588849 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da439b70-4991-4d5e-8c43-2458390259e1 req-4ad2d95d-3a5f-49e7-b2cb-be37d91720e2 service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1328943 May 12 15:48:49.679858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4422ce0-dd51-4a99-8aae-5dc26166a8e2 req-2ecf7a0e-ce4a-4fd4-92df-5a4046a8335b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:49.681328 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4422ce0-dd51-4a99-8aae-5dc26166a8e2 req-2ecf7a0e-ce4a-4fd4-92df-5a4046a8335b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 943 time: 0.0904014 May 12 15:48:49.730874 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4422ce0-dd51-4a99-8aae-5dc26166a8e2 req-23c29ab1-7b9d-47a4-aeab-3469f0d61ccd tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427020 May 12 15:48:49.768123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:49.780919 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Sync routers for ids ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:48:49.794111 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Routers {'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:49.797705 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:49.800777 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2236e514-90cd-49e8-9a42-087b62c4943b admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 918 time: 2.8698516 May 12 15:48:49.801093 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:49.801373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49514) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:49.884942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3bba5053-89ea-41a3-a948-079db908d144 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:49.956772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d1ad6359-f2e5-45c3-a607-d1cbe20ec05f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:48:22Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '553c2d8d-aaa2-4f71-b736-7b6255f73611', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'floating_ip_address': '172.25.8.172', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'port_id': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4014, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'mac_address': 'fa:16:3e:fe:e9:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14a655a9-bdaa-4d2e-8238-f05604300363', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:46Z', 'revision_number': 0, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ba356da3-692c-41a7-9dae-e94814fdc047', 'name': '', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:88:8c:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3982, 'fixed_ips': [{'subnet_id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:20Z', 'updated_at': '2022-05-12T15:48:34Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:49.962811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1ad6359-f2e5-45c3-a607-d1cbe20ec05f None None] The sync data for ids ['8730f760-162a-4cbe-920e-62ab9491281b'] in n-d-841483-1 is: [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:48:22Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '553c2d8d-aaa2-4f71-b736-7b6255f73611', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'floating_ip_address': '172.25.8.172', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'port_id': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4014, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'mac_address': 'fa:16:3e:fe:e9:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14a655a9-bdaa-4d2e-8238-f05604300363', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:46Z', 'revision_number': 0, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ba356da3-692c-41a7-9dae-e94814fdc047', 'name': '', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:88:8c:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3982, 'fixed_ips': [{'subnet_id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:20Z', 'updated_at': '2022-05-12T15:48:34Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:48:49.984966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 3bba5053-89ea-41a3-a948-079db908d144 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:49.991281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 3bba5053-89ea-41a3-a948-079db908d144 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:49.991593 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:50.072050 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Set router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:50.133831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49518) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:50.184503 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:50.249540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 3bba5053-89ea-41a3-a948-079db908d144, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3bba5053-89ea-41a3-a948-079db908d144,segment=NetworkSegment(fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76),segment_id=fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:50.261513 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:50.374567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=3bba5053-89ea-41a3-a948-079db908d144,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:50.377103 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-279cef6c-e686-4571-ae1c-035cd032df71 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/553c2d8d-aaa2-4f71-b736-7b6255f73611 HTTP/1.1" status: 200 len: 991 time: 0.2431362 May 12 15:48:50.386410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf331ea8-86e6-4db0-969a-0017b87afbc9 None None] New status for floating IP 553c2d8d-aaa2-4f71-b736-7b6255f73611: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:48:50.448095 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:48Z', 'revision_number': 3, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:47Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:50.452612 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Checking router: dd5e48e9-bffc-4a41-8d4c-ca99803fdfad for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:48:50.453053 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Updating router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad port 53058f3d-d8fa-4817-a143-1964a7baa056 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:48:50.487423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-def02a3b-7b1b-434f-a478-c4fe0f145028 None None] Provisioning complete for port 3bba5053-89ea-41a3-a948-079db908d144 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:50.487794 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-def02a3b-7b1b-434f-a478-c4fe0f145028 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:50.518593 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:50.765316 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:50.882838 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:50.895405 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Transition to ACTIVE for port object 53058f3d-d8fa-4817-a143-1964a7baa056 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:50.902655 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:50.986123 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92132880-5339-481a-916f-516fb0d97a27 None None] Pushing event updated for resources: {'Port': ['ID=53058f3d-d8fa-4817-a143-1964a7baa056,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:50.988294 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Attempting to bind port 53058f3d-d8fa-4817-a143-1964a7baa056 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:50.988648 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Attempting to bind port 53058f3d-d8fa-4817-a143-1964a7baa056 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:50.988996 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Attempting to bind port 53058f3d-d8fa-4817-a143-1964a7baa056 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:50.994732 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:50.995093 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:50.995481 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:50.995858 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:50.996309 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Bound port: 53058f3d-d8fa-4817-a143-1964a7baa056, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:50.996668 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:51.048873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62da825b-3a73-4c4b-9f67-c58220191d0e req-57a26ea0-cfaf-4606-a96a-f96c98a203fa tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:51.050266 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62da825b-3a73-4c4b-9f67-c58220191d0e req-57a26ea0-cfaf-4606-a96a-f96c98a203fa tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 943 time: 0.1983745 May 12 15:48:51.051391 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Allocated IP 172.20.0.1 (b6bf3355-4481-47dd-96cc-1e4a6e5445a3/a6a2c883-c889-4a5d-b880-b94c7f7dbeff/b8ff0404-7287-4829-8582-deec91c98f44) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:51.070118 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] For port 53058f3d-d8fa-4817-a143-1964a7baa056, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:51.073155 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] For port 53058f3d-d8fa-4817-a143-1964a7baa056, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=53058f3d-d8fa-4817-a143-1964a7baa056,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:51.078029 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:51.153500 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Routers {'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:51.154155 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:51.177169 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-62da825b-3a73-4c4b-9f67-c58220191d0e req-4238565a-f6c7-4afe-899d-79cf2bdef2c4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1188686 May 12 15:48:51.236703 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92132880-5339-481a-916f-516fb0d97a27 None None] Pushing event updated for resources: {'Port': ['ID=53058f3d-d8fa-4817-a143-1964a7baa056,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:51.243096 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:51.260042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Transition to ACTIVE for port object b8ff0404-7287-4829-8582-deec91c98f44 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:51.285822 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:51.338125 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] Set router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:51.359153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:51.362044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:51.366296 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:51.381796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49524) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:51.393023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Pushing event updated for resources: {'Port': ['ID=b8ff0404-7287-4829-8582-deec91c98f44,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:51.422094 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:51.514265 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f59e3a0c-9b1b-4eef-a052-ea78abbca0a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/553c2d8d-aaa2-4f71-b736-7b6255f73611 HTTP/1.1" status: 200 len: 993 time: 0.1306148 May 12 15:48:51.594888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d0d8137e-ca30-49c6-9380-08686b046317 None None] Provisioning for port b8ff0404-7287-4829-8582-deec91c98f44 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:51.599633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d0d8137e-ca30-49c6-9380-08686b046317 None None] Provisioning complete for port b8ff0404-7287-4829-8582-deec91c98f44 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:51.599995 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d0d8137e-ca30-49c6-9380-08686b046317 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:51.663260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d0d8137e-ca30-49c6-9380-08686b046317 None None] Port b8ff0404-7287-4829-8582-deec91c98f44 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:48:51.674664 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:48Z', 'revision_number': 3, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:51.678631 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7684ad88-522c-4722-b789-fabbc5423557 None None] The sync data for ids ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'] in n-d-841483-1 is: [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:48Z', 'revision_number': 3, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:48:51.698304 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:51.779007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3bba5053-89ea-41a3-a948-079db908d144 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:51.849179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 3bba5053-89ea-41a3-a948-079db908d144 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:51.849490 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:52.084247 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:52.088857 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:52.198699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Pushing event updated for resources: {'Port': ['ID=b8ff0404-7287-4829-8582-deec91c98f44,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:52.201687 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:52.403617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:52.405818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:52.478147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c99248d6-7aaa-4c68-a98e-72835c1bcc67 req-269f4689-7786-479f-92c2-f8f3d5ad82fe tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:52.479628 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c99248d6-7aaa-4c68-a98e-72835c1bcc67 req-269f4689-7786-479f-92c2-f8f3d5ad82fe tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 943 time: 0.1884408 May 12 15:48:52.617057 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c99248d6-7aaa-4c68-a98e-72835c1bcc67 req-a9f18860-1040-4cdd-a1ad-af4c51465b5a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1285305 May 12 15:48:52.642300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:48:52.689268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6152bd1a-1c70-48a5-a343-bfa04c384399 None None] Provisioning complete for port b8ff0404-7287-4829-8582-deec91c98f44 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:52.689811 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6152bd1a-1c70-48a5-a343-bfa04c384399 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:52.741887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6152bd1a-1c70-48a5-a343-bfa04c384399 None None] Port b8ff0404-7287-4829-8582-deec91c98f44 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:48:52.829102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:52.837595 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-99035f74-f505-41fa-b530-ff88d76cad5c admin admin] 10.222.0.82 "PUT /v2.0/routers/dd5e48e9-bffc-4a41-8d4c-ca99803fdfad/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0346451 May 12 15:48:53.220084 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Sync routers for ids ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:48:53.229132 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Routers {'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:53.229851 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:53.345430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49544) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:53.351028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Request body: {'network': {'name': 'tempest-TestServerBasicOps-1422217319-network', 'tenant_id': '7693fc7953154378987fe7c2935363e5'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:53.356625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:53.361094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Usage tracker for resource:network and tenant:7693fc7953154378987fe7c2935363e5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:53.364041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:53.369802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:53.383494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Made reservation on behalf of 7693fc7953154378987fe7c2935363e5 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:48:53.385897 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:53.398371 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:53.412991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:53.413325 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Set router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:53.417039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Usage tracker for resource:security_group_rule and tenant:7693fc7953154378987fe7c2935363e5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:53.420001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:53.425751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:53.509247 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:53.513034 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:53.547025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 598} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:48:53.556070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6305eafc-58f4-49dd-a900-1b7d2407b069,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:53.562293 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:53.562674 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Added segment 323fc110-5525-47d9-b44e-a0080f2b820d of type vlan for network 771e7061-f52a-45e5-8c9e-e38333bdca6c May 12 15:48:53.590022 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:53.622036 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:53.623639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:53.624207 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:53.741296 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3947575 May 12 15:48:53.742285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f9399d2-2597-49f0-b64d-cae57f93a67d admin admin] Pushing event updated for resources: {'Network': ['ID=771e7061-f52a-45e5-8c9e-e38333bdca6c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:53.745448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49550) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:53.753295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Request body: {'subnet': {'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerBasicOps-1422217319-subnet', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:53.758165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 771e7061-f52a-45e5-8c9e-e38333bdca6c details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:48:53.759451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:53.764418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Usage tracker for resource:subnet and tenant:7693fc7953154378987fe7c2935363e5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:53.767546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:53.770494 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:51Z', 'revision_number': 4, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'b8ff0404-7287-4829-8582-deec91c98f44', 'name': '', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'tenant_id': '1151aa532835463f914c578c906281f8', 'mac_address': 'fa:16:3e:af:ee:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_interface', 'standard_attr_id': 4018, 'fixed_ips': [{'subnet_id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:50Z', 'updated_at': '2022-05-12T15:48:51Z', 'revision_number': 2, 'project_id': '1151aa532835463f914c578c906281f8', 'subnets': [{'id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:53.774473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:53.775326 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Checking router: dd5e48e9-bffc-4a41-8d4c-ca99803fdfad for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:48:53.776073 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Updating router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad port b8ff0404-7287-4829-8582-deec91c98f44 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:48:53.790623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Made reservation on behalf of 7693fc7953154378987fe7c2935363e5 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:48:53.793818 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:53.815779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b56a53a4-1ea8-430e-bc84-4e7be57dd87c req-b772b55f-db03-40ab-b305-48f2acbc0d6e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:53.829962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b56a53a4-1ea8-430e-bc84-4e7be57dd87c req-b772b55f-db03-40ab-b305-48f2acbc0d6e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 943 time: 0.1059072 May 12 15:48:53.855375 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:53.882828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 53058f3d-d8fa-4817-a143-1964a7baa056 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:53.899659 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b56a53a4-1ea8-430e-bc84-4e7be57dd87c req-d8b28529-52c2-4fe4-9723-65f1f40096f9 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619199 May 12 15:48:53.918068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e2437d02-b992-47e4-8d72-0a2dde082069 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:48:54.039171 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.088592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 53058f3d-d8fa-4817-a143-1964a7baa056 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:54.117523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 53058f3d-d8fa-4817-a143-1964a7baa056 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:54.118301 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.119502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4eed5e42-a620-43a1-98e4-71cecbfe4f0e,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:54.127237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Checking segment: {'id': '323fc110-5525-47d9-b44e-a0080f2b820d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:54.127583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Network hostable DHCP agents. Network: 771e7061-f52a-45e5-8c9e-e38333bdca6c, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:48:54.146744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Network 771e7061-f52a-45e5-8c9e-e38333bdca6c is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:48:54.157437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 771e7061-f52a-45e5-8c9e-e38333bdca6c) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:54.162844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:54.163595 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.176060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e602ebff-6e62-4dda-98dc-fd38ba624d06 None None] Network 771e7061-f52a-45e5-8c9e-e38333bdca6c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:48:54.189526 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4abe573e-30da-4385-b2b3-4b9f238f1db6 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.4404137 May 12 15:48:54.189740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49554) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:54.195430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Request body: {'router': {'name': 'tempest-TestServerBasicOps-1422217319-router', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:48:54.201788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:48:54.206212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Usage tracker for resource:router and tenant:7693fc7953154378987fe7c2935363e5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:48:54.209034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:48:54.215269 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:48:54.230844 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.231885 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.250033 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.251719 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.265080 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Transition to ACTIVE for port object b8ff0404-7287-4829-8582-deec91c98f44 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:54.272997 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.289921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e2437d02-b992-47e4-8d72-0a2dde082069, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e2437d02-b992-47e4-8d72-0a2dde082069,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:54.315620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'e2437d02-b992-47e4-8d72-0a2dde082069', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'port_id': 'e2437d02-b992-47e4-8d72-0a2dde082069', 'mac_address': 'fa:16:3e:ab:53:a8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 566, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:48:54.437365 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0db0cdf7-8017-40ad-81a4-976228786773 None None] Pushing event updated for resources: {'Port': ['ID=b8ff0404-7287-4829-8582-deec91c98f44,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:54.519789 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Attempting to bind port b8ff0404-7287-4829-8582-deec91c98f44 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:54.520251 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Attempting to bind port b8ff0404-7287-4829-8582-deec91c98f44 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:54.520701 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Attempting to bind port b8ff0404-7287-4829-8582-deec91c98f44 on network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:54.526290 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:54.526793 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Checking segment: {'id': 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:54.527281 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.527754 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Bound using segment: {'id': 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:54.528302 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Bound port: b8ff0404-7287-4829-8582-deec91c98f44, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:54.528793 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.537352 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.548442 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.586844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e2437d02-b992-47e4-8d72-0a2dde082069 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:48:54.593423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 53058f3d-d8fa-4817-a143-1964a7baa056, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=53058f3d-d8fa-4817-a143-1964a7baa056,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:54.609811 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.630680 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] For port b8ff0404-7287-4829-8582-deec91c98f44, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:54.633926 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] For port b8ff0404-7287-4829-8582-deec91c98f44, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b8ff0404-7287-4829-8582-deec91c98f44,segment=NetworkSegment(fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76),segment_id=fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:54.638374 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.689914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e2437d02-b992-47e4-8d72-0a2dde082069, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e2437d02-b992-47e4-8d72-0a2dde082069,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:54.715036 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.734830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-771e7061-f52a-45e5-8c9e-e38333bdca6c', 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'fixed_ips': [{'subnet_id': '4eed5e42-a620-43a1-98e4-71cecbfe4f0e'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:48:54.735781 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.744597 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Routers {'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:54.745336 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:54.759342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=53058f3d-d8fa-4817-a143-1964a7baa056,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:54.774262 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:54.806314 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0db0cdf7-8017-40ad-81a4-976228786773 None None] Pushing event updated for resources: {'Port': ['ID=b8ff0404-7287-4829-8582-deec91c98f44,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:54.918801 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=e2437d02-b992-47e4-8d72-0a2dde082069,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:54.926809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['e2437d02-b992-47e4-8d72-0a2dde082069'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:48:55.001915 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] Set router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:55.113084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Allocated IP 172.20.0.2 (771e7061-f52a-45e5-8c9e-e38333bdca6c/4eed5e42-a620-43a1-98e4-71cecbfe4f0e/0a7ed4d2-89c0-463f-8771-03a1168de92a) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:55.152357 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:55.152843 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-383f6123-573c-447c-9479-cb029e9fc72c req-bd7a57fa-c376-4f44-8582-f69d15e2be09 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:55.161661 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-383f6123-573c-447c-9479-cb029e9fc72c req-bd7a57fa-c376-4f44-8582-f69d15e2be09 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 944 time: 0.1050675 May 12 15:48:55.189203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:55.222472 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-383f6123-573c-447c-9479-cb029e9fc72c req-a5a349ba-d132-4c32-955e-c0450de125ca tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595424 May 12 15:48:55.352683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Allocated IP 172.25.8.200 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/ae759da5-88a0-4fab-a684-7cbbd3c4318a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:55.378027 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:51Z', 'revision_number': 4, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'b8ff0404-7287-4829-8582-deec91c98f44', 'name': '', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'tenant_id': '1151aa532835463f914c578c906281f8', 'mac_address': 'fa:16:3e:af:ee:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_interface', 'standard_attr_id': 4018, 'fixed_ips': [{'subnet_id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:50Z', 'updated_at': '2022-05-12T15:48:54Z', 'revision_number': 4, 'project_id': '1151aa532835463f914c578c906281f8', 'subnets': [{'id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:55.381855 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-529f246e-48a5-4ba4-b5b6-d9693946e97e None None] The sync data for ids ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'] in n-d-841483-1 is: [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:51Z', 'revision_number': 4, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'b8ff0404-7287-4829-8582-deec91c98f44', 'name': '', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'tenant_id': '1151aa532835463f914c578c906281f8', 'mac_address': 'fa:16:3e:af:ee:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_interface', 'standard_attr_id': 4018, 'fixed_ips': [{'subnet_id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:50Z', 'updated_at': '2022-05-12T15:48:54Z', 'revision_number': 4, 'project_id': '1151aa532835463f914c578c906281f8', 'subnets': [{'id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:48:55.481009 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:55.493135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Transition to ACTIVE for port object 0a7ed4d2-89c0-463f-8771-03a1168de92a will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:55.515176 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Transition to ACTIVE for port object 0a7ed4d2-89c0-463f-8771-03a1168de92a will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:55.520319 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:55.544512 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:55.583750 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:55.591356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Network 771e7061-f52a-45e5-8c9e-e38333bdca6c is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:55.594504 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:55.598529 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:55.604423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Pushing event updated for resources: {'Port': ['ID=0a7ed4d2-89c0-463f-8771-03a1168de92a,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:55.654583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:55.657903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:55.661650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:55.696944 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Attempting to bind port 0a7ed4d2-89c0-463f-8771-03a1168de92a on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:55.697215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Attempting to bind port 0a7ed4d2-89c0-463f-8771-03a1168de92a by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '323fc110-5525-47d9-b44e-a0080f2b820d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:55.697588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Attempting to bind port 0a7ed4d2-89c0-463f-8771-03a1168de92a on network 771e7061-f52a-45e5-8c9e-e38333bdca6c {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:55.700069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Pushing event updated for resources: {'Port': ['ID=ae759da5-88a0-4fab-a684-7cbbd3c4318a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:55.703345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:55.703783 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Checking segment: {'id': '323fc110-5525-47d9-b44e-a0080f2b820d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:55.704088 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:55.704473 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Bound using segment: {'id': '323fc110-5525-47d9-b44e-a0080f2b820d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:55.705066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Bound port: 0a7ed4d2-89c0-463f-8771-03a1168de92a, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '323fc110-5525-47d9-b44e-a0080f2b820d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:55.705462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:55.812463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] For port 0a7ed4d2-89c0-463f-8771-03a1168de92a, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:55.816282 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] For port 0a7ed4d2-89c0-463f-8771-03a1168de92a, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0a7ed4d2-89c0-463f-8771-03a1168de92a,segment=NetworkSegment(323fc110-5525-47d9-b44e-a0080f2b820d),segment_id=323fc110-5525-47d9-b44e-a0080f2b820d)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:55.821873 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:55.913783 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1a8c423-46f3-4c86-a652-7a9cab557f72 None None] Pushing event updated for resources: {'Port': ['ID=0a7ed4d2-89c0-463f-8771-03a1168de92a,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:55.918827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e2437d02-b992-47e4-8d72-0a2dde082069 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:55.959032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 53058f3d-d8fa-4817-a143-1964a7baa056 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:56.084836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port e2437d02-b992-47e4-8d72-0a2dde082069 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:56.093480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 53058f3d-d8fa-4817-a143-1964a7baa056 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:56.094157 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:56.136458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port e2437d02-b992-47e4-8d72-0a2dde082069 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:56.137180 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:56.353668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b8ff0404-7287-4829-8582-deec91c98f44 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:56.359275 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:56.481819 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:56.508777 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port b8ff0404-7287-4829-8582-deec91c98f44 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:56.516259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd5cc08c-b0ae-4c5a-becb-61bfca8b86ec req-203937dc-449d-49d6-9828-15e53845de05 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:56.518943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b5508855-5e88-4ff1-8ed9-b3df18a0ae70', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e2437d02-b992-47e4-8d72-0a2dde082069'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:48:56.524148 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd5cc08c-b0ae-4c5a-becb-61bfca8b86ec req-203937dc-449d-49d6-9828-15e53845de05 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 944 time: 0.1202362 May 12 15:48:56.527524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b8ff0404-7287-4829-8582-deec91c98f44 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:56.528152 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:56.620554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port e2437d02-b992-47e4-8d72-0a2dde082069, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e2437d02-b992-47e4-8d72-0a2dde082069,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:56.622603 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-dceaaf6b-4010-4cdf-9aba-b32943b91a99'] response: {'server_uuid': 'b5508855-5e88-4ff1-8ed9-b3df18a0ae70', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e2437d02-b992-47e4-8d72-0a2dde082069', 'code': 200} May 12 15:48:56.638272 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd5cc08c-b0ae-4c5a-becb-61bfca8b86ec req-e1bd3f4f-80ac-4072-bda0-3c6f6384ab01 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1106334 May 12 15:48:56.642635 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:56.748464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=e2437d02-b992-47e4-8d72-0a2dde082069,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:56.810047 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:56.853074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:56.861945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port b8ff0404-7287-4829-8582-deec91c98f44, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b8ff0404-7287-4829-8582-deec91c98f44,segment=NetworkSegment(fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76),segment_id=fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:56.863395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7591109b-954f-4235-b2f2-6b927fc17f75 req-cd45424d-9c70-4ca4-94cb-0f80b54668c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:56.865136 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7591109b-954f-4235-b2f2-6b927fc17f75 req-cd45424d-9c70-4ca4-94cb-0f80b54668c5 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 1096 time: 0.1812418 May 12 15:48:56.868606 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:56.949745 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=b8ff0404-7287-4829-8582-deec91c98f44,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:57.050468 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7591109b-954f-4235-b2f2-6b927fc17f75 req-591a723c-f9da-4a39-bbb3-0945dd95844f service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1307514 May 12 15:48:57.106291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Router c9ffb090-c018-46fd-a6c1-d125c7c07e18 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:48:57.125070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63a732f6-a771-4c3e-88a5-ade75a12e0c3 None None] Network 771e7061-f52a-45e5-8c9e-e38333bdca6c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:48:57.221178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3eab7090-6842-47b3-b8d8-17f6f7ab50a4 None None] Provisioning for port 0a7ed4d2-89c0-463f-8771-03a1168de92a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:57.291231 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:57.302913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Sync routers for ids ['c9ffb090-c018-46fd-a6c1-d125c7c07e18'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:48:57.316599 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:57.318161 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-96e6fa3a-57bf-428d-9343-ef602380c923 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 3.1275063 May 12 15:48:57.320839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49564) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:48:57.347354 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Routers {'c9ffb090-c018-46fd-a6c1-d125c7c07e18'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:57.348010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c9ffb090-c018-46fd-a6c1-d125c7c07e18'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:57.552543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Set router c9ffb090-c018-46fd-a6c1-d125c7c07e18 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:57.860298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c19b287-4d72-4bd7-920c-7860897de995 req-2a0bffd0-c065-4655-9a82-9ac06dfdfdd7 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:57.863139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c19b287-4d72-4bd7-920c-7860897de995 req-2a0bffd0-c065-4655-9a82-9ac06dfdfdd7 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 945 time: 0.1036205 May 12 15:48:57.915290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'name': 'tempest-TestServerBasicOps-1422217319-router', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.200'}], 'enable_snat': True}, 'gw_port_id': 'ae759da5-88a0-4fab-a684-7cbbd3c4318a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:54Z', 'updated_at': '2022-05-12T15:48:55Z', 'revision_number': 3, 'project_id': '7693fc7953154378987fe7c2935363e5', 'gw_port': {'id': 'ae759da5-88a0-4fab-a684-7cbbd3c4318a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:33:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4029, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:55Z', 'updated_at': '2022-05-12T15:48:55Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:57.925681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Checking router: c9ffb090-c018-46fd-a6c1-d125c7c07e18 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:48:57.927864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Updating router c9ffb090-c018-46fd-a6c1-d125c7c07e18 port ae759da5-88a0-4fab-a684-7cbbd3c4318a binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:48:57.930870 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4c19b287-4d72-4bd7-920c-7860897de995 req-53a72218-308c-4719-a1a2-d3993aeee48e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590737 May 12 15:48:57.968371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0a7ed4d2-89c0-463f-8771-03a1168de92a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:58.048870 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:58.157728 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 0a7ed4d2-89c0-463f-8771-03a1168de92a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:58.176060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0a7ed4d2-89c0-463f-8771-03a1168de92a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:58.176397 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:58.240275 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:58.422198 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:58.450377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Allocated IP 172.20.0.1 (771e7061-f52a-45e5-8c9e-e38333bdca6c/4eed5e42-a620-43a1-98e4-71cecbfe4f0e/4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:48:58.512503 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 0a7ed4d2-89c0-463f-8771-03a1168de92a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0a7ed4d2-89c0-463f-8771-03a1168de92a,segment=NetworkSegment(323fc110-5525-47d9-b44e-a0080f2b820d),segment_id=323fc110-5525-47d9-b44e-a0080f2b820d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:48:58.542585 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:58.543363 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b8ff0404-7287-4829-8582-deec91c98f44 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:58.606547 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:58.621892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Transition to ACTIVE for port object 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:58.647241 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:58.679100 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:58.698985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=0a7ed4d2-89c0-463f-8771-03a1168de92a,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:58.704311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Transition to ACTIVE for port object ae759da5-88a0-4fab-a684-7cbbd3c4318a will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:48:58.711176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Network 771e7061-f52a-45e5-8c9e-e38333bdca6c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:58.714051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:58.717260 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:58.718743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:48:58.758987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port b8ff0404-7287-4829-8582-deec91c98f44 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:58.759197 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:58.761100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Pushing event updated for resources: {'Port': ['ID=4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:58.778644 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:58.857008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae19faf0-0e75-4706-b6c2-32ed9be99fba None None] Pushing event updated for resources: {'Port': ['ID=ae759da5-88a0-4fab-a684-7cbbd3c4318a,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:58.863300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Attempting to bind port ae759da5-88a0-4fab-a684-7cbbd3c4318a on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:48:58.863809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Attempting to bind port ae759da5-88a0-4fab-a684-7cbbd3c4318a by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:48:58.864373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Attempting to bind port ae759da5-88a0-4fab-a684-7cbbd3c4318a on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:48:58.872682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:48:58.873713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:48:58.874115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:58.874490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:48:58.874950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Bound port: ae759da5-88a0-4fab-a684-7cbbd3c4318a, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:48:58.875335 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:58.914798 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:58.959164 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:48:59.008003 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] For port ae759da5-88a0-4fab-a684-7cbbd3c4318a, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:48:59.020502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d05840db-34fd-4872-b6b0-1771e5ea5522 None None] Provisioning for port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:48:59.026553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] For port ae759da5-88a0-4fab-a684-7cbbd3c4318a, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ae759da5-88a0-4fab-a684-7cbbd3c4318a,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:48:59.028547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d05840db-34fd-4872-b6b0-1771e5ea5522 None None] Provisioning complete for port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:59.028981 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d05840db-34fd-4872-b6b0-1771e5ea5522 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:59.060164 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:59.131427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d043f9f4-2fee-4133-aaf6-abda57f8f735 req-4fb14eed-25b2-4136-8ec5-d013202ab353 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:59.138990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d043f9f4-2fee-4133-aaf6-abda57f8f735 req-4fb14eed-25b2-4136-8ec5-d013202ab353 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 945 time: 0.0959601 May 12 15:48:59.154301 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:59.160555 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:59.161765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d05840db-34fd-4872-b6b0-1771e5ea5522 None None] Port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:48:59.170380 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae19faf0-0e75-4706-b6c2-32ed9be99fba None None] Pushing event updated for resources: {'Port': ['ID=ae759da5-88a0-4fab-a684-7cbbd3c4318a,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:59.174911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Routers {'c9ffb090-c018-46fd-a6c1-d125c7c07e18'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:48:59.175527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c9ffb090-c018-46fd-a6c1-d125c7c07e18'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:59.195620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d043f9f4-2fee-4133-aaf6-abda57f8f735 req-0bff8c84-7c50-46a5-b813-f68cfe327668 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0555379 May 12 15:48:59.271965 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:59.275649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Pushing event updated for resources: {'Port': ['ID=4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:48:59.365539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] Set router c9ffb090-c018-46fd-a6c1-d125c7c07e18 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:48:59.403836 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e904f866-9eab-4c20-ad73-45837ac04aee req-6fde4010-04a9-4df9-a5c5-63be78deef80 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:59.411118 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e904f866-9eab-4c20-ad73-45837ac04aee req-6fde4010-04a9-4df9-a5c5-63be78deef80 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 945 time: 0.0871863 May 12 15:48:59.415610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Network 771e7061-f52a-45e5-8c9e-e38333bdca6c is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:48:59.416718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:48:59.464233 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e904f866-9eab-4c20-ad73-45837ac04aee req-293cf0d0-be03-4c3b-b185-2d738ab96c24 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511661 May 12 15:48:59.629041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Router c9ffb090-c018-46fd-a6c1-d125c7c07e18 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:48:59.715360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd59e7c2-cc8d-45e0-845a-13e981ccc784 req-086841a1-79ca-4072-8be4-ca56df47cdf9 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:48:59.722592 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd59e7c2-cc8d-45e0-845a-13e981ccc784 req-086841a1-79ca-4072-8be4-ca56df47cdf9 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 945 time: 0.1109083 May 12 15:48:59.728389 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'name': 'tempest-TestServerBasicOps-1422217319-router', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.200'}], 'enable_snat': True}, 'gw_port_id': 'ae759da5-88a0-4fab-a684-7cbbd3c4318a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:54Z', 'updated_at': '2022-05-12T15:48:58Z', 'revision_number': 4, 'project_id': '7693fc7953154378987fe7c2935363e5', 'gw_port': {'id': 'ae759da5-88a0-4fab-a684-7cbbd3c4318a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:33:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4029, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:55Z', 'updated_at': '2022-05-12T15:48:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0', 'name': '', 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'mac_address': 'fa:16:3e:8a:fc:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'device_owner': 'network:router_interface', 'standard_attr_id': 4030, 'fixed_ips': [{'subnet_id': '4eed5e42-a620-43a1-98e4-71cecbfe4f0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:58Z', 'updated_at': '2022-05-12T15:48:58Z', 'revision_number': 2, 'project_id': '7693fc7953154378987fe7c2935363e5', 'subnets': [{'id': '4eed5e42-a620-43a1-98e4-71cecbfe4f0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:48:59.733314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba7a2f12-a67e-4a2c-9c39-5f7c2ae54d75 None None] The sync data for ids ['c9ffb090-c018-46fd-a6c1-d125c7c07e18'] in n-d-841483-1 is: [{'id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'name': 'tempest-TestServerBasicOps-1422217319-router', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.200'}], 'enable_snat': True}, 'gw_port_id': 'ae759da5-88a0-4fab-a684-7cbbd3c4318a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:54Z', 'updated_at': '2022-05-12T15:48:58Z', 'revision_number': 4, 'project_id': '7693fc7953154378987fe7c2935363e5', 'gw_port': {'id': 'ae759da5-88a0-4fab-a684-7cbbd3c4318a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:33:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4029, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:55Z', 'updated_at': '2022-05-12T15:48:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0', 'name': '', 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'mac_address': 'fa:16:3e:8a:fc:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'device_owner': 'network:router_interface', 'standard_attr_id': 4030, 'fixed_ips': [{'subnet_id': '4eed5e42-a620-43a1-98e4-71cecbfe4f0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:58Z', 'updated_at': '2022-05-12T15:48:58Z', 'revision_number': 2, 'project_id': '7693fc7953154378987fe7c2935363e5', 'subnets': [{'id': '4eed5e42-a620-43a1-98e4-71cecbfe4f0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:48:59.777227 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd59e7c2-cc8d-45e0-845a-13e981ccc784 req-205a6a01-99ad-4932-afef-01baf9f73fd3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537555 May 12 15:48:59.792203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-731c3d70-19ba-45da-8cdd-299822972264 None None] Provisioning complete for port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:59.792686 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-731c3d70-19ba-45da-8cdd-299822972264 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:59.839695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0a7ed4d2-89c0-463f-8771-03a1168de92a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:48:59.917216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-731c3d70-19ba-45da-8cdd-299822972264 None None] Port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:48:59.936198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0a7ed4d2-89c0-463f-8771-03a1168de92a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:48:59.936808 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:48:59.984379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:48:59.997876 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f05d2b92-c902-4f1d-946e-826af1ed8b96 admin admin] 10.222.0.82 "PUT /v2.0/routers/c9ffb090-c018-46fd-a6c1-d125c7c07e18/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6758716 May 12 15:49:00.270127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae016ea8-d7d8-4a65-942d-ebfe65e5cc1e req-dcdd0b69-705d-4957-b4c0-cd97daf8a4f5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:00.272262 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae016ea8-d7d8-4a65-942d-ebfe65e5cc1e req-dcdd0b69-705d-4957-b4c0-cd97daf8a4f5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 945 time: 0.0944235 May 12 15:49:00.449365 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae016ea8-d7d8-4a65-942d-ebfe65e5cc1e req-70408872-4f1e-48d5-9532-5376238c4829 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1709030 May 12 15:49:00.513813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49586) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:49:00.519122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2091924256', 'description': 'tempest-secgroup-smoke-2091924256 description', 'project_id': '1151aa532835463f914c578c906281f8'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:49:00.526212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:49:00.531014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Usage tracker for resource:security_group and tenant:1151aa532835463f914c578c906281f8 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:49:00.534048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:49:00.540086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:49:00.551004 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:00.586909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:49:00.590739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Usage tracker for resource:security_group_rule and tenant:1151aa532835463f914c578c906281f8 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:49:00.594646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:49:00.600225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:49:00.677553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:00.681949 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:00.725497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Pushing event updated for resources: {'SecurityGroup': ['ID=70ee9218-9856-4d3d-b5da-e401c11c7db5,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:00.728972 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:00.730254 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b2c41a4d-c801-46c9-be26-2ec65298f22d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.2154200 May 12 15:49:00.733545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49590) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:49:00.738829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-033d88a9-1473-4648-9f56-0b8f0a21c349 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Request body: {'security_group_rule': {'security_group_id': '70ee9218-9856-4d3d-b5da-e401c11c7db5', 'project_id': '1151aa532835463f914c578c906281f8', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:49:00.745729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-033d88a9-1473-4648-9f56-0b8f0a21c349 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:49:00.749845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-033d88a9-1473-4648-9f56-0b8f0a21c349 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Usage tracker for resource:security_group_rule and tenant:1151aa532835463f914c578c906281f8 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:49:00.752827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-033d88a9-1473-4648-9f56-0b8f0a21c349 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:49:00.760298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-033d88a9-1473-4648-9f56-0b8f0a21c349 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:49:00.778088 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-033d88a9-1473-4648-9f56-0b8f0a21c349 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:00.843926 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-033d88a9-1473-4648-9f56-0b8f0a21c349 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:00.847755 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-033d88a9-1473-4648-9f56-0b8f0a21c349 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:00.870866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-033d88a9-1473-4648-9f56-0b8f0a21c349 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4fb6d542-6a88-4aeb-baa8-32d166c71172,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:00.881121 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-033d88a9-1473-4648-9f56-0b8f0a21c349 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:00.882304 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-033d88a9-1473-4648-9f56-0b8f0a21c349 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1477184 May 12 15:49:00.885076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49594) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:49:00.890818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-36e787d9-d3b7-47dc-a5c2-56faf496e1d7 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Request body: {'security_group_rule': {'security_group_id': '70ee9218-9856-4d3d-b5da-e401c11c7db5', 'project_id': '1151aa532835463f914c578c906281f8', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:49:00.897189 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-36e787d9-d3b7-47dc-a5c2-56faf496e1d7 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:49:00.900960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-36e787d9-d3b7-47dc-a5c2-56faf496e1d7 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Usage tracker for resource:security_group_rule and tenant:1151aa532835463f914c578c906281f8 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:49:00.903899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-36e787d9-d3b7-47dc-a5c2-56faf496e1d7 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:49:00.910555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-36e787d9-d3b7-47dc-a5c2-56faf496e1d7 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:49:00.927308 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36e787d9-d3b7-47dc-a5c2-56faf496e1d7 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:00.990027 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36e787d9-d3b7-47dc-a5c2-56faf496e1d7 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:00.993973 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36e787d9-d3b7-47dc-a5c2-56faf496e1d7 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.018730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36e787d9-d3b7-47dc-a5c2-56faf496e1d7 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=04b1ab3b-5c4c-48ab-b9fb-c24fbcabd4a2,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:01.027253 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36e787d9-d3b7-47dc-a5c2-56faf496e1d7 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.028429 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-36e787d9-d3b7-47dc-a5c2-56faf496e1d7 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1423645 May 12 15:49:01.031388 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49598) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:49:01.036222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d055c0c6-fcee-48b3-b532-d9eef6fc03cf tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Request body: {'security_group_rule': {'security_group_id': '70ee9218-9856-4d3d-b5da-e401c11c7db5', 'project_id': '1151aa532835463f914c578c906281f8', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:49:01.042522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d055c0c6-fcee-48b3-b532-d9eef6fc03cf tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:49:01.046518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d055c0c6-fcee-48b3-b532-d9eef6fc03cf tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Usage tracker for resource:security_group_rule and tenant:1151aa532835463f914c578c906281f8 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:49:01.049422 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d055c0c6-fcee-48b3-b532-d9eef6fc03cf tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:49:01.055464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d055c0c6-fcee-48b3-b532-d9eef6fc03cf tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:49:01.073204 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d055c0c6-fcee-48b3-b532-d9eef6fc03cf tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.136200 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d055c0c6-fcee-48b3-b532-d9eef6fc03cf tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.140916 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d055c0c6-fcee-48b3-b532-d9eef6fc03cf tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.166704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d055c0c6-fcee-48b3-b532-d9eef6fc03cf tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=49b4c445-b849-4f54-aceb-dffc24a83550,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:01.177115 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d055c0c6-fcee-48b3-b532-d9eef6fc03cf tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.178312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d055c0c6-fcee-48b3-b532-d9eef6fc03cf tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1460114 May 12 15:49:01.181355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49602) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:49:01.187169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-fd653e2b-4d18-4dcd-a5db-115bad5b01e0 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Request body: {'security_group_rule': {'security_group_id': '70ee9218-9856-4d3d-b5da-e401c11c7db5', 'project_id': '1151aa532835463f914c578c906281f8', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:49:01.193897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fd653e2b-4d18-4dcd-a5db-115bad5b01e0 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:49:01.197709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fd653e2b-4d18-4dcd-a5db-115bad5b01e0 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Usage tracker for resource:security_group_rule and tenant:1151aa532835463f914c578c906281f8 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:49:01.200672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-fd653e2b-4d18-4dcd-a5db-115bad5b01e0 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:49:01.207224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-fd653e2b-4d18-4dcd-a5db-115bad5b01e0 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:49:01.224760 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd653e2b-4d18-4dcd-a5db-115bad5b01e0 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.288853 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd653e2b-4d18-4dcd-a5db-115bad5b01e0 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.293621 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd653e2b-4d18-4dcd-a5db-115bad5b01e0 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.317777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd653e2b-4d18-4dcd-a5db-115bad5b01e0 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=22974277-46f7-48d4-a712-79e9a7bdc0d6,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:01.326506 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fd653e2b-4d18-4dcd-a5db-115bad5b01e0 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.328010 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fd653e2b-4d18-4dcd-a5db-115bad5b01e0 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1454673 May 12 15:49:01.330470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49606) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:49:01.335822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4c5bae2b-2553-47f3-9c99-004fe1cd9a34 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Request body: {'security_group_rule': {'security_group_id': '70ee9218-9856-4d3d-b5da-e401c11c7db5', 'project_id': '1151aa532835463f914c578c906281f8', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:49:01.342260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4c5bae2b-2553-47f3-9c99-004fe1cd9a34 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:49:01.346046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4c5bae2b-2553-47f3-9c99-004fe1cd9a34 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Usage tracker for resource:security_group_rule and tenant:1151aa532835463f914c578c906281f8 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:49:01.348853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4c5bae2b-2553-47f3-9c99-004fe1cd9a34 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:49:01.354442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4c5bae2b-2553-47f3-9c99-004fe1cd9a34 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:49:01.367589 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-4c5bae2b-2553-47f3-9c99-004fe1cd9a34 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Project 1151aa532835463f914c578c906281f8 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:49:01.375265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c5bae2b-2553-47f3-9c99-004fe1cd9a34 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.439095 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c5bae2b-2553-47f3-9c99-004fe1cd9a34 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.442647 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c5bae2b-2553-47f3-9c99-004fe1cd9a34 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.475812 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4c5bae2b-2553-47f3-9c99-004fe1cd9a34 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.476991 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4c5bae2b-2553-47f3-9c99-004fe1cd9a34 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1455867 May 12 15:49:01.477991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c5bae2b-2553-47f3-9c99-004fe1cd9a34 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e67c4cc7-cb6b-4b1d-8132-3ae9391266de,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:01.479690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49612) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:49:01.486269 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-be074cfa-c8c0-411e-b7d8-463fcb5d1600 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Request body: {'security_group_rule': {'security_group_id': '70ee9218-9856-4d3d-b5da-e401c11c7db5', 'project_id': '1151aa532835463f914c578c906281f8', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:49:01.493175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-be074cfa-c8c0-411e-b7d8-463fcb5d1600 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:49:01.497224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-be074cfa-c8c0-411e-b7d8-463fcb5d1600 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Usage tracker for resource:security_group_rule and tenant:1151aa532835463f914c578c906281f8 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:49:01.501188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-be074cfa-c8c0-411e-b7d8-463fcb5d1600 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:49:01.508934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-be074cfa-c8c0-411e-b7d8-463fcb5d1600 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:49:01.520906 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-be074cfa-c8c0-411e-b7d8-463fcb5d1600 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Project 1151aa532835463f914c578c906281f8 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:49:01.571407 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be074cfa-c8c0-411e-b7d8-463fcb5d1600 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.668102 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be074cfa-c8c0-411e-b7d8-463fcb5d1600 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.677410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e68e59e8-e249-478c-a7ca-363fd2161b9a req-78f12c92-3ade-4566-8ded-242f3861e8d5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:01.678031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-e68e59e8-e249-478c-a7ca-363fd2161b9a req-78f12c92-3ade-4566-8ded-242f3861e8d5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Synchronizing usage tracker for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:49:01.682503 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be074cfa-c8c0-411e-b7d8-463fcb5d1600 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.713494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be074cfa-c8c0-411e-b7d8-463fcb5d1600 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dff364b9-aed1-46ef-aabe-7c8fc93bce75,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:01.721153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-e68e59e8-e249-478c-a7ca-363fd2161b9a req-78f12c92-3ade-4566-8ded-242f3861e8d5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Unset dirty status for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:49:01.722364 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e68e59e8-e249-478c-a7ca-363fd2161b9a req-78f12c92-3ade-4566-8ded-242f3861e8d5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 945 time: 0.1966679 May 12 15:49:01.723716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be074cfa-c8c0-411e-b7d8-463fcb5d1600 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.724816 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-be074cfa-c8c0-411e-b7d8-463fcb5d1600 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2442100 May 12 15:49:01.803443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-e68e59e8-e249-478c-a7ca-363fd2161b9a req-67df48a9-9ecc-4ee1-aec7-9cb4ae6bb67a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Deleting port e2437d02-b992-47e4-8d72-0a2dde082069 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:49:01.804029 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e68e59e8-e249-478c-a7ca-363fd2161b9a req-67df48a9-9ecc-4ee1-aec7-9cb4ae6bb67a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.853473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b2d1b84-de90-46da-b8cb-5cbc5ca0c0d5 req-cc25d931-347f-4300-876e-e065a3ba578e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:01.861284 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7b2d1b84-de90-46da-b8cb-5cbc5ca0c0d5 req-cc25d931-347f-4300-876e-e065a3ba578e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 945 time: 0.1405005 May 12 15:49:01.883159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ae759da5-88a0-4fab-a684-7cbbd3c4318a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:49:01.948156 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7b2d1b84-de90-46da-b8cb-5cbc5ca0c0d5 req-d6b0828d-dbb5-44a7-b4ca-3e5d3685cf7e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0859792 May 12 15:49:01.970302 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ae759da5-88a0-4fab-a684-7cbbd3c4318a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:49:01.972135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-5673d09d-3a89-4ee6-91f1-93b08d272851 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Synchronizing usage tracker for tenant:1151aa532835463f914c578c906281f8 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:49:01.976117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ae759da5-88a0-4fab-a684-7cbbd3c4318a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:49:01.976606 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:01.996373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-5673d09d-3a89-4ee6-91f1-93b08d272851 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Unset dirty status for tenant:1151aa532835463f914c578c906281f8 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:49:02.005546 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-5673d09d-3a89-4ee6-91f1-93b08d272851 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2091924256&fields=id&tenant_id=1151aa532835463f914c578c906281f8 HTTP/1.1" status: 200 len: 267 time: 0.1055815 May 12 15:49:02.113674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-e68e59e8-e249-478c-a7ca-363fd2161b9a req-67df48a9-9ecc-4ee1-aec7-9cb4ae6bb67a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] For port e2437d02-b992-47e4-8d72-0a2dde082069, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=e2437d02-b992-47e4-8d72-0a2dde082069,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:02.114042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e68e59e8-e249-478c-a7ca-363fd2161b9a req-67df48a9-9ecc-4ee1-aec7-9cb4ae6bb67a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:02.137476 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:02.156728 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ae759da5-88a0-4fab-a684-7cbbd3c4318a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ae759da5-88a0-4fab-a684-7cbbd3c4318a,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:02.163427 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:02.178145 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-112dd53f-bfaf-4fe0-a8f1-71ddc861e2ff tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:02.185099 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-112dd53f-bfaf-4fe0-a8f1-71ddc861e2ff tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/networks?id=b6bf3355-4481-47dd-96cc-1e4a6e5445a3 HTTP/1.1" status: 200 len: 806 time: 0.1786015 May 12 15:49:02.203410 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-66a1731b-2c0c-4bc6-99c6-5fb91f07546c tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/quotas/1151aa532835463f914c578c906281f8 HTTP/1.1" status: 200 len: 375 time: 0.0173142 May 12 15:49:02.255667 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ae759da5-88a0-4fab-a684-7cbbd3c4318a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:02.264078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-e68e59e8-e249-478c-a7ca-363fd2161b9a req-67df48a9-9ecc-4ee1-aec7-9cb4ae6bb67a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Calling delete_port for e2437d02-b992-47e4-8d72-0a2dde082069 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:49:02.293599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-f3cb7370-1978-4e5f-b98e-9440b3922b50 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Synchronizing usage tracker for tenant:1151aa532835463f914c578c906281f8 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:49:02.314925 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-f3cb7370-1978-4e5f-b98e-9440b3922b50 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Unset dirty status for tenant:1151aa532835463f914c578c906281f8 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:49:02.316359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-f3cb7370-1978-4e5f-b98e-9440b3922b50 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=1151aa532835463f914c578c906281f8&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1121345 May 12 15:49:02.434689 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e68e59e8-e249-478c-a7ca-363fd2161b9a req-67df48a9-9ecc-4ee1-aec7-9cb4ae6bb67a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:02.447559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['e2437d02-b992-47e4-8d72-0a2dde082069'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:49:02.464820 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-4aeebfdb-33c1-4e92-97fa-6dfa505253c0 service neutron] 10.222.0.82 "GET /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1358781 May 12 15:49:02.490343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67df48a9-9ecc-4ee1-aec7-9cb4ae6bb67a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event deleted for resources: {'Port': ['ID=e2437d02-b992-47e4-8d72-0a2dde082069,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:02.565218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-e68e59e8-e249-478c-a7ca-363fd2161b9a req-67df48a9-9ecc-4ee1-aec7-9cb4ae6bb67a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] No DVR routers for this DVR port e2437d02-b992-47e4-8d72-0a2dde082069 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:49:02.567853 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e68e59e8-e249-478c-a7ca-363fd2161b9a req-67df48a9-9ecc-4ee1-aec7-9cb4ae6bb67a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:02.570465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b5508855-5e88-4ff1-8ed9-b3df18a0ae70', 'name': 'network-vif-deleted', 'tag': 'e2437d02-b992-47e4-8d72-0a2dde082069'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:49:02.592460 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e68e59e8-e249-478c-a7ca-363fd2161b9a req-67df48a9-9ecc-4ee1-aec7-9cb4ae6bb67a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "DELETE /v2.0/ports/e2437d02-b992-47e4-8d72-0a2dde082069 HTTP/1.1" status: 204 len: 173 time: 0.8642063 May 12 15:49:02.611023 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:02.629741 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-ea293b4b-0e36-447b-8c87-2af82a77230e service neutron] 10.222.0.82 "GET /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1573577 May 12 15:49:02.646908 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-40ae4d44-4004-4529-9cf7-6abb6dfecb41'] response: {'server_uuid': 'b5508855-5e88-4ff1-8ed9-b3df18a0ae70', 'name': 'network-vif-deleted', 'tag': 'e2437d02-b992-47e4-8d72-0a2dde082069', 'status': 'completed', 'code': 200} May 12 15:49:02.869418 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0f446569-90b0-468a-bdb8-1c6e6b9d542a req-fdb76273-9b49-459e-be59-fa1d675896fb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 210 time: 0.0507419 May 12 15:49:03.135907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a3fbd60-5486-46a1-b398-e36b0ed283e9 req-eedfc301-cc3e-45c9-8f84-915182a5686e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b5508855-5e88-4ff1-8ed9-b3df18a0ae70 HTTP/1.1" status: 200 len: 210 time: 0.0692675 May 12 15:49:03.442768 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Sync routers for ids ['c9ffb090-c018-46fd-a6c1-d125c7c07e18'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:49:03.453943 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Routers {'c9ffb090-c018-46fd-a6c1-d125c7c07e18'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:49:03.454879 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c9ffb090-c018-46fd-a6c1-d125c7c07e18'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:49:03.649990 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Set router c9ffb090-c018-46fd-a6c1-d125c7c07e18 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:49:03.791573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ae759da5-88a0-4fab-a684-7cbbd3c4318a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:49:03.864290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ae759da5-88a0-4fab-a684-7cbbd3c4318a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:49:03.864665 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:03.987732 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'name': 'tempest-TestServerBasicOps-1422217319-router', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.200'}], 'enable_snat': True}, 'gw_port_id': 'ae759da5-88a0-4fab-a684-7cbbd3c4318a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:54Z', 'updated_at': '2022-05-12T15:48:58Z', 'revision_number': 4, 'project_id': '7693fc7953154378987fe7c2935363e5', 'gw_port': {'id': 'ae759da5-88a0-4fab-a684-7cbbd3c4318a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:33:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4029, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:55Z', 'updated_at': '2022-05-12T15:49:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0', 'name': '', 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'mac_address': 'fa:16:3e:8a:fc:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'device_owner': 'network:router_interface', 'standard_attr_id': 4030, 'fixed_ips': [{'subnet_id': '4eed5e42-a620-43a1-98e4-71cecbfe4f0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:58Z', 'updated_at': '2022-05-12T15:48:58Z', 'revision_number': 2, 'project_id': '7693fc7953154378987fe7c2935363e5', 'subnets': [{'id': '4eed5e42-a620-43a1-98e4-71cecbfe4f0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:49:03.995286 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Checking router: c9ffb090-c018-46fd-a6c1-d125c7c07e18 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:49:03.995633 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Updating router c9ffb090-c018-46fd-a6c1-d125c7c07e18 port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:49:04.031678 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d3f4a0a5-d673-4d14-8801-64b8e3903f61 req-c1bd9be0-6fdd-478d-b001-de2046c05c08 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 210 time: 0.0499945 May 12 15:49:04.050943 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:04.475765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-6ee01a9a-3590-4d41-9ede-db1b2e288c35 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:04.477492 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-6ee01a9a-3590-4d41-9ede-db1b2e288c35 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.84 "GET /v2.0/networks?id=b6bf3355-4481-47dd-96cc-1e4a6e5445a3 HTTP/1.1" status: 200 len: 806 time: 0.1846538 May 12 15:49:04.552227 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-1772d593-5465-4092-a2e8-4f999ebefc0f tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1151aa532835463f914c578c906281f8 HTTP/1.1" status: 200 len: 380 time: 0.0581968 May 12 15:49:04.564702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Request body: {'port': {'device_id': '78ab9ae1-0c08-4baf-bd69-47cce23548a7', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'admin_state_up': True, 'tenant_id': '1151aa532835463f914c578c906281f8', 'security_groups': ['70ee9218-9856-4d3d-b5da-e401c11c7db5']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:49:04.577005 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:04.588859 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Transition to ACTIVE for port object 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:49:04.596916 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:04.730277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:49:04.735927 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce4fc0a8-139c-4e44-80da-f383d21401b6 None None] Pushing event updated for resources: {'Port': ['ID=4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:04.742084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:49:04.755257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Made reservation on behalf of 1151aa532835463f914c578c906281f8 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:49:04.759467 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:04.833051 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Attempting to bind port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:49:04.834473 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Attempting to bind port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '323fc110-5525-47d9-b44e-a0080f2b820d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:49:04.837193 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Attempting to bind port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 on network 771e7061-f52a-45e5-8c9e-e38333bdca6c {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:49:04.849311 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:49:04.849738 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Checking segment: {'id': '323fc110-5525-47d9-b44e-a0080f2b820d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:49:04.850301 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:04.850688 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Bound using segment: {'id': '323fc110-5525-47d9-b44e-a0080f2b820d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:49:04.851158 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Bound port: 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '323fc110-5525-47d9-b44e-a0080f2b820d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 598, 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:49:04.851704 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:04.943857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Allocated IP 172.20.0.4 (b6bf3355-4481-47dd-96cc-1e4a6e5445a3/a6a2c883-c889-4a5d-b880-b94c7f7dbeff/e16d3d05-585a-4be8-8c6c-1b6d2aa8467b) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:49:04.959504 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] For port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:49:04.963271 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] For port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0,segment=NetworkSegment(323fc110-5525-47d9-b44e-a0080f2b820d),segment_id=323fc110-5525-47d9-b44e-a0080f2b820d)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:49:04.967980 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:05.049459 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Routers {'c9ffb090-c018-46fd-a6c1-d125c7c07e18'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:49:05.050175 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:48:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c9ffb090-c018-46fd-a6c1-d125c7c07e18'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:49:05.151358 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce4fc0a8-139c-4e44-80da-f383d21401b6 None None] Pushing event updated for resources: {'Port': ['ID=4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:05.188687 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:05.206204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Transition to ACTIVE for port object e16d3d05-585a-4be8-8c6c-1b6d2aa8467b will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:49:05.270362 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] Set router c9ffb090-c018-46fd-a6c1-d125c7c07e18 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:49:05.281778 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5cea5e8-67cd-4de1-a970-f195cd538229 req-49c51b97-579c-4dc6-b449-d0772a9cfc8a tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 210 time: 0.0594742 May 12 15:49:05.310332 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:05.383630 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:49:05.386750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:49:05.391568 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:49:05.438935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Pushing event updated for resources: {'Port': ['ID=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:05.466873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:05.468425 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:05.518544 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-b3088262-676c-4f7c-896a-2ade937af58d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9435101 May 12 15:49:05.633596 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'name': 'tempest-TestServerBasicOps-1422217319-router', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.200'}], 'enable_snat': True}, 'gw_port_id': 'ae759da5-88a0-4fab-a684-7cbbd3c4318a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:54Z', 'updated_at': '2022-05-12T15:48:58Z', 'revision_number': 4, 'project_id': '7693fc7953154378987fe7c2935363e5', 'gw_port': {'id': 'ae759da5-88a0-4fab-a684-7cbbd3c4318a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:33:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4029, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:55Z', 'updated_at': '2022-05-12T15:49:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0', 'name': '', 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'mac_address': 'fa:16:3e:8a:fc:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'device_owner': 'network:router_interface', 'standard_attr_id': 4030, 'fixed_ips': [{'subnet_id': '4eed5e42-a620-43a1-98e4-71cecbfe4f0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:58Z', 'updated_at': '2022-05-12T15:49:04Z', 'revision_number': 4, 'project_id': '7693fc7953154378987fe7c2935363e5', 'subnets': [{'id': '4eed5e42-a620-43a1-98e4-71cecbfe4f0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:49:05.639060 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f8818c4-7faa-47e4-81a9-3ed1d231e38f None None] The sync data for ids ['c9ffb090-c018-46fd-a6c1-d125c7c07e18'] in n-d-841483-1 is: [{'id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'name': 'tempest-TestServerBasicOps-1422217319-router', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.200'}], 'enable_snat': True}, 'gw_port_id': 'ae759da5-88a0-4fab-a684-7cbbd3c4318a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:54Z', 'updated_at': '2022-05-12T15:48:58Z', 'revision_number': 4, 'project_id': '7693fc7953154378987fe7c2935363e5', 'gw_port': {'id': 'ae759da5-88a0-4fab-a684-7cbbd3c4318a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:33:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4029, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:55Z', 'updated_at': '2022-05-12T15:49:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0', 'name': '', 'network_id': '771e7061-f52a-45e5-8c9e-e38333bdca6c', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'mac_address': 'fa:16:3e:8a:fc:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'device_owner': 'network:router_interface', 'standard_attr_id': 4030, 'fixed_ips': [{'subnet_id': '4eed5e42-a620-43a1-98e4-71cecbfe4f0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:58Z', 'updated_at': '2022-05-12T15:49:04Z', 'revision_number': 4, 'project_id': '7693fc7953154378987fe7c2935363e5', 'subnets': [{'id': '4eed5e42-a620-43a1-98e4-71cecbfe4f0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:49:05.672119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Request body: {'port': {'device_id': '78ab9ae1-0c08-4baf-bd69-47cce23548a7', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:49:05.772819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f57972c3-39fd-4151-93e3-b2e961ad9a9a None None] Provisioning for port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:49:05.778588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f57972c3-39fd-4151-93e3-b2e961ad9a9a None None] Provisioning complete for port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:49:05.779546 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f57972c3-39fd-4151-93e3-b2e961ad9a9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:05.809924 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:05.852264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:49:05.926222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f57972c3-39fd-4151-93e3-b2e961ad9a9a None None] Port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:49:05.947664 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e2437d02-b992-47e4-8d72-0a2dde082069 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:49:05.987414 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:49:06.001146 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: e2437d02-b992-47e4-8d72-0a2dde082069 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:49:06.001951 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device e2437d02-b992-47e4-8d72-0a2dde082069 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:49:06.009471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:49:06.009860 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:06.144916 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:06.189431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0,segment=NetworkSegment(323fc110-5525-47d9-b44e-a0080f2b820d),segment_id=323fc110-5525-47d9-b44e-a0080f2b820d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:06.189431 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:06.279809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:06.328736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e16d3d05-585a-4be8-8c6c-1b6d2aa8467b {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:49:06.337534 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:06.354774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Transition to ACTIVE for port object e16d3d05-585a-4be8-8c6c-1b6d2aa8467b will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:49:06.359369 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:06.552602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Pushing event updated for resources: {'Port': ['ID=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:06.693715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c0aa13-5c83-447d-9001-31de0089fff3 req-79d0ce7e-afe2-459f-b795-7d8fc30af98d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:06.694410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-81c0aa13-5c83-447d-9001-31de0089fff3 req-79d0ce7e-afe2-459f-b795-7d8fc30af98d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Synchronizing usage tracker for tenant:1151aa532835463f914c578c906281f8 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:49:06.701056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Attempting to bind port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:49:06.701469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Attempting to bind port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:49:06.701966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Attempting to bind port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b on network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:49:06.710294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b on network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:49:06.710645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Attempting to bind port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b on network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:49:06.718693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 48, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:49:06.719031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Checking segment: {'id': 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:49:06.719415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Bound using segment: {'id': 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:49:06.719860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Bound port: e16d3d05-585a-4be8-8c6c-1b6d2aa8467b, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:49:06.720226 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:06.736317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-81c0aa13-5c83-447d-9001-31de0089fff3 req-79d0ce7e-afe2-459f-b795-7d8fc30af98d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Unset dirty status for tenant:1151aa532835463f914c578c906281f8 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:49:06.737489 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81c0aa13-5c83-447d-9001-31de0089fff3 req-79d0ce7e-afe2-459f-b795-7d8fc30af98d tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 943 time: 0.2647529 May 12 15:49:06.858595 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81c0aa13-5c83-447d-9001-31de0089fff3 req-decfb84d-aa50-4549-a3c3-6f59a9b3e17f tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/security-groups?id=70ee9218-9856-4d3d-b5da-e401c11c7db5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1131747 May 12 15:49:06.877223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] For port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:49:06.880978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] For port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b,segment=NetworkSegment(fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76),segment_id=fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:49:06.885019 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:06.956418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:06.956977 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:06.958347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] 10.222.0.84 "PUT /v2.0/ports/e16d3d05-585a-4be8-8c6c-1b6d2aa8467b HTTP/1.1" status: 200 len: 1091 time: 1.4363379 May 12 15:49:06.958801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '78ab9ae1-0c08-4baf-bd69-47cce23548a7', 'tag': 'e16d3d05-585a-4be8-8c6c-1b6d2aa8467b'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:49:07.006243 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd87e0e4-cac0-4a97-8a9e-49c130365c4e service neutron] Pushing event updated for resources: {'Port': ['ID=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:07.118118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-1ba5584c-ff98-4765-a89e-a194fc5b57a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:07.120988 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-1ba5584c-ff98-4765-a89e-a194fc5b57a8 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1151aa532835463f914c578c906281f8&device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 1094 time: 0.0876544 May 12 15:49:07.200225 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-963c5ed8-981c-44bc-80a9-c9923fb7528f'] response: {'name': 'network-changed', 'server_uuid': '78ab9ae1-0c08-4baf-bd69-47cce23548a7', 'tag': 'e16d3d05-585a-4be8-8c6c-1b6d2aa8467b', 'status': 'completed', 'code': 200} May 12 15:49:07.212807 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-8fb99c1f-85cf-46b7-b611-0992be5a4494 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b HTTP/1.1" status: 200 len: 217 time: 0.0740957 May 12 15:49:07.286340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-ed720da3-edc4-4c53-89af-2d88c5431938 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:07.287924 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-ed720da3-edc4-4c53-89af-2d88c5431938 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=a6a2c883-c889-4a5d-b880-b94c7f7dbeff HTTP/1.1" status: 200 len: 845 time: 0.0676336 May 12 15:49:07.373175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-907912f4-f7cc-4ed5-9fba-2682b308b341 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:07.375142 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-907912f4-f7cc-4ed5-9fba-2682b308b341 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b6bf3355-4481-47dd-96cc-1e4a6e5445a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0809646 May 12 15:49:07.533263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-00e6250e-3f28-47c3-a73d-972eb03dfb7d service neutron] 10.222.0.84 "GET /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1509001 May 12 15:49:07.679254 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d9a32ebb-5676-47e7-b3fe-830f9c789a92 req-9aa5e047-ba0d-47b4-81d0-dd586264c776 service neutron] 10.222.0.84 "GET /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1372876 May 12 15:49:07.790714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:49:07.852198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64e43bd5-4941-44a6-9339-2020acb2091f req-be58c6d7-4da1-411e-8e6f-764653396ece service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:07.853897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64e43bd5-4941-44a6-9339-2020acb2091f req-be58c6d7-4da1-411e-8e6f-764653396ece service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1151aa532835463f914c578c906281f8&device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 1094 time: 0.0843921 May 12 15:49:07.863748 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:49:07.864473 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:08.175927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64e43bd5-4941-44a6-9339-2020acb2091f req-4cf73b9e-8222-49a6-ae76-a98eff38c7e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:08.177290 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64e43bd5-4941-44a6-9339-2020acb2091f req-4cf73b9e-8222-49a6-ae76-a98eff38c7e6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=b6bf3355-4481-47dd-96cc-1e4a6e5445a3 HTTP/1.1" status: 200 len: 907 time: 0.3167198 May 12 15:49:08.194844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67416c0c-4040-4266-91aa-7dc5ad05db8f req-55fb5f8a-ac77-4749-8ea6-1d45216026b1 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:08.196289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67416c0c-4040-4266-91aa-7dc5ad05db8f req-55fb5f8a-ac77-4749-8ea6-1d45216026b1 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 943 time: 0.1329777 May 12 15:49:08.275055 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64e43bd5-4941-44a6-9339-2020acb2091f req-a413c3ef-9231-498a-8e6e-53564c8d969b service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b HTTP/1.1" status: 200 len: 217 time: 0.0778134 May 12 15:49:08.355910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67416c0c-4040-4266-91aa-7dc5ad05db8f req-0d8f85cd-0e33-40ca-9a9f-377fcb388d64 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/security-groups?id=70ee9218-9856-4d3d-b5da-e401c11c7db5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1098473 May 12 15:49:08.367416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64e43bd5-4941-44a6-9339-2020acb2091f req-a8e3d328-40d5-43cc-8dc6-ec465d12e2cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:08.368829 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64e43bd5-4941-44a6-9339-2020acb2091f req-a8e3d328-40d5-43cc-8dc6-ec465d12e2cb service neutron] 10.222.0.84 "GET /v2.0/subnets?id=a6a2c883-c889-4a5d-b880-b94c7f7dbeff HTTP/1.1" status: 200 len: 845 time: 0.0867240 May 12 15:49:08.448348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64e43bd5-4941-44a6-9339-2020acb2091f req-2c157905-3eb3-4b53-9704-b28568ba9402 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:08.449894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64e43bd5-4941-44a6-9339-2020acb2091f req-2c157905-3eb3-4b53-9704-b28568ba9402 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b6bf3355-4481-47dd-96cc-1e4a6e5445a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0734556 May 12 15:49:08.592807 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64e43bd5-4941-44a6-9339-2020acb2091f req-afe053b3-09dd-45f6-9468-dd754d3a0444 service neutron] 10.222.0.84 "GET /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1361518 May 12 15:49:08.740670 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64e43bd5-4941-44a6-9339-2020acb2091f req-dbc843d5-60bf-4f4b-8f4d-03f44b0bbc56 service neutron] 10.222.0.84 "GET /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1416276 May 12 15:49:09.551853 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ea175b-0ae1-473d-83c5-6a2bcc4a0109 req-782e204a-3312-41fa-a519-853b56748b18 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:09.553348 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1ea175b-0ae1-473d-83c5-6a2bcc4a0109 req-782e204a-3312-41fa-a519-853b56748b18 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 943 time: 0.0879424 May 12 15:49:09.605589 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1ea175b-0ae1-473d-83c5-6a2bcc4a0109 req-a4ee28a6-fb86-476b-9609-740408f13a37 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/security-groups?id=70ee9218-9856-4d3d-b5da-e401c11c7db5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408244 May 12 15:49:10.310908 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c5de305d-b252-42df-bec0-049cfca501aa req-c67784c4-e7a6-4e16-a337-95a66e55fa7e service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0446627 May 12 15:49:10.380921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e16d3d05-585a-4be8-8c6c-1b6d2aa8467b details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:49:10.441745 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c5de305d-b252-42df-bec0-049cfca501aa req-4e4f5acb-1552-415b-b18e-92bb6954e863 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0468204 May 12 15:49:10.487502 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c5de305d-b252-42df-bec0-049cfca501aa req-98465238-88b5-4330-a8d2-87576d0bfce8 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0263901 May 12 15:49:10.541720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b,segment=NetworkSegment(fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76),segment_id=fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:10.560737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'e16d3d05-585a-4be8-8c6c-1b6d2aa8467b', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'port_id': 'e16d3d05-585a-4be8-8c6c-1b6d2aa8467b', 'mac_address': 'fa:16:3e:c5:fb:2a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 562, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:49:10.626108 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:10.639619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5de305d-b252-42df-bec0-049cfca501aa req-e1f61db4-aad6-4bc7-8c09-bbf3839a424c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:10.644596 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c5de305d-b252-42df-bec0-049cfca501aa req-e1f61db4-aad6-4bc7-8c09-bbf3839a424c service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1508486 May 12 15:49:10.646168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e16d3d05-585a-4be8-8c6c-1b6d2aa8467b {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:49:10.663018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b,segment=NetworkSegment(fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76),segment_id=fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:10.667523 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:10.751512 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:10.846360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7893908b-5e82-445d-ae38-bd32e6cb0fac req-99d317f1-dd70-4d27-a8b0-d9617c0fa9b4 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:10.847908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7893908b-5e82-445d-ae38-bd32e6cb0fac req-99d317f1-dd70-4d27-a8b0-d9617c0fa9b4 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 944 time: 0.1121910 May 12 15:49:10.894261 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7893908b-5e82-445d-ae38-bd32e6cb0fac req-de8c415e-cb70-4c2d-9114-3e2a6e8047b8 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/security-groups?id=70ee9218-9856-4d3d-b5da-e401c11c7db5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405159 May 12 15:49:10.971146 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['e16d3d05-585a-4be8-8c6c-1b6d2aa8467b'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:49:12.090763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b94f9dd-0535-4b5d-a8a5-59e53e949b43 req-37bb0613-04e3-41d1-90eb-d71bcfc2ec75 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:12.092257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b94f9dd-0535-4b5d-a8a5-59e53e949b43 req-37bb0613-04e3-41d1-90eb-d71bcfc2ec75 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 944 time: 0.0900578 May 12 15:49:12.138065 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b94f9dd-0535-4b5d-a8a5-59e53e949b43 req-e6ef6f64-8386-4fd1-b665-f61203ba41c9 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/security-groups?id=70ee9218-9856-4d3d-b5da-e401c11c7db5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392475 May 12 15:49:12.376512 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e16d3d05-585a-4be8-8c6c-1b6d2aa8467b up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:49:12.448485 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:49:12.453227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:49:12.453623 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:12.604036 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:12.632327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78ab9ae1-0c08-4baf-bd69-47cce23548a7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e16d3d05-585a-4be8-8c6c-1b6d2aa8467b'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:49:12.642741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b,segment=NetworkSegment(fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76),segment_id=fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:12.648781 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:12.684088 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4ab254ab-62b5-408f-bf1a-a04660ad5e4c'] response: {'server_uuid': '78ab9ae1-0c08-4baf-bd69-47cce23548a7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e16d3d05-585a-4be8-8c6c-1b6d2aa8467b', 'code': 200} May 12 15:49:12.724320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:12.760603 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-70d40dc1-fd11-4d60-beb7-2ee89efd8581 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:12.846565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-580f0ef8-74a2-4f2b-b0f7-93d8b5137ce7 req-a30466ad-490b-445a-a06c-553e5d94b145 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:12.848063 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-580f0ef8-74a2-4f2b-b0f7-93d8b5137ce7 req-a30466ad-490b-445a-a06c-553e5d94b145 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 1096 time: 0.0731363 May 12 15:49:12.904532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-580f0ef8-74a2-4f2b-b0f7-93d8b5137ce7 req-90d331ee-17fa-496b-966b-337e1c66c89e service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=70ee9218-9856-4d3d-b5da-e401c11c7db5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495212 May 12 15:49:13.331089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f1ee9be-ca8b-4194-9953-b160985d46d2 req-e60735b4-42b1-4e2e-a8bf-dc692c81a4a6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:13.332809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8f1ee9be-ca8b-4194-9953-b160985d46d2 req-e60735b4-42b1-4e2e-a8bf-dc692c81a4a6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 945 time: 0.0862586 May 12 15:49:13.351372 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:13.385153 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8f1ee9be-ca8b-4194-9953-b160985d46d2 req-96de9b56-5988-4fa4-9992-035637d67865 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/security-groups?id=70ee9218-9856-4d3d-b5da-e401c11c7db5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463543 May 12 15:49:14.582465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cdc3bd0-4aea-4689-a723-0c1eec5a0e27 req-d17f18b0-0cec-4029-a86d-bc5316681b10 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:14.583887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2cdc3bd0-4aea-4689-a723-0c1eec5a0e27 req-d17f18b0-0cec-4029-a86d-bc5316681b10 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 945 time: 0.0898254 May 12 15:49:14.629076 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2cdc3bd0-4aea-4689-a723-0c1eec5a0e27 req-6f8417b2-bd3e-48c1-b47b-0aee5707746b tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/security-groups?id=70ee9218-9856-4d3d-b5da-e401c11c7db5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395396 May 12 15:49:14.820230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992310a7-6441-4d78-aabc-528f0491e607 req-774d3946-76e7-43f1-989e-6a8cb463e000 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:14.821739 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-992310a7-6441-4d78-aabc-528f0491e607 req-774d3946-76e7-43f1-989e-6a8cb463e000 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 945 time: 0.0819416 May 12 15:49:14.870963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-992310a7-6441-4d78-aabc-528f0491e607 req-dfaf669c-bf1a-4318-97f2-268544e26200 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/security-groups?id=70ee9218-9856-4d3d-b5da-e401c11c7db5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411210 May 12 15:49:15.079992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bff3f034-a721-4515-bf8f-ed3e8c05384d req-7c1c3671-636f-456b-b6aa-39e518e181aa tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:15.081499 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bff3f034-a721-4515-bf8f-ed3e8c05384d req-7c1c3671-636f-456b-b6aa-39e518e181aa tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 945 time: 0.0873027 May 12 15:49:15.139152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bff3f034-a721-4515-bf8f-ed3e8c05384d req-ead45589-efe9-42ff-ac27-ae76fddc7ffe tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/security-groups?id=70ee9218-9856-4d3d-b5da-e401c11c7db5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486562 May 12 15:49:15.159235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 49784) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:49:15.278615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6766050-7e55-42df-85c7-73fa7d234e10 tempest-TestServerBasicOps-796277407 tempest-TestServerBasicOps-796277407-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:15.280199 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e6766050-7e55-42df-85c7-73fa7d234e10 tempest-TestServerBasicOps-796277407 tempest-TestServerBasicOps-796277407-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 1091 time: 0.1198988 May 12 15:49:15.283190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49790) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:49:15.289441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': 'e16d3d05-585a-4be8-8c6c-1b6d2aa8467b', 'tenant_id': '1151aa532835463f914c578c906281f8', 'fixed_ip_address': '172.20.0.4'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:49:15.299781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:49:15.305336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Usage tracker for resource:floatingip and tenant:1151aa532835463f914c578c906281f8 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:49:15.308983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:49:15.310058 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bda26c3a-ba49-482b-9979-40c836d0a19a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:15.325961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:49:15.339103 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:15.595873 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:15.751789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Allocated IP 172.25.8.105 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/ade5b4cd-2598-48c4-9497-add06ed7197f) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:49:15.920838 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:15.952989 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:16.023090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:49:16.025916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:49:16.030328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:49:16.054756 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:16.062718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Pushing event updated for resources: {'Port': ['ID=ade5b4cd-2598-48c4-9497-add06ed7197f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:16.081664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:16.082001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:16.082334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:16.082661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:16.082983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:16.083311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:16.083632 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:16.083948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:16.084259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:16.084578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:16.084893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:16.085205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:16.273429 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:16.490152 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:16.565035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:16.788784 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:16.824460 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:16.934197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Pushing event updated for resources: {'Port': ['ID=ade5b4cd-2598-48c4-9497-add06ed7197f,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:16.946603 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:17.120431 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Floating IP 0ccdedb9-fd11-4353-8664-0287183b82b0 associated. External IP: 172.25.8.105, port: e16d3d05-585a-4be8-8c6c-1b6d2aa8467b. May 12 15:49:17.597612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:49:17.756867 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:17.784059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:49:17.796276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06acb8d3-2bbc-4b90-aba7-ea0b687e51ca None None] Sync routers for ids ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:49:17.806630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06acb8d3-2bbc-4b90-aba7-ea0b687e51ca None None] Routers {'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:49:17.807518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-06acb8d3-2bbc-4b90-aba7-ea0b687e51ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:49:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:49:17.812279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:17.869429 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ffaaf00-d036-430e-afb4-4b13dd692742 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5843706 May 12 15:49:17.870011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '78ab9ae1-0c08-4baf-bd69-47cce23548a7', 'tag': 'e16d3d05-585a-4be8-8c6c-1b6d2aa8467b'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:49:17.980918 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-61002131-4441-4390-90e3-66ead091b921'] response: {'name': 'network-changed', 'server_uuid': '78ab9ae1-0c08-4baf-bd69-47cce23548a7', 'tag': 'e16d3d05-585a-4be8-8c6c-1b6d2aa8467b', 'status': 'completed', 'code': 200} May 12 15:49:17.994075 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-06acb8d3-2bbc-4b90-aba7-ea0b687e51ca None None] Set router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:49:18.111137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10872b21-735f-4b54-9999-44724f890bba req-ce54c5d5-b62a-466e-9724-21727eb86f4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:18.112505 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10872b21-735f-4b54-9999-44724f890bba req-ce54c5d5-b62a-466e-9724-21727eb86f4e service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1151aa532835463f914c578c906281f8&device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 1096 time: 0.0847118 May 12 15:49:18.379809 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-06acb8d3-2bbc-4b90-aba7-ea0b687e51ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:51Z', 'revision_number': 4, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '0ccdedb9-fd11-4353-8664-0287183b82b0', 'tenant_id': '1151aa532835463f914c578c906281f8', 'floating_ip_address': '172.25.8.105', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'port_id': 'e16d3d05-585a-4be8-8c6c-1b6d2aa8467b', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4042, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'mac_address': 'fa:16:3e:c5:fb:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78ab9ae1-0c08-4baf-bd69-47cce23548a7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:49:16Z', 'updated_at': '2022-05-12T15:49:16Z', 'revision_number': 0, 'project_id': '1151aa532835463f914c578c906281f8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b8ff0404-7287-4829-8582-deec91c98f44', 'name': '', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'tenant_id': '1151aa532835463f914c578c906281f8', 'mac_address': 'fa:16:3e:af:ee:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_interface', 'standard_attr_id': 4018, 'fixed_ips': [{'subnet_id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:50Z', 'updated_at': '2022-05-12T15:48:56Z', 'revision_number': 5, 'project_id': '1151aa532835463f914c578c906281f8', 'subnets': [{'id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:49:18.384267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06acb8d3-2bbc-4b90-aba7-ea0b687e51ca None None] Checking router: dd5e48e9-bffc-4a41-8d4c-ca99803fdfad for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:49:18.393885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06acb8d3-2bbc-4b90-aba7-ea0b687e51ca None None] Routers {'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:49:18.394018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10872b21-735f-4b54-9999-44724f890bba req-c7efa14f-e473-4baa-aec5-a532d2ac253c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:18.394636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-06acb8d3-2bbc-4b90-aba7-ea0b687e51ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:49:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:49:18.395581 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10872b21-735f-4b54-9999-44724f890bba req-c7efa14f-e473-4baa-aec5-a532d2ac253c service neutron] 10.222.0.84 "GET /v2.0/networks?id=b6bf3355-4481-47dd-96cc-1e4a6e5445a3 HTTP/1.1" status: 200 len: 907 time: 0.2768688 May 12 15:49:18.504996 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10872b21-735f-4b54-9999-44724f890bba req-ce19dba2-ee9e-49ec-9fc9-a7e4669b5fb6 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b HTTP/1.1" status: 200 len: 999 time: 0.1020193 May 12 15:49:18.569536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10872b21-735f-4b54-9999-44724f890bba req-47182148-37b0-428a-baaf-8feb99941ab2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:18.571545 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10872b21-735f-4b54-9999-44724f890bba req-47182148-37b0-428a-baaf-8feb99941ab2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=a6a2c883-c889-4a5d-b880-b94c7f7dbeff HTTP/1.1" status: 200 len: 845 time: 0.0589821 May 12 15:49:18.581787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-06acb8d3-2bbc-4b90-aba7-ea0b687e51ca None None] Set router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:49:18.653507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10872b21-735f-4b54-9999-44724f890bba req-aec80b35-bc59-4c8a-9071-d74b697a7580 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:18.654888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10872b21-735f-4b54-9999-44724f890bba req-aec80b35-bc59-4c8a-9071-d74b697a7580 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b6bf3355-4481-47dd-96cc-1e4a6e5445a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0779412 May 12 15:49:18.803552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10872b21-735f-4b54-9999-44724f890bba req-d0977ed4-94da-4bc5-839d-0b562671ac55 service neutron] 10.222.0.84 "GET /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1326194 May 12 15:49:18.944786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10872b21-735f-4b54-9999-44724f890bba req-cb97112e-4ef5-4c6b-88b7-55a449fc5777 service neutron] 10.222.0.84 "GET /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1347923 May 12 15:49:18.952095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-06acb8d3-2bbc-4b90-aba7-ea0b687e51ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:51Z', 'revision_number': 4, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '0ccdedb9-fd11-4353-8664-0287183b82b0', 'tenant_id': '1151aa532835463f914c578c906281f8', 'floating_ip_address': '172.25.8.105', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'port_id': 'e16d3d05-585a-4be8-8c6c-1b6d2aa8467b', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4042, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'mac_address': 'fa:16:3e:c5:fb:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78ab9ae1-0c08-4baf-bd69-47cce23548a7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:49:16Z', 'updated_at': '2022-05-12T15:49:16Z', 'revision_number': 0, 'project_id': '1151aa532835463f914c578c906281f8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b8ff0404-7287-4829-8582-deec91c98f44', 'name': '', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'tenant_id': '1151aa532835463f914c578c906281f8', 'mac_address': 'fa:16:3e:af:ee:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_interface', 'standard_attr_id': 4018, 'fixed_ips': [{'subnet_id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:50Z', 'updated_at': '2022-05-12T15:48:56Z', 'revision_number': 5, 'project_id': '1151aa532835463f914c578c906281f8', 'subnets': [{'id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:49:18.956088 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06acb8d3-2bbc-4b90-aba7-ea0b687e51ca None None] The sync data for ids ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'] in n-d-841483-1 is: [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:51Z', 'revision_number': 4, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '0ccdedb9-fd11-4353-8664-0287183b82b0', 'tenant_id': '1151aa532835463f914c578c906281f8', 'floating_ip_address': '172.25.8.105', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'port_id': 'e16d3d05-585a-4be8-8c6c-1b6d2aa8467b', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4042, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'mac_address': 'fa:16:3e:c5:fb:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78ab9ae1-0c08-4baf-bd69-47cce23548a7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:49:16Z', 'updated_at': '2022-05-12T15:49:16Z', 'revision_number': 0, 'project_id': '1151aa532835463f914c578c906281f8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b8ff0404-7287-4829-8582-deec91c98f44', 'name': '', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'tenant_id': '1151aa532835463f914c578c906281f8', 'mac_address': 'fa:16:3e:af:ee:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_interface', 'standard_attr_id': 4018, 'fixed_ips': [{'subnet_id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:50Z', 'updated_at': '2022-05-12T15:48:56Z', 'revision_number': 5, 'project_id': '1151aa532835463f914c578c906281f8', 'subnets': [{'id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:49:19.146420 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b5e3d7c-04d5-45b6-b685-889b3afce0b9 None None] New status for floating IP 0ccdedb9-fd11-4353-8664-0287183b82b0: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:49:22.842777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc90b180-489d-44c5-af06-eb06aef7ad9a req-26e3cd4b-431f-43fb-97d3-a89dc68561a1 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:22.844292 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc90b180-489d-44c5-af06-eb06aef7ad9a req-26e3cd4b-431f-43fb-97d3-a89dc68561a1 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1096 time: 0.1289930 May 12 15:49:22.887520 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc90b180-489d-44c5-af06-eb06aef7ad9a req-e50f21b9-0a09-4458-bc34-d60056269e3c tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374415 May 12 15:49:23.217290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d237267-badd-46e9-b745-c59cd512def3 req-49f6e647-65e0-44ce-8ce6-184f67fe14eb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:23.220579 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d237267-badd-46e9-b745-c59cd512def3 req-49f6e647-65e0-44ce-8ce6-184f67fe14eb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.1984928 May 12 15:49:23.271015 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d237267-badd-46e9-b745-c59cd512def3 req-4ed23115-0116-4bc6-a65c-23d4e00d0ac0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465798 May 12 15:49:23.298913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 49856) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:49:23.406736 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-51c4b21a-7840-43f4-894f-0318aa9c672e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/553c2d8d-aaa2-4f71-b736-7b6255f73611 HTTP/1.1" status: 200 len: 993 time: 0.1063697 May 12 15:49:24.159214 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-7361b662-8aa2-4172-84d2-521fe45dda2b service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1316662 May 12 15:49:24.181880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0293777-3d3d-48ed-a9f7-265f9821be00 req-39cbdb60-5e40-4faa-9397-366dc8a3744d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:24.183672 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b0293777-3d3d-48ed-a9f7-265f9821be00 req-39cbdb60-5e40-4faa-9397-366dc8a3744d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.1006989 May 12 15:49:24.245561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b0293777-3d3d-48ed-a9f7-265f9821be00 req-f187e99a-c07b-4aba-a21a-d4dad865faca tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0541823 May 12 15:49:24.621541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-8ae7ac34-8467-47db-9474-021379407ddc tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:24.622965 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-8ae7ac34-8467-47db-9474-021379407ddc tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 812 time: 0.1464627 May 12 15:49:24.638365 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-64fa3707-3698-44a5-bc8d-fb89ebaa7b23 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/quotas/939000b7f70c4c85a39e52ee93a06ed5 HTTP/1.1" status: 200 len: 375 time: 0.0095096 May 12 15:49:24.728722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-bbd8a8b4-e03f-4fed-a296-891a9dc6c41d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0847714 May 12 15:49:24.741704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-54d99d4c-0bb1-4387-9e1f-362740ab40f8 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:49:24.742746 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-54d99d4c-0bb1-4387-9e1f-362740ab40f8 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0057936 May 12 15:49:24.885895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-23c4675e-fecd-45f7-918c-e905e06f86bf service neutron] 10.222.0.82 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1373084 May 12 15:49:25.021447 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-c9506c42-fc43-4eea-b380-b6ded93f46ae service neutron] 10.222.0.82 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1296315 May 12 15:49:25.256649 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2c100f4-5eef-46a7-a5b2-a1e75837ebb2 req-b13acb31-0762-4b55-acfd-293dbfb2f8e7 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 210 time: 0.0600569 May 12 15:49:25.374888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-a64adc19-5464-4916-bbfa-c8c540dc00a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:25.376340 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-a64adc19-5464-4916-bbfa-c8c540dc00a9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1096 time: 0.0845253 May 12 15:49:25.690153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-fe0bebd3-1b4a-44a5-a3ce-bea905f1f490 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:25.691579 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-fe0bebd3-1b4a-44a5-a3ce-bea905f1f490 service neutron] 10.222.0.84 "GET /v2.0/networks?id=2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 200 len: 898 time: 0.3085203 May 12 15:49:25.753647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fcca271-f2a4-4727-81a0-be8467dbc897 req-4949c7c7-7a52-45cd-8166-c5d0c51b419a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:25.755074 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9fcca271-f2a4-4727-81a0-be8467dbc897 req-4949c7c7-7a52-45cd-8166-c5d0c51b419a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.1803992 May 12 15:49:25.842903 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9fcca271-f2a4-4727-81a0-be8467dbc897 req-770f64de-d597-4bb8-ab7f-8bd08b631b7a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0812905 May 12 15:49:25.845017 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-98e93b4c-b355-4edb-8874-30b67282e8ec service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 1001 time: 0.1452212 May 12 15:49:25.913663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-291ad61f-749f-46a4-a241-f1dde5b8d228 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:25.915104 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-291ad61f-749f-46a4-a241-f1dde5b8d228 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae HTTP/1.1" status: 200 len: 835 time: 0.0603502 May 12 15:49:25.994407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-c81adbf3-2b49-4d8f-8070-55be77e80794 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:25.995860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-c81adbf3-2b49-4d8f-8070-55be77e80794 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2c49c390-e121-4f31-92ba-528e8cdf62dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0731347 May 12 15:49:26.140115 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-7e07f823-ba6c-466a-bc0d-aaccfe74b890 service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1292439 May 12 15:49:26.308857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d61c97ec-4de5-45a2-a84d-e0a1107e7949 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:26.310527 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d61c97ec-4de5-45a2-a84d-e0a1107e7949 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 812 time: 0.1645408 May 12 15:49:26.315007 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-b282f63d-c8f8-4b15-9a26-112ac9634ab2 service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1648450 May 12 15:49:26.329426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'port': {'device_id': 'b1ced7b7-ee2f-45a0-bce3-89119932d3dc', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'admin_state_up': True, 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:49:26.452493 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5144fb87-ce02-4cb4-9dfc-0404a0fcfd05 req-323c3aec-3f81-459e-a8c5-de041e03ede5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 210 time: 0.0527811 May 12 15:49:26.507484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:49:26.511823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:port and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:49:26.515214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:49:26.521902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:49:26.531947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Made reservation on behalf of 939000b7f70c4c85a39e52ee93a06ed5 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:49:26.535373 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:26.701301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Allocated IP 172.20.0.12 (d13f4c27-5358-4d60-abb1-0c94e69df718/020f79af-22ce-41ca-91a6-931258be2176/a75d0499-932a-4af9-bb6e-f34e6387ba0a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:49:26.914814 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:26.932572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Transition to ACTIVE for port object a75d0499-932a-4af9-bb6e-f34e6387ba0a will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:49:26.959606 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:27.042447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Network d13f4c27-5358-4d60-abb1-0c94e69df718 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:49:27.046037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:49:27.049982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:49:27.080006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10441734-0757-4215-863d-9e6f02c0d2e0 req-13f5927b-4c09-4090-94a0-9d0ac5497089 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:27.081649 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10441734-0757-4215-863d-9e6f02c0d2e0 req-13f5927b-4c09-4090-94a0-9d0ac5497089 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.1065969 May 12 15:49:27.099721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'Port': ['ID=a75d0499-932a-4af9-bb6e-f34e6387ba0a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:27.123476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:27.124210 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:27.145968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10441734-0757-4215-863d-9e6f02c0d2e0 req-7c564619-69f6-4267-8cdf-0e2881d7bd5e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0562809 May 12 15:49:27.151946 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-745e7c97-2800-4d00-8588-559f35d3039a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8266470 May 12 15:49:27.162436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Request body: {'port': {'device_id': 'b1ced7b7-ee2f-45a0-bce3-89119932d3dc', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:49:27.360594 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c8269223-944c-4e9b-ad66-d85522dc4ccd None None] Provisioning for port a75d0499-932a-4af9-bb6e-f34e6387ba0a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:49:27.366246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c8269223-944c-4e9b-ad66-d85522dc4ccd None None] Provisioning complete for port a75d0499-932a-4af9-bb6e-f34e6387ba0a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:49:27.366718 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c8269223-944c-4e9b-ad66-d85522dc4ccd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:27.412201 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:27.424295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c8269223-944c-4e9b-ad66-d85522dc4ccd None None] Port a75d0499-932a-4af9-bb6e-f34e6387ba0a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:49:27.657465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d111114-ea97-4f64-9206-b80f8a69535f req-6138399d-62fb-4996-a9d2-169138637eaf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:27.659074 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d111114-ea97-4f64-9206-b80f8a69535f req-6138399d-62fb-4996-a9d2-169138637eaf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 932 time: 0.0884032 May 12 15:49:27.714296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d111114-ea97-4f64-9206-b80f8a69535f req-cf40fbc6-a594-446e-8c1e-7d74ff54f3b6 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490301 May 12 15:49:27.801626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a75d0499-932a-4af9-bb6e-f34e6387ba0a {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:49:27.809248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:27.824461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Transition to ACTIVE for port object a75d0499-932a-4af9-bb6e-f34e6387ba0a will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:49:27.828601 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:27.962982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Pushing event updated for resources: {'Port': ['ID=a75d0499-932a-4af9-bb6e-f34e6387ba0a,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:28.068838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Attempting to bind port a75d0499-932a-4af9-bb6e-f34e6387ba0a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:49:28.069174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Attempting to bind port a75d0499-932a-4af9-bb6e-f34e6387ba0a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:49:28.069528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Attempting to bind port a75d0499-932a-4af9-bb6e-f34e6387ba0a on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:49:28.074218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Port a75d0499-932a-4af9-bb6e-f34e6387ba0a on network d13f4c27-5358-4d60-abb1-0c94e69df718 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:49:28.074536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Attempting to bind port a75d0499-932a-4af9-bb6e-f34e6387ba0a on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:49:28.080518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 49, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:49:28.080848 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Checking segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:49:28.081236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Bound using segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:49:28.081700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Bound port: a75d0499-932a-4af9-bb6e-f34e6387ba0a, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:49:28.082039 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:28.174952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] For port a75d0499-932a-4af9-bb6e-f34e6387ba0a, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:49:28.177997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] For port a75d0499-932a-4af9-bb6e-f34e6387ba0a, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a75d0499-932a-4af9-bb6e-f34e6387ba0a,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:49:28.183309 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:28.255314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:28.255909 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:28.257275 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] 10.222.0.76 "PUT /v2.0/ports/a75d0499-932a-4af9-bb6e-f34e6387ba0a HTTP/1.1" status: 200 len: 1092 time: 1.0990610 May 12 15:49:28.257728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b1ced7b7-ee2f-45a0-bce3-89119932d3dc', 'tag': 'a75d0499-932a-4af9-bb6e-f34e6387ba0a'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:49:28.304690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0630847-a60c-4bc4-95d0-2f372c51fb64 service neutron] Pushing event updated for resources: {'Port': ['ID=a75d0499-932a-4af9-bb6e-f34e6387ba0a,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:28.386776 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9b14ffd9-a79a-4dfe-817d-d71486b718d4'] response: {'name': 'network-changed', 'server_uuid': 'b1ced7b7-ee2f-45a0-bce3-89119932d3dc', 'tag': 'a75d0499-932a-4af9-bb6e-f34e6387ba0a', 'status': 'completed', 'code': 200} May 12 15:49:28.395535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-391ccf19-1d03-4263-a467-30c51d01ea27 req-8e41f140-e932-4a03-94be-eb27c3206e01 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:28.403222 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-391ccf19-1d03-4263-a467-30c51d01ea27 req-8e41f140-e932-4a03-94be-eb27c3206e01 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.1092031 May 12 15:49:28.428160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-65acf65f-1ff9-467e-91cf-859c2539103a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:28.429694 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-65acf65f-1ff9-467e-91cf-859c2539103a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 1095 time: 0.1048965 May 12 15:49:28.456627 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-391ccf19-1d03-4263-a467-30c51d01ea27 req-9165bcdd-ffcb-4e87-9d35-ff88c013f539 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520973 May 12 15:49:28.507343 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-e4ba3c26-d47a-44fd-8eec-8187d06d3751 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a75d0499-932a-4af9-bb6e-f34e6387ba0a HTTP/1.1" status: 200 len: 217 time: 0.0695517 May 12 15:49:28.572499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-4bf43f19-d6bd-41d3-ade0-18f2ed8d7d83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:28.573974 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-4bf43f19-d6bd-41d3-ade0-18f2ed8d7d83 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0612316 May 12 15:49:28.648299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-156ab5ec-5584-4a4f-8c67-064db405db89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:28.649804 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-156ab5ec-5584-4a4f-8c67-064db405db89 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0701504 May 12 15:49:28.792533 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-fbeafe6b-3296-481a-8d1c-85f8c7a592e0 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1369097 May 12 15:49:28.929955 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-88437460-d5e1-40da-8c0b-1acbaaedabff req-2569f5dd-ff67-490b-8e85-b5fadce846f6 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1314559 May 12 15:49:28.938956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3c2b7db-8595-46e9-89d6-11e1949e99e5 req-73dbfd80-3e79-4473-9bde-50731f7fd4d5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:28.941146 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3c2b7db-8595-46e9-89d6-11e1949e99e5 req-73dbfd80-3e79-4473-9bde-50731f7fd4d5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 944 time: 0.0890310 May 12 15:49:28.986902 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3c2b7db-8595-46e9-89d6-11e1949e99e5 req-29e06e3e-fe63-49d4-bb89-0cd6260b7775 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397048 May 12 15:49:29.066008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4db8aab3-f1d6-48e0-a4a3-1fd7a7f6c44f req-84891286-cf9b-42ef-b8df-2c200fe82c9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:29.067494 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4db8aab3-f1d6-48e0-a4a3-1fd7a7f6c44f req-84891286-cf9b-42ef-b8df-2c200fe82c9a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 1095 time: 0.0947566 May 12 15:49:29.203765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4db8aab3-f1d6-48e0-a4a3-1fd7a7f6c44f req-63df4686-ff38-40ff-9cfe-07b5bb7beb4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:29.205171 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4db8aab3-f1d6-48e0-a4a3-1fd7a7f6c44f req-63df4686-ff38-40ff-9cfe-07b5bb7beb4c service neutron] 10.222.0.76 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1319120 May 12 15:49:29.380420 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4db8aab3-f1d6-48e0-a4a3-1fd7a7f6c44f req-27522a8f-e085-4169-b851-271d4f548224 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a75d0499-932a-4af9-bb6e-f34e6387ba0a HTTP/1.1" status: 200 len: 217 time: 0.1690595 May 12 15:49:29.449265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4db8aab3-f1d6-48e0-a4a3-1fd7a7f6c44f req-f756877e-6f7c-4e24-a39f-09666379e2a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:29.450719 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4db8aab3-f1d6-48e0-a4a3-1fd7a7f6c44f req-f756877e-6f7c-4e24-a39f-09666379e2a0 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0648897 May 12 15:49:29.559086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4db8aab3-f1d6-48e0-a4a3-1fd7a7f6c44f req-de537bb1-b96c-4800-a3a4-acd49ae2fba4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:29.560761 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4db8aab3-f1d6-48e0-a4a3-1fd7a7f6c44f req-de537bb1-b96c-4800-a3a4-acd49ae2fba4 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1031032 May 12 15:49:29.727872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b726a107-f64d-41ba-a7cc-0fe972439711 req-cf4c0d46-7dea-4d97-86f2-6fedf61dc954 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:29.730054 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b726a107-f64d-41ba-a7cc-0fe972439711 req-cf4c0d46-7dea-4d97-86f2-6fedf61dc954 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.1042840 May 12 15:49:29.747689 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4db8aab3-f1d6-48e0-a4a3-1fd7a7f6c44f req-cdc7bb05-867f-4c57-bc26-54d8cd5cdd40 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1808472 May 12 15:49:29.826620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b726a107-f64d-41ba-a7cc-0fe972439711 req-b18f13c7-4776-4e2a-af6c-f10f25c06a77 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0816333 May 12 15:49:29.927576 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4db8aab3-f1d6-48e0-a4a3-1fd7a7f6c44f req-639098ba-68d7-4876-9bc4-ad9c62e051c9 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1742415 May 12 15:49:30.280660 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5100f5d0-4848-4701-b7a4-6daecf551f8b req-0e5798b1-fc5b-45eb-a0e0-4925a2568637 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:30.282880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5100f5d0-4848-4701-b7a4-6daecf551f8b req-0e5798b1-fc5b-45eb-a0e0-4925a2568637 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 944 time: 0.1433926 May 12 15:49:30.332822 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5100f5d0-4848-4701-b7a4-6daecf551f8b req-55cfec09-2b2f-4e0f-8837-600a0c7b4aa4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440626 May 12 15:49:31.137551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bead55f-bd2a-4e18-b171-af49055c54ed req-7299267f-3775-40a2-9cee-982452a7104a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:31.141016 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bead55f-bd2a-4e18-b171-af49055c54ed req-7299267f-3775-40a2-9cee-982452a7104a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.1587284 May 12 15:49:31.208922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bead55f-bd2a-4e18-b171-af49055c54ed req-d339d0bb-08b2-457a-981d-2e54c45b52db tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0595384 May 12 15:49:31.622779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78160d89-2bc4-425d-a56c-baeb53bdcbf8 req-cad1c965-f7f3-406a-bda6-a9b7cea5c3e2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:31.624224 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78160d89-2bc4-425d-a56c-baeb53bdcbf8 req-cad1c965-f7f3-406a-bda6-a9b7cea5c3e2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 944 time: 0.1637833 May 12 15:49:31.713884 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78160d89-2bc4-425d-a56c-baeb53bdcbf8 req-ea07567b-588a-4c03-b00c-5c35363be659 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782306 May 12 15:49:32.146461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2076e5b9-b4d2-42e1-959c-ecf3aa2b89b4 req-a74b8db9-48dd-4a24-ba64-5ae0feb67750 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:32.147920 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2076e5b9-b4d2-42e1-959c-ecf3aa2b89b4 req-a74b8db9-48dd-4a24-ba64-5ae0feb67750 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1096 time: 0.0763416 May 12 15:49:32.514928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2076e5b9-b4d2-42e1-959c-ecf3aa2b89b4 req-50e85d0f-e709-4955-b298-6da1a1179af6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:32.516888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2076e5b9-b4d2-42e1-959c-ecf3aa2b89b4 req-50e85d0f-e709-4955-b298-6da1a1179af6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 200 len: 898 time: 0.3478231 May 12 15:49:32.534464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63938cc7-31a2-4b81-a633-0626a7267a0d req-4b8d963a-0b5c-47c6-9f11-16db61d1f9db tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:32.535988 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63938cc7-31a2-4b81-a633-0626a7267a0d req-4b8d963a-0b5c-47c6-9f11-16db61d1f9db tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.1448486 May 12 15:49:32.602721 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:32.718401 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63938cc7-31a2-4b81-a633-0626a7267a0d req-404000e3-4c3a-4fc0-a134-999d9ef11114 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1311541 May 12 15:49:32.721411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2076e5b9-b4d2-42e1-959c-ecf3aa2b89b4 req-b0be2e15-6866-451f-b1a8-ab5582c71fcf service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 1001 time: 0.1953869 May 12 15:49:32.788809 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2076e5b9-b4d2-42e1-959c-ecf3aa2b89b4 req-4b7371b3-0d44-47be-af63-766f4bcd6c4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:32.789672 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2076e5b9-b4d2-42e1-959c-ecf3aa2b89b4 req-4b7371b3-0d44-47be-af63-766f4bcd6c4c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae HTTP/1.1" status: 200 len: 835 time: 0.0593743 May 12 15:49:32.936653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2076e5b9-b4d2-42e1-959c-ecf3aa2b89b4 req-66b5a4bf-41df-432f-bfed-59627483018e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:32.938183 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2076e5b9-b4d2-42e1-959c-ecf3aa2b89b4 req-66b5a4bf-41df-432f-bfed-59627483018e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2c49c390-e121-4f31-92ba-528e8cdf62dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1406982 May 12 15:49:32.945500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cb2e4dd-0d99-4877-b6e4-3048738d6a74 req-343c190b-f456-4944-8c8f-72ffa07bc976 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:32.946806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0cb2e4dd-0d99-4877-b6e4-3048738d6a74 req-343c190b-f456-4944-8c8f-72ffa07bc976 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 944 time: 0.1108489 May 12 15:49:33.069364 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0cb2e4dd-0d99-4877-b6e4-3048738d6a74 req-a726230f-c042-4d1f-8e62-59a37ae78aef tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1042542 May 12 15:49:33.108632 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2076e5b9-b4d2-42e1-959c-ecf3aa2b89b4 req-775a4fbb-bb42-41b3-b65d-9a69b07010d4 service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1609120 May 12 15:49:33.253821 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2076e5b9-b4d2-42e1-959c-ecf3aa2b89b4 req-d698d00e-0784-4a8e-98ad-d274f48da11b service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1374381 May 12 15:49:33.922956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e929b19c-d471-4104-9653-d1cd44621ccd req-4900f93f-14b1-45cf-b2be-9f1b409b5868 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:33.924456 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e929b19c-d471-4104-9653-d1cd44621ccd req-4900f93f-14b1-45cf-b2be-9f1b409b5868 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.0886431 May 12 15:49:33.977904 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e929b19c-d471-4104-9653-d1cd44621ccd req-6d94b97d-af29-4424-aa7e-72f5f86964e4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465186 May 12 15:49:34.276225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f8ca29c-ca62-461f-9f73-b2560805a308 req-72d37e48-6675-466d-b191-0b98fb00ad7d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:34.277840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f8ca29c-ca62-461f-9f73-b2560805a308 req-72d37e48-6675-466d-b191-0b98fb00ad7d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 944 time: 0.0922666 May 12 15:49:34.335714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f8ca29c-ca62-461f-9f73-b2560805a308 req-8f12742d-1263-4940-81ba-83aff78a7fd9 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517433 May 12 15:49:35.162599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea0a2425-f7e5-4732-a7a9-89c583f00ddb req-28431f34-6367-4f15-9c4a-457ae5e2f475 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:35.164053 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea0a2425-f7e5-4732-a7a9-89c583f00ddb req-28431f34-6367-4f15-9c4a-457ae5e2f475 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.0834458 May 12 15:49:35.207970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea0a2425-f7e5-4732-a7a9-89c583f00ddb req-8580ab01-0886-4a20-a9e5-7093482cd483 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383184 May 12 15:49:35.516024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f71a5089-2114-4a42-9e73-4d703c98074f req-2e4bb420-c8c4-4fff-9cc8-5bbc0428b188 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:35.517457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f71a5089-2114-4a42-9e73-4d703c98074f req-2e4bb420-c8c4-4fff-9cc8-5bbc0428b188 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 944 time: 0.0784104 May 12 15:49:35.564524 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f71a5089-2114-4a42-9e73-4d703c98074f req-81f4ed7b-3ad7-4661-aebd-c1c78cb7d6ee tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413504 May 12 15:49:35.960128 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:49:36.392554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ecc3221-bdc8-4564-ac66-283bf86837c1 req-1f7c50b6-0f05-40d4-873a-96cf7701a6dd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:36.394140 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ecc3221-bdc8-4564-ac66-283bf86837c1 req-1f7c50b6-0f05-40d4-873a-96cf7701a6dd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.0800328 May 12 15:49:36.438264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ecc3221-bdc8-4564-ac66-283bf86837c1 req-9dec97f9-f1d7-4010-b181-cb4d335700fe tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383797 May 12 15:49:36.751698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a6208f6-009a-4db0-b905-beec1eec6e19 req-51d8df2f-b30d-4521-93ba-cd1f5b1b0c27 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:36.753159 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a6208f6-009a-4db0-b905-beec1eec6e19 req-51d8df2f-b30d-4521-93ba-cd1f5b1b0c27 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 944 time: 0.0842202 May 12 15:49:36.797431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a6208f6-009a-4db0-b905-beec1eec6e19 req-4f35ff95-b31d-4cfd-b79c-180b464905b0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383573 May 12 15:49:37.624976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e5bfb1-cbf9-42c7-a931-f3dfab380ac9 req-222ec718-5d0b-4eb6-b4df-9a78c3de1033 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:37.627899 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e6e5bfb1-cbf9-42c7-a931-f3dfab380ac9 req-222ec718-5d0b-4eb6-b4df-9a78c3de1033 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.0817671 May 12 15:49:37.681930 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e6e5bfb1-cbf9-42c7-a931-f3dfab380ac9 req-89dee76b-f05e-4041-a2cd-fd953c7a1bf1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464041 May 12 15:49:37.993495 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fddcd2d-2f03-4f5f-87ea-b25d1d278d9a req-3c438ea3-b55f-4152-8c90-c7fcd12dec4b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:37.994851 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8fddcd2d-2f03-4f5f-87ea-b25d1d278d9a req-3c438ea3-b55f-4152-8c90-c7fcd12dec4b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 944 time: 0.0873189 May 12 15:49:38.042459 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8fddcd2d-2f03-4f5f-87ea-b25d1d278d9a req-b3283555-d908-4dbf-bd84-dfd220d6273c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411029 May 12 15:49:38.870821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-135f46d7-4d7a-4a3d-9f43-0f12e36dc73e req-9f683ee9-a2cc-4559-ba98-0f45fd011b54 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:38.872236 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-135f46d7-4d7a-4a3d-9f43-0f12e36dc73e req-9f683ee9-a2cc-4559-ba98-0f45fd011b54 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.0804365 May 12 15:49:38.918685 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-135f46d7-4d7a-4a3d-9f43-0f12e36dc73e req-640cb3c3-0728-457a-9c48-c801cd3c2148 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398662 May 12 15:49:39.321246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76316bee-8717-42fe-b36e-60b28277363b req-3faac0d5-65cb-4149-9914-f3774179e7b4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:39.322753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-76316bee-8717-42fe-b36e-60b28277363b req-3faac0d5-65cb-4149-9914-f3774179e7b4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 944 time: 0.1737313 May 12 15:49:39.365376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-76316bee-8717-42fe-b36e-60b28277363b req-5226653a-ce7f-4c14-b983-f12ba0a5bd2c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0369589 May 12 15:49:40.102086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7dc2b99-cc63-4ca0-aba6-2eedd432b390 req-a998a258-1a6f-4d5a-9c1b-5564865b39cf tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:40.103424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7dc2b99-cc63-4ca0-aba6-2eedd432b390 req-a998a258-1a6f-4d5a-9c1b-5564865b39cf tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.0807953 May 12 15:49:40.148619 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7dc2b99-cc63-4ca0-aba6-2eedd432b390 req-c5420e24-ce2c-4036-b84d-19bf88a09f83 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394468 May 12 15:49:40.546746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e814a7ec-a39a-4a56-89f0-9b0d7a7aa255 req-24399d4b-ae98-4556-9410-3073b8a57e20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:40.548165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e814a7ec-a39a-4a56-89f0-9b0d7a7aa255 req-24399d4b-ae98-4556-9410-3073b8a57e20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 944 time: 0.0787148 May 12 15:49:40.591417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e814a7ec-a39a-4a56-89f0-9b0d7a7aa255 req-1eb406d4-b567-4896-873c-95d77418c763 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376966 May 12 15:49:41.338406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716b52cd-1700-4c52-8aa8-c74882f74762 req-93e99b66-a57b-49b7-b34e-738c46f33e30 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:41.339880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716b52cd-1700-4c52-8aa8-c74882f74762 req-93e99b66-a57b-49b7-b34e-738c46f33e30 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.0865920 May 12 15:49:41.384847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-716b52cd-1700-4c52-8aa8-c74882f74762 req-52af6b0f-7308-4839-93e7-58ea032a72f2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384820 May 12 15:49:41.777961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daa140a6-9a6c-42d8-80a6-e7f541507a7e req-0f1c1314-8b6a-4f13-accb-e9424c1cb720 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:41.779381 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-daa140a6-9a6c-42d8-80a6-e7f541507a7e req-0f1c1314-8b6a-4f13-accb-e9424c1cb720 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 944 time: 0.0786936 May 12 15:49:41.825674 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-daa140a6-9a6c-42d8-80a6-e7f541507a7e req-b72acb0d-ea3b-4cef-9ead-dc0f73647413 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406616 May 12 15:49:42.570613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d4a300-3341-4447-b275-522d61eeb715 req-319668e0-5f38-4061-b8c8-a303d6591175 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:42.571938 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73d4a300-3341-4447-b275-522d61eeb715 req-319668e0-5f38-4061-b8c8-a303d6591175 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.0783453 May 12 15:49:42.615036 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73d4a300-3341-4447-b275-522d61eeb715 req-e74a5ebf-0cf2-4e64-9c96-076db7bfead1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0369740 May 12 15:49:42.752604 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7303f7ea-c2ce-4154-9dad-da3d93548933 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:43.012730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be08524-ffed-471c-b294-23c1e87e8302 req-dca5755f-a809-42dc-8a28-8bb43a79620c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:43.014811 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1be08524-ffed-471c-b294-23c1e87e8302 req-dca5755f-a809-42dc-8a28-8bb43a79620c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 944 time: 0.0834448 May 12 15:49:43.058496 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1be08524-ffed-471c-b294-23c1e87e8302 req-c98f1cd9-bf8c-48a8-9483-42b08e82de23 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378060 May 12 15:49:43.352988 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:43.577467 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-bc7aab32-1525-4b0e-b3cc-6241c060c08d service neutron] show failed (client error): The resource could not be found. May 12 15:49:43.578359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-bc7aab32-1525-4b0e-b3cc-6241c060c08d service neutron] 10.222.0.84 "GET /v2.0/ports/fcfbcee7-a160-4968-9ce4-95d57bd748bc/bindings/n-h2-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.0732479 May 12 15:49:43.864180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-073930c9-f697-44dc-bdc8-0ea8daac657e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:43.865675 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-073930c9-f697-44dc-bdc8-0ea8daac657e service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363&tenant_id=b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 1096 time: 0.0824814 May 12 15:49:43.877529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Request body: {'port': {'binding:host_id': 'n-h2-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:49:43.954029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd2cdba3-4415-4d23-8e35-54a938106449 req-c99c9ce5-1977-4f44-9829-d646ba632c91 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:43.955455 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd2cdba3-4415-4d23-8e35-54a938106449 req-c99c9ce5-1977-4f44-9829-d646ba632c91 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 945 time: 0.0827398 May 12 15:49:43.985953 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:43.999271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd2cdba3-4415-4d23-8e35-54a938106449 req-89508678-9f70-4e6f-b60b-eb683d57a432 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377007 May 12 15:49:44.251535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-befe8e78-62e0-4a2f-b3a9-f0b693a30f9a req-2365b417-fae2-46f4-92cc-b2902e5eb651 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:44.252998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-befe8e78-62e0-4a2f-b3a9-f0b693a30f9a req-2365b417-fae2-46f4-92cc-b2902e5eb651 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 944 time: 0.0891511 May 12 15:49:44.261694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:44.293218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:49:44.298909 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-befe8e78-62e0-4a2f-b3a9-f0b693a30f9a req-e4aa2bf9-09dc-4eec-9c37-00147aeb1bbe tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400903 May 12 15:49:44.356523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:49:44.362328 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:44.377348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Transition to ACTIVE for port object fcfbcee7-a160-4968-9ce4-95d57bd748bc will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:49:44.381598 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:44.422899 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b6aac808-8c43-4c6b-b6ab-d39038b2ece0'] response: {'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'code': 200} May 12 15:49:44.528443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Pushing event updated for resources: {'Port': ['ID=fcfbcee7-a160-4968-9ce4-95d57bd748bc,revision_number=6']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:44.597369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] No DVR routers for this DVR port fcfbcee7-a160-4968-9ce4-95d57bd748bc on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:49:44.823245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Attempting to bind port fcfbcee7-a160-4968-9ce4-95d57bd748bc on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:49:44.823486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Attempting to bind port fcfbcee7-a160-4968-9ce4-95d57bd748bc by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:49:44.823803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Attempting to bind port fcfbcee7-a160-4968-9ce4-95d57bd748bc on network 2c49c390-e121-4f31-92ba-528e8cdf62dd {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:49:44.829034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Port fcfbcee7-a160-4968-9ce4-95d57bd748bc on network 2c49c390-e121-4f31-92ba-528e8cdf62dd not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:49:44.829353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Attempting to bind port fcfbcee7-a160-4968-9ce4-95d57bd748bc on network 2c49c390-e121-4f31-92ba-528e8cdf62dd {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:49:44.834587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 49, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:49:44.834927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Checking segment: {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:49:44.835308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Bound using segment: {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:49:44.835732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Bound port: fcfbcee7-a160-4968-9ce4-95d57bd748bc, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:49:44.836075 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:45.047683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:49:45.050695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:49:45.056525 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:45.120297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:45.120997 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:45.122386 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] 10.222.0.76 "PUT /v2.0/ports/fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 1091 time: 1.2499571 May 12 15:49:45.138525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f580832-7f01-477c-84c1-d56a25ed663c service neutron] Pushing event updated for resources: {'Port': ['ID=fcfbcee7-a160-4968-9ce4-95d57bd748bc,revision_number=7']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:45.201975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d22f8172-cd33-4ece-8114-16abb1b25e3f req-0a07171b-8919-46c0-8833-4383e5275334 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:45.204130 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d22f8172-cd33-4ece-8114-16abb1b25e3f req-0a07171b-8919-46c0-8833-4383e5275334 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 943 time: 0.0941014 May 12 15:49:45.233759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-1d781bfc-561a-4a31-bc0e-7d0f28242d44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:45.235312 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-1d781bfc-561a-4a31-bc0e-7d0f28242d44 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1094 time: 0.0887153 May 12 15:49:45.259786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d22f8172-cd33-4ece-8114-16abb1b25e3f req-beff122b-3f33-42fa-87af-7b3f82518c04 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495560 May 12 15:49:45.317520 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21f57cbf-1f97-40b5-9525-1fc2e608fe74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:45.387739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-a8d6d992-9b8a-4174-b850-67fcf2c24fda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:45.389172 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-a8d6d992-9b8a-4174-b850-67fcf2c24fda service neutron] 10.222.0.76 "GET /v2.0/networks?id=2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 200 len: 898 time: 0.1474302 May 12 15:49:45.484479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f4cfd4a-ccf1-4059-a94a-2e22e8b3b169 req-ac9fee14-7459-4eb2-bc4c-b42f8eca3c03 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:45.486014 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f4cfd4a-ccf1-4059-a94a-2e22e8b3b169 req-ac9fee14-7459-4eb2-bc4c-b42f8eca3c03 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 944 time: 0.0813003 May 12 15:49:45.491882 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-e859bf87-a693-4612-af3b-3287a450d366 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 999 time: 0.0973542 May 12 15:49:45.534531 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9f4cfd4a-ccf1-4059-a94a-2e22e8b3b169 req-aea7c5c4-4127-4da3-a931-cfc41d18f6bb tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428269 May 12 15:49:45.554767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-1c48ff0e-15b9-4bdc-9ac8-de74544cf7da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:45.556442 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-1c48ff0e-15b9-4bdc-9ac8-de74544cf7da service neutron] 10.222.0.76 "GET /v2.0/subnets?id=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae HTTP/1.1" status: 200 len: 835 time: 0.0587609 May 12 15:49:45.635676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-461de58a-9e1b-4740-b53c-cb57d4fc88f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:45.637285 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-461de58a-9e1b-4740-b53c-cb57d4fc88f6 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=2c49c390-e121-4f31-92ba-528e8cdf62dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0751846 May 12 15:49:45.771627 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-11380af9-aef0-4d9b-b474-de9304545f4a service neutron] 10.222.0.76 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1286206 May 12 15:49:45.909857 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9be91093-b35c-42cd-9df6-7a97619c82f2 req-b1046e26-495a-4145-9e9e-55f92735d45e service neutron] 10.222.0.76 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1324084 May 12 15:49:46.051767 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:46.054684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a75d0499-932a-4af9-bb6e-f34e6387ba0a details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:49:46.225183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a75d0499-932a-4af9-bb6e-f34e6387ba0a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a75d0499-932a-4af9-bb6e-f34e6387ba0a,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:46.242272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'a75d0499-932a-4af9-bb6e-f34e6387ba0a', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'port_id': 'a75d0499-932a-4af9-bb6e-f34e6387ba0a', 'mac_address': 'fa:16:3e:ac:45:a7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 566, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:49:46.305094 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:46.309203 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:46.326212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a75d0499-932a-4af9-bb6e-f34e6387ba0a {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:49:46.342876 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a75d0499-932a-4af9-bb6e-f34e6387ba0a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a75d0499-932a-4af9-bb6e-f34e6387ba0a,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:46.347973 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:46.417204 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a75d0499-932a-4af9-bb6e-f34e6387ba0a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:46.423846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:49:46.424874 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:46.425233 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:46.425587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:46.425923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:46.426252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:46.426578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:46.426904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:46.427227 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:46.427550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:46.427871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:46.428184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:46.428707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:46.459604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caae3d13-af2a-4722-8ec7-c10d57c55b4d req-11e986e0-cc86-4070-9a4d-71b3ee0e2757 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:46.461092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-caae3d13-af2a-4722-8ec7-c10d57c55b4d req-11e986e0-cc86-4070-9a4d-71b3ee0e2757 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 943 time: 0.0882261 May 12 15:49:46.480721 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8b0079bf-d6fa-405a-af40-3d418c5a39d7'] response: {'name': 'network-changed', 'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'status': 'completed', 'code': 200} May 12 15:49:46.506402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-caae3d13-af2a-4722-8ec7-c10d57c55b4d req-94e60256-2842-4ba7-9972-09e96557d4fa tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395384 May 12 15:49:46.540706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a75d0499-932a-4af9-bb6e-f34e6387ba0a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:49:46.577091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-3b45ead2-b0bb-44a0-b3c6-41ccf35b7eb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:46.578633 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-3b45ead2-b0bb-44a0-b3c6-41ccf35b7eb1 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1094 time: 0.0811703 May 12 15:49:46.608336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-8632471b-847c-4e75-a342-a031212978d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:46.610009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-8632471b-847c-4e75-a342-a031212978d6 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1094 time: 0.0776446 May 12 15:49:46.732460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-99e77508-c1f4-40cd-8794-7647c4a6497a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:46.733999 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-99e77508-c1f4-40cd-8794-7647c4a6497a service neutron] 10.222.0.76 "GET /v2.0/networks?id=2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 200 len: 898 time: 0.1474802 May 12 15:49:46.804047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-3c9c98cb-488a-49b0-898e-bb2e9d9060e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:46.805744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-3c9c98cb-488a-49b0-898e-bb2e9d9060e4 service neutron] 10.222.0.84 "GET /v2.0/networks?id=2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 200 len: 898 time: 0.1873946 May 12 15:49:46.822147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68125b04-c634-4a40-8955-75f61ae3425c req-e49855d0-22ac-4159-97fe-35e8a4748ad3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:46.823451 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-68125b04-c634-4a40-8955-75f61ae3425c req-e49855d0-22ac-4159-97fe-35e8a4748ad3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 945 time: 0.1357846 May 12 15:49:46.838913 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-74addd34-00b0-4a79-b2b3-a6c524dca139 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 999 time: 0.0980504 May 12 15:49:46.901520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-f3a1293a-f6b3-410a-8e88-d0a139af9208 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:46.902949 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-f3a1293a-f6b3-410a-8e88-d0a139af9208 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae HTTP/1.1" status: 200 len: 835 time: 0.0573196 May 12 15:49:46.947901 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-68125b04-c634-4a40-8955-75f61ae3425c req-b379e7ce-d96b-4b61-ad35-510cfce9d7ab tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0736575 May 12 15:49:46.964510 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-27b5b0e4-e537-4f7d-a457-332e05315158 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 999 time: 0.1500046 May 12 15:49:46.991747 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-d9e24713-953d-4ea2-961c-dc90b984bc4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:46.993193 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-d9e24713-953d-4ea2-961c-dc90b984bc4d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=2c49c390-e121-4f31-92ba-528e8cdf62dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0834057 May 12 15:49:47.031009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-e47b6625-7088-4e20-91c2-4fdeb3e8e8bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:47.032443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-e47b6625-7088-4e20-91c2-4fdeb3e8e8bf service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae HTTP/1.1" status: 200 len: 835 time: 0.0613294 May 12 15:49:47.108880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-07caf1eb-25c7-435e-a52e-73d3d768910d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:47.110296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-07caf1eb-25c7-435e-a52e-73d3d768910d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2c49c390-e121-4f31-92ba-528e8cdf62dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0707090 May 12 15:49:47.126582 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-7f7cc0d6-10fc-4675-b39f-96a43ac53d5f service neutron] 10.222.0.76 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1263518 May 12 15:49:47.355659 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-22c0da77-b750-4aaf-ae65-82433f231bb5 service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2356877 May 12 15:49:47.383412 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-c55edbb3-795b-482b-9e20-b5f6dc83f65f service neutron] 10.222.0.76 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2500675 May 12 15:49:47.494082 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b56341a-9e8d-446a-8771-bb14de2d5911 req-9341f571-f70a-4965-badd-bb8cfd1d067a service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1317949 May 12 15:49:47.698890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675a52ea-5c20-4690-9e48-96acdc58e061 req-2a7e3255-5545-4156-87fd-ca1470e31ce9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:47.700232 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-675a52ea-5c20-4690-9e48-96acdc58e061 req-2a7e3255-5545-4156-87fd-ca1470e31ce9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 943 time: 0.0852845 May 12 15:49:47.746888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-675a52ea-5c20-4690-9e48-96acdc58e061 req-ff074264-4428-466b-a17c-1bd3a36fa162 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407174 May 12 15:49:47.753032 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:48.070862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a75d0499-932a-4af9-bb6e-f34e6387ba0a up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:49:48.078584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-b20443f3-c6c7-40f4-a664-6f995c10d658 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:48.079281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-b20443f3-c6c7-40f4-a664-6f995c10d658 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:49:48.097786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-b20443f3-c6c7-40f4-a664-6f995c10d658 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:49:48.100283 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-b20443f3-c6c7-40f4-a664-6f995c10d658 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.76 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363&tenant_id=b88b5989d4c548dba6124f2e4690e5c3&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 943 time: 0.1085725 May 12 15:49:48.148154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port a75d0499-932a-4af9-bb6e-f34e6387ba0a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:49:48.153650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port a75d0499-932a-4af9-bb6e-f34e6387ba0a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:49:48.154019 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:48.197479 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-c2c4d58a-408d-4f78-b55f-56a6c070e2e6 service neutron] 10.222.0.76 "GET /v2.0/ports/fcfbcee7-a160-4968-9ce4-95d57bd748bc/bindings/n-h2-841483-1 HTTP/1.1" status: 200 len: 382 time: 0.0932281 May 12 15:49:48.222204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41bccb64-2959-46dd-9e2f-24d04b3eec79 req-13902616-8825-478a-9765-f3abb5307514 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:48.223462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41bccb64-2959-46dd-9e2f-24d04b3eec79 req-13902616-8825-478a-9765-f3abb5307514 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 943 time: 0.1732545 May 12 15:49:48.232315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbdb41b5-1a51-4c26-95d4-43c06a20bced req-7d33edba-c8bc-445c-a31a-ff3dee4bf4b9 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:48.233933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bbdb41b5-1a51-4c26-95d4-43c06a20bced req-7d33edba-c8bc-445c-a31a-ff3dee4bf4b9 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 945 time: 0.1445091 May 12 15:49:48.286373 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:48.299706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-ef7178fb-6f67-40ef-b993-b7785238fb0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:48.301234 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-ef7178fb-6f67-40ef-b993-b7785238fb0e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1094 time: 0.0778134 May 12 15:49:48.311668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41bccb64-2959-46dd-9e2f-24d04b3eec79 req-201c1d0a-6ba2-4b30-835b-4875f2032af8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0761476 May 12 15:49:48.315987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b1ced7b7-ee2f-45a0-bce3-89119932d3dc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a75d0499-932a-4af9-bb6e-f34e6387ba0a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:49:48.327383 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a75d0499-932a-4af9-bb6e-f34e6387ba0a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a75d0499-932a-4af9-bb6e-f34e6387ba0a,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:48.328061 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bbdb41b5-1a51-4c26-95d4-43c06a20bced req-4ca36708-8822-44dc-a400-4b3a56de14bd tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797579 May 12 15:49:48.341751 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:48.415243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a75d0499-932a-4af9-bb6e-f34e6387ba0a,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:48.437408 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4dea7ec4-bac5-4b59-bf0d-bcc5dff29da7'] response: {'server_uuid': 'b1ced7b7-ee2f-45a0-bce3-89119932d3dc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a75d0499-932a-4af9-bb6e-f34e6387ba0a', 'code': 200} May 12 15:49:48.457625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-ae920bba-d856-4b6b-a1f4-855eaef68b53 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:48.459107 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-ae920bba-d856-4b6b-a1f4-855eaef68b53 service neutron] 10.222.0.76 "GET /v2.0/networks?id=2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 200 len: 898 time: 0.1516347 May 12 15:49:48.562028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fcfbcee7-a160-4968-9ce4-95d57bd748bc no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:49:48.606660 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-1561a31c-2812-4b4d-bcf5-c847eb4a7949 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 999 time: 0.1411958 May 12 15:49:48.622047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fcfbcee7-a160-4968-9ce4-95d57bd748bc not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:49:48.672291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ea4eeb-cc55-4e9f-94b4-b2f28f26ea8d req-139c99c7-316c-4f5b-b565-ad7624755962 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:48.673750 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b2ea4eeb-cc55-4e9f-94b4-b2f28f26ea8d req-139c99c7-316c-4f5b-b565-ad7624755962 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 1097 time: 0.1614101 May 12 15:49:48.678670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-605a2fc9-0368-466f-8abb-ad53683b3d91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:48.680010 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-605a2fc9-0368-466f-8abb-ad53683b3d91 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae HTTP/1.1" status: 200 len: 835 time: 0.0676434 May 12 15:49:48.757681 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b2ea4eeb-cc55-4e9f-94b4-b2f28f26ea8d req-b4bce32f-7dc9-4f9d-8ccf-94447b5fbe69 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0767436 May 12 15:49:48.776894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-b3a1365d-d929-406a-a0ff-f2406569dbf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:48.778313 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-b3a1365d-d929-406a-a0ff-f2406569dbf2 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=2c49c390-e121-4f31-92ba-528e8cdf62dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0841396 May 12 15:49:49.070461 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-cca551b9-ac93-445e-aab3-d6ee998beb94 service neutron] 10.222.0.76 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1251280 May 12 15:49:49.200784 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-0ba8e30f-6ce8-46ba-8da7-74280d4896f0 service neutron] 10.222.0.76 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1239705 May 12 15:49:49.563610 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-682a39e0-fdf8-4893-b472-77157c0e4405 req-4461415b-55e4-4e19-849c-617771e7f5bf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:49.565242 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-682a39e0-fdf8-4893-b472-77157c0e4405 req-4461415b-55e4-4e19-849c-617771e7f5bf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 946 time: 0.1404326 May 12 15:49:49.572686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d2463db-63c9-444f-a6aa-1ced516af03b req-b70f3ebf-7e71-4952-b791-fa754a5d8334 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:49.574042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d2463db-63c9-444f-a6aa-1ced516af03b req-b70f3ebf-7e71-4952-b791-fa754a5d8334 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 943 time: 0.1504989 May 12 15:49:49.646731 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-682a39e0-fdf8-4893-b472-77157c0e4405 req-81e4b540-4f57-45ad-af05-7dc0b8be0fe0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717583 May 12 15:49:49.650024 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d2463db-63c9-444f-a6aa-1ced516af03b req-1de61ae0-22f9-4613-ba86-bec648e8bfa9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0622475 May 12 15:49:50.070753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device fcfbcee7-a160-4968-9ce4-95d57bd748bc details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:49:50.204411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:50.217340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'port_id': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'mac_address': 'fa:16:3e:fe:e9:0f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 564, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:49:50.279198 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:50.295884 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fcfbcee7-a160-4968-9ce4-95d57bd748bc {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:49:50.313119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:50.316907 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:50.388972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=fcfbcee7-a160-4968-9ce4-95d57bd748bc,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:50.896813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6dfb100-6fef-407c-ac92-bd97b05d9ace req-a2e362dd-7c27-4333-8ddf-bb67c9404719 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:50.898295 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6dfb100-6fef-407c-ac92-bd97b05d9ace req-a2e362dd-7c27-4333-8ddf-bb67c9404719 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 944 time: 0.1425381 May 12 15:49:50.906383 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a63e984-cc29-4268-81e2-1186ba463306 req-61b876a8-c7f9-4469-85f7-4e8d9f12510c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:50.907802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a63e984-cc29-4268-81e2-1186ba463306 req-61b876a8-c7f9-4469-85f7-4e8d9f12510c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 946 time: 0.1540122 May 12 15:49:50.973378 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6dfb100-6fef-407c-ac92-bd97b05d9ace req-555b0be5-edd0-4e25-845f-d1396bb1de15 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0646420 May 12 15:49:50.983223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a63e984-cc29-4268-81e2-1186ba463306 req-cc4ad43e-1dbc-4f22-b420-f5e02d6790e2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0597351 May 12 15:49:51.228116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004ddcdd-ee28-41e0-be98-b6d68c226e7a req-5a7d3e2a-3373-4b2b-83ac-79b6cfcd1dd6 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:51.229483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-004ddcdd-ee28-41e0-be98-b6d68c226e7a req-5a7d3e2a-3373-4b2b-83ac-79b6cfcd1dd6 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 946 time: 0.1377740 May 12 15:49:51.253321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-30b8efe5-ba80-48c2-868e-84f300d7edb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:51.254756 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-30b8efe5-ba80-48c2-868e-84f300d7edb6 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363&tenant_id=b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 1095 time: 0.1098216 May 12 15:49:51.276432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Request body: {'port': {'binding:host_id': 'n-h1-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:49:51.316338 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-004ddcdd-ee28-41e0-be98-b6d68c226e7a req-82bde2ab-8a4d-4bf3-ac59-c81599738fe7 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0803499 May 12 15:49:51.394178 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:51.616219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a15c79ce-848e-4306-9713-b892a00fed1b req-53049009-7651-44b7-aef9-5c6b52a5d51f tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:51.617584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a15c79ce-848e-4306-9713-b892a00fed1b req-53049009-7651-44b7-aef9-5c6b52a5d51f tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 946 time: 0.1848807 May 12 15:49:51.731481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a15c79ce-848e-4306-9713-b892a00fed1b req-16526d6c-2250-4fa0-89ef-6aed493a34bc tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683661 May 12 15:49:51.755624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:51.785506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:49:51.945622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id fcfbcee7-a160-4968-9ce4-95d57bd748bc {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:49:51.954434 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:51.967527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Ignored duplicate provisioning block setup for port fcfbcee7-a160-4968-9ce4-95d57bd748bc by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:68}} May 12 15:49:51.971316 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:52.226352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Pushing event updated for resources: {'Port': ['ID=fcfbcee7-a160-4968-9ce4-95d57bd748bc,revision_number=9']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:52.257113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:52.257469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:52.257792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:52.258117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:52.258439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:52.258752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:52.259061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:52.259366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:52.259673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:52.259977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:52.260295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:52.260580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:49:52.322042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] No DVR routers for this DVR port fcfbcee7-a160-4968-9ce4-95d57bd748bc on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:49:52.421180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-428fc218-144e-47cc-9cbb-a43ea2a763e0 req-f8e56d9d-10dd-4f02-a081-0ad81f3f6b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:52.423327 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-428fc218-144e-47cc-9cbb-a43ea2a763e0 req-f8e56d9d-10dd-4f02-a081-0ad81f3f6b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 943 time: 0.3123510 May 12 15:49:52.519518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-760f1a86-3db7-4302-9d16-e23cd6d52c31 req-1352d0b4-4dd8-477e-bff2-dbef0d161bbd tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:52.520933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-760f1a86-3db7-4302-9d16-e23cd6d52c31 req-1352d0b4-4dd8-477e-bff2-dbef0d161bbd tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 946 time: 0.3539753 May 12 15:49:52.573214 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-428fc218-144e-47cc-9cbb-a43ea2a763e0 req-846afbf9-6e89-44c6-91ef-93da86b4cec7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0987291 May 12 15:49:52.624501 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-760f1a86-3db7-4302-9d16-e23cd6d52c31 req-068ad704-c767-47c5-905e-bb5e345676f3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0937974 May 12 15:49:52.644976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Attempting to bind port fcfbcee7-a160-4968-9ce4-95d57bd748bc on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:49:52.645299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Attempting to bind port fcfbcee7-a160-4968-9ce4-95d57bd748bc by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:49:52.645657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Attempting to bind port fcfbcee7-a160-4968-9ce4-95d57bd748bc on network 2c49c390-e121-4f31-92ba-528e8cdf62dd {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:49:52.650191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Port fcfbcee7-a160-4968-9ce4-95d57bd748bc on network 2c49c390-e121-4f31-92ba-528e8cdf62dd not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:49:52.650524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Attempting to bind port fcfbcee7-a160-4968-9ce4-95d57bd748bc on network 2c49c390-e121-4f31-92ba-528e8cdf62dd {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:49:52.655464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 49, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:49:52.656303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Checking segment: {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:49:52.656668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Bound using segment: {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:49:52.657074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Bound port: fcfbcee7-a160-4968-9ce4-95d57bd748bc, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8324a333-973a-4a60-b286-77665151f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:49:52.657421 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:52.743385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:49:52.746233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:49:52.749616 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:52.810233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:52.810829 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:52.812231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] 10.222.0.84 "PUT /v2.0/ports/fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 1091 time: 1.5425141 May 12 15:49:52.812663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:49:52.835020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b6dae94-e3b9-485c-bb08-b802a109e88e service neutron] Pushing event updated for resources: {'Port': ['ID=fcfbcee7-a160-4968-9ce4-95d57bd748bc,revision_number=10']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:52.889311 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6a115eb7-20bd-4200-b0b5-7a3f2a8d0c8a'] response: {'name': 'network-changed', 'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'status': 'completed', 'code': 200} May 12 15:49:52.935793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-7abf8aa9-b187-4933-9b2a-2891a20c5aa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:52.938023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-7abf8aa9-b187-4933-9b2a-2891a20c5aa4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1095 time: 0.0821421 May 12 15:49:52.978591 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-c94a0628-d9cf-4745-b084-1246175d6d18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:52.980046 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-c94a0628-d9cf-4745-b084-1246175d6d18 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1095 time: 0.0799634 May 12 15:49:53.080385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-e0530930-d753-4729-8833-3c744bbf6940 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:53.081746 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-e0530930-d753-4729-8833-3c744bbf6940 service neutron] 10.222.0.84 "GET /v2.0/networks?id=2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 200 len: 898 time: 0.1319144 May 12 15:49:53.120185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-fb278587-848f-4b8f-9741-3b733cc4fbbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:53.121715 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-fb278587-848f-4b8f-9741-3b733cc4fbbb service neutron] 10.222.0.76 "GET /v2.0/networks?id=2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 200 len: 898 time: 0.1355209 May 12 15:49:53.196585 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-330305e9-d1a2-460e-9baa-dba4062a17d1 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 999 time: 0.1076725 May 12 15:49:53.229733 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-7bea396c-01c2-4269-977c-52570cc7a488 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 999 time: 0.1015272 May 12 15:49:53.264434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-b19f3b64-a584-4546-811b-cc17f4bd79a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:53.266223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-b19f3b64-a584-4546-811b-cc17f4bd79a8 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae HTTP/1.1" status: 200 len: 835 time: 0.0639021 May 12 15:49:53.292746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-725fdd02-2cd2-47ec-b5e6-83a36fda2ddd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:53.294302 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-725fdd02-2cd2-47ec-b5e6-83a36fda2ddd service neutron] 10.222.0.76 "GET /v2.0/subnets?id=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae HTTP/1.1" status: 200 len: 835 time: 0.0586882 May 12 15:49:53.341420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-76b30b0a-d7ac-428e-b23e-0bf57c62c632 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:53.342794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-76b30b0a-d7ac-428e-b23e-0bf57c62c632 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2c49c390-e121-4f31-92ba-528e8cdf62dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0703716 May 12 15:49:53.371434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-afa07292-c29e-4c54-bff5-6d959e33ba1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:53.372898 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-afa07292-c29e-4c54-bff5-6d959e33ba1f service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=2c49c390-e121-4f31-92ba-528e8cdf62dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0727990 May 12 15:49:53.477596 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-ad0fc6b8-8a2a-4231-91cb-5e4dd0e06155 service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1271918 May 12 15:49:53.504715 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-44bf37d7-de3f-4b36-9257-10a75e6ca12d service neutron] 10.222.0.76 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1254334 May 12 15:49:53.818257 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-795b98b3-7aa6-4fa8-ad8a-734c86a2e12a service neutron] 10.222.0.76 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3029008 May 12 15:49:53.826412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81991296-6851-4863-94de-42c4d9188994 req-5a73be78-26fd-42e7-adfc-1826253ba470 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:53.827085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-81991296-6851-4863-94de-42c4d9188994 req-5a73be78-26fd-42e7-adfc-1826253ba470 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Synchronizing usage tracker for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:49:53.842801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-81991296-6851-4863-94de-42c4d9188994 req-5a73be78-26fd-42e7-adfc-1826253ba470 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Unset dirty status for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:49:53.844269 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-81991296-6851-4863-94de-42c4d9188994 req-5a73be78-26fd-42e7-adfc-1826253ba470 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 946 time: 0.3278120 May 12 15:49:53.849808 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-514160cf-31a9-4d0b-b235-afa72e5e96cd req-d602c413-c67c-4480-82e4-1408c2ebc17e service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3657105 May 12 15:49:53.892418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23027afe-e8eb-4f73-946a-61e35be5d2fb req-f4c8ae1c-5b6b-409c-a24d-931182e5985c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:53.894193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23027afe-e8eb-4f73-946a-61e35be5d2fb req-f4c8ae1c-5b6b-409c-a24d-931182e5985c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 944 time: 0.1912959 May 12 15:49:53.901968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0608cdb8-81f0-45b1-83b6-c66ab251d4c5 req-5a5758f3-7181-4e3a-a9ba-0c5c00ece6c1 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:53.903335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0608cdb8-81f0-45b1-83b6-c66ab251d4c5 req-5a5758f3-7181-4e3a-a9ba-0c5c00ece6c1 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 946 time: 0.1610968 May 12 15:49:53.919467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-81991296-6851-4863-94de-42c4d9188994 req-026bd974-3351-4326-a948-595db751be41 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Deleting port a75d0499-932a-4af9-bb6e-f34e6387ba0a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:49:53.919805 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-81991296-6851-4863-94de-42c4d9188994 req-026bd974-3351-4326-a948-595db751be41 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:54.021271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23027afe-e8eb-4f73-946a-61e35be5d2fb req-ab61b5ce-2074-4d05-9bbe-9540cf304d39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1169784 May 12 15:49:54.039223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0608cdb8-81f0-45b1-83b6-c66ab251d4c5 req-95a15c64-8532-4b6e-815d-a60d055692ec tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1197183 May 12 15:49:54.057349 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-0d45cc4f-f056-4a40-92f6-5318cf82f7f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:54.058843 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-0d45cc4f-f056-4a40-92f6-5318cf82f7f8 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1095 time: 0.1174340 May 12 15:49:54.181261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-81991296-6851-4863-94de-42c4d9188994 req-026bd974-3351-4326-a948-595db751be41 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] For port a75d0499-932a-4af9-bb6e-f34e6387ba0a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a75d0499-932a-4af9-bb6e-f34e6387ba0a,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:54.181871 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-81991296-6851-4863-94de-42c4d9188994 req-026bd974-3351-4326-a948-595db751be41 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:54.196924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-867d6733-6f6f-4890-9560-dc6c2d0ca332 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:54.198381 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-867d6733-6f6f-4890-9560-dc6c2d0ca332 service neutron] 10.222.0.84 "GET /v2.0/networks?id=2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 200 len: 898 time: 0.1290751 May 12 15:49:54.308575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-2f54ac7e-21d5-4ab6-a00b-34e1c28cbfbb service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 999 time: 0.1034868 May 12 15:49:54.311464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-81991296-6851-4863-94de-42c4d9188994 req-026bd974-3351-4326-a948-595db751be41 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Calling delete_port for a75d0499-932a-4af9-bb6e-f34e6387ba0a owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:49:54.371948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-73e9ce94-8f80-4de4-aeb8-1f0f2f10a352 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:54.373491 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-73e9ce94-8f80-4de4-aeb8-1f0f2f10a352 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae HTTP/1.1" status: 200 len: 835 time: 0.0586879 May 12 15:49:54.454392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-c4946435-3bdd-41e9-b3e7-2e160cad5eef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:54.455929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-c4946435-3bdd-41e9-b3e7-2e160cad5eef service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2c49c390-e121-4f31-92ba-528e8cdf62dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0755272 May 12 15:49:54.472248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-81991296-6851-4863-94de-42c4d9188994 req-026bd974-3351-4326-a948-595db751be41 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:54.486156 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a75d0499-932a-4af9-bb6e-f34e6387ba0a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:49:54.520198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50048) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:49:54.567252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-026bd974-3351-4326-a948-595db751be41 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event deleted for resources: {'Port': ['ID=a75d0499-932a-4af9-bb6e-f34e6387ba0a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:54.598561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-3ae7edd8-b31d-4ca6-86e4-5c571c7ef07c service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1351373 May 12 15:49:54.622044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-81991296-6851-4863-94de-42c4d9188994 req-026bd974-3351-4326-a948-595db751be41 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] No DVR routers for this DVR port a75d0499-932a-4af9-bb6e-f34e6387ba0a on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:49:54.625710 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-81991296-6851-4863-94de-42c4d9188994 req-026bd974-3351-4326-a948-595db751be41 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:54.629769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b1ced7b7-ee2f-45a0-bce3-89119932d3dc', 'name': 'network-vif-deleted', 'tag': 'a75d0499-932a-4af9-bb6e-f34e6387ba0a'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:49:54.697740 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-838aff86-fc5a-4d29-82fe-25690d895e24'] response: {'server_uuid': 'b1ced7b7-ee2f-45a0-bce3-89119932d3dc', 'name': 'network-vif-deleted', 'tag': 'a75d0499-932a-4af9-bb6e-f34e6387ba0a', 'status': 'completed', 'code': 200} May 12 15:49:54.701169 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-81991296-6851-4863-94de-42c4d9188994 req-026bd974-3351-4326-a948-595db751be41 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "DELETE /v2.0/ports/a75d0499-932a-4af9-bb6e-f34e6387ba0a HTTP/1.1" status: 204 len: 173 time: 0.8513312 May 12 15:49:54.734983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b54a2b49-3d64-49e6-8911-78fc47284ffd req-a5c022be-e5fc-4e55-89c8-6be5b18dda1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:54.736478 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b54a2b49-3d64-49e6-8911-78fc47284ffd req-a5c022be-e5fc-4e55-89c8-6be5b18dda1c service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 1096 time: 0.2153540 May 12 15:49:54.758124 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02c6ba94-9606-4a04-97f3-0459a0fcfda8 req-c83fbd1d-6f9f-4dd7-9ddf-fb29e542ed12 service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1519530 May 12 15:49:54.778999 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b54a2b49-3d64-49e6-8911-78fc47284ffd req-bb9d38d8-a580-4d2f-bfe3-bdcc4db2ea34 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=70ee9218-9856-4d3d-b5da-e401c11c7db5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0366690 May 12 15:49:55.231194 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4999ca62-228b-427d-99e2-d12004ea5c8b req-9410c020-2328-454a-b57a-1a2347914b24 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b1ced7b7-ee2f-45a0-bce3-89119932d3dc HTTP/1.1" status: 200 len: 210 time: 0.0479047 May 12 15:49:55.280990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd773df2-1872-40b4-a17c-35b3e4c9a59d req-abd5c500-1f5a-4b04-bb20-deb446ed1e50 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:55.283385 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd773df2-1872-40b4-a17c-35b3e4c9a59d req-abd5c500-1f5a-4b04-bb20-deb446ed1e50 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 944 time: 0.1359465 May 12 15:49:55.334281 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd773df2-1872-40b4-a17c-35b3e4c9a59d req-4f1ddf2a-61f4-4f5f-862b-b59776522275 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451908 May 12 15:49:56.086465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device fcfbcee7-a160-4968-9ce4-95d57bd748bc no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:49:56.144132 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device fcfbcee7-a160-4968-9ce4-95d57bd748bc not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:49:56.528397 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe5b96e9-1ee9-414b-9260-78c16ddfff8f req-25999133-e3d0-4c6d-b8ab-572dbf15339a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:49:56.529893 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fe5b96e9-1ee9-414b-9260-78c16ddfff8f req-25999133-e3d0-4c6d-b8ab-572dbf15339a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 944 time: 0.0864878 May 12 15:49:56.574407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fcfbcee7-a160-4968-9ce4-95d57bd748bc details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:49:56.576761 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fe5b96e9-1ee9-414b-9260-78c16ddfff8f req-7f242dcd-fa4f-4ae0-a09f-868a6dbf88a1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407753 May 12 15:49:56.602449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50076) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:49:56.717523 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f604357e-48df-4ff7-902c-24db62805971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/553c2d8d-aaa2-4f71-b736-7b6255f73611 HTTP/1.1" status: 200 len: 991 time: 0.1127794 May 12 15:49:56.730682 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:56.744683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'port_id': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'mac_address': 'fa:16:3e:fe:e9:0f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 564, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:49:56.807267 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:56.826331 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fcfbcee7-a160-4968-9ce4-95d57bd748bc {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:49:56.841604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:56.845654 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:56.914323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=fcfbcee7-a160-4968-9ce4-95d57bd748bc,revision_number=11']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:49:57.189516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['fcfbcee7-a160-4968-9ce4-95d57bd748bc'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:49:58.117187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a75d0499-932a-4af9-bb6e-f34e6387ba0a no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:49:58.152413 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: a75d0499-932a-4af9-bb6e-f34e6387ba0a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:49:58.152747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a75d0499-932a-4af9-bb6e-f34e6387ba0a not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:49:58.575226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fcfbcee7-a160-4968-9ce4-95d57bd748bc up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:49:58.650307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port fcfbcee7-a160-4968-9ce4-95d57bd748bc completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:49:58.655912 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port fcfbcee7-a160-4968-9ce4-95d57bd748bc triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:49:58.656262 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:58.776505 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:58.809633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:49:58.820150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:49:58.824579 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:49:58.864235 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-05b8dc48-0057-46dc-9a04-a54ee247adbc'] response: {'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'code': 200} May 12 15:49:58.896047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=fcfbcee7-a160-4968-9ce4-95d57bd748bc,revision_number=12']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:02.599715 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:10.373752 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63e84b00-437d-4dbd-b22a-656878a8381e req-b1103555-5e09-4665-a749-cdfaa9f8bf53 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0971379 May 12 15:50:10.484636 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63e84b00-437d-4dbd-b22a-656878a8381e req-fcc4f1a2-f577-4391-9082-dc6e680bcf70 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0444074 May 12 15:50:10.526229 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63e84b00-437d-4dbd-b22a-656878a8381e req-57905189-adab-45eb-9fc8-ad50e5de72ad service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0250466 May 12 15:50:10.666110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63e84b00-437d-4dbd-b22a-656878a8381e req-8151e976-ed3a-4103-9c74-74626c43c5be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:10.667545 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63e84b00-437d-4dbd-b22a-656878a8381e req-8151e976-ed3a-4103-9c74-74626c43c5be service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1359937 May 12 15:50:12.756341 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1b412f60-1fe7-4ed3-8e02-aa2d265bb7aa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:12.960572 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:50:13.348736 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:15.312751 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5d574cb7-3b04-47db-9304-7bc4ba650e24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:16.044724 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:16.114655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-cd169d0f-327d-4a19-a3f5-dcaab8e8630d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:16.116097 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-cd169d0f-327d-4a19-a3f5-dcaab8e8630d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 812 time: 0.1502266 May 12 15:50:16.131880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-489545ad-6740-416a-930a-8f950ef35e0e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/quotas/939000b7f70c4c85a39e52ee93a06ed5 HTTP/1.1" status: 200 len: 375 time: 0.0103977 May 12 15:50:16.213617 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ca6b2663-6f25-43de-b549-ec2cce8e26c3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0765941 May 12 15:50:16.283671 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:16.400419 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-c51eb68d-3c96-4ccc-af7d-1aad6afe2035 service neutron] 10.222.0.82 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1797836 May 12 15:50:16.630749 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f47e8d62-1d61-434d-8647-353f383e96d3 service neutron] 10.222.0.82 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2244093 May 12 15:50:17.020104 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b7a425b-11a4-4b71-9672-caf8051b5a49 req-2acc0565-c63d-4db5-85c0-fa96ca6dbec8 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 210 time: 0.0490537 May 12 15:50:17.756597 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:18.115074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-e85ce0fb-992f-48a6-ac10-329dbad07d11 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:18.116675 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-e85ce0fb-992f-48a6-ac10-329dbad07d11 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 812 time: 0.2591863 May 12 15:50:18.129685 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'port': {'device_id': 'f0459b60-9f54-4abe-a672-1cf9077c6465', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'admin_state_up': True, 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:18.184966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6d3f549-7d1c-497e-a289-18fad011ad35 req-5ea109ed-c42c-4803-9eca-085e99fcb8c4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 210 time: 0.0483060 May 12 15:50:18.276112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:50:18.280211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:port and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:50:18.283168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:50:18.288941 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:50:18.299123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Made reservation on behalf of 939000b7f70c4c85a39e52ee93a06ed5 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:50:18.302755 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:18.467515 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Allocated IP 172.20.0.10 (d13f4c27-5358-4d60-abb1-0c94e69df718/020f79af-22ce-41ca-91a6-931258be2176/3dbc269e-09ab-4df2-bf68-d107d7df7c00) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:50:18.675791 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:18.691779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Transition to ACTIVE for port object 3dbc269e-09ab-4df2-bf68-d107d7df7c00 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:50:18.717265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:18.794102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Network d13f4c27-5358-4d60-abb1-0c94e69df718 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:50:18.797433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:50:18.801512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:50:18.834868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'Port': ['ID=3dbc269e-09ab-4df2-bf68-d107d7df7c00,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:18.855536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:18.855874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:18.856210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:18.856551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:18.856863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:18.857183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:18.857533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:18.857853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:18.858174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:18.858487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:18.858802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:18.859117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:18.883966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:18.884582 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:18.910775 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-ff67da31-e519-4b59-a295-953b65ce692e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7862825 May 12 15:50:18.921850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Request body: {'port': {'device_id': 'f0459b60-9f54-4abe-a672-1cf9077c6465', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:19.038336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-31156e25-ecd7-42f0-8f2e-b5c11a7afe42 None None] Provisioning for port 3dbc269e-09ab-4df2-bf68-d107d7df7c00 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:50:19.040339 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:19.043603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-31156e25-ecd7-42f0-8f2e-b5c11a7afe42 None None] Provisioning complete for port 3dbc269e-09ab-4df2-bf68-d107d7df7c00 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:50:19.043971 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-31156e25-ecd7-42f0-8f2e-b5c11a7afe42 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:19.098257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-31156e25-ecd7-42f0-8f2e-b5c11a7afe42 None None] Port 3dbc269e-09ab-4df2-bf68-d107d7df7c00 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:50:19.397009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90df6d73-7987-465f-8949-875d84526e3a req-b4acf27d-9ed7-4a8c-8808-ef2e04cfb18b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:19.398622 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-90df6d73-7987-465f-8949-875d84526e3a req-b4acf27d-9ed7-4a8c-8808-ef2e04cfb18b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 932 time: 0.0858192 May 12 15:50:19.400038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3dbc269e-09ab-4df2-bf68-d107d7df7c00 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:50:19.408615 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:19.424432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Transition to ACTIVE for port object 3dbc269e-09ab-4df2-bf68-d107d7df7c00 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:50:19.429790 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:19.446648 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-90df6d73-7987-465f-8949-875d84526e3a req-f8dec830-4b68-4a7d-91db-9278d0ece649 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392399 May 12 15:50:19.568011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Pushing event updated for resources: {'Port': ['ID=3dbc269e-09ab-4df2-bf68-d107d7df7c00,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:19.684681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Attempting to bind port 3dbc269e-09ab-4df2-bf68-d107d7df7c00 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:50:19.685086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Attempting to bind port 3dbc269e-09ab-4df2-bf68-d107d7df7c00 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:50:19.685576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Attempting to bind port 3dbc269e-09ab-4df2-bf68-d107d7df7c00 on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:50:19.691132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Port 3dbc269e-09ab-4df2-bf68-d107d7df7c00 on network d13f4c27-5358-4d60-abb1-0c94e69df718 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:50:19.691450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Attempting to bind port 3dbc269e-09ab-4df2-bf68-d107d7df7c00 on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:50:19.696603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 50, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:50:19.696938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Checking segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:50:19.697321 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Bound using segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:50:19.697783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Bound port: 3dbc269e-09ab-4df2-bf68-d107d7df7c00, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:50:19.698126 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:19.790198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] For port 3dbc269e-09ab-4df2-bf68-d107d7df7c00, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:50:19.793054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] For port 3dbc269e-09ab-4df2-bf68-d107d7df7c00, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3dbc269e-09ab-4df2-bf68-d107d7df7c00,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:50:19.798051 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:19.858087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:19.858625 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:19.860466 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] 10.222.0.76 "PUT /v2.0/ports/3dbc269e-09ab-4df2-bf68-d107d7df7c00 HTTP/1.1" status: 200 len: 1092 time: 0.9429243 May 12 15:50:19.863270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f0459b60-9f54-4abe-a672-1cf9077c6465', 'tag': '3dbc269e-09ab-4df2-bf68-d107d7df7c00'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:50:19.888712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8835033-f02d-49d5-a7f0-c6010466750a service neutron] Pushing event updated for resources: {'Port': ['ID=3dbc269e-09ab-4df2-bf68-d107d7df7c00,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:19.944090 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-82cf83fd-9d06-4ae0-910b-8e5f08bea6d4'] response: {'name': 'network-changed', 'server_uuid': 'f0459b60-9f54-4abe-a672-1cf9077c6465', 'tag': '3dbc269e-09ab-4df2-bf68-d107d7df7c00', 'status': 'completed', 'code': 200} May 12 15:50:19.986946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-4493dbc3-7c3d-49a6-bbc6-fc6ad185dfc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:19.988353 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-4493dbc3-7c3d-49a6-bbc6-fc6ad185dfc3 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 1095 time: 0.0768781 May 12 15:50:20.173894 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-3f2585a1-351b-491c-8195-ce3c2b63b688 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3dbc269e-09ab-4df2-bf68-d107d7df7c00 HTTP/1.1" status: 200 len: 217 time: 0.1792810 May 12 15:50:20.237152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-c556698c-697b-45c7-969f-3927e01da3fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:20.238510 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-c556698c-697b-45c7-969f-3927e01da3fb service neutron] 10.222.0.76 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0593822 May 12 15:50:20.318623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-a90c231c-58c3-49b4-b6b0-7777c775cbb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:20.320082 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-a90c231c-58c3-49b4-b6b0-7777c775cbb6 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0760558 May 12 15:50:20.454438 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-db7edba9-e327-46ba-8665-70bc3e83db41 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1273537 May 12 15:50:20.589563 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60f7fca2-74e2-485c-9f2c-b84021f2ca5d req-21384729-3469-45b7-81bf-0934eb139ed1 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1297069 May 12 15:50:20.641878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265c4222-2b8b-41e6-8617-9f83a7a72b7a req-69968f20-9c86-40a2-95fe-10372effcf5b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:20.643361 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265c4222-2b8b-41e6-8617-9f83a7a72b7a req-69968f20-9c86-40a2-95fe-10372effcf5b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 944 time: 0.0847223 May 12 15:50:20.690133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-265c4222-2b8b-41e6-8617-9f83a7a72b7a req-9739efaa-bcf1-4aff-bc6a-a9d8338a19f5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410531 May 12 15:50:20.703643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6641816-2a39-4838-9549-db404463147c req-af4c102b-19e3-4dd1-be05-e9c40cda7d45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:20.705125 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6641816-2a39-4838-9549-db404463147c req-af4c102b-19e3-4dd1-be05-e9c40cda7d45 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 1095 time: 0.0720205 May 12 15:50:20.838005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6641816-2a39-4838-9549-db404463147c req-4eb81728-8c36-48e7-8507-3c4d19b2a70e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:20.839439 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6641816-2a39-4838-9549-db404463147c req-4eb81728-8c36-48e7-8507-3c4d19b2a70e service neutron] 10.222.0.76 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1283362 May 12 15:50:20.910471 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6641816-2a39-4838-9549-db404463147c req-49bd2a70-7d0a-4094-8f77-13c354fbd81e service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3dbc269e-09ab-4df2-bf68-d107d7df7c00 HTTP/1.1" status: 200 len: 217 time: 0.0643256 May 12 15:50:20.972736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6641816-2a39-4838-9549-db404463147c req-075f79fc-79c9-48c7-8cc0-cfa21da41251 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:20.977617 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6641816-2a39-4838-9549-db404463147c req-075f79fc-79c9-48c7-8cc0-cfa21da41251 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0564072 May 12 15:50:21.051332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6641816-2a39-4838-9549-db404463147c req-8d75571d-b5e2-4bb7-9c37-69341a99d2fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:21.052774 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6641816-2a39-4838-9549-db404463147c req-8d75571d-b5e2-4bb7-9c37-69341a99d2fd service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0741346 May 12 15:50:21.183707 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6641816-2a39-4838-9549-db404463147c req-225943cd-762b-48c1-9406-9ecb774f2289 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1246860 May 12 15:50:21.311531 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e6641816-2a39-4838-9549-db404463147c req-e115e3c9-f3f5-455e-b37f-91059f1c62b4 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1224670 May 12 15:50:21.879165 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa456b20-28d2-448c-be28-2a2120ca3c3f req-8c4ff34b-2294-4747-9a77-9c82e0576b86 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:21.880597 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa456b20-28d2-448c-be28-2a2120ca3c3f req-8c4ff34b-2294-4747-9a77-9c82e0576b86 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 944 time: 0.0824451 May 12 15:50:21.924025 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aa456b20-28d2-448c-be28-2a2120ca3c3f req-58b89a8d-616d-4bc6-a1be-0411d7036c0c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378067 May 12 15:50:23.115235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-761a5dc9-e5ae-47ca-960e-630102550cf3 req-b9681be5-a506-4a21-a897-a887fa3fe663 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:23.116584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-761a5dc9-e5ae-47ca-960e-630102550cf3 req-b9681be5-a506-4a21-a897-a887fa3fe663 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 944 time: 0.0881493 May 12 15:50:23.164125 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-761a5dc9-e5ae-47ca-960e-630102550cf3 req-4c5e590e-8948-4a1c-b69e-d236796a3541 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418191 May 12 15:50:24.352130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a710400-c8de-4e11-9d23-d85a4c549576 req-217b0d52-abdb-431f-bc80-7127d1dafd17 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:24.353605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a710400-c8de-4e11-9d23-d85a4c549576 req-217b0d52-abdb-431f-bc80-7127d1dafd17 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 944 time: 0.0834196 May 12 15:50:24.400690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a710400-c8de-4e11-9d23-d85a4c549576 req-07d97c76-1c22-4391-b48a-447dfacec93d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413563 May 12 15:50:25.587820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40120066-580c-4792-8a07-56a29bd496c4 req-80e87363-d51d-4cf3-b34e-aee3e501cf47 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:25.589173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40120066-580c-4792-8a07-56a29bd496c4 req-80e87363-d51d-4cf3-b34e-aee3e501cf47 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 944 time: 0.0829136 May 12 15:50:25.632723 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40120066-580c-4792-8a07-56a29bd496c4 req-cf750c0c-3726-4e39-a140-9a109330aedc tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377448 May 12 15:50:26.812427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5678f930-7c2f-4c79-af62-1a62532c472f req-89cdd256-7a0f-4665-9ffb-47aacee5a578 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:26.814428 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5678f930-7c2f-4c79-af62-1a62532c472f req-89cdd256-7a0f-4665-9ffb-47aacee5a578 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 944 time: 0.0795095 May 12 15:50:26.857642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5678f930-7c2f-4c79-af62-1a62532c472f req-24deb16d-2c31-419b-9c8b-a0fc6d0d7dab tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372312 May 12 15:50:28.054053 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-533b04e4-0153-4678-bb79-e90ab287a233 req-93589e3b-2f7f-4e25-acc0-e49dfc71cd9e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:28.055424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-533b04e4-0153-4678-bb79-e90ab287a233 req-93589e3b-2f7f-4e25-acc0-e49dfc71cd9e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 944 time: 0.0828099 May 12 15:50:28.099499 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-533b04e4-0153-4678-bb79-e90ab287a233 req-db8b661c-08fe-4fe0-8199-62c8b5614910 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382550 May 12 15:50:28.194927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 3dbc269e-09ab-4df2-bf68-d107d7df7c00 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:50:28.332847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 3dbc269e-09ab-4df2-bf68-d107d7df7c00, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3dbc269e-09ab-4df2-bf68-d107d7df7c00,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:50:28.345833 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '3dbc269e-09ab-4df2-bf68-d107d7df7c00', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'port_id': '3dbc269e-09ab-4df2-bf68-d107d7df7c00', 'mac_address': 'fa:16:3e:0a:d6:83', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 566, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:50:28.400355 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:28.416524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3dbc269e-09ab-4df2-bf68-d107d7df7c00 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:50:28.432567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 3dbc269e-09ab-4df2-bf68-d107d7df7c00, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3dbc269e-09ab-4df2-bf68-d107d7df7c00,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:50:28.436106 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:28.504281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=3dbc269e-09ab-4df2-bf68-d107d7df7c00,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:28.633188 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['3dbc269e-09ab-4df2-bf68-d107d7df7c00'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:50:29.288293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-519260df-a426-4858-83f9-245813139136 req-b72a573e-a639-4a94-8d88-d73824581b30 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:29.289804 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-519260df-a426-4858-83f9-245813139136 req-b72a573e-a639-4a94-8d88-d73824581b30 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 945 time: 0.0807149 May 12 15:50:29.334498 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-519260df-a426-4858-83f9-245813139136 req-d0de0f87-f38c-490e-b171-40bc7fa47437 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387154 May 12 15:50:29.424229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d12e049-b294-46bd-8515-6dd3bae1cb73 req-c978f627-dc22-40dd-8de2-ba90367b8740 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:29.425636 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d12e049-b294-46bd-8515-6dd3bae1cb73 req-c978f627-dc22-40dd-8de2-ba90367b8740 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1097 time: 0.0775402 May 12 15:50:29.467562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d12e049-b294-46bd-8515-6dd3bae1cb73 req-6f16e5cf-24f3-43af-b6c3-93508e1568cd tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0362988 May 12 15:50:29.490099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50292) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:29.694101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-79ae284a-bf0a-45f1-a3fe-bc4b32544b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port 72328225-023d-4371-9794-c0b90b5becf4 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:50:29.694348 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79ae284a-bf0a-45f1-a3fe-bc4b32544b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:29.860359 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79ae284a-bf0a-45f1-a3fe-bc4b32544b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:29.860677 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79ae284a-bf0a-45f1-a3fe-bc4b32544b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:30.074964 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-79ae284a-bf0a-45f1-a3fe-bc4b32544b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for 72328225-023d-4371-9794-c0b90b5becf4 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:50:30.194505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 3dbc269e-09ab-4df2-bf68-d107d7df7c00 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:50:30.220763 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79ae284a-bf0a-45f1-a3fe-bc4b32544b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:30.267664 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 3dbc269e-09ab-4df2-bf68-d107d7df7c00 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:50:30.272649 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 3dbc269e-09ab-4df2-bf68-d107d7df7c00 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:50:30.273108 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:30.305774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79ae284a-bf0a-45f1-a3fe-bc4b32544b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=72328225-023d-4371-9794-c0b90b5becf4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:30.368168 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79ae284a-bf0a-45f1-a3fe-bc4b32544b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:30.368506 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-79ae284a-bf0a-45f1-a3fe-bc4b32544b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Floating IP 553c2d8d-aaa2-4f71-b736-7b6255f73611 disassociated (deleted). External IP: 172.25.8.172, port: fcfbcee7-a160-4968-9ce4-95d57bd748bc. May 12 15:50:30.391238 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:30.418457 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0459b60-9f54-4abe-a672-1cf9077c6465', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3dbc269e-09ab-4df2-bf68-d107d7df7c00'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:50:30.428572 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 3dbc269e-09ab-4df2-bf68-d107d7df7c00, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3dbc269e-09ab-4df2-bf68-d107d7df7c00,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:50:30.437106 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:30.482341 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bd72012d-292f-4fd1-945f-69cb9f22262f'] response: {'server_uuid': 'f0459b60-9f54-4abe-a672-1cf9077c6465', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3dbc269e-09ab-4df2-bf68-d107d7df7c00', 'code': 200} May 12 15:50:30.508817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=3dbc269e-09ab-4df2-bf68-d107d7df7c00,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:30.611182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98aa0392-9f52-4ce1-aedc-ba1b2b239249 req-f92cbd68-daaa-4921-8729-7d8ea34a68c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:30.612649 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-98aa0392-9f52-4ce1-aedc-ba1b2b239249 req-f92cbd68-daaa-4921-8729-7d8ea34a68c7 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 1097 time: 0.0727103 May 12 15:50:30.652627 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-98aa0392-9f52-4ce1-aedc-ba1b2b239249 req-74c6624e-ddcf-49d5-bb7b-a606099464b8 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338874 May 12 15:50:30.676877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d27cca0-c8ae-4cab-959b-0bba2ecadb17 req-140f6a3e-fa1b-4620-9856-579da902d9f6 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:30.678338 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d27cca0-c8ae-4cab-959b-0bba2ecadb17 req-140f6a3e-fa1b-4620-9856-579da902d9f6 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 946 time: 0.2244740 May 12 15:50:30.812145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9d27cca0-c8ae-4cab-959b-0bba2ecadb17 req-c93b6173-7069-4508-98bd-3d92363e2b6b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1258695 May 12 15:50:30.836276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-79ae284a-bf0a-45f1-a3fe-bc4b32544b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router 8730f760-162a-4cbe-920e-62ab9491281b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:50:31.010417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-79ae284a-bf0a-45f1-a3fe-bc4b32544b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:50:31.021058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8df6a33c-81e3-450b-a25f-caa3bc20f03a None None] Sync routers for ids ['8730f760-162a-4cbe-920e-62ab9491281b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:50:31.030219 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79ae284a-bf0a-45f1-a3fe-bc4b32544b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:31.030544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8df6a33c-81e3-450b-a25f-caa3bc20f03a None None] Routers {'8730f760-162a-4cbe-920e-62ab9491281b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:50:31.031702 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8df6a33c-81e3-450b-a25f-caa3bc20f03a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:50:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8730f760-162a-4cbe-920e-62ab9491281b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:31.086579 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-79ae284a-bf0a-45f1-a3fe-bc4b32544b64 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/floatingips/553c2d8d-aaa2-4f71-b736-7b6255f73611 HTTP/1.1" status: 204 len: 168 time: 1.5954256 May 12 15:50:31.087486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:50:31.139361 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-abb369a3-e43c-4b6f-bace-259e48ff39de'] response: {'name': 'network-changed', 'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'status': 'completed', 'code': 200} May 12 15:50:31.267555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d003f869-f4c0-4611-99f5-02bfdded575e req-c65ac5ae-f4b0-44d1-b0c2-c13ddc56aeea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:31.269555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d003f869-f4c0-4611-99f5-02bfdded575e req-c65ac5ae-f4b0-44d1-b0c2-c13ddc56aeea service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 1097 time: 0.0829530 May 12 15:50:31.283161 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8df6a33c-81e3-450b-a25f-caa3bc20f03a None None] Set router 8730f760-162a-4cbe-920e-62ab9491281b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:50:31.417905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d003f869-f4c0-4611-99f5-02bfdded575e req-782e7e68-2dc0-4660-950b-dd3b4d54487c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:31.419336 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d003f869-f4c0-4611-99f5-02bfdded575e req-782e7e68-2dc0-4660-950b-dd3b4d54487c service neutron] 10.222.0.84 "GET /v2.0/networks?id=2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 200 len: 898 time: 0.1436937 May 12 15:50:31.619244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8df6a33c-81e3-450b-a25f-caa3bc20f03a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:48:22Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'ba356da3-692c-41a7-9dae-e94814fdc047', 'name': '', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:88:8c:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3982, 'fixed_ips': [{'subnet_id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:20Z', 'updated_at': '2022-05-12T15:48:34Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:31.623234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8df6a33c-81e3-450b-a25f-caa3bc20f03a None None] Checking router: 8730f760-162a-4cbe-920e-62ab9491281b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:50:31.632563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8df6a33c-81e3-450b-a25f-caa3bc20f03a None None] Routers {'8730f760-162a-4cbe-920e-62ab9491281b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:50:31.633193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8df6a33c-81e3-450b-a25f-caa3bc20f03a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:50:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8730f760-162a-4cbe-920e-62ab9491281b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:31.644475 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d003f869-f4c0-4611-99f5-02bfdded575e req-3c18312c-4887-4118-a57e-dff31066bae7 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 200 len: 217 time: 0.1916420 May 12 15:50:31.725778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d003f869-f4c0-4611-99f5-02bfdded575e req-7438cbc5-a953-40dd-9b94-383c9c3df1b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:31.728547 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d003f869-f4c0-4611-99f5-02bfdded575e req-7438cbc5-a953-40dd-9b94-383c9c3df1b6 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae HTTP/1.1" status: 200 len: 835 time: 0.0749006 May 12 15:50:31.740218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f93038e8-78e4-43b4-af22-0552edf02d61 req-02e739bf-f286-4336-bd05-d3575cf5718c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:31.740823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f93038e8-78e4-43b4-af22-0552edf02d61 req-02e739bf-f286-4336-bd05-d3575cf5718c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:50:31.801955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-f93038e8-78e4-43b4-af22-0552edf02d61 req-02e739bf-f286-4336-bd05-d3575cf5718c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:50:31.803104 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f93038e8-78e4-43b4-af22-0552edf02d61 req-02e739bf-f286-4336-bd05-d3575cf5718c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 946 time: 0.3805344 May 12 15:50:31.821519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8df6a33c-81e3-450b-a25f-caa3bc20f03a None None] Set router 8730f760-162a-4cbe-920e-62ab9491281b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:50:31.852230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d003f869-f4c0-4611-99f5-02bfdded575e req-efc1698f-9fcc-470e-9687-c60000318db6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:31.853693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d003f869-f4c0-4611-99f5-02bfdded575e req-efc1698f-9fcc-470e-9687-c60000318db6 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=2c49c390-e121-4f31-92ba-528e8cdf62dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1101377 May 12 15:50:31.861627 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f93038e8-78e4-43b4-af22-0552edf02d61 req-f1902029-d028-42eb-8b38-955ad835a3d1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505989 May 12 15:50:32.050892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d003f869-f4c0-4611-99f5-02bfdded575e req-373d66b1-5527-4bbb-a8fa-f1186b6df91c service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1883299 May 12 15:50:32.063381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde04641-ec26-4b74-b134-d3f0f7cd3b3d req-6b6f6873-5d95-4a12-a89e-b5d6c5104760 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:32.064377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dde04641-ec26-4b74-b134-d3f0f7cd3b3d req-6b6f6873-5d95-4a12-a89e-b5d6c5104760 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 946 time: 0.1314595 May 12 15:50:32.102570 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3ef295a-f3ee-454e-8341-8caa89e23222 req-96bca3c3-36b8-4ab6-b0b5-e8c52661591b service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0872140 May 12 15:50:32.158409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8df6a33c-81e3-450b-a25f-caa3bc20f03a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:48:22Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'ba356da3-692c-41a7-9dae-e94814fdc047', 'name': '', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:88:8c:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3982, 'fixed_ips': [{'subnet_id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:20Z', 'updated_at': '2022-05-12T15:48:34Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:32.162645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8df6a33c-81e3-450b-a25f-caa3bc20f03a None None] The sync data for ids ['8730f760-162a-4cbe-920e-62ab9491281b'] in n-d-841483-1 is: [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:48:22Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'ba356da3-692c-41a7-9dae-e94814fdc047', 'name': '', 'network_id': '2c49c390-e121-4f31-92ba-528e8cdf62dd', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:88:8c:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3982, 'fixed_ips': [{'subnet_id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:20Z', 'updated_at': '2022-05-12T15:48:34Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:50:32.190182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dde04641-ec26-4b74-b134-d3f0f7cd3b3d req-cdc1ffc9-4f4b-429d-866b-d80e7ee22bcb tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1074040 May 12 15:50:32.217061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3ef295a-f3ee-454e-8341-8caa89e23222 req-fe747da3-d1f0-4841-93fe-0d0acbd18dc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:32.218618 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3ef295a-f3ee-454e-8341-8caa89e23222 req-fe747da3-d1f0-4841-93fe-0d0acbd18dc0 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1151aa532835463f914c578c906281f8&device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 1096 time: 0.0833933 May 12 15:50:32.238193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d003f869-f4c0-4611-99f5-02bfdded575e req-f8d7f24f-835a-4d6b-bca1-34b1efc6f11c service neutron] 10.222.0.84 "GET /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1727285 May 12 15:50:32.393807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e003980-0e89-412a-8e03-7ec0f58e2db9 req-2e39926d-68d0-4671-a0ae-95b326c8c2de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:32.401424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e003980-0e89-412a-8e03-7ec0f58e2db9 req-2e39926d-68d0-4671-a0ae-95b326c8c2de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 946 time: 0.0921049 May 12 15:50:32.402896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3ef295a-f3ee-454e-8341-8caa89e23222 req-1c6255eb-125e-4775-85f3-aa3fca407bde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:32.404358 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3ef295a-f3ee-454e-8341-8caa89e23222 req-1c6255eb-125e-4775-85f3-aa3fca407bde service neutron] 10.222.0.84 "GET /v2.0/networks?id=b6bf3355-4481-47dd-96cc-1e4a6e5445a3 HTTP/1.1" status: 200 len: 907 time: 0.1439085 May 12 15:50:32.448532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e003980-0e89-412a-8e03-7ec0f58e2db9 req-027d1a63-76b5-489f-89c9-54bbd5dc0f39 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461807 May 12 15:50:32.459002 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a04416bf-d510-457b-9487-e175118dee14 None None] New status for floating IP 553c2d8d-aaa2-4f71-b736-7b6255f73611: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:50:32.602672 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:32.645469 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3ef295a-f3ee-454e-8341-8caa89e23222 req-3d862b74-7cfb-4739-869e-1c259bf48dac service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b HTTP/1.1" status: 200 len: 1001 time: 0.2340531 May 12 15:50:32.713782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3ef295a-f3ee-454e-8341-8caa89e23222 req-b3b5ca1b-1621-4d2b-b14b-ec8773e283b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:32.715217 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3ef295a-f3ee-454e-8341-8caa89e23222 req-b3b5ca1b-1621-4d2b-b14b-ec8773e283b9 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=a6a2c883-c889-4a5d-b880-b94c7f7dbeff HTTP/1.1" status: 200 len: 845 time: 0.0619113 May 12 15:50:32.808677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3ef295a-f3ee-454e-8341-8caa89e23222 req-61461cf4-0a9c-4da7-8a38-6cb674811ab3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:32.810176 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3ef295a-f3ee-454e-8341-8caa89e23222 req-61461cf4-0a9c-4da7-8a38-6cb674811ab3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b6bf3355-4481-47dd-96cc-1e4a6e5445a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0783510 May 12 15:50:32.957233 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3ef295a-f3ee-454e-8341-8caa89e23222 req-4e3e5925-ac83-4462-8385-8cedd93c5ba0 service neutron] 10.222.0.84 "GET /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1350529 May 12 15:50:33.137128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15acfe08-ff90-4010-89d0-c72ed439dac1 req-933d736c-8aac-4962-b8d3-b5f6c7d17c75 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:33.138615 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15acfe08-ff90-4010-89d0-c72ed439dac1 req-933d736c-8aac-4962-b8d3-b5f6c7d17c75 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.84 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 946 time: 0.1180451 May 12 15:50:33.179192 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3ef295a-f3ee-454e-8341-8caa89e23222 req-8284cf70-0a04-4a5c-96e6-267f68c78333 service neutron] 10.222.0.84 "GET /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1650519 May 12 15:50:33.217076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-554fef0a-969f-4298-a69b-78f9adb9b74b req-124143ca-be78-4c06-833f-f49cfcc2128a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:33.219310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-554fef0a-969f-4298-a69b-78f9adb9b74b req-124143ca-be78-4c06-833f-f49cfcc2128a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 946 time: 0.2453156 May 12 15:50:33.244647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-15acfe08-ff90-4010-89d0-c72ed439dac1 req-6c5848b7-d60e-4cf4-a5bb-32ccdfdbfddc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port fcfbcee7-a160-4968-9ce4-95d57bd748bc {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:50:33.245195 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15acfe08-ff90-4010-89d0-c72ed439dac1 req-6c5848b7-d60e-4cf4-a5bb-32ccdfdbfddc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:33.335422 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-554fef0a-969f-4298-a69b-78f9adb9b74b req-4cf939e3-edef-4f00-b4d6-0e11a54163f3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=7161f302-3fa1-419c-846a-d65b5f05897a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0960994 May 12 15:50:33.546188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-15acfe08-ff90-4010-89d0-c72ed439dac1 req-6c5848b7-d60e-4cf4-a5bb-32ccdfdbfddc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] For port fcfbcee7-a160-4968-9ce4-95d57bd748bc, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=fcfbcee7-a160-4968-9ce4-95d57bd748bc,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:50:33.548070 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15acfe08-ff90-4010-89d0-c72ed439dac1 req-6c5848b7-d60e-4cf4-a5bb-32ccdfdbfddc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:33.675917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-15acfe08-ff90-4010-89d0-c72ed439dac1 req-6c5848b7-d60e-4cf4-a5bb-32ccdfdbfddc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for fcfbcee7-a160-4968-9ce4-95d57bd748bc owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:50:33.834549 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15acfe08-ff90-4010-89d0-c72ed439dac1 req-6c5848b7-d60e-4cf4-a5bb-32ccdfdbfddc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:33.895763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c5848b7-d60e-4cf4-a5bb-32ccdfdbfddc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=fcfbcee7-a160-4968-9ce4-95d57bd748bc,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:34.098765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-15acfe08-ff90-4010-89d0-c72ed439dac1 req-6c5848b7-d60e-4cf4-a5bb-32ccdfdbfddc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] No DVR routers for this DVR port fcfbcee7-a160-4968-9ce4-95d57bd748bc on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:50:34.101179 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15acfe08-ff90-4010-89d0-c72ed439dac1 req-6c5848b7-d60e-4cf4-a5bb-32ccdfdbfddc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:34.103816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'name': 'network-vif-deleted', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:50:34.143652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15acfe08-ff90-4010-89d0-c72ed439dac1 req-6c5848b7-d60e-4cf4-a5bb-32ccdfdbfddc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.84 "DELETE /v2.0/ports/fcfbcee7-a160-4968-9ce4-95d57bd748bc HTTP/1.1" status: 204 len: 173 time: 0.9956439 May 12 15:50:34.199727 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-30e43e4a-088f-4de5-92fa-dcc001b62d10'] response: {'server_uuid': '14a655a9-bdaa-4d2e-8238-f05604300363', 'name': 'network-vif-deleted', 'tag': 'fcfbcee7-a160-4968-9ce4-95d57bd748bc', 'status': 'completed', 'code': 200} May 12 15:50:34.517256 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4847f90e-e9e5-4abe-a95b-9932602b211e req-f5f1c000-709b-4bfd-a9fa-c26178ed6b86 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:50:34.531982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-4847f90e-e9e5-4abe-a95b-9932602b211e req-f5f1c000-709b-4bfd-a9fa-c26178ed6b86 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:50:34.533511 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4847f90e-e9e5-4abe-a95b-9932602b211e req-f5f1c000-709b-4bfd-a9fa-c26178ed6b86 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=14a655a9-bdaa-4d2e-8238-f05604300363 HTTP/1.1" status: 200 len: 210 time: 0.0591526 May 12 15:50:35.320246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-582d8d03-f1e7-4f09-9de2-a4f790273063 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:35.321690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-582d8d03-f1e7-4f09-9de2-a4f790273063 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 812 time: 0.1421514 May 12 15:50:35.337031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-b67bc7ef-de41-4dec-b516-4252909f7ab7 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/quotas/939000b7f70c4c85a39e52ee93a06ed5 HTTP/1.1" status: 200 len: 375 time: 0.0099590 May 12 15:50:35.422963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-0d147330-296a-41d0-bd93-0d24733bbce0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0809052 May 12 15:50:35.610301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-a20c7f82-77dc-4e45-ab10-31433e410e57 service neutron] 10.222.0.82 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1797142 May 12 15:50:35.627140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50396) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:35.744503 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-aaaaeaa5-ee3d-4162-b8f0-52f3584f983e service neutron] 10.222.0.82 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1284521 May 12 15:50:35.973435 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0c5d3f3-f5db-448c-9586-ecccebe097c1 req-f871fd01-e724-4f67-9411-36ca3222e141 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 210 time: 0.0432730 May 12 15:50:36.216523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b364698-78f9-46bf-9db2-c6c3ab4aa798 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:36.587782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8b364698-78f9-46bf-9db2-c6c3ab4aa798 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port ba356da3-692c-41a7-9dae-e94814fdc047 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:50:36.588122 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b364698-78f9-46bf-9db2-c6c3ab4aa798 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:36.798468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fcfbcee7-a160-4968-9ce4-95d57bd748bc no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:50:36.834409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: fcfbcee7-a160-4968-9ce4-95d57bd748bc {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:50:36.834743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device fcfbcee7-a160-4968-9ce4-95d57bd748bc not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:50:36.896662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-8b364698-78f9-46bf-9db2-c6c3ab4aa798 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] For port ba356da3-692c-41a7-9dae-e94814fdc047, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ba356da3-692c-41a7-9dae-e94814fdc047,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:50:36.897265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b364698-78f9-46bf-9db2-c6c3ab4aa798 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:37.026444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-8b364698-78f9-46bf-9db2-c6c3ab4aa798 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for ba356da3-692c-41a7-9dae-e94814fdc047 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:50:37.217985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-731079bd-14ff-4f90-9034-6ccb62d45f70 req-229fe2ce-487b-41e3-bd1c-e75d5798cd0d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 210 time: 0.0976582 May 12 15:50:37.316537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-8b6c4f62-7d51-4d3a-bf30-7c5fef170ea8 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:37.318073 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-8b6c4f62-7d51-4d3a-bf30-7c5fef170ea8 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.84 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 812 time: 0.2331595 May 12 15:50:37.341062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'port': {'device_id': '43a0f365-5784-43c7-b293-9e5fe54bd81a', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'admin_state_up': True, 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:37.449811 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b364698-78f9-46bf-9db2-c6c3ab4aa798 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:37.497778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:50:37.502548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:port and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:50:37.515232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:50:37.523244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:50:37.539303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Made reservation on behalf of 939000b7f70c4c85a39e52ee93a06ed5 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:50:37.542854 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:37.562323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b364698-78f9-46bf-9db2-c6c3ab4aa798 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=ba356da3-692c-41a7-9dae-e94814fdc047,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:37.805959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Allocated IP 172.20.0.11 (d13f4c27-5358-4d60-abb1-0c94e69df718/020f79af-22ce-41ca-91a6-931258be2176/bf953e28-a55a-4b66-91d5-4f44a6c42d01) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:50:37.853776 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8b364698-78f9-46bf-9db2-c6c3ab4aa798 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:38.044595 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:38.065869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Transition to ACTIVE for port object bf953e28-a55a-4b66-91d5-4f44a6c42d01 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:50:38.097248 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:38.110372 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['3dbc269e-09ab-4df2-bf68-d107d7df7c00'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:50:38.283989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Network d13f4c27-5358-4d60-abb1-0c94e69df718 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:50:38.292356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:50:38.305419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:50:38.395718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'Port': ['ID=bf953e28-a55a-4b66-91d5-4f44a6c42d01,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:38.428860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b364698-78f9-46bf-9db2-c6c3ab4aa798 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router 8730f760-162a-4cbe-920e-62ab9491281b has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:50:38.434737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:38.435822 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:38.474574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-696b2cf8-c4d3-47af-8d26-b1868fcbe75d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1384647 May 12 15:50:38.500977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Request body: {'port': {'device_id': '43a0f365-5784-43c7-b293-9e5fe54bd81a', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:38.684113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5bb3163b-eb21-4edc-abf9-129e6d7fa1e8 None None] Provisioning for port bf953e28-a55a-4b66-91d5-4f44a6c42d01 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:50:38.691087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5bb3163b-eb21-4edc-abf9-129e6d7fa1e8 None None] Provisioning complete for port bf953e28-a55a-4b66-91d5-4f44a6c42d01 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:50:38.691462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5bb3163b-eb21-4edc-abf9-129e6d7fa1e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:38.753630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5bb3163b-eb21-4edc-abf9-129e6d7fa1e8 None None] Port bf953e28-a55a-4b66-91d5-4f44a6c42d01 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:50:38.792068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b364698-78f9-46bf-9db2-c6c3ab4aa798 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:50:38.809068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-404c00ef-f2e5-4a92-8820-1112948c906d None None] Sync routers for ids ['8730f760-162a-4cbe-920e-62ab9491281b'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:50:38.819102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50422) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:38.819296 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8b364698-78f9-46bf-9db2-c6c3ab4aa798 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "PUT /v2.0/routers/8730f760-162a-4cbe-920e-62ab9491281b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1910026 May 12 15:50:38.822741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-404c00ef-f2e5-4a92-8820-1112948c906d None None] Routers {'8730f760-162a-4cbe-920e-62ab9491281b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:50:38.823575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-404c00ef-f2e5-4a92-8820-1112948c906d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:50:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8730f760-162a-4cbe-920e-62ab9491281b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:38.825833 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:38.877874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c001b82f-aa03-4481-b54c-5d9fc365b56a req-cc07ae6e-2a0d-4157-9699-8d7d5cba65db tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:38.878717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c001b82f-aa03-4481-b54c-5d9fc365b56a req-cc07ae6e-2a0d-4157-9699-8d7d5cba65db tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Synchronizing usage tracker for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:50:38.968207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c001b82f-aa03-4481-b54c-5d9fc365b56a req-cc07ae6e-2a0d-4157-9699-8d7d5cba65db tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Unset dirty status for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:50:38.969675 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c001b82f-aa03-4481-b54c-5d9fc365b56a req-cc07ae6e-2a0d-4157-9699-8d7d5cba65db tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 932 time: 0.4338157 May 12 15:50:38.983002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-8d09cf82-bd50-43a4-becb-a4e7e02d98c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting subnet 3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:50:39.047213 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d09cf82-bd50-43a4-becb-a4e7e02d98c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:39.082950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-404c00ef-f2e5-4a92-8820-1112948c906d None None] Set router 8730f760-162a-4cbe-920e-62ab9491281b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:50:39.149085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c001b82f-aa03-4481-b54c-5d9fc365b56a req-def379c4-82bd-46f7-bf0c-a73118cf6673 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1702793 May 12 15:50:39.165379 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d09cf82-bd50-43a4-becb-a4e7e02d98c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:39.349992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d09cf82-bd50-43a4-becb-a4e7e02d98c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:39.387971 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-404c00ef-f2e5-4a92-8820-1112948c906d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:50:37Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:39.392772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-404c00ef-f2e5-4a92-8820-1112948c906d None None] Checking router: 8730f760-162a-4cbe-920e-62ab9491281b for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:50:39.402047 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-404c00ef-f2e5-4a92-8820-1112948c906d None None] Routers {'8730f760-162a-4cbe-920e-62ab9491281b'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:50:39.402482 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-404c00ef-f2e5-4a92-8820-1112948c906d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:50:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['8730f760-162a-4cbe-920e-62ab9491281b'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:39.471125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bf953e28-a55a-4b66-91d5-4f44a6c42d01 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:50:39.482528 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:39.493574 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d09cf82-bd50-43a4-becb-a4e7e02d98c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:39.536093 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Transition to ACTIVE for port object bf953e28-a55a-4b66-91d5-4f44a6c42d01 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:50:39.541651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d09cf82-bd50-43a4-becb-a4e7e02d98c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Subnet': ['ID=3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:39.543621 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:39.563788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51a2da33-26bc-4d4f-b1c9-9c805135f64f None None] Network 2c49c390-e121-4f31-92ba-528e8cdf62dd requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:50:39.583031 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d09cf82-bd50-43a4-becb-a4e7e02d98c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:39.614594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8d09cf82-bd50-43a4-becb-a4e7e02d98c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/subnets/3ae5a83d-ed6b-47d0-b18c-bb72b2a20dae HTTP/1.1" status: 204 len: 168 time: 0.7873421 May 12 15:50:39.615078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50426) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:39.748609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Pushing event updated for resources: {'Port': ['ID=bf953e28-a55a-4b66-91d5-4f44a6c42d01,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:39.819654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-404c00ef-f2e5-4a92-8820-1112948c906d None None] Set router 8730f760-162a-4cbe-920e-62ab9491281b gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:50:39.881571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Attempting to bind port bf953e28-a55a-4b66-91d5-4f44a6c42d01 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:50:39.881898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Attempting to bind port bf953e28-a55a-4b66-91d5-4f44a6c42d01 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:50:39.882218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Attempting to bind port bf953e28-a55a-4b66-91d5-4f44a6c42d01 on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:50:39.886907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Port bf953e28-a55a-4b66-91d5-4f44a6c42d01 on network d13f4c27-5358-4d60-abb1-0c94e69df718 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:50:39.887337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Attempting to bind port bf953e28-a55a-4b66-91d5-4f44a6c42d01 on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:50:39.892889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 50, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:50:39.893214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Checking segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:50:39.893621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Bound using segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:50:39.894043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Bound port: bf953e28-a55a-4b66-91d5-4f44a6c42d01, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:50:39.894382 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:39.924867 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:40.020010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] For port bf953e28-a55a-4b66-91d5-4f44a6c42d01, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:50:40.023499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] For port bf953e28-a55a-4b66-91d5-4f44a6c42d01, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bf953e28-a55a-4b66-91d5-4f44a6c42d01,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:50:40.034756 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:40.050215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0589e60d-f7ce-48dc-acd8-495d549d99f2 None None] DHCP port deletion for 2c49c390-e121-4f31-92ba-528e8cdf62dd request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:50:40.144883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:40.145518 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:40.146977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] 10.222.0.84 "PUT /v2.0/ports/bf953e28-a55a-4b66-91d5-4f44a6c42d01 HTTP/1.1" status: 200 len: 1092 time: 1.6510086 May 12 15:50:40.147331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43a0f365-5784-43c7-b293-9e5fe54bd81a', 'tag': 'bf953e28-a55a-4b66-91d5-4f44a6c42d01'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:50:40.160857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0589e60d-f7ce-48dc-acd8-495d549d99f2 None None] Deleting port 72b90871-bbf5-4362-b6cc-49c16f451e78 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:50:40.162048 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0589e60d-f7ce-48dc-acd8-495d549d99f2 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:40.185794 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:40.205051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-233d57b3-7533-4566-a80a-959fc9101305 service neutron] Pushing event updated for resources: {'Port': ['ID=bf953e28-a55a-4b66-91d5-4f44a6c42d01,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:40.215083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port 6456e927-9c55-44a1-867f-9d614d3489f4 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:50:40.215437 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:40.288153 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-624e3f99-4f1d-4454-b5ff-8d18466a9292'] response: {'name': 'network-changed', 'server_uuid': '43a0f365-5784-43c7-b293-9e5fe54bd81a', 'tag': 'bf953e28-a55a-4b66-91d5-4f44a6c42d01', 'status': 'completed', 'code': 200} May 12 15:50:40.364012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-8557adda-911c-4cad-b28b-a1d27fffb96d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:40.369643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-8557adda-911c-4cad-b28b-a1d27fffb96d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 1095 time: 0.1442461 May 12 15:50:40.512852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-404c00ef-f2e5-4a92-8820-1112948c906d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:50:37Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:40.521097 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-4470ccce-fb6b-4bb7-8e7c-ade1dd6820aa service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=bf953e28-a55a-4b66-91d5-4f44a6c42d01 HTTP/1.1" status: 200 len: 217 time: 0.0948329 May 12 15:50:40.552786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] For port 6456e927-9c55-44a1-867f-9d614d3489f4, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6456e927-9c55-44a1-867f-9d614d3489f4,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:50:40.553236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:40.565706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-404c00ef-f2e5-4a92-8820-1112948c906d None None] The sync data for ids ['8730f760-162a-4cbe-920e-62ab9491281b'] in n-d-841483-1 is: [{'id': '8730f760-162a-4cbe-920e-62ab9491281b', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1412191605', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37'}], 'enable_snat': True}, 'gw_port_id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:12Z', 'updated_at': '2022-05-12T15:50:37Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': '6456e927-9c55-44a1-867f-9d614d3489f4', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:86:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8730f760-162a-4cbe-920e-62ab9491281b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3961, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:50:40.640448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0589e60d-f7ce-48dc-acd8-495d549d99f2 None None] For port 72b90871-bbf5-4362-b6cc-49c16f451e78, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=72b90871-bbf5-4362-b6cc-49c16f451e78,segment=NetworkSegment(8324a333-973a-4a60-b286-77665151f901),segment_id=8324a333-973a-4a60-b286-77665151f901)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:50:40.640779 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0589e60d-f7ce-48dc-acd8-495d549d99f2 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:40.664863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-a419dcaa-5839-42e4-8757-20774a3e0291 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:40.667665 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-a419dcaa-5839-42e4-8757-20774a3e0291 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.1339488 May 12 15:50:40.681002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ff63ae2-a614-4951-aace-55b6bf023651 req-b0eeea10-33d7-4330-b852-b4815bdbf8cc tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:40.682968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2ff63ae2-a614-4951-aace-55b6bf023651 req-b0eeea10-33d7-4330-b852-b4815bdbf8cc tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 944 time: 0.3119397 May 12 15:50:40.738014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for 6456e927-9c55-44a1-867f-9d614d3489f4 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:50:40.778649 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2ff63ae2-a614-4951-aace-55b6bf023651 req-f788433a-0a01-4ab2-8e41-981eff7aa43c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612903 May 12 15:50:40.801802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-92b0ef33-4e89-46b9-8d21-9d5d6a2664f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:40.803377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-92b0ef33-4e89-46b9-8d21-9d5d6a2664f4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1193829 May 12 15:50:40.848633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0589e60d-f7ce-48dc-acd8-495d549d99f2 None None] Calling delete_port for 72b90871-bbf5-4362-b6cc-49c16f451e78 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:50:40.941890 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0589e60d-f7ce-48dc-acd8-495d549d99f2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:41.026348 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:41.044521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0589e60d-f7ce-48dc-acd8-495d549d99f2 None None] Pushing event deleted for resources: {'Port': ['ID=72b90871-bbf5-4362-b6cc-49c16f451e78,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:41.067602 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0589e60d-f7ce-48dc-acd8-495d549d99f2 None None] No DVR routers for this DVR port 72b90871-bbf5-4362-b6cc-49c16f451e78 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:50:41.131374 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=6456e927-9c55-44a1-867f-9d614d3489f4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:41.177962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-aa786fc5-61c6-4219-86da-0af5cd97714f service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3646610 May 12 15:50:41.265269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:41.416189 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dff607c-b834-49fa-9f78-e004fa39e690 req-cb13697f-90cc-4ad9-b026-b6b6f1e61d59 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2276309 May 12 15:50:41.495939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:41.498277 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:41.523474 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:41.524007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Fanout notify agent at l3_agent the message router_deleted on router 8730f760-162a-4cbe-920e-62ab9491281b {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:50:41.549858 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:41.550983 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c79e4548-a524-4e4b-aef8-13acee105246 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/routers/8730f760-162a-4cbe-920e-62ab9491281b HTTP/1.1" status: 204 len: 168 time: 1.9367478 May 12 15:50:41.553796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50434) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:41.672210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a30f146-165d-4e01-8b6e-ce71d8247b3c req-6f3e2100-3b08-4e1e-90c3-601b1f48192c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:41.674219 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a30f146-165d-4e01-8b6e-ce71d8247b3c req-6f3e2100-3b08-4e1e-90c3-601b1f48192c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 1095 time: 0.1433496 May 12 15:50:41.910933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a30f146-165d-4e01-8b6e-ce71d8247b3c req-34cac042-6040-48c0-87d2-55c1d2100e3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:41.910933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a30f146-165d-4e01-8b6e-ce71d8247b3c req-34cac042-6040-48c0-87d2-55c1d2100e3f service neutron] 10.222.0.84 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.2192838 May 12 15:50:41.994249 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db325a94-ebdd-4374-98d8-94cd1b67dec7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:41.994769 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a30f146-165d-4e01-8b6e-ce71d8247b3c req-8a8e0dce-6bb6-4170-89bc-e0cb8358dc54 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=bf953e28-a55a-4b66-91d5-4f44a6c42d01 HTTP/1.1" status: 200 len: 217 time: 0.0780659 May 12 15:50:42.160686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a30f146-165d-4e01-8b6e-ce71d8247b3c req-678a2395-be9e-4fa6-a8f2-6dcc7fb7d3a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:42.162359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a30f146-165d-4e01-8b6e-ce71d8247b3c req-678a2395-be9e-4fa6-a8f2-6dcc7fb7d3a6 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.1249955 May 12 15:50:42.246728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3eff3c-f19f-4c1c-b6da-23093f765c95 req-1d6f82d4-c5c7-487b-9fd4-773b4d2a5d2e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:42.247882 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab3eff3c-f19f-4c1c-b6da-23093f765c95 req-1d6f82d4-c5c7-487b-9fd4-773b4d2a5d2e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 944 time: 0.2522726 May 12 15:50:42.255012 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 72b90871-bbf5-4362-b6cc-49c16f451e78 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:50:42.298954 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db325a94-ebdd-4374-98d8-94cd1b67dec7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:42.333313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 72b90871-bbf5-4362-b6cc-49c16f451e78 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:50:42.333313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 72b90871-bbf5-4362-b6cc-49c16f451e78 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:50:42.335064 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ba356da3-692c-41a7-9dae-e94814fdc047 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:50:42.385815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-db325a94-ebdd-4374-98d8-94cd1b67dec7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2c49c390-e121-4f31-92ba-528e8cdf62dd']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:42.386036 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: ba356da3-692c-41a7-9dae-e94814fdc047 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:50:42.386320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ba356da3-692c-41a7-9dae-e94814fdc047 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:50:42.387350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6456e927-9c55-44a1-867f-9d614d3489f4 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:50:42.412688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-db325a94-ebdd-4374-98d8-94cd1b67dec7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8324a333-973a-4a60-b286-77665151f901') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:42.412936 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-db325a94-ebdd-4374-98d8-94cd1b67dec7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8324a333-973a-4a60-b286-77665151f901') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:42.421045 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab3eff3c-f19f-4c1c-b6da-23093f765c95 req-31eed5a9-1ba8-4602-bfd6-0bd15523301d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1552765 May 12 15:50:42.434074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db325a94-ebdd-4374-98d8-94cd1b67dec7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:42.439600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 6456e927-9c55-44a1-867f-9d614d3489f4 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:50:42.440657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6456e927-9c55-44a1-867f-9d614d3489f4 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:50:42.464418 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db325a94-ebdd-4374-98d8-94cd1b67dec7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:42.466408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a30f146-165d-4e01-8b6e-ce71d8247b3c req-2f354ac2-cde7-4f2f-9779-7a8419ecd34f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:42.468067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a30f146-165d-4e01-8b6e-ce71d8247b3c req-2f354ac2-cde7-4f2f-9779-7a8419ecd34f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.2914939 May 12 15:50:42.473120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-db325a94-ebdd-4374-98d8-94cd1b67dec7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Releasing vlan 564 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:50:42.473677 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db325a94-ebdd-4374-98d8-94cd1b67dec7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: timer() May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:50:42.491400 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:50:42.605099 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db325a94-ebdd-4374-98d8-94cd1b67dec7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:42.634092 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-db325a94-ebdd-4374-98d8-94cd1b67dec7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:42.645230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db325a94-ebdd-4374-98d8-94cd1b67dec7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Network': ['ID=2c49c390-e121-4f31-92ba-528e8cdf62dd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:42.649959 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-db325a94-ebdd-4374-98d8-94cd1b67dec7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/networks/2c49c390-e121-4f31-92ba-528e8cdf62dd HTTP/1.1" status: 204 len: 168 time: 1.0940285 May 12 15:50:42.652679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50440) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:42.789332 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ae930d3-ebe7-4e72-88b8-e25d299f1bbd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:42.804298 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-808b8b4c-e046-4a40-abc2-c394a23aa3ab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:42.809130 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a30f146-165d-4e01-8b6e-ce71d8247b3c req-aa267447-1897-465b-b55e-38f0caecc485 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3104081 May 12 15:50:42.856745 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ae930d3-ebe7-4e72-88b8-e25d299f1bbd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:43.043753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a30f146-165d-4e01-8b6e-ce71d8247b3c req-8da7a8cb-7eb4-4dd4-aaf3-fed5079d4ccc service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2276638 May 12 15:50:43.074497 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ae930d3-ebe7-4e72-88b8-e25d299f1bbd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:43.110847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ae930d3-ebe7-4e72-88b8-e25d299f1bbd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7161f302-3fa1-419c-846a-d65b5f05897a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:43.121380 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ae930d3-ebe7-4e72-88b8-e25d299f1bbd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:43.136358 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4ae930d3-ebe7-4e72-88b8-e25d299f1bbd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/security-groups/7161f302-3fa1-419c-846a-d65b5f05897a HTTP/1.1" status: 204 len: 168 time: 0.4757245 May 12 15:50:43.385566 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:43.693522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23165194-f132-4911-87cf-0099748d01c6 req-5e11430a-708d-4862-8315-a5a96829af34 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:43.695091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23165194-f132-4911-87cf-0099748d01c6 req-5e11430a-708d-4862-8315-a5a96829af34 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 944 time: 0.1293483 May 12 15:50:43.756996 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23165194-f132-4911-87cf-0099748d01c6 req-dc5d8ade-eec2-4642-acb3-9dd7b8470e68 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548999 May 12 15:50:44.361549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50452) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:44.366966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1628903651', 'description': 'tempest-secgroup-smoke-1628903651 description', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:44.374201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:50:44.379428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:50:44.382494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:50:44.389368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:50:44.401011 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:44.426335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:50:44.433041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:50:44.436089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:50:44.443401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:50:44.552952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:44.559291 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:44.612216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2cb52c0b-a50c-4d09-b2b8-9544f58e876c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:44.623169 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:44.625852 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-be102289-384d-4c9a-9905-7ec44b040cd2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.2628589 May 12 15:50:44.636490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50456) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:44.642675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6b130dab-4a4b-41ba-8371-42d17b65d830 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '2cb52c0b-a50c-4d09-b2b8-9544f58e876c', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:44.649420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6b130dab-4a4b-41ba-8371-42d17b65d830 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:50:44.653878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6b130dab-4a4b-41ba-8371-42d17b65d830 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:50:44.657499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6b130dab-4a4b-41ba-8371-42d17b65d830 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:50:44.666210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6b130dab-4a4b-41ba-8371-42d17b65d830 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:50:44.703628 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6b130dab-4a4b-41ba-8371-42d17b65d830 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:44.789351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6b130dab-4a4b-41ba-8371-42d17b65d830 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:44.794141 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6b130dab-4a4b-41ba-8371-42d17b65d830 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:44.834744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b130dab-4a4b-41ba-8371-42d17b65d830 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f26394fb-d8c9-4204-aad1-1a894fb66cd9,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:44.849525 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6b130dab-4a4b-41ba-8371-42d17b65d830 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:44.854490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50462) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:44.855491 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6b130dab-4a4b-41ba-8371-42d17b65d830 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2162135 May 12 15:50:44.862637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b7b4b103-55c4-45f1-ba80-6b5b13779d59 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '2cb52c0b-a50c-4d09-b2b8-9544f58e876c', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:44.872406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b7b4b103-55c4-45f1-ba80-6b5b13779d59 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:50:44.880789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b7b4b103-55c4-45f1-ba80-6b5b13779d59 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:50:44.884846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b7b4b103-55c4-45f1-ba80-6b5b13779d59 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:50:44.894094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b7b4b103-55c4-45f1-ba80-6b5b13779d59 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:50:44.925557 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b4b103-55c4-45f1-ba80-6b5b13779d59 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:44.985368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfc297e2-e5c4-41a0-a710-3f17a5284bcc req-4d008949-54fb-43c3-91bb-b54464fcf192 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:44.986905 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bfc297e2-e5c4-41a0-a710-3f17a5284bcc req-4d008949-54fb-43c3-91bb-b54464fcf192 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 944 time: 0.1015856 May 12 15:50:45.008197 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b4b103-55c4-45f1-ba80-6b5b13779d59 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.013904 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b4b103-55c4-45f1-ba80-6b5b13779d59 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.035464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7b4b103-55c4-45f1-ba80-6b5b13779d59 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2fcfef09-32a2-4d41-b7cd-c4598d540ece,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:45.044860 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bfc297e2-e5c4-41a0-a710-3f17a5284bcc req-c5206379-1ef8-467c-a904-e5fcaf8ed216 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519888 May 12 15:50:45.058034 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7b4b103-55c4-45f1-ba80-6b5b13779d59 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.059588 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b7b4b103-55c4-45f1-ba80-6b5b13779d59 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2036636 May 12 15:50:45.063609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50466) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:45.071401 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-73e052e7-15d2-4434-a678-8a59997300ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '2cb52c0b-a50c-4d09-b2b8-9544f58e876c', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:45.078279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-73e052e7-15d2-4434-a678-8a59997300ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:50:45.082167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-73e052e7-15d2-4434-a678-8a59997300ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:50:45.085164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-73e052e7-15d2-4434-a678-8a59997300ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:50:45.090901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-73e052e7-15d2-4434-a678-8a59997300ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:50:45.108057 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-73e052e7-15d2-4434-a678-8a59997300ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.204062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-73e052e7-15d2-4434-a678-8a59997300ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.209934 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-73e052e7-15d2-4434-a678-8a59997300ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.237514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73e052e7-15d2-4434-a678-8a59997300ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f3cbe0b2-474e-4c3f-92d8-ff3166ef347d,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:45.247689 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-73e052e7-15d2-4434-a678-8a59997300ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.249805 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-73e052e7-15d2-4434-a678-8a59997300ad tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1850781 May 12 15:50:45.252834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50470) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:45.258992 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b678b332-cab9-4a2d-a99a-145dfa268912 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '2cb52c0b-a50c-4d09-b2b8-9544f58e876c', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:45.267114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b678b332-cab9-4a2d-a99a-145dfa268912 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:50:45.271603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b678b332-cab9-4a2d-a99a-145dfa268912 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:50:45.275233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b678b332-cab9-4a2d-a99a-145dfa268912 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:50:45.282721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b678b332-cab9-4a2d-a99a-145dfa268912 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:50:45.304738 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b678b332-cab9-4a2d-a99a-145dfa268912 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.330558 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-233746f9-2f1c-4e41-b6bc-74876c0308a7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.379436 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b678b332-cab9-4a2d-a99a-145dfa268912 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.383537 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b678b332-cab9-4a2d-a99a-145dfa268912 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.407428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b678b332-cab9-4a2d-a99a-145dfa268912 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c32bff2a-ab36-44b6-ac6a-d41df98b6ba3,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:45.417166 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b678b332-cab9-4a2d-a99a-145dfa268912 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.421056 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b678b332-cab9-4a2d-a99a-145dfa268912 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1643431 May 12 15:50:45.421056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50474) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:45.427382 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1873538c-3d09-425b-88e4-8823cb00ab68 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '2cb52c0b-a50c-4d09-b2b8-9544f58e876c', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:45.434764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1873538c-3d09-425b-88e4-8823cb00ab68 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:50:45.439426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1873538c-3d09-425b-88e4-8823cb00ab68 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:50:45.442573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1873538c-3d09-425b-88e4-8823cb00ab68 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:50:45.448433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1873538c-3d09-425b-88e4-8823cb00ab68 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:50:45.459591 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-1873538c-3d09-425b-88e4-8823cb00ab68 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Project b88b5989d4c548dba6124f2e4690e5c3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:50:45.466959 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1873538c-3d09-425b-88e4-8823cb00ab68 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.539015 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1873538c-3d09-425b-88e4-8823cb00ab68 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.542859 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1873538c-3d09-425b-88e4-8823cb00ab68 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.569132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1873538c-3d09-425b-88e4-8823cb00ab68 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0011d8de-9b4f-4947-ab91-29de70db1b5b,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:45.580470 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1873538c-3d09-425b-88e4-8823cb00ab68 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.582407 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1873538c-3d09-425b-88e4-8823cb00ab68 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1591544 May 12 15:50:45.584704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50478) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:45.589852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c3a11931-09fd-4c6a-9904-0a8857bf050d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '2cb52c0b-a50c-4d09-b2b8-9544f58e876c', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:45.598055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c3a11931-09fd-4c6a-9904-0a8857bf050d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:50:45.603002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c3a11931-09fd-4c6a-9904-0a8857bf050d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:50:45.606877 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c3a11931-09fd-4c6a-9904-0a8857bf050d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:50:45.612413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c3a11931-09fd-4c6a-9904-0a8857bf050d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:50:45.626783 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-c3a11931-09fd-4c6a-9904-0a8857bf050d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Project b88b5989d4c548dba6124f2e4690e5c3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:50:45.634670 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3a11931-09fd-4c6a-9904-0a8857bf050d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.712230 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3a11931-09fd-4c6a-9904-0a8857bf050d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.716238 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3a11931-09fd-4c6a-9904-0a8857bf050d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.741921 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3a11931-09fd-4c6a-9904-0a8857bf050d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0ac1d3d7-93d5-4e42-868d-9866ed692c7d,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:45.751781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c3a11931-09fd-4c6a-9904-0a8857bf050d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.752980 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c3a11931-09fd-4c6a-9904-0a8857bf050d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1672459 May 12 15:50:45.755663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50482) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:45.761179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'network': {'name': 'tempest-network-smoke--942587896', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'port_security_enabled': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:45.767906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:50:45.772695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:network and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:50:45.775722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:50:45.782338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:50:45.792864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Made reservation on behalf of b88b5989d4c548dba6124f2e4690e5c3 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:50:45.796193 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.826349 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 579} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:50:45.841466 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.842268 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Added segment 9851d85a-5882-482f-aef2-a31617f7f1c6 of type vlan for network 5c356018-3c06-4505-81ef-c3ae2fab3978 May 12 15:50:45.871350 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.905075 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:45.911047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:45.911930 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:46.019407 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.2627270 May 12 15:50:46.022256 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50486) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:46.025280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c919352-84ab-422d-b15b-53595b0e0007 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Network': ['ID=5c356018-3c06-4505-81ef-c3ae2fab3978,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:46.027649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'admin_state_up': True, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:46.039781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:50:46.045982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:router and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:50:46.046420 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 5c356018-3c06-4505-81ef-c3ae2fab3978 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:50:46.049943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:50:46.058060 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:50:46.073685 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:46.075433 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:46.102657 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:46.160661 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:46.289971 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:46.574257 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:46.614769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b1c8d8-24a6-4c25-af09-f2c6b2cbf88f req-6f4c15d8-55bb-4501-95db-3fbd7d65cb53 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:46.616348 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3b1c8d8-24a6-4c25-af09-f2c6b2cbf88f req-6f4c15d8-55bb-4501-95db-3fbd7d65cb53 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 944 time: 0.4233687 May 12 15:50:46.728924 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3b1c8d8-24a6-4c25-af09-f2c6b2cbf88f req-5b959a4b-fc21-42d7-a5a9-9e3cf5a0dcce tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0607843 May 12 15:50:46.968077 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:46.997418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:47.132641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.25.8.86 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/c86e9dce-5af9-4b7b-80d0-606963ac0d0e) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:50:47.284013 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:47.313299 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:47.380589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:50:47.383389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:50:47.387120 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:50:47.421857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=c86e9dce-5af9-4b7b-80d0-606963ac0d0e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:47.779822 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:48.000956 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:48.099348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6b800fa-9dbe-4eb4-a08c-ad563911832c req-b433350d-3d14-433a-84e8-4a5258a6b288 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:48.100826 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6b800fa-9dbe-4eb4-a08c-ad563911832c req-b433350d-3d14-433a-84e8-4a5258a6b288 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 944 time: 0.1963661 May 12 15:50:48.227878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6b800fa-9dbe-4eb4-a08c-ad563911832c req-19b6a89d-9fba-4bb8-b14e-fcdcf6e2c005 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0737617 May 12 15:50:48.410017 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:48.639200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router 75747bdd-2928-4a50-929a-8d28830552b1 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:50:48.820425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:50:48.829914 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Sync routers for ids ['75747bdd-2928-4a50-929a-8d28830552b1'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:50:48.851375 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Routers {'75747bdd-2928-4a50-929a-8d28830552b1'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:50:48.851375 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:50:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['75747bdd-2928-4a50-929a-8d28830552b1'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:48.864526 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:48.864526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d50ebbd6-1620-4d92-95d4-7c88dc711971 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 892 time: 2.8286724 May 12 15:50:48.864526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50494) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:49.061475 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Set router 75747bdd-2928-4a50-929a-8d28830552b1 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:50:49.070229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50500) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:49.080380 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fc7c9da0-e7ba-40c5-9e86-21d9ea8e6350 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=b88b5989d4c548dba6124f2e4690e5c3&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2222133 May 12 15:50:49.222213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-472003d0-626f-4479-b647-69c43c003165 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:49.227382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50504) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:49.242490 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-472003d0-626f-4479-b647-69c43c003165 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1711223 May 12 15:50:49.279086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50510) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:49.283366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8445a4ce-a265-47e9-866d-775c16f6e262 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0546446 May 12 15:50:49.288674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1052442506', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:49.421751 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:50:47Z', 'revision_number': 3, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:47Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:49.421751 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Checking router: 75747bdd-2928-4a50-929a-8d28830552b1 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:50:49.421751 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Updating router 75747bdd-2928-4a50-929a-8d28830552b1 port c86e9dce-5af9-4b7b-80d0-606963ac0d0e binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:50:49.502417 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:49.522094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:50:49.531460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:subnet and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:50:49.538676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:50:49.544620 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:50:49.564483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Made reservation on behalf of b88b5989d4c548dba6124f2e4690e5c3 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:50:49.564483 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:49.588121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02703817-f1dc-493a-a44e-36c2a221b8f7 req-b892818c-df81-4990-bbc9-5a15934eca2c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:49.600230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02703817-f1dc-493a-a44e-36c2a221b8f7 req-b892818c-df81-4990-bbc9-5a15934eca2c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 944 time: 0.1909065 May 12 15:50:49.696449 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-02703817-f1dc-493a-a44e-36c2a221b8f7 req-2f21e69c-f783-456e-9766-e7b6d46b161f tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0996580 May 12 15:50:49.866938 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:49.979528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Subnet': ['ID=c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:49.979528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Checking segment: {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:50:49.984383 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:50:49.990279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network hostable DHCP agents. Network: 5c356018-3c06-4505-81ef-c3ae2fab3978, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:50:49.998938 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:50.003630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 5c356018-3c06-4505-81ef-c3ae2fab3978 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:50:50.014307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 5c356018-3c06-4505-81ef-c3ae2fab3978) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:50:50.021551 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Transition to ACTIVE for port object c86e9dce-5af9-4b7b-80d0-606963ac0d0e will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:50:50.029896 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72c0c813-2675-4132-9e3c-c827ea7680fa None None] Network 5c356018-3c06-4505-81ef-c3ae2fab3978 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:50:50.034766 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:50.039491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:50.039491 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:50.053711 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-16326c81-2709-4ce6-8a85-396057597b35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.7640662 May 12 15:50:50.053711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50514) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:50:50.132502 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Attempting to bind port c86e9dce-5af9-4b7b-80d0-606963ac0d0e on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:50:50.132502 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Attempting to bind port c86e9dce-5af9-4b7b-80d0-606963ac0d0e by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:50:50.132502 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Attempting to bind port c86e9dce-5af9-4b7b-80d0-606963ac0d0e on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:50:50.147401 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 50, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:50:50.147401 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:50:50.147401 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:50.147401 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:50:50.147401 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Bound port: c86e9dce-5af9-4b7b-80d0-606963ac0d0e, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:50:50.147401 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:50.225477 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] For port c86e9dce-5af9-4b7b-80d0-606963ac0d0e, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:50:50.230295 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] For port c86e9dce-5af9-4b7b-80d0-606963ac0d0e, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c86e9dce-5af9-4b7b-80d0-606963ac0d0e,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:50:50.240374 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535a082b-4773-468c-8489-67832949e418 None None] Pushing event updated for resources: {'Port': ['ID=c86e9dce-5af9-4b7b-80d0-606963ac0d0e,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:50.243307 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:50.255756 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535a082b-4773-468c-8489-67832949e418 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:50.256093 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535a082b-4773-468c-8489-67832949e418 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:50.259079 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535a082b-4773-468c-8489-67832949e418 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:50.259079 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535a082b-4773-468c-8489-67832949e418 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:50.259079 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535a082b-4773-468c-8489-67832949e418 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:50.259079 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535a082b-4773-468c-8489-67832949e418 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:50.259079 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535a082b-4773-468c-8489-67832949e418 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:50.259079 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535a082b-4773-468c-8489-67832949e418 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:50.259079 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535a082b-4773-468c-8489-67832949e418 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:50.263622 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535a082b-4773-468c-8489-67832949e418 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:50.263622 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535a082b-4773-468c-8489-67832949e418 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:50.263622 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535a082b-4773-468c-8489-67832949e418 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:50.332980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-5c356018-3c06-4505-81ef-c3ae2fab3978', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ips': [{'subnet_id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:50:50.332980 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:50.398581 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Routers {'75747bdd-2928-4a50-929a-8d28830552b1'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:50:50.398581 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:50:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['75747bdd-2928-4a50-929a-8d28830552b1'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:50.494358 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535a082b-4773-468c-8489-67832949e418 None None] Pushing event updated for resources: {'Port': ['ID=c86e9dce-5af9-4b7b-80d0-606963ac0d0e,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:50.617842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Allocated IP 172.20.0.2 (5c356018-3c06-4505-81ef-c3ae2fab3978/c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d/f6d439f2-e13e-4056-8bf6-865f881585c9) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:50:50.625777 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] Set router 75747bdd-2928-4a50-929a-8d28830552b1 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:50:50.847944 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:50.865532 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Transition to ACTIVE for port object f6d439f2-e13e-4056-8bf6-865f881585c9 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:50:50.895721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Transition to ACTIVE for port object f6d439f2-e13e-4056-8bf6-865f881585c9 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:50:50.904036 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:50.931222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de15c6ae-5df2-4097-a944-b14807a1ec7f req-93c60ffe-0c9b-4c67-86b1-031080001dad tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:50.936470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de15c6ae-5df2-4097-a944-b14807a1ec7f req-93c60ffe-0c9b-4c67-86b1-031080001dad tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 944 time: 0.1177580 May 12 15:50:50.946007 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:50:47Z', 'revision_number': 3, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:50.950219 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-232b409c-7db7-4aad-a07f-8fdc5f4f610a None None] The sync data for ids ['75747bdd-2928-4a50-929a-8d28830552b1'] in n-d-841483-1 is: [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:50:47Z', 'revision_number': 3, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:50:50.992496 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de15c6ae-5df2-4097-a944-b14807a1ec7f req-4f026592-56c0-4207-9cf2-cebc1c4bd79b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499747 May 12 15:50:51.001857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Network 5c356018-3c06-4505-81ef-c3ae2fab3978 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:50:51.005239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:50:51.007709 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:50:51.048185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Pushing event updated for resources: {'Port': ['ID=f6d439f2-e13e-4056-8bf6-865f881585c9,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:51.085546 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:51.101910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:51.101910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:51.101910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:51.101910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:51.101910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:51.101910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:51.101910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:51.101910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:51.101910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:51.101910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:51.101910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:51.101910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:50:51.123565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Attempting to bind port f6d439f2-e13e-4056-8bf6-865f881585c9 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:50:51.123565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Attempting to bind port f6d439f2-e13e-4056-8bf6-865f881585c9 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:50:51.130469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Attempting to bind port f6d439f2-e13e-4056-8bf6-865f881585c9 on network 5c356018-3c06-4505-81ef-c3ae2fab3978 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:50:51.134518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 50, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:50:51.134518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Checking segment: {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:50:51.134518 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:51.134518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Bound using segment: {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:50:51.134518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Bound port: f6d439f2-e13e-4056-8bf6-865f881585c9, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:50:51.134518 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:51.235320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] For port f6d439f2-e13e-4056-8bf6-865f881585c9, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:50:51.239598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] For port f6d439f2-e13e-4056-8bf6-865f881585c9, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f6d439f2-e13e-4056-8bf6-865f881585c9,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:50:51.261196 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:51.403020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c90c496-81f4-461d-9d05-456c1a6e3c6d None None] Pushing event updated for resources: {'Port': ['ID=f6d439f2-e13e-4056-8bf6-865f881585c9,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:51.606547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.20.0.1 (5c356018-3c06-4505-81ef-c3ae2fab3978/c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d/7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:50:51.784345 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:51.803461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Transition to ACTIVE for port object 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:50:51.841131 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:51.906704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c86e9dce-5af9-4b7b-80d0-606963ac0d0e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:50:51.920571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 5c356018-3c06-4505-81ef-c3ae2fab3978 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:50:51.925133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:50:51.929086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:50:51.986125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:52.001991 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:52.007215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port c86e9dce-5af9-4b7b-80d0-606963ac0d0e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:50:52.013090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c86e9dce-5af9-4b7b-80d0-606963ac0d0e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:50:52.013555 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:52.159571 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:52.181423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port c86e9dce-5af9-4b7b-80d0-606963ac0d0e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c86e9dce-5af9-4b7b-80d0-606963ac0d0e,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:50:52.187806 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:52.188702 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6d439f2-e13e-4056-8bf6-865f881585c9 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:50:52.263030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eac4a39e-214c-478a-8e91-f43ecb094576 req-0355dd96-ad25-4bab-9ef0-bda348b6c5b1 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:52.271503 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eac4a39e-214c-478a-8e91-f43ecb094576 req-0355dd96-ad25-4bab-9ef0-bda348b6c5b1 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 944 time: 0.1377158 May 12 15:50:52.340486 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eac4a39e-214c-478a-8e91-f43ecb094576 req-75da9a72-f1d5-40c8-866d-4053fd80f345 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0680704 May 12 15:50:52.444960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=c86e9dce-5af9-4b7b-80d0-606963ac0d0e,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:52.460488 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f6d439f2-e13e-4056-8bf6-865f881585c9 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:50:52.555477 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:52.616996 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be7d40ec-b739-4909-8729-1652c290d3e8 None None] Network 5c356018-3c06-4505-81ef-c3ae2fab3978 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:50:52.740991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf31b0e6-2470-412d-b400-992cc63184cf None None] Provisioning for port f6d439f2-e13e-4056-8bf6-865f881585c9 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:50:52.746074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf31b0e6-2470-412d-b400-992cc63184cf None None] Provisioning complete for port f6d439f2-e13e-4056-8bf6-865f881585c9 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:50:52.746074 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf31b0e6-2470-412d-b400-992cc63184cf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:52.974725 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf31b0e6-2470-412d-b400-992cc63184cf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:53.014625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf31b0e6-2470-412d-b400-992cc63184cf None None] For port f6d439f2-e13e-4056-8bf6-865f881585c9, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f6d439f2-e13e-4056-8bf6-865f881585c9,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:50:53.020242 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:53.023539 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf31b0e6-2470-412d-b400-992cc63184cf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:53.029979 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:53.112248 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf31b0e6-2470-412d-b400-992cc63184cf None None] Pushing event updated for resources: {'Port': ['ID=f6d439f2-e13e-4056-8bf6-865f881585c9,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:53.160487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:53.174947 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:53.357261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 5c356018-3c06-4505-81ef-c3ae2fab3978 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:50:53.357261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:50:53.369072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fc731788-a1ca-48a4-98e5-2aaeb44fdd7c None None] Provisioning for port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:50:53.376861 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fc731788-a1ca-48a4-98e5-2aaeb44fdd7c None None] Provisioning complete for port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:50:53.376861 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fc731788-a1ca-48a4-98e5-2aaeb44fdd7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:53.435799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fc731788-a1ca-48a4-98e5-2aaeb44fdd7c None None] Port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:50:53.457645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fc731788-a1ca-48a4-98e5-2aaeb44fdd7c None None] Provisioning complete for port f6d439f2-e13e-4056-8bf6-865f881585c9 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:50:53.458082 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fc731788-a1ca-48a4-98e5-2aaeb44fdd7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:53.636380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-662a0efc-a3bf-4622-abeb-f1fd44830259 req-4af3ba5e-bda9-417c-a1c9-871a6cea02ef tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:53.640107 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-662a0efc-a3bf-4622-abeb-f1fd44830259 req-4af3ba5e-bda9-417c-a1c9-871a6cea02ef tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 944 time: 0.1273973 May 12 15:50:53.676683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router 75747bdd-2928-4a50-929a-8d28830552b1 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:50:53.696331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-662a0efc-a3bf-4622-abeb-f1fd44830259 req-7cb6eca4-cb41-450d-afa1-0b0643595854 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473773 May 12 15:50:53.770005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-faec19ee-4beb-48ab-ad17-8337ab36113b None None] Provisioning complete for port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:50:53.770005 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-faec19ee-4beb-48ab-ad17-8337ab36113b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:53.849699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-faec19ee-4beb-48ab-ad17-8337ab36113b None None] Port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:50:53.899954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c86e9dce-5af9-4b7b-80d0-606963ac0d0e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:50:53.906977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:50:53.919110 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0c69b8fe-320a-4ea5-88c0-ff0f5443bf0a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "PUT /v2.0/routers/75747bdd-2928-4a50-929a-8d28830552b1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8672953 May 12 15:50:53.938492 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Sync routers for ids ['75747bdd-2928-4a50-929a-8d28830552b1'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:50:53.971031 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Routers {'75747bdd-2928-4a50-929a-8d28830552b1'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:50:53.971031 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:50:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['75747bdd-2928-4a50-929a-8d28830552b1'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:54.096374 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-463e3503-9621-4be2-85ea-993848df1eba tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:50:54.113285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-463e3503-9621-4be2-85ea-993848df1eba tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:50:54.114485 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-463e3503-9621-4be2-85ea-993848df1eba tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1628903651&fields=id&tenant_id=b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 267 time: 0.0579274 May 12 15:50:54.155491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-959934b8-cf5a-4f55-88bc-9cdc8504974e None None] Provisioning complete for port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:50:54.156493 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-959934b8-cf5a-4f55-88bc-9cdc8504974e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:54.212911 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c86e9dce-5af9-4b7b-80d0-606963ac0d0e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:50:54.212911 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:54.279181 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Set router 75747bdd-2928-4a50-929a-8d28830552b1 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:50:54.342532 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-959934b8-cf5a-4f55-88bc-9cdc8504974e None None] Port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:50:54.390866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-fdd487da-d318-4cd0-b8e6-19b2bc361305 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:54.392287 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-fdd487da-d318-4cd0-b8e6-19b2bc361305 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/networks?id=5c356018-3c06-4505-81ef-c3ae2fab3978 HTTP/1.1" status: 200 len: 796 time: 0.2706780 May 12 15:50:54.408039 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-8f8eb252-caaa-4268-bbbd-3db54b07dddf tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/quotas/b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 375 time: 0.0101020 May 12 15:50:54.495228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-177fb904-f32a-442c-a13d-3e29c35d8352 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0821111 May 12 15:50:54.558928 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6d439f2-e13e-4056-8bf6-865f881585c9 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:50:54.643461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-0e5eb92f-9396-4bc1-b8aa-139b837f292f service neutron] 10.222.0.82 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1361701 May 12 15:50:54.748930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f6d439f2-e13e-4056-8bf6-865f881585c9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:50:54.749307 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:54.805367 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-8609a423-cffc-4da5-9cbc-c8d8e1708596 service neutron] 10.222.0.82 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1557291 May 12 15:50:54.840034 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256', 'name': '', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:51:de:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4061, 'fixed_ips': [{'subnet_id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:51Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 2, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:54.846092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Checking router: 75747bdd-2928-4a50-929a-8d28830552b1 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:50:54.846441 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Updating router 75747bdd-2928-4a50-929a-8d28830552b1 port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:50:54.899657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b63954b-7a6a-49e5-9bff-d54e38a1733e req-ab3edef7-c45b-4e27-ac6b-7104d0ba9aa8 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:54.906790 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b63954b-7a6a-49e5-9bff-d54e38a1733e req-ab3edef7-c45b-4e27-ac6b-7104d0ba9aa8 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 944 time: 0.0976696 May 12 15:50:54.979189 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:54.989805 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b63954b-7a6a-49e5-9bff-d54e38a1733e req-9d6c7c7b-b138-4327-b8de-1727647e863a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0787380 May 12 15:50:55.040693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7d444d3-2646-4535-8f27-bce2d71b5c6a req-270eed5c-2d2b-4996-9d3d-3156585129a6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 210 time: 0.0506811 May 12 15:50:55.427512 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:55.440315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Transition to ACTIVE for port object 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:50:55.455168 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:55.594831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e063141-ec29-4d02-ae64-b27f083ab10b None None] Pushing event updated for resources: {'Port': ['ID=7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:55.698058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Attempting to bind port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:50:55.698404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Attempting to bind port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:50:55.698792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Attempting to bind port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 on network 5c356018-3c06-4505-81ef-c3ae2fab3978 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:50:55.704938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 50, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:50:55.705801 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Checking segment: {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:50:55.705801 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:55.706065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Bound using segment: {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:50:55.706456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Bound port: 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:50:55.707376 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:55.824178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] For port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:50:55.828326 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] For port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:50:55.832157 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:55.917918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Routers {'75747bdd-2928-4a50-929a-8d28830552b1'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:50:55.918530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:50:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['75747bdd-2928-4a50-929a-8d28830552b1'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:55.986714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e063141-ec29-4d02-ae64-b27f083ab10b None None] Pushing event updated for resources: {'Port': ['ID=7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:56.167882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] Set router 75747bdd-2928-4a50-929a-8d28830552b1 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:50:56.353654 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28b4693f-f556-42dc-9355-3277de8e92c6 req-9264c01f-4d12-4452-8d0c-ae6080920f1d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 210 time: 0.1104300 May 12 15:50:56.429241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a0301f-934a-49a2-bfe2-66f3612aba74 req-fd1f22d4-db34-429e-980a-20945ccb458c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:56.446405 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43a0301f-934a-49a2-bfe2-66f3612aba74 req-fd1f22d4-db34-429e-980a-20945ccb458c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 944 time: 0.1661406 May 12 15:50:56.496779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-d31828db-ddd5-4945-b82e-5993e3c8cff8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:56.498346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-d31828db-ddd5-4945-b82e-5993e3c8cff8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:50:56.510325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-43a0301f-934a-49a2-bfe2-66f3612aba74 req-d0f61768-1395-4eca-b28f-e488bae65041 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634799 May 12 15:50:56.538773 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-d31828db-ddd5-4945-b82e-5993e3c8cff8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:50:56.539795 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-d31828db-ddd5-4945-b82e-5993e3c8cff8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.76 "GET /v2.0/networks?id=5c356018-3c06-4505-81ef-c3ae2fab3978 HTTP/1.1" status: 200 len: 796 time: 0.3807049 May 12 15:50:56.603210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-421453a8-2154-4183-b9c0-574556a00ca7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:50:56.617670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-421453a8-2154-4183-b9c0-574556a00ca7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:50:56.618931 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-421453a8-2154-4183-b9c0-574556a00ca7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 380 time: 0.0703597 May 12 15:50:56.628345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'port': {'device_id': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'admin_state_up': True, 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'security_groups': ['2cb52c0b-a50c-4d09-b2b8-9544f58e876c']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:56.629345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256', 'name': '', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:51:de:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4061, 'fixed_ips': [{'subnet_id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:51Z', 'updated_at': '2022-05-12T15:50:55Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:50:56.633421 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5450b24-da60-4784-8387-c794ea29a947 None None] The sync data for ids ['75747bdd-2928-4a50-929a-8d28830552b1'] in n-d-841483-1 is: [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256', 'name': '', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:51:de:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4061, 'fixed_ips': [{'subnet_id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:51Z', 'updated_at': '2022-05-12T15:50:55Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:50:56.936585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:50:56.941917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:port and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:50:56.945824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:50:56.953608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:50:56.966370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Made reservation on behalf of b88b5989d4c548dba6124f2e4690e5c3 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:50:56.970819 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:57.156886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.20.0.12 (5c356018-3c06-4505-81ef-c3ae2fab3978/c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d/35823aef-382e-46b8-9045-a3751e05ead2) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:50:57.398094 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:57.415409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Transition to ACTIVE for port object 35823aef-382e-46b8-9045-a3751e05ead2 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:50:57.446732 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:57.537583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 5c356018-3c06-4505-81ef-c3ae2fab3978 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:50:57.540640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:50:57.543543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:50:57.604370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=35823aef-382e-46b8-9045-a3751e05ead2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:57.613193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8350e15b-b4b9-4b35-9cac-0d1eca35f262 req-f5bb7e5f-d725-4470-8a0e-01de143771a7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:57.614752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8350e15b-b4b9-4b35-9cac-0d1eca35f262 req-f5bb7e5f-d725-4470-8a0e-01de143771a7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 932 time: 0.1366768 May 12 15:50:57.643014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:57.644138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:57.677704 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-9097bace-8718-42e1-9e7e-9783e40e2694 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0533097 May 12 15:50:57.693736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Request body: {'port': {'device_id': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:50:57.770724 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8350e15b-b4b9-4b35-9cac-0d1eca35f262 req-8b1bb17c-4925-4e5d-868f-02dcdb3b49f0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1472654 May 12 15:50:57.823356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2529d1b-641c-43cf-aa9f-5a7a8ad76f75 req-635dc3d6-8f07-4167-a3ff-fe12cd528bf8 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:57.833903 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2529d1b-641c-43cf-aa9f-5a7a8ad76f75 req-635dc3d6-8f07-4167-a3ff-fe12cd528bf8 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 944 time: 0.1236582 May 12 15:50:57.855539 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:57.896975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2529d1b-641c-43cf-aa9f-5a7a8ad76f75 req-8b1930d5-5f40-4e82-ba0b-281d131e6586 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620174 May 12 15:50:57.898092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-53d97531-097d-437d-826b-6269780d361d None None] Provisioning for port 35823aef-382e-46b8-9045-a3751e05ead2 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:50:57.915090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-53d97531-097d-437d-826b-6269780d361d None None] Provisioning complete for port 35823aef-382e-46b8-9045-a3751e05ead2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:50:57.916023 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-53d97531-097d-437d-826b-6269780d361d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:57.957442 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:50:58.037751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-53d97531-097d-437d-826b-6269780d361d None None] Port 35823aef-382e-46b8-9045-a3751e05ead2 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:50:58.058936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:50:58.067464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:50:58.067464 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:58.246288 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:58.289485 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:50:58.295443 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:58.329719 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 35823aef-382e-46b8-9045-a3751e05ead2 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:50:58.338401 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:58.355597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Transition to ACTIVE for port object 35823aef-382e-46b8-9045-a3751e05ead2 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:50:58.359647 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:58.379490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:58.559730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Pushing event updated for resources: {'Port': ['ID=35823aef-382e-46b8-9045-a3751e05ead2,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:58.626831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Attempting to bind port 35823aef-382e-46b8-9045-a3751e05ead2 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:50:58.626831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Attempting to bind port 35823aef-382e-46b8-9045-a3751e05ead2 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:50:58.626831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Attempting to bind port 35823aef-382e-46b8-9045-a3751e05ead2 on network 5c356018-3c06-4505-81ef-c3ae2fab3978 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:50:58.633063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Port 35823aef-382e-46b8-9045-a3751e05ead2 on network 5c356018-3c06-4505-81ef-c3ae2fab3978 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:50:58.633063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Attempting to bind port 35823aef-382e-46b8-9045-a3751e05ead2 on network 5c356018-3c06-4505-81ef-c3ae2fab3978 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:50:58.638454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 50, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:50:58.639056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Checking segment: {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:50:58.639993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Bound using segment: {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:50:58.640533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Bound port: 35823aef-382e-46b8-9045-a3751e05ead2, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:50:58.642418 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:58.753978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:50:58.757162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=35823aef-382e-46b8-9045-a3751e05ead2,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:50:58.762975 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:58.833452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:58.834053 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:58.835469 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] 10.222.0.76 "PUT /v2.0/ports/35823aef-382e-46b8-9045-a3751e05ead2 HTTP/1.1" status: 200 len: 1092 time: 1.1488540 May 12 15:50:58.835898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:50:58.880428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3d5d63b-9c00-4527-bffa-19dc9488ba6f service neutron] Pushing event updated for resources: {'Port': ['ID=35823aef-382e-46b8-9045-a3751e05ead2,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:58.897973 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-89327014-3a6f-43ca-a125-1cf57e634e60'] response: {'name': 'network-changed', 'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2', 'status': 'completed', 'code': 200} May 12 15:50:58.918218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bf953e28-a55a-4b66-91d5-4f44a6c42d01 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:50:58.994763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fcb386c-bc66-4a34-9106-ec631b152426 req-bffabb3f-39a8-43dc-b65c-c0bf94f980ed tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:59.003368 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0fcb386c-bc66-4a34-9106-ec631b152426 req-bffabb3f-39a8-43dc-b65c-c0bf94f980ed tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 944 time: 0.1144733 May 12 15:50:59.014901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-404dfc41-42bd-4a91-a0e0-02a5b9515287 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:59.017294 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-404dfc41-42bd-4a91-a0e0-02a5b9515287 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 1095 time: 0.1183479 May 12 15:50:59.071422 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0fcb386c-bc66-4a34-9106-ec631b152426 req-4705aa52-07eb-4060-9c42-6803fab07757 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0667994 May 12 15:50:59.156914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port bf953e28-a55a-4b66-91d5-4f44a6c42d01, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bf953e28-a55a-4b66-91d5-4f44a6c42d01,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:50:59.211458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'bf953e28-a55a-4b66-91d5-4f44a6c42d01', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'port_id': 'bf953e28-a55a-4b66-91d5-4f44a6c42d01', 'mac_address': 'fa:16:3e:8b:bc:4b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 566, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:50:59.211679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1da1ed4-dd03-464d-ade3-b257e8d7e68e req-9e23a40e-4ddd-4eb9-9863-1a896883f5ff tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:59.211679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1da1ed4-dd03-464d-ade3-b257e8d7e68e req-9e23a40e-4ddd-4eb9-9863-1a896883f5ff tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 944 time: 0.1056788 May 12 15:50:59.251548 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-84764122-8199-4b3d-8614-770203c8b755 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=35823aef-382e-46b8-9045-a3751e05ead2 HTTP/1.1" status: 200 len: 217 time: 0.2274013 May 12 15:50:59.274391 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1da1ed4-dd03-464d-ade3-b257e8d7e68e req-ebd1505c-5207-4fbf-a71b-afbe8107fc5f tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557678 May 12 15:50:59.311473 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:59.330726 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bf953e28-a55a-4b66-91d5-4f44a6c42d01 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:50:59.338410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-3d112b16-8f61-49d6-8f9b-5cf6ffaab26b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:59.341708 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-3d112b16-8f61-49d6-8f9b-5cf6ffaab26b service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d HTTP/1.1" status: 200 len: 835 time: 0.0802753 May 12 15:50:59.351251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port bf953e28-a55a-4b66-91d5-4f44a6c42d01, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bf953e28-a55a-4b66-91d5-4f44a6c42d01,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:50:59.355511 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:59.427902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-d2f65288-e6b4-4613-9103-c2ae90f89a16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:59.428411 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-d2f65288-e6b4-4613-9103-c2ae90f89a16 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=5c356018-3c06-4505-81ef-c3ae2fab3978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0837483 May 12 15:50:59.444429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=bf953e28-a55a-4b66-91d5-4f44a6c42d01,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:50:59.563837 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-ed9356d4-86db-4dbd-a5e3-7c1a7978bf16 service neutron] 10.222.0.76 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1290727 May 12 15:50:59.701914 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c9de4781-11ba-434b-b0d7-6efc6bc6cdca req-3fea0854-7643-4628-8c69-ee9980d1c668 service neutron] 10.222.0.76 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1293635 May 12 15:50:59.705215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['bf953e28-a55a-4b66-91d5-4f44a6c42d01'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:50:59.832546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b097c716-cc6e-4ce2-960f-98942f8e842f req-9efbe6e4-fd5e-4d88-89e8-e44bc9dc1b2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:59.833969 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b097c716-cc6e-4ce2-960f-98942f8e842f req-9efbe6e4-fd5e-4d88-89e8-e44bc9dc1b2f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 1095 time: 0.0858443 May 12 15:50:59.852835 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:50:59.957352 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:50:59.957352 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:50:59.978784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b097c716-cc6e-4ce2-960f-98942f8e842f req-73daf37a-c339-4637-b7c5-e1299186a0d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:50:59.980232 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b097c716-cc6e-4ce2-960f-98942f8e842f req-73daf37a-c339-4637-b7c5-e1299186a0d5 service neutron] 10.222.0.76 "GET /v2.0/networks?id=5c356018-3c06-4505-81ef-c3ae2fab3978 HTTP/1.1" status: 200 len: 897 time: 0.1396339 May 12 15:51:00.056181 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b097c716-cc6e-4ce2-960f-98942f8e842f req-b6d9ca2e-d2df-4c39-a371-f540acba0901 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=35823aef-382e-46b8-9045-a3751e05ead2 HTTP/1.1" status: 200 len: 217 time: 0.0691607 May 12 15:51:00.134242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b097c716-cc6e-4ce2-960f-98942f8e842f req-539b604a-6037-42f2-a8da-de255038bfad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:00.135965 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b097c716-cc6e-4ce2-960f-98942f8e842f req-539b604a-6037-42f2-a8da-de255038bfad service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d HTTP/1.1" status: 200 len: 835 time: 0.0724583 May 12 15:51:00.227645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b097c716-cc6e-4ce2-960f-98942f8e842f req-2f90c7aa-82f7-4942-b8fc-98bfa1f385f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:00.229577 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b097c716-cc6e-4ce2-960f-98942f8e842f req-2f90c7aa-82f7-4942-b8fc-98bfa1f385f9 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=5c356018-3c06-4505-81ef-c3ae2fab3978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0873768 May 12 15:51:00.287109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3838e50-bf27-4149-9679-b29e40dd9491 req-e801f7cb-9634-4a7a-8aee-a2f331ff0790 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:00.288556 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3838e50-bf27-4149-9679-b29e40dd9491 req-e801f7cb-9634-4a7a-8aee-a2f331ff0790 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 944 time: 0.0936575 May 12 15:51:00.342721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3838e50-bf27-4149-9679-b29e40dd9491 req-b3550e20-9280-49f1-a579-f34af6383a78 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442481 May 12 15:51:00.370415 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b097c716-cc6e-4ce2-960f-98942f8e842f req-1e21f909-ac0b-40e6-860c-988012bdea66 service neutron] 10.222.0.76 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1344666 May 12 15:51:00.465757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef4b90c7-3ba2-4b3f-8400-5eeb332ef114 req-1ca5643b-88d7-4a67-b7d8-8fde9f4c4e93 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:00.467283 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef4b90c7-3ba2-4b3f-8400-5eeb332ef114 req-1ca5643b-88d7-4a67-b7d8-8fde9f4c4e93 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 945 time: 0.0804539 May 12 15:51:00.506547 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b097c716-cc6e-4ce2-960f-98942f8e842f req-4d45a428-6344-4e56-b425-770e5b4587a1 service neutron] 10.222.0.76 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1297815 May 12 15:51:00.517231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef4b90c7-3ba2-4b3f-8400-5eeb332ef114 req-8a62586d-0bb4-491b-ae7a-5c849814ac04 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433054 May 12 15:51:00.922037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bf953e28-a55a-4b66-91d5-4f44a6c42d01 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:51:00.990373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port bf953e28-a55a-4b66-91d5-4f44a6c42d01 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:51:00.995258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port bf953e28-a55a-4b66-91d5-4f44a6c42d01 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:51:00.995622 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:01.107940 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:01.134399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43a0f365-5784-43c7-b293-9e5fe54bd81a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf953e28-a55a-4b66-91d5-4f44a6c42d01'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:51:01.144896 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port bf953e28-a55a-4b66-91d5-4f44a6c42d01, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bf953e28-a55a-4b66-91d5-4f44a6c42d01,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:51:01.148290 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:01.184545 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-954fe8d4-ec5a-4b3d-8f52-43217f76050b'] response: {'server_uuid': '43a0f365-5784-43c7-b293-9e5fe54bd81a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf953e28-a55a-4b66-91d5-4f44a6c42d01', 'code': 200} May 12 15:51:01.225683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=bf953e28-a55a-4b66-91d5-4f44a6c42d01,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:01.340546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf84e37b-b0af-4cae-a1f4-5f62bf340b33 req-a21afcbe-57b8-48cd-a976-e1ddf6052e67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:01.342028 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf84e37b-b0af-4cae-a1f4-5f62bf340b33 req-a21afcbe-57b8-48cd-a976-e1ddf6052e67 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 1097 time: 0.0694997 May 12 15:51:01.386611 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf84e37b-b0af-4cae-a1f4-5f62bf340b33 req-cbe9d72a-28e1-482b-9252-0d1421cd4db4 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0351248 May 12 15:51:01.543688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdbc1c3d-6ce7-4e52-9510-332947abfbb5 req-639712c9-1996-4466-8a71-df5860b647b7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:01.545136 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cdbc1c3d-6ce7-4e52-9510-332947abfbb5 req-639712c9-1996-4466-8a71-df5860b647b7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 944 time: 0.0901046 May 12 15:51:01.599769 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cdbc1c3d-6ce7-4e52-9510-332947abfbb5 req-39b54c00-b02b-4a15-8be0-b8d7e8c51d6e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465226 May 12 15:51:01.716821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ccca72-2fec-42e8-b2c1-71cf5694c6d3 req-d11adbf8-bc41-4ef9-b57a-f3ceaa8ec56d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:01.719082 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37ccca72-2fec-42e8-b2c1-71cf5694c6d3 req-d11adbf8-bc41-4ef9-b57a-f3ceaa8ec56d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 946 time: 0.0889373 May 12 15:51:01.766836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37ccca72-2fec-42e8-b2c1-71cf5694c6d3 req-bbd3bcf2-0e49-4f8f-887d-e360d2d03655 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406544 May 12 15:51:02.350410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 35823aef-382e-46b8-9045-a3751e05ead2 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:51:02.496346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=35823aef-382e-46b8-9045-a3751e05ead2,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:51:02.512772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '35823aef-382e-46b8-9045-a3751e05ead2', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'port_id': '35823aef-382e-46b8-9045-a3751e05ead2', 'mac_address': 'fa:16:3e:e9:1b:e7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 579, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:51:02.570934 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:02.590553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 35823aef-382e-46b8-9045-a3751e05ead2 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:51:02.650856 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=35823aef-382e-46b8-9045-a3751e05ead2,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:51:02.652827 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:02.663711 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:02.746545 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=35823aef-382e-46b8-9045-a3751e05ead2,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:02.876256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['35823aef-382e-46b8-9045-a3751e05ead2'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:51:02.954710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08f3125c-ada8-4276-b944-cb75ec039bfe req-ded2c2e1-1833-411f-bc4f-23e982d46fa4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:02.957059 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08f3125c-ada8-4276-b944-cb75ec039bfe req-ded2c2e1-1833-411f-bc4f-23e982d46fa4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 945 time: 0.2331553 May 12 15:51:03.023413 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-08f3125c-ada8-4276-b944-cb75ec039bfe req-67c141ac-08f8-46cf-b5ff-72131d721b29 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0560665 May 12 15:51:03.041049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ba80f2-abf5-4a56-87f2-80cbecdbc8cf req-2b0b8546-2df6-476e-b37c-cc396818ed8d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:03.042779 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6ba80f2-abf5-4a56-87f2-80cbecdbc8cf req-2b0b8546-2df6-476e-b37c-cc396818ed8d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 946 time: 0.1449032 May 12 15:51:03.102012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6ba80f2-abf5-4a56-87f2-80cbecdbc8cf req-2183ed19-4530-4b2d-b5a4-f8e690bce809 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513399 May 12 15:51:03.320963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dc9f6bc-5899-4b28-881f-d04c8d94fa50 req-a48ddf6f-64ad-428e-8d7b-57e392dd9e38 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:03.323069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1dc9f6bc-5899-4b28-881f-d04c8d94fa50 req-a48ddf6f-64ad-428e-8d7b-57e392dd9e38 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 946 time: 0.1075184 May 12 15:51:03.375733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1dc9f6bc-5899-4b28-881f-d04c8d94fa50 req-fd328f4f-619a-4170-927d-5d0fef8f818f tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447490 May 12 15:51:03.869401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d550a4a8-c890-43e5-b920-ddae7ae3ea2b req-acf98ac1-a394-4089-817e-036286ce400c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:03.870852 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d550a4a8-c890-43e5-b920-ddae7ae3ea2b req-acf98ac1-a394-4089-817e-036286ce400c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 946 time: 0.0874460 May 12 15:51:03.921206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d550a4a8-c890-43e5-b920-ddae7ae3ea2b req-f1cd1286-d331-4b14-863d-49be4586be64 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395637 May 12 15:51:04.227543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88f432ba-5786-4dff-b95a-6f75ad64da3b req-c8ea3485-5976-4026-9e5e-4096c06202e9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:04.229013 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88f432ba-5786-4dff-b95a-6f75ad64da3b req-c8ea3485-5976-4026-9e5e-4096c06202e9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 945 time: 0.0840082 May 12 15:51:04.289923 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88f432ba-5786-4dff-b95a-6f75ad64da3b req-76332aca-c418-4025-84de-0d4ca96ee73c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0538566 May 12 15:51:04.350025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 35823aef-382e-46b8-9045-a3751e05ead2 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:51:04.420378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 35823aef-382e-46b8-9045-a3751e05ead2 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:51:04.425523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 35823aef-382e-46b8-9045-a3751e05ead2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:51:04.425727 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:04.547594 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:04.578230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:51:04.598305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=35823aef-382e-46b8-9045-a3751e05ead2,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:51:04.598884 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:04.646291 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-44d291a4-5db3-40b1-962d-b028c1fe4640'] response: {'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2', 'code': 200} May 12 15:51:04.688113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=35823aef-382e-46b8-9045-a3751e05ead2,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:04.796799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2adf8212-f770-4835-87d7-d704bc9a9bf8 req-80d58120-3224-46cf-aa3a-e70e9d1bc65c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:04.798705 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2adf8212-f770-4835-87d7-d704bc9a9bf8 req-80d58120-3224-46cf-aa3a-e70e9d1bc65c service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 1097 time: 0.0810890 May 12 15:51:04.846617 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2adf8212-f770-4835-87d7-d704bc9a9bf8 req-22a1b6d7-3a4b-432e-9c80-19250d4765fd service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418901 May 12 15:51:05.136175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e12b499f-e950-4ad1-b448-02a451d42e0c req-68a2ed35-ea92-4090-92d2-afbd8091c33d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:05.136175 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e12b499f-e950-4ad1-b448-02a451d42e0c req-68a2ed35-ea92-4090-92d2-afbd8091c33d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 946 time: 0.0894492 May 12 15:51:05.181443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e12b499f-e950-4ad1-b448-02a451d42e0c req-eeab944f-6a1f-4c7f-8451-199bb455a7f9 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398500 May 12 15:51:05.481727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f43d1eb5-6e71-4e2e-9d28-7801550c5e9c req-58c0178c-a84c-4eb4-a9ea-2e397e5be772 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:05.484482 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f43d1eb5-6e71-4e2e-9d28-7801550c5e9c req-58c0178c-a84c-4eb4-a9ea-2e397e5be772 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 946 time: 0.0807743 May 12 15:51:05.584908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f43d1eb5-6e71-4e2e-9d28-7801550c5e9c req-81ecb297-1be4-45e7-ba6a-b5d4e57edb3b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0931630 May 12 15:51:05.610296 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70ab5474-361f-4ada-8f72-854723c7230e req-3033f52b-78c7-4fa4-aa7d-0f7a454e5f82 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:05.611542 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70ab5474-361f-4ada-8f72-854723c7230e req-3033f52b-78c7-4fa4-aa7d-0f7a454e5f82 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.84 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 946 time: 0.1033261 May 12 15:51:05.692371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-70ab5474-361f-4ada-8f72-854723c7230e req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Deleting port bf953e28-a55a-4b66-91d5-4f44a6c42d01 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:51:05.692714 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-70ab5474-361f-4ada-8f72-854723c7230e req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:05.972619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-70ab5474-361f-4ada-8f72-854723c7230e req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] For port bf953e28-a55a-4b66-91d5-4f44a6c42d01, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=bf953e28-a55a-4b66-91d5-4f44a6c42d01,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:51:05.972619 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-70ab5474-361f-4ada-8f72-854723c7230e req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:06.134057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-70ab5474-361f-4ada-8f72-854723c7230e req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Calling delete_port for bf953e28-a55a-4b66-91d5-4f44a6c42d01 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:51:06.362703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-70ab5474-361f-4ada-8f72-854723c7230e req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:06.376607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['3dbc269e-09ab-4df2-bf68-d107d7df7c00'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:51:06.417294 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['bf953e28-a55a-4b66-91d5-4f44a6c42d01'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:51:06.450712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event deleted for resources: {'Port': ['ID=bf953e28-a55a-4b66-91d5-4f44a6c42d01,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:06.507068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:06.507670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:06.507782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:06.508037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:06.508356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:06.508909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:06.509045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:06.509645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:06.510010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:06.510561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:06.510710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:06.511231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:06.529469 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-70ab5474-361f-4ada-8f72-854723c7230e req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] No DVR routers for this DVR port bf953e28-a55a-4b66-91d5-4f44a6c42d01 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:51:06.532899 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-70ab5474-361f-4ada-8f72-854723c7230e req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:06.535645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43a0f365-5784-43c7-b293-9e5fe54bd81a', 'name': 'network-vif-deleted', 'tag': 'bf953e28-a55a-4b66-91d5-4f44a6c42d01'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:51:06.570164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a2a9bbc-4486-4cda-87b1-e42b89d0cb57 req-5e4322b7-f05a-4876-8197-fbab1ba96b16 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:06.571616 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a2a9bbc-4486-4cda-87b1-e42b89d0cb57 req-5e4322b7-f05a-4876-8197-fbab1ba96b16 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 946 time: 0.2764182 May 12 15:51:06.596234 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70ab5474-361f-4ada-8f72-854723c7230e req-25903150-6a81-47bb-bfa9-118a6ca35f20 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.84 "DELETE /v2.0/ports/bf953e28-a55a-4b66-91d5-4f44a6c42d01 HTTP/1.1" status: 204 len: 173 time: 0.9769530 May 12 15:51:06.600981 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3aacf350-c296-480a-af45-752b6816611b'] response: {'server_uuid': '43a0f365-5784-43c7-b293-9e5fe54bd81a', 'name': 'network-vif-deleted', 'tag': 'bf953e28-a55a-4b66-91d5-4f44a6c42d01', 'status': 'completed', 'code': 200} May 12 15:51:06.642815 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a2a9bbc-4486-4cda-87b1-e42b89d0cb57 req-b315f415-1b08-4df1-883a-5d5b5fa9ef1b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645857 May 12 15:51:06.823512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-956192af-ab02-4357-b433-9dbc4eca2396 req-029e9bc4-7dd1-4873-af01-01c2731519fb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:06.825413 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-956192af-ab02-4357-b433-9dbc4eca2396 req-029e9bc4-7dd1-4873-af01-01c2731519fb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 946 time: 0.0977380 May 12 15:51:06.989469 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-956192af-ab02-4357-b433-9dbc4eca2396 req-23c77459-2b7b-4b6b-a2aa-845bf29fa816 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1562240 May 12 15:51:07.233546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-353d2447-c395-4f59-9a77-eb861f729460 req-c25785cd-5879-44b4-8428-0d97e0cbac60 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:07.238045 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-353d2447-c395-4f59-9a77-eb861f729460 req-c25785cd-5879-44b4-8428-0d97e0cbac60 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 946 time: 0.1221201 May 12 15:51:07.303551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-353d2447-c395-4f59-9a77-eb861f729460 req-1ed57bf6-983d-415b-b21b-0cb771d50303 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0579782 May 12 15:51:07.326425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50602) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:07.398646 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a57374ed-6726-4119-928e-8aafb73fac89 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:07.400171 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a57374ed-6726-4119-928e-8aafb73fac89 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 1092 time: 0.0718822 May 12 15:51:07.403068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50606) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:07.408679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '35823aef-382e-46b8-9045-a3751e05ead2', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address': '172.20.0.12'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:51:07.415619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:51:07.419752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:floatingip and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:51:07.423060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:51:07.429212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:51:07.441675 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:07.580602 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:07.728292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.25.8.207 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/007163ab-b33d-4bb4-9d50-8f0cb780a49d) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:51:07.873951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-464f9105-ea55-477f-843c-fa0d615e350f req-2141dae9-faaa-4a25-a11d-f2e77cf31ccd tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Synchronizing usage tracker for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:51:07.891800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-464f9105-ea55-477f-843c-fa0d615e350f req-2141dae9-faaa-4a25-a11d-f2e77cf31ccd tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Unset dirty status for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:51:07.892930 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-464f9105-ea55-477f-843c-fa0d615e350f req-2141dae9-faaa-4a25-a11d-f2e77cf31ccd tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=43a0f365-5784-43c7-b293-9e5fe54bd81a HTTP/1.1" status: 200 len: 210 time: 0.1164916 May 12 15:51:07.912261 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:07.943551 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:08.146938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:51:08.150530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:51:08.153708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:51:08.188549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=007163ab-b33d-4bb4-9d50-8f0cb780a49d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:08.632887 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:08.710196 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:08.921141 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:08.926275 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:08.954415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bf953e28-a55a-4b66-91d5-4f44a6c42d01 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:51:09.008499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: bf953e28-a55a-4b66-91d5-4f44a6c42d01 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:51:09.009078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device bf953e28-a55a-4b66-91d5-4f44a6c42d01 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:51:09.043254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=007163ab-b33d-4bb4-9d50-8f0cb780a49d,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:09.052361 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:09.227951 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Floating IP 62f35174-7941-4bca-9593-bb1dd910fbeb associated. External IP: 172.25.8.207, port: 35823aef-382e-46b8-9045-a3751e05ead2. May 12 15:51:09.588673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router 75747bdd-2928-4a50-929a-8d28830552b1 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:51:09.894368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:51:09.904100 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e15f2dc3-72b0-43bb-ac3f-684e255a0508 None None] Sync routers for ids ['75747bdd-2928-4a50-929a-8d28830552b1'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:51:09.915787 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e15f2dc3-72b0-43bb-ac3f-684e255a0508 None None] Routers {'75747bdd-2928-4a50-929a-8d28830552b1'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:51:09.916294 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e15f2dc3-72b0-43bb-ac3f-684e255a0508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:50:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['75747bdd-2928-4a50-929a-8d28830552b1'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:51:09.919549 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:09.998986 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-abf0c8cb-40f1-403b-ba1a-82a6ac33196d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.5915213 May 12 15:51:09.998986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:51:10.056286 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-82a58c5c-e10a-4062-97f2-de120f764560'] response: {'name': 'network-changed', 'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2', 'status': 'completed', 'code': 200} May 12 15:51:10.103768 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-e15f2dc3-72b0-43bb-ac3f-684e255a0508 None None] Set router 75747bdd-2928-4a50-929a-8d28830552b1 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:51:10.154116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef37b2d3-21f3-406a-abbe-511c71d2b32a req-553b0da1-450f-4c48-b7b2-3e15b547bef4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:10.156241 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef37b2d3-21f3-406a-abbe-511c71d2b32a req-553b0da1-450f-4c48-b7b2-3e15b547bef4 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 1097 time: 0.0763159 May 12 15:51:10.234367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49af26bb-d36a-4a1e-a82b-1ae3e5d9d7f0 req-175ef4ca-c585-4bf4-9f73-146571a1e3ba tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:10.237174 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49af26bb-d36a-4a1e-a82b-1ae3e5d9d7f0 req-175ef4ca-c585-4bf4-9f73-146571a1e3ba tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 946 time: 0.1218691 May 12 15:51:10.304702 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49af26bb-d36a-4a1e-a82b-1ae3e5d9d7f0 req-94c1cfb7-2874-48cc-8dba-7e0b89c4933a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0617356 May 12 15:51:10.339256 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50626) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:10.380106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef37b2d3-21f3-406a-abbe-511c71d2b32a req-9bf045b6-99ad-4295-aeec-25eef68cca6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:10.382097 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef37b2d3-21f3-406a-abbe-511c71d2b32a req-9bf045b6-99ad-4295-aeec-25eef68cca6e service neutron] 10.222.0.76 "GET /v2.0/networks?id=5c356018-3c06-4505-81ef-c3ae2fab3978 HTTP/1.1" status: 200 len: 897 time: 0.2204504 May 12 15:51:10.488921 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8aa40c34-49fd-495a-9272-597d3df8c49d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/62f35174-7941-4bca-9593-bb1dd910fbeb HTTP/1.1" status: 200 len: 992 time: 0.1468732 May 12 15:51:10.498610 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef37b2d3-21f3-406a-abbe-511c71d2b32a req-17028441-8fb5-4b5d-b3b7-534fb488de6b service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=35823aef-382e-46b8-9045-a3751e05ead2 HTTP/1.1" status: 200 len: 1000 time: 0.1090457 May 12 15:51:10.525532 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e15f2dc3-72b0-43bb-ac3f-684e255a0508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '62f35174-7941-4bca-9593-bb1dd910fbeb', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'floating_ip_address': '172.25.8.207', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'port_id': '35823aef-382e-46b8-9045-a3751e05ead2', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 4064, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'mac_address': 'fa:16:3e:e9:1b:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:51:08Z', 'updated_at': '2022-05-12T15:51:08Z', 'revision_number': 0, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256', 'name': '', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:51:de:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4061, 'fixed_ips': [{'subnet_id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:51Z', 'updated_at': '2022-05-12T15:50:58Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:51:10.529368 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e15f2dc3-72b0-43bb-ac3f-684e255a0508 None None] Checking router: 75747bdd-2928-4a50-929a-8d28830552b1 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:51:10.538977 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e15f2dc3-72b0-43bb-ac3f-684e255a0508 None None] Routers {'75747bdd-2928-4a50-929a-8d28830552b1'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:51:10.539572 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e15f2dc3-72b0-43bb-ac3f-684e255a0508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:50:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['75747bdd-2928-4a50-929a-8d28830552b1'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:51:10.562282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef37b2d3-21f3-406a-abbe-511c71d2b32a req-64c374d5-86f1-4ca9-a9b5-0b5796d9ad32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:10.563722 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef37b2d3-21f3-406a-abbe-511c71d2b32a req-64c374d5-86f1-4ca9-a9b5-0b5796d9ad32 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d HTTP/1.1" status: 200 len: 835 time: 0.0598073 May 12 15:51:10.645687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef37b2d3-21f3-406a-abbe-511c71d2b32a req-8b5b410e-f22d-4dd0-8a45-0c9ebd0b11f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:10.647153 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef37b2d3-21f3-406a-abbe-511c71d2b32a req-8b5b410e-f22d-4dd0-8a45-0c9ebd0b11f1 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=5c356018-3c06-4505-81ef-c3ae2fab3978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0767312 May 12 15:51:10.722359 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-e15f2dc3-72b0-43bb-ac3f-684e255a0508 None None] Set router 75747bdd-2928-4a50-929a-8d28830552b1 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:51:10.792538 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef37b2d3-21f3-406a-abbe-511c71d2b32a req-16d0bc9a-b507-4295-85f2-2ac3b3f2b65d service neutron] 10.222.0.76 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1389005 May 12 15:51:10.934469 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ef37b2d3-21f3-406a-abbe-511c71d2b32a req-bf552e77-5d9e-4742-886a-3deee4ee6540 service neutron] 10.222.0.76 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1360271 May 12 15:51:11.125149 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e15f2dc3-72b0-43bb-ac3f-684e255a0508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '62f35174-7941-4bca-9593-bb1dd910fbeb', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'floating_ip_address': '172.25.8.207', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'port_id': '35823aef-382e-46b8-9045-a3751e05ead2', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 4064, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'mac_address': 'fa:16:3e:e9:1b:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:51:08Z', 'updated_at': '2022-05-12T15:51:08Z', 'revision_number': 0, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256', 'name': '', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:51:de:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4061, 'fixed_ips': [{'subnet_id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:51Z', 'updated_at': '2022-05-12T15:50:58Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:51:11.129293 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e15f2dc3-72b0-43bb-ac3f-684e255a0508 None None] The sync data for ids ['75747bdd-2928-4a50-929a-8d28830552b1'] in n-d-841483-1 is: [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '62f35174-7941-4bca-9593-bb1dd910fbeb', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'floating_ip_address': '172.25.8.207', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'port_id': '35823aef-382e-46b8-9045-a3751e05ead2', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 4064, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'mac_address': 'fa:16:3e:e9:1b:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:51:08Z', 'updated_at': '2022-05-12T15:51:08Z', 'revision_number': 0, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256', 'name': '', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:51:de:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4061, 'fixed_ips': [{'subnet_id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:51Z', 'updated_at': '2022-05-12T15:50:58Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:51:11.366992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1594fa69-77b1-4fed-ad35-700f7add5ae9 None None] New status for floating IP 62f35174-7941-4bca-9593-bb1dd910fbeb: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:51:11.492960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50632) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:11.614667 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c7ae5e84-bfdf-4ded-8895-d74dd203e7a4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/62f35174-7941-4bca-9593-bb1dd910fbeb HTTP/1.1" status: 200 len: 992 time: 0.1195216 May 12 15:51:12.304822 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01bdc555-5bfb-4592-ad98-40db2f025184 req-56d95085-70e3-43ae-810d-ccb9d9604819 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0401356 May 12 15:51:12.411757 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01bdc555-5bfb-4592-ad98-40db2f025184 req-4ccd40db-daf1-4f4f-87f7-421b916917db service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0408974 May 12 15:51:12.454751 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01bdc555-5bfb-4592-ad98-40db2f025184 req-ba94673a-3391-40dd-ba4c-526f151002ea service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0259273 May 12 15:51:12.589255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01bdc555-5bfb-4592-ad98-40db2f025184 req-f241802f-3509-4789-9016-3c8c5a46be4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:12.590637 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-01bdc555-5bfb-4592-ad98-40db2f025184 req-f241802f-3509-4789-9016-3c8c5a46be4c service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1305628 May 12 15:51:12.618099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50640) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:12.728770 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ad1684fd-b66d-4f0a-b04a-cb8c2321921a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/62f35174-7941-4bca-9593-bb1dd910fbeb HTTP/1.1" status: 200 len: 994 time: 0.1095083 May 12 15:51:12.764487 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6dc3b21e-8277-46b7-956e-9d0c00fb4145 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:12.821318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b23eac5-8329-409f-9127-c6c3bfa29cf2 req-68a1a07b-6084-4e62-a1d4-94814f07cc2c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:12.822768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b23eac5-8329-409f-9127-c6c3bfa29cf2 req-68a1a07b-6084-4e62-a1d4-94814f07cc2c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 946 time: 0.0799937 May 12 15:51:12.871831 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b23eac5-8329-409f-9127-c6c3bfa29cf2 req-f93ad2c4-e512-451c-b0a5-96ec9b59de82 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426207 May 12 15:51:13.379569 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:14.060627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10d67adc-1362-450b-9440-dfbfc359c39e req-ccde72e6-ff00-4015-9f5e-feff1e7ef60b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:14.062042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10d67adc-1362-450b-9440-dfbfc359c39e req-ccde72e6-ff00-4015-9f5e-feff1e7ef60b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 946 time: 0.0801849 May 12 15:51:14.105589 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10d67adc-1362-450b-9440-dfbfc359c39e req-5aad6f9a-fe34-4c88-9a96-a35a76e19a08 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=222fbe49-cc04-4730-9bd7-c945c6e93703&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377707 May 12 15:51:14.273943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04fd2bca-91ee-4752-9719-d3667bfcfae2 req-3c1958c8-68f8-4ae7-b152-d6bfb83db29c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:14.274665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-04fd2bca-91ee-4752-9719-d3667bfcfae2 req-3c1958c8-68f8-4ae7-b152-d6bfb83db29c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Synchronizing usage tracker for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:51:14.286874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-04fd2bca-91ee-4752-9719-d3667bfcfae2 req-3c1958c8-68f8-4ae7-b152-d6bfb83db29c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Unset dirty status for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:51:14.288121 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-04fd2bca-91ee-4752-9719-d3667bfcfae2 req-3c1958c8-68f8-4ae7-b152-d6bfb83db29c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 946 time: 0.0969305 May 12 15:51:14.356402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-04fd2bca-91ee-4752-9719-d3667bfcfae2 req-45dbe5d2-3ef1-4105-87ad-ac34554d7d22 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Deleting port 3dbc269e-09ab-4df2-bf68-d107d7df7c00 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:51:14.356665 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-04fd2bca-91ee-4752-9719-d3667bfcfae2 req-45dbe5d2-3ef1-4105-87ad-ac34554d7d22 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:14.703871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-04fd2bca-91ee-4752-9719-d3667bfcfae2 req-45dbe5d2-3ef1-4105-87ad-ac34554d7d22 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] For port 3dbc269e-09ab-4df2-bf68-d107d7df7c00, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3dbc269e-09ab-4df2-bf68-d107d7df7c00,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:51:14.704131 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-04fd2bca-91ee-4752-9719-d3667bfcfae2 req-45dbe5d2-3ef1-4105-87ad-ac34554d7d22 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:14.830161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-04fd2bca-91ee-4752-9719-d3667bfcfae2 req-45dbe5d2-3ef1-4105-87ad-ac34554d7d22 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Calling delete_port for 3dbc269e-09ab-4df2-bf68-d107d7df7c00 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:51:14.972171 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-04fd2bca-91ee-4752-9719-d3667bfcfae2 req-45dbe5d2-3ef1-4105-87ad-ac34554d7d22 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:14.983057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['3dbc269e-09ab-4df2-bf68-d107d7df7c00'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:51:15.024279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45dbe5d2-3ef1-4105-87ad-ac34554d7d22 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event deleted for resources: {'Port': ['ID=3dbc269e-09ab-4df2-bf68-d107d7df7c00,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:15.100172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-04fd2bca-91ee-4752-9719-d3667bfcfae2 req-45dbe5d2-3ef1-4105-87ad-ac34554d7d22 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] No DVR routers for this DVR port 3dbc269e-09ab-4df2-bf68-d107d7df7c00 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:51:15.102738 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-04fd2bca-91ee-4752-9719-d3667bfcfae2 req-45dbe5d2-3ef1-4105-87ad-ac34554d7d22 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:15.105176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0459b60-9f54-4abe-a672-1cf9077c6465', 'name': 'network-vif-deleted', 'tag': '3dbc269e-09ab-4df2-bf68-d107d7df7c00'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:51:15.121983 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-04fd2bca-91ee-4752-9719-d3667bfcfae2 req-45dbe5d2-3ef1-4105-87ad-ac34554d7d22 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "DELETE /v2.0/ports/3dbc269e-09ab-4df2-bf68-d107d7df7c00 HTTP/1.1" status: 204 len: 173 time: 0.8285711 May 12 15:51:15.155154 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1afd30e3-f277-47fe-b378-05655f000b42'] response: {'server_uuid': 'f0459b60-9f54-4abe-a672-1cf9077c6465', 'name': 'network-vif-deleted', 'tag': '3dbc269e-09ab-4df2-bf68-d107d7df7c00', 'status': 'completed', 'code': 200} May 12 15:51:15.266513 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b7c36ea9-5f06-4dd5-8e3d-15b175670253 req-3980e7e3-2b9a-4a55-8698-0f024a3c1c19 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=f0459b60-9f54-4abe-a672-1cf9077c6465 HTTP/1.1" status: 200 len: 210 time: 0.0509923 May 12 15:51:15.314751 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-68b630a5-639f-4600-9eb3-f303a783ffc0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:16.050709 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:16.281061 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:17.761584 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.409814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 50704) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:18.415030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-bbf4c027-9598-432d-bbfb-b2e505cc62d2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1371785595', 'description': 'tempest-secgroup-smoke-1371785595 description', 'project_id': '939000b7f70c4c85a39e52ee93a06ed5'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:51:18.421745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bbf4c027-9598-432d-bbfb-b2e505cc62d2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:51:18.431094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bbf4c027-9598-432d-bbfb-b2e505cc62d2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:51:18.442148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbf4c027-9598-432d-bbfb-b2e505cc62d2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.443187 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 3dbc269e-09ab-4df2-bf68-d107d7df7c00 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:51:18.462961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bbf4c027-9598-432d-bbfb-b2e505cc62d2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:51:18.466713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bbf4c027-9598-432d-bbfb-b2e505cc62d2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:security_group_rule and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:51:18.469738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bbf4c027-9598-432d-bbfb-b2e505cc62d2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:51:18.475625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bbf4c027-9598-432d-bbfb-b2e505cc62d2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:51:18.477964 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 3dbc269e-09ab-4df2-bf68-d107d7df7c00 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:51:18.478312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 3dbc269e-09ab-4df2-bf68-d107d7df7c00 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:51:18.548036 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbf4c027-9598-432d-bbfb-b2e505cc62d2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.551432 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbf4c027-9598-432d-bbfb-b2e505cc62d2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.596071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbf4c027-9598-432d-bbfb-b2e505cc62d2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d3930bee-f9c9-401c-921a-1058f06217af,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:18.598678 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbf4c027-9598-432d-bbfb-b2e505cc62d2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.601854 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bbf4c027-9598-432d-bbfb-b2e505cc62d2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1909051 May 12 15:51:18.602801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50708) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:18.608211 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-08ba57d8-4ffc-44b1-a36f-ecc3c1d7d6f5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'security_group_rule': {'security_group_id': 'd3930bee-f9c9-401c-921a-1058f06217af', 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:51:18.616849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-08ba57d8-4ffc-44b1-a36f-ecc3c1d7d6f5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:51:18.620644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-08ba57d8-4ffc-44b1-a36f-ecc3c1d7d6f5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:security_group_rule and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:51:18.623500 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-08ba57d8-4ffc-44b1-a36f-ecc3c1d7d6f5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:51:18.630168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-08ba57d8-4ffc-44b1-a36f-ecc3c1d7d6f5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:51:18.645836 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-08ba57d8-4ffc-44b1-a36f-ecc3c1d7d6f5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.708460 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-08ba57d8-4ffc-44b1-a36f-ecc3c1d7d6f5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.711894 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-08ba57d8-4ffc-44b1-a36f-ecc3c1d7d6f5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.735236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08ba57d8-4ffc-44b1-a36f-ecc3c1d7d6f5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c84beba4-209f-4bf8-9100-363a3c836d5e,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:18.743287 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-08ba57d8-4ffc-44b1-a36f-ecc3c1d7d6f5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.744510 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-08ba57d8-4ffc-44b1-a36f-ecc3c1d7d6f5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1403852 May 12 15:51:18.747334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50712) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:18.753589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-43a210d8-12bb-45bf-b2c6-56b30e91d3ee tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'security_group_rule': {'security_group_id': 'd3930bee-f9c9-401c-921a-1058f06217af', 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:51:18.759969 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-43a210d8-12bb-45bf-b2c6-56b30e91d3ee tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:51:18.763926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-43a210d8-12bb-45bf-b2c6-56b30e91d3ee tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:security_group_rule and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:51:18.767033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-43a210d8-12bb-45bf-b2c6-56b30e91d3ee tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:51:18.772620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-43a210d8-12bb-45bf-b2c6-56b30e91d3ee tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:51:18.789100 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43a210d8-12bb-45bf-b2c6-56b30e91d3ee tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.849061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43a210d8-12bb-45bf-b2c6-56b30e91d3ee tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.852556 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43a210d8-12bb-45bf-b2c6-56b30e91d3ee tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.876450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43a210d8-12bb-45bf-b2c6-56b30e91d3ee tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b91feff6-ace5-4cd6-84a6-9a8153d46d2b,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:18.884728 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-43a210d8-12bb-45bf-b2c6-56b30e91d3ee tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.885937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-43a210d8-12bb-45bf-b2c6-56b30e91d3ee tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1377089 May 12 15:51:18.888581 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50716) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:18.893823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-79522ea5-77e2-466f-a4a6-139dadafacaf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'security_group_rule': {'security_group_id': 'd3930bee-f9c9-401c-921a-1058f06217af', 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:51:18.900147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-79522ea5-77e2-466f-a4a6-139dadafacaf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:51:18.904023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-79522ea5-77e2-466f-a4a6-139dadafacaf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:security_group_rule and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:51:18.907532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-79522ea5-77e2-466f-a4a6-139dadafacaf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:51:18.913157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-79522ea5-77e2-466f-a4a6-139dadafacaf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:51:18.930221 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79522ea5-77e2-466f-a4a6-139dadafacaf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.994201 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79522ea5-77e2-466f-a4a6-139dadafacaf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:18.998862 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79522ea5-77e2-466f-a4a6-139dadafacaf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:19.029237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79522ea5-77e2-466f-a4a6-139dadafacaf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9d73032f-c7eb-4659-8f37-0b7b15047a68,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:19.038088 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79522ea5-77e2-466f-a4a6-139dadafacaf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:19.039298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-79522ea5-77e2-466f-a4a6-139dadafacaf tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1497426 May 12 15:51:19.042008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50720) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:19.047625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f477cfe5-8ad0-4bbb-a2cb-76e9370e7675 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'security_group_rule': {'security_group_id': 'd3930bee-f9c9-401c-921a-1058f06217af', 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:51:19.054154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f477cfe5-8ad0-4bbb-a2cb-76e9370e7675 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:51:19.058259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f477cfe5-8ad0-4bbb-a2cb-76e9370e7675 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:security_group_rule and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:51:19.061633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f477cfe5-8ad0-4bbb-a2cb-76e9370e7675 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:51:19.068443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f477cfe5-8ad0-4bbb-a2cb-76e9370e7675 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:51:19.084438 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f477cfe5-8ad0-4bbb-a2cb-76e9370e7675 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:19.146919 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f477cfe5-8ad0-4bbb-a2cb-76e9370e7675 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:19.150566 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f477cfe5-8ad0-4bbb-a2cb-76e9370e7675 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:19.174200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f477cfe5-8ad0-4bbb-a2cb-76e9370e7675 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a6b50e47-18b7-485e-b1aa-34f07120c875,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:19.182511 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f477cfe5-8ad0-4bbb-a2cb-76e9370e7675 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:19.183722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f477cfe5-8ad0-4bbb-a2cb-76e9370e7675 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1407964 May 12 15:51:19.186401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50724) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:19.191268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4eed6238-4ef3-4a31-9eda-0bd7df90570c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'security_group_rule': {'security_group_id': 'd3930bee-f9c9-401c-921a-1058f06217af', 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:51:19.197540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4eed6238-4ef3-4a31-9eda-0bd7df90570c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:51:19.201276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4eed6238-4ef3-4a31-9eda-0bd7df90570c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:security_group_rule and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:51:19.204136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4eed6238-4ef3-4a31-9eda-0bd7df90570c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:51:19.209690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4eed6238-4ef3-4a31-9eda-0bd7df90570c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:51:19.221109 n-d-841483-1 neutron-server[88152]: INFO neutron.db.securitygroups_db [None req-4eed6238-4ef3-4a31-9eda-0bd7df90570c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Project 939000b7f70c4c85a39e52ee93a06ed5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:51:19.227641 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4eed6238-4ef3-4a31-9eda-0bd7df90570c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:19.292233 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4eed6238-4ef3-4a31-9eda-0bd7df90570c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:19.295899 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4eed6238-4ef3-4a31-9eda-0bd7df90570c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:19.323150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eed6238-4ef3-4a31-9eda-0bd7df90570c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e31c2043-bc89-485e-bbf0-466c32c2eb44,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:19.332497 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4eed6238-4ef3-4a31-9eda-0bd7df90570c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:19.333931 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4eed6238-4ef3-4a31-9eda-0bd7df90570c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1465085 May 12 15:51:19.336640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50728) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:19.341839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1c371371-1828-4f55-b954-570abb12cbc3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'security_group_rule': {'security_group_id': 'd3930bee-f9c9-401c-921a-1058f06217af', 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:51:19.349361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1c371371-1828-4f55-b954-570abb12cbc3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:51:19.353203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1c371371-1828-4f55-b954-570abb12cbc3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:security_group_rule and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:51:19.356113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1c371371-1828-4f55-b954-570abb12cbc3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:51:19.361798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1c371371-1828-4f55-b954-570abb12cbc3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:51:19.371588 n-d-841483-1 neutron-server[88152]: INFO neutron.db.securitygroups_db [None req-1c371371-1828-4f55-b954-570abb12cbc3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Project 939000b7f70c4c85a39e52ee93a06ed5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:51:19.378276 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1c371371-1828-4f55-b954-570abb12cbc3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:19.441943 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1c371371-1828-4f55-b954-570abb12cbc3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:19.445657 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1c371371-1828-4f55-b954-570abb12cbc3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:19.469107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c371371-1828-4f55-b954-570abb12cbc3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0e9dfd76-a3f8-4df1-888f-034b12417ee2,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:19.478231 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1c371371-1828-4f55-b954-570abb12cbc3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:19.479403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1c371371-1828-4f55-b954-570abb12cbc3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1418197 May 12 15:51:26.973186 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:51:32.630591 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:33.306664 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-975ddbeb-2e1f-44ea-b9f8-57991637c9a7 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1371785595&fields=id&tenant_id=939000b7f70c4c85a39e52ee93a06ed5 HTTP/1.1" status: 200 len: 267 time: 0.0388751 May 12 15:51:33.454577 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-eb6f3b0e-8fd7-48d9-bf08-627b7d3b3b43 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:33.455983 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-eb6f3b0e-8fd7-48d9-bf08-627b7d3b3b43 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 812 time: 0.1417968 May 12 15:51:33.471086 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-642e53be-b51a-412e-aa10-7511890c652e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/quotas/939000b7f70c4c85a39e52ee93a06ed5 HTTP/1.1" status: 200 len: 375 time: 0.0097184 May 12 15:51:33.555038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4e6848db-90cc-4ead-afc9-9abf743779a7 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0790334 May 12 15:51:33.691279 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-7064feb7-3bee-437d-9812-76e2099c5047 service neutron] 10.222.0.82 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1245902 May 12 15:51:33.821526 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-962399ed-f404-4482-91f4-de76bd520506 service neutron] 10.222.0.82 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1243110 May 12 15:51:34.068966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-114c8bf5-43fb-4387-8376-c83376d046ad req-38c72329-b528-4e16-898d-b9f2da67308a service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0756848 May 12 15:51:34.364398 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d920db1a-64b8-4224-b418-a2c3bb3a58d5 req-72e5cb14-7258-488a-8366-fd5a92e90a2b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 210 time: 0.1571007 May 12 15:51:34.407922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-114c8bf5-43fb-4387-8376-c83376d046ad req-e504489e-24a3-425b-90e7-0b1accb7c6cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:34.409400 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-114c8bf5-43fb-4387-8376-c83376d046ad req-e504489e-24a3-425b-90e7-0b1accb7c6cf service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1151aa532835463f914c578c906281f8&device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 1096 time: 0.2326429 May 12 15:51:34.569648 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-114c8bf5-43fb-4387-8376-c83376d046ad req-ace63883-cfac-4ff1-935a-802969e2c0d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:34.571083 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-114c8bf5-43fb-4387-8376-c83376d046ad req-ace63883-cfac-4ff1-935a-802969e2c0d7 service neutron] 10.222.0.84 "GET /v2.0/networks?id=b6bf3355-4481-47dd-96cc-1e4a6e5445a3 HTTP/1.1" status: 200 len: 907 time: 0.1377172 May 12 15:51:34.681684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-114c8bf5-43fb-4387-8376-c83376d046ad req-8efaf3ec-da62-4354-8809-eea3ddc9956b service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b HTTP/1.1" status: 200 len: 1001 time: 0.1036968 May 12 15:51:34.758864 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-114c8bf5-43fb-4387-8376-c83376d046ad req-25fe6892-1cbf-4e87-86c5-84dc48b97f90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:34.760941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-114c8bf5-43fb-4387-8376-c83376d046ad req-25fe6892-1cbf-4e87-86c5-84dc48b97f90 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=a6a2c883-c889-4a5d-b880-b94c7f7dbeff HTTP/1.1" status: 200 len: 845 time: 0.0616300 May 12 15:51:34.840738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-114c8bf5-43fb-4387-8376-c83376d046ad req-af199c6a-398e-472d-a83b-9a506d4438fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:34.842298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-114c8bf5-43fb-4387-8376-c83376d046ad req-af199c6a-398e-472d-a83b-9a506d4438fd service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b6bf3355-4481-47dd-96cc-1e4a6e5445a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0718923 May 12 15:51:34.982791 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-114c8bf5-43fb-4387-8376-c83376d046ad req-b4f10a8c-f7b2-4ac5-8165-1b78036ccf5b service neutron] 10.222.0.84 "GET /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1293478 May 12 15:51:35.126542 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-114c8bf5-43fb-4387-8376-c83376d046ad req-afe1fabd-064b-4d5a-8dca-94ba57b01c42 service neutron] 10.222.0.84 "GET /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1364079 May 12 15:51:35.431395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-136495a7-3126-45c6-9251-e5e9bf8034a8 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:35.433093 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-136495a7-3126-45c6-9251-e5e9bf8034a8 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.84 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 812 time: 0.1477263 May 12 15:51:35.538380 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-2bb2f886-70d2-484a-beb9-d0981be8de8b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=939000b7f70c4c85a39e52ee93a06ed5 HTTP/1.1" status: 200 len: 380 time: 0.0876298 May 12 15:51:35.540431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9d10066-62eb-4e59-a28a-703ea3697915 req-87d830ae-222a-4748-b9e6-d91a6aa7a2ba tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 210 time: 0.0541964 May 12 15:51:35.548299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'port': {'device_id': 'b004132e-15ad-433d-8b3e-3dbb8e638ab6', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'admin_state_up': True, 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'security_groups': ['d3930bee-f9c9-401c-921a-1058f06217af']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:51:35.688389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:51:35.692473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:port and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:51:35.695409 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:51:35.701066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:51:35.710951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Made reservation on behalf of 939000b7f70c4c85a39e52ee93a06ed5 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:51:35.714671 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:35.883342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Allocated IP 172.20.0.4 (d13f4c27-5358-4d60-abb1-0c94e69df718/020f79af-22ce-41ca-91a6-931258be2176/85d9b905-7c16-4604-ae2c-c37c82f5eeec) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:51:36.080400 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:36.096406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Transition to ACTIVE for port object 85d9b905-7c16-4604-ae2c-c37c82f5eeec will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:51:36.121691 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:36.200029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Network d13f4c27-5358-4d60-abb1-0c94e69df718 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:51:36.203424 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:51:36.207381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:51:36.240356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'Port': ['ID=85d9b905-7c16-4604-ae2c-c37c82f5eeec,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:36.282191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:36.282963 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:36.316658 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-5766996c-865e-412a-9285-c7c56beb9ae0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7728934 May 12 15:51:36.341773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Request body: {'port': {'device_id': 'b004132e-15ad-433d-8b3e-3dbb8e638ab6', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:51:36.483571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ac6cf2ab-4148-4a48-a330-4bb9e83e7569 None None] Provisioning for port 85d9b905-7c16-4604-ae2c-c37c82f5eeec completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:51:36.489584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ac6cf2ab-4148-4a48-a330-4bb9e83e7569 None None] Provisioning complete for port 85d9b905-7c16-4604-ae2c-c37c82f5eeec triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:51:36.489951 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ac6cf2ab-4148-4a48-a330-4bb9e83e7569 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:36.550038 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ac6cf2ab-4148-4a48-a330-4bb9e83e7569 None None] Port 85d9b905-7c16-4604-ae2c-c37c82f5eeec cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:51:36.566029 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:36.887885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f61586-22d5-4c46-9ca7-a066c82204b3 req-2fc5b933-7f54-4fe5-a885-d7b62660fa5c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:36.888472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-e5f61586-22d5-4c46-9ca7-a066c82204b3 req-2fc5b933-7f54-4fe5-a885-d7b62660fa5c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Synchronizing usage tracker for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:51:36.924562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-e5f61586-22d5-4c46-9ca7-a066c82204b3 req-2fc5b933-7f54-4fe5-a885-d7b62660fa5c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Unset dirty status for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:51:36.925787 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5f61586-22d5-4c46-9ca7-a066c82204b3 req-2fc5b933-7f54-4fe5-a885-d7b62660fa5c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 931 time: 0.2395382 May 12 15:51:37.029701 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5f61586-22d5-4c46-9ca7-a066c82204b3 req-2d8820f9-bc87-4702-ab37-e295cdbf2135 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0972755 May 12 15:51:37.038446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 85d9b905-7c16-4604-ae2c-c37c82f5eeec {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:51:37.048247 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:37.064990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Transition to ACTIVE for port object 85d9b905-7c16-4604-ae2c-c37c82f5eeec will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:51:37.069258 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:37.230842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Pushing event updated for resources: {'Port': ['ID=85d9b905-7c16-4604-ae2c-c37c82f5eeec,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:37.323108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Attempting to bind port 85d9b905-7c16-4604-ae2c-c37c82f5eeec on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:51:37.323445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Attempting to bind port 85d9b905-7c16-4604-ae2c-c37c82f5eeec by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:51:37.323769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Attempting to bind port 85d9b905-7c16-4604-ae2c-c37c82f5eeec on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:51:37.328734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Port 85d9b905-7c16-4604-ae2c-c37c82f5eeec on network d13f4c27-5358-4d60-abb1-0c94e69df718 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:51:37.329052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Attempting to bind port 85d9b905-7c16-4604-ae2c-c37c82f5eeec on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:51:37.334286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 51, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:51:37.334628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Checking segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:51:37.335037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Bound using segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:51:37.335447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Bound port: 85d9b905-7c16-4604-ae2c-c37c82f5eeec, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:51:37.335793 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:37.426433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] For port 85d9b905-7c16-4604-ae2c-c37c82f5eeec, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:51:37.429284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] For port 85d9b905-7c16-4604-ae2c-c37c82f5eeec, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85d9b905-7c16-4604-ae2c-c37c82f5eeec,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:51:37.433961 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:37.499918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:37.500592 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:37.502192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] 10.222.0.84 "PUT /v2.0/ports/85d9b905-7c16-4604-ae2c-c37c82f5eeec HTTP/1.1" status: 200 len: 1091 time: 1.1646667 May 12 15:51:37.502454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b004132e-15ad-433d-8b3e-3dbb8e638ab6', 'tag': '85d9b905-7c16-4604-ae2c-c37c82f5eeec'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:51:37.521360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4699d82a-0cec-4a86-8816-a3f96af9c4ba service neutron] Pushing event updated for resources: {'Port': ['ID=85d9b905-7c16-4604-ae2c-c37c82f5eeec,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:37.567742 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0d4470cc-f0a3-4037-9fba-d741c309ddb5'] response: {'name': 'network-changed', 'server_uuid': 'b004132e-15ad-433d-8b3e-3dbb8e638ab6', 'tag': '85d9b905-7c16-4604-ae2c-c37c82f5eeec', 'status': 'completed', 'code': 200} May 12 15:51:37.666594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-72bb8351-b471-4af7-9e74-3ae97d813882 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:37.668111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-72bb8351-b471-4af7-9e74-3ae97d813882 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 1094 time: 0.0832605 May 12 15:51:37.751980 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-e02671a7-ffa9-471a-8f04-0c81e715b6ba service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=85d9b905-7c16-4604-ae2c-c37c82f5eeec HTTP/1.1" status: 200 len: 217 time: 0.0646739 May 12 15:51:37.817421 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-17634d06-ded0-4b26-8e9e-536d52bbdb58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:37.818874 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-17634d06-ded0-4b26-8e9e-536d52bbdb58 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0581954 May 12 15:51:37.902531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-301bf672-7bdf-4896-8fc5-8ed1466856d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:37.904004 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-301bf672-7bdf-4896-8fc5-8ed1466856d5 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0736926 May 12 15:51:38.040933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-d9fc7118-8737-49cb-9140-3091d4e45ccf service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1265543 May 12 15:51:38.238900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1a4d54ab-9758-492f-aaaf-62352df3a844 req-ddcceed7-a535-448f-9bed-08298720daf4 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1888335 May 12 15:51:38.265288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59c08386-0da6-4d2e-8592-d342eced6c26 req-873ab872-691c-46c2-9830-a1a38cb4df05 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:38.267220 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59c08386-0da6-4d2e-8592-d342eced6c26 req-873ab872-691c-46c2-9830-a1a38cb4df05 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 943 time: 0.1238177 May 12 15:51:38.313195 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59c08386-0da6-4d2e-8592-d342eced6c26 req-d9c4a3c6-11cd-4075-8220-bd3e50c163e8 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395148 May 12 15:51:38.516363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4611f04-9149-4f55-81f0-7ed9baba52ef req-458cdf20-f8b0-4afd-b902-0a70ed4c593e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:38.517840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4611f04-9149-4f55-81f0-7ed9baba52ef req-458cdf20-f8b0-4afd-b902-0a70ed4c593e service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 1094 time: 0.1726990 May 12 15:51:38.651594 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4611f04-9149-4f55-81f0-7ed9baba52ef req-bb9ec567-e7ac-4b46-9ab4-ae27f97e038b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:38.652906 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4611f04-9149-4f55-81f0-7ed9baba52ef req-bb9ec567-e7ac-4b46-9ab4-ae27f97e038b service neutron] 10.222.0.84 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1258717 May 12 15:51:38.720427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4611f04-9149-4f55-81f0-7ed9baba52ef req-7f484644-b2f3-4d87-8874-7c2ac5e52d5d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=85d9b905-7c16-4604-ae2c-c37c82f5eeec HTTP/1.1" status: 200 len: 217 time: 0.0605745 May 12 15:51:38.784492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4611f04-9149-4f55-81f0-7ed9baba52ef req-a9bf78d8-38fe-445c-9b93-9dfed87a230f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:38.785865 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4611f04-9149-4f55-81f0-7ed9baba52ef req-a9bf78d8-38fe-445c-9b93-9dfed87a230f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0586195 May 12 15:51:38.865691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4611f04-9149-4f55-81f0-7ed9baba52ef req-a3bd457d-7e5e-4949-b7ba-830933b7bfa0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:38.867138 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4611f04-9149-4f55-81f0-7ed9baba52ef req-a3bd457d-7e5e-4949-b7ba-830933b7bfa0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0721302 May 12 15:51:39.003672 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4611f04-9149-4f55-81f0-7ed9baba52ef req-e4ad423c-55f2-472c-b1c3-65af0084e1bf service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1263530 May 12 15:51:39.133263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4611f04-9149-4f55-81f0-7ed9baba52ef req-c63a0707-330b-441d-bedc-a979310f3231 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1231704 May 12 15:51:39.504367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e81f642-f9a1-4682-8d02-050479c80085 req-67bae98c-7a18-46ec-8ae2-7c2e073fa359 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:39.505836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e81f642-f9a1-4682-8d02-050479c80085 req-67bae98c-7a18-46ec-8ae2-7c2e073fa359 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 943 time: 0.0854275 May 12 15:51:39.549789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e81f642-f9a1-4682-8d02-050479c80085 req-2c390fb4-84d7-473d-a836-0ecc9eb4ad82 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382175 May 12 15:51:40.732854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d35df6da-916a-46d2-af11-9ee0b41473b1 req-6d6dad13-2b3e-4d4a-ab64-8bb06a394dd3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:40.734976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d35df6da-916a-46d2-af11-9ee0b41473b1 req-6d6dad13-2b3e-4d4a-ab64-8bb06a394dd3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 943 time: 0.0804839 May 12 15:51:40.777528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d35df6da-916a-46d2-af11-9ee0b41473b1 req-97c1bcbb-d3fb-4855-a799-3897cc317a4a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0369608 May 12 15:51:42.167704 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b389830-a1e7-479a-bd8e-53cea2a62a6c req-8e4cf6ce-4c66-4907-a5d3-09d3c9232d19 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:42.169042 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8b389830-a1e7-479a-bd8e-53cea2a62a6c req-8e4cf6ce-4c66-4907-a5d3-09d3c9232d19 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 943 time: 0.1373117 May 12 15:51:42.204471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87f008ab-f9c8-4a1a-89f2-5819956a6bef req-ec4d3eb3-913c-473c-bf9c-98ad18c1a2d4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:42.205945 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87f008ab-f9c8-4a1a-89f2-5819956a6bef req-ec4d3eb3-913c-473c-bf9c-98ad18c1a2d4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 946 time: 0.1188600 May 12 15:51:42.244691 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8b389830-a1e7-479a-bd8e-53cea2a62a6c req-86918ea5-7e08-432e-8481-ef40a1d21c2c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0691266 May 12 15:51:42.264244 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87f008ab-f9c8-4a1a-89f2-5819956a6bef req-57ce27b2-8785-45b2-aa67-1947ade5d458 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481706 May 12 15:51:42.288697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50908) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:42.394958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dfa5ba81-4d0d-4e12-abdf-2369c809e167 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/62f35174-7941-4bca-9593-bb1dd910fbeb HTTP/1.1" status: 200 len: 994 time: 0.1051099 May 12 15:51:42.768156 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30ebc02f-2a4c-4ef0-929f-221eec7b9247 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:42.816051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f6f3f4-81b1-4442-a2e2-27ce47138c97 req-64682a49-e288-4ae5-9bd8-300e4bd27698 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:42.817568 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9f6f3f4-81b1-4442-a2e2-27ce47138c97 req-64682a49-e288-4ae5-9bd8-300e4bd27698 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 1097 time: 0.0747659 May 12 15:51:42.857803 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b9f6f3f4-81b1-4442-a2e2-27ce47138c97 req-5be76a19-41a2-4cc5-ad78-26308b972f77 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0345900 May 12 15:51:43.380005 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:43.485827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e94940d8-f76d-430a-9d26-a7f51c22e834 req-79a46db7-7c0c-4f6f-b027-a134a8e43604 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:43.487247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e94940d8-f76d-430a-9d26-a7f51c22e834 req-79a46db7-7c0c-4f6f-b027-a134a8e43604 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 943 time: 0.1366503 May 12 15:51:43.512016 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-ceaf9777-962e-495a-9a47-62fa00dcc61c service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1061294 May 12 15:51:43.535867 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e94940d8-f76d-430a-9d26-a7f51c22e834 req-60980fa0-bad0-42f0-8fa1-8c28f87de878 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422411 May 12 15:51:44.136113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-18432302-3cc9-44de-9589-8fa07c0f3751 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:51:44.137106 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-18432302-3cc9-44de-9589-8fa07c0f3751 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1248417 May 12 15:51:44.146188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] Request body: {'binding': {'host': 'n-h1-841483-1', 'vnic_type': 'normal', 'profile': {}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:51:44.146680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] Unknown quota resources ['binding']. {{(pid=88152) _create /opt/stack/neutron/neutron/api/v2/base.py:495}} May 12 15:51:44.445751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] Attempting to bind port 35823aef-382e-46b8-9045-a3751e05ead2 on host n-h1-841483-1 for vnic_type normal with profile None {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:51:44.446082 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] Attempting to bind port 35823aef-382e-46b8-9045-a3751e05ead2 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:51:44.446409 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] Attempting to bind port 35823aef-382e-46b8-9045-a3751e05ead2 on network 5c356018-3c06-4505-81ef-c3ae2fab3978 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:51:44.450927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] Port 35823aef-382e-46b8-9045-a3751e05ead2 on network 5c356018-3c06-4505-81ef-c3ae2fab3978 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:51:44.451239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] Attempting to bind port 35823aef-382e-46b8-9045-a3751e05ead2 on network 5c356018-3c06-4505-81ef-c3ae2fab3978 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:51:44.457459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 51, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:51:44.457791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] Checking segment: {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:51:44.458168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] Bound using segment: {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:51:44.458582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] Bound port: 35823aef-382e-46b8-9045-a3751e05ead2, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:51:44.526180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=35823aef-382e-46b8-9045-a3751e05ead2,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:51:44.530859 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] Notify callbacks [] for binding, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:44.532466 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] 10.222.0.82 "POST /v2.0/ports/35823aef-382e-46b8-9045-a3751e05ead2/bindings HTTP/1.1" status: 201 len: 389 time: 0.3893762 May 12 15:51:44.848432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf9ad7a-c8e1-42ff-8fcd-fd7fff74368d req-85a3a19c-a001-4ff7-80b7-0dd213519398 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:44.849798 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-adf9ad7a-c8e1-42ff-8fcd-fd7fff74368d req-85a3a19c-a001-4ff7-80b7-0dd213519398 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 946 time: 0.1643186 May 12 15:51:44.862271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdaa27a9-b195-450f-b890-de51e115e1ee req-0dc03267-ed5a-47c5-9a83-6163db40a92a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:44.863659 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdaa27a9-b195-450f-b890-de51e115e1ee req-0dc03267-ed5a-47c5-9a83-6163db40a92a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 943 time: 0.2121630 May 12 15:51:44.924540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-3f458198-35bb-43fd-9bb5-1076f4287a24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:44.925987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-3f458198-35bb-43fd-9bb5-1076f4287a24 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 1097 time: 0.1783471 May 12 15:51:44.942083 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-adf9ad7a-c8e1-42ff-8fcd-fd7fff74368d req-61f7144c-6d12-4564-be8c-753ff7299130 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0775421 May 12 15:51:45.015951 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdaa27a9-b195-450f-b890-de51e115e1ee req-1abdcb2b-9b7a-4904-8697-bec8a33ec5b1 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1346362 May 12 15:51:45.079490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-9ee6b51b-aa95-4335-b7c5-9b0467ba037d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:45.080909 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-9ee6b51b-aa95-4335-b7c5-9b0467ba037d service neutron] 10.222.0.84 "GET /v2.0/networks?id=5c356018-3c06-4505-81ef-c3ae2fab3978 HTTP/1.1" status: 200 len: 897 time: 0.1443567 May 12 15:51:45.191362 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-d871fd64-2965-4d00-9103-7be5cad8b62e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=35823aef-382e-46b8-9045-a3751e05ead2 HTTP/1.1" status: 200 len: 1002 time: 0.1007159 May 12 15:51:45.260976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-8b4609b3-3766-4a06-8bae-162712c3cfdc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:45.262414 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-8b4609b3-3766-4a06-8bae-162712c3cfdc service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d HTTP/1.1" status: 200 len: 835 time: 0.0612605 May 12 15:51:45.317583 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1d6a0534-c45a-4118-8b56-06b6b26c37a4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:45.342656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-d884d386-835e-4672-921c-0d47d69b7f39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:45.344702 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-d884d386-835e-4672-921c-0d47d69b7f39 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5c356018-3c06-4505-81ef-c3ae2fab3978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0723627 May 12 15:51:45.479523 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-f5686f9e-b529-4ade-8988-b09ad693b6d4 service neutron] 10.222.0.84 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1250169 May 12 15:51:45.613092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7af31c3-a2e5-4429-9d8a-27084c014880 service neutron] 10.222.0.84 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1241848 May 12 15:51:45.814727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-4fc96835-c39c-44ef-9d8f-e62dbc3d821a tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:45.816173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-4fc96835-c39c-44ef-9d8f-e62dbc3d821a tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.84 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158&tenant_id=b88b5989d4c548dba6124f2e4690e5c3&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 1097 time: 0.0799847 May 12 15:51:45.830388 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-841483-1'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:51:45.951413 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:46.046101 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:46.282793 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:46.375385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=35823aef-382e-46b8-9045-a3751e05ead2,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:51:46.422436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcbe0ac6-21e3-440f-8b00-0b520c710d8b req-acf2cde4-cd65-473c-a859-fb0019f01844 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:46.423955 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bcbe0ac6-21e3-440f-8b00-0b520c710d8b req-acf2cde4-cd65-473c-a859-fb0019f01844 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 943 time: 0.2821643 May 12 15:51:46.433611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64dbdf40-121e-48fa-9cd3-ffcf12b9eec0 req-eb3372bf-111a-49d1-8035-db7781b879a7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:46.435092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64dbdf40-121e-48fa-9cd3-ffcf12b9eec0 req-eb3372bf-111a-49d1-8035-db7781b879a7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 946 time: 0.3393519 May 12 15:51:46.477958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:51:46.557816 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bcbe0ac6-21e3-440f-8b00-0b520c710d8b req-273424dd-f188-4759-bf36-44965419a9b4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1214561 May 12 15:51:46.582600 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64dbdf40-121e-48fa-9cd3-ffcf12b9eec0 req-95b7d49e-ac88-4adb-a8bf-adf7d6e432bc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1412327 May 12 15:51:46.583031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:51:46.589112 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:46.596240 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:46.633540 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-643a02ec-b879-4e8f-a3a2-79a44bc34545'] response: {'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2', 'code': 200} May 12 15:51:46.758308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Pushing event updated for resources: {'Port': ['ID=35823aef-382e-46b8-9045-a3751e05ead2,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:46.822318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Attempting to bind port 35823aef-382e-46b8-9045-a3751e05ead2 on host n-h2-841483-1 for vnic_type normal with profile {"migrating_to": "n-h1-841483-1"} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:51:46.822646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Attempting to bind port 35823aef-382e-46b8-9045-a3751e05ead2 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:51:46.822971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Attempting to bind port 35823aef-382e-46b8-9045-a3751e05ead2 on network 5c356018-3c06-4505-81ef-c3ae2fab3978 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:51:46.831558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Port 35823aef-382e-46b8-9045-a3751e05ead2 on network 5c356018-3c06-4505-81ef-c3ae2fab3978 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:51:46.831873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Attempting to bind port 35823aef-382e-46b8-9045-a3751e05ead2 on network 5c356018-3c06-4505-81ef-c3ae2fab3978 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:51:46.836976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 51, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:51:46.837307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Checking segment: {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:51:46.837712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Bound using segment: {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:51:46.838129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Bound port: 35823aef-382e-46b8-9045-a3751e05ead2, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9851d85a-5882-482f-aef2-a31617f7f1c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 579, 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:51:46.838472 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:46.876714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6bcf5b09-475b-4a7c-b6bc-a89a34d54ab3 None None] Provisioning complete for port 35823aef-382e-46b8-9045-a3751e05ead2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:51:46.877262 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6bcf5b09-475b-4a7c-b6bc-a89a34d54ab3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:46.929419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6bcf5b09-475b-4a7c-b6bc-a89a34d54ab3 None None] Port 35823aef-382e-46b8-9045-a3751e05ead2 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:51:46.931694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:51:46.935031 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=35823aef-382e-46b8-9045-a3751e05ead2,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:51:46.940158 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:47.098443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Pushing event updated for resources: {'Port': ['ID=35823aef-382e-46b8-9045-a3751e05ead2,revision_number=8']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:47.132475 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 85d9b905-7c16-4604-ae2c-c37c82f5eeec details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:51:47.149300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:47.149931 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:47.151357 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-e7cd09ab-2a2a-4e80-b488-46d1db28a572 service neutron] 10.222.0.84 "PUT /v2.0/ports/35823aef-382e-46b8-9045-a3751e05ead2 HTTP/1.1" status: 200 len: 1122 time: 1.3252730 May 12 15:51:47.256053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['35823aef-382e-46b8-9045-a3751e05ead2'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:51:47.334606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 85d9b905-7c16-4604-ae2c-c37c82f5eeec, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85d9b905-7c16-4604-ae2c-c37c82f5eeec,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:51:47.343009 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-40c62cbe-a597-4382-8d16-4ca75ccc9795 None None] Provisioning complete for port 35823aef-382e-46b8-9045-a3751e05ead2 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:51:47.344003 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-40c62cbe-a597-4382-8d16-4ca75ccc9795 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:47.401654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '85d9b905-7c16-4604-ae2c-c37c82f5eeec', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'port_id': '85d9b905-7c16-4604-ae2c-c37c82f5eeec', 'mac_address': 'fa:16:3e:ae:38:e5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 566, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:51:47.569515 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:47.612811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 85d9b905-7c16-4604-ae2c-c37c82f5eeec {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:51:47.651344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 85d9b905-7c16-4604-ae2c-c37c82f5eeec, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85d9b905-7c16-4604-ae2c-c37c82f5eeec,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:51:47.662073 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:47.699277 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-40c62cbe-a597-4382-8d16-4ca75ccc9795 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:47.775979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:51:47.807175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-40c62cbe-a597-4382-8d16-4ca75ccc9795 None None] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=35823aef-382e-46b8-9045-a3751e05ead2,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:51:47.809689 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb6977e-2906-4e49-8754-75b35924770a req-7822baa1-051e-4e5f-9867-2aa0deb9642d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:47.811174 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9eb6977e-2906-4e49-8754-75b35924770a req-7822baa1-051e-4e5f-9867-2aa0deb9642d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 944 time: 0.1466615 May 12 15:51:47.812051 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:47.820693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5da3e2a8-616d-4191-b1c5-e2f0ba05bbc1 req-9631c467-6286-49b2-806e-f41116f0e529 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:47.822255 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5da3e2a8-616d-4191-b1c5-e2f0ba05bbc1 req-9631c467-6286-49b2-806e-f41116f0e529 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 944 time: 0.1163416 May 12 15:51:47.822387 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-40c62cbe-a597-4382-8d16-4ca75ccc9795 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:47.880517 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=85d9b905-7c16-4604-ae2c-c37c82f5eeec,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:47.896452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9eb6977e-2906-4e49-8754-75b35924770a req-eed60439-28b8-4981-9636-a12d26295539 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0731308 May 12 15:51:47.900736 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5da3e2a8-616d-4191-b1c5-e2f0ba05bbc1 req-2c14632a-a41a-4bdb-99c6-e20fb70ae328 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0638990 May 12 15:51:47.972064 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-48421f90-2f03-44bc-9f34-0bef12fcc097'] response: {'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2', 'code': 200} May 12 15:51:48.011416 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['85d9b905-7c16-4604-ae2c-c37c82f5eeec'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:51:48.063586 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40c62cbe-a597-4382-8d16-4ca75ccc9795 None None] Pushing event updated for resources: {'Port': ['ID=35823aef-382e-46b8-9045-a3751e05ead2,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:48.634328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:51:48.678561 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f6c661e5-3dde-4f10-a8ce-79b573d5448d'] response: {'name': 'network-changed', 'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2', 'status': 'completed', 'code': 200} May 12 15:51:48.773147 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8efc4308-6481-4e92-bb7d-f5c1dc5f8365 req-edb6c17e-6dd8-4d72-bc2f-001b5a128f8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:48.774660 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8efc4308-6481-4e92-bb7d-f5c1dc5f8365 req-edb6c17e-6dd8-4d72-bc2f-001b5a128f8c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 1127 time: 0.0737875 May 12 15:51:48.912779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8efc4308-6481-4e92-bb7d-f5c1dc5f8365 req-881d4cad-2a19-40ab-ba87-bab47fc44d0a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:48.914157 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8efc4308-6481-4e92-bb7d-f5c1dc5f8365 req-881d4cad-2a19-40ab-ba87-bab47fc44d0a service neutron] 10.222.0.76 "GET /v2.0/networks?id=5c356018-3c06-4505-81ef-c3ae2fab3978 HTTP/1.1" status: 200 len: 897 time: 0.1321959 May 12 15:51:49.023244 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8efc4308-6481-4e92-bb7d-f5c1dc5f8365 req-326455ce-c15d-4156-aae7-6154a21e2980 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=35823aef-382e-46b8-9045-a3751e05ead2 HTTP/1.1" status: 200 len: 1002 time: 0.1023602 May 12 15:51:49.088729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8efc4308-6481-4e92-bb7d-f5c1dc5f8365 req-463606a8-85e3-40f7-8698-1166572a0ace service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:49.090597 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8efc4308-6481-4e92-bb7d-f5c1dc5f8365 req-463606a8-85e3-40f7-8698-1166572a0ace service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d HTTP/1.1" status: 200 len: 835 time: 0.0582271 May 12 15:51:49.151303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 35823aef-382e-46b8-9045-a3751e05ead2 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:51:49.152367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa5f9fcc-bf4f-4009-a6e4-4463a3b46aaf req-eff07f77-d14b-474c-87e1-f39af55bc9b8 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:49.154075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa5f9fcc-bf4f-4009-a6e4-4463a3b46aaf req-eff07f77-d14b-474c-87e1-f39af55bc9b8 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 944 time: 0.1477709 May 12 15:51:49.158687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 85d9b905-7c16-4604-ae2c-c37c82f5eeec up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:51:49.162943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20aaf1c2-df3a-4f43-921f-01d6644fc3ff req-eaa1bffb-32c3-41ff-a034-d754f19dddb0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:49.164344 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20aaf1c2-df3a-4f43-921f-01d6644fc3ff req-eaa1bffb-32c3-41ff-a034-d754f19dddb0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 946 time: 0.1267161 May 12 15:51:49.178781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8efc4308-6481-4e92-bb7d-f5c1dc5f8365 req-19434c15-2872-48c9-826d-dc86563d5f60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:49.180390 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8efc4308-6481-4e92-bb7d-f5c1dc5f8365 req-19434c15-2872-48c9-826d-dc86563d5f60 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=5c356018-3c06-4505-81ef-c3ae2fab3978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0832953 May 12 15:51:49.231163 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa5f9fcc-bf4f-4009-a6e4-4463a3b46aaf req-7c6fd918-2a2e-4db4-9ac9-862649c867e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0658383 May 12 15:51:49.254645 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20aaf1c2-df3a-4f43-921f-01d6644fc3ff req-ba5d252f-97fb-4243-ae80-57c1c4351526 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0672731 May 12 15:51:49.324647 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 85d9b905-7c16-4604-ae2c-c37c82f5eeec completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:51:49.339640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 85d9b905-7c16-4604-ae2c-c37c82f5eeec triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:51:49.340006 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:49.344083 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8efc4308-6481-4e92-bb7d-f5c1dc5f8365 req-b5983c3f-ae43-4dc8-9000-c6be967237fc service neutron] 10.222.0.76 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1561701 May 12 15:51:49.392859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=35823aef-382e-46b8-9045-a3751e05ead2,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:51:49.413602 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 35823aef-382e-46b8-9045-a3751e05ead2 has no active binding in host n-h1-841483-1 {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:142}} May 12 15:51:49.478856 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:49.481399 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8efc4308-6481-4e92-bb7d-f5c1dc5f8365 req-8a335767-21c6-42b2-9eec-49c52ab93e4a service neutron] 10.222.0.76 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1322396 May 12 15:51:49.513544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 85d9b905-7c16-4604-ae2c-c37c82f5eeec, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85d9b905-7c16-4604-ae2c-c37c82f5eeec,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:51:49.518044 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:49.587260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=85d9b905-7c16-4604-ae2c-c37c82f5eeec,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:49.973839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b004132e-15ad-433d-8b3e-3dbb8e638ab6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85d9b905-7c16-4604-ae2c-c37c82f5eeec'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:51:50.018290 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-98883a33-36d7-4473-886c-d65fdd4a2242'] response: {'server_uuid': 'b004132e-15ad-433d-8b3e-3dbb8e638ab6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85d9b905-7c16-4604-ae2c-c37c82f5eeec', 'code': 200} May 12 15:51:50.195572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16bd8487-cb3e-4e8e-9f4f-5fb2fbe4c0ca req-5102663e-f381-4da1-b4f5-68956e10d4d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:50.196929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16bd8487-cb3e-4e8e-9f4f-5fb2fbe4c0ca req-5102663e-f381-4da1-b4f5-68956e10d4d8 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 1096 time: 0.0686107 May 12 15:51:50.242079 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16bd8487-cb3e-4e8e-9f4f-5fb2fbe4c0ca req-1e123140-c0c0-4c06-a50d-a9ef82bb1e88 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371709 May 12 15:51:50.471539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70f38ecd-87a3-4463-a589-97039b4ce94c req-c2af9e86-6759-4c6e-ad33-03bd5d0e133f tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:50.472859 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70f38ecd-87a3-4463-a589-97039b4ce94c req-c2af9e86-6759-4c6e-ad33-03bd5d0e133f tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 945 time: 0.1354213 May 12 15:51:50.484973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f57329-e64a-483b-87ef-60313959bd66 req-9edbadd7-f9e9-44b2-9426-2170d5c26c47 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:50.486348 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14f57329-e64a-483b-87ef-60313959bd66 req-9edbadd7-f9e9-44b2-9426-2170d5c26c47 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 946 time: 0.1180041 May 12 15:51:50.556340 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70f38ecd-87a3-4463-a589-97039b4ce94c req-db4f4a6e-e6da-41a0-bee9-c8c82ae641dd tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0690739 May 12 15:51:50.559228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14f57329-e64a-483b-87ef-60313959bd66 req-ba274c78-6196-4e1e-98d4-11995cfe7a94 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0568316 May 12 15:51:51.811654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e8c7d2b-3f97-42c7-adcd-7930ad86d81c req-e0e25f08-ccbb-48fe-9cb8-72abde92c5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:51.814348 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7e8c7d2b-3f97-42c7-adcd-7930ad86d81c req-e0e25f08-ccbb-48fe-9cb8-72abde92c5b2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 946 time: 0.1508873 May 12 15:51:51.825446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c92d6df1-d2e9-49ad-abc0-d5782335de44 req-c7a23956-3cea-4d1a-9ab6-3ad989603f6e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:51.826806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c92d6df1-d2e9-49ad-abc0-d5782335de44 req-c7a23956-3cea-4d1a-9ab6-3ad989603f6e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 945 time: 0.1614811 May 12 15:51:51.895962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7e8c7d2b-3f97-42c7-adcd-7930ad86d81c req-cebad378-c767-4a93-afe8-aa181e7f384a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0681520 May 12 15:51:51.900179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c92d6df1-d2e9-49ad-abc0-d5782335de44 req-2dfdd2ca-5c4d-4a42-b07c-0730b310cd9b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0595474 May 12 15:51:52.194404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa66a9c-3e26-4ae6-804b-00a3a0196683 req-85cd4435-e248-468e-ac97-1cfdfed8b3e6 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:52.195757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-faa66a9c-3e26-4ae6-804b-00a3a0196683 req-85cd4435-e248-468e-ac97-1cfdfed8b3e6 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 945 time: 0.1911590 May 12 15:51:52.241305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-faa66a9c-3e26-4ae6-804b-00a3a0196683 req-8c9f7299-39a6-4e0e-b4a3-87b4e8c10482 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399947 May 12 15:51:52.250942 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-f3ac4574-43d9-474e-9f73-0c1e9d026202 service neutron] 10.222.0.76 "GET /v2.0/ports/35823aef-382e-46b8-9045-a3751e05ead2/bindings/n-h1-841483-1 HTTP/1.1" status: 200 len: 384 time: 0.0813308 May 12 15:51:52.266770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50982) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:52.337915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86c0b334-a5d2-4683-8a2e-f1cf5e902bc5 tempest-TestVolumeBootPattern-545659823 tempest-TestVolumeBootPattern-545659823-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:52.342606 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-86c0b334-a5d2-4683-8a2e-f1cf5e902bc5 tempest-TestVolumeBootPattern-545659823 tempest-TestVolumeBootPattern-545659823-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 1091 time: 0.0717614 May 12 15:51:52.342833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 50986) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:52.348915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '85d9b905-7c16-4604-ae2c-c37c82f5eeec', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address': '172.20.0.4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:51:52.355842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:51:52.360008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:floatingip and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:51:52.363094 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:51:52.368856 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:51:52.380449 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:52.518291 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:52.615544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=35823aef-382e-46b8-9045-a3751e05ead2,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:51:52.638776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:51:52.661286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Allocated IP 172.25.8.110 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/49329db0-848e-4438-961e-2267d53ecaef) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:51:52.705272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:51:52.714641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=35823aef-382e-46b8-9045-a3751e05ead2,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:51:52.735353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:52.752498 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-cd7a4eb8-68ce-48db-90cf-dba7422f1d64'] response: {'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2', 'code': 200} May 12 15:51:52.821160 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:52.839240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Transition to ACTIVE for port object 35823aef-382e-46b8-9045-a3751e05ead2 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:51:52.844672 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:52.852583 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:52.923328 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:51:52.926548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:51:52.932701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:51:52.975078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'Port': ['ID=49329db0-848e-4438-961e-2267d53ecaef,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:53.047570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] No DVR routers for this DVR port 35823aef-382e-46b8-9045-a3751e05ead2 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:51:53.134597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Pushing event updated for resources: {'Port': ['ID=35823aef-382e-46b8-9045-a3751e05ead2,revision_number=11']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:53.147715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:53.148055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:53.148744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:53.148744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:53.149033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:53.149353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:53.149697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:53.150016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:53.150333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:53.150643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:53.150960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:53.151274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:51:53.251174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a3046d-5ae8-4b0a-951f-647a86a1b671 req-909192c9-7abf-42d9-a124-8966c3898609 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:53.252638 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40a3046d-5ae8-4b0a-951f-647a86a1b671 req-909192c9-7abf-42d9-a124-8966c3898609 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 945 time: 0.2221997 May 12 15:51:53.293342 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-ba4c3fde-5d83-4ddd-bfa4-3ef8f2ce4441 service neutron] 10.222.0.76 "PUT /v2.0/ports/35823aef-382e-46b8-9045-a3751e05ead2/bindings/n-h1-841483-1/activate HTTP/1.1" status: 200 len: 369 time: 1.0375490 May 12 15:51:53.420620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40a3046d-5ae8-4b0a-951f-647a86a1b671 req-2735012f-909d-4583-aac4-071bfec8dc34 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1599483 May 12 15:51:53.492108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-9df7ad00-d590-464e-a622-da8f54c122d8 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:53.493575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-9df7ad00-d590-464e-a622-da8f54c122d8 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.84 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158&tenant_id=b88b5989d4c548dba6124f2e4690e5c3&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 1096 time: 0.1368556 May 12 15:51:53.590476 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:53.594490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-58327912-9009-413a-acf3-177b60b73aa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:53.595903 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-58327912-9009-413a-acf3-177b60b73aa4 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158&tenant_id=b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 1096 time: 0.0903301 May 12 15:51:53.714875 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:53.788194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-4f403d90-40a6-41f7-9c24-8a4c679d1ec1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:53.789667 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-4f403d90-40a6-41f7-9c24-8a4c679d1ec1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 1096 time: 0.1503601 May 12 15:51:54.123402 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-71fa1739-1d4d-46ad-8284-3945f2750563 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:54.125318 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-71fa1739-1d4d-46ad-8284-3945f2750563 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5c356018-3c06-4505-81ef-c3ae2fab3978 HTTP/1.1" status: 200 len: 897 time: 0.3179080 May 12 15:51:54.213863 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:54.223781 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:54.341257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-16dfe15b-d81f-4bc5-aeee-743a358b5526 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=35823aef-382e-46b8-9045-a3751e05ead2 HTTP/1.1" status: 200 len: 1000 time: 0.2086546 May 12 15:51:54.352325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'Port': ['ID=49329db0-848e-4438-961e-2267d53ecaef,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:51:54.393123 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:54.490417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-68945b20-1394-4f82-9f24-8c42dbfdad84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:54.491861 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-68945b20-1394-4f82-9f24-8c42dbfdad84 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d HTTP/1.1" status: 200 len: 835 time: 0.1422274 May 12 15:51:54.680855 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Floating IP fcac9fd6-a5ce-480f-8a2c-b0c706cb64ec associated. External IP: 172.25.8.110, port: 85d9b905-7c16-4604-ae2c-c37c82f5eeec. May 12 15:51:54.850669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b8ccbd4-fb36-4e27-b507-296f87111780 req-e28bdbb4-8207-411b-baf6-0b34d53fc86c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:54.852088 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b8ccbd4-fb36-4e27-b507-296f87111780 req-e28bdbb4-8207-411b-baf6-0b34d53fc86c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 945 time: 0.3114879 May 12 15:51:54.858539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-b2f83410-7184-48f6-b3c2-2c870396d55e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:54.860622 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-b2f83410-7184-48f6-b3c2-2c870396d55e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5c356018-3c06-4505-81ef-c3ae2fab3978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3189685 May 12 15:51:55.055527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b8ccbd4-fb36-4e27-b507-296f87111780 req-9935af58-4957-45af-9bac-8c0f928872d4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1939795 May 12 15:51:55.175066 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-c20bb789-49d9-40e1-b1f5-7fd6ca499a62 service neutron] 10.222.0.84 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2939487 May 12 15:51:55.398334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Router c4a7b7e0-fe66-4b58-a3e2-7e635585791d has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:51:55.518171 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-f191afc8-8fc7-481c-ac49-b8d4084b5b57 service neutron] 10.222.0.84 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3360491 May 12 15:51:55.611104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:51:55.621242 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e91751d3-242a-468a-8152-18fbcd32dd9e None None] Sync routers for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:51:55.631738 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e91751d3-242a-468a-8152-18fbcd32dd9e None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:51:55.632333 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e91751d3-242a-468a-8152-18fbcd32dd9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:51:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:51:55.635364 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:55.693836 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0af3061e-6f79-4e32-bae7-a9233d071381 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 3.3480899 May 12 15:51:55.694619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b004132e-15ad-433d-8b3e-3dbb8e638ab6', 'tag': '85d9b905-7c16-4604-ae2c-c37c82f5eeec'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:51:55.740006 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-75041146-8d8b-40d2-98f4-86497a051ad1'] response: {'name': 'network-changed', 'server_uuid': 'b004132e-15ad-433d-8b3e-3dbb8e638ab6', 'tag': '85d9b905-7c16-4604-ae2c-c37c82f5eeec', 'status': 'completed', 'code': 200} May 12 15:51:55.830061 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-e91751d3-242a-468a-8152-18fbcd32dd9e None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:51:55.866817 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db9e358f-3977-4513-825c-c57dfec631d9 req-02007b92-3bca-4838-a7e9-4f42aae49d12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:55.868379 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db9e358f-3977-4513-825c-c57dfec631d9 req-02007b92-3bca-4838-a7e9-4f42aae49d12 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 1096 time: 0.0778713 May 12 15:51:55.889057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-d5ce2567-38e3-4919-b15a-85cb2a21df95 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:55.891971 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-d5ce2567-38e3-4919-b15a-85cb2a21df95 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.84 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158&tenant_id=b88b5989d4c548dba6124f2e4690e5c3&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 1096 time: 0.0799003 May 12 15:51:56.008898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db9e358f-3977-4513-825c-c57dfec631d9 req-971342ab-5355-4ed1-9681-3c8e22f5e5ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:56.010406 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db9e358f-3977-4513-825c-c57dfec631d9 req-971342ab-5355-4ed1-9681-3c8e22f5e5ba service neutron] 10.222.0.84 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1361728 May 12 15:51:56.012270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-039856f1-475f-48b8-af2b-96df6b351ce6 service neutron] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:51:56.015493 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-039856f1-475f-48b8-af2b-96df6b351ce6 service neutron] Notify callbacks [] for binding, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:56.016614 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-039856f1-475f-48b8-af2b-96df6b351ce6 service neutron] 10.222.0.84 "DELETE /v2.0/ports/35823aef-382e-46b8-9045-a3751e05ead2/bindings/n-h2-841483-1 HTTP/1.1" status: 204 len: 173 time: 0.1186900 May 12 15:51:56.135309 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db9e358f-3977-4513-825c-c57dfec631d9 req-6b1c5db6-71f6-4a84-8d7c-2fcf2f312dc9 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=85d9b905-7c16-4604-ae2c-c37c82f5eeec HTTP/1.1" status: 200 len: 999 time: 0.1016560 May 12 15:51:56.203561 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e91751d3-242a-468a-8152-18fbcd32dd9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'fcac9fd6-a5ce-480f-8a2c-b0c706cb64ec', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.110', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '85d9b905-7c16-4604-ae2c-c37c82f5eeec', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4076, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:ae:38:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b004132e-15ad-433d-8b3e-3dbb8e638ab6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:51:53Z', 'updated_at': '2022-05-12T15:51:53Z', 'revision_number': 0, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:51:56.207748 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e91751d3-242a-468a-8152-18fbcd32dd9e None None] Checking router: c4a7b7e0-fe66-4b58-a3e2-7e635585791d for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:51:56.216409 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e91751d3-242a-468a-8152-18fbcd32dd9e None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:51:56.217005 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e91751d3-242a-468a-8152-18fbcd32dd9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:51:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:51:56.260401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db9e358f-3977-4513-825c-c57dfec631d9 req-aac82e62-5d18-47d4-93e4-b5818a3cea1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:56.261752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db9e358f-3977-4513-825c-c57dfec631d9 req-aac82e62-5d18-47d4-93e4-b5818a3cea1a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.1197054 May 12 15:51:56.338000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c74b4d32-cd23-4fa7-be26-5ea44cf1fe74 req-439fec5b-fabb-4ae2-8867-8a73775f0473 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:56.339430 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c74b4d32-cd23-4fa7-be26-5ea44cf1fe74 req-439fec5b-fabb-4ae2-8867-8a73775f0473 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 945 time: 0.1641953 May 12 15:51:56.392184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db9e358f-3977-4513-825c-c57dfec631d9 req-ccdd0b1b-cf08-4931-a2f9-34b777525a63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:56.393663 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db9e358f-3977-4513-825c-c57dfec631d9 req-ccdd0b1b-cf08-4931-a2f9-34b777525a63 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1251035 May 12 15:51:56.400750 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c74b4d32-cd23-4fa7-be26-5ea44cf1fe74 req-9b731fd2-4acc-4a83-b6ce-d5c0d596ef60 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0506961 May 12 15:51:56.402109 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-e91751d3-242a-468a-8152-18fbcd32dd9e None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:51:56.573502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db9e358f-3977-4513-825c-c57dfec631d9 req-19aeceb6-ae25-4137-9510-e269b11da3b1 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1717050 May 12 15:51:56.707320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 35823aef-382e-46b8-9045-a3751e05ead2 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:51:56.707914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b52f3932-6820-4130-932b-68b06548f59a req-446f6d73-9c6e-4081-a124-49d34f8f2fd4 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:56.708798 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b52f3932-6820-4130-932b-68b06548f59a req-446f6d73-9c6e-4081-a124-49d34f8f2fd4 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 1096 time: 0.1784096 May 12 15:51:56.741670 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-db9e358f-3977-4513-825c-c57dfec631d9 req-4a99920e-44f7-48cb-b731-3184f69fced5 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1569481 May 12 15:51:56.777473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b52f3932-6820-4130-932b-68b06548f59a req-c6008afe-b3ce-43d7-9022-16cd184d79b6 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0541418 May 12 15:51:56.798219 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e91751d3-242a-468a-8152-18fbcd32dd9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'fcac9fd6-a5ce-480f-8a2c-b0c706cb64ec', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.110', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '85d9b905-7c16-4604-ae2c-c37c82f5eeec', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4076, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:ae:38:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b004132e-15ad-433d-8b3e-3dbb8e638ab6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:51:53Z', 'updated_at': '2022-05-12T15:51:53Z', 'revision_number': 0, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:51:56.799542 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 35823aef-382e-46b8-9045-a3751e05ead2 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:51:56.802784 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e91751d3-242a-468a-8152-18fbcd32dd9e None None] The sync data for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 is: [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'fcac9fd6-a5ce-480f-8a2c-b0c706cb64ec', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.110', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '85d9b905-7c16-4604-ae2c-c37c82f5eeec', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4076, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:ae:38:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b004132e-15ad-433d-8b3e-3dbb8e638ab6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:51:53Z', 'updated_at': '2022-05-12T15:51:53Z', 'revision_number': 0, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:51:56.968390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af5f210-7493-4f56-b336-15915c694d27 req-da5f2d9a-49aa-46cc-b953-d3c9a769dd83 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:51:56.970100 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3af5f210-7493-4f56-b336-15915c694d27 req-da5f2d9a-49aa-46cc-b953-d3c9a769dd83 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 945 time: 0.0873547 May 12 15:51:56.990952 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54e9f125-d796-439c-ae3d-ab1597744865 None None] New status for floating IP fcac9fd6-a5ce-480f-8a2c-b0c706cb64ec: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:51:57.018155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3af5f210-7493-4f56-b336-15915c694d27 req-94845e4d-d737-4bce-940f-83423920801e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423067 May 12 15:51:57.040813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51006) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:57.148252 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5a96d5a7-61d1-4e8d-bf0d-b0584e4f8a5d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/62f35174-7941-4bca-9593-bb1dd910fbeb HTTP/1.1" status: 200 len: 992 time: 0.1062040 May 12 15:51:59.419122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51018) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:51:59.743991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-42f09670-09e1-4ab0-a14b-9938711500e3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port 007163ab-b33d-4bb4-9d50-8f0cb780a49d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:51:59.744330 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42f09670-09e1-4ab0-a14b-9938711500e3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:59.915695 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42f09670-09e1-4ab0-a14b-9938711500e3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:51:59.916022 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42f09670-09e1-4ab0-a14b-9938711500e3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:00.038831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-42f09670-09e1-4ab0-a14b-9938711500e3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for 007163ab-b33d-4bb4-9d50-8f0cb780a49d owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:52:00.193093 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42f09670-09e1-4ab0-a14b-9938711500e3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:00.240112 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42f09670-09e1-4ab0-a14b-9938711500e3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=007163ab-b33d-4bb4-9d50-8f0cb780a49d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:00.333450 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42f09670-09e1-4ab0-a14b-9938711500e3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:00.333787 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-42f09670-09e1-4ab0-a14b-9938711500e3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Floating IP 62f35174-7941-4bca-9593-bb1dd910fbeb disassociated (deleted). External IP: 172.25.8.207, port: 35823aef-382e-46b8-9045-a3751e05ead2. May 12 15:52:00.689717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-42f09670-09e1-4ab0-a14b-9938711500e3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router 75747bdd-2928-4a50-929a-8d28830552b1 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:52:00.876841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42f09670-09e1-4ab0-a14b-9938711500e3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:52:00.886731 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96cb5762-6a3a-480f-8756-8f6ec7ea391f None None] Sync routers for ids ['75747bdd-2928-4a50-929a-8d28830552b1'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:52:00.896111 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-42f09670-09e1-4ab0-a14b-9938711500e3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:00.897204 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96cb5762-6a3a-480f-8756-8f6ec7ea391f None None] Routers {'75747bdd-2928-4a50-929a-8d28830552b1'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:52:00.897924 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-96cb5762-6a3a-480f-8756-8f6ec7ea391f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:51:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['75747bdd-2928-4a50-929a-8d28830552b1'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:00.958038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-42f09670-09e1-4ab0-a14b-9938711500e3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/floatingips/62f35174-7941-4bca-9593-bb1dd910fbeb HTTP/1.1" status: 204 len: 168 time: 1.5378089 May 12 15:52:00.959152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:52:01.043067 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-da85e083-4dc9-46e4-b1ed-220fef32add0'] response: {'name': 'network-changed', 'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2', 'status': 'completed', 'code': 200} May 12 15:52:01.092997 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-96cb5762-6a3a-480f-8756-8f6ec7ea391f None None] Set router 75747bdd-2928-4a50-929a-8d28830552b1 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:52:01.325877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff30deb6-0d95-4baa-9375-368150927a57 req-18be81a5-8b26-48be-8c8f-7e58fd533687 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:01.327366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff30deb6-0d95-4baa-9375-368150927a57 req-18be81a5-8b26-48be-8c8f-7e58fd533687 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 1096 time: 0.2332838 May 12 15:52:01.434760 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-96cb5762-6a3a-480f-8756-8f6ec7ea391f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256', 'name': '', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:51:de:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4061, 'fixed_ips': [{'subnet_id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:51Z', 'updated_at': '2022-05-12T15:50:58Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:01.439901 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96cb5762-6a3a-480f-8756-8f6ec7ea391f None None] Checking router: 75747bdd-2928-4a50-929a-8d28830552b1 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:52:01.448016 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96cb5762-6a3a-480f-8756-8f6ec7ea391f None None] Routers {'75747bdd-2928-4a50-929a-8d28830552b1'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:52:01.448616 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-96cb5762-6a3a-480f-8756-8f6ec7ea391f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:51:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['75747bdd-2928-4a50-929a-8d28830552b1'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:01.514196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff30deb6-0d95-4baa-9375-368150927a57 req-11f808f8-e870-4dd8-bfe6-6db19d828be1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:01.515697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff30deb6-0d95-4baa-9375-368150927a57 req-11f808f8-e870-4dd8-bfe6-6db19d828be1 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5c356018-3c06-4505-81ef-c3ae2fab3978 HTTP/1.1" status: 200 len: 897 time: 0.1819139 May 12 15:52:01.526566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff65fba-af85-4a68-a57e-ebb308b59c55 req-881cc1a7-8a7c-435b-b918-44e989cd4167 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:01.527221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cff65fba-af85-4a68-a57e-ebb308b59c55 req-881cc1a7-8a7c-435b-b918-44e989cd4167 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:52:01.595946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff30deb6-0d95-4baa-9375-368150927a57 req-e8360da7-c578-427f-ac1c-afc385826d23 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=35823aef-382e-46b8-9045-a3751e05ead2 HTTP/1.1" status: 200 len: 217 time: 0.0660534 May 12 15:52:01.605355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cff65fba-af85-4a68-a57e-ebb308b59c55 req-881cc1a7-8a7c-435b-b918-44e989cd4167 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:52:01.609829 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cff65fba-af85-4a68-a57e-ebb308b59c55 req-881cc1a7-8a7c-435b-b918-44e989cd4167 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 945 time: 0.2584672 May 12 15:52:01.631865 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-96cb5762-6a3a-480f-8756-8f6ec7ea391f None None] Set router 75747bdd-2928-4a50-929a-8d28830552b1 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:52:01.708784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cff65fba-af85-4a68-a57e-ebb308b59c55 req-d7002c65-1c3c-4a2c-b14a-8132040a177f tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=2cb52c0b-a50c-4d09-b2b8-9544f58e876c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0950747 May 12 15:52:01.710282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff30deb6-0d95-4baa-9375-368150927a57 req-d794665c-e080-46c3-a6ba-3ee703a76ae4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:01.711618 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff30deb6-0d95-4baa-9375-368150927a57 req-d794665c-e080-46c3-a6ba-3ee703a76ae4 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d HTTP/1.1" status: 200 len: 835 time: 0.0993037 May 12 15:52:01.790373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff30deb6-0d95-4baa-9375-368150927a57 req-6ff4eac3-6d1a-4a69-913b-1ddac35fc6df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:01.791744 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff30deb6-0d95-4baa-9375-368150927a57 req-6ff4eac3-6d1a-4a69-913b-1ddac35fc6df service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5c356018-3c06-4505-81ef-c3ae2fab3978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0725181 May 12 15:52:01.928011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff30deb6-0d95-4baa-9375-368150927a57 req-a90ef96d-0e71-4ea4-82f9-d596b5003990 service neutron] 10.222.0.84 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1295390 May 12 15:52:01.947523 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-96cb5762-6a3a-480f-8756-8f6ec7ea391f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256', 'name': '', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:51:de:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4061, 'fixed_ips': [{'subnet_id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:51Z', 'updated_at': '2022-05-12T15:50:58Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:01.951486 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96cb5762-6a3a-480f-8756-8f6ec7ea391f None None] The sync data for ids ['75747bdd-2928-4a50-929a-8d28830552b1'] in n-d-841483-1 is: [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256', 'name': '', 'network_id': '5c356018-3c06-4505-81ef-c3ae2fab3978', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:51:de:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4061, 'fixed_ips': [{'subnet_id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:51Z', 'updated_at': '2022-05-12T15:50:58Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': 'c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:52:01.977418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffbc9b2a-5d40-4031-b4ec-15b37186c5d1 req-27233a6e-bb24-4bc0-9fe5-7f99c0971ff0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:01.978141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ffbc9b2a-5d40-4031-b4ec-15b37186c5d1 req-27233a6e-bb24-4bc0-9fe5-7f99c0971ff0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:52:01.991314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ffbc9b2a-5d40-4031-b4ec-15b37186c5d1 req-27233a6e-bb24-4bc0-9fe5-7f99c0971ff0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:52:01.992676 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ffbc9b2a-5d40-4031-b4ec-15b37186c5d1 req-27233a6e-bb24-4bc0-9fe5-7f99c0971ff0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.84 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 945 time: 0.0957983 May 12 15:52:02.068949 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff30deb6-0d95-4baa-9375-368150927a57 req-326310d6-db92-46b6-a801-359586901ae2 service neutron] 10.222.0.84 "GET /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1346376 May 12 15:52:02.070326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-ffbc9b2a-5d40-4031-b4ec-15b37186c5d1 req-4a7ffed2-75d6-4883-a037-8ee5614bb9bb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port 35823aef-382e-46b8-9045-a3751e05ead2 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:52:02.070664 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ffbc9b2a-5d40-4031-b4ec-15b37186c5d1 req-4a7ffed2-75d6-4883-a037-8ee5614bb9bb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:02.200430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b64d5898-a855-4c90-a938-0e1379266005 None None] New status for floating IP 62f35174-7941-4bca-9593-bb1dd910fbeb: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:52:02.335351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ffbc9b2a-5d40-4031-b4ec-15b37186c5d1 req-4a7ffed2-75d6-4883-a037-8ee5614bb9bb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] For port 35823aef-382e-46b8-9045-a3751e05ead2, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=35823aef-382e-46b8-9045-a3751e05ead2,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:52:02.335704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ffbc9b2a-5d40-4031-b4ec-15b37186c5d1 req-4a7ffed2-75d6-4883-a037-8ee5614bb9bb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:02.574360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-ffbc9b2a-5d40-4031-b4ec-15b37186c5d1 req-4a7ffed2-75d6-4883-a037-8ee5614bb9bb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for 35823aef-382e-46b8-9045-a3751e05ead2 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:52:02.644779 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:02.729737 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ffbc9b2a-5d40-4031-b4ec-15b37186c5d1 req-4a7ffed2-75d6-4883-a037-8ee5614bb9bb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:02.782370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a7ffed2-75d6-4883-a037-8ee5614bb9bb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=35823aef-382e-46b8-9045-a3751e05ead2,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:02.868482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ffbc9b2a-5d40-4031-b4ec-15b37186c5d1 req-4a7ffed2-75d6-4883-a037-8ee5614bb9bb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] No DVR routers for this DVR port 35823aef-382e-46b8-9045-a3751e05ead2 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:52:02.875348 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ffbc9b2a-5d40-4031-b4ec-15b37186c5d1 req-4a7ffed2-75d6-4883-a037-8ee5614bb9bb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:02.877083 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-59921ac1-f1e3-4f1a-b878-ec8cb21cdb47 req-2fd4c4ce-86d3-4276-a0a7-96d0b8a07637 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=60cd0c03-0b6e-4db4-b98c-979d0b0dd158 HTTP/1.1" status: 200 len: 210 time: 0.0434160 May 12 15:52:02.879507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'name': 'network-vif-deleted', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:52:02.894439 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ffbc9b2a-5d40-4031-b4ec-15b37186c5d1 req-4a7ffed2-75d6-4883-a037-8ee5614bb9bb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.84 "DELETE /v2.0/ports/35823aef-382e-46b8-9045-a3751e05ead2 HTTP/1.1" status: 204 len: 173 time: 0.8955152 May 12 15:52:02.949373 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fe8b3038-cbd1-4b92-b54f-f7a8e6f68bfb'] response: {'server_uuid': '60cd0c03-0b6e-4db4-b98c-979d0b0dd158', 'name': 'network-vif-deleted', 'tag': '35823aef-382e-46b8-9045-a3751e05ead2', 'status': 'completed', 'code': 200} May 12 15:52:03.972882 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:52:03.975869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51036) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:04.522424 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-930a4943-ba1c-4b8f-b4f1-468543909cb3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:04.989415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-930a4943-ba1c-4b8f-b4f1-468543909cb3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:52:04.990108 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-930a4943-ba1c-4b8f-b4f1-468543909cb3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:05.181318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-930a4943-ba1c-4b8f-b4f1-468543909cb3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] For port 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:52:05.181705 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-930a4943-ba1c-4b8f-b4f1-468543909cb3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:05.220186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 35823aef-382e-46b8-9045-a3751e05ead2 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:52:05.254264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 35823aef-382e-46b8-9045-a3751e05ead2 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:52:05.254572 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 35823aef-382e-46b8-9045-a3751e05ead2 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:52:05.309452 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-930a4943-ba1c-4b8f-b4f1-468543909cb3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:52:05.625631 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-930a4943-ba1c-4b8f-b4f1-468543909cb3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:05.704920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-930a4943-ba1c-4b8f-b4f1-468543909cb3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:05.954563 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-930a4943-ba1c-4b8f-b4f1-468543909cb3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:06.425494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-930a4943-ba1c-4b8f-b4f1-468543909cb3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router 75747bdd-2928-4a50-929a-8d28830552b1 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:52:06.602313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-930a4943-ba1c-4b8f-b4f1-468543909cb3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:52:06.611519 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f7d4ce2-8bd3-460f-b576-9f6b9a7448f2 None None] Sync routers for ids ['75747bdd-2928-4a50-929a-8d28830552b1'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:52:06.617176 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-930a4943-ba1c-4b8f-b4f1-468543909cb3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "PUT /v2.0/routers/75747bdd-2928-4a50-929a-8d28830552b1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6377466 May 12 15:52:06.617440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51040) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:06.620836 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f7d4ce2-8bd3-460f-b576-9f6b9a7448f2 None None] Routers {'75747bdd-2928-4a50-929a-8d28830552b1'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:52:06.621450 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3f7d4ce2-8bd3-460f-b576-9f6b9a7448f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:51:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['75747bdd-2928-4a50-929a-8d28830552b1'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:06.682940 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting subnet c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:52:06.685725 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:06.742656 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:06.797745 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-3f7d4ce2-8bd3-460f-b576-9f6b9a7448f2 None None] Set router 75747bdd-2928-4a50-929a-8d28830552b1 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:52:06.824408 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:06.900704 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:06.945110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Subnet': ['ID=c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:06.948082 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:06.953059 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54bf0735-3d56-4c34-9ead-02b8e0be4be8 None None] Network 5c356018-3c06-4505-81ef-c3ae2fab3978 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:52:06.957121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:06.957490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:06.957826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:06.958155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:06.958477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:06.958797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:06.959114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:06.959429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:06.959744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:06.960057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:06.960368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:06.960676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:06.966681 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-84369e96-7217-4d4c-a9ee-2f9468437565 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/subnets/c7e2ab4d-b4b1-42b6-a37b-5f207b754e0d HTTP/1.1" status: 204 len: 168 time: 0.3458204 May 12 15:52:06.967474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51044) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:07.125196 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3f7d4ce2-8bd3-460f-b576-9f6b9a7448f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:52:05Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:07.129111 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f7d4ce2-8bd3-460f-b576-9f6b9a7448f2 None None] Checking router: 75747bdd-2928-4a50-929a-8d28830552b1 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:52:07.138461 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f7d4ce2-8bd3-460f-b576-9f6b9a7448f2 None None] Routers {'75747bdd-2928-4a50-929a-8d28830552b1'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:52:07.139120 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3f7d4ce2-8bd3-460f-b576-9f6b9a7448f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:51:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['75747bdd-2928-4a50-929a-8d28830552b1'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:07.150044 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:07.247985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] DHCP port deletion for 5c356018-3c06-4505-81ef-c3ae2fab3978 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:52:07.252242 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Deleting port f6d439f2-e13e-4056-8bf6-865f881585c9 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:52:07.252798 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:07.324516 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-3f7d4ce2-8bd3-460f-b576-9f6b9a7448f2 None None] Set router 75747bdd-2928-4a50-929a-8d28830552b1 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:52:07.359893 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:07.370066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port c86e9dce-5af9-4b7b-80d0-606963ac0d0e {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:52:07.370402 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:07.463122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] For port f6d439f2-e13e-4056-8bf6-865f881585c9, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f6d439f2-e13e-4056-8bf6-865f881585c9,segment=NetworkSegment(9851d85a-5882-482f-aef2-a31617f7f1c6),segment_id=9851d85a-5882-482f-aef2-a31617f7f1c6)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:52:07.463477 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:07.552494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] For port c86e9dce-5af9-4b7b-80d0-606963ac0d0e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c86e9dce-5af9-4b7b-80d0-606963ac0d0e,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:52:07.553092 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:07.588315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Calling delete_port for f6d439f2-e13e-4056-8bf6-865f881585c9 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:52:07.610404 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3f7d4ce2-8bd3-460f-b576-9f6b9a7448f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:52:05Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:07.615295 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f7d4ce2-8bd3-460f-b576-9f6b9a7448f2 None None] The sync data for ids ['75747bdd-2928-4a50-929a-8d28830552b1'] in n-d-841483-1 is: [{'id': '75747bdd-2928-4a50-929a-8d28830552b1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-7126107', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86'}], 'enable_snat': True}, 'gw_port_id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:50:46Z', 'updated_at': '2022-05-12T15:52:05Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'c86e9dce-5af9-4b7b-80d0-606963ac0d0e', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:de:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75747bdd-2928-4a50-929a-8d28830552b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4058, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:50:47Z', 'updated_at': '2022-05-12T15:50:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:52:07.673985 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:07.723150 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Pushing event deleted for resources: {'Port': ['ID=f6d439f2-e13e-4056-8bf6-865f881585c9,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:07.725534 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] No DVR routers for this DVR port f6d439f2-e13e-4056-8bf6-865f881585c9 on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:52:07.738337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:07.738679 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:07.739018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:07.739345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:07.739673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:07.740002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:07.740322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:07.740642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:07.740962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:07.741277 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:07.741623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:07.741937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d0c3108-18b8-4e57-9323-5fbd742283db None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:07.798767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for c86e9dce-5af9-4b7b-80d0-606963ac0d0e owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:52:07.967657 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.012897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:52:08.054128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=c86e9dce-5af9-4b7b-80d0-606963ac0d0e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:08.054385 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:52:08.054678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7e2f5b3a-f460-4f0c-8fb9-cfe6fec9c256 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:52:08.055099 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6d439f2-e13e-4056-8bf6-865f881585c9 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:52:08.090543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: f6d439f2-e13e-4056-8bf6-865f881585c9 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:52:08.090885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f6d439f2-e13e-4056-8bf6-865f881585c9 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:52:08.125684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.303719 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.305908 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.328684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.329208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Fanout notify agent at l3_agent the message router_deleted on router 75747bdd-2928-4a50-929a-8d28830552b1 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:52:08.344342 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.345452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9b57e50f-fcdf-48cb-bc10-35f7d531b7fd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/routers/75747bdd-2928-4a50-929a-8d28830552b1 HTTP/1.1" status: 204 len: 168 time: 1.3776574 May 12 15:52:08.348475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51048) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:08.468733 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ef205b44-39c2-4ac5-9900-b1e194036d21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.596812 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ef205b44-39c2-4ac5-9900-b1e194036d21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.621220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-ef205b44-39c2-4ac5-9900-b1e194036d21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5c356018-3c06-4505-81ef-c3ae2fab3978']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:08.632959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-ef205b44-39c2-4ac5-9900-b1e194036d21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9851d85a-5882-482f-aef2-a31617f7f1c6') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:08.633253 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-ef205b44-39c2-4ac5-9900-b1e194036d21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9851d85a-5882-482f-aef2-a31617f7f1c6') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:08.644392 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ef205b44-39c2-4ac5-9900-b1e194036d21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.660461 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ef205b44-39c2-4ac5-9900-b1e194036d21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.666407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ef205b44-39c2-4ac5-9900-b1e194036d21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Releasing vlan 579 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:52:08.666773 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ef205b44-39c2-4ac5-9900-b1e194036d21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: timer() May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:52:08.681725 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:52:08.765807 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ef205b44-39c2-4ac5-9900-b1e194036d21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.771777 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ef205b44-39c2-4ac5-9900-b1e194036d21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.798057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef205b44-39c2-4ac5-9900-b1e194036d21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Network': ['ID=5c356018-3c06-4505-81ef-c3ae2fab3978,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:08.808594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ef205b44-39c2-4ac5-9900-b1e194036d21 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/networks/5c356018-3c06-4505-81ef-c3ae2fab3978 HTTP/1.1" status: 204 len: 168 time: 0.4578021 May 12 15:52:08.810249 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51052) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:08.883465 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-014e64aa-f0cb-4430-a163-b5367b0298c1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.915262 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-014e64aa-f0cb-4430-a163-b5367b0298c1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:08.986391 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-014e64aa-f0cb-4430-a163-b5367b0298c1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.003466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-014e64aa-f0cb-4430-a163-b5367b0298c1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2cb52c0b-a50c-4d09-b2b8-9544f58e876c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:09.017496 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-014e64aa-f0cb-4430-a163-b5367b0298c1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.018602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-014e64aa-f0cb-4430-a163-b5367b0298c1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/security-groups/2cb52c0b-a50c-4d09-b2b8-9544f58e876c HTTP/1.1" status: 204 len: 168 time: 0.2074115 May 12 15:52:09.138586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51062) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:09.144501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-168432885', 'description': 'tempest-secgroup-smoke-168432885 description', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:52:09.150998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:52:09.155122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:52:09.158018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:52:09.163548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:52:09.173824 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.193666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:52:09.197700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:52:09.200683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:52:09.208521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:52:09.278465 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.282187 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.327219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1714f52e-97da-4eb7-8528-174c68796708,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:09.332112 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.333280 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b14ec3eb-8f02-4af2-a694-5ec78bebe9d5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.1937153 May 12 15:52:09.336136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51066) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:09.340882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-461ddf0b-6b9c-4e36-9fde-d72e02c7852d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '1714f52e-97da-4eb7-8528-174c68796708', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:52:09.347471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-461ddf0b-6b9c-4e36-9fde-d72e02c7852d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:52:09.351329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-461ddf0b-6b9c-4e36-9fde-d72e02c7852d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:52:09.354154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-461ddf0b-6b9c-4e36-9fde-d72e02c7852d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:52:09.359802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-461ddf0b-6b9c-4e36-9fde-d72e02c7852d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:52:09.375984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-461ddf0b-6b9c-4e36-9fde-d72e02c7852d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.438307 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-461ddf0b-6b9c-4e36-9fde-d72e02c7852d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.441762 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-461ddf0b-6b9c-4e36-9fde-d72e02c7852d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.465238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-461ddf0b-6b9c-4e36-9fde-d72e02c7852d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a80e2098-30d9-426d-9f26-7f3c9e21ad09,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:09.475589 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-461ddf0b-6b9c-4e36-9fde-d72e02c7852d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.476817 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-461ddf0b-6b9c-4e36-9fde-d72e02c7852d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1397817 May 12 15:52:09.479728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51070) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:09.485435 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6d91ddc1-3bec-4c65-a8f4-f457893e6cec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '1714f52e-97da-4eb7-8528-174c68796708', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:52:09.491581 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6d91ddc1-3bec-4c65-a8f4-f457893e6cec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:52:09.495431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6d91ddc1-3bec-4c65-a8f4-f457893e6cec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:52:09.498259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6d91ddc1-3bec-4c65-a8f4-f457893e6cec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:52:09.505278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6d91ddc1-3bec-4c65-a8f4-f457893e6cec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:52:09.522011 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d91ddc1-3bec-4c65-a8f4-f457893e6cec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.582386 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d91ddc1-3bec-4c65-a8f4-f457893e6cec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.586058 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d91ddc1-3bec-4c65-a8f4-f457893e6cec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.618494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d91ddc1-3bec-4c65-a8f4-f457893e6cec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8ef747f3-33be-443c-baf6-d456fd805d74,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:09.626449 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6d91ddc1-3bec-4c65-a8f4-f457893e6cec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.627639 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6d91ddc1-3bec-4c65-a8f4-f457893e6cec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1470132 May 12 15:52:09.630485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51074) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:09.635261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c2e666f8-fe26-40b1-988d-be6ed62df3ec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '1714f52e-97da-4eb7-8528-174c68796708', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:52:09.641725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c2e666f8-fe26-40b1-988d-be6ed62df3ec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:52:09.645558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c2e666f8-fe26-40b1-988d-be6ed62df3ec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:52:09.648373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c2e666f8-fe26-40b1-988d-be6ed62df3ec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:52:09.654006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c2e666f8-fe26-40b1-988d-be6ed62df3ec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:52:09.670647 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c2e666f8-fe26-40b1-988d-be6ed62df3ec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.732536 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c2e666f8-fe26-40b1-988d-be6ed62df3ec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.740567 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c2e666f8-fe26-40b1-988d-be6ed62df3ec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.763051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2e666f8-fe26-40b1-988d-be6ed62df3ec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0b855609-3f0c-49d3-8bc9-63779fe66107,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:09.777672 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c2e666f8-fe26-40b1-988d-be6ed62df3ec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:09.779069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c2e666f8-fe26-40b1-988d-be6ed62df3ec tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1475470 May 12 15:52:09.782163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51078) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:09.787036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4c738cf1-db6b-4084-9d15-a5032badd5f0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '1714f52e-97da-4eb7-8528-174c68796708', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:52:09.793438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4c738cf1-db6b-4084-9d15-a5032badd5f0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:52:09.798392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4c738cf1-db6b-4084-9d15-a5032badd5f0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:52:09.801330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4c738cf1-db6b-4084-9d15-a5032badd5f0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:52:09.807257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4c738cf1-db6b-4084-9d15-a5032badd5f0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:52:09.873320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c86e9dce-5af9-4b7b-80d0-606963ac0d0e no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:52:09.922643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: c86e9dce-5af9-4b7b-80d0-606963ac0d0e {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:52:09.922643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c86e9dce-5af9-4b7b-80d0-606963ac0d0e not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:52:09.937166 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c738cf1-db6b-4084-9d15-a5032badd5f0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.007688 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c738cf1-db6b-4084-9d15-a5032badd5f0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.007688 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c738cf1-db6b-4084-9d15-a5032badd5f0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.035927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c738cf1-db6b-4084-9d15-a5032badd5f0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d1b63b89-fdc4-4683-b2eb-6f79d3f55d82,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:10.042900 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c738cf1-db6b-4084-9d15-a5032badd5f0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.042900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4c738cf1-db6b-4084-9d15-a5032badd5f0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2587104 May 12 15:52:10.047905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51082) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:10.050493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8a3bed5a-d1d5-48c3-89e1-a841f70fd476 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '1714f52e-97da-4eb7-8528-174c68796708', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:52:10.057164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8a3bed5a-d1d5-48c3-89e1-a841f70fd476 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:52:10.061216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8a3bed5a-d1d5-48c3-89e1-a841f70fd476 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:52:10.068892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8a3bed5a-d1d5-48c3-89e1-a841f70fd476 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:52:10.078094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8a3bed5a-d1d5-48c3-89e1-a841f70fd476 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:52:10.085911 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-8a3bed5a-d1d5-48c3-89e1-a841f70fd476 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Project b88b5989d4c548dba6124f2e4690e5c3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:52:10.093725 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a3bed5a-d1d5-48c3-89e1-a841f70fd476 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.192528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a3bed5a-d1d5-48c3-89e1-a841f70fd476 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.192528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a3bed5a-d1d5-48c3-89e1-a841f70fd476 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.239576 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8a3bed5a-d1d5-48c3-89e1-a841f70fd476 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.239576 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8a3bed5a-d1d5-48c3-89e1-a841f70fd476 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1851239 May 12 15:52:10.245461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51086) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:10.251934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a3bed5a-d1d5-48c3-89e1-a841f70fd476 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e39f14d4-bd6e-48ce-87d9-b7d5b4c387e9,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:10.263079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-51b37e9d-854c-4313-8513-2ad4ef62c26a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'security_group_rule': {'security_group_id': '1714f52e-97da-4eb7-8528-174c68796708', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:52:10.279936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-51b37e9d-854c-4313-8513-2ad4ef62c26a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:52:10.279936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-51b37e9d-854c-4313-8513-2ad4ef62c26a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:security_group_rule and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:52:10.291980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-51b37e9d-854c-4313-8513-2ad4ef62c26a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:52:10.291980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-51b37e9d-854c-4313-8513-2ad4ef62c26a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:52:10.315975 n-d-841483-1 neutron-server[88152]: INFO neutron.db.securitygroups_db [None req-51b37e9d-854c-4313-8513-2ad4ef62c26a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Project b88b5989d4c548dba6124f2e4690e5c3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 15:52:10.320054 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-51b37e9d-854c-4313-8513-2ad4ef62c26a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.389501 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-51b37e9d-854c-4313-8513-2ad4ef62c26a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.396476 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-51b37e9d-854c-4313-8513-2ad4ef62c26a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.418882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51b37e9d-854c-4313-8513-2ad4ef62c26a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b0c56dc4-e826-40dc-82e9-16609194477c,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:10.425943 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-51b37e9d-854c-4313-8513-2ad4ef62c26a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.425943 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-51b37e9d-854c-4313-8513-2ad4ef62c26a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1919222 May 12 15:52:10.432281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51090) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:10.441839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'network': {'name': 'tempest-network-smoke--2043592983', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'port_security_enabled': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:52:10.441839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:52:10.450818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:network and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:52:10.450818 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:52:10.461609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:52:10.471200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Made reservation on behalf of b88b5989d4c548dba6124f2e4690e5c3 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:52:10.471200 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.505990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 587} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:52:10.516247 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.516247 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Added segment 1aa7c9a9-f503-41e5-a120-02f107bdc1af of type vlan for network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 May 12 15:52:10.539724 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.567543 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.578074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:10.578074 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.695574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2616830 May 12 15:52:10.699347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51094) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:10.699347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'admin_state_up': True, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:52:10.706394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e3af7ab-e556-4483-a0b2-399bbadc100b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Network': ['ID=2e6edaa4-6d0b-49db-a2ad-54939b74c9a9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:10.716408 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:52:10.719312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:52:10.725153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:router and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:52:10.725153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:52:10.739109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:52:10.752966 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.752966 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:10.770768 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:11.054992 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:11.358654 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:11.387268 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:11.523907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.25.8.238 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/d8489fff-54e6-4b87-b64f-bcaca7fcc6b3) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:52:11.674070 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:11.704478 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:11.766656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:52:11.769244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:52:11.772958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:52:11.922715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=d8489fff-54e6-4b87-b64f-bcaca7fcc6b3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:12.302189 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:12.646246 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:12.770015 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fd49ee67-9457-4629-bae6-0b9c9efbf67c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:12.857787 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router d9a32230-fac5-430a-90e6-e9464fa203aa is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 15:52:13.039349 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:52:13.048951 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Sync routers for ids ['d9a32230-fac5-430a-90e6-e9464fa203aa'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:52:13.058586 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Routers {'d9a32230-fac5-430a-90e6-e9464fa203aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:52:13.059131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:51:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['d9a32230-fac5-430a-90e6-e9464fa203aa'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:13.075604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:13.075604 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-60598494-8b80-49f9-9285-ccc7cacf4a39 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 2.3775771 May 12 15:52:13.075604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51098) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:13.128126 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-887d4710-6ca3-48c0-a816-81458c89898a tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=b88b5989d4c548dba6124f2e4690e5c3&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0494187 May 12 15:52:13.128126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51102) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:13.271139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a369b8d7-1be6-483e-85da-c655d7e4a255 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:13.273481 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a369b8d7-1be6-483e-85da-c655d7e4a255 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1438169 May 12 15:52:13.275308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51106) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:13.300645 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Set router d9a32230-fac5-430a-90e6-e9464fa203aa gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:52:13.447134 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-44f30240-9920-4184-8ed8-fdcee1a89fdc tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1704006 May 12 15:52:13.449662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51110) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:13.455462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1413665253', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:52:13.491366 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:13.564845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:52:13.568707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:subnet and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:52:13.571483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:52:13.578728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:52:13.587929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Made reservation on behalf of b88b5989d4c548dba6124f2e4690e5c3 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:52:13.591952 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:13.617626 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:52:12Z', 'revision_number': 3, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:13.621650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Checking router: d9a32230-fac5-430a-90e6-e9464fa203aa for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:52:13.621995 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Updating router d9a32230-fac5-430a-90e6-e9464fa203aa port d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:52:13.684793 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:13.822752 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:13.908782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Subnet': ['ID=16a59a2f-5dba-4ee9-a867-07b0ad8d6846,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:13.919779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Checking segment: {'id': '1aa7c9a9-f503-41e5-a120-02f107bdc1af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:52:13.920141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network hostable DHCP agents. Network: 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:52:13.946082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:52:13.962834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:52:13.962834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:13.962834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:13.975434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04d4314d-3324-437a-87d7-6c76a0594853 None None] Network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:52:13.993714 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d3218abd-a3c1-4bcf-9b45-3b6781144274 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.5393033 May 12 15:52:13.993714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51114) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:14.144652 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:14.192739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Transition to ACTIVE for port object d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:52:14.206302 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:14.290857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Attempting to bind port d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:52:14.291218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Attempting to bind port d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:52:14.291873 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Attempting to bind port d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:52:14.329045 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 51, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:52:14.329045 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:52:14.330052 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:14.330052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:52:14.330879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Bound port: d8489fff-54e6-4b87-b64f-bcaca7fcc6b3, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:52:14.330974 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:14.384721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09c0f74d-3680-4879-ad48-f6eddfcbebbc None None] Pushing event updated for resources: {'Port': ['ID=d8489fff-54e6-4b87-b64f-bcaca7fcc6b3,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:14.423658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ips': [{'subnet_id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 15:52:14.423658 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:14.503152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] For port d8489fff-54e6-4b87-b64f-bcaca7fcc6b3, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:52:14.528216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] For port d8489fff-54e6-4b87-b64f-bcaca7fcc6b3, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d8489fff-54e6-4b87-b64f-bcaca7fcc6b3,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:52:14.535247 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:14.672389 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Routers {'d9a32230-fac5-430a-90e6-e9464fa203aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:52:14.672389 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:51:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['d9a32230-fac5-430a-90e6-e9464fa203aa'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:14.776300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Allocated IP 172.20.0.2 (2e6edaa4-6d0b-49db-a2ad-54939b74c9a9/16a59a2f-5dba-4ee9-a867-07b0ad8d6846/31be8389-bac0-4f0d-871e-a78a1e0a9dda) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:52:14.777512 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:14.778245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09c0f74d-3680-4879-ad48-f6eddfcbebbc None None] Pushing event updated for resources: {'Port': ['ID=d8489fff-54e6-4b87-b64f-bcaca7fcc6b3,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:14.986310 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] Set router d9a32230-fac5-430a-90e6-e9464fa203aa gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:52:15.277671 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:15.300535 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Transition to ACTIVE for port object 31be8389-bac0-4f0d-871e-a78a1e0a9dda will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:52:15.360704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Transition to ACTIVE for port object 31be8389-bac0-4f0d-871e-a78a1e0a9dda will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:52:15.366778 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-16976c74-492d-45be-a8f0-9365e63c8d7e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:15.371641 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:15.444721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.20.0.1 (2e6edaa4-6d0b-49db-a2ad-54939b74c9a9/16a59a2f-5dba-4ee9-a867-07b0ad8d6846/ba0eb22b-635a-49a7-b451-bf288678d4dd) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:52:15.446820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:52:15.450329 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:52:15.457348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:52:15.461976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Pushing event updated for resources: {'Port': ['ID=31be8389-bac0-4f0d-871e-a78a1e0a9dda,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:15.533647 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:52:12Z', 'revision_number': 3, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:15.549761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca5eea4e-bd33-4807-85fd-83b03e9854fe None None] The sync data for ids ['d9a32230-fac5-430a-90e6-e9464fa203aa'] in n-d-841483-1 is: [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:52:12Z', 'revision_number': 3, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:52:15.557000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Attempting to bind port 31be8389-bac0-4f0d-871e-a78a1e0a9dda on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:52:15.558189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Attempting to bind port 31be8389-bac0-4f0d-871e-a78a1e0a9dda by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '1aa7c9a9-f503-41e5-a120-02f107bdc1af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:52:15.558189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Attempting to bind port 31be8389-bac0-4f0d-871e-a78a1e0a9dda on network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:52:15.563815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 51, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:52:15.564182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Checking segment: {'id': '1aa7c9a9-f503-41e5-a120-02f107bdc1af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:52:15.565138 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:15.565138 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Bound using segment: {'id': '1aa7c9a9-f503-41e5-a120-02f107bdc1af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:52:15.565505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Bound port: 31be8389-bac0-4f0d-871e-a78a1e0a9dda, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1aa7c9a9-f503-41e5-a120-02f107bdc1af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:52:15.565813 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:15.633734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:15.654820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Transition to ACTIVE for port object ba0eb22b-635a-49a7-b451-bf288678d4dd will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:52:15.669468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] For port 31be8389-bac0-4f0d-871e-a78a1e0a9dda, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:52:15.673261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] For port 31be8389-bac0-4f0d-871e-a78a1e0a9dda, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=31be8389-bac0-4f0d-871e-a78a1e0a9dda,segment=NetworkSegment(1aa7c9a9-f503-41e5-a120-02f107bdc1af),segment_id=1aa7c9a9-f503-41e5-a120-02f107bdc1af)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:52:15.678601 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:15.690060 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:15.771541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:52:15.776232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7055a86-4d19-45e4-beb3-5086629fa492 None None] Pushing event updated for resources: {'Port': ['ID=31be8389-bac0-4f0d-871e-a78a1e0a9dda,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:15.781867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:52:15.781867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:52:15.853573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=ba0eb22b-635a-49a7-b451-bf288678d4dd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:15.880773 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:16.072644 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:16.082238 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:16.320736 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:16.602079 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:16.608695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:16.736496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=ba0eb22b-635a-49a7-b451-bf288678d4dd,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:16.743632 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:16.896391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:52:16.896391 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:52:17.028496 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f5f94f9-ee09-4969-956d-0ace4cd9fc4b None None] Network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:52:17.126808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router d9a32230-fac5-430a-90e6-e9464fa203aa has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:52:17.129332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-99853323-3a3d-434f-a15e-8de2341e08e0 None None] Provisioning for port 31be8389-bac0-4f0d-871e-a78a1e0a9dda completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:52:17.486737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:52:17.502574 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d621bf9c-f7f2-46e0-8453-2f862c7d8f74 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "PUT /v2.0/routers/d9a32230-fac5-430a-90e6-e9464fa203aa/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5073137 May 12 15:52:17.539400 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Sync routers for ids ['d9a32230-fac5-430a-90e6-e9464fa203aa'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:52:17.549013 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Routers {'d9a32230-fac5-430a-90e6-e9464fa203aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:52:17.549635 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:52:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['d9a32230-fac5-430a-90e6-e9464fa203aa'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:17.588832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-653ad2b2-bec0-4bf2-ac46-8f6532878b47 None None] Provisioning for port ba0eb22b-635a-49a7-b451-bf288678d4dd completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:52:17.600622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-653ad2b2-bec0-4bf2-ac46-8f6532878b47 None None] Provisioning complete for port ba0eb22b-635a-49a7-b451-bf288678d4dd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:52:17.601069 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-653ad2b2-bec0-4bf2-ac46-8f6532878b47 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:17.684678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-653ad2b2-bec0-4bf2-ac46-8f6532878b47 None None] Port ba0eb22b-635a-49a7-b451-bf288678d4dd cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:52:17.708597 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-70c6d29c-1138-4ee6-950c-9df13aa8e194 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:52:17.736357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-70c6d29c-1138-4ee6-950c-9df13aa8e194 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:52:17.744932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-70c6d29c-1138-4ee6-950c-9df13aa8e194 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-168432885&fields=id&tenant_id=b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 267 time: 0.0923831 May 12 15:52:17.751629 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Set router d9a32230-fac5-430a-90e6-e9464fa203aa gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:52:17.774981 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:17.916832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5581f460-7f51-4cfd-9ee6-ee0c85733337 None None] Provisioning complete for port ba0eb22b-635a-49a7-b451-bf288678d4dd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:52:17.917188 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5581f460-7f51-4cfd-9ee6-ee0c85733337 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:17.961786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d29e829a-b477-4de3-8bdb-4de4df4c097e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:17.962679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d29e829a-b477-4de3-8bdb-4de4df4c097e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:52:17.991941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d29e829a-b477-4de3-8bdb-4de4df4c097e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:52:18.002419 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d29e829a-b477-4de3-8bdb-4de4df4c097e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/networks?id=2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 HTTP/1.1" status: 200 len: 797 time: 0.2566381 May 12 15:52:18.022075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-fdb2642a-874b-4881-90a4-470e6a54382e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/quotas/b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 375 time: 0.0180902 May 12 15:52:18.027381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 31be8389-bac0-4f0d-871e-a78a1e0a9dda up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:52:18.065835 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5581f460-7f51-4cfd-9ee6-ee0c85733337 None None] Port ba0eb22b-635a-49a7-b451-bf288678d4dd cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:52:18.120808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 31be8389-bac0-4f0d-871e-a78a1e0a9dda completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:52:18.130750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 31be8389-bac0-4f0d-871e-a78a1e0a9dda triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:52:18.131356 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:18.151736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-03bdccd6-42e2-4b1b-a52e-15b96cce64a4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:52:18.184767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-03bdccd6-42e2-4b1b-a52e-15b96cce64a4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:52:18.190545 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-03bdccd6-42e2-4b1b-a52e-15b96cce64a4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1633112 May 12 15:52:18.195659 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:52:15Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'ba0eb22b-635a-49a7-b451-bf288678d4dd', 'name': '', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:75:c7:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 4092, 'fixed_ips': [{'subnet_id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:15Z', 'updated_at': '2022-05-12T15:52:16Z', 'revision_number': 2, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:18.199182 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Checking router: d9a32230-fac5-430a-90e6-e9464fa203aa for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:52:18.199973 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Updating router d9a32230-fac5-430a-90e6-e9464fa203aa port ba0eb22b-635a-49a7-b451-bf288678d4dd binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 15:52:18.268002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b7c2c809-5692-46ea-b5a3-8ac431a79098 None None] Provisioning complete for port ba0eb22b-635a-49a7-b451-bf288678d4dd triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:52:18.268499 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b7c2c809-5692-46ea-b5a3-8ac431a79098 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:18.291072 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:18.378403 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b7c2c809-5692-46ea-b5a3-8ac431a79098 None None] Port ba0eb22b-635a-49a7-b451-bf288678d4dd cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:52:18.394537 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:18.397779 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-ee46810d-37a2-4ef3-bf20-c47d5a66e4f3 service neutron] 10.222.0.82 "GET /v2.0/networks/2e6edaa4-6d0b-49db-a2ad-54939b74c9a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1959176 May 12 15:52:18.449995 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 31be8389-bac0-4f0d-871e-a78a1e0a9dda, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=31be8389-bac0-4f0d-871e-a78a1e0a9dda,segment=NetworkSegment(1aa7c9a9-f503-41e5-a120-02f107bdc1af),segment_id=1aa7c9a9-f503-41e5-a120-02f107bdc1af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:52:18.456022 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:18.457140 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:52:18.591489 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=31be8389-bac0-4f0d-871e-a78a1e0a9dda,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:18.602302 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-76117ad8-1be1-4cf4-b99b-c2fb9b24d1c0 service neutron] 10.222.0.82 "GET /v2.0/networks/2e6edaa4-6d0b-49db-a2ad-54939b74c9a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1968429 May 12 15:52:18.608433 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:52:18.617694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:52:18.618562 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:18.783123 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:18.797968 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:18.798229 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Transition to ACTIVE for port object ba0eb22b-635a-49a7-b451-bf288678d4dd will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:52:18.809318 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:18.839885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port d8489fff-54e6-4b87-b64f-bcaca7fcc6b3, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d8489fff-54e6-4b87-b64f-bcaca7fcc6b3,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:52:18.847234 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0872599f-7123-4a15-9f24-a1e7f766f7c1 req-37220d15-fc2a-48a5-9dd8-092c5746a189 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 210 time: 0.0617094 May 12 15:52:18.855487 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:18.965545 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=d8489fff-54e6-4b87-b64f-bcaca7fcc6b3,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:19.033625 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e0fcb7d-268c-405e-81dd-477afd6dfdbb None None] Pushing event updated for resources: {'Port': ['ID=ba0eb22b-635a-49a7-b451-bf288678d4dd,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:19.084841 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0fcb7d-268c-405e-81dd-477afd6dfdbb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:19.085656 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0fcb7d-268c-405e-81dd-477afd6dfdbb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:19.086180 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0fcb7d-268c-405e-81dd-477afd6dfdbb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:19.086180 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0fcb7d-268c-405e-81dd-477afd6dfdbb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:19.086404 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0fcb7d-268c-405e-81dd-477afd6dfdbb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:19.086830 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0fcb7d-268c-405e-81dd-477afd6dfdbb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:19.087902 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0fcb7d-268c-405e-81dd-477afd6dfdbb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:19.087902 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0fcb7d-268c-405e-81dd-477afd6dfdbb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:19.087902 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0fcb7d-268c-405e-81dd-477afd6dfdbb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:19.088203 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0fcb7d-268c-405e-81dd-477afd6dfdbb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:19.088553 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0fcb7d-268c-405e-81dd-477afd6dfdbb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:19.089024 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0fcb7d-268c-405e-81dd-477afd6dfdbb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:52:19.126141 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Attempting to bind port ba0eb22b-635a-49a7-b451-bf288678d4dd on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:52:19.126141 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Attempting to bind port ba0eb22b-635a-49a7-b451-bf288678d4dd by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '1aa7c9a9-f503-41e5-a120-02f107bdc1af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:52:19.126141 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Attempting to bind port ba0eb22b-635a-49a7-b451-bf288678d4dd on network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:52:19.133181 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 52, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:52:19.133181 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Checking segment: {'id': '1aa7c9a9-f503-41e5-a120-02f107bdc1af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:52:19.134063 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:19.134063 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Bound using segment: {'id': '1aa7c9a9-f503-41e5-a120-02f107bdc1af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:52:19.134250 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Bound port: ba0eb22b-635a-49a7-b451-bf288678d4dd, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1aa7c9a9-f503-41e5-a120-02f107bdc1af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:52:19.134443 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:19.232796 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] For port ba0eb22b-635a-49a7-b451-bf288678d4dd, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:52:19.237577 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] For port ba0eb22b-635a-49a7-b451-bf288678d4dd, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ba0eb22b-635a-49a7-b451-bf288678d4dd,segment=NetworkSegment(1aa7c9a9-f503-41e5-a120-02f107bdc1af),segment_id=1aa7c9a9-f503-41e5-a120-02f107bdc1af)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:52:19.244928 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:19.342671 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Routers {'d9a32230-fac5-430a-90e6-e9464fa203aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:52:19.343290 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:52:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['d9a32230-fac5-430a-90e6-e9464fa203aa'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:19.451220 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e0fcb7d-268c-405e-81dd-477afd6dfdbb None None] Pushing event updated for resources: {'Port': ['ID=ba0eb22b-635a-49a7-b451-bf288678d4dd,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:19.598800 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] Set router d9a32230-fac5-430a-90e6-e9464fa203aa gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:52:19.895149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 31be8389-bac0-4f0d-871e-a78a1e0a9dda up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:52:19.930778 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:52:15Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'ba0eb22b-635a-49a7-b451-bf288678d4dd', 'name': '', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:75:c7:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 4092, 'fixed_ips': [{'subnet_id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:15Z', 'updated_at': '2022-05-12T15:52:19Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:19.935923 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d1f77f3-59de-4d93-a359-e7abd7130450 None None] The sync data for ids ['d9a32230-fac5-430a-90e6-e9464fa203aa'] in n-d-841483-1 is: [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:52:15Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'ba0eb22b-635a-49a7-b451-bf288678d4dd', 'name': '', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:75:c7:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 4092, 'fixed_ips': [{'subnet_id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:15Z', 'updated_at': '2022-05-12T15:52:19Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:52:20.022926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 31be8389-bac0-4f0d-871e-a78a1e0a9dda triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:52:20.024677 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:20.148997 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b28734d2-377e-4c6a-82ef-ea70a517d5b0 req-97c5fd8c-e1bf-43e2-bcc2-2ab04eeb8ee6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 210 time: 0.0643640 May 12 15:52:20.213789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:52:20.307068 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:52:20.308004 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:20.526661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-fd26e3f7-580a-4775-9eac-5b0ca505176a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:20.528097 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-fd26e3f7-580a-4775-9eac-5b0ca505176a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.76 "GET /v2.0/networks?id=2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 HTTP/1.1" status: 200 len: 797 time: 0.1963108 May 12 15:52:20.580249 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-47217a3f-5f7e-4420-b6dd-c5c284d81c1c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b88b5989d4c548dba6124f2e4690e5c3 HTTP/1.1" status: 200 len: 379 time: 0.0433526 May 12 15:52:20.588604 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'port': {'device_id': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'admin_state_up': True, 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'security_groups': ['1714f52e-97da-4eb7-8528-174c68796708']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:52:20.735449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:52:20.745314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:52:20.755240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Made reservation on behalf of b88b5989d4c548dba6124f2e4690e5c3 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:52:20.758775 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:20.931645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.20.0.10 (2e6edaa4-6d0b-49db-a2ad-54939b74c9a9/16a59a2f-5dba-4ee9-a867-07b0ad8d6846/db644c30-f926-487d-ad60-611aac7e2e42) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:52:21.138258 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:21.157149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Transition to ACTIVE for port object db644c30-f926-487d-ad60-611aac7e2e42 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:52:21.185513 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:21.269814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:52:21.272806 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:52:21.277005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:52:21.314520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76dcf148-8087-4964-8c53-e2d375a9009a req-ed5c2f80-08a2-492e-89ae-51acf56e6fb1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:21.317862 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-76dcf148-8087-4964-8c53-e2d375a9009a req-ed5c2f80-08a2-492e-89ae-51acf56e6fb1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 932 time: 0.1022341 May 12 15:52:21.321218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=db644c30-f926-487d-ad60-611aac7e2e42,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:21.348012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:21.348642 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:21.364051 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-76dcf148-8087-4964-8c53-e2d375a9009a req-05706cde-a991-4814-a965-8a18bc7cd72a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418024 May 12 15:52:21.379253 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-d4e436a0-b68e-4a80-9e39-93d5d43d25c6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7943547 May 12 15:52:21.391394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Request body: {'port': {'device_id': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:52:21.493691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4c2f06a4-c897-40e3-ac9d-433bbca4a201 None None] Provisioning for port db644c30-f926-487d-ad60-611aac7e2e42 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:52:21.498644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4c2f06a4-c897-40e3-ac9d-433bbca4a201 None None] Provisioning complete for port db644c30-f926-487d-ad60-611aac7e2e42 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:52:21.499041 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c2f06a4-c897-40e3-ac9d-433bbca4a201 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:21.510762 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:21.551753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4c2f06a4-c897-40e3-ac9d-433bbca4a201 None None] Port db644c30-f926-487d-ad60-611aac7e2e42 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:52:21.878417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id db644c30-f926-487d-ad60-611aac7e2e42 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:52:21.886162 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:21.903313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Transition to ACTIVE for port object db644c30-f926-487d-ad60-611aac7e2e42 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:52:21.909516 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:21.913279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ba0eb22b-635a-49a7-b451-bf288678d4dd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:52:21.991175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ba0eb22b-635a-49a7-b451-bf288678d4dd completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:52:21.996666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ba0eb22b-635a-49a7-b451-bf288678d4dd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:52:21.997189 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:22.148813 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:22.190744 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ba0eb22b-635a-49a7-b451-bf288678d4dd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ba0eb22b-635a-49a7-b451-bf288678d4dd,segment=NetworkSegment(1aa7c9a9-f503-41e5-a120-02f107bdc1af),segment_id=1aa7c9a9-f503-41e5-a120-02f107bdc1af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:52:22.196373 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:22.247565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Pushing event updated for resources: {'Port': ['ID=db644c30-f926-487d-ad60-611aac7e2e42,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:22.292087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ba0eb22b-635a-49a7-b451-bf288678d4dd,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:22.313976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Attempting to bind port db644c30-f926-487d-ad60-611aac7e2e42 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:52:22.314311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Attempting to bind port db644c30-f926-487d-ad60-611aac7e2e42 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '1aa7c9a9-f503-41e5-a120-02f107bdc1af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:52:22.315098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Attempting to bind port db644c30-f926-487d-ad60-611aac7e2e42 on network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:52:22.319435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Port db644c30-f926-487d-ad60-611aac7e2e42 on network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:52:22.319744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Attempting to bind port db644c30-f926-487d-ad60-611aac7e2e42 on network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:52:22.324939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 52, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:52:22.325266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Checking segment: {'id': '1aa7c9a9-f503-41e5-a120-02f107bdc1af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:52:22.325738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Bound using segment: {'id': '1aa7c9a9-f503-41e5-a120-02f107bdc1af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:52:22.326071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Bound port: db644c30-f926-487d-ad60-611aac7e2e42, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1aa7c9a9-f503-41e5-a120-02f107bdc1af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:52:22.326416 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:22.426368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] For port db644c30-f926-487d-ad60-611aac7e2e42, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:52:22.429340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] For port db644c30-f926-487d-ad60-611aac7e2e42, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=db644c30-f926-487d-ad60-611aac7e2e42,segment=NetworkSegment(1aa7c9a9-f503-41e5-a120-02f107bdc1af),segment_id=1aa7c9a9-f503-41e5-a120-02f107bdc1af)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:52:22.433874 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:22.502576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:22.503187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:22.506246 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] 10.222.0.76 "PUT /v2.0/ports/db644c30-f926-487d-ad60-611aac7e2e42 HTTP/1.1" status: 200 len: 1092 time: 1.1184838 May 12 15:52:22.506246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'tag': 'db644c30-f926-487d-ad60-611aac7e2e42'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:52:22.575180 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a432756-d622-44ed-a66c-0e7845a58659 req-78f02230-ac71-4fb5-8c01-dcfc3af00655 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:22.576785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a432756-d622-44ed-a66c-0e7845a58659 req-78f02230-ac71-4fb5-8c01-dcfc3af00655 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 944 time: 0.0983667 May 12 15:52:22.590053 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d1adb690-6780-439b-8f63-f9e2ed9252cb'] response: {'name': 'network-changed', 'server_uuid': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'tag': 'db644c30-f926-487d-ad60-611aac7e2e42', 'status': 'completed', 'code': 200} May 12 15:52:22.596448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a7074a0-01be-4107-962b-8677b73b7d45 service neutron] Pushing event updated for resources: {'Port': ['ID=db644c30-f926-487d-ad60-611aac7e2e42,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:22.635503 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2a432756-d622-44ed-a66c-0e7845a58659 req-141e16ef-4f77-4f25-9fd1-aa09203d16bf tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478628 May 12 15:52:22.643499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-4960f97c-1e53-44bb-b593-8f263c9a6bee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:22.645163 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-4960f97c-1e53-44bb-b593-8f263c9a6bee service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 1095 time: 0.1014965 May 12 15:52:22.726340 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-8031c5c5-e5aa-4994-982e-71faf3a63cea service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=db644c30-f926-487d-ad60-611aac7e2e42 HTTP/1.1" status: 200 len: 217 time: 0.0747056 May 12 15:52:22.799152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-ecd51fac-361e-4e7b-9fc1-bcc966d635aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:22.800724 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-ecd51fac-361e-4e7b-9fc1-bcc966d635aa service neutron] 10.222.0.76 "GET /v2.0/subnets?id=16a59a2f-5dba-4ee9-a867-07b0ad8d6846 HTTP/1.1" status: 200 len: 835 time: 0.0690866 May 12 15:52:22.884301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-06455978-e923-4d26-adf0-43c6aa6ca59c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:22.886008 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-06455978-e923-4d26-adf0-43c6aa6ca59c service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=2e6edaa4-6d0b-49db-a2ad-54939b74c9a9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0790315 May 12 15:52:23.019561 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-720dd2a6-c2d8-4404-bd22-ec08c3364727 service neutron] 10.222.0.76 "GET /v2.0/networks/2e6edaa4-6d0b-49db-a2ad-54939b74c9a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1282420 May 12 15:52:23.158906 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8cec2a3-a0f9-4e47-b384-f7af845e1735 req-ba3c7778-e9b8-4b86-b139-8782a5a550f5 service neutron] 10.222.0.76 "GET /v2.0/networks/2e6edaa4-6d0b-49db-a2ad-54939b74c9a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1339846 May 12 15:52:23.287178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c38c4e83-d916-42b2-ad02-28a024634193 req-6fcea821-7899-4613-984d-d07d80006cff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:23.288849 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c38c4e83-d916-42b2-ad02-28a024634193 req-6fcea821-7899-4613-984d-d07d80006cff service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 1095 time: 0.0835562 May 12 15:52:23.426074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c38c4e83-d916-42b2-ad02-28a024634193 req-9000f268-d9f2-4d0d-8ebb-ef1c5d516c3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:23.427304 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c38c4e83-d916-42b2-ad02-28a024634193 req-9000f268-d9f2-4d0d-8ebb-ef1c5d516c3f service neutron] 10.222.0.76 "GET /v2.0/networks?id=2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 HTTP/1.1" status: 200 len: 898 time: 0.1324210 May 12 15:52:23.502523 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c38c4e83-d916-42b2-ad02-28a024634193 req-200bb732-576d-4031-8887-7fc0c06a4867 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=db644c30-f926-487d-ad60-611aac7e2e42 HTTP/1.1" status: 200 len: 217 time: 0.0679257 May 12 15:52:23.569077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c38c4e83-d916-42b2-ad02-28a024634193 req-29b6a8f6-1e32-45a5-ac97-d7f7d0e588ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:23.570748 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c38c4e83-d916-42b2-ad02-28a024634193 req-29b6a8f6-1e32-45a5-ac97-d7f7d0e588ee service neutron] 10.222.0.76 "GET /v2.0/subnets?id=16a59a2f-5dba-4ee9-a867-07b0ad8d6846 HTTP/1.1" status: 200 len: 835 time: 0.0626786 May 12 15:52:23.648622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c38c4e83-d916-42b2-ad02-28a024634193 req-b2292a2c-b060-48e8-a9da-b3a90e473b71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:23.650184 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c38c4e83-d916-42b2-ad02-28a024634193 req-b2292a2c-b060-48e8-a9da-b3a90e473b71 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=2e6edaa4-6d0b-49db-a2ad-54939b74c9a9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0739262 May 12 15:52:23.796567 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c38c4e83-d916-42b2-ad02-28a024634193 req-55093a07-ddbd-4762-8c34-7cf2fc06b851 service neutron] 10.222.0.76 "GET /v2.0/networks/2e6edaa4-6d0b-49db-a2ad-54939b74c9a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1391165 May 12 15:52:23.897591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ba0eb22b-635a-49a7-b451-bf288678d4dd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:52:23.901083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aafc5a73-3836-4a89-95ff-8eb08e5e7236 req-c2368014-bbe8-4c50-a129-16ce0e33e7bc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:23.903926 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aafc5a73-3836-4a89-95ff-8eb08e5e7236 req-c2368014-bbe8-4c50-a129-16ce0e33e7bc tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 944 time: 0.1090753 May 12 15:52:23.955831 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c38c4e83-d916-42b2-ad02-28a024634193 req-ed7107a1-f601-4397-90d6-677679a94fe1 service neutron] 10.222.0.76 "GET /v2.0/networks/2e6edaa4-6d0b-49db-a2ad-54939b74c9a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1527514 May 12 15:52:23.960499 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aafc5a73-3836-4a89-95ff-8eb08e5e7236 req-4e9391da-8180-426b-a58f-102bf41dd330 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0509558 May 12 15:52:23.979830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ba0eb22b-635a-49a7-b451-bf288678d4dd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:52:23.980196 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:25.166006 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-719017ff-d0e7-4b5e-a08b-bdc36cb017b3 req-58150125-24d8-4fe5-a2c8-d4e8d2cfa832 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:25.171402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-719017ff-d0e7-4b5e-a08b-bdc36cb017b3 req-58150125-24d8-4fe5-a2c8-d4e8d2cfa832 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 944 time: 0.0864570 May 12 15:52:25.216196 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-719017ff-d0e7-4b5e-a08b-bdc36cb017b3 req-d5a74fa6-9d28-4e3a-a116-d04ca06c9dde tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414536 May 12 15:52:26.416729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c499f24-f853-4009-80a0-fbb491cf9dcc req-90aa6423-4545-4745-b097-1b8b2e2ed473 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:26.418046 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c499f24-f853-4009-80a0-fbb491cf9dcc req-90aa6423-4545-4745-b097-1b8b2e2ed473 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 944 time: 0.0904121 May 12 15:52:26.465753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c499f24-f853-4009-80a0-fbb491cf9dcc req-c7b2d734-c705-4007-a979-6ca62a53189d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409763 May 12 15:52:26.801362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device db644c30-f926-487d-ad60-611aac7e2e42 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:52:26.939325 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port db644c30-f926-487d-ad60-611aac7e2e42, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=db644c30-f926-487d-ad60-611aac7e2e42,segment=NetworkSegment(1aa7c9a9-f503-41e5-a120-02f107bdc1af),segment_id=1aa7c9a9-f503-41e5-a120-02f107bdc1af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:52:26.951968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'db644c30-f926-487d-ad60-611aac7e2e42', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'port_id': 'db644c30-f926-487d-ad60-611aac7e2e42', 'mac_address': 'fa:16:3e:31:68:90', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 587, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:52:27.005511 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:27.021369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id db644c30-f926-487d-ad60-611aac7e2e42 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:52:27.036002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port db644c30-f926-487d-ad60-611aac7e2e42, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=db644c30-f926-487d-ad60-611aac7e2e42,segment=NetworkSegment(1aa7c9a9-f503-41e5-a120-02f107bdc1af),segment_id=1aa7c9a9-f503-41e5-a120-02f107bdc1af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:52:27.039833 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:27.136426 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=db644c30-f926-487d-ad60-611aac7e2e42,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:27.239177 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['db644c30-f926-487d-ad60-611aac7e2e42'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:52:27.654083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48d5099-0397-4416-9d24-733f32b37cad req-2aec9fb3-4c57-46e0-9346-e11f8a64955f tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:27.655420 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b48d5099-0397-4416-9d24-733f32b37cad req-2aec9fb3-4c57-46e0-9346-e11f8a64955f tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 945 time: 0.0820513 May 12 15:52:27.699886 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b48d5099-0397-4416-9d24-733f32b37cad req-a2548390-bcab-40b9-b103-b2b4c6b93fe6 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0377293 May 12 15:52:28.817134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device db644c30-f926-487d-ad60-611aac7e2e42 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:52:28.886294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eaae029-7bb7-4138-b6c7-1096b5e0dedf req-1d9b916c-ebfd-45ee-9fce-a56f65f4cc12 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:28.886875 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port db644c30-f926-487d-ad60-611aac7e2e42 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:52:28.887871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3eaae029-7bb7-4138-b6c7-1096b5e0dedf req-1d9b916c-ebfd-45ee-9fce-a56f65f4cc12 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 945 time: 0.0811303 May 12 15:52:28.891641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port db644c30-f926-487d-ad60-611aac7e2e42 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:52:28.892005 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:28.933231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3eaae029-7bb7-4138-b6c7-1096b5e0dedf req-043db59b-02a0-4e49-b97d-f97d56aaf2d1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385144 May 12 15:52:29.009884 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:29.035391 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db644c30-f926-487d-ad60-611aac7e2e42'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:52:29.045266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port db644c30-f926-487d-ad60-611aac7e2e42, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=db644c30-f926-487d-ad60-611aac7e2e42,segment=NetworkSegment(1aa7c9a9-f503-41e5-a120-02f107bdc1af),segment_id=1aa7c9a9-f503-41e5-a120-02f107bdc1af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:52:29.049817 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:29.086047 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1e741607-f4b1-4b21-97f0-08d04ec864e5'] response: {'server_uuid': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db644c30-f926-487d-ad60-611aac7e2e42', 'code': 200} May 12 15:52:29.117521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=db644c30-f926-487d-ad60-611aac7e2e42,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:29.203592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9d0aa3-80d0-4608-8099-d1ed21b2e764 req-71cc0698-9a57-42b3-ac80-949f2c7358b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:29.205036 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b9d0aa3-80d0-4608-8099-d1ed21b2e764 req-71cc0698-9a57-42b3-ac80-949f2c7358b9 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 1097 time: 0.0697806 May 12 15:52:29.252089 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5b9d0aa3-80d0-4608-8099-d1ed21b2e764 req-4afac218-8e69-4315-a3eb-363fdb7eba67 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412481 May 12 15:52:30.121756 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee847e1-6bfc-409a-bed2-1f6ea9cd3cf0 req-12284f3b-0e67-4dd4-a506-c9a8eaad5199 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:30.123719 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fee847e1-6bfc-409a-bed2-1f6ea9cd3cf0 req-12284f3b-0e67-4dd4-a506-c9a8eaad5199 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0857947 May 12 15:52:30.171547 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fee847e1-6bfc-409a-bed2-1f6ea9cd3cf0 req-064689e7-73a5-42f7-8abd-a136c011b98b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414846 May 12 15:52:31.357145 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee72addd-4364-4715-a38b-13cf5eb34e1e req-9d21531b-8abd-4df1-be35-5ab8ffe93727 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:31.358539 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee72addd-4364-4715-a38b-13cf5eb34e1e req-9d21531b-8abd-4df1-be35-5ab8ffe93727 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0799453 May 12 15:52:31.403692 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee72addd-4364-4715-a38b-13cf5eb34e1e req-e255264a-f894-4f53-bb9c-dc57b71468be tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394838 May 12 15:52:31.695770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb2386b2-c9c1-445c-a07f-c4aff2d60705 req-6b792b96-3a2d-4ad9-9056-ad302e850617 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:31.697258 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb2386b2-c9c1-445c-a07f-c4aff2d60705 req-6b792b96-3a2d-4ad9-9056-ad302e850617 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.1883254 May 12 15:52:31.743801 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb2386b2-c9c1-445c-a07f-c4aff2d60705 req-3c75fa8c-d760-4539-a965-b863a2eabc61 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407224 May 12 15:52:31.766616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51180) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:31.949463 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cee2800a-5ab6-46c8-a1f1-7bf91f55e609 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:31.950961 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cee2800a-5ab6-46c8-a1f1-7bf91f55e609 tempest-TestNetworkAdvancedServerOps-220269978 tempest-TestNetworkAdvancedServerOps-220269978-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 1092 time: 0.1833334 May 12 15:52:31.953886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51186) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:31.959019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': 'db644c30-f926-487d-ad60-611aac7e2e42', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address': '172.20.0.10'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:52:31.965728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:52:31.969968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Usage tracker for resource:floatingip and tenant:b88b5989d4c548dba6124f2e4690e5c3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:52:31.973430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:52:31.979001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:52:31.990415 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:32.132615 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:32.277456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Allocated IP 172.25.8.163 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/bf2b11ba-caaf-4951-97cb-1319141623b2) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:52:32.425148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:32.456024 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:32.523590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:52:32.526433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:52:32.529074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:52:32.578737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=bf2b11ba-caaf-4951-97cb-1319141623b2,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:32.660933 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:32.974027 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:33.048283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:33.265277 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:33.271169 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:33.385859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event updated for resources: {'Port': ['ID=bf2b11ba-caaf-4951-97cb-1319141623b2,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:52:33.396729 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:33.692995 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Floating IP 21df8f8a-bb6a-4fbf-a6dc-74729cccd0fc associated. External IP: 172.25.8.163, port: db644c30-f926-487d-ad60-611aac7e2e42. May 12 15:52:34.048045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router d9a32230-fac5-430a-90e6-e9464fa203aa has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:52:34.239172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:52:34.250155 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97856ca9-a97c-40ef-bfa1-945f382b02a4 None None] Sync routers for ids ['d9a32230-fac5-430a-90e6-e9464fa203aa'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:52:34.260014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97856ca9-a97c-40ef-bfa1-945f382b02a4 None None] Routers {'d9a32230-fac5-430a-90e6-e9464fa203aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:52:34.260632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-97856ca9-a97c-40ef-bfa1-945f382b02a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:52:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['d9a32230-fac5-430a-90e6-e9464fa203aa'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:34.265139 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:34.323183 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0026559f-1c77-48b4-837b-17dd2a8b93c4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.3682742 May 12 15:52:34.323754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'tag': 'db644c30-f926-487d-ad60-611aac7e2e42'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:52:34.374134 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-95a0b94f-6ce4-453e-83d1-498794adf467'] response: {'name': 'network-changed', 'server_uuid': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'tag': 'db644c30-f926-487d-ad60-611aac7e2e42', 'status': 'completed', 'code': 200} May 12 15:52:34.469593 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-97856ca9-a97c-40ef-bfa1-945f382b02a4 None None] Set router d9a32230-fac5-430a-90e6-e9464fa203aa gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:52:34.480845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726abd47-7fb3-4795-b47d-59462c1069ad req-32882b77-7f0a-42d8-8748-a009bceecaaf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:34.482374 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-726abd47-7fb3-4795-b47d-59462c1069ad req-32882b77-7f0a-42d8-8748-a009bceecaaf service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 1097 time: 0.0850971 May 12 15:52:34.521069 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d622e59-3f35-4202-bfc5-a167d2619d79 req-6a5898b2-efac-43ba-997c-2c8d254b421f tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:34.522705 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d622e59-3f35-4202-bfc5-a167d2619d79 req-6a5898b2-efac-43ba-997c-2c8d254b421f tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0974290 May 12 15:52:34.578899 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d622e59-3f35-4202-bfc5-a167d2619d79 req-9d5091ef-626b-4533-b585-25da46ea082b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0472636 May 12 15:52:34.604496 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51196) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:34.634229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726abd47-7fb3-4795-b47d-59462c1069ad req-5c080713-499a-46b2-9bf2-945c3451ea75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:34.636770 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-726abd47-7fb3-4795-b47d-59462c1069ad req-5c080713-499a-46b2-9bf2-945c3451ea75 service neutron] 10.222.0.76 "GET /v2.0/networks?id=2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 HTTP/1.1" status: 200 len: 898 time: 0.1475689 May 12 15:52:34.721267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-789db945-a2d4-46ca-a35f-87efde3abc19 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/21df8f8a-bb6a-4fbf-a6dc-74729cccd0fc HTTP/1.1" status: 200 len: 992 time: 0.1152215 May 12 15:52:34.748216 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-726abd47-7fb3-4795-b47d-59462c1069ad req-79adcce6-d68a-4ea8-b84b-f3e3f89f6ada service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=db644c30-f926-487d-ad60-611aac7e2e42 HTTP/1.1" status: 200 len: 1000 time: 0.1055899 May 12 15:52:34.818797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726abd47-7fb3-4795-b47d-59462c1069ad req-279e09a3-e574-41b6-82d5-130ea7347472 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:34.819237 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-726abd47-7fb3-4795-b47d-59462c1069ad req-279e09a3-e574-41b6-82d5-130ea7347472 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=16a59a2f-5dba-4ee9-a867-07b0ad8d6846 HTTP/1.1" status: 200 len: 835 time: 0.0625160 May 12 15:52:34.872413 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-97856ca9-a97c-40ef-bfa1-945f382b02a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:52:15Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '21df8f8a-bb6a-4fbf-a6dc-74729cccd0fc', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'floating_ip_address': '172.25.8.163', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'port_id': 'db644c30-f926-487d-ad60-611aac7e2e42', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4095, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'mac_address': 'fa:16:3e:31:68:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:52:32Z', 'updated_at': '2022-05-12T15:52:32Z', 'revision_number': 0, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ba0eb22b-635a-49a7-b451-bf288678d4dd', 'name': '', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:75:c7:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 4092, 'fixed_ips': [{'subnet_id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:15Z', 'updated_at': '2022-05-12T15:52:22Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:34.876868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97856ca9-a97c-40ef-bfa1-945f382b02a4 None None] Checking router: d9a32230-fac5-430a-90e6-e9464fa203aa for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:52:34.886151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97856ca9-a97c-40ef-bfa1-945f382b02a4 None None] Routers {'d9a32230-fac5-430a-90e6-e9464fa203aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:52:34.887120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-97856ca9-a97c-40ef-bfa1-945f382b02a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:52:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['d9a32230-fac5-430a-90e6-e9464fa203aa'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:34.898478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726abd47-7fb3-4795-b47d-59462c1069ad req-aeca8515-0b06-4a81-bfcf-c8693b8d8a39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:34.898639 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-726abd47-7fb3-4795-b47d-59462c1069ad req-aeca8515-0b06-4a81-bfcf-c8693b8d8a39 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=2e6edaa4-6d0b-49db-a2ad-54939b74c9a9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0741661 May 12 15:52:35.074794 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-97856ca9-a97c-40ef-bfa1-945f382b02a4 None None] Set router d9a32230-fac5-430a-90e6-e9464fa203aa gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:52:35.102950 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-726abd47-7fb3-4795-b47d-59462c1069ad req-2abdbdf0-0751-4281-acff-cc246a362314 service neutron] 10.222.0.76 "GET /v2.0/networks/2e6edaa4-6d0b-49db-a2ad-54939b74c9a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1983263 May 12 15:52:35.131722 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc98c105-1ab8-44ce-b5cc-280ae57c378c req-15868070-a37c-4e1f-9458-d4c3553c8b25 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.1478052 May 12 15:52:35.427117 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-726abd47-7fb3-4795-b47d-59462c1069ad req-14092a62-d77e-4558-8b58-f6378cbf81fd service neutron] 10.222.0.76 "GET /v2.0/networks/2e6edaa4-6d0b-49db-a2ad-54939b74c9a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3170099 May 12 15:52:35.436808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc98c105-1ab8-44ce-b5cc-280ae57c378c req-7c83b562-e3d3-4c10-8c0d-6e71d885dcf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:35.438248 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc98c105-1ab8-44ce-b5cc-280ae57c378c req-7c83b562-e3d3-4c10-8c0d-6e71d885dcf7 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=1151aa532835463f914c578c906281f8&device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 1096 time: 0.1196604 May 12 15:52:35.504724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-97856ca9-a97c-40ef-bfa1-945f382b02a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:52:15Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '21df8f8a-bb6a-4fbf-a6dc-74729cccd0fc', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'floating_ip_address': '172.25.8.163', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'port_id': 'db644c30-f926-487d-ad60-611aac7e2e42', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4095, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'mac_address': 'fa:16:3e:31:68:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:52:32Z', 'updated_at': '2022-05-12T15:52:32Z', 'revision_number': 0, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ba0eb22b-635a-49a7-b451-bf288678d4dd', 'name': '', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:75:c7:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 4092, 'fixed_ips': [{'subnet_id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:15Z', 'updated_at': '2022-05-12T15:52:22Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:52:35.508835 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97856ca9-a97c-40ef-bfa1-945f382b02a4 None None] The sync data for ids ['d9a32230-fac5-430a-90e6-e9464fa203aa'] in n-d-841483-1 is: [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:52:15Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '21df8f8a-bb6a-4fbf-a6dc-74729cccd0fc', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'floating_ip_address': '172.25.8.163', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'port_id': 'db644c30-f926-487d-ad60-611aac7e2e42', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4095, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'mac_address': 'fa:16:3e:31:68:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:52:32Z', 'updated_at': '2022-05-12T15:52:32Z', 'revision_number': 0, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ba0eb22b-635a-49a7-b451-bf288678d4dd', 'name': '', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:75:c7:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 4092, 'fixed_ips': [{'subnet_id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:15Z', 'updated_at': '2022-05-12T15:52:22Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:52:35.594067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc98c105-1ab8-44ce-b5cc-280ae57c378c req-d58da39a-692a-44c4-9933-937143c22b7a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:35.596694 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc98c105-1ab8-44ce-b5cc-280ae57c378c req-d58da39a-692a-44c4-9933-937143c22b7a service neutron] 10.222.0.84 "GET /v2.0/networks?id=b6bf3355-4481-47dd-96cc-1e4a6e5445a3 HTTP/1.1" status: 200 len: 907 time: 0.1327133 May 12 15:52:35.703662 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc98c105-1ab8-44ce-b5cc-280ae57c378c req-ffc036f6-3580-4fc5-ab2d-199cc90dd15d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b HTTP/1.1" status: 200 len: 1001 time: 0.0996060 May 12 15:52:35.716019 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff62ce90-544c-416a-b250-132e68388ef4 None None] New status for floating IP 21df8f8a-bb6a-4fbf-a6dc-74729cccd0fc: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:52:35.723850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51200) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:35.779249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc98c105-1ab8-44ce-b5cc-280ae57c378c req-90b6e7fb-1ebe-4b87-8c0c-6cdacff9fdae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:35.781267 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc98c105-1ab8-44ce-b5cc-280ae57c378c req-90b6e7fb-1ebe-4b87-8c0c-6cdacff9fdae service neutron] 10.222.0.84 "GET /v2.0/subnets?id=a6a2c883-c889-4a5d-b880-b94c7f7dbeff HTTP/1.1" status: 200 len: 845 time: 0.0679917 May 12 15:52:35.837635 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b364fcbe-7810-4828-9484-a6f81037dc12 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/21df8f8a-bb6a-4fbf-a6dc-74729cccd0fc HTTP/1.1" status: 200 len: 992 time: 0.1115088 May 12 15:52:35.869756 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc98c105-1ab8-44ce-b5cc-280ae57c378c req-8c43287b-2909-448c-aa6c-dd3ddca78796 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:52:35.871278 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc98c105-1ab8-44ce-b5cc-280ae57c378c req-8c43287b-2909-448c-aa6c-dd3ddca78796 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=b6bf3355-4481-47dd-96cc-1e4a6e5445a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0841620 May 12 15:52:36.017302 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc98c105-1ab8-44ce-b5cc-280ae57c378c req-eaae193c-7a6b-46a4-af9e-a24030a7490d service neutron] 10.222.0.84 "GET /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1358173 May 12 15:52:36.180556 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dc98c105-1ab8-44ce-b5cc-280ae57c378c req-c85f27d8-586f-4fdc-9f3e-da5509841a9b service neutron] 10.222.0.84 "GET /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1539600 May 12 15:52:36.840547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51204) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:52:36.959918 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9aed8fd7-fe3e-4f4b-a0ec-9f731b470961 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/21df8f8a-bb6a-4fbf-a6dc-74729cccd0fc HTTP/1.1" status: 200 len: 994 time: 0.1182535 May 12 15:52:40.973655 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:52:42.773538 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-732dc461-d9d4-4411-a9fe-841b44f14ecf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:43.426237 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:45.320277 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b036f5ee-a430-4a59-9aeb-de271e889497 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:46.041174 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:46.289749 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:52:47.773666 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:02.660531 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:06.673746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eece272-c2a7-46cf-bc79-16ea35a1b252 req-b8d32dde-8409-45b2-a8f6-ce69cb1cba84 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:06.675470 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0eece272-c2a7-46cf-bc79-16ea35a1b252 req-b8d32dde-8409-45b2-a8f6-ce69cb1cba84 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0808105 May 12 15:53:06.721219 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0eece272-c2a7-46cf-bc79-16ea35a1b252 req-1ad2563e-20a5-44f9-beda-02f19d193999 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397213 May 12 15:53:07.912416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77543b81-87d3-4bd6-92b0-d3fc3f927176 req-b6f67d1a-0a56-48f7-98af-a6aab790571e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:07.913868 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77543b81-87d3-4bd6-92b0-d3fc3f927176 req-b6f67d1a-0a56-48f7-98af-a6aab790571e tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0833995 May 12 15:53:07.957253 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77543b81-87d3-4bd6-92b0-d3fc3f927176 req-b816415b-d0f1-40d3-9937-33d643c51318 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0378077 May 12 15:53:09.136624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca1ef16-bd12-4fb4-ac25-204321cff776 req-34f9472b-41be-4614-8814-e42b808a7236 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:09.138060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ca1ef16-bd12-4fb4-ac25-204321cff776 req-34f9472b-41be-4614-8814-e42b808a7236 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0777934 May 12 15:53:09.181591 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ca1ef16-bd12-4fb4-ac25-204321cff776 req-4c953fdd-ebc9-4c7d-a413-078fead75e12 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0379589 May 12 15:53:10.365748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba591f74-1ade-48cc-89a3-01e069f23d2e req-eea8d85b-6bff-4fd5-b028-436de79d73c0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:10.367305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba591f74-1ade-48cc-89a3-01e069f23d2e req-eea8d85b-6bff-4fd5-b028-436de79d73c0 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0827408 May 12 15:53:10.411294 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba591f74-1ade-48cc-89a3-01e069f23d2e req-084d41c6-9a12-425d-892e-bb5afddeeed5 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0384223 May 12 15:53:11.598026 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d0d1201-35af-43a3-a97a-7db591e92844 req-25918e2e-ea01-49ac-a841-0d590f4e03b9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:11.599431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d0d1201-35af-43a3-a97a-7db591e92844 req-25918e2e-ea01-49ac-a841-0d590f4e03b9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0792716 May 12 15:53:11.647818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d0d1201-35af-43a3-a97a-7db591e92844 req-7a4e6884-fac5-4144-b4e4-004944c0c5c2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427961 May 12 15:53:12.776885 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-adad09d9-8856-4c6f-a22a-6fe92a52d7b2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:12.832885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2090cb0b-0060-4895-804e-389ac98f0c10 req-997e757f-af1a-425e-9452-47712d4a09f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:12.834966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2090cb0b-0060-4895-804e-389ac98f0c10 req-997e757f-af1a-425e-9452-47712d4a09f1 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0799839 May 12 15:53:12.877442 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2090cb0b-0060-4895-804e-389ac98f0c10 req-ad43b978-2476-48ad-8720-a717b5b741ff tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0367908 May 12 15:53:13.439561 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:14.217234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bda9eea-2bee-46f2-861a-a74e1b72eba9 req-9ba87e94-8298-4e93-a554-6eadc2a05ce9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:14.218714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0bda9eea-2bee-46f2-861a-a74e1b72eba9 req-9ba87e94-8298-4e93-a554-6eadc2a05ce9 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0867360 May 12 15:53:14.264736 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0bda9eea-2bee-46f2-861a-a74e1b72eba9 req-55386647-31a6-4909-89db-71bc2bba5ffe tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396481 May 12 15:53:14.311687 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5042534-959b-4eeb-bcd3-56f859d437f8 req-37976324-2b4b-40f4-9130-67b6e7021d59 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0449204 May 12 15:53:14.421443 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5042534-959b-4eeb-bcd3-56f859d437f8 req-9f383ff3-e6ad-4ba9-a85c-f7707fd782f1 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0435224 May 12 15:53:14.465200 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5042534-959b-4eeb-bcd3-56f859d437f8 req-c8cf2fb1-7509-4a74-9463-d3f58351f54c service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0260050 May 12 15:53:14.602840 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5042534-959b-4eeb-bcd3-56f859d437f8 req-dacde8b7-cd26-4655-b62c-c146d4da697a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:14.604268 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5042534-959b-4eeb-bcd3-56f859d437f8 req-dacde8b7-cd26-4655-b62c-c146d4da697a service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1329029 May 12 15:53:15.329364 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c2dadce8-0c8e-430c-928a-74b347670a69 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:15.451930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-573e5bbc-a2a8-486e-b50d-0a091c864c84 req-0de407a6-9732-49fa-bf57-ff507d426d9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:15.453376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-573e5bbc-a2a8-486e-b50d-0a091c864c84 req-0de407a6-9732-49fa-bf57-ff507d426d9d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0790389 May 12 15:53:15.496118 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-573e5bbc-a2a8-486e-b50d-0a091c864c84 req-f803e3e9-2107-4338-a9bb-2acf02d7a262 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0370622 May 12 15:53:16.043677 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:16.292242 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:16.681201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee21900b-05c8-4cf5-a729-4047dca61e3e req-8f2a1773-5673-4679-aa02-2c021351cb0b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:16.682578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee21900b-05c8-4cf5-a729-4047dca61e3e req-8f2a1773-5673-4679-aa02-2c021351cb0b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0819476 May 12 15:53:16.727364 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee21900b-05c8-4cf5-a729-4047dca61e3e req-2150efa1-602e-49dd-a214-2cdff64211d2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389845 May 12 15:53:17.770350 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:17.914265 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28b23f54-6aed-4eb9-aa6f-b65ba06d497c req-de7286e8-dd26-4c7d-9706-c30ba68dee9a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:17.915705 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28b23f54-6aed-4eb9-aa6f-b65ba06d497c req-de7286e8-dd26-4c7d-9706-c30ba68dee9a tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0810316 May 12 15:53:17.959749 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28b23f54-6aed-4eb9-aa6f-b65ba06d497c req-77bfe5bd-b1b2-4bf5-b9c0-4c862c7c0ebb tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0382681 May 12 15:53:17.972636 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:53:19.144924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e955f4a1-eb0e-44d2-baff-d73f81dca23c req-1a227ce4-5700-443d-b169-a24c02d75bb2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:19.146464 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e955f4a1-eb0e-44d2-baff-d73f81dca23c req-1a227ce4-5700-443d-b169-a24c02d75bb2 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0821242 May 12 15:53:19.190571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e955f4a1-eb0e-44d2-baff-d73f81dca23c req-cc7bbabf-51b0-4c9c-9e82-bd0c0d493c8f tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385947 May 12 15:53:20.372169 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5f44c70-6730-4709-9751-f72cd7f74202 req-229fa234-8ccc-4e59-ba31-0a85aeedfe53 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:20.373615 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5f44c70-6730-4709-9751-f72cd7f74202 req-229fa234-8ccc-4e59-ba31-0a85aeedfe53 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0784240 May 12 15:53:20.420638 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d5f44c70-6730-4709-9751-f72cd7f74202 req-28f46127-18a4-411d-8573-8f8331dfe1fa tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414124 May 12 15:53:21.603735 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a838e41-8e5e-4e0d-b0fe-6f4814d66832 req-89de28af-0a10-490d-aabf-16b46e9b6e35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:21.605082 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a838e41-8e5e-4e0d-b0fe-6f4814d66832 req-89de28af-0a10-490d-aabf-16b46e9b6e35 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0791323 May 12 15:53:21.649204 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a838e41-8e5e-4e0d-b0fe-6f4814d66832 req-d0c28e00-176a-4a11-b174-41efe78ae740 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0384722 May 12 15:53:22.948337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd879448-a1a1-41d1-80c8-2254f61d11bc req-d39fb927-25b9-4681-b6bf-42c5f44fcf8d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:22.949700 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd879448-a1a1-41d1-80c8-2254f61d11bc req-d39fb927-25b9-4681-b6bf-42c5f44fcf8d tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.1916811 May 12 15:53:22.992693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd879448-a1a1-41d1-80c8-2254f61d11bc req-21af12e5-b48d-4a85-829c-c774556253f3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0372248 May 12 15:53:24.184017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb8fb06-d6cc-4ea5-81f2-baa099dfbb31 req-b55c77ac-09aa-43e1-9095-9200bbbba410 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:24.185416 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3cb8fb06-d6cc-4ea5-81f2-baa099dfbb31 req-b55c77ac-09aa-43e1-9095-9200bbbba410 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0849698 May 12 15:53:24.241964 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3cb8fb06-d6cc-4ea5-81f2-baa099dfbb31 req-59bd4670-b6d0-4e19-a180-98c81f48d0d4 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0484490 May 12 15:53:25.283624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59e16619-ad14-4aed-91bf-f32b7d057713 req-f0a63436-ab7b-4e85-8346-952efd4db262 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:25.285101 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59e16619-ad14-4aed-91bf-f32b7d057713 req-f0a63436-ab7b-4e85-8346-952efd4db262 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 1097 time: 0.0714898 May 12 15:53:25.326018 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59e16619-ad14-4aed-91bf-f32b7d057713 req-c4654d5f-561f-48b5-98a2-c2d01ae1a31f service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0346189 May 12 15:53:25.419685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a99a0f62-baeb-4514-a1b8-bd629b53d020 req-1bb54c21-cb0a-409a-bb65-d9d4000ebcfd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:25.421113 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a99a0f62-baeb-4514-a1b8-bd629b53d020 req-1bb54c21-cb0a-409a-bb65-d9d4000ebcfd tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0784042 May 12 15:53:25.463840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a99a0f62-baeb-4514-a1b8-bd629b53d020 req-0b9d0f47-7707-4369-9197-7d23e5214f2c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0371721 May 12 15:53:26.655795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-923b2853-09ad-4a8b-99a0-7a14b67d69f4 req-5bf154eb-214a-4934-9f90-749735d40277 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:26.657127 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-923b2853-09ad-4a8b-99a0-7a14b67d69f4 req-5bf154eb-214a-4934-9f90-749735d40277 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.0828922 May 12 15:53:26.702321 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-923b2853-09ad-4a8b-99a0-7a14b67d69f4 req-98ae9a11-5d36-40d0-8877-4d426473eea3 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388110 May 12 15:53:26.725802 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51282) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:53:26.834793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dcb56609-2687-4b81-be12-39f4a6a58f50 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/floatingips/21df8f8a-bb6a-4fbf-a6dc-74729cccd0fc HTTP/1.1" status: 200 len: 994 time: 0.1078892 May 12 15:53:27.129166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device db644c30-f926-487d-ad60-611aac7e2e42 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:53:27.262863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port db644c30-f926-487d-ad60-611aac7e2e42, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=db644c30-f926-487d-ad60-611aac7e2e42,segment=NetworkSegment(1aa7c9a9-f503-41e5-a120-02f107bdc1af),segment_id=1aa7c9a9-f503-41e5-a120-02f107bdc1af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:53:27.275624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'db644c30-f926-487d-ad60-611aac7e2e42', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'port_id': 'db644c30-f926-487d-ad60-611aac7e2e42', 'mac_address': 'fa:16:3e:31:68:90', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 587, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:53:27.329036 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:27.345475 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id db644c30-f926-487d-ad60-611aac7e2e42 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:53:27.361273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port db644c30-f926-487d-ad60-611aac7e2e42, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=db644c30-f926-487d-ad60-611aac7e2e42,segment=NetworkSegment(1aa7c9a9-f503-41e5-a120-02f107bdc1af),segment_id=1aa7c9a9-f503-41e5-a120-02f107bdc1af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:53:27.365519 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:27.436828 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=db644c30-f926-487d-ad60-611aac7e2e42,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:53:27.444432 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:27.444772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:27.445105 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:27.445459 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:27.445787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:27.446107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:27.446426 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:27.446743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:27.447057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:27.447370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:27.447683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:27.447994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:27.586197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['db644c30-f926-487d-ad60-611aac7e2e42'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:53:29.128325 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device db644c30-f926-487d-ad60-611aac7e2e42 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:53:29.198701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port db644c30-f926-487d-ad60-611aac7e2e42 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:53:29.199060 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:29.313018 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:29.339406 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db644c30-f926-487d-ad60-611aac7e2e42'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:53:29.349097 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port db644c30-f926-487d-ad60-611aac7e2e42, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=db644c30-f926-487d-ad60-611aac7e2e42,segment=NetworkSegment(1aa7c9a9-f503-41e5-a120-02f107bdc1af),segment_id=1aa7c9a9-f503-41e5-a120-02f107bdc1af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:53:29.353950 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:29.394589 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b845e8c6-aae3-4f71-a5aa-1c6f30a6b251'] response: {'server_uuid': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db644c30-f926-487d-ad60-611aac7e2e42', 'code': 200} May 12 15:53:29.426125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=db644c30-f926-487d-ad60-611aac7e2e42,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:53:32.660218 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:35.087518 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96ef4082-7cf6-4400-aaaf-3c898426010d req-e0716cd0-caf9-40d1-9030-1021f79cbc66 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0775304 May 12 15:53:35.200879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ef4082-7cf6-4400-aaaf-3c898426010d req-f3b14166-9efa-4607-ac05-899367405b5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:35.202347 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96ef4082-7cf6-4400-aaaf-3c898426010d req-f3b14166-9efa-4607-ac05-899367405b5b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 1096 time: 0.0701246 May 12 15:53:35.350889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ef4082-7cf6-4400-aaaf-3c898426010d req-4089066e-0309-4906-b409-caf611c36d4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:35.352229 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96ef4082-7cf6-4400-aaaf-3c898426010d req-4089066e-0309-4906-b409-caf611c36d4b service neutron] 10.222.0.84 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1254075 May 12 15:53:35.456916 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96ef4082-7cf6-4400-aaaf-3c898426010d req-24d9d0d7-c260-49c5-b6d9-925fdac43257 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=85d9b905-7c16-4604-ae2c-c37c82f5eeec HTTP/1.1" status: 200 len: 1001 time: 0.0952353 May 12 15:53:35.522390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ef4082-7cf6-4400-aaaf-3c898426010d req-b145fb9e-b3f2-48eb-9b21-db0e59774b9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:35.523747 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96ef4082-7cf6-4400-aaaf-3c898426010d req-b145fb9e-b3f2-48eb-9b21-db0e59774b9a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0584342 May 12 15:53:35.699663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ef4082-7cf6-4400-aaaf-3c898426010d req-7d664f93-dc62-4d97-af91-1680ce553777 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:35.701117 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96ef4082-7cf6-4400-aaaf-3c898426010d req-7d664f93-dc62-4d97-af91-1680ce553777 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1686258 May 12 15:53:35.832903 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96ef4082-7cf6-4400-aaaf-3c898426010d req-78714313-5e00-477c-a976-4638c1fc79f6 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1213999 May 12 15:53:35.967698 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-96ef4082-7cf6-4400-aaaf-3c898426010d req-48ff2542-1933-4f5b-a219-4e93e7811390 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1250293 May 12 15:53:42.778625 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-26c62dc4-d608-4c32-8dac-9d2a9f9e5dbe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:43.454614 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:45.321513 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-104eeee2-b81b-4b2b-85a6-78307e507470 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:46.045893 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:46.292807 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:47.772761 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:54.953528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9b8c5ae-78a1-4593-ae62-9f8cccf8bb31 req-75e51ec8-ea17-4b72-885a-598cfa7b8831 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:54.954978 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9b8c5ae-78a1-4593-ae62-9f8cccf8bb31 req-75e51ec8-ea17-4b72-885a-598cfa7b8831 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 945 time: 0.0828104 May 12 15:53:54.971698 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:53:54.999749 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9b8c5ae-78a1-4593-ae62-9f8cccf8bb31 req-5ffbead6-c057-40ea-8b88-344d4f869b50 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391512 May 12 15:53:56.188257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f13c01d-380d-42a7-bb9c-fc0af6d6a815 req-78e16bff-e2d2-47b8-8fcd-7fea886040ad tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:56.189609 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f13c01d-380d-42a7-bb9c-fc0af6d6a815 req-78e16bff-e2d2-47b8-8fcd-7fea886040ad tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 945 time: 0.0815301 May 12 15:53:56.233407 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f13c01d-380d-42a7-bb9c-fc0af6d6a815 req-d5e951e3-ebe7-4178-b5d6-a57fcf54c487 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381069 May 12 15:53:56.900736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-382a7cb4-3429-4521-80a5-b5860590a183 req-a10eb64c-471a-4f1a-8348-6344a812b84b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:56.901557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-382a7cb4-3429-4521-80a5-b5860590a183 req-a10eb64c-471a-4f1a-8348-6344a812b84b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Synchronizing usage tracker for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:53:56.916655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-382a7cb4-3429-4521-80a5-b5860590a183 req-a10eb64c-471a-4f1a-8348-6344a812b84b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Unset dirty status for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:53:56.918097 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-382a7cb4-3429-4521-80a5-b5860590a183 req-a10eb64c-471a-4f1a-8348-6344a812b84b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.84 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 945 time: 0.1009505 May 12 15:53:56.991794 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-382a7cb4-3429-4521-80a5-b5860590a183 req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Deleting port 85d9b905-7c16-4604-ae2c-c37c82f5eeec {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:53:56.992126 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-382a7cb4-3429-4521-80a5-b5860590a183 req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:57.234792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-382a7cb4-3429-4521-80a5-b5860590a183 req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] For port 85d9b905-7c16-4604-ae2c-c37c82f5eeec, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=85d9b905-7c16-4604-ae2c-c37c82f5eeec,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:53:57.235146 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-382a7cb4-3429-4521-80a5-b5860590a183 req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:57.422144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e65a6060-7fb0-49be-9562-df3fdd42a0d7 req-f9f932e4-29e6-43cf-ac7b-80438c225d16 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:53:57.423604 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e65a6060-7fb0-49be-9562-df3fdd42a0d7 req-f9f932e4-29e6-43cf-ac7b-80438c225d16 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 945 time: 0.0801473 May 12 15:53:57.467502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e65a6060-7fb0-49be-9562-df3fdd42a0d7 req-22afb08a-76dc-4b67-baab-0d1e452d169a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382607 May 12 15:53:57.520482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-382a7cb4-3429-4521-80a5-b5860590a183 req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:57.520798 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-382a7cb4-3429-4521-80a5-b5860590a183 req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:57.521082 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-382a7cb4-3429-4521-80a5-b5860590a183 req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Floating IP fcac9fd6-a5ce-480f-8a2c-b0c706cb64ec disassociated. External IP: 172.25.8.110, port: 85d9b905-7c16-4604-ae2c-c37c82f5eeec. May 12 15:53:57.521431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-382a7cb4-3429-4521-80a5-b5860590a183 req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Calling delete_port for 85d9b905-7c16-4604-ae2c-c37c82f5eeec owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:53:57.664460 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-382a7cb4-3429-4521-80a5-b5860590a183 req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:57.713654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event deleted for resources: {'Port': ['ID=85d9b905-7c16-4604-ae2c-c37c82f5eeec,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:53:57.724763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:57.725105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:57.725455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:57.725786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:57.726174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:57.726417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:57.726735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:57.727049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:57.727363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:57.727673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:57.727988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:57.728846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:53:57.906307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-382a7cb4-3429-4521-80a5-b5860590a183 req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Router c4a7b7e0-fe66-4b58-a3e2-7e635585791d has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:53:58.195494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-382a7cb4-3429-4521-80a5-b5860590a183 req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:53:58.207704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-581e9720-9fbc-41c1-b985-1fbe9e474450 None None] Sync routers for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:53:58.222892 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-581e9720-9fbc-41c1-b985-1fbe9e474450 None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:53:58.223508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-581e9720-9fbc-41c1-b985-1fbe9e474450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:53:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:53:58.280167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-382a7cb4-3429-4521-80a5-b5860590a183 req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] No DVR routers for this DVR port 85d9b905-7c16-4604-ae2c-c37c82f5eeec on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:53:58.282874 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-382a7cb4-3429-4521-80a5-b5860590a183 req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:53:58.285812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b004132e-15ad-433d-8b3e-3dbb8e638ab6', 'name': 'network-vif-deleted', 'tag': '85d9b905-7c16-4604-ae2c-c37c82f5eeec'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:53:58.303424 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-382a7cb4-3429-4521-80a5-b5860590a183 req-bfdeac8b-1187-40a6-a684-ffb2fe6294e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.84 "DELETE /v2.0/ports/85d9b905-7c16-4604-ae2c-c37c82f5eeec HTTP/1.1" status: 204 len: 173 time: 1.3765090 May 12 15:53:58.334916 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a7e44d3a-88ac-4d1d-9d62-2257cc7dfb75'] response: {'server_uuid': 'b004132e-15ad-433d-8b3e-3dbb8e638ab6', 'name': 'network-vif-deleted', 'tag': '85d9b905-7c16-4604-ae2c-c37c82f5eeec', 'status': 'completed', 'code': 200} May 12 15:53:58.422961 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-581e9720-9fbc-41c1-b985-1fbe9e474450 None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:53:58.623068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1bfb07ac-5266-4ba5-88b2-ba495c3d812c req-4dd4bf7f-b588-4170-a957-3ae2164c0b89 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=b004132e-15ad-433d-8b3e-3dbb8e638ab6 HTTP/1.1" status: 200 len: 210 time: 0.0483246 May 12 15:53:58.785989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-581e9720-9fbc-41c1-b985-1fbe9e474450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:53:58.789908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-581e9720-9fbc-41c1-b985-1fbe9e474450 None None] Checking router: c4a7b7e0-fe66-4b58-a3e2-7e635585791d for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:53:58.798367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-581e9720-9fbc-41c1-b985-1fbe9e474450 None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:53:58.799035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-581e9720-9fbc-41c1-b985-1fbe9e474450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:53:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:53:58.975125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-581e9720-9fbc-41c1-b985-1fbe9e474450 None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:53:59.285773 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-581e9720-9fbc-41c1-b985-1fbe9e474450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:53:59.290113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-581e9720-9fbc-41c1-b985-1fbe9e474450 None None] The sync data for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 is: [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:53:59.520841 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-853254a5-0fd9-45f2-99f5-289bb4f9c093 None None] New status for floating IP fcac9fd6-a5ce-480f-8a2c-b0c706cb64ec: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:53:59.789978 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 85d9b905-7c16-4604-ae2c-c37c82f5eeec no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:53:59.825367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 85d9b905-7c16-4604-ae2c-c37c82f5eeec {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:53:59.825727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 85d9b905-7c16-4604-ae2c-c37c82f5eeec not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:53:59.915522 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-aa5f19fa-5a08-49e8-905f-397776831a74 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1371785595&fields=id&tenant_id=939000b7f70c4c85a39e52ee93a06ed5 HTTP/1.1" status: 200 len: 267 time: 0.0380316 May 12 15:54:00.063765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-d66c6cca-39df-4942-99be-15a776c2c7e3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:00.065066 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-d66c6cca-39df-4942-99be-15a776c2c7e3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 812 time: 0.1427610 May 12 15:54:00.081085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-52074ea8-bc1c-43f0-9547-5f0abc6ca3d4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/quotas/939000b7f70c4c85a39e52ee93a06ed5 HTTP/1.1" status: 200 len: 375 time: 0.0105479 May 12 15:54:00.165203 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-7adc3455-1cea-4bd7-ace6-6317397de273 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0786984 May 12 15:54:00.311531 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-14d139b6-4e37-47d3-824e-20f07ceff1db service neutron] 10.222.0.82 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1347466 May 12 15:54:00.497663 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-efe44773-6b0d-4c25-8511-ae18965d1b08 service neutron] 10.222.0.82 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1800923 May 12 15:54:00.512973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-516bcbf1-ec29-4631-b600-b6004830605b req-42f51f46-9192-47ad-a324-e7bc49216f10 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:00.514391 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-516bcbf1-ec29-4631-b600-b6004830605b req-42f51f46-9192-47ad-a324-e7bc49216f10 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 945 time: 0.1293936 May 12 15:54:00.559945 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-516bcbf1-ec29-4631-b600-b6004830605b req-65aff23c-148f-418c-a365-2d8b136fc9e7 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/security-groups?id=70ee9218-9856-4d3d-b5da-e401c11c7db5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397453 May 12 15:54:00.874888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22b1343d-5379-444d-91d6-e5cc919c0643 req-9d1fc4bd-ddbc-41b0-bab0-063ca704004b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 210 time: 0.0458078 May 12 15:54:01.812479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5772306-5bb4-443d-b0e6-8e1aeac48198 req-6bc8499d-3e11-4515-a067-83b8384a10d3 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:01.813958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5772306-5bb4-443d-b0e6-8e1aeac48198 req-6bc8499d-3e11-4515-a067-83b8384a10d3 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 945 time: 0.0802317 May 12 15:54:01.858709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5772306-5bb4-443d-b0e6-8e1aeac48198 req-dd7c7e00-606e-4cfc-8fe0-f37290f514fb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/security-groups?id=70ee9218-9856-4d3d-b5da-e401c11c7db5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390329 May 12 15:54:02.027141 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e7a1bac-6fbb-48cb-8aa6-87f9f48b8371 req-e74ef61d-f43d-4040-8f9a-a4fc9a75e608 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 210 time: 0.0466785 May 12 15:54:02.050607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51368) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:02.172683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-4578119c-8287-4656-910f-901b7dad4bc7 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:02.174047 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-4578119c-8287-4656-910f-901b7dad4bc7 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.84 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 945 time: 0.1031356 May 12 15:54:02.262029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Deleting port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:02.262485 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:02.490151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-6d57e58b-0230-43a4-bdc0-20a5beb533d7 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:02.491556 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-6d57e58b-0230-43a4-bdc0-20a5beb533d7 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.84 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 812 time: 0.2769997 May 12 15:54:02.495275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port bf2b11ba-caaf-4951-97cb-1319141623b2 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:02.495616 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:02.520597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] For port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b,segment=NetworkSegment(fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76),segment_id=fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:02.521062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:02.601324 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-aa1955d6-aeac-403a-b99f-0344d5701f4c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=939000b7f70c4c85a39e52ee93a06ed5 HTTP/1.1" status: 200 len: 380 time: 0.0812709 May 12 15:54:02.653344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'port': {'device_id': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'admin_state_up': True, 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'security_groups': ['d3930bee-f9c9-401c-921a-1058f06217af']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:54:02.660142 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:02.817679 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:02.818268 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:02.824130 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:02.824499 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:02.824801 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Floating IP 0ccdedb9-fd11-4353-8664-0287183b82b0 disassociated. External IP: 172.25.8.105, port: e16d3d05-585a-4be8-8c6c-1b6d2aa8467b. May 12 15:54:02.825132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Calling delete_port for e16d3d05-585a-4be8-8c6c-1b6d2aa8467b owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:54:02.961565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for bf2b11ba-caaf-4951-97cb-1319141623b2 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:54:02.975824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:02.996004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:54:03.000579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:port and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:54:03.003760 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:54:03.035865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Pushing event deleted for resources: {'Port': ['ID=e16d3d05-585a-4be8-8c6c-1b6d2aa8467b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:03.067895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:54:03.086138 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-caf12976-6d14-4554-9372-ff2064b020e8 req-798187cd-3154-44c3-8d6d-2276dc33a58b tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 210 time: 0.0785670 May 12 15:54:03.097632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Made reservation on behalf of 939000b7f70c4c85a39e52ee93a06ed5 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:54:03.101091 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:03.247431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:54:03.252756 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4ed1c249-bcf3-4efa-9cb2-3fb4badc7986 req-5c16d1f3-1c5d-409f-9ca7-1533e48e4f87 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 210 time: 0.0644209 May 12 15:54:03.413257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Allocated IP 172.20.0.5 (d13f4c27-5358-4d60-abb1-0c94e69df718/020f79af-22ce-41ca-91a6-931258be2176/5befeada-1d07-4acc-be4a-c0cf3f8b7240) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:54:03.455479 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:03.551629 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=bf2b11ba-caaf-4951-97cb-1319141623b2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:03.568441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:54:03.568787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:54:03.569121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:54:03.569475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:54:03.570531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:54:03.570531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:54:03.570711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:54:03.571032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:54:03.571356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:54:03.571674 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:54:03.572833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:54:03.573652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:54:03.586766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:54:03.597755 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26889349-7b66-419c-9920-fae2adf6fb1c None None] Sync routers for ids ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:54:03.612114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26889349-7b66-419c-9920-fae2adf6fb1c None None] Routers {'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:54:03.613635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-26889349-7b66-419c-9920-fae2adf6fb1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:53:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:03.682555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] No DVR routers for this DVR port e16d3d05-585a-4be8-8c6c-1b6d2aa8467b on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:54:03.685783 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:03.688927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78ab9ae1-0c08-4baf-bd69-47cce23548a7', 'name': 'network-vif-deleted', 'tag': 'e16d3d05-585a-4be8-8c6c-1b6d2aa8467b'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:54:03.708527 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-45ec2711-84dc-49ec-a34e-39ba75cdf6b2 req-38979fbb-d360-44c2-9219-15b87fd14fd6 tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.84 "DELETE /v2.0/ports/e16d3d05-585a-4be8-8c6c-1b6d2aa8467b HTTP/1.1" status: 204 len: 173 time: 1.5289359 May 12 15:54:03.767306 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5e9e49cf-77cf-465f-b5ad-d564aa7b2738'] response: {'server_uuid': '78ab9ae1-0c08-4baf-bd69-47cce23548a7', 'name': 'network-vif-deleted', 'tag': 'e16d3d05-585a-4be8-8c6c-1b6d2aa8467b', 'status': 'completed', 'code': 200} May 12 15:54:03.844061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-26889349-7b66-419c-9920-fae2adf6fb1c None None] Set router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:54:03.897940 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:03.898830 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Floating IP 21df8f8a-bb6a-4fbf-a6dc-74729cccd0fc disassociated (deleted). External IP: 172.25.8.163, port: db644c30-f926-487d-ad60-611aac7e2e42. May 12 15:54:04.164485 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:04.215429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-26889349-7b66-419c-9920-fae2adf6fb1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:51Z', 'revision_number': 4, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'b8ff0404-7287-4829-8582-deec91c98f44', 'name': '', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'tenant_id': '1151aa532835463f914c578c906281f8', 'mac_address': 'fa:16:3e:af:ee:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_interface', 'standard_attr_id': 4018, 'fixed_ips': [{'subnet_id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:50Z', 'updated_at': '2022-05-12T15:48:56Z', 'revision_number': 5, 'project_id': '1151aa532835463f914c578c906281f8', 'subnets': [{'id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:04.219471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26889349-7b66-419c-9920-fae2adf6fb1c None None] Checking router: dd5e48e9-bffc-4a41-8d4c-ca99803fdfad for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:54:04.229666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26889349-7b66-419c-9920-fae2adf6fb1c None None] Routers {'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:54:04.230409 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-26889349-7b66-419c-9920-fae2adf6fb1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:53:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:04.316530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Transition to ACTIVE for port object 5befeada-1d07-4acc-be4a-c0cf3f8b7240 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:54:04.336168 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-815d99fe-52fc-4be8-868b-7e8f11133eca req-942e53ef-6c92-42f2-aa9d-f724313ba8da tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "GET /v2.0/ports?device_id=78ab9ae1-0c08-4baf-bd69-47cce23548a7 HTTP/1.1" status: 200 len: 210 time: 0.0777628 May 12 15:54:04.458959 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-26889349-7b66-419c-9920-fae2adf6fb1c None None] Set router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:54:04.484594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-433665f4-0428-4cba-abff-a5be1fbc5bb0 req-6a0004dc-0e56-4f02-b805-cff93fb0e3f0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 210 time: 0.0576084 May 12 15:54:04.502625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router d9a32230-fac5-430a-90e6-e9464fa203aa has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:54:04.506906 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:04.649138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Network d13f4c27-5358-4d60-abb1-0c94e69df718 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:54:04.654618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:54:04.666148 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:54:04.700755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'Port': ['ID=5befeada-1d07-4acc-be4a-c0cf3f8b7240,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:04.797493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-26889349-7b66-419c-9920-fae2adf6fb1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:51Z', 'revision_number': 4, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'b8ff0404-7287-4829-8582-deec91c98f44', 'name': '', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'tenant_id': '1151aa532835463f914c578c906281f8', 'mac_address': 'fa:16:3e:af:ee:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_interface', 'standard_attr_id': 4018, 'fixed_ips': [{'subnet_id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:50Z', 'updated_at': '2022-05-12T15:48:56Z', 'revision_number': 5, 'project_id': '1151aa532835463f914c578c906281f8', 'subnets': [{'id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:04.801549 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26889349-7b66-419c-9920-fae2adf6fb1c None None] The sync data for ids ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'] in n-d-841483-1 is: [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:48:51Z', 'revision_number': 4, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'b8ff0404-7287-4829-8582-deec91c98f44', 'name': '', 'network_id': 'b6bf3355-4481-47dd-96cc-1e4a6e5445a3', 'tenant_id': '1151aa532835463f914c578c906281f8', 'mac_address': 'fa:16:3e:af:ee:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_interface', 'standard_attr_id': 4018, 'fixed_ips': [{'subnet_id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:50Z', 'updated_at': '2022-05-12T15:48:56Z', 'revision_number': 5, 'project_id': '1151aa532835463f914c578c906281f8', 'subnets': [{'id': 'a6a2c883-c889-4a5d-b880-b94c7f7dbeff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:54:04.815394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:04.816022 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:04.853653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:54:04.859342 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:04.866189 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a33763f8-5bdb-447b-9737-9d1b7d5e0824 None None] Sync routers for ids ['d9a32230-fac5-430a-90e6-e9464fa203aa'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:54:04.879031 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a33763f8-5bdb-447b-9737-9d1b7d5e0824 None None] Routers {'d9a32230-fac5-430a-90e6-e9464fa203aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:54:04.879637 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a33763f8-5bdb-447b-9737-9d1b7d5e0824 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:53:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['d9a32230-fac5-430a-90e6-e9464fa203aa'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:04.899271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-59a9044d-1f70-474d-88a8-50377de3e7de tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2502892 May 12 15:54:04.924172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Request body: {'port': {'device_id': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:54:04.934295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d47b3ee3-9f07-43c8-b28c-167d8e3d2344 None None] Provisioning for port 5befeada-1d07-4acc-be4a-c0cf3f8b7240 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:54:04.940826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d47b3ee3-9f07-43c8-b28c-167d8e3d2344 None None] Provisioning complete for port 5befeada-1d07-4acc-be4a-c0cf3f8b7240 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:54:04.941543 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d47b3ee3-9f07-43c8-b28c-167d8e3d2344 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:04.956157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-23daf0bc-f656-4ded-9bf5-11506f8e7578 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/floatingips/21df8f8a-bb6a-4fbf-a6dc-74729cccd0fc HTTP/1.1" status: 204 len: 168 time: 2.9110043 May 12 15:54:04.959882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'tag': 'db644c30-f926-487d-ad60-611aac7e2e42'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:54:05.053590 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b81391de-2442-4091-8a17-c38a661908a8'] response: {'name': 'network-changed', 'server_uuid': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'tag': 'db644c30-f926-487d-ad60-611aac7e2e42', 'status': 'completed', 'code': 200} May 12 15:54:05.061751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d47b3ee3-9f07-43c8-b28c-167d8e3d2344 None None] Port 5befeada-1d07-4acc-be4a-c0cf3f8b7240 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:54:05.112627 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:05.137606 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-a33763f8-5bdb-447b-9737-9d1b7d5e0824 None None] Set router d9a32230-fac5-430a-90e6-e9464fa203aa gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:54:05.173505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66238ef4-7356-4590-96af-850db95a93a2 req-7b7f8e2d-5ce6-4d2a-9d0b-0bc4e531a182 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:05.174980 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-66238ef4-7356-4590-96af-850db95a93a2 req-7b7f8e2d-5ce6-4d2a-9d0b-0bc4e531a182 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 1097 time: 0.1010578 May 12 15:54:05.188471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d5f473b-2ae6-4754-a1f2-27f731cfaf79 None None] New status for floating IP 0ccdedb9-fd11-4353-8664-0287183b82b0: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:54:05.376612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66238ef4-7356-4590-96af-850db95a93a2 req-9f24b11f-847f-4f4b-bb56-79ae4f6e250b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:05.381592 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-66238ef4-7356-4590-96af-850db95a93a2 req-9f24b11f-847f-4f4b-bb56-79ae4f6e250b service neutron] 10.222.0.76 "GET /v2.0/networks?id=2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 HTTP/1.1" status: 200 len: 898 time: 0.1989634 May 12 15:54:05.498971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51392) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:05.502492 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-66238ef4-7356-4590-96af-850db95a93a2 req-09a267a2-cbf9-4ead-997a-8ca7b2fc3dee service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=db644c30-f926-487d-ad60-611aac7e2e42 HTTP/1.1" status: 200 len: 217 time: 0.1141763 May 12 15:54:05.629945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66238ef4-7356-4590-96af-850db95a93a2 req-cec592d4-370a-48b3-9f18-8d49e35384dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:05.631370 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-66238ef4-7356-4590-96af-850db95a93a2 req-cec592d4-370a-48b3-9f18-8d49e35384dd service neutron] 10.222.0.76 "GET /v2.0/subnets?id=16a59a2f-5dba-4ee9-a867-07b0ad8d6846 HTTP/1.1" status: 200 len: 835 time: 0.0738564 May 12 15:54:05.715699 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a33763f8-5bdb-447b-9737-9d1b7d5e0824 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:52:15Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'ba0eb22b-635a-49a7-b451-bf288678d4dd', 'name': '', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:75:c7:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 4092, 'fixed_ips': [{'subnet_id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:15Z', 'updated_at': '2022-05-12T15:52:22Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:05.720664 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a33763f8-5bdb-447b-9737-9d1b7d5e0824 None None] Checking router: d9a32230-fac5-430a-90e6-e9464fa203aa for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:54:05.731257 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a33763f8-5bdb-447b-9737-9d1b7d5e0824 None None] Routers {'d9a32230-fac5-430a-90e6-e9464fa203aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:54:05.732206 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a33763f8-5bdb-447b-9737-9d1b7d5e0824 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:53:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['d9a32230-fac5-430a-90e6-e9464fa203aa'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:05.777527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-834faa26-cb3b-4d26-bb00-c4b160d2c9cb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Deleting port ade5b4cd-2598-48c4-9497-add06ed7197f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:05.777863 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-834faa26-cb3b-4d26-bb00-c4b160d2c9cb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:05.826283 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e16d3d05-585a-4be8-8c6c-1b6d2aa8467b no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:54:05.874490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: e16d3d05-585a-4be8-8c6c-1b6d2aa8467b {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:54:05.875078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device e16d3d05-585a-4be8-8c6c-1b6d2aa8467b not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:54:05.935330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e3f6e89-9c0e-4253-b263-fc31add69e13 req-7d304ac7-05d3-4f0e-ae15-c5fbd6e893ff tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:05.936136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9e3f6e89-9c0e-4253-b263-fc31add69e13 req-7d304ac7-05d3-4f0e-ae15-c5fbd6e893ff tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:54:05.950092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66238ef4-7356-4590-96af-850db95a93a2 req-7a2f8ff2-cd8b-4089-8db6-7db4008506ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:05.952280 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-66238ef4-7356-4590-96af-850db95a93a2 req-7a2f8ff2-cd8b-4089-8db6-7db4008506ed service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=2e6edaa4-6d0b-49db-a2ad-54939b74c9a9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.3053913 May 12 15:54:05.977223 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9e3f6e89-9c0e-4253-b263-fc31add69e13 req-7d304ac7-05d3-4f0e-ae15-c5fbd6e893ff tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:54:05.979257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e3f6e89-9c0e-4253-b263-fc31add69e13 req-7d304ac7-05d3-4f0e-ae15-c5fbd6e893ff tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.5921421 May 12 15:54:06.049739 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-a33763f8-5bdb-447b-9737-9d1b7d5e0824 None None] Set router d9a32230-fac5-430a-90e6-e9464fa203aa gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:54:06.077032 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-834faa26-cb3b-4d26-bb00-c4b160d2c9cb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:06.078413 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-834faa26-cb3b-4d26-bb00-c4b160d2c9cb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:06.079785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958de0e9-c252-491f-aaf0-087a21b5a7e7 req-facd8b4f-b55a-4019-bfc0-338392eaea17 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:06.080560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-958de0e9-c252-491f-aaf0-087a21b5a7e7 req-facd8b4f-b55a-4019-bfc0-338392eaea17 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Synchronizing usage tracker for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:54:06.109472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5befeada-1d07-4acc-be4a-c0cf3f8b7240 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:54:06.124045 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e3f6e89-9c0e-4253-b263-fc31add69e13 req-04b56d46-bcdc-4d57-ad59-b36e07e17364 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1289051 May 12 15:54:06.125802 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:06.138681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-958de0e9-c252-491f-aaf0-087a21b5a7e7 req-facd8b4f-b55a-4019-bfc0-338392eaea17 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Unset dirty status for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:54:06.140062 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-958de0e9-c252-491f-aaf0-087a21b5a7e7 req-facd8b4f-b55a-4019-bfc0-338392eaea17 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 931 time: 0.4433086 May 12 15:54:06.147617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Transition to ACTIVE for port object 5befeada-1d07-4acc-be4a-c0cf3f8b7240 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:54:06.155571 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:06.221999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-834faa26-cb3b-4d26-bb00-c4b160d2c9cb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Calling delete_port for ade5b4cd-2598-48c4-9497-add06ed7197f owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:54:06.311337 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-66238ef4-7356-4590-96af-850db95a93a2 req-09a76630-9ccd-42be-8a10-69f76f2cc97d service neutron] 10.222.0.76 "GET /v2.0/networks/2e6edaa4-6d0b-49db-a2ad-54939b74c9a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3507316 May 12 15:54:06.336323 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-958de0e9-c252-491f-aaf0-087a21b5a7e7 req-d14074b2-35cc-493b-8055-746e59fa6fd7 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1834495 May 12 15:54:06.352183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Pushing event updated for resources: {'Port': ['ID=5befeada-1d07-4acc-be4a-c0cf3f8b7240,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:06.464371 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a33763f8-5bdb-447b-9737-9d1b7d5e0824 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:52:15Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'ba0eb22b-635a-49a7-b451-bf288678d4dd', 'name': '', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:75:c7:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 4092, 'fixed_ips': [{'subnet_id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:15Z', 'updated_at': '2022-05-12T15:52:22Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:06.468728 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a33763f8-5bdb-447b-9737-9d1b7d5e0824 None None] The sync data for ids ['d9a32230-fac5-430a-90e6-e9464fa203aa'] in n-d-841483-1 is: [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:52:15Z', 'revision_number': 4, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'ba0eb22b-635a-49a7-b451-bf288678d4dd', 'name': '', 'network_id': '2e6edaa4-6d0b-49db-a2ad-54939b74c9a9', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'mac_address': 'fa:16:3e:75:c7:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 4092, 'fixed_ips': [{'subnet_id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:15Z', 'updated_at': '2022-05-12T15:52:22Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'subnets': [{'id': '16a59a2f-5dba-4ee9-a867-07b0ad8d6846', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:54:06.470753 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Attempting to bind port 5befeada-1d07-4acc-be4a-c0cf3f8b7240 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:54:06.471291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Attempting to bind port 5befeada-1d07-4acc-be4a-c0cf3f8b7240 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:54:06.471705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Attempting to bind port 5befeada-1d07-4acc-be4a-c0cf3f8b7240 on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:54:06.476947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Port 5befeada-1d07-4acc-be4a-c0cf3f8b7240 on network d13f4c27-5358-4d60-abb1-0c94e69df718 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:54:06.477475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Attempting to bind port 5befeada-1d07-4acc-be4a-c0cf3f8b7240 on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:54:06.482421 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-66238ef4-7356-4590-96af-850db95a93a2 req-0fc9134c-a795-4815-b0f5-5b54ad20673e service neutron] 10.222.0.76 "GET /v2.0/networks/2e6edaa4-6d0b-49db-a2ad-54939b74c9a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1514244 May 12 15:54:06.483691 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 53, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:54:06.484132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Checking segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:54:06.484613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Bound using segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:54:06.485158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Bound port: 5befeada-1d07-4acc-be4a-c0cf3f8b7240, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:54:06.485628 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:06.595757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] For port 5befeada-1d07-4acc-be4a-c0cf3f8b7240, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:54:06.600207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] For port 5befeada-1d07-4acc-be4a-c0cf3f8b7240, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=5befeada-1d07-4acc-be4a-c0cf3f8b7240,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:54:06.606755 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:06.667428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:06.668028 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:06.669923 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] 10.222.0.84 "PUT /v2.0/ports/5befeada-1d07-4acc-be4a-c0cf3f8b7240 HTTP/1.1" status: 200 len: 1091 time: 1.7497947 May 12 15:54:06.696510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-061eb4c8-f380-4719-bbe6-c6969ca5a7b5 service neutron] Pushing event updated for resources: {'Port': ['ID=5befeada-1d07-4acc-be4a-c0cf3f8b7240,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:06.778765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1cb14be-b687-43f6-8c3d-b20782ad80e2 req-3daee5c4-8e3d-4546-989c-cd8fbe1ba62c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:06.779516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a1cb14be-b687-43f6-8c3d-b20782ad80e2 req-3daee5c4-8e3d-4546-989c-cd8fbe1ba62c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Synchronizing usage tracker for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:54:06.786581 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-834faa26-cb3b-4d26-bb00-c4b160d2c9cb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:06.806316 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69ed8058-21b8-445d-8a0c-e1bb0a8fc877 None None] New status for floating IP 21df8f8a-bb6a-4fbf-a6dc-74729cccd0fc: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:54:06.845139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-834faa26-cb3b-4d26-bb00-c4b160d2c9cb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Pushing event deleted for resources: {'Port': ['ID=ade5b4cd-2598-48c4-9497-add06ed7197f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:06.876838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a1cb14be-b687-43f6-8c3d-b20782ad80e2 req-3daee5c4-8e3d-4546-989c-cd8fbe1ba62c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Unset dirty status for tenant:b88b5989d4c548dba6124f2e4690e5c3 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:54:06.879438 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a1cb14be-b687-43f6-8c3d-b20782ad80e2 req-3daee5c4-8e3d-4546-989c-cd8fbe1ba62c tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.76 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.3677936 May 12 15:54:06.910486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-10ffa0aa-dde2-4d5c-8f8e-4ae51d6d904c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:06.912146 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-10ffa0aa-dde2-4d5c-8f8e-4ae51d6d904c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 1094 time: 0.1658478 May 12 15:54:07.000819 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-14ff082a-6f0e-411d-878b-0ac9c8a18f0a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5befeada-1d07-4acc-be4a-c0cf3f8b7240 HTTP/1.1" status: 200 len: 217 time: 0.0687258 May 12 15:54:07.017849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-a1cb14be-b687-43f6-8c3d-b20782ad80e2 req-3cbd5817-a7f8-4b60-ac22-75127e087c06 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port db644c30-f926-487d-ad60-611aac7e2e42 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:07.018195 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a1cb14be-b687-43f6-8c3d-b20782ad80e2 req-3cbd5817-a7f8-4b60-ac22-75127e087c06 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:07.059654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'tag': '5befeada-1d07-4acc-be4a-c0cf3f8b7240'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:54:07.064166 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-834faa26-cb3b-4d26-bb00-c4b160d2c9cb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:07.075778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-4d11c573-3984-4438-8ee1-9b9b13214512 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:07.077205 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-4d11c573-3984-4438-8ee1-9b9b13214512 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0678542 May 12 15:54:07.120527 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-834faa26-cb3b-4d26-bb00-c4b160d2c9cb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:07.121703 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-834faa26-cb3b-4d26-bb00-c4b160d2c9cb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "DELETE /v2.0/floatingips/0ccdedb9-fd11-4353-8664-0287183b82b0 HTTP/1.1" status: 204 len: 168 time: 1.6216972 May 12 15:54:07.163880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-0861e50d-aade-47e3-86cd-ef29b86605c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:07.165152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-0861e50d-aade-47e3-86cd-ef29b86605c0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0814030 May 12 15:54:07.166761 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0fcb26b1-23fd-415a-934e-a1159912eed5'] response: {'name': 'network-changed', 'server_uuid': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'tag': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'status': 'completed', 'code': 200} May 12 15:54:07.280477 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51410) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:07.346495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-a1cb14be-b687-43f6-8c3d-b20782ad80e2 req-3cbd5817-a7f8-4b60-ac22-75127e087c06 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] For port db644c30-f926-487d-ad60-611aac7e2e42, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=db644c30-f926-487d-ad60-611aac7e2e42,segment=NetworkSegment(1aa7c9a9-f503-41e5-a120-02f107bdc1af),segment_id=1aa7c9a9-f503-41e5-a120-02f107bdc1af)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:07.347063 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a1cb14be-b687-43f6-8c3d-b20782ad80e2 req-3cbd5817-a7f8-4b60-ac22-75127e087c06 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:07.481299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-a1cb14be-b687-43f6-8c3d-b20782ad80e2 req-3cbd5817-a7f8-4b60-ac22-75127e087c06 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for db644c30-f926-487d-ad60-611aac7e2e42 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:54:07.487111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-1117c599-885b-4121-8b20-21cab74ee67c service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2880907 May 12 15:54:07.498741 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2960a1a0-8bb6-4934-8054-f7d6234505bb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:07.628658 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a1cb14be-b687-43f6-8c3d-b20782ad80e2 req-3cbd5817-a7f8-4b60-ac22-75127e087c06 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:07.641047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88789d31-2f4c-4f4c-9d73-602cdfc868bf req-d5a9791e-16ed-443b-b8e2-128422d672c7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:07.642585 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88789d31-2f4c-4f4c-9d73-602cdfc868bf req-d5a9791e-16ed-443b-b8e2-128422d672c7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/ports?device_id=e1c47326-6cb0-4279-8c79-1662de624da2 HTTP/1.1" status: 200 len: 946 time: 0.3610101 May 12 15:54:07.654113 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2960a1a0-8bb6-4934-8054-f7d6234505bb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:07.682263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cbd5817-a7f8-4b60-ac22-75127e087c06 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=db644c30-f926-487d-ad60-611aac7e2e42,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:07.761450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-a1cb14be-b687-43f6-8c3d-b20782ad80e2 req-3cbd5817-a7f8-4b60-ac22-75127e087c06 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] No DVR routers for this DVR port db644c30-f926-487d-ad60-611aac7e2e42 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:54:07.763959 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a1cb14be-b687-43f6-8c3d-b20782ad80e2 req-3cbd5817-a7f8-4b60-ac22-75127e087c06 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:07.766780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'name': 'network-vif-deleted', 'tag': 'db644c30-f926-487d-ad60-611aac7e2e42'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:54:07.770567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-877e22b8-9dc1-45b9-8ce7-7fedbc547a60 req-c82179e8-483b-4cad-b690-04c1f3621d1e service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2728591 May 12 15:54:07.776628 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88789d31-2f4c-4f4c-9d73-602cdfc868bf req-fc212f53-cc98-412f-b88c-ed593939cdd7 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "GET /v2.0/security-groups?id=1714f52e-97da-4eb7-8528-174c68796708&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1265366 May 12 15:54:07.784510 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a1cb14be-b687-43f6-8c3d-b20782ad80e2 req-3cbd5817-a7f8-4b60-ac22-75127e087c06 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.76 "DELETE /v2.0/ports/db644c30-f926-487d-ad60-611aac7e2e42 HTTP/1.1" status: 204 len: 173 time: 0.8975770 May 12 15:54:07.784965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68221250-402d-4e2a-be72-529c33e439fe req-022595aa-8f33-4423-8513-0be4355a96cb tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:07.786434 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-68221250-402d-4e2a-be72-529c33e439fe req-022595aa-8f33-4423-8513-0be4355a96cb tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 943 time: 0.3387978 May 12 15:54:07.848462 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c511f00a-82b0-4f41-8e59-58b1643a699b'] response: {'server_uuid': 'e1c47326-6cb0-4279-8c79-1662de624da2', 'name': 'network-vif-deleted', 'tag': 'db644c30-f926-487d-ad60-611aac7e2e42', 'status': 'completed', 'code': 200} May 12 15:54:07.851597 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-68221250-402d-4e2a-be72-529c33e439fe req-dd378869-e855-41d9-84b8-66ddef99b749 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485399 May 12 15:54:07.861510 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2960a1a0-8bb6-4934-8054-f7d6234505bb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:07.916309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2960a1a0-8bb6-4934-8054-f7d6234505bb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=70ee9218-9856-4d3d-b5da-e401c11c7db5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:07.953366 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2960a1a0-8bb6-4934-8054-f7d6234505bb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:07.954502 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2960a1a0-8bb6-4934-8054-f7d6234505bb tempest-TestServerBasicOps-580366230 tempest-TestServerBasicOps-580366230-project] 10.222.0.82 "DELETE /v2.0/security-groups/70ee9218-9856-4d3d-b5da-e401c11c7db5 HTTP/1.1" status: 204 len: 168 time: 0.6717832 May 12 15:54:07.970973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a136cd58-ea76-46fa-af51-0a48d0ec6e8d req-82b35fa0-ca12-4263-89b3-816a908e4722 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:07.972463 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a136cd58-ea76-46fa-af51-0a48d0ec6e8d req-82b35fa0-ca12-4263-89b3-816a908e4722 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 1094 time: 0.0873430 May 12 15:54:07.998695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51420) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:08.267138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a136cd58-ea76-46fa-af51-0a48d0ec6e8d req-0b27c668-89ec-4c57-b8e1-ad9baeaa0871 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:08.268769 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a136cd58-ea76-46fa-af51-0a48d0ec6e8d req-0b27c668-89ec-4c57-b8e1-ad9baeaa0871 service neutron] 10.222.0.84 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.2892852 May 12 15:54:08.346101 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a136cd58-ea76-46fa-af51-0a48d0ec6e8d req-bf6f9be9-6520-45c7-955f-8ac03a201963 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5befeada-1d07-4acc-be4a-c0cf3f8b7240 HTTP/1.1" status: 200 len: 217 time: 0.0706089 May 12 15:54:08.413037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a136cd58-ea76-46fa-af51-0a48d0ec6e8d req-5d5ba617-94e4-4004-a72d-1372e1f8891b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:08.414575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a136cd58-ea76-46fa-af51-0a48d0ec6e8d req-5d5ba617-94e4-4004-a72d-1372e1f8891b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0620267 May 12 15:54:08.495277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a136cd58-ea76-46fa-af51-0a48d0ec6e8d req-8d59f138-591a-41b9-871c-d53b6df960f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:08.496709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a136cd58-ea76-46fa-af51-0a48d0ec6e8d req-8d59f138-591a-41b9-871c-d53b6df960f8 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0751021 May 12 15:54:08.633721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a136cd58-ea76-46fa-af51-0a48d0ec6e8d req-3c570691-6e40-4353-8bf1-69ec34d48917 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1261256 May 12 15:54:08.778009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a136cd58-ea76-46fa-af51-0a48d0ec6e8d req-cf513092-cca4-4127-b523-89b0268e0892 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1348221 May 12 15:54:08.870666 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e3b2d27-015e-439b-9fb3-fb298be25610 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:08.873551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51430) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:09.223250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-5e3b2d27-015e-439b-9fb3-fb298be25610 admin admin] Deleting port b8ff0404-7287-4829-8582-deec91c98f44 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:09.223581 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e3b2d27-015e-439b-9fb3-fb298be25610 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:09.273889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d4847c-48c0-4648-9186-bd5b58abb7e4 req-363f9a12-0a59-4679-a5dc-672c0ef05543 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:09.275366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5d4847c-48c0-4648-9186-bd5b58abb7e4 req-363f9a12-0a59-4679-a5dc-672c0ef05543 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 943 time: 0.2625904 May 12 15:54:09.371090 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5d4847c-48c0-4648-9186-bd5b58abb7e4 req-a5e3a31a-8e37-4e4f-9467-6f94e385ed74 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0879111 May 12 15:54:09.397235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-5e3b2d27-015e-439b-9fb3-fb298be25610 admin admin] For port b8ff0404-7287-4829-8582-deec91c98f44, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=b8ff0404-7287-4829-8582-deec91c98f44,segment=NetworkSegment(fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76),segment_id=fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:09.397616 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e3b2d27-015e-439b-9fb3-fb298be25610 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:09.525531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-5e3b2d27-015e-439b-9fb3-fb298be25610 admin admin] Calling delete_port for b8ff0404-7287-4829-8582-deec91c98f44 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:54:09.529268 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-681da3d7-6af5-46bf-9967-596192de9326 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:09.862926 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e3b2d27-015e-439b-9fb3-fb298be25610 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:09.908672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e3b2d27-015e-439b-9fb3-fb298be25610 admin admin] Pushing event deleted for resources: {'Port': ['ID=b8ff0404-7287-4829-8582-deec91c98f44,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:10.016252 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-681da3d7-6af5-46bf-9967-596192de9326 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port ba0eb22b-635a-49a7-b451-bf288678d4dd {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:10.016594 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-681da3d7-6af5-46bf-9967-596192de9326 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:10.222852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-681da3d7-6af5-46bf-9967-596192de9326 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] For port ba0eb22b-635a-49a7-b451-bf288678d4dd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ba0eb22b-635a-49a7-b451-bf288678d4dd,segment=NetworkSegment(1aa7c9a9-f503-41e5-a120-02f107bdc1af),segment_id=1aa7c9a9-f503-41e5-a120-02f107bdc1af)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:10.223459 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-681da3d7-6af5-46bf-9967-596192de9326 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:10.312137 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-5e3b2d27-015e-439b-9fb3-fb298be25610 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:10.356122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-681da3d7-6af5-46bf-9967-596192de9326 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for ba0eb22b-635a-49a7-b451-bf288678d4dd owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:54:10.599333 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-681da3d7-6af5-46bf-9967-596192de9326 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:10.651933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-681da3d7-6af5-46bf-9967-596192de9326 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=ba0eb22b-635a-49a7-b451-bf288678d4dd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:10.678620 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5e3b2d27-015e-439b-9fb3-fb298be25610 admin admin] Router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:54:10.703998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5318607-6aae-4298-aafb-59c08408e5d2 req-2fe9b4fb-6685-4aaf-9863-5082d19499e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:10.705524 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5318607-6aae-4298-aafb-59c08408e5d2 req-2fe9b4fb-6685-4aaf-9863-5082d19499e4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 943 time: 0.2223620 May 12 15:54:10.802676 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5318607-6aae-4298-aafb-59c08408e5d2 req-7daefdda-361c-4052-bd40-d797b495856a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0701313 May 12 15:54:10.866754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5e3b2d27-015e-439b-9fb3-fb298be25610 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:54:10.876552 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02bfde5b-f968-4725-92f0-e2f25c2b5433 None None] Sync routers for ids ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:54:10.879944 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-5e3b2d27-015e-439b-9fb3-fb298be25610 admin admin] 10.222.0.82 "PUT /v2.0/routers/dd5e48e9-bffc-4a41-8d4c-ca99803fdfad/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8801610 May 12 15:54:10.883276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51438) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:10.886634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02bfde5b-f968-4725-92f0-e2f25c2b5433 None None] Routers {'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:54:10.887243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-02bfde5b-f968-4725-92f0-e2f25c2b5433 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:53:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:11.068051 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-02bfde5b-f968-4725-92f0-e2f25c2b5433 None None] Set router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:54:11.120465 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-681da3d7-6af5-46bf-9967-596192de9326 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:11.284598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device db644c30-f926-487d-ad60-611aac7e2e42 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:54:11.320958 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:11.332000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: db644c30-f926-487d-ad60-611aac7e2e42 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:54:11.332332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device db644c30-f926-487d-ad60-611aac7e2e42 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:54:11.435053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-02bfde5b-f968-4725-92f0-e2f25c2b5433 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:54:09Z', 'revision_number': 5, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:11.438847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02bfde5b-f968-4725-92f0-e2f25c2b5433 None None] Checking router: dd5e48e9-bffc-4a41-8d4c-ca99803fdfad for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:54:11.447016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02bfde5b-f968-4725-92f0-e2f25c2b5433 None None] Routers {'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:54:11.447591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-02bfde5b-f968-4725-92f0-e2f25c2b5433 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:53:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:11.623491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-02bfde5b-f968-4725-92f0-e2f25c2b5433 None None] Set router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:54:11.647283 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:11.679679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] Deleting port 53058f3d-d8fa-4817-a143-1964a7baa056 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:11.680014 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:11.900583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-681da3d7-6af5-46bf-9967-596192de9326 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Router d9a32230-fac5-430a-90e6-e9464fa203aa has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:54:11.932017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-02bfde5b-f968-4725-92f0-e2f25c2b5433 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:54:09Z', 'revision_number': 5, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:11.937042 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02bfde5b-f968-4725-92f0-e2f25c2b5433 None None] The sync data for ids ['dd5e48e9-bffc-4a41-8d4c-ca99803fdfad'] in n-d-841483-1 is: [{'id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'name': 'tempest-TestServerBasicOps-7749450-router', 'tenant_id': '1151aa532835463f914c578c906281f8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120'}], 'enable_snat': True}, 'gw_port_id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:46Z', 'updated_at': '2022-05-12T15:54:09Z', 'revision_number': 5, 'project_id': '1151aa532835463f914c578c906281f8', 'gw_port': {'id': '53058f3d-d8fa-4817-a143-1964a7baa056', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd5e48e9-bffc-4a41-8d4c-ca99803fdfad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4017, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:47Z', 'updated_at': '2022-05-12T15:48:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:54:12.054987 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] For port 53058f3d-d8fa-4817-a143-1964a7baa056, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=53058f3d-d8fa-4817-a143-1964a7baa056,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:12.055333 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:12.195914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] Calling delete_port for 53058f3d-d8fa-4817-a143-1964a7baa056 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:54:12.369615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-681da3d7-6af5-46bf-9967-596192de9326 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:54:12.378117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0f254d-fdf4-41b5-99f0-b0712be0846c req-43497b6d-1235-4c87-a868-93a69399e378 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:12.379521 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e0f254d-fdf4-41b5-99f0-b0712be0846c req-43497b6d-1235-4c87-a868-93a69399e378 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 943 time: 0.4523940 May 12 15:54:12.382936 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28b737e8-ac6a-4099-abde-502ef7b6769d None None] Sync routers for ids ['d9a32230-fac5-430a-90e6-e9464fa203aa'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:54:12.393021 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28b737e8-ac6a-4099-abde-502ef7b6769d None None] Routers {'d9a32230-fac5-430a-90e6-e9464fa203aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:54:12.393656 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-28b737e8-ac6a-4099-abde-502ef7b6769d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:53:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['d9a32230-fac5-430a-90e6-e9464fa203aa'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:12.409726 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-681da3d7-6af5-46bf-9967-596192de9326 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "PUT /v2.0/routers/d9a32230-fac5-430a-90e6-e9464fa203aa/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5350275 May 12 15:54:12.412416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51444) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:12.448293 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e0f254d-fdf4-41b5-99f0-b0712be0846c req-76f2c722-9ba2-4112-9605-7f2823607986 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0581987 May 12 15:54:12.516371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-f5320587-2fe0-477a-91c6-0e665643520b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting subnet 16a59a2f-5dba-4ee9-a867-07b0ad8d6846 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:54:12.519954 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5320587-2fe0-477a-91c6-0e665643520b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:12.523054 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:12.581897 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5320587-2fe0-477a-91c6-0e665643520b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:12.590035 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-28b737e8-ac6a-4099-abde-502ef7b6769d None None] Set router d9a32230-fac5-430a-90e6-e9464fa203aa gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:54:12.675144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5320587-2fe0-477a-91c6-0e665643520b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:12.755823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] Pushing event deleted for resources: {'Port': ['ID=53058f3d-d8fa-4817-a143-1964a7baa056,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:12.757252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5320587-2fe0-477a-91c6-0e665643520b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:12.786045 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87323fa7-1153-4cde-a0fb-6bacad6a0693 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:12.812534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5320587-2fe0-477a-91c6-0e665643520b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Subnet': ['ID=16a59a2f-5dba-4ee9-a867-07b0ad8d6846,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:12.816386 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5320587-2fe0-477a-91c6-0e665643520b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:12.818891 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:12.825854 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f5320587-2fe0-477a-91c6-0e665643520b tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/subnets/16a59a2f-5dba-4ee9-a867-07b0ad8d6846 HTTP/1.1" status: 204 len: 168 time: 0.4122493 May 12 15:54:12.828124 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46bdf32a-90f2-4406-9eaf-2dfe18342861 None None] Network 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:54:12.830095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51450) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:12.913133 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-28b737e8-ac6a-4099-abde-502ef7b6769d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:54:10Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:12.919242 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28b737e8-ac6a-4099-abde-502ef7b6769d None None] Checking router: d9a32230-fac5-430a-90e6-e9464fa203aa for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:54:12.929526 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28b737e8-ac6a-4099-abde-502ef7b6769d None None] Routers {'d9a32230-fac5-430a-90e6-e9464fa203aa'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:54:12.930688 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-28b737e8-ac6a-4099-abde-502ef7b6769d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:53:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['d9a32230-fac5-430a-90e6-e9464fa203aa'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:13.022561 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.026495 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.039260 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.064006 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.064853 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] Fanout notify agent at l3_agent the message router_deleted on router dd5e48e9-bffc-4a41-8d4c-ca99803fdfad {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:54:13.079298 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.080392 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d9f2f2bb-2b53-4fed-a864-d96845594311 admin admin] 10.222.0.82 "DELETE /v2.0/routers/dd5e48e9-bffc-4a41-8d4c-ca99803fdfad HTTP/1.1" status: 204 len: 168 time: 2.1962147 May 12 15:54:13.082881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51454) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:13.117934 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a30f1281-b424-441f-bc68-d2780b511d4e None None] DHCP port deletion for 2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:54:13.124814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a30f1281-b424-441f-bc68-d2780b511d4e None None] Deleting port 31be8389-bac0-4f0d-871e-a78a1e0a9dda {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:13.125713 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a30f1281-b424-441f-bc68-d2780b511d4e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.147428 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-28b737e8-ac6a-4099-abde-502ef7b6769d None None] Set router d9a32230-fac5-430a-90e6-e9464fa203aa gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:54:13.175700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-8f45c4e5-a81b-4d42-ad8a-305a4d4554c1 admin admin] Deleting subnet a6a2c883-c889-4a5d-b880-b94c7f7dbeff {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:54:13.179977 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f45c4e5-a81b-4d42-ad8a-305a4d4554c1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.248592 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f45c4e5-a81b-4d42-ad8a-305a4d4554c1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.301519 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.321151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Deleting port d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:13.321542 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.365616 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f45c4e5-a81b-4d42-ad8a-305a4d4554c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.444755 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f45c4e5-a81b-4d42-ad8a-305a4d4554c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.504763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f45c4e5-a81b-4d42-ad8a-305a4d4554c1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a6a2c883-c889-4a5d-b880-b94c7f7dbeff,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:13.507917 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8f45c4e5-a81b-4d42-ad8a-305a4d4554c1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.516728 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8f45c4e5-a81b-4d42-ad8a-305a4d4554c1 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/a6a2c883-c889-4a5d-b880-b94c7f7dbeff HTTP/1.1" status: 204 len: 168 time: 0.4328246 May 12 15:54:13.523352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51460) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:13.527212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b15bedb-48c3-4ea6-80f2-11c7daaf9d2c None None] Network b6bf3355-4481-47dd-96cc-1e4a6e5445a3 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:54:13.564189 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-28b737e8-ac6a-4099-abde-502ef7b6769d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:54:10Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:13.568845 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28b737e8-ac6a-4099-abde-502ef7b6769d None None] The sync data for ids ['d9a32230-fac5-430a-90e6-e9464fa203aa'] in n-d-841483-1 is: [{'id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1232538567', 'tenant_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238'}], 'enable_snat': True}, 'gw_port_id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:52:10Z', 'updated_at': '2022-05-12T15:54:10Z', 'revision_number': 5, 'project_id': 'b88b5989d4c548dba6124f2e4690e5c3', 'gw_port': {'id': 'd8489fff-54e6-4b87-b64f-bcaca7fcc6b3', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:3a:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9a32230-fac5-430a-90e6-e9464fa203aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4089, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:52:11Z', 'updated_at': '2022-05-12T15:52:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:54:13.653051 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a30f1281-b424-441f-bc68-d2780b511d4e None None] For port 31be8389-bac0-4f0d-871e-a78a1e0a9dda, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=31be8389-bac0-4f0d-871e-a78a1e0a9dda,segment=NetworkSegment(1aa7c9a9-f503-41e5-a120-02f107bdc1af),segment_id=1aa7c9a9-f503-41e5-a120-02f107bdc1af)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:13.653865 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a30f1281-b424-441f-bc68-d2780b511d4e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.701596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] For port d8489fff-54e6-4b87-b64f-bcaca7fcc6b3, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d8489fff-54e6-4b87-b64f-bcaca7fcc6b3,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:13.702197 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.737368 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.763647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Deleting port 3bba5053-89ea-41a3-a948-079db908d144 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:13.764309 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.784701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a30f1281-b424-441f-bc68-d2780b511d4e None None] Calling delete_port for 31be8389-bac0-4f0d-871e-a78a1e0a9dda owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:54:13.833984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c24271-480c-4ef7-bcf6-3321c92282c8 req-1a924328-55a7-4d17-aed3-6379e233cc0e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:13.835552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52c24271-480c-4ef7-bcf6-3321c92282c8 req-1a924328-55a7-4d17-aed3-6379e233cc0e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 943 time: 0.1497006 May 12 15:54:13.848908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Calling delete_port for d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:54:13.863504 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:13.939658 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52c24271-480c-4ef7-bcf6-3321c92282c8 req-5a90bbb5-665e-425c-810b-81dc7221d886 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0793669 May 12 15:54:13.994956 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a30f1281-b424-441f-bc68-d2780b511d4e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.059291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a30f1281-b424-441f-bc68-d2780b511d4e None None] Pushing event deleted for resources: {'Port': ['ID=31be8389-bac0-4f0d-871e-a78a1e0a9dda,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:14.061428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a30f1281-b424-441f-bc68-d2780b511d4e None None] No DVR routers for this DVR port 31be8389-bac0-4f0d-871e-a78a1e0a9dda on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:54:14.077640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] For port 3bba5053-89ea-41a3-a948-079db908d144, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3bba5053-89ea-41a3-a948-079db908d144,segment=NetworkSegment(fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76),segment_id=fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:14.079162 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.109509 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.112821 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 31be8389-bac0-4f0d-871e-a78a1e0a9dda no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:54:14.163046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50a6760b-572e-47a0-841d-a964075f6bfc None None] DHCP port deletion for b6bf3355-4481-47dd-96cc-1e4a6e5445a3 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:54:14.168808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 31be8389-bac0-4f0d-871e-a78a1e0a9dda {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:54:14.169433 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 31be8389-bac0-4f0d-871e-a78a1e0a9dda not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:54:14.170029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ba0eb22b-635a-49a7-b451-bf288678d4dd no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:54:14.220382 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-50a6760b-572e-47a0-841d-a964075f6bfc None None] Deleting port 3bba5053-89ea-41a3-a948-079db908d144 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:14.221092 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-50a6760b-572e-47a0-841d-a964075f6bfc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.227281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Calling delete_port for 3bba5053-89ea-41a3-a948-079db908d144 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:54:14.244217 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Port': ['ID=d8489fff-54e6-4b87-b64f-bcaca7fcc6b3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:14.317569 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.319310 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: ba0eb22b-635a-49a7-b451-bf288678d4dd {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:54:14.319673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ba0eb22b-635a-49a7-b451-bf288678d4dd not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:54:14.320091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b8ff0404-7287-4829-8582-deec91c98f44 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:54:14.332533 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.362683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: b8ff0404-7287-4829-8582-deec91c98f44 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:54:14.363024 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device b8ff0404-7287-4829-8582-deec91c98f44 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:54:14.363441 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 53058f3d-d8fa-4817-a143-1964a7baa056 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:54:14.376694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Pushing event deleted for resources: {'Port': ['ID=3bba5053-89ea-41a3-a948-079db908d144,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:14.383644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] No DVR routers for this DVR port 3bba5053-89ea-41a3-a948-079db908d144 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:54:14.399583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-50a6760b-572e-47a0-841d-a964075f6bfc None None] The port '3bba5053-89ea-41a3-a948-079db908d144' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:54:14.410303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 53058f3d-d8fa-4817-a143-1964a7baa056 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:54:14.410644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 53058f3d-d8fa-4817-a143-1964a7baa056 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:54:14.512136 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.512514 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.514805 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.538098 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.538653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Fanout notify agent at l3_agent the message router_deleted on router d9a32230-fac5-430a-90e6-e9464fa203aa {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:54:14.538873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b6bf3355-4481-47dd-96cc-1e4a6e5445a3']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:14.554021 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.564332 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-adf40bc8-7608-4954-86c9-ad48371537a8 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/routers/d9a32230-fac5-430a-90e6-e9464fa203aa HTTP/1.1" status: 204 len: 168 time: 1.7238555 May 12 15:54:14.564586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:14.564586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fb6b1f32-c5b7-4b5d-a251-fe5e3ffd5b76') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:14.564732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51468) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:14.568372 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.585423 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.592789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Releasing vlan 562 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:54:14.593121 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: timer() May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: self._notify() May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:54:14.607019 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:54:14.684345 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a107c201-3494-4907-8b0c-d170d01c8941 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.795304 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.800353 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.820786 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a107c201-3494-4907-8b0c-d170d01c8941 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:14.827212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] Pushing event deleted for resources: {'Network': ['ID=b6bf3355-4481-47dd-96cc-1e4a6e5445a3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:14.836252 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-18bca6f6-ae30-421c-a7c6-aa78a1e3bcc7 admin admin] 10.222.0.82 "DELETE /v2.0/networks/b6bf3355-4481-47dd-96cc-1e4a6e5445a3 HTTP/1.1" status: 204 len: 168 time: 1.3089426 May 12 15:54:14.836526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51472) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:14.910964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a107c201-3494-4907-8b0c-d170d01c8941 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2e6edaa4-6d0b-49db-a2ad-54939b74c9a9']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:14.936828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a107c201-3494-4907-8b0c-d170d01c8941 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1aa7c9a9-f503-41e5-a120-02f107bdc1af') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:14.937122 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a107c201-3494-4907-8b0c-d170d01c8941 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1aa7c9a9-f503-41e5-a120-02f107bdc1af') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:14.953223 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a107c201-3494-4907-8b0c-d170d01c8941 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:15.038388 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a107c201-3494-4907-8b0c-d170d01c8941 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:15.050111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a107c201-3494-4907-8b0c-d170d01c8941 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Releasing vlan 587 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:54:15.050498 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a107c201-3494-4907-8b0c-d170d01c8941 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: timer() May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:54:15.065935 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:54:15.183015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75cd0940-ca9d-4138-84b8-fa8e03a7a1e9 req-6b4a9876-55d1-4309-837f-a78eaf42d096 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:15.184722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75cd0940-ca9d-4138-84b8-fa8e03a7a1e9 req-6b4a9876-55d1-4309-837f-a78eaf42d096 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 943 time: 0.0837288 May 12 15:54:15.238778 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75cd0940-ca9d-4138-84b8-fa8e03a7a1e9 req-9214b8a1-5336-4ffe-9bcb-9421bfadae1e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475552 May 12 15:54:15.323873 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3b3ce10b-9bb1-454f-8779-17ff4c18ac7c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:15.341100 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a107c201-3494-4907-8b0c-d170d01c8941 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:15.360804 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a107c201-3494-4907-8b0c-d170d01c8941 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:15.375441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a107c201-3494-4907-8b0c-d170d01c8941 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'Network': ['ID=2e6edaa4-6d0b-49db-a2ad-54939b74c9a9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:15.438282 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a107c201-3494-4907-8b0c-d170d01c8941 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/networks/2e6edaa4-6d0b-49db-a2ad-54939b74c9a9 HTTP/1.1" status: 204 len: 168 time: 0.8794200 May 12 15:54:15.440950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51478) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:15.510649 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9106f81d-a2bb-4f6e-8ba9-b07d3fe20883 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:15.540278 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9106f81d-a2bb-4f6e-8ba9-b07d3fe20883 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:15.606594 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9106f81d-a2bb-4f6e-8ba9-b07d3fe20883 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:15.624239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9106f81d-a2bb-4f6e-8ba9-b07d3fe20883 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1714f52e-97da-4eb7-8528-174c68796708,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:15.637625 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9106f81d-a2bb-4f6e-8ba9-b07d3fe20883 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:15.641786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9106f81d-a2bb-4f6e-8ba9-b07d3fe20883 tempest-TestNetworkAdvancedServerOps-1890173908 tempest-TestNetworkAdvancedServerOps-1890173908-project] 10.222.0.82 "DELETE /v2.0/security-groups/1714f52e-97da-4eb7-8528-174c68796708 HTTP/1.1" status: 204 len: 168 time: 0.1997902 May 12 15:54:15.678441 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19df2aef-833e-4cf6-94c6-3a49cc7c42ff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:15.900540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51488) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:15.902962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 5befeada-1d07-4acc-be4a-c0cf3f8b7240 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:54:15.988515 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3bba5053-89ea-41a3-a948-079db908d144 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:54:16.035402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 3bba5053-89ea-41a3-a948-079db908d144 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:54:16.035958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3bba5053-89ea-41a3-a948-079db908d144 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:54:16.036382 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:54:16.056933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-19df2aef-833e-4cf6-94c6-3a49cc7c42ff admin admin] Deleting port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:16.057500 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19df2aef-833e-4cf6-94c6-3a49cc7c42ff admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.088938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:54:16.089539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d8489fff-54e6-4b87-b64f-bcaca7fcc6b3 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:54:16.095076 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.102301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9a71a330-aa7a-453d-958f-299669a4a224 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b88b5989d4c548dba6124f2e4690e5c3&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1994026 May 12 15:54:16.105268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51494) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:16.136746 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 5befeada-1d07-4acc-be4a-c0cf3f8b7240, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=5befeada-1d07-4acc-be4a-c0cf3f8b7240,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:16.151133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'port_id': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'mac_address': 'fa:16:3e:e5:b4:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 566, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:54:16.172420 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e6e0d85b-da53-464e-9f18-638bfc75a14f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.201595 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e6e0d85b-da53-464e-9f18-638bfc75a14f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.209812 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.231275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5befeada-1d07-4acc-be4a-c0cf3f8b7240 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:54:16.247699 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-19df2aef-833e-4cf6-94c6-3a49cc7c42ff admin admin] For port 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0,segment=NetworkSegment(323fc110-5525-47d9-b44e-a0080f2b820d),segment_id=323fc110-5525-47d9-b44e-a0080f2b820d)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:16.248144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19df2aef-833e-4cf6-94c6-3a49cc7c42ff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.252133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 5befeada-1d07-4acc-be4a-c0cf3f8b7240, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=5befeada-1d07-4acc-be4a-c0cf3f8b7240,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:16.258397 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.273770 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e6e0d85b-da53-464e-9f18-638bfc75a14f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.296056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6e0d85b-da53-464e-9f18-638bfc75a14f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08663c65-52e4-493a-a1c9-3be0a47695bd,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:16.306698 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e6e0d85b-da53-464e-9f18-638bfc75a14f admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.308841 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e6e0d85b-da53-464e-9f18-638bfc75a14f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/08663c65-52e4-493a-a1c9-3be0a47695bd HTTP/1.1" status: 204 len: 168 time: 0.2025211 May 12 15:54:16.373198 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.387399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=5befeada-1d07-4acc-be4a-c0cf3f8b7240,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:16.430468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-19df2aef-833e-4cf6-94c6-3a49cc7c42ff admin admin] Calling delete_port for 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:54:16.489215 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5c0b3cf-9533-4c09-a89d-31acbef12b4d req-09f9fcfe-fc8a-4816-b67d-eb785ffed245 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:16.490951 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5c0b3cf-9533-4c09-a89d-31acbef12b4d req-09f9fcfe-fc8a-4816-b67d-eb785ffed245 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 944 time: 0.0897682 May 12 15:54:16.540274 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5c0b3cf-9533-4c09-a89d-31acbef12b4d req-396a3ed1-b417-4511-8c3a-37a365917406 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434217 May 12 15:54:16.596288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['5befeada-1d07-4acc-be4a-c0cf3f8b7240'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:54:16.627334 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19df2aef-833e-4cf6-94c6-3a49cc7c42ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.678410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51506) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:16.682708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19df2aef-833e-4cf6-94c6-3a49cc7c42ff admin admin] Pushing event deleted for resources: {'Port': ['ID=4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:16.749610 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5fa53d3d-1b87-4f1e-bbe5-39fbc2c9a3ff admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c4f01cc8269a4c928114504c61053540&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0677745 May 12 15:54:16.750192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51510) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:16.814126 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-600fb079-ad15-43ad-b170-49e099090726 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.842310 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-600fb079-ad15-43ad-b170-49e099090726 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.899560 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-600fb079-ad15-43ad-b170-49e099090726 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.916796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-600fb079-ad15-43ad-b170-49e099090726 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbf45695-ee3f-4b73-8ad9-5c06dc2b7bbf,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:16.933210 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-600fb079-ad15-43ad-b170-49e099090726 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:16.937661 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-600fb079-ad15-43ad-b170-49e099090726 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/dbf45695-ee3f-4b73-8ad9-5c06dc2b7bbf HTTP/1.1" status: 204 len: 168 time: 0.1829813 May 12 15:54:17.100875 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19df2aef-833e-4cf6-94c6-3a49cc7c42ff admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:17.485551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-19df2aef-833e-4cf6-94c6-3a49cc7c42ff admin admin] Router c9ffb090-c018-46fd-a6c1-d125c7c07e18 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:54:17.677911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-19df2aef-833e-4cf6-94c6-3a49cc7c42ff admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:54:17.688120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8653ec18-c37b-4bf2-bd3a-5a071d280c2c None None] Sync routers for ids ['c9ffb090-c018-46fd-a6c1-d125c7c07e18'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:54:17.689902 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-19df2aef-833e-4cf6-94c6-3a49cc7c42ff admin admin] 10.222.0.82 "PUT /v2.0/routers/c9ffb090-c018-46fd-a6c1-d125c7c07e18/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8523543 May 12 15:54:17.690720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51518) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:17.700451 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8653ec18-c37b-4bf2-bd3a-5a071d280c2c None None] Routers {'c9ffb090-c018-46fd-a6c1-d125c7c07e18'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:54:17.701081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8653ec18-c37b-4bf2-bd3a-5a071d280c2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:54:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c9ffb090-c018-46fd-a6c1-d125c7c07e18'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:17.747220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-094fb038-0fd3-4a34-a4b9-01531de50697 req-6f7a38d9-a632-4946-9a79-24cb29617822 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:17.748933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-094fb038-0fd3-4a34-a4b9-01531de50697 req-6f7a38d9-a632-4946-9a79-24cb29617822 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 944 time: 0.0905724 May 12 15:54:17.794994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-094fb038-0fd3-4a34-a4b9-01531de50697 req-5588ca64-1ba6-42c6-99d5-1f93eb8a935c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403135 May 12 15:54:17.801318 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:17.880414 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:17.914444 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8653ec18-c37b-4bf2-bd3a-5a071d280c2c None None] Set router c9ffb090-c018-46fd-a6c1-d125c7c07e18 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:54:18.014803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 5befeada-1d07-4acc-be4a-c0cf3f8b7240 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:54:18.061181 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:18.070727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] Deleting port ae759da5-88a0-4fab-a684-7cbbd3c4318a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:18.071233 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:18.245977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] For port ae759da5-88a0-4fab-a684-7cbbd3c4318a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ae759da5-88a0-4fab-a684-7cbbd3c4318a,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:18.247005 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:18.266824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 5befeada-1d07-4acc-be4a-c0cf3f8b7240 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:54:18.276785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 5befeada-1d07-4acc-be4a-c0cf3f8b7240 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:54:18.277158 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:18.375370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] Calling delete_port for ae759da5-88a0-4fab-a684-7cbbd3c4318a owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:54:18.391791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8653ec18-c37b-4bf2-bd3a-5a071d280c2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'name': 'tempest-TestServerBasicOps-1422217319-router', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.200'}], 'enable_snat': True}, 'gw_port_id': 'ae759da5-88a0-4fab-a684-7cbbd3c4318a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:54Z', 'updated_at': '2022-05-12T15:54:16Z', 'revision_number': 5, 'project_id': '7693fc7953154378987fe7c2935363e5', 'gw_port': {'id': 'ae759da5-88a0-4fab-a684-7cbbd3c4318a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:33:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4029, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:55Z', 'updated_at': '2022-05-12T15:49:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:18.409833 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8653ec18-c37b-4bf2-bd3a-5a071d280c2c None None] Checking router: c9ffb090-c018-46fd-a6c1-d125c7c07e18 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:54:18.426385 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:18.436323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8653ec18-c37b-4bf2-bd3a-5a071d280c2c None None] Routers {'c9ffb090-c018-46fd-a6c1-d125c7c07e18'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:54:18.436953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8653ec18-c37b-4bf2-bd3a-5a071d280c2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:54:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c9ffb090-c018-46fd-a6c1-d125c7c07e18'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:18.584546 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5befeada-1d07-4acc-be4a-c0cf3f8b7240'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:54:18.599954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 5befeada-1d07-4acc-be4a-c0cf3f8b7240, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=5befeada-1d07-4acc-be4a-c0cf3f8b7240,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:18.608655 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:18.648383 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-13adc1ce-b6e0-4744-9f5d-62a310378eb1'] response: {'server_uuid': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'code': 200} May 12 15:54:18.661941 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8653ec18-c37b-4bf2-bd3a-5a071d280c2c None None] Set router c9ffb090-c018-46fd-a6c1-d125c7c07e18 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:54:18.670201 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:18.717797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] Pushing event deleted for resources: {'Port': ['ID=ae759da5-88a0-4fab-a684-7cbbd3c4318a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:18.796590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8653ec18-c37b-4bf2-bd3a-5a071d280c2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'name': 'tempest-TestServerBasicOps-1422217319-router', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:54Z', 'updated_at': '2022-05-12T15:54:18Z', 'revision_number': 6, 'project_id': '7693fc7953154378987fe7c2935363e5', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:18.811112 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8653ec18-c37b-4bf2-bd3a-5a071d280c2c None None] The sync data for ids ['c9ffb090-c018-46fd-a6c1-d125c7c07e18'] in n-d-841483-1 is: [{'id': 'c9ffb090-c018-46fd-a6c1-d125c7c07e18', 'name': 'tempest-TestServerBasicOps-1422217319-router', 'tenant_id': '7693fc7953154378987fe7c2935363e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:54Z', 'updated_at': '2022-05-12T15:54:18Z', 'revision_number': 6, 'project_id': '7693fc7953154378987fe7c2935363e5', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:54:18.815841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=5befeada-1d07-4acc-be4a-c0cf3f8b7240,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:18.816296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:18.822456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41477024-aa73-4326-a9e7-7cf796e43edc req-8a817d16-f908-4de0-9f57-40ad1b2136e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:18.827642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41477024-aa73-4326-a9e7-7cf796e43edc req-8a817d16-f908-4de0-9f57-40ad1b2136e0 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 1096 time: 0.0891271 May 12 15:54:18.883027 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41477024-aa73-4326-a9e7-7cf796e43edc req-acb67fed-cdec-4444-9c6f-9a06073a1849 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444787 May 12 15:54:18.991761 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:18.994650 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:18.998861 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc33ec6c-ae51-4d2a-a67f-a2ea17995eaf req-1659d956-4116-4f23-96ec-ba091712d7c2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:19.000347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc33ec6c-ae51-4d2a-a67f-a2ea17995eaf req-1659d956-4116-4f23-96ec-ba091712d7c2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 945 time: 0.0839446 May 12 15:54:19.017189 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:19.017703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] Fanout notify agent at l3_agent the message router_deleted on router c9ffb090-c018-46fd-a6c1-d125c7c07e18 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:54:19.029657 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:19.030759 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f5793a96-9d4d-430f-8d70-b6338f97093f admin admin] 10.222.0.82 "DELETE /v2.0/routers/c9ffb090-c018-46fd-a6c1-d125c7c07e18 HTTP/1.1" status: 204 len: 168 time: 1.3390753 May 12 15:54:19.033300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51532) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:19.049157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc33ec6c-ae51-4d2a-a67f-a2ea17995eaf req-bc738230-842a-4b62-a377-94edd6f9061c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424309 May 12 15:54:19.093553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-bbd744a0-f2e9-469b-b783-03eee573cc6e admin admin] Deleting subnet 4eed5e42-a620-43a1-98e4-71cecbfe4f0e {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:54:19.096372 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbd744a0-f2e9-469b-b783-03eee573cc6e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:19.159741 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbd744a0-f2e9-469b-b783-03eee573cc6e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:19.242276 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbd744a0-f2e9-469b-b783-03eee573cc6e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:19.310775 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbd744a0-f2e9-469b-b783-03eee573cc6e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:19.351299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbd744a0-f2e9-469b-b783-03eee573cc6e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4eed5e42-a620-43a1-98e4-71cecbfe4f0e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:19.354696 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bbd744a0-f2e9-469b-b783-03eee573cc6e admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:19.360347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c385856-3526-4d4c-827e-d1b783f98640 None None] Network 771e7061-f52a-45e5-8c9e-e38333bdca6c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:54:19.360665 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bbd744a0-f2e9-469b-b783-03eee573cc6e admin admin] 10.222.0.82 "DELETE /v2.0/subnets/4eed5e42-a620-43a1-98e4-71cecbfe4f0e HTTP/1.1" status: 204 len: 168 time: 0.3263791 May 12 15:54:19.363109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51536) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:19.468286 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:19.478404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Deleting port 0a7ed4d2-89c0-463f-8771-03a1168de92a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:19.478726 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:19.628984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b923dfe2-c614-4d49-9042-705bb6f1d763 None None] DHCP port deletion for 771e7061-f52a-45e5-8c9e-e38333bdca6c request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:54:19.633266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b923dfe2-c614-4d49-9042-705bb6f1d763 None None] Deleting port 0a7ed4d2-89c0-463f-8771-03a1168de92a {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:19.633737 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b923dfe2-c614-4d49-9042-705bb6f1d763 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:19.692365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] For port 0a7ed4d2-89c0-463f-8771-03a1168de92a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0a7ed4d2-89c0-463f-8771-03a1168de92a,segment=NetworkSegment(323fc110-5525-47d9-b44e-a0080f2b820d),segment_id=323fc110-5525-47d9-b44e-a0080f2b820d)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:19.692882 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:19.821664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Calling delete_port for 0a7ed4d2-89c0-463f-8771-03a1168de92a owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:54:19.849739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b923dfe2-c614-4d49-9042-705bb6f1d763 None None] For port 0a7ed4d2-89c0-463f-8771-03a1168de92a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0a7ed4d2-89c0-463f-8771-03a1168de92a,segment=NetworkSegment(323fc110-5525-47d9-b44e-a0080f2b820d),segment_id=323fc110-5525-47d9-b44e-a0080f2b820d)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:54:19.850257 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b923dfe2-c614-4d49-9042-705bb6f1d763 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:19.917058 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:19.969588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Pushing event deleted for resources: {'Port': ['ID=0a7ed4d2-89c0-463f-8771-03a1168de92a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:19.971360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] No DVR routers for this DVR port 0a7ed4d2-89c0-463f-8771-03a1168de92a on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:54:19.980847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:54:20.013723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b923dfe2-c614-4d49-9042-705bb6f1d763 None None] Calling delete_port for 0a7ed4d2-89c0-463f-8771-03a1168de92a owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:54:20.090159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:54:20.090442 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:20.090582 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4a7eb7bd-df3e-460f-b0e5-8dd7afed35f0 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:54:20.090893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0a7ed4d2-89c0-463f-8771-03a1168de92a no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:54:20.128851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['771e7061-f52a-45e5-8c9e-e38333bdca6c']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'provisioningblocks' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 15:54:20.136815 n-d-841483-1 neutron-server[88153]: util.warn( May 12 15:54:20.140501 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-b923dfe2-c614-4d49-9042-705bb6f1d763 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:54:20.140863 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-b923dfe2-c614-4d49-9042-705bb6f1d763 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:54:20.149175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 0a7ed4d2-89c0-463f-8771-03a1168de92a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:54:20.149545 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0a7ed4d2-89c0-463f-8771-03a1168de92a not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:54:20.149991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ae759da5-88a0-4fab-a684-7cbbd3c4318a no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:54:20.153780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '323fc110-5525-47d9-b44e-a0080f2b820d') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:20.154245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '323fc110-5525-47d9-b44e-a0080f2b820d') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:20.169261 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:20.188081 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:20.197571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Releasing vlan 598 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:54:20.198035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: timer() May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:54:20.214483 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:54:20.259178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: ae759da5-88a0-4fab-a684-7cbbd3c4318a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:54:20.259661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ae759da5-88a0-4fab-a684-7cbbd3c4318a not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:54:20.275450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7740a90-3f77-497c-a71a-383aac414297 req-d00bdb05-3033-447c-a5e9-faaf172fde2a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:20.276922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f7740a90-3f77-497c-a71a-383aac414297 req-d00bdb05-3033-447c-a5e9-faaf172fde2a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 945 time: 0.0880322 May 12 15:54:20.296980 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:20.314006 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:20.328588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] Pushing event deleted for resources: {'Network': ['ID=771e7061-f52a-45e5-8c9e-e38333bdca6c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:20.333645 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f7740a90-3f77-497c-a71a-383aac414297 req-3cb3069f-eb1c-4cb0-9857-7a9914715471 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0498610 May 12 15:54:20.334016 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b7a79148-b380-4a53-ba17-e4d678dc3c5f admin admin] 10.222.0.82 "DELETE /v2.0/networks/771e7061-f52a-45e5-8c9e-e38333bdca6c HTTP/1.1" status: 204 len: 168 time: 0.9687355 May 12 15:54:20.521949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e2125b-4e73-4217-a073-6c3b61d79d3b req-98da58f6-027a-4884-9aba-372fc9e05472 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:20.523563 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e8e2125b-4e73-4217-a073-6c3b61d79d3b req-98da58f6-027a-4884-9aba-372fc9e05472 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 945 time: 0.0835555 May 12 15:54:20.534325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51546) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:20.569497 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e8e2125b-4e73-4217-a073-6c3b61d79d3b req-2945bf70-1973-472a-80d9-ff90bb6b194f tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402360 May 12 15:54:20.594377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51550) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:20.641936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b923dfe2-c614-4d49-9042-705bb6f1d763 None None] Deleting port 0a7ed4d2-89c0-463f-8771-03a1168de92a {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:54:20.642314 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b923dfe2-c614-4d49-9042-705bb6f1d763 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:20.693618 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-aef3a5ec-0a6c-4569-8020-eea24aa5ce38 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1151aa532835463f914c578c906281f8&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1579614 May 12 15:54:20.696099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51556) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:20.710522 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b923dfe2-c614-4d49-9042-705bb6f1d763 None None] The port '0a7ed4d2-89c0-463f-8771-03a1168de92a' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:54:20.764554 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ea837933-67ba-478e-a5bf-8e746d00b357 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:20.791290 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ea837933-67ba-478e-a5bf-8e746d00b357 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:20.843833 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ea837933-67ba-478e-a5bf-8e746d00b357 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:20.895353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea837933-67ba-478e-a5bf-8e746d00b357 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a63d8a4-d8af-4d35-8e6b-53491117dcd0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:20.908344 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ea837933-67ba-478e-a5bf-8e746d00b357 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:20.909451 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ea837933-67ba-478e-a5bf-8e746d00b357 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1a63d8a4-d8af-4d35-8e6b-53491117dcd0 HTTP/1.1" status: 204 len: 168 time: 0.2123051 May 12 15:54:20.942960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b58e4a8f-2193-47f3-ba29-cd29fc379f16 tempest-TestVolumeBootPattern-545659823 tempest-TestVolumeBootPattern-545659823-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:20.944785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b58e4a8f-2193-47f3-ba29-cd29fc379f16 tempest-TestVolumeBootPattern-545659823 tempest-TestVolumeBootPattern-545659823-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 1091 time: 0.3490362 May 12 15:54:20.947278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51562) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:20.952110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address': '172.20.0.5'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:54:20.958557 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:54:20.962697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:floatingip and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:54:20.965702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:54:20.971341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:54:20.982140 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:21.121133 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:21.257461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51568) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:21.273846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Allocated IP 172.25.8.104 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/52e69b14-0f26-40de-93df-9d1478bc6f11) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:54:21.309623 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-20be3de3-bf69-47e9-9f37-b57a0755f313 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7693fc7953154378987fe7c2935363e5&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0507050 May 12 15:54:21.312186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51572) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:54:21.370734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f702f634-621f-4ab2-971b-5c5e1ff1f202 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:21.396528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f702f634-621f-4ab2-971b-5c5e1ff1f202 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:21.421936 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:21.450261 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f702f634-621f-4ab2-971b-5c5e1ff1f202 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:21.452679 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:21.467779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f702f634-621f-4ab2-971b-5c5e1ff1f202 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6305eafc-58f4-49dd-a900-1b7d2407b069,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:21.474819 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f702f634-621f-4ab2-971b-5c5e1ff1f202 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:21.478330 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f702f634-621f-4ab2-971b-5c5e1ff1f202 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6305eafc-58f4-49dd-a900-1b7d2407b069 HTTP/1.1" status: 204 len: 168 time: 0.1628332 May 12 15:54:21.518698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:54:21.521519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:54:21.525113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:54:21.568844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'Port': ['ID=52e69b14-0f26-40de-93df-9d1478bc6f11,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:22.091925 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:22.167779 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:22.372649 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:22.376988 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:22.486977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'Port': ['ID=52e69b14-0f26-40de-93df-9d1478bc6f11,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:54:22.499796 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:22.669037 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Floating IP cae4026b-c341-42a2-96e8-3593ebcd953e associated. External IP: 172.25.8.104, port: 5befeada-1d07-4acc-be4a-c0cf3f8b7240. May 12 15:54:23.018450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Router c4a7b7e0-fe66-4b58-a3e2-7e635585791d has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:54:23.199195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:54:23.208996 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ed948e5-b865-4ecc-a93c-efb52dc8672e None None] Sync routers for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:54:23.218524 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ed948e5-b865-4ecc-a93c-efb52dc8672e None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:54:23.219211 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9ed948e5-b865-4ecc-a93c-efb52dc8672e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:54:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:23.224526 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:23.283063 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8d29bf4f-012f-4cd5-b48c-f4c93a68a4da tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.3325539 May 12 15:54:23.283063 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'tag': '5befeada-1d07-4acc-be4a-c0cf3f8b7240'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:54:23.330310 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6a181cc6-7b38-4afc-b113-f39d33f122c4'] response: {'name': 'network-changed', 'server_uuid': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'tag': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'status': 'completed', 'code': 200} May 12 15:54:23.403759 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-9ed948e5-b865-4ecc-a93c-efb52dc8672e None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:54:23.570898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32e957f7-2cb4-4860-99a0-2657fcdaf3f5 req-6d636ff3-5aa4-47ca-89b7-f7366c654c6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:23.573253 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32e957f7-2cb4-4860-99a0-2657fcdaf3f5 req-6d636ff3-5aa4-47ca-89b7-f7366c654c6b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 1096 time: 0.2015500 May 12 15:54:23.706590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32e957f7-2cb4-4860-99a0-2657fcdaf3f5 req-881b3c6b-0240-48ad-8073-48119e850cd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:23.708023 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32e957f7-2cb4-4860-99a0-2657fcdaf3f5 req-881b3c6b-0240-48ad-8073-48119e850cd6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1286545 May 12 15:54:23.754636 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9ed948e5-b865-4ecc-a93c-efb52dc8672e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'cae4026b-c341-42a2-96e8-3593ebcd953e', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.104', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 4098, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:e5:b4:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:54:22Z', 'updated_at': '2022-05-12T15:54:22Z', 'revision_number': 0, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:23.758436 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ed948e5-b865-4ecc-a93c-efb52dc8672e None None] Checking router: c4a7b7e0-fe66-4b58-a3e2-7e635585791d for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:54:23.767167 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ed948e5-b865-4ecc-a93c-efb52dc8672e None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:54:23.767747 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9ed948e5-b865-4ecc-a93c-efb52dc8672e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:54:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:23.813069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32e957f7-2cb4-4860-99a0-2657fcdaf3f5 req-ee652aa2-6600-4bfa-b5f9-95391586ab27 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5befeada-1d07-4acc-be4a-c0cf3f8b7240 HTTP/1.1" status: 200 len: 999 time: 0.0993252 May 12 15:54:23.878003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32e957f7-2cb4-4860-99a0-2657fcdaf3f5 req-fa878657-159b-48be-a030-8e8e30a020da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:23.879373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32e957f7-2cb4-4860-99a0-2657fcdaf3f5 req-fa878657-159b-48be-a030-8e8e30a020da service neutron] 10.222.0.84 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0600152 May 12 15:54:23.939495 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-9ed948e5-b865-4ecc-a93c-efb52dc8672e None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:54:23.954717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32e957f7-2cb4-4860-99a0-2657fcdaf3f5 req-6cb78376-5f90-42b8-b92c-b4b45c48520d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:23.956178 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32e957f7-2cb4-4860-99a0-2657fcdaf3f5 req-6cb78376-5f90-42b8-b92c-b4b45c48520d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0709410 May 12 15:54:24.093623 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32e957f7-2cb4-4860-99a0-2657fcdaf3f5 req-bc588f5a-f8c5-4687-b374-9d219fe0fdd5 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1309171 May 12 15:54:24.231687 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32e957f7-2cb4-4860-99a0-2657fcdaf3f5 req-607a8343-1db6-4df2-ba7c-d457b0c21b95 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1324656 May 12 15:54:24.284597 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9ed948e5-b865-4ecc-a93c-efb52dc8672e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'cae4026b-c341-42a2-96e8-3593ebcd953e', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.104', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 4098, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:e5:b4:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:54:22Z', 'updated_at': '2022-05-12T15:54:22Z', 'revision_number': 0, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:54:24.288760 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ed948e5-b865-4ecc-a93c-efb52dc8672e None None] The sync data for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 is: [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'cae4026b-c341-42a2-96e8-3593ebcd953e', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.104', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 4098, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:e5:b4:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:54:22Z', 'updated_at': '2022-05-12T15:54:22Z', 'revision_number': 0, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:54:24.476249 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc6366dd-3b9b-45ee-837b-8964df3a053d None None] New status for floating IP cae4026b-c341-42a2-96e8-3593ebcd953e: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:54:31.970639 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:54:32.672155 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:36.054424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4daf59a-a100-469a-99b3-3d1224537121 req-39ce5ad3-b90e-45bb-b6d9-7e534f8587ab service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0728879 May 12 15:54:36.205249 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4daf59a-a100-469a-99b3-3d1224537121 req-f24c6177-f9b9-40be-95bc-95eb73eb9a6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:36.206725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4daf59a-a100-469a-99b3-3d1224537121 req-f24c6177-f9b9-40be-95bc-95eb73eb9a6b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 1096 time: 0.0706482 May 12 15:54:36.359129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4daf59a-a100-469a-99b3-3d1224537121 req-4b9e98ed-2f19-4e19-a824-d4c124a4ba1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:36.360597 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4daf59a-a100-469a-99b3-3d1224537121 req-4b9e98ed-2f19-4e19-a824-d4c124a4ba1c service neutron] 10.222.0.84 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1331236 May 12 15:54:36.466685 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4daf59a-a100-469a-99b3-3d1224537121 req-db565646-2a13-434f-93eb-edc0c61df8ca service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5befeada-1d07-4acc-be4a-c0cf3f8b7240 HTTP/1.1" status: 200 len: 1001 time: 0.0994942 May 12 15:54:36.534869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4daf59a-a100-469a-99b3-3d1224537121 req-8b77c007-4f22-4ade-a5a0-b32a7e98e055 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:36.536379 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4daf59a-a100-469a-99b3-3d1224537121 req-8b77c007-4f22-4ade-a5a0-b32a7e98e055 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0637455 May 12 15:54:36.612887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4daf59a-a100-469a-99b3-3d1224537121 req-2622726d-baa7-49d7-8b29-64f9bc59a9b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:54:36.614346 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4daf59a-a100-469a-99b3-3d1224537121 req-2622726d-baa7-49d7-8b29-64f9bc59a9b0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0720308 May 12 15:54:36.749875 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4daf59a-a100-469a-99b3-3d1224537121 req-d00d083e-ae0d-4cef-afe9-f2c78a0527ee service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1268847 May 12 15:54:36.882571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4daf59a-a100-469a-99b3-3d1224537121 req-ad45cecb-664a-4902-86d1-43e61f9b784a service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1259844 May 12 15:54:42.782068 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d89bc802-1a3c-4094-8f2b-56c13934daee None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:43.475765 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:45.327556 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-436aeba0-b1d4-44ad-ba6c-6ee8fb3765ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:46.048967 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:46.300199 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:54:47.780277 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:55:02.674211 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:55:08.970440 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:55:12.783962 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-194a03e1-0907-4224-9f4a-926902c643e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:55:13.480403 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:55:15.329234 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-93dda51d-671b-4b73-bfae-2e5f0f98e234 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:55:15.475289 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-57f78903-fdb5-43ea-b81d-e525634c6705 req-b396fe65-1af9-4211-a01b-4770c7a7b872 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.2180305 May 12 15:55:15.584105 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-57f78903-fdb5-43ea-b81d-e525634c6705 req-b1627352-ec78-475a-a67e-820ead41b49e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0425487 May 12 15:55:15.627557 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-57f78903-fdb5-43ea-b81d-e525634c6705 req-37081762-0552-4b24-88c3-d76a7dea3f05 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0254464 May 12 15:55:15.759472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57f78903-fdb5-43ea-b81d-e525634c6705 req-394138e6-8660-4e36-822a-e2e09dafe710 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:55:15.760881 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-57f78903-fdb5-43ea-b81d-e525634c6705 req-394138e6-8660-4e36-822a-e2e09dafe710 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1279557 May 12 15:55:16.052429 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:55:16.304687 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:55:17.781955 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:55:32.684912 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:55:38.026851 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0866428a-5e09-44bc-b732-f6d7a8062d29 req-bfad0bc8-e3f5-47cb-b3d1-fa792c407716 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0689709 May 12 15:55:38.315572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0866428a-5e09-44bc-b732-f6d7a8062d29 req-774268f4-b5be-472d-bc3e-b129b7f8b72b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:55:38.317636 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0866428a-5e09-44bc-b732-f6d7a8062d29 req-774268f4-b5be-472d-bc3e-b129b7f8b72b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 1096 time: 0.1836526 May 12 15:55:38.471373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0866428a-5e09-44bc-b732-f6d7a8062d29 req-610cdf96-9d60-462b-9b34-5bb4bc6bd4a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:55:38.472838 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0866428a-5e09-44bc-b732-f6d7a8062d29 req-610cdf96-9d60-462b-9b34-5bb4bc6bd4a9 service neutron] 10.222.0.84 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1318901 May 12 15:55:38.576473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0866428a-5e09-44bc-b732-f6d7a8062d29 req-f9050330-c861-4c15-a8d3-52ad25c871ce service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5befeada-1d07-4acc-be4a-c0cf3f8b7240 HTTP/1.1" status: 200 len: 1001 time: 0.0953095 May 12 15:55:38.640126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0866428a-5e09-44bc-b732-f6d7a8062d29 req-33981d09-2c2c-4b19-bc7c-0152abe7e11c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:55:38.641547 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0866428a-5e09-44bc-b732-f6d7a8062d29 req-33981d09-2c2c-4b19-bc7c-0152abe7e11c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0560777 May 12 15:55:38.721639 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0866428a-5e09-44bc-b732-f6d7a8062d29 req-71fcf34f-d6b4-49f9-8d1a-f45200700f79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:55:38.723113 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0866428a-5e09-44bc-b732-f6d7a8062d29 req-71fcf34f-d6b4-49f9-8d1a-f45200700f79 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0725026 May 12 15:55:38.855986 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0866428a-5e09-44bc-b732-f6d7a8062d29 req-d3993d51-2765-4837-9a9e-31ad2cdd54ca service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1228831 May 12 15:55:38.996210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0866428a-5e09-44bc-b732-f6d7a8062d29 req-482ff386-2f47-4700-883a-403b036dec47 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1308258 May 12 15:55:42.786862 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a181e062-7fd5-4f8d-9a03-61328519eb1b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:55:43.484425 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:55:45.332516 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b3266b14-c595-40c2-a143-0f87ebb887c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:55:45.969115 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:55:46.053978 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:55:46.305702 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:55:47.783734 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:02.684647 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:12.789205 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-13a2ee2e-4c7c-4314-a7eb-1d3a6498aa94 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:13.499432 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:13.637166 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-8a6e356b-44bf-4c06-9d9c-28f3377856cd tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1371785595&fields=id&tenant_id=939000b7f70c4c85a39e52ee93a06ed5 HTTP/1.1" status: 200 len: 267 time: 0.0385108 May 12 15:56:13.783443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-36c3dc37-acd7-4d21-a531-4b8592745ad6 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:13.784756 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-36c3dc37-acd7-4d21-a531-4b8592745ad6 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 812 time: 0.1412842 May 12 15:56:13.799618 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-7c39c560-27ef-4ccc-b4d5-952dc69c21fc tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/quotas/939000b7f70c4c85a39e52ee93a06ed5 HTTP/1.1" status: 200 len: 375 time: 0.0092630 May 12 15:56:13.886875 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-5256d819-e941-446f-8a64-00e85321e80c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0817633 May 12 15:56:13.951778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-44d169f6-0370-4056-ac83-5b128945efcc service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:56:13.952841 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-44d169f6-0370-4056-ac83-5b128945efcc service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0550520 May 12 15:56:14.085153 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-d0cdafc2-5d25-41d8-a1e8-3b8348ebf973 service neutron] 10.222.0.82 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1237891 May 12 15:56:14.214789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-46a5c4a8-e167-4900-a94e-c380287d9fb4 service neutron] 10.222.0.82 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1240180 May 12 15:56:14.668301 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e7494cd5-d4a1-480a-a1e6-c0725b3e121f req-2b1803dc-b30a-43ce-bd70-8047138e62d4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 210 time: 0.1028161 May 12 15:56:15.298370 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72f6c90f-2e93-4c66-91a1-cb3cfb5e90a9 req-692bad53-1c3c-46a1-ae68-853b22c3769c service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0457551 May 12 15:56:15.336247 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-65ca3e82-2573-48bb-9a31-e48602e75cbd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:15.415985 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72f6c90f-2e93-4c66-91a1-cb3cfb5e90a9 req-5139e741-b382-4b35-8870-0b22ef697b37 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0413496 May 12 15:56:15.461432 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72f6c90f-2e93-4c66-91a1-cb3cfb5e90a9 req-f25930bf-d05d-4b07-8437-f49d3176e549 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0273149 May 12 15:56:15.735414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cfba558b-409e-45f4-8a08-efe6188e20ac tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:15.736816 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cfba558b-409e-45f4-8a08-efe6188e20ac tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 812 time: 0.2622902 May 12 15:56:15.739163 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f6c90f-2e93-4c66-91a1-cb3cfb5e90a9 req-b19acb47-a75f-43bf-91a7-63a7d43af67b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:15.740464 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72f6c90f-2e93-4c66-91a1-cb3cfb5e90a9 req-b19acb47-a75f-43bf-91a7-63a7d43af67b service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2443531 May 12 15:56:15.788610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-22003355-03ed-43bb-b977-4933ba074a36 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Synchronizing usage tracker for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:56:15.804876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-22003355-03ed-43bb-b977-4933ba074a36 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Unset dirty status for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:56:15.806175 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-22003355-03ed-43bb-b977-4933ba074a36 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=939000b7f70c4c85a39e52ee93a06ed5 HTTP/1.1" status: 200 len: 380 time: 0.0585022 May 12 15:56:15.817044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'port': {'device_id': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'admin_state_up': True, 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'security_groups': ['d3930bee-f9c9-401c-921a-1058f06217af']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:56:15.826452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88c4fe1b-018b-4794-a265-b853259381d1 req-358b9947-edd6-475c-b6c0-b14114525617 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 210 time: 0.0444760 May 12 15:56:15.957431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:56:15.967558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:56:15.977421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Made reservation on behalf of 939000b7f70c4c85a39e52ee93a06ed5 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:56:15.980901 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:16.058809 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:16.150875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Allocated IP 172.20.0.8 (d13f4c27-5358-4d60-abb1-0c94e69df718/020f79af-22ce-41ca-91a6-931258be2176/61fc96cf-57a4-48ab-98e9-39cb695e4fda) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:56:16.308304 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:16.348691 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:16.364592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Transition to ACTIVE for port object 61fc96cf-57a4-48ab-98e9-39cb695e4fda will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:56:16.390178 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:16.464694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Network d13f4c27-5358-4d60-abb1-0c94e69df718 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:56:16.467816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:56:16.470411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:56:16.534799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'Port': ['ID=61fc96cf-57a4-48ab-98e9-39cb695e4fda,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:56:16.548781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:16.549124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:16.549488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:16.549824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:16.550155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:16.550481 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:16.550805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:16.551161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:16.551481 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:16.551798 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:16.552112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:16.552492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:16.568724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:16.570108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:16.597543 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-cada0876-2262-4c83-a61e-47321e4c18af tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7860713 May 12 15:56:16.607478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-8ede27d4-be21-479c-ae34-4590e639e021 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:56:16.608741 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-8ede27d4-be21-479c-ae34-4590e639e021 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0057962 May 12 15:56:16.618779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Request body: {'port': {'device_id': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:56:16.707543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-61887223-fd71-4247-a741-551dab13b80e None None] Provisioning for port 61fc96cf-57a4-48ab-98e9-39cb695e4fda completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:56:16.715424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-61887223-fd71-4247-a741-551dab13b80e None None] Provisioning complete for port 61fc96cf-57a4-48ab-98e9-39cb695e4fda triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:56:16.715724 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-61887223-fd71-4247-a741-551dab13b80e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:16.744105 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:16.775984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-61887223-fd71-4247-a741-551dab13b80e None None] Port 61fc96cf-57a4-48ab-98e9-39cb695e4fda cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:56:17.023763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-761a6aba-9b8d-4376-a54e-cb0b101295ef req-78fd7eb1-f150-40c0-95b4-a1a34d462144 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:17.025877 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-761a6aba-9b8d-4376-a54e-cb0b101295ef req-78fd7eb1-f150-40c0-95b4-a1a34d462144 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 931 time: 0.0829849 May 12 15:56:17.079139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-761a6aba-9b8d-4376-a54e-cb0b101295ef req-9784d237-cb2d-4b2e-9bd3-f565b58eed1f tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474865 May 12 15:56:17.236728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 61fc96cf-57a4-48ab-98e9-39cb695e4fda {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:56:17.245126 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:17.261970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Transition to ACTIVE for port object 61fc96cf-57a4-48ab-98e9-39cb695e4fda will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:56:17.266914 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:17.426711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Pushing event updated for resources: {'Port': ['ID=61fc96cf-57a4-48ab-98e9-39cb695e4fda,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:56:17.510874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Attempting to bind port 61fc96cf-57a4-48ab-98e9-39cb695e4fda on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:56:17.511208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Attempting to bind port 61fc96cf-57a4-48ab-98e9-39cb695e4fda by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:56:17.511534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Attempting to bind port 61fc96cf-57a4-48ab-98e9-39cb695e4fda on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:56:17.516136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Port 61fc96cf-57a4-48ab-98e9-39cb695e4fda on network d13f4c27-5358-4d60-abb1-0c94e69df718 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:56:17.516452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Attempting to bind port 61fc96cf-57a4-48ab-98e9-39cb695e4fda on network d13f4c27-5358-4d60-abb1-0c94e69df718 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:56:17.522223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 56, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:56:17.522558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Checking segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:56:17.522937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Bound using segment: {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:56:17.523365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Bound port: 61fc96cf-57a4-48ab-98e9-39cb695e4fda, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'df75c3d3-8e48-420e-8a5f-7e8bc6400515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:56:17.523707 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:17.614493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] For port 61fc96cf-57a4-48ab-98e9-39cb695e4fda, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:56:17.617671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] For port 61fc96cf-57a4-48ab-98e9-39cb695e4fda, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=61fc96cf-57a4-48ab-98e9-39cb695e4fda,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:56:17.622776 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:17.682581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:17.683196 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:17.684574 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] 10.222.0.76 "PUT /v2.0/ports/61fc96cf-57a4-48ab-98e9-39cb695e4fda HTTP/1.1" status: 200 len: 1091 time: 1.0699291 May 12 15:56:17.685010 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'tag': '61fc96cf-57a4-48ab-98e9-39cb695e4fda'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:56:17.708090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc0f9efe-e62a-4d5b-95c7-cf2082773888 service neutron] Pushing event updated for resources: {'Port': ['ID=61fc96cf-57a4-48ab-98e9-39cb695e4fda,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:56:17.793373 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:17.804931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-5aabcd8b-4788-4b6a-83ae-641d8477d09f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:17.806527 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-5aabcd8b-4788-4b6a-83ae-641d8477d09f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 1094 time: 0.0805402 May 12 15:56:17.867272 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0eed942e-60a7-4386-814e-bc610bb4470c'] response: {'name': 'network-changed', 'server_uuid': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'tag': '61fc96cf-57a4-48ab-98e9-39cb695e4fda', 'status': 'completed', 'code': 200} May 12 15:56:17.882113 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-951a103d-ee00-4c4e-8ac0-677f924a43fe service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=61fc96cf-57a4-48ab-98e9-39cb695e4fda HTTP/1.1" status: 200 len: 217 time: 0.0689890 May 12 15:56:17.943929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-ddb05082-e5fb-49d4-9db5-b8f3cc494c0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:17.945360 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-ddb05082-e5fb-49d4-9db5-b8f3cc494c0d service neutron] 10.222.0.76 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0580022 May 12 15:56:18.023123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fddfc16f-9ee1-4bb7-a34c-068ffdf8deb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:18.024567 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-fddfc16f-9ee1-4bb7-a34c-068ffdf8deb4 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0737443 May 12 15:56:18.155511 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-30303b04-4a2f-44d0-8c74-ffb01a36788c service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1245861 May 12 15:56:18.275359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf0d366e-42d0-40d1-9722-a0b3d762ca35 req-6cb39a83-81b8-4d6f-a95b-407d9e90a398 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:18.277460 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf0d366e-42d0-40d1-9722-a0b3d762ca35 req-6cb39a83-81b8-4d6f-a95b-407d9e90a398 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 943 time: 0.0866480 May 12 15:56:18.292508 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bdaf7d9d-54ab-4466-bb3d-995a463cb553 req-452ee26a-f8f9-452d-951b-a336d9a5e029 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1309452 May 12 15:56:18.324998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf0d366e-42d0-40d1-9722-a0b3d762ca35 req-ab3a52ba-8616-4dc0-998e-e14ee3efd873 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416987 May 12 15:56:18.401124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b82651c-372b-449d-8721-dbdc90d1feb8 req-60aa0534-104c-45ed-bfeb-207450fe652c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:18.402508 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2b82651c-372b-449d-8721-dbdc90d1feb8 req-60aa0534-104c-45ed-bfeb-207450fe652c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 1094 time: 0.0700626 May 12 15:56:18.531828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b82651c-372b-449d-8721-dbdc90d1feb8 req-e90e8fdb-5c83-470b-905e-39c81c932129 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:18.533251 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2b82651c-372b-449d-8721-dbdc90d1feb8 req-e90e8fdb-5c83-470b-905e-39c81c932129 service neutron] 10.222.0.76 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1241055 May 12 15:56:18.712307 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2b82651c-372b-449d-8721-dbdc90d1feb8 req-ccaf5759-885a-4494-87f9-013fe7226bde service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=61fc96cf-57a4-48ab-98e9-39cb695e4fda HTTP/1.1" status: 200 len: 217 time: 0.1676664 May 12 15:56:18.767669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b82651c-372b-449d-8721-dbdc90d1feb8 req-69f437c0-396d-4e01-82ef-2713792c5284 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:18.769046 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2b82651c-372b-449d-8721-dbdc90d1feb8 req-69f437c0-396d-4e01-82ef-2713792c5284 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0560238 May 12 15:56:18.843740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b82651c-372b-449d-8721-dbdc90d1feb8 req-b9e7f0f8-2608-46fb-b714-653bcfaab3cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:18.845182 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2b82651c-372b-449d-8721-dbdc90d1feb8 req-b9e7f0f8-2608-46fb-b714-653bcfaab3cd service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0707338 May 12 15:56:18.973322 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2b82651c-372b-449d-8721-dbdc90d1feb8 req-93f198e9-5a26-4897-bf23-5b269b5cb5bd service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1216848 May 12 15:56:19.100589 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2b82651c-372b-449d-8721-dbdc90d1feb8 req-1e2a3e60-a82e-45a3-b855-ab885371f723 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1218019 May 12 15:56:19.615978 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-754cd5c1-049e-4d2c-bf5c-d3f095032624 req-60aa661e-883c-410f-9aa8-32d74596a070 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:19.617315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-754cd5c1-049e-4d2c-bf5c-d3f095032624 req-60aa661e-883c-410f-9aa8-32d74596a070 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 943 time: 0.1853695 May 12 15:56:19.659387 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-754cd5c1-049e-4d2c-bf5c-d3f095032624 req-f61ebb3e-cdf1-4c79-aec6-e180b92e8640 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0363276 May 12 15:56:20.840271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20bb3083-1ba4-4398-8c90-f9d102fc0554 req-6e6639ee-44be-46d3-836c-89c87388902a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:20.841748 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20bb3083-1ba4-4398-8c90-f9d102fc0554 req-6e6639ee-44be-46d3-836c-89c87388902a tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 943 time: 0.0794022 May 12 15:56:20.888415 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20bb3083-1ba4-4398-8c90-f9d102fc0554 req-748687fb-4120-46f0-9e56-e6397e6d6b38 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411711 May 12 15:56:22.094894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e7c489-3c77-4c15-85a2-4981becff0ca req-b2626864-91e7-4432-bf3c-f5a51ab0d77f tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:22.096035 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9e7c489-3c77-4c15-85a2-4981becff0ca req-b2626864-91e7-4432-bf3c-f5a51ab0d77f tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 943 time: 0.0978901 May 12 15:56:22.146787 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9e7c489-3c77-4c15-85a2-4981becff0ca req-4f041c26-196d-46e9-9d33-557fb9bed9c5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453682 May 12 15:56:22.968688 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:56:23.355674 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e5c2db8-b87b-4f24-9167-25502d153edd req-827b472d-8b7f-4834-9f60-a16bc6eef77b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:23.357332 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e5c2db8-b87b-4f24-9167-25502d153edd req-827b472d-8b7f-4834-9f60-a16bc6eef77b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 943 time: 0.0949678 May 12 15:56:23.408810 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e5c2db8-b87b-4f24-9167-25502d153edd req-4b00c165-a45a-4bfa-b778-46dfdb431dd3 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457811 May 12 15:56:24.595358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd238c9-ecc4-4d34-b85e-7b1325ada32a req-04ab640d-0e7a-4bd0-8a8e-d1904031b51b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:24.596698 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1bd238c9-ecc4-4d34-b85e-7b1325ada32a req-04ab640d-0e7a-4bd0-8a8e-d1904031b51b tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 943 time: 0.0806911 May 12 15:56:24.639657 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1bd238c9-ecc4-4d34-b85e-7b1325ada32a req-ad197f5c-9091-4070-9cd4-51d5e1a9205d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371349 May 12 15:56:25.833263 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba2569d1-878b-4294-989b-5652bf2f4dc8 req-d56c3c63-3f30-4cf9-823b-aa8d5a403277 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:25.835211 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba2569d1-878b-4294-989b-5652bf2f4dc8 req-d56c3c63-3f30-4cf9-823b-aa8d5a403277 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 943 time: 0.0831954 May 12 15:56:25.878222 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba2569d1-878b-4294-989b-5652bf2f4dc8 req-dab3ec7f-ec55-4346-b6a5-975987c990e2 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375295 May 12 15:56:25.983082 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 61fc96cf-57a4-48ab-98e9-39cb695e4fda details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:56:26.116057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 61fc96cf-57a4-48ab-98e9-39cb695e4fda, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=61fc96cf-57a4-48ab-98e9-39cb695e4fda,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:56:26.128634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '61fc96cf-57a4-48ab-98e9-39cb695e4fda', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'port_id': '61fc96cf-57a4-48ab-98e9-39cb695e4fda', 'mac_address': 'fa:16:3e:8a:14:cd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 566, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:56:26.183236 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:26.200109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 61fc96cf-57a4-48ab-98e9-39cb695e4fda {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:56:26.216125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 61fc96cf-57a4-48ab-98e9-39cb695e4fda, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=61fc96cf-57a4-48ab-98e9-39cb695e4fda,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:56:26.220213 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:26.288922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=61fc96cf-57a4-48ab-98e9-39cb695e4fda,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:56:26.297234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:26.297610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:26.297938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:26.298262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:26.298576 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:26.298889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:26.299198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:26.299507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:26.299815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:26.300121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:26.300426 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:26.300731 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:26.447058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['61fc96cf-57a4-48ab-98e9-39cb695e4fda'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:56:27.064022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e5552b-ba6e-4a8b-9a66-eaf5034def56 req-820173b9-3993-4383-b20a-5d410fc9f0fc tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:27.065495 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9e5552b-ba6e-4a8b-9a66-eaf5034def56 req-820173b9-3993-4383-b20a-5d410fc9f0fc tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 944 time: 0.0842295 May 12 15:56:27.109115 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9e5552b-ba6e-4a8b-9a66-eaf5034def56 req-0c1a1295-505b-4077-b1d3-191916f5f1bd tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379612 May 12 15:56:27.982823 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 61fc96cf-57a4-48ab-98e9-39cb695e4fda up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:56:28.087438 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 61fc96cf-57a4-48ab-98e9-39cb695e4fda completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:56:28.091892 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 61fc96cf-57a4-48ab-98e9-39cb695e4fda triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:56:28.092257 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:28.207384 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:28.235521 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '61fc96cf-57a4-48ab-98e9-39cb695e4fda'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:56:28.247257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 61fc96cf-57a4-48ab-98e9-39cb695e4fda, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=61fc96cf-57a4-48ab-98e9-39cb695e4fda,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:56:28.255570 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:28.302141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b58fa0b-ad2b-43a9-a4ec-42a477235f18 req-caa69017-da50-4e11-81c6-d56b42c7dff0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:28.304659 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8b58fa0b-ad2b-43a9-a4ec-42a477235f18 req-caa69017-da50-4e11-81c6-d56b42c7dff0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 945 time: 0.0871119 May 12 15:56:28.334005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=61fc96cf-57a4-48ab-98e9-39cb695e4fda,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:56:28.355184 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-089836d6-a2b4-4d88-83ef-5dba29d39a15'] response: {'server_uuid': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '61fc96cf-57a4-48ab-98e9-39cb695e4fda', 'code': 200} May 12 15:56:28.359535 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8b58fa0b-ad2b-43a9-a4ec-42a477235f18 req-1561fbdf-d51e-497a-a9d2-d95eefb5c27c tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479214 May 12 15:56:28.483616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd3f729-c378-4d16-a619-9e9eb86eb2f9 req-8ea81284-7e70-4468-b19c-b50728ff633a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:28.485050 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5bd3f729-c378-4d16-a619-9e9eb86eb2f9 req-8ea81284-7e70-4468-b19c-b50728ff633a service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 1096 time: 0.0686295 May 12 15:56:28.523754 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5bd3f729-c378-4d16-a619-9e9eb86eb2f9 req-1b170db3-9b51-4919-8e58-60e8b31d7c1c service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0329537 May 12 15:56:29.556072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26e6c0f8-481c-4d23-8a3c-92c3b3e2dbb1 req-ce847f36-8dc2-4b79-a932-a179224076df tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:29.557579 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-26e6c0f8-481c-4d23-8a3c-92c3b3e2dbb1 req-ce847f36-8dc2-4b79-a932-a179224076df tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 945 time: 0.0828207 May 12 15:56:29.608383 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-26e6c0f8-481c-4d23-8a3c-92c3b3e2dbb1 req-4b495643-1b76-4e71-b5f6-9d47a8a1614e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443730 May 12 15:56:30.794295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e441acd-2f37-4614-9d6b-04c204d71a87 req-82d2fa20-457f-49e4-b711-22461a380ad5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:30.795730 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e441acd-2f37-4614-9d6b-04c204d71a87 req-82d2fa20-457f-49e4-b711-22461a380ad5 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 945 time: 0.0796180 May 12 15:56:30.840039 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e441acd-2f37-4614-9d6b-04c204d71a87 req-48821d5b-0d32-4d16-ba2a-9b79a172eec6 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386832 May 12 15:56:31.026346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2495946-fe32-4d12-8362-8df31f2fd5b3 req-726db176-fb39-4fdc-8acf-4c0faea51742 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:31.027774 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2495946-fe32-4d12-8362-8df31f2fd5b3 req-726db176-fb39-4fdc-8acf-4c0faea51742 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 945 time: 0.0837612 May 12 15:56:31.071678 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2495946-fe32-4d12-8362-8df31f2fd5b3 req-d3d74358-9424-4f4c-9b6e-cbb8a8ba5796 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382593 May 12 15:56:31.094436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51716) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:56:31.163337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24865271-2306-4852-8e65-6e68cf0be029 tempest-TestVolumeBootPattern-545659823 tempest-TestVolumeBootPattern-545659823-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:31.164816 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-24865271-2306-4852-8e65-6e68cf0be029 tempest-TestVolumeBootPattern-545659823 tempest-TestVolumeBootPattern-545659823-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 1091 time: 0.0694115 May 12 15:56:31.167545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51720) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:56:31.172259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '61fc96cf-57a4-48ab-98e9-39cb695e4fda', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address': '172.20.0.8'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:56:31.179262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:56:31.183116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Usage tracker for resource:floatingip and tenant:939000b7f70c4c85a39e52ee93a06ed5 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:56:31.186214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:56:31.191800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:56:31.202740 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:31.341349 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:31.479086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Allocated IP 172.25.8.245 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/18d06da4-6191-4156-8787-11f7bd1902f9) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:56:31.624880 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:31.653616 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:31.718811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:56:31.721414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:56:31.724001 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:56:31.769567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'Port': ['ID=18d06da4-6191-4156-8787-11f7bd1902f9,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:56:31.782049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:31.782392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:31.782728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:31.783056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:31.783386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:31.784015 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:31.784340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:31.784662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:31.785007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:31.785327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:31.785672 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:31.785989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:56:32.251344 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:32.329590 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:32.542720 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:32.546868 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:32.652670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event updated for resources: {'Port': ['ID=18d06da4-6191-4156-8787-11f7bd1902f9,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:56:32.664767 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:32.684458 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:32.831973 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Floating IP 132c8292-a298-428b-b39b-3707cf5f5a76 associated. External IP: 172.25.8.245, port: 61fc96cf-57a4-48ab-98e9-39cb695e4fda. May 12 15:56:33.177101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Router c4a7b7e0-fe66-4b58-a3e2-7e635585791d has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:56:33.479219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:56:33.489060 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6b6ce8d-ddc7-4665-997e-bc59922327a1 None None] Sync routers for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:56:33.498243 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6b6ce8d-ddc7-4665-997e-bc59922327a1 None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:56:33.498841 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e6b6ce8d-ddc7-4665-997e-bc59922327a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:56:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:56:33.503031 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:33.557490 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bb8fe8bb-c536-42ec-85e9-b0a97329f4a4 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.3889353 May 12 15:56:33.558081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'tag': '61fc96cf-57a4-48ab-98e9-39cb695e4fda'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:56:33.601608 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b3a49da7-cff6-4f41-b9fd-d33fc1e137be'] response: {'name': 'network-changed', 'server_uuid': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'tag': '61fc96cf-57a4-48ab-98e9-39cb695e4fda', 'status': 'completed', 'code': 200} May 12 15:56:33.675719 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-e6b6ce8d-ddc7-4665-997e-bc59922327a1 None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:56:33.696233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4af7e5f8-e86c-45f2-8c10-a99d2fb84d28 req-83788c75-5761-4d9d-b59b-b3fce2596307 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:33.697732 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4af7e5f8-e86c-45f2-8c10-a99d2fb84d28 req-83788c75-5761-4d9d-b59b-b3fce2596307 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 1096 time: 0.0746269 May 12 15:56:33.829899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4af7e5f8-e86c-45f2-8c10-a99d2fb84d28 req-d163ba02-1826-4057-af75-d28b06b19121 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:33.831259 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4af7e5f8-e86c-45f2-8c10-a99d2fb84d28 req-d163ba02-1826-4057-af75-d28b06b19121 service neutron] 10.222.0.76 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1283045 May 12 15:56:33.935825 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4af7e5f8-e86c-45f2-8c10-a99d2fb84d28 req-6aff2d5d-1e9b-4060-8e89-5dc23c35bb1b service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=61fc96cf-57a4-48ab-98e9-39cb695e4fda HTTP/1.1" status: 200 len: 999 time: 0.0982726 May 12 15:56:33.996819 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4af7e5f8-e86c-45f2-8c10-a99d2fb84d28 req-1854ec3c-eeff-4e40-a02e-8dd5714edcb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:33.998319 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4af7e5f8-e86c-45f2-8c10-a99d2fb84d28 req-1854ec3c-eeff-4e40-a02e-8dd5714edcb8 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0576346 May 12 15:56:34.019804 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e6b6ce8d-ddc7-4665-997e-bc59922327a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '132c8292-a298-428b-b39b-3707cf5f5a76', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.245', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '61fc96cf-57a4-48ab-98e9-39cb695e4fda', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 4101, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:8a:14:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:56:32Z', 'updated_at': '2022-05-12T15:56:32Z', 'revision_number': 0, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}, {'id': 'cae4026b-c341-42a2-96e8-3593ebcd953e', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.104', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 4098, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:e5:b4:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:54:22Z', 'updated_at': '2022-05-12T15:54:24Z', 'revision_number': 1, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:56:34.024086 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6b6ce8d-ddc7-4665-997e-bc59922327a1 None None] Checking router: c4a7b7e0-fe66-4b58-a3e2-7e635585791d for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:56:34.032089 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6b6ce8d-ddc7-4665-997e-bc59922327a1 None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:56:34.032665 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e6b6ce8d-ddc7-4665-997e-bc59922327a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:56:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:56:34.076869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4af7e5f8-e86c-45f2-8c10-a99d2fb84d28 req-55805eaf-8015-47a1-903b-0fd647e5d2db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:34.078481 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4af7e5f8-e86c-45f2-8c10-a99d2fb84d28 req-55805eaf-8015-47a1-903b-0fd647e5d2db service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0737321 May 12 15:56:34.204000 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-e6b6ce8d-ddc7-4665-997e-bc59922327a1 None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:56:34.211051 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4af7e5f8-e86c-45f2-8c10-a99d2fb84d28 req-962bde18-65a6-4b53-ba75-7191b4865ab6 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1251907 May 12 15:56:34.352257 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4af7e5f8-e86c-45f2-8c10-a99d2fb84d28 req-218b216d-86a0-4b40-a1bf-27afe4a62d07 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1360152 May 12 15:56:34.552621 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e6b6ce8d-ddc7-4665-997e-bc59922327a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '132c8292-a298-428b-b39b-3707cf5f5a76', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.245', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '61fc96cf-57a4-48ab-98e9-39cb695e4fda', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 4101, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:8a:14:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:56:32Z', 'updated_at': '2022-05-12T15:56:32Z', 'revision_number': 0, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}, {'id': 'cae4026b-c341-42a2-96e8-3593ebcd953e', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.104', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 4098, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:e5:b4:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:54:22Z', 'updated_at': '2022-05-12T15:54:24Z', 'revision_number': 1, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:56:34.557361 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6b6ce8d-ddc7-4665-997e-bc59922327a1 None None] The sync data for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 is: [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '132c8292-a298-428b-b39b-3707cf5f5a76', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.245', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '61fc96cf-57a4-48ab-98e9-39cb695e4fda', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 4101, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:8a:14:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:56:32Z', 'updated_at': '2022-05-12T15:56:32Z', 'revision_number': 0, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}, {'id': 'cae4026b-c341-42a2-96e8-3593ebcd953e', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.104', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 4098, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:e5:b4:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:54:22Z', 'updated_at': '2022-05-12T15:54:24Z', 'revision_number': 1, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:56:34.735886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66927fe3-8c6e-493d-aaeb-9775526ee6ca None None] New status for floating IP 132c8292-a298-428b-b39b-3707cf5f5a76: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:56:39.057610 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77a03737-b44d-4683-b072-e65b17755bdc req-188304f6-89ca-43e9-98fd-5850f9f46a51 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0706823 May 12 15:56:39.227628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a03737-b44d-4683-b072-e65b17755bdc req-e9622f7e-2555-4c17-9c21-fecd8e97fb75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:39.229057 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77a03737-b44d-4683-b072-e65b17755bdc req-e9622f7e-2555-4c17-9c21-fecd8e97fb75 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 1096 time: 0.0711093 May 12 15:56:39.377954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a03737-b44d-4683-b072-e65b17755bdc req-8c6a48db-0f81-4e8f-803c-9f8582080268 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:39.379282 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77a03737-b44d-4683-b072-e65b17755bdc req-8c6a48db-0f81-4e8f-803c-9f8582080268 service neutron] 10.222.0.84 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1245058 May 12 15:56:39.485341 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77a03737-b44d-4683-b072-e65b17755bdc req-79341761-f0a5-4056-b0cc-6a686d7870d2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5befeada-1d07-4acc-be4a-c0cf3f8b7240 HTTP/1.1" status: 200 len: 1001 time: 0.0966864 May 12 15:56:39.550360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a03737-b44d-4683-b072-e65b17755bdc req-6a95d7f5-63f9-446f-b73f-cea19aedb89f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:39.551448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77a03737-b44d-4683-b072-e65b17755bdc req-6a95d7f5-63f9-446f-b73f-cea19aedb89f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0568006 May 12 15:56:39.635167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a03737-b44d-4683-b072-e65b17755bdc req-8935bcdf-f171-421c-8d83-9afd0c9ca461 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:56:39.636920 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77a03737-b44d-4683-b072-e65b17755bdc req-8935bcdf-f171-421c-8d83-9afd0c9ca461 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0767689 May 12 15:56:39.650966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-77a03737-b44d-4683-b072-e65b17755bdc req-c7885874-c08b-49f2-8196-f08b379f8c23 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 15:56:39.651277 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77a03737-b44d-4683-b072-e65b17755bdc req-c7885874-c08b-49f2-8196-f08b379f8c23 service neutron] 10.222.0.84 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0051861 May 12 15:56:39.798335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77a03737-b44d-4683-b072-e65b17755bdc req-4e3d1adf-44e4-4cc8-966c-0a16757a23be service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1370897 May 12 15:56:39.940339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-77a03737-b44d-4683-b072-e65b17755bdc req-19e01d5a-eabf-4fe1-b408-c8a11032b6c8 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1333296 May 12 15:56:42.792888 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b24d94b1-4db2-4639-9bf9-f5568820e51a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:43.499233 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:45.341197 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c2cdbf7-c4ea-4d27-8c84-4edb1299e802 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:46.050997 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:46.311095 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:47.796791 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:56:59.968420 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:57:02.693628 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:57:12.801703 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-65ac1dd0-91cc-4822-98f7-e22a15ef8e9c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:57:13.513887 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:57:15.314712 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c9877cf-21e7-4337-9e56-c38d8169cbd0 req-4e553c33-e328-4ff9-995c-cce0f71870e1 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0422919 May 12 15:57:15.345863 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d671e51-3712-410c-b634-3b6656e32686 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:57:15.425202 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c9877cf-21e7-4337-9e56-c38d8169cbd0 req-ef628edc-b3c8-4b8e-815a-eab44fd9549d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0410378 May 12 15:57:15.467794 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c9877cf-21e7-4337-9e56-c38d8169cbd0 req-feb088f0-2660-428e-992d-f9e9e983af24 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0247436 May 12 15:57:15.602236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c9877cf-21e7-4337-9e56-c38d8169cbd0 req-8e7d346b-9205-47e1-bd9f-6b7fb80ea48a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:57:15.603571 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c9877cf-21e7-4337-9e56-c38d8169cbd0 req-8e7d346b-9205-47e1-bd9f-6b7fb80ea48a service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1302598 May 12 15:57:16.052463 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:57:16.313706 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:57:17.796708 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:57:32.699686 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:57:36.968065 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:57:39.053891 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fca72210-fcf5-439f-a078-ccbde773e510 req-65532249-9cc1-4606-8c6a-c994e1d7bf13 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0683274 May 12 15:57:39.239007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fca72210-fcf5-439f-a078-ccbde773e510 req-3b0f3187-c3a5-40b9-af85-f0b3a9a93591 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:57:39.240506 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fca72210-fcf5-439f-a078-ccbde773e510 req-3b0f3187-c3a5-40b9-af85-f0b3a9a93591 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 1096 time: 0.0809581 May 12 15:57:39.388901 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fca72210-fcf5-439f-a078-ccbde773e510 req-0cb82c56-1328-48af-85a6-3828227c9dfb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:57:39.390262 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fca72210-fcf5-439f-a078-ccbde773e510 req-0cb82c56-1328-48af-85a6-3828227c9dfb service neutron] 10.222.0.84 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1249664 May 12 15:57:39.494946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fca72210-fcf5-439f-a078-ccbde773e510 req-e552d3ab-414c-411a-9b43-f87711c87bfa service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5befeada-1d07-4acc-be4a-c0cf3f8b7240 HTTP/1.1" status: 200 len: 1001 time: 0.0952725 May 12 15:57:39.562527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fca72210-fcf5-439f-a078-ccbde773e510 req-2c10ca6f-a96b-4475-bbfb-7dd93d1c8f00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:57:39.563895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fca72210-fcf5-439f-a078-ccbde773e510 req-2c10ca6f-a96b-4475-bbfb-7dd93d1c8f00 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0565970 May 12 15:57:39.638537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fca72210-fcf5-439f-a078-ccbde773e510 req-2de830d3-d20d-482e-acb3-5709b95133c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:57:39.639975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fca72210-fcf5-439f-a078-ccbde773e510 req-2de830d3-d20d-482e-acb3-5709b95133c0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0674038 May 12 15:57:39.778663 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fca72210-fcf5-439f-a078-ccbde773e510 req-f7f309a3-2648-49ac-81b5-740fa0768744 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1291232 May 12 15:57:40.028422 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fca72210-fcf5-439f-a078-ccbde773e510 req-ae46b80d-cb2b-4b52-948a-c3bfda88a34c service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2391169 May 12 15:57:42.793989 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ae4d2dde-fd58-43de-8d15-d866fde600aa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:57:43.530207 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:57:45.347993 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-daee22bf-f60e-49a5-a490-d8b687f5ad66 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:57:46.055239 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:57:46.315226 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:57:47.796930 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:02.712930 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:12.747640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51758) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:12.797675 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-474d5ed5-f88c-4d06-ac11-9242dec62139 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:13.056837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Deleting port 18d06da4-6191-4156-8787-11f7bd1902f9 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:13.057130 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:13.226524 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:13.226845 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:13.347455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Calling delete_port for 18d06da4-6191-4156-8787-11f7bd1902f9 owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:58:13.502310 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:13.533637 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:13.548682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event deleted for resources: {'Port': ['ID=18d06da4-6191-4156-8787-11f7bd1902f9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:13.585867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:13.586201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:13.586530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:13.586852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:13.587170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:13.587485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:13.587896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:13.588356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:13.588760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:13.589076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:13.589433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:13.589742 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:13.651730 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:13.652043 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Floating IP 132c8292-a298-428b-b39b-3707cf5f5a76 disassociated (deleted). External IP: 172.25.8.245, port: 61fc96cf-57a4-48ab-98e9-39cb695e4fda. May 12 15:58:13.968172 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:58:14.007415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Router c4a7b7e0-fe66-4b58-a3e2-7e635585791d has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:58:14.319354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:58:14.329274 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cc7c1a8-0d87-420d-8100-d9a2ad2e9bf6 None None] Sync routers for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:58:14.336968 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:14.338552 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cc7c1a8-0d87-420d-8100-d9a2ad2e9bf6 None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:58:14.339008 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3cc7c1a8-0d87-420d-8100-d9a2ad2e9bf6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:57:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:14.392956 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b5ec34a9-3062-408c-9260-31292878be59 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "DELETE /v2.0/floatingips/132c8292-a298-428b-b39b-3707cf5f5a76 HTTP/1.1" status: 204 len: 168 time: 1.6442027 May 12 15:58:14.393676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'tag': '61fc96cf-57a4-48ab-98e9-39cb695e4fda'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:58:14.444587 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5b36ef5d-ecad-45ba-9965-f09499f074e6'] response: {'name': 'network-changed', 'server_uuid': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'tag': '61fc96cf-57a4-48ab-98e9-39cb695e4fda', 'status': 'completed', 'code': 200} May 12 15:58:14.537373 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-3cc7c1a8-0d87-420d-8100-d9a2ad2e9bf6 None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:58:14.542431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14950dd6-176b-4dd4-9d8c-99fa5e8b8d32 req-dcef7046-e8bb-4fdb-b3af-2c04292c7de9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:14.543983 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-14950dd6-176b-4dd4-9d8c-99fa5e8b8d32 req-dcef7046-e8bb-4fdb-b3af-2c04292c7de9 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 1096 time: 0.0737298 May 12 15:58:14.686001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14950dd6-176b-4dd4-9d8c-99fa5e8b8d32 req-5daf5625-fe71-41cd-b823-d57f3ed6c343 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:14.687744 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-14950dd6-176b-4dd4-9d8c-99fa5e8b8d32 req-5daf5625-fe71-41cd-b823-d57f3ed6c343 service neutron] 10.222.0.76 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1378946 May 12 15:58:14.761895 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-14950dd6-176b-4dd4-9d8c-99fa5e8b8d32 req-79612921-fd61-4a20-9325-09e1145346b9 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=61fc96cf-57a4-48ab-98e9-39cb695e4fda HTTP/1.1" status: 200 len: 217 time: 0.0674164 May 12 15:58:14.772118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc62117-c3cf-44b9-9fa2-dfb24617b691 req-670985d5-f736-484a-8d04-4656d1296e52 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:14.774780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3fc62117-c3cf-44b9-9fa2-dfb24617b691 req-670985d5-f736-484a-8d04-4656d1296e52 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 945 time: 0.0885794 May 12 15:58:14.823225 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3fc62117-c3cf-44b9-9fa2-dfb24617b691 req-219a6df3-adf6-49a1-8118-4b9d2e56ac98 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423496 May 12 15:58:14.832300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14950dd6-176b-4dd4-9d8c-99fa5e8b8d32 req-1352ca25-d84b-4819-a04d-74f4048cbf43 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:14.833980 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-14950dd6-176b-4dd4-9d8c-99fa5e8b8d32 req-1352ca25-d84b-4819-a04d-74f4048cbf43 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0656388 May 12 15:58:14.898081 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3cc7c1a8-0d87-420d-8100-d9a2ad2e9bf6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'cae4026b-c341-42a2-96e8-3593ebcd953e', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.104', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 4098, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:e5:b4:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:54:22Z', 'updated_at': '2022-05-12T15:54:24Z', 'revision_number': 1, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:14.902114 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cc7c1a8-0d87-420d-8100-d9a2ad2e9bf6 None None] Checking router: c4a7b7e0-fe66-4b58-a3e2-7e635585791d for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:58:14.910280 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cc7c1a8-0d87-420d-8100-d9a2ad2e9bf6 None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:58:14.910410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14950dd6-176b-4dd4-9d8c-99fa5e8b8d32 req-0f91ed27-c53f-48c3-a83a-263f752a4ef9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:14.910890 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3cc7c1a8-0d87-420d-8100-d9a2ad2e9bf6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:57:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:14.911827 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-14950dd6-176b-4dd4-9d8c-99fa5e8b8d32 req-0f91ed27-c53f-48c3-a83a-263f752a4ef9 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0710633 May 12 15:58:15.044897 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-14950dd6-176b-4dd4-9d8c-99fa5e8b8d32 req-7bab7a92-27c8-4c26-b336-fcbcab08ac30 service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1261647 May 12 15:58:15.089627 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-3cc7c1a8-0d87-420d-8100-d9a2ad2e9bf6 None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:58:15.181587 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-14950dd6-176b-4dd4-9d8c-99fa5e8b8d32 req-e157f36a-854e-4e34-b7ad-4c416aa49f4e service neutron] 10.222.0.76 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1300042 May 12 15:58:15.349559 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-06b9476a-9c97-43f0-9c1f-7e941a430f94 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:15.436591 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3cc7c1a8-0d87-420d-8100-d9a2ad2e9bf6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'cae4026b-c341-42a2-96e8-3593ebcd953e', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.104', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 4098, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:e5:b4:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:54:22Z', 'updated_at': '2022-05-12T15:54:24Z', 'revision_number': 1, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:15.440730 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cc7c1a8-0d87-420d-8100-d9a2ad2e9bf6 None None] The sync data for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 is: [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'cae4026b-c341-42a2-96e8-3593ebcd953e', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'floating_ip_address': '172.25.8.104', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'port_id': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 4098, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'mac_address': 'fa:16:3e:e5:b4:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T15:54:22Z', 'updated_at': '2022-05-12T15:54:24Z', 'revision_number': 1, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:58:15.643512 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e4818f1-8631-482a-9954-47785d0db724 None None] New status for floating IP 132c8292-a298-428b-b39b-3707cf5f5a76: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:58:16.016536 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357b6456-9af0-48d5-b9d6-2a0f810269e8 req-af462292-367a-4cdc-af09-e90914cae2d0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:16.017975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-357b6456-9af0-48d5-b9d6-2a0f810269e8 req-af462292-367a-4cdc-af09-e90914cae2d0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 945 time: 0.0791297 May 12 15:58:16.057490 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:16.070635 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-357b6456-9af0-48d5-b9d6-2a0f810269e8 req-66f702ee-b4b3-42a2-9ff0-7d5e3ccd0562 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468118 May 12 15:58:16.166205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-670e3ac5-9096-4636-95c4-67e610291376 req-eb683616-737f-4387-8c26-d1550afa4288 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:16.166822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-670e3ac5-9096-4636-95c4-67e610291376 req-eb683616-737f-4387-8c26-d1550afa4288 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Synchronizing usage tracker for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:58:16.181139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-670e3ac5-9096-4636-95c4-67e610291376 req-eb683616-737f-4387-8c26-d1550afa4288 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Unset dirty status for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:58:16.182765 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-670e3ac5-9096-4636-95c4-67e610291376 req-eb683616-737f-4387-8c26-d1550afa4288 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 945 time: 0.0950036 May 12 15:58:16.255745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-670e3ac5-9096-4636-95c4-67e610291376 req-46d6e17b-a730-4976-bec7-83e762271410 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Deleting port 61fc96cf-57a4-48ab-98e9-39cb695e4fda {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:16.256184 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-670e3ac5-9096-4636-95c4-67e610291376 req-46d6e17b-a730-4976-bec7-83e762271410 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:16.320092 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:16.507062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-670e3ac5-9096-4636-95c4-67e610291376 req-46d6e17b-a730-4976-bec7-83e762271410 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] For port 61fc96cf-57a4-48ab-98e9-39cb695e4fda, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=61fc96cf-57a4-48ab-98e9-39cb695e4fda,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:58:16.507419 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-670e3ac5-9096-4636-95c4-67e610291376 req-46d6e17b-a730-4976-bec7-83e762271410 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:16.630720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-670e3ac5-9096-4636-95c4-67e610291376 req-46d6e17b-a730-4976-bec7-83e762271410 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Calling delete_port for 61fc96cf-57a4-48ab-98e9-39cb695e4fda owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:58:16.774481 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-670e3ac5-9096-4636-95c4-67e610291376 req-46d6e17b-a730-4976-bec7-83e762271410 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:16.827625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46d6e17b-a730-4976-bec7-83e762271410 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event deleted for resources: {'Port': ['ID=61fc96cf-57a4-48ab-98e9-39cb695e4fda,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:16.905485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-670e3ac5-9096-4636-95c4-67e610291376 req-46d6e17b-a730-4976-bec7-83e762271410 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] No DVR routers for this DVR port 61fc96cf-57a4-48ab-98e9-39cb695e4fda on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:58:16.907918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-670e3ac5-9096-4636-95c4-67e610291376 req-46d6e17b-a730-4976-bec7-83e762271410 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:16.910436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'name': 'network-vif-deleted', 'tag': '61fc96cf-57a4-48ab-98e9-39cb695e4fda'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:58:16.926338 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-670e3ac5-9096-4636-95c4-67e610291376 req-46d6e17b-a730-4976-bec7-83e762271410 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.76 "DELETE /v2.0/ports/61fc96cf-57a4-48ab-98e9-39cb695e4fda HTTP/1.1" status: 204 len: 173 time: 0.7386284 May 12 15:58:16.956414 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d78d0c93-e0ad-42a5-b5b5-c06cd775bc5c'] response: {'server_uuid': '020553f8-9b78-4f3b-ba11-f2e5527fa18b', 'name': 'network-vif-deleted', 'tag': '61fc96cf-57a4-48ab-98e9-39cb695e4fda', 'status': 'completed', 'code': 200} May 12 15:58:17.224568 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da1a9116-feed-4b88-8b92-34dbd4959ef8 req-6c061ab5-aa18-496e-be4f-0c2d86590e91 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=020553f8-9b78-4f3b-ba11-f2e5527fa18b HTTP/1.1" status: 200 len: 210 time: 0.0438285 May 12 15:58:17.798935 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:20.558907 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 61fc96cf-57a4-48ab-98e9-39cb695e4fda no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:58:20.593569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 61fc96cf-57a4-48ab-98e9-39cb695e4fda {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:58:20.593907 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 61fc96cf-57a4-48ab-98e9-39cb695e4fda not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:58:22.843404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51802) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:23.043057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d88dccbc-ece4-461c-ac0c-077a8b19a585 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Deleting port 52e69b14-0f26-40de-93df-9d1478bc6f11 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:23.043395 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d88dccbc-ece4-461c-ac0c-077a8b19a585 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:23.213808 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d88dccbc-ece4-461c-ac0c-077a8b19a585 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:23.214042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d88dccbc-ece4-461c-ac0c-077a8b19a585 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:23.446510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d88dccbc-ece4-461c-ac0c-077a8b19a585 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Calling delete_port for 52e69b14-0f26-40de-93df-9d1478bc6f11 owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:58:23.595753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d88dccbc-ece4-461c-ac0c-077a8b19a585 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:23.641917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d88dccbc-ece4-461c-ac0c-077a8b19a585 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event deleted for resources: {'Port': ['ID=52e69b14-0f26-40de-93df-9d1478bc6f11,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:23.735684 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d88dccbc-ece4-461c-ac0c-077a8b19a585 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:23.736011 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-d88dccbc-ece4-461c-ac0c-077a8b19a585 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Floating IP cae4026b-c341-42a2-96e8-3593ebcd953e disassociated (deleted). External IP: 172.25.8.104, port: 5befeada-1d07-4acc-be4a-c0cf3f8b7240. May 12 15:58:24.080881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d88dccbc-ece4-461c-ac0c-077a8b19a585 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Router c4a7b7e0-fe66-4b58-a3e2-7e635585791d has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:58:24.258059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d88dccbc-ece4-461c-ac0c-077a8b19a585 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:58:24.270080 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f03e7b27-4a7d-4cd9-ba07-f8dcb4faff20 None None] Sync routers for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:58:24.273917 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d88dccbc-ece4-461c-ac0c-077a8b19a585 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:24.280440 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f03e7b27-4a7d-4cd9-ba07-f8dcb4faff20 None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:58:24.281188 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f03e7b27-4a7d-4cd9-ba07-f8dcb4faff20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:58:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:24.329867 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d88dccbc-ece4-461c-ac0c-077a8b19a585 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "DELETE /v2.0/floatingips/cae4026b-c341-42a2-96e8-3593ebcd953e HTTP/1.1" status: 204 len: 168 time: 1.4853570 May 12 15:58:24.330528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'tag': '5befeada-1d07-4acc-be4a-c0cf3f8b7240'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:58:24.377307 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-bea5d841-5db8-462c-9ab5-9d82ee9f8d4b'] response: {'name': 'network-changed', 'server_uuid': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'tag': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'status': 'completed', 'code': 200} May 12 15:58:24.501826 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-f03e7b27-4a7d-4cd9-ba07-f8dcb4faff20 None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:58:24.504111 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1be80a3-2ded-46da-ae7b-f6c34905931b req-372928dd-86d6-409e-ade8-4925d844acf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:24.506154 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1be80a3-2ded-46da-ae7b-f6c34905931b req-372928dd-86d6-409e-ade8-4925d844acf4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 1096 time: 0.0732031 May 12 15:58:24.710574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1be80a3-2ded-46da-ae7b-f6c34905931b req-80592aaf-dbc8-4e5a-9426-795a7b71662d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:24.712008 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1be80a3-2ded-46da-ae7b-f6c34905931b req-80592aaf-dbc8-4e5a-9426-795a7b71662d service neutron] 10.222.0.84 "GET /v2.0/networks?id=d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 200 len: 913 time: 0.1871212 May 12 15:58:24.785266 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1be80a3-2ded-46da-ae7b-f6c34905931b req-b5dc69ee-83cb-49f3-8390-7708f82e9d10 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5befeada-1d07-4acc-be4a-c0cf3f8b7240 HTTP/1.1" status: 200 len: 217 time: 0.0656941 May 12 15:58:24.824008 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f03e7b27-4a7d-4cd9-ba07-f8dcb4faff20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:24.827756 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f03e7b27-4a7d-4cd9-ba07-f8dcb4faff20 None None] Checking router: c4a7b7e0-fe66-4b58-a3e2-7e635585791d for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:58:24.832595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36354246-8fb1-42c6-8b1e-912bf593927f req-7301a6b1-cce8-4cac-b553-93e24348c566 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:24.834057 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-36354246-8fb1-42c6-8b1e-912bf593927f req-7301a6b1-cce8-4cac-b553-93e24348c566 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 945 time: 0.2064421 May 12 15:58:24.835873 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f03e7b27-4a7d-4cd9-ba07-f8dcb4faff20 None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:58:24.836469 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f03e7b27-4a7d-4cd9-ba07-f8dcb4faff20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:58:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:24.886565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1be80a3-2ded-46da-ae7b-f6c34905931b req-2e037d86-70a5-4ce0-b568-43d3669ca0af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:24.888278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1be80a3-2ded-46da-ae7b-f6c34905931b req-2e037d86-70a5-4ce0-b568-43d3669ca0af service neutron] 10.222.0.84 "GET /v2.0/subnets?id=020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 200 len: 851 time: 0.0958178 May 12 15:58:24.937659 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-36354246-8fb1-42c6-8b1e-912bf593927f req-55d97506-cd56-4637-a8a9-ef26d07d42bc tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0924978 May 12 15:58:24.976572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1be80a3-2ded-46da-ae7b-f6c34905931b req-147f4773-2225-4f5d-8241-af668a37d209 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:24.978075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1be80a3-2ded-46da-ae7b-f6c34905931b req-147f4773-2225-4f5d-8241-af668a37d209 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d13f4c27-5358-4d60-abb1-0c94e69df718&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0832651 May 12 15:58:25.013875 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-f03e7b27-4a7d-4cd9-ba07-f8dcb4faff20 None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:58:25.113099 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1be80a3-2ded-46da-ae7b-f6c34905931b req-1d923314-f302-4639-855c-c7fd81ab5778 service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1277559 May 12 15:58:25.254818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1be80a3-2ded-46da-ae7b-f6c34905931b req-68a5a7a9-cb01-4555-bd14-9f06c87a156b service neutron] 10.222.0.84 "GET /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1344156 May 12 15:58:25.331296 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-f03e7b27-4a7d-4cd9-ba07-f8dcb4faff20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:25.335081 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f03e7b27-4a7d-4cd9-ba07-f8dcb4faff20 None None] The sync data for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 is: [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:48:15Z', 'revision_number': 4, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '20864bd6-8986-4ba2-bb53-6f32c19879a5', 'name': '', 'network_id': 'd13f4c27-5358-4d60-abb1-0c94e69df718', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'mac_address': 'fa:16:3e:f5:64:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_interface', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': '020f79af-22ce-41ca-91a6-931258be2176', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:14Z', 'updated_at': '2022-05-12T15:48:24Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'subnets': [{'id': '020f79af-22ce-41ca-91a6-931258be2176', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:58:25.547786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-064d44a6-fca6-4978-a86b-700e0fd1cc10 None None] New status for floating IP cae4026b-c341-42a2-96e8-3593ebcd953e: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 15:58:26.283797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e7fd0a-c68a-49fe-abc0-8ab52b19bf28 req-6ee79b7a-b9f6-44d4-a8d4-70fd6c3ba424 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:26.285418 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04e7fd0a-c68a-49fe-abc0-8ab52b19bf28 req-6ee79b7a-b9f6-44d4-a8d4-70fd6c3ba424 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 945 time: 0.0854344 May 12 15:58:26.329086 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04e7fd0a-c68a-49fe-abc0-8ab52b19bf28 req-dc4ec671-80ea-459a-b53d-2a88e8d68b07 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/security-groups?id=d3930bee-f9c9-401c-921a-1058f06217af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382106 May 12 15:58:26.678170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab6cc8af-8c3e-4dd6-be85-8f0924628f2e req-f0bff372-4d32-4649-8d7d-64a2c200f249 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:26.679486 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab6cc8af-8c3e-4dd6-be85-8f0924628f2e req-f0bff372-4d32-4649-8d7d-64a2c200f249 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.84 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 945 time: 0.0824387 May 12 15:58:26.752353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-ab6cc8af-8c3e-4dd6-be85-8f0924628f2e req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Deleting port 5befeada-1d07-4acc-be4a-c0cf3f8b7240 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:26.752680 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ab6cc8af-8c3e-4dd6-be85-8f0924628f2e req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:27.093047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-ab6cc8af-8c3e-4dd6-be85-8f0924628f2e req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] For port 5befeada-1d07-4acc-be4a-c0cf3f8b7240, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=5befeada-1d07-4acc-be4a-c0cf3f8b7240,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:58:27.093413 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ab6cc8af-8c3e-4dd6-be85-8f0924628f2e req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:27.211248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-ab6cc8af-8c3e-4dd6-be85-8f0924628f2e req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Calling delete_port for 5befeada-1d07-4acc-be4a-c0cf3f8b7240 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:58:27.354203 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ab6cc8af-8c3e-4dd6-be85-8f0924628f2e req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:27.403677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event deleted for resources: {'Port': ['ID=5befeada-1d07-4acc-be4a-c0cf3f8b7240,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:27.445295 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:27.445653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:27.445979 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:27.446299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:27.446617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:27.447445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:27.447754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:27.448062 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:27.448367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:27.448674 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:27.448975 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:27.449276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:58:27.526184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-ab6cc8af-8c3e-4dd6-be85-8f0924628f2e req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] No DVR routers for this DVR port 5befeada-1d07-4acc-be4a-c0cf3f8b7240 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:58:27.529190 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a24302f8-f09d-46c5-b37b-4e5bcce8e932 req-889bdb25-0ec7-4c8a-b00f-cec297fff6a8 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 210 time: 0.0771027 May 12 15:58:27.530133 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-ab6cc8af-8c3e-4dd6-be85-8f0924628f2e req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:27.532604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'name': 'network-vif-deleted', 'tag': '5befeada-1d07-4acc-be4a-c0cf3f8b7240'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:58:27.545191 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ab6cc8af-8c3e-4dd6-be85-8f0924628f2e req-f0fc7d6e-b875-4394-9988-501d602c49a0 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.84 "DELETE /v2.0/ports/5befeada-1d07-4acc-be4a-c0cf3f8b7240 HTTP/1.1" status: 204 len: 173 time: 0.8568728 May 12 15:58:27.577667 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b2cfd667-6354-459d-9aec-633832113cde'] response: {'server_uuid': 'c855b4df-b811-47dd-bdd8-9d070a3d24a5', 'name': 'network-vif-deleted', 'tag': '5befeada-1d07-4acc-be4a-c0cf3f8b7240', 'status': 'completed', 'code': 200} May 12 15:58:28.695784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-465f5068-d3eb-45b6-85c2-633a00c51075 req-366325ff-5fe8-49ce-b7ba-5653c86e985d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Synchronizing usage tracker for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:58:28.711717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-465f5068-d3eb-45b6-85c2-633a00c51075 req-366325ff-5fe8-49ce-b7ba-5653c86e985d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Unset dirty status for tenant:939000b7f70c4c85a39e52ee93a06ed5 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:58:28.712900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-465f5068-d3eb-45b6-85c2-633a00c51075 req-366325ff-5fe8-49ce-b7ba-5653c86e985d tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "GET /v2.0/ports?device_id=c855b4df-b811-47dd-bdd8-9d070a3d24a5 HTTP/1.1" status: 200 len: 210 time: 0.0620489 May 12 15:58:28.945936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 5befeada-1d07-4acc-be4a-c0cf3f8b7240 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:58:28.983758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 5befeada-1d07-4acc-be4a-c0cf3f8b7240 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:58:28.984094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 5befeada-1d07-4acc-be4a-c0cf3f8b7240 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:58:29.809037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51824) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:29.967116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-450ae6dd-10a5-4d90-acce-6f603a47a138 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Deleting port 49329db0-848e-4438-961e-2267d53ecaef {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:29.967451 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-450ae6dd-10a5-4d90-acce-6f603a47a138 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:30.258265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-450ae6dd-10a5-4d90-acce-6f603a47a138 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:30.258519 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-450ae6dd-10a5-4d90-acce-6f603a47a138 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:30.379692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-450ae6dd-10a5-4d90-acce-6f603a47a138 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Calling delete_port for 49329db0-848e-4438-961e-2267d53ecaef owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:58:30.518143 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-450ae6dd-10a5-4d90-acce-6f603a47a138 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:30.565280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-450ae6dd-10a5-4d90-acce-6f603a47a138 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event deleted for resources: {'Port': ['ID=49329db0-848e-4438-961e-2267d53ecaef,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:30.655237 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-450ae6dd-10a5-4d90-acce-6f603a47a138 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:30.673576 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-450ae6dd-10a5-4d90-acce-6f603a47a138 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:30.674700 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-450ae6dd-10a5-4d90-acce-6f603a47a138 tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "DELETE /v2.0/floatingips/fcac9fd6-a5ce-480f-8a2c-b0c706cb64ec HTTP/1.1" status: 204 len: 168 time: 0.8645909 May 12 15:58:32.712967 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:33.115677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 51840) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:33.184674 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5f124bad-c71c-4de6-9fe7-f5e7c7e5892e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:33.214729 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5f124bad-c71c-4de6-9fe7-f5e7c7e5892e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:33.281819 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5f124bad-c71c-4de6-9fe7-f5e7c7e5892e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:33.301779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f124bad-c71c-4de6-9fe7-f5e7c7e5892e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3930bee-f9c9-401c-921a-1058f06217af,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:33.313108 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5f124bad-c71c-4de6-9fe7-f5e7c7e5892e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:33.314260 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5f124bad-c71c-4de6-9fe7-f5e7c7e5892e tempest-TestVolumeBootPattern-375804785 tempest-TestVolumeBootPattern-375804785-project] 10.222.0.82 "DELETE /v2.0/security-groups/d3930bee-f9c9-401c-921a-1058f06217af HTTP/1.1" status: 204 len: 168 time: 0.1975982 May 12 15:58:34.380536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51848) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:35.053911 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f2a13c9-64f8-4df1-a05c-f1103d9a485f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:35.401239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9f2a13c9-64f8-4df1-a05c-f1103d9a485f admin admin] Deleting port 20864bd6-8986-4ba2-bb53-6f32c19879a5 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:35.401889 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f2a13c9-64f8-4df1-a05c-f1103d9a485f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:35.684051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-9f2a13c9-64f8-4df1-a05c-f1103d9a485f admin admin] For port 20864bd6-8986-4ba2-bb53-6f32c19879a5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=20864bd6-8986-4ba2-bb53-6f32c19879a5,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:58:35.684312 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f2a13c9-64f8-4df1-a05c-f1103d9a485f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:35.804739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9f2a13c9-64f8-4df1-a05c-f1103d9a485f admin admin] Calling delete_port for 20864bd6-8986-4ba2-bb53-6f32c19879a5 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:58:35.977860 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f2a13c9-64f8-4df1-a05c-f1103d9a485f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:36.028556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f2a13c9-64f8-4df1-a05c-f1103d9a485f admin admin] Pushing event deleted for resources: {'Port': ['ID=20864bd6-8986-4ba2-bb53-6f32c19879a5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:36.293803 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f2a13c9-64f8-4df1-a05c-f1103d9a485f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:36.648978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9f2a13c9-64f8-4df1-a05c-f1103d9a485f admin admin] Router c4a7b7e0-fe66-4b58-a3e2-7e635585791d has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:58:36.957330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9f2a13c9-64f8-4df1-a05c-f1103d9a485f admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:58:36.966167 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-007bf224-61a5-4a1f-9ba3-a5dd42afbb5c None None] Sync routers for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:58:36.969578 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9f2a13c9-64f8-4df1-a05c-f1103d9a485f admin admin] 10.222.0.82 "PUT /v2.0/routers/c4a7b7e0-fe66-4b58-a3e2-7e635585791d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5879550 May 12 15:58:36.972024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51854) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:36.978089 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-007bf224-61a5-4a1f-9ba3-a5dd42afbb5c None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:58:36.979286 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-007bf224-61a5-4a1f-9ba3-a5dd42afbb5c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:58:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:37.146527 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:37.158164 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-007bf224-61a5-4a1f-9ba3-a5dd42afbb5c None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:58:37.335179 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:37.346406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] Deleting port 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:37.346777 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:37.475473 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-007bf224-61a5-4a1f-9ba3-a5dd42afbb5c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209'}], 'enable_snat': True}, 'gw_port_id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:58:35Z', 'revision_number': 5, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port': {'id': '27013f92-3ec2-4c63-a09f-c5fb5ef8f397', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:08Z', 'updated_at': '2022-05-12T15:48:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:37.480163 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-007bf224-61a5-4a1f-9ba3-a5dd42afbb5c None None] Checking router: c4a7b7e0-fe66-4b58-a3e2-7e635585791d for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:58:37.490163 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-007bf224-61a5-4a1f-9ba3-a5dd42afbb5c None None] Routers {'c4a7b7e0-fe66-4b58-a3e2-7e635585791d'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:58:37.490755 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-007bf224-61a5-4a1f-9ba3-a5dd42afbb5c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:58:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:37.533560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] For port 27013f92-3ec2-4c63-a09f-c5fb5ef8f397, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=27013f92-3ec2-4c63-a09f-c5fb5ef8f397,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:58:37.533869 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:37.640691 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-007bf224-61a5-4a1f-9ba3-a5dd42afbb5c None None] Set router c4a7b7e0-fe66-4b58-a3e2-7e635585791d gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:58:37.663636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] Calling delete_port for 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:58:37.749087 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-007bf224-61a5-4a1f-9ba3-a5dd42afbb5c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:58:37Z', 'revision_number': 6, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:37.753134 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-007bf224-61a5-4a1f-9ba3-a5dd42afbb5c None None] The sync data for ids ['c4a7b7e0-fe66-4b58-a3e2-7e635585791d'] in n-d-841483-1 is: [{'id': 'c4a7b7e0-fe66-4b58-a3e2-7e635585791d', 'name': 'tempest-TestVolumeBootPattern-1403548621-router', 'tenant_id': '939000b7f70c4c85a39e52ee93a06ed5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:07Z', 'updated_at': '2022-05-12T15:58:37Z', 'revision_number': 6, 'project_id': '939000b7f70c4c85a39e52ee93a06ed5', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:58:37.857995 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:37.908894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] Pushing event deleted for resources: {'Port': ['ID=27013f92-3ec2-4c63-a09f-c5fb5ef8f397,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:38.001943 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:38.195910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 20864bd6-8986-4ba2-bb53-6f32c19879a5 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:58:38.196406 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:38.198702 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:38.232212 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:38.232833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] Fanout notify agent at l3_agent the message router_deleted on router c4a7b7e0-fe66-4b58-a3e2-7e635585791d {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:58:38.233838 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 20864bd6-8986-4ba2-bb53-6f32c19879a5 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:58:38.234384 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 20864bd6-8986-4ba2-bb53-6f32c19879a5 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:58:38.250979 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:38.252215 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2a7b114e-deb5-4319-826f-0bc7600a0530 admin admin] 10.222.0.82 "DELETE /v2.0/routers/c4a7b7e0-fe66-4b58-a3e2-7e635585791d HTTP/1.1" status: 204 len: 168 time: 1.2792354 May 12 15:58:38.254698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51858) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:38.318833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-ecb134c8-e70e-41af-9450-19754de2dae7 admin admin] Deleting subnet 020f79af-22ce-41ca-91a6-931258be2176 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:58:38.322309 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecb134c8-e70e-41af-9450-19754de2dae7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:38.369737 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecb134c8-e70e-41af-9450-19754de2dae7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:38.566404 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecb134c8-e70e-41af-9450-19754de2dae7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:38.632340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecb134c8-e70e-41af-9450-19754de2dae7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:38.670150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecb134c8-e70e-41af-9450-19754de2dae7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=020f79af-22ce-41ca-91a6-931258be2176,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:38.673486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ecb134c8-e70e-41af-9450-19754de2dae7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:38.679316 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ecb134c8-e70e-41af-9450-19754de2dae7 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/020f79af-22ce-41ca-91a6-931258be2176 HTTP/1.1" status: 204 len: 168 time: 0.4235864 May 12 15:58:38.679538 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17241d06-9be9-40a7-b122-14f12f45802b None None] Network d13f4c27-5358-4d60-abb1-0c94e69df718 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:58:38.682657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51862) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:38.795641 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:38.807008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Deleting port 49246c67-1781-44e0-b588-1ca9a8bb37de {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:38.810232 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:39.004890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8f6dc43-a1be-4578-ae7d-849e8b96b76b None None] DHCP port deletion for d13f4c27-5358-4d60-abb1-0c94e69df718 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:58:39.009130 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a8f6dc43-a1be-4578-ae7d-849e8b96b76b None None] Deleting port 49246c67-1781-44e0-b588-1ca9a8bb37de {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:39.010554 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a8f6dc43-a1be-4578-ae7d-849e8b96b76b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:39.017508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] For port 49246c67-1781-44e0-b588-1ca9a8bb37de, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=49246c67-1781-44e0-b588-1ca9a8bb37de,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:58:39.017867 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:39.142040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Calling delete_port for 49246c67-1781-44e0-b588-1ca9a8bb37de owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:58:39.220275 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:39.221554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a8f6dc43-a1be-4578-ae7d-849e8b96b76b None None] For port 49246c67-1781-44e0-b588-1ca9a8bb37de, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=49246c67-1781-44e0-b588-1ca9a8bb37de,segment=NetworkSegment(df75c3d3-8e48-420e-8a5f-7e8bc6400515),segment_id=df75c3d3-8e48-420e-8a5f-7e8bc6400515)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:58:39.222054 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a8f6dc43-a1be-4578-ae7d-849e8b96b76b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:39.273910 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] No DVR routers for this DVR port 49246c67-1781-44e0-b588-1ca9a8bb37de on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:58:39.275477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Pushing event deleted for resources: {'Port': ['ID=49246c67-1781-44e0-b588-1ca9a8bb37de,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:39.351879 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a8f6dc43-a1be-4578-ae7d-849e8b96b76b None None] Calling delete_port for 49246c67-1781-44e0-b588-1ca9a8bb37de owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:58:39.393308 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:39.420197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d13f4c27-5358-4d60-abb1-0c94e69df718']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:39.424595 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-a8f6dc43-a1be-4578-ae7d-849e8b96b76b None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:58:39.424943 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-a8f6dc43-a1be-4578-ae7d-849e8b96b76b None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:58:39.432354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'df75c3d3-8e48-420e-8a5f-7e8bc6400515') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:39.432647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'df75c3d3-8e48-420e-8a5f-7e8bc6400515') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:39.443927 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:39.459609 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:39.466056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Releasing vlan 566 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:58:39.466442 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: timer() May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:58:39.479189 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:58:39.554353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:39.569895 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:39.581534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] Pushing event deleted for resources: {'Network': ['ID=d13f4c27-5358-4d60-abb1-0c94e69df718,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:39.594309 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-51a5066a-ecc2-4f42-8ed1-f20ae8d5340c admin admin] 10.222.0.82 "DELETE /v2.0/networks/d13f4c27-5358-4d60-abb1-0c94e69df718 HTTP/1.1" status: 204 len: 168 time: 0.9106874 May 12 15:58:39.597138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51866) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:39.926391 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a8f6dc43-a1be-4578-ae7d-849e8b96b76b None None] Deleting port 49246c67-1781-44e0-b588-1ca9a8bb37de {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:39.926770 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a8f6dc43-a1be-4578-ae7d-849e8b96b76b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:40.000592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a8f6dc43-a1be-4578-ae7d-849e8b96b76b None None] The port '49246c67-1781-44e0-b588-1ca9a8bb37de' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:58:40.068198 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 49246c67-1781-44e0-b588-1ca9a8bb37de no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:58:40.102125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 49246c67-1781-44e0-b588-1ca9a8bb37de {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:58:40.102466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 49246c67-1781-44e0-b588-1ca9a8bb37de not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:58:40.102880 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:58:40.136395 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:58:40.136735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 27013f92-3ec2-4c63-a09f-c5fb5ef8f397 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:58:40.248366 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e98fa44-fb21-4fb9-9794-560840c6a58e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:40.595376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4e98fa44-fb21-4fb9-9794-560840c6a58e admin admin] Deleting port 197f9cef-8851-4e66-915d-5daabb37cd45 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:40.595621 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e98fa44-fb21-4fb9-9794-560840c6a58e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:40.768527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-4e98fa44-fb21-4fb9-9794-560840c6a58e admin admin] For port 197f9cef-8851-4e66-915d-5daabb37cd45, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=197f9cef-8851-4e66-915d-5daabb37cd45,segment=NetworkSegment(b08993ad-0765-41fc-9d7e-0a9c098fbc64),segment_id=b08993ad-0765-41fc-9d7e-0a9c098fbc64)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:58:40.768881 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e98fa44-fb21-4fb9-9794-560840c6a58e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:40.889418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4e98fa44-fb21-4fb9-9794-560840c6a58e admin admin] Calling delete_port for 197f9cef-8851-4e66-915d-5daabb37cd45 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:58:41.072569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e98fa44-fb21-4fb9-9794-560840c6a58e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:41.120808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e98fa44-fb21-4fb9-9794-560840c6a58e admin admin] Pushing event deleted for resources: {'Port': ['ID=197f9cef-8851-4e66-915d-5daabb37cd45,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:41.389979 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4e98fa44-fb21-4fb9-9794-560840c6a58e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:41.860631 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4e98fa44-fb21-4fb9-9794-560840c6a58e admin admin] Router 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 15:58:42.040937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4e98fa44-fb21-4fb9-9794-560840c6a58e admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 15:58:42.050548 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4e98fa44-fb21-4fb9-9794-560840c6a58e admin admin] 10.222.0.82 "PUT /v2.0/routers/4b0ad84c-7e1e-4b79-881d-e1a2d280d891/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4524186 May 12 15:58:42.052353 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfb11ba8-fe17-455d-8ab5-c2dee7a52e90 None None] Sync routers for ids ['4b0ad84c-7e1e-4b79-881d-e1a2d280d891'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 15:58:42.054439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51870) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:42.065243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfb11ba8-fe17-455d-8ab5-c2dee7a52e90 None None] Routers {'4b0ad84c-7e1e-4b79-881d-e1a2d280d891'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:58:42.066553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dfb11ba8-fe17-455d-8ab5-c2dee7a52e90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:58:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['4b0ad84c-7e1e-4b79-881d-e1a2d280d891'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:42.231052 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:42.249536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-dfb11ba8-fe17-455d-8ab5-c2dee7a52e90 None None] Set router 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:58:42.409574 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:42.421738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] Deleting port fb368f25-f1fa-4eb7-8109-23e3550d259f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:42.422119 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:42.536572 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dfb11ba8-fe17-455d-8ab5-c2dee7a52e90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'name': 'tempest-TestVolumeBootPattern-1714193566-router', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211'}], 'enable_snat': True}, 'gw_port_id': 'fb368f25-f1fa-4eb7-8109-23e3550d259f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:22Z', 'updated_at': '2022-05-12T15:58:41Z', 'revision_number': 5, 'project_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'gw_port': {'id': 'fb368f25-f1fa-4eb7-8109-23e3550d259f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:9e:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3986, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T15:48:25Z', 'updated_at': '2022-05-12T15:48:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:42.540346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfb11ba8-fe17-455d-8ab5-c2dee7a52e90 None None] Checking router: 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 15:58:42.549488 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfb11ba8-fe17-455d-8ab5-c2dee7a52e90 None None] Routers {'4b0ad84c-7e1e-4b79-881d-e1a2d280d891'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 15:58:42.550086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dfb11ba8-fe17-455d-8ab5-c2dee7a52e90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T15:58:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['4b0ad84c-7e1e-4b79-881d-e1a2d280d891'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:42.595392 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] For port fb368f25-f1fa-4eb7-8109-23e3550d259f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=fb368f25-f1fa-4eb7-8109-23e3550d259f,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:58:42.595743 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:42.722078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] Calling delete_port for fb368f25-f1fa-4eb7-8109-23e3550d259f owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:58:42.739436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-dfb11ba8-fe17-455d-8ab5-c2dee7a52e90 None None] Set router 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 15:58:42.849565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-dfb11ba8-fe17-455d-8ab5-c2dee7a52e90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'name': 'tempest-TestVolumeBootPattern-1714193566-router', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:22Z', 'updated_at': '2022-05-12T15:58:42Z', 'revision_number': 6, 'project_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:42.859955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfb11ba8-fe17-455d-8ab5-c2dee7a52e90 None None] The sync data for ids ['4b0ad84c-7e1e-4b79-881d-e1a2d280d891'] in n-d-841483-1 is: [{'id': '4b0ad84c-7e1e-4b79-881d-e1a2d280d891', 'name': 'tempest-TestVolumeBootPattern-1714193566-router', 'tenant_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T15:48:22Z', 'updated_at': '2022-05-12T15:58:42Z', 'revision_number': 6, 'project_id': 'b9e092935fcb4a6aa088e881bf1641c3', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 15:58:42.863595 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7cbed5de-17bb-4c62-a268-e2883f8ce852 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:42.898397 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:43.071460 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] Pushing event deleted for resources: {'Port': ['ID=fb368f25-f1fa-4eb7-8109-23e3550d259f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:43.158229 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:43.332884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:43.335089 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:43.361473 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:43.361983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4b0ad84c-7e1e-4b79-881d-e1a2d280d891 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 15:58:43.374295 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:43.375394 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-348cac69-9749-416c-b711-d31bc17107d3 admin admin] 10.222.0.82 "DELETE /v2.0/routers/4b0ad84c-7e1e-4b79-881d-e1a2d280d891 HTTP/1.1" status: 204 len: 168 time: 1.3200691 May 12 15:58:43.378018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51874) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:43.436726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-ad7a8570-4344-48cd-9972-65317c53fb2b admin admin] Deleting subnet f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 15:58:43.439781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad7a8570-4344-48cd-9972-65317c53fb2b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:43.489252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad7a8570-4344-48cd-9972-65317c53fb2b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:43.543460 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:43.571619 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad7a8570-4344-48cd-9972-65317c53fb2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:43.652323 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad7a8570-4344-48cd-9972-65317c53fb2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:43.691070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad7a8570-4344-48cd-9972-65317c53fb2b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:43.695149 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad7a8570-4344-48cd-9972-65317c53fb2b admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:43.703208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c47cc843-3335-441b-8897-c2ac72b429d7 None None] Network 0eeaef15-2568-445a-9d02-7051964139fe requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:58:43.706280 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ad7a8570-4344-48cd-9972-65317c53fb2b admin admin] 10.222.0.82 "DELETE /v2.0/subnets/f19c0ff5-b9e0-47ee-a678-f7b4ab5db12e HTTP/1.1" status: 204 len: 168 time: 0.3272064 May 12 15:58:43.708634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51878) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:43.814094 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:43.824907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Deleting port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:43.825236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:43.965908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ab9a484-9496-45e0-ad51-5197571b546b None None] DHCP port deletion for 0eeaef15-2568-445a-9d02-7051964139fe request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 15:58:43.970234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4ab9a484-9496-45e0-ad51-5197571b546b None None] Deleting port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:43.970605 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4ab9a484-9496-45e0-ad51-5197571b546b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:44.045660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] For port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02,segment=NetworkSegment(b08993ad-0765-41fc-9d7e-0a9c098fbc64),segment_id=b08993ad-0765-41fc-9d7e-0a9c098fbc64)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:58:44.046021 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:44.074500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fb368f25-f1fa-4eb7-8109-23e3550d259f no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:58:44.112840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: fb368f25-f1fa-4eb7-8109-23e3550d259f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:58:44.113176 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device fb368f25-f1fa-4eb7-8109-23e3550d259f not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:58:44.113611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:58:44.169328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Calling delete_port for 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:58:44.250737 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:44.262014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No active binding found for port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 {{(pid=88153) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:224}} May 12 15:58:44.262410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:58:44.262810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 197f9cef-8851-4e66-915d-5daabb37cd45 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:58:44.302488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Pushing event deleted for resources: {'Port': ['ID=3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:44.303109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 197f9cef-8851-4e66-915d-5daabb37cd45 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:58:44.304285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] No DVR routers for this DVR port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:58:44.304404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 197f9cef-8851-4e66-915d-5daabb37cd45 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:58:44.312904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4ab9a484-9496-45e0-ad51-5197571b546b None None] For port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02,segment=NetworkSegment(b08993ad-0765-41fc-9d7e-0a9c098fbc64),segment_id=b08993ad-0765-41fc-9d7e-0a9c098fbc64)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:58:44.313298 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4ab9a484-9496-45e0-ad51-5197571b546b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:44.422316 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:44.437851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4ab9a484-9496-45e0-ad51-5197571b546b None None] Calling delete_port for 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:58:44.447638 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0eeaef15-2568-445a-9d02-7051964139fe']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:44.459661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b08993ad-0765-41fc-9d7e-0a9c098fbc64') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:44.459957 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b08993ad-0765-41fc-9d7e-0a9c098fbc64') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 15:58:44.472026 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:44.489077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:44.495439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Releasing vlan 557 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 15:58:44.495861 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: timer() May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: self._notify() May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 15:58:44.508820 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 15:58:44.511518 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-4ab9a484-9496-45e0-ad51-5197571b546b None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 15:58:44.511518 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-4ab9a484-9496-45e0-ad51-5197571b546b None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 15:58:44.584732 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:44.602786 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:44.614242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] Pushing event deleted for resources: {'Network': ['ID=0eeaef15-2568-445a-9d02-7051964139fe,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:44.617044 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cf6088a4-78ea-4cd8-89d4-a5c9fc0b9141 admin admin] 10.222.0.82 "DELETE /v2.0/networks/0eeaef15-2568-445a-9d02-7051964139fe HTTP/1.1" status: 204 len: 168 time: 0.9074843 May 12 15:58:44.746194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51884) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:44.797461 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d9a4cfea-7afb-4c58-99d2-480bb106104a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=939000b7f70c4c85a39e52ee93a06ed5&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0500360 May 12 15:58:44.799805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51888) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:44.860779 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2cc36d3d-23c6-4d6d-86a4-38c59216e062 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:44.885678 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2cc36d3d-23c6-4d6d-86a4-38c59216e062 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:44.937259 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2cc36d3d-23c6-4d6d-86a4-38c59216e062 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:44.954919 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cc36d3d-23c6-4d6d-86a4-38c59216e062 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=222fbe49-cc04-4730-9bd7-c945c6e93703,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:44.961539 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2cc36d3d-23c6-4d6d-86a4-38c59216e062 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:44.963403 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2cc36d3d-23c6-4d6d-86a4-38c59216e062 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/222fbe49-cc04-4730-9bd7-c945c6e93703 HTTP/1.1" status: 204 len: 168 time: 0.1627073 May 12 15:58:45.010634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4ab9a484-9496-45e0-ad51-5197571b546b None None] Deleting port 3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:58:45.011144 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4ab9a484-9496-45e0-ad51-5197571b546b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:45.079523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4ab9a484-9496-45e0-ad51-5197571b546b None None] The port '3b61cef1-35ad-44b2-a5f5-6c2e3e1f3d02' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 15:58:45.334519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51896) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:45.350885 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e87566f5-cca7-4ea9-b7b0-6b099903db9e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:45.381945 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0bb6191e-842e-44e5-a98d-8fc9700c57fb admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b9e092935fcb4a6aa088e881bf1641c3&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0463092 May 12 15:58:45.384865 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 51900) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:58:45.440688 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f91ccb53-9cb3-467b-8fdd-c9440f8928b3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:45.468668 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f91ccb53-9cb3-467b-8fdd-c9440f8928b3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:45.520521 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f91ccb53-9cb3-467b-8fdd-c9440f8928b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:45.537557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f91ccb53-9cb3-467b-8fdd-c9440f8928b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0598dde3-111e-4ff0-b9f3-52316b280f00,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:58:45.541854 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f91ccb53-9cb3-467b-8fdd-c9440f8928b3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:45.543206 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f91ccb53-9cb3-467b-8fdd-c9440f8928b3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0598dde3-111e-4ff0-b9f3-52316b280f00 HTTP/1.1" status: 204 len: 168 time: 0.1571107 May 12 15:58:46.062413 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:46.323067 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:47.802283 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:58:50.968327 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:58:56.651155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-20dc791a-dbf6-4420-b8e7-8aa542b4cc2c tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=04a1367b6b634209b7f562f465b7e6ea&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0305882 May 12 15:58:56.799446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-6cd2e97b-97f2-497f-834a-c46340fd3bc3 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:58:56.800740 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-6cd2e97b-97f2-497f-834a-c46340fd3bc3 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1445141 May 12 15:58:56.816620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-de055303-da1f-43ec-aed1-dc789c58b5c1 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/quotas/04a1367b6b634209b7f562f465b7e6ea HTTP/1.1" status: 200 len: 375 time: 0.0095334 May 12 15:58:56.862342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-c6dbd6f6-323c-456f-8115-3caada3d3ed6 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=04a1367b6b634209b7f562f465b7e6ea&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0407522 May 12 15:58:58.047358 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-272e2e12-b7bf-4ca1-99a6-628b36fc002a req-b3a5a6ef-18ac-4534-aa9a-308930103d2d tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 210 time: 0.0421524 May 12 15:58:59.146442 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b9b8766-6c29-4ad4-90a2-b24eceb37de4 req-48a4f13a-d538-4311-b762-5536c9b66d97 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 210 time: 0.0454698 May 12 15:59:00.239569 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-220b6b84-b812-4f15-8be3-1aa65229834c req-359182d7-884b-416a-8f0b-231e6e9864b6 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 210 time: 0.0428562 May 12 15:59:01.345912 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8689f1db-a79c-426f-964e-b2e7c6dafbc0 req-63d3d518-527f-49d0-b004-db458b889969 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 210 time: 0.0429130 May 12 15:59:02.495615 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dfda61b7-f73e-4da3-989d-35f0bc7cd789 req-2a713046-d936-4020-914e-b907f92f091b tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 210 time: 0.0457919 May 12 15:59:02.728321 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:03.292103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-e92e31ce-ba4b-47ce-b3bf-683b2ea9a891 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=04a1367b6b634209b7f562f465b7e6ea&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0271828 May 12 15:59:03.448150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-5ccbd2a6-d096-4fff-946d-986031a00ac1 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:03.449799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-5ccbd2a6-d096-4fff-946d-986031a00ac1 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1524212 May 12 15:59:03.488097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Request body: {'port': {'device_id': 'd25ef8ca-d3c8-4466-b120-382d1fc04475', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'admin_state_up': True, 'tenant_id': '04a1367b6b634209b7f562f465b7e6ea'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:59:03.654595 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c20f830b-0c48-4358-88f3-2cdb63eabbe1 req-cc013b87-6da4-41be-99b8-ee4473043ec1 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 210 time: 0.0538387 May 12 15:59:03.662744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:59:03.666730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Usage tracker for resource:port and tenant:04a1367b6b634209b7f562f465b7e6ea is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:59:03.669567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:59:03.675101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:59:03.684376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Made reservation on behalf of 04a1367b6b634209b7f562f465b7e6ea for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:59:03.688279 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:03.701182 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:03.715456 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:59:03.719221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Usage tracker for resource:security_group_rule and tenant:04a1367b6b634209b7f562f465b7e6ea is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:59:03.722147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:59:03.728149 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:59:03.811120 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:03.814997 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:04.002891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e23ee998-c3fe-4890-a14d-8f8cceb5af11,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:04.085590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Allocated IP 192.168.233.138 (a44a68c4-7e98-4d43-8306-5fa007779c3c/dd1c7d4f-070b-4ce9-8969-e46d734b17c3/47436c18-bc15-4982-b5b9-08dead2d4032) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:59:04.287110 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:04.303043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Transition to ACTIVE for port object 47436c18-bc15-4982-b5b9-08dead2d4032 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:59:04.327843 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:04.398981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Network a44a68c4-7e98-4d43-8306-5fa007779c3c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:59:04.402632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:59:04.405236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:59:04.456581 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Pushing event updated for resources: {'Port': ['ID=47436c18-bc15-4982-b5b9-08dead2d4032,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:04.484415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:04.485031 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:04.511630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-abe4df42-ab52-463a-9782-98008a412329 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.0271311 May 12 15:59:04.536251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Request body: {'port': {'device_id': 'd25ef8ca-d3c8-4466-b120-382d1fc04475', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:59:04.644056 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:04.681079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fe8d6f4a-1dc0-4f00-996c-63454cde84b9 None None] Provisioning for port 47436c18-bc15-4982-b5b9-08dead2d4032 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:59:04.686184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fe8d6f4a-1dc0-4f00-996c-63454cde84b9 None None] Provisioning complete for port 47436c18-bc15-4982-b5b9-08dead2d4032 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:59:04.686553 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fe8d6f4a-1dc0-4f00-996c-63454cde84b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:04.745010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-fe8d6f4a-1dc0-4f00-996c-63454cde84b9 None None] Port 47436c18-bc15-4982-b5b9-08dead2d4032 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 15:59:04.967777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b95bea-51f5-4d0a-a3b5-0567d4993695 req-80ea664e-0131-4292-ae51-b5fe26900af3 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:04.968375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a8b95bea-51f5-4d0a-a3b5-0567d4993695 req-80ea664e-0131-4292-ae51-b5fe26900af3 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Synchronizing usage tracker for tenant:04a1367b6b634209b7f562f465b7e6ea on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:59:05.002250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a8b95bea-51f5-4d0a-a3b5-0567d4993695 req-80ea664e-0131-4292-ae51-b5fe26900af3 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Unset dirty status for tenant:04a1367b6b634209b7f562f465b7e6ea on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:59:05.003383 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8b95bea-51f5-4d0a-a3b5-0567d4993695 req-80ea664e-0131-4292-ae51-b5fe26900af3 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 936 time: 0.2305474 May 12 15:59:05.099736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 47436c18-bc15-4982-b5b9-08dead2d4032 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:59:05.108807 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a8b95bea-51f5-4d0a-a3b5-0567d4993695 req-07cebe79-44b3-4540-b408-dc5136877b9f tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Synchronizing usage tracker for tenant:04a1367b6b634209b7f562f465b7e6ea on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:59:05.112018 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:05.133578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Transition to ACTIVE for port object 47436c18-bc15-4982-b5b9-08dead2d4032 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:59:05.137759 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:05.172075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a8b95bea-51f5-4d0a-a3b5-0567d4993695 req-07cebe79-44b3-4540-b408-dc5136877b9f tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Unset dirty status for tenant:04a1367b6b634209b7f562f465b7e6ea on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:59:05.173189 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8b95bea-51f5-4d0a-a3b5-0567d4993695 req-07cebe79-44b3-4540-b408-dc5136877b9f tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/security-groups?id=e23ee998-c3fe-4890-a14d-8f8cceb5af11&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1601071 May 12 15:59:05.298406 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Pushing event updated for resources: {'Port': ['ID=47436c18-bc15-4982-b5b9-08dead2d4032,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:05.373092 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Attempting to bind port 47436c18-bc15-4982-b5b9-08dead2d4032 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:59:05.373444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Attempting to bind port 47436c18-bc15-4982-b5b9-08dead2d4032 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:59:05.373773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Attempting to bind port 47436c18-bc15-4982-b5b9-08dead2d4032 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:59:05.378276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Port 47436c18-bc15-4982-b5b9-08dead2d4032 on network a44a68c4-7e98-4d43-8306-5fa007779c3c not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:59:05.378588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Attempting to bind port 47436c18-bc15-4982-b5b9-08dead2d4032 on network a44a68c4-7e98-4d43-8306-5fa007779c3c {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:59:05.383539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 58, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:59:05.384521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Checking segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:59:05.384915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Bound using segment: {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:59:05.385332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Bound port: 47436c18-bc15-4982-b5b9-08dead2d4032, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8f9d8a6-0e4b-49d7-bae9-38499934da61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 556, 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:59:05.385692 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:05.475017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] For port 47436c18-bc15-4982-b5b9-08dead2d4032, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:59:05.478507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] For port 47436c18-bc15-4982-b5b9-08dead2d4032, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=47436c18-bc15-4982-b5b9-08dead2d4032,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:59:05.483172 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:05.543150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:05.543748 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:05.545096 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] 10.222.0.84 "PUT /v2.0/ports/47436c18-bc15-4982-b5b9-08dead2d4032 HTTP/1.1" status: 200 len: 1096 time: 1.0132773 May 12 15:59:05.545543 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd25ef8ca-d3c8-4466-b120-382d1fc04475', 'tag': '47436c18-bc15-4982-b5b9-08dead2d4032'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:59:05.565690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a00867d-54d5-4445-a01a-65c86bc8632b service neutron] Pushing event updated for resources: {'Port': ['ID=47436c18-bc15-4982-b5b9-08dead2d4032,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:05.595096 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8bb4c2ca-bc04-4bf0-a04a-a7c6de33dc36'] response: {'name': 'network-changed', 'server_uuid': 'd25ef8ca-d3c8-4466-b120-382d1fc04475', 'tag': '47436c18-bc15-4982-b5b9-08dead2d4032', 'status': 'completed', 'code': 200} May 12 15:59:05.694408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-42878567-e409-408c-b15d-78f64bb9afb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:05.696044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-42878567-e409-408c-b15d-78f64bb9afb8 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=04a1367b6b634209b7f562f465b7e6ea&device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 1099 time: 0.0785744 May 12 15:59:05.776439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-f358982d-070f-4a11-aea7-4078df568d8f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.138&port_id=47436c18-bc15-4982-b5b9-08dead2d4032 HTTP/1.1" status: 200 len: 217 time: 0.0601420 May 12 15:59:05.949445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-b34182e8-3c3d-4f9a-b918-8d04b856a4a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:05.950725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-b34182e8-3c3d-4f9a-b918-8d04b856a4a0 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.1646574 May 12 15:59:06.130793 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-ba9a38c5-f9ce-4e63-9b34-373d4426645f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:06.132241 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-ba9a38c5-f9ce-4e63-9b34-373d4426645f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.1746063 May 12 15:59:06.266750 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-2fbd9b7a-b0f9-4857-a313-8b552c11bc3c service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1261771 May 12 15:59:06.464754 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14ff1f6f-29ef-4b7a-90c0-d50b1e9ad34f req-9b7af012-cbbe-4ccc-bc93-82edbbaeebd9 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1877255 May 12 15:59:06.475563 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1bb2fba-3cd2-4404-987e-4ef8c643f0ff req-038f4cd6-3614-4721-ba20-ceb94a2c389f tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:06.476915 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1bb2fba-3cd2-4404-987e-4ef8c643f0ff req-038f4cd6-3614-4721-ba20-ceb94a2c389f tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 948 time: 0.1826026 May 12 15:59:06.522792 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1bb2fba-3cd2-4404-987e-4ef8c643f0ff req-501be274-8c44-426b-82ab-4434e3c6747e tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/security-groups?id=e23ee998-c3fe-4890-a14d-8f8cceb5af11&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395439 May 12 15:59:06.634319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d4c4e2-ccc7-4f43-858d-aef44377981f req-0b16f9cc-e83d-4434-8a13-83a059278413 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:06.635787 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34d4c4e2-ccc7-4f43-858d-aef44377981f req-0b16f9cc-e83d-4434-8a13-83a059278413 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=04a1367b6b634209b7f562f465b7e6ea&device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 1099 time: 0.0725033 May 12 15:59:06.766113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d4c4e2-ccc7-4f43-858d-aef44377981f req-ba67363d-2e2e-445d-bdf0-141d47ea9c32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:06.767537 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34d4c4e2-ccc7-4f43-858d-aef44377981f req-ba67363d-2e2e-445d-bdf0-141d47ea9c32 service neutron] 10.222.0.84 "GET /v2.0/networks?id=a44a68c4-7e98-4d43-8306-5fa007779c3c HTTP/1.1" status: 200 len: 870 time: 0.1253276 May 12 15:59:06.835585 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34d4c4e2-ccc7-4f43-858d-aef44377981f req-33ba8097-7680-4e34-b1ee-45e225cff2c3 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.138&port_id=47436c18-bc15-4982-b5b9-08dead2d4032 HTTP/1.1" status: 200 len: 217 time: 0.0599115 May 12 15:59:06.900402 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d4c4e2-ccc7-4f43-858d-aef44377981f req-3c7f707c-435e-432a-9d5a-546bdc28aa3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:06.901870 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34d4c4e2-ccc7-4f43-858d-aef44377981f req-3c7f707c-435e-432a-9d5a-546bdc28aa3a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=dd1c7d4f-070b-4ce9-8969-e46d734b17c3 HTTP/1.1" status: 200 len: 843 time: 0.0597630 May 12 15:59:06.979490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d4c4e2-ccc7-4f43-858d-aef44377981f req-1b3acda0-2023-4173-b1cb-8723054683b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:06.980992 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34d4c4e2-ccc7-4f43-858d-aef44377981f req-1b3acda0-2023-4173-b1cb-8723054683b9 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a44a68c4-7e98-4d43-8306-5fa007779c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1166 time: 0.0716040 May 12 15:59:07.115231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34d4c4e2-ccc7-4f43-858d-aef44377981f req-8cb0f64f-a38b-4adb-87c3-31eb3916b5a2 service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1273041 May 12 15:59:07.246368 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-34d4c4e2-ccc7-4f43-858d-aef44377981f req-41936ead-2306-4759-af59-1fac7b10225b service neutron] 10.222.0.84 "GET /v2.0/networks/a44a68c4-7e98-4d43-8306-5fa007779c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1242695 May 12 15:59:07.711566 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9c51ea-e008-4ae5-aa49-bc2ea63104a6 req-0e8948e7-67fa-41eb-a5b6-9792b71340c9 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:07.713036 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd9c51ea-e008-4ae5-aa49-bc2ea63104a6 req-0e8948e7-67fa-41eb-a5b6-9792b71340c9 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 948 time: 0.0844076 May 12 15:59:07.755961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd9c51ea-e008-4ae5-aa49-bc2ea63104a6 req-29cb1aba-8f95-4d16-a7bf-517c2cfc5958 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/security-groups?id=e23ee998-c3fe-4890-a14d-8f8cceb5af11&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372126 May 12 15:59:08.935395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eb48212-bff0-4ee5-9c86-8e70fd06e83f req-4d0792ed-2298-45f9-a6af-046e6d6ebc89 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:08.936817 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4eb48212-bff0-4ee5-9c86-8e70fd06e83f req-4d0792ed-2298-45f9-a6af-046e6d6ebc89 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 948 time: 0.0790491 May 12 15:59:08.980762 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4eb48212-bff0-4ee5-9c86-8e70fd06e83f req-25cc19c6-cf49-4663-9d15-997df2a20858 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/security-groups?id=e23ee998-c3fe-4890-a14d-8f8cceb5af11&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380771 May 12 15:59:09.166517 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 47436c18-bc15-4982-b5b9-08dead2d4032 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:59:09.297481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 47436c18-bc15-4982-b5b9-08dead2d4032, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=47436c18-bc15-4982-b5b9-08dead2d4032,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:59:09.310744 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '47436c18-bc15-4982-b5b9-08dead2d4032', 'network_id': 'a44a68c4-7e98-4d43-8306-5fa007779c3c', 'port_id': '47436c18-bc15-4982-b5b9-08dead2d4032', 'mac_address': 'fa:16:3e:7c:5c:9f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 556, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd1c7d4f-070b-4ce9-8969-e46d734b17c3', 'ip_address': '192.168.233.138'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:59:09.364398 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:09.380805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 47436c18-bc15-4982-b5b9-08dead2d4032 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:59:09.396030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 47436c18-bc15-4982-b5b9-08dead2d4032, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=47436c18-bc15-4982-b5b9-08dead2d4032,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:59:09.400410 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:09.504559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=47436c18-bc15-4982-b5b9-08dead2d4032,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:09.512223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:09.512560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:09.512917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:09.513245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:09.513597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:09.513921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:09.514265 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:09.514609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:09.514922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:09.515233 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:09.515546 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:09.515876 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:09.765932 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['47436c18-bc15-4982-b5b9-08dead2d4032'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:59:10.169773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b74f66e-1bd5-42c3-b9a2-5206685d45d8 req-ee129154-862a-4d33-bd1c-fd73f40f3af5 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:10.171209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b74f66e-1bd5-42c3-b9a2-5206685d45d8 req-ee129154-862a-4d33-bd1c-fd73f40f3af5 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 949 time: 0.0844185 May 12 15:59:10.216055 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b74f66e-1bd5-42c3-b9a2-5206685d45d8 req-49e115e6-3a84-4017-93ed-2c72735e8bfd tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/security-groups?id=e23ee998-c3fe-4890-a14d-8f8cceb5af11&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390491 May 12 15:59:11.165560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 47436c18-bc15-4982-b5b9-08dead2d4032 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:59:11.235219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 47436c18-bc15-4982-b5b9-08dead2d4032 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:59:11.240149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 47436c18-bc15-4982-b5b9-08dead2d4032 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:59:11.240525 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:11.362380 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:11.389970 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd25ef8ca-d3c8-4466-b120-382d1fc04475', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '47436c18-bc15-4982-b5b9-08dead2d4032'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:59:11.402273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 47436c18-bc15-4982-b5b9-08dead2d4032, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=47436c18-bc15-4982-b5b9-08dead2d4032,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:59:11.407417 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:11.410564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6fbc0b9-b845-4d06-b3e6-cf1fa7e0d001 req-d72668b2-e751-41d2-8dae-d58bd08dc6a7 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:11.412073 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f6fbc0b9-b845-4d06-b3e6-cf1fa7e0d001 req-d72668b2-e751-41d2-8dae-d58bd08dc6a7 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 949 time: 0.0892911 May 12 15:59:11.444460 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f75bc9fa-3d81-4244-91b0-c0427f41d292'] response: {'server_uuid': 'd25ef8ca-d3c8-4466-b120-382d1fc04475', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '47436c18-bc15-4982-b5b9-08dead2d4032', 'code': 200} May 12 15:59:11.459930 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f6fbc0b9-b845-4d06-b3e6-cf1fa7e0d001 req-5a980ea1-b7d9-4ffb-b4d3-45539ed3ed53 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/security-groups?id=e23ee998-c3fe-4890-a14d-8f8cceb5af11&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402553 May 12 15:59:11.475900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=47436c18-bc15-4982-b5b9-08dead2d4032,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:11.702900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c5775f1-8dc8-4fde-bd55-d8568d5ec725 req-423443ed-2f0c-48bd-881a-7cc7540fdf6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:11.704294 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c5775f1-8dc8-4fde-bd55-d8568d5ec725 req-423443ed-2f0c-48bd-881a-7cc7540fdf6c service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 1101 time: 0.1755304 May 12 15:59:11.746632 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c5775f1-8dc8-4fde-bd55-d8568d5ec725 req-64afa94d-e77c-4f30-9a69-a81b44571a2f service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=e23ee998-c3fe-4890-a14d-8f8cceb5af11&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329192 May 12 15:59:12.645034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a58a32b6-d1cf-4aee-88e6-e5d001cb0ccc req-526a1731-7b94-4f75-b7f4-4f4a2735859f tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:12.646402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a58a32b6-d1cf-4aee-88e6-e5d001cb0ccc req-526a1731-7b94-4f75-b7f4-4f4a2735859f tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 950 time: 0.0810499 May 12 15:59:12.691210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a58a32b6-d1cf-4aee-88e6-e5d001cb0ccc req-c9f9b74c-eb06-479a-9e56-9bf6be3efa4e tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/security-groups?id=e23ee998-c3fe-4890-a14d-8f8cceb5af11&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389707 May 12 15:59:12.806482 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-02ce1fad-11f0-40aa-bfc0-d8638cc46358 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:13.542916 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:13.876829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7686651a-d4cf-444b-b535-27c7e01ad39c req-a406eb9c-3e9d-49b5-974a-3d18b14bf705 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:13.878192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7686651a-d4cf-444b-b535-27c7e01ad39c req-a406eb9c-3e9d-49b5-974a-3d18b14bf705 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 950 time: 0.0782058 May 12 15:59:13.921372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7686651a-d4cf-444b-b535-27c7e01ad39c req-2b4f00e1-cc7e-4f85-adf6-ad9375cb75e9 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/security-groups?id=e23ee998-c3fe-4890-a14d-8f8cceb5af11&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376966 May 12 15:59:15.011791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dce79ac-20e2-4f33-be42-589148e47768 req-72c73d82-a795-4d3a-b074-b543fde7dc87 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:15.013147 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dce79ac-20e2-4f33-be42-589148e47768 req-72c73d82-a795-4d3a-b074-b543fde7dc87 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 950 time: 0.0887976 May 12 15:59:15.057759 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dce79ac-20e2-4f33-be42-589148e47768 req-e5b8fd2a-224a-4837-9980-7c2f3ddc0eca tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/security-groups?id=e23ee998-c3fe-4890-a14d-8f8cceb5af11&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389042 May 12 15:59:15.357531 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5fe30f6-b08f-49df-a542-6d3bd3a98b0c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:16.054771 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:16.247534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ab77de6-daea-4c6d-9c95-97a29a539786 req-744a47cf-4a27-437a-9684-3f3d6f31f38a tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:16.248961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ab77de6-daea-4c6d-9c95-97a29a539786 req-744a47cf-4a27-437a-9684-3f3d6f31f38a tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 950 time: 0.0801928 May 12 15:59:16.293283 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ab77de6-daea-4c6d-9c95-97a29a539786 req-be08946a-dec2-4601-afab-e175c94558b7 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/security-groups?id=e23ee998-c3fe-4890-a14d-8f8cceb5af11&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386579 May 12 15:59:16.323986 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:16.452319 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1eb2f8d-0c83-4599-95b4-1029bcc977cd req-a703e823-11bc-45c3-adbd-164333609971 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:16.453760 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1eb2f8d-0c83-4599-95b4-1029bcc977cd req-a703e823-11bc-45c3-adbd-164333609971 tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.84 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 950 time: 0.0837929 May 12 15:59:16.527971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-c1eb2f8d-0c83-4599-95b4-1029bcc977cd req-71195d3c-90df-44df-9a6a-0ce298c7eefb tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Deleting port 47436c18-bc15-4982-b5b9-08dead2d4032 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 15:59:16.528312 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c1eb2f8d-0c83-4599-95b4-1029bcc977cd req-71195d3c-90df-44df-9a6a-0ce298c7eefb tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:16.779465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-c1eb2f8d-0c83-4599-95b4-1029bcc977cd req-71195d3c-90df-44df-9a6a-0ce298c7eefb tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] For port 47436c18-bc15-4982-b5b9-08dead2d4032, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=47436c18-bc15-4982-b5b9-08dead2d4032,segment=NetworkSegment(d8f9d8a6-0e4b-49d7-bae9-38499934da61),segment_id=d8f9d8a6-0e4b-49d7-bae9-38499934da61)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:59:16.779843 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c1eb2f8d-0c83-4599-95b4-1029bcc977cd req-71195d3c-90df-44df-9a6a-0ce298c7eefb tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:16.905060 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-c1eb2f8d-0c83-4599-95b4-1029bcc977cd req-71195d3c-90df-44df-9a6a-0ce298c7eefb tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Calling delete_port for 47436c18-bc15-4982-b5b9-08dead2d4032 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 15:59:17.051861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c1eb2f8d-0c83-4599-95b4-1029bcc977cd req-71195d3c-90df-44df-9a6a-0ce298c7eefb tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:17.096060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['47436c18-bc15-4982-b5b9-08dead2d4032'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:59:17.106216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71195d3c-90df-44df-9a6a-0ce298c7eefb tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Pushing event deleted for resources: {'Port': ['ID=47436c18-bc15-4982-b5b9-08dead2d4032,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:17.179281 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-c1eb2f8d-0c83-4599-95b4-1029bcc977cd req-71195d3c-90df-44df-9a6a-0ce298c7eefb tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] No DVR routers for this DVR port 47436c18-bc15-4982-b5b9-08dead2d4032 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 15:59:17.182296 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-c1eb2f8d-0c83-4599-95b4-1029bcc977cd req-71195d3c-90df-44df-9a6a-0ce298c7eefb tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:17.189208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd25ef8ca-d3c8-4466-b120-382d1fc04475', 'name': 'network-vif-deleted', 'tag': '47436c18-bc15-4982-b5b9-08dead2d4032'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:59:17.203869 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1eb2f8d-0c83-4599-95b4-1029bcc977cd req-71195d3c-90df-44df-9a6a-0ce298c7eefb tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.84 "DELETE /v2.0/ports/47436c18-bc15-4982-b5b9-08dead2d4032 HTTP/1.1" status: 204 len: 173 time: 0.7395654 May 12 15:59:17.319559 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d7b68b78-bb55-4959-8272-b833ed9d74a9'] response: {'server_uuid': 'd25ef8ca-d3c8-4466-b120-382d1fc04475', 'name': 'network-vif-deleted', 'tag': '47436c18-bc15-4982-b5b9-08dead2d4032', 'status': 'completed', 'code': 200} May 12 15:59:17.458891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cbf09a21-1f6f-460d-a7c1-ae0cab95b96a req-01097aa2-2491-49e5-88a9-09728d23e88d tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Synchronizing usage tracker for tenant:04a1367b6b634209b7f562f465b7e6ea on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:59:17.473515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cbf09a21-1f6f-460d-a7c1-ae0cab95b96a req-01097aa2-2491-49e5-88a9-09728d23e88d tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] Unset dirty status for tenant:04a1367b6b634209b7f562f465b7e6ea on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:59:17.474871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cbf09a21-1f6f-460d-a7c1-ae0cab95b96a req-01097aa2-2491-49e5-88a9-09728d23e88d tempest-ServersAdminNegativeTestJSON-1066495874 tempest-ServersAdminNegativeTestJSON-1066495874-project] 10.222.0.82 "GET /v2.0/ports?device_id=d25ef8ca-d3c8-4466-b120-382d1fc04475 HTTP/1.1" status: 200 len: 210 time: 0.0613732 May 12 15:59:17.804179 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:18.293668 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c1ba60fb-44f4-4a88-93a9-28b9a67dd43d req-f510373a-98fa-46aa-9659-a256302a1e7b service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0436375 May 12 15:59:18.398735 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c1ba60fb-44f4-4a88-93a9-28b9a67dd43d req-83177fc0-140c-4be3-af94-4dea45f7f079 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0396249 May 12 15:59:18.443951 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c1ba60fb-44f4-4a88-93a9-28b9a67dd43d req-cd128f47-10fa-4b9a-a68a-ee33684c264d service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0271304 May 12 15:59:18.693593 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ba60fb-44f4-4a88-93a9-28b9a67dd43d req-a2676576-d9c2-4c4c-8cb7-7dfe8590d027 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:18.695179 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c1ba60fb-44f4-4a88-93a9-28b9a67dd43d req-a2676576-d9c2-4c4c-8cb7-7dfe8590d027 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2461584 May 12 15:59:18.840208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52070) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:59:18.984109 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4766d10d-5bc2-412c-a95f-5fc044cea81d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=04a1367b6b634209b7f562f465b7e6ea&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1427569 May 12 15:59:18.986760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52076) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:59:19.042633 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:19.067457 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:19.117115 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:19.134947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e23ee998-c3fe-4890-a14d-8f8cceb5af11,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:19.145174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:19.145538 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:19.145866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:19.146187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:19.146505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:19.146817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:19.147127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:19.147436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:19.147744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:19.148050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:19.148356 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:19.148659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 15:59:19.152686 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:19.154229 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-28f87add-b8d4-4fe1-8902-157de91cdc19 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e23ee998-c3fe-4890-a14d-8f8cceb5af11 HTTP/1.1" status: 204 len: 168 time: 0.1661310 May 12 15:59:19.197484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 47436c18-bc15-4982-b5b9-08dead2d4032 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 15:59:19.233662 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 47436c18-bc15-4982-b5b9-08dead2d4032 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 15:59:19.234072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 47436c18-bc15-4982-b5b9-08dead2d4032 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 15:59:19.428520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52084) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:59:19.446736 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68f96a4e-b70a-4117-af7d-325e56fd582b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:19.461146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-68f96a4e-b70a-4117-af7d-325e56fd582b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:59:19.465294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-68f96a4e-b70a-4117-af7d-325e56fd582b admin admin] Usage tracker for resource:security_group_rule and tenant:909e5ab45d134d46ae991ffc158da105 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:59:19.468342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-68f96a4e-b70a-4117-af7d-325e56fd582b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:59:19.473984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-68f96a4e-b70a-4117-af7d-325e56fd582b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:59:19.559889 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68f96a4e-b70a-4117-af7d-325e56fd582b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:19.563803 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68f96a4e-b70a-4117-af7d-325e56fd582b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:19.611561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-68f96a4e-b70a-4117-af7d-325e56fd582b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=909e5ab45d134d46ae991ffc158da105&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1820135 May 12 15:59:19.613083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68f96a4e-b70a-4117-af7d-325e56fd582b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=028cce06-75f3-46ea-b3a0-a354e9ea522a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:19.614261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52088) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:59:19.676811 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a83761a-a4e8-4ddc-8ff5-dd566e365950 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:19.702911 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a83761a-a4e8-4ddc-8ff5-dd566e365950 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:19.755261 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a83761a-a4e8-4ddc-8ff5-dd566e365950 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:19.770592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a83761a-a4e8-4ddc-8ff5-dd566e365950 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=028cce06-75f3-46ea-b3a0-a354e9ea522a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:19.775430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3a83761a-a4e8-4ddc-8ff5-dd566e365950 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:19.776435 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3a83761a-a4e8-4ddc-8ff5-dd566e365950 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/028cce06-75f3-46ea-b3a0-a354e9ea522a HTTP/1.1" status: 204 len: 168 time: 0.1612113 May 12 15:59:20.481440 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52112) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:59:20.581621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1948249055-network', 'tenant_id': 'c8125bb099e9451bb501bcce403efb07'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:59:20.587468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:59:20.591337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Usage tracker for resource:network and tenant:c8125bb099e9451bb501bcce403efb07 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:59:20.595145 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:59:20.600724 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:59:20.610780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Made reservation on behalf of c8125bb099e9451bb501bcce403efb07 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:59:20.612952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:20.624598 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:20.638445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:59:20.642155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Usage tracker for resource:security_group_rule and tenant:c8125bb099e9451bb501bcce403efb07 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:59:20.644846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:59:20.650922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:59:20.741017 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:20.745381 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:20.776369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 557} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 15:59:20.784687 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9b6ff423-ea58-423c-9b3c-d74a248efb26,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:20.793087 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:20.793087 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Added segment 9a0565bb-eb2d-43d9-9e77-04925e08d416 of type vlan for network 4f674cc5-d04a-49c2-8a6b-40b49f36afd3 May 12 15:59:20.820033 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:20.848360 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:20.849312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:20.849935 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:20.954337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] Pushing event updated for resources: {'Network': ['ID=4f674cc5-d04a-49c2-8a6b-40b49f36afd3,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:20.957613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c72983a1-deb2-46a0-bf1d-39182d6bb6c1 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.4751410 May 12 15:59:20.960703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52118) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:59:20.965498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 4f674cc5-d04a-49c2-8a6b-40b49f36afd3 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 15:59:20.967361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Request body: {'subnet': {'network_id': '4f674cc5-d04a-49c2-8a6b-40b49f36afd3', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1948249055-subnet', 'tenant_id': 'c8125bb099e9451bb501bcce403efb07', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:59:20.972754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:59:20.976573 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Usage tracker for resource:subnet and tenant:c8125bb099e9451bb501bcce403efb07 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:59:20.979586 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:59:20.985192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:59:20.995884 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Made reservation on behalf of c8125bb099e9451bb501bcce403efb07 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:59:20.998183 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:21.299654 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:21.376516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3ae5859a-3683-4498-83c8-ce40960631c8,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:21.384570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Checking segment: {'id': '9a0565bb-eb2d-43d9-9e77-04925e08d416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '4f674cc5-d04a-49c2-8a6b-40b49f36afd3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:59:21.384932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Network hostable DHCP agents. Network: 4f674cc5-d04a-49c2-8a6b-40b49f36afd3, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 15:59:21.403241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Network 4f674cc5-d04a-49c2-8a6b-40b49f36afd3 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 15:59:21.412176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 4f674cc5-d04a-49c2-8a6b-40b49f36afd3) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:59:21.416464 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:21.417025 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:21.422069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b2a4d49-1a94-4420-9349-cc2276dab386 None None] Network 4f674cc5-d04a-49c2-8a6b-40b49f36afd3 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:59:21.438977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6ad8209f-e797-4adf-902b-8242012f8720 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.4772990 May 12 15:59:21.637410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30bca6e1-ec8f-4e36-b8b3-0c6d1b8a490b None None] Network 4f674cc5-d04a-49c2-8a6b-40b49f36afd3 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 15:59:21.945061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ac613898-5ac9-4446-a93d-b24d1ff81136 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:21.945771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ac613898-5ac9-4446-a93d-b24d1ff81136 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Synchronizing usage tracker for tenant:c8125bb099e9451bb501bcce403efb07 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:59:21.963461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ac613898-5ac9-4446-a93d-b24d1ff81136 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Unset dirty status for tenant:c8125bb099e9451bb501bcce403efb07 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:59:21.964871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ac613898-5ac9-4446-a93d-b24d1ff81136 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/networks?id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3 HTTP/1.1" status: 200 len: 812 time: 0.1630201 May 12 15:59:21.979968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-e10abbab-ac8d-4909-9fad-13c6581d71f1 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/quotas/c8125bb099e9451bb501bcce403efb07 HTTP/1.1" status: 200 len: 375 time: 0.0095739 May 12 15:59:22.026724 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-78b06350-d805-46a6-82f2-486caa5f8354 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=c8125bb099e9451bb501bcce403efb07&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0418444 May 12 15:59:22.160081 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-5a78f41e-5d81-4b6c-b544-3119be3c18f6 service neutron] 10.222.0.82 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1265376 May 12 15:59:22.292946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-cf5fccfb-19b1-4dfb-b2ac-eed409913927 service neutron] 10.222.0.82 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1266360 May 12 15:59:22.465565 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b10096b-b8f8-4633-b4e4-e8805e6af25e req-50ee095b-a27f-4777-9824-e1b861361241 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 210 time: 0.0426314 May 12 15:59:23.624199 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-91c7f0e4-bb0b-4d6d-9e8a-ad2954251d1c req-62122868-5b63-4d42-a320-2682d41926df tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 210 time: 0.0485632 May 12 15:59:23.802580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-abdf8a49-3c40-4eb2-b17c-58cb03e9eab5 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:23.803977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-abdf8a49-3c40-4eb2-b17c-58cb03e9eab5 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.84 "GET /v2.0/networks?id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3 HTTP/1.1" status: 200 len: 812 time: 0.1495097 May 12 15:59:23.830411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Request body: {'port': {'device_id': '99aec6b3-8413-4f2d-92e8-9681312de865', 'network_id': '4f674cc5-d04a-49c2-8a6b-40b49f36afd3', 'admin_state_up': True, 'tenant_id': 'c8125bb099e9451bb501bcce403efb07'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:59:23.964541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 15:59:23.969781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Usage tracker for resource:port and tenant:c8125bb099e9451bb501bcce403efb07 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 15:59:23.972652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 15:59:23.979000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 15:59:23.988541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Made reservation on behalf of c8125bb099e9451bb501bcce403efb07 for: {'port': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 15:59:23.992249 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:24.155533 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Allocated IP 172.20.0.6 (4f674cc5-d04a-49c2-8a6b-40b49f36afd3/3ae5859a-3683-4498-83c8-ce40960631c8/19fb186d-dbbb-453e-b025-33746337c501) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 15:59:24.356378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:24.384564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:24.456167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Network 4f674cc5-d04a-49c2-8a6b-40b49f36afd3 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 15:59:24.459043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 15:59:24.463943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 15:59:24.498934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Pushing event updated for resources: {'Port': ['ID=19fb186d-dbbb-453e-b025-33746337c501,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:24.529993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:24.530588 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:24.549926 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-fd12a719-7f28-472e-81bf-be6787abe982 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7238133 May 12 15:59:24.572162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Request body: {'port': {'device_id': '99aec6b3-8413-4f2d-92e8-9681312de865', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 15:59:24.838712 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:24.929816 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddc17c3d-2ea2-423f-b69b-2d59c456e06b req-4a932552-767e-4330-9b9d-8565a7378fad tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:24.931183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ddc17c3d-2ea2-423f-b69b-2d59c456e06b req-4a932552-767e-4330-9b9d-8565a7378fad tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Synchronizing usage tracker for tenant:c8125bb099e9451bb501bcce403efb07 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:59:24.999967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ddc17c3d-2ea2-423f-b69b-2d59c456e06b req-4a932552-767e-4330-9b9d-8565a7378fad tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Unset dirty status for tenant:c8125bb099e9451bb501bcce403efb07 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:59:25.001081 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ddc17c3d-2ea2-423f-b69b-2d59c456e06b req-4a932552-767e-4330-9b9d-8565a7378fad tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 931 time: 0.2286701 May 12 15:59:25.121697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ddc17c3d-2ea2-423f-b69b-2d59c456e06b req-649e8766-d26f-41e2-a487-bfeb58f4dde5 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Synchronizing usage tracker for tenant:c8125bb099e9451bb501bcce403efb07 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 15:59:25.172448 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ddc17c3d-2ea2-423f-b69b-2d59c456e06b req-649e8766-d26f-41e2-a487-bfeb58f4dde5 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Unset dirty status for tenant:c8125bb099e9451bb501bcce403efb07 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 15:59:25.173577 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ddc17c3d-2ea2-423f-b69b-2d59c456e06b req-649e8766-d26f-41e2-a487-bfeb58f4dde5 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1661205 May 12 15:59:25.247210 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 19fb186d-dbbb-453e-b025-33746337c501 {{(pid=88152) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:59:25.254780 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:25.268697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Transition to ACTIVE for port object 19fb186d-dbbb-453e-b025-33746337c501 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 15:59:25.272088 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:25.397558 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Pushing event updated for resources: {'Port': ['ID=19fb186d-dbbb-453e-b025-33746337c501,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:25.499157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Attempting to bind port 19fb186d-dbbb-453e-b025-33746337c501 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 15:59:25.499472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Attempting to bind port 19fb186d-dbbb-453e-b025-33746337c501 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '9a0565bb-eb2d-43d9-9e77-04925e08d416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '4f674cc5-d04a-49c2-8a6b-40b49f36afd3'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 15:59:25.499786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Attempting to bind port 19fb186d-dbbb-453e-b025-33746337c501 on network 4f674cc5-d04a-49c2-8a6b-40b49f36afd3 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:59:25.504197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Port 19fb186d-dbbb-453e-b025-33746337c501 on network 4f674cc5-d04a-49c2-8a6b-40b49f36afd3 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 15:59:25.504504 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Attempting to bind port 19fb186d-dbbb-453e-b025-33746337c501 on network 4f674cc5-d04a-49c2-8a6b-40b49f36afd3 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 15:59:25.509617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 15, 59, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 15:59:25.509943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Checking segment: {'id': '9a0565bb-eb2d-43d9-9e77-04925e08d416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '4f674cc5-d04a-49c2-8a6b-40b49f36afd3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 15:59:25.510311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Bound using segment: {'id': '9a0565bb-eb2d-43d9-9e77-04925e08d416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '4f674cc5-d04a-49c2-8a6b-40b49f36afd3'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 15:59:25.510717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Bound port: 19fb186d-dbbb-453e-b025-33746337c501, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9a0565bb-eb2d-43d9-9e77-04925e08d416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '4f674cc5-d04a-49c2-8a6b-40b49f36afd3'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 15:59:25.511047 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:25.596088 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] For port 19fb186d-dbbb-453e-b025-33746337c501, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 15:59:25.598920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] For port 19fb186d-dbbb-453e-b025-33746337c501, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=19fb186d-dbbb-453e-b025-33746337c501,segment=NetworkSegment(9a0565bb-eb2d-43d9-9e77-04925e08d416),segment_id=9a0565bb-eb2d-43d9-9e77-04925e08d416)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 15:59:25.604017 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:25.665646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:25.666241 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:25.667571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] 10.222.0.84 "PUT /v2.0/ports/19fb186d-dbbb-453e-b025-33746337c501 HTTP/1.1" status: 200 len: 1091 time: 1.0998447 May 12 15:59:25.667992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '99aec6b3-8413-4f2d-92e8-9681312de865', 'tag': '19fb186d-dbbb-453e-b025-33746337c501'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:59:25.685526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef06a4ed-d045-4c2f-bd75-88f5990adf33 service neutron] Pushing event updated for resources: {'Port': ['ID=19fb186d-dbbb-453e-b025-33746337c501,revision_number=3']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:25.715057 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b134bae7-1816-42da-8088-a0462eca4514'] response: {'name': 'network-changed', 'server_uuid': '99aec6b3-8413-4f2d-92e8-9681312de865', 'tag': '19fb186d-dbbb-453e-b025-33746337c501', 'status': 'completed', 'code': 200} May 12 15:59:25.801339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-13f1d918-aab7-4d77-8fc3-0b66e5e23eb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:25.802794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-13f1d918-aab7-4d77-8fc3-0b66e5e23eb2 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c8125bb099e9451bb501bcce403efb07&device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 1094 time: 0.0701954 May 12 15:59:25.886337 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-dfea603f-0c06-4987-a1c5-2d40cde82f9f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=19fb186d-dbbb-453e-b025-33746337c501 HTTP/1.1" status: 200 len: 217 time: 0.0640543 May 12 15:59:25.951906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-cf8fae9c-fd42-4dea-b235-9952a353ae21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:25.953211 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-cf8fae9c-fd42-4dea-b235-9952a353ae21 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5859a-3683-4498-83c8-ce40960631c8 HTTP/1.1" status: 200 len: 852 time: 0.0578222 May 12 15:59:26.005352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-337eb8e5-3732-40c9-982c-d1d0be68ed9b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0423872 May 12 15:59:26.144558 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-2d59dc38-067e-47cc-9a89-ccb489c83660 service neutron] 10.222.0.84 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1291308 May 12 15:59:26.311689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cf9d5f3-f52e-4d0f-9d95-eee7d182b82c req-a6abc4a7-8180-4bab-b731-a99c6bc3a4b5 service neutron] 10.222.0.84 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1580358 May 12 15:59:26.361297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16449b09-2010-480b-9f08-3feed241ff2c req-423943cc-1321-4148-b95f-d34cd4433871 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:26.362776 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16449b09-2010-480b-9f08-3feed241ff2c req-423943cc-1321-4148-b95f-d34cd4433871 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 943 time: 0.0844846 May 12 15:59:26.406363 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16449b09-2010-480b-9f08-3feed241ff2c req-b298049c-1065-4ec8-8cae-4fc6a647f811 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380013 May 12 15:59:26.514000 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da526dc2-f54b-4cb6-beed-6fe2ba5d665b req-0203650f-8edb-430f-8050-75c831d5516b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:26.515416 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da526dc2-f54b-4cb6-beed-6fe2ba5d665b req-0203650f-8edb-430f-8050-75c831d5516b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c8125bb099e9451bb501bcce403efb07&device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 1094 time: 0.0734749 May 12 15:59:26.650564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da526dc2-f54b-4cb6-beed-6fe2ba5d665b req-0083c7ec-65c5-4e72-8599-6ac08fa2738c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:26.651964 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da526dc2-f54b-4cb6-beed-6fe2ba5d665b req-0083c7ec-65c5-4e72-8599-6ac08fa2738c service neutron] 10.222.0.84 "GET /v2.0/networks?id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3 HTTP/1.1" status: 200 len: 913 time: 0.1269102 May 12 15:59:26.819440 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da526dc2-f54b-4cb6-beed-6fe2ba5d665b req-c7737f30-2d8a-4afe-a2d1-9cfeab944bda service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=19fb186d-dbbb-453e-b025-33746337c501 HTTP/1.1" status: 200 len: 217 time: 0.1602399 May 12 15:59:26.884862 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da526dc2-f54b-4cb6-beed-6fe2ba5d665b req-3aa56737-7cdd-4e85-bfad-86dc5ac91ded service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:26.886266 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da526dc2-f54b-4cb6-beed-6fe2ba5d665b req-3aa56737-7cdd-4e85-bfad-86dc5ac91ded service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5859a-3683-4498-83c8-ce40960631c8 HTTP/1.1" status: 200 len: 852 time: 0.0593088 May 12 15:59:26.931898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da526dc2-f54b-4cb6-beed-6fe2ba5d665b req-a341791b-15e6-4225-893e-e5eda7746801 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0389442 May 12 15:59:27.065592 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da526dc2-f54b-4cb6-beed-6fe2ba5d665b req-cf6763e4-5fd3-4254-81a2-7c28cc7fd592 service neutron] 10.222.0.84 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1247563 May 12 15:59:27.194304 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da526dc2-f54b-4cb6-beed-6fe2ba5d665b req-ac7789d7-3f18-4461-8051-c4964a4ee556 service neutron] 10.222.0.84 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1219923 May 12 15:59:27.595425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87339dbe-0fda-42a6-97b6-34bb5a16ecda req-62c3d2ce-ff51-4e5d-8201-0d6191ebeb08 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:27.596840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87339dbe-0fda-42a6-97b6-34bb5a16ecda req-62c3d2ce-ff51-4e5d-8201-0d6191ebeb08 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 943 time: 0.0825350 May 12 15:59:27.640265 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87339dbe-0fda-42a6-97b6-34bb5a16ecda req-0c7f9eaa-120d-427c-a834-1cab5e8720b0 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372872 May 12 15:59:27.969471 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 15:59:28.828842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b89853f-9e52-4c1a-84ae-0bc97140bfb4 req-2347c792-c9e0-4aab-a5d8-0ec377ca4575 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:28.830310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b89853f-9e52-4c1a-84ae-0bc97140bfb4 req-2347c792-c9e0-4aab-a5d8-0ec377ca4575 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 943 time: 0.0833580 May 12 15:59:28.874947 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9b89853f-9e52-4c1a-84ae-0bc97140bfb4 req-56136487-aeb3-4d29-9694-c15950058329 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390060 May 12 15:59:29.194208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 19fb186d-dbbb-453e-b025-33746337c501 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 15:59:29.327334 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 19fb186d-dbbb-453e-b025-33746337c501, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=19fb186d-dbbb-453e-b025-33746337c501,segment=NetworkSegment(9a0565bb-eb2d-43d9-9e77-04925e08d416),segment_id=9a0565bb-eb2d-43d9-9e77-04925e08d416)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:59:29.339935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '19fb186d-dbbb-453e-b025-33746337c501', 'network_id': '4f674cc5-d04a-49c2-8a6b-40b49f36afd3', 'port_id': '19fb186d-dbbb-453e-b025-33746337c501', 'mac_address': 'fa:16:3e:27:23:d4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 557, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3ae5859a-3683-4498-83c8-ce40960631c8', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 15:59:29.397736 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:29.416284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 19fb186d-dbbb-453e-b025-33746337c501 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 15:59:29.431557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 19fb186d-dbbb-453e-b025-33746337c501, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=19fb186d-dbbb-453e-b025-33746337c501,segment=NetworkSegment(9a0565bb-eb2d-43d9-9e77-04925e08d416),segment_id=9a0565bb-eb2d-43d9-9e77-04925e08d416)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:59:29.435445 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:29.503849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=19fb186d-dbbb-453e-b025-33746337c501,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:29.901715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['19fb186d-dbbb-453e-b025-33746337c501'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 15:59:30.064121 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c42886c-522a-4284-a0f0-86870d48eb86 req-e08557c5-ce9f-44b0-8366-b921fc664e9f tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:30.065622 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c42886c-522a-4284-a0f0-86870d48eb86 req-e08557c5-ce9f-44b0-8366-b921fc664e9f tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 944 time: 0.0844722 May 12 15:59:30.109772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c42886c-522a-4284-a0f0-86870d48eb86 req-6f9a10c2-ad95-49b3-9544-4291d66fcdc1 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377338 May 12 15:59:31.213162 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 19fb186d-dbbb-453e-b025-33746337c501 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 15:59:31.281553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 19fb186d-dbbb-453e-b025-33746337c501 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 15:59:31.286410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 19fb186d-dbbb-453e-b025-33746337c501 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 15:59:31.286781 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:31.296003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beaab376-6d22-4f54-aec0-265a066f491e req-67942f18-5f43-4d2f-9a11-b5220c8daf07 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:31.297614 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-beaab376-6d22-4f54-aec0-265a066f491e req-67942f18-5f43-4d2f-9a11-b5220c8daf07 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 944 time: 0.0833185 May 12 15:59:31.354034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-beaab376-6d22-4f54-aec0-265a066f491e req-03cd3f21-0541-4715-8d24-90ce0ca8669d tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507092 May 12 15:59:31.438637 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:31.465531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '99aec6b3-8413-4f2d-92e8-9681312de865', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '19fb186d-dbbb-453e-b025-33746337c501'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 15:59:31.475468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 19fb186d-dbbb-453e-b025-33746337c501, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=19fb186d-dbbb-453e-b025-33746337c501,segment=NetworkSegment(9a0565bb-eb2d-43d9-9e77-04925e08d416),segment_id=9a0565bb-eb2d-43d9-9e77-04925e08d416)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 15:59:31.479240 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:31.515212 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f20f19cd-1b41-48db-bd66-604770739b93'] response: {'server_uuid': '99aec6b3-8413-4f2d-92e8-9681312de865', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '19fb186d-dbbb-453e-b025-33746337c501', 'code': 200} May 12 15:59:31.552738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=19fb186d-dbbb-453e-b025-33746337c501,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 15:59:31.685275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-308a4c60-6d91-4aaf-8634-2e38cff81c33 req-a01d1bf6-77b3-4ebc-88e0-8c924e41f183 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:31.686770 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-308a4c60-6d91-4aaf-8634-2e38cff81c33 req-a01d1bf6-77b3-4ebc-88e0-8c924e41f183 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 1096 time: 0.0849009 May 12 15:59:31.731452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-308a4c60-6d91-4aaf-8634-2e38cff81c33 req-43d96d79-0fd3-4e68-9253-6dc5c4b44b82 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342839 May 12 15:59:32.535698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd6e1a31-90be-484e-ac02-aba6d7eb2aad req-64a05e25-d2a6-45bc-b68f-4fcd24e138a3 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:32.537164 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd6e1a31-90be-484e-ac02-aba6d7eb2aad req-64a05e25-d2a6-45bc-b68f-4fcd24e138a3 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0791893 May 12 15:59:32.584309 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd6e1a31-90be-484e-ac02-aba6d7eb2aad req-5727c7c7-182d-49d8-a648-fbf6deb217f9 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408831 May 12 15:59:32.725962 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:33.776072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-823208ff-87b4-4cd9-b31b-66f6d019af5e req-7d58a7e3-9f59-4a4a-a2d3-efc52626464c tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:33.777518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-823208ff-87b4-4cd9-b31b-66f6d019af5e req-7d58a7e3-9f59-4a4a-a2d3-efc52626464c tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0809982 May 12 15:59:33.821091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-823208ff-87b4-4cd9-b31b-66f6d019af5e req-d81f79d1-fae4-4c8d-a1a4-08a9aca52f5f tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379472 May 12 15:59:34.096660 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52176) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 15:59:34.275039 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-fbecbe31-978d-4e89-b166-1740cd847579 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1762578 May 12 15:59:34.283438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de07c17c-3805-4020-b58c-a12ae4d6e300 req-01f71712-e2da-4228-9e0d-07a741c673fe tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:34.284828 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de07c17c-3805-4020-b58c-a12ae4d6e300 req-01f71712-e2da-4228-9e0d-07a741c673fe tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.1448820 May 12 15:59:34.332445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-de07c17c-3805-4020-b58c-a12ae4d6e300 req-4b68c01e-2415-40ce-96c0-915795d9af7b tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413857 May 12 15:59:35.524311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-885d41bd-1647-41e1-b372-0837346e1a24 req-e6ec17b8-1be4-4290-bf0a-56c315ae88eb tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:35.525852 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-885d41bd-1647-41e1-b372-0837346e1a24 req-e6ec17b8-1be4-4290-bf0a-56c315ae88eb tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0875678 May 12 15:59:35.609414 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-885d41bd-1647-41e1-b372-0837346e1a24 req-4147bb0b-a6f5-4dd8-ba0e-5d983e40c0ba tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0778244 May 12 15:59:35.636615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2919181f-46af-4881-bfa5-62f968637b5e req-222bb36e-3054-4ad4-9740-0dbb02405199 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:35.638097 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-222bb36e-3054-4ad4-9740-0dbb02405199 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c8125bb099e9451bb501bcce403efb07&device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 1096 time: 0.0783439 May 12 15:59:35.770247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2919181f-46af-4881-bfa5-62f968637b5e req-3f3d292f-0936-42f1-a9be-bfa187e4af2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:35.771669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-3f3d292f-0936-42f1-a9be-bfa187e4af2a service neutron] 10.222.0.84 "GET /v2.0/networks?id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3 HTTP/1.1" status: 200 len: 913 time: 0.1271532 May 12 15:59:35.841085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-749b20b7-d058-4eb4-81f2-cbcf8a25ac65 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=19fb186d-dbbb-453e-b025-33746337c501 HTTP/1.1" status: 200 len: 217 time: 0.0635307 May 12 15:59:35.905104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2919181f-46af-4881-bfa5-62f968637b5e req-3abceba0-5687-4a01-bb19-ee963af7befc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:35.906797 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-3abceba0-5687-4a01-bb19-ee963af7befc service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5859a-3683-4498-83c8-ce40960631c8 HTTP/1.1" status: 200 len: 852 time: 0.0599322 May 12 15:59:35.954168 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-ae3fb39c-7db5-42da-bb8f-4854ad59484f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0410361 May 12 15:59:36.196874 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-061c59f5-d38c-4ab4-9196-663725f68f3c service neutron] 10.222.0.84 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2362518 May 12 15:59:36.330308 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-48d53a54-dcb0-46f6-a8d9-7a599cc2410a service neutron] 10.222.0.84 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1279397 May 12 15:59:36.793693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b462bd4-8bd5-40e4-99ff-bb68c455285e req-dfeb75aa-7c47-49b3-9fed-757bde2cc612 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:36.795102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7b462bd4-8bd5-40e4-99ff-bb68c455285e req-dfeb75aa-7c47-49b3-9fed-757bde2cc612 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0780942 May 12 15:59:36.838623 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7b462bd4-8bd5-40e4-99ff-bb68c455285e req-638494df-93e8-4248-906e-7a335f96e6ac tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379670 May 12 15:59:38.031131 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2f01e9-6287-41b9-a4c3-a1533407204a req-971a8b24-5f05-4c41-939e-4c7b2d9bbaf7 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:38.032552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a2f01e9-6287-41b9-a4c3-a1533407204a req-971a8b24-5f05-4c41-939e-4c7b2d9bbaf7 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0832384 May 12 15:59:38.077460 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a2f01e9-6287-41b9-a4c3-a1533407204a req-a97a0950-56d1-4116-a5f6-be0161e5ed32 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391841 May 12 15:59:39.264447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f06137aa-138d-4847-9c04-a85819739901 req-dd2f653c-2a08-45bf-8e74-2ca32b86560c tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:39.265896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f06137aa-138d-4847-9c04-a85819739901 req-dd2f653c-2a08-45bf-8e74-2ca32b86560c tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0788639 May 12 15:59:39.313755 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f06137aa-138d-4847-9c04-a85819739901 req-689fb4aa-ce13-41c3-adc3-560fda4b5e2c tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421369 May 12 15:59:40.497518 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb3d3fbf-f38b-4a68-bc4c-02a47d4617a6 req-79395dac-02ed-4250-8358-d53ad03ec721 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:40.498942 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb3d3fbf-f38b-4a68-bc4c-02a47d4617a6 req-79395dac-02ed-4250-8358-d53ad03ec721 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0793235 May 12 15:59:40.542614 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb3d3fbf-f38b-4a68-bc4c-02a47d4617a6 req-3cc4cabd-9f8f-4ef5-badb-a5e6747a288b tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381436 May 12 15:59:41.729248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aa9e6ff-9aa6-4dc3-be91-fa04f17a44b5 req-32ceeaac-8cc9-42e4-832f-410414ea61e4 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:41.730711 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0aa9e6ff-9aa6-4dc3-be91-fa04f17a44b5 req-32ceeaac-8cc9-42e4-832f-410414ea61e4 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0853217 May 12 15:59:41.774195 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0aa9e6ff-9aa6-4dc3-be91-fa04f17a44b5 req-b1d506c8-e650-455f-a04f-f9190ea403cf tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378616 May 12 15:59:42.112455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598b9d33-5f3f-42a6-9b49-405191edb6cb req-d93cdee3-ef89-4f74-b278-660b00eed815 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:42.113964 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-598b9d33-5f3f-42a6-9b49-405191edb6cb req-d93cdee3-ef89-4f74-b278-660b00eed815 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c8125bb099e9451bb501bcce403efb07&device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 1096 time: 0.0745585 May 12 15:59:42.256615 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598b9d33-5f3f-42a6-9b49-405191edb6cb req-a8009177-038e-46a9-a77b-88f548fd667d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:42.258684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-598b9d33-5f3f-42a6-9b49-405191edb6cb req-a8009177-038e-46a9-a77b-88f548fd667d service neutron] 10.222.0.84 "GET /v2.0/networks?id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3 HTTP/1.1" status: 200 len: 913 time: 0.1254313 May 12 15:59:42.327514 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-598b9d33-5f3f-42a6-9b49-405191edb6cb req-bb5d18d8-ea87-494d-8f62-28b1b684a81c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=19fb186d-dbbb-453e-b025-33746337c501 HTTP/1.1" status: 200 len: 217 time: 0.0638323 May 12 15:59:42.386860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598b9d33-5f3f-42a6-9b49-405191edb6cb req-b60f2511-718d-44b6-841d-cd9f607b6450 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:42.388211 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-598b9d33-5f3f-42a6-9b49-405191edb6cb req-b60f2511-718d-44b6-841d-cd9f607b6450 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5859a-3683-4498-83c8-ce40960631c8 HTTP/1.1" status: 200 len: 852 time: 0.0558186 May 12 15:59:42.437797 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-598b9d33-5f3f-42a6-9b49-405191edb6cb req-0870463e-c15b-45b7-955c-2ae9366c7047 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0434806 May 12 15:59:42.573815 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-598b9d33-5f3f-42a6-9b49-405191edb6cb req-a43acab6-88f3-4f22-9923-5026537a87f0 service neutron] 10.222.0.84 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1291270 May 12 15:59:42.706594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-598b9d33-5f3f-42a6-9b49-405191edb6cb req-31902651-9e9d-4ba4-954a-e163e8cd15ee service neutron] 10.222.0.84 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1273458 May 12 15:59:42.809768 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2bae9a1f-841f-4953-9119-b14b488fa136 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:42.958109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd3e257d-fcd5-46e5-98d5-f6e27775bf97 req-9c002ad5-d4ca-4b7d-b2c2-a4fe3136d5b0 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:42.959449 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd3e257d-fcd5-46e5-98d5-f6e27775bf97 req-9c002ad5-d4ca-4b7d-b2c2-a4fe3136d5b0 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0793049 May 12 15:59:43.004320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd3e257d-fcd5-46e5-98d5-f6e27775bf97 req-56583311-0210-4732-a68a-89800a76ff26 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386100 May 12 15:59:43.558798 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:44.190787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f9afee-3cc9-4cb2-95eb-b938dd68884b req-70a9e070-d483-48f8-974c-f77c93a75bcb tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:44.192206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39f9afee-3cc9-4cb2-95eb-b938dd68884b req-70a9e070-d483-48f8-974c-f77c93a75bcb tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0823119 May 12 15:59:44.235172 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39f9afee-3cc9-4cb2-95eb-b938dd68884b req-72f54c7a-3bc4-4639-80ee-57846a4dac84 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373135 May 12 15:59:45.349695 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a682ae7a-2838-4c6b-864b-e1de3bee4c4c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:45.420972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c27a2359-9edb-40b1-9dcf-1c9a355de6c2 req-987bff01-7828-4581-ab0c-b5e95b2e68e1 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:45.422445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c27a2359-9edb-40b1-9dcf-1c9a355de6c2 req-987bff01-7828-4581-ab0c-b5e95b2e68e1 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0802138 May 12 15:59:45.470646 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c27a2359-9edb-40b1-9dcf-1c9a355de6c2 req-7a0134de-056c-4c88-b2e1-cc33c02b7dd1 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425401 May 12 15:59:46.058182 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:46.326822 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:46.660829 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a106e1c7-49eb-432c-97d9-39bcc35c31d8 req-04baa5c7-3a3e-4e0c-a11b-61327a480495 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:46.662199 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a106e1c7-49eb-432c-97d9-39bcc35c31d8 req-04baa5c7-3a3e-4e0c-a11b-61327a480495 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0821071 May 12 15:59:46.707349 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a106e1c7-49eb-432c-97d9-39bcc35c31d8 req-82d842f2-695d-4067-a08d-c7a576631ce6 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389674 May 12 15:59:47.807968 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 15:59:47.891483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d87e3849-c0c0-4ecb-9442-cdd75f2c3c9a req-18543aa2-212c-42c4-8f13-1e2a1178efa3 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:47.892894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d87e3849-c0c0-4ecb-9442-cdd75f2c3c9a req-18543aa2-212c-42c4-8f13-1e2a1178efa3 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0775259 May 12 15:59:47.939290 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d87e3849-c0c0-4ecb-9442-cdd75f2c3c9a req-348d1933-f498-432f-8cd6-c33a69721dfe tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408142 May 12 15:59:49.126036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43f1285-242f-47a1-8c1b-1f19bf9c32bf req-85cadd5f-e338-4947-b8cd-acc41a2f9952 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:49.127548 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e43f1285-242f-47a1-8c1b-1f19bf9c32bf req-85cadd5f-e338-4947-b8cd-acc41a2f9952 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0844831 May 12 15:59:49.173776 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e43f1285-242f-47a1-8c1b-1f19bf9c32bf req-728d870a-c711-4971-9090-4421074c9b6f tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390201 May 12 15:59:50.360248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce4741df-3580-446e-8eea-0cba79a21da1 req-6d53b1e1-d3a9-4058-902b-4f50864a4cdb tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:50.361601 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce4741df-3580-446e-8eea-0cba79a21da1 req-6d53b1e1-d3a9-4058-902b-4f50864a4cdb tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0836787 May 12 15:59:50.512670 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce4741df-3580-446e-8eea-0cba79a21da1 req-9c6f7061-76e4-40dd-a78a-c9510d72d29b tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1451218 May 12 15:59:51.695741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29c471c9-35f6-4a6c-b44b-2c0b9e95d836 req-01c6af90-a773-4da6-af55-a7984f141d03 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:51.697433 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29c471c9-35f6-4a6c-b44b-2c0b9e95d836 req-01c6af90-a773-4da6-af55-a7984f141d03 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0798061 May 12 15:59:51.740946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29c471c9-35f6-4a6c-b44b-2c0b9e95d836 req-c7dc5436-1062-4add-8718-ea7be7ca3301 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377994 May 12 15:59:52.926576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553c37cb-fe75-407b-8bb2-f0d9b7459895 req-6b040dc1-dc21-4be2-945b-b05d74767208 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:52.927994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-553c37cb-fe75-407b-8bb2-f0d9b7459895 req-6b040dc1-dc21-4be2-945b-b05d74767208 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0810330 May 12 15:59:52.971662 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-553c37cb-fe75-407b-8bb2-f0d9b7459895 req-bf8741d0-f18f-413d-a9b1-29df56488431 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0371096 May 12 15:59:54.171860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbdad0c8-e88b-4eec-a114-e76808cc5b2d req-721272a2-e291-4a0e-afe1-c3403ac480fe tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:54.173324 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fbdad0c8-e88b-4eec-a114-e76808cc5b2d req-721272a2-e291-4a0e-afe1-c3403ac480fe tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0817704 May 12 15:59:54.224686 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fbdad0c8-e88b-4eec-a114-e76808cc5b2d req-29c0d4b6-4e88-4e23-8c0c-2c478297cc0e tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429237 May 12 15:59:55.410643 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6671b23-1f8b-455b-bae4-c43a8bf0e169 req-6c7d1432-37e9-4c25-850f-f1029db27add tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:55.412423 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6671b23-1f8b-455b-bae4-c43a8bf0e169 req-6c7d1432-37e9-4c25-850f-f1029db27add tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0800555 May 12 15:59:55.456711 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6671b23-1f8b-455b-bae4-c43a8bf0e169 req-b2534d4e-bcab-4f15-9f52-238d3c25fb60 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386741 May 12 15:59:56.641590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-319576eb-d7b3-42cc-94ea-cc3e2f90f024 req-1787504e-c940-4525-b2b5-cdc0477c5aff tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:56.643008 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-319576eb-d7b3-42cc-94ea-cc3e2f90f024 req-1787504e-c940-4525-b2b5-cdc0477c5aff tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0814483 May 12 15:59:56.685915 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-319576eb-d7b3-42cc-94ea-cc3e2f90f024 req-cd51c150-f7ca-45ce-8ac3-f0ee5f39a35d tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373583 May 12 15:59:57.878662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd163b1c-bd1a-406e-a79b-81489cad9d82 req-8da372ae-4b30-4b45-ae79-64d0a737c95f tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:57.880082 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd163b1c-bd1a-406e-a79b-81489cad9d82 req-8da372ae-4b30-4b45-ae79-64d0a737c95f tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0796039 May 12 15:59:57.923238 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd163b1c-bd1a-406e-a79b-81489cad9d82 req-acd02af8-f52a-4b00-b841-e003e906a777 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0375929 May 12 15:59:59.110405 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdb193b4-8e64-4378-96bb-f5152b00bd59 req-75a317c3-58db-496f-b123-554ef6e1ef7b tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 15:59:59.111848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cdb193b4-8e64-4378-96bb-f5152b00bd59 req-75a317c3-58db-496f-b123-554ef6e1ef7b tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0855794 May 12 15:59:59.156497 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cdb193b4-8e64-4378-96bb-f5152b00bd59 req-c6173558-61f5-4ac2-b6c2-2eb45bfe59a9 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390525 May 12 16:00:00.342699 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f0ad09f-7d7f-420d-a815-f0a5937d9554 req-680ac23f-9e61-4933-9f5b-8d5dd0323d6f tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:00.344094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8f0ad09f-7d7f-420d-a815-f0a5937d9554 req-680ac23f-9e61-4933-9f5b-8d5dd0323d6f tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0828388 May 12 16:00:00.392339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8f0ad09f-7d7f-420d-a815-f0a5937d9554 req-06803c17-ce9e-40d0-a173-82e2ebb47131 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425572 May 12 16:00:01.579827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a72ca40-5e1c-47a8-88bf-77b076384de2 req-ecec9b03-cc83-4d1d-a1eb-fd09a44d80fb tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:01.581157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a72ca40-5e1c-47a8-88bf-77b076384de2 req-ecec9b03-cc83-4d1d-a1eb-fd09a44d80fb tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0792396 May 12 16:00:01.624218 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a72ca40-5e1c-47a8-88bf-77b076384de2 req-c5d4fefc-f5d2-4d54-ba1d-de8114c3c02e tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374572 May 12 16:00:02.741646 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:02.813785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0154340e-d708-4d82-8064-41bcca79ce0c req-d9f071d0-ce1f-4ed4-90da-f9a13a032cf8 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:02.815229 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0154340e-d708-4d82-8064-41bcca79ce0c req-d9f071d0-ce1f-4ed4-90da-f9a13a032cf8 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0844212 May 12 16:00:02.858152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0154340e-d708-4d82-8064-41bcca79ce0c req-98830e94-5747-40e9-a152-9cfc69fb5f9b tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372891 May 12 16:00:03.604759 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-2919181f-46af-4881-bfa5-62f968637b5e req-8b6665df-a128-4755-bce1-43a36ea0956a service neutron] show failed (client error): The resource could not be found. May 12 16:00:03.605676 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-8b6665df-a128-4755-bce1-43a36ea0956a service neutron] 10.222.0.84 "GET /v2.0/ports/19fb186d-dbbb-453e-b025-33746337c501/bindings/n-h2-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.0726631 May 12 16:00:03.879670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2919181f-46af-4881-bfa5-62f968637b5e req-2a5508c4-9f9c-4c80-8505-02acced62efd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:03.881016 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-2a5508c4-9f9c-4c80-8505-02acced62efd service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865&tenant_id=c8125bb099e9451bb501bcce403efb07 HTTP/1.1" status: 200 len: 1096 time: 0.0721776 May 12 16:00:03.891572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:00:03.998609 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:04.050534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a06d97ca-b6c4-485d-9240-9d38d365cfce req-34fb6606-d1b0-42c6-b50e-36c6e604d186 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:04.051982 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a06d97ca-b6c4-485d-9240-9d38d365cfce req-34fb6606-d1b0-42c6-b50e-36c6e604d186 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0846143 May 12 16:00:04.097736 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a06d97ca-b6c4-485d-9240-9d38d365cfce req-02b8fdbd-b48a-40ad-863c-2868141a4d2e tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390501 May 12 16:00:04.265049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] For port 19fb186d-dbbb-453e-b025-33746337c501, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=19fb186d-dbbb-453e-b025-33746337c501,segment=NetworkSegment(9a0565bb-eb2d-43d9-9e77-04925e08d416),segment_id=9a0565bb-eb2d-43d9-9e77-04925e08d416)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:00:04.293723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] For port 19fb186d-dbbb-453e-b025-33746337c501, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:00:04.355495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '99aec6b3-8413-4f2d-92e8-9681312de865', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '19fb186d-dbbb-453e-b025-33746337c501'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:00:04.361218 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:04.376470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Transition to ACTIVE for port object 19fb186d-dbbb-453e-b025-33746337c501 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:00:04.380312 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:04.423438 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-de4f757f-3656-4533-9da6-548261686eb1'] response: {'server_uuid': '99aec6b3-8413-4f2d-92e8-9681312de865', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '19fb186d-dbbb-453e-b025-33746337c501', 'code': 200} May 12 16:00:04.547915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] No DVR routers for this DVR port 19fb186d-dbbb-453e-b025-33746337c501 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:00:04.551118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Pushing event updated for resources: {'Port': ['ID=19fb186d-dbbb-453e-b025-33746337c501,revision_number=6']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:04.605563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Attempting to bind port 19fb186d-dbbb-453e-b025-33746337c501 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:00:04.605888 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Attempting to bind port 19fb186d-dbbb-453e-b025-33746337c501 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '9a0565bb-eb2d-43d9-9e77-04925e08d416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '4f674cc5-d04a-49c2-8a6b-40b49f36afd3'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:00:04.606211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Attempting to bind port 19fb186d-dbbb-453e-b025-33746337c501 on network 4f674cc5-d04a-49c2-8a6b-40b49f36afd3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:00:04.610689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Port 19fb186d-dbbb-453e-b025-33746337c501 on network 4f674cc5-d04a-49c2-8a6b-40b49f36afd3 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:00:04.611007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Attempting to bind port 19fb186d-dbbb-453e-b025-33746337c501 on network 4f674cc5-d04a-49c2-8a6b-40b49f36afd3 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:00:04.616032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 0, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:00:04.616364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Checking segment: {'id': '9a0565bb-eb2d-43d9-9e77-04925e08d416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '4f674cc5-d04a-49c2-8a6b-40b49f36afd3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:00:04.616744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Bound using segment: {'id': '9a0565bb-eb2d-43d9-9e77-04925e08d416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '4f674cc5-d04a-49c2-8a6b-40b49f36afd3'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:00:04.617164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Bound port: 19fb186d-dbbb-453e-b025-33746337c501, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9a0565bb-eb2d-43d9-9e77-04925e08d416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 557, 'network_id': '4f674cc5-d04a-49c2-8a6b-40b49f36afd3'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:00:04.617538 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:04.704827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] For port 19fb186d-dbbb-453e-b025-33746337c501, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:00:04.707975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] For port 19fb186d-dbbb-453e-b025-33746337c501, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=19fb186d-dbbb-453e-b025-33746337c501,segment=NetworkSegment(9a0565bb-eb2d-43d9-9e77-04925e08d416),segment_id=9a0565bb-eb2d-43d9-9e77-04925e08d416)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:00:04.713969 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:04.773308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:04.774221 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:04.776618 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] 10.222.0.76 "PUT /v2.0/ports/19fb186d-dbbb-453e-b025-33746337c501 HTTP/1.1" status: 200 len: 1091 time: 0.8889792 May 12 16:00:04.799146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85344ce7-864a-47aa-93f4-f3c7d7d31a91 service neutron] Pushing event updated for resources: {'Port': ['ID=19fb186d-dbbb-453e-b025-33746337c501,revision_number=7']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:04.870100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2919181f-46af-4881-bfa5-62f968637b5e req-166d0d89-3ea5-45e3-a363-e5801b169abe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:04.871532 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-166d0d89-3ea5-45e3-a363-e5801b169abe service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=c8125bb099e9451bb501bcce403efb07&device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 1094 time: 0.0734823 May 12 16:00:04.969825 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:00:05.001827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2919181f-46af-4881-bfa5-62f968637b5e req-a9d5170b-ff9a-43b6-9620-2452531a31db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:05.003258 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-a9d5170b-ff9a-43b6-9620-2452531a31db service neutron] 10.222.0.76 "GET /v2.0/networks?id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3 HTTP/1.1" status: 200 len: 913 time: 0.1260734 May 12 16:00:05.073215 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-785c8965-89fb-4bb2-96f3-89384c51bb92 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=19fb186d-dbbb-453e-b025-33746337c501 HTTP/1.1" status: 200 len: 217 time: 0.0632224 May 12 16:00:05.135154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2919181f-46af-4881-bfa5-62f968637b5e req-31a3d0e1-e6da-4064-8b69-e22b3f5ae2f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:05.136272 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-31a3d0e1-e6da-4064-8b69-e22b3f5ae2f3 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=3ae5859a-3683-4498-83c8-ce40960631c8 HTTP/1.1" status: 200 len: 852 time: 0.0581369 May 12 16:00:05.182151 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-911999ce-327a-4198-a995-a0c2dae7dcb1 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0402873 May 12 16:00:05.289537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d3f4c70-5cbb-49f2-ad05-5607c3659689 req-2f84cae3-e4a7-4a2a-aa12-ad4e74119a22 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:05.291167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d3f4c70-5cbb-49f2-ad05-5607c3659689 req-2f84cae3-e4a7-4a2a-aa12-ad4e74119a22 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 943 time: 0.0869596 May 12 16:00:05.338552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d3f4c70-5cbb-49f2-ad05-5607c3659689 req-c0760481-1535-4010-a701-f083258efa1b tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411029 May 12 16:00:05.427157 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-78722f6c-f58b-40b9-92c7-b7743dda7739 service neutron] 10.222.0.76 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2387238 May 12 16:00:05.562066 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2919181f-46af-4881-bfa5-62f968637b5e req-42dd2268-e5c0-4515-ae11-bb3fd397f8d6 service neutron] 10.222.0.76 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1287608 May 12 16:00:06.425407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '99aec6b3-8413-4f2d-92e8-9681312de865', 'tag': '19fb186d-dbbb-453e-b025-33746337c501'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:00:06.486185 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-06108c7a-5b63-400f-bf07-0631fe071383'] response: {'name': 'network-changed', 'server_uuid': '99aec6b3-8413-4f2d-92e8-9681312de865', 'tag': '19fb186d-dbbb-453e-b025-33746337c501', 'status': 'completed', 'code': 200} May 12 16:00:06.532291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcd4e9ad-6e11-4cd7-baf4-2d2d1ac89c98 req-a1633e72-8e3d-4b2f-b9c2-1ef83c639a49 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:06.535480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bcd4e9ad-6e11-4cd7-baf4-2d2d1ac89c98 req-a1633e72-8e3d-4b2f-b9c2-1ef83c639a49 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 943 time: 0.0866456 May 12 16:00:06.578917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088d100c-eb1f-445c-818d-45fe352c54bd req-d8b125ce-5b61-461b-8b8f-d6dcb0d46e37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:06.580368 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-088d100c-eb1f-445c-818d-45fe352c54bd req-d8b125ce-5b61-461b-8b8f-d6dcb0d46e37 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=c8125bb099e9451bb501bcce403efb07&device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 1094 time: 0.0763180 May 12 16:00:06.632730 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bcd4e9ad-6e11-4cd7-baf4-2d2d1ac89c98 req-e58e0abb-ae8e-4fe3-8b14-6acf5690b418 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630164 May 12 16:00:06.645944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088d100c-eb1f-445c-818d-45fe352c54bd req-1a647899-8aaf-4d8a-a075-467082cab32f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:06.647411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-088d100c-eb1f-445c-818d-45fe352c54bd req-1a647899-8aaf-4d8a-a075-467082cab32f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c8125bb099e9451bb501bcce403efb07&device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 1094 time: 0.1109693 May 12 16:00:06.714898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088d100c-eb1f-445c-818d-45fe352c54bd req-381c46d9-2c2b-46c7-8291-29fc3c30c161 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:06.716338 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-088d100c-eb1f-445c-818d-45fe352c54bd req-381c46d9-2c2b-46c7-8291-29fc3c30c161 service neutron] 10.222.0.76 "GET /v2.0/networks?id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3 HTTP/1.1" status: 200 len: 913 time: 0.1295550 May 12 16:00:06.787894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088d100c-eb1f-445c-818d-45fe352c54bd req-04d3e192-3566-4f58-a67e-45ef85802be1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:06.789344 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-088d100c-eb1f-445c-818d-45fe352c54bd req-04d3e192-3566-4f58-a67e-45ef85802be1 service neutron] 10.222.0.84 "GET /v2.0/networks?id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3 HTTP/1.1" status: 200 len: 913 time: 0.1319759 May 12 16:00:06.790325 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-088d100c-eb1f-445c-818d-45fe352c54bd req-3b46dd8a-65ee-4b59-adb9-16affae62e0d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=19fb186d-dbbb-453e-b025-33746337c501 HTTP/1.1" status: 200 len: 217 time: 0.0656748 May 12 16:00:06.854417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088d100c-eb1f-445c-818d-45fe352c54bd req-73f376e8-8748-497f-8129-b48c4a06f64c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:06.855855 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-088d100c-eb1f-445c-818d-45fe352c54bd req-73f376e8-8748-497f-8129-b48c4a06f64c service neutron] 10.222.0.76 "GET /v2.0/subnets?id=3ae5859a-3683-4498-83c8-ce40960631c8 HTTP/1.1" status: 200 len: 852 time: 0.0595102 May 12 16:00:06.871292 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-088d100c-eb1f-445c-818d-45fe352c54bd req-72f15868-c32e-4093-bfda-512bf4ef8e10 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=19fb186d-dbbb-453e-b025-33746337c501 HTTP/1.1" status: 200 len: 217 time: 0.0708461 May 12 16:00:06.903788 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-088d100c-eb1f-445c-818d-45fe352c54bd req-ede7a9d6-afab-4e2a-bb31-85b8473bab7f service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0412364 May 12 16:00:06.941360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088d100c-eb1f-445c-818d-45fe352c54bd req-cf206cf7-5032-41d4-b187-ffad1acf8b99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:06.943343 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-088d100c-eb1f-445c-818d-45fe352c54bd req-cf206cf7-5032-41d4-b187-ffad1acf8b99 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5859a-3683-4498-83c8-ce40960631c8 HTTP/1.1" status: 200 len: 852 time: 0.0627244 May 12 16:00:06.992684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-088d100c-eb1f-445c-818d-45fe352c54bd req-89886bf9-b11a-40df-962c-320e2fee4c78 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0401318 May 12 16:00:07.043782 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 19fb186d-dbbb-453e-b025-33746337c501 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:00:07.044378 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-088d100c-eb1f-445c-818d-45fe352c54bd req-c1084746-912d-4483-8e1e-a4e37b346a50 service neutron] 10.222.0.76 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1342926 May 12 16:00:07.142162 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-088d100c-eb1f-445c-818d-45fe352c54bd req-acebf226-8751-4553-9194-5df2debeb622 service neutron] 10.222.0.84 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1399541 May 12 16:00:07.209214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 19fb186d-dbbb-453e-b025-33746337c501, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=19fb186d-dbbb-453e-b025-33746337c501,segment=NetworkSegment(9a0565bb-eb2d-43d9-9e77-04925e08d416),segment_id=9a0565bb-eb2d-43d9-9e77-04925e08d416)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:00:07.235875 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-088d100c-eb1f-445c-818d-45fe352c54bd req-98e53ce9-ef46-4add-9b21-a9814eda0bb1 service neutron] 10.222.0.76 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1856017 May 12 16:00:07.238623 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '19fb186d-dbbb-453e-b025-33746337c501', 'network_id': '4f674cc5-d04a-49c2-8a6b-40b49f36afd3', 'port_id': '19fb186d-dbbb-453e-b025-33746337c501', 'mac_address': 'fa:16:3e:27:23:d4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 557, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3ae5859a-3683-4498-83c8-ce40960631c8', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:00:07.301726 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:07.321025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 19fb186d-dbbb-453e-b025-33746337c501 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:00:07.339015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 19fb186d-dbbb-453e-b025-33746337c501, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=19fb186d-dbbb-453e-b025-33746337c501,segment=NetworkSegment(9a0565bb-eb2d-43d9-9e77-04925e08d416),segment_id=9a0565bb-eb2d-43d9-9e77-04925e08d416)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:00:07.345684 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:07.393561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 19fb186d-dbbb-453e-b025-33746337c501 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:00:07.420084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-088d100c-eb1f-445c-818d-45fe352c54bd req-5f5e8215-5980-4558-a96f-78ab09b8dc92 service neutron] 10.222.0.84 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2706606 May 12 16:00:07.477562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=19fb186d-dbbb-453e-b025-33746337c501,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:07.481336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 19fb186d-dbbb-453e-b025-33746337c501 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:00:07.605961 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['19fb186d-dbbb-453e-b025-33746337c501'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:00:07.819325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf14ceb0-ef6f-46b7-8f7d-63da9e4c35cf req-51370cbd-75d5-4e4a-928e-3e7f6a7a1c99 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:07.820760 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf14ceb0-ef6f-46b7-8f7d-63da9e4c35cf req-51370cbd-75d5-4e4a-928e-3e7f6a7a1c99 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 944 time: 0.0804174 May 12 16:00:07.864702 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf14ceb0-ef6f-46b7-8f7d-63da9e4c35cf req-0ac270b9-3aae-4a31-8ff6-de93bc2b0ff0 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380845 May 12 16:00:08.261340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-5a8b420b-b020-44d6-8265-497e9f068baa tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:08.262709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-5a8b420b-b020-44d6-8265-497e9f068baa tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.84 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865&tenant_id=c8125bb099e9451bb501bcce403efb07&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 944 time: 0.0852101 May 12 16:00:08.343473 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-c4b44d9e-fcff-4058-9af7-3d3326b83b90 service neutron] delete failed (client error): The resource could not be found. May 12 16:00:08.344439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-c4b44d9e-fcff-4058-9af7-3d3326b83b90 service neutron] 10.222.0.84 "DELETE /v2.0/ports/19fb186d-dbbb-453e-b025-33746337c501/bindings/n-h1-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.0733488 May 12 16:00:08.518432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-99e35858-e420-4427-9194-d617adaeca01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:08.519764 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-99e35858-e420-4427-9194-d617adaeca01 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=c8125bb099e9451bb501bcce403efb07&device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 1095 time: 0.0721841 May 12 16:00:08.649110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-85c77f94-0791-4952-95ae-33b2b52af104 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:08.651304 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-85c77f94-0791-4952-95ae-33b2b52af104 service neutron] 10.222.0.84 "GET /v2.0/networks?id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3 HTTP/1.1" status: 200 len: 913 time: 0.1228120 May 12 16:00:08.723936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-d4838c28-1649-4df2-b580-5c68f4320c18 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=19fb186d-dbbb-453e-b025-33746337c501 HTTP/1.1" status: 200 len: 217 time: 0.0635207 May 12 16:00:08.786951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-aadcdc76-6a16-4df9-87d5-941ccc0f4c8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:08.788213 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-aadcdc76-6a16-4df9-87d5-941ccc0f4c8a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3ae5859a-3683-4498-83c8-ce40960631c8 HTTP/1.1" status: 200 len: 852 time: 0.0552964 May 12 16:00:08.835815 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-e37222a1-1531-4102-8b13-834860c07447 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=4f674cc5-d04a-49c2-8a6b-40b49f36afd3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0399342 May 12 16:00:08.970854 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-ae6bbba7-412f-475f-a558-65a55cbbf7e9 service neutron] 10.222.0.84 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1232936 May 12 16:00:09.055308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 19fb186d-dbbb-453e-b025-33746337c501 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:00:09.107743 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-89e29d62-fad1-4b14-a541-1b66a6a64f91 service neutron] 10.222.0.84 "GET /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1272790 May 12 16:00:09.121360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 19fb186d-dbbb-453e-b025-33746337c501 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:00:09.126206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 19fb186d-dbbb-453e-b025-33746337c501 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:00:09.126574 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:09.246272 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:09.272469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '99aec6b3-8413-4f2d-92e8-9681312de865', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '19fb186d-dbbb-453e-b025-33746337c501'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:00:09.282671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 19fb186d-dbbb-453e-b025-33746337c501, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=19fb186d-dbbb-453e-b025-33746337c501,segment=NetworkSegment(9a0565bb-eb2d-43d9-9e77-04925e08d416),segment_id=9a0565bb-eb2d-43d9-9e77-04925e08d416)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:00:09.287517 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:09.333341 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-caf76b57-e4f5-4dd2-a6f7-f2fde7124edc'] response: {'server_uuid': '99aec6b3-8413-4f2d-92e8-9681312de865', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '19fb186d-dbbb-453e-b025-33746337c501', 'code': 200} May 12 16:00:09.357398 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=19fb186d-dbbb-453e-b025-33746337c501,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:10.247503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fc87ae-f8cd-43f1-bb92-cb652a6c4f8f req-48b80599-1116-4249-ba3d-ca24e2b585d8 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:10.248934 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10fc87ae-f8cd-43f1-bb92-cb652a6c4f8f req-48b80599-1116-4249-ba3d-ca24e2b585d8 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0823848 May 12 16:00:10.295438 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-10fc87ae-f8cd-43f1-bb92-cb652a6c4f8f req-d2690aeb-5bd1-4f46-8018-536e46fd944c tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407145 May 12 16:00:11.415836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-d7290d3f-a578-4786-8cdb-e2b0edde5b7f tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:11.417824 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-d7290d3f-a578-4786-8cdb-e2b0edde5b7f tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.76 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0865886 May 12 16:00:11.479883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c736fc54-f6f4-4297-903d-d016d996599c req-d27b6804-b500-4da4-bfcf-fbc95cd546e7 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:11.481324 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c736fc54-f6f4-4297-903d-d016d996599c req-d27b6804-b500-4da4-bfcf-fbc95cd546e7 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/ports?device_id=99aec6b3-8413-4f2d-92e8-9681312de865 HTTP/1.1" status: 200 len: 945 time: 0.0797548 May 12 16:00:11.488925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-76c27bee-3696-4336-aa49-f55de18e522d tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Deleting port 19fb186d-dbbb-453e-b025-33746337c501 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:00:11.489263 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-76c27bee-3696-4336-aa49-f55de18e522d tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:11.526455 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c736fc54-f6f4-4297-903d-d016d996599c req-c23cc2ce-2e28-4448-9fab-b0b56c42c9d4 tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.82 "GET /v2.0/security-groups?id=9b6ff423-ea58-423c-9b3c-d74a248efb26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394180 May 12 16:00:11.733567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-76c27bee-3696-4336-aa49-f55de18e522d tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] For port 19fb186d-dbbb-453e-b025-33746337c501, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=19fb186d-dbbb-453e-b025-33746337c501,segment=NetworkSegment(9a0565bb-eb2d-43d9-9e77-04925e08d416),segment_id=9a0565bb-eb2d-43d9-9e77-04925e08d416)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:00:11.733934 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-76c27bee-3696-4336-aa49-f55de18e522d tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:11.853734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-76c27bee-3696-4336-aa49-f55de18e522d tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Calling delete_port for 19fb186d-dbbb-453e-b025-33746337c501 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:00:11.994802 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-76c27bee-3696-4336-aa49-f55de18e522d tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:12.006367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['19fb186d-dbbb-453e-b025-33746337c501'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:00:12.047805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76c27bee-3696-4336-aa49-f55de18e522d tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Pushing event deleted for resources: {'Port': ['ID=19fb186d-dbbb-453e-b025-33746337c501,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:12.224425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-76c27bee-3696-4336-aa49-f55de18e522d tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] No DVR routers for this DVR port 19fb186d-dbbb-453e-b025-33746337c501 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:00:12.226950 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-76c27bee-3696-4336-aa49-f55de18e522d tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:12.230142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '99aec6b3-8413-4f2d-92e8-9681312de865', 'name': 'network-vif-deleted', 'tag': '19fb186d-dbbb-453e-b025-33746337c501'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:00:12.245244 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-188dced6-86d2-40b2-ab1e-bb94891afa58 req-76c27bee-3696-4336-aa49-f55de18e522d tempest-DeleteServersTestJSON-1709850184 tempest-DeleteServersTestJSON-1709850184-project] 10.222.0.76 "DELETE /v2.0/ports/19fb186d-dbbb-453e-b025-33746337c501 HTTP/1.1" status: 204 len: 173 time: 0.8223100 May 12 16:00:12.289101 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5252e5dc-4634-4793-aa70-e4c9dd6e2ad8'] response: {'server_uuid': '99aec6b3-8413-4f2d-92e8-9681312de865', 'name': 'network-vif-deleted', 'tag': '19fb186d-dbbb-453e-b025-33746337c501', 'status': 'completed', 'code': 200} May 12 16:00:12.774104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52288) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:00:12.814287 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-168fff56-aa7d-42e0-af7c-a8a70e7e29d3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:12.840564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Deleting subnet 3ae5859a-3683-4498-83c8-ce40960631c8 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:00:12.843684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:12.893401 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:12.950162 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.016436 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.054391 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3ae5859a-3683-4498-83c8-ce40960631c8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:13.057288 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.066711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:13.066989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:13.067312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:13.067633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:13.067950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:13.068266 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:13.068578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:13.068887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:13.069196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:13.069531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:13.069844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:13.070149 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:13.074352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c6a3ba79-100b-42cd-a1be-fc1e83681ed0 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/3ae5859a-3683-4498-83c8-ce40960631c8 HTTP/1.1" status: 204 len: 168 time: 0.2992570 May 12 16:00:13.076791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52292) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:00:13.184162 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-333081b5-f998-4169-ae0a-7689542ced27 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.308442 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-333081b5-f998-4169-ae0a-7689542ced27 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.332627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-333081b5-f998-4169-ae0a-7689542ced27 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4f674cc5-d04a-49c2-8a6b-40b49f36afd3']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:00:13.347680 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-333081b5-f998-4169-ae0a-7689542ced27 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9a0565bb-eb2d-43d9-9e77-04925e08d416') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:00:13.347965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-333081b5-f998-4169-ae0a-7689542ced27 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9a0565bb-eb2d-43d9-9e77-04925e08d416') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:00:13.359381 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-333081b5-f998-4169-ae0a-7689542ced27 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.478993 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-333081b5-f998-4169-ae0a-7689542ced27 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.485279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-333081b5-f998-4169-ae0a-7689542ced27 admin admin] Releasing vlan 557 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:00:13.485771 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-333081b5-f998-4169-ae0a-7689542ced27 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: timer() May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: self._notify() May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:00:13.500315 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:00:13.558591 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.578246 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-333081b5-f998-4169-ae0a-7689542ced27 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.594107 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-333081b5-f998-4169-ae0a-7689542ced27 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.604531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-333081b5-f998-4169-ae0a-7689542ced27 admin admin] Pushing event deleted for resources: {'Network': ['ID=4f674cc5-d04a-49c2-8a6b-40b49f36afd3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:13.613059 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-333081b5-f998-4169-ae0a-7689542ced27 admin admin] 10.222.0.82 "DELETE /v2.0/networks/4f674cc5-d04a-49c2-8a6b-40b49f36afd3 HTTP/1.1" status: 204 len: 168 time: 0.5352693 May 12 16:00:13.722076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52298) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:00:13.769472 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d057882a-a527-4345-bc23-037eb9ea5dd4 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c8125bb099e9451bb501bcce403efb07&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0462213 May 12 16:00:13.771775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52302) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:00:13.832203 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab7af3b0-fc6e-49ce-8ed6-e619221e7d93 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.861825 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab7af3b0-fc6e-49ce-8ed6-e619221e7d93 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.917694 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab7af3b0-fc6e-49ce-8ed6-e619221e7d93 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.935299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab7af3b0-fc6e-49ce-8ed6-e619221e7d93 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b6ff423-ea58-423c-9b3c-d74a248efb26,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:13.947423 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ab7af3b0-fc6e-49ce-8ed6-e619221e7d93 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:13.948700 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ab7af3b0-fc6e-49ce-8ed6-e619221e7d93 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9b6ff423-ea58-423c-9b3c-d74a248efb26 HTTP/1.1" status: 204 len: 168 time: 0.1760688 May 12 16:00:14.653752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52326) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:00:14.756768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Request body: {'network': {'name': 'tempest-ServerDiskConfigTestJSON-1249916384-network', 'tenant_id': '58cfa2ec20c94aa7af98c7be5675feb4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:00:14.762494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:00:14.766321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Usage tracker for resource:network and tenant:58cfa2ec20c94aa7af98c7be5675feb4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:00:14.769119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:00:14.775222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:00:14.785642 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Made reservation on behalf of 58cfa2ec20c94aa7af98c7be5675feb4 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:00:14.787865 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:14.799835 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:14.814237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:00:14.817928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Usage tracker for resource:security_group_rule and tenant:58cfa2ec20c94aa7af98c7be5675feb4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:00:14.820640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:00:14.826842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:00:14.907798 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:14.911421 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:14.940860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 589} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:00:14.949984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c1ece45-a385-4bc4-afe6-398964c0ea2f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:14.955519 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:14.955853 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Added segment f6dc9d63-af4f-4f75-8ae2-937f514a3f14 of type vlan for network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f May 12 16:00:14.983335 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:15.011840 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:15.012755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:15.013316 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:15.070672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 19fb186d-dbbb-453e-b025-33746337c501 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:00:15.109687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 19fb186d-dbbb-453e-b025-33746337c501 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:00:15.110032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 19fb186d-dbbb-453e-b025-33746337c501 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:00:15.117025 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.4621947 May 12 16:00:15.120047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52332) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:00:15.120559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ede545d1-e410-4a7e-9571-2020dda77e8c admin admin] Pushing event updated for resources: {'Network': ['ID=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:15.125513 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Request body: {'subnet': {'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerDiskConfigTestJSON-1249916384-subnet', 'tenant_id': '58cfa2ec20c94aa7af98c7be5675feb4', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:00:15.131040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:00:15.131402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:00:15.135282 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Usage tracker for resource:subnet and tenant:58cfa2ec20c94aa7af98c7be5675feb4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:00:15.138153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:00:15.143991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:00:15.154672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Made reservation on behalf of 58cfa2ec20c94aa7af98c7be5675feb4 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:00:15.156970 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:15.351391 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dd1ca4f1-c2bd-4aa1-ab4a-724927fde3f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:15.363825 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:15.436467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2ac83bda-e932-46dd-ae57-390b2e4d797b,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:15.445259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Checking segment: {'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:00:15.445644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Network hostable DHCP agents. Network: ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:00:15.475540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:00:15.485263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:00:15.490032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:15.491379 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:15.496241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0def3004-775d-41d5-ae03-4e7379ba9965 None None] Network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:00:15.522433 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2557d19c-9fd9-45f1-82c1-2659408f7ed3 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.4007471 May 12 16:00:15.747535 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdc9d93e-3b2a-40b4-8f86-ff935963b62a None None] Network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:00:16.032871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-24cd2284-19e8-4978-86d1-e65d7de8cd54 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:16.033486 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-24cd2284-19e8-4978-86d1-e65d7de8cd54 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Synchronizing usage tracker for tenant:58cfa2ec20c94aa7af98c7be5675feb4 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:00:16.050222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-24cd2284-19e8-4978-86d1-e65d7de8cd54 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Unset dirty status for tenant:58cfa2ec20c94aa7af98c7be5675feb4 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:00:16.051473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-24cd2284-19e8-4978-86d1-e65d7de8cd54 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 815 time: 0.1622703 May 12 16:00:16.060017 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:16.069249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-6b6c242f-4e8b-4473-9b16-7686673556a7 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/quotas/58cfa2ec20c94aa7af98c7be5675feb4 HTTP/1.1" status: 200 len: 375 time: 0.0112383 May 12 16:00:16.122283 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-1aa7ccd3-1d78-4219-a011-be4c48a11d07 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0468664 May 12 16:00:16.259916 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-aa43da3f-2b6c-491a-bcd6-e52d9745732e service neutron] 10.222.0.82 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1307535 May 12 16:00:16.329199 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:16.394978 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-15465bf8-f444-4ac3-b682-629b61c91091 service neutron] 10.222.0.82 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1291168 May 12 16:00:16.573314 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8a3537b-fab0-4d09-a01b-81662bc90a63 req-6f38f35e-26b8-4623-8c88-a8ef1bb0460b tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 210 time: 0.0428128 May 12 16:00:17.610869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-16d6b835-b259-4063-90a2-1c4ea5861db2 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:17.612299 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-16d6b835-b259-4063-90a2-1c4ea5861db2 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.76 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 815 time: 0.1540062 May 12 16:00:17.624913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Request body: {'port': {'device_id': '137e04b7-0b75-4e2f-996f-c09958046a73', 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f', 'admin_state_up': True, 'tenant_id': '58cfa2ec20c94aa7af98c7be5675feb4'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:00:17.721920 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a77271b2-cf5c-47ba-b360-479e91c8f775 req-f163635c-2f9d-4570-8805-c4bccc2990c3 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 210 time: 0.0430479 May 12 16:00:17.768027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:00:17.771816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Usage tracker for resource:port and tenant:58cfa2ec20c94aa7af98c7be5675feb4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:00:17.774607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:00:17.781228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:00:17.790546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Made reservation on behalf of 58cfa2ec20c94aa7af98c7be5675feb4 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:00:17.794979 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:17.810195 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:17.956838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Allocated IP 172.20.0.3 (ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f/2ac83bda-e932-46dd-ae57-390b2e4d797b/9fe513b3-122d-4e70-9200-622975f32f09) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:00:18.154972 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:18.183704 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:18.257402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:00:18.261309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:00:18.265303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:00:18.300095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Pushing event updated for resources: {'Port': ['ID=9fe513b3-122d-4e70-9200-622975f32f09,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:18.331801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:18.332398 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:18.351537 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-d8091f29-b539-4ab7-ad3a-4de565e1565a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7306213 May 12 16:00:18.412751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Request body: {'port': {'device_id': '137e04b7-0b75-4e2f-996f-c09958046a73', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:00:18.523766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:18.863323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9fe513b3-122d-4e70-9200-622975f32f09 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:00:18.870515 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:18.884594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Transition to ACTIVE for port object 9fe513b3-122d-4e70-9200-622975f32f09 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:00:18.887477 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:18.910921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce4e6f57-d363-438b-8c30-f6b9cf0f6e32 req-4c1e7ee8-7a4c-4fcb-95c4-21c1a7e86b11 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:18.912477 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce4e6f57-d363-438b-8c30-f6b9cf0f6e32 req-4c1e7ee8-7a4c-4fcb-95c4-21c1a7e86b11 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 931 time: 0.0841179 May 12 16:00:18.956951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ce4e6f57-d363-438b-8c30-f6b9cf0f6e32 req-a1b733e3-d353-408f-b82b-c4c3d3dc6221 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Synchronizing usage tracker for tenant:58cfa2ec20c94aa7af98c7be5675feb4 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:00:18.975087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-ce4e6f57-d363-438b-8c30-f6b9cf0f6e32 req-a1b733e3-d353-408f-b82b-c4c3d3dc6221 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Unset dirty status for tenant:58cfa2ec20c94aa7af98c7be5675feb4 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:00:18.976407 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce4e6f57-d363-438b-8c30-f6b9cf0f6e32 req-a1b733e3-d353-408f-b82b-c4c3d3dc6221 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576959 May 12 16:00:19.151386 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Pushing event updated for resources: {'Port': ['ID=9fe513b3-122d-4e70-9200-622975f32f09,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:19.190666 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:19.191007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:19.191336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:19.191662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:19.191984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:19.192299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:19.192615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:19.192929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:19.193242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:19.193584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:19.193899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:19.194207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:19.239056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Attempting to bind port 9fe513b3-122d-4e70-9200-622975f32f09 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:00:19.239381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Attempting to bind port 9fe513b3-122d-4e70-9200-622975f32f09 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:00:19.239700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Attempting to bind port 9fe513b3-122d-4e70-9200-622975f32f09 on network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:00:19.244157 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Port 9fe513b3-122d-4e70-9200-622975f32f09 on network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:00:19.244594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Attempting to bind port 9fe513b3-122d-4e70-9200-622975f32f09 on network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:00:19.249660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 0, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:00:19.249990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Checking segment: {'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:00:19.250370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Bound using segment: {'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:00:19.251009 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Bound port: 9fe513b3-122d-4e70-9200-622975f32f09, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:00:19.251352 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:19.342007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] For port 9fe513b3-122d-4e70-9200-622975f32f09, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:00:19.344843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] For port 9fe513b3-122d-4e70-9200-622975f32f09, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9fe513b3-122d-4e70-9200-622975f32f09,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:00:19.349261 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:19.406255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:19.406695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:19.408058 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] 10.222.0.76 "PUT /v2.0/ports/9fe513b3-122d-4e70-9200-622975f32f09 HTTP/1.1" status: 200 len: 1091 time: 1.0494056 May 12 16:00:19.410903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '137e04b7-0b75-4e2f-996f-c09958046a73', 'tag': '9fe513b3-122d-4e70-9200-622975f32f09'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:00:19.432608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04875320-992f-4a35-a61b-8481a8a6f21b service neutron] Pushing event updated for resources: {'Port': ['ID=9fe513b3-122d-4e70-9200-622975f32f09,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:19.483197 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ac12770d-9413-48dd-acb4-cadf83606f9f'] response: {'name': 'network-changed', 'server_uuid': '137e04b7-0b75-4e2f-996f-c09958046a73', 'tag': '9fe513b3-122d-4e70-9200-622975f32f09', 'status': 'completed', 'code': 200} May 12 16:00:19.518241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-33bb4bee-57ed-4044-8828-49bb43e00f3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:19.519700 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-33bb4bee-57ed-4044-8828-49bb43e00f3e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 1094 time: 0.0762875 May 12 16:00:19.586949 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-9abe3d7d-e03a-49fc-bfd8-4962854d5386 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=9fe513b3-122d-4e70-9200-622975f32f09 HTTP/1.1" status: 200 len: 217 time: 0.0611994 May 12 16:00:19.650888 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-806ba0f8-59e0-4815-88fa-ad5fe2f002ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:19.652268 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-806ba0f8-59e0-4815-88fa-ad5fe2f002ce service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.0598283 May 12 16:00:19.697350 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-4428c473-a6af-4c01-b49e-e426dd439636 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0392737 May 12 16:00:19.835825 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-59cb709f-a44e-405e-8e85-ea99063ccfbc service neutron] 10.222.0.76 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1329076 May 12 16:00:19.964727 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-21e51fc0-3f00-4396-a874-0ab75df95e6d req-968c78b4-adb3-4cd6-8ed0-a9c6d7a04eea service neutron] 10.222.0.76 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1229913 May 12 16:00:20.085901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c41d9f87-9dae-4ef9-87f9-ed53ca2add89 req-b6aa9c6d-c541-4649-8882-f0cf396ce2d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:20.087381 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c41d9f87-9dae-4ef9-87f9-ed53ca2add89 req-b6aa9c6d-c541-4649-8882-f0cf396ce2d7 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 1094 time: 0.0754561 May 12 16:00:20.175476 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0748e63-cbfb-4874-8106-5bcc05b11471 req-0da4bf3f-91a3-480c-adf2-024440368127 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:20.176957 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0748e63-cbfb-4874-8106-5bcc05b11471 req-0da4bf3f-91a3-480c-adf2-024440368127 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 943 time: 0.0814281 May 12 16:00:20.219861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c41d9f87-9dae-4ef9-87f9-ed53ca2add89 req-2f157849-cb4a-4123-96a3-c103275077b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:20.221214 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c41d9f87-9dae-4ef9-87f9-ed53ca2add89 req-2f157849-cb4a-4123-96a3-c103275077b2 service neutron] 10.222.0.76 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 916 time: 0.1279647 May 12 16:00:20.221409 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0748e63-cbfb-4874-8106-5bcc05b11471 req-b8714c14-b6a0-4eb9-8a83-9d0bcd7369d9 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388491 May 12 16:00:20.334681 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c41d9f87-9dae-4ef9-87f9-ed53ca2add89 req-c8ded581-d95d-4648-b03e-6858163694c4 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=9fe513b3-122d-4e70-9200-622975f32f09 HTTP/1.1" status: 200 len: 217 time: 0.1028121 May 12 16:00:20.336839 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-762cb57f-8103-4572-a7e1-551bf96d5135 req-51c25adc-48c4-48f0-990a-e3521cd3662a service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0498080 May 12 16:00:20.402521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c41d9f87-9dae-4ef9-87f9-ed53ca2add89 req-da31e80b-e27f-4756-a32b-1f8aada9e696 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:20.403988 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c41d9f87-9dae-4ef9-87f9-ed53ca2add89 req-da31e80b-e27f-4756-a32b-1f8aada9e696 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.0584157 May 12 16:00:20.478903 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-762cb57f-8103-4572-a7e1-551bf96d5135 req-71df9a4f-4ee1-43ca-8ef7-bea31a556d68 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0739224 May 12 16:00:20.484979 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c41d9f87-9dae-4ef9-87f9-ed53ca2add89 req-0e3c0c77-cbe8-4e83-9d31-0a8b6037d533 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0469894 May 12 16:00:20.691721 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-762cb57f-8103-4572-a7e1-551bf96d5135 req-32d089ab-1eb1-412e-be49-67f08dde8d31 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1835899 May 12 16:00:20.840942 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c41d9f87-9dae-4ef9-87f9-ed53ca2add89 req-eb4d7186-7c00-4148-bc29-166c65db48f4 service neutron] 10.222.0.76 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3498733 May 12 16:00:20.924925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-762cb57f-8103-4572-a7e1-551bf96d5135 req-1cde60c8-c363-4263-9be9-d00ab9cc22b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:20.926342 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-762cb57f-8103-4572-a7e1-551bf96d5135 req-1cde60c8-c363-4263-9be9-d00ab9cc22b1 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2272003 May 12 16:00:20.984312 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c41d9f87-9dae-4ef9-87f9-ed53ca2add89 req-0fa6f759-1cab-4069-bdc1-bc32a52dc733 service neutron] 10.222.0.76 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1310353 May 12 16:00:21.101598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 9fe513b3-122d-4e70-9200-622975f32f09 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:00:21.241777 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 9fe513b3-122d-4e70-9200-622975f32f09, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9fe513b3-122d-4e70-9200-622975f32f09,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:00:21.255160 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '9fe513b3-122d-4e70-9200-622975f32f09', 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f', 'port_id': '9fe513b3-122d-4e70-9200-622975f32f09', 'mac_address': 'fa:16:3e:30:df:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 589, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ac83bda-e932-46dd-ae57-390b2e4d797b', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:00:21.309879 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:21.329858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9fe513b3-122d-4e70-9200-622975f32f09 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:00:21.345691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 9fe513b3-122d-4e70-9200-622975f32f09, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9fe513b3-122d-4e70-9200-622975f32f09,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:00:21.349982 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:21.419886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ad1c02-4796-49e6-ac22-5052558582ba req-bc633892-c09c-4c32-aa7a-99edb59665f4 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:21.421251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=9fe513b3-122d-4e70-9200-622975f32f09,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:21.421477 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6ad1c02-4796-49e6-ac22-5052558582ba req-bc633892-c09c-4c32-aa7a-99edb59665f4 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 944 time: 0.0896378 May 12 16:00:21.429231 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:21.429597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:21.429939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:21.430271 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:21.430600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:21.430930 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:21.431273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:21.431597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:21.432648 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:21.432984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:21.433314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:21.433961 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:00:21.466761 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6ad1c02-4796-49e6-ac22-5052558582ba req-2153c2d0-840d-4199-bf28-e70a45eade1f tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397804 May 12 16:00:21.536064 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['9fe513b3-122d-4e70-9200-622975f32f09'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:00:22.646304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9f696ce-9f21-4f89-858f-381c82b059f0 req-f4daa93a-ef98-4528-bdce-186e1ce0a8b5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:22.647717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9f696ce-9f21-4f89-858f-381c82b059f0 req-f4daa93a-ef98-4528-bdce-186e1ce0a8b5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 944 time: 0.0777807 May 12 16:00:22.693451 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a9f696ce-9f21-4f89-858f-381c82b059f0 req-ac27ede2-a094-4d66-84fd-a83ea444f696 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401657 May 12 16:00:23.133977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 9fe513b3-122d-4e70-9200-622975f32f09 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:00:23.202314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 9fe513b3-122d-4e70-9200-622975f32f09 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:00:23.206846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 9fe513b3-122d-4e70-9200-622975f32f09 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:00:23.207230 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:23.325167 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:23.350461 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '137e04b7-0b75-4e2f-996f-c09958046a73', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9fe513b3-122d-4e70-9200-622975f32f09'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:00:23.360556 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 9fe513b3-122d-4e70-9200-622975f32f09, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9fe513b3-122d-4e70-9200-622975f32f09,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:00:23.364198 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:23.398377 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c8f4da04-6620-4ff9-9f22-b5bf938fe0ad'] response: {'server_uuid': '137e04b7-0b75-4e2f-996f-c09958046a73', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9fe513b3-122d-4e70-9200-622975f32f09', 'code': 200} May 12 16:00:23.436229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=9fe513b3-122d-4e70-9200-622975f32f09,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:23.527112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c28b8311-d38a-4185-b51d-014255387c26 req-6e21c602-bf24-4a7d-860f-c02f06332213 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:23.528586 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c28b8311-d38a-4185-b51d-014255387c26 req-6e21c602-bf24-4a7d-860f-c02f06332213 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 1096 time: 0.0754972 May 12 16:00:23.568426 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c28b8311-d38a-4185-b51d-014255387c26 req-d4869a82-5506-4408-a97d-4ae5008800c6 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342586 May 12 16:00:23.877056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b70edc0c-e313-4992-bb9c-c76862db0b45 req-5c193540-fe82-4814-a4d7-4ed1130db1b1 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:23.878495 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b70edc0c-e313-4992-bb9c-c76862db0b45 req-5c193540-fe82-4814-a4d7-4ed1130db1b1 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0787714 May 12 16:00:23.921477 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b70edc0c-e313-4992-bb9c-c76862db0b45 req-2633bfe7-c03f-4570-85f9-2b2c7d6ddee9 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0371218 May 12 16:00:25.111120 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d37471-6b65-47fd-9b6c-e2044a44b957 req-7264ecff-e6a7-401f-a1c2-0db9212cf94f tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:25.112549 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60d37471-6b65-47fd-9b6c-e2044a44b957 req-7264ecff-e6a7-401f-a1c2-0db9212cf94f tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0848784 May 12 16:00:25.155593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60d37471-6b65-47fd-9b6c-e2044a44b957 req-25ebaa6e-02b3-49a3-aa04-d75fc8e84171 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374844 May 12 16:00:25.340595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92970e0e-9f8a-438e-a183-845835f7032c req-dedde36a-37c5-4e95-846a-ad8f2f6a145a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:25.342072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-92970e0e-9f8a-438e-a183-845835f7032c req-dedde36a-37c5-4e95-846a-ad8f2f6a145a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0793424 May 12 16:00:25.385983 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-92970e0e-9f8a-438e-a183-845835f7032c req-b71e84ac-a662-4f63-b610-4b8f97195607 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383201 May 12 16:00:25.731499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a79dea15-46a0-470e-a486-01cb9ac72635 req-95d81987-1591-49e4-882f-f58cc7a2fced tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:25.732943 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a79dea15-46a0-470e-a486-01cb9ac72635 req-95d81987-1591-49e4-882f-f58cc7a2fced tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0842314 May 12 16:00:25.774734 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a79dea15-46a0-470e-a486-01cb9ac72635 req-ae180259-dc26-44e9-9275-ce4bb1517130 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0361989 May 12 16:00:25.955011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4539a54f-5489-4e15-a23d-508c178b01db req-9f3790a2-b3ed-473e-b5f5-46f79120284d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:25.956445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4539a54f-5489-4e15-a23d-508c178b01db req-9f3790a2-b3ed-473e-b5f5-46f79120284d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0789771 May 12 16:00:26.002501 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4539a54f-5489-4e15-a23d-508c178b01db req-0fd12ad3-d5f0-46f7-8b9d-f9c8bd20e720 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404561 May 12 16:00:26.520537 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-f1dd6d32-0eff-42f8-a634-4c306d2c8b5b service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.2408917 May 12 16:00:26.531690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-937ac787-d255-439e-b173-8bf0627a97bf req-dcf48a1f-b129-4fa1-93bd-4ae3ac6bf965 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:26.533037 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-937ac787-d255-439e-b173-8bf0627a97bf req-dcf48a1f-b129-4fa1-93bd-4ae3ac6bf965 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.2118974 May 12 16:00:26.581643 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-937ac787-d255-439e-b173-8bf0627a97bf req-0acdf86f-8762-4434-b1b8-809908efa425 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429204 May 12 16:00:27.767537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3c3b73f-d1c2-4f36-baef-e9aac3001838 req-4a2e59ba-df65-4c13-b40d-a813765640c4 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:27.769209 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3c3b73f-d1c2-4f36-baef-e9aac3001838 req-4a2e59ba-df65-4c13-b40d-a813765640c4 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0805790 May 12 16:00:27.814536 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3c3b73f-d1c2-4f36-baef-e9aac3001838 req-cc25ab7b-e1af-4092-bc52-29b1a2992658 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392222 May 12 16:00:27.877757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e5bd772e-c32b-4f7d-ada6-862dba469871 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:27.879130 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e5bd772e-c32b-4f7d-ada6-862dba469871 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 1096 time: 0.0712371 May 12 16:00:28.011124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-6b51470c-c3b3-4fc3-b4fd-6052b8e6cd4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:28.012542 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-6b51470c-c3b3-4fc3-b4fd-6052b8e6cd4c service neutron] 10.222.0.76 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 916 time: 0.1280673 May 12 16:00:28.081848 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-7e037847-2ba0-433b-9ef7-ca81b29183cb service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=9fe513b3-122d-4e70-9200-622975f32f09 HTTP/1.1" status: 200 len: 217 time: 0.0635183 May 12 16:00:28.145375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-c5df415d-11c9-42b8-9ff4-aee8a66cdbbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:28.146703 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-c5df415d-11c9-42b8-9ff4-aee8a66cdbbb service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.0562096 May 12 16:00:28.195794 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-d5c6c7d0-3fbd-4cbb-a579-3eba900a0e0c service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0425038 May 12 16:00:28.340137 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-d70602ba-5e91-459c-82bd-84045f5d3638 service neutron] 10.222.0.76 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1379566 May 12 16:00:28.470671 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-c20ad6f6-2854-4429-8313-ab6a06a39740 service neutron] 10.222.0.76 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1240430 May 12 16:00:29.002840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35c815f8-ea27-4383-af2f-d72be3bdf301 req-ed3a7dc8-2da0-4e54-88e8-6a0a603acb37 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:29.004269 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35c815f8-ea27-4383-af2f-d72be3bdf301 req-ed3a7dc8-2da0-4e54-88e8-6a0a603acb37 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0820146 May 12 16:00:29.049067 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35c815f8-ea27-4383-af2f-d72be3bdf301 req-0aff8fef-573d-47fd-8a43-a6ff9050816c tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390260 May 12 16:00:30.229512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-121486f2-4e40-42ab-95f1-5f536e20d032 req-5bc667ff-a68f-4647-85ec-ddd12d7281c5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:30.230954 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-121486f2-4e40-42ab-95f1-5f536e20d032 req-5bc667ff-a68f-4647-85ec-ddd12d7281c5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0794284 May 12 16:00:30.280762 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-121486f2-4e40-42ab-95f1-5f536e20d032 req-6e137103-9de9-4c47-be01-09929d076ffd tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438182 May 12 16:00:31.467212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a46a18a-6d47-4298-988c-cab8081db405 req-e887a3f6-8fe8-430a-b46e-1e8a942cee51 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:31.468649 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a46a18a-6d47-4298-988c-cab8081db405 req-e887a3f6-8fe8-430a-b46e-1e8a942cee51 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0826223 May 12 16:00:31.513525 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4a46a18a-6d47-4298-988c-cab8081db405 req-95980ee9-d270-41eb-a7e8-0084af396b65 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392911 May 12 16:00:32.704775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-062f5907-a9d2-48fc-b5d9-a3f615327818 req-a32d6fcc-672c-44b2-b25c-75412ba6d0ab tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:32.706588 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-062f5907-a9d2-48fc-b5d9-a3f615327818 req-a32d6fcc-672c-44b2-b25c-75412ba6d0ab tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0853703 May 12 16:00:32.753245 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-062f5907-a9d2-48fc-b5d9-a3f615327818 req-4182259f-0147-4ad2-acd0-61047f71c589 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411363 May 12 16:00:32.758913 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:33.936972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bd9f438-8e1d-4461-aaf7-fd688b0658d7 req-7fe9f3e4-5ae5-4a7c-8215-86b17a28c748 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:33.938750 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6bd9f438-8e1d-4461-aaf7-fd688b0658d7 req-7fe9f3e4-5ae5-4a7c-8215-86b17a28c748 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0821471 May 12 16:00:33.983487 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6bd9f438-8e1d-4461-aaf7-fd688b0658d7 req-3b316d85-834c-433d-8024-a554bd36cb2f tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391552 May 12 16:00:35.171976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d939ad06-b87e-46da-a62f-52d7ed199808 req-48c29464-09bd-4718-976b-cf9e7fff1fe7 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:35.173440 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d939ad06-b87e-46da-a62f-52d7ed199808 req-48c29464-09bd-4718-976b-cf9e7fff1fe7 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0858777 May 12 16:00:35.218612 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d939ad06-b87e-46da-a62f-52d7ed199808 req-8d74f128-7994-4ddf-86d5-0ce5f3255f65 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396078 May 12 16:00:36.411916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8097c562-d991-4ee8-822d-bdc0e90e60a8 req-686c795f-a926-4e59-ac81-48baccbf0267 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:36.413267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8097c562-d991-4ee8-822d-bdc0e90e60a8 req-686c795f-a926-4e59-ac81-48baccbf0267 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0782695 May 12 16:00:36.458900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8097c562-d991-4ee8-822d-bdc0e90e60a8 req-e34547bf-0d1d-4948-95f2-4e57e45e6e11 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392673 May 12 16:00:37.647618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d30172d8-68ac-43da-a314-a2ec8ebfb99f req-8bb58baf-81ed-4f16-bbc0-c5d6e9507a84 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:37.648974 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d30172d8-68ac-43da-a314-a2ec8ebfb99f req-8bb58baf-81ed-4f16-bbc0-c5d6e9507a84 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0841966 May 12 16:00:37.695126 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d30172d8-68ac-43da-a314-a2ec8ebfb99f req-7139f162-0021-4fdf-87ee-eba587401820 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404830 May 12 16:00:38.878166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f2a486f-8a7f-4803-b436-8eb6c503f6b9 req-e70ef355-0fe9-4c96-b416-1c5054380044 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:38.879630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f2a486f-8a7f-4803-b436-8eb6c503f6b9 req-e70ef355-0fe9-4c96-b416-1c5054380044 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0800846 May 12 16:00:38.926409 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f2a486f-8a7f-4803-b436-8eb6c503f6b9 req-4468f962-ead5-47e4-9ec1-e3e932fdcfd1 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412323 May 12 16:00:40.259293 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84bfce44-cf25-4154-baea-0f3255fca66a req-4d19d544-3869-4eab-ae17-b3b7a1666241 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:40.260790 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-84bfce44-cf25-4154-baea-0f3255fca66a req-4d19d544-3869-4eab-ae17-b3b7a1666241 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0800390 May 12 16:00:40.306059 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-84bfce44-cf25-4154-baea-0f3255fca66a req-a829e21d-0154-418b-b60e-232c443dd4b5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393529 May 12 16:00:41.490478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f947a4-b754-43a3-a9e1-b5dee0dadd34 req-7461eec9-8a2f-49e7-9f02-a51d70e7080b tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:41.491913 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a5f947a4-b754-43a3-a9e1-b5dee0dadd34 req-7461eec9-8a2f-49e7-9f02-a51d70e7080b tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0825436 May 12 16:00:41.536210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a5f947a4-b754-43a3-a9e1-b5dee0dadd34 req-bfbc8b51-8c05-4c6c-8041-73b4d46ffb88 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376356 May 12 16:00:41.970656 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:00:42.720415 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6247c85f-49d5-4954-9583-b3d0353dce82 req-71f1230e-089e-4423-b702-03809571b8ab tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:42.721891 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6247c85f-49d5-4954-9583-b3d0353dce82 req-71f1230e-089e-4423-b702-03809571b8ab tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0831041 May 12 16:00:42.766375 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6247c85f-49d5-4954-9583-b3d0353dce82 req-cbd38f6d-82e4-4724-a9ef-f02e27aaca5d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389273 May 12 16:00:42.816864 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0583c999-29b2-4df5-9a6e-a5da5124747f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:43.579315 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:43.957444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78964eba-d4db-4828-a7f4-d357e2f35c6e req-71ba6bb0-43ee-4d0b-a31a-5e94b2029045 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:43.958810 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78964eba-d4db-4828-a7f4-d357e2f35c6e req-71ba6bb0-43ee-4d0b-a31a-5e94b2029045 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0836506 May 12 16:00:44.002850 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78964eba-d4db-4828-a7f4-d357e2f35c6e req-a61140d6-4e7b-4a32-9450-eaf5f9484588 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382631 May 12 16:00:45.183175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e88f5e-ab95-4680-9088-49e28d78f8b9 req-a0bde4ae-cd29-4cb4-9e35-44f46236d7d1 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:45.184606 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78e88f5e-ab95-4680-9088-49e28d78f8b9 req-a0bde4ae-cd29-4cb4-9e35-44f46236d7d1 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0785632 May 12 16:00:45.231884 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78e88f5e-ab95-4680-9088-49e28d78f8b9 req-df80c137-d9ff-41dc-aafe-4c1cae54c81f tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414662 May 12 16:00:45.353693 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c7f3534a-19fb-43c2-809f-fe4e75dfbb7d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:46.062853 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:46.332113 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:46.415352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e25d570-8c49-43a5-8fbf-3c4c1103ae42 req-5d0c3e9d-277a-431d-a348-3d6f37ce23cd tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:46.417311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e25d570-8c49-43a5-8fbf-3c4c1103ae42 req-5d0c3e9d-277a-431d-a348-3d6f37ce23cd tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0797880 May 12 16:00:46.461847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e25d570-8c49-43a5-8fbf-3c4c1103ae42 req-4beff713-6f87-466b-bcd1-0f425920ddd6 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387950 May 12 16:00:47.657446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de61e53-01dc-43c2-b66c-2eae5645db62 req-4274b8c6-199d-4945-94d7-1dfc31344d94 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:47.658807 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0de61e53-01dc-43c2-b66c-2eae5645db62 req-4274b8c6-199d-4945-94d7-1dfc31344d94 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0874274 May 12 16:00:47.702792 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0de61e53-01dc-43c2-b66c-2eae5645db62 req-5cac51b8-f57c-4446-95f7-35817b37e166 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384111 May 12 16:00:47.814115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:48.883515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd6b106-171f-44f7-98b5-4b6dbbd9065b req-d4e5d1ce-5e69-411a-88ea-305a67723528 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:48.884952 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8fd6b106-171f-44f7-98b5-4b6dbbd9065b req-d4e5d1ce-5e69-411a-88ea-305a67723528 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0803304 May 12 16:00:48.928985 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8fd6b106-171f-44f7-98b5-4b6dbbd9065b req-7276e23e-508a-4974-bc6f-8ca8a96d52ef tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377543 May 12 16:00:50.114331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b65db221-490a-4b7d-a37b-65e919221ba5 req-bf3cf496-c9bd-4ba3-8ac0-3c40f8334c37 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:50.115789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b65db221-490a-4b7d-a37b-65e919221ba5 req-bf3cf496-c9bd-4ba3-8ac0-3c40f8334c37 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0839269 May 12 16:00:50.159102 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b65db221-490a-4b7d-a37b-65e919221ba5 req-adba1778-3d68-4127-a826-c47017f468d9 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0371099 May 12 16:00:51.343962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d3e6a12-3e23-499f-a675-665894dc3aae req-2f55dc06-9072-455e-8b68-167477c37a17 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:51.345402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d3e6a12-3e23-499f-a675-665894dc3aae req-2f55dc06-9072-455e-8b68-167477c37a17 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0785704 May 12 16:00:51.388578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d3e6a12-3e23-499f-a675-665894dc3aae req-b56c1fe2-bcc5-430c-b794-989436950796 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0375249 May 12 16:00:52.574194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44cb055d-c334-4124-9eaf-8a0d76cb09bf req-e8fb253c-950b-4de9-9d81-06f8f70a1fa5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:52.575560 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44cb055d-c334-4124-9eaf-8a0d76cb09bf req-e8fb253c-950b-4de9-9d81-06f8f70a1fa5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0838091 May 12 16:00:52.617946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44cb055d-c334-4124-9eaf-8a0d76cb09bf req-7ba8f420-dc57-42b8-9253-efa04c6e8930 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0368464 May 12 16:00:53.801953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fcc0a3d-ef71-4750-9624-3a2e9a470a9b req-79fe85ef-c545-48bb-850f-8278323bc3eb tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:53.803374 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9fcc0a3d-ef71-4750-9624-3a2e9a470a9b req-79fe85ef-c545-48bb-850f-8278323bc3eb tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0786293 May 12 16:00:53.850007 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9fcc0a3d-ef71-4750-9624-3a2e9a470a9b req-9a95eeb4-68ad-42c9-aa29-046c26554e23 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402880 May 12 16:00:55.034850 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14397945-e159-4acc-8b0a-111f66d4d31f req-aa3ec5bd-0332-4901-8e3c-af858d286d37 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:55.036275 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14397945-e159-4acc-8b0a-111f66d4d31f req-aa3ec5bd-0332-4901-8e3c-af858d286d37 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0793247 May 12 16:00:55.080994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-14397945-e159-4acc-8b0a-111f66d4d31f req-0991efd0-222f-45d1-80e5-3bdf668683e5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390854 May 12 16:00:55.442296 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-ac918f73-278a-4467-b608-7cefea08f49c service neutron] show failed (client error): The resource could not be found. May 12 16:00:55.443283 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-ac918f73-278a-4467-b608-7cefea08f49c service neutron] 10.222.0.76 "GET /v2.0/ports/9fe513b3-122d-4e70-9200-622975f32f09/bindings/n-h1-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.0755935 May 12 16:00:55.708990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-dfd980ad-095f-4d2b-bdff-228b8f49069c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:55.711062 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-dfd980ad-095f-4d2b-bdff-228b8f49069c service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73&tenant_id=58cfa2ec20c94aa7af98c7be5675feb4 HTTP/1.1" status: 200 len: 1096 time: 0.0775330 May 12 16:00:55.735799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:00:55.844194 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:56.301133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] For port 9fe513b3-122d-4e70-9200-622975f32f09, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9fe513b3-122d-4e70-9200-622975f32f09,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:00:56.336209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e93b64-a4b5-4c46-afdc-04a936b98caf req-d42a5442-5104-4934-b83a-d1fce29f0617 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:56.337610 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66e93b64-a4b5-4c46-afdc-04a936b98caf req-d42a5442-5104-4934-b83a-d1fce29f0617 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.1453502 May 12 16:00:56.362913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] For port 9fe513b3-122d-4e70-9200-622975f32f09, host n-h2-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:00:56.441935 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66e93b64-a4b5-4c46-afdc-04a936b98caf req-16a52f41-fcb7-4301-a88a-a18b049f6d7c tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0985129 May 12 16:00:56.445144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '137e04b7-0b75-4e2f-996f-c09958046a73', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9fe513b3-122d-4e70-9200-622975f32f09'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:00:56.454984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:56.476565 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Transition to ACTIVE for port object 9fe513b3-122d-4e70-9200-622975f32f09 will not be triggered until provisioned by entity L2. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:00:56.480338 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:56.522771 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b1e182aa-9f9d-4bda-9c57-dda6e9fd105d'] response: {'server_uuid': '137e04b7-0b75-4e2f-996f-c09958046a73', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9fe513b3-122d-4e70-9200-622975f32f09', 'code': 200} May 12 16:00:56.643177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] No DVR routers for this DVR port 9fe513b3-122d-4e70-9200-622975f32f09 on host n-h2-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:00:56.678762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Pushing event updated for resources: {'Port': ['ID=9fe513b3-122d-4e70-9200-622975f32f09,revision_number=6']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:56.701649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Attempting to bind port 9fe513b3-122d-4e70-9200-622975f32f09 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:00:56.701971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Attempting to bind port 9fe513b3-122d-4e70-9200-622975f32f09 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:00:56.702290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Attempting to bind port 9fe513b3-122d-4e70-9200-622975f32f09 on network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:00:56.708041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Port 9fe513b3-122d-4e70-9200-622975f32f09 on network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:00:56.708351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Attempting to bind port 9fe513b3-122d-4e70-9200-622975f32f09 on network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:00:56.713784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 0, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:00:56.714114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Checking segment: {'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:00:56.714483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Bound using segment: {'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'} {{(pid=88152) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:00:56.714902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.managers [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Bound port: 9fe513b3-122d-4e70-9200-622975f32f09, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'}}] {{(pid=88152) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:00:56.715231 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:56.805598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] For port 9fe513b3-122d-4e70-9200-622975f32f09, host n-h1-841483-1, cleared binding levels {{(pid=88152) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:00:56.809564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] For port 9fe513b3-122d-4e70-9200-622975f32f09, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9fe513b3-122d-4e70-9200-622975f32f09,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88152) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:00:56.814584 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:56.866055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:56.866657 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:00:56.868457 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] 10.222.0.84 "PUT /v2.0/ports/9fe513b3-122d-4e70-9200-622975f32f09 HTTP/1.1" status: 200 len: 1091 time: 1.1361544 May 12 16:00:56.894906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e33443b0-e325-4519-8d59-1bb4843b9f60 service neutron] Pushing event updated for resources: {'Port': ['ID=9fe513b3-122d-4e70-9200-622975f32f09,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:00:56.980087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-2f990a6b-9caa-4a3a-8c86-b6c4c11740e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:56.981553 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-2f990a6b-9caa-4a3a-8c86-b6c4c11740e4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 1094 time: 0.0745914 May 12 16:00:57.113651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-4e4d9022-2049-4c50-94dc-60f3eaab779f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:57.115044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-4e4d9022-2049-4c50-94dc-60f3eaab779f service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 916 time: 0.1244857 May 12 16:00:57.183345 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-48a60e7e-6900-4e54-95fe-b1131bb7542e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=9fe513b3-122d-4e70-9200-622975f32f09 HTTP/1.1" status: 200 len: 217 time: 0.0586078 May 12 16:00:57.249437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-b4270911-5c25-4e66-bd8b-9c44e963671f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:57.250844 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-b4270911-5c25-4e66-bd8b-9c44e963671f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.0590746 May 12 16:00:57.300312 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-dc4a61b0-be74-4923-bb7d-23bd52a67d3b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0400538 May 12 16:00:57.433008 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-892a5540-6729-4974-b7cb-506b68b40336 service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1225049 May 12 16:00:57.609809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d11eda97-82fc-4a21-abb6-bfbdfb71edc4 req-517acba5-0db0-433e-8a93-f7fb6e1c81c8 service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1676004 May 12 16:00:57.648141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8911782-4993-4090-bb06-71ec6975415c req-0611ee8f-c1f1-4971-af80-6eaaba414069 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:57.649595 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f8911782-4993-4090-bb06-71ec6975415c req-0611ee8f-c1f1-4971-af80-6eaaba414069 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 943 time: 0.0886467 May 12 16:00:57.696709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f8911782-4993-4090-bb06-71ec6975415c req-424237b8-c942-4af7-ba19-ee4ef630c17f tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415027 May 12 16:00:58.523954 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '137e04b7-0b75-4e2f-996f-c09958046a73', 'tag': '9fe513b3-122d-4e70-9200-622975f32f09'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:00:58.581403 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7ad4b0c0-09fb-4665-89ef-cd99d7cb9391'] response: {'name': 'network-changed', 'server_uuid': '137e04b7-0b75-4e2f-996f-c09958046a73', 'tag': '9fe513b3-122d-4e70-9200-622975f32f09', 'status': 'completed', 'code': 200} May 12 16:00:58.670342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-4129d8be-9bd0-46e1-95c6-e97f33ce71f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:58.672450 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-4129d8be-9bd0-46e1-95c6-e97f33ce71f5 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 1094 time: 0.0763235 May 12 16:00:58.698645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-d8c38b71-3f4b-4a4c-92c9-de96af653d16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:58.700087 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-d8c38b71-3f4b-4a4c-92c9-de96af653d16 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 1094 time: 0.0713665 May 12 16:00:58.814425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-cb2da35d-777c-4126-abf0-78e7caba3363 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:58.816153 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-cb2da35d-777c-4126-abf0-78e7caba3363 service neutron] 10.222.0.76 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 916 time: 0.1372311 May 12 16:00:58.889832 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-186bb3fc-6838-45e6-a6e6-7a772c356df7 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=9fe513b3-122d-4e70-9200-622975f32f09 HTTP/1.1" status: 200 len: 217 time: 0.0669022 May 12 16:00:58.960812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-6acf708f-50d1-4952-bf54-480975843d49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:58.962280 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-6acf708f-50d1-4952-bf54-480975843d49 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.0669496 May 12 16:00:59.004640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-bf440be2-2d3e-4540-8f26-474cbf94bce5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:59.006126 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-bf440be2-2d3e-4540-8f26-474cbf94bce5 service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 916 time: 0.2998238 May 12 16:00:59.081237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a059786f-4970-4b69-a40b-66b62653a81a req-3574c186-9099-4617-8abe-d904f9e0ac20 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:59.082668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a059786f-4970-4b69-a40b-66b62653a81a req-3574c186-9099-4617-8abe-d904f9e0ac20 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 943 time: 0.1950290 May 12 16:00:59.092831 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-14d51708-401b-4780-af84-227c03d0bbe8 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=9fe513b3-122d-4e70-9200-622975f32f09 HTTP/1.1" status: 200 len: 217 time: 0.0779557 May 12 16:00:59.119234 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-9bd180b7-1ba5-4d0e-b7cb-af66238bf783 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1515083 May 12 16:00:59.176897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a059786f-4970-4b69-a40b-66b62653a81a req-e4755e50-c1d3-402d-bfdd-26624e3321cb tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0864537 May 12 16:00:59.182745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-57c09ac9-3302-4f09-831d-e2c6e7666bb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:00:59.184144 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-57c09ac9-3302-4f09-831d-e2c6e7666bb6 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.0788877 May 12 16:00:59.237072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-066e43a4-5d5b-484d-be2c-2310e2b562e0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0459483 May 12 16:00:59.251202 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-6cd6be48-dafa-48d5-bfcb-3bf20f4aaba2 service neutron] 10.222.0.76 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1259625 May 12 16:00:59.319685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 9fe513b3-122d-4e70-9200-622975f32f09 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:00:59.377529 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-6015d59a-f9ae-4456-84f4-b77ab63be748 service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1329043 May 12 16:00:59.382413 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 9fe513b3-122d-4e70-9200-622975f32f09 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:00:59.385181 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-d64aebe9-58f0-451f-af9c-b8a35275ab03 service neutron] 10.222.0.76 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1277735 May 12 16:00:59.511950 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cc20b53-b169-4fc6-8480-e92e5b10f5a0 req-bddfccba-b900-465d-a004-22820fe6b4a0 service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1259694 May 12 16:01:00.364360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9d2292-0a4b-4798-b439-d05923359e59 req-91973eb3-2e62-4968-b4e2-d5f62136ed1a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:00.365690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd9d2292-0a4b-4798-b439-d05923359e59 req-91973eb3-2e62-4968-b4e2-d5f62136ed1a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 943 time: 0.0803385 May 12 16:01:00.408723 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd9d2292-0a4b-4798-b439-d05923359e59 req-935cf17b-a01f-4ea5-8b25-9dc239ae5582 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366123 May 12 16:01:00.712710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03cf8681-2918-495a-bbbb-c88aca0490ce req-f68a6f14-5d09-4719-94c4-8907006da6b9 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:00.714651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03cf8681-2918-495a-bbbb-c88aca0490ce req-f68a6f14-5d09-4719-94c4-8907006da6b9 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 943 time: 0.0853934 May 12 16:01:00.716449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-4d42e397-8e24-40dd-a315-611bf8bae2b9 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:00.717139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-4d42e397-8e24-40dd-a315-611bf8bae2b9 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Synchronizing usage tracker for tenant:58cfa2ec20c94aa7af98c7be5675feb4 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:01:00.738032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-4d42e397-8e24-40dd-a315-611bf8bae2b9 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Unset dirty status for tenant:58cfa2ec20c94aa7af98c7be5675feb4 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:01:00.739401 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-4d42e397-8e24-40dd-a315-611bf8bae2b9 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.76 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73&tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 943 time: 0.1061177 May 12 16:01:00.758994 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-03cf8681-2918-495a-bbbb-c88aca0490ce req-0b55c712-f0dc-423f-9170-6215e52241b8 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385902 May 12 16:01:00.824437 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-dad8afd0-0d05-4b0a-8c85-96859f38a881 service neutron] delete failed (client error): The resource could not be found. May 12 16:01:00.825450 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-dad8afd0-0d05-4b0a-8c85-96859f38a881 service neutron] 10.222.0.76 "DELETE /v2.0/ports/9fe513b3-122d-4e70-9200-622975f32f09/bindings/n-h2-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.0806553 May 12 16:01:00.961951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-e538834c-20d8-4b9d-a9a7-746c455cdfc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:00.963470 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-e538834c-20d8-4b9d-a9a7-746c455cdfc7 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 1094 time: 0.0701036 May 12 16:01:01.091436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-fc1741c4-04f8-4566-a8ef-c206dc3cc5a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:01.092855 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-fc1741c4-04f8-4566-a8ef-c206dc3cc5a5 service neutron] 10.222.0.76 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 916 time: 0.1243153 May 12 16:01:01.163076 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-b10d04d1-a2e5-477c-8a05-412f4090cc61 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=9fe513b3-122d-4e70-9200-622975f32f09 HTTP/1.1" status: 200 len: 217 time: 0.0639167 May 12 16:01:01.223471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-5edeba09-f54b-4d9a-9410-18fb82c0e374 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:01.224866 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-5edeba09-f54b-4d9a-9410-18fb82c0e374 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.0567741 May 12 16:01:01.273204 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-705c221d-107b-44fd-8848-67d849b65215 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0426276 May 12 16:01:01.408139 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-421cda47-4ab2-4e6a-a86a-d503a0afce08 service neutron] 10.222.0.76 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1289067 May 12 16:01:01.537740 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-16254f42-5726-46be-9a06-8a5bd3f28dfe req-0f9f1cc9-ad67-4ee8-b712-5ca63c7aaeda service neutron] 10.222.0.76 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1228645 May 12 16:01:01.543019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9fe513b3-122d-4e70-9200-622975f32f09 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:01:01.689137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9fe513b3-122d-4e70-9200-622975f32f09, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9fe513b3-122d-4e70-9200-622975f32f09,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:01:01.702524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '9fe513b3-122d-4e70-9200-622975f32f09', 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f', 'port_id': '9fe513b3-122d-4e70-9200-622975f32f09', 'mac_address': 'fa:16:3e:30:df:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 589, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ac83bda-e932-46dd-ae57-390b2e4d797b', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:01:01.758967 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:01.776154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9fe513b3-122d-4e70-9200-622975f32f09 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:01:01.791881 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9fe513b3-122d-4e70-9200-622975f32f09, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9fe513b3-122d-4e70-9200-622975f32f09,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:01:01.795678 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:01.864183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=9fe513b3-122d-4e70-9200-622975f32f09,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:01.953915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef05b1ea-6d15-466d-9697-a601fcef8cf6 req-631630aa-fd04-4e69-8f59-4b0591e9e6e5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:01.955361 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef05b1ea-6d15-466d-9697-a601fcef8cf6 req-631630aa-fd04-4e69-8f59-4b0591e9e6e5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 944 time: 0.0823350 May 12 16:01:02.001008 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef05b1ea-6d15-466d-9697-a601fcef8cf6 req-e2e5c8d1-0621-4d61-a676-e78b7d264b26 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400586 May 12 16:01:02.104616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['9fe513b3-122d-4e70-9200-622975f32f09'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:01:02.754234 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:03.190126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45dbd18a-c1ef-40c4-82af-3b56cc7dab1a req-121cf300-c710-42ff-beac-d2bc41fef157 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:03.191591 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45dbd18a-c1ef-40c4-82af-3b56cc7dab1a req-121cf300-c710-42ff-beac-d2bc41fef157 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 944 time: 0.0837018 May 12 16:01:03.236806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45dbd18a-c1ef-40c4-82af-3b56cc7dab1a req-edd4685d-2620-4ef0-8fef-b2aef3ced80a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395150 May 12 16:01:03.419997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44044d39-8322-464c-a560-f86d1e63ad39 req-76c97fd7-f5ba-4d9b-a82a-868f0413d5dd tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:03.421528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44044d39-8322-464c-a560-f86d1e63ad39 req-76c97fd7-f5ba-4d9b-a82a-868f0413d5dd tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 944 time: 0.0806842 May 12 16:01:03.468180 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44044d39-8322-464c-a560-f86d1e63ad39 req-24a58c5b-85ec-4c6d-a67b-a1ce1dfc2201 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410745 May 12 16:01:03.556120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9fe513b3-122d-4e70-9200-622975f32f09 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:01:03.623974 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 9fe513b3-122d-4e70-9200-622975f32f09 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:01:03.629120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 9fe513b3-122d-4e70-9200-622975f32f09 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:01:03.629625 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:03.653786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96defbc3-bd2e-459c-9bf4-d02fb3d688f3 req-d1ebddf5-93df-45a9-b6a3-909c9a5f1825 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:03.655239 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96defbc3-bd2e-459c-9bf4-d02fb3d688f3 req-d1ebddf5-93df-45a9-b6a3-909c9a5f1825 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 944 time: 0.0813251 May 12 16:01:03.704145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96defbc3-bd2e-459c-9bf4-d02fb3d688f3 req-74155df1-0ada-40b1-b181-5f26c215cbe7 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431864 May 12 16:01:03.778702 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:03.806498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '137e04b7-0b75-4e2f-996f-c09958046a73', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9fe513b3-122d-4e70-9200-622975f32f09'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:01:03.816336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9fe513b3-122d-4e70-9200-622975f32f09, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9fe513b3-122d-4e70-9200-622975f32f09,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:01:03.821832 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:03.860892 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c74d0e84-7b69-4c88-a502-a5633eeca892'] response: {'server_uuid': '137e04b7-0b75-4e2f-996f-c09958046a73', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9fe513b3-122d-4e70-9200-622975f32f09', 'code': 200} May 12 16:01:03.893076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=9fe513b3-122d-4e70-9200-622975f32f09,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:04.189459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-38c74468-da5f-45ff-a438-6a61204cdbf7 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:04.190861 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-38c74468-da5f-45ff-a438-6a61204cdbf7 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 815 time: 0.1438172 May 12 16:01:04.205584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-bfd63de3-ac13-40ed-a0f9-05c384200d13 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/quotas/58cfa2ec20c94aa7af98c7be5675feb4 HTTP/1.1" status: 200 len: 375 time: 0.0093465 May 12 16:01:04.286880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-d3153466-446b-4c6c-9b61-a08946db49ef tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0764740 May 12 16:01:04.345502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-a0f8c0db-4507-4c7b-9c3d-36534bb2a721 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 16:01:04.346485 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-a0f8c0db-4507-4c7b-9c3d-36534bb2a721 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0518639 May 12 16:01:04.480542 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-026f351d-a7a7-46d1-8f16-238c118c3a52 service neutron] 10.222.0.82 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1281583 May 12 16:01:04.709962 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-a847ccd5-a46a-4b2c-adda-a01b2067ac6a service neutron] 10.222.0.82 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2233455 May 12 16:01:04.883596 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60f5af7c-815f-4310-9ba1-ed4cb7bfa1f9 req-d98c66d4-547b-4d65-a911-331fc5f9e95b tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 210 time: 0.0421462 May 12 16:01:05.576162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ffc02c-ef86-47ab-a209-da9a62d9cb69 req-6313e394-3175-4159-8ba1-5305514d9bec tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:05.577485 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15ffc02c-ef86-47ab-a209-da9a62d9cb69 req-6313e394-3175-4159-8ba1-5305514d9bec tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.84 "GET /v2.0/ports?device_id=137e04b7-0b75-4e2f-996f-c09958046a73 HTTP/1.1" status: 200 len: 945 time: 0.0788116 May 12 16:01:05.648441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-15ffc02c-ef86-47ab-a209-da9a62d9cb69 req-769aca0d-fb05-4ffd-b81c-48762a2b86cb tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Deleting port 9fe513b3-122d-4e70-9200-622975f32f09 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:01:05.648774 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15ffc02c-ef86-47ab-a209-da9a62d9cb69 req-769aca0d-fb05-4ffd-b81c-48762a2b86cb tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:05.895949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-15ffc02c-ef86-47ab-a209-da9a62d9cb69 req-769aca0d-fb05-4ffd-b81c-48762a2b86cb tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] For port 9fe513b3-122d-4e70-9200-622975f32f09, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9fe513b3-122d-4e70-9200-622975f32f09,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:01:05.897157 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15ffc02c-ef86-47ab-a209-da9a62d9cb69 req-769aca0d-fb05-4ffd-b81c-48762a2b86cb tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:06.028627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [req-15ffc02c-ef86-47ab-a209-da9a62d9cb69 req-769aca0d-fb05-4ffd-b81c-48762a2b86cb tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Calling delete_port for 9fe513b3-122d-4e70-9200-622975f32f09 owned by compute:nova {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:01:06.111967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-f891c761-b31e-4cd3-83ea-c12207bfd89d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:06.112794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c01864f8-55d2-4126-ac66-557c113a2052 req-9645ea31-0cce-4c45-9bf3-7a970ff87417 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 210 time: 0.0916419 May 12 16:01:06.113375 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-f891c761-b31e-4cd3-83ea-c12207bfd89d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.84 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 815 time: 0.1667068 May 12 16:01:06.140506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Request body: {'port': {'device_id': 'cfc74c55-2d0f-447e-af34-63178bf3b0e2', 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f', 'admin_state_up': True, 'tenant_id': '58cfa2ec20c94aa7af98c7be5675feb4'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:01:06.234406 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15ffc02c-ef86-47ab-a209-da9a62d9cb69 req-769aca0d-fb05-4ffd-b81c-48762a2b86cb tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:06.278541 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['9fe513b3-122d-4e70-9200-622975f32f09'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:01:06.294191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:01:06.304045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:01:06.316663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Made reservation on behalf of 58cfa2ec20c94aa7af98c7be5675feb4 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:01:06.319722 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:06.334221 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-769aca0d-fb05-4ffd-b81c-48762a2b86cb tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Pushing event deleted for resources: {'Port': ['ID=9fe513b3-122d-4e70-9200-622975f32f09,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:06.371542 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [req-15ffc02c-ef86-47ab-a209-da9a62d9cb69 req-769aca0d-fb05-4ffd-b81c-48762a2b86cb tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] No DVR routers for this DVR port 9fe513b3-122d-4e70-9200-622975f32f09 on host n-h1-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:01:06.374205 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-15ffc02c-ef86-47ab-a209-da9a62d9cb69 req-769aca0d-fb05-4ffd-b81c-48762a2b86cb tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:06.376867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '137e04b7-0b75-4e2f-996f-c09958046a73', 'name': 'network-vif-deleted', 'tag': '9fe513b3-122d-4e70-9200-622975f32f09'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:01:06.395972 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15ffc02c-ef86-47ab-a209-da9a62d9cb69 req-769aca0d-fb05-4ffd-b81c-48762a2b86cb tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.84 "DELETE /v2.0/ports/9fe513b3-122d-4e70-9200-622975f32f09 HTTP/1.1" status: 204 len: 173 time: 0.8127418 May 12 16:01:06.426511 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4c354090-5e3e-4120-90fe-9321ba4712cd'] response: {'server_uuid': '137e04b7-0b75-4e2f-996f-c09958046a73', 'name': 'network-vif-deleted', 'tag': '9fe513b3-122d-4e70-9200-622975f32f09', 'status': 'completed', 'code': 200} May 12 16:01:06.608163 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Allocated IP 172.20.0.7 (ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f/2ac83bda-e932-46dd-ae57-390b2e4d797b/3717df35-c204-40fe-9330-1bae7b8cba27) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:01:06.820438 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:06.849909 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:06.893425 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['9fe513b3-122d-4e70-9200-622975f32f09'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:01:06.925070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:01:06.928033 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:01:06.932592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:01:06.974375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Pushing event updated for resources: {'Port': ['ID=3717df35-c204-40fe-9330-1bae7b8cba27,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:06.998371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:06.998958 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:07.021796 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-651789fb-9170-4264-905c-0ea5c62a261d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8852189 May 12 16:01:07.045097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Request body: {'port': {'device_id': 'cfc74c55-2d0f-447e-af34-63178bf3b0e2', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:01:07.156278 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:07.313835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b1eea5-60aa-4a91-8b1d-70850219de8e req-49b5a270-4913-4a3a-b040-bcb75ac405ca tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:07.314521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-75b1eea5-60aa-4a91-8b1d-70850219de8e req-49b5a270-4913-4a3a-b040-bcb75ac405ca tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Synchronizing usage tracker for tenant:58cfa2ec20c94aa7af98c7be5675feb4 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:01:07.330186 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-75b1eea5-60aa-4a91-8b1d-70850219de8e req-49b5a270-4913-4a3a-b040-bcb75ac405ca tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Unset dirty status for tenant:58cfa2ec20c94aa7af98c7be5675feb4 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:01:07.331285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75b1eea5-60aa-4a91-8b1d-70850219de8e req-49b5a270-4913-4a3a-b040-bcb75ac405ca tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 931 time: 0.1075828 May 12 16:01:07.377560 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-75b1eea5-60aa-4a91-8b1d-70850219de8e req-3f29f669-8868-4be5-8fb0-ec8bc3c8c0d9 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403018 May 12 16:01:07.497165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3717df35-c204-40fe-9330-1bae7b8cba27 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:01:07.504135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:07.517684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Transition to ACTIVE for port object 3717df35-c204-40fe-9330-1bae7b8cba27 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:01:07.521602 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:07.677032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Pushing event updated for resources: {'Port': ['ID=3717df35-c204-40fe-9330-1bae7b8cba27,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:07.756164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Attempting to bind port 3717df35-c204-40fe-9330-1bae7b8cba27 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:01:07.756419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Attempting to bind port 3717df35-c204-40fe-9330-1bae7b8cba27 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:01:07.756740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Attempting to bind port 3717df35-c204-40fe-9330-1bae7b8cba27 on network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:01:07.762089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Port 3717df35-c204-40fe-9330-1bae7b8cba27 on network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:01:07.762412 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Attempting to bind port 3717df35-c204-40fe-9330-1bae7b8cba27 on network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:01:07.767397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 0, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:01:07.767726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Checking segment: {'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:01:07.768097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Bound using segment: {'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:01:07.768508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Bound port: 3717df35-c204-40fe-9330-1bae7b8cba27, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:01:07.768842 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:07.859473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] For port 3717df35-c204-40fe-9330-1bae7b8cba27, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:01:07.862302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] For port 3717df35-c204-40fe-9330-1bae7b8cba27, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3717df35-c204-40fe-9330-1bae7b8cba27,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:01:07.866884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:07.924261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:07.924854 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:07.926655 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] 10.222.0.84 "PUT /v2.0/ports/3717df35-c204-40fe-9330-1bae7b8cba27 HTTP/1.1" status: 200 len: 1091 time: 0.8854897 May 12 16:01:07.929738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cfc74c55-2d0f-447e-af34-63178bf3b0e2', 'tag': '3717df35-c204-40fe-9330-1bae7b8cba27'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:01:07.952767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8cb86f5-a941-42a9-b64a-57b7a5d56bec service neutron] Pushing event updated for resources: {'Port': ['ID=3717df35-c204-40fe-9330-1bae7b8cba27,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:07.976115 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-20e7c61c-a00b-4a98-80b2-d180104758e6'] response: {'name': 'network-changed', 'server_uuid': 'cfc74c55-2d0f-447e-af34-63178bf3b0e2', 'tag': '3717df35-c204-40fe-9330-1bae7b8cba27', 'status': 'completed', 'code': 200} May 12 16:01:08.062449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-56b33381-f65a-4d12-b049-ed150bc3de9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:08.064072 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-56b33381-f65a-4d12-b049-ed150bc3de9b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 1094 time: 0.0697892 May 12 16:01:08.146448 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-e85e0ef2-c2b1-4133-87d0-dda3da06ffdb service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3717df35-c204-40fe-9330-1bae7b8cba27 HTTP/1.1" status: 200 len: 217 time: 0.0629742 May 12 16:01:08.210689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8534e48-9e48-4888-a768-83caaefd81f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:08.212843 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-b8534e48-9e48-4888-a768-83caaefd81f2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.0569601 May 12 16:01:08.267272 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-079c830d-3be3-4c71-9dde-d44ead824d64 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0450940 May 12 16:01:08.515576 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-bc78eeed-f681-48ad-8bfd-a107831b4796 service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2384856 May 12 16:01:08.566115 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f8e0b18-c945-47cd-bc12-7f4ef56fc70e req-a8310299-e00f-451c-bd08-d2e41d3d938e tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:08.567682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f8e0b18-c945-47cd-bc12-7f4ef56fc70e req-a8310299-e00f-451c-bd08-d2e41d3d938e tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 943 time: 0.0818274 May 12 16:01:08.612610 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f8e0b18-c945-47cd-bc12-7f4ef56fc70e req-3c296fcd-5581-4bed-9c16-67fbf954b5d7 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389354 May 12 16:01:08.651301 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc71efa6-0e33-454c-a965-1965f1f03844 req-366d9dfa-4f1a-42c1-b0c0-9d69babedf70 service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1266141 May 12 16:01:08.823665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c0d95cc-f50d-4d95-866a-0b5d099d7876 req-5aa05308-78fa-4e2d-8d90-610e079d1cf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:08.825111 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c0d95cc-f50d-4d95-866a-0b5d099d7876 req-5aa05308-78fa-4e2d-8d90-610e079d1cf7 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 1094 time: 0.0708265 May 12 16:01:08.955987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c0d95cc-f50d-4d95-866a-0b5d099d7876 req-64f8da99-69b7-41d8-ad73-8a491bf2d2a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:08.957461 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c0d95cc-f50d-4d95-866a-0b5d099d7876 req-64f8da99-69b7-41d8-ad73-8a491bf2d2a6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 916 time: 0.1266339 May 12 16:01:09.029439 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c0d95cc-f50d-4d95-866a-0b5d099d7876 req-2523af27-7d29-4b58-a9b0-47acd9379064 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3717df35-c204-40fe-9330-1bae7b8cba27 HTTP/1.1" status: 200 len: 217 time: 0.0636430 May 12 16:01:09.090956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c0d95cc-f50d-4d95-866a-0b5d099d7876 req-704cf64a-cabe-4e67-91b8-358c0a1553e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:09.092231 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c0d95cc-f50d-4d95-866a-0b5d099d7876 req-704cf64a-cabe-4e67-91b8-358c0a1553e6 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.0565164 May 12 16:01:09.141461 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c0d95cc-f50d-4d95-866a-0b5d099d7876 req-b398beac-ad36-429d-afad-8a2b8c38b4d4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0422785 May 12 16:01:09.273050 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c0d95cc-f50d-4d95-866a-0b5d099d7876 req-9811af04-0a18-4359-b1ef-197060f79687 service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1248400 May 12 16:01:09.404811 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4c0d95cc-f50d-4d95-866a-0b5d099d7876 req-503b54f5-1814-4e62-9a63-c3e8587e9a14 service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1253150 May 12 16:01:09.580608 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9fe513b3-122d-4e70-9200-622975f32f09 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:01:09.617206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 9fe513b3-122d-4e70-9200-622975f32f09 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:01:09.617571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9fe513b3-122d-4e70-9200-622975f32f09 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:01:09.798670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7d59086-2494-41d8-a534-48497d73889b req-de05c703-547a-4052-9cea-37a327b320ea tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:09.800087 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7d59086-2494-41d8-a534-48497d73889b req-de05c703-547a-4052-9cea-37a327b320ea tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 943 time: 0.0812943 May 12 16:01:09.843226 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7d59086-2494-41d8-a534-48497d73889b req-cb0993dd-75d0-4f7d-9f31-7fb599800979 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374966 May 12 16:01:11.025087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18860461-f890-48cd-9dfa-b7f24d3f4858 req-97e10aff-c4e3-411c-8098-72d38fdef488 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:11.027108 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18860461-f890-48cd-9dfa-b7f24d3f4858 req-97e10aff-c4e3-411c-8098-72d38fdef488 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 943 time: 0.0790515 May 12 16:01:11.073857 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18860461-f890-48cd-9dfa-b7f24d3f4858 req-dd99b267-3888-4c27-824e-54ac9f746d4d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411947 May 12 16:01:11.585684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3717df35-c204-40fe-9330-1bae7b8cba27 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:01:11.720318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 3717df35-c204-40fe-9330-1bae7b8cba27, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3717df35-c204-40fe-9330-1bae7b8cba27,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:01:11.733896 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '3717df35-c204-40fe-9330-1bae7b8cba27', 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f', 'port_id': '3717df35-c204-40fe-9330-1bae7b8cba27', 'mac_address': 'fa:16:3e:54:3f:7d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 589, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ac83bda-e932-46dd-ae57-390b2e4d797b', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:01:11.787468 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:11.804778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3717df35-c204-40fe-9330-1bae7b8cba27 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:01:11.820347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 3717df35-c204-40fe-9330-1bae7b8cba27, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3717df35-c204-40fe-9330-1bae7b8cba27,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:01:11.824547 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:11.892741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=3717df35-c204-40fe-9330-1bae7b8cba27,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:12.153568 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['3717df35-c204-40fe-9330-1bae7b8cba27'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:01:12.261238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1e9b176-3361-400a-8ada-df866a592a5c req-7ecf2780-9d8a-4b9d-9163-0b9e3a519f8f tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:12.262729 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a1e9b176-3361-400a-8ada-df866a592a5c req-7ecf2780-9d8a-4b9d-9163-0b9e3a519f8f tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 944 time: 0.0829904 May 12 16:01:12.307689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a1e9b176-3361-400a-8ada-df866a592a5c req-27bd75f8-d0e5-41b7-9b99-6c967f67cca8 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389297 May 12 16:01:12.818441 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a67fb233-36d5-4dcd-a6c1-dbbfcdd69af7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:13.578267 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:13.597602 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c635895-552e-4222-9899-ccffc4ce8aa6 req-5bb7affa-507e-457f-a29f-fbfb17ec6996 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:13.599065 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c635895-552e-4222-9899-ccffc4ce8aa6 req-5bb7affa-507e-457f-a29f-fbfb17ec6996 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 944 time: 0.1858718 May 12 16:01:13.600434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3717df35-c204-40fe-9330-1bae7b8cba27 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:01:13.643811 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c635895-552e-4222-9899-ccffc4ce8aa6 req-cb9bc561-508a-4f8b-a03d-29dae870350a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387399 May 12 16:01:13.666472 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 3717df35-c204-40fe-9330-1bae7b8cba27 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:01:13.671655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 3717df35-c204-40fe-9330-1bae7b8cba27 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:01:13.672022 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:13.790246 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:13.817030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cfc74c55-2d0f-447e-af34-63178bf3b0e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3717df35-c204-40fe-9330-1bae7b8cba27'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:01:13.827841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 3717df35-c204-40fe-9330-1bae7b8cba27, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3717df35-c204-40fe-9330-1bae7b8cba27,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:01:13.831825 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:13.863024 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1765b147-e1fa-41ed-a62f-6d98e1d26547'] response: {'server_uuid': 'cfc74c55-2d0f-447e-af34-63178bf3b0e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3717df35-c204-40fe-9330-1bae7b8cba27', 'code': 200} May 12 16:01:13.901184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=3717df35-c204-40fe-9330-1bae7b8cba27,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:14.042417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44000178-950a-4f60-8ca5-6b1d74947a85 req-85e3c4a7-1489-46a0-b2fb-9d85a3b4c508 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:14.043906 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-44000178-950a-4f60-8ca5-6b1d74947a85 req-85e3c4a7-1489-46a0-b2fb-9d85a3b4c508 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 1096 time: 0.0897560 May 12 16:01:14.087903 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-44000178-950a-4f60-8ca5-6b1d74947a85 req-f29fa8f5-f072-4838-90d8-5305e8186225 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0347188 May 12 16:01:14.877308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dc9d6ad-6ac4-46d1-9b95-ef45fa591668 req-aa99ab2b-8633-4184-a425-ad207da1aaa5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:14.878779 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9dc9d6ad-6ac4-46d1-9b95-ef45fa591668 req-aa99ab2b-8633-4184-a425-ad207da1aaa5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.1320016 May 12 16:01:14.926243 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9dc9d6ad-6ac4-46d1-9b95-ef45fa591668 req-21811d00-0441-474c-a38a-6936d22f7300 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418339 May 12 16:01:15.357694 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9459646e-a32d-46b4-9035-7d8d073ab4b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:16.067064 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:16.168684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ada9dc94-4891-441a-8d1e-254de580fd32 req-91c96ab2-494f-4e5e-8f71-d31471b0ec71 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:16.170157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ada9dc94-4891-441a-8d1e-254de580fd32 req-91c96ab2-494f-4e5e-8f71-d31471b0ec71 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.1349905 May 12 16:01:16.213742 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ada9dc94-4891-441a-8d1e-254de580fd32 req-9288eba0-79aa-4b55-86d8-2a425499026d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376794 May 12 16:01:16.335748 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:16.401974 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1002d0af-1e76-4bdd-a03e-9fb7c964472b req-90d7abfd-bc15-4680-ad4e-65a8c8e3f918 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:16.403439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1002d0af-1e76-4bdd-a03e-9fb7c964472b req-90d7abfd-bc15-4680-ad4e-65a8c8e3f918 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0848763 May 12 16:01:16.448257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1002d0af-1e76-4bdd-a03e-9fb7c964472b req-88703cca-9999-4140-a0e1-5ef1297ff2de tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391824 May 12 16:01:16.854182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-82a1654f-25cf-43b5-b5e1-f1d3389cac0e service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1293566 May 12 16:01:16.870684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0f2df71-77a7-47e6-9da2-8d781c173e5d req-11444e57-b009-46bf-b80a-fd935cd24d54 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:16.872293 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0f2df71-77a7-47e6-9da2-8d781c173e5d req-11444e57-b009-46bf-b80a-fd935cd24d54 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.1037800 May 12 16:01:16.917910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0f2df71-77a7-47e6-9da2-8d781c173e5d req-e9f43e50-3c48-4c5d-b68b-e9d2e5298638 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392382 May 12 16:01:17.815578 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:17.980453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-f45bb60e-f0dc-43b6-b061-2e1301166168 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:17.982344 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-f45bb60e-f0dc-43b6-b061-2e1301166168 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 1096 time: 0.0816600 May 12 16:01:18.109672 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16cf8124-bc3a-4e19-8ca9-76cd613c6056 req-02420054-88b2-4116-aa58-3aa3990965b6 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:18.111114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16cf8124-bc3a-4e19-8ca9-76cd613c6056 req-02420054-88b2-4116-aa58-3aa3990965b6 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0789974 May 12 16:01:18.116162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-ba5f2579-09c1-4077-b976-670ddbbbcfa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:18.117602 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-ba5f2579-09c1-4077-b976-670ddbbbcfa4 service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 916 time: 0.1296790 May 12 16:01:18.158187 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16cf8124-bc3a-4e19-8ca9-76cd613c6056 req-7f92a178-46ef-4693-8dbc-5a4b515b932c tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413156 May 12 16:01:18.184113 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-488f4159-0897-47dc-8fa7-163adddbcdcb service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3717df35-c204-40fe-9330-1bae7b8cba27 HTTP/1.1" status: 200 len: 217 time: 0.0606976 May 12 16:01:18.253032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-ed97470c-30a6-4df7-9ee5-dab2ab3068e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:18.254531 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-ed97470c-30a6-4df7-9ee5-dab2ab3068e6 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.0647879 May 12 16:01:18.305787 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-ad965341-37aa-4476-a278-469e11535d5e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0441957 May 12 16:01:18.433254 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-a7c701d4-a80c-4a50-abb3-7f28681747f4 service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1217639 May 12 16:01:18.673783 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d3a92374-4ce0-4de2-9166-b91e21d419f8 service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2352579 May 12 16:01:18.970526 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:01:19.352789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426e8dd6-b36b-4f26-8bc5-35dbb3c6c049 req-b49b9728-ddbc-4645-8987-7b09fd665131 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:19.354439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-426e8dd6-b36b-4f26-8bc5-35dbb3c6c049 req-b49b9728-ddbc-4645-8987-7b09fd665131 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0788805 May 12 16:01:19.396561 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-426e8dd6-b36b-4f26-8bc5-35dbb3c6c049 req-4b89078c-04c6-448b-97f6-08fa81fb9523 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366802 May 12 16:01:20.584274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7a942f0-f0e3-4243-b492-5f8ecdec8f28 req-792c925b-30d9-4a22-909c-bfeda856dbd0 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:20.585734 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7a942f0-f0e3-4243-b492-5f8ecdec8f28 req-792c925b-30d9-4a22-909c-bfeda856dbd0 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0832591 May 12 16:01:20.629107 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d7a942f0-f0e3-4243-b492-5f8ecdec8f28 req-611891c4-b323-4f56-a7ab-7134a48f17e7 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0368981 May 12 16:01:21.309494 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f32099da-950c-4c7d-bb67-8914586a0b7a req-2c889849-83ae-4550-afdc-0faa8c0c639b service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0470600 May 12 16:01:21.417899 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f32099da-950c-4c7d-bb67-8914586a0b7a req-db0aeda4-24f7-49ed-90e1-c7d01feefccf service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0433834 May 12 16:01:21.460773 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f32099da-950c-4c7d-bb67-8914586a0b7a req-f558bd51-0ab7-43d5-849b-5ece585c68db service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0250003 May 12 16:01:21.594799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f32099da-950c-4c7d-bb67-8914586a0b7a req-4cbe12e5-cff2-4976-9f70-956ba594f066 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:21.596161 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f32099da-950c-4c7d-bb67-8914586a0b7a req-4cbe12e5-cff2-4976-9f70-956ba594f066 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1299579 May 12 16:01:21.815442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d21943f-055b-4065-b1ee-4c56f54dfa47 req-a3bbe2ba-c019-4d53-8a0a-d7b640321bce tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:21.816877 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d21943f-055b-4065-b1ee-4c56f54dfa47 req-a3bbe2ba-c019-4d53-8a0a-d7b640321bce tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0792751 May 12 16:01:21.860792 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3d21943f-055b-4065-b1ee-4c56f54dfa47 req-86ac873f-9a23-4abd-aa56-6912525efb59 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382149 May 12 16:01:23.044550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70f59a2f-6ae3-4ad4-94ba-c032198f114d req-b0de9d8c-432e-4538-9409-ee3a35ace24c tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:23.045987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70f59a2f-6ae3-4ad4-94ba-c032198f114d req-b0de9d8c-432e-4538-9409-ee3a35ace24c tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0820985 May 12 16:01:23.090247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70f59a2f-6ae3-4ad4-94ba-c032198f114d req-bb843caf-95ba-4a02-ab96-3d31c02f1bcc tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386374 May 12 16:01:24.271367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e07df5f-9bc5-4ae5-9aaf-964fc13ad6eb req-86afba27-3a46-4e38-b1de-93d8f6e0e1c5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:24.272818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1e07df5f-9bc5-4ae5-9aaf-964fc13ad6eb req-86afba27-3a46-4e38-b1de-93d8f6e0e1c5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0796759 May 12 16:01:24.317348 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1e07df5f-9bc5-4ae5-9aaf-964fc13ad6eb req-e01eb80d-cfd8-447f-a0cf-9b1de8e31aef tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382547 May 12 16:01:25.503731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-509b23de-f8e5-49a3-baf5-d34cb85fe26b req-3ad39292-4f15-4f3c-973c-26a564fed960 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:25.505149 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-509b23de-f8e5-49a3-baf5-d34cb85fe26b req-3ad39292-4f15-4f3c-973c-26a564fed960 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0821977 May 12 16:01:25.549329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-509b23de-f8e5-49a3-baf5-d34cb85fe26b req-b267a135-8a4f-44bf-9c4b-265297eb4221 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383732 May 12 16:01:26.733521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2b0cbb-f313-4c53-b23b-6e8fe1bc4a1a req-c95c7c96-abed-4bfa-bbf9-77c69ebe6414 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:26.734974 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a2b0cbb-f313-4c53-b23b-6e8fe1bc4a1a req-c95c7c96-abed-4bfa-bbf9-77c69ebe6414 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0812891 May 12 16:01:26.783481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a2b0cbb-f313-4c53-b23b-6e8fe1bc4a1a req-22ecb3fd-a543-41b1-a698-440c19995fe0 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416477 May 12 16:01:27.965705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1532241-def0-4334-9931-94bc565a4d17 req-fa00e05d-9311-43b0-9eee-6e19828ee017 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:27.967125 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1532241-def0-4334-9931-94bc565a4d17 req-fa00e05d-9311-43b0-9eee-6e19828ee017 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0796177 May 12 16:01:28.011509 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1532241-def0-4334-9931-94bc565a4d17 req-f63b4ba6-ce35-415a-a418-a0d41490c8a0 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386758 May 12 16:01:29.202341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-594d28b0-82f5-4889-a2c0-9f4035e751c3 req-98427cab-5479-4ba3-88e3-65ab499542e2 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:29.203762 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-594d28b0-82f5-4889-a2c0-9f4035e751c3 req-98427cab-5479-4ba3-88e3-65ab499542e2 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0824149 May 12 16:01:29.247780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-594d28b0-82f5-4889-a2c0-9f4035e751c3 req-59f9cff0-5ac3-465c-9b10-ff83aae8c8a4 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383794 May 12 16:01:30.430522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144827f7-8df1-418d-aced-0c4639728753 req-1bf878f8-24b2-4eb7-a963-6708146a9403 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:30.431892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-144827f7-8df1-418d-aced-0c4639728753 req-1bf878f8-24b2-4eb7-a963-6708146a9403 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0789070 May 12 16:01:30.476315 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-144827f7-8df1-418d-aced-0c4639728753 req-6d4faccf-a01f-44b3-af4f-9af60303359c tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388832 May 12 16:01:31.668481 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5e6059e-b9f3-4655-a4eb-dbf6f6703690 req-f4501785-a6c0-4c94-840c-8b0cab38e48c tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:31.669960 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5e6059e-b9f3-4655-a4eb-dbf6f6703690 req-f4501785-a6c0-4c94-840c-8b0cab38e48c tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0889292 May 12 16:01:31.715739 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5e6059e-b9f3-4655-a4eb-dbf6f6703690 req-339eb9e4-1575-4684-bd42-ae44aad91d66 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401294 May 12 16:01:32.770110 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:32.902139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06a1b843-4182-4878-a0b8-118a477e10a0 req-c75ce4c7-a616-40a7-b7be-dc69b4e420f5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:32.903574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06a1b843-4182-4878-a0b8-118a477e10a0 req-c75ce4c7-a616-40a7-b7be-dc69b4e420f5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0786812 May 12 16:01:32.951471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-06a1b843-4182-4878-a0b8-118a477e10a0 req-984c5c63-8c4d-4d67-9b5b-3036384ccab2 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422595 May 12 16:01:34.137912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f1267e8-6c2f-48dc-b1b6-af19b50939f7 req-32d4b597-0797-4dd7-91ee-2f8a1e430368 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:34.139362 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f1267e8-6c2f-48dc-b1b6-af19b50939f7 req-32d4b597-0797-4dd7-91ee-2f8a1e430368 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0809498 May 12 16:01:34.182853 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5f1267e8-6c2f-48dc-b1b6-af19b50939f7 req-340ae8a9-ccd4-4fb2-acc1-583222172b30 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379255 May 12 16:01:35.379333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dc7a51a-5402-44f5-842a-27771ac5a5a1 req-656546b2-a7e3-473e-b311-794a41f0e674 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:35.380777 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4dc7a51a-5402-44f5-842a-27771ac5a5a1 req-656546b2-a7e3-473e-b311-794a41f0e674 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0890107 May 12 16:01:35.523084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4dc7a51a-5402-44f5-842a-27771ac5a5a1 req-f297048d-88b4-4a19-a621-ca26a91dff1a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1359143 May 12 16:01:36.708562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-218fe3e2-a12c-46d6-a7a8-ce3ba20c7342 req-76779462-fbfe-40f6-b1f7-aa97601e4999 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:36.710036 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-218fe3e2-a12c-46d6-a7a8-ce3ba20c7342 req-76779462-fbfe-40f6-b1f7-aa97601e4999 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0795434 May 12 16:01:36.753573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-218fe3e2-a12c-46d6-a7a8-ce3ba20c7342 req-1321db02-4382-4c85-9830-03e195a12e69 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372155 May 12 16:01:37.939693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb26fa98-47af-4ab0-9056-f3a1447a34a1 req-e0cf81b6-0e84-43de-a3b4-d5bd02aab744 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:37.941125 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb26fa98-47af-4ab0-9056-f3a1447a34a1 req-e0cf81b6-0e84-43de-a3b4-d5bd02aab744 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0820072 May 12 16:01:37.984556 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb26fa98-47af-4ab0-9056-f3a1447a34a1 req-f2d86918-793b-41b1-88f0-6461ff3af2a6 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376964 May 12 16:01:39.165511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b5fda6c-a27e-446e-b4c7-7999aaac020b req-4708ea40-9624-4e6d-8323-aaa7797f0fad tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:39.167028 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b5fda6c-a27e-446e-b4c7-7999aaac020b req-4708ea40-9624-4e6d-8323-aaa7797f0fad tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0774558 May 12 16:01:39.213750 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b5fda6c-a27e-446e-b4c7-7999aaac020b req-f057cd27-69da-4654-90d5-3e50219300a5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410836 May 12 16:01:40.401473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e195d869-4652-4abf-b038-254dda839244 req-48cdc87a-f25a-4213-b35a-0ccc72e6a753 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:40.402859 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e195d869-4652-4abf-b038-254dda839244 req-48cdc87a-f25a-4213-b35a-0ccc72e6a753 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0782919 May 12 16:01:40.446528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e195d869-4652-4abf-b038-254dda839244 req-49aab262-b5d5-460c-bf82-eeedfe6f0eb3 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381198 May 12 16:01:41.634163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4927021-31b5-4429-bc3c-9dfb3c5444ed req-b33b65b1-a05a-4927-b08c-c0f757a357f3 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:41.635605 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4927021-31b5-4429-bc3c-9dfb3c5444ed req-b33b65b1-a05a-4927-b08c-c0f757a357f3 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0850141 May 12 16:01:41.678784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4927021-31b5-4429-bc3c-9dfb3c5444ed req-cff08555-2259-4b6c-94ab-91c4bbb47ae5 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374563 May 12 16:01:42.825246 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d18a56e9-161a-437e-bef1-8048a041a325 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:42.863241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c6ba57-8b14-406c-9cec-f6c807decff9 req-ddcbb864-d324-4b9d-a1ef-995935db1110 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:42.864725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20c6ba57-8b14-406c-9cec-f6c807decff9 req-ddcbb864-d324-4b9d-a1ef-995935db1110 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0802159 May 12 16:01:42.908921 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20c6ba57-8b14-406c-9cec-f6c807decff9 req-61dea128-9c2a-44b6-967c-2e482009e916 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380363 May 12 16:01:43.130126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc23e46f-1473-4ab6-be88-0b7df1b38340 req-78eeaa51-f853-4d64-bfb4-45d2bf5318db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:43.131575 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc23e46f-1473-4ab6-be88-0b7df1b38340 req-78eeaa51-f853-4d64-bfb4-45d2bf5318db service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 1096 time: 0.0703714 May 12 16:01:43.277766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc23e46f-1473-4ab6-be88-0b7df1b38340 req-4f4dca3d-347e-44a7-b17f-256f41b2cb75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:43.279230 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc23e46f-1473-4ab6-be88-0b7df1b38340 req-4f4dca3d-347e-44a7-b17f-256f41b2cb75 service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 916 time: 0.1289666 May 12 16:01:43.350781 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc23e46f-1473-4ab6-be88-0b7df1b38340 req-5183c4f2-e7fc-444d-b3b7-9b196420bb76 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3717df35-c204-40fe-9330-1bae7b8cba27 HTTP/1.1" status: 200 len: 217 time: 0.0648088 May 12 16:01:43.411616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc23e46f-1473-4ab6-be88-0b7df1b38340 req-4f1e20b7-ee5e-4147-a985-474cc81a701e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:43.412914 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc23e46f-1473-4ab6-be88-0b7df1b38340 req-4f1e20b7-ee5e-4147-a985-474cc81a701e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.0564480 May 12 16:01:43.464790 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc23e46f-1473-4ab6-be88-0b7df1b38340 req-2ba72f11-be8d-4161-9f80-5efc96a8dcb6 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0434303 May 12 16:01:43.576841 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:43.599109 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc23e46f-1473-4ab6-be88-0b7df1b38340 req-5bfdf401-c222-4a26-ac12-7793c137a0f2 service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1260145 May 12 16:01:43.735181 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fc23e46f-1473-4ab6-be88-0b7df1b38340 req-703877f1-2896-4476-9dc5-ac105e868b4a service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1286755 May 12 16:01:44.100003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-937ac718-ce1e-45d4-97ff-a7dfc28973f1 req-217d07e8-6da2-4b00-ac0b-79a32f440287 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:44.101512 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-937ac718-ce1e-45d4-97ff-a7dfc28973f1 req-217d07e8-6da2-4b00-ac0b-79a32f440287 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0818243 May 12 16:01:44.145242 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-937ac718-ce1e-45d4-97ff-a7dfc28973f1 req-b55843e9-948c-4c18-8e46-41b497f604bd tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376942 May 12 16:01:45.331720 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6bc1490-f7cb-4a2c-9c52-e6dc2408cebc req-2c5e67a9-4cf8-4634-b187-3641362d0939 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:45.333151 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6bc1490-f7cb-4a2c-9c52-e6dc2408cebc req-2c5e67a9-4cf8-4634-b187-3641362d0939 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0838435 May 12 16:01:45.359755 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8c3fe631-72ac-41b6-ac39-e262bd0b85fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:45.383027 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a6bc1490-f7cb-4a2c-9c52-e6dc2408cebc req-ccf71463-52ae-4f11-857a-7eed006047c6 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429780 May 12 16:01:45.928651 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-dc3488f6-ee32-419b-b932-ba3a401d3646 service neutron] show failed (client error): The resource could not be found. May 12 16:01:45.929643 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-dc3488f6-ee32-419b-b932-ba3a401d3646 service neutron] 10.222.0.84 "GET /v2.0/ports/3717df35-c204-40fe-9330-1bae7b8cba27/bindings/n-h2-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.0730228 May 12 16:01:46.069554 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:46.202780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-aca33746-8833-4b48-b20c-915cd5a89183 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:46.204133 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-aca33746-8833-4b48-b20c-915cd5a89183 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2&tenant_id=58cfa2ec20c94aa7af98c7be5675feb4 HTTP/1.1" status: 200 len: 1096 time: 0.0768261 May 12 16:01:46.215950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Request body: {'port': {'binding:host_id': 'n-h2-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:01:46.326559 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:46.339499 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:46.570801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b6d130-c58a-4e84-bbd0-a410c5489b88 req-ae7256e9-730b-4ff1-9755-ce600d9825d3 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:46.572891 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50b6d130-c58a-4e84-bbd0-a410c5489b88 req-ae7256e9-730b-4ff1-9755-ce600d9825d3 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0810814 May 12 16:01:46.603826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] For port 3717df35-c204-40fe-9330-1bae7b8cba27, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=3717df35-c204-40fe-9330-1bae7b8cba27,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:01:46.617751 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50b6d130-c58a-4e84-bbd0-a410c5489b88 req-968fcb13-dd49-4944-9151-b352d6ce5d4b tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382876 May 12 16:01:46.634207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] For port 3717df35-c204-40fe-9330-1bae7b8cba27, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:01:46.697000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cfc74c55-2d0f-447e-af34-63178bf3b0e2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3717df35-c204-40fe-9330-1bae7b8cba27'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:01:46.703033 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:46.718890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Transition to ACTIVE for port object 3717df35-c204-40fe-9330-1bae7b8cba27 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:01:46.724008 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:46.870335 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f8b4eea3-f152-4f59-ad0d-a3243d991904'] response: {'server_uuid': 'cfc74c55-2d0f-447e-af34-63178bf3b0e2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3717df35-c204-40fe-9330-1bae7b8cba27', 'code': 200} May 12 16:01:46.989515 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] No DVR routers for this DVR port 3717df35-c204-40fe-9330-1bae7b8cba27 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:01:46.996830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Pushing event updated for resources: {'Port': ['ID=3717df35-c204-40fe-9330-1bae7b8cba27,revision_number=6']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:47.043881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:47.044215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:47.044547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:47.044875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:47.045201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:47.045549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:47.045872 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:47.046189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:47.046505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:47.046826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:47.047134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:47.047443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:47.058871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Attempting to bind port 3717df35-c204-40fe-9330-1bae7b8cba27 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:01:47.059199 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Attempting to bind port 3717df35-c204-40fe-9330-1bae7b8cba27 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:01:47.059523 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Attempting to bind port 3717df35-c204-40fe-9330-1bae7b8cba27 on network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:01:47.064308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Port 3717df35-c204-40fe-9330-1bae7b8cba27 on network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:01:47.064617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Attempting to bind port 3717df35-c204-40fe-9330-1bae7b8cba27 on network ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:01:47.069675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 1, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:01:47.070007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Checking segment: {'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:01:47.070377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Bound using segment: {'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:01:47.070797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Bound port: 3717df35-c204-40fe-9330-1bae7b8cba27, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 589, 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:01:47.071134 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:47.157277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] For port 3717df35-c204-40fe-9330-1bae7b8cba27, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:01:47.160394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] For port 3717df35-c204-40fe-9330-1bae7b8cba27, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3717df35-c204-40fe-9330-1bae7b8cba27,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:01:47.163889 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:47.227214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:47.227811 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:47.229863 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] 10.222.0.76 "PUT /v2.0/ports/3717df35-c204-40fe-9330-1bae7b8cba27 HTTP/1.1" status: 200 len: 1091 time: 1.0183184 May 12 16:01:47.244376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d836959a-b836-40d8-87a4-33786c0d7fcf service neutron] Pushing event updated for resources: {'Port': ['ID=3717df35-c204-40fe-9330-1bae7b8cba27,revision_number=7']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:47.319247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-ed839f15-c7b8-4bdd-b3d1-f4264577a398 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:47.320690 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-ed839f15-c7b8-4bdd-b3d1-f4264577a398 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 1094 time: 0.0706112 May 12 16:01:47.450913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-618f72a8-91b9-4413-9715-33b99ccef5db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:47.452226 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-618f72a8-91b9-4413-9715-33b99ccef5db service neutron] 10.222.0.76 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 916 time: 0.1260097 May 12 16:01:47.521778 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-81f9afbe-dc15-47d1-b45c-2eb4692df0d9 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3717df35-c204-40fe-9330-1bae7b8cba27 HTTP/1.1" status: 200 len: 217 time: 0.0633059 May 12 16:01:47.583697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-2a73bbad-4481-4fcb-a4c8-240504e78e56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:47.585106 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-2a73bbad-4481-4fcb-a4c8-240504e78e56 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.0581331 May 12 16:01:47.641376 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-0ad99ddb-5da9-42c8-9837-2fe04e61d3bb service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0507007 May 12 16:01:47.779528 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-7cb5b677-ab5e-4fca-8747-36dd78c31cb6 service neutron] 10.222.0.76 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1282995 May 12 16:01:47.820873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5273d7f-ea57-457f-8458-b748dcabed33 req-2b5e8e4a-1467-4e16-be2d-0db773368b7a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:47.821598 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:47.822534 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5273d7f-ea57-457f-8458-b748dcabed33 req-2b5e8e4a-1467-4e16-be2d-0db773368b7a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 943 time: 0.0863745 May 12 16:01:47.871711 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5273d7f-ea57-457f-8458-b748dcabed33 req-d1a550f4-533b-4273-8c22-818d37197197 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429597 May 12 16:01:47.915162 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0b43f363-2dd3-4199-b249-5c750a0cef63 req-9e30e209-e6a2-4fe4-a7b1-12783415f187 service neutron] 10.222.0.76 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1298280 May 12 16:01:48.871515 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cfc74c55-2d0f-447e-af34-63178bf3b0e2', 'tag': '3717df35-c204-40fe-9330-1bae7b8cba27'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:01:48.940626 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fa3f0a26-d0f8-494f-823e-208feb051644'] response: {'name': 'network-changed', 'server_uuid': 'cfc74c55-2d0f-447e-af34-63178bf3b0e2', 'tag': '3717df35-c204-40fe-9330-1bae7b8cba27', 'status': 'completed', 'code': 200} May 12 16:01:49.063311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dee795e-2388-4f4c-a3c5-ff29205ffc4e req-80c82f14-38c4-4d6b-b1b6-c93515ad250b tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:49.065031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8dee795e-2388-4f4c-a3c5-ff29205ffc4e req-80c82f14-38c4-4d6b-b1b6-c93515ad250b tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 943 time: 0.0836236 May 12 16:01:49.081091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-14cd3b3c-6d66-4e17-a0d9-fc7d17f050f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:49.082582 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-14cd3b3c-6d66-4e17-a0d9-fc7d17f050f4 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 1094 time: 0.1243131 May 12 16:01:49.110117 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8dee795e-2388-4f4c-a3c5-ff29205ffc4e req-a06bf46e-0807-4402-8b18-9a3db3cabf26 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394197 May 12 16:01:49.116571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-8374e893-16fb-4a6a-b908-2136e80f719f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:49.118010 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-8374e893-16fb-4a6a-b908-2136e80f719f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 1094 time: 0.1115224 May 12 16:01:49.324862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-7cb05b45-eb65-4049-b7af-318b55b6e610 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:49.326301 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-7cb05b45-eb65-4049-b7af-318b55b6e610 service neutron] 10.222.0.76 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 916 time: 0.2368860 May 12 16:01:49.332616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-c476efb9-810d-4da7-bb21-7a23a73cc2c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:49.333914 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-c476efb9-810d-4da7-bb21-7a23a73cc2c2 service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 916 time: 0.1710377 May 12 16:01:49.541838 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 3717df35-c204-40fe-9330-1bae7b8cba27 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:01:49.564602 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-8b6cae10-03f9-4721-bd19-6d0d53de015e service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3717df35-c204-40fe-9330-1bae7b8cba27 HTTP/1.1" status: 200 len: 217 time: 0.2297723 May 12 16:01:49.604469 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-60d08ac9-35e7-4f08-b350-ebdfe3014a41 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3717df35-c204-40fe-9330-1bae7b8cba27 HTTP/1.1" status: 200 len: 217 time: 0.1075675 May 12 16:01:49.681272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-e91b9e53-1db0-4400-b5c6-aa1c7f27e988 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:49.682437 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 3717df35-c204-40fe-9330-1bae7b8cba27, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3717df35-c204-40fe-9330-1bae7b8cba27,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:01:49.683234 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-e91b9e53-1db0-4400-b5c6-aa1c7f27e988 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.1108334 May 12 16:01:49.691361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-9290c358-3c07-46bb-8318-84a399d618cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:49.693004 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-9290c358-3c07-46bb-8318-84a399d618cf service neutron] 10.222.0.84 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.0749683 May 12 16:01:49.696166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '3717df35-c204-40fe-9330-1bae7b8cba27', 'network_id': 'ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f', 'port_id': '3717df35-c204-40fe-9330-1bae7b8cba27', 'mac_address': 'fa:16:3e:54:3f:7d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 589, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ac83bda-e932-46dd-ae57-390b2e4d797b', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:01:49.751666 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:49.769783 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3717df35-c204-40fe-9330-1bae7b8cba27 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:01:49.774832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3717df35-c204-40fe-9330-1bae7b8cba27 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:01:49.781516 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-0cd5237f-64b1-4256-b5ef-8353bfa18989 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0915892 May 12 16:01:49.783419 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-223aad02-2bcd-4e3c-a925-c3898afc68c3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0600696 May 12 16:01:49.834046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 3717df35-c204-40fe-9330-1bae7b8cba27, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3717df35-c204-40fe-9330-1bae7b8cba27,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:01:49.840503 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:49.890548 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 3717df35-c204-40fe-9330-1bae7b8cba27 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:01:49.909321 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=3717df35-c204-40fe-9330-1bae7b8cba27,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:49.917775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:49.918109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:49.918438 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:49.918761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:49.919087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:49.919404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:49.919716 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:49.920029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:49.920340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:49.920649 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:49.920959 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:49.921267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:50.026407 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-81a1d03b-e164-4e32-a56a-729c233ad878 service neutron] 10.222.0.76 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2390032 May 12 16:01:50.028225 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-76112317-6196-4013-9e11-550f1ffaac36 service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2241092 May 12 16:01:50.065800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['3717df35-c204-40fe-9330-1bae7b8cba27'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:01:50.270416 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-6d3dda06-f81c-48a5-87a3-0dffc5ae0d9f service neutron] 10.222.0.76 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2352841 May 12 16:01:50.273446 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fa8b0b0d-627a-4cca-b61e-be3a5ada86cc req-1afa7fd0-faa2-4d89-871b-90303e0b358c service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2212963 May 12 16:01:50.311259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76669318-421b-428c-b7f5-db40e633b146 req-cf08f702-cd24-4773-a0a2-2ea62d772376 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:50.312698 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-76669318-421b-428c-b7f5-db40e633b146 req-cf08f702-cd24-4773-a0a2-2ea62d772376 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 944 time: 0.0903172 May 12 16:01:50.357132 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-76669318-421b-428c-b7f5-db40e633b146 req-98d89b83-3b12-4296-a03e-c5ca8ee6bf09 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383618 May 12 16:01:50.653213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f19b3c-4c91-4f4c-b62f-303608dd087b req-bb098acf-db74-477d-9c91-d86b49e8e83a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:50.654630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8f19b3c-4c91-4f4c-b62f-303608dd087b req-bb098acf-db74-477d-9c91-d86b49e8e83a tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 944 time: 0.0800343 May 12 16:01:50.692366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-56591f07-4cd3-46ea-a1c2-a575980b9a68 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:50.693058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-56591f07-4cd3-46ea-a1c2-a575980b9a68 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Synchronizing usage tracker for tenant:58cfa2ec20c94aa7af98c7be5675feb4 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:01:50.698721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8f19b3c-4c91-4f4c-b62f-303608dd087b req-38d3241b-3d00-499d-812e-dd51ea38e3f7 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384429 May 12 16:01:50.705724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-56591f07-4cd3-46ea-a1c2-a575980b9a68 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Unset dirty status for tenant:58cfa2ec20c94aa7af98c7be5675feb4 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:01:50.706900 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-56591f07-4cd3-46ea-a1c2-a575980b9a68 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.84 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2&tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 944 time: 0.0975957 May 12 16:01:50.790680 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-9e8e8c38-686e-44cf-9987-93cc48928d87 service neutron] delete failed (client error): The resource could not be found. May 12 16:01:50.791742 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-9e8e8c38-686e-44cf-9987-93cc48928d87 service neutron] 10.222.0.84 "DELETE /v2.0/ports/3717df35-c204-40fe-9330-1bae7b8cba27/bindings/n-h1-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.0761645 May 12 16:01:50.954266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-50f06979-d8c0-4788-ac08-2eb616083af7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:50.955616 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-50f06979-d8c0-4788-ac08-2eb616083af7 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 1095 time: 0.0699129 May 12 16:01:51.089545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-072fa12a-908f-4fd5-8d1e-7771aecc5a3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:51.090956 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-072fa12a-908f-4fd5-8d1e-7771aecc5a3b service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 200 len: 916 time: 0.1248941 May 12 16:01:51.162796 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-b7a176c5-d1ca-41c9-be85-62ed95178832 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3717df35-c204-40fe-9330-1bae7b8cba27 HTTP/1.1" status: 200 len: 217 time: 0.0622916 May 12 16:01:51.227107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-a70b9bcd-1ebc-4a19-95c8-36635092c622 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:51.228519 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-a70b9bcd-1ebc-4a19-95c8-36635092c622 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 200 len: 855 time: 0.0562398 May 12 16:01:51.277177 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-5766db56-d30a-4aa3-8473-e9349bae02df service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0399942 May 12 16:01:51.524571 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-5bbaab4f-6859-4a85-8e62-8071c40adaed service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2377536 May 12 16:01:51.552747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 3717df35-c204-40fe-9330-1bae7b8cba27 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:01:51.619901 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 3717df35-c204-40fe-9330-1bae7b8cba27 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:01:51.624648 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 3717df35-c204-40fe-9330-1bae7b8cba27 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:01:51.625015 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:51.659650 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a64e52d0-9c2a-4e06-b8e5-d356bae82b23 req-8a9c54ae-19e2-4806-8ee7-b1a9a2316dac service neutron] 10.222.0.84 "GET /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1261241 May 12 16:01:51.780085 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:51.810189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cfc74c55-2d0f-447e-af34-63178bf3b0e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3717df35-c204-40fe-9330-1bae7b8cba27'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:01:51.819929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 3717df35-c204-40fe-9330-1bae7b8cba27, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3717df35-c204-40fe-9330-1bae7b8cba27,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:01:51.827038 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:51.910551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=3717df35-c204-40fe-9330-1bae7b8cba27,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:51.915064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f08e121e-ec2d-42c4-9aa4-06413c463470 req-e4bd79b1-b0fc-4b73-a856-0565be54d136 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:51.916704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f08e121e-ec2d-42c4-9aa4-06413c463470 req-e4bd79b1-b0fc-4b73-a856-0565be54d136 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0979748 May 12 16:01:51.938945 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4f5a7ffc-6236-4f8c-9914-10bc4aee6c5f'] response: {'server_uuid': 'cfc74c55-2d0f-447e-af34-63178bf3b0e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3717df35-c204-40fe-9330-1bae7b8cba27', 'code': 200} May 12 16:01:51.963917 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f08e121e-ec2d-42c4-9aa4-06413c463470 req-6cab60c2-c1c2-4c45-a22a-b1ff9fbdaeae tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408502 May 12 16:01:53.149952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b836f82a-47c6-4ddd-9593-6951d395b0d2 req-43bb5d7e-4253-4320-aa29-c74ba434cd45 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:53.151959 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b836f82a-47c6-4ddd-9593-6951d395b0d2 req-43bb5d7e-4253-4320-aa29-c74ba434cd45 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0802596 May 12 16:01:53.198622 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b836f82a-47c6-4ddd-9593-6951d395b0d2 req-766b3b59-973e-4170-a661-d7e8e9e3f8e3 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411594 May 12 16:01:53.383033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-513b05dd-d0ef-4867-b29a-5bbb6ae0f62e req-313a52a4-ceab-4228-9905-c207eefd867f tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:53.384473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-513b05dd-d0ef-4867-b29a-5bbb6ae0f62e req-313a52a4-ceab-4228-9905-c207eefd867f tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0803261 May 12 16:01:53.427187 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-513b05dd-d0ef-4867-b29a-5bbb6ae0f62e req-8d1df23e-5290-4aba-8d35-98612ef96583 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0364258 May 12 16:01:53.614962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2843bcf-c139-43f5-bbbf-c36ff6ca7ce9 req-dc0dc424-846c-4993-a0ff-eb7712b85d99 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:53.616357 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2843bcf-c139-43f5-bbbf-c36ff6ca7ce9 req-dc0dc424-846c-4993-a0ff-eb7712b85d99 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0850499 May 12 16:01:53.659927 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2843bcf-c139-43f5-bbbf-c36ff6ca7ce9 req-b4cce72d-514b-4ab9-b4fd-59e1750bc124 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0371950 May 12 16:01:54.195863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80de4b1f-2f57-4cb4-9d60-cc2603b13f50 req-ab2fb700-6bb8-4232-bd2f-6e14264888f8 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:54.197815 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-80de4b1f-2f57-4cb4-9d60-cc2603b13f50 req-ab2fb700-6bb8-4232-bd2f-6e14264888f8 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0791252 May 12 16:01:54.240542 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-80de4b1f-2f57-4cb4-9d60-cc2603b13f50 req-1a8b6603-c5a0-48bb-9818-247b3f09c4a4 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372081 May 12 16:01:55.267733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b9a443-afaa-40ba-8c5d-a431affb126b req-c4250176-09b8-47f1-87f0-83f1b53b24ce tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:55.269364 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a4b9a443-afaa-40ba-8c5d-a431affb126b req-c4250176-09b8-47f1-87f0-83f1b53b24ce tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.76 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0825424 May 12 16:01:55.338956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-a4b9a443-afaa-40ba-8c5d-a431affb126b req-969446cc-7ed7-4549-97cb-00ab48d46a5d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Deleting port 3717df35-c204-40fe-9330-1bae7b8cba27 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:01:55.339295 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a4b9a443-afaa-40ba-8c5d-a431affb126b req-969446cc-7ed7-4549-97cb-00ab48d46a5d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:55.430472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61d6481d-d625-4689-8080-e4a2a5ed6cae req-fadfad9e-2107-469e-a8c0-c63161d22946 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:55.432761 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61d6481d-d625-4689-8080-e4a2a5ed6cae req-fadfad9e-2107-469e-a8c0-c63161d22946 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/ports?device_id=cfc74c55-2d0f-447e-af34-63178bf3b0e2 HTTP/1.1" status: 200 len: 945 time: 0.0836058 May 12 16:01:55.476745 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61d6481d-d625-4689-8080-e4a2a5ed6cae req-e3df2cfd-85ce-4ce4-a7a3-5e086d1eb6c6 tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.82 "GET /v2.0/security-groups?id=1c1ece45-a385-4bc4-afe6-398964c0ea2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382416 May 12 16:01:55.591293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-a4b9a443-afaa-40ba-8c5d-a431affb126b req-969446cc-7ed7-4549-97cb-00ab48d46a5d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] For port 3717df35-c204-40fe-9330-1bae7b8cba27, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=3717df35-c204-40fe-9330-1bae7b8cba27,segment=NetworkSegment(f6dc9d63-af4f-4f75-8ae2-937f514a3f14),segment_id=f6dc9d63-af4f-4f75-8ae2-937f514a3f14)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:01:55.591568 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a4b9a443-afaa-40ba-8c5d-a431affb126b req-969446cc-7ed7-4549-97cb-00ab48d46a5d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:55.717250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-a4b9a443-afaa-40ba-8c5d-a431affb126b req-969446cc-7ed7-4549-97cb-00ab48d46a5d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Calling delete_port for 3717df35-c204-40fe-9330-1bae7b8cba27 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:01:55.860262 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a4b9a443-afaa-40ba-8c5d-a431affb126b req-969446cc-7ed7-4549-97cb-00ab48d46a5d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:55.871882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['3717df35-c204-40fe-9330-1bae7b8cba27'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:01:55.914093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969446cc-7ed7-4549-97cb-00ab48d46a5d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Pushing event deleted for resources: {'Port': ['ID=3717df35-c204-40fe-9330-1bae7b8cba27,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:55.970411 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:01:55.986215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-a4b9a443-afaa-40ba-8c5d-a431affb126b req-969446cc-7ed7-4549-97cb-00ab48d46a5d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] No DVR routers for this DVR port 3717df35-c204-40fe-9330-1bae7b8cba27 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:01:55.988720 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-a4b9a443-afaa-40ba-8c5d-a431affb126b req-969446cc-7ed7-4549-97cb-00ab48d46a5d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:55.991161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cfc74c55-2d0f-447e-af34-63178bf3b0e2', 'name': 'network-vif-deleted', 'tag': '3717df35-c204-40fe-9330-1bae7b8cba27'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:01:56.006239 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a4b9a443-afaa-40ba-8c5d-a431affb126b req-969446cc-7ed7-4549-97cb-00ab48d46a5d tempest-ServerDiskConfigTestJSON-1095321643 tempest-ServerDiskConfigTestJSON-1095321643-project] 10.222.0.76 "DELETE /v2.0/ports/3717df35-c204-40fe-9330-1bae7b8cba27 HTTP/1.1" status: 204 len: 173 time: 0.7316129 May 12 16:01:56.042502 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8418e6a9-8434-4714-aa72-2eb6a0b5ad7c'] response: {'server_uuid': 'cfc74c55-2d0f-447e-af34-63178bf3b0e2', 'name': 'network-vif-deleted', 'tag': '3717df35-c204-40fe-9330-1bae7b8cba27', 'status': 'completed', 'code': 200} May 12 16:01:56.722204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52676) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:01:56.783614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-67eee55c-2325-4898-a6b8-d1110bc19402 admin admin] Deleting subnet 2ac83bda-e932-46dd-ae57-390b2e4d797b {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:01:56.786352 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-67eee55c-2325-4898-a6b8-d1110bc19402 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:56.837826 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-67eee55c-2325-4898-a6b8-d1110bc19402 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:56.899827 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-67eee55c-2325-4898-a6b8-d1110bc19402 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:56.985558 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-67eee55c-2325-4898-a6b8-d1110bc19402 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:57.024669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67eee55c-2325-4898-a6b8-d1110bc19402 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2ac83bda-e932-46dd-ae57-390b2e4d797b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:57.030240 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-67eee55c-2325-4898-a6b8-d1110bc19402 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:57.036840 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-67eee55c-2325-4898-a6b8-d1110bc19402 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/2ac83bda-e932-46dd-ae57-390b2e4d797b HTTP/1.1" status: 204 len: 168 time: 0.3135309 May 12 16:01:57.039196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52680) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:01:57.154069 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e17e57a1-b2d0-407d-8d1a-194d1cad54a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:57.290285 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e17e57a1-b2d0-407d-8d1a-194d1cad54a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:57.319124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e17e57a1-b2d0-407d-8d1a-194d1cad54a5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:01:57.332286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e17e57a1-b2d0-407d-8d1a-194d1cad54a5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:01:57.332750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e17e57a1-b2d0-407d-8d1a-194d1cad54a5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f6dc9d63-af4f-4f75-8ae2-937f514a3f14') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:01:57.344469 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e17e57a1-b2d0-407d-8d1a-194d1cad54a5 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:57.361617 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e17e57a1-b2d0-407d-8d1a-194d1cad54a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:57.367619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e17e57a1-b2d0-407d-8d1a-194d1cad54a5 admin admin] Releasing vlan 589 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:01:57.368006 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e17e57a1-b2d0-407d-8d1a-194d1cad54a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: timer() May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:01:57.386754 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:01:57.466012 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e17e57a1-b2d0-407d-8d1a-194d1cad54a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:57.471292 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e17e57a1-b2d0-407d-8d1a-194d1cad54a5 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:57.498916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e17e57a1-b2d0-407d-8d1a-194d1cad54a5 admin admin] Pushing event deleted for resources: {'Network': ['ID=ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:57.506573 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e17e57a1-b2d0-407d-8d1a-194d1cad54a5 admin admin] 10.222.0.82 "DELETE /v2.0/networks/ca48eb2f-11e1-4df0-8d6b-6bd7f493bf8f HTTP/1.1" status: 204 len: 168 time: 0.4664121 May 12 16:01:57.623437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52686) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:01:57.675688 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c387ad55-a8ba-42a5-8e0a-9af73af5af46 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=58cfa2ec20c94aa7af98c7be5675feb4&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0511303 May 12 16:01:57.678172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52690) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:01:57.735494 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-50b0e97b-67c4-46c9-ad2e-4bf73726711b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:57.761176 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-50b0e97b-67c4-46c9-ad2e-4bf73726711b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:57.812824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-50b0e97b-67c4-46c9-ad2e-4bf73726711b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:57.830650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50b0e97b-67c4-46c9-ad2e-4bf73726711b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c1ece45-a385-4bc4-afe6-398964c0ea2f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:57.842186 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-50b0e97b-67c4-46c9-ad2e-4bf73726711b admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:57.843230 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-50b0e97b-67c4-46c9-ad2e-4bf73726711b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1c1ece45-a385-4bc4-afe6-398964c0ea2f HTTP/1.1" status: 204 len: 168 time: 0.1641960 May 12 16:01:58.557299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52716) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:01:58.661014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-1949209289-network', 'tenant_id': '22f425833dc74d6b985912b8d7db7222'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:01:58.667287 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:01:58.671210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Usage tracker for resource:network and tenant:22f425833dc74d6b985912b8d7db7222 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:01:58.674057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:01:58.680154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:01:58.690336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Made reservation on behalf of 22f425833dc74d6b985912b8d7db7222 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:01:58.692435 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:58.704368 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:58.720526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:01:58.724314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Usage tracker for resource:security_group_rule and tenant:22f425833dc74d6b985912b8d7db7222 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:01:58.727099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:01:58.733551 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:01:58.820034 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:58.824411 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:58.856987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 595} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:01:58.862357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e02c2431-9ee7-4f7c-b267-afe490100cc9,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:58.871018 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:58.871387 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Added segment b5e092c9-3496-44dd-842e-3dc14179b327 of type vlan for network 9475b307-5f43-40f6-b384-65417948d75d May 12 16:01:58.897369 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:58.925505 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:58.926436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:58.926996 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:59.135360 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.5760717 May 12 16:01:59.136109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7dc8f02-8740-4bab-b50a-69f9927aad54 admin admin] Pushing event updated for resources: {'Network': ['ID=9475b307-5f43-40f6-b384-65417948d75d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:59.137965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52722) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:01:59.143466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Request body: {'subnet': {'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-1949209289-subnet', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:01:59.146060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 9475b307-5f43-40f6-b384-65417948d75d details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:01:59.148982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:01:59.153611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Usage tracker for resource:subnet and tenant:22f425833dc74d6b985912b8d7db7222 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:01:59.156450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:01:59.162107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:01:59.171521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Made reservation on behalf of 22f425833dc74d6b985912b8d7db7222 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:01:59.173781 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:59.383412 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:59.457434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:01:59.469970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:59.470310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:59.470644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:59.470971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:59.471294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:59.471614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:59.471930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:59.472246 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:59.472561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:59.472872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:59.473184 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:59.473534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:01:59.478302 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Checking segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:01:59.478655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Network hostable DHCP agents. Network: 9475b307-5f43-40f6-b384-65417948d75d, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:01:59.497664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Network 9475b307-5f43-40f6-b384-65417948d75d is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:01:59.506766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 9475b307-5f43-40f6-b384-65417948d75d) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:01:59.511286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:01:59.511949 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:59.515968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38391018-15b6-4d8b-8014-306bf354c31c None None] Network 9475b307-5f43-40f6-b384-65417948d75d requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:01:59.532824 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-edaddac1-1ed2-4655-beac-377b54a7bed0 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3937864 May 12 16:01:59.535826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52726) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:01:59.540925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:01:59.546625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:01:59.550480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Usage tracker for resource:router and tenant:22f425833dc74d6b985912b8d7db7222 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:01:59.553262 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:01:59.561223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:01:59.573016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:59.574109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:59.581480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 3717df35-c204-40fe-9330-1bae7b8cba27 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:01:59.591173 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:59.633046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 3717df35-c204-40fe-9330-1bae7b8cba27 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:01:59.633401 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 3717df35-c204-40fe-9330-1bae7b8cba27 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:01:59.773896 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-9475b307-5f43-40f6-b384-65417948d75d', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:01:59.774806 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:59.880249 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:01:59.932751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Allocated IP 172.20.0.2 (9475b307-5f43-40f6-b384-65417948d75d/d0bd473b-b60e-4879-b8b8-94c3dfcc17c8/aeac494d-008f-48ba-853e-5a3b56c3e7d5) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:02:00.138473 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:00.149034 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Transition to ACTIVE for port object aeac494d-008f-48ba-853e-5a3b56c3e7d5 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:02:00.169114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Transition to ACTIVE for port object aeac494d-008f-48ba-853e-5a3b56c3e7d5 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:02:00.174926 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:00.187337 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:00.217969 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:00.242072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Network 9475b307-5f43-40f6-b384-65417948d75d is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:02:00.245459 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:02:00.248098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:02:00.288550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Pushing event updated for resources: {'Port': ['ID=aeac494d-008f-48ba-853e-5a3b56c3e7d5,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:00.346888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Attempting to bind port aeac494d-008f-48ba-853e-5a3b56c3e7d5 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:02:00.347246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Attempting to bind port aeac494d-008f-48ba-853e-5a3b56c3e7d5 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:02:00.347601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Attempting to bind port aeac494d-008f-48ba-853e-5a3b56c3e7d5 on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:02:00.354274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 1, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:02:00.354470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Checking segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:02:00.354721 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:00.355104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Bound using segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:02:00.355559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Bound port: aeac494d-008f-48ba-853e-5a3b56c3e7d5, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:02:00.355922 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:00.360006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Allocated IP 172.25.8.78 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/ac0f52bc-a47d-41d1-a35e-cec46efd76f6) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:02:00.447654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] For port aeac494d-008f-48ba-853e-5a3b56c3e7d5, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:02:00.451492 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] For port aeac494d-008f-48ba-853e-5a3b56c3e7d5, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=aeac494d-008f-48ba-853e-5a3b56c3e7d5,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:02:00.455299 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:00.508092 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:00.539036 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:00.550723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-599e1fdd-5bbc-49db-9bba-6a9230dac908 None None] Pushing event updated for resources: {'Port': ['ID=aeac494d-008f-48ba-853e-5a3b56c3e7d5,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:00.604073 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:02:00.606873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:02:00.610777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:02:00.641937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Pushing event updated for resources: {'Port': ['ID=ac0f52bc-a47d-41d1-a35e-cec46efd76f6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:01.179635 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:01.455328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9abdc4f0-c9c8-42b3-87b1-83715d09b237 None None] Network 9475b307-5f43-40f6-b384-65417948d75d requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:02:01.530347 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:01.582611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a9ffc33c-0870-4c80-9058-188f3777916a None None] Provisioning for port aeac494d-008f-48ba-853e-5a3b56c3e7d5 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:02:01.739614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Router cd523971-49e8-4deb-9f61-a0342aee2763 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 16:02:01.931580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:02:01.940337 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Sync routers for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:02:01.950451 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:02:01.951050 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:01:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:01.956984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:01.958224 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-960f99bc-c98b-4301-af6d-7bea689642fc admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.4213736 May 12 16:02:01.960917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52730) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:02:02.128266 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:02:02.198841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device aeac494d-008f-48ba-853e-5a3b56c3e7d5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:02:02.310614 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port aeac494d-008f-48ba-853e-5a3b56c3e7d5 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:02:02.316537 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port aeac494d-008f-48ba-853e-5a3b56c3e7d5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:02:02.316890 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:02.442749 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:02.477792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port aeac494d-008f-48ba-853e-5a3b56c3e7d5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=aeac494d-008f-48ba-853e-5a3b56c3e7d5,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:02:02.482163 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:02.541365 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:00Z', 'revision_number': 3, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:02.545504 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Checking router: cd523971-49e8-4deb-9f61-a0342aee2763 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:02:02.545954 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Updating router cd523971-49e8-4deb-9f61-a0342aee2763 port ac0f52bc-a47d-41d1-a35e-cec46efd76f6 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:02:02.583152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=aeac494d-008f-48ba-853e-5a3b56c3e7d5,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:02.607433 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:02.769058 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:02.883842 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:02.932917 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:02.944859 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Transition to ACTIVE for port object ac0f52bc-a47d-41d1-a35e-cec46efd76f6 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:02:02.951843 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:03.027291 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Attempting to bind port ac0f52bc-a47d-41d1-a35e-cec46efd76f6 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:02:03.027637 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Attempting to bind port ac0f52bc-a47d-41d1-a35e-cec46efd76f6 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:02:03.027987 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Attempting to bind port ac0f52bc-a47d-41d1-a35e-cec46efd76f6 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:02:03.036763 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 1, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:02:03.037121 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:02:03.037609 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:03.037988 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:02:03.038436 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Bound port: ac0f52bc-a47d-41d1-a35e-cec46efd76f6, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:02:03.038793 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:03.061540 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f92f34e2-f96d-4078-ba3a-3f9d4514ad28 None None] Pushing event updated for resources: {'Port': ['ID=ac0f52bc-a47d-41d1-a35e-cec46efd76f6,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:03.087002 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f92f34e2-f96d-4078-ba3a-3f9d4514ad28 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:03.087331 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f92f34e2-f96d-4078-ba3a-3f9d4514ad28 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:03.088321 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f92f34e2-f96d-4078-ba3a-3f9d4514ad28 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:03.088822 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f92f34e2-f96d-4078-ba3a-3f9d4514ad28 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:03.088920 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f92f34e2-f96d-4078-ba3a-3f9d4514ad28 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:03.089215 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f92f34e2-f96d-4078-ba3a-3f9d4514ad28 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:03.089556 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f92f34e2-f96d-4078-ba3a-3f9d4514ad28 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:03.089868 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f92f34e2-f96d-4078-ba3a-3f9d4514ad28 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:03.090176 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f92f34e2-f96d-4078-ba3a-3f9d4514ad28 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:03.090481 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f92f34e2-f96d-4078-ba3a-3f9d4514ad28 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:03.090789 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f92f34e2-f96d-4078-ba3a-3f9d4514ad28 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:03.091089 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f92f34e2-f96d-4078-ba3a-3f9d4514ad28 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:03.095846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Allocated IP 172.20.0.1 (9475b307-5f43-40f6-b384-65417948d75d/d0bd473b-b60e-4879-b8b8-94c3dfcc17c8/629fbd42-7e9e-4170-9343-40c14387aff5) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:02:03.130289 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] For port ac0f52bc-a47d-41d1-a35e-cec46efd76f6, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:02:03.133521 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] For port ac0f52bc-a47d-41d1-a35e-cec46efd76f6, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ac0f52bc-a47d-41d1-a35e-cec46efd76f6,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:02:03.138448 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:03.213579 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:02:03.214184 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:01:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:03.255079 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:03.271409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Transition to ACTIVE for port object 629fbd42-7e9e-4170-9343-40c14387aff5 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:02:03.282727 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f92f34e2-f96d-4078-ba3a-3f9d4514ad28 None None] Pushing event updated for resources: {'Port': ['ID=ac0f52bc-a47d-41d1-a35e-cec46efd76f6,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:03.299084 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:03.368415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Network 9475b307-5f43-40f6-b384-65417948d75d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:02:03.371788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:02:03.375610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:02:03.401367 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:02:03.410678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Pushing event updated for resources: {'Port': ['ID=629fbd42-7e9e-4170-9343-40c14387aff5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:03.436071 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:03.647652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e1ab5b43-040f-415e-8a8f-47a5636ce329 None None] Provisioning for port 629fbd42-7e9e-4170-9343-40c14387aff5 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:02:03.652598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e1ab5b43-040f-415e-8a8f-47a5636ce329 None None] Provisioning complete for port 629fbd42-7e9e-4170-9343-40c14387aff5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:02:03.652964 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e1ab5b43-040f-415e-8a8f-47a5636ce329 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:03.705987 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:03.715724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e1ab5b43-040f-415e-8a8f-47a5636ce329 None None] Port 629fbd42-7e9e-4170-9343-40c14387aff5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:02:03.727020 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:00Z', 'revision_number': 3, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:03.731473 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a958961-d680-4a4e-a5e8-ac9d961febec None None] The sync data for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 is: [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:00Z', 'revision_number': 3, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:02:03.951009 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:03.955686 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:04.062487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Pushing event updated for resources: {'Port': ['ID=629fbd42-7e9e-4170-9343-40c14387aff5,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:04.067517 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:04.212634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Network 9475b307-5f43-40f6-b384-65417948d75d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:02:04.214039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:02:04.260562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device aeac494d-008f-48ba-853e-5a3b56c3e7d5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:02:04.352146 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port aeac494d-008f-48ba-853e-5a3b56c3e7d5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:02:04.352516 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:04.492978 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ac0f52bc-a47d-41d1-a35e-cec46efd76f6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:02:04.560396 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Router cd523971-49e8-4deb-9f61-a0342aee2763 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:02:04.564674 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-01479499-e42c-47cc-bb18-5955a22dec81 None None] Provisioning complete for port 629fbd42-7e9e-4170-9343-40c14387aff5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:02:04.565057 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-01479499-e42c-47cc-bb18-5955a22dec81 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:04.623448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ac0f52bc-a47d-41d1-a35e-cec46efd76f6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:02:04.627466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-01479499-e42c-47cc-bb18-5955a22dec81 None None] Port 629fbd42-7e9e-4170-9343-40c14387aff5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:02:04.630915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ac0f52bc-a47d-41d1-a35e-cec46efd76f6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:02:04.630915 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:04.754040 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:04.754764 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:02:04.764384 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ffdad04a-0a77-4261-9222-ba29d63b372f admin admin] 10.222.0.82 "PUT /v2.0/routers/cd523971-49e8-4deb-9f61-a0342aee2763/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8024580 May 12 16:02:04.771474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ac0f52bc-a47d-41d1-a35e-cec46efd76f6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ac0f52bc-a47d-41d1-a35e-cec46efd76f6,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:02:04.776859 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:04.844517 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ac0f52bc-a47d-41d1-a35e-cec46efd76f6,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:05.096156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52740) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:02:05.101444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1087207809', 'description': 'tempest-description--545708339'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:02:05.108843 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:02:05.112671 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Usage tracker for resource:security_group and tenant:22f425833dc74d6b985912b8d7db7222 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:02:05.115652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:02:05.122876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:02:05.133679 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.153870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:02:05.157779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Usage tracker for resource:security_group_rule and tenant:22f425833dc74d6b985912b8d7db7222 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:02:05.160633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:02:05.166881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:02:05.243150 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.248746 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.293304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3aebfd3b-72ff-4972-bf89-463e07cfaf27,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:05.293565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Sync routers for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:02:05.296881 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.300764 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c4dbfd64-c18a-4689-85b4-ee0d638ab1c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1781 time: 0.2009335 May 12 16:02:05.301153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52744) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:02:05.305533 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:02:05.306816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d27dce50-7d8a-447f-bc8a-8e71274826b1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Request body: {'security_group_rule': {'security_group_id': '3aebfd3b-72ff-4972-bf89-463e07cfaf27', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:02:05.307078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:01:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:05.313504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d27dce50-7d8a-447f-bc8a-8e71274826b1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:02:05.317541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d27dce50-7d8a-447f-bc8a-8e71274826b1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Usage tracker for resource:security_group_rule and tenant:22f425833dc74d6b985912b8d7db7222 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:02:05.320433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d27dce50-7d8a-447f-bc8a-8e71274826b1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:02:05.327365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d27dce50-7d8a-447f-bc8a-8e71274826b1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:02:05.347174 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d27dce50-7d8a-447f-bc8a-8e71274826b1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.411042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d27dce50-7d8a-447f-bc8a-8e71274826b1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.414154 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d27dce50-7d8a-447f-bc8a-8e71274826b1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.440276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d27dce50-7d8a-447f-bc8a-8e71274826b1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0b890285-e444-4e7f-9dcb-858da87e34d8,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:05.452838 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d27dce50-7d8a-447f-bc8a-8e71274826b1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.453849 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d27dce50-7d8a-447f-bc8a-8e71274826b1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1516485 May 12 16:02:05.456443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52748) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:02:05.461730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f5792804-ee73-4a0d-b3e7-80ca5cc61ece tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Request body: {'security_group_rule': {'security_group_id': '3aebfd3b-72ff-4972-bf89-463e07cfaf27', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:02:05.468456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f5792804-ee73-4a0d-b3e7-80ca5cc61ece tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:02:05.472397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f5792804-ee73-4a0d-b3e7-80ca5cc61ece tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Usage tracker for resource:security_group_rule and tenant:22f425833dc74d6b985912b8d7db7222 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:02:05.475661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f5792804-ee73-4a0d-b3e7-80ca5cc61ece tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:02:05.482209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f5792804-ee73-4a0d-b3e7-80ca5cc61ece tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:02:05.501975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:02:05.505542 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5792804-ee73-4a0d-b3e7-80ca5cc61ece tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.576040 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5792804-ee73-4a0d-b3e7-80ca5cc61ece tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.580979 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5792804-ee73-4a0d-b3e7-80ca5cc61ece tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.605450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5792804-ee73-4a0d-b3e7-80ca5cc61ece tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4ece197a-3f6c-4739-a297-a026c671eb88,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:05.615340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f5792804-ee73-4a0d-b3e7-80ca5cc61ece tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.616624 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f5792804-ee73-4a0d-b3e7-80ca5cc61ece tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1592364 May 12 16:02:05.620325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 52752) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:02:05.625185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:02:05.631780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:02:05.635811 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Usage tracker for resource:floatingip and tenant:22f425833dc74d6b985912b8d7db7222 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:02:05.638683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:02:05.644317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:02:05.655791 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.796741 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.866668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 2, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:05.871657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Checking router: cd523971-49e8-4deb-9f61-a0342aee2763 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:02:05.872029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Updating router cd523971-49e8-4deb-9f61-a0342aee2763 port 629fbd42-7e9e-4170-9343-40c14387aff5 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:02:05.928177 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:05.934721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Allocated IP 172.25.8.219 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/b3306083-3628-4f09-9461-15d578bf0d38) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:02:06.084670 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:06.114836 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:06.184852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ac0f52bc-a47d-41d1-a35e-cec46efd76f6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:02:06.186299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:02:06.189220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:02:06.192955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:02:06.269766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:06.279139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event updated for resources: {'Port': ['ID=b3306083-3628-4f09-9461-15d578bf0d38,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:06.335211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ac0f52bc-a47d-41d1-a35e-cec46efd76f6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:02:06.335581 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:06.344493 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:06.399402 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:06.416188 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Transition to ACTIVE for port object 629fbd42-7e9e-4170-9343-40c14387aff5 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:02:06.427347 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:06.568387 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:06.573885 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:06.604208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0d2fd13-ad88-4c3e-94fa-d17b7f40a421 None None] Pushing event updated for resources: {'Port': ['ID=629fbd42-7e9e-4170-9343-40c14387aff5,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:06.707129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event updated for resources: {'Port': ['ID=b3306083-3628-4f09-9461-15d578bf0d38,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:06.718616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Attempting to bind port 629fbd42-7e9e-4170-9343-40c14387aff5 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:02:06.719026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Attempting to bind port 629fbd42-7e9e-4170-9343-40c14387aff5 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:02:06.719547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Attempting to bind port 629fbd42-7e9e-4170-9343-40c14387aff5 on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:02:06.722473 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:06.725572 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 1, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:02:06.725973 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Checking segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:02:06.726372 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:06.726762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Bound using segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:02:06.727219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Bound port: 629fbd42-7e9e-4170-9343-40c14387aff5, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:02:06.727586 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:06.746716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:06.747965 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e660129b-8790-4b6d-9eb4-1ec554b2dd56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.1267307 May 12 16:02:06.831023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] For port 629fbd42-7e9e-4170-9343-40c14387aff5, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:02:06.834469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] For port 629fbd42-7e9e-4170-9343-40c14387aff5, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=629fbd42-7e9e-4170-9343-40c14387aff5,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:02:06.839416 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:06.916704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:02:06.917431 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:01:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:06.922711 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-934273ec-47ed-43f5-bc3d-b1d491fe0648 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Synchronizing usage tracker for tenant:22f425833dc74d6b985912b8d7db7222 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:02:06.945041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-934273ec-47ed-43f5-bc3d-b1d491fe0648 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Unset dirty status for tenant:22f425833dc74d6b985912b8d7db7222 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:02:06.946680 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-934273ec-47ed-43f5-bc3d-b1d491fe0648 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1087207809&fields=id&tenant_id=22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 267 time: 0.0700295 May 12 16:02:06.978840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0d2fd13-ad88-4c3e-94fa-d17b7f40a421 None None] Pushing event updated for resources: {'Port': ['ID=629fbd42-7e9e-4170-9343-40c14387aff5,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:07.118237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:02:07.223213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-89c9df24-2e89-42f4-aeb0-c5ede752d41e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:07.224653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-89c9df24-2e89-42f4-aeb0-c5ede752d41e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 812 time: 0.2700763 May 12 16:02:07.315010 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-fd1131d9-f2dd-4cdb-ac4d-f1954682edab tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/quotas/22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 375 time: 0.0112081 May 12 16:02:07.400752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-342c3d24-5d82-4dcc-b050-5d4b82552398 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0805829 May 12 16:02:07.488295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:06Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:07.492288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c80ad11a-b993-4bad-89ec-efcb85cdab53 None None] The sync data for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 is: [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:06Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:02:07.605271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-a2cddbb2-9219-4659-b2fa-01dd2c20a407 service neutron] 10.222.0.82 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1929882 May 12 16:02:07.760294 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-3eb3bd50-3e27-447d-8266-7b20c0bcfd54 service neutron] 10.222.0.82 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1485119 May 12 16:02:08.028387 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-61a402b8-301a-4885-a24e-9986e4cf3b6f req-2c1851e0-6111-4997-aff7-42cd89692a5e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 210 time: 0.0510051 May 12 16:02:08.236016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 629fbd42-7e9e-4170-9343-40c14387aff5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:02:08.332547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 629fbd42-7e9e-4170-9343-40c14387aff5 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:02:08.338966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 629fbd42-7e9e-4170-9343-40c14387aff5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:02:08.339427 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:08.468395 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:08.504121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 629fbd42-7e9e-4170-9343-40c14387aff5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=629fbd42-7e9e-4170-9343-40c14387aff5,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:02:08.508822 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:08.584204 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=629fbd42-7e9e-4170-9343-40c14387aff5,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:09.277472 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-abc477aa-7b6b-47f3-82c3-3ab29eaf02c5 req-3e5756b1-0f62-42ad-9a78-c02cbc57275f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 210 time: 0.0924981 May 12 16:02:09.293947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-d5cc8e58-83f2-47c9-bcb5-df8a88411024 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:09.294642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-d5cc8e58-83f2-47c9-bcb5-df8a88411024 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Synchronizing usage tracker for tenant:22f425833dc74d6b985912b8d7db7222 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:02:09.312846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-d5cc8e58-83f2-47c9-bcb5-df8a88411024 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Unset dirty status for tenant:22f425833dc74d6b985912b8d7db7222 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:02:09.314183 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-d5cc8e58-83f2-47c9-bcb5-df8a88411024 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 812 time: 0.2875643 May 12 16:02:09.360998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-8594c0a2-d347-4f12-8c70-76f83e0ab721 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Synchronizing usage tracker for tenant:22f425833dc74d6b985912b8d7db7222 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:02:09.372517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-8594c0a2-d347-4f12-8c70-76f83e0ab721 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Unset dirty status for tenant:22f425833dc74d6b985912b8d7db7222 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:02:09.373580 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-8594c0a2-d347-4f12-8c70-76f83e0ab721 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 380 time: 0.0499511 May 12 16:02:09.381471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Request body: {'port': {'device_id': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'admin_state_up': True, 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'security_groups': ['3aebfd3b-72ff-4972-bf89-463e07cfaf27']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:02:09.513777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:02:09.517514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Usage tracker for resource:port and tenant:22f425833dc74d6b985912b8d7db7222 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:02:09.520232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:02:09.525836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:02:09.534399 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Made reservation on behalf of 22f425833dc74d6b985912b8d7db7222 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:02:09.537915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:09.698725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Allocated IP 172.20.0.13 (9475b307-5f43-40f6-b384-65417948d75d/d0bd473b-b60e-4879-b8b8-94c3dfcc17c8/9452574a-6832-4b4f-b05b-7f97b9d36d2f) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:02:09.890099 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:09.905847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Transition to ACTIVE for port object 9452574a-6832-4b4f-b05b-7f97b9d36d2f will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:02:09.929442 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:10.001851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Network 9475b307-5f43-40f6-b384-65417948d75d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:02:10.004731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:02:10.008885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:02:10.045960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event updated for resources: {'Port': ['ID=9452574a-6832-4b4f-b05b-7f97b9d36d2f,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:10.078684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:10.079275 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:10.100010 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-7c8270a8-add1-4ddb-b86a-9b61a70c5162 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7218511 May 12 16:02:10.110682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Request body: {'port': {'device_id': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:02:10.181909 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 629fbd42-7e9e-4170-9343-40c14387aff5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:02:10.228394 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:10.246490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-50fa5e97-7eab-4582-b6f8-d3c9849b9dd9 None None] Provisioning for port 9452574a-6832-4b4f-b05b-7f97b9d36d2f completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:02:10.254183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-50fa5e97-7eab-4582-b6f8-d3c9849b9dd9 None None] Provisioning complete for port 9452574a-6832-4b4f-b05b-7f97b9d36d2f triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:02:10.254551 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-50fa5e97-7eab-4582-b6f8-d3c9849b9dd9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:10.327056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 629fbd42-7e9e-4170-9343-40c14387aff5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:02:10.327543 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:10.356897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-50fa5e97-7eab-4582-b6f8-d3c9849b9dd9 None None] Port 9452574a-6832-4b4f-b05b-7f97b9d36d2f cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:02:10.465895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dba88d21-f262-43d1-90e2-293a0f4107ed req-b9190308-9a34-4270-9fd5-52de656d0756 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:10.467336 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dba88d21-f262-43d1-90e2-293a0f4107ed req-b9190308-9a34-4270-9fd5-52de656d0756 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 932 time: 0.0814478 May 12 16:02:10.514937 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dba88d21-f262-43d1-90e2-293a0f4107ed req-043f809d-1e83-4943-aef6-c4467e71c5cb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417020 May 12 16:02:10.582930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9452574a-6832-4b4f-b05b-7f97b9d36d2f {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:02:10.590433 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:10.604295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Transition to ACTIVE for port object 9452574a-6832-4b4f-b05b-7f97b9d36d2f will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:02:10.608055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:10.766892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Pushing event updated for resources: {'Port': ['ID=9452574a-6832-4b4f-b05b-7f97b9d36d2f,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:10.847421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Attempting to bind port 9452574a-6832-4b4f-b05b-7f97b9d36d2f on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:02:10.847749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Attempting to bind port 9452574a-6832-4b4f-b05b-7f97b9d36d2f by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:02:10.848156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Attempting to bind port 9452574a-6832-4b4f-b05b-7f97b9d36d2f on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:02:10.852759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Port 9452574a-6832-4b4f-b05b-7f97b9d36d2f on network 9475b307-5f43-40f6-b384-65417948d75d not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:02:10.853760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Attempting to bind port 9452574a-6832-4b4f-b05b-7f97b9d36d2f on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:02:10.858858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 2, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:02:10.859183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Checking segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:02:10.859555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Bound using segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:02:10.859968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Bound port: 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:02:10.860306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:10.952200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] For port 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:02:10.955230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] For port 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:02:10.958985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:11.009693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:11.010112 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:11.011719 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] 10.222.0.76 "PUT /v2.0/ports/9452574a-6832-4b4f-b05b-7f97b9d36d2f HTTP/1.1" status: 200 len: 1092 time: 0.9052486 May 12 16:02:11.019400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'tag': '9452574a-6832-4b4f-b05b-7f97b9d36d2f'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:02:11.046189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a601e3f-fdfd-4554-aa06-371ee5c10fc2 service neutron] Pushing event updated for resources: {'Port': ['ID=9452574a-6832-4b4f-b05b-7f97b9d36d2f,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:11.098477 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-cffd2abf-4049-4138-a370-dbd2a061c355'] response: {'name': 'network-changed', 'server_uuid': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'tag': '9452574a-6832-4b4f-b05b-7f97b9d36d2f', 'status': 'completed', 'code': 200} May 12 16:02:11.257885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-2a6ddbfc-9d7e-4780-ac84-80eeeb840064 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:11.259895 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-2a6ddbfc-9d7e-4780-ac84-80eeeb840064 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 1095 time: 0.1944325 May 12 16:02:11.329100 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-75c8b316-11f3-4492-accb-d3b5829b0681 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f HTTP/1.1" status: 200 len: 217 time: 0.0632033 May 12 16:02:11.395626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-97d2f0ba-27f5-4566-9ad4-cd1649e0a2ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:11.397005 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-97d2f0ba-27f5-4566-9ad4-cd1649e0a2ae service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0615497 May 12 16:02:11.471596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-46bf869e-c89e-48be-ac9a-1191101407da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:11.473062 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-46bf869e-c89e-48be-ac9a-1191101407da service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0703959 May 12 16:02:11.604299 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-2971588d-f513-48f1-b1c2-bc92fbd615e2 service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1249394 May 12 16:02:11.745859 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-860b0c8d-fae1-4ddd-b356-2dfb40a1ff78 req-a557d484-a321-468c-8877-362f3dc9a42c service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1362095 May 12 16:02:11.792783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db8b0cf-9211-497b-b859-ecfa90bf67b1 req-f457f5bf-f365-476b-b229-7030e0e57a9a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:11.794346 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8db8b0cf-9211-497b-b859-ecfa90bf67b1 req-f457f5bf-f365-476b-b229-7030e0e57a9a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 944 time: 0.1311085 May 12 16:02:11.840032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8db8b0cf-9211-497b-b859-ecfa90bf67b1 req-f9097146-2f98-46f7-9410-ab16a90884a5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399940 May 12 16:02:11.866537 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da4877b-efa2-46e2-ae23-a2452769179b req-5743d849-89f6-46b6-b617-7685f91c2e84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:11.868125 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9da4877b-efa2-46e2-ae23-a2452769179b req-5743d849-89f6-46b6-b617-7685f91c2e84 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 1095 time: 0.0761895 May 12 16:02:12.001706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da4877b-efa2-46e2-ae23-a2452769179b req-c3557124-bbd4-4046-a9c3-963f3a5d697c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:12.003128 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9da4877b-efa2-46e2-ae23-a2452769179b req-c3557124-bbd4-4046-a9c3-963f3a5d697c service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1290469 May 12 16:02:12.070395 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9da4877b-efa2-46e2-ae23-a2452769179b req-909331c4-5797-4e24-aa40-26a976dd27db service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f HTTP/1.1" status: 200 len: 217 time: 0.0610728 May 12 16:02:12.136037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da4877b-efa2-46e2-ae23-a2452769179b req-5c1fb004-dde9-4207-93fb-5fee21dc4772 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:12.137481 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9da4877b-efa2-46e2-ae23-a2452769179b req-5c1fb004-dde9-4207-93fb-5fee21dc4772 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0610037 May 12 16:02:12.210758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da4877b-efa2-46e2-ae23-a2452769179b req-8602dc14-0c1d-4982-8ee8-2bfc6fde46d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:12.212229 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9da4877b-efa2-46e2-ae23-a2452769179b req-8602dc14-0c1d-4982-8ee8-2bfc6fde46d3 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0686886 May 12 16:02:12.344443 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9da4877b-efa2-46e2-ae23-a2452769179b req-85f1d3e5-880a-4de0-bb81-43c2eb8fa871 service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1253572 May 12 16:02:12.476229 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9da4877b-efa2-46e2-ae23-a2452769179b req-ca5c7a47-e8fc-4c6f-81bf-c2d057e67c2f service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1247423 May 12 16:02:12.817851 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4f899fb9-38e2-4dc2-bd71-5da3916ad633 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:13.022249 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc89d840-7f67-402b-9f51-dd9e325fae94 req-678de4bc-6549-4ee9-9447-e5b6139188da tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:13.023583 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc89d840-7f67-402b-9f51-dd9e325fae94 req-678de4bc-6549-4ee9-9447-e5b6139188da tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 944 time: 0.0777166 May 12 16:02:13.072528 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc89d840-7f67-402b-9f51-dd9e325fae94 req-c8bce6ba-d24c-48af-9751-be3f720aa3f4 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420346 May 12 16:02:13.571745 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:13.597975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 9452574a-6832-4b4f-b05b-7f97b9d36d2f details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:02:13.734115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:02:13.747261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '9452574a-6832-4b4f-b05b-7f97b9d36d2f', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'port_id': '9452574a-6832-4b4f-b05b-7f97b9d36d2f', 'mac_address': 'fa:16:3e:73:37:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 595, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:02:13.801712 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:13.819015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9452574a-6832-4b4f-b05b-7f97b9d36d2f {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:02:13.834681 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:02:13.838741 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:13.905984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=9452574a-6832-4b4f-b05b-7f97b9d36d2f,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:14.026261 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['9452574a-6832-4b4f-b05b-7f97b9d36d2f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:02:14.256889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da83f864-3ae9-4298-9c78-cfd0cf6aeecb req-2dfb8f5a-7fdc-4df0-a80d-a511b2fc9d17 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:14.258342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da83f864-3ae9-4298-9c78-cfd0cf6aeecb req-2dfb8f5a-7fdc-4df0-a80d-a511b2fc9d17 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 945 time: 0.0803123 May 12 16:02:14.302739 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da83f864-3ae9-4298-9c78-cfd0cf6aeecb req-33ca2c3a-8bef-4db2-8d17-323d7c2f5d0f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384462 May 12 16:02:15.364262 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6fb43cab-3d15-4d4e-aea5-c0c9feedb823 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:15.494924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6570bf97-37af-4a32-9bbb-dbb6f69d4f68 req-dadb27b3-e0f0-4c52-bd8f-dc20234d4e1e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:15.496366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6570bf97-37af-4a32-9bbb-dbb6f69d4f68 req-dadb27b3-e0f0-4c52-bd8f-dc20234d4e1e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 945 time: 0.0861192 May 12 16:02:15.539829 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6570bf97-37af-4a32-9bbb-dbb6f69d4f68 req-fd9a9c4f-45bf-45c3-accf-ae6a6b74ed59 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377605 May 12 16:02:15.614319 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 9452574a-6832-4b4f-b05b-7f97b9d36d2f up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:02:15.683573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 9452574a-6832-4b4f-b05b-7f97b9d36d2f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:02:15.688201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 9452574a-6832-4b4f-b05b-7f97b9d36d2f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:02:15.688564 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:15.806027 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:15.832217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9452574a-6832-4b4f-b05b-7f97b9d36d2f'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:02:15.842565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:02:15.846464 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:15.878980 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-270b148f-1700-4a58-be09-8a8fdc4edddc'] response: {'server_uuid': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9452574a-6832-4b4f-b05b-7f97b9d36d2f', 'code': 200} May 12 16:02:15.917380 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=9452574a-6832-4b4f-b05b-7f97b9d36d2f,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:16.005567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b67c066-7da7-4658-8bd9-1fba8d42214e req-bea103a0-a4c5-4daf-90a3-643b4d2b78fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:16.007033 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9b67c066-7da7-4658-8bd9-1fba8d42214e req-bea103a0-a4c5-4daf-90a3-643b4d2b78fb service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 1097 time: 0.0709639 May 12 16:02:16.050672 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9b67c066-7da7-4658-8bd9-1fba8d42214e req-e2607d5e-e439-4793-9a2a-1410e7b30568 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376515 May 12 16:02:16.072791 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:16.342053 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:16.729768 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d02b3986-5800-4f0a-b809-700681b71676 req-8df43b2b-b99e-49fc-b807-4abbd401ba0d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:16.731219 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d02b3986-5800-4f0a-b809-700681b71676 req-8df43b2b-b99e-49fc-b807-4abbd401ba0d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0825555 May 12 16:02:16.775471 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d02b3986-5800-4f0a-b809-700681b71676 req-f11a12f0-9824-45e2-8258-8cd7541e7eff tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380955 May 12 16:02:17.823114 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:17.965400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f92566-e327-4eee-ae01-3edda895c016 req-bc444801-043c-4d24-9811-9ffe873aa678 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:17.966897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9f92566-e327-4eee-ae01-3edda895c016 req-bc444801-043c-4d24-9811-9ffe873aa678 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0853086 May 12 16:02:18.013335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9f92566-e327-4eee-ae01-3edda895c016 req-74d2e9c0-2010-4267-a3e9-1c5582f65f75 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407553 May 12 16:02:18.197313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b12832bd-3ad2-42f6-9fac-e3b0a0a7d715 req-6ec61688-0a4a-468c-82c4-d544a8c223f5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:18.198754 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b12832bd-3ad2-42f6-9fac-e3b0a0a7d715 req-6ec61688-0a4a-468c-82c4-d544a8c223f5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0778556 May 12 16:02:18.207110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 52816) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:02:18.212013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d224efea-e8a2-4508-be73-ea519af62aea tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Request body: {'floatingip': {'port_id': '9452574a-6832-4b4f-b05b-7f97b9d36d2f'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:02:18.289996 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d224efea-e8a2-4508-be73-ea519af62aea tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:18.974872 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d224efea-e8a2-4508-be73-ea519af62aea tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:18.979188 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d224efea-e8a2-4508-be73-ea519af62aea tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:19.145671 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-d224efea-e8a2-4508-be73-ea519af62aea tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d associated. External IP: 172.25.8.219, port: 9452574a-6832-4b4f-b05b-7f97b9d36d2f. May 12 16:02:19.487412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d224efea-e8a2-4508-be73-ea519af62aea tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Router cd523971-49e8-4deb-9f61-a0342aee2763 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:02:19.667155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d224efea-e8a2-4508-be73-ea519af62aea tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:02:19.671595 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d224efea-e8a2-4508-be73-ea519af62aea tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:19.677248 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6cf3df6-1099-4724-8f4f-7899cd1183a5 None None] Sync routers for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:02:19.687452 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6cf3df6-1099-4724-8f4f-7899cd1183a5 None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:02:19.688051 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a6cf3df6-1099-4724-8f4f-7899cd1183a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:02:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:19.734968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d224efea-e8a2-4508-be73-ea519af62aea tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "PUT /v2.0/floatingips/6998d782-f9e2-4cb3-80a3-d55f6fa8888d HTTP/1.1" status: 200 len: 992 time: 1.5267847 May 12 16:02:19.735820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'tag': '9452574a-6832-4b4f-b05b-7f97b9d36d2f'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:02:19.788082 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-66fb23af-2f95-4861-a525-b8da962f6182'] response: {'name': 'network-changed', 'server_uuid': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'tag': '9452574a-6832-4b4f-b05b-7f97b9d36d2f', 'status': 'completed', 'code': 200} May 12 16:02:19.877639 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-a6cf3df6-1099-4724-8f4f-7899cd1183a5 None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:02:19.916903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2655aa7d-e621-4615-8833-35a276cb47b9 req-2931166d-5dab-4f77-a70b-f688d055a8d8 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:19.918566 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2655aa7d-e621-4615-8833-35a276cb47b9 req-2931166d-5dab-4f77-a70b-f688d055a8d8 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0843699 May 12 16:02:19.965808 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2655aa7d-e621-4615-8833-35a276cb47b9 req-04f2ca9f-8070-4802-bdd1-74341b74dde1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411437 May 12 16:02:20.005543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aec7ddd-b5ae-4718-978b-66fdd2763fb4 req-43bb782e-2e7a-415e-98a3-b61113c9a92f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:20.006990 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0aec7ddd-b5ae-4718-978b-66fdd2763fb4 req-43bb782e-2e7a-415e-98a3-b61113c9a92f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 1097 time: 0.1259375 May 12 16:02:20.155832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aec7ddd-b5ae-4718-978b-66fdd2763fb4 req-83fa66f6-8572-41e9-b649-45439d3d843c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:20.157279 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0aec7ddd-b5ae-4718-978b-66fdd2763fb4 req-83fa66f6-8572-41e9-b649-45439d3d843c service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1443818 May 12 16:02:20.162749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36dc6af1-ee11-4ef6-9585-4ca4c959b2c0 req-0995efe3-3ab8-4b6a-b140-6a50644ecbff tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:20.164335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-36dc6af1-ee11-4ef6-9585-4ca4c959b2c0 req-0995efe3-3ab8-4b6a-b140-6a50644ecbff tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0823083 May 12 16:02:20.222036 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-36dc6af1-ee11-4ef6-9585-4ca4c959b2c0 req-3e2b846e-3096-4776-b360-ccfebabc801e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504844 May 12 16:02:20.279462 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a6cf3df6-1099-4724-8f4f-7899cd1183a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '6998d782-f9e2-4cb3-80a3-d55f6fa8888d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'floating_ip_address': '172.25.8.219', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'port_id': '9452574a-6832-4b4f-b05b-7f97b9d36d2f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 4150, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'mac_address': 'fa:16:3e:73:37:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:02:06Z', 'updated_at': '2022-05-12T16:02:18Z', 'revision_number': 1, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:20.283730 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6cf3df6-1099-4724-8f4f-7899cd1183a5 None None] Checking router: cd523971-49e8-4deb-9f61-a0342aee2763 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:02:20.293307 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6cf3df6-1099-4724-8f4f-7899cd1183a5 None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:02:20.293760 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a6cf3df6-1099-4724-8f4f-7899cd1183a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:02:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:20.383115 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0aec7ddd-b5ae-4718-978b-66fdd2763fb4 req-b245ace6-d668-49fc-849b-6b7045876992 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f HTTP/1.1" status: 200 len: 1000 time: 0.2200081 May 12 16:02:20.444726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aec7ddd-b5ae-4718-978b-66fdd2763fb4 req-d3ff8dfc-f7c3-4e17-a7c5-6983d2e73175 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:20.446207 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0aec7ddd-b5ae-4718-978b-66fdd2763fb4 req-d3ff8dfc-f7c3-4e17-a7c5-6983d2e73175 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0580003 May 12 16:02:20.470255 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-a6cf3df6-1099-4724-8f4f-7899cd1183a5 None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:02:20.525264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aec7ddd-b5ae-4718-978b-66fdd2763fb4 req-323b987c-aa94-4f7c-a68e-244e81d16607 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:20.526770 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0aec7ddd-b5ae-4718-978b-66fdd2763fb4 req-323b987c-aa94-4f7c-a68e-244e81d16607 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0751541 May 12 16:02:20.660195 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0aec7ddd-b5ae-4718-978b-66fdd2763fb4 req-d81df877-39d9-4116-908d-f726e02ecd57 service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1276259 May 12 16:02:20.795304 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0aec7ddd-b5ae-4718-978b-66fdd2763fb4 req-3eccf6b1-27fd-4a8e-b484-c6cbad31aa85 service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1286752 May 12 16:02:20.815501 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a6cf3df6-1099-4724-8f4f-7899cd1183a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '6998d782-f9e2-4cb3-80a3-d55f6fa8888d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'floating_ip_address': '172.25.8.219', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'port_id': '9452574a-6832-4b4f-b05b-7f97b9d36d2f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 4150, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'mac_address': 'fa:16:3e:73:37:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:02:06Z', 'updated_at': '2022-05-12T16:02:18Z', 'revision_number': 1, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:20.819524 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6cf3df6-1099-4724-8f4f-7899cd1183a5 None None] The sync data for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 is: [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '6998d782-f9e2-4cb3-80a3-d55f6fa8888d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'floating_ip_address': '172.25.8.219', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'port_id': '9452574a-6832-4b4f-b05b-7f97b9d36d2f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 4150, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'mac_address': 'fa:16:3e:73:37:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:02:06Z', 'updated_at': '2022-05-12T16:02:18Z', 'revision_number': 1, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:02:21.004606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54166284-16ff-495d-9221-9f675717a905 None None] New status for floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:02:21.406792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed594f71-9dde-4fed-bc76-db731b2ed12f req-9cdff04a-9f3e-429e-b0db-d7200b93107d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:21.408238 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed594f71-9dde-4fed-bc76-db731b2ed12f req-9cdff04a-9f3e-429e-b0db-d7200b93107d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0833166 May 12 16:02:21.452948 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ed594f71-9dde-4fed-bc76-db731b2ed12f req-9772d9e5-f6df-4fe6-905d-9170233e6500 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390923 May 12 16:02:21.636360 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6763d039-5a16-4cb3-9569-94327f74aadc req-04ebf240-6d6d-42fa-ba4c-e6978d3f2df6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:21.637697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6763d039-5a16-4cb3-9569-94327f74aadc req-04ebf240-6d6d-42fa-ba4c-e6978d3f2df6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0822585 May 12 16:02:21.787019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6763d039-5a16-4cb3-9569-94327f74aadc req-9b3443ba-40dd-44f4-90cb-0ae48b305a86 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1436727 May 12 16:02:22.188069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-dadb16ce-b99a-4b32-9719-94612ca73a0a service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1287572 May 12 16:02:22.204129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc960da4-7a61-4f97-99bb-a1fc9e1871e0 req-a7e51c5e-696e-47cc-a57f-c2155740e4d0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:22.206043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc960da4-7a61-4f97-99bb-a1fc9e1871e0 req-a7e51c5e-696e-47cc-a57f-c2155740e4d0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0980847 May 12 16:02:22.257799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc960da4-7a61-4f97-99bb-a1fc9e1871e0 req-224e0563-a48a-42c5-beb0-a46001327cee tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394208 May 12 16:02:23.289366 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ced3ea57-a824-4607-a154-a504650bde30 req-67985f07-dd8f-48f9-9a0d-b87541bb850c service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0416102 May 12 16:02:23.396462 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ced3ea57-a824-4607-a154-a504650bde30 req-0934983c-cb69-46fc-9a50-724a3a65a4d9 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0404322 May 12 16:02:23.443156 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ced3ea57-a824-4607-a154-a504650bde30 req-bdd3db70-3c31-4641-8267-86e9e8ba8783 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0290582 May 12 16:02:23.444303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a4ba69-44b2-4aae-8c61-fe723ba769eb req-8f4c52d0-7081-4e91-96ce-212772746863 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:23.445771 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01a4ba69-44b2-4aae-8c61-fe723ba769eb req-8f4c52d0-7081-4e91-96ce-212772746863 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0803256 May 12 16:02:23.494787 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01a4ba69-44b2-4aae-8c61-fe723ba769eb req-403cf693-fb45-4cdd-a6ce-3e6051e5bb61 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422606 May 12 16:02:23.638943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ced3ea57-a824-4607-a154-a504650bde30 req-8cd5280f-c793-4f74-93b3-0920f8595d49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:23.640366 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ced3ea57-a824-4607-a154-a504650bde30 req-8cd5280f-c793-4f74-93b3-0920f8595d49 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1916211 May 12 16:02:23.654585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-4c85658c-b625-4ca4-a360-2cdae7b6cea9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:23.655941 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-4c85658c-b625-4ca4-a360-2cdae7b6cea9 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 1097 time: 0.1138890 May 12 16:02:23.791358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-ab5741a6-6172-4366-9f53-8ceeafe487cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:23.792796 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-ab5741a6-6172-4366-9f53-8ceeafe487cc service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1301816 May 12 16:02:23.896257 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-667b486e-99c9-4982-851a-51697d3b0cc7 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f HTTP/1.1" status: 200 len: 1002 time: 0.0979202 May 12 16:02:23.958809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-a5c2cd9e-9349-459c-8f6a-544a34d0c568 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:23.960105 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-a5c2cd9e-9349-459c-8f6a-544a34d0c568 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0578864 May 12 16:02:24.035999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-21f660a8-10c7-4bc3-9084-83842cab0495 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:24.037449 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-21f660a8-10c7-4bc3-9084-83842cab0495 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0718253 May 12 16:02:24.167423 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-990a9fb1-2100-4ef2-a6b7-a4eae8cb942c service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1237824 May 12 16:02:24.298657 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-968e1bf9-594a-4c01-a0fd-6b66ac3f3fc6 service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1258807 May 12 16:02:24.683197 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc0c040-648a-45ec-8b4a-22f8a237a4a1 req-7dcedefe-9c56-4129-90b6-f7bbed55a774 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:24.684629 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6dc0c040-648a-45ec-8b4a-22f8a237a4a1 req-7dcedefe-9c56-4129-90b6-f7bbed55a774 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0795231 May 12 16:02:24.730065 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6dc0c040-648a-45ec-8b4a-22f8a237a4a1 req-c51810a4-d279-46f0-9e18-c2d68f8398ce tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392933 May 12 16:02:25.915479 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42c545c1-5cb3-4808-8cec-fd4590af301f req-d3a32e74-f119-404d-bbdd-9379bbbf1399 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:25.916999 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-42c545c1-5cb3-4808-8cec-fd4590af301f req-d3a32e74-f119-404d-bbdd-9379bbbf1399 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0823603 May 12 16:02:25.959576 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-42c545c1-5cb3-4808-8cec-fd4590af301f req-a2074d89-796a-4383-87ee-ad445d14f64f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0370719 May 12 16:02:27.141920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e3e5044-9727-42c5-9240-66dccf69bf6a req-e151fde4-1fe1-4127-9e2e-3de54246ba6c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:27.144006 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7e3e5044-9727-42c5-9240-66dccf69bf6a req-e151fde4-1fe1-4127-9e2e-3de54246ba6c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0804477 May 12 16:02:27.187456 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7e3e5044-9727-42c5-9240-66dccf69bf6a req-09134a94-7ee1-4bc8-b482-cb2df441dc4b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380776 May 12 16:02:28.378439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f2285a-ad9a-4560-8231-31bd43a28305 req-1396fb03-4031-4143-b18a-0d85bfc46768 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:28.379781 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7f2285a-ad9a-4560-8231-31bd43a28305 req-1396fb03-4031-4143-b18a-0d85bfc46768 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0820818 May 12 16:02:28.423384 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7f2285a-ad9a-4560-8231-31bd43a28305 req-47cdd6d9-ab73-4123-bd64-b5599b7cc97a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374370 May 12 16:02:29.604830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eea7b0ec-191d-45e4-8af8-fb14e7db5e48 req-74f19403-f3fb-42e6-a414-d75af452c771 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:29.606187 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eea7b0ec-191d-45e4-8af8-fb14e7db5e48 req-74f19403-f3fb-42e6-a414-d75af452c771 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0792108 May 12 16:02:29.654095 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eea7b0ec-191d-45e4-8af8-fb14e7db5e48 req-3cb7162a-22c8-4303-af11-7aae35e0c354 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422587 May 12 16:02:30.839681 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adc56775-2c9d-41e3-885a-d5567edd823a req-dfbd84a0-db32-4153-9f4c-b8fc9df37851 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:30.841143 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-adc56775-2c9d-41e3-885a-d5567edd823a req-dfbd84a0-db32-4153-9f4c-b8fc9df37851 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0793188 May 12 16:02:30.884516 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-adc56775-2c9d-41e3-885a-d5567edd823a req-cffcb906-04d0-4ae3-b47f-9331e92f95c7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376873 May 12 16:02:32.223702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d13983f-1c23-4755-9171-d6a0535ea988 req-fe3c5209-6274-4326-a5f1-dd0657ecff55 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:32.226127 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d13983f-1c23-4755-9171-d6a0535ea988 req-fe3c5209-6274-4326-a5f1-dd0657ecff55 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0833011 May 12 16:02:32.271019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d13983f-1c23-4755-9171-d6a0535ea988 req-0bf0ce40-4809-437c-9f97-189b551af0a0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389152 May 12 16:02:32.771666 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:32.969992 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:02:33.456458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-895bc465-7175-44a7-a18e-0deb6e94d294 req-0d286d79-cb14-45b5-a0b0-0c7b6cb552ae tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:33.457887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-895bc465-7175-44a7-a18e-0deb6e94d294 req-0d286d79-cb14-45b5-a0b0-0c7b6cb552ae tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0776265 May 12 16:02:33.500839 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-895bc465-7175-44a7-a18e-0deb6e94d294 req-6edb046a-fe01-47b7-a243-34803a4946ab tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374279 May 12 16:02:34.683769 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ecb5cf7-6f2e-4e94-af6b-1ead9b63d077 req-c56971f3-abd5-4e47-888c-87c62b2165de tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:34.685194 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ecb5cf7-6f2e-4e94-af6b-1ead9b63d077 req-c56971f3-abd5-4e47-888c-87c62b2165de tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0819492 May 12 16:02:34.729330 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ecb5cf7-6f2e-4e94-af6b-1ead9b63d077 req-1aacc8d7-0daf-4cab-a73a-2ca59b914a72 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380971 May 12 16:02:35.916795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-094a1826-57bb-4d3c-98e3-6fbb6d552ea5 req-301f2bec-f1fc-491b-9b91-8ca44fa4b3b7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:35.918293 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-094a1826-57bb-4d3c-98e3-6fbb6d552ea5 req-301f2bec-f1fc-491b-9b91-8ca44fa4b3b7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0795283 May 12 16:02:35.961627 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-094a1826-57bb-4d3c-98e3-6fbb6d552ea5 req-2baeaf69-fe21-497c-a435-8af06f352820 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377815 May 12 16:02:37.145218 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4776f06e-c58d-4c28-8df5-affff3021820 req-4e620434-c272-4ea2-a18a-280c0fbf8c24 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:37.146658 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4776f06e-c58d-4c28-8df5-affff3021820 req-4e620434-c272-4ea2-a18a-280c0fbf8c24 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0814538 May 12 16:02:37.189907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4776f06e-c58d-4c28-8df5-affff3021820 req-5c1fca3e-7b3b-4b9e-9465-a00644b60653 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0369866 May 12 16:02:38.372085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d376c7fa-80b9-4686-9aa9-6ad729f4cb98 req-e786b09a-6cc2-4031-90f5-006225a13a78 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:38.373545 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d376c7fa-80b9-4686-9aa9-6ad729f4cb98 req-e786b09a-6cc2-4031-90f5-006225a13a78 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0784934 May 12 16:02:38.420893 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d376c7fa-80b9-4686-9aa9-6ad729f4cb98 req-6da5be50-145b-428c-8a1e-fa50607ef1b2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416939 May 12 16:02:39.603361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66309897-739a-4edd-9a68-01f2df423efc req-df087808-1d09-4a16-81c7-405a2513d270 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:39.604739 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66309897-739a-4edd-9a68-01f2df423efc req-df087808-1d09-4a16-81c7-405a2513d270 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0794957 May 12 16:02:39.648096 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66309897-739a-4edd-9a68-01f2df423efc req-2ac4294a-24f1-49dc-95d3-255b6c0f4c9b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377939 May 12 16:02:40.833278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-450d7691-fdab-4753-83b8-255268db80e6 req-917df242-08ad-43db-b46f-685e3f0ea8a3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:40.834735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-450d7691-fdab-4753-83b8-255268db80e6 req-917df242-08ad-43db-b46f-685e3f0ea8a3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0830688 May 12 16:02:40.878449 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-450d7691-fdab-4753-83b8-255268db80e6 req-6f240ec1-7d0b-4923-99c1-a429b2a6b5c0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381076 May 12 16:02:42.059813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f857eec-e14c-4a1e-a8d7-9d328f2753c8 req-da3e6979-84ea-4c67-a8f8-1a3846c7678a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:42.061236 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f857eec-e14c-4a1e-a8d7-9d328f2753c8 req-da3e6979-84ea-4c67-a8f8-1a3846c7678a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0787797 May 12 16:02:42.104823 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f857eec-e14c-4a1e-a8d7-9d328f2753c8 req-1721e0cd-2d82-4ce9-b165-715e8bab370f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377080 May 12 16:02:42.819750 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a1390455-3947-41a1-99dd-6eb61da7ae1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:43.292882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6f1fe58-6dd6-414e-b2ab-19612ae87b0d req-67b7c622-57fe-4ca2-aa2e-a195609d5cb3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:43.294338 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6f1fe58-6dd6-414e-b2ab-19612ae87b0d req-67b7c622-57fe-4ca2-aa2e-a195609d5cb3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0836148 May 12 16:02:43.337417 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6f1fe58-6dd6-414e-b2ab-19612ae87b0d req-9264ffd9-e5f4-4592-8856-02cfd07af521 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373492 May 12 16:02:43.571503 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:44.521081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38362747-2422-4726-b54d-7c05430e2213 req-578c1412-0759-4a71-a1ac-4ee07f0ad850 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:44.522548 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-38362747-2422-4726-b54d-7c05430e2213 req-578c1412-0759-4a71-a1ac-4ee07f0ad850 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0811706 May 12 16:02:44.569726 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-38362747-2422-4726-b54d-7c05430e2213 req-16f477d2-0724-4755-a675-da1edc746fee tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409789 May 12 16:02:45.366342 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9f84d247-f0b4-4e9a-9586-7fcb67dfaa60 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:45.758118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50d6ba87-4542-4ccb-9c81-25fd0d6019c8 req-b47ed5a7-4d16-4d51-85e2-c1ed454c2d89 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:45.759555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50d6ba87-4542-4ccb-9c81-25fd0d6019c8 req-b47ed5a7-4d16-4d51-85e2-c1ed454c2d89 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0840333 May 12 16:02:45.803468 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50d6ba87-4542-4ccb-9c81-25fd0d6019c8 req-4923f7f5-8fe0-4907-b956-820776a1e1d1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382047 May 12 16:02:45.999409 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-fe0913ac-17dd-4ce0-875a-41e59764856e service neutron] show failed (client error): The resource could not be found. May 12 16:02:46.000535 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-fe0913ac-17dd-4ce0-875a-41e59764856e service neutron] 10.222.0.76 "GET /v2.0/ports/9452574a-6832-4b4f-b05b-7f97b9d36d2f/bindings/n-h1-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.0739243 May 12 16:02:46.076301 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:46.345413 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:46.461039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-cb3623e1-8921-466c-a5e4-a152043d5226 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:46.462550 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-cb3623e1-8921-466c-a5e4-a152043d5226 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7&tenant_id=22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 1097 time: 0.2261865 May 12 16:02:46.487424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:02:46.597567 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:46.866223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] For port 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:02:46.899655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] For port 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:02:46.959749 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:46.961809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9452574a-6832-4b4f-b05b-7f97b9d36d2f'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:02:46.978001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Transition to ACTIVE for port object 9452574a-6832-4b4f-b05b-7f97b9d36d2f will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:02:46.983309 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:46.997625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7299efa5-96a2-441b-ad77-ef5575f906d1 req-d8ce2467-f9f0-4159-9fab-e2d62e81b715 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:46.999161 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7299efa5-96a2-441b-ad77-ef5575f906d1 req-d8ce2467-f9f0-4159-9fab-e2d62e81b715 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0869892 May 12 16:02:47.145001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Pushing event updated for resources: {'Port': ['ID=9452574a-6832-4b4f-b05b-7f97b9d36d2f,revision_number=6']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:47.158943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:47.159492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:47.159986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:47.160459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:47.160929 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:47.161416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:47.162763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:47.163393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:47.163876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:47.164343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:47.164822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:47.165296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:47.174097 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-eb1dd0f7-e3cc-4f90-a1dc-80a6df07b4bb'] response: {'server_uuid': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9452574a-6832-4b4f-b05b-7f97b9d36d2f', 'code': 200} May 12 16:02:47.180374 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7299efa5-96a2-441b-ad77-ef5575f906d1 req-0e112302-cd52-4292-9d00-9e3a4298f9d7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1749346 May 12 16:02:47.216201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] No DVR routers for this DVR port 9452574a-6832-4b4f-b05b-7f97b9d36d2f on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:02:47.442996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Attempting to bind port 9452574a-6832-4b4f-b05b-7f97b9d36d2f on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:02:47.443239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Attempting to bind port 9452574a-6832-4b4f-b05b-7f97b9d36d2f by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:02:47.443560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Attempting to bind port 9452574a-6832-4b4f-b05b-7f97b9d36d2f on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:02:47.448680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Port 9452574a-6832-4b4f-b05b-7f97b9d36d2f on network 9475b307-5f43-40f6-b384-65417948d75d not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:02:47.449214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Attempting to bind port 9452574a-6832-4b4f-b05b-7f97b9d36d2f on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:02:47.454032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 2, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:02:47.454362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Checking segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:02:47.454734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Bound using segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:02:47.455149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Bound port: 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:02:47.455484 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:47.540868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] For port 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:02:47.544643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] For port 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:02:47.549073 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:47.609319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:47.609949 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:47.611711 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] 10.222.0.84 "PUT /v2.0/ports/9452574a-6832-4b4f-b05b-7f97b9d36d2f HTTP/1.1" status: 200 len: 1092 time: 1.1276650 May 12 16:02:47.631780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00e5fe35-1666-40ad-acae-250f81750e24 service neutron] Pushing event updated for resources: {'Port': ['ID=9452574a-6832-4b4f-b05b-7f97b9d36d2f,revision_number=7']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:47.731076 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-2fe3d7a8-547a-437c-b84f-b7ff945e4978 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:47.732594 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-2fe3d7a8-547a-437c-b84f-b7ff945e4978 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 1095 time: 0.0751503 May 12 16:02:47.824650 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:47.877167 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-4020d38c-dadb-447d-9854-9a1295aa4b69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:47.878587 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-4020d38c-dadb-447d-9854-9a1295aa4b69 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1373026 May 12 16:02:47.986172 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-148cf955-8e9b-4436-84be-fa927cda1332 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f HTTP/1.1" status: 200 len: 1000 time: 0.0971096 May 12 16:02:48.050993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-ae13c3e4-e69c-4caf-b162-4c6640248959 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:48.052372 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-ae13c3e4-e69c-4caf-b162-4c6640248959 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0563016 May 12 16:02:48.248067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-bae46564-8774-4193-a056-ede5478d4f64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:48.249508 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-bae46564-8774-4193-a056-ede5478d4f64 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1899035 May 12 16:02:48.379493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01c1a840-a279-4561-834d-1be379a2268c req-9fb199f4-8647-4dca-bbaf-148b7ebe3015 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:48.380953 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01c1a840-a279-4561-834d-1be379a2268c req-9fb199f4-8647-4dca-bbaf-148b7ebe3015 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 944 time: 0.0830622 May 12 16:02:48.391010 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-f858fb11-e753-4ff6-b720-06716fe6988c service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1307104 May 12 16:02:48.427532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01c1a840-a279-4561-834d-1be379a2268c req-79de8e48-8ac1-4fec-bb7c-46a9b7c8a409 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400720 May 12 16:02:48.526168 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-263647e5-f4c0-4bd0-8558-3394f443ecb0 req-e8de342c-137a-4872-82bf-a7c0bc1b116b service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1256468 May 12 16:02:49.175456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'tag': '9452574a-6832-4b4f-b05b-7f97b9d36d2f'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:02:49.232690 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ddb56435-4213-4495-a06f-1bb974f98e23'] response: {'name': 'network-changed', 'server_uuid': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'tag': '9452574a-6832-4b4f-b05b-7f97b9d36d2f', 'status': 'completed', 'code': 200} May 12 16:02:49.379524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-3141e2dc-8db5-4bba-8d69-e78ff3a0981a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:49.380979 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-3141e2dc-8db5-4bba-8d69-e78ff3a0981a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 1095 time: 0.1325140 May 12 16:02:49.383377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-703540e4-a010-4066-89ba-5dda0acd5ef3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:49.384662 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-703540e4-a010-4066-89ba-5dda0acd5ef3 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 1095 time: 0.1010175 May 12 16:02:49.616934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fabb12dc-bae1-4884-9559-d233d1c8a414 req-e21415dd-4fcd-40b2-8d1e-5fe8d88fd648 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:49.617565 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-ee04e4c5-c543-4e81-9041-8b9040d3f0a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:49.618419 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fabb12dc-bae1-4884-9559-d233d1c8a414 req-e21415dd-4fcd-40b2-8d1e-5fe8d88fd648 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 944 time: 0.0834436 May 12 16:02:49.618887 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-ee04e4c5-c543-4e81-9041-8b9040d3f0a3 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2314594 May 12 16:02:49.624238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-49c12303-8f95-4279-b848-11ecc56605dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:49.625610 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-49c12303-8f95-4279-b848-11ecc56605dd service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2188962 May 12 16:02:49.664652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fabb12dc-bae1-4884-9559-d233d1c8a414 req-d72aa521-b144-4305-83de-89ac1ca571a6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397675 May 12 16:02:49.802036 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 9452574a-6832-4b4f-b05b-7f97b9d36d2f no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:02:49.805276 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-7ddcf614-23a4-4c01-bfbf-84353e21eebb service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f HTTP/1.1" status: 200 len: 1000 time: 0.1786056 May 12 16:02:49.809466 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-531eeec0-9c2c-4acf-bf0c-b26557cdefbd service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f HTTP/1.1" status: 200 len: 1000 time: 0.1309867 May 12 16:02:49.864371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 9452574a-6832-4b4f-b05b-7f97b9d36d2f not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:02:49.913512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-4ca5f829-408b-4490-b0e7-6e286dfe78ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:49.914935 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-4ca5f829-408b-4490-b0e7-6e286dfe78ce service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.1035631 May 12 16:02:49.918516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-74a11ff6-584a-45d0-a084-e103baf6f8c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:49.919818 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-74a11ff6-584a-45d0-a084-e103baf6f8c3 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0767989 May 12 16:02:50.048332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-80c1d944-15d1-4cb4-864c-9e7b1a232a98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:50.049812 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-80c1d944-15d1-4cb4-864c-9e7b1a232a98 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1291583 May 12 16:02:50.051588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-89c547b4-2c43-4dd9-9375-ea845277c44c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:50.052938 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-89c547b4-2c43-4dd9-9375-ea845277c44c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0997527 May 12 16:02:50.287317 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-dcdc96db-d897-4fa6-808a-a7586457e09c service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2304263 May 12 16:02:50.289147 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-4be56ea5-5fe4-4e7c-8d03-2d98540e0994 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2143376 May 12 16:02:50.656738 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-911116d3-d4fa-4064-a323-3c35f78fb18e service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3639367 May 12 16:02:50.658492 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3e9f8ab4-491e-4a9f-a9be-4ea918768c69 req-622fc9d8-aa71-4328-af42-57a741fb0d8b service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3477898 May 12 16:02:50.859408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec95e414-e976-4cf6-859a-95beee15322c req-dafc975f-15dd-42aa-9b95-5654b264837b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:50.860839 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec95e414-e976-4cf6-859a-95beee15322c req-dafc975f-15dd-42aa-9b95-5654b264837b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 944 time: 0.0877347 May 12 16:02:50.908648 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec95e414-e976-4cf6-859a-95beee15322c req-50521905-437a-41a5-bddb-c37c3179530a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420225 May 12 16:02:51.208690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6673fd82-8eb0-46a3-b7e1-b948aea8b4f0 req-945c6ade-3f36-419e-9a32-0d9e3a563fc9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:51.210059 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6673fd82-8eb0-46a3-b7e1-b948aea8b4f0 req-945c6ade-3f36-419e-9a32-0d9e3a563fc9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 944 time: 0.0831082 May 12 16:02:51.219970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-0af575f1-f04e-4ced-bd74-cc91b4d6bfc7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:51.220678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-0af575f1-f04e-4ced-bd74-cc91b4d6bfc7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Synchronizing usage tracker for tenant:22f425833dc74d6b985912b8d7db7222 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:02:51.239300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-0af575f1-f04e-4ced-bd74-cc91b4d6bfc7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Unset dirty status for tenant:22f425833dc74d6b985912b8d7db7222 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:02:51.240459 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-0af575f1-f04e-4ced-bd74-cc91b4d6bfc7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.76 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7&tenant_id=22f425833dc74d6b985912b8d7db7222&binding%3Ahost_id=n-h1-841483-1 HTTP/1.1" status: 200 len: 944 time: 0.1089840 May 12 16:02:51.259372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6673fd82-8eb0-46a3-b7e1-b948aea8b4f0 req-443a7c23-f2ae-480e-869b-00dadc21c71e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419066 May 12 16:02:51.321646 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-01bd6978-064b-4d61-80df-885f87ef002c service neutron] delete failed (client error): The resource could not be found. May 12 16:02:51.322634 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-01bd6978-064b-4d61-80df-885f87ef002c service neutron] 10.222.0.76 "DELETE /v2.0/ports/9452574a-6832-4b4f-b05b-7f97b9d36d2f/bindings/n-h2-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.0770059 May 12 16:02:51.467569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-35d5f0fa-f944-4766-b970-4157fc9d65da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:51.468922 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-35d5f0fa-f944-4766-b970-4157fc9d65da service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 1095 time: 0.0744858 May 12 16:02:51.596949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-2dd176cb-69c9-4256-b6ee-e2c19e82c09c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:51.598386 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-2dd176cb-69c9-4256-b6ee-e2c19e82c09c service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1241379 May 12 16:02:51.696303 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-a065df01-32c0-40ad-8f24-31a8459261bb service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f HTTP/1.1" status: 200 len: 1000 time: 0.0922050 May 12 16:02:51.760240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-f3efa364-d1eb-4184-b716-c5dc6fb4481e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:51.762325 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-f3efa364-d1eb-4184-b716-c5dc6fb4481e service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0603044 May 12 16:02:51.840250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-7a0160b5-00bf-4970-8861-19b1b458482c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:51.841773 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-7a0160b5-00bf-4970-8861-19b1b458482c service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0736473 May 12 16:02:51.972945 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-93a5373e-0f39-4f0e-825a-ef9c58569d90 service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1251318 May 12 16:02:52.046109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9452574a-6832-4b4f-b05b-7f97b9d36d2f details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:02:52.112975 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5745a0f9-4b4d-40df-802b-7f67f69e2434 req-18589bdc-d73c-4989-b131-c2c4c471bd0c service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1329536 May 12 16:02:52.198238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:02:52.211603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '9452574a-6832-4b4f-b05b-7f97b9d36d2f', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'port_id': '9452574a-6832-4b4f-b05b-7f97b9d36d2f', 'mac_address': 'fa:16:3e:73:37:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 595, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:02:52.267643 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:52.284099 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9452574a-6832-4b4f-b05b-7f97b9d36d2f {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:02:52.300218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:02:52.303966 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:52.373597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=9452574a-6832-4b4f-b05b-7f97b9d36d2f,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:52.381006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:52.381339 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:52.381689 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:52.382010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:52.382324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:52.382635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:52.382943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:52.383250 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:52.383557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:52.383862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:52.384166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:52.384471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:02:52.456347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8834e381-7df7-4cd4-8cc1-8f035108d4ca req-a43b5e85-a4ea-49dd-9185-8193c0349364 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:52.457802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8834e381-7df7-4cd4-8cc1-8f035108d4ca req-a43b5e85-a4ea-49dd-9185-8193c0349364 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 945 time: 0.0863411 May 12 16:02:52.503613 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8834e381-7df7-4cd4-8cc1-8f035108d4ca req-7c574840-6abb-442a-a570-5dbb7bf6e70e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402126 May 12 16:02:52.626666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['9452574a-6832-4b4f-b05b-7f97b9d36d2f'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:02:53.688970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f868c6-8c69-446e-b068-803dd3eda0f6 req-d5c8e161-ccbe-45d6-b66a-45fec395202b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:53.690718 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72f868c6-8c69-446e-b068-803dd3eda0f6 req-d5c8e161-ccbe-45d6-b66a-45fec395202b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 945 time: 0.0792294 May 12 16:02:53.736263 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72f868c6-8c69-446e-b068-803dd3eda0f6 req-28e4d0d1-c198-40c2-a47b-25786ec7c924 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398328 May 12 16:02:54.071463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9452574a-6832-4b4f-b05b-7f97b9d36d2f up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:02:54.074334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff443d07-f28a-4987-a074-e574a463a7d8 req-98e3005d-5e56-4770-9691-cce3860a7c49 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:54.075806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff443d07-f28a-4987-a074-e574a463a7d8 req-98e3005d-5e56-4770-9691-cce3860a7c49 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 945 time: 0.0839474 May 12 16:02:54.120374 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff443d07-f28a-4987-a074-e574a463a7d8 req-559c502b-3f3b-4472-a14f-2a45be28ee42 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387878 May 12 16:02:54.150741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 9452574a-6832-4b4f-b05b-7f97b9d36d2f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:02:54.156170 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 9452574a-6832-4b4f-b05b-7f97b9d36d2f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:02:54.156554 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:54.275775 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:54.303230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9452574a-6832-4b4f-b05b-7f97b9d36d2f'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:02:54.307002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aab02250-c502-409e-acf2-4f8a1f2e24f9 req-50aac186-b3fb-493b-bec6-4575d556474d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:54.308684 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aab02250-c502-409e-acf2-4f8a1f2e24f9 req-50aac186-b3fb-493b-bec6-4575d556474d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 945 time: 0.0845928 May 12 16:02:54.313785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:02:54.318763 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:54.362264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aab02250-c502-409e-acf2-4f8a1f2e24f9 req-8c5ae618-71a8-4233-9a53-41ed5de16fbb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468357 May 12 16:02:54.392116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=9452574a-6832-4b4f-b05b-7f97b9d36d2f,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:54.460186 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-cea38c41-795e-43c7-a4ac-0441eb899ffc'] response: {'server_uuid': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9452574a-6832-4b4f-b05b-7f97b9d36d2f', 'code': 200} May 12 16:02:54.740285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23f1b143-460d-4f0a-aee2-7d9262d2adcd req-588e6419-9a09-4c01-9d13-bfca5f72f2a7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:54.741714 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23f1b143-460d-4f0a-aee2-7d9262d2adcd req-588e6419-9a09-4c01-9d13-bfca5f72f2a7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0790184 May 12 16:02:54.784799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23f1b143-460d-4f0a-aee2-7d9262d2adcd req-18fc9267-817e-4ca8-8a2e-28fd70f4edc0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0370207 May 12 16:02:55.973646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49890a26-bb33-4449-b484-32d31fdd30fa req-6afcd706-4373-4154-9ad0-5022fdc7a9a9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:55.975085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49890a26-bb33-4449-b484-32d31fdd30fa req-6afcd706-4373-4154-9ad0-5022fdc7a9a9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0845172 May 12 16:02:56.020034 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49890a26-bb33-4449-b484-32d31fdd30fa req-e4b02ab9-efc6-423a-8f0e-bf1ad4bc2ba9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392299 May 12 16:02:56.203769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-f3caedcb-2baf-4ca8-b016-196486ce3587 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:56.205235 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-f3caedcb-2baf-4ca8-b016-196486ce3587 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 946 time: 0.0860510 May 12 16:02:56.277016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Deleting port 9452574a-6832-4b4f-b05b-7f97b9d36d2f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:02:56.277354 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:56.518473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] For port 9452574a-6832-4b4f-b05b-7f97b9d36d2f, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=9452574a-6832-4b4f-b05b-7f97b9d36d2f,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:02:56.518825 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:56.911452 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:56.911731 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:56.912036 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d disassociated. External IP: 172.25.8.219, port: 9452574a-6832-4b4f-b05b-7f97b9d36d2f. May 12 16:02:56.912368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Calling delete_port for 9452574a-6832-4b4f-b05b-7f97b9d36d2f owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:02:57.063521 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:57.118224 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event deleted for resources: {'Port': ['ID=9452574a-6832-4b4f-b05b-7f97b9d36d2f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:02:57.181199 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6723859c-1731-4da7-9862-f9aa888d54fe req-d0540e80-85b8-49c5-a32b-17288c8be68b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=01ce1596-994d-43f6-b49c-fadd8d396ed7 HTTP/1.1" status: 200 len: 210 time: 0.0546863 May 12 16:02:57.315630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Router cd523971-49e8-4deb-9f61-a0342aee2763 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:02:57.529769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:02:57.539764 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1881c6e4-d179-4377-ad47-ddce9e80e084 None None] Sync routers for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:02:57.549893 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1881c6e4-d179-4377-ad47-ddce9e80e084 None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:02:57.550989 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1881c6e4-d179-4377-ad47-ddce9e80e084 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:02:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:57.622021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] No DVR routers for this DVR port 9452574a-6832-4b4f-b05b-7f97b9d36d2f on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:02:57.624680 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:02:57.627329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'name': 'network-vif-deleted', 'tag': '9452574a-6832-4b4f-b05b-7f97b9d36d2f'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:02:57.645009 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4063f7c5-c1d5-488d-b7e6-18d34d1fe60f req-ea7b5a32-fc8f-4757-829e-28097b9e9e66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "DELETE /v2.0/ports/9452574a-6832-4b4f-b05b-7f97b9d36d2f HTTP/1.1" status: 204 len: 173 time: 1.4315526 May 12 16:02:57.684296 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7ea9e358-caee-4eae-aad6-1e51cabe7f7f'] response: {'server_uuid': '01ce1596-994d-43f6-b49c-fadd8d396ed7', 'name': 'network-vif-deleted', 'tag': '9452574a-6832-4b4f-b05b-7f97b9d36d2f', 'status': 'completed', 'code': 200} May 12 16:02:57.744018 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-1881c6e4-d179-4377-ad47-ddce9e80e084 None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:02:58.095945 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1881c6e4-d179-4377-ad47-ddce9e80e084 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:58.099557 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1881c6e4-d179-4377-ad47-ddce9e80e084 None None] Checking router: cd523971-49e8-4deb-9f61-a0342aee2763 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:02:58.108225 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1881c6e4-d179-4377-ad47-ddce9e80e084 None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:02:58.108801 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1881c6e4-d179-4377-ad47-ddce9e80e084 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:02:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:58.291180 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-1881c6e4-d179-4377-ad47-ddce9e80e084 None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:02:58.514838 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-b31fb5bf-7fcc-4df5-9029-b2805ee566a7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1087207809&fields=id&tenant_id=22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 267 time: 0.0391738 May 12 16:02:58.599870 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-1881c6e4-d179-4377-ad47-ddce9e80e084 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:02:58.603940 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1881c6e4-d179-4377-ad47-ddce9e80e084 None None] The sync data for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 is: [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:02:58.668466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-30d3f2d6-060b-43e3-81f1-be2af8f1c8b0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:02:58.669933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-30d3f2d6-060b-43e3-81f1-be2af8f1c8b0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 812 time: 0.1486254 May 12 16:02:58.685893 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-c3f8aec8-b661-4892-a40b-c7ce85ce541f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/quotas/22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 375 time: 0.0104373 May 12 16:02:58.776617 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-7eb5e5d6-9a89-429c-bd11-09a4d95c6c76 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0851674 May 12 16:02:58.825002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac6ec4c6-a691-4087-bc9a-306256ce7950 None None] New status for floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:02:58.914129 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-911b366c-b5b0-4f03-9b44-8e9c5eb4a31b service neutron] 10.222.0.82 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1258831 May 12 16:02:59.045914 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-acef2922-7f2c-4ee2-ad98-e976b914766c service neutron] 10.222.0.82 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1251967 May 12 16:02:59.226759 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-435bd48f-6a21-4172-bd50-1b0c493aabc2 req-d7b75ca9-e6dc-4dd5-a086-2b4d73416c37 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 210 time: 0.0425076 May 12 16:03:00.078208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9452574a-6832-4b4f-b05b-7f97b9d36d2f no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:03:00.116308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 9452574a-6832-4b4f-b05b-7f97b9d36d2f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:03:00.116670 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 9452574a-6832-4b4f-b05b-7f97b9d36d2f not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:03:00.393101 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-073851d3-0f66-4972-9d82-1e9699f72442 req-a5cdf471-e4c8-4942-a8ed-2c695b58ec22 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 210 time: 0.0475399 May 12 16:03:00.443169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-6ffed275-ac10-41e1-b8d0-e02e951e454c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:00.444572 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-6ffed275-ac10-41e1-b8d0-e02e951e454c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 812 time: 0.1550784 May 12 16:03:00.511029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-d415c55c-2d15-45df-808e-0f2d3f1c877c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 380 time: 0.0453749 May 12 16:03:00.520672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Request body: {'port': {'device_id': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'admin_state_up': True, 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'security_groups': ['3aebfd3b-72ff-4972-bf89-463e07cfaf27']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:03:00.654835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:03:00.658763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Usage tracker for resource:port and tenant:22f425833dc74d6b985912b8d7db7222 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:03:00.661542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:03:00.667089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:03:00.676485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Made reservation on behalf of 22f425833dc74d6b985912b8d7db7222 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:03:00.679915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:00.838377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Allocated IP 172.20.0.3 (9475b307-5f43-40f6-b384-65417948d75d/d0bd473b-b60e-4879-b8b8-94c3dfcc17c8/babb56a1-eab0-42f6-9b7e-b0166b4b1a7a) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:03:01.149439 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:01.165279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Transition to ACTIVE for port object babb56a1-eab0-42f6-9b7e-b0166b4b1a7a will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:03:01.189927 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:01.263111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Network 9475b307-5f43-40f6-b384-65417948d75d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:03:01.266400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:03:01.270286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:03:01.307818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event updated for resources: {'Port': ['ID=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:03:01.346572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:01.347193 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:01.374698 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-33af63c0-7541-41c2-988e-7a7351bbe8dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8571768 May 12 16:03:01.398341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Request body: {'port': {'device_id': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:03:01.455479 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-58af7ad6-7bcd-4923-8c5b-cd01b828b6a2 None None] Provisioning for port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:03:01.460841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-58af7ad6-7bcd-4923-8c5b-cd01b828b6a2 None None] Provisioning complete for port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:03:01.461472 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-58af7ad6-7bcd-4923-8c5b-cd01b828b6a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:01.515508 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-58af7ad6-7bcd-4923-8c5b-cd01b828b6a2 None None] Port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:03:01.525723 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:01.701044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60babe8e-ff11-4e9f-a30c-b07342c465ab req-eb337b0c-d84e-4807-807a-93d82464fbec tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:01.702669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60babe8e-ff11-4e9f-a30c-b07342c465ab req-eb337b0c-d84e-4807-807a-93d82464fbec tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 931 time: 0.1948102 May 12 16:03:01.748467 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60babe8e-ff11-4e9f-a30c-b07342c465ab req-4466e58b-d474-4b5b-b40d-f47a23909c32 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401819 May 12 16:03:01.877149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id babb56a1-eab0-42f6-9b7e-b0166b4b1a7a {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:03:01.884269 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:01.898570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Transition to ACTIVE for port object babb56a1-eab0-42f6-9b7e-b0166b4b1a7a will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:03:01.903096 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:02.056825 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Pushing event updated for resources: {'Port': ['ID=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:03:02.146943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Attempting to bind port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:03:02.147271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Attempting to bind port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:03:02.147596 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Attempting to bind port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:03:02.152677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a on network 9475b307-5f43-40f6-b384-65417948d75d not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:03:02.153009 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Attempting to bind port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:03:02.158063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 2, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:03:02.158396 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Checking segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:03:02.158774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Bound using segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:03:02.159191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Bound port: babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:03:02.159529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:02.247974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] For port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:03:02.250923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] For port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:03:02.255643 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:02.324864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:02.325498 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:02.326904 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] 10.222.0.84 "PUT /v2.0/ports/babb56a1-eab0-42f6-9b7e-b0166b4b1a7a HTTP/1.1" status: 200 len: 1091 time: 0.9329593 May 12 16:03:02.327332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'tag': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:03:02.348300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e02e3dcf-edd6-4556-a21c-fc7e08cb04fa service neutron] Pushing event updated for resources: {'Port': ['ID=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:03:02.389365 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5a0c1a17-69a1-4933-85bd-fc98d46bdbb1'] response: {'name': 'network-changed', 'server_uuid': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'tag': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a', 'status': 'completed', 'code': 200} May 12 16:03:02.476011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-8c372788-5870-46a5-bc8a-c7264babd8b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:02.477512 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-8c372788-5870-46a5-bc8a-c7264babd8b8 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 1094 time: 0.0732038 May 12 16:03:02.561722 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-83685305-fa84-44d6-b383-ef2479126ae3 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a HTTP/1.1" status: 200 len: 217 time: 0.0647695 May 12 16:03:02.624223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-38881e64-9c7b-460f-ad21-7eca2ac50079 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:02.625533 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-38881e64-9c7b-460f-ad21-7eca2ac50079 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0561442 May 12 16:03:02.705437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-63fe5e54-5adc-4b16-94ff-73835b70f871 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:02.706860 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-63fe5e54-5adc-4b16-94ff-73835b70f871 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0723717 May 12 16:03:02.791680 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:02.843008 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-54d70732-c9ce-4c90-940c-20fac79fe02e service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1261783 May 12 16:03:02.933188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f72553bb-fba7-4f2a-931e-471acdde17d3 req-1365b8da-ab15-4db8-9111-3938c75c2c37 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:02.934655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f72553bb-fba7-4f2a-931e-471acdde17d3 req-1365b8da-ab15-4db8-9111-3938c75c2c37 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 943 time: 0.0803328 May 12 16:03:02.983653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f72553bb-fba7-4f2a-931e-471acdde17d3 req-2abeeb77-4733-44f4-8b3f-1257922eeba6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430951 May 12 16:03:03.087483 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1533a59e-d2b1-4423-8009-5a0dd34d4857 req-e38d3d25-228b-4dc5-8941-3cba6811fa7b service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2340324 May 12 16:03:03.259070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e460069-3c4b-4d25-b737-be96ab6c2092 req-d28c1c9d-4505-46ee-8b90-5c6f8c40005a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:03.261127 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6e460069-3c4b-4d25-b737-be96ab6c2092 req-d28c1c9d-4505-46ee-8b90-5c6f8c40005a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 1094 time: 0.0704484 May 12 16:03:03.402156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e460069-3c4b-4d25-b737-be96ab6c2092 req-ffa1f100-c3a9-430b-b1fa-caf1d79643ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:03.403411 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6e460069-3c4b-4d25-b737-be96ab6c2092 req-ffa1f100-c3a9-430b-b1fa-caf1d79643ff service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1362231 May 12 16:03:03.479944 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6e460069-3c4b-4d25-b737-be96ab6c2092 req-f6d723fe-2a6c-4df2-b359-fd22956e6309 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a HTTP/1.1" status: 200 len: 217 time: 0.0685568 May 12 16:03:03.545011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e460069-3c4b-4d25-b737-be96ab6c2092 req-bb55c89c-1a22-4ce8-add0-aef9eb3ea51a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:03.546453 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6e460069-3c4b-4d25-b737-be96ab6c2092 req-bb55c89c-1a22-4ce8-add0-aef9eb3ea51a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0599132 May 12 16:03:03.627082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e460069-3c4b-4d25-b737-be96ab6c2092 req-2e5f921b-5036-44b2-b5ca-39991df8f3d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:03.628523 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6e460069-3c4b-4d25-b737-be96ab6c2092 req-2e5f921b-5036-44b2-b5ca-39991df8f3d0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0726075 May 12 16:03:03.766589 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6e460069-3c4b-4d25-b737-be96ab6c2092 req-2a720d80-6b6b-4752-993e-d4ad125c22b1 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1304772 May 12 16:03:03.899421 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6e460069-3c4b-4d25-b737-be96ab6c2092 req-5cb7dd98-f235-4545-be3c-0fbd2c929380 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1266284 May 12 16:03:04.164986 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baa9cd4f-1bc1-40f3-bbaa-58696b03a44a req-bf5862d2-e55b-47eb-b4dd-3fd3d64b98a0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:04.167120 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-baa9cd4f-1bc1-40f3-bbaa-58696b03a44a req-bf5862d2-e55b-47eb-b4dd-3fd3d64b98a0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 943 time: 0.0777621 May 12 16:03:04.210577 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-baa9cd4f-1bc1-40f3-bbaa-58696b03a44a req-69601cf8-de55-4780-90dc-568414a47304 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379620 May 12 16:03:05.405228 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf1490f-aa71-4ec7-9f57-70001d80c423 req-b260945f-ac3a-4eef-b665-e2586f21806f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:05.406695 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7bf1490f-aa71-4ec7-9f57-70001d80c423 req-b260945f-ac3a-4eef-b665-e2586f21806f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 943 time: 0.0828893 May 12 16:03:05.450113 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7bf1490f-aa71-4ec7-9f57-70001d80c423 req-f243c34d-3ee2-4883-b7fb-1074e1ad7505 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377674 May 12 16:03:06.128212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device babb56a1-eab0-42f6-9b7e-b0166b4b1a7a details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:03:06.261868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:03:06.274770 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'port_id': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a', 'mac_address': 'fa:16:3e:11:62:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 595, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:03:06.332252 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:06.348573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id babb56a1-eab0-42f6-9b7e-b0166b4b1a7a {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:03:06.364025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:03:06.368808 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:06.436524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:03:06.642630 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-422d50df-70d0-427a-895e-426867f76474 req-52399481-d7bd-43fc-8912-b39f87b999cf tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:06.644061 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-422d50df-70d0-427a-895e-426867f76474 req-52399481-d7bd-43fc-8912-b39f87b999cf tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 944 time: 0.0784590 May 12 16:03:06.688851 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-422d50df-70d0-427a-895e-426867f76474 req-8c3ccd9b-77a3-4b95-83a5-72acca1c3f4e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384638 May 12 16:03:06.712565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['babb56a1-eab0-42f6-9b7e-b0166b4b1a7a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:03:07.878337 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93e9bd3a-0bd1-4cf6-9335-47c4b1b1b312 req-fbe5aa00-a347-42c5-a4f6-70f7b4e52168 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:07.879777 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93e9bd3a-0bd1-4cf6-9335-47c4b1b1b312 req-fbe5aa00-a347-42c5-a4f6-70f7b4e52168 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 944 time: 0.0836179 May 12 16:03:07.923184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93e9bd3a-0bd1-4cf6-9335-47c4b1b1b312 req-3014962c-2f31-4d35-81ab-ed1e1153f032 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378301 May 12 16:03:08.128668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device babb56a1-eab0-42f6-9b7e-b0166b4b1a7a up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:03:08.194649 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:03:08.199313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:03:08.199684 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:08.324931 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:08.352613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:03:08.363286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:03:08.367775 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:08.400976 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c5c40bb1-dc1a-4d98-8e20-57ad5314c61d'] response: {'server_uuid': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a', 'code': 200} May 12 16:03:08.441732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:03:08.561430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e194b8fe-b846-41b6-9d55-db22421fbafd req-7113b714-ba89-461b-a72c-e1fe1fc0eb4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:08.562878 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e194b8fe-b846-41b6-9d55-db22421fbafd req-7113b714-ba89-461b-a72c-e1fe1fc0eb4b service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 1096 time: 0.0687988 May 12 16:03:08.607082 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e194b8fe-b846-41b6-9d55-db22421fbafd req-6c4f98c1-258d-4dd2-9eee-298ebf1355c8 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0339389 May 12 16:03:09.106414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb2cddd9-2d0d-4fed-93d7-af0cc0c51dea req-3fd4ecd0-9fd1-4d40-a861-242194a9cc39 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:09.107834 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb2cddd9-2d0d-4fed-93d7-af0cc0c51dea req-3fd4ecd0-9fd1-4d40-a861-242194a9cc39 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0794203 May 12 16:03:09.154898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb2cddd9-2d0d-4fed-93d7-af0cc0c51dea req-575650a1-5129-48b7-9585-9f31d13a23fd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415204 May 12 16:03:09.969965 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:03:10.340012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a042f8-6660-4f5e-b11a-ce28ad825f87 req-5c1927bc-d552-4dac-8e5b-2d1c8c97b8f8 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:10.341494 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2a042f8-6660-4f5e-b11a-ce28ad825f87 req-5c1927bc-d552-4dac-8e5b-2d1c8c97b8f8 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0828323 May 12 16:03:10.387326 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f2a042f8-6660-4f5e-b11a-ce28ad825f87 req-50487d97-03d7-4033-8fab-8784373bf17b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399432 May 12 16:03:10.568738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8a47d32-2f91-4cca-884e-fe476d9cc483 req-65569419-f58f-4b42-88ad-1555d4468b2f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:10.570117 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8a47d32-2f91-4cca-884e-fe476d9cc483 req-65569419-f58f-4b42-88ad-1555d4468b2f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0828235 May 12 16:03:10.579333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53004) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:03:10.584097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-5c583ed4-41a3-4d35-8ca7-2e3507c2277d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Request body: {'floatingip': {'port_id': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:03:10.658681 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c583ed4-41a3-4d35-8ca7-2e3507c2277d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:11.243181 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c583ed4-41a3-4d35-8ca7-2e3507c2277d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:11.246946 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c583ed4-41a3-4d35-8ca7-2e3507c2277d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:11.515068 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-5c583ed4-41a3-4d35-8ca7-2e3507c2277d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d associated. External IP: 172.25.8.219, port: babb56a1-eab0-42f6-9b7e-b0166b4b1a7a. May 12 16:03:11.859564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5c583ed4-41a3-4d35-8ca7-2e3507c2277d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Router cd523971-49e8-4deb-9f61-a0342aee2763 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:03:12.037944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5c583ed4-41a3-4d35-8ca7-2e3507c2277d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:03:12.043357 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5c583ed4-41a3-4d35-8ca7-2e3507c2277d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:12.047810 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4831aad1-b7c8-4ae3-b7fe-8750113153f5 None None] Sync routers for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:03:12.058038 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4831aad1-b7c8-4ae3-b7fe-8750113153f5 None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:03:12.058633 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4831aad1-b7c8-4ae3-b7fe-8750113153f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:02:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:03:12.104072 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5c583ed4-41a3-4d35-8ca7-2e3507c2277d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "PUT /v2.0/floatingips/6998d782-f9e2-4cb3-80a3-d55f6fa8888d HTTP/1.1" status: 200 len: 991 time: 1.5211852 May 12 16:03:12.104072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'tag': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:03:12.241240 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-60b5e1b1-ea7a-4f6c-b42a-23c71c04e62f'] response: {'name': 'network-changed', 'server_uuid': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'tag': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a', 'status': 'completed', 'code': 200} May 12 16:03:12.247973 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-4831aad1-b7c8-4ae3-b7fe-8750113153f5 None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:03:12.362656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f5509d3-e483-45c4-87a0-42b3b2803ad0 req-7d81267a-5fc3-4c46-aeb0-62d30b01072d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:12.364135 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5f5509d3-e483-45c4-87a0-42b3b2803ad0 req-7d81267a-5fc3-4c46-aeb0-62d30b01072d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 1096 time: 0.0801389 May 12 16:03:12.449352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3bfce73-9f18-4522-abda-0fc17855f6a7 req-abda3420-ea69-4b41-96bb-49db32bd5fa4 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:12.451399 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3bfce73-9f18-4522-abda-0fc17855f6a7 req-abda3420-ea69-4b41-96bb-49db32bd5fa4 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0862277 May 12 16:03:12.497043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3bfce73-9f18-4522-abda-0fc17855f6a7 req-09905ffe-b486-4b97-b5cf-03bceaa41424 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404537 May 12 16:03:12.521036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f5509d3-e483-45c4-87a0-42b3b2803ad0 req-d008f2b5-f986-4ca9-b7dc-f38ffb7b785b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:12.522486 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5f5509d3-e483-45c4-87a0-42b3b2803ad0 req-d008f2b5-f986-4ca9-b7dc-f38ffb7b785b service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1374316 May 12 16:03:12.621892 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5f5509d3-e483-45c4-87a0-42b3b2803ad0 req-9956401d-47f1-4cdb-8315-34bdfd84da03 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a HTTP/1.1" status: 200 len: 999 time: 0.0929501 May 12 16:03:12.631410 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4831aad1-b7c8-4ae3-b7fe-8750113153f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '6998d782-f9e2-4cb3-80a3-d55f6fa8888d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'floating_ip_address': '172.25.8.219', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'port_id': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 4150, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'mac_address': 'fa:16:3e:11:62:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:02:06Z', 'updated_at': '2022-05-12T16:03:11Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:03:12.635090 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4831aad1-b7c8-4ae3-b7fe-8750113153f5 None None] Checking router: cd523971-49e8-4deb-9f61-a0342aee2763 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:03:12.643415 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4831aad1-b7c8-4ae3-b7fe-8750113153f5 None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:03:12.643985 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4831aad1-b7c8-4ae3-b7fe-8750113153f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:02:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:03:12.686012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f5509d3-e483-45c4-87a0-42b3b2803ad0 req-116d8fb7-8d38-40b5-82c6-3592acdfbc6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:12.687425 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5f5509d3-e483-45c4-87a0-42b3b2803ad0 req-116d8fb7-8d38-40b5-82c6-3592acdfbc6b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0601592 May 12 16:03:12.762726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f5509d3-e483-45c4-87a0-42b3b2803ad0 req-e8313572-55fb-4c3c-a4b6-022f5533ebb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:12.764238 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5f5509d3-e483-45c4-87a0-42b3b2803ad0 req-e8313572-55fb-4c3c-a4b6-022f5533ebb5 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0708137 May 12 16:03:12.822819 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ab1cb6ce-7796-45f6-aa6d-86ab50b6be90 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:12.847475 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-4831aad1-b7c8-4ae3-b7fe-8750113153f5 None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:03:12.897423 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5f5509d3-e483-45c4-87a0-42b3b2803ad0 req-2eb612d7-fbf9-4e15-9a3d-62c4dc3bbe8e service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1271439 May 12 16:03:13.029408 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5f5509d3-e483-45c4-87a0-42b3b2803ad0 req-5704511e-6e3b-4202-b4da-84a302bdcc55 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1263773 May 12 16:03:13.188342 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-4831aad1-b7c8-4ae3-b7fe-8750113153f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '6998d782-f9e2-4cb3-80a3-d55f6fa8888d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'floating_ip_address': '172.25.8.219', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'port_id': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 4150, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'mac_address': 'fa:16:3e:11:62:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:02:06Z', 'updated_at': '2022-05-12T16:03:11Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:03:13.192399 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4831aad1-b7c8-4ae3-b7fe-8750113153f5 None None] The sync data for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 is: [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '6998d782-f9e2-4cb3-80a3-d55f6fa8888d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'floating_ip_address': '172.25.8.219', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'port_id': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 4150, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'mac_address': 'fa:16:3e:11:62:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:02:06Z', 'updated_at': '2022-05-12T16:03:11Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:03:13.376051 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-575202c5-c116-4fba-aceb-d061c63fd62f None None] New status for floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:03:13.640453 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:13.691022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-829e461e-9efc-4ecb-b689-0dfa86a45577 req-6b8762d1-7738-4905-8502-fe604f8bced7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:13.692497 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-829e461e-9efc-4ecb-b689-0dfa86a45577 req-6b8762d1-7738-4905-8502-fe604f8bced7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0887940 May 12 16:03:13.736077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-829e461e-9efc-4ecb-b689-0dfa86a45577 req-2b6ce799-e163-41f0-a39c-9e3405620e8c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379238 May 12 16:03:14.916235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-542150cc-dd90-450d-89df-35cf27f6156d req-cc248615-1960-4e88-bc5d-eae8a8c6ce72 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:14.917764 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-542150cc-dd90-450d-89df-35cf27f6156d req-cc248615-1960-4e88-bc5d-eae8a8c6ce72 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0792224 May 12 16:03:14.961203 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-542150cc-dd90-450d-89df-35cf27f6156d req-b08396cc-4055-4334-a034-e23baa08095f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378373 May 12 16:03:15.367319 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0a0859cb-fa7c-431c-be53-197ac1b70f30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:16.078469 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:16.146534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8100a8da-8d00-43f6-b071-05aff73e8afc req-10bd8733-3868-4087-adab-7ead407fcdfe tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:16.147956 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8100a8da-8d00-43f6-b071-05aff73e8afc req-10bd8733-3868-4087-adab-7ead407fcdfe tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0817730 May 12 16:03:16.192898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8100a8da-8d00-43f6-b071-05aff73e8afc req-6a6b0862-9cad-4353-ba46-7c6e7cc66375 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385125 May 12 16:03:16.347214 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:17.374344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f7028d7-4d78-4b53-899c-d03a82635b7a req-2e8a8513-a61f-4ca5-9a7e-06e7982dc6c0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:17.375776 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f7028d7-4d78-4b53-899c-d03a82635b7a req-2e8a8513-a61f-4ca5-9a7e-06e7982dc6c0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0783839 May 12 16:03:17.422013 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f7028d7-4d78-4b53-899c-d03a82635b7a req-e4375886-a6a1-4d4f-99d0-ed80054ee42d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406313 May 12 16:03:17.828036 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:18.610034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5807e5c4-1596-4038-8df5-5e2befafef6b req-9ad2be52-c3a5-4c32-9834-689659ffcfa6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:18.611445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5807e5c4-1596-4038-8df5-5e2befafef6b req-9ad2be52-c3a5-4c32-9834-689659ffcfa6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0847797 May 12 16:03:18.654936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5807e5c4-1596-4038-8df5-5e2befafef6b req-01397062-7cd3-44eb-b9ce-28e502c4600c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379739 May 12 16:03:19.847160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81dc1bc5-8325-4351-b6a5-b0a496a0d084 req-25cc57f0-ca54-4a17-a364-723f156c80f2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:19.848602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81dc1bc5-8325-4351-b6a5-b0a496a0d084 req-25cc57f0-ca54-4a17-a364-723f156c80f2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0848591 May 12 16:03:20.002776 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81dc1bc5-8325-4351-b6a5-b0a496a0d084 req-f43b0d0b-3c5d-4b99-b4eb-bdf1a9b6eb7e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1485569 May 12 16:03:21.183560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25f6b9c2-c81d-416c-bcd3-7eb84d5a9ca2 req-92996a5c-2655-40ac-ab46-e7ac180f43bd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:21.185055 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25f6b9c2-c81d-416c-bcd3-7eb84d5a9ca2 req-92996a5c-2655-40ac-ab46-e7ac180f43bd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0782437 May 12 16:03:21.228002 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25f6b9c2-c81d-416c-bcd3-7eb84d5a9ca2 req-54d6929f-6bd2-4b29-922a-6b7ad7d166c4 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371766 May 12 16:03:22.416965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb5a2050-1ebb-4d25-ad44-5853ad725487 req-02d4b8b8-d109-4c9a-b769-40ca64281b19 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:22.418328 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb5a2050-1ebb-4d25-ad44-5853ad725487 req-02d4b8b8-d109-4c9a-b769-40ca64281b19 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0826106 May 12 16:03:22.462213 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fb5a2050-1ebb-4d25-ad44-5853ad725487 req-94d14d94-5af4-4888-8896-055032500f65 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382664 May 12 16:03:23.648208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da935fb2-4168-4c2a-80c7-4b1814fbe624 req-5bc1fc45-acad-4e13-913c-f80f90b9ae93 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:23.649658 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da935fb2-4168-4c2a-80c7-4b1814fbe624 req-5bc1fc45-acad-4e13-913c-f80f90b9ae93 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0788283 May 12 16:03:23.697602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da935fb2-4168-4c2a-80c7-4b1814fbe624 req-47044719-578f-44d0-9991-c5b8fdfa48b5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415630 May 12 16:03:24.880618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5f9152-186d-4ad3-9061-6641709997a8 req-8bac852a-81ed-4971-b1f9-671ce68645d1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:24.882081 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5f9152-186d-4ad3-9061-6641709997a8 req-8bac852a-81ed-4971-b1f9-671ce68645d1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0788889 May 12 16:03:24.925433 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2e5f9152-186d-4ad3-9061-6641709997a8 req-d7b52f97-0adf-4411-9f24-c840da9b146e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377340 May 12 16:03:26.111303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c78eb43-c1eb-4b3c-8b0b-036ec23a4ea0 req-b71d2c0b-63b5-4441-84d2-86906db2cc22 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:26.112740 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c78eb43-c1eb-4b3c-8b0b-036ec23a4ea0 req-b71d2c0b-63b5-4441-84d2-86906db2cc22 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0825748 May 12 16:03:26.157222 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c78eb43-c1eb-4b3c-8b0b-036ec23a4ea0 req-deed0bbc-847f-4df5-a975-a6ddcc679445 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389159 May 12 16:03:27.341782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cbab177-d707-4922-9007-aeea73bf0e56 req-de66e645-1af5-4019-a086-d9bb4ad58321 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:27.343206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2cbab177-d707-4922-9007-aeea73bf0e56 req-de66e645-1af5-4019-a086-d9bb4ad58321 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0789115 May 12 16:03:27.386559 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2cbab177-d707-4922-9007-aeea73bf0e56 req-e65a42d3-4800-44d5-bb29-3d59270a8424 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376360 May 12 16:03:28.573343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2985bc5-f803-4470-aebf-48c875f7045d req-3894bf0c-314f-4ce5-85aa-dfdfaba37740 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:28.574939 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2985bc5-f803-4470-aebf-48c875f7045d req-3894bf0c-314f-4ce5-85aa-dfdfaba37740 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0823598 May 12 16:03:28.616888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2985bc5-f803-4470-aebf-48c875f7045d req-577e73ba-f8b1-4bd4-863b-b5f3bb2bfe5d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0364118 May 12 16:03:29.802770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9f09729-f9d7-414c-bbcc-72de4cf4763d req-160908e4-c2e6-48b1-bd2c-31592acab9b6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:29.804181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9f09729-f9d7-414c-bbcc-72de4cf4763d req-160908e4-c2e6-48b1-bd2c-31592acab9b6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0776749 May 12 16:03:29.852888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e9f09729-f9d7-414c-bbcc-72de4cf4763d req-89d307fa-cb32-4512-b107-41d90c4bb151 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429265 May 12 16:03:31.034633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57aab10-b713-4e91-908f-f3d4506b61b6 req-8189a9fe-ab29-4154-bea3-e1c376be62fa tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:31.036070 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b57aab10-b713-4e91-908f-f3d4506b61b6 req-8189a9fe-ab29-4154-bea3-e1c376be62fa tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0806735 May 12 16:03:31.080172 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b57aab10-b713-4e91-908f-f3d4506b61b6 req-47339822-037f-44c6-aed3-198bf4fdb6dd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385771 May 12 16:03:32.270457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8b1a082-2079-4341-9970-0d9f12645c8a req-606649ae-ee88-4b2c-aca6-cce84bdb8ee2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:32.271908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e8b1a082-2079-4341-9970-0d9f12645c8a req-606649ae-ee88-4b2c-aca6-cce84bdb8ee2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0873625 May 12 16:03:32.317328 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e8b1a082-2079-4341-9970-0d9f12645c8a req-5c3f0f7e-891c-451f-8f9b-8a3badd288b5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390332 May 12 16:03:32.776763 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:33.502080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e460dd-e5ab-4ae3-a601-3b9f6fad657d req-474f4e3f-c2e7-4c4b-8c46-5ec46d739a30 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:33.503525 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3e460dd-e5ab-4ae3-a601-3b9f6fad657d req-474f4e3f-c2e7-4c4b-8c46-5ec46d739a30 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0799158 May 12 16:03:33.546458 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3e460dd-e5ab-4ae3-a601-3b9f6fad657d req-ebc7ede1-e247-499e-a14f-ebdc3e3d7023 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373492 May 12 16:03:34.735341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6a3ad2f-14df-48e8-bfd9-e6ec8e004c1b req-a2a39d1d-a4b3-4797-b17f-320135aece24 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:34.736789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6a3ad2f-14df-48e8-bfd9-e6ec8e004c1b req-a2a39d1d-a4b3-4797-b17f-320135aece24 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0833559 May 12 16:03:34.780175 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6a3ad2f-14df-48e8-bfd9-e6ec8e004c1b req-02155980-7b9e-4fe6-98cc-07017738bf9b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377414 May 12 16:03:35.961840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a80e30d-2aaf-42eb-bd50-ba53d7f4447d req-782309fb-bcb9-4d14-a14c-7ec069a67d65 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:35.963282 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a80e30d-2aaf-42eb-bd50-ba53d7f4447d req-782309fb-bcb9-4d14-a14c-7ec069a67d65 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0797498 May 12 16:03:36.007678 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a80e30d-2aaf-42eb-bd50-ba53d7f4447d req-1d490c8b-0ff7-4b6f-9222-c81a3e5ca5b6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378530 May 12 16:03:37.195665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92b20a4-23fb-49e2-bf3c-99b6c7e657a3 req-69100a28-7408-4e20-b6db-cb192f9e651b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:37.197103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a92b20a4-23fb-49e2-bf3c-99b6c7e657a3 req-69100a28-7408-4e20-b6db-cb192f9e651b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0832353 May 12 16:03:37.244066 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a92b20a4-23fb-49e2-bf3c-99b6c7e657a3 req-2d913fb4-5077-4262-864b-e962ce69603a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409973 May 12 16:03:38.428933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4291a127-3e3b-4d2e-9df1-aea82e92a687 req-4fd2f31c-28f4-4fc3-bbdf-1411bbba01dd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:38.430296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4291a127-3e3b-4d2e-9df1-aea82e92a687 req-4fd2f31c-28f4-4fc3-bbdf-1411bbba01dd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0799305 May 12 16:03:38.478321 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4291a127-3e3b-4d2e-9df1-aea82e92a687 req-7a243641-b995-41ea-9261-e0c153ce5ba8 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411785 May 12 16:03:38.936330 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffa484f0-0eb5-4712-a3ca-b2c74767da50 req-74f8962b-9bd6-47e8-9b85-ab1fb55b7056 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:38.937896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ffa484f0-0eb5-4712-a3ca-b2c74767da50 req-74f8962b-9bd6-47e8-9b85-ab1fb55b7056 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.1383622 May 12 16:03:38.940793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-f97bf4fd-2745-4928-a6fc-c0f85afb15d0 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1505961 May 12 16:03:38.981483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ffa484f0-0eb5-4712-a3ca-b2c74767da50 req-9bf628af-834f-4a0e-9f9b-e8fe8a34c631 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378683 May 12 16:03:40.082784 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-b67f8799-c95a-4b16-bb9b-f4e78a67442e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:40.084250 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-b67f8799-c95a-4b16-bb9b-f4e78a67442e service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 1096 time: 0.0753024 May 12 16:03:40.172386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60e70f09-5240-47c2-83fc-1bacfbd4e5cd req-ecbca4c5-7487-4915-ad72-fac6853d7adc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:40.174298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60e70f09-5240-47c2-83fc-1bacfbd4e5cd req-ecbca4c5-7487-4915-ad72-fac6853d7adc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0823426 May 12 16:03:40.219717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60e70f09-5240-47c2-83fc-1bacfbd4e5cd req-5037b70d-c936-4c80-ab1f-cbb856b4e319 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401764 May 12 16:03:40.330176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-d49ee890-efdd-42d3-9daa-92323661118c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:40.331608 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-d49ee890-efdd-42d3-9daa-92323661118c service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2378273 May 12 16:03:40.438442 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-dc8db428-2dc9-44ef-9b50-dfb3aa71b514 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a HTTP/1.1" status: 200 len: 1001 time: 0.0962267 May 12 16:03:40.503692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-1de59451-a005-421f-9325-e957a3ced1e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:40.505110 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-1de59451-a005-421f-9325-e957a3ced1e0 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0575404 May 12 16:03:40.587853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-51cd1adc-113a-439e-9830-73ced16a935c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:40.589219 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-51cd1adc-113a-439e-9830-73ced16a935c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0751772 May 12 16:03:40.728616 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-1d577eec-2916-4054-96dc-8885d5012ca7 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1293242 May 12 16:03:40.875053 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-5cec4d20-eab0-4b89-9133-ff31f3a28102 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1312039 May 12 16:03:41.408460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddb48822-fbed-4d30-867e-db04edef6926 req-aff6131e-006c-41e5-b3db-f9454050b2bd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:41.409917 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ddb48822-fbed-4d30-867e-db04edef6926 req-aff6131e-006c-41e5-b3db-f9454050b2bd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0837965 May 12 16:03:41.454612 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ddb48822-fbed-4d30-867e-db04edef6926 req-ead289d3-c070-43df-a8a6-a7e4b019bc6e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390944 May 12 16:03:42.642304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c52cb833-580a-4aa2-879b-918dd7fdd078 req-1edd3ea0-29dc-4ab6-9382-979a132038c9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:42.643737 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c52cb833-580a-4aa2-879b-918dd7fdd078 req-1edd3ea0-29dc-4ab6-9382-979a132038c9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0799785 May 12 16:03:42.691162 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c52cb833-580a-4aa2-879b-918dd7fdd078 req-2741c232-abac-4367-adcc-bec710557ba3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419080 May 12 16:03:42.830562 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-54c71285-3681-422f-85e6-6b9e4457d8da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:43.071267 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-37a2cc91-0726-4d76-9a68-34a4b9c2e8aa service neutron] show failed (client error): The resource could not be found. May 12 16:03:43.072223 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-37a2cc91-0726-4d76-9a68-34a4b9c2e8aa service neutron] 10.222.0.84 "GET /v2.0/ports/babb56a1-eab0-42f6-9b7e-b0166b4b1a7a/bindings/n-h2-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.0730846 May 12 16:03:43.346072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-9b2850da-d748-486f-8526-134d4d9972a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:43.347529 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-9b2850da-d748-486f-8526-134d4d9972a9 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931&tenant_id=22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 1096 time: 0.0718753 May 12 16:03:43.357857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:03:43.468540 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:43.586083 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:43.737959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] For port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:03:43.767779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] For port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:03:43.825841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:03:43.833189 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:43.851808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Transition to ACTIVE for port object babb56a1-eab0-42f6-9b7e-b0166b4b1a7a will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:03:43.855774 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:43.879466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f55ee72-0b90-43f9-bc38-035a63f09dd9 req-98b0ed9b-494f-44bb-b08d-dc84c6204e8b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:43.881264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f55ee72-0b90-43f9-bc38-035a63f09dd9 req-98b0ed9b-494f-44bb-b08d-dc84c6204e8b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0846701 May 12 16:03:43.899460 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-beff9c49-5ec8-47f7-bdb2-75e5254d3161'] response: {'server_uuid': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a', 'code': 200} May 12 16:03:43.928410 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6f55ee72-0b90-43f9-bc38-035a63f09dd9 req-ad6f4306-338b-46f1-8dab-7f3aa7c60c49 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404932 May 12 16:03:44.017346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Pushing event updated for resources: {'Port': ['ID=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,revision_number=6']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:03:44.064135 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] No DVR routers for this DVR port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:03:44.394881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Attempting to bind port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:03:44.395572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Attempting to bind port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:03:44.395572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Attempting to bind port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:03:44.399864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a on network 9475b307-5f43-40f6-b384-65417948d75d not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:03:44.400175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Attempting to bind port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:03:44.405470 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 3, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:03:44.405795 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Checking segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:03:44.406168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Bound using segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:03:44.406581 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Bound port: babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:03:44.406912 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:44.496063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] For port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:03:44.499850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] For port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:03:44.503190 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:44.560509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:44.561779 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:44.563141 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] 10.222.0.76 "PUT /v2.0/ports/babb56a1-eab0-42f6-9b7e-b0166b4b1a7a HTTP/1.1" status: 200 len: 1091 time: 1.2091250 May 12 16:03:44.580245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fbb918a-0d68-4f98-aa0d-0d722ecc5b07 service neutron] Pushing event updated for resources: {'Port': ['ID=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,revision_number=7']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:03:44.665308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-b61b298d-b233-4bbb-b7f6-468fab164cbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:44.666852 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-b61b298d-b233-4bbb-b7f6-468fab164cbe service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 1094 time: 0.0767882 May 12 16:03:44.800494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-8ee0ccf7-1d9a-4262-8347-4b50592c9950 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:44.801936 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-8ee0ccf7-1d9a-4262-8347-4b50592c9950 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1290839 May 12 16:03:44.901588 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-479a685b-727d-4907-b205-d919f6f958c8 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a HTTP/1.1" status: 200 len: 999 time: 0.0914454 May 12 16:03:44.968227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-8b3fbe23-cae3-45b7-8e00-a98b01dd7440 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:44.969496 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-8b3fbe23-cae3-45b7-8e00-a98b01dd7440 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0609031 May 12 16:03:45.047315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-ec271fab-4c37-4593-8e19-6cc20f2c1ef2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:45.048787 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-ec271fab-4c37-4593-8e19-6cc20f2c1ef2 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0736034 May 12 16:03:45.124237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d24247f-e0ea-4933-8e26-4cee10f523d4 req-2e1a308d-e77f-484c-aff5-75b973582de0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:45.125703 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d24247f-e0ea-4933-8e26-4cee10f523d4 req-2e1a308d-e77f-484c-aff5-75b973582de0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 943 time: 0.0840304 May 12 16:03:45.168864 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d24247f-e0ea-4933-8e26-4cee10f523d4 req-0b3a0f70-9107-432e-b82d-ee335579ce48 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373898 May 12 16:03:45.187728 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-b5e5d77c-fda3-44ee-b36f-eeb09acb7a72 service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1322074 May 12 16:03:45.333830 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-95f1b6cd-c0df-495b-bd40-b3774e991342 req-a9909e95-15f6-44a1-855e-db5bfba4f30a service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1391525 May 12 16:03:45.367643 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b105f19a-c1db-4e03-89ae-a16c39be172d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:45.900736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'tag': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:03:45.958260 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fd7702d3-ff2d-4727-a5ce-94f1c4849a92'] response: {'name': 'network-changed', 'server_uuid': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'tag': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a', 'status': 'completed', 'code': 200} May 12 16:03:46.081810 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:46.113359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-e14f56bb-f53f-4326-81fd-9a5236e6a92f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:46.114846 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-e14f56bb-f53f-4326-81fd-9a5236e6a92f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 1094 time: 0.1380720 May 12 16:03:46.119718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-667eca71-d17e-4bf5-8b54-270e0eef929f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:46.121042 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-667eca71-d17e-4bf5-8b54-270e0eef929f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 1094 time: 0.1026337 May 12 16:03:46.352108 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:46.361433 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cadfb77-ea6b-411f-8d46-8c071851129c req-3b9556db-0c3b-4e49-bce3-853543e3bbe9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:46.363013 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5cadfb77-ea6b-411f-8d46-8c071851129c req-3b9556db-0c3b-4e49-bce3-853543e3bbe9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 943 time: 0.0855820 May 12 16:03:46.364737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-ac204856-64e1-4e3b-aecc-951c1e47a9c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:46.366197 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-ac204856-64e1-4e3b-aecc-951c1e47a9c4 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2442999 May 12 16:03:46.370468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-1a56d2c4-01c0-4c32-9928-1fc4d637c550 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:46.371776 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-1a56d2c4-01c0-4c32-9928-1fc4d637c550 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2299259 May 12 16:03:46.408081 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5cadfb77-ea6b-411f-8d46-8c071851129c req-e275294e-b79f-4611-9ab0-9eff98c6b4f7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387964 May 12 16:03:46.677674 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-d85460c4-0e68-42b8-b906-eae4912fe57d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a HTTP/1.1" status: 200 len: 999 time: 0.3048601 May 12 16:03:46.679325 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-f5cd8660-0148-47b9-b27a-75271590833c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a HTTP/1.1" status: 200 len: 999 time: 0.2499888 May 12 16:03:46.795785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-f1005d70-cbdc-4fa0-ae66-42804e0a215b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:46.797211 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-f1005d70-cbdc-4fa0-ae66-42804e0a215b service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.1124666 May 12 16:03:46.798609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-42d7ff3a-613b-478c-993a-db76ccaa650f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:46.799880 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-42d7ff3a-613b-478c-993a-db76ccaa650f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.1139433 May 12 16:03:46.933213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-c68a2284-b022-4ce6-9e21-89e0a348b0fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:46.934634 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-c68a2284-b022-4ce6-9e21-89e0a348b0fa service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1020114 May 12 16:03:46.937234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-672db57f-23a1-48e2-b491-ed2d8f48c003 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:46.938608 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-672db57f-23a1-48e2-b491-ed2d8f48c003 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1358316 May 12 16:03:46.969794 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:03:47.176681 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-9f666660-bb2a-4316-8b72-904facd4aeec service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2317035 May 12 16:03:47.181554 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-d79ca752-8464-4f8a-8950-bb1ea1e44e88 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2162137 May 12 16:03:47.414110 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-de9fb632-78b2-4a17-b903-a445b3a4d317 service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2309518 May 12 16:03:47.417053 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4232d3e-a2d7-49a0-817a-378733be9f42 req-ca119cd2-e633-471c-b6e4-95031d804be6 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2143912 May 12 16:03:47.696866 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6faa288f-d836-471f-b593-d6d196fb8013 req-c7f0e272-c34c-4c17-bbe1-d8f66d2e5fca tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:47.698240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6faa288f-d836-471f-b593-d6d196fb8013 req-c7f0e272-c34c-4c17-bbe1-d8f66d2e5fca tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 943 time: 0.1796939 May 12 16:03:47.742202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6faa288f-d836-471f-b593-d6d196fb8013 req-43b2c903-c6be-43f8-83e7-9c25a17fc47d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373747 May 12 16:03:47.831443 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:48.058786 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6acf2b9c-c6f1-4aec-a74d-5cf5528d206b req-670a4cd1-255b-421a-b4ba-c637694e8194 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:48.060231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6acf2b9c-c6f1-4aec-a74d-5cf5528d206b req-670a4cd1-255b-421a-b4ba-c637694e8194 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 943 time: 0.0887702 May 12 16:03:48.086419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-5bde6f44-9336-49c6-9d65-f9309c563007 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:48.087103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-5bde6f44-9336-49c6-9d65-f9309c563007 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Synchronizing usage tracker for tenant:22f425833dc74d6b985912b8d7db7222 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:03:48.102920 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-5bde6f44-9336-49c6-9d65-f9309c563007 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Unset dirty status for tenant:22f425833dc74d6b985912b8d7db7222 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:03:48.104264 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-5bde6f44-9336-49c6-9d65-f9309c563007 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931&tenant_id=22f425833dc74d6b985912b8d7db7222&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 943 time: 0.0996866 May 12 16:03:48.108565 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6acf2b9c-c6f1-4aec-a74d-5cf5528d206b req-3d7f4522-8d2d-4741-be72-73918b8eed55 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415149 May 12 16:03:48.188190 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-28ff3eea-381b-48f8-a175-5ca57c8ef849 service neutron] delete failed (client error): The resource could not be found. May 12 16:03:48.189153 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-28ff3eea-381b-48f8-a175-5ca57c8ef849 service neutron] 10.222.0.84 "DELETE /v2.0/ports/babb56a1-eab0-42f6-9b7e-b0166b4b1a7a/bindings/n-h1-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.0763381 May 12 16:03:48.331286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device babb56a1-eab0-42f6-9b7e-b0166b4b1a7a no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:03:48.359469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-5eda8b77-230b-4328-9d8a-5f3e02cfe642 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:48.360915 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-5eda8b77-230b-4328-9d8a-5f3e02cfe642 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 1094 time: 0.0711744 May 12 16:03:48.388054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device babb56a1-eab0-42f6-9b7e-b0166b4b1a7a not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:03:48.494759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-33ac7512-fb8d-4952-b92d-e08ac577343c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:48.496156 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-33ac7512-fb8d-4952-b92d-e08ac577343c service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1247990 May 12 16:03:48.600344 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-8a7645a3-2c57-4ff5-b3ba-9be5b7f2e7c2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a HTTP/1.1" status: 200 len: 999 time: 0.0945177 May 12 16:03:48.663216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-a43c4651-7729-4d48-b4d9-fc608a17b012 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:48.664577 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-a43c4651-7729-4d48-b4d9-fc608a17b012 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0554574 May 12 16:03:48.745958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-bc90ee42-e250-43d2-b84f-abfe93f80ea9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:48.747417 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-bc90ee42-e250-43d2-b84f-abfe93f80ea9 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0737984 May 12 16:03:48.999537 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-67791813-ef4d-44e1-acda-15e756517a11 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2423847 May 12 16:03:49.135336 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-53afdc21-8d51-4a99-afa0-719c78c71395 req-5f1581db-c56e-4144-81fd-f884f09adff3 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1255352 May 12 16:03:49.304329 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-966e8a18-bc44-4fe9-889e-c2abe637f901 req-3635c512-3429-4b10-9901-860b67df4bbe tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:49.305782 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-966e8a18-bc44-4fe9-889e-c2abe637f901 req-3635c512-3429-4b10-9901-860b67df4bbe tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 943 time: 0.0858712 May 12 16:03:49.351568 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-966e8a18-bc44-4fe9-889e-c2abe637f901 req-7f868c6b-971b-4ccf-b363-638827cfb587 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388219 May 12 16:03:50.048975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device babb56a1-eab0-42f6-9b7e-b0166b4b1a7a details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:03:50.178206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:03:50.191539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'port_id': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a', 'mac_address': 'fa:16:3e:11:62:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 595, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:03:50.252060 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:50.269017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id babb56a1-eab0-42f6-9b7e-b0166b4b1a7a {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:03:50.284654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:03:50.288654 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:50.353033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:03:50.525352 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['babb56a1-eab0-42f6-9b7e-b0166b4b1a7a'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:03:50.541326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598231e9-78d1-4eb7-9562-14eea5b5019a req-51cb4a10-acf1-47ae-bc31-14039d1e4ac3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:50.543033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-598231e9-78d1-4eb7-9562-14eea5b5019a req-51cb4a10-acf1-47ae-bc31-14039d1e4ac3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 944 time: 0.0849459 May 12 16:03:50.587916 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-598231e9-78d1-4eb7-9562-14eea5b5019a req-d7c364d2-cb4d-43d6-9108-285183ef4fc7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382800 May 12 16:03:50.775155 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba8a9c23-fd3f-44e9-bfd2-3e4e578be9b2 req-07bb464a-2873-4073-aa1b-6302eb84ef1c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:50.776576 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba8a9c23-fd3f-44e9-bfd2-3e4e578be9b2 req-07bb464a-2873-4073-aa1b-6302eb84ef1c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 944 time: 0.0802677 May 12 16:03:50.821134 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba8a9c23-fd3f-44e9-bfd2-3e4e578be9b2 req-fdfc14c3-a91d-4e67-aa00-b1242f34d46c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376034 May 12 16:03:51.157662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f49221fb-63c7-4291-8a2a-759bb6c18f7a req-678ccc84-e096-4fef-a566-8e00e8423a57 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:51.159167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f49221fb-63c7-4291-8a2a-759bb6c18f7a req-678ccc84-e096-4fef-a566-8e00e8423a57 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 944 time: 0.0876911 May 12 16:03:51.194961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86479146-9633-433d-9873-783027695a68 req-4c8af1a2-37db-4e30-9698-5c1c95d907cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:51.196348 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-86479146-9633-433d-9873-783027695a68 req-4c8af1a2-37db-4e30-9698-5c1c95d907cf service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 1095 time: 0.0718391 May 12 16:03:51.204441 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f49221fb-63c7-4291-8a2a-759bb6c18f7a req-0b21d333-79e6-4101-b42b-6d25c61befbb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397019 May 12 16:03:51.327885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86479146-9633-433d-9873-783027695a68 req-cc4212f4-3d53-410b-ab30-a4ded832ebfd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:51.329306 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-86479146-9633-433d-9873-783027695a68 req-cc4212f4-3d53-410b-ab30-a4ded832ebfd service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1265883 May 12 16:03:51.431017 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-86479146-9633-433d-9873-783027695a68 req-d66caea3-dfc3-4686-b5f1-8d8080ed16f1 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a HTTP/1.1" status: 200 len: 1000 time: 0.0952795 May 12 16:03:51.491351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86479146-9633-433d-9873-783027695a68 req-bf325472-c256-499a-a83b-7a770b2ec346 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:51.492741 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-86479146-9633-433d-9873-783027695a68 req-bf325472-c256-499a-a83b-7a770b2ec346 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0559545 May 12 16:03:51.568128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86479146-9633-433d-9873-783027695a68 req-90453886-f815-4031-a966-416fe28f7007 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:51.569566 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-86479146-9633-433d-9873-783027695a68 req-90453886-f815-4031-a966-416fe28f7007 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0714209 May 12 16:03:51.698191 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-86479146-9633-433d-9873-783027695a68 req-a2597bb3-fcd8-449c-af20-e943a7d7803e service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1220086 May 12 16:03:51.827148 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-86479146-9633-433d-9873-783027695a68 req-7d650597-ea18-4148-9d5f-d66645052123 service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1224797 May 12 16:03:52.049263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device babb56a1-eab0-42f6-9b7e-b0166b4b1a7a up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:03:52.115448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:03:52.120017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:03:52.120380 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:52.236521 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:52.266251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:03:52.277571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:03:52.292920 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:52.335846 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2e9711ed-64bd-466a-a803-d61da4efbfc0'] response: {'server_uuid': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a', 'code': 200} May 12 16:03:52.373977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:03:52.446195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4db242d9-6006-4564-9406-91ed672bd394 req-e6a00bc8-1565-4a09-b61f-3ab8039ba290 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:52.447651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4db242d9-6006-4564-9406-91ed672bd394 req-e6a00bc8-1565-4a09-b61f-3ab8039ba290 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0873008 May 12 16:03:52.495535 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4db242d9-6006-4564-9406-91ed672bd394 req-0c92ac17-9c45-4e45-819d-5e88812987fc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419736 May 12 16:03:53.681886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e31cb330-3d39-4755-b119-5505359ef262 req-5a3fa6df-9774-4ed5-942e-a211321bee08 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:53.683298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e31cb330-3d39-4755-b119-5505359ef262 req-5a3fa6df-9774-4ed5-942e-a211321bee08 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0791304 May 12 16:03:53.727515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e31cb330-3d39-4755-b119-5505359ef262 req-81d4956c-eafe-4416-a71c-9ca1aefa8959 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375311 May 12 16:03:54.101132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-271818e4-1f30-4e8e-b497-9cbd026e5dc6 req-7b0b1cf4-4e3e-42de-82ef-687ef5e4cbc1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:54.102481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-271818e4-1f30-4e8e-b497-9cbd026e5dc6 req-7b0b1cf4-4e3e-42de-82ef-687ef5e4cbc1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0821788 May 12 16:03:54.146753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-271818e4-1f30-4e8e-b497-9cbd026e5dc6 req-9693f4f7-023c-47ab-801a-2f0e1c274237 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380218 May 12 16:03:55.297237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-35a00284-fa7c-437c-b9ac-fe8decfabdb6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:55.298740 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-35a00284-fa7c-437c-b9ac-fe8decfabdb6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.76 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0856140 May 12 16:03:55.331740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3be5f571-e2ea-4b98-b1a6-76c145378fe8 req-7ddebcc8-622e-41ca-a21e-16d9dcd084b9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:55.333206 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3be5f571-e2ea-4b98-b1a6-76c145378fe8 req-7ddebcc8-622e-41ca-a21e-16d9dcd084b9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 945 time: 0.0804627 May 12 16:03:55.371522 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Deleting port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:03:55.371866 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:55.378271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3be5f571-e2ea-4b98-b1a6-76c145378fe8 req-ee7aa622-af89-407f-b0fd-819fe0bafdff tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393705 May 12 16:03:55.614832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] For port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:03:55.615188 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:56.015365 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:56.015727 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:56.016037 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d disassociated. External IP: 172.25.8.219, port: babb56a1-eab0-42f6-9b7e-b0166b4b1a7a. May 12 16:03:56.016373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Calling delete_port for babb56a1-eab0-42f6-9b7e-b0166b4b1a7a owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:03:56.160237 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:56.208373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event deleted for resources: {'Port': ['ID=babb56a1-eab0-42f6-9b7e-b0166b4b1a7a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:03:56.224942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:03:56.225276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:03:56.225637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:03:56.225972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:03:56.226302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:03:56.226628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:03:56.226950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:03:56.227273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:03:56.227579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:03:56.227985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:03:56.228293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:03:56.228578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:03:56.421371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Router cd523971-49e8-4deb-9f61-a0342aee2763 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:03:56.528794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ed41391-a7e4-4720-8389-9169410e0b1b req-65f36c77-7841-48a6-852c-67c1c75cb021 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=de0b3544-a105-4eb3-b4c1-649bfc010931 HTTP/1.1" status: 200 len: 210 time: 0.0458410 May 12 16:03:56.602893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:03:56.613774 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d505a06c-2660-4480-952b-0a3e4d601612 None None] Sync routers for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:03:56.623679 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d505a06c-2660-4480-952b-0a3e4d601612 None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:03:56.624334 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d505a06c-2660-4480-952b-0a3e4d601612 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:03:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:03:56.675236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] No DVR routers for this DVR port babb56a1-eab0-42f6-9b7e-b0166b4b1a7a on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:03:56.677825 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:03:56.681503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'name': 'network-vif-deleted', 'tag': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:03:56.698687 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-626c7e6d-4ada-421a-93d8-f4a9d38cf5c1 req-25f0f41d-0066-479e-9b86-4e77a712becb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.76 "DELETE /v2.0/ports/babb56a1-eab0-42f6-9b7e-b0166b4b1a7a HTTP/1.1" status: 204 len: 173 time: 1.3947153 May 12 16:03:56.729652 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-48b95a0a-e162-4fc2-86f1-915972c101e3'] response: {'server_uuid': 'de0b3544-a105-4eb3-b4c1-649bfc010931', 'name': 'network-vif-deleted', 'tag': 'babb56a1-eab0-42f6-9b7e-b0166b4b1a7a', 'status': 'completed', 'code': 200} May 12 16:03:56.813644 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d505a06c-2660-4480-952b-0a3e4d601612 None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:03:57.134047 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d505a06c-2660-4480-952b-0a3e4d601612 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:03:57.137669 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d505a06c-2660-4480-952b-0a3e4d601612 None None] Checking router: cd523971-49e8-4deb-9f61-a0342aee2763 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:03:57.146742 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d505a06c-2660-4480-952b-0a3e4d601612 None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:03:57.147323 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d505a06c-2660-4480-952b-0a3e4d601612 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:03:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:03:57.327827 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d505a06c-2660-4480-952b-0a3e4d601612 None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:03:57.674687 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d505a06c-2660-4480-952b-0a3e4d601612 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:03:57.678625 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d505a06c-2660-4480-952b-0a3e4d601612 None None] The sync data for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 is: [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:03:57.872044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-60cb2a3d-36eb-4ff2-b0b1-f5ca63eb8f1d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1087207809&fields=id&tenant_id=22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 267 time: 0.0417078 May 12 16:03:57.898266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2b24ff9-b73d-4132-b94d-f0cbab8332fc None None] New status for floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:03:58.028458 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-feef6aae-e983-4694-a8ce-661b1b6becca tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:58.030704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-feef6aae-e983-4694-a8ce-661b1b6becca tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 812 time: 0.1512601 May 12 16:03:58.046050 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-2cf1a61d-e515-4d72-a551-d36fd2f9fbe3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/quotas/22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 375 time: 0.0098655 May 12 16:03:58.132514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device babb56a1-eab0-42f6-9b7e-b0166b4b1a7a no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:03:58.137676 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-dd31812c-7326-49ae-8538-e3d93ea13515 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0863538 May 12 16:03:58.177657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: babb56a1-eab0-42f6-9b7e-b0166b4b1a7a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:03:58.178026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device babb56a1-eab0-42f6-9b7e-b0166b4b1a7a not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:03:58.386077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-a8e27618-b30e-4801-8b8b-21d4a2ebdc5d service neutron] 10.222.0.82 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1890585 May 12 16:03:58.525161 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-d4f429ca-2615-4c0a-8ea9-67a3212d6a0b service neutron] 10.222.0.82 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1324358 May 12 16:03:58.734677 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b0c06586-c053-4487-914e-bf31047851b5 req-b714bdc2-473e-4d50-9df4-5e08ac793941 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 210 time: 0.0603137 May 12 16:03:59.901431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2ba005ff-f1e2-4fb2-9a93-6134eb4879cd req-b4921098-fd1a-4ed9-b53d-e2e0e8ff1d66 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 210 time: 0.0574446 May 12 16:03:59.955405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-c6a2034d-bd4c-4e57-8e9a-016dcf467411 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:03:59.956833 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-c6a2034d-bd4c-4e57-8e9a-016dcf467411 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 812 time: 0.1604638 May 12 16:04:00.026405 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-752a4834-6dbd-4110-95ec-a9307d838a5c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 380 time: 0.0472744 May 12 16:04:00.037985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Request body: {'port': {'device_id': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'admin_state_up': True, 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'security_groups': ['3aebfd3b-72ff-4972-bf89-463e07cfaf27']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:04:00.175194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:04:00.179274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Usage tracker for resource:port and tenant:22f425833dc74d6b985912b8d7db7222 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:04:00.182127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:04:00.187930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:04:00.197557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Made reservation on behalf of 22f425833dc74d6b985912b8d7db7222 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:04:00.202356 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:00.382972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Allocated IP 172.20.0.14 (9475b307-5f43-40f6-b384-65417948d75d/d0bd473b-b60e-4879-b8b8-94c3dfcc17c8/32cd03c9-4d72-4ba1-9597-c26b892c4ce4) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:04:00.571960 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:00.590700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Transition to ACTIVE for port object 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:04:00.613749 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:00.681854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Network 9475b307-5f43-40f6-b384-65417948d75d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:04:00.684705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:04:00.689365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:04:00.726171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event updated for resources: {'Port': ['ID=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:04:00.761729 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:00.762356 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:00.787073 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-f487fb80-4447-46ca-95e6-faacfbddafda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7523952 May 12 16:04:00.808474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Request body: {'port': {'device_id': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:04:00.954226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-eac2122e-6148-4605-a458-4da44d37814d None None] Provisioning for port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:04:01.024196 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-eac2122e-6148-4605-a458-4da44d37814d None None] Provisioning complete for port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:04:01.024568 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-eac2122e-6148-4605-a458-4da44d37814d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:01.031812 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:01.096178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-eac2122e-6148-4605-a458-4da44d37814d None None] Port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:04:01.099478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d31b059-ceb4-41c4-9d41-5b800acfaed4 req-b06b6dd0-c646-4b3c-b42d-0c34507f0c5c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:01.102086 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d31b059-ceb4-41c4-9d41-5b800acfaed4 req-b06b6dd0-c646-4b3c-b42d-0c34507f0c5c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 932 time: 0.0845716 May 12 16:04:01.151786 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d31b059-ceb4-41c4-9d41-5b800acfaed4 req-5077b297-7816-43f2-b521-7b7a63031d7d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431247 May 12 16:04:01.388209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:04:01.395711 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:01.409980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Transition to ACTIVE for port object 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:04:01.413439 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:01.568797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Pushing event updated for resources: {'Port': ['ID=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:04:01.653442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Attempting to bind port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:04:01.653702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Attempting to bind port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:04:01.654029 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Attempting to bind port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:04:01.661928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on network 9475b307-5f43-40f6-b384-65417948d75d not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:04:01.662250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Attempting to bind port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:04:01.667349 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 3, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:04:01.667686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Checking segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:04:01.671346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Bound using segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:04:01.671781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Bound port: 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:04:01.672138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:01.766276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:04:01.769083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:04:01.773686 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:01.838473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:01.839084 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:01.840454 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] 10.222.0.84 "PUT /v2.0/ports/32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 1092 time: 1.0362542 May 12 16:04:01.840892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'tag': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:04:01.867760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66b81ab9-eb86-4033-8a92-82c6bf9338a0 service neutron] Pushing event updated for resources: {'Port': ['ID=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:04:01.890419 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3fd8e67d-7ea7-4c96-8487-53a6feed3a67'] response: {'name': 'network-changed', 'server_uuid': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'tag': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'status': 'completed', 'code': 200} May 12 16:04:02.004693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-cd7726a7-cbcf-4504-af6e-fa3ad95be6d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:02.006465 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-cd7726a7-cbcf-4504-af6e-fa3ad95be6d4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 1095 time: 0.0988150 May 12 16:04:02.094375 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-ca792f11-b5f7-4d12-ba9a-3eb94996840d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 217 time: 0.0676439 May 12 16:04:02.159024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-bb4d2a67-16be-44bf-b859-0f3c5c3199a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:02.160329 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-bb4d2a67-16be-44bf-b859-0f3c5c3199a9 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0568600 May 12 16:04:02.243430 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-d4029ce0-5d87-43d6-8a49-26226a77f20a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:02.245053 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-d4029ce0-5d87-43d6-8a49-26226a77f20a service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0755527 May 12 16:04:02.341290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5475aab-67dd-4fc3-b1b2-6e8bdf211726 req-d2abaded-9b19-4d02-b3d9-7f5c3d65d6ec tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:02.343381 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5475aab-67dd-4fc3-b1b2-6e8bdf211726 req-d2abaded-9b19-4d02-b3d9-7f5c3d65d6ec tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 944 time: 0.0847728 May 12 16:04:02.387079 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5475aab-67dd-4fc3-b1b2-6e8bdf211726 req-3f6f063c-dd1a-46d7-bc07-d382be7d2255 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376978 May 12 16:04:02.396660 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-3c14a12a-83b2-41f6-8d9d-d46d902d3d5f service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1426220 May 12 16:04:02.532245 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0abaf39d-b45e-49fa-b824-e4a1d8fdc8e2 req-46ccd43e-da44-44da-bb5d-d27200b270b9 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1254592 May 12 16:04:02.694833 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dc9ddef-aa15-4b38-8693-fc34abd8d423 req-a5538a78-5eaa-438a-b55f-aabb48dea8c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:02.696271 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4dc9ddef-aa15-4b38-8693-fc34abd8d423 req-a5538a78-5eaa-438a-b55f-aabb48dea8c3 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 1095 time: 0.0704920 May 12 16:04:02.782425 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:02.947612 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dc9ddef-aa15-4b38-8693-fc34abd8d423 req-c221c22b-cb46-4f28-b327-fd233d4b3146 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:02.949064 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4dc9ddef-aa15-4b38-8693-fc34abd8d423 req-c221c22b-cb46-4f28-b327-fd233d4b3146 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2452950 May 12 16:04:03.019645 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4dc9ddef-aa15-4b38-8693-fc34abd8d423 req-bcc5231d-f3a5-4b22-8864-b3ab88739df9 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 217 time: 0.0634811 May 12 16:04:03.082592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dc9ddef-aa15-4b38-8693-fc34abd8d423 req-5ebeb83d-5f7c-4588-96a5-555c8090acaf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:03.083881 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4dc9ddef-aa15-4b38-8693-fc34abd8d423 req-5ebeb83d-5f7c-4588-96a5-555c8090acaf service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0568321 May 12 16:04:03.165706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dc9ddef-aa15-4b38-8693-fc34abd8d423 req-68d02a4d-e341-4c5f-8a4e-bb63832d17e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:03.167138 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4dc9ddef-aa15-4b38-8693-fc34abd8d423 req-68d02a4d-e341-4c5f-8a4e-bb63832d17e8 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0720577 May 12 16:04:03.296878 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4dc9ddef-aa15-4b38-8693-fc34abd8d423 req-7089f757-cdf8-4116-b38d-921fc17e1143 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1231894 May 12 16:04:03.426947 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4dc9ddef-aa15-4b38-8693-fc34abd8d423 req-f7ddf04e-546c-41d8-a564-bb0f01dba9a9 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1233432 May 12 16:04:03.576570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20dee56c-7a64-47ef-a765-f371499757d8 req-8e628414-5eb4-496c-bf20-e467ea7cb0c0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:03.577938 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20dee56c-7a64-47ef-a765-f371499757d8 req-8e628414-5eb4-496c-bf20-e467ea7cb0c0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 944 time: 0.0821333 May 12 16:04:03.726016 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-20dee56c-7a64-47ef-a765-f371499757d8 req-84a0312f-8952-44f3-b132-49f93b82e9df tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1423721 May 12 16:04:04.928926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdcb052c-5147-4d1d-85e3-cce85c735c88 req-6542bfa1-d6d2-485c-b609-aa203b71a777 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:04.930389 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdcb052c-5147-4d1d-85e3-cce85c735c88 req-6542bfa1-d6d2-485c-b609-aa203b71a777 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 944 time: 0.0883632 May 12 16:04:04.986031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bdcb052c-5147-4d1d-85e3-cce85c735c88 req-a31816cd-490f-45cc-915f-eb1a70936415 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0498295 May 12 16:04:06.174393 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54bd93e4-54e0-47f9-a308-faec3441f45a req-ae955403-78d2-44cb-b67f-5ae09b379f16 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:06.175814 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-54bd93e4-54e0-47f9-a308-faec3441f45a req-ae955403-78d2-44cb-b67f-5ae09b379f16 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 944 time: 0.0820360 May 12 16:04:06.219226 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-54bd93e4-54e0-47f9-a308-faec3441f45a req-93b8a57f-f4b2-4053-a672-cffd86d02b4d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378420 May 12 16:04:06.410584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:04:06.542683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:04:06.555744 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'port_id': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'mac_address': 'fa:16:3e:63:ed:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 595, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:04:06.610443 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:06.628960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:04:06.645688 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:04:06.649053 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:06.719002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:04:06.726407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:06.726745 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:06.727074 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:06.727402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:06.727725 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:06.728043 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:06.728360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:06.728676 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:06.728989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:06.729301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:06.729639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:06.729952 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:06.984902 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['32cd03c9-4d72-4ba1-9597-c26b892c4ce4'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:04:07.419109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f16654e2-dea4-4751-9ced-6e4b29531bd7 req-7a58e317-52d7-4470-a112-e8832fdb269a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:07.420852 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f16654e2-dea4-4751-9ced-6e4b29531bd7 req-7a58e317-52d7-4470-a112-e8832fdb269a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 945 time: 0.0822170 May 12 16:04:07.469640 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f16654e2-dea4-4751-9ced-6e4b29531bd7 req-a3765a1f-2bb4-4a2a-baa7-eb9d7e36a8e2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431347 May 12 16:04:08.410546 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:04:08.480071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:04:08.484923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:04:08.485287 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:08.608666 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:08.644188 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:04:08.645245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:04:08.651031 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:08.668499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1adbf228-e5e2-4a48-a9b7-05d62f354ef9 req-2fd6c01f-023d-45b0-9ad0-7e77ac712178 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:08.676991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1adbf228-e5e2-4a48-a9b7-05d62f354ef9 req-2fd6c01f-023d-45b0-9ad0-7e77ac712178 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 945 time: 0.0932670 May 12 16:04:08.710180 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8a52a6bf-8088-4b9d-a213-c0c5b4b365cd'] response: {'server_uuid': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'code': 200} May 12 16:04:08.720258 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1adbf228-e5e2-4a48-a9b7-05d62f354ef9 req-3ba4d28c-2b38-47c8-ba8f-2baedaf52acd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418866 May 12 16:04:08.728366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:04:08.881971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4a6901a-0d55-4f82-8293-9bc2c6813d6d req-22824c8c-9b0f-4361-9199-5d06c81a22e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:08.883434 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f4a6901a-0d55-4f82-8293-9bc2c6813d6d req-22824c8c-9b0f-4361-9199-5d06c81a22e9 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 1097 time: 0.0737197 May 12 16:04:08.926890 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f4a6901a-0d55-4f82-8293-9bc2c6813d6d req-9a091198-7a2f-4ef8-aa71-5beb2fc25e08 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0333552 May 12 16:04:09.914395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e52359a-a7eb-4c06-8dc4-3b285eb691a9 req-6b5b8928-105c-4d83-838c-82aba2278ad2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:09.915805 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e52359a-a7eb-4c06-8dc4-3b285eb691a9 req-6b5b8928-105c-4d83-838c-82aba2278ad2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0828011 May 12 16:04:09.959167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e52359a-a7eb-4c06-8dc4-3b285eb691a9 req-4b4f6e56-8ce8-49b5-a674-a98a532a2283 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374441 May 12 16:04:11.145609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07281cd-6d50-469e-866b-a63dfcc65dca req-5322b033-5eaa-4763-88a0-6437be89f48f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:11.147037 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f07281cd-6d50-469e-866b-a63dfcc65dca req-5322b033-5eaa-4763-88a0-6437be89f48f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0780740 May 12 16:04:11.191075 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f07281cd-6d50-469e-866b-a63dfcc65dca req-40da216e-99de-452d-b514-a6297361368f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385106 May 12 16:04:11.371380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-243ff1e1-88af-47ab-a16d-e11fd5caa3bc req-dcb18736-c80e-4b23-93f7-f534bbbf842b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:11.372787 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-243ff1e1-88af-47ab-a16d-e11fd5caa3bc req-dcb18736-c80e-4b23-93f7-f534bbbf842b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0839212 May 12 16:04:11.381310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53216) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:04:11.386126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-68dacb08-f96b-4610-bd6a-995e5cafb9ad tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Request body: {'floatingip': {'port_id': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:04:11.463089 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68dacb08-f96b-4610-bd6a-995e5cafb9ad tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:12.051920 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68dacb08-f96b-4610-bd6a-995e5cafb9ad tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:12.055751 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68dacb08-f96b-4610-bd6a-995e5cafb9ad tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:12.336825 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-68dacb08-f96b-4610-bd6a-995e5cafb9ad tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d associated. External IP: 172.25.8.219, port: 32cd03c9-4d72-4ba1-9597-c26b892c4ce4. May 12 16:04:12.717646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-68dacb08-f96b-4610-bd6a-995e5cafb9ad tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Router cd523971-49e8-4deb-9f61-a0342aee2763 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:04:12.824941 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-16a3d645-30b9-4983-82f6-87cd8a9e5167 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:12.938795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-68dacb08-f96b-4610-bd6a-995e5cafb9ad tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:04:12.943631 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68dacb08-f96b-4610-bd6a-995e5cafb9ad tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:12.948921 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5df29438-bcec-42fc-9179-bc293561cc3a None None] Sync routers for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:04:12.962747 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5df29438-bcec-42fc-9179-bc293561cc3a None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:04:12.963395 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5df29438-bcec-42fc-9179-bc293561cc3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:03:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:04:13.021579 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-68dacb08-f96b-4610-bd6a-995e5cafb9ad tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "PUT /v2.0/floatingips/6998d782-f9e2-4cb3-80a3-d55f6fa8888d HTTP/1.1" status: 200 len: 992 time: 1.6391807 May 12 16:04:13.022262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'tag': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:04:13.073841 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9e9fd9d7-350f-4a44-9539-fa3483d9c257'] response: {'name': 'network-changed', 'server_uuid': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'tag': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'status': 'completed', 'code': 200} May 12 16:04:13.168370 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-5df29438-bcec-42fc-9179-bc293561cc3a None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:04:13.206404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d90616-e255-4218-9aca-e1c1e9ac8e8d req-cb9d429e-84b6-44b9-a812-2addd9d63344 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:13.207910 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-09d90616-e255-4218-9aca-e1c1e9ac8e8d req-cb9d429e-84b6-44b9-a812-2addd9d63344 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 1097 time: 0.0863783 May 12 16:04:13.408688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d90616-e255-4218-9aca-e1c1e9ac8e8d req-f3f96e32-6da1-4555-9d63-56de881b2f38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:13.410224 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-09d90616-e255-4218-9aca-e1c1e9ac8e8d req-f3f96e32-6da1-4555-9d63-56de881b2f38 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1930215 May 12 16:04:13.538966 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-09d90616-e255-4218-9aca-e1c1e9ac8e8d req-f1c4f591-f0dc-43b2-aa5c-a581fe16539a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 1000 time: 0.1222775 May 12 16:04:13.544935 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-6c5aa23b-dc3f-47d6-affe-9f3e4327c1df service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1560352 May 12 16:04:13.572600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7529b49f-1368-4816-a955-806cef57daf0 req-68f162ab-8517-4de2-8925-2e239e7ad0eb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:13.573916 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7529b49f-1368-4816-a955-806cef57daf0 req-68f162ab-8517-4de2-8925-2e239e7ad0eb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.1283901 May 12 16:04:13.598842 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5df29438-bcec-42fc-9179-bc293561cc3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '6998d782-f9e2-4cb3-80a3-d55f6fa8888d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'floating_ip_address': '172.25.8.219', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'port_id': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4150, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'mac_address': 'fa:16:3e:63:ed:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:02:06Z', 'updated_at': '2022-05-12T16:04:11Z', 'revision_number': 9, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:04:13.612167 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5df29438-bcec-42fc-9179-bc293561cc3a None None] Checking router: cd523971-49e8-4deb-9f61-a0342aee2763 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:04:13.628231 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5df29438-bcec-42fc-9179-bc293561cc3a None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:04:13.628231 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5df29438-bcec-42fc-9179-bc293561cc3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:03:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:04:13.628694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d90616-e255-4218-9aca-e1c1e9ac8e8d req-4a40ca4e-bdfb-42e1-9e41-adc81ae863da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:13.630458 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-09d90616-e255-4218-9aca-e1c1e9ac8e8d req-4a40ca4e-bdfb-42e1-9e41-adc81ae863da service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0836759 May 12 16:04:13.653998 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:13.659109 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7529b49f-1368-4816-a955-806cef57daf0 req-70ce9df6-c5a2-40f9-b6cb-d915e4f8b88e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0783448 May 12 16:04:13.732191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d90616-e255-4218-9aca-e1c1e9ac8e8d req-4a4a24a8-47fa-461f-8c62-a81627845673 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:13.735524 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-09d90616-e255-4218-9aca-e1c1e9ac8e8d req-4a4a24a8-47fa-461f-8c62-a81627845673 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0991035 May 12 16:04:13.898421 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-5df29438-bcec-42fc-9179-bc293561cc3a None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:04:13.918343 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-09d90616-e255-4218-9aca-e1c1e9ac8e8d req-4e38ebfa-70bb-4feb-ae57-9f9a5f3ddcf0 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1771467 May 12 16:04:14.082706 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-09d90616-e255-4218-9aca-e1c1e9ac8e8d req-7bed1111-8ebc-4599-bdd3-ed096d3ba738 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1586475 May 12 16:04:14.284253 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5df29438-bcec-42fc-9179-bc293561cc3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '6998d782-f9e2-4cb3-80a3-d55f6fa8888d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'floating_ip_address': '172.25.8.219', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'port_id': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4150, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'mac_address': 'fa:16:3e:63:ed:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:02:06Z', 'updated_at': '2022-05-12T16:04:11Z', 'revision_number': 9, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:04:14.288169 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5df29438-bcec-42fc-9179-bc293561cc3a None None] The sync data for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 is: [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '6998d782-f9e2-4cb3-80a3-d55f6fa8888d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'floating_ip_address': '172.25.8.219', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'port_id': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4150, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'mac_address': 'fa:16:3e:63:ed:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:02:06Z', 'updated_at': '2022-05-12T16:04:11Z', 'revision_number': 9, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:04:14.507706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a8f2104-abab-4091-8d36-d3178f879d0a None None] New status for floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:04:14.898282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc92915c-9333-4511-8006-e6271b0b551c req-f4c6f777-7af3-41a4-8a41-ed219c7c5cc8 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:14.899731 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc92915c-9333-4511-8006-e6271b0b551c req-f4c6f777-7af3-41a4-8a41-ed219c7c5cc8 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.1294086 May 12 16:04:14.902119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-ef511fb3-3e03-42ad-b17d-cf55c6b16efd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:14.903565 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-ef511fb3-3e03-42ad-b17d-cf55c6b16efd service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 1097 time: 0.0748987 May 12 16:04:14.946258 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc92915c-9333-4511-8006-e6271b0b551c req-6c3fb4b1-8e0a-449c-8b45-cc56c12c55a9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397370 May 12 16:04:15.151985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-589d7ab0-e9f3-463f-b28c-fab5f1b9c898 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:15.153412 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-589d7ab0-e9f3-463f-b28c-fab5f1b9c898 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2405713 May 12 16:04:15.253532 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-88baddc5-41f1-4eb3-b785-e24d0bb757dd service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 1003 time: 0.0943017 May 12 16:04:15.313774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-97915040-1ed9-4c37-8c9f-aa1a5df9e7ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:15.315428 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-97915040-1ed9-4c37-8c9f-aa1a5df9e7ae service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0565579 May 12 16:04:15.369889 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9890c510-9faf-4c0d-8d30-e134f6cfa141 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:15.394766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-38cefd30-0831-434d-9c04-bf603c200e3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:15.396213 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-38cefd30-0831-434d-9c04-bf603c200e3e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0728462 May 12 16:04:15.527122 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-c4fd0045-ede5-4ea0-b702-21383302e44b service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1252391 May 12 16:04:15.672073 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-b09fc761-ef96-4ac2-b805-7b6aa74f290b service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1395466 May 12 16:04:16.130311 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:16.158641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3efb2bef-4a32-469e-926d-22632ec90aa8 req-7db2cd95-d603-47e1-b7f0-96d8899cc929 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:16.160094 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3efb2bef-4a32-469e-926d-22632ec90aa8 req-7db2cd95-d603-47e1-b7f0-96d8899cc929 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0974040 May 12 16:04:16.214142 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3efb2bef-4a32-469e-926d-22632ec90aa8 req-4dc67e05-299e-41e4-9b35-d194fb436faa tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395577 May 12 16:04:16.354203 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:17.437905 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3664b61c-3ed7-4958-b311-86db5de68e48 req-4209c1a9-bff2-4061-904a-cd9c8f32f85e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:17.439439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3664b61c-3ed7-4958-b311-86db5de68e48 req-4209c1a9-bff2-4061-904a-cd9c8f32f85e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0986905 May 12 16:04:17.493641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3664b61c-3ed7-4958-b311-86db5de68e48 req-be2590be-2eec-4a66-9001-b2ab792959ec tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468035 May 12 16:04:17.839964 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:18.712761 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1dda9a1-b833-4b3d-a2c5-dd47d002e9be req-2dea1416-c1f0-48ca-969e-51d53359b5e3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:18.714202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1dda9a1-b833-4b3d-a2c5-dd47d002e9be req-2dea1416-c1f0-48ca-969e-51d53359b5e3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0894721 May 12 16:04:18.770730 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1dda9a1-b833-4b3d-a2c5-dd47d002e9be req-ea868821-771c-4dac-85b7-de85d41e8e89 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474272 May 12 16:04:20.028042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0551cc84-6686-44b6-8686-a757a022bb47 req-1c433b35-d74f-466c-b7b3-052283e19741 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:20.029988 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0551cc84-6686-44b6-8686-a757a022bb47 req-1c433b35-d74f-466c-b7b3-052283e19741 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0864429 May 12 16:04:20.074626 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0551cc84-6686-44b6-8686-a757a022bb47 req-f47a8c3e-259b-4fc4-8dc1-7f3eeb91bca6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381231 May 12 16:04:21.290206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92b4ff2-db07-4966-b323-1e3f12458706 req-8b79423b-a370-4ed6-865a-2cbfda51fcb4 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:21.291655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a92b4ff2-db07-4966-b323-1e3f12458706 req-8b79423b-a370-4ed6-865a-2cbfda51fcb4 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.1029263 May 12 16:04:21.354683 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a92b4ff2-db07-4966-b323-1e3f12458706 req-c594a0c4-2302-46a5-a2d5-b07407bd6046 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0518272 May 12 16:04:22.665066 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba7d0447-bf98-43af-a18c-256e2407c866 req-7d3aa3cb-3b09-40cc-bc92-1730c72b4473 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:22.666530 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba7d0447-bf98-43af-a18c-256e2407c866 req-7d3aa3cb-3b09-40cc-bc92-1730c72b4473 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.1936879 May 12 16:04:22.711368 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba7d0447-bf98-43af-a18c-256e2407c866 req-3104989d-3aff-402c-b56e-a7b9097797a1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386460 May 12 16:04:23.897560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e930689-a595-4fab-aaa1-10314085cd2f req-3fdc8d18-196e-406d-9f46-fd0c299fcce1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:23.898995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e930689-a595-4fab-aaa1-10314085cd2f req-3fdc8d18-196e-406d-9f46-fd0c299fcce1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0791929 May 12 16:04:23.945793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e930689-a595-4fab-aaa1-10314085cd2f req-a5990ce2-7b82-4606-94fe-f172d06152ea tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409710 May 12 16:04:23.969037 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:04:25.167255 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50fa0338-d157-4684-9579-d28ca7ed260a req-906103db-ebeb-47c0-a741-b90c70247def tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:25.169225 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50fa0338-d157-4684-9579-d28ca7ed260a req-906103db-ebeb-47c0-a741-b90c70247def tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.1094654 May 12 16:04:25.233806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50fa0338-d157-4684-9579-d28ca7ed260a req-7edca8c4-5b44-4d52-9aee-e5d06e8fbdd2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0579078 May 12 16:04:25.361492 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ce98c9ea-c07b-472e-858d-2dcc3e6c6595 req-17cf7f04-46ec-4621-8e71-678bb65f1a78 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0535431 May 12 16:04:25.486352 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ce98c9ea-c07b-472e-858d-2dcc3e6c6595 req-edaacfea-0b9c-4af6-82e8-aefa60469719 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0465968 May 12 16:04:25.546946 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ce98c9ea-c07b-472e-858d-2dcc3e6c6595 req-4fb8614b-1a6b-4684-9c4a-f194ff2df74a service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0425065 May 12 16:04:25.699299 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce98c9ea-c07b-472e-858d-2dcc3e6c6595 req-70bf9826-ba55-4ce0-a9aa-0075f651f024 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:25.700795 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ce98c9ea-c07b-472e-858d-2dcc3e6c6595 req-70bf9826-ba55-4ce0-a9aa-0075f651f024 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1491227 May 12 16:04:26.443443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d780dc0-1fa0-4748-a941-b391c45d65ea req-01cf90f6-edbe-4949-b997-0fe4c8bf9412 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:26.444862 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d780dc0-1fa0-4748-a941-b391c45d65ea req-01cf90f6-edbe-4949-b997-0fe4c8bf9412 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0962706 May 12 16:04:26.492202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d780dc0-1fa0-4748-a941-b391c45d65ea req-f98a0f4b-6b82-41b8-91c2-50c3327d27a5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415442 May 12 16:04:27.713358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2439d4e2-35fa-46fc-8a36-63d6534259fa req-4808c467-7daa-4d27-8add-db80e2a30c8e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:27.714848 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2439d4e2-35fa-46fc-8a36-63d6534259fa req-4808c467-7daa-4d27-8add-db80e2a30c8e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.1082871 May 12 16:04:27.766748 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2439d4e2-35fa-46fc-8a36-63d6534259fa req-7ba7ddff-1726-4196-9f4e-04d03a562761 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443490 May 12 16:04:28.960364 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67bca1d2-467b-418f-acb6-a7fd62a8015c req-640691ad-2a44-4dc4-8a46-fbb6c5138d8a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:28.961846 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67bca1d2-467b-418f-acb6-a7fd62a8015c req-640691ad-2a44-4dc4-8a46-fbb6c5138d8a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0844545 May 12 16:04:29.007690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67bca1d2-467b-418f-acb6-a7fd62a8015c req-76e047f1-48ad-4673-9f9b-c3187c721f0a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401406 May 12 16:04:30.210886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ab1439c-4563-4b12-93fa-6b45ffe403b9 req-ee20c4b6-75a7-441e-b3a7-ded13e2a3b42 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:30.212369 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ab1439c-4563-4b12-93fa-6b45ffe403b9 req-ee20c4b6-75a7-441e-b3a7-ded13e2a3b42 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0930638 May 12 16:04:30.260972 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3ab1439c-4563-4b12-93fa-6b45ffe403b9 req-14e702fa-2f3f-4b8f-91d7-2aafb5480331 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425906 May 12 16:04:31.447162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31d1cf55-ea34-4036-9dce-d8d94329f66d req-dda77915-db39-451e-b718-6229b013cdb3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:31.448598 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31d1cf55-ea34-4036-9dce-d8d94329f66d req-dda77915-db39-451e-b718-6229b013cdb3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0812156 May 12 16:04:31.492679 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31d1cf55-ea34-4036-9dce-d8d94329f66d req-372825ce-31a6-4fe7-859e-83a50cf2fcee tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382986 May 12 16:04:32.835373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b236b645-7736-476d-9bbd-509900172f61 req-1d54fc89-619d-445b-aa3f-1fe6a4f68101 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:32.836079 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:32.836724 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b236b645-7736-476d-9bbd-509900172f61 req-1d54fc89-619d-445b-aa3f-1fe6a4f68101 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0906916 May 12 16:04:32.879945 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b236b645-7736-476d-9bbd-509900172f61 req-5f2566d3-603f-4ac9-9e42-7afe4e8aa442 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373287 May 12 16:04:34.068298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce78446-cbbb-433c-9857-9f53ed94d499 req-c2126e0c-1ed6-4305-bc69-24ee57255851 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:34.069806 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ce78446-cbbb-433c-9857-9f53ed94d499 req-c2126e0c-1ed6-4305-bc69-24ee57255851 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0810599 May 12 16:04:34.116402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ce78446-cbbb-433c-9857-9f53ed94d499 req-2b45e6fa-9e6b-4b1a-ae74-ce09400efea1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409300 May 12 16:04:35.323262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74e80467-a680-4a1b-a977-beee3b44a31a req-8244e53a-ccaf-4bec-872a-40c435e60208 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:35.324734 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74e80467-a680-4a1b-a977-beee3b44a31a req-8244e53a-ccaf-4bec-872a-40c435e60208 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0862985 May 12 16:04:35.369711 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-74e80467-a680-4a1b-a977-beee3b44a31a req-e9e6d73d-468d-40a9-9766-e6a1fa64f3de tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390403 May 12 16:04:36.550658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d65f726-0bb4-4500-87cb-91bfc8919bd4 req-93a22bfb-5413-4f01-93c0-3302ef6fe5d7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:36.552079 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d65f726-0bb4-4500-87cb-91bfc8919bd4 req-93a22bfb-5413-4f01-93c0-3302ef6fe5d7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0788524 May 12 16:04:36.596178 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d65f726-0bb4-4500-87cb-91bfc8919bd4 req-1ae13b8f-6181-406b-981b-4f546d4ff1f9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384808 May 12 16:04:37.826670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9209f7b7-14b2-47fe-a258-25e14bd5ccdc req-d85dc7d2-5c4e-454d-8c5a-e6fe13b5ffc0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:37.828325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9209f7b7-14b2-47fe-a258-25e14bd5ccdc req-d85dc7d2-5c4e-454d-8c5a-e6fe13b5ffc0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.1055458 May 12 16:04:37.895681 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9209f7b7-14b2-47fe-a258-25e14bd5ccdc req-5ab503ab-8c53-4cf1-aa8f-4f07e055779a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0597799 May 12 16:04:39.089046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd8c7c85-ed2d-440f-9d0c-76622c453cc5 req-435d7523-ba53-4b6e-9d12-3bd695d1499f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:39.090579 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd8c7c85-ed2d-440f-9d0c-76622c453cc5 req-435d7523-ba53-4b6e-9d12-3bd695d1499f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0831645 May 12 16:04:39.143816 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd8c7c85-ed2d-440f-9d0c-76622c453cc5 req-44b9fc0d-c395-4d89-818f-728ef6f634a0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472944 May 12 16:04:40.334140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d61f34c-3779-4a77-9afb-6358cce9dc4d req-ab989cdd-67bb-43b7-b918-9803270d1fe6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:40.335590 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d61f34c-3779-4a77-9afb-6358cce9dc4d req-ab989cdd-67bb-43b7-b918-9803270d1fe6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0828125 May 12 16:04:40.380764 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d61f34c-3779-4a77-9afb-6358cce9dc4d req-dd07093a-3cc5-43dc-b79a-9727c7f44f0c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396049 May 12 16:04:41.573335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-625b11b3-0557-4882-bbd5-d972d9850e9f req-29706458-7e95-413f-8ae0-d77014ed8063 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:41.574724 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-625b11b3-0557-4882-bbd5-d972d9850e9f req-29706458-7e95-413f-8ae0-d77014ed8063 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0860393 May 12 16:04:41.621025 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-625b11b3-0557-4882-bbd5-d972d9850e9f req-e29ca9d5-922b-4ab9-99fe-e4bbca6b4a3d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400281 May 12 16:04:42.815952 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37c737e-a993-4972-918f-e17898b23843 req-0a7adaa3-7065-4fca-84f1-628deb825a2f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:42.818703 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a37c737e-a993-4972-918f-e17898b23843 req-0a7adaa3-7065-4fca-84f1-628deb825a2f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0900528 May 12 16:04:42.833211 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5aae47b0-5a22-4449-9a8f-e8dceae58e59 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:42.866198 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a37c737e-a993-4972-918f-e17898b23843 req-003dbeca-b318-436a-9674-1c87cecb2edd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409050 May 12 16:04:43.615980 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:44.054709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e15b19f2-5562-47a7-9d5d-0a686553198d req-77427466-00e9-4e87-8ac4-728b7508f4a2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:44.056174 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e15b19f2-5562-47a7-9d5d-0a686553198d req-77427466-00e9-4e87-8ac4-728b7508f4a2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0841815 May 12 16:04:44.100311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e15b19f2-5562-47a7-9d5d-0a686553198d req-93f54cdb-d1db-4cdf-a52d-d84bd6c65616 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385251 May 12 16:04:45.290207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f0c1b1d-49f2-4299-bf35-c320fc4b9f7e req-7a4f64bc-f6f9-4fc6-9d9e-8815d5c2b374 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:45.291633 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8f0c1b1d-49f2-4299-bf35-c320fc4b9f7e req-7a4f64bc-f6f9-4fc6-9d9e-8815d5c2b374 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0816920 May 12 16:04:45.338250 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8f0c1b1d-49f2-4299-bf35-c320fc4b9f7e req-bdd6ba65-004e-4bad-9412-f5d215cf63a0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407686 May 12 16:04:45.370727 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b184a146-6999-4236-81da-a40432ed475c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:46.081625 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:46.356974 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:46.519449 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e33990ed-00d6-4653-94c7-5618ad112a6e req-9e1ccaae-150b-4659-b12b-08c50e9fa4bb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:46.520872 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e33990ed-00d6-4653-94c7-5618ad112a6e req-9e1ccaae-150b-4659-b12b-08c50e9fa4bb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0783494 May 12 16:04:46.564651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e33990ed-00d6-4653-94c7-5618ad112a6e req-a898f0b8-1fd8-44a5-b401-58dff36f2aac tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381641 May 12 16:04:47.753750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c45973d-8cf4-4e55-8cf9-70a3ca696880 req-355e3101-afac-42de-8a6c-8dc99c393864 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:47.755185 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c45973d-8cf4-4e55-8cf9-70a3ca696880 req-355e3101-afac-42de-8a6c-8dc99c393864 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0833671 May 12 16:04:47.798906 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c45973d-8cf4-4e55-8cf9-70a3ca696880 req-50d46488-de8c-4ea9-9bd2-d4c4abc598be tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376573 May 12 16:04:47.839379 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:47.895593 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-700ab119-dd04-4180-93bd-519d3403095a service neutron] show failed (client error): The resource could not be found. May 12 16:04:47.896507 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-700ab119-dd04-4180-93bd-519d3403095a service neutron] 10.222.0.84 "GET /v2.0/ports/32cd03c9-4d72-4ba1-9597-c26b892c4ce4/bindings/n-h2-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.0808198 May 12 16:04:48.213518 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-797c1c89-6fce-477b-90a8-66506318f18c req-b7db05f8-dcb7-4997-b7e3-12a37264beb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:48.214990 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-797c1c89-6fce-477b-90a8-66506318f18c req-b7db05f8-dcb7-4997-b7e3-12a37264beb8 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 1097 time: 0.1349032 May 12 16:04:48.231747 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-69fc8276-2631-43f5-8437-4770e5bc3b0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:48.234355 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-69fc8276-2631-43f5-8437-4770e5bc3b0f service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa&tenant_id=22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 1097 time: 0.1062038 May 12 16:04:48.261343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Request body: {'port': {'binding:host_id': 'n-h2-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:04:48.485754 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:48.496153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-797c1c89-6fce-477b-90a8-66506318f18c req-e60ccffa-8c3c-4d9c-ab6d-e8de4f0ea7d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:48.497606 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-797c1c89-6fce-477b-90a8-66506318f18c req-e60ccffa-8c3c-4d9c-ab6d-e8de4f0ea7d8 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2580581 May 12 16:04:48.831826 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-797c1c89-6fce-477b-90a8-66506318f18c req-6555d309-3d5f-4c10-8e1d-47702cd41e21 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 1003 time: 0.3042476 May 12 16:04:48.984411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-797c1c89-6fce-477b-90a8-66506318f18c req-2b04f0a9-6d58-4244-a768-dbfa3b3b11ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:48.986839 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-797c1c89-6fce-477b-90a8-66506318f18c req-2b04f0a9-6d58-4244-a768-dbfa3b3b11ff service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.1427901 May 12 16:04:49.032940 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ea7d60f-031d-4fb5-8b0d-5e3b3830ca43 req-543241ee-3c06-47f8-98a0-fcec299b9f1a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:49.034556 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ea7d60f-031d-4fb5-8b0d-5e3b3830ca43 req-543241ee-3c06-47f8-98a0-fcec299b9f1a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.1141438 May 12 16:04:49.091142 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ea7d60f-031d-4fb5-8b0d-5e3b3830ca43 req-3fd57c00-2f6a-470f-899b-3de23402ad0c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470581 May 12 16:04:49.101958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:04:49.119173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-797c1c89-6fce-477b-90a8-66506318f18c req-b24a90d7-1257-4aa0-820f-8a624db9a5e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:49.120647 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-797c1c89-6fce-477b-90a8-66506318f18c req-b24a90d7-1257-4aa0-820f-8a624db9a5e8 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1235225 May 12 16:04:49.205373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:04:49.294960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:04:49.301237 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:49.332206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Transition to ACTIVE for port object 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:04:49.335874 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-797c1c89-6fce-477b-90a8-66506318f18c req-b00ec676-c3b3-40fa-a588-fa5b203e4509 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2050967 May 12 16:04:49.336964 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:49.371849 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-741aa099-3619-4138-bd13-2c9affa0cbd8'] response: {'server_uuid': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'code': 200} May 12 16:04:49.575409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Pushing event updated for resources: {'Port': ['ID=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,revision_number=6']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:04:49.636385 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] No DVR routers for this DVR port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:04:49.722042 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-797c1c89-6fce-477b-90a8-66506318f18c req-94d10bdb-ca40-4922-8460-05351afdb066 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3528655 May 12 16:04:49.872530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Attempting to bind port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:04:49.872873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Attempting to bind port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:04:49.873180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Attempting to bind port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:04:49.878512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on network 9475b307-5f43-40f6-b384-65417948d75d not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:04:49.878829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Attempting to bind port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:04:49.883795 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 4, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:04:49.884127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Checking segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:04:49.884503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Bound using segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:04:49.884923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Bound port: 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:04:49.885260 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:49.972739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:04:49.975642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:04:49.979988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:50.044926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:50.045552 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:50.047004 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] 10.222.0.76 "PUT /v2.0/ports/32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 1092 time: 1.7895489 May 12 16:04:50.065661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74c25811-5e98-4d76-9208-d6ebac639cbb service neutron] Pushing event updated for resources: {'Port': ['ID=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,revision_number=7']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:04:50.142019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-abedc872-071a-4565-9c9b-1f4ebfa565b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:50.143520 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-abedc872-071a-4565-9c9b-1f4ebfa565b8 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 1095 time: 0.0749686 May 12 16:04:50.288885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ef5e11-3c22-4dda-8195-02eba6c16b47 req-16cf2a7f-88c0-46d3-b986-d162bfa6c75e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:50.292068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-dd658354-6207-4521-9c6b-9d1dc189cf4e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:50.294279 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-dd658354-6207-4521-9c6b-9d1dc189cf4e service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1446645 May 12 16:04:50.296487 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96ef5e11-3c22-4dda-8195-02eba6c16b47 req-16cf2a7f-88c0-46d3-b986-d162bfa6c75e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 944 time: 0.0938649 May 12 16:04:50.337772 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-96ef5e11-3c22-4dda-8195-02eba6c16b47 req-0e1c0019-9b7a-465e-aaca-4828d1298ed1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401034 May 12 16:04:50.519721 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-c6b052cc-b09f-4993-b6dd-7310b6bea8cf service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 1001 time: 0.2177958 May 12 16:04:50.584400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-3684d970-c8be-4ee1-b33d-501f0a9be2d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:50.585783 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-3684d970-c8be-4ee1-b33d-501f0a9be2d7 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0603418 May 12 16:04:50.659708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-08b35d33-7113-4399-9dba-9e060082700f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:50.661177 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-08b35d33-7113-4399-9dba-9e060082700f service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0694144 May 12 16:04:50.792908 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-1bf7b93c-3d43-45b6-9c8a-a342bb9b9a4e service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1257503 May 12 16:04:50.924381 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-efdba72d-c4b1-42eb-9bc8-d990b5088b41 req-b9e53827-9099-4c32-bd4e-ebbdeb097cad service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1255939 May 12 16:04:51.373499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'tag': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:04:51.432915 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a199d776-4ba0-4977-b5f2-2d403d4b2760'] response: {'name': 'network-changed', 'server_uuid': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'tag': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'status': 'completed', 'code': 200} May 12 16:04:51.525336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16c6388a-2b76-43ac-a45e-5336093f439b req-7d561fcf-056c-4b99-ae34-f2771fb4d927 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:51.527504 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16c6388a-2b76-43ac-a45e-5336093f439b req-7d561fcf-056c-4b99-ae34-f2771fb4d927 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 944 time: 0.0810893 May 12 16:04:51.571656 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-16c6388a-2b76-43ac-a45e-5336093f439b req-8e44611d-acb4-4df7-994e-00f05ae3291a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381408 May 12 16:04:51.586752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-e2ec7448-e014-4677-8c05-5f03e76c542f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:51.588222 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-e2ec7448-e014-4677-8c05-5f03e76c542f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 1095 time: 0.1369185 May 12 16:04:51.593379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-773ebdfe-9ada-42e0-9eb4-80f28ee97654 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:51.594687 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-773ebdfe-9ada-42e0-9eb4-80f28ee97654 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 1095 time: 0.1003411 May 12 16:04:51.834592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-d972fb09-39fe-403b-95a5-091014e49829 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:51.836031 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-d972fb09-39fe-403b-95a5-091014e49829 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2405112 May 12 16:04:51.838411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-df8e0cbe-29b4-4ac6-9f58-2c80028502e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:51.839720 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-df8e0cbe-29b4-4ac6-9f58-2c80028502e9 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2268085 May 12 16:04:52.024559 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-0944e6db-1f54-4aea-b99f-b307c0d0da1d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 1001 time: 0.1822481 May 12 16:04:52.026291 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-c9432f49-06d7-4dfb-b834-4120b3c17107 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 1001 time: 0.1331706 May 12 16:04:52.135059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-cfcba3c5-ca35-49a4-9f66-b0594ffef19a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:52.136364 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-cfcba3c5-ca35-49a4-9f66-b0594ffef19a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.1048510 May 12 16:04:52.137750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-5d001d37-a01a-4d97-9294-e0280400b348 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:52.139008 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-5d001d37-a01a-4d97-9294-e0280400b348 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0793209 May 12 16:04:52.278988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-491bebfe-9fb8-4ccd-9c3c-d2080ea2896a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:52.280474 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-491bebfe-9fb8-4ccd-9c3c-d2080ea2896a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1371601 May 12 16:04:52.282881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-5b3a176a-d3bc-4713-b3b3-ad58206fb79e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:52.284180 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-5b3a176a-d3bc-4713-b3b3-ad58206fb79e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1116121 May 12 16:04:52.648539 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-b341e65e-01cc-4c59-98df-b6c514633f8e service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3617027 May 12 16:04:52.650348 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-e4954920-d641-4693-ab72-16ad820bf062 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3469722 May 12 16:04:52.659269 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:04:52.720939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:04:52.772881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad2262bf-5d0b-4f94-8c42-45e128e5d903 req-e8d7fbbd-f13f-4e55-aa14-220c51eb1325 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:52.774325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad2262bf-5d0b-4f94-8c42-45e128e5d903 req-e8d7fbbd-f13f-4e55-aa14-220c51eb1325 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 944 time: 0.0874307 May 12 16:04:52.820469 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad2262bf-5d0b-4f94-8c42-45e128e5d903 req-47498936-cddc-45fa-9bfe-5895840309e4 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403981 May 12 16:04:52.893035 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-52dd02cf-1bf2-4945-b0ce-8071983bd3aa service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2373495 May 12 16:04:52.894905 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63ab8c5c-74b7-450d-8835-0b4d18e82e17 req-3891e314-1a3d-477c-844e-4032ea013045 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2214191 May 12 16:04:53.215633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5db626-6f18-48fe-8279-169047109354 req-6e7a7c53-e09f-4909-8915-1dbaddc4f729 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:53.216332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-7d5db626-6f18-48fe-8279-169047109354 req-6e7a7c53-e09f-4909-8915-1dbaddc4f729 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Synchronizing usage tracker for tenant:22f425833dc74d6b985912b8d7db7222 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:04:53.232375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-7d5db626-6f18-48fe-8279-169047109354 req-6e7a7c53-e09f-4909-8915-1dbaddc4f729 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Unset dirty status for tenant:22f425833dc74d6b985912b8d7db7222 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:04:53.234488 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-6e7a7c53-e09f-4909-8915-1dbaddc4f729 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.76 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa&tenant_id=22f425833dc74d6b985912b8d7db7222&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 944 time: 0.1035047 May 12 16:04:53.271418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11a45b1e-388d-4311-8045-bafc7e35aa0b req-71ce2b05-8c19-4048-b31f-3a49365cf800 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:53.272887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11a45b1e-388d-4311-8045-bafc7e35aa0b req-71ce2b05-8c19-4048-b31f-3a49365cf800 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 944 time: 0.0826132 May 12 16:04:53.322701 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-11a45b1e-388d-4311-8045-bafc7e35aa0b req-2bfbe7de-8a92-426b-8fb6-48d4a4ca0ab4 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434008 May 12 16:04:53.323388 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-28b3f55d-080b-4181-9b88-319f40ac5206 service neutron] 10.222.0.76 "GET /v2.0/ports/32cd03c9-4d72-4ba1-9597-c26b892c4ce4/bindings/n-h2-841483-1 HTTP/1.1" status: 200 len: 382 time: 0.0837572 May 12 16:04:53.414389 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5db626-6f18-48fe-8279-169047109354 req-1e22cc86-2218-4929-8dfd-6a3cec47c526 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:53.415799 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-1e22cc86-2218-4929-8dfd-6a3cec47c526 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 1095 time: 0.0717227 May 12 16:04:53.544994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5db626-6f18-48fe-8279-169047109354 req-10a97ca3-b25c-4962-8fa2-0f1d6491dae5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:53.546998 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-10a97ca3-b25c-4962-8fa2-0f1d6491dae5 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1249206 May 12 16:04:53.647473 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-405889b1-ea92-4723-831e-1e124b248278 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 1001 time: 0.0950279 May 12 16:04:53.712600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5db626-6f18-48fe-8279-169047109354 req-3451ec79-a655-4d9a-bf89-66ed37dd1b4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:53.714479 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-3451ec79-a655-4d9a-bf89-66ed37dd1b4a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0612304 May 12 16:04:53.793825 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5db626-6f18-48fe-8279-169047109354 req-25193192-b2d7-43e8-9d11-eecc2434a315 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:53.795287 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-25193192-b2d7-43e8-9d11-eecc2434a315 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0752423 May 12 16:04:53.925304 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-55c53edf-f149-4fc6-bd0a-3be8e0f826a7 service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1242204 May 12 16:04:54.056432 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-c62c072f-1793-4f45-af26-0fb1ec295edc service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1252699 May 12 16:04:54.376420 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:04:54.512546 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:04:54.520580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f20f9b6-da46-49c0-9070-a110b29bdbec req-7a0bff6a-c4cd-42a2-9abd-77edf08d5da7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:54.522081 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f20f9b6-da46-49c0-9070-a110b29bdbec req-7a0bff6a-c4cd-42a2-9abd-77edf08d5da7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 944 time: 0.0828457 May 12 16:04:54.526502 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'port_id': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'mac_address': 'fa:16:3e:63:ed:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 595, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:04:54.567473 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f20f9b6-da46-49c0-9070-a110b29bdbec req-a88964c6-892b-4f06-8f42-3b0e44e66b26 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396383 May 12 16:04:54.582035 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:54.598307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:04:54.613479 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:04:54.617007 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:54.692850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:04:54.780675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-b54a2b49-3d64-49e6-8911-78fc47284ffd req-bb9d38d8-a580-4d2f-bfe3-bdcc4db2ea34 service neutron] (88151) timed out ('10.222.0.82', 50048) {{(pid=88151) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 16:04:54.885458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['32cd03c9-4d72-4ba1-9597-c26b892c4ce4'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:04:55.876564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81d00289-e4a1-4687-8cb1-898d12f05b52 req-ec1508e3-97a5-4663-89f7-1f9d596fc194 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:55.878044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81d00289-e4a1-4687-8cb1-898d12f05b52 req-ec1508e3-97a5-4663-89f7-1f9d596fc194 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 945 time: 0.1997578 May 12 16:04:55.922795 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-81d00289-e4a1-4687-8cb1-898d12f05b52 req-e95768ec-898d-497a-ad88-26204b898834 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391061 May 12 16:04:56.041032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5db626-6f18-48fe-8279-169047109354 req-03ff3487-b131-4087-9d5f-83401640e1bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:56.042500 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-03ff3487-b131-4087-9d5f-83401640e1bc service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa&tenant_id=22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 1096 time: 0.0697968 May 12 16:04:56.066330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:04:56.174969 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:56.392558 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:04:56.525573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:04:56.538576 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'port_id': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'mac_address': 'fa:16:3e:63:ed:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 595, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:04:56.563410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:04:56.592670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:04:56.647339 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:04:56.655226 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:56.668050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Ignored duplicate provisioning block setup for port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:68}} May 12 16:04:56.672446 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:56.829618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Pushing event updated for resources: {'Port': ['ID=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,revision_number=9']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:04:56.842435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:56.843300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:56.844271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:56.844597 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:56.844931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:56.845274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:56.845617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:56.845940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:56.846264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:56.846586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:56.846906 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:56.847227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:04:56.893755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] No DVR routers for this DVR port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:04:57.113640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7153c27f-54fb-47b8-b3e8-7e6ff5c83be1 req-4b1036b0-1553-4508-bca6-2b54a0f2c7b5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:57.114959 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7153c27f-54fb-47b8-b3e8-7e6ff5c83be1 req-4b1036b0-1553-4508-bca6-2b54a0f2c7b5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 944 time: 0.0799839 May 12 16:04:57.133275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Attempting to bind port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:04:57.133868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Attempting to bind port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:04:57.133986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Attempting to bind port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:04:57.138583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on network 9475b307-5f43-40f6-b384-65417948d75d not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:04:57.138905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Attempting to bind port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:04:57.145218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 4, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:04:57.145585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Checking segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:04:57.145967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Bound using segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:04:57.146393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Bound port: 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:04:57.146739 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:57.162365 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7153c27f-54fb-47b8-b3e8-7e6ff5c83be1 req-80ba39bc-d182-488a-aa55-cda6e8582270 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415425 May 12 16:04:57.241188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:04:57.244109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:04:57.251054 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:57.310728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:57.311401 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:04:57.313956 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-11bae287-cef7-4873-8e52-635921f22922 service neutron] 10.222.0.84 "PUT /v2.0/ports/32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 1092 time: 1.2516284 May 12 16:04:57.314403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'tag': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:04:57.338050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11bae287-cef7-4873-8e52-635921f22922 service neutron] Pushing event updated for resources: {'Port': ['ID=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,revision_number=10']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:04:57.392774 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-51145be3-a7ec-40ec-a687-9b58f5f94a88'] response: {'name': 'network-changed', 'server_uuid': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'tag': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'status': 'completed', 'code': 200} May 12 16:04:57.490255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5db626-6f18-48fe-8279-169047109354 req-712c480f-fb59-449c-9eb8-a0dcb1bf3256 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:57.491723 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-712c480f-fb59-449c-9eb8-a0dcb1bf3256 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 1096 time: 0.1354492 May 12 16:04:57.497290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-d95c5052-a0bd-4736-87c3-7338d3bc62b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:57.498634 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-d95c5052-a0bd-4736-87c3-7338d3bc62b9 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 1096 time: 0.1007283 May 12 16:04:57.730438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5db626-6f18-48fe-8279-169047109354 req-076ff231-69ba-436e-a395-aaf3d2c57046 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:57.731860 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-076ff231-69ba-436e-a395-aaf3d2c57046 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2310524 May 12 16:04:57.734266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-0cdc9fa5-f182-41d5-af8b-c9dc399f5173 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:57.735549 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-0cdc9fa5-f182-41d5-af8b-c9dc399f5173 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2150133 May 12 16:04:58.052042 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-317e1c8e-a8d8-44d8-9e6d-082a7606b745 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 1001 time: 0.3104374 May 12 16:04:58.053730 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-40afcac5-11a6-4c4b-b365-ca82df92b281 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 1001 time: 0.2619903 May 12 16:04:58.170079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-eacd974f-e2d4-4bba-9766-d7e4227d6a79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:58.171999 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-eacd974f-e2d4-4bba-9766-d7e4227d6a79 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.1144683 May 12 16:04:58.173218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5db626-6f18-48fe-8279-169047109354 req-003115ce-a51c-4497-b7c8-601f3794c278 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:58.174512 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-003115ce-a51c-4497-b7c8-601f3794c278 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0845394 May 12 16:04:58.316016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-50466e6c-4113-4143-bea2-253faf9388ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:58.317407 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-50466e6c-4113-4143-bea2-253faf9388ca service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1402206 May 12 16:04:58.319926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5db626-6f18-48fe-8279-169047109354 req-ec42e76d-1dd8-4cdd-810f-8a3d5e3b5d00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:58.321241 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-ec42e76d-1dd8-4cdd-810f-8a3d5e3b5d00 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1133494 May 12 16:04:58.373018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-430dc8af-ab26-4d96-8d7a-06a161d99dce req-d3cd1ff5-7628-4d79-bacf-5921ef9c896a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:58.375096 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-430dc8af-ab26-4d96-8d7a-06a161d99dce req-d3cd1ff5-7628-4d79-bacf-5921ef9c896a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 945 time: 0.0986114 May 12 16:04:58.406802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:04:58.422619 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-430dc8af-ab26-4d96-8d7a-06a161d99dce req-12d95346-f26e-423a-8cd9-1eb2d73ac5f3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415261 May 12 16:04:58.479094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:04:58.568332 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-ee040ebf-6a1c-4f22-aefc-d1219e8f8d6c service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2439058 May 12 16:04:58.571254 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-ce9b68c0-1b27-436c-9bbe-504421a02a46 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2264452 May 12 16:04:58.812688 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-08a60696-591d-492c-8553-7c96268129d1 service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2380159 May 12 16:04:58.814570 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d5db626-6f18-48fe-8279-169047109354 req-7fa5a292-f0ac-4e2a-a730-01a3cb1944aa service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2221627 May 12 16:04:58.982129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-631cba00-5f32-43c0-8c30-c71cbbd53396 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:58.983708 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-631cba00-5f32-43c0-8c30-c71cbbd53396 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 1096 time: 0.0706351 May 12 16:04:59.115407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-212f8ffc-00fb-4efa-b1b7-468bd4bb3af7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:59.116818 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-212f8ffc-00fb-4efa-b1b7-468bd4bb3af7 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1277504 May 12 16:04:59.220578 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-0cd475ee-b63d-4578-9079-2589e4bcb61d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 200 len: 1001 time: 0.0965264 May 12 16:04:59.283915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-294eec7b-d78d-40da-8300-9bd21e4fbda4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:59.285345 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-294eec7b-d78d-40da-8300-9bd21e4fbda4 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0583031 May 12 16:04:59.363427 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-6b344f6d-d9ea-40c1-a423-95bcce8bfd3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:59.364850 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-6b344f6d-d9ea-40c1-a423-95bcce8bfd3c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0731432 May 12 16:04:59.494929 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-e1452d46-fc72-4d23-883d-46d530d5af2b service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1231306 May 12 16:04:59.615201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b21e735-9614-4a33-ae63-5512ce3e486f req-1a1f5292-7953-48a6-9b69-43dc30a3e646 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:04:59.616672 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b21e735-9614-4a33-ae63-5512ce3e486f req-1a1f5292-7953-48a6-9b69-43dc30a3e646 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 945 time: 0.0847635 May 12 16:04:59.663375 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b21e735-9614-4a33-ae63-5512ce3e486f req-e5ef24b0-f6a2-4912-a45d-cf27e76da13c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408280 May 12 16:04:59.756796 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4a718-5da9-40d7-8570-e20154f4dece req-3c330126-6198-47c6-8e3f-d3e02dd1acbb service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2552860 May 12 16:05:00.851373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c835f1d-c962-4ca6-9114-d3468ffcc9f3 req-d38fe1a3-8bb5-489c-bc8c-111b6ded1541 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:00.852792 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c835f1d-c962-4ca6-9114-d3468ffcc9f3 req-d38fe1a3-8bb5-489c-bc8c-111b6ded1541 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 945 time: 0.0798128 May 12 16:05:00.896495 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c835f1d-c962-4ca6-9114-d3468ffcc9f3 req-bc2231e6-02fa-413c-80c5-546470b497e4 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378947 May 12 16:05:00.968385 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:05:01.085362 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0428eaa-714f-48ea-a95b-80fa985b1d0f req-0317aba1-0445-4387-ac6c-1ff85d5c920d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:01.086816 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0428eaa-714f-48ea-a95b-80fa985b1d0f req-0317aba1-0445-4387-ac6c-1ff85d5c920d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 945 time: 0.0825038 May 12 16:05:01.129755 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0428eaa-714f-48ea-a95b-80fa985b1d0f req-2fb5bdac-27ae-49a6-a4bd-9b10e263681a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373013 May 12 16:05:01.314258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c659ec-ae3d-4aa5-b5db-9a59c858baa8 req-562501d9-b7b8-46a8-bc9b-fdc89169bc0d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:01.315935 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8c659ec-ae3d-4aa5-b5db-9a59c858baa8 req-562501d9-b7b8-46a8-bc9b-fdc89169bc0d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 945 time: 0.0816097 May 12 16:05:01.361521 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8c659ec-ae3d-4aa5-b5db-9a59c858baa8 req-d8bd203d-21dd-458e-adeb-50763cdee0f3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398445 May 12 16:05:01.733324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7a304b-b50b-478f-8587-297776adee45 req-b749b8b2-d5ba-4d3e-8d69-3efa21fe4dc2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:01.735385 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea7a304b-b50b-478f-8587-297776adee45 req-b749b8b2-d5ba-4d3e-8d69-3efa21fe4dc2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 945 time: 0.0854323 May 12 16:05:01.778717 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea7a304b-b50b-478f-8587-297776adee45 req-0683c8cc-ff25-42f1-807a-256a2a491455 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376976 May 12 16:05:02.747358 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:05:02.853337 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:02.891764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:05:02.904874 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'port_id': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'mac_address': 'fa:16:3e:63:ed:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 595, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:05:02.960408 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:02.971416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5642661e-9be5-4da7-b35e-2d4319010dbd req-0fe629e0-daee-4e45-9c67-8b0443369af0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:02.972890 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5642661e-9be5-4da7-b35e-2d4319010dbd req-0fe629e0-daee-4e45-9c67-8b0443369af0 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 945 time: 0.0809994 May 12 16:05:02.981348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:05:02.997991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:05:03.001973 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:03.020736 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5642661e-9be5-4da7-b35e-2d4319010dbd req-a1946295-ec86-4703-8b63-e71424f41681 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420024 May 12 16:05:03.069419 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,revision_number=11']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:05:03.100915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-40b0c4bd-abf9-4bc9-a0fc-6f23d589bfbd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:03.102343 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-40b0c4bd-abf9-4bc9-a0fc-6f23d589bfbd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 946 time: 0.0792601 May 12 16:05:03.174466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Deleting port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:05:03.174803 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:03.415775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] For port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:05:03.416128 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:03.705439 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:03.705851 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:03.710683 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d disassociated. External IP: 172.25.8.219, port: 32cd03c9-4d72-4ba1-9597-c26b892c4ce4. May 12 16:05:03.711042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Calling delete_port for 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:05:03.862134 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:03.911418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event deleted for resources: {'Port': ['ID=32cd03c9-4d72-4ba1-9597-c26b892c4ce4,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:05:04.111849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Router cd523971-49e8-4deb-9f61-a0342aee2763 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:05:04.173789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-715c2a24-4d7d-450d-bf28-025938d70681 req-3d3a5682-cd42-4233-9b73-d371165a6c7f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=d4a0e523-5a29-4492-907e-045a217f8ffa HTTP/1.1" status: 200 len: 210 time: 0.0430264 May 12 16:05:04.310869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:05:04.321459 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b4325c6-94b9-4458-85a5-01ac0a18418b None None] Sync routers for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:05:04.331817 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b4325c6-94b9-4458-85a5-01ac0a18418b None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:05:04.332416 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5b4325c6-94b9-4458-85a5-01ac0a18418b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:04:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:05:04.388138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] No DVR routers for this DVR port 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:05:04.391518 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:04.394039 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'name': 'network-vif-deleted', 'tag': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:05:04.409561 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2d550a73-3f63-4cd5-b382-0c5ac2d7cdf3 req-c6a96bec-c29b-4d78-a2f9-0428584d515b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "DELETE /v2.0/ports/32cd03c9-4d72-4ba1-9597-c26b892c4ce4 HTTP/1.1" status: 204 len: 173 time: 1.3013196 May 12 16:05:04.447184 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d94f9a82-8633-4a59-b6e5-0ac03f33b1e3'] response: {'server_uuid': 'd4a0e523-5a29-4492-907e-045a217f8ffa', 'name': 'network-vif-deleted', 'tag': '32cd03c9-4d72-4ba1-9597-c26b892c4ce4', 'status': 'completed', 'code': 200} May 12 16:05:04.516392 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-5b4325c6-94b9-4458-85a5-01ac0a18418b None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:05:04.820611 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5b4325c6-94b9-4458-85a5-01ac0a18418b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:05:04.824351 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b4325c6-94b9-4458-85a5-01ac0a18418b None None] Checking router: cd523971-49e8-4deb-9f61-a0342aee2763 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:05:04.833088 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b4325c6-94b9-4458-85a5-01ac0a18418b None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:05:04.833701 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5b4325c6-94b9-4458-85a5-01ac0a18418b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:04:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:05:05.014729 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-5b4325c6-94b9-4458-85a5-01ac0a18418b None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:05:05.329069 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-5b4325c6-94b9-4458-85a5-01ac0a18418b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:05:05.332984 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b4325c6-94b9-4458-85a5-01ac0a18418b None None] The sync data for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 is: [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:05:05.516671 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-83de9dc9-bf0f-4170-a357-580ab5b24b74 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1087207809&fields=id&tenant_id=22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 267 time: 0.0413682 May 12 16:05:05.561142 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad71c911-6924-47db-8ee1-62846d003760 None None] New status for floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:05:05.668703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-4a41ff0a-28b9-4ebb-87ba-13a5007a7631 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:05.670139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-4a41ff0a-28b9-4ebb-87ba-13a5007a7631 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 812 time: 0.1467552 May 12 16:05:05.685298 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-9bda2ff3-7de7-4f08-b52c-4c3c59ab90cc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/quotas/22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 375 time: 0.0095484 May 12 16:05:05.776531 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-667d911e-c641-4759-a707-47f2ecfecb8e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0859420 May 12 16:05:05.913722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-20e0a729-bacc-4b21-8157-9dbe6942830f service neutron] 10.222.0.82 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1251709 May 12 16:05:06.042496 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-67d1a516-8e1e-4247-9147-4fb43e792932 service neutron] 10.222.0.82 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1228962 May 12 16:05:06.225770 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b6962539-05eb-4a91-87af-bf764e5cafb5 req-0af3f53b-d1a7-4755-ac4a-3fe8d7475b5e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 210 time: 0.0444620 May 12 16:05:06.767710 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:05:06.802897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:05:06.803231 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 32cd03c9-4d72-4ba1-9597-c26b892c4ce4 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:05:07.380009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71375abb-c0e9-42b7-b508-5fd3970c7d75 req-255dbbee-9d4d-4228-a1f1-5d48c9dee3dd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 210 time: 0.0413978 May 12 16:05:07.625158 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-8470d88a-4a2e-4f40-9ce6-57e55586eeec tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:07.626689 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-8470d88a-4a2e-4f40-9ce6-57e55586eeec tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 812 time: 0.2678170 May 12 16:05:07.708133 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7663ba4f-d4be-4cda-a1d8-4e644abef785 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 380 time: 0.0394697 May 12 16:05:07.716294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Request body: {'port': {'device_id': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'admin_state_up': True, 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'security_groups': ['3aebfd3b-72ff-4972-bf89-463e07cfaf27']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:05:07.852278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:05:07.856280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Usage tracker for resource:port and tenant:22f425833dc74d6b985912b8d7db7222 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:05:07.859704 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Quota usage for port was recalculated. Used quota:3. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:05:07.865296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:05:07.875740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Made reservation on behalf of 22f425833dc74d6b985912b8d7db7222 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:05:07.879116 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:08.048776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Allocated IP 172.20.0.4 (9475b307-5f43-40f6-b384-65417948d75d/d0bd473b-b60e-4879-b8b8-94c3dfcc17c8/75098235-08b8-4e01-90a4-2619f1c82299) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:05:08.232076 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:08.247348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Transition to ACTIVE for port object 75098235-08b8-4e01-90a4-2619f1c82299 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:05:08.271193 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:08.343981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Network 9475b307-5f43-40f6-b384-65417948d75d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:05:08.345074 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:05:08.349045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:05:08.393996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event updated for resources: {'Port': ['ID=75098235-08b8-4e01-90a4-2619f1c82299,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:05:08.423247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:08.423885 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:08.449237 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-0045295a-1bc3-474d-87ad-bb7e32ebf516 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7361696 May 12 16:05:08.473826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Request body: {'port': {'device_id': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:05:08.563772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-90b6b3c1-f403-45ac-9a0c-3a93a73433f1 None None] Provisioning for port 75098235-08b8-4e01-90a4-2619f1c82299 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:05:08.571303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-90b6b3c1-f403-45ac-9a0c-3a93a73433f1 None None] Provisioning complete for port 75098235-08b8-4e01-90a4-2619f1c82299 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:05:08.572001 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-90b6b3c1-f403-45ac-9a0c-3a93a73433f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:08.580104 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4c9c618-1d81-413a-b2c3-b66a2f719a9b req-8d894d7e-4206-4cc4-a4fa-d588b8232862 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:08.581683 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4c9c618-1d81-413a-b2c3-b66a2f719a9b req-8d894d7e-4206-4cc4-a4fa-d588b8232862 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 931 time: 0.0867014 May 12 16:05:08.597976 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:08.628864 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4c9c618-1d81-413a-b2c3-b66a2f719a9b req-bda5c990-f83e-445d-b3f1-4a4732330021 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406528 May 12 16:05:08.635145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-90b6b3c1-f403-45ac-9a0c-3a93a73433f1 None None] Port 75098235-08b8-4e01-90a4-2619f1c82299 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:05:08.935713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 75098235-08b8-4e01-90a4-2619f1c82299 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:05:08.944061 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:08.959740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Transition to ACTIVE for port object 75098235-08b8-4e01-90a4-2619f1c82299 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:05:08.963918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:09.157483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Pushing event updated for resources: {'Port': ['ID=75098235-08b8-4e01-90a4-2619f1c82299,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:05:09.204818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Attempting to bind port 75098235-08b8-4e01-90a4-2619f1c82299 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:05:09.205058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Attempting to bind port 75098235-08b8-4e01-90a4-2619f1c82299 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:05:09.205354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Attempting to bind port 75098235-08b8-4e01-90a4-2619f1c82299 on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:05:09.210149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Port 75098235-08b8-4e01-90a4-2619f1c82299 on network 9475b307-5f43-40f6-b384-65417948d75d not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:05:09.210464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Attempting to bind port 75098235-08b8-4e01-90a4-2619f1c82299 on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:05:09.215882 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 4, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:05:09.216210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Checking segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:05:09.216585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Bound using segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:05:09.217011 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Bound port: 75098235-08b8-4e01-90a4-2619f1c82299, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:05:09.217353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:09.309285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:05:09.312727 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:05:09.317793 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:09.375599 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:09.376205 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:09.377602 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-7f76b204-717d-4585-9331-970f0157f293 service neutron] 10.222.0.84 "PUT /v2.0/ports/75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 1091 time: 0.9082687 May 12 16:05:09.378043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:05:09.406112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f76b204-717d-4585-9331-970f0157f293 service neutron] Pushing event updated for resources: {'Port': ['ID=75098235-08b8-4e01-90a4-2619f1c82299,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:05:09.436656 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5d0a05a0-6e36-4b89-aed2-d022b8741dd7'] response: {'name': 'network-changed', 'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299', 'status': 'completed', 'code': 200} May 12 16:05:09.639689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-6d911010-b648-4cad-9d9e-670bdabcda46 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:09.641128 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-6d911010-b648-4cad-9d9e-670bdabcda46 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 1094 time: 0.1901412 May 12 16:05:09.721369 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-9430f0d5-277b-4e4c-ad41-e7e774cd1685 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 217 time: 0.0606029 May 12 16:05:09.796680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-4d8f863e-412c-494b-9c43-7f5705e28af3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:09.798152 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-4d8f863e-412c-494b-9c43-7f5705e28af3 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0678144 May 12 16:05:09.826353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aee98c18-b444-4152-b30d-cd9e3085dd2a req-cf503942-a12e-48fe-aa41-f3566f57e139 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:09.828365 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aee98c18-b444-4152-b30d-cd9e3085dd2a req-cf503942-a12e-48fe-aa41-f3566f57e139 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 943 time: 0.0822408 May 12 16:05:09.876136 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aee98c18-b444-4152-b30d-cd9e3085dd2a req-a880e4e2-4dee-4567-82bd-d5ff3902e7f5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417566 May 12 16:05:09.879474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-1ba93c71-e63f-4e95-bd9c-9591b716064b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:09.880977 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-1ba93c71-e63f-4e95-bd9c-9591b716064b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0730464 May 12 16:05:10.020029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-9dbf750f-3f97-4a96-937c-8109f2e67be7 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1288037 May 12 16:05:10.159135 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af01108c-ab42-44fe-b2bb-ce0e5ffb5a10 req-41f46924-98e1-41fb-93ff-9de7f27fa8d6 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1304197 May 12 16:05:10.324675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e45e4a-bdb4-4375-af2c-7583d0b06d79 req-fc7bb970-9257-403f-b891-46f0f0fa2e11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:10.326169 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6e45e4a-bdb4-4375-af2c-7583d0b06d79 req-fc7bb970-9257-403f-b891-46f0f0fa2e11 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 1094 time: 0.0758648 May 12 16:05:10.481012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e45e4a-bdb4-4375-af2c-7583d0b06d79 req-5bbf91a6-77a7-4bcb-b095-bdf3f5ebcf42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:10.483128 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6e45e4a-bdb4-4375-af2c-7583d0b06d79 req-5bbf91a6-77a7-4bcb-b095-bdf3f5ebcf42 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1506395 May 12 16:05:10.550311 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6e45e4a-bdb4-4375-af2c-7583d0b06d79 req-43ece140-ae0b-4f40-bfdc-6ba25fbd80c0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 217 time: 0.0594864 May 12 16:05:10.616319 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e45e4a-bdb4-4375-af2c-7583d0b06d79 req-429f03a8-a2f0-406d-9450-a8a99b9b4ae8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:10.617774 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6e45e4a-bdb4-4375-af2c-7583d0b06d79 req-429f03a8-a2f0-406d-9450-a8a99b9b4ae8 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0609262 May 12 16:05:10.692940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e45e4a-bdb4-4375-af2c-7583d0b06d79 req-35410347-cb83-4ea8-be62-eba7854b2289 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:10.694387 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6e45e4a-bdb4-4375-af2c-7583d0b06d79 req-35410347-cb83-4ea8-be62-eba7854b2289 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0687900 May 12 16:05:10.825689 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6e45e4a-bdb4-4375-af2c-7583d0b06d79 req-439e4fc9-4cea-4c3e-bbee-dc3da70cd19a service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1245661 May 12 16:05:10.958803 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6e45e4a-bdb4-4375-af2c-7583d0b06d79 req-29421140-a47d-440d-8680-69414d97f04a service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1241903 May 12 16:05:11.169336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9453b2ee-2f55-4689-bfdf-7b018887d8d7 req-e4258adf-26e2-4888-ab3b-0782383a5f93 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:11.170720 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9453b2ee-2f55-4689-bfdf-7b018887d8d7 req-e4258adf-26e2-4888-ab3b-0782383a5f93 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 943 time: 0.1869819 May 12 16:05:11.216117 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9453b2ee-2f55-4689-bfdf-7b018887d8d7 req-0fc1eec4-7701-4de4-a041-d1d578088170 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395164 May 12 16:05:12.399685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e317a44-07f4-43b4-8086-945e701fe9ff req-8e541574-17a2-4b67-9779-a81281a68bd4 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:12.401107 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e317a44-07f4-43b4-8086-945e701fe9ff req-8e541574-17a2-4b67-9779-a81281a68bd4 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 943 time: 0.0811880 May 12 16:05:12.444088 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e317a44-07f4-43b4-8086-945e701fe9ff req-d40cf756-d9e1-45c2-8bb5-1223bbfe0911 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0366580 May 12 16:05:12.810840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 75098235-08b8-4e01-90a4-2619f1c82299 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:05:12.835562 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21374e38-5156-438b-8e19-7ac4fd867069 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:12.985426 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:05:12.997913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '75098235-08b8-4e01-90a4-2619f1c82299', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'port_id': '75098235-08b8-4e01-90a4-2619f1c82299', 'mac_address': 'fa:16:3e:5b:15:33', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 595, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:05:13.053860 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:13.070602 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 75098235-08b8-4e01-90a4-2619f1c82299 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:05:13.085127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:05:13.089010 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:13.153301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=75098235-08b8-4e01-90a4-2619f1c82299,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:05:13.160609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:05:13.160943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:05:13.161271 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:05:13.161624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:05:13.161946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:05:13.162262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:05:13.162577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:05:13.162890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:05:13.163202 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:05:13.163513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:05:13.163819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:05:13.164127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:05:13.451006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['75098235-08b8-4e01-90a4-2619f1c82299'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:05:13.632772 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e986ff1f-0a11-48fe-8b33-c43c5bffbb1c req-8ad69843-27d2-41c0-b8d3-8adb46e28a3d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:13.634483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e986ff1f-0a11-48fe-8b33-c43c5bffbb1c req-8ad69843-27d2-41c0-b8d3-8adb46e28a3d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.0798402 May 12 16:05:13.637703 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:13.682089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e986ff1f-0a11-48fe-8b33-c43c5bffbb1c req-073e8527-5326-45b4-9a54-3800a6aa58c4 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422056 May 12 16:05:14.830269 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 75098235-08b8-4e01-90a4-2619f1c82299 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:05:14.874346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa26c9d9-bf5e-42be-a0fe-42d193ca7312 req-4b0ea112-51d4-4bf7-9ce9-f684ff15e9e1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:14.876889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa26c9d9-bf5e-42be-a0fe-42d193ca7312 req-4b0ea112-51d4-4bf7-9ce9-f684ff15e9e1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.0892625 May 12 16:05:14.904458 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 75098235-08b8-4e01-90a4-2619f1c82299 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:05:14.909738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 75098235-08b8-4e01-90a4-2619f1c82299 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:05:14.910106 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:14.921903 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fa26c9d9-bf5e-42be-a0fe-42d193ca7312 req-3d95f1ec-9956-41ef-ae95-93e35d025921 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387671 May 12 16:05:15.026746 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:15.055093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:05:15.064969 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:05:15.069378 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:15.103915 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0563a65d-9bad-4ac4-b232-f2cae20a29aa'] response: {'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299', 'code': 200} May 12 16:05:15.146312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=75098235-08b8-4e01-90a4-2619f1c82299,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:05:15.269866 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1166bc31-ec8a-4469-bcf2-624c692d69c2 req-b6b54cfc-b205-4516-904e-b0fcda342435 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:15.271328 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1166bc31-ec8a-4469-bcf2-624c692d69c2 req-b6b54cfc-b205-4516-904e-b0fcda342435 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 1096 time: 0.0730658 May 12 16:05:15.314496 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1166bc31-ec8a-4469-bcf2-624c692d69c2 req-e25ce033-6423-4631-9415-2692587fc3ff service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0338526 May 12 16:05:15.371641 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5be68d10-41be-41ba-a438-a5947e5010fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:16.084814 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:16.117122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d755edec-6556-4c6e-a2c5-ff0cabf9cd36 req-1063e9b3-19c9-4253-9c9c-7375162c8c15 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:16.118599 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d755edec-6556-4c6e-a2c5-ff0cabf9cd36 req-1063e9b3-19c9-4253-9c9c-7375162c8c15 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0861256 May 12 16:05:16.164341 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d755edec-6556-4c6e-a2c5-ff0cabf9cd36 req-8f958a95-31c8-4e74-b4f7-9a6abfe01db8 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401082 May 12 16:05:16.360159 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:17.352419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef83c91e-e568-47e8-aecf-3b3f8e676ef2 req-b76700c9-4159-45b5-b079-770b36131a5d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:17.353880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef83c91e-e568-47e8-aecf-3b3f8e676ef2 req-b76700c9-4159-45b5-b079-770b36131a5d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0787535 May 12 16:05:17.397242 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef83c91e-e568-47e8-aecf-3b3f8e676ef2 req-864576cf-f552-45bd-bc83-a16d9c0ebcda tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373225 May 12 16:05:17.575833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af7297f2-9a05-4f87-b525-45c7f5f9b889 req-1094042a-2b28-409b-a839-ee012423f04b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:17.577378 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af7297f2-9a05-4f87-b525-45c7f5f9b889 req-1094042a-2b28-409b-a839-ee012423f04b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0831933 May 12 16:05:17.585881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53446) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:05:17.590636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-903314da-bd13-4561-8adc-538669e35ff9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Request body: {'floatingip': {'port_id': '75098235-08b8-4e01-90a4-2619f1c82299'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:05:17.667808 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-903314da-bd13-4561-8adc-538669e35ff9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:17.840367 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:18.256867 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-903314da-bd13-4561-8adc-538669e35ff9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:18.260763 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-903314da-bd13-4561-8adc-538669e35ff9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:18.536736 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-903314da-bd13-4561-8adc-538669e35ff9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d associated. External IP: 172.25.8.219, port: 75098235-08b8-4e01-90a4-2619f1c82299. May 12 16:05:18.898747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-903314da-bd13-4561-8adc-538669e35ff9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Router cd523971-49e8-4deb-9f61-a0342aee2763 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:05:19.082871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-903314da-bd13-4561-8adc-538669e35ff9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:05:19.087648 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-903314da-bd13-4561-8adc-538669e35ff9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:19.092139 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3df434f8-9538-4d28-8f5d-585ccc56fe44 None None] Sync routers for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:05:19.102133 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3df434f8-9538-4d28-8f5d-585ccc56fe44 None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:05:19.102724 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3df434f8-9538-4d28-8f5d-585ccc56fe44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:05:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:05:19.145576 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-903314da-bd13-4561-8adc-538669e35ff9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "PUT /v2.0/floatingips/6998d782-f9e2-4cb3-80a3-d55f6fa8888d HTTP/1.1" status: 200 len: 992 time: 1.5586154 May 12 16:05:19.146129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:05:19.196645 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-dc2599f0-7b8e-4e9b-9273-5385a7497d45'] response: {'name': 'network-changed', 'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299', 'status': 'completed', 'code': 200} May 12 16:05:19.318150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0da8fc57-2607-4c39-a09a-bf73493dd255 req-51993ade-1b19-47f9-96b1-74967e81f3d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:19.319843 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0da8fc57-2607-4c39-a09a-bf73493dd255 req-51993ade-1b19-47f9-96b1-74967e81f3d1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 1096 time: 0.0799060 May 12 16:05:19.355778 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-3df434f8-9538-4d28-8f5d-585ccc56fe44 None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:05:19.459771 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0da8fc57-2607-4c39-a09a-bf73493dd255 req-90bb0fbf-c477-4b5c-b608-344a9d7f5bc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:19.461160 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0da8fc57-2607-4c39-a09a-bf73493dd255 req-90bb0fbf-c477-4b5c-b608-344a9d7f5bc5 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1355422 May 12 16:05:19.584132 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0da8fc57-2607-4c39-a09a-bf73493dd255 req-e0a77817-02df-459f-9c5d-7edbe03fa6dd service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 1000 time: 0.1160176 May 12 16:05:19.654904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0da8fc57-2607-4c39-a09a-bf73493dd255 req-5d429d10-2419-46a5-b842-29ef9a0d5b40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:19.657182 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0da8fc57-2607-4c39-a09a-bf73493dd255 req-5d429d10-2419-46a5-b842-29ef9a0d5b40 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0629468 May 12 16:05:19.747541 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3df434f8-9538-4d28-8f5d-585ccc56fe44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '6998d782-f9e2-4cb3-80a3-d55f6fa8888d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'floating_ip_address': '172.25.8.219', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'port_id': '75098235-08b8-4e01-90a4-2619f1c82299', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4150, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'mac_address': 'fa:16:3e:5b:15:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:02:06Z', 'updated_at': '2022-05-12T16:05:18Z', 'revision_number': 13, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:05:19.752539 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3df434f8-9538-4d28-8f5d-585ccc56fe44 None None] Checking router: cd523971-49e8-4deb-9f61-a0342aee2763 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:05:19.764001 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3df434f8-9538-4d28-8f5d-585ccc56fe44 None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:05:19.764001 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3df434f8-9538-4d28-8f5d-585ccc56fe44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:05:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:05:19.853807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0da8fc57-2607-4c39-a09a-bf73493dd255 req-e4897040-4c7a-4f33-bb14-163769ed5850 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:19.855447 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0da8fc57-2607-4c39-a09a-bf73493dd255 req-e4897040-4c7a-4f33-bb14-163769ed5850 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1923704 May 12 16:05:19.953860 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-3df434f8-9538-4d28-8f5d-585ccc56fe44 None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:05:19.988971 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0da8fc57-2607-4c39-a09a-bf73493dd255 req-180eb980-f6ce-4326-98cc-263190ec72d3 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1270077 May 12 16:05:20.129607 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0da8fc57-2607-4c39-a09a-bf73493dd255 req-1a936682-e9a8-4e96-960c-91432587a7e1 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1339817 May 12 16:05:20.322190 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3df434f8-9538-4d28-8f5d-585ccc56fe44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '6998d782-f9e2-4cb3-80a3-d55f6fa8888d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'floating_ip_address': '172.25.8.219', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'port_id': '75098235-08b8-4e01-90a4-2619f1c82299', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4150, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'mac_address': 'fa:16:3e:5b:15:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:02:06Z', 'updated_at': '2022-05-12T16:05:18Z', 'revision_number': 13, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:05:20.326387 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3df434f8-9538-4d28-8f5d-585ccc56fe44 None None] The sync data for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 is: [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '6998d782-f9e2-4cb3-80a3-d55f6fa8888d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'floating_ip_address': '172.25.8.219', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'port_id': '75098235-08b8-4e01-90a4-2619f1c82299', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4150, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'mac_address': 'fa:16:3e:5b:15:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:02:06Z', 'updated_at': '2022-05-12T16:05:18Z', 'revision_number': 13, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:05:20.523491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5517d435-cd70-4d52-a67d-b2064ab314d2 None None] New status for floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:05:20.844418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb2966d3-cd62-4610-8151-2a0c49bf4989 req-674076d7-8808-4f80-b174-501fdbf2b76a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:20.845890 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb2966d3-cd62-4610-8151-2a0c49bf4989 req-674076d7-8808-4f80-b174-501fdbf2b76a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0818245 May 12 16:05:20.889329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb2966d3-cd62-4610-8151-2a0c49bf4989 req-34e6409b-eb37-47be-b8bb-5aa82e1148cd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376461 May 12 16:05:27.281959 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3884ee00-5948-46ae-bd17-cbb8e267b9ea req-e98d26cd-b9aa-405c-b55b-8416459a8101 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0419500 May 12 16:05:27.393162 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3884ee00-5948-46ae-bd17-cbb8e267b9ea req-2d4767a4-1a64-4f89-beb7-02e90c4abc1a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0455918 May 12 16:05:27.435657 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3884ee00-5948-46ae-bd17-cbb8e267b9ea req-f2c8ca6a-a53f-4f00-a34d-c5947a6898af service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0250046 May 12 16:05:27.571973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3884ee00-5948-46ae-bd17-cbb8e267b9ea req-f2b07bee-420f-4282-bb12-ba310ee42411 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:27.573321 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3884ee00-5948-46ae-bd17-cbb8e267b9ea req-f2b07bee-420f-4282-bb12-ba310ee42411 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1327817 May 12 16:05:32.841696 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:35.888049 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-98417364-40a2-4d03-b15e-66c48b4e5612 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1309958 May 12 16:05:35.904194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d45398-1132-4b16-8f51-95cbb27f1017 req-db575104-0ad5-4b67-921e-37c59fa91b92 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:35.905793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60d45398-1132-4b16-8f51-95cbb27f1017 req-db575104-0ad5-4b67-921e-37c59fa91b92 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0946157 May 12 16:05:35.951077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60d45398-1132-4b16-8f51-95cbb27f1017 req-a164216a-c1d9-4156-a133-293044fd965b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386918 May 12 16:05:37.122027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-3416ed1f-d42e-4a86-a4f1-b56897667e55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:37.123530 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-3416ed1f-d42e-4a86-a4f1-b56897667e55 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 1096 time: 0.0719085 May 12 16:05:37.149532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44857bb9-2146-41fc-9771-830419a5c4aa req-7ae29fb7-0312-4375-9547-776ad8727553 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:37.150981 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44857bb9-2146-41fc-9771-830419a5c4aa req-7ae29fb7-0312-4375-9547-776ad8727553 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0848069 May 12 16:05:37.195563 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-44857bb9-2146-41fc-9771-830419a5c4aa req-d5d5c9b4-7538-403e-8556-8ab681fcdba7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381703 May 12 16:05:37.263765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-175d1da8-c1cb-44a5-9463-6dade8748fb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:37.265912 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-175d1da8-c1cb-44a5-9463-6dade8748fb3 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1361947 May 12 16:05:37.370479 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-123b619e-02b7-4553-8801-9ae4e612ef20 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 1002 time: 0.0979896 May 12 16:05:37.435256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-09ab36fe-4716-4e7d-a07d-3dd13ed88a4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:37.437232 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-09ab36fe-4716-4e7d-a07d-3dd13ed88a4b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0576727 May 12 16:05:37.517348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-12d900fe-9e69-43be-aeee-09fecc83b136 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:37.518763 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-12d900fe-9e69-43be-aeee-09fecc83b136 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0742924 May 12 16:05:37.654416 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-bdac102e-aceb-49d7-814b-c9c5b3311a38 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1284869 May 12 16:05:37.793248 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-162c0ab3-5f78-4497-97f3-beb2782e945e service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1310740 May 12 16:05:37.968985 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:05:38.387742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3f658fc-31a6-4b8d-b71e-ceab81e25785 req-8d2d4722-8fb8-47dc-802c-bbfc0f2237c9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:38.389750 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3f658fc-31a6-4b8d-b71e-ceab81e25785 req-8d2d4722-8fb8-47dc-802c-bbfc0f2237c9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0831239 May 12 16:05:38.435327 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e3f658fc-31a6-4b8d-b71e-ceab81e25785 req-0fe77392-2991-441d-a390-f9399b2715bb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399790 May 12 16:05:39.634697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bfc1d83-9cb1-49fc-84f7-9a85d1b0921e req-a93c72c0-6ccd-4bd6-a5c0-8f8edf08e5a3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:39.636053 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1bfc1d83-9cb1-49fc-84f7-9a85d1b0921e req-a93c72c0-6ccd-4bd6-a5c0-8f8edf08e5a3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0851808 May 12 16:05:39.680152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1bfc1d83-9cb1-49fc-84f7-9a85d1b0921e req-18aa36b1-d594-4601-a730-d95152f9fdc5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385110 May 12 16:05:40.870976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-befcbba1-9805-43fd-93eb-67d7cf0d116e req-c06ec91b-59b9-4760-b603-1191af2cc5c2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:40.872400 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-befcbba1-9805-43fd-93eb-67d7cf0d116e req-c06ec91b-59b9-4760-b603-1191af2cc5c2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0821793 May 12 16:05:40.920638 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-befcbba1-9805-43fd-93eb-67d7cf0d116e req-f49ab3a7-1220-4863-b5a9-7778120b5ac3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423234 May 12 16:05:42.106068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad1c5e2-d0b1-4ec5-a400-6b14ec778eaa req-a78e39d3-e5e1-4fbb-8134-82485b096562 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:42.107475 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ad1c5e2-d0b1-4ec5-a400-6b14ec778eaa req-a78e39d3-e5e1-4fbb-8134-82485b096562 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0786295 May 12 16:05:42.150641 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ad1c5e2-d0b1-4ec5-a400-6b14ec778eaa req-7a0cfad3-a42f-4b60-baf2-8d8aa3c24e50 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371954 May 12 16:05:42.829496 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-32d09169-bf31-4643-ab4e-1790c4baca2a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:43.340434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e5a96f-ebfb-4a6c-9da4-27b608b052fe req-3a4af7ed-8678-4392-9bf8-81d17e28a227 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:43.341865 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70e5a96f-ebfb-4a6c-9da4-27b608b052fe req-3a4af7ed-8678-4392-9bf8-81d17e28a227 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0821972 May 12 16:05:43.494291 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70e5a96f-ebfb-4a6c-9da4-27b608b052fe req-52e3b2a4-b757-4b9b-8d90-1eb0d5f4f6b5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1466722 May 12 16:05:43.644962 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:44.676935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78c5b66b-b193-4710-a6b5-2f067093c37b req-e4701de2-fe82-4a4e-a016-8bfc27f29778 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:44.678798 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78c5b66b-b193-4710-a6b5-2f067093c37b req-e4701de2-fe82-4a4e-a016-8bfc27f29778 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0797839 May 12 16:05:44.723029 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78c5b66b-b193-4710-a6b5-2f067093c37b req-3741ddc3-206b-406a-83f6-4af09bff1432 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387013 May 12 16:05:45.374330 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4e9cdfc-1182-4a9d-960a-d512ca3e1020 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:45.909119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f6b4d1b-255c-4d71-ab4a-5424acb1fa99 req-31ed4056-1c72-4709-8bed-e7c9f13e26f9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:45.910584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f6b4d1b-255c-4d71-ab4a-5424acb1fa99 req-31ed4056-1c72-4709-8bed-e7c9f13e26f9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0822055 May 12 16:05:45.953986 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f6b4d1b-255c-4d71-ab4a-5424acb1fa99 req-26df6d32-1a9b-44f0-9f79-6b102cf67df3 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377746 May 12 16:05:46.087101 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:46.361935 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:47.134501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7630c09b-5b94-4f40-80af-8dca2af4d5a7 req-2f9819a0-4801-4a31-bdbb-61670720801c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:47.135932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7630c09b-5b94-4f40-80af-8dca2af4d5a7 req-2f9819a0-4801-4a31-bdbb-61670720801c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0790205 May 12 16:05:47.182907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7630c09b-5b94-4f40-80af-8dca2af4d5a7 req-85ace420-46f2-4640-bf3b-276fe9305abd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407414 May 12 16:05:47.843276 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:48.373945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584e87c1-8910-408f-a2c2-61588f3f653b req-98f74004-4527-47e6-abe6-206c6de3d4e1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:48.375402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-584e87c1-8910-408f-a2c2-61588f3f653b req-98f74004-4527-47e6-abe6-206c6de3d4e1 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0811296 May 12 16:05:48.417722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-584e87c1-8910-408f-a2c2-61588f3f653b req-6cb656b4-9d0d-4793-8707-fd58d7c2086a tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0366318 May 12 16:05:49.609729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b88c3826-8e7f-479e-afa8-460bb3e51d5f req-ea2c26a2-35fb-468c-bf5f-51f8d1e19b49 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:49.611090 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b88c3826-8e7f-479e-afa8-460bb3e51d5f req-ea2c26a2-35fb-468c-bf5f-51f8d1e19b49 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0846477 May 12 16:05:49.655527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b88c3826-8e7f-479e-afa8-460bb3e51d5f req-017a76ae-92ff-414f-98df-1fce8b3d40e5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383213 May 12 16:05:50.135707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ed6339a-1bbb-4222-be01-45277ec496cc req-f975e17a-4926-4593-a51b-18c93b3d44d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:50.137240 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2ed6339a-1bbb-4222-be01-45277ec496cc req-f975e17a-4926-4593-a51b-18c93b3d44d3 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 1096 time: 0.0686347 May 12 16:05:50.329960 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ed6339a-1bbb-4222-be01-45277ec496cc req-c682ff79-ced0-406e-8992-598402759f0e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:50.331389 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2ed6339a-1bbb-4222-be01-45277ec496cc req-c682ff79-ced0-406e-8992-598402759f0e service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1388533 May 12 16:05:50.552153 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2ed6339a-1bbb-4222-be01-45277ec496cc req-6c7f5f59-06f2-43f9-a4a2-d1714bceb7ad service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 1002 time: 0.2138400 May 12 16:05:50.622241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ed6339a-1bbb-4222-be01-45277ec496cc req-4c3b0fb9-3ef2-45c1-aebe-1613a7d08fc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:50.624289 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2ed6339a-1bbb-4222-be01-45277ec496cc req-4c3b0fb9-3ef2-45c1-aebe-1613a7d08fc1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0606921 May 12 16:05:50.706254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ed6339a-1bbb-4222-be01-45277ec496cc req-ff50509f-f155-4477-a12b-d3d2299faa0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:50.707732 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2ed6339a-1bbb-4222-be01-45277ec496cc req-ff50509f-f155-4477-a12b-d3d2299faa0b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0717754 May 12 16:05:50.848970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2ed6339a-1bbb-4222-be01-45277ec496cc req-666aaac1-0bd0-404a-ac46-2a02432add48 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1303196 May 12 16:05:50.917979 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e90dd73-5849-4710-ac72-7ed243e1c89e req-bc182b2f-64b9-44a3-83f9-bb149552f309 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:50.919418 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e90dd73-5849-4710-ac72-7ed243e1c89e req-bc182b2f-64b9-44a3-83f9-bb149552f309 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.1497176 May 12 16:05:50.920978 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-b44be00c-a664-4467-9309-27a562418e80 service neutron] show failed (client error): The resource could not be found. May 12 16:05:50.921973 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-b44be00c-a664-4467-9309-27a562418e80 service neutron] 10.222.0.84 "GET /v2.0/ports/75098235-08b8-4e01-90a4-2619f1c82299/bindings/n-h2-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.1087353 May 12 16:05:50.968128 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e90dd73-5849-4710-ac72-7ed243e1c89e req-6ae40b73-3a52-4075-a090-3d4164271bab tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417695 May 12 16:05:50.988526 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2ed6339a-1bbb-4222-be01-45277ec496cc req-b036c76e-5100-4ec6-a3c2-e5bfdad54860 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1303439 May 12 16:05:51.205625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-6687567b-0070-4bf9-9633-7d53e0c81e90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:51.207089 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-6687567b-0070-4bf9-9633-7d53e0c81e90 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f&tenant_id=22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 1096 time: 0.0771523 May 12 16:05:51.217241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Request body: {'port': {'binding:host_id': 'n-h2-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:05:51.329593 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:51.607161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:05:51.635810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:05:51.698983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:05:51.705960 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:51.721610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Transition to ACTIVE for port object 75098235-08b8-4e01-90a4-2619f1c82299 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:05:51.725604 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:51.769031 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-11896c8e-c91d-4904-b4c4-f06f7f659df2'] response: {'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299', 'code': 200} May 12 16:05:51.877206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Pushing event updated for resources: {'Port': ['ID=75098235-08b8-4e01-90a4-2619f1c82299,revision_number=6']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:05:51.925172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] No DVR routers for this DVR port 75098235-08b8-4e01-90a4-2619f1c82299 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:05:52.150692 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Attempting to bind port 75098235-08b8-4e01-90a4-2619f1c82299 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:05:52.150923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Attempting to bind port 75098235-08b8-4e01-90a4-2619f1c82299 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:05:52.151247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Attempting to bind port 75098235-08b8-4e01-90a4-2619f1c82299 on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:05:52.156358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Port 75098235-08b8-4e01-90a4-2619f1c82299 on network 9475b307-5f43-40f6-b384-65417948d75d not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:05:52.156668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Attempting to bind port 75098235-08b8-4e01-90a4-2619f1c82299 on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:05:52.161706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 5, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:05:52.161841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b285ed6-c19c-4a48-9c5b-b5490e6c90de req-0f419177-a37b-4b72-a7e4-fd701df27278 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:52.162307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Checking segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:05:52.162415 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Bound using segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:05:52.162812 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Bound port: 75098235-08b8-4e01-90a4-2619f1c82299, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:05:52.163159 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:52.163296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b285ed6-c19c-4a48-9c5b-b5490e6c90de req-0f419177-a37b-4b72-a7e4-fd701df27278 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 943 time: 0.0819392 May 12 16:05:52.211731 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b285ed6-c19c-4a48-9c5b-b5490e6c90de req-ba09faf9-2c44-482b-abdf-2c7f03e91b92 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428305 May 12 16:05:52.368227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:05:52.371311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:05:52.376061 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:52.435913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:52.437135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:05:52.438469 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] 10.222.0.76 "PUT /v2.0/ports/75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 1091 time: 1.2250469 May 12 16:05:52.454791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4917cdf0-2085-4755-8a50-830f819e231a service neutron] Pushing event updated for resources: {'Port': ['ID=75098235-08b8-4e01-90a4-2619f1c82299,revision_number=7']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:05:52.542794 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-8fef11b1-f6b2-4a30-bc36-7f33e71f6f56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:52.542794 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-8fef11b1-f6b2-4a30-bc36-7f33e71f6f56 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 1094 time: 0.0738323 May 12 16:05:52.672767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-2dc9a872-8071-42d7-81e1-ee40d20e551a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:52.674253 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-2dc9a872-8071-42d7-81e1-ee40d20e551a service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1284850 May 12 16:05:52.776789 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-ecc7e9f3-2868-494e-b1b4-5b351b3e8470 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 1000 time: 0.0970287 May 12 16:05:52.839977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-1f7d814a-3ac7-402b-8ed1-944c381cc3f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:52.841422 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-1f7d814a-3ac7-402b-8ed1-944c381cc3f8 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0592976 May 12 16:05:52.922881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-0b885588-4f46-4302-bdbb-75f3998d27ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:52.924368 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-0b885588-4f46-4302-bdbb-75f3998d27ff service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0775106 May 12 16:05:53.056991 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-a67efaa7-c579-4518-a6da-430d75ceef85 service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1268768 May 12 16:05:53.197839 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-45844ccd-5aee-4e4d-bd83-79209ea7182d service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1348422 May 12 16:05:53.407521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8c8e16b-0b0d-4b34-9cd0-77cec53c26eb req-d1a45e3a-24b2-4512-9616-2c4391b6d887 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:53.408996 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8c8e16b-0b0d-4b34-9cd0-77cec53c26eb req-d1a45e3a-24b2-4512-9616-2c4391b6d887 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 943 time: 0.0840116 May 12 16:05:53.455196 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8c8e16b-0b0d-4b34-9cd0-77cec53c26eb req-f9543d40-ebd7-4b02-8a72-258ad830a3b8 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405416 May 12 16:05:53.769966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:05:53.829275 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-20c23135-7422-464d-972e-baef42534ab0'] response: {'name': 'network-changed', 'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299', 'status': 'completed', 'code': 200} May 12 16:05:53.977733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-d869b7a1-0d40-42b0-addf-93e513f34ada service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:53.979240 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-d869b7a1-0d40-42b0-addf-93e513f34ada service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 1094 time: 0.1345966 May 12 16:05:53.988171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-7c564d34-dc86-43fe-985d-3093b7a67496 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:53.989621 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-7c564d34-dc86-43fe-985d-3093b7a67496 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 1094 time: 0.1012859 May 12 16:05:54.229990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-5613c9bb-0b6e-4af5-bad6-2de1f610fa9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:54.231448 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-5613c9bb-0b6e-4af5-bad6-2de1f610fa9b service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2459071 May 12 16:05:54.234198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-8f8d6024-e248-47b9-92d3-9b74c6687f3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:54.235636 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-8f8d6024-e248-47b9-92d3-9b74c6687f3b service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2283313 May 12 16:05:54.560939 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-80537ed1-853a-4907-9f32-f9a00527d181 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 1000 time: 0.3228681 May 12 16:05:54.563505 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-92d90ce1-105b-470e-ab01-a0fff17763c9 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 1000 time: 0.2779465 May 12 16:05:54.668544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70c5c12b-7210-4255-9810-5e68683b0f9a req-e310cb72-f42c-4593-a225-88fce395d574 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:54.670076 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70c5c12b-7210-4255-9810-5e68683b0f9a req-e310cb72-f42c-4593-a225-88fce395d574 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 943 time: 0.0865786 May 12 16:05:54.672602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-9fa36126-65b3-4b21-92e6-205a236cc55a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:54.675535 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-9fa36126-65b3-4b21-92e6-205a236cc55a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.1073678 May 12 16:05:54.675535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-00d75370-09fe-42f3-a30b-95abbb9b996d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:54.676561 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-00d75370-09fe-42f3-a30b-95abbb9b996d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0801334 May 12 16:05:54.719448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-70c5c12b-7210-4255-9810-5e68683b0f9a req-8c65d9af-5dd8-4b19-93b5-f148dc727ac7 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436442 May 12 16:05:54.831268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-f8f125a9-4824-4ed6-ba39-f2df0588adb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:54.832792 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-f8f125a9-4824-4ed6-ba39-f2df0588adb1 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1497159 May 12 16:05:54.834938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-ecc6001d-1c64-4adf-ae35-325d02c1d2a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:54.836365 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-ecc6001d-1c64-4adf-ae35-325d02c1d2a1 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1076412 May 12 16:05:54.987641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 75098235-08b8-4e01-90a4-2619f1c82299 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:05:55.045379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 75098235-08b8-4e01-90a4-2619f1c82299 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:05:55.086154 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-01ca2bd2-77f7-4874-bf26-49216be5d68d service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2466712 May 12 16:05:55.089056 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-074ddbfa-e182-4982-ac3d-e01a9b78181a service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2279930 May 12 16:05:55.351900 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-3349ac9f-caa6-4536-8da9-e0310f852343 service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2590089 May 12 16:05:55.353794 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e7fcad76-d1c4-43ec-aa14-428ab3006a64 req-3b3ef5fc-31c7-423d-9549-eedda439018d service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2430124 May 12 16:05:55.916136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3241bb9e-9a3a-470d-ae0c-594e248e486c req-7a792ad1-cfa4-4ca7-992e-f2d15c573a1b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:55.917610 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3241bb9e-9a3a-470d-ae0c-594e248e486c req-7a792ad1-cfa4-4ca7-992e-f2d15c573a1b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 943 time: 0.0814159 May 12 16:05:55.963240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3241bb9e-9a3a-470d-ae0c-594e248e486c req-7ef0ea30-574b-4909-bcca-dbd3e2c7c077 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392904 May 12 16:05:57.309222 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e6626a3-6314-4d9b-a2ce-c63860a4e8b2 req-742c303e-ca87-44d5-9d76-fc8631d0a19f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:57.311103 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e6626a3-6314-4d9b-a2ce-c63860a4e8b2 req-742c303e-ca87-44d5-9d76-fc8631d0a19f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 943 time: 0.0901270 May 12 16:05:57.355257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8e6626a3-6314-4d9b-a2ce-c63860a4e8b2 req-c6551a4d-8e78-48f3-a3b6-cabf490ce628 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380683 May 12 16:05:58.539636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-773f37cc-0ce9-4f6f-9c3c-47855b207f9b req-8dfb3d66-d477-4df2-a945-5e89bc6fa1dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:58.540989 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-773f37cc-0ce9-4f6f-9c3c-47855b207f9b req-8dfb3d66-d477-4df2-a945-5e89bc6fa1dc tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 943 time: 0.0817130 May 12 16:05:58.589887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-773f37cc-0ce9-4f6f-9c3c-47855b207f9b req-28949bf1-ea8c-48d5-8843-6037bce4d769 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426862 May 12 16:05:59.780620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dfc690d-88d9-40d8-af87-c4796f43c783 req-72de540c-8bbc-48f2-bbe3-d789c70687bd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:05:59.782630 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8dfc690d-88d9-40d8-af87-c4796f43c783 req-72de540c-8bbc-48f2-bbe3-d789c70687bd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 943 time: 0.0829356 May 12 16:05:59.838125 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8dfc690d-88d9-40d8-af87-c4796f43c783 req-a1cf706d-1e63-491a-8948-aa33b305de56 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497668 May 12 16:06:01.029118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c54ecda-3867-4e6e-9ce3-4715551dee97 req-2ddaf6cc-81c1-4195-bb89-14d1457336d5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:01.030837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1c54ecda-3867-4e6e-9ce3-4715551dee97 req-2ddaf6cc-81c1-4195-bb89-14d1457336d5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 943 time: 0.0826344 May 12 16:06:01.074858 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1c54ecda-3867-4e6e-9ce3-4715551dee97 req-fdbbd310-578f-4b66-ad7a-3578d3f5f143 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382264 May 12 16:06:02.263962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f302b0c7-13d2-424a-8f8d-743f39a1dfdd req-e1436d94-fd8d-4569-8aba-0398ea76db4f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:02.265427 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f302b0c7-13d2-424a-8f8d-743f39a1dfdd req-e1436d94-fd8d-4569-8aba-0398ea76db4f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 943 time: 0.0822957 May 12 16:06:02.308811 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f302b0c7-13d2-424a-8f8d-743f39a1dfdd req-a4629c8b-4df5-4fd4-812e-7aeca609e3b2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375638 May 12 16:06:02.686384 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 75098235-08b8-4e01-90a4-2619f1c82299 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:06:02.713207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-86901693-945f-4847-af73-724e88f2bfdd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:02.713966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-86901693-945f-4847-af73-724e88f2bfdd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Synchronizing usage tracker for tenant:22f425833dc74d6b985912b8d7db7222 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:06:02.730749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-86901693-945f-4847-af73-724e88f2bfdd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Unset dirty status for tenant:22f425833dc74d6b985912b8d7db7222 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:06:02.732082 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-86901693-945f-4847-af73-724e88f2bfdd tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.76 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f&tenant_id=22f425833dc74d6b985912b8d7db7222&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 943 time: 0.1076262 May 12 16:06:02.771025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b15d717-c61e-490e-9b84-70b7aac65f56 req-813c8a99-d7f4-4099-b35e-1fc4780ced9f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:02.772509 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7b15d717-c61e-490e-9b84-70b7aac65f56 req-813c8a99-d7f4-4099-b35e-1fc4780ced9f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 943 time: 0.0922379 May 12 16:06:02.816608 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-2ac7ce86-82bf-4822-8776-7e556076a4b2 service neutron] 10.222.0.76 "GET /v2.0/ports/75098235-08b8-4e01-90a4-2619f1c82299/bindings/n-h2-841483-1 HTTP/1.1" status: 200 len: 382 time: 0.0790284 May 12 16:06:02.819988 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7b15d717-c61e-490e-9b84-70b7aac65f56 req-335283b8-1f74-4fe6-af86-adc0d472a68e tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418079 May 12 16:06:02.835760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:02.856142 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '75098235-08b8-4e01-90a4-2619f1c82299', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'port_id': '75098235-08b8-4e01-90a4-2619f1c82299', 'mac_address': 'fa:16:3e:5b:15:33', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 595, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:06:02.894838 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:02.910656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-b6cddb98-f124-442c-b494-1062c91158ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:02.912103 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-b6cddb98-f124-442c-b494-1062c91158ad service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 1094 time: 0.0711036 May 12 16:06:02.913529 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:02.930484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 75098235-08b8-4e01-90a4-2619f1c82299 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:06:02.946510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:02.950386 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:03.052317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-2945a25c-5c0e-4c62-aebd-0d16592bd4f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:03.053794 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-2945a25c-5c0e-4c62-aebd-0d16592bd4f8 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1352153 May 12 16:06:03.063460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=75098235-08b8-4e01-90a4-2619f1c82299,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:03.161943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['75098235-08b8-4e01-90a4-2619f1c82299'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:06:03.163165 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-d141ac8f-4ad9-4a74-aa7b-2a710ecd2e53 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 1001 time: 0.1025052 May 12 16:06:03.229984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-b68b4b5d-4053-42dc-8286-4d1d208bc6d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:03.231429 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-b68b4b5d-4053-42dc-8286-4d1d208bc6d7 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0615361 May 12 16:06:03.306636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-ae3b1d2c-6923-4041-899f-1e068cd433f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:03.308103 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-ae3b1d2c-6923-4041-899f-1e068cd433f9 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0708802 May 12 16:06:03.441845 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-858ef989-6113-480a-92da-a5fca3fc576a service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1272292 May 12 16:06:03.695323 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-e84fa07d-cd16-41e0-956e-1ac46c36e8fe service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2465487 May 12 16:06:04.004813 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae49ef5d-dc39-4e3a-8630-d42d83e2c71e req-b73478d5-80f1-4267-997b-31c4001676df tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:04.006271 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae49ef5d-dc39-4e3a-8630-d42d83e2c71e req-b73478d5-80f1-4267-997b-31c4001676df tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.0800092 May 12 16:06:04.050485 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae49ef5d-dc39-4e3a-8630-d42d83e2c71e req-34d16b68-dff0-4dd4-af9c-412e953d3e47 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385830 May 12 16:06:04.697084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 75098235-08b8-4e01-90a4-2619f1c82299 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:06:04.765273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 75098235-08b8-4e01-90a4-2619f1c82299 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:06:04.770643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 75098235-08b8-4e01-90a4-2619f1c82299 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:06:04.771010 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:04.885826 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:04.912694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:06:04.923644 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:04.928469 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:04.972949 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5e2c4d2c-4d0f-4e58-90be-9e98a165acde'] response: {'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299', 'code': 200} May 12 16:06:04.998010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=75098235-08b8-4e01-90a4-2619f1c82299,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:05.248492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce5de396-b6dd-4fad-a76c-0228635077e5 req-f36ed8f2-32ce-4f46-95f0-f7b3677fd2c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:05.249950 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce5de396-b6dd-4fad-a76c-0228635077e5 req-f36ed8f2-32ce-4f46-95f0-f7b3677fd2c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0846066 May 12 16:06:05.293784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce5de396-b6dd-4fad-a76c-0228635077e5 req-158b5ee3-1e14-4133-8dfa-8a53f9a86cb5 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375352 May 12 16:06:06.380598 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-07d5b812-9843-47ea-9180-36068e8284c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:06.382038 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-07d5b812-9843-47ea-9180-36068e8284c1 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f&tenant_id=22f425833dc74d6b985912b8d7db7222 HTTP/1.1" status: 200 len: 1096 time: 0.0756536 May 12 16:06:06.406741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:06:06.484173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5a430aa-5318-4e1c-a4d8-881f11bfea9c req-eedf7839-8099-48f3-88d6-dbaa32597b3c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:06.486411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5a430aa-5318-4e1c-a4d8-881f11bfea9c req-eedf7839-8099-48f3-88d6-dbaa32597b3c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0813317 May 12 16:06:06.517217 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:06.534010 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5a430aa-5318-4e1c-a4d8-881f11bfea9c req-bc971a4b-ea4d-44a3-9870-29aa20c17250 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418873 May 12 16:06:06.791933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:06.821035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:06:06.882698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:06:06.888478 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:06.903725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Transition to ACTIVE for port object 75098235-08b8-4e01-90a4-2619f1c82299 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:06:06.907839 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:06.949325 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-cee2ba4f-e6ca-4a60-a2e2-4b65485a6c0c'] response: {'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299', 'code': 200} May 12 16:06:07.057753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Pushing event updated for resources: {'Port': ['ID=75098235-08b8-4e01-90a4-2619f1c82299,revision_number=10']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:07.070952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:07.071296 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:07.071633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:07.071971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:07.072302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:07.072627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:07.072954 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:07.073306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:07.073629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:07.073950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:07.074270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:07.074588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:07.118480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] No DVR routers for this DVR port 75098235-08b8-4e01-90a4-2619f1c82299 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:06:07.341804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Attempting to bind port 75098235-08b8-4e01-90a4-2619f1c82299 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:06:07.342045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Attempting to bind port 75098235-08b8-4e01-90a4-2619f1c82299 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:06:07.342363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Attempting to bind port 75098235-08b8-4e01-90a4-2619f1c82299 on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:06:07.348081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Port 75098235-08b8-4e01-90a4-2619f1c82299 on network 9475b307-5f43-40f6-b384-65417948d75d not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:06:07.348390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Attempting to bind port 75098235-08b8-4e01-90a4-2619f1c82299 on network 9475b307-5f43-40f6-b384-65417948d75d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:06:07.353346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 5, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:06:07.353700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Checking segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:06:07.354073 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Bound using segment: {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:06:07.354483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Bound port: 75098235-08b8-4e01-90a4-2619f1c82299, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b5e092c9-3496-44dd-842e-3dc14179b327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 595, 'network_id': '9475b307-5f43-40f6-b384-65417948d75d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:06:07.354817 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:07.442314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:06:07.445126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:06:07.449683 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:07.508514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:07.509129 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:07.510536 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] 10.222.0.84 "PUT /v2.0/ports/75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 1092 time: 1.1079278 May 12 16:06:07.526204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-918f0c73-d0cf-427b-944b-01a2556b5681 service neutron] Pushing event updated for resources: {'Port': ['ID=75098235-08b8-4e01-90a4-2619f1c82299,revision_number=11']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:07.630572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-9708d802-f1a2-42a6-b17b-d7311984bf45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:07.632353 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-9708d802-f1a2-42a6-b17b-d7311984bf45 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 1095 time: 0.0816977 May 12 16:06:07.730580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ec9baca-c524-43f1-a7da-8e18d9451b5f req-84a8a160-4f38-4844-8fed-065375d02726 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:07.732087 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2ec9baca-c524-43f1-a7da-8e18d9451b5f req-84a8a160-4f38-4844-8fed-065375d02726 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.0845592 May 12 16:06:07.776272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-c5a01f88-d179-406c-94e9-a186d6770c00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:07.776999 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2ec9baca-c524-43f1-a7da-8e18d9451b5f req-51097118-2be5-482e-b1ff-1cd72b3e2856 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380497 May 12 16:06:07.777637 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-c5a01f88-d179-406c-94e9-a186d6770c00 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.1353700 May 12 16:06:07.997767 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-9d6ac10e-ce09-4b06-9f11-c47893987d7c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 1000 time: 0.2105968 May 12 16:06:08.061980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-98e67faa-2e34-4894-bc13-2e53feb191a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:08.063432 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-98e67faa-2e34-4894-bc13-2e53feb191a7 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0564466 May 12 16:06:08.140249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-d7732b15-0476-484f-89ed-a7315479b1ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:08.142326 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-d7732b15-0476-484f-89ed-a7315479b1ac service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0693932 May 12 16:06:08.277024 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-e62d45eb-d86a-4fef-b99a-fec027d02600 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1253226 May 12 16:06:08.414413 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b7fb3336-027e-4b82-8de2-20f2e65b86a8 req-6ab47378-e8f3-49b9-93cd-03f884dbda31 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1256800 May 12 16:06:08.702301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 75098235-08b8-4e01-90a4-2619f1c82299 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:06:08.762617 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 75098235-08b8-4e01-90a4-2619f1c82299 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:06:08.951121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:06:09.013231 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a47a5249-ea3e-406e-82d8-f23b2654d312'] response: {'name': 'network-changed', 'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299', 'status': 'completed', 'code': 200} May 12 16:06:09.084549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4f9e6d6-965d-4a8a-9edb-ed1ddf35a697 req-de1a0d58-fea7-4600-80d3-37cf759d66bb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:09.086371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4f9e6d6-965d-4a8a-9edb-ed1ddf35a697 req-de1a0d58-fea7-4600-80d3-37cf759d66bb tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.2002010 May 12 16:06:09.147038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4f9e6d6-965d-4a8a-9edb-ed1ddf35a697 req-af158713-7bce-4aff-912f-1cb3486961f2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0548131 May 12 16:06:09.174344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381cf592-69fb-4911-b4dd-647215b532ce req-caeb498b-aa94-498e-bed5-cb2bcc05fdf5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:09.176051 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-381cf592-69fb-4911-b4dd-647215b532ce req-caeb498b-aa94-498e-bed5-cb2bcc05fdf5 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 1095 time: 0.1041615 May 12 16:06:09.182662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381cf592-69fb-4911-b4dd-647215b532ce req-2b3d5dd3-532d-4bbb-bb7e-79a035effb40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:09.184106 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-381cf592-69fb-4911-b4dd-647215b532ce req-2b3d5dd3-532d-4bbb-bb7e-79a035effb40 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=22f425833dc74d6b985912b8d7db7222&device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 1095 time: 0.1525431 May 12 16:06:09.441636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381cf592-69fb-4911-b4dd-647215b532ce req-2913cee4-8310-442b-8ea7-b2df89fd79a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:09.443085 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-381cf592-69fb-4911-b4dd-647215b532ce req-2913cee4-8310-442b-8ea7-b2df89fd79a9 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2574735 May 12 16:06:09.444168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381cf592-69fb-4911-b4dd-647215b532ce req-ef570369-f795-4ac9-9d79-0eb3b4c14e2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:09.445659 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-381cf592-69fb-4911-b4dd-647215b532ce req-ef570369-f795-4ac9-9d79-0eb3b4c14e2c service neutron] 10.222.0.76 "GET /v2.0/networks?id=9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 200 len: 913 time: 0.2411397 May 12 16:06:09.633971 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-381cf592-69fb-4911-b4dd-647215b532ce req-2f795ee5-a55d-4b06-bd37-4485748c8656 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 1000 time: 0.1825027 May 12 16:06:09.635654 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-381cf592-69fb-4911-b4dd-647215b532ce req-2e1c8a38-3c7e-4cd8-9e95-592ebd963a01 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 200 len: 1000 time: 0.1832361 May 12 16:06:09.745847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381cf592-69fb-4911-b4dd-647215b532ce req-7302548b-e3e1-4795-b6dd-ad79cb8b9832 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:09.747202 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-381cf592-69fb-4911-b4dd-647215b532ce req-7302548b-e3e1-4795-b6dd-ad79cb8b9832 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.1072176 May 12 16:06:09.750843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381cf592-69fb-4911-b4dd-647215b532ce req-a464a176-c35a-40ad-9337-50f0947d7c48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:09.752144 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-381cf592-69fb-4911-b4dd-647215b532ce req-a464a176-c35a-40ad-9337-50f0947d7c48 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 200 len: 851 time: 0.0836244 May 12 16:06:09.883582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381cf592-69fb-4911-b4dd-647215b532ce req-549d07f6-9d44-4a9c-91a9-d8a18cb3875a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:09.885036 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-381cf592-69fb-4911-b4dd-647215b532ce req-549d07f6-9d44-4a9c-91a9-d8a18cb3875a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1320133 May 12 16:06:09.886864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381cf592-69fb-4911-b4dd-647215b532ce req-3d2616bc-7368-418f-bf30-ed757d6db08a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:09.888163 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-381cf592-69fb-4911-b4dd-647215b532ce req-3d2616bc-7368-418f-bf30-ed757d6db08a service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9475b307-5f43-40f6-b384-65417948d75d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1061275 May 12 16:06:10.241413 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-381cf592-69fb-4911-b4dd-647215b532ce req-7f7f482a-48f8-456b-83c2-61fccc2177de service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3495696 May 12 16:06:10.248894 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-381cf592-69fb-4911-b4dd-647215b532ce req-5238f5d0-1d8e-4ba4-82ab-436bc833a688 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3339245 May 12 16:06:10.326949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4c0816a-84f1-43f3-9daf-c2de29062581 req-5507e006-200c-4b39-b93f-bcf13e34e97c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:10.328578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4c0816a-84f1-43f3-9daf-c2de29062581 req-5507e006-200c-4b39-b93f-bcf13e34e97c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.0809941 May 12 16:06:10.374425 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4c0816a-84f1-43f3-9daf-c2de29062581 req-8b13cda6-7788-4c26-89b9-c46b0c0d47ee tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401995 May 12 16:06:10.483888 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-381cf592-69fb-4911-b4dd-647215b532ce req-e35f9272-5830-4806-9746-6fd7e269a293 service neutron] 10.222.0.76 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2340889 May 12 16:06:10.487642 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-381cf592-69fb-4911-b4dd-647215b532ce req-4427b26b-1090-4cff-8044-3bda26fa8b08 service neutron] 10.222.0.84 "GET /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2202682 May 12 16:06:11.557227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a5b508-82d0-4894-a068-184020ec8b7f req-23c1f7fa-b160-4ca9-a148-1fbdc2b65578 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:11.558600 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01a5b508-82d0-4894-a068-184020ec8b7f req-23c1f7fa-b160-4ca9-a148-1fbdc2b65578 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.0775747 May 12 16:06:11.602149 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01a5b508-82d0-4894-a068-184020ec8b7f req-12b854df-1a98-48d8-8b8b-2a424a334ee2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373304 May 12 16:06:12.790118 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c69fd7-9b85-4bed-a703-b573afdf0cd5 req-e7cdce38-eb1b-4cd5-86f7-719cae11a10c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:12.791530 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60c69fd7-9b85-4bed-a703-b573afdf0cd5 req-e7cdce38-eb1b-4cd5-86f7-719cae11a10c tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.0855649 May 12 16:06:12.832252 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f5b13cad-f6f1-4522-96ed-5cd26ae9dc00 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:12.836885 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-60c69fd7-9b85-4bed-a703-b573afdf0cd5 req-e22b6a36-30ef-4d8c-ae78-0ad5ed2eca42 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393119 May 12 16:06:13.646087 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:14.022833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0db9ef1-66d7-46ce-bb3b-67bfbb1cf5e1 req-797ab872-af87-4442-b99a-b3505510fc19 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:14.024266 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0db9ef1-66d7-46ce-bb3b-67bfbb1cf5e1 req-797ab872-af87-4442-b99a-b3505510fc19 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.0785794 May 12 16:06:14.070715 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0db9ef1-66d7-46ce-bb3b-67bfbb1cf5e1 req-cc49846d-4e86-4575-a2e2-5d355898ba5f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404966 May 12 16:06:14.967641 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:06:15.262589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a434f07-91b3-4690-a5ba-d2b9748b3108 req-54d0fe64-c4dc-401c-acba-a9fc2dd63fb4 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:15.264031 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a434f07-91b3-4690-a5ba-d2b9748b3108 req-54d0fe64-c4dc-401c-acba-a9fc2dd63fb4 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.0859847 May 12 16:06:15.307640 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7a434f07-91b3-4690-a5ba-d2b9748b3108 req-98605de1-fd99-4888-9271-bc705b75b543 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0372612 May 12 16:06:15.376991 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-691ab39f-5874-4e00-b998-6e4b71a20e79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:16.091003 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:16.365610 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:16.494852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30e43ad3-bd38-478b-b287-b339d40db169 req-809bb11b-a5bb-403a-b227-b41133af3b84 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:16.496282 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30e43ad3-bd38-478b-b287-b339d40db169 req-809bb11b-a5bb-403a-b227-b41133af3b84 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.0800865 May 12 16:06:16.540545 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30e43ad3-bd38-478b-b287-b339d40db169 req-d17e97bb-9cc6-443f-ade2-1404f203b3ff tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384462 May 12 16:06:17.725633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a616f328-c910-4fa3-9582-2bc3faf6bbd2 req-58b44300-d055-44d1-b838-5a4f59f9a177 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:17.727047 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a616f328-c910-4fa3-9582-2bc3faf6bbd2 req-58b44300-d055-44d1-b838-5a4f59f9a177 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.0826263 May 12 16:06:17.770780 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a616f328-c910-4fa3-9582-2bc3faf6bbd2 req-2f9cee48-2e79-4fcf-b9c3-17f33376ac69 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378361 May 12 16:06:17.845895 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:17.957945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-637adbb6-53b7-4404-b864-aebde17f9a7f req-bc08b9e1-d37c-4bd9-a56a-04a284c3a084 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:17.959377 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-637adbb6-53b7-4404-b864-aebde17f9a7f req-bc08b9e1-d37c-4bd9-a56a-04a284c3a084 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.0823348 May 12 16:06:18.006576 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-637adbb6-53b7-4404-b864-aebde17f9a7f req-1e750e35-1dc9-484a-8a17-9c23acab8ab2 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415444 May 12 16:06:18.192607 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63bad867-0769-4d3b-ae5d-88cd0a5df80a req-877f934b-6109-4d84-8a75-39dc5452b246 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:18.193963 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63bad867-0769-4d3b-ae5d-88cd0a5df80a req-877f934b-6109-4d84-8a75-39dc5452b246 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.0854259 May 12 16:06:18.237493 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63bad867-0769-4d3b-ae5d-88cd0a5df80a req-43aa4173-b4fc-4903-a3dc-46e07a801717 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379796 May 12 16:06:18.628637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9364a3e7-d677-4949-b6fb-abf07fb42025 req-005f7e8b-a671-4aff-ac86-61aee08dfc83 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:18.630081 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9364a3e7-d677-4949-b6fb-abf07fb42025 req-005f7e8b-a671-4aff-ac86-61aee08dfc83 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 944 time: 0.0841064 May 12 16:06:18.673267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9364a3e7-d677-4949-b6fb-abf07fb42025 req-c23efc17-7930-4b33-a94b-5933ec9e5c4d tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375345 May 12 16:06:19.098637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 75098235-08b8-4e01-90a4-2619f1c82299 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:06:19.230734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:19.243627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '75098235-08b8-4e01-90a4-2619f1c82299', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'port_id': '75098235-08b8-4e01-90a4-2619f1c82299', 'mac_address': 'fa:16:3e:5b:15:33', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 595, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:06:19.300054 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:19.322537 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 75098235-08b8-4e01-90a4-2619f1c82299 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:06:19.338137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:19.341744 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:19.408377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=75098235-08b8-4e01-90a4-2619f1c82299,revision_number=12']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:19.418156 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:19.418495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:19.418829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:19.419159 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:19.419486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:19.419811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:19.420131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:19.420447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:19.420764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:19.421081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:19.421407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:19.421800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:19.658026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['75098235-08b8-4e01-90a4-2619f1c82299'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:06:19.860467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a62bd2ee-dea4-45aa-8cb8-3934a9be185e req-4a0a9e26-f6e4-4a86-aa04-da943f60d8c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:19.861922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a62bd2ee-dea4-45aa-8cb8-3934a9be185e req-4a0a9e26-f6e4-4a86-aa04-da943f60d8c6 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0820396 May 12 16:06:19.904568 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a62bd2ee-dea4-45aa-8cb8-3934a9be185e req-dfccb649-017b-41fe-98d6-521438ad2b97 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0370455 May 12 16:06:20.410228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-3a41e90e-241e-4806-8dc2-c15aafdac03b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:20.411635 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-3a41e90e-241e-4806-8dc2-c15aafdac03b tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0783699 May 12 16:06:20.486370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Deleting port 75098235-08b8-4e01-90a4-2619f1c82299 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:06:20.486649 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:20.728395 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:20.728743 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:21.023788 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:21.024394 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:21.024828 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d disassociated. External IP: 172.25.8.219, port: 75098235-08b8-4e01-90a4-2619f1c82299. May 12 16:06:21.025289 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Calling delete_port for 75098235-08b8-4e01-90a4-2619f1c82299 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:06:21.102889 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3b5de35-7038-49ef-852c-290e8c119f16 req-e41b381d-a64a-44ee-9990-eb7b538f2418 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:21.104757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3b5de35-7038-49ef-852c-290e8c119f16 req-e41b381d-a64a-44ee-9990-eb7b538f2418 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 945 time: 0.0892272 May 12 16:06:21.120323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 75098235-08b8-4e01-90a4-2619f1c82299 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:06:21.154039 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b3b5de35-7038-49ef-852c-290e8c119f16 req-7630f096-a0ff-4fec-9457-8da6a95ec7fa tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups?id=3aebfd3b-72ff-4972-bf89-463e07cfaf27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409472 May 12 16:06:21.184097 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:21.261731 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 75098235-08b8-4e01-90a4-2619f1c82299, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=75098235-08b8-4e01-90a4-2619f1c82299,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:21.275788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '75098235-08b8-4e01-90a4-2619f1c82299', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'port_id': '75098235-08b8-4e01-90a4-2619f1c82299', 'mac_address': 'fa:16:3e:5b:15:33', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 595, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:06:21.301446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event deleted for resources: {'Port': ['ID=75098235-08b8-4e01-90a4-2619f1c82299,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:21.439036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Router cd523971-49e8-4deb-9f61-a0342aee2763 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:06:21.736083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:06:21.745392 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef6752d3-a3d2-40e5-a819-0d06b7031b65 None None] Sync routers for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:06:21.754709 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef6752d3-a3d2-40e5-a819-0d06b7031b65 None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:06:21.755292 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ef6752d3-a3d2-40e5-a819-0d06b7031b65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:06:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:06:21.807785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] No DVR routers for this DVR port 75098235-08b8-4e01-90a4-2619f1c82299 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:06:21.810464 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:21.814653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'name': 'network-vif-deleted', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:06:21.830733 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-decdf7a7-7624-4601-85d4-4b6c3d01b169 req-955d11f9-2c3e-4e44-88a8-01d5be68bda9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.84 "DELETE /v2.0/ports/75098235-08b8-4e01-90a4-2619f1c82299 HTTP/1.1" status: 204 len: 173 time: 1.4114418 May 12 16:06:21.862471 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-98407bbf-b03a-4a48-96c5-3f93aa987054'] response: {'server_uuid': '9f300c05-fd82-4b6b-a593-75529e633a4f', 'name': 'network-vif-deleted', 'tag': '75098235-08b8-4e01-90a4-2619f1c82299', 'status': 'completed', 'code': 200} May 12 16:06:21.936398 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-ef6752d3-a3d2-40e5-a819-0d06b7031b65 None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:06:22.304234 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ef6752d3-a3d2-40e5-a819-0d06b7031b65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:06:22.308906 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef6752d3-a3d2-40e5-a819-0d06b7031b65 None None] Checking router: cd523971-49e8-4deb-9f61-a0342aee2763 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:06:22.318775 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef6752d3-a3d2-40e5-a819-0d06b7031b65 None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:06:22.319000 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ef6752d3-a3d2-40e5-a819-0d06b7031b65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:06:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:06:22.334975 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23376236-d129-49c1-9068-c484aaaa5f20 req-51294b85-0197-40bd-a7e9-87ec3efe1732 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/ports?device_id=9f300c05-fd82-4b6b-a593-75529e633a4f HTTP/1.1" status: 200 len: 210 time: 0.0465565 May 12 16:06:22.505873 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-ef6752d3-a3d2-40e5-a819-0d06b7031b65 None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:06:22.818385 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ef6752d3-a3d2-40e5-a819-0d06b7031b65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:06:22.822328 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef6752d3-a3d2-40e5-a819-0d06b7031b65 None None] The sync data for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 is: [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:02:03Z', 'revision_number': 4, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '629fbd42-7e9e-4170-9343-40c14387aff5', 'name': '', 'network_id': '9475b307-5f43-40f6-b384-65417948d75d', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'mac_address': 'fa:16:3e:6a:99:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_interface', 'standard_attr_id': 4143, 'fixed_ips': [{'subnet_id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:02Z', 'updated_at': '2022-05-12T16:02:08Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'subnets': [{'id': 'd0bd473b-b60e-4879-b8b8-94c3dfcc17c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:06:23.046217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c77c4e9-66dd-47a0-96d2-320491596e9e None None] New status for floating IP 6998d782-f9e2-4cb3-80a3-d55f6fa8888d: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:06:23.118310 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 75098235-08b8-4e01-90a4-2619f1c82299 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:06:23.217855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 75098235-08b8-4e01-90a4-2619f1c82299 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:06:23.218188 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 75098235-08b8-4e01-90a4-2619f1c82299 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:06:26.595492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53686) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:06:26.668825 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:26.696375 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:26.750351 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:26.770190 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3aebfd3b-72ff-4972-bf89-463e07cfaf27,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:26.779604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:26.779937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:26.780270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:26.780590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:26.781606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:26.781934 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:26.782251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:26.782563 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:26.782938 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:26.783287 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:26.783599 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:26.783914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:06:26.789524 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:26.790614 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1cee3d80-ef54-4609-ba48-ff23249f2045 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "DELETE /v2.0/security-groups/3aebfd3b-72ff-4972-bf89-463e07cfaf27 HTTP/1.1" status: 204 len: 168 time: 0.1917396 May 12 16:06:26.793074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53690) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:06:26.808517 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-9b3f7464-fe0c-4e55-875a-6a4c666c9ea9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] show failed (client error): The resource could not be found. May 12 16:06:26.809518 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9b3f7464-fe0c-4e55-875a-6a4c666c9ea9 tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "GET /v2.0/security-groups/3aebfd3b-72ff-4972-bf89-463e07cfaf27 HTTP/1.1" status: 404 len: 347 time: 0.0154605 May 12 16:06:26.812175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53694) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:06:26.967878 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-c847c5a5-2310-48aa-82b9-873be3ccaf2f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Deleting port b3306083-3628-4f09-9461-15d578bf0d38 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:06:26.968119 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c847c5a5-2310-48aa-82b9-873be3ccaf2f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:27.132987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c847c5a5-2310-48aa-82b9-873be3ccaf2f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:27.133338 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c847c5a5-2310-48aa-82b9-873be3ccaf2f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:27.290055 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9c130e4f-342e-489d-9fa1-81139246e3da req-ef76f215-0c66-4e8b-b91d-a50d22871ebb service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0497839 May 12 16:06:27.368559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-c847c5a5-2310-48aa-82b9-873be3ccaf2f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Calling delete_port for b3306083-3628-4f09-9461-15d578bf0d38 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:06:27.398745 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9c130e4f-342e-489d-9fa1-81139246e3da req-2d0e4824-e48a-47c1-aef1-268e3e02374d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0406632 May 12 16:06:27.444844 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9c130e4f-342e-489d-9fa1-81139246e3da req-66662460-235c-49a1-85f8-04573d903d7d service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0252137 May 12 16:06:27.516521 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c847c5a5-2310-48aa-82b9-873be3ccaf2f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:27.562901 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c847c5a5-2310-48aa-82b9-873be3ccaf2f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Pushing event deleted for resources: {'Port': ['ID=b3306083-3628-4f09-9461-15d578bf0d38,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:27.587816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c130e4f-342e-489d-9fa1-81139246e3da req-ab5a6a7f-1967-4d54-a0f0-807136fc8edc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:27.589726 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9c130e4f-342e-489d-9fa1-81139246e3da req-ab5a6a7f-1967-4d54-a0f0-807136fc8edc service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1390610 May 12 16:06:27.656572 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c847c5a5-2310-48aa-82b9-873be3ccaf2f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:27.669861 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c847c5a5-2310-48aa-82b9-873be3ccaf2f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:27.670960 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c847c5a5-2310-48aa-82b9-873be3ccaf2f tempest-ServerActionsTestJSON-962000751 tempest-ServerActionsTestJSON-962000751-project] 10.222.0.82 "DELETE /v2.0/floatingips/6998d782-f9e2-4cb3-80a3-d55f6fa8888d HTTP/1.1" status: 204 len: 168 time: 0.8578494 May 12 16:06:27.674439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53698) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:06:28.207141 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0cc8d659-3779-4b0d-82ed-adb725f00339 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:28.552334 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-0cc8d659-3779-4b0d-82ed-adb725f00339 admin admin] Deleting port 629fbd42-7e9e-4170-9343-40c14387aff5 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:06:28.552665 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0cc8d659-3779-4b0d-82ed-adb725f00339 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:28.721574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-0cc8d659-3779-4b0d-82ed-adb725f00339 admin admin] For port 629fbd42-7e9e-4170-9343-40c14387aff5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=629fbd42-7e9e-4170-9343-40c14387aff5,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:28.722232 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0cc8d659-3779-4b0d-82ed-adb725f00339 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:28.956526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-0cc8d659-3779-4b0d-82ed-adb725f00339 admin admin] Calling delete_port for 629fbd42-7e9e-4170-9343-40c14387aff5 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:06:29.127423 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0cc8d659-3779-4b0d-82ed-adb725f00339 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:29.171160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cc8d659-3779-4b0d-82ed-adb725f00339 admin admin] Pushing event deleted for resources: {'Port': ['ID=629fbd42-7e9e-4170-9343-40c14387aff5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:29.442490 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-0cc8d659-3779-4b0d-82ed-adb725f00339 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:29.812444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0cc8d659-3779-4b0d-82ed-adb725f00339 admin admin] Router cd523971-49e8-4deb-9f61-a0342aee2763 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:06:29.988394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0cc8d659-3779-4b0d-82ed-adb725f00339 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:06:29.997050 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d403e817-0551-4422-8ea6-54b55bc3a6cb None None] Sync routers for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:06:30.000791 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0cc8d659-3779-4b0d-82ed-adb725f00339 admin admin] 10.222.0.82 "PUT /v2.0/routers/cd523971-49e8-4deb-9f61-a0342aee2763/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3253558 May 12 16:06:30.003384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53704) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:06:30.006758 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d403e817-0551-4422-8ea6-54b55bc3a6cb None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:06:30.007358 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d403e817-0551-4422-8ea6-54b55bc3a6cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:06:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:06:30.185401 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d403e817-0551-4422-8ea6-54b55bc3a6cb None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:06:30.305872 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:30.478093 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d403e817-0551-4422-8ea6-54b55bc3a6cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78'}], 'enable_snat': True}, 'gw_port_id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:06:29Z', 'revision_number': 5, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port': {'id': 'ac0f52bc-a47d-41d1-a35e-cec46efd76f6', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:9a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4142, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:02:00Z', 'updated_at': '2022-05-12T16:02:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:06:30.481947 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d403e817-0551-4422-8ea6-54b55bc3a6cb None None] Checking router: cd523971-49e8-4deb-9f61-a0342aee2763 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:06:30.486813 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:30.490443 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d403e817-0551-4422-8ea6-54b55bc3a6cb None None] Routers {'cd523971-49e8-4deb-9f61-a0342aee2763'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:06:30.491087 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d403e817-0551-4422-8ea6-54b55bc3a6cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:06:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['cd523971-49e8-4deb-9f61-a0342aee2763'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:06:30.496004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] Deleting port ac0f52bc-a47d-41d1-a35e-cec46efd76f6 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:06:30.496337 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:30.638828 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d403e817-0551-4422-8ea6-54b55bc3a6cb None None] Set router cd523971-49e8-4deb-9f61-a0342aee2763 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:06:30.673199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] For port ac0f52bc-a47d-41d1-a35e-cec46efd76f6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ac0f52bc-a47d-41d1-a35e-cec46efd76f6,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:30.673598 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:30.772250 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d403e817-0551-4422-8ea6-54b55bc3a6cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:06:30Z', 'revision_number': 6, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:06:30.776139 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d403e817-0551-4422-8ea6-54b55bc3a6cb None None] The sync data for ids ['cd523971-49e8-4deb-9f61-a0342aee2763'] in n-d-841483-1 is: [{'id': 'cd523971-49e8-4deb-9f61-a0342aee2763', 'name': 'tempest-ServerActionsTestJSON-1949209289-router', 'tenant_id': '22f425833dc74d6b985912b8d7db7222', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:01:59Z', 'updated_at': '2022-05-12T16:06:30Z', 'revision_number': 6, 'project_id': '22f425833dc74d6b985912b8d7db7222', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:06:30.799841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] Calling delete_port for ac0f52bc-a47d-41d1-a35e-cec46efd76f6 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:06:30.969600 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:31.019778 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] Pushing event deleted for resources: {'Port': ['ID=ac0f52bc-a47d-41d1-a35e-cec46efd76f6,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:31.106748 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:31.282952 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:31.285154 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:31.307869 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:31.308480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router cd523971-49e8-4deb-9f61-a0342aee2763 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:06:31.320385 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:31.321514 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6e7da3d7-3d25-4dc2-8390-f5bc5fc554d0 admin admin] 10.222.0.82 "DELETE /v2.0/routers/cd523971-49e8-4deb-9f61-a0342aee2763 HTTP/1.1" status: 204 len: 168 time: 1.3171959 May 12 16:06:31.324047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53708) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:06:31.382137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-91014b56-c649-4eff-84ad-d6ddb275cca4 admin admin] Deleting subnet d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:06:31.384939 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91014b56-c649-4eff-84ad-d6ddb275cca4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:31.435970 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91014b56-c649-4eff-84ad-d6ddb275cca4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:31.513318 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91014b56-c649-4eff-84ad-d6ddb275cca4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:31.586416 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91014b56-c649-4eff-84ad-d6ddb275cca4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:31.624812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91014b56-c649-4eff-84ad-d6ddb275cca4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d0bd473b-b60e-4879-b8b8-94c3dfcc17c8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:31.628312 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-91014b56-c649-4eff-84ad-d6ddb275cca4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:31.633734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-edf24b39-0067-4bb5-ab80-8140664af920 None None] Network 9475b307-5f43-40f6-b384-65417948d75d requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:06:31.634204 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-91014b56-c649-4eff-84ad-d6ddb275cca4 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/d0bd473b-b60e-4879-b8b8-94c3dfcc17c8 HTTP/1.1" status: 204 len: 168 time: 0.3092287 May 12 16:06:31.636581 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53712) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:06:31.871287 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:31.883021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Deleting port aeac494d-008f-48ba-853e-5a3b56c3e7d5 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:06:31.883341 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:31.931972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4025ee82-e3bd-4696-a6a1-fd638161a307 None None] DHCP port deletion for 9475b307-5f43-40f6-b384-65417948d75d request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:06:31.936196 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4025ee82-e3bd-4696-a6a1-fd638161a307 None None] Deleting port aeac494d-008f-48ba-853e-5a3b56c3e7d5 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:06:31.936572 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4025ee82-e3bd-4696-a6a1-fd638161a307 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:32.088885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] For port aeac494d-008f-48ba-853e-5a3b56c3e7d5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=aeac494d-008f-48ba-853e-5a3b56c3e7d5,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:32.089473 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:32.139121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4025ee82-e3bd-4696-a6a1-fd638161a307 None None] For port aeac494d-008f-48ba-853e-5a3b56c3e7d5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=aeac494d-008f-48ba-853e-5a3b56c3e7d5,segment=NetworkSegment(b5e092c9-3496-44dd-842e-3dc14179b327),segment_id=b5e092c9-3496-44dd-842e-3dc14179b327)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:32.139426 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4025ee82-e3bd-4696-a6a1-fd638161a307 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:32.216503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Calling delete_port for aeac494d-008f-48ba-853e-5a3b56c3e7d5 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:06:32.261477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4025ee82-e3bd-4696-a6a1-fd638161a307 None None] Calling delete_port for aeac494d-008f-48ba-853e-5a3b56c3e7d5 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:06:32.297542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:32.309622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device aeac494d-008f-48ba-853e-5a3b56c3e7d5 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:06:32.341541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] No DVR routers for this DVR port aeac494d-008f-48ba-853e-5a3b56c3e7d5 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:06:32.351520 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: aeac494d-008f-48ba-853e-5a3b56c3e7d5 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:06:32.351845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device aeac494d-008f-48ba-853e-5a3b56c3e7d5 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:06:32.352246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 629fbd42-7e9e-4170-9343-40c14387aff5 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:06:32.378641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Pushing event deleted for resources: {'Port': ['ID=aeac494d-008f-48ba-853e-5a3b56c3e7d5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:32.388824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 629fbd42-7e9e-4170-9343-40c14387aff5 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:06:32.389252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 629fbd42-7e9e-4170-9343-40c14387aff5 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:06:32.389579 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ac0f52bc-a47d-41d1-a35e-cec46efd76f6 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:06:32.434758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: ac0f52bc-a47d-41d1-a35e-cec46efd76f6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:06:32.435084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ac0f52bc-a47d-41d1-a35e-cec46efd76f6 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:06:32.439807 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-4025ee82-e3bd-4696-a6a1-fd638161a307 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:06:32.440155 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-4025ee82-e3bd-4696-a6a1-fd638161a307 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:06:32.470319 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:32.496325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9475b307-5f43-40f6-b384-65417948d75d']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:06:32.508407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b5e092c9-3496-44dd-842e-3dc14179b327') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:06:32.508703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b5e092c9-3496-44dd-842e-3dc14179b327') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:06:32.519839 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:32.535819 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:32.542125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Releasing vlan 595 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:06:32.542670 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: timer() May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: self._notify() May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:06:32.556569 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:06:32.633964 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:32.650310 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:32.660887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] Pushing event deleted for resources: {'Network': ['ID=9475b307-5f43-40f6-b384-65417948d75d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:32.675580 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2c811883-65e1-46b7-9cb0-b84ee056589d admin admin] 10.222.0.82 "DELETE /v2.0/networks/9475b307-5f43-40f6-b384-65417948d75d HTTP/1.1" status: 204 len: 168 time: 1.0380611 May 12 16:06:32.802896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53718) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:06:32.840016 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:32.852145 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-28b041a2-bb62-482d-aaf4-35708880761f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=22f425833dc74d6b985912b8d7db7222&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0481007 May 12 16:06:32.854635 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53722) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:06:32.911328 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4dc8981-df34-48a9-a9aa-d7eec1d8bbcb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:32.936257 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4dc8981-df34-48a9-a9aa-d7eec1d8bbcb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:32.941455 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4025ee82-e3bd-4696-a6a1-fd638161a307 None None] Deleting port aeac494d-008f-48ba-853e-5a3b56c3e7d5 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:06:32.941898 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4025ee82-e3bd-4696-a6a1-fd638161a307 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:32.987676 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4dc8981-df34-48a9-a9aa-d7eec1d8bbcb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:33.007747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4dc8981-df34-48a9-a9aa-d7eec1d8bbcb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e02c2431-9ee7-4f7c-b267-afe490100cc9,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:33.010540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4025ee82-e3bd-4696-a6a1-fd638161a307 None None] The port 'aeac494d-008f-48ba-853e-5a3b56c3e7d5' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 16:06:33.017090 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b4dc8981-df34-48a9-a9aa-d7eec1d8bbcb admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:33.017090 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b4dc8981-df34-48a9-a9aa-d7eec1d8bbcb admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e02c2431-9ee7-4f7c-b267-afe490100cc9 HTTP/1.1" status: 204 len: 168 time: 0.1597598 May 12 16:06:33.726914 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53746) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:06:33.855833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestJSON-896903322-network', 'tenant_id': '135720757bc445afb4c226a0fb56c5fb'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:06:33.861655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:06:33.865457 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Usage tracker for resource:network and tenant:135720757bc445afb4c226a0fb56c5fb is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:06:33.868242 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:06:33.873788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:06:33.883900 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Made reservation on behalf of 135720757bc445afb4c226a0fb56c5fb for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:06:33.886329 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:33.898870 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:33.913231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:06:33.917069 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Usage tracker for resource:security_group_rule and tenant:135720757bc445afb4c226a0fb56c5fb is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:06:33.919939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:06:33.926353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:06:34.011548 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:34.016615 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:34.048641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 581} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:06:34.057025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ce98697-6d03-4bb8-a2e9-dd3971089eab,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:34.064722 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:34.065243 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Added segment 74418aef-b2b9-4991-90d8-95b2bfee1cd5 of type vlan for network a1469184-f089-49ab-8132-3fcb3bdc7aca May 12 16:06:34.092120 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:34.121492 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:34.122411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:34.122984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:34.227552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.4995105 May 12 16:06:34.228447 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-195687ed-cc73-4ac4-bba2-0d4f2ec3a4c7 admin admin] Pushing event updated for resources: {'Network': ['ID=a1469184-f089-49ab-8132-3fcb3bdc7aca,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:34.231171 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53752) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:06:34.236911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Request body: {'subnet': {'network_id': 'a1469184-f089-49ab-8132-3fcb3bdc7aca', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestJSON-896903322-subnet', 'tenant_id': '135720757bc445afb4c226a0fb56c5fb', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:06:34.240776 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network a1469184-f089-49ab-8132-3fcb3bdc7aca details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:06:34.243088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:06:34.248086 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Usage tracker for resource:subnet and tenant:135720757bc445afb4c226a0fb56c5fb is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:06:34.251576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:06:34.259889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:06:34.272019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Made reservation on behalf of 135720757bc445afb4c226a0fb56c5fb for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:06:34.274470 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:34.475652 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:34.557117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1eac5a0d-5645-43f2-8f39-b6fd8e67eb76,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:34.561090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Checking segment: {'id': '74418aef-b2b9-4991-90d8-95b2bfee1cd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'a1469184-f089-49ab-8132-3fcb3bdc7aca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:06:34.561459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Network hostable DHCP agents. Network: a1469184-f089-49ab-8132-3fcb3bdc7aca, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:06:34.581445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Network a1469184-f089-49ab-8132-3fcb3bdc7aca is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:06:34.590407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, a1469184-f089-49ab-8132-3fcb3bdc7aca) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:06:34.594488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:34.595053 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:34.598936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70ae240c-d9bf-4925-a3b2-d8ace23bc91c None None] Network a1469184-f089-49ab-8132-3fcb3bdc7aca requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:06:34.615483 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-09165b80-2951-4145-bc96-194c31c7bb30 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3831327 May 12 16:06:34.813495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed983257-af35-4b30-9ad0-57c1da835055 None None] Network a1469184-f089-49ab-8132-3fcb3bdc7aca requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:06:35.159968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-2ffafe4b-1090-49c8-bf2c-fea5b3e060d3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:35.160538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-2ffafe4b-1090-49c8-bf2c-fea5b3e060d3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Synchronizing usage tracker for tenant:135720757bc445afb4c226a0fb56c5fb on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:06:35.176788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-2ffafe4b-1090-49c8-bf2c-fea5b3e060d3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Unset dirty status for tenant:135720757bc445afb4c226a0fb56c5fb on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:06:35.177944 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-2ffafe4b-1090-49c8-bf2c-fea5b3e060d3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/networks?id=a1469184-f089-49ab-8132-3fcb3bdc7aca HTTP/1.1" status: 200 len: 813 time: 0.1609185 May 12 16:06:35.193147 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-0e408a10-cd13-4bd3-934a-92fba2367bdf tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/quotas/135720757bc445afb4c226a0fb56c5fb HTTP/1.1" status: 200 len: 375 time: 0.0096672 May 12 16:06:35.239190 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-97fe3f18-68f4-444a-aa62-b1ecb69c4ecd tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=135720757bc445afb4c226a0fb56c5fb&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0411265 May 12 16:06:35.452342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-a772fd46-7694-4ad8-959c-1d047f20e940 service neutron] 10.222.0.82 "GET /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1626091 May 12 16:06:35.585167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-3756b395-b832-41fa-8529-75101fb5cbee service neutron] 10.222.0.82 "GET /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1262307 May 12 16:06:35.764721 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04c54908-1173-4d05-8eb3-a6739c2f712a req-60501941-6925-49de-90a7-14b9889681f1 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 210 time: 0.0483615 May 12 16:06:36.916520 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2660e4c5-5fb0-4181-b0d2-e7b07467fe13 req-4f1097ad-d37d-422f-b59d-b95bd8c4f932 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 210 time: 0.0454342 May 12 16:06:36.962309 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-dc8dbc60-6b9b-4ba2-9c26-0ba5688143b5 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:36.964021 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-dc8dbc60-6b9b-4ba2-9c26-0ba5688143b5 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.84 "GET /v2.0/networks?id=a1469184-f089-49ab-8132-3fcb3bdc7aca HTTP/1.1" status: 200 len: 813 time: 0.1496897 May 12 16:06:36.991253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Request body: {'port': {'device_id': '5d495e53-0a76-42b6-a111-b3b789ce23a6', 'network_id': 'a1469184-f089-49ab-8132-3fcb3bdc7aca', 'admin_state_up': True, 'tenant_id': '135720757bc445afb4c226a0fb56c5fb'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:06:37.127880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:06:37.131618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Usage tracker for resource:port and tenant:135720757bc445afb4c226a0fb56c5fb is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:06:37.134369 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Quota usage for port was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:06:37.139889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:06:37.149283 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Made reservation on behalf of 135720757bc445afb4c226a0fb56c5fb for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:06:37.152805 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:37.319340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Allocated IP 172.20.0.9 (a1469184-f089-49ab-8132-3fcb3bdc7aca/1eac5a0d-5645-43f2-8f39-b6fd8e67eb76/a1837b0b-2257-4584-ae92-7fd3277fa5f7) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:06:37.521062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:37.550413 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:37.623849 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Network a1469184-f089-49ab-8132-3fcb3bdc7aca is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:06:37.627652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:06:37.631481 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:06:37.661347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Pushing event updated for resources: {'Port': ['ID=a1837b0b-2257-4584-ae92-7fd3277fa5f7,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:37.695856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:37.696445 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:37.716490 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-9523513d-9263-4c96-b452-c0eeaca73c04 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7294478 May 12 16:06:37.740839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Request body: {'port': {'device_id': '5d495e53-0a76-42b6-a111-b3b789ce23a6', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:06:37.975871 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:38.114001 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe9b710a-db8b-41b9-a647-83d308c5384e req-20602cf3-e6f9-4698-8a7d-3196792ba42b tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:38.115463 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fe9b710a-db8b-41b9-a647-83d308c5384e req-20602cf3-e6f9-4698-8a7d-3196792ba42b tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 931 time: 0.0905061 May 12 16:06:38.289666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-fe9b710a-db8b-41b9-a647-83d308c5384e req-adeb0f4b-b2ce-4db4-b808-8c599c0f6e79 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Synchronizing usage tracker for tenant:135720757bc445afb4c226a0fb56c5fb on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:06:38.307244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-fe9b710a-db8b-41b9-a647-83d308c5384e req-adeb0f4b-b2ce-4db4-b808-8c599c0f6e79 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Unset dirty status for tenant:135720757bc445afb4c226a0fb56c5fb on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:06:38.308951 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fe9b710a-db8b-41b9-a647-83d308c5384e req-adeb0f4b-b2ce-4db4-b808-8c599c0f6e79 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1865902 May 12 16:06:38.360807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a1837b0b-2257-4584-ae92-7fd3277fa5f7 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:06:38.367911 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:38.384178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Transition to ACTIVE for port object a1837b0b-2257-4584-ae92-7fd3277fa5f7 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:06:38.387556 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:38.544389 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Pushing event updated for resources: {'Port': ['ID=a1837b0b-2257-4584-ae92-7fd3277fa5f7,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:38.615274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Attempting to bind port a1837b0b-2257-4584-ae92-7fd3277fa5f7 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:06:38.615594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Attempting to bind port a1837b0b-2257-4584-ae92-7fd3277fa5f7 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '74418aef-b2b9-4991-90d8-95b2bfee1cd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'a1469184-f089-49ab-8132-3fcb3bdc7aca'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:06:38.615912 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Attempting to bind port a1837b0b-2257-4584-ae92-7fd3277fa5f7 on network a1469184-f089-49ab-8132-3fcb3bdc7aca {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:06:38.620441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Port a1837b0b-2257-4584-ae92-7fd3277fa5f7 on network a1469184-f089-49ab-8132-3fcb3bdc7aca not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:06:38.620694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Attempting to bind port a1837b0b-2257-4584-ae92-7fd3277fa5f7 on network a1469184-f089-49ab-8132-3fcb3bdc7aca {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:06:38.626277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 6, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:06:38.626605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Checking segment: {'id': '74418aef-b2b9-4991-90d8-95b2bfee1cd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'a1469184-f089-49ab-8132-3fcb3bdc7aca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:06:38.626976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Bound using segment: {'id': '74418aef-b2b9-4991-90d8-95b2bfee1cd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'a1469184-f089-49ab-8132-3fcb3bdc7aca'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:06:38.627389 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Bound port: a1837b0b-2257-4584-ae92-7fd3277fa5f7, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '74418aef-b2b9-4991-90d8-95b2bfee1cd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'a1469184-f089-49ab-8132-3fcb3bdc7aca'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:06:38.627720 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:38.717073 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] For port a1837b0b-2257-4584-ae92-7fd3277fa5f7, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:06:38.719973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] For port a1837b0b-2257-4584-ae92-7fd3277fa5f7, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a1837b0b-2257-4584-ae92-7fd3277fa5f7,segment=NetworkSegment(74418aef-b2b9-4991-90d8-95b2bfee1cd5),segment_id=74418aef-b2b9-4991-90d8-95b2bfee1cd5)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:06:38.724329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:38.782114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:38.782708 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:38.784068 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] 10.222.0.84 "PUT /v2.0/ports/a1837b0b-2257-4584-ae92-7fd3277fa5f7 HTTP/1.1" status: 200 len: 1091 time: 1.0477450 May 12 16:06:38.784488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5d495e53-0a76-42b6-a111-b3b789ce23a6', 'tag': 'a1837b0b-2257-4584-ae92-7fd3277fa5f7'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:06:38.806918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad939c6b-1c3a-411d-b95e-52c7bbc2af80 service neutron] Pushing event updated for resources: {'Port': ['ID=a1837b0b-2257-4584-ae92-7fd3277fa5f7,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:38.834800 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-775d52be-4709-4a96-9400-830886e35673'] response: {'name': 'network-changed', 'server_uuid': '5d495e53-0a76-42b6-a111-b3b789ce23a6', 'tag': 'a1837b0b-2257-4584-ae92-7fd3277fa5f7', 'status': 'completed', 'code': 200} May 12 16:06:38.928529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-67387c1d-7c90-423d-b98d-691cbd4d7e4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:38.929944 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-67387c1d-7c90-423d-b98d-691cbd4d7e4c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=135720757bc445afb4c226a0fb56c5fb&device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 1094 time: 0.0747426 May 12 16:06:39.008390 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-f939d720-3f59-47f6-8fde-30d3c0105022 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a1837b0b-2257-4584-ae92-7fd3277fa5f7 HTTP/1.1" status: 200 len: 217 time: 0.0598264 May 12 16:06:39.075605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-fa43e488-e4c9-4b75-b896-f71301cd6fda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:39.076976 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-fa43e488-e4c9-4b75-b896-f71301cd6fda service neutron] 10.222.0.84 "GET /v2.0/subnets?id=1eac5a0d-5645-43f2-8f39-b6fd8e67eb76 HTTP/1.1" status: 200 len: 853 time: 0.0594339 May 12 16:06:39.125987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-c916096c-424d-4ee9-82a6-79cbb84cae50 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a1469184-f089-49ab-8132-3fcb3bdc7aca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0396748 May 12 16:06:39.260067 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-8fd09d4c-3886-42b7-bf6a-def9d691b511 service neutron] 10.222.0.84 "GET /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1247587 May 12 16:06:39.399897 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2f1a550c-65e0-4b15-8989-24068240efb6 req-b594318f-2582-4099-93ab-f82abdc25815 service neutron] 10.222.0.84 "GET /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1310160 May 12 16:06:39.497478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecc38d69-3ff0-4919-9113-d356917bbd52 req-fd4b1c8c-b36a-4551-ab18-beb4512f8098 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:39.498928 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecc38d69-3ff0-4919-9113-d356917bbd52 req-fd4b1c8c-b36a-4551-ab18-beb4512f8098 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 943 time: 0.0864894 May 12 16:06:39.543910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecc38d69-3ff0-4919-9113-d356917bbd52 req-d2994bc4-b88e-41c8-beb8-207dfdf764e6 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383530 May 12 16:06:39.565945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a74cf3c4-cec4-484c-ae35-fc5b96ba261e req-950edf3a-d490-4760-94e2-3370948a1bc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:39.567666 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a74cf3c4-cec4-484c-ae35-fc5b96ba261e req-950edf3a-d490-4760-94e2-3370948a1bc1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=135720757bc445afb4c226a0fb56c5fb&device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 1094 time: 0.0750473 May 12 16:06:39.697098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a74cf3c4-cec4-484c-ae35-fc5b96ba261e req-f654d453-181d-483e-997a-32a17ec8d26e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:39.698542 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a74cf3c4-cec4-484c-ae35-fc5b96ba261e req-f654d453-181d-483e-997a-32a17ec8d26e service neutron] 10.222.0.84 "GET /v2.0/networks?id=a1469184-f089-49ab-8132-3fcb3bdc7aca HTTP/1.1" status: 200 len: 914 time: 0.1246345 May 12 16:06:39.869943 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a74cf3c4-cec4-484c-ae35-fc5b96ba261e req-d37e4dd1-2f19-4389-9673-7da24aeed424 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a1837b0b-2257-4584-ae92-7fd3277fa5f7 HTTP/1.1" status: 200 len: 217 time: 0.1628807 May 12 16:06:39.938827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a74cf3c4-cec4-484c-ae35-fc5b96ba261e req-4f18223e-badd-475e-b7fb-29d371051814 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:39.940252 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a74cf3c4-cec4-484c-ae35-fc5b96ba261e req-4f18223e-badd-475e-b7fb-29d371051814 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=1eac5a0d-5645-43f2-8f39-b6fd8e67eb76 HTTP/1.1" status: 200 len: 853 time: 0.0639112 May 12 16:06:39.999412 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a74cf3c4-cec4-484c-ae35-fc5b96ba261e req-7a9c7ee9-30e3-4168-b0f3-71bf04fb119b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a1469184-f089-49ab-8132-3fcb3bdc7aca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0407605 May 12 16:06:40.010373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-a74cf3c4-cec4-484c-ae35-fc5b96ba261e req-2295c614-d957-4702-9e6b-3b3cbb9e5777 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 16:06:40.011378 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a74cf3c4-cec4-484c-ae35-fc5b96ba261e req-2295c614-d957-4702-9e6b-3b3cbb9e5777 service neutron] 10.222.0.84 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0053036 May 12 16:06:40.143627 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a74cf3c4-cec4-484c-ae35-fc5b96ba261e req-6d73d562-453c-4131-8f37-722c7c817f5c service neutron] 10.222.0.84 "GET /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1256881 May 12 16:06:40.285152 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a74cf3c4-cec4-484c-ae35-fc5b96ba261e req-fd8d0a9c-2918-46bd-a666-bd4708df1d41 service neutron] 10.222.0.84 "GET /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1331131 May 12 16:06:40.739306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5f30c3-27f1-48d9-bce3-ca017fd38d14 req-48503f67-9ed4-48f0-b510-02987eebfcf9 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:40.740770 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af5f30c3-27f1-48d9-bce3-ca017fd38d14 req-48503f67-9ed4-48f0-b510-02987eebfcf9 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 943 time: 0.0857725 May 12 16:06:40.786020 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af5f30c3-27f1-48d9-bce3-ca017fd38d14 req-056fef68-22fe-4194-871b-d3a5c4f14ff5 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395694 May 12 16:06:41.971544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c0ab36-588b-49e2-9146-39bbbc3ff6a2 req-197bd726-734f-4d1f-a94d-f84e388e2465 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:41.973157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69c0ab36-588b-49e2-9146-39bbbc3ff6a2 req-197bd726-734f-4d1f-a94d-f84e388e2465 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 943 time: 0.0808218 May 12 16:06:42.020683 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69c0ab36-588b-49e2-9146-39bbbc3ff6a2 req-2f530711-147a-419c-984d-216b3901921d tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417955 May 12 16:06:42.841699 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-00de126c-0402-4934-843a-5ee3f2df0f06 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:43.202373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-457c61f6-7ecb-41c2-a7a6-ea142938f522 req-04b1894e-3cd5-4088-90d3-6e1445141235 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:43.203709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-457c61f6-7ecb-41c2-a7a6-ea142938f522 req-04b1894e-3cd5-4088-90d3-6e1445141235 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 943 time: 0.0803664 May 12 16:06:43.246570 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-457c61f6-7ecb-41c2-a7a6-ea142938f522 req-22476d52-4f0e-4c55-9cfd-24cd72b191cc tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373254 May 12 16:06:43.251640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a1837b0b-2257-4584-ae92-7fd3277fa5f7 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:06:43.388052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a1837b0b-2257-4584-ae92-7fd3277fa5f7, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a1837b0b-2257-4584-ae92-7fd3277fa5f7,segment=NetworkSegment(74418aef-b2b9-4991-90d8-95b2bfee1cd5),segment_id=74418aef-b2b9-4991-90d8-95b2bfee1cd5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:43.400943 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'a1837b0b-2257-4584-ae92-7fd3277fa5f7', 'network_id': 'a1469184-f089-49ab-8132-3fcb3bdc7aca', 'port_id': 'a1837b0b-2257-4584-ae92-7fd3277fa5f7', 'mac_address': 'fa:16:3e:b7:87:fd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 581, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1eac5a0d-5645-43f2-8f39-b6fd8e67eb76', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:06:43.490629 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:43.507184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a1837b0b-2257-4584-ae92-7fd3277fa5f7 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:06:43.521860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a1837b0b-2257-4584-ae92-7fd3277fa5f7, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a1837b0b-2257-4584-ae92-7fd3277fa5f7,segment=NetworkSegment(74418aef-b2b9-4991-90d8-95b2bfee1cd5),segment_id=74418aef-b2b9-4991-90d8-95b2bfee1cd5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:43.525260 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:43.589380 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a1837b0b-2257-4584-ae92-7fd3277fa5f7,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:43.650869 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:43.846289 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a1837b0b-2257-4584-ae92-7fd3277fa5f7'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:06:44.432552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2f9bfcd-2ec7-435e-a833-b6c29735649c req-f5c0f17a-3250-4ad1-a507-7c7304bdbeef tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:44.434016 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2f9bfcd-2ec7-435e-a833-b6c29735649c req-f5c0f17a-3250-4ad1-a507-7c7304bdbeef tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 944 time: 0.0839865 May 12 16:06:44.478573 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c2f9bfcd-2ec7-435e-a833-b6c29735649c req-78df5dc1-9d73-4b83-bf16-037432c2ea06 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384872 May 12 16:06:44.533814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-f9de8f0b-c9b5-4672-9d70-f2618daa711b req-112cd3d3-3888-4c86-b0f4-43b64331f706 service neutron] (88152) timed out ('10.222.0.82', 46992) {{(pid=88152) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 16:06:45.260214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a1837b0b-2257-4584-ae92-7fd3277fa5f7 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:06:45.329722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port a1837b0b-2257-4584-ae92-7fd3277fa5f7 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:06:45.334288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port a1837b0b-2257-4584-ae92-7fd3277fa5f7 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:06:45.334647 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:45.392586 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5cf41759-5a14-4a76-babf-9ceb3f0ba276 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:45.461345 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:45.487375 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5d495e53-0a76-42b6-a111-b3b789ce23a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1837b0b-2257-4584-ae92-7fd3277fa5f7'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:06:45.498292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port a1837b0b-2257-4584-ae92-7fd3277fa5f7, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a1837b0b-2257-4584-ae92-7fd3277fa5f7,segment=NetworkSegment(74418aef-b2b9-4991-90d8-95b2bfee1cd5),segment_id=74418aef-b2b9-4991-90d8-95b2bfee1cd5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:45.503083 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:45.535890 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-423ea306-2915-4c4c-99dc-d710c1da53b4'] response: {'server_uuid': '5d495e53-0a76-42b6-a111-b3b789ce23a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1837b0b-2257-4584-ae92-7fd3277fa5f7', 'code': 200} May 12 16:06:45.573331 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=a1837b0b-2257-4584-ae92-7fd3277fa5f7,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:45.670514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e61b7b9e-4d86-4db1-b053-4f7429f58248 req-9fcf6479-40ff-46a0-a556-bea5a2f2ed82 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:45.672015 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e61b7b9e-4d86-4db1-b053-4f7429f58248 req-9fcf6479-40ff-46a0-a556-bea5a2f2ed82 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 945 time: 0.0835373 May 12 16:06:45.714251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c1e1bbb-64bd-4ae1-9dff-7d92271805ee req-89017a2b-5aa4-4fa7-9f9d-f0196ca9db4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:45.715726 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c1e1bbb-64bd-4ae1-9dff-7d92271805ee req-89017a2b-5aa4-4fa7-9f9d-f0196ca9db4a service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 1096 time: 0.0740480 May 12 16:06:45.717006 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e61b7b9e-4d86-4db1-b053-4f7429f58248 req-810c86fd-4df3-44a2-baa3-93d5d329dd2d tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392668 May 12 16:06:45.760106 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2c1e1bbb-64bd-4ae1-9dff-7d92271805ee req-acff82b5-cd50-437d-aa8b-43b73dea95a3 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0350943 May 12 16:06:46.092837 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:46.369077 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:46.906844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c50647aa-ebdf-4785-af83-9f2aa82d17d1 req-ab826c6c-cc6d-44a5-8a26-00a81ef9d9e2 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:46.908335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c50647aa-ebdf-4785-af83-9f2aa82d17d1 req-ab826c6c-cc6d-44a5-8a26-00a81ef9d9e2 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 945 time: 0.0842712 May 12 16:06:46.955002 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c50647aa-ebdf-4785-af83-9f2aa82d17d1 req-a5bed9ca-a055-4334-9be9-4125d06cab49 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403306 May 12 16:06:47.849075 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:48.143187 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c3bc45a-2bd0-47fc-be2e-b35687f9ad5e req-2dafd1ef-7893-407c-9c9f-f90b0c18c83f tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:48.144538 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c3bc45a-2bd0-47fc-be2e-b35687f9ad5e req-2dafd1ef-7893-407c-9c9f-f90b0c18c83f tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 945 time: 0.0795407 May 12 16:06:48.190961 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6c3bc45a-2bd0-47fc-be2e-b35687f9ad5e req-ec690c83-db45-4d99-a472-1d31392de475 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408318 May 12 16:06:48.477538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-c9cf836c-077a-460f-8c8d-34f84747dc5d tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:48.478940 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-c9cf836c-077a-460f-8c8d-34f84747dc5d tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/networks?id=a1469184-f089-49ab-8132-3fcb3bdc7aca HTTP/1.1" status: 200 len: 813 time: 0.1450613 May 12 16:06:48.494220 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-62e550a8-e8d6-4b88-802f-6a329cccf9d5 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/quotas/135720757bc445afb4c226a0fb56c5fb HTTP/1.1" status: 200 len: 375 time: 0.0098040 May 12 16:06:48.571607 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-4b28eece-e5bf-4a85-a1df-6875dd24a313 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=135720757bc445afb4c226a0fb56c5fb&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0725405 May 12 16:06:48.701195 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-99c93192-2e7d-4dda-a117-72dbf3f3787d service neutron] 10.222.0.82 "GET /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1229651 May 12 16:06:48.831182 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-a211b172-099f-4402-bf9c-d07f4f0705ff service neutron] 10.222.0.82 "GET /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1235180 May 12 16:06:49.014015 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-154840da-6a8c-4a9e-8b09-fbded73654aa req-5d0bb018-eb43-4e11-b565-039a5825897a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 210 time: 0.0414076 May 12 16:06:50.045942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-b2a842b3-6579-43b7-9893-10b7546219c7 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:50.047959 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-b2a842b3-6579-43b7-9893-10b7546219c7 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.76 "GET /v2.0/networks?id=a1469184-f089-49ab-8132-3fcb3bdc7aca HTTP/1.1" status: 200 len: 813 time: 0.1524930 May 12 16:06:50.060035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Request body: {'port': {'device_id': 'a413b8e0-39ac-494e-af31-6ba1ad041b47', 'network_id': 'a1469184-f089-49ab-8132-3fcb3bdc7aca', 'admin_state_up': True, 'tenant_id': '135720757bc445afb4c226a0fb56c5fb'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:06:50.169278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd0bac95-1052-4ec0-a00f-cc8dd924db31 req-6d71434f-a820-4bee-b528-eedd8541563c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 210 time: 0.0471165 May 12 16:06:50.207898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:06:50.211714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Usage tracker for resource:port and tenant:135720757bc445afb4c226a0fb56c5fb is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:06:50.214547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Quota usage for port was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:06:50.220912 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:06:50.230044 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Made reservation on behalf of 135720757bc445afb4c226a0fb56c5fb for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:06:50.233818 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:50.396279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Allocated IP 172.20.0.11 (a1469184-f089-49ab-8132-3fcb3bdc7aca/1eac5a0d-5645-43f2-8f39-b6fd8e67eb76/a9762908-aeef-4bd1-af57-d6bd22b4eef9) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:06:50.592724 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:50.621025 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:50.656313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a1837b0b-2257-4584-ae92-7fd3277fa5f7'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:06:50.690580 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Network a1469184-f089-49ab-8132-3fcb3bdc7aca is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:06:50.693804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:06:50.697909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:06:50.738215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Pushing event updated for resources: {'Port': ['ID=a9762908-aeef-4bd1-af57-d6bd22b4eef9,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:50.769414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:50.770037 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:50.792029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-caa7cc1f-226d-4bc9-8bd1-086fcb817ba3 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7358265 May 12 16:06:50.801972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-71311666-0497-4e70-bfa4-a8a1b6e8fcb7 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 16:06:50.802907 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-71311666-0497-4e70-bfa4-a8a1b6e8fcb7 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0049639 May 12 16:06:50.814016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Request body: {'port': {'device_id': 'a413b8e0-39ac-494e-af31-6ba1ad041b47', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:06:50.927467 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:51.242479 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8513be1-bbc6-4319-adf0-46585f45e9e7 req-d78d00dc-d88c-4e28-a4c6-1eb6b2126fe4 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.2696059 May 12 16:06:51.372605 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d039e884-0c29-40b1-b11d-b17d1ec9171c req-5f3ca2c6-ce1f-4909-b608-223648589a92 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:51.374087 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d039e884-0c29-40b1-b11d-b17d1ec9171c req-5f3ca2c6-ce1f-4909-b608-223648589a92 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 932 time: 0.0950294 May 12 16:06:51.419009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d039e884-0c29-40b1-b11d-b17d1ec9171c req-6c2236d7-dfb8-4214-bec1-35e6dfb6ef98 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384450 May 12 16:06:51.512438 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8513be1-bbc6-4319-adf0-46585f45e9e7 req-4e9ac2f7-fffb-405d-a949-17c4db08bffa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:51.513916 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8513be1-bbc6-4319-adf0-46585f45e9e7 req-4e9ac2f7-fffb-405d-a949-17c4db08bffa service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=135720757bc445afb4c226a0fb56c5fb&device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 1096 time: 0.1484463 May 12 16:06:51.518839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a9762908-aeef-4bd1-af57-d6bd22b4eef9 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:06:51.526571 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:51.611890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Transition to ACTIVE for port object a9762908-aeef-4bd1-af57-d6bd22b4eef9 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:06:51.624720 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:51.834266 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Pushing event updated for resources: {'Port': ['ID=a9762908-aeef-4bd1-af57-d6bd22b4eef9,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:51.867951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8513be1-bbc6-4319-adf0-46585f45e9e7 req-870086ac-d5f9-45e4-a3e7-f29a578d37db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:51.869407 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8513be1-bbc6-4319-adf0-46585f45e9e7 req-870086ac-d5f9-45e4-a3e7-f29a578d37db service neutron] 10.222.0.84 "GET /v2.0/networks?id=a1469184-f089-49ab-8132-3fcb3bdc7aca HTTP/1.1" status: 200 len: 914 time: 0.3348174 May 12 16:06:51.947393 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8513be1-bbc6-4319-adf0-46585f45e9e7 req-0f974bd4-bc80-46e7-b668-f910e2c59b21 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a1837b0b-2257-4584-ae92-7fd3277fa5f7 HTTP/1.1" status: 200 len: 217 time: 0.0698814 May 12 16:06:51.969713 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:06:52.028950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Attempting to bind port a9762908-aeef-4bd1-af57-d6bd22b4eef9 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:06:52.029284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Attempting to bind port a9762908-aeef-4bd1-af57-d6bd22b4eef9 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': '74418aef-b2b9-4991-90d8-95b2bfee1cd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'a1469184-f089-49ab-8132-3fcb3bdc7aca'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:06:52.029637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Attempting to bind port a9762908-aeef-4bd1-af57-d6bd22b4eef9 on network a1469184-f089-49ab-8132-3fcb3bdc7aca {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:06:52.037886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Port a9762908-aeef-4bd1-af57-d6bd22b4eef9 on network a1469184-f089-49ab-8132-3fcb3bdc7aca not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:06:52.038208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Attempting to bind port a9762908-aeef-4bd1-af57-d6bd22b4eef9 on network a1469184-f089-49ab-8132-3fcb3bdc7aca {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:06:52.046308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 6, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:06:52.047725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Checking segment: {'id': '74418aef-b2b9-4991-90d8-95b2bfee1cd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'a1469184-f089-49ab-8132-3fcb3bdc7aca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:06:52.048136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Bound using segment: {'id': '74418aef-b2b9-4991-90d8-95b2bfee1cd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'a1469184-f089-49ab-8132-3fcb3bdc7aca'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:06:52.048567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Bound port: a9762908-aeef-4bd1-af57-d6bd22b4eef9, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '74418aef-b2b9-4991-90d8-95b2bfee1cd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 581, 'network_id': 'a1469184-f089-49ab-8132-3fcb3bdc7aca'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:06:52.048912 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:52.059743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8513be1-bbc6-4319-adf0-46585f45e9e7 req-5b23f54a-fdaa-4144-9190-abf7c348ef49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:52.061165 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8513be1-bbc6-4319-adf0-46585f45e9e7 req-5b23f54a-fdaa-4144-9190-abf7c348ef49 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=1eac5a0d-5645-43f2-8f39-b6fd8e67eb76 HTTP/1.1" status: 200 len: 853 time: 0.1071715 May 12 16:06:52.153298 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8513be1-bbc6-4319-adf0-46585f45e9e7 req-9a1c6fdc-2856-4bff-acfe-bc842bd97ccb service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=a1469184-f089-49ab-8132-3fcb3bdc7aca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0617757 May 12 16:06:52.267657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] For port a9762908-aeef-4bd1-af57-d6bd22b4eef9, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:06:52.285701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] For port a9762908-aeef-4bd1-af57-d6bd22b4eef9, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a9762908-aeef-4bd1-af57-d6bd22b4eef9,segment=NetworkSegment(74418aef-b2b9-4991-90d8-95b2bfee1cd5),segment_id=74418aef-b2b9-4991-90d8-95b2bfee1cd5)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:06:52.299009 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:52.364477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:52.364997 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:52.366798 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] 10.222.0.76 "PUT /v2.0/ports/a9762908-aeef-4bd1-af57-d6bd22b4eef9 HTTP/1.1" status: 200 len: 1092 time: 1.5575871 May 12 16:06:52.377869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a413b8e0-39ac-494e-af31-6ba1ad041b47', 'tag': 'a9762908-aeef-4bd1-af57-d6bd22b4eef9'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:06:52.394653 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8513be1-bbc6-4319-adf0-46585f45e9e7 req-69402fbc-cfd8-4ae0-b2ca-84d80a6cacd9 service neutron] 10.222.0.84 "GET /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2340050 May 12 16:06:52.428232 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-554d48bd-61d8-447c-beb2-6ea6bce84435'] response: {'name': 'network-changed', 'server_uuid': 'a413b8e0-39ac-494e-af31-6ba1ad041b47', 'tag': 'a9762908-aeef-4bd1-af57-d6bd22b4eef9', 'status': 'completed', 'code': 200} May 12 16:06:52.524140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97fbc3e5-7944-48b6-9590-a988f690635f service neutron] Pushing event updated for resources: {'Port': ['ID=a9762908-aeef-4bd1-af57-d6bd22b4eef9,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:52.606842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2d7bab3-9952-4380-a57e-87ab764e4cf1 req-1d712289-3986-4416-bb18-dc80c07e3981 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:52.608258 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2d7bab3-9952-4380-a57e-87ab764e4cf1 req-1d712289-3986-4416-bb18-dc80c07e3981 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 944 time: 0.0846965 May 12 16:06:52.611167 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c8513be1-bbc6-4319-adf0-46585f45e9e7 req-5673a651-f860-4862-8693-cea6de02335b service neutron] 10.222.0.84 "GET /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2084961 May 12 16:06:52.615450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-152d468f-a45f-45ad-a901-1edc449542b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:52.616814 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-152d468f-a45f-45ad-a901-1edc449542b6 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=135720757bc445afb4c226a0fb56c5fb&device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 1095 time: 0.1906278 May 12 16:06:52.653496 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d2d7bab3-9952-4380-a57e-87ab764e4cf1 req-f311bc31-b34d-42c8-94eb-aa0457352095 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392437 May 12 16:06:52.689441 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-1f28b43c-d88e-487a-9f2a-9b7191678ac6 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=a9762908-aeef-4bd1-af57-d6bd22b4eef9 HTTP/1.1" status: 200 len: 217 time: 0.0658967 May 12 16:06:52.874530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-5211bf34-4aa0-4d76-a9c3-123ef65e96b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:52.876970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-5211bf34-4aa0-4d76-a9c3-123ef65e96b8 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=1eac5a0d-5645-43f2-8f39-b6fd8e67eb76 HTTP/1.1" status: 200 len: 853 time: 0.1825957 May 12 16:06:52.925519 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-d72b7f06-737c-4e69-b179-5c25f91e6713 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a1469184-f089-49ab-8132-3fcb3bdc7aca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0426884 May 12 16:06:53.058118 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-9027f191-6d31-471a-ba81-6ed96cb544be service neutron] 10.222.0.76 "GET /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1264577 May 12 16:06:53.192861 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e24d5a33-9e57-4c41-bfb9-40895984b5d6 req-4fa6cf3e-9c9f-4964-93f4-71c93aa1481d service neutron] 10.222.0.76 "GET /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1285372 May 12 16:06:53.310658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3899653f-b1f9-4ce7-806c-5170fa634a3a req-81b3adce-c6f4-4686-bb67-2018b5fd550a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:53.314019 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3899653f-b1f9-4ce7-806c-5170fa634a3a req-81b3adce-c6f4-4686-bb67-2018b5fd550a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=135720757bc445afb4c226a0fb56c5fb&device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 1095 time: 0.0748706 May 12 16:06:53.448342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3899653f-b1f9-4ce7-806c-5170fa634a3a req-b437278b-4936-4b7e-b3ff-6534cb5b7c85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:53.449809 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3899653f-b1f9-4ce7-806c-5170fa634a3a req-b437278b-4936-4b7e-b3ff-6534cb5b7c85 service neutron] 10.222.0.76 "GET /v2.0/networks?id=a1469184-f089-49ab-8132-3fcb3bdc7aca HTTP/1.1" status: 200 len: 914 time: 0.1323662 May 12 16:06:53.518220 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3899653f-b1f9-4ce7-806c-5170fa634a3a req-f1e1346d-0d01-4318-b2a7-9e77b25ee0b3 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=a9762908-aeef-4bd1-af57-d6bd22b4eef9 HTTP/1.1" status: 200 len: 217 time: 0.0616837 May 12 16:06:53.586000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3899653f-b1f9-4ce7-806c-5170fa634a3a req-255dc422-7e93-4d42-beb1-bd1bfb4dee3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:53.587340 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3899653f-b1f9-4ce7-806c-5170fa634a3a req-255dc422-7e93-4d42-beb1-bd1bfb4dee3f service neutron] 10.222.0.76 "GET /v2.0/subnets?id=1eac5a0d-5645-43f2-8f39-b6fd8e67eb76 HTTP/1.1" status: 200 len: 853 time: 0.0622306 May 12 16:06:53.635632 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3899653f-b1f9-4ce7-806c-5170fa634a3a req-a98c9a72-5673-475f-8d3a-2bf2da8ccd97 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=a1469184-f089-49ab-8132-3fcb3bdc7aca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0413043 May 12 16:06:53.771536 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3899653f-b1f9-4ce7-806c-5170fa634a3a req-376c9343-0450-4d02-b0ff-e5dced0431fe service neutron] 10.222.0.76 "GET /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1290460 May 12 16:06:53.838559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5571aaa-41a9-46d5-9df2-aec24a9b2415 req-7a6cdb2f-5d6c-4342-be4d-ce07ab4099c1 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:53.839896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5571aaa-41a9-46d5-9df2-aec24a9b2415 req-7a6cdb2f-5d6c-4342-be4d-ce07ab4099c1 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 944 time: 0.0805809 May 12 16:06:53.883404 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c5571aaa-41a9-46d5-9df2-aec24a9b2415 req-af3c3852-f921-4c9c-811d-3753f32a806d tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366082 May 12 16:06:53.909196 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3899653f-b1f9-4ce7-806c-5170fa634a3a req-52a0e37e-56ab-48ce-8fa7-73a8858d5c31 service neutron] 10.222.0.76 "GET /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1282268 May 12 16:06:55.079297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-480f299f-b29a-4a80-af52-52ebd418c928 req-c686757f-0987-437a-99cd-f3f1c82e34c9 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:55.080724 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-480f299f-b29a-4a80-af52-52ebd418c928 req-c686757f-0987-437a-99cd-f3f1c82e34c9 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 944 time: 0.0817590 May 12 16:06:55.124833 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-480f299f-b29a-4a80-af52-52ebd418c928 req-12a5281d-253f-425d-ba8c-6e55873b8f8d tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382507 May 12 16:06:56.310546 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ddc39d-19e0-4197-b771-55d62b29b106 req-2ff1b85d-68a1-4fa3-ac5b-bed0d8c1364a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:56.311990 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5ddc39d-19e0-4197-b771-55d62b29b106 req-2ff1b85d-68a1-4fa3-ac5b-bed0d8c1364a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 944 time: 0.0782864 May 12 16:06:56.359132 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5ddc39d-19e0-4197-b771-55d62b29b106 req-772bd388-3c9c-4e24-bfa2-e954a22741da tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405617 May 12 16:06:56.904966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a9762908-aeef-4bd1-af57-d6bd22b4eef9 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:06:57.039029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a9762908-aeef-4bd1-af57-d6bd22b4eef9, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a9762908-aeef-4bd1-af57-d6bd22b4eef9,segment=NetworkSegment(74418aef-b2b9-4991-90d8-95b2bfee1cd5),segment_id=74418aef-b2b9-4991-90d8-95b2bfee1cd5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:57.052563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'a9762908-aeef-4bd1-af57-d6bd22b4eef9', 'network_id': 'a1469184-f089-49ab-8132-3fcb3bdc7aca', 'port_id': 'a9762908-aeef-4bd1-af57-d6bd22b4eef9', 'mac_address': 'fa:16:3e:1e:db:dd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 581, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1eac5a0d-5645-43f2-8f39-b6fd8e67eb76', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:06:57.106575 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:57.126303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a9762908-aeef-4bd1-af57-d6bd22b4eef9 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:06:57.141654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a9762908-aeef-4bd1-af57-d6bd22b4eef9, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a9762908-aeef-4bd1-af57-d6bd22b4eef9,segment=NetworkSegment(74418aef-b2b9-4991-90d8-95b2bfee1cd5),segment_id=74418aef-b2b9-4991-90d8-95b2bfee1cd5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:57.145126 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:57.211139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a9762908-aeef-4bd1-af57-d6bd22b4eef9,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:57.341606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a9762908-aeef-4bd1-af57-d6bd22b4eef9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:06:57.551671 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-696e467b-cb1e-4398-ab38-4c11a44ec655 req-ce31f2a1-1964-4078-b3c4-340b90f9503e tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:57.553132 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-696e467b-cb1e-4398-ab38-4c11a44ec655 req-ce31f2a1-1964-4078-b3c4-340b90f9503e tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 945 time: 0.0814517 May 12 16:06:57.596568 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-696e467b-cb1e-4398-ab38-4c11a44ec655 req-8228c539-770e-4280-a023-11ff4c72544c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377305 May 12 16:06:58.780034 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25329bb2-b5a4-4802-9e0a-f955b89b99b9 req-8a1a6058-430a-4697-80b0-8fce00fe75c6 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:58.781537 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25329bb2-b5a4-4802-9e0a-f955b89b99b9 req-8a1a6058-430a-4697-80b0-8fce00fe75c6 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 945 time: 0.0815468 May 12 16:06:58.825738 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-25329bb2-b5a4-4802-9e0a-f955b89b99b9 req-69590b15-da07-466b-aefe-71a142db06fc tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383129 May 12 16:06:58.903575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a9762908-aeef-4bd1-af57-d6bd22b4eef9 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:06:58.971371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port a9762908-aeef-4bd1-af57-d6bd22b4eef9 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:06:58.976619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port a9762908-aeef-4bd1-af57-d6bd22b4eef9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:06:58.976980 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:59.094069 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:59.120721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a413b8e0-39ac-494e-af31-6ba1ad041b47', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a9762908-aeef-4bd1-af57-d6bd22b4eef9'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:06:59.131416 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a9762908-aeef-4bd1-af57-d6bd22b4eef9, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a9762908-aeef-4bd1-af57-d6bd22b4eef9,segment=NetworkSegment(74418aef-b2b9-4991-90d8-95b2bfee1cd5),segment_id=74418aef-b2b9-4991-90d8-95b2bfee1cd5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:06:59.135489 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:06:59.172097 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e566bea7-4c58-471c-b21e-f9ec2b482421'] response: {'server_uuid': 'a413b8e0-39ac-494e-af31-6ba1ad041b47', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a9762908-aeef-4bd1-af57-d6bd22b4eef9', 'code': 200} May 12 16:06:59.203770 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a9762908-aeef-4bd1-af57-d6bd22b4eef9,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:06:59.293891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14fa3ee8-a1d7-4b70-bed1-e642b5c19fde req-a75224eb-b25f-41cd-9c1f-a82188fd6c4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:06:59.295343 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-14fa3ee8-a1d7-4b70-bed1-e642b5c19fde req-a75224eb-b25f-41cd-9c1f-a82188fd6c4e service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 1097 time: 0.0730948 May 12 16:06:59.334111 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-14fa3ee8-a1d7-4b70-bed1-e642b5c19fde req-478de14c-70c0-4242-8559-1933a26611b7 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331452 May 12 16:07:00.015450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a46857f1-4925-41f4-b1a2-70cbaaa7ce97 req-6e088a76-9769-4336-ac9a-6c96d3ba7371 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:00.016912 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a46857f1-4925-41f4-b1a2-70cbaaa7ce97 req-6e088a76-9769-4336-ac9a-6c96d3ba7371 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 946 time: 0.0800028 May 12 16:07:00.067416 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a46857f1-4925-41f4-b1a2-70cbaaa7ce97 req-29b506d8-13c6-44ef-930f-e88c732d65d2 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448103 May 12 16:07:01.356628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31876c5d-141f-4e00-a45c-cd47509c2f41 req-7f36f32a-6191-4bbe-aa33-ef174d5808e5 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:01.357991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31876c5d-141f-4e00-a45c-cd47509c2f41 req-7f36f32a-6191-4bbe-aa33-ef174d5808e5 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 946 time: 0.1835425 May 12 16:07:01.401964 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31876c5d-141f-4e00-a45c-cd47509c2f41 req-595e69af-6b71-4f92-b2d2-4652082f2574 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378675 May 12 16:07:01.781146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c731fb57-5879-4ebf-a4ec-a1bd3848f750 req-e245f406-6470-4579-bb55-566e308ca864 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:01.782593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c731fb57-5879-4ebf-a4ec-a1bd3848f750 req-e245f406-6470-4579-bb55-566e308ca864 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 946 time: 0.0800567 May 12 16:07:01.828896 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c731fb57-5879-4ebf-a4ec-a1bd3848f750 req-279ebcdf-e97d-4e86-b910-c2a52319c35c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407348 May 12 16:07:02.838805 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:02.956546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe3ed6ef-541e-42cd-927e-37822bd0dea4 req-254b2854-d059-45f4-a418-3a3a4f5ce93b tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:02.957225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-fe3ed6ef-541e-42cd-927e-37822bd0dea4 req-254b2854-d059-45f4-a418-3a3a4f5ce93b tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Synchronizing usage tracker for tenant:135720757bc445afb4c226a0fb56c5fb on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:07:02.974459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-fe3ed6ef-541e-42cd-927e-37822bd0dea4 req-254b2854-d059-45f4-a418-3a3a4f5ce93b tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Unset dirty status for tenant:135720757bc445afb4c226a0fb56c5fb on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:07:02.975686 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fe3ed6ef-541e-42cd-927e-37822bd0dea4 req-254b2854-d059-45f4-a418-3a3a4f5ce93b tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.76 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 946 time: 0.0959411 May 12 16:07:03.020930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef57654c-00e3-4ca9-816e-d3ca3bc8ef5b req-a2c0947e-7a97-4f69-a6c0-0b084b8da675 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:03.022429 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef57654c-00e3-4ca9-816e-d3ca3bc8ef5b req-a2c0947e-7a97-4f69-a6c0-0b084b8da675 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 946 time: 0.0871835 May 12 16:07:03.049092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-fe3ed6ef-541e-42cd-927e-37822bd0dea4 req-85f10a16-715c-4117-a960-dad84d4b766c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Deleting port a9762908-aeef-4bd1-af57-d6bd22b4eef9 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:07:03.049575 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fe3ed6ef-541e-42cd-927e-37822bd0dea4 req-85f10a16-715c-4117-a960-dad84d4b766c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:03.067092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ef57654c-00e3-4ca9-816e-d3ca3bc8ef5b req-84d22bd7-ce1e-468e-9c24-95190cf152f6 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383220 May 12 16:07:03.289493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-fe3ed6ef-541e-42cd-927e-37822bd0dea4 req-85f10a16-715c-4117-a960-dad84d4b766c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] For port a9762908-aeef-4bd1-af57-d6bd22b4eef9, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a9762908-aeef-4bd1-af57-d6bd22b4eef9,segment=NetworkSegment(74418aef-b2b9-4991-90d8-95b2bfee1cd5),segment_id=74418aef-b2b9-4991-90d8-95b2bfee1cd5)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:03.289849 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fe3ed6ef-541e-42cd-927e-37822bd0dea4 req-85f10a16-715c-4117-a960-dad84d4b766c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:03.525204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-fe3ed6ef-541e-42cd-927e-37822bd0dea4 req-85f10a16-715c-4117-a960-dad84d4b766c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Calling delete_port for a9762908-aeef-4bd1-af57-d6bd22b4eef9 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:07:03.664694 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fe3ed6ef-541e-42cd-927e-37822bd0dea4 req-85f10a16-715c-4117-a960-dad84d4b766c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:03.675341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a9762908-aeef-4bd1-af57-d6bd22b4eef9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:07:03.709131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a1837b0b-2257-4584-ae92-7fd3277fa5f7'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:07:03.714958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85f10a16-715c-4117-a960-dad84d4b766c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Pushing event deleted for resources: {'Port': ['ID=a9762908-aeef-4bd1-af57-d6bd22b4eef9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:03.790582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-fe3ed6ef-541e-42cd-927e-37822bd0dea4 req-85f10a16-715c-4117-a960-dad84d4b766c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] No DVR routers for this DVR port a9762908-aeef-4bd1-af57-d6bd22b4eef9 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:07:03.793185 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-fe3ed6ef-541e-42cd-927e-37822bd0dea4 req-85f10a16-715c-4117-a960-dad84d4b766c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:03.795740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a413b8e0-39ac-494e-af31-6ba1ad041b47', 'name': 'network-vif-deleted', 'tag': 'a9762908-aeef-4bd1-af57-d6bd22b4eef9'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:07:03.813629 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-fe3ed6ef-541e-42cd-927e-37822bd0dea4 req-85f10a16-715c-4117-a960-dad84d4b766c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.76 "DELETE /v2.0/ports/a9762908-aeef-4bd1-af57-d6bd22b4eef9 HTTP/1.1" status: 204 len: 173 time: 0.8325272 May 12 16:07:03.850447 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-00d16adf-0d64-4a43-8e3f-a4fe1c3e2c38'] response: {'server_uuid': 'a413b8e0-39ac-494e-af31-6ba1ad041b47', 'name': 'network-vif-deleted', 'tag': 'a9762908-aeef-4bd1-af57-d6bd22b4eef9', 'status': 'completed', 'code': 200} May 12 16:07:04.238181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6786c57e-6ead-42ff-8a8f-2f9e3b69ccc2 req-3371146b-a54f-49ae-b88f-9507d514cbcf tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=a413b8e0-39ac-494e-af31-6ba1ad041b47 HTTP/1.1" status: 200 len: 210 time: 0.0476732 May 12 16:07:05.498511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bf458be-2819-4a60-831f-d02fd58bed6e req-59eccbc1-85de-496c-bc27-d436960f6541 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:05.499908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9bf458be-2819-4a60-831f-d02fd58bed6e req-59eccbc1-85de-496c-bc27-d436960f6541 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 945 time: 0.0785794 May 12 16:07:05.544314 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9bf458be-2819-4a60-831f-d02fd58bed6e req-fce2fad5-02dd-484f-814d-672a9c25a497 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380490 May 12 16:07:05.747974 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ff8570b-49fc-4d27-8e3a-4da57b23f06a req-35236345-491e-4d30-adc0-53669b4a8fdd tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:05.749415 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ff8570b-49fc-4d27-8e3a-4da57b23f06a req-35236345-491e-4d30-adc0-53669b4a8fdd tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 945 time: 0.0824511 May 12 16:07:05.793339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0ff8570b-49fc-4d27-8e3a-4da57b23f06a req-448b341e-a536-44d0-b429-749122f12527 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376532 May 12 16:07:05.973955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b81bf24d-5605-425b-9582-db48ce06e321 req-5e515fd0-de4d-4d4a-b106-57b03dcaad9c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:05.975359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b81bf24d-5605-425b-9582-db48ce06e321 req-5e515fd0-de4d-4d4a-b106-57b03dcaad9c tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 945 time: 0.0780668 May 12 16:07:06.018444 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b81bf24d-5605-425b-9582-db48ce06e321 req-4cf54c02-8d2b-40d8-b6c7-b017f79a530e tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376024 May 12 16:07:06.312806 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb182f9-e8b5-4588-a87c-0245985c3fa2 req-fe3ac63b-efb5-4a62-af45-a1178e596264 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:06.314198 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdb182f9-e8b5-4588-a87c-0245985c3fa2 req-fe3ac63b-efb5-4a62-af45-a1178e596264 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 945 time: 0.0859561 May 12 16:07:06.358244 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdb182f9-e8b5-4588-a87c-0245985c3fa2 req-5ebb7b5f-6351-4bf8-8080-ee81dd01dc30 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381515 May 12 16:07:06.538298 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbe5ec34-437a-4632-997f-01eb9f033bba req-32130f82-ed01-4fcc-98d9-cf806cbcc9a7 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:06.539724 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fbe5ec34-437a-4632-997f-01eb9f033bba req-32130f82-ed01-4fcc-98d9-cf806cbcc9a7 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 945 time: 0.0791392 May 12 16:07:06.584593 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fbe5ec34-437a-4632-997f-01eb9f033bba req-f20a03a9-74be-43f5-8264-0539c8f8ee52 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392213 May 12 16:07:06.779694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-090bd62a-88af-4891-a353-1e40654c8c36 req-5e26b1b4-ddc9-4adf-8c3f-02b6cc4a5720 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:06.781829 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-090bd62a-88af-4891-a353-1e40654c8c36 req-5e26b1b4-ddc9-4adf-8c3f-02b6cc4a5720 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 945 time: 0.0820732 May 12 16:07:06.827602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-090bd62a-88af-4891-a353-1e40654c8c36 req-12c88008-73f3-4616-ae39-be23f8afd171 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401871 May 12 16:07:06.950762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a9762908-aeef-4bd1-af57-d6bd22b4eef9 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:07:06.985487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: a9762908-aeef-4bd1-af57-d6bd22b4eef9 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:07:06.985938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a9762908-aeef-4bd1-af57-d6bd22b4eef9 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:07:07.356995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a78db7-8844-4482-af57-a2c633030dc4 req-0facffca-5bbc-43a2-88e9-5e8b60a9d462 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:07.358494 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95a78db7-8844-4482-af57-a2c633030dc4 req-0facffca-5bbc-43a2-88e9-5e8b60a9d462 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 945 time: 0.0829942 May 12 16:07:07.408056 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-95a78db7-8844-4482-af57-a2c633030dc4 req-579e7596-766e-4e93-8ad3-971369ae7ec9 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432367 May 12 16:07:08.639682 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6faa8847-9bd8-449f-9599-96850bddf70e req-07db94b6-701e-4ba2-834d-62845ba69fcf tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:08.641799 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6faa8847-9bd8-449f-9599-96850bddf70e req-07db94b6-701e-4ba2-834d-62845ba69fcf tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 945 time: 0.1288490 May 12 16:07:08.684646 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6faa8847-9bd8-449f-9599-96850bddf70e req-79e38e53-2e07-44b7-b3d0-5d6fd8838180 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/security-groups?id=0ce98697-6d03-4bb8-a2e9-dd3971089eab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373135 May 12 16:07:08.890064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdab653-f234-4d2d-a8ba-43741aca8f2b req-d46d98d4-4091-48cc-ae33-7df320d0cffc tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:08.891373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9fdab653-f234-4d2d-a8ba-43741aca8f2b req-d46d98d4-4091-48cc-ae33-7df320d0cffc tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Synchronizing usage tracker for tenant:135720757bc445afb4c226a0fb56c5fb on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:07:08.906455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9fdab653-f234-4d2d-a8ba-43741aca8f2b req-d46d98d4-4091-48cc-ae33-7df320d0cffc tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Unset dirty status for tenant:135720757bc445afb4c226a0fb56c5fb on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:07:08.907587 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9fdab653-f234-4d2d-a8ba-43741aca8f2b req-d46d98d4-4091-48cc-ae33-7df320d0cffc tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.84 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 945 time: 0.0960507 May 12 16:07:08.979508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-9fdab653-f234-4d2d-a8ba-43741aca8f2b req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Deleting port a1837b0b-2257-4584-ae92-7fd3277fa5f7 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:07:08.979854 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9fdab653-f234-4d2d-a8ba-43741aca8f2b req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:09.224892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9fdab653-f234-4d2d-a8ba-43741aca8f2b req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] For port a1837b0b-2257-4584-ae92-7fd3277fa5f7, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=a1837b0b-2257-4584-ae92-7fd3277fa5f7,segment=NetworkSegment(74418aef-b2b9-4991-90d8-95b2bfee1cd5),segment_id=74418aef-b2b9-4991-90d8-95b2bfee1cd5)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:09.225251 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9fdab653-f234-4d2d-a8ba-43741aca8f2b req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:09.350760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-9fdab653-f234-4d2d-a8ba-43741aca8f2b req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Calling delete_port for a1837b0b-2257-4584-ae92-7fd3277fa5f7 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:07:09.501935 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9fdab653-f234-4d2d-a8ba-43741aca8f2b req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:09.550580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['a1837b0b-2257-4584-ae92-7fd3277fa5f7'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:07:09.556911 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Pushing event deleted for resources: {'Port': ['ID=a1837b0b-2257-4584-ae92-7fd3277fa5f7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:09.600261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:09.600592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:09.600923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:09.601243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:09.601589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:09.601905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:09.602218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:09.602527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:09.602836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:09.603143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:09.603449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:09.603754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:09.641782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-9fdab653-f234-4d2d-a8ba-43741aca8f2b req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] No DVR routers for this DVR port a1837b0b-2257-4584-ae92-7fd3277fa5f7 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:07:09.644241 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9fdab653-f234-4d2d-a8ba-43741aca8f2b req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:09.646805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5d495e53-0a76-42b6-a111-b3b789ce23a6', 'name': 'network-vif-deleted', 'tag': 'a1837b0b-2257-4584-ae92-7fd3277fa5f7'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:07:09.665950 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9fdab653-f234-4d2d-a8ba-43741aca8f2b req-5b618635-3c37-4ce9-a0a1-e48c9458be8a tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.84 "DELETE /v2.0/ports/a1837b0b-2257-4584-ae92-7fd3277fa5f7 HTTP/1.1" status: 204 len: 173 time: 0.7506049 May 12 16:07:09.694146 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-56e3e503-7fbe-46fe-97f2-855c8e4e9172'] response: {'server_uuid': '5d495e53-0a76-42b6-a111-b3b789ce23a6', 'name': 'network-vif-deleted', 'tag': 'a1837b0b-2257-4584-ae92-7fd3277fa5f7', 'status': 'completed', 'code': 200} May 12 16:07:09.845720 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ebcc295-7854-475d-ae59-9f506dd6ca99 req-f120e236-cd1a-4222-abce-1b131be74025 tempest-ServersNegativeTestJSON-195445916 tempest-ServersNegativeTestJSON-195445916-project] 10.222.0.82 "GET /v2.0/ports?device_id=5d495e53-0a76-42b6-a111-b3b789ce23a6 HTTP/1.1" status: 200 len: 210 time: 0.0466266 May 12 16:07:10.940179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53908) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:11.010471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-532a7f4e-356d-45c7-a8cc-5a9bcac2df49 admin admin] Deleting subnet 1eac5a0d-5645-43f2-8f39-b6fd8e67eb76 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:07:11.013414 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-532a7f4e-356d-45c7-a8cc-5a9bcac2df49 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.061743 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-532a7f4e-356d-45c7-a8cc-5a9bcac2df49 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.118955 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-532a7f4e-356d-45c7-a8cc-5a9bcac2df49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.183919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-532a7f4e-356d-45c7-a8cc-5a9bcac2df49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.223379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-532a7f4e-356d-45c7-a8cc-5a9bcac2df49 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1eac5a0d-5645-43f2-8f39-b6fd8e67eb76,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:11.225283 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-532a7f4e-356d-45c7-a8cc-5a9bcac2df49 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.231882 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-532a7f4e-356d-45c7-a8cc-5a9bcac2df49 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/1eac5a0d-5645-43f2-8f39-b6fd8e67eb76 HTTP/1.1" status: 204 len: 168 time: 0.2906644 May 12 16:07:11.234587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53912) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:11.337096 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d729217a-7036-4de2-9fc6-6a6cb7f16df1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.472074 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d729217a-7036-4de2-9fc6-6a6cb7f16df1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.496892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-d729217a-7036-4de2-9fc6-6a6cb7f16df1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a1469184-f089-49ab-8132-3fcb3bdc7aca']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:11.509124 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-d729217a-7036-4de2-9fc6-6a6cb7f16df1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '74418aef-b2b9-4991-90d8-95b2bfee1cd5') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:11.509460 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-d729217a-7036-4de2-9fc6-6a6cb7f16df1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '74418aef-b2b9-4991-90d8-95b2bfee1cd5') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:11.520445 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d729217a-7036-4de2-9fc6-6a6cb7f16df1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.535867 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d729217a-7036-4de2-9fc6-6a6cb7f16df1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.542098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d729217a-7036-4de2-9fc6-6a6cb7f16df1 admin admin] Releasing vlan 581 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:07:11.542480 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d729217a-7036-4de2-9fc6-6a6cb7f16df1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: timer() May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: self._notify() May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:07:11.556000 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:07:11.631460 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d729217a-7036-4de2-9fc6-6a6cb7f16df1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.647909 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d729217a-7036-4de2-9fc6-6a6cb7f16df1 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.659290 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d729217a-7036-4de2-9fc6-6a6cb7f16df1 admin admin] Pushing event deleted for resources: {'Network': ['ID=a1469184-f089-49ab-8132-3fcb3bdc7aca,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:11.665915 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d729217a-7036-4de2-9fc6-6a6cb7f16df1 admin admin] 10.222.0.82 "DELETE /v2.0/networks/a1469184-f089-49ab-8132-3fcb3bdc7aca HTTP/1.1" status: 204 len: 168 time: 0.4301879 May 12 16:07:11.775316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53918) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:11.824670 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-94ba2f26-823f-4247-8f4a-e6af1f1dbc01 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=135720757bc445afb4c226a0fb56c5fb&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0481431 May 12 16:07:11.827050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53922) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:11.885103 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91bbd267-a920-469e-9c6f-725152c63d53 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.913870 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91bbd267-a920-469e-9c6f-725152c63d53 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.963444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91bbd267-a920-469e-9c6f-725152c63d53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.978276 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91bbd267-a920-469e-9c6f-725152c63d53 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ce98697-6d03-4bb8-a2e9-dd3971089eab,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:11.989919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-91bbd267-a920-469e-9c6f-725152c63d53 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:11.990956 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-91bbd267-a920-469e-9c6f-725152c63d53 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0ce98697-6d03-4bb8-a2e9-dd3971089eab HTTP/1.1" status: 204 len: 168 time: 0.1629562 May 12 16:07:12.789187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53946) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:12.834539 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-763e0418-e501-433f-90d9-c0de48054d54 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:12.892414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1218198757'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:12.898234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:12.902120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Usage tracker for resource:network and tenant:d773dc7c6dd2474a983b86da13037bad is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:12.905903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:12.912670 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:12.922134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Made reservation on behalf of d773dc7c6dd2474a983b86da13037bad for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:12.925560 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:12.937204 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:12.951774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:12.956206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Usage tracker for resource:security_group_rule and tenant:d773dc7c6dd2474a983b86da13037bad is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:12.958932 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:12.964810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:13.053343 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:13.057023 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:13.092442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 563} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:07:13.099482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event updated for resources: {'SecurityGroup': ['ID=40cc6ed2-f7c2-45e1-8806-604257a142d9,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:13.105181 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:13.105597 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Added segment efae1cd4-393e-44fb-b27e-ff29e090987c of type vlan for network 07846936-71b6-422f-8535-ecb2fe1e1299 May 12 16:07:13.132801 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:13.165347 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:13.170720 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:13.171292 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:13.277155 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.4868104 May 12 16:07:13.280777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5a2cba-627a-447b-90ee-351befe0f2b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event updated for resources: {'Network': ['ID=07846936-71b6-422f-8535-ecb2fe1e1299,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:13.304026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 07846936-71b6-422f-8535-ecb2fe1e1299 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:07:13.399928 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a1837b0b-2257-4584-ae92-7fd3277fa5f7 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:07:13.451538 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: a1837b0b-2257-4584-ae92-7fd3277fa5f7 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:07:13.451867 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device a1837b0b-2257-4584-ae92-7fd3277fa5f7 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:07:13.659896 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:15.374896 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a95b56d5-e82e-4061-bc31-4596f148052f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:16.095278 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:16.377417 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:16.522569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53952) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:16.528251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Request body: {'subnet': {'network_id': '07846936-71b6-422f-8535-ecb2fe1e1299', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:16.643719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:16.647560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Usage tracker for resource:subnet and tenant:d773dc7c6dd2474a983b86da13037bad is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:16.650340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:16.655961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:16.665845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Made reservation on behalf of d773dc7c6dd2474a983b86da13037bad for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:16.669275 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:16.989728 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:17.071947 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event updated for resources: {'Subnet': ['ID=aac00ae6-ac21-4b29-9034-90288e3be8e6,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:17.078872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Checking segment: {'id': 'efae1cd4-393e-44fb-b27e-ff29e090987c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '07846936-71b6-422f-8535-ecb2fe1e1299'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:17.079331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Network hostable DHCP agents. Network: 07846936-71b6-422f-8535-ecb2fe1e1299, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:07:17.097930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Network 07846936-71b6-422f-8535-ecb2fe1e1299 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:07:17.106054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 07846936-71b6-422f-8535-ecb2fe1e1299) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:17.110109 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:17.110655 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:17.115738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2631ab4-aa0b-479e-af5c-881722d35b38 None None] Network 07846936-71b6-422f-8535-ecb2fe1e1299 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:17.130895 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8adf3332-b955-4f55-9c60-abacc57b3dcb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.6072447 May 12 16:07:17.134375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53956) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:17.140095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1214279822'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:17.147480 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:17.151312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Usage tracker for resource:network and tenant:d773dc7c6dd2474a983b86da13037bad is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:17.154224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:17.160503 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:17.170622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Made reservation on behalf of d773dc7c6dd2474a983b86da13037bad for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:17.174171 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:17.202013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 583} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:07:17.211325 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:17.211809 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Added segment 8e3d49de-6de2-4f49-8251-d5cd7af70d73 of type vlan for network 5a73246a-7324-42e8-8903-f3fe91bc1145 May 12 16:07:17.237649 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:17.270990 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:17.277502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:17.278406 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:17.343650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-07846936-71b6-422f-8535-ecb2fe1e1299', 'network_id': '07846936-71b6-422f-8535-ecb2fe1e1299', 'tenant_id': 'd773dc7c6dd2474a983b86da13037bad', 'fixed_ips': [{'subnet_id': 'aac00ae6-ac21-4b29-9034-90288e3be8e6'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:07:17.344631 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:17.384250 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.2487614 May 12 16:07:17.384452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53960) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:17.390817 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Request body: {'subnet': {'network_id': '5a73246a-7324-42e8-8903-f3fe91bc1145', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': True, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:17.393412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-208a1da2-ae14-49b8-bdfc-9376c7dd63b2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event updated for resources: {'Network': ['ID=5a73246a-7324-42e8-8903-f3fe91bc1145,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:17.403870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 5a73246a-7324-42e8-8903-f3fe91bc1145 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:07:17.510228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:17.514079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Usage tracker for resource:subnet and tenant:d773dc7c6dd2474a983b86da13037bad is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:17.516874 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:17.522590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:17.533127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Made reservation on behalf of d773dc7c6dd2474a983b86da13037bad for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:17.537051 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:17.589802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Allocated IP 2001:db8:0:ffff::2 (07846936-71b6-422f-8535-ecb2fe1e1299/aac00ae6-ac21-4b29-9034-90288e3be8e6/e45aa986-23d1-4720-b9da-c8f58facbb1f) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:07:17.779742 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:17.801324 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:17.812223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Transition to ACTIVE for port object e45aa986-23d1-4720-b9da-c8f58facbb1f will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:17.833019 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Transition to ACTIVE for port object e45aa986-23d1-4720-b9da-c8f58facbb1f will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:17.845799 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:17.859980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event updated for resources: {'Subnet': ['ID=c1d605b8-9f74-4067-acca-943463df1aa1,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:17.869036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Checking segment: {'id': '8e3d49de-6de2-4f49-8251-d5cd7af70d73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 583, 'network_id': '5a73246a-7324-42e8-8903-f3fe91bc1145'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:17.869413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Network hostable DHCP agents. Network: 5a73246a-7324-42e8-8903-f3fe91bc1145, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:07:17.888275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Network 5a73246a-7324-42e8-8903-f3fe91bc1145 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:07:17.898521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 5a73246a-7324-42e8-8903-f3fe91bc1145) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:17.902675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:17.903259 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:17.908768 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:17.913238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab370f0e-0712-44a6-a627-c8efd74bb3e8 None None] Network 5a73246a-7324-42e8-8903-f3fe91bc1145 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:17.927152 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-35fe27c1-be3c-476d-be8e-fe22d141b565 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 913 time: 0.5392888 May 12 16:07:17.928081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53964) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:17.938131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Network 07846936-71b6-422f-8535-ecb2fe1e1299 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:07:17.985769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:18.000479 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:07:18.002556 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Pushing event updated for resources: {'Port': ['ID=e45aa986-23d1-4720-b9da-c8f58facbb1f,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:18.067204 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.128122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Attempting to bind port e45aa986-23d1-4720-b9da-c8f58facbb1f on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:07:18.128471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Attempting to bind port e45aa986-23d1-4720-b9da-c8f58facbb1f by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'efae1cd4-393e-44fb-b27e-ff29e090987c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '07846936-71b6-422f-8535-ecb2fe1e1299'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:07:18.128833 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Attempting to bind port e45aa986-23d1-4720-b9da-c8f58facbb1f on network 07846936-71b6-422f-8535-ecb2fe1e1299 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:07:18.162481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 7, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:07:18.162846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Checking segment: {'id': 'efae1cd4-393e-44fb-b27e-ff29e090987c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '07846936-71b6-422f-8535-ecb2fe1e1299'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:18.163247 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.163633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Bound using segment: {'id': 'efae1cd4-393e-44fb-b27e-ff29e090987c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '07846936-71b6-422f-8535-ecb2fe1e1299'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:07:18.164098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Bound port: e45aa986-23d1-4720-b9da-c8f58facbb1f, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'efae1cd4-393e-44fb-b27e-ff29e090987c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 563, 'network_id': '07846936-71b6-422f-8535-ecb2fe1e1299'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:07:18.164463 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.249665 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.296379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46e744cc-0275-46ea-b9f7-2367bf4bda36 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-5a73246a-7324-42e8-8903-f3fe91bc1145', 'network_id': '5a73246a-7324-42e8-8903-f3fe91bc1145', 'tenant_id': 'd773dc7c6dd2474a983b86da13037bad', 'fixed_ips': [{'subnet_id': 'c1d605b8-9f74-4067-acca-943463df1aa1'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:07:18.297285 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-46e744cc-0275-46ea-b9f7-2367bf4bda36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.331539 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.362540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-14024220-4154-4364-850c-4cd0b0121891 None None] For port e45aa986-23d1-4720-b9da-c8f58facbb1f, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:07:18.373312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event deleted for resources: {'Subnet': ['ID=c1d605b8-9f74-4067-acca-943463df1aa1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:18.391300 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-14024220-4154-4364-850c-4cd0b0121891 None None] For port e45aa986-23d1-4720-b9da-c8f58facbb1f, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e45aa986-23d1-4720-b9da-c8f58facbb1f,segment=NetworkSegment(efae1cd4-393e-44fb-b27e-ff29e090987c),segment_id=efae1cd4-393e-44fb-b27e-ff29e090987c)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:07:18.399312 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.473375 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server [None req-46e744cc-0275-46ea-b9f7-2367bf4bda36 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet c1d605b8-9f74-4067-acca-943463df1aa1: This subnet is being modified by another concurrent operation. May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 289, in create_dhcp_port May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 114, in _port_action May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 692, in inner May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kwargs) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 217, in wrapped May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.force_reraise() May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise self.value May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1452, in create_port May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1419, in _create_port_db May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1441, in create_port_db May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 219, in allocate_ips_for_port_and_store May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server ips = self.allocate_ips_for_port(context, port_copy) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 217, in wrapped May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1014, in wrapper May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 226, in allocate_ips_for_port May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server return self._allocate_ips_for_port(context, port) May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 258, in _allocate_ips_for_port May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 683, in _ipam_get_subnets May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server subnet.lock_register( May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server raise exception May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet c1d605b8-9f74-4067-acca-943463df1aa1: This subnet is being modified by another concurrent operation. May 12 16:07:18.479704 n-d-841483-1 neutron-server[88153]: ERROR oslo_messaging.rpc.server May 12 16:07:18.503071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14024220-4154-4364-850c-4cd0b0121891 None None] Pushing event updated for resources: {'Port': ['ID=e45aa986-23d1-4720-b9da-c8f58facbb1f,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:18.504665 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-436fc95f-cfb9-46bd-a39f-13a787ce6a81 None None] Network 5a73246a-7324-42e8-8903-f3fe91bc1145 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:18.504766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5a73246a-7324-42e8-8903-f3fe91bc1145']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:18.518185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8e3d49de-6de2-4f49-8251-d5cd7af70d73') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:18.518484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8e3d49de-6de2-4f49-8251-d5cd7af70d73') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:18.530440 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.547805 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.554832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Releasing vlan 583 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:07:18.555210 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: timer() May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:07:18.571760 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:07:18.658878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.683115 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.700416 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "DELETE /v2.0/networks/5a73246a-7324-42e8-8903-f3fe91bc1145 HTTP/1.1" status: 204 len: 168 time: 0.7665703 May 12 16:07:18.701489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53968) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:18.706543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a31313c5-9f30-4b75-bbf3-b2e80c5fe710 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event deleted for resources: {'Network': ['ID=5a73246a-7324-42e8-8903-f3fe91bc1145,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:18.712140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-647373609'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:18.717865 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:18.722715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Usage tracker for resource:network and tenant:d773dc7c6dd2474a983b86da13037bad is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:18.725655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:18.731874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:18.751351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Made reservation on behalf of d773dc7c6dd2474a983b86da13037bad for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:18.754969 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.787638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 564} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:07:18.797795 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.798130 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Added segment 3670a2d8-fa9c-46af-84ea-f3bea27579bd of type vlan for network 6da571fd-4028-4a7a-89c5-70650b64d2e1 May 12 16:07:18.827751 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.869984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.876623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:18.877200 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:18.979548 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.2738755 May 12 16:07:18.979908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53972) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:18.988749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Request body: {'subnet': {'network_id': '6da571fd-4028-4a7a-89c5-70650b64d2e1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:19.012141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-213de55d-5847-4f59-bf6f-5ed0f74f38cb tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event updated for resources: {'Network': ['ID=6da571fd-4028-4a7a-89c5-70650b64d2e1,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:19.022032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 6da571fd-4028-4a7a-89c5-70650b64d2e1 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:07:19.117564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:19.121487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Usage tracker for resource:subnet and tenant:d773dc7c6dd2474a983b86da13037bad is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:19.124461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:19.132217 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:19.145478 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Made reservation on behalf of d773dc7c6dd2474a983b86da13037bad for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:19.149080 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:19.246799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.ipam_backend_mixin [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Performing IP validity checks on allocation pools {{(pid=88152) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:314}} May 12 16:07:19.247311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.ipam_backend_mixin [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Checking for overlaps among allocation pools and gateway ip {{(pid=88152) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:335}} May 12 16:07:19.382539 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:19.451803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e66bbc6a-6161-4535-b3eb-2544207a3c74 None None] Network 07846936-71b6-422f-8535-ecb2fe1e1299 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:19.460656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event updated for resources: {'Subnet': ['ID=c0a9efcb-dece-4b75-8fee-ff56d8be697c,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:19.471332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Checking segment: {'id': '3670a2d8-fa9c-46af-84ea-f3bea27579bd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 564, 'network_id': '6da571fd-4028-4a7a-89c5-70650b64d2e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:19.471690 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Network hostable DHCP agents. Network: 6da571fd-4028-4a7a-89c5-70650b64d2e1, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:07:19.490517 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Network 6da571fd-4028-4a7a-89c5-70650b64d2e1 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:07:19.499620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 6da571fd-4028-4a7a-89c5-70650b64d2e1) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:19.504203 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:19.504823 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:19.513459 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d137e96-4e34-4556-9909-1ae353eff8d6 None None] Network 6da571fd-4028-4a7a-89c5-70650b64d2e1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:19.529141 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5a53968d-56f7-43a8-8b75-48ed0a45b8ee tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 0.5457206 May 12 16:07:19.529520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53976) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:19.644144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c92d735d-afcf-4388-b788-c70508994228 None None] Provisioning for port e45aa986-23d1-4720-b9da-c8f58facbb1f completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:19.675592 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:19.744624 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:19.821871 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:19.862083 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9432dfba-608e-4e43-b1c1-c4e92d7937be None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-6da571fd-4028-4a7a-89c5-70650b64d2e1', 'network_id': '6da571fd-4028-4a7a-89c5-70650b64d2e1', 'tenant_id': 'd773dc7c6dd2474a983b86da13037bad', 'fixed_ips': [{'subnet_id': 'c0a9efcb-dece-4b75-8fee-ff56d8be697c'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:07:19.862887 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9432dfba-608e-4e43-b1c1-c4e92d7937be None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:19.886373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event deleted for resources: {'Subnet': ['ID=c0a9efcb-dece-4b75-8fee-ff56d8be697c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:19.973303 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:19.980609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-685dd69a-439b-413a-a66d-8a2de691c948 None None] Network 6da571fd-4028-4a7a-89c5-70650b64d2e1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:20.005898 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6da571fd-4028-4a7a-89c5-70650b64d2e1']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:20.019916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3670a2d8-fa9c-46af-84ea-f3bea27579bd') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:20.020223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3670a2d8-fa9c-46af-84ea-f3bea27579bd') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:20.036305 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.058130 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.067350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Releasing vlan 564 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:07:20.067760 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: timer() May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:07:20.084770 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:07:20.169967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1c1fc37-35d0-4fec-83c0-ccb22827b1b1 None None] get_active_networks_info from n-d-841483-1 {{(pid=88153) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:157}} May 12 16:07:20.173531 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.191831 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.204526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event deleted for resources: {'Network': ['ID=6da571fd-4028-4a7a-89c5-70650b64d2e1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:20.207712 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-96f2ea8e-4b40-458c-b169-27c005172be7 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "DELETE /v2.0/networks/6da571fd-4028-4a7a-89c5-70650b64d2e1 HTTP/1.1" status: 204 len: 168 time: 0.6771855 May 12 16:07:20.211316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53980) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:20.217621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1038435408'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:20.224155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:20.228106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Usage tracker for resource:network and tenant:d773dc7c6dd2474a983b86da13037bad is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:20.231322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:20.237442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:20.248457 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Made reservation on behalf of d773dc7c6dd2474a983b86da13037bad for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:20.252621 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.283328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1c1fc37-35d0-4fec-83c0-ccb22827b1b1 None None] Resources bound (agent type, host, resource id): {{(pid=88153) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} May 12 16:07:20.285067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 575} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:07:20.297109 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.297582 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Added segment b99961cb-286b-4d12-bbe3-e7426e2f91e7 of type vlan for network b96ea897-7c28-44a6-a38d-cfff768a4831 May 12 16:07:20.326933 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.365523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.371532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:20.372132 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.374008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e45aa986-23d1-4720-b9da-c8f58facbb1f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:20.471372 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.2586753 May 12 16:07:20.474584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53984) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:20.480616 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Request body: {'subnet': {'network_id': 'b96ea897-7c28-44a6-a38d-cfff768a4831', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:20.483685 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6960fe38-c508-47f7-8f57-7b414bdcf3e3 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event updated for resources: {'Network': ['ID=b96ea897-7c28-44a6-a38d-cfff768a4831,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:20.492710 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port e45aa986-23d1-4720-b9da-c8f58facbb1f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:20.501286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network b96ea897-7c28-44a6-a38d-cfff768a4831 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:07:20.548815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port e45aa986-23d1-4720-b9da-c8f58facbb1f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:20.549535 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.594305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:20.598072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Usage tracker for resource:subnet and tenant:d773dc7c6dd2474a983b86da13037bad is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:20.600815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:20.606404 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:20.616347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Made reservation on behalf of d773dc7c6dd2474a983b86da13037bad for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:20.619852 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.851786 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.852099 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.902286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port e45aa986-23d1-4720-b9da-c8f58facbb1f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e45aa986-23d1-4720-b9da-c8f58facbb1f,segment=NetworkSegment(efae1cd4-393e-44fb-b27e-ff29e090987c),segment_id=efae1cd4-393e-44fb-b27e-ff29e090987c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:20.907986 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.936274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event updated for resources: {'Subnet': ['ID=0c028c11-d945-478f-b825-290aae5a8448,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:20.945920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Checking segment: {'id': 'b99961cb-286b-4d12-bbe3-e7426e2f91e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': 'b96ea897-7c28-44a6-a38d-cfff768a4831'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:20.946272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Network hostable DHCP agents. Network: b96ea897-7c28-44a6-a38d-cfff768a4831, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:07:20.966483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Network b96ea897-7c28-44a6-a38d-cfff768a4831 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:07:20.976236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, b96ea897-7c28-44a6-a38d-cfff768a4831) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:20.980382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:20.980951 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:20.983141 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=e45aa986-23d1-4720-b9da-c8f58facbb1f,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:20.988271 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b076751-7d97-4b22-9196-1ca91aad5814 None None] Network b96ea897-7c28-44a6-a38d-cfff768a4831 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:21.002483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f673c4fc-118f-4295-bb1a-32a2b05271b4 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5267363 May 12 16:07:21.006021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53988) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:21.007334 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:21.007671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:21.008000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:21.008322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:21.008639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:21.008958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:21.009272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:21.009622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:21.009936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:21.010245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:21.010555 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:21.010863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:21.011659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-155541026'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:21.017795 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:21.021663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Usage tracker for resource:network and tenant:d773dc7c6dd2474a983b86da13037bad is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:21.024509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Quota usage for network was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:21.031562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:21.042207 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Made reservation on behalf of d773dc7c6dd2474a983b86da13037bad for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:21.045609 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:21.082364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 574} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:07:21.090886 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:21.091225 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Added segment 08bfe879-60b7-4eb8-a035-9a881ef80021 of type vlan for network 3b307f44-63c0-42df-921f-e740cafc89c6 May 12 16:07:21.117144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:21.146200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:21.151873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:21.152443 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:21.221473 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-b96ea897-7c28-44a6-a38d-cfff768a4831', 'network_id': 'b96ea897-7c28-44a6-a38d-cfff768a4831', 'tenant_id': 'd773dc7c6dd2474a983b86da13037bad', 'fixed_ips': [{'subnet_id': '0c028c11-d945-478f-b825-290aae5a8448'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:07:21.222511 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:21.256197 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.2489965 May 12 16:07:21.259208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 53992) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:21.266870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Request body: {'subnet': {'network_id': '3b307f44-63c0-42df-921f-e740cafc89c6', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:21.284517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5fe33d2-0a55-4a8c-9cce-10cccfa1e171 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event updated for resources: {'Network': ['ID=3b307f44-63c0-42df-921f-e740cafc89c6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:21.298084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 3b307f44-63c0-42df-921f-e740cafc89c6 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:07:21.382185 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:21.385965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Usage tracker for resource:subnet and tenant:d773dc7c6dd2474a983b86da13037bad is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:21.388706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:21.395045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:21.404144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Made reservation on behalf of d773dc7c6dd2474a983b86da13037bad for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:21.408379 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:21.495314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Allocated IP 2001:db8::2 (b96ea897-7c28-44a6-a38d-cfff768a4831/0c028c11-d945-478f-b825-290aae5a8448/01a303da-f6da-4023-b658-9fddcee524fd) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:07:21.631239 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:21.700530 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:21.708837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event updated for resources: {'Subnet': ['ID=ca5fa159-ee39-4397-9b92-d51033d15462,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:21.712048 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Transition to ACTIVE for port object 01a303da-f6da-4023-b658-9fddcee524fd will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:21.716124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Checking segment: {'id': '08bfe879-60b7-4eb8-a035-9a881ef80021', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 574, 'network_id': '3b307f44-63c0-42df-921f-e740cafc89c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:21.716479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Network hostable DHCP agents. Network: 3b307f44-63c0-42df-921f-e740cafc89c6, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:07:21.730071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Transition to ACTIVE for port object 01a303da-f6da-4023-b658-9fddcee524fd will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:21.735921 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Network 3b307f44-63c0-42df-921f-e740cafc89c6 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:07:21.736697 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:21.745837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 3b307f44-63c0-42df-921f-e740cafc89c6) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:21.751901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:21.752500 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:21.774985 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a1f7d125-b6e0-43a7-974b-d6c043f25075 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5149777 May 12 16:07:21.777380 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-550a8f45-a737-4bd1-86e4-7b9fdc559288 None None] Network 3b307f44-63c0-42df-921f-e740cafc89c6 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:21.777886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 53996) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:21.872783 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Network b96ea897-7c28-44a6-a38d-cfff768a4831 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:07:21.878014 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:21.884886 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:07:21.895949 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Pushing event updated for resources: {'Port': ['ID=01a303da-f6da-4023-b658-9fddcee524fd,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:21.924106 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:21.994019 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.039246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Attempting to bind port 01a303da-f6da-4023-b658-9fddcee524fd on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:07:22.039601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Attempting to bind port 01a303da-f6da-4023-b658-9fddcee524fd by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'b99961cb-286b-4d12-bbe3-e7426e2f91e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': 'b96ea897-7c28-44a6-a38d-cfff768a4831'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:07:22.039952 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Attempting to bind port 01a303da-f6da-4023-b658-9fddcee524fd on network b96ea897-7c28-44a6-a38d-cfff768a4831 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:07:22.053841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 7, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:07:22.054202 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Checking segment: {'id': 'b99961cb-286b-4d12-bbe3-e7426e2f91e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': 'b96ea897-7c28-44a6-a38d-cfff768a4831'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:22.054593 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.054972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Bound using segment: {'id': 'b99961cb-286b-4d12-bbe3-e7426e2f91e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': 'b96ea897-7c28-44a6-a38d-cfff768a4831'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:07:22.055424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Bound port: 01a303da-f6da-4023-b658-9fddcee524fd, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b99961cb-286b-4d12-bbe3-e7426e2f91e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 575, 'network_id': 'b96ea897-7c28-44a6-a38d-cfff768a4831'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:07:22.055785 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.070633 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.111052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event deleted for resources: {'Subnet': ['ID=ca5fa159-ee39-4397-9b92-d51033d15462,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:22.166362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00b43a49-69f3-4027-8446-6fcaac7ac82f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-3b307f44-63c0-42df-921f-e740cafc89c6', 'network_id': '3b307f44-63c0-42df-921f-e740cafc89c6', 'tenant_id': 'd773dc7c6dd2474a983b86da13037bad', 'fixed_ips': [{'subnet_id': 'ca5fa159-ee39-4397-9b92-d51033d15462'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:07:22.167171 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-00b43a49-69f3-4027-8446-6fcaac7ac82f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.204798 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.207758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] For port 01a303da-f6da-4023-b658-9fddcee524fd, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:07:22.230666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3b307f44-63c0-42df-921f-e740cafc89c6']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:22.243265 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '08bfe879-60b7-4eb8-a035-9a881ef80021') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:22.243545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '08bfe879-60b7-4eb8-a035-9a881ef80021') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:22.255585 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.259594 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] For port 01a303da-f6da-4023-b658-9fddcee524fd, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=01a303da-f6da-4023-b658-9fddcee524fd,segment=NetworkSegment(b99961cb-286b-4d12-bbe3-e7426e2f91e7),segment_id=b99961cb-286b-4d12-bbe3-e7426e2f91e7)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:07:22.273553 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.276257 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.280548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Releasing vlan 574 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:07:22.281727 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: timer() May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: self._notify() May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:07:22.304638 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:07:22.340365 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e45aa986-23d1-4720-b9da-c8f58facbb1f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:22.388808 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.411002 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.422882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event deleted for resources: {'Network': ['ID=3b307f44-63c0-42df-921f-e740cafc89c6,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:22.431592 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6a71c6f5-b726-44ac-81f3-6ed3881e5f74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "DELETE /v2.0/networks/3b307f44-63c0-42df-921f-e740cafc89c6 HTTP/1.1" status: 204 len: 168 time: 0.6526160 May 12 16:07:22.434567 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54000) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:22.479366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b00af11-ecca-492b-ad0a-d05b024ebd43 None None] Network 3b307f44-63c0-42df-921f-e740cafc89c6 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:22.512191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b00af11-ecca-492b-ad0a-d05b024ebd43 None None] Network 3b307f44-63c0-42df-921f-e740cafc89c6 could not be found, it might have been deleted concurrently. {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:220}} May 12 16:07:22.514127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21dfad01-3ddb-44ad-a77b-881100405cdd None None] Pushing event updated for resources: {'Port': ['ID=01a303da-f6da-4023-b658-9fddcee524fd,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:22.533960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port e45aa986-23d1-4720-b9da-c8f58facbb1f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:22.534470 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.595164 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-21d80ec2-358e-4029-a93f-cf09a3fd0a65 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] GET failed (client error): The resource could not be found. May 12 16:07:22.595688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-21d80ec2-358e-4029-a93f-cf09a3fd0a65 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Synchronizing usage tracker for tenant:d773dc7c6dd2474a983b86da13037bad on resource:subnet {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:07:22.614645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-21d80ec2-358e-4029-a93f-cf09a3fd0a65 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Unset dirty status for tenant:d773dc7c6dd2474a983b86da13037bad on resource:subnet {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:07:22.615916 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-21d80ec2-358e-4029-a93f-cf09a3fd0a65 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "GET /v2.0/subnets/ca5fa159-ee39-4397-9b92-d51033d15462 HTTP/1.1" status: 404 len: 337 time: 0.1804245 May 12 16:07:22.618717 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54004) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:22.660454 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-3fbcef99-d121-4ab6-90d4-4da6d49d0169 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] DELETE failed (client error): The resource could not be found. May 12 16:07:22.660932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3fbcef99-d121-4ab6-90d4-4da6d49d0169 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 16:07:22.665362 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3fbcef99-d121-4ab6-90d4-4da6d49d0169 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "DELETE /v2.0/networks/3b307f44-63c0-42df-921f-e740cafc89c6 HTTP/1.1" status: 404 len: 339 time: 0.0449512 May 12 16:07:22.668250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54008) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:22.712353 n-d-841483-1 neutron-server[88152]: INFO neutron.pecan_wsgi.hooks.translation [None req-ef6934f4-9ffc-4c66-a769-f3ecb2c7a1cd tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] DELETE failed (client error): The resource could not be found. May 12 16:07:22.712801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ef6934f4-9ffc-4c66-a769-f3ecb2c7a1cd tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88152) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 16:07:22.717056 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ef6934f4-9ffc-4c66-a769-f3ecb2c7a1cd tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "DELETE /v2.0/subnets/ca5fa159-ee39-4397-9b92-d51033d15462 HTTP/1.1" status: 404 len: 337 time: 0.0476336 May 12 16:07:22.717249 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54012) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:22.748330 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-9f94f423-e46c-4420-8c65-b5f4bbbbc07e tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] DELETE failed (client error): The resource could not be found. May 12 16:07:22.748808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9f94f423-e46c-4420-8c65-b5f4bbbbc07e tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 16:07:22.751405 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9f94f423-e46c-4420-8c65-b5f4bbbbc07e tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "DELETE /v2.0/networks/3b307f44-63c0-42df-921f-e740cafc89c6 HTTP/1.1" status: 404 len: 339 time: 0.0331144 May 12 16:07:22.753799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54016) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:22.831256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-b6ce9ade-dfec-4a66-bf82-2abae210ea74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Deleting subnet 0c028c11-d945-478f-b825-290aae5a8448 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:07:22.834216 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6ce9ade-dfec-4a66-bf82-2abae210ea74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.888073 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6ce9ade-dfec-4a66-bf82-2abae210ea74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:22.975050 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6ce9ade-dfec-4a66-bf82-2abae210ea74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:23.052148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6ce9ade-dfec-4a66-bf82-2abae210ea74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:23.092707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6ce9ade-dfec-4a66-bf82-2abae210ea74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event deleted for resources: {'Subnet': ['ID=0c028c11-d945-478f-b825-290aae5a8448,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:23.099506 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b6ce9ade-dfec-4a66-bf82-2abae210ea74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:23.114448 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b6ce9ade-dfec-4a66-bf82-2abae210ea74 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "DELETE /v2.0/subnets/0c028c11-d945-478f-b825-290aae5a8448 HTTP/1.1" status: 204 len: 168 time: 0.3595212 May 12 16:07:23.116896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54020) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:23.351708 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:23.366096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Deleting port 01a303da-f6da-4023-b658-9fddcee524fd {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:07:23.366620 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:23.420844 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d17cd305-57ae-4ede-88c0-eaa8692cf2a9 None None] Network b96ea897-7c28-44a6-a38d-cfff768a4831 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:23.523566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-3a18c6b8-400b-4444-8a5a-a2e487ac1e87 None None] Provisioning for port 01a303da-f6da-4023-b658-9fddcee524fd completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:23.582947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] For port 01a303da-f6da-4023-b658-9fddcee524fd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=01a303da-f6da-4023-b658-9fddcee524fd,segment=NetworkSegment(b99961cb-286b-4d12-bbe3-e7426e2f91e7),segment_id=b99961cb-286b-4d12-bbe3-e7426e2f91e7)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:23.583298 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:23.673811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecb69226-2cec-4224-ac8b-66687a4903fd None None] DHCP port deletion for b96ea897-7c28-44a6-a38d-cfff768a4831 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:07:23.678148 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ecb69226-2cec-4224-ac8b-66687a4903fd None None] Deleting port 01a303da-f6da-4023-b658-9fddcee524fd {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:07:23.678521 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ecb69226-2cec-4224-ac8b-66687a4903fd None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:23.708519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Calling delete_port for 01a303da-f6da-4023-b658-9fddcee524fd owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:07:23.783649 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:23.834826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event deleted for resources: {'Port': ['ID=01a303da-f6da-4023-b658-9fddcee524fd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:23.838917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] No DVR routers for this DVR port 01a303da-f6da-4023-b658-9fddcee524fd on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:07:23.885264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ecb69226-2cec-4224-ac8b-66687a4903fd None None] For port 01a303da-f6da-4023-b658-9fddcee524fd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=01a303da-f6da-4023-b658-9fddcee524fd,segment=NetworkSegment(b99961cb-286b-4d12-bbe3-e7426e2f91e7),segment_id=b99961cb-286b-4d12-bbe3-e7426e2f91e7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:23.885674 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ecb69226-2cec-4224-ac8b-66687a4903fd None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:23.967401 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:23.993990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b96ea897-7c28-44a6-a38d-cfff768a4831']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:24.006229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ecb69226-2cec-4224-ac8b-66687a4903fd None None] Calling delete_port for 01a303da-f6da-4023-b658-9fddcee524fd owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:07:24.006408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b99961cb-286b-4d12-bbe3-e7426e2f91e7') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:24.006527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b99961cb-286b-4d12-bbe3-e7426e2f91e7') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:24.018296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:24.035315 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:24.041656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Releasing vlan 575 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:07:24.042045 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: timer() May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:07:24.057399 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:07:24.084265 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-ecb69226-2cec-4224-ac8b-66687a4903fd None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:07:24.084620 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-ecb69226-2cec-4224-ac8b-66687a4903fd None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:07:24.139090 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:24.157156 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:24.168527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event deleted for resources: {'Network': ['ID=b96ea897-7c28-44a6-a38d-cfff768a4831,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:24.171283 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a7f37b08-deb6-4fe3-997f-8b225e5cf3a8 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "DELETE /v2.0/networks/b96ea897-7c28-44a6-a38d-cfff768a4831 HTTP/1.1" status: 204 len: 168 time: 1.0533493 May 12 16:07:24.173845 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54024) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:24.210377 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-54dde4da-2c1b-42e8-a7ba-62072d5e774b tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] DELETE failed (client error): The resource could not be found. May 12 16:07:24.210802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-54dde4da-2c1b-42e8-a7ba-62072d5e774b tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 16:07:24.212376 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-54dde4da-2c1b-42e8-a7ba-62072d5e774b tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "DELETE /v2.0/subnets/c0a9efcb-dece-4b75-8fee-ff56d8be697c HTTP/1.1" status: 404 len: 337 time: 0.0376694 May 12 16:07:24.214832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54028) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:24.242641 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-4ebb1fb8-0007-4548-a568-b67ce8870de9 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] DELETE failed (client error): The resource could not be found. May 12 16:07:24.243097 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4ebb1fb8-0007-4548-a568-b67ce8870de9 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 16:07:24.244661 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ebb1fb8-0007-4548-a568-b67ce8870de9 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "DELETE /v2.0/networks/6da571fd-4028-4a7a-89c5-70650b64d2e1 HTTP/1.1" status: 404 len: 339 time: 0.0289853 May 12 16:07:24.247069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54032) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:24.284539 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-a3f06243-adb4-42ca-9a4e-d2c6ff48a003 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] DELETE failed (client error): The resource could not be found. May 12 16:07:24.284975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a3f06243-adb4-42ca-9a4e-d2c6ff48a003 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 16:07:24.286726 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a3f06243-adb4-42ca-9a4e-d2c6ff48a003 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "DELETE /v2.0/subnets/c1d605b8-9f74-4067-acca-943463df1aa1 HTTP/1.1" status: 404 len: 337 time: 0.0387478 May 12 16:07:24.289151 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54036) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:24.312842 n-d-841483-1 neutron-server[88151]: INFO neutron.pecan_wsgi.hooks.translation [None req-ed2b3ba2-a156-4866-be8f-6a365f19548f tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] DELETE failed (client error): The resource could not be found. May 12 16:07:24.313286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ed2b3ba2-a156-4866-be8f-6a365f19548f tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=88151) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} May 12 16:07:24.314858 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ed2b3ba2-a156-4866-be8f-6a365f19548f tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "DELETE /v2.0/networks/5a73246a-7324-42e8-8903-f3fe91bc1145 HTTP/1.1" status: 404 len: 339 time: 0.0248196 May 12 16:07:24.317277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54040) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:24.382852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-52a55fb1-a905-489f-a0e7-bff4b89a41c2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Deleting subnet aac00ae6-ac21-4b29-9034-90288e3be8e6 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:07:24.385621 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-52a55fb1-a905-489f-a0e7-bff4b89a41c2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:24.438453 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-52a55fb1-a905-489f-a0e7-bff4b89a41c2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:24.520410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-52a55fb1-a905-489f-a0e7-bff4b89a41c2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:24.586245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ecb69226-2cec-4224-ac8b-66687a4903fd None None] Deleting port 01a303da-f6da-4023-b658-9fddcee524fd {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:07:24.586770 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ecb69226-2cec-4224-ac8b-66687a4903fd None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:24.595858 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-52a55fb1-a905-489f-a0e7-bff4b89a41c2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:24.634213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52a55fb1-a905-489f-a0e7-bff4b89a41c2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event deleted for resources: {'Subnet': ['ID=aac00ae6-ac21-4b29-9034-90288e3be8e6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:24.637959 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-52a55fb1-a905-489f-a0e7-bff4b89a41c2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:24.648117 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-52a55fb1-a905-489f-a0e7-bff4b89a41c2 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "DELETE /v2.0/subnets/aac00ae6-ac21-4b29-9034-90288e3be8e6 HTTP/1.1" status: 204 len: 168 time: 0.3299067 May 12 16:07:24.648304 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27fae5eb-ea6c-4b35-b50f-61e64b675774 None None] Network 07846936-71b6-422f-8535-ecb2fe1e1299 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:24.650583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54044) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:24.664486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ecb69226-2cec-4224-ac8b-66687a4903fd None None] The port '01a303da-f6da-4023-b658-9fddcee524fd' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 16:07:24.765566 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:24.775752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Deleting port e45aa986-23d1-4720-b9da-c8f58facbb1f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:07:24.776079 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:24.904179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-911ace0a-6f28-4aba-9f52-81e787e86744 None None] DHCP port deletion for 07846936-71b6-422f-8535-ecb2fe1e1299 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:07:24.909307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-911ace0a-6f28-4aba-9f52-81e787e86744 None None] Deleting port e45aa986-23d1-4720-b9da-c8f58facbb1f {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:07:24.909742 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-911ace0a-6f28-4aba-9f52-81e787e86744 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:24.983900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] For port e45aa986-23d1-4720-b9da-c8f58facbb1f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e45aa986-23d1-4720-b9da-c8f58facbb1f,segment=NetworkSegment(efae1cd4-393e-44fb-b27e-ff29e090987c),segment_id=efae1cd4-393e-44fb-b27e-ff29e090987c)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:24.984564 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:25.120485 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-911ace0a-6f28-4aba-9f52-81e787e86744 None None] For port e45aa986-23d1-4720-b9da-c8f58facbb1f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=e45aa986-23d1-4720-b9da-c8f58facbb1f,segment=NetworkSegment(efae1cd4-393e-44fb-b27e-ff29e090987c),segment_id=efae1cd4-393e-44fb-b27e-ff29e090987c)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:25.120779 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-911ace0a-6f28-4aba-9f52-81e787e86744 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:25.217713 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Calling delete_port for e45aa986-23d1-4720-b9da-c8f58facbb1f owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:07:25.241183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-911ace0a-6f28-4aba-9f52-81e787e86744 None None] Calling delete_port for e45aa986-23d1-4720-b9da-c8f58facbb1f owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:07:25.301919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:25.349776 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-911ace0a-6f28-4aba-9f52-81e787e86744 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:07:25.350116 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-911ace0a-6f28-4aba-9f52-81e787e86744 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:07:25.354070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] No DVR routers for this DVR port e45aa986-23d1-4720-b9da-c8f58facbb1f on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:07:25.355857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event deleted for resources: {'Port': ['ID=e45aa986-23d1-4720-b9da-c8f58facbb1f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:25.478567 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:25.503609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['07846936-71b6-422f-8535-ecb2fe1e1299']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:25.515316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'efae1cd4-393e-44fb-b27e-ff29e090987c') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:25.515610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'efae1cd4-393e-44fb-b27e-ff29e090987c') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:25.526577 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:25.542523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:25.549514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Releasing vlan 563 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:07:25.549989 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: timer() May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:07:25.564502 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:07:25.644857 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:25.662568 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:25.673446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] Pushing event deleted for resources: {'Network': ['ID=07846936-71b6-422f-8535-ecb2fe1e1299,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:25.677337 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d1891e27-fc3f-4307-9149-a8aa355edfd5 tempest-NetworksIpV6Test-733786107 tempest-NetworksIpV6Test-733786107-project] 10.222.0.82 "DELETE /v2.0/networks/07846936-71b6-422f-8535-ecb2fe1e1299 HTTP/1.1" status: 204 len: 168 time: 1.0258427 May 12 16:07:25.851475 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-911ace0a-6f28-4aba-9f52-81e787e86744 None None] Deleting port e45aa986-23d1-4720-b9da-c8f58facbb1f {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:07:25.851939 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-911ace0a-6f28-4aba-9f52-81e787e86744 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:25.918259 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-911ace0a-6f28-4aba-9f52-81e787e86744 None None] The port 'e45aa986-23d1-4720-b9da-c8f58facbb1f' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 16:07:25.943126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54052) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:26.091439 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-be768c2c-2e06-471b-a604-db3baacefc47 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d773dc7c6dd2474a983b86da13037bad&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1471310 May 12 16:07:26.093981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54058) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:26.151250 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c2d0da5e-10f0-4dc2-a298-c40bc44ed5a7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:26.179757 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c2d0da5e-10f0-4dc2-a298-c40bc44ed5a7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:26.230187 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c2d0da5e-10f0-4dc2-a298-c40bc44ed5a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:26.243870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2d0da5e-10f0-4dc2-a298-c40bc44ed5a7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40cc6ed2-f7c2-45e1-8806-604257a142d9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:26.250940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c2d0da5e-10f0-4dc2-a298-c40bc44ed5a7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:26.254474 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c2d0da5e-10f0-4dc2-a298-c40bc44ed5a7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/40cc6ed2-f7c2-45e1-8806-604257a142d9 HTTP/1.1" status: 204 len: 168 time: 0.1594307 May 12 16:07:26.325715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e45aa986-23d1-4720-b9da-c8f58facbb1f no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:07:26.360147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: e45aa986-23d1-4720-b9da-c8f58facbb1f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:07:26.360491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device e45aa986-23d1-4720-b9da-c8f58facbb1f not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:07:26.933627 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54082) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:27.031442 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-67c866df-5322-4342-a796-1c6898fa578c tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-190941876', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:27.040215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-67c866df-5322-4342-a796-1c6898fa578c tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:27.044734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-67c866df-5322-4342-a796-1c6898fa578c tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Usage tracker for resource:router and tenant:7b38f9d7b1d24ed796eb57d57155635b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:27.048746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-67c866df-5322-4342-a796-1c6898fa578c tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:27.054976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-67c866df-5322-4342-a796-1c6898fa578c tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:27.064974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-67c866df-5322-4342-a796-1c6898fa578c tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.066209 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-67c866df-5322-4342-a796-1c6898fa578c tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.083492 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-67c866df-5322-4342-a796-1c6898fa578c tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.101660 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-67c866df-5322-4342-a796-1c6898fa578c tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.123780 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-67c866df-5322-4342-a796-1c6898fa578c tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.124925 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-67c866df-5322-4342-a796-1c6898fa578c tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 707 time: 0.1903119 May 12 16:07:27.127796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54088) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:27.133712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-624816934'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:27.139168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:27.144558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Usage tracker for resource:network and tenant:7b38f9d7b1d24ed796eb57d57155635b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:27.147466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:27.153338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:27.164635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Made reservation on behalf of 7b38f9d7b1d24ed796eb57d57155635b for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:27.168011 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.180429 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.195242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:27.199073 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Usage tracker for resource:security_group_rule and tenant:7b38f9d7b1d24ed796eb57d57155635b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:27.201791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:27.207396 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:27.289942 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.293692 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.329153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 552} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:07:27.337260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0efa7c09-ef5e-4f29-b3e7-b976956c6833,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:27.342757 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.343117 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Added segment 8023473f-5f02-4cdd-a28f-905fa0b1f5e3 of type vlan for network 9632a01b-872f-4393-b5fc-f0098c05df25 May 12 16:07:27.369194 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.398606 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.403867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:27.404436 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.512724 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Pushing event updated for resources: {'Network': ['ID=9632a01b-872f-4393-b5fc-f0098c05df25,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:27.515943 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-03b3a1d8-002b-4324-978c-95a94cbb2eaa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.3871977 May 12 16:07:27.519469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54092) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:27.523831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 9632a01b-872f-4393-b5fc-f0098c05df25 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:07:27.524751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Request body: {'subnet': {'network_id': '9632a01b-872f-4393-b5fc-f0098c05df25', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:27.633031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:27.636768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Usage tracker for resource:subnet and tenant:7b38f9d7b1d24ed796eb57d57155635b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:27.639533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:27.645647 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:27.654680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Made reservation on behalf of 7b38f9d7b1d24ed796eb57d57155635b for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:27.658119 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.872675 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.950104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Pushing event updated for resources: {'Subnet': ['ID=65b0a529-2bd9-40eb-85cd-b94596b53184,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:27.958425 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Checking segment: {'id': '8023473f-5f02-4cdd-a28f-905fa0b1f5e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '9632a01b-872f-4393-b5fc-f0098c05df25'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:27.958780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Network hostable DHCP agents. Network: 9632a01b-872f-4393-b5fc-f0098c05df25, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:07:27.977479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Network 9632a01b-872f-4393-b5fc-f0098c05df25 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:07:27.986983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 9632a01b-872f-4393-b5fc-f0098c05df25) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:27.990754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:27.991343 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:27.997324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4601c59e-3057-44dc-8abf-ac6c3c470294 None None] Network 9632a01b-872f-4393-b5fc-f0098c05df25 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:28.015565 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-00db4cdf-103a-4fdf-848a-500ecf2f2378 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.4951613 May 12 16:07:28.018738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54096) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:28.024096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-602019985'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:28.029655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:28.033644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Usage tracker for resource:network and tenant:7b38f9d7b1d24ed796eb57d57155635b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:28.036549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Quota usage for network was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:28.042674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:28.054982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Made reservation on behalf of 7b38f9d7b1d24ed796eb57d57155635b for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:28.058350 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:28.087499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 558} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:07:28.098087 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:28.098448 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Added segment e2b4eebb-195f-4156-98b9-4688deede5a6 of type vlan for network 519daa88-de16-4c77-b8eb-e14dd87c31e7 May 12 16:07:28.126558 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:28.155632 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:28.161176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:28.161782 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:28.221213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-9632a01b-872f-4393-b5fc-f0098c05df25', 'network_id': '9632a01b-872f-4393-b5fc-f0098c05df25', 'tenant_id': '7b38f9d7b1d24ed796eb57d57155635b', 'fixed_ips': [{'subnet_id': '65b0a529-2bd9-40eb-85cd-b94596b53184'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:07:28.222833 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:28.277209 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.2574060 May 12 16:07:28.283562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54102) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:28.286987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573b4992-155e-4021-ac29-e9058b105076 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Pushing event updated for resources: {'Network': ['ID=519daa88-de16-4c77-b8eb-e14dd87c31e7,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:28.292891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Request body: {'subnet': {'network_id': '519daa88-de16-4c77-b8eb-e14dd87c31e7', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:28.336025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 519daa88-de16-4c77-b8eb-e14dd87c31e7 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:07:28.381948 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4aa268ef-c916-435f-a806-6be2d5177ad1 req-e8aef957-fa10-4f2f-bf5c-aa294c4eece1 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.1144891 May 12 16:07:28.428452 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:28.432321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Usage tracker for resource:subnet and tenant:7b38f9d7b1d24ed796eb57d57155635b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:28.435204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:28.442883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:28.460814 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Made reservation on behalf of 7b38f9d7b1d24ed796eb57d57155635b for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:28.464663 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:28.515874 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4aa268ef-c916-435f-a806-6be2d5177ad1 req-a52186a7-04ab-41c1-8b33-fca07642f8bb service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0502036 May 12 16:07:28.533755 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Allocated IP 172.20.0.2 (9632a01b-872f-4393-b5fc-f0098c05df25/65b0a529-2bd9-40eb-85cd-b94596b53184/d8bbea0c-4c2b-4165-ab6e-26acabb069a6) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:07:28.678871 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4aa268ef-c916-435f-a806-6be2d5177ad1 req-2a98120f-60c6-4186-a87e-d3ebedd80624 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1450903 May 12 16:07:28.712455 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:28.744936 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:28.756587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Transition to ACTIVE for port object d8bbea0c-4c2b-4165-ab6e-26acabb069a6 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:28.775803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Transition to ACTIVE for port object d8bbea0c-4c2b-4165-ab6e-26acabb069a6 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:28.784415 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:28.798206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Pushing event updated for resources: {'Subnet': ['ID=e3971834-3be2-4827-9108-610975388cda,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:28.811297 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:28.812202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:28.812202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:28.812431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:28.812658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:28.813686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:28.814019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:28.814349 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:28.815024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:28.815341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:28.816072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:28.816072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:28.822697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Checking segment: {'id': 'e2b4eebb-195f-4156-98b9-4688deede5a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '519daa88-de16-4c77-b8eb-e14dd87c31e7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:28.823061 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Network hostable DHCP agents. Network: 519daa88-de16-4c77-b8eb-e14dd87c31e7, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:07:28.835285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aa268ef-c916-435f-a806-6be2d5177ad1 req-bf53f451-7315-42a0-9c2f-8ae2f0245143 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:28.836820 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4aa268ef-c916-435f-a806-6be2d5177ad1 req-bf53f451-7315-42a0-9c2f-8ae2f0245143 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1522088 May 12 16:07:28.848799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Network 519daa88-de16-4c77-b8eb-e14dd87c31e7 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:07:28.855446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Network 9632a01b-872f-4393-b5fc-f0098c05df25 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:07:28.858247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:28.859395 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 519daa88-de16-4c77-b8eb-e14dd87c31e7) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:28.862792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:07:28.865025 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:28.865777 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:28.872524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae7c9637-e34a-4200-b51c-487157bf68fa None None] Network 519daa88-de16-4c77-b8eb-e14dd87c31e7 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:28.887976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-be1385b7-21f0-42da-bff5-e6141d4db2e2 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6027164 May 12 16:07:28.890679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54106) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:28.896434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-2b2507ea-cb6e-4458-ae0e-c91e01241f98 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Request body: {'router': {'external_gateway_info': {'network_id': '519daa88-de16-4c77-b8eb-e14dd87c31e7'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:28.912758 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Pushing event updated for resources: {'Port': ['ID=d8bbea0c-4c2b-4165-ab6e-26acabb069a6,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:28.968801 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:07:29.034759 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Attempting to bind port d8bbea0c-4c2b-4165-ab6e-26acabb069a6 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:07:29.035023 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Attempting to bind port d8bbea0c-4c2b-4165-ab6e-26acabb069a6 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '8023473f-5f02-4cdd-a28f-905fa0b1f5e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '9632a01b-872f-4393-b5fc-f0098c05df25'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:07:29.035371 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Attempting to bind port d8bbea0c-4c2b-4165-ab6e-26acabb069a6 on network 9632a01b-872f-4393-b5fc-f0098c05df25 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:07:29.054025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 7, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:07:29.054383 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Checking segment: {'id': '8023473f-5f02-4cdd-a28f-905fa0b1f5e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '9632a01b-872f-4393-b5fc-f0098c05df25'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:29.054773 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:29.055152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Bound using segment: {'id': '8023473f-5f02-4cdd-a28f-905fa0b1f5e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '9632a01b-872f-4393-b5fc-f0098c05df25'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:07:29.055606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Bound port: d8bbea0c-4c2b-4165-ab6e-26acabb069a6, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8023473f-5f02-4cdd-a28f-905fa0b1f5e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 552, 'network_id': '9632a01b-872f-4393-b5fc-f0098c05df25'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:07:29.055972 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:29.238785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] For port d8bbea0c-4c2b-4165-ab6e-26acabb069a6, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:07:29.247603 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] For port d8bbea0c-4c2b-4165-ab6e-26acabb069a6, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d8bbea0c-4c2b-4165-ab6e-26acabb069a6,segment=NetworkSegment(8023473f-5f02-4cdd-a28f-905fa0b1f5e3),segment_id=8023473f-5f02-4cdd-a28f-905fa0b1f5e3)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:07:29.253195 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:29.279205 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2b2507ea-cb6e-4458-ae0e-c91e01241f98 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:29.286599 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-519daa88-de16-4c77-b8eb-e14dd87c31e7', 'network_id': '519daa88-de16-4c77-b8eb-e14dd87c31e7', 'tenant_id': '7b38f9d7b1d24ed796eb57d57155635b', 'fixed_ips': [{'subnet_id': 'e3971834-3be2-4827-9108-610975388cda'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:07:29.287333 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:29.428499 n-d-841483-1 neutron-server[88152]: INFO neutron.api.v2.resource [None req-2b2507ea-cb6e-4458-ae0e-c91e01241f98 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. May 12 16:07:29.436126 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2b2507ea-cb6e-4458-ae0e-c91e01241f98 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] 10.222.0.82 "PUT /v2.0/routers/b8963a71-b06e-44ef-8a8c-d0dd808ac942 HTTP/1.1" status: 400 len: 364 time: 0.5382719 May 12 16:07:29.437100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54112) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:29.450904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51863df5-0556-4904-8484-dcc46998d4ca None None] Pushing event updated for resources: {'Port': ['ID=d8bbea0c-4c2b-4165-ab6e-26acabb069a6,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:29.517402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-64d315b4-ee36-4655-87fd-3d2f6019cec7 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Deleting subnet e3971834-3be2-4827-9108-610975388cda {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:07:29.539846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Allocated IP 172.21.0.2 (519daa88-de16-4c77-b8eb-e14dd87c31e7/e3971834-3be2-4827-9108-610975388cda/0b4acec6-c6b7-4804-b230-4119a91fc101) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:07:29.760868 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:29.774090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Transition to ACTIVE for port object 0b4acec6-c6b7-4804-b230-4119a91fc101 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:29.792189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Transition to ACTIVE for port object 0b4acec6-c6b7-4804-b230-4119a91fc101 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:29.796904 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64d315b4-ee36-4655-87fd-3d2f6019cec7 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:29.798271 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:29.857608 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64d315b4-ee36-4655-87fd-3d2f6019cec7 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:29.865574 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Network 519daa88-de16-4c77-b8eb-e14dd87c31e7 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:07:29.868530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:29.872081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:07:29.878164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Pushing event updated for resources: {'Port': ['ID=0b4acec6-c6b7-4804-b230-4119a91fc101,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:29.952125 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64d315b4-ee36-4655-87fd-3d2f6019cec7 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:29.968370 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Attempting to bind port 0b4acec6-c6b7-4804-b230-4119a91fc101 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:07:29.968731 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Attempting to bind port 0b4acec6-c6b7-4804-b230-4119a91fc101 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'e2b4eebb-195f-4156-98b9-4688deede5a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '519daa88-de16-4c77-b8eb-e14dd87c31e7'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:07:29.969314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Attempting to bind port 0b4acec6-c6b7-4804-b230-4119a91fc101 on network 519daa88-de16-4c77-b8eb-e14dd87c31e7 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:07:29.974493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 7, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:07:29.974860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Checking segment: {'id': 'e2b4eebb-195f-4156-98b9-4688deede5a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '519daa88-de16-4c77-b8eb-e14dd87c31e7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:29.975251 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:29.975628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Bound using segment: {'id': 'e2b4eebb-195f-4156-98b9-4688deede5a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '519daa88-de16-4c77-b8eb-e14dd87c31e7'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:07:29.976081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Bound port: 0b4acec6-c6b7-4804-b230-4119a91fc101, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e2b4eebb-195f-4156-98b9-4688deede5a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 558, 'network_id': '519daa88-de16-4c77-b8eb-e14dd87c31e7'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:07:29.976443 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:30.026311 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64d315b4-ee36-4655-87fd-3d2f6019cec7 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:30.069523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] For port 0b4acec6-c6b7-4804-b230-4119a91fc101, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:07:30.070830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64d315b4-ee36-4655-87fd-3d2f6019cec7 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Pushing event deleted for resources: {'Subnet': ['ID=e3971834-3be2-4827-9108-610975388cda,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:30.072785 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-64d315b4-ee36-4655-87fd-3d2f6019cec7 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:30.073060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] For port 0b4acec6-c6b7-4804-b230-4119a91fc101, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0b4acec6-c6b7-4804-b230-4119a91fc101,segment=NetworkSegment(e2b4eebb-195f-4156-98b9-4688deede5a6),segment_id=e2b4eebb-195f-4156-98b9-4688deede5a6)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:07:30.082254 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-64d315b4-ee36-4655-87fd-3d2f6019cec7 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] 10.222.0.82 "DELETE /v2.0/subnets/e3971834-3be2-4827-9108-610975388cda HTTP/1.1" status: 204 len: 168 time: 0.6405432 May 12 16:07:30.082398 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:30.082506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54116) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:30.162583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d5e734a-162c-4552-a453-1e7494b0d756 None None] Pushing event updated for resources: {'Port': ['ID=0b4acec6-c6b7-4804-b230-4119a91fc101,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:30.208512 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:30.221161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Deleting port 0b4acec6-c6b7-4804-b230-4119a91fc101 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:07:30.221161 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:30.396197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d8bbea0c-4c2b-4165-ab6e-26acabb069a6 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:30.502607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port d8bbea0c-4c2b-4165-ab6e-26acabb069a6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:30.599808 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82b19f5a-2542-4c49-90e0-254548bef3d0 None None] Network 9632a01b-872f-4393-b5fc-f0098c05df25 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:30.612250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] For port 0b4acec6-c6b7-4804-b230-4119a91fc101, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0b4acec6-c6b7-4804-b230-4119a91fc101,segment=NetworkSegment(e2b4eebb-195f-4156-98b9-4688deede5a6),segment_id=e2b4eebb-195f-4156-98b9-4688deede5a6)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:30.612825 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:30.687520 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-053b2bce-bb40-4c72-8308-f4c2c692f183 None None] Provisioning for port d8bbea0c-4c2b-4165-ab6e-26acabb069a6 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:30.695427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-053b2bce-bb40-4c72-8308-f4c2c692f183 None None] Provisioning complete for port d8bbea0c-4c2b-4165-ab6e-26acabb069a6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:30.695799 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-053b2bce-bb40-4c72-8308-f4c2c692f183 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:30.739030 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Calling delete_port for 0b4acec6-c6b7-4804-b230-4119a91fc101 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:07:30.821323 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:30.872117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Pushing event deleted for resources: {'Port': ['ID=0b4acec6-c6b7-4804-b230-4119a91fc101,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:30.878414 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] No DVR routers for this DVR port 0b4acec6-c6b7-4804-b230-4119a91fc101 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:07:30.927607 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-053b2bce-bb40-4c72-8308-f4c2c692f183 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:30.972124 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-053b2bce-bb40-4c72-8308-f4c2c692f183 None None] For port d8bbea0c-4c2b-4165-ab6e-26acabb069a6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d8bbea0c-4c2b-4165-ab6e-26acabb069a6,segment=NetworkSegment(8023473f-5f02-4cdd-a28f-905fa0b1f5e3),segment_id=8023473f-5f02-4cdd-a28f-905fa0b1f5e3)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:30.978207 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-053b2bce-bb40-4c72-8308-f4c2c692f183 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.017912 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.048420 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['519daa88-de16-4c77-b8eb-e14dd87c31e7']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:31.051865 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-053b2bce-bb40-4c72-8308-f4c2c692f183 None None] Pushing event updated for resources: {'Port': ['ID=d8bbea0c-4c2b-4165-ab6e-26acabb069a6,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:31.062019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e2b4eebb-195f-4156-98b9-4688deede5a6') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:31.062382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e2b4eebb-195f-4156-98b9-4688deede5a6') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:31.085871 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.103104 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.110202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Releasing vlan 558 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:07:31.110607 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: timer() May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: self._notify() May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:07:31.129966 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:07:31.218922 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.237231 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.248714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Pushing event deleted for resources: {'Network': ['ID=519daa88-de16-4c77-b8eb-e14dd87c31e7,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:31.253267 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7b4f0c74-6c6b-4d53-8a1f-0e068b5e7874 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] 10.222.0.82 "DELETE /v2.0/networks/519daa88-de16-4c77-b8eb-e14dd87c31e7 HTTP/1.1" status: 204 len: 168 time: 1.1696541 May 12 16:07:31.255827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54120) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:31.330366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-c76a2caf-ac1f-40e2-88d8-a4c61753a1f8 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Deleting subnet 65b0a529-2bd9-40eb-85cd-b94596b53184 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:07:31.333484 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c76a2caf-ac1f-40e2-88d8-a4c61753a1f8 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.394513 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c76a2caf-ac1f-40e2-88d8-a4c61753a1f8 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.398049 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a6b2656-c64e-4f54-a9ed-8f7e073390aa None None] DHCP port deletion for 519daa88-de16-4c77-b8eb-e14dd87c31e7 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:07:31.405849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fb97ad84-07a9-4a8f-9df3-059189d10681 None None] Provisioning complete for port d8bbea0c-4c2b-4165-ab6e-26acabb069a6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:31.406219 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fb97ad84-07a9-4a8f-9df3-059189d10681 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.445894 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-902faf70-e47d-440e-8d51-3394b955cdf6 None None] Network 519daa88-de16-4c77-b8eb-e14dd87c31e7 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:31.478344 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-902faf70-e47d-440e-8d51-3394b955cdf6 None None] Network 519daa88-de16-4c77-b8eb-e14dd87c31e7 could not be found, it might have been deleted concurrently. {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:220}} May 12 16:07:31.489534 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c76a2caf-ac1f-40e2-88d8-a4c61753a1f8 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.550945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fb97ad84-07a9-4a8f-9df3-059189d10681 None None] Could not find standard attr ID for object 0b4acec6-c6b7-4804-b230-4119a91fc101. {{(pid=88153) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} May 12 16:07:31.563917 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c76a2caf-ac1f-40e2-88d8-a4c61753a1f8 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.606778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c76a2caf-ac1f-40e2-88d8-a4c61753a1f8 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Pushing event deleted for resources: {'Subnet': ['ID=65b0a529-2bd9-40eb-85cd-b94596b53184,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:31.608569 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c76a2caf-ac1f-40e2-88d8-a4c61753a1f8 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.615367 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c76a2caf-ac1f-40e2-88d8-a4c61753a1f8 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] 10.222.0.82 "DELETE /v2.0/subnets/65b0a529-2bd9-40eb-85cd-b94596b53184 HTTP/1.1" status: 204 len: 168 time: 0.3585086 May 12 16:07:31.615514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-216bf772-94ef-45ae-a764-cd33bd4d0c53 None None] Network 9632a01b-872f-4393-b5fc-f0098c05df25 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:31.617747 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54124) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:31.730495 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.742480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Deleting port d8bbea0c-4c2b-4165-ab6e-26acabb069a6 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:07:31.742814 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.852385 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5ecb4a67-351c-4348-b320-a9439a13ccb0 None None] DHCP port deletion for 9632a01b-872f-4393-b5fc-f0098c05df25 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:07:31.856643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5ecb4a67-351c-4348-b320-a9439a13ccb0 None None] Deleting port d8bbea0c-4c2b-4165-ab6e-26acabb069a6 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:07:31.857073 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ecb4a67-351c-4348-b320-a9439a13ccb0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:31.950955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] For port d8bbea0c-4c2b-4165-ab6e-26acabb069a6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d8bbea0c-4c2b-4165-ab6e-26acabb069a6,segment=NetworkSegment(8023473f-5f02-4cdd-a28f-905fa0b1f5e3),segment_id=8023473f-5f02-4cdd-a28f-905fa0b1f5e3)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:31.951313 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:32.077718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Calling delete_port for d8bbea0c-4c2b-4165-ab6e-26acabb069a6 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:07:32.093005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5ecb4a67-351c-4348-b320-a9439a13ccb0 None None] For port d8bbea0c-4c2b-4165-ab6e-26acabb069a6, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d8bbea0c-4c2b-4165-ab6e-26acabb069a6,segment=NetworkSegment(8023473f-5f02-4cdd-a28f-905fa0b1f5e3),segment_id=8023473f-5f02-4cdd-a28f-905fa0b1f5e3)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:32.093324 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ecb4a67-351c-4348-b320-a9439a13ccb0 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:32.159005 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:32.208360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Pushing event deleted for resources: {'Port': ['ID=d8bbea0c-4c2b-4165-ab6e-26acabb069a6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:32.210179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] No DVR routers for this DVR port d8bbea0c-4c2b-4165-ab6e-26acabb069a6 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:07:32.214038 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5ecb4a67-351c-4348-b320-a9439a13ccb0 None None] Calling delete_port for d8bbea0c-4c2b-4165-ab6e-26acabb069a6 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:07:32.289548 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-5ecb4a67-351c-4348-b320-a9439a13ccb0 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:07:32.289895 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-5ecb4a67-351c-4348-b320-a9439a13ccb0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:07:32.332996 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d8bbea0c-4c2b-4165-ab6e-26acabb069a6 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:07:32.342983 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:32.367238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: d8bbea0c-4c2b-4165-ab6e-26acabb069a6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:07:32.367566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d8bbea0c-4c2b-4165-ab6e-26acabb069a6 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:07:32.373204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9632a01b-872f-4393-b5fc-f0098c05df25']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:32.385950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8023473f-5f02-4cdd-a28f-905fa0b1f5e3') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:32.386248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8023473f-5f02-4cdd-a28f-905fa0b1f5e3') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:32.397951 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:32.414163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:32.420368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Releasing vlan 552 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:07:32.420810 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: timer() May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:07:32.436178 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:07:32.516879 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:32.636166 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:32.647013 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Pushing event deleted for resources: {'Network': ['ID=9632a01b-872f-4393-b5fc-f0098c05df25,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:32.652074 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-79535745-7382-4448-853a-e30e7aeb1afd tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] 10.222.0.82 "DELETE /v2.0/networks/9632a01b-872f-4393-b5fc-f0098c05df25 HTTP/1.1" status: 204 len: 168 time: 1.0322924 May 12 16:07:32.653634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54128) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:32.696278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-191d76a0-652c-42b9-a244-7f0d9c4631fa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Synchronizing usage tracker for tenant:7b38f9d7b1d24ed796eb57d57155635b on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:07:32.712603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-191d76a0-652c-42b9-a244-7f0d9c4631fa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Unset dirty status for tenant:7b38f9d7b1d24ed796eb57d57155635b on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:07:32.713751 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-191d76a0-652c-42b9-a244-7f0d9c4631fa tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] 10.222.0.82 "GET /v2.0/ports?device_id=b8963a71-b06e-44ef-8a8c-d0dd808ac942 HTTP/1.1" status: 200 len: 205 time: 0.0592387 May 12 16:07:32.716176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54132) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:32.791564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5ecb4a67-351c-4348-b320-a9439a13ccb0 None None] Deleting port d8bbea0c-4c2b-4165-ab6e-26acabb069a6 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:07:32.792151 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5ecb4a67-351c-4348-b320-a9439a13ccb0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:32.849136 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6d56e7ea-3642-4384-a682-59976f4870e0 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:32.869779 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5ecb4a67-351c-4348-b320-a9439a13ccb0 None None] The port 'd8bbea0c-4c2b-4165-ab6e-26acabb069a6' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 16:07:32.881481 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:33.140464 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6d56e7ea-3642-4384-a682-59976f4870e0 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:33.143138 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6d56e7ea-3642-4384-a682-59976f4870e0 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:33.165098 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6d56e7ea-3642-4384-a682-59976f4870e0 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:33.165606 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d56e7ea-3642-4384-a682-59976f4870e0 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Fanout notify agent at l3_agent the message router_deleted on router b8963a71-b06e-44ef-8a8c-d0dd808ac942 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:07:33.176625 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6d56e7ea-3642-4384-a682-59976f4870e0 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:33.177713 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6d56e7ea-3642-4384-a682-59976f4870e0 tempest-RoutersNegativeTest-455161744 tempest-RoutersNegativeTest-455161744-project] 10.222.0.82 "DELETE /v2.0/routers/b8963a71-b06e-44ef-8a8c-d0dd808ac942 HTTP/1.1" status: 204 len: 168 time: 0.4606450 May 12 16:07:33.439148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54140) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:33.585373 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d29103c4-1e40-4368-a866-07a2fd7b2c1c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7b38f9d7b1d24ed796eb57d57155635b&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1450245 May 12 16:07:33.587805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54146) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:33.646595 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7a58604-a890-4b45-a2f9-f83dffa39d52 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:33.671602 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7a58604-a890-4b45-a2f9-f83dffa39d52 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:33.726742 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7a58604-a890-4b45-a2f9-f83dffa39d52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:33.744818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a58604-a890-4b45-a2f9-f83dffa39d52 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0efa7c09-ef5e-4f29-b3e7-b976956c6833,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:33.752543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c7a58604-a890-4b45-a2f9-f83dffa39d52 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:33.756926 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c7a58604-a890-4b45-a2f9-f83dffa39d52 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0efa7c09-ef5e-4f29-b3e7-b976956c6833 HTTP/1.1" status: 204 len: 168 time: 0.1682286 May 12 16:07:34.404945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54170) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:34.510609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Request body: {'network': {'name': 'tempest-TestEncryptedCinderVolumes-221317309-network', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:34.517459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:34.521233 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Usage tracker for resource:network and tenant:9d2ddec2b766440fab8b257efda46f59 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:34.524069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:34.529715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:34.539313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Made reservation on behalf of 9d2ddec2b766440fab8b257efda46f59 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:34.541534 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:34.553917 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:34.568615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:34.572338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Usage tracker for resource:security_group_rule and tenant:9d2ddec2b766440fab8b257efda46f59 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:34.575152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:34.580922 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:34.660383 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:34.664312 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:34.693501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 550} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:07:34.701409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5bc9fe62-fd41-43c0-9779-83fca95fbccd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:34.707055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:34.707387 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Added segment 543d1def-817b-422e-8be2-83e1c89dcdac of type vlan for network 6df4e173-ea16-4675-98b5-60fef3f72088 May 12 16:07:34.737950 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:34.767525 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:34.768420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:34.769024 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:34.868226 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] Pushing event updated for resources: {'Network': ['ID=6df4e173-ea16-4675-98b5-60fef3f72088,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:34.871284 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-21015df1-a81d-4ab0-aa01-549726a68115 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.4652905 May 12 16:07:34.874550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54176) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:34.878866 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 6df4e173-ea16-4675-98b5-60fef3f72088 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:07:34.880303 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Request body: {'subnet': {'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestEncryptedCinderVolumes-221317309-subnet', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:34.886254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:34.890073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Usage tracker for resource:subnet and tenant:9d2ddec2b766440fab8b257efda46f59 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:34.892959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:34.898655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:34.910161 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Made reservation on behalf of 9d2ddec2b766440fab8b257efda46f59 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:34.912407 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:35.120214 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:35.196716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Pushing event updated for resources: {'Subnet': ['ID=567ea8ae-7967-4eae-8499-8b5e3e2b7ab3,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:35.200685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Checking segment: {'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:35.201038 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Network hostable DHCP agents. Network: 6df4e173-ea16-4675-98b5-60fef3f72088, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:07:35.220160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Network 6df4e173-ea16-4675-98b5-60fef3f72088 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:07:35.230350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 6df4e173-ea16-4675-98b5-60fef3f72088) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:35.235183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:35.235874 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:35.240390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d692634-4d52-49cb-8439-457deb878c19 None None] Network 6df4e173-ea16-4675-98b5-60fef3f72088 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:35.259815 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-cf022353-5b84-4f54-b28c-beba774c4368 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.3842783 May 12 16:07:35.262492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54180) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:35.267933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Request body: {'router': {'name': 'tempest-TestEncryptedCinderVolumes-221317309-router', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:35.273113 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:35.277073 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Usage tracker for resource:router and tenant:9d2ddec2b766440fab8b257efda46f59 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:35.279920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:35.285798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:35.296375 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:35.297933 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:35.312315 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:35.458839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-6df4e173-ea16-4675-98b5-60fef3f72088', 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'fixed_ips': [{'subnet_id': '567ea8ae-7967-4eae-8499-8b5e3e2b7ab3'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:07:35.459688 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:35.587464 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:35.616642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Allocated IP 172.20.0.2 (6df4e173-ea16-4675-98b5-60fef3f72088/567ea8ae-7967-4eae-8499-8b5e3e2b7ab3/6110429c-054b-4639-ae3e-ac591d83202e) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:07:35.821325 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:35.832511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Transition to ACTIVE for port object 6110429c-054b-4639-ae3e-ac591d83202e will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:35.852266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Transition to ACTIVE for port object 6110429c-054b-4639-ae3e-ac591d83202e will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:35.858329 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:35.927511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Network 6df4e173-ea16-4675-98b5-60fef3f72088 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:07:35.930430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:35.933968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:07:35.964525 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Pushing event updated for resources: {'Port': ['ID=6110429c-054b-4639-ae3e-ac591d83202e,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:36.014254 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:36.026832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Attempting to bind port 6110429c-054b-4639-ae3e-ac591d83202e on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:07:36.027186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Attempting to bind port 6110429c-054b-4639-ae3e-ac591d83202e by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:07:36.027536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Attempting to bind port 6110429c-054b-4639-ae3e-ac591d83202e on network 6df4e173-ea16-4675-98b5-60fef3f72088 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:07:36.033358 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 7, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:07:36.033741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Checking segment: {'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:36.034131 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:36.034513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Bound using segment: {'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:07:36.034962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Bound port: 6110429c-054b-4639-ae3e-ac591d83202e, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:07:36.035323 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:36.044882 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:36.121360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] For port 6110429c-054b-4639-ae3e-ac591d83202e, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:07:36.124253 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] For port 6110429c-054b-4639-ae3e-ac591d83202e, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6110429c-054b-4639-ae3e-ac591d83202e,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:07:36.128195 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:36.181572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Allocated IP 172.25.8.42 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/adaab294-8a56-4fca-864d-6cc3fa7e6c2a) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:07:36.248129 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f6c54e3-3e0d-4eb1-b9e9-5653a7df819d None None] Pushing event updated for resources: {'Port': ['ID=6110429c-054b-4639-ae3e-ac591d83202e,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:36.339043 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:36.373552 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:36.446701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:07:36.449562 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:36.452455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:07:36.501370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Pushing event updated for resources: {'Port': ['ID=adaab294-8a56-4fca-864d-6cc3fa7e6c2a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:36.869178 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:37.188119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bd0d451-7d76-4ddd-952c-73f63fbdaeed None None] Network 6df4e173-ea16-4675-98b5-60fef3f72088 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:37.216186 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:37.284125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fead8f62-7831-4b97-907e-aa2f3b2c7ece None None] Provisioning for port 6110429c-054b-4639-ae3e-ac591d83202e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:37.572466 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Router eb600664-877c-4c5a-bed6-7943ca39c2c2 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 16:07:37.757225 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:07:37.766687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Sync routers for ids ['eb600664-877c-4c5a-bed6-7943ca39c2c2'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:07:37.776627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Routers {'eb600664-877c-4c5a-bed6-7943ca39c2c2'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:07:37.777368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['eb600664-877c-4c5a-bed6-7943ca39c2c2'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:37.782579 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:37.783918 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f927a93e-d0f6-45dc-9a55-a56f573cab08 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.5202913 May 12 16:07:37.786665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54184) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:37.980256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Set router eb600664-877c-4c5a-bed6-7943ca39c2c2 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:07:38.339275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'name': 'tempest-TestEncryptedCinderVolumes-221317309-router', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.42'}], 'enable_snat': True}, 'gw_port_id': 'adaab294-8a56-4fca-864d-6cc3fa7e6c2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:35Z', 'updated_at': '2022-05-12T16:07:36Z', 'revision_number': 3, 'project_id': '9d2ddec2b766440fab8b257efda46f59', 'gw_port': {'id': 'adaab294-8a56-4fca-864d-6cc3fa7e6c2a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:9c:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4214, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:36Z', 'updated_at': '2022-05-12T16:07:36Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:38.343587 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Checking router: eb600664-877c-4c5a-bed6-7943ca39c2c2 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:07:38.344509 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Updating router eb600664-877c-4c5a-bed6-7943ca39c2c2 port adaab294-8a56-4fca-864d-6cc3fa7e6c2a binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:07:38.373273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6110429c-054b-4639-ae3e-ac591d83202e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:38.447800 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:38.502202 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:38.553073 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 6110429c-054b-4639-ae3e-ac591d83202e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:38.568867 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 6110429c-054b-4639-ae3e-ac591d83202e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:38.569319 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:38.720907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Allocated IP 172.20.0.1 (6df4e173-ea16-4675-98b5-60fef3f72088/567ea8ae-7967-4eae-8499-8b5e3e2b7ab3/4fc9693c-01da-4b8f-9141-c829bf0b7050) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:07:38.807851 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:38.861672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 6110429c-054b-4639-ae3e-ac591d83202e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6110429c-054b-4639-ae3e-ac591d83202e,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:38.892880 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:38.981300 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:38.996619 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:38.998174 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=6110429c-054b-4639-ae3e-ac591d83202e,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:39.001117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Transition to ACTIVE for port object adaab294-8a56-4fca-864d-6cc3fa7e6c2a will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:39.008228 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:39.012595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Transition to ACTIVE for port object 4fc9693c-01da-4b8f-9141-c829bf0b7050 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:39.037075 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:39.088605 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Attempting to bind port adaab294-8a56-4fca-864d-6cc3fa7e6c2a on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:07:39.088962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Attempting to bind port adaab294-8a56-4fca-864d-6cc3fa7e6c2a by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:07:39.089320 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Attempting to bind port adaab294-8a56-4fca-864d-6cc3fa7e6c2a on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:07:39.099908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-755d732c-317b-4c85-95e4-189094f406f8 None None] Pushing event updated for resources: {'Port': ['ID=adaab294-8a56-4fca-864d-6cc3fa7e6c2a,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:39.100970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Network 6df4e173-ea16-4675-98b5-60fef3f72088 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:07:39.103129 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 7, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:07:39.103500 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:39.103658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:39.103892 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:39.104268 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:07:39.104733 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Bound port: adaab294-8a56-4fca-864d-6cc3fa7e6c2a, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:07:39.105595 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:39.107445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:07:39.148003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Pushing event updated for resources: {'Port': ['ID=4fc9693c-01da-4b8f-9141-c829bf0b7050,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:39.172510 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:39.230670 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] For port adaab294-8a56-4fca-864d-6cc3fa7e6c2a, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:07:39.234202 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] For port adaab294-8a56-4fca-864d-6cc3fa7e6c2a, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=adaab294-8a56-4fca-864d-6cc3fa7e6c2a,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:07:39.240701 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:39.326255 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Routers {'eb600664-877c-4c5a-bed6-7943ca39c2c2'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:07:39.326881 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['eb600664-877c-4c5a-bed6-7943ca39c2c2'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:39.382704 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-755d732c-317b-4c85-95e4-189094f406f8 None None] Pushing event updated for resources: {'Port': ['ID=adaab294-8a56-4fca-864d-6cc3fa7e6c2a,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:39.443066 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:39.508220 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-dc7074e5-2daf-4c09-af6b-e2847f50312b None None] Provisioning for port 4fc9693c-01da-4b8f-9141-c829bf0b7050 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:39.521203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-dc7074e5-2daf-4c09-af6b-e2847f50312b None None] Provisioning complete for port 4fc9693c-01da-4b8f-9141-c829bf0b7050 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:39.521601 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dc7074e5-2daf-4c09-af6b-e2847f50312b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:39.558316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] Set router eb600664-877c-4c5a-bed6-7943ca39c2c2 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:07:39.663366 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:39.668169 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:39.747012 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-dc7074e5-2daf-4c09-af6b-e2847f50312b None None] Port 4fc9693c-01da-4b8f-9141-c829bf0b7050 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:07:39.776115 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:39.779411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Pushing event updated for resources: {'Port': ['ID=4fc9693c-01da-4b8f-9141-c829bf0b7050,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:39.867216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'name': 'tempest-TestEncryptedCinderVolumes-221317309-router', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.42'}], 'enable_snat': True}, 'gw_port_id': 'adaab294-8a56-4fca-864d-6cc3fa7e6c2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:35Z', 'updated_at': '2022-05-12T16:07:36Z', 'revision_number': 3, 'project_id': '9d2ddec2b766440fab8b257efda46f59', 'gw_port': {'id': 'adaab294-8a56-4fca-864d-6cc3fa7e6c2a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:9c:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4214, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:36Z', 'updated_at': '2022-05-12T16:07:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:39.871156 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95e3773f-1c86-46c2-b7bb-e4266f4e9f62 None None] The sync data for ids ['eb600664-877c-4c5a-bed6-7943ca39c2c2'] in n-d-841483-1 is: [{'id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'name': 'tempest-TestEncryptedCinderVolumes-221317309-router', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.42'}], 'enable_snat': True}, 'gw_port_id': 'adaab294-8a56-4fca-864d-6cc3fa7e6c2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:35Z', 'updated_at': '2022-05-12T16:07:36Z', 'revision_number': 3, 'project_id': '9d2ddec2b766440fab8b257efda46f59', 'gw_port': {'id': 'adaab294-8a56-4fca-864d-6cc3fa7e6c2a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:9c:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4214, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:36Z', 'updated_at': '2022-05-12T16:07:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:07:39.920379 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Network 6df4e173-ea16-4675-98b5-60fef3f72088 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:07:39.921520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:40.138838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Router eb600664-877c-4c5a-bed6-7943ca39c2c2 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:07:40.169945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-11c5a19f-40a3-4b29-acd2-1dc1b98272f3 None None] Provisioning complete for port 4fc9693c-01da-4b8f-9141-c829bf0b7050 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:40.170450 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-11c5a19f-40a3-4b29-acd2-1dc1b98272f3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:40.236840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-11c5a19f-40a3-4b29-acd2-1dc1b98272f3 None None] Port 4fc9693c-01da-4b8f-9141-c829bf0b7050 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:07:40.348386 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:07:40.368447 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-af5c70f0-651a-4611-a5e5-31aa770badd9 admin admin] 10.222.0.82 "PUT /v2.0/routers/eb600664-877c-4c5a-bed6-7943ca39c2c2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5805075 May 12 16:07:40.411429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device adaab294-8a56-4fca-864d-6cc3fa7e6c2a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:40.483411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port adaab294-8a56-4fca-864d-6cc3fa7e6c2a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:40.489567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port adaab294-8a56-4fca-864d-6cc3fa7e6c2a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:40.489937 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:40.615564 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:40.633773 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port adaab294-8a56-4fca-864d-6cc3fa7e6c2a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=adaab294-8a56-4fca-864d-6cc3fa7e6c2a,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:40.639190 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:40.639963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6110429c-054b-4639-ae3e-ac591d83202e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:40.764451 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=adaab294-8a56-4fca-864d-6cc3fa7e6c2a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:40.778057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 6110429c-054b-4639-ae3e-ac591d83202e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:40.778425 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:40.917765 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54204) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:40.924047 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Request body: {'network': {'name': 'tempest-TestEncryptedCinderVolumes-2065161667-network', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:40.929427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:40.933178 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Usage tracker for resource:network and tenant:6e2103950a2548ac87b0ca305617aa1f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:40.936036 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:40.942595 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:40.951926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Made reservation on behalf of 6e2103950a2548ac87b0ca305617aa1f for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:40.954418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:40.966919 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:40.985751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:40.989591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Usage tracker for resource:security_group_rule and tenant:6e2103950a2548ac87b0ca305617aa1f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:40.992355 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:40.998130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:41.081229 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:41.084839 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:41.117628 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 587} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:07:41.126891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=99d81ddf-6913-4ea1-8cfa-9432371b4a4e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:41.134172 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:41.134579 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Added segment 2041a794-00bc-4574-bc84-e314cbeaceff of type vlan for network 40855429-852e-405c-b233-35098a6ccc6c May 12 16:07:41.162523 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:41.191378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:41.192554 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:41.193120 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:41.424070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] Pushing event updated for resources: {'Network': ['ID=40855429-852e-405c-b233-35098a6ccc6c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:41.427179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2e1be3c9-2fe4-467d-b63a-c919c85b094f admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.5082853 May 12 16:07:41.430552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54208) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:41.433935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 40855429-852e-405c-b233-35098a6ccc6c details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:07:41.435141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Request body: {'subnet': {'network_id': '40855429-852e-405c-b233-35098a6ccc6c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestEncryptedCinderVolumes-2065161667-subnet', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:41.441300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:41.445570 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Usage tracker for resource:subnet and tenant:6e2103950a2548ac87b0ca305617aa1f is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:41.448492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:41.454820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:41.467507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Made reservation on behalf of 6e2103950a2548ac87b0ca305617aa1f for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:41.469950 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:41.503884 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Sync routers for ids ['eb600664-877c-4c5a-bed6-7943ca39c2c2'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:07:41.514207 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Routers {'eb600664-877c-4c5a-bed6-7943ca39c2c2'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:07:41.514925 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['eb600664-877c-4c5a-bed6-7943ca39c2c2'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:41.683566 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:41.693786 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Set router eb600664-877c-4c5a-bed6-7943ca39c2c2 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:07:41.767827 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Pushing event updated for resources: {'Subnet': ['ID=17e572b3-53cd-4cc0-8e8d-dc4f9309acb7,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:41.776838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Checking segment: {'id': '2041a794-00bc-4574-bc84-e314cbeaceff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '40855429-852e-405c-b233-35098a6ccc6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:41.777235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Network hostable DHCP agents. Network: 40855429-852e-405c-b233-35098a6ccc6c, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:07:41.799895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Network 40855429-852e-405c-b233-35098a6ccc6c is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:07:41.811018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 40855429-852e-405c-b233-35098a6ccc6c) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:41.815461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:41.816021 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:41.822917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64bb2202-34cc-4680-aa3e-d1d0fb1572fb None None] Network 40855429-852e-405c-b233-35098a6ccc6c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:41.839575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54212) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:41.840131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9266b6f5-c16b-4bc9-a290-3547fdabb11b admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.4089561 May 12 16:07:41.845994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Request body: {'router': {'name': 'tempest-TestEncryptedCinderVolumes-2065161667-router', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:41.851605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:41.855535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Usage tracker for resource:router and tenant:6e2103950a2548ac87b0ca305617aa1f is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:07:41.858330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:07:41.864576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:41.880322 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:41.882057 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:41.900005 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.024105 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'name': 'tempest-TestEncryptedCinderVolumes-221317309-router', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.42'}], 'enable_snat': True}, 'gw_port_id': 'adaab294-8a56-4fca-864d-6cc3fa7e6c2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:35Z', 'updated_at': '2022-05-12T16:07:39Z', 'revision_number': 4, 'project_id': '9d2ddec2b766440fab8b257efda46f59', 'gw_port': {'id': 'adaab294-8a56-4fca-864d-6cc3fa7e6c2a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:9c:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4214, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:36Z', 'updated_at': '2022-05-12T16:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4fc9693c-01da-4b8f-9141-c829bf0b7050', 'name': '', 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'mac_address': 'fa:16:3e:68:4e:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'device_owner': 'network:router_interface', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': '567ea8ae-7967-4eae-8499-8b5e3e2b7ab3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:38Z', 'updated_at': '2022-05-12T16:07:39Z', 'revision_number': 2, 'project_id': '9d2ddec2b766440fab8b257efda46f59', 'subnets': [{'id': '567ea8ae-7967-4eae-8499-8b5e3e2b7ab3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:42.028260 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Checking router: eb600664-877c-4c5a-bed6-7943ca39c2c2 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:07:42.028607 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Updating router eb600664-877c-4c5a-bed6-7943ca39c2c2 port 4fc9693c-01da-4b8f-9141-c829bf0b7050 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:07:42.083789 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.098942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-40855429-852e-405c-b233-35098a6ccc6c', 'network_id': '40855429-852e-405c-b233-35098a6ccc6c', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'fixed_ips': [{'subnet_id': '17e572b3-53cd-4cc0-8e8d-dc4f9309acb7'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:07:42.099766 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.192059 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.259522 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Allocated IP 172.20.0.2 (40855429-852e-405c-b233-35098a6ccc6c/17e572b3-53cd-4cc0-8e8d-dc4f9309acb7/c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:07:42.379118 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device adaab294-8a56-4fca-864d-6cc3fa7e6c2a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:42.471749 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.483794 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Transition to ACTIVE for port object 4fc9693c-01da-4b8f-9141-c829bf0b7050 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:42.490941 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.539740 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port adaab294-8a56-4fca-864d-6cc3fa7e6c2a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:42.540309 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.622465 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.639426 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Transition to ACTIVE for port object c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:42.726932 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.729622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Transition to ACTIVE for port object c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:42.741413 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77af0e90-7322-4e9e-a4d7-9f2131f68bee None None] Pushing event updated for resources: {'Port': ['ID=4fc9693c-01da-4b8f-9141-c829bf0b7050,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:42.742062 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.762461 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.764988 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77af0e90-7322-4e9e-a4d7-9f2131f68bee None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:42.765569 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77af0e90-7322-4e9e-a4d7-9f2131f68bee None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:42.766093 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77af0e90-7322-4e9e-a4d7-9f2131f68bee None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:42.766689 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77af0e90-7322-4e9e-a4d7-9f2131f68bee None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:42.767760 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77af0e90-7322-4e9e-a4d7-9f2131f68bee None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:42.768229 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77af0e90-7322-4e9e-a4d7-9f2131f68bee None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:42.768771 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77af0e90-7322-4e9e-a4d7-9f2131f68bee None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:42.769229 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77af0e90-7322-4e9e-a4d7-9f2131f68bee None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:42.769701 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77af0e90-7322-4e9e-a4d7-9f2131f68bee None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:42.770153 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77af0e90-7322-4e9e-a4d7-9f2131f68bee None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:42.770628 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77af0e90-7322-4e9e-a4d7-9f2131f68bee None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:42.771541 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77af0e90-7322-4e9e-a4d7-9f2131f68bee None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:07:42.780378 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Attempting to bind port 4fc9693c-01da-4b8f-9141-c829bf0b7050 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:07:42.780966 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Attempting to bind port 4fc9693c-01da-4b8f-9141-c829bf0b7050 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:07:42.781744 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Attempting to bind port 4fc9693c-01da-4b8f-9141-c829bf0b7050 on network 6df4e173-ea16-4675-98b5-60fef3f72088 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:07:42.790680 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 7, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:07:42.790984 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Checking segment: {'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:42.791375 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.791769 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Bound using segment: {'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:07:42.792605 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Bound port: 4fc9693c-01da-4b8f-9141-c829bf0b7050, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:07:42.792605 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.844553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Network 40855429-852e-405c-b233-35098a6ccc6c is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:07:42.854439 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:42.861210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:07:42.892098 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] For port 4fc9693c-01da-4b8f-9141-c829bf0b7050, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:07:42.896312 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] For port 4fc9693c-01da-4b8f-9141-c829bf0b7050, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4fc9693c-01da-4b8f-9141-c829bf0b7050,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:07:42.900726 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.911184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Allocated IP 172.25.8.29 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/2c686102-a1f7-47dd-b704-0e0aa7a7c8a0) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:07:42.958625 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-aed132c5-41ec-4746-99dc-9e4186d1eb87 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:42.981420 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Routers {'eb600664-877c-4c5a-bed6-7943ca39c2c2'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:07:42.982539 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['eb600664-877c-4c5a-bed6-7943ca39c2c2'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:42.990340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Attempting to bind port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:07:42.990706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Attempting to bind port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '2041a794-00bc-4574-bc84-e314cbeaceff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '40855429-852e-405c-b233-35098a6ccc6c'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:07:42.991065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Attempting to bind port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f on network 40855429-852e-405c-b233-35098a6ccc6c {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:07:42.993230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Pushing event updated for resources: {'Port': ['ID=c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:42.999338 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 7, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:07:42.999711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Checking segment: {'id': '2041a794-00bc-4574-bc84-e314cbeaceff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '40855429-852e-405c-b233-35098a6ccc6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:43.000173 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:43.000560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Bound using segment: {'id': '2041a794-00bc-4574-bc84-e314cbeaceff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '40855429-852e-405c-b233-35098a6ccc6c'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:07:43.001154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Bound port: c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2041a794-00bc-4574-bc84-e314cbeaceff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '40855429-852e-405c-b233-35098a6ccc6c'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:07:43.002144 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:43.055988 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77af0e90-7322-4e9e-a4d7-9f2131f68bee None None] Pushing event updated for resources: {'Port': ['ID=4fc9693c-01da-4b8f-9141-c829bf0b7050,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:43.086168 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:43.115475 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] For port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:07:43.119936 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] For port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f,segment=NetworkSegment(2041a794-00bc-4574-bc84-e314cbeaceff),segment_id=2041a794-00bc-4574-bc84-e314cbeaceff)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:07:43.124016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:43.125054 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:43.190690 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] Set router eb600664-877c-4c5a-bed6-7943ca39c2c2 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:07:43.203227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:07:43.214950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21d663d2-f48a-4882-9c3c-6fbeef6f0ba7 None None] Pushing event updated for resources: {'Port': ['ID=c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:43.240894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:43.249768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:07:43.454028 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Pushing event updated for resources: {'Port': ['ID=2c686102-a1f7-47dd-b704-0e0aa7a7c8a0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:43.581983 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'name': 'tempest-TestEncryptedCinderVolumes-221317309-router', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.42'}], 'enable_snat': True}, 'gw_port_id': 'adaab294-8a56-4fca-864d-6cc3fa7e6c2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:35Z', 'updated_at': '2022-05-12T16:07:39Z', 'revision_number': 4, 'project_id': '9d2ddec2b766440fab8b257efda46f59', 'gw_port': {'id': 'adaab294-8a56-4fca-864d-6cc3fa7e6c2a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:9c:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4214, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:36Z', 'updated_at': '2022-05-12T16:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4fc9693c-01da-4b8f-9141-c829bf0b7050', 'name': '', 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'mac_address': 'fa:16:3e:68:4e:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'device_owner': 'network:router_interface', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': '567ea8ae-7967-4eae-8499-8b5e3e2b7ab3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:38Z', 'updated_at': '2022-05-12T16:07:42Z', 'revision_number': 4, 'project_id': '9d2ddec2b766440fab8b257efda46f59', 'subnets': [{'id': '567ea8ae-7967-4eae-8499-8b5e3e2b7ab3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:43.587466 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-164c3ebc-df60-4bac-860b-406445ed06d7 None None] The sync data for ids ['eb600664-877c-4c5a-bed6-7943ca39c2c2'] in n-d-841483-1 is: [{'id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'name': 'tempest-TestEncryptedCinderVolumes-221317309-router', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.42'}], 'enable_snat': True}, 'gw_port_id': 'adaab294-8a56-4fca-864d-6cc3fa7e6c2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:35Z', 'updated_at': '2022-05-12T16:07:39Z', 'revision_number': 4, 'project_id': '9d2ddec2b766440fab8b257efda46f59', 'gw_port': {'id': 'adaab294-8a56-4fca-864d-6cc3fa7e6c2a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:9c:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4214, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:36Z', 'updated_at': '2022-05-12T16:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '4fc9693c-01da-4b8f-9141-c829bf0b7050', 'name': '', 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'mac_address': 'fa:16:3e:68:4e:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'device_owner': 'network:router_interface', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': '567ea8ae-7967-4eae-8499-8b5e3e2b7ab3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:38Z', 'updated_at': '2022-05-12T16:07:42Z', 'revision_number': 4, 'project_id': '9d2ddec2b766440fab8b257efda46f59', 'subnets': [{'id': '567ea8ae-7967-4eae-8499-8b5e3e2b7ab3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:07:43.664789 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:43.723673 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:44.218698 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:44.234544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dff3bab6-c8cc-4793-9485-1672083f50c8 None None] Network 40855429-852e-405c-b233-35098a6ccc6c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:07:44.355290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-640ac227-3aca-4fb3-99e1-04f98d262554 None None] Provisioning for port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:44.450477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4fc9693c-01da-4b8f-9141-c829bf0b7050 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:44.476883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Router a1450b0f-8706-42f8-9136-5aadc13bcf98 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 16:07:44.585321 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 4fc9693c-01da-4b8f-9141-c829bf0b7050 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:44.592627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4fc9693c-01da-4b8f-9141-c829bf0b7050 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:44.592995 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:44.690500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:07:44.704807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Sync routers for ids ['a1450b0f-8706-42f8-9136-5aadc13bcf98'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:07:44.727358 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Routers {'a1450b0f-8706-42f8-9136-5aadc13bcf98'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:07:44.727991 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:07:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['a1450b0f-8706-42f8-9136-5aadc13bcf98'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:44.729130 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:44.730805 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f1fd6c1a-3772-453d-9728-a90e2c5c1caa admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 2.8901768 May 12 16:07:44.733716 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54216) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:07:44.819142 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:44.972694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 4fc9693c-01da-4b8f-9141-c829bf0b7050, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4fc9693c-01da-4b8f-9141-c829bf0b7050,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:44.982217 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:44.982976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:45.099862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Set router a1450b0f-8706-42f8-9136-5aadc13bcf98 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:07:45.247416 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=4fc9693c-01da-4b8f-9141-c829bf0b7050,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:45.322867 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:45.331593 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:45.331956 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:45.418196 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d0d95a27-c56d-484f-a83c-ee502476c6ed None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:45.430954 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:45.532359 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:45.551455 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'name': 'tempest-TestEncryptedCinderVolumes-2065161667-router', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.29'}], 'enable_snat': True}, 'gw_port_id': '2c686102-a1f7-47dd-b704-0e0aa7a7c8a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:41Z', 'updated_at': '2022-05-12T16:07:43Z', 'revision_number': 3, 'project_id': '6e2103950a2548ac87b0ca305617aa1f', 'gw_port': {'id': '2c686102-a1f7-47dd-b704-0e0aa7a7c8a0', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:91:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4226, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:42Z', 'updated_at': '2022-05-12T16:07:42Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:45.560745 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Checking router: a1450b0f-8706-42f8-9136-5aadc13bcf98 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:07:45.561081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Updating router a1450b0f-8706-42f8-9136-5aadc13bcf98 port 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:07:45.613904 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f,segment=NetworkSegment(2041a794-00bc-4574-bc84-e314cbeaceff),segment_id=2041a794-00bc-4574-bc84-e314cbeaceff)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:45.621896 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:45.640761 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Allocated IP 172.20.0.1 (40855429-852e-405c-b233-35098a6ccc6c/17e572b3-53cd-4cc0-8e8d-dc4f9309acb7/1294f640-ca2b-413d-b691-2c32cab0c5ca) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:07:45.665911 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:45.784590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:45.788248 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:45.805257 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Transition to ACTIVE for port object 1294f640-ca2b-413d-b691-2c32cab0c5ca will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:45.830248 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.018617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Network 40855429-852e-405c-b233-35098a6ccc6c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:07:46.021647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:46.024216 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:07:46.037109 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.051257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Transition to ACTIVE for port object 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:46.059147 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.070138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Pushing event updated for resources: {'Port': ['ID=1294f640-ca2b-413d-b691-2c32cab0c5ca,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:46.090541 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.159244 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.162442 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d469a623-6326-4ed7-8f76-b9cf5ab8f95b None None] Pushing event updated for resources: {'Port': ['ID=2c686102-a1f7-47dd-b704-0e0aa7a7c8a0,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:46.165350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Attempting to bind port 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:07:46.165737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Attempting to bind port 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:07:46.166119 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Attempting to bind port 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:07:46.172280 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 7, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:07:46.172606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:46.173622 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.174076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:07:46.174559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Bound port: 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:07:46.174931 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.228829 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.257185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] For port 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:07:46.260631 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] For port 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2c686102-a1f7-47dd-b704-0e0aa7a7c8a0,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:07:46.265178 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.354766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4fc9693c-01da-4b8f-9141-c829bf0b7050 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:46.417711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a727916d-a870-47c6-b594-ac2005003061 None None] Provisioning for port 1294f640-ca2b-413d-b691-2c32cab0c5ca completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:46.431487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Routers {'a1450b0f-8706-42f8-9136-5aadc13bcf98'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:07:46.432125 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:07:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['a1450b0f-8706-42f8-9136-5aadc13bcf98'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:46.472895 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.477542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.490981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d469a623-6326-4ed7-8f76-b9cf5ab8f95b None None] Pushing event updated for resources: {'Port': ['ID=2c686102-a1f7-47dd-b704-0e0aa7a7c8a0,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:46.493477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a727916d-a870-47c6-b594-ac2005003061 None None] Provisioning complete for port 1294f640-ca2b-413d-b691-2c32cab0c5ca triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:46.493889 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a727916d-a870-47c6-b594-ac2005003061 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.550242 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.587817 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.591262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Pushing event updated for resources: {'Port': ['ID=1294f640-ca2b-413d-b691-2c32cab0c5ca,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:46.679501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a727916d-a870-47c6-b594-ac2005003061 None None] Port 1294f640-ca2b-413d-b691-2c32cab0c5ca cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:07:46.715491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 4fc9693c-01da-4b8f-9141-c829bf0b7050 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:46.715859 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:46.731358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Network 40855429-852e-405c-b233-35098a6ccc6c is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:07:46.732516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:46.775636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] Set router a1450b0f-8706-42f8-9136-5aadc13bcf98 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:07:46.932715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Router a1450b0f-8706-42f8-9136-5aadc13bcf98 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:07:47.063511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d5ad3289-03ca-4859-9cf5-a4fffccb1796 None None] Provisioning complete for port 1294f640-ca2b-413d-b691-2c32cab0c5ca triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:47.064561 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d5ad3289-03ca-4859-9cf5-a4fffccb1796 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:47.095553 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:47.115729 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:07:47.124629 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fb5f42ba-a0ab-4e87-a86d-1f8571617727 admin admin] 10.222.0.82 "PUT /v2.0/routers/a1450b0f-8706-42f8-9136-5aadc13bcf98/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3892863 May 12 16:07:47.192335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-d5ad3289-03ca-4859-9cf5-a4fffccb1796 None None] Port 1294f640-ca2b-413d-b691-2c32cab0c5ca cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:07:47.256610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:47.256980 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:47.332336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'name': 'tempest-TestEncryptedCinderVolumes-2065161667-router', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.29'}], 'enable_snat': True}, 'gw_port_id': '2c686102-a1f7-47dd-b704-0e0aa7a7c8a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:41Z', 'updated_at': '2022-05-12T16:07:46Z', 'revision_number': 4, 'project_id': '6e2103950a2548ac87b0ca305617aa1f', 'gw_port': {'id': '2c686102-a1f7-47dd-b704-0e0aa7a7c8a0', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:91:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4226, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:42Z', 'updated_at': '2022-05-12T16:07:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1294f640-ca2b-413d-b691-2c32cab0c5ca', 'name': '', 'network_id': '40855429-852e-405c-b233-35098a6ccc6c', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'mac_address': 'fa:16:3e:70:dd:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'device_owner': 'network:router_interface', 'standard_attr_id': 4227, 'fixed_ips': [{'subnet_id': '17e572b3-53cd-4cc0-8e8d-dc4f9309acb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:45Z', 'updated_at': '2022-05-12T16:07:46Z', 'revision_number': 2, 'project_id': '6e2103950a2548ac87b0ca305617aa1f', 'subnets': [{'id': '17e572b3-53cd-4cc0-8e8d-dc4f9309acb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:47.338307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48f1309-a72f-483b-848c-1ec46ffd3ad7 None None] The sync data for ids ['a1450b0f-8706-42f8-9136-5aadc13bcf98'] in n-d-841483-1 is: [{'id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'name': 'tempest-TestEncryptedCinderVolumes-2065161667-router', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.29'}], 'enable_snat': True}, 'gw_port_id': '2c686102-a1f7-47dd-b704-0e0aa7a7c8a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:41Z', 'updated_at': '2022-05-12T16:07:46Z', 'revision_number': 4, 'project_id': '6e2103950a2548ac87b0ca305617aa1f', 'gw_port': {'id': '2c686102-a1f7-47dd-b704-0e0aa7a7c8a0', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:91:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4226, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:42Z', 'updated_at': '2022-05-12T16:07:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1294f640-ca2b-413d-b691-2c32cab0c5ca', 'name': '', 'network_id': '40855429-852e-405c-b233-35098a6ccc6c', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'mac_address': 'fa:16:3e:70:dd:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'device_owner': 'network:router_interface', 'standard_attr_id': 4227, 'fixed_ips': [{'subnet_id': '17e572b3-53cd-4cc0-8e8d-dc4f9309acb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:45Z', 'updated_at': '2022-05-12T16:07:46Z', 'revision_number': 2, 'project_id': '6e2103950a2548ac87b0ca305617aa1f', 'subnets': [{'id': '17e572b3-53cd-4cc0-8e8d-dc4f9309acb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:07:47.862695 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:48.038127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-68760fd6-7bd2-4ee3-87ce-65d541b492fa tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:48.039751 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-68760fd6-7bd2-4ee3-87ce-65d541b492fa tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/networks?id=6df4e173-ea16-4675-98b5-60fef3f72088 HTTP/1.1" status: 200 len: 816 time: 0.1676667 May 12 16:07:48.056615 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-e5bf2edb-4381-4f98-a738-3f0f1db22f7a tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/quotas/9d2ddec2b766440fab8b257efda46f59 HTTP/1.1" status: 200 len: 375 time: 0.0106854 May 12 16:07:48.145608 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-c68454a3-98fa-47b2-af0c-42390ffab9f7 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Synchronizing usage tracker for tenant:9d2ddec2b766440fab8b257efda46f59 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:07:48.163345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-c68454a3-98fa-47b2-af0c-42390ffab9f7 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Unset dirty status for tenant:9d2ddec2b766440fab8b257efda46f59 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:07:48.164642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-c68454a3-98fa-47b2-af0c-42390ffab9f7 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=9d2ddec2b766440fab8b257efda46f59&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1019411 May 12 16:07:48.329750 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-2966f2bb-0bed-4fba-95c5-bba570e78abc service neutron] 10.222.0.82 "GET /v2.0/networks/6df4e173-ea16-4675-98b5-60fef3f72088?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1522961 May 12 16:07:48.364982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:48.450111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:48.456238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:48.456602 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:48.583873 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:48.603134 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2c686102-a1f7-47dd-b704-0e0aa7a7c8a0,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:48.607637 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-372530e6-a474-4272-a103-f095775a658d service neutron] 10.222.0.82 "GET /v2.0/networks/6df4e173-ea16-4675-98b5-60fef3f72088?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2703774 May 12 16:07:48.611308 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:48.682591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=2c686102-a1f7-47dd-b704-0e0aa7a7c8a0,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:48.790112 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-35aadb5e-3525-4108-bde5-52e31a292bb5 req-66bc80e7-ce29-4cd5-842f-c9e1ea2994ff tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 210 time: 0.0446422 May 12 16:07:49.959173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1824fbdd-43e5-470d-a375-aa4112f31c99 req-bb7c6c90-7241-4b3d-8a5a-69f44292dcf5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 210 time: 0.0519264 May 12 16:07:50.023818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-3d721a42-f819-45cb-a099-638fd02537df tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:50.024505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-3d721a42-f819-45cb-a099-638fd02537df tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Synchronizing usage tracker for tenant:9d2ddec2b766440fab8b257efda46f59 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:07:50.042229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-3d721a42-f819-45cb-a099-638fd02537df tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Unset dirty status for tenant:9d2ddec2b766440fab8b257efda46f59 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:07:50.043442 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-3d721a42-f819-45cb-a099-638fd02537df tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.84 "GET /v2.0/networks?id=6df4e173-ea16-4675-98b5-60fef3f72088 HTTP/1.1" status: 200 len: 816 time: 0.1793342 May 12 16:07:50.069636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Request body: {'port': {'device_id': '7ddf046f-8d7c-4410-9d5f-444ae48e30ac', 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088', 'admin_state_up': True, 'tenant_id': '9d2ddec2b766440fab8b257efda46f59'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:50.204934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:07:50.214869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:07:50.226901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Made reservation on behalf of 9d2ddec2b766440fab8b257efda46f59 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:07:50.230507 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:50.336063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:50.394860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Allocated IP 172.20.0.10 (6df4e173-ea16-4675-98b5-60fef3f72088/567ea8ae-7967-4eae-8499-8b5e3e2b7ab3/31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:07:50.405364 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:50.405921 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:50.595414 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:50.610902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Transition to ACTIVE for port object 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:50.633555 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:50.707962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Network 6df4e173-ea16-4675-98b5-60fef3f72088 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:07:50.711198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:07:50.714994 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:07:50.745668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Pushing event updated for resources: {'Port': ['ID=31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:50.783807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:50.784326 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:50.810454 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-1f523d08-055b-4cb6-9fa0-035f723eca4f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7448497 May 12 16:07:50.945495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Request body: {'port': {'device_id': '7ddf046f-8d7c-4410-9d5f-444ae48e30ac', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:07:50.946025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bb531d4b-f2ce-420c-9613-cc971f796967 None None] Provisioning for port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:50.951863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bb531d4b-f2ce-420c-9613-cc971f796967 None None] Provisioning complete for port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:50.952240 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bb531d4b-f2ce-420c-9613-cc971f796967 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:51.009529 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bb531d4b-f2ce-420c-9613-cc971f796967 None None] Port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:07:51.070068 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:51.123617 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Sync routers for ids ['a1450b0f-8706-42f8-9136-5aadc13bcf98'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:07:51.135874 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Routers {'a1450b0f-8706-42f8-9136-5aadc13bcf98'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:07:51.136499 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:07:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['a1450b0f-8706-42f8-9136-5aadc13bcf98'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:51.325804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be6aeeb5-390a-4fdc-bb52-c92181a42b4a req-9e5bbfe8-7a37-4d4e-9ab1-985b125ff64d tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:51.327723 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be6aeeb5-390a-4fdc-bb52-c92181a42b4a req-9e5bbfe8-7a37-4d4e-9ab1-985b125ff64d tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 932 time: 0.0905275 May 12 16:07:51.331377 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Set router a1450b0f-8706-42f8-9136-5aadc13bcf98 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:07:51.377015 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be6aeeb5-390a-4fdc-bb52-c92181a42b4a req-b034c3cc-4d71-4fd8-9fae-ab77641e8bf8 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419593 May 12 16:07:51.570330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:07:51.577349 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:51.592961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Transition to ACTIVE for port object 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:51.597803 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:51.645368 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'name': 'tempest-TestEncryptedCinderVolumes-2065161667-router', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.29'}], 'enable_snat': True}, 'gw_port_id': '2c686102-a1f7-47dd-b704-0e0aa7a7c8a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:41Z', 'updated_at': '2022-05-12T16:07:46Z', 'revision_number': 4, 'project_id': '6e2103950a2548ac87b0ca305617aa1f', 'gw_port': {'id': '2c686102-a1f7-47dd-b704-0e0aa7a7c8a0', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:91:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4226, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:42Z', 'updated_at': '2022-05-12T16:07:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1294f640-ca2b-413d-b691-2c32cab0c5ca', 'name': '', 'network_id': '40855429-852e-405c-b233-35098a6ccc6c', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'mac_address': 'fa:16:3e:70:dd:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'device_owner': 'network:router_interface', 'standard_attr_id': 4227, 'fixed_ips': [{'subnet_id': '17e572b3-53cd-4cc0-8e8d-dc4f9309acb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:45Z', 'updated_at': '2022-05-12T16:07:46Z', 'revision_number': 2, 'project_id': '6e2103950a2548ac87b0ca305617aa1f', 'subnets': [{'id': '17e572b3-53cd-4cc0-8e8d-dc4f9309acb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:51.649115 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Checking router: a1450b0f-8706-42f8-9136-5aadc13bcf98 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:07:51.649493 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Updating router a1450b0f-8706-42f8-9136-5aadc13bcf98 port 1294f640-ca2b-413d-b691-2c32cab0c5ca binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:07:51.702558 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:51.728514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Pushing event updated for resources: {'Port': ['ID=31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:51.843008 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Attempting to bind port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:07:51.843342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Attempting to bind port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:07:51.843671 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Attempting to bind port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea on network 6df4e173-ea16-4675-98b5-60fef3f72088 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:07:51.848491 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea on network 6df4e173-ea16-4675-98b5-60fef3f72088 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:07:51.848810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Attempting to bind port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea on network 6df4e173-ea16-4675-98b5-60fef3f72088 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:07:51.853904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 7, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:07:51.854243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Checking segment: {'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:51.854629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Bound using segment: {'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:07:51.855051 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Bound port: 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:07:51.855397 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:51.950934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] For port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:07:51.954367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] For port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:07:51.958457 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:52.020760 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:52.021465 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:52.023092 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] 10.222.0.84 "PUT /v2.0/ports/31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea HTTP/1.1" status: 200 len: 1092 time: 1.1928704 May 12 16:07:52.023390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7ddf046f-8d7c-4410-9d5f-444ae48e30ac', 'tag': '31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:07:52.058978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5226918e-fff8-4930-bb03-ada23717c04d service neutron] Pushing event updated for resources: {'Port': ['ID=31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:52.087274 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:52.100037 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Transition to ACTIVE for port object 1294f640-ca2b-413d-b691-2c32cab0c5ca will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:07:52.107486 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:52.148343 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-49d6f67e-78c4-440b-91a8-7abfd1773084'] response: {'name': 'network-changed', 'server_uuid': '7ddf046f-8d7c-4410-9d5f-444ae48e30ac', 'tag': '31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea', 'status': 'completed', 'code': 200} May 12 16:07:52.177343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-c1b24f12-a639-48c0-ac2d-54b430b92b51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:52.179465 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-c1b24f12-a639-48c0-ac2d-54b430b92b51 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=9d2ddec2b766440fab8b257efda46f59&device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 1095 time: 0.0897939 May 12 16:07:52.269892 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-7521357a-ea98-4223-9fce-484482b23703 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea HTTP/1.1" status: 200 len: 217 time: 0.0767684 May 12 16:07:52.339365 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Attempting to bind port 1294f640-ca2b-413d-b691-2c32cab0c5ca on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:07:52.339913 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Attempting to bind port 1294f640-ca2b-413d-b691-2c32cab0c5ca by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '2041a794-00bc-4574-bc84-e314cbeaceff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '40855429-852e-405c-b233-35098a6ccc6c'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:07:52.340004 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Attempting to bind port 1294f640-ca2b-413d-b691-2c32cab0c5ca on network 40855429-852e-405c-b233-35098a6ccc6c {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:07:52.348419 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 7, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:07:52.348745 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Checking segment: {'id': '2041a794-00bc-4574-bc84-e314cbeaceff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '40855429-852e-405c-b233-35098a6ccc6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:07:52.349593 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:52.349971 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Bound using segment: {'id': '2041a794-00bc-4574-bc84-e314cbeaceff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '40855429-852e-405c-b233-35098a6ccc6c'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:07:52.350414 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Bound port: 1294f640-ca2b-413d-b691-2c32cab0c5ca, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2041a794-00bc-4574-bc84-e314cbeaceff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 587, 'network_id': '40855429-852e-405c-b233-35098a6ccc6c'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:07:52.350931 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:52.353235 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-3ac54ffd-2225-48db-8603-9b984d988199 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:52.354774 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-3ac54ffd-2225-48db-8603-9b984d988199 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=567ea8ae-7967-4eae-8499-8b5e3e2b7ab3 HTTP/1.1" status: 200 len: 855 time: 0.0751703 May 12 16:07:52.359571 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4f23089-a14b-4ccc-b3bc-1cb9b22fdccd None None] Pushing event updated for resources: {'Port': ['ID=1294f640-ca2b-413d-b691-2c32cab0c5ca,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:52.443827 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] For port 1294f640-ca2b-413d-b691-2c32cab0c5ca, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:07:52.448265 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] For port 1294f640-ca2b-413d-b691-2c32cab0c5ca, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1294f640-ca2b-413d-b691-2c32cab0c5ca,segment=NetworkSegment(2041a794-00bc-4574-bc84-e314cbeaceff),segment_id=2041a794-00bc-4574-bc84-e314cbeaceff)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:07:52.452999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-b516720a-72d4-4bf4-a1ed-cf5fb0483d79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:52.454326 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:52.454788 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-b516720a-72d4-4bf4-a1ed-cf5fb0483d79 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=6df4e173-ea16-4675-98b5-60fef3f72088&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0898747 May 12 16:07:52.527949 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Routers {'a1450b0f-8706-42f8-9136-5aadc13bcf98'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:07:52.528569 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:07:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['a1450b0f-8706-42f8-9136-5aadc13bcf98'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:52.588149 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd7481c-4770-461e-8988-47d72c38e35a req-65250787-e02a-4b51-92eb-97d6c2e3be54 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:52.594254 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0bd7481c-4770-461e-8988-47d72c38e35a req-65250787-e02a-4b51-92eb-97d6c2e3be54 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 944 time: 0.1063583 May 12 16:07:52.617828 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-41a620f3-add5-41d9-995c-891bd356d5b0 service neutron] 10.222.0.84 "GET /v2.0/networks/6df4e173-ea16-4675-98b5-60fef3f72088?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1532845 May 12 16:07:52.658069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0bd7481c-4770-461e-8988-47d72c38e35a req-5a3e527c-8cba-4ea8-910b-bcfe9f05aa25 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0562079 May 12 16:07:52.712811 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4f23089-a14b-4ccc-b3bc-1cb9b22fdccd None None] Pushing event updated for resources: {'Port': ['ID=1294f640-ca2b-413d-b691-2c32cab0c5ca,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:52.725896 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] Set router a1450b0f-8706-42f8-9136-5aadc13bcf98 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:07:52.769202 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58dbf056-a154-41bb-813f-f8bacbb2a9b6 req-32c8043a-df60-48b6-b23d-c8b1b978ad3f service neutron] 10.222.0.84 "GET /v2.0/networks/6df4e173-ea16-4675-98b5-60fef3f72088?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1410959 May 12 16:07:52.943055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-572a60de-c2ce-45f2-a0ef-437ee46c7658 req-d123a9ca-7a73-491e-ad59-bbeada15179c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:52.944412 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-572a60de-c2ce-45f2-a0ef-437ee46c7658 req-d123a9ca-7a73-491e-ad59-bbeada15179c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=9d2ddec2b766440fab8b257efda46f59&device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 1095 time: 0.0720923 May 12 16:07:53.043330 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'name': 'tempest-TestEncryptedCinderVolumes-2065161667-router', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.29'}], 'enable_snat': True}, 'gw_port_id': '2c686102-a1f7-47dd-b704-0e0aa7a7c8a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:41Z', 'updated_at': '2022-05-12T16:07:46Z', 'revision_number': 4, 'project_id': '6e2103950a2548ac87b0ca305617aa1f', 'gw_port': {'id': '2c686102-a1f7-47dd-b704-0e0aa7a7c8a0', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:91:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4226, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:42Z', 'updated_at': '2022-05-12T16:07:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1294f640-ca2b-413d-b691-2c32cab0c5ca', 'name': '', 'network_id': '40855429-852e-405c-b233-35098a6ccc6c', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'mac_address': 'fa:16:3e:70:dd:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'device_owner': 'network:router_interface', 'standard_attr_id': 4227, 'fixed_ips': [{'subnet_id': '17e572b3-53cd-4cc0-8e8d-dc4f9309acb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:45Z', 'updated_at': '2022-05-12T16:07:52Z', 'revision_number': 4, 'project_id': '6e2103950a2548ac87b0ca305617aa1f', 'subnets': [{'id': '17e572b3-53cd-4cc0-8e8d-dc4f9309acb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:07:53.047615 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dda3e6f9-0eac-46e1-89bf-2f00d1144df4 None None] The sync data for ids ['a1450b0f-8706-42f8-9136-5aadc13bcf98'] in n-d-841483-1 is: [{'id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'name': 'tempest-TestEncryptedCinderVolumes-2065161667-router', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.29'}], 'enable_snat': True}, 'gw_port_id': '2c686102-a1f7-47dd-b704-0e0aa7a7c8a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:41Z', 'updated_at': '2022-05-12T16:07:46Z', 'revision_number': 4, 'project_id': '6e2103950a2548ac87b0ca305617aa1f', 'gw_port': {'id': '2c686102-a1f7-47dd-b704-0e0aa7a7c8a0', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:91:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4226, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:42Z', 'updated_at': '2022-05-12T16:07:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1294f640-ca2b-413d-b691-2c32cab0c5ca', 'name': '', 'network_id': '40855429-852e-405c-b233-35098a6ccc6c', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'mac_address': 'fa:16:3e:70:dd:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'device_owner': 'network:router_interface', 'standard_attr_id': 4227, 'fixed_ips': [{'subnet_id': '17e572b3-53cd-4cc0-8e8d-dc4f9309acb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:45Z', 'updated_at': '2022-05-12T16:07:52Z', 'revision_number': 4, 'project_id': '6e2103950a2548ac87b0ca305617aa1f', 'subnets': [{'id': '17e572b3-53cd-4cc0-8e8d-dc4f9309acb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:07:53.100432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-572a60de-c2ce-45f2-a0ef-437ee46c7658 req-7c72fa70-3ddd-4005-b097-8305dc5bfda1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:53.101915 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-572a60de-c2ce-45f2-a0ef-437ee46c7658 req-7c72fa70-3ddd-4005-b097-8305dc5bfda1 service neutron] 10.222.0.84 "GET /v2.0/networks?id=6df4e173-ea16-4675-98b5-60fef3f72088 HTTP/1.1" status: 200 len: 917 time: 0.1406538 May 12 16:07:53.173688 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-572a60de-c2ce-45f2-a0ef-437ee46c7658 req-8ac5023b-b96d-4e69-9108-d26662168b73 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea HTTP/1.1" status: 200 len: 217 time: 0.0640745 May 12 16:07:53.235486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-572a60de-c2ce-45f2-a0ef-437ee46c7658 req-db9f4258-952f-4043-8c3f-9ebdaa133095 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:53.236907 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-572a60de-c2ce-45f2-a0ef-437ee46c7658 req-db9f4258-952f-4043-8c3f-9ebdaa133095 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=567ea8ae-7967-4eae-8499-8b5e3e2b7ab3 HTTP/1.1" status: 200 len: 855 time: 0.0574570 May 12 16:07:53.327193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-572a60de-c2ce-45f2-a0ef-437ee46c7658 req-6baa8167-0193-4870-b8ad-2a7e9f0657a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:53.328656 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-572a60de-c2ce-45f2-a0ef-437ee46c7658 req-6baa8167-0193-4870-b8ad-2a7e9f0657a3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=6df4e173-ea16-4675-98b5-60fef3f72088&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0853670 May 12 16:07:53.569341 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-572a60de-c2ce-45f2-a0ef-437ee46c7658 req-fad8b815-7566-45b5-8367-bb73f3ae4962 service neutron] 10.222.0.84 "GET /v2.0/networks/6df4e173-ea16-4675-98b5-60fef3f72088?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2339897 May 12 16:07:53.702243 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-572a60de-c2ce-45f2-a0ef-437ee46c7658 req-8f21bd9f-06fc-42ef-ad3d-2e963ac90e8f service neutron] 10.222.0.84 "GET /v2.0/networks/6df4e173-ea16-4675-98b5-60fef3f72088?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1269588 May 12 16:07:53.847173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c759792f-f36b-47f0-b6b6-5f1eae2bdd89 req-2492bbd9-c0ea-42b8-b4e6-d5973faada0a tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:53.848548 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c759792f-f36b-47f0-b6b6-5f1eae2bdd89 req-2492bbd9-c0ea-42b8-b4e6-d5973faada0a tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 944 time: 0.0808575 May 12 16:07:53.894331 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c759792f-f36b-47f0-b6b6-5f1eae2bdd89 req-54207eae-3331-4035-ba75-9c293f44b758 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401464 May 12 16:07:54.348331 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1294f640-ca2b-413d-b691-2c32cab0c5ca up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:54.418095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 1294f640-ca2b-413d-b691-2c32cab0c5ca completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:54.424199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 1294f640-ca2b-413d-b691-2c32cab0c5ca triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:54.424454 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:54.547804 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:54.582469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 1294f640-ca2b-413d-b691-2c32cab0c5ca, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1294f640-ca2b-413d-b691-2c32cab0c5ca,segment=NetworkSegment(2041a794-00bc-4574-bc84-e314cbeaceff),segment_id=2041a794-00bc-4574-bc84-e314cbeaceff)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:54.586454 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:54.656787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=1294f640-ca2b-413d-b691-2c32cab0c5ca,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:55.085897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3582baf-c0de-4dee-9d26-62d7038d2242 req-2c7500c7-c843-49eb-a310-cdc6288231b6 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:55.087326 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3582baf-c0de-4dee-9d26-62d7038d2242 req-2c7500c7-c843-49eb-a310-cdc6288231b6 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 944 time: 0.0823526 May 12 16:07:55.130230 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3582baf-c0de-4dee-9d26-62d7038d2242 req-c41e5058-9c10-42c8-9dbd-67f52ca10626 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373387 May 12 16:07:55.624123 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:07:55.797056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:55.812518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea', 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088', 'port_id': '31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea', 'mac_address': 'fa:16:3e:b7:d9:3e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 550, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '567ea8ae-7967-4eae-8499-8b5e3e2b7ab3', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:07:55.872154 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:55.889017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:07:55.904517 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:55.909463 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:55.979440 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:56.257092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:07:56.320159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c7e4c9-7047-446c-ab4d-5d134a4690a3 req-1bf674c3-f9a5-434b-8fde-5a16a87191a2 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:56.321637 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48c7e4c9-7047-446c-ab4d-5d134a4690a3 req-1bf674c3-f9a5-434b-8fde-5a16a87191a2 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 945 time: 0.0896211 May 12 16:07:56.343868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1294f640-ca2b-413d-b691-2c32cab0c5ca up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:56.369929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48c7e4c9-7047-446c-ab4d-5d134a4690a3 req-821735ee-8539-4ce3-85ad-c364414f85cf tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423250 May 12 16:07:56.470207 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 1294f640-ca2b-413d-b691-2c32cab0c5ca triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:56.470483 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:57.555035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b299dc-a30d-40e4-bafb-e7956781445b req-6cf0ccf0-79d1-4488-9fe2-3db3159378ec tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:57.556360 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12b299dc-a30d-40e4-bafb-e7956781445b req-6cf0ccf0-79d1-4488-9fe2-3db3159378ec tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 945 time: 0.0813417 May 12 16:07:57.600100 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12b299dc-a30d-40e4-bafb-e7956781445b req-1d2e6184-ffac-4483-931e-a01d1baec73d tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380788 May 12 16:07:57.625310 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:07:57.698776 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:07:57.703604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:07:57.704540 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:57.817860 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:57.846511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ddf046f-8d7c-4410-9d5f-444ae48e30ac', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:07:57.855827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:07:57.862186 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:07:57.929629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:07:57.945887 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2eadf473-1f46-421d-ab18-cbb197696fb5'] response: {'server_uuid': '7ddf046f-8d7c-4410-9d5f-444ae48e30ac', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea', 'code': 200} May 12 16:07:58.120855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d7e17ed-b67f-41c0-9102-5535251fc62a req-25271bb8-e918-46d5-8698-6e5e86bceacc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:58.122232 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1d7e17ed-b67f-41c0-9102-5535251fc62a req-25271bb8-e918-46d5-8698-6e5e86bceacc service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 1097 time: 0.0681064 May 12 16:07:58.164871 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1d7e17ed-b67f-41c0-9102-5535251fc62a req-f88f535a-1ccc-43b8-8e07-f141926c0e15 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321293 May 12 16:07:58.784314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4036a460-b510-4e60-9c90-dfbbbed6d85d req-a4d14dfd-1798-4ce0-abd5-e7bc3836d05b tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:07:58.785794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4036a460-b510-4e60-9c90-dfbbbed6d85d req-a4d14dfd-1798-4ce0-abd5-e7bc3836d05b tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 946 time: 0.0805590 May 12 16:07:58.830402 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4036a460-b510-4e60-9c90-dfbbbed6d85d req-734d1e47-9a46-4890-9e23-261e651af0b3 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389378 May 12 16:08:00.023136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b0cffb-40c1-4659-afc7-4e09888160d4 req-8efef8b0-dc9e-4785-b114-3394e3a53919 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:00.024663 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22b0cffb-40c1-4659-afc7-4e09888160d4 req-8efef8b0-dc9e-4785-b114-3394e3a53919 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 946 time: 0.0844276 May 12 16:08:00.068715 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22b0cffb-40c1-4659-afc7-4e09888160d4 req-0f5db55a-f653-4b52-9deb-964b8c58670a tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383747 May 12 16:08:00.253528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1801f091-1652-4c95-926a-f8210786398b req-d21130e1-ab6c-4d31-a775-9442daeb7890 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:00.254995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1801f091-1652-4c95-926a-f8210786398b req-d21130e1-ab6c-4d31-a775-9442daeb7890 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 946 time: 0.0808384 May 12 16:08:00.307262 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1801f091-1652-4c95-926a-f8210786398b req-e7fe183b-1031-440a-a621-3e3c786b8de3 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462363 May 12 16:08:02.838109 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:05.967685 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:08:12.840741 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a95175df-41dd-4850-9801-de8b0f38a202 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:13.662148 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:15.382830 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-53142c6d-9400-40a0-84d4-24c51762ab66 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:15.869860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c30458b-02ab-46d9-9fce-d18ac7f1373e req-9500ef38-3c04-4f23-bf77-afa44c4ed9eb tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:15.871202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c30458b-02ab-46d9-9fce-d18ac7f1373e req-9500ef38-3c04-4f23-bf77-afa44c4ed9eb tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 946 time: 0.0801890 May 12 16:08:15.914625 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0c30458b-02ab-46d9-9fce-d18ac7f1373e req-d48f438c-f359-4740-b3ba-e501ea7f297e tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377791 May 12 16:08:16.103850 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:16.378840 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:17.104548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec0a97e-8353-4f4b-9fd5-1a9c1991141b req-599784a7-602a-4499-8840-8053e2ce3063 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:17.106028 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4ec0a97e-8353-4f4b-9fd5-1a9c1991141b req-599784a7-602a-4499-8840-8053e2ce3063 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 946 time: 0.0834634 May 12 16:08:17.150894 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4ec0a97e-8353-4f4b-9fd5-1a9c1991141b req-55d81240-dbc9-47bd-b8a4-6a9c485c8692 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384407 May 12 16:08:17.624679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9064cabe-39fb-40b1-a220-033f6eebfd9a req-dc097257-7075-44f8-a8b2-230c7c1f645a tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:17.625285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9064cabe-39fb-40b1-a220-033f6eebfd9a req-dc097257-7075-44f8-a8b2-230c7c1f645a tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Synchronizing usage tracker for tenant:9d2ddec2b766440fab8b257efda46f59 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:08:17.640176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9064cabe-39fb-40b1-a220-033f6eebfd9a req-dc097257-7075-44f8-a8b2-230c7c1f645a tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Unset dirty status for tenant:9d2ddec2b766440fab8b257efda46f59 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:08:17.641901 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9064cabe-39fb-40b1-a220-033f6eebfd9a req-dc097257-7075-44f8-a8b2-230c7c1f645a tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.84 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 946 time: 0.0976899 May 12 16:08:17.714278 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-9064cabe-39fb-40b1-a220-033f6eebfd9a req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Deleting port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:08:17.714617 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9064cabe-39fb-40b1-a220-033f6eebfd9a req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:17.857678 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:17.961001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9064cabe-39fb-40b1-a220-033f6eebfd9a req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] For port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:08:17.961273 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9064cabe-39fb-40b1-a220-033f6eebfd9a req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:18.083622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-9064cabe-39fb-40b1-a220-033f6eebfd9a req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Calling delete_port for 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:08:18.228648 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9064cabe-39fb-40b1-a220-033f6eebfd9a req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:18.273693 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:08:18.285354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Pushing event deleted for resources: {'Port': ['ID=31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:08:18.298168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:18.298635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:18.299069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:18.299484 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:18.299900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:18.300314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:18.301928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:18.301928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:18.301928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:18.301928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:18.302314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:18.302657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:18.309730 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bce2220-ea07-4ce3-8758-1ab9f6f78072 req-c54e47b3-df5f-4516-9d78-f187fffff218 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ddf046f-8d7c-4410-9d5f-444ae48e30ac HTTP/1.1" status: 200 len: 210 time: 0.0497928 May 12 16:08:18.391779 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-9064cabe-39fb-40b1-a220-033f6eebfd9a req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] No DVR routers for this DVR port 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:08:18.394431 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9064cabe-39fb-40b1-a220-033f6eebfd9a req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:18.398985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ddf046f-8d7c-4410-9d5f-444ae48e30ac', 'name': 'network-vif-deleted', 'tag': '31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:08:18.414665 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9064cabe-39fb-40b1-a220-033f6eebfd9a req-abd0ce44-62e6-4e36-9a41-ff02f5c502a5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.84 "DELETE /v2.0/ports/31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea HTTP/1.1" status: 204 len: 173 time: 0.7652023 May 12 16:08:18.446217 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8bf2728a-37d8-4999-848c-83f29bda0057'] response: {'server_uuid': '7ddf046f-8d7c-4410-9d5f-444ae48e30ac', 'name': 'network-vif-deleted', 'tag': '31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea', 'status': 'completed', 'code': 200} May 12 16:08:19.784638 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-e66e3a56-582a-4877-8035-97f0379d045a tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:19.786109 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-e66e3a56-582a-4877-8035-97f0379d045a tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/networks?id=6df4e173-ea16-4675-98b5-60fef3f72088 HTTP/1.1" status: 200 len: 816 time: 0.1503932 May 12 16:08:19.801155 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-f5637d9f-d2f8-4d16-a89a-0c8705ec7a21 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/quotas/9d2ddec2b766440fab8b257efda46f59 HTTP/1.1" status: 200 len: 375 time: 0.0094779 May 12 16:08:19.885868 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-dded814e-1785-4bee-9b2c-5da70e0f23a1 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=9d2ddec2b766440fab8b257efda46f59&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0797617 May 12 16:08:20.023880 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-08deeeff-6266-442c-9e3a-6d5c9342f7bf service neutron] 10.222.0.82 "GET /v2.0/networks/6df4e173-ea16-4675-98b5-60fef3f72088?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1263056 May 12 16:08:20.156733 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-d2830fcb-c152-4040-9b21-a56802907a7d service neutron] 10.222.0.82 "GET /v2.0/networks/6df4e173-ea16-4675-98b5-60fef3f72088?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1269686 May 12 16:08:20.336550 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-51b27d20-7d62-4f29-8eff-a2e7cc6807eb req-b5c394a3-f896-4a54-9c58-aa828a973945 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 210 time: 0.0427814 May 12 16:08:21.502809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-17e5d978-0b65-43b7-9138-cdbb5fc1fbcf req-a154051f-229d-40b6-af08-1c4ed4224085 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 210 time: 0.0425818 May 12 16:08:21.713361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-2ce695e3-6ec1-4d38-aa6d-bc591904613d tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:21.714730 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-2ce695e3-6ec1-4d38-aa6d-bc591904613d tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.84 "GET /v2.0/networks?id=6df4e173-ea16-4675-98b5-60fef3f72088 HTTP/1.1" status: 200 len: 816 time: 0.1537132 May 12 16:08:21.741483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Request body: {'port': {'device_id': 'f2057a43-8b9c-400f-b0db-1e770d93dd3c', 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088', 'admin_state_up': True, 'tenant_id': '9d2ddec2b766440fab8b257efda46f59'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:08:21.775919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:08:21.812946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:08:21.813286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 31e85f01-1d9d-4bd0-876e-c6c4a3aa4cea not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:08:21.881618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:08:21.885601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Usage tracker for resource:port and tenant:9d2ddec2b766440fab8b257efda46f59 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:08:21.888322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:08:21.894703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:08:21.904184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Made reservation on behalf of 9d2ddec2b766440fab8b257efda46f59 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:08:21.908113 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:22.068566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Allocated IP 172.20.0.14 (6df4e173-ea16-4675-98b5-60fef3f72088/567ea8ae-7967-4eae-8499-8b5e3e2b7ab3/416501b9-0243-4d6c-845f-c5e240e49990) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:08:22.266644 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:22.282312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Transition to ACTIVE for port object 416501b9-0243-4d6c-845f-c5e240e49990 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:08:22.305347 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:22.378722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Network 6df4e173-ea16-4675-98b5-60fef3f72088 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:08:22.381781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:08:22.385563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:08:22.415542 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Pushing event updated for resources: {'Port': ['ID=416501b9-0243-4d6c-845f-c5e240e49990,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:08:22.452288 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:22.452883 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:22.478187 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b3c52d73-4678-4ed0-b526-92a7cad49e05 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7404630 May 12 16:08:22.502767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Request body: {'port': {'device_id': 'f2057a43-8b9c-400f-b0db-1e770d93dd3c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:08:22.592394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b1d6c460-ea4e-4404-b6de-e6b76ff87e2b None None] Provisioning for port 416501b9-0243-4d6c-845f-c5e240e49990 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:08:22.598165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b1d6c460-ea4e-4404-b6de-e6b76ff87e2b None None] Provisioning complete for port 416501b9-0243-4d6c-845f-c5e240e49990 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:08:22.598789 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b1d6c460-ea4e-4404-b6de-e6b76ff87e2b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:22.618974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:22.654001 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-b1d6c460-ea4e-4404-b6de-e6b76ff87e2b None None] Port 416501b9-0243-4d6c-845f-c5e240e49990 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:08:22.706555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29ee4b6c-c416-4081-8ebb-8e18d4f8c7e0 req-dd4e05b5-cf46-479f-815c-423e8b1c5d96 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:22.708009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29ee4b6c-c416-4081-8ebb-8e18d4f8c7e0 req-dd4e05b5-cf46-479f-815c-423e8b1c5d96 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 932 time: 0.0881019 May 12 16:08:22.753398 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-29ee4b6c-c416-4081-8ebb-8e18d4f8c7e0 req-fa93da48-3775-4089-9f03-9c6ead94ff3f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396864 May 12 16:08:23.085570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 416501b9-0243-4d6c-845f-c5e240e49990 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:08:23.092701 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:23.106995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Transition to ACTIVE for port object 416501b9-0243-4d6c-845f-c5e240e49990 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:08:23.111013 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:23.270693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Pushing event updated for resources: {'Port': ['ID=416501b9-0243-4d6c-845f-c5e240e49990,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:08:23.351291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Attempting to bind port 416501b9-0243-4d6c-845f-c5e240e49990 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:08:23.351619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Attempting to bind port 416501b9-0243-4d6c-845f-c5e240e49990 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:08:23.351942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Attempting to bind port 416501b9-0243-4d6c-845f-c5e240e49990 on network 6df4e173-ea16-4675-98b5-60fef3f72088 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:08:23.356473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Port 416501b9-0243-4d6c-845f-c5e240e49990 on network 6df4e173-ea16-4675-98b5-60fef3f72088 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:08:23.356788 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Attempting to bind port 416501b9-0243-4d6c-845f-c5e240e49990 on network 6df4e173-ea16-4675-98b5-60fef3f72088 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:08:23.361917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 8, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:08:23.362250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Checking segment: {'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:08:23.362628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Bound using segment: {'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:08:23.363045 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Bound port: 416501b9-0243-4d6c-845f-c5e240e49990, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '543d1def-817b-422e-8be2-83e1c89dcdac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 550, 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:08:23.364244 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:23.454926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] For port 416501b9-0243-4d6c-845f-c5e240e49990, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:08:23.458271 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] For port 416501b9-0243-4d6c-845f-c5e240e49990, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=416501b9-0243-4d6c-845f-c5e240e49990,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:08:23.461811 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:23.524770 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:23.525370 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:23.526732 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] 10.222.0.84 "PUT /v2.0/ports/416501b9-0243-4d6c-845f-c5e240e49990 HTTP/1.1" status: 200 len: 1092 time: 1.0290301 May 12 16:08:23.527182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f2057a43-8b9c-400f-b0db-1e770d93dd3c', 'tag': '416501b9-0243-4d6c-845f-c5e240e49990'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:08:23.546893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0893845a-5f2f-48f7-8286-0dffc33a0981 service neutron] Pushing event updated for resources: {'Port': ['ID=416501b9-0243-4d6c-845f-c5e240e49990,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:08:23.579699 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-399e0f14-a1bc-414f-ba55-5694078b3c01'] response: {'name': 'network-changed', 'server_uuid': 'f2057a43-8b9c-400f-b0db-1e770d93dd3c', 'tag': '416501b9-0243-4d6c-845f-c5e240e49990', 'status': 'completed', 'code': 200} May 12 16:08:23.669705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0b530bce-524e-48d3-8fb8-d5cc2ced1faa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:23.671202 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-0b530bce-524e-48d3-8fb8-d5cc2ced1faa service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=9d2ddec2b766440fab8b257efda46f59&device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 1095 time: 0.0748656 May 12 16:08:23.757727 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-b5230db0-922c-47df-bc99-1db2590d822d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=416501b9-0243-4d6c-845f-c5e240e49990 HTTP/1.1" status: 200 len: 217 time: 0.0670395 May 12 16:08:23.830448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-5ef76ae7-7466-48f5-bd0c-3fea92081670 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:23.831891 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-5ef76ae7-7466-48f5-bd0c-3fea92081670 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=567ea8ae-7967-4eae-8499-8b5e3e2b7ab3 HTTP/1.1" status: 200 len: 855 time: 0.0650766 May 12 16:08:23.911669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-21ba5bea-e897-4307-9f69-e7f034dcd060 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:23.913179 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-21ba5bea-e897-4307-9f69-e7f034dcd060 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=6df4e173-ea16-4675-98b5-60fef3f72088&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0716851 May 12 16:08:23.939385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bda09a91-4c34-453c-b581-2bdbf376f4dd req-0ed4be66-2461-4a0c-aa1a-024a57d99a47 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:23.940822 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bda09a91-4c34-453c-b581-2bdbf376f4dd req-0ed4be66-2461-4a0c-aa1a-024a57d99a47 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 944 time: 0.0785561 May 12 16:08:23.984388 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bda09a91-4c34-453c-b581-2bdbf376f4dd req-09e1e8aa-ed45-4c49-982a-6e648128d6d3 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372548 May 12 16:08:24.052582 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-8f9fb074-898a-4dbd-97da-290ad6518807 service neutron] 10.222.0.84 "GET /v2.0/networks/6df4e173-ea16-4675-98b5-60fef3f72088?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1293705 May 12 16:08:24.190836 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c44c1e-461f-4ba8-805f-50e0470efb44 req-cedeec1b-316f-4994-a1ea-4d7267933f83 service neutron] 10.222.0.84 "GET /v2.0/networks/6df4e173-ea16-4675-98b5-60fef3f72088?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1288605 May 12 16:08:24.374047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9e2f288-a09c-4d23-b355-a74fb739a12d req-9567d36b-3fb6-47e5-a7b4-00e0e69c5666 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:24.375522 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d9e2f288-a09c-4d23-b355-a74fb739a12d req-9567d36b-3fb6-47e5-a7b4-00e0e69c5666 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=9d2ddec2b766440fab8b257efda46f59&device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 1095 time: 0.0743496 May 12 16:08:24.506829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9e2f288-a09c-4d23-b355-a74fb739a12d req-4f3fb347-e734-4b6b-81b8-132e47945555 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:24.508286 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d9e2f288-a09c-4d23-b355-a74fb739a12d req-4f3fb347-e734-4b6b-81b8-132e47945555 service neutron] 10.222.0.84 "GET /v2.0/networks?id=6df4e173-ea16-4675-98b5-60fef3f72088 HTTP/1.1" status: 200 len: 917 time: 0.1268859 May 12 16:08:24.581598 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d9e2f288-a09c-4d23-b355-a74fb739a12d req-8499b5e4-683e-40d4-8cb5-170faf25d3fb service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=416501b9-0243-4d6c-845f-c5e240e49990 HTTP/1.1" status: 200 len: 217 time: 0.0654991 May 12 16:08:24.645184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9e2f288-a09c-4d23-b355-a74fb739a12d req-50f75c92-f16c-47c2-aab2-aecdd434c7a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:24.646616 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d9e2f288-a09c-4d23-b355-a74fb739a12d req-50f75c92-f16c-47c2-aab2-aecdd434c7a3 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=567ea8ae-7967-4eae-8499-8b5e3e2b7ab3 HTTP/1.1" status: 200 len: 855 time: 0.0573297 May 12 16:08:24.721805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9e2f288-a09c-4d23-b355-a74fb739a12d req-677d36a3-99ce-4d47-b1d5-bd4834846ec3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:24.723217 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d9e2f288-a09c-4d23-b355-a74fb739a12d req-677d36a3-99ce-4d47-b1d5-bd4834846ec3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=6df4e173-ea16-4675-98b5-60fef3f72088&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0688965 May 12 16:08:24.962867 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d9e2f288-a09c-4d23-b355-a74fb739a12d req-75341e12-6057-485c-82f6-ac62abd45aa5 service neutron] 10.222.0.84 "GET /v2.0/networks/6df4e173-ea16-4675-98b5-60fef3f72088?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2320681 May 12 16:08:25.102745 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d9e2f288-a09c-4d23-b355-a74fb739a12d req-4c56b063-80ee-424c-995c-36728d8b03cc service neutron] 10.222.0.84 "GET /v2.0/networks/6df4e173-ea16-4675-98b5-60fef3f72088?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1256835 May 12 16:08:25.268709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bdfc008-5e71-405d-b3c7-f0f6cb3b90ed req-d410f756-901c-4701-8770-43be80d6a0cd tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:25.270202 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1bdfc008-5e71-405d-b3c7-f0f6cb3b90ed req-d410f756-901c-4701-8770-43be80d6a0cd tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 944 time: 0.1761658 May 12 16:08:25.318788 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1bdfc008-5e71-405d-b3c7-f0f6cb3b90ed req-c15acd70-6128-41ec-a3ef-7e3134be133c tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420938 May 12 16:08:26.512734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1560f6c-8005-4297-a56e-51ce578375f1 req-3eb6b724-c3b8-48de-8fca-323d6af72d5c tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:26.514184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1560f6c-8005-4297-a56e-51ce578375f1 req-3eb6b724-c3b8-48de-8fca-323d6af72d5c tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 944 time: 0.0816944 May 12 16:08:26.559762 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b1560f6c-8005-4297-a56e-51ce578375f1 req-0c0255e7-e809-4726-a755-7325c036ebf5 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392625 May 12 16:08:27.744056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead5584b-8e42-432f-a7e9-aa48d0a7612e req-5bf9e541-42da-4c49-a653-5deacd176aa8 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:27.745519 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ead5584b-8e42-432f-a7e9-aa48d0a7612e req-5bf9e541-42da-4c49-a653-5deacd176aa8 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 944 time: 0.0799882 May 12 16:08:27.789629 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ead5584b-8e42-432f-a7e9-aa48d0a7612e req-b9163c25-b2bb-4bec-a2b9-a4a05bdb73e3 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380833 May 12 16:08:27.828182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 416501b9-0243-4d6c-845f-c5e240e49990 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:08:27.958713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 416501b9-0243-4d6c-845f-c5e240e49990, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=416501b9-0243-4d6c-845f-c5e240e49990,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:08:27.972067 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '416501b9-0243-4d6c-845f-c5e240e49990', 'network_id': '6df4e173-ea16-4675-98b5-60fef3f72088', 'port_id': '416501b9-0243-4d6c-845f-c5e240e49990', 'mac_address': 'fa:16:3e:1b:39:91', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 550, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '567ea8ae-7967-4eae-8499-8b5e3e2b7ab3', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:08:28.029132 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:28.045867 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 416501b9-0243-4d6c-845f-c5e240e49990 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:08:28.061063 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 416501b9-0243-4d6c-845f-c5e240e49990, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=416501b9-0243-4d6c-845f-c5e240e49990,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:08:28.065336 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:28.130081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=416501b9-0243-4d6c-845f-c5e240e49990,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:08:28.137311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:28.137675 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:28.138006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:28.138337 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:28.138657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:28.138979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:28.139296 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:28.139611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:28.139924 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:28.140237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:28.140550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:28.140985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:28.384429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['416501b9-0243-4d6c-845f-c5e240e49990'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:08:28.423090 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2ce3910-cdcb-4841-bc6e-11fc4ce9948b req-22aa8960-52ef-47d6-8bc6-3da4f7a08fec service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0461054 May 12 16:08:28.535464 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2ce3910-cdcb-4841-bc6e-11fc4ce9948b req-9f4a10a0-be96-4f5b-aec1-76da6abfce12 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0409307 May 12 16:08:28.577849 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2ce3910-cdcb-4841-bc6e-11fc4ce9948b req-dfdcc4ea-ac20-4a1e-8f5c-4f315cff3b72 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0251927 May 12 16:08:28.713021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2ce3910-cdcb-4841-bc6e-11fc4ce9948b req-3be06bd8-94cc-471c-b4fa-5352b8117caa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:28.714480 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2ce3910-cdcb-4841-bc6e-11fc4ce9948b req-3be06bd8-94cc-471c-b4fa-5352b8117caa service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1314008 May 12 16:08:28.981125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b830a86-1d7e-4208-bbf7-9b8cb63acec3 req-be669ae2-8033-48de-bb01-26da1e663c7f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:28.982560 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b830a86-1d7e-4208-bbf7-9b8cb63acec3 req-be669ae2-8033-48de-bb01-26da1e663c7f tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 945 time: 0.0832651 May 12 16:08:29.025708 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1b830a86-1d7e-4208-bbf7-9b8cb63acec3 req-be87c027-35b2-475f-ad5c-8c3f6d822ab3 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0365748 May 12 16:08:29.840443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 416501b9-0243-4d6c-845f-c5e240e49990 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:08:29.910540 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 416501b9-0243-4d6c-845f-c5e240e49990 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:08:29.915673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 416501b9-0243-4d6c-845f-c5e240e49990 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:08:29.916040 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:30.034814 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:30.064064 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f2057a43-8b9c-400f-b0db-1e770d93dd3c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '416501b9-0243-4d6c-845f-c5e240e49990'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:08:30.073982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 416501b9-0243-4d6c-845f-c5e240e49990, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=416501b9-0243-4d6c-845f-c5e240e49990,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:08:30.079193 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:30.113224 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9f7de92b-4f63-4959-9471-df5c6e1d7650'] response: {'server_uuid': 'f2057a43-8b9c-400f-b0db-1e770d93dd3c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '416501b9-0243-4d6c-845f-c5e240e49990', 'code': 200} May 12 16:08:30.154687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=416501b9-0243-4d6c-845f-c5e240e49990,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:08:30.215973 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f601df59-bacd-4e4a-b07f-2e337c623b41 req-176ddac9-8ed0-4960-87ec-1145e997779b tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:30.217556 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f601df59-bacd-4e4a-b07f-2e337c623b41 req-176ddac9-8ed0-4960-87ec-1145e997779b tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 946 time: 0.0856047 May 12 16:08:30.263490 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f601df59-bacd-4e4a-b07f-2e337c623b41 req-d933d48b-3033-46bb-af61-036dde9005b7 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400679 May 12 16:08:30.309681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe66a13-0802-43b2-938a-f108debed6d6 req-24111f40-fb45-416e-8778-f3da4ccce15d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:30.311129 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2fe66a13-0802-43b2-938a-f108debed6d6 req-24111f40-fb45-416e-8778-f3da4ccce15d service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 1097 time: 0.0943947 May 12 16:08:30.358442 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2fe66a13-0802-43b2-938a-f108debed6d6 req-6ab55490-7507-409d-96ac-45981122e638 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342016 May 12 16:08:31.452666 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8acd489-6194-41cc-b27c-614a33ce6458 req-ec58b93b-bcc4-4dbf-bace-7add05115869 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:31.454697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8acd489-6194-41cc-b27c-614a33ce6458 req-ec58b93b-bcc4-4dbf-bace-7add05115869 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 946 time: 0.0846944 May 12 16:08:31.497033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8acd489-6194-41cc-b27c-614a33ce6458 req-16d5db8b-12f8-4bfd-99af-7c69e0bf71c8 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366924 May 12 16:08:32.684946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b84055-3c4e-4be4-aa99-dd958703c338 req-1e5ecf99-e381-4d6e-9ece-7ca8c85e61dd tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:32.686411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1b84055-3c4e-4be4-aa99-dd958703c338 req-1e5ecf99-e381-4d6e-9ece-7ca8c85e61dd tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 946 time: 0.0828798 May 12 16:08:32.733932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c1b84055-3c4e-4be4-aa99-dd958703c338 req-2de52cb2-3419-467b-85d1-b7af49280bb8 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408270 May 12 16:08:32.852526 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:32.913549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1637f17e-da95-4b72-aa42-a8380dc79385 req-5b0e53c7-7be3-424e-8a74-73568dc22c55 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:32.914977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1637f17e-da95-4b72-aa42-a8380dc79385 req-5b0e53c7-7be3-424e-8a74-73568dc22c55 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 946 time: 0.0786302 May 12 16:08:32.959060 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1637f17e-da95-4b72-aa42-a8380dc79385 req-003ac0d2-4857-4937-bbd2-204a2ed6d4d2 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384669 May 12 16:08:42.844312 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1bd1e26f-9c86-498d-98e4-c14baaf7b588 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:42.966669 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:08:43.668617 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:45.385694 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-33a9aa4a-8fec-4510-949d-47a8a44694f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:46.106143 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:46.380559 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:47.862514 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:48.365314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206ea9e2-6b9b-41da-93d9-847cd76b5397 req-f9b4e692-81ea-428e-8cf4-c8968e666de0 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:48.366784 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-206ea9e2-6b9b-41da-93d9-847cd76b5397 req-f9b4e692-81ea-428e-8cf4-c8968e666de0 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 946 time: 0.0930052 May 12 16:08:48.411452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-206ea9e2-6b9b-41da-93d9-847cd76b5397 req-e85a5e37-0cfe-4581-99c5-eaebb8897609 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390594 May 12 16:08:49.604867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b394e0-152a-406d-aae3-1a6eebb25fda req-3b4aea66-9326-4ae8-995c-3f2f10eb7e1a tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:49.606262 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57b394e0-152a-406d-aae3-1a6eebb25fda req-3b4aea66-9326-4ae8-995c-3f2f10eb7e1a tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 946 time: 0.0795825 May 12 16:08:49.649378 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-57b394e0-152a-406d-aae3-1a6eebb25fda req-6e7220ab-43b9-420c-b3b4-660ea83cdfba tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/security-groups?id=5bc9fe62-fd41-43c0-9779-83fca95fbccd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374851 May 12 16:08:50.118371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e3cc491-f0a5-4811-8a04-438c6b1783d3 req-d85243a6-ce6d-4945-ae1e-776003051734 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:08:50.119053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5e3cc491-f0a5-4811-8a04-438c6b1783d3 req-d85243a6-ce6d-4945-ae1e-776003051734 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Synchronizing usage tracker for tenant:9d2ddec2b766440fab8b257efda46f59 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:08:50.134397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5e3cc491-f0a5-4811-8a04-438c6b1783d3 req-d85243a6-ce6d-4945-ae1e-776003051734 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Unset dirty status for tenant:9d2ddec2b766440fab8b257efda46f59 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:08:50.135739 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5e3cc491-f0a5-4811-8a04-438c6b1783d3 req-d85243a6-ce6d-4945-ae1e-776003051734 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.84 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 946 time: 0.0953472 May 12 16:08:50.211555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-5e3cc491-f0a5-4811-8a04-438c6b1783d3 req-f903407a-37b1-4f35-8dd3-ffe2263bd1d9 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Deleting port 416501b9-0243-4d6c-845f-c5e240e49990 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:08:50.211877 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5e3cc491-f0a5-4811-8a04-438c6b1783d3 req-f903407a-37b1-4f35-8dd3-ffe2263bd1d9 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:50.460691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-5e3cc491-f0a5-4811-8a04-438c6b1783d3 req-f903407a-37b1-4f35-8dd3-ffe2263bd1d9 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] For port 416501b9-0243-4d6c-845f-c5e240e49990, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=416501b9-0243-4d6c-845f-c5e240e49990,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:08:50.460974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5e3cc491-f0a5-4811-8a04-438c6b1783d3 req-f903407a-37b1-4f35-8dd3-ffe2263bd1d9 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:50.582433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-5e3cc491-f0a5-4811-8a04-438c6b1783d3 req-f903407a-37b1-4f35-8dd3-ffe2263bd1d9 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Calling delete_port for 416501b9-0243-4d6c-845f-c5e240e49990 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:08:50.726252 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5e3cc491-f0a5-4811-8a04-438c6b1783d3 req-f903407a-37b1-4f35-8dd3-ffe2263bd1d9 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:50.768509 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['416501b9-0243-4d6c-845f-c5e240e49990'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:08:50.804173 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f903407a-37b1-4f35-8dd3-ffe2263bd1d9 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Pushing event deleted for resources: {'Port': ['ID=416501b9-0243-4d6c-845f-c5e240e49990,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:08:50.810657 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a973e69-1bd1-4da4-9e76-99a97c0fe53f req-a781f0db-18bd-422f-b132-e563f4079ae6 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.82 "GET /v2.0/ports?device_id=f2057a43-8b9c-400f-b0db-1e770d93dd3c HTTP/1.1" status: 200 len: 210 time: 0.0526984 May 12 16:08:50.856718 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-5e3cc491-f0a5-4811-8a04-438c6b1783d3 req-f903407a-37b1-4f35-8dd3-ffe2263bd1d9 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] No DVR routers for this DVR port 416501b9-0243-4d6c-845f-c5e240e49990 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:08:50.859336 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5e3cc491-f0a5-4811-8a04-438c6b1783d3 req-f903407a-37b1-4f35-8dd3-ffe2263bd1d9 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:50.862099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f2057a43-8b9c-400f-b0db-1e770d93dd3c', 'name': 'network-vif-deleted', 'tag': '416501b9-0243-4d6c-845f-c5e240e49990'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:08:50.879224 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5e3cc491-f0a5-4811-8a04-438c6b1783d3 req-f903407a-37b1-4f35-8dd3-ffe2263bd1d9 tempest-TestEncryptedCinderVolumes-1459536140 tempest-TestEncryptedCinderVolumes-1459536140-project] 10.222.0.84 "DELETE /v2.0/ports/416501b9-0243-4d6c-845f-c5e240e49990 HTTP/1.1" status: 204 len: 173 time: 0.7350857 May 12 16:08:50.916268 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-929df6d4-26a0-4824-a1a3-76cc7676e7c1'] response: {'server_uuid': 'f2057a43-8b9c-400f-b0db-1e770d93dd3c', 'name': 'network-vif-deleted', 'tag': '416501b9-0243-4d6c-845f-c5e240e49990', 'status': 'completed', 'code': 200} May 12 16:08:51.940080 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54510) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:08:52.473399 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:52.922784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Deleting port 4fc9693c-01da-4b8f-9141-c829bf0b7050 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:08:52.923118 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:53.092514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] For port 4fc9693c-01da-4b8f-9141-c829bf0b7050, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=4fc9693c-01da-4b8f-9141-c829bf0b7050,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:08:53.093188 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:53.213550 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Calling delete_port for 4fc9693c-01da-4b8f-9141-c829bf0b7050 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:08:53.519610 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:53.571051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Pushing event deleted for resources: {'Port': ['ID=4fc9693c-01da-4b8f-9141-c829bf0b7050,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:08:53.637049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:53.637377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:53.637727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:53.638045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:53.638359 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:53.638669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:53.638976 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:53.639280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:53.639583 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:53.639888 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:53.640192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:53.640494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:08:53.845189 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:53.951122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 416501b9-0243-4d6c-845f-c5e240e49990 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:08:53.992295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 416501b9-0243-4d6c-845f-c5e240e49990 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:08:53.992658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 416501b9-0243-4d6c-845f-c5e240e49990 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:08:54.316286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Router eb600664-877c-4c5a-bed6-7943ca39c2c2 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:08:54.494644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:08:54.503893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c67e5a0e-7965-4de8-921f-8c36b6f5634a None None] Sync routers for ids ['eb600664-877c-4c5a-bed6-7943ca39c2c2'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:08:54.507184 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fbdbf88a-d742-4014-9355-ea74ba090972 admin admin] 10.222.0.82 "PUT /v2.0/routers/eb600664-877c-4c5a-bed6-7943ca39c2c2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5660350 May 12 16:08:54.509641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54514) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:08:54.513514 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c67e5a0e-7965-4de8-921f-8c36b6f5634a None None] Routers {'eb600664-877c-4c5a-bed6-7943ca39c2c2'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:08:54.514104 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c67e5a0e-7965-4de8-921f-8c36b6f5634a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['eb600664-877c-4c5a-bed6-7943ca39c2c2'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:08:54.687174 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:54.692818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c67e5a0e-7965-4de8-921f-8c36b6f5634a None None] Set router eb600664-877c-4c5a-bed6-7943ca39c2c2 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:08:54.863990 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:54.874052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] Deleting port adaab294-8a56-4fca-864d-6cc3fa7e6c2a {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:08:54.874385 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:54.977880 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c67e5a0e-7965-4de8-921f-8c36b6f5634a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'name': 'tempest-TestEncryptedCinderVolumes-221317309-router', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.42'}], 'enable_snat': True}, 'gw_port_id': 'adaab294-8a56-4fca-864d-6cc3fa7e6c2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:35Z', 'updated_at': '2022-05-12T16:08:53Z', 'revision_number': 5, 'project_id': '9d2ddec2b766440fab8b257efda46f59', 'gw_port': {'id': 'adaab294-8a56-4fca-864d-6cc3fa7e6c2a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:9c:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4214, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:36Z', 'updated_at': '2022-05-12T16:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:08:54.981872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c67e5a0e-7965-4de8-921f-8c36b6f5634a None None] Checking router: eb600664-877c-4c5a-bed6-7943ca39c2c2 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:08:54.990220 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c67e5a0e-7965-4de8-921f-8c36b6f5634a None None] Routers {'eb600664-877c-4c5a-bed6-7943ca39c2c2'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:08:54.990806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c67e5a0e-7965-4de8-921f-8c36b6f5634a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['eb600664-877c-4c5a-bed6-7943ca39c2c2'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:08:55.050207 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] For port adaab294-8a56-4fca-864d-6cc3fa7e6c2a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=adaab294-8a56-4fca-864d-6cc3fa7e6c2a,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:08:55.050554 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:55.164791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c67e5a0e-7965-4de8-921f-8c36b6f5634a None None] Set router eb600664-877c-4c5a-bed6-7943ca39c2c2 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:08:55.172785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] Calling delete_port for adaab294-8a56-4fca-864d-6cc3fa7e6c2a owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:08:55.271399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c67e5a0e-7965-4de8-921f-8c36b6f5634a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'name': 'tempest-TestEncryptedCinderVolumes-221317309-router', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:35Z', 'updated_at': '2022-05-12T16:08:54Z', 'revision_number': 6, 'project_id': '9d2ddec2b766440fab8b257efda46f59', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:08:55.276937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c67e5a0e-7965-4de8-921f-8c36b6f5634a None None] The sync data for ids ['eb600664-877c-4c5a-bed6-7943ca39c2c2'] in n-d-841483-1 is: [{'id': 'eb600664-877c-4c5a-bed6-7943ca39c2c2', 'name': 'tempest-TestEncryptedCinderVolumes-221317309-router', 'tenant_id': '9d2ddec2b766440fab8b257efda46f59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:35Z', 'updated_at': '2022-05-12T16:08:54Z', 'revision_number': 6, 'project_id': '9d2ddec2b766440fab8b257efda46f59', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:08:55.461898 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:55.534358 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] Pushing event deleted for resources: {'Port': ['ID=adaab294-8a56-4fca-864d-6cc3fa7e6c2a,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:08:55.604424 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:55.782506 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:55.784961 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:55.808216 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:55.809064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] Fanout notify agent at l3_agent the message router_deleted on router eb600664-877c-4c5a-bed6-7943ca39c2c2 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:08:55.826250 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:55.827354 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3c2f7715-6900-4819-85f5-c031110dd239 admin admin] 10.222.0.82 "DELETE /v2.0/routers/eb600664-877c-4c5a-bed6-7943ca39c2c2 HTTP/1.1" status: 204 len: 168 time: 1.3168335 May 12 16:08:55.829953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54518) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:08:55.890435 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-aff634a1-81ff-400f-b5e1-dc891bb7b108 admin admin] Deleting subnet 567ea8ae-7967-4eae-8499-8b5e3e2b7ab3 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:08:55.893823 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aff634a1-81ff-400f-b5e1-dc891bb7b108 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:55.942416 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aff634a1-81ff-400f-b5e1-dc891bb7b108 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:56.020627 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aff634a1-81ff-400f-b5e1-dc891bb7b108 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:56.094609 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aff634a1-81ff-400f-b5e1-dc891bb7b108 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:56.133065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aff634a1-81ff-400f-b5e1-dc891bb7b108 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=567ea8ae-7967-4eae-8499-8b5e3e2b7ab3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:08:56.137914 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-aff634a1-81ff-400f-b5e1-dc891bb7b108 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:56.143182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-954fed8a-b039-4032-85b9-e4f32895e130 None None] Network 6df4e173-ea16-4675-98b5-60fef3f72088 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:08:56.145403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-aff634a1-81ff-400f-b5e1-dc891bb7b108 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/567ea8ae-7967-4eae-8499-8b5e3e2b7ab3 HTTP/1.1" status: 204 len: 168 time: 0.3144388 May 12 16:08:56.147758 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54522) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:08:56.262411 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:56.274441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Deleting port 6110429c-054b-4639-ae3e-ac591d83202e {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:08:56.274784 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:56.372630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4fc9693c-01da-4b8f-9141-c829bf0b7050 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:08:56.412762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 4fc9693c-01da-4b8f-9141-c829bf0b7050 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:08:56.413091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 4fc9693c-01da-4b8f-9141-c829bf0b7050 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:08:56.413600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device adaab294-8a56-4fca-864d-6cc3fa7e6c2a no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:08:56.448282 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: adaab294-8a56-4fca-864d-6cc3fa7e6c2a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:08:56.448612 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device adaab294-8a56-4fca-864d-6cc3fa7e6c2a not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:08:56.498351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] For port 6110429c-054b-4639-ae3e-ac591d83202e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6110429c-054b-4639-ae3e-ac591d83202e,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:08:56.498847 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:56.516351 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3ebd199-aac2-46a1-a67a-74d9ababb3f4 None None] DHCP port deletion for 6df4e173-ea16-4675-98b5-60fef3f72088 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:08:56.520678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c3ebd199-aac2-46a1-a67a-74d9ababb3f4 None None] Deleting port 6110429c-054b-4639-ae3e-ac591d83202e {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:08:56.521042 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3ebd199-aac2-46a1-a67a-74d9ababb3f4 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:56.621800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Calling delete_port for 6110429c-054b-4639-ae3e-ac591d83202e owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:08:56.697207 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:56.722316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c3ebd199-aac2-46a1-a67a-74d9ababb3f4 None None] For port 6110429c-054b-4639-ae3e-ac591d83202e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6110429c-054b-4639-ae3e-ac591d83202e,segment=NetworkSegment(543d1def-817b-422e-8be2-83e1c89dcdac),segment_id=543d1def-817b-422e-8be2-83e1c89dcdac)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:08:56.722697 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3ebd199-aac2-46a1-a67a-74d9ababb3f4 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:56.748049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Pushing event deleted for resources: {'Port': ['ID=6110429c-054b-4639-ae3e-ac591d83202e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:08:56.753590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] No DVR routers for this DVR port 6110429c-054b-4639-ae3e-ac591d83202e on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:08:56.844853 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c3ebd199-aac2-46a1-a67a-74d9ababb3f4 None None] Calling delete_port for 6110429c-054b-4639-ae3e-ac591d83202e owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:08:56.920145 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-c3ebd199-aac2-46a1-a67a-74d9ababb3f4 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:08:56.920402 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-c3ebd199-aac2-46a1-a67a-74d9ababb3f4 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:08:56.972414 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:56.996928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6df4e173-ea16-4675-98b5-60fef3f72088']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:08:57.009948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '543d1def-817b-422e-8be2-83e1c89dcdac') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:08:57.010235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '543d1def-817b-422e-8be2-83e1c89dcdac') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:08:57.021526 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:57.041417 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:57.049924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Releasing vlan 550 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:08:57.050315 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: timer() May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: self._notify() May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:08:57.063359 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:08:57.139663 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:57.154992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:57.166141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] Pushing event deleted for resources: {'Network': ['ID=6df4e173-ea16-4675-98b5-60fef3f72088,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:08:57.178356 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8109b002-a949-4350-aca9-de84291a7c21 admin admin] 10.222.0.82 "DELETE /v2.0/networks/6df4e173-ea16-4675-98b5-60fef3f72088 HTTP/1.1" status: 204 len: 168 time: 1.0296524 May 12 16:08:57.181299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54526) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:08:57.422121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c3ebd199-aac2-46a1-a67a-74d9ababb3f4 None None] Deleting port 6110429c-054b-4639-ae3e-ac591d83202e {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:08:57.422783 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c3ebd199-aac2-46a1-a67a-74d9ababb3f4 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:57.493550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c3ebd199-aac2-46a1-a67a-74d9ababb3f4 None None] The port '6110429c-054b-4639-ae3e-ac591d83202e' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 16:08:57.717609 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-72d89068-d489-41d8-8b7e-8d7a2aaf1672 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:58.055331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-72d89068-d489-41d8-8b7e-8d7a2aaf1672 admin admin] Deleting port 1294f640-ca2b-413d-b691-2c32cab0c5ca {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:08:58.055658 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-72d89068-d489-41d8-8b7e-8d7a2aaf1672 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:58.220126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-72d89068-d489-41d8-8b7e-8d7a2aaf1672 admin admin] For port 1294f640-ca2b-413d-b691-2c32cab0c5ca, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1294f640-ca2b-413d-b691-2c32cab0c5ca,segment=NetworkSegment(2041a794-00bc-4574-bc84-e314cbeaceff),segment_id=2041a794-00bc-4574-bc84-e314cbeaceff)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:08:58.220983 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-72d89068-d489-41d8-8b7e-8d7a2aaf1672 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:58.362721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6110429c-054b-4639-ae3e-ac591d83202e no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:08:58.397580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 6110429c-054b-4639-ae3e-ac591d83202e {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:08:58.397916 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6110429c-054b-4639-ae3e-ac591d83202e not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:08:58.457784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-72d89068-d489-41d8-8b7e-8d7a2aaf1672 admin admin] Calling delete_port for 1294f640-ca2b-413d-b691-2c32cab0c5ca owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:08:58.632626 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-72d89068-d489-41d8-8b7e-8d7a2aaf1672 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:58.703686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72d89068-d489-41d8-8b7e-8d7a2aaf1672 admin admin] Pushing event deleted for resources: {'Port': ['ID=1294f640-ca2b-413d-b691-2c32cab0c5ca,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:08:58.948238 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-72d89068-d489-41d8-8b7e-8d7a2aaf1672 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:59.302572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-72d89068-d489-41d8-8b7e-8d7a2aaf1672 admin admin] Router a1450b0f-8706-42f8-9136-5aadc13bcf98 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:08:59.477946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-72d89068-d489-41d8-8b7e-8d7a2aaf1672 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:08:59.487202 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da95f4e5-8d49-4ca0-b5c3-9ac1e4d9bb12 None None] Sync routers for ids ['a1450b0f-8706-42f8-9136-5aadc13bcf98'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:08:59.488305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-72d89068-d489-41d8-8b7e-8d7a2aaf1672 admin admin] 10.222.0.82 "PUT /v2.0/routers/a1450b0f-8706-42f8-9136-5aadc13bcf98/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3060076 May 12 16:08:59.490774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54530) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:08:59.523597 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da95f4e5-8d49-4ca0-b5c3-9ac1e4d9bb12 None None] Routers {'a1450b0f-8706-42f8-9136-5aadc13bcf98'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:08:59.524190 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-da95f4e5-8d49-4ca0-b5c3-9ac1e4d9bb12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['a1450b0f-8706-42f8-9136-5aadc13bcf98'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:08:59.670635 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:08:59.695840 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-da95f4e5-8d49-4ca0-b5c3-9ac1e4d9bb12 None None] Set router a1450b0f-8706-42f8-9136-5aadc13bcf98 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:08:59.978913 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-da95f4e5-8d49-4ca0-b5c3-9ac1e4d9bb12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'name': 'tempest-TestEncryptedCinderVolumes-2065161667-router', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.29'}], 'enable_snat': True}, 'gw_port_id': '2c686102-a1f7-47dd-b704-0e0aa7a7c8a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:41Z', 'updated_at': '2022-05-12T16:08:58Z', 'revision_number': 5, 'project_id': '6e2103950a2548ac87b0ca305617aa1f', 'gw_port': {'id': '2c686102-a1f7-47dd-b704-0e0aa7a7c8a0', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:91:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4226, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:07:42Z', 'updated_at': '2022-05-12T16:07:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:08:59.983054 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da95f4e5-8d49-4ca0-b5c3-9ac1e4d9bb12 None None] Checking router: a1450b0f-8706-42f8-9136-5aadc13bcf98 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:08:59.992654 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da95f4e5-8d49-4ca0-b5c3-9ac1e4d9bb12 None None] Routers {'a1450b0f-8706-42f8-9136-5aadc13bcf98'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:08:59.993281 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-da95f4e5-8d49-4ca0-b5c3-9ac1e4d9bb12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['a1450b0f-8706-42f8-9136-5aadc13bcf98'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:08:59.996192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:00.005370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] Deleting port 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:09:00.005846 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:00.143553 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-da95f4e5-8d49-4ca0-b5c3-9ac1e4d9bb12 None None] Set router a1450b0f-8706-42f8-9136-5aadc13bcf98 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:09:00.179664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] For port 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2c686102-a1f7-47dd-b704-0e0aa7a7c8a0,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:09:00.180019 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:00.247426 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-da95f4e5-8d49-4ca0-b5c3-9ac1e4d9bb12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'name': 'tempest-TestEncryptedCinderVolumes-2065161667-router', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:41Z', 'updated_at': '2022-05-12T16:08:59Z', 'revision_number': 6, 'project_id': '6e2103950a2548ac87b0ca305617aa1f', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:00.251310 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da95f4e5-8d49-4ca0-b5c3-9ac1e4d9bb12 None None] The sync data for ids ['a1450b0f-8706-42f8-9136-5aadc13bcf98'] in n-d-841483-1 is: [{'id': 'a1450b0f-8706-42f8-9136-5aadc13bcf98', 'name': 'tempest-TestEncryptedCinderVolumes-2065161667-router', 'tenant_id': '6e2103950a2548ac87b0ca305617aa1f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:07:41Z', 'updated_at': '2022-05-12T16:08:59Z', 'revision_number': 6, 'project_id': '6e2103950a2548ac87b0ca305617aa1f', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:09:00.307200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] Calling delete_port for 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:09:00.490916 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:00.538887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] Pushing event deleted for resources: {'Port': ['ID=2c686102-a1f7-47dd-b704-0e0aa7a7c8a0,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:00.639235 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:00.829837 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:00.831915 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:00.854396 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:00.855103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] Fanout notify agent at l3_agent the message router_deleted on router a1450b0f-8706-42f8-9136-5aadc13bcf98 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:09:00.869001 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:00.870139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4c403544-047e-461b-b2a7-5dc546d05d4c admin admin] 10.222.0.82 "DELETE /v2.0/routers/a1450b0f-8706-42f8-9136-5aadc13bcf98 HTTP/1.1" status: 204 len: 168 time: 1.3784707 May 12 16:09:00.872568 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54534) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:00.933604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-78961d0a-a3a2-4d0c-a41c-7511f8233daa admin admin] Deleting subnet 17e572b3-53cd-4cc0-8e8d-dc4f9309acb7 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:09:00.936371 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78961d0a-a3a2-4d0c-a41c-7511f8233daa admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:00.978885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1294f640-ca2b-413d-b691-2c32cab0c5ca no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:09:00.989052 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78961d0a-a3a2-4d0c-a41c-7511f8233daa admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:01.017929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 1294f640-ca2b-413d-b691-2c32cab0c5ca {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:09:01.018236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1294f640-ca2b-413d-b691-2c32cab0c5ca not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:09:01.077781 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78961d0a-a3a2-4d0c-a41c-7511f8233daa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:01.149161 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78961d0a-a3a2-4d0c-a41c-7511f8233daa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:01.187371 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78961d0a-a3a2-4d0c-a41c-7511f8233daa admin admin] Pushing event deleted for resources: {'Subnet': ['ID=17e572b3-53cd-4cc0-8e8d-dc4f9309acb7,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:01.191115 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-78961d0a-a3a2-4d0c-a41c-7511f8233daa admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:01.197858 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-78961d0a-a3a2-4d0c-a41c-7511f8233daa admin admin] 10.222.0.82 "DELETE /v2.0/subnets/17e572b3-53cd-4cc0-8e8d-dc4f9309acb7 HTTP/1.1" status: 204 len: 168 time: 0.3243337 May 12 16:09:01.200363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54538) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:01.202239 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8afd0547-3a45-40af-8002-3b6a43785dc8 None None] Network 40855429-852e-405c-b233-35098a6ccc6c requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:09:01.320144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:01.331179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Deleting port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:09:01.331454 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:01.457889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-770de4ce-cbd6-42eb-bc81-89a2b162175a None None] DHCP port deletion for 40855429-852e-405c-b233-35098a6ccc6c request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:09:01.463470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-770de4ce-cbd6-42eb-bc81-89a2b162175a None None] Deleting port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:09:01.464001 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-770de4ce-cbd6-42eb-bc81-89a2b162175a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:01.563947 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] For port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f,segment=NetworkSegment(2041a794-00bc-4574-bc84-e314cbeaceff),segment_id=2041a794-00bc-4574-bc84-e314cbeaceff)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:09:01.564937 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:01.678967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-770de4ce-cbd6-42eb-bc81-89a2b162175a None None] For port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f,segment=NetworkSegment(2041a794-00bc-4574-bc84-e314cbeaceff),segment_id=2041a794-00bc-4574-bc84-e314cbeaceff)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:09:01.679258 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-770de4ce-cbd6-42eb-bc81-89a2b162175a None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:01.687170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Calling delete_port for c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:09:01.774144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:01.825810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-770de4ce-cbd6-42eb-bc81-89a2b162175a None None] Calling delete_port for c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:09:01.831492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Pushing event deleted for resources: {'Port': ['ID=c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:01.833416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] No DVR routers for this DVR port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:09:01.912069 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-770de4ce-cbd6-42eb-bc81-89a2b162175a None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:09:01.912418 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-770de4ce-cbd6-42eb-bc81-89a2b162175a None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:09:01.970088 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:01.997362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['40855429-852e-405c-b233-35098a6ccc6c']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:02.013375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2041a794-00bc-4574-bc84-e314cbeaceff') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:02.013693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2041a794-00bc-4574-bc84-e314cbeaceff') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:02.025753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:02.159670 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:02.166587 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Releasing vlan 587 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:09:02.167095 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: timer() May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:09:02.184606 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:09:02.267918 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:02.272799 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:02.297564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] Pushing event deleted for resources: {'Network': ['ID=40855429-852e-405c-b233-35098a6ccc6c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:02.302912 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-74b330d1-4247-4f08-b8c7-66fc8a2bbf88 admin admin] 10.222.0.82 "DELETE /v2.0/networks/40855429-852e-405c-b233-35098a6ccc6c HTTP/1.1" status: 204 len: 168 time: 1.1015322 May 12 16:09:02.364985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:09:02.433219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-770de4ce-cbd6-42eb-bc81-89a2b162175a None None] Deleting port c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:09:02.433612 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-770de4ce-cbd6-42eb-bc81-89a2b162175a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:02.465022 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:09:02.465356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2c686102-a1f7-47dd-b704-0e0aa7a7c8a0 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:09:02.465796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:09:02.505133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:09:02.505499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:09:02.529104 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54544) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:02.543598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-770de4ce-cbd6-42eb-bc81-89a2b162175a None None] The port 'c48f9a4f-512d-4dbe-b8fb-0980ada3cd5f' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 16:09:02.582157 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-234968ed-3903-4845-b498-2321c33545a0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9d2ddec2b766440fab8b257efda46f59&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0517955 May 12 16:09:02.584546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54548) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:02.642457 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-655cca68-4bfd-4d20-a2af-82edde2e8319 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:02.668523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-655cca68-4bfd-4d20-a2af-82edde2e8319 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:02.719336 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-655cca68-4bfd-4d20-a2af-82edde2e8319 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:02.733860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-655cca68-4bfd-4d20-a2af-82edde2e8319 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5bc9fe62-fd41-43c0-9779-83fca95fbccd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:02.740871 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-655cca68-4bfd-4d20-a2af-82edde2e8319 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:02.742006 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-655cca68-4bfd-4d20-a2af-82edde2e8319 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5bc9fe62-fd41-43c0-9779-83fca95fbccd HTTP/1.1" status: 204 len: 168 time: 0.1565685 May 12 16:09:02.890312 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:03.109678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54556) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:03.160156 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ddd64a90-9a16-4e4f-9efb-f7ec1b674a2f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6e2103950a2548ac87b0ca305617aa1f&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0493362 May 12 16:09:03.162662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54560) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:03.218837 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8bfd1df-b02a-4ae4-95bf-dd17c431f935 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:03.245076 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8bfd1df-b02a-4ae4-95bf-dd17c431f935 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:03.295307 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8bfd1df-b02a-4ae4-95bf-dd17c431f935 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:03.309879 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8bfd1df-b02a-4ae4-95bf-dd17c431f935 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=99d81ddf-6913-4ea1-8cfa-9432371b4a4e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:03.315944 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a8bfd1df-b02a-4ae4-95bf-dd17c431f935 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:03.317040 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a8bfd1df-b02a-4ae4-95bf-dd17c431f935 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/99d81ddf-6913-4ea1-8cfa-9432371b4a4e HTTP/1.1" status: 204 len: 168 time: 0.1535130 May 12 16:09:04.082584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54584) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:04.184823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-530545337-network', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:09:04.190564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:09:04.194625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Usage tracker for resource:network and tenant:01848e54c5dd4735962a6a10c4c0537b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:09:04.197435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:09:04.202992 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:09:04.213095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Made reservation on behalf of 01848e54c5dd4735962a6a10c4c0537b for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:09:04.215464 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:04.228584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:04.243624 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:09:04.247548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Usage tracker for resource:security_group_rule and tenant:01848e54c5dd4735962a6a10c4c0537b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:09:04.250340 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:09:04.256471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:09:04.342662 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:04.347209 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:04.377517 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 596} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:09:04.385524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8be97727-1a22-4860-9a0f-16feb2050988,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:04.391035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:04.391354 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Added segment 49989138-c9c5-4f43-9f26-c28f48284359 of type vlan for network 5418b7a4-7287-44ab-80e4-b891f73479fd May 12 16:09:04.417133 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:04.444928 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:04.445900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:04.446456 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:04.547557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] Pushing event updated for resources: {'Network': ['ID=5418b7a4-7287-44ab-80e4-b891f73479fd,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:04.552666 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e87ef88f-ff81-48bc-ace4-ccad329d302d admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.4690073 May 12 16:09:04.555507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54590) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:04.558362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 5418b7a4-7287-44ab-80e4-b891f73479fd details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:09:04.561437 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Request body: {'subnet': {'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-530545337-subnet', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:09:04.568995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:09:04.572946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Usage tracker for resource:subnet and tenant:01848e54c5dd4735962a6a10c4c0537b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:09:04.575928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:09:04.582253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:09:04.592345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Made reservation on behalf of 01848e54c5dd4735962a6a10c4c0537b for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:09:04.594751 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:04.796467 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:04.876306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Pushing event updated for resources: {'Subnet': ['ID=4a05f8bc-f6c5-48f5-908e-08f8d89e9171,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:04.881048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Checking segment: {'id': '49989138-c9c5-4f43-9f26-c28f48284359', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:09:04.881413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Network hostable DHCP agents. Network: 5418b7a4-7287-44ab-80e4-b891f73479fd, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:09:04.899743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Network 5418b7a4-7287-44ab-80e4-b891f73479fd is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:09:04.908837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 5418b7a4-7287-44ab-80e4-b891f73479fd) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:09:04.912780 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:04.913355 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:04.917727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3731503a-3ee5-4eaa-8bdf-97c9405ee1cc None None] Network 5418b7a4-7287-44ab-80e4-b891f73479fd requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:09:04.934191 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-eb55a25e-c591-4754-b363-b38e41da70ef admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3771739 May 12 16:09:04.936681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54594) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:04.941674 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:09:04.947270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:09:04.951091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Usage tracker for resource:router and tenant:01848e54c5dd4735962a6a10c4c0537b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:09:04.953910 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:09:04.959901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:09:04.970931 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:04.971960 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:04.987708 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:05.135921 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-5418b7a4-7287-44ab-80e4-b891f73479fd', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'fixed_ips': [{'subnet_id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:09:05.136772 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:05.255912 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:05.293491 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Allocated IP 172.20.0.2 (5418b7a4-7287-44ab-80e4-b891f73479fd/4a05f8bc-f6c5-48f5-908e-08f8d89e9171/a8c818b1-69b0-46c7-8f65-c4a2b1887350) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:09:05.497940 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:05.510449 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Transition to ACTIVE for port object a8c818b1-69b0-46c7-8f65-c4a2b1887350 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:09:05.529968 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Transition to ACTIVE for port object a8c818b1-69b0-46c7-8f65-c4a2b1887350 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:09:05.535475 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:05.605396 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Network 5418b7a4-7287-44ab-80e4-b891f73479fd is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:09:05.608290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:09:05.612391 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:09:05.617920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Pushing event updated for resources: {'Port': ['ID=a8c818b1-69b0-46c7-8f65-c4a2b1887350,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:05.689200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:05.705193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Attempting to bind port a8c818b1-69b0-46c7-8f65-c4a2b1887350 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:09:05.705583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Attempting to bind port a8c818b1-69b0-46c7-8f65-c4a2b1887350 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '49989138-c9c5-4f43-9f26-c28f48284359', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:09:05.705938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Attempting to bind port a8c818b1-69b0-46c7-8f65-c4a2b1887350 on network 5418b7a4-7287-44ab-80e4-b891f73479fd {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:09:05.711053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 8, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:09:05.711414 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Checking segment: {'id': '49989138-c9c5-4f43-9f26-c28f48284359', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:09:05.711805 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:05.712189 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Bound using segment: {'id': '49989138-c9c5-4f43-9f26-c28f48284359', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:09:05.712642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Bound port: a8c818b1-69b0-46c7-8f65-c4a2b1887350, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '49989138-c9c5-4f43-9f26-c28f48284359', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:09:05.713003 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:05.719179 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:05.802787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] For port a8c818b1-69b0-46c7-8f65-c4a2b1887350, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:09:05.806087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] For port a8c818b1-69b0-46c7-8f65-c4a2b1887350, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a8c818b1-69b0-46c7-8f65-c4a2b1887350,segment=NetworkSegment(49989138-c9c5-4f43-9f26-c28f48284359),segment_id=49989138-c9c5-4f43-9f26-c28f48284359)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:09:05.810337 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:05.858563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Allocated IP 172.25.8.135 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/f01dfd27-c50e-4f07-ac74-79cd423b1dbe) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:09:05.896496 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea151537-aad7-43a6-91b2-3a4b2e845d48 None None] Pushing event updated for resources: {'Port': ['ID=a8c818b1-69b0-46c7-8f65-c4a2b1887350,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:06.019508 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:06.054570 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:06.133776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:09:06.136997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:09:06.140908 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:09:06.178466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Pushing event updated for resources: {'Port': ['ID=f01dfd27-c50e-4f07-ac74-79cd423b1dbe,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:06.396987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a8c818b1-69b0-46c7-8f65-c4a2b1887350 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:09:06.466492 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port a8c818b1-69b0-46c7-8f65-c4a2b1887350 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:09:06.577970 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:06.822797 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5984954-017d-4e25-a6fe-7b1673dec235 None None] Network 5418b7a4-7287-44ab-80e4-b891f73479fd requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:09:06.920333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fbffc05b-08a5-4154-ad0b-a4688006c03a None None] Provisioning for port a8c818b1-69b0-46c7-8f65-c4a2b1887350 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:09:06.927287 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:06.938184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-fbffc05b-08a5-4154-ad0b-a4688006c03a None None] Provisioning complete for port a8c818b1-69b0-46c7-8f65-c4a2b1887350 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:06.938549 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fbffc05b-08a5-4154-ad0b-a4688006c03a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:07.199391 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fbffc05b-08a5-4154-ad0b-a4688006c03a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:07.242513 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-fbffc05b-08a5-4154-ad0b-a4688006c03a None None] For port a8c818b1-69b0-46c7-8f65-c4a2b1887350, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a8c818b1-69b0-46c7-8f65-c4a2b1887350,segment=NetworkSegment(49989138-c9c5-4f43-9f26-c28f48284359),segment_id=49989138-c9c5-4f43-9f26-c28f48284359)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:09:07.251285 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fbffc05b-08a5-4154-ad0b-a4688006c03a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:07.274938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Router ca249da1-5465-47ee-9400-a9beaa61f6ca is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 16:09:07.328602 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbffc05b-08a5-4154-ad0b-a4688006c03a None None] Pushing event updated for resources: {'Port': ['ID=a8c818b1-69b0-46c7-8f65-c4a2b1887350,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:07.471433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:09:07.473210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8d1975a2-233e-4f9f-9ab8-ca757cddf1eb None None] Provisioning complete for port a8c818b1-69b0-46c7-8f65-c4a2b1887350 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:07.473599 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8d1975a2-233e-4f9f-9ab8-ca757cddf1eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:07.497351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:07.498662 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7fb325f2-17c9-423c-bdd0-a5ac14396f48 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.5610754 May 12 16:09:07.501373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54598) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:07.506135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Sync routers for ids ['ca249da1-5465-47ee-9400-a9beaa61f6ca'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:09:07.535080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Routers {'ca249da1-5465-47ee-9400-a9beaa61f6ca'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:09:07.535609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ca249da1-5465-47ee-9400-a9beaa61f6ca'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:07.770985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Set router ca249da1-5465-47ee-9400-a9beaa61f6ca gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:09:08.063624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135'}], 'enable_snat': True}, 'gw_port_id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:09:06Z', 'revision_number': 3, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port': {'id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:b3:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4240, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:05Z', 'updated_at': '2022-05-12T16:09:05Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:08.068774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Checking router: ca249da1-5465-47ee-9400-a9beaa61f6ca for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:09:08.069136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Updating router ca249da1-5465-47ee-9400-a9beaa61f6ca port f01dfd27-c50e-4f07-ac74-79cd423b1dbe binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:09:08.126186 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:08.198019 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:08.378410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a8c818b1-69b0-46c7-8f65-c4a2b1887350 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:09:08.411778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Allocated IP 172.20.0.1 (5418b7a4-7287-44ab-80e4-b891f73479fd/4a05f8bc-f6c5-48f5-908e-08f8d89e9171/0d16c794-8ac1-4494-8dc6-1ab21c3d77d3) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:09:08.522504 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a8c818b1-69b0-46c7-8f65-c4a2b1887350 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:08.522869 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:08.552969 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:08.563255 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:08.579402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Transition to ACTIVE for port object 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:09:08.584417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Transition to ACTIVE for port object f01dfd27-c50e-4f07-ac74-79cd423b1dbe will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:09:08.594284 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:08.602523 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:08.708759 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Attempting to bind port f01dfd27-c50e-4f07-ac74-79cd423b1dbe on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:09:08.709115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Attempting to bind port f01dfd27-c50e-4f07-ac74-79cd423b1dbe by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:09:08.709488 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Attempting to bind port f01dfd27-c50e-4f07-ac74-79cd423b1dbe on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:09:08.724298 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cb4978a-cff1-4deb-9470-7933eaff4641 None None] Pushing event updated for resources: {'Port': ['ID=f01dfd27-c50e-4f07-ac74-79cd423b1dbe,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:08.737236 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 8, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:09:08.737624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:09:08.738020 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:08.738397 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:09:08.738850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Bound port: f01dfd27-c50e-4f07-ac74-79cd423b1dbe, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:09:08.739211 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:08.787384 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Network 5418b7a4-7287-44ab-80e4-b891f73479fd is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:09:08.790025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:09:08.793791 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:09:08.820331 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] For port f01dfd27-c50e-4f07-ac74-79cd423b1dbe, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:09:08.823243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] For port f01dfd27-c50e-4f07-ac74-79cd423b1dbe, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f01dfd27-c50e-4f07-ac74-79cd423b1dbe,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:09:08.830818 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:08.837959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Pushing event updated for resources: {'Port': ['ID=0d16c794-8ac1-4494-8dc6-1ab21c3d77d3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:08.854456 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:08.911823 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Routers {'ca249da1-5465-47ee-9400-a9beaa61f6ca'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:09:08.912436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ca249da1-5465-47ee-9400-a9beaa61f6ca'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:08.983063 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:09.015580 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cb4978a-cff1-4deb-9470-7933eaff4641 None None] Pushing event updated for resources: {'Port': ['ID=f01dfd27-c50e-4f07-ac74-79cd423b1dbe,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:09.128247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-608de7f2-de0a-4b09-a2ab-623aae166374 None None] Provisioning for port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:09:09.139079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-608de7f2-de0a-4b09-a2ab-623aae166374 None None] Provisioning complete for port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:09.139439 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-608de7f2-de0a-4b09-a2ab-623aae166374 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:09.169859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] Set router ca249da1-5465-47ee-9400-a9beaa61f6ca gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:09:09.216147 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:09.221366 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:09.311598 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-608de7f2-de0a-4b09-a2ab-623aae166374 None None] Port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:09:09.334041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Pushing event updated for resources: {'Port': ['ID=0d16c794-8ac1-4494-8dc6-1ab21c3d77d3,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:09.336573 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:09.477265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Network 5418b7a4-7287-44ab-80e4-b891f73479fd is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:09:09.478501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:09:09.507226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135'}], 'enable_snat': True}, 'gw_port_id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 4, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port': {'id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:b3:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4240, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:05Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0d16c794-8ac1-4494-8dc6-1ab21c3d77d3', 'name': '', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'mac_address': 'fa:16:3e:1b:bc:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 4241, 'fixed_ips': [{'subnet_id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:08Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 1, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'subnets': [{'id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:09.511967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e3ddf0f-806c-4429-bede-6eebd7f3f3c7 None None] The sync data for ids ['ca249da1-5465-47ee-9400-a9beaa61f6ca'] in n-d-841483-1 is: [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135'}], 'enable_snat': True}, 'gw_port_id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 4, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port': {'id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:b3:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4240, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:05Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0d16c794-8ac1-4494-8dc6-1ab21c3d77d3', 'name': '', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'mac_address': 'fa:16:3e:1b:bc:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 4241, 'fixed_ips': [{'subnet_id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:08Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 1, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'subnets': [{'id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:09:09.683267 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Router ca249da1-5465-47ee-9400-a9beaa61f6ca has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:09:09.739661 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1952c5dc-d8c2-44ac-8000-d1e074abe026 None None] Provisioning complete for port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:09.739941 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1952c5dc-d8c2-44ac-8000-d1e074abe026 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:09.807711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1952c5dc-d8c2-44ac-8000-d1e074abe026 None None] Port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:09:09.891375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:09:09.900631 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-25922156-f8af-439f-ab40-c541122fa945 admin admin] 10.222.0.82 "PUT /v2.0/routers/ca249da1-5465-47ee-9400-a9beaa61f6ca/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3981040 May 12 16:09:10.426033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f01dfd27-c50e-4f07-ac74-79cd423b1dbe up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:09:10.500217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f01dfd27-c50e-4f07-ac74-79cd423b1dbe completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:09:10.506519 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f01dfd27-c50e-4f07-ac74-79cd423b1dbe triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:10.506887 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:10.544613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54616) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:10.551142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1414816353-network', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:09:10.556857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:09:10.561100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Usage tracker for resource:network and tenant:0b00c923adb0414f8dca1a3f561259b3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:09:10.564823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:09:10.574298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:09:10.587905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Made reservation on behalf of 0b00c923adb0414f8dca1a3f561259b3 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:09:10.590958 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:10.604451 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:10.621254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:09:10.625197 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Usage tracker for resource:security_group_rule and tenant:0b00c923adb0414f8dca1a3f561259b3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:09:10.628831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:09:10.633167 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:10.634650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:09:10.650675 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port f01dfd27-c50e-4f07-ac74-79cd423b1dbe, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f01dfd27-c50e-4f07-ac74-79cd423b1dbe,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:09:10.655601 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:10.728799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=f01dfd27-c50e-4f07-ac74-79cd423b1dbe,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:10.732630 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:10.743290 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:10.774154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 576} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:09:10.788547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ff79f760-2bbe-403e-9272-135caab70d31,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:10.793228 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:10.793597 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Added segment 7b71a3ab-0865-4974-9436-c674d28f38e2 of type vlan for network dffbc212-a0c7-4790-adc4-3c8839bf23a1 May 12 16:09:10.825003 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:10.856845 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:10.858018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:10.858593 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:10.963234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] Pushing event updated for resources: {'Network': ['ID=dffbc212-a0c7-4790-adc4-3c8839bf23a1,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:10.967051 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e9874fd2-a030-4305-bdc1-87e46e47a01b admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.4213510 May 12 16:09:10.969918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54620) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:10.972885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network dffbc212-a0c7-4790-adc4-3c8839bf23a1 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:09:10.976413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Request body: {'subnet': {'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1414816353-subnet', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:09:10.982349 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:09:10.986516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Usage tracker for resource:subnet and tenant:0b00c923adb0414f8dca1a3f561259b3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:09:10.989227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:09:10.994965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:09:11.009823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Made reservation on behalf of 0b00c923adb0414f8dca1a3f561259b3 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:09:11.012073 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:11.330552 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:11.403611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Pushing event updated for resources: {'Subnet': ['ID=bbd000c8-70aa-4ba5-9691-a5b6a8da8090,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:11.414733 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Checking segment: {'id': '7b71a3ab-0865-4974-9436-c674d28f38e2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:09:11.415090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Network hostable DHCP agents. Network: dffbc212-a0c7-4790-adc4-3c8839bf23a1, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:09:11.433864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Network dffbc212-a0c7-4790-adc4-3c8839bf23a1 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:09:11.442804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, dffbc212-a0c7-4790-adc4-3c8839bf23a1) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:09:11.447106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:11.447676 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:11.451774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c47278aa-6a05-489a-aa85-3bc8de6812f7 None None] Network dffbc212-a0c7-4790-adc4-3c8839bf23a1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:09:11.471216 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cef37e6c-a580-480c-84d6-a4169a415bca admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.4992895 May 12 16:09:11.473669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54624) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:11.479078 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1414816353-router', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:09:11.484810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:09:11.488838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Usage tracker for resource:router and tenant:0b00c923adb0414f8dca1a3f561259b3 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:09:11.491776 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:09:11.497473 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:09:11.509024 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:11.510034 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:11.525888 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:11.576436 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Sync routers for ids ['ca249da1-5465-47ee-9400-a9beaa61f6ca'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:09:11.596898 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Routers {'ca249da1-5465-47ee-9400-a9beaa61f6ca'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:09:11.597611 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ca249da1-5465-47ee-9400-a9beaa61f6ca'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:11.676889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-dffbc212-a0c7-4790-adc4-3c8839bf23a1', 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'fixed_ips': [{'subnet_id': 'bbd000c8-70aa-4ba5-9691-a5b6a8da8090'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:09:11.678188 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:11.778965 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Set router ca249da1-5465-47ee-9400-a9beaa61f6ca gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:09:11.806753 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:11.850697 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Allocated IP 172.20.0.2 (dffbc212-a0c7-4790-adc4-3c8839bf23a1/bbd000c8-70aa-4ba5-9691-a5b6a8da8090/972e244a-be70-42b4-b350-d0c07405857e) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:09:12.120748 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.132815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Transition to ACTIVE for port object 972e244a-be70-42b4-b350-d0c07405857e will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:09:12.135600 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.139542 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135'}], 'enable_snat': True}, 'gw_port_id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 4, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port': {'id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:b3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4240, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:05Z', 'updated_at': '2022-05-12T16:09:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0d16c794-8ac1-4494-8dc6-1ab21c3d77d3', 'name': '', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'mac_address': 'fa:16:3e:1b:bc:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 4241, 'fixed_ips': [{'subnet_id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:08Z', 'updated_at': '2022-05-12T16:09:09Z', 'revision_number': 2, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'subnets': [{'id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:12.143628 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Checking router: ca249da1-5465-47ee-9400-a9beaa61f6ca for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:09:12.143970 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Updating router ca249da1-5465-47ee-9400-a9beaa61f6ca port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:09:12.154094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Transition to ACTIVE for port object 972e244a-be70-42b4-b350-d0c07405857e will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:09:12.160578 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.169656 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.199438 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.229656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Network dffbc212-a0c7-4790-adc4-3c8839bf23a1 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:09:12.232315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:09:12.236783 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:09:12.246213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Pushing event updated for resources: {'Port': ['ID=972e244a-be70-42b4-b350-d0c07405857e,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:12.344528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Allocated IP 172.25.8.61 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:09:12.358348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Attempting to bind port 972e244a-be70-42b4-b350-d0c07405857e on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:09:12.358712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Attempting to bind port 972e244a-be70-42b4-b350-d0c07405857e by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '7b71a3ab-0865-4974-9436-c674d28f38e2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:09:12.359423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Attempting to bind port 972e244a-be70-42b4-b350-d0c07405857e on network dffbc212-a0c7-4790-adc4-3c8839bf23a1 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:09:12.367986 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 8, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:09:12.368395 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Checking segment: {'id': '7b71a3ab-0865-4974-9436-c674d28f38e2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:09:12.368835 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.369262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Bound using segment: {'id': '7b71a3ab-0865-4974-9436-c674d28f38e2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:09:12.369762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Bound port: 972e244a-be70-42b4-b350-d0c07405857e, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7b71a3ab-0865-4974-9436-c674d28f38e2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:09:12.370173 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.388109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f01dfd27-c50e-4f07-ac74-79cd423b1dbe up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:09:12.522388 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] For port 972e244a-be70-42b4-b350-d0c07405857e, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:09:12.527734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] For port 972e244a-be70-42b4-b350-d0c07405857e, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=972e244a-be70-42b4-b350-d0c07405857e,segment=NetworkSegment(7b71a3ab-0865-4974-9436-c674d28f38e2),segment_id=7b71a3ab-0865-4974-9436-c674d28f38e2)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:09:12.533374 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.537029 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.567737 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.579516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f01dfd27-c50e-4f07-ac74-79cd423b1dbe triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:12.579516 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.608520 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.621727 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Transition to ACTIVE for port object 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:09:12.629349 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.641705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:09:12.644957 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:09:12.649059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:09:12.683228 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f090142f-9060-4aa5-bc17-c7f95261b806 None None] Pushing event updated for resources: {'Port': ['ID=972e244a-be70-42b4-b350-d0c07405857e,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:12.693279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Pushing event updated for resources: {'Port': ['ID=2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:12.781364 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf707390-8249-41c8-8091-79c220937589 None None] Pushing event updated for resources: {'Port': ['ID=0d16c794-8ac1-4494-8dc6-1ab21c3d77d3,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:12.821607 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf707390-8249-41c8-8091-79c220937589 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:12.821945 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf707390-8249-41c8-8091-79c220937589 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:12.822274 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf707390-8249-41c8-8091-79c220937589 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:12.822603 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf707390-8249-41c8-8091-79c220937589 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:12.822923 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf707390-8249-41c8-8091-79c220937589 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:12.823245 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf707390-8249-41c8-8091-79c220937589 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:12.823562 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf707390-8249-41c8-8091-79c220937589 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:12.823874 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf707390-8249-41c8-8091-79c220937589 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:12.824189 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf707390-8249-41c8-8091-79c220937589 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:12.824500 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf707390-8249-41c8-8091-79c220937589 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:12.824809 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf707390-8249-41c8-8091-79c220937589 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:12.825117 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf707390-8249-41c8-8091-79c220937589 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:12.863639 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bb89a7b7-211b-4f0b-a310-0de61692788c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.896488 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Attempting to bind port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:09:12.896859 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Attempting to bind port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '49989138-c9c5-4f43-9f26-c28f48284359', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:09:12.897429 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Attempting to bind port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 on network 5418b7a4-7287-44ab-80e4-b891f73479fd {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:09:12.904027 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 8, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:09:12.904413 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Checking segment: {'id': '49989138-c9c5-4f43-9f26-c28f48284359', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:09:12.904793 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:12.905229 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Bound using segment: {'id': '49989138-c9c5-4f43-9f26-c28f48284359', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:09:12.905729 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Bound port: 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '49989138-c9c5-4f43-9f26-c28f48284359', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:09:12.906122 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:13.037099 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] For port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:09:13.041652 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] For port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0d16c794-8ac1-4494-8dc6-1ab21c3d77d3,segment=NetworkSegment(49989138-c9c5-4f43-9f26-c28f48284359),segment_id=49989138-c9c5-4f43-9f26-c28f48284359)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:09:13.050556 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:13.149485 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Routers {'ca249da1-5465-47ee-9400-a9beaa61f6ca'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:09:13.150121 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ca249da1-5465-47ee-9400-a9beaa61f6ca'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:13.235774 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf707390-8249-41c8-8091-79c220937589 None None] Pushing event updated for resources: {'Port': ['ID=0d16c794-8ac1-4494-8dc6-1ab21c3d77d3,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:13.348690 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:13.368211 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] Set router ca249da1-5465-47ee-9400-a9beaa61f6ca gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:09:13.680876 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:13.694363 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135'}], 'enable_snat': True}, 'gw_port_id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 4, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port': {'id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:b3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4240, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:05Z', 'updated_at': '2022-05-12T16:09:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0d16c794-8ac1-4494-8dc6-1ab21c3d77d3', 'name': '', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'mac_address': 'fa:16:3e:1b:bc:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 4241, 'fixed_ips': [{'subnet_id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:08Z', 'updated_at': '2022-05-12T16:09:13Z', 'revision_number': 4, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'subnets': [{'id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:13.698511 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b74b583-1a68-408f-bb34-6ed37ddc89e5 None None] The sync data for ids ['ca249da1-5465-47ee-9400-a9beaa61f6ca'] in n-d-841483-1 is: [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135'}], 'enable_snat': True}, 'gw_port_id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 4, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port': {'id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:b3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4240, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:05Z', 'updated_at': '2022-05-12T16:09:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0d16c794-8ac1-4494-8dc6-1ab21c3d77d3', 'name': '', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'mac_address': 'fa:16:3e:1b:bc:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 4241, 'fixed_ips': [{'subnet_id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:08Z', 'updated_at': '2022-05-12T16:09:13Z', 'revision_number': 4, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'subnets': [{'id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:09:13.718491 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:13.956605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Router 11a25ae7-25ec-4822-af08-27dedb2c0d02 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 16:09:13.991621 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7afeca30-ebea-4680-bbff-1be29a469eb1 None None] Network dffbc212-a0c7-4790-adc4-3c8839bf23a1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:09:14.087101 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-784f2fca-1116-4089-9372-bdc2c05781a4 None None] Provisioning for port 972e244a-be70-42b4-b350-d0c07405857e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:09:14.147455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:09:14.170618 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Sync routers for ids ['11a25ae7-25ec-4822-af08-27dedb2c0d02'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:09:14.174008 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:14.178571 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54628) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:14.179460 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-dc876d48-b381-456b-8773-ee58a22de7e5 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.7039948 May 12 16:09:14.195427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Routers {'11a25ae7-25ec-4822-af08-27dedb2c0d02'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:09:14.196055 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:08:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['11a25ae7-25ec-4822-af08-27dedb2c0d02'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:14.449745 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Set router 11a25ae7-25ec-4822-af08-27dedb2c0d02 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:09:14.564656 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:09:14.835769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:09:14.846754 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:14.847115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:14.964181 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'name': 'tempest-TestMinimumBasicScenario-1414816353-router', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.61'}], 'enable_snat': True}, 'gw_port_id': '2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:11Z', 'updated_at': '2022-05-12T16:09:13Z', 'revision_number': 3, 'project_id': '0b00c923adb0414f8dca1a3f561259b3', 'gw_port': {'id': '2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:c3:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4252, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:12Z', 'updated_at': '2022-05-12T16:09:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:14.973250 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Checking router: 11a25ae7-25ec-4822-af08-27dedb2c0d02 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:09:14.973657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Updating router 11a25ae7-25ec-4822-af08-27dedb2c0d02 port 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:09:15.016616 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.049562 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.050913 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.101471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0d16c794-8ac1-4494-8dc6-1ab21c3d77d3,segment=NetworkSegment(49989138-c9c5-4f43-9f26-c28f48284359),segment_id=49989138-c9c5-4f43-9f26-c28f48284359)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:09:15.108818 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.109601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 972e244a-be70-42b4-b350-d0c07405857e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:09:15.259474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Allocated IP 172.20.0.1 (dffbc212-a0c7-4790-adc4-3c8839bf23a1/bbd000c8-70aa-4ba5-9691-a5b6a8da8090/1f8dc9c0-a1d6-43bb-b2a6-0b527613c679) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:09:15.290281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=0d16c794-8ac1-4494-8dc6-1ab21c3d77d3,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:15.322368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 972e244a-be70-42b4-b350-d0c07405857e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:09:15.385788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 972e244a-be70-42b4-b350-d0c07405857e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:15.386151 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.412456 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.428194 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Transition to ACTIVE for port object 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:09:15.451579 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.452932 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1e1f1df7-17bc-4031-a2a4-b9651950499c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.517527 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Network dffbc212-a0c7-4790-adc4-3c8839bf23a1 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:09:15.520374 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:09:15.523967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:09:15.567733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Pushing event updated for resources: {'Port': ['ID=1f8dc9c0-a1d6-43bb-b2a6-0b527613c679,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:15.586735 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.609272 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.654134 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.668640 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 972e244a-be70-42b4-b350-d0c07405857e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=972e244a-be70-42b4-b350-d0c07405857e,segment=NetworkSegment(7b71a3ab-0865-4974-9436-c674d28f38e2),segment_id=7b71a3ab-0865-4974-9436-c674d28f38e2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:09:15.671606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Transition to ACTIVE for port object 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:09:15.675423 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.723455 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.775332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Attempting to bind port 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:09:15.775610 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Attempting to bind port 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:09:15.775966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Attempting to bind port 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:09:15.779056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=972e244a-be70-42b4-b350-d0c07405857e,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:15.820624 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 8, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:09:15.820997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:09:15.821291 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.821694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:09:15.822158 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Bound port: 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:09:15.822522 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.845998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e6300b3d-2386-46a0-9874-7065caf80799 None None] Provisioning for port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:09:15.853757 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.877427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e6300b3d-2386-46a0-9874-7065caf80799 None None] Provisioning complete for port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:15.877796 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e6300b3d-2386-46a0-9874-7065caf80799 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:15.944850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee7f64f0-945f-4462-abdf-0012a82cc47f None None] Pushing event updated for resources: {'Port': ['ID=2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:15.972267 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e6300b3d-2386-46a0-9874-7065caf80799 None None] Port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:09:15.979266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] For port 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:09:15.982662 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] For port 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:09:15.987432 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:16.072172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Routers {'11a25ae7-25ec-4822-af08-27dedb2c0d02'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:09:16.072776 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:09:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['11a25ae7-25ec-4822-af08-27dedb2c0d02'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:16.090759 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:16.095185 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:16.142590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee7f64f0-945f-4462-abdf-0012a82cc47f None None] Pushing event updated for resources: {'Port': ['ID=2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:16.176794 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:16.281100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] Set router 11a25ae7-25ec-4822-af08-27dedb2c0d02 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:09:16.328560 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Pushing event updated for resources: {'Port': ['ID=1f8dc9c0-a1d6-43bb-b2a6-0b527613c679,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:16.343576 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:16.420060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:09:16.486748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Network dffbc212-a0c7-4790-adc4-3c8839bf23a1 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:09:16.488010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:09:16.550862 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:16.696845 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:16.697215 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:16.702438 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Router 11a25ae7-25ec-4822-af08-27dedb2c0d02 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:09:16.820312 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a3b85976-4f65-4125-9d75-072729f77f83 None None] Provisioning complete for port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:16.820587 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a3b85976-4f65-4125-9d75-072729f77f83 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:16.891700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:09:16.901412 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8b2caf0a-2577-438d-8d83-2ab2e41f5a29 admin admin] 10.222.0.82 "PUT /v2.0/routers/11a25ae7-25ec-4822-af08-27dedb2c0d02/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7217004 May 12 16:09:16.930426 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a3b85976-4f65-4125-9d75-072729f77f83 None None] Port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:09:16.936101 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 972e244a-be70-42b4-b350-d0c07405857e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:09:16.997232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'name': 'tempest-TestMinimumBasicScenario-1414816353-router', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.61'}], 'enable_snat': True}, 'gw_port_id': '2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:11Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 4, 'project_id': '0b00c923adb0414f8dca1a3f561259b3', 'gw_port': {'id': '2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:c3:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4252, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:12Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1f8dc9c0-a1d6-43bb-b2a6-0b527613c679', 'name': '', 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'mac_address': 'fa:16:3e:08:8f:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'device_owner': 'network:router_interface', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'bbd000c8-70aa-4ba5-9691-a5b6a8da8090', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:15Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 2, 'project_id': '0b00c923adb0414f8dca1a3f561259b3', 'subnets': [{'id': 'bbd000c8-70aa-4ba5-9691-a5b6a8da8090', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:17.003712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b15d50b5-cf49-4e65-9023-9b8a4d8cfa8c None None] The sync data for ids ['11a25ae7-25ec-4822-af08-27dedb2c0d02'] in n-d-841483-1 is: [{'id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'name': 'tempest-TestMinimumBasicScenario-1414816353-router', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.61'}], 'enable_snat': True}, 'gw_port_id': '2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:11Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 4, 'project_id': '0b00c923adb0414f8dca1a3f561259b3', 'gw_port': {'id': '2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:c3:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4252, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:12Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1f8dc9c0-a1d6-43bb-b2a6-0b527613c679', 'name': '', 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'mac_address': 'fa:16:3e:08:8f:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'device_owner': 'network:router_interface', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'bbd000c8-70aa-4ba5-9691-a5b6a8da8090', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:15Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 2, 'project_id': '0b00c923adb0414f8dca1a3f561259b3', 'subnets': [{'id': 'bbd000c8-70aa-4ba5-9691-a5b6a8da8090', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:09:17.033920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 972e244a-be70-42b4-b350-d0c07405857e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:17.034286 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:17.865417 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:18.438510 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:09:18.524086 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:09:18.529847 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:18.530210 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:18.662115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:18.683590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:09:18.688486 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:18.778990 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:19.967336 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:09:20.389503 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:09:20.466145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:20.466507 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:21.114285 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Sync routers for ids ['11a25ae7-25ec-4822-af08-27dedb2c0d02'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:09:21.124420 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Routers {'11a25ae7-25ec-4822-af08-27dedb2c0d02'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:09:21.125261 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:09:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['11a25ae7-25ec-4822-af08-27dedb2c0d02'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:21.355654 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Set router 11a25ae7-25ec-4822-af08-27dedb2c0d02 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:09:21.705831 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'name': 'tempest-TestMinimumBasicScenario-1414816353-router', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.61'}], 'enable_snat': True}, 'gw_port_id': '2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:11Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 4, 'project_id': '0b00c923adb0414f8dca1a3f561259b3', 'gw_port': {'id': '2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:c3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4252, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:12Z', 'updated_at': '2022-05-12T16:09:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1f8dc9c0-a1d6-43bb-b2a6-0b527613c679', 'name': '', 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'mac_address': 'fa:16:3e:08:8f:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'device_owner': 'network:router_interface', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'bbd000c8-70aa-4ba5-9691-a5b6a8da8090', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:15Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 2, 'project_id': '0b00c923adb0414f8dca1a3f561259b3', 'subnets': [{'id': 'bbd000c8-70aa-4ba5-9691-a5b6a8da8090', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:21.712296 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Checking router: 11a25ae7-25ec-4822-af08-27dedb2c0d02 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:09:21.712773 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Updating router 11a25ae7-25ec-4822-af08-27dedb2c0d02 port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:09:21.769285 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:22.142271 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:22.156415 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Transition to ACTIVE for port object 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:09:22.164995 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:22.244297 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a492c0-0461-4117-9e3d-9b1cc08d6250 None None] Pushing event updated for resources: {'Port': ['ID=1f8dc9c0-a1d6-43bb-b2a6-0b527613c679,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:22.410143 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Attempting to bind port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:09:22.410444 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Attempting to bind port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '7b71a3ab-0865-4974-9436-c674d28f38e2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:09:22.410761 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Attempting to bind port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 on network dffbc212-a0c7-4790-adc4-3c8839bf23a1 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:09:22.416255 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 9, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:09:22.416618 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Checking segment: {'id': '7b71a3ab-0865-4974-9436-c674d28f38e2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:09:22.417004 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:22.417402 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Bound using segment: {'id': '7b71a3ab-0865-4974-9436-c674d28f38e2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:09:22.418455 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Bound port: 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7b71a3ab-0865-4974-9436-c674d28f38e2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 576, 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:09:22.418455 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:22.518299 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] For port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:09:22.521951 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] For port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1f8dc9c0-a1d6-43bb-b2a6-0b527613c679,segment=NetworkSegment(7b71a3ab-0865-4974-9436-c674d28f38e2),segment_id=7b71a3ab-0865-4974-9436-c674d28f38e2)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:09:22.528235 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:22.614667 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Routers {'11a25ae7-25ec-4822-af08-27dedb2c0d02'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:09:22.615289 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:09:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['11a25ae7-25ec-4822-af08-27dedb2c0d02'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:22.680876 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a492c0-0461-4117-9e3d-9b1cc08d6250 None None] Pushing event updated for resources: {'Port': ['ID=1f8dc9c0-a1d6-43bb-b2a6-0b527613c679,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:22.844490 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] Set router 11a25ae7-25ec-4822-af08-27dedb2c0d02 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:09:23.232265 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'name': 'tempest-TestMinimumBasicScenario-1414816353-router', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.61'}], 'enable_snat': True}, 'gw_port_id': '2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:11Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 4, 'project_id': '0b00c923adb0414f8dca1a3f561259b3', 'gw_port': {'id': '2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:c3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4252, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:12Z', 'updated_at': '2022-05-12T16:09:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1f8dc9c0-a1d6-43bb-b2a6-0b527613c679', 'name': '', 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'mac_address': 'fa:16:3e:08:8f:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'device_owner': 'network:router_interface', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'bbd000c8-70aa-4ba5-9691-a5b6a8da8090', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:15Z', 'updated_at': '2022-05-12T16:09:22Z', 'revision_number': 4, 'project_id': '0b00c923adb0414f8dca1a3f561259b3', 'subnets': [{'id': 'bbd000c8-70aa-4ba5-9691-a5b6a8da8090', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:09:23.237941 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64588a84-39b8-4de7-8cb0-13470a8bec4d None None] The sync data for ids ['11a25ae7-25ec-4822-af08-27dedb2c0d02'] in n-d-841483-1 is: [{'id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'name': 'tempest-TestMinimumBasicScenario-1414816353-router', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.61'}], 'enable_snat': True}, 'gw_port_id': '2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:11Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 4, 'project_id': '0b00c923adb0414f8dca1a3f561259b3', 'gw_port': {'id': '2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:c3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4252, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:12Z', 'updated_at': '2022-05-12T16:09:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1f8dc9c0-a1d6-43bb-b2a6-0b527613c679', 'name': '', 'network_id': 'dffbc212-a0c7-4790-adc4-3c8839bf23a1', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'mac_address': 'fa:16:3e:08:8f:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'device_owner': 'network:router_interface', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'bbd000c8-70aa-4ba5-9691-a5b6a8da8090', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:15Z', 'updated_at': '2022-05-12T16:09:22Z', 'revision_number': 4, 'project_id': '0b00c923adb0414f8dca1a3f561259b3', 'subnets': [{'id': 'bbd000c8-70aa-4ba5-9691-a5b6a8da8090', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:09:24.408910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:09:24.491578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:09:24.497272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:24.497674 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:24.639683 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:24.678974 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1f8dc9c0-a1d6-43bb-b2a6-0b527613c679,segment=NetworkSegment(7b71a3ab-0865-4974-9436-c674d28f38e2),segment_id=7b71a3ab-0865-4974-9436-c674d28f38e2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:09:24.686948 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:24.771472 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=1f8dc9c0-a1d6-43bb-b2a6-0b527613c679,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:26.389554 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:09:26.463017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:26.463491 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:27.184946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-fb46c904-9c78-47bf-b425-086e08bad761 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:27.186292 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-fb46c904-9c78-47bf-b425-086e08bad761 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/networks?id=5418b7a4-7287-44ab-80e4-b891f73479fd HTTP/1.1" status: 200 len: 814 time: 0.1522396 May 12 16:09:27.202008 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-f58124d2-7592-4d2e-b45d-5d4656e2cc7b tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/quotas/01848e54c5dd4735962a6a10c4c0537b HTTP/1.1" status: 200 len: 375 time: 0.0096898 May 12 16:09:27.287725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-1968e488-c9e2-4759-a11a-dab4bbec1c3c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=01848e54c5dd4735962a6a10c4c0537b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0805304 May 12 16:09:27.424289 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-95cbfb48-5088-4b14-a54f-8b21936c47e6 service neutron] 10.222.0.82 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1247137 May 12 16:09:27.556624 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-782327ef-5fe1-4929-98a6-c7e79d3740df service neutron] 10.222.0.82 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1265225 May 12 16:09:27.731195 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-606cd58e-719d-4cb3-a3e5-de381ff0deff req-7ea5c9b1-10f7-4c0d-8200-ae9a8b83322b tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 210 time: 0.0435834 May 12 16:09:28.278344 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2770ac30-cdea-4bf1-8769-849a5bc5c346 req-dada727b-2aa8-467f-b145-5f45454704a7 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0444283 May 12 16:09:28.392856 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2770ac30-cdea-4bf1-8769-849a5bc5c346 req-f8bc5bb9-eafb-4f8b-9671-6cda9b77efb5 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0453141 May 12 16:09:28.437180 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2770ac30-cdea-4bf1-8769-849a5bc5c346 req-04744b72-dc1c-4e6f-b14f-d0d486c50c42 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0260766 May 12 16:09:28.576162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2770ac30-cdea-4bf1-8769-849a5bc5c346 req-51460442-b91f-4c92-88ae-c3938cbac041 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:28.577650 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2770ac30-cdea-4bf1-8769-849a5bc5c346 req-51460442-b91f-4c92-88ae-c3938cbac041 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1352701 May 12 16:09:28.886030 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8486e6f-eab8-4e52-8f90-bb3e5903b117 req-f158a428-296e-4ad2-b9e7-093fdf1cd7c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 210 time: 0.0459590 May 12 16:09:29.152381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-a80a584a-e8a3-4f6b-8968-f6fc1e808d9c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:29.152974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-a80a584a-e8a3-4f6b-8968-f6fc1e808d9c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Synchronizing usage tracker for tenant:01848e54c5dd4735962a6a10c4c0537b on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:09:29.170399 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-a80a584a-e8a3-4f6b-8968-f6fc1e808d9c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Unset dirty status for tenant:01848e54c5dd4735962a6a10c4c0537b on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:09:29.171642 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-a80a584a-e8a3-4f6b-8968-f6fc1e808d9c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.84 "GET /v2.0/networks?id=5418b7a4-7287-44ab-80e4-b891f73479fd HTTP/1.1" status: 200 len: 814 time: 0.3253267 May 12 16:09:29.211270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Request body: {'port': {'device_id': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'admin_state_up': True, 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:09:29.359119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:09:29.365687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Usage tracker for resource:port and tenant:01848e54c5dd4735962a6a10c4c0537b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:09:29.369370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:09:29.375561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:09:29.386725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Made reservation on behalf of 01848e54c5dd4735962a6a10c4c0537b for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:09:29.390450 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:29.608777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Allocated IP 172.20.0.12 (5418b7a4-7287-44ab-80e4-b891f73479fd/4a05f8bc-f6c5-48f5-908e-08f8d89e9171/6321215f-8a2d-4b14-81a3-ec47dcbc0e95) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:09:29.872461 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:29.890069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Transition to ACTIVE for port object 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:09:29.924801 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:30.028709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Network 5418b7a4-7287-44ab-80e4-b891f73479fd is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:09:30.033268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:09:30.036061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:09:30.088990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event updated for resources: {'Port': ['ID=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:30.116530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:30.117022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:30.117364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:30.117732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:30.118059 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:30.118390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:30.118709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:30.119034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:30.119357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:30.119672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:30.119989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:30.120304 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:30.153436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bf1346-395f-48c8-9b78-5032aab5175d req-61b1d9ef-b840-48f4-8390-5cb866b9f43f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:30.154244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:30.155108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:30.171713 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13bf1346-395f-48c8-9b78-5032aab5175d req-61b1d9ef-b840-48f4-8390-5cb866b9f43f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 932 time: 0.1358063 May 12 16:09:30.191799 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-b3a34fc0-9d7d-4575-b549-a8b1389b96c9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9845316 May 12 16:09:30.232247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13bf1346-395f-48c8-9b78-5032aab5175d req-98d411e6-bd33-46f3-b12b-1af14c9c5c10 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527589 May 12 16:09:30.426694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-14a1016e-065d-48b0-9d23-ac360f8cb3f0 None None] Provisioning for port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:09:30.433182 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-14a1016e-065d-48b0-9d23-ac360f8cb3f0 None None] Provisioning complete for port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:30.433685 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-14a1016e-065d-48b0-9d23-ac360f8cb3f0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:30.491575 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-14a1016e-065d-48b0-9d23-ac360f8cb3f0 None None] Port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:09:31.444067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8991b754-712b-4d19-9f37-36697ee417f5 req-7059bc99-0307-4713-ae3b-727527e370d5 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:31.445610 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8991b754-712b-4d19-9f37-36697ee417f5 req-7059bc99-0307-4713-ae3b-727527e370d5 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 932 time: 0.0928249 May 12 16:09:31.496576 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8991b754-712b-4d19-9f37-36697ee417f5 req-582a9c8a-ba33-4337-9673-a1185d8de319 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449622 May 12 16:09:32.696163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af66dad2-2240-4a10-bd5e-22c87e841f64 req-6d0deaac-5d54-428f-b18f-085b2f929190 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:32.697863 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af66dad2-2240-4a10-bd5e-22c87e841f64 req-6d0deaac-5d54-428f-b18f-085b2f929190 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 932 time: 0.0878720 May 12 16:09:32.752692 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af66dad2-2240-4a10-bd5e-22c87e841f64 req-e07f2894-cded-496d-9893-95dfe605f93d tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485363 May 12 16:09:32.885436 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:34.076507 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2809b204-e5e3-4361-9f38-0acf43c51d1a req-c511e0e1-8e8d-4f80-8db0-493654553bb2 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:34.077922 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2809b204-e5e3-4361-9f38-0acf43c51d1a req-c511e0e1-8e8d-4f80-8db0-493654553bb2 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 932 time: 0.2099557 May 12 16:09:34.134435 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2809b204-e5e3-4361-9f38-0acf43c51d1a req-f6aa6cc9-991f-4bc2-84d1-ae47a1b3a050 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491824 May 12 16:09:35.340592 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e719431-e003-41a4-a6d2-3f3d993ba8b5 req-fd29fc80-487b-4030-92b9-b8789fd38879 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:35.343309 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e719431-e003-41a4-a6d2-3f3d993ba8b5 req-fd29fc80-487b-4030-92b9-b8789fd38879 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 932 time: 0.0926795 May 12 16:09:35.392436 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e719431-e003-41a4-a6d2-3f3d993ba8b5 req-ba213a1f-2c4c-483a-91d8-204d62abcb1b tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420175 May 12 16:09:36.600736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f4c042-5743-41d6-8a76-896619c5d37c req-ae34f83a-e185-4c33-8bb3-b05a1a0dbabd tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:36.602176 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67f4c042-5743-41d6-8a76-896619c5d37c req-ae34f83a-e185-4c33-8bb3-b05a1a0dbabd tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 932 time: 0.0921738 May 12 16:09:36.650649 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67f4c042-5743-41d6-8a76-896619c5d37c req-e55167b8-cc9c-44f7-a985-5d6f11687d5f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424814 May 12 16:09:37.368669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Request body: {'port': {'device_id': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:09:37.485044 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:37.845696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:09:37.851274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a38a7470-d543-4d6f-aca5-f6dac40d7ae7 req-79d3b938-1581-459a-8fbc-451ba4237ee9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:37.852747 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a38a7470-d543-4d6f-aca5-f6dac40d7ae7 req-79d3b938-1581-459a-8fbc-451ba4237ee9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 932 time: 0.0877266 May 12 16:09:37.853370 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:37.869708 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Transition to ACTIVE for port object 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:09:37.875065 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:37.903899 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a38a7470-d543-4d6f-aca5-f6dac40d7ae7 req-ccfc0f62-bd6b-490f-9335-fce25ce6c0bf tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450008 May 12 16:09:38.043292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Pushing event updated for resources: {'Port': ['ID=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:38.125191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Attempting to bind port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:09:38.125789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Attempting to bind port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '49989138-c9c5-4f43-9f26-c28f48284359', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:09:38.126162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Attempting to bind port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 on network 5418b7a4-7287-44ab-80e4-b891f73479fd {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:09:38.130886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 on network 5418b7a4-7287-44ab-80e4-b891f73479fd not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:09:38.131223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Attempting to bind port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 on network 5418b7a4-7287-44ab-80e4-b891f73479fd {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:09:38.136334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 9, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:09:38.136666 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Checking segment: {'id': '49989138-c9c5-4f43-9f26-c28f48284359', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:09:38.137047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Bound using segment: {'id': '49989138-c9c5-4f43-9f26-c28f48284359', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:09:38.137508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Bound port: 6321215f-8a2d-4b14-81a3-ec47dcbc0e95, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '49989138-c9c5-4f43-9f26-c28f48284359', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:09:38.137881 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:38.233121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] For port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:09:38.237004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] For port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,segment=NetworkSegment(49989138-c9c5-4f43-9f26-c28f48284359),segment_id=49989138-c9c5-4f43-9f26-c28f48284359)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:09:38.242095 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:38.306594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:38.307263 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:38.308689 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] 10.222.0.84 "PUT /v2.0/ports/6321215f-8a2d-4b14-81a3-ec47dcbc0e95 HTTP/1.1" status: 200 len: 1092 time: 0.9445448 May 12 16:09:38.309136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'tag': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:09:38.335020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22e68f09-b44e-4e42-b76b-cbe88255c74a service neutron] Pushing event updated for resources: {'Port': ['ID=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:38.371184 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f0339b94-8cb8-4506-adce-74cc846c33c4'] response: {'name': 'network-changed', 'server_uuid': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'tag': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95', 'status': 'completed', 'code': 200} May 12 16:09:38.466172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-2cf034f9-4671-4815-b943-d6506c1d03c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:38.467834 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-2cf034f9-4671-4815-b943-d6506c1d03c6 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=01848e54c5dd4735962a6a10c4c0537b&device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 1095 time: 0.0805678 May 12 16:09:38.664440 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-4bc26963-6c76-423e-90c0-de45ebffce4c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95 HTTP/1.1" status: 200 len: 217 time: 0.1769669 May 12 16:09:38.731669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-71bdf351-969a-4678-b175-2a3487c4c0a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:38.733096 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-71bdf351-969a-4678-b175-2a3487c4c0a9 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4a05f8bc-f6c5-48f5-908e-08f8d89e9171 HTTP/1.1" status: 200 len: 853 time: 0.0585399 May 12 16:09:38.814238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-608e57c1-3dd9-4c6b-9c6a-f18a69ac8e3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:38.815872 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-608e57c1-3dd9-4c6b-9c6a-f18a69ac8e3b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5418b7a4-7287-44ab-80e4-b891f73479fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0733986 May 12 16:09:38.957130 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-6edb42ee-6e33-4318-a4fd-9e0b48a8d004 service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1315491 May 12 16:09:39.096759 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8aacd650-783b-4861-9b73-3cddf6b24bb4 req-ede4022c-73c9-458d-928c-b77c5139c02a service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1294851 May 12 16:09:39.099043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c15924ba-c461-47c4-a8e7-67ab00909e37 req-73558915-682f-4752-af55-47f8400a448b tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:39.100492 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c15924ba-c461-47c4-a8e7-67ab00909e37 req-73558915-682f-4752-af55-47f8400a448b tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 944 time: 0.0822904 May 12 16:09:39.148620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c15924ba-c461-47c4-a8e7-67ab00909e37 req-b8226cc0-37e3-48ce-ad12-da3761fc6047 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424097 May 12 16:09:39.260774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf0d752-76cf-4fd7-ada1-e37f0ea81eb0 req-5662db5e-7a89-4af0-b734-b0964c76f4a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:39.262293 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dcf0d752-76cf-4fd7-ada1-e37f0ea81eb0 req-5662db5e-7a89-4af0-b734-b0964c76f4a2 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=01848e54c5dd4735962a6a10c4c0537b&device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 1095 time: 0.0723114 May 12 16:09:39.399413 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf0d752-76cf-4fd7-ada1-e37f0ea81eb0 req-2a2387e3-83ff-4cf4-ba63-8515b9d51566 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:39.400766 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dcf0d752-76cf-4fd7-ada1-e37f0ea81eb0 req-2a2387e3-83ff-4cf4-ba63-8515b9d51566 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5418b7a4-7287-44ab-80e4-b891f73479fd HTTP/1.1" status: 200 len: 915 time: 0.1294472 May 12 16:09:39.476895 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dcf0d752-76cf-4fd7-ada1-e37f0ea81eb0 req-df3327d3-fa3a-4b29-ad70-2045d0125c3f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95 HTTP/1.1" status: 200 len: 217 time: 0.0685637 May 12 16:09:39.542281 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf0d752-76cf-4fd7-ada1-e37f0ea81eb0 req-77099b9b-54db-405a-ab75-a06d6bbdf19c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:39.543713 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dcf0d752-76cf-4fd7-ada1-e37f0ea81eb0 req-77099b9b-54db-405a-ab75-a06d6bbdf19c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4a05f8bc-f6c5-48f5-908e-08f8d89e9171 HTTP/1.1" status: 200 len: 853 time: 0.0593386 May 12 16:09:39.627804 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf0d752-76cf-4fd7-ada1-e37f0ea81eb0 req-60e123b3-84f9-4dc0-aac7-47602be25cec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:39.629293 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dcf0d752-76cf-4fd7-ada1-e37f0ea81eb0 req-60e123b3-84f9-4dc0-aac7-47602be25cec service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5418b7a4-7287-44ab-80e4-b891f73479fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0785747 May 12 16:09:39.775093 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dcf0d752-76cf-4fd7-ada1-e37f0ea81eb0 req-a84f8051-ce44-4da9-8c0f-42c88b180c0f service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1388593 May 12 16:09:39.913185 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dcf0d752-76cf-4fd7-ada1-e37f0ea81eb0 req-60356c11-ed8f-4673-97f0-f8223205c5af service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1300309 May 12 16:09:40.338007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecfa13b6-80ee-46fd-aded-345464f90a7f req-905fd625-805f-4e5a-898e-3bf0c0a2fc64 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:40.339438 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecfa13b6-80ee-46fd-aded-345464f90a7f req-905fd625-805f-4e5a-898e-3bf0c0a2fc64 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 944 time: 0.0828257 May 12 16:09:40.384925 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecfa13b6-80ee-46fd-aded-345464f90a7f req-e2af255d-5cb6-4977-84a6-9521a849587e tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397949 May 12 16:09:41.617280 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5eabd9c-bbc1-4520-a573-04e23e5468b3 req-e27ac28a-0964-4ace-b0b4-0f0c91bece45 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:41.618669 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5eabd9c-bbc1-4520-a573-04e23e5468b3 req-e27ac28a-0964-4ace-b0b4-0f0c91bece45 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 944 time: 0.1143878 May 12 16:09:41.662158 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f5eabd9c-bbc1-4520-a573-04e23e5468b3 req-0856c375-cb4e-48d3-bb7d-0147bd2dcc7b tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378625 May 12 16:09:42.094402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:09:42.260231 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,segment=NetworkSegment(49989138-c9c5-4f43-9f26-c28f48284359),segment_id=49989138-c9c5-4f43-9f26-c28f48284359)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:09:42.273416 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'port_id': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95', 'mac_address': 'fa:16:3e:47:ac:ad', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 596, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:09:42.328660 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:42.345108 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:09:42.360549 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,segment=NetworkSegment(49989138-c9c5-4f43-9f26-c28f48284359),segment_id=49989138-c9c5-4f43-9f26-c28f48284359)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:09:42.364098 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:42.432763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:42.440205 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:42.440567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:42.440942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:42.441352 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:42.441695 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:42.442021 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:42.442342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:42.442916 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:42.443237 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:42.443549 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:42.443870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:42.444183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:42.698208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['6321215f-8a2d-4b14-81a3-ec47dcbc0e95'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:09:42.851962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0131919-630d-4079-822f-e2a3482cc50f req-fc1150c4-a51a-420b-8a19-29ac3b81a15c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:42.853451 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0131919-630d-4079-822f-e2a3482cc50f req-fc1150c4-a51a-420b-8a19-29ac3b81a15c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 945 time: 0.0848401 May 12 16:09:42.877763 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3e2f9ce3-42c2-4a84-bbee-cbae298c4cad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:42.899077 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0131919-630d-4079-822f-e2a3482cc50f req-9cfd08bd-cc47-48d1-a06b-0de2191b6c9e tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398159 May 12 16:09:43.687931 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:44.084146 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fefe786d-3efc-4ca3-b93c-0e06192f3da6 req-2e3b5005-0246-456f-8ac1-d5683e7a0a85 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:44.085619 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fefe786d-3efc-4ca3-b93c-0e06192f3da6 req-2e3b5005-0246-456f-8ac1-d5683e7a0a85 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 945 time: 0.0797932 May 12 16:09:44.106265 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:09:44.133287 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fefe786d-3efc-4ca3-b93c-0e06192f3da6 req-4f33b0c3-3b64-4784-a0cc-4ad062acf06c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420661 May 12 16:09:44.173093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:09:44.179269 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:09:44.179668 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:44.299791 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:44.327674 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:09:44.337741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,segment=NetworkSegment(49989138-c9c5-4f43-9f26-c28f48284359),segment_id=49989138-c9c5-4f43-9f26-c28f48284359)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:09:44.341994 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:44.380119 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-188348ed-e65f-41e0-ad1e-67946be898b0'] response: {'server_uuid': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95', 'code': 200} May 12 16:09:44.410438 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:44.534306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c60164d-f6da-4764-a3ab-f48e4e911cd6 req-a207dba9-4df5-46ce-a241-d664024ae24c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:44.536376 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c60164d-f6da-4764-a3ab-f48e4e911cd6 req-a207dba9-4df5-46ce-a241-d664024ae24c service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 1097 time: 0.0677211 May 12 16:09:44.579091 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c60164d-f6da-4764-a3ab-f48e4e911cd6 req-589c807a-961a-42d6-8b8a-f959e0431760 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340428 May 12 16:09:45.334865 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f84ea031-0e4a-4ace-a39e-3299d44db609 req-86a3cd81-e363-424a-a608-acf586c829c1 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:45.336382 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f84ea031-0e4a-4ace-a39e-3299d44db609 req-86a3cd81-e363-424a-a608-acf586c829c1 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 946 time: 0.0961959 May 12 16:09:45.381407 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f84ea031-0e4a-4ace-a39e-3299d44db609 req-ddb4a38f-5517-4f00-8e6b-1f77dd247e93 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392764 May 12 16:09:45.386089 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1bf6e2f8-1bde-4936-a41d-a008575d3fa0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:46.110372 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:46.387145 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:46.572812 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ecb5872-cdc1-4ad3-88c1-1b0c96e86dbd req-9ac86f1d-fd9d-4df8-ba5c-9cba3068cd63 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:46.574280 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ecb5872-cdc1-4ad3-88c1-1b0c96e86dbd req-9ac86f1d-fd9d-4df8-ba5c-9cba3068cd63 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 946 time: 0.0833936 May 12 16:09:46.617210 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ecb5872-cdc1-4ad3-88c1-1b0c96e86dbd req-e578b517-d2be-41fc-a536-907bc854c4f3 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374088 May 12 16:09:46.801930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146a9dbb-3029-418f-8945-397c98340b6a req-acc01e07-d9b5-449f-a774-18cbc030dd60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:46.803585 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-146a9dbb-3029-418f-8945-397c98340b6a req-acc01e07-d9b5-449f-a774-18cbc030dd60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 946 time: 0.0810678 May 12 16:09:46.850164 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-146a9dbb-3029-418f-8945-397c98340b6a req-ded88bdf-ccd5-4487-a8f6-b455f94a929d tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409698 May 12 16:09:47.249240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d24da2c-0662-4675-b37b-1eaf4e93ec98 req-1f252273-05ea-43b4-88cc-bbfdc9e0fa9a tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:47.250655 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d24da2c-0662-4675-b37b-1eaf4e93ec98 req-1f252273-05ea-43b4-88cc-bbfdc9e0fa9a tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 946 time: 0.0836926 May 12 16:09:47.295007 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2d24da2c-0662-4675-b37b-1eaf4e93ec98 req-d99fa11a-d80b-4428-985b-620fdc3721fb tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385983 May 12 16:09:47.862760 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:55.049074 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e5e7e5fc-30ad-4cc5-a5c5-e4c7b09627cf req-8d4b729c-61d6-44f1-bf6c-cc351c65ec96 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0724678 May 12 16:09:55.218450 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5e7e5fc-30ad-4cc5-a5c5-e4c7b09627cf req-bf9b2a22-c7a9-4425-b1e9-0109e46c8403 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:55.220183 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e5e7e5fc-30ad-4cc5-a5c5-e4c7b09627cf req-bf9b2a22-c7a9-4425-b1e9-0109e46c8403 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=01848e54c5dd4735962a6a10c4c0537b&device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 1097 time: 0.0740044 May 12 16:09:55.388131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5e7e5fc-30ad-4cc5-a5c5-e4c7b09627cf req-c7df8a07-3f90-4b3e-9b30-e99368026fd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:55.389702 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e5e7e5fc-30ad-4cc5-a5c5-e4c7b09627cf req-c7df8a07-3f90-4b3e-9b30-e99368026fd3 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5418b7a4-7287-44ab-80e4-b891f73479fd HTTP/1.1" status: 200 len: 915 time: 0.1502018 May 12 16:09:55.591473 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e5e7e5fc-30ad-4cc5-a5c5-e4c7b09627cf req-6b61d92d-71af-4e91-80be-a67dd9fae0c4 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95 HTTP/1.1" status: 200 len: 217 time: 0.1954749 May 12 16:09:55.654479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5e7e5fc-30ad-4cc5-a5c5-e4c7b09627cf req-831aa96c-2270-43d2-95bf-e087e02ef70f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:55.655892 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e5e7e5fc-30ad-4cc5-a5c5-e4c7b09627cf req-831aa96c-2270-43d2-95bf-e087e02ef70f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4a05f8bc-f6c5-48f5-908e-08f8d89e9171 HTTP/1.1" status: 200 len: 853 time: 0.0567451 May 12 16:09:55.736880 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5e7e5fc-30ad-4cc5-a5c5-e4c7b09627cf req-8710959d-05c1-43dc-8cf6-05b781bd4d01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:55.738517 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e5e7e5fc-30ad-4cc5-a5c5-e4c7b09627cf req-8710959d-05c1-43dc-8cf6-05b781bd4d01 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5418b7a4-7287-44ab-80e4-b891f73479fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0766580 May 12 16:09:55.875020 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e5e7e5fc-30ad-4cc5-a5c5-e4c7b09627cf req-7626832b-3bb6-431d-a0f9-f9cf05006bf0 service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1302810 May 12 16:09:56.010832 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e5e7e5fc-30ad-4cc5-a5c5-e4c7b09627cf req-29bce31c-1119-469e-a6ce-59e52e3576cd service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1300297 May 12 16:09:56.966856 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:09:57.456675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c3defb7-a29a-4a3e-878e-f341b678a9b3 req-915f946a-da90-421c-9223-36f0c40520f5 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:57.458190 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c3defb7-a29a-4a3e-878e-f341b678a9b3 req-915f946a-da90-421c-9223-36f0c40520f5 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 946 time: 0.0812082 May 12 16:09:57.509065 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c3defb7-a29a-4a3e-878e-f341b678a9b3 req-e6418d59-9176-413a-a59d-70d7a1fb86be tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425518 May 12 16:09:57.531937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54826) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:57.701107 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52475a2e-eb55-4572-9d3a-e6d9cb399010 tempest-TestMinimumBasicScenario-578536713 tempest-TestMinimumBasicScenario-578536713-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:09:57.701823 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-52475a2e-eb55-4572-9d3a-e6d9cb399010 tempest-TestMinimumBasicScenario-578536713 tempest-TestMinimumBasicScenario-578536713-project-admin] Synchronizing usage tracker for tenant:0b00c923adb0414f8dca1a3f561259b3 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:09:57.717732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-52475a2e-eb55-4572-9d3a-e6d9cb399010 tempest-TestMinimumBasicScenario-578536713 tempest-TestMinimumBasicScenario-578536713-project-admin] Unset dirty status for tenant:0b00c923adb0414f8dca1a3f561259b3 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:09:57.719040 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-52475a2e-eb55-4572-9d3a-e6d9cb399010 tempest-TestMinimumBasicScenario-578536713 tempest-TestMinimumBasicScenario-578536713-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 1092 time: 0.1860709 May 12 16:09:57.722051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54832) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:09:57.727027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'fixed_ip_address': '172.20.0.12'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:09:57.734390 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:09:57.738476 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Usage tracker for resource:floatingip and tenant:01848e54c5dd4735962a6a10c4c0537b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:09:57.741783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:09:57.747627 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:09:57.760880 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:57.911172 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:58.058209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Allocated IP 172.25.8.98 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/d35a1d8c-72d1-4681-b942-07cedb4a78f4) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:09:58.220668 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:58.253688 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:58.328285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:09:58.330876 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:09:58.335929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:09:58.372312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event updated for resources: {'Port': ['ID=d35a1d8c-72d1-4681-b942-07cedb4a78f4,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:58.397339 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:58.397715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:58.398054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:58.398409 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:58.398715 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:58.399044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:58.399364 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:58.399684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:58.400007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:58.400345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:58.400662 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:58.400980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:09:58.891486 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:58.969911 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:59.171359 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:59.175711 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:59.283684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event updated for resources: {'Port': ['ID=d35a1d8c-72d1-4681-b942-07cedb4a78f4,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:09:59.298608 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:09:59.470461 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Floating IP e14c6ca5-23db-40ce-8370-88cd06040a41 associated. External IP: 172.25.8.98, port: 6321215f-8a2d-4b14-81a3-ec47dcbc0e95. May 12 16:09:59.851172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Router ca249da1-5465-47ee-9400-a9beaa61f6ca has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:10:00.043428 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:10:00.054565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-974f0137-7df1-4cb1-ac7b-3a05d0695ef7 None None] Sync routers for ids ['ca249da1-5465-47ee-9400-a9beaa61f6ca'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:10:00.064448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-974f0137-7df1-4cb1-ac7b-3a05d0695ef7 None None] Routers {'ca249da1-5465-47ee-9400-a9beaa61f6ca'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:10:00.065056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-974f0137-7df1-4cb1-ac7b-3a05d0695ef7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:09:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ca249da1-5465-47ee-9400-a9beaa61f6ca'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:10:00.069692 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:00.261376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2e963308-e303-453a-a912-08adc820da94 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5331686 May 12 16:10:00.261376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'tag': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:10:00.261869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54836) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:10:00.271246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-974f0137-7df1-4cb1-ac7b-3a05d0695ef7 None None] Set router ca249da1-5465-47ee-9400-a9beaa61f6ca gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:10:00.274500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-546785071', 'description': 'tempest-secgroup-smoke-546785071 description', 'project_id': '01848e54c5dd4735962a6a10c4c0537b'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:10:00.284110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:10:00.289937 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Usage tracker for resource:security_group and tenant:01848e54c5dd4735962a6a10c4c0537b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:10:00.293466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:10:00.303101 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:10:00.314062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:00.335385 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:10:00.340816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Usage tracker for resource:security_group_rule and tenant:01848e54c5dd4735962a6a10c4c0537b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:10:00.343778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:10:00.350068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:10:00.427077 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:00.436823 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:00.471710 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5f7940f3-015a-4c87-ad53-3163f8ce159d'] response: {'name': 'network-changed', 'server_uuid': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'tag': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95', 'status': 'completed', 'code': 200} May 12 16:10:00.481878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:00.485752 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.2139795 May 12 16:10:00.485952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54844) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:10:00.491588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b4974430-624a-42ba-b4c6-72f403b9b768 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Request body: {'security_group_rule': {'security_group_id': 'a4d7d697-bf15-4548-8c1e-4ee6fc573110', 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:10:00.496648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f989f848-5f21-4560-9b23-94f71e15fb41 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a4d7d697-bf15-4548-8c1e-4ee6fc573110,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:10:00.500751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b4974430-624a-42ba-b4c6-72f403b9b768 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:10:00.505304 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b4974430-624a-42ba-b4c6-72f403b9b768 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Usage tracker for resource:security_group_rule and tenant:01848e54c5dd4735962a6a10c4c0537b is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:10:00.507850 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b4974430-624a-42ba-b4c6-72f403b9b768 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:10:00.513752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b4974430-624a-42ba-b4c6-72f403b9b768 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:10:00.576390 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4974430-624a-42ba-b4c6-72f403b9b768 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:00.647106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32fa2152-c052-4bd9-8bff-781ba463055f req-bda0bc6b-e3ec-459d-bd1e-607666cf19d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:00.648563 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32fa2152-c052-4bd9-8bff-781ba463055f req-bda0bc6b-e3ec-459d-bd1e-607666cf19d9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=01848e54c5dd4735962a6a10c4c0537b&device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 1097 time: 0.1235003 May 12 16:10:00.678754 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4974430-624a-42ba-b4c6-72f403b9b768 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:00.700369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-974f0137-7df1-4cb1-ac7b-3a05d0695ef7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135'}], 'enable_snat': True}, 'gw_port_id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 4, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port': {'id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:b3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4240, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:05Z', 'updated_at': '2022-05-12T16:09:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'e14c6ca5-23db-40ce-8370-88cd06040a41', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'floating_ip_address': '172.25.8.98', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'port_id': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 4256, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'mac_address': 'fa:16:3e:47:ac:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:09:58Z', 'updated_at': '2022-05-12T16:09:58Z', 'revision_number': 0, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0d16c794-8ac1-4494-8dc6-1ab21c3d77d3', 'name': '', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'mac_address': 'fa:16:3e:1b:bc:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 4241, 'fixed_ips': [{'subnet_id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:08Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 5, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'subnets': [{'id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:10:00.705633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-974f0137-7df1-4cb1-ac7b-3a05d0695ef7 None None] Checking router: ca249da1-5465-47ee-9400-a9beaa61f6ca for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:10:00.717622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-974f0137-7df1-4cb1-ac7b-3a05d0695ef7 None None] Routers {'ca249da1-5465-47ee-9400-a9beaa61f6ca'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:10:00.718446 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-974f0137-7df1-4cb1-ac7b-3a05d0695ef7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:09:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ca249da1-5465-47ee-9400-a9beaa61f6ca'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:10:00.733460 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4974430-624a-42ba-b4c6-72f403b9b768 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:00.776180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4974430-624a-42ba-b4c6-72f403b9b768 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6c07550d-90ba-4d40-840b-f7b8be066fa9,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:10:00.790190 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4974430-624a-42ba-b4c6-72f403b9b768 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:00.793995 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b4974430-624a-42ba-b4c6-72f403b9b768 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3045259 May 12 16:10:00.794580 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54848) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:10:00.801173 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-5a75912a-ff07-43d8-a4f3-ffd8a10ed555 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Request body: {'security_group_rule': {'security_group_id': 'a4d7d697-bf15-4548-8c1e-4ee6fc573110', 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:10:00.809663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5a75912a-ff07-43d8-a4f3-ffd8a10ed555 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:10:00.814342 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5a75912a-ff07-43d8-a4f3-ffd8a10ed555 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Usage tracker for resource:security_group_rule and tenant:01848e54c5dd4735962a6a10c4c0537b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:10:00.818948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5a75912a-ff07-43d8-a4f3-ffd8a10ed555 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:10:00.826660 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5a75912a-ff07-43d8-a4f3-ffd8a10ed555 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:10:00.827312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32fa2152-c052-4bd9-8bff-781ba463055f req-a56e9143-d4e1-4cce-974c-9caf81ab1d8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:00.828991 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32fa2152-c052-4bd9-8bff-781ba463055f req-a56e9143-d4e1-4cce-974c-9caf81ab1d8c service neutron] 10.222.0.84 "GET /v2.0/networks?id=5418b7a4-7287-44ab-80e4-b891f73479fd HTTP/1.1" status: 200 len: 915 time: 0.1718216 May 12 16:10:00.851471 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a75912a-ff07-43d8-a4f3-ffd8a10ed555 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:00.932861 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-974f0137-7df1-4cb1-ac7b-3a05d0695ef7 None None] Set router ca249da1-5465-47ee-9400-a9beaa61f6ca gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:10:00.933573 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a75912a-ff07-43d8-a4f3-ffd8a10ed555 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:00.937680 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32fa2152-c052-4bd9-8bff-781ba463055f req-823a576d-c3dc-4e2a-b474-03524f5ba3cc service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95 HTTP/1.1" status: 200 len: 999 time: 0.1013718 May 12 16:10:00.938771 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a75912a-ff07-43d8-a4f3-ffd8a10ed555 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:00.969119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a75912a-ff07-43d8-a4f3-ffd8a10ed555 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=58652fbf-d762-4e63-a548-7471008443dc,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:10:00.979271 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5a75912a-ff07-43d8-a4f3-ffd8a10ed555 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:00.984152 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5a75912a-ff07-43d8-a4f3-ffd8a10ed555 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1881905 May 12 16:10:00.984869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54852) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:10:00.991206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8cd9722a-35af-457c-addc-bef02bdfa18c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Request body: {'security_group_rule': {'security_group_id': 'a4d7d697-bf15-4548-8c1e-4ee6fc573110', 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:10:00.998838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8cd9722a-35af-457c-addc-bef02bdfa18c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:10:01.003955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8cd9722a-35af-457c-addc-bef02bdfa18c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Usage tracker for resource:security_group_rule and tenant:01848e54c5dd4735962a6a10c4c0537b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:10:01.007872 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8cd9722a-35af-457c-addc-bef02bdfa18c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:10:01.014399 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8cd9722a-35af-457c-addc-bef02bdfa18c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:10:01.018506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32fa2152-c052-4bd9-8bff-781ba463055f req-ad07de90-bff5-44ff-968a-e98198953ec0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:01.020793 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32fa2152-c052-4bd9-8bff-781ba463055f req-ad07de90-bff5-44ff-968a-e98198953ec0 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4a05f8bc-f6c5-48f5-908e-08f8d89e9171 HTTP/1.1" status: 200 len: 853 time: 0.0743730 May 12 16:10:01.035237 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8cd9722a-35af-457c-addc-bef02bdfa18c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.125114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32fa2152-c052-4bd9-8bff-781ba463055f req-1e91902b-6ea5-40bf-bf16-deeb3ee50220 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:01.126716 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32fa2152-c052-4bd9-8bff-781ba463055f req-1e91902b-6ea5-40bf-bf16-deeb3ee50220 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5418b7a4-7287-44ab-80e4-b891f73479fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0999126 May 12 16:10:01.131132 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8cd9722a-35af-457c-addc-bef02bdfa18c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.136107 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8cd9722a-35af-457c-addc-bef02bdfa18c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.164364 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cd9722a-35af-457c-addc-bef02bdfa18c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0f076076-caee-4ad6-aa42-1d49bd85dd53,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:10:01.177462 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8cd9722a-35af-457c-addc-bef02bdfa18c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.181647 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8cd9722a-35af-457c-addc-bef02bdfa18c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1929369 May 12 16:10:01.181859 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54856) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:10:01.187887 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d398f044-17d9-448f-a777-7c64380631d4 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Request body: {'security_group_rule': {'security_group_id': 'a4d7d697-bf15-4548-8c1e-4ee6fc573110', 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:10:01.196582 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d398f044-17d9-448f-a777-7c64380631d4 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:10:01.200945 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d398f044-17d9-448f-a777-7c64380631d4 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Usage tracker for resource:security_group_rule and tenant:01848e54c5dd4735962a6a10c4c0537b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:10:01.204418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d398f044-17d9-448f-a777-7c64380631d4 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:10:01.212578 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d398f044-17d9-448f-a777-7c64380631d4 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:10:01.241826 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d398f044-17d9-448f-a777-7c64380631d4 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.297088 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32fa2152-c052-4bd9-8bff-781ba463055f req-5735bd5d-e53d-4247-a5de-cfcbace9cdde service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1630166 May 12 16:10:01.328416 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d398f044-17d9-448f-a777-7c64380631d4 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.332358 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d398f044-17d9-448f-a777-7c64380631d4 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.365809 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d398f044-17d9-448f-a777-7c64380631d4 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=41c7b8ac-732d-410a-9096-0362022511e3,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:10:01.373867 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d398f044-17d9-448f-a777-7c64380631d4 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.375140 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d398f044-17d9-448f-a777-7c64380631d4 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1920624 May 12 16:10:01.381838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54860) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:10:01.387276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-701578e4-c9c4-4701-9226-30b260fdb267 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Request body: {'security_group_rule': {'security_group_id': 'a4d7d697-bf15-4548-8c1e-4ee6fc573110', 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:10:01.395321 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-701578e4-c9c4-4701-9226-30b260fdb267 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:10:01.400019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-701578e4-c9c4-4701-9226-30b260fdb267 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Usage tracker for resource:security_group_rule and tenant:01848e54c5dd4735962a6a10c4c0537b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:10:01.403706 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-701578e4-c9c4-4701-9226-30b260fdb267 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:10:01.412487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-701578e4-c9c4-4701-9226-30b260fdb267 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:10:01.425728 n-d-841483-1 neutron-server[88152]: INFO neutron.db.securitygroups_db [None req-701578e4-c9c4-4701-9226-30b260fdb267 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Project 01848e54c5dd4735962a6a10c4c0537b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:10:01.434753 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-701578e4-c9c4-4701-9226-30b260fdb267 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.476023 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32fa2152-c052-4bd9-8bff-781ba463055f req-6cb09a59-c762-47f8-b276-7674bcc898df service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1693146 May 12 16:10:01.512657 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-701578e4-c9c4-4701-9226-30b260fdb267 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.516564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-701578e4-c9c4-4701-9226-30b260fdb267 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.544454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-701578e4-c9c4-4701-9226-30b260fdb267 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c1175604-9d89-47c4-8ec1-fb4dc6a8fe37,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:10:01.563160 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-701578e4-c9c4-4701-9226-30b260fdb267 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.566321 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-701578e4-c9c4-4701-9226-30b260fdb267 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1829123 May 12 16:10:01.568718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54864) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:10:01.573790 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-bc2da42e-5369-432d-b8ad-c6df3448a42f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Request body: {'security_group_rule': {'security_group_id': 'a4d7d697-bf15-4548-8c1e-4ee6fc573110', 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:10:01.580645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bc2da42e-5369-432d-b8ad-c6df3448a42f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:10:01.581619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-974f0137-7df1-4cb1-ac7b-3a05d0695ef7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135'}], 'enable_snat': True}, 'gw_port_id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 4, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port': {'id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:b3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4240, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:05Z', 'updated_at': '2022-05-12T16:09:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'e14c6ca5-23db-40ce-8370-88cd06040a41', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'floating_ip_address': '172.25.8.98', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'port_id': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 4256, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'mac_address': 'fa:16:3e:47:ac:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:09:58Z', 'updated_at': '2022-05-12T16:09:58Z', 'revision_number': 0, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0d16c794-8ac1-4494-8dc6-1ab21c3d77d3', 'name': '', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'mac_address': 'fa:16:3e:1b:bc:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 4241, 'fixed_ips': [{'subnet_id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:08Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 5, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'subnets': [{'id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:10:01.584624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bc2da42e-5369-432d-b8ad-c6df3448a42f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Usage tracker for resource:security_group_rule and tenant:01848e54c5dd4735962a6a10c4c0537b is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:10:01.586376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-974f0137-7df1-4cb1-ac7b-3a05d0695ef7 None None] The sync data for ids ['ca249da1-5465-47ee-9400-a9beaa61f6ca'] in n-d-841483-1 is: [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135'}], 'enable_snat': True}, 'gw_port_id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 4, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port': {'id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:b3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4240, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:05Z', 'updated_at': '2022-05-12T16:09:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'e14c6ca5-23db-40ce-8370-88cd06040a41', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'floating_ip_address': '172.25.8.98', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'port_id': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 4256, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'mac_address': 'fa:16:3e:47:ac:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:09:58Z', 'updated_at': '2022-05-12T16:09:58Z', 'revision_number': 0, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0d16c794-8ac1-4494-8dc6-1ab21c3d77d3', 'name': '', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'mac_address': 'fa:16:3e:1b:bc:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 4241, 'fixed_ips': [{'subnet_id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:08Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 5, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'subnets': [{'id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:10:01.588489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bc2da42e-5369-432d-b8ad-c6df3448a42f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:10:01.595149 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bc2da42e-5369-432d-b8ad-c6df3448a42f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:10:01.607110 n-d-841483-1 neutron-server[88152]: INFO neutron.db.securitygroups_db [None req-bc2da42e-5369-432d-b8ad-c6df3448a42f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Project 01848e54c5dd4735962a6a10c4c0537b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:10:01.614771 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc2da42e-5369-432d-b8ad-c6df3448a42f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.683968 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc2da42e-5369-432d-b8ad-c6df3448a42f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.688077 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc2da42e-5369-432d-b8ad-c6df3448a42f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.713951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc2da42e-5369-432d-b8ad-c6df3448a42f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=23c2febe-6e99-475a-a476-c492da4ebe77,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:10:01.724751 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bc2da42e-5369-432d-b8ad-c6df3448a42f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:01.726069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bc2da42e-5369-432d-b8ad-c6df3448a42f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1563013 May 12 16:10:01.805121 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e83bcc4-30c8-4851-ada4-0f0a54972d4c None None] New status for floating IP e14c6ca5-23db-40ce-8370-88cd06040a41: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:10:01.855040 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a9a8c66-b27f-4507-9eb5-88774c2f2285 req-7fef075c-1eae-4352-9b01-15f58b545f06 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-546785071&fields=id&tenant_id=01848e54c5dd4735962a6a10c4c0537b HTTP/1.1" status: 200 len: 267 time: 0.0404921 May 12 16:10:01.944084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a9a8c66-b27f-4507-9eb5-88774c2f2285 req-3e68bced-d58f-4773-a77a-1a744f8e36f2 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:01.945560 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a9a8c66-b27f-4507-9eb5-88774c2f2285 req-3e68bced-d58f-4773-a77a-1a744f8e36f2 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 946 time: 0.0850725 May 12 16:10:01.957987 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-5a9a8c66-b27f-4507-9eb5-88774c2f2285 req-87b980ad-9d43-4cd3-a80d-f8b1e72246bc tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Request body: {'port': {'security_groups': ['8be97727-1a22-4860-9a0f-16feb2050988', 'a4d7d697-bf15-4548-8c1e-4ee6fc573110']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:10:02.088615 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5a9a8c66-b27f-4507-9eb5-88774c2f2285 req-87b980ad-9d43-4cd3-a80d-f8b1e72246bc tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:02.382133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-5a9a8c66-b27f-4507-9eb5-88774c2f2285 req-87b980ad-9d43-4cd3-a80d-f8b1e72246bc tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] For port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,segment=NetworkSegment(49989138-c9c5-4f43-9f26-c28f48284359),segment_id=49989138-c9c5-4f43-9f26-c28f48284359)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:10:02.407721 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5a9a8c66-b27f-4507-9eb5-88774c2f2285 req-87b980ad-9d43-4cd3-a80d-f8b1e72246bc tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:02.414126 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5a9a8c66-b27f-4507-9eb5-88774c2f2285 req-87b980ad-9d43-4cd3-a80d-f8b1e72246bc tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:02.449311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['6321215f-8a2d-4b14-81a3-ec47dcbc0e95'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:10:02.491982 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a9a8c66-b27f-4507-9eb5-88774c2f2285 req-87b980ad-9d43-4cd3-a80d-f8b1e72246bc tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:02.492624 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-5a9a8c66-b27f-4507-9eb5-88774c2f2285 req-87b980ad-9d43-4cd3-a80d-f8b1e72246bc tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:02.497431 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a9a8c66-b27f-4507-9eb5-88774c2f2285 req-87b980ad-9d43-4cd3-a80d-f8b1e72246bc tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "PUT /v2.0/ports/6321215f-8a2d-4b14-81a3-ec47dcbc0e95 HTTP/1.1" status: 200 len: 982 time: 0.5425286 May 12 16:10:02.497431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'tag': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:10:02.520944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87b980ad-9d43-4cd3-a80d-f8b1e72246bc tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event updated for resources: {'Port': ['ID=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,revision_number=6']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:10:02.559225 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-89d0bd90-7496-4d52-bb83-ef3f520755bb'] response: {'name': 'network-changed', 'server_uuid': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'tag': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95', 'status': 'completed', 'code': 200} May 12 16:10:02.618897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['6321215f-8a2d-4b14-81a3-ec47dcbc0e95'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:10:02.704591 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab5cbae-61d2-41d8-8b3c-a74ac08e02a5 req-f02536d9-bfc6-4bb4-8fe0-4dd13830bc90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:02.706798 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5ab5cbae-61d2-41d8-8b3c-a74ac08e02a5 req-f02536d9-bfc6-4bb4-8fe0-4dd13830bc90 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=01848e54c5dd4735962a6a10c4c0537b&device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 1136 time: 0.0979633 May 12 16:10:02.717413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99bd85e8-2d9c-4109-9b25-a1277748a95b req-8d08bcc2-295d-44a5-ab35-afc339948afd tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:02.719252 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99bd85e8-2d9c-4109-9b25-a1277748a95b req-8d08bcc2-295d-44a5-ab35-afc339948afd tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0935838 May 12 16:10:02.776012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99bd85e8-2d9c-4109-9b25-a1277748a95b req-f4cf5ee8-1cf1-4b23-bd8e-06137ab370b3 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0501215 May 12 16:10:02.837881 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f8fd0a95-3254-410a-9a70-0eef54dd7089 None None] Provisioning complete for port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:10:02.838402 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f8fd0a95-3254-410a-9a70-0eef54dd7089 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:02.862529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab5cbae-61d2-41d8-8b3c-a74ac08e02a5 req-7c30f142-777e-40a7-a7f2-b131c435abbf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:02.864860 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5ab5cbae-61d2-41d8-8b3c-a74ac08e02a5 req-7c30f142-777e-40a7-a7f2-b131c435abbf service neutron] 10.222.0.84 "GET /v2.0/networks?id=5418b7a4-7287-44ab-80e4-b891f73479fd HTTP/1.1" status: 200 len: 915 time: 0.1486568 May 12 16:10:02.963377 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:03.118767 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5ab5cbae-61d2-41d8-8b3c-a74ac08e02a5 req-ef04564a-21de-48e4-bb81-271be6227702 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95 HTTP/1.1" status: 200 len: 1001 time: 0.2470360 May 12 16:10:03.188376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab5cbae-61d2-41d8-8b3c-a74ac08e02a5 req-37aced3b-c843-4d7a-aa18-0a8b807c2003 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:03.189844 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5ab5cbae-61d2-41d8-8b3c-a74ac08e02a5 req-37aced3b-c843-4d7a-aa18-0a8b807c2003 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4a05f8bc-f6c5-48f5-908e-08f8d89e9171 HTTP/1.1" status: 200 len: 853 time: 0.0653677 May 12 16:10:03.270496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab5cbae-61d2-41d8-8b3c-a74ac08e02a5 req-c44113d5-38ff-4f41-8c65-59d8fa0f8363 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:03.271991 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5ab5cbae-61d2-41d8-8b3c-a74ac08e02a5 req-c44113d5-38ff-4f41-8c65-59d8fa0f8363 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5418b7a4-7287-44ab-80e4-b891f73479fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0753953 May 12 16:10:03.427539 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5ab5cbae-61d2-41d8-8b3c-a74ac08e02a5 req-7b28801e-4138-4993-94b4-e78b34971521 service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1473737 May 12 16:10:03.593780 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5ab5cbae-61d2-41d8-8b3c-a74ac08e02a5 req-f85cbf4f-e15e-4f4d-8a0d-8bc3a8c7fa66 service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1618569 May 12 16:10:12.864289 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b109d5ba-d772-49e1-8334-54fdb07c7ac6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:13.688535 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:15.390080 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d45050c9-8444-4b71-a574-79e4e669937d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:16.118586 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:16.389883 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:17.859464 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:25.812377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb9a263f-7b35-461a-bc71-ddf9f1bab4a1 req-b1b42011-3c71-4751-aed8-673119e02b20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:25.813890 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bb9a263f-7b35-461a-bc71-ddf9f1bab4a1 req-b1b42011-3c71-4751-aed8-673119e02b20 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=01848e54c5dd4735962a6a10c4c0537b&device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 1136 time: 0.0756845 May 12 16:10:25.836624 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5cb0184-f4e7-4177-b754-69b082d942ef req-47fd1fcb-a914-41d8-a56b-40304315e27d tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:25.838110 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5cb0184-f4e7-4177-b754-69b082d942ef req-47fd1fcb-a914-41d8-a56b-40304315e27d tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0884643 May 12 16:10:25.890004 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e5cb0184-f4e7-4177-b754-69b082d942ef req-dc6d06d4-3821-4375-9a35-022526882946 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0458233 May 12 16:10:25.956586 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb9a263f-7b35-461a-bc71-ddf9f1bab4a1 req-d76d15c1-0817-4264-aa6c-62888ee39867 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:25.958091 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bb9a263f-7b35-461a-bc71-ddf9f1bab4a1 req-d76d15c1-0817-4264-aa6c-62888ee39867 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5418b7a4-7287-44ab-80e4-b891f73479fd HTTP/1.1" status: 200 len: 915 time: 0.1372862 May 12 16:10:26.076471 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bb9a263f-7b35-461a-bc71-ddf9f1bab4a1 req-da1e96fc-b42f-4fcf-9eda-3f8056978e26 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95 HTTP/1.1" status: 200 len: 1001 time: 0.1115177 May 12 16:10:26.151307 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb9a263f-7b35-461a-bc71-ddf9f1bab4a1 req-c9fb5f55-53ee-44f1-b4a1-a0a64fb0221c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:26.152824 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bb9a263f-7b35-461a-bc71-ddf9f1bab4a1 req-c9fb5f55-53ee-44f1-b4a1-a0a64fb0221c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4a05f8bc-f6c5-48f5-908e-08f8d89e9171 HTTP/1.1" status: 200 len: 853 time: 0.0695498 May 12 16:10:26.232510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb9a263f-7b35-461a-bc71-ddf9f1bab4a1 req-c3464792-bfeb-4124-9597-141776efea39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:26.234029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bb9a263f-7b35-461a-bc71-ddf9f1bab4a1 req-c3464792-bfeb-4124-9597-141776efea39 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5418b7a4-7287-44ab-80e4-b891f73479fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0746512 May 12 16:10:26.373964 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bb9a263f-7b35-461a-bc71-ddf9f1bab4a1 req-e113cc00-d843-4597-9de6-20e4ece415b7 service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1326559 May 12 16:10:26.521495 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bb9a263f-7b35-461a-bc71-ddf9f1bab4a1 req-a1fd7204-bb54-467d-afcb-9f183cbe1e1d service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1406667 May 12 16:10:27.080258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f5d84c-454b-4260-a0e3-2ca4e01ea92e req-17ea7fd5-6dc7-4ca2-a966-6d2d87461908 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:27.081824 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1f5d84c-454b-4260-a0e3-2ca4e01ea92e req-17ea7fd5-6dc7-4ca2-a966-6d2d87461908 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0815399 May 12 16:10:27.130291 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d1f5d84c-454b-4260-a0e3-2ca4e01ea92e req-7db0af4a-8bbb-49d4-8308-21d4365f7f27 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0423825 May 12 16:10:28.320057 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-108db5a9-b102-4c43-a854-1b9ac083c829 req-4703d2b8-eb5d-4aec-94b8-f33cac9631e1 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:28.321549 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-108db5a9-b102-4c43-a854-1b9ac083c829 req-4703d2b8-eb5d-4aec-94b8-f33cac9631e1 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0860593 May 12 16:10:28.369010 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-108db5a9-b102-4c43-a854-1b9ac083c829 req-a77d3a93-edaa-4941-8941-b8164decce15 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0416803 May 12 16:10:29.274696 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-905b6ae3-9580-40f0-9e53-c9afe2c44836 req-25293f56-6205-4a70-999f-98b4d884a943 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0403259 May 12 16:10:29.389803 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-905b6ae3-9580-40f0-9e53-c9afe2c44836 req-29077451-1b41-4156-8e48-6ce262d08d5d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0449340 May 12 16:10:29.440020 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-905b6ae3-9580-40f0-9e53-c9afe2c44836 req-0c636a49-3722-4fd8-b183-4fce25e95962 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0260394 May 12 16:10:29.566301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a31fedab-8d9e-47aa-8c91-db6731d19853 req-1d00206b-f5f4-438d-a9a5-8f514b0d8537 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:29.567952 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a31fedab-8d9e-47aa-8c91-db6731d19853 req-1d00206b-f5f4-438d-a9a5-8f514b0d8537 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0856659 May 12 16:10:29.583975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-905b6ae3-9580-40f0-9e53-c9afe2c44836 req-344b85db-beea-4565-aba4-785bb7359380 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:29.585502 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-905b6ae3-9580-40f0-9e53-c9afe2c44836 req-344b85db-beea-4565-aba4-785bb7359380 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1390216 May 12 16:10:29.630557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a31fedab-8d9e-47aa-8c91-db6731d19853 req-967c6413-f509-4c12-bc0b-8c1d800f8abb tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0559599 May 12 16:10:30.825993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48fd227d-829e-4ed2-a1cc-904bb99825aa req-33dcd0dc-14ab-41ef-bcfc-a6a41b320f76 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:30.827461 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48fd227d-829e-4ed2-a1cc-904bb99825aa req-33dcd0dc-14ab-41ef-bcfc-a6a41b320f76 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0913529 May 12 16:10:30.874515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-48fd227d-829e-4ed2-a1cc-904bb99825aa req-131e4b44-4d0b-4e99-982a-deb4531b2520 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0413160 May 12 16:10:32.075886 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46bf5fd5-4608-4d53-90be-61586f538b1a req-f045dd08-3076-41c0-b9d7-12cb628d440a tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:32.077449 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46bf5fd5-4608-4d53-90be-61586f538b1a req-f045dd08-3076-41c0-b9d7-12cb628d440a tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0962284 May 12 16:10:32.124337 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-46bf5fd5-4608-4d53-90be-61586f538b1a req-6e044d0c-f77b-490c-9541-34f89d4239bf tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0411243 May 12 16:10:32.890173 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:33.315250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d7c9608-eb78-4bd0-a0f5-060dd88ad457 req-f8aa72ef-f87a-4210-a43b-25c9db32f949 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:33.316699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d7c9608-eb78-4bd0-a0f5-060dd88ad457 req-f8aa72ef-f87a-4210-a43b-25c9db32f949 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0835056 May 12 16:10:33.363477 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d7c9608-eb78-4bd0-a0f5-060dd88ad457 req-0dabd1fe-1f8f-47ae-9a30-98642a97d70f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0404146 May 12 16:10:33.966189 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:10:34.554314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89017894-f51f-4759-89ff-6cee7a7a1a79 req-4a4c2934-d37a-4c09-b39e-d919d4779fe9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:34.555802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89017894-f51f-4759-89ff-6cee7a7a1a79 req-4a4c2934-d37a-4c09-b39e-d919d4779fe9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0863092 May 12 16:10:34.606323 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89017894-f51f-4759-89ff-6cee7a7a1a79 req-90dccc4e-03fc-4782-9c74-055f8ded545a tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0446274 May 12 16:10:35.790849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-882bb311-b7e4-46e2-a90b-9b070409f2ad req-eebc70c7-04e4-4a35-88fb-efbab1eafbad tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:35.792296 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-882bb311-b7e4-46e2-a90b-9b070409f2ad req-eebc70c7-04e4-4a35-88fb-efbab1eafbad tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0805283 May 12 16:10:35.846486 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-882bb311-b7e4-46e2-a90b-9b070409f2ad req-05fcdc46-438b-4ed7-9fd3-d564a99fe0d8 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0484281 May 12 16:10:37.037141 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0b6d43b-f545-4f5c-8259-ba2160104462 req-1bd17e19-0e25-4779-bb92-1a518f19c684 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:37.039438 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0b6d43b-f545-4f5c-8259-ba2160104462 req-1bd17e19-0e25-4779-bb92-1a518f19c684 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0820377 May 12 16:10:37.087053 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0b6d43b-f545-4f5c-8259-ba2160104462 req-8513e8f4-b425-4b6a-980b-4d4f57f6f051 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0414429 May 12 16:10:38.301865 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69279a79-ba38-4554-b2e1-382f31cc0f7e req-97b3dfb7-7929-4f7f-a194-060946d81f4a tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:38.303393 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69279a79-ba38-4554-b2e1-382f31cc0f7e req-97b3dfb7-7929-4f7f-a194-060946d81f4a tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0847368 May 12 16:10:38.348844 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-69279a79-ba38-4554-b2e1-382f31cc0f7e req-02e22c22-6ad7-4d6a-92d1-5d00492898d9 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0397508 May 12 16:10:39.537078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aef8313e-7178-4a78-85bc-fcbb3a1e9f7e req-a6a1bd2a-57b1-47c9-b321-96b70f0626fe tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:39.539314 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aef8313e-7178-4a78-85bc-fcbb3a1e9f7e req-a6a1bd2a-57b1-47c9-b321-96b70f0626fe tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0855744 May 12 16:10:39.589575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aef8313e-7178-4a78-85bc-fcbb3a1e9f7e req-834e1251-a17b-421b-bba1-991dec23f73c tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0443304 May 12 16:10:40.897494 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e43d85-a060-4481-ba89-70913d3a7b43 req-42e039d8-180f-4896-9ccc-5c5d1be1d5f2 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:40.898901 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13e43d85-a060-4481-ba89-70913d3a7b43 req-42e039d8-180f-4896-9ccc-5c5d1be1d5f2 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.1959379 May 12 16:10:40.945735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13e43d85-a060-4481-ba89-70913d3a7b43 req-bc032ba4-4b27-4aa8-b896-32ca4b2774fd tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0408020 May 12 16:10:42.143676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9153f6b-30ed-4108-8e94-791e6771d03b req-82c4e0d2-a62c-4848-94f8-16633b176a6f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:42.145139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9153f6b-30ed-4108-8e94-791e6771d03b req-82c4e0d2-a62c-4848-94f8-16633b176a6f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0914974 May 12 16:10:42.196341 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9153f6b-30ed-4108-8e94-791e6771d03b req-3d53852f-347c-40a4-b18a-68d15a06b862 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0445924 May 12 16:10:42.861408 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5546a934-4f96-412f-98f1-0b513cb94dc0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:43.396413 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bbb7503-b5b0-4d4f-9bfd-a3f2d975b236 req-db33bdfd-7b8d-4593-a773-e766d2226085 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:43.398174 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bbb7503-b5b0-4d4f-9bfd-a3f2d975b236 req-db33bdfd-7b8d-4593-a773-e766d2226085 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0821352 May 12 16:10:43.445513 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bbb7503-b5b0-4d4f-9bfd-a3f2d975b236 req-a02e16b7-36b2-49d0-ae59-3d3f16529daa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=a4d7d697-bf15-4548-8c1e-4ee6fc573110&id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0415525 May 12 16:10:43.710221 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:45.394948 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-30c2625c-1df1-4e74-b77d-df5031649114 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:46.112185 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:46.393065 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:47.861721 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:10:56.011940 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29cc2476-04f5-4e30-bb69-31a666ddc672 req-757f2115-bf92-4586-b83f-5b5a9cfb19be service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0699344 May 12 16:10:56.183986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29cc2476-04f5-4e30-bb69-31a666ddc672 req-68bf6f44-bfbf-4a8f-82e1-73717f676331 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:56.185478 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29cc2476-04f5-4e30-bb69-31a666ddc672 req-68bf6f44-bfbf-4a8f-82e1-73717f676331 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=01848e54c5dd4735962a6a10c4c0537b&device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 1136 time: 0.0780513 May 12 16:10:56.457149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29cc2476-04f5-4e30-bb69-31a666ddc672 req-d068c032-5bd7-454c-a034-ad4bc9689706 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:56.459095 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29cc2476-04f5-4e30-bb69-31a666ddc672 req-d068c032-5bd7-454c-a034-ad4bc9689706 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5418b7a4-7287-44ab-80e4-b891f73479fd HTTP/1.1" status: 200 len: 915 time: 0.2512398 May 12 16:10:56.569484 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29cc2476-04f5-4e30-bb69-31a666ddc672 req-d391ed2c-8dd5-49fc-8947-fb08cb73092c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95 HTTP/1.1" status: 200 len: 1001 time: 0.1041932 May 12 16:10:56.635479 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29cc2476-04f5-4e30-bb69-31a666ddc672 req-9c1af30f-fac2-4466-8578-b8db04b75480 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:56.636950 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29cc2476-04f5-4e30-bb69-31a666ddc672 req-9c1af30f-fac2-4466-8578-b8db04b75480 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4a05f8bc-f6c5-48f5-908e-08f8d89e9171 HTTP/1.1" status: 200 len: 853 time: 0.0619950 May 12 16:10:56.716796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29cc2476-04f5-4e30-bb69-31a666ddc672 req-62f3cdc9-97c2-4b9b-8647-26cdede78fed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:10:56.718325 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29cc2476-04f5-4e30-bb69-31a666ddc672 req-62f3cdc9-97c2-4b9b-8647-26cdede78fed service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5418b7a4-7287-44ab-80e4-b891f73479fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0757780 May 12 16:10:56.857292 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29cc2476-04f5-4e30-bb69-31a666ddc672 req-d3454e86-cfc1-4b40-be45-30bf602ce008 service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1328158 May 12 16:10:56.995649 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-29cc2476-04f5-4e30-bb69-31a666ddc672 req-66316c81-be8d-4b0b-80fd-8d1ae3ccfd42 service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1324458 May 12 16:11:02.898410 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:10.964945 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:11:12.854187 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-555259ec-0b77-457e-80c3-bcb20202aa23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:13.702075 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:15.388149 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e7dde59a-3e2f-4df1-aa1a-5306ca87de49 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:15.940906 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-333b08d0-080d-4206-a195-68f1c93d17b7 req-927b43a5-fa38-4b17-b844-cd2c56ca1eb8 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-546785071&fields=id&tenant_id=01848e54c5dd4735962a6a10c4c0537b HTTP/1.1" status: 200 len: 267 time: 0.0388970 May 12 16:11:16.029574 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333b08d0-080d-4206-a195-68f1c93d17b7 req-5a98b20d-70d8-4fab-a39b-63d97d1cf670 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:16.031013 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-333b08d0-080d-4206-a195-68f1c93d17b7 req-5a98b20d-70d8-4fab-a39b-63d97d1cf670 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 985 time: 0.0834112 May 12 16:11:16.041748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [req-333b08d0-080d-4206-a195-68f1c93d17b7 req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Request body: {'port': {'security_groups': ['8be97727-1a22-4860-9a0f-16feb2050988']}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:11:16.115288 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:16.167258 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-333b08d0-080d-4206-a195-68f1c93d17b7 req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:16.394815 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:16.418622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [req-333b08d0-080d-4206-a195-68f1c93d17b7 req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] For port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,segment=NetworkSegment(49989138-c9c5-4f43-9f26-c28f48284359),segment_id=49989138-c9c5-4f43-9f26-c28f48284359)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:16.443377 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-333b08d0-080d-4206-a195-68f1c93d17b7 req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:16.448462 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-333b08d0-080d-4206-a195-68f1c93d17b7 req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:16.484052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['6321215f-8a2d-4b14-81a3-ec47dcbc0e95'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:11:16.531332 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333b08d0-080d-4206-a195-68f1c93d17b7 req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:16.531966 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [req-333b08d0-080d-4206-a195-68f1c93d17b7 req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:16.533337 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-333b08d0-080d-4206-a195-68f1c93d17b7 req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "PUT /v2.0/ports/6321215f-8a2d-4b14-81a3-ec47dcbc0e95 HTTP/1.1" status: 200 len: 943 time: 0.4960892 May 12 16:11:16.537445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'tag': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:11:16.540691 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 54934) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:16.552102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event updated for resources: {'Port': ['ID=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,revision_number=7']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:16.560804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.561140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.561485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.561810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.562127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.562437 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.562745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.563052 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.563590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.563906 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.564213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.564515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7728c44-8115-45a4-aee8-f61b447cf0de tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.594228 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-13289fa8-a16c-4c0a-a39e-b0a01360679f'] response: {'name': 'network-changed', 'server_uuid': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'tag': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95', 'status': 'completed', 'code': 200} May 12 16:11:16.671796 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['6321215f-8a2d-4b14-81a3-ec47dcbc0e95'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:11:16.684050 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:16.731105 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:16.791334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcd6721e-9f06-48c6-beda-101fb26d2fce req-9e757206-94c9-41ec-b0c3-2fd36510b5ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:16.792765 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dcd6721e-9f06-48c6-beda-101fb26d2fce req-9e757206-94c9-41ec-b0c3-2fd36510b5ff service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=01848e54c5dd4735962a6a10c4c0537b&device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 1097 time: 0.1468556 May 12 16:11:16.870539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-de3278ba-91c0-4a32-93f7-b8560e150c8a None None] Provisioning complete for port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:11:16.870912 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-de3278ba-91c0-4a32-93f7-b8560e150c8a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:16.891428 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:16.914678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4d7d697-bf15-4548-8c1e-4ee6fc573110,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:16.945034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.945377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.946351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.946759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.947273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.947599 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.947912 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.948230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.948546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.948855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.949169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.949507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:16.956349 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:16.960063 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0c0a65e8-5060-425c-b5d9-ed7e5f0b42fa tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "DELETE /v2.0/security-groups/a4d7d697-bf15-4548-8c1e-4ee6fc573110 HTTP/1.1" status: 204 len: 168 time: 0.4149160 May 12 16:11:16.960498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 54940) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:16.975216 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcd6721e-9f06-48c6-beda-101fb26d2fce req-3e62f1cd-1849-4156-8341-c6707cc6e576 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:16.977660 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dcd6721e-9f06-48c6-beda-101fb26d2fce req-3e62f1cd-1849-4156-8341-c6707cc6e576 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5418b7a4-7287-44ab-80e4-b891f73479fd HTTP/1.1" status: 200 len: 915 time: 0.1773520 May 12 16:11:17.096335 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dcd6721e-9f06-48c6-beda-101fb26d2fce req-23c566aa-a92d-49fd-a84e-c2ed3b6afa5a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95 HTTP/1.1" status: 200 len: 1001 time: 0.1126218 May 12 16:11:17.167420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcd6721e-9f06-48c6-beda-101fb26d2fce req-bdce90db-f5b8-4b7e-adce-fcf4543b625a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:17.168928 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dcd6721e-9f06-48c6-beda-101fb26d2fce req-bdce90db-f5b8-4b7e-adce-fcf4543b625a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4a05f8bc-f6c5-48f5-908e-08f8d89e9171 HTTP/1.1" status: 200 len: 853 time: 0.0649178 May 12 16:11:17.186226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-f2df6e59-4544-4e73-ba7d-d3e6093d0e60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Deleting port d35a1d8c-72d1-4681-b942-07cedb4a78f4 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:11:17.186564 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f2df6e59-4544-4e73-ba7d-d3e6093d0e60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:17.248927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcd6721e-9f06-48c6-beda-101fb26d2fce req-c151357e-bf5b-4d14-aa57-a6d4167f667d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:17.250532 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dcd6721e-9f06-48c6-beda-101fb26d2fce req-c151357e-bf5b-4d14-aa57-a6d4167f667d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5418b7a4-7287-44ab-80e4-b891f73479fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0744517 May 12 16:11:17.361675 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f2df6e59-4544-4e73-ba7d-d3e6093d0e60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:17.362162 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f2df6e59-4544-4e73-ba7d-d3e6093d0e60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:17.386441 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dcd6721e-9f06-48c6-beda-101fb26d2fce req-18c915f9-fdbc-4919-bcd2-97465a15b1ed service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1294765 May 12 16:11:17.490375 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-f2df6e59-4544-4e73-ba7d-d3e6093d0e60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Calling delete_port for d35a1d8c-72d1-4681-b942-07cedb4a78f4 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:11:17.523651 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-dcd6721e-9f06-48c6-beda-101fb26d2fce req-cf91da5f-c2a3-4790-a33f-86aabdf3b736 service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1308808 May 12 16:11:17.648286 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f2df6e59-4544-4e73-ba7d-d3e6093d0e60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:17.724851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2df6e59-4544-4e73-ba7d-d3e6093d0e60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event deleted for resources: {'Port': ['ID=d35a1d8c-72d1-4681-b942-07cedb4a78f4,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:17.863703 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:17.895349 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f2df6e59-4544-4e73-ba7d-d3e6093d0e60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:17.895647 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-f2df6e59-4544-4e73-ba7d-d3e6093d0e60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Floating IP e14c6ca5-23db-40ce-8370-88cd06040a41 disassociated (deleted). External IP: 172.25.8.98, port: 6321215f-8a2d-4b14-81a3-ec47dcbc0e95. May 12 16:11:18.262346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f2df6e59-4544-4e73-ba7d-d3e6093d0e60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Router ca249da1-5465-47ee-9400-a9beaa61f6ca has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:11:18.440083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f2df6e59-4544-4e73-ba7d-d3e6093d0e60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:11:18.450993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f46f041-aa4e-43c5-b51e-61803bc1615e None None] Sync routers for ids ['ca249da1-5465-47ee-9400-a9beaa61f6ca'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:11:18.453194 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f2df6e59-4544-4e73-ba7d-d3e6093d0e60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:18.460898 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f46f041-aa4e-43c5-b51e-61803bc1615e None None] Routers {'ca249da1-5465-47ee-9400-a9beaa61f6ca'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:11:18.462142 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5f46f041-aa4e-43c5-b51e-61803bc1615e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ca249da1-5465-47ee-9400-a9beaa61f6ca'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:18.512947 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f2df6e59-4544-4e73-ba7d-d3e6093d0e60 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "DELETE /v2.0/floatingips/e14c6ca5-23db-40ce-8370-88cd06040a41 HTTP/1.1" status: 204 len: 168 time: 1.5504498 May 12 16:11:18.595167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'tag': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:11:18.644355 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e5370156-94ba-4479-ac4e-6e005c179eb9'] response: {'name': 'network-changed', 'server_uuid': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'tag': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95', 'status': 'completed', 'code': 200} May 12 16:11:18.658341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-5f46f041-aa4e-43c5-b51e-61803bc1615e None None] Set router ca249da1-5465-47ee-9400-a9beaa61f6ca gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:11:18.778205 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23bb3111-dd14-4137-b15c-b5d87c775670 req-3e64dd2b-91f7-44eb-beca-2fdbd0bd0a02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:18.779725 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-23bb3111-dd14-4137-b15c-b5d87c775670 req-3e64dd2b-91f7-44eb-beca-2fdbd0bd0a02 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=01848e54c5dd4735962a6a10c4c0537b&device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 1097 time: 0.0854006 May 12 16:11:18.968852 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23bb3111-dd14-4137-b15c-b5d87c775670 req-27c6aa6a-edd2-45fb-9272-b1e0ad273923 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:18.970320 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-23bb3111-dd14-4137-b15c-b5d87c775670 req-27c6aa6a-edd2-45fb-9272-b1e0ad273923 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5418b7a4-7287-44ab-80e4-b891f73479fd HTTP/1.1" status: 200 len: 915 time: 0.1811957 May 12 16:11:19.019450 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5f46f041-aa4e-43c5-b51e-61803bc1615e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135'}], 'enable_snat': True}, 'gw_port_id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 4, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port': {'id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:b3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4240, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:05Z', 'updated_at': '2022-05-12T16:09:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0d16c794-8ac1-4494-8dc6-1ab21c3d77d3', 'name': '', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'mac_address': 'fa:16:3e:1b:bc:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 4241, 'fixed_ips': [{'subnet_id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:08Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 5, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'subnets': [{'id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:19.023842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f46f041-aa4e-43c5-b51e-61803bc1615e None None] Checking router: ca249da1-5465-47ee-9400-a9beaa61f6ca for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:11:19.033797 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f46f041-aa4e-43c5-b51e-61803bc1615e None None] Routers {'ca249da1-5465-47ee-9400-a9beaa61f6ca'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:11:19.034543 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5f46f041-aa4e-43c5-b51e-61803bc1615e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ca249da1-5465-47ee-9400-a9beaa61f6ca'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:19.048914 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-23bb3111-dd14-4137-b15c-b5d87c775670 req-25b14ffc-3192-41b4-bff3-81848da37de1 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95 HTTP/1.1" status: 200 len: 217 time: 0.0711815 May 12 16:11:19.222670 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-5f46f041-aa4e-43c5-b51e-61803bc1615e None None] Set router ca249da1-5465-47ee-9400-a9beaa61f6ca gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:11:19.234334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23bb3111-dd14-4137-b15c-b5d87c775670 req-f97d1022-ece6-4c60-ba8e-b1ab431cf2bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:19.235819 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-23bb3111-dd14-4137-b15c-b5d87c775670 req-f97d1022-ece6-4c60-ba8e-b1ab431cf2bc service neutron] 10.222.0.84 "GET /v2.0/subnets?id=4a05f8bc-f6c5-48f5-908e-08f8d89e9171 HTTP/1.1" status: 200 len: 853 time: 0.1791482 May 12 16:11:19.312149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23bb3111-dd14-4137-b15c-b5d87c775670 req-eececf9f-c9dd-4cda-adae-8886ef2f6425 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:19.313631 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-23bb3111-dd14-4137-b15c-b5d87c775670 req-eececf9f-c9dd-4cda-adae-8886ef2f6425 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5418b7a4-7287-44ab-80e4-b891f73479fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0714107 May 12 16:11:19.448815 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-23bb3111-dd14-4137-b15c-b5d87c775670 req-35b15439-88f4-4ac7-acb4-a0d3a55e7e1b service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1261237 May 12 16:11:19.542188 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-5f46f041-aa4e-43c5-b51e-61803bc1615e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135'}], 'enable_snat': True}, 'gw_port_id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 4, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port': {'id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:b3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4240, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:05Z', 'updated_at': '2022-05-12T16:09:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0d16c794-8ac1-4494-8dc6-1ab21c3d77d3', 'name': '', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'mac_address': 'fa:16:3e:1b:bc:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 4241, 'fixed_ips': [{'subnet_id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:08Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 5, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'subnets': [{'id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:19.546262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f46f041-aa4e-43c5-b51e-61803bc1615e None None] The sync data for ids ['ca249da1-5465-47ee-9400-a9beaa61f6ca'] in n-d-841483-1 is: [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135'}], 'enable_snat': True}, 'gw_port_id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:09:08Z', 'revision_number': 4, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port': {'id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:b3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4240, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:05Z', 'updated_at': '2022-05-12T16:09:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '0d16c794-8ac1-4494-8dc6-1ab21c3d77d3', 'name': '', 'network_id': '5418b7a4-7287-44ab-80e4-b891f73479fd', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'mac_address': 'fa:16:3e:1b:bc:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 4241, 'fixed_ips': [{'subnet_id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:08Z', 'updated_at': '2022-05-12T16:09:15Z', 'revision_number': 5, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'subnets': [{'id': '4a05f8bc-f6c5-48f5-908e-08f8d89e9171', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:11:19.588410 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-23bb3111-dd14-4137-b15c-b5d87c775670 req-7216783e-c029-4da1-bea1-915d397df40b service neutron] 10.222.0.84 "GET /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1328030 May 12 16:11:19.782281 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5356ff6-b25d-424a-8be4-414afafbc72c None None] New status for floating IP e14c6ca5-23db-40ce-8370-88cd06040a41: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:11:23.970871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a96eeb0e-b881-4f28-86fb-653a32bc0bbe req-420ee60e-04be-4045-bf25-16d5b0691ac2 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:23.971547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a96eeb0e-b881-4f28-86fb-653a32bc0bbe req-420ee60e-04be-4045-bf25-16d5b0691ac2 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Synchronizing usage tracker for tenant:01848e54c5dd4735962a6a10c4c0537b on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:11:23.989168 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-a96eeb0e-b881-4f28-86fb-653a32bc0bbe req-420ee60e-04be-4045-bf25-16d5b0691ac2 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Unset dirty status for tenant:01848e54c5dd4735962a6a10c4c0537b on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:11:23.990369 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a96eeb0e-b881-4f28-86fb-653a32bc0bbe req-420ee60e-04be-4045-bf25-16d5b0691ac2 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 946 time: 0.1016545 May 12 16:11:24.036661 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a96eeb0e-b881-4f28-86fb-653a32bc0bbe req-90c3c1c8-0f73-400e-b496-2c2719d13e0f tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398905 May 12 16:11:25.232701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf67985e-de66-4019-8d93-8358b545fbf8 req-9cbabdda-7a01-4d5a-be03-72d19a1c62cd tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:25.234253 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cf67985e-de66-4019-8d93-8358b545fbf8 req-9cbabdda-7a01-4d5a-be03-72d19a1c62cd tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 946 time: 0.0852787 May 12 16:11:25.279219 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cf67985e-de66-4019-8d93-8358b545fbf8 req-cfd59bcc-7653-47bf-b989-ad01b9750c32 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390198 May 12 16:11:25.932594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6cbb75c-e477-4762-a26b-209eb6509116 req-849eeb72-d587-401f-b7fe-27acfc5ceed1 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:25.933285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d6cbb75c-e477-4762-a26b-209eb6509116 req-849eeb72-d587-401f-b7fe-27acfc5ceed1 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Synchronizing usage tracker for tenant:01848e54c5dd4735962a6a10c4c0537b on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:11:25.945323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-d6cbb75c-e477-4762-a26b-209eb6509116 req-849eeb72-d587-401f-b7fe-27acfc5ceed1 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Unset dirty status for tenant:01848e54c5dd4735962a6a10c4c0537b on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:11:25.947024 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6cbb75c-e477-4762-a26b-209eb6509116 req-849eeb72-d587-401f-b7fe-27acfc5ceed1 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.84 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 946 time: 0.0971630 May 12 16:11:26.019735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-d6cbb75c-e477-4762-a26b-209eb6509116 req-bf565f43-6118-48ba-83a8-da0ef95213c7 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Deleting port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:11:26.020074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6cbb75c-e477-4762-a26b-209eb6509116 req-bf565f43-6118-48ba-83a8-da0ef95213c7 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:26.266458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-d6cbb75c-e477-4762-a26b-209eb6509116 req-bf565f43-6118-48ba-83a8-da0ef95213c7 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] For port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,segment=NetworkSegment(49989138-c9c5-4f43-9f26-c28f48284359),segment_id=49989138-c9c5-4f43-9f26-c28f48284359)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:26.266798 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6cbb75c-e477-4762-a26b-209eb6509116 req-bf565f43-6118-48ba-83a8-da0ef95213c7 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:26.394055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-d6cbb75c-e477-4762-a26b-209eb6509116 req-bf565f43-6118-48ba-83a8-da0ef95213c7 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Calling delete_port for 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:11:26.473785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-289a34e2-2a09-4ef6-960b-e219a98d31cd req-c32ebb87-834b-4268-8cae-bb6adb9d5647 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:26.476104 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-289a34e2-2a09-4ef6-960b-e219a98d31cd req-c32ebb87-834b-4268-8cae-bb6adb9d5647 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/ports?device_id=3f4b9d9b-ad7d-476a-92c3-4451c2230baa HTTP/1.1" status: 200 len: 946 time: 0.0825262 May 12 16:11:26.522418 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-289a34e2-2a09-4ef6-960b-e219a98d31cd req-e054483d-56d7-4f98-aa6d-5b43cc38f603 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.82 "GET /v2.0/security-groups?id=8be97727-1a22-4860-9a0f-16feb2050988&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393355 May 12 16:11:26.551430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6cbb75c-e477-4762-a26b-209eb6509116 req-bf565f43-6118-48ba-83a8-da0ef95213c7 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:26.592387 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['6321215f-8a2d-4b14-81a3-ec47dcbc0e95'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:11:26.602093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf565f43-6118-48ba-83a8-da0ef95213c7 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Pushing event deleted for resources: {'Port': ['ID=6321215f-8a2d-4b14-81a3-ec47dcbc0e95,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:26.684175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-d6cbb75c-e477-4762-a26b-209eb6509116 req-bf565f43-6118-48ba-83a8-da0ef95213c7 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] No DVR routers for this DVR port 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:11:26.686587 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-d6cbb75c-e477-4762-a26b-209eb6509116 req-bf565f43-6118-48ba-83a8-da0ef95213c7 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:26.689114 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'name': 'network-vif-deleted', 'tag': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:11:26.705851 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6cbb75c-e477-4762-a26b-209eb6509116 req-bf565f43-6118-48ba-83a8-da0ef95213c7 tempest-TestMinimumBasicScenario-1827303974 tempest-TestMinimumBasicScenario-1827303974-project] 10.222.0.84 "DELETE /v2.0/ports/6321215f-8a2d-4b14-81a3-ec47dcbc0e95 HTTP/1.1" status: 204 len: 173 time: 0.7500045 May 12 16:11:26.738954 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9ca6f669-40e0-406c-9f57-d18fc158499b'] response: {'server_uuid': '3f4b9d9b-ad7d-476a-92c3-4451c2230baa', 'name': 'network-vif-deleted', 'tag': '6321215f-8a2d-4b14-81a3-ec47dcbc0e95', 'status': 'completed', 'code': 200} May 12 16:11:28.171013 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55034) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:28.558511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:11:28.594495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:11:28.594824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 6321215f-8a2d-4b14-81a3-ec47dcbc0e95 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:11:28.841068 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a184194-de1e-4c36-b336-d48f20e48ed6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:29.191368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-7a184194-de1e-4c36-b336-d48f20e48ed6 admin admin] Deleting port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:11:29.192064 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a184194-de1e-4c36-b336-d48f20e48ed6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:29.373023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-7a184194-de1e-4c36-b336-d48f20e48ed6 admin admin] For port 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0d16c794-8ac1-4494-8dc6-1ab21c3d77d3,segment=NetworkSegment(49989138-c9c5-4f43-9f26-c28f48284359),segment_id=49989138-c9c5-4f43-9f26-c28f48284359)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:29.373376 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a184194-de1e-4c36-b336-d48f20e48ed6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:29.502144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-7a184194-de1e-4c36-b336-d48f20e48ed6 admin admin] Calling delete_port for 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:11:29.821725 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a184194-de1e-4c36-b336-d48f20e48ed6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:29.868598 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a184194-de1e-4c36-b336-d48f20e48ed6 admin admin] Pushing event deleted for resources: {'Port': ['ID=0d16c794-8ac1-4494-8dc6-1ab21c3d77d3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:30.245393 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a184194-de1e-4c36-b336-d48f20e48ed6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:30.607782 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7a184194-de1e-4c36-b336-d48f20e48ed6 admin admin] Router ca249da1-5465-47ee-9400-a9beaa61f6ca has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:11:30.789894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a184194-de1e-4c36-b336-d48f20e48ed6 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:11:30.798436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2827a37-43cb-4d05-931d-3ee10efe1b17 None None] Sync routers for ids ['ca249da1-5465-47ee-9400-a9beaa61f6ca'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:11:30.802582 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7a184194-de1e-4c36-b336-d48f20e48ed6 admin admin] 10.222.0.82 "PUT /v2.0/routers/ca249da1-5465-47ee-9400-a9beaa61f6ca/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6304893 May 12 16:11:30.805219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55038) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:30.808028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2827a37-43cb-4d05-931d-3ee10efe1b17 None None] Routers {'ca249da1-5465-47ee-9400-a9beaa61f6ca'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:11:30.808657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e2827a37-43cb-4d05-931d-3ee10efe1b17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ca249da1-5465-47ee-9400-a9beaa61f6ca'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:30.990451 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:31.004000 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-e2827a37-43cb-4d05-931d-3ee10efe1b17 None None] Set router ca249da1-5465-47ee-9400-a9beaa61f6ca gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:11:31.297781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e2827a37-43cb-4d05-931d-3ee10efe1b17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135'}], 'enable_snat': True}, 'gw_port_id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:11:29Z', 'revision_number': 5, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port': {'id': 'f01dfd27-c50e-4f07-ac74-79cd423b1dbe', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:b3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4240, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:05Z', 'updated_at': '2022-05-12T16:09:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:31.301928 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2827a37-43cb-4d05-931d-3ee10efe1b17 None None] Checking router: ca249da1-5465-47ee-9400-a9beaa61f6ca for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:11:31.303196 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9302bc8-782a-473a-b25b-c1b25d8a4f17 req-011ad04b-37d2-4dfa-9e7c-228088d0d6c2 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0656331 May 12 16:11:31.310452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2827a37-43cb-4d05-931d-3ee10efe1b17 None None] Routers {'ca249da1-5465-47ee-9400-a9beaa61f6ca'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:11:31.311052 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e2827a37-43cb-4d05-931d-3ee10efe1b17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['ca249da1-5465-47ee-9400-a9beaa61f6ca'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:31.331703 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:31.342967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] Deleting port f01dfd27-c50e-4f07-ac74-79cd423b1dbe {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:11:31.343285 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:31.431600 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9302bc8-782a-473a-b25b-c1b25d8a4f17 req-31b4dbe9-fb2c-43d2-8d70-9c1e0d8a8472 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0493743 May 12 16:11:31.468453 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-e2827a37-43cb-4d05-931d-3ee10efe1b17 None None] Set router ca249da1-5465-47ee-9400-a9beaa61f6ca gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:11:31.537168 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9302bc8-782a-473a-b25b-c1b25d8a4f17 req-34ccce06-f59f-440e-9723-73174ae25013 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0836380 May 12 16:11:31.578890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e2827a37-43cb-4d05-931d-3ee10efe1b17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:11:31Z', 'revision_number': 6, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:31.583169 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2827a37-43cb-4d05-931d-3ee10efe1b17 None None] The sync data for ids ['ca249da1-5465-47ee-9400-a9beaa61f6ca'] in n-d-841483-1 is: [{'id': 'ca249da1-5465-47ee-9400-a9beaa61f6ca', 'name': 'tempest-TestMinimumBasicScenario-530545337-router', 'tenant_id': '01848e54c5dd4735962a6a10c4c0537b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:04Z', 'updated_at': '2022-05-12T16:11:31Z', 'revision_number': 6, 'project_id': '01848e54c5dd4735962a6a10c4c0537b', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:11:31.704868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] For port f01dfd27-c50e-4f07-ac74-79cd423b1dbe, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f01dfd27-c50e-4f07-ac74-79cd423b1dbe,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:31.705235 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:31.837248 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9302bc8-782a-473a-b25b-c1b25d8a4f17 req-1044f7e1-3c51-48b6-9254-370cd3343c2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:31.838643 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9302bc8-782a-473a-b25b-c1b25d8a4f17 req-1044f7e1-3c51-48b6-9254-370cd3343c2f service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2951658 May 12 16:11:31.845160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] Calling delete_port for f01dfd27-c50e-4f07-ac74-79cd423b1dbe owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:11:32.151743 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:32.199974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] Pushing event deleted for resources: {'Port': ['ID=f01dfd27-c50e-4f07-ac74-79cd423b1dbe,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:32.294844 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:32.447861 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:11:32.470294 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:32.472792 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:32.488140 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:11:32.490551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0d16c794-8ac1-4494-8dc6-1ab21c3d77d3 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:11:32.490551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f01dfd27-c50e-4f07-ac74-79cd423b1dbe no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:11:32.499652 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:32.500232 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] Fanout notify agent at l3_agent the message router_deleted on router ca249da1-5465-47ee-9400-a9beaa61f6ca {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:11:32.518860 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:32.519992 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-af3f99f7-da37-426f-8404-1943132b8a26 admin admin] 10.222.0.82 "DELETE /v2.0/routers/ca249da1-5465-47ee-9400-a9beaa61f6ca HTTP/1.1" status: 204 len: 168 time: 1.7130909 May 12 16:11:32.522512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55042) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:32.534438 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: f01dfd27-c50e-4f07-ac74-79cd423b1dbe {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:11:32.534826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f01dfd27-c50e-4f07-ac74-79cd423b1dbe not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:11:32.713105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-1084091b-ee35-49d4-8612-41ec6845a15f admin admin] Deleting subnet 4a05f8bc-f6c5-48f5-908e-08f8d89e9171 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:11:32.719003 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1084091b-ee35-49d4-8612-41ec6845a15f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:32.770511 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1084091b-ee35-49d4-8612-41ec6845a15f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:32.852352 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1084091b-ee35-49d4-8612-41ec6845a15f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:32.892946 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:32.921691 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1084091b-ee35-49d4-8612-41ec6845a15f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:32.962884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1084091b-ee35-49d4-8612-41ec6845a15f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4a05f8bc-f6c5-48f5-908e-08f8d89e9171,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:32.969260 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1084091b-ee35-49d4-8612-41ec6845a15f admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:32.974402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f957dc1-fb2f-4c7f-9c95-f69a65651155 None None] Network 5418b7a4-7287-44ab-80e4-b891f73479fd requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:11:32.975624 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1084091b-ee35-49d4-8612-41ec6845a15f admin admin] 10.222.0.82 "DELETE /v2.0/subnets/4a05f8bc-f6c5-48f5-908e-08f8d89e9171 HTTP/1.1" status: 204 len: 168 time: 0.4520576 May 12 16:11:32.979367 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55046) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:33.095411 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:33.107603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Deleting port a8c818b1-69b0-46c7-8f65-c4a2b1887350 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:11:33.107990 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:33.239722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e892cf90-e57e-4b30-a306-15ce2a13586f None None] DHCP port deletion for 5418b7a4-7287-44ab-80e4-b891f73479fd request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:11:33.244528 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e892cf90-e57e-4b30-a306-15ce2a13586f None None] Deleting port a8c818b1-69b0-46c7-8f65-c4a2b1887350 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:11:33.244908 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e892cf90-e57e-4b30-a306-15ce2a13586f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:33.339569 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] For port a8c818b1-69b0-46c7-8f65-c4a2b1887350, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a8c818b1-69b0-46c7-8f65-c4a2b1887350,segment=NetworkSegment(49989138-c9c5-4f43-9f26-c28f48284359),segment_id=49989138-c9c5-4f43-9f26-c28f48284359)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:33.339968 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:33.472134 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Calling delete_port for a8c818b1-69b0-46c7-8f65-c4a2b1887350 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:11:33.491713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-e892cf90-e57e-4b30-a306-15ce2a13586f None None] For port a8c818b1-69b0-46c7-8f65-c4a2b1887350, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a8c818b1-69b0-46c7-8f65-c4a2b1887350,segment=NetworkSegment(49989138-c9c5-4f43-9f26-c28f48284359),segment_id=49989138-c9c5-4f43-9f26-c28f48284359)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:33.492466 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e892cf90-e57e-4b30-a306-15ce2a13586f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:33.555462 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:33.602756 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Pushing event deleted for resources: {'Port': ['ID=a8c818b1-69b0-46c7-8f65-c4a2b1887350,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:33.607765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] No DVR routers for this DVR port a8c818b1-69b0-46c7-8f65-c4a2b1887350 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:11:33.613849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e892cf90-e57e-4b30-a306-15ce2a13586f None None] Calling delete_port for a8c818b1-69b0-46c7-8f65-c4a2b1887350 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:11:33.690192 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-e892cf90-e57e-4b30-a306-15ce2a13586f None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:11:33.690533 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-e892cf90-e57e-4b30-a306-15ce2a13586f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:11:33.736368 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:33.761808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5418b7a4-7287-44ab-80e4-b891f73479fd']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:33.774794 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '49989138-c9c5-4f43-9f26-c28f48284359') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:33.775118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '49989138-c9c5-4f43-9f26-c28f48284359') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:33.786308 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:33.806492 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:33.812891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Releasing vlan 596 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:11:33.813348 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: timer() May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:11:33.826874 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:11:33.900700 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:33.906453 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:33.934128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] Pushing event deleted for resources: {'Network': ['ID=5418b7a4-7287-44ab-80e4-b891f73479fd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:33.950634 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fc14d037-3cef-4914-864c-96883d30babc admin admin] 10.222.0.82 "DELETE /v2.0/networks/5418b7a4-7287-44ab-80e4-b891f73479fd HTTP/1.1" status: 204 len: 168 time: 0.9701328 May 12 16:11:33.953298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55050) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:34.191642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e892cf90-e57e-4b30-a306-15ce2a13586f None None] Deleting port a8c818b1-69b0-46c7-8f65-c4a2b1887350 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:11:34.191925 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e892cf90-e57e-4b30-a306-15ce2a13586f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:34.266857 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e892cf90-e57e-4b30-a306-15ce2a13586f None None] The port 'a8c818b1-69b0-46c7-8f65-c4a2b1887350' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 16:11:34.448737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a8c818b1-69b0-46c7-8f65-c4a2b1887350 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:11:34.486384 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: a8c818b1-69b0-46c7-8f65-c4a2b1887350 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:11:34.486718 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a8c818b1-69b0-46c7-8f65-c4a2b1887350 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:11:34.663001 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1532cdfc-0d8e-42ce-9013-960d6d5d572b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:35.033318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1532cdfc-0d8e-42ce-9013-960d6d5d572b admin admin] Deleting port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:11:35.034026 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1532cdfc-0d8e-42ce-9013-960d6d5d572b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:35.219358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-1532cdfc-0d8e-42ce-9013-960d6d5d572b admin admin] For port 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1f8dc9c0-a1d6-43bb-b2a6-0b527613c679,segment=NetworkSegment(7b71a3ab-0865-4974-9436-c674d28f38e2),segment_id=7b71a3ab-0865-4974-9436-c674d28f38e2)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:35.219721 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1532cdfc-0d8e-42ce-9013-960d6d5d572b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:35.346106 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1532cdfc-0d8e-42ce-9013-960d6d5d572b admin admin] Calling delete_port for 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:11:35.533620 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1532cdfc-0d8e-42ce-9013-960d6d5d572b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:35.585375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1532cdfc-0d8e-42ce-9013-960d6d5d572b admin admin] Pushing event deleted for resources: {'Port': ['ID=1f8dc9c0-a1d6-43bb-b2a6-0b527613c679,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:35.857643 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1532cdfc-0d8e-42ce-9013-960d6d5d572b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:36.335636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1532cdfc-0d8e-42ce-9013-960d6d5d572b admin admin] Router 11a25ae7-25ec-4822-af08-27dedb2c0d02 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:11:36.530204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1532cdfc-0d8e-42ce-9013-960d6d5d572b admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:11:36.538841 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa895e87-5cec-4305-8fc1-8bb66ba12fc0 None None] Sync routers for ids ['11a25ae7-25ec-4822-af08-27dedb2c0d02'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:11:36.547377 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1532cdfc-0d8e-42ce-9013-960d6d5d572b admin admin] 10.222.0.82 "PUT /v2.0/routers/11a25ae7-25ec-4822-af08-27dedb2c0d02/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5929704 May 12 16:11:36.549223 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa895e87-5cec-4305-8fc1-8bb66ba12fc0 None None] Routers {'11a25ae7-25ec-4822-af08-27dedb2c0d02'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:11:36.549855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55054) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:36.550068 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-aa895e87-5cec-4305-8fc1-8bb66ba12fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['11a25ae7-25ec-4822-af08-27dedb2c0d02'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:36.733537 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:36.738379 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-aa895e87-5cec-4305-8fc1-8bb66ba12fc0 None None] Set router 11a25ae7-25ec-4822-af08-27dedb2c0d02 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:11:36.910316 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:36.921561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] Deleting port 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:11:36.922006 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:37.075884 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-aa895e87-5cec-4305-8fc1-8bb66ba12fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'name': 'tempest-TestMinimumBasicScenario-1414816353-router', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.61'}], 'enable_snat': True}, 'gw_port_id': '2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:11Z', 'updated_at': '2022-05-12T16:11:35Z', 'revision_number': 5, 'project_id': '0b00c923adb0414f8dca1a3f561259b3', 'gw_port': {'id': '2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:c3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4252, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:09:12Z', 'updated_at': '2022-05-12T16:09:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:37.079672 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa895e87-5cec-4305-8fc1-8bb66ba12fc0 None None] Checking router: 11a25ae7-25ec-4822-af08-27dedb2c0d02 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:11:37.089676 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa895e87-5cec-4305-8fc1-8bb66ba12fc0 None None] Routers {'11a25ae7-25ec-4822-af08-27dedb2c0d02'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:11:37.090272 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-aa895e87-5cec-4305-8fc1-8bb66ba12fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:11:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['11a25ae7-25ec-4822-af08-27dedb2c0d02'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:37.101038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] For port 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:37.101464 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:37.227886 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] Calling delete_port for 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:11:37.258937 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-aa895e87-5cec-4305-8fc1-8bb66ba12fc0 None None] Set router 11a25ae7-25ec-4822-af08-27dedb2c0d02 gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:11:37.371132 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-aa895e87-5cec-4305-8fc1-8bb66ba12fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'name': 'tempest-TestMinimumBasicScenario-1414816353-router', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:11Z', 'updated_at': '2022-05-12T16:11:36Z', 'revision_number': 6, 'project_id': '0b00c923adb0414f8dca1a3f561259b3', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:37.376874 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa895e87-5cec-4305-8fc1-8bb66ba12fc0 None None] The sync data for ids ['11a25ae7-25ec-4822-af08-27dedb2c0d02'] in n-d-841483-1 is: [{'id': '11a25ae7-25ec-4822-af08-27dedb2c0d02', 'name': 'tempest-TestMinimumBasicScenario-1414816353-router', 'tenant_id': '0b00c923adb0414f8dca1a3f561259b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:09:11Z', 'updated_at': '2022-05-12T16:11:36Z', 'revision_number': 6, 'project_id': '0b00c923adb0414f8dca1a3f561259b3', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:11:37.535644 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:37.584664 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] Pushing event deleted for resources: {'Port': ['ID=2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:37.673256 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:37.863854 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:37.866154 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:37.891900 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:37.892550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 11a25ae7-25ec-4822-af08-27dedb2c0d02 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:11:37.906410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:37.907675 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1fddbe12-c7af-483d-a0eb-e16295d11c0f admin admin] 10.222.0.82 "DELETE /v2.0/routers/11a25ae7-25ec-4822-af08-27dedb2c0d02 HTTP/1.1" status: 204 len: 168 time: 1.3568962 May 12 16:11:37.911116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55058) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:37.978315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-7e169a00-e0dc-4bb4-9b0d-b622593a36c8 admin admin] Deleting subnet bbd000c8-70aa-4ba5-9691-a5b6a8da8090 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:11:37.981422 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e169a00-e0dc-4bb4-9b0d-b622593a36c8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:38.032339 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e169a00-e0dc-4bb4-9b0d-b622593a36c8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:38.118890 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e169a00-e0dc-4bb4-9b0d-b622593a36c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:38.197643 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e169a00-e0dc-4bb4-9b0d-b622593a36c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:38.238345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e169a00-e0dc-4bb4-9b0d-b622593a36c8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bbd000c8-70aa-4ba5-9691-a5b6a8da8090,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:38.242681 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7e169a00-e0dc-4bb4-9b0d-b622593a36c8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:38.248903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4c4771a-62f8-4fd8-b724-3691b46ce4de None None] Network dffbc212-a0c7-4790-adc4-3c8839bf23a1 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:11:38.253882 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55064) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:38.254920 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7e169a00-e0dc-4bb4-9b0d-b622593a36c8 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/bbd000c8-70aa-4ba5-9691-a5b6a8da8090 HTTP/1.1" status: 204 len: 168 time: 0.3419185 May 12 16:11:38.370406 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:38.381802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Deleting port 972e244a-be70-42b4-b350-d0c07405857e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:11:38.382280 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:38.465759 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:11:38.509763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:11:38.510093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1f8dc9c0-a1d6-43bb-b2a6-0b527613c679 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:11:38.510493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:11:38.545611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:11:38.545948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2abd1f31-2d28-4b85-aaf0-b7dc467c5b9c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:11:38.615646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f45c186f-68b6-41a8-a4b3-c466771c8260 None None] DHCP port deletion for dffbc212-a0c7-4790-adc4-3c8839bf23a1 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:11:38.621165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f45c186f-68b6-41a8-a4b3-c466771c8260 None None] Deleting port 972e244a-be70-42b4-b350-d0c07405857e {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:11:38.621589 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f45c186f-68b6-41a8-a4b3-c466771c8260 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:38.627478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] For port 972e244a-be70-42b4-b350-d0c07405857e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=972e244a-be70-42b4-b350-d0c07405857e,segment=NetworkSegment(7b71a3ab-0865-4974-9436-c674d28f38e2),segment_id=7b71a3ab-0865-4974-9436-c674d28f38e2)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:38.627984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:38.763644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Calling delete_port for 972e244a-be70-42b4-b350-d0c07405857e owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:11:38.827769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f45c186f-68b6-41a8-a4b3-c466771c8260 None None] For port 972e244a-be70-42b4-b350-d0c07405857e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=972e244a-be70-42b4-b350-d0c07405857e,segment=NetworkSegment(7b71a3ab-0865-4974-9436-c674d28f38e2),segment_id=7b71a3ab-0865-4974-9436-c674d28f38e2)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:38.828342 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f45c186f-68b6-41a8-a4b3-c466771c8260 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:38.841781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:38.894077 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Pushing event deleted for resources: {'Port': ['ID=972e244a-be70-42b4-b350-d0c07405857e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:38.897439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] No DVR routers for this DVR port 972e244a-be70-42b4-b350-d0c07405857e on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:11:38.957071 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f45c186f-68b6-41a8-a4b3-c466771c8260 None None] Calling delete_port for 972e244a-be70-42b4-b350-d0c07405857e owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:11:39.017536 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:39.028820 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-f45c186f-68b6-41a8-a4b3-c466771c8260 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:11:39.029173 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-f45c186f-68b6-41a8-a4b3-c466771c8260 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:11:39.044536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dffbc212-a0c7-4790-adc4-3c8839bf23a1']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:39.056553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7b71a3ab-0865-4974-9436-c674d28f38e2') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:39.056843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7b71a3ab-0865-4974-9436-c674d28f38e2') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:39.067982 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:39.084748 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:39.091507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Releasing vlan 576 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:11:39.091889 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: timer() May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:11:39.105607 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:11:39.182508 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:39.199161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:39.209198 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] Pushing event deleted for resources: {'Network': ['ID=dffbc212-a0c7-4790-adc4-3c8839bf23a1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:39.216907 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e971dee1-2eef-45a8-ab03-2c0673ea9055 admin admin] 10.222.0.82 "DELETE /v2.0/networks/dffbc212-a0c7-4790-adc4-3c8839bf23a1 HTTP/1.1" status: 204 len: 168 time: 0.9617198 May 12 16:11:39.387043 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55070) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:39.434526 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6a11de17-65cb-4afa-9beb-0d3bf866427a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=01848e54c5dd4735962a6a10c4c0537b&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0462360 May 12 16:11:39.436987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55074) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:39.503232 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d5b48fb-22b9-4481-9917-7b3893dac0a5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:39.529149 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d5b48fb-22b9-4481-9917-7b3893dac0a5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:39.530432 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f45c186f-68b6-41a8-a4b3-c466771c8260 None None] Deleting port 972e244a-be70-42b4-b350-d0c07405857e {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:11:39.530978 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f45c186f-68b6-41a8-a4b3-c466771c8260 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:39.583656 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d5b48fb-22b9-4481-9917-7b3893dac0a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:39.608748 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f45c186f-68b6-41a8-a4b3-c466771c8260 None None] The port '972e244a-be70-42b4-b350-d0c07405857e' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 16:11:39.706999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d5b48fb-22b9-4481-9917-7b3893dac0a5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8be97727-1a22-4860-9a0f-16feb2050988,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:39.712310 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d5b48fb-22b9-4481-9917-7b3893dac0a5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:39.712447 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1d5b48fb-22b9-4481-9917-7b3893dac0a5 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8be97727-1a22-4860-9a0f-16feb2050988 HTTP/1.1" status: 204 len: 168 time: 0.2745266 May 12 16:11:40.052237 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55082) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:40.100685 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e568d5ff-aa03-4f00-8ea7-0c5830db692d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0b00c923adb0414f8dca1a3f561259b3&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0472200 May 12 16:11:40.103796 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55086) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:40.160855 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adabc8d6-b002-4c3c-9c0b-8a247cf976f5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:40.185710 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adabc8d6-b002-4c3c-9c0b-8a247cf976f5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:40.239135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adabc8d6-b002-4c3c-9c0b-8a247cf976f5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:40.253605 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adabc8d6-b002-4c3c-9c0b-8a247cf976f5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff79f760-2bbe-403e-9272-135caab70d31,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:40.261540 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-adabc8d6-b002-4c3c-9c0b-8a247cf976f5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:40.262620 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-adabc8d6-b002-4c3c-9c0b-8a247cf976f5 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ff79f760-2bbe-403e-9272-135caab70d31 HTTP/1.1" status: 204 len: 168 time: 0.1579552 May 12 16:11:40.446668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 972e244a-be70-42b4-b350-d0c07405857e no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:11:40.481690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 972e244a-be70-42b4-b350-d0c07405857e {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:11:40.482098 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 972e244a-be70-42b4-b350-d0c07405857e not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:11:41.839461 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55128) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:41.844835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-837407075', 'description': 'tempest-secgroup-smoke-837407075 description', 'project_id': 'f50049e6814046a9abf21905584f94e1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:11:41.852376 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:11:41.856414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:11:41.859345 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:11:41.864914 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:11:41.876000 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:41.891628 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:41.907001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:11:41.910836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:11:41.913633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:11:41.920888 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:11:42.013299 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.017284 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.033141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:11:42.045547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:11:42.051095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:11:42.059945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:11:42.061822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4e7d8622-6c6d-4252-bba4-c4fed57452a3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:42.134979 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.139022 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.182694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8c4a7c2d-c682-4153-ab93-3e846956b00c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:42.186161 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.187372 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7acd71d2-3d1e-4c43-b571-45576a28b01c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.3469110 May 12 16:11:42.190366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55132) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:42.196152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1f62f419-49e6-4f3f-8880-847d8f976f96 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '8c4a7c2d-c682-4153-ab93-3e846956b00c', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:11:42.202945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1f62f419-49e6-4f3f-8880-847d8f976f96 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:11:42.206813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1f62f419-49e6-4f3f-8880-847d8f976f96 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:11:42.209659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1f62f419-49e6-4f3f-8880-847d8f976f96 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:11:42.216381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1f62f419-49e6-4f3f-8880-847d8f976f96 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:11:42.234238 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1f62f419-49e6-4f3f-8880-847d8f976f96 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.297772 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1f62f419-49e6-4f3f-8880-847d8f976f96 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.301236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1f62f419-49e6-4f3f-8880-847d8f976f96 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.324469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f62f419-49e6-4f3f-8880-847d8f976f96 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=79a37003-0065-485d-bb1f-7217eda4d4dc,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:42.333721 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1f62f419-49e6-4f3f-8880-847d8f976f96 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.334890 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1f62f419-49e6-4f3f-8880-847d8f976f96 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1436825 May 12 16:11:42.338169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55136) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:42.343180 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-34fdaf04-89ab-42bc-bb2d-c1ea389961c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '8c4a7c2d-c682-4153-ab93-3e846956b00c', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:11:42.349702 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-34fdaf04-89ab-42bc-bb2d-c1ea389961c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:11:42.353657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-34fdaf04-89ab-42bc-bb2d-c1ea389961c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:11:42.356451 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-34fdaf04-89ab-42bc-bb2d-c1ea389961c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:11:42.362245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-34fdaf04-89ab-42bc-bb2d-c1ea389961c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:11:42.377800 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-34fdaf04-89ab-42bc-bb2d-c1ea389961c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.439931 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-34fdaf04-89ab-42bc-bb2d-c1ea389961c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.444316 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-34fdaf04-89ab-42bc-bb2d-c1ea389961c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.468544 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34fdaf04-89ab-42bc-bb2d-c1ea389961c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e849d519-46bc-43f4-8256-bd6adb768dcd,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:42.480874 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-34fdaf04-89ab-42bc-bb2d-c1ea389961c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.482094 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-34fdaf04-89ab-42bc-bb2d-c1ea389961c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1429811 May 12 16:11:42.485065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55140) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:42.494962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-0f45a473-94ed-466f-b944-83725a218aaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '8c4a7c2d-c682-4153-ab93-3e846956b00c', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:11:42.501734 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0f45a473-94ed-466f-b944-83725a218aaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:11:42.505589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0f45a473-94ed-466f-b944-83725a218aaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:11:42.509037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0f45a473-94ed-466f-b944-83725a218aaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:11:42.514737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0f45a473-94ed-466f-b944-83725a218aaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:11:42.533055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f45a473-94ed-466f-b944-83725a218aaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.600489 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f45a473-94ed-466f-b944-83725a218aaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.604767 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f45a473-94ed-466f-b944-83725a218aaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.630585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f45a473-94ed-466f-b944-83725a218aaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ae5c8e3c-20c4-4036-9d14-2b00cbb266bd,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:42.639797 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0f45a473-94ed-466f-b944-83725a218aaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.640970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0f45a473-94ed-466f-b944-83725a218aaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1549435 May 12 16:11:42.643684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55144) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:42.649253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-35ebf59f-0266-4cdc-b354-3d8425d3e9b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '8c4a7c2d-c682-4153-ab93-3e846956b00c', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:11:42.655975 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-35ebf59f-0266-4cdc-b354-3d8425d3e9b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:11:42.659962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-35ebf59f-0266-4cdc-b354-3d8425d3e9b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:11:42.662862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-35ebf59f-0266-4cdc-b354-3d8425d3e9b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:11:42.669360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-35ebf59f-0266-4cdc-b354-3d8425d3e9b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:11:42.684879 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35ebf59f-0266-4cdc-b354-3d8425d3e9b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.747988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35ebf59f-0266-4cdc-b354-3d8425d3e9b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.751558 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35ebf59f-0266-4cdc-b354-3d8425d3e9b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.774744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35ebf59f-0266-4cdc-b354-3d8425d3e9b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=56e93bf6-8757-4cf5-a7c2-e4e73e6c5190,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:42.786193 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-35ebf59f-0266-4cdc-b354-3d8425d3e9b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.787365 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-35ebf59f-0266-4cdc-b354-3d8425d3e9b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1428435 May 12 16:11:42.790677 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55148) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:42.795498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-235080ef-1e7f-4d86-87df-df63d0652332 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '8c4a7c2d-c682-4153-ab93-3e846956b00c', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:11:42.801962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-235080ef-1e7f-4d86-87df-df63d0652332 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:11:42.805766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-235080ef-1e7f-4d86-87df-df63d0652332 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:11:42.808653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-235080ef-1e7f-4d86-87df-df63d0652332 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:11:42.814566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-235080ef-1e7f-4d86-87df-df63d0652332 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:11:42.825642 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-235080ef-1e7f-4d86-87df-df63d0652332 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Project f50049e6814046a9abf21905584f94e1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:11:42.831919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-235080ef-1e7f-4d86-87df-df63d0652332 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.856592 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b95e8c7a-1f25-4fec-952c-a5f4b8da2e9d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.896369 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-235080ef-1e7f-4d86-87df-df63d0652332 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.900377 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-235080ef-1e7f-4d86-87df-df63d0652332 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.923032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-235080ef-1e7f-4d86-87df-df63d0652332 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dfc0819a-a8e7-4c40-aa8c-5a3e694ad098,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:42.931551 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-235080ef-1e7f-4d86-87df-df63d0652332 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:42.932708 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-235080ef-1e7f-4d86-87df-df63d0652332 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1411006 May 12 16:11:42.935368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55152) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:42.940088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-460e4e2a-2332-47b5-9edb-e2a08fb26a5d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '8c4a7c2d-c682-4153-ab93-3e846956b00c', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:11:42.946755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-460e4e2a-2332-47b5-9edb-e2a08fb26a5d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:11:42.950497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-460e4e2a-2332-47b5-9edb-e2a08fb26a5d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:11:42.953275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-460e4e2a-2332-47b5-9edb-e2a08fb26a5d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:11:42.958900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-460e4e2a-2332-47b5-9edb-e2a08fb26a5d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:11:42.970159 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-460e4e2a-2332-47b5-9edb-e2a08fb26a5d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Project f50049e6814046a9abf21905584f94e1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:11:42.977362 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-460e4e2a-2332-47b5-9edb-e2a08fb26a5d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:43.046467 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-460e4e2a-2332-47b5-9edb-e2a08fb26a5d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:43.049974 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-460e4e2a-2332-47b5-9edb-e2a08fb26a5d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:43.072989 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-460e4e2a-2332-47b5-9edb-e2a08fb26a5d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=420cd9c5-ecd5-4dc2-9da7-d3a087c1d589,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:43.082466 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-460e4e2a-2332-47b5-9edb-e2a08fb26a5d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:43.083662 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-460e4e2a-2332-47b5-9edb-e2a08fb26a5d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1474118 May 12 16:11:43.086881 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55156) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:43.092274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'network': {'name': 'tempest-network-smoke--658814108', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'port_security_enabled': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:11:43.097816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:11:43.102112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:network and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:11:43.104916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:11:43.110561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:11:43.121372 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:11:43.124752 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:43.151831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 596} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:11:43.161233 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:43.161611 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Added segment a92a5199-bc99-4977-9b40-9967a18957f3 of type vlan for network 372dd2ac-a732-491f-b0d4-cbcb252de859 May 12 16:11:43.187735 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:43.217919 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:43.223577 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:43.224152 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:43.329658 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.2417278 May 12 16:11:43.332370 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19c078a9-1d5b-45f6-9c3c-a9d810d2b63c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Network': ['ID=372dd2ac-a732-491f-b0d4-cbcb252de859,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:43.332625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55160) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:43.338235 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'admin_state_up': True, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:11:43.343222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 372dd2ac-a732-491f-b0d4-cbcb252de859 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:11:43.347455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:11:43.352384 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:router and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:11:43.355532 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:11:43.361960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:11:43.373002 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:43.373999 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:43.389209 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:43.672385 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:43.702736 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:44.099379 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:44.128978 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:44.262528 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.25.8.242 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/cae61808-db83-40e5-93c8-5a1930e6dcf8) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:11:44.409664 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:44.438707 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:44.503172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:11:44.506085 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:11:44.510903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:11:44.544366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=cae61808-db83-40e5-93c8-5a1930e6dcf8,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:44.929290 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:45.394532 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-93ce3e26-5af2-4280-848a-667059001b79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:45.398147 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:45.607798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 0623ad63-ca1b-45af-95e5-0af159f492b3 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 16:11:45.795347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:11:45.806520 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Sync routers for ids ['0623ad63-ca1b-45af-95e5-0af159f492b3'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:11:45.815862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Routers {'0623ad63-ca1b-45af-95e5-0af159f492b3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:11:45.816467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0623ad63-ca1b-45af-95e5-0af159f492b3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:45.823866 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:45.825054 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c3308c7c-b073-4b15-b715-de26671d124b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 2.4914486 May 12 16:11:45.828303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55164) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:45.983420 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-90a1ad9b-e2d4-4563-9f77-9645d6b672c0 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=f50049e6814046a9abf21905584f94e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1539745 May 12 16:11:45.986054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55170) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:46.031284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Set router 0623ad63-ca1b-45af-95e5-0af159f492b3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:11:46.119417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab9c721c-f585-4430-a940-8713f8093414 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:46.123573 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ab9c721c-f585-4430-a940-8713f8093414 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1339581 May 12 16:11:46.123786 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55174) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:46.162451 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-df4447ba-4f10-4082-b830-bd6e398b0f13 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0375159 May 12 16:11:46.165445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55178) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:46.170860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1434687991', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:11:46.233564 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:46.306857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:11:46.310830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:subnet and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:11:46.313656 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:11:46.319515 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:11:46.329608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:11:46.333008 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:46.352006 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:11:44Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:44Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:46.355924 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Checking router: 0623ad63-ca1b-45af-95e5-0af159f492b3 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:11:46.356260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Updating router 0623ad63-ca1b-45af-95e5-0af159f492b3 port cae61808-db83-40e5-93c8-5a1930e6dcf8 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:11:46.433280 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:46.435378 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:46.560202 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:46.642042 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Subnet': ['ID=d121cd7e-6898-4997-b00a-4f1b0558f5f7,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:46.649923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Checking segment: {'id': 'a92a5199-bc99-4977-9b40-9967a18957f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:11:46.650280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network hostable DHCP agents. Network: 372dd2ac-a732-491f-b0d4-cbcb252de859, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:11:46.669985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 372dd2ac-a732-491f-b0d4-cbcb252de859 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:11:46.679904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 372dd2ac-a732-491f-b0d4-cbcb252de859) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:11:46.686300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:46.687159 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:46.688667 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-febc07d0-e5b0-4b61-a254-f8f8e597f122 None None] Network 372dd2ac-a732-491f-b0d4-cbcb252de859 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:11:46.708976 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-7d129313-d9f3-46fe-a758-569d3fa3674f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.5425003 May 12 16:11:46.712403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55182) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:11:46.933578 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:46.950918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Transition to ACTIVE for port object cae61808-db83-40e5-93c8-5a1930e6dcf8 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:11:46.961183 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:47.068269 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-372dd2ac-a732-491f-b0d4-cbcb252de859', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ips': [{'subnet_id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:11:47.069329 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:47.092830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Attempting to bind port cae61808-db83-40e5-93c8-5a1930e6dcf8 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:11:47.093190 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Attempting to bind port cae61808-db83-40e5-93c8-5a1930e6dcf8 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:11:47.093569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Attempting to bind port cae61808-db83-40e5-93c8-5a1930e6dcf8 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:11:47.106027 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74244e3f-939f-4eb5-afc0-2cb3aaab0ec1 None None] Pushing event updated for resources: {'Port': ['ID=cae61808-db83-40e5-93c8-5a1930e6dcf8,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:47.108178 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 11, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:11:47.108544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:11:47.108941 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:47.109324 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:11:47.109813 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Bound port: cae61808-db83-40e5-93c8-5a1930e6dcf8, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:11:47.110180 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:47.195470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74244e3f-939f-4eb5-afc0-2cb3aaab0ec1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:47.195814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74244e3f-939f-4eb5-afc0-2cb3aaab0ec1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:47.196153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74244e3f-939f-4eb5-afc0-2cb3aaab0ec1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:47.196945 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74244e3f-939f-4eb5-afc0-2cb3aaab0ec1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:47.197281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74244e3f-939f-4eb5-afc0-2cb3aaab0ec1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:47.197630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74244e3f-939f-4eb5-afc0-2cb3aaab0ec1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:47.197956 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74244e3f-939f-4eb5-afc0-2cb3aaab0ec1 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:47.198275 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74244e3f-939f-4eb5-afc0-2cb3aaab0ec1 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:47.198593 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74244e3f-939f-4eb5-afc0-2cb3aaab0ec1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:47.198910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74244e3f-939f-4eb5-afc0-2cb3aaab0ec1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:47.199230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74244e3f-939f-4eb5-afc0-2cb3aaab0ec1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:47.199547 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74244e3f-939f-4eb5-afc0-2cb3aaab0ec1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:47.305048 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] For port cae61808-db83-40e5-93c8-5a1930e6dcf8, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:11:47.322108 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] For port cae61808-db83-40e5-93c8-5a1930e6dcf8, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cae61808-db83-40e5-93c8-5a1930e6dcf8,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:11:47.328443 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:47.380955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Allocated IP 172.20.0.2 (372dd2ac-a732-491f-b0d4-cbcb252de859/d121cd7e-6898-4997-b00a-4f1b0558f5f7/224f60d2-797e-4d08-a43b-4fb0210d5a7c) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:11:47.451795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Routers {'0623ad63-ca1b-45af-95e5-0af159f492b3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:11:47.452487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0623ad63-ca1b-45af-95e5-0af159f492b3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:47.536449 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:47.622029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74244e3f-939f-4eb5-afc0-2cb3aaab0ec1 None None] Pushing event updated for resources: {'Port': ['ID=cae61808-db83-40e5-93c8-5a1930e6dcf8,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:47.808993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] Set router 0623ad63-ca1b-45af-95e5-0af159f492b3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:11:47.965267 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:11:47.968976 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:48.031053 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:48.048181 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Transition to ACTIVE for port object 224f60d2-797e-4d08-a43b-4fb0210d5a7c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:11:48.087333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Transition to ACTIVE for port object 224f60d2-797e-4d08-a43b-4fb0210d5a7c will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:11:48.102694 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:48.170036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.20.0.1 (372dd2ac-a732-491f-b0d4-cbcb252de859/d121cd7e-6898-4997-b00a-4f1b0558f5f7/a2c2e0f5-590d-4081-9993-ec9718b5739c) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:11:48.212629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Network 372dd2ac-a732-491f-b0d4-cbcb252de859 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:11:48.215709 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:11:48.224181 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:11:48.226065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Pushing event updated for resources: {'Port': ['ID=224f60d2-797e-4d08-a43b-4fb0210d5a7c,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:48.325559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Attempting to bind port 224f60d2-797e-4d08-a43b-4fb0210d5a7c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:11:48.325912 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Attempting to bind port 224f60d2-797e-4d08-a43b-4fb0210d5a7c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'a92a5199-bc99-4977-9b40-9967a18957f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:11:48.326260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Attempting to bind port 224f60d2-797e-4d08-a43b-4fb0210d5a7c on network 372dd2ac-a732-491f-b0d4-cbcb252de859 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:11:48.330320 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:48.333652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 11, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:11:48.334010 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Checking segment: {'id': 'a92a5199-bc99-4977-9b40-9967a18957f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:11:48.334402 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:48.334778 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Bound using segment: {'id': 'a92a5199-bc99-4977-9b40-9967a18957f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:11:48.335230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Bound port: 224f60d2-797e-4d08-a43b-4fb0210d5a7c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a92a5199-bc99-4977-9b40-9967a18957f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:11:48.335646 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:48.347417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Transition to ACTIVE for port object a2c2e0f5-590d-4081-9993-ec9718b5739c will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:11:48.355070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:11:44Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:48.370863 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:48.386318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e654c70-831c-4887-bb0e-2d4c62fa956c None None] The sync data for ids ['0623ad63-ca1b-45af-95e5-0af159f492b3'] in n-d-841483-1 is: [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:11:44Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:11:48.436020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] For port 224f60d2-797e-4d08-a43b-4fb0210d5a7c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:11:48.439901 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] For port 224f60d2-797e-4d08-a43b-4fb0210d5a7c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=224f60d2-797e-4d08-a43b-4fb0210d5a7c,segment=NetworkSegment(a92a5199-bc99-4977-9b40-9967a18957f3),segment_id=a92a5199-bc99-4977-9b40-9967a18957f3)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:11:48.443047 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 372dd2ac-a732-491f-b0d4-cbcb252de859 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:11:48.446740 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:48.448383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:11:48.453035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:11:48.524853 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=a2c2e0f5-590d-4081-9993-ec9718b5739c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:48.543691 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:48.552438 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87a6eafe-f9ab-4202-b102-5fb411754753 None None] Pushing event updated for resources: {'Port': ['ID=224f60d2-797e-4d08-a43b-4fb0210d5a7c,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:48.989063 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:49.438768 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:49.444498 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:49.530939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d65d6c94-4a63-4a75-938c-0ef55fa7b0fb None None] Network 372dd2ac-a732-491f-b0d4-cbcb252de859 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:11:49.567654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=a2c2e0f5-590d-4081-9993-ec9718b5739c,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:49.576436 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:49.626416 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-6f6f1ce7-748a-4074-a253-e8669f453925 None None] Provisioning for port 224f60d2-797e-4d08-a43b-4fb0210d5a7c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:11:49.718467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 372dd2ac-a732-491f-b0d4-cbcb252de859 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:11:49.719778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:11:49.920182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 0623ad63-ca1b-45af-95e5-0af159f492b3 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:11:50.069408 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5dca1698-f3d6-42c6-9de1-64aa6756e209 None None] Provisioning for port a2c2e0f5-590d-4081-9993-ec9718b5739c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:11:50.075807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5dca1698-f3d6-42c6-9de1-64aa6756e209 None None] Provisioning complete for port a2c2e0f5-590d-4081-9993-ec9718b5739c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:11:50.076591 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5dca1698-f3d6-42c6-9de1-64aa6756e209 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:50.118418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:11:50.128638 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e58f6dbf-c06f-49d0-8f68-5c23c5756870 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "PUT /v2.0/routers/0623ad63-ca1b-45af-95e5-0af159f492b3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4152102 May 12 16:11:50.129581 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Sync routers for ids ['0623ad63-ca1b-45af-95e5-0af159f492b3'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:11:50.141183 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Routers {'0623ad63-ca1b-45af-95e5-0af159f492b3'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:11:50.141912 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0623ad63-ca1b-45af-95e5-0af159f492b3'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:50.150627 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5dca1698-f3d6-42c6-9de1-64aa6756e209 None None] Port a2c2e0f5-590d-4081-9993-ec9718b5739c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:11:50.290747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ab13c492-8b51-46be-ad16-9696503f4580 None None] Provisioning complete for port a2c2e0f5-590d-4081-9993-ec9718b5739c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:11:50.293186 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ab13c492-8b51-46be-ad16-9696503f4580 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:50.325971 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Set router 0623ad63-ca1b-45af-95e5-0af159f492b3 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:11:50.334038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-586a6d7d-aafd-4faa-817d-f53cc65fb427 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-837407075&fields=id&tenant_id=f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 267 time: 0.0595429 May 12 16:11:50.389301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ab13c492-8b51-46be-ad16-9696503f4580 None None] Port a2c2e0f5-590d-4081-9993-ec9718b5739c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:11:50.508272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c619c288-2abc-4843-b91c-6396d990d109 req-a7fb32c4-0ebd-4f79-97f3-33ecafacf7f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:50.509809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-a7fb32c4-0ebd-4f79-97f3-33ecafacf7f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/networks?id=372dd2ac-a732-491f-b0d4-cbcb252de859 HTTP/1.1" status: 200 len: 796 time: 0.1743608 May 12 16:11:50.523356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 224f60d2-797e-4d08-a43b-4fb0210d5a7c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:11:50.528572 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-3de185df-ec1c-4647-8e1e-5cb37c874e8f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/quotas/f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 375 time: 0.0102088 May 12 16:11:50.555486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-feadf2b1-27df-4914-abba-fd022ad173f6 None None] Provisioning complete for port a2c2e0f5-590d-4081-9993-ec9718b5739c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:11:50.555850 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-feadf2b1-27df-4914-abba-fd022ad173f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:50.615349 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-858b0c0d-0a2c-476b-8dcb-6e8c1718efac tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0808203 May 12 16:11:50.628670 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-feadf2b1-27df-4914-abba-fd022ad173f6 None None] Port a2c2e0f5-590d-4081-9993-ec9718b5739c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:11:50.644076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 224f60d2-797e-4d08-a43b-4fb0210d5a7c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:11:50.649715 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 224f60d2-797e-4d08-a43b-4fb0210d5a7c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:11:50.650015 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:50.659273 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:11:48Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'a2c2e0f5-590d-4081-9993-ec9718b5739c', 'name': '', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:43:5f:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 4286, 'fixed_ips': [{'subnet_id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:47Z', 'updated_at': '2022-05-12T16:11:49Z', 'revision_number': 2, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:50.663407 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Checking router: 0623ad63-ca1b-45af-95e5-0af159f492b3 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:11:50.663782 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Updating router 0623ad63-ca1b-45af-95e5-0af159f492b3 port a2c2e0f5-590d-4081-9993-ec9718b5739c binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:11:50.686785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-863f0fca-792a-42e3-8cfd-6da19049ab5a service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 16:11:50.687812 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-863f0fca-792a-42e3-8cfd-6da19049ab5a service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0576086 May 12 16:11:50.722679 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:50.811340 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:50.843195 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 224f60d2-797e-4d08-a43b-4fb0210d5a7c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=224f60d2-797e-4d08-a43b-4fb0210d5a7c,segment=NetworkSegment(a92a5199-bc99-4977-9b40-9967a18957f3),segment_id=a92a5199-bc99-4977-9b40-9967a18957f3)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:50.843820 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-c4ac0822-3628-43de-b201-9170784f6962 service neutron] 10.222.0.82 "GET /v2.0/networks/372dd2ac-a732-491f-b0d4-cbcb252de859?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1486721 May 12 16:11:50.854645 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:50.856917 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cae61808-db83-40e5-93c8-5a1930e6dcf8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:11:50.979909 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=224f60d2-797e-4d08-a43b-4fb0210d5a7c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:50.994869 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port cae61808-db83-40e5-93c8-5a1930e6dcf8 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:11:50.995207 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-e95ed59f-be72-4de8-9430-a9787b3b3ebc service neutron] 10.222.0.82 "GET /v2.0/networks/372dd2ac-a732-491f-b0d4-cbcb252de859?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1429887 May 12 16:11:51.000504 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port cae61808-db83-40e5-93c8-5a1930e6dcf8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:11:51.000936 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:51.083689 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:51.096216 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Transition to ACTIVE for port object a2c2e0f5-590d-4081-9993-ec9718b5739c will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:11:51.103173 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:51.124526 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:51.143322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port cae61808-db83-40e5-93c8-5a1930e6dcf8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cae61808-db83-40e5-93c8-5a1930e6dcf8,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:51.147326 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:51.234744 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=cae61808-db83-40e5-93c8-5a1930e6dcf8,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:51.287615 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8482b77f-14e7-4f50-ae00-3bc7f5e4689a None None] Pushing event updated for resources: {'Port': ['ID=a2c2e0f5-590d-4081-9993-ec9718b5739c,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:51.330020 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8482b77f-14e7-4f50-ae00-3bc7f5e4689a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:51.330358 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8482b77f-14e7-4f50-ae00-3bc7f5e4689a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:51.330691 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8482b77f-14e7-4f50-ae00-3bc7f5e4689a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:51.331025 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8482b77f-14e7-4f50-ae00-3bc7f5e4689a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:51.331348 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8482b77f-14e7-4f50-ae00-3bc7f5e4689a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:51.331668 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8482b77f-14e7-4f50-ae00-3bc7f5e4689a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:51.331984 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8482b77f-14e7-4f50-ae00-3bc7f5e4689a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:51.332299 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8482b77f-14e7-4f50-ae00-3bc7f5e4689a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:51.332612 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8482b77f-14e7-4f50-ae00-3bc7f5e4689a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:51.332922 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8482b77f-14e7-4f50-ae00-3bc7f5e4689a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:51.333232 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8482b77f-14e7-4f50-ae00-3bc7f5e4689a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:51.333570 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8482b77f-14e7-4f50-ae00-3bc7f5e4689a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:11:51.365857 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Attempting to bind port a2c2e0f5-590d-4081-9993-ec9718b5739c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:11:51.366220 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Attempting to bind port a2c2e0f5-590d-4081-9993-ec9718b5739c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'a92a5199-bc99-4977-9b40-9967a18957f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:11:51.366569 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Attempting to bind port a2c2e0f5-590d-4081-9993-ec9718b5739c on network 372dd2ac-a732-491f-b0d4-cbcb252de859 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:11:51.372652 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 11, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:11:51.373012 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Checking segment: {'id': 'a92a5199-bc99-4977-9b40-9967a18957f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:11:51.373413 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:51.373800 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Bound using segment: {'id': 'a92a5199-bc99-4977-9b40-9967a18957f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:11:51.374256 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Bound port: a2c2e0f5-590d-4081-9993-ec9718b5739c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a92a5199-bc99-4977-9b40-9967a18957f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:11:51.374614 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:51.463571 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] For port a2c2e0f5-590d-4081-9993-ec9718b5739c, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:11:51.466549 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] For port a2c2e0f5-590d-4081-9993-ec9718b5739c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a2c2e0f5-590d-4081-9993-ec9718b5739c,segment=NetworkSegment(a92a5199-bc99-4977-9b40-9967a18957f3),segment_id=a92a5199-bc99-4977-9b40-9967a18957f3)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:11:51.471028 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:51.549346 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Routers {'0623ad63-ca1b-45af-95e5-0af159f492b3'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:11:51.549989 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0623ad63-ca1b-45af-95e5-0af159f492b3'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:51.605736 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8482b77f-14e7-4f50-ae00-3bc7f5e4689a None None] Pushing event updated for resources: {'Port': ['ID=a2c2e0f5-590d-4081-9993-ec9718b5739c,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:51.731849 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] Set router 0623ad63-ca1b-45af-95e5-0af159f492b3 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:11:52.044710 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:11:48Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'a2c2e0f5-590d-4081-9993-ec9718b5739c', 'name': '', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:43:5f:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 4286, 'fixed_ips': [{'subnet_id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:47Z', 'updated_at': '2022-05-12T16:11:51Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:11:52.048475 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c86d3b6d-2a67-4997-9785-d8eff0e64e7b None None] The sync data for ids ['0623ad63-ca1b-45af-95e5-0af159f492b3'] in n-d-841483-1 is: [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:11:48Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'a2c2e0f5-590d-4081-9993-ec9718b5739c', 'name': '', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:43:5f:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 4286, 'fixed_ips': [{'subnet_id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:47Z', 'updated_at': '2022-05-12T16:11:51Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:11:52.204007 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f1a4efed-542e-41b7-b768-9f490fffe183 req-b9fdb7df-ff93-48d2-a4aa-6574c50a5f6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 210 time: 0.0466664 May 12 16:11:52.532805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 224f60d2-797e-4d08-a43b-4fb0210d5a7c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:11:52.618878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 224f60d2-797e-4d08-a43b-4fb0210d5a7c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:11:52.619246 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:52.743583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cae61808-db83-40e5-93c8-5a1930e6dcf8 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:11:52.818276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port cae61808-db83-40e5-93c8-5a1930e6dcf8 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:11:52.819007 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:52.945576 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a2c2e0f5-590d-4081-9993-ec9718b5739c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:11:53.016922 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port a2c2e0f5-590d-4081-9993-ec9718b5739c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:11:53.021748 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a2c2e0f5-590d-4081-9993-ec9718b5739c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:11:53.022114 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:53.140612 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:53.172981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port a2c2e0f5-590d-4081-9993-ec9718b5739c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a2c2e0f5-590d-4081-9993-ec9718b5739c,segment=NetworkSegment(a92a5199-bc99-4977-9b40-9967a18957f3),segment_id=a92a5199-bc99-4977-9b40-9967a18957f3)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:53.176897 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:53.254583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=a2c2e0f5-590d-4081-9993-ec9718b5739c,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:53.321279 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3914dfad-f1b1-4242-a00d-02e56aa7ff66 req-435e633d-6535-43e7-8548-a36182d965f7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 210 time: 0.0491450 May 12 16:11:54.464271 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a2c2e0f5-590d-4081-9993-ec9718b5739c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:11:54.471837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f950570d-4cd4-4ee4-8f89-414271afc408 req-4fa4688c-4d77-4dad-89a2-8daf3a3af107 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 210 time: 0.0459549 May 12 16:11:54.535219 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port a2c2e0f5-590d-4081-9993-ec9718b5739c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:11:54.535484 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:54.696700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c619c288-2abc-4843-b91c-6396d990d109 req-1252a2b5-6f0d-41d2-99a6-32304c8692c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:54.698088 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c619c288-2abc-4843-b91c-6396d990d109 req-1252a2b5-6f0d-41d2-99a6-32304c8692c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:11:54.714125 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c619c288-2abc-4843-b91c-6396d990d109 req-1252a2b5-6f0d-41d2-99a6-32304c8692c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:11:54.715244 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-1252a2b5-6f0d-41d2-99a6-32304c8692c4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/networks?id=372dd2ac-a732-491f-b0d4-cbcb252de859 HTTP/1.1" status: 200 len: 796 time: 0.1761377 May 12 16:11:54.770731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c619c288-2abc-4843-b91c-6396d990d109 req-dd8ee317-ee70-4ed2-ad55-0e1abd000971 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:11:54.786988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c619c288-2abc-4843-b91c-6396d990d109 req-dd8ee317-ee70-4ed2-ad55-0e1abd000971 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:11:54.788018 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-dd8ee317-ee70-4ed2-ad55-0e1abd000971 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 379 time: 0.0579836 May 12 16:11:54.820246 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'port': {'device_id': '363d3614-6b17-48e5-8590-d557bf57fc49', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'admin_state_up': True, 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'security_groups': ['8c4a7c2d-c682-4153-ab93-3e846956b00c']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:11:55.078781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:11:55.082505 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:port and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:11:55.085275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:11:55.090884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:11:55.100383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:11:55.104531 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:55.265211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.20.0.3 (372dd2ac-a732-491f-b0d4-cbcb252de859/d121cd7e-6898-4997-b00a-4f1b0558f5f7/32860e96-1fd7-4006-865b-b042900b312b) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:11:55.450130 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:55.465823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Transition to ACTIVE for port object 32860e96-1fd7-4006-865b-b042900b312b will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:11:55.488930 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:55.560896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 372dd2ac-a732-491f-b0d4-cbcb252de859 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:11:55.563783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:11:55.567822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:11:55.604838 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=32860e96-1fd7-4006-865b-b042900b312b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:55.637241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:55.637906 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:55.660927 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-ccd924de-5552-4f67-ac45-634fd4d96141 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8443444 May 12 16:11:55.665800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1897c431-63ae-4a5a-889b-af3e7e951ab9 req-41035274-fc0a-46c0-9ae5-f056c481b8ae tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:55.667626 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1897c431-63ae-4a5a-889b-af3e7e951ab9 req-41035274-fc0a-46c0-9ae5-f056c481b8ae tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 931 time: 0.0869231 May 12 16:11:55.685970 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Request body: {'port': {'device_id': '363d3614-6b17-48e5-8590-d557bf57fc49', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:11:55.722637 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1897c431-63ae-4a5a-889b-af3e7e951ab9 req-3b526e68-fcaa-4285-9871-8c9c50999dbf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478351 May 12 16:11:55.802254 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:55.822564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7333d11f-89d1-4d2b-9238-08ac4698fbe5 None None] Provisioning for port 32860e96-1fd7-4006-865b-b042900b312b completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:11:55.827505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-7333d11f-89d1-4d2b-9238-08ac4698fbe5 None None] Provisioning complete for port 32860e96-1fd7-4006-865b-b042900b312b triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:11:55.827876 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7333d11f-89d1-4d2b-9238-08ac4698fbe5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:55.882015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-7333d11f-89d1-4d2b-9238-08ac4698fbe5 None None] Port 32860e96-1fd7-4006-865b-b042900b312b cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:11:56.138189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 32860e96-1fd7-4006-865b-b042900b312b {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:11:56.145405 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:56.160174 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Transition to ACTIVE for port object 32860e96-1fd7-4006-865b-b042900b312b will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:11:56.163672 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:56.331244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Pushing event updated for resources: {'Port': ['ID=32860e96-1fd7-4006-865b-b042900b312b,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:56.411690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Attempting to bind port 32860e96-1fd7-4006-865b-b042900b312b on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:11:56.412020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Attempting to bind port 32860e96-1fd7-4006-865b-b042900b312b by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'a92a5199-bc99-4977-9b40-9967a18957f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:11:56.412342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Attempting to bind port 32860e96-1fd7-4006-865b-b042900b312b on network 372dd2ac-a732-491f-b0d4-cbcb252de859 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:11:56.416981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Port 32860e96-1fd7-4006-865b-b042900b312b on network 372dd2ac-a732-491f-b0d4-cbcb252de859 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:11:56.417286 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Attempting to bind port 32860e96-1fd7-4006-865b-b042900b312b on network 372dd2ac-a732-491f-b0d4-cbcb252de859 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:11:56.422251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 11, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:11:56.422578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Checking segment: {'id': 'a92a5199-bc99-4977-9b40-9967a18957f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:11:56.422946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Bound using segment: {'id': 'a92a5199-bc99-4977-9b40-9967a18957f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:11:56.423357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Bound port: 32860e96-1fd7-4006-865b-b042900b312b, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a92a5199-bc99-4977-9b40-9967a18957f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 596, 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:11:56.423694 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:56.516411 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] For port 32860e96-1fd7-4006-865b-b042900b312b, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:11:56.519274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] For port 32860e96-1fd7-4006-865b-b042900b312b, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=32860e96-1fd7-4006-865b-b042900b312b,segment=NetworkSegment(a92a5199-bc99-4977-9b40-9967a18957f3),segment_id=a92a5199-bc99-4977-9b40-9967a18957f3)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:11:56.522640 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:56.584534 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:56.585131 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:56.586543 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] 10.222.0.84 "PUT /v2.0/ports/32860e96-1fd7-4006-865b-b042900b312b HTTP/1.1" status: 200 len: 1091 time: 0.9057178 May 12 16:11:56.586977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '363d3614-6b17-48e5-8590-d557bf57fc49', 'tag': '32860e96-1fd7-4006-865b-b042900b312b'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:11:56.622699 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8853b4c1-19eb-41f1-b226-c5759f4b2ab8 service neutron] Pushing event updated for resources: {'Port': ['ID=32860e96-1fd7-4006-865b-b042900b312b,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:56.647299 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-88890654-328c-41bf-a9f7-36c7147a90af'] response: {'name': 'network-changed', 'server_uuid': '363d3614-6b17-48e5-8590-d557bf57fc49', 'tag': '32860e96-1fd7-4006-865b-b042900b312b', 'status': 'completed', 'code': 200} May 12 16:11:56.748057 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c619c288-2abc-4843-b91c-6396d990d109 req-5f2c3de6-5fe0-4419-80c1-6f9cf9ec6014 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:56.749560 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-5f2c3de6-5fe0-4419-80c1-6f9cf9ec6014 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 1094 time: 0.0780430 May 12 16:11:56.832449 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-ca7df145-69cd-46cb-98f3-5ae28bdf177a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=32860e96-1fd7-4006-865b-b042900b312b HTTP/1.1" status: 200 len: 217 time: 0.0622513 May 12 16:11:56.913488 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a665b9d7-a3c2-4168-82a5-6de1084bd000 req-231a7900-ce58-407d-8a01-9bb7c9666411 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:56.914897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a665b9d7-a3c2-4168-82a5-6de1084bd000 req-231a7900-ce58-407d-8a01-9bb7c9666411 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 943 time: 0.0837238 May 12 16:11:56.967691 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a665b9d7-a3c2-4168-82a5-6de1084bd000 req-e08f8532-3c55-47a6-b115-2bdea42172aa tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459931 May 12 16:11:57.015987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c619c288-2abc-4843-b91c-6396d990d109 req-30a79b91-3887-4f4c-b70b-be248c05957a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:57.017423 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-30a79b91-3887-4f4c-b70b-be248c05957a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d121cd7e-6898-4997-b00a-4f1b0558f5f7 HTTP/1.1" status: 200 len: 835 time: 0.1762199 May 12 16:11:57.095978 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c619c288-2abc-4843-b91c-6396d990d109 req-d3b83b67-4bfa-45ce-a12b-01cabcd55f2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:57.097433 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-d3b83b67-4bfa-45ce-a12b-01cabcd55f2c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=372dd2ac-a732-491f-b0d4-cbcb252de859&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0720909 May 12 16:11:57.234997 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-63bd4bec-e149-4ac3-af21-445f6b0f0770 service neutron] 10.222.0.84 "GET /v2.0/networks/372dd2ac-a732-491f-b0d4-cbcb252de859?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1272061 May 12 16:11:57.373469 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c619c288-2abc-4843-b91c-6396d990d109 req-78b31f1b-6b09-4c0e-8896-15539fb8cecb service neutron] 10.222.0.84 "GET /v2.0/networks/372dd2ac-a732-491f-b0d4-cbcb252de859?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1296580 May 12 16:11:57.546260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb44ac0-91f5-4ee2-adbe-9ec5ab9505a2 req-71cbfda3-34c5-4f78-bd17-aae05c94bdaa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:57.547652 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-acb44ac0-91f5-4ee2-adbe-9ec5ab9505a2 req-71cbfda3-34c5-4f78-bd17-aae05c94bdaa service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 1094 time: 0.0756872 May 12 16:11:57.679238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb44ac0-91f5-4ee2-adbe-9ec5ab9505a2 req-9b884b65-2ff2-4bee-b412-1c7dc1d94f46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:57.680665 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-acb44ac0-91f5-4ee2-adbe-9ec5ab9505a2 req-9b884b65-2ff2-4bee-b412-1c7dc1d94f46 service neutron] 10.222.0.84 "GET /v2.0/networks?id=372dd2ac-a732-491f-b0d4-cbcb252de859 HTTP/1.1" status: 200 len: 897 time: 0.1270833 May 12 16:11:57.747295 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-acb44ac0-91f5-4ee2-adbe-9ec5ab9505a2 req-5fa76b37-2336-4f07-a840-b2c65058f431 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=32860e96-1fd7-4006-865b-b042900b312b HTTP/1.1" status: 200 len: 217 time: 0.0600300 May 12 16:11:57.813360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb44ac0-91f5-4ee2-adbe-9ec5ab9505a2 req-273b229e-a89f-489a-b527-c03b52daeac7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:57.815077 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-acb44ac0-91f5-4ee2-adbe-9ec5ab9505a2 req-273b229e-a89f-489a-b527-c03b52daeac7 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d121cd7e-6898-4997-b00a-4f1b0558f5f7 HTTP/1.1" status: 200 len: 835 time: 0.0609746 May 12 16:11:57.891895 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb44ac0-91f5-4ee2-adbe-9ec5ab9505a2 req-6e436655-2e31-4629-804b-31d57363df2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:57.893340 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-acb44ac0-91f5-4ee2-adbe-9ec5ab9505a2 req-6e436655-2e31-4629-804b-31d57363df2c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=372dd2ac-a732-491f-b0d4-cbcb252de859&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0720420 May 12 16:11:58.042344 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-acb44ac0-91f5-4ee2-adbe-9ec5ab9505a2 req-f72c7920-9dde-4930-a648-787fbeed85f3 service neutron] 10.222.0.84 "GET /v2.0/networks/372dd2ac-a732-491f-b0d4-cbcb252de859?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1316974 May 12 16:11:58.161684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd8c7dc-f9eb-40a3-962b-5801fe0960f9 req-9eb54b48-d0b8-4b6e-96a6-3475075f1984 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:58.163052 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bd8c7dc-f9eb-40a3-962b-5801fe0960f9 req-9eb54b48-d0b8-4b6e-96a6-3475075f1984 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 943 time: 0.0839894 May 12 16:11:58.180340 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-acb44ac0-91f5-4ee2-adbe-9ec5ab9505a2 req-732e9b8a-abb8-4b8e-9d0f-f23fb52ede87 service neutron] 10.222.0.84 "GET /v2.0/networks/372dd2ac-a732-491f-b0d4-cbcb252de859?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1291838 May 12 16:11:58.207339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4bd8c7dc-f9eb-40a3-962b-5801fe0960f9 req-bb7531b9-277c-4192-83bd-f4efa4373c68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0384109 May 12 16:11:58.743007 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 32860e96-1fd7-4006-865b-b042900b312b details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:11:58.874146 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 32860e96-1fd7-4006-865b-b042900b312b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=32860e96-1fd7-4006-865b-b042900b312b,segment=NetworkSegment(a92a5199-bc99-4977-9b40-9967a18957f3),segment_id=a92a5199-bc99-4977-9b40-9967a18957f3)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:58.886625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '32860e96-1fd7-4006-865b-b042900b312b', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'port_id': '32860e96-1fd7-4006-865b-b042900b312b', 'mac_address': 'fa:16:3e:b5:a7:8d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 596, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:11:58.943747 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:58.960574 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 32860e96-1fd7-4006-865b-b042900b312b {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:11:58.975942 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 32860e96-1fd7-4006-865b-b042900b312b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=32860e96-1fd7-4006-865b-b042900b312b,segment=NetworkSegment(a92a5199-bc99-4977-9b40-9967a18957f3),segment_id=a92a5199-bc99-4977-9b40-9967a18957f3)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:11:58.980648 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:11:59.047424 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=32860e96-1fd7-4006-865b-b042900b312b,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:11:59.304478 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['32860e96-1fd7-4006-865b-b042900b312b'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:11:59.393587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eba3298-fa0e-439b-8bff-08c14ea78c46 req-8c86f812-46ec-4033-9a35-f5ce5f58f110 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:11:59.395194 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7eba3298-fa0e-439b-8bff-08c14ea78c46 req-8c86f812-46ec-4033-9a35-f5ce5f58f110 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 944 time: 0.0811052 May 12 16:11:59.439451 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7eba3298-fa0e-439b-8bff-08c14ea78c46 req-ed970687-d12e-41f5-a151-c3ee989246af tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0381818 May 12 16:12:00.747539 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb19aba9-7e7b-47bf-a94b-369ebf1779ae req-62fcc439-03fc-41b1-9887-eb5c4a95679a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:00.748986 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb19aba9-7e7b-47bf-a94b-369ebf1779ae req-62fcc439-03fc-41b1-9887-eb5c4a95679a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 944 time: 0.1943519 May 12 16:12:00.761018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 32860e96-1fd7-4006-865b-b042900b312b up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:12:00.794897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb19aba9-7e7b-47bf-a94b-369ebf1779ae req-c79fec68-ce88-4e6f-b77c-a55626a915a5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400631 May 12 16:12:00.828366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 32860e96-1fd7-4006-865b-b042900b312b completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:12:00.832872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 32860e96-1fd7-4006-865b-b042900b312b triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:12:00.833232 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:00.948750 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:00.975116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '363d3614-6b17-48e5-8590-d557bf57fc49', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '32860e96-1fd7-4006-865b-b042900b312b'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:12:00.991266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 32860e96-1fd7-4006-865b-b042900b312b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=32860e96-1fd7-4006-865b-b042900b312b,segment=NetworkSegment(a92a5199-bc99-4977-9b40-9967a18957f3),segment_id=a92a5199-bc99-4977-9b40-9967a18957f3)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:12:00.997534 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:01.035410 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d7b7d745-b319-4a9f-b673-4b1ab21da791'] response: {'server_uuid': '363d3614-6b17-48e5-8590-d557bf57fc49', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '32860e96-1fd7-4006-865b-b042900b312b', 'code': 200} May 12 16:12:01.142875 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=32860e96-1fd7-4006-865b-b042900b312b,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:01.188789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d4fae1-e570-48cb-88d6-29cd87fa54a1 req-a5f01966-b38d-45f9-b039-108147c60eb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:01.190314 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60d4fae1-e570-48cb-88d6-29cd87fa54a1 req-a5f01966-b38d-45f9-b039-108147c60eb5 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 1096 time: 0.0783923 May 12 16:12:01.238552 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60d4fae1-e570-48cb-88d6-29cd87fa54a1 req-df52c9a0-be27-4f21-a1e3-a7e544775585 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389705 May 12 16:12:01.982811 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9ac1ed1-0663-478f-aed8-75aa2346a913 req-26f10f8a-b415-4237-993a-81d659e93087 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:01.984255 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9ac1ed1-0663-478f-aed8-75aa2346a913 req-26f10f8a-b415-4237-993a-81d659e93087 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 945 time: 0.0803509 May 12 16:12:02.031699 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9ac1ed1-0663-478f-aed8-75aa2346a913 req-d0e64c8b-b6f0-4037-b374-bb215defaf95 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418212 May 12 16:12:02.887892 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:03.214951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03bc0ff-3d09-4fec-9bf0-1cd68552ff07 req-b65230d2-0e7d-4288-b076-3672b45757a1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:03.216406 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d03bc0ff-3d09-4fec-9bf0-1cd68552ff07 req-b65230d2-0e7d-4288-b076-3672b45757a1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 945 time: 0.0803399 May 12 16:12:03.260624 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d03bc0ff-3d09-4fec-9bf0-1cd68552ff07 req-fc76c2c0-7cb1-4d3f-8f08-0733c0a8d97d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385122 May 12 16:12:03.442382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-907f953b-ef85-4442-9980-d615cfe98d26 req-bc18c7a9-5268-4618-a217-a849a7c06e49 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:03.443958 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-907f953b-ef85-4442-9980-d615cfe98d26 req-bc18c7a9-5268-4618-a217-a849a7c06e49 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 945 time: 0.0807226 May 12 16:12:03.487181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-907f953b-ef85-4442-9980-d615cfe98d26 req-d10637d2-6725-4744-99ca-cfa7931ceccd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0369537 May 12 16:12:03.508899 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55242) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:03.579909 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc457d3b-65bc-464d-bfd1-167b8a899e24 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:03.581475 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dc457d3b-65bc-464d-bfd1-167b8a899e24 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 1091 time: 0.0714958 May 12 16:12:03.584261 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55246) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:03.589736 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '32860e96-1fd7-4006-865b-b042900b312b', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address': '172.20.0.3'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:12:03.596249 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:12:03.600089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:floatingip and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:12:03.602960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:12:03.609058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:12:03.620180 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:03.772724 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:03.914087 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.25.8.167 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/994a38be-ac77-420c-b9b0-52a3b49e0e5c) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:12:04.062594 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:04.091290 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:04.154059 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:12:04.156728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:12:04.160515 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:12:04.199882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=994a38be-ac77-420c-b9b0-52a3b49e0e5c,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:04.586646 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:04.660044 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:04.969131 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:04.973759 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:05.080849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=994a38be-ac77-420c-b9b0-52a3b49e0e5c,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:05.092995 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:05.261144 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Floating IP 77b1e68f-d15a-4580-b82b-a216adbb8e58 associated. External IP: 172.25.8.167, port: 32860e96-1fd7-4006-865b-b042900b312b. May 12 16:12:05.607920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 0623ad63-ca1b-45af-95e5-0af159f492b3 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:12:05.788733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:12:05.798240 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c22af28-2dc1-4e13-9def-62fb0f43bd37 None None] Sync routers for ids ['0623ad63-ca1b-45af-95e5-0af159f492b3'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:12:05.812548 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c22af28-2dc1-4e13-9def-62fb0f43bd37 None None] Routers {'0623ad63-ca1b-45af-95e5-0af159f492b3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:12:05.813305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8c22af28-2dc1-4e13-9def-62fb0f43bd37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0623ad63-ca1b-45af-95e5-0af159f492b3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:05.814285 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:05.870578 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c0b904c6-ff47-470e-baf5-c872ef95382c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2850344 May 12 16:12:05.871070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '363d3614-6b17-48e5-8590-d557bf57fc49', 'tag': '32860e96-1fd7-4006-865b-b042900b312b'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:12:05.926758 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a5d80490-2e91-4a59-8779-39b5f5e071f0'] response: {'name': 'network-changed', 'server_uuid': '363d3614-6b17-48e5-8590-d557bf57fc49', 'tag': '32860e96-1fd7-4006-865b-b042900b312b', 'status': 'completed', 'code': 200} May 12 16:12:06.000081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8c22af28-2dc1-4e13-9def-62fb0f43bd37 None None] Set router 0623ad63-ca1b-45af-95e5-0af159f492b3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:12:06.054657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60ca5b50-f927-4c9d-ad5e-c97819f391e8 req-dc312d9c-82da-4f68-aa4a-efa793f29ae9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:06.056142 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60ca5b50-f927-4c9d-ad5e-c97819f391e8 req-dc312d9c-82da-4f68-aa4a-efa793f29ae9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 1096 time: 0.0768645 May 12 16:12:06.201342 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60ca5b50-f927-4c9d-ad5e-c97819f391e8 req-dd0c2244-11a2-4b14-9f89-7358cd003c1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:06.203642 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60ca5b50-f927-4c9d-ad5e-c97819f391e8 req-dd0c2244-11a2-4b14-9f89-7358cd003c1a service neutron] 10.222.0.84 "GET /v2.0/networks?id=372dd2ac-a732-491f-b0d4-cbcb252de859 HTTP/1.1" status: 200 len: 897 time: 0.1414278 May 12 16:12:06.216048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdddb74d-e1e3-451a-ae6c-f1b67fea6679 req-e1ad3712-b5e3-45f4-a200-756c49d5208b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:06.218276 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdddb74d-e1e3-451a-ae6c-f1b67fea6679 req-e1ad3712-b5e3-45f4-a200-756c49d5208b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 945 time: 0.0946946 May 12 16:12:06.277693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdddb74d-e1e3-451a-ae6c-f1b67fea6679 req-a745f214-34d5-4a2a-bc57-adccc5b136ae tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0484629 May 12 16:12:06.297476 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55254) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:06.358243 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60ca5b50-f927-4c9d-ad5e-c97819f391e8 req-dde261ed-147b-42e6-ae0b-21e0b8b4698d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=32860e96-1fd7-4006-865b-b042900b312b HTTP/1.1" status: 200 len: 999 time: 0.1476154 May 12 16:12:06.411634 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9470456b-dec7-4534-ab9d-723418bd95b6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/77b1e68f-d15a-4580-b82b-a216adbb8e58 HTTP/1.1" status: 200 len: 991 time: 0.1125243 May 12 16:12:06.425714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8c22af28-2dc1-4e13-9def-62fb0f43bd37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:11:48Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '77b1e68f-d15a-4580-b82b-a216adbb8e58', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.167', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'port_id': '32860e96-1fd7-4006-865b-b042900b312b', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 4289, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'mac_address': 'fa:16:3e:b5:a7:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '363d3614-6b17-48e5-8590-d557bf57fc49', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:12:04Z', 'updated_at': '2022-05-12T16:12:04Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a2c2e0f5-590d-4081-9993-ec9718b5739c', 'name': '', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:43:5f:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 4286, 'fixed_ips': [{'subnet_id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:47Z', 'updated_at': '2022-05-12T16:11:53Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:06.427322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60ca5b50-f927-4c9d-ad5e-c97819f391e8 req-0f403de8-6754-440b-9c6f-3851313ccac5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:06.428754 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60ca5b50-f927-4c9d-ad5e-c97819f391e8 req-0f403de8-6754-440b-9c6f-3851313ccac5 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d121cd7e-6898-4997-b00a-4f1b0558f5f7 HTTP/1.1" status: 200 len: 835 time: 0.0644765 May 12 16:12:06.429753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c22af28-2dc1-4e13-9def-62fb0f43bd37 None None] Checking router: 0623ad63-ca1b-45af-95e5-0af159f492b3 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:12:06.438589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c22af28-2dc1-4e13-9def-62fb0f43bd37 None None] Routers {'0623ad63-ca1b-45af-95e5-0af159f492b3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:12:06.439192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8c22af28-2dc1-4e13-9def-62fb0f43bd37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:11:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0623ad63-ca1b-45af-95e5-0af159f492b3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:06.630827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60ca5b50-f927-4c9d-ad5e-c97819f391e8 req-93d3ce89-2847-4375-b01d-910d97275747 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:06.632560 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60ca5b50-f927-4c9d-ad5e-c97819f391e8 req-93d3ce89-2847-4375-b01d-910d97275747 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=372dd2ac-a732-491f-b0d4-cbcb252de859&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1980500 May 12 16:12:06.667976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8c22af28-2dc1-4e13-9def-62fb0f43bd37 None None] Set router 0623ad63-ca1b-45af-95e5-0af159f492b3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:12:06.794089 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60ca5b50-f927-4c9d-ad5e-c97819f391e8 req-65840b65-9faf-4b7f-a2ca-a9adee472714 service neutron] 10.222.0.84 "GET /v2.0/networks/372dd2ac-a732-491f-b0d4-cbcb252de859?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1542041 May 12 16:12:06.950967 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60ca5b50-f927-4c9d-ad5e-c97819f391e8 req-4b13d09c-8a8b-43e2-b377-56bf36305d8f service neutron] 10.222.0.84 "GET /v2.0/networks/372dd2ac-a732-491f-b0d4-cbcb252de859?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1508892 May 12 16:12:07.099566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8c22af28-2dc1-4e13-9def-62fb0f43bd37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:11:48Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '77b1e68f-d15a-4580-b82b-a216adbb8e58', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.167', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'port_id': '32860e96-1fd7-4006-865b-b042900b312b', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 4289, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'mac_address': 'fa:16:3e:b5:a7:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '363d3614-6b17-48e5-8590-d557bf57fc49', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:12:04Z', 'updated_at': '2022-05-12T16:12:04Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a2c2e0f5-590d-4081-9993-ec9718b5739c', 'name': '', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:43:5f:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 4286, 'fixed_ips': [{'subnet_id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:47Z', 'updated_at': '2022-05-12T16:11:53Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:07.103621 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c22af28-2dc1-4e13-9def-62fb0f43bd37 None None] The sync data for ids ['0623ad63-ca1b-45af-95e5-0af159f492b3'] in n-d-841483-1 is: [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:11:48Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '77b1e68f-d15a-4580-b82b-a216adbb8e58', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.167', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'port_id': '32860e96-1fd7-4006-865b-b042900b312b', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 4289, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'mac_address': 'fa:16:3e:b5:a7:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '363d3614-6b17-48e5-8590-d557bf57fc49', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:12:04Z', 'updated_at': '2022-05-12T16:12:04Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a2c2e0f5-590d-4081-9993-ec9718b5739c', 'name': '', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:43:5f:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 4286, 'fixed_ips': [{'subnet_id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:47Z', 'updated_at': '2022-05-12T16:11:53Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:12:07.293603 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d96f81ea-340e-4ef9-95b8-b9e317a36a22 None None] New status for floating IP 77b1e68f-d15a-4580-b82b-a216adbb8e58: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:12:07.415356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55258) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:07.523949 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9cd7bc37-9ba0-48a1-b67e-f6f2f5ab0aa3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/77b1e68f-d15a-4580-b82b-a216adbb8e58 HTTP/1.1" status: 200 len: 991 time: 0.1074572 May 12 16:12:08.527835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55262) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:08.629142 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b8b547fc-156f-4789-a922-058172371a10 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/77b1e68f-d15a-4580-b82b-a216adbb8e58 HTTP/1.1" status: 200 len: 993 time: 0.0997965 May 12 16:12:12.860851 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-20675ee5-f3ee-4be3-8dfe-94cecd7cc6f3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:13.715787 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:15.387957 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-68e011e3-054d-4506-84d3-88ad71104499 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:16.115663 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:16.400039 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:17.872374 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:24.965053 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:12:32.908906 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:33.314969 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5902ef66-eeca-4bf0-95f4-ce3450c9533a req-fdbfb5f2-609a-49f1-9e32-3dbfc992a375 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0866759 May 12 16:12:33.423861 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5902ef66-eeca-4bf0-95f4-ce3450c9533a req-a4d625b8-3207-4780-8975-4f12c197de77 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0434599 May 12 16:12:33.465712 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5902ef66-eeca-4bf0-95f4-ce3450c9533a req-1b0b62cf-f723-4d7a-b339-52a44bf7ff35 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0241115 May 12 16:12:33.597274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5902ef66-eeca-4bf0-95f4-ce3450c9533a req-05904e98-9374-4441-8603-ef1791d5bf37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:33.598622 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5902ef66-eeca-4bf0-95f4-ce3450c9533a req-05904e98-9374-4441-8603-ef1791d5bf37 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1271338 May 12 16:12:40.248352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-161fffce-bb4b-42e4-82b2-a008f162d135 req-e304348e-6917-4e3e-ba4b-7764837dff85 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:40.249853 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-161fffce-bb4b-42e4-82b2-a008f162d135 req-e304348e-6917-4e3e-ba4b-7764837dff85 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 945 time: 0.2591875 May 12 16:12:40.295413 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-161fffce-bb4b-42e4-82b2-a008f162d135 req-418f236f-b3e7-4a9c-a9a7-c0c47c449c9f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397680 May 12 16:12:41.490767 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc34c270-b34a-4b88-9348-fe674c62e51a req-51335d28-1c8d-4848-9fff-ea8a7b89c479 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:41.492181 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc34c270-b34a-4b88-9348-fe674c62e51a req-51335d28-1c8d-4848-9fff-ea8a7b89c479 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 945 time: 0.0809844 May 12 16:12:41.535952 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc34c270-b34a-4b88-9348-fe674c62e51a req-1c3a54a8-27b8-4a4e-94d2-731be23d7cdc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0379002 May 12 16:12:41.558376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55296) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:41.662647 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9d4a1355-e4e7-47aa-adf8-b0ea8ee934e6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/77b1e68f-d15a-4580-b82b-a216adbb8e58 HTTP/1.1" status: 200 len: 993 time: 0.1030846 May 12 16:12:42.863947 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0f4f4cca-36a9-438d-a7a4-10e0f5b50cfa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:43.132485 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b335606-394b-4e8b-b4e2-6f13673bef93 req-25890b80-8cde-4fb3-bfca-a8ebfbd28fb2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:43.133948 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b335606-394b-4e8b-b4e2-6f13673bef93 req-25890b80-8cde-4fb3-bfca-a8ebfbd28fb2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 945 time: 0.0811026 May 12 16:12:43.179953 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0b335606-394b-4e8b-b4e2-6f13673bef93 req-58408d7a-49e0-4807-88ef-62071cd48db1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390878 May 12 16:12:43.716782 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:44.368693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76beb272-d606-45fa-a4e4-71e3824de269 req-d8fe359d-8901-43d6-a1af-6e1c78e5dc44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:44.370157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-76beb272-d606-45fa-a4e4-71e3824de269 req-d8fe359d-8901-43d6-a1af-6e1c78e5dc44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 945 time: 0.0828233 May 12 16:12:44.413734 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-76beb272-d606-45fa-a4e4-71e3824de269 req-650dd980-63a9-48e7-a565-669bc8891681 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0380197 May 12 16:12:44.436847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55312) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:44.545810 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-08e06642-f3ec-49a9-86f4-fd26ebd3e003 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/77b1e68f-d15a-4580-b82b-a216adbb8e58 HTTP/1.1" status: 200 len: 993 time: 0.1076670 May 12 16:12:44.850229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55320) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:45.056357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port 994a38be-ac77-420c-b9b0-52a3b49e0e5c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:12:45.056731 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:45.227255 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:45.227584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:45.348855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for 994a38be-ac77-420c-b9b0-52a3b49e0e5c owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:12:45.389957 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a3f3cf37-c751-45b8-8c4c-30c478fc4335 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:45.499164 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:45.544253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=994a38be-ac77-420c-b9b0-52a3b49e0e5c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:45.581120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:45.581482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:45.581815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:45.582139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:45.582456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:45.582777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:45.583092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:45.583402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:45.583714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:45.584022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:45.584328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:45.584637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:45.754534 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:45.754766 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Floating IP 77b1e68f-d15a-4580-b82b-a216adbb8e58 disassociated (deleted). External IP: 172.25.8.167, port: 32860e96-1fd7-4006-865b-b042900b312b. May 12 16:12:46.098358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 0623ad63-ca1b-45af-95e5-0af159f492b3 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:12:46.119769 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:46.279552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:12:46.289032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cdd9cbe9-e816-41a9-8f2f-fc620e2e8c1a None None] Sync routers for ids ['0623ad63-ca1b-45af-95e5-0af159f492b3'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:12:46.292094 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:46.298223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cdd9cbe9-e816-41a9-8f2f-fc620e2e8c1a None None] Routers {'0623ad63-ca1b-45af-95e5-0af159f492b3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:12:46.298832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-cdd9cbe9-e816-41a9-8f2f-fc620e2e8c1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:12:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0623ad63-ca1b-45af-95e5-0af159f492b3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:46.349741 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-17709c82-5219-477c-9bc4-8379cef3e994 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/floatingips/77b1e68f-d15a-4580-b82b-a216adbb8e58 HTTP/1.1" status: 204 len: 168 time: 1.4983606 May 12 16:12:46.350242 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '363d3614-6b17-48e5-8590-d557bf57fc49', 'tag': '32860e96-1fd7-4006-865b-b042900b312b'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:12:46.395454 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-17cad3bf-b7e5-4406-bb10-e85a70366a6d'] response: {'name': 'network-changed', 'server_uuid': '363d3614-6b17-48e5-8590-d557bf57fc49', 'tag': '32860e96-1fd7-4006-865b-b042900b312b', 'status': 'completed', 'code': 200} May 12 16:12:46.504469 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-cdd9cbe9-e816-41a9-8f2f-fc620e2e8c1a None None] Set router 0623ad63-ca1b-45af-95e5-0af159f492b3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:12:46.535504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdbf6205-8a94-410f-a745-9ecaf3c4ecfa req-5fe126cc-a646-41ed-9c63-54d687138b94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:46.536993 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cdbf6205-8a94-410f-a745-9ecaf3c4ecfa req-5fe126cc-a646-41ed-9c63-54d687138b94 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 1096 time: 0.0811696 May 12 16:12:46.553835 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:46.689600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdbf6205-8a94-410f-a745-9ecaf3c4ecfa req-1b0dc704-82da-48c8-b269-e9844241ea2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:46.691206 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cdbf6205-8a94-410f-a745-9ecaf3c4ecfa req-1b0dc704-82da-48c8-b269-e9844241ea2b service neutron] 10.222.0.84 "GET /v2.0/networks?id=372dd2ac-a732-491f-b0d4-cbcb252de859 HTTP/1.1" status: 200 len: 897 time: 0.1445615 May 12 16:12:46.749870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4503398-4ddb-4b9e-a561-a0d7c6ed2512 req-f1b6fd7f-6535-4330-860e-e1af7b3e65bf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:46.752045 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e4503398-4ddb-4b9e-a561-a0d7c6ed2512 req-f1b6fd7f-6535-4330-860e-e1af7b3e65bf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 945 time: 0.0856287 May 12 16:12:46.760169 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cdbf6205-8a94-410f-a745-9ecaf3c4ecfa req-12b9032c-3a12-48f0-ad58-249440428cb2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=32860e96-1fd7-4006-865b-b042900b312b HTTP/1.1" status: 200 len: 217 time: 0.0621870 May 12 16:12:46.801372 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e4503398-4ddb-4b9e-a561-a0d7c6ed2512 req-835aefca-17c8-4228-a881-0c5bf147b633 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436838 May 12 16:12:46.833362 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdbf6205-8a94-410f-a745-9ecaf3c4ecfa req-8128bf7f-757b-4a8b-82d0-86c6ae14d42a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:46.834823 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cdbf6205-8a94-410f-a745-9ecaf3c4ecfa req-8128bf7f-757b-4a8b-82d0-86c6ae14d42a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=d121cd7e-6898-4997-b00a-4f1b0558f5f7 HTTP/1.1" status: 200 len: 835 time: 0.0685389 May 12 16:12:46.839433 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-cdd9cbe9-e816-41a9-8f2f-fc620e2e8c1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:11:48Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'a2c2e0f5-590d-4081-9993-ec9718b5739c', 'name': '', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:43:5f:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 4286, 'fixed_ips': [{'subnet_id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:47Z', 'updated_at': '2022-05-12T16:11:53Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:46.844226 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cdd9cbe9-e816-41a9-8f2f-fc620e2e8c1a None None] Checking router: 0623ad63-ca1b-45af-95e5-0af159f492b3 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:12:46.852394 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cdd9cbe9-e816-41a9-8f2f-fc620e2e8c1a None None] Routers {'0623ad63-ca1b-45af-95e5-0af159f492b3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:12:46.852972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-cdd9cbe9-e816-41a9-8f2f-fc620e2e8c1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:12:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0623ad63-ca1b-45af-95e5-0af159f492b3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:46.910660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdbf6205-8a94-410f-a745-9ecaf3c4ecfa req-001523ae-0898-4f16-9deb-08fa19e79190 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:46.912238 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cdbf6205-8a94-410f-a745-9ecaf3c4ecfa req-001523ae-0898-4f16-9deb-08fa19e79190 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=372dd2ac-a732-491f-b0d4-cbcb252de859&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0711918 May 12 16:12:47.033955 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-cdd9cbe9-e816-41a9-8f2f-fc620e2e8c1a None None] Set router 0623ad63-ca1b-45af-95e5-0af159f492b3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:12:47.075996 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cdbf6205-8a94-410f-a745-9ecaf3c4ecfa req-2065a4e4-9673-4e36-a34d-e0aefbb9d4ec service neutron] 10.222.0.84 "GET /v2.0/networks/372dd2ac-a732-491f-b0d4-cbcb252de859?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1300790 May 12 16:12:47.214310 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-cdbf6205-8a94-410f-a745-9ecaf3c4ecfa req-4de8c124-63fc-492c-8e80-4d2e03e94923 service neutron] 10.222.0.84 "GET /v2.0/networks/372dd2ac-a732-491f-b0d4-cbcb252de859?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1313322 May 12 16:12:47.390405 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-cdd9cbe9-e816-41a9-8f2f-fc620e2e8c1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:11:48Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'a2c2e0f5-590d-4081-9993-ec9718b5739c', 'name': '', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:43:5f:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 4286, 'fixed_ips': [{'subnet_id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:47Z', 'updated_at': '2022-05-12T16:11:53Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:47.394463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cdd9cbe9-e816-41a9-8f2f-fc620e2e8c1a None None] The sync data for ids ['0623ad63-ca1b-45af-95e5-0af159f492b3'] in n-d-841483-1 is: [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:11:48Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'a2c2e0f5-590d-4081-9993-ec9718b5739c', 'name': '', 'network_id': '372dd2ac-a732-491f-b0d4-cbcb252de859', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:43:5f:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 4286, 'fixed_ips': [{'subnet_id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:47Z', 'updated_at': '2022-05-12T16:11:53Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'd121cd7e-6898-4997-b00a-4f1b0558f5f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:12:47.601860 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea1e0620-0697-4225-b6f3-ddcac49e4a32 None None] New status for floating IP 77b1e68f-d15a-4580-b82b-a216adbb8e58: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:12:47.872171 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:48.037927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0339f8c-913d-44b7-bed9-6c79c41a2eb0 req-3d8340c8-70a6-49d5-b468-459c34d5c02d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:48.039366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0339f8c-913d-44b7-bed9-6c79c41a2eb0 req-3d8340c8-70a6-49d5-b468-459c34d5c02d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 945 time: 0.1276577 May 12 16:12:48.085327 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d0339f8c-913d-44b7-bed9-6c79c41a2eb0 req-ffcccd4d-20f2-4ee5-bdc9-185ab9c4a778 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397696 May 12 16:12:48.676240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2355ba3f-d90e-4279-8b0c-30ae10c38d19 req-2470b37e-12cc-4a0a-b740-f29f74fb9b01 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:48.676818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-2355ba3f-d90e-4279-8b0c-30ae10c38d19 req-2470b37e-12cc-4a0a-b740-f29f74fb9b01 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:12:48.694192 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-2355ba3f-d90e-4279-8b0c-30ae10c38d19 req-2470b37e-12cc-4a0a-b740-f29f74fb9b01 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:12:48.695292 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2355ba3f-d90e-4279-8b0c-30ae10c38d19 req-2470b37e-12cc-4a0a-b740-f29f74fb9b01 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 945 time: 0.0988591 May 12 16:12:48.873976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-2355ba3f-d90e-4279-8b0c-30ae10c38d19 req-e404dd2b-341a-4448-a755-7ea96eadc886 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port 32860e96-1fd7-4006-865b-b042900b312b {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:12:48.874324 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2355ba3f-d90e-4279-8b0c-30ae10c38d19 req-e404dd2b-341a-4448-a755-7ea96eadc886 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:49.128490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-2355ba3f-d90e-4279-8b0c-30ae10c38d19 req-e404dd2b-341a-4448-a755-7ea96eadc886 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port 32860e96-1fd7-4006-865b-b042900b312b, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=32860e96-1fd7-4006-865b-b042900b312b,segment=NetworkSegment(a92a5199-bc99-4977-9b40-9967a18957f3),segment_id=a92a5199-bc99-4977-9b40-9967a18957f3)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:12:49.128849 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2355ba3f-d90e-4279-8b0c-30ae10c38d19 req-e404dd2b-341a-4448-a755-7ea96eadc886 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:49.253330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-2355ba3f-d90e-4279-8b0c-30ae10c38d19 req-e404dd2b-341a-4448-a755-7ea96eadc886 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for 32860e96-1fd7-4006-865b-b042900b312b owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:12:49.281100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae57dd57-bf92-4149-afdc-b2ccdb6e57bb req-dc294e76-9f88-4a05-9f04-8e70b0d46ddd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:49.282628 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae57dd57-bf92-4149-afdc-b2ccdb6e57bb req-dc294e76-9f88-4a05-9f04-8e70b0d46ddd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=363d3614-6b17-48e5-8590-d557bf57fc49 HTTP/1.1" status: 200 len: 945 time: 0.0858769 May 12 16:12:49.327551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae57dd57-bf92-4149-afdc-b2ccdb6e57bb req-ed524f43-109d-4ca9-9100-6e27fdff0ffb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=8c4a7c2d-c682-4153-ab93-3e846956b00c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390675 May 12 16:12:49.400885 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2355ba3f-d90e-4279-8b0c-30ae10c38d19 req-e404dd2b-341a-4448-a755-7ea96eadc886 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:49.450659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e404dd2b-341a-4448-a755-7ea96eadc886 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=32860e96-1fd7-4006-865b-b042900b312b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:49.525799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-2355ba3f-d90e-4279-8b0c-30ae10c38d19 req-e404dd2b-341a-4448-a755-7ea96eadc886 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] No DVR routers for this DVR port 32860e96-1fd7-4006-865b-b042900b312b on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:12:49.528304 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-2355ba3f-d90e-4279-8b0c-30ae10c38d19 req-e404dd2b-341a-4448-a755-7ea96eadc886 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:49.531247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '363d3614-6b17-48e5-8590-d557bf57fc49', 'name': 'network-vif-deleted', 'tag': '32860e96-1fd7-4006-865b-b042900b312b'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:12:49.546942 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2355ba3f-d90e-4279-8b0c-30ae10c38d19 req-e404dd2b-341a-4448-a755-7ea96eadc886 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "DELETE /v2.0/ports/32860e96-1fd7-4006-865b-b042900b312b HTTP/1.1" status: 204 len: 173 time: 0.8441186 May 12 16:12:49.577326 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2bdb0421-8232-4933-8e97-a97ac167df7e'] response: {'server_uuid': '363d3614-6b17-48e5-8590-d557bf57fc49', 'name': 'network-vif-deleted', 'tag': '32860e96-1fd7-4006-865b-b042900b312b', 'status': 'completed', 'code': 200} May 12 16:12:50.425203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55344) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:50.985230 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42849bbb-0de3-4c98-973c-70c6c906285f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:51.447208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-42849bbb-0de3-4c98-973c-70c6c906285f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port a2c2e0f5-590d-4081-9993-ec9718b5739c {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:12:51.448125 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42849bbb-0de3-4c98-973c-70c6c906285f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:51.630655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-42849bbb-0de3-4c98-973c-70c6c906285f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port a2c2e0f5-590d-4081-9993-ec9718b5739c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=a2c2e0f5-590d-4081-9993-ec9718b5739c,segment=NetworkSegment(a92a5199-bc99-4977-9b40-9967a18957f3),segment_id=a92a5199-bc99-4977-9b40-9967a18957f3)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:12:51.630925 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42849bbb-0de3-4c98-973c-70c6c906285f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:51.751465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-42849bbb-0de3-4c98-973c-70c6c906285f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for a2c2e0f5-590d-4081-9993-ec9718b5739c owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:12:52.075812 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42849bbb-0de3-4c98-973c-70c6c906285f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:52.125602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42849bbb-0de3-4c98-973c-70c6c906285f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=a2c2e0f5-590d-4081-9993-ec9718b5739c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:52.397647 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-42849bbb-0de3-4c98-973c-70c6c906285f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:52.883295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-42849bbb-0de3-4c98-973c-70c6c906285f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 0623ad63-ca1b-45af-95e5-0af159f492b3 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:12:52.938939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 32860e96-1fd7-4006-865b-b042900b312b no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:12:52.978323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 32860e96-1fd7-4006-865b-b042900b312b {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:12:52.978665 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 32860e96-1fd7-4006-865b-b042900b312b not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:12:53.069757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42849bbb-0de3-4c98-973c-70c6c906285f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:12:53.079604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-999aac24-cd91-4513-aa21-16a491112f7f None None] Sync routers for ids ['0623ad63-ca1b-45af-95e5-0af159f492b3'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:12:53.083739 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-42849bbb-0de3-4c98-973c-70c6c906285f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "PUT /v2.0/routers/0623ad63-ca1b-45af-95e5-0af159f492b3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6574416 May 12 16:12:53.086475 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55348) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:53.088910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-999aac24-cd91-4513-aa21-16a491112f7f None None] Routers {'0623ad63-ca1b-45af-95e5-0af159f492b3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:12:53.089536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-999aac24-cd91-4513-aa21-16a491112f7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:12:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0623ad63-ca1b-45af-95e5-0af159f492b3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:53.151535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-73206374-39b9-487d-babf-55b1a2608726 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting subnet d121cd7e-6898-4997-b00a-4f1b0558f5f7 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:12:53.155532 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-73206374-39b9-487d-babf-55b1a2608726 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:53.219888 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-73206374-39b9-487d-babf-55b1a2608726 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:53.273906 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-999aac24-cd91-4513-aa21-16a491112f7f None None] Set router 0623ad63-ca1b-45af-95e5-0af159f492b3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:12:53.313472 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-73206374-39b9-487d-babf-55b1a2608726 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:53.386584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-73206374-39b9-487d-babf-55b1a2608726 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:53.429081 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73206374-39b9-487d-babf-55b1a2608726 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Subnet': ['ID=d121cd7e-6898-4997-b00a-4f1b0558f5f7,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:53.436325 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-73206374-39b9-487d-babf-55b1a2608726 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:53.443630 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-73206374-39b9-487d-babf-55b1a2608726 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/subnets/d121cd7e-6898-4997-b00a-4f1b0558f5f7 HTTP/1.1" status: 204 len: 168 time: 0.3560746 May 12 16:12:53.444910 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b178319-5bd0-4db0-a8ef-a6ffa8dfda2c None None] Network 372dd2ac-a732-491f-b0d4-cbcb252de859 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:12:53.446503 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55352) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:53.628270 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:53.734887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-999aac24-cd91-4513-aa21-16a491112f7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:12:52Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:53.738725 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-999aac24-cd91-4513-aa21-16a491112f7f None None] Checking router: 0623ad63-ca1b-45af-95e5-0af159f492b3 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:12:53.750490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-999aac24-cd91-4513-aa21-16a491112f7f None None] Routers {'0623ad63-ca1b-45af-95e5-0af159f492b3'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:12:53.751096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-999aac24-cd91-4513-aa21-16a491112f7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:12:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['0623ad63-ca1b-45af-95e5-0af159f492b3'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:53.805628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] DHCP port deletion for 372dd2ac-a732-491f-b0d4-cbcb252de859 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:12:53.816288 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:53.826891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port cae61808-db83-40e5-93c8-5a1930e6dcf8 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:12:53.827256 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:53.830802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Deleting port 224f60d2-797e-4d08-a43b-4fb0210d5a7c {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:12:53.831169 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:54.009901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port cae61808-db83-40e5-93c8-5a1930e6dcf8, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cae61808-db83-40e5-93c8-5a1930e6dcf8,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:12:54.010482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:54.040154 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-999aac24-cd91-4513-aa21-16a491112f7f None None] Set router 0623ad63-ca1b-45af-95e5-0af159f492b3 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:12:54.138964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for cae61808-db83-40e5-93c8-5a1930e6dcf8 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:12:54.334706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] For port 224f60d2-797e-4d08-a43b-4fb0210d5a7c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=224f60d2-797e-4d08-a43b-4fb0210d5a7c,segment=NetworkSegment(a92a5199-bc99-4977-9b40-9967a18957f3),segment_id=a92a5199-bc99-4977-9b40-9967a18957f3)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:12:54.335090 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:54.435472 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:54.469913 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Calling delete_port for 224f60d2-797e-4d08-a43b-4fb0210d5a7c owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:12:54.485049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=cae61808-db83-40e5-93c8-5a1930e6dcf8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:54.499084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 224f60d2-797e-4d08-a43b-4fb0210d5a7c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:12:54.585011 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:54.667372 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:54.751107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Port 224f60d2-797e-4d08-a43b-4fb0210d5a7c update to DOWN by agent not found {{(pid=88153) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2140}} May 12 16:12:54.752549 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] No DVR routers for this DVR port 224f60d2-797e-4d08-a43b-4fb0210d5a7c on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:12:54.754604 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Pushing event deleted for resources: {'Port': ['ID=224f60d2-797e-4d08-a43b-4fb0210d5a7c,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:54.769711 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:54.772534 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:54.776243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:54.776738 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:54.777121 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:54.777566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:54.778245 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:54.778909 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:54.779118 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:54.779437 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:54.779759 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:54.780161 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:54.780479 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:54.780793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee0cb7d1-5741-43a9-a684-d6dde56fd934 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:54.793633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-999aac24-cd91-4513-aa21-16a491112f7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:12:52Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:54.798686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-999aac24-cd91-4513-aa21-16a491112f7f None None] The sync data for ids ['0623ad63-ca1b-45af-95e5-0af159f492b3'] in n-d-841483-1 is: [{'id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-311112711', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242'}], 'enable_snat': True}, 'gw_port_id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:11:43Z', 'updated_at': '2022-05-12T16:12:52Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'cae61808-db83-40e5-93c8-5a1930e6dcf8', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:3e:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0623ad63-ca1b-45af-95e5-0af159f492b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4283, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:11:44Z', 'updated_at': '2022-05-12T16:11:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:12:54.801082 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:54.801988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Fanout notify agent at l3_agent the message router_deleted on router 0623ad63-ca1b-45af-95e5-0af159f492b3 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:12:54.819701 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:54.820780 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2fcd8a87-5f29-434b-8f50-2909af32d75f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/routers/0623ad63-ca1b-45af-95e5-0af159f492b3 HTTP/1.1" status: 204 len: 168 time: 1.3733907 May 12 16:12:54.823469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55356) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:54.949245 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8bb3e34a-1347-46a7-948b-5e56441d9695 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.085260 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8bb3e34a-1347-46a7-948b-5e56441d9695 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.110844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8bb3e34a-1347-46a7-948b-5e56441d9695 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['372dd2ac-a732-491f-b0d4-cbcb252de859']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:55.123295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8bb3e34a-1347-46a7-948b-5e56441d9695 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a92a5199-bc99-4977-9b40-9967a18957f3') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:55.123584 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-8bb3e34a-1347-46a7-948b-5e56441d9695 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a92a5199-bc99-4977-9b40-9967a18957f3') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:55.135665 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8bb3e34a-1347-46a7-948b-5e56441d9695 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.152178 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8bb3e34a-1347-46a7-948b-5e56441d9695 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.158662 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8bb3e34a-1347-46a7-948b-5e56441d9695 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Releasing vlan 596 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:12:55.159057 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8bb3e34a-1347-46a7-948b-5e56441d9695 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: timer() May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:12:55.174558 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:12:55.261861 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8bb3e34a-1347-46a7-948b-5e56441d9695 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.268329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8bb3e34a-1347-46a7-948b-5e56441d9695 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.297585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bb3e34a-1347-46a7-948b-5e56441d9695 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Network': ['ID=372dd2ac-a732-491f-b0d4-cbcb252de859,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:55.302204 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8bb3e34a-1347-46a7-948b-5e56441d9695 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/networks/372dd2ac-a732-491f-b0d4-cbcb252de859 HTTP/1.1" status: 204 len: 168 time: 0.4777946 May 12 16:12:55.304840 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55360) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:55.376576 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-44e3696e-bd30-462d-b41a-26c5d8a87faa tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.412621 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-44e3696e-bd30-462d-b41a-26c5d8a87faa tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.483884 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-44e3696e-bd30-462d-b41a-26c5d8a87faa tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.502983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44e3696e-bd30-462d-b41a-26c5d8a87faa tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c4a7c2d-c682-4153-ab93-3e846956b00c,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:55.512472 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-44e3696e-bd30-462d-b41a-26c5d8a87faa tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.513652 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-44e3696e-bd30-462d-b41a-26c5d8a87faa tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/security-groups/8c4a7c2d-c682-4153-ab93-3e846956b00c HTTP/1.1" status: 204 len: 168 time: 0.2077732 May 12 16:12:55.635579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55368) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:55.642036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-725691961', 'description': 'tempest-secgroup-smoke-725691961 description', 'project_id': 'f50049e6814046a9abf21905584f94e1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:12:55.648651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:12:55.652926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:12:55.656320 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:12:55.661870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:12:55.671717 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.691601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:12:55.695678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:12:55.698531 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:12:55.705472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:12:55.781399 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.785189 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.831219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroup': ['ID=183f4909-127b-46ed-8e00-da76f6d21486,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:55.836118 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.837473 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-66d5752c-147b-450d-a663-d8781150a590 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.2007306 May 12 16:12:55.840455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55372) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:55.846497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '183f4909-127b-46ed-8e00-da76f6d21486', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:12:55.853294 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:12:55.857248 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:12:55.860158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:12:55.866356 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:12:55.882224 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.943040 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.948989 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:55.976563 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=438db22b-af15-42af-82f7-e0a0ee85e5e1,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:55.987323 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:55.987670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:55.988009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:55.988340 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:55.988669 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:55.988998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:55.989327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:55.989678 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:55.990004 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:55.990324 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:55.990641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:55.991040 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:12:55.999478 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.000697 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7ae5f555-7c3d-42a5-8acd-fda5461141bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1586885 May 12 16:12:56.003557 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55376) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:56.008785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-b69a128f-e232-47eb-859f-5e00aba07b46 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '183f4909-127b-46ed-8e00-da76f6d21486', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:12:56.016215 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b69a128f-e232-47eb-859f-5e00aba07b46 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:12:56.020131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b69a128f-e232-47eb-859f-5e00aba07b46 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:12:56.023000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-b69a128f-e232-47eb-859f-5e00aba07b46 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:12:56.029350 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-b69a128f-e232-47eb-859f-5e00aba07b46 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:12:56.045117 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b69a128f-e232-47eb-859f-5e00aba07b46 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.110590 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b69a128f-e232-47eb-859f-5e00aba07b46 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.113964 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b69a128f-e232-47eb-859f-5e00aba07b46 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.136907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b69a128f-e232-47eb-859f-5e00aba07b46 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=accbf3ce-a343-42ba-8c16-c5ad4f60a6bf,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:56.146678 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b69a128f-e232-47eb-859f-5e00aba07b46 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.150316 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b69a128f-e232-47eb-859f-5e00aba07b46 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1431320 May 12 16:12:56.150494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55380) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:56.155769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1b595cfc-998e-4e0c-9e2a-d0964e208790 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '183f4909-127b-46ed-8e00-da76f6d21486', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:12:56.162424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1b595cfc-998e-4e0c-9e2a-d0964e208790 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:12:56.166297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1b595cfc-998e-4e0c-9e2a-d0964e208790 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:12:56.170477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1b595cfc-998e-4e0c-9e2a-d0964e208790 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:12:56.176068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1b595cfc-998e-4e0c-9e2a-d0964e208790 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:12:56.194030 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b595cfc-998e-4e0c-9e2a-d0964e208790 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.261438 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b595cfc-998e-4e0c-9e2a-d0964e208790 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.265858 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b595cfc-998e-4e0c-9e2a-d0964e208790 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.290696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b595cfc-998e-4e0c-9e2a-d0964e208790 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5fd1deb1-d9d2-421d-918a-1b10d2724fc9,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:56.301250 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1b595cfc-998e-4e0c-9e2a-d0964e208790 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.302470 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1b595cfc-998e-4e0c-9e2a-d0964e208790 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1511407 May 12 16:12:56.305253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55384) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:56.310254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-83dc885f-8805-4e71-b47e-0abb5c6edda5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '183f4909-127b-46ed-8e00-da76f6d21486', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:12:56.316726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-83dc885f-8805-4e71-b47e-0abb5c6edda5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:12:56.320832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-83dc885f-8805-4e71-b47e-0abb5c6edda5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:12:56.323690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-83dc885f-8805-4e71-b47e-0abb5c6edda5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:12:56.329940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-83dc885f-8805-4e71-b47e-0abb5c6edda5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:12:56.347339 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-83dc885f-8805-4e71-b47e-0abb5c6edda5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.412000 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-83dc885f-8805-4e71-b47e-0abb5c6edda5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.415555 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-83dc885f-8805-4e71-b47e-0abb5c6edda5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.439816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83dc885f-8805-4e71-b47e-0abb5c6edda5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3174e005-10ce-4cf1-b7b5-858811472eea,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:56.449479 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-83dc885f-8805-4e71-b47e-0abb5c6edda5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.451222 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-83dc885f-8805-4e71-b47e-0abb5c6edda5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1450033 May 12 16:12:56.454025 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55388) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:56.459054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-f35b989a-a8b7-47aa-a12b-e38215845edd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '183f4909-127b-46ed-8e00-da76f6d21486', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:12:56.465807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f35b989a-a8b7-47aa-a12b-e38215845edd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:12:56.470481 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f35b989a-a8b7-47aa-a12b-e38215845edd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:12:56.473294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-f35b989a-a8b7-47aa-a12b-e38215845edd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:12:56.478951 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-f35b989a-a8b7-47aa-a12b-e38215845edd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:12:56.487272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cae61808-db83-40e5-93c8-5a1930e6dcf8 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:12:56.490894 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-f35b989a-a8b7-47aa-a12b-e38215845edd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Project f50049e6814046a9abf21905584f94e1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:12:56.498137 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f35b989a-a8b7-47aa-a12b-e38215845edd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.521797 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: cae61808-db83-40e5-93c8-5a1930e6dcf8 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:12:56.522133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cae61808-db83-40e5-93c8-5a1930e6dcf8 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:12:56.522541 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a2c2e0f5-590d-4081-9993-ec9718b5739c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:12:56.556862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: a2c2e0f5-590d-4081-9993-ec9718b5739c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:12:56.557208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device a2c2e0f5-590d-4081-9993-ec9718b5739c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:12:56.566163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f35b989a-a8b7-47aa-a12b-e38215845edd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.570191 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f35b989a-a8b7-47aa-a12b-e38215845edd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.592280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f35b989a-a8b7-47aa-a12b-e38215845edd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d38dd044-d6c1-431e-96ec-846307d19100,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:56.601151 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f35b989a-a8b7-47aa-a12b-e38215845edd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.602335 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f35b989a-a8b7-47aa-a12b-e38215845edd tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1473980 May 12 16:12:56.604968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55392) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:56.610408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-1036ec78-69b6-428e-835c-145bc0efda52 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '183f4909-127b-46ed-8e00-da76f6d21486', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:12:56.616759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1036ec78-69b6-428e-835c-145bc0efda52 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:12:56.620480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1036ec78-69b6-428e-835c-145bc0efda52 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:12:56.624130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-1036ec78-69b6-428e-835c-145bc0efda52 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:12:56.629750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-1036ec78-69b6-428e-835c-145bc0efda52 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:12:56.639895 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-1036ec78-69b6-428e-835c-145bc0efda52 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Project f50049e6814046a9abf21905584f94e1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:12:56.646153 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1036ec78-69b6-428e-835c-145bc0efda52 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.710117 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1036ec78-69b6-428e-835c-145bc0efda52 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.713627 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1036ec78-69b6-428e-835c-145bc0efda52 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.737161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1036ec78-69b6-428e-835c-145bc0efda52 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=326ce36f-1264-4b9b-b995-fffe7842f4d2,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:56.746185 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1036ec78-69b6-428e-835c-145bc0efda52 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.747515 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1036ec78-69b6-428e-835c-145bc0efda52 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1415377 May 12 16:12:56.750301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55396) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:56.755493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'network': {'name': 'tempest-network-smoke--542980261', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'port_security_enabled': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:12:56.760939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:12:56.765090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:network and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:12:56.768017 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:12:56.773976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:12:56.786628 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:12:56.790004 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.915944 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 578} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:12:56.924372 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.924719 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Added segment 8b20c3b5-a1ae-42f8-808b-76bcb14601cc of type vlan for network 354ba4a6-049f-4366-92ec-a25cf1ee982d May 12 16:12:56.951683 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.979499 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:56.985364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:56.985981 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:57.096029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.3447175 May 12 16:12:57.098844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55400) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:57.104001 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'admin_state_up': True, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:12:57.105018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75cb3268-6793-43cc-84e1-3e01a6627582 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Network': ['ID=354ba4a6-049f-4366-92ec-a25cf1ee982d,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:57.114051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:12:57.115539 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 354ba4a6-049f-4366-92ec-a25cf1ee982d details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:12:57.118305 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:router and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:12:57.121070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:12:57.129144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:12:57.139891 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:57.140910 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:57.156475 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:57.431013 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:57.845470 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:57.874924 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:58.008642 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.25.8.53 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/69f44e18-c1cb-47d8-9851-fc24eae74651) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:12:58.154583 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:58.183375 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:58.259247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:12:58.262224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:12:58.266129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:12:58.304881 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=69f44e18-c1cb-47d8-9851-fc24eae74651,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:12:58.683355 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:59.036128 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:59.368762 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 16:12:59.541484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:12:59.551662 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Sync routers for ids ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:12:59.561194 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Routers {'2fb26cea-49ef-41a0-84d5-9dc84143bc8f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:12:59.561888 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:12:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:12:59.569478 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:12:59.570654 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-25ca7957-7810-4f3e-a21b-1f19816d0906 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 894 time: 2.4708288 May 12 16:12:59.573883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55404) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:59.618892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0134c71f-72a7-49a3-827f-ad26af1b08d1 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=f50049e6814046a9abf21905584f94e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0437298 May 12 16:12:59.621274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55408) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:59.752846 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436e35f3-abe3-4f79-8324-1c3877a23e94 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:12:59.754339 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-436e35f3-abe3-4f79-8324-1c3877a23e94 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1321633 May 12 16:12:59.757123 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55412) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:59.777193 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Set router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:12:59.799670 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dffd5330-3484-4916-93cf-1a4ff18351bf tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0414515 May 12 16:12:59.802366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55416) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:12:59.808432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1874530667', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:12:59.922175 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:12:59.925846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:subnet and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:12:59.928560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:12:59.934312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:12:59.947041 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:12:59.951740 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:00.066494 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:12:58Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:12:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:13:00.070965 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Checking router: 2fb26cea-49ef-41a0-84d5-9dc84143bc8f for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:13:00.071482 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Updating router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f port 69f44e18-c1cb-47d8-9851-fc24eae74651 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:13:00.125962 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:00.176386 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:00.258230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Subnet': ['ID=ca2f4e65-126d-4f50-87d1-dc9039e572fe,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:00.267579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Checking segment: {'id': '8b20c3b5-a1ae-42f8-808b-76bcb14601cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:13:00.267945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network hostable DHCP agents. Network: 354ba4a6-049f-4366-92ec-a25cf1ee982d, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:13:00.287888 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 354ba4a6-049f-4366-92ec-a25cf1ee982d is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:13:00.297753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 354ba4a6-049f-4366-92ec-a25cf1ee982d) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:13:00.301634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:00.302213 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:00.308619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cb1b10b-d2e5-4ed0-84be-ca1d2bd1dff9 None None] Network 354ba4a6-049f-4366-92ec-a25cf1ee982d requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:13:00.323721 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bf6081af-0e9b-4353-a5b3-60bb0b042ff4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.5200601 May 12 16:13:00.327194 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55420) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:13:00.470776 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:00.484754 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Transition to ACTIVE for port object 69f44e18-c1cb-47d8-9851-fc24eae74651 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:13:00.491920 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:00.551963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-354ba4a6-049f-4366-92ec-a25cf1ee982d', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ips': [{'subnet_id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:13:00.553052 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:00.563408 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f768ca07-d3a2-4908-b98b-ac25c43440fb None None] Pushing event updated for resources: {'Port': ['ID=69f44e18-c1cb-47d8-9851-fc24eae74651,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:00.578875 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f768ca07-d3a2-4908-b98b-ac25c43440fb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:13:00.578875 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f768ca07-d3a2-4908-b98b-ac25c43440fb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:13:00.579224 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f768ca07-d3a2-4908-b98b-ac25c43440fb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:13:00.579746 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f768ca07-d3a2-4908-b98b-ac25c43440fb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:13:00.580072 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f768ca07-d3a2-4908-b98b-ac25c43440fb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:13:00.580394 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f768ca07-d3a2-4908-b98b-ac25c43440fb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:13:00.580715 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f768ca07-d3a2-4908-b98b-ac25c43440fb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:13:00.581026 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f768ca07-d3a2-4908-b98b-ac25c43440fb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:13:00.581345 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f768ca07-d3a2-4908-b98b-ac25c43440fb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:13:00.581682 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f768ca07-d3a2-4908-b98b-ac25c43440fb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:13:00.581995 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f768ca07-d3a2-4908-b98b-ac25c43440fb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:13:00.582311 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f768ca07-d3a2-4908-b98b-ac25c43440fb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:13:00.594430 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Attempting to bind port 69f44e18-c1cb-47d8-9851-fc24eae74651 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:13:00.594789 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Attempting to bind port 69f44e18-c1cb-47d8-9851-fc24eae74651 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:13:00.595139 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Attempting to bind port 69f44e18-c1cb-47d8-9851-fc24eae74651 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:13:00.600503 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 12, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:13:00.600866 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:13:00.601256 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:00.601668 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:13:00.602123 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Bound port: 69f44e18-c1cb-47d8-9851-fc24eae74651, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:13:00.602483 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:00.677984 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] For port 69f44e18-c1cb-47d8-9851-fc24eae74651, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:13:00.681367 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] For port 69f44e18-c1cb-47d8-9851-fc24eae74651, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=69f44e18-c1cb-47d8-9851-fc24eae74651,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:13:00.686975 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:00.720501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Allocated IP 172.20.0.2 (354ba4a6-049f-4366-92ec-a25cf1ee982d/ca2f4e65-126d-4f50-87d1-dc9039e572fe/11609ab3-6414-463b-b5ae-7cb4d7283cac) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:13:00.763694 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Routers {'2fb26cea-49ef-41a0-84d5-9dc84143bc8f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:13:00.764295 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:12:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:13:00.857848 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f768ca07-d3a2-4908-b98b-ac25c43440fb None None] Pushing event updated for resources: {'Port': ['ID=69f44e18-c1cb-47d8-9851-fc24eae74651,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:00.941612 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:00.955452 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Transition to ACTIVE for port object 11609ab3-6414-463b-b5ae-7cb4d7283cac will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:13:00.963334 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] Set router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:13:00.976266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Transition to ACTIVE for port object 11609ab3-6414-463b-b5ae-7cb4d7283cac will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:13:00.984294 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:01.062906 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:01.097490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Network 354ba4a6-049f-4366-92ec-a25cf1ee982d is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:13:01.100262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:13:01.104297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:13:01.138595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Pushing event updated for resources: {'Port': ['ID=11609ab3-6414-463b-b5ae-7cb4d7283cac,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:01.204270 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Attempting to bind port 11609ab3-6414-463b-b5ae-7cb4d7283cac on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:13:01.204625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Attempting to bind port 11609ab3-6414-463b-b5ae-7cb4d7283cac by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '8b20c3b5-a1ae-42f8-808b-76bcb14601cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:13:01.204902 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Attempting to bind port 11609ab3-6414-463b-b5ae-7cb4d7283cac on network 354ba4a6-049f-4366-92ec-a25cf1ee982d {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:13:01.210878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 12, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:13:01.212672 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Checking segment: {'id': '8b20c3b5-a1ae-42f8-808b-76bcb14601cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:13:01.213474 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:01.214091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Bound using segment: {'id': '8b20c3b5-a1ae-42f8-808b-76bcb14601cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:13:01.215487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Bound port: 11609ab3-6414-463b-b5ae-7cb4d7283cac, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8b20c3b5-a1ae-42f8-808b-76bcb14601cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:13:01.216780 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:01.309476 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:12:58Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:13:01.313637 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08d43a46-fe21-4ffc-8333-208e9f7a98bd None None] The sync data for ids ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'] in n-d-841483-1 is: [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:12:58Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:13:01.325471 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] For port 11609ab3-6414-463b-b5ae-7cb4d7283cac, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:13:01.329341 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] For port 11609ab3-6414-463b-b5ae-7cb4d7283cac, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=11609ab3-6414-463b-b5ae-7cb4d7283cac,segment=NetworkSegment(8b20c3b5-a1ae-42f8-808b-76bcb14601cc),segment_id=8b20c3b5-a1ae-42f8-808b-76bcb14601cc)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:13:01.333857 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:01.421671 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d31952df-da0e-413c-a8b3-066772f26d6d None None] Pushing event updated for resources: {'Port': ['ID=11609ab3-6414-463b-b5ae-7cb4d7283cac,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:01.665633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.20.0.1 (354ba4a6-049f-4366-92ec-a25cf1ee982d/ca2f4e65-126d-4f50-87d1-dc9039e572fe/2e794133-e3a0-4b85-b3b2-a2e25bdb59a5) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:13:01.849589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:01.866268 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Transition to ACTIVE for port object 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:13:01.890873 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:01.961589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 354ba4a6-049f-4366-92ec-a25cf1ee982d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:13:01.964901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:13:01.966507 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:13:01.969456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:13:02.004111 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=2e794133-e3a0-4b85-b3b2-a2e25bdb59a5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:02.036200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:02.322062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:02.490114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e92c99ed-e229-43ee-81fe-d8c488d2ba1b None None] Network 354ba4a6-049f-4366-92ec-a25cf1ee982d requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:13:02.574258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 69f44e18-c1cb-47d8-9851-fc24eae74651 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:13:02.643833 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-9595152d-27f2-489d-886b-f10f4a6fcae6 None None] Provisioning for port 11609ab3-6414-463b-b5ae-7cb4d7283cac completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:13:02.714780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 69f44e18-c1cb-47d8-9851-fc24eae74651 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:13:02.734069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 69f44e18-c1cb-47d8-9851-fc24eae74651 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:13:02.734438 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:02.778878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:02.785714 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:02.907439 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=2e794133-e3a0-4b85-b3b2-a2e25bdb59a5,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:02.910050 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:02.924013 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:02.928500 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:02.949584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 69f44e18-c1cb-47d8-9851-fc24eae74651, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=69f44e18-c1cb-47d8-9851-fc24eae74651,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:13:02.955447 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:02.956241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 11609ab3-6414-463b-b5ae-7cb4d7283cac up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:13:03.094460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=69f44e18-c1cb-47d8-9851-fc24eae74651,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:03.105097 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 11609ab3-6414-463b-b5ae-7cb4d7283cac completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:13:03.111931 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 11609ab3-6414-463b-b5ae-7cb4d7283cac triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:13:03.112303 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:03.194435 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 354ba4a6-049f-4366-92ec-a25cf1ee982d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:13:03.195368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8947a496-6a9c-41ed-b710-228e3835dde9 None None] Provisioning complete for port 11609ab3-6414-463b-b5ae-7cb4d7283cac triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:13:03.195594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:13:03.195770 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8947a496-6a9c-41ed-b710-228e3835dde9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:03.316342 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:03.396401 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 11609ab3-6414-463b-b5ae-7cb4d7283cac, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=11609ab3-6414-463b-b5ae-7cb4d7283cac,segment=NetworkSegment(8b20c3b5-a1ae-42f8-808b-76bcb14601cc),segment_id=8b20c3b5-a1ae-42f8-808b-76bcb14601cc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:13:03.404296 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:03.406252 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:13:03.447298 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8947a496-6a9c-41ed-b710-228e3835dde9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:03.535622 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=11609ab3-6414-463b-b5ae-7cb4d7283cac,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:03.560529 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-8947a496-6a9c-41ed-b710-228e3835dde9 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:13:03.560875 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-8947a496-6a9c-41ed-b710-228e3835dde9 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:13:03.621089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:13:03.630807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Sync routers for ids ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:13:03.634500 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9040f978-9ea1-4889-89e8-243ad138fcf9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "PUT /v2.0/routers/2fb26cea-49ef-41a0-84d5-9dc84143bc8f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3058839 May 12 16:13:03.640483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Routers {'2fb26cea-49ef-41a0-84d5-9dc84143bc8f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:13:03.641076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:12:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:13:03.801001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-9f9b4aeb-5bcd-410d-abe6-454c7a72ce3b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-725691961&fields=id&tenant_id=f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 267 time: 0.0422053 May 12 16:13:03.821871 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Set router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:13:03.961312 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-f568f839-f9a2-4088-a7de-a2a085dcca62 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:03.962736 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-f568f839-f9a2-4088-a7de-a2a085dcca62 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/networks?id=354ba4a6-049f-4366-92ec-a25cf1ee982d HTTP/1.1" status: 200 len: 796 time: 0.1552966 May 12 16:13:03.978330 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-797519ac-3df1-44a1-b200-12c7003b3d78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/quotas/f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 375 time: 0.0095062 May 12 16:13:04.061881 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-977059b5-1a2c-4e52-9893-1bd3e548d5c2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0778279 May 12 16:13:04.201554 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-5e0f9efe-eeae-4d31-b10d-2c4cc6c7b851 service neutron] 10.222.0.82 "GET /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1279278 May 12 16:13:04.201786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8947a496-6a9c-41ed-b710-228e3835dde9 None None] Provisioning for port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:13:04.211567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8947a496-6a9c-41ed-b710-228e3835dde9 None None] Provisioning complete for port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:13:04.211942 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8947a496-6a9c-41ed-b710-228e3835dde9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:04.279824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8947a496-6a9c-41ed-b710-228e3835dde9 None None] Port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:13:04.296919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2e794133-e3a0-4b85-b3b2-a2e25bdb59a5', 'name': '', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:d3:93:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4305, 'fixed_ips': [{'subnet_id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:13:01Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 2, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:13:04.301034 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Checking router: 2fb26cea-49ef-41a0-84d5-9dc84143bc8f for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:13:04.301328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Updating router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:13:04.341932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-e2096402-6000-4979-8569-eabcb1181931 service neutron] 10.222.0.82 "GET /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1325717 May 12 16:13:04.354867 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:04.470290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-2967639e-2233-4de5-b182-19f2458f03c2 None None] Provisioning complete for port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:13:04.471002 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2967639e-2233-4de5-b182-19f2458f03c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:04.518784 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 69f44e18-c1cb-47d8-9851-fc24eae74651 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:13:04.533293 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-22755b35-28b3-496a-8f89-9386539447b6 req-299b5594-b234-47fd-8138-ecf1ef09ebed tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 210 time: 0.0494821 May 12 16:13:04.604028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-2967639e-2233-4de5-b182-19f2458f03c2 None None] Port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:13:04.702305 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 69f44e18-c1cb-47d8-9851-fc24eae74651 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:13:04.702673 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:04.902787 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 11609ab3-6414-463b-b5ae-7cb4d7283cac up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:13:04.942655 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:04.967562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Transition to ACTIVE for port object 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:13:04.976178 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:05.140529 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23d9793c-9796-49f3-9aed-781f2e841a58 None None] Pushing event updated for resources: {'Port': ['ID=2e794133-e3a0-4b85-b3b2-a2e25bdb59a5,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:05.147819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 11609ab3-6414-463b-b5ae-7cb4d7283cac triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:13:05.148095 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:05.258173 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Attempting to bind port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:13:05.258531 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Attempting to bind port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '8b20c3b5-a1ae-42f8-808b-76bcb14601cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:13:05.258883 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Attempting to bind port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 on network 354ba4a6-049f-4366-92ec-a25cf1ee982d {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:13:05.272109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 12, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:13:05.272464 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Checking segment: {'id': '8b20c3b5-a1ae-42f8-808b-76bcb14601cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:13:05.272885 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:05.273257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Bound using segment: {'id': '8b20c3b5-a1ae-42f8-808b-76bcb14601cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:13:05.273711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Bound port: 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8b20c3b5-a1ae-42f8-808b-76bcb14601cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:13:05.274080 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:05.456734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] For port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:13:05.459885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] For port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2e794133-e3a0-4b85-b3b2-a2e25bdb59a5,segment=NetworkSegment(8b20c3b5-a1ae-42f8-808b-76bcb14601cc),segment_id=8b20c3b5-a1ae-42f8-808b-76bcb14601cc)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:13:05.463486 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:05.540436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Routers {'2fb26cea-49ef-41a0-84d5-9dc84143bc8f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:13:05.541054 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:12:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:13:05.600954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23d9793c-9796-49f3-9aed-781f2e841a58 None None] Pushing event updated for resources: {'Port': ['ID=2e794133-e3a0-4b85-b3b2-a2e25bdb59a5,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:05.659878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e305b288-8e0b-498e-9e80-58a1bd223480 req-07f87c02-ef70-44ce-8fb2-a793343d1a52 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 210 time: 0.0612714 May 12 16:13:05.759184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] Set router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:13:06.086118 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2e794133-e3a0-4b85-b3b2-a2e25bdb59a5', 'name': '', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:d3:93:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4305, 'fixed_ips': [{'subnet_id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:13:01Z', 'updated_at': '2022-05-12T16:13:05Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:13:06.089987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ad6d068-cc52-4cc7-809d-b9a10d3dce5b None None] The sync data for ids ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'] in n-d-841483-1 is: [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2e794133-e3a0-4b85-b3b2-a2e25bdb59a5', 'name': '', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:d3:93:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4305, 'fixed_ips': [{'subnet_id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:13:01Z', 'updated_at': '2022-05-12T16:13:05Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:13:06.513860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:13:06.591311 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:13:06.596637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:13:06.597113 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:06.729198 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:06.767846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2e794133-e3a0-4b85-b3b2-a2e25bdb59a5,segment=NetworkSegment(8b20c3b5-a1ae-42f8-808b-76bcb14601cc),segment_id=8b20c3b5-a1ae-42f8-808b-76bcb14601cc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:13:06.773287 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:06.813272 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6b1dd687-7786-4ec4-80e8-1a8f9ad8cce5 req-e912b5ac-b131-423d-88bd-4992ae14d30e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 210 time: 0.0500879 May 12 16:13:06.854231 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=2e794133-e3a0-4b85-b3b2-a2e25bdb59a5,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:07.935981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-6cf351b2-57b4-4857-9980-67e492719b0d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:07.936667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-6cf351b2-57b4-4857-9980-67e492719b0d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:13:07.955469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-6cf351b2-57b4-4857-9980-67e492719b0d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:13:07.956036 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-6cf351b2-57b4-4857-9980-67e492719b0d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/networks?id=354ba4a6-049f-4366-92ec-a25cf1ee982d HTTP/1.1" status: 200 len: 796 time: 0.1707156 May 12 16:13:07.973802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-afeed5da-fd7f-4662-b781-fda998c1b219 req-49ec1ca2-49a7-4e97-a4e2-860e8653e272 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 210 time: 0.0497503 May 12 16:13:08.035387 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-9e7f27c9-8ced-4f87-9b95-e685977b1fb8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:13:08.051358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-9e7f27c9-8ced-4f87-9b95-e685977b1fb8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:13:08.052721 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-9e7f27c9-8ced-4f87-9b95-e685977b1fb8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 379 time: 0.0618920 May 12 16:13:08.072468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'port': {'device_id': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'admin_state_up': True, 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'security_groups': ['183f4909-127b-46ed-8e00-da76f6d21486']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:13:08.208529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:13:08.212611 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:port and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:13:08.216001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:13:08.222312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:13:08.233603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:13:08.237129 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:08.400681 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.20.0.9 (354ba4a6-049f-4366-92ec-a25cf1ee982d/ca2f4e65-126d-4f50-87d1-dc9039e572fe/d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:13:08.493113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:13:08.564224 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:13:08.564584 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:08.597807 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:08.613711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Transition to ACTIVE for port object d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:13:08.643841 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:08.717087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 354ba4a6-049f-4366-92ec-a25cf1ee982d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:13:08.720035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:13:08.722410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:13:08.781651 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:08.807390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:08.808009 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:08.834234 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-4b5f4c17-c7dd-4db3-a4d9-e360e4dce283 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7656217 May 12 16:13:08.903338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Request body: {'port': {'device_id': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:13:08.931830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ba939de8-a579-49f4-a038-c924d8e01b4a None None] Provisioning for port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:13:08.937164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ba939de8-a579-49f4-a038-c924d8e01b4a None None] Provisioning complete for port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:13:08.937569 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ba939de8-a579-49f4-a038-c924d8e01b4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:08.996172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ba939de8-a579-49f4-a038-c924d8e01b4a None None] Port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:13:09.013662 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:09.179008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eff4f2b7-6e49-4e5a-8c1d-944682cfeab5 req-e1bb530c-063a-479d-8dd8-24cb61c097ea tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:09.180562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eff4f2b7-6e49-4e5a-8c1d-944682cfeab5 req-e1bb530c-063a-479d-8dd8-24cb61c097ea tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 931 time: 0.0805809 May 12 16:13:09.227948 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eff4f2b7-6e49-4e5a-8c1d-944682cfeab5 req-f28d2b42-ca82-4918-9fcf-9bc0e8fa5e65 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396841 May 12 16:13:09.483949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:13:09.491312 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:09.505414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Transition to ACTIVE for port object d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:13:09.509533 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:09.678825 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Pushing event updated for resources: {'Port': ['ID=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:09.758240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Attempting to bind port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:13:09.758570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Attempting to bind port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '8b20c3b5-a1ae-42f8-808b-76bcb14601cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:13:09.758894 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Attempting to bind port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa on network 354ba4a6-049f-4366-92ec-a25cf1ee982d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:13:09.763469 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa on network 354ba4a6-049f-4366-92ec-a25cf1ee982d not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:13:09.763783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Attempting to bind port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa on network 354ba4a6-049f-4366-92ec-a25cf1ee982d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:13:09.768797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 12, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:13:09.769129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Checking segment: {'id': '8b20c3b5-a1ae-42f8-808b-76bcb14601cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:13:09.769641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Bound using segment: {'id': '8b20c3b5-a1ae-42f8-808b-76bcb14601cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:13:09.770186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Bound port: d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8b20c3b5-a1ae-42f8-808b-76bcb14601cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 578, 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:13:09.770591 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:09.864946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] For port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:13:09.867767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] For port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa,segment=NetworkSegment(8b20c3b5-a1ae-42f8-808b-76bcb14601cc),segment_id=8b20c3b5-a1ae-42f8-808b-76bcb14601cc)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:13:09.872112 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:09.934789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:09.935597 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:09.936999 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] 10.222.0.84 "PUT /v2.0/ports/d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa HTTP/1.1" status: 200 len: 1091 time: 1.0822003 May 12 16:13:09.937444 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'tag': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:13:09.960529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0520acc1-da34-4ec5-b21d-78a97daec1b0 service neutron] Pushing event updated for resources: {'Port': ['ID=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:10.048181 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9496a440-42e0-4951-8e23-0da8bc36b758'] response: {'name': 'network-changed', 'server_uuid': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'tag': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa', 'status': 'completed', 'code': 200} May 12 16:13:10.077899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-c6afadd7-6e81-4962-9da9-b1c599e6d152 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:10.079303 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-c6afadd7-6e81-4962-9da9-b1c599e6d152 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 1094 time: 0.0866656 May 12 16:13:10.160391 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-0912a106-6aa5-4899-ad3e-c2fe6b4138ba service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa HTTP/1.1" status: 200 len: 217 time: 0.0673892 May 12 16:13:10.224988 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-c0f183a9-12c8-4aa4-9763-12198ee7dfe9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:10.226462 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-c0f183a9-12c8-4aa4-9763-12198ee7dfe9 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ca2f4e65-126d-4f50-87d1-dc9039e572fe HTTP/1.1" status: 200 len: 835 time: 0.0576770 May 12 16:13:10.308652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-10be079d-4ca2-4873-ba73-84b811f19a63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:10.310952 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-10be079d-4ca2-4873-ba73-84b811f19a63 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=354ba4a6-049f-4366-92ec-a25cf1ee982d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0745666 May 12 16:13:10.433867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8eb3016-9004-4f35-bb30-62c12e4236ad req-4cb15cfe-6da7-4f88-aa25-b9f3b7b9e50e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:10.435910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8eb3016-9004-4f35-bb30-62c12e4236ad req-4cb15cfe-6da7-4f88-aa25-b9f3b7b9e50e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 943 time: 0.0971332 May 12 16:13:10.454647 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-660851ad-f294-4e48-8e7b-67a822de5ed2 service neutron] 10.222.0.84 "GET /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1339946 May 12 16:13:10.481151 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a8eb3016-9004-4f35-bb30-62c12e4236ad req-3cd6cdca-df28-4d31-8dd6-301eac7962d2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394595 May 12 16:13:10.591215 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0e408331-c8a1-428e-955d-b683c9a3d7d0 req-dd803ad2-9f83-4607-b849-d974dc8be476 service neutron] 10.222.0.84 "GET /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1272647 May 12 16:13:10.766756 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496a44ab-6efb-4a4a-a4bf-fc594126f346 req-b0bc4d3e-e9bb-48c8-8b2a-de44419f199d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:10.768221 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-496a44ab-6efb-4a4a-a4bf-fc594126f346 req-b0bc4d3e-e9bb-48c8-8b2a-de44419f199d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 1094 time: 0.0695119 May 12 16:13:10.901826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496a44ab-6efb-4a4a-a4bf-fc594126f346 req-2226636d-97a2-4396-8698-2e75d5291429 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:10.903855 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-496a44ab-6efb-4a4a-a4bf-fc594126f346 req-2226636d-97a2-4396-8698-2e75d5291429 service neutron] 10.222.0.84 "GET /v2.0/networks?id=354ba4a6-049f-4366-92ec-a25cf1ee982d HTTP/1.1" status: 200 len: 897 time: 0.1280079 May 12 16:13:10.975126 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-496a44ab-6efb-4a4a-a4bf-fc594126f346 req-68e39e09-85e7-41a7-98fd-0c17d313c42c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa HTTP/1.1" status: 200 len: 217 time: 0.0650213 May 12 16:13:11.037965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496a44ab-6efb-4a4a-a4bf-fc594126f346 req-1b4ed033-2fe7-4ff4-80bd-7a29f764d547 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:11.039289 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-496a44ab-6efb-4a4a-a4bf-fc594126f346 req-1b4ed033-2fe7-4ff4-80bd-7a29f764d547 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ca2f4e65-126d-4f50-87d1-dc9039e572fe HTTP/1.1" status: 200 len: 835 time: 0.0572500 May 12 16:13:11.120641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496a44ab-6efb-4a4a-a4bf-fc594126f346 req-828eb9f3-2209-4c21-9914-815fd6999daa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:11.122249 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-496a44ab-6efb-4a4a-a4bf-fc594126f346 req-828eb9f3-2209-4c21-9914-815fd6999daa service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=354ba4a6-049f-4366-92ec-a25cf1ee982d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0763521 May 12 16:13:11.372479 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-496a44ab-6efb-4a4a-a4bf-fc594126f346 req-b897b394-a8c5-45be-8d26-5c09c029ab81 service neutron] 10.222.0.84 "GET /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2431855 May 12 16:13:11.504747 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-496a44ab-6efb-4a4a-a4bf-fc594126f346 req-2d9dc672-f8ce-4e6a-a424-ad6b71e43ad3 service neutron] 10.222.0.84 "GET /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1253507 May 12 16:13:11.671857 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec48ad4e-6a20-48de-809f-f6a056abe80a req-de628537-04ba-40c4-a6eb-311387efe345 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:11.673261 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec48ad4e-6a20-48de-809f-f6a056abe80a req-de628537-04ba-40c4-a6eb-311387efe345 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 943 time: 0.0860519 May 12 16:13:11.720530 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec48ad4e-6a20-48de-809f-f6a056abe80a req-7342b953-bbd5-4261-8f39-81aa5acbd7b6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416775 May 12 16:13:12.867028 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-35238066-8e27-41cf-bb99-7ae0d4b438f9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:12.904350 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18c5b854-2ca4-432d-8060-3f83ccaad1d6 req-6c3e4faa-2de1-4254-850c-d2d21b29917b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:12.905797 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18c5b854-2ca4-432d-8060-3f83ccaad1d6 req-6c3e4faa-2de1-4254-850c-d2d21b29917b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 943 time: 0.0795314 May 12 16:13:12.949504 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18c5b854-2ca4-432d-8060-3f83ccaad1d6 req-fe3fa18e-5b2a-4567-a077-20d00425b741 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0380344 May 12 16:13:13.731903 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:14.136623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b7126d7-cedc-4619-a0cf-cbb745934c52 req-3720a4ff-34b7-4eb8-be6a-46b248bf6b28 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:14.138227 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b7126d7-cedc-4619-a0cf-cbb745934c52 req-3720a4ff-34b7-4eb8-be6a-46b248bf6b28 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 943 time: 0.0831256 May 12 16:13:14.182871 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3b7126d7-cedc-4619-a0cf-cbb745934c52 req-01a25dc5-505b-4681-aae7-9cb7e518af44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385087 May 12 16:13:14.978443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:13:15.111151 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa,segment=NetworkSegment(8b20c3b5-a1ae-42f8-808b-76bcb14601cc),segment_id=8b20c3b5-a1ae-42f8-808b-76bcb14601cc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:13:15.124590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'port_id': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa', 'mac_address': 'fa:16:3e:2b:3d:63', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 578, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:13:15.178458 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:15.195564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:13:15.210673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa,segment=NetworkSegment(8b20c3b5-a1ae-42f8-808b-76bcb14601cc),segment_id=8b20c3b5-a1ae-42f8-808b-76bcb14601cc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:13:15.216894 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:15.290658 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:15.374199 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53625eff-d160-4350-88da-db6b7c23915e req-6a6de8be-1e40-4eb4-b9fe-c8b0ff0bf690 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:15.375637 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-53625eff-d160-4350-88da-db6b7c23915e req-6a6de8be-1e40-4eb4-b9fe-c8b0ff0bf690 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 944 time: 0.0839264 May 12 16:13:15.391648 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc003be9-6268-4ddd-a454-258534588646 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:15.419977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-53625eff-d160-4350-88da-db6b7c23915e req-85123030-347e-4342-ac68-86453850ad07 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0383365 May 12 16:13:15.548655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:13:16.121839 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:16.404303 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:16.606559 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c80148e-6108-4ca3-8d0d-06beb9c6f79a req-9f7330dc-5934-4bbe-8473-0a5ea8dcf6ee tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:16.608005 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c80148e-6108-4ca3-8d0d-06beb9c6f79a req-9f7330dc-5934-4bbe-8473-0a5ea8dcf6ee tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 944 time: 0.0855389 May 12 16:13:16.652329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2c80148e-6108-4ca3-8d0d-06beb9c6f79a req-cee77439-469a-4256-b68f-267fe9fb505d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0380795 May 12 16:13:16.978196 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:13:17.046993 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:13:17.051762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:13:17.052130 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:17.170727 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:17.197785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:13:17.208650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa,segment=NetworkSegment(8b20c3b5-a1ae-42f8-808b-76bcb14601cc),segment_id=8b20c3b5-a1ae-42f8-808b-76bcb14601cc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:13:17.213221 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:17.285342 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:17.297173 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ceef406f-2304-40b1-81d3-ae61db1ca524'] response: {'server_uuid': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa', 'code': 200} May 12 16:13:17.465318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65cfb2f4-1f12-4eb1-b31a-2dd5d66f54cf req-906ff808-b63e-4038-bec6-4200319a1252 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:17.466820 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-65cfb2f4-1f12-4eb1-b31a-2dd5d66f54cf req-906ff808-b63e-4038-bec6-4200319a1252 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 1096 time: 0.0698926 May 12 16:13:17.511046 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-65cfb2f4-1f12-4eb1-b31a-2dd5d66f54cf req-c11d0ed2-6075-4f37-872d-facb804ed33b service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0346315 May 12 16:13:17.838684 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-634e0834-720d-4c87-8755-787860c8c97e req-89c9a390-072d-4375-a23a-07262847f0e6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:17.840044 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-634e0834-720d-4c87-8755-787860c8c97e req-89c9a390-072d-4375-a23a-07262847f0e6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0833628 May 12 16:13:17.876880 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:17.888800 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-634e0834-720d-4c87-8755-787860c8c97e req-cb41f378-3189-4b83-9ca5-e34666eebf91 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423982 May 12 16:13:19.095011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7851b038-a24f-4d00-9f10-9c20b84c558b req-81da87d0-abf7-4b76-8aa6-5b7264162689 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:19.096452 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7851b038-a24f-4d00-9f10-9c20b84c558b req-81da87d0-abf7-4b76-8aa6-5b7264162689 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.1007111 May 12 16:13:19.142522 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7851b038-a24f-4d00-9f10-9c20b84c558b req-aa25b96f-fada-40c0-ae22-aca637680897 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402410 May 12 16:13:19.331512 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c9d9abd-e708-4844-9e5b-32ebce06a31b req-0114d28b-617f-4aa8-b006-eb86cc8ca215 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:19.332950 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c9d9abd-e708-4844-9e5b-32ebce06a31b req-0114d28b-617f-4aa8-b006-eb86cc8ca215 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0833495 May 12 16:13:19.385580 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3c9d9abd-e708-4844-9e5b-32ebce06a31b req-bbcb23f3-1295-4271-b7a9-1f22282f9f08 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467055 May 12 16:13:19.409359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55490) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:13:19.482492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abc32169-2780-40b9-a1b9-253bb25ace98 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:19.483962 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-abc32169-2780-40b9-a1b9-253bb25ace98 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 1091 time: 0.0736132 May 12 16:13:19.486917 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55494) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:13:19.492110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address': '172.20.0.9'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:13:19.499508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:13:19.503564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:floatingip and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:13:19.506407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:13:19.512170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:13:19.523342 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:19.660145 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:19.795899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.25.8.194 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/4d015179-ef0d-42a0-9e5c-c3cc5bb55623) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:13:19.948434 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:19.977971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:20.043530 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:13:20.046783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:13:20.050529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:13:20.086679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=4d015179-ef0d-42a0-9e5c-c3cc5bb55623,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:20.486799 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:20.563378 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:20.879986 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:20.885296 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:20.997560 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=4d015179-ef0d-42a0-9e5c-c3cc5bb55623,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:13:21.007573 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:21.192517 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Floating IP 13f66680-0d14-43d4-9809-25f1ca378cd5 associated. External IP: 172.25.8.194, port: d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa. May 12 16:13:21.545607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:13:21.722529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:13:21.732366 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67e06943-82f2-4559-892f-12523afbc3dc None None] Sync routers for ids ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:13:21.741170 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67e06943-82f2-4559-892f-12523afbc3dc None None] Routers {'2fb26cea-49ef-41a0-84d5-9dc84143bc8f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:13:21.741788 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-67e06943-82f2-4559-892f-12523afbc3dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:13:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:13:21.747621 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:21.803206 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4bb8cf3f-0513-4752-9c53-d6507ea21826 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.3149960 May 12 16:13:21.803698 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'tag': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:13:21.854989 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-55681b1a-2e04-454a-a042-140af01a5711'] response: {'name': 'network-changed', 'server_uuid': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'tag': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa', 'status': 'completed', 'code': 200} May 12 16:13:21.917748 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-67e06943-82f2-4559-892f-12523afbc3dc None None] Set router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:13:21.979949 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b872bc22-45bf-4b6d-9f5b-65ceb35c4f8d req-76284087-817b-4cad-8472-a3f3f375181f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:21.981943 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b872bc22-45bf-4b6d-9f5b-65ceb35c4f8d req-76284087-817b-4cad-8472-a3f3f375181f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 1096 time: 0.0826418 May 12 16:13:21.993096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4724dc-df46-4e30-ba34-9013944c3751 req-22868bc8-eec6-486e-bd52-07acd52ab64d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:21.994587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d4724dc-df46-4e30-ba34-9013944c3751 req-22868bc8-eec6-486e-bd52-07acd52ab64d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0879071 May 12 16:13:22.039797 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5d4724dc-df46-4e30-ba34-9013944c3751 req-912575a5-530f-4c3a-b138-0d0eae1b24ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0383770 May 12 16:13:22.064685 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55502) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:13:22.116800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b872bc22-45bf-4b6d-9f5b-65ceb35c4f8d req-0c9cf395-8ab9-401f-bb4e-bfed6199e8a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:22.118311 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b872bc22-45bf-4b6d-9f5b-65ceb35c4f8d req-0c9cf395-8ab9-401f-bb4e-bfed6199e8a4 service neutron] 10.222.0.84 "GET /v2.0/networks?id=354ba4a6-049f-4366-92ec-a25cf1ee982d HTTP/1.1" status: 200 len: 897 time: 0.1312981 May 12 16:13:22.229708 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b872bc22-45bf-4b6d-9f5b-65ceb35c4f8d req-45918c78-20f0-4a0b-bdc4-a5ec75acbf6c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa HTTP/1.1" status: 200 len: 999 time: 0.1044059 May 12 16:13:22.286350 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-67e06943-82f2-4559-892f-12523afbc3dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '13f66680-0d14-43d4-9809-25f1ca378cd5', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.194', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'port_id': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 4308, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'mac_address': 'fa:16:3e:2b:3d:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:13:20Z', 'updated_at': '2022-05-12T16:13:20Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2e794133-e3a0-4b85-b3b2-a2e25bdb59a5', 'name': '', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:d3:93:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4305, 'fixed_ips': [{'subnet_id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:13:01Z', 'updated_at': '2022-05-12T16:13:06Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:13:22.289693 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-46ddd549-ad14-4775-b711-b8fd603a105a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/13f66680-0d14-43d4-9809-25f1ca378cd5 HTTP/1.1" status: 200 len: 991 time: 0.2236059 May 12 16:13:22.292196 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67e06943-82f2-4559-892f-12523afbc3dc None None] Checking router: 2fb26cea-49ef-41a0-84d5-9dc84143bc8f for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:13:22.302225 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67e06943-82f2-4559-892f-12523afbc3dc None None] Routers {'2fb26cea-49ef-41a0-84d5-9dc84143bc8f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:13:22.302818 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-67e06943-82f2-4559-892f-12523afbc3dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:13:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:13:22.309980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b872bc22-45bf-4b6d-9f5b-65ceb35c4f8d req-b7b3cfdf-3f1b-4c7f-b35a-616dae58bfa6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:22.311535 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b872bc22-45bf-4b6d-9f5b-65ceb35c4f8d req-b7b3cfdf-3f1b-4c7f-b35a-616dae58bfa6 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ca2f4e65-126d-4f50-87d1-dc9039e572fe HTTP/1.1" status: 200 len: 835 time: 0.0752428 May 12 16:13:22.486967 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-67e06943-82f2-4559-892f-12523afbc3dc None None] Set router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:13:22.511582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b872bc22-45bf-4b6d-9f5b-65ceb35c4f8d req-f0cdd81c-4dbe-4960-9827-c772184b2ed8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:22.513738 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b872bc22-45bf-4b6d-9f5b-65ceb35c4f8d req-f0cdd81c-4dbe-4960-9827-c772184b2ed8 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=354ba4a6-049f-4366-92ec-a25cf1ee982d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1958575 May 12 16:13:22.644259 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b872bc22-45bf-4b6d-9f5b-65ceb35c4f8d req-82f708bd-baa6-4a7a-a218-0a76b9c2af31 service neutron] 10.222.0.84 "GET /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1243575 May 12 16:13:22.779712 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b872bc22-45bf-4b6d-9f5b-65ceb35c4f8d req-c1642e75-ec57-47d9-8c71-5bcdd0af4efb service neutron] 10.222.0.84 "GET /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1280732 May 12 16:13:22.857497 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-67e06943-82f2-4559-892f-12523afbc3dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '13f66680-0d14-43d4-9809-25f1ca378cd5', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.194', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'port_id': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 4308, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'mac_address': 'fa:16:3e:2b:3d:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:13:20Z', 'updated_at': '2022-05-12T16:13:20Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2e794133-e3a0-4b85-b3b2-a2e25bdb59a5', 'name': '', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:d3:93:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4305, 'fixed_ips': [{'subnet_id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:13:01Z', 'updated_at': '2022-05-12T16:13:06Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:13:22.861399 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67e06943-82f2-4559-892f-12523afbc3dc None None] The sync data for ids ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'] in n-d-841483-1 is: [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '13f66680-0d14-43d4-9809-25f1ca378cd5', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.194', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'port_id': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 4308, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'mac_address': 'fa:16:3e:2b:3d:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:13:20Z', 'updated_at': '2022-05-12T16:13:20Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2e794133-e3a0-4b85-b3b2-a2e25bdb59a5', 'name': '', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:d3:93:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4305, 'fixed_ips': [{'subnet_id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:13:01Z', 'updated_at': '2022-05-12T16:13:06Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:13:23.039400 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9b893da-53bb-4013-8867-fa478a2f9cf2 None None] New status for floating IP 13f66680-0d14-43d4-9809-25f1ca378cd5: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:13:23.292705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55508) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:13:23.399406 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-148cebe5-5254-4174-8a4f-f7c93c38584d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/13f66680-0d14-43d4-9809-25f1ca378cd5 HTTP/1.1" status: 200 len: 993 time: 0.1055596 May 12 16:13:32.905262 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:33.267128 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-33964e77-860f-433a-8638-741e937aba20 req-342c8eb5-7620-449f-a32e-d46950a3f54f service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0411010 May 12 16:13:33.389987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-33964e77-860f-433a-8638-741e937aba20 req-2424951a-9bd4-4f0e-a268-adc2dae4d7a4 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0468161 May 12 16:13:33.432359 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-33964e77-860f-433a-8638-741e937aba20 req-57c6431f-c873-4a11-a516-639a80f2ac3e service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0240335 May 12 16:13:33.567066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33964e77-860f-433a-8638-741e937aba20 req-d0d34cd5-a630-4fad-91a4-f8850c889f47 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:33.568384 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-33964e77-860f-433a-8638-741e937aba20 req-d0d34cd5-a630-4fad-91a4-f8850c889f47 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1288929 May 12 16:13:38.966281 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:13:42.869523 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ee6b7ea5-f56c-4c94-8afa-313c990faaa8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:43.733400 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:45.395278 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1289454c-8b9c-4404-ab62-65fda6f64f1b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:46.126010 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:46.406462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:47.879246 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:13:57.908152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84473e38-ecf6-40df-827a-6113f6525c73 req-bae18758-e1a2-4e0d-a625-aa02f7dca908 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:57.910141 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-84473e38-ecf6-40df-827a-6113f6525c73 req-bae18758-e1a2-4e0d-a625-aa02f7dca908 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 1096 time: 0.0725172 May 12 16:13:57.922821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0782cfb1-13bb-4386-9528-975124f66259 req-cc34f5df-ff65-482f-8399-5d3ccd3e8c1d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:57.924264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0782cfb1-13bb-4386-9528-975124f66259 req-cc34f5df-ff65-482f-8399-5d3ccd3e8c1d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0815523 May 12 16:13:57.972426 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0782cfb1-13bb-4386-9528-975124f66259 req-bb4a1df9-0c72-4c8f-a3eb-e29fd40ff3a5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419128 May 12 16:13:58.048448 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84473e38-ecf6-40df-827a-6113f6525c73 req-c49906fc-fdbc-4802-af86-41b7cd59a747 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:58.049905 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-84473e38-ecf6-40df-827a-6113f6525c73 req-c49906fc-fdbc-4802-af86-41b7cd59a747 service neutron] 10.222.0.84 "GET /v2.0/networks?id=354ba4a6-049f-4366-92ec-a25cf1ee982d HTTP/1.1" status: 200 len: 897 time: 0.1337235 May 12 16:13:58.151933 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-84473e38-ecf6-40df-827a-6113f6525c73 req-1ac99729-d156-42da-96ef-e6ffe532079a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa HTTP/1.1" status: 200 len: 1001 time: 0.0952718 May 12 16:13:58.219273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84473e38-ecf6-40df-827a-6113f6525c73 req-95ba9931-b979-4d8f-8599-22ae08888bb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:58.220584 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-84473e38-ecf6-40df-827a-6113f6525c73 req-95ba9931-b979-4d8f-8599-22ae08888bb2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ca2f4e65-126d-4f50-87d1-dc9039e572fe HTTP/1.1" status: 200 len: 835 time: 0.0595551 May 12 16:13:58.295474 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84473e38-ecf6-40df-827a-6113f6525c73 req-51700a8f-b260-4300-ac0c-60797addd3e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:58.296944 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-84473e38-ecf6-40df-827a-6113f6525c73 req-51700a8f-b260-4300-ac0c-60797addd3e6 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=354ba4a6-049f-4366-92ec-a25cf1ee982d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0692837 May 12 16:13:58.427970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-84473e38-ecf6-40df-827a-6113f6525c73 req-39c1ec9c-e638-4f53-8c65-d0257c7475fb service neutron] 10.222.0.84 "GET /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1237702 May 12 16:13:58.563657 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-84473e38-ecf6-40df-827a-6113f6525c73 req-18a16023-daf7-415a-a190-9dccdbe97845 service neutron] 10.222.0.84 "GET /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1280930 May 12 16:13:58.764190 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065353d4-71e7-46c2-803e-ffbdb37e1aa5 req-511886e7-99c7-472e-aa49-0777f317d781 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:58.765654 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-065353d4-71e7-46c2-803e-ffbdb37e1aa5 req-511886e7-99c7-472e-aa49-0777f317d781 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 1096 time: 0.0694456 May 12 16:13:58.909336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065353d4-71e7-46c2-803e-ffbdb37e1aa5 req-02c09a1f-9271-4652-9ea6-7baa000d3785 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:58.911440 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-065353d4-71e7-46c2-803e-ffbdb37e1aa5 req-02c09a1f-9271-4652-9ea6-7baa000d3785 service neutron] 10.222.0.84 "GET /v2.0/networks?id=354ba4a6-049f-4366-92ec-a25cf1ee982d HTTP/1.1" status: 200 len: 897 time: 0.1268318 May 12 16:13:59.018290 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-065353d4-71e7-46c2-803e-ffbdb37e1aa5 req-4ab6e30e-018b-428e-82c9-4feb31c13b7e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa HTTP/1.1" status: 200 len: 1001 time: 0.0979257 May 12 16:13:59.166948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ee1d641-2714-440c-b13e-a2e3242d363d req-07cc6124-5418-4228-8f4c-fb1790efb057 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:59.168362 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4ee1d641-2714-440c-b13e-a2e3242d363d req-07cc6124-5418-4228-8f4c-fb1790efb057 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0872402 May 12 16:13:59.199555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065353d4-71e7-46c2-803e-ffbdb37e1aa5 req-2571ee30-6c0b-4dd2-9453-05ee14421abc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:59.201004 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-065353d4-71e7-46c2-803e-ffbdb37e1aa5 req-2571ee30-6c0b-4dd2-9453-05ee14421abc service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ca2f4e65-126d-4f50-87d1-dc9039e572fe HTTP/1.1" status: 200 len: 835 time: 0.1753275 May 12 16:13:59.214587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4ee1d641-2714-440c-b13e-a2e3242d363d req-3c831251-5409-4faf-8e86-ed39a326ff39 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404415 May 12 16:13:59.277108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065353d4-71e7-46c2-803e-ffbdb37e1aa5 req-55eef249-7caa-4e8f-972f-59a72f80a3a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:13:59.278599 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-065353d4-71e7-46c2-803e-ffbdb37e1aa5 req-55eef249-7caa-4e8f-972f-59a72f80a3a9 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=354ba4a6-049f-4366-92ec-a25cf1ee982d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0705235 May 12 16:13:59.409047 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-065353d4-71e7-46c2-803e-ffbdb37e1aa5 req-467ff7ca-d2d7-46ad-bbd5-5ebf11a18aa2 service neutron] 10.222.0.84 "GET /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1228113 May 12 16:13:59.540494 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-065353d4-71e7-46c2-803e-ffbdb37e1aa5 req-690c504a-c3ad-446d-85ba-bf32172579ce service neutron] 10.222.0.84 "GET /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1261470 May 12 16:14:00.401781 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37684c5e-aeaa-42ef-847f-8ff66268bffe req-da64f09d-f051-469f-81ed-97fcfe61b0a3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:00.403246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37684c5e-aeaa-42ef-847f-8ff66268bffe req-da64f09d-f051-469f-81ed-97fcfe61b0a3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0826755 May 12 16:14:00.447552 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-37684c5e-aeaa-42ef-847f-8ff66268bffe req-ce50a5a6-0b1a-4de6-989a-776de72f98fc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0386159 May 12 16:14:01.631791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc354db7-5e82-423f-9361-3c584e3b4c3a req-6b1748be-d718-4224-9a76-5c4eff9ff2b1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:01.633158 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc354db7-5e82-423f-9361-3c584e3b4c3a req-6b1748be-d718-4224-9a76-5c4eff9ff2b1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0799201 May 12 16:14:01.677037 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc354db7-5e82-423f-9361-3c584e3b4c3a req-f76a701a-0c0d-4f65-8989-5ce92d27cf3f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0382934 May 12 16:14:02.866819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05e583ec-3673-4784-8f3f-092fb068bd30 req-429771a8-b598-4c67-a91d-d3876fc48e0b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:02.868244 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05e583ec-3673-4784-8f3f-092fb068bd30 req-429771a8-b598-4c67-a91d-d3876fc48e0b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0846121 May 12 16:14:02.904923 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:02.913001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-05e583ec-3673-4784-8f3f-092fb068bd30 req-8e17a180-b8c5-4081-9df8-7fd3242bfb08 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390875 May 12 16:14:04.094489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaaa1e06-498d-49e8-ad6c-a594688094ee req-836d6e93-2b9c-4653-942f-12321f27975c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:04.095929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eaaa1e06-498d-49e8-ad6c-a594688094ee req-836d6e93-2b9c-4653-942f-12321f27975c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0790882 May 12 16:14:04.144016 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eaaa1e06-498d-49e8-ad6c-a594688094ee req-982a654b-df6b-4421-8166-d9099a04a16c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419197 May 12 16:14:05.330473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49784988-93a8-4bc7-abdf-8ff31ebb3f2f req-c8efc491-36b8-4eda-8883-6963f2e08c4b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:05.332026 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49784988-93a8-4bc7-abdf-8ff31ebb3f2f req-c8efc491-36b8-4eda-8883-6963f2e08c4b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0801406 May 12 16:14:05.375228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-49784988-93a8-4bc7-abdf-8ff31ebb3f2f req-2c074848-6384-4987-8158-7fb0e1000a36 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0373094 May 12 16:14:06.560139 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94850e39-64a6-457c-a8db-1024c8282d86 req-fc41b37b-14c6-4608-b01b-c11b66018ef6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:06.561665 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-94850e39-64a6-457c-a8db-1024c8282d86 req-fc41b37b-14c6-4608-b01b-c11b66018ef6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0832760 May 12 16:14:06.607746 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-94850e39-64a6-457c-a8db-1024c8282d86 req-92447526-f14c-420b-8341-4ddf1432c8bb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396814 May 12 16:14:07.791910 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4b8c4c-d784-4942-9ee7-4b3a196aeb63 req-f0a85a51-3bd1-42e3-aa7c-f1c346d26e53 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:07.793376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae4b8c4c-d784-4942-9ee7-4b3a196aeb63 req-f0a85a51-3bd1-42e3-aa7c-f1c346d26e53 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0798583 May 12 16:14:07.837011 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ae4b8c4c-d784-4942-9ee7-4b3a196aeb63 req-ca02a2c1-2d68-4c21-87a1-d6f5a16fe704 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0380125 May 12 16:14:09.032631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d25163-e1b9-42cb-836b-3bba283c31aa req-0b944e5e-67ef-46b7-b75b-5e4afc93614a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:09.034112 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28d25163-e1b9-42cb-836b-3bba283c31aa req-0b944e5e-67ef-46b7-b75b-5e4afc93614a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0897002 May 12 16:14:09.078834 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-28d25163-e1b9-42cb-836b-3bba283c31aa req-8ffb1dd0-ac34-4061-9351-d186b125b9f5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0387840 May 12 16:14:10.260980 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b21fe7b1-fb12-4be4-aa5d-c0d99712b3ec req-7e322f39-e498-4df6-9df0-186aa6f10dac tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:10.262460 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b21fe7b1-fb12-4be4-aa5d-c0d99712b3ec req-7e322f39-e498-4df6-9df0-186aa6f10dac tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0802574 May 12 16:14:10.306258 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b21fe7b1-fb12-4be4-aa5d-c0d99712b3ec req-2b317e01-93d8-4bd3-a889-21a296453bb5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0380018 May 12 16:14:11.497198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ecb0d88-3941-4bfd-8a3e-bb352beb2bbd req-325e514c-705d-439f-8716-677da53d58d8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:11.498771 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4ecb0d88-3941-4bfd-8a3e-bb352beb2bbd req-325e514c-705d-439f-8716-677da53d58d8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0847540 May 12 16:14:11.546976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4ecb0d88-3941-4bfd-8a3e-bb352beb2bbd req-46db52e6-c6bd-46b3-824e-98072cf0348b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404453 May 12 16:14:12.732247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d820f1e-e176-40c1-98cc-5ca4b35f178d req-51b05a96-571e-453f-88ea-8892da329d01 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:12.733725 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0d820f1e-e176-40c1-98cc-5ca4b35f178d req-51b05a96-571e-453f-88ea-8892da329d01 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0798891 May 12 16:14:12.781947 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0d820f1e-e176-40c1-98cc-5ca4b35f178d req-c1fa4903-8f13-485c-b41b-a1bf260d29d4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426540 May 12 16:14:12.871501 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a7525ea8-11f7-49f4-b526-ddd2350d2829 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:13.745748 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:13.968453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcc4435d-fd9b-4367-b795-7adf707e542f req-caf701d7-88c5-4bdf-bba4-ebea7d7d7fbc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:13.969921 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bcc4435d-fd9b-4367-b795-7adf707e542f req-caf701d7-88c5-4bdf-bba4-ebea7d7d7fbc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0826702 May 12 16:14:14.014757 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bcc4435d-fd9b-4367-b795-7adf707e542f req-7ad506d4-bfb2-4e08-a0d2-f89803333c49 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388846 May 12 16:14:15.206898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f9a45ad-2eef-44f8-8735-e4cdbe04e6bb req-f3d65783-8ee3-4f4b-ac4c-aa615b1d7c68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:15.209020 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f9a45ad-2eef-44f8-8735-e4cdbe04e6bb req-f3d65783-8ee3-4f4b-ac4c-aa615b1d7c68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0839789 May 12 16:14:15.252847 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f9a45ad-2eef-44f8-8735-e4cdbe04e6bb req-cf51674e-98fe-466c-be95-a8b0d36ee0af tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0380402 May 12 16:14:15.277244 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55568) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:15.387037 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4e6b6762-c29d-45b7-ba6d-199fdd1ef355 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/13f66680-0d14-43d4-9809-25f1ca378cd5 HTTP/1.1" status: 200 len: 993 time: 0.1086421 May 12 16:14:15.398534 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4e74cf92-981c-4c2c-95bf-0fd9a366fd68 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:15.965719 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:14:16.127693 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:16.408790 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:17.882119 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:32.906456 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:34.300096 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8d1ef7ee-ff2b-42ab-8b17-94e19c99a8e4 req-184ae2d7-758e-44c2-b0cf-8592fd0f76b9 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0434799 May 12 16:14:34.411578 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8d1ef7ee-ff2b-42ab-8b17-94e19c99a8e4 req-9454f7be-11a8-4a0c-b5e0-095b020ee5b9 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0456343 May 12 16:14:34.454811 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8d1ef7ee-ff2b-42ab-8b17-94e19c99a8e4 req-ba1918c1-2dcc-4b78-b888-240451c7160d service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0257115 May 12 16:14:34.594072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d1ef7ee-ff2b-42ab-8b17-94e19c99a8e4 req-41fca8ee-db7d-4e5a-adb9-441339c1a215 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:34.595430 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8d1ef7ee-ff2b-42ab-8b17-94e19c99a8e4 req-41fca8ee-db7d-4e5a-adb9-441339c1a215 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1351655 May 12 16:14:42.875446 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2f41d410-1eaa-4a9a-a3c8-de81409aa3bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:43.761036 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:45.401890 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d4247e45-fee1-4bf3-8e3f-cc82bd41e1ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:46.133656 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:46.411769 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:47.856101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55584) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:47.885157 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:48.165748 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port 4d015179-ef0d-42a0-9e5c-c3cc5bb55623 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:14:48.165983 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:48.340444 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:48.340771 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:48.461398 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for 4d015179-ef0d-42a0-9e5c-c3cc5bb55623 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:14:48.613176 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:48.660264 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=4d015179-ef0d-42a0-9e5c-c3cc5bb55623,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:48.697014 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:48.697343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:48.697695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:48.698020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:48.698336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:48.698652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:48.698965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:48.699277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:48.699588 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:48.699894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:48.700272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:48.701041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:48.762391 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:48.763340 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Floating IP 13f66680-0d14-43d4-9809-25f1ca378cd5 disassociated (deleted). External IP: 172.25.8.194, port: d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa. May 12 16:14:49.116531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:14:49.304740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:14:49.314958 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8d07521-f0aa-4d38-8c8a-28a10b87dac9 None None] Sync routers for ids ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:14:49.323281 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:49.324415 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8d07521-f0aa-4d38-8c8a-28a10b87dac9 None None] Routers {'2fb26cea-49ef-41a0-84d5-9dc84143bc8f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:14:49.325009 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a8d07521-f0aa-4d38-8c8a-28a10b87dac9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:14:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:14:49.378884 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7d9b9241-ff17-4164-8aac-00be631415cc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/floatingips/13f66680-0d14-43d4-9809-25f1ca378cd5 HTTP/1.1" status: 204 len: 168 time: 1.5215967 May 12 16:14:49.379584 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'tag': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:14:49.438804 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-861660b8-dd52-416c-b3f6-3d67f41f9f36'] response: {'name': 'network-changed', 'server_uuid': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'tag': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa', 'status': 'completed', 'code': 200} May 12 16:14:49.510326 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-a8d07521-f0aa-4d38-8c8a-28a10b87dac9 None None] Set router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:14:49.555645 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3006b3b-8cd6-4480-b079-e0edfdd4d03c req-6d1c93e3-e665-4205-9e8b-1cf29c2ae8d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:49.558710 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3006b3b-8cd6-4480-b079-e0edfdd4d03c req-6d1c93e3-e665-4205-9e8b-1cf29c2ae8d8 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 1096 time: 0.0752242 May 12 16:14:49.708743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3006b3b-8cd6-4480-b079-e0edfdd4d03c req-9d19389c-0ae0-4f11-a85b-bfbc30b0c695 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:49.710104 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3006b3b-8cd6-4480-b079-e0edfdd4d03c req-9d19389c-0ae0-4f11-a85b-bfbc30b0c695 service neutron] 10.222.0.84 "GET /v2.0/networks?id=354ba4a6-049f-4366-92ec-a25cf1ee982d HTTP/1.1" status: 200 len: 897 time: 0.1362331 May 12 16:14:49.751432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-134d440d-57f6-4984-a12b-5667d15c4b90 req-a0b419fe-455b-4806-be9d-9356855d0f10 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:49.752127 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-134d440d-57f6-4984-a12b-5667d15c4b90 req-a0b419fe-455b-4806-be9d-9356855d0f10 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:14:49.769214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-134d440d-57f6-4984-a12b-5667d15c4b90 req-a0b419fe-455b-4806-be9d-9356855d0f10 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:14:49.770812 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-134d440d-57f6-4984-a12b-5667d15c4b90 req-a0b419fe-455b-4806-be9d-9356855d0f10 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.1009912 May 12 16:14:49.787822 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3006b3b-8cd6-4480-b079-e0edfdd4d03c req-de6ef664-7f69-419b-8f51-f05f201a728c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa HTTP/1.1" status: 200 len: 217 time: 0.0699065 May 12 16:14:49.827039 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a8d07521-f0aa-4d38-8c8a-28a10b87dac9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2e794133-e3a0-4b85-b3b2-a2e25bdb59a5', 'name': '', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:d3:93:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4305, 'fixed_ips': [{'subnet_id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:13:01Z', 'updated_at': '2022-05-12T16:13:06Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:14:49.831296 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8d07521-f0aa-4d38-8c8a-28a10b87dac9 None None] Checking router: 2fb26cea-49ef-41a0-84d5-9dc84143bc8f for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:14:49.842805 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8d07521-f0aa-4d38-8c8a-28a10b87dac9 None None] Routers {'2fb26cea-49ef-41a0-84d5-9dc84143bc8f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:14:49.843753 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a8d07521-f0aa-4d38-8c8a-28a10b87dac9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:14:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:14:49.855065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3006b3b-8cd6-4480-b079-e0edfdd4d03c req-120fb5ad-5234-430a-a9c3-82a1d7da7f3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:49.857070 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3006b3b-8cd6-4480-b079-e0edfdd4d03c req-120fb5ad-5234-430a-a9c3-82a1d7da7f3a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ca2f4e65-126d-4f50-87d1-dc9039e572fe HTTP/1.1" status: 200 len: 835 time: 0.0612178 May 12 16:14:49.940082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3006b3b-8cd6-4480-b079-e0edfdd4d03c req-bb969ff1-b62d-4276-8d31-bbb491748bee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:49.941657 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3006b3b-8cd6-4480-b079-e0edfdd4d03c req-bb969ff1-b62d-4276-8d31-bbb491748bee service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=354ba4a6-049f-4366-92ec-a25cf1ee982d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0784457 May 12 16:14:49.945165 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-134d440d-57f6-4984-a12b-5667d15c4b90 req-021cc43c-dbd8-4894-b39c-288ea3a8f776 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1680269 May 12 16:14:50.030914 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-a8d07521-f0aa-4d38-8c8a-28a10b87dac9 None None] Set router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:14:50.075460 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3006b3b-8cd6-4480-b079-e0edfdd4d03c req-489ec051-56b7-4e3e-8122-aa902b95d6ac service neutron] 10.222.0.84 "GET /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1266377 May 12 16:14:50.210958 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3006b3b-8cd6-4480-b079-e0edfdd4d03c req-6459efb6-27db-4b20-b070-3d1109519e2a service neutron] 10.222.0.84 "GET /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1284513 May 12 16:14:50.349832 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a8d07521-f0aa-4d38-8c8a-28a10b87dac9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2e794133-e3a0-4b85-b3b2-a2e25bdb59a5', 'name': '', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:d3:93:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4305, 'fixed_ips': [{'subnet_id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:13:01Z', 'updated_at': '2022-05-12T16:13:06Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:14:50.353549 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8d07521-f0aa-4d38-8c8a-28a10b87dac9 None None] The sync data for ids ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'] in n-d-841483-1 is: [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '2e794133-e3a0-4b85-b3b2-a2e25bdb59a5', 'name': '', 'network_id': '354ba4a6-049f-4366-92ec-a25cf1ee982d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:d3:93:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4305, 'fixed_ips': [{'subnet_id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:13:01Z', 'updated_at': '2022-05-12T16:13:06Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'ca2f4e65-126d-4f50-87d1-dc9039e572fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:14:50.567197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31de6804-5945-463c-b30c-032d662c0c3c None None] New status for floating IP 13f66680-0d14-43d4-9809-25f1ca378cd5: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:14:51.140089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fc38fbd-9875-438c-950a-c2b44de6d39a req-2a544ef5-cb45-46c3-8006-689012c864f8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:51.141562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9fc38fbd-9875-438c-950a-c2b44de6d39a req-2a544ef5-cb45-46c3-8006-689012c864f8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0827312 May 12 16:14:51.189524 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9fc38fbd-9875-438c-950a-c2b44de6d39a req-4b0e47c9-af44-4306-9c77-8cd947700096 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=183f4909-127b-46ed-8e00-da76f6d21486&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420902 May 12 16:14:51.509161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-434d1169-8ae2-4229-8297-090cdd0a6ac2 req-c69d9c6b-e641-4984-8f7d-cab8dad6f93c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:51.509876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-434d1169-8ae2-4229-8297-090cdd0a6ac2 req-c69d9c6b-e641-4984-8f7d-cab8dad6f93c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:14:51.521981 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-434d1169-8ae2-4229-8297-090cdd0a6ac2 req-c69d9c6b-e641-4984-8f7d-cab8dad6f93c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:14:51.523068 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-434d1169-8ae2-4229-8297-090cdd0a6ac2 req-c69d9c6b-e641-4984-8f7d-cab8dad6f93c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 945 time: 0.0925887 May 12 16:14:51.600265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-434d1169-8ae2-4229-8297-090cdd0a6ac2 req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:14:51.600525 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-434d1169-8ae2-4229-8297-090cdd0a6ac2 req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:51.965683 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-434d1169-8ae2-4229-8297-090cdd0a6ac2 req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa,segment=NetworkSegment(8b20c3b5-a1ae-42f8-808b-76bcb14601cc),segment_id=8b20c3b5-a1ae-42f8-808b-76bcb14601cc)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:14:51.966531 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-434d1169-8ae2-4229-8297-090cdd0a6ac2 req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:52.088001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-434d1169-8ae2-4229-8297-090cdd0a6ac2 req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:14:52.234710 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-434d1169-8ae2-4229-8297-090cdd0a6ac2 req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:52.291540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:52.300810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:52.301783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:52.302124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:52.302459 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:52.302789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:52.303116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:52.303445 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:52.303772 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:52.304099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:52.304417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:52.304735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:52.305049 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:52.348246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d089629b-3309-4867-a7cd-5a85e0d07db7 req-743c945c-0c4d-4fd8-880d-8113680bca96 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f180cf7-66cc-4a49-81d1-181ed38660f5 HTTP/1.1" status: 200 len: 210 time: 0.0496893 May 12 16:14:52.381498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-434d1169-8ae2-4229-8297-090cdd0a6ac2 req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] No DVR routers for this DVR port d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:14:52.384058 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-434d1169-8ae2-4229-8297-090cdd0a6ac2 req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:52.386512 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'name': 'network-vif-deleted', 'tag': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:14:52.403387 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-434d1169-8ae2-4229-8297-090cdd0a6ac2 req-376bbf4e-566d-4d5b-8ace-3c543cbf41b4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "DELETE /v2.0/ports/d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa HTTP/1.1" status: 204 len: 173 time: 0.8716676 May 12 16:14:52.433142 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6fc1bc73-3695-4fef-b98c-0ee0faad64bf'] response: {'server_uuid': '4f180cf7-66cc-4a49-81d1-181ed38660f5', 'name': 'network-vif-deleted', 'tag': 'd7a53361-5f42-4ff2-b6c4-da58f0c0a6fa', 'status': 'completed', 'code': 200} May 12 16:14:52.965050 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:14:53.444942 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55604) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:54.007691 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13286064-37e6-48aa-bcdc-3b2c519601b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:54.472650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-13286064-37e6-48aa-bcdc-3b2c519601b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:14:54.473355 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13286064-37e6-48aa-bcdc-3b2c519601b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:54.664145 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-13286064-37e6-48aa-bcdc-3b2c519601b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=2e794133-e3a0-4b85-b3b2-a2e25bdb59a5,segment=NetworkSegment(8b20c3b5-a1ae-42f8-808b-76bcb14601cc),segment_id=8b20c3b5-a1ae-42f8-808b-76bcb14601cc)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:14:54.664396 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13286064-37e6-48aa-bcdc-3b2c519601b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:54.796466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-13286064-37e6-48aa-bcdc-3b2c519601b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:14:55.115557 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13286064-37e6-48aa-bcdc-3b2c519601b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:55.166161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13286064-37e6-48aa-bcdc-3b2c519601b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=2e794133-e3a0-4b85-b3b2-a2e25bdb59a5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:55.330819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:14:55.364596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:14:55.364937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device d7a53361-5f42-4ff2-b6c4-da58f0c0a6fa not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:14:55.439035 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-13286064-37e6-48aa-bcdc-3b2c519601b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:55.914329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-13286064-37e6-48aa-bcdc-3b2c519601b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:14:56.095471 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-13286064-37e6-48aa-bcdc-3b2c519601b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:14:56.105228 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a36b452-3f3a-4556-8d17-23f75ada49a8 None None] Sync routers for ids ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:14:56.109698 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-13286064-37e6-48aa-bcdc-3b2c519601b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "PUT /v2.0/routers/2fb26cea-49ef-41a0-84d5-9dc84143bc8f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6636109 May 12 16:14:56.112379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55608) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:56.115383 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a36b452-3f3a-4556-8d17-23f75ada49a8 None None] Routers {'2fb26cea-49ef-41a0-84d5-9dc84143bc8f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:14:56.115969 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0a36b452-3f3a-4556-8d17-23f75ada49a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:14:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:14:56.180495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-f9d853c5-7edd-4c59-a16f-2756797da0fb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting subnet ca2f4e65-126d-4f50-87d1-dc9039e572fe {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:14:56.183363 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9d853c5-7edd-4c59-a16f-2756797da0fb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:56.245004 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9d853c5-7edd-4c59-a16f-2756797da0fb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:56.321371 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-0a36b452-3f3a-4556-8d17-23f75ada49a8 None None] Set router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:14:56.333312 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9d853c5-7edd-4c59-a16f-2756797da0fb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:56.407108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9d853c5-7edd-4c59-a16f-2756797da0fb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:56.451002 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9d853c5-7edd-4c59-a16f-2756797da0fb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Subnet': ['ID=ca2f4e65-126d-4f50-87d1-dc9039e572fe,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:56.456329 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-f9d853c5-7edd-4c59-a16f-2756797da0fb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:56.464319 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f9d853c5-7edd-4c59-a16f-2756797da0fb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/subnets/ca2f4e65-126d-4f50-87d1-dc9039e572fe HTTP/1.1" status: 204 len: 168 time: 0.3509600 May 12 16:14:56.465290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a6982a4-46ca-4cbb-90fa-4339d0852c52 None None] Network 354ba4a6-049f-4366-92ec-a25cf1ee982d requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:14:56.467177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55612) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:56.607907 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0a36b452-3f3a-4556-8d17-23f75ada49a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:14:55Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:14:56.611853 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a36b452-3f3a-4556-8d17-23f75ada49a8 None None] Checking router: 2fb26cea-49ef-41a0-84d5-9dc84143bc8f for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:14:56.620356 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a36b452-3f3a-4556-8d17-23f75ada49a8 None None] Routers {'2fb26cea-49ef-41a0-84d5-9dc84143bc8f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:14:56.620939 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0a36b452-3f3a-4556-8d17-23f75ada49a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:14:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:14:56.654570 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:56.789652 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] DHCP port deletion for 354ba4a6-049f-4366-92ec-a25cf1ee982d request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:14:56.795203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Deleting port 11609ab3-6414-463b-b5ae-7cb4d7283cac {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:14:56.795809 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:56.802527 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-0a36b452-3f3a-4556-8d17-23f75ada49a8 None None] Set router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:14:56.864065 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:56.874293 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port 69f44e18-c1cb-47d8-9851-fc24eae74651 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:14:56.874896 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:56.999706 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] For port 11609ab3-6414-463b-b5ae-7cb4d7283cac, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=11609ab3-6414-463b-b5ae-7cb4d7283cac,segment=NetworkSegment(8b20c3b5-a1ae-42f8-808b-76bcb14601cc),segment_id=8b20c3b5-a1ae-42f8-808b-76bcb14601cc)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:14:57.000136 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:57.065213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port 69f44e18-c1cb-47d8-9851-fc24eae74651, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=69f44e18-c1cb-47d8-9851-fc24eae74651,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:14:57.065859 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:57.104520 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-0a36b452-3f3a-4556-8d17-23f75ada49a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:14:55Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:14:57.109144 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a36b452-3f3a-4556-8d17-23f75ada49a8 None None] The sync data for ids ['2fb26cea-49ef-41a0-84d5-9dc84143bc8f'] in n-d-841483-1 is: [{'id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-611522413', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53'}], 'enable_snat': True}, 'gw_port_id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:14:55Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '69f44e18-c1cb-47d8-9851-fc24eae74651', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:77:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2fb26cea-49ef-41a0-84d5-9dc84143bc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4302, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:12:57Z', 'updated_at': '2022-05-12T16:13:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:14:57.136590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Calling delete_port for 11609ab3-6414-463b-b5ae-7cb4d7283cac owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:14:57.204610 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for 69f44e18-c1cb-47d8-9851-fc24eae74651 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:14:57.217112 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:57.263814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Pushing event deleted for resources: {'Port': ['ID=11609ab3-6414-463b-b5ae-7cb4d7283cac,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:57.268347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] No DVR routers for this DVR port 11609ab3-6414-463b-b5ae-7cb4d7283cac on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:14:57.283731 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:57.284117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:57.284460 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:57.284842 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:57.285176 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:57.285524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:57.285887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:57.286577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:57.286577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:57.286856 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:57.287172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:57.287488 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-414c75d7-e5b6-4d9a-8565-e3a68f77349b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:14:57.393053 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:57.567511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=69f44e18-c1cb-47d8-9851-fc24eae74651,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:57.662042 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:57.851342 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:57.853452 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:57.875635 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:57.876220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Fanout notify agent at l3_agent the message router_deleted on router 2fb26cea-49ef-41a0-84d5-9dc84143bc8f {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:14:57.892030 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:57.893330 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-14515c9b-e28f-4c39-8389-8aa7c46323e2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/routers/2fb26cea-49ef-41a0-84d5-9dc84143bc8f HTTP/1.1" status: 204 len: 168 time: 1.4250379 May 12 16:14:57.895717 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55616) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:58.011891 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffeb5a2d-d512-4e87-9519-b38372b4fd6b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.144868 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffeb5a2d-d512-4e87-9519-b38372b4fd6b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.169488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ffeb5a2d-d512-4e87-9519-b38372b4fd6b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['354ba4a6-049f-4366-92ec-a25cf1ee982d']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:14:58.181012 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ffeb5a2d-d512-4e87-9519-b38372b4fd6b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8b20c3b5-a1ae-42f8-808b-76bcb14601cc') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:14:58.181315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-ffeb5a2d-d512-4e87-9519-b38372b4fd6b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8b20c3b5-a1ae-42f8-808b-76bcb14601cc') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:14:58.192837 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffeb5a2d-d512-4e87-9519-b38372b4fd6b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.208988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffeb5a2d-d512-4e87-9519-b38372b4fd6b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.214987 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ffeb5a2d-d512-4e87-9519-b38372b4fd6b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Releasing vlan 578 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:14:58.215373 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffeb5a2d-d512-4e87-9519-b38372b4fd6b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: timer() May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:14:58.229355 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:14:58.310441 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffeb5a2d-d512-4e87-9519-b38372b4fd6b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.331529 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ffeb5a2d-d512-4e87-9519-b38372b4fd6b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.337805 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffeb5a2d-d512-4e87-9519-b38372b4fd6b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Network': ['ID=354ba4a6-049f-4366-92ec-a25cf1ee982d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:58.349646 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ffeb5a2d-d512-4e87-9519-b38372b4fd6b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/networks/354ba4a6-049f-4366-92ec-a25cf1ee982d HTTP/1.1" status: 204 len: 168 time: 0.4528432 May 12 16:14:58.352385 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55622) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:58.424930 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6b0d12f7-0b38-404d-a889-5dedebfa14b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.456111 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6b0d12f7-0b38-404d-a889-5dedebfa14b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.523615 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6b0d12f7-0b38-404d-a889-5dedebfa14b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.544744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b0d12f7-0b38-404d-a889-5dedebfa14b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=183f4909-127b-46ed-8e00-da76f6d21486,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:58.554983 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6b0d12f7-0b38-404d-a889-5dedebfa14b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.557711 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6b0d12f7-0b38-404d-a889-5dedebfa14b0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/security-groups/183f4909-127b-46ed-8e00-da76f6d21486 HTTP/1.1" status: 204 len: 168 time: 0.2042847 May 12 16:14:58.568484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 11609ab3-6414-463b-b5ae-7cb4d7283cac no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:14:58.616026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 11609ab3-6414-463b-b5ae-7cb4d7283cac {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:14:58.616026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 11609ab3-6414-463b-b5ae-7cb4d7283cac not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:14:58.616026 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:14:58.648106 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:14:58.648443 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 2e794133-e3a0-4b85-b3b2-a2e25bdb59a5 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:14:58.648846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 69f44e18-c1cb-47d8-9851-fc24eae74651 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:14:58.681066 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55630) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:58.686013 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 69f44e18-c1cb-47d8-9851-fc24eae74651 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:14:58.686345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 69f44e18-c1cb-47d8-9851-fc24eae74651 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:14:58.687550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1320956241', 'description': 'tempest-secgroup-smoke-1320956241 description', 'project_id': 'f50049e6814046a9abf21905584f94e1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:14:58.694407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:14:58.699075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:14:58.701966 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:14:58.707585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:14:58.717787 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.737635 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:14:58.741316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:14:58.744302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:14:58.750711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:14:58.821279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.825577 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.873355 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroup': ['ID=97e00970-bf76-45d6-888c-86903d323271,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:58.877368 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.878663 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8c3e4e87-2db9-418a-8723-891af4f206df tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1965678 May 12 16:14:58.881508 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55634) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:58.886419 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-6e11fc7f-6164-4645-abea-bbbd597792f6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '97e00970-bf76-45d6-888c-86903d323271', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:14:58.893206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6e11fc7f-6164-4645-abea-bbbd597792f6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:14:58.896984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6e11fc7f-6164-4645-abea-bbbd597792f6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:14:58.899823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-6e11fc7f-6164-4645-abea-bbbd597792f6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:14:58.905931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-6e11fc7f-6164-4645-abea-bbbd597792f6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:14:58.922450 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e11fc7f-6164-4645-abea-bbbd597792f6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.981929 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e11fc7f-6164-4645-abea-bbbd597792f6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:58.985200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e11fc7f-6164-4645-abea-bbbd597792f6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.007504 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e11fc7f-6164-4645-abea-bbbd597792f6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1a80ef44-f2de-4a88-a5b2-4bd2d0a0cf3a,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:59.016911 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6e11fc7f-6164-4645-abea-bbbd597792f6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.018185 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6e11fc7f-6164-4645-abea-bbbd597792f6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1358552 May 12 16:14:59.020843 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55638) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:59.025499 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-72597e40-d3be-47cc-bb68-cca6d32eb5d4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '97e00970-bf76-45d6-888c-86903d323271', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:14:59.032649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-72597e40-d3be-47cc-bb68-cca6d32eb5d4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:14:59.036424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-72597e40-d3be-47cc-bb68-cca6d32eb5d4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:14:59.039240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-72597e40-d3be-47cc-bb68-cca6d32eb5d4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:14:59.045371 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-72597e40-d3be-47cc-bb68-cca6d32eb5d4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:14:59.065493 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-72597e40-d3be-47cc-bb68-cca6d32eb5d4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.128018 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-72597e40-d3be-47cc-bb68-cca6d32eb5d4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.131683 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-72597e40-d3be-47cc-bb68-cca6d32eb5d4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.159160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72597e40-d3be-47cc-bb68-cca6d32eb5d4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4bb548ba-0d43-4532-8a1e-1ced44080887,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:59.165907 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-72597e40-d3be-47cc-bb68-cca6d32eb5d4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.167161 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-72597e40-d3be-47cc-bb68-cca6d32eb5d4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1453106 May 12 16:14:59.170711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55642) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:59.175553 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ad5429bc-96fb-4a85-94ac-1b4da86151f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '97e00970-bf76-45d6-888c-86903d323271', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:14:59.182116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ad5429bc-96fb-4a85-94ac-1b4da86151f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:14:59.185934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ad5429bc-96fb-4a85-94ac-1b4da86151f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:14:59.188740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ad5429bc-96fb-4a85-94ac-1b4da86151f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:14:59.194361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ad5429bc-96fb-4a85-94ac-1b4da86151f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:14:59.214002 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad5429bc-96fb-4a85-94ac-1b4da86151f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.284047 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad5429bc-96fb-4a85-94ac-1b4da86151f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.287598 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad5429bc-96fb-4a85-94ac-1b4da86151f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.312007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad5429bc-96fb-4a85-94ac-1b4da86151f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=52dc3b6c-2cd9-4164-a186-e37d94127bfe,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:59.320398 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ad5429bc-96fb-4a85-94ac-1b4da86151f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.321681 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ad5429bc-96fb-4a85-94ac-1b4da86151f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1500411 May 12 16:14:59.324454 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55646) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:59.330330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-0865f32b-c301-4485-ac4b-40bbb91fa09b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '97e00970-bf76-45d6-888c-86903d323271', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:14:59.337014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0865f32b-c301-4485-ac4b-40bbb91fa09b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:14:59.341946 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0865f32b-c301-4485-ac4b-40bbb91fa09b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:14:59.344778 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0865f32b-c301-4485-ac4b-40bbb91fa09b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:14:59.350428 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0865f32b-c301-4485-ac4b-40bbb91fa09b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:14:59.366915 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0865f32b-c301-4485-ac4b-40bbb91fa09b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.430658 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0865f32b-c301-4485-ac4b-40bbb91fa09b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.434309 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0865f32b-c301-4485-ac4b-40bbb91fa09b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.459352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0865f32b-c301-4485-ac4b-40bbb91fa09b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=13bb4ac0-bdeb-49d4-9dc1-86a76a84e0cc,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:59.468343 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0865f32b-c301-4485-ac4b-40bbb91fa09b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.469568 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0865f32b-c301-4485-ac4b-40bbb91fa09b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1436539 May 12 16:14:59.472275 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55650) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:59.477141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2a1fb22d-c028-42c9-ae63-1af91216f58c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '97e00970-bf76-45d6-888c-86903d323271', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:14:59.484062 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2a1fb22d-c028-42c9-ae63-1af91216f58c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:14:59.487820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2a1fb22d-c028-42c9-ae63-1af91216f58c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:14:59.490641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2a1fb22d-c028-42c9-ae63-1af91216f58c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:14:59.496225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2a1fb22d-c028-42c9-ae63-1af91216f58c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:14:59.507037 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-2a1fb22d-c028-42c9-ae63-1af91216f58c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Project f50049e6814046a9abf21905584f94e1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:14:59.514532 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a1fb22d-c028-42c9-ae63-1af91216f58c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.582236 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a1fb22d-c028-42c9-ae63-1af91216f58c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.585538 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a1fb22d-c028-42c9-ae63-1af91216f58c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.610510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a1fb22d-c028-42c9-ae63-1af91216f58c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=50ed8d6a-ae9a-47ce-8557-b53ba4031243,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:59.619876 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a1fb22d-c028-42c9-ae63-1af91216f58c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.621264 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2a1fb22d-c028-42c9-ae63-1af91216f58c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1479039 May 12 16:14:59.624402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55654) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:59.629458 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ef8d3575-fc64-4df6-a9a9-08f569a686bf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '97e00970-bf76-45d6-888c-86903d323271', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:14:59.635896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ef8d3575-fc64-4df6-a9a9-08f569a686bf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:14:59.640357 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef8d3575-fc64-4df6-a9a9-08f569a686bf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:14:59.643218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ef8d3575-fc64-4df6-a9a9-08f569a686bf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:14:59.649182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ef8d3575-fc64-4df6-a9a9-08f569a686bf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:14:59.660157 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-ef8d3575-fc64-4df6-a9a9-08f569a686bf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Project f50049e6814046a9abf21905584f94e1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:14:59.666506 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef8d3575-fc64-4df6-a9a9-08f569a686bf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.729777 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef8d3575-fc64-4df6-a9a9-08f569a686bf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.733433 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef8d3575-fc64-4df6-a9a9-08f569a686bf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.756103 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef8d3575-fc64-4df6-a9a9-08f569a686bf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cfeb7ebb-97c3-4cd3-aeee-c8ea3cfccee8,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:14:59.766119 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef8d3575-fc64-4df6-a9a9-08f569a686bf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.767285 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ef8d3575-fc64-4df6-a9a9-08f569a686bf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1419425 May 12 16:14:59.770154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55658) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:14:59.775537 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'network': {'name': 'tempest-network-smoke--1261419680', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'port_security_enabled': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:14:59.781642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:14:59.785837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:network and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:14:59.788668 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:14:59.794390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:14:59.804735 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:14:59.808361 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.837132 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 553} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:14:59.846022 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.846390 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Added segment ff6e1144-21dd-4621-9c9b-74d7120617b5 of type vlan for network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 May 12 16:14:59.871514 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.903189 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:14:59.908555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:14:59.909114 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:00.011467 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2402902 May 12 16:15:00.014883 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55662) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:15:00.020234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'admin_state_up': True, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:15:00.020521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cf4c737-079e-4fa7-b38d-8363603b1f7e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Network': ['ID=9a6ee36e-4706-491e-8e3f-fdd038ffad04,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:00.028012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:15:00.030332 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:15:00.032090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:router and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:15:00.034948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:15:00.041233 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:15:00.051697 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:00.052954 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:00.071905 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:00.342767 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:00.649643 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:00.680832 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:00.820943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.25.8.84 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/ce5196a8-c926-41d2-a14f-c9607467b245) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:15:00.972084 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:01.001178 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:01.067391 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:15:01.070316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:15:01.072838 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:15:01.116763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=ce5196a8-c926-41d2-a14f-c9607467b245,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:01.603050 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:01.947246 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:02.153773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 99b1e28b-7903-47cb-ac29-802fff94199f is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 16:15:02.331226 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:15:02.342365 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Sync routers for ids ['99b1e28b-7903-47cb-ac29-802fff94199f'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:15:02.351363 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Routers {'99b1e28b-7903-47cb-ac29-802fff94199f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:15:02.352057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:14:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99b1e28b-7903-47cb-ac29-802fff94199f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:15:02.359113 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:02.360300 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dc3225c2-cef8-48c7-959a-8c56c7fadeaf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 2.3443749 May 12 16:15:02.363748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55666) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:15:02.409582 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-540f99f9-c083-4a6f-ab52-cff5192f7b3f tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=f50049e6814046a9abf21905584f94e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0422845 May 12 16:15:02.409837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55670) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:15:02.540699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Set router 99b1e28b-7903-47cb-ac29-802fff94199f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:15:02.647381 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9200c36-e376-406e-9665-22922ed2c492 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:02.648869 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a9200c36-e376-406e-9665-22922ed2c492 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2382128 May 12 16:15:02.651639 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55674) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:15:02.693670 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f0a8ef89-581c-4d7f-ab83-6d02b72b046c tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0407939 May 12 16:15:02.696405 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55678) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:15:02.702740 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1381263920', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:15:02.826436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:15:02.830229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:subnet and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:15:02.833031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:15:02.834838 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:01Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:15:02.838595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Checking router: 99b1e28b-7903-47cb-ac29-802fff94199f for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:15:02.838743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:15:02.838923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Updating router 99b1e28b-7903-47cb-ac29-802fff94199f port ce5196a8-c926-41d2-a14f-c9607467b245 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:15:02.849279 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:15:02.852875 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:02.892460 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:02.954799 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:03.086958 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:03.168403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Subnet': ['ID=3116a1dc-79e6-4477-8c17-2ca48ca89166,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:03.177728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Checking segment: {'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:15:03.178085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network hostable DHCP agents. Network: 9a6ee36e-4706-491e-8e3f-fdd038ffad04, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:15:03.197744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:15:03.208050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 9a6ee36e-4706-491e-8e3f-fdd038ffad04) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:15:03.213555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:03.214158 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:03.221765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d42c9ad-8be8-4f19-93a3-169808fdd4f3 None None] Network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:15:03.241972 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4062b7d1-e55b-4ca2-839e-c697e6a0fe7a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.5420251 May 12 16:15:03.242291 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55682) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:15:03.358811 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:03.389831 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Transition to ACTIVE for port object ce5196a8-c926-41d2-a14f-c9607467b245 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:15:03.402824 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:03.533291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Attempting to bind port ce5196a8-c926-41d2-a14f-c9607467b245 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:15:03.533673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Attempting to bind port ce5196a8-c926-41d2-a14f-c9607467b245 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:15:03.534028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Attempting to bind port ce5196a8-c926-41d2-a14f-c9607467b245 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:15:03.535976 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f183462-7b3c-4ff5-b42e-c8ab7ac66cc2 None None] Pushing event updated for resources: {'Port': ['ID=ce5196a8-c926-41d2-a14f-c9607467b245,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:03.545350 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 14, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:15:03.545740 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:15:03.546137 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:03.546518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:15:03.546977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Bound port: ce5196a8-c926-41d2-a14f-c9607467b245, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:15:03.547343 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:03.641830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ips': [{'subnet_id': '3116a1dc-79e6-4477-8c17-2ca48ca89166'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:15:03.642626 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:03.670908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] For port ce5196a8-c926-41d2-a14f-c9607467b245, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:15:03.674642 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] For port ce5196a8-c926-41d2-a14f-c9607467b245, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce5196a8-c926-41d2-a14f-c9607467b245,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:15:03.713573 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:03.868315 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Routers {'99b1e28b-7903-47cb-ac29-802fff94199f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:15:03.868924 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:14:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99b1e28b-7903-47cb-ac29-802fff94199f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:15:03.936171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f183462-7b3c-4ff5-b42e-c8ab7ac66cc2 None None] Pushing event updated for resources: {'Port': ['ID=ce5196a8-c926-41d2-a14f-c9607467b245,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:03.962100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Allocated IP 172.20.0.2 (9a6ee36e-4706-491e-8e3f-fdd038ffad04/3116a1dc-79e6-4477-8c17-2ca48ca89166/7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:15:03.962330 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:04.141978 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] Set router 99b1e28b-7903-47cb-ac29-802fff94199f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:15:04.503228 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:04.541647 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Transition to ACTIVE for port object 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:15:04.568687 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Transition to ACTIVE for port object 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:15:04.576251 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:04.644846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.20.0.1 (9a6ee36e-4706-491e-8e3f-fdd038ffad04/3116a1dc-79e6-4477-8c17-2ca48ca89166/6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:15:04.649260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:15:04.652646 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:15:04.659785 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:15:04.667392 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:01Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:15:04.708629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Pushing event updated for resources: {'Port': ['ID=7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:04.740643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0083bb48-8b5c-4ad0-ab58-c0ad4d7ea574 None None] The sync data for ids ['99b1e28b-7903-47cb-ac29-802fff94199f'] in n-d-841483-1 is: [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:01Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:15:04.766927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Attempting to bind port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:15:04.767422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Attempting to bind port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:15:04.767895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Attempting to bind port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 on network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:15:04.774040 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 14, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:15:04.774410 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Checking segment: {'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:15:04.774809 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:04.775193 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Bound using segment: {'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:15:04.775655 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Bound port: 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:15:04.776024 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:04.816389 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:04.834326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Transition to ACTIVE for port object 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:15:04.859639 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:04.870263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] For port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:15:04.875262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] For port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:15:04.880411 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:04.935686 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:15:04.940423 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:15:04.942802 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:15:04.969578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573e6763-7675-4bf0-b01d-d79f19c5495e None None] Pushing event updated for resources: {'Port': ['ID=7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:05.002562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:05.033656 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:05.366541 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:05.801652 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:05.806816 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:05.923986 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:05.926361 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:05.961273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-073a9f57-31bc-48ca-963f-2fcbf4e1f495 None None] Network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:15:06.057376 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b5b9c013-cfe2-4ce9-8c27-6bd746c5cb51 None None] Provisioning for port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:15:06.075963 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:15:06.077916 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:15:06.406328 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 99b1e28b-7903-47cb-ac29-802fff94199f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:15:06.498601 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-95f3ecaa-1ff9-4baa-bb97-58bde80175f8 None None] Provisioning for port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:15:06.505434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-95f3ecaa-1ff9-4baa-bb97-58bde80175f8 None None] Provisioning complete for port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:15:06.505965 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-95f3ecaa-1ff9-4baa-bb97-58bde80175f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:06.572185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-95f3ecaa-1ff9-4baa-bb97-58bde80175f8 None None] Port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:15:06.621149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:15:06.634324 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Sync routers for ids ['99b1e28b-7903-47cb-ac29-802fff94199f'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:15:06.639441 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-df944172-dd01-4b98-8ae6-9d0d5fc15afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "PUT /v2.0/routers/99b1e28b-7903-47cb-ac29-802fff94199f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3952739 May 12 16:15:06.653492 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Routers {'99b1e28b-7903-47cb-ac29-802fff94199f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:15:06.654600 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:15:06.655708 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:14:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99b1e28b-7903-47cb-ac29-802fff94199f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:15:06.738538 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-5311e0d3-7ac3-47c4-b871-0210cdca886f None None] Provisioning complete for port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:15:06.739021 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5311e0d3-7ac3-47c4-b871-0210cdca886f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:06.812214 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5311e0d3-7ac3-47c4-b871-0210cdca886f None None] Port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:15:06.824751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:15:06.830840 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:15:06.831218 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:06.871488 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Set router 99b1e28b-7903-47cb-ac29-802fff94199f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:15:06.885890 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-d3754772-027e-46a5-ad88-997f4cff1c8e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:15:06.904484 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-d3754772-027e-46a5-ad88-997f4cff1c8e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:15:06.906221 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-d3754772-027e-46a5-ad88-997f4cff1c8e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1320956241&fields=id&tenant_id=f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 267 time: 0.0673647 May 12 16:15:06.963272 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-dc46db49-5df2-434f-a83c-befb1e8c8517 None None] Provisioning complete for port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:15:06.963859 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-dc46db49-5df2-434f-a83c-befb1e8c8517 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:06.987794 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:07.052447 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-dc46db49-5df2-434f-a83c-befb1e8c8517 None None] Port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:15:07.057348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:15:07.063216 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:07.064468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ce5196a8-c926-41d2-a14f-c9607467b245 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:15:07.091370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-65e0e313-7a39-4dac-9f03-0c6b308ec4e0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:07.093317 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-65e0e313-7a39-4dac-9f03-0c6b308ec4e0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/networks?id=9a6ee36e-4706-491e-8e3f-fdd038ffad04 HTTP/1.1" status: 200 len: 797 time: 0.1799710 May 12 16:15:07.109887 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-0a21061e-1b35-4957-b1b0-f5de75119063 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/quotas/f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 375 time: 0.0104864 May 12 16:15:07.187449 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:07.199170 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-be1f6955-0c7a-4e11-8946-1ad646825a19 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0836868 May 12 16:15:07.200165 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port ce5196a8-c926-41d2-a14f-c9607467b245 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:15:07.206082 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ce5196a8-c926-41d2-a14f-c9607467b245 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:15:07.206451 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:07.247590 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:05Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0', 'name': '', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:0f:db:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4324, 'fixed_ips': [{'subnet_id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:04Z', 'updated_at': '2022-05-12T16:15:05Z', 'revision_number': 2, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:15:07.252316 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Checking router: 99b1e28b-7903-47cb-ac29-802fff94199f for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:15:07.253437 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Updating router 99b1e28b-7903-47cb-ac29-802fff94199f port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:15:07.324970 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:07.338197 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:07.358703 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port ce5196a8-c926-41d2-a14f-c9607467b245, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce5196a8-c926-41d2-a14f-c9607467b245,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:15:07.362845 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:07.447826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=ce5196a8-c926-41d2-a14f-c9607467b245,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:07.476805 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-7e77b00a-f4fe-46ab-b3b1-a40510ed71ed service neutron] 10.222.0.82 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2635326 May 12 16:15:07.608076 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-b38d2ed8-89b3-4720-95c4-6707340dae5d service neutron] 10.222.0.82 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1253002 May 12 16:15:07.674569 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:07.686251 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Transition to ACTIVE for port object 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:15:07.692264 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:07.795040 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8d6d991d-1010-4f6f-bab6-b6c1d6160424 req-4702c285-6f86-4547-8fc6-6ebd894da4bb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 210 time: 0.0490265 May 12 16:15:07.912230 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cd0dab8-df6e-472e-a966-f1ae64a63634 None None] Pushing event updated for resources: {'Port': ['ID=6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:07.923189 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cd0dab8-df6e-472e-a966-f1ae64a63634 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:15:07.923672 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cd0dab8-df6e-472e-a966-f1ae64a63634 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:15:07.924096 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cd0dab8-df6e-472e-a966-f1ae64a63634 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:15:07.924652 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cd0dab8-df6e-472e-a966-f1ae64a63634 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:15:07.925285 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cd0dab8-df6e-472e-a966-f1ae64a63634 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:15:07.925828 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cd0dab8-df6e-472e-a966-f1ae64a63634 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:15:07.926308 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cd0dab8-df6e-472e-a966-f1ae64a63634 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:15:07.926639 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cd0dab8-df6e-472e-a966-f1ae64a63634 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:15:07.926953 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cd0dab8-df6e-472e-a966-f1ae64a63634 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:15:07.927698 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cd0dab8-df6e-472e-a966-f1ae64a63634 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:15:07.927996 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cd0dab8-df6e-472e-a966-f1ae64a63634 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:15:07.928403 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cd0dab8-df6e-472e-a966-f1ae64a63634 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:15:07.937127 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Attempting to bind port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:15:07.937521 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Attempting to bind port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:15:07.938488 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Attempting to bind port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 on network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:15:07.948099 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 14, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:15:07.948469 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Checking segment: {'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:15:07.948844 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:07.949218 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Bound using segment: {'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:15:07.949701 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Bound port: 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:15:07.950619 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:08.046007 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] For port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:15:08.048892 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] For port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:15:08.052849 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:08.132707 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Routers {'99b1e28b-7903-47cb-ac29-802fff94199f'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:15:08.133315 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:14:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99b1e28b-7903-47cb-ac29-802fff94199f'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:15:08.197515 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cd0dab8-df6e-472e-a966-f1ae64a63634 None None] Pushing event updated for resources: {'Port': ['ID=6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:08.329872 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] Set router 99b1e28b-7903-47cb-ac29-802fff94199f gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:15:08.561247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:15:08.629417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:15:08.629809 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:08.646629 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:05Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0', 'name': '', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:0f:db:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4324, 'fixed_ips': [{'subnet_id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:04Z', 'updated_at': '2022-05-12T16:15:08Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:15:08.650488 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42145f36-d8ac-416f-9578-50ec81308672 None None] The sync data for ids ['99b1e28b-7903-47cb-ac29-802fff94199f'] in n-d-841483-1 is: [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:05Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0', 'name': '', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:0f:db:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4324, 'fixed_ips': [{'subnet_id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:04Z', 'updated_at': '2022-05-12T16:15:08Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:15:08.767415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ce5196a8-c926-41d2-a14f-c9607467b245 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:15:08.851504 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port ce5196a8-c926-41d2-a14f-c9607467b245 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:15:08.851865 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:08.977329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eaaf927d-2262-4224-9708-5663c00ac3cb req-d9f53005-ac6d-4092-817f-6c544d0f273e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 210 time: 0.0495498 May 12 16:15:09.138892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-a4efd492-015b-4173-93b9-e84163e0d88c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:09.139608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-a4efd492-015b-4173-93b9-e84163e0d88c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:15:09.158652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-a4efd492-015b-4173-93b9-e84163e0d88c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:15:09.159870 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-a4efd492-015b-4173-93b9-e84163e0d88c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/networks?id=9a6ee36e-4706-491e-8e3f-fdd038ffad04 HTTP/1.1" status: 200 len: 797 time: 0.2193370 May 12 16:15:09.228827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-63c2853d-bdb3-4927-b989-8f07c3b17f37 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:15:09.241511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-63c2853d-bdb3-4927-b989-8f07c3b17f37 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:15:09.242674 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-63c2853d-bdb3-4927-b989-8f07c3b17f37 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 380 time: 0.0566874 May 12 16:15:09.275130 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'port': {'device_id': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'admin_state_up': True, 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'security_groups': ['97e00970-bf76-45d6-888c-86903d323271']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:15:09.426732 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:15:09.430904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:port and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:15:09.433851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:15:09.440005 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:15:09.450795 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:15:09.454524 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:09.628757 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.20.0.14 (9a6ee36e-4706-491e-8e3f-fdd038ffad04/3116a1dc-79e6-4477-8c17-2ca48ca89166/7ed0066b-1c90-45f5-b62d-aebbea6fd2e3) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:15:09.840055 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:09.855241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Transition to ACTIVE for port object 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:15:09.878341 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:09.953653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:15:09.956797 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:15:09.959616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:15:10.017037 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:10.042127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:10.042759 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:10.071377 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2a06ad46-dbe5-439d-8509-1225ea80db1f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8003783 May 12 16:15:10.096204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Request body: {'port': {'device_id': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:15:10.210721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a5663a-706a-4059-a616-6c0d0f733e1d req-ccc3f90a-1b6e-448e-9367-f844e1427f2c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:10.212408 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-42a5663a-706a-4059-a616-6c0d0f733e1d req-ccc3f90a-1b6e-448e-9367-f844e1427f2c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 932 time: 0.0954652 May 12 16:15:10.235996 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:10.239630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0ad2a275-13f8-4ee7-9c18-f74f36baec85 None None] Provisioning for port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:15:10.252432 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0ad2a275-13f8-4ee7-9c18-f74f36baec85 None None] Provisioning complete for port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:15:10.253539 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0ad2a275-13f8-4ee7-9c18-f74f36baec85 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:10.272325 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-42a5663a-706a-4059-a616-6c0d0f733e1d req-14548c5d-5aee-4f66-a5e5-134dcb6228d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515974 May 12 16:15:10.329066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-0ad2a275-13f8-4ee7-9c18-f74f36baec85 None None] Port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:15:10.577448 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:15:10.623397 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:15:10.631484 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:10.649251 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Transition to ACTIVE for port object 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:15:10.651158 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:15:10.653862 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:10.657457 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:15:10.657822 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:10.790672 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:10.827432 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:15:10.831867 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:10.906766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:10.987455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Pushing event updated for resources: {'Port': ['ID=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:11.031403 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Attempting to bind port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:15:11.031766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Attempting to bind port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:15:11.032099 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Attempting to bind port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 on network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:15:11.036689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 on network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:15:11.037007 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Attempting to bind port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 on network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:15:11.042193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 14, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:15:11.042535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Checking segment: {'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:15:11.042918 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Bound using segment: {'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:15:11.043344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Bound port: 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:15:11.044166 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:11.135940 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] For port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:15:11.139657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] For port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:15:11.143068 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:11.207903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:11.207903 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:11.207903 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] 10.222.0.84 "PUT /v2.0/ports/7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 HTTP/1.1" status: 200 len: 1092 time: 1.1142473 May 12 16:15:11.207903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:15:11.231711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aafbcf83-f2f2-4913-9b9f-4ba221c2719d service neutron] Pushing event updated for resources: {'Port': ['ID=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:11.271191 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4e9e3a37-2caa-4581-bbd7-75c9ada7ed88'] response: {'name': 'network-changed', 'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'status': 'completed', 'code': 200} May 12 16:15:11.370910 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-4ab5e3f2-31a5-4fb1-a82a-969ffc3205e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:11.374129 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-4ab5e3f2-31a5-4fb1-a82a-969ffc3205e5 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 1095 time: 0.0855439 May 12 16:15:11.457783 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-0cd567b0-cedb-4fde-95a8-d3c0a14ef2a5 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 HTTP/1.1" status: 200 len: 217 time: 0.0645289 May 12 16:15:11.468706 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcf9450e-34a5-4758-9757-9487c9d87f9b req-d0dcd3e7-185e-456a-b01b-e52e119b1346 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:11.470226 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fcf9450e-34a5-4758-9757-9487c9d87f9b req-d0dcd3e7-185e-456a-b01b-e52e119b1346 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 944 time: 0.0849328 May 12 16:15:11.517220 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fcf9450e-34a5-4758-9757-9487c9d87f9b req-7d1e677d-fd62-4a9f-9a23-ca9d65782ccc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409148 May 12 16:15:11.531113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2cc46d0c-37cf-41c1-aa67-a4c56ab2aaf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:11.532577 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-2cc46d0c-37cf-41c1-aa67-a4c56ab2aaf9 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3116a1dc-79e6-4477-8c17-2ca48ca89166 HTTP/1.1" status: 200 len: 835 time: 0.0655451 May 12 16:15:11.620255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-d5b5ee0a-afe5-4a11-b126-5a6da45678b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:11.622719 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-d5b5ee0a-afe5-4a11-b126-5a6da45678b1 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9a6ee36e-4706-491e-8e3f-fdd038ffad04&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0804241 May 12 16:15:11.765723 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-ad2daac0-4cf6-4ddc-abac-d3d90cf6e99a service neutron] 10.222.0.84 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1320987 May 12 16:15:11.902222 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ff83f32-96c2-4b76-9867-f0961b654ea3 req-b4f3f5dc-945e-49d7-a566-e6363631202b service neutron] 10.222.0.84 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1293528 May 12 16:15:12.064206 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b177b54c-3451-4725-8db0-aac1839595fb req-b8c02425-5d61-4a70-babf-5828a9f3880a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:12.065676 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b177b54c-3451-4725-8db0-aac1839595fb req-b8c02425-5d61-4a70-babf-5828a9f3880a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 1095 time: 0.0703776 May 12 16:15:12.209341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b177b54c-3451-4725-8db0-aac1839595fb req-e6e8ca3d-0367-44fe-bb05-da450d9c5fc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:12.210805 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b177b54c-3451-4725-8db0-aac1839595fb req-e6e8ca3d-0367-44fe-bb05-da450d9c5fc3 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9a6ee36e-4706-491e-8e3f-fdd038ffad04 HTTP/1.1" status: 200 len: 898 time: 0.1393831 May 12 16:15:12.283049 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b177b54c-3451-4725-8db0-aac1839595fb req-f9e462a4-acd0-4630-bfd2-615a22de0360 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 HTTP/1.1" status: 200 len: 217 time: 0.0648391 May 12 16:15:12.347566 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b177b54c-3451-4725-8db0-aac1839595fb req-32cc4ff2-1589-4351-b146-d39448ceac09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:12.348844 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b177b54c-3451-4725-8db0-aac1839595fb req-32cc4ff2-1589-4351-b146-d39448ceac09 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3116a1dc-79e6-4477-8c17-2ca48ca89166 HTTP/1.1" status: 200 len: 835 time: 0.0593977 May 12 16:15:12.422846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b177b54c-3451-4725-8db0-aac1839595fb req-76c922d4-33e8-4bfb-9dae-d57d7a9278e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:12.424262 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b177b54c-3451-4725-8db0-aac1839595fb req-76c922d4-33e8-4bfb-9dae-d57d7a9278e9 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9a6ee36e-4706-491e-8e3f-fdd038ffad04&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0683508 May 12 16:15:12.562440 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b177b54c-3451-4725-8db0-aac1839595fb req-22bde69e-cd11-4b90-88a7-d8e41ff8d3ca service neutron] 10.222.0.84 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1313021 May 12 16:15:12.563862 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:15:12.636786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:15:12.637072 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:12.741204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e0fa34-e7cf-4812-939b-3b65217481b4 req-02280c5e-5f57-4eb4-9267-557f48304ba1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:12.742791 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39e0fa34-e7cf-4812-939b-3b65217481b4 req-02280c5e-5f57-4eb4-9267-557f48304ba1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 944 time: 0.0898986 May 12 16:15:12.795594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-39e0fa34-e7cf-4812-939b-3b65217481b4 req-a135c1d0-f69e-4422-8b1e-c47e351badc2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456784 May 12 16:15:12.816950 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b177b54c-3451-4725-8db0-aac1839595fb req-0b402cd4-d06e-4eb1-8ee8-e983a415fb01 service neutron] 10.222.0.84 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2451615 May 12 16:15:12.877025 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e88b1e56-684f-4740-82e1-aa5bdfb36c8d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:13.760685 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:13.983705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92e992b9-92fb-4fab-936f-8998ace99091 req-3b8a0b79-be84-445d-bf54-8515c2a26ec1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:13.985134 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-92e992b9-92fb-4fab-936f-8998ace99091 req-3b8a0b79-be84-445d-bf54-8515c2a26ec1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 944 time: 0.0796070 May 12 16:15:14.028381 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-92e992b9-92fb-4fab-936f-8998ace99091 req-4cf73467-d4a6-4e9b-8f9d-0827cc00a795 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374277 May 12 16:15:15.214842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e89ec908-4482-4cb9-8c8b-1e0219e965fe req-5e785217-d168-4ce6-a4b3-8a68ad068dfe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:15.217441 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e89ec908-4482-4cb9-8c8b-1e0219e965fe req-5e785217-d168-4ce6-a4b3-8a68ad068dfe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 944 time: 0.0841703 May 12 16:15:15.261192 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e89ec908-4482-4cb9-8c8b-1e0219e965fe req-2cbdca77-d64e-4cc5-82b9-ae61f2033628 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381331 May 12 16:15:15.405359 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-93eff01b-aa57-4ee2-a567-3b3b7cef7e0d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:15.491998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:15:15.623434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:15:15.635979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'port_id': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'mac_address': 'fa:16:3e:f6:a0:a5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 553, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:15:15.689120 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:15.708817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:15:15.724221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:15:15.727862 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:15.795528 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:16.059472 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['7ed0066b-1c90-45f5-b62d-aebbea6fd2e3'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:15:16.145005 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:16.414574 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:16.448416 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d18950ab-4e4e-4ff9-9dab-46b16a904fc3 req-b5d91f02-7f83-4736-b5d7-1fd553ab5123 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:16.449983 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d18950ab-4e4e-4ff9-9dab-46b16a904fc3 req-b5d91f02-7f83-4736-b5d7-1fd553ab5123 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 945 time: 0.0796764 May 12 16:15:16.492761 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d18950ab-4e4e-4ff9-9dab-46b16a904fc3 req-38f6d4e9-9aa7-47fb-81bd-c04701af9da2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371919 May 12 16:15:17.491083 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:15:17.564003 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:15:17.569131 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:15:17.570164 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:17.682656 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4424be2-a9bc-4766-9611-24b01e3fecde req-c247a280-ab44-4e6a-9151-c5345e187e9d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:17.684104 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e4424be2-a9bc-4766-9611-24b01e3fecde req-c247a280-ab44-4e6a-9151-c5345e187e9d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 945 time: 0.0864317 May 12 16:15:17.690141 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:17.717619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:15:17.727802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:15:17.729178 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e4424be2-a9bc-4766-9611-24b01e3fecde req-61e6b7b7-4022-442c-a106-5fd0b9339111 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391283 May 12 16:15:17.733561 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:17.768461 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-28bbc74a-05bc-466c-aa1e-31a5b716584e'] response: {'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'code': 200} May 12 16:15:17.805860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:17.886408 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:17.933492 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4baa8296-b7b9-4476-9b6b-0304562c84c5 req-57641ede-3915-4117-b9a9-28cbd3f26f39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:17.934954 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4baa8296-b7b9-4476-9b6b-0304562c84c5 req-57641ede-3915-4117-b9a9-28cbd3f26f39 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 1097 time: 0.0696135 May 12 16:15:17.981698 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4baa8296-b7b9-4476-9b6b-0304562c84c5 req-7e13dc2f-ebac-48b7-8873-dc2e9de6881c service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375006 May 12 16:15:18.920946 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93ddcb04-29e9-468c-bcfc-18752d60147e req-01732ba7-5bac-4a4f-b301-e67890c2a179 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:18.922970 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93ddcb04-29e9-468c-bcfc-18752d60147e req-01732ba7-5bac-4a4f-b301-e67890c2a179 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0814559 May 12 16:15:18.972195 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-93ddcb04-29e9-468c-bcfc-18752d60147e req-216934ae-6f3d-4b7f-92ba-582679c9d12e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433006 May 12 16:15:20.160136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad221985-7062-458e-8854-96c2991e1d09 req-81b2db91-730f-4e46-bed4-9d8997fa46ad tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:20.161494 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad221985-7062-458e-8854-96c2991e1d09 req-81b2db91-730f-4e46-bed4-9d8997fa46ad tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0801272 May 12 16:15:20.207070 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ad221985-7062-458e-8854-96c2991e1d09 req-720564bb-00f3-4d51-813d-377ed499046b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397243 May 12 16:15:20.395096 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-693b2ce7-43b2-4b81-a8ac-f29906a827ab req-e3149698-e928-45fb-b801-c9c8dc556526 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:20.396522 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-693b2ce7-43b2-4b81-a8ac-f29906a827ab req-e3149698-e928-45fb-b801-c9c8dc556526 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0821252 May 12 16:15:20.442840 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-693b2ce7-43b2-4b81-a8ac-f29906a827ab req-c48e4a6a-8ad4-4bd8-8016-df28703ece1a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404162 May 12 16:15:20.464941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55734) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:15:20.534614 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-527cbe87-57bc-4b9b-9112-7ef1f608a22c tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:20.536085 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-527cbe87-57bc-4b9b-9112-7ef1f608a22c tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 1092 time: 0.0701602 May 12 16:15:20.538826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55738) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:15:20.543733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address': '172.20.0.14'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:15:20.550799 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:15:20.554658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:floatingip and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:15:20.557489 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:15:20.563714 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:15:20.574380 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:20.711872 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:20.851380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.25.8.8 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/73786369-90a0-4151-9e8b-4b8e5b26ad6e) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:15:21.004498 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:21.035992 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:21.098664 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:15:21.101307 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:15:21.105054 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:15:21.260436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=73786369-90a0-4151-9e8b-4b8e5b26ad6e,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:21.629485 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:21.704891 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:21.916059 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:21.920620 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:22.032937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=73786369-90a0-4151-9e8b-4b8e5b26ad6e,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:15:22.039017 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:22.219416 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Floating IP 5b6a6be3-f498-41f3-bf1a-86d65a18c0f4 associated. External IP: 172.25.8.8, port: 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3. May 12 16:15:22.576147 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 99b1e28b-7903-47cb-ac29-802fff94199f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:15:22.873652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:15:22.884181 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71042247-82af-4ec2-8f33-544d521dd2ea None None] Sync routers for ids ['99b1e28b-7903-47cb-ac29-802fff94199f'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:15:22.894954 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71042247-82af-4ec2-8f33-544d521dd2ea None None] Routers {'99b1e28b-7903-47cb-ac29-802fff94199f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:15:22.895664 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-71042247-82af-4ec2-8f33-544d521dd2ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:15:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99b1e28b-7903-47cb-ac29-802fff94199f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:15:22.899953 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:22.956084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4c0a90aa-7c6c-47c6-8928-e1c6a14623e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.4162135 May 12 16:15:22.956645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:15:23.104271 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-344d1663-7b64-4265-86e1-899550016424'] response: {'name': 'network-changed', 'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'status': 'completed', 'code': 200} May 12 16:15:23.114473 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-71042247-82af-4ec2-8f33-544d521dd2ea None None] Set router 99b1e28b-7903-47cb-ac29-802fff94199f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:15:23.129156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e9b5a69-6fe5-413b-aeeb-47827dd6b53d req-af753eef-9b0c-404f-ad30-221266213550 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:23.130575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e9b5a69-6fe5-413b-aeeb-47827dd6b53d req-af753eef-9b0c-404f-ad30-221266213550 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0872662 May 12 16:15:23.179908 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5e9b5a69-6fe5-413b-aeeb-47827dd6b53d req-fbf57545-ab71-46b4-9837-379334fc57a1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430934 May 12 16:15:23.203897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55748) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:15:23.227406 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32db811d-3652-4ff2-b558-8215666b55cf req-b671b07b-8a11-479d-81a3-48c0ec6653f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:23.228993 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32db811d-3652-4ff2-b558-8215666b55cf req-b671b07b-8a11-479d-81a3-48c0ec6653f2 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 1097 time: 0.0828819 May 12 16:15:23.320620 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a900c29d-ddcf-4c92-9e3c-35c8ffdda916 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/5b6a6be3-f498-41f3-bf1a-86d65a18c0f4 HTTP/1.1" status: 200 len: 990 time: 0.1152141 May 12 16:15:23.376816 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32db811d-3652-4ff2-b558-8215666b55cf req-5b2926ac-0b71-4481-9beb-80b3e2d011a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:23.378290 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32db811d-3652-4ff2-b558-8215666b55cf req-5b2926ac-0b71-4481-9beb-80b3e2d011a6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9a6ee36e-4706-491e-8e3f-fdd038ffad04 HTTP/1.1" status: 200 len: 898 time: 0.1429965 May 12 16:15:23.481530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-71042247-82af-4ec2-8f33-544d521dd2ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:05Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '5b6a6be3-f498-41f3-bf1a-86d65a18c0f4', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.8', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'port_id': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4327, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'mac_address': 'fa:16:3e:f6:a0:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:15:21Z', 'updated_at': '2022-05-12T16:15:21Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0', 'name': '', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:0f:db:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4324, 'fixed_ips': [{'subnet_id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:04Z', 'updated_at': '2022-05-12T16:15:10Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:15:23.482103 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32db811d-3652-4ff2-b558-8215666b55cf req-e1d0f4c6-6bb4-4358-84ba-8206766c160e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 HTTP/1.1" status: 200 len: 998 time: 0.0981357 May 12 16:15:23.486725 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71042247-82af-4ec2-8f33-544d521dd2ea None None] Checking router: 99b1e28b-7903-47cb-ac29-802fff94199f for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:15:23.494975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71042247-82af-4ec2-8f33-544d521dd2ea None None] Routers {'99b1e28b-7903-47cb-ac29-802fff94199f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:15:23.495566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-71042247-82af-4ec2-8f33-544d521dd2ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:15:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99b1e28b-7903-47cb-ac29-802fff94199f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:15:23.546961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32db811d-3652-4ff2-b558-8215666b55cf req-1930b1ca-6f08-4878-9132-189b5856baa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:23.548380 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32db811d-3652-4ff2-b558-8215666b55cf req-1930b1ca-6f08-4878-9132-189b5856baa3 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3116a1dc-79e6-4477-8c17-2ca48ca89166 HTTP/1.1" status: 200 len: 835 time: 0.0576432 May 12 16:15:23.629991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32db811d-3652-4ff2-b558-8215666b55cf req-712b6979-f602-4b15-8e94-8d17e2ac10c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:23.631453 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32db811d-3652-4ff2-b558-8215666b55cf req-712b6979-f602-4b15-8e94-8d17e2ac10c5 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9a6ee36e-4706-491e-8e3f-fdd038ffad04&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0772228 May 12 16:15:23.679996 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-71042247-82af-4ec2-8f33-544d521dd2ea None None] Set router 99b1e28b-7903-47cb-ac29-802fff94199f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:15:23.764101 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32db811d-3652-4ff2-b558-8215666b55cf req-c043fd16-05e5-4911-ae1c-3aeffa5d5ac9 service neutron] 10.222.0.84 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1262515 May 12 16:15:23.897042 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-32db811d-3652-4ff2-b558-8215666b55cf req-d57e0a2e-8a56-4f47-8486-9abfb5abc4fa service neutron] 10.222.0.84 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1246607 May 12 16:15:24.039135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-71042247-82af-4ec2-8f33-544d521dd2ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:05Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '5b6a6be3-f498-41f3-bf1a-86d65a18c0f4', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.8', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'port_id': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4327, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'mac_address': 'fa:16:3e:f6:a0:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:15:21Z', 'updated_at': '2022-05-12T16:15:21Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0', 'name': '', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:0f:db:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4324, 'fixed_ips': [{'subnet_id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:04Z', 'updated_at': '2022-05-12T16:15:10Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:15:24.042951 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71042247-82af-4ec2-8f33-544d521dd2ea None None] The sync data for ids ['99b1e28b-7903-47cb-ac29-802fff94199f'] in n-d-841483-1 is: [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:05Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '5b6a6be3-f498-41f3-bf1a-86d65a18c0f4', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.8', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'port_id': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4327, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'mac_address': 'fa:16:3e:f6:a0:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:15:21Z', 'updated_at': '2022-05-12T16:15:21Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0', 'name': '', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:0f:db:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4324, 'fixed_ips': [{'subnet_id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:04Z', 'updated_at': '2022-05-12T16:15:10Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:15:24.220567 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f98d3910-3ab1-44b1-8011-8fd4c150f3de None None] New status for floating IP 5b6a6be3-f498-41f3-bf1a-86d65a18c0f4: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:15:24.324525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55754) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:15:24.432482 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ff17d91-28f5-4b23-957c-d9e1040cc8a7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/5b6a6be3-f498-41f3-bf1a-86d65a18c0f4 HTTP/1.1" status: 200 len: 990 time: 0.1058559 May 12 16:15:25.435455 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55758) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:15:25.548785 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-65b986a3-b33d-4a87-9200-6ed665101061 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/5b6a6be3-f498-41f3-bf1a-86d65a18c0f4 HTTP/1.1" status: 200 len: 992 time: 0.1121202 May 12 16:15:29.964643 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:15:32.935821 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:35.279604 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ff9aa55c-1009-4acf-9527-0ff2119ad430 req-8e4ad8cf-ec37-4e98-8f84-7676e61904ec service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0404859 May 12 16:15:35.384169 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ff9aa55c-1009-4acf-9527-0ff2119ad430 req-3d390ccb-8243-484e-9a85-d988a8733dee service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0395570 May 12 16:15:35.427950 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ff9aa55c-1009-4acf-9527-0ff2119ad430 req-a0ab02bd-f241-4f6a-bb98-edee053ec4b5 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0244510 May 12 16:15:35.559891 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9aa55c-1009-4acf-9527-0ff2119ad430 req-1ac07f0c-2887-47a2-b371-6f85d5ec716d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:35.561218 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ff9aa55c-1009-4acf-9527-0ff2119ad430 req-1ac07f0c-2887-47a2-b371-6f85d5ec716d service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1274593 May 12 16:15:42.879322 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-85726e25-24a9-4181-968f-3b1e7dc9531b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:43.772085 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:45.408237 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2bbb7c7d-6749-4267-a750-5a95f85d949e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:46.139615 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:46.417058 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:47.889626 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:15:56.996873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55786) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:15:57.063695 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e2da0e9-f7b9-45c5-8c25-91742ab6762a req-5979c3b6-ed1f-4c11-9266-2397fed01ef9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:57.065751 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e2da0e9-f7b9-45c5-8c25-91742ab6762a req-5979c3b6-ed1f-4c11-9266-2397fed01ef9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0846550 May 12 16:15:57.109188 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-e0623c02-8926-4afe-8ceb-617a9f4c2bd9 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1111512 May 12 16:15:57.112082 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3e2da0e9-f7b9-45c5-8c25-91742ab6762a req-f3ac207e-d66f-45f2-9473-020060ebf111 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395854 May 12 16:15:58.265227 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-d00ec8ce-dd20-43ae-80fa-c9213b8ebdfa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:58.266920 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-d00ec8ce-dd20-43ae-80fa-c9213b8ebdfa service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 1097 time: 0.0719016 May 12 16:15:58.312353 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c8b39e8-54fa-4b28-bd1f-43694184ab4c req-435f83ec-55d2-4f2b-a006-e9e71b3e8f17 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:58.315032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c8b39e8-54fa-4b28-bd1f-43694184ab4c req-435f83ec-55d2-4f2b-a006-e9e71b3e8f17 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0928259 May 12 16:15:58.363510 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8c8b39e8-54fa-4b28-bd1f-43694184ab4c req-581078d8-9a61-4692-83b8-d1d8b540041c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422161 May 12 16:15:58.518955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-8e1a8bc8-7756-4ecc-a3dd-ac7b46b718b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:58.520404 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-8e1a8bc8-7756-4ecc-a3dd-ac7b46b718b1 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9a6ee36e-4706-491e-8e3f-fdd038ffad04 HTTP/1.1" status: 200 len: 898 time: 0.2472491 May 12 16:15:58.630651 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-76409a94-6be4-4078-aba1-e2b3b88fa27e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 HTTP/1.1" status: 200 len: 1000 time: 0.1022034 May 12 16:15:58.698737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af890779-12be-40da-8e2f-a7934646d34b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:58.700149 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af890779-12be-40da-8e2f-a7934646d34b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3116a1dc-79e6-4477-8c17-2ca48ca89166 HTTP/1.1" status: 200 len: 835 time: 0.0626690 May 12 16:15:58.775377 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-409fa014-545f-43ae-b8b7-aab28507ca08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:58.776827 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-409fa014-545f-43ae-b8b7-aab28507ca08 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9a6ee36e-4706-491e-8e3f-fdd038ffad04&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0696592 May 12 16:15:58.908315 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-5be4e3d2-d930-4d12-92a9-fef3485b72f8 service neutron] 10.222.0.84 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1239021 May 12 16:15:59.048039 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-652ad5f9-5439-445a-8263-a41fab11b995 service neutron] 10.222.0.84 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1333692 May 12 16:15:59.548301 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56828cdd-5aec-46c7-a61f-2e70d6884775 req-8721b22e-d19f-4a95-8056-b543306049ef tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:15:59.549678 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56828cdd-5aec-46c7-a61f-2e70d6884775 req-8721b22e-d19f-4a95-8056-b543306049ef tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0813580 May 12 16:15:59.598587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56828cdd-5aec-46c7-a61f-2e70d6884775 req-c69edd11-5d6e-4462-80fd-0d9c90138a9a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431533 May 12 16:16:00.786137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a60ab84-a4d3-48da-9c89-5753bd544c34 req-84a38590-78db-430a-9888-5f933b2298d8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:00.787751 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a60ab84-a4d3-48da-9c89-5753bd544c34 req-84a38590-78db-430a-9888-5f933b2298d8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0825908 May 12 16:16:00.832028 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6a60ab84-a4d3-48da-9c89-5753bd544c34 req-9a23f8c8-759e-42ca-adcf-b24ce5c14637 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384810 May 12 16:16:02.020237 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b54cfd69-2476-4804-87ad-14b1af79e3be req-307a5bb1-bd9e-4577-8274-0628c793d3fa tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:02.021720 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b54cfd69-2476-4804-87ad-14b1af79e3be req-307a5bb1-bd9e-4577-8274-0628c793d3fa tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0860441 May 12 16:16:02.066899 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b54cfd69-2476-4804-87ad-14b1af79e3be req-7cd66a21-f1a0-4e07-af30-4aa02a9ce583 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395153 May 12 16:16:02.086498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d048c51a-3e7a-441a-b3d6-6a2b3cdce1ae req-769f7617-80d1-4cbc-8763-2b3e6116a84c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:02.088072 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d048c51a-3e7a-441a-b3d6-6a2b3cdce1ae req-769f7617-80d1-4cbc-8763-2b3e6116a84c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 1097 time: 0.0744841 May 12 16:16:02.231928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d048c51a-3e7a-441a-b3d6-6a2b3cdce1ae req-32d66f6c-c0f8-4f63-af95-31a766d371f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:02.233369 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d048c51a-3e7a-441a-b3d6-6a2b3cdce1ae req-32d66f6c-c0f8-4f63-af95-31a766d371f0 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9a6ee36e-4706-491e-8e3f-fdd038ffad04 HTTP/1.1" status: 200 len: 898 time: 0.1260536 May 12 16:16:02.337657 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d048c51a-3e7a-441a-b3d6-6a2b3cdce1ae req-3d0cb2a5-020d-4b7d-bf35-51a03aad5605 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 HTTP/1.1" status: 200 len: 1000 time: 0.0978067 May 12 16:16:02.402689 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d048c51a-3e7a-441a-b3d6-6a2b3cdce1ae req-95b2bb86-102c-4756-a363-69b0036ad22b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:02.404068 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d048c51a-3e7a-441a-b3d6-6a2b3cdce1ae req-95b2bb86-102c-4756-a363-69b0036ad22b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3116a1dc-79e6-4477-8c17-2ca48ca89166 HTTP/1.1" status: 200 len: 835 time: 0.0599792 May 12 16:16:02.483559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d048c51a-3e7a-441a-b3d6-6a2b3cdce1ae req-efaabb3a-9347-4452-8a68-337caf12d2b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:02.484918 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d048c51a-3e7a-441a-b3d6-6a2b3cdce1ae req-efaabb3a-9347-4452-8a68-337caf12d2b3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9a6ee36e-4706-491e-8e3f-fdd038ffad04&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0699124 May 12 16:16:02.618272 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d048c51a-3e7a-441a-b3d6-6a2b3cdce1ae req-d22c3160-48f5-45c0-9fd2-f5c9d360c5ee service neutron] 10.222.0.84 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1265688 May 12 16:16:02.751593 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d048c51a-3e7a-441a-b3d6-6a2b3cdce1ae req-a59c0462-5765-42fe-982d-df85d49ba4b0 service neutron] 10.222.0.84 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1250706 May 12 16:16:02.932709 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:03.255831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30dff8ac-55a1-4869-8470-fc7543c87d65 req-e7284b57-5803-4e2f-ad32-b497285b41bb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:03.257265 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30dff8ac-55a1-4869-8470-fc7543c87d65 req-e7284b57-5803-4e2f-ad32-b497285b41bb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0823164 May 12 16:16:03.303180 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-30dff8ac-55a1-4869-8470-fc7543c87d65 req-c0a54dc6-bdb7-48c6-9883-77559bbe937b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381632 May 12 16:16:04.493010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-820067c6-75f9-46e8-b4aa-0cf6af9cb57c req-bf244fa0-a502-4126-8c97-2d4304abbd3c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:04.494480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-820067c6-75f9-46e8-b4aa-0cf6af9cb57c req-bf244fa0-a502-4126-8c97-2d4304abbd3c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0833523 May 12 16:16:04.537968 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-820067c6-75f9-46e8-b4aa-0cf6af9cb57c req-e14ac956-cd3b-4190-bb97-51a00252cf3e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378602 May 12 16:16:05.720533 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63c7dd89-f745-4c69-bb32-3522b8cd01a1 req-8c0f9dc6-4ce8-4da5-82c3-699d0b7e5b08 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:05.721991 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63c7dd89-f745-4c69-bb32-3522b8cd01a1 req-8c0f9dc6-4ce8-4da5-82c3-699d0b7e5b08 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0793707 May 12 16:16:05.769419 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-63c7dd89-f745-4c69-bb32-3522b8cd01a1 req-ec369a99-0e0e-477e-a1cd-33a364df4bfe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410330 May 12 16:16:06.953780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fffc4ad-4650-4bde-a084-5220f46154d6 req-2fa1c41c-7a96-48e8-a2f7-f27202bf9931 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:06.955208 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6fffc4ad-4650-4bde-a084-5220f46154d6 req-2fa1c41c-7a96-48e8-a2f7-f27202bf9931 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0797925 May 12 16:16:06.964628 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:16:06.999704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6fffc4ad-4650-4bde-a084-5220f46154d6 req-3ca48620-45fc-4706-8577-4c5be507aa8d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381765 May 12 16:16:08.188917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ae9bce-6c19-4491-8aaa-d9213d940b53 req-7f18f227-377a-4754-a673-c9f0686e2fb0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:08.190369 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50ae9bce-6c19-4491-8aaa-d9213d940b53 req-7f18f227-377a-4754-a673-c9f0686e2fb0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0837283 May 12 16:16:08.234649 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-50ae9bce-6c19-4491-8aaa-d9213d940b53 req-f2a39496-ac8c-4686-8e69-443b4223c8d8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382667 May 12 16:16:09.429195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4492a14-f7bf-4b95-9711-7b3aa6e54d00 req-8d6eefb5-a129-4c5d-91bd-79bb89898554 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:09.430685 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4492a14-f7bf-4b95-9711-7b3aa6e54d00 req-8d6eefb5-a129-4c5d-91bd-79bb89898554 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0796325 May 12 16:16:09.474008 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b4492a14-f7bf-4b95-9711-7b3aa6e54d00 req-64816055-5046-4469-9c5b-9811ea8cbc8f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377421 May 12 16:16:10.661697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0bd2a4c-a526-4fe9-8763-e692137144ba req-cb7be157-29c3-4e07-9279-a50a0a883434 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:10.663022 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0bd2a4c-a526-4fe9-8763-e692137144ba req-cb7be157-29c3-4e07-9279-a50a0a883434 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0815451 May 12 16:16:10.706183 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c0bd2a4c-a526-4fe9-8763-e692137144ba req-41e481d3-56fb-491d-adac-c6cf40265001 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374827 May 12 16:16:11.264644 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-91248e64-476d-484c-acf4-b9bb21e9bcfc service neutron] show failed (client error): The resource could not be found. May 12 16:16:11.265701 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-91248e64-476d-484c-acf4-b9bb21e9bcfc service neutron] 10.222.0.84 "GET /v2.0/ports/7ed0066b-1c90-45f5-b62d-aebbea6fd2e3/bindings/n-h2-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.0793979 May 12 16:16:11.541682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-ec8afa93-b70c-4f4f-b8b2-00f00645782d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:11.543036 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-ec8afa93-b70c-4f4f-b8b2-00f00645782d service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22&tenant_id=f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 1097 time: 0.0741909 May 12 16:16:11.553633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-841483-1', 'device_owner': 'compute:nova'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:16:11.770213 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:11.915383 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d3e3ec-6268-4dd2-a120-47684314cce1 req-0e5c86fa-b772-4023-81c4-709e3b4594bb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:11.917001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86d3e3ec-6268-4dd2-a120-47684314cce1 req-0e5c86fa-b772-4023-81c4-709e3b4594bb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0918915 May 12 16:16:11.969415 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-86d3e3ec-6268-4dd2-a120-47684314cce1 req-90a126fe-6cf8-4b5f-8d2d-15d3334cb649 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425365 May 12 16:16:12.053745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] For port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:16:12.083743 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] For port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:16:12.142239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:16:12.148520 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:12.164359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Transition to ACTIVE for port object 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:16:12.169935 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:12.331064 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Pushing event updated for resources: {'Port': ['ID=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,revision_number=6']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:12.344801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:12.345136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:12.345493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:12.345820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:12.346142 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:12.346464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:12.346775 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:12.347098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:12.348204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:12.348945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:12.348945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:12.349257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:12.383114 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8b4ce9fc-68cd-41cf-b879-a2839e14177d'] response: {'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'code': 200} May 12 16:16:12.394170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] No DVR routers for this DVR port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:16:12.620332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Attempting to bind port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:16:12.620658 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Attempting to bind port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:16:12.620982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Attempting to bind port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 on network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:16:12.625494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 on network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:16:12.625814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Attempting to bind port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 on network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:16:12.631346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 16, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:16:12.631682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Checking segment: {'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:16:12.632060 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Bound using segment: {'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:16:12.632480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Bound port: 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ff6e1144-21dd-4621-9c9b-74d7120617b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:16:12.632820 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:12.721335 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] For port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:16:12.724973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] For port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:16:12.729411 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:12.795343 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:12.795963 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:12.797328 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] 10.222.0.76 "PUT /v2.0/ports/7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 HTTP/1.1" status: 200 len: 1092 time: 1.2481568 May 12 16:16:12.848241 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af528b9c-e45f-4fda-99ab-458b5eb8fbb9 service neutron] Pushing event updated for resources: {'Port': ['ID=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,revision_number=7']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:12.888687 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0eeab25f-e14a-47e7-9d63-9f0eaa61ee1a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:12.896548 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-b3323d6e-bf50-45b2-896f-83683c04abed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:12.898086 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-b3323d6e-bf50-45b2-896f-83683c04abed service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 1095 time: 0.0795863 May 12 16:16:13.034090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-91093787-e565-47d4-973f-ec728c338b7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:13.036222 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-91093787-e565-47d4-973f-ec728c338b7f service neutron] 10.222.0.76 "GET /v2.0/networks?id=9a6ee36e-4706-491e-8e3f-fdd038ffad04 HTTP/1.1" status: 200 len: 898 time: 0.1317115 May 12 16:16:13.141476 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-7d51b1e5-c4c6-486e-a4ac-ad9d326a6842 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 HTTP/1.1" status: 200 len: 998 time: 0.0999064 May 12 16:16:13.162639 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd97f74f-b6ae-4de8-967c-7b1665f85be6 req-d3aa7dc5-1be3-4a7a-b883-c428400f7119 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:13.164089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd97f74f-b6ae-4de8-967c-7b1665f85be6 req-d3aa7dc5-1be3-4a7a-b883-c428400f7119 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 944 time: 0.0831528 May 12 16:16:13.206876 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-4fdca5a8-beb6-43fb-8ec7-00d3d3f5f6c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:13.207900 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bd97f74f-b6ae-4de8-967c-7b1665f85be6 req-f29246cd-f969-450f-b707-0c814082aaac tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380485 May 12 16:16:13.208309 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-4fdca5a8-beb6-43fb-8ec7-00d3d3f5f6c0 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=3116a1dc-79e6-4477-8c17-2ca48ca89166 HTTP/1.1" status: 200 len: 835 time: 0.0616803 May 12 16:16:13.283971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-d8704e83-6e4b-425f-9767-a79187656898 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:13.286166 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-d8704e83-6e4b-425f-9767-a79187656898 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9a6ee36e-4706-491e-8e3f-fdd038ffad04&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0707684 May 12 16:16:13.525572 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-b94797ed-e21d-4167-ad91-9beee6932530 service neutron] 10.222.0.76 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2339449 May 12 16:16:13.655477 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9ee71520-68c4-47d1-862a-9d6e7459157c req-5a16ce10-f46a-42d9-98bc-4f7da20c0ca4 service neutron] 10.222.0.76 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1244926 May 12 16:16:13.787829 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:14.384700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:16:14.397996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce8489e7-7a1f-4192-a384-c9e0597f7ed2 req-b839cb83-f1fb-4b63-a82c-ade3da1d8137 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:14.399448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce8489e7-7a1f-4192-a384-c9e0597f7ed2 req-b839cb83-f1fb-4b63-a82c-ade3da1d8137 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 944 time: 0.0820103 May 12 16:16:14.445232 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-567b31ef-90bf-42bc-9ffd-fe6379a9fe64'] response: {'name': 'network-changed', 'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'status': 'completed', 'code': 200} May 12 16:16:14.448129 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce8489e7-7a1f-4192-a384-c9e0597f7ed2 req-70c806a7-03d8-4405-8e85-8729b2c8a2a4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430894 May 12 16:16:14.589766 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-9ddfa82e-8d91-4cff-b523-e8b3263aae67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:14.591223 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-9ddfa82e-8d91-4cff-b523-e8b3263aae67 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 1095 time: 0.1299498 May 12 16:16:14.620083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-580a4fac-7363-470f-a68c-7f1991a0a870 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:14.621515 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-580a4fac-7363-470f-a68c-7f1991a0a870 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 1095 time: 0.1050057 May 12 16:16:14.833899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-03f49e5d-6c1a-411e-89f5-6a90dc79256e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:14.835248 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-03f49e5d-6c1a-411e-89f5-6a90dc79256e service neutron] 10.222.0.76 "GET /v2.0/networks?id=9a6ee36e-4706-491e-8e3f-fdd038ffad04 HTTP/1.1" status: 200 len: 898 time: 0.2369206 May 12 16:16:14.919143 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-e135cc09-6558-4a83-83e1-081721d6e237 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:14.920568 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-e135cc09-6558-4a83-83e1-081721d6e237 service neutron] 10.222.0.84 "GET /v2.0/networks?id=9a6ee36e-4706-491e-8e3f-fdd038ffad04 HTTP/1.1" status: 200 len: 898 time: 0.2515371 May 12 16:16:15.024390 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-4f32f6a7-4e2f-41b5-b004-822f2ecfa83d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 HTTP/1.1" status: 200 len: 998 time: 0.1808083 May 12 16:16:15.076384 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-9213769b-7d85-48dc-a419-8e49aa253f3d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 HTTP/1.1" status: 200 len: 998 time: 0.1435919 May 12 16:16:15.146997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-725999e8-1f54-4b77-8e6c-8b3670de5fef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:15.148341 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-725999e8-1f54-4b77-8e6c-8b3670de5fef service neutron] 10.222.0.76 "GET /v2.0/subnets?id=3116a1dc-79e6-4477-8c17-2ca48ca89166 HTTP/1.1" status: 200 len: 835 time: 0.1167123 May 12 16:16:15.158095 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-0536f71b-baa5-44a3-a938-9e453fa02ce8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:15.159409 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-0536f71b-baa5-44a3-a938-9e453fa02ce8 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3116a1dc-79e6-4477-8c17-2ca48ca89166 HTTP/1.1" status: 200 len: 835 time: 0.0740833 May 12 16:16:15.233505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:16:15.297736 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-683e14c6-e8a2-45ea-be82-04bdde92f0a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:15.299204 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-683e14c6-e8a2-45ea-be82-04bdde92f0a3 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9a6ee36e-4706-491e-8e3f-fdd038ffad04&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1427050 May 12 16:16:15.302410 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-00ab8888-a479-4fcf-a7ea-01bf728da78b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:15.303795 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-00ab8888-a479-4fcf-a7ea-01bf728da78b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9a6ee36e-4706-491e-8e3f-fdd038ffad04&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1083691 May 12 16:16:15.379860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:16:15.393878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'port_id': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'mac_address': 'fa:16:3e:f6:a0:a5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 553, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:16:15.495365 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0a5c4d46-471d-4935-bc04-a688e66ef1a6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:15.509143 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:15.526581 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:16:15.542830 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:16:15.547379 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:15.556801 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-37d3fd29-c4c5-4042-a2f6-99c54de43ae5 service neutron] 10.222.0.76 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2515345 May 12 16:16:15.558654 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-dfaed034-8a89-4511-b428-baab74b87338 service neutron] 10.222.0.84 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2347925 May 12 16:16:15.617095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:15.624966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:15.624966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:15.625221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:15.625654 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:15.625880 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:15.626194 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:15.626505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:15.626814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:15.627120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:15.627427 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:15.627740 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:15.628045 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:15.646205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a89dc19b-5212-4d67-8420-81415df9a92b req-d1a30948-192f-43d1-a770-9ed66be7ee38 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:15.647710 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a89dc19b-5212-4d67-8420-81415df9a92b req-d1a30948-192f-43d1-a770-9ed66be7ee38 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 945 time: 0.0844626 May 12 16:16:15.696247 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a89dc19b-5212-4d67-8420-81415df9a92b req-56221f66-e237-4525-bd95-0fdf164f7a8d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425315 May 12 16:16:15.773276 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:16:15.809213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['7ed0066b-1c90-45f5-b62d-aebbea6fd2e3'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:16:15.892636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:16:15.946860 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-7e9d4a9a-d125-410a-a4fb-caa445fc3f53 service neutron] 10.222.0.76 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3844078 May 12 16:16:15.950159 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f2fee61d-3d23-498d-83f9-02875397aff5 req-67c83dd8-bc1e-4eba-b270-54bf482f59a6 service neutron] 10.222.0.84 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3671286 May 12 16:16:16.029132 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7e11e6-76f1-4234-871b-224aa0a1c6b7 req-b442d782-094f-4ec7-a07f-b2a3c285ee3b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:16.030634 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee7e11e6-76f1-4234-871b-224aa0a1c6b7 req-b442d782-094f-4ec7-a07f-b2a3c285ee3b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 945 time: 0.0930510 May 12 16:16:16.081584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee7e11e6-76f1-4234-871b-224aa0a1c6b7 req-55be67ee-88a6-41f8-b6f8-b40737a42ddf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432246 May 12 16:16:16.106069 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-34d94e95-10af-4624-9733-92a21e7184eb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:16.106870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-34d94e95-10af-4624-9733-92a21e7184eb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:16:16.125494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-34d94e95-10af-4624-9733-92a21e7184eb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:16:16.128400 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-34d94e95-10af-4624-9733-92a21e7184eb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22&tenant_id=f50049e6814046a9abf21905584f94e1&binding%3Ahost_id=n-h2-841483-1 HTTP/1.1" status: 200 len: 945 time: 0.1125205 May 12 16:16:16.165418 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:16.231766 n-d-841483-1 neutron-server[88151]: INFO neutron.api.v2.resource [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-958a9a8d-d8d9-46e8-add6-522fbe951462 service neutron] delete failed (client error): The resource could not be found. May 12 16:16:16.233420 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-958a9a8d-d8d9-46e8-add6-522fbe951462 service neutron] 10.222.0.84 "DELETE /v2.0/ports/7ed0066b-1c90-45f5-b62d-aebbea6fd2e3/bindings/n-h1-841483-1 HTTP/1.1" status: 404 len: 380 time: 0.0968020 May 12 16:16:16.277136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8091c54-3a0f-4424-95cb-2e8667fe8e58 req-4f483bb1-3a44-4ed6-9f36-88219d784fee tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:16.282115 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8091c54-3a0f-4424-95cb-2e8667fe8e58 req-4f483bb1-3a44-4ed6-9f36-88219d784fee tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 945 time: 0.0844822 May 12 16:16:16.324009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d8091c54-3a0f-4424-95cb-2e8667fe8e58 req-1b84222b-48e0-4e5b-b4e7-47093fb1a0a4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395055 May 12 16:16:16.414938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-9211a280-f6a9-466c-8922-ce98ba447b72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:16.416376 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-9211a280-f6a9-466c-8922-ce98ba447b72 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 1096 time: 0.0708899 May 12 16:16:16.419909 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:16.551754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-5e4df9ae-8e76-4625-90a6-384587a3cfff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:16.553181 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-5e4df9ae-8e76-4625-90a6-384587a3cfff service neutron] 10.222.0.84 "GET /v2.0/networks?id=9a6ee36e-4706-491e-8e3f-fdd038ffad04 HTTP/1.1" status: 200 len: 898 time: 0.1264579 May 12 16:16:16.660781 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-303b40e8-83a2-4c87-91f8-585065a81d7e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 HTTP/1.1" status: 200 len: 999 time: 0.0977485 May 12 16:16:16.727126 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-7f67be9a-0752-4181-9d3f-d5c7cdc98a8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:16.728500 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-7f67be9a-0752-4181-9d3f-d5c7cdc98a8c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=3116a1dc-79e6-4477-8c17-2ca48ca89166 HTTP/1.1" status: 200 len: 835 time: 0.0573850 May 12 16:16:16.810127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-13784432-92bb-4c64-9564-21f1c6b09a0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:16.811487 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-13784432-92bb-4c64-9564-21f1c6b09a0d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=9a6ee36e-4706-491e-8e3f-fdd038ffad04&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0738804 May 12 16:16:16.943042 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-78e1ee2d-1fa2-4a0f-a456-879c475ebc8e service neutron] 10.222.0.84 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1221373 May 12 16:16:17.077042 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bfe841e6-abe6-4378-b4f2-f963833df3b9 req-87103605-2c5d-4b48-a6e8-9653e7f48f82 service neutron] 10.222.0.84 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1241243 May 12 16:16:17.250616 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:16:17.317292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:16:17.322092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:16:17.322462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:17.439709 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:17.467444 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:16:17.480870 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:16:17.488797 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:17.546122 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6a6ac31e-9062-4189-8dca-22be1ddab178'] response: {'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'code': 200} May 12 16:16:17.574821 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:17.630490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9721d836-22d7-42f7-9686-baa0ae3be9c7 req-6d84a47e-b5d2-44d0-b6cb-51ee968f399f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:17.631982 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9721d836-22d7-42f7-9686-baa0ae3be9c7 req-6d84a47e-b5d2-44d0-b6cb-51ee968f399f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.2004709 May 12 16:16:17.678106 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9721d836-22d7-42f7-9686-baa0ae3be9c7 req-9a6d8894-517a-48a0-8ca2-3a7d860c06c6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388575 May 12 16:16:17.892058 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:18.862592 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c76726e0-8ad1-46cf-a02f-6cfdfb522606 req-50a97d2b-d327-44d8-bd3f-f86ff6dbed1e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:18.864568 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c76726e0-8ad1-46cf-a02f-6cfdfb522606 req-50a97d2b-d327-44d8-bd3f-f86ff6dbed1e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0798380 May 12 16:16:18.910382 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c76726e0-8ad1-46cf-a02f-6cfdfb522606 req-6240d161-1b7b-482e-9567-c2f713aa95f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400379 May 12 16:16:18.933465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55860) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:19.039224 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9fc11bc9-5d10-4a00-a40b-406c623f6f53 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/5b6a6be3-f498-41f3-bf1a-86d65a18c0f4 HTTP/1.1" status: 200 len: 992 time: 0.1045754 May 12 16:16:32.932754 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:37.270802 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8a91cf50-7476-4d1c-9b93-c02ecc3756df req-3427a202-bea1-4ca6-b795-9c90e317d313 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0428576 May 12 16:16:37.380438 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8a91cf50-7476-4d1c-9b93-c02ecc3756df req-cb360b98-5518-4c55-8507-d2eb4cbab4ce service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0407977 May 12 16:16:37.426421 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8a91cf50-7476-4d1c-9b93-c02ecc3756df req-c62a0906-93f6-4bc1-a22a-e316ffc002dc service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0273767 May 12 16:16:37.565657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a91cf50-7476-4d1c-9b93-c02ecc3756df req-f1c090d8-f20b-416e-8224-388c63e47fbe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:37.567263 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8a91cf50-7476-4d1c-9b93-c02ecc3756df req-f1c090d8-f20b-416e-8224-388c63e47fbe service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1361279 May 12 16:16:42.882698 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ee199ba6-de2b-4346-9d6d-066ebd341e1a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:43.791022 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:43.963828 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:16:45.407198 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3350bb96-1c7e-40fc-85d2-aadd9e421bb2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:45.415948 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55872) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:45.781536 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-be25e8ea-87c4-46fd-a288-cd042b25265a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port 73786369-90a0-4151-9e8b-4b8e5b26ad6e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:16:45.782482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be25e8ea-87c4-46fd-a288-cd042b25265a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:45.952029 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be25e8ea-87c4-46fd-a288-cd042b25265a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:45.952353 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be25e8ea-87c4-46fd-a288-cd042b25265a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:46.074934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-be25e8ea-87c4-46fd-a288-cd042b25265a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for 73786369-90a0-4151-9e8b-4b8e5b26ad6e owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:16:46.147521 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:46.225245 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be25e8ea-87c4-46fd-a288-cd042b25265a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:46.270589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be25e8ea-87c4-46fd-a288-cd042b25265a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=73786369-90a0-4151-9e8b-4b8e5b26ad6e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:46.363108 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be25e8ea-87c4-46fd-a288-cd042b25265a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:46.363377 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-be25e8ea-87c4-46fd-a288-cd042b25265a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Floating IP 5b6a6be3-f498-41f3-bf1a-86d65a18c0f4 disassociated (deleted). External IP: 172.25.8.8, port: 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3. May 12 16:16:46.424221 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:46.721985 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-be25e8ea-87c4-46fd-a288-cd042b25265a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 99b1e28b-7903-47cb-ac29-802fff94199f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:16:46.900800 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-be25e8ea-87c4-46fd-a288-cd042b25265a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:16:46.910114 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-343e3996-6e4b-4c6e-a6ab-f906ae3869c0 None None] Sync routers for ids ['99b1e28b-7903-47cb-ac29-802fff94199f'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:16:46.920174 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-343e3996-6e4b-4c6e-a6ab-f906ae3869c0 None None] Routers {'99b1e28b-7903-47cb-ac29-802fff94199f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:16:46.920776 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-343e3996-6e4b-4c6e-a6ab-f906ae3869c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:16:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99b1e28b-7903-47cb-ac29-802fff94199f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:16:46.921038 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be25e8ea-87c4-46fd-a288-cd042b25265a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:46.976103 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-be25e8ea-87c4-46fd-a288-cd042b25265a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/floatingips/5b6a6be3-f498-41f3-bf1a-86d65a18c0f4 HTTP/1.1" status: 204 len: 168 time: 1.5589540 May 12 16:16:46.976603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:16:47.023927 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-3ad5043e-be77-4240-8b18-d8192648024e'] response: {'name': 'network-changed', 'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'status': 'completed', 'code': 200} May 12 16:16:47.111730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-343e3996-6e4b-4c6e-a6ab-f906ae3869c0 None None] Set router 99b1e28b-7903-47cb-ac29-802fff94199f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:16:47.273102 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-275e2885-0b63-4f85-8708-859d616d2fbe req-2cd3dd69-adc0-437e-8c09-b340c0fee67b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:47.274793 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-275e2885-0b63-4f85-8708-859d616d2fbe req-2cd3dd69-adc0-437e-8c09-b340c0fee67b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 1097 time: 0.2281270 May 12 16:16:47.402352 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af12c006-ce85-4de8-ad94-b802d0bb22e5 req-b8d78c35-94f2-4f73-a6e6-09b4d7e5daec tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:47.403834 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af12c006-ce85-4de8-ad94-b802d0bb22e5 req-b8d78c35-94f2-4f73-a6e6-09b4d7e5daec tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0842631 May 12 16:16:47.415317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-275e2885-0b63-4f85-8708-859d616d2fbe req-2b9ef46b-b8f9-4d94-8c3b-1cf32abc55e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:47.416749 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-275e2885-0b63-4f85-8708-859d616d2fbe req-2b9ef46b-b8f9-4d94-8c3b-1cf32abc55e9 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9a6ee36e-4706-491e-8e3f-fdd038ffad04 HTTP/1.1" status: 200 len: 898 time: 0.1345649 May 12 16:16:47.453705 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-af12c006-ce85-4de8-ad94-b802d0bb22e5 req-1627b5ae-9b1b-46d9-8583-598ffd8fc664 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434289 May 12 16:16:47.455995 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-343e3996-6e4b-4c6e-a6ab-f906ae3869c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:05Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0', 'name': '', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:0f:db:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4324, 'fixed_ips': [{'subnet_id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:04Z', 'updated_at': '2022-05-12T16:15:10Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:16:47.460867 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-343e3996-6e4b-4c6e-a6ab-f906ae3869c0 None None] Checking router: 99b1e28b-7903-47cb-ac29-802fff94199f for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:16:47.471122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-343e3996-6e4b-4c6e-a6ab-f906ae3869c0 None None] Routers {'99b1e28b-7903-47cb-ac29-802fff94199f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:16:47.471818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-343e3996-6e4b-4c6e-a6ab-f906ae3869c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:16:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99b1e28b-7903-47cb-ac29-802fff94199f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:16:47.492130 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-275e2885-0b63-4f85-8708-859d616d2fbe req-35f69948-d525-43f4-ae8c-9f1675e089b5 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 HTTP/1.1" status: 200 len: 217 time: 0.0688827 May 12 16:16:47.577259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-275e2885-0b63-4f85-8708-859d616d2fbe req-f42ba0f3-b5b8-4a76-9525-9391ca51a4b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:47.578701 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-275e2885-0b63-4f85-8708-859d616d2fbe req-f42ba0f3-b5b8-4a76-9525-9391ca51a4b2 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=3116a1dc-79e6-4477-8c17-2ca48ca89166 HTTP/1.1" status: 200 len: 835 time: 0.0733364 May 12 16:16:47.655120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-275e2885-0b63-4f85-8708-859d616d2fbe req-c3577c9f-efcf-42ab-bc37-a5c4d850fe9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:47.656591 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-275e2885-0b63-4f85-8708-859d616d2fbe req-c3577c9f-efcf-42ab-bc37-a5c4d850fe9d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9a6ee36e-4706-491e-8e3f-fdd038ffad04&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0703573 May 12 16:16:47.663301 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-343e3996-6e4b-4c6e-a6ab-f906ae3869c0 None None] Set router 99b1e28b-7903-47cb-ac29-802fff94199f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:16:47.793111 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-275e2885-0b63-4f85-8708-859d616d2fbe req-0a10db73-dd2a-4dcb-a0a5-d9d7f0903674 service neutron] 10.222.0.76 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1292071 May 12 16:16:47.927878 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-275e2885-0b63-4f85-8708-859d616d2fbe req-0e177fe8-fce8-4e98-98b3-5e2dc9e8b750 service neutron] 10.222.0.76 "GET /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1284380 May 12 16:16:47.933032 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:48.035256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-343e3996-6e4b-4c6e-a6ab-f906ae3869c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:05Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0', 'name': '', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:0f:db:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4324, 'fixed_ips': [{'subnet_id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:04Z', 'updated_at': '2022-05-12T16:15:10Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:16:48.039316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-343e3996-6e4b-4c6e-a6ab-f906ae3869c0 None None] The sync data for ids ['99b1e28b-7903-47cb-ac29-802fff94199f'] in n-d-841483-1 is: [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:05Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0', 'name': '', 'network_id': '9a6ee36e-4706-491e-8e3f-fdd038ffad04', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:0f:db:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4324, 'fixed_ips': [{'subnet_id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:04Z', 'updated_at': '2022-05-12T16:15:10Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '3116a1dc-79e6-4477-8c17-2ca48ca89166', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:16:48.249871 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80dd3344-95c3-4a8e-819e-89c55576a613 None None] New status for floating IP 5b6a6be3-f498-41f3-bf1a-86d65a18c0f4: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:16:48.624105 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-977bc9eb-2783-40f9-b02c-9c0636240bc3 req-6ebf2dcb-ec8f-48dd-b41b-2deae4fc103d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:48.624709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-977bc9eb-2783-40f9-b02c-9c0636240bc3 req-6ebf2dcb-ec8f-48dd-b41b-2deae4fc103d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:16:48.641841 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-977bc9eb-2783-40f9-b02c-9c0636240bc3 req-6ebf2dcb-ec8f-48dd-b41b-2deae4fc103d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:16:48.643225 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-977bc9eb-2783-40f9-b02c-9c0636240bc3 req-6ebf2dcb-ec8f-48dd-b41b-2deae4fc103d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.76 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.1046498 May 12 16:16:48.644344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e60997b6-1ffb-4300-9139-4182a1b5dc38 req-d2d9f8ab-7fe2-45b2-81e4-1d75b8aadc12 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:48.645796 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e60997b6-1ffb-4300-9139-4182a1b5dc38 req-d2d9f8ab-7fe2-45b2-81e4-1d75b8aadc12 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 946 time: 0.0844049 May 12 16:16:48.689898 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e60997b6-1ffb-4300-9139-4182a1b5dc38 req-43e35dee-b203-4f11-b7fb-f5736a10eaa4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=97e00970-bf76-45d6-888c-86903d323271&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382257 May 12 16:16:48.718436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-977bc9eb-2783-40f9-b02c-9c0636240bc3 req-3cbd4d55-4ef8-4323-8d36-121ebff0cee5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:16:48.718780 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-977bc9eb-2783-40f9-b02c-9c0636240bc3 req-3cbd4d55-4ef8-4323-8d36-121ebff0cee5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:48.973366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-977bc9eb-2783-40f9-b02c-9c0636240bc3 req-3cbd4d55-4ef8-4323-8d36-121ebff0cee5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:16:48.974080 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-977bc9eb-2783-40f9-b02c-9c0636240bc3 req-3cbd4d55-4ef8-4323-8d36-121ebff0cee5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:49.093325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-977bc9eb-2783-40f9-b02c-9c0636240bc3 req-3cbd4d55-4ef8-4323-8d36-121ebff0cee5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:16:49.249062 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-977bc9eb-2783-40f9-b02c-9c0636240bc3 req-3cbd4d55-4ef8-4323-8d36-121ebff0cee5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:49.301117 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cbd4d55-4ef8-4323-8d36-121ebff0cee5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=7ed0066b-1c90-45f5-b62d-aebbea6fd2e3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:49.378617 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-977bc9eb-2783-40f9-b02c-9c0636240bc3 req-3cbd4d55-4ef8-4323-8d36-121ebff0cee5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] No DVR routers for this DVR port 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:16:49.383494 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-977bc9eb-2783-40f9-b02c-9c0636240bc3 req-3cbd4d55-4ef8-4323-8d36-121ebff0cee5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:49.385990 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'name': 'network-vif-deleted', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:16:49.402496 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-977bc9eb-2783-40f9-b02c-9c0636240bc3 req-3cbd4d55-4ef8-4323-8d36-121ebff0cee5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.76 "DELETE /v2.0/ports/7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 HTTP/1.1" status: 204 len: 173 time: 0.7545838 May 12 16:16:49.433811 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7777c651-c6fd-405a-818a-369eba4f570d'] response: {'server_uuid': 'f5374304-af7a-455f-8cca-0ed35a754d22', 'name': 'network-vif-deleted', 'tag': '7ed0066b-1c90-45f5-b62d-aebbea6fd2e3', 'status': 'completed', 'code': 200} May 12 16:16:49.858928 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7de1e858-8237-46bf-985a-1c4dc18154d6 req-350c0498-ce30-4f28-a177-ed3e73158508 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5374304-af7a-455f-8cca-0ed35a754d22 HTTP/1.1" status: 200 len: 210 time: 0.0435393 May 12 16:16:50.954939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55892) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:51.437814 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:16:51.472127 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:16:51.472456 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device 7ed0066b-1c90-45f5-b62d-aebbea6fd2e3 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:16:51.608967 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bc36f5d-67fc-4eaa-aea2-6e458029036d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:51.953737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4bc36f5d-67fc-4eaa-aea2-6e458029036d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:16:51.953984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bc36f5d-67fc-4eaa-aea2-6e458029036d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:52.137747 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-4bc36f5d-67fc-4eaa-aea2-6e458029036d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:16:52.138481 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bc36f5d-67fc-4eaa-aea2-6e458029036d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:52.261649 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-4bc36f5d-67fc-4eaa-aea2-6e458029036d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:16:52.695150 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bc36f5d-67fc-4eaa-aea2-6e458029036d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:52.743115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bc36f5d-67fc-4eaa-aea2-6e458029036d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:53.016099 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4bc36f5d-67fc-4eaa-aea2-6e458029036d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:53.371154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4bc36f5d-67fc-4eaa-aea2-6e458029036d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router 99b1e28b-7903-47cb-ac29-802fff94199f has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:16:53.543052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4bc36f5d-67fc-4eaa-aea2-6e458029036d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:16:53.552279 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3c34dba-16a9-4f2f-8769-e0bc52992474 None None] Sync routers for ids ['99b1e28b-7903-47cb-ac29-802fff94199f'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:16:53.556612 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4bc36f5d-67fc-4eaa-aea2-6e458029036d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "PUT /v2.0/routers/99b1e28b-7903-47cb-ac29-802fff94199f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5999789 May 12 16:16:53.558621 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55896) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:53.562566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3c34dba-16a9-4f2f-8769-e0bc52992474 None None] Routers {'99b1e28b-7903-47cb-ac29-802fff94199f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:16:53.563162 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a3c34dba-16a9-4f2f-8769-e0bc52992474 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:16:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99b1e28b-7903-47cb-ac29-802fff94199f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:16:53.626373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-be8f9575-3027-4b2e-b444-b35cade9e5ab tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting subnet 3116a1dc-79e6-4477-8c17-2ca48ca89166 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:16:53.629335 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be8f9575-3027-4b2e-b444-b35cade9e5ab tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:53.683167 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be8f9575-3027-4b2e-b444-b35cade9e5ab tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:53.740827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-a3c34dba-16a9-4f2f-8769-e0bc52992474 None None] Set router 99b1e28b-7903-47cb-ac29-802fff94199f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:16:53.767433 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be8f9575-3027-4b2e-b444-b35cade9e5ab tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:53.844580 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be8f9575-3027-4b2e-b444-b35cade9e5ab tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:53.886750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be8f9575-3027-4b2e-b444-b35cade9e5ab tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Subnet': ['ID=3116a1dc-79e6-4477-8c17-2ca48ca89166,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:53.888693 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-be8f9575-3027-4b2e-b444-b35cade9e5ab tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:53.898047 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-be8f9575-3027-4b2e-b444-b35cade9e5ab tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/subnets/3116a1dc-79e6-4477-8c17-2ca48ca89166 HTTP/1.1" status: 204 len: 168 time: 0.3355076 May 12 16:16:53.899021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55900) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:53.911138 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f93c0502-9bb5-4409-95b9-83b7443ba810 None None] Network 9a6ee36e-4706-491e-8e3f-fdd038ffad04 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:16:54.202888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a3c34dba-16a9-4f2f-8769-e0bc52992474 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:16:52Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:16:54.206863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3c34dba-16a9-4f2f-8769-e0bc52992474 None None] Checking router: 99b1e28b-7903-47cb-ac29-802fff94199f for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:16:54.216232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3c34dba-16a9-4f2f-8769-e0bc52992474 None None] Routers {'99b1e28b-7903-47cb-ac29-802fff94199f'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:16:54.216841 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a3c34dba-16a9-4f2f-8769-e0bc52992474 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:16:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99b1e28b-7903-47cb-ac29-802fff94199f'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:16:54.218460 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:54.295109 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] DHCP port deletion for 9a6ee36e-4706-491e-8e3f-fdd038ffad04 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:16:54.308292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] Deleting port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:16:54.308662 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:54.417984 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:54.430974 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port ce5196a8-c926-41d2-a14f-c9607467b245 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:16:54.431584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:54.489379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-a3c34dba-16a9-4f2f-8769-e0bc52992474 None None] Set router 99b1e28b-7903-47cb-ac29-802fff94199f gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:16:54.614616 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port ce5196a8-c926-41d2-a14f-c9607467b245, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=ce5196a8-c926-41d2-a14f-c9607467b245,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:16:54.614893 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:54.665438 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:16:54.741971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for ce5196a8-c926-41d2-a14f-c9607467b245 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:16:54.888819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] For port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:16:54.889206 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:54.923279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:54.972031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=ce5196a8-c926-41d2-a14f-c9607467b245,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:55.064825 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:55.072211 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] Calling delete_port for 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:16:55.135677 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:55.223885 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:16:55.231416 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:55.250144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:55.252418 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:55.274130 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:16:55.274614 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:16:55.280456 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:55.281003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Fanout notify agent at l3_agent the message router_deleted on router 99b1e28b-7903-47cb-ac29-802fff94199f {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:16:55.300334 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:55.301439 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a283536b-b482-4fd8-b7dd-172394f592f3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/routers/99b1e28b-7903-47cb-ac29-802fff94199f HTTP/1.1" status: 204 len: 168 time: 1.4022388 May 12 16:16:55.305119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55904) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:55.317816 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-a3c34dba-16a9-4f2f-8769-e0bc52992474 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:16:52Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:16:55.319887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:55.324753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3c34dba-16a9-4f2f-8769-e0bc52992474 None None] The sync data for ids ['99b1e28b-7903-47cb-ac29-802fff94199f'] in n-d-841483-1 is: [{'id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2079152706', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84'}], 'enable_snat': True}, 'gw_port_id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:16:52Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': 'ce5196a8-c926-41d2-a14f-c9607467b245', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:22:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99b1e28b-7903-47cb-ac29-802fff94199f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4321, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:15:00Z', 'updated_at': '2022-05-12T16:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:16:55.419863 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:55.430203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:16:55.430535 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:55.758950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:16:55.759312 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:55.776367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] Deleting port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:16:55.777089 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:55.886814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:16:55.973312 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:55.992908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] For port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5,segment=NetworkSegment(ff6e1144-21dd-4621-9c9b-74d7120617b5),segment_id=ff6e1144-21dd-4621-9c9b-74d7120617b5)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:16:55.993299 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.025904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] No DVR routers for this DVR port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:16:56.054363 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:56.128674 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] Calling delete_port for 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:16:56.155321 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.180825 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9a6ee36e-4706-491e-8e3f-fdd038ffad04']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:16:56.192824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ff6e1144-21dd-4621-9c9b-74d7120617b5') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:16:56.193149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ff6e1144-21dd-4621-9c9b-74d7120617b5') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:16:56.199964 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:16:56.200308 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:16:56.204877 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.221012 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.227885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Releasing vlan 553 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:16:56.228343 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: timer() May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:16:56.243018 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:16:56.324862 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.343160 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.355094 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Network': ['ID=9a6ee36e-4706-491e-8e3f-fdd038ffad04,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:56.369203 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-93d713bf-e3d6-47ad-a987-79438a44f43a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/networks/9a6ee36e-4706-491e-8e3f-fdd038ffad04 HTTP/1.1" status: 204 len: 168 time: 1.0630453 May 12 16:16:56.371721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55908) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:56.443308 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fc25cc7f-e85e-4c35-94b3-d044e79987bb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.472908 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fc25cc7f-e85e-4c35-94b3-d044e79987bb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.542215 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fc25cc7f-e85e-4c35-94b3-d044e79987bb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.561137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc25cc7f-e85e-4c35-94b3-d044e79987bb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=97e00970-bf76-45d6-888c-86903d323271,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:56.574254 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fc25cc7f-e85e-4c35-94b3-d044e79987bb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.575626 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fc25cc7f-e85e-4c35-94b3-d044e79987bb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/security-groups/97e00970-bf76-45d6-888c-86903d323271 HTTP/1.1" status: 204 len: 168 time: 0.2029517 May 12 16:16:56.632868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:16:56.665817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:16:56.666163 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 6aa65dcc-66b2-43e1-8f65-79efeaa6d7e0 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:16:56.666573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ce5196a8-c926-41d2-a14f-c9607467b245 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:16:56.700649 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: ce5196a8-c926-41d2-a14f-c9607467b245 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:16:56.700990 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device ce5196a8-c926-41d2-a14f-c9607467b245 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:16:56.702592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55916) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:56.707690 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1236353560', 'description': 'tempest-secgroup-smoke-1236353560 description', 'project_id': 'f50049e6814046a9abf21905584f94e1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:16:56.715110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:16:56.719191 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:16:56.722038 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:16:56.727663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:16:56.737853 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.757685 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:16:56.761361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:16:56.764108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:16:56.769636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:16:56.838655 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.842257 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.886420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroup': ['ID=acff21d9-6710-4d66-af2f-144511787fbf,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:56.889163 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.890378 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-0a98b52f-1d91-4310-a0e0-b65e200bf8d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1867959 May 12 16:16:56.893119 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55920) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:56.898684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-e753e572-a3ae-4d49-9436-5546bc1073ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': 'acff21d9-6710-4d66-af2f-144511787fbf', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:16:56.905316 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e753e572-a3ae-4d49-9436-5546bc1073ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:16:56.909089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e753e572-a3ae-4d49-9436-5546bc1073ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:16:56.910030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] Deleting port 7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:16:56.910481 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.912669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-e753e572-a3ae-4d49-9436-5546bc1073ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:16:56.918564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-e753e572-a3ae-4d49-9436-5546bc1073ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:16:56.938450 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e753e572-a3ae-4d49-9436-5546bc1073ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:56.979468 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-22afdd12-3bc9-4f2e-85bf-bd96e46535dc None None] The port '7f3dcdc7-bfa5-4947-9ca1-15db40bf2ee5' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 16:16:57.003536 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e753e572-a3ae-4d49-9436-5546bc1073ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.007051 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e753e572-a3ae-4d49-9436-5546bc1073ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.030478 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e753e572-a3ae-4d49-9436-5546bc1073ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6ab1a1ff-dab3-4bdb-9009-33a0c6954658,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:57.040530 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e753e572-a3ae-4d49-9436-5546bc1073ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.041733 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e753e572-a3ae-4d49-9436-5546bc1073ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1476603 May 12 16:16:57.044432 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55924) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:57.049359 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-a4a37c1d-e632-4620-b941-23f7318b4d0b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': 'acff21d9-6710-4d66-af2f-144511787fbf', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:16:57.056837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a4a37c1d-e632-4620-b941-23f7318b4d0b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:16:57.060592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a4a37c1d-e632-4620-b941-23f7318b4d0b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:16:57.063417 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-a4a37c1d-e632-4620-b941-23f7318b4d0b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:16:57.069744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-a4a37c1d-e632-4620-b941-23f7318b4d0b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:16:57.085897 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a4a37c1d-e632-4620-b941-23f7318b4d0b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.146287 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a4a37c1d-e632-4620-b941-23f7318b4d0b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.150265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a4a37c1d-e632-4620-b941-23f7318b4d0b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.179032 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4a37c1d-e632-4620-b941-23f7318b4d0b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3700144d-6e21-4c3c-8ec8-9a2a25ee136c,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:57.188854 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-a4a37c1d-e632-4620-b941-23f7318b4d0b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.190074 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-a4a37c1d-e632-4620-b941-23f7318b4d0b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1447182 May 12 16:16:57.192746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55928) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:57.198687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-32c74cbe-77c6-4d55-99dd-c7679e89a969 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': 'acff21d9-6710-4d66-af2f-144511787fbf', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:16:57.205116 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-32c74cbe-77c6-4d55-99dd-c7679e89a969 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:16:57.209055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-32c74cbe-77c6-4d55-99dd-c7679e89a969 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:16:57.211956 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-32c74cbe-77c6-4d55-99dd-c7679e89a969 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:16:57.218169 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-32c74cbe-77c6-4d55-99dd-c7679e89a969 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:16:57.235977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32c74cbe-77c6-4d55-99dd-c7679e89a969 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.303781 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32c74cbe-77c6-4d55-99dd-c7679e89a969 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.307278 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32c74cbe-77c6-4d55-99dd-c7679e89a969 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.331244 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32c74cbe-77c6-4d55-99dd-c7679e89a969 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a9bdd8b1-b375-4888-abf7-a71ae64c8c7d,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:57.340211 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-32c74cbe-77c6-4d55-99dd-c7679e89a969 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.341369 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-32c74cbe-77c6-4d55-99dd-c7679e89a969 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1470525 May 12 16:16:57.344178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55932) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:57.349048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-c9f8a359-bc44-4fad-86de-4958fa5f676b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': 'acff21d9-6710-4d66-af2f-144511787fbf', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:16:57.356509 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c9f8a359-bc44-4fad-86de-4958fa5f676b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:16:57.360294 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c9f8a359-bc44-4fad-86de-4958fa5f676b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:16:57.363148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-c9f8a359-bc44-4fad-86de-4958fa5f676b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:16:57.369925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-c9f8a359-bc44-4fad-86de-4958fa5f676b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:16:57.386157 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9f8a359-bc44-4fad-86de-4958fa5f676b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.450859 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9f8a359-bc44-4fad-86de-4958fa5f676b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.454609 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9f8a359-bc44-4fad-86de-4958fa5f676b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.480070 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9f8a359-bc44-4fad-86de-4958fa5f676b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ddcba048-ad5c-46ba-a455-57fe8ed7a7af,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:57.489026 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c9f8a359-bc44-4fad-86de-4958fa5f676b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.490809 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c9f8a359-bc44-4fad-86de-4958fa5f676b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1450830 May 12 16:16:57.493532 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55936) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:57.498588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2bc5d25e-db6d-44fa-8dca-b62fd5986335 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': 'acff21d9-6710-4d66-af2f-144511787fbf', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:16:57.505358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2bc5d25e-db6d-44fa-8dca-b62fd5986335 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:16:57.510113 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2bc5d25e-db6d-44fa-8dca-b62fd5986335 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:16:57.512961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2bc5d25e-db6d-44fa-8dca-b62fd5986335 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:16:57.518618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2bc5d25e-db6d-44fa-8dca-b62fd5986335 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:16:57.529106 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-2bc5d25e-db6d-44fa-8dca-b62fd5986335 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Project f50049e6814046a9abf21905584f94e1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:16:57.535481 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2bc5d25e-db6d-44fa-8dca-b62fd5986335 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.601740 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2bc5d25e-db6d-44fa-8dca-b62fd5986335 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.605331 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2bc5d25e-db6d-44fa-8dca-b62fd5986335 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.632882 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bc5d25e-db6d-44fa-8dca-b62fd5986335 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2dff64d5-f58a-4eed-a347-76235bc5858b,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:57.641538 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2bc5d25e-db6d-44fa-8dca-b62fd5986335 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.642702 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2bc5d25e-db6d-44fa-8dca-b62fd5986335 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1483486 May 12 16:16:57.645335 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55940) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:57.651452 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-9c9e9875-6fb8-4bcd-ad22-72e3b988d9e9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': 'acff21d9-6710-4d66-af2f-144511787fbf', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:16:57.658148 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9c9e9875-6fb8-4bcd-ad22-72e3b988d9e9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:16:57.662675 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9c9e9875-6fb8-4bcd-ad22-72e3b988d9e9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:16:57.665558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9c9e9875-6fb8-4bcd-ad22-72e3b988d9e9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:16:57.671210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9c9e9875-6fb8-4bcd-ad22-72e3b988d9e9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:16:57.682045 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-9c9e9875-6fb8-4bcd-ad22-72e3b988d9e9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Project f50049e6814046a9abf21905584f94e1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:16:57.688478 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9c9e9875-6fb8-4bcd-ad22-72e3b988d9e9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.752247 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9c9e9875-6fb8-4bcd-ad22-72e3b988d9e9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.755593 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9c9e9875-6fb8-4bcd-ad22-72e3b988d9e9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.778529 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c9e9875-6fb8-4bcd-ad22-72e3b988d9e9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2680f618-c20a-4f62-846c-afcf940eaa50,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:57.787887 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9c9e9875-6fb8-4bcd-ad22-72e3b988d9e9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.789029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9c9e9875-6fb8-4bcd-ad22-72e3b988d9e9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1427722 May 12 16:16:57.791961 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 55944) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:57.797208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'network': {'name': 'tempest-network-smoke--1887789484', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'port_security_enabled': True}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:16:57.802872 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:16:57.806962 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:network and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:16:57.809785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:16:57.815358 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:16:57.825703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:16:57.828967 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.856373 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 568} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:16:57.865589 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.866022 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Added segment bc276dae-0957-4f73-a935-f2bd95979cc7 of type vlan for network 27c02bdd-0e84-45ab-a390-660b1b7986c8 May 12 16:16:57.892575 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.921158 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:57.926498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:16:57.927074 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:58.031285 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2381544 May 12 16:16:58.033915 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55948) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:16:58.039442 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'admin_state_up': True, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:16:58.041408 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce6e8c86-32f4-479c-a0a5-d1a267b53469 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Network': ['ID=27c02bdd-0e84-45ab-a390-660b1b7986c8,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:58.048271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:16:58.051535 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 27c02bdd-0e84-45ab-a390-660b1b7986c8 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:16:58.054122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:router and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:16:58.056956 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:16:58.063249 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:16:58.075529 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:58.076675 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:58.093514 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:58.376304 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:58.684017 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:58.716530 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:58.852834 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.25.8.63 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/82a93771-840a-4a68-9522-56e975637345) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:16:58.997156 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:59.028721 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:59.093196 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:16:59.095840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:16:59.098509 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:16:59.256916 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=82a93771-840a-4a68-9522-56e975637345,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:16:59.269621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:59.269959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:59.270283 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:59.270604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:59.270921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:59.271751 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:59.272065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:59.272376 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:59.272724 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:59.273044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:59.273351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:59.273693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:16:59.641148 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:16:59.980948 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:00.188472 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 16:17:00.371158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:17:00.380362 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Sync routers for ids ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:17:00.389830 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Routers {'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:17:00.390625 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:16:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:17:00.398200 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:00.399688 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-55d2a78c-045c-4d39-8fa0-2067dc33c8e1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 894 time: 2.3647900 May 12 16:17:00.402688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55952) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:17:00.492782 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d0a29f9b-caa5-4a1e-9e68-852c70121e3f tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=f50049e6814046a9abf21905584f94e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0889900 May 12 16:17:00.495345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55958) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:17:00.570641 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Set router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:17:00.757231 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6add92ec-60bb-4d30-bc1f-a9925e1623c8 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:00.758690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6add92ec-60bb-4d30-bc1f-a9925e1623c8 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2624240 May 12 16:17:00.761529 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55962) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:17:00.801347 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-77760322-4916-4717-9b64-71e7e1d2c0c8 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0385871 May 12 16:17:00.803649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55966) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:17:00.810008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-942645395', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:17:00.863780 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:16:59Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:16:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:17:00.868148 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Checking router: c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:17:00.868479 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Updating router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 port 82a93771-840a-4a68-9522-56e975637345 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:17:00.919254 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:17:00.922391 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:00.923011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:subnet and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:17:00.925779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:17:00.931981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:17:00.942545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:17:00.946886 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:01.172707 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:01.261135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Subnet': ['ID=b6cde1a1-1d06-4503-9a98-2ea767e33e4c,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:01.273535 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Checking segment: {'id': 'bc276dae-0957-4f73-a935-f2bd95979cc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:17:01.273893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network hostable DHCP agents. Network: 27c02bdd-0e84-45ab-a390-660b1b7986c8, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:17:01.285441 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:01.294634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 27c02bdd-0e84-45ab-a390-660b1b7986c8 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:17:01.299281 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Transition to ACTIVE for port object 82a93771-840a-4a68-9522-56e975637345 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:17:01.304867 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 27c02bdd-0e84-45ab-a390-660b1b7986c8) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:17:01.306877 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:01.308966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:01.309594 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:01.318170 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79104e13-e652-4681-a150-9f7037a36822 None None] Network 27c02bdd-0e84-45ab-a390-660b1b7986c8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:17:01.336073 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-48271619-8841-4b77-9257-3725f6196307 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.5288603 May 12 16:17:01.336276 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 55970) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:17:01.386361 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Attempting to bind port 82a93771-840a-4a68-9522-56e975637345 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:17:01.386974 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Attempting to bind port 82a93771-840a-4a68-9522-56e975637345 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:17:01.387106 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Attempting to bind port 82a93771-840a-4a68-9522-56e975637345 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:17:01.392691 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ee68243-7941-4ff6-b6b9-158c9786f670 None None] Pushing event updated for resources: {'Port': ['ID=82a93771-840a-4a68-9522-56e975637345,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:01.398368 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 16, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:17:01.398577 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:17:01.398884 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:01.399239 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:17:01.399693 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Bound port: 82a93771-840a-4a68-9522-56e975637345, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:17:01.400056 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:01.433699 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee68243-7941-4ff6-b6b9-158c9786f670 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:17:01.433929 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee68243-7941-4ff6-b6b9-158c9786f670 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:17:01.434262 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee68243-7941-4ff6-b6b9-158c9786f670 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:17:01.434967 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee68243-7941-4ff6-b6b9-158c9786f670 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:17:01.434967 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee68243-7941-4ff6-b6b9-158c9786f670 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:17:01.435209 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee68243-7941-4ff6-b6b9-158c9786f670 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:17:01.435523 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee68243-7941-4ff6-b6b9-158c9786f670 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:17:01.435837 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee68243-7941-4ff6-b6b9-158c9786f670 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:17:01.436157 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee68243-7941-4ff6-b6b9-158c9786f670 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:17:01.436466 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee68243-7941-4ff6-b6b9-158c9786f670 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:17:01.437169 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee68243-7941-4ff6-b6b9-158c9786f670 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:17:01.437169 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee68243-7941-4ff6-b6b9-158c9786f670 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:17:01.484712 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] For port 82a93771-840a-4a68-9522-56e975637345, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:17:01.487836 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] For port 82a93771-840a-4a68-9522-56e975637345, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=82a93771-840a-4a68-9522-56e975637345,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:17:01.493176 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:01.550375 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-27c02bdd-0e84-45ab-a390-660b1b7986c8', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ips': [{'subnet_id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:17:01.551311 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:01.563722 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ee68243-7941-4ff6-b6b9-158c9786f670 None None] Pushing event updated for resources: {'Port': ['ID=82a93771-840a-4a68-9522-56e975637345,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:01.581124 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Routers {'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:17:01.581767 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:16:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:17:01.721204 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Allocated IP 172.20.0.2 (27c02bdd-0e84-45ab-a390-660b1b7986c8/b6cde1a1-1d06-4503-9a98-2ea767e33e4c/3a8c9835-7192-4682-9c0c-75e7781d125d) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:17:01.765115 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] Set router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:17:01.928230 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:01.938638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Transition to ACTIVE for port object 3a8c9835-7192-4682-9c0c-75e7781d125d will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:17:01.959979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Transition to ACTIVE for port object 3a8c9835-7192-4682-9c0c-75e7781d125d will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:17:01.968083 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:02.044602 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Network 27c02bdd-0e84-45ab-a390-660b1b7986c8 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:17:02.045691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:17:02.050947 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:17:02.070015 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:16:59Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:17:02.074728 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4b7e3e2-fd9e-48a7-a0d6-d5ff8e65617a None None] The sync data for ids ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'] in n-d-841483-1 is: [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:16:59Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:17:02.105181 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:02.131727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Pushing event updated for resources: {'Port': ['ID=3a8c9835-7192-4682-9c0c-75e7781d125d,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:02.154348 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Attempting to bind port 3a8c9835-7192-4682-9c0c-75e7781d125d on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:17:02.154711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Attempting to bind port 3a8c9835-7192-4682-9c0c-75e7781d125d by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'bc276dae-0957-4f73-a935-f2bd95979cc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:17:02.155070 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Attempting to bind port 3a8c9835-7192-4682-9c0c-75e7781d125d on network 27c02bdd-0e84-45ab-a390-660b1b7986c8 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:17:02.160590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 16, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:17:02.160963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Checking segment: {'id': 'bc276dae-0957-4f73-a935-f2bd95979cc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:17:02.161359 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:02.161849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Bound using segment: {'id': 'bc276dae-0957-4f73-a935-f2bd95979cc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:17:02.162839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Bound port: 3a8c9835-7192-4682-9c0c-75e7781d125d, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc276dae-0957-4f73-a935-f2bd95979cc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:17:02.163304 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:02.256678 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] For port 3a8c9835-7192-4682-9c0c-75e7781d125d, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:17:02.259915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] For port 3a8c9835-7192-4682-9c0c-75e7781d125d, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3a8c9835-7192-4682-9c0c-75e7781d125d,segment=NetworkSegment(bc276dae-0957-4f73-a935-f2bd95979cc7),segment_id=bc276dae-0957-4f73-a935-f2bd95979cc7)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:17:02.266870 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:02.364176 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c2a3dbf-d3ae-4a4a-a706-8b2a5e1cbd45 None None] Pushing event updated for resources: {'Port': ['ID=3a8c9835-7192-4682-9c0c-75e7781d125d,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:02.723731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.20.0.1 (27c02bdd-0e84-45ab-a390-660b1b7986c8/b6cde1a1-1d06-4503-9a98-2ea767e33e4c/25111495-0b1b-452c-9fdd-ac2c24035268) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:17:02.737941 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 82a93771-840a-4a68-9522-56e975637345 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:17:02.826253 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 82a93771-840a-4a68-9522-56e975637345 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:17:02.832230 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 82a93771-840a-4a68-9522-56e975637345 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:17:02.832596 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:02.911540 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:02.938277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Transition to ACTIVE for port object 25111495-0b1b-452c-9fdd-ac2c24035268 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:17:02.977464 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:02.981149 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:02.982068 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:03.000334 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 82a93771-840a-4a68-9522-56e975637345, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=82a93771-840a-4a68-9522-56e975637345,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:17:03.004385 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:03.005557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3a8c9835-7192-4682-9c0c-75e7781d125d up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:17:03.046431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 27c02bdd-0e84-45ab-a390-660b1b7986c8 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:17:03.049693 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:17:03.054514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:17:03.106471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=25111495-0b1b-452c-9fdd-ac2c24035268,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:03.124901 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:03.131402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=82a93771-840a-4a68-9522-56e975637345,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:03.145235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 3a8c9835-7192-4682-9c0c-75e7781d125d completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:17:03.400745 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:03.463096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a81bcf02-5719-45a7-9fc4-55ad4d6b128b None None] Network 27c02bdd-0e84-45ab-a390-660b1b7986c8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:17:03.556152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bfac4c4e-6abd-480b-95cb-d7620f3bfdf1 None None] Provisioning for port 3a8c9835-7192-4682-9c0c-75e7781d125d completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:17:03.573989 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bfac4c4e-6abd-480b-95cb-d7620f3bfdf1 None None] Provisioning complete for port 3a8c9835-7192-4682-9c0c-75e7781d125d triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:17:03.574279 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bfac4c4e-6abd-480b-95cb-d7620f3bfdf1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:03.830627 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bfac4c4e-6abd-480b-95cb-d7620f3bfdf1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:03.834498 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:03.840288 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:03.872221 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bfac4c4e-6abd-480b-95cb-d7620f3bfdf1 None None] For port 3a8c9835-7192-4682-9c0c-75e7781d125d, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3a8c9835-7192-4682-9c0c-75e7781d125d,segment=NetworkSegment(bc276dae-0957-4f73-a935-f2bd95979cc7),segment_id=bc276dae-0957-4f73-a935-f2bd95979cc7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:17:03.878034 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bfac4c4e-6abd-480b-95cb-d7620f3bfdf1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:03.953994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfac4c4e-6abd-480b-95cb-d7620f3bfdf1 None None] Pushing event updated for resources: {'Port': ['ID=3a8c9835-7192-4682-9c0c-75e7781d125d,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:03.954283 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:03.967483 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=25111495-0b1b-452c-9fdd-ac2c24035268,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:04.105043 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 27c02bdd-0e84-45ab-a390-660b1b7986c8 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:17:04.106163 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:17:04.200812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-892e5039-3603-4d6e-9d21-7c09c56a1a26 None None] Provisioning complete for port 3a8c9835-7192-4682-9c0c-75e7781d125d triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:17:04.201158 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-892e5039-3603-4d6e-9d21-7c09c56a1a26 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:04.354916 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-892e5039-3603-4d6e-9d21-7c09c56a1a26 None None] Provisioning for port 25111495-0b1b-452c-9fdd-ac2c24035268 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:17:04.360621 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-892e5039-3603-4d6e-9d21-7c09c56a1a26 None None] Provisioning complete for port 25111495-0b1b-452c-9fdd-ac2c24035268 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:17:04.361448 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-892e5039-3603-4d6e-9d21-7c09c56a1a26 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:04.420699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-892e5039-3603-4d6e-9d21-7c09c56a1a26 None None] Port 25111495-0b1b-452c-9fdd-ac2c24035268 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:17:04.449208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:17:04.540277 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-4bd540b2-4f97-423e-93eb-4224bb1caa57 None None] Provisioning complete for port 25111495-0b1b-452c-9fdd-ac2c24035268 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:17:04.540846 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4bd540b2-4f97-423e-93eb-4224bb1caa57 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:04.598264 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4bd540b2-4f97-423e-93eb-4224bb1caa57 None None] Port 25111495-0b1b-452c-9fdd-ac2c24035268 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:17:04.624340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 82a93771-840a-4a68-9522-56e975637345 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:17:04.631520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:17:04.643724 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ad4b3b0b-9209-4f8e-9a64-1fe1d1792d8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "PUT /v2.0/routers/c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3063781 May 12 16:17:04.655030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Sync routers for ids ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:17:04.682327 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Routers {'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:17:04.682933 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:16:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:17:04.814827 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-e5165a26-d778-4eae-b65b-27799512f170 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1236353560&fields=id&tenant_id=f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 267 time: 0.0397143 May 12 16:17:04.851836 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 82a93771-840a-4a68-9522-56e975637345 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:17:04.852112 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:04.921953 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Set router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:17:04.970508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-644624b5-d031-4a76-9a51-d654d6db46b1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:04.971966 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-644624b5-d031-4a76-9a51-d654d6db46b1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/networks?id=27c02bdd-0e84-45ab-a390-660b1b7986c8 HTTP/1.1" status: 200 len: 797 time: 0.1495695 May 12 16:17:04.987482 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-bbd2f59a-7c94-476d-a2e3-499e28813567 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/quotas/f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 375 time: 0.0099895 May 12 16:17:05.071400 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-1cc83ae3-27c7-4b8b-98cb-01a58c5486dc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:17:05.087105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-1cc83ae3-27c7-4b8b-98cb-01a58c5486dc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:17:05.088562 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-1cc83ae3-27c7-4b8b-98cb-01a58c5486dc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0952122 May 12 16:17:05.165632 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-4d2bd4aa-b231-4798-b373-f75090ed559f service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 16:17:05.166729 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-4d2bd4aa-b231-4798-b373-f75090ed559f service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0659139 May 12 16:17:05.189635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3a8c9835-7192-4682-9c0c-75e7781d125d up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:17:05.307422 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-e3a1c2fa-399e-4b12-9f31-31befbb4c5e5 service neutron] 10.222.0.82 "GET /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1345246 May 12 16:17:05.330015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 3a8c9835-7192-4682-9c0c-75e7781d125d triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:17:05.330374 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:05.405037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:03Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '25111495-0b1b-452c-9fdd-ac2c24035268', 'name': '', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:99:c2:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 4343, 'fixed_ips': [{'subnet_id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:17:02Z', 'updated_at': '2022-05-12T16:17:03Z', 'revision_number': 2, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:17:05.436145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Checking router: c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:17:05.436485 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Updating router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 port 25111495-0b1b-452c-9fdd-ac2c24035268 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:17:05.445752 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-5a14c65f-6016-4aaf-bd1f-f87f3a992959 service neutron] 10.222.0.82 "GET /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1325364 May 12 16:17:05.515252 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:05.662327 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0a907690-7fa5-47ab-9399-df23ea7836a8 req-602e7e3d-d3b2-401c-98fc-57dbd20a19aa tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 210 time: 0.0600049 May 12 16:17:05.906841 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:05.919669 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Transition to ACTIVE for port object 25111495-0b1b-452c-9fdd-ac2c24035268 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:17:05.926582 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:06.058107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-626b374c-fb1e-4738-a530-470c8ca972fe None None] Pushing event updated for resources: {'Port': ['ID=25111495-0b1b-452c-9fdd-ac2c24035268,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:06.147852 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Attempting to bind port 25111495-0b1b-452c-9fdd-ac2c24035268 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:17:06.148216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Attempting to bind port 25111495-0b1b-452c-9fdd-ac2c24035268 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'bc276dae-0957-4f73-a935-f2bd95979cc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:17:06.148634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Attempting to bind port 25111495-0b1b-452c-9fdd-ac2c24035268 on network 27c02bdd-0e84-45ab-a390-660b1b7986c8 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:17:06.154271 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 16, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:17:06.154637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Checking segment: {'id': 'bc276dae-0957-4f73-a935-f2bd95979cc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:17:06.155029 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:06.155411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Bound using segment: {'id': 'bc276dae-0957-4f73-a935-f2bd95979cc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:17:06.155864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Bound port: 25111495-0b1b-452c-9fdd-ac2c24035268, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc276dae-0957-4f73-a935-f2bd95979cc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:17:06.156228 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:06.254789 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] For port 25111495-0b1b-452c-9fdd-ac2c24035268, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:17:06.259467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] For port 25111495-0b1b-452c-9fdd-ac2c24035268, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=25111495-0b1b-452c-9fdd-ac2c24035268,segment=NetworkSegment(bc276dae-0957-4f73-a935-f2bd95979cc7),segment_id=bc276dae-0957-4f73-a935-f2bd95979cc7)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:17:06.264282 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:06.345567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Routers {'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:17:06.346185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:16:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:17:06.401850 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-626b374c-fb1e-4738-a530-470c8ca972fe None None] Pushing event updated for resources: {'Port': ['ID=25111495-0b1b-452c-9fdd-ac2c24035268,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:06.527325 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] Set router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:17:06.823480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a73c638f-1a1d-4c06-b09f-7b2841a0f643 req-0cb66abc-60ec-47fd-8361-226e72a64aa0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 210 time: 0.0518677 May 12 16:17:06.888815 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:03Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '25111495-0b1b-452c-9fdd-ac2c24035268', 'name': '', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:99:c2:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 4343, 'fixed_ips': [{'subnet_id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:17:02Z', 'updated_at': '2022-05-12T16:17:06Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:17:06.892918 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-246aeeb3-ca44-4c62-82c9-261f45b6a29b None None] The sync data for ids ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'] in n-d-841483-1 is: [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:03Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '25111495-0b1b-452c-9fdd-ac2c24035268', 'name': '', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:99:c2:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 4343, 'fixed_ips': [{'subnet_id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:17:02Z', 'updated_at': '2022-05-12T16:17:06Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:17:06.923934 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-283921ab-58b4-464c-afda-123b6d58a61b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:06.924528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-283921ab-58b4-464c-afda-123b6d58a61b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:17:06.951615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-283921ab-58b4-464c-afda-123b6d58a61b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:17:06.953253 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-283921ab-58b4-464c-afda-123b6d58a61b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/networks?id=27c02bdd-0e84-45ab-a390-660b1b7986c8 HTTP/1.1" status: 200 len: 797 time: 0.1964691 May 12 16:17:07.018259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-2f009d67-b729-4e9a-99b4-7c744ba773bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:17:07.037831 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-2f009d67-b729-4e9a-99b4-7c744ba773bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:17:07.039033 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-2f009d67-b729-4e9a-99b4-7c744ba773bc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 380 time: 0.0683289 May 12 16:17:07.072892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'port': {'device_id': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'admin_state_up': True, 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'security_groups': ['acff21d9-6710-4d66-af2f-144511787fbf']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:17:07.222765 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:17:07.233298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:17:07.243705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:17:07.248063 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:07.421218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.20.0.6 (27c02bdd-0e84-45ab-a390-660b1b7986c8/b6cde1a1-1d06-4503-9a98-2ea767e33e4c/f886d202-5aaa-4fec-94a4-aa4fadced1f9) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:17:07.631112 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:07.648582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Transition to ACTIVE for port object f886d202-5aaa-4fec-94a4-aa4fadced1f9 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:17:07.673670 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:07.752860 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 27c02bdd-0e84-45ab-a390-660b1b7986c8 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:17:07.756712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:17:07.760792 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:17:07.793023 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=f886d202-5aaa-4fec-94a4-aa4fadced1f9,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:07.835590 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:07.836240 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:07.872786 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-83c47f92-23dd-4077-8716-ccf54240815f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8043041 May 12 16:17:07.890090 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-5934fc0f-e8ef-4578-ab2a-825ce137607d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 16:17:07.891412 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-5934fc0f-e8ef-4578-ab2a-825ce137607d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0063562 May 12 16:17:07.905160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Request body: {'port': {'device_id': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:17:08.032077 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71533e32-b84f-40ac-92cc-acc79688f65d req-a02a29c9-ac7b-4fd4-8ae9-61727a7ec885 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:08.033559 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71533e32-b84f-40ac-92cc-acc79688f65d req-a02a29c9-ac7b-4fd4-8ae9-61727a7ec885 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 931 time: 0.0892329 May 12 16:17:08.088243 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71533e32-b84f-40ac-92cc-acc79688f65d req-358070c3-0940-4f75-a533-700e3169bc95 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479057 May 12 16:17:08.095470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-481b3265-8901-4704-a525-aef76d78acda None None] Provisioning for port f886d202-5aaa-4fec-94a4-aa4fadced1f9 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:17:08.101972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-481b3265-8901-4704-a525-aef76d78acda None None] Provisioning complete for port f886d202-5aaa-4fec-94a4-aa4fadced1f9 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:17:08.102345 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-481b3265-8901-4704-a525-aef76d78acda None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:08.135737 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:08.166889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-481b3265-8901-4704-a525-aef76d78acda None None] Port f886d202-5aaa-4fec-94a4-aa4fadced1f9 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:17:08.480301 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f886d202-5aaa-4fec-94a4-aa4fadced1f9 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:17:08.487496 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:08.501945 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Transition to ACTIVE for port object f886d202-5aaa-4fec-94a4-aa4fadced1f9 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:17:08.506418 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:08.663263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 25111495-0b1b-452c-9fdd-ac2c24035268 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:17:08.664187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Pushing event updated for resources: {'Port': ['ID=f886d202-5aaa-4fec-94a4-aa4fadced1f9,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:08.742122 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 25111495-0b1b-452c-9fdd-ac2c24035268 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:17:08.747164 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 25111495-0b1b-452c-9fdd-ac2c24035268 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:17:08.747528 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:08.749759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Attempting to bind port f886d202-5aaa-4fec-94a4-aa4fadced1f9 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:17:08.750172 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Attempting to bind port f886d202-5aaa-4fec-94a4-aa4fadced1f9 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'bc276dae-0957-4f73-a935-f2bd95979cc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:17:08.750579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Attempting to bind port f886d202-5aaa-4fec-94a4-aa4fadced1f9 on network 27c02bdd-0e84-45ab-a390-660b1b7986c8 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:17:08.755486 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Port f886d202-5aaa-4fec-94a4-aa4fadced1f9 on network 27c02bdd-0e84-45ab-a390-660b1b7986c8 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:17:08.756240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Attempting to bind port f886d202-5aaa-4fec-94a4-aa4fadced1f9 on network 27c02bdd-0e84-45ab-a390-660b1b7986c8 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:17:08.761546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 16, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:17:08.761909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Checking segment: {'id': 'bc276dae-0957-4f73-a935-f2bd95979cc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:17:08.762274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Bound using segment: {'id': 'bc276dae-0957-4f73-a935-f2bd95979cc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:17:08.762705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Bound port: f886d202-5aaa-4fec-94a4-aa4fadced1f9, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bc276dae-0957-4f73-a935-f2bd95979cc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 568, 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:17:08.763052 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:08.861896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] For port f886d202-5aaa-4fec-94a4-aa4fadced1f9, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:17:08.864619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] For port f886d202-5aaa-4fec-94a4-aa4fadced1f9, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f886d202-5aaa-4fec-94a4-aa4fadced1f9,segment=NetworkSegment(bc276dae-0957-4f73-a935-f2bd95979cc7),segment_id=bc276dae-0957-4f73-a935-f2bd95979cc7)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:17:08.870244 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:08.871487 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:08.920110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 25111495-0b1b-452c-9fdd-ac2c24035268, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=25111495-0b1b-452c-9fdd-ac2c24035268,segment=NetworkSegment(bc276dae-0957-4f73-a935-f2bd95979cc7),segment_id=bc276dae-0957-4f73-a935-f2bd95979cc7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:17:08.925317 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:08.933302 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:08.933843 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:08.935399 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] 10.222.0.84 "PUT /v2.0/ports/f886d202-5aaa-4fec-94a4-aa4fadced1f9 HTTP/1.1" status: 200 len: 1091 time: 1.0346305 May 12 16:17:08.935835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'tag': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:17:08.986390 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99927eca-a406-4ed5-ba1d-6a9bfa76248a service neutron] Pushing event updated for resources: {'Port': ['ID=f886d202-5aaa-4fec-94a4-aa4fadced1f9,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:09.006919 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9257043e-3f65-431c-b71a-08168754279b'] response: {'name': 'network-changed', 'server_uuid': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'tag': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9', 'status': 'completed', 'code': 200} May 12 16:17:09.042638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=25111495-0b1b-452c-9fdd-ac2c24035268,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:09.126238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-cbcce56b-09ed-4d5a-9f8d-cb15e8472042 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:09.127753 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-cbcce56b-09ed-4d5a-9f8d-cb15e8472042 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 1094 time: 0.0946565 May 12 16:17:09.215763 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-637a0c29-625d-4a95-9dd6-57d56467e56e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f886d202-5aaa-4fec-94a4-aa4fadced1f9 HTTP/1.1" status: 200 len: 217 time: 0.0682206 May 12 16:17:09.298186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-a8f4c06a-96d4-442f-b81c-1c8964908568 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:09.299628 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-a8f4c06a-96d4-442f-b81c-1c8964908568 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b6cde1a1-1d06-4503-9a98-2ea767e33e4c HTTP/1.1" status: 200 len: 834 time: 0.0755961 May 12 16:17:09.321492 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1946e66c-f82b-4448-b5a3-e0364618f196 req-3b21898a-cdd4-49bb-a2e4-299854844d1a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:09.322977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1946e66c-f82b-4448-b5a3-e0364618f196 req-3b21898a-cdd4-49bb-a2e4-299854844d1a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 943 time: 0.1074524 May 12 16:17:09.381012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1946e66c-f82b-4448-b5a3-e0364618f196 req-067f2448-06f6-4c2f-8fa5-dfeac14c9ef4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517499 May 12 16:17:09.394188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-08f2f5dd-e894-4f2a-9c79-721fc53494c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:09.395841 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-08f2f5dd-e894-4f2a-9c79-721fc53494c5 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=27c02bdd-0e84-45ab-a390-660b1b7986c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0870869 May 12 16:17:09.539316 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-a801da2d-bf02-4d59-a6fc-bc57140f5a24 service neutron] 10.222.0.84 "GET /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1329765 May 12 16:17:09.679091 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-afcc7ac4-43ad-4b72-a7ff-879cba797020 req-ae0a3caf-1a74-4fef-a1aa-2af080265c6b service neutron] 10.222.0.84 "GET /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1310544 May 12 16:17:09.873414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dee5992-6b55-42cb-8717-0692aa8283f0 req-4526dceb-9879-4f10-8df2-634ff5718a70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:09.874883 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0dee5992-6b55-42cb-8717-0692aa8283f0 req-4526dceb-9879-4f10-8df2-634ff5718a70 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 1094 time: 0.0829988 May 12 16:17:10.117361 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dee5992-6b55-42cb-8717-0692aa8283f0 req-1443707e-98b1-4ee7-8b86-55c497633306 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:10.118923 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0dee5992-6b55-42cb-8717-0692aa8283f0 req-1443707e-98b1-4ee7-8b86-55c497633306 service neutron] 10.222.0.84 "GET /v2.0/networks?id=27c02bdd-0e84-45ab-a390-660b1b7986c8 HTTP/1.1" status: 200 len: 898 time: 0.2376058 May 12 16:17:10.188812 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0dee5992-6b55-42cb-8717-0692aa8283f0 req-47fe1e01-5cb8-478a-bbda-94def83eacb9 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f886d202-5aaa-4fec-94a4-aa4fadced1f9 HTTP/1.1" status: 200 len: 217 time: 0.0629914 May 12 16:17:10.251177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dee5992-6b55-42cb-8717-0692aa8283f0 req-8ff09ea7-63bb-43ba-8668-04e99c2e8ed7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:10.252610 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0dee5992-6b55-42cb-8717-0692aa8283f0 req-8ff09ea7-63bb-43ba-8668-04e99c2e8ed7 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b6cde1a1-1d06-4503-9a98-2ea767e33e4c HTTP/1.1" status: 200 len: 834 time: 0.0579846 May 12 16:17:10.328431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dee5992-6b55-42cb-8717-0692aa8283f0 req-8003a70b-30c7-43ee-bc79-52a2296cebd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:10.329911 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0dee5992-6b55-42cb-8717-0692aa8283f0 req-8003a70b-30c7-43ee-bc79-52a2296cebd4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=27c02bdd-0e84-45ab-a390-660b1b7986c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0694594 May 12 16:17:10.467923 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0dee5992-6b55-42cb-8717-0692aa8283f0 req-8bf6b406-b93d-4596-b984-48c63a6cc1ff service neutron] 10.222.0.84 "GET /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1309805 May 12 16:17:10.577591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be485baf-2cc4-4bc1-8c47-fadfa0859527 req-3ad0f6be-8da6-4386-ae61-b4a92bc37808 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:10.579167 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be485baf-2cc4-4bc1-8c47-fadfa0859527 req-3ad0f6be-8da6-4386-ae61-b4a92bc37808 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 943 time: 0.0844414 May 12 16:17:10.623357 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 25111495-0b1b-452c-9fdd-ac2c24035268 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:17:10.628065 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0dee5992-6b55-42cb-8717-0692aa8283f0 req-6f6e2e52-3c9c-493a-88a0-0cad39cc4d17 service neutron] 10.222.0.84 "GET /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1492460 May 12 16:17:10.629490 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-be485baf-2cc4-4bc1-8c47-fadfa0859527 req-72ed03ca-dfbe-4ca6-abc1-d3048ab35ae3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415411 May 12 16:17:10.689314 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 25111495-0b1b-452c-9fdd-ac2c24035268 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:17:10.689617 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:11.812869 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f754a30-1e7d-40a3-9254-e71a66d69adc req-73719cf8-fe8b-4374-a733-3873cd60c2f8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:11.814313 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f754a30-1e7d-40a3-9254-e71a66d69adc req-73719cf8-fe8b-4374-a733-3873cd60c2f8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 943 time: 0.0820808 May 12 16:17:11.858517 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1f754a30-1e7d-40a3-9254-e71a66d69adc req-a6db12e1-2ddb-4c81-be5f-9e72454dcdfe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374300 May 12 16:17:12.052820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f886d202-5aaa-4fec-94a4-aa4fadced1f9 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:17:12.189256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port f886d202-5aaa-4fec-94a4-aa4fadced1f9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f886d202-5aaa-4fec-94a4-aa4fadced1f9,segment=NetworkSegment(bc276dae-0957-4f73-a935-f2bd95979cc7),segment_id=bc276dae-0957-4f73-a935-f2bd95979cc7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:17:12.203407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'port_id': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9', 'mac_address': 'fa:16:3e:17:a1:42', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 568, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:17:12.269962 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:12.288635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f886d202-5aaa-4fec-94a4-aa4fadced1f9 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:17:12.304732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port f886d202-5aaa-4fec-94a4-aa4fadced1f9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f886d202-5aaa-4fec-94a4-aa4fadced1f9,segment=NetworkSegment(bc276dae-0957-4f73-a935-f2bd95979cc7),segment_id=bc276dae-0957-4f73-a935-f2bd95979cc7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:17:12.309943 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:12.377243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=f886d202-5aaa-4fec-94a4-aa4fadced1f9,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:12.733925 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f886d202-5aaa-4fec-94a4-aa4fadced1f9'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:17:12.901829 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fde50bfc-9a75-4b50-a8fe-84222b47191e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:13.051177 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7541637-3a22-4902-b103-c768fadcb3d5 req-2e2ae398-a31a-4bd8-9883-82c6fd594763 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:13.052623 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7541637-3a22-4902-b103-c768fadcb3d5 req-2e2ae398-a31a-4bd8-9883-82c6fd594763 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 944 time: 0.0841370 May 12 16:17:13.096691 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a7541637-3a22-4902-b103-c768fadcb3d5 req-6f8fe530-e890-4f11-be0e-bd485fe76835 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383618 May 12 16:17:13.789193 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:14.068428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f886d202-5aaa-4fec-94a4-aa4fadced1f9 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:17:14.139740 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port f886d202-5aaa-4fec-94a4-aa4fadced1f9 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:17:14.144650 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port f886d202-5aaa-4fec-94a4-aa4fadced1f9 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:17:14.145018 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:14.264759 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:14.290959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1cb0157-d6de-4f44-bd92-caca2cd91310 req-28f2d780-5f28-45dd-ac2d-62de8743c073 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:14.292939 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a1cb0157-d6de-4f44-bd92-caca2cd91310 req-28f2d780-5f28-45dd-ac2d-62de8743c073 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 944 time: 0.0858929 May 12 16:17:14.293079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:17:14.303628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port f886d202-5aaa-4fec-94a4-aa4fadced1f9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f886d202-5aaa-4fec-94a4-aa4fadced1f9,segment=NetworkSegment(bc276dae-0957-4f73-a935-f2bd95979cc7),segment_id=bc276dae-0957-4f73-a935-f2bd95979cc7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:17:14.307990 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:14.344767 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a1cb0157-d6de-4f44-bd92-caca2cd91310 req-fba8c9e1-6659-4f39-8240-268065325eb2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451415 May 12 16:17:14.345022 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-78d3c2a8-75c5-452a-bd67-a2efaa7d3dc2'] response: {'server_uuid': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9', 'code': 200} May 12 16:17:14.377213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=f886d202-5aaa-4fec-94a4-aa4fadced1f9,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:14.500996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-833269ed-ac69-4020-bc38-1e8b55195066 req-a12b2aec-60d1-46ec-a79d-26489c0bbfb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:14.502487 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-833269ed-ac69-4020-bc38-1e8b55195066 req-a12b2aec-60d1-46ec-a79d-26489c0bbfb1 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 1096 time: 0.0740802 May 12 16:17:14.545834 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-833269ed-ac69-4020-bc38-1e8b55195066 req-821d3248-b843-41ab-8bba-e1554786725c service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0335338 May 12 16:17:15.410514 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0c76a8b2-f81f-47dc-9ac1-45da972e4cc8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:15.528641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba637e65-72bc-4cf4-b759-6531ba3a431b req-869f2e52-ca7b-4975-a3b9-cdbe9e11df6a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:15.530089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba637e65-72bc-4cf4-b759-6531ba3a431b req-869f2e52-ca7b-4975-a3b9-cdbe9e11df6a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0804648 May 12 16:17:15.576483 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ba637e65-72bc-4cf4-b759-6531ba3a431b req-fd500df1-820b-4c9c-8ef8-fb0d8b01992e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406396 May 12 16:17:16.151157 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:16.426773 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:16.764787 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3f5bd16-5fd3-44ec-b492-24aecfbaa6a6 req-fa42a2c9-b39d-4cfa-9690-a4b122d3807e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:16.766252 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3f5bd16-5fd3-44ec-b492-24aecfbaa6a6 req-fa42a2c9-b39d-4cfa-9690-a4b122d3807e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0827446 May 12 16:17:16.811234 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c3f5bd16-5fd3-44ec-b492-24aecfbaa6a6 req-8283cade-1688-49fd-b330-2291f9798962 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384097 May 12 16:17:16.993688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6889702d-c60d-468f-8810-900ff3f59a5a req-7c095a7d-aba0-4995-87a9-cb3a21dd236e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:16.995105 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6889702d-c60d-468f-8810-900ff3f59a5a req-7c095a7d-aba0-4995-87a9-cb3a21dd236e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0794823 May 12 16:17:17.039792 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6889702d-c60d-468f-8810-900ff3f59a5a req-db0fdc0f-a8e0-4a5c-aeab-8031543e000b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390673 May 12 16:17:17.062277 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56022) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:17:17.244788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27915a58-bb56-469f-b0fa-52476a4cceac tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:17.246541 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-27915a58-bb56-469f-b0fa-52476a4cceac tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 1091 time: 0.1833146 May 12 16:17:17.249327 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56026) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:17:17.254175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address': '172.20.0.6'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:17:17.261262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:17:17.265037 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:floatingip and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:17:17.267991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:17:17.274309 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:17:17.284554 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:17.423993 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:17.556126 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.25.8.185 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/1fc6625f-2d5a-4617-8124-85d4c57eb25f) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:17:17.706377 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:17.735225 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:17.799775 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:17:17.802626 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:17:17.804961 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:17:17.847538 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=1fc6625f-2d5a-4617-8124-85d4c57eb25f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:17.897991 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:18.233902 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:18.310061 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:18.513242 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:18.517717 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:18.627989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=1fc6625f-2d5a-4617-8124-85d4c57eb25f,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:17:18.637913 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:18.812458 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Floating IP e729fb29-f38a-4230-a650-dc274e14d1dd associated. External IP: 172.25.8.185, port: f886d202-5aaa-4fec-94a4-aa4fadced1f9. May 12 16:17:19.268256 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:17:19.448314 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:17:19.458155 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d05ca409-a43d-430e-9c18-64eb10da1e36 None None] Sync routers for ids ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:17:19.468767 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d05ca409-a43d-430e-9c18-64eb10da1e36 None None] Routers {'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:17:19.469363 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d05ca409-a43d-430e-9c18-64eb10da1e36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:17:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:17:19.472322 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:19.528574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-7a7b08c9-c0c6-4c4e-9980-dee1404941f4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2780311 May 12 16:17:19.529021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'tag': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:17:19.582278 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d714ed25-02e4-4188-bfb4-67b64b12533f'] response: {'name': 'network-changed', 'server_uuid': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'tag': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9', 'status': 'completed', 'code': 200} May 12 16:17:19.650111 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d05ca409-a43d-430e-9c18-64eb10da1e36 None None] Set router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:17:19.697748 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72941b69-407e-49c4-8742-9cc8aa5e5c19 req-e3bf0a49-481e-457c-b69e-2376fac682e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:19.699272 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72941b69-407e-49c4-8742-9cc8aa5e5c19 req-e3bf0a49-481e-457c-b69e-2376fac682e8 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 1096 time: 0.0722127 May 12 16:17:19.707725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a256c24-10ff-4f91-b656-d7fec8ca71d0 req-6a8c7588-bcab-4643-90df-920c193ebb9f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:19.710246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a256c24-10ff-4f91-b656-d7fec8ca71d0 req-6a8c7588-bcab-4643-90df-920c193ebb9f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0846260 May 12 16:17:19.758868 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a256c24-10ff-4f91-b656-d7fec8ca71d0 req-599330a2-3297-46b0-a9f4-2fd6e03f6c1d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427260 May 12 16:17:19.782795 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56034) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:17:19.838055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72941b69-407e-49c4-8742-9cc8aa5e5c19 req-d6e3e6d7-a2d7-468f-b250-591d71c9ce72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:19.839505 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72941b69-407e-49c4-8742-9cc8aa5e5c19 req-d6e3e6d7-a2d7-468f-b250-591d71c9ce72 service neutron] 10.222.0.84 "GET /v2.0/networks?id=27c02bdd-0e84-45ab-a390-660b1b7986c8 HTTP/1.1" status: 200 len: 898 time: 0.1331778 May 12 16:17:19.888557 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b9baada5-0a7d-4dca-ad66-c29e65ee0331 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/e729fb29-f38a-4230-a650-dc274e14d1dd HTTP/1.1" status: 200 len: 991 time: 0.1034696 May 12 16:17:19.945427 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72941b69-407e-49c4-8742-9cc8aa5e5c19 req-ff86fa30-a302-4a49-8648-cdaae9120410 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f886d202-5aaa-4fec-94a4-aa4fadced1f9 HTTP/1.1" status: 200 len: 999 time: 0.0991857 May 12 16:17:20.010915 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72941b69-407e-49c4-8742-9cc8aa5e5c19 req-da57307e-b6d4-4f61-8124-6cce1ec5f94a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:20.012725 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72941b69-407e-49c4-8742-9cc8aa5e5c19 req-da57307e-b6d4-4f61-8124-6cce1ec5f94a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b6cde1a1-1d06-4503-9a98-2ea767e33e4c HTTP/1.1" status: 200 len: 834 time: 0.0617011 May 12 16:17:20.012866 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d05ca409-a43d-430e-9c18-64eb10da1e36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:03Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'e729fb29-f38a-4230-a650-dc274e14d1dd', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.185', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'port_id': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4346, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'mac_address': 'fa:16:3e:17:a1:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:17:18Z', 'updated_at': '2022-05-12T16:17:18Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25111495-0b1b-452c-9fdd-ac2c24035268', 'name': '', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:99:c2:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 4343, 'fixed_ips': [{'subnet_id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:17:02Z', 'updated_at': '2022-05-12T16:17:08Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:17:20.016501 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d05ca409-a43d-430e-9c18-64eb10da1e36 None None] Checking router: c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:17:20.025504 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d05ca409-a43d-430e-9c18-64eb10da1e36 None None] Routers {'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:17:20.026083 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d05ca409-a43d-430e-9c18-64eb10da1e36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:17:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:17:20.089434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72941b69-407e-49c4-8742-9cc8aa5e5c19 req-884cde2b-01a7-450f-9430-b39c1b27f3cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:20.090876 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72941b69-407e-49c4-8742-9cc8aa5e5c19 req-884cde2b-01a7-450f-9430-b39c1b27f3cc service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=27c02bdd-0e84-45ab-a390-660b1b7986c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0724103 May 12 16:17:20.226559 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72941b69-407e-49c4-8742-9cc8aa5e5c19 req-cea60a75-6bd3-47c2-a085-8572aecad905 service neutron] 10.222.0.84 "GET /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1299856 May 12 16:17:20.235899 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d05ca409-a43d-430e-9c18-64eb10da1e36 None None] Set router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:17:20.357345 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72941b69-407e-49c4-8742-9cc8aa5e5c19 req-ba9581dc-cf7e-4081-a8ec-cb690bd74a4a service neutron] 10.222.0.84 "GET /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1250453 May 12 16:17:20.582031 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d05ca409-a43d-430e-9c18-64eb10da1e36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:03Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'e729fb29-f38a-4230-a650-dc274e14d1dd', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.185', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'port_id': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4346, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'mac_address': 'fa:16:3e:17:a1:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:17:18Z', 'updated_at': '2022-05-12T16:17:18Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25111495-0b1b-452c-9fdd-ac2c24035268', 'name': '', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:99:c2:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 4343, 'fixed_ips': [{'subnet_id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:17:02Z', 'updated_at': '2022-05-12T16:17:08Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:17:20.586627 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d05ca409-a43d-430e-9c18-64eb10da1e36 None None] The sync data for ids ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'] in n-d-841483-1 is: [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:03Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'e729fb29-f38a-4230-a650-dc274e14d1dd', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.185', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'port_id': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4346, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'mac_address': 'fa:16:3e:17:a1:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:17:18Z', 'updated_at': '2022-05-12T16:17:18Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25111495-0b1b-452c-9fdd-ac2c24035268', 'name': '', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:99:c2:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 4343, 'fixed_ips': [{'subnet_id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:17:02Z', 'updated_at': '2022-05-12T16:17:08Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:17:20.760465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55285d10-24b1-48e6-a90e-1eeea01863bd None None] New status for floating IP e729fb29-f38a-4230-a650-dc274e14d1dd: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:17:20.891453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56038) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:17:20.963780 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:17:21.000523 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-3358c44a-4310-43e0-8565-6de7cbe61201 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/e729fb29-f38a-4230-a650-dc274e14d1dd HTTP/1.1" status: 200 len: 991 time: 0.1069286 May 12 16:17:22.002951 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56042) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:17:22.109932 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-430c41e0-c367-4714-a07b-a427b8d055ba tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/e729fb29-f38a-4230-a650-dc274e14d1dd HTTP/1.1" status: 200 len: 993 time: 0.1056890 May 12 16:17:23.642220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-ced3ea57-a824-4607-a154-a504650bde30 req-8cd5280f-c793-4f74-93b3-0920f8595d49 service neutron] (88151) timed out ('10.222.0.76', 61677) {{(pid=88151) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 16:17:32.947016 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:42.884218 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-192179ea-ae1b-4481-b7e7-3ed49485bcc9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:43.807161 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:45.413177 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a73742cc-a145-463d-9478-8b5246e5bdcf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:46.153062 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:46.430680 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:47.901666 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:17:53.641418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd82cfd6-5349-44d4-a8ce-eb47afd76fd5 req-f6a5480b-6a19-4784-aeb5-73e827d6e496 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:53.642946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd82cfd6-5349-44d4-a8ce-eb47afd76fd5 req-f6a5480b-6a19-4784-aeb5-73e827d6e496 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.1516631 May 12 16:17:53.689481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fd82cfd6-5349-44d4-a8ce-eb47afd76fd5 req-a8d4aa71-f57d-4095-bb6f-6013be8e9910 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401499 May 12 16:17:54.918084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90509c40-2e08-46cc-b366-61d876b271f1 req-ebfb5080-28f3-489a-95eb-25434d4c1601 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:54.919509 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-90509c40-2e08-46cc-b366-61d876b271f1 req-ebfb5080-28f3-489a-95eb-25434d4c1601 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.1214402 May 12 16:17:54.963129 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-90509c40-2e08-46cc-b366-61d876b271f1 req-8328377a-e2a0-4421-8ab6-caa87aae9d08 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380452 May 12 16:17:56.151935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a78ad4dd-b976-4677-8944-a7965a317f8e req-0bcc162e-61df-4cca-88c4-ea230d42e1f2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:56.153361 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a78ad4dd-b976-4677-8944-a7965a317f8e req-0bcc162e-61df-4cca-88c4-ea230d42e1f2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0833948 May 12 16:17:56.196793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a78ad4dd-b976-4677-8944-a7965a317f8e req-5ffe350b-d8c6-4a8d-968a-642d02f9c433 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375636 May 12 16:17:57.383741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c0aa081-e43d-474a-a93b-6bc7bacc4e4b req-a3f691d9-d61f-4217-9e09-7d958f15c92e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:57.385177 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c0aa081-e43d-474a-a93b-6bc7bacc4e4b req-a3f691d9-d61f-4217-9e09-7d958f15c92e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0800343 May 12 16:17:57.428177 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c0aa081-e43d-474a-a93b-6bc7bacc4e4b req-44a6d3f1-01ff-4d3a-b957-99b43c9cf4d7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374267 May 12 16:17:57.963561 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:17:58.723665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b1b03bb-6902-4c6f-b683-64bd0edd8ab0 req-55469bb9-c666-4240-a7e3-e84f27ca5d27 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:58.725090 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7b1b03bb-6902-4c6f-b683-64bd0edd8ab0 req-55469bb9-c666-4240-a7e3-e84f27ca5d27 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.1897924 May 12 16:17:58.768765 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7b1b03bb-6902-4c6f-b683-64bd0edd8ab0 req-4320c987-5791-40e7-8a73-41b620a097e6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374796 May 12 16:17:59.957076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951a8ef4-d081-46f2-8515-8be0295507d3 req-0b3732f7-e0f1-4803-9136-04b3f3a9245d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:17:59.958551 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-951a8ef4-d081-46f2-8515-8be0295507d3 req-0b3732f7-e0f1-4803-9136-04b3f3a9245d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0852001 May 12 16:18:00.010032 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-951a8ef4-d081-46f2-8515-8be0295507d3 req-2ed91cc5-6f02-43d1-b10d-38d64f30c977 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457604 May 12 16:18:01.190335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db1fec9-1a91-4ff6-ba87-12c289e0db3b req-bf378edd-25a2-442d-b336-2c9247f37179 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:01.191788 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1db1fec9-1a91-4ff6-ba87-12c289e0db3b req-bf378edd-25a2-442d-b336-2c9247f37179 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0776258 May 12 16:18:01.239116 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1db1fec9-1a91-4ff6-ba87-12c289e0db3b req-b0939795-0231-4075-8873-27bb8173581f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406079 May 12 16:18:02.429522 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71804364-9751-4473-89ce-cdfe7ae03dfc req-6762c853-8ac2-4bbf-98a3-30c8badeede6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:02.430951 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71804364-9751-4473-89ce-cdfe7ae03dfc req-6762c853-8ac2-4bbf-98a3-30c8badeede6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0834351 May 12 16:18:02.475582 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-71804364-9751-4473-89ce-cdfe7ae03dfc req-9dcf5c46-1f1c-4ae8-8647-58342acb9962 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385020 May 12 16:18:02.962038 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:03.660045 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb75385-4179-4bb5-81ed-db363f00f3d7 req-f91c84ae-ab28-42a9-b454-4887509629b8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:03.661412 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdb75385-4179-4bb5-81ed-db363f00f3d7 req-f91c84ae-ab28-42a9-b454-4887509629b8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0797791 May 12 16:18:03.705532 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdb75385-4179-4bb5-81ed-db363f00f3d7 req-e9ad4eaf-4976-44b0-9dcd-65e9becf2253 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0372975 May 12 16:18:04.895292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09db1b4e-2145-49e2-b3b9-bdf694599a93 req-5eb2942c-70bf-4b8b-b516-4549ff75ff63 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:04.896636 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09db1b4e-2145-49e2-b3b9-bdf694599a93 req-5eb2942c-70bf-4b8b-b516-4549ff75ff63 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0838137 May 12 16:18:04.939939 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-09db1b4e-2145-49e2-b3b9-bdf694599a93 req-09b25e4a-b449-4732-a83e-67681da9a3c7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0370865 May 12 16:18:04.964154 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56086) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:05.071047 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6be24d96-ef0f-40b0-acb1-c3af647fde77 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/e729fb29-f38a-4230-a650-dc274e14d1dd HTTP/1.1" status: 200 len: 993 time: 0.1057560 May 12 16:18:05.118700 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c61302-8bac-4764-be9b-13046b3ce197 req-823bfe5e-8ba9-48dc-9dfb-7d7d80e5bbb3 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0694938 May 12 16:18:05.295332 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c61302-8bac-4764-be9b-13046b3ce197 req-d95aa070-2d8a-4a08-ad15-ea15b23dfc6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:05.296784 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c61302-8bac-4764-be9b-13046b3ce197 req-d95aa070-2d8a-4a08-ad15-ea15b23dfc6b service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 1096 time: 0.0744412 May 12 16:18:05.545927 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c61302-8bac-4764-be9b-13046b3ce197 req-c6b5f4bf-a0a5-4cb7-bbdd-67112d033984 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:05.547287 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c61302-8bac-4764-be9b-13046b3ce197 req-c6b5f4bf-a0a5-4cb7-bbdd-67112d033984 service neutron] 10.222.0.84 "GET /v2.0/networks?id=27c02bdd-0e84-45ab-a390-660b1b7986c8 HTTP/1.1" status: 200 len: 898 time: 0.2277048 May 12 16:18:05.657644 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c61302-8bac-4764-be9b-13046b3ce197 req-1704e0c1-d04a-4674-b8d0-c3d8ae1e8018 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f886d202-5aaa-4fec-94a4-aa4fadced1f9 HTTP/1.1" status: 200 len: 1001 time: 0.0999048 May 12 16:18:05.723622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c61302-8bac-4764-be9b-13046b3ce197 req-e5fd90e2-cdef-4a72-893c-f492cc0ed48b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:05.725003 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c61302-8bac-4764-be9b-13046b3ce197 req-e5fd90e2-cdef-4a72-893c-f492cc0ed48b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b6cde1a1-1d06-4503-9a98-2ea767e33e4c HTTP/1.1" status: 200 len: 834 time: 0.0581560 May 12 16:18:05.805201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c61302-8bac-4764-be9b-13046b3ce197 req-10284549-7d04-4eca-a03c-1d92bbc983b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:05.807281 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c61302-8bac-4764-be9b-13046b3ce197 req-10284549-7d04-4eca-a03c-1d92bbc983b8 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=27c02bdd-0e84-45ab-a390-660b1b7986c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0730214 May 12 16:18:05.940070 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c61302-8bac-4764-be9b-13046b3ce197 req-94534cb4-a39a-4982-9943-2e3586e96659 service neutron] 10.222.0.84 "GET /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1235647 May 12 16:18:06.071419 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d6c61302-8bac-4764-be9b-13046b3ce197 req-1f11dad8-831c-4341-93b2-3fa40dcfa994 service neutron] 10.222.0.84 "GET /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1220546 May 12 16:18:06.536728 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d773a4-de05-44e3-be58-3a6ecb9868b5 req-b4c36856-5339-4413-ae21-3345933030c3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:06.538207 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13d773a4-de05-44e3-be58-3a6ecb9868b5 req-b4c36856-5339-4413-ae21-3345933030c3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0835280 May 12 16:18:06.586404 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-13d773a4-de05-44e3-be58-3a6ecb9868b5 req-14e28c6a-952b-4e13-9bf5-d665640e3267 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412436 May 12 16:18:06.624653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b008264c-9221-4234-b3c7-d67ae071221d req-e0f1528f-1cd3-47d8-bac3-5a40525a4fd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:06.626211 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b008264c-9221-4234-b3c7-d67ae071221d req-e0f1528f-1cd3-47d8-bac3-5a40525a4fd0 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 1096 time: 0.0764816 May 12 16:18:06.766096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b008264c-9221-4234-b3c7-d67ae071221d req-fc070724-9dcc-4ce0-9b34-5aeb2c7bafd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:06.767533 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b008264c-9221-4234-b3c7-d67ae071221d req-fc070724-9dcc-4ce0-9b34-5aeb2c7bafd6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=27c02bdd-0e84-45ab-a390-660b1b7986c8 HTTP/1.1" status: 200 len: 898 time: 0.1327524 May 12 16:18:06.880543 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b008264c-9221-4234-b3c7-d67ae071221d req-523e6e74-ee8f-4245-af41-247f617083a2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f886d202-5aaa-4fec-94a4-aa4fadced1f9 HTTP/1.1" status: 200 len: 1001 time: 0.1037555 May 12 16:18:06.950487 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b008264c-9221-4234-b3c7-d67ae071221d req-c60eb837-7433-43f4-933e-e426ab410c59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:06.951894 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b008264c-9221-4234-b3c7-d67ae071221d req-c60eb837-7433-43f4-933e-e426ab410c59 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b6cde1a1-1d06-4503-9a98-2ea767e33e4c HTTP/1.1" status: 200 len: 834 time: 0.0626447 May 12 16:18:07.036212 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b008264c-9221-4234-b3c7-d67ae071221d req-b0f6d61b-8091-4e62-b430-9dff8ea89502 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:07.037725 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b008264c-9221-4234-b3c7-d67ae071221d req-b0f6d61b-8091-4e62-b430-9dff8ea89502 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=27c02bdd-0e84-45ab-a390-660b1b7986c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0767133 May 12 16:18:07.183511 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b008264c-9221-4234-b3c7-d67ae071221d req-ceae08cb-6592-4c41-8ed3-94f4a3513896 service neutron] 10.222.0.84 "GET /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1363814 May 12 16:18:07.317570 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b008264c-9221-4234-b3c7-d67ae071221d req-b5c0ab04-8d3d-4ede-a09e-ca914c4e58ae service neutron] 10.222.0.84 "GET /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1248770 May 12 16:18:07.779153 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c75e1c0-5f9c-42ec-b3a2-7802eeef389d req-01ec96b5-184e-4bee-ba0d-263cbb7ac87e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:07.780606 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c75e1c0-5f9c-42ec-b3a2-7802eeef389d req-01ec96b5-184e-4bee-ba0d-263cbb7ac87e tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0819793 May 12 16:18:07.823690 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9c75e1c0-5f9c-42ec-b3a2-7802eeef389d req-ecf9c257-528f-4b4f-8261-435b84c42ea0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374732 May 12 16:18:09.012322 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6202bd4-60c6-46ad-8271-ab46e3b8628a req-5c756268-ced6-4986-8e23-68e8a7634fa7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:09.013783 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6202bd4-60c6-46ad-8271-ab46e3b8628a req-5c756268-ced6-4986-8e23-68e8a7634fa7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0833676 May 12 16:18:09.057088 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d6202bd4-60c6-46ad-8271-ab46e3b8628a req-77c7c1da-bab3-4aed-8426-1da38685342d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376568 May 12 16:18:09.081676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56100) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:09.187275 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-53e5f5ab-b949-41a3-a512-7fa4f968cc86 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/e729fb29-f38a-4230-a650-dc274e14d1dd HTTP/1.1" status: 200 len: 993 time: 0.1043937 May 12 16:18:12.886618 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b4acac46-d35f-45b4-997d-df6d9fcdd574 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:13.805603 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:15.415326 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d21f929a-b662-44e4-803d-855682fd6d5a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:16.155649 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:16.432297 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:17.904639 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:32.960776 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:34.962454 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:18:40.388596 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e8b46ad0-7d89-4a1c-9411-5d58f4990a73 req-51ca1a93-37a2-43a5-b393-60c7afe6ca07 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0768795 May 12 16:18:40.498970 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e8b46ad0-7d89-4a1c-9411-5d58f4990a73 req-6e2f3609-e5da-48aa-8a58-1667e972e87c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0428977 May 12 16:18:40.544442 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e8b46ad0-7d89-4a1c-9411-5d58f4990a73 req-6aec4c2c-ee43-48d7-a783-a9b155dbd889 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0283957 May 12 16:18:40.678759 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8b46ad0-7d89-4a1c-9411-5d58f4990a73 req-ac60a72e-6efb-4c1a-83ed-4f65b85dfa07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:40.680160 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e8b46ad0-7d89-4a1c-9411-5d58f4990a73 req-ac60a72e-6efb-4c1a-83ed-4f65b85dfa07 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1307378 May 12 16:18:41.702238 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56126) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:41.897410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port 1fc6625f-2d5a-4617-8124-85d4c57eb25f {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:18:41.897773 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:42.066766 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:42.067086 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:42.297048 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for 1fc6625f-2d5a-4617-8124-85d4c57eb25f owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:18:42.445248 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:42.490679 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=1fc6625f-2d5a-4617-8124-85d4c57eb25f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:42.534377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:42.534804 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:42.535166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:42.535497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:42.535826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:42.536152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:42.536476 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:42.536845 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:42.537171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:42.537520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:42.537841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:42.538159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:42.599846 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:42.600195 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Floating IP e729fb29-f38a-4230-a650-dc274e14d1dd disassociated (deleted). External IP: 172.25.8.185, port: f886d202-5aaa-4fec-94a4-aa4fadced1f9. May 12 16:18:42.888046 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0a54e1cf-4233-4bd4-bf9f-85ae37f8d533 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:42.952790 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:18:43.143152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:18:43.152834 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67bc0158-b501-4c1d-89d1-08afe5e03fca None None] Sync routers for ids ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:18:43.160168 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:43.162781 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67bc0158-b501-4c1d-89d1-08afe5e03fca None None] Routers {'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:18:43.163365 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-67bc0158-b501-4c1d-89d1-08afe5e03fca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:18:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:43.218998 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-be30ff63-96cf-43a3-93b5-a014f56a4b78 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/floatingips/e729fb29-f38a-4230-a650-dc274e14d1dd HTTP/1.1" status: 204 len: 168 time: 1.5129609 May 12 16:18:43.218998 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'tag': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:18:43.270424 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-33a9df29-40cc-41a3-a6e1-28b030188b16'] response: {'name': 'network-changed', 'server_uuid': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'tag': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9', 'status': 'completed', 'code': 200} May 12 16:18:43.347235 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-67bc0158-b501-4c1d-89d1-08afe5e03fca None None] Set router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:18:43.563622 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835b5146-62c3-42e4-ab11-43e69998d84f req-9dfa62f8-e1a1-49bc-8d40-5ed5788ff234 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:43.565096 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-835b5146-62c3-42e4-ab11-43e69998d84f req-9dfa62f8-e1a1-49bc-8d40-5ed5788ff234 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 1096 time: 0.2400973 May 12 16:18:43.642544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb10812d-18b7-4713-9468-bcca6ad9a8cb req-df3ddeed-a5f4-45ad-b625-fff4b8705044 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:43.643348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cb10812d-18b7-4713-9468-bcca6ad9a8cb req-df3ddeed-a5f4-45ad-b625-fff4b8705044 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:18:43.661345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-cb10812d-18b7-4713-9468-bcca6ad9a8cb req-df3ddeed-a5f4-45ad-b625-fff4b8705044 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:18:43.662531 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb10812d-18b7-4713-9468-bcca6ad9a8cb req-df3ddeed-a5f4-45ad-b625-fff4b8705044 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.1046011 May 12 16:18:43.680499 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-67bc0158-b501-4c1d-89d1-08afe5e03fca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:03Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '25111495-0b1b-452c-9fdd-ac2c24035268', 'name': '', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:99:c2:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 4343, 'fixed_ips': [{'subnet_id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:17:02Z', 'updated_at': '2022-05-12T16:17:08Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:43.686089 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67bc0158-b501-4c1d-89d1-08afe5e03fca None None] Checking router: c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:18:43.695078 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67bc0158-b501-4c1d-89d1-08afe5e03fca None None] Routers {'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:18:43.695661 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-67bc0158-b501-4c1d-89d1-08afe5e03fca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:18:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:43.706348 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835b5146-62c3-42e4-ab11-43e69998d84f req-6bfcf9ac-e57d-49bb-b747-6a88649322d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:43.707954 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-835b5146-62c3-42e4-ab11-43e69998d84f req-6bfcf9ac-e57d-49bb-b747-6a88649322d5 service neutron] 10.222.0.84 "GET /v2.0/networks?id=27c02bdd-0e84-45ab-a390-660b1b7986c8 HTTP/1.1" status: 200 len: 898 time: 0.1356263 May 12 16:18:43.713135 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb10812d-18b7-4713-9468-bcca6ad9a8cb req-45f7f31d-dcec-414e-905a-c048c2c8ebd0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444415 May 12 16:18:43.781080 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-835b5146-62c3-42e4-ab11-43e69998d84f req-adbf6cc9-9715-4cf6-a27b-4a40125a80e5 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f886d202-5aaa-4fec-94a4-aa4fadced1f9 HTTP/1.1" status: 200 len: 217 time: 0.0663686 May 12 16:18:43.814027 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:43.849219 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835b5146-62c3-42e4-ab11-43e69998d84f req-30375410-6b38-44c8-a116-4bbfd5eb104f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:43.850688 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-835b5146-62c3-42e4-ab11-43e69998d84f req-30375410-6b38-44c8-a116-4bbfd5eb104f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=b6cde1a1-1d06-4503-9a98-2ea767e33e4c HTTP/1.1" status: 200 len: 834 time: 0.0624566 May 12 16:18:43.908871 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-67bc0158-b501-4c1d-89d1-08afe5e03fca None None] Set router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:18:43.929476 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835b5146-62c3-42e4-ab11-43e69998d84f req-cd362e4c-a535-4d32-a688-c0f4e5794fcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:43.930943 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-835b5146-62c3-42e4-ab11-43e69998d84f req-cd362e4c-a535-4d32-a688-c0f4e5794fcc service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=27c02bdd-0e84-45ab-a390-660b1b7986c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0741653 May 12 16:18:44.063404 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-835b5146-62c3-42e4-ab11-43e69998d84f req-03f5277b-018f-4d97-b17b-2cfb1b332948 service neutron] 10.222.0.84 "GET /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1257620 May 12 16:18:44.197904 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-835b5146-62c3-42e4-ab11-43e69998d84f req-654b1712-c84c-4868-ae68-076718cc3f81 service neutron] 10.222.0.84 "GET /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1277699 May 12 16:18:44.220350 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-67bc0158-b501-4c1d-89d1-08afe5e03fca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:03Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '25111495-0b1b-452c-9fdd-ac2c24035268', 'name': '', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:99:c2:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 4343, 'fixed_ips': [{'subnet_id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:17:02Z', 'updated_at': '2022-05-12T16:17:08Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:44.225293 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67bc0158-b501-4c1d-89d1-08afe5e03fca None None] The sync data for ids ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'] in n-d-841483-1 is: [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:03Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '25111495-0b1b-452c-9fdd-ac2c24035268', 'name': '', 'network_id': '27c02bdd-0e84-45ab-a390-660b1b7986c8', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:99:c2:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 4343, 'fixed_ips': [{'subnet_id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:17:02Z', 'updated_at': '2022-05-12T16:17:08Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': 'b6cde1a1-1d06-4503-9a98-2ea767e33e4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:18:44.437944 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61f81fe8-4be6-462a-8a5d-65c6308e7544 None None] New status for floating IP e729fb29-f38a-4230-a650-dc274e14d1dd: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:18:44.899600 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb7b465-5613-44ee-998a-176585a05f34 req-208c7da2-1f40-49c9-8aaa-0eaac7cd5e40 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:44.900976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdb7b465-5613-44ee-998a-176585a05f34 req-208c7da2-1f40-49c9-8aaa-0eaac7cd5e40 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0798588 May 12 16:18:44.945005 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fdb7b465-5613-44ee-998a-176585a05f34 req-f87726a5-dc1b-44c6-b523-2d07d96c7e8b tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=acff21d9-6710-4d66-af2f-144511787fbf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382471 May 12 16:18:45.404261 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dfb4579-7ef5-4c37-ba1b-1fb37a13d924 req-d4c34791-b014-428a-acea-507c1ef3fc0d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:45.405048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-3dfb4579-7ef5-4c37-ba1b-1fb37a13d924 req-d4c34791-b014-428a-acea-507c1ef3fc0d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:18:45.416801 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-3dfb4579-7ef5-4c37-ba1b-1fb37a13d924 req-d4c34791-b014-428a-acea-507c1ef3fc0d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:18:45.417808 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3dfb4579-7ef5-4c37-ba1b-1fb37a13d924 req-d4c34791-b014-428a-acea-507c1ef3fc0d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 945 time: 0.0903554 May 12 16:18:45.418364 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-08fa4c0f-5c31-430d-bcf8-e13c821df21b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:45.490749 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-3dfb4579-7ef5-4c37-ba1b-1fb37a13d924 req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port f886d202-5aaa-4fec-94a4-aa4fadced1f9 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:18:45.491092 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3dfb4579-7ef5-4c37-ba1b-1fb37a13d924 req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:45.736783 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-3dfb4579-7ef5-4c37-ba1b-1fb37a13d924 req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port f886d202-5aaa-4fec-94a4-aa4fadced1f9, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f886d202-5aaa-4fec-94a4-aa4fadced1f9,segment=NetworkSegment(bc276dae-0957-4f73-a935-f2bd95979cc7),segment_id=bc276dae-0957-4f73-a935-f2bd95979cc7)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:18:45.737146 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3dfb4579-7ef5-4c37-ba1b-1fb37a13d924 req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:45.867093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-3dfb4579-7ef5-4c37-ba1b-1fb37a13d924 req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for f886d202-5aaa-4fec-94a4-aa4fadced1f9 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:18:46.008818 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3dfb4579-7ef5-4c37-ba1b-1fb37a13d924 req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:46.061040 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=f886d202-5aaa-4fec-94a4-aa4fadced1f9,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:46.097398 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:46.097752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:46.098087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:46.098421 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:46.098750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:46.099079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:46.099404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:46.099730 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:46.100058 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:46.100310 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ff368662-7870-4ba1-abf3-305ed3d6e692 req-cf89189e-7482-4ac3-95a4-1c7e39a0c103 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=84f70d32-1ac9-4791-8475-86fce028a3f3 HTTP/1.1" status: 200 len: 210 time: 0.0479617 May 12 16:18:46.100763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:46.100763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:46.101031 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:46.149093 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-3dfb4579-7ef5-4c37-ba1b-1fb37a13d924 req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] No DVR routers for this DVR port f886d202-5aaa-4fec-94a4-aa4fadced1f9 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:18:46.151552 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3dfb4579-7ef5-4c37-ba1b-1fb37a13d924 req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:46.154618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'name': 'network-vif-deleted', 'tag': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:18:46.158408 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:46.170337 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3dfb4579-7ef5-4c37-ba1b-1fb37a13d924 req-88960ddb-8490-46d6-a4a8-8eb1d940adfc tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "DELETE /v2.0/ports/f886d202-5aaa-4fec-94a4-aa4fadced1f9 HTTP/1.1" status: 204 len: 173 time: 0.7448931 May 12 16:18:46.249104 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-aa524116-9cdc-4573-bb86-280ec6604177'] response: {'server_uuid': '84f70d32-1ac9-4791-8475-86fce028a3f3', 'name': 'network-vif-deleted', 'tag': 'f886d202-5aaa-4fec-94a4-aa4fadced1f9', 'status': 'completed', 'code': 200} May 12 16:18:46.437201 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:47.196613 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56148) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:47.855207 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8f0de1d-a3cf-4f1f-8af4-184f89eabc68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:47.907523 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:48.209000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b8f0de1d-a3cf-4f1f-8af4-184f89eabc68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port 25111495-0b1b-452c-9fdd-ac2c24035268 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:18:48.209584 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8f0de1d-a3cf-4f1f-8af4-184f89eabc68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:48.394418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-b8f0de1d-a3cf-4f1f-8af4-184f89eabc68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port 25111495-0b1b-452c-9fdd-ac2c24035268, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=25111495-0b1b-452c-9fdd-ac2c24035268,segment=NetworkSegment(bc276dae-0957-4f73-a935-f2bd95979cc7),segment_id=bc276dae-0957-4f73-a935-f2bd95979cc7)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:18:48.394774 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8f0de1d-a3cf-4f1f-8af4-184f89eabc68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:48.520431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b8f0de1d-a3cf-4f1f-8af4-184f89eabc68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for 25111495-0b1b-452c-9fdd-ac2c24035268 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:18:48.613741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f886d202-5aaa-4fec-94a4-aa4fadced1f9 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:18:48.648316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: f886d202-5aaa-4fec-94a4-aa4fadced1f9 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:18:48.648657 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f886d202-5aaa-4fec-94a4-aa4fadced1f9 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:18:48.711647 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8f0de1d-a3cf-4f1f-8af4-184f89eabc68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:48.763863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8f0de1d-a3cf-4f1f-8af4-184f89eabc68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=25111495-0b1b-452c-9fdd-ac2c24035268,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:49.150925 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b8f0de1d-a3cf-4f1f-8af4-184f89eabc68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:49.513842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b8f0de1d-a3cf-4f1f-8af4-184f89eabc68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:18:49.692139 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b8f0de1d-a3cf-4f1f-8af4-184f89eabc68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:18:49.702339 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b27bcdb7-0ae3-44c3-a296-3474e728bdcc None None] Sync routers for ids ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:18:49.706644 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b8f0de1d-a3cf-4f1f-8af4-184f89eabc68 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "PUT /v2.0/routers/c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5073881 May 12 16:18:49.708260 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56152) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:49.711483 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b27bcdb7-0ae3-44c3-a296-3474e728bdcc None None] Routers {'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:18:49.712140 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b27bcdb7-0ae3-44c3-a296-3474e728bdcc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:18:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:49.773958 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-f9215e2f-7d94-45a4-b0fb-68258530d392 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting subnet b6cde1a1-1d06-4503-9a98-2ea767e33e4c {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:18:49.776868 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9215e2f-7d94-45a4-b0fb-68258530d392 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:49.846296 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9215e2f-7d94-45a4-b0fb-68258530d392 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:49.886169 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-b27bcdb7-0ae3-44c3-a296-3474e728bdcc None None] Set router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:18:49.929539 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9215e2f-7d94-45a4-b0fb-68258530d392 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:50.002746 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9215e2f-7d94-45a4-b0fb-68258530d392 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:50.159705 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9215e2f-7d94-45a4-b0fb-68258530d392 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Subnet': ['ID=b6cde1a1-1d06-4503-9a98-2ea767e33e4c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:50.163252 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9215e2f-7d94-45a4-b0fb-68258530d392 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:50.170375 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f9215e2f-7d94-45a4-b0fb-68258530d392 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/subnets/b6cde1a1-1d06-4503-9a98-2ea767e33e4c HTTP/1.1" status: 204 len: 168 time: 0.4610713 May 12 16:18:50.173645 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56156) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:50.175827 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5f7d5c0-5105-413c-832d-eea16d39a7c5 None None] Network 27c02bdd-0e84-45ab-a390-660b1b7986c8 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:18:50.177188 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b27bcdb7-0ae3-44c3-a296-3474e728bdcc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:18:48Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:50.181133 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b27bcdb7-0ae3-44c3-a296-3474e728bdcc None None] Checking router: c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:18:50.189503 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b27bcdb7-0ae3-44c3-a296-3474e728bdcc None None] Routers {'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:18:50.190287 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b27bcdb7-0ae3-44c3-a296-3474e728bdcc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:18:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:50.369117 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-b27bcdb7-0ae3-44c3-a296-3474e728bdcc None None] Set router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:18:50.383534 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:50.447889 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] DHCP port deletion for 27c02bdd-0e84-45ab-a390-660b1b7986c8 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:18:50.455038 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Deleting port 3a8c9835-7192-4682-9c0c-75e7781d125d {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:18:50.455642 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:50.582464 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:50.593286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port 82a93771-840a-4a68-9522-56e975637345 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:18:50.593678 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:50.684036 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] For port 3a8c9835-7192-4682-9c0c-75e7781d125d, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=3a8c9835-7192-4682-9c0c-75e7781d125d,segment=NetworkSegment(bc276dae-0957-4f73-a935-f2bd95979cc7),segment_id=bc276dae-0957-4f73-a935-f2bd95979cc7)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:18:50.684428 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:50.733029 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-b27bcdb7-0ae3-44c3-a296-3474e728bdcc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:18:48Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:50.737872 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b27bcdb7-0ae3-44c3-a296-3474e728bdcc None None] The sync data for ids ['c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6'] in n-d-841483-1 is: [{'id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'name': 'tempest-TestNetworkAdvancedServerOps-router-537201172', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63'}], 'enable_snat': True}, 'gw_port_id': '82a93771-840a-4a68-9522-56e975637345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:18:48Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '82a93771-840a-4a68-9522-56e975637345', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:4a:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4340, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:16:58Z', 'updated_at': '2022-05-12T16:17:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:18:50.760972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 3a8c9835-7192-4682-9c0c-75e7781d125d no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:18:50.794140 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port 82a93771-840a-4a68-9522-56e975637345, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=82a93771-840a-4a68-9522-56e975637345,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:18:50.795378 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:50.855636 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Calling delete_port for 3a8c9835-7192-4682-9c0c-75e7781d125d owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:18:50.923212 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for 82a93771-840a-4a68-9522-56e975637345 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:18:50.996626 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023'] for port, after_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:51.049380 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Pushing event deleted for resources: {'Port': ['ID=3a8c9835-7192-4682-9c0c-75e7781d125d,revision_number=None']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:51.053273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] No DVR routers for this DVR port 3a8c9835-7192-4682-9c0c-75e7781d125d on host n-d-841483-1 {{(pid=88153) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:18:51.057108 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:51.080139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:51.080139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:51.080139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:51.080139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:51.080868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:51.080868 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:51.081201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:51.081530 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:51.081851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:51.082168 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:51.082481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:51.082800 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a8efbbb-399b-47fb-a887-5a18148777cc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:18:51.230653 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:51.281444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=82a93771-840a-4a68-9522-56e975637345,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:51.370307 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:51.652930 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:51.655552 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:51.677418 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:51.677936 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Fanout notify agent at l3_agent the message router_deleted on router c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:18:51.693417 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:51.694510 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-327f959f-f667-4b11-8f98-0f9d6f922b3d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/routers/c88e51a4-b9a0-4f8d-85ac-f3e987e80fd6 HTTP/1.1" status: 204 len: 168 time: 1.5199156 May 12 16:18:51.697463 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56160) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:51.818578 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-51c40dba-d549-4035-8f7d-dd7b235218ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:51.958056 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-51c40dba-d549-4035-8f7d-dd7b235218ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:51.985844 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-51c40dba-d549-4035-8f7d-dd7b235218ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['27c02bdd-0e84-45ab-a390-660b1b7986c8']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:51.997451 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-51c40dba-d549-4035-8f7d-dd7b235218ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bc276dae-0957-4f73-a935-f2bd95979cc7') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:51.997745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-51c40dba-d549-4035-8f7d-dd7b235218ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bc276dae-0957-4f73-a935-f2bd95979cc7') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:52.008665 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-51c40dba-d549-4035-8f7d-dd7b235218ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.024946 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-51c40dba-d549-4035-8f7d-dd7b235218ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.031417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-51c40dba-d549-4035-8f7d-dd7b235218ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Releasing vlan 568 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:18:52.031792 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-51c40dba-d549-4035-8f7d-dd7b235218ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: timer() May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: self._notify() May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:18:52.045849 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:18:52.130404 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-51c40dba-d549-4035-8f7d-dd7b235218ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.147691 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-51c40dba-d549-4035-8f7d-dd7b235218ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.159229 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51c40dba-d549-4035-8f7d-dd7b235218ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Network': ['ID=27c02bdd-0e84-45ab-a390-660b1b7986c8,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:52.167707 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-51c40dba-d549-4035-8f7d-dd7b235218ce tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/networks/27c02bdd-0e84-45ab-a390-660b1b7986c8 HTTP/1.1" status: 204 len: 168 time: 0.4692931 May 12 16:18:52.170930 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56164) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:52.243390 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57acfc92-b985-4e32-b5e7-b7f8cd6b7d53 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.275609 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57acfc92-b985-4e32-b5e7-b7f8cd6b7d53 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.344457 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57acfc92-b985-4e32-b5e7-b7f8cd6b7d53 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.362967 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57acfc92-b985-4e32-b5e7-b7f8cd6b7d53 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=acff21d9-6710-4d66-af2f-144511787fbf,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:52.376916 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-57acfc92-b985-4e32-b5e7-b7f8cd6b7d53 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.378076 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-57acfc92-b985-4e32-b5e7-b7f8cd6b7d53 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/security-groups/acff21d9-6710-4d66-af2f-144511787fbf HTTP/1.1" status: 204 len: 168 time: 0.2062061 May 12 16:18:52.503966 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56172) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:52.509144 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-928886426', 'description': 'tempest-secgroup-smoke-928886426 description', 'project_id': 'f50049e6814046a9abf21905584f94e1'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:18:52.516232 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:18:52.520269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:18:52.523065 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:18:52.528620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:18:52.539750 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.561928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:18:52.565637 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:18:52.568341 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:18:52.574108 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:18:52.649568 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.653444 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.668138 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 25111495-0b1b-452c-9fdd-ac2c24035268 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:18:52.697841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:52.704492 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.705814 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1298baa8-44d0-4656-98c9-f1b2ef6f32cf tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.2008133 May 12 16:18:52.708556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56176) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:52.713107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 25111495-0b1b-452c-9fdd-ac2c24035268 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:18:52.713470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 25111495-0b1b-452c-9fdd-ac2c24035268 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:18:52.713870 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-5bdef00e-bc57-48a6-999c-92301fad7281 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '7a554ed5-5c12-41b6-80f7-c62af4cb9d6b', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:18:52.714001 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 82a93771-840a-4a68-9522-56e975637345 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:18:52.721162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5bdef00e-bc57-48a6-999c-92301fad7281 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:18:52.724991 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5bdef00e-bc57-48a6-999c-92301fad7281 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:18:52.727852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5bdef00e-bc57-48a6-999c-92301fad7281 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:18:52.733620 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5bdef00e-bc57-48a6-999c-92301fad7281 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:18:52.747872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 82a93771-840a-4a68-9522-56e975637345 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:18:52.749985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 82a93771-840a-4a68-9522-56e975637345 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:18:52.751025 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5bdef00e-bc57-48a6-999c-92301fad7281 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.811985 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5bdef00e-bc57-48a6-999c-92301fad7281 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.815638 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5bdef00e-bc57-48a6-999c-92301fad7281 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.838718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bdef00e-bc57-48a6-999c-92301fad7281 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0c502a5e-76a3-4490-8eaf-17bc76c98289,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:52.847426 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5bdef00e-bc57-48a6-999c-92301fad7281 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.848789 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5bdef00e-bc57-48a6-999c-92301fad7281 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1390269 May 12 16:18:52.851473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56180) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:52.856234 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-b94b1eb1-20e8-44f4-9d4a-b192f17a21b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '7a554ed5-5c12-41b6-80f7-c62af4cb9d6b', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:18:52.862548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b94b1eb1-20e8-44f4-9d4a-b192f17a21b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:18:52.866317 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b94b1eb1-20e8-44f4-9d4a-b192f17a21b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:18:52.869075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-b94b1eb1-20e8-44f4-9d4a-b192f17a21b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:18:52.875369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-b94b1eb1-20e8-44f4-9d4a-b192f17a21b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:18:52.892777 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b94b1eb1-20e8-44f4-9d4a-b192f17a21b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.956284 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b94b1eb1-20e8-44f4-9d4a-b192f17a21b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.959606 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b94b1eb1-20e8-44f4-9d4a-b192f17a21b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.982078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b94b1eb1-20e8-44f4-9d4a-b192f17a21b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0ea67350-99a3-4139-8371-afbb17388560,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:52.990128 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-b94b1eb1-20e8-44f4-9d4a-b192f17a21b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:52.991238 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b94b1eb1-20e8-44f4-9d4a-b192f17a21b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1388819 May 12 16:18:52.994032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56184) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:52.999848 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-fc72434b-ba31-4867-8a1d-b5c772cc314c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '7a554ed5-5c12-41b6-80f7-c62af4cb9d6b', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:18:53.006417 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fc72434b-ba31-4867-8a1d-b5c772cc314c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:18:53.010138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fc72434b-ba31-4867-8a1d-b5c772cc314c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:18:53.012962 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fc72434b-ba31-4867-8a1d-b5c772cc314c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:18:53.019326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fc72434b-ba31-4867-8a1d-b5c772cc314c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:18:53.035846 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc72434b-ba31-4867-8a1d-b5c772cc314c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.097694 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc72434b-ba31-4867-8a1d-b5c772cc314c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.101149 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc72434b-ba31-4867-8a1d-b5c772cc314c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.128072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc72434b-ba31-4867-8a1d-b5c772cc314c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=571b9099-6730-4101-b4c8-b3b8c6f0f2e8,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:53.134250 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fc72434b-ba31-4867-8a1d-b5c772cc314c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.135621 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fc72434b-ba31-4867-8a1d-b5c772cc314c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1406689 May 12 16:18:53.138935 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56188) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:53.144209 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-400355a1-ad9d-482e-8768-a6a53fc1bbad tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '7a554ed5-5c12-41b6-80f7-c62af4cb9d6b', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:18:53.151429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-400355a1-ad9d-482e-8768-a6a53fc1bbad tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:18:53.155343 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-400355a1-ad9d-482e-8768-a6a53fc1bbad tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:18:53.158217 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-400355a1-ad9d-482e-8768-a6a53fc1bbad tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:18:53.163826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-400355a1-ad9d-482e-8768-a6a53fc1bbad tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:18:53.179901 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-400355a1-ad9d-482e-8768-a6a53fc1bbad tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.245593 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-400355a1-ad9d-482e-8768-a6a53fc1bbad tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.250150 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-400355a1-ad9d-482e-8768-a6a53fc1bbad tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.275752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-400355a1-ad9d-482e-8768-a6a53fc1bbad tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9b187c92-cb34-4c61-9595-1ce591d0d14e,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:53.286013 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-400355a1-ad9d-482e-8768-a6a53fc1bbad tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.287187 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-400355a1-ad9d-482e-8768-a6a53fc1bbad tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1473060 May 12 16:18:53.290055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56192) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:53.297259 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-ebe1c83b-5217-4538-92a0-ac4949131afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '7a554ed5-5c12-41b6-80f7-c62af4cb9d6b', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:18:53.304110 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ebe1c83b-5217-4538-92a0-ac4949131afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:18:53.307938 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ebe1c83b-5217-4538-92a0-ac4949131afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:18:53.311731 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ebe1c83b-5217-4538-92a0-ac4949131afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:18:53.318014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ebe1c83b-5217-4538-92a0-ac4949131afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:18:53.328271 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-ebe1c83b-5217-4538-92a0-ac4949131afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Project f50049e6814046a9abf21905584f94e1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:18:53.334824 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ebe1c83b-5217-4538-92a0-ac4949131afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.402293 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ebe1c83b-5217-4538-92a0-ac4949131afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.406013 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ebe1c83b-5217-4538-92a0-ac4949131afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.430325 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebe1c83b-5217-4538-92a0-ac4949131afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=13000b8a-7e16-456b-b70e-1836faca6c52,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:53.439767 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ebe1c83b-5217-4538-92a0-ac4949131afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.441210 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ebe1c83b-5217-4538-92a0-ac4949131afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1494823 May 12 16:18:53.444044 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56196) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:53.449338 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-2bc8f949-49e6-4c33-91fa-0d5075a9b068 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'security_group_rule': {'security_group_id': '7a554ed5-5c12-41b6-80f7-c62af4cb9d6b', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:18:53.456181 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2bc8f949-49e6-4c33-91fa-0d5075a9b068 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:18:53.460051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2bc8f949-49e6-4c33-91fa-0d5075a9b068 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:security_group_rule and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:18:53.462944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2bc8f949-49e6-4c33-91fa-0d5075a9b068 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:18:53.468783 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2bc8f949-49e6-4c33-91fa-0d5075a9b068 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:18:53.479334 n-d-841483-1 neutron-server[88152]: INFO neutron.db.securitygroups_db [None req-2bc8f949-49e6-4c33-91fa-0d5075a9b068 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Project f50049e6814046a9abf21905584f94e1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:18:53.486628 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2bc8f949-49e6-4c33-91fa-0d5075a9b068 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.552328 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2bc8f949-49e6-4c33-91fa-0d5075a9b068 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.555594 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2bc8f949-49e6-4c33-91fa-0d5075a9b068 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.578644 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bc8f949-49e6-4c33-91fa-0d5075a9b068 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1389b613-4925-4a05-9fb1-c1ba855c8e2e,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:53.587210 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2bc8f949-49e6-4c33-91fa-0d5075a9b068 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.588363 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2bc8f949-49e6-4c33-91fa-0d5075a9b068 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1433439 May 12 16:18:53.591227 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56200) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:53.596426 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'network': {'name': 'tempest-network-smoke--1186305424', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'port_security_enabled': True}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:18:53.601731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:18:53.605745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:network and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:18:53.609106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:18:53.614702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:18:53.624734 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:18:53.627993 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.654894 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 566} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:18:53.663542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.663885 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Added segment 1bc9de87-b4ce-4d74-ba44-5f4632eb4d54 of type vlan for network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d May 12 16:18:53.691207 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.721000 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.726407 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:53.726977 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.850716 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2583210 May 12 16:18:53.853285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2209494b-7120-4cea-8ec0-8e05a33ecaca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Network': ['ID=5f507fb1-efe4-49a5-8ce7-83e6efe3b99d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:53.853540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56204) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:53.859344 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'admin_state_up': True, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:18:53.863971 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:18:53.867480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:18:53.871364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:router and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:18:53.874318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for router was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:18:53.880714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:18:53.890561 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.891670 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:53.908237 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:54.171368 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:54.587212 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:54.619825 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:54.752123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.25.8.93 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/34a0ea4e-a639-4c4b-8fc3-8b2890e48a36) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:18:54.900671 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:54.929453 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:54.996543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:18:54.999737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:18:55.003501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:18:55.036723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=34a0ea4e-a639-4c4b-8fc3-8b2890e48a36,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:55.412618 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:55.752277 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:56.062449 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router baf71ae2-a221-4e92-8239-9d929dd78bc7 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88151) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 16:18:56.236955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:18:56.246730 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Sync routers for ids ['baf71ae2-a221-4e92-8239-9d929dd78bc7'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:18:56.257802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Routers {'baf71ae2-a221-4e92-8239-9d929dd78bc7'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:18:56.258402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:18:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['baf71ae2-a221-4e92-8239-9d929dd78bc7'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:56.265072 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:56.266410 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cda72b7c-5ce9-468b-b6d8-9841e283a6f9 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 2.4120605 May 12 16:18:56.269672 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56208) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:56.309908 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ea4300c8-dba4-4f17-9e8b-3b07ccbc21a2 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/subnets?project_id=f50049e6814046a9abf21905584f94e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0390425 May 12 16:18:56.312714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56212) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:56.442305 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f57d9e68-e2b8-48c9-bfa9-47bc4479cc01 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:56.443987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-f57d9e68-e2b8-48c9-bfa9-47bc4479cc01 tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1304383 May 12 16:18:56.446807 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56216) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:56.492497 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-cee606fd-8211-4619-a208-f86f1028603b tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/subnets?network_id=5bff663f-be1e-4c0c-b2e2-d037214cb143&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0420895 May 12 16:18:56.492729 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Set router baf71ae2-a221-4e92-8239-9d929dd78bc7 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:18:56.492854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56220) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:56.498514 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-502361798', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'project_id': 'f50049e6814046a9abf21905584f94e1', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:18:56.610096 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:18:56.614485 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:subnet and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:18:56.617855 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:18:56.624257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:18:56.634414 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:18:56.637822 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:56.792760 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:18:55Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:18:54Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:56.797116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Checking router: baf71ae2-a221-4e92-8239-9d929dd78bc7 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:18:56.797477 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Updating router baf71ae2-a221-4e92-8239-9d929dd78bc7 port 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:18:56.852890 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:56.855924 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:56.934822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Subnet': ['ID=20c35ef1-b8b6-4700-a771-63fc5ceeef17,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:56.945573 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Checking segment: {'id': '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:18:56.945925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network hostable DHCP agents. Network: 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:18:56.965507 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:18:56.974854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:18:56.979353 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:18:56.980047 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:56.996743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-975c41cd-3dc3-4bc9-a96a-72803350b93a None None] Network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:18:57.002919 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-85987191-0e39-4358-b0f7-8088640aa276 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.5091794 May 12 16:18:57.005703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56224) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:18:57.369878 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ips': [{'subnet_id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:18:57.370701 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:57.388412 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:57.405217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Transition to ACTIVE for port object 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:18:57.454455 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:57.559935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Attempting to bind port 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:18:57.560223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Attempting to bind port 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:18:57.561113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Attempting to bind port 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:18:57.573266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-828f8425-38a6-4f41-a878-d3ea1d57b88c None None] Pushing event updated for resources: {'Port': ['ID=34a0ea4e-a639-4c4b-8fc3-8b2890e48a36,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:57.575578 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 18, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:18:57.575981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:18:57.576884 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:57.577328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:18:57.577769 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Bound port: 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:18:57.578119 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:57.690538 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Allocated IP 172.20.0.2 (5f507fb1-efe4-49a5-8ce7-83e6efe3b99d/20c35ef1-b8b6-4700-a771-63fc5ceeef17/257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:18:57.702668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] For port 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:18:57.706204 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] For port 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=34a0ea4e-a639-4c4b-8fc3-8b2890e48a36,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:18:57.724298 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:57.818507 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:57.948773 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Routers {'baf71ae2-a221-4e92-8239-9d929dd78bc7'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:18:57.949480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:18:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['baf71ae2-a221-4e92-8239-9d929dd78bc7'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:58.020967 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-828f8425-38a6-4f41-a878-d3ea1d57b88c None None] Pushing event updated for resources: {'Port': ['ID=34a0ea4e-a639-4c4b-8fc3-8b2890e48a36,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:58.196853 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:58.222893 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Transition to ACTIVE for port object 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:18:58.226680 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] Set router baf71ae2-a221-4e92-8239-9d929dd78bc7 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:18:58.405247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Transition to ACTIVE for port object 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:18:58.420858 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:58.480600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.20.0.1 (5f507fb1-efe4-49a5-8ce7-83e6efe3b99d/20c35ef1-b8b6-4700-a771-63fc5ceeef17/f75bf229-1094-49d7-b40a-d35bfb3b2291) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:18:58.511278 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:18:58.518381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:18:58.542393 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:18:58.560570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Pushing event updated for resources: {'Port': ['ID=257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:58.650150 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:58.665535 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Transition to ACTIVE for port object f75bf229-1094-49d7-b40a-d35bfb3b2291 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:18:58.689304 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:58.689702 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Attempting to bind port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:18:58.690069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Attempting to bind port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:18:58.690429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Attempting to bind port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd on network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:18:58.698966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 18, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:18:58.699329 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Checking segment: {'id': '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:18:58.699730 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:58.700111 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Bound using segment: {'id': '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:18:58.700562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Bound port: 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:18:58.700955 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:58.761483 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:18:58.764614 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:18:58.768739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:18:58.778149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:18:55Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:18:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:18:58.793929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b672841-cc25-48e5-9333-aef128980aa8 None None] The sync data for ids ['baf71ae2-a221-4e92-8239-9d929dd78bc7'] in n-d-841483-1 is: [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:18:55Z', 'revision_number': 3, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:18:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:18:58.806898 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] For port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:18:58.811407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] For port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd,segment=NetworkSegment(1bc9de87-b4ce-4d74-ba44-5f4632eb4d54),segment_id=1bc9de87-b4ce-4d74-ba44-5f4632eb4d54)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:18:58.813982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=f75bf229-1094-49d7-b40a-d35bfb3b2291,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:58.818041 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:58.840057 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:58.916772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4f7ee35-d69d-4853-8516-f81002a151c3 None None] Pushing event updated for resources: {'Port': ['ID=257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:59.144248 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:59.725441 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:59.731278 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:59.849200 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:18:59.853065 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=f75bf229-1094-49d7-b40a-d35bfb3b2291,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:18:59.905439 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d7d2d84-599f-4fcb-bcb5-8ef0cc9ff9d9 None None] Network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:18:59.993123 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:18:59.994360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:19:00.035435 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-26193703-b5ff-4c6a-9215-53e91fd055bf None None] Provisioning for port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:19:00.186904 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router baf71ae2-a221-4e92-8239-9d929dd78bc7 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:19:00.393277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:19:00.406405 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c1163e2f-b36c-48e4-8943-fa101648e34d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "PUT /v2.0/routers/baf71ae2-a221-4e92-8239-9d929dd78bc7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3996894 May 12 16:19:00.472100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1bbc6f09-3397-400a-871d-62f25e97043f None None] Provisioning for port f75bf229-1094-49d7-b40a-d35bfb3b2291 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:19:00.478123 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-1bbc6f09-3397-400a-871d-62f25e97043f None None] Provisioning complete for port f75bf229-1094-49d7-b40a-d35bfb3b2291 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:19:00.478721 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1bbc6f09-3397-400a-871d-62f25e97043f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:00.495752 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Sync routers for ids ['baf71ae2-a221-4e92-8239-9d929dd78bc7'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:19:00.510708 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Routers {'baf71ae2-a221-4e92-8239-9d929dd78bc7'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:19:00.512073 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:18:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['baf71ae2-a221-4e92-8239-9d929dd78bc7'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:19:00.550467 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-1bbc6f09-3397-400a-871d-62f25e97043f None None] Port f75bf229-1094-49d7-b40a-d35bfb3b2291 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:19:00.609719 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-d60a2459-8079-418b-8070-1c7ce351b45f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:19:00.643784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-d60a2459-8079-418b-8070-1c7ce351b45f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:19:00.644811 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-d60a2459-8079-418b-8070-1c7ce351b45f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-928886426&fields=id&tenant_id=f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 267 time: 0.0816197 May 12 16:19:00.687621 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c59eaae5-bbea-4985-8c70-39b413eb676e None None] Provisioning complete for port f75bf229-1094-49d7-b40a-d35bfb3b2291 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:19:00.688004 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c59eaae5-bbea-4985-8c70-39b413eb676e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:00.731612 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Set router baf71ae2-a221-4e92-8239-9d929dd78bc7 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:19:00.761734 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:19:00.827206 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c59eaae5-bbea-4985-8c70-39b413eb676e None None] Port f75bf229-1094-49d7-b40a-d35bfb3b2291 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:19:00.849948 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:19:00.855480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:19:00.856039 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:00.869530 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-34430eb8-a022-4f74-bf5b-65400d0ef798 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:00.870633 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-34430eb8-a022-4f74-bf5b-65400d0ef798 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:19:00.889348 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-34430eb8-a022-4f74-bf5b-65400d0ef798 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:19:00.890892 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-34430eb8-a022-4f74-bf5b-65400d0ef798 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/networks?id=5f507fb1-efe4-49a5-8ce7-83e6efe3b99d HTTP/1.1" status: 200 len: 797 time: 0.2380543 May 12 16:19:00.910666 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-47d79ace-5154-4dd4-b6a8-f0dfa8a89706 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/quotas/f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 375 time: 0.0133328 May 12 16:19:00.989120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a8568a2d-0bf7-45e5-91ba-798bb790e566 None None] Provisioning complete for port f75bf229-1094-49d7-b40a-d35bfb3b2291 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:19:00.989783 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a8568a2d-0bf7-45e5-91ba-798bb790e566 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:01.009300 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7664bbee-8738-4747-bf24-2d58c970efb6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0924931 May 12 16:19:01.067946 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:01.104760 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:18:59Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:18:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'f75bf229-1094-49d7-b40a-d35bfb3b2291', 'name': '', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:af:12:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:58Z', 'updated_at': '2022-05-12T16:18:59Z', 'revision_number': 2, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:19:01.105285 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=34a0ea4e-a639-4c4b-8fc3-8b2890e48a36,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:19:01.108133 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a8568a2d-0bf7-45e5-91ba-798bb790e566 None None] Port f75bf229-1094-49d7-b40a-d35bfb3b2291 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:19:01.110480 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Checking router: baf71ae2-a221-4e92-8239-9d929dd78bc7 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:19:01.110887 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Updating router baf71ae2-a221-4e92-8239-9d929dd78bc7 port f75bf229-1094-49d7-b40a-d35bfb3b2291 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:19:01.111889 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:01.113274 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:19:01.162173 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-2104182e-d525-44ed-a76d-6b944d874dad service neutron] 10.222.0.82 "GET /v2.0/networks/5f507fb1-efe4-49a5-8ce7-83e6efe3b99d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1382537 May 12 16:19:01.174085 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:01.235498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=34a0ea4e-a639-4c4b-8fc3-8b2890e48a36,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:19:01.252192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:19:01.258280 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:19:01.258878 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:01.324462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-90545ffe-00ce-4b45-946d-f77099e05aa8 service neutron] 10.222.0.82 "GET /v2.0/networks/5f507fb1-efe4-49a5-8ce7-83e6efe3b99d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1550381 May 12 16:19:01.392745 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:01.435099 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd,segment=NetworkSegment(1bc9de87-b4ce-4d74-ba44-5f4632eb4d54),segment_id=1bc9de87-b4ce-4d74-ba44-5f4632eb4d54)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:19:01.442975 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:01.527381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:19:01.543577 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:01.553854 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9e8ec77-5f3f-4c81-8206-214d3b5a0b03 req-1f61e8c2-7394-43d6-aed8-5472d48cb4d1 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 210 time: 0.0688365 May 12 16:19:01.556270 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Transition to ACTIVE for port object f75bf229-1094-49d7-b40a-d35bfb3b2291 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:19:01.565597 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:01.703753 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0991a931-caba-4641-ab89-f87965459ea5 None None] Pushing event updated for resources: {'Port': ['ID=f75bf229-1094-49d7-b40a-d35bfb3b2291,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:19:01.716647 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0991a931-caba-4641-ab89-f87965459ea5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:01.717145 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0991a931-caba-4641-ab89-f87965459ea5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:01.717559 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0991a931-caba-4641-ab89-f87965459ea5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:01.718071 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0991a931-caba-4641-ab89-f87965459ea5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:01.718441 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0991a931-caba-4641-ab89-f87965459ea5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:01.718779 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0991a931-caba-4641-ab89-f87965459ea5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:01.719091 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0991a931-caba-4641-ab89-f87965459ea5 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:01.719402 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0991a931-caba-4641-ab89-f87965459ea5 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:01.719713 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0991a931-caba-4641-ab89-f87965459ea5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:01.720021 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0991a931-caba-4641-ab89-f87965459ea5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:01.720596 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0991a931-caba-4641-ab89-f87965459ea5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:01.720780 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0991a931-caba-4641-ab89-f87965459ea5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:01.820554 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Attempting to bind port f75bf229-1094-49d7-b40a-d35bfb3b2291 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:19:01.820913 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Attempting to bind port f75bf229-1094-49d7-b40a-d35bfb3b2291 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:19:01.821262 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Attempting to bind port f75bf229-1094-49d7-b40a-d35bfb3b2291 on network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:19:01.827444 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 18, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:19:01.827863 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Checking segment: {'id': '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:19:01.828254 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:01.828638 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Bound using segment: {'id': '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:19:01.829105 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Bound port: f75bf229-1094-49d7-b40a-d35bfb3b2291, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:19:01.829490 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:01.926176 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] For port f75bf229-1094-49d7-b40a-d35bfb3b2291, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:19:01.931272 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] For port f75bf229-1094-49d7-b40a-d35bfb3b2291, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f75bf229-1094-49d7-b40a-d35bfb3b2291,segment=NetworkSegment(1bc9de87-b4ce-4d74-ba44-5f4632eb4d54),segment_id=1bc9de87-b4ce-4d74-ba44-5f4632eb4d54)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:19:01.935556 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:02.015218 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Routers {'baf71ae2-a221-4e92-8239-9d929dd78bc7'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:19:02.015772 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:18:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['baf71ae2-a221-4e92-8239-9d929dd78bc7'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:19:02.103705 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0991a931-caba-4641-ab89-f87965459ea5 None None] Pushing event updated for resources: {'Port': ['ID=f75bf229-1094-49d7-b40a-d35bfb3b2291,revision_number=4']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:19:02.248255 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] Set router baf71ae2-a221-4e92-8239-9d929dd78bc7 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:19:02.587112 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:18:59Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:19:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'f75bf229-1094-49d7-b40a-d35bfb3b2291', 'name': '', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:af:12:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:58Z', 'updated_at': '2022-05-12T16:19:01Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:19:02.593640 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8410fc08-61a8-4cc3-ae43-e7517d3f6a20 None None] The sync data for ids ['baf71ae2-a221-4e92-8239-9d929dd78bc7'] in n-d-841483-1 is: [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:18:59Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:19:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'f75bf229-1094-49d7-b40a-d35bfb3b2291', 'name': '', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:af:12:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:58Z', 'updated_at': '2022-05-12T16:19:01Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:19:02.739575 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b5771c11-b1b1-41e3-ad7b-f439c7bca8ac req-8ce8d8a0-2646-4431-bb2a-a1630d29987a tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 210 time: 0.0494106 May 12 16:19:02.751837 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:19:02.852213 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:19:02.853003 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:02.970767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-2b8cad7d-e445-45a2-9eb8-1a49605991b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:02.973349 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-2b8cad7d-e445-45a2-9eb8-1a49605991b7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/networks?id=5f507fb1-efe4-49a5-8ce7-83e6efe3b99d HTTP/1.1" status: 200 len: 797 time: 0.1847425 May 12 16:19:03.014094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:19:03.051076 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:03.056290 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-8b70109e-ad4d-4f89-ad64-3cd73275f7e4 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f50049e6814046a9abf21905584f94e1 HTTP/1.1" status: 200 len: 379 time: 0.0610075 May 12 16:19:03.073793 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'port': {'device_id': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'admin_state_up': True, 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'security_groups': ['7a554ed5-5c12-41b6-80f7-c62af4cb9d6b']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:19:03.092629 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:19:03.093176 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:03.221809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:19:03.225931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:port and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:19:03.228863 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:19:03.235360 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:19:03.246892 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Made reservation on behalf of f50049e6814046a9abf21905584f94e1 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:19:03.251009 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:03.421924 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.20.0.3 (5f507fb1-efe4-49a5-8ce7-83e6efe3b99d/20c35ef1-b8b6-4700-a771-63fc5ceeef17/f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:19:03.621472 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:03.640464 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Transition to ACTIVE for port object f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:19:03.665289 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:03.738388 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:19:03.741682 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:19:03.745633 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:19:03.912696 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:19:03.938434 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:03.939060 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:03.955128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd66c769-547d-4f93-b943-a10a4c11642a req-cf1d69a0-7dfa-455f-97e7-08160b382781 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:03.956763 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd66c769-547d-4f93-b943-a10a4c11642a req-cf1d69a0-7dfa-455f-97e7-08160b382781 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 931 time: 0.0931077 May 12 16:19:03.964916 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-646676d3-f21d-4b3a-a508-e499d3dadb6f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8955517 May 12 16:19:03.990098 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Request body: {'port': {'device_id': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:19:04.002293 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-52402a08-9be0-494e-9693-01cfe41d1efe None None] Provisioning for port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:19:04.004875 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dd66c769-547d-4f93-b943-a10a4c11642a req-9e76e43c-f4c3-4395-baca-e5bb1511dd63 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423326 May 12 16:19:04.008362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-52402a08-9be0-494e-9693-01cfe41d1efe None None] Provisioning complete for port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:19:04.008931 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-52402a08-9be0-494e-9693-01cfe41d1efe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:04.063218 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-52402a08-9be0-494e-9693-01cfe41d1efe None None] Port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:19:04.100201 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:04.453182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:19:04.460231 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:04.475183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Transition to ACTIVE for port object f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:19:04.478876 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:04.610516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Pushing event updated for resources: {'Port': ['ID=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:19:04.720557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f75bf229-1094-49d7-b40a-d35bfb3b2291 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:19:04.722223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Attempting to bind port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:19:04.722558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Attempting to bind port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:19:04.722903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Attempting to bind port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 on network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:19:04.727654 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 on network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:19:04.727973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Attempting to bind port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 on network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:19:04.733625 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 18, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:19:04.733964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Checking segment: {'id': '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:19:04.734347 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Bound using segment: {'id': '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:19:04.734774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Bound port: f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:19:04.735119 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:04.810960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port f75bf229-1094-49d7-b40a-d35bfb3b2291 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:19:04.816277 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f75bf229-1094-49d7-b40a-d35bfb3b2291 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:19:04.817210 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:04.831122 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] For port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:19:04.834311 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] For port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6,segment=NetworkSegment(1bc9de87-b4ce-4d74-ba44-5f4632eb4d54),segment_id=1bc9de87-b4ce-4d74-ba44-5f4632eb4d54)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:19:04.838378 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:04.899893 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:04.900504 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:04.902118 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] 10.222.0.84 "PUT /v2.0/ports/f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 HTTP/1.1" status: 200 len: 1091 time: 0.9161112 May 12 16:19:04.902571 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'tag': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:19:04.932314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a4893dc-2378-4845-a3f9-fc8b867c5975 service neutron] Pushing event updated for resources: {'Port': ['ID=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:19:04.948608 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:04.984863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port f75bf229-1094-49d7-b40a-d35bfb3b2291, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f75bf229-1094-49d7-b40a-d35bfb3b2291,segment=NetworkSegment(1bc9de87-b4ce-4d74-ba44-5f4632eb4d54),segment_id=1bc9de87-b4ce-4d74-ba44-5f4632eb4d54)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:19:04.989874 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ec6193bd-485b-45e9-9f51-b4e3888d3bb9'] response: {'name': 'network-changed', 'server_uuid': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'tag': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6', 'status': 'completed', 'code': 200} May 12 16:19:04.990075 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:05.086288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=f75bf229-1094-49d7-b40a-d35bfb3b2291,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:19:05.094429 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-61d23681-fb69-42c1-957b-e8569a14a8b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:05.095938 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-61d23681-fb69-42c1-957b-e8569a14a8b1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 1094 time: 0.0890338 May 12 16:19:05.181804 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-fde769f6-00a1-415b-bf05-24fff1fb6d7a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 HTTP/1.1" status: 200 len: 217 time: 0.0667324 May 12 16:19:05.214698 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-390f62c2-b3a4-490d-a2e0-b90e7cc7595a req-e1ba912f-238f-4c76-ab19-b994af89ad73 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:05.217445 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-390f62c2-b3a4-490d-a2e0-b90e7cc7595a req-e1ba912f-238f-4c76-ab19-b994af89ad73 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 943 time: 0.0837073 May 12 16:19:05.248056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-88cd391d-73bc-4ae1-8f3b-a31edee772d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:05.249422 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-88cd391d-73bc-4ae1-8f3b-a31edee772d7 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=20c35ef1-b8b6-4700-a771-63fc5ceeef17 HTTP/1.1" status: 200 len: 834 time: 0.0589488 May 12 16:19:05.268273 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-390f62c2-b3a4-490d-a2e0-b90e7cc7595a req-f6aa3e61-e3cf-4af1-8a66-3f453db44ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438898 May 12 16:19:05.327592 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-e9deccd2-bf1e-4e38-9bb5-ca66e7b2ccdd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:05.329065 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-e9deccd2-bf1e-4e38-9bb5-ca66e7b2ccdd service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5f507fb1-efe4-49a5-8ce7-83e6efe3b99d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0705440 May 12 16:19:05.461637 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-0faf2b94-5c92-4acb-ab6c-98aa8203cfce service neutron] 10.222.0.84 "GET /v2.0/networks/5f507fb1-efe4-49a5-8ce7-83e6efe3b99d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1230655 May 12 16:19:05.598002 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c40135d8-605d-4e2d-a7ca-03834c058f6a req-023a8812-0791-4c71-a847-ce458233b7f7 service neutron] 10.222.0.84 "GET /v2.0/networks/5f507fb1-efe4-49a5-8ce7-83e6efe3b99d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1295326 May 12 16:19:05.770836 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2244d147-d85f-480a-a169-38e8ff6c238a req-05483e9b-bd6f-49ac-b86b-dce777f634e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:05.772296 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2244d147-d85f-480a-a169-38e8ff6c238a req-05483e9b-bd6f-49ac-b86b-dce777f634e4 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 1094 time: 0.0733998 May 12 16:19:06.010418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2244d147-d85f-480a-a169-38e8ff6c238a req-2dfa9947-a21d-40dd-99a5-109a7c89d2bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:06.011849 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2244d147-d85f-480a-a169-38e8ff6c238a req-2dfa9947-a21d-40dd-99a5-109a7c89d2bf service neutron] 10.222.0.84 "GET /v2.0/networks?id=5f507fb1-efe4-49a5-8ce7-83e6efe3b99d HTTP/1.1" status: 200 len: 898 time: 0.2336440 May 12 16:19:06.078864 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2244d147-d85f-480a-a169-38e8ff6c238a req-fb792dd1-2e7b-4cfb-bf1c-a876d9f795ec service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 HTTP/1.1" status: 200 len: 217 time: 0.0602441 May 12 16:19:06.143777 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2244d147-d85f-480a-a169-38e8ff6c238a req-701669ec-fa99-4d99-9f7d-9d1ff8544832 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:06.145164 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2244d147-d85f-480a-a169-38e8ff6c238a req-701669ec-fa99-4d99-9f7d-9d1ff8544832 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=20c35ef1-b8b6-4700-a771-63fc5ceeef17 HTTP/1.1" status: 200 len: 834 time: 0.0592847 May 12 16:19:06.220488 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2244d147-d85f-480a-a169-38e8ff6c238a req-c57cdcda-5462-40dc-ab4e-92478d3f366b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:06.221887 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2244d147-d85f-480a-a169-38e8ff6c238a req-c57cdcda-5462-40dc-ab4e-92478d3f366b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5f507fb1-efe4-49a5-8ce7-83e6efe3b99d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0702124 May 12 16:19:06.358410 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2244d147-d85f-480a-a169-38e8ff6c238a req-af6f83ef-e466-43b2-81ab-6293a5b223c4 service neutron] 10.222.0.84 "GET /v2.0/networks/5f507fb1-efe4-49a5-8ce7-83e6efe3b99d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1296327 May 12 16:19:06.455475 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2db52fb1-3152-4496-b629-b1f45243a904 req-ce3b15b8-4bf8-4c97-9a47-ebbaf1bfccb6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:06.456913 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2db52fb1-3152-4496-b629-b1f45243a904 req-ce3b15b8-4bf8-4c97-9a47-ebbaf1bfccb6 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 943 time: 0.0794327 May 12 16:19:06.499402 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2244d147-d85f-480a-a169-38e8ff6c238a req-77debd72-4bbf-4834-bff2-037b599ed511 service neutron] 10.222.0.84 "GET /v2.0/networks/5f507fb1-efe4-49a5-8ce7-83e6efe3b99d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1341040 May 12 16:19:06.503798 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2db52fb1-3152-4496-b629-b1f45243a904 req-3b262c61-35bb-4fe7-85b2-cebd6f325d09 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407550 May 12 16:19:06.673045 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f75bf229-1094-49d7-b40a-d35bfb3b2291 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:19:06.742232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port f75bf229-1094-49d7-b40a-d35bfb3b2291 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:19:06.742601 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:07.796501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9ee16fe-f73f-4f31-ae4a-466676e293dc req-00144991-e901-4cd4-9c0b-1d0db54e15c2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:07.797864 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9ee16fe-f73f-4f31-ae4a-466676e293dc req-00144991-e901-4cd4-9c0b-1d0db54e15c2 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 943 time: 0.1868198 May 12 16:19:07.842594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c9ee16fe-f73f-4f31-ae4a-466676e293dc req-e3766782-4873-43fc-be7f-ab3e8eaff621 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0383463 May 12 16:19:08.753484 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:19:08.889251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6,segment=NetworkSegment(1bc9de87-b4ce-4d74-ba44-5f4632eb4d54),segment_id=1bc9de87-b4ce-4d74-ba44-5f4632eb4d54)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:19:08.902482 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'port_id': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6', 'mac_address': 'fa:16:3e:06:51:bc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 566, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:19:08.964920 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:08.984745 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:19:09.001994 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6,segment=NetworkSegment(1bc9de87-b4ce-4d74-ba44-5f4632eb4d54),segment_id=1bc9de87-b4ce-4d74-ba44-5f4632eb4d54)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:19:09.006711 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:09.035055 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6d4653d-0779-4eb7-b80e-28e549c8b66d req-04d88e7d-98ba-496e-8896-ec070979cc5c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:09.036976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6d4653d-0779-4eb7-b80e-28e549c8b66d req-04d88e7d-98ba-496e-8896-ec070979cc5c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 943 time: 0.0844409 May 12 16:19:09.088862 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c6d4653d-0779-4eb7-b80e-28e549c8b66d req-b9047ebd-24c2-4ce6-81f1-f108646e028d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458610 May 12 16:19:09.092072 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:19:09.356139 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:19:10.278741 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ba2c51-d55f-4add-bfe1-26c167de30ea req-65f1b282-2d37-41f1-859b-058203fde171 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:10.280946 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3ba2c51-d55f-4add-bfe1-26c167de30ea req-65f1b282-2d37-41f1-859b-058203fde171 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 944 time: 0.0816674 May 12 16:19:10.344226 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3ba2c51-d55f-4add-bfe1-26c167de30ea req-9e80e4b9-821f-4755-9988-293328a23102 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0549839 May 12 16:19:10.755281 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:19:10.823323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:19:10.829147 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:19:10.829542 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:10.944627 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:10.972373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:19:10.982356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6,segment=NetworkSegment(1bc9de87-b4ce-4d74-ba44-5f4632eb4d54),segment_id=1bc9de87-b4ce-4d74-ba44-5f4632eb4d54)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:19:10.986902 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:11.056027 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:19:11.065999 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-335ec44b-2da0-442a-9e02-ad90f0e6106e'] response: {'server_uuid': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6', 'code': 200} May 12 16:19:11.228873 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641b2cea-71ea-494e-b9e1-aa2155d3809c req-8b105ccf-ef2c-417e-929b-49b7d1d1896d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:11.230368 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-641b2cea-71ea-494e-b9e1-aa2155d3809c req-8b105ccf-ef2c-417e-929b-49b7d1d1896d service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 1096 time: 0.0765200 May 12 16:19:11.273393 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-641b2cea-71ea-494e-b9e1-aa2155d3809c req-3351edd6-ef9f-4a5d-b7c1-458b33d02d29 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0341380 May 12 16:19:11.534239 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-686633e7-d1f3-414e-a8e0-1347686f604c req-46a8ff42-3bc2-40b3-baed-d4a80ff00ec8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:11.535653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-686633e7-d1f3-414e-a8e0-1347686f604c req-46a8ff42-3bc2-40b3-baed-d4a80ff00ec8 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 945 time: 0.0814288 May 12 16:19:11.579825 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-686633e7-d1f3-414e-a8e0-1347686f604c req-adf5b693-0d86-451c-b03c-ec67d21f0528 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385029 May 12 16:19:11.962383 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:19:12.770444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5031e72d-2a99-4201-bbb3-7f65df7e0f17 req-8e98f7dc-100f-45bb-a100-0307353d4388 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:12.774108 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5031e72d-2a99-4201-bbb3-7f65df7e0f17 req-8e98f7dc-100f-45bb-a100-0307353d4388 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 945 time: 0.0817053 May 12 16:19:12.825950 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5031e72d-2a99-4201-bbb3-7f65df7e0f17 req-cee9628c-a570-4bc0-9db8-bf51ab503bee tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478623 May 12 16:19:12.890110 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2c3249f4-68fc-4c27-bd8a-170047c644b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:13.013170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb0e857d-bce8-4ada-a283-18c5c1ea592d req-69fe5e01-32ef-491a-8e82-beb94d444afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:13.014633 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb0e857d-bce8-4ada-a283-18c5c1ea592d req-69fe5e01-32ef-491a-8e82-beb94d444afe tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 945 time: 0.0840030 May 12 16:19:13.058238 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb0e857d-bce8-4ada-a283-18c5c1ea592d req-54f2b843-5e52-4241-9b04-c1b2ad0472ec tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0379264 May 12 16:19:13.080963 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56290) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:19:13.150003 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55e7b1be-cab8-447d-82ec-5c3edfb3481d tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:13.151386 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-55e7b1be-cab8-447d-82ec-5c3edfb3481d tempest-TestNetworkAdvancedServerOps-2046968894 tempest-TestNetworkAdvancedServerOps-2046968894-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 1091 time: 0.0694458 May 12 16:19:13.154258 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56294) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:19:13.159835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address': '172.20.0.3'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:19:13.166286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:19:13.170049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Usage tracker for resource:floatingip and tenant:f50049e6814046a9abf21905584f94e1 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:19:13.173316 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:19:13.178953 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:19:13.189225 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:13.330292 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:13.466663 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Allocated IP 172.25.8.63 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/c6433f78-817b-4b43-8449-cb3bd0390c43) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:19:13.613576 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:13.642103 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:13.709969 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:19:13.712920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:19:13.716526 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:19:13.753300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=c6433f78-817b-4b43-8449-cb3bd0390c43,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:19:13.806580 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:14.148784 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:14.231913 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:14.541695 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:14.546204 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:14.664002 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event updated for resources: {'Port': ['ID=c6433f78-817b-4b43-8449-cb3bd0390c43,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:19:14.670137 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:14.840024 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Floating IP a62ba147-6a77-4145-b81a-6bd1a8ab8c7f associated. External IP: 172.25.8.63, port: f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6. May 12 16:19:15.184721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router baf71ae2-a221-4e92-8239-9d929dd78bc7 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:19:15.363282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:19:15.373028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b71307fe-0bef-488f-b97f-dcd94be822e5 None None] Sync routers for ids ['baf71ae2-a221-4e92-8239-9d929dd78bc7'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:19:15.382323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b71307fe-0bef-488f-b97f-dcd94be822e5 None None] Routers {'baf71ae2-a221-4e92-8239-9d929dd78bc7'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:19:15.382927 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b71307fe-0bef-488f-b97f-dcd94be822e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:18:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['baf71ae2-a221-4e92-8239-9d929dd78bc7'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:19:15.388226 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:15.447694 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-24cbf653-56a5-431a-84c4-143e64a29000 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.2920368 May 12 16:19:15.448201 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'tag': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:19:15.493775 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8455ea85-86f4-4fef-8596-b9fe3caee00a'] response: {'name': 'network-changed', 'server_uuid': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'tag': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6', 'status': 'completed', 'code': 200} May 12 16:19:15.558970 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d663c1c3-c691-420e-a3d3-9df7b334e87a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:15.581244 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b71307fe-0bef-488f-b97f-dcd94be822e5 None None] Set router baf71ae2-a221-4e92-8239-9d929dd78bc7 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:19:15.619839 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66fdcc09-defd-4640-a516-f03cf94b3812 req-293d26b7-52f5-407b-be23-c72a07832809 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:15.620164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59eb5591-5a6b-4f6d-86d4-9ef9f175d2c2 req-47312a3b-6fa1-49df-9045-078c4fb8d8b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:15.621501 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66fdcc09-defd-4640-a516-f03cf94b3812 req-293d26b7-52f5-407b-be23-c72a07832809 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 945 time: 0.0860322 May 12 16:19:15.622428 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59eb5591-5a6b-4f6d-86d4-9ef9f175d2c2 req-47312a3b-6fa1-49df-9045-078c4fb8d8b2 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 1096 time: 0.0839496 May 12 16:19:15.668548 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-66fdcc09-defd-4640-a516-f03cf94b3812 req-d29a1d1a-b6e9-4a69-935e-20e786e8b4ff tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403388 May 12 16:19:15.693245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56304) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:19:15.764050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59eb5591-5a6b-4f6d-86d4-9ef9f175d2c2 req-6c26897f-fcf6-4c71-b4a9-777da04e70e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:15.765536 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59eb5591-5a6b-4f6d-86d4-9ef9f175d2c2 req-6c26897f-fcf6-4c71-b4a9-777da04e70e8 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5f507fb1-efe4-49a5-8ce7-83e6efe3b99d HTTP/1.1" status: 200 len: 898 time: 0.1368399 May 12 16:19:15.802299 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c785eeb4-f8cc-452d-8a8c-d4dc73a034c3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/a62ba147-6a77-4145-b81a-6bd1a8ab8c7f HTTP/1.1" status: 200 len: 990 time: 0.1073129 May 12 16:19:15.875649 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59eb5591-5a6b-4f6d-86d4-9ef9f175d2c2 req-264370a3-1612-4660-bae6-d29f9ec23209 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 HTTP/1.1" status: 200 len: 998 time: 0.1041563 May 12 16:19:15.941229 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59eb5591-5a6b-4f6d-86d4-9ef9f175d2c2 req-bc125d21-cb0d-4343-8aaf-201465255822 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:15.942724 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59eb5591-5a6b-4f6d-86d4-9ef9f175d2c2 req-bc125d21-cb0d-4343-8aaf-201465255822 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=20c35ef1-b8b6-4700-a771-63fc5ceeef17 HTTP/1.1" status: 200 len: 834 time: 0.0619545 May 12 16:19:15.947826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b71307fe-0bef-488f-b97f-dcd94be822e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:18:59Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:19:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'a62ba147-6a77-4145-b81a-6bd1a8ab8c7f', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.63', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'port_id': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 4365, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'mac_address': 'fa:16:3e:06:51:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:19:14Z', 'updated_at': '2022-05-12T16:19:14Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f75bf229-1094-49d7-b40a-d35bfb3b2291', 'name': '', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:af:12:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:58Z', 'updated_at': '2022-05-12T16:19:04Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:19:15.951705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b71307fe-0bef-488f-b97f-dcd94be822e5 None None] Checking router: baf71ae2-a221-4e92-8239-9d929dd78bc7 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:19:15.960090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b71307fe-0bef-488f-b97f-dcd94be822e5 None None] Routers {'baf71ae2-a221-4e92-8239-9d929dd78bc7'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:19:15.960673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b71307fe-0bef-488f-b97f-dcd94be822e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:19:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['baf71ae2-a221-4e92-8239-9d929dd78bc7'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:19:16.017146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59eb5591-5a6b-4f6d-86d4-9ef9f175d2c2 req-1e8a8186-ae2e-4cf6-ae37-f6bad53f3141 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:16.018568 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59eb5591-5a6b-4f6d-86d4-9ef9f175d2c2 req-1e8a8186-ae2e-4cf6-ae37-f6bad53f3141 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5f507fb1-efe4-49a5-8ce7-83e6efe3b99d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0701523 May 12 16:19:16.139673 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-b71307fe-0bef-488f-b97f-dcd94be822e5 None None] Set router baf71ae2-a221-4e92-8239-9d929dd78bc7 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:19:16.152550 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59eb5591-5a6b-4f6d-86d4-9ef9f175d2c2 req-d95ade98-f564-454f-8fcd-e250f10c21f7 service neutron] 10.222.0.84 "GET /v2.0/networks/5f507fb1-efe4-49a5-8ce7-83e6efe3b99d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1275835 May 12 16:19:16.215533 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:16.288413 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-59eb5591-5a6b-4f6d-86d4-9ef9f175d2c2 req-a4f5abe5-4d3d-4081-9daa-459896e57168 service neutron] 10.222.0.84 "GET /v2.0/networks/5f507fb1-efe4-49a5-8ce7-83e6efe3b99d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1296527 May 12 16:19:16.454248 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:16.551107 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-b71307fe-0bef-488f-b97f-dcd94be822e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:18:59Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:19:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'a62ba147-6a77-4145-b81a-6bd1a8ab8c7f', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.63', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'port_id': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 4365, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'mac_address': 'fa:16:3e:06:51:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:19:14Z', 'updated_at': '2022-05-12T16:19:14Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f75bf229-1094-49d7-b40a-d35bfb3b2291', 'name': '', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:af:12:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:58Z', 'updated_at': '2022-05-12T16:19:04Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:19:16.554962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b71307fe-0bef-488f-b97f-dcd94be822e5 None None] The sync data for ids ['baf71ae2-a221-4e92-8239-9d929dd78bc7'] in n-d-841483-1 is: [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:18:59Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:19:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'a62ba147-6a77-4145-b81a-6bd1a8ab8c7f', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'floating_ip_address': '172.25.8.63', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'port_id': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 4365, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'mac_address': 'fa:16:3e:06:51:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:19:14Z', 'updated_at': '2022-05-12T16:19:14Z', 'revision_number': 0, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f75bf229-1094-49d7-b40a-d35bfb3b2291', 'name': '', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:af:12:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:58Z', 'updated_at': '2022-05-12T16:19:04Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:19:16.746887 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7154b9c1-acae-4e8a-9781-dd3ce2a3e529 None None] New status for floating IP a62ba147-6a77-4145-b81a-6bd1a8ab8c7f: ACTIVE {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:19:16.805453 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56308) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:19:17.035736 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ec31c9f7-1629-4928-8d49-3b130a02418c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/a62ba147-6a77-4145-b81a-6bd1a8ab8c7f HTTP/1.1" status: 200 len: 990 time: 0.2292106 May 12 16:19:17.908549 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:18.039072 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56312) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:19:18.146987 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-b9a680e3-9209-49b3-8b56-8f8d1b6e6e0f tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/a62ba147-6a77-4145-b81a-6bd1a8ab8c7f HTTP/1.1" status: 200 len: 992 time: 0.1068506 May 12 16:19:32.975389 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:40.283833 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f693ac5e-baa8-4d27-94e3-13a2c314b4ec req-f49a456e-eab3-478b-a282-c194e7f6f60a service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0525260 May 12 16:19:40.400083 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f693ac5e-baa8-4d27-94e3-13a2c314b4ec req-1d9be7e4-fb77-413b-bd50-f46fb14ca88f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0475781 May 12 16:19:40.443036 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f693ac5e-baa8-4d27-94e3-13a2c314b4ec req-77b1ba6d-39e8-4319-83d3-5fa0d363afd9 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0248086 May 12 16:19:40.693021 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f693ac5e-baa8-4d27-94e3-13a2c314b4ec req-9ee0464b-1ad2-4733-9b22-b2a228554aff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:40.694488 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f693ac5e-baa8-4d27-94e3-13a2c314b4ec req-9ee0464b-1ad2-4733-9b22-b2a228554aff service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2455540 May 12 16:19:42.893718 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-650816a4-58b5-4565-95d7-2aa526721b4b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:43.805837 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:45.422306 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1f9373f2-c7a5-4f5b-9de8-8d846a8d5d8c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:46.158669 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:46.441067 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:47.913314 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:48.961473 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:19:51.835206 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd99f5b9-75da-4a19-b3d2-ca0922d786cb req-39157f84-88e2-4a58-bd29-af6e770ece0d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:51.836689 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd99f5b9-75da-4a19-b3d2-ca0922d786cb req-39157f84-88e2-4a58-bd29-af6e770ece0d tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 945 time: 0.0807226 May 12 16:19:51.880893 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd99f5b9-75da-4a19-b3d2-ca0922d786cb req-9e22526d-dd17-4d12-add4-fb9278f2fe09 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0379162 May 12 16:19:53.066491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5490379c-ce1c-4f1d-8d8e-2e3c4e3aa8cc req-c90e8450-aa3a-4376-a3fd-2c509b2ec478 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:53.067899 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5490379c-ce1c-4f1d-8d8e-2e3c4e3aa8cc req-c90e8450-aa3a-4376-a3fd-2c509b2ec478 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 945 time: 0.0817688 May 12 16:19:53.110625 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5490379c-ce1c-4f1d-8d8e-2e3c4e3aa8cc req-9e0b413b-4e7a-43cd-92c7-bf8604aeaab7 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0368676 May 12 16:19:53.136250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56334) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:19:53.249571 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-0cace7e3-8760-4a05-882e-c41c3b2312af tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/a62ba147-6a77-4145-b81a-6bd1a8ab8c7f HTTP/1.1" status: 200 len: 992 time: 0.1119964 May 12 16:19:54.718363 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23296b6-07c8-4691-9ecc-001f762d3932 req-5d7132be-3266-4d1c-a1aa-f546fd209d32 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:54.719928 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a23296b6-07c8-4691-9ecc-001f762d3932 req-5d7132be-3266-4d1c-a1aa-f546fd209d32 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 945 time: 0.0880675 May 12 16:19:54.764957 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a23296b6-07c8-4691-9ecc-001f762d3932 req-34b78869-0c6b-412d-8c33-9f9995f6efb0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393913 May 12 16:19:54.765409 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4611fe0-8fca-4d72-97ec-c7409cbc74b4 req-ff7cb2ba-b522-43de-bd65-4734fd7098b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:54.766874 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4611fe0-8fca-4d72-97ec-c7409cbc74b4 req-ff7cb2ba-b522-43de-bd65-4734fd7098b0 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 1096 time: 0.0708706 May 12 16:19:54.902525 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4611fe0-8fca-4d72-97ec-c7409cbc74b4 req-d12bec35-d74c-4595-9656-7488590b305b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:54.903867 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4611fe0-8fca-4d72-97ec-c7409cbc74b4 req-d12bec35-d74c-4595-9656-7488590b305b service neutron] 10.222.0.84 "GET /v2.0/networks?id=5f507fb1-efe4-49a5-8ce7-83e6efe3b99d HTTP/1.1" status: 200 len: 898 time: 0.1276960 May 12 16:19:55.010886 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4611fe0-8fca-4d72-97ec-c7409cbc74b4 req-319c9aad-8772-4fcc-855d-86620fb68bca service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 HTTP/1.1" status: 200 len: 1000 time: 0.0974257 May 12 16:19:55.080378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4611fe0-8fca-4d72-97ec-c7409cbc74b4 req-900ec648-300f-4e54-ae16-60d5fe3c892b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:55.081799 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4611fe0-8fca-4d72-97ec-c7409cbc74b4 req-900ec648-300f-4e54-ae16-60d5fe3c892b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=20c35ef1-b8b6-4700-a771-63fc5ceeef17 HTTP/1.1" status: 200 len: 834 time: 0.0606089 May 12 16:19:55.160052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4611fe0-8fca-4d72-97ec-c7409cbc74b4 req-f91a4674-22cd-41e0-9f1f-d7c0272bccef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:55.161472 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4611fe0-8fca-4d72-97ec-c7409cbc74b4 req-f91a4674-22cd-41e0-9f1f-d7c0272bccef service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5f507fb1-efe4-49a5-8ce7-83e6efe3b99d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0708089 May 12 16:19:55.301401 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4611fe0-8fca-4d72-97ec-c7409cbc74b4 req-231d400e-5064-4136-8136-e5a0982e83a1 service neutron] 10.222.0.84 "GET /v2.0/networks/5f507fb1-efe4-49a5-8ce7-83e6efe3b99d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1304631 May 12 16:19:55.438864 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d4611fe0-8fca-4d72-97ec-c7409cbc74b4 req-b6120cf3-a3ac-4ed7-a92c-74ba1aa501f0 service neutron] 10.222.0.84 "GET /v2.0/networks/5f507fb1-efe4-49a5-8ce7-83e6efe3b99d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1285620 May 12 16:19:55.956018 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f620c19-3d02-4973-aa17-41581c748819 req-b234faba-ad48-4708-9867-a0bd7170dfca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:55.957480 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0f620c19-3d02-4973-aa17-41581c748819 req-b234faba-ad48-4708-9867-a0bd7170dfca tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 945 time: 0.0824711 May 12 16:19:56.000809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0f620c19-3d02-4973-aa17-41581c748819 req-0ef8a1d0-7f35-4f95-a982-58ec70fb1bea tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0376818 May 12 16:19:57.187050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b68b4c3-adb7-4849-b708-382c7f499d6c req-1da6be0d-e126-42d8-872b-583f28c1843c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:57.188487 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b68b4c3-adb7-4849-b708-382c7f499d6c req-1da6be0d-e126-42d8-872b-583f28c1843c tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 945 time: 0.0791690 May 12 16:19:57.236124 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-4b68b4c3-adb7-4849-b708-382c7f499d6c req-4d3b4437-f020-4476-b15c-c863895fd7d5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420134 May 12 16:19:57.259445 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56348) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:19:57.369342 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-18106034-740d-4951-966c-522f8b860795 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/floatingips/a62ba147-6a77-4145-b81a-6bd1a8ab8c7f HTTP/1.1" status: 200 len: 992 time: 0.1087039 May 12 16:19:57.664661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56356) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:19:57.865364 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port c6433f78-817b-4b43-8449-cb3bd0390c43 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:19:57.865734 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:58.030279 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:58.030600 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:58.150453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for c6433f78-817b-4b43-8449-cb3bd0390c43 owned by network:floatingip {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:19:58.300545 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:58.350768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=c6433f78-817b-4b43-8449-cb3bd0390c43,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:19:58.514984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:58.515330 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:58.515669 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:58.516004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:58.516334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:58.516661 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:58.516984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:58.517308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:58.517652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:58.517971 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:58.518288 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:58.518600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:19:58.575661 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for floatingip, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:58.575912 n-d-841483-1 neutron-server[88151]: INFO neutron.db.l3_db [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Floating IP a62ba147-6a77-4145-b81a-6bd1a8ab8c7f disassociated (deleted). External IP: 172.25.8.63, port: f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6. May 12 16:19:58.948179 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router baf71ae2-a221-4e92-8239-9d929dd78bc7 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:19:59.129054 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:19:59.139373 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba7d6068-3620-45d8-8da4-23cc44e85309 None None] Sync routers for ids ['baf71ae2-a221-4e92-8239-9d929dd78bc7'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:19:59.146148 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:19:59.148705 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba7d6068-3620-45d8-8da4-23cc44e85309 None None] Routers {'baf71ae2-a221-4e92-8239-9d929dd78bc7'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:19:59.149310 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ba7d6068-3620-45d8-8da4-23cc44e85309 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:19:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['baf71ae2-a221-4e92-8239-9d929dd78bc7'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:19:59.211818 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bad22623-f032-4956-a523-0aac6b2ab627 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/floatingips/a62ba147-6a77-4145-b81a-6bd1a8ab8c7f HTTP/1.1" status: 204 len: 168 time: 1.5437417 May 12 16:19:59.211818 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'tag': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:19:59.273464 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1cde5208-35c5-451a-8ca9-11210beead90'] response: {'name': 'network-changed', 'server_uuid': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'tag': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6', 'status': 'completed', 'code': 200} May 12 16:19:59.336402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ba7d6068-3620-45d8-8da4-23cc44e85309 None None] Set router baf71ae2-a221-4e92-8239-9d929dd78bc7 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:19:59.402500 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3beafc0a-8fde-4857-9822-5557172abb98 req-b51cbc0d-1b9e-4771-ad87-a2b81f7b83f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:59.404012 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3beafc0a-8fde-4857-9822-5557172abb98 req-b51cbc0d-1b9e-4771-ad87-a2b81f7b83f9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=f50049e6814046a9abf21905584f94e1&device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 1096 time: 0.0751145 May 12 16:19:59.557158 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3beafc0a-8fde-4857-9822-5557172abb98 req-e779a981-2044-414c-ac30-19ad4d6fe552 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:59.558678 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3beafc0a-8fde-4857-9822-5557172abb98 req-e779a981-2044-414c-ac30-19ad4d6fe552 service neutron] 10.222.0.84 "GET /v2.0/networks?id=5f507fb1-efe4-49a5-8ce7-83e6efe3b99d HTTP/1.1" status: 200 len: 898 time: 0.1452663 May 12 16:19:59.626284 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec871a59-ec20-4b11-86d4-349450666d23 req-27a77781-73eb-4e52-9e2f-52fb9eae4753 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:59.628965 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec871a59-ec20-4b11-86d4-349450666d23 req-27a77781-73eb-4e52-9e2f-52fb9eae4753 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 945 time: 0.0932267 May 12 16:19:59.634555 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3beafc0a-8fde-4857-9822-5557172abb98 req-f56f0ffa-bd8c-455b-b443-35722beaf92f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 HTTP/1.1" status: 200 len: 217 time: 0.0680377 May 12 16:19:59.664829 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ba7d6068-3620-45d8-8da4-23cc44e85309 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:18:59Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:19:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'f75bf229-1094-49d7-b40a-d35bfb3b2291', 'name': '', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:af:12:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:58Z', 'updated_at': '2022-05-12T16:19:04Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:19:59.669195 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba7d6068-3620-45d8-8da4-23cc44e85309 None None] Checking router: baf71ae2-a221-4e92-8239-9d929dd78bc7 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:19:59.676695 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ec871a59-ec20-4b11-86d4-349450666d23 req-7556ac1b-3b56-4591-b14b-0c6afbbb4308 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417638 May 12 16:19:59.678663 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba7d6068-3620-45d8-8da4-23cc44e85309 None None] Routers {'baf71ae2-a221-4e92-8239-9d929dd78bc7'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:19:59.679263 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ba7d6068-3620-45d8-8da4-23cc44e85309 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:19:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['baf71ae2-a221-4e92-8239-9d929dd78bc7'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:19:59.703794 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3beafc0a-8fde-4857-9822-5557172abb98 req-8df5be54-4e61-4152-9750-2c4bec343c5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:59.705242 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3beafc0a-8fde-4857-9822-5557172abb98 req-8df5be54-4e61-4152-9750-2c4bec343c5e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=20c35ef1-b8b6-4700-a771-63fc5ceeef17 HTTP/1.1" status: 200 len: 834 time: 0.0647173 May 12 16:19:59.778136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3beafc0a-8fde-4857-9822-5557172abb98 req-3cba3971-4e90-4cbe-a588-afb0dd8be6de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:19:59.780191 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3beafc0a-8fde-4857-9822-5557172abb98 req-3cba3971-4e90-4cbe-a588-afb0dd8be6de service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=5f507fb1-efe4-49a5-8ce7-83e6efe3b99d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0685687 May 12 16:19:59.862820 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ba7d6068-3620-45d8-8da4-23cc44e85309 None None] Set router baf71ae2-a221-4e92-8239-9d929dd78bc7 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:19:59.912718 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3beafc0a-8fde-4857-9822-5557172abb98 req-6ee66bbd-84ec-449c-b62c-1d4d37f0798b service neutron] 10.222.0.84 "GET /v2.0/networks/5f507fb1-efe4-49a5-8ce7-83e6efe3b99d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1257052 May 12 16:20:00.045437 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3beafc0a-8fde-4857-9822-5557172abb98 req-1b4ada90-3c81-4709-a71d-5aa04c3717ea service neutron] 10.222.0.84 "GET /v2.0/networks/5f507fb1-efe4-49a5-8ce7-83e6efe3b99d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1254897 May 12 16:20:00.187197 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ba7d6068-3620-45d8-8da4-23cc44e85309 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:18:59Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:19:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'f75bf229-1094-49d7-b40a-d35bfb3b2291', 'name': '', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:af:12:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:58Z', 'updated_at': '2022-05-12T16:19:04Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:00.192571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba7d6068-3620-45d8-8da4-23cc44e85309 None None] The sync data for ids ['baf71ae2-a221-4e92-8239-9d929dd78bc7'] in n-d-841483-1 is: [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:18:59Z', 'revision_number': 4, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:19:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'f75bf229-1094-49d7-b40a-d35bfb3b2291', 'name': '', 'network_id': '5f507fb1-efe4-49a5-8ce7-83e6efe3b99d', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'mac_address': 'fa:16:3e:af:12:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:58Z', 'updated_at': '2022-05-12T16:19:04Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'subnets': [{'id': '20c35ef1-b8b6-4700-a771-63fc5ceeef17', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:20:00.411686 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56d1e10b-0fc3-4766-a5e3-e083426fff9f None None] New status for floating IP a62ba147-6a77-4145-b81a-6bd1a8ab8c7f: DOWN {{(pid=88154) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:20:00.866159 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73052f38-a68b-484b-a1f3-5229dbafe4c8 req-dcd7698a-faef-463b-9153-5b277a34befb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:00.867509 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73052f38-a68b-484b-a1f3-5229dbafe4c8 req-dcd7698a-faef-463b-9153-5b277a34befb tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 945 time: 0.0806882 May 12 16:20:00.913704 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73052f38-a68b-484b-a1f3-5229dbafe4c8 req-29c0f269-7f42-4390-bf7a-47fdb9fa4fa3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405309 May 12 16:20:01.551304 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de25f7b-2522-4b51-8561-705dba2299a5 req-73e36e21-ca1e-4934-9a01-a0d147f7f181 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:01.551897 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-3de25f7b-2522-4b51-8561-705dba2299a5 req-73e36e21-ca1e-4934-9a01-a0d147f7f181 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Synchronizing usage tracker for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:20:01.566785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-3de25f7b-2522-4b51-8561-705dba2299a5 req-73e36e21-ca1e-4934-9a01-a0d147f7f181 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Unset dirty status for tenant:f50049e6814046a9abf21905584f94e1 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:20:01.567880 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3de25f7b-2522-4b51-8561-705dba2299a5 req-73e36e21-ca1e-4934-9a01-a0d147f7f181 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 945 time: 0.2061133 May 12 16:20:01.637809 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-3de25f7b-2522-4b51-8561-705dba2299a5 req-f703b2a1-f9a7-45b8-b12d-5aac84074a75 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:20:01.638144 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3de25f7b-2522-4b51-8561-705dba2299a5 req-f703b2a1-f9a7-45b8-b12d-5aac84074a75 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:01.879885 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-3de25f7b-2522-4b51-8561-705dba2299a5 req-f703b2a1-f9a7-45b8-b12d-5aac84074a75 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6,segment=NetworkSegment(1bc9de87-b4ce-4d74-ba44-5f4632eb4d54),segment_id=1bc9de87-b4ce-4d74-ba44-5f4632eb4d54)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:01.880117 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3de25f7b-2522-4b51-8561-705dba2299a5 req-f703b2a1-f9a7-45b8-b12d-5aac84074a75 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:02.005684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-3de25f7b-2522-4b51-8561-705dba2299a5 req-f703b2a1-f9a7-45b8-b12d-5aac84074a75 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:20:02.101068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dcc12c3-0fc9-4b51-bb82-c1b1c2329091 req-ff00fd56-42ae-4246-a1ff-b9fadb1f7918 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:02.102876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dcc12c3-0fc9-4b51-bb82-c1b1c2329091 req-ff00fd56-42ae-4246-a1ff-b9fadb1f7918 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/ports?device_id=891e60d9-3e7a-4524-9b2e-34909128aa0e HTTP/1.1" status: 200 len: 945 time: 0.0825446 May 12 16:20:02.147112 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3dcc12c3-0fc9-4b51-bb82-c1b1c2329091 req-68c05289-95d8-412f-ae5e-74399cdb5fc5 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "GET /v2.0/security-groups?id=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0382895 May 12 16:20:02.150434 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3de25f7b-2522-4b51-8561-705dba2299a5 req-f703b2a1-f9a7-45b8-b12d-5aac84074a75 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:02.206465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f703b2a1-f9a7-45b8-b12d-5aac84074a75 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:02.283112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-3de25f7b-2522-4b51-8561-705dba2299a5 req-f703b2a1-f9a7-45b8-b12d-5aac84074a75 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] No DVR routers for this DVR port f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:20:02.285633 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-3de25f7b-2522-4b51-8561-705dba2299a5 req-f703b2a1-f9a7-45b8-b12d-5aac84074a75 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:02.288071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'name': 'network-vif-deleted', 'tag': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:20:02.303398 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3de25f7b-2522-4b51-8561-705dba2299a5 req-f703b2a1-f9a7-45b8-b12d-5aac84074a75 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.84 "DELETE /v2.0/ports/f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 HTTP/1.1" status: 204 len: 173 time: 0.7279904 May 12 16:20:02.336822 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6a9e9462-d9bb-43f0-ad21-e60a8e09d623'] response: {'server_uuid': '891e60d9-3e7a-4524-9b2e-34909128aa0e', 'name': 'network-vif-deleted', 'tag': 'f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6', 'status': 'completed', 'code': 200} May 12 16:20:02.991110 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:03.242543 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56374) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:03.787409 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ade0a4ba-2dd1-47fa-bc33-3df293ac6e44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:04.264303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ade0a4ba-2dd1-47fa-bc33-3df293ac6e44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port f75bf229-1094-49d7-b40a-d35bfb3b2291 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:20:04.264985 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ade0a4ba-2dd1-47fa-bc33-3df293ac6e44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:04.460326 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-ade0a4ba-2dd1-47fa-bc33-3df293ac6e44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port f75bf229-1094-49d7-b40a-d35bfb3b2291, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=f75bf229-1094-49d7-b40a-d35bfb3b2291,segment=NetworkSegment(1bc9de87-b4ce-4d74-ba44-5f4632eb4d54),segment_id=1bc9de87-b4ce-4d74-ba44-5f4632eb4d54)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:04.460684 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ade0a4ba-2dd1-47fa-bc33-3df293ac6e44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:04.584477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-ade0a4ba-2dd1-47fa-bc33-3df293ac6e44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for f75bf229-1094-49d7-b40a-d35bfb3b2291 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:20:04.913474 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ade0a4ba-2dd1-47fa-bc33-3df293ac6e44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:04.961939 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ade0a4ba-2dd1-47fa-bc33-3df293ac6e44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=f75bf229-1094-49d7-b40a-d35bfb3b2291,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:05.033571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:20:05.070626 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:20:05.070960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device f30801f2-41fc-4fb9-9bb2-d36a3d39f6b6 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:20:05.246744 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ade0a4ba-2dd1-47fa-bc33-3df293ac6e44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:05.724273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ade0a4ba-2dd1-47fa-bc33-3df293ac6e44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Router baf71ae2-a221-4e92-8239-9d929dd78bc7 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:20:05.898943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ade0a4ba-2dd1-47fa-bc33-3df293ac6e44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:20:05.908179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7a9b306-cf5f-4035-911f-509985a6066d None None] Sync routers for ids ['baf71ae2-a221-4e92-8239-9d929dd78bc7'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:20:05.911347 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ade0a4ba-2dd1-47fa-bc33-3df293ac6e44 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "PUT /v2.0/routers/baf71ae2-a221-4e92-8239-9d929dd78bc7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6677446 May 12 16:20:05.914128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56378) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:05.918060 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7a9b306-cf5f-4035-911f-509985a6066d None None] Routers {'baf71ae2-a221-4e92-8239-9d929dd78bc7'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:20:05.918951 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d7a9b306-cf5f-4035-911f-509985a6066d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:19:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['baf71ae2-a221-4e92-8239-9d929dd78bc7'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:05.988019 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting subnet 20c35ef1-b8b6-4700-a771-63fc5ceeef17 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:20:05.991558 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:06.048215 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:06.094916 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-d7a9b306-cf5f-4035-911f-509985a6066d None None] Set router baf71ae2-a221-4e92-8239-9d929dd78bc7 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:20:06.130784 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:06.208560 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:06.247549 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:06.260546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56382) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:06.260776 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/subnets/20c35ef1-b8b6-4700-a771-63fc5ceeef17 HTTP/1.1" status: 204 len: 168 time: 0.3452830 May 12 16:20:06.265622 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Subnet': ['ID=20c35ef1-b8b6-4700-a771-63fc5ceeef17,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:06.266761 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1663ee44-eb66-42b2-bf78-2dbc820ce76d None None] Network 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:20:06.273273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:06.273652 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:06.273988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:06.274318 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:06.274646 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:06.274971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:06.275296 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:06.275618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:06.275937 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:06.276262 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:06.276579 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:06.276895 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca365784-d124-4c7a-8fe5-694acd493084 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:06.463373 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:06.558567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d7a9b306-cf5f-4035-911f-509985a6066d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:20:04Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:19:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:06.563529 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7a9b306-cf5f-4035-911f-509985a6066d None None] Checking router: baf71ae2-a221-4e92-8239-9d929dd78bc7 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:20:06.573053 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7a9b306-cf5f-4035-911f-509985a6066d None None] Routers {'baf71ae2-a221-4e92-8239-9d929dd78bc7'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:20:06.573720 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d7a9b306-cf5f-4035-911f-509985a6066d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:19:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['baf71ae2-a221-4e92-8239-9d929dd78bc7'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:06.639046 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e615fe5-cea3-4eb0-976b-ffc67e339aae None None] DHCP port deletion for 5f507fb1-efe4-49a5-8ce7-83e6efe3b99d request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:20:06.649741 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:06.652090 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3e615fe5-cea3-4eb0-976b-ffc67e339aae None None] Deleting port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:20:06.652518 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3e615fe5-cea3-4eb0-976b-ffc67e339aae None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:06.664712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:20:06.665061 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:06.776144 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:20:06.856763 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=34a0ea4e-a639-4c4b-8fc3-8b2890e48a36,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:06.857964 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:06.980642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:20:07.020686 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-d7a9b306-cf5f-4035-911f-509985a6066d None None] Set router baf71ae2-a221-4e92-8239-9d929dd78bc7 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:20:07.150017 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:07.196000 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=34a0ea4e-a639-4c4b-8fc3-8b2890e48a36,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:07.322183 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:07.348487 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-3e615fe5-cea3-4eb0-976b-ffc67e339aae None None] For port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd,segment=NetworkSegment(1bc9de87-b4ce-4d74-ba44-5f4632eb4d54),segment_id=1bc9de87-b4ce-4d74-ba44-5f4632eb4d54)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:07.348879 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3e615fe5-cea3-4eb0-976b-ffc67e339aae None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:07.414092 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:07.490997 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3e615fe5-cea3-4eb0-976b-ffc67e339aae None None] Calling delete_port for 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:20:07.556872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd,segment=NetworkSegment(1bc9de87-b4ce-4d74-ba44-5f4632eb4d54),segment_id=1bc9de87-b4ce-4d74-ba44-5f4632eb4d54)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:07.579160 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:07.593702 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:07.595916 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:07.618972 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:07.619588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Fanout notify agent at l3_agent the message router_deleted on router baf71ae2-a221-4e92-8239-9d929dd78bc7 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:20:07.635458 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:07.636529 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9dd02343-d2fc-4697-a9e8-62c3d7406ca3 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/routers/baf71ae2-a221-4e92-8239-9d929dd78bc7 HTTP/1.1" status: 204 len: 168 time: 1.3741674 May 12 16:20:07.639830 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56386) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:07.709285 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-3e615fe5-cea3-4eb0-976b-ffc67e339aae None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:20:07.709581 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-3e615fe5-cea3-4eb0-976b-ffc67e339aae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:20:07.712565 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:07.722212 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:07.722583 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:07.722920 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:07.723251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:07.723577 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:07.723901 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:07.724222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:07.724544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:07.724859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:07.725175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:07.725534 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:07.725838 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:07.746607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-d7a9b306-cf5f-4035-911f-509985a6066d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:20:04Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:19:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:07.751887 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7a9b306-cf5f-4035-911f-509985a6066d None None] The sync data for ids ['baf71ae2-a221-4e92-8239-9d929dd78bc7'] in n-d-841483-1 is: [{'id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1715810619', 'tenant_id': 'f50049e6814046a9abf21905584f94e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93'}], 'enable_snat': True}, 'gw_port_id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:18:53Z', 'updated_at': '2022-05-12T16:20:04Z', 'revision_number': 5, 'project_id': 'f50049e6814046a9abf21905584f94e1', 'gw_port': {'id': '34a0ea4e-a639-4c4b-8fc3-8b2890e48a36', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4d:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'baf71ae2-a221-4e92-8239-9d929dd78bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4359, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:18:54Z', 'updated_at': '2022-05-12T16:19:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:20:07.759603 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:07.771084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Deleting port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:20:07.771425 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:07.975550 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] For port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd,segment=NetworkSegment(1bc9de87-b4ce-4d74-ba44-5f4632eb4d54),segment_id=1bc9de87-b4ce-4d74-ba44-5f4632eb4d54)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:07.976257 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:08.098024 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Calling delete_port for 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:20:08.179809 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:08.213764 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3e615fe5-cea3-4eb0-976b-ffc67e339aae None None] Deleting port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:20:08.214518 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3e615fe5-cea3-4eb0-976b-ffc67e339aae None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:08.229559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Port': ['ID=257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:08.233001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] No DVR routers for this DVR port 257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:20:08.297727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-3e615fe5-cea3-4eb0-976b-ffc67e339aae None None] The port '257f49ab-f4fd-4bfa-a75a-9f6729a1e2dd' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 16:20:08.371405 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:08.400984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5f507fb1-efe4-49a5-8ce7-83e6efe3b99d']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:08.411020 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:08.411315 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1bc9de87-b4ce-4d74-ba44-5f4632eb4d54') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:08.423259 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:08.442058 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:08.449182 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Releasing vlan 566 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:20:08.449611 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: timer() May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:20:08.464430 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:20:08.556070 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:08.573468 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:08.586056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'Network': ['ID=5f507fb1-efe4-49a5-8ce7-83e6efe3b99d,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:08.600438 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-fb8a0259-d5cb-4f43-b711-c1ef9de1b9d0 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/networks/5f507fb1-efe4-49a5-8ce7-83e6efe3b99d HTTP/1.1" status: 204 len: 168 time: 0.9595981 May 12 16:20:08.603264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56390) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:08.678063 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2f979b9-f490-4e5b-ad82-ba13680c5196 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:08.709212 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2f979b9-f490-4e5b-ad82-ba13680c5196 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:08.789683 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2f979b9-f490-4e5b-ad82-ba13680c5196 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:08.801683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:20:08.812920 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2f979b9-f490-4e5b-ad82-ba13680c5196 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a554ed5-5c12-41b6-80f7-c62af4cb9d6b,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:08.829178 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e2f979b9-f490-4e5b-ad82-ba13680c5196 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:08.830405 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e2f979b9-f490-4e5b-ad82-ba13680c5196 tempest-TestNetworkAdvancedServerOps-819063984 tempest-TestNetworkAdvancedServerOps-819063984-project] 10.222.0.82 "DELETE /v2.0/security-groups/7a554ed5-5c12-41b6-80f7-c62af4cb9d6b HTTP/1.1" status: 204 len: 168 time: 0.2262502 May 12 16:20:08.846858 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:20:08.847191 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 34a0ea4e-a639-4c4b-8fc3-8b2890e48a36 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:20:08.847589 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f75bf229-1094-49d7-b40a-d35bfb3b2291 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:20:08.884123 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: f75bf229-1094-49d7-b40a-d35bfb3b2291 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:20:08.884295 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device f75bf229-1094-49d7-b40a-d35bfb3b2291 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:20:09.210035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56400) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:09.359746 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d31a94b4-aff5-46b8-9910-8932a623f828 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f50049e6814046a9abf21905584f94e1&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1484692 May 12 16:20:09.362137 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56406) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:09.418290 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-003d26d6-7cb3-4f26-a2b7-943e3a8c5575 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:09.442973 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-003d26d6-7cb3-4f26-a2b7-943e3a8c5575 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:09.495754 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-003d26d6-7cb3-4f26-a2b7-943e3a8c5575 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:09.617494 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-003d26d6-7cb3-4f26-a2b7-943e3a8c5575 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4e7d8622-6c6d-4252-bba4-c4fed57452a3,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:09.625359 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-003d26d6-7cb3-4f26-a2b7-943e3a8c5575 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:09.626473 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-003d26d6-7cb3-4f26-a2b7-943e3a8c5575 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4e7d8622-6c6d-4252-bba4-c4fed57452a3 HTTP/1.1" status: 204 len: 168 time: 0.2634273 May 12 16:20:09.907744 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56414) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:09.928094 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce05ae6b-e963-426d-ab5e-9197518508ad admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:09.943752 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ce05ae6b-e963-426d-ab5e-9197518508ad admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:09.949016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ce05ae6b-e963-426d-ab5e-9197518508ad admin admin] Usage tracker for resource:security_group_rule and tenant:34639219bce44d36a3238368d0d94331 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:09.952578 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-ce05ae6b-e963-426d-ab5e-9197518508ad admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:09.958204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-ce05ae6b-e963-426d-ab5e-9197518508ad admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:10.038716 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce05ae6b-e963-426d-ab5e-9197518508ad admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:10.042505 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ce05ae6b-e963-426d-ab5e-9197518508ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:10.089347 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ce05ae6b-e963-426d-ab5e-9197518508ad admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=34639219bce44d36a3238368d0d94331&name=default HTTP/1.1" status: 200 len: 2983 time: 0.1805217 May 12 16:20:10.090240 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce05ae6b-e963-426d-ab5e-9197518508ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7dd5fc3a-9f68-4a13-bc2f-f152af272122,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:10.092506 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56418) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:10.153663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8652e8f2-2d49-4084-aceb-26dca1d3b9d4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:10.183390 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8652e8f2-2d49-4084-aceb-26dca1d3b9d4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:10.237340 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8652e8f2-2d49-4084-aceb-26dca1d3b9d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:10.252160 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8652e8f2-2d49-4084-aceb-26dca1d3b9d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7dd5fc3a-9f68-4a13-bc2f-f152af272122,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:10.259695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-8652e8f2-2d49-4084-aceb-26dca1d3b9d4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:10.263474 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-8652e8f2-2d49-4084-aceb-26dca1d3b9d4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7dd5fc3a-9f68-4a13-bc2f-f152af272122 HTTP/1.1" status: 204 len: 168 time: 0.1674073 May 12 16:20:11.060793 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56442) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:11.166859 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-494001375-network', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:11.172641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:11.176394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Usage tracker for resource:network and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:11.179218 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:11.184969 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:11.195540 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Made reservation on behalf of 6b4fff63f40147c189245b3a596d32b4 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:20:11.198306 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:11.212359 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:11.228991 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:11.233156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:11.236200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:11.242186 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:11.329622 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:11.333347 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:11.364467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 553} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:20:11.373502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9280f04-e407-455d-8687-2e382dc57a6e,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:11.380742 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:11.381097 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Added segment fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876 of type vlan for network 48e2a895-0939-4482-a024-4695162ad5b7 May 12 16:20:11.409351 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:11.442995 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:11.444155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:11.444782 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:11.557596 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.4956479 May 12 16:20:11.558465 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08d3b5a3-e268-413c-bc50-2e09f94ac800 admin admin] Pushing event updated for resources: {'Network': ['ID=48e2a895-0939-4482-a024-4695162ad5b7,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:11.561349 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56448) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:11.567078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Request body: {'subnet': {'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-494001375-subnet', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:11.568643 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 48e2a895-0939-4482-a024-4695162ad5b7 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:20:11.572757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:11.578022 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Usage tracker for resource:subnet and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:11.581164 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:11.587840 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:11.598710 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Made reservation on behalf of 6b4fff63f40147c189245b3a596d32b4 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:20:11.601379 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:11.826900 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:11.908885 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8139b3d1-92b7-4512-b9ab-db914dde57e3,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:11.912860 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Checking segment: {'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:20:11.913213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Network hostable DHCP agents. Network: 48e2a895-0939-4482-a024-4695162ad5b7, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:20:11.932927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Network 48e2a895-0939-4482-a024-4695162ad5b7 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:20:11.943213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 48e2a895-0939-4482-a024-4695162ad5b7) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:20:11.947103 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:11.947682 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:11.952318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a04dee69-d774-4935-8b8f-187df6511d13 None None] Network 48e2a895-0939-4482-a024-4695162ad5b7 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:20:11.969329 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-71334e9c-3cbd-4773-b376-4d9fd7a8c0a1 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.4067328 May 12 16:20:11.972122 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56452) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:11.976943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:11.982770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:11.987313 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Usage tracker for resource:router and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:11.990188 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:11.995940 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:12.006984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:12.008230 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:12.025557 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:12.176713 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-48e2a895-0939-4482-a024-4695162ad5b7', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:20:12.177655 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:12.355999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Allocated IP 172.20.0.2 (48e2a895-0939-4482-a024-4695162ad5b7/8139b3d1-92b7-4512-b9ab-db914dde57e3/46a3438f-08b9-443c-abfc-44af7f6ffc55) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:20:12.428882 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:12.580580 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:12.592205 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Transition to ACTIVE for port object 46a3438f-08b9-443c-abfc-44af7f6ffc55 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:20:12.611584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Transition to ACTIVE for port object 46a3438f-08b9-443c-abfc-44af7f6ffc55 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:20:12.618309 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:12.731765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Network 48e2a895-0939-4482-a024-4695162ad5b7 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:20:12.734507 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:20:12.738807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:20:12.749045 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Pushing event updated for resources: {'Port': ['ID=46a3438f-08b9-443c-abfc-44af7f6ffc55,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:12.779086 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:12.821139 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:12.838570 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Attempting to bind port 46a3438f-08b9-443c-abfc-44af7f6ffc55 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:20:12.838995 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Attempting to bind port 46a3438f-08b9-443c-abfc-44af7f6ffc55 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:20:12.839607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Attempting to bind port 46a3438f-08b9-443c-abfc-44af7f6ffc55 on network 48e2a895-0939-4482-a024-4695162ad5b7 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:20:12.846224 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 19, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:20:12.846595 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Checking segment: {'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:20:12.846993 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:12.849186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Bound using segment: {'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:20:12.850774 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Bound port: 46a3438f-08b9-443c-abfc-44af7f6ffc55, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:20:12.851171 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:12.980924 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Allocated IP 172.25.8.62 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/9d72a3da-de5e-4329-b92b-afb59dad74f2) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:20:12.986389 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-428cac19-b3af-430c-af8b-cbc376738784 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:12.991247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] For port 46a3438f-08b9-443c-abfc-44af7f6ffc55, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:20:12.994839 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] For port 46a3438f-08b9-443c-abfc-44af7f6ffc55, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=46a3438f-08b9-443c-abfc-44af7f6ffc55,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:20:13.002505 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:13.094564 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f689ed94-ae38-46ee-a94f-7614738741b3 None None] Pushing event updated for resources: {'Port': ['ID=46a3438f-08b9-443c-abfc-44af7f6ffc55,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:13.167523 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:13.199023 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:13.264351 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:20:13.267193 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:20:13.270970 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:20:13.330412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Pushing event updated for resources: {'Port': ['ID=9d72a3da-de5e-4329-b92b-afb59dad74f2,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:13.821239 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:13.835903 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:14.051091 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1db40408-9896-436b-8766-97d497e1c3bd None None] Network 48e2a895-0939-4482-a024-4695162ad5b7 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:20:14.157739 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-239866e6-6a26-44fc-b059-3ad94a981900 None None] Provisioning for port 46a3438f-08b9-443c-abfc-44af7f6ffc55 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:20:14.183190 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:14.396306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 16:20:14.578747 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:20:14.590131 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Sync routers for ids ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:20:14.599897 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Routers {'99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:20:14.600515 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:19:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:14.602381 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:14.606157 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e7b59603-c254-4f29-8e68-0792dcdeb634 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 2.6305902 May 12 16:20:14.606620 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56456) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:14.741016 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 46a3438f-08b9-443c-abfc-44af7f6ffc55 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:20:14.783634 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Set router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:20:14.809084 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 46a3438f-08b9-443c-abfc-44af7f6ffc55 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:20:14.815837 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 46a3438f-08b9-443c-abfc-44af7f6ffc55 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:14.816208 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:14.941284 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:14.975192 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 46a3438f-08b9-443c-abfc-44af7f6ffc55, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=46a3438f-08b9-443c-abfc-44af7f6ffc55,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:14.980246 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:15.052153 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=46a3438f-08b9-443c-abfc-44af7f6ffc55,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:15.121587 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:13Z', 'revision_number': 3, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:15.125981 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Checking router: 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:20:15.126321 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Updating router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc port 9d72a3da-de5e-4329-b92b-afb59dad74f2 binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:20:15.177812 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:15.315694 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:15.424711 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c4cc915e-be56-4c16-947b-9bb6411c7bf0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:15.497743 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:15.508816 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Transition to ACTIVE for port object 9d72a3da-de5e-4329-b92b-afb59dad74f2 will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:20:15.516123 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:15.523660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Allocated IP 172.20.0.1 (48e2a895-0939-4482-a024-4695162ad5b7/8139b3d1-92b7-4512-b9ab-db914dde57e3/d41f2319-31af-49c2-b7b4-c64cf4da506c) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:20:15.603749 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Attempting to bind port 9d72a3da-de5e-4329-b92b-afb59dad74f2 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:20:15.604319 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Attempting to bind port 9d72a3da-de5e-4329-b92b-afb59dad74f2 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:20:15.604458 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Attempting to bind port 9d72a3da-de5e-4329-b92b-afb59dad74f2 on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:20:15.610676 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8b420d2-8b82-4c93-8e03-c893c60df126 None None] Pushing event updated for resources: {'Port': ['ID=9d72a3da-de5e-4329-b92b-afb59dad74f2,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:15.616578 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 19, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:20:15.616945 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:20:15.617334 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:15.617747 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:20:15.618205 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Bound port: 9d72a3da-de5e-4329-b92b-afb59dad74f2, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:20:15.618568 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:15.653089 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8b420d2-8b82-4c93-8e03-c893c60df126 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:15.653453 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8b420d2-8b82-4c93-8e03-c893c60df126 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:15.653786 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8b420d2-8b82-4c93-8e03-c893c60df126 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:15.654854 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8b420d2-8b82-4c93-8e03-c893c60df126 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:15.655270 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8b420d2-8b82-4c93-8e03-c893c60df126 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:15.655702 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8b420d2-8b82-4c93-8e03-c893c60df126 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:15.656030 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8b420d2-8b82-4c93-8e03-c893c60df126 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:15.656343 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8b420d2-8b82-4c93-8e03-c893c60df126 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:15.656667 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8b420d2-8b82-4c93-8e03-c893c60df126 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:15.656987 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8b420d2-8b82-4c93-8e03-c893c60df126 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:15.657304 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8b420d2-8b82-4c93-8e03-c893c60df126 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:15.657643 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8b420d2-8b82-4c93-8e03-c893c60df126 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:20:15.710349 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] For port 9d72a3da-de5e-4329-b92b-afb59dad74f2, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:20:15.713792 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] For port 9d72a3da-de5e-4329-b92b-afb59dad74f2, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9d72a3da-de5e-4329-b92b-afb59dad74f2,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:20:15.719520 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:15.791960 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:15.795894 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Routers {'99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:20:15.796499 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:15.807630 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Transition to ACTIVE for port object d41f2319-31af-49c2-b7b4-c64cf4da506c will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:20:15.833411 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:15.884829 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8b420d2-8b82-4c93-8e03-c893c60df126 None None] Pushing event updated for resources: {'Port': ['ID=9d72a3da-de5e-4329-b92b-afb59dad74f2,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:15.898177 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Network 48e2a895-0939-4482-a024-4695162ad5b7 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:20:15.901100 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:20:15.904703 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:20:15.939667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Pushing event updated for resources: {'Port': ['ID=d41f2319-31af-49c2-b7b4-c64cf4da506c,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:15.970221 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:15.996680 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] Set router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:20:16.120149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a41001d6-1913-4b7c-9655-36fa0c5fb7d4 None None] Provisioning for port d41f2319-31af-49c2-b7b4-c64cf4da506c completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:20:16.127905 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a41001d6-1913-4b7c-9655-36fa0c5fb7d4 None None] Provisioning complete for port d41f2319-31af-49c2-b7b4-c64cf4da506c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:16.128286 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a41001d6-1913-4b7c-9655-36fa0c5fb7d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:16.206143 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:16.214960 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a41001d6-1913-4b7c-9655-36fa0c5fb7d4 None None] Port d41f2319-31af-49c2-b7b4-c64cf4da506c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:20:16.245447 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:16.337723 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:13Z', 'revision_number': 3, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:16.341540 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1770b12-4192-47a6-9911-8b2cb743ec53 None None] The sync data for ids ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'] in n-d-841483-1 is: [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:13Z', 'revision_number': 3, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:20:16.450253 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:16.475213 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:16.480846 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:16.603016 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:16.606527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Pushing event updated for resources: {'Port': ['ID=d41f2319-31af-49c2-b7b4-c64cf4da506c,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:16.757739 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Network 48e2a895-0939-4482-a024-4695162ad5b7 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:20:16.758900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:20:16.788035 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 46a3438f-08b9-443c-abfc-44af7f6ffc55 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:20:16.869313 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 46a3438f-08b9-443c-abfc-44af7f6ffc55 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:16.869939 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:17.002933 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:20:17.003716 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9d72a3da-de5e-4329-b92b-afb59dad74f2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:20:17.070358 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-765f838d-d150-4287-9241-1ae6d70ed682 None None] Provisioning complete for port d41f2319-31af-49c2-b7b4-c64cf4da506c triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:17.070737 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-765f838d-d150-4287-9241-1ae6d70ed682 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:17.138932 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-765f838d-d150-4287-9241-1ae6d70ed682 None None] Port d41f2319-31af-49c2-b7b4-c64cf4da506c cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:20:17.145556 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 9d72a3da-de5e-4329-b92b-afb59dad74f2 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:20:17.151005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 9d72a3da-de5e-4329-b92b-afb59dad74f2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:17.151379 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:17.189737 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:20:17.206526 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b896b085-ce00-49b8-b62e-99b26292487c admin admin] 10.222.0.82 "PUT /v2.0/routers/99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5911582 May 12 16:20:17.300414 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:17.318080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 9d72a3da-de5e-4329-b92b-afb59dad74f2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9d72a3da-de5e-4329-b92b-afb59dad74f2,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:17.322578 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:17.391737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=9d72a3da-de5e-4329-b92b-afb59dad74f2,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:17.738921 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56474) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:17.744280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-847427837-network', 'tenant_id': '59610b028688469da6329f4ac88d5293'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:17.750867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:17.754679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Usage tracker for resource:network and tenant:59610b028688469da6329f4ac88d5293 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:17.757555 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:17.763158 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:17.775149 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Made reservation on behalf of 59610b028688469da6329f4ac88d5293 for: {'network': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:20:17.778267 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:17.791806 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:17.812284 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:17.816120 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Usage tracker for resource:security_group_rule and tenant:59610b028688469da6329f4ac88d5293 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:17.819016 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:17.824958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:17.910738 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:17.914979 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:17.916105 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:17.951257 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 562} {{(pid=88151) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:20:17.952262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Sync routers for ids ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:20:17.953871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4136cee6-0bb6-49dc-bd10-9bfd1c7a952b,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:17.962972 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Routers {'99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:20:17.963591 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:17.963791 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:17.964555 n-d-841483-1 neutron-server[88151]: INFO neutron.db.segments_db [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Added segment cf8d8114-3e96-43ac-92d1-2b303b9ab997 of type vlan for network 8c5ae056-e90a-4b08-ad7b-58eee574e324 May 12 16:20:17.992910 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:18.023304 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:18.024297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:18.024864 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:18.188066 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Set router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:20:18.258472 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.5184762 May 12 16:20:18.259738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a933b3c-31f6-40d5-9737-d91b7b2057c4 admin admin] Pushing event updated for resources: {'Network': ['ID=8c5ae056-e90a-4b08-ad7b-58eee574e324,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:18.261706 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56478) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:18.273929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Request body: {'subnet': {'network_id': '8c5ae056-e90a-4b08-ad7b-58eee574e324', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-847427837-subnet', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:18.281653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:18.285882 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Usage tracker for resource:subnet and tenant:59610b028688469da6329f4ac88d5293 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:18.290074 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:18.297286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:18.307401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Made reservation on behalf of 59610b028688469da6329f4ac88d5293 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:20:18.309857 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:18.314630 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 8c5ae056-e90a-4b08-ad7b-58eee574e324 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:20:18.519176 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:18.593636 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Pushing event updated for resources: {'Subnet': ['ID=d1401063-8f55-4e28-922d-4e9b09f11ce1,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:18.597156 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 2, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:18.601407 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Checking router: 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:20:18.601657 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Checking segment: {'id': 'cf8d8114-3e96-43ac-92d1-2b303b9ab997', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '8c5ae056-e90a-4b08-ad7b-58eee574e324'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:20:18.601786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Updating router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc port d41f2319-31af-49c2-b7b4-c64cf4da506c binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:20:18.602010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Network hostable DHCP agents. Network: 8c5ae056-e90a-4b08-ad7b-58eee574e324, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:20:18.621083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Network 8c5ae056-e90a-4b08-ad7b-58eee574e324 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:20:18.634959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 8c5ae056-e90a-4b08-ad7b-58eee574e324) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:20:18.640514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:18.641092 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:18.645938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-489734db-1d83-416b-a049-346e6dbcd4ba None None] Network 8c5ae056-e90a-4b08-ad7b-58eee574e324 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:20:18.667073 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fca4d9fb-20ee-4cb7-99e4-97dfc4c022ef admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.4011679 May 12 16:20:18.667564 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56482) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:18.673349 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-847427837-router', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:18.678760 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:18.682847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Usage tracker for resource:router and tenant:59610b028688469da6329f4ac88d5293 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:18.685815 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:18.691841 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:18.704990 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:18.706181 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:18.723461 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:18.723668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9d72a3da-de5e-4329-b92b-afb59dad74f2 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:20:18.789365 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:19.031795 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 9d72a3da-de5e-4329-b92b-afb59dad74f2 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:19.032024 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:19.118057 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:19.159126 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-8c5ae056-e90a-4b08-ad7b-58eee574e324', 'network_id': '8c5ae056-e90a-4b08-ad7b-58eee574e324', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'fixed_ips': [{'subnet_id': 'd1401063-8f55-4e28-922d-4e9b09f11ce1'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:20:19.159936 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:19.439108 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:19.470237 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:19.544012 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Allocated IP 172.20.0.2 (8c5ae056-e90a-4b08-ad7b-58eee574e324/d1401063-8f55-4e28-922d-4e9b09f11ce1/72a508c9-461d-42bb-852c-88cff4f0059e) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:20:19.562495 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:19.594284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Transition to ACTIVE for port object d41f2319-31af-49c2-b7b4-c64cf4da506c will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:20:19.610170 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Allocated IP 172.25.8.51 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/cef796c0-988c-4ae3-84c7-2bcf3a5955bb) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:20:19.651162 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:19.768385 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:19.799174 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:19.873727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:20:19.875725 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce51d323-f7e0-4dc9-8016-ca893250198c None None] Pushing event updated for resources: {'Port': ['ID=d41f2319-31af-49c2-b7b4-c64cf4da506c,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:19.876686 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:20:19.881296 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:20:19.912702 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Pushing event updated for resources: {'Port': ['ID=cef796c0-988c-4ae3-84c7-2bcf3a5955bb,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:20.042684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Attempting to bind port d41f2319-31af-49c2-b7b4-c64cf4da506c on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:20:20.042929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Attempting to bind port d41f2319-31af-49c2-b7b4-c64cf4da506c by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:20:20.043286 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Attempting to bind port d41f2319-31af-49c2-b7b4-c64cf4da506c on network 48e2a895-0939-4482-a024-4695162ad5b7 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:20:20.054567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 20, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:20:20.054939 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Checking segment: {'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:20:20.055396 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:20.055788 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Bound using segment: {'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:20:20.056306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Bound port: d41f2319-31af-49c2-b7b4-c64cf4da506c, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:20:20.056677 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:20.136013 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:20.173309 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Transition to ACTIVE for port object 72a508c9-461d-42bb-852c-88cff4f0059e will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:20:20.203174 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] For port d41f2319-31af-49c2-b7b4-c64cf4da506c, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:20:20.205256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Transition to ACTIVE for port object 72a508c9-461d-42bb-852c-88cff4f0059e will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:20:20.207323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] For port d41f2319-31af-49c2-b7b4-c64cf4da506c, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d41f2319-31af-49c2-b7b4-c64cf4da506c,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:20:20.213544 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:20.252272 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:20.275737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Network 8c5ae056-e90a-4b08-ad7b-58eee574e324 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:20:20.293563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:20:20.301637 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:20:20.312613 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:20.355923 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Routers {'99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:20:20.356560 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:20.455786 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce51d323-f7e0-4dc9-8016-ca893250198c None None] Pushing event updated for resources: {'Port': ['ID=d41f2319-31af-49c2-b7b4-c64cf4da506c,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:20.550666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Attempting to bind port 72a508c9-461d-42bb-852c-88cff4f0059e on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:20:20.551366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Attempting to bind port 72a508c9-461d-42bb-852c-88cff4f0059e by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'cf8d8114-3e96-43ac-92d1-2b303b9ab997', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '8c5ae056-e90a-4b08-ad7b-58eee574e324'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:20:20.551366 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Attempting to bind port 72a508c9-461d-42bb-852c-88cff4f0059e on network 8c5ae056-e90a-4b08-ad7b-58eee574e324 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:20:20.637317 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 20, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:20:20.637634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Checking segment: {'id': 'cf8d8114-3e96-43ac-92d1-2b303b9ab997', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '8c5ae056-e90a-4b08-ad7b-58eee574e324'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:20:20.638027 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:20.639095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Bound using segment: {'id': 'cf8d8114-3e96-43ac-92d1-2b303b9ab997', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '8c5ae056-e90a-4b08-ad7b-58eee574e324'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:20:20.639095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Bound port: 72a508c9-461d-42bb-852c-88cff4f0059e, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf8d8114-3e96-43ac-92d1-2b303b9ab997', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '8c5ae056-e90a-4b08-ad7b-58eee574e324'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:20:20.639822 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:20.650474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Pushing event updated for resources: {'Port': ['ID=72a508c9-461d-42bb-852c-88cff4f0059e,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:20.728181 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] Set router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:20:20.801050 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:20.941572 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] For port 72a508c9-461d-42bb-852c-88cff4f0059e, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:20:20.963208 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] For port 72a508c9-461d-42bb-852c-88cff4f0059e, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=72a508c9-461d-42bb-852c-88cff4f0059e,segment=NetworkSegment(cf8d8114-3e96-43ac-92d1-2b303b9ab997),segment_id=cf8d8114-3e96-43ac-92d1-2b303b9ab997)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:20:20.971734 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:21.018544 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Router b17393cf-63fb-4301-ba0c-5cd2740b366c is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 16:20:21.122171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf0ce797-34ed-4c73-a08f-8289e6fd5fe6 None None] Pushing event updated for resources: {'Port': ['ID=72a508c9-461d-42bb-852c-88cff4f0059e,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:21.149872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:20Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:21.154335 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96e0534d-43c6-4292-9cb0-2d7fe5c691bb None None] The sync data for ids ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'] in n-d-841483-1 is: [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:20Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:20:21.230097 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:20:21.240379 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Sync routers for ids ['b17393cf-63fb-4301-ba0c-5cd2740b366c'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:20:21.259762 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Routers {'b17393cf-63fb-4301-ba0c-5cd2740b366c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:20:21.260641 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['b17393cf-63fb-4301-ba0c-5cd2740b366c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:21.265439 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:21.265439 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-15d2122b-f38b-4686-ae00-ff5828828b64 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 2.5946643 May 12 16:20:21.266700 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56486) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:21.543217 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Set router b17393cf-63fb-4301-ba0c-5cd2740b366c gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:20:21.849555 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'name': 'tempest-TestShelveInstance-847427837-router', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.51'}], 'enable_snat': True}, 'gw_port_id': 'cef796c0-988c-4ae3-84c7-2bcf3a5955bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:18Z', 'updated_at': '2022-05-12T16:20:20Z', 'revision_number': 3, 'project_id': '59610b028688469da6329f4ac88d5293', 'gw_port': {'id': 'cef796c0-988c-4ae3-84c7-2bcf3a5955bb', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:10:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4393, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:19Z', 'updated_at': '2022-05-12T16:20:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:21.854461 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Checking router: b17393cf-63fb-4301-ba0c-5cd2740b366c for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:20:21.854805 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Updating router b17393cf-63fb-4301-ba0c-5cd2740b366c port cef796c0-988c-4ae3-84c7-2bcf3a5955bb binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:20:21.912032 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:22.105134 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:22.285047 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:22.291757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfc77fee-9006-4441-b5c9-1647379df015 None None] Network 8c5ae056-e90a-4b08-ad7b-58eee574e324 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:20:22.299224 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Transition to ACTIVE for port object cef796c0-988c-4ae3-84c7-2bcf3a5955bb will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:20:22.308776 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:22.367184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Allocated IP 172.20.0.1 (8c5ae056-e90a-4b08-ad7b-58eee574e324/d1401063-8f55-4e28-922d-4e9b09f11ce1/7413a840-611a-48c8-82c3-9542b4ef7bd5) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:20:22.395010 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Attempting to bind port cef796c0-988c-4ae3-84c7-2bcf3a5955bb on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:20:22.395455 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Attempting to bind port cef796c0-988c-4ae3-84c7-2bcf3a5955bb by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:20:22.396462 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Attempting to bind port cef796c0-988c-4ae3-84c7-2bcf3a5955bb on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:20:22.407685 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 20, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:20:22.408175 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:20:22.408674 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:22.409221 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:20:22.409843 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Bound port: cef796c0-988c-4ae3-84c7-2bcf3a5955bb, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:20:22.410301 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:22.463838 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a8d7cf76-5dee-48e1-a82f-bd1e9461df8e None None] Provisioning for port 72a508c9-461d-42bb-852c-88cff4f0059e completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:20:22.464100 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-561e6bc4-be27-479c-b377-8c6135407909 None None] Pushing event updated for resources: {'Port': ['ID=cef796c0-988c-4ae3-84c7-2bcf3a5955bb,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:22.499292 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] For port cef796c0-988c-4ae3-84c7-2bcf3a5955bb, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:20:22.503695 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] For port cef796c0-988c-4ae3-84c7-2bcf3a5955bb, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cef796c0-988c-4ae3-84c7-2bcf3a5955bb,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:20:22.508765 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:22.557112 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:22.578694 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Transition to ACTIVE for port object 7413a840-611a-48c8-82c3-9542b4ef7bd5 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:20:22.595312 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Routers {'b17393cf-63fb-4301-ba0c-5cd2740b366c'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:20:22.596460 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['b17393cf-63fb-4301-ba0c-5cd2740b366c'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:22.614384 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:22.693709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Network 8c5ae056-e90a-4b08-ad7b-58eee574e324 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:20:22.706466 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:20:22.713857 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:20:22.780272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Pushing event updated for resources: {'Port': ['ID=7413a840-611a-48c8-82c3-9542b4ef7bd5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:22.786787 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-561e6bc4-be27-479c-b377-8c6135407909 None None] Pushing event updated for resources: {'Port': ['ID=cef796c0-988c-4ae3-84c7-2bcf3a5955bb,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:22.815046 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:22.815266 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 72a508c9-461d-42bb-852c-88cff4f0059e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:20:22.842633 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] Set router b17393cf-63fb-4301-ba0c-5cd2740b366c gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:20:22.895915 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 72a508c9-461d-42bb-852c-88cff4f0059e completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:20:22.908498 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 72a508c9-461d-42bb-852c-88cff4f0059e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:22.908857 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:22.949834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:23.106011 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:23.124755 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-272a03ca-c5ef-4ad7-b435-c5bbbe840a79 None None] Provisioning for port 7413a840-611a-48c8-82c3-9542b4ef7bd5 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:20:23.136347 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-272a03ca-c5ef-4ad7-b435-c5bbbe840a79 None None] Provisioning complete for port 7413a840-611a-48c8-82c3-9542b4ef7bd5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:23.136909 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-272a03ca-c5ef-4ad7-b435-c5bbbe840a79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:23.255588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-272a03ca-c5ef-4ad7-b435-c5bbbe840a79 None None] Port 7413a840-611a-48c8-82c3-9542b4ef7bd5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:20:23.274561 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 72a508c9-461d-42bb-852c-88cff4f0059e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=72a508c9-461d-42bb-852c-88cff4f0059e,segment=NetworkSegment(cf8d8114-3e96-43ac-92d1-2b303b9ab997),segment_id=cf8d8114-3e96-43ac-92d1-2b303b9ab997)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:23.280753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-272a03ca-c5ef-4ad7-b435-c5bbbe840a79 None None] Provisioning complete for port 72a508c9-461d-42bb-852c-88cff4f0059e triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:23.281127 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-272a03ca-c5ef-4ad7-b435-c5bbbe840a79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:23.283634 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'name': 'tempest-TestShelveInstance-847427837-router', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.51'}], 'enable_snat': True}, 'gw_port_id': 'cef796c0-988c-4ae3-84c7-2bcf3a5955bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:18Z', 'updated_at': '2022-05-12T16:20:20Z', 'revision_number': 3, 'project_id': '59610b028688469da6329f4ac88d5293', 'gw_port': {'id': 'cef796c0-988c-4ae3-84c7-2bcf3a5955bb', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:10:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4393, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:19Z', 'updated_at': '2022-05-12T16:20:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:23.288956 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39b34188-114b-4e4d-beba-0c06db9d6106 None None] The sync data for ids ['b17393cf-63fb-4301-ba0c-5cd2740b366c'] in n-d-841483-1 is: [{'id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'name': 'tempest-TestShelveInstance-847427837-router', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.51'}], 'enable_snat': True}, 'gw_port_id': 'cef796c0-988c-4ae3-84c7-2bcf3a5955bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:18Z', 'updated_at': '2022-05-12T16:20:20Z', 'revision_number': 3, 'project_id': '59610b028688469da6329f4ac88d5293', 'gw_port': {'id': 'cef796c0-988c-4ae3-84c7-2bcf3a5955bb', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:10:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4393, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:19Z', 'updated_at': '2022-05-12T16:20:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:20:23.313763 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:23.315096 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d41f2319-31af-49c2-b7b4-c64cf4da506c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:20:23.402047 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:23.409359 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:23.466483 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=72a508c9-461d-42bb-852c-88cff4f0059e,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:23.511210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port d41f2319-31af-49c2-b7b4-c64cf4da506c completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:20:23.525815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Pushing event updated for resources: {'Port': ['ID=7413a840-611a-48c8-82c3-9542b4ef7bd5,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:23.529110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port d41f2319-31af-49c2-b7b4-c64cf4da506c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:23.532955 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:23.542860 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:23.684031 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:23.696170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Network 8c5ae056-e90a-4b08-ad7b-58eee574e324 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:20:23.697781 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:20:23.732235 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port d41f2319-31af-49c2-b7b4-c64cf4da506c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d41f2319-31af-49c2-b7b4-c64cf4da506c,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:23.741070 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:23.786544 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8d30130c-d0c7-41d8-b080-62290714a623 None None] Provisioning complete for port 7413a840-611a-48c8-82c3-9542b4ef7bd5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:23.786960 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8d30130c-d0c7-41d8-b080-62290714a623 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:23.869183 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8d30130c-d0c7-41d8-b080-62290714a623 None None] Port 7413a840-611a-48c8-82c3-9542b4ef7bd5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:20:23.873984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=d41f2319-31af-49c2-b7b4-c64cf4da506c,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:23.931310 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Router b17393cf-63fb-4301-ba0c-5cd2740b366c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:20:23.991093 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-53ab867c-9b82-43fd-a0f9-c0fd9ecd7a83 None None] Provisioning complete for port 7413a840-611a-48c8-82c3-9542b4ef7bd5 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:23.991455 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-53ab867c-9b82-43fd-a0f9-c0fd9ecd7a83 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:24.048201 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-53ab867c-9b82-43fd-a0f9-c0fd9ecd7a83 None None] Port 7413a840-611a-48c8-82c3-9542b4ef7bd5 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:20:24.116447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:20:24.126006 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-4ca3198d-ebf4-49eb-9cbf-36a759e82d1f admin admin] 10.222.0.82 "PUT /v2.0/routers/b17393cf-63fb-4301-ba0c-5cd2740b366c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8574071 May 12 16:20:24.520247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 56496) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:24.525351 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-233520239', 'description': 'tempest-secgroup-smoke-233520239 description', 'project_id': '6b4fff63f40147c189245b3a596d32b4'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:24.532856 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:24.536640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:24.539502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:24.545250 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:24.555874 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:24.579558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:24.583336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:24.586138 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:24.592346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:24.666528 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:24.671482 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:24.707683 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:24.711992 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.1878307 May 12 16:20:24.712367 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56500) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:24.718926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d348bbc1-6fe9-4e29-9b9e-f9bcd01c7b01 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'security_group_rule': {'security_group_id': '29493af2-02ca-4fa1-95b5-6daf584d74a5', 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:24.722803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f633fd7-4808-4e51-b57c-0bc06b7f8aca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'SecurityGroup': ['ID=29493af2-02ca-4fa1-95b5-6daf584d74a5,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:24.731611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d348bbc1-6fe9-4e29-9b9e-f9bcd01c7b01 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:24.738865 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d348bbc1-6fe9-4e29-9b9e-f9bcd01c7b01 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:24.742830 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d348bbc1-6fe9-4e29-9b9e-f9bcd01c7b01 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:24.751820 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d348bbc1-6fe9-4e29-9b9e-f9bcd01c7b01 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:24.772817 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d348bbc1-6fe9-4e29-9b9e-f9bcd01c7b01 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:24.804353 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 72a508c9-461d-42bb-852c-88cff4f0059e up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:20:24.839984 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d348bbc1-6fe9-4e29-9b9e-f9bcd01c7b01 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:24.844239 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d348bbc1-6fe9-4e29-9b9e-f9bcd01c7b01 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:24.874347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d348bbc1-6fe9-4e29-9b9e-f9bcd01c7b01 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9510aea6-6fff-4c55-af11-88d5f6614b67,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:24.881979 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d348bbc1-6fe9-4e29-9b9e-f9bcd01c7b01 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:24.883359 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d348bbc1-6fe9-4e29-9b9e-f9bcd01c7b01 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1699262 May 12 16:20:24.886084 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56504) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:24.887694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 72a508c9-461d-42bb-852c-88cff4f0059e triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:24.888874 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:24.892143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d054fdfd-6ba8-4e56-87c7-36fce13c7d20 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'security_group_rule': {'security_group_id': '29493af2-02ca-4fa1-95b5-6daf584d74a5', 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:24.898849 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d054fdfd-6ba8-4e56-87c7-36fce13c7d20 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:24.902733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d054fdfd-6ba8-4e56-87c7-36fce13c7d20 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:24.905779 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d054fdfd-6ba8-4e56-87c7-36fce13c7d20 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:24.911516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d054fdfd-6ba8-4e56-87c7-36fce13c7d20 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:24.930040 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d054fdfd-6ba8-4e56-87c7-36fce13c7d20 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:24.937888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Sync routers for ids ['b17393cf-63fb-4301-ba0c-5cd2740b366c'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:20:24.959369 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Routers {'b17393cf-63fb-4301-ba0c-5cd2740b366c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:20:24.959978 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['b17393cf-63fb-4301-ba0c-5cd2740b366c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:24.993052 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d054fdfd-6ba8-4e56-87c7-36fce13c7d20 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:24.997079 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d054fdfd-6ba8-4e56-87c7-36fce13c7d20 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.030921 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d054fdfd-6ba8-4e56-87c7-36fce13c7d20 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=980d42db-eca9-4af9-9cf4-7d7cabcfb022,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:25.041294 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d054fdfd-6ba8-4e56-87c7-36fce13c7d20 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.045279 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d054fdfd-6ba8-4e56-87c7-36fce13c7d20 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1549592 May 12 16:20:25.045821 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56508) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:25.050873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-ca689fd4-0873-4dd2-acfd-72f984cac58d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'security_group_rule': {'security_group_id': '29493af2-02ca-4fa1-95b5-6daf584d74a5', 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:25.057369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ca689fd4-0873-4dd2-acfd-72f984cac58d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:25.061893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ca689fd4-0873-4dd2-acfd-72f984cac58d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:25.065709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-ca689fd4-0873-4dd2-acfd-72f984cac58d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:25.071619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-ca689fd4-0873-4dd2-acfd-72f984cac58d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:25.088189 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca689fd4-0873-4dd2-acfd-72f984cac58d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.151572 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca689fd4-0873-4dd2-acfd-72f984cac58d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.155331 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca689fd4-0873-4dd2-acfd-72f984cac58d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.164474 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d41f2319-31af-49c2-b7b4-c64cf4da506c up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:20:25.179020 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca689fd4-0873-4dd2-acfd-72f984cac58d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=320d75bb-feb4-4432-b951-dfbeb846ddf5,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:25.189323 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ca689fd4-0873-4dd2-acfd-72f984cac58d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.190841 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ca689fd4-0873-4dd2-acfd-72f984cac58d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1441615 May 12 16:20:25.193524 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56512) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:25.199547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a01c9606-695f-4d02-b874-f994afb52b5d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'security_group_rule': {'security_group_id': '29493af2-02ca-4fa1-95b5-6daf584d74a5', 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:25.206240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a01c9606-695f-4d02-b874-f994afb52b5d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:25.210160 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a01c9606-695f-4d02-b874-f994afb52b5d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:25.212981 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a01c9606-695f-4d02-b874-f994afb52b5d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:25.218923 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a01c9606-695f-4d02-b874-f994afb52b5d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:25.238057 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a01c9606-695f-4d02-b874-f994afb52b5d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.241362 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Set router b17393cf-63fb-4301-ba0c-5cd2740b366c gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:20:25.304481 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a01c9606-695f-4d02-b874-f994afb52b5d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.308372 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a01c9606-695f-4d02-b874-f994afb52b5d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.337929 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a01c9606-695f-4d02-b874-f994afb52b5d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cf157303-5b81-40f4-ae3b-6100b67b7c9d,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:25.349258 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a01c9606-695f-4d02-b874-f994afb52b5d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.350527 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a01c9606-695f-4d02-b874-f994afb52b5d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1554260 May 12 16:20:25.353499 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56516) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:25.359149 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e7d549fc-d357-4636-9adf-1ec870dda8f9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'security_group_rule': {'security_group_id': '29493af2-02ca-4fa1-95b5-6daf584d74a5', 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:25.366431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e7d549fc-d357-4636-9adf-1ec870dda8f9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:25.370291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e7d549fc-d357-4636-9adf-1ec870dda8f9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:25.373308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e7d549fc-d357-4636-9adf-1ec870dda8f9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:25.379100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e7d549fc-d357-4636-9adf-1ec870dda8f9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:25.390230 n-d-841483-1 neutron-server[88152]: INFO neutron.db.securitygroups_db [None req-e7d549fc-d357-4636-9adf-1ec870dda8f9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Project 6b4fff63f40147c189245b3a596d32b4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:20:25.397080 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7d549fc-d357-4636-9adf-1ec870dda8f9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.435935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port d41f2319-31af-49c2-b7b4-c64cf4da506c triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:25.436300 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.467767 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7d549fc-d357-4636-9adf-1ec870dda8f9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.471690 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7d549fc-d357-4636-9adf-1ec870dda8f9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.494604 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7d549fc-d357-4636-9adf-1ec870dda8f9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8b8c1607-b462-4d07-b550-7798d04de446,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:25.504161 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e7d549fc-d357-4636-9adf-1ec870dda8f9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.508057 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e7d549fc-d357-4636-9adf-1ec870dda8f9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1508780 May 12 16:20:25.508250 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56520) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:25.515540 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-375d1270-9cd1-4d22-98b0-765ada3f623c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'security_group_rule': {'security_group_id': '29493af2-02ca-4fa1-95b5-6daf584d74a5', 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:25.522430 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-375d1270-9cd1-4d22-98b0-765ada3f623c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:25.526851 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-375d1270-9cd1-4d22-98b0-765ada3f623c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:25.531754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-375d1270-9cd1-4d22-98b0-765ada3f623c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:25.538336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-375d1270-9cd1-4d22-98b0-765ada3f623c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:25.553167 n-d-841483-1 neutron-server[88152]: INFO neutron.db.securitygroups_db [None req-375d1270-9cd1-4d22-98b0-765ada3f623c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Project 6b4fff63f40147c189245b3a596d32b4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:20:25.561491 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-375d1270-9cd1-4d22-98b0-765ada3f623c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.636081 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-375d1270-9cd1-4d22-98b0-765ada3f623c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.639942 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-375d1270-9cd1-4d22-98b0-765ada3f623c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.665274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-375d1270-9cd1-4d22-98b0-765ada3f623c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8c9781a7-a6b4-4a07-801b-d32c87c355d1,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:25.675538 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-375d1270-9cd1-4d22-98b0-765ada3f623c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.677812 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-375d1270-9cd1-4d22-98b0-765ada3f623c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1684964 May 12 16:20:25.699864 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cef796c0-988c-4ae3-84c7-2bcf3a5955bb up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:20:25.778199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'name': 'tempest-TestShelveInstance-847427837-router', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.51'}], 'enable_snat': True}, 'gw_port_id': 'cef796c0-988c-4ae3-84c7-2bcf3a5955bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:18Z', 'updated_at': '2022-05-12T16:20:22Z', 'revision_number': 4, 'project_id': '59610b028688469da6329f4ac88d5293', 'gw_port': {'id': 'cef796c0-988c-4ae3-84c7-2bcf3a5955bb', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:10:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4393, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:19Z', 'updated_at': '2022-05-12T16:20:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7413a840-611a-48c8-82c3-9542b4ef7bd5', 'name': '', 'network_id': '8c5ae056-e90a-4b08-ad7b-58eee574e324', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'mac_address': 'fa:16:3e:9f:c6:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'device_owner': 'network:router_interface', 'standard_attr_id': 4394, 'fixed_ips': [{'subnet_id': 'd1401063-8f55-4e28-922d-4e9b09f11ce1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:22Z', 'updated_at': '2022-05-12T16:20:23Z', 'revision_number': 2, 'project_id': '59610b028688469da6329f4ac88d5293', 'subnets': [{'id': 'd1401063-8f55-4e28-922d-4e9b09f11ce1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:25.784499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Checking router: b17393cf-63fb-4301-ba0c-5cd2740b366c for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:20:25.784877 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Updating router b17393cf-63fb-4301-ba0c-5cd2740b366c port 7413a840-611a-48c8-82c3-9542b4ef7bd5 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:20:25.815117 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port cef796c0-988c-4ae3-84c7-2bcf3a5955bb completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:20:25.831588 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port cef796c0-988c-4ae3-84c7-2bcf3a5955bb triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:25.831955 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.841019 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-8ef4d25d-6e62-4f25-8337-12dc0d7a6683 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-233520239&fields=id&tenant_id=6b4fff63f40147c189245b3a596d32b4 HTTP/1.1" status: 200 len: 267 time: 0.0408187 May 12 16:20:25.891372 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:25.960077 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:20:25.990508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f01907-e05b-455d-8ead-26698bfeec64 req-cc81869f-41c3-498d-8f91-86b9d8318bca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:25.992479 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-cc81869f-41c3-498d-8f91-86b9d8318bca tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 808 time: 0.1437333 May 12 16:20:26.008246 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-71eed806-d460-4217-9a0e-34b60b4422e4 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/quotas/6b4fff63f40147c189245b3a596d32b4 HTTP/1.1" status: 200 len: 375 time: 0.0105593 May 12 16:20:26.077121 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:26.096713 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-1fd19ba7-c409-48e5-9d7c-2079595e189d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0825117 May 12 16:20:26.114803 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port cef796c0-988c-4ae3-84c7-2bcf3a5955bb, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cef796c0-988c-4ae3-84c7-2bcf3a5955bb,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:26.164607 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:26.272549 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=cef796c0-988c-4ae3-84c7-2bcf3a5955bb,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:26.352476 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-2b4492f8-d306-4655-8ec2-35793978b70d service neutron] 10.222.0.82 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2435486 May 12 16:20:26.367405 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:26.379415 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Transition to ACTIVE for port object 7413a840-611a-48c8-82c3-9542b4ef7bd5 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:20:26.385840 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:26.520184 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe6b799d-9739-4870-971c-813fa649868c None None] Pushing event updated for resources: {'Port': ['ID=7413a840-611a-48c8-82c3-9542b4ef7bd5,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:26.610556 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-4ca3b8e0-4778-488f-9210-835b833a9694 service neutron] 10.222.0.82 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2516997 May 12 16:20:26.613292 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Attempting to bind port 7413a840-611a-48c8-82c3-9542b4ef7bd5 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:20:26.613590 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Attempting to bind port 7413a840-611a-48c8-82c3-9542b4ef7bd5 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'cf8d8114-3e96-43ac-92d1-2b303b9ab997', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '8c5ae056-e90a-4b08-ad7b-58eee574e324'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:20:26.613949 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Attempting to bind port 7413a840-611a-48c8-82c3-9542b4ef7bd5 on network 8c5ae056-e90a-4b08-ad7b-58eee574e324 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:20:26.619765 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 20, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:20:26.620136 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Checking segment: {'id': 'cf8d8114-3e96-43ac-92d1-2b303b9ab997', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '8c5ae056-e90a-4b08-ad7b-58eee574e324'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:20:26.620536 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:26.620919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Bound using segment: {'id': 'cf8d8114-3e96-43ac-92d1-2b303b9ab997', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '8c5ae056-e90a-4b08-ad7b-58eee574e324'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:20:26.621397 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Bound port: 7413a840-611a-48c8-82c3-9542b4ef7bd5, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf8d8114-3e96-43ac-92d1-2b303b9ab997', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 562, 'network_id': '8c5ae056-e90a-4b08-ad7b-58eee574e324'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:20:26.621790 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:26.723895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cef796c0-988c-4ae3-84c7-2bcf3a5955bb up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:20:26.755638 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] For port 7413a840-611a-48c8-82c3-9542b4ef7bd5, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:20:26.780328 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] For port 7413a840-611a-48c8-82c3-9542b4ef7bd5, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7413a840-611a-48c8-82c3-9542b4ef7bd5,segment=NetworkSegment(cf8d8114-3e96-43ac-92d1-2b303b9ab997),segment_id=cf8d8114-3e96-43ac-92d1-2b303b9ab997)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:20:26.787766 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:26.875666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Routers {'b17393cf-63fb-4301-ba0c-5cd2740b366c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:20:26.876316 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['b17393cf-63fb-4301-ba0c-5cd2740b366c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:26.988354 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe6b799d-9739-4870-971c-813fa649868c None None] Pushing event updated for resources: {'Port': ['ID=7413a840-611a-48c8-82c3-9542b4ef7bd5,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:27.003246 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port cef796c0-988c-4ae3-84c7-2bcf3a5955bb triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:27.003613 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:27.168097 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] Set router b17393cf-63fb-4301-ba0c-5cd2740b366c gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:20:27.534381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'name': 'tempest-TestShelveInstance-847427837-router', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.51'}], 'enable_snat': True}, 'gw_port_id': 'cef796c0-988c-4ae3-84c7-2bcf3a5955bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:18Z', 'updated_at': '2022-05-12T16:20:22Z', 'revision_number': 4, 'project_id': '59610b028688469da6329f4ac88d5293', 'gw_port': {'id': 'cef796c0-988c-4ae3-84c7-2bcf3a5955bb', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:10:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4393, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:19Z', 'updated_at': '2022-05-12T16:20:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7413a840-611a-48c8-82c3-9542b4ef7bd5', 'name': '', 'network_id': '8c5ae056-e90a-4b08-ad7b-58eee574e324', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'mac_address': 'fa:16:3e:9f:c6:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'device_owner': 'network:router_interface', 'standard_attr_id': 4394, 'fixed_ips': [{'subnet_id': 'd1401063-8f55-4e28-922d-4e9b09f11ce1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:22Z', 'updated_at': '2022-05-12T16:20:26Z', 'revision_number': 4, 'project_id': '59610b028688469da6329f4ac88d5293', 'subnets': [{'id': 'd1401063-8f55-4e28-922d-4e9b09f11ce1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:27.538977 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99de3b4e-e160-46b9-9a3b-e08797241b20 None None] The sync data for ids ['b17393cf-63fb-4301-ba0c-5cd2740b366c'] in n-d-841483-1 is: [{'id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'name': 'tempest-TestShelveInstance-847427837-router', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.51'}], 'enable_snat': True}, 'gw_port_id': 'cef796c0-988c-4ae3-84c7-2bcf3a5955bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:18Z', 'updated_at': '2022-05-12T16:20:22Z', 'revision_number': 4, 'project_id': '59610b028688469da6329f4ac88d5293', 'gw_port': {'id': 'cef796c0-988c-4ae3-84c7-2bcf3a5955bb', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:10:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4393, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:19Z', 'updated_at': '2022-05-12T16:20:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '7413a840-611a-48c8-82c3-9542b4ef7bd5', 'name': '', 'network_id': '8c5ae056-e90a-4b08-ad7b-58eee574e324', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'mac_address': 'fa:16:3e:9f:c6:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'device_owner': 'network:router_interface', 'standard_attr_id': 4394, 'fixed_ips': [{'subnet_id': 'd1401063-8f55-4e28-922d-4e9b09f11ce1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:22Z', 'updated_at': '2022-05-12T16:20:26Z', 'revision_number': 4, 'project_id': '59610b028688469da6329f4ac88d5293', 'subnets': [{'id': 'd1401063-8f55-4e28-922d-4e9b09f11ce1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:20:27.815009 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-04d70e60-9c3c-4496-b547-9d319378698d req-d4ac38c8-d78c-4284-a334-f62da19bc2d9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 210 time: 0.0464020 May 12 16:20:28.743368 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7413a840-611a-48c8-82c3-9542b4ef7bd5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:20:28.819702 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 7413a840-611a-48c8-82c3-9542b4ef7bd5 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:20:28.826171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7413a840-611a-48c8-82c3-9542b4ef7bd5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:28.827115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:28.955148 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:28.967198 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-23084ef2-c193-4f8e-ad72-304e44aa980a req-0f91435e-c605-4b7a-8010-21d709a9745e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 210 time: 0.0422530 May 12 16:20:28.989062 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 7413a840-611a-48c8-82c3-9542b4ef7bd5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7413a840-611a-48c8-82c3-9542b4ef7bd5,segment=NetworkSegment(cf8d8114-3e96-43ac-92d1-2b303b9ab997),segment_id=cf8d8114-3e96-43ac-92d1-2b303b9ab997)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:28.993084 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:29.064982 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=7413a840-611a-48c8-82c3-9542b4ef7bd5,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:29.262312 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f01907-e05b-455d-8ead-26698bfeec64 req-25bc9262-0196-4977-a949-0b6d9dd2c1d8 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:29.263068 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-72f01907-e05b-455d-8ead-26698bfeec64 req-25bc9262-0196-4977-a949-0b6d9dd2c1d8 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Synchronizing usage tracker for tenant:6b4fff63f40147c189245b3a596d32b4 on resource:network {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:20:29.282084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-72f01907-e05b-455d-8ead-26698bfeec64 req-25bc9262-0196-4977-a949-0b6d9dd2c1d8 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Unset dirty status for tenant:6b4fff63f40147c189245b3a596d32b4 on resource:network {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:20:29.283526 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-25bc9262-0196-4977-a949-0b6d9dd2c1d8 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 808 time: 0.1733720 May 12 16:20:29.347754 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-72f01907-e05b-455d-8ead-26698bfeec64 req-81e491db-28fb-4dc4-bf41-80d050031ee6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Synchronizing usage tracker for tenant:6b4fff63f40147c189245b3a596d32b4 on resource:security_group {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:20:29.363842 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-72f01907-e05b-455d-8ead-26698bfeec64 req-81e491db-28fb-4dc4-bf41-80d050031ee6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Unset dirty status for tenant:6b4fff63f40147c189245b3a596d32b4 on resource:security_group {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:20:29.365192 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-81e491db-28fb-4dc4-bf41-80d050031ee6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6b4fff63f40147c189245b3a596d32b4 HTTP/1.1" status: 200 len: 379 time: 0.0577559 May 12 16:20:29.398869 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'port': {'device_id': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'admin_state_up': True, 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'security_groups': ['29493af2-02ca-4fa1-95b5-6daf584d74a5']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:29.531424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:29.535300 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:port and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:29.538154 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:29.543676 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:29.553799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Made reservation on behalf of 6b4fff63f40147c189245b3a596d32b4 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:20:29.557166 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:29.721255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Allocated IP 172.20.0.7 (48e2a895-0939-4482-a024-4695162ad5b7/8139b3d1-92b7-4512-b9ab-db914dde57e3/8f8cebb9-f3dc-4a14-a548-614afd12cf88) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:20:29.911444 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:29.927579 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Transition to ACTIVE for port object 8f8cebb9-f3dc-4a14-a548-614afd12cf88 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:20:29.951909 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:30.153292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Network 48e2a895-0939-4482-a024-4695162ad5b7 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:20:30.157482 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:20:30.160898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0c84dad-33d9-4dde-9d86-e3a0e0bb0bb4 req-9314298e-d874-4ce8-b191-6aec5c24d315 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:30.161519 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:20:30.162393 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0c84dad-33d9-4dde-9d86-e3a0e0bb0bb4 req-9314298e-d874-4ce8-b191-6aec5c24d315 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 931 time: 0.0865002 May 12 16:20:30.197527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'Port': ['ID=8f8cebb9-f3dc-4a14-a548-614afd12cf88,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:30.213618 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0c84dad-33d9-4dde-9d86-e3a0e0bb0bb4 req-a988cf77-acb4-4c5e-9b2f-777281079c21 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445528 May 12 16:20:30.233533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:30.234250 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:30.260306 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-e5e33a79-cc26-494b-aa36-9062f6828b02 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8648841 May 12 16:20:30.285634 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Request body: {'port': {'device_id': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:30.389996 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ca88be49-3e62-4a27-b392-dbc4324fb899 None None] Provisioning for port 8f8cebb9-f3dc-4a14-a548-614afd12cf88 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:20:30.394932 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-ca88be49-3e62-4a27-b392-dbc4324fb899 None None] Provisioning complete for port 8f8cebb9-f3dc-4a14-a548-614afd12cf88 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:30.395370 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ca88be49-3e62-4a27-b392-dbc4324fb899 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:30.402742 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:30.447900 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-ca88be49-3e62-4a27-b392-dbc4324fb899 None None] Port 8f8cebb9-f3dc-4a14-a548-614afd12cf88 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:20:30.717999 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7413a840-611a-48c8-82c3-9542b4ef7bd5 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:20:30.750721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8f8cebb9-f3dc-4a14-a548-614afd12cf88 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:20:30.757834 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:30.771837 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Transition to ACTIVE for port object 8f8cebb9-f3dc-4a14-a548-614afd12cf88 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:20:30.775878 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:30.789291 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7413a840-611a-48c8-82c3-9542b4ef7bd5 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:30.789691 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:30.937253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Pushing event updated for resources: {'Port': ['ID=8f8cebb9-f3dc-4a14-a548-614afd12cf88,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:31.022223 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Attempting to bind port 8f8cebb9-f3dc-4a14-a548-614afd12cf88 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:20:31.022552 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Attempting to bind port 8f8cebb9-f3dc-4a14-a548-614afd12cf88 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:20:31.022870 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Attempting to bind port 8f8cebb9-f3dc-4a14-a548-614afd12cf88 on network 48e2a895-0939-4482-a024-4695162ad5b7 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:20:31.027441 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Port 8f8cebb9-f3dc-4a14-a548-614afd12cf88 on network 48e2a895-0939-4482-a024-4695162ad5b7 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:20:31.027758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Attempting to bind port 8f8cebb9-f3dc-4a14-a548-614afd12cf88 on network 48e2a895-0939-4482-a024-4695162ad5b7 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:20:31.033564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 20, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:20:31.033901 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Checking segment: {'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:20:31.034285 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Bound using segment: {'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:20:31.034750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Bound port: 8f8cebb9-f3dc-4a14-a548-614afd12cf88, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:20:31.035259 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:31.137200 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] For port 8f8cebb9-f3dc-4a14-a548-614afd12cf88, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:20:31.140687 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] For port 8f8cebb9-f3dc-4a14-a548-614afd12cf88, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:20:31.145868 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:31.209013 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:31.209636 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:31.211028 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] 10.222.0.84 "PUT /v2.0/ports/8f8cebb9-f3dc-4a14-a548-614afd12cf88 HTTP/1.1" status: 200 len: 1091 time: 0.9300032 May 12 16:20:31.211456 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:20:31.256684 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3493b92-66f6-4fdc-af04-0109087464d3 service neutron] Pushing event updated for resources: {'Port': ['ID=8f8cebb9-f3dc-4a14-a548-614afd12cf88,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:31.274093 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4eebcb21-0607-465d-a957-8a9b93a04a58'] response: {'name': 'network-changed', 'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'status': 'completed', 'code': 200} May 12 16:20:31.361995 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f01907-e05b-455d-8ead-26698bfeec64 req-c08fa4ee-0a13-4660-9333-90ff80589443 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:31.363610 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-c08fa4ee-0a13-4660-9333-90ff80589443 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 1094 time: 0.0769506 May 12 16:20:31.437892 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-750cdefe-086a-4af4-abf7-a73acfc1c88d req-77f45d28-f8e7-4a11-a03d-5eac54a686af tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:31.439403 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-750cdefe-086a-4af4-abf7-a73acfc1c88d req-77f45d28-f8e7-4a11-a03d-5eac54a686af tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0901251 May 12 16:20:31.459321 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-d879dca4-9d85-4a08-b10a-a275fbaede2a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88 HTTP/1.1" status: 200 len: 217 time: 0.0747428 May 12 16:20:31.488132 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-750cdefe-086a-4af4-abf7-a73acfc1c88d req-49d3435d-6038-49d7-ae7d-cfc69035f383 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427575 May 12 16:20:31.533163 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f01907-e05b-455d-8ead-26698bfeec64 req-b8b7a864-0788-454d-956e-a7e31b359bad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:31.534631 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-b8b7a864-0788-454d-956e-a7e31b359bad service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0665009 May 12 16:20:31.611146 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a893a682-49f1-461c-926f-e4b2c8cd8527 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:31.612580 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-a893a682-49f1-461c-926f-e4b2c8cd8527 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0695231 May 12 16:20:31.746849 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-03cb35d0-363f-4c5b-8d0a-e927d6c6b474 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1248991 May 12 16:20:31.881571 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-72f01907-e05b-455d-8ead-26698bfeec64 req-14d5233e-ad8f-4d90-b549-6ffbe2db8d0e service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1258569 May 12 16:20:32.049768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce1acbb-f65a-40b5-a511-fc36606d437f req-85209246-5254-49ca-bd38-3dc66c540cca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:32.051218 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3ce1acbb-f65a-40b5-a511-fc36606d437f req-85209246-5254-49ca-bd38-3dc66c540cca service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 1094 time: 0.0698891 May 12 16:20:32.281570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce1acbb-f65a-40b5-a511-fc36606d437f req-61268bb9-a396-4d38-a9b7-a945b6ae21f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:32.283035 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3ce1acbb-f65a-40b5-a511-fc36606d437f req-61268bb9-a396-4d38-a9b7-a945b6ae21f8 service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.2258465 May 12 16:20:32.353468 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3ce1acbb-f65a-40b5-a511-fc36606d437f req-abaf3a56-3f0e-441b-a431-0d6442b7eccf service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88 HTTP/1.1" status: 200 len: 217 time: 0.0639179 May 12 16:20:32.421230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce1acbb-f65a-40b5-a511-fc36606d437f req-a7e15466-6633-4c29-b7ba-fd1bbb1668ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:32.422644 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3ce1acbb-f65a-40b5-a511-fc36606d437f req-a7e15466-6633-4c29-b7ba-fd1bbb1668ec service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0603230 May 12 16:20:32.496623 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce1acbb-f65a-40b5-a511-fc36606d437f req-01f3a80f-0d07-4ff2-803c-660a2c8fdd2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:32.498736 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3ce1acbb-f65a-40b5-a511-fc36606d437f req-01f3a80f-0d07-4ff2-803c-660a2c8fdd2d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0691423 May 12 16:20:32.632681 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3ce1acbb-f65a-40b5-a511-fc36606d437f req-d7fdbfff-b251-473c-8ba3-c2002db90baf service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1268823 May 12 16:20:32.677162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd57af5c-093b-4972-a53c-e30f23c8f192 req-38f3f783-ac54-4cca-a958-a82d89a10387 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:32.678634 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd57af5c-093b-4972-a53c-e30f23c8f192 req-38f3f783-ac54-4cca-a958-a82d89a10387 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0811965 May 12 16:20:32.725889 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cd57af5c-093b-4972-a53c-e30f23c8f192 req-a75a3593-7d7c-44d8-87cf-899f692ca813 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413709 May 12 16:20:32.770948 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3ce1acbb-f65a-40b5-a511-fc36606d437f req-95553cc6-290e-4c6d-99bf-b98aa552a0cb service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1272676 May 12 16:20:32.985099 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:33.915918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce5fe772-cebb-498b-baf1-a387fc70b9ec req-72182081-58ef-4df4-a8dd-64292027535f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:33.917269 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce5fe772-cebb-498b-baf1-a387fc70b9ec req-72182081-58ef-4df4-a8dd-64292027535f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0815499 May 12 16:20:33.960809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ce5fe772-cebb-498b-baf1-a387fc70b9ec req-bf9023e7-0b2c-4979-9e97-fdbf2b54a1c2 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0378973 May 12 16:20:35.142382 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8f8cebb9-f3dc-4a14-a548-614afd12cf88 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:20:35.146874 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eaf3052-e606-464f-8019-c4ad65377367 req-26fb0f91-8f5d-4728-9145-2b7bfe704a8a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:35.148391 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1eaf3052-e606-464f-8019-c4ad65377367 req-26fb0f91-8f5d-4728-9145-2b7bfe704a8a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0827763 May 12 16:20:35.204674 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1eaf3052-e606-464f-8019-c4ad65377367 req-e1566731-f691-4988-8950-019b57b73e59 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0505602 May 12 16:20:35.278550 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8f8cebb9-f3dc-4a14-a548-614afd12cf88, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:35.291632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'port_id': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'mac_address': 'fa:16:3e:86:7e:79', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 553, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:20:35.346706 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:35.362963 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8f8cebb9-f3dc-4a14-a548-614afd12cf88 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:20:35.378200 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8f8cebb9-f3dc-4a14-a548-614afd12cf88, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:35.381984 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:35.452061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=8f8cebb9-f3dc-4a14-a548-614afd12cf88,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:35.725691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['8f8cebb9-f3dc-4a14-a548-614afd12cf88'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:20:35.890152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-98417364-40a2-4d03-b15e-66c48b4e5612 service neutron] (88152) timed out ('10.222.0.82', 52176) {{(pid=88152) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 16:20:36.390730 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-495c36ac-9fda-4bd8-9b17-e8f968e9156f req-d83905ce-1c66-4c2d-8d52-e40cd81ba774 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:36.392147 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-495c36ac-9fda-4bd8-9b17-e8f968e9156f req-d83905ce-1c66-4c2d-8d52-e40cd81ba774 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 944 time: 0.0833979 May 12 16:20:36.435591 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-495c36ac-9fda-4bd8-9b17-e8f968e9156f req-edaf5783-e253-4643-86ff-a56cee2dc362 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0373576 May 12 16:20:37.142817 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8f8cebb9-f3dc-4a14-a548-614afd12cf88 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:20:37.213504 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 8f8cebb9-f3dc-4a14-a548-614afd12cf88 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:20:37.218480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 8f8cebb9-f3dc-4a14-a548-614afd12cf88 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:20:37.218844 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:37.345561 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:37.373378 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:20:37.383163 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8f8cebb9-f3dc-4a14-a548-614afd12cf88, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:20:37.387241 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:37.425935 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e9740ddf-39e6-4aa1-98b0-f7bd094edcc5'] response: {'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'code': 200} May 12 16:20:37.460485 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=8f8cebb9-f3dc-4a14-a548-614afd12cf88,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:37.581210 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee3362f7-1aca-4b1b-ac4e-31926a30eaa9 req-2736a6ee-8024-49ba-8e18-19478b048dc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:37.582603 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee3362f7-1aca-4b1b-ac4e-31926a30eaa9 req-2736a6ee-8024-49ba-8e18-19478b048dc9 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 1096 time: 0.0767813 May 12 16:20:37.631205 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ee3362f7-1aca-4b1b-ac4e-31926a30eaa9 req-f55d5a2b-de94-4e48-a13d-dd7d7b6b64ca service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389030 May 12 16:20:37.636462 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a976fac4-5e43-418e-8c3b-3ea15fced390 req-5bfdbc75-154d-4db6-ade7-8a456aff8e03 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:37.638081 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a976fac4-5e43-418e-8c3b-3ea15fced390 req-5bfdbc75-154d-4db6-ade7-8a456aff8e03 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0799828 May 12 16:20:37.683594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a976fac4-5e43-418e-8c3b-3ea15fced390 req-ac76cec5-4b4f-4015-b9d8-5faa07da17e6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395286 May 12 16:20:38.877950 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3647aa-22e4-4a6a-80fa-13bc9a07fa3e req-d28cd185-80b7-4791-8d88-1f7bccc7b69b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:38.879441 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d3647aa-22e4-4a6a-80fa-13bc9a07fa3e req-d28cd185-80b7-4791-8d88-1f7bccc7b69b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0911698 May 12 16:20:38.928269 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d3647aa-22e4-4a6a-80fa-13bc9a07fa3e req-d2f31f7a-7d1b-407e-bd39-e946f525fdc3 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428264 May 12 16:20:40.113992 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b48d45b-813b-4c87-b95a-efdb20e1ceae req-1525925c-54b8-44ff-8f2e-d770c086a225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:40.115440 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b48d45b-813b-4c87-b95a-efdb20e1ceae req-1525925c-54b8-44ff-8f2e-d770c086a225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0800521 May 12 16:20:40.164158 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2b48d45b-813b-4c87-b95a-efdb20e1ceae req-b73a0dd3-9f0f-4acd-afcb-104660df1d88 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429523 May 12 16:20:40.349984 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97e043df-a317-4ad8-acb0-ec0459f5eb65 req-6631a5dc-793b-4305-b6a5-820f3a629274 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:40.351415 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-97e043df-a317-4ad8-acb0-ec0459f5eb65 req-6631a5dc-793b-4305-b6a5-820f3a629274 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0798266 May 12 16:20:40.394388 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-97e043df-a317-4ad8-acb0-ec0459f5eb65 req-eec25cc2-4682-432d-8967-98ce12d058c9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0374403 May 12 16:20:40.416754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56580) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:40.538673 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e96aed21-ce9c-4014-b9a2-752bb4d88f63 tempest-TestShelveInstance-1430599996 tempest-TestShelveInstance-1430599996-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:40.540109 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e96aed21-ce9c-4014-b9a2-752bb4d88f63 tempest-TestShelveInstance-1430599996 tempest-TestShelveInstance-1430599996-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 1091 time: 0.1224074 May 12 16:20:40.543086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56586) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:20:40.547928 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'fixed_ip_address': '172.20.0.7'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:20:40.554396 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:20:40.558156 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:floatingip and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:20:40.561436 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:20:40.567007 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:20:40.578283 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:40.714648 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:40.849208 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Allocated IP 172.25.8.106 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/c4ef2413-0d26-49e4-ae10-592a7d07679d) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:20:40.996548 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:41.025037 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:41.092864 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:20:41.095514 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:20:41.099346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:20:41.133563 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'Port': ['ID=c4ef2413-0d26-49e4-ae10-592a7d07679d,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:41.622737 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:41.696256 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:41.902869 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:41.907841 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:42.017552 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'Port': ['ID=c4ef2413-0d26-49e4-ae10-592a7d07679d,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:20:42.027376 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:42.195931 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Floating IP ab6420c0-7a95-47bb-85cd-5fe51d4a2ff3 associated. External IP: 172.25.8.106, port: 8f8cebb9-f3dc-4a14-a548-614afd12cf88. May 12 16:20:42.272727 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-03f9b8b9-1747-42bc-9093-5de17683ca93 req-02aaaca9-53cd-49b5-a2c4-9a42c3f5bcf1 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0407250 May 12 16:20:42.381095 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-03f9b8b9-1747-42bc-9093-5de17683ca93 req-336588d6-fc36-48b9-b713-09088a3bbe13 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0413954 May 12 16:20:42.423830 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-03f9b8b9-1747-42bc-9093-5de17683ca93 req-22c921de-0d57-4e62-a53e-bebca60e4224 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0250428 May 12 16:20:42.549311 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:20:42.560844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f9b8b9-1747-42bc-9093-5de17683ca93 req-26bf60a6-44e2-48ac-b0f6-121124f261c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:42.562321 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-03f9b8b9-1747-42bc-9093-5de17683ca93 req-26bf60a6-44e2-48ac-b0f6-121124f261c6 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1331105 May 12 16:20:42.728826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:20:42.739422 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce7df6eb-1bb2-4389-8f05-040b1c8756cb None None] Sync routers for ids ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:20:42.748974 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce7df6eb-1bb2-4389-8f05-040b1c8756cb None None] Routers {'99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:20:42.749669 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ce7df6eb-1bb2-4389-8f05-040b1c8756cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:42.752990 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:42.809228 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-541b39fb-7efc-495f-a132-ba2937181982 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2648427 May 12 16:20:42.810344 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:20:42.904145 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-27ea22f1-4f1e-4493-b402-4d21f52caaea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:42.910461 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c6af5e56-0d4d-4006-9c69-b80e0663262b'] response: {'name': 'network-changed', 'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'status': 'completed', 'code': 200} May 12 16:20:42.934778 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-ce7df6eb-1bb2-4389-8f05-040b1c8756cb None None] Set router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:20:43.027496 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11cbc62-e7ba-4a83-9054-0e990260f560 req-e6c3c7a3-f733-4b35-bfb6-3c9ab89c64cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:43.029550 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a11cbc62-e7ba-4a83-9054-0e990260f560 req-e6c3c7a3-f733-4b35-bfb6-3c9ab89c64cb service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 1096 time: 0.0777743 May 12 16:20:43.172813 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11cbc62-e7ba-4a83-9054-0e990260f560 req-c7499394-6ea0-43b6-907c-e43cf43f66f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:43.174216 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a11cbc62-e7ba-4a83-9054-0e990260f560 req-c7499394-6ea0-43b6-907c-e43cf43f66f5 service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1381443 May 12 16:20:43.278956 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a11cbc62-e7ba-4a83-9054-0e990260f560 req-65145695-0e15-4312-8420-8cb099caca24 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88 HTTP/1.1" status: 200 len: 999 time: 0.0988245 May 12 16:20:43.280543 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ce7df6eb-1bb2-4389-8f05-040b1c8756cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ab6420c0-7a95-47bb-85cd-5fe51d4a2ff3', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'floating_ip_address': '172.25.8.106', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'port_id': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 4406, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'mac_address': 'fa:16:3e:86:7e:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:20:41Z', 'updated_at': '2022-05-12T16:20:41Z', 'revision_number': 0, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:23Z', 'revision_number': 5, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:43.284469 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce7df6eb-1bb2-4389-8f05-040b1c8756cb None None] Checking router: 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:20:43.292862 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce7df6eb-1bb2-4389-8f05-040b1c8756cb None None] Routers {'99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:20:43.293469 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ce7df6eb-1bb2-4389-8f05-040b1c8756cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:20:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:43.341331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11cbc62-e7ba-4a83-9054-0e990260f560 req-f6a47528-6708-499e-b3de-88f26e77c9d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:43.342822 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a11cbc62-e7ba-4a83-9054-0e990260f560 req-f6a47528-6708-499e-b3de-88f26e77c9d1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0585783 May 12 16:20:43.416152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11cbc62-e7ba-4a83-9054-0e990260f560 req-acf80e37-a65f-4e70-ab44-575ee6d38972 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:20:43.417666 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a11cbc62-e7ba-4a83-9054-0e990260f560 req-acf80e37-a65f-4e70-ab44-575ee6d38972 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0692365 May 12 16:20:43.469803 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-ce7df6eb-1bb2-4389-8f05-040b1c8756cb None None] Set router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:20:43.549618 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a11cbc62-e7ba-4a83-9054-0e990260f560 req-07a19d95-8d12-4f21-bff4-d039acb22e22 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1261957 May 12 16:20:43.791403 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a11cbc62-e7ba-4a83-9054-0e990260f560 req-9c7f73da-b3b6-4b68-9cc3-ccb7ea723292 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2359030 May 12 16:20:43.817134 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:43.819643 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-ce7df6eb-1bb2-4389-8f05-040b1c8756cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ab6420c0-7a95-47bb-85cd-5fe51d4a2ff3', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'floating_ip_address': '172.25.8.106', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'port_id': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 4406, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'mac_address': 'fa:16:3e:86:7e:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:20:41Z', 'updated_at': '2022-05-12T16:20:41Z', 'revision_number': 0, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:23Z', 'revision_number': 5, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:20:43.824220 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce7df6eb-1bb2-4389-8f05-040b1c8756cb None None] The sync data for ids ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'] in n-d-841483-1 is: [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': 'ab6420c0-7a95-47bb-85cd-5fe51d4a2ff3', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'floating_ip_address': '172.25.8.106', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'port_id': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 4406, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'mac_address': 'fa:16:3e:86:7e:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:20:41Z', 'updated_at': '2022-05-12T16:20:41Z', 'revision_number': 0, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:23Z', 'revision_number': 5, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:20:43.999429 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e667db8-8ba2-43b2-94a4-970161a65d8b None None] New status for floating IP ab6420c0-7a95-47bb-85cd-5fe51d4a2ff3: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:20:45.427044 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c79ba838-5ca6-4d7c-ae33-831454bef37d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:46.161931 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:46.446807 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:47.918291 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:20:50.923285 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-664d8bbc-8508-4d9b-a44e-a454e3197781 req-b44be00c-a664-4467-9309-27a562418e80 service neutron] (88152) timed out ('10.222.0.84', 55065) {{(pid=88152) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 16:21:02.959680 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:21:02.988900 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:21:06.990840 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae819cf0-0d3c-4af6-8f92-1c1ea6015b21 req-65d573d5-03de-43af-a44d-7c74dd92c0c5 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0697875 May 12 16:21:07.147810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae819cf0-0d3c-4af6-8f92-1c1ea6015b21 req-9555dde8-783e-4d01-9400-e1b3b4ad6296 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:21:07.149245 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae819cf0-0d3c-4af6-8f92-1c1ea6015b21 req-9555dde8-783e-4d01-9400-e1b3b4ad6296 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 1096 time: 0.0701559 May 12 16:21:07.293774 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae819cf0-0d3c-4af6-8f92-1c1ea6015b21 req-261c2361-0d29-4e52-bc4d-49ebc7c493d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:21:07.295207 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae819cf0-0d3c-4af6-8f92-1c1ea6015b21 req-261c2361-0d29-4e52-bc4d-49ebc7c493d2 service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1273386 May 12 16:21:07.397951 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae819cf0-0d3c-4af6-8f92-1c1ea6015b21 req-b6908b36-a8a0-4fb5-bd54-6b4878481220 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88 HTTP/1.1" status: 200 len: 1001 time: 0.0960214 May 12 16:21:07.462558 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae819cf0-0d3c-4af6-8f92-1c1ea6015b21 req-502e833e-bd08-4214-b396-cd2b9edf444c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:21:07.463932 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae819cf0-0d3c-4af6-8f92-1c1ea6015b21 req-502e833e-bd08-4214-b396-cd2b9edf444c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0599861 May 12 16:21:07.541826 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae819cf0-0d3c-4af6-8f92-1c1ea6015b21 req-c526dec3-2f07-45af-90de-66b16cd05630 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:21:07.543203 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae819cf0-0d3c-4af6-8f92-1c1ea6015b21 req-c526dec3-2f07-45af-90de-66b16cd05630 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0701230 May 12 16:21:07.687169 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae819cf0-0d3c-4af6-8f92-1c1ea6015b21 req-d2372f67-b1dc-49a1-8b3a-99408c331550 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1364563 May 12 16:21:07.818466 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae819cf0-0d3c-4af6-8f92-1c1ea6015b21 req-2eddc9b7-6b88-4dc7-983e-6bdcbbc23cf8 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1252143 May 12 16:21:12.897839 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-40276480-af1d-4d43-a730-474fa4491aa8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:21:13.834928 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:21:15.428739 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-255ee0fe-df10-4d13-9d2c-a2e803299561 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:21:16.162921 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:21:16.450083 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:21:17.921447 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:21:33.004071 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:21:39.958883 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:21:42.900256 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0270485b-867a-4f62-b3e6-5fdac39b0604 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:21:43.834475 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:21:44.257641 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8673712c-88bb-4ba0-b0ef-cf2a09462739 req-022ae58a-5337-4c0a-9ac7-f5ce907d36f5 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0424197 May 12 16:21:44.368979 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8673712c-88bb-4ba0-b0ef-cf2a09462739 req-c389759f-238f-4dce-9952-b45bee237c4a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0459940 May 12 16:21:44.410885 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8673712c-88bb-4ba0-b0ef-cf2a09462739 req-98dc7212-6a7c-4452-827d-58d35db0d879 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0248213 May 12 16:21:44.543220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8673712c-88bb-4ba0-b0ef-cf2a09462739 req-aa76fe08-a426-4ed8-bb69-97ced126aaa6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:21:44.544768 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8673712c-88bb-4ba0-b0ef-cf2a09462739 req-aa76fe08-a426-4ed8-bb69-97ced126aaa6 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1289470 May 12 16:21:45.430357 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7505b3d1-3c0e-4032-a988-9b1bda1f0f99 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:21:46.165584 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:21:46.452882 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:21:47.927019 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:03.002247 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:08.997412 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08a6f4c1-2a98-4ece-857f-737679aef9d1 req-e135c863-85f2-4a03-9122-5b24d5445134 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0731430 May 12 16:22:09.171576 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a6f4c1-2a98-4ece-857f-737679aef9d1 req-f22157e6-de30-4ba4-ba2e-96d74dcfc889 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:09.173090 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08a6f4c1-2a98-4ece-857f-737679aef9d1 req-f22157e6-de30-4ba4-ba2e-96d74dcfc889 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 1096 time: 0.0772390 May 12 16:22:09.329928 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a6f4c1-2a98-4ece-857f-737679aef9d1 req-dbf3f7f8-d79f-4d9d-8e10-0759aa750286 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:09.331404 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08a6f4c1-2a98-4ece-857f-737679aef9d1 req-dbf3f7f8-d79f-4d9d-8e10-0759aa750286 service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1348083 May 12 16:22:09.550821 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08a6f4c1-2a98-4ece-857f-737679aef9d1 req-d46918d3-8590-435d-bf6c-4fb077630a57 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88 HTTP/1.1" status: 200 len: 1001 time: 0.2103860 May 12 16:22:09.615883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a6f4c1-2a98-4ece-857f-737679aef9d1 req-af2519f1-a2eb-4f97-8abe-1888d667e443 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:09.617066 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08a6f4c1-2a98-4ece-857f-737679aef9d1 req-af2519f1-a2eb-4f97-8abe-1888d667e443 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0573578 May 12 16:22:09.692896 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a6f4c1-2a98-4ece-857f-737679aef9d1 req-ae15d87d-7d74-4f58-8a2e-a601f9a4c042 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:09.694400 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08a6f4c1-2a98-4ece-857f-737679aef9d1 req-ae15d87d-7d74-4f58-8a2e-a601f9a4c042 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0689757 May 12 16:22:09.832073 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08a6f4c1-2a98-4ece-857f-737679aef9d1 req-ecdd8f47-f320-4158-951d-9fc46c145aeb service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1272566 May 12 16:22:09.968753 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-08a6f4c1-2a98-4ece-857f-737679aef9d1 req-ec70c1ed-9a5e-4939-b122-f2587cac23d9 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1263280 May 12 16:22:12.904566 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c6e6fb8d-091f-4871-bfbf-b5b1b97d2e5c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:13.848377 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:15.432525 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8730fe7d-ea3e-4b25-8d0d-24466ea73333 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:16.167126 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:16.455335 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:16.957860 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:22:17.929479 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:33.018609 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:41.157959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ea8b6ac-3283-4f70-a17c-2ebcdd408350 req-61a08748-adb4-47fb-ad7c-ef1a29b1d033 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:41.159311 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ea8b6ac-3283-4f70-a17c-2ebcdd408350 req-61a08748-adb4-47fb-ad7c-ef1a29b1d033 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.1967702 May 12 16:22:41.202793 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6ea8b6ac-3283-4f70-a17c-2ebcdd408350 req-4e61a6e2-6185-4c64-9ad2-928980ffa499 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0370605 May 12 16:22:42.403852 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00bf9a82-72b7-4346-8078-bf8198bc81de req-6de955ef-7d38-4934-ad23-4c0594b17d7b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:42.405284 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00bf9a82-72b7-4346-8078-bf8198bc81de req-6de955ef-7d38-4934-ad23-4c0594b17d7b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0785072 May 12 16:22:42.451982 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00bf9a82-72b7-4346-8078-bf8198bc81de req-0b9fe728-2280-42d8-a057-396c9736c9fb tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411167 May 12 16:22:42.907511 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a25f2620-eaa5-4a82-ae21-80a2ebfd998b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:43.657926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d006499-aa06-4551-b163-404f10ba661c req-0db18f67-8564-4b0d-8e9d-217b9416e3fe tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:43.659368 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d006499-aa06-4551-b163-404f10ba661c req-0db18f67-8564-4b0d-8e9d-217b9416e3fe tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0984356 May 12 16:22:43.704515 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1d006499-aa06-4551-b163-404f10ba661c req-389777d3-a061-48d5-99f5-0f3cb8690226 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388691 May 12 16:22:43.848741 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:44.303254 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a38a7d4-1fee-43b6-8cc3-a777acda6306 req-a22460a0-a961-4bbf-a754-4cddeea2e0ee service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0449607 May 12 16:22:44.409190 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a38a7d4-1fee-43b6-8cc3-a777acda6306 req-536933c6-d6b3-4bc3-b2ed-78170d501398 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0409989 May 12 16:22:44.452425 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a38a7d4-1fee-43b6-8cc3-a777acda6306 req-8b545543-c0f2-42f3-b7d4-20928cca413a service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0246785 May 12 16:22:44.586071 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a38a7d4-1fee-43b6-8cc3-a777acda6306 req-95d4a3d8-e76a-4ba0-be3c-5b60a8a46b9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:44.587534 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1a38a7d4-1fee-43b6-8cc3-a777acda6306 req-95d4a3d8-e76a-4ba0-be3c-5b60a8a46b9e service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1296923 May 12 16:22:44.894419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e10a6fb0-add7-41ac-9268-4ead5ebf8595 req-dac31240-bdd5-4ede-883a-5dc9ea8ef8c5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:44.895767 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e10a6fb0-add7-41ac-9268-4ead5ebf8595 req-dac31240-bdd5-4ede-883a-5dc9ea8ef8c5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0859897 May 12 16:22:44.941158 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e10a6fb0-add7-41ac-9268-4ead5ebf8595 req-9224fb6d-dc15-48dd-b67b-668096a9277d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391412 May 12 16:22:45.435290 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-db9c2287-8960-473f-981c-66a6b58c36af None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:46.125919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31d08cf7-e1b8-49d6-8c0d-71726fee3af5 req-759fc9d8-9dfc-4e7c-b3e7-0ba5b395c9b2 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:46.127255 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31d08cf7-e1b8-49d6-8c0d-71726fee3af5 req-759fc9d8-9dfc-4e7c-b3e7-0ba5b395c9b2 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0783083 May 12 16:22:46.169503 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:46.173055 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-31d08cf7-e1b8-49d6-8c0d-71726fee3af5 req-23cc2c98-d351-4da3-9090-2e50d1e4c9ad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396442 May 12 16:22:46.458875 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:47.365670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-526f437a-e3ad-4e02-b3c8-0e5348d53872 req-77ae5030-4230-484a-962d-29fc6bd6ea2b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:47.367335 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-526f437a-e3ad-4e02-b3c8-0e5348d53872 req-77ae5030-4230-484a-962d-29fc6bd6ea2b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0845060 May 12 16:22:47.411604 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-526f437a-e3ad-4e02-b3c8-0e5348d53872 req-b1de46ea-a550-4146-be6a-af53cc1339b0 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0384855 May 12 16:22:47.931533 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:48.595169 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4677a8a-407d-4604-bfa9-6f24a63c4bac req-8e6dea03-2b3d-4ce1-ba61-341126e5e47e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:48.596493 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4677a8a-407d-4604-bfa9-6f24a63c4bac req-8e6dea03-2b3d-4ce1-ba61-341126e5e47e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0804365 May 12 16:22:48.642936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f4677a8a-407d-4604-bfa9-6f24a63c4bac req-8a31775a-7dea-4d87-a293-dd712ac2ad16 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407972 May 12 16:22:49.830493 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fed54d9-ee89-4998-b1ff-f0d5ad3018e3 req-4dfba41c-81f4-4aac-b8df-9255e97df2f0 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:49.831923 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7fed54d9-ee89-4998-b1ff-f0d5ad3018e3 req-4dfba41c-81f4-4aac-b8df-9255e97df2f0 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0805178 May 12 16:22:49.875842 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7fed54d9-ee89-4998-b1ff-f0d5ad3018e3 req-9ea881cc-6d70-4ae3-9d56-9b9ab615e0f9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0376558 May 12 16:22:51.064300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4f6e99-7592-4792-9b5b-c79dff5af1e6 req-ea4da719-130c-4763-bc20-4ade082f2762 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:51.065653 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da4f6e99-7592-4792-9b5b-c79dff5af1e6 req-ea4da719-130c-4763-bc20-4ade082f2762 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0850482 May 12 16:22:51.110646 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-da4f6e99-7592-4792-9b5b-c79dff5af1e6 req-25372d24-614f-4ec4-a302-e83145a24892 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0386491 May 12 16:22:51.810065 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8f8cebb9-f3dc-4a14-a548-614afd12cf88 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:22:51.944633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8f8cebb9-f3dc-4a14-a548-614afd12cf88, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:22:51.957594 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'port_id': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'mac_address': 'fa:16:3e:86:7e:79', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 553, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:22:52.017861 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:52.035890 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 8f8cebb9-f3dc-4a14-a548-614afd12cf88 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:22:52.051946 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8f8cebb9-f3dc-4a14-a548-614afd12cf88, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:22:52.055864 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:52.121753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=8f8cebb9-f3dc-4a14-a548-614afd12cf88,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:22:52.129057 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:22:52.129411 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:22:52.129762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:22:52.130095 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:22:52.130422 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:22:52.130752 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:22:52.131571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:22:52.131929 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:22:52.132252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:22:52.132571 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:22:52.132888 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:22:52.133203 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:22:52.225866 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['8f8cebb9-f3dc-4a14-a548-614afd12cf88'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:22:52.300382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0cf3529-7619-4a73-9a68-3c22fc5bd523 req-f0fbddb5-9c23-433b-8fbd-af06101ae7c7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:52.302099 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0cf3529-7619-4a73-9a68-3c22fc5bd523 req-f0fbddb5-9c23-433b-8fbd-af06101ae7c7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 944 time: 0.0822968 May 12 16:22:52.350694 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0cf3529-7619-4a73-9a68-3c22fc5bd523 req-ffeca411-580c-4e98-b18c-4ea9858d30a0 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414276 May 12 16:22:53.550653 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00cb5ef0-90cf-4f2d-be1d-053960747763 req-9d563a1d-92bf-4b42-8212-2722bdc4b556 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:53.552117 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00cb5ef0-90cf-4f2d-be1d-053960747763 req-9d563a1d-92bf-4b42-8212-2722bdc4b556 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 944 time: 0.0932939 May 12 16:22:53.652839 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-00cb5ef0-90cf-4f2d-be1d-053960747763 req-5dccb1e5-9815-400d-8d38-6f86c453530d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0939507 May 12 16:22:53.826851 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8f8cebb9-f3dc-4a14-a548-614afd12cf88 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:22:53.895243 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 8f8cebb9-f3dc-4a14-a548-614afd12cf88 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:22:53.896216 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:53.956638 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:22:54.019879 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:54.051247 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:22:54.063418 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8f8cebb9-f3dc-4a14-a548-614afd12cf88, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:22:54.067654 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:22:54.106495 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a8deee59-8935-4683-b3f2-92f60ba1a5d1'] response: {'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'code': 200} May 12 16:22:54.142258 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=8f8cebb9-f3dc-4a14-a548-614afd12cf88,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:22:54.853709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88193f97-e5d7-4a36-b84e-749746b8dce0 req-567b079d-6ea2-464b-b880-56d3a9cb5a91 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:54.855809 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88193f97-e5d7-4a36-b84e-749746b8dce0 req-567b079d-6ea2-464b-b880-56d3a9cb5a91 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0890439 May 12 16:22:54.905741 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88193f97-e5d7-4a36-b84e-749746b8dce0 req-a0bb53ad-b30b-4b0a-97ee-568f2c399482 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440619 May 12 16:22:56.196510 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8be60e3-374d-43ac-b2e6-030d058b6ea4 req-b707e026-66b1-4b96-a79c-8cbf623ff226 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:56.197907 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f8be60e3-374d-43ac-b2e6-030d058b6ea4 req-b707e026-66b1-4b96-a79c-8cbf623ff226 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.1621308 May 12 16:22:56.245478 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f8be60e3-374d-43ac-b2e6-030d058b6ea4 req-4e999d8b-84b6-4739-8204-4ec081b03a76 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415974 May 12 16:22:57.445429 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b3d034-bddc-4c90-91e0-0126e913a6e3 req-ed90532e-6e0b-45e7-a245-65c3dcdd9f7b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:57.453877 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d4b3d034-bddc-4c90-91e0-0126e913a6e3 req-ed90532e-6e0b-45e7-a245-65c3dcdd9f7b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0955899 May 12 16:22:57.505677 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d4b3d034-bddc-4c90-91e0-0126e913a6e3 req-92587fd3-ba22-4e40-9148-7e22be405988 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0506229 May 12 16:22:58.708854 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7afba4da-80ab-4aad-97ad-779ab64bd1fe req-da6a6c11-9860-46a5-9076-ca456dbdfea5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:58.711146 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7afba4da-80ab-4aad-97ad-779ab64bd1fe req-da6a6c11-9860-46a5-9076-ca456dbdfea5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0916727 May 12 16:22:58.760260 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7afba4da-80ab-4aad-97ad-779ab64bd1fe req-e2ae38fa-ffaf-4f3e-8fa7-cf2205309341 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425618 May 12 16:22:59.975200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bffb31a-fd9f-4749-8ad5-0e67714afc30 req-c4af61e5-1f3f-453f-9a15-f653133e31b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:22:59.976722 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9bffb31a-fd9f-4749-8ad5-0e67714afc30 req-c4af61e5-1f3f-453f-9a15-f653133e31b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.1002285 May 12 16:23:00.029982 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9bffb31a-fd9f-4749-8ad5-0e67714afc30 req-b09c3d20-c6c6-42bc-9a13-51b862d7c417 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476267 May 12 16:23:01.233596 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abf0069-c134-4e2e-8509-7ef7f926cc10 req-dee123b7-5e53-4af3-842a-cdf774616e12 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:01.241205 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2abf0069-c134-4e2e-8509-7ef7f926cc10 req-dee123b7-5e53-4af3-842a-cdf774616e12 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.1034076 May 12 16:23:01.291197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2abf0069-c134-4e2e-8509-7ef7f926cc10 req-e0342beb-fa26-4b42-84db-57eeac6519a8 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0489571 May 12 16:23:02.493917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9b476c-a98c-42a7-b220-3f47c0513d47 req-5cb4e479-497d-4f69-b230-fe66f18d1597 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:02.495490 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b9b476c-a98c-42a7-b220-3f47c0513d47 req-5cb4e479-497d-4f69-b230-fe66f18d1597 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0879321 May 12 16:23:02.541185 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5b9b476c-a98c-42a7-b220-3f47c0513d47 req-46448c4c-0480-4f75-bbaf-93383bf18187 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398920 May 12 16:23:03.015341 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:03.558477 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06fb0cc5-753f-46f4-a1a5-e4d26580c000 req-31908a1d-07ba-4201-a42a-3affeadab7e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:03.559855 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06fb0cc5-753f-46f4-a1a5-e4d26580c000 req-31908a1d-07ba-4201-a42a-3affeadab7e9 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 1096 time: 0.0818641 May 12 16:23:03.697980 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06fb0cc5-753f-46f4-a1a5-e4d26580c000 req-4a50d48a-ef74-4f6a-a298-6d308fc9a79d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:03.699677 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06fb0cc5-753f-46f4-a1a5-e4d26580c000 req-4a50d48a-ef74-4f6a-a298-6d308fc9a79d service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1292391 May 12 16:23:03.726425 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-366dbd8f-a1e1-4933-aa63-68523923d17c req-f61f5edb-fc07-4efb-8a15-ab9ebc88dd87 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:03.733410 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-366dbd8f-a1e1-4933-aa63-68523923d17c req-f61f5edb-fc07-4efb-8a15-ab9ebc88dd87 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0802917 May 12 16:23:03.778734 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-366dbd8f-a1e1-4933-aa63-68523923d17c req-f18c15fe-56e3-4b93-b6fc-c70cb0865d68 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438225 May 12 16:23:03.810519 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06fb0cc5-753f-46f4-a1a5-e4d26580c000 req-deaadad2-0b78-47d3-9da6-975b3d296f96 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88 HTTP/1.1" status: 200 len: 1001 time: 0.1050439 May 12 16:23:03.877861 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06fb0cc5-753f-46f4-a1a5-e4d26580c000 req-a176c0fe-9d63-40ed-a86e-3c929ab7b99f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:03.879279 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06fb0cc5-753f-46f4-a1a5-e4d26580c000 req-a176c0fe-9d63-40ed-a86e-3c929ab7b99f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0621042 May 12 16:23:03.967665 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06fb0cc5-753f-46f4-a1a5-e4d26580c000 req-39a0e378-1c14-47b4-8da6-5a20838b60a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:03.969142 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06fb0cc5-753f-46f4-a1a5-e4d26580c000 req-39a0e378-1c14-47b4-8da6-5a20838b60a4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0713425 May 12 16:23:04.103016 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06fb0cc5-753f-46f4-a1a5-e4d26580c000 req-c33d790e-f559-48ed-8442-3728cc56b4be service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1264403 May 12 16:23:04.238516 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06fb0cc5-753f-46f4-a1a5-e4d26580c000 req-afec27ac-05f7-4dea-9f19-6ebe58fa6cdf service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1265016 May 12 16:23:04.965725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78c8e9cc-ff9a-4d29-8602-eb8bbd31314c req-2a366ae5-26a0-4826-bbc6-ef8128145b29 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:04.967169 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78c8e9cc-ff9a-4d29-8602-eb8bbd31314c req-2a366ae5-26a0-4826-bbc6-ef8128145b29 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 945 time: 0.0830157 May 12 16:23:05.012113 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-78c8e9cc-ff9a-4d29-8602-eb8bbd31314c req-2381e353-7f02-4328-bac0-6c8fc9d2c5aa tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392370 May 12 16:23:05.929607 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8f8cebb9-f3dc-4a14-a548-614afd12cf88 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:23:06.043517 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:06.076741 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:23:06.088102 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8f8cebb9-f3dc-4a14-a548-614afd12cf88, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:23:06.092096 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:06.154125 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-03cb5881-f094-41fd-8a98-eb68183ea7d4'] response: {'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'code': 200} May 12 16:23:06.173288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=8f8cebb9-f3dc-4a14-a548-614afd12cf88,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:23:06.381990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a0fb8d-8495-497f-ba6f-a1e99bf9ba4a req-3b0fd160-0b46-4875-bf9c-b54f73333c38 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:06.383424 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73a0fb8d-8495-497f-ba6f-a1e99bf9ba4a req-3b0fd160-0b46-4875-bf9c-b54f73333c38 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0832770 May 12 16:23:06.426443 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-73a0fb8d-8495-497f-ba6f-a1e99bf9ba4a req-8ad1178a-27c0-43a6-868b-dbd78d8506ce tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0374787 May 12 16:23:06.783064 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9c688c9-6cea-4cd8-a71e-6fd6d58476ea req-00b69a8d-57b3-48c1-bd70-3b0534351895 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:06.784517 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9c688c9-6cea-4cd8-a71e-6fd6d58476ea req-00b69a8d-57b3-48c1-bd70-3b0534351895 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0817139 May 12 16:23:06.830458 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9c688c9-6cea-4cd8-a71e-6fd6d58476ea req-0ce10382-8193-4286-8dcc-39dcb13c18a0 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399685 May 12 16:23:07.108991 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6bd0f532-cc7a-4800-a69c-f9562914b50d req-56db9d53-d5d8-4376-a648-51a5c1bb2db1 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1153378 May 12 16:23:08.019403 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c934056-e0a2-4526-9fa7-26a30a2b074b req-fc720ec0-b00b-499a-9991-5ce545f308cd tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:08.020837 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c934056-e0a2-4526-9fa7-26a30a2b074b req-fc720ec0-b00b-499a-9991-5ce545f308cd tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0852969 May 12 16:23:08.065590 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c934056-e0a2-4526-9fa7-26a30a2b074b req-2d09251d-15ff-4517-bdfa-c867d9f21fa4 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385046 May 12 16:23:08.097701 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bd0f532-cc7a-4800-a69c-f9562914b50d req-655411ba-938d-46d2-9a01-341b5cb67070 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:08.099190 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6bd0f532-cc7a-4800-a69c-f9562914b50d req-655411ba-938d-46d2-9a01-341b5cb67070 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80&tenant_id=6b4fff63f40147c189245b3a596d32b4 HTTP/1.1" status: 200 len: 1094 time: 0.0717850 May 12 16:23:08.214715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bd0f532-cc7a-4800-a69c-f9562914b50d req-8c33336c-1e95-4d3e-9db1-a70ef9fd4bc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:08.216106 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6bd0f532-cc7a-4800-a69c-f9562914b50d req-8c33336c-1e95-4d3e-9db1-a70ef9fd4bc6 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 1094 time: 0.0765121 May 12 16:23:08.354082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bd0f532-cc7a-4800-a69c-f9562914b50d req-575092cb-db0c-49cf-b173-b3f9f606154c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:08.355514 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6bd0f532-cc7a-4800-a69c-f9562914b50d req-575092cb-db0c-49cf-b173-b3f9f606154c service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1302843 May 12 16:23:08.460017 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6bd0f532-cc7a-4800-a69c-f9562914b50d req-668f8ce0-7ccc-4847-b5de-b9ccb214e5c1 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88 HTTP/1.1" status: 200 len: 999 time: 0.0941298 May 12 16:23:08.527426 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bd0f532-cc7a-4800-a69c-f9562914b50d req-8eed6f07-6188-406c-b618-247a006ac08e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:08.528813 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6bd0f532-cc7a-4800-a69c-f9562914b50d req-8eed6f07-6188-406c-b618-247a006ac08e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0603945 May 12 16:23:08.606354 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bd0f532-cc7a-4800-a69c-f9562914b50d req-50da4d14-6807-4b23-9f0b-760fc1a810cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:08.607808 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6bd0f532-cc7a-4800-a69c-f9562914b50d req-50da4d14-6807-4b23-9f0b-760fc1a810cb service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0690222 May 12 16:23:08.742103 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6bd0f532-cc7a-4800-a69c-f9562914b50d req-2d3ec85c-4c24-4587-925d-bdc375a4f0cd service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1248195 May 12 16:23:08.984603 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6bd0f532-cc7a-4800-a69c-f9562914b50d req-d0ba314f-b964-487b-b86d-9ae469198964 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2329259 May 12 16:23:09.259863 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c030752-4953-4ab0-a01d-75d1db0d4880 req-2e50e6b2-d65b-40cc-9458-fdc607c95a1d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:09.261337 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c030752-4953-4ab0-a01d-75d1db0d4880 req-2e50e6b2-d65b-40cc-9458-fdc607c95a1d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0837438 May 12 16:23:09.306273 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7c030752-4953-4ab0-a01d-75d1db0d4880 req-9082973f-39a8-4d94-8ed7-8807b51bd0a0 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393991 May 12 16:23:10.507502 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9195bba5-d9a5-44fd-9cc0-96efe0bbd98e req-87d7ce44-118a-4207-961d-61efdb369813 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:10.508989 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9195bba5-d9a5-44fd-9cc0-96efe0bbd98e req-87d7ce44-118a-4207-961d-61efdb369813 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0891500 May 12 16:23:10.557055 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9195bba5-d9a5-44fd-9cc0-96efe0bbd98e req-16dda8a1-832c-4896-9912-a8afa8d3d3a6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411351 May 12 16:23:11.757957 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ad4ffb-ad54-4a42-82ee-acce3bd71fd8 req-a8109f31-c76b-4d4a-85ba-4abdc2515fbc tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:11.759448 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01ad4ffb-ad54-4a42-82ee-acce3bd71fd8 req-a8109f31-c76b-4d4a-85ba-4abdc2515fbc tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0915313 May 12 16:23:11.913933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-01ad4ffb-ad54-4a42-82ee-acce3bd71fd8 req-0b5600fb-ce14-4b11-a8b4-8023dde42fa1 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1480300 May 12 16:23:12.910104 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-de0d8c30-8615-4ae0-b27f-f5dd6def0fbe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:13.116241 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4dbfda8-efad-4854-a44f-0af9746ab548 req-7272fe28-3b70-4bae-8fe2-9efd3ee894ba tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:13.122619 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4dbfda8-efad-4854-a44f-0af9746ab548 req-7272fe28-3b70-4bae-8fe2-9efd3ee894ba tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.1013405 May 12 16:23:13.171411 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a4dbfda8-efad-4854-a44f-0af9746ab548 req-64dea854-eb65-4529-ba0d-f1449ae478b4 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437443 May 12 16:23:13.851954 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:14.391134 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650968da-aca2-4f94-aa16-ff5d385c2b86 req-1382829e-acda-40f5-a96f-bb21da420b58 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:14.392891 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-650968da-aca2-4f94-aa16-ff5d385c2b86 req-1382829e-acda-40f5-a96f-bb21da420b58 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0954590 May 12 16:23:14.442828 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-650968da-aca2-4f94-aa16-ff5d385c2b86 req-b666f4cb-6278-4d1b-baae-9beb3721af42 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429101 May 12 16:23:15.439849 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0eaa42da-32b2-460e-9b4b-eca7859a15a1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:15.638587 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0c7066d-b597-4b01-a51b-caa85a78215d req-f8d67d69-0cde-41ff-8634-3a9f5b6475a6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:15.639988 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0c7066d-b597-4b01-a51b-caa85a78215d req-f8d67d69-0cde-41ff-8634-3a9f5b6475a6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0836112 May 12 16:23:15.687062 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a0c7066d-b597-4b01-a51b-caa85a78215d req-4c6f0454-5b54-4d51-8855-2782a77c3fad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413487 May 12 16:23:16.173074 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:16.463709 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:16.889462 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12684e32-aa59-45db-baf7-963d81f36b2e req-f03066de-42ea-4812-868f-bfc87457be3a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:16.891049 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12684e32-aa59-45db-baf7-963d81f36b2e req-f03066de-42ea-4812-868f-bfc87457be3a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0897093 May 12 16:23:16.939986 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-12684e32-aa59-45db-baf7-963d81f36b2e req-22466fdc-1021-47d5-a800-4b7d4ee8f032 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427270 May 12 16:23:17.935204 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:18.127789 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56a704cd-0374-4dcf-87c0-a97e912294a1 req-92dc709d-53dd-4b00-bb55-564badadb6de tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:18.129226 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56a704cd-0374-4dcf-87c0-a97e912294a1 req-92dc709d-53dd-4b00-bb55-564badadb6de tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0788743 May 12 16:23:18.181197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-56a704cd-0374-4dcf-87c0-a97e912294a1 req-452948ed-8dde-4fc6-a625-00cc3259683b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423892 May 12 16:23:18.517822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1e9a1c-c0bc-479b-9254-f2edc1da20d9 req-fec3b340-a85f-4aee-b1b7-180ba2579050 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:18.519279 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc1e9a1c-c0bc-479b-9254-f2edc1da20d9 req-fec3b340-a85f-4aee-b1b7-180ba2579050 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 1094 time: 0.0740795 May 12 16:23:18.663490 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1e9a1c-c0bc-479b-9254-f2edc1da20d9 req-6e6990b5-366a-4a07-ac2b-df2459602118 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:18.664919 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc1e9a1c-c0bc-479b-9254-f2edc1da20d9 req-6e6990b5-366a-4a07-ac2b-df2459602118 service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1258843 May 12 16:23:18.769315 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc1e9a1c-c0bc-479b-9254-f2edc1da20d9 req-0c6f3262-9127-4f0d-9559-9da00ab7d074 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88 HTTP/1.1" status: 200 len: 999 time: 0.0982995 May 12 16:23:18.832648 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1e9a1c-c0bc-479b-9254-f2edc1da20d9 req-d0291b18-c3e7-40cf-9c0d-27df5e0f5d50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:18.834109 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc1e9a1c-c0bc-479b-9254-f2edc1da20d9 req-d0291b18-c3e7-40cf-9c0d-27df5e0f5d50 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0578296 May 12 16:23:18.908203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1e9a1c-c0bc-479b-9254-f2edc1da20d9 req-a45a1818-a3cd-431f-8822-1286ee65a5ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:18.909751 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc1e9a1c-c0bc-479b-9254-f2edc1da20d9 req-a45a1818-a3cd-431f-8822-1286ee65a5ea service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0691917 May 12 16:23:19.043608 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc1e9a1c-c0bc-479b-9254-f2edc1da20d9 req-8e115d25-8fc8-4d03-8bfa-1c3f8f68e1aa service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1275623 May 12 16:23:19.174411 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-bc1e9a1c-c0bc-479b-9254-f2edc1da20d9 req-e96f1383-abad-4471-b7cf-342772757b00 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1239393 May 12 16:23:19.367275 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0cc8213-60e5-4df1-8118-c529fb8b3bb8 req-06957821-198a-4146-81d4-ab5cc952ca9c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:19.369038 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0cc8213-60e5-4df1-8118-c529fb8b3bb8 req-06957821-198a-4146-81d4-ab5cc952ca9c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 943 time: 0.0793612 May 12 16:23:19.416135 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0cc8213-60e5-4df1-8118-c529fb8b3bb8 req-68270780-d72e-469c-9057-c7fdccff9367 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413730 May 12 16:23:19.978345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8f8cebb9-f3dc-4a14-a548-614afd12cf88 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:23:20.110668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8f8cebb9-f3dc-4a14-a548-614afd12cf88, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:23:20.124042 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'port_id': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'mac_address': 'fa:16:3e:86:7e:79', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 553, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:23:20.184132 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:20.202113 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8f8cebb9-f3dc-4a14-a548-614afd12cf88 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:23:20.217635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8f8cebb9-f3dc-4a14-a548-614afd12cf88, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:23:20.221606 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:20.288596 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=8f8cebb9-f3dc-4a14-a548-614afd12cf88,revision_number=9']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:23:20.598998 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['8f8cebb9-f3dc-4a14-a548-614afd12cf88'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:23:20.608651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a886d84-5718-4e09-a0f0-45211391d689 req-f834f77f-2795-4d02-94a6-ccc79250fed7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:20.610133 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a886d84-5718-4e09-a0f0-45211391d689 req-f834f77f-2795-4d02-94a6-ccc79250fed7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 944 time: 0.0845134 May 12 16:23:20.655373 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5a886d84-5718-4e09-a0f0-45211391d689 req-80ac7f1f-e0f3-476f-8cd9-30ede535503a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385721 May 12 16:23:21.838733 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb69e1b1-bbbc-4100-b55f-5244ba1f2c0c req-4b226dee-a0c5-473f-82e3-0dba637f9667 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:21.848222 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb69e1b1-bbbc-4100-b55f-5244ba1f2c0c req-4b226dee-a0c5-473f-82e3-0dba637f9667 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 944 time: 0.0891573 May 12 16:23:21.891208 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bb69e1b1-bbbc-4100-b55f-5244ba1f2c0c req-175bf1ac-cc29-4585-bd6d-7c2bfcbcb9a9 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0371330 May 12 16:23:21.983816 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8f8cebb9-f3dc-4a14-a548-614afd12cf88 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:23:22.051619 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 8f8cebb9-f3dc-4a14-a548-614afd12cf88 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:23:22.051987 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:22.166713 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:22.192735 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:23:22.202873 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 8f8cebb9-f3dc-4a14-a548-614afd12cf88, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:23:22.206807 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:22.238973 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b3870bb3-c67d-4fde-934a-fcf04e472ed7'] response: {'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'code': 200} May 12 16:23:22.276562 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=8f8cebb9-f3dc-4a14-a548-614afd12cf88,revision_number=10']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:23:22.518976 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cb11bbf-7bd4-401d-868a-6dd5e3bda76c req-581a0b17-a575-4837-8e63-94ade4fc7985 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:22.520367 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4cb11bbf-7bd4-401d-868a-6dd5e3bda76c req-581a0b17-a575-4837-8e63-94ade4fc7985 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 1097 time: 0.0804057 May 12 16:23:22.567113 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4cb11bbf-7bd4-401d-868a-6dd5e3bda76c req-5f68a311-1c64-4b5a-8fc5-40b310a4eaef service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0378597 May 12 16:23:23.080389 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f360c6e3-ddd4-4734-a9eb-771084e4b789 req-541c90ed-084a-4417-bb99-46d4766b6431 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:23.081854 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f360c6e3-ddd4-4734-a9eb-771084e4b789 req-541c90ed-084a-4417-bb99-46d4766b6431 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 946 time: 0.0833089 May 12 16:23:23.127818 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f360c6e3-ddd4-4734-a9eb-771084e4b789 req-ad2c131c-30b5-4887-8665-b34a59a186df tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396388 May 12 16:23:24.322833 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a4a924b-7b5d-4cb1-960f-fbd910ca7612 req-2ee0f85a-e5e4-4b83-bef5-f7613d62f4d2 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:24.324320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a4a924b-7b5d-4cb1-960f-fbd910ca7612 req-2ee0f85a-e5e4-4b83-bef5-f7613d62f4d2 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 946 time: 0.0898373 May 12 16:23:24.373130 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3a4a924b-7b5d-4cb1-960f-fbd910ca7612 req-36d66d1a-ab7f-420c-b47f-f1b966c1137c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423963 May 12 16:23:25.558070 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d17b8f49-dfed-494e-9750-ac5329b98cc3 req-f4400c17-c350-4265-8c7c-7d02d5da0bf1 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:25.559388 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d17b8f49-dfed-494e-9750-ac5329b98cc3 req-f4400c17-c350-4265-8c7c-7d02d5da0bf1 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 946 time: 0.0793231 May 12 16:23:25.603743 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d17b8f49-dfed-494e-9750-ac5329b98cc3 req-62c151e7-e655-41a0-b83a-360e59dbc196 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388210 May 12 16:23:30.956814 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:23:33.015700 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:42.917809 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-be760e7e-45fb-4916-a668-4c037ca7ead1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:43.848287 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:45.442093 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f4b4ec24-6aa5-4342-9fd7-4ca6cc9f3443 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:46.175271 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:46.310403 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63925fd5-b7ec-404a-a461-b7b32c707324 req-03842a7f-02a2-4ba9-9e27-15ee25b7edc6 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0835841 May 12 16:23:46.421233 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63925fd5-b7ec-404a-a461-b7b32c707324 req-17197148-bb9c-4b1a-8731-6d305a83611d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0432231 May 12 16:23:46.464664 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:23:46.465768 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63925fd5-b7ec-404a-a461-b7b32c707324 req-15c0636b-2d67-44d3-8338-bfb1d51cd437 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0257716 May 12 16:23:46.600258 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63925fd5-b7ec-404a-a461-b7b32c707324 req-940fef3f-9d7d-49f8-af28-532d308277ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:23:46.602248 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-63925fd5-b7ec-404a-a461-b7b32c707324 req-940fef3f-9d7d-49f8-af28-532d308277ce service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1307018 May 12 16:23:47.939565 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:03.029107 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:07.956739 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:24:11.057897 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8d59be44-6e52-4b1d-b46c-0f3f095ca8ed req-4a722cb7-b08d-43fe-b0e7-e8614ab4d7fb service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.1152337 May 12 16:24:11.238758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d59be44-6e52-4b1d-b46c-0f3f095ca8ed req-43f0500b-6366-4ce8-93cc-d17e43e874ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:24:11.240199 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8d59be44-6e52-4b1d-b46c-0f3f095ca8ed req-43f0500b-6366-4ce8-93cc-d17e43e874ff service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 1097 time: 0.0773492 May 12 16:24:11.392554 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d59be44-6e52-4b1d-b46c-0f3f095ca8ed req-7695f472-e7b6-468f-a528-a413ab299514 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:24:11.393926 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8d59be44-6e52-4b1d-b46c-0f3f095ca8ed req-7695f472-e7b6-468f-a528-a413ab299514 service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1293676 May 12 16:24:11.603740 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8d59be44-6e52-4b1d-b46c-0f3f095ca8ed req-af8e0b7b-cdfe-410f-bff5-9ea4167d42f0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88 HTTP/1.1" status: 200 len: 1001 time: 0.2009518 May 12 16:24:11.667128 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d59be44-6e52-4b1d-b46c-0f3f095ca8ed req-91effa40-fc9e-411b-8a90-2a1ced0bcc3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:24:11.668414 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8d59be44-6e52-4b1d-b46c-0f3f095ca8ed req-91effa40-fc9e-411b-8a90-2a1ced0bcc3b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0557656 May 12 16:24:11.745821 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d59be44-6e52-4b1d-b46c-0f3f095ca8ed req-ee3ed813-663d-4930-b070-c65497fcd63f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:24:11.747221 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8d59be44-6e52-4b1d-b46c-0f3f095ca8ed req-ee3ed813-663d-4930-b070-c65497fcd63f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0690556 May 12 16:24:11.882888 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8d59be44-6e52-4b1d-b46c-0f3f095ca8ed req-b1cc6784-1909-41bc-b3a4-b045519e052c service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1258876 May 12 16:24:12.016321 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-8d59be44-6e52-4b1d-b46c-0f3f095ca8ed req-eff39f20-5b18-4935-be36-0a593f751095 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1240859 May 12 16:24:12.909953 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9e469e9e-b01b-4b8f-9940-841b064fb3fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:13.846330 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:15.443801 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b6c9c1b6-be7a-4ff1-aed7-91e877eecb69 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:16.177672 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:16.466460 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:17.942496 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:33.045552 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:39.144251 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56898) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:24:39.349167 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Deleting port c4ef2413-0d26-49e4-ae10-592a7d07679d {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:24:39.349532 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:39.515234 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:39.515558 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:39.640288 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Calling delete_port for c4ef2413-0d26-49e4-ae10-592a7d07679d owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:24:39.793604 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:39.845505 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event deleted for resources: {'Port': ['ID=c4ef2413-0d26-49e4-ae10-592a7d07679d,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:24:39.886549 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:39.887431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:39.887770 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:39.888099 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:39.888419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:39.888738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:39.889056 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:39.889370 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:39.889707 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:39.890024 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:39.890346 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:39.890655 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:39.945204 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:39.945591 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Floating IP ab6420c0-7a95-47bb-85cd-5fe51d4a2ff3 disassociated (deleted). External IP: 172.25.8.106, port: 8f8cebb9-f3dc-4a14-a548-614afd12cf88. May 12 16:24:40.396897 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:24:40.575665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:24:40.585178 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09a0c846-7224-4eb5-9393-2d5b1a05a0b1 None None] Sync routers for ids ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:24:40.587964 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:40.594897 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09a0c846-7224-4eb5-9393-2d5b1a05a0b1 None None] Routers {'99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:24:40.595488 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-09a0c846-7224-4eb5-9393-2d5b1a05a0b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:24:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:24:40.646083 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ce89a8a7-ffa6-473c-acfe-12025b3ba796 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "DELETE /v2.0/floatingips/ab6420c0-7a95-47bb-85cd-5fe51d4a2ff3 HTTP/1.1" status: 204 len: 168 time: 1.5008230 May 12 16:24:40.646665 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:24:40.701071 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-032d6748-a341-48d6-b020-cbf1913042bf'] response: {'name': 'network-changed', 'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'status': 'completed', 'code': 200} May 12 16:24:40.772254 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-09a0c846-7224-4eb5-9393-2d5b1a05a0b1 None None] Set router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:24:40.822979 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87c3ba4-adb1-48ff-8c51-123f796c91ad req-b91c21de-b427-4c5d-9b69-37bf51eca832 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:24:40.826237 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a87c3ba4-adb1-48ff-8c51-123f796c91ad req-b91c21de-b427-4c5d-9b69-37bf51eca832 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 1097 time: 0.0783052 May 12 16:24:40.970208 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87c3ba4-adb1-48ff-8c51-123f796c91ad req-1b432c62-0c77-42fd-9827-c19f07058f3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:24:40.972010 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a87c3ba4-adb1-48ff-8c51-123f796c91ad req-1b432c62-0c77-42fd-9827-c19f07058f3d service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1372473 May 12 16:24:41.043623 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a87c3ba4-adb1-48ff-8c51-123f796c91ad req-7281828e-b5be-4f72-a3b3-f876d56ef241 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88 HTTP/1.1" status: 200 len: 217 time: 0.0616155 May 12 16:24:41.051808 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-845ae499-fa16-4ced-89ee-980e009c0393 req-ed60a031-63d8-4e05-8981-06d2e2afe2a8 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:24:41.052576 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-845ae499-fa16-4ced-89ee-980e009c0393 req-ed60a031-63d8-4e05-8981-06d2e2afe2a8 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Synchronizing usage tracker for tenant:6b4fff63f40147c189245b3a596d32b4 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:24:41.070668 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-845ae499-fa16-4ced-89ee-980e009c0393 req-ed60a031-63d8-4e05-8981-06d2e2afe2a8 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Unset dirty status for tenant:6b4fff63f40147c189245b3a596d32b4 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:24:41.072100 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-845ae499-fa16-4ced-89ee-980e009c0393 req-ed60a031-63d8-4e05-8981-06d2e2afe2a8 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 946 time: 0.1010923 May 12 16:24:41.108208 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-09a0c846-7224-4eb5-9393-2d5b1a05a0b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:23Z', 'revision_number': 5, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:24:41.111993 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09a0c846-7224-4eb5-9393-2d5b1a05a0b1 None None] Checking router: 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:24:41.112383 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87c3ba4-adb1-48ff-8c51-123f796c91ad req-571dd674-5ef8-485c-b1fb-d17c39f3e787 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:24:41.113913 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a87c3ba4-adb1-48ff-8c51-123f796c91ad req-571dd674-5ef8-485c-b1fb-d17c39f3e787 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0633831 May 12 16:24:41.120280 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09a0c846-7224-4eb5-9393-2d5b1a05a0b1 None None] Routers {'99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:24:41.120862 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-09a0c846-7224-4eb5-9393-2d5b1a05a0b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:24:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:24:41.124389 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-845ae499-fa16-4ced-89ee-980e009c0393 req-1cd69dd0-bc75-4cac-89d3-1abd871e2206 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420680 May 12 16:24:41.189984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87c3ba4-adb1-48ff-8c51-123f796c91ad req-07b95d0f-1b4c-400c-95f9-0b2bb452cdf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:24:41.191445 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a87c3ba4-adb1-48ff-8c51-123f796c91ad req-07b95d0f-1b4c-400c-95f9-0b2bb452cdf2 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0710275 May 12 16:24:41.303718 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-09a0c846-7224-4eb5-9393-2d5b1a05a0b1 None None] Set router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:24:41.325775 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a87c3ba4-adb1-48ff-8c51-123f796c91ad req-1dadac25-aa40-4878-a39e-7c1452de8d1c service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1274388 May 12 16:24:41.459847 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a87c3ba4-adb1-48ff-8c51-123f796c91ad req-28e40215-af6e-49c8-8c00-009cd6f06e08 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1273572 May 12 16:24:41.618540 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-09a0c846-7224-4eb5-9393-2d5b1a05a0b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:23Z', 'revision_number': 5, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:24:41.622935 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09a0c846-7224-4eb5-9393-2d5b1a05a0b1 None None] The sync data for ids ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'] in n-d-841483-1 is: [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:23Z', 'revision_number': 5, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:24:41.830223 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b24d6690-6c7d-429f-be1f-2bbc0942f5f6 None None] New status for floating IP ab6420c0-7a95-47bb-85cd-5fe51d4a2ff3: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:24:42.318419 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cecabeef-238d-4c14-a26d-731f0a147b6e req-e51415f1-e2cd-4c53-b247-dde7fc987ed3 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:24:42.319878 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cecabeef-238d-4c14-a26d-731f0a147b6e req-e51415f1-e2cd-4c53-b247-dde7fc987ed3 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 946 time: 0.0851727 May 12 16:24:42.365352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cecabeef-238d-4c14-a26d-731f0a147b6e req-4b0edc21-34cd-4f72-acc3-cf8410ea1c2b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=29493af2-02ca-4fa1-95b5-6daf584d74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0382228 May 12 16:24:42.642228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16c2cace-9481-4cbe-a69a-8f02c5e397dc req-5639068c-8a94-4859-8018-bc7724cb0f91 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:24:42.642825 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-16c2cace-9481-4cbe-a69a-8f02c5e397dc req-5639068c-8a94-4859-8018-bc7724cb0f91 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Synchronizing usage tracker for tenant:6b4fff63f40147c189245b3a596d32b4 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:24:42.655202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-16c2cace-9481-4cbe-a69a-8f02c5e397dc req-5639068c-8a94-4859-8018-bc7724cb0f91 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Unset dirty status for tenant:6b4fff63f40147c189245b3a596d32b4 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:24:42.656292 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-16c2cace-9481-4cbe-a69a-8f02c5e397dc req-5639068c-8a94-4859-8018-bc7724cb0f91 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.84 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 946 time: 0.0976801 May 12 16:24:42.729079 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-16c2cace-9481-4cbe-a69a-8f02c5e397dc req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Deleting port 8f8cebb9-f3dc-4a14-a548-614afd12cf88 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:24:42.729437 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-16c2cace-9481-4cbe-a69a-8f02c5e397dc req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:42.912678 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-226ed38c-1532-4e45-a0dc-0d063c72d56f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:42.983189 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-16c2cace-9481-4cbe-a69a-8f02c5e397dc req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] For port 8f8cebb9-f3dc-4a14-a548-614afd12cf88, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=8f8cebb9-f3dc-4a14-a548-614afd12cf88,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:24:42.983543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-16c2cace-9481-4cbe-a69a-8f02c5e397dc req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:43.104803 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-16c2cace-9481-4cbe-a69a-8f02c5e397dc req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Calling delete_port for 8f8cebb9-f3dc-4a14-a548-614afd12cf88 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:24:43.360412 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-16c2cace-9481-4cbe-a69a-8f02c5e397dc req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:43.408187 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event deleted for resources: {'Port': ['ID=8f8cebb9-f3dc-4a14-a548-614afd12cf88,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:24:43.418170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:43.418575 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:43.419018 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:43.419424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:43.419745 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:43.420061 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:43.420375 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:43.420685 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:43.420993 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:43.421303 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:43.421659 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:43.421972 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:24:43.500365 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-16c2cace-9481-4cbe-a69a-8f02c5e397dc req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] No DVR routers for this DVR port 8f8cebb9-f3dc-4a14-a548-614afd12cf88 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:24:43.502976 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-16c2cace-9481-4cbe-a69a-8f02c5e397dc req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:43.505601 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'name': 'network-vif-deleted', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:24:43.523759 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-16c2cace-9481-4cbe-a69a-8f02c5e397dc req-b3b1d78a-4b45-47c0-8181-e242c5a35aad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.84 "DELETE /v2.0/ports/8f8cebb9-f3dc-4a14-a548-614afd12cf88 HTTP/1.1" status: 204 len: 173 time: 0.8616860 May 12 16:24:43.527481 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-42a04c2f-fc4d-407a-9c55-bffa9158e1e8 req-21bc395a-66ab-471f-af64-e9cf8fad8b93 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=9ef8e7ad-952e-47f5-9297-52cfb5056d80 HTTP/1.1" status: 200 len: 210 time: 0.0472088 May 12 16:24:43.617311 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ddd6a7e2-b93d-4208-855a-957c8ae6548a'] response: {'server_uuid': '9ef8e7ad-952e-47f5-9297-52cfb5056d80', 'name': 'network-vif-deleted', 'tag': '8f8cebb9-f3dc-4a14-a548-614afd12cf88', 'status': 'completed', 'code': 200} May 12 16:24:43.854383 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:44.621102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56918) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:24:44.693118 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd2cd507-750a-4349-8935-eabe67d591fb tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:44.723620 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd2cd507-750a-4349-8935-eabe67d591fb tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:44.790264 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd2cd507-750a-4349-8935-eabe67d591fb tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:44.809366 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd2cd507-750a-4349-8935-eabe67d591fb tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=29493af2-02ca-4fa1-95b5-6daf584d74a5,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:24:44.821195 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bd2cd507-750a-4349-8935-eabe67d591fb tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:44.822269 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bd2cd507-750a-4349-8935-eabe67d591fb tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "DELETE /v2.0/security-groups/29493af2-02ca-4fa1-95b5-6daf584d74a5 HTTP/1.1" status: 204 len: 168 time: 0.2001767 May 12 16:24:44.940757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56926) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:24:44.945941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1586943972', 'description': 'tempest-secgroup-smoke-1586943972 description', 'project_id': '6b4fff63f40147c189245b3a596d32b4'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:24:44.953490 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:24:44.957078 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:24:44.957784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:24:44.960752 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:24:44.966805 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:24:44.977003 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:44.998130 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:24:45.003955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:24:45.007373 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:24:45.014213 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:24:45.085768 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.089204 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.135411 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'SecurityGroup': ['ID=18a9595e-e477-48a6-8dbc-4c992dad06e8,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:24:45.143173 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.144343 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-37646e16-0357-4cd1-80bd-f655076a9225 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.2025905 May 12 16:24:45.147192 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56930) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:24:45.152138 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a758c39e-881e-44ba-bae1-5df174156499 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'security_group_rule': {'security_group_id': '18a9595e-e477-48a6-8dbc-4c992dad06e8', 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:24:45.159394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a758c39e-881e-44ba-bae1-5df174156499 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:24:45.163219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a758c39e-881e-44ba-bae1-5df174156499 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:24:45.166035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a758c39e-881e-44ba-bae1-5df174156499 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:24:45.171737 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a758c39e-881e-44ba-bae1-5df174156499 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:24:45.188413 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a758c39e-881e-44ba-bae1-5df174156499 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.250520 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a758c39e-881e-44ba-bae1-5df174156499 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.255519 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a758c39e-881e-44ba-bae1-5df174156499 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.279430 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a758c39e-881e-44ba-bae1-5df174156499 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=536808af-e2f9-4d68-9ef8-fd6f42cd4604,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:24:45.288240 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a758c39e-881e-44ba-bae1-5df174156499 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.289497 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a758c39e-881e-44ba-bae1-5df174156499 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1413324 May 12 16:24:45.292401 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56934) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:24:45.297918 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-79f26fe8-b521-4d54-b6d4-1ba847c97675 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'security_group_rule': {'security_group_id': '18a9595e-e477-48a6-8dbc-4c992dad06e8', 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:24:45.304335 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-79f26fe8-b521-4d54-b6d4-1ba847c97675 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:24:45.308116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-79f26fe8-b521-4d54-b6d4-1ba847c97675 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:24:45.311759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-79f26fe8-b521-4d54-b6d4-1ba847c97675 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:24:45.317325 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-79f26fe8-b521-4d54-b6d4-1ba847c97675 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:24:45.333405 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79f26fe8-b521-4d54-b6d4-1ba847c97675 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.394045 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79f26fe8-b521-4d54-b6d4-1ba847c97675 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.398005 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79f26fe8-b521-4d54-b6d4-1ba847c97675 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.422446 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79f26fe8-b521-4d54-b6d4-1ba847c97675 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fdc24ecb-9dc3-4003-aca7-b05672e99b47,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:24:45.432577 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-79f26fe8-b521-4d54-b6d4-1ba847c97675 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.433941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-79f26fe8-b521-4d54-b6d4-1ba847c97675 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1405375 May 12 16:24:45.438143 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56938) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:24:45.443245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-8dfee93a-b297-4f94-8434-6d517111a20c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'security_group_rule': {'security_group_id': '18a9595e-e477-48a6-8dbc-4c992dad06e8', 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:24:45.448085 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3b5975ba-27b2-4b04-8cf4-903d5ec5faf8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.452058 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8dfee93a-b297-4f94-8434-6d517111a20c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:24:45.456467 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8dfee93a-b297-4f94-8434-6d517111a20c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:24:45.459368 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-8dfee93a-b297-4f94-8434-6d517111a20c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:24:45.465670 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-8dfee93a-b297-4f94-8434-6d517111a20c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:24:45.480662 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dfee93a-b297-4f94-8434-6d517111a20c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.544533 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dfee93a-b297-4f94-8434-6d517111a20c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.547976 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dfee93a-b297-4f94-8434-6d517111a20c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.571696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dfee93a-b297-4f94-8434-6d517111a20c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8fd26a6c-a686-4e1b-81a2-603f76c08989,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:24:45.580155 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8dfee93a-b297-4f94-8434-6d517111a20c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.581408 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8dfee93a-b297-4f94-8434-6d517111a20c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1423092 May 12 16:24:45.584098 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56942) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:24:45.588949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-21ced299-ba16-4a83-9915-d1faeea732d7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'security_group_rule': {'security_group_id': '18a9595e-e477-48a6-8dbc-4c992dad06e8', 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:24:45.596590 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-21ced299-ba16-4a83-9915-d1faeea732d7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:24:45.600508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-21ced299-ba16-4a83-9915-d1faeea732d7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:24:45.603423 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-21ced299-ba16-4a83-9915-d1faeea732d7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:24:45.610191 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-21ced299-ba16-4a83-9915-d1faeea732d7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:24:45.627473 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21ced299-ba16-4a83-9915-d1faeea732d7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.692112 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21ced299-ba16-4a83-9915-d1faeea732d7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.695277 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21ced299-ba16-4a83-9915-d1faeea732d7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.718120 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21ced299-ba16-4a83-9915-d1faeea732d7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=64aa597c-5e38-40cd-a98b-f6bc223ca9f3,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:24:45.727768 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-21ced299-ba16-4a83-9915-d1faeea732d7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.728929 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-21ced299-ba16-4a83-9915-d1faeea732d7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1439009 May 12 16:24:45.732511 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56946) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:24:45.737278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-bb4afd46-41f7-44a9-bd52-e2fd8bbca96f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'security_group_rule': {'security_group_id': '18a9595e-e477-48a6-8dbc-4c992dad06e8', 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:24:45.743658 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bb4afd46-41f7-44a9-bd52-e2fd8bbca96f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:24:45.751236 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bb4afd46-41f7-44a9-bd52-e2fd8bbca96f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:24:45.754106 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-bb4afd46-41f7-44a9-bd52-e2fd8bbca96f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:24:45.759589 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-bb4afd46-41f7-44a9-bd52-e2fd8bbca96f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:24:45.770667 n-d-841483-1 neutron-server[88152]: INFO neutron.db.securitygroups_db [None req-bb4afd46-41f7-44a9-bd52-e2fd8bbca96f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Project 6b4fff63f40147c189245b3a596d32b4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:24:45.777092 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb4afd46-41f7-44a9-bd52-e2fd8bbca96f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.846097 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb4afd46-41f7-44a9-bd52-e2fd8bbca96f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.849877 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb4afd46-41f7-44a9-bd52-e2fd8bbca96f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.873912 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb4afd46-41f7-44a9-bd52-e2fd8bbca96f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9d779277-4f64-45dd-970e-655525f2462e,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:24:45.882665 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-bb4afd46-41f7-44a9-bd52-e2fd8bbca96f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.883794 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-bb4afd46-41f7-44a9-bd52-e2fd8bbca96f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1503994 May 12 16:24:45.886525 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 56950) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:24:45.891957 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-6e83ecf8-940e-4365-8883-f95f6e029f3a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'security_group_rule': {'security_group_id': '18a9595e-e477-48a6-8dbc-4c992dad06e8', 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:24:45.898408 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6e83ecf8-940e-4365-8883-f95f6e029f3a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:24:45.902333 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6e83ecf8-940e-4365-8883-f95f6e029f3a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:security_group_rule and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:24:45.906247 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-6e83ecf8-940e-4365-8883-f95f6e029f3a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:24:45.911907 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-6e83ecf8-940e-4365-8883-f95f6e029f3a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:24:45.922674 n-d-841483-1 neutron-server[88152]: INFO neutron.db.securitygroups_db [None req-6e83ecf8-940e-4365-8883-f95f6e029f3a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Project 6b4fff63f40147c189245b3a596d32b4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:24:45.929071 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e83ecf8-940e-4365-8883-f95f6e029f3a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.993489 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e83ecf8-940e-4365-8883-f95f6e029f3a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:45.997126 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e83ecf8-940e-4365-8883-f95f6e029f3a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:46.020067 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e83ecf8-940e-4365-8883-f95f6e029f3a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fc3caecd-e7fc-4849-9ad7-3580e36477f3,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:24:46.029774 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-6e83ecf8-940e-4365-8883-f95f6e029f3a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:46.030912 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-6e83ecf8-940e-4365-8883-f95f6e029f3a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1434793 May 12 16:24:46.184145 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:46.285032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8f8cebb9-f3dc-4a14-a548-614afd12cf88 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:24:46.321849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 8f8cebb9-f3dc-4a14-a548-614afd12cf88 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:24:46.322186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 8f8cebb9-f3dc-4a14-a548-614afd12cf88 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:24:46.470222 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:24:47.286287 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ea2696cc-6f44-4c44-954c-dae09576e658 req-b4355035-66fc-4af5-a896-2b1836daa644 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0455534 May 12 16:24:47.401832 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ea2696cc-6f44-4c44-954c-dae09576e658 req-de5990a8-fbe5-4d12-9d85-25234986af11 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0453887 May 12 16:24:47.446052 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ea2696cc-6f44-4c44-954c-dae09576e658 req-40727b9a-b6a4-4ba1-90db-f0121f8cc72e service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0269895 May 12 16:24:47.586238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2696cc-6f44-4c44-954c-dae09576e658 req-483d03cf-1586-49d7-abd2-3ed15fac48e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:24:47.587723 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ea2696cc-6f44-4c44-954c-dae09576e658 req-483d03cf-1586-49d7-abd2-3ed15fac48e6 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1361539 May 12 16:24:47.948834 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:00.850640 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-f023c90a-9a1a-47c9-8dd0-8b304429ec6b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Synchronizing usage tracker for tenant:6b4fff63f40147c189245b3a596d32b4 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:25:00.867268 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-f023c90a-9a1a-47c9-8dd0-8b304429ec6b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Unset dirty status for tenant:6b4fff63f40147c189245b3a596d32b4 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:25:00.868555 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-f023c90a-9a1a-47c9-8dd0-8b304429ec6b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1586943972&fields=id&tenant_id=6b4fff63f40147c189245b3a596d32b4 HTTP/1.1" status: 200 len: 267 time: 0.0597806 May 12 16:25:01.122326 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-6816eaec-3acd-45e7-893e-b4647487d6eb tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:01.123753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-6816eaec-3acd-45e7-893e-b4647487d6eb tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 808 time: 0.2460539 May 12 16:25:01.139616 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-5090b833-ce83-4f1d-87d2-a07711ca025f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/quotas/6b4fff63f40147c189245b3a596d32b4 HTTP/1.1" status: 200 len: 375 time: 0.0095243 May 12 16:25:01.231138 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8476cfba-9b15-4b6b-b601-f7aeeea3a5e0 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0854466 May 12 16:25:01.411240 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-a4f06a39-8063-413d-85fa-cedb68769260 service neutron] 10.222.0.82 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1681898 May 12 16:25:01.543366 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-f943af56-c153-43b6-8dfe-5282b30990af service neutron] 10.222.0.82 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1263998 May 12 16:25:01.916652 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c4530026-5490-410f-b2e7-6256d7bc733f req-8cd6b67e-3eed-4289-a6cc-62130d321185 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 210 time: 0.0435925 May 12 16:25:03.045434 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:03.074257 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ea30bca8-fa46-41fd-8681-d529f160d534 req-a4dd3201-bab1-4c4f-b38e-06dd06bf12a6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 210 time: 0.0462203 May 12 16:25:03.136767 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-f874ce82-c57b-4d82-8c73-f0e77d9be9d5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:03.138288 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-f874ce82-c57b-4d82-8c73-f0e77d9be9d5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 808 time: 0.1605597 May 12 16:25:03.198432 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-f512c3d9-6640-4a53-9897-d35d1726326c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6b4fff63f40147c189245b3a596d32b4 HTTP/1.1" status: 200 len: 380 time: 0.0428391 May 12 16:25:03.209907 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'port': {'device_id': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'admin_state_up': True, 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'security_groups': ['18a9595e-e477-48a6-8dbc-4c992dad06e8']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:25:03.350274 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:25:03.354272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:port and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:25:03.357089 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:25:03.363501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:25:03.373155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Made reservation on behalf of 6b4fff63f40147c189245b3a596d32b4 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:25:03.377617 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:03.544313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Allocated IP 172.20.0.5 (48e2a895-0939-4482-a024-4695162ad5b7/8139b3d1-92b7-4512-b9ab-db914dde57e3/26ea03e6-402b-442a-8a05-eedb82616657) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:25:03.741684 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:03.757255 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Transition to ACTIVE for port object 26ea03e6-402b-442a-8a05-eedb82616657 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:25:03.781139 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:03.862418 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Network 48e2a895-0939-4482-a024-4695162ad5b7 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:25:03.865660 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:25:03.868386 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:25:03.916170 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'Port': ['ID=26ea03e6-402b-442a-8a05-eedb82616657,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:25:03.945497 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:03.946111 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:03.972804 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-8387891f-c38f-4f71-98a9-11eea6b53c77 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7665203 May 12 16:25:04.002184 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Request body: {'port': {'device_id': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:25:04.122530 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:04.162957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-40ec9058-a679-4f3a-ac88-3ee0888743d6 None None] Provisioning for port 26ea03e6-402b-442a-8a05-eedb82616657 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:25:04.170375 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-40ec9058-a679-4f3a-ac88-3ee0888743d6 None None] Provisioning complete for port 26ea03e6-402b-442a-8a05-eedb82616657 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:25:04.170997 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-40ec9058-a679-4f3a-ac88-3ee0888743d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:04.238768 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-40ec9058-a679-4f3a-ac88-3ee0888743d6 None None] Port 26ea03e6-402b-442a-8a05-eedb82616657 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:25:04.296944 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9cc67f8-7cc3-43b4-9f4e-9188ad9a53eb req-fc106212-0a33-49c4-b70d-1bc4bf3328cf tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:04.299883 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9cc67f8-7cc3-43b4-9f4e-9188ad9a53eb req-fc106212-0a33-49c4-b70d-1bc4bf3328cf tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 931 time: 0.1132953 May 12 16:25:04.348876 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f9cc67f8-7cc3-43b4-9f4e-9188ad9a53eb req-d4ab1e54-1a26-4653-b79e-ded9662cb01a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435891 May 12 16:25:04.607799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 26ea03e6-402b-442a-8a05-eedb82616657 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:25:04.615156 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:04.630072 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Transition to ACTIVE for port object 26ea03e6-402b-442a-8a05-eedb82616657 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:25:04.634364 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:04.801091 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Pushing event updated for resources: {'Port': ['ID=26ea03e6-402b-442a-8a05-eedb82616657,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:25:04.880998 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Attempting to bind port 26ea03e6-402b-442a-8a05-eedb82616657 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:25:04.881336 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Attempting to bind port 26ea03e6-402b-442a-8a05-eedb82616657 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:25:04.881697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Attempting to bind port 26ea03e6-402b-442a-8a05-eedb82616657 on network 48e2a895-0939-4482-a024-4695162ad5b7 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:25:04.886642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Port 26ea03e6-402b-442a-8a05-eedb82616657 on network 48e2a895-0939-4482-a024-4695162ad5b7 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:25:04.887022 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Attempting to bind port 26ea03e6-402b-442a-8a05-eedb82616657 on network 48e2a895-0939-4482-a024-4695162ad5b7 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:25:04.892436 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 24, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:25:04.892769 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Checking segment: {'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:25:04.893155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Bound using segment: {'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:25:04.893996 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Bound port: 26ea03e6-402b-442a-8a05-eedb82616657, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 553, 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:25:04.893996 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:04.992159 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] For port 26ea03e6-402b-442a-8a05-eedb82616657, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:25:04.995153 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] For port 26ea03e6-402b-442a-8a05-eedb82616657, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=26ea03e6-402b-442a-8a05-eedb82616657,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:25:04.998692 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:05.052214 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:05.052833 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:05.054753 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] 10.222.0.84 "PUT /v2.0/ports/26ea03e6-402b-442a-8a05-eedb82616657 HTTP/1.1" status: 200 len: 1091 time: 1.0571988 May 12 16:25:05.061758 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'tag': '26ea03e6-402b-442a-8a05-eedb82616657'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:25:05.087141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-591164c4-84d1-492f-ac3a-568ba0dc69ab service neutron] Pushing event updated for resources: {'Port': ['ID=26ea03e6-402b-442a-8a05-eedb82616657,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:25:05.112821 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c0c6fd57-6f43-4380-aebf-c6c07c66d32a'] response: {'name': 'network-changed', 'server_uuid': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'tag': '26ea03e6-402b-442a-8a05-eedb82616657', 'status': 'completed', 'code': 200} May 12 16:25:05.215695 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-d28d884c-5f45-482e-8f1c-0a77621be405 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:05.217273 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-d28d884c-5f45-482e-8f1c-0a77621be405 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 1094 time: 0.0809083 May 12 16:25:05.299137 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-82ee1e23-f648-4450-ad0d-e90e9468975c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=26ea03e6-402b-442a-8a05-eedb82616657 HTTP/1.1" status: 200 len: 217 time: 0.0623946 May 12 16:25:05.367203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-f69da0e1-aafa-45c4-a530-ca56003db24b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:05.368495 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-f69da0e1-aafa-45c4-a530-ca56003db24b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0609648 May 12 16:25:05.449789 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-121b756f-4b34-4915-80b0-702e34fb0e85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:05.451534 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-121b756f-4b34-4915-80b0-702e34fb0e85 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0729010 May 12 16:25:05.535051 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40213a8c-9502-45ad-a129-bb1b85d84afe req-edbfbabc-6f13-4c7c-8bf8-aa62364de355 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:05.536510 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40213a8c-9502-45ad-a129-bb1b85d84afe req-edbfbabc-6f13-4c7c-8bf8-aa62364de355 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0797946 May 12 16:25:05.584313 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-40213a8c-9502-45ad-a129-bb1b85d84afe req-124dd306-43cf-4338-b314-a6cbd7b766fa tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420485 May 12 16:25:05.588410 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-3a7856cb-e07c-41ac-bf68-7395975f2468 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1275175 May 12 16:25:05.724444 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e4da9159-ecdc-4132-ba73-9f6c9589ddff req-7300b2a0-3ebf-4507-8df5-24c23adae81d service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1246271 May 12 16:25:05.902556 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-382ddac5-3724-4f01-86c6-e2172828280b req-e0af3bd2-422c-4f96-bacd-7282333f02d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:05.904081 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-382ddac5-3724-4f01-86c6-e2172828280b req-e0af3bd2-422c-4f96-bacd-7282333f02d1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 1094 time: 0.0820012 May 12 16:25:06.046168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-382ddac5-3724-4f01-86c6-e2172828280b req-94174719-8671-4619-abb1-ffd197457744 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:06.048642 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-382ddac5-3724-4f01-86c6-e2172828280b req-94174719-8671-4619-abb1-ffd197457744 service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1380579 May 12 16:25:06.118184 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-382ddac5-3724-4f01-86c6-e2172828280b req-d0e85e99-e086-4c2d-bd0f-719e6642428d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=26ea03e6-402b-442a-8a05-eedb82616657 HTTP/1.1" status: 200 len: 217 time: 0.0624559 May 12 16:25:06.189234 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-382ddac5-3724-4f01-86c6-e2172828280b req-e85b23c0-c7b2-4529-8ce5-cc9cd59887f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:06.190727 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-382ddac5-3724-4f01-86c6-e2172828280b req-e85b23c0-c7b2-4529-8ce5-cc9cd59887f0 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0665808 May 12 16:25:06.269663 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-382ddac5-3724-4f01-86c6-e2172828280b req-e393b314-48a2-4bc2-becb-16590b158ad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:06.271128 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-382ddac5-3724-4f01-86c6-e2172828280b req-e393b314-48a2-4bc2-becb-16590b158ad3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0735805 May 12 16:25:06.515603 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-382ddac5-3724-4f01-86c6-e2172828280b req-d50e3ad8-fc93-4a03-8969-aa98d54bffd1 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2370498 May 12 16:25:06.653302 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-382ddac5-3724-4f01-86c6-e2172828280b req-6fddb6b0-c806-40fa-b71b-ef8d949ecd13 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1280837 May 12 16:25:06.771763 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b94c58c4-a98e-42d4-91e7-42bffa641da4 req-c4aa9b59-f4fb-4020-bf44-89b29a5f9b6e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:06.773118 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b94c58c4-a98e-42d4-91e7-42bffa641da4 req-c4aa9b59-f4fb-4020-bf44-89b29a5f9b6e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0793402 May 12 16:25:06.816768 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b94c58c4-a98e-42d4-91e7-42bffa641da4 req-b79d5b0f-711e-4d7e-84d4-80a10806ee2f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379560 May 12 16:25:08.010541 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9867133e-4d34-4180-9fef-7ce13130fa3a req-7a2d9360-153f-43e4-9497-c4cee49145bb tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:08.011972 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9867133e-4d34-4180-9fef-7ce13130fa3a req-7a2d9360-153f-43e4-9497-c4cee49145bb tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0922978 May 12 16:25:08.057084 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9867133e-4d34-4180-9fef-7ce13130fa3a req-59e431f0-14b7-41e0-910a-86939d4be9a4 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385249 May 12 16:25:09.240649 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bc4d6b8-6f6f-46db-9556-6125cfe85740 req-1f20f999-b8ba-4290-8e94-e84e63f7ec61 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:09.242117 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0bc4d6b8-6f6f-46db-9556-6125cfe85740 req-1f20f999-b8ba-4290-8e94-e84e63f7ec61 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0798333 May 12 16:25:09.286405 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0bc4d6b8-6f6f-46db-9556-6125cfe85740 req-66f86234-9d67-4f12-9449-f2b325810324 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386474 May 12 16:25:10.467708 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8b7d515-aec5-4d10-991c-744b31cbf863 req-1e8afe3e-6064-485f-8f29-9c3ec091d8a6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:10.469130 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8b7d515-aec5-4d10-991c-744b31cbf863 req-1e8afe3e-6064-485f-8f29-9c3ec091d8a6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0824764 May 12 16:25:10.514941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b8b7d515-aec5-4d10-991c-744b31cbf863 req-a132e2de-64ff-4925-b1c3-a5e38e86e8b3 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395610 May 12 16:25:11.702286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a9e18c8-05ab-404d-9594-43f03033b321 req-8c001f40-030f-4693-a8ff-81580953438d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:11.703642 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a9e18c8-05ab-404d-9594-43f03033b321 req-8c001f40-030f-4693-a8ff-81580953438d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0810287 May 12 16:25:11.747746 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9a9e18c8-05ab-404d-9594-43f03033b321 req-6fc939bd-974c-420d-9ad2-f93213c283c0 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378933 May 12 16:25:12.915073 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4c78080b-89d3-42af-8415-de9c868b4db8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:12.944755 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e97255a-3448-4bf0-aa64-30450ed9dd94 req-beab51f9-77a6-4a7f-9e0a-83b69f517dc6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:12.946243 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7e97255a-3448-4bf0-aa64-30450ed9dd94 req-beab51f9-77a6-4a7f-9e0a-83b69f517dc6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0879872 May 12 16:25:12.991236 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7e97255a-3448-4bf0-aa64-30450ed9dd94 req-bd994e20-e3ba-47fa-9eaf-91e723dfa167 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390720 May 12 16:25:13.863095 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:14.171245 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8158972f-8e16-460a-9a01-b64885554c08 req-db021168-c65c-4a80-a0f7-d8a95abb4996 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:14.172596 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8158972f-8e16-460a-9a01-b64885554c08 req-db021168-c65c-4a80-a0f7-d8a95abb4996 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0793750 May 12 16:25:14.221320 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8158972f-8e16-460a-9a01-b64885554c08 req-1978d913-1259-4255-9d0d-d20346d7dd65 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421245 May 12 16:25:14.465874 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 26ea03e6-402b-442a-8a05-eedb82616657 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:25:14.604567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 26ea03e6-402b-442a-8a05-eedb82616657, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=26ea03e6-402b-442a-8a05-eedb82616657,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:25:14.618430 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '26ea03e6-402b-442a-8a05-eedb82616657', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'port_id': '26ea03e6-402b-442a-8a05-eedb82616657', 'mac_address': 'fa:16:3e:79:74:b0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 553, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:25:14.675711 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:14.692100 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 26ea03e6-402b-442a-8a05-eedb82616657 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:25:14.707566 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 26ea03e6-402b-442a-8a05-eedb82616657, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=26ea03e6-402b-442a-8a05-eedb82616657,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:25:14.711409 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:14.779914 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=26ea03e6-402b-442a-8a05-eedb82616657,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:25:14.787635 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:25:14.788002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:25:14.788360 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:25:14.788732 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:25:14.789079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:25:14.789428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:25:14.789759 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:25:14.790080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:25:14.790402 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:25:14.790721 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:25:14.791037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:25:14.791352 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:25:15.050966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['26ea03e6-402b-442a-8a05-eedb82616657'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:25:15.416709 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e6f92c-985e-40c9-a95a-71165af43dcb req-183994b4-4640-4bd5-8891-569488b054df tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:15.418168 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e6f92c-985e-40c9-a95a-71165af43dcb req-183994b4-4640-4bd5-8891-569488b054df tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 944 time: 0.0819087 May 12 16:25:15.451910 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-946d2b35-57d7-450c-b189-83ec07335d53 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:15.465308 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c8e6f92c-985e-40c9-a95a-71165af43dcb req-14deed9a-3f82-45f1-9520-2e02c03ef1eb tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411801 May 12 16:25:16.178042 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:16.472135 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:16.480701 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 26ea03e6-402b-442a-8a05-eedb82616657 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:25:16.562824 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 26ea03e6-402b-442a-8a05-eedb82616657 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:25:16.568505 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 26ea03e6-402b-442a-8a05-eedb82616657 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:25:16.568867 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:16.658172 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0c3086a-e31e-4c22-bdf6-b7ff650c4e46 req-fb175667-d1b5-4c87-88ba-53991c519db4 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:16.660888 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0c3086a-e31e-4c22-bdf6-b7ff650c4e46 req-fb175667-d1b5-4c87-88ba-53991c519db4 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 944 time: 0.0864155 May 12 16:25:16.687396 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:16.707082 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f0c3086a-e31e-4c22-bdf6-b7ff650c4e46 req-0c052262-a2cf-4cda-82ff-843a2bbfa649 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401964 May 12 16:25:16.714667 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '26ea03e6-402b-442a-8a05-eedb82616657'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:25:16.724780 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 26ea03e6-402b-442a-8a05-eedb82616657, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=26ea03e6-402b-442a-8a05-eedb82616657,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:25:16.729738 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:16.799253 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=26ea03e6-402b-442a-8a05-eedb82616657,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:25:16.832440 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e11e7cbf-fb30-4134-bd50-8a3a1c428831'] response: {'server_uuid': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '26ea03e6-402b-442a-8a05-eedb82616657', 'code': 200} May 12 16:25:16.999226 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70dd60b3-2267-415a-ad49-3981808ce6e5 req-3b84d3fb-3e9b-4de6-8066-d3da8dd227d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:17.000598 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-70dd60b3-2267-415a-ad49-3981808ce6e5 req-3b84d3fb-3e9b-4de6-8066-d3da8dd227d5 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 1096 time: 0.0749106 May 12 16:25:17.040827 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-70dd60b3-2267-415a-ad49-3981808ce6e5 req-916bd65f-cb86-446b-9cee-3fab5cb56c76 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0337322 May 12 16:25:17.888667 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf4aca4-d99d-4c30-b2cd-c47db673e269 req-fe73c660-dd5e-4eac-a0ee-66545b19de13 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:17.890138 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dcf4aca4-d99d-4c30-b2cd-c47db673e269 req-fe73c660-dd5e-4eac-a0ee-66545b19de13 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0791826 May 12 16:25:17.935370 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-dcf4aca4-d99d-4c30-b2cd-c47db673e269 req-6ca67faa-c02e-4c0b-8c96-f404e3144fa6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395555 May 12 16:25:17.951948 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:19.220547 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39935ed-05e1-4468-8a76-f41ec171e932 req-6731c2dd-47b4-4a88-82bb-7d41566e3acd tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:19.221928 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d39935ed-05e1-4468-8a76-f41ec171e932 req-6731c2dd-47b4-4a88-82bb-7d41566e3acd tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.1800170 May 12 16:25:19.265664 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d39935ed-05e1-4468-8a76-f41ec171e932 req-d6c84397-9b1c-417e-878a-2fd2c0412687 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378535 May 12 16:25:19.448412 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a26f100-3651-49e2-8492-bd1660822577 req-c69e8abe-9f23-4f56-95e9-adca2d6bfe64 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:19.449861 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a26f100-3651-49e2-8492-bd1660822577 req-c69e8abe-9f23-4f56-95e9-adca2d6bfe64 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0793612 May 12 16:25:19.495249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8a26f100-3651-49e2-8492-bd1660822577 req-9221ae1f-47ca-4488-a011-cf3b405a914f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395911 May 12 16:25:19.518105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57134) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:25:19.587444 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f7bf357-6df8-43d5-be66-d7f403b5cbcb tempest-TestShelveInstance-1430599996 tempest-TestShelveInstance-1430599996-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:19.588882 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1f7bf357-6df8-43d5-be66-d7f403b5cbcb tempest-TestShelveInstance-1430599996 tempest-TestShelveInstance-1430599996-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 1091 time: 0.0698364 May 12 16:25:19.591759 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57138) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:25:19.596426 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '26ea03e6-402b-442a-8a05-eedb82616657', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'fixed_ip_address': '172.20.0.5'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:25:19.602965 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:25:19.606740 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Usage tracker for resource:floatingip and tenant:6b4fff63f40147c189245b3a596d32b4 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:25:19.609519 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:25:19.615677 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:25:19.625736 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:19.762094 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:19.896068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Allocated IP 172.25.8.82 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/43073b42-acbe-4092-8bdc-6b64bd015b31) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:25:20.039968 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:20.069485 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:20.131292 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:25:20.133903 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:25:20.137625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:25:20.174959 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'Port': ['ID=43073b42-acbe-4092-8bdc-6b64bd015b31,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:25:20.555846 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:20.627540 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:20.834234 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:20.838580 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:20.946081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event updated for resources: {'Port': ['ID=43073b42-acbe-4092-8bdc-6b64bd015b31,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:25:20.955483 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:21.230730 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Floating IP 02da9843-9e41-40dd-a8c5-e6fc2049ba45 associated. External IP: 172.25.8.82, port: 26ea03e6-402b-442a-8a05-eedb82616657. May 12 16:25:21.589824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:25:21.766801 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:25:21.776762 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d235d33a-4e1e-49f4-9536-e2faaa312212 None None] Sync routers for ids ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:25:21.786039 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d235d33a-4e1e-49f4-9536-e2faaa312212 None None] Routers {'99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:25:21.786632 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d235d33a-4e1e-49f4-9536-e2faaa312212 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:25:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:25:21.791612 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:21.849587 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1d09aeb8-efae-45c4-8bdd-52be24ced42b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.2567317 May 12 16:25:21.850174 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'tag': '26ea03e6-402b-442a-8a05-eedb82616657'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:25:21.894378 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7ef93380-4c09-46a1-b989-498582a3a5cf'] response: {'name': 'network-changed', 'server_uuid': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'tag': '26ea03e6-402b-442a-8a05-eedb82616657', 'status': 'completed', 'code': 200} May 12 16:25:21.961547 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:25:21.970707 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d235d33a-4e1e-49f4-9536-e2faaa312212 None None] Set router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:25:22.011055 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f265bd2-851a-4abc-b7b2-1aa94d5a50f1 req-4abe2ef9-d077-4f09-87e1-8cb0a69c39fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:22.012526 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f265bd2-851a-4abc-b7b2-1aa94d5a50f1 req-4abe2ef9-d077-4f09-87e1-8cb0a69c39fb service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 1096 time: 0.0717242 May 12 16:25:22.142243 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f265bd2-851a-4abc-b7b2-1aa94d5a50f1 req-3e525ada-54db-428c-a183-aba659f04a06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:22.143580 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f265bd2-851a-4abc-b7b2-1aa94d5a50f1 req-3e525ada-54db-428c-a183-aba659f04a06 service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1256289 May 12 16:25:22.247781 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f265bd2-851a-4abc-b7b2-1aa94d5a50f1 req-9598a360-ee64-4700-9920-f54fd93bf0e1 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=26ea03e6-402b-442a-8a05-eedb82616657 HTTP/1.1" status: 200 len: 998 time: 0.0983303 May 12 16:25:22.309930 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f265bd2-851a-4abc-b7b2-1aa94d5a50f1 req-db4ffa4f-daba-4f6a-84d6-6757008df357 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:22.311355 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f265bd2-851a-4abc-b7b2-1aa94d5a50f1 req-db4ffa4f-daba-4f6a-84d6-6757008df357 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0577242 May 12 16:25:22.329493 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d235d33a-4e1e-49f4-9536-e2faaa312212 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '02da9843-9e41-40dd-a8c5-e6fc2049ba45', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'floating_ip_address': '172.25.8.82', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'port_id': '26ea03e6-402b-442a-8a05-eedb82616657', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 4418, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'mac_address': 'fa:16:3e:79:74:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:25:20Z', 'updated_at': '2022-05-12T16:25:20Z', 'revision_number': 0, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:23Z', 'revision_number': 5, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:25:22.333927 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d235d33a-4e1e-49f4-9536-e2faaa312212 None None] Checking router: 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:25:22.342103 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d235d33a-4e1e-49f4-9536-e2faaa312212 None None] Routers {'99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:25:22.342709 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d235d33a-4e1e-49f4-9536-e2faaa312212 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:25:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:25:22.388480 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f265bd2-851a-4abc-b7b2-1aa94d5a50f1 req-07d1530c-0b3e-4781-a1d7-61c0f8b67cb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:22.389951 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f265bd2-851a-4abc-b7b2-1aa94d5a50f1 req-07d1530c-0b3e-4781-a1d7-61c0f8b67cb8 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0726008 May 12 16:25:22.518104 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-d235d33a-4e1e-49f4-9536-e2faaa312212 None None] Set router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:25:22.520889 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f265bd2-851a-4abc-b7b2-1aa94d5a50f1 req-686d7b38-fc0a-40c8-ad8d-33230c1832cb service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1248691 May 12 16:25:22.654317 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0f265bd2-851a-4abc-b7b2-1aa94d5a50f1 req-b725e264-da6f-413a-87c2-2c19839fd41f service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1279662 May 12 16:25:22.870617 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-d235d33a-4e1e-49f4-9536-e2faaa312212 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '02da9843-9e41-40dd-a8c5-e6fc2049ba45', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'floating_ip_address': '172.25.8.82', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'port_id': '26ea03e6-402b-442a-8a05-eedb82616657', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 4418, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'mac_address': 'fa:16:3e:79:74:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:25:20Z', 'updated_at': '2022-05-12T16:25:20Z', 'revision_number': 0, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:23Z', 'revision_number': 5, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:25:22.874698 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d235d33a-4e1e-49f4-9536-e2faaa312212 None None] The sync data for ids ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'] in n-d-841483-1 is: [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '02da9843-9e41-40dd-a8c5-e6fc2049ba45', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'floating_ip_address': '172.25.8.82', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'port_id': '26ea03e6-402b-442a-8a05-eedb82616657', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 4418, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'mac_address': 'fa:16:3e:79:74:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:25:20Z', 'updated_at': '2022-05-12T16:25:20Z', 'revision_number': 0, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:23Z', 'revision_number': 5, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:25:23.046708 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f084d46d-4976-43b5-a17c-4f31fe7eb577 None None] New status for floating IP 02da9843-9e41-40dd-a8c5-e6fc2049ba45: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:25:33.075283 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:42.921015 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-67c24771-b55a-469c-859a-5e5fa2405f66 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:43.870395 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:45.454547 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3c3616f3-5009-4ed7-9a74-7d514277caa5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:46.182643 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:46.479231 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:47.285948 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-68140e1d-78c3-44cc-b087-c6d9fafccd4d req-93f53174-8219-487c-8124-3d2758dd29fd service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0766561 May 12 16:25:47.417878 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-68140e1d-78c3-44cc-b087-c6d9fafccd4d req-ceb20050-f615-4e04-bbf3-1f1b2691be1c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0494251 May 12 16:25:47.465645 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-68140e1d-78c3-44cc-b087-c6d9fafccd4d req-cc4d2042-97ec-47fb-b1e4-8a678a6b9fc7 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0291059 May 12 16:25:47.627652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68140e1d-78c3-44cc-b087-c6d9fafccd4d req-7e1d6e04-cc79-4ed9-abfa-8ea6dac9e680 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:25:47.629346 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-68140e1d-78c3-44cc-b087-c6d9fafccd4d req-7e1d6e04-cc79-4ed9-abfa-8ea6dac9e680 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1578431 May 12 16:25:47.954732 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:25:58.961796 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:26:03.081548 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:26:12.922550 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b3591ed8-99b2-466b-b0fd-12a66da7bc13 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:26:12.993285 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ccde2b0-3983-4fcc-a874-9145608e3240 req-d9f562b5-033d-4d1f-8f68-04d12c7b9fdd service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0679731 May 12 16:26:13.165308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ccde2b0-3983-4fcc-a874-9145608e3240 req-7b5976f3-9288-4d36-895d-96ae82f130ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:26:13.166678 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ccde2b0-3983-4fcc-a874-9145608e3240 req-7b5976f3-9288-4d36-895d-96ae82f130ae service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 1096 time: 0.0726185 May 12 16:26:13.316220 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ccde2b0-3983-4fcc-a874-9145608e3240 req-88e6cf9a-fb5f-4e9b-a4e4-3ff9b48020ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:26:13.317684 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ccde2b0-3983-4fcc-a874-9145608e3240 req-88e6cf9a-fb5f-4e9b-a4e4-3ff9b48020ac service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1267152 May 12 16:26:13.529526 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ccde2b0-3983-4fcc-a874-9145608e3240 req-c07d2255-e15a-4586-83f7-eb985e94464a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=26ea03e6-402b-442a-8a05-eedb82616657 HTTP/1.1" status: 200 len: 1000 time: 0.2023237 May 12 16:26:13.590609 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ccde2b0-3983-4fcc-a874-9145608e3240 req-3dc0b718-7408-4b8f-9d40-d517f87379b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:26:13.591984 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ccde2b0-3983-4fcc-a874-9145608e3240 req-3dc0b718-7408-4b8f-9d40-d517f87379b2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0558794 May 12 16:26:13.669706 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ccde2b0-3983-4fcc-a874-9145608e3240 req-9144d620-5397-4453-a735-b0944663175e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:26:13.671167 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ccde2b0-3983-4fcc-a874-9145608e3240 req-9144d620-5397-4453-a735-b0944663175e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0707347 May 12 16:26:13.804831 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ccde2b0-3983-4fcc-a874-9145608e3240 req-63808d48-1a0d-48b1-9eea-ed22ec30f18b service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1239817 May 12 16:26:13.874870 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:26:13.947955 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6ccde2b0-3983-4fcc-a874-9145608e3240 req-7191698c-c00d-4b42-be61-4e750307ac86 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1336811 May 12 16:26:15.457603 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0199c788-56f7-4ae4-befc-771f653c0289 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:26:16.185018 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:26:16.479577 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:26:17.955120 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:26:33.073038 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:26:35.961547 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:26:42.925953 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6003e165-b946-4bfb-a9e4-3522a12bcbdd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:26:43.890509 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:26:45.462723 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c63ace70-485d-4eac-983d-6498eab423c0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:26:46.187361 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:26:46.482115 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:26:47.958105 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:26:48.266771 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0402090e-9c53-457f-8df8-5767786f95ae req-11df09f6-ba83-4cde-bb75-4f9a6426384b service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0456326 May 12 16:26:48.381491 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0402090e-9c53-457f-8df8-5767786f95ae req-bc6c331d-1cff-489f-be0b-cb643c52def9 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0408771 May 12 16:26:48.423173 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0402090e-9c53-457f-8df8-5767786f95ae req-709529fd-96b7-466f-a3fb-9967c00246c3 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0247085 May 12 16:26:48.560082 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0402090e-9c53-457f-8df8-5767786f95ae req-f9cebb55-8e09-4d18-85c1-2793f163d5f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:26:48.561462 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-0402090e-9c53-457f-8df8-5767786f95ae req-f9cebb55-8e09-4d18-85c1-2793f163d5f1 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1328571 May 12 16:27:03.071175 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:12.926769 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-acb33ef0-4a69-41da-9d51-f7abc2210c23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:12.960057 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:27:13.891860 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:14.003025 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-208b2aca-159f-4886-bdee-1f2ef28c613d req-00bfa87a-b96d-43d9-8199-c3bb25223a30 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0734599 May 12 16:27:14.173260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-208b2aca-159f-4886-bdee-1f2ef28c613d req-bb97ebc8-e161-47ed-b009-5670fb515285 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:14.174660 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-208b2aca-159f-4886-bdee-1f2ef28c613d req-bb97ebc8-e161-47ed-b009-5670fb515285 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 1096 time: 0.0747814 May 12 16:27:14.322402 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-208b2aca-159f-4886-bdee-1f2ef28c613d req-3a464901-04e9-4907-bdf5-24211af89d30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:14.323816 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-208b2aca-159f-4886-bdee-1f2ef28c613d req-3a464901-04e9-4907-bdf5-24211af89d30 service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1253862 May 12 16:27:14.429268 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-208b2aca-159f-4886-bdee-1f2ef28c613d req-90d556f8-3ab9-400b-99cb-be66490e281e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=26ea03e6-402b-442a-8a05-eedb82616657 HTTP/1.1" status: 200 len: 1000 time: 0.0961533 May 12 16:27:14.493926 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-208b2aca-159f-4886-bdee-1f2ef28c613d req-997968e1-d468-4773-9c43-1b340919bd14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:14.495318 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-208b2aca-159f-4886-bdee-1f2ef28c613d req-997968e1-d468-4773-9c43-1b340919bd14 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0574582 May 12 16:27:14.574594 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-208b2aca-159f-4886-bdee-1f2ef28c613d req-559a4164-c9ff-4c2e-8c4f-a148a9718f92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:14.576029 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-208b2aca-159f-4886-bdee-1f2ef28c613d req-559a4164-c9ff-4c2e-8c4f-a148a9718f92 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0719049 May 12 16:27:14.589075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-208b2aca-159f-4886-bdee-1f2ef28c613d req-16e04ed2-32cb-4895-84d1-f6e4bb555ba1 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 16:27:14.590028 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-208b2aca-159f-4886-bdee-1f2ef28c613d req-16e04ed2-32cb-4895-84d1-f6e4bb555ba1 service neutron] 10.222.0.84 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0048258 May 12 16:27:14.726055 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-208b2aca-159f-4886-bdee-1f2ef28c613d req-019a9883-3161-4b2b-978a-0bb530966b4e service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1253352 May 12 16:27:14.984172 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-208b2aca-159f-4886-bdee-1f2ef28c613d req-5a777c6a-bf99-47b0-aa76-830a8ba56656 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2484653 May 12 16:27:15.455736 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ef8025d5-30eb-486a-8aef-9e056b966246 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:16.189257 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:16.487836 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:17.962518 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:19.898176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2101023e-4a61-45f1-820c-1a25311c8bbf req-b9054979-4139-48f1-b453-d991add256dd tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:19.899658 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2101023e-4a61-45f1-820c-1a25311c8bbf req-b9054979-4139-48f1-b453-d991add256dd tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0879054 May 12 16:27:19.946092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-2101023e-4a61-45f1-820c-1a25311c8bbf req-1233a87f-fa56-4c23-ad6d-ac321e4669cb tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408330 May 12 16:27:21.139032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c69fe0f2-5730-4a04-83c5-6f96b21c71bb req-cd3fbd56-ec7b-4043-9857-8c3685d7d080 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:21.141274 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c69fe0f2-5730-4a04-83c5-6f96b21c71bb req-cd3fbd56-ec7b-4043-9857-8c3685d7d080 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0813496 May 12 16:27:21.188232 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c69fe0f2-5730-4a04-83c5-6f96b21c71bb req-64f1169a-4b93-4ffa-b5cc-5ec7560422b1 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408242 May 12 16:27:22.389068 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee56323d-cabe-47e2-ba8c-bf0906d69979 req-fe6daa71-80d6-49fb-b227-06805b6b15ee tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:22.391111 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee56323d-cabe-47e2-ba8c-bf0906d69979 req-fe6daa71-80d6-49fb-b227-06805b6b15ee tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0795527 May 12 16:27:22.435462 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ee56323d-cabe-47e2-ba8c-bf0906d69979 req-d8c1f2ab-e7af-4d25-b076-dbbce8fa14fb tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380340 May 12 16:27:23.623441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89121879-d83a-400b-b377-0f90ae642291 req-cdf3086c-cee4-4a1f-bcb1-9d919d69c65b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:23.624868 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89121879-d83a-400b-b377-0f90ae642291 req-cdf3086c-cee4-4a1f-bcb1-9d919d69c65b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0827706 May 12 16:27:23.670245 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-89121879-d83a-400b-b377-0f90ae642291 req-7989bdee-3fb7-4e1e-b358-d027039834bf tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397425 May 12 16:27:24.852625 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52011a07-7963-4b7a-a7d7-f5b4003f5cff req-eb96c41f-39e8-4d3b-b93b-742c706d31b6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:24.854013 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52011a07-7963-4b7a-a7d7-f5b4003f5cff req-eb96c41f-39e8-4d3b-b93b-742c706d31b6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0793614 May 12 16:27:24.896897 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-52011a07-7963-4b7a-a7d7-f5b4003f5cff req-f03e76b6-05fb-45a4-9b81-d643f8fb986d tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373726 May 12 16:27:26.238902 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7788559d-edfc-42d0-8a47-7301e77273e2 req-cbc788f7-1a4d-46d0-ac88-458968b8ad05 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:26.240352 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7788559d-edfc-42d0-8a47-7301e77273e2 req-cbc788f7-1a4d-46d0-ac88-458968b8ad05 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0833399 May 12 16:27:26.284456 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7788559d-edfc-42d0-8a47-7301e77273e2 req-b1c6edb8-cb41-43d9-87bb-c12582d28e7c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383797 May 12 16:27:27.474271 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc485ae-4e81-4ab7-ad23-274436f075be req-398d37dd-75db-43cc-9e96-8fb0d6f91190 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:27.476056 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cc485ae-4e81-4ab7-ad23-274436f075be req-398d37dd-75db-43cc-9e96-8fb0d6f91190 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0802317 May 12 16:27:27.523791 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7cc485ae-4e81-4ab7-ad23-274436f075be req-fb52f2f3-3e65-4c80-b3bc-554952886d1e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422015 May 12 16:27:28.809176 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-677ffdbb-9e00-40a4-93b8-9a7ca3166c8b req-32a54068-eaf6-4077-8066-7ab47201ae3e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:28.810559 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-677ffdbb-9e00-40a4-93b8-9a7ca3166c8b req-32a54068-eaf6-4077-8066-7ab47201ae3e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.1816700 May 12 16:27:28.855129 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-677ffdbb-9e00-40a4-93b8-9a7ca3166c8b req-afe52ca8-a178-4e44-84ca-aa7ab84716b0 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379124 May 12 16:27:30.042623 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3b758e5-c11e-4c33-bf1a-7416b345b083 req-6fbeda31-1abe-4973-a53f-c1dcb5830e55 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:30.043976 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3b758e5-c11e-4c33-bf1a-7416b345b083 req-6fbeda31-1abe-4973-a53f-c1dcb5830e55 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0808320 May 12 16:27:30.094278 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3b758e5-c11e-4c33-bf1a-7416b345b083 req-fbc7a508-5706-458f-8614-33c39114772e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438218 May 12 16:27:30.139799 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489a5800-5bb1-448c-8c49-a9bd9bd13beb req-4c826b9f-1235-427a-a10a-cd7e14bcff10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:30.141410 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-489a5800-5bb1-448c-8c49-a9bd9bd13beb req-4c826b9f-1235-427a-a10a-cd7e14bcff10 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 1096 time: 0.0698366 May 12 16:27:30.276385 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489a5800-5bb1-448c-8c49-a9bd9bd13beb req-6359623a-542b-408c-9baf-4003a7adb7f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:30.277846 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-489a5800-5bb1-448c-8c49-a9bd9bd13beb req-6359623a-542b-408c-9baf-4003a7adb7f2 service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1267643 May 12 16:27:30.382741 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-489a5800-5bb1-448c-8c49-a9bd9bd13beb req-8e95c834-7fdb-4d59-8ccb-34ce8b5dedaf service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=26ea03e6-402b-442a-8a05-eedb82616657 HTTP/1.1" status: 200 len: 1000 time: 0.0952950 May 12 16:27:30.446959 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489a5800-5bb1-448c-8c49-a9bd9bd13beb req-27772161-cdfa-479f-b741-f0bc322c0b2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:30.448338 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-489a5800-5bb1-448c-8c49-a9bd9bd13beb req-27772161-cdfa-479f-b741-f0bc322c0b2c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0562253 May 12 16:27:30.534136 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489a5800-5bb1-448c-8c49-a9bd9bd13beb req-516782d4-d6de-4674-aa4d-32567c71a256 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:30.535586 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-489a5800-5bb1-448c-8c49-a9bd9bd13beb req-516782d4-d6de-4674-aa4d-32567c71a256 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0774713 May 12 16:27:30.670901 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-489a5800-5bb1-448c-8c49-a9bd9bd13beb req-394c43a8-49bc-4dbf-912b-6bd65b62578e service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1253607 May 12 16:27:30.803704 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-489a5800-5bb1-448c-8c49-a9bd9bd13beb req-4fdac3c7-f47c-4159-aed8-c9dd5a479ebb service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1241066 May 12 16:27:31.281078 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44d82c1-ef26-4429-9cc3-22c6e2d7210d req-d0f76490-d5f6-48a1-8071-bafc85e11ce2 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:31.283253 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b44d82c1-ef26-4429-9cc3-22c6e2d7210d req-d0f76490-d5f6-48a1-8071-bafc85e11ce2 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0800221 May 12 16:27:31.331056 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-b44d82c1-ef26-4429-9cc3-22c6e2d7210d req-2b30affc-836d-4167-8d0f-bb39190ab7b1 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419226 May 12 16:27:32.522468 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e5cbdc-9914-4a92-a95e-7cb56c122788 req-effa0e88-29a2-4e5c-ab3d-33845075a261 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:32.523910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19e5cbdc-9914-4a92-a95e-7cb56c122788 req-effa0e88-29a2-4e5c-ab3d-33845075a261 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0815136 May 12 16:27:32.572913 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-19e5cbdc-9914-4a92-a95e-7cb56c122788 req-ea87f1d2-ccaf-4b0b-8241-b9f665514f93 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432551 May 12 16:27:33.087321 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:33.759927 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1214fa3-ba60-4ef4-889f-64ba6cb54b59 req-6a92a28d-958e-4795-9dd4-03c4eb50835f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:33.761358 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1214fa3-ba60-4ef4-889f-64ba6cb54b59 req-6a92a28d-958e-4795-9dd4-03c4eb50835f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0840890 May 12 16:27:33.804134 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1214fa3-ba60-4ef4-889f-64ba6cb54b59 req-5c833b65-c7ec-41be-9bc9-e21e695e57ed tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371177 May 12 16:27:34.091858 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-2be4d597-73a5-4709-ba88-120489556069 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0740643 May 12 16:27:34.160785 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ed8167-b9e4-4926-9479-f6eccf0662ba req-7380c256-80ed-45a9-8f48-af7083167125 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:34.162389 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45ed8167-b9e4-4926-9479-f6eccf0662ba req-7380c256-80ed-45a9-8f48-af7083167125 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0856824 May 12 16:27:34.208612 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-45ed8167-b9e4-4926-9479-f6eccf0662ba req-fdddea4c-fa24-424c-bc92-4c2998baa8ad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405481 May 12 16:27:35.197563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 26ea03e6-402b-442a-8a05-eedb82616657 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:27:35.325447 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:35.359087 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '26ea03e6-402b-442a-8a05-eedb82616657'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:27:35.371025 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 26ea03e6-402b-442a-8a05-eedb82616657, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=26ea03e6-402b-442a-8a05-eedb82616657,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:27:35.380059 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:35.417169 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecee70f3-79e2-4a62-bd2d-57231f3c86db req-f4371dc6-8142-430f-9bca-d85e1bfe36ff tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:35.418735 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecee70f3-79e2-4a62-bd2d-57231f3c86db req-f4371dc6-8142-430f-9bca-d85e1bfe36ff tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.1014204 May 12 16:27:35.436289 n-d-841483-1 neutron-server[88153]: WARNING neutron.notifiers.nova [-] Nova event matching ['req-2fe734a7-de2d-4214-975a-45fd3d8ef590']: {'server_uuid': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '26ea03e6-402b-442a-8a05-eedb82616657', 'code': 422} returned with failed status May 12 16:27:35.457684 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=26ea03e6-402b-442a-8a05-eedb82616657,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:27:35.465690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:27:35.466028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:27:35.466363 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:27:35.466714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:27:35.467037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:27:35.467357 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:27:35.467707 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:27:35.467985 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:27:35.468298 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:27:35.468609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:27:35.468767 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecee70f3-79e2-4a62-bd2d-57231f3c86db req-f9d32edd-cc92-4e20-af7f-3b61c0343a5b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434611 May 12 16:27:35.469034 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:27:35.469492 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:27:36.653617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cabc4086-6f6b-4097-914d-c92606b86d53 req-bdc48236-6cc0-457c-a775-3b0820c93a08 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:36.655033 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cabc4086-6f6b-4097-914d-c92606b86d53 req-bdc48236-6cc0-457c-a775-3b0820c93a08 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0784271 May 12 16:27:36.702513 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cabc4086-6f6b-4097-914d-c92606b86d53 req-e95a64aa-7657-4160-be25-4484e824285c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410109 May 12 16:27:36.838925 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-4d6a991d-bd5f-4d64-983f-bda21e44444d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:36.840339 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-4d6a991d-bd5f-4d64-983f-bda21e44444d service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829&tenant_id=6b4fff63f40147c189245b3a596d32b4 HTTP/1.1" status: 200 len: 1094 time: 0.0737729 May 12 16:27:36.952574 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-251d6f96-2b82-4a32-acfd-b8b9703a9bdc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:36.954055 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-251d6f96-2b82-4a32-acfd-b8b9703a9bdc service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 1094 time: 0.0711193 May 12 16:27:37.091722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-8ed5c711-d7fb-4acd-a9d6-5498a58f327b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:37.093061 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-8ed5c711-d7fb-4acd-a9d6-5498a58f327b service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1255558 May 12 16:27:37.197756 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-addd86ef-0f7d-46de-bb28-c48c7de44f1f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=26ea03e6-402b-442a-8a05-eedb82616657 HTTP/1.1" status: 200 len: 998 time: 0.0954022 May 12 16:27:37.264188 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-394046b9-7108-4a6c-9b85-6be6da4bbdee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:37.265699 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-394046b9-7108-4a6c-9b85-6be6da4bbdee service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0584042 May 12 16:27:37.348003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-2c389f97-a83b-4f3e-b775-739aef70126e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:37.349460 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-2c389f97-a83b-4f3e-b775-739aef70126e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0740986 May 12 16:27:37.485216 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-fcab8831-01da-4041-a40d-c316f3f61c75 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1262949 May 12 16:27:37.743101 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-97fb2ccb-9e06-45d1-b863-049a6f5e3204 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2484629 May 12 16:27:37.896880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3be5386b-3d6d-430e-8d2b-42c3dceabe57 req-80df324e-2953-48b6-85c2-50725f70a970 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:37.898341 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3be5386b-3d6d-430e-8d2b-42c3dceabe57 req-80df324e-2953-48b6-85c2-50725f70a970 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0833650 May 12 16:27:37.942681 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3be5386b-3d6d-430e-8d2b-42c3dceabe57 req-7fa7336b-eb40-4815-8b50-4a2fc4c125bd tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384712 May 12 16:27:39.124042 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ed124e-6529-4812-ae5a-80452e67a45c req-354f6ac7-c62b-4e8e-80d8-c23d17b1d28c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:39.125413 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-92ed124e-6529-4812-ae5a-80452e67a45c req-354f6ac7-c62b-4e8e-80d8-c23d17b1d28c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0791101 May 12 16:27:39.174384 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-92ed124e-6529-4812-ae5a-80452e67a45c req-9fab8bed-aa9c-49f5-bdd7-3bb4a29e99f0 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433412 May 12 16:27:40.358377 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e78ca240-af1d-468a-ab3a-97ca4c637276 req-86cdf172-b248-412d-9ee6-c052451a8cc0 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:40.359866 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e78ca240-af1d-468a-ab3a-97ca4c637276 req-86cdf172-b248-412d-9ee6-c052451a8cc0 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0817933 May 12 16:27:40.403872 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e78ca240-af1d-468a-ab3a-97ca4c637276 req-efc86d03-0b29-4218-a729-43ccac75fc88 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377150 May 12 16:27:41.588858 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18796f60-08e8-4685-a151-5b1503a348b7 req-581be7c6-0515-42eb-9f65-25998927b83c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:41.590223 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18796f60-08e8-4685-a151-5b1503a348b7 req-581be7c6-0515-42eb-9f65-25998927b83c tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0835893 May 12 16:27:41.633294 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-18796f60-08e8-4685-a151-5b1503a348b7 req-579e9dff-9d0a-448c-bf5a-ca1e08eda888 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374947 May 12 16:27:42.815831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb02fa00-4904-40d5-aa23-1c9d93a45525 req-56ae1bca-5db0-43fd-9c65-a24f71421c27 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:42.818376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb02fa00-4904-40d5-aa23-1c9d93a45525 req-56ae1bca-5db0-43fd-9c65-a24f71421c27 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0834448 May 12 16:27:42.862651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cb02fa00-4904-40d5-aa23-1c9d93a45525 req-46054d3d-5cc5-4211-8ba8-bca3b626c82f tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387006 May 12 16:27:42.929873 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c311a98f-9ae7-49d8-a032-28fae6285343 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:43.904386 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:44.053162 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99554db6-6f89-4069-b8a4-449009e8f5d2 req-c6a8ba49-9b3d-4a7b-8e46-62daec3f5c29 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:44.054609 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99554db6-6f89-4069-b8a4-449009e8f5d2 req-c6a8ba49-9b3d-4a7b-8e46-62daec3f5c29 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0812192 May 12 16:27:44.097782 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-99554db6-6f89-4069-b8a4-449009e8f5d2 req-248373f6-6fac-4622-b1ca-db32f9c4a540 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376003 May 12 16:27:45.260690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 26ea03e6-402b-442a-8a05-eedb82616657 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:27:45.285893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf82e4b7-0550-4343-a333-7375464db740 req-ae7f5053-0576-427f-b58c-305ad8ccdf82 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:45.287371 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf82e4b7-0550-4343-a333-7375464db740 req-ae7f5053-0576-427f-b58c-305ad8ccdf82 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 943 time: 0.0811269 May 12 16:27:45.335409 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bf82e4b7-0550-4343-a333-7375464db740 req-3d790dab-a2d6-4b5f-a8e9-6f91ba031f51 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423455 May 12 16:27:45.397277 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 26ea03e6-402b-442a-8a05-eedb82616657, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=26ea03e6-402b-442a-8a05-eedb82616657,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:27:45.409810 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '26ea03e6-402b-442a-8a05-eedb82616657', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'port_id': '26ea03e6-402b-442a-8a05-eedb82616657', 'mac_address': 'fa:16:3e:79:74:b0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 553, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:27:45.478744 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:45.487252 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-887976ba-2016-4c11-bffc-aa7b66f729f8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:45.496897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 26ea03e6-402b-442a-8a05-eedb82616657 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:27:45.512392 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 26ea03e6-402b-442a-8a05-eedb82616657, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=26ea03e6-402b-442a-8a05-eedb82616657,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:27:45.515760 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:45.581079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=26ea03e6-402b-442a-8a05-eedb82616657,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:27:45.899018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['26ea03e6-402b-442a-8a05-eedb82616657'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:27:46.193010 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:46.490977 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:46.518133 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a428f571-ae53-4dfa-af06-7ce19aa7c770 req-eab22626-953c-423b-a18c-6b8e803cdbb6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:46.520140 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a428f571-ae53-4dfa-af06-7ce19aa7c770 req-eab22626-953c-423b-a18c-6b8e803cdbb6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 944 time: 0.0813861 May 12 16:27:46.564406 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a428f571-ae53-4dfa-af06-7ce19aa7c770 req-d366bfdf-c636-4ba2-ae43-ff6321cf1af7 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384095 May 12 16:27:47.276175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 26ea03e6-402b-442a-8a05-eedb82616657 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:27:47.348152 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 26ea03e6-402b-442a-8a05-eedb82616657 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:27:47.349093 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:47.462856 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:47.489436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '26ea03e6-402b-442a-8a05-eedb82616657'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:27:47.498934 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 26ea03e6-402b-442a-8a05-eedb82616657, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=26ea03e6-402b-442a-8a05-eedb82616657,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:27:47.504112 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:47.537109 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6f7da2f4-45df-4423-92e3-ee85711d7448'] response: {'server_uuid': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '26ea03e6-402b-442a-8a05-eedb82616657', 'code': 200} May 12 16:27:47.574480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=26ea03e6-402b-442a-8a05-eedb82616657,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:27:47.758617 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baa29590-9b10-46a4-bb4d-1158195fa1aa req-fd46386e-0a9e-4471-8073-1e756e43b05e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:47.760063 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-baa29590-9b10-46a4-bb4d-1158195fa1aa req-fd46386e-0a9e-4471-8073-1e756e43b05e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0864191 May 12 16:27:47.805843 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-baa29590-9b10-46a4-bb4d-1158195fa1aa req-eec6507d-aa1e-49ac-863d-21b494e879ac tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400479 May 12 16:27:47.819657 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2546675-caf7-4826-a173-53518795ff64 req-5efd1e78-fd81-4653-ba0c-e53eeae5fcc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:47.821140 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2546675-caf7-4826-a173-53518795ff64 req-5efd1e78-fd81-4653-ba0c-e53eeae5fcc1 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 1096 time: 0.0708015 May 12 16:27:47.865254 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c2546675-caf7-4826-a173-53518795ff64 req-53c2ac1a-a996-4b7a-935e-5572e6b2c558 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0351775 May 12 16:27:47.963875 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:27:48.992304 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f4043fb-6569-4851-8ad3-c89ea6170ae4 req-46c4569d-e644-468b-8d63-d0e8d0e87396 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:48.993802 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f4043fb-6569-4851-8ad3-c89ea6170ae4 req-46c4569d-e644-468b-8d63-d0e8d0e87396 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0806358 May 12 16:27:49.038863 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-3f4043fb-6569-4851-8ad3-c89ea6170ae4 req-5cf79b12-2b7c-4de5-be38-80db373106a3 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392790 May 12 16:27:49.241352 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c7c3b6d-568a-4b1d-947c-b3a0db0672da req-95ea89a2-c873-44a9-a248-14df8b94958f service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0447795 May 12 16:27:49.348961 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c7c3b6d-568a-4b1d-947c-b3a0db0672da req-99030304-55f8-4807-a2c4-b42ce9dc36f5 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0412140 May 12 16:27:49.391247 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c7c3b6d-568a-4b1d-947c-b3a0db0672da req-2dcfd084-59d0-482d-941c-a67f4a8fa43c service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0242097 May 12 16:27:49.524118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c7c3b6d-568a-4b1d-947c-b3a0db0672da req-5cc6e9a9-4a91-4cfc-8c61-acb861ab06a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:49.525488 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5c7c3b6d-568a-4b1d-947c-b3a0db0672da req-5cc6e9a9-4a91-4cfc-8c61-acb861ab06a6 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1293182 May 12 16:27:49.960329 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:27:50.233537 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d8ba582-9eea-40b8-ae21-5f8496d38570 req-56e37ffd-6501-4b07-8372-beebae01281b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:27:50.235144 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d8ba582-9eea-40b8-ae21-5f8496d38570 req-56e37ffd-6501-4b07-8372-beebae01281b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0861051 May 12 16:27:50.280368 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6d8ba582-9eea-40b8-ae21-5f8496d38570 req-770630f8-e8f1-4388-a587-247c4511dc8b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390909 May 12 16:28:03.086052 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:28:12.930968 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b08e9fa5-6608-474b-b7b2-5cff2533ef62 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:28:13.904037 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:28:14.009593 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9667aec-9994-485e-84a3-2b37b3f11624 req-09137a9c-15b9-4df4-ac31-a6ad46b84ce8 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0798953 May 12 16:28:14.174547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9667aec-9994-485e-84a3-2b37b3f11624 req-a6d25925-7a27-4637-983f-c7db4263acef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:28:14.174547 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9667aec-9994-485e-84a3-2b37b3f11624 req-a6d25925-7a27-4637-983f-c7db4263acef service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 1096 time: 0.0756664 May 12 16:28:14.322083 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9667aec-9994-485e-84a3-2b37b3f11624 req-24d00c6f-a974-4fda-aad0-149374db99ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:28:14.323974 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9667aec-9994-485e-84a3-2b37b3f11624 req-24d00c6f-a974-4fda-aad0-149374db99ee service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.1315346 May 12 16:28:14.433642 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9667aec-9994-485e-84a3-2b37b3f11624 req-1a488d83-6893-4dbf-ae74-12b467cc9d6c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=26ea03e6-402b-442a-8a05-eedb82616657 HTTP/1.1" status: 200 len: 1000 time: 0.1031923 May 12 16:28:14.500431 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9667aec-9994-485e-84a3-2b37b3f11624 req-3a22175f-9d75-4c85-b5da-55b1081c742d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:28:14.501933 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9667aec-9994-485e-84a3-2b37b3f11624 req-3a22175f-9d75-4c85-b5da-55b1081c742d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0591347 May 12 16:28:14.582827 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9667aec-9994-485e-84a3-2b37b3f11624 req-7236778c-9afe-4748-a18a-6649c7bf051e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:28:14.584679 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9667aec-9994-485e-84a3-2b37b3f11624 req-7236778c-9afe-4748-a18a-6649c7bf051e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0747321 May 12 16:28:14.722719 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9667aec-9994-485e-84a3-2b37b3f11624 req-4fdef6d0-0661-43b7-8fbe-0dbf707a858b service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1306999 May 12 16:28:14.855782 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e9667aec-9994-485e-84a3-2b37b3f11624 req-d1c382fe-658c-4130-bdd1-8898602feb16 service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1273754 May 12 16:28:15.460451 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d0b88187-5c99-4e8d-8c2b-3f0a50195f6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:28:16.194943 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:28:16.491620 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:28:17.968592 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:28:26.960115 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:28:33.101259 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:28:42.933598 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6ae4d559-b145-49f4-9bd3-f93395926d5c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:28:43.918570 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:28:45.462151 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-417dceed-50c4-4e21-a5fd-1b038eeafb0f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:28:46.198805 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:28:46.492609 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:28:47.970111 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:28:50.295740 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f595b9ca-a643-46bc-8ba5-72dbdebe5272 req-56dfbe8d-0ee1-4dd7-8aca-82eb97674af9 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0932636 May 12 16:28:50.401718 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f595b9ca-a643-46bc-8ba5-72dbdebe5272 req-f66c8b82-e3e8-4aa6-ad0d-01ed798fe8b3 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0410850 May 12 16:28:50.447662 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f595b9ca-a643-46bc-8ba5-72dbdebe5272 req-d16ab688-e085-44c8-8720-79bf00720c2f service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0282407 May 12 16:28:50.583943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f595b9ca-a643-46bc-8ba5-72dbdebe5272 req-22094489-c7c5-480b-8ca9-9eef78c45581 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:28:50.585235 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f595b9ca-a643-46bc-8ba5-72dbdebe5272 req-22094489-c7c5-480b-8ca9-9eef78c45581 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1322136 May 12 16:29:03.100729 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:03.959811 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:29:08.829939 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57300) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:09.132606 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Deleting port 43073b42-acbe-4092-8bdc-6b64bd015b31 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:29:09.132830 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:09.301309 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:09.301663 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:09.423898 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Calling delete_port for 43073b42-acbe-4092-8bdc-6b64bd015b31 owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:29:09.579339 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:09.626877 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event deleted for resources: {'Port': ['ID=43073b42-acbe-4092-8bdc-6b64bd015b31,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:09.668826 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:09.669158 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:09.669509 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:09.669835 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:09.670151 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:09.670465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:09.670777 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:09.671086 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:09.671394 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:09.671701 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:09.672010 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:09.672315 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:09.726948 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:09.727297 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Floating IP 02da9843-9e41-40dd-a8c5-e6fc2049ba45 disassociated (deleted). External IP: 172.25.8.82, port: 26ea03e6-402b-442a-8a05-eedb82616657. May 12 16:29:10.071204 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:29:10.248388 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:29:10.259236 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a42e3da8-0a9d-44e3-be75-1dce02f3e680 None None] Sync routers for ids ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:29:10.266344 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:10.268728 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a42e3da8-0a9d-44e3-be75-1dce02f3e680 None None] Routers {'99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:10.269475 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a42e3da8-0a9d-44e3-be75-1dce02f3e680 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:28:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:10.321574 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-1d8e8cab-9593-4f3b-aa47-4a992a98a44a tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "DELETE /v2.0/floatingips/02da9843-9e41-40dd-a8c5-e6fc2049ba45 HTTP/1.1" status: 204 len: 168 time: 1.4902902 May 12 16:29:10.322369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'tag': '26ea03e6-402b-442a-8a05-eedb82616657'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:29:10.439090 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-88caa27e-0158-4f3c-b9c6-c25b48a2e570'] response: {'name': 'network-changed', 'server_uuid': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'tag': '26ea03e6-402b-442a-8a05-eedb82616657', 'status': 'completed', 'code': 200} May 12 16:29:10.457220 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-a42e3da8-0a9d-44e3-be75-1dce02f3e680 None None] Set router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:10.572388 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b4145d-5d67-4b27-86c8-af02c04293fd req-02398f7b-be18-462d-8687-50132dc0efcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:10.574039 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02b4145d-5d67-4b27-86c8-af02c04293fd req-02398f7b-be18-462d-8687-50132dc0efcc service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=6b4fff63f40147c189245b3a596d32b4&device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 1096 time: 0.0773518 May 12 16:29:10.787183 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a42e3da8-0a9d-44e3-be75-1dce02f3e680 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:23Z', 'revision_number': 5, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:10.797095 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a42e3da8-0a9d-44e3-be75-1dce02f3e680 None None] Checking router: 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:29:10.801628 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a42e3da8-0a9d-44e3-be75-1dce02f3e680 None None] Routers {'99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:10.802254 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a42e3da8-0a9d-44e3-be75-1dce02f3e680 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:28:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:10.894133 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b4145d-5d67-4b27-86c8-af02c04293fd req-d9d9141f-d453-4e16-8bb9-93395258caf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:10.895479 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02b4145d-5d67-4b27-86c8-af02c04293fd req-d9d9141f-d453-4e16-8bb9-93395258caf0 service neutron] 10.222.0.84 "GET /v2.0/networks?id=48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 200 len: 909 time: 0.2667222 May 12 16:29:10.897788 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88831932-2c19-4f2a-bfae-d6bcb0ebdc2c req-05f58e7a-e1f1-494d-8437-91106c3774ad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:10.898676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-88831932-2c19-4f2a-bfae-d6bcb0ebdc2c req-05f58e7a-e1f1-494d-8437-91106c3774ad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Synchronizing usage tracker for tenant:6b4fff63f40147c189245b3a596d32b4 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:29:10.915083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-88831932-2c19-4f2a-bfae-d6bcb0ebdc2c req-05f58e7a-e1f1-494d-8437-91106c3774ad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Unset dirty status for tenant:6b4fff63f40147c189245b3a596d32b4 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:29:10.917941 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88831932-2c19-4f2a-bfae-d6bcb0ebdc2c req-05f58e7a-e1f1-494d-8437-91106c3774ad tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.2753966 May 12 16:29:10.968816 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02b4145d-5d67-4b27-86c8-af02c04293fd req-f2127dd7-0142-40d2-b816-928ce716ddcf service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=26ea03e6-402b-442a-8a05-eedb82616657 HTTP/1.1" status: 200 len: 217 time: 0.0650887 May 12 16:29:10.970816 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-88831932-2c19-4f2a-bfae-d6bcb0ebdc2c req-c4c92ba4-7f62-4c51-823e-a547c0b134ec tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425026 May 12 16:29:10.993506 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-a42e3da8-0a9d-44e3-be75-1dce02f3e680 None None] Set router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:11.032862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b4145d-5d67-4b27-86c8-af02c04293fd req-7d5611a0-792e-4357-893f-da6c91058b97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:11.034319 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02b4145d-5d67-4b27-86c8-af02c04293fd req-7d5611a0-792e-4357-893f-da6c91058b97 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 200 len: 847 time: 0.0592229 May 12 16:29:11.111711 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b4145d-5d67-4b27-86c8-af02c04293fd req-10c00e70-c807-4aa4-a649-8ad28f800b71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:11.113173 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02b4145d-5d67-4b27-86c8-af02c04293fd req-10c00e70-c807-4aa4-a649-8ad28f800b71 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=48e2a895-0939-4482-a024-4695162ad5b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0728309 May 12 16:29:11.290719 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02b4145d-5d67-4b27-86c8-af02c04293fd req-69899940-bcb2-4a19-8b0c-50980864ef5b service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1706448 May 12 16:29:11.311097 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-a42e3da8-0a9d-44e3-be75-1dce02f3e680 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:23Z', 'revision_number': 5, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:11.315010 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a42e3da8-0a9d-44e3-be75-1dce02f3e680 None None] The sync data for ids ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'] in n-d-841483-1 is: [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:16Z', 'revision_number': 4, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': 'd41f2319-31af-49c2-b7b4-c64cf4da506c', 'name': '', 'network_id': '48e2a895-0939-4482-a024-4695162ad5b7', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'mac_address': 'fa:16:3e:96:d4:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 4382, 'fixed_ips': [{'subnet_id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:15Z', 'updated_at': '2022-05-12T16:20:23Z', 'revision_number': 5, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'subnets': [{'id': '8139b3d1-92b7-4512-b9ab-db914dde57e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:29:11.430894 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-02b4145d-5d67-4b27-86c8-af02c04293fd req-fadff196-068f-49d8-94b6-b6aeb6a9710e service neutron] 10.222.0.84 "GET /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1332123 May 12 16:29:11.548832 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37b5f2c7-576c-425d-bc0d-508b78bf27a8 None None] New status for floating IP 02da9843-9e41-40dd-a8c5-e6fc2049ba45: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:29:12.201150 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0b360eb-11dc-4a38-92d4-942a1ecae583 req-0fa688f3-bb6a-480a-82c0-32eeac52080b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:12.202882 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0b360eb-11dc-4a38-92d4-942a1ecae583 req-0fa688f3-bb6a-480a-82c0-32eeac52080b tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.1237824 May 12 16:29:12.248179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e0b360eb-11dc-4a38-92d4-942a1ecae583 req-704a255d-323c-456d-8e76-c869a1ff6427 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/security-groups?id=18a9595e-e477-48a6-8dbc-4c992dad06e8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396798 May 12 16:29:12.635298 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2124ea6-2987-451e-bfdd-156e853755c9 req-3249ee19-b4e4-409b-8c0a-5456d684c5d6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:12.635829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-e2124ea6-2987-451e-bfdd-156e853755c9 req-3249ee19-b4e4-409b-8c0a-5456d684c5d6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Synchronizing usage tracker for tenant:6b4fff63f40147c189245b3a596d32b4 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:29:12.647203 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-e2124ea6-2987-451e-bfdd-156e853755c9 req-3249ee19-b4e4-409b-8c0a-5456d684c5d6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Unset dirty status for tenant:6b4fff63f40147c189245b3a596d32b4 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:29:12.648432 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2124ea6-2987-451e-bfdd-156e853755c9 req-3249ee19-b4e4-409b-8c0a-5456d684c5d6 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.84 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 945 time: 0.0912330 May 12 16:29:12.719404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-e2124ea6-2987-451e-bfdd-156e853755c9 req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Deleting port 26ea03e6-402b-442a-8a05-eedb82616657 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:29:12.719739 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e2124ea6-2987-451e-bfdd-156e853755c9 req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:12.934102 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c988f767-133a-498d-b5ff-3143f191c680 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:12.969085 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-e2124ea6-2987-451e-bfdd-156e853755c9 req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] For port 26ea03e6-402b-442a-8a05-eedb82616657, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=26ea03e6-402b-442a-8a05-eedb82616657,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:12.969473 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e2124ea6-2987-451e-bfdd-156e853755c9 req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:13.095144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-e2124ea6-2987-451e-bfdd-156e853755c9 req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Calling delete_port for 26ea03e6-402b-442a-8a05-eedb82616657 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:29:13.239839 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e2124ea6-2987-451e-bfdd-156e853755c9 req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:13.295109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event deleted for resources: {'Port': ['ID=26ea03e6-402b-442a-8a05-eedb82616657,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:13.339253 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:13.339588 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:13.339923 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:13.340254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:13.340582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:13.340903 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:13.341225 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:13.341570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:13.341890 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:13.342209 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:13.342547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:13.342867 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:13.380400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-e2124ea6-2987-451e-bfdd-156e853755c9 req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] No DVR routers for this DVR port 26ea03e6-402b-442a-8a05-eedb82616657 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:29:13.383636 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-e2124ea6-2987-451e-bfdd-156e853755c9 req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:13.386168 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'name': 'network-vif-deleted', 'tag': '26ea03e6-402b-442a-8a05-eedb82616657'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:29:13.402967 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e2124ea6-2987-451e-bfdd-156e853755c9 req-cec7202a-d25c-474c-a432-ba229c8bf7b5 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.84 "DELETE /v2.0/ports/26ea03e6-402b-442a-8a05-eedb82616657 HTTP/1.1" status: 204 len: 173 time: 0.7463963 May 12 16:29:13.403763 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-15d8f19e-90e3-4773-bfcb-f36be283e5f5 req-e4c3412e-48d1-463a-8909-cddaf9158825 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 210 time: 0.0429151 May 12 16:29:13.433908 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9009e54b-c580-498d-941a-66789346bceb'] response: {'server_uuid': '6a56eb83-1781-4f69-9cb5-d0e59e705829', 'name': 'network-vif-deleted', 'tag': '26ea03e6-402b-442a-8a05-eedb82616657', 'status': 'completed', 'code': 200} May 12 16:29:13.919249 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:14.579980 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-cc8eff04-747e-4fad-9302-c0b56aa22e29 req-b278e80c-1255-411c-92bc-326ed43a9a59 tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "GET /v2.0/ports?device_id=6a56eb83-1781-4f69-9cb5-d0e59e705829 HTTP/1.1" status: 200 len: 210 time: 0.0466025 May 12 16:29:15.465877 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-86d39592-d530-4aef-883f-650dabf1ebd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:15.672680 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57328) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:15.681751 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 26ea03e6-402b-442a-8a05-eedb82616657 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:29:15.720811 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 26ea03e6-402b-442a-8a05-eedb82616657 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:29:15.721256 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 26ea03e6-402b-442a-8a05-eedb82616657 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:29:15.747897 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17b09dd5-21bd-42a7-8bea-06a9f207778e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:15.778435 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17b09dd5-21bd-42a7-8bea-06a9f207778e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:15.845663 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17b09dd5-21bd-42a7-8bea-06a9f207778e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:15.863313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17b09dd5-21bd-42a7-8bea-06a9f207778e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=18a9595e-e477-48a6-8dbc-4c992dad06e8,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:15.878256 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-17b09dd5-21bd-42a7-8bea-06a9f207778e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:15.883470 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-17b09dd5-21bd-42a7-8bea-06a9f207778e tempest-TestShelveInstance-1877512891 tempest-TestShelveInstance-1877512891-project] 10.222.0.82 "DELETE /v2.0/security-groups/18a9595e-e477-48a6-8dbc-4c992dad06e8 HTTP/1.1" status: 204 len: 168 time: 0.2092509 May 12 16:29:15.936506 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57334) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:16.206592 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:16.494865 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:16.603271 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36bd573c-000d-4b3a-b253-00457e17fb4f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:16.958291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-36bd573c-000d-4b3a-b253-00457e17fb4f admin admin] Deleting port d41f2319-31af-49c2-b7b4-c64cf4da506c {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:29:16.958963 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36bd573c-000d-4b3a-b253-00457e17fb4f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:17.128675 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-36bd573c-000d-4b3a-b253-00457e17fb4f admin admin] For port d41f2319-31af-49c2-b7b4-c64cf4da506c, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=d41f2319-31af-49c2-b7b4-c64cf4da506c,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:17.129029 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36bd573c-000d-4b3a-b253-00457e17fb4f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:17.359450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-36bd573c-000d-4b3a-b253-00457e17fb4f admin admin] Calling delete_port for d41f2319-31af-49c2-b7b4-c64cf4da506c owned by network:router_interface {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:29:17.542319 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36bd573c-000d-4b3a-b253-00457e17fb4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:17.620008 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36bd573c-000d-4b3a-b253-00457e17fb4f admin admin] Pushing event deleted for resources: {'Port': ['ID=d41f2319-31af-49c2-b7b4-c64cf4da506c,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:17.873248 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-36bd573c-000d-4b3a-b253-00457e17fb4f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:17.973682 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:18.232757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-36bd573c-000d-4b3a-b253-00457e17fb4f admin admin] Router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:29:18.409169 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-36bd573c-000d-4b3a-b253-00457e17fb4f admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:29:18.417907 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f02a43c-93a4-4fb7-acac-a605c760c73e None None] Sync routers for ids ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:29:18.423396 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-36bd573c-000d-4b3a-b253-00457e17fb4f admin admin] 10.222.0.82 "PUT /v2.0/routers/99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4836349 May 12 16:29:18.423651 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57340) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:18.426949 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f02a43c-93a4-4fb7-acac-a605c760c73e None None] Routers {'99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:18.427539 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2f02a43c-93a4-4fb7-acac-a605c760c73e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:29:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:18.601432 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] Notify callbacks [] for router, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:18.636374 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-2f02a43c-93a4-4fb7-acac-a605c760c73e None None] Set router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:18.897456 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:18.906913 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] Deleting port 9d72a3da-de5e-4329-b92b-afb59dad74f2 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:29:18.907255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:18.918703 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2f02a43c-93a4-4fb7-acac-a605c760c73e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62'}], 'enable_snat': True}, 'gw_port_id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:29:17Z', 'revision_number': 5, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port': {'id': '9d72a3da-de5e-4329-b92b-afb59dad74f2', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:a7:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4381, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:20:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:18.922585 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f02a43c-93a4-4fb7-acac-a605c760c73e None None] Checking router: 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:29:18.931428 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f02a43c-93a4-4fb7-acac-a605c760c73e None None] Routers {'99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:18.932015 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2f02a43c-93a4-4fb7-acac-a605c760c73e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:29:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:19.077175 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-2f02a43c-93a4-4fb7-acac-a605c760c73e None None] Set router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:19.088331 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] For port 9d72a3da-de5e-4329-b92b-afb59dad74f2, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=9d72a3da-de5e-4329-b92b-afb59dad74f2,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:19.088684 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:19.180946 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-2f02a43c-93a4-4fb7-acac-a605c760c73e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:29:18Z', 'revision_number': 6, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:19.184727 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f02a43c-93a4-4fb7-acac-a605c760c73e None None] The sync data for ids ['99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc'] in n-d-841483-1 is: [{'id': '99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc', 'name': 'tempest-TestShelveInstance-494001375-router', 'tenant_id': '6b4fff63f40147c189245b3a596d32b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:12Z', 'updated_at': '2022-05-12T16:29:18Z', 'revision_number': 6, 'project_id': '6b4fff63f40147c189245b3a596d32b4', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:29:19.213152 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] Calling delete_port for 9d72a3da-de5e-4329-b92b-afb59dad74f2 owned by network:router_gateway {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:29:19.380121 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:19.426240 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] Pushing event deleted for resources: {'Port': ['ID=9d72a3da-de5e-4329-b92b-afb59dad74f2,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:19.521792 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:19.698589 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:19.700650 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:19.723106 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:19.723609 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc {{(pid=88152) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:29:19.735745 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:19.736830 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-53dd8c7b-cf3f-4a99-bb3d-4342b941d562 admin admin] 10.222.0.82 "DELETE /v2.0/routers/99f2d3b6-8201-4a44-b63d-d3cbcc78f6cc HTTP/1.1" status: 204 len: 168 time: 1.3122835 May 12 16:29:19.739387 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57344) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:19.799545 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_v2 [None req-5e64178b-862e-4782-9c9f-2ee9e8928b2b admin admin] Deleting subnet 8139b3d1-92b7-4512-b9ab-db914dde57e3 {{(pid=88152) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:29:19.802446 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e64178b-862e-4782-9c9f-2ee9e8928b2b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:19.868004 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e64178b-862e-4782-9c9f-2ee9e8928b2b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28130188'] for subnet, precommit_delete_associations {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:19.952098 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e64178b-862e-4782-9c9f-2ee9e8928b2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:20.025449 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e64178b-862e-4782-9c9f-2ee9e8928b2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28130216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1637744'] for subnet, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:20.066971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e64178b-862e-4782-9c9f-2ee9e8928b2b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8139b3d1-92b7-4512-b9ab-db914dde57e3,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:20.071200 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5e64178b-862e-4782-9c9f-2ee9e8928b2b admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:20.077097 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45a4c84a-980c-4bfd-9c1d-dcfcf42144c3 None None] Network 48e2a895-0939-4482-a024-4695162ad5b7 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:29:20.078064 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5e64178b-862e-4782-9c9f-2ee9e8928b2b admin admin] 10.222.0.82 "DELETE /v2.0/subnets/8139b3d1-92b7-4512-b9ab-db914dde57e3 HTTP/1.1" status: 204 len: 168 time: 0.3370869 May 12 16:29:20.081418 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57348) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:20.326049 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:20.345427 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Deleting port 46a3438f-08b9-443c-abfc-44af7f6ffc55 {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:29:20.345931 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:20.386822 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ea65e36-9c80-439a-b2bf-c2c38124d7ec None None] DHCP port deletion for 48e2a895-0939-4482-a024-4695162ad5b7 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:29:20.391303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6ea65e36-9c80-439a-b2bf-c2c38124d7ec None None] Deleting port 46a3438f-08b9-443c-abfc-44af7f6ffc55 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:29:20.391706 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6ea65e36-9c80-439a-b2bf-c2c38124d7ec None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:20.563917 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.db [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] For port 46a3438f-08b9-443c-abfc-44af7f6ffc55, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=46a3438f-08b9-443c-abfc-44af7f6ffc55,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88152) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:20.564469 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:20.636318 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-6ea65e36-9c80-439a-b2bf-c2c38124d7ec None None] For port 46a3438f-08b9-443c-abfc-44af7f6ffc55, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=46a3438f-08b9-443c-abfc-44af7f6ffc55,segment=NetworkSegment(fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876),segment_id=fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:20.636742 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6ea65e36-9c80-439a-b2bf-c2c38124d7ec None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:20.705049 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Calling delete_port for 46a3438f-08b9-443c-abfc-44af7f6ffc55 owned by network:dhcp {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:29:20.777322 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6ea65e36-9c80-439a-b2bf-c2c38124d7ec None None] Calling delete_port for 46a3438f-08b9-443c-abfc-44af7f6ffc55 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:29:20.782866 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:20.834932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Pushing event deleted for resources: {'Port': ['ID=46a3438f-08b9-443c-abfc-44af7f6ffc55,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:20.838374 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] No DVR routers for this DVR port 46a3438f-08b9-443c-abfc-44af7f6ffc55 on host n-d-841483-1 {{(pid=88152) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 12 16:29:20.849800 n-d-841483-1 neutron-server[88153]: util.warn( May 12 16:29:20.854831 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-6ea65e36-9c80-439a-b2bf-c2c38124d7ec None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:29:20.855229 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-6ea65e36-9c80-439a-b2bf-c2c38124d7ec None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:29:20.958838 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:20.986922 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['48e2a895-0939-4482-a024-4695162ad5b7']}} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:20.990356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 46a3438f-08b9-443c-abfc-44af7f6ffc55 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:29:21.001135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876') {'for_net_delete': True} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:21.001461 n-d-841483-1 neutron-server[88152]: DEBUG neutron.services.segments.db [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fcb3dcfc-40e9-4263-b5e2-ed06b7cd6876') {} {{(pid=88152) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:21.013029 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28130229'] for segment, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:21.024473 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 46a3438f-08b9-443c-abfc-44af7f6ffc55 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:29:21.024807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 46a3438f-08b9-443c-abfc-44af7f6ffc55 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:29:21.025216 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d41f2319-31af-49c2-b7b4-c64cf4da506c no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:29:21.029267 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:21.040700 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Releasing vlan 553 on physical network physnet1 to pool {{(pid=88152) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:29:21.041123 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28164106'] for segment, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: Traceback (most recent call last): May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: timer() May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: cb(*args, **kw) May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: return func(*args, **kwargs) May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: self._notify() May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: self.callback(batched_events) May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: event.method(event) May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: return f(self, *a, **k) May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: return self._get(url).json() May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: return self.request(url, 'GET', **kwargs) May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:29:21.055557 n-d-841483-1 neutron-server[88152]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:29:21.060061 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: d41f2319-31af-49c2-b7b4-c64cf4da506c {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:29:21.060481 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device d41f2319-31af-49c2-b7b4-c64cf4da506c not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:29:21.060941 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9d72a3da-de5e-4329-b92b-afb59dad74f2 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:29:21.097664 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 9d72a3da-de5e-4329-b92b-afb59dad74f2 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:29:21.098323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 9d72a3da-de5e-4329-b92b-afb59dad74f2 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:29:21.135085 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:21.139881 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:21.167224 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] Pushing event deleted for resources: {'Network': ['ID=48e2a895-0939-4482-a024-4695162ad5b7,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:21.177884 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-99564c6c-b4b7-406c-8a90-dd072ebb6111 admin admin] 10.222.0.82 "DELETE /v2.0/networks/48e2a895-0939-4482-a024-4695162ad5b7 HTTP/1.1" status: 204 len: 168 time: 1.0954316 May 12 16:29:21.181036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57352) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:21.356383 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6ea65e36-9c80-439a-b2bf-c2c38124d7ec None None] Deleting port 46a3438f-08b9-443c-abfc-44af7f6ffc55 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:29:21.356659 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6ea65e36-9c80-439a-b2bf-c2c38124d7ec None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:21.421399 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-6ea65e36-9c80-439a-b2bf-c2c38124d7ec None None] The port '46a3438f-08b9-443c-abfc-44af7f6ffc55' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 16:29:21.835952 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4a17e2d-cf8f-4e73-8dbb-828d44f88062 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:22.177152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b4a17e2d-cf8f-4e73-8dbb-828d44f88062 admin admin] Deleting port 7413a840-611a-48c8-82c3-9542b4ef7bd5 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:29:22.177410 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4a17e2d-cf8f-4e73-8dbb-828d44f88062 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:22.345815 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-b4a17e2d-cf8f-4e73-8dbb-828d44f88062 admin admin] For port 7413a840-611a-48c8-82c3-9542b4ef7bd5, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7413a840-611a-48c8-82c3-9542b4ef7bd5,segment=NetworkSegment(cf8d8114-3e96-43ac-92d1-2b303b9ab997),segment_id=cf8d8114-3e96-43ac-92d1-2b303b9ab997)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:22.346473 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4a17e2d-cf8f-4e73-8dbb-828d44f88062 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:22.469280 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-b4a17e2d-cf8f-4e73-8dbb-828d44f88062 admin admin] Calling delete_port for 7413a840-611a-48c8-82c3-9542b4ef7bd5 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:29:22.891049 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4a17e2d-cf8f-4e73-8dbb-828d44f88062 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:22.941467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4a17e2d-cf8f-4e73-8dbb-828d44f88062 admin admin] Pushing event deleted for resources: {'Port': ['ID=7413a840-611a-48c8-82c3-9542b4ef7bd5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:23.209768 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-b4a17e2d-cf8f-4e73-8dbb-828d44f88062 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:23.564236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b4a17e2d-cf8f-4e73-8dbb-828d44f88062 admin admin] Router b17393cf-63fb-4301-ba0c-5cd2740b366c has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:29:23.738829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b4a17e2d-cf8f-4e73-8dbb-828d44f88062 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:29:23.747666 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef5b0766-052f-4476-b059-fcdeb2fe5e10 None None] Sync routers for ids ['b17393cf-63fb-4301-ba0c-5cd2740b366c'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:29:23.748159 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-b4a17e2d-cf8f-4e73-8dbb-828d44f88062 admin admin] 10.222.0.82 "PUT /v2.0/routers/b17393cf-63fb-4301-ba0c-5cd2740b366c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5655932 May 12 16:29:23.750183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57356) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:23.757683 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef5b0766-052f-4476-b059-fcdeb2fe5e10 None None] Routers {'b17393cf-63fb-4301-ba0c-5cd2740b366c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:23.758390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ef5b0766-052f-4476-b059-fcdeb2fe5e10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:29:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['b17393cf-63fb-4301-ba0c-5cd2740b366c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:23.930304 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:23.969333 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ef5b0766-052f-4476-b059-fcdeb2fe5e10 None None] Set router b17393cf-63fb-4301-ba0c-5cd2740b366c gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:24.110071 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:24.120112 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] Deleting port cef796c0-988c-4ae3-84c7-2bcf3a5955bb {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:29:24.120513 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:24.260524 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ef5b0766-052f-4476-b059-fcdeb2fe5e10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'name': 'tempest-TestShelveInstance-847427837-router', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.51'}], 'enable_snat': True}, 'gw_port_id': 'cef796c0-988c-4ae3-84c7-2bcf3a5955bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:18Z', 'updated_at': '2022-05-12T16:29:22Z', 'revision_number': 5, 'project_id': '59610b028688469da6329f4ac88d5293', 'gw_port': {'id': 'cef796c0-988c-4ae3-84c7-2bcf3a5955bb', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:10:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4393, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:20:19Z', 'updated_at': '2022-05-12T16:20:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:24.264898 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef5b0766-052f-4476-b059-fcdeb2fe5e10 None None] Checking router: b17393cf-63fb-4301-ba0c-5cd2740b366c for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:29:24.274308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef5b0766-052f-4476-b059-fcdeb2fe5e10 None None] Routers {'b17393cf-63fb-4301-ba0c-5cd2740b366c'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:24.274919 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ef5b0766-052f-4476-b059-fcdeb2fe5e10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:29:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['b17393cf-63fb-4301-ba0c-5cd2740b366c'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:24.422826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-ef5b0766-052f-4476-b059-fcdeb2fe5e10 None None] Set router b17393cf-63fb-4301-ba0c-5cd2740b366c gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:24.427808 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] For port cef796c0-988c-4ae3-84c7-2bcf3a5955bb, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=cef796c0-988c-4ae3-84c7-2bcf3a5955bb,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:24.428179 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:24.529082 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-ef5b0766-052f-4476-b059-fcdeb2fe5e10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'name': 'tempest-TestShelveInstance-847427837-router', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:18Z', 'updated_at': '2022-05-12T16:29:24Z', 'revision_number': 6, 'project_id': '59610b028688469da6329f4ac88d5293', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:24.532980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef5b0766-052f-4476-b059-fcdeb2fe5e10 None None] The sync data for ids ['b17393cf-63fb-4301-ba0c-5cd2740b366c'] in n-d-841483-1 is: [{'id': 'b17393cf-63fb-4301-ba0c-5cd2740b366c', 'name': 'tempest-TestShelveInstance-847427837-router', 'tenant_id': '59610b028688469da6329f4ac88d5293', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:20:18Z', 'updated_at': '2022-05-12T16:29:24Z', 'revision_number': 6, 'project_id': '59610b028688469da6329f4ac88d5293', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:29:24.552607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] Calling delete_port for cef796c0-988c-4ae3-84c7-2bcf3a5955bb owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:29:24.718233 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:24.767521 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] Pushing event deleted for resources: {'Port': ['ID=cef796c0-988c-4ae3-84c7-2bcf3a5955bb,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:24.858065 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.036170 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.039190 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.061411 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.061965 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] Fanout notify agent at l3_agent the message router_deleted on router b17393cf-63fb-4301-ba0c-5cd2740b366c {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:29:25.073971 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.075089 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-185b92af-c247-45ca-92ef-24bf001de188 admin admin] 10.222.0.82 "DELETE /v2.0/routers/b17393cf-63fb-4301-ba0c-5cd2740b366c HTTP/1.1" status: 204 len: 168 time: 1.3240168 May 12 16:29:25.077527 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57360) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:25.139820 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-998b6e89-e15b-44db-a3f6-de5986bc13c4 admin admin] Deleting subnet d1401063-8f55-4e28-922d-4e9b09f11ce1 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:29:25.142813 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-998b6e89-e15b-44db-a3f6-de5986bc13c4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.191533 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-998b6e89-e15b-44db-a3f6-de5986bc13c4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.271512 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-998b6e89-e15b-44db-a3f6-de5986bc13c4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.343582 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-998b6e89-e15b-44db-a3f6-de5986bc13c4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.355895 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7413a840-611a-48c8-82c3-9542b4ef7bd5 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:29:25.386254 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-998b6e89-e15b-44db-a3f6-de5986bc13c4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d1401063-8f55-4e28-922d-4e9b09f11ce1,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:25.389928 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-998b6e89-e15b-44db-a3f6-de5986bc13c4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.393897 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 7413a840-611a-48c8-82c3-9542b4ef7bd5 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:29:25.394240 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7413a840-611a-48c8-82c3-9542b4ef7bd5 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:29:25.396107 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-998b6e89-e15b-44db-a3f6-de5986bc13c4 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/d1401063-8f55-4e28-922d-4e9b09f11ce1 HTTP/1.1" status: 204 len: 168 time: 0.3173652 May 12 16:29:25.396729 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a0c0423-715a-41f4-96cf-0b41947a0326 None None] Network 8c5ae056-e90a-4b08-ad7b-58eee574e324 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:29:25.399162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57364) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:25.510749 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.521950 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Deleting port 72a508c9-461d-42bb-852c-88cff4f0059e {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:29:25.522893 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.653863 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4af624a6-d14e-4828-b0fc-4cdcc3998a24 None None] DHCP port deletion for 8c5ae056-e90a-4b08-ad7b-58eee574e324 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:29:25.657647 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4af624a6-d14e-4828-b0fc-4cdcc3998a24 None None] Deleting port 72a508c9-461d-42bb-852c-88cff4f0059e {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:29:25.658019 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4af624a6-d14e-4828-b0fc-4cdcc3998a24 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.847547 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] For port 72a508c9-461d-42bb-852c-88cff4f0059e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=72a508c9-461d-42bb-852c-88cff4f0059e,segment=NetworkSegment(cf8d8114-3e96-43ac-92d1-2b303b9ab997),segment_id=cf8d8114-3e96-43ac-92d1-2b303b9ab997)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:25.848094 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.869799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-4af624a6-d14e-4828-b0fc-4cdcc3998a24 None None] For port 72a508c9-461d-42bb-852c-88cff4f0059e, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=72a508c9-461d-42bb-852c-88cff4f0059e,segment=NetworkSegment(cf8d8114-3e96-43ac-92d1-2b303b9ab997),segment_id=cf8d8114-3e96-43ac-92d1-2b303b9ab997)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:25.870190 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4af624a6-d14e-4828-b0fc-4cdcc3998a24 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:25.971626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Calling delete_port for 72a508c9-461d-42bb-852c-88cff4f0059e owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:29:26.031079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4af624a6-d14e-4828-b0fc-4cdcc3998a24 None None] Calling delete_port for 72a508c9-461d-42bb-852c-88cff4f0059e owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:29:26.056950 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:26.104140 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-4af624a6-d14e-4828-b0fc-4cdcc3998a24 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:29:26.104504 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-4af624a6-d14e-4828-b0fc-4cdcc3998a24 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:29:26.105322 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Pushing event deleted for resources: {'Port': ['ID=72a508c9-461d-42bb-852c-88cff4f0059e,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:26.107121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] No DVR routers for this DVR port 72a508c9-461d-42bb-852c-88cff4f0059e on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:29:26.221798 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:26.246150 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8c5ae056-e90a-4b08-ad7b-58eee574e324']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:26.259546 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cf8d8114-3e96-43ac-92d1-2b303b9ab997') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:26.259851 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cf8d8114-3e96-43ac-92d1-2b303b9ab997') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:26.271651 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:26.290573 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:26.296433 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Releasing vlan 562 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:29:26.296805 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: timer() May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:29:26.310017 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:29:26.385988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:26.400988 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:26.410716 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] Pushing event deleted for resources: {'Network': ['ID=8c5ae056-e90a-4b08-ad7b-58eee574e324,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:26.414804 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-1d51fb3b-42e3-4276-a745-62eb62f82d59 admin admin] 10.222.0.82 "DELETE /v2.0/networks/8c5ae056-e90a-4b08-ad7b-58eee574e324 HTTP/1.1" status: 204 len: 168 time: 1.0145872 May 12 16:29:26.526501 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57370) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:26.580061 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-fe53b156-6338-4a36-bed8-af2affdff040 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6b4fff63f40147c189245b3a596d32b4&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0517097 May 12 16:29:26.582533 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57374) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:26.606463 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4af624a6-d14e-4828-b0fc-4cdcc3998a24 None None] Deleting port 72a508c9-461d-42bb-852c-88cff4f0059e {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:29:26.606957 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4af624a6-d14e-4828-b0fc-4cdcc3998a24 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:26.639939 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d9b060f-079c-4573-82e7-812b10e3a3e9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:26.666228 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d9b060f-079c-4573-82e7-812b10e3a3e9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:26.674379 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-4af624a6-d14e-4828-b0fc-4cdcc3998a24 None None] The port '72a508c9-461d-42bb-852c-88cff4f0059e' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 16:29:26.718900 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d9b060f-079c-4573-82e7-812b10e3a3e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:26.738960 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d9b060f-079c-4573-82e7-812b10e3a3e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9280f04-e407-455d-8687-2e382dc57a6e,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:26.745630 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-8d9b060f-079c-4573-82e7-812b10e3a3e9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:26.746709 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-8d9b060f-079c-4573-82e7-812b10e3a3e9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c9280f04-e407-455d-8687-2e382dc57a6e HTTP/1.1" status: 204 len: 168 time: 0.1633086 May 12 16:29:26.980984 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 72a508c9-461d-42bb-852c-88cff4f0059e no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:29:27.014017 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 72a508c9-461d-42bb-852c-88cff4f0059e {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:29:27.014351 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 72a508c9-461d-42bb-852c-88cff4f0059e not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:29:27.014750 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cef796c0-988c-4ae3-84c7-2bcf3a5955bb no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:29:27.049698 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: cef796c0-988c-4ae3-84c7-2bcf3a5955bb {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:29:27.050031 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device cef796c0-988c-4ae3-84c7-2bcf3a5955bb not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:29:27.095744 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57382) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:27.144314 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ee25b0e0-2a0b-4fd2-ba84-cebaa2249ff2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=59610b028688469da6329f4ac88d5293&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0474467 May 12 16:29:27.146810 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57386) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:27.203342 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-037b3645-9935-419f-88db-6ac5fd9c1168 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:27.228870 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-037b3645-9935-419f-88db-6ac5fd9c1168 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:27.281655 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-037b3645-9935-419f-88db-6ac5fd9c1168 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:27.296345 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-037b3645-9935-419f-88db-6ac5fd9c1168 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4136cee6-0bb6-49dc-bd10-9bfd1c7a952b,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:27.302610 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-037b3645-9935-419f-88db-6ac5fd9c1168 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:27.304071 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-037b3645-9935-419f-88db-6ac5fd9c1168 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4136cee6-0bb6-49dc-bd10-9bfd1c7a952b HTTP/1.1" status: 204 len: 168 time: 0.1556177 May 12 16:29:28.011105 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57410) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:28.130491 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Request body: {'network': {'name': 'tempest-TestSnapshotPattern-2068289601-network', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:28.136534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:28.140380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Usage tracker for resource:network and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:28.143259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:28.149621 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:28.158259 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Made reservation on behalf of db6d55e7484248b38b40fa3b29a09ab9 for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:29:28.160488 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:28.172154 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:28.189746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:28.193534 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Usage tracker for resource:security_group_rule and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:28.197033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:28.203220 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:28.286398 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:28.290531 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:28.317732 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 566} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:29:28.330286 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=29b923d2-1938-4f87-a21a-4240d2bd6aac,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:28.334613 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:28.334954 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Added segment ddd0765d-5046-493f-a791-a2865e3d2e7b of type vlan for network 6b3165c5-d574-4d2f-be7c-45593aa36427 May 12 16:29:28.361632 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:28.389571 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:28.390487 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:28.391043 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:28.492977 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] Pushing event updated for resources: {'Network': ['ID=6b3165c5-d574-4d2f-be7c-45593aa36427,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:28.496264 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-85c3b88e-d3e9-4d6e-b76b-831acc63dcfe admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.4841497 May 12 16:29:28.499171 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57416) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:28.505498 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Request body: {'subnet': {'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestSnapshotPattern-2068289601-subnet', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'ip_version': 4}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:28.505762 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network 6b3165c5-d574-4d2f-be7c-45593aa36427 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:29:28.511117 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:28.516046 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Usage tracker for resource:subnet and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:28.518943 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:28.525561 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:28.537076 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Made reservation on behalf of db6d55e7484248b38b40fa3b29a09ab9 for: {'subnet': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:29:28.539948 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1637725'] for subnet, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:28.740236 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28130281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1637707'] for subnet, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:28.918893 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:28.928441 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Checking segment: {'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88152) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:29:28.928919 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Network hostable DHCP agents. Network: 6b3165c5-d574-4d2f-be7c-45593aa36427, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88152) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:29:28.948102 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Network 6b3165c5-d574-4d2f-be7c-45593aa36427 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88152) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:29:28.957017 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, 6b3165c5-d574-4d2f-be7c-45593aa36427) {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:29:28.962745 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:28.963316 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:28.968711 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cea5f0b-0186-4f84-bf1d-be9c00fafb76 None None] Network 6b3165c5-d574-4d2f-be7c-45593aa36427 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:29:28.986977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-a284d716-3dbb-44ce-b12b-2e6b067b10a2 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.4842842 May 12 16:29:28.987166 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57420) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:28.992175 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Request body: {'router': {'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:28.997202 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:29.001041 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Usage tracker for resource:router and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:29.003831 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:29.010089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:29.020331 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:29.021254 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:29.036920 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:29.185806 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-6b3165c5-d574-4d2f-be7c-45593aa36427', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:29:29.186634 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:29.310880 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:29.347390 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Allocated IP 172.20.0.2 (6b3165c5-d574-4d2f-be7c-45593aa36427/f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629/feee8dab-cd0c-44e7-9e01-4c5f54819533) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:29:29.555427 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:29.565536 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Transition to ACTIVE for port object feee8dab-cd0c-44e7-9e01-4c5f54819533 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:29:29.583740 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Transition to ACTIVE for port object feee8dab-cd0c-44e7-9e01-4c5f54819533 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:29:29.589782 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:29.627792 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:29.657217 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Network 6b3165c5-d574-4d2f-be7c-45593aa36427 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:29:29.659952 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:29:29.664480 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:29:29.667255 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:29.673321 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Pushing event updated for resources: {'Port': ['ID=feee8dab-cd0c-44e7-9e01-4c5f54819533,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:29.714791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:29.715135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:29.715465 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:29.715792 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:29.716115 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:29.716436 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:29.716772 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:29.717076 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:29.717414 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:29.717722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:29.718039 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:29.718354 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:29.773801 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Attempting to bind port feee8dab-cd0c-44e7-9e01-4c5f54819533 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:29:29.774160 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Attempting to bind port feee8dab-cd0c-44e7-9e01-4c5f54819533 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:29:29.774511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Attempting to bind port feee8dab-cd0c-44e7-9e01-4c5f54819533 on network 6b3165c5-d574-4d2f-be7c-45593aa36427 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:29:29.779775 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 29, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:29:29.780137 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Checking segment: {'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:29:29.780526 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:29.780909 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Bound using segment: {'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:29:29.781499 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Bound port: feee8dab-cd0c-44e7-9e01-4c5f54819533, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:29:29.781866 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:29.809050 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Allocated IP 172.25.8.146 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/de8b681d-853a-4fbe-a5a7-9a1ebf75791a) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:29:29.870641 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] For port feee8dab-cd0c-44e7-9e01-4c5f54819533, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:29:29.873859 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] For port feee8dab-cd0c-44e7-9e01-4c5f54819533, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=feee8dab-cd0c-44e7-9e01-4c5f54819533,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:29:29.879576 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:29.962208 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:29.967611 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d5e3c7-99f7-4eb6-b1e7-1ef183a0092b None None] Pushing event updated for resources: {'Port': ['ID=feee8dab-cd0c-44e7-9e01-4c5f54819533,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:29.997449 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:30.069825 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:29:30.073551 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:29:30.076683 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:29:30.129749 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Pushing event updated for resources: {'Port': ['ID=de8b681d-853a-4fbe-a5a7-9a1ebf75791a,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:30.635552 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:30.900628 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc9f5f19-50ce-4fa0-8653-c8b89166b708 None None] Network 6b3165c5-d574-4d2f-be7c-45593aa36427 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:29:31.005064 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:31.027541 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device feee8dab-cd0c-44e7-9e01-4c5f54819533 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:29:31.108185 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b1c5ba7e-b2cf-4885-9403-6c4bd2ae8518 None None] Provisioning for port feee8dab-cd0c-44e7-9e01-4c5f54819533 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:29:31.230581 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Router 5e022072-e09a-48f5-a3c9-be500ce472bb is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 16:29:31.234567 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port feee8dab-cd0c-44e7-9e01-4c5f54819533 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:29:31.240975 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port feee8dab-cd0c-44e7-9e01-4c5f54819533 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:31.241712 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:31.365259 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:31.403030 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port feee8dab-cd0c-44e7-9e01-4c5f54819533, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=feee8dab-cd0c-44e7-9e01-4c5f54819533,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:31.408220 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:31.441357 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:29:31.453424 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Sync routers for ids ['5e022072-e09a-48f5-a3c9-be500ce472bb'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:29:31.464829 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Routers {'5e022072-e09a-48f5-a3c9-be500ce472bb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:31.465705 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:29:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5e022072-e09a-48f5-a3c9-be500ce472bb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:31.477785 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:31.480393 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5ff137ac-302c-48c7-9484-30e2ce798e42 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.4922156 May 12 16:29:31.483407 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57424) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:31.491435 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=feee8dab-cd0c-44e7-9e01-4c5f54819533,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:31.546278 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-b98f663a-9c17-4fcc-9ad6-8a9456145aac None None] Provisioning complete for port feee8dab-cd0c-44e7-9e01-4c5f54819533 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:31.546731 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b98f663a-9c17-4fcc-9ad6-8a9456145aac None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:31.669514 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Set router 5e022072-e09a-48f5-a3c9-be500ce472bb gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:31.987718 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:30Z', 'revision_number': 3, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:29Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:31.992230 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Checking router: 5e022072-e09a-48f5-a3c9-be500ce472bb for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:29:31.992621 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Updating router 5e022072-e09a-48f5-a3c9-be500ce472bb port de8b681d-853a-4fbe-a5a7-9a1ebf75791a binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:29:32.047522 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:32.176135 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:32.380864 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:32.392656 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Transition to ACTIVE for port object de8b681d-853a-4fbe-a5a7-9a1ebf75791a will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:29:32.400767 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:32.480753 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Attempting to bind port de8b681d-853a-4fbe-a5a7-9a1ebf75791a on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:29:32.481434 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Attempting to bind port de8b681d-853a-4fbe-a5a7-9a1ebf75791a by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:29:32.481434 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Attempting to bind port de8b681d-853a-4fbe-a5a7-9a1ebf75791a on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:29:32.483317 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c98e8262-6bdd-4911-8f15-8090d71b2ed3 None None] Pushing event updated for resources: {'Port': ['ID=de8b681d-853a-4fbe-a5a7-9a1ebf75791a,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:32.492371 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 29, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:29:32.492725 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:29:32.493111 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:32.493511 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:29:32.493954 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Bound port: de8b681d-853a-4fbe-a5a7-9a1ebf75791a, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:29:32.494311 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:32.500115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Allocated IP 172.20.0.1 (6b3165c5-d574-4d2f-be7c-45593aa36427/f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629/1273325e-078d-4d3b-a939-25ae1bdcef89) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:29:32.525203 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e8262-6bdd-4911-8f15-8090d71b2ed3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:32.525553 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e8262-6bdd-4911-8f15-8090d71b2ed3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:32.525876 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e8262-6bdd-4911-8f15-8090d71b2ed3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:32.526189 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e8262-6bdd-4911-8f15-8090d71b2ed3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:32.526513 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e8262-6bdd-4911-8f15-8090d71b2ed3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:32.526812 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e8262-6bdd-4911-8f15-8090d71b2ed3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:32.527113 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e8262-6bdd-4911-8f15-8090d71b2ed3 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:32.527417 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e8262-6bdd-4911-8f15-8090d71b2ed3 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:32.527723 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e8262-6bdd-4911-8f15-8090d71b2ed3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:32.528019 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e8262-6bdd-4911-8f15-8090d71b2ed3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:32.528317 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e8262-6bdd-4911-8f15-8090d71b2ed3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:32.528612 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e8262-6bdd-4911-8f15-8090d71b2ed3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88154) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:29:32.576234 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] For port de8b681d-853a-4fbe-a5a7-9a1ebf75791a, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:29:32.579517 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] For port de8b681d-853a-4fbe-a5a7-9a1ebf75791a, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=de8b681d-853a-4fbe-a5a7-9a1ebf75791a,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:29:32.583311 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:32.651473 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:32.659788 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Routers {'5e022072-e09a-48f5-a3c9-be500ce472bb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:32.660382 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:29:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5e022072-e09a-48f5-a3c9-be500ce472bb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:32.667164 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Transition to ACTIVE for port object 1273325e-078d-4d3b-a939-25ae1bdcef89 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:29:32.692735 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:32.730470 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c98e8262-6bdd-4911-8f15-8090d71b2ed3 None None] Pushing event updated for resources: {'Port': ['ID=de8b681d-853a-4fbe-a5a7-9a1ebf75791a,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:32.764196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Network 6b3165c5-d574-4d2f-be7c-45593aa36427 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:29:32.766899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:29:32.770725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:29:32.807034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Pushing event updated for resources: {'Port': ['ID=1273325e-078d-4d3b-a939-25ae1bdcef89,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:32.830474 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:32.854609 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] Set router 5e022072-e09a-48f5-a3c9-be500ce472bb gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:32.999404 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a81e7019-1486-48cb-a51f-d71eb65dc579 None None] Provisioning for port 1273325e-078d-4d3b-a939-25ae1bdcef89 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:29:33.006846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device feee8dab-cd0c-44e7-9e01-4c5f54819533 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:29:33.044032 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a81e7019-1486-48cb-a51f-d71eb65dc579 None None] Provisioning complete for port 1273325e-078d-4d3b-a939-25ae1bdcef89 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:33.044697 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a81e7019-1486-48cb-a51f-d71eb65dc579 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:33.104842 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:33.135038 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-a81e7019-1486-48cb-a51f-d71eb65dc579 None None] Port 1273325e-078d-4d3b-a939-25ae1bdcef89 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:29:33.142521 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:33.166175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port feee8dab-cd0c-44e7-9e01-4c5f54819533 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:33.166947 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:33.179402 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:30Z', 'revision_number': 3, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:33.183501 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc252d21-9998-4433-a222-b1226ba55cc1 None None] The sync data for ids ['5e022072-e09a-48f5-a3c9-be500ce472bb'] in n-d-841483-1 is: [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:30Z', 'revision_number': 3, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:29:33.351902 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:33.357743 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:33.478446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Pushing event updated for resources: {'Port': ['ID=1273325e-078d-4d3b-a939-25ae1bdcef89,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:33.481057 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:33.621644 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Network 6b3165c5-d574-4d2f-be7c-45593aa36427 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:29:33.622782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:29:33.822053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Router 5e022072-e09a-48f5-a3c9-be500ce472bb has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:29:33.863523 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-59ae8364-0842-4946-9de4-092dd101c919 None None] Provisioning complete for port 1273325e-078d-4d3b-a939-25ae1bdcef89 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:33.863810 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-59ae8364-0842-4946-9de4-092dd101c919 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:33.920882 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-59ae8364-0842-4946-9de4-092dd101c919 None None] Port 1273325e-078d-4d3b-a939-25ae1bdcef89 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:29:34.120144 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:29:34.128801 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-e76ba84c-54de-433a-b067-f28e473293cc admin admin] 10.222.0.82 "PUT /v2.0/routers/5e022072-e09a-48f5-a3c9-be500ce472bb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6444314 May 12 16:29:34.637760 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57442) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:34.642020 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Sync routers for ids ['5e022072-e09a-48f5-a3c9-be500ce472bb'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:29:34.645089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Request body: {'network': {'name': 'tempest-TestSnapshotPattern-1256536562-network', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:34.651089 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:34.652078 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Routers {'5e022072-e09a-48f5-a3c9-be500ce472bb'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:34.652691 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:29:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5e022072-e09a-48f5-a3c9-be500ce472bb'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:34.655023 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Usage tracker for resource:network and tenant:1964d6d2e49246c5a8ab5ba8bd039d1c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:34.661274 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:34.667800 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:34.678252 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Made reservation on behalf of 1964d6d2e49246c5a8ab5ba8bd039d1c for: {'network': 1} {{(pid=88152) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:29:34.680637 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for network, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:34.693010 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:34.707721 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:34.712308 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Usage tracker for resource:security_group_rule and tenant:1964d6d2e49246c5a8ab5ba8bd039d1c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:34.715219 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:34.721198 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:34.809151 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:34.813379 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:34.840648 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Set router 5e022072-e09a-48f5-a3c9-be500ce472bb gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:34.842083 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 588} {{(pid=88152) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 12 16:29:34.854798 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c41ef342-855d-457e-9c0a-f1991a5af7f6,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:34.859170 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:34.859513 n-d-841483-1 neutron-server[88152]: INFO neutron.db.segments_db [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Added segment 24125eff-534c-4c84-8123-1a53549449dd of type vlan for network c2cf2b76-ee93-4846-9103-01cfe75f0997 May 12 16:29:34.888611 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8768026436563'] for network, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:34.919480 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107'] for network, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:34.920392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:34.920949 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Notify callbacks [] for network, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:35.032012 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.3931613 May 12 16:29:35.033136 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9bcfa83-fb41-41dc-aa83-a3dcda8a6b89 admin admin] Pushing event updated for resources: {'Network': ['ID=c2cf2b76-ee93-4846-9103-01cfe75f0997,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:35.034997 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57446) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:35.043447 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Request body: {'subnet': {'network_id': 'c2cf2b76-ee93-4846-9103-01cfe75f0997', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestSnapshotPattern-1256536562-subnet', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'ip_version': 4}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:35.049247 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:35.053306 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device de8b681d-853a-4fbe-a5a7-9a1ebf75791a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:29:35.054899 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Usage tracker for resource:subnet and tenant:1964d6d2e49246c5a8ab5ba8bd039d1c is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:35.057952 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:35.063697 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:35.075875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Made reservation on behalf of 1964d6d2e49246c5a8ab5ba8bd039d1c for: {'subnet': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:29:35.078702 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1887840'] for subnet, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:35.081377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Network c2cf2b76-ee93-4846-9103-01cfe75f0997 details requested by agent ovs-agent-n-d-841483-1 with host n-d-841483-1 {{(pid=88153) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 12 16:29:35.297466 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port de8b681d-853a-4fbe-a5a7-9a1ebf75791a completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:29:35.306354 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28283998', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1887862'] for subnet, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:35.310659 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port de8b681d-853a-4fbe-a5a7-9a1ebf75791a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:35.311032 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:35.394498 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b2e024ba-3685-4f03-a079-a785b6179ea5,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:35.396129 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 2, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:35.402501 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Checking segment: {'id': '24125eff-534c-4c84-8123-1a53549449dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': 'c2cf2b76-ee93-4846-9103-01cfe75f0997'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:29:35.402854 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Network hostable DHCP agents. Network: c2cf2b76-ee93-4846-9103-01cfe75f0997, hostable agents: ['62f64aba-1951-452f-9938-cd517262c713'], hosted agents: [] {{(pid=88151) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 12 16:29:35.421035 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Network c2cf2b76-ee93-4846-9103-01cfe75f0997 is scheduled to be hosted by DHCP agent 62f64aba-1951-452f-9938-cd517262c713 with binding_index 1 {{(pid=88151) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 12 16:29:35.430434 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Checking router: 5e022072-e09a-48f5-a3c9-be500ce472bb for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:29:35.430781 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Updating router 5e022072-e09a-48f5-a3c9-be500ce472bb port 1273325e-078d-4d3b-a939-25ae1bdcef89 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:29:35.431982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-841483-1, c2cf2b76-ee93-4846-9103-01cfe75f0997) {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:29:35.435943 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:35.436594 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:35.458499 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-736e850d-2c00-47b2-b849-3c511ff187c1 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.4222875 May 12 16:29:35.461214 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57450) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:35.466382 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Request body: {'router': {'name': 'tempest-TestSnapshotPattern-1256536562-router', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:35.468367 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-76fcdb4a-6b65-4aff-ba63-65f578cebfd1 None None] Network c2cf2b76-ee93-4846-9103-01cfe75f0997 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:29:35.471718 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:35.475968 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Usage tracker for resource:router and tenant:1964d6d2e49246c5a8ab5ba8bd039d1c is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:35.479081 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:35.485279 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:35.497104 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3784339', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-27525'] for router, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:35.498179 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3783606', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3769131', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-397611', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27644'] for router, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:35.515447 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:35.616576 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:35.629143 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:35.713251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port de8b681d-853a-4fbe-a5a7-9a1ebf75791a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=de8b681d-853a-4fbe-a5a7-9a1ebf75791a,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:35.722563 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:35.914820 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3769149', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3784321', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27630'] for router, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:35.924069 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=de8b681d-853a-4fbe-a5a7-9a1ebf75791a,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:35.990145 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc50c60cb-3d87-5465-8e78-6ba9f4a241cd-c2cf2b76-ee93-4846-9103-01cfe75f0997', 'network_id': 'c2cf2b76-ee93-4846-9103-01cfe75f0997', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'fixed_ips': [{'subnet_id': 'b2e024ba-3685-4f03-a079-a785b6179ea5'}]}} from n-d-841483-1. {{(pid=88153) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:279}} May 12 16:29:35.991587 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:36.229267 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:36.261153 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:36.310202 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.db_base_plugin_common [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Allocated IP 172.20.0.2 (c2cf2b76-ee93-4846-9103-01cfe75f0997/b2e024ba-3685-4f03-a079-a785b6179ea5/7c5235c1-d3dc-4355-820b-580975c0a590) {{(pid=88153) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:29:36.353769 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:36.401990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Allocated IP 172.25.8.237 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/0118baeb-6e90-4fdc-98b7-afd4a0deba2f) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:29:36.434252 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Transition to ACTIVE for port object 1273325e-078d-4d3b-a939-25ae1bdcef89 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:29:36.446250 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:36.558469 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:36.594934 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:36.661508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:29:36.664932 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:29:36.668757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:29:36.677685 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f7d006c-faaa-465f-a4b5-594f4026f5b1 None None] Pushing event updated for resources: {'Port': ['ID=1273325e-078d-4d3b-a939-25ae1bdcef89,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:36.708455 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Pushing event updated for resources: {'Port': ['ID=0118baeb-6e90-4fdc-98b7-afd4a0deba2f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:36.766260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Attempting to bind port 1273325e-078d-4d3b-a939-25ae1bdcef89 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:29:36.766260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Attempting to bind port 1273325e-078d-4d3b-a939-25ae1bdcef89 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:29:36.766260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Attempting to bind port 1273325e-078d-4d3b-a939-25ae1bdcef89 on network 6b3165c5-d574-4d2f-be7c-45593aa36427 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:29:36.781215 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 29, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:29:36.781518 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Checking segment: {'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:29:36.781915 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:36.782303 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Bound using segment: {'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:29:36.782757 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Bound port: 1273325e-078d-4d3b-a939-25ae1bdcef89, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:29:36.783127 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:36.810676 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Notify callbacks [] for port, precommit_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:36.850116 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Transition to ACTIVE for port object 7c5235c1-d3dc-4355-820b-580975c0a590 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:29:36.888290 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Transition to ACTIVE for port object 7c5235c1-d3dc-4355-820b-580975c0a590 will not be triggered until provisioned by entity DHCP. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:29:36.903911 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014'] for port, after_create {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:36.964980 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] For port 1273325e-078d-4d3b-a939-25ae1bdcef89, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:29:36.983903 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] For port 1273325e-078d-4d3b-a939-25ae1bdcef89, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1273325e-078d-4d3b-a939-25ae1bdcef89,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:29:36.986005 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Network c2cf2b76-ee93-4846-9103-01cfe75f0997 is already hosted by enough agents. {{(pid=88153) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:29:36.988724 n-d-841483-1 neutron-server[88153]: DEBUG neutron.scheduler.base_scheduler [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Resources bound (agent type, host, resource id): {{(pid=88153) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:29:36.993950 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Received port after_create {{(pid=88153) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:29:36.996778 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:37.004549 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device de8b681d-853a-4fbe-a5a7-9a1ebf75791a up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:29:37.038712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Pushing event updated for resources: {'Port': ['ID=7c5235c1-d3dc-4355-820b-580975c0a590,revision_number=1']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:37.103773 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:37.275625 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Attempting to bind port 7c5235c1-d3dc-4355-820b-580975c0a590 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:29:37.275988 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Attempting to bind port 7c5235c1-d3dc-4355-820b-580975c0a590 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '24125eff-534c-4c84-8123-1a53549449dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': 'c2cf2b76-ee93-4846-9103-01cfe75f0997'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:29:37.276343 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Attempting to bind port 7c5235c1-d3dc-4355-820b-580975c0a590 on network c2cf2b76-ee93-4846-9103-01cfe75f0997 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:29:37.280791 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Routers {'5e022072-e09a-48f5-a3c9-be500ce472bb'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:37.281486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:29:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5e022072-e09a-48f5-a3c9-be500ce472bb'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:37.340966 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f7d006c-faaa-465f-a4b5-594f4026f5b1 None None] Pushing event updated for resources: {'Port': ['ID=1273325e-078d-4d3b-a939-25ae1bdcef89,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:37.355609 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 29, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:29:37.355979 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Checking segment: {'id': '24125eff-534c-4c84-8123-1a53549449dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': 'c2cf2b76-ee93-4846-9103-01cfe75f0997'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:29:37.356379 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:37.356766 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Bound using segment: {'id': '24125eff-534c-4c84-8123-1a53549449dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': 'c2cf2b76-ee93-4846-9103-01cfe75f0997'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:29:37.357238 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Bound port: 7c5235c1-d3dc-4355-820b-580975c0a590, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '24125eff-534c-4c84-8123-1a53549449dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': 'c2cf2b76-ee93-4846-9103-01cfe75f0997'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:29:37.357631 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:37.497450 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port de8b681d-853a-4fbe-a5a7-9a1ebf75791a triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:37.497825 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:37.617711 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3784344', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3769094'] for router, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:37.625262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] For port 7c5235c1-d3dc-4355-820b-580975c0a590, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:29:37.630763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] For port 7c5235c1-d3dc-4355-820b-580975c0a590, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7c5235c1-d3dc-4355-820b-580975c0a590,segment=NetworkSegment(24125eff-534c-4c84-8123-1a53549449dd),segment_id=24125eff-534c-4c84-8123-1a53549449dd)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:29:37.633056 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] Set router 5e022072-e09a-48f5-a3c9-be500ce472bb gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:37.684725 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:37.832880 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Router 259b3e41-831c-46f0-9ea9-3c83a3a53712 is scheduled to L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c with binding_index 1 {{(pid=88152) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 12 16:29:37.914033 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0248af4c-489c-4b70-b448-61b8268787dc None None] Pushing event updated for resources: {'Port': ['ID=7c5235c1-d3dc-4355-820b-580975c0a590,revision_number=2']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:38.056393 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:29:38.066011 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Sync routers for ids ['259b3e41-831c-46f0-9ea9-3c83a3a53712'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:29:38.085367 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Routers {'259b3e41-831c-46f0-9ea9-3c83a3a53712'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:38.086305 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:29:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['259b3e41-831c-46f0-9ea9-3c83a3a53712'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:38.100297 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] Notify callbacks [] for router, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:38.102090 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-68d72427-cc34-4b2b-a5e0-57f239b7bda3 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.6396768 May 12 16:29:38.104593 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57454) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:38.167569 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:36Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:38.172299 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c26e3f72-f564-4846-ba18-26c58811d8cc None None] The sync data for ids ['5e022072-e09a-48f5-a3c9-be500ce472bb'] in n-d-841483-1 is: [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:36Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:29:38.424796 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Set router 259b3e41-831c-46f0-9ea9-3c83a3a53712 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:38.740238 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'name': 'tempest-TestSnapshotPattern-1256536562-router', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.237'}], 'enable_snat': True}, 'gw_port_id': '0118baeb-6e90-4fdc-98b7-afd4a0deba2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:35Z', 'updated_at': '2022-05-12T16:29:36Z', 'revision_number': 3, 'project_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'gw_port': {'id': '0118baeb-6e90-4fdc-98b7-afd4a0deba2f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4441, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:36Z', 'updated_at': '2022-05-12T16:29:36Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:38.747195 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Checking router: 259b3e41-831c-46f0-9ea9-3c83a3a53712 for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:29:38.747539 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Updating router 259b3e41-831c-46f0-9ea9-3c83a3a53712 port 0118baeb-6e90-4fdc-98b7-afd4a0deba2f binding host n-d-841483-1 {{(pid=88154) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:29:38.816597 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:39.129179 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7c5235c1-d3dc-4355-820b-580975c0a590 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:29:39.161072 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:39.237495 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 7c5235c1-d3dc-4355-820b-580975c0a590 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:29:39.243819 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1273325e-078d-4d3b-a939-25ae1bdcef89 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:29:39.244798 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Notify callbacks [] for port, precommit_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:39.263238 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.provisioning_blocks [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Transition to ACTIVE for port object 0118baeb-6e90-4fdc-98b7-afd4a0deba2f will not be triggered until provisioned by entity L2. {{(pid=88154) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:29:39.270607 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:39.287511 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb0b6ec7-6366-46c5-b1d8-58e1f25fd640 None None] Network c2cf2b76-ee93-4846-9103-01cfe75f0997 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:29:39.356257 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Attempting to bind port 0118baeb-6e90-4fdc-98b7-afd4a0deba2f on host n-d-841483-1 for vnic_type normal with profile {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:29:39.356772 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Attempting to bind port 0118baeb-6e90-4fdc-98b7-afd4a0deba2f by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:29:39.357206 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Attempting to bind port 0118baeb-6e90-4fdc-98b7-afd4a0deba2f on network 5bff663f-be1e-4c0c-b2e2-d037214cb143 {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:29:39.368319 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 29, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:29:39.368848 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Checking segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88154) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:29:39.369341 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:39.370212 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Bound using segment: {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'} {{(pid=88154) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:29:39.370790 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.managers [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Bound port: 0118baeb-6e90-4fdc-98b7-afd4a0deba2f, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '621d696b-9fdc-4be4-896e-f6734c2e06e4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143'}}] {{(pid=88154) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:29:39.371265 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:39.417181 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c39bba4f-a082-49be-aa0a-e560be641a92 None None] Pushing event updated for resources: {'Port': ['ID=0118baeb-6e90-4fdc-98b7-afd4a0deba2f,revision_number=2']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:39.446753 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a3144a82-5d0b-4b10-ab29-2669e3030b2d None None] Provisioning for port 7c5235c1-d3dc-4355-820b-580975c0a590 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:29:39.455967 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] For port 0118baeb-6e90-4fdc-98b7-afd4a0deba2f, host n-d-841483-1, cleared binding levels {{(pid=88154) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:29:39.459205 n-d-841483-1 neutron-server[88154]: DEBUG neutron.plugins.ml2.db [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] For port 0118baeb-6e90-4fdc-98b7-afd4a0deba2f, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0118baeb-6e90-4fdc-98b7-afd4a0deba2f,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88154) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:29:39.463788 n-d-841483-1 neutron-server[88154]: DEBUG neutron_lib.callbacks.manager [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88154) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:39.474825 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-a3144a82-5d0b-4b10-ab29-2669e3030b2d None None] Provisioning complete for port 7c5235c1-d3dc-4355-820b-580975c0a590 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:39.475826 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a3144a82-5d0b-4b10-ab29-2669e3030b2d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:39.489090 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Allocated IP 172.20.0.1 (c2cf2b76-ee93-4846-9103-01cfe75f0997/b2e024ba-3685-4f03-a079-a785b6179ea5/64a971da-d9fd-44fc-a49f-baae6fd97131) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:29:39.518031 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 1273325e-078d-4d3b-a939-25ae1bdcef89 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:29:39.540835 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c39bba4f-a082-49be-aa0a-e560be641a92 None None] Pushing event updated for resources: {'Port': ['ID=0118baeb-6e90-4fdc-98b7-afd4a0deba2f,revision_number=3']} {{(pid=88154) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:39.549110 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 1273325e-078d-4d3b-a939-25ae1bdcef89 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:39.549531 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:39.563626 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Routers {'259b3e41-831c-46f0-9ea9-3c83a3a53712'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:39.564230 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:29:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['259b3e41-831c-46f0-9ea9-3c83a3a53712'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:39.679025 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:39.696361 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.provisioning_blocks [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Transition to ACTIVE for port object 64a971da-d9fd-44fc-a49f-baae6fd97131 will not be triggered until provisioned by entity DHCP. {{(pid=88152) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:29:39.726595 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:39.754201 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] Set router 259b3e41-831c-46f0-9ea9-3c83a3a53712 gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:39.790497 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Network c2cf2b76-ee93-4846-9103-01cfe75f0997 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:29:39.798101 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:29:39.802205 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:29:39.821220 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a3144a82-5d0b-4b10-ab29-2669e3030b2d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:39.853157 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Pushing event updated for resources: {'Port': ['ID=64a971da-d9fd-44fc-a49f-baae6fd97131,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:39.867621 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3770576'] for router_interface, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:39.930402 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:39.961639 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-a3144a82-5d0b-4b10-ab29-2669e3030b2d None None] For port 7c5235c1-d3dc-4355-820b-580975c0a590, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7c5235c1-d3dc-4355-820b-580975c0a590,segment=NetworkSegment(24125eff-534c-4c84-8123-1a53549449dd),segment_id=24125eff-534c-4c84-8123-1a53549449dd)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:39.970958 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a3144a82-5d0b-4b10-ab29-2669e3030b2d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:40.031714 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 1273325e-078d-4d3b-a939-25ae1bdcef89, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1273325e-078d-4d3b-a939-25ae1bdcef89,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:40.042556 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:40.064962 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3144a82-5d0b-4b10-ab29-2669e3030b2d None None] Pushing event updated for resources: {'Port': ['ID=7c5235c1-d3dc-4355-820b-580975c0a590,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:40.111646 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'name': 'tempest-TestSnapshotPattern-1256536562-router', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.237'}], 'enable_snat': True}, 'gw_port_id': '0118baeb-6e90-4fdc-98b7-afd4a0deba2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:35Z', 'updated_at': '2022-05-12T16:29:36Z', 'revision_number': 3, 'project_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'gw_port': {'id': '0118baeb-6e90-4fdc-98b7-afd4a0deba2f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4441, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:36Z', 'updated_at': '2022-05-12T16:29:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:40.116190 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17007e91-13b7-418b-af37-fefb2facc9b5 None None] The sync data for ids ['259b3e41-831c-46f0-9ea9-3c83a3a53712'] in n-d-841483-1 is: [{'id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'name': 'tempest-TestSnapshotPattern-1256536562-router', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.237'}], 'enable_snat': True}, 'gw_port_id': '0118baeb-6e90-4fdc-98b7-afd4a0deba2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:35Z', 'updated_at': '2022-05-12T16:29:36Z', 'revision_number': 3, 'project_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'gw_port': {'id': '0118baeb-6e90-4fdc-98b7-afd4a0deba2f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4441, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:36Z', 'updated_at': '2022-05-12T16:29:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:29:40.155876 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=1273325e-078d-4d3b-a939-25ae1bdcef89,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:40.172108 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:40.303908 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-310b4f77-aa17-4011-9d5c-0ee9df5983cb None None] Provisioning complete for port 7c5235c1-d3dc-4355-820b-580975c0a590 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:40.304713 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-310b4f77-aa17-4011-9d5c-0ee9df5983cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:40.456463 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:40.463266 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:40.585556 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Pushing event updated for resources: {'Port': ['ID=64a971da-d9fd-44fc-a49f-baae6fd97131,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:40.588422 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3874057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3770485'] for router_interface, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:40.618157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c5d318d5-4004-4b06-9966-9d14dfeb81ec None None] Provisioning for port 64a971da-d9fd-44fc-a49f-baae6fd97131 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:29:40.623229 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-c5d318d5-4004-4b06-9966-9d14dfeb81ec None None] Provisioning complete for port 64a971da-d9fd-44fc-a49f-baae6fd97131 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:40.623598 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c5d318d5-4004-4b06-9966-9d14dfeb81ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:40.690042 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-c5d318d5-4004-4b06-9966-9d14dfeb81ec None None] Port 64a971da-d9fd-44fc-a49f-baae6fd97131 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:29:40.734750 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Network c2cf2b76-ee93-4846-9103-01cfe75f0997 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:29:40.735847 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:29:40.964345 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:29:41.025175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-e5b167d2-404b-44f0-89f9-8620395ff0ff None None] Provisioning complete for port 64a971da-d9fd-44fc-a49f-baae6fd97131 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:41.025767 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e5b167d2-404b-44f0-89f9-8620395ff0ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:41.059949 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Router 259b3e41-831c-46f0-9ea9-3c83a3a53712 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:29:41.087257 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-e5b167d2-404b-44f0-89f9-8620395ff0ff None None] Port 64a971da-d9fd-44fc-a49f-baae6fd97131 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:29:41.106478 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7c5235c1-d3dc-4355-820b-580975c0a590 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:29:41.177613 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 7c5235c1-d3dc-4355-820b-580975c0a590 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:41.178868 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:41.249310 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:29:41.263114 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-9a7dcd7f-a67b-4871-b2f7-2746cf2d45aa admin admin] 10.222.0.82 "PUT /v2.0/routers/259b3e41-831c-46f0-9ea9-3c83a3a53712/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1526928 May 12 16:29:41.307260 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0118baeb-6e90-4fdc-98b7-afd4a0deba2f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:29:41.375490 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 0118baeb-6e90-4fdc-98b7-afd4a0deba2f completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:29:41.380417 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0118baeb-6e90-4fdc-98b7-afd4a0deba2f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:41.380790 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:41.516260 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:41.533092 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 0118baeb-6e90-4fdc-98b7-afd4a0deba2f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0118baeb-6e90-4fdc-98b7-afd4a0deba2f,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:41.539440 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:41.540234 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1273325e-078d-4d3b-a939-25ae1bdcef89 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:29:41.660297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=0118baeb-6e90-4fdc-98b7-afd4a0deba2f,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:41.672651 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 1273325e-078d-4d3b-a939-25ae1bdcef89 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:41.673020 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:41.750135 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57464) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:41.760797 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1199673062', 'description': 'tempest-secgroup-smoke-1199673062 description', 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:41.767742 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:41.771796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Usage tracker for resource:security_group and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:41.774971 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:41.780819 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:41.790884 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Sync routers for ids ['259b3e41-831c-46f0-9ea9-3c83a3a53712'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:29:41.795402 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:41.805856 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Routers {'259b3e41-831c-46f0-9ea9-3c83a3a53712'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:41.806520 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:29:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['259b3e41-831c-46f0-9ea9-3c83a3a53712'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:41.815996 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:41.819988 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Usage tracker for resource:security_group_rule and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:41.822926 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:41.828780 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:41.900245 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:41.904006 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:41.950766 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:41.953440 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:41.954651 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-846dd695-866e-47d6-b816-c0308e2427a3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.2015131 May 12 16:29:41.957533 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57468) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:41.962725 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-4ed37adb-eea7-4647-840a-f8a06083232d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Request body: {'security_group_rule': {'security_group_id': 'f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63', 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:41.969125 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4ed37adb-eea7-4647-840a-f8a06083232d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:41.972972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4ed37adb-eea7-4647-840a-f8a06083232d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Usage tracker for resource:security_group_rule and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:41.976347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-4ed37adb-eea7-4647-840a-f8a06083232d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:41.981993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-4ed37adb-eea7-4647-840a-f8a06083232d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:41.994501 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Set router 259b3e41-831c-46f0-9ea9-3c83a3a53712 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:41.998550 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ed37adb-eea7-4647-840a-f8a06083232d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.062081 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ed37adb-eea7-4647-840a-f8a06083232d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.066543 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ed37adb-eea7-4647-840a-f8a06083232d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.090410 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed37adb-eea7-4647-840a-f8a06083232d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e8924afe-9be0-4526-82c1-ce97fee0674c,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:42.101012 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-4ed37adb-eea7-4647-840a-f8a06083232d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.101668 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-4ed37adb-eea7-4647-840a-f8a06083232d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1431932 May 12 16:29:42.104381 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57472) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:42.109336 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-63ca8cac-e158-45b1-bf26-9941d048be86 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Request body: {'security_group_rule': {'security_group_id': 'f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63', 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:42.116634 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-63ca8cac-e158-45b1-bf26-9941d048be86 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:42.121027 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-63ca8cac-e158-45b1-bf26-9941d048be86 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Usage tracker for resource:security_group_rule and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:42.123891 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-63ca8cac-e158-45b1-bf26-9941d048be86 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:42.129569 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-63ca8cac-e158-45b1-bf26-9941d048be86 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:42.149685 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63ca8cac-e158-45b1-bf26-9941d048be86 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.215685 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63ca8cac-e158-45b1-bf26-9941d048be86 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.220773 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63ca8cac-e158-45b1-bf26-9941d048be86 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.249079 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63ca8cac-e158-45b1-bf26-9941d048be86 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d2917c74-7071-49a9-918a-84b0d8823381,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:42.262817 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-63ca8cac-e158-45b1-bf26-9941d048be86 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.267128 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-63ca8cac-e158-45b1-bf26-9941d048be86 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1590426 May 12 16:29:42.267548 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57476) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:42.273521 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-d7f56f88-20d6-4fc8-94f2-b59b81edb044 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Request body: {'security_group_rule': {'security_group_id': 'f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63', 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:42.282182 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d7f56f88-20d6-4fc8-94f2-b59b81edb044 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:42.286439 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d7f56f88-20d6-4fc8-94f2-b59b81edb044 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Usage tracker for resource:security_group_rule and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:42.289920 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-d7f56f88-20d6-4fc8-94f2-b59b81edb044 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:42.295739 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-d7f56f88-20d6-4fc8-94f2-b59b81edb044 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:42.316229 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7f56f88-20d6-4fc8-94f2-b59b81edb044 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.318330 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'name': 'tempest-TestSnapshotPattern-1256536562-router', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.237'}], 'enable_snat': True}, 'gw_port_id': '0118baeb-6e90-4fdc-98b7-afd4a0deba2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:35Z', 'updated_at': '2022-05-12T16:29:40Z', 'revision_number': 4, 'project_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'gw_port': {'id': '0118baeb-6e90-4fdc-98b7-afd4a0deba2f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4441, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:36Z', 'updated_at': '2022-05-12T16:29:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '64a971da-d9fd-44fc-a49f-baae6fd97131', 'name': '', 'network_id': 'c2cf2b76-ee93-4846-9103-01cfe75f0997', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'mac_address': 'fa:16:3e:35:ae:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'device_owner': 'network:router_interface', 'standard_attr_id': 4442, 'fixed_ips': [{'subnet_id': 'b2e024ba-3685-4f03-a079-a785b6179ea5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:39Z', 'updated_at': '2022-05-12T16:29:40Z', 'revision_number': 2, 'project_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'subnets': [{'id': 'b2e024ba-3685-4f03-a079-a785b6179ea5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:42.323881 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Checking router: 259b3e41-831c-46f0-9ea9-3c83a3a53712 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:29:42.324224 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Updating router 259b3e41-831c-46f0-9ea9-3c83a3a53712 port 64a971da-d9fd-44fc-a49f-baae6fd97131 binding host n-d-841483-1 {{(pid=88153) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 12 16:29:42.383542 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7f56f88-20d6-4fc8-94f2-b59b81edb044 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.388570 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7f56f88-20d6-4fc8-94f2-b59b81edb044 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.411771 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f56f88-20d6-4fc8-94f2-b59b81edb044 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6f1845fd-8616-43f2-94f7-9510c158f66a,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:42.420769 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-d7f56f88-20d6-4fc8-94f2-b59b81edb044 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.421508 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.421981 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-d7f56f88-20d6-4fc8-94f2-b59b81edb044 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1532190 May 12 16:29:42.424726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57480) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:42.430347 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-97d76e9f-c00c-42c3-81e6-2234df85d55f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Request body: {'security_group_rule': {'security_group_id': 'f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63', 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:42.436873 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-97d76e9f-c00c-42c3-81e6-2234df85d55f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:42.440631 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-97d76e9f-c00c-42c3-81e6-2234df85d55f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Usage tracker for resource:security_group_rule and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:42.443516 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-97d76e9f-c00c-42c3-81e6-2234df85d55f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:42.449933 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-97d76e9f-c00c-42c3-81e6-2234df85d55f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:42.467481 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-97d76e9f-c00c-42c3-81e6-2234df85d55f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.530132 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-97d76e9f-c00c-42c3-81e6-2234df85d55f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.533923 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-97d76e9f-c00c-42c3-81e6-2234df85d55f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.563454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97d76e9f-c00c-42c3-81e6-2234df85d55f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dcb0c4af-97b9-49f2-9516-2d072c722c42,revision_number=0']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:42.570935 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-97d76e9f-c00c-42c3-81e6-2234df85d55f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.572197 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-97d76e9f-c00c-42c3-81e6-2234df85d55f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1465576 May 12 16:29:42.575156 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57484) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:42.580750 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-d09adc9f-57e9-49c3-bfc3-125c532fd3d4 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Request body: {'security_group_rule': {'security_group_id': 'f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63', 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:42.588270 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d09adc9f-57e9-49c3-bfc3-125c532fd3d4 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:42.592213 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d09adc9f-57e9-49c3-bfc3-125c532fd3d4 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Usage tracker for resource:security_group_rule and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:42.595183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-d09adc9f-57e9-49c3-bfc3-125c532fd3d4 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:42.602652 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-d09adc9f-57e9-49c3-bfc3-125c532fd3d4 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:42.612823 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-d09adc9f-57e9-49c3-bfc3-125c532fd3d4 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Project db6d55e7484248b38b40fa3b29a09ab9 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:29:42.620497 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d09adc9f-57e9-49c3-bfc3-125c532fd3d4 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.687017 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d09adc9f-57e9-49c3-bfc3-125c532fd3d4 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.691071 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d09adc9f-57e9-49c3-bfc3-125c532fd3d4 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.714265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d09adc9f-57e9-49c3-bfc3-125c532fd3d4 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=05a929fb-222b-4ad2-bc8f-effd9d9d041b,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:42.723695 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d09adc9f-57e9-49c3-bfc3-125c532fd3d4 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.724866 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d09adc9f-57e9-49c3-bfc3-125c532fd3d4 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1486003 May 12 16:29:42.728746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 57488) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:42.733655 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [None req-da8662c1-5be5-42de-b221-66e9fee50502 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Request body: {'security_group_rule': {'security_group_id': 'f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63', 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:42.740238 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-da8662c1-5be5-42de-b221-66e9fee50502 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:42.744600 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-da8662c1-5be5-42de-b221-66e9fee50502 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Usage tracker for resource:security_group_rule and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:42.747570 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [None req-da8662c1-5be5-42de-b221-66e9fee50502 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:42.753324 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [None req-da8662c1-5be5-42de-b221-66e9fee50502 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:42.763404 n-d-841483-1 neutron-server[88151]: INFO neutron.db.securitygroups_db [None req-da8662c1-5be5-42de-b221-66e9fee50502 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Project db6d55e7484248b38b40fa3b29a09ab9 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 12 16:29:42.769888 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-da8662c1-5be5-42de-b221-66e9fee50502 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.774293 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Notify callbacks [] for port, precommit_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.786346 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Transition to ACTIVE for port object 64a971da-d9fd-44fc-a49f-baae6fd97131 will not be triggered until provisioned by entity L2. {{(pid=88153) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:29:42.794403 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.836680 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-da8662c1-5be5-42de-b221-66e9fee50502 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.840742 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-da8662c1-5be5-42de-b221-66e9fee50502 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758537'] for security_group_rule, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.865264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da8662c1-5be5-42de-b221-66e9fee50502 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4bd4c57a-290a-4613-aa43-6fb0217d5618,revision_number=0']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:42.877913 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-da8662c1-5be5-42de-b221-66e9fee50502 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group_rule, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:42.881858 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-da8662c1-5be5-42de-b221-66e9fee50502 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1521120 May 12 16:29:42.936559 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6218cb77-cd82-4b72-b606-72db6976442c None None] Pushing event updated for resources: {'Port': ['ID=64a971da-d9fd-44fc-a49f-baae6fd97131,revision_number=3']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:43.013737 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-191a7f4d-5ec9-4f86-a14d-5e1dc506833e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:43.032743 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0118baeb-6e90-4fdc-98b7-afd4a0deba2f up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:29:43.087453 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Attempting to bind port 64a971da-d9fd-44fc-a49f-baae6fd97131 on host n-d-841483-1 for vnic_type normal with profile {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:29:43.087747 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Attempting to bind port 64a971da-d9fd-44fc-a49f-baae6fd97131 by drivers openvswitch,hyperv on host n-d-841483-1 at level 0 using segments [{'id': '24125eff-534c-4c84-8123-1a53549449dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': 'c2cf2b76-ee93-4846-9103-01cfe75f0997'}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:29:43.088099 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Attempting to bind port 64a971da-d9fd-44fc-a49f-baae6fd97131 on network c2cf2b76-ee93-4846-9103-01cfe75f0997 {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:29:43.090531 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-090ad9ac-3184-496a-a661-b537395f31fd tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Synchronizing usage tracker for tenant:db6d55e7484248b38b40fa3b29a09ab9 on resource:security_group {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:29:43.098632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Checking agent: {'id': '76ee82ad-99ea-473b-b62e-f09968490838', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 14, 53, 16), 'started_at': datetime.datetime(2022, 5, 12, 14, 53, 46), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 29, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-841483-1'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:29:43.098992 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Checking segment: {'id': '24125eff-534c-4c84-8123-1a53549449dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': 'c2cf2b76-ee93-4846-9103-01cfe75f0997'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88153) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:29:43.099385 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:43.099763 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Bound using segment: {'id': '24125eff-534c-4c84-8123-1a53549449dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': 'c2cf2b76-ee93-4846-9103-01cfe75f0997'} {{(pid=88153) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:29:43.100826 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.managers [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Bound port: 64a971da-d9fd-44fc-a49f-baae6fd97131, host: n-d-841483-1, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '24125eff-534c-4c84-8123-1a53549449dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 588, 'network_id': 'c2cf2b76-ee93-4846-9103-01cfe75f0997'}}] {{(pid=88153) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:29:43.101262 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:43.108306 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-090ad9ac-3184-496a-a661-b537395f31fd tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Unset dirty status for tenant:db6d55e7484248b38b40fa3b29a09ab9 on resource:security_group {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:29:43.109536 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-090ad9ac-3184-496a-a661-b537395f31fd tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1199673062&fields=id&tenant_id=db6d55e7484248b38b40fa3b29a09ab9 HTTP/1.1" status: 200 len: 267 time: 0.0684004 May 12 16:29:43.210166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 0118baeb-6e90-4fdc-98b7-afd4a0deba2f triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:43.210557 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:43.263296 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] For port 64a971da-d9fd-44fc-a49f-baae6fd97131, host n-d-841483-1, cleared binding levels {{(pid=88153) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:29:43.265300 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-6fdbf13a-53e0-4c34-8b7e-b4c02bf6d895 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:43.266009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-6fdbf13a-53e0-4c34-8b7e-b4c02bf6d895 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Synchronizing usage tracker for tenant:db6d55e7484248b38b40fa3b29a09ab9 on resource:network {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:29:43.276699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] For port 64a971da-d9fd-44fc-a49f-baae6fd97131, host n-d-841483-1, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=64a971da-d9fd-44fc-a49f-baae6fd97131,segment=NetworkSegment(24125eff-534c-4c84-8123-1a53549449dd),segment_id=24125eff-534c-4c84-8123-1a53549449dd)] {{(pid=88153) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:29:43.284773 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-6fdbf13a-53e0-4c34-8b7e-b4c02bf6d895 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Unset dirty status for tenant:db6d55e7484248b38b40fa3b29a09ab9 on resource:network {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:29:43.284962 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:43.285955 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-6fdbf13a-53e0-4c34-8b7e-b4c02bf6d895 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 810 time: 0.1694820 May 12 16:29:43.302159 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-5dc316cf-2e23-4114-bfe1-3259eeacd8fb tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/quotas/db6d55e7484248b38b40fa3b29a09ab9 HTTP/1.1" status: 200 len: 375 time: 0.0098710 May 12 16:29:43.401068 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-076d609c-657b-4af2-a327-8c6fc9ef6840 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0936430 May 12 16:29:43.402340 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Routers {'259b3e41-831c-46f0-9ea9-3c83a3a53712'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:43.402981 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:29:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['259b3e41-831c-46f0-9ea9-3c83a3a53712'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:43.413671 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-0f7eed1c-07a6-4412-b0c4-ae24ecfe9296 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 16:29:43.414940 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-0f7eed1c-07a6-4412-b0c4-ae24ecfe9296 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0060689 May 12 16:29:43.502123 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6218cb77-cd82-4b72-b606-72db6976442c None None] Pushing event updated for resources: {'Port': ['ID=64a971da-d9fd-44fc-a49f-baae6fd97131,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:43.560616 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-f6e3d1a6-fa27-4342-a18e-ce25c4d1102a service neutron] 10.222.0.82 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1397784 May 12 16:29:43.622383 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] Set router 259b3e41-831c-46f0-9ea9-3c83a3a53712 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:43.696522 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-6000968a-7b3a-4d49-ac5e-6bcfbd37365b service neutron] 10.222.0.82 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1300499 May 12 16:29:43.887594 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-752a233b-6fd1-4e58-aaa9-cef1c6d00fa9 req-161839f8-3c8b-48a3-b49d-f0e01ccbafb6 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 210 time: 0.0527771 May 12 16:29:43.979328 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:44.002123 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'name': 'tempest-TestSnapshotPattern-1256536562-router', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.237'}], 'enable_snat': True}, 'gw_port_id': '0118baeb-6e90-4fdc-98b7-afd4a0deba2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:35Z', 'updated_at': '2022-05-12T16:29:40Z', 'revision_number': 4, 'project_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'gw_port': {'id': '0118baeb-6e90-4fdc-98b7-afd4a0deba2f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4441, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:36Z', 'updated_at': '2022-05-12T16:29:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '64a971da-d9fd-44fc-a49f-baae6fd97131', 'name': '', 'network_id': 'c2cf2b76-ee93-4846-9103-01cfe75f0997', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'mac_address': 'fa:16:3e:35:ae:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'device_owner': 'network:router_interface', 'standard_attr_id': 4442, 'fixed_ips': [{'subnet_id': 'b2e024ba-3685-4f03-a079-a785b6179ea5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:39Z', 'updated_at': '2022-05-12T16:29:43Z', 'revision_number': 4, 'project_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'subnets': [{'id': 'b2e024ba-3685-4f03-a079-a785b6179ea5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:44.006232 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-298b4fd5-bc9c-4d2c-98d9-c750ee5060df None None] The sync data for ids ['259b3e41-831c-46f0-9ea9-3c83a3a53712'] in n-d-841483-1 is: [{'id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'name': 'tempest-TestSnapshotPattern-1256536562-router', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.237'}], 'enable_snat': True}, 'gw_port_id': '0118baeb-6e90-4fdc-98b7-afd4a0deba2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:35Z', 'updated_at': '2022-05-12T16:29:40Z', 'revision_number': 4, 'project_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'gw_port': {'id': '0118baeb-6e90-4fdc-98b7-afd4a0deba2f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4441, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:36Z', 'updated_at': '2022-05-12T16:29:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '64a971da-d9fd-44fc-a49f-baae6fd97131', 'name': '', 'network_id': 'c2cf2b76-ee93-4846-9103-01cfe75f0997', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'mac_address': 'fa:16:3e:35:ae:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'device_owner': 'network:router_interface', 'standard_attr_id': 4442, 'fixed_ips': [{'subnet_id': 'b2e024ba-3685-4f03-a079-a785b6179ea5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:39Z', 'updated_at': '2022-05-12T16:29:43Z', 'revision_number': 4, 'project_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'subnets': [{'id': 'b2e024ba-3685-4f03-a079-a785b6179ea5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:29:45.031592 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 64a971da-d9fd-44fc-a49f-baae6fd97131 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:29:45.052560 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a3b33165-5a3e-4c64-a443-64171be6a739 req-14035950-0bfa-4fcd-b999-b8669ccd0543 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 210 time: 0.0511737 May 12 16:29:45.107323 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning for port 64a971da-d9fd-44fc-a49f-baae6fd97131 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:29:45.112307 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 64a971da-d9fd-44fc-a49f-baae6fd97131 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:45.112675 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:45.238813 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:45.273186 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] For port 64a971da-d9fd-44fc-a49f-baae6fd97131, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=64a971da-d9fd-44fc-a49f-baae6fd97131,segment=NetworkSegment(24125eff-534c-4c84-8123-1a53549449dd),segment_id=24125eff-534c-4c84-8123-1a53549449dd)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:45.277835 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:45.350812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Pushing event updated for resources: {'Port': ['ID=64a971da-d9fd-44fc-a49f-baae6fd97131,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:45.401004 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-52402bd6-524a-41ea-8cde-a839e7a20056 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:45.402419 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-52402bd6-524a-41ea-8cde-a839e7a20056 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.84 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 810 time: 0.1710491 May 12 16:29:45.464819 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-68fa0b83-8171-49e6-b52c-1ac487d23759 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=db6d55e7484248b38b40fa3b29a09ab9 HTTP/1.1" status: 200 len: 380 time: 0.0427237 May 12 16:29:45.467539 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-aa4cd89c-7b70-44b4-ab40-0487d920ecc1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:45.474290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Request body: {'port': {'device_id': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'admin_state_up': True, 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'security_groups': ['f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:45.616909 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:45.620746 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Usage tracker for resource:port and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:45.623564 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Quota usage for port was recalculated. Used quota:2. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:45.629183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:45.639141 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Made reservation on behalf of db6d55e7484248b38b40fa3b29a09ab9 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:29:45.642864 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:45.810283 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Allocated IP 172.20.0.7 (6b3165c5-d574-4d2f-be7c-45593aa36427/f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629/2d83b211-5f7e-4aca-bc2e-f6299dc94c23) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:29:45.997586 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:46.013118 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Transition to ACTIVE for port object 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:29:46.035328 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:46.104673 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Network 6b3165c5-d574-4d2f-be7c-45593aa36427 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:29:46.107868 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:29:46.111653 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:29:46.147245 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event updated for resources: {'Port': ['ID=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:46.183084 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:46.183703 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:46.207134 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-71d2289e-a475-46b0-8cb7-58f940f743bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7363837 May 12 16:29:46.209089 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:46.231124 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Request body: {'port': {'device_id': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:46.291137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ddd5a57-7cd8-433c-aa1f-2482b5e54fa1 req-a2154ae7-fbc5-43b9-a22a-8664f06abf67 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:46.297923 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ddd5a57-7cd8-433c-aa1f-2482b5e54fa1 req-a2154ae7-fbc5-43b9-a22a-8664f06abf67 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 931 time: 0.1277225 May 12 16:29:46.341753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-8ddd5a57-7cd8-433c-aa1f-2482b5e54fa1 req-873cd73a-223b-45e1-95d3-c25c2a600f7c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418446 May 12 16:29:46.356455 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:46.423308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-874dbd3a-a09d-49df-9f4a-abb8c84c6706 None None] Provisioning for port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:29:46.428793 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-874dbd3a-a09d-49df-9f4a-abb8c84c6706 None None] Provisioning complete for port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:46.429328 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-874dbd3a-a09d-49df-9f4a-abb8c84c6706 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:46.486128 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-874dbd3a-a09d-49df-9f4a-abb8c84c6706 None None] Port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:29:46.500534 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:46.811393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:29:46.818451 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:46.832416 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Transition to ACTIVE for port object 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:29:46.836820 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:46.997567 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Pushing event updated for resources: {'Port': ['ID=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:47.012080 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 64a971da-d9fd-44fc-a49f-baae6fd97131 up at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:29:47.091158 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Provisioning complete for port 64a971da-d9fd-44fc-a49f-baae6fd97131 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:47.091526 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:47.092295 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Attempting to bind port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 on host n-h1-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:29:47.092636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Attempting to bind port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 by drivers openvswitch,hyperv on host n-h1-841483-1 at level 0 using segments [{'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:29:47.092967 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Attempting to bind port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 on network 6b3165c5-d574-4d2f-be7c-45593aa36427 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:29:47.097707 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 on network 6b3165c5-d574-4d2f-be7c-45593aa36427 not bound, no agent of type Open vSwitch agent registered on host n-h1-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:29:47.098027 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Attempting to bind port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 on network 6b3165c5-d574-4d2f-be7c-45593aa36427 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:29:47.105824 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Checking agent: {'id': '660291ce-ae5a-47b3-b265-3798c966e205', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 43), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 29, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:29:47.106162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Checking segment: {'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:29:47.106545 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Bound using segment: {'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:29:47.106968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Bound port: 2d83b211-5f7e-4aca-bc2e-f6299dc94c23, host: n-h1-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:29:47.107314 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:47.205034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] For port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23, host n-h1-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:29:47.208260 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] For port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23, host n-h1-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:29:47.212643 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:47.277048 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:47.277682 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:47.279044 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] 10.222.0.84 "PUT /v2.0/ports/2d83b211-5f7e-4aca-bc2e-f6299dc94c23 HTTP/1.1" status: 200 len: 1091 time: 1.0522430 May 12 16:29:47.279598 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'tag': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:29:47.306107 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ed35339-ad46-428d-89c8-ae224244d2ea service neutron] Pushing event updated for resources: {'Port': ['ID=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:47.405313 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ec9945a8-3909-4a89-8259-921736f84ee8'] response: {'name': 'network-changed', 'server_uuid': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'tag': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'status': 'completed', 'code': 200} May 12 16:29:47.427162 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-9029966c-90ef-4627-86a0-743be50c5da7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:47.429036 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-9029966c-90ef-4627-86a0-743be50c5da7 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 1094 time: 0.0806546 May 12 16:29:47.509508 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-6176ef10-2da0-4dfb-91c6-457f62ede034 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23 HTTP/1.1" status: 200 len: 217 time: 0.0683560 May 12 16:29:47.538618 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd95f5d-3aad-42eb-b07a-7738b7a5bf7f req-57ade3d8-ae69-4e7d-833a-1122acb185dd tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:47.539972 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1bd95f5d-3aad-42eb-b07a-7738b7a5bf7f req-57ade3d8-ae69-4e7d-833a-1122acb185dd tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 943 time: 0.0874715 May 12 16:29:47.588139 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-1bd95f5d-3aad-42eb-b07a-7738b7a5bf7f req-9eefea85-6ce1-49e7-a5df-059b50455647 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425482 May 12 16:29:47.590228 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-42087e29-eff2-4c95-ad82-34b103893d9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:47.592578 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-42087e29-eff2-4c95-ad82-34b103893d9d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 200 len: 849 time: 0.0741625 May 12 16:29:47.683155 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-9ba756a6-d701-4b9b-8ad6-58f11aab5c8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:47.684616 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-9ba756a6-d701-4b9b-8ad6-58f11aab5c8a service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=6b3165c5-d574-4d2f-be7c-45593aa36427&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0846055 May 12 16:29:47.820354 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-29dfb319-d87c-4e50-9649-5461a05629e0 service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1248012 May 12 16:29:47.960997 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-7d34ede7-a659-4d34-ad8f-d0c999e52afe req-77269d7c-d176-492d-906f-1a2ca8448081 service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1331675 May 12 16:29:47.980113 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:48.135263 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c0d8746-b84f-41c6-bb70-58e72c43322c req-981e42ff-21ef-44ae-830e-5ba114698240 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:48.136847 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1c0d8746-b84f-41c6-bb70-58e72c43322c req-981e42ff-21ef-44ae-830e-5ba114698240 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 1094 time: 0.0722661 May 12 16:29:48.269832 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c0d8746-b84f-41c6-bb70-58e72c43322c req-c8166e50-7934-497e-8cd5-5ab69025e8cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:48.271286 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1c0d8746-b84f-41c6-bb70-58e72c43322c req-c8166e50-7934-497e-8cd5-5ab69025e8cd service neutron] 10.222.0.84 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 911 time: 0.1281345 May 12 16:29:48.342695 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1c0d8746-b84f-41c6-bb70-58e72c43322c req-52de8c9d-0bf9-4fdd-abf0-7f5295224b1f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23 HTTP/1.1" status: 200 len: 217 time: 0.0645881 May 12 16:29:48.405087 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c0d8746-b84f-41c6-bb70-58e72c43322c req-a76fcbc2-3f79-45f8-ad72-11c8f4c6f4c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:48.406475 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1c0d8746-b84f-41c6-bb70-58e72c43322c req-a76fcbc2-3f79-45f8-ad72-11c8f4c6f4c3 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 200 len: 849 time: 0.0554092 May 12 16:29:48.604591 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c0d8746-b84f-41c6-bb70-58e72c43322c req-85573cc4-8eee-4375-9942-a427ad5652b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:48.605994 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1c0d8746-b84f-41c6-bb70-58e72c43322c req-85573cc4-8eee-4375-9942-a427ad5652b3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=6b3165c5-d574-4d2f-be7c-45593aa36427&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1915936 May 12 16:29:48.742820 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1c0d8746-b84f-41c6-bb70-58e72c43322c req-bd7785fa-2d8f-4683-90c1-f42d49f782e4 service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1296515 May 12 16:29:48.795641 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e0c5a54-f120-4610-b751-241010664d3b req-dca7b306-8f85-4337-9bd9-c42030c5fb62 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:48.797090 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e0c5a54-f120-4610-b751-241010664d3b req-dca7b306-8f85-4337-9bd9-c42030c5fb62 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 943 time: 0.0816753 May 12 16:29:48.842676 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-6e0c5a54-f120-4610-b751-241010664d3b req-377022d9-d20d-45e5-ae2d-dea170e0046a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397918 May 12 16:29:48.880783 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1c0d8746-b84f-41c6-bb70-58e72c43322c req-1b7410d9-5cfd-4807-b93c-2fd0c0a07bd7 service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1297367 May 12 16:29:49.898773 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:29:50.032520 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d78f03f3-290e-4c9b-8e0f-32d1a1b8ea4a req-94ae7520-2f5c-4109-8740-55f2b3830856 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:50.034107 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d78f03f3-290e-4c9b-8e0f-32d1a1b8ea4a req-94ae7520-2f5c-4109-8740-55f2b3830856 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 943 time: 0.0862217 May 12 16:29:50.034357 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:50.048439 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'port_id': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'mac_address': 'fa:16:3e:0a:a9:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 566, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:29:50.079057 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d78f03f3-290e-4c9b-8e0f-32d1a1b8ea4a req-5f2080fd-e436-4686-8162-93d682107786 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381229 May 12 16:29:50.106137 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:50.123028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:29:50.138527 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:50.142357 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:50.214958 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:50.493674 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['2d83b211-5f7e-4aca-bc2e-f6299dc94c23'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:29:51.265032 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d485cadb-bd5f-4a3c-b0ed-ef181ac8e519 req-d02a5657-7a4d-45d2-8576-314dfc046834 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:51.266507 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d485cadb-bd5f-4a3c-b0ed-ef181ac8e519 req-d02a5657-7a4d-45d2-8576-314dfc046834 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 944 time: 0.0796585 May 12 16:29:51.310819 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d485cadb-bd5f-4a3c-b0ed-ef181ac8e519 req-700b0050-1927-4ad4-82c9-f04b45e29c51 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385973 May 12 16:29:51.914987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:29:51.981804 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning for port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:29:51.986576 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:29:51.986933 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:52.103593 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:52.131028 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:29:52.141722 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:29:52.145886 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:52.185271 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5ff5cef5-5b71-4b6d-a1de-b4f8537364b4'] response: {'server_uuid': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'code': 200} May 12 16:29:52.217633 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:52.244193 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4cc56bf0-2adb-48c0-a1fa-ae056c80e25b req-ee9b5c8d-8932-4b76-a09a-2782e75dd374 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0434194 May 12 16:29:52.366535 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4cc56bf0-2adb-48c0-a1fa-ae056c80e25b req-388277f8-aa7e-4b61-909d-09339026ab98 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0555396 May 12 16:29:52.416600 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4cc56bf0-2adb-48c0-a1fa-ae056c80e25b req-c50459ad-4686-4047-a5a2-cdfc8c5163d0 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0318072 May 12 16:29:52.422599 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b69948-6f4c-4e5d-aa10-d5d7ab559f0a req-9ea664ef-bd84-4a20-a1a6-b065730b1e54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:52.424183 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-73b69948-6f4c-4e5d-aa10-d5d7ab559f0a req-9ea664ef-bd84-4a20-a1a6-b065730b1e54 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 1096 time: 0.1475837 May 12 16:29:52.552963 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-73b69948-6f4c-4e5d-aa10-d5d7ab559f0a req-b4e7263b-8943-4d9c-bc10-e1e7c98351f9 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1092618 May 12 16:29:52.595317 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc56bf0-2adb-48c0-a1fa-ae056c80e25b req-dcef8e16-8e80-4f3a-8895-4aec033841f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:52.596761 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4cc56bf0-2adb-48c0-a1fa-ae056c80e25b req-dcef8e16-8e80-4f3a-8895-4aec033841f6 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1717997 May 12 16:29:52.605572 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-240920e2-5092-43ef-a889-5597c370e557 req-d07b4678-7e3e-4bdd-9a6e-eb5bb6683129 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:52.607069 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-240920e2-5092-43ef-a889-5597c370e557 req-d07b4678-7e3e-4bdd-9a6e-eb5bb6683129 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 945 time: 0.1910927 May 12 16:29:52.653238 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-240920e2-5092-43ef-a889-5597c370e557 req-78002275-abb9-42c1-b996-cf0506b61859 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403295 May 12 16:29:53.841369 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b1d94d-0f93-4b46-b25f-6fd0072b6320 req-c8077f08-76b4-4a78-9669-aa7a850335aa tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:53.842867 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1b1d94d-0f93-4b46-b25f-6fd0072b6320 req-c8077f08-76b4-4a78-9669-aa7a850335aa tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 945 time: 0.0842979 May 12 16:29:53.890136 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-e1b1d94d-0f93-4b46-b25f-6fd0072b6320 req-d4175c65-af15-4589-a9f7-cc86ae868fca tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414979 May 12 16:29:55.076948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53990f84-4760-44e7-ba57-819a1776fb0f req-a1e385ae-0c94-4d17-9f4c-fa36769acda8 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:55.078660 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-53990f84-4760-44e7-ba57-819a1776fb0f req-a1e385ae-0c94-4d17-9f4c-fa36769acda8 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 945 time: 0.0793910 May 12 16:29:55.123251 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-53990f84-4760-44e7-ba57-819a1776fb0f req-2b4ce5ee-d0a2-4280-b816-6f3ea07c4ce4 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390618 May 12 16:29:55.310824 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5586bd08-28aa-4fc1-b563-01368bbaa931 req-1c2d913b-5685-40a1-af5e-668a619241f3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:55.312249 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5586bd08-28aa-4fc1-b563-01368bbaa931 req-1c2d913b-5685-40a1-af5e-668a619241f3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 945 time: 0.0829003 May 12 16:29:55.356151 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5586bd08-28aa-4fc1-b563-01368bbaa931 req-6b67d96d-624d-49ed-9a69-8ef3fb4f65cb tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381534 May 12 16:29:55.377995 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57544) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:55.541009 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eef1bd62-d92a-4dbb-9c2c-98fe1b52c180 tempest-TestSnapshotPattern-724859185 tempest-TestSnapshotPattern-724859185-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:55.541726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-eef1bd62-d92a-4dbb-9c2c-98fe1b52c180 tempest-TestSnapshotPattern-724859185 tempest-TestSnapshotPattern-724859185-project-admin] Synchronizing usage tracker for tenant:1964d6d2e49246c5a8ab5ba8bd039d1c on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:29:55.557450 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-eef1bd62-d92a-4dbb-9c2c-98fe1b52c180 tempest-TestSnapshotPattern-724859185 tempest-TestSnapshotPattern-724859185-project-admin] Unset dirty status for tenant:1964d6d2e49246c5a8ab5ba8bd039d1c on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:29:55.558567 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-eef1bd62-d92a-4dbb-9c2c-98fe1b52c180 tempest-TestSnapshotPattern-724859185 tempest-TestSnapshotPattern-724859185-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 1091 time: 0.1796350 May 12 16:29:55.561754 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57550) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:29:55.566738 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ip_address': '172.20.0.7'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:29:55.573195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:29:55.576997 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Usage tracker for resource:floatingip and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:29:55.580029 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:29:55.585654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:29:55.596369 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:55.729813 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:55.863110 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Allocated IP 172.25.8.91 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/2a6d2abf-7782-49b0-9093-5e9a94abc7ce) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:29:56.005452 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:56.034845 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:56.102142 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:29:56.105129 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:29:56.108703 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:29:56.137654 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event updated for resources: {'Port': ['ID=2a6d2abf-7782-49b0-9093-5e9a94abc7ce,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:56.513575 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:56.584945 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:56.885124 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:56.889374 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:56.995513 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event updated for resources: {'Port': ['ID=2a6d2abf-7782-49b0-9093-5e9a94abc7ce,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:29:57.007179 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:57.182694 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Floating IP 41d05069-1c82-4e1a-9d61-5b015067b725 associated. External IP: 172.25.8.91, port: 2d83b211-5f7e-4aca-bc2e-f6299dc94c23. May 12 16:29:57.544190 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Router 5e022072-e09a-48f5-a3c9-be500ce472bb has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:29:57.725299 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:29:57.735228 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd65dc7-a0d5-49a9-b656-2a33932af7f9 None None] Sync routers for ids ['5e022072-e09a-48f5-a3c9-be500ce472bb'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:29:57.746053 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cd65dc7-a0d5-49a9-b656-2a33932af7f9 None None] Routers {'5e022072-e09a-48f5-a3c9-be500ce472bb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:57.746654 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3cd65dc7-a0d5-49a9-b656-2a33932af7f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:29:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5e022072-e09a-48f5-a3c9-be500ce472bb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:57.751382 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:29:57.809915 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-5659d106-8278-4c81-9c1e-d7f72cc6dace tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.2469285 May 12 16:29:57.810508 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'tag': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:29:57.854711 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e737bba9-f2db-46e0-84a8-f1955eaede28'] response: {'name': 'network-changed', 'server_uuid': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'tag': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'status': 'completed', 'code': 200} May 12 16:29:57.933635 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-3cd65dc7-a0d5-49a9-b656-2a33932af7f9 None None] Set router 5e022072-e09a-48f5-a3c9-be500ce472bb gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:57.974864 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c66e2ded-1e47-4cb2-8d41-a9f46ce51337 req-bc49ee09-e3cd-4429-96e2-eaf7dddcf9bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:57.976316 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c66e2ded-1e47-4cb2-8d41-a9f46ce51337 req-bc49ee09-e3cd-4429-96e2-eaf7dddcf9bb service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 1096 time: 0.0741062 May 12 16:29:58.106598 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c66e2ded-1e47-4cb2-8d41-a9f46ce51337 req-4255a4c2-b77d-4721-a327-2d60ea298ee0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:58.107946 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c66e2ded-1e47-4cb2-8d41-a9f46ce51337 req-4255a4c2-b77d-4721-a327-2d60ea298ee0 service neutron] 10.222.0.84 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 911 time: 0.1254075 May 12 16:29:58.209002 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c66e2ded-1e47-4cb2-8d41-a9f46ce51337 req-daef951c-9727-4fbd-a73d-39b034b6d4c5 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23 HTTP/1.1" status: 200 len: 998 time: 0.0954676 May 12 16:29:58.278520 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c66e2ded-1e47-4cb2-8d41-a9f46ce51337 req-9ad50830-8574-489a-b0ac-14ece0b276de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:58.280517 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c66e2ded-1e47-4cb2-8d41-a9f46ce51337 req-9ad50830-8574-489a-b0ac-14ece0b276de service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 200 len: 849 time: 0.0657566 May 12 16:29:58.281604 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3cd65dc7-a0d5-49a9-b656-2a33932af7f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '41d05069-1c82-4e1a-9d61-5b015067b725', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'floating_ip_address': '172.25.8.91', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'port_id': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 4454, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'mac_address': 'fa:16:3e:0a:a9:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:29:56Z', 'updated_at': '2022-05-12T16:29:56Z', 'revision_number': 0, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:39Z', 'revision_number': 5, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:58.285745 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd65dc7-a0d5-49a9-b656-2a33932af7f9 None None] Checking router: 5e022072-e09a-48f5-a3c9-be500ce472bb for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:29:58.294392 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cd65dc7-a0d5-49a9-b656-2a33932af7f9 None None] Routers {'5e022072-e09a-48f5-a3c9-be500ce472bb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:29:58.294977 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3cd65dc7-a0d5-49a9-b656-2a33932af7f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:29:45Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5e022072-e09a-48f5-a3c9-be500ce472bb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:58.355443 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c66e2ded-1e47-4cb2-8d41-a9f46ce51337 req-0aa2d0cb-6d1b-4d29-862e-3c0f0e4ec904 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:29:58.357235 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c66e2ded-1e47-4cb2-8d41-a9f46ce51337 req-0aa2d0cb-6d1b-4d29-862e-3c0f0e4ec904 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=6b3165c5-d574-4d2f-be7c-45593aa36427&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0710237 May 12 16:29:58.474608 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-3cd65dc7-a0d5-49a9-b656-2a33932af7f9 None None] Set router 5e022072-e09a-48f5-a3c9-be500ce472bb gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:29:58.493264 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c66e2ded-1e47-4cb2-8d41-a9f46ce51337 req-27840869-6359-471a-9865-21c39bed054a service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1266451 May 12 16:29:58.627479 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c66e2ded-1e47-4cb2-8d41-a9f46ce51337 req-1bb59ed8-9138-4dbc-84e9-4f66d916e632 service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1280782 May 12 16:29:58.824393 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-3cd65dc7-a0d5-49a9-b656-2a33932af7f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '41d05069-1c82-4e1a-9d61-5b015067b725', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'floating_ip_address': '172.25.8.91', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'port_id': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 4454, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'mac_address': 'fa:16:3e:0a:a9:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:29:56Z', 'updated_at': '2022-05-12T16:29:56Z', 'revision_number': 0, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:39Z', 'revision_number': 5, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:29:58.828481 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd65dc7-a0d5-49a9-b656-2a33932af7f9 None None] The sync data for ids ['5e022072-e09a-48f5-a3c9-be500ce472bb'] in n-d-841483-1 is: [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '41d05069-1c82-4e1a-9d61-5b015067b725', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'floating_ip_address': '172.25.8.91', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'port_id': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 4454, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'mac_address': 'fa:16:3e:0a:a9:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:29:56Z', 'updated_at': '2022-05-12T16:29:56Z', 'revision_number': 0, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:39Z', 'revision_number': 5, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:29:59.028336 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-426d94ad-9039-4520-8e68-68727c741897 None None] New status for floating IP 41d05069-1c82-4e1a-9d61-5b015067b725: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:30:03.117156 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:30:12.936646 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-283f5446-eba7-4c01-b760-2798a05c1316 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:30:13.939412 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:30:15.469565 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3f3abf9b-3d26-436a-97a7-a56008d138ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:30:15.997810 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af6e56e9-3a14-48ab-bcbd-6d73ed7d9a43 req-41208f68-9b28-4490-ad40-1418f7dd710a service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0728006 May 12 16:30:16.161075 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6e56e9-3a14-48ab-bcbd-6d73ed7d9a43 req-71ff9263-2735-4506-b094-d4ea0d5aa1dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:30:16.162565 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af6e56e9-3a14-48ab-bcbd-6d73ed7d9a43 req-71ff9263-2735-4506-b094-d4ea0d5aa1dc service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 1096 time: 0.0693564 May 12 16:30:16.202752 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:30:16.313650 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6e56e9-3a14-48ab-bcbd-6d73ed7d9a43 req-8a71cb87-544d-4ae9-998b-83f483bd9199 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:30:16.315153 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af6e56e9-3a14-48ab-bcbd-6d73ed7d9a43 req-8a71cb87-544d-4ae9-998b-83f483bd9199 service neutron] 10.222.0.84 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 911 time: 0.1320834 May 12 16:30:16.503149 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:30:16.527876 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af6e56e9-3a14-48ab-bcbd-6d73ed7d9a43 req-7e4f715f-e3a3-431f-9112-fcd14147dafd service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23 HTTP/1.1" status: 200 len: 1000 time: 0.2059700 May 12 16:30:16.590404 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6e56e9-3a14-48ab-bcbd-6d73ed7d9a43 req-2c4ab44b-424e-4d7d-a49d-620926d6af67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:30:16.591712 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af6e56e9-3a14-48ab-bcbd-6d73ed7d9a43 req-2c4ab44b-424e-4d7d-a49d-620926d6af67 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 200 len: 849 time: 0.0575926 May 12 16:30:16.667178 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6e56e9-3a14-48ab-bcbd-6d73ed7d9a43 req-04da1ae0-a887-40a1-ab94-8e66af020d39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:30:16.668774 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af6e56e9-3a14-48ab-bcbd-6d73ed7d9a43 req-04da1ae0-a887-40a1-ab94-8e66af020d39 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=6b3165c5-d574-4d2f-be7c-45593aa36427&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0713630 May 12 16:30:16.804000 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af6e56e9-3a14-48ab-bcbd-6d73ed7d9a43 req-7264563b-8315-4ee2-a059-02d3a25bb182 service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1278069 May 12 16:30:16.937954 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-af6e56e9-3a14-48ab-bcbd-6d73ed7d9a43 req-62732162-02a3-4b16-a1c0-d346fb735c76 service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1260555 May 12 16:30:17.964244 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:30:17.979641 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:30:33.129569 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:30:42.939660 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-5bdc9ede-e0b4-4c08-bfda-319bdd526b04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:30:43.935629 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:30:45.471147 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-74e0f226-0b0a-49f9-9ad0-79cb334261ed None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:30:46.205464 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:30:46.504137 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:30:47.982203 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:30:54.257148 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-df352308-e7d7-4606-b839-d0614a938858 req-17c16631-f441-4192-9756-e947a35d980a service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0423765 May 12 16:30:54.365505 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-df352308-e7d7-4606-b839-d0614a938858 req-3ae126f8-0ef3-4d66-a419-e318ec284381 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0441830 May 12 16:30:54.407122 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-df352308-e7d7-4606-b839-d0614a938858 req-54f9d2f2-7148-4b4a-a9ad-15065bb9853e service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0244448 May 12 16:30:54.540688 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df352308-e7d7-4606-b839-d0614a938858 req-8aa0582e-96df-45a7-8bcd-3b3d00a05fc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:30:54.542053 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-df352308-e7d7-4606-b839-d0614a938858 req-8aa0582e-96df-45a7-8bcd-3b3d00a05fc6 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1301417 May 12 16:30:54.964466 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:31:03.127126 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:31:12.941962 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a7977a66-c95a-4802-b99e-07e7647746bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:31:13.932286 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:31:15.473706 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d2d3d75b-29c1-465c-8380-3c43d5e08fe6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:31:16.208574 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:31:16.507626 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:31:17.026702 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5a388dc5-0e40-4d57-9ae9-f43101f10ed1 req-a1a45a27-4aec-4a09-9d2c-0d6251ad7934 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.0696659 May 12 16:31:17.199723 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a388dc5-0e40-4d57-9ae9-f43101f10ed1 req-a15ea66d-04a6-4184-b1e9-c4b70b334002 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:31:17.201176 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5a388dc5-0e40-4d57-9ae9-f43101f10ed1 req-a15ea66d-04a6-4184-b1e9-c4b70b334002 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 1096 time: 0.0744050 May 12 16:31:17.350607 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a388dc5-0e40-4d57-9ae9-f43101f10ed1 req-efd7e115-1e92-44d6-9516-f905f46ce119 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:31:17.352890 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5a388dc5-0e40-4d57-9ae9-f43101f10ed1 req-efd7e115-1e92-44d6-9516-f905f46ce119 service neutron] 10.222.0.84 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 911 time: 0.1284838 May 12 16:31:17.453202 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5a388dc5-0e40-4d57-9ae9-f43101f10ed1 req-50ca2fdf-60f3-44d2-b7db-4cd6bc33374e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23 HTTP/1.1" status: 200 len: 1000 time: 0.0915575 May 12 16:31:17.520608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a388dc5-0e40-4d57-9ae9-f43101f10ed1 req-37e4eb61-0e13-40e0-b796-217ba31c563e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:31:17.522015 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5a388dc5-0e40-4d57-9ae9-f43101f10ed1 req-37e4eb61-0e13-40e0-b796-217ba31c563e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 200 len: 849 time: 0.0594432 May 12 16:31:17.599533 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a388dc5-0e40-4d57-9ae9-f43101f10ed1 req-a2e7e83e-cffd-422f-ae52-b1898f4f57ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:31:17.600873 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5a388dc5-0e40-4d57-9ae9-f43101f10ed1 req-a2e7e83e-cffd-422f-ae52-b1898f4f57ed service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=6b3165c5-d574-4d2f-be7c-45593aa36427&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0694742 May 12 16:31:17.738335 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5a388dc5-0e40-4d57-9ae9-f43101f10ed1 req-7998920b-f95d-45cf-afeb-558f19fef2ff service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1280568 May 12 16:31:17.875907 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5a388dc5-0e40-4d57-9ae9-f43101f10ed1 req-d7b32c47-3b5c-44da-89eb-a0f0d20ee23a service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1257758 May 12 16:31:17.985359 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:31:31.963249 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:31:33.126985 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:31:42.945014 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-80b6162c-cabb-4dc3-b3b5-bbaa124979a8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:31:43.947163 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:31:45.477431 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-514a19b4-6c59-4c3b-8ec1-a63d01484aa6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:31:46.213216 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:31:46.510236 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:31:47.987920 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:31:54.240429 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9198e5f7-3f2f-4b6d-b8a2-d72b1348e89e req-4ab67ace-65b3-4653-9373-7e9e036b076b service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0447960 May 12 16:31:54.462751 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9198e5f7-3f2f-4b6d-b8a2-d72b1348e89e req-e6a214bc-6c01-497a-b197-acb77ecae48b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.1550317 May 12 16:31:54.508011 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9198e5f7-3f2f-4b6d-b8a2-d72b1348e89e req-cb44ec52-ea85-4bee-b729-a068c2cb54c6 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0250461 May 12 16:31:54.641721 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9198e5f7-3f2f-4b6d-b8a2-d72b1348e89e req-682f5b1c-f816-4dfe-a510-9fd6390aaa6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:31:54.643406 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-9198e5f7-3f2f-4b6d-b8a2-d72b1348e89e req-682f5b1c-f816-4dfe-a510-9fd6390aaa6e service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1298077 May 12 16:32:00.413199 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 details requested by agent hyperv_n-h1-841483-1 with host n-h1-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:32:00.555959 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:32:00.577843 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Returning: {'device': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'port_id': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'mac_address': 'fa:16:3e:0a:a9:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 566, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:32:00.635149 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:00.653551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:32:00.670937 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:32:00.674712 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:00.745041 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:32:00.754171 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:00.754515 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:00.754855 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:00.755190 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:00.755522 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:00.755849 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:00.756172 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:00.756494 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:00.756816 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:00.757135 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:00.757482 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:00.757807 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:00.840085 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] get_ports_and_sgs() called for port_ids ['2d83b211-5f7e-4aca-bc2e-f6299dc94c23'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:32:02.413288 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 up at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:32:02.496210 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Provisioning complete for port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:32:02.496683 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:02.636759 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:02.670978 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:32:02.682196 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:32:02.688442 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:02.770334 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:32:02.817172 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5035447c-6ac0-4587-824d-18f762532f0e'] response: {'server_uuid': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'code': 200} May 12 16:32:03.145863 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:08.962257 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:32:09.510286 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-99d70a64-4a62-4b39-a466-08e0b07ad704 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1199673062&fields=id&tenant_id=db6d55e7484248b38b40fa3b29a09ab9 HTTP/1.1" status: 200 len: 267 time: 0.0429492 May 12 16:32:09.661012 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-9ef9c237-efd5-49e9-b9d7-4536533d668d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:09.662524 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-9ef9c237-efd5-49e9-b9d7-4536533d668d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 810 time: 0.1452987 May 12 16:32:09.677682 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-4772061a-dc18-4bfc-932e-9e477684d1af tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/quotas/db6d55e7484248b38b40fa3b29a09ab9 HTTP/1.1" status: 200 len: 375 time: 0.0095360 May 12 16:32:09.768906 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-58ea2070-0ff0-4799-9313-31b46141063b tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&fields=id HTTP/1.1" status: 200 len: 394 time: 0.0849812 May 12 16:32:09.825075 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-9fff7080-9009-489e-8bf1-9b7735aaec73 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88152) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 16:32:09.826089 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-9fff7080-9009-489e-8bf1-9b7735aaec73 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0466945 May 12 16:32:09.960584 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-f33ede52-58cc-4640-a4ea-fee22b301610 service neutron] 10.222.0.82 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1277297 May 12 16:32:10.200472 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-fed7e337-1f1f-4275-aaed-150cf679d563 service neutron] 10.222.0.82 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2340586 May 12 16:32:10.397153 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-ecf14013-c371-426d-ab8a-8d13d7544aae req-b8450fa1-61c9-41ee-a2b3-14ae3ba3a047 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 210 time: 0.0466928 May 12 16:32:11.445467 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-a84a42f1-bbf2-4912-beb0-bcd3d6abf0a5 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:11.446907 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-a84a42f1-bbf2-4912-beb0-bcd3d6abf0a5 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.76 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 810 time: 0.1565835 May 12 16:32:11.497625 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-66fd3b53-6da9-4f40-9c07-da6bf46e1fb1 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=db6d55e7484248b38b40fa3b29a09ab9 HTTP/1.1" status: 200 len: 380 time: 0.0426090 May 12 16:32:11.505346 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Request body: {'port': {'device_id': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'admin_state_up': True, 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'security_groups': ['f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63']}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:32:11.551097 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c7d45468-3723-4638-8315-5627bd0e2f8e req-107e1082-8167-4ee4-8187-cf67e2c3f7d5 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 210 time: 0.0428443 May 12 16:32:11.647277 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:32:11.651290 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Usage tracker for resource:port and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:32:11.654329 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Quota usage for port was recalculated. Used quota:4. {{(pid=88151) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:32:11.660265 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.quota.driver [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=88151) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:32:11.670642 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Made reservation on behalf of db6d55e7484248b38b40fa3b29a09ab9 for: {'port': 1} {{(pid=88151) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 12 16:32:11.674808 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:11.905762 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_common [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Allocated IP 172.20.0.14 (6b3165c5-d574-4d2f-be7c-45593aa36427/f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629/a5c3a8b6-34d8-4b81-9cfa-ff208e057292) {{(pid=88151) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:32:12.150430 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for port, precommit_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:12.168887 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Transition to ACTIVE for port object a5c3a8b6-34d8-4b81-9cfa-ff208e057292 will not be triggered until provisioned by entity DHCP. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:32:12.193885 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_create {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:12.282585 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Network 6b3165c5-d574-4d2f-be7c-45593aa36427 is already hosted by enough agents. {{(pid=88151) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:32:12.286313 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.base_scheduler [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources bound (agent type, host, resource id): {{(pid=88151) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:32:12.288256 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event updated for resources: {'Port': ['ID=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,revision_number=1']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:32:12.290583 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Received port after_create {{(pid=88151) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:32:12.336640 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:12.336984 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:12.337314 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:12.337667 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:12.337992 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:12.338318 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:12.338637 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:12.338955 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:12.339368 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:12.339615 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:12.339973 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:12.340331 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:12.377983 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:12.379004 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:12.410098 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2674a4b6-106f-43db-a866-d93d46f5ff6c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9077387 May 12 16:32:12.490843 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:32:12.617301 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:12.654008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:32:12.661584 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f0df4479-337b-4c2a-86e3-b405ad45ae08 None None] Provisioning for port a5c3a8b6-34d8-4b81-9cfa-ff208e057292 completed by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:32:12.675573 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] For port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:32:12.676846 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-f0df4479-337b-4c2a-86e3-b405ad45ae08 None None] Provisioning complete for port a5c3a8b6-34d8-4b81-9cfa-ff208e057292 triggered by entity DHCP. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:32:12.677883 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f0df4479-337b-4c2a-86e3-b405ad45ae08 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:12.709509 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:12.789621 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1dd499a0-f81e-4132-86a9-67447961304e'] response: {'server_uuid': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'code': 200} May 12 16:32:12.790194 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Pushing event updated for resources: {'Port': ['ID=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:32:12.798434 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0617c8c0-0119-4ec1-bbb2-22c54f376a7f req-c024ed8d-88cc-4aac-b7c9-83db14a1f859 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:12.806912 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0617c8c0-0119-4ec1-bbb2-22c54f376a7f req-c024ed8d-88cc-4aac-b7c9-83db14a1f859 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 932 time: 0.1387930 May 12 16:32:12.813517 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-f0df4479-337b-4c2a-86e3-b405ad45ae08 None None] Port a5c3a8b6-34d8-4b81-9cfa-ff208e057292 cannot update to ACTIVE because it is not bound. {{(pid=88153) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 12 16:32:12.871213 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0617c8c0-0119-4ec1-bbb2-22c54f376a7f req-736cb040-8690-41e3-839d-b596445d420a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0606599 May 12 16:32:12.946913 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6118baaa-a849-4eda-81ce-d9d69ad0b4a8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:13.986319 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:14.065613 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64d52c38-5e94-406d-a085-299c58cbd2be req-89f129de-4274-4444-b2d4-486ecadac10e tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:14.067054 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64d52c38-5e94-406d-a085-299c58cbd2be req-89f129de-4274-4444-b2d4-486ecadac10e tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 932 time: 0.0836749 May 12 16:32:14.117650 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-64d52c38-5e94-406d-a085-299c58cbd2be req-f28d6533-5085-4f37-8e21-80fee9a43531 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441189 May 12 16:32:15.421291 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5099d6f4-91b4-4499-a2f3-e2d0252c6696 req-e69733c3-a031-4384-8204-a847cf5d0ced tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:15.426166 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5099d6f4-91b4-4499-a2f3-e2d0252c6696 req-e69733c3-a031-4384-8204-a847cf5d0ced tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 932 time: 0.1839840 May 12 16:32:15.476753 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-5099d6f4-91b4-4499-a2f3-e2d0252c6696 req-eaf3a591-0a1e-423e-b6c3-4c94ca01c9cb tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464802 May 12 16:32:15.482360 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7df52491-e606-44c1-95b9-78b6ef010490 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:16.211074 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:16.515903 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:16.697661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e6a48d9-0ad4-41f5-a60d-11f3ec66253f req-1029cb85-f180-42fa-9900-c097e656afd1 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:16.699159 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e6a48d9-0ad4-41f5-a60d-11f3ec66253f req-1029cb85-f180-42fa-9900-c097e656afd1 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 932 time: 0.1043344 May 12 16:32:16.749602 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9e6a48d9-0ad4-41f5-a60d-11f3ec66253f req-94e692f9-f917-43d6-9fe9-3d672fc799bf tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426583 May 12 16:32:18.010372 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87a08c50-36da-4b3c-9bd3-47ea15532834 req-4158f553-b049-4770-8fc6-d5677c68cca8 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:18.016385 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:18.024477 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87a08c50-36da-4b3c-9bd3-47ea15532834 req-4158f553-b049-4770-8fc6-d5677c68cca8 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 932 time: 0.1229339 May 12 16:32:18.033742 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-488469db-f30b-4926-bbc4-8a65e2c74f47 req-7940d863-9b7e-4a5a-8251-48e344926d05 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.1071093 May 12 16:32:18.069619 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-87a08c50-36da-4b3c-9bd3-47ea15532834 req-eb8ab2bd-0213-4904-b328-7c76df24a321 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440593 May 12 16:32:18.227378 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488469db-f30b-4926-bbc4-8a65e2c74f47 req-7ef6e7c8-e849-4187-a53f-d78c08aeeb68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:18.229218 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-488469db-f30b-4926-bbc4-8a65e2c74f47 req-7ef6e7c8-e849-4187-a53f-d78c08aeeb68 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 1094 time: 0.0756381 May 12 16:32:18.401900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488469db-f30b-4926-bbc4-8a65e2c74f47 req-8e3f2ad4-d12b-4e93-bade-efd92000c5a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:18.403373 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-488469db-f30b-4926-bbc4-8a65e2c74f47 req-8e3f2ad4-d12b-4e93-bade-efd92000c5a7 service neutron] 10.222.0.84 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 911 time: 0.1486225 May 12 16:32:18.528054 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-488469db-f30b-4926-bbc4-8a65e2c74f47 req-dc210d7f-11d1-4c4e-bde5-7e3a1110510f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23 HTTP/1.1" status: 200 len: 998 time: 0.1147690 May 12 16:32:18.606394 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488469db-f30b-4926-bbc4-8a65e2c74f47 req-edff84bf-66e6-442c-8e47-400bddc0381c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:18.607843 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-488469db-f30b-4926-bbc4-8a65e2c74f47 req-edff84bf-66e6-442c-8e47-400bddc0381c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 200 len: 849 time: 0.0711408 May 12 16:32:18.714001 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488469db-f30b-4926-bbc4-8a65e2c74f47 req-53843623-efcd-4267-beb4-1a1389416814 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:18.715491 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-488469db-f30b-4926-bbc4-8a65e2c74f47 req-53843623-efcd-4267-beb4-1a1389416814 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=6b3165c5-d574-4d2f-be7c-45593aa36427&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0996819 May 12 16:32:18.869147 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-488469db-f30b-4926-bbc4-8a65e2c74f47 req-0a60e0a3-90be-48e2-8b75-d2de6d536431 service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1438179 May 12 16:32:19.010085 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-488469db-f30b-4926-bbc4-8a65e2c74f47 req-fc9af54b-6284-4634-b50b-638e7a34703b service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1303351 May 12 16:32:19.255474 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fc6f19e-4eb1-495f-9c75-2fac20310888 req-6edc445a-cdf6-4b9e-869a-539755b3b583 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:19.256936 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0fc6f19e-4eb1-495f-9c75-2fac20310888 req-6edc445a-cdf6-4b9e-869a-539755b3b583 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 932 time: 0.0829554 May 12 16:32:19.302862 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-0fc6f19e-4eb1-495f-9c75-2fac20310888 req-96ffa95f-4fb5-4f04-a55b-c5c04ca286d1 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402398 May 12 16:32:19.448785 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-3c9d96a2-087b-4f89-8753-a6643e1f9412 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=88151) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 12 16:32:19.449770 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-3c9d96a2-087b-4f89-8753-a6643e1f9412 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0052125 May 12 16:32:19.459341 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.v2.base [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Request body: {'port': {'device_id': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-841483-1'}} {{(pid=88151) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:32:19.685225 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:20.051559 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a5c3a8b6-34d8-4b81-9cfa-ff208e057292 {{(pid=88151) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:32:20.059277 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Notify callbacks [] for port, precommit_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:20.073977 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.provisioning_blocks [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Transition to ACTIVE for port object a5c3a8b6-34d8-4b81-9cfa-ff208e057292 will not be triggered until provisioned by entity L2. {{(pid=88151) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 12 16:32:20.078100 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:20.214056 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Pushing event updated for resources: {'Port': ['ID=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,revision_number=2']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:32:20.329562 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Attempting to bind port a5c3a8b6-34d8-4b81-9cfa-ff208e057292 on host n-h2-841483-1 for vnic_type normal with profile {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 12 16:32:20.330239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Attempting to bind port a5c3a8b6-34d8-4b81-9cfa-ff208e057292 by drivers openvswitch,hyperv on host n-h2-841483-1 at level 0 using segments [{'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 12 16:32:20.330239 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Attempting to bind port a5c3a8b6-34d8-4b81-9cfa-ff208e057292 on network 6b3165c5-d574-4d2f-be7c-45593aa36427 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:32:20.335810 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Port a5c3a8b6-34d8-4b81-9cfa-ff208e057292 on network 6b3165c5-d574-4d2f-be7c-45593aa36427 not bound, no agent of type Open vSwitch agent registered on host n-h2-841483-1 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 12 16:32:20.336140 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Attempting to bind port a5c3a8b6-34d8-4b81-9cfa-ff208e057292 on network 6b3165c5-d574-4d2f-be7c-45593aa36427 {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 12 16:32:20.341715 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Checking agent: {'id': '465428e1-5ab8-4148-8e08-4819501da7e5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-841483-1', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'started_at': datetime.datetime(2022, 5, 12, 15, 1, 32), 'heartbeat_timestamp': datetime.datetime(2022, 5, 12, 16, 32, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 12 16:32:20.342236 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Checking segment: {'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=88151) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:343}} May 12 16:32:20.342572 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Bound using segment: {'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'} {{(pid=88151) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 12 16:32:20.343092 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.managers [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Bound port: a5c3a8b6-34d8-4b81-9cfa-ff208e057292, host: n-h2-841483-1, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ddd0765d-5046-493f-a791-a2865e3d2e7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 566, 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427'}}] {{(pid=88151) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 12 16:32:20.343594 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:20.440352 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] For port a5c3a8b6-34d8-4b81-9cfa-ff208e057292, host n-h2-841483-1, cleared binding levels {{(pid=88151) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 12 16:32:20.443603 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] For port a5c3a8b6-34d8-4b81-9cfa-ff208e057292, host n-h2-841483-1, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88151) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 12 16:32:20.449139 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28274649'] for port, after_update {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:20.513183 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41622446-d55f-4cab-a31b-caaeca9530a8 req-16a7bb0d-a1a8-4c5d-aa52-07d14cd81c27 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:20.515433 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41622446-d55f-4cab-a31b-caaeca9530a8 req-16a7bb0d-a1a8-4c5d-aa52-07d14cd81c27 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 944 time: 0.0954905 May 12 16:32:20.518131 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:20.518783 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:20.520286 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] 10.222.0.76 "PUT /v2.0/ports/a5c3a8b6-34d8-4b81-9cfa-ff208e057292 HTTP/1.1" status: 200 len: 1092 time: 1.0645432 May 12 16:32:20.520728 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'tag': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:32:20.544230 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dd9c2af-28d0-47f1-8122-9f500b61a96c service neutron] Pushing event updated for resources: {'Port': ['ID=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,revision_number=3']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:32:20.592891 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-41622446-d55f-4cab-a31b-caaeca9530a8 req-00dd5740-fd37-4a83-8693-f1de9bc7690d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0660744 May 12 16:32:20.612743 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-559e707e-f91d-4193-b86f-ffc8ba9cb36b'] response: {'name': 'network-changed', 'server_uuid': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'tag': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'status': 'completed', 'code': 200} May 12 16:32:20.660014 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2fd3ed7c-7f00-49ca-a5be-25aab88f69fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:20.661548 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-2fd3ed7c-7f00-49ca-a5be-25aab88f69fb service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 1095 time: 0.0945597 May 12 16:32:20.734989 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-c296cf53-5fff-4976-b423-d08c1d038138 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a5c3a8b6-34d8-4b81-9cfa-ff208e057292 HTTP/1.1" status: 200 len: 217 time: 0.0667968 May 12 16:32:20.797009 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-f6ef46f5-d47c-41d3-8c13-ac89e8111970 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:20.798923 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-f6ef46f5-d47c-41d3-8c13-ac89e8111970 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 200 len: 849 time: 0.0583222 May 12 16:32:20.878839 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-a94b4346-bc57-4837-8ff1-0a1329fc6de7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:20.880218 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-a94b4346-bc57-4837-8ff1-0a1329fc6de7 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=6b3165c5-d574-4d2f-be7c-45593aa36427&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0759797 May 12 16:32:21.018208 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-62beeaa5-9c7b-419f-b122-48d4c486f908 service neutron] 10.222.0.76 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1307223 May 12 16:32:21.165487 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-67ba4c06-c953-4b6f-ba6c-d40899c0261d req-c3541d58-5649-4d12-b9ed-9841be7d1d51 service neutron] 10.222.0.76 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1418147 May 12 16:32:21.276393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f2a7a0b-5a08-4058-b8b7-2fb03584e32b req-bb471323-450c-49a1-a9ae-68cdc2adcab1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:21.277889 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f2a7a0b-5a08-4058-b8b7-2fb03584e32b req-bb471323-450c-49a1-a9ae-68cdc2adcab1 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 1095 time: 0.0702350 May 12 16:32:21.408643 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f2a7a0b-5a08-4058-b8b7-2fb03584e32b req-13d8e3bd-0835-478b-b61b-5599789e08da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:21.410098 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f2a7a0b-5a08-4058-b8b7-2fb03584e32b req-13d8e3bd-0835-478b-b61b-5599789e08da service neutron] 10.222.0.76 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 911 time: 0.1261108 May 12 16:32:21.594112 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f2a7a0b-5a08-4058-b8b7-2fb03584e32b req-bfff44d1-3958-43b7-8855-4ace8a194ba9 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a5c3a8b6-34d8-4b81-9cfa-ff208e057292 HTTP/1.1" status: 200 len: 217 time: 0.1774364 May 12 16:32:21.657063 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f2a7a0b-5a08-4058-b8b7-2fb03584e32b req-afeac7c3-aa16-43e2-bee2-769f56c17e65 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:21.658678 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f2a7a0b-5a08-4058-b8b7-2fb03584e32b req-afeac7c3-aa16-43e2-bee2-769f56c17e65 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 200 len: 849 time: 0.0581112 May 12 16:32:21.737714 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f2a7a0b-5a08-4058-b8b7-2fb03584e32b req-8a9351eb-dde8-4cf5-814e-7cce39a0f359 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:21.739188 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f2a7a0b-5a08-4058-b8b7-2fb03584e32b req-8a9351eb-dde8-4cf5-814e-7cce39a0f359 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=6b3165c5-d574-4d2f-be7c-45593aa36427&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0740268 May 12 16:32:21.781972 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aefccfe5-8b9d-4e8a-8038-26adcce6b52e req-0bb24538-c5b7-4772-9c5f-f5fe244222e6 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:21.783563 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aefccfe5-8b9d-4e8a-8038-26adcce6b52e req-0bb24538-c5b7-4772-9c5f-f5fe244222e6 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 944 time: 0.0810919 May 12 16:32:21.834977 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-aefccfe5-8b9d-4e8a-8038-26adcce6b52e req-f5222404-48e9-4b60-b1be-32c0902af510 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444820 May 12 16:32:21.874075 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f2a7a0b-5a08-4058-b8b7-2fb03584e32b req-bda15a5d-f8e2-4031-bfae-1b6673f28f6a service neutron] 10.222.0.76 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1281147 May 12 16:32:22.005075 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-6f2a7a0b-5a08-4058-b8b7-2fb03584e32b req-96fd24cc-a33a-41b9-9325-6221a9b398bb service neutron] 10.222.0.76 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1237512 May 12 16:32:23.020993 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfef134b-d05a-486a-89ca-5f45b6720eef req-4b204f1f-f589-4921-9528-44d01297bb1c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:23.022479 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bfef134b-d05a-486a-89ca-5f45b6720eef req-4b204f1f-f589-4921-9528-44d01297bb1c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 944 time: 0.0809233 May 12 16:32:23.068482 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-bfef134b-d05a-486a-89ca-5f45b6720eef req-f3b57a6d-0bad-4f60-8d58-30bbc1c1c988 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402477 May 12 16:32:23.848251 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a5c3a8b6-34d8-4b81-9cfa-ff208e057292 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:32:23.978222 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a5c3a8b6-34d8-4b81-9cfa-ff208e057292, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:32:23.991597 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'port_id': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'mac_address': 'fa:16:3e:22:30:f7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 566, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:32:24.045015 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:24.061557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a5c3a8b6-34d8-4b81-9cfa-ff208e057292 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:32:24.076805 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a5c3a8b6-34d8-4b81-9cfa-ff208e057292, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:32:24.081350 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:24.150699 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,revision_number=4']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:32:24.260230 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9926d394-a84f-40ae-8b3a-fad0258207eb req-e90ce0e6-77aa-4149-bc1e-51a6ae18609e tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:24.261705 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9926d394-a84f-40ae-8b3a-fad0258207eb req-e90ce0e6-77aa-4149-bc1e-51a6ae18609e tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 945 time: 0.0882292 May 12 16:32:24.305910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-9926d394-a84f-40ae-8b3a-fad0258207eb req-9e6fec51-7858-40d7-b36b-82b40ce8fb35 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384271 May 12 16:32:24.307516 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a5c3a8b6-34d8-4b81-9cfa-ff208e057292'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:32:25.522217 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c16272e9-202e-4eb1-8253-68cdc08419f7 req-e2c8b212-b1d3-4c96-8ee3-611d720038b9 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:25.523658 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c16272e9-202e-4eb1-8253-68cdc08419f7 req-e2c8b212-b1d3-4c96-8ee3-611d720038b9 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 945 time: 0.0828688 May 12 16:32:25.569043 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c16272e9-202e-4eb1-8253-68cdc08419f7 req-64380549-7499-4ecc-9b2e-1c27f406fa60 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396147 May 12 16:32:25.861902 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a5c3a8b6-34d8-4b81-9cfa-ff208e057292 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:32:25.930987 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning for port a5c3a8b6-34d8-4b81-9cfa-ff208e057292 completed by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 12 16:32:25.935988 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port a5c3a8b6-34d8-4b81-9cfa-ff208e057292 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:32:25.936355 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:26.050681 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:26.079818 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:32:26.090188 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a5c3a8b6-34d8-4b81-9cfa-ff208e057292, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:32:26.094063 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:26.136109 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8a208f59-3b76-4d45-99bb-2c4c11a38986'] response: {'server_uuid': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'code': 200} May 12 16:32:26.174662 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,revision_number=5']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:32:26.259338 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-273aab67-e9eb-46b4-a876-a93a6a202dba req-e4448c9c-0ed8-4c4b-bda0-032e0a9d4d99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:26.260792 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-273aab67-e9eb-46b4-a876-a93a6a202dba req-e4448c9c-0ed8-4c4b-bda0-032e0a9d4d99 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 1097 time: 0.0684795 May 12 16:32:26.301493 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-273aab67-e9eb-46b4-a876-a93a6a202dba req-721a53da-0407-4ff0-9167-829a0957b224 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0342417 May 12 16:32:26.761272 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05c59fb-ce26-4256-8196-a5d53c9deaa6 req-cc5de4e6-0d2a-4766-aeba-7a52fae9b744 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:26.762785 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d05c59fb-ce26-4256-8196-a5d53c9deaa6 req-cc5de4e6-0d2a-4766-aeba-7a52fae9b744 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 946 time: 0.0842702 May 12 16:32:26.806091 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-d05c59fb-ce26-4256-8196-a5d53c9deaa6 req-92c4d51a-d511-4791-82f6-715cf8879ff4 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373924 May 12 16:32:27.992731 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2004819-c2a6-4db3-8e10-fbbe695ce3f5 req-1ef9864d-02d2-4b4d-bf25-1d829670f642 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:27.994231 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2004819-c2a6-4db3-8e10-fbbe695ce3f5 req-1ef9864d-02d2-4b4d-bf25-1d829670f642 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 946 time: 0.0802503 May 12 16:32:28.041933 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-a2004819-c2a6-4db3-8e10-fbbe695ce3f5 req-7941bd3f-28b0-425a-a797-b70b8304dc05 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420511 May 12 16:32:28.224713 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb3aced3-ee31-41aa-bd8f-d645b0ed1e5e req-f5062af6-3097-4867-a6a0-aad0d9bb564c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:28.226179 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eb3aced3-ee31-41aa-bd8f-d645b0ed1e5e req-f5062af6-3097-4867-a6a0-aad0d9bb564c tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 946 time: 0.0801089 May 12 16:32:28.283995 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-eb3aced3-ee31-41aa-bd8f-d645b0ed1e5e req-58d05049-7129-464b-9056-5797947e94aa tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520108 May 12 16:32:28.307431 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57820) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:32:28.381647 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba01b588-a464-4ca6-a111-f3c6ad6a5050 tempest-TestSnapshotPattern-724859185 tempest-TestSnapshotPattern-724859185-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:28.384234 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-ba01b588-a464-4ca6-a111-f3c6ad6a5050 tempest-TestSnapshotPattern-724859185 tempest-TestSnapshotPattern-724859185-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 1092 time: 0.0757461 May 12 16:32:28.387033 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 57824) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:32:28.395128 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.v2.base [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Request body: {'floatingip': {'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'port_id': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ip_address': '172.20.0.14'}} {{(pid=88152) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 12 16:32:28.402195 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 12 16:32:28.406035 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Usage tracker for resource:floatingip and tenant:db6d55e7484248b38b40fa3b29a09ab9 is out of sync, need to count used quota {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 12 16:32:28.408896 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=88152) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 12 16:32:28.414774 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.quota.driver [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=88152) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 12 16:32:28.425987 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for floatingip, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:28.578328 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:28.712726 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.db_base_plugin_common [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Allocated IP 172.25.8.240 (5bff663f-be1e-4c0c-b2e2-d037214cb143/9a9fe5f0-4a5e-4d67-842d-7e60d2702213/a5a0ce7a-7793-4bed-b490-e05fd59ff83f) {{(pid=88152) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 12 16:32:28.864192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for port, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:28.892912 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8768026450014', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:29.056465 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Network 5bff663f-be1e-4c0c-b2e2-d037214cb143 is already hosted by enough agents. {{(pid=88152) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 12 16:32:29.059392 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.base_scheduler [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Resources bound (agent type, host, resource id): {{(pid=88152) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 12 16:32:29.063011 n-d-841483-1 neutron-server[88152]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Received port after_create {{(pid=88152) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:538}} May 12 16:32:29.092095 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event updated for resources: {'Port': ['ID=a5a0ce7a-7793-4bed-b490-e05fd59ff83f,revision_number=1']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:32:29.108119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:29.108459 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:29.108791 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:29.109119 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:29.109471 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:29.109796 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:29.110116 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:29.110432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:29.110746 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:29.111060 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:29.111374 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:29.111688 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:32:29.491519 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for floatingip, precommit_create {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:29.565172 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:29.771689 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for port, precommit_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:29.776405 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28164206'] for port, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:29.895021 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event updated for resources: {'Port': ['ID=a5a0ce7a-7793-4bed-b490-e05fd59ff83f,revision_number=2']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:32:29.903197 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3770541'] for floatingip, after_update {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:30.072192 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Floating IP 0d335ac4-7c2b-4b4b-a861-de42a599e844 associated. External IP: 172.25.8.240, port: a5c3a8b6-34d8-4b81-9cfa-ff208e057292. May 12 16:32:30.422990 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Router 5e022072-e09a-48f5-a3c9-be500ce472bb has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:32:30.713273 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:32:30.723307 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15bc07a8-be02-4282-bec1-b4e8f6c9ba74 None None] Sync routers for ids ['5e022072-e09a-48f5-a3c9-be500ce472bb'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:32:30.733801 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15bc07a8-be02-4282-bec1-b4e8f6c9ba74 None None] Routers {'5e022072-e09a-48f5-a3c9-be500ce472bb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:32:30.734491 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-15bc07a8-be02-4282-bec1-b4e8f6c9ba74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:32:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5e022072-e09a-48f5-a3c9-be500ce472bb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:32:30.736135 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:30.796092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-e86b7636-9a5c-41e6-b243-49a607631fce tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.4076524 May 12 16:32:30.796712 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'tag': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:32:30.842467 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-29d3fbaf-e701-4734-8da4-8b267a00b784'] response: {'name': 'network-changed', 'server_uuid': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'tag': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'status': 'completed', 'code': 200} May 12 16:32:30.907966 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-15bc07a8-be02-4282-bec1-b4e8f6c9ba74 None None] Set router 5e022072-e09a-48f5-a3c9-be500ce472bb gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:32:30.935563 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d4954e-d40b-4687-b1f5-7e3aa3484b2f req-67a9b2b7-ff7e-4fc1-94e0-13829b19e6dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:30.937015 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4954e-d40b-4687-b1f5-7e3aa3484b2f req-67a9b2b7-ff7e-4fc1-94e0-13829b19e6dc service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 1097 time: 0.0732861 May 12 16:32:31.068889 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d4954e-d40b-4687-b1f5-7e3aa3484b2f req-7bf2ee87-f99e-4f99-a816-084b295f6793 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:31.070354 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4954e-d40b-4687-b1f5-7e3aa3484b2f req-7bf2ee87-f99e-4f99-a816-084b295f6793 service neutron] 10.222.0.76 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 911 time: 0.1276119 May 12 16:32:31.172432 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4954e-d40b-4687-b1f5-7e3aa3484b2f req-3f24ce3e-7bb2-4c79-b630-7d8c03ec2ad3 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a5c3a8b6-34d8-4b81-9cfa-ff208e057292 HTTP/1.1" status: 200 len: 1000 time: 0.0963259 May 12 16:32:31.233782 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d4954e-d40b-4687-b1f5-7e3aa3484b2f req-c9f1012f-4df5-44af-a875-61115d17a7c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:31.235630 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4954e-d40b-4687-b1f5-7e3aa3484b2f req-c9f1012f-4df5-44af-a875-61115d17a7c7 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 200 len: 849 time: 0.0578270 May 12 16:32:31.250695 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-15bc07a8-be02-4282-bec1-b4e8f6c9ba74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '0d335ac4-7c2b-4b4b-a861-de42a599e844', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'floating_ip_address': '172.25.8.240', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'port_id': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4457, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'mac_address': 'fa:16:3e:22:30:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:32:29Z', 'updated_at': '2022-05-12T16:32:29Z', 'revision_number': 0, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ip_address_scope': None}, {'id': '41d05069-1c82-4e1a-9d61-5b015067b725', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'floating_ip_address': '172.25.8.91', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'port_id': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 4454, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'mac_address': 'fa:16:3e:0a:a9:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:29:56Z', 'updated_at': '2022-05-12T16:29:59Z', 'revision_number': 1, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:39Z', 'revision_number': 5, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:32:31.254527 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15bc07a8-be02-4282-bec1-b4e8f6c9ba74 None None] Checking router: 5e022072-e09a-48f5-a3c9-be500ce472bb for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:32:31.262550 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15bc07a8-be02-4282-bec1-b4e8f6c9ba74 None None] Routers {'5e022072-e09a-48f5-a3c9-be500ce472bb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:32:31.263127 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-15bc07a8-be02-4282-bec1-b4e8f6c9ba74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:32:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5e022072-e09a-48f5-a3c9-be500ce472bb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:32:31.309958 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d4954e-d40b-4687-b1f5-7e3aa3484b2f req-3438ecf0-bb49-4020-bc1e-1d51cb481914 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:31.311411 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4954e-d40b-4687-b1f5-7e3aa3484b2f req-3438ecf0-bb49-4020-bc1e-1d51cb481914 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=6b3165c5-d574-4d2f-be7c-45593aa36427&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0700941 May 12 16:32:31.440835 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-15bc07a8-be02-4282-bec1-b4e8f6c9ba74 None None] Set router 5e022072-e09a-48f5-a3c9-be500ce472bb gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:32:31.445669 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4954e-d40b-4687-b1f5-7e3aa3484b2f req-891e8286-8260-4624-b80d-e9ca9cae4ba8 service neutron] 10.222.0.76 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1282365 May 12 16:32:31.577651 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-d5d4954e-d40b-4687-b1f5-7e3aa3484b2f req-ba0a52be-5e28-44a2-bff8-8b03bc25a772 service neutron] 10.222.0.76 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1258736 May 12 16:32:31.791956 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-15bc07a8-be02-4282-bec1-b4e8f6c9ba74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '0d335ac4-7c2b-4b4b-a861-de42a599e844', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'floating_ip_address': '172.25.8.240', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'port_id': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4457, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'mac_address': 'fa:16:3e:22:30:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:32:29Z', 'updated_at': '2022-05-12T16:32:29Z', 'revision_number': 0, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ip_address_scope': None}, {'id': '41d05069-1c82-4e1a-9d61-5b015067b725', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'floating_ip_address': '172.25.8.91', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'port_id': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 4454, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'mac_address': 'fa:16:3e:0a:a9:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:29:56Z', 'updated_at': '2022-05-12T16:29:59Z', 'revision_number': 1, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:39Z', 'revision_number': 5, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:32:31.795818 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15bc07a8-be02-4282-bec1-b4e8f6c9ba74 None None] The sync data for ids ['5e022072-e09a-48f5-a3c9-be500ce472bb'] in n-d-841483-1 is: [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '0d335ac4-7c2b-4b4b-a861-de42a599e844', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'floating_ip_address': '172.25.8.240', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'port_id': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4457, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'mac_address': 'fa:16:3e:22:30:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:32:29Z', 'updated_at': '2022-05-12T16:32:29Z', 'revision_number': 0, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ip_address_scope': None}, {'id': '41d05069-1c82-4e1a-9d61-5b015067b725', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'floating_ip_address': '172.25.8.91', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'port_id': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 4454, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'mac_address': 'fa:16:3e:0a:a9:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:29:56Z', 'updated_at': '2022-05-12T16:29:59Z', 'revision_number': 1, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:39Z', 'revision_number': 5, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:32:31.976737 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06afe994-f073-4a85-a1dd-eb803b61159f None None] New status for floating IP 0d335ac4-7c2b-4b4b-a861-de42a599e844: ACTIVE {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:32:33.155458 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:42.948270 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-2d636811-344d-41fa-a40a-94a004f1541b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:44.009336 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:45.476116 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-28cd673d-36b7-449d-a09f-805d30fedcfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:45.962098 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:32:46.207342 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:46.515549 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:48.006977 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:32:55.244658 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2dae51b7-83b7-495b-b97e-85d604191559 req-c074cab0-7b19-4645-97b3-15acf5fd2212 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0468638 May 12 16:32:55.355713 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2dae51b7-83b7-495b-b97e-85d604191559 req-f5230be0-b9f2-490b-b8c5-84081c0b21fe service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0417163 May 12 16:32:55.401785 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2dae51b7-83b7-495b-b97e-85d604191559 req-2a17a79e-8051-45c6-a620-089069fdd56e service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0264139 May 12 16:32:55.566129 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dae51b7-83b7-495b-b97e-85d604191559 req-9c902eb6-482b-420e-8772-5e01f69472e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:32:55.567475 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-2dae51b7-83b7-495b-b97e-85d604191559 req-9c902eb6-482b-420e-8772-5e01f69472e1 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1604912 May 12 16:33:03.158603 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:33:12.950307 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-90aa87c3-b28c-4154-bca4-9e815908bd9a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:33:14.008699 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:33:15.478931 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3df7b674-90f5-4dac-9e54-a81c7558f41c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:33:16.211023 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:33:16.520947 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:33:18.002760 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:33:20.132927 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e1f0d64-26fd-4156-8c00-36fffdb89d2e req-2746d356-30cb-4052-bcb9-c0c0cec4dfa7 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.1890557 May 12 16:33:20.318379 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1f0d64-26fd-4156-8c00-36fffdb89d2e req-62aed53b-5e7e-4faa-b7e6-2b4b769c9ebe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:33:20.319872 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e1f0d64-26fd-4156-8c00-36fffdb89d2e req-62aed53b-5e7e-4faa-b7e6-2b4b769c9ebe service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 1094 time: 0.0817330 May 12 16:33:20.473847 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1f0d64-26fd-4156-8c00-36fffdb89d2e req-36347a03-a7ac-46a8-aa58-6fc8478be99a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:33:20.475992 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e1f0d64-26fd-4156-8c00-36fffdb89d2e req-36347a03-a7ac-46a8-aa58-6fc8478be99a service neutron] 10.222.0.84 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 911 time: 0.1298537 May 12 16:33:20.583260 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e1f0d64-26fd-4156-8c00-36fffdb89d2e req-4e3708c8-ab52-4b77-be62-afa570bec2f9 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23 HTTP/1.1" status: 200 len: 998 time: 0.0984385 May 12 16:33:20.647468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1f0d64-26fd-4156-8c00-36fffdb89d2e req-7a87c5bc-3808-4f31-b79b-fe74abce5630 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:33:20.648875 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e1f0d64-26fd-4156-8c00-36fffdb89d2e req-7a87c5bc-3808-4f31-b79b-fe74abce5630 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 200 len: 849 time: 0.0567498 May 12 16:33:20.729127 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1f0d64-26fd-4156-8c00-36fffdb89d2e req-6e8ae5c8-a045-4809-8b38-c53690328a6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:33:20.730522 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e1f0d64-26fd-4156-8c00-36fffdb89d2e req-6e8ae5c8-a045-4809-8b38-c53690328a6c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=6b3165c5-d574-4d2f-be7c-45593aa36427&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0724752 May 12 16:33:20.874885 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e1f0d64-26fd-4156-8c00-36fffdb89d2e req-17873042-be4f-409e-bde9-2e644632af81 service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1351395 May 12 16:33:21.050773 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-1e1f0d64-26fd-4156-8c00-36fffdb89d2e req-c95f51e4-7b6b-4ac3-a925-de9c2c6fde9d service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1664376 May 12 16:33:22.961507 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:33:33.169713 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:33:42.952740 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3e236fec-f85a-44f8-8e92-68c1f1a5af8d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:33:44.023371 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:33:45.481665 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1a992945-08b4-425e-9431-b444e826a83d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:33:46.213365 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:33:46.520709 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:33:48.004816 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:33:56.342434 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e46bd6ce-b12c-43d5-a48a-538661ec8703 req-0b848659-5353-4879-a472-773de8047579 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.1138012 May 12 16:33:56.434814 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e46bd6ce-b12c-43d5-a48a-538661ec8703 req-3780a0f3-2fc9-4368-8610-bef895e44ac5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:33:56.436297 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e46bd6ce-b12c-43d5-a48a-538661ec8703 req-3780a0f3-2fc9-4368-8610-bef895e44ac5 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 1097 time: 0.0723870 May 12 16:33:56.576693 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e46bd6ce-b12c-43d5-a48a-538661ec8703 req-5350cd7f-aeae-480c-82ca-c76432b65617 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:33:56.578048 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e46bd6ce-b12c-43d5-a48a-538661ec8703 req-5350cd7f-aeae-480c-82ca-c76432b65617 service neutron] 10.222.0.76 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 911 time: 0.1234837 May 12 16:33:56.677518 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e46bd6ce-b12c-43d5-a48a-538661ec8703 req-d2c7042c-7032-4c3d-9420-1850699222c5 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a5c3a8b6-34d8-4b81-9cfa-ff208e057292 HTTP/1.1" status: 200 len: 1002 time: 0.0938580 May 12 16:33:56.737306 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e46bd6ce-b12c-43d5-a48a-538661ec8703 req-78b8ed63-c4ff-4678-8fbe-a6904d58d864 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:33:56.738709 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e46bd6ce-b12c-43d5-a48a-538661ec8703 req-78b8ed63-c4ff-4678-8fbe-a6904d58d864 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 200 len: 849 time: 0.0561736 May 12 16:33:56.811003 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e46bd6ce-b12c-43d5-a48a-538661ec8703 req-5a126266-dc53-4535-a79f-875378daa8a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:33:56.812471 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e46bd6ce-b12c-43d5-a48a-538661ec8703 req-5a126266-dc53-4535-a79f-875378daa8a9 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=6b3165c5-d574-4d2f-be7c-45593aa36427&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0681157 May 12 16:33:56.939801 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e46bd6ce-b12c-43d5-a48a-538661ec8703 req-f7434e65-52e9-4d6a-b1ac-b48059461271 service neutron] 10.222.0.76 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1216199 May 12 16:33:57.067947 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e46bd6ce-b12c-43d5-a48a-538661ec8703 req-1c52cf50-f45c-4be8-a1dc-eeff736465c8 service neutron] 10.222.0.76 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1223962 May 12 16:33:59.961067 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:34:03.170827 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:06.424081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a5c3a8b6-34d8-4b81-9cfa-ff208e057292 details requested by agent hyperv_n-h2-841483-1 with host n-h2-841483-1 {{(pid=88153) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 12 16:34:06.595284 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a5c3a8b6-34d8-4b81-9cfa-ff208e057292, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:34:06.609694 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Returning: {'device': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'port_id': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'mac_address': 'fa:16:3e:22:30:f7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 566, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=88153) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 12 16:34:06.668414 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:06.686175 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id a5c3a8b6-34d8-4b81-9cfa-ff208e057292 {{(pid=88153) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} May 12 16:34:06.701015 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a5c3a8b6-34d8-4b81-9cfa-ff208e057292, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:34:06.705686 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:06.775875 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,revision_number=6']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:06.785493 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] get_ports_and_sgs() called for port_ids ['a5c3a8b6-34d8-4b81-9cfa-ff208e057292'] {{(pid=88153) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 12 16:34:06.821688 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:06.822024 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:06.822351 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:06.822674 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:06.823008 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:06.823308 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:06.823621 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:06.823932 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:06.824241 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:06.824551 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:06.824860 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:06.825304 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88153) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:08.438166 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a5c3a8b6-34d8-4b81-9cfa-ff208e057292 up at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 12 16:34:08.510345 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.provisioning_blocks [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Provisioning complete for port a5c3a8b6-34d8-4b81-9cfa-ff208e057292 triggered by entity L2. {{(pid=88153) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 12 16:34:08.510713 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3565301'] for port, provisioning_complete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:08.656203 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:08.689149 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:34:08.702081 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a5c3a8b6-34d8-4b81-9cfa-ff208e057292, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:34:08.708495 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:08.756567 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8fab439b-ee3a-4878-bd19-a77ec6028e8d'] response: {'server_uuid': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'code': 200} May 12 16:34:08.785120 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,revision_number=7']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:12.960402 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b05c4141-4ef3-4069-a84c-ed40f2a75f89 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:14.047904 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:15.485307 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-cf2b2590-fcfe-4b6a-9399-3435ed4b7b5e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:16.217882 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:16.314282 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58030) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:16.514137 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Deleting port a5a0ce7a-7793-4bed-b490-e05fd59ff83f {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:34:16.514463 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:16.524678 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:16.695276 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:16.695474 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:16.826575 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Calling delete_port for a5a0ce7a-7793-4bed-b490-e05fd59ff83f owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:34:16.983728 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:17.033989 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event deleted for resources: {'Port': ['ID=a5a0ce7a-7793-4bed-b490-e05fd59ff83f,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:17.074611 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:17.074955 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:17.075289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:17.075619 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:17.075948 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:17.076269 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:17.076871 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:17.077200 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:17.077553 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:17.079100 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:17.079432 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:17.079757 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88152) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:17.146029 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:17.146401 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Floating IP 0d335ac4-7c2b-4b4b-a861-de42a599e844 disassociated (deleted). External IP: 172.25.8.240, port: a5c3a8b6-34d8-4b81-9cfa-ff208e057292. May 12 16:34:17.620289 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Router 5e022072-e09a-48f5-a3c9-be500ce472bb has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:34:17.808941 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:34:17.819161 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f1c580b-c485-4c1e-85c1-9755b63d9b4c None None] Sync routers for ids ['5e022072-e09a-48f5-a3c9-be500ce472bb'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:34:17.823105 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:17.828464 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f1c580b-c485-4c1e-85c1-9755b63d9b4c None None] Routers {'5e022072-e09a-48f5-a3c9-be500ce472bb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:34:17.829154 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7f1c580b-c485-4c1e-85c1-9755b63d9b4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:34:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5e022072-e09a-48f5-a3c9-be500ce472bb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:17.885007 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-dc7b40f0-9996-41bf-b27e-ed3a867f855d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "DELETE /v2.0/floatingips/0d335ac4-7c2b-4b4b-a861-de42a599e844 HTTP/1.1" status: 204 len: 168 time: 1.5694363 May 12 16:34:17.885443 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'tag': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:34:18.002943 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b9dac1ec-210f-40b7-8a76-0aea54966074'] response: {'name': 'network-changed', 'server_uuid': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'tag': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'status': 'completed', 'code': 200} May 12 16:34:18.015706 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:18.083845 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-7f1c580b-c485-4c1e-85c1-9755b63d9b4c None None] Set router 5e022072-e09a-48f5-a3c9-be500ce472bb gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:34:18.233030 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c6f828c-8425-452d-b3ef-bb9f20daed36 req-ca2b3d39-0362-454c-9bbe-23f387b1f6aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:18.236017 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c6f828c-8425-452d-b3ef-bb9f20daed36 req-ca2b3d39-0362-454c-9bbe-23f387b1f6aa service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 1097 time: 0.2095282 May 12 16:34:18.362696 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32004381-122e-46cf-ba44-e9f28df916da req-b06514aa-a0a2-4195-8ac6-fd0edfd6abdd tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:18.363676 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-32004381-122e-46cf-ba44-e9f28df916da req-b06514aa-a0a2-4195-8ac6-fd0edfd6abdd tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Synchronizing usage tracker for tenant:db6d55e7484248b38b40fa3b29a09ab9 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:34:18.381697 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-32004381-122e-46cf-ba44-e9f28df916da req-b06514aa-a0a2-4195-8ac6-fd0edfd6abdd tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Unset dirty status for tenant:db6d55e7484248b38b40fa3b29a09ab9 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:34:18.383193 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32004381-122e-46cf-ba44-e9f28df916da req-b06514aa-a0a2-4195-8ac6-fd0edfd6abdd tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 946 time: 0.1585875 May 12 16:34:18.388176 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c6f828c-8425-452d-b3ef-bb9f20daed36 req-20b5fad7-6599-458d-b68b-4b0d7fd2e965 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:18.389662 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c6f828c-8425-452d-b3ef-bb9f20daed36 req-20b5fad7-6599-458d-b68b-4b0d7fd2e965 service neutron] 10.222.0.76 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 911 time: 0.1446548 May 12 16:34:18.441376 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-32004381-122e-46cf-ba44-e9f28df916da req-7747e7cd-29ac-46c1-9d01-ad18baa8d360 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509996 May 12 16:34:18.457730 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7f1c580b-c485-4c1e-85c1-9755b63d9b4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '41d05069-1c82-4e1a-9d61-5b015067b725', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'floating_ip_address': '172.25.8.91', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'port_id': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 4454, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'mac_address': 'fa:16:3e:0a:a9:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:29:56Z', 'updated_at': '2022-05-12T16:29:59Z', 'revision_number': 1, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:39Z', 'revision_number': 5, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:18.462167 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f1c580b-c485-4c1e-85c1-9755b63d9b4c None None] Checking router: 5e022072-e09a-48f5-a3c9-be500ce472bb for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:34:18.462442 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c6f828c-8425-452d-b3ef-bb9f20daed36 req-9611cee3-e196-4ccd-9ad7-b60eb5ecd973 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a5c3a8b6-34d8-4b81-9cfa-ff208e057292 HTTP/1.1" status: 200 len: 217 time: 0.0666583 May 12 16:34:18.471370 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f1c580b-c485-4c1e-85c1-9755b63d9b4c None None] Routers {'5e022072-e09a-48f5-a3c9-be500ce472bb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:34:18.472033 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7f1c580b-c485-4c1e-85c1-9755b63d9b4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:34:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5e022072-e09a-48f5-a3c9-be500ce472bb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:18.501381 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a5c3a8b6-34d8-4b81-9cfa-ff208e057292 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:34:18.525705 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c6f828c-8425-452d-b3ef-bb9f20daed36 req-f9fbef8d-b39e-4c25-8805-a83339f7ad8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:18.527192 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c6f828c-8425-452d-b3ef-bb9f20daed36 req-f9fbef8d-b39e-4c25-8805-a83339f7ad8a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 200 len: 849 time: 0.0579123 May 12 16:34:18.607006 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c6f828c-8425-452d-b3ef-bb9f20daed36 req-25f7623c-2cfe-42f7-a862-6ee5c0be288d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:18.608493 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c6f828c-8425-452d-b3ef-bb9f20daed36 req-25f7623c-2cfe-42f7-a862-6ee5c0be288d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=6b3165c5-d574-4d2f-be7c-45593aa36427&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0749516 May 12 16:34:18.619707 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-587607'] for port, before_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:18.653294 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] For port a5c3a8b6-34d8-4b81-9cfa-ff208e057292, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:34:18.654620 n-d-841483-1 neutron-server[88153]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292'}] {{(pid=88153) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:34:18.661624 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8768026839911', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8768026450032', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8768026450077'] for port, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:18.662251 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-7f1c580b-c485-4c1e-85c1-9755b63d9b4c None None] Set router 5e022072-e09a-48f5-a3c9-be500ce472bb gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:34:18.725177 n-d-841483-1 neutron-server[88153]: INFO neutron.notifiers.nova [-] Nova event matching ['req-411151e9-ec86-41c0-bc24-4cd319b1f858'] response: {'server_uuid': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'code': 200} May 12 16:34:18.732938 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Pushing event updated for resources: {'Port': ['ID=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,revision_number=8']} {{(pid=88153) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:18.750662 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c6f828c-8425-452d-b3ef-bb9f20daed36 req-a890d91a-4af9-4e86-96d4-30fe4ba212f3 service neutron] 10.222.0.76 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1349766 May 12 16:34:18.883499 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-3c6f828c-8425-452d-b3ef-bb9f20daed36 req-8ac9a909-fa54-4993-afcc-1a7143789a41 service neutron] 10.222.0.76 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1268394 May 12 16:34:19.023907 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7f1c580b-c485-4c1e-85c1-9755b63d9b4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '41d05069-1c82-4e1a-9d61-5b015067b725', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'floating_ip_address': '172.25.8.91', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'port_id': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 4454, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'mac_address': 'fa:16:3e:0a:a9:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:29:56Z', 'updated_at': '2022-05-12T16:29:59Z', 'revision_number': 1, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:39Z', 'revision_number': 5, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:19.027747 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f1c580b-c485-4c1e-85c1-9755b63d9b4c None None] The sync data for ids ['5e022072-e09a-48f5-a3c9-be500ce472bb'] in n-d-841483-1 is: [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_floatingips': [{'id': '41d05069-1c82-4e1a-9d61-5b015067b725', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'floating_ip_address': '172.25.8.91', 'floating_network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'router_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'port_id': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 4454, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'mac_address': 'fa:16:3e:0a:a9:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-05-12T16:29:56Z', 'updated_at': '2022-05-12T16:29:59Z', 'revision_number': 1, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:39Z', 'revision_number': 5, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:34:19.283634 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d192240f-9189-4ba8-ac46-70774c0cd645 None None] New status for floating IP 0d335ac4-7c2b-4b4b-a861-de42a599e844: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:34:19.621114 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c16df59b-0f37-41ac-a47a-311cc29c1893 req-22403409-d6d5-430d-808e-7f1621eeda65 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:19.622512 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c16df59b-0f37-41ac-a47a-311cc29c1893 req-22403409-d6d5-430d-808e-7f1621eeda65 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 944 time: 0.0802841 May 12 16:34:19.667499 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-c16df59b-0f37-41ac-a47a-311cc29c1893 req-99155456-fd4b-492f-96d1-b65645924195 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393932 May 12 16:34:19.719982 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae7ff21c-4207-4537-b7e0-9e619251e34c req-8dd50d2f-2236-4c31-b7ea-f59547d966df tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:19.720828 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ae7ff21c-4207-4537-b7e0-9e619251e34c req-8dd50d2f-2236-4c31-b7ea-f59547d966df tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Synchronizing usage tracker for tenant:db6d55e7484248b38b40fa3b29a09ab9 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:34:19.732741 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-ae7ff21c-4207-4537-b7e0-9e619251e34c req-8dd50d2f-2236-4c31-b7ea-f59547d966df tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Unset dirty status for tenant:db6d55e7484248b38b40fa3b29a09ab9 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:34:19.733881 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae7ff21c-4207-4537-b7e0-9e619251e34c req-8dd50d2f-2236-4c31-b7ea-f59547d966df tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.76 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 944 time: 0.0963461 May 12 16:34:19.801108 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-ae7ff21c-4207-4537-b7e0-9e619251e34c req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Deleting port a5c3a8b6-34d8-4b81-9cfa-ff208e057292 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:34:19.801469 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ae7ff21c-4207-4537-b7e0-9e619251e34c req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:20.046446 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-ae7ff21c-4207-4537-b7e0-9e619251e34c req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] For port a5c3a8b6-34d8-4b81-9cfa-ff208e057292, host n-h2-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-841483-1',level=0,port_id=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:34:20.046809 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ae7ff21c-4207-4537-b7e0-9e619251e34c req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:20.171334 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-ae7ff21c-4207-4537-b7e0-9e619251e34c req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Calling delete_port for a5c3a8b6-34d8-4b81-9cfa-ff208e057292 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:34:20.312504 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ae7ff21c-4207-4537-b7e0-9e619251e34c req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:20.367196 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event deleted for resources: {'Port': ['ID=a5c3a8b6-34d8-4b81-9cfa-ff208e057292,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:20.406862 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:20.407202 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:20.407541 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:20.407871 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:20.408201 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:20.408526 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:20.408846 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:20.409165 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:20.409516 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:20.409835 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:20.410152 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:20.410468 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-841483-1 {{(pid=88151) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 12 16:34:20.452629 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae7ff21c-4207-4537-b7e0-9e619251e34c req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] No DVR routers for this DVR port a5c3a8b6-34d8-4b81-9cfa-ff208e057292 on host n-h2-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:34:20.455385 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-ae7ff21c-4207-4537-b7e0-9e619251e34c req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:20.457823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'name': 'network-vif-deleted', 'tag': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:34:20.473662 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-ae7ff21c-4207-4537-b7e0-9e619251e34c req-3905df86-055a-4d61-b87c-9a2c023a905a tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.76 "DELETE /v2.0/ports/a5c3a8b6-34d8-4b81-9cfa-ff208e057292 HTTP/1.1" status: 204 len: 173 time: 0.7349765 May 12 16:34:20.509897 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2a1ccd8b-0a7f-4081-830f-b901418118a4'] response: {'server_uuid': 'dba8bb0e-d476-4e71-9efa-9d40c5480290', 'name': 'network-vif-deleted', 'tag': 'a5c3a8b6-34d8-4b81-9cfa-ff208e057292', 'status': 'completed', 'code': 200} May 12 16:34:20.844160 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-7f747c6f-65b8-4f25-a528-54e48751c7f0 req-fdd80562-d1b8-4ae7-9c22-daa3e5d87eb3 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=dba8bb0e-d476-4e71-9efa-9d40c5480290 HTTP/1.1" status: 200 len: 210 time: 0.0492535 May 12 16:34:21.165324 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b4d3fdfb-b147-4479-980b-73ec745ecd2c req-7de863bc-4384-40da-bca6-23d4bf77c4cf service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 273 time: 0.2279654 May 12 16:34:21.336015 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d3fdfb-b147-4479-980b-73ec745ecd2c req-65724dd5-35d7-4668-8a68-286eab50e00f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:21.337475 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b4d3fdfb-b147-4479-980b-73ec745ecd2c req-65724dd5-35d7-4668-8a68-286eab50e00f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 1094 time: 0.0696442 May 12 16:34:21.486751 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d3fdfb-b147-4479-980b-73ec745ecd2c req-6b05a7e8-33c6-4ffc-a4ca-f08c4db191eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:21.488171 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b4d3fdfb-b147-4479-980b-73ec745ecd2c req-6b05a7e8-33c6-4ffc-a4ca-f08c4db191eb service neutron] 10.222.0.84 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 911 time: 0.1267536 May 12 16:34:21.595096 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b4d3fdfb-b147-4479-980b-73ec745ecd2c req-c85c3ec5-da3a-4dbd-817d-da98a3b7f87d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23 HTTP/1.1" status: 200 len: 998 time: 0.0966725 May 12 16:34:21.662510 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d3fdfb-b147-4479-980b-73ec745ecd2c req-a94e32aa-1c13-4f06-8b84-4beaa8ba4902 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:21.663921 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b4d3fdfb-b147-4479-980b-73ec745ecd2c req-a94e32aa-1c13-4f06-8b84-4beaa8ba4902 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 200 len: 849 time: 0.0594521 May 12 16:34:21.741036 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d3fdfb-b147-4479-980b-73ec745ecd2c req-328a2ac0-a079-483b-8927-3fa92d4e1b29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:21.742503 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b4d3fdfb-b147-4479-980b-73ec745ecd2c req-328a2ac0-a079-483b-8927-3fa92d4e1b29 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=6b3165c5-d574-4d2f-be7c-45593aa36427&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0696199 May 12 16:34:21.882482 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b4d3fdfb-b147-4479-980b-73ec745ecd2c req-3b369999-19ab-461a-84b6-3e26523534ee service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1303673 May 12 16:34:22.035789 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-b4d3fdfb-b147-4479-980b-73ec745ecd2c req-369192e7-22f6-4fea-a7d9-90a531ee6f88 service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1440213 May 12 16:34:22.504557 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a5c3a8b6-34d8-4b81-9cfa-ff208e057292 no longer exists at agent hyperv_n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:34:22.533278 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58102) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:22.544470 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] No Port match for: a5c3a8b6-34d8-4b81-9cfa-ff208e057292 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:34:22.544812 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Device a5c3a8b6-34d8-4b81-9cfa-ff208e057292 not bound to the agent host n-h2-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:34:22.738454 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-acc184f7-579c-4ded-938d-931b8d4b071f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Deleting port 2a6d2abf-7782-49b0-9093-5e9a94abc7ce {{(pid=88152) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:34:22.738789 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acc184f7-579c-4ded-938d-931b8d4b071f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:22.907386 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acc184f7-579c-4ded-938d-931b8d4b071f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:22.907703 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acc184f7-579c-4ded-938d-931b8d4b071f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:23.034270 n-d-841483-1 neutron-server[88152]: DEBUG neutron.plugins.ml2.plugin [None req-acc184f7-579c-4ded-938d-931b8d4b071f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Calling delete_port for 2a6d2abf-7782-49b0-9093-5e9a94abc7ce owned by network:floatingip {{(pid=88152) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:34:23.185657 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acc184f7-579c-4ded-938d-931b8d4b071f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28164185'] for port, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:23.235661 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acc184f7-579c-4ded-938d-931b8d4b071f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event deleted for resources: {'Port': ['ID=2a6d2abf-7782-49b0-9093-5e9a94abc7ce,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:23.331384 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acc184f7-579c-4ded-938d-931b8d4b071f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for floatingip, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:23.331629 n-d-841483-1 neutron-server[88152]: INFO neutron.db.l3_db [None req-acc184f7-579c-4ded-938d-931b8d4b071f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Floating IP 41d05069-1c82-4e1a-9d61-5b015067b725 disassociated (deleted). External IP: 172.25.8.91, port: 2d83b211-5f7e-4aca-bc2e-f6299dc94c23. May 12 16:34:23.786591 n-d-841483-1 neutron-server[88152]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-acc184f7-579c-4ded-938d-931b8d4b071f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Router 5e022072-e09a-48f5-a3c9-be500ce472bb has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88152) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:34:23.962555 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-acc184f7-579c-4ded-938d-931b8d4b071f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88152) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:34:23.973582 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bd847da-e385-4d55-abf8-64f924667f4d None None] Sync routers for ids ['5e022072-e09a-48f5-a3c9-be500ce472bb'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:34:23.978686 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-acc184f7-579c-4ded-938d-931b8d4b071f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for floatingip, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:23.982566 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bd847da-e385-4d55-abf8-64f924667f4d None None] Routers {'5e022072-e09a-48f5-a3c9-be500ce472bb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:34:23.983162 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7bd847da-e385-4d55-abf8-64f924667f4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:34:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5e022072-e09a-48f5-a3c9-be500ce472bb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:24.036092 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-acc184f7-579c-4ded-938d-931b8d4b071f tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "DELETE /v2.0/floatingips/41d05069-1c82-4e1a-9d61-5b015067b725 HTTP/1.1" status: 204 len: 168 time: 1.5016344 May 12 16:34:24.036727 n-d-841483-1 neutron-server[88152]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'tag': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23'}] {{(pid=88152) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:34:24.082206 n-d-841483-1 neutron-server[88152]: INFO neutron.notifiers.nova [-] Nova event matching ['req-03e52abb-fb61-4ae6-a549-bc34e7cf5dcd'] response: {'name': 'network-changed', 'server_uuid': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'tag': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'status': 'completed', 'code': 200} May 12 16:34:24.169249 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-7bd847da-e385-4d55-abf8-64f924667f4d None None] Set router 5e022072-e09a-48f5-a3c9-be500ce472bb gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:34:24.206264 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa5f5341-30a7-4d49-8d45-8f2f1e86fe9d req-760c3d94-502f-4738-b863-4ce46937ebae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:24.207735 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-aa5f5341-30a7-4d49-8d45-8f2f1e86fe9d req-760c3d94-502f-4738-b863-4ce46937ebae service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 1094 time: 0.0716305 May 12 16:34:24.373875 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa5f5341-30a7-4d49-8d45-8f2f1e86fe9d req-46bce6ae-8f5a-49a4-8291-b822830c5076 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:24.375421 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-aa5f5341-30a7-4d49-8d45-8f2f1e86fe9d req-46bce6ae-8f5a-49a4-8291-b822830c5076 service neutron] 10.222.0.84 "GET /v2.0/networks?id=6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 200 len: 911 time: 0.1586728 May 12 16:34:24.447274 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-aa5f5341-30a7-4d49-8d45-8f2f1e86fe9d req-52d83615-50d2-4003-94ce-3dc79cd69378 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23 HTTP/1.1" status: 200 len: 217 time: 0.0646019 May 12 16:34:24.489792 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc43e90e-e338-4990-be44-2a597cfc1c8f req-93340bdf-1170-4bb6-b766-2ec87b2e1c28 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:24.490784 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-fc43e90e-e338-4990-be44-2a597cfc1c8f req-93340bdf-1170-4bb6-b766-2ec87b2e1c28 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Synchronizing usage tracker for tenant:db6d55e7484248b38b40fa3b29a09ab9 on resource:port {{(pid=88152) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:34:24.510694 n-d-841483-1 neutron-server[88152]: DEBUG neutron.quota.resource [req-fc43e90e-e338-4990-be44-2a597cfc1c8f req-93340bdf-1170-4bb6-b766-2ec87b2e1c28 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Unset dirty status for tenant:db6d55e7484248b38b40fa3b29a09ab9 on resource:port {{(pid=88152) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:34:24.512001 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc43e90e-e338-4990-be44-2a597cfc1c8f req-93340bdf-1170-4bb6-b766-2ec87b2e1c28 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 943 time: 0.1574321 May 12 16:34:24.521053 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa5f5341-30a7-4d49-8d45-8f2f1e86fe9d req-7cfa3eec-807a-4591-95fe-35ef1b6a2f18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:24.522525 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-aa5f5341-30a7-4d49-8d45-8f2f1e86fe9d req-7cfa3eec-807a-4591-95fe-35ef1b6a2f18 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 200 len: 849 time: 0.0683455 May 12 16:34:24.540472 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7bd847da-e385-4d55-abf8-64f924667f4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:39Z', 'revision_number': 5, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:24.544244 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bd847da-e385-4d55-abf8-64f924667f4d None None] Checking router: 5e022072-e09a-48f5-a3c9-be500ce472bb for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:34:24.552793 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bd847da-e385-4d55-abf8-64f924667f4d None None] Routers {'5e022072-e09a-48f5-a3c9-be500ce472bb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:34:24.553406 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7bd847da-e385-4d55-abf8-64f924667f4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:34:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5e022072-e09a-48f5-a3c9-be500ce472bb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:24.560285 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-fc43e90e-e338-4990-be44-2a597cfc1c8f req-6a60c1e9-7a22-4faf-a5cf-9afd511e8704 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402379 May 12 16:34:24.603453 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa5f5341-30a7-4d49-8d45-8f2f1e86fe9d req-dc7f510d-7959-420b-9c19-610bacf2e1f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:24.604924 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-aa5f5341-30a7-4d49-8d45-8f2f1e86fe9d req-dc7f510d-7959-420b-9c19-610bacf2e1f9 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=6b3165c5-d574-4d2f-be7c-45593aa36427&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0757163 May 12 16:34:24.729961 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-7bd847da-e385-4d55-abf8-64f924667f4d None None] Set router 5e022072-e09a-48f5-a3c9-be500ce472bb gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:34:24.738755 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-aa5f5341-30a7-4d49-8d45-8f2f1e86fe9d req-32b4271b-f072-4910-80b3-43e3a214fd1e service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1270394 May 12 16:34:24.869717 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-aa5f5341-30a7-4d49-8d45-8f2f1e86fe9d req-8cf062f1-debd-4542-a71c-b6a17123ef2d service neutron] 10.222.0.84 "GET /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1243865 May 12 16:34:25.039839 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-7bd847da-e385-4d55-abf8-64f924667f4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:39Z', 'revision_number': 5, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:25.043678 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bd847da-e385-4d55-abf8-64f924667f4d None None] The sync data for ids ['5e022072-e09a-48f5-a3c9-be500ce472bb'] in n-d-841483-1 is: [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:33Z', 'revision_number': 4, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1', '_interfaces': [{'id': '1273325e-078d-4d3b-a939-25ae1bdcef89', 'name': '', 'network_id': '6b3165c5-d574-4d2f-be7c-45593aa36427', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'mac_address': 'fa:16:3e:bf:94:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4430, 'fixed_ips': [{'subnet_id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:32Z', 'updated_at': '2022-05-12T16:29:39Z', 'revision_number': 5, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'subnets': [{'id': 'f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:34:25.253606 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-652ccdce-1cae-4826-a396-268b17ec1cea None None] New status for floating IP 41d05069-1c82-4e1a-9d61-5b015067b725: DOWN {{(pid=88153) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 12 16:34:25.754380 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84499268-e638-4e3f-8f91-2a9650621d6b req-6dc748b8-ab22-43c5-8b0f-9cb5803a1aef tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:25.755813 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-84499268-e638-4e3f-8f91-2a9650621d6b req-6dc748b8-ab22-43c5-8b0f-9cb5803a1aef tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 943 time: 0.0825706 May 12 16:34:25.799131 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-84499268-e638-4e3f-8f91-2a9650621d6b req-b3bb46ef-8503-4453-bf0e-cb618fb2857d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376718 May 12 16:34:26.342067 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f7f507e-c74a-4f41-b129-1650f95439ce req-b435c4ea-9c1b-4c60-bf39-e25afdcdddf2 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:26.342858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5f7f507e-c74a-4f41-b129-1650f95439ce req-b435c4ea-9c1b-4c60-bf39-e25afdcdddf2 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Synchronizing usage tracker for tenant:db6d55e7484248b38b40fa3b29a09ab9 on resource:port {{(pid=88151) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 12 16:34:26.354308 n-d-841483-1 neutron-server[88151]: DEBUG neutron.quota.resource [req-5f7f507e-c74a-4f41-b129-1650f95439ce req-b435c4ea-9c1b-4c60-bf39-e25afdcdddf2 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Unset dirty status for tenant:db6d55e7484248b38b40fa3b29a09ab9 on resource:port {{(pid=88151) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 12 16:34:26.355373 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5f7f507e-c74a-4f41-b129-1650f95439ce req-b435c4ea-9c1b-4c60-bf39-e25afdcdddf2 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.84 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 943 time: 0.0915320 May 12 16:34:26.540046 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-5f7f507e-c74a-4f41-b129-1650f95439ce req-2e60ade0-b8a9-4db6-bb70-f72307623a0d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Deleting port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:34:26.540300 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5f7f507e-c74a-4f41-b129-1650f95439ce req-2e60ade0-b8a9-4db6-bb70-f72307623a0d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:26.785712 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [req-5f7f507e-c74a-4f41-b129-1650f95439ce req-2e60ade0-b8a9-4db6-bb70-f72307623a0d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] For port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23, host n-h1-841483-1, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-841483-1',level=0,port_id=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:34:26.786069 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5f7f507e-c74a-4f41-b129-1650f95439ce req-2e60ade0-b8a9-4db6-bb70-f72307623a0d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:26.909161 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [req-5f7f507e-c74a-4f41-b129-1650f95439ce req-2e60ade0-b8a9-4db6-bb70-f72307623a0d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Calling delete_port for 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 owned by compute:nova {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:34:26.982908 n-d-841483-1 neutron-server[88152]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e16a19-3d96-4b76-a108-5bbda742bd85 req-f8ae3018-c14d-42f6-b223-d5c97a91b528 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=88152) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:26.985163 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3e16a19-3d96-4b76-a108-5bbda742bd85 req-f8ae3018-c14d-42f6-b223-d5c97a91b528 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f9212b4-a5fc-4499-9585-439d1a263b26 HTTP/1.1" status: 200 len: 943 time: 0.0794148 May 12 16:34:27.032910 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [req-f3e16a19-3d96-4b76-a108-5bbda742bd85 req-4ca472e0-ab60-40b5-b031-60c385e677ad tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "GET /v2.0/security-groups?id=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421748 May 12 16:34:27.056059 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5f7f507e-c74a-4f41-b129-1650f95439ce req-2e60ade0-b8a9-4db6-bb70-f72307623a0d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:27.105844 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e60ade0-b8a9-4db6-bb70-f72307623a0d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event deleted for resources: {'Port': ['ID=2d83b211-5f7e-4aca-bc2e-f6299dc94c23,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:27.182493 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [req-5f7f507e-c74a-4f41-b129-1650f95439ce req-2e60ade0-b8a9-4db6-bb70-f72307623a0d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] No DVR routers for this DVR port 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 on host n-h1-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:34:27.184981 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [req-5f7f507e-c74a-4f41-b129-1650f95439ce req-2e60ade0-b8a9-4db6-bb70-f72307623a0d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4183063'] for port, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:27.188181 n-d-841483-1 neutron-server[88151]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'name': 'network-vif-deleted', 'tag': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23'}] {{(pid=88151) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} May 12 16:34:27.203830 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-5f7f507e-c74a-4f41-b129-1650f95439ce req-2e60ade0-b8a9-4db6-bb70-f72307623a0d tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.84 "DELETE /v2.0/ports/2d83b211-5f7e-4aca-bc2e-f6299dc94c23 HTTP/1.1" status: 204 len: 173 time: 0.8406229 May 12 16:34:27.232153 n-d-841483-1 neutron-server[88151]: INFO neutron.notifiers.nova [-] Nova event matching ['req-dec419f1-fe9a-4ec6-89c3-1333d5ab1c0b'] response: {'server_uuid': '4f9212b4-a5fc-4499-9585-439d1a263b26', 'name': 'network-vif-deleted', 'tag': '2d83b211-5f7e-4aca-bc2e-f6299dc94c23', 'status': 'completed', 'code': 200} May 12 16:34:28.127968 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58124) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:28.194423 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea583a0a-0e8e-4f4e-807a-7094165de950 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:28.224024 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea583a0a-0e8e-4f4e-807a-7094165de950 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:28.289141 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea583a0a-0e8e-4f4e-807a-7094165de950 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:28.310400 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea583a0a-0e8e-4f4e-807a-7094165de950 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:28.321170 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ea583a0a-0e8e-4f4e-807a-7094165de950 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:28.324741 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ea583a0a-0e8e-4f4e-807a-7094165de950 tempest-TestSnapshotPattern-2002456845 tempest-TestSnapshotPattern-2002456845-project] 10.222.0.82 "DELETE /v2.0/security-groups/f9d3e9e2-b4e4-44fa-b951-1a2f77dd8d63 HTTP/1.1" status: 204 len: 168 time: 0.1933475 May 12 16:34:28.369272 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58130) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:29.030175 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-49f522d6-fb31-4f25-a02e-4d4f19cb9e78 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:29.493333 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-49f522d6-fb31-4f25-a02e-4d4f19cb9e78 admin admin] Deleting port 1273325e-078d-4d3b-a939-25ae1bdcef89 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:34:29.494007 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-49f522d6-fb31-4f25-a02e-4d4f19cb9e78 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:29.668050 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-49f522d6-fb31-4f25-a02e-4d4f19cb9e78 admin admin] For port 1273325e-078d-4d3b-a939-25ae1bdcef89, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=1273325e-078d-4d3b-a939-25ae1bdcef89,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:34:29.668323 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-49f522d6-fb31-4f25-a02e-4d4f19cb9e78 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:29.795626 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-49f522d6-fb31-4f25-a02e-4d4f19cb9e78 admin admin] Calling delete_port for 1273325e-078d-4d3b-a939-25ae1bdcef89 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:34:30.057607 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-49f522d6-fb31-4f25-a02e-4d4f19cb9e78 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:30.105323 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49f522d6-fb31-4f25-a02e-4d4f19cb9e78 admin admin] Pushing event deleted for resources: {'Port': ['ID=1273325e-078d-4d3b-a939-25ae1bdcef89,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:30.385100 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-49f522d6-fb31-4f25-a02e-4d4f19cb9e78 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:30.859297 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-49f522d6-fb31-4f25-a02e-4d4f19cb9e78 admin admin] Router 5e022072-e09a-48f5-a3c9-be500ce472bb has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:34:31.036900 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-49f522d6-fb31-4f25-a02e-4d4f19cb9e78 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:34:31.045306 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69946b12-8231-4bbf-8cc7-e4364dc60b3b None None] Sync routers for ids ['5e022072-e09a-48f5-a3c9-be500ce472bb'] in n-d-841483-1 {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:34:31.049952 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-49f522d6-fb31-4f25-a02e-4d4f19cb9e78 admin admin] 10.222.0.82 "PUT /v2.0/routers/5e022072-e09a-48f5-a3c9-be500ce472bb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6795895 May 12 16:34:31.052424 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58136) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:31.054993 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69946b12-8231-4bbf-8cc7-e4364dc60b3b None None] Routers {'5e022072-e09a-48f5-a3c9-be500ce472bb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:34:31.055582 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-69946b12-8231-4bbf-8cc7-e4364dc60b3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:34:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5e022072-e09a-48f5-a3c9-be500ce472bb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:31.227855 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:31.230917 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-69946b12-8231-4bbf-8cc7-e4364dc60b3b None None] Set router 5e022072-e09a-48f5-a3c9-be500ce472bb gateway port host: n-d-841483-1 {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:34:31.285423 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 no longer exists at agent hyperv_n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:34:31.323002 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] No Port match for: 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:34:31.323572 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Device 2d83b211-5f7e-4aca-bc2e-f6299dc94c23 not bound to the agent host n-h1-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:34:31.412877 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:31.422964 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] Deleting port de8b681d-853a-4fbe-a5a7-9a1ebf75791a {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:34:31.423298 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:31.517760 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-69946b12-8231-4bbf-8cc7-e4364dc60b3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146'}], 'enable_snat': True}, 'gw_port_id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:34:29Z', 'revision_number': 5, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port': {'id': 'de8b681d-853a-4fbe-a5a7-9a1ebf75791a', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:e1:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4429, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:29:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:31.521557 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69946b12-8231-4bbf-8cc7-e4364dc60b3b None None] Checking router: 5e022072-e09a-48f5-a3c9-be500ce472bb for host: n-d-841483-1 {{(pid=88154) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:34:31.529657 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69946b12-8231-4bbf-8cc7-e4364dc60b3b None None] Routers {'5e022072-e09a-48f5-a3c9-be500ce472bb'} bound to L3 agent in host n-d-841483-1 {{(pid=88154) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:34:31.530240 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-69946b12-8231-4bbf-8cc7-e4364dc60b3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:34:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['5e022072-e09a-48f5-a3c9-be500ce472bb'], 'active': True} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:31.595641 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] For port de8b681d-853a-4fbe-a5a7-9a1ebf75791a, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=de8b681d-853a-4fbe-a5a7-9a1ebf75791a,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:34:31.595993 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:31.709199 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_dvr_db [None req-69946b12-8231-4bbf-8cc7-e4364dc60b3b None None] Set router 5e022072-e09a-48f5-a3c9-be500ce472bb gateway port host: None {{(pid=88154) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:34:31.722524 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] Calling delete_port for de8b681d-853a-4fbe-a5a7-9a1ebf75791a owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:34:31.816154 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.l3_hamode_db [None req-69946b12-8231-4bbf-8cc7-e4364dc60b3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:34:31Z', 'revision_number': 6, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88154) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:31.820295 n-d-841483-1 neutron-server[88154]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69946b12-8231-4bbf-8cc7-e4364dc60b3b None None] The sync data for ids ['5e022072-e09a-48f5-a3c9-be500ce472bb'] in n-d-841483-1 is: [{'id': '5e022072-e09a-48f5-a3c9-be500ce472bb', 'name': 'tempest-TestSnapshotPattern-2068289601-router', 'tenant_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:29Z', 'updated_at': '2022-05-12T16:34:31Z', 'revision_number': 6, 'project_id': 'db6d55e7484248b38b40fa3b29a09ab9', 'gw_port_host': None}] {{(pid=88154) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:34:31.894886 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:31.943823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] Pushing event deleted for resources: {'Port': ['ID=de8b681d-853a-4fbe-a5a7-9a1ebf75791a,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:32.033940 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:32.333439 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:32.335636 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:32.357916 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:32.358549 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5e022072-e09a-48f5-a3c9-be500ce472bb {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:34:32.372467 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:32.373750 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-6ab3b02b-ec6b-4474-9b44-f42e06840ef0 admin admin] 10.222.0.82 "DELETE /v2.0/routers/5e022072-e09a-48f5-a3c9-be500ce472bb HTTP/1.1" status: 204 len: 168 time: 1.3203707 May 12 16:34:32.376636 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58140) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:32.436495 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-ef6cf474-2779-4f93-b68a-dc1b7a876e3c admin admin] Deleting subnet f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:34:32.439903 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef6cf474-2779-4f93-b68a-dc1b7a876e3c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:32.491314 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef6cf474-2779-4f93-b68a-dc1b7a876e3c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:32.572446 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef6cf474-2779-4f93-b68a-dc1b7a876e3c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:32.654231 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef6cf474-2779-4f93-b68a-dc1b7a876e3c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:32.693858 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef6cf474-2779-4f93-b68a-dc1b7a876e3c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:32.703977 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-ef6cf474-2779-4f93-b68a-dc1b7a876e3c admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:32.710486 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f86c29b-1372-4e90-84eb-f85f33e3e19f None None] Network 6b3165c5-d574-4d2f-be7c-45593aa36427 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:34:32.712249 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-ef6cf474-2779-4f93-b68a-dc1b7a876e3c admin admin] 10.222.0.82 "DELETE /v2.0/subnets/f5fbc98a-db7b-41bc-bfbc-ddf0d8a10629 HTTP/1.1" status: 204 len: 168 time: 0.3345835 May 12 16:34:32.714679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58144) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:32.825514 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:32.838883 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Deleting port feee8dab-cd0c-44e7-9e01-4c5f54819533 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:34:32.839228 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:33.008723 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15ecd05f-0699-473c-a75d-7c2c36bb8ccb None None] DHCP port deletion for 6b3165c5-d574-4d2f-be7c-45593aa36427 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:34:33.013018 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-15ecd05f-0699-473c-a75d-7c2c36bb8ccb None None] Deleting port feee8dab-cd0c-44e7-9e01-4c5f54819533 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:34:33.013413 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-15ecd05f-0699-473c-a75d-7c2c36bb8ccb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:33.068109 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] For port feee8dab-cd0c-44e7-9e01-4c5f54819533, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=feee8dab-cd0c-44e7-9e01-4c5f54819533,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:34:33.068682 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:33.145854 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device de8b681d-853a-4fbe-a5a7-9a1ebf75791a no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:34:33.199884 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Calling delete_port for feee8dab-cd0c-44e7-9e01-4c5f54819533 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:34:33.254926 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: de8b681d-853a-4fbe-a5a7-9a1ebf75791a {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:34:33.255262 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device de8b681d-853a-4fbe-a5a7-9a1ebf75791a not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:34:33.255668 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device feee8dab-cd0c-44e7-9e01-4c5f54819533 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:34:33.282199 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:33.306837 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: feee8dab-cd0c-44e7-9e01-4c5f54819533 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:34:33.307157 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device feee8dab-cd0c-44e7-9e01-4c5f54819533 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:34:33.307563 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1273325e-078d-4d3b-a939-25ae1bdcef89 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:34:33.331420 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Pushing event deleted for resources: {'Port': ['ID=feee8dab-cd0c-44e7-9e01-4c5f54819533,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:33.333115 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] No DVR routers for this DVR port feee8dab-cd0c-44e7-9e01-4c5f54819533 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:34:33.344748 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 1273325e-078d-4d3b-a939-25ae1bdcef89 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:34:33.345094 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 1273325e-078d-4d3b-a939-25ae1bdcef89 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:34:33.350158 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:33.352079 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-15ecd05f-0699-473c-a75d-7c2c36bb8ccb None None] For port feee8dab-cd0c-44e7-9e01-4c5f54819533, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=feee8dab-cd0c-44e7-9e01-4c5f54819533,segment=NetworkSegment(ddd0765d-5046-493f-a791-a2865e3d2e7b),segment_id=ddd0765d-5046-493f-a791-a2865e3d2e7b)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:34:33.352464 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-15ecd05f-0699-473c-a75d-7c2c36bb8ccb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:33.451486 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:33.474727 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-15ecd05f-0699-473c-a75d-7c2c36bb8ccb None None] Calling delete_port for feee8dab-cd0c-44e7-9e01-4c5f54819533 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:34:33.476679 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6b3165c5-d574-4d2f-be7c-45593aa36427']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:33.489822 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ddd0765d-5046-493f-a791-a2865e3d2e7b') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:33.490121 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ddd0765d-5046-493f-a791-a2865e3d2e7b') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:33.502779 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:33.519002 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:33.524999 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Releasing vlan 566 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:34:33.525417 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: timer() May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:34:33.543493 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:34:33.551651 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-15ecd05f-0699-473c-a75d-7c2c36bb8ccb None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:34:33.552035 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-15ecd05f-0699-473c-a75d-7c2c36bb8ccb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:34:33.619769 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:33.636270 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:33.646834 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] Pushing event deleted for resources: {'Network': ['ID=6b3165c5-d574-4d2f-be7c-45593aa36427,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:33.660708 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-244d137d-f0ce-4dfc-8d0a-11a0419dbd21 admin admin] 10.222.0.82 "DELETE /v2.0/networks/6b3165c5-d574-4d2f-be7c-45593aa36427 HTTP/1.1" status: 204 len: 168 time: 0.9448929 May 12 16:34:33.663608 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58148) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:34.053428 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-15ecd05f-0699-473c-a75d-7c2c36bb8ccb None None] Deleting port feee8dab-cd0c-44e7-9e01-4c5f54819533 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:34:34.053989 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-15ecd05f-0699-473c-a75d-7c2c36bb8ccb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:34.121934 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-15ecd05f-0699-473c-a75d-7c2c36bb8ccb None None] The port 'feee8dab-cd0c-44e7-9e01-4c5f54819533' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 16:34:34.316896 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bc87365c-908c-4a23-aea2-7076c3bb8ea6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3770439'] for router_interface, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:34.658287 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-bc87365c-908c-4a23-aea2-7076c3bb8ea6 admin admin] Deleting port 64a971da-d9fd-44fc-a49f-baae6fd97131 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:34:34.658543 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bc87365c-908c-4a23-aea2-7076c3bb8ea6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:34.827366 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-bc87365c-908c-4a23-aea2-7076c3bb8ea6 admin admin] For port 64a971da-d9fd-44fc-a49f-baae6fd97131, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=64a971da-d9fd-44fc-a49f-baae6fd97131,segment=NetworkSegment(24125eff-534c-4c84-8123-1a53549449dd),segment_id=24125eff-534c-4c84-8123-1a53549449dd)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:34:34.827733 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bc87365c-908c-4a23-aea2-7076c3bb8ea6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:34.949052 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-bc87365c-908c-4a23-aea2-7076c3bb8ea6 admin admin] Calling delete_port for 64a971da-d9fd-44fc-a49f-baae6fd97131 owned by network:router_interface {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:34:35.122527 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bc87365c-908c-4a23-aea2-7076c3bb8ea6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:35.276709 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc87365c-908c-4a23-aea2-7076c3bb8ea6 admin admin] Pushing event deleted for resources: {'Port': ['ID=64a971da-d9fd-44fc-a49f-baae6fd97131,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:35.550289 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-bc87365c-908c-4a23-aea2-7076c3bb8ea6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3874098', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3784439'] for router_interface, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:35.904292 n-d-841483-1 neutron-server[88151]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bc87365c-908c-4a23-aea2-7076c3bb8ea6 admin admin] Router 259b3e41-831c-46f0-9ea9-3c83a3a53712 has already been hosted by L3 agent 324555f3-f05c-4dea-93a3-cffb1104e23c {{(pid=88151) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 12 16:34:36.081502 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc87365c-908c-4a23-aea2-7076c3bb8ea6 admin admin] Notify agent at l3_agent.n-d-841483-1 the message routers_updated {{(pid=88151) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 12 16:34:36.090029 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4dd8708-f6ac-401c-a09f-ff2261f53b91 None None] Sync routers for ids ['259b3e41-831c-46f0-9ea9-3c83a3a53712'] in n-d-841483-1 {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 12 16:34:36.097058 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-bc87365c-908c-4a23-aea2-7076c3bb8ea6 admin admin] 10.222.0.82 "PUT /v2.0/routers/259b3e41-831c-46f0-9ea9-3c83a3a53712/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4324262 May 12 16:34:36.099472 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58152) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:36.099692 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4dd8708-f6ac-401c-a09f-ff2261f53b91 None None] Routers {'259b3e41-831c-46f0-9ea9-3c83a3a53712'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:34:36.100297 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e4dd8708-f6ac-401c-a09f-ff2261f53b91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:34:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['259b3e41-831c-46f0-9ea9-3c83a3a53712'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:36.275387 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] Notify callbacks [] for router, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:36.277414 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-e4dd8708-f6ac-401c-a09f-ff2261f53b91 None None] Set router 259b3e41-831c-46f0-9ea9-3c83a3a53712 gateway port host: n-d-841483-1 {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:34:36.451456 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:36.461755 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] Deleting port 0118baeb-6e90-4fdc-98b7-afd4a0deba2f {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:34:36.462082 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:36.563731 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e4dd8708-f6ac-401c-a09f-ff2261f53b91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'name': 'tempest-TestSnapshotPattern-1256536562-router', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'external_fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.237'}], 'enable_snat': True}, 'gw_port_id': '0118baeb-6e90-4fdc-98b7-afd4a0deba2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:35Z', 'updated_at': '2022-05-12T16:34:35Z', 'revision_number': 5, 'project_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'gw_port': {'id': '0118baeb-6e90-4fdc-98b7-afd4a0deba2f', 'name': '', 'network_id': '5bff663f-be1e-4c0c-b2e2-d037214cb143', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:49:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4441, 'fixed_ips': [{'subnet_id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'ip_address': '172.25.8.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-841483-1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-05-12T16:29:36Z', 'updated_at': '2022-05-12T16:29:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '9a9fe5f0-4a5e-4d67-842d-7e60d2702213', 'cidr': '172.25.8.0/24', 'gateway_ip': '172.25.8.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-841483-1'}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:36.567869 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4dd8708-f6ac-401c-a09f-ff2261f53b91 None None] Checking router: 259b3e41-831c-46f0-9ea9-3c83a3a53712 for host: n-d-841483-1 {{(pid=88153) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 12 16:34:36.576799 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4dd8708-f6ac-401c-a09f-ff2261f53b91 None None] Routers {'259b3e41-831c-46f0-9ea9-3c83a3a53712'} bound to L3 agent in host n-d-841483-1 {{(pid=88153) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:423}} May 12 16:34:36.578359 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e4dd8708-f6ac-401c-a09f-ff2261f53b91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-841483-1', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-05-12T14:53:15Z,description=,heartbeat_timestamp=2022-05-12T16:34:15Z,host='n-d-841483-1',id=324555f3-f05c-4dea-93a3-cffb1104e23c,load=0,resource_versions=,resources_synced=,started_at=2022-05-12T14:53:15Z,topic='l3_agent')) {'router_ids': ['259b3e41-831c-46f0-9ea9-3c83a3a53712'], 'active': True} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:36.757753 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] For port 0118baeb-6e90-4fdc-98b7-afd4a0deba2f, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=0118baeb-6e90-4fdc-98b7-afd4a0deba2f,segment=NetworkSegment(621d696b-9fdc-4be4-896e-f6734c2e06e4),segment_id=621d696b-9fdc-4be4-896e-f6734c2e06e4)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:34:36.758367 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:36.767865 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_dvr_db [None req-e4dd8708-f6ac-401c-a09f-ff2261f53b91 None None] Set router 259b3e41-831c-46f0-9ea9-3c83a3a53712 gateway port host: None {{(pid=88153) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:875}} May 12 16:34:36.870582 n-d-841483-1 neutron-server[88153]: DEBUG neutron.db.l3_hamode_db [None req-e4dd8708-f6ac-401c-a09f-ff2261f53b91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'name': 'tempest-TestSnapshotPattern-1256536562-router', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:35Z', 'updated_at': '2022-05-12T16:34:36Z', 'revision_number': 6, 'project_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'gw_port_host': None}], 'n-d-841483-1', False) {} {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:36.875103 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4dd8708-f6ac-401c-a09f-ff2261f53b91 None None] The sync data for ids ['259b3e41-831c-46f0-9ea9-3c83a3a53712'] in n-d-841483-1 is: [{'id': '259b3e41-831c-46f0-9ea9-3c83a3a53712', 'name': 'tempest-TestSnapshotPattern-1256536562-router', 'tenant_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-05-12T16:29:35Z', 'updated_at': '2022-05-12T16:34:36Z', 'revision_number': 6, 'project_id': '1964d6d2e49246c5a8ab5ba8bd039d1c', 'gw_port_host': None}] {{(pid=88153) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 12 16:34:36.884678 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] Calling delete_port for 0118baeb-6e90-4fdc-98b7-afd4a0deba2f owned by network:router_gateway {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:34:36.959866 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:34:37.052634 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:37.097738 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] Pushing event deleted for resources: {'Port': ['ID=0118baeb-6e90-4fdc-98b7-afd4a0deba2f,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:37.191822 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3769210'] for router_gateway, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:37.382947 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3770385', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27639'] for router, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:37.385265 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:37.409877 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3773767'] for router, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:37.410725 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] Fanout notify agent at l3_agent the message router_deleted on router 259b3e41-831c-46f0-9ea9-3c83a3a53712 {{(pid=88151) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 12 16:34:37.423342 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] Notify callbacks [] for router, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:37.424454 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-c6f736b1-cee3-4834-8d02-0f3b516e4efa admin admin] 10.222.0.82 "DELETE /v2.0/routers/259b3e41-831c-46f0-9ea9-3c83a3a53712 HTTP/1.1" status: 204 len: 168 time: 1.3240948 May 12 16:34:37.427273 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58156) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:37.486528 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.db_base_plugin_v2 [None req-d0764697-f273-4f61-ae2c-195bd39a07b5 admin admin] Deleting subnet b2e024ba-3685-4f03-a079-a785b6179ea5 {{(pid=88151) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1048}} May 12 16:34:37.489656 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0764697-f273-4f61-ae2c-195bd39a07b5 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:37.541595 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0764697-f273-4f61-ae2c-195bd39a07b5 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28284067'] for subnet, precommit_delete_associations {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:37.621435 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0764697-f273-4f61-ae2c-195bd39a07b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3566139'] for subnet, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:37.670690 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 64a971da-d9fd-44fc-a49f-baae6fd97131 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:34:37.700033 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0764697-f273-4f61-ae2c-195bd39a07b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3566128', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3818711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28283935', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1887821'] for subnet, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:37.716037 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 64a971da-d9fd-44fc-a49f-baae6fd97131 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:34:37.716377 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 64a971da-d9fd-44fc-a49f-baae6fd97131 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:34:37.744113 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-d0764697-f273-4f61-ae2c-195bd39a07b5 admin admin] Notify callbacks [] for subnet, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:37.749712 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ccc4ab0d-df2b-418f-9127-0898b12e51e4 None None] Network c2cf2b76-ee93-4846-9103-01cfe75f0997 requested from n-d-841483-1 {{(pid=88153) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:213}} May 12 16:34:37.752602 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0764697-f273-4f61-ae2c-195bd39a07b5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b2e024ba-3685-4f03-a079-a785b6179ea5,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:37.757156 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-d0764697-f273-4f61-ae2c-195bd39a07b5 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/b2e024ba-3685-4f03-a079-a785b6179ea5 HTTP/1.1" status: 204 len: 168 time: 0.3289020 May 12 16:34:37.759582 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58160) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:37.878489 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3630854'] for network, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:37.889931 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Deleting port 7c5235c1-d3dc-4355-820b-580975c0a590 {{(pid=88151) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:34:37.890267 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:38.065356 n-d-841483-1 neutron-server[88153]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65717108-3815-4f63-81e9-802f675c308e None None] DHCP port deletion for c2cf2b76-ee93-4846-9103-01cfe75f0997 request from n-d-841483-1 {{(pid=88153) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:260}} May 12 16:34:38.070302 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-65717108-3815-4f63-81e9-802f675c308e None None] Deleting port 7c5235c1-d3dc-4355-820b-580975c0a590 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:34:38.070781 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-65717108-3815-4f63-81e9-802f675c308e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:38.116902 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.db [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] For port 7c5235c1-d3dc-4355-820b-580975c0a590, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7c5235c1-d3dc-4355-820b-580975c0a590,segment=NetworkSegment(24125eff-534c-4c84-8123-1a53549449dd),segment_id=24125eff-534c-4c84-8123-1a53549449dd)] {{(pid=88151) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:34:38.117432 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:38.243561 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.plugin [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Calling delete_port for 7c5235c1-d3dc-4355-820b-580975c0a590 owned by network:dhcp {{(pid=88151) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:34:38.286872 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.db [None req-65717108-3815-4f63-81e9-802f675c308e None None] For port 7c5235c1-d3dc-4355-820b-580975c0a590, host n-d-841483-1, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-841483-1',level=0,port_id=7c5235c1-d3dc-4355-820b-580975c0a590,segment=NetworkSegment(24125eff-534c-4c84-8123-1a53549449dd),segment_id=24125eff-534c-4c84-8123-1a53549449dd)] {{(pid=88153) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 12 16:34:38.287257 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-65717108-3815-4f63-81e9-802f675c308e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3770241'] for port, precommit_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:38.330418 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-587540', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-32912', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8768026839938', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8768026450023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28274670'] for port, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:38.378829 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Pushing event deleted for resources: {'Port': ['ID=7c5235c1-d3dc-4355-820b-580975c0a590,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:38.380619 n-d-841483-1 neutron-server[88151]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] No DVR routers for this DVR port 7c5235c1-d3dc-4355-820b-580975c0a590 on host n-d-841483-1 {{(pid=88151) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 12 16:34:38.416957 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-65717108-3815-4f63-81e9-802f675c308e None None] Calling delete_port for 7c5235c1-d3dc-4355-820b-580975c0a590 owned by network:dhcp {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1987}} May 12 16:34:38.490808 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.db.api [None req-65717108-3815-4f63-81e9-802f675c308e None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=88153) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 12 16:34:38.491166 n-d-841483-1 neutron-server[88153]: DEBUG oslo_db.api [None req-65717108-3815-4f63-81e9-802f675c308e None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=88153) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 12 16:34:38.598747 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3565690', 'neutron.services.segments.db._delete_segments_for_network-8768026983042'] for network, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:38.626034 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c2cf2b76-ee93-4846-9103-01cfe75f0997']}} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:38.637905 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '24125eff-534c-4c84-8123-1a53549449dd') {'for_net_delete': True} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:38.638204 n-d-841483-1 neutron-server[88151]: DEBUG neutron.services.segments.db [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '24125eff-534c-4c84-8123-1a53549449dd') {} {{(pid=88151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 12 16:34:38.650766 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8768026986653', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28284058'] for segment, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:38.667491 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3603557'] for segment, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:38.673618 n-d-841483-1 neutron-server[88151]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Releasing vlan 588 on physical network physnet1 to pool {{(pid=88151) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 12 16:34:38.674018 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-3603578', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28274621'] for segment, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: Traceback (most recent call last): May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: timer() May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: cb(*args, **kw) May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/common/utils.py", line 912, in wrapper May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: return func(*args, **kwargs) May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: self._notify() May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: self.callback(batched_events) May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: event.method(event) May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: aggregate_id = self._get_aggregate_id(event.segment_id) May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: aggregate_uuid = self.p_client.list_aggregates( May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: return f(self, *a, **k) May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: return self._get(url).json() May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: return self._client.get(url, endpoint_filter=self._ks_filter, May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: return self.request(url, 'GET', **kwargs) May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: base_url = self.get_endpoint(auth, allow=allow, May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: auth = self._auth_required(auth, 'determine endpoint URL') May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 12 16:34:38.687022 n-d-841483-1 neutron-server[88151]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 12 16:34:38.763100 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3565669', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3874107', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3769159'] for network, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:38.779664 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Notify callbacks [] for network, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:38.791768 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] Pushing event deleted for resources: {'Network': ['ID=c2cf2b76-ee93-4846-9103-01cfe75f0997,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:38.796450 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-2d92a373-6084-4155-8d40-c86a56963654 admin admin] 10.222.0.82 "DELETE /v2.0/networks/c2cf2b76-ee93-4846-9103-01cfe75f0997 HTTP/1.1" status: 204 len: 168 time: 1.0351210 May 12 16:34:38.907211 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58166) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:38.954119 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-369d76ca-8526-4edd-a3c2-61559ee91fc3 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=db6d55e7484248b38b40fa3b29a09ab9&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0457580 May 12 16:34:38.956842 n-d-841483-1 neutron-server[88152]: DEBUG neutron.wsgi [-] (88152) accepted ('10.222.0.82', 58170) {{(pid=88152) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:38.992632 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-65717108-3815-4f63-81e9-802f675c308e None None] Deleting port 7c5235c1-d3dc-4355-820b-580975c0a590 {{(pid=88153) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1915}} May 12 16:34:38.993173 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-65717108-3815-4f63-81e9-802f675c308e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8768026821928'] for port, before_delete {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:39.014641 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c88bd628-dd42-4c98-847c-cea6fee6b5ac admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:39.040416 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c88bd628-dd42-4c98-847c-cea6fee6b5ac admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:39.061416 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-65717108-3815-4f63-81e9-802f675c308e None None] The port '7c5235c1-d3dc-4355-820b-580975c0a590' was deleted {{(pid=88153) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1945}} May 12 16:34:39.095162 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c88bd628-dd42-4c98-847c-cea6fee6b5ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:39.113473 n-d-841483-1 neutron-server[88152]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c88bd628-dd42-4c98-847c-cea6fee6b5ac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=29b923d2-1938-4f87-a21a-4240d2bd6aac,revision_number=None']} {{(pid=88152) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:39.120192 n-d-841483-1 neutron-server[88152]: DEBUG neutron_lib.callbacks.manager [None req-c88bd628-dd42-4c98-847c-cea6fee6b5ac admin admin] Notify callbacks [] for security_group, before_response {{(pid=88152) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:39.121305 n-d-841483-1 neutron-server[88152]: INFO neutron.wsgi [None req-c88bd628-dd42-4c98-847c-cea6fee6b5ac admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/29b923d2-1938-4f87-a21a-4240d2bd6aac HTTP/1.1" status: 204 len: 168 time: 0.1634712 May 12 16:34:39.148058 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7c5235c1-d3dc-4355-820b-580975c0a590 no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:34:39.181935 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 7c5235c1-d3dc-4355-820b-580975c0a590 {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:34:39.182273 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 7c5235c1-d3dc-4355-820b-580975c0a590 not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:34:39.182693 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0118baeb-6e90-4fdc-98b7-afd4a0deba2f no longer exists at agent ovs-agent-n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 12 16:34:39.218802 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.plugin [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] No Port match for: 0118baeb-6e90-4fdc-98b7-afd4a0deba2f {{(pid=88153) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2241}} May 12 16:34:39.219146 n-d-841483-1 neutron-server[88153]: DEBUG neutron.plugins.ml2.rpc [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Device 0118baeb-6e90-4fdc-98b7-afd4a0deba2f not bound to the agent host n-d-841483-1 {{(pid=88153) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 12 16:34:39.477511 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58178) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:39.525819 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-53bb1a33-ee4f-4003-b4a6-11493c46d5b1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1964d6d2e49246c5a8ab5ba8bd039d1c&name=default HTTP/1.1" status: 200 len: 2983 time: 0.0471675 May 12 16:34:39.528183 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [-] (88151) accepted ('10.222.0.82', 58182) {{(pid=88151) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 12 16:34:39.585779 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3073b182-f857-40b2-9286-ef1202d24322 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:39.610939 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3073b182-f857-40b2-9286-ef1202d24322 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:39.665197 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3073b182-f857-40b2-9286-ef1202d24322 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3758456'] for security_group, after_delete {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:39.680726 n-d-841483-1 neutron-server[88151]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3073b182-f857-40b2-9286-ef1202d24322 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c41ef342-855d-457e-9c0a-f1991a5af7f6,revision_number=None']} {{(pid=88151) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 12 16:34:39.685029 n-d-841483-1 neutron-server[88151]: DEBUG neutron_lib.callbacks.manager [None req-3073b182-f857-40b2-9286-ef1202d24322 admin admin] Notify callbacks [] for security_group, before_response {{(pid=88151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:39.689621 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [None req-3073b182-f857-40b2-9286-ef1202d24322 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c41ef342-855d-457e-9c0a-f1991a5af7f6 HTTP/1.1" status: 204 len: 168 time: 0.1571116 May 12 16:34:42.953226 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-47714208-3434-44e1-81ed-ad94959454a7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:44.040412 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:45.487000 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e2b8db8a-e81e-441f-8e50-0f325263e33f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:46.226388 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:46.527462 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:48.011494 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:34:57.280962 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58ebfe0a-ffed-498f-b57f-abc48e8c16e0 req-27d61e25-1783-4a81-a59d-d7f92860f2f1 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0414617 May 12 16:34:57.389972 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58ebfe0a-ffed-498f-b57f-abc48e8c16e0 req-c6d567a0-b933-4687-bf2c-36b3945bc2d2 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0416226 May 12 16:34:57.432897 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58ebfe0a-ffed-498f-b57f-abc48e8c16e0 req-3daa6cff-fe6b-4e00-8bf6-0b8c356960e1 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0251055 May 12 16:34:57.569163 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58ebfe0a-ffed-498f-b57f-abc48e8c16e0 req-d1f4228b-04f8-4421-b86e-9a69ace6476c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:34:57.570630 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-58ebfe0a-ffed-498f-b57f-abc48e8c16e0 req-d1f4228b-04f8-4421-b86e-9a69ace6476c service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1323011 May 12 16:35:03.170903 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:35:12.956084 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-9e02e804-15ea-4391-bb1e-f75dd5da57b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:35:13.959407 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:35:14.051969 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:35:15.490537 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-04d10ecf-737f-40e1-87d6-a6c28e763677 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:35:16.220961 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:35:16.531263 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:35:18.013270 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:35:33.166879 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:35:42.958034 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-fd8a1a02-014d-403a-9354-8d8f51640a45 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:35:44.052231 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:35:45.493121 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-3813c235-9ce7-4948-99ee-2769634e5326 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:35:46.224653 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:35:46.532244 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:35:48.015111 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:35:50.960927 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:35:59.235444 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6137cef-68bc-49ee-89be-e0e9a08bf93a req-612fd8d6-c7d8-4353-a82f-cb36241d0813 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0450323 May 12 16:35:59.344750 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6137cef-68bc-49ee-89be-e0e9a08bf93a req-e599d05e-dbea-4d42-95fb-d812d25f6f79 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0419850 May 12 16:35:59.389317 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6137cef-68bc-49ee-89be-e0e9a08bf93a req-ac80b6da-247c-4c41-987d-86f497cbd71f service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0262921 May 12 16:35:59.528019 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6137cef-68bc-49ee-89be-e0e9a08bf93a req-e5a8631b-3f12-4f5d-a1a2-3ca808422d98 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:35:59.529478 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-c6137cef-68bc-49ee-89be-e0e9a08bf93a req-e5a8631b-3f12-4f5d-a1a2-3ca808422d98 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1353464 May 12 16:36:03.175213 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:36:12.959707 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-d10ee9a8-43c9-4580-9fe0-f07b0ea5edaf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:36:14.069995 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:36:15.497615 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-f0742582-c327-443a-a2e4-07e5bb903f20 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:36:16.228088 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:36:16.537739 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:36:18.058842 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:36:27.963668 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:36:33.170104 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:36:42.961880 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-414e83aa-d271-4294-b8a3-7be76dfee48f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:36:44.066068 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:36:45.498582 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e7af6e74-bfbc-477f-bff0-1bb0ff81197d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:36:46.231271 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:36:46.537616 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:36:48.021560 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:37:00.226987 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-57736f5b-cba7-463c-8d07-854ba4b0a540 req-cb2af458-747f-4922-b0df-efe12e8e501b service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0454345 May 12 16:37:00.332888 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-57736f5b-cba7-463c-8d07-854ba4b0a540 req-85133836-062a-413c-9269-0b18a11e0277 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0403426 May 12 16:37:00.376485 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-57736f5b-cba7-463c-8d07-854ba4b0a540 req-ed5134be-6050-42f1-ac36-0f18a8d891ef service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0252409 May 12 16:37:00.514823 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57736f5b-cba7-463c-8d07-854ba4b0a540 req-e1a89eaf-afac-4731-9bc3-9e28fc7b4b48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:37:00.516176 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-57736f5b-cba7-463c-8d07-854ba4b0a540 req-e1a89eaf-afac-4731-9bc3-9e28fc7b4b48 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1339536 May 12 16:37:03.180068 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:37:04.963129 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:37:12.963886 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-62c16380-866a-4739-9832-c89d4b59b148 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:37:14.080663 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:37:15.500258 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-29795c77-c8e4-4be4-a452-194a9dda01e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:37:16.234189 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:37:16.541195 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:37:18.023967 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:37:33.195976 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:37:41.963065 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:37:42.966615 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e4c36872-7e02-45fe-a2fb-31376a08fe36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:37:44.080617 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:37:45.504835 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-531bd1f8-fb1c-4934-bad8-aa3683fd06bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:37:46.236650 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:37:46.544314 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:37:48.026847 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:01.233962 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60cbd1b1-b4bd-451d-ae06-b126e37a08f1 req-b0961349-8203-4df5-a4aa-dc33e4d9801d service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0473306 May 12 16:38:01.343838 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60cbd1b1-b4bd-451d-ae06-b126e37a08f1 req-3210483d-5f88-45f7-9bfa-987ddc5b06d8 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0416996 May 12 16:38:01.386909 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60cbd1b1-b4bd-451d-ae06-b126e37a08f1 req-fe03c168-04f6-441a-8a88-0de38e26deab service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0251541 May 12 16:38:01.522589 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60cbd1b1-b4bd-451d-ae06-b126e37a08f1 req-7796744e-e332-40cc-ba77-f66e8aba39b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:38:01.524020 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-60cbd1b1-b4bd-451d-ae06-b126e37a08f1 req-7796744e-e332-40cc-ba77-f66e8aba39b5 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1315701 May 12 16:38:03.210921 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:12.969519 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b9f72a24-8f1e-441f-b2e4-64590b8044f3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:14.091000 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:15.506721 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7273cf36-8343-497d-b2ee-28bb993a83da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:16.240566 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:16.546536 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:18.028902 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:18.962434 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:38:33.209150 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:42.971547 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21bef0c7-0229-4200-8a21-dbe712b3e860 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:44.079055 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:45.509980 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-e4bc57ec-d416-4305-81c9-e08f461a7fb3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:46.243255 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:46.549974 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:48.032337 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:38:55.962605 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:39:02.339580 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a4d77e4d-9827-4c4c-b0ac-82fffb16c8a1 req-bb681f79-018c-4f53-8924-4c02a5347cce service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.1552110 May 12 16:39:02.452619 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a4d77e4d-9827-4c4c-b0ac-82fffb16c8a1 req-d664e644-cc52-478c-a0fd-a653affe72e7 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0449102 May 12 16:39:02.496938 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a4d77e4d-9827-4c4c-b0ac-82fffb16c8a1 req-2f9fe83c-8f93-4419-84fd-460b61737d6a service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0260274 May 12 16:39:02.629539 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4d77e4d-9827-4c4c-b0ac-82fffb16c8a1 req-8230bb08-d61f-4cc5-bf88-cec884537b93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:39:02.631583 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-a4d77e4d-9827-4c4c-b0ac-82fffb16c8a1 req-8230bb08-d61f-4cc5-bf88-cec884537b93 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1295402 May 12 16:39:03.207732 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:39:12.973332 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1c19fec0-503a-488a-8056-8cff2f4fbafa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:39:14.094245 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:39:15.511401 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-ce4e0f5f-c7ed-41d7-9f9b-3ef6f9d5c7e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:39:16.246420 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:39:16.552398 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:39:18.034071 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:39:32.963330 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:39:33.207739 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:39:42.975625 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-b2738d15-6e43-4c8b-b8b1-985442693c22 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:39:44.100263 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:39:45.513181 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-4a49c6dd-7e9d-4ac1-9b04-8d330954e416 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:39:46.248779 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:39:46.556448 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:39:48.037745 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:40:02.226679 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f62fafdf-be32-4d87-b0a7-c44a2f4fc843 req-100d94bb-899d-4d31-98e5-e8d7cba92aa3 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0429468 May 12 16:40:02.337331 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f62fafdf-be32-4d87-b0a7-c44a2f4fc843 req-a12a6f10-136a-4ab2-b568-76781861d3bc service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0445080 May 12 16:40:02.478453 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f62fafdf-be32-4d87-b0a7-c44a2f4fc843 req-42afc71b-399c-49f9-b50d-23ae686f290f service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1224246 May 12 16:40:02.610193 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f62fafdf-be32-4d87-b0a7-c44a2f4fc843 req-06e72fe8-21fd-4cf8-91cd-5a952dce085f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:40:02.611882 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-f62fafdf-be32-4d87-b0a7-c44a2f4fc843 req-06e72fe8-21fd-4cf8-91cd-5a952dce085f service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1279852 May 12 16:40:03.209603 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:40:09.963006 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:40:12.976234 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c04dbb67-e2ec-4bd9-a4a7-5b934a1cf9a0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:40:14.096778 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:40:15.515295 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c050432b-93ce-4353-a3eb-0815a2a9f792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:40:16.251814 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:40:16.557661 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:40:18.039782 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:40:33.205940 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:40:42.979081 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-a290d07e-a0ff-4188-b1c1-003fd9c6091d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:40:44.109157 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:40:45.517076 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-c76bd429-1adf-45a9-bb58-06c838569b64 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:40:46.254637 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:40:46.561158 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:40:46.963660 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:40:48.042756 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:41:03.205360 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:41:03.223243 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3c1b5f2-29be-4e5d-9c3c-94b8b7057198 req-87dbe867-4348-480e-8942-4db98058bbf2 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0415092 May 12 16:41:03.337679 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3c1b5f2-29be-4e5d-9c3c-94b8b7057198 req-66339e5b-2cc2-429c-bf0c-352b3dfe3bbf service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0440516 May 12 16:41:03.380947 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3c1b5f2-29be-4e5d-9c3c-94b8b7057198 req-202a43c3-b71d-4127-ab68-e85862e19116 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0250714 May 12 16:41:03.512913 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c1b5f2-29be-4e5d-9c3c-94b8b7057198 req-135b4e93-02d5-4a89-9187-3980e6dc9539 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:41:03.514364 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-e3c1b5f2-29be-4e5d-9c3c-94b8b7057198 req-135b4e93-02d5-4a89-9187-3980e6dc9539 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1284115 May 12 16:41:12.980737 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-be0bdcdb-7a76-470e-a12f-c9d6e56e6b29 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:41:14.115940 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:41:15.520226 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-25ac1ab4-b845-4b40-ac1d-9ef6a108a996 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:41:16.256997 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:41:16.564647 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:41:18.043820 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:41:23.964170 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:41:33.202921 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:41:42.982608 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-21b8871a-72b3-4c32-b691-c508e44b4a23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:41:44.123250 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:41:45.523323 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-6d29e5d9-699c-4fda-9646-0822706fd9a9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:41:46.258508 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:41:46.567596 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:41:48.046757 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:42:00.964420 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:42:03.205497 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:42:03.220529 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-36642360-8467-4f01-bfc1-983a3f84e1a3 req-7e1faf1c-1be5-4d12-97d0-eecb4b440055 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0410028 May 12 16:42:03.339873 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-36642360-8467-4f01-bfc1-983a3f84e1a3 req-a0afbde3-8719-48bf-9de5-440048260063 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0406113 May 12 16:42:03.385604 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-36642360-8467-4f01-bfc1-983a3f84e1a3 req-4dcdee3d-3640-4b84-9162-a98aed26150b service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0276771 May 12 16:42:03.520722 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36642360-8467-4f01-bfc1-983a3f84e1a3 req-37fa7165-cde0-4f73-943f-e10830daba93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:42:03.522141 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-36642360-8467-4f01-bfc1-983a3f84e1a3 req-37fa7165-cde0-4f73-943f-e10830daba93 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1302836 May 12 16:42:12.984364 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-013f8b77-0521-4376-b3a9-9ec4243a507b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:42:14.124184 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:42:15.524402 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-1d5219f5-1b3a-4946-af6c-4b7ce6b177d6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:42:16.260814 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:42:16.570698 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:42:18.049346 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:42:33.203503 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:42:34.093462 n-d-841483-1 neutron-server[88151]: DEBUG neutron.wsgi [req-06c8cc00-9747-4c49-aa01-4c81006c66cd req-2be4d597-73a5-4709-ba88-120489556069 service neutron] (88151) timed out ('10.222.0.82', 55786) {{(pid=88151) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 12 16:42:37.964443 n-d-841483-1 neutron-server[88154]: DEBUG neutron.db.agents_db [None req-d0bf7ba4-4db2-4730-a7fb-bfe85126c0da None None] Agent healthcheck: found 7 active agents {{(pid=88154) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} May 12 16:42:42.985924 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-678afb56-b4b7-41a2-a439-b4867b8180a4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:42:44.142244 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bf2e25c5-707d-40ba-aeb4-4306627ff16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:42:45.566692 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-7e845e62-0bea-4a1b-abf3-f03e3036c283 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:42:46.264047 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-bc7a057f-5ae3-48e5-9a05-2f20d5f3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:42:46.573792 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-64ce7579-235a-479b-869c-24f7c55db458 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:42:48.051782 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-0b7d5238-ed52-46aa-be1b-f7ee41c62590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:43:03.232298 n-d-841483-1 neutron-server[88153]: DEBUG neutron_lib.callbacks.manager [None req-8e5f0ffe-8817-4c2c-bf06-f07a54df9311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8768026983024', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3565220'] for agent, after_update {{(pid=88153) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 12 16:43:04.221886 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4e3103e1-01f4-41ab-a3d5-3da88564647a req-579dfc13-b29c-4986-b2bf-3279abe47f27 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6a304fd0-80ef-4b27-86c5-a861e6627236&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0432324 May 12 16:43:04.329798 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4e3103e1-01f4-41ab-a3d5-3da88564647a req-71bfc518-b4ca-4112-beb3-509aca488d50 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=68c66ae0cd45476b87e2e79625b80f69&device_id=6a304fd0-80ef-4b27-86c5-a861e6627236 HTTP/1.1" status: 200 len: 210 time: 0.0405436 May 12 16:43:04.376393 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4e3103e1-01f4-41ab-a3d5-3da88564647a req-3be82596-49d3-41e5-b566-15815ce4cb57 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=68c66ae0cd45476b87e2e79625b80f69&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0292637 May 12 16:43:04.510393 n-d-841483-1 neutron-server[88151]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e3103e1-01f4-41ab-a3d5-3da88564647a req-17b9c955-1866-486c-aeea-a5d19348e571 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=88151) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:259}} May 12 16:43:04.511742 n-d-841483-1 neutron-server[88151]: INFO neutron.wsgi [req-4e3103e1-01f4-41ab-a3d5-3da88564647a req-17b9c955-1866-486c-aeea-a5d19348e571 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1299622